-- Logs begin at Sat 2022-08-27 01:52:05 UTC, end at Sat 2022-08-27 04:23:53 UTC. -- Aug 27 02:29:04.067599 n-d-852278-4 systemd[1]: Starting Devstack devstack@n-api.service... Aug 27 02:29:04.076683 n-d-852278-4 devstack@n-api.service[106580]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 27 02:29:04.078696 n-d-852278-4 devstack@n-api.service[106580]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Aug 27 02:29:04 2022] *** Aug 27 02:29:04.078696 n-d-852278-4 devstack@n-api.service[106580]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 27 02:29:04.078696 n-d-852278-4 devstack@n-api.service[106580]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 27 02:29:04.078696 n-d-852278-4 devstack@n-api.service[106580]: nodename: n-d-852278-4 Aug 27 02:29:04.078696 n-d-852278-4 devstack@n-api.service[106580]: machine: x86_64 Aug 27 02:29:04.078696 n-d-852278-4 devstack@n-api.service[106580]: clock source: unix Aug 27 02:29:04.078696 n-d-852278-4 devstack@n-api.service[106580]: pcre jit disabled Aug 27 02:29:04.078696 n-d-852278-4 devstack@n-api.service[106580]: detected number of CPU cores: 4 Aug 27 02:29:04.078696 n-d-852278-4 devstack@n-api.service[106580]: current working directory: / Aug 27 02:29:04.078696 n-d-852278-4 devstack@n-api.service[106580]: detected binary path: /usr/bin/uwsgi-core Aug 27 02:29:04.079400 n-d-852278-4 devstack@n-api.service[106580]: your processes number limit is 47680 Aug 27 02:29:04.079400 n-d-852278-4 devstack@n-api.service[106580]: your memory page size is 4096 bytes Aug 27 02:29:04.079400 n-d-852278-4 devstack@n-api.service[106580]: detected max file descriptor number: 2048 Aug 27 02:29:04.079400 n-d-852278-4 devstack@n-api.service[106580]: lock engine: pthread robust mutexes Aug 27 02:29:04.079400 n-d-852278-4 devstack@n-api.service[106580]: thunder lock: enabled Aug 27 02:29:04.079400 n-d-852278-4 devstack@n-api.service[106580]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 27 02:29:04.079400 n-d-852278-4 devstack@n-api.service[106580]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 27 02:29:04.118385 n-d-852278-4 devstack@n-api.service[106580]: Python main interpreter initialized at 0x5567792909c0 Aug 27 02:29:04.118385 n-d-852278-4 devstack@n-api.service[106580]: python threads support enabled Aug 27 02:29:04.118385 n-d-852278-4 devstack@n-api.service[106580]: your server socket listen backlog is limited to 100 connections Aug 27 02:29:04.118385 n-d-852278-4 devstack@n-api.service[106580]: your mercy for graceful operations on workers is 90 seconds Aug 27 02:29:04.118814 n-d-852278-4 devstack@n-api.service[106580]: mapped 403077 bytes (393 KB) for 2 cores Aug 27 02:29:04.118814 n-d-852278-4 devstack@n-api.service[106580]: *** Operational MODE: preforking *** Aug 27 02:29:04.119093 n-d-852278-4 devstack@n-api.service[106580]: *** uWSGI is running in multiple interpreter mode *** Aug 27 02:29:04.119093 n-d-852278-4 devstack@n-api.service[106580]: spawned uWSGI master process (pid: 106580) Aug 27 02:29:04.119302 n-d-852278-4 systemd[1]: Started Devstack devstack@n-api.service. Aug 27 02:29:04.121905 n-d-852278-4 devstack@n-api.service[106580]: spawned uWSGI worker 1 (pid: 106581, cores: 1) Aug 27 02:29:04.121905 n-d-852278-4 devstack@n-api.service[106580]: spawned uWSGI worker 2 (pid: 106582, cores: 1) Aug 27 02:29:04.121905 n-d-852278-4 devstack@n-api.service[106580]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 27 02:29:04.778982 n-d-852278-4 devstack@n-api.service[106581]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 27 02:29:04.779744 n-d-852278-4 devstack@n-api.service[106582]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 27 02:29:05.863074 n-d-852278-4 devstack@n-api.service[106582]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 02:29:05.863074 n-d-852278-4 devstack@n-api.service[106582]: from cryptography.utils import int_from_bytes Aug 27 02:29:05.863899 n-d-852278-4 devstack@n-api.service[106582]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 02:29:05.863899 n-d-852278-4 devstack@n-api.service[106582]: from cryptography.utils import int_from_bytes Aug 27 02:29:05.864883 n-d-852278-4 devstack@n-api.service[106581]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 02:29:05.864883 n-d-852278-4 devstack@n-api.service[106581]: from cryptography.utils import int_from_bytes Aug 27 02:29:05.865427 n-d-852278-4 devstack@n-api.service[106581]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 02:29:05.865427 n-d-852278-4 devstack@n-api.service[106581]: from cryptography.utils import int_from_bytes Aug 27 02:29:08.406197 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 27 02:29:08.406827 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 27 02:29:08.406975 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 27 02:29:08.407305 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 27 02:29:08.407610 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 27 02:29:08.407941 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.408631 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.408631 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.408959 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.409240 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.409573 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.409874 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.410221 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.410514 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.410783 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.410898 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 27 02:29:08.411274 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.411361 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 27 02:29:08.411438 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-852278-4 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.411691 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 27 02:29:08.411784 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.412030 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.412128 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 27 02:29:08.412329 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 27 02:29:08.412419 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.412732 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.412927 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.413075 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.413227 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.413428 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.413522 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.413691 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.413806 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.414086 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.414173 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.414464 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.415533 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.415644 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.415721 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.415787 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.415850 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.415914 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.415984 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.416061 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.416126 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.416189 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.416265 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.416364 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-852278-4 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.416449 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.416527 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.416833 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.416937 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.417147 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.417436 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.417534 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.417752 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.417983 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.418068 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.418351 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.418565 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-852278-4 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.418857 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.418952 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.419160 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.419253 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.419513 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.419592 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.419806 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.419938 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.420145 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.420280 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.420474 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.420661 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.420873 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.420983 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.421224 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.421324 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.421536 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.421634 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.421833 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.421998 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.422146 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.422267 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.422488 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.422588 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-852278-4 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.422818 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.422970 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.423144 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.423285 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.423431 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.423543 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.423683 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.423788 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.424017 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.424131 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.424301 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.424447 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.424645 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.424785 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.424896 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.425053 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.425175 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.425347 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.425490 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.425653 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.425862 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.426006 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.426521 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.426690 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.426835 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.426967 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.427052 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.427157 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.427284 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.427409 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.427505 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.427807 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.427913 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.428097 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.428194 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.428430 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.428521 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.428720 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.428977 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.429179 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.429331 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.429466 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.429593 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.429696 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.429833 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.429946 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.430030 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.430165 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.430350 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.430493 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.430592 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.430784 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.430869 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.430954 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.431185 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.431282 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.431500 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.431620 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.431806 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.431893 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.70 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.432103 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.432205 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.70 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.432428 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.432519 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.432735 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.432825 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.433029 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.433181 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.433328 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.433416 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.433627 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.433715 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.433935 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.434070 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.434209 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.434315 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.434542 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.434638 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.434843 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.434976 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.435119 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.435250 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.435478 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.435580 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.70 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.435762 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.70 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.435857 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.436022 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.436159 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.436396 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.436489 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.436662 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.436800 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.436969 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.437103 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.437275 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.437384 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.437594 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.437764 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.437921 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.438080 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.438191 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.438373 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.438500 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.438682 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.438821 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.438977 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.439118 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.439306 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.439446 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.439588 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.439720 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.439853 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.439976 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.440124 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.440256 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.440446 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.440560 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.440832 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.440940 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.441051 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.441146 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.441358 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.441453 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.441647 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.441770 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.441948 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.442045 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.442245 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.442354 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.442551 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.442649 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.442847 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.442941 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.443142 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.443237 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.443468 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.443572 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.443766 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.443897 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.444099 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.444201 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.444413 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.444620 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.444751 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.444843 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.445064 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.445302 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.445448 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.445679 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.445831 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.445984 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.447095 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.447292 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.447464 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.447634 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.447776 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.447893 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.448037 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.448170 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.448348 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.448520 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.448654 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.448807 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.448948 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.449065 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.449219 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.449458 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.449677 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.449879 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.450081 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.450291 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.450504 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.450731 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.450731 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.451137 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.451277 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.451424 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.451574 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.451736 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.451887 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.452023 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.452170 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.452306 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.452536 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.452685 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.452824 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.452969 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.453105 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.453257 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.453394 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.453584 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.453741 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.453888 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.454082 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.454241 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.454396 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.454549 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.454689 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.454832 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.454973 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.455125 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.455264 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.455403 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.455552 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.455706 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.455852 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.456011 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.456141 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.456399 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.456539 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.456700 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.456955 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.457091 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.457222 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:29:08.457358 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.457495 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.457632 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.457791 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.457928 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.458064 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.458211 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.458348 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.458484 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.458638 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.458778 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.458954 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.459105 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.459240 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.459392 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.459636 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.459800 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.459938 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.460076 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.460210 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.460428 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.460586 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.460723 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.460838 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.461032 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.461284 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.461428 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.461580 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.461718 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.461843 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.461968 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.462101 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.462254 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.462393 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.462540 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.462676 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.462813 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.462946 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.463095 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.463228 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.463361 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.463506 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.463643 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.463767 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.463916 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.464051 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.464250 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.464431 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.464596 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.464736 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.464888 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.465028 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.465166 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.465302 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.465438 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.465597 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.465742 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.465882 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.466026 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.466026 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.466290 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.466444 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.466585 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.466723 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.466855 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.467001 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.467140 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.467293 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.467437 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.467574 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.467661 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.467727 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.467830 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.467925 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.468139 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.468300 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.468510 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.468676 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.468835 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.469047 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.469202 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.469342 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.469479 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.469656 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.469817 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.469965 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.470101 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.470275 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.470431 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.470615 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.470833 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.471058 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.471200 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.471349 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.471497 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.471635 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.471785 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.471922 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.472068 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.472203 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.472385 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.472522 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.472682 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.472837 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.472976 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.473137 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.473297 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.473455 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.473593 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.473728 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.473928 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.474069 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.474204 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.474415 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.474597 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.474742 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.474880 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.475028 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.475165 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.475316 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.475455 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.475592 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.475730 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.475872 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.476012 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.476165 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.476298 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.476521 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.476660 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.476797 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.476957 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.477096 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.477246 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.477396 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.477536 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.477688 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.477826 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.477943 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.478058 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.478190 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.478343 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.478514 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.478776 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.478919 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.479059 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.479196 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.479331 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.479448 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.479597 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.479735 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.479849 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.479987 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.480125 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.480278 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.480449 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.480590 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.480748 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.480884 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.481002 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.481185 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.481317 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.481491 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.481633 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.481770 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.481899 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.482055 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.482200 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.482367 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.482507 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.482690 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.482827 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.483000 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.483149 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.483279 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.483421 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.483577 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.483726 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.483863 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.483998 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.484203 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.484396 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.484515 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.484647 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.484813 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.484953 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.485118 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.485262 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.485396 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.485555 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.485701 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.485838 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.485972 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.486101 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.486271 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.486418 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.486557 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.486694 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.486844 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.486981 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.487133 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.487269 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.487415 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.487557 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.487691 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.487876 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.488029 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.488193 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.488377 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.488520 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.488655 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.488836 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.488999 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.489141 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.489281 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.489454 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.489568 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.489771 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.489864 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.490105 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.490229 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.490463 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.490572 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.490791 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.490930 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.491098 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.491246 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.491450 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.491564 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.491709 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.491838 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.492019 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.492161 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.492388 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.492570 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.492677 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.492759 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.492957 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.493041 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.493267 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.493384 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.493571 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.493686 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.493873 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.494000 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.494188 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.494273 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.494490 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.494622 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.494801 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.494884 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.495097 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.495194 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.495407 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.495494 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.495727 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.495818 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.496036 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.496140 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.496368 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.496494 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.496684 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.496768 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.496998 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.497113 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.497301 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.497411 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.497616 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.497811 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.497926 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.498022 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.498206 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.498312 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.498511 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.498620 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.498826 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.499089 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.499324 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.499757 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.500016 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.500200 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.500605 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.500746 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.500891 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.501017 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.501148 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.501291 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.501423 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.501613 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.501768 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.501898 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.502029 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.502148 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.502277 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.502401 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.502520 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.502642 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.502764 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.502909 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.503041 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.503172 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.503307 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.503443 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.503580 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.503726 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.503821 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.503907 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.503985 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.504069 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.504154 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.504242 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.504392 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.504523 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.504654 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.504833 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.504962 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.505138 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.505271 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.505443 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.505576 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.505777 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.505911 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.506125 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.506213 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.506441 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.506530 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.506746 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.506917 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.507068 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.507207 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.507360 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.507452 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.507669 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.507774 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.507986 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.508089 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.508282 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.508420 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.508621 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.508715 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.508940 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.509044 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.509233 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.509318 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.509531 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.509654 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.509847 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.509933 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.510150 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.510275 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.510453 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.510593 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.510748 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.510842 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.511044 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.511129 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.511381 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.511510 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.511686 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.511771 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.511983 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.512075 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.512282 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.512434 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.512617 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.512712 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.512927 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.513011 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.513313 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.513514 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.513611 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.513850 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.513943 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.514166 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.514252 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.514483 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.514610 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.514788 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.514912 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.515093 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.515178 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.515396 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.515490 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.515699 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.515783 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.516003 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.516100 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.516475 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.516819 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.516819 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.517320 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.517392 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.517472 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.517559 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.517638 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.517710 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.517775 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.517855 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.517975 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.518114 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.518288 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.518422 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.518731 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.518963 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.519116 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.519244 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.519364 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.519495 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.519643 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.519894 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.520207 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.520543 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.520672 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.520859 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.521005 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.521157 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.521352 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.521526 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.521711 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.521947 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.522047 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.522134 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.523085 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.523354 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.523447 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.523526 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.523604 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.523669 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.524610 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.524778 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.524910 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.525098 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.525252 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.525400 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.525551 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.525672 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.525756 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.525834 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.525900 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.525974 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.526052 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.526129 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.526205 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.526290 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.526390 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.526479 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.526558 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.526634 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.526711 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.526788 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.526871 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.526871 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.527033 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.527111 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.527187 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.527274 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.527358 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.527535 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.527677 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.527846 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.527986 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.528145 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.528294 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.528480 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.528600 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.528746 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.528833 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.529046 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.529217 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.529360 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.529448 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.529668 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.529754 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.529974 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.530077 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.530276 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.530418 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.530588 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.530698 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.530880 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.530991 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.531182 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.531306 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.531474 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.531565 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.531776 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.531907 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.532134 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.532228 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.532383 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.532489 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.532687 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.532877 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.532971 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.533040 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.533272 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.533359 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.533578 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.533668 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.533879 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.533994 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.534180 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.534278 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.534501 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.534733 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.534831 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.534999 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.535164 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.535375 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.535487 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.535605 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.535715 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.535840 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.535966 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.536142 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.536283 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.536461 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.536614 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.536765 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.536930 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.537092 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.537260 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.537388 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.537572 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.537690 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.537876 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.537987 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.538181 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.538325 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.538485 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.538580 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.538793 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.538879 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.539095 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.539178 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.539399 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.539535 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.539703 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.539850 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.540004 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.540132 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.540342 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.540486 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.540657 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.540804 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.540967 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.541095 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.541272 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.541399 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.541576 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.541711 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.541877 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.542020 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.542209 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.542345 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.542515 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.542644 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.542834 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.542975 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.543145 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.543280 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.543446 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.543574 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.543755 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.543881 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.544053 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.544188 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.544373 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.544504 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.544673 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.544799 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.545044 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.545187 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.545276 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.545343 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.545538 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.545677 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.545835 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.545962 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.546133 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.546259 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.546428 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.546562 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.546745 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.546873 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.547045 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.547188 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.547345 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.547472 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.547646 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.547774 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.547943 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.548071 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.548276 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.548486 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.548626 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.548752 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.548886 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.549009 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.549191 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.549326 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.549502 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.549648 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.549811 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.549948 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.550119 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.550215 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.550425 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.550513 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.550731 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.550817 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.551025 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.551466 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.551638 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.551728 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.551943 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.552097 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.552254 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.552505 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.552719 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.552871 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.553013 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.553154 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.553311 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.553443 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.553592 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.553682 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.553875 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.554020 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.554160 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.554259 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.554489 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.554622 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.554793 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.554974 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.555139 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.555271 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.555444 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.555532 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.555812 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.555947 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.556081 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.556194 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.556439 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.556574 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.556739 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.556890 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.557014 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.557106 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.557325 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.557416 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.557629 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.557751 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.557923 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.558065 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.558202 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.558342 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.558512 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.558673 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.558817 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.558914 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.559113 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.559202 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.559410 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.559615 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.559697 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.559796 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.560014 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.560198 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.560434 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.560527 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.560739 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.560833 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.561045 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.561130 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.561350 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.561435 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.561656 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.561831 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.561975 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.562280 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.562429 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.562598 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.562726 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.562957 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.563083 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.563257 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.563395 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.563570 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.563699 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.563874 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.564014 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.564183 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.564384 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.564514 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.564641 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.564801 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.564929 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.565215 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.565350 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.565520 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.565607 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.565824 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.565926 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.566127 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.566239 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.566431 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.566547 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.566761 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.566910 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.567064 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.567210 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.567371 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.567529 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.567698 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.567860 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.568004 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.568146 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.568396 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.568558 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.568702 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.568937 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.569090 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.569244 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.569386 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.569566 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.569709 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.569975 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.570125 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.570391 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.570533 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.570675 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.570818 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.570959 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.571103 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.571263 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.571367 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.571507 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.571647 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.571788 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.571930 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.572122 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.572294 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.572512 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.572653 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.572791 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.572949 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.573093 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.573252 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.573354 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.573435 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.573544 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.573696 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.573841 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.573934 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.574161 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.574320 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.574457 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.574606 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.574822 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.574980 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.575123 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.575306 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.575468 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.575711 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.575890 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.576020 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.576171 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.576410 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.576581 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.576725 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.576861 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.576994 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.577119 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.577236 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.577518 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.577700 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.577816 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.577900 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.578121 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.578289 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.578453 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.578554 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.578775 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.578952 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.579072 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.579215 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.579366 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.579453 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.579679 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.579865 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.579963 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.580056 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.580285 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.580475 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.580656 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.580790 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.580955 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.581075 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.581276 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.581375 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.581615 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.581773 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.581903 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.582044 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.582215 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.582368 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.582475 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.582601 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.582770 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.582889 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.583095 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.583230 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.583373 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.583485 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.583705 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.583908 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.584046 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.584157 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.584366 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.584514 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.584628 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.584822 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.584967 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.585078 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.585254 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.585401 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.585620 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.585772 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.585931 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.586013 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.586181 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.586371 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.586517 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.586624 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.586743 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.586897 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.587115 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.587263 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.587412 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.587506 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.587732 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.587823 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.588043 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.588144 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.588385 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.588547 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.588694 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.588843 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.589018 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.589185 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.589336 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.589477 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.589657 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.589751 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.589962 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.590073 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.590275 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.590421 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.590559 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.590699 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.590840 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.590929 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.591152 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.591249 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.591442 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.591536 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.591739 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.591834 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.592040 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.592391 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.592539 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.592691 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.592923 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.593117 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.593261 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.593438 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.593583 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.593755 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.593928 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.594068 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.594210 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.594355 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.594498 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.594654 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.594797 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.594968 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.595116 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.595280 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.595427 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.595581 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.595789 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.595932 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.596109 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.596233 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.596396 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.596558 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.596690 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.596884 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.597030 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.597199 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.597359 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.597523 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.597735 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.597882 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.598015 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.598157 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.598310 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.598448 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.598598 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.598741 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.598886 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.599039 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.599294 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.599440 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.599616 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.599757 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.599925 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.600140 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.600285 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.600455 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.600599 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.600739 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.600877 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.601035 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.601176 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.601330 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.601481 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.601619 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.601760 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.601912 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.602067 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.602302 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.602446 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.602569 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.602730 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.602924 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.603070 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.603207 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.603344 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.603483 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.603641 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.603916 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.604064 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.604230 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.604448 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.604784 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.604954 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.605105 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.605228 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.605446 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.605609 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.605762 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.605939 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.606067 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.606193 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.606396 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.606572 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.606732 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.606910 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.607055 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.607203 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.607455 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.607602 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.607840 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.607985 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.608175 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.608459 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.608605 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.608773 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.608906 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.609034 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.609154 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.609290 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.609428 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.609580 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.609734 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.609886 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.610025 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.610172 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.610299 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.610443 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.610584 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.610721 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.610869 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.611022 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.611174 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.611317 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.611460 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.611616 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.611759 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.611898 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.612048 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.612186 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.612415 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.612568 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.612691 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.612992 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.613215 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.613357 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.613502 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.613641 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.613800 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.613938 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.614088 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.614225 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.614362 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.614490 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.614625 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.614770 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.614899 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.615068 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.615294 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.615478 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.615667 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.615823 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.615966 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.616090 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.616267 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.616494 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.616657 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.616823 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.616962 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.617101 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.617241 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.617393 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.617529 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.617684 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.617837 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.617979 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.618117 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.618256 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.618412 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.618554 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.618752 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.618900 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.619108 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.619242 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.619399 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.619539 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.619684 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.619837 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.619975 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.620108 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.620260 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.620503 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.620641 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.620780 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.620935 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.621075 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.621230 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.621367 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.621505 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.621642 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.621789 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.621938 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.622086 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.622227 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.622370 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.622509 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.622688 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.622838 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.622979 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.623122 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.623338 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.623489 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.623643 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.623793 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.623933 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.624076 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.624225 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.624400 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.624606 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.624811 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.624982 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.625127 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.625264 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.625449 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.625614 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.625787 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.625941 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.626120 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.626265 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.626408 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.626561 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.626686 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.626824 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.626992 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.627149 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.627287 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.627436 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.627587 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.627730 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.627878 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.628031 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.628184 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.628529 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.628675 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.628814 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.628981 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.629133 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.629282 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.629423 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.629563 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.629722 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.629864 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.629998 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.630149 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.630316 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.630460 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.630588 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.630733 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.630870 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.631015 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.631215 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.631364 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.631522 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.631663 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.631816 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.631953 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.632089 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.632222 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.632400 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.632539 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.632715 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.632867 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.633046 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.633233 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.633441 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.633585 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.633732 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.633879 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.634029 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.634225 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.634368 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.634515 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.634667 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.634806 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.634944 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.635081 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.635218 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.635373 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.635517 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.635657 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.635797 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.635936 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.636134 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.636457 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.636607 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.636802 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.636946 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.637109 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.637266 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.637425 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.637565 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.637704 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.637704 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.637978 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.638129 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.638266 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.638476 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.638632 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.638632 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.638906 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.639066 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.639212 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.639352 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.639498 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.639639 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.639780 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.639944 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.640144 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.640299 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.640485 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.640632 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.640772 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.640908 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.641081 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.641227 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.641396 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.641542 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.641702 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.641845 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.642012 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.642154 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.642298 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.642445 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.642602 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.642740 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.642907 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.643048 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.643193 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.643313 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.643500 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.643633 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.643806 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.643962 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.644126 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.644284 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.644544 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.644771 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.644913 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.645057 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.645194 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.645352 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.645493 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.645629 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.645768 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.645906 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.646043 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.646208 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.646413 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.646555 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.646678 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.646823 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.647034 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.647181 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.647327 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.647473 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.647713 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.647871 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.648029 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.648169 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.648382 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.648552 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.648709 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.648861 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.649018 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.649157 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.649332 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.649480 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.649624 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.649776 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.649975 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.650122 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.650266 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.650422 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.650566 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.650735 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.650876 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.651004 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.651130 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.651270 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.651418 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.651572 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.651716 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.651858 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.652002 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.652144 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.652302 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.652517 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.652658 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.652795 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.652914 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.653114 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.653277 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.653423 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.653570 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.653710 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.653834 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.653974 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.654131 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.654274 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.654415 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.654556 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.654693 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.654784 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.654862 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.655084 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.655231 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.655397 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.655545 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.655713 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.655844 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.656027 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.656144 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.656462 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.656564 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.656716 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.656787 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.656983 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.657147 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.657303 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.657481 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.657645 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.657804 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.657963 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.658108 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.658251 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.658393 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.658550 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.658692 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.658833 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.658975 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.659117 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.659281 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.659401 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.659485 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.659704 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.659790 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.660030 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.660127 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.660375 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.660486 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.660703 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.660842 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.661038 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.661223 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.661370 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.661514 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.661685 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.661822 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.662061 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.662174 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.662393 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.662674 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.662764 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.663001 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.663146 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.663306 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.663382 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.663559 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 27 02:29:08.663763 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.663991 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.664286 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.664671 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.664992 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.668673 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.668673 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.668673 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.668673 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.668673 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.668673 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.668673 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.668673 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.669673 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.669673 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.669673 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.669673 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.669673 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.669673 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.669673 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.670482 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.670482 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.670482 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.670778 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.671089 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.671686 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.672134 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.672487 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.672795 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.673097 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:29:08.673338 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 27 02:29:08.818287 n-d-852278-4 devstack@n-api.service[106582]: INFO dbcounter [None req-23bf1ebf-2aeb-48ab-9fb3-9c20f2d9afbf None None] Registered counter for database nova_api Aug 27 02:29:08.829522 n-d-852278-4 devstack@n-api.service[106581]: INFO dbcounter [None req-0da528e9-a58f-41c8-b710-9ba805cb6dbd None None] Registered counter for database nova_api Aug 27 02:29:08.840648 n-d-852278-4 devstack@n-api.service[106582]: DEBUG oslo_db.sqlalchemy.engines [None req-23bf1ebf-2aeb-48ab-9fb3-9c20f2d9afbf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106582) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 02:29:08.848128 n-d-852278-4 devstack@n-api.service[106582]: DEBUG dbcounter [-] [106582] Writer thread running {{(pid=106582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 02:29:08.850699 n-d-852278-4 devstack@n-api.service[106581]: DEBUG oslo_db.sqlalchemy.engines [None req-0da528e9-a58f-41c8-b710-9ba805cb6dbd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106581) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 02:29:08.857643 n-d-852278-4 devstack@n-api.service[106581]: DEBUG dbcounter [-] [106581] Writer thread running {{(pid=106581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 02:29:08.905961 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.context [None req-23bf1ebf-2aeb-48ab-9fb3-9c20f2d9afbf None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9e3f7cc8-d9cf-4064-9831-4fdba8cfa839(cell1) {{(pid=106582) load_cells /opt/stack/nova/nova/context.py:464}} Aug 27 02:29:08.909995 n-d-852278-4 devstack@n-api.service[106582]: DEBUG oslo_concurrency.lockutils [None req-23bf1ebf-2aeb-48ab-9fb3-9c20f2d9afbf None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:08.910397 n-d-852278-4 devstack@n-api.service[106582]: DEBUG oslo_concurrency.lockutils [None req-23bf1ebf-2aeb-48ab-9fb3-9c20f2d9afbf None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:08.912000 n-d-852278-4 devstack@n-api.service[106582]: DEBUG oslo_concurrency.lockutils [None req-23bf1ebf-2aeb-48ab-9fb3-9c20f2d9afbf None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:08.912795 n-d-852278-4 devstack@n-api.service[106582]: DEBUG oslo_concurrency.lockutils [None req-23bf1ebf-2aeb-48ab-9fb3-9c20f2d9afbf None None] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:08.913235 n-d-852278-4 devstack@n-api.service[106582]: DEBUG oslo_concurrency.lockutils [None req-23bf1ebf-2aeb-48ab-9fb3-9c20f2d9afbf None None] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:08.915248 n-d-852278-4 devstack@n-api.service[106582]: DEBUG oslo_concurrency.lockutils [None req-23bf1ebf-2aeb-48ab-9fb3-9c20f2d9afbf None None] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:08.915856 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.context [None req-0da528e9-a58f-41c8-b710-9ba805cb6dbd None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9e3f7cc8-d9cf-4064-9831-4fdba8cfa839(cell1) {{(pid=106581) load_cells /opt/stack/nova/nova/context.py:464}} Aug 27 02:29:08.917330 n-d-852278-4 devstack@n-api.service[106582]: INFO dbcounter [None req-23bf1ebf-2aeb-48ab-9fb3-9c20f2d9afbf None None] Registered counter for database nova_cell0 Aug 27 02:29:08.920016 n-d-852278-4 devstack@n-api.service[106581]: DEBUG oslo_concurrency.lockutils [None req-0da528e9-a58f-41c8-b710-9ba805cb6dbd None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:08.920525 n-d-852278-4 devstack@n-api.service[106581]: DEBUG oslo_concurrency.lockutils [None req-0da528e9-a58f-41c8-b710-9ba805cb6dbd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:08.922251 n-d-852278-4 devstack@n-api.service[106582]: INFO dbcounter [None req-23bf1ebf-2aeb-48ab-9fb3-9c20f2d9afbf None None] Registered counter for database nova_cell1 Aug 27 02:29:08.922408 n-d-852278-4 devstack@n-api.service[106581]: DEBUG oslo_concurrency.lockutils [None req-0da528e9-a58f-41c8-b710-9ba805cb6dbd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:08.923291 n-d-852278-4 devstack@n-api.service[106581]: DEBUG oslo_concurrency.lockutils [None req-0da528e9-a58f-41c8-b710-9ba805cb6dbd None None] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:08.923737 n-d-852278-4 devstack@n-api.service[106581]: DEBUG oslo_concurrency.lockutils [None req-0da528e9-a58f-41c8-b710-9ba805cb6dbd None None] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:08.925905 n-d-852278-4 devstack@n-api.service[106581]: DEBUG oslo_concurrency.lockutils [None req-0da528e9-a58f-41c8-b710-9ba805cb6dbd None None] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:08.928392 n-d-852278-4 devstack@n-api.service[106581]: INFO dbcounter [None req-0da528e9-a58f-41c8-b710-9ba805cb6dbd None None] Registered counter for database nova_cell0 Aug 27 02:29:08.929779 n-d-852278-4 devstack@n-api.service[106582]: DEBUG oslo_db.sqlalchemy.engines [None req-23bf1ebf-2aeb-48ab-9fb3-9c20f2d9afbf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106582) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 02:29:08.931168 n-d-852278-4 devstack@n-api.service[106582]: DEBUG oslo_db.sqlalchemy.engines [None req-23bf1ebf-2aeb-48ab-9fb3-9c20f2d9afbf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106582) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 02:29:08.932791 n-d-852278-4 devstack@n-api.service[106581]: INFO dbcounter [None req-0da528e9-a58f-41c8-b710-9ba805cb6dbd None None] Registered counter for database nova_cell1 Aug 27 02:29:08.937936 n-d-852278-4 devstack@n-api.service[106582]: DEBUG dbcounter [-] [106582] Writer thread running {{(pid=106582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 02:29:08.939599 n-d-852278-4 devstack@n-api.service[106582]: DEBUG dbcounter [-] [106582] Writer thread running {{(pid=106582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 02:29:08.942413 n-d-852278-4 devstack@n-api.service[106581]: DEBUG oslo_db.sqlalchemy.engines [None req-0da528e9-a58f-41c8-b710-9ba805cb6dbd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106581) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 02:29:08.943774 n-d-852278-4 devstack@n-api.service[106581]: DEBUG oslo_db.sqlalchemy.engines [None req-0da528e9-a58f-41c8-b710-9ba805cb6dbd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106581) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 02:29:08.950155 n-d-852278-4 devstack@n-api.service[106581]: DEBUG dbcounter [-] [106581] Writer thread running {{(pid=106581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 02:29:08.951976 n-d-852278-4 devstack@n-api.service[106581]: DEBUG dbcounter [-] [106581] Writer thread running {{(pid=106581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 02:29:09.091567 n-d-852278-4 devstack@n-api.service[106582]: INFO dbcounter [None req-23bf1ebf-2aeb-48ab-9fb3-9c20f2d9afbf None None] Registered counter for database nova_cell0 Aug 27 02:29:09.098815 n-d-852278-4 devstack@n-api.service[106582]: DEBUG oslo_db.sqlalchemy.engines [None req-23bf1ebf-2aeb-48ab-9fb3-9c20f2d9afbf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106582) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 02:29:09.103516 n-d-852278-4 devstack@n-api.service[106582]: DEBUG dbcounter [-] [106582] Writer thread running {{(pid=106582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 02:29:09.106948 n-d-852278-4 devstack@n-api.service[106581]: INFO dbcounter [None req-0da528e9-a58f-41c8-b710-9ba805cb6dbd None None] Registered counter for database nova_cell0 Aug 27 02:29:09.117567 n-d-852278-4 devstack@n-api.service[106581]: DEBUG oslo_db.sqlalchemy.engines [None req-0da528e9-a58f-41c8-b710-9ba805cb6dbd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106581) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 02:29:09.122765 n-d-852278-4 devstack@n-api.service[106581]: DEBUG dbcounter [-] [106581] Writer thread running {{(pid=106581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 02:29:09.444185 n-d-852278-4 devstack@n-api.service[106582]: WARNING keystonemiddleware.auth_token [None req-23bf1ebf-2aeb-48ab-9fb3-9c20f2d9afbf None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 27 02:29:09.446111 n-d-852278-4 devstack@n-api.service[106581]: WARNING keystonemiddleware.auth_token [None req-0da528e9-a58f-41c8-b710-9ba805cb6dbd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 27 02:29:09.451780 n-d-852278-4 devstack@n-api.service[106582]: WARNING keystonemiddleware.auth_token [None req-23bf1ebf-2aeb-48ab-9fb3-9c20f2d9afbf None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 27 02:29:09.453944 n-d-852278-4 devstack@n-api.service[106581]: WARNING keystonemiddleware.auth_token [None req-0da528e9-a58f-41c8-b710-9ba805cb6dbd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 27 02:29:09.795447 n-d-852278-4 devstack@n-api.service[106581]: WARNING keystonemiddleware.auth_token [None req-0da528e9-a58f-41c8-b710-9ba805cb6dbd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 27 02:29:09.795897 n-d-852278-4 devstack@n-api.service[106582]: WARNING keystonemiddleware.auth_token [None req-23bf1ebf-2aeb-48ab-9fb3-9c20f2d9afbf None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 27 02:29:09.802634 n-d-852278-4 devstack@n-api.service[106582]: WARNING keystonemiddleware.auth_token [None req-23bf1ebf-2aeb-48ab-9fb3-9c20f2d9afbf None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 27 02:29:09.807803 n-d-852278-4 devstack@n-api.service[106582]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5567792909c0 pid: 106582 (default app) Aug 27 02:29:09.809961 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi [None req-23bf1ebf-2aeb-48ab-9fb3-9c20f2d9afbf None None] Calling method '>' {{(pid=106582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:09.810482 n-d-852278-4 devstack@n-api.service[106581]: WARNING keystonemiddleware.auth_token [None req-0da528e9-a58f-41c8-b710-9ba805cb6dbd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 27 02:29:09.811160 n-d-852278-4 devstack@n-api.service[106582]: INFO nova.api.openstack.requestlog [None req-23bf1ebf-2aeb-48ab-9fb3-9c20f2d9afbf None None] 10.222.0.70 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001810 Aug 27 02:29:09.811591 n-d-852278-4 devstack@n-api.service[106582]: [pid: 106582|app: 0|req: 1/1] 10.222.0.70 () {50 vars in 788 bytes} [Sat Aug 27 02:29:09 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:29:09.816072 n-d-852278-4 devstack@n-api.service[106581]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5567792909c0 pid: 106581 (default app) Aug 27 02:30:31.801800 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi [None req-23bf1ebf-2aeb-48ab-9fb3-9c20f2d9afbf None None] Calling method '>' {{(pid=106582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:31.803189 n-d-852278-4 devstack@n-api.service[106582]: INFO nova.api.openstack.requestlog [None req-23bf1ebf-2aeb-48ab-9fb3-9c20f2d9afbf None None] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001820 Aug 27 02:30:31.803780 n-d-852278-4 devstack@n-api.service[106582]: [pid: 106582|app: 0|req: 2/2] 10.222.0.70 () {54 vars in 931 bytes} [Sat Aug 27 02:30:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:30:31.816182 n-d-852278-4 devstack@n-api.service[106581]: DEBUG dbcounter [-] [106581] Writing DB stats nova_api:SELECT=3 {{(pid=106581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:30:31.817325 n-d-852278-4 devstack@n-api.service[106581]: DEBUG dbcounter [-] [106581] Writing DB stats nova_cell0:SELECT=3 {{(pid=106581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:30:31.818466 n-d-852278-4 devstack@n-api.service[106581]: DEBUG dbcounter [-] [106581] Writing DB stats nova_cell1:SELECT=3 {{(pid=106581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:30:31.819168 n-d-852278-4 devstack@n-api.service[106581]: DEBUG dbcounter [-] [106581] Writing DB stats nova_cell0:SELECT=3 {{(pid=106581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:30:32.713079 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi [None req-0940322f-ddfc-47af-a964-9dc63db219b3 admin admin] Calling method '>' {{(pid=106581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:32.747285 n-d-852278-4 devstack@n-api.service[106581]: INFO nova.api.openstack.requestlog [None req-0940322f-ddfc-47af-a964-9dc63db219b3 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.935865 Aug 27 02:30:32.748914 n-d-852278-4 devstack@n-api.service[106581]: [pid: 106581|app: 0|req: 1/3] 10.222.0.70 () {60 vars in 1292 bytes} [Sat Aug 27 02:30:31 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:30:35.093241 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi [None req-23bf1ebf-2aeb-48ab-9fb3-9c20f2d9afbf None None] Calling method '>' {{(pid=106582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:35.094188 n-d-852278-4 devstack@n-api.service[106582]: INFO nova.api.openstack.requestlog [None req-23bf1ebf-2aeb-48ab-9fb3-9c20f2d9afbf None None] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Aug 27 02:30:35.099695 n-d-852278-4 devstack@n-api.service[106582]: [pid: 106582|app: 0|req: 3/4] 10.222.0.70 () {54 vars in 931 bytes} [Sat Aug 27 02:30:35 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:30:35.566813 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi [None req-9790f6d5-9697-4a3d-80cc-0f461b42c597 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 1, "id": "c1", "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 256, "vcpus": 1}} {{(pid=106581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:30:35.628632 n-d-852278-4 devstack@n-api.service[106581]: INFO nova.api.openstack.requestlog [None req-9790f6d5-9697-4a3d-80cc-0f461b42c597 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.527657 Aug 27 02:30:35.643569 n-d-852278-4 devstack@n-api.service[106582]: DEBUG dbcounter [-] [106582] Writing DB stats nova_api:SELECT=3 {{(pid=106582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:30:35.644497 n-d-852278-4 devstack@n-api.service[106582]: DEBUG dbcounter [-] [106582] Writing DB stats nova_cell1:SELECT=3 {{(pid=106582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:30:35.645266 n-d-852278-4 devstack@n-api.service[106582]: DEBUG dbcounter [-] [106582] Writing DB stats nova_cell0:SELECT=3 {{(pid=106582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:30:35.645996 n-d-852278-4 devstack@n-api.service[106582]: DEBUG dbcounter [-] [106582] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:30:35.646900 n-d-852278-4 devstack@n-api.service[106581]: [pid: 106581|app: 0|req: 2/5] 10.222.0.70 () {64 vars in 1283 bytes} [Sat Aug 27 02:30:35 2022] POST /compute/v2.1/flavors => generated 407 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 02:30:35.901089 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi [None req-7f265bff-3da6-48d8-b9ab-d95e25943ccd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:30:35.971268 n-d-852278-4 devstack@n-api.service[106582]: INFO nova.api.openstack.requestlog [None req-7f265bff-3da6-48d8-b9ab-d95e25943ccd admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.332347 Aug 27 02:30:35.971648 n-d-852278-4 devstack@n-api.service[106582]: [pid: 106582|app: 0|req: 4/6] 10.222.0.70 () {64 vars in 1336 bytes} [Sat Aug 27 02:30:35 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:30:38.451098 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi [None req-9790f6d5-9697-4a3d-80cc-0f461b42c597 admin admin] Calling method '>' {{(pid=106581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:38.452176 n-d-852278-4 devstack@n-api.service[106581]: INFO nova.api.openstack.requestlog [None req-9790f6d5-9697-4a3d-80cc-0f461b42c597 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001676 Aug 27 02:30:38.454411 n-d-852278-4 devstack@n-api.service[106581]: [pid: 106581|app: 0|req: 3/7] 10.222.0.70 () {54 vars in 931 bytes} [Sat Aug 27 02:30:38 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:30:39.381952 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi [None req-8802efa6-a354-4d65-9cd2-c819d84c3f2a admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "rxtx_factor": 1.0, "vcpus": 1, "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "name": "ds512M", "disk": 5}} {{(pid=106582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:30:39.436127 n-d-852278-4 devstack@n-api.service[106582]: INFO nova.api.openstack.requestlog [None req-8802efa6-a354-4d65-9cd2-c819d84c3f2a admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.976080 Aug 27 02:30:39.444460 n-d-852278-4 devstack@n-api.service[106582]: [pid: 106582|app: 0|req: 5/8] 10.222.0.70 () {64 vars in 1283 bytes} [Sat Aug 27 02:30:38 2022] POST /compute/v2.1/flavors => generated 404 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:30:39.451936 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi [None req-2f384e92-e250-45e4-ae32-396219d6192e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:30:39.513860 n-d-852278-4 devstack@n-api.service[106581]: INFO nova.api.openstack.requestlog [None req-2f384e92-e250-45e4-ae32-396219d6192e admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.066021 Aug 27 02:30:39.514470 n-d-852278-4 devstack@n-api.service[106581]: [pid: 106581|app: 0|req: 4/9] 10.222.0.70 () {64 vars in 1336 bytes} [Sat Aug 27 02:30:39 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:30:42.350138 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi [None req-8802efa6-a354-4d65-9cd2-c819d84c3f2a admin admin] Calling method '>' {{(pid=106582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:42.351270 n-d-852278-4 devstack@n-api.service[106582]: INFO nova.api.openstack.requestlog [None req-8802efa6-a354-4d65-9cd2-c819d84c3f2a admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001733 Aug 27 02:30:42.351703 n-d-852278-4 devstack@n-api.service[106582]: [pid: 106582|app: 0|req: 6/10] 10.222.0.70 () {54 vars in 931 bytes} [Sat Aug 27 02:30:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:30:43.228169 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi [None req-57c96abf-5c78-47e8-9d5b-2648b8c31dd3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "ram": 1024, "disk": 10, "id": "d2", "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:30:43.252715 n-d-852278-4 devstack@n-api.service[106581]: INFO nova.api.openstack.requestlog [None req-57c96abf-5c78-47e8-9d5b-2648b8c31dd3 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.894305 Aug 27 02:30:43.253845 n-d-852278-4 devstack@n-api.service[106581]: [pid: 106581|app: 0|req: 5/11] 10.222.0.70 () {64 vars in 1283 bytes} [Sat Aug 27 02:30:42 2022] POST /compute/v2.1/flavors => generated 404 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:30:43.278676 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi [None req-562e402c-5322-46b1-a2c8-0e2ebfb66b40 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:30:43.317902 n-d-852278-4 devstack@n-api.service[106582]: INFO nova.api.openstack.requestlog [None req-562e402c-5322-46b1-a2c8-0e2ebfb66b40 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.048275 Aug 27 02:30:43.319381 n-d-852278-4 devstack@n-api.service[106582]: [pid: 106582|app: 0|req: 7/12] 10.222.0.70 () {64 vars in 1336 bytes} [Sat Aug 27 02:30:43 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:30:45.929386 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi [None req-57c96abf-5c78-47e8-9d5b-2648b8c31dd3 admin admin] Calling method '>' {{(pid=106581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:45.931988 n-d-852278-4 devstack@n-api.service[106581]: INFO nova.api.openstack.requestlog [None req-57c96abf-5c78-47e8-9d5b-2648b8c31dd3 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003164 Aug 27 02:30:45.933015 n-d-852278-4 devstack@n-api.service[106581]: [pid: 106581|app: 0|req: 6/13] 10.222.0.70 () {54 vars in 931 bytes} [Sat Aug 27 02:30:45 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:30:46.381962 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi [None req-ca8b985d-88cb-42c3-93e9-897e5d391ed9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "ram": 2048, "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "ds2G", "rxtx_factor": 1.0, "vcpus": 2, "swap": 0}} {{(pid=106582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:30:46.414764 n-d-852278-4 devstack@n-api.service[106582]: INFO nova.api.openstack.requestlog [None req-ca8b985d-88cb-42c3-93e9-897e5d391ed9 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.475827 Aug 27 02:30:46.420082 n-d-852278-4 devstack@n-api.service[106582]: [pid: 106582|app: 0|req: 8/14] 10.222.0.70 () {64 vars in 1283 bytes} [Sat Aug 27 02:30:45 2022] POST /compute/v2.1/flavors => generated 404 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:30:46.428508 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi [None req-c06b7a17-0508-4dd4-a50b-220652e441b8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:30:46.467550 n-d-852278-4 devstack@n-api.service[106581]: INFO nova.api.openstack.requestlog [None req-c06b7a17-0508-4dd4-a50b-220652e441b8 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043449 Aug 27 02:30:46.468661 n-d-852278-4 devstack@n-api.service[106581]: [pid: 106581|app: 0|req: 7/15] 10.222.0.70 () {64 vars in 1336 bytes} [Sat Aug 27 02:30:46 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:30:48.909085 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi [None req-ca8b985d-88cb-42c3-93e9-897e5d391ed9 admin admin] Calling method '>' {{(pid=106582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:48.910785 n-d-852278-4 devstack@n-api.service[106582]: INFO nova.api.openstack.requestlog [None req-ca8b985d-88cb-42c3-93e9-897e5d391ed9 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002217 Aug 27 02:30:48.928123 n-d-852278-4 devstack@n-api.service[106582]: [pid: 106582|app: 0|req: 9/16] 10.222.0.70 () {54 vars in 931 bytes} [Sat Aug 27 02:30:48 2022] GET /compute/v2.1 => generated 388 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:30:49.422245 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi [None req-c558aa05-f835-47af-a5f9-b7294b719aab admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "os-flavor-access:is_public": true, "swap": 0, "disk": 20, "ram": 4096, "name": "ds4G"}} {{(pid=106581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:30:49.453248 n-d-852278-4 devstack@n-api.service[106581]: INFO nova.api.openstack.requestlog [None req-c558aa05-f835-47af-a5f9-b7294b719aab admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.531167 Aug 27 02:30:49.454515 n-d-852278-4 devstack@n-api.service[106581]: [pid: 106581|app: 0|req: 8/17] 10.222.0.70 () {64 vars in 1283 bytes} [Sat Aug 27 02:30:48 2022] POST /compute/v2.1/flavors => generated 404 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:30:49.466947 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi [None req-be9e505f-f316-440b-8fc4-6e45b304735b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:30:49.493720 n-d-852278-4 devstack@n-api.service[106582]: INFO nova.api.openstack.requestlog [None req-be9e505f-f316-440b-8fc4-6e45b304735b admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030594 Aug 27 02:30:49.494675 n-d-852278-4 devstack@n-api.service[106582]: [pid: 106582|app: 0|req: 10/18] 10.222.0.70 () {64 vars in 1336 bytes} [Sat Aug 27 02:30:49 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:30:51.879667 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi [None req-c558aa05-f835-47af-a5f9-b7294b719aab admin admin] Calling method '>' {{(pid=106581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:51.881538 n-d-852278-4 devstack@n-api.service[106581]: INFO nova.api.openstack.requestlog [None req-c558aa05-f835-47af-a5f9-b7294b719aab admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002402 Aug 27 02:30:51.883034 n-d-852278-4 devstack@n-api.service[106581]: [pid: 106581|app: 0|req: 9/19] 10.222.0.70 () {54 vars in 931 bytes} [Sat Aug 27 02:30:51 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:30:52.425563 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi [None req-703a4de3-e905-480f-b14f-3f6a3632a22e admin admin] Calling method '>' {{(pid=106582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:52.452424 n-d-852278-4 devstack@n-api.service[106582]: INFO nova.api.openstack.requestlog [None req-703a4de3-e905-480f-b14f-3f6a3632a22e admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.563721 Aug 27 02:30:52.473565 n-d-852278-4 devstack@n-api.service[106582]: [pid: 106582|app: 0|req: 11/20] 10.222.0.70 () {60 vars in 1292 bytes} [Sat Aug 27 02:30:51 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:30:54.943050 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi [None req-c558aa05-f835-47af-a5f9-b7294b719aab admin admin] Calling method '>' {{(pid=106581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:54.944076 n-d-852278-4 devstack@n-api.service[106581]: INFO nova.api.openstack.requestlog [None req-c558aa05-f835-47af-a5f9-b7294b719aab admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 Aug 27 02:30:54.944749 n-d-852278-4 devstack@n-api.service[106581]: [pid: 106581|app: 0|req: 10/21] 10.222.0.70 () {54 vars in 931 bytes} [Sat Aug 27 02:30:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:30:55.406754 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi [None req-bf8bbe1c-c8e8-48dc-bc5b-31bf51103445 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "disk": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "m1.tiny", "vcpus": 1}} {{(pid=106582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:30:55.428772 n-d-852278-4 devstack@n-api.service[106582]: INFO nova.api.openstack.requestlog [None req-bf8bbe1c-c8e8-48dc-bc5b-31bf51103445 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.475781 Aug 27 02:30:55.429383 n-d-852278-4 devstack@n-api.service[106582]: [pid: 106582|app: 0|req: 12/22] 10.222.0.70 () {64 vars in 1283 bytes} [Sat Aug 27 02:30:54 2022] POST /compute/v2.1/flavors => generated 402 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:30:55.443741 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi [None req-3f7be809-9294-47e0-ae99-c354c70fd342 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:30:55.476128 n-d-852278-4 devstack@n-api.service[106581]: INFO nova.api.openstack.requestlog [None req-3f7be809-9294-47e0-ae99-c354c70fd342 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037271 Aug 27 02:30:55.477077 n-d-852278-4 devstack@n-api.service[106581]: [pid: 106581|app: 0|req: 11/23] 10.222.0.70 () {64 vars in 1333 bytes} [Sat Aug 27 02:30:55 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:30:58.021313 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi [None req-bf8bbe1c-c8e8-48dc-bc5b-31bf51103445 admin admin] Calling method '>' {{(pid=106582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:58.022503 n-d-852278-4 devstack@n-api.service[106582]: INFO nova.api.openstack.requestlog [None req-bf8bbe1c-c8e8-48dc-bc5b-31bf51103445 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001925 Aug 27 02:30:58.022964 n-d-852278-4 devstack@n-api.service[106582]: [pid: 106582|app: 0|req: 13/24] 10.222.0.70 () {54 vars in 931 bytes} [Sat Aug 27 02:30:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:30:58.522233 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi [None req-7cf0bbdd-2bfc-4e96-9aa9-124b351cf83a admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 1, "disk": 20, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "id": "2", "rxtx_factor": 1.0, "name": "m1.small"}} {{(pid=106581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:30:58.542743 n-d-852278-4 devstack@n-api.service[106581]: INFO nova.api.openstack.requestlog [None req-7cf0bbdd-2bfc-4e96-9aa9-124b351cf83a admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.512263 Aug 27 02:30:58.543314 n-d-852278-4 devstack@n-api.service[106581]: [pid: 106581|app: 0|req: 12/25] 10.222.0.70 () {64 vars in 1283 bytes} [Sat Aug 27 02:30:58 2022] POST /compute/v2.1/flavors => generated 405 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:30:58.556331 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi [None req-b70c45ef-4a6f-4342-8fbf-d84c0a769672 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:30:58.582396 n-d-852278-4 devstack@n-api.service[106582]: INFO nova.api.openstack.requestlog [None req-b70c45ef-4a6f-4342-8fbf-d84c0a769672 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030397 Aug 27 02:30:58.583021 n-d-852278-4 devstack@n-api.service[106582]: [pid: 106582|app: 0|req: 14/26] 10.222.0.70 () {64 vars in 1333 bytes} [Sat Aug 27 02:30:58 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:00.937043 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi [None req-7cf0bbdd-2bfc-4e96-9aa9-124b351cf83a admin admin] Calling method '>' {{(pid=106581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:00.938063 n-d-852278-4 devstack@n-api.service[106581]: INFO nova.api.openstack.requestlog [None req-7cf0bbdd-2bfc-4e96-9aa9-124b351cf83a admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001535 Aug 27 02:31:00.938469 n-d-852278-4 devstack@n-api.service[106581]: [pid: 106581|app: 0|req: 13/27] 10.222.0.70 () {54 vars in 931 bytes} [Sat Aug 27 02:31:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:31:01.371063 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi [None req-0e5a0b1e-36c2-41f3-8dac-32297a86b563 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "id": "3", "swap": 0, "disk": 40, "name": "m1.medium"}} {{(pid=106582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:31:01.391207 n-d-852278-4 devstack@n-api.service[106582]: INFO nova.api.openstack.requestlog [None req-0e5a0b1e-36c2-41f3-8dac-32297a86b563 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.446489 Aug 27 02:31:01.391760 n-d-852278-4 devstack@n-api.service[106582]: [pid: 106582|app: 0|req: 15/28] 10.222.0.70 () {64 vars in 1283 bytes} [Sat Aug 27 02:31:00 2022] POST /compute/v2.1/flavors => generated 406 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:31:01.404054 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi [None req-99a760ca-b42e-4fb2-be9b-f2c2c585b5ce admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:31:01.430644 n-d-852278-4 devstack@n-api.service[106581]: INFO nova.api.openstack.requestlog [None req-99a760ca-b42e-4fb2-be9b-f2c2c585b5ce admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030305 Aug 27 02:31:01.431360 n-d-852278-4 devstack@n-api.service[106581]: [pid: 106581|app: 0|req: 14/29] 10.222.0.70 () {64 vars in 1333 bytes} [Sat Aug 27 02:31:01 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:03.836434 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi [None req-0e5a0b1e-36c2-41f3-8dac-32297a86b563 admin admin] Calling method '>' {{(pid=106582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:03.838069 n-d-852278-4 devstack@n-api.service[106582]: INFO nova.api.openstack.requestlog [None req-0e5a0b1e-36c2-41f3-8dac-32297a86b563 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002140 Aug 27 02:31:03.838447 n-d-852278-4 devstack@n-api.service[106582]: [pid: 106582|app: 0|req: 16/30] 10.222.0.70 () {54 vars in 931 bytes} [Sat Aug 27 02:31:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:31:04.287992 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi [None req-3d3d9092-f496-4cff-b3a1-f2515fae5ef6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "4", "os-flavor-access:is_public": true, "name": "m1.large", "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 4, "disk": 80}} {{(pid=106581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:31:04.296821 n-d-852278-4 devstack@n-api.service[106581]: DEBUG dbcounter [-] [106581] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=106581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:31:04.310152 n-d-852278-4 devstack@n-api.service[106581]: INFO nova.api.openstack.requestlog [None req-3d3d9092-f496-4cff-b3a1-f2515fae5ef6 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.465151 Aug 27 02:31:04.311199 n-d-852278-4 devstack@n-api.service[106581]: [pid: 106581|app: 0|req: 15/31] 10.222.0.70 () {64 vars in 1283 bytes} [Sat Aug 27 02:31:03 2022] POST /compute/v2.1/flavors => generated 405 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:31:04.323747 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi [None req-2d3a4150-5812-4f78-ac3d-0bbd6a9642ca admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:31:04.352704 n-d-852278-4 devstack@n-api.service[106582]: INFO nova.api.openstack.requestlog [None req-2d3a4150-5812-4f78-ac3d-0bbd6a9642ca admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032659 Aug 27 02:31:04.353593 n-d-852278-4 devstack@n-api.service[106582]: [pid: 106582|app: 0|req: 17/32] 10.222.0.70 () {64 vars in 1333 bytes} [Sat Aug 27 02:31:04 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:06.761102 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi [None req-3d3d9092-f496-4cff-b3a1-f2515fae5ef6 admin admin] Calling method '>' {{(pid=106581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:06.762838 n-d-852278-4 devstack@n-api.service[106581]: INFO nova.api.openstack.requestlog [None req-3d3d9092-f496-4cff-b3a1-f2515fae5ef6 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002426 Aug 27 02:31:06.763417 n-d-852278-4 devstack@n-api.service[106581]: [pid: 106581|app: 0|req: 16/33] 10.222.0.70 () {54 vars in 931 bytes} [Sat Aug 27 02:31:06 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:31:07.218503 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi [None req-dfbdbb38-2188-461e-a6e6-3af6c35db965 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "rxtx_factor": 1.0, "ram": 16384, "os-flavor-access:is_public": true, "name": "m1.xlarge", "disk": 160, "vcpus": 8, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:31:07.241511 n-d-852278-4 devstack@n-api.service[106582]: INFO nova.api.openstack.requestlog [None req-dfbdbb38-2188-461e-a6e6-3af6c35db965 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.470895 Aug 27 02:31:07.242482 n-d-852278-4 devstack@n-api.service[106582]: [pid: 106582|app: 0|req: 18/34] 10.222.0.70 () {64 vars in 1283 bytes} [Sat Aug 27 02:31:06 2022] POST /compute/v2.1/flavors => generated 408 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:31:07.255047 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi [None req-be6590f2-b0fa-45be-a2b4-28942d3b07cb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:31:07.287523 n-d-852278-4 devstack@n-api.service[106581]: INFO nova.api.openstack.requestlog [None req-be6590f2-b0fa-45be-a2b4-28942d3b07cb admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036286 Aug 27 02:31:07.288107 n-d-852278-4 devstack@n-api.service[106581]: [pid: 106581|app: 0|req: 17/35] 10.222.0.70 () {64 vars in 1333 bytes} [Sat Aug 27 02:31:07 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:30.369702 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi [None req-dfbdbb38-2188-461e-a6e6-3af6c35db965 admin admin] Calling method '>' {{(pid=106582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:30.371039 n-d-852278-4 devstack@n-api.service[106582]: INFO nova.api.openstack.requestlog [None req-dfbdbb38-2188-461e-a6e6-3af6c35db965 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002145 Aug 27 02:31:30.372109 n-d-852278-4 devstack@n-api.service[106582]: [pid: 106582|app: 0|req: 19/36] 10.222.0.70 () {54 vars in 931 bytes} [Sat Aug 27 02:31:30 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:31:30.386120 n-d-852278-4 devstack@n-api.service[106581]: DEBUG dbcounter [-] [106581] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=106581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:31:30.808709 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi [None req-e12e8bf6-c0ac-482f-ac50-0f0235910ce1 admin admin] Calling method '>' {{(pid=106581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:30.826859 n-d-852278-4 devstack@n-api.service[106581]: INFO nova.api.openstack.requestlog [None req-e12e8bf6-c0ac-482f-ac50-0f0235910ce1 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.445302 Aug 27 02:31:30.827408 n-d-852278-4 devstack@n-api.service[106581]: [pid: 106581|app: 0|req: 18/37] 10.222.0.70 () {60 vars in 1292 bytes} [Sat Aug 27 02:31:30 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:31:31.921893 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi [None req-dfbdbb38-2188-461e-a6e6-3af6c35db965 admin admin] Calling method '>' {{(pid=106582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:31.922919 n-d-852278-4 devstack@n-api.service[106582]: INFO nova.api.openstack.requestlog [None req-dfbdbb38-2188-461e-a6e6-3af6c35db965 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001581 Aug 27 02:31:31.923555 n-d-852278-4 devstack@n-api.service[106582]: [pid: 106582|app: 0|req: 20/38] 10.222.0.70 () {56 vars in 1074 bytes} [Sat Aug 27 02:31:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:31:32.537112 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi [None req-86602440-c90a-49ea-93b3-765f362fd923 admin admin] Calling method '>' {{(pid=106581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:32.545421 n-d-852278-4 devstack@n-api.service[106581]: INFO nova.api.openstack.wsgi [None req-86602440-c90a-49ea-93b3-765f362fd923 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 27 02:31:32.550248 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi [None req-86602440-c90a-49ea-93b3-765f362fd923 admin admin] Request method failure captured: Aug 27 02:31:32.550248 n-d-852278-4 devstack@n-api.service[106581]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 27 02:31:32.550248 n-d-852278-4 devstack@n-api.service[106581]: Accept: application/json Aug 27 02:31:32.550248 n-d-852278-4 devstack@n-api.service[106581]: Accept-Encoding: gzip, deflate Aug 27 02:31:32.550248 n-d-852278-4 devstack@n-api.service[106581]: Connection: keep-alive Aug 27 02:31:32.550248 n-d-852278-4 devstack@n-api.service[106581]: Content-Length: 0 Aug 27 02:31:32.550248 n-d-852278-4 devstack@n-api.service[106581]: Host: 10.222.0.70 Aug 27 02:31:32.550248 n-d-852278-4 devstack@n-api.service[106581]: Openstack-Api-Version: compute 2.90 Aug 27 02:31:32.550248 n-d-852278-4 devstack@n-api.service[106581]: Openstack-System-Scope: None Aug 27 02:31:32.550248 n-d-852278-4 devstack@n-api.service[106581]: User-Agent: python-novaclient Aug 27 02:31:32.550248 n-d-852278-4 devstack@n-api.service[106581]: X-Auth-Token: gAAAAABjCYIDmhPHL2bo0LmLoC6zmbnj_Klm4N3k4F7RoZ3oOh4Nvsov8lidkhbtxzUdUZygSdCJUFiDhfv67wHxOvtNg8y6YYlnI1hxiaeETjPY_yrAUozvbJuJyqKSO3PnyfDDvApVD6IOGKt72F0Xx_pKL4oh7-aXA2JfOl3rhQeaZYa-SWI Aug 27 02:31:32.550248 n-d-852278-4 devstack@n-api.service[106581]: X-Domain-Id: None Aug 27 02:31:32.550248 n-d-852278-4 devstack@n-api.service[106581]: X-Domain-Name: None Aug 27 02:31:32.550248 n-d-852278-4 devstack@n-api.service[106581]: X-Identity-Status: Confirmed Aug 27 02:31:32.550248 n-d-852278-4 devstack@n-api.service[106581]: X-Is-Admin-Project: True Aug 27 02:31:32.550248 n-d-852278-4 devstack@n-api.service[106581]: X-Openstack-Nova-Api-Version: 2.90 Aug 27 02:31:32.550248 n-d-852278-4 devstack@n-api.service[106581]: X-Project-Domain-Id: default Aug 27 02:31:32.550248 n-d-852278-4 devstack@n-api.service[106581]: X-Project-Domain-Name: Default Aug 27 02:31:32.550248 n-d-852278-4 devstack@n-api.service[106581]: X-Project-Id: 1db248914bad414e8269d593c31d4de4 Aug 27 02:31:32.550248 n-d-852278-4 devstack@n-api.service[106581]: X-Project-Name: admin Aug 27 02:31:32.550248 n-d-852278-4 devstack@n-api.service[106581]: X-Role: reader,admin,member Aug 27 02:31:32.550248 n-d-852278-4 devstack@n-api.service[106581]: X-Roles: reader,admin,member Aug 27 02:31:32.552153 n-d-852278-4 devstack@n-api.service[106581]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/1db248914bad414e8269d593c31d4de4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_1db248914bad414e8269d593c31d4de4", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/1db248914bad414e8269d593c31d4de4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/1db248914bad414e8269d593c31d4de4"}]}] Aug 27 02:31:32.552153 n-d-852278-4 devstack@n-api.service[106581]: X-Tenant: admin Aug 27 02:31:32.552153 n-d-852278-4 devstack@n-api.service[106581]: X-Tenant-Id: 1db248914bad414e8269d593c31d4de4 Aug 27 02:31:32.552153 n-d-852278-4 devstack@n-api.service[106581]: X-Tenant-Name: admin Aug 27 02:31:32.552153 n-d-852278-4 devstack@n-api.service[106581]: X-User: admin Aug 27 02:31:32.552153 n-d-852278-4 devstack@n-api.service[106581]: X-User-Domain-Id: default Aug 27 02:31:32.552153 n-d-852278-4 devstack@n-api.service[106581]: X-User-Domain-Name: Default Aug 27 02:31:32.552153 n-d-852278-4 devstack@n-api.service[106581]: X-User-Id: cd1ca7ea2f56450086b024bede14e7e0 Aug 27 02:31:32.552153 n-d-852278-4 devstack@n-api.service[106581]: X-User-Name: admin Aug 27 02:31:32.552153 n-d-852278-4 devstack@n-api.service[106581]: method: > Aug 27 02:31:32.552153 n-d-852278-4 devstack@n-api.service[106581]: exception: Flavor 42 could not be found. Aug 27 02:31:32.552153 n-d-852278-4 devstack@n-api.service[106581]: action_args: {'id': '42'} Aug 27 02:31:32.552153 n-d-852278-4 devstack@n-api.service[106581]: {{(pid=106581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:31:32.552153 n-d-852278-4 devstack@n-api.service[106581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:31:32.553290 n-d-852278-4 devstack@n-api.service[106581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 27 02:31:32.553290 n-d-852278-4 devstack@n-api.service[106581]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 27 02:31:32.553290 n-d-852278-4 devstack@n-api.service[106581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 27 02:31:32.553290 n-d-852278-4 devstack@n-api.service[106581]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 27 02:31:32.553290 n-d-852278-4 devstack@n-api.service[106581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 02:31:32.553290 n-d-852278-4 devstack@n-api.service[106581]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 02:31:32.553290 n-d-852278-4 devstack@n-api.service[106581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 27 02:31:32.553290 n-d-852278-4 devstack@n-api.service[106581]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 27 02:31:32.553290 n-d-852278-4 devstack@n-api.service[106581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 27 02:31:32.553290 n-d-852278-4 devstack@n-api.service[106581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:31:32.553290 n-d-852278-4 devstack@n-api.service[106581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 27 02:31:32.553290 n-d-852278-4 devstack@n-api.service[106581]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 27 02:31:32.553290 n-d-852278-4 devstack@n-api.service[106581]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 27 02:31:32.553290 n-d-852278-4 devstack@n-api.service[106581]: ERROR nova.api.openstack.wsgi Aug 27 02:31:32.553290 n-d-852278-4 devstack@n-api.service[106581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:31:32.553290 n-d-852278-4 devstack@n-api.service[106581]: ERROR nova.api.openstack.wsgi Aug 27 02:31:32.553290 n-d-852278-4 devstack@n-api.service[106581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:31:32.553290 n-d-852278-4 devstack@n-api.service[106581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:31:32.553290 n-d-852278-4 devstack@n-api.service[106581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:31:32.554769 n-d-852278-4 devstack@n-api.service[106581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:31:32.554769 n-d-852278-4 devstack@n-api.service[106581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:31:32.554769 n-d-852278-4 devstack@n-api.service[106581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:31:32.554769 n-d-852278-4 devstack@n-api.service[106581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:31:32.554769 n-d-852278-4 devstack@n-api.service[106581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 27 02:31:32.554769 n-d-852278-4 devstack@n-api.service[106581]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:31:32.554769 n-d-852278-4 devstack@n-api.service[106581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 27 02:31:32.554769 n-d-852278-4 devstack@n-api.service[106581]: ERROR nova.api.openstack.wsgi Aug 27 02:31:32.554769 n-d-852278-4 devstack@n-api.service[106581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:31:32.554769 n-d-852278-4 devstack@n-api.service[106581]: ERROR nova.api.openstack.wsgi Aug 27 02:31:32.554769 n-d-852278-4 devstack@n-api.service[106581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:31:32.554769 n-d-852278-4 devstack@n-api.service[106581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:31:32.554769 n-d-852278-4 devstack@n-api.service[106581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:31:32.554769 n-d-852278-4 devstack@n-api.service[106581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:31:32.554769 n-d-852278-4 devstack@n-api.service[106581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:31:32.554769 n-d-852278-4 devstack@n-api.service[106581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 27 02:31:32.554769 n-d-852278-4 devstack@n-api.service[106581]: ERROR nova.api.openstack.wsgi Aug 27 02:31:32.554769 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi [None req-86602440-c90a-49ea-93b3-765f362fd923 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:31:32.556037 n-d-852278-4 devstack@n-api.service[106581]: INFO nova.api.openstack.requestlog [None req-86602440-c90a-49ea-93b3-765f362fd923 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.463807 Aug 27 02:31:32.556037 n-d-852278-4 devstack@n-api.service[106581]: [pid: 106581|app: 0|req: 19/39] 10.222.0.70 () {60 vars in 1190 bytes} [Sat Aug 27 02:31:32 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 465 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 27 02:31:32.561894 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi [None req-b4bd4b53-9814-47cf-987f-e7aeff5ccd7d admin admin] Calling method '>' {{(pid=106582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:32.566217 n-d-852278-4 devstack@n-api.service[106582]: DEBUG dbcounter [-] [106582] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=106582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:31:32.586696 n-d-852278-4 devstack@n-api.service[106582]: INFO nova.api.openstack.requestlog [None req-b4bd4b53-9814-47cf-987f-e7aeff5ccd7d admin admin] 10.222.0.70 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028393 Aug 27 02:31:32.587245 n-d-852278-4 devstack@n-api.service[106582]: [pid: 106582|app: 0|req: 21/40] 10.222.0.70 () {60 vars in 1210 bytes} [Sat Aug 27 02:31:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:31:32.604218 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi [None req-e849a843-cb59-46fc-8156-355d07f337a1 admin admin] Calling method '>' {{(pid=106581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:32.626782 n-d-852278-4 devstack@n-api.service[106581]: INFO nova.api.openstack.requestlog [None req-e849a843-cb59-46fc-8156-355d07f337a1 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026194 Aug 27 02:31:32.627342 n-d-852278-4 devstack@n-api.service[106581]: [pid: 106581|app: 0|req: 20/41] 10.222.0.70 () {60 vars in 1210 bytes} [Sat Aug 27 02:31:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:31:32.637122 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi [None req-5ae4a497-dd18-4363-9032-b7e0348e6885 admin admin] Calling method '>' {{(pid=106582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:32.645731 n-d-852278-4 devstack@n-api.service[106582]: INFO nova.api.openstack.wsgi [None req-5ae4a497-dd18-4363-9032-b7e0348e6885 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 27 02:31:32.650708 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi [None req-5ae4a497-dd18-4363-9032-b7e0348e6885 admin admin] Request method failure captured: Aug 27 02:31:32.650708 n-d-852278-4 devstack@n-api.service[106582]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 27 02:31:32.650708 n-d-852278-4 devstack@n-api.service[106582]: Accept: application/json Aug 27 02:31:32.650708 n-d-852278-4 devstack@n-api.service[106582]: Accept-Encoding: gzip, deflate Aug 27 02:31:32.650708 n-d-852278-4 devstack@n-api.service[106582]: Connection: keep-alive Aug 27 02:31:32.650708 n-d-852278-4 devstack@n-api.service[106582]: Content-Length: 0 Aug 27 02:31:32.650708 n-d-852278-4 devstack@n-api.service[106582]: Host: 10.222.0.70 Aug 27 02:31:32.650708 n-d-852278-4 devstack@n-api.service[106582]: Openstack-Api-Version: compute 2.90 Aug 27 02:31:32.650708 n-d-852278-4 devstack@n-api.service[106582]: Openstack-System-Scope: None Aug 27 02:31:32.650708 n-d-852278-4 devstack@n-api.service[106582]: User-Agent: python-novaclient Aug 27 02:31:32.650708 n-d-852278-4 devstack@n-api.service[106582]: X-Auth-Token: gAAAAABjCYIDmhPHL2bo0LmLoC6zmbnj_Klm4N3k4F7RoZ3oOh4Nvsov8lidkhbtxzUdUZygSdCJUFiDhfv67wHxOvtNg8y6YYlnI1hxiaeETjPY_yrAUozvbJuJyqKSO3PnyfDDvApVD6IOGKt72F0Xx_pKL4oh7-aXA2JfOl3rhQeaZYa-SWI Aug 27 02:31:32.650708 n-d-852278-4 devstack@n-api.service[106582]: X-Domain-Id: None Aug 27 02:31:32.650708 n-d-852278-4 devstack@n-api.service[106582]: X-Domain-Name: None Aug 27 02:31:32.650708 n-d-852278-4 devstack@n-api.service[106582]: X-Identity-Status: Confirmed Aug 27 02:31:32.650708 n-d-852278-4 devstack@n-api.service[106582]: X-Is-Admin-Project: True Aug 27 02:31:32.650708 n-d-852278-4 devstack@n-api.service[106582]: X-Openstack-Nova-Api-Version: 2.90 Aug 27 02:31:32.650708 n-d-852278-4 devstack@n-api.service[106582]: X-Project-Domain-Id: default Aug 27 02:31:32.650708 n-d-852278-4 devstack@n-api.service[106582]: X-Project-Domain-Name: Default Aug 27 02:31:32.650708 n-d-852278-4 devstack@n-api.service[106582]: X-Project-Id: 1db248914bad414e8269d593c31d4de4 Aug 27 02:31:32.650708 n-d-852278-4 devstack@n-api.service[106582]: X-Project-Name: admin Aug 27 02:31:32.650708 n-d-852278-4 devstack@n-api.service[106582]: X-Role: reader,admin,member Aug 27 02:31:32.650708 n-d-852278-4 devstack@n-api.service[106582]: X-Roles: reader,admin,member Aug 27 02:31:32.653378 n-d-852278-4 devstack@n-api.service[106582]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/1db248914bad414e8269d593c31d4de4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_1db248914bad414e8269d593c31d4de4", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/1db248914bad414e8269d593c31d4de4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/1db248914bad414e8269d593c31d4de4"}]}] Aug 27 02:31:32.653378 n-d-852278-4 devstack@n-api.service[106582]: X-Tenant: admin Aug 27 02:31:32.653378 n-d-852278-4 devstack@n-api.service[106582]: X-Tenant-Id: 1db248914bad414e8269d593c31d4de4 Aug 27 02:31:32.653378 n-d-852278-4 devstack@n-api.service[106582]: X-Tenant-Name: admin Aug 27 02:31:32.653378 n-d-852278-4 devstack@n-api.service[106582]: X-User: admin Aug 27 02:31:32.653378 n-d-852278-4 devstack@n-api.service[106582]: X-User-Domain-Id: default Aug 27 02:31:32.653378 n-d-852278-4 devstack@n-api.service[106582]: X-User-Domain-Name: Default Aug 27 02:31:32.653378 n-d-852278-4 devstack@n-api.service[106582]: X-User-Id: cd1ca7ea2f56450086b024bede14e7e0 Aug 27 02:31:32.653378 n-d-852278-4 devstack@n-api.service[106582]: X-User-Name: admin Aug 27 02:31:32.653378 n-d-852278-4 devstack@n-api.service[106582]: method: > Aug 27 02:31:32.653378 n-d-852278-4 devstack@n-api.service[106582]: exception: Flavor 42 could not be found. Aug 27 02:31:32.653378 n-d-852278-4 devstack@n-api.service[106582]: action_args: {'id': '42'} Aug 27 02:31:32.653378 n-d-852278-4 devstack@n-api.service[106582]: {{(pid=106582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:31:32.653378 n-d-852278-4 devstack@n-api.service[106582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:31:32.655223 n-d-852278-4 devstack@n-api.service[106582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 27 02:31:32.655223 n-d-852278-4 devstack@n-api.service[106582]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 27 02:31:32.655223 n-d-852278-4 devstack@n-api.service[106582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 27 02:31:32.655223 n-d-852278-4 devstack@n-api.service[106582]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 27 02:31:32.655223 n-d-852278-4 devstack@n-api.service[106582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 02:31:32.655223 n-d-852278-4 devstack@n-api.service[106582]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 02:31:32.655223 n-d-852278-4 devstack@n-api.service[106582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 27 02:31:32.655223 n-d-852278-4 devstack@n-api.service[106582]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 27 02:31:32.655223 n-d-852278-4 devstack@n-api.service[106582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 27 02:31:32.655223 n-d-852278-4 devstack@n-api.service[106582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:31:32.655223 n-d-852278-4 devstack@n-api.service[106582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 27 02:31:32.655223 n-d-852278-4 devstack@n-api.service[106582]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 27 02:31:32.655223 n-d-852278-4 devstack@n-api.service[106582]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 27 02:31:32.655223 n-d-852278-4 devstack@n-api.service[106582]: ERROR nova.api.openstack.wsgi Aug 27 02:31:32.655223 n-d-852278-4 devstack@n-api.service[106582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:31:32.655223 n-d-852278-4 devstack@n-api.service[106582]: ERROR nova.api.openstack.wsgi Aug 27 02:31:32.655223 n-d-852278-4 devstack@n-api.service[106582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:31:32.655223 n-d-852278-4 devstack@n-api.service[106582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:31:32.655223 n-d-852278-4 devstack@n-api.service[106582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:31:32.657478 n-d-852278-4 devstack@n-api.service[106582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:31:32.657478 n-d-852278-4 devstack@n-api.service[106582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:31:32.657478 n-d-852278-4 devstack@n-api.service[106582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:31:32.657478 n-d-852278-4 devstack@n-api.service[106582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:31:32.657478 n-d-852278-4 devstack@n-api.service[106582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 27 02:31:32.657478 n-d-852278-4 devstack@n-api.service[106582]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:31:32.657478 n-d-852278-4 devstack@n-api.service[106582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 27 02:31:32.657478 n-d-852278-4 devstack@n-api.service[106582]: ERROR nova.api.openstack.wsgi Aug 27 02:31:32.657478 n-d-852278-4 devstack@n-api.service[106582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:31:32.657478 n-d-852278-4 devstack@n-api.service[106582]: ERROR nova.api.openstack.wsgi Aug 27 02:31:32.657478 n-d-852278-4 devstack@n-api.service[106582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:31:32.657478 n-d-852278-4 devstack@n-api.service[106582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:31:32.657478 n-d-852278-4 devstack@n-api.service[106582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:31:32.657478 n-d-852278-4 devstack@n-api.service[106582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:31:32.657478 n-d-852278-4 devstack@n-api.service[106582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:31:32.657478 n-d-852278-4 devstack@n-api.service[106582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 27 02:31:32.657478 n-d-852278-4 devstack@n-api.service[106582]: ERROR nova.api.openstack.wsgi Aug 27 02:31:32.657478 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi [None req-5ae4a497-dd18-4363-9032-b7e0348e6885 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:31:32.659641 n-d-852278-4 devstack@n-api.service[106582]: INFO nova.api.openstack.requestlog [None req-5ae4a497-dd18-4363-9032-b7e0348e6885 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.018877 Aug 27 02:31:32.659641 n-d-852278-4 devstack@n-api.service[106582]: [pid: 106582|app: 0|req: 22/42] 10.222.0.70 () {60 vars in 1190 bytes} [Sat Aug 27 02:31:32 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 27 02:31:33.660186 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi [None req-e849a843-cb59-46fc-8156-355d07f337a1 admin admin] Calling method '>' {{(pid=106581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:33.661758 n-d-852278-4 devstack@n-api.service[106581]: INFO nova.api.openstack.requestlog [None req-e849a843-cb59-46fc-8156-355d07f337a1 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002279 Aug 27 02:31:33.662428 n-d-852278-4 devstack@n-api.service[106581]: [pid: 106581|app: 0|req: 21/43] 10.222.0.70 () {56 vars in 1074 bytes} [Sat Aug 27 02:31:33 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:31:34.233475 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi [None req-1a523818-3278-4fd7-9b98-8d0a26b8705b admin admin] Calling method '>' {{(pid=106582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:34.238931 n-d-852278-4 devstack@n-api.service[106582]: INFO nova.api.openstack.wsgi [None req-1a523818-3278-4fd7-9b98-8d0a26b8705b admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 27 02:31:34.240494 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi [None req-1a523818-3278-4fd7-9b98-8d0a26b8705b admin admin] Request method failure captured: Aug 27 02:31:34.240494 n-d-852278-4 devstack@n-api.service[106582]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 27 02:31:34.240494 n-d-852278-4 devstack@n-api.service[106582]: Accept: application/json Aug 27 02:31:34.240494 n-d-852278-4 devstack@n-api.service[106582]: Accept-Encoding: gzip, deflate Aug 27 02:31:34.240494 n-d-852278-4 devstack@n-api.service[106582]: Connection: keep-alive Aug 27 02:31:34.240494 n-d-852278-4 devstack@n-api.service[106582]: Content-Length: 0 Aug 27 02:31:34.240494 n-d-852278-4 devstack@n-api.service[106582]: Host: 10.222.0.70 Aug 27 02:31:34.240494 n-d-852278-4 devstack@n-api.service[106582]: Openstack-Api-Version: compute 2.90 Aug 27 02:31:34.240494 n-d-852278-4 devstack@n-api.service[106582]: Openstack-System-Scope: None Aug 27 02:31:34.240494 n-d-852278-4 devstack@n-api.service[106582]: User-Agent: python-novaclient Aug 27 02:31:34.240494 n-d-852278-4 devstack@n-api.service[106582]: X-Auth-Token: gAAAAABjCYIFQpHiitP34JNxkJQxPnCV9MjjsnK-uNfOlPWrAo6Jy6r1Y6X4omiqF42o2qoQgRTMQ_YJP0tf4mUImEU-4ZU5tAMp5aKyDw7SW8vx6pcRcfz2zHayRjYK2e1iLb6VaHYef3slNl2nx_XJ9ubR-zXbFPeuCMrnSLNjId7orXbkQxg Aug 27 02:31:34.240494 n-d-852278-4 devstack@n-api.service[106582]: X-Domain-Id: None Aug 27 02:31:34.240494 n-d-852278-4 devstack@n-api.service[106582]: X-Domain-Name: None Aug 27 02:31:34.240494 n-d-852278-4 devstack@n-api.service[106582]: X-Identity-Status: Confirmed Aug 27 02:31:34.240494 n-d-852278-4 devstack@n-api.service[106582]: X-Is-Admin-Project: True Aug 27 02:31:34.240494 n-d-852278-4 devstack@n-api.service[106582]: X-Openstack-Nova-Api-Version: 2.90 Aug 27 02:31:34.240494 n-d-852278-4 devstack@n-api.service[106582]: X-Project-Domain-Id: default Aug 27 02:31:34.240494 n-d-852278-4 devstack@n-api.service[106582]: X-Project-Domain-Name: Default Aug 27 02:31:34.240494 n-d-852278-4 devstack@n-api.service[106582]: X-Project-Id: 1db248914bad414e8269d593c31d4de4 Aug 27 02:31:34.240494 n-d-852278-4 devstack@n-api.service[106582]: X-Project-Name: admin Aug 27 02:31:34.240494 n-d-852278-4 devstack@n-api.service[106582]: X-Role: reader,admin,member Aug 27 02:31:34.240494 n-d-852278-4 devstack@n-api.service[106582]: X-Roles: reader,admin,member Aug 27 02:31:34.241841 n-d-852278-4 devstack@n-api.service[106582]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/1db248914bad414e8269d593c31d4de4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_1db248914bad414e8269d593c31d4de4", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/1db248914bad414e8269d593c31d4de4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/1db248914bad414e8269d593c31d4de4"}]}] Aug 27 02:31:34.241841 n-d-852278-4 devstack@n-api.service[106582]: X-Tenant: admin Aug 27 02:31:34.241841 n-d-852278-4 devstack@n-api.service[106582]: X-Tenant-Id: 1db248914bad414e8269d593c31d4de4 Aug 27 02:31:34.241841 n-d-852278-4 devstack@n-api.service[106582]: X-Tenant-Name: admin Aug 27 02:31:34.241841 n-d-852278-4 devstack@n-api.service[106582]: X-User: admin Aug 27 02:31:34.241841 n-d-852278-4 devstack@n-api.service[106582]: X-User-Domain-Id: default Aug 27 02:31:34.241841 n-d-852278-4 devstack@n-api.service[106582]: X-User-Domain-Name: Default Aug 27 02:31:34.241841 n-d-852278-4 devstack@n-api.service[106582]: X-User-Id: cd1ca7ea2f56450086b024bede14e7e0 Aug 27 02:31:34.241841 n-d-852278-4 devstack@n-api.service[106582]: X-User-Name: admin Aug 27 02:31:34.241841 n-d-852278-4 devstack@n-api.service[106582]: method: > Aug 27 02:31:34.241841 n-d-852278-4 devstack@n-api.service[106582]: exception: Flavor 84 could not be found. Aug 27 02:31:34.241841 n-d-852278-4 devstack@n-api.service[106582]: action_args: {'id': '84'} Aug 27 02:31:34.241841 n-d-852278-4 devstack@n-api.service[106582]: {{(pid=106582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:31:34.241841 n-d-852278-4 devstack@n-api.service[106582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:31:34.242722 n-d-852278-4 devstack@n-api.service[106582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 27 02:31:34.242722 n-d-852278-4 devstack@n-api.service[106582]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 27 02:31:34.242722 n-d-852278-4 devstack@n-api.service[106582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 27 02:31:34.242722 n-d-852278-4 devstack@n-api.service[106582]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 27 02:31:34.242722 n-d-852278-4 devstack@n-api.service[106582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 02:31:34.242722 n-d-852278-4 devstack@n-api.service[106582]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 02:31:34.242722 n-d-852278-4 devstack@n-api.service[106582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 27 02:31:34.242722 n-d-852278-4 devstack@n-api.service[106582]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 27 02:31:34.242722 n-d-852278-4 devstack@n-api.service[106582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 27 02:31:34.242722 n-d-852278-4 devstack@n-api.service[106582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:31:34.242722 n-d-852278-4 devstack@n-api.service[106582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 27 02:31:34.242722 n-d-852278-4 devstack@n-api.service[106582]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 27 02:31:34.242722 n-d-852278-4 devstack@n-api.service[106582]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 27 02:31:34.242722 n-d-852278-4 devstack@n-api.service[106582]: ERROR nova.api.openstack.wsgi Aug 27 02:31:34.242722 n-d-852278-4 devstack@n-api.service[106582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:31:34.242722 n-d-852278-4 devstack@n-api.service[106582]: ERROR nova.api.openstack.wsgi Aug 27 02:31:34.242722 n-d-852278-4 devstack@n-api.service[106582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:31:34.242722 n-d-852278-4 devstack@n-api.service[106582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:31:34.242722 n-d-852278-4 devstack@n-api.service[106582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:31:34.243805 n-d-852278-4 devstack@n-api.service[106582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:31:34.243805 n-d-852278-4 devstack@n-api.service[106582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:31:34.243805 n-d-852278-4 devstack@n-api.service[106582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:31:34.243805 n-d-852278-4 devstack@n-api.service[106582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:31:34.243805 n-d-852278-4 devstack@n-api.service[106582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 27 02:31:34.243805 n-d-852278-4 devstack@n-api.service[106582]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:31:34.243805 n-d-852278-4 devstack@n-api.service[106582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 27 02:31:34.243805 n-d-852278-4 devstack@n-api.service[106582]: ERROR nova.api.openstack.wsgi Aug 27 02:31:34.243805 n-d-852278-4 devstack@n-api.service[106582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:31:34.243805 n-d-852278-4 devstack@n-api.service[106582]: ERROR nova.api.openstack.wsgi Aug 27 02:31:34.243805 n-d-852278-4 devstack@n-api.service[106582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:31:34.243805 n-d-852278-4 devstack@n-api.service[106582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:31:34.243805 n-d-852278-4 devstack@n-api.service[106582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:31:34.243805 n-d-852278-4 devstack@n-api.service[106582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:31:34.243805 n-d-852278-4 devstack@n-api.service[106582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:31:34.243805 n-d-852278-4 devstack@n-api.service[106582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 27 02:31:34.243805 n-d-852278-4 devstack@n-api.service[106582]: ERROR nova.api.openstack.wsgi Aug 27 02:31:34.243805 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi [None req-1a523818-3278-4fd7-9b98-8d0a26b8705b admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:31:34.244934 n-d-852278-4 devstack@n-api.service[106582]: INFO nova.api.openstack.requestlog [None req-1a523818-3278-4fd7-9b98-8d0a26b8705b admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.429865 Aug 27 02:31:34.244934 n-d-852278-4 devstack@n-api.service[106582]: [pid: 106582|app: 0|req: 23/44] 10.222.0.70 () {60 vars in 1190 bytes} [Sat Aug 27 02:31:33 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 431 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 27 02:31:34.252644 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi [None req-6384baa8-6499-44e2-b618-68cb81b03959 admin admin] Calling method '>' {{(pid=106581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:34.268539 n-d-852278-4 devstack@n-api.service[106581]: INFO nova.api.openstack.requestlog [None req-6384baa8-6499-44e2-b618-68cb81b03959 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019941 Aug 27 02:31:34.269074 n-d-852278-4 devstack@n-api.service[106581]: [pid: 106581|app: 0|req: 22/45] 10.222.0.70 () {60 vars in 1210 bytes} [Sat Aug 27 02:31:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:31:34.279395 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi [None req-248da63f-658f-4dbb-b087-d08663e68b4e admin admin] Calling method '>' {{(pid=106582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:34.295044 n-d-852278-4 devstack@n-api.service[106582]: INFO nova.api.openstack.requestlog [None req-248da63f-658f-4dbb-b087-d08663e68b4e admin admin] 10.222.0.70 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019355 Aug 27 02:31:34.295578 n-d-852278-4 devstack@n-api.service[106582]: [pid: 106582|app: 0|req: 24/46] 10.222.0.70 () {60 vars in 1210 bytes} [Sat Aug 27 02:31:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:31:34.308698 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi [None req-f988cb65-afa2-4c7f-ae85-7f844f9611ae admin admin] Calling method '>' {{(pid=106581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:34.316963 n-d-852278-4 devstack@n-api.service[106581]: INFO nova.api.openstack.wsgi [None req-f988cb65-afa2-4c7f-ae85-7f844f9611ae admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 27 02:31:34.318480 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi [None req-f988cb65-afa2-4c7f-ae85-7f844f9611ae admin admin] Request method failure captured: Aug 27 02:31:34.318480 n-d-852278-4 devstack@n-api.service[106581]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 27 02:31:34.318480 n-d-852278-4 devstack@n-api.service[106581]: Accept: application/json Aug 27 02:31:34.318480 n-d-852278-4 devstack@n-api.service[106581]: Accept-Encoding: gzip, deflate Aug 27 02:31:34.318480 n-d-852278-4 devstack@n-api.service[106581]: Connection: keep-alive Aug 27 02:31:34.318480 n-d-852278-4 devstack@n-api.service[106581]: Content-Length: 0 Aug 27 02:31:34.318480 n-d-852278-4 devstack@n-api.service[106581]: Host: 10.222.0.70 Aug 27 02:31:34.318480 n-d-852278-4 devstack@n-api.service[106581]: Openstack-Api-Version: compute 2.90 Aug 27 02:31:34.318480 n-d-852278-4 devstack@n-api.service[106581]: Openstack-System-Scope: None Aug 27 02:31:34.318480 n-d-852278-4 devstack@n-api.service[106581]: User-Agent: python-novaclient Aug 27 02:31:34.318480 n-d-852278-4 devstack@n-api.service[106581]: X-Auth-Token: gAAAAABjCYIFQpHiitP34JNxkJQxPnCV9MjjsnK-uNfOlPWrAo6Jy6r1Y6X4omiqF42o2qoQgRTMQ_YJP0tf4mUImEU-4ZU5tAMp5aKyDw7SW8vx6pcRcfz2zHayRjYK2e1iLb6VaHYef3slNl2nx_XJ9ubR-zXbFPeuCMrnSLNjId7orXbkQxg Aug 27 02:31:34.318480 n-d-852278-4 devstack@n-api.service[106581]: X-Domain-Id: None Aug 27 02:31:34.318480 n-d-852278-4 devstack@n-api.service[106581]: X-Domain-Name: None Aug 27 02:31:34.318480 n-d-852278-4 devstack@n-api.service[106581]: X-Identity-Status: Confirmed Aug 27 02:31:34.318480 n-d-852278-4 devstack@n-api.service[106581]: X-Is-Admin-Project: True Aug 27 02:31:34.318480 n-d-852278-4 devstack@n-api.service[106581]: X-Openstack-Nova-Api-Version: 2.90 Aug 27 02:31:34.318480 n-d-852278-4 devstack@n-api.service[106581]: X-Project-Domain-Id: default Aug 27 02:31:34.318480 n-d-852278-4 devstack@n-api.service[106581]: X-Project-Domain-Name: Default Aug 27 02:31:34.318480 n-d-852278-4 devstack@n-api.service[106581]: X-Project-Id: 1db248914bad414e8269d593c31d4de4 Aug 27 02:31:34.318480 n-d-852278-4 devstack@n-api.service[106581]: X-Project-Name: admin Aug 27 02:31:34.318480 n-d-852278-4 devstack@n-api.service[106581]: X-Role: reader,admin,member Aug 27 02:31:34.318480 n-d-852278-4 devstack@n-api.service[106581]: X-Roles: reader,admin,member Aug 27 02:31:34.320083 n-d-852278-4 devstack@n-api.service[106581]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/1db248914bad414e8269d593c31d4de4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_1db248914bad414e8269d593c31d4de4", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/1db248914bad414e8269d593c31d4de4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/1db248914bad414e8269d593c31d4de4"}]}] Aug 27 02:31:34.320083 n-d-852278-4 devstack@n-api.service[106581]: X-Tenant: admin Aug 27 02:31:34.320083 n-d-852278-4 devstack@n-api.service[106581]: X-Tenant-Id: 1db248914bad414e8269d593c31d4de4 Aug 27 02:31:34.320083 n-d-852278-4 devstack@n-api.service[106581]: X-Tenant-Name: admin Aug 27 02:31:34.320083 n-d-852278-4 devstack@n-api.service[106581]: X-User: admin Aug 27 02:31:34.320083 n-d-852278-4 devstack@n-api.service[106581]: X-User-Domain-Id: default Aug 27 02:31:34.320083 n-d-852278-4 devstack@n-api.service[106581]: X-User-Domain-Name: Default Aug 27 02:31:34.320083 n-d-852278-4 devstack@n-api.service[106581]: X-User-Id: cd1ca7ea2f56450086b024bede14e7e0 Aug 27 02:31:34.320083 n-d-852278-4 devstack@n-api.service[106581]: X-User-Name: admin Aug 27 02:31:34.320083 n-d-852278-4 devstack@n-api.service[106581]: method: > Aug 27 02:31:34.320083 n-d-852278-4 devstack@n-api.service[106581]: exception: Flavor 84 could not be found. Aug 27 02:31:34.320083 n-d-852278-4 devstack@n-api.service[106581]: action_args: {'id': '84'} Aug 27 02:31:34.320083 n-d-852278-4 devstack@n-api.service[106581]: {{(pid=106581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:31:34.320083 n-d-852278-4 devstack@n-api.service[106581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:31:34.321091 n-d-852278-4 devstack@n-api.service[106581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 27 02:31:34.321091 n-d-852278-4 devstack@n-api.service[106581]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 27 02:31:34.321091 n-d-852278-4 devstack@n-api.service[106581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 27 02:31:34.321091 n-d-852278-4 devstack@n-api.service[106581]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 27 02:31:34.321091 n-d-852278-4 devstack@n-api.service[106581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 02:31:34.321091 n-d-852278-4 devstack@n-api.service[106581]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 02:31:34.321091 n-d-852278-4 devstack@n-api.service[106581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 27 02:31:34.321091 n-d-852278-4 devstack@n-api.service[106581]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 27 02:31:34.321091 n-d-852278-4 devstack@n-api.service[106581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 27 02:31:34.321091 n-d-852278-4 devstack@n-api.service[106581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:31:34.321091 n-d-852278-4 devstack@n-api.service[106581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 27 02:31:34.321091 n-d-852278-4 devstack@n-api.service[106581]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 27 02:31:34.321091 n-d-852278-4 devstack@n-api.service[106581]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 27 02:31:34.321091 n-d-852278-4 devstack@n-api.service[106581]: ERROR nova.api.openstack.wsgi Aug 27 02:31:34.321091 n-d-852278-4 devstack@n-api.service[106581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:31:34.321091 n-d-852278-4 devstack@n-api.service[106581]: ERROR nova.api.openstack.wsgi Aug 27 02:31:34.321091 n-d-852278-4 devstack@n-api.service[106581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:31:34.321091 n-d-852278-4 devstack@n-api.service[106581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:31:34.321091 n-d-852278-4 devstack@n-api.service[106581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:31:34.322447 n-d-852278-4 devstack@n-api.service[106581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:31:34.322447 n-d-852278-4 devstack@n-api.service[106581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:31:34.322447 n-d-852278-4 devstack@n-api.service[106581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:31:34.322447 n-d-852278-4 devstack@n-api.service[106581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:31:34.322447 n-d-852278-4 devstack@n-api.service[106581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 27 02:31:34.322447 n-d-852278-4 devstack@n-api.service[106581]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:31:34.322447 n-d-852278-4 devstack@n-api.service[106581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 27 02:31:34.322447 n-d-852278-4 devstack@n-api.service[106581]: ERROR nova.api.openstack.wsgi Aug 27 02:31:34.322447 n-d-852278-4 devstack@n-api.service[106581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:31:34.322447 n-d-852278-4 devstack@n-api.service[106581]: ERROR nova.api.openstack.wsgi Aug 27 02:31:34.322447 n-d-852278-4 devstack@n-api.service[106581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:31:34.322447 n-d-852278-4 devstack@n-api.service[106581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:31:34.322447 n-d-852278-4 devstack@n-api.service[106581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:31:34.322447 n-d-852278-4 devstack@n-api.service[106581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:31:34.322447 n-d-852278-4 devstack@n-api.service[106581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:31:34.322447 n-d-852278-4 devstack@n-api.service[106581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 27 02:31:34.322447 n-d-852278-4 devstack@n-api.service[106581]: ERROR nova.api.openstack.wsgi Aug 27 02:31:34.322447 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi [None req-f988cb65-afa2-4c7f-ae85-7f844f9611ae admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:31:34.323752 n-d-852278-4 devstack@n-api.service[106581]: INFO nova.api.openstack.requestlog [None req-f988cb65-afa2-4c7f-ae85-7f844f9611ae admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.017247 Aug 27 02:31:34.323752 n-d-852278-4 devstack@n-api.service[106581]: [pid: 106581|app: 0|req: 23/47] 10.222.0.70 () {60 vars in 1190 bytes} [Sat Aug 27 02:31:34 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 27 02:31:35.314236 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi [None req-248da63f-658f-4dbb-b087-d08663e68b4e admin admin] Calling method '>' {{(pid=106582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:35.315314 n-d-852278-4 devstack@n-api.service[106582]: INFO nova.api.openstack.requestlog [None req-248da63f-658f-4dbb-b087-d08663e68b4e admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001517 Aug 27 02:31:35.315729 n-d-852278-4 devstack@n-api.service[106582]: [pid: 106582|app: 0|req: 25/48] 10.222.0.70 () {56 vars in 1074 bytes} [Sat Aug 27 02:31:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:31:35.898408 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi [None req-7848400b-cb65-42f7-b3c2-93baf098f5f7 admin admin] Calling method '>' {{(pid=106581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:35.904344 n-d-852278-4 devstack@n-api.service[106581]: INFO nova.api.openstack.wsgi [None req-7848400b-cb65-42f7-b3c2-93baf098f5f7 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 27 02:31:35.905868 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi [None req-7848400b-cb65-42f7-b3c2-93baf098f5f7 admin admin] Request method failure captured: Aug 27 02:31:35.905868 n-d-852278-4 devstack@n-api.service[106581]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 27 02:31:35.905868 n-d-852278-4 devstack@n-api.service[106581]: Accept: application/json Aug 27 02:31:35.905868 n-d-852278-4 devstack@n-api.service[106581]: Accept-Encoding: gzip, deflate Aug 27 02:31:35.905868 n-d-852278-4 devstack@n-api.service[106581]: Connection: keep-alive Aug 27 02:31:35.905868 n-d-852278-4 devstack@n-api.service[106581]: Content-Length: 0 Aug 27 02:31:35.905868 n-d-852278-4 devstack@n-api.service[106581]: Host: 10.222.0.70 Aug 27 02:31:35.905868 n-d-852278-4 devstack@n-api.service[106581]: Openstack-Api-Version: compute 2.90 Aug 27 02:31:35.905868 n-d-852278-4 devstack@n-api.service[106581]: Openstack-System-Scope: None Aug 27 02:31:35.905868 n-d-852278-4 devstack@n-api.service[106581]: User-Agent: python-novaclient Aug 27 02:31:35.905868 n-d-852278-4 devstack@n-api.service[106581]: X-Auth-Token: gAAAAABjCYIHq-JsHaqhV9BpgqY5_cf3odBDTZO4xelZitByFIzwbRy43A12g5srP4GH6N3lmciBPCYW0T-EhYmClKQNVqnBBJ7ftMsHEJh94aT3bOTY7enAb3nnYw56TL_tRUWK84jwp2zfVfeYXGPzpGtrFWDgCdpBVaAm8ES7o9N60i0cVU4 Aug 27 02:31:35.905868 n-d-852278-4 devstack@n-api.service[106581]: X-Domain-Id: None Aug 27 02:31:35.905868 n-d-852278-4 devstack@n-api.service[106581]: X-Domain-Name: None Aug 27 02:31:35.905868 n-d-852278-4 devstack@n-api.service[106581]: X-Identity-Status: Confirmed Aug 27 02:31:35.905868 n-d-852278-4 devstack@n-api.service[106581]: X-Is-Admin-Project: True Aug 27 02:31:35.905868 n-d-852278-4 devstack@n-api.service[106581]: X-Openstack-Nova-Api-Version: 2.90 Aug 27 02:31:35.905868 n-d-852278-4 devstack@n-api.service[106581]: X-Project-Domain-Id: default Aug 27 02:31:35.905868 n-d-852278-4 devstack@n-api.service[106581]: X-Project-Domain-Name: Default Aug 27 02:31:35.905868 n-d-852278-4 devstack@n-api.service[106581]: X-Project-Id: 1db248914bad414e8269d593c31d4de4 Aug 27 02:31:35.905868 n-d-852278-4 devstack@n-api.service[106581]: X-Project-Name: admin Aug 27 02:31:35.905868 n-d-852278-4 devstack@n-api.service[106581]: X-Role: reader,admin,member Aug 27 02:31:35.905868 n-d-852278-4 devstack@n-api.service[106581]: X-Roles: reader,admin,member Aug 27 02:31:35.907380 n-d-852278-4 devstack@n-api.service[106581]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/1db248914bad414e8269d593c31d4de4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_1db248914bad414e8269d593c31d4de4", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/1db248914bad414e8269d593c31d4de4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/1db248914bad414e8269d593c31d4de4"}]}] Aug 27 02:31:35.907380 n-d-852278-4 devstack@n-api.service[106581]: X-Tenant: admin Aug 27 02:31:35.907380 n-d-852278-4 devstack@n-api.service[106581]: X-Tenant-Id: 1db248914bad414e8269d593c31d4de4 Aug 27 02:31:35.907380 n-d-852278-4 devstack@n-api.service[106581]: X-Tenant-Name: admin Aug 27 02:31:35.907380 n-d-852278-4 devstack@n-api.service[106581]: X-User: admin Aug 27 02:31:35.907380 n-d-852278-4 devstack@n-api.service[106581]: X-User-Domain-Id: default Aug 27 02:31:35.907380 n-d-852278-4 devstack@n-api.service[106581]: X-User-Domain-Name: Default Aug 27 02:31:35.907380 n-d-852278-4 devstack@n-api.service[106581]: X-User-Id: cd1ca7ea2f56450086b024bede14e7e0 Aug 27 02:31:35.907380 n-d-852278-4 devstack@n-api.service[106581]: X-User-Name: admin Aug 27 02:31:35.907380 n-d-852278-4 devstack@n-api.service[106581]: method: > Aug 27 02:31:35.907380 n-d-852278-4 devstack@n-api.service[106581]: exception: Flavor 451 could not be found. Aug 27 02:31:35.907380 n-d-852278-4 devstack@n-api.service[106581]: action_args: {'id': '451'} Aug 27 02:31:35.907380 n-d-852278-4 devstack@n-api.service[106581]: {{(pid=106581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:31:35.907380 n-d-852278-4 devstack@n-api.service[106581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:31:35.909158 n-d-852278-4 devstack@n-api.service[106581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 27 02:31:35.909158 n-d-852278-4 devstack@n-api.service[106581]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 27 02:31:35.909158 n-d-852278-4 devstack@n-api.service[106581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 27 02:31:35.909158 n-d-852278-4 devstack@n-api.service[106581]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 27 02:31:35.909158 n-d-852278-4 devstack@n-api.service[106581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 02:31:35.909158 n-d-852278-4 devstack@n-api.service[106581]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 02:31:35.909158 n-d-852278-4 devstack@n-api.service[106581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 27 02:31:35.909158 n-d-852278-4 devstack@n-api.service[106581]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 27 02:31:35.909158 n-d-852278-4 devstack@n-api.service[106581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 27 02:31:35.909158 n-d-852278-4 devstack@n-api.service[106581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:31:35.909158 n-d-852278-4 devstack@n-api.service[106581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 27 02:31:35.909158 n-d-852278-4 devstack@n-api.service[106581]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 27 02:31:35.909158 n-d-852278-4 devstack@n-api.service[106581]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 27 02:31:35.909158 n-d-852278-4 devstack@n-api.service[106581]: ERROR nova.api.openstack.wsgi Aug 27 02:31:35.909158 n-d-852278-4 devstack@n-api.service[106581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:31:35.909158 n-d-852278-4 devstack@n-api.service[106581]: ERROR nova.api.openstack.wsgi Aug 27 02:31:35.909158 n-d-852278-4 devstack@n-api.service[106581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:31:35.909158 n-d-852278-4 devstack@n-api.service[106581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:31:35.909158 n-d-852278-4 devstack@n-api.service[106581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:31:35.910496 n-d-852278-4 devstack@n-api.service[106581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:31:35.910496 n-d-852278-4 devstack@n-api.service[106581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:31:35.910496 n-d-852278-4 devstack@n-api.service[106581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:31:35.910496 n-d-852278-4 devstack@n-api.service[106581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:31:35.910496 n-d-852278-4 devstack@n-api.service[106581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 27 02:31:35.910496 n-d-852278-4 devstack@n-api.service[106581]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:31:35.910496 n-d-852278-4 devstack@n-api.service[106581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 27 02:31:35.910496 n-d-852278-4 devstack@n-api.service[106581]: ERROR nova.api.openstack.wsgi Aug 27 02:31:35.910496 n-d-852278-4 devstack@n-api.service[106581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:31:35.910496 n-d-852278-4 devstack@n-api.service[106581]: ERROR nova.api.openstack.wsgi Aug 27 02:31:35.910496 n-d-852278-4 devstack@n-api.service[106581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:31:35.910496 n-d-852278-4 devstack@n-api.service[106581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:31:35.910496 n-d-852278-4 devstack@n-api.service[106581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:31:35.910496 n-d-852278-4 devstack@n-api.service[106581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:31:35.910496 n-d-852278-4 devstack@n-api.service[106581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:31:35.910496 n-d-852278-4 devstack@n-api.service[106581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 27 02:31:35.910496 n-d-852278-4 devstack@n-api.service[106581]: ERROR nova.api.openstack.wsgi Aug 27 02:31:35.910496 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi [None req-7848400b-cb65-42f7-b3c2-93baf098f5f7 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:31:35.911718 n-d-852278-4 devstack@n-api.service[106581]: INFO nova.api.openstack.requestlog [None req-7848400b-cb65-42f7-b3c2-93baf098f5f7 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.453176 Aug 27 02:31:35.911718 n-d-852278-4 devstack@n-api.service[106581]: [pid: 106581|app: 0|req: 24/49] 10.222.0.70 () {60 vars in 1193 bytes} [Sat Aug 27 02:31:35 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 455 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 27 02:31:35.917525 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi [None req-a9ee3718-8418-46e4-9296-01806621d5e9 admin admin] Calling method '>' {{(pid=106582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:35.933480 n-d-852278-4 devstack@n-api.service[106582]: INFO nova.api.openstack.requestlog [None req-a9ee3718-8418-46e4-9296-01806621d5e9 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019548 Aug 27 02:31:35.934034 n-d-852278-4 devstack@n-api.service[106582]: [pid: 106582|app: 0|req: 26/50] 10.222.0.70 () {60 vars in 1210 bytes} [Sat Aug 27 02:31:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:31:35.943943 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi [None req-f5dd8593-c8f9-4b1e-9cbf-fa365c234ebc admin admin] Calling method '>' {{(pid=106581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:35.959406 n-d-852278-4 devstack@n-api.service[106581]: INFO nova.api.openstack.requestlog [None req-f5dd8593-c8f9-4b1e-9cbf-fa365c234ebc admin admin] 10.222.0.70 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019134 Aug 27 02:31:35.959949 n-d-852278-4 devstack@n-api.service[106581]: [pid: 106581|app: 0|req: 25/51] 10.222.0.70 () {60 vars in 1210 bytes} [Sat Aug 27 02:31:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:31:35.969612 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi [None req-29e81eef-8fdc-4ebd-ac3e-42ba81c85b76 admin admin] Calling method '>' {{(pid=106582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:35.975717 n-d-852278-4 devstack@n-api.service[106582]: INFO nova.api.openstack.wsgi [None req-29e81eef-8fdc-4ebd-ac3e-42ba81c85b76 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 27 02:31:35.977272 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi [None req-29e81eef-8fdc-4ebd-ac3e-42ba81c85b76 admin admin] Request method failure captured: Aug 27 02:31:35.977272 n-d-852278-4 devstack@n-api.service[106582]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 27 02:31:35.977272 n-d-852278-4 devstack@n-api.service[106582]: Accept: application/json Aug 27 02:31:35.977272 n-d-852278-4 devstack@n-api.service[106582]: Accept-Encoding: gzip, deflate Aug 27 02:31:35.977272 n-d-852278-4 devstack@n-api.service[106582]: Connection: keep-alive Aug 27 02:31:35.977272 n-d-852278-4 devstack@n-api.service[106582]: Content-Length: 0 Aug 27 02:31:35.977272 n-d-852278-4 devstack@n-api.service[106582]: Host: 10.222.0.70 Aug 27 02:31:35.977272 n-d-852278-4 devstack@n-api.service[106582]: Openstack-Api-Version: compute 2.90 Aug 27 02:31:35.977272 n-d-852278-4 devstack@n-api.service[106582]: Openstack-System-Scope: None Aug 27 02:31:35.977272 n-d-852278-4 devstack@n-api.service[106582]: User-Agent: python-novaclient Aug 27 02:31:35.977272 n-d-852278-4 devstack@n-api.service[106582]: X-Auth-Token: gAAAAABjCYIHq-JsHaqhV9BpgqY5_cf3odBDTZO4xelZitByFIzwbRy43A12g5srP4GH6N3lmciBPCYW0T-EhYmClKQNVqnBBJ7ftMsHEJh94aT3bOTY7enAb3nnYw56TL_tRUWK84jwp2zfVfeYXGPzpGtrFWDgCdpBVaAm8ES7o9N60i0cVU4 Aug 27 02:31:35.977272 n-d-852278-4 devstack@n-api.service[106582]: X-Domain-Id: None Aug 27 02:31:35.977272 n-d-852278-4 devstack@n-api.service[106582]: X-Domain-Name: None Aug 27 02:31:35.977272 n-d-852278-4 devstack@n-api.service[106582]: X-Identity-Status: Confirmed Aug 27 02:31:35.977272 n-d-852278-4 devstack@n-api.service[106582]: X-Is-Admin-Project: True Aug 27 02:31:35.977272 n-d-852278-4 devstack@n-api.service[106582]: X-Openstack-Nova-Api-Version: 2.90 Aug 27 02:31:35.977272 n-d-852278-4 devstack@n-api.service[106582]: X-Project-Domain-Id: default Aug 27 02:31:35.977272 n-d-852278-4 devstack@n-api.service[106582]: X-Project-Domain-Name: Default Aug 27 02:31:35.977272 n-d-852278-4 devstack@n-api.service[106582]: X-Project-Id: 1db248914bad414e8269d593c31d4de4 Aug 27 02:31:35.977272 n-d-852278-4 devstack@n-api.service[106582]: X-Project-Name: admin Aug 27 02:31:35.977272 n-d-852278-4 devstack@n-api.service[106582]: X-Role: reader,admin,member Aug 27 02:31:35.977272 n-d-852278-4 devstack@n-api.service[106582]: X-Roles: reader,admin,member Aug 27 02:31:35.978882 n-d-852278-4 devstack@n-api.service[106582]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/1db248914bad414e8269d593c31d4de4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_1db248914bad414e8269d593c31d4de4", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/1db248914bad414e8269d593c31d4de4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/1db248914bad414e8269d593c31d4de4"}]}] Aug 27 02:31:35.978882 n-d-852278-4 devstack@n-api.service[106582]: X-Tenant: admin Aug 27 02:31:35.978882 n-d-852278-4 devstack@n-api.service[106582]: X-Tenant-Id: 1db248914bad414e8269d593c31d4de4 Aug 27 02:31:35.978882 n-d-852278-4 devstack@n-api.service[106582]: X-Tenant-Name: admin Aug 27 02:31:35.978882 n-d-852278-4 devstack@n-api.service[106582]: X-User: admin Aug 27 02:31:35.978882 n-d-852278-4 devstack@n-api.service[106582]: X-User-Domain-Id: default Aug 27 02:31:35.978882 n-d-852278-4 devstack@n-api.service[106582]: X-User-Domain-Name: Default Aug 27 02:31:35.978882 n-d-852278-4 devstack@n-api.service[106582]: X-User-Id: cd1ca7ea2f56450086b024bede14e7e0 Aug 27 02:31:35.978882 n-d-852278-4 devstack@n-api.service[106582]: X-User-Name: admin Aug 27 02:31:35.978882 n-d-852278-4 devstack@n-api.service[106582]: method: > Aug 27 02:31:35.978882 n-d-852278-4 devstack@n-api.service[106582]: exception: Flavor 451 could not be found. Aug 27 02:31:35.978882 n-d-852278-4 devstack@n-api.service[106582]: action_args: {'id': '451'} Aug 27 02:31:35.978882 n-d-852278-4 devstack@n-api.service[106582]: {{(pid=106582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:31:35.978882 n-d-852278-4 devstack@n-api.service[106582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:31:35.979804 n-d-852278-4 devstack@n-api.service[106582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 27 02:31:35.979804 n-d-852278-4 devstack@n-api.service[106582]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 27 02:31:35.979804 n-d-852278-4 devstack@n-api.service[106582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 27 02:31:35.979804 n-d-852278-4 devstack@n-api.service[106582]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 27 02:31:35.979804 n-d-852278-4 devstack@n-api.service[106582]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 02:31:35.979804 n-d-852278-4 devstack@n-api.service[106582]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 02:31:35.979804 n-d-852278-4 devstack@n-api.service[106582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 27 02:31:35.979804 n-d-852278-4 devstack@n-api.service[106582]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 27 02:31:35.979804 n-d-852278-4 devstack@n-api.service[106582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 27 02:31:35.979804 n-d-852278-4 devstack@n-api.service[106582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:31:35.979804 n-d-852278-4 devstack@n-api.service[106582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 27 02:31:35.979804 n-d-852278-4 devstack@n-api.service[106582]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 27 02:31:35.979804 n-d-852278-4 devstack@n-api.service[106582]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 27 02:31:35.979804 n-d-852278-4 devstack@n-api.service[106582]: ERROR nova.api.openstack.wsgi Aug 27 02:31:35.979804 n-d-852278-4 devstack@n-api.service[106582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:31:35.979804 n-d-852278-4 devstack@n-api.service[106582]: ERROR nova.api.openstack.wsgi Aug 27 02:31:35.979804 n-d-852278-4 devstack@n-api.service[106582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:31:35.979804 n-d-852278-4 devstack@n-api.service[106582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:31:35.979804 n-d-852278-4 devstack@n-api.service[106582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:31:35.981222 n-d-852278-4 devstack@n-api.service[106582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:31:35.981222 n-d-852278-4 devstack@n-api.service[106582]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:31:35.981222 n-d-852278-4 devstack@n-api.service[106582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:31:35.981222 n-d-852278-4 devstack@n-api.service[106582]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:31:35.981222 n-d-852278-4 devstack@n-api.service[106582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 27 02:31:35.981222 n-d-852278-4 devstack@n-api.service[106582]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:31:35.981222 n-d-852278-4 devstack@n-api.service[106582]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 27 02:31:35.981222 n-d-852278-4 devstack@n-api.service[106582]: ERROR nova.api.openstack.wsgi Aug 27 02:31:35.981222 n-d-852278-4 devstack@n-api.service[106582]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:31:35.981222 n-d-852278-4 devstack@n-api.service[106582]: ERROR nova.api.openstack.wsgi Aug 27 02:31:35.981222 n-d-852278-4 devstack@n-api.service[106582]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:31:35.981222 n-d-852278-4 devstack@n-api.service[106582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:31:35.981222 n-d-852278-4 devstack@n-api.service[106582]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:31:35.981222 n-d-852278-4 devstack@n-api.service[106582]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:31:35.981222 n-d-852278-4 devstack@n-api.service[106582]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:31:35.981222 n-d-852278-4 devstack@n-api.service[106582]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 27 02:31:35.981222 n-d-852278-4 devstack@n-api.service[106582]: ERROR nova.api.openstack.wsgi Aug 27 02:31:35.981222 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi [None req-29e81eef-8fdc-4ebd-ac3e-42ba81c85b76 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:31:35.982442 n-d-852278-4 devstack@n-api.service[106582]: INFO nova.api.openstack.requestlog [None req-29e81eef-8fdc-4ebd-ac3e-42ba81c85b76 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012694 Aug 27 02:31:35.982442 n-d-852278-4 devstack@n-api.service[106582]: [pid: 106582|app: 0|req: 27/52] 10.222.0.70 () {60 vars in 1193 bytes} [Sat Aug 27 02:31:35 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 27 02:31:36.956182 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi [None req-f5dd8593-c8f9-4b1e-9cbf-fa365c234ebc admin admin] Calling method '>' {{(pid=106581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:36.956757 n-d-852278-4 devstack@n-api.service[106581]: INFO nova.api.openstack.requestlog [None req-f5dd8593-c8f9-4b1e-9cbf-fa365c234ebc admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001978 Aug 27 02:31:36.957151 n-d-852278-4 devstack@n-api.service[106581]: [pid: 106581|app: 0|req: 26/53] 10.222.0.70 () {56 vars in 1074 bytes} [Sat Aug 27 02:31:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:31:37.526508 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi [None req-39953a99-a0e1-4370-a713-045addab02cc admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:31:37.549650 n-d-852278-4 devstack@n-api.service[106582]: INFO nova.api.openstack.requestlog [None req-39953a99-a0e1-4370-a713-045addab02cc admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.453860 Aug 27 02:31:37.550210 n-d-852278-4 devstack@n-api.service[106582]: [pid: 106582|app: 0|req: 28/54] 10.222.0.70 () {64 vars in 1235 bytes} [Sat Aug 27 02:31:37 2022] POST /compute/v2.1/flavors => generated 404 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:31:38.544769 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi [None req-f5dd8593-c8f9-4b1e-9cbf-fa365c234ebc admin admin] Calling method '>' {{(pid=106581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:38.545877 n-d-852278-4 devstack@n-api.service[106581]: INFO nova.api.openstack.requestlog [None req-f5dd8593-c8f9-4b1e-9cbf-fa365c234ebc admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001632 Aug 27 02:31:38.546279 n-d-852278-4 devstack@n-api.service[106581]: [pid: 106581|app: 0|req: 27/55] 10.222.0.70 () {56 vars in 1074 bytes} [Sat Aug 27 02:31:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:31:39.127426 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi [None req-622f5325-221c-4fb7-80de-1d4eeb187191 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:31:39.151127 n-d-852278-4 devstack@n-api.service[106582]: INFO nova.api.openstack.requestlog [None req-622f5325-221c-4fb7-80de-1d4eeb187191 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.467657 Aug 27 02:31:39.151687 n-d-852278-4 devstack@n-api.service[106582]: [pid: 106582|app: 0|req: 29/56] 10.222.0.70 () {64 vars in 1235 bytes} [Sat Aug 27 02:31:38 2022] POST /compute/v2.1/flavors => generated 405 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:31:40.159692 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi [None req-f5dd8593-c8f9-4b1e-9cbf-fa365c234ebc admin admin] Calling method '>' {{(pid=106581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:40.160911 n-d-852278-4 devstack@n-api.service[106581]: INFO nova.api.openstack.requestlog [None req-f5dd8593-c8f9-4b1e-9cbf-fa365c234ebc admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001876 Aug 27 02:31:40.161463 n-d-852278-4 devstack@n-api.service[106581]: [pid: 106581|app: 0|req: 28/57] 10.222.0.70 () {56 vars in 1074 bytes} [Sat Aug 27 02:31:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:31:40.759340 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi [None req-a9d59819-8f31-4500-84a6-5b4bea6d9fcb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:31:40.781649 n-d-852278-4 devstack@n-api.service[106582]: INFO nova.api.openstack.requestlog [None req-a9d59819-8f31-4500-84a6-5b4bea6d9fcb admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.473106 Aug 27 02:31:40.782192 n-d-852278-4 devstack@n-api.service[106582]: [pid: 106582|app: 0|req: 30/58] 10.222.0.70 () {64 vars in 1235 bytes} [Sat Aug 27 02:31:40 2022] POST /compute/v2.1/flavors => generated 407 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:31:41.777914 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi [None req-f5dd8593-c8f9-4b1e-9cbf-fa365c234ebc admin admin] Calling method '>' {{(pid=106581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:41.779517 n-d-852278-4 devstack@n-api.service[106581]: INFO nova.api.openstack.requestlog [None req-f5dd8593-c8f9-4b1e-9cbf-fa365c234ebc admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002596 Aug 27 02:31:41.780078 n-d-852278-4 devstack@n-api.service[106581]: [pid: 106581|app: 0|req: 29/59] 10.222.0.70 () {56 vars in 1074 bytes} [Sat Aug 27 02:31:41 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:31:42.484318 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi [None req-464a4fd8-4122-4778-88e8-07d52f45439a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:31:42.506025 n-d-852278-4 devstack@n-api.service[106582]: INFO nova.api.openstack.requestlog [None req-464a4fd8-4122-4778-88e8-07d52f45439a admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.580302 Aug 27 02:31:42.506568 n-d-852278-4 devstack@n-api.service[106582]: [pid: 106582|app: 0|req: 31/60] 10.222.0.70 () {64 vars in 1235 bytes} [Sat Aug 27 02:31:41 2022] POST /compute/v2.1/flavors => generated 409 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:31:43.516143 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi [None req-f5dd8593-c8f9-4b1e-9cbf-fa365c234ebc admin admin] Calling method '>' {{(pid=106581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:43.517189 n-d-852278-4 devstack@n-api.service[106581]: INFO nova.api.openstack.requestlog [None req-f5dd8593-c8f9-4b1e-9cbf-fa365c234ebc admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001560 Aug 27 02:31:43.517566 n-d-852278-4 devstack@n-api.service[106581]: [pid: 106581|app: 0|req: 30/61] 10.222.0.70 () {56 vars in 1074 bytes} [Sat Aug 27 02:31:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:31:44.097574 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi [None req-ead16617-ea22-4b73-adad-1b7f200c3387 admin admin] Calling method '>' {{(pid=106582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:44.117850 n-d-852278-4 devstack@n-api.service[106582]: INFO nova.api.openstack.requestlog [None req-ead16617-ea22-4b73-adad-1b7f200c3387 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.464458 Aug 27 02:31:44.118335 n-d-852278-4 devstack@n-api.service[106582]: [pid: 106582|app: 0|req: 32/62] 10.222.0.70 () {60 vars in 1202 bytes} [Sat Aug 27 02:31:43 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:32:38.680106 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi [None req-f5dd8593-c8f9-4b1e-9cbf-fa365c234ebc admin admin] Calling method '>' {{(pid=106581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:32:38.681387 n-d-852278-4 devstack@n-api.service[106581]: INFO nova.api.openstack.requestlog [None req-f5dd8593-c8f9-4b1e-9cbf-fa365c234ebc admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001976 Aug 27 02:32:38.681972 n-d-852278-4 devstack@n-api.service[106581]: [pid: 106581|app: 0|req: 31/63] 10.222.0.70 () {54 vars in 931 bytes} [Sat Aug 27 02:32:38 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:32:38.699683 n-d-852278-4 devstack@n-api.service[106582]: DEBUG dbcounter [-] [106582] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=106582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:32:39.128162 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi [None req-94bbea12-abdf-41b6-a614-73ca5e27dabc admin admin] Calling method '>' {{(pid=106582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:32:39.148812 n-d-852278-4 devstack@n-api.service[106582]: INFO nova.api.openstack.requestlog [None req-94bbea12-abdf-41b6-a614-73ca5e27dabc admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.456548 Aug 27 02:32:39.149349 n-d-852278-4 devstack@n-api.service[106582]: [pid: 106582|app: 0|req: 33/64] 10.222.0.70 () {60 vars in 1292 bytes} [Sat Aug 27 02:32:38 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:32:39.170917 n-d-852278-4 devstack@n-api.service[106581]: DEBUG dbcounter [-] [106581] Writing DB stats nova_api:SELECT=14 {{(pid=106581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:32:39.174825 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi [None req-3f4a9b39-cd81-40e5-825e-da0c3b8dde16 admin admin] Calling method '>' {{(pid=106581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:32:39.183176 n-d-852278-4 devstack@n-api.service[106581]: INFO nova.api.openstack.requestlog [None req-3f4a9b39-cd81-40e5-825e-da0c3b8dde16 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013829 Aug 27 02:32:39.183741 n-d-852278-4 devstack@n-api.service[106581]: [pid: 106581|app: 0|req: 32/65] 10.222.0.70 () {60 vars in 1283 bytes} [Sat Aug 27 02:32:39 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:32:39.198607 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi [None req-052653f3-aa32-46fd-94cf-1ec78d5104c8 admin admin] Calling method '>' {{(pid=106582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:32:39.208224 n-d-852278-4 devstack@n-api.service[106582]: INFO nova.api.openstack.requestlog [None req-052653f3-aa32-46fd-94cf-1ec78d5104c8 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.015511 Aug 27 02:32:39.208876 n-d-852278-4 devstack@n-api.service[106582]: [pid: 106582|app: 0|req: 34/66] 10.222.0.70 () {60 vars in 1286 bytes} [Sat Aug 27 02:32:39 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:32:39.220964 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi [None req-8862065a-5c03-4c86-bbb4-659329bed67a admin admin] Calling method '>' {{(pid=106581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:32:39.229266 n-d-852278-4 devstack@n-api.service[106581]: INFO nova.api.openstack.requestlog [None req-8862065a-5c03-4c86-bbb4-659329bed67a admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011965 Aug 27 02:32:39.229787 n-d-852278-4 devstack@n-api.service[106581]: [pid: 106581|app: 0|req: 33/67] 10.222.0.70 () {60 vars in 1286 bytes} [Sat Aug 27 02:32:39 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:32:39.244245 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi [None req-22c26c37-9d9b-40e7-bb8e-57220cf2b2cb admin admin] Calling method '>' {{(pid=106582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:32:39.256235 n-d-852278-4 devstack@n-api.service[106582]: INFO nova.api.openstack.requestlog [None req-22c26c37-9d9b-40e7-bb8e-57220cf2b2cb admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.017395 Aug 27 02:32:39.256837 n-d-852278-4 devstack@n-api.service[106582]: [pid: 106582|app: 0|req: 35/68] 10.222.0.70 () {60 vars in 1283 bytes} [Sat Aug 27 02:32:39 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:38:07.768907 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi [None req-8862065a-5c03-4c86-bbb4-659329bed67a admin admin] Calling method '>' {{(pid=106581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:07.769899 n-d-852278-4 devstack@n-api.service[106581]: INFO nova.api.openstack.requestlog [None req-8862065a-5c03-4c86-bbb4-659329bed67a admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001598 Aug 27 02:38:07.770290 n-d-852278-4 devstack@n-api.service[106581]: [pid: 106581|app: 0|req: 34/69] 10.222.0.70 () {56 vars in 1074 bytes} [Sat Aug 27 02:38:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:38:07.915075 n-d-852278-4 devstack@n-api.service[106582]: DEBUG dbcounter [-] [106582] Writing DB stats nova_api:SELECT=6 {{(pid=106582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:38:08.076442 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi [None req-5ff59327-1e22-43d8-9f11-1fa513bbfbf0 admin admin] Calling method '>' {{(pid=106582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:08.079991 n-d-852278-4 devstack@n-api.service[106582]: DEBUG oslo_concurrency.lockutils [None req-5ff59327-1e22-43d8-9f11-1fa513bbfbf0 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:08.080565 n-d-852278-4 devstack@n-api.service[106582]: DEBUG oslo_concurrency.lockutils [None req-5ff59327-1e22-43d8-9f11-1fa513bbfbf0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:08.080997 n-d-852278-4 devstack@n-api.service[106582]: DEBUG oslo_concurrency.lockutils [None req-5ff59327-1e22-43d8-9f11-1fa513bbfbf0 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:08.081713 n-d-852278-4 devstack@n-api.service[106582]: DEBUG oslo_concurrency.lockutils [None req-5ff59327-1e22-43d8-9f11-1fa513bbfbf0 admin admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:08.082159 n-d-852278-4 devstack@n-api.service[106582]: DEBUG oslo_concurrency.lockutils [None req-5ff59327-1e22-43d8-9f11-1fa513bbfbf0 admin admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:08.082572 n-d-852278-4 devstack@n-api.service[106582]: DEBUG oslo_concurrency.lockutils [None req-5ff59327-1e22-43d8-9f11-1fa513bbfbf0 admin admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:08.123024 n-d-852278-4 devstack@n-api.service[106582]: INFO nova.api.openstack.requestlog [None req-5ff59327-1e22-43d8-9f11-1fa513bbfbf0 admin admin] 10.222.0.70 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.90 time: 0.210389 Aug 27 02:38:08.123586 n-d-852278-4 devstack@n-api.service[106582]: [pid: 106582|app: 0|req: 36/70] 10.222.0.70 () {60 vars in 1193 bytes} [Sat Aug 27 02:38:07 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:38:08.951207 n-d-852278-4 devstack@n-api.service[106581]: DEBUG nova.api.openstack.wsgi [None req-8862065a-5c03-4c86-bbb4-659329bed67a admin admin] Calling method '>' {{(pid=106581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:08.952253 n-d-852278-4 devstack@n-api.service[106581]: INFO nova.api.openstack.requestlog [None req-8862065a-5c03-4c86-bbb4-659329bed67a admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001512 Aug 27 02:38:08.952955 n-d-852278-4 devstack@n-api.service[106581]: [pid: 106581|app: 0|req: 35/71] 10.222.0.70 () {56 vars in 1074 bytes} [Sat Aug 27 02:38:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:38:09.164342 n-d-852278-4 devstack@n-api.service[106582]: DEBUG nova.api.openstack.wsgi [None req-fea4243d-03d6-471f-8975-b9ad573e260d admin admin] Calling method '>' {{(pid=106582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:09.167820 n-d-852278-4 devstack@n-api.service[106582]: DEBUG oslo_concurrency.lockutils [None req-fea4243d-03d6-471f-8975-b9ad573e260d admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:09.168848 n-d-852278-4 devstack@n-api.service[106582]: DEBUG oslo_concurrency.lockutils [None req-fea4243d-03d6-471f-8975-b9ad573e260d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:09.169286 n-d-852278-4 devstack@n-api.service[106582]: DEBUG oslo_concurrency.lockutils [None req-fea4243d-03d6-471f-8975-b9ad573e260d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:09.169989 n-d-852278-4 devstack@n-api.service[106582]: DEBUG oslo_concurrency.lockutils [None req-fea4243d-03d6-471f-8975-b9ad573e260d admin admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:09.170424 n-d-852278-4 devstack@n-api.service[106582]: DEBUG oslo_concurrency.lockutils [None req-fea4243d-03d6-471f-8975-b9ad573e260d admin admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:09.170833 n-d-852278-4 devstack@n-api.service[106582]: DEBUG oslo_concurrency.lockutils [None req-fea4243d-03d6-471f-8975-b9ad573e260d admin admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:09.193201 n-d-852278-4 devstack@n-api.service[106582]: INFO nova.api.openstack.requestlog [None req-fea4243d-03d6-471f-8975-b9ad573e260d admin admin] 10.222.0.70 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.90 time: 0.097164 Aug 27 02:38:09.193749 n-d-852278-4 devstack@n-api.service[106582]: [pid: 106582|app: 0|req: 37/72] 10.222.0.70 () {60 vars in 1193 bytes} [Sat Aug 27 02:38:09 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:38:55.828014 n-d-852278-4 devstack@n-api.service[106580]: Sat Aug 27 02:38:55 2022 - graceful shutdown triggered... Aug 27 02:38:55.828586 n-d-852278-4 devstack@n-api.service[106581]: Gracefully killing worker 1 (pid: 106581)... Aug 27 02:38:55.829846 n-d-852278-4 devstack@n-api.service[106582]: Gracefully killing worker 2 (pid: 106582)... Aug 27 02:38:55.830419 n-d-852278-4 systemd[1]: Stopping Devstack devstack@n-api.service... Aug 27 02:38:56.828678 n-d-852278-4 devstack@n-api.service[106580]: worker 1 buried after 1 seconds Aug 27 02:38:56.828678 n-d-852278-4 devstack@n-api.service[106580]: worker 2 buried after 1 seconds Aug 27 02:38:56.828678 n-d-852278-4 devstack@n-api.service[106580]: goodbye to uWSGI. Aug 27 02:38:56.831170 n-d-852278-4 systemd[1]: devstack@n-api.service: Succeeded. Aug 27 02:38:56.832235 n-d-852278-4 systemd[1]: Stopped Devstack devstack@n-api.service. Aug 27 02:38:56.836524 n-d-852278-4 systemd[1]: Starting Devstack devstack@n-api.service... Aug 27 02:38:56.860209 n-d-852278-4 devstack@n-api.service[134042]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 27 02:38:56.880011 n-d-852278-4 devstack@n-api.service[134042]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Aug 27 02:38:56 2022] *** Aug 27 02:38:56.880011 n-d-852278-4 devstack@n-api.service[134042]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 27 02:38:56.880011 n-d-852278-4 devstack@n-api.service[134042]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 27 02:38:56.880011 n-d-852278-4 devstack@n-api.service[134042]: nodename: n-d-852278-4 Aug 27 02:38:56.880011 n-d-852278-4 devstack@n-api.service[134042]: machine: x86_64 Aug 27 02:38:56.880011 n-d-852278-4 devstack@n-api.service[134042]: clock source: unix Aug 27 02:38:56.880011 n-d-852278-4 devstack@n-api.service[134042]: pcre jit disabled Aug 27 02:38:56.880011 n-d-852278-4 devstack@n-api.service[134042]: detected number of CPU cores: 4 Aug 27 02:38:56.880011 n-d-852278-4 devstack@n-api.service[134042]: current working directory: / Aug 27 02:38:56.880011 n-d-852278-4 devstack@n-api.service[134042]: detected binary path: /usr/bin/uwsgi-core Aug 27 02:38:56.880011 n-d-852278-4 devstack@n-api.service[134042]: your processes number limit is 47680 Aug 27 02:38:56.880011 n-d-852278-4 devstack@n-api.service[134042]: your memory page size is 4096 bytes Aug 27 02:38:56.880011 n-d-852278-4 devstack@n-api.service[134042]: detected max file descriptor number: 2048 Aug 27 02:38:56.880011 n-d-852278-4 devstack@n-api.service[134042]: lock engine: pthread robust mutexes Aug 27 02:38:56.881049 n-d-852278-4 devstack@n-api.service[134042]: thunder lock: enabled Aug 27 02:38:56.881049 n-d-852278-4 devstack@n-api.service[134042]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 27 02:38:56.881049 n-d-852278-4 devstack@n-api.service[134042]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 27 02:38:56.920619 n-d-852278-4 devstack@n-api.service[134042]: Python main interpreter initialized at 0x5643f61a99c0 Aug 27 02:38:56.920619 n-d-852278-4 devstack@n-api.service[134042]: python threads support enabled Aug 27 02:38:56.920619 n-d-852278-4 devstack@n-api.service[134042]: your server socket listen backlog is limited to 100 connections Aug 27 02:38:56.920619 n-d-852278-4 devstack@n-api.service[134042]: your mercy for graceful operations on workers is 90 seconds Aug 27 02:38:56.921052 n-d-852278-4 devstack@n-api.service[134042]: mapped 403077 bytes (393 KB) for 2 cores Aug 27 02:38:56.921052 n-d-852278-4 devstack@n-api.service[134042]: *** Operational MODE: preforking *** Aug 27 02:38:56.921291 n-d-852278-4 devstack@n-api.service[134042]: *** uWSGI is running in multiple interpreter mode *** Aug 27 02:38:56.921291 n-d-852278-4 devstack@n-api.service[134042]: spawned uWSGI master process (pid: 134042) Aug 27 02:38:56.921501 n-d-852278-4 systemd[1]: Started Devstack devstack@n-api.service. Aug 27 02:38:56.924256 n-d-852278-4 devstack@n-api.service[134042]: spawned uWSGI worker 1 (pid: 134051, cores: 1) Aug 27 02:38:56.924256 n-d-852278-4 devstack@n-api.service[134042]: spawned uWSGI worker 2 (pid: 134052, cores: 1) Aug 27 02:38:56.924256 n-d-852278-4 devstack@n-api.service[134042]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 27 02:38:57.574290 n-d-852278-4 devstack@n-api.service[134052]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 27 02:38:57.581150 n-d-852278-4 devstack@n-api.service[134051]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 27 02:38:58.714663 n-d-852278-4 devstack@n-api.service[134052]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 02:38:58.714663 n-d-852278-4 devstack@n-api.service[134052]: from cryptography.utils import int_from_bytes Aug 27 02:38:58.715376 n-d-852278-4 devstack@n-api.service[134052]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 02:38:58.715376 n-d-852278-4 devstack@n-api.service[134052]: from cryptography.utils import int_from_bytes Aug 27 02:38:58.719577 n-d-852278-4 devstack@n-api.service[134051]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 02:38:58.719577 n-d-852278-4 devstack@n-api.service[134051]: from cryptography.utils import int_from_bytes Aug 27 02:38:58.720037 n-d-852278-4 devstack@n-api.service[134051]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 02:38:58.720037 n-d-852278-4 devstack@n-api.service[134051]: from cryptography.utils import int_from_bytes Aug 27 02:39:01.102625 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 27 02:39:01.103205 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 27 02:39:01.103490 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 27 02:39:01.103733 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 27 02:39:01.103989 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 27 02:39:01.104412 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.104741 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.104851 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 27 02:39:01.105206 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.105301 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 27 02:39:01.105385 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.105579 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 27 02:39:01.105699 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.105943 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 27 02:39:01.106072 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.106241 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 27 02:39:01.106343 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.106595 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.106710 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.106924 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.107045 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.107192 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.107298 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.107536 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.107674 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.107859 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-852278-4 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.107974 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.108155 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.108273 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.108487 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.108590 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.108774 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.108877 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.109124 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.109279 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.109456 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.109647 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.109848 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.110020 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.110020 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.110394 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-852278-4 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.110394 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.110703 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.112094 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.112094 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.112593 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.113790 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.114041 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.114268 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.114553 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.114880 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.115142 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.115452 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.115717 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.115989 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.116252 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.116502 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.116757 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.116985 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.117173 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.117373 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.117555 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.117716 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.117865 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.118062 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.118216 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-852278-4 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.118367 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.118650 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.118811 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.118956 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.119120 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.119282 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.120072 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.120241 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.120422 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.120585 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.120743 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-852278-4 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.120929 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.121097 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.121704 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.121888 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.122046 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.122207 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.122368 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.122512 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.122737 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.122895 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.123046 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.123202 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.123376 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.123538 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.123707 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.123863 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.124013 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.124163 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.124361 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.124524 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.124676 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.124830 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.124984 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.125149 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.125306 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.125474 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.125624 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.125624 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.125926 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.126131 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.126297 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.126454 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.126664 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.126817 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.127205 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.127374 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.127534 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.127697 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.127843 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.127998 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.128161 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.128572 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.128732 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.128877 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.129033 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.129177 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.129277 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.129416 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.129579 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.129939 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.130098 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.130098 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.130285 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.130370 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.130461 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.130555 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.130656 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.130757 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.130851 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.130941 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.131033 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.131126 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.131407 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.131595 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.131853 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.131947 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.132034 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.132129 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.132228 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.132336 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.132423 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.132520 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.132607 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.70 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.132699 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.132799 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.70 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.132893 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.132977 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.133069 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.133155 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.133238 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.133336 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.133430 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.133521 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.133612 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.70 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.133704 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.133788 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.70 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.133886 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.133974 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.134064 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.134148 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.134239 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.134337 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.134423 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.134513 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.134597 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.134688 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.134779 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.134877 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.135013 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.135124 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.135242 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.135242 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.135463 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.135762 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.135866 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.136001 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.136152 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.136240 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.136350 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.136459 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.136545 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.136545 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.136711 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.136802 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.136886 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.136978 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.137068 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.137151 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.137233 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.137321 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.137415 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.137501 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.137584 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.137584 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.137748 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.137748 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.137914 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.137914 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.138076 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.138169 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.138255 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.138338 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.138433 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.138433 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.138605 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.138688 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.138770 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.138852 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.138951 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.139039 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.139131 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.139215 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.139303 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.139396 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.139487 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.139571 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.139653 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.139653 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.139836 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.140088 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.140192 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.140192 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.140445 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.140533 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.140623 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.140725 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.140819 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.140819 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.140973 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.141063 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.141158 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.141318 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.141412 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.141510 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.141645 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.141781 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.142021 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.142130 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.142223 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.142318 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.142412 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.142502 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.142596 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.142688 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.142780 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.142871 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.142945 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.143085 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.143183 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.143276 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.143360 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.143451 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.143541 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.143665 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.143819 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.143962 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.144126 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.144256 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.144486 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.144594 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.144743 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.144900 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.145045 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.145205 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.145351 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.145507 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.145654 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.145809 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.145957 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.146122 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.146267 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.146457 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.146560 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.146785 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.146885 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.147129 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.147221 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.147439 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.147541 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.147740 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.147846 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.148061 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:39:01.148155 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.148425 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.148524 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.148763 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.148856 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.149081 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.149181 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.149410 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.149510 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.149719 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.149817 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.150082 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.150239 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.150332 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.150454 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.150637 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.150729 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.150953 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.151064 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.151277 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.151369 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.151588 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.151716 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.151899 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.152030 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.152214 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.152376 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.152612 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.152704 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.152848 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.152956 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.153172 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.153303 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.153486 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.153805 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.154123 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.157210 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.157389 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.157524 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.157650 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.157807 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.157942 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.158071 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.158198 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.158316 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.158594 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.158703 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.158799 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.158899 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.158993 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.159079 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.159169 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.159262 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.159349 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.159445 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.159530 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.159621 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.159712 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.159712 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.159865 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.160013 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.160153 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.160397 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.160533 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.160533 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.160757 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.160877 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.160987 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.161097 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.161207 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.161316 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.161586 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.161716 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.161840 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.161960 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.162072 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.162072 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.162701 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.162840 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.162976 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.163073 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.163298 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.163410 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.163508 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.163602 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.163690 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.163781 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.163866 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.163958 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.164043 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.164134 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.164226 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.164334 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.164434 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.164534 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.164621 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.164704 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.164800 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.164891 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.164975 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.165071 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.165157 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.165239 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.165332 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.165418 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.165508 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.165601 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.165688 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.165779 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.165872 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.165957 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.166047 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.166142 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.166229 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.166387 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.166489 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.166700 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.166855 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.167007 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.167105 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.167319 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.167420 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.167621 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.167726 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.167931 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.168022 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.168235 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.168373 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.168563 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.168671 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.168873 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.168971 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.169181 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.169271 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.169485 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.169588 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.169805 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.169901 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.170109 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.170204 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.170399 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.170601 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.170718 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.170820 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.171023 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.171123 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.171331 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.171425 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.171657 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.171757 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.171951 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.172049 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.172262 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.172420 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.172638 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.172773 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.172905 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.172997 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.173212 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.173316 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.173730 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.173822 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.173907 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.173996 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.174165 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.174268 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.174488 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.174587 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.174794 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.174912 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.175095 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.175185 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.175402 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.175495 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.175705 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.175807 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.176008 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.176100 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.176426 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.176537 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.176671 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.177094 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.177248 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.177353 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.177549 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.177647 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.177850 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.177943 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.178149 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.178241 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.178447 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.178539 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.178751 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.178843 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.179058 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.179149 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.179361 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.179461 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.179668 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.179786 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.179973 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.180084 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.180288 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.180557 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.180812 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.180909 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.180995 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.181191 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.181429 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.181538 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.181743 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.181844 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.182092 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.182265 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.182435 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.182548 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.182794 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.182951 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.183042 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.183135 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.183354 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.183463 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.183661 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.183761 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.183970 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.184062 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.184281 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.184516 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.184611 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.184702 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.184916 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.185044 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.185222 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.185354 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.185536 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.185636 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.185844 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.185944 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.186156 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.186257 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.186460 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.186593 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.186776 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.186882 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.187093 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.187194 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.187403 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.187504 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.187719 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.187816 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.188033 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.188138 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.188359 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.188457 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.188673 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.188769 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.188996 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.189129 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.189340 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.189438 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.189650 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.189762 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.189958 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.190056 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.190269 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.190366 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.190579 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.190736 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.190903 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.190993 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.191191 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.191284 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.191503 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.191609 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.191809 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.191909 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.192120 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.192220 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.192443 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.192556 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.192822 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.192982 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.193102 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.193241 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.193374 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.193467 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.193674 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.193780 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.193992 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.194091 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.194311 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.194403 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.194621 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.194711 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.194927 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.195025 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.195236 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.195336 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.195540 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.195633 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.195842 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.195944 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.196149 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.196243 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.196476 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.196583 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.196784 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.196929 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.197093 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.197183 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.197394 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.197494 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.197705 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.197811 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.198009 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.198107 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.198310 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.198403 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.198615 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.198736 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.198918 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.199020 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.199222 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.199333 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.199525 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.199631 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.199835 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.199936 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.200154 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.200252 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.200477 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.200599 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.200780 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.200875 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.201105 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.201228 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.201426 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.201538 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.201729 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.201852 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.202029 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.202129 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.202343 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.202497 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.202657 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.202790 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.202988 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.203131 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.203285 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.203387 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.203573 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.203780 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.203884 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.203967 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.204193 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.204295 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.204537 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.204659 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.204890 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.205002 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.205174 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.205267 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.205493 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.205592 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.205806 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.205906 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.206112 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.206216 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.206421 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.206513 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.206730 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.206836 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.207039 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.207132 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.207344 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.207435 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.207654 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.207756 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.207961 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.208052 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.208271 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.208397 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.208603 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.208697 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.208906 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.209005 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.209215 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.209316 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.209525 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.209624 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.209833 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.210115 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.210207 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.210450 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.210555 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.210767 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.211030 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.211167 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.211371 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.211466 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.211693 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.211801 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.212030 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.212161 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.212383 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.212483 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.212736 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.212826 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.213098 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.213256 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.213348 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.213447 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.213640 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.213743 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.213943 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.214035 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.214251 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.214356 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.214557 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.214651 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.214863 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.214958 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.215165 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.215267 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.215472 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.215574 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.215771 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.215872 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.216074 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.216181 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.216395 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.216564 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.216699 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.216807 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.217002 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.217108 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.217303 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.217395 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.217609 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.217717 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.217910 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.218053 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.218215 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.218321 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.218530 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.218624 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.218830 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.218940 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.219131 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.219232 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.219445 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.219544 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.219754 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.219847 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.220058 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.220161 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.220427 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.220527 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.220774 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.220870 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.221080 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.221172 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.221403 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.221509 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.221706 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.221807 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.222029 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.222129 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.222333 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.222426 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.222634 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.222728 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.222938 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.223038 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.223248 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.223365 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.223548 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.223653 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.223848 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.223952 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.224155 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.224298 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.224489 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.224595 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.224796 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.224897 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.225100 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.225274 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.225426 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.225520 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.225732 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.225833 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.226034 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.226136 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.226337 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.226429 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.226642 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.226733 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.226940 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.227033 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.227238 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.227337 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.227544 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.227645 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.227849 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.227941 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.228147 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.228238 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.228476 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.228571 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.228780 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.228875 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.229086 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.229178 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.229390 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.229490 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.229693 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.229786 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.229995 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.230095 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.230299 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.230404 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.230608 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.230734 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.230909 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.231016 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.231216 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.231319 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.231521 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.231614 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.231821 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.231922 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.232121 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.232298 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.232440 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.232525 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.232737 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.232843 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.233036 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.233149 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.233340 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.233475 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.233645 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.233739 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.233949 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.234044 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.234251 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.234350 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.234559 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.234663 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.234860 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.234961 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.235163 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.235255 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.235465 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.235569 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.235769 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.235879 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.236094 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.236194 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.236421 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.236517 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.236724 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.236817 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.237025 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.237116 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.237323 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.237423 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.237625 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.237715 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.237932 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.238024 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.238232 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.238331 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.238535 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.238636 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.238837 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.238935 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.239144 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.239252 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.239449 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.239542 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.239754 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.239846 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.240100 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.240202 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.240429 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.240537 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.240749 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.240840 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.241059 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.241152 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.241370 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.241470 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.241684 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.241787 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.241986 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.242079 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.242299 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.242390 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.242607 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.242705 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.242914 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.243013 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.243213 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.243311 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.243517 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.243620 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.243831 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.243934 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.244139 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.244241 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.244469 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.244597 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.244806 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.244907 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.245120 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.245214 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.245433 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.245535 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.245734 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.245825 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.246040 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.246140 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.246348 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.246449 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.246653 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.246746 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.246960 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.247053 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.247269 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.247369 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.247577 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.247683 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.247885 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.247984 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.248195 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.248300 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.248527 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.248627 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.248835 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.248929 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.249142 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.249243 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.249449 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.249541 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.249754 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.249853 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.250055 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.250155 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.250364 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.250464 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.250669 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.250767 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.250969 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.251070 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.251406 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.251550 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.251691 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.251792 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.251919 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.252014 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.252225 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.252367 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.252554 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.252660 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.252866 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.252960 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.253172 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.253275 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.253928 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.254054 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.254145 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.254219 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.254289 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.254358 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.254436 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.254530 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.254749 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.254842 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.255050 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.255144 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.255391 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.255498 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.255707 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.255809 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.256014 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.256108 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.256376 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.256475 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.256683 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.256789 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.256985 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.257077 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.257291 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.257431 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.257611 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.257705 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.257914 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.258007 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.258216 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.258309 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.258517 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.258620 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.258835 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.258934 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.259139 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.259240 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.259443 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.259542 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.259771 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.259878 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.260078 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.260170 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.260425 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.260534 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.260846 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.261021 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.261160 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.261260 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.261465 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.261608 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.261780 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.261881 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.262098 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.262189 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.262418 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.262524 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.262721 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.262813 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.263035 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.263134 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.263343 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.263444 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.263662 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.263754 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.263980 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.264079 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.264291 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.264447 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.264624 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.264726 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.264928 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.265018 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.265248 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.265345 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.265563 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.265654 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.265871 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.265963 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.266188 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.266288 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.266510 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.266601 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.266825 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.266925 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.267192 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.267293 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.267565 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.267730 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.267893 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.267980 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.268191 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.268290 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.268521 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.268661 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.268832 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.268983 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.269137 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.269274 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.269460 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.269544 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.269793 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.269894 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.270101 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.270201 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.270411 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.270511 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.270726 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.270827 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.271038 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.271175 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.271342 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.271441 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.271652 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.271766 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.271963 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.272122 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.272249 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.272423 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.272595 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.272699 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.272909 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.273017 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.273213 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.273327 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.273541 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.273634 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.273850 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.273958 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.274155 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.274255 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.274462 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.274561 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.274769 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.274861 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.275070 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.275169 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.275381 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.275482 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.275714 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.275805 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.276024 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.276138 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.276359 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.276495 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.276699 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.276799 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.277014 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.277115 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.277342 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.277441 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.277687 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.277786 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.278020 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.278126 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.278334 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.278433 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.278662 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.278752 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.278989 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.279095 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.279297 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.279389 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.279603 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.279705 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.279913 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.280007 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.280223 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.280363 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.280556 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.280651 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.280863 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.280973 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.281174 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.281314 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.281475 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.281574 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.281778 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.281876 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.282083 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.282179 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.282394 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.282484 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.282701 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.282851 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.283028 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.283122 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.283354 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.283466 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.283661 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.283754 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.283980 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.284082 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.284285 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.284410 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.284615 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.284713 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.284922 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.285025 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.285235 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.285384 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.285556 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.285647 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.285867 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.285972 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.286191 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.286291 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.286506 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.286613 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.286822 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.286914 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.287136 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.287229 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.287448 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.287539 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.287763 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.287855 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.288081 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.288189 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.288406 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.288507 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.288722 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.288816 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.289035 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.289128 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.289341 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.289445 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.289657 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.289885 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.289998 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.290227 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.290333 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.290532 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.290807 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.290910 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.291147 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.291248 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.291461 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.291558 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.291780 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.291923 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.292089 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.292242 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.292421 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.292527 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.292734 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.292839 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.293046 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.293138 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.321393 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.321678 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.322141 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.322308 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.322432 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.322598 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.322944 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.323078 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.323228 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.323451 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.323598 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.323744 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.323894 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.324063 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.324229 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.324392 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.324538 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.324538 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.324880 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.325014 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.325170 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.325328 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.325487 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.325487 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.325660 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.325750 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.325914 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.326010 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.326132 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.326264 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.326397 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.326558 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.326801 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.327022 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.327134 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.327283 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.327474 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.327631 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.327810 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.327936 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.328032 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.328169 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.328441 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.328672 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.328882 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.329014 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.329235 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.329499 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.330631 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.330824 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.334437 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.334591 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.334734 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.335000 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.335147 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.335284 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.335479 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.335479 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.336044 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.336207 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.336270 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.336270 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.336401 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.336472 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.336555 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.336615 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.336672 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.336741 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.336809 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.336876 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.336951 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.337023 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.337091 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.337160 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.337226 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.337292 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.337366 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.337436 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.337504 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.337579 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.337649 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.337717 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.337784 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.337852 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.338059 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.338302 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.338392 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.338462 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.338530 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.338606 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.338676 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.338743 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.338811 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.338811 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.338922 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.338998 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.339072 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.339072 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.339183 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.339250 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.339317 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.339392 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.339462 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.339529 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.339596 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.339596 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.339596 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.339766 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.339836 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.339903 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.339971 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.340038 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.340113 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.340183 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.340250 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.340333 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.340394 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.340506 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.340579 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.340654 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.340726 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.340794 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.340862 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.340862 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.340975 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.341040 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.341098 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.341165 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.341234 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.341301 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.341368 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.341445 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.341516 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.341585 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.341585 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.341698 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.341765 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.341842 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.341913 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.341980 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.342048 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.342116 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.342191 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.342261 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.342329 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.342397 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.342466 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.342536 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.342612 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.342682 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.342750 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.342819 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.342888 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.342955 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.342955 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.343087 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.343156 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.343223 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.343290 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.343358 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.343435 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.343505 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.343572 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.343640 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.343708 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.343784 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.343854 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.343921 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.343991 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.344059 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.344126 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.344202 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.344272 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.344356 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.344415 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.344484 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.344484 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.344608 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.344679 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.344679 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.344791 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.344791 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.344902 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.344979 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.344979 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.345082 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.345137 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.345193 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.345348 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.345348 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.345467 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.345535 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.345603 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.345671 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.345764 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.345837 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.346135 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.346260 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.346260 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.346389 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.346389 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.346502 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.346558 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.346613 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.346694 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.346783 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.346844 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.346913 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.346981 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.347048 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.347048 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.347157 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.347226 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.347293 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.347293 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.347403 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.347535 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.347621 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.347691 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.347759 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.347827 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.347827 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.347937 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.348062 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.348139 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.348197 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.348197 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.348475 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.348475 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.348475 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.348650 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.348718 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.348786 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.348861 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.348943 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.349014 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.349082 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.349158 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.349227 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.349294 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.349368 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.349438 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.349506 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.349572 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.349639 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.349706 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.349780 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.349849 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.349916 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.349983 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.350050 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.350116 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.350191 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.350260 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.350327 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.350394 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.350462 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.350527 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.350638 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.350732 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.350812 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.350881 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.350949 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.351025 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.351095 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.351163 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.351230 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.351297 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.351364 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.351439 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.351508 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.351575 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.351642 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.351709 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.351785 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.351855 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.351922 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.351989 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.352057 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.352123 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.352198 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.352267 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.352352 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.352412 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.352479 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.352545 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.352659 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.352733 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.352802 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.352870 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.352937 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.353004 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.353080 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.353149 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.353217 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.353284 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.353351 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.353426 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.353495 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.353562 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.353629 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.353695 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.353750 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.353813 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.353883 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.353950 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.354022 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.354090 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.354158 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.354235 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.354310 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.354423 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.354502 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.354570 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.354627 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.354743 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.354839 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.354943 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.355037 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.355129 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.355229 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.355323 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.355432 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.355506 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.355574 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.355643 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.355720 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.355790 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.355858 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.355925 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.356284 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.356426 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.356516 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.356588 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.356657 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.356724 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.356792 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.356859 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.356937 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.357008 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.357076 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.357144 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.357212 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.357287 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.357358 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.357425 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.357493 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.357560 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.357627 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.357702 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.357772 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.357913 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.357999 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.358115 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.358192 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.358252 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.358309 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.358366 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.358561 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.358641 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.358726 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.358799 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.358868 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.358945 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.359017 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.359094 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.359167 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.359236 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.359306 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.359375 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.359449 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.359531 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.359603 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.359672 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.359742 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.359811 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.359881 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.359958 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.360029 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.360098 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.360168 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.360245 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.360338 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.360412 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.360482 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.360551 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.360621 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.360690 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.360772 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.360865 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.360955 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.361028 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.361098 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.361155 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.361276 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.361351 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.361421 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.361491 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.361560 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.361637 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.361708 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.361777 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.361846 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.361915 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.361983 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.362060 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.362131 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.362200 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.362269 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.362337 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.362406 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.362473 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.362532 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.362589 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.362645 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.362702 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.362766 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.362825 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.362825 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.362925 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.363102 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.363204 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.363381 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.363505 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.363705 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.363784 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.364023 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.364100 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.364377 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.364461 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.364704 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.364783 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.365017 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.365094 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.365393 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.365483 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.365628 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.365706 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.365870 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=134052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 27 02:39:01.366024 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:39:01.366249 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=134051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 27 02:39:01.426488 n-d-852278-4 devstack@n-api.service[134052]: INFO dbcounter [None req-328a5be2-fd38-44fe-85d5-dfe04e4e2926 None None] Registered counter for database nova_api Aug 27 02:39:01.427296 n-d-852278-4 devstack@n-api.service[134051]: INFO dbcounter [None req-1d1619d2-548b-4746-8ae2-305502886384 None None] Registered counter for database nova_api Aug 27 02:39:01.448288 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_db.sqlalchemy.engines [None req-1d1619d2-548b-4746-8ae2-305502886384 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134051) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 02:39:01.450419 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_db.sqlalchemy.engines [None req-328a5be2-fd38-44fe-85d5-dfe04e4e2926 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134052) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 02:39:01.457292 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writer thread running {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 02:39:01.458661 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writer thread running {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 02:39:01.512651 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.context [None req-1d1619d2-548b-4746-8ae2-305502886384 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9e3f7cc8-d9cf-4064-9831-4fdba8cfa839(cell1) {{(pid=134051) load_cells /opt/stack/nova/nova/context.py:464}} Aug 27 02:39:01.515075 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.context [None req-328a5be2-fd38-44fe-85d5-dfe04e4e2926 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9e3f7cc8-d9cf-4064-9831-4fdba8cfa839(cell1) {{(pid=134052) load_cells /opt/stack/nova/nova/context.py:464}} Aug 27 02:39:01.516750 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1d1619d2-548b-4746-8ae2-305502886384 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:01.517248 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1d1619d2-548b-4746-8ae2-305502886384 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:01.518869 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1d1619d2-548b-4746-8ae2-305502886384 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:01.519165 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-328a5be2-fd38-44fe-85d5-dfe04e4e2926 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:01.519583 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1d1619d2-548b-4746-8ae2-305502886384 None None] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:01.519681 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-328a5be2-fd38-44fe-85d5-dfe04e4e2926 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:01.520034 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1d1619d2-548b-4746-8ae2-305502886384 None None] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:01.521282 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-328a5be2-fd38-44fe-85d5-dfe04e4e2926 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:01.522003 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-328a5be2-fd38-44fe-85d5-dfe04e4e2926 None None] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:01.522094 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1d1619d2-548b-4746-8ae2-305502886384 None None] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:01.522455 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-328a5be2-fd38-44fe-85d5-dfe04e4e2926 None None] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:01.524025 n-d-852278-4 devstack@n-api.service[134051]: INFO dbcounter [None req-1d1619d2-548b-4746-8ae2-305502886384 None None] Registered counter for database nova_cell0 Aug 27 02:39:01.524466 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-328a5be2-fd38-44fe-85d5-dfe04e4e2926 None None] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:01.526523 n-d-852278-4 devstack@n-api.service[134052]: INFO dbcounter [None req-328a5be2-fd38-44fe-85d5-dfe04e4e2926 None None] Registered counter for database nova_cell0 Aug 27 02:39:01.529480 n-d-852278-4 devstack@n-api.service[134051]: INFO dbcounter [None req-1d1619d2-548b-4746-8ae2-305502886384 None None] Registered counter for database nova_cell1 Aug 27 02:39:01.531964 n-d-852278-4 devstack@n-api.service[134052]: INFO dbcounter [None req-328a5be2-fd38-44fe-85d5-dfe04e4e2926 None None] Registered counter for database nova_cell1 Aug 27 02:39:01.537163 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_db.sqlalchemy.engines [None req-1d1619d2-548b-4746-8ae2-305502886384 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134051) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 02:39:01.538837 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_db.sqlalchemy.engines [None req-1d1619d2-548b-4746-8ae2-305502886384 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134051) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 02:39:01.540978 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_db.sqlalchemy.engines [None req-328a5be2-fd38-44fe-85d5-dfe04e4e2926 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134052) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 02:39:01.542312 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_db.sqlalchemy.engines [None req-328a5be2-fd38-44fe-85d5-dfe04e4e2926 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134052) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 02:39:01.546050 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writer thread running {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 02:39:01.546308 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writer thread running {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 02:39:01.549641 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writer thread running {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 02:39:01.551013 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writer thread running {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 02:39:01.707743 n-d-852278-4 devstack@n-api.service[134052]: INFO dbcounter [None req-328a5be2-fd38-44fe-85d5-dfe04e4e2926 None None] Registered counter for database nova_cell0 Aug 27 02:39:01.715086 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_db.sqlalchemy.engines [None req-328a5be2-fd38-44fe-85d5-dfe04e4e2926 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134052) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 02:39:01.719702 n-d-852278-4 devstack@n-api.service[134051]: INFO dbcounter [None req-1d1619d2-548b-4746-8ae2-305502886384 None None] Registered counter for database nova_cell0 Aug 27 02:39:01.720883 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writer thread running {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 02:39:01.727235 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_db.sqlalchemy.engines [None req-1d1619d2-548b-4746-8ae2-305502886384 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134051) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 02:39:01.731989 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writer thread running {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 02:39:02.043656 n-d-852278-4 devstack@n-api.service[134052]: WARNING keystonemiddleware.auth_token [None req-328a5be2-fd38-44fe-85d5-dfe04e4e2926 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 27 02:39:02.051049 n-d-852278-4 devstack@n-api.service[134052]: WARNING keystonemiddleware.auth_token [None req-328a5be2-fd38-44fe-85d5-dfe04e4e2926 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 27 02:39:02.102411 n-d-852278-4 devstack@n-api.service[134051]: WARNING keystonemiddleware.auth_token [None req-1d1619d2-548b-4746-8ae2-305502886384 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 27 02:39:02.109805 n-d-852278-4 devstack@n-api.service[134051]: WARNING keystonemiddleware.auth_token [None req-1d1619d2-548b-4746-8ae2-305502886384 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 27 02:39:02.391970 n-d-852278-4 devstack@n-api.service[134052]: WARNING keystonemiddleware.auth_token [None req-328a5be2-fd38-44fe-85d5-dfe04e4e2926 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 27 02:39:02.398077 n-d-852278-4 devstack@n-api.service[134052]: WARNING keystonemiddleware.auth_token [None req-328a5be2-fd38-44fe-85d5-dfe04e4e2926 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 27 02:39:02.403339 n-d-852278-4 devstack@n-api.service[134052]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5643f61a99c0 pid: 134052 (default app) Aug 27 02:39:02.464693 n-d-852278-4 devstack@n-api.service[134051]: WARNING keystonemiddleware.auth_token [None req-1d1619d2-548b-4746-8ae2-305502886384 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 27 02:39:02.470830 n-d-852278-4 devstack@n-api.service[134051]: WARNING keystonemiddleware.auth_token [None req-1d1619d2-548b-4746-8ae2-305502886384 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 27 02:39:02.476126 n-d-852278-4 devstack@n-api.service[134051]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5643f61a99c0 pid: 134051 (default app) Aug 27 02:39:41.501456 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=3 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:39:41.502588 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=3 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:39:41.504220 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=3 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:39:41.505396 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=3 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:39:42.990704 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-09ed8467-3dcb-431e-bb79-89af49cde387 tempest-AZAdminV2TestJSON-1235340065 tempest-AZAdminV2TestJSON-1235340065-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:42.993533 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-09ed8467-3dcb-431e-bb79-89af49cde387 tempest-AZAdminV2TestJSON-1235340065 tempest-AZAdminV2TestJSON-1235340065-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:42.994244 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-09ed8467-3dcb-431e-bb79-89af49cde387 tempest-AZAdminV2TestJSON-1235340065 tempest-AZAdminV2TestJSON-1235340065-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:42.994935 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-09ed8467-3dcb-431e-bb79-89af49cde387 tempest-AZAdminV2TestJSON-1235340065 tempest-AZAdminV2TestJSON-1235340065-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:42.995827 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-09ed8467-3dcb-431e-bb79-89af49cde387 tempest-AZAdminV2TestJSON-1235340065 tempest-AZAdminV2TestJSON-1235340065-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:42.996892 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-09ed8467-3dcb-431e-bb79-89af49cde387 tempest-AZAdminV2TestJSON-1235340065 tempest-AZAdminV2TestJSON-1235340065-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:42.997471 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-09ed8467-3dcb-431e-bb79-89af49cde387 tempest-AZAdminV2TestJSON-1235340065 tempest-AZAdminV2TestJSON-1235340065-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:43.051294 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-09ed8467-3dcb-431e-bb79-89af49cde387 tempest-AZAdminV2TestJSON-1235340065 tempest-AZAdminV2TestJSON-1235340065-project-admin] 10.222.0.70 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 1.555456 Aug 27 02:39:43.059792 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1/1] 10.222.0.70 () {58 vars in 1164 bytes} [Sat Aug 27 02:39:41 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 1558 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:39:43.071554 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=3 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:39:43.072987 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=3 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:39:43.074604 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=3 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:39:43.075797 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=3 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:39:43.345277 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8645c25f-0651-464c-97bb-a517e799cf1c tempest-AZAdminV2TestJSON-1235340065 tempest-AZAdminV2TestJSON-1235340065-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:43.347439 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8645c25f-0651-464c-97bb-a517e799cf1c tempest-AZAdminV2TestJSON-1235340065 tempest-AZAdminV2TestJSON-1235340065-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:43.348378 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8645c25f-0651-464c-97bb-a517e799cf1c tempest-AZAdminV2TestJSON-1235340065 tempest-AZAdminV2TestJSON-1235340065-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:43.348953 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8645c25f-0651-464c-97bb-a517e799cf1c tempest-AZAdminV2TestJSON-1235340065 tempest-AZAdminV2TestJSON-1235340065-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:43.349891 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8645c25f-0651-464c-97bb-a517e799cf1c tempest-AZAdminV2TestJSON-1235340065 tempest-AZAdminV2TestJSON-1235340065-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:43.350596 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8645c25f-0651-464c-97bb-a517e799cf1c tempest-AZAdminV2TestJSON-1235340065 tempest-AZAdminV2TestJSON-1235340065-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:43.351192 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8645c25f-0651-464c-97bb-a517e799cf1c tempest-AZAdminV2TestJSON-1235340065 tempest-AZAdminV2TestJSON-1235340065-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:43.420861 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-8645c25f-0651-464c-97bb-a517e799cf1c tempest-AZAdminV2TestJSON-1235340065 tempest-AZAdminV2TestJSON-1235340065-project-admin] 10.222.0.70 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.358310 Aug 27 02:39:43.431139 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1/2] 10.222.0.70 () {58 vars in 1185 bytes} [Sat Aug 27 02:39:43 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:39:44.651322 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f97f371e-ecee-4a1e-be84-707e27e2d87b tempest-FlavorsExtraSpecsTestJSON-937511445 tempest-FlavorsExtraSpecsTestJSON-937511445-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-394896402", "ram": 512, "vcpus": 1, "disk": 10, "id": 1098620398, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:39:44.730608 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f97f371e-ecee-4a1e-be84-707e27e2d87b tempest-FlavorsExtraSpecsTestJSON-937511445 tempest-FlavorsExtraSpecsTestJSON-937511445-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.902609 Aug 27 02:39:44.732006 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2/3] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 02:39:43 2022] POST /compute/v2.1/flavors => generated 415 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:39:45.129008 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6891b0fe-54ae-4323-ace8-0e8d3730c7c9 tempest-AZAdminNegativeTestJSON-1269169025 tempest-AZAdminNegativeTestJSON-1269169025-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:45.131496 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-6891b0fe-54ae-4323-ace8-0e8d3730c7c9 tempest-AZAdminNegativeTestJSON-1269169025 tempest-AZAdminNegativeTestJSON-1269169025-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '3245683a66ee4a41a380319815d940c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41dca194a44f424c959fcdb1e70a6330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:45.138061 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6891b0fe-54ae-4323-ace8-0e8d3730c7c9 tempest-AZAdminNegativeTestJSON-1269169025 tempest-AZAdminNegativeTestJSON-1269169025-project] Request method failure captured: Aug 27 02:39:45.138061 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Aug 27 02:39:45.138061 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:39:45.138061 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:39:45.138061 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:39:45.138061 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:39:45.138061 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:39:45.138061 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:39:45.138061 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:39:45.138061 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:39:45.138061 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYPtazLCH_w26GAl4JFKV0hgsriIF21a119moh4NgHArHkJ2DELaz8ZDaaNh3Rcfmn4p5MJDcEaYKH1vG9N46uCw-_IWcj6av0MNGJxByqX6__G5XlOvyQOAw4aZ4C6m3wCdBPrKheBr7a1ALRQYp_jzVequwpxEdz2R_ZdQKMIx5Ao Aug 27 02:39:45.138061 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:39:45.138061 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:39:45.138061 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:39:45.138061 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:39:45.138061 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:39:45.138061 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:39:45.138061 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 41dca194a44f424c959fcdb1e70a6330 Aug 27 02:39:45.138061 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-AZAdminNegativeTestJSON-1269169025 Aug 27 02:39:45.138061 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:39:45.138061 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:39:45.139370 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/41dca194a44f424c959fcdb1e70a6330"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_41dca194a44f424c959fcdb1e70a6330", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/41dca194a44f424c959fcdb1e70a6330"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/41dca194a44f424c959fcdb1e70a6330"}]}] Aug 27 02:39:45.139370 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-AZAdminNegativeTestJSON-1269169025 Aug 27 02:39:45.139370 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 41dca194a44f424c959fcdb1e70a6330 Aug 27 02:39:45.139370 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-1269169025 Aug 27 02:39:45.139370 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-AZAdminNegativeTestJSON-1269169025-project Aug 27 02:39:45.139370 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:39:45.139370 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:39:45.139370 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 3245683a66ee4a41a380319815d940c5 Aug 27 02:39:45.139370 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-AZAdminNegativeTestJSON-1269169025-project Aug 27 02:39:45.139370 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 02:39:45.139370 n-d-852278-4 devstack@n-api.service[134052]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 27 02:39:45.139370 n-d-852278-4 devstack@n-api.service[134052]: action_args: {} Aug 27 02:39:45.140219 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:39:45.140219 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:39:45.140219 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:39:45.140219 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:39:45.140219 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:39:45.140219 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:39:45.140219 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:39:45.140219 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:39:45.140219 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Aug 27 02:39:45.140219 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Aug 27 02:39:45.140219 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 02:39:45.140219 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 02:39:45.140219 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 02:39:45.140219 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 02:39:45.140219 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 02:39:45.140219 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 02:39:45.140219 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 02:39:45.140219 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 02:39:45.140219 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 02:39:45.141373 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 02:39:45.141373 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 02:39:45.141373 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 02:39:45.141373 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 02:39:45.141373 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 02:39:45.141373 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 27 02:39:45.141373 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:39:45.141373 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:39:45.141373 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:39:45.141373 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:39:45.141373 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:39:45.141373 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:39:45.141373 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 02:39:45.141373 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 02:39:45.141373 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 27 02:39:45.141373 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:39:45.147313 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6891b0fe-54ae-4323-ace8-0e8d3730c7c9 tempest-AZAdminNegativeTestJSON-1269169025 tempest-AZAdminNegativeTestJSON-1269169025-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:39:45.149157 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-6891b0fe-54ae-4323-ace8-0e8d3730c7c9 tempest-AZAdminNegativeTestJSON-1269169025 tempest-AZAdminNegativeTestJSON-1269169025-project] 10.222.0.70 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.412652 Aug 27 02:39:45.158716 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3/4] 10.222.0.70 () {58 vars in 1185 bytes} [Sat Aug 27 02:39:44 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 423 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:39:45.166312 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-506d8d14-e0a0-486a-8bf2-49eec349a41e tempest-FlavorsExtraSpecsTestJSON-937511445 tempest-FlavorsExtraSpecsTestJSON-937511445-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:39:45.243774 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-506d8d14-e0a0-486a-8bf2-49eec349a41e tempest-FlavorsExtraSpecsTestJSON-937511445 tempest-FlavorsExtraSpecsTestJSON-937511445-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors/1098620398/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.083315 Aug 27 02:39:45.245166 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 4/5] 10.222.0.70 () {60 vars in 1224 bytes} [Sat Aug 27 02:39:45 2022] POST /compute/v2.1/flavors/1098620398/os-extra_specs => generated 66 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:39:45.466707 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-57a79e21-92b3-4496-8487-7ec8b74c829c tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] Calling method '.version_select at 0x7f5ee4930f70>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:45.478435 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-57a79e21-92b3-4496-8487-7ec8b74c829c tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9e3f7cc8-d9cf-4064-9831-4fdba8cfa839(cell1) {{(pid=134051) load_cells /opt/stack/nova/nova/compute/api.py:319}} Aug 27 02:39:45.479497 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-57a79e21-92b3-4496-8487-7ec8b74c829c tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:45.480044 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-57a79e21-92b3-4496-8487-7ec8b74c829c tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:45.480709 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-57a79e21-92b3-4496-8487-7ec8b74c829c tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:45.538236 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-57a79e21-92b3-4496-8487-7ec8b74c829c tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:45.539154 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-57a79e21-92b3-4496-8487-7ec8b74c829c tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:45.539752 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-57a79e21-92b3-4496-8487-7ec8b74c829c tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:45.564227 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-57a79e21-92b3-4496-8487-7ec8b74c829c tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:45.564976 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-57a79e21-92b3-4496-8487-7ec8b74c829c tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:45.567286 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-57a79e21-92b3-4496-8487-7ec8b74c829c tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:45.579085 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-57a79e21-92b3-4496-8487-7ec8b74c829c tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 1.517685 Aug 27 02:39:45.580475 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2/6] 10.222.0.70 () {58 vars in 1167 bytes} [Sat Aug 27 02:39:44 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 1520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:39:45.714107 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8255623a-ab07-48af-9bd6-0f86438282c2 tempest-AggregatesAdminTestV241-333737186 tempest-AggregatesAdminTestV241-333737186-project-admin] Calling method '.version_select at 0x7f5ee489fee0>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:45.733155 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-8255623a-ab07-48af-9bd6-0f86438282c2 tempest-AggregatesAdminTestV241-333737186 tempest-AggregatesAdminTestV241-333737186-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9e3f7cc8-d9cf-4064-9831-4fdba8cfa839(cell1) {{(pid=134052) load_cells /opt/stack/nova/nova/compute/api.py:319}} Aug 27 02:39:45.737116 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8255623a-ab07-48af-9bd6-0f86438282c2 tempest-AggregatesAdminTestV241-333737186 tempest-AggregatesAdminTestV241-333737186-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:45.738141 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8255623a-ab07-48af-9bd6-0f86438282c2 tempest-AggregatesAdminTestV241-333737186 tempest-AggregatesAdminTestV241-333737186-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:45.738802 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8255623a-ab07-48af-9bd6-0f86438282c2 tempest-AggregatesAdminTestV241-333737186 tempest-AggregatesAdminTestV241-333737186-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:45.812456 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8255623a-ab07-48af-9bd6-0f86438282c2 tempest-AggregatesAdminTestV241-333737186 tempest-AggregatesAdminTestV241-333737186-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:45.814351 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8255623a-ab07-48af-9bd6-0f86438282c2 tempest-AggregatesAdminTestV241-333737186 tempest-AggregatesAdminTestV241-333737186-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:45.814831 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8255623a-ab07-48af-9bd6-0f86438282c2 tempest-AggregatesAdminTestV241-333737186 tempest-AggregatesAdminTestV241-333737186-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:45.844784 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8255623a-ab07-48af-9bd6-0f86438282c2 tempest-AggregatesAdminTestV241-333737186 tempest-AggregatesAdminTestV241-333737186-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:45.845291 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8255623a-ab07-48af-9bd6-0f86438282c2 tempest-AggregatesAdminTestV241-333737186 tempest-AggregatesAdminTestV241-333737186-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:45.845718 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8255623a-ab07-48af-9bd6-0f86438282c2 tempest-AggregatesAdminTestV241-333737186 tempest-AggregatesAdminTestV241-333737186-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:45.870676 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-8255623a-ab07-48af-9bd6-0f86438282c2 tempest-AggregatesAdminTestV241-333737186 tempest-AggregatesAdminTestV241-333737186-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 0.624316 Aug 27 02:39:45.871820 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 5/7] 10.222.0.70 () {60 vars in 1208 bytes} [Sat Aug 27 02:39:45 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:39:46.226473 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-253dffdc-9097-4931-9afc-f9694d955117 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-182648812", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:39:46.228362 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-11c0d9c6-1c34-43a2-833f-d05f31537646 tempest-FlavorsExtraSpecsTestJSON-770143039 tempest-FlavorsExtraSpecsTestJSON-770143039-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:46.291024 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-11c0d9c6-1c34-43a2-833f-d05f31537646 tempest-FlavorsExtraSpecsTestJSON-770143039 tempest-FlavorsExtraSpecsTestJSON-770143039-project] 10.222.0.70 "GET /compute/v2.1/flavors/1098620398/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.709244 Aug 27 02:39:46.292464 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3/8] 10.222.0.70 () {58 vars in 1203 bytes} [Sat Aug 27 02:39:45 2022] GET /compute/v2.1/flavors/1098620398/os-extra_specs => generated 66 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:39:46.305248 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d34cbe9b-b232-4207-8081-b3dc53736994 tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1189054550", "name": "tempest-test_aggregate-1674054639"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:39:46.395802 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.objects.aggregate [None req-d34cbe9b-b232-4207-8081-b3dc53736994 tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] Generated uuid 1c94720f-6476-4ded-b574-ef9b8d87a60a for aggregate {{(pid=134051) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 02:39:46.548624 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d34cbe9b-b232-4207-8081-b3dc53736994 tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.253687 Aug 27 02:39:46.550512 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 4/9] 10.222.0.70 () {60 vars in 1165 bytes} [Sat Aug 27 02:39:46 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:39:46.561704 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-13689a7b-46a7-448f-a035-125aa9a71507 tempest-FlavorsExtraSpecsTestJSON-937511445 tempest-FlavorsExtraSpecsTestJSON-937511445-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:39:46.641457 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-13689a7b-46a7-448f-a035-125aa9a71507 tempest-FlavorsExtraSpecsTestJSON-937511445 tempest-FlavorsExtraSpecsTestJSON-937511445-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors/1098620398/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.089670 Aug 27 02:39:46.642648 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 5/10] 10.222.0.70 () {60 vars in 1224 bytes} [Sat Aug 27 02:39:46 2022] POST /compute/v2.1/flavors/1098620398/os-extra_specs => generated 66 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:39:46.650770 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e962c5e7-2581-499d-a006-b470a310d3b5 tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:46.668057 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e962c5e7-2581-499d-a006-b470a310d3b5 tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] 10.222.0.70 "GET /compute/v2.1/os-aggregates" status: 200 len: 303 microversion: 2.1 time: 0.023823 Aug 27 02:39:46.669206 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 6/11] 10.222.0.70 () {58 vars in 1143 bytes} [Sat Aug 27 02:39:46 2022] GET /compute/v2.1/os-aggregates => generated 303 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:39:46.674777 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e21675b9-f4e9-42fc-bada-93b0d6184700 tempest-FlavorsExtraSpecsTestJSON-770143039 tempest-FlavorsExtraSpecsTestJSON-770143039-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:46.686490 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e21675b9-f4e9-42fc-bada-93b0d6184700 tempest-FlavorsExtraSpecsTestJSON-770143039 tempest-FlavorsExtraSpecsTestJSON-770143039-project] 10.222.0.70 "GET /compute/v2.1/flavors/1098620398/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.015862 Aug 27 02:39:46.697135 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 7/12] 10.222.0.70 () {58 vars in 1245 bytes} [Sat Aug 27 02:39:46 2022] GET /compute/v2.1/flavors/1098620398/os-extra_specs/hw:numa_nodes => generated 22 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:39:46.710700 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-45f8c5fd-7cb5-4a9c-b68c-fef3ccc1913e tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-852278-4"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:39:46.733271 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-45f8c5fd-7cb5-4a9c-b68c-fef3ccc1913e tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:46.733911 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-45f8c5fd-7cb5-4a9c-b68c-fef3ccc1913e tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:46.734623 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-45f8c5fd-7cb5-4a9c-b68c-fef3ccc1913e tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:47.167765 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.network.neutron [None req-253dffdc-9097-4931-9afc-f9694d955117 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] validate_networks() for None {{(pid=134052) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:39:47.979095 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-45f8c5fd-7cb5-4a9c-b68c-fef3ccc1913e tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 315 microversion: 2.1 time: 1.280102 Aug 27 02:39:47.993905 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 8/13] 10.222.0.70 () {60 vars in 1191 bytes} [Sat Aug 27 02:39:46 2022] POST /compute/v2.1/os-aggregates/1/action => generated 315 bytes in 1295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:39:48.000340 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-bb553c88-5afe-4ffb-91f7-45617daf9c27 tempest-FlavorsExtraSpecsTestJSON-937511445 tempest-FlavorsExtraSpecsTestJSON-937511445-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:39:48.027038 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-bb553c88-5afe-4ffb-91f7-45617daf9c27 tempest-FlavorsExtraSpecsTestJSON-937511445 tempest-FlavorsExtraSpecsTestJSON-937511445-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors/1098620398/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.031511 Aug 27 02:39:48.033172 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 9/14] 10.222.0.70 () {60 vars in 1224 bytes} [Sat Aug 27 02:39:47 2022] POST /compute/v2.1/flavors/1098620398/os-extra_specs => generated 66 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:39:48.038289 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b4b8bf2f-5f30-4cd1-bccd-ab276e336978 tempest-FlavorsExtraSpecsTestJSON-937511445 tempest-FlavorsExtraSpecsTestJSON-937511445-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:48.048432 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b4b8bf2f-5f30-4cd1-bccd-ab276e336978 tempest-FlavorsExtraSpecsTestJSON-937511445 tempest-FlavorsExtraSpecsTestJSON-937511445-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/1098620398/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.013688 Aug 27 02:39:48.054247 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 10/15] 10.222.0.70 () {58 vars in 1203 bytes} [Sat Aug 27 02:39:48 2022] GET /compute/v2.1/flavors/1098620398/os-extra_specs => generated 66 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:39:48.060049 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0c67d522-ac1b-4440-8968-7603388b89a6 tempest-FlavorsExtraSpecsTestJSON-937511445 tempest-FlavorsExtraSpecsTestJSON-937511445-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:39:48.116678 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-0c67d522-ac1b-4440-8968-7603388b89a6 tempest-FlavorsExtraSpecsTestJSON-937511445 tempest-FlavorsExtraSpecsTestJSON-937511445-project-admin] 10.222.0.70 "PUT /compute/v2.1/flavors/1098620398/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.059888 Aug 27 02:39:48.119348 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 11/16] 10.222.0.70 () {60 vars in 1265 bytes} [Sat Aug 27 02:39:48 2022] PUT /compute/v2.1/flavors/1098620398/os-extra_specs/hw:numa_nodes => generated 22 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:39:48.130640 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-43ec43c9-a77e-46a3-93fb-a89ef3bb55ba tempest-FlavorsExtraSpecsTestJSON-937511445 tempest-FlavorsExtraSpecsTestJSON-937511445-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:48.144939 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-253dffdc-9097-4931-9afc-f9694d955117 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Flavor limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:39:48.145587 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-253dffdc-9097-4931-9afc-f9694d955117 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Image limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:39:48.146218 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-253dffdc-9097-4931-9afc-f9694d955117 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Flavor pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:39:48.146757 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-253dffdc-9097-4931-9afc-f9694d955117 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Image pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:39:48.147298 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-253dffdc-9097-4931-9afc-f9694d955117 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:39:48.155128 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-43ec43c9-a77e-46a3-93fb-a89ef3bb55ba tempest-FlavorsExtraSpecsTestJSON-937511445 tempest-FlavorsExtraSpecsTestJSON-937511445-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/1098620398/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.029713 Aug 27 02:39:48.156830 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 12/17] 10.222.0.70 () {58 vars in 1203 bytes} [Sat Aug 27 02:39:48 2022] GET /compute/v2.1/flavors/1098620398/os-extra_specs => generated 66 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:39:48.169839 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a323636a-1967-45d0-a8f7-00605763f4be tempest-FlavorsExtraSpecsTestJSON-937511445 tempest-FlavorsExtraSpecsTestJSON-937511445-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:48.191177 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-253dffdc-9097-4931-9afc-f9694d955117 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:48.191707 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-253dffdc-9097-4931-9afc-f9694d955117 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:48.198445 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-253dffdc-9097-4931-9afc-f9694d955117 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:48.223967 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-253dffdc-9097-4931-9afc-f9694d955117 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:48.228177 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-253dffdc-9097-4931-9afc-f9694d955117 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:48.230943 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-253dffdc-9097-4931-9afc-f9694d955117 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:48.233569 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a323636a-1967-45d0-a8f7-00605763f4be tempest-FlavorsExtraSpecsTestJSON-937511445 tempest-FlavorsExtraSpecsTestJSON-937511445-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/1098620398/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.072042 Aug 27 02:39:48.236673 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 13/18] 10.222.0.70 () {58 vars in 1248 bytes} [Sat Aug 27 02:39:48 2022] DELETE /compute/v2.1/flavors/1098620398/os-extra_specs/hw:numa_nodes => generated 0 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 27 02:39:48.248726 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b3ca7e43-cab3-4d45-b3c9-2a75c2347109 tempest-FlavorsExtraSpecsTestJSON-937511445 tempest-FlavorsExtraSpecsTestJSON-937511445-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:48.295245 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b3ca7e43-cab3-4d45-b3c9-2a75c2347109 tempest-FlavorsExtraSpecsTestJSON-937511445 tempest-FlavorsExtraSpecsTestJSON-937511445-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/1098620398/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.054078 Aug 27 02:39:48.300885 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 14/19] 10.222.0.70 () {58 vars in 1248 bytes} [Sat Aug 27 02:39:48 2022] DELETE /compute/v2.1/flavors/1098620398/os-extra_specs/hw:cpu_policy => generated 0 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 27 02:39:48.310258 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-2c01a0ca-b92b-428d-8192-c0529eb34b36 tempest-FlavorsExtraSpecsTestJSON-937511445 tempest-FlavorsExtraSpecsTestJSON-937511445-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:48.338686 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-253dffdc-9097-4931-9afc-f9694d955117 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Getting quotas for project 5b2f4a529a3e4ea0937ca903dd5924bf. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:39:48.342857 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-2c01a0ca-b92b-428d-8192-c0529eb34b36 tempest-FlavorsExtraSpecsTestJSON-937511445 tempest-FlavorsExtraSpecsTestJSON-937511445-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/1098620398/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.037351 Aug 27 02:39:48.343470 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 15/20] 10.222.0.70 () {58 vars in 1203 bytes} [Sat Aug 27 02:39:48 2022] GET /compute/v2.1/flavors/1098620398/os-extra_specs => generated 19 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 27 02:39:48.364268 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-253dffdc-9097-4931-9afc-f9694d955117 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Getting quotas for user 772e2e66c92e44f8838ce325437d5a48 and project 5b2f4a529a3e4ea0937ca903dd5924bf. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:39:48.392993 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-253dffdc-9097-4931-9afc-f9694d955117 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Going to run 1 instances... {{(pid=134052) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:39:48.416085 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-253dffdc-9097-4931-9afc-f9694d955117 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] [instance: 459d7a41-f50d-4ffe-a184-c0a12437669a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134052) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:39:48.530683 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-253dffdc-9097-4931-9afc-f9694d955117 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.657413 Aug 27 02:39:48.542001 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 6/21] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 02:39:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 2669 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:39:48.553329 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b0b17a72-b975-4a84-bde2-3d75e586c361 tempest-FlavorsExtraSpecsTestJSON-937511445 tempest-FlavorsExtraSpecsTestJSON-937511445-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:48.632923 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b0b17a72-b975-4a84-bde2-3d75e586c361 tempest-FlavorsExtraSpecsTestJSON-937511445 tempest-FlavorsExtraSpecsTestJSON-937511445-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/1098620398" status: 202 len: 0 microversion: 2.1 time: 0.087693 Aug 27 02:39:48.635307 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 7/22] 10.222.0.70 () {58 vars in 1161 bytes} [Sat Aug 27 02:39:48 2022] DELETE /compute/v2.1/flavors/1098620398 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:39:48.651897 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f1799142-8863-4668-9a27-72aebcc0f6f4 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:48.653865 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-f1799142-8863-4668-9a27-72aebcc0f6f4 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] [instance: 459d7a41-f50d-4ffe-a184-c0a12437669a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:39:48.696289 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-53e123d4-ba3c-4f06-ba36-325e69da5f43 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-761634319", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "availability_zone": "tempest-test_az-1189054550"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:39:48.731222 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-53e123d4-ba3c-4f06-ba36-325e69da5f43 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:48.731709 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-53e123d4-ba3c-4f06-ba36-325e69da5f43 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:48.732164 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-53e123d4-ba3c-4f06-ba36-325e69da5f43 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:48.732896 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-53e123d4-ba3c-4f06-ba36-325e69da5f43 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:48.739862 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-53e123d4-ba3c-4f06-ba36-325e69da5f43 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:48.740537 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-53e123d4-ba3c-4f06-ba36-325e69da5f43 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:48.786204 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-f1799142-8863-4668-9a27-72aebcc0f6f4 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772e2e66c92e44f8838ce325437d5a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b2f4a529a3e4ea0937ca903dd5924bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:48.808895 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f1799142-8863-4668-9a27-72aebcc0f6f4 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] 10.222.0.70 "GET /compute/v2.1/servers/459d7a41-f50d-4ffe-a184-c0a12437669a" status: 200 len: 1219 microversion: 2.1 time: 0.171173 Aug 27 02:39:48.809489 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 8/23] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:39:48 2022] GET /compute/v2.1/servers/459d7a41-f50d-4ffe-a184-c0a12437669a => generated 1219 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:39:48.815378 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0901214d-f5d1-4197-9626-922bf6924758 tempest-FlavorsExtraSpecsTestJSON-937511445 tempest-FlavorsExtraSpecsTestJSON-937511445-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:48.846693 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-0901214d-f5d1-4197-9626-922bf6924758 tempest-FlavorsExtraSpecsTestJSON-937511445 tempest-FlavorsExtraSpecsTestJSON-937511445-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.035738 Aug 27 02:39:48.847334 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 9/24] 10.222.0.70 () {58 vars in 1146 bytes} [Sat Aug 27 02:39:48 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:39:50.073556 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a99ddece-73e5-4272-811c-aafa06f1cdff tempest-HypervisorAdminTestJSON-427842350 tempest-HypervisorAdminTestJSON-427842350-project-admin] Calling method '.version_select at 0x7f5ee3efa310>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:50.079552 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a99ddece-73e5-4272-811c-aafa06f1cdff tempest-HypervisorAdminTestJSON-427842350 tempest-HypervisorAdminTestJSON-427842350-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:50.080728 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a99ddece-73e5-4272-811c-aafa06f1cdff tempest-HypervisorAdminTestJSON-427842350 tempest-HypervisorAdminTestJSON-427842350-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:50.081548 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a99ddece-73e5-4272-811c-aafa06f1cdff tempest-HypervisorAdminTestJSON-427842350 tempest-HypervisorAdminTestJSON-427842350-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:50.083062 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.network.neutron [None req-53e123d4-ba3c-4f06-ba36-325e69da5f43 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] validate_networks() for None {{(pid=134051) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:39:50.120779 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a99ddece-73e5-4272-811c-aafa06f1cdff tempest-HypervisorAdminTestJSON-427842350 tempest-HypervisorAdminTestJSON-427842350-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:50.121349 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a99ddece-73e5-4272-811c-aafa06f1cdff tempest-HypervisorAdminTestJSON-427842350 tempest-HypervisorAdminTestJSON-427842350-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:50.121796 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a99ddece-73e5-4272-811c-aafa06f1cdff tempest-HypervisorAdminTestJSON-427842350 tempest-HypervisorAdminTestJSON-427842350-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:50.150385 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a99ddece-73e5-4272-811c-aafa06f1cdff tempest-HypervisorAdminTestJSON-427842350 tempest-HypervisorAdminTestJSON-427842350-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:50.153121 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a99ddece-73e5-4272-811c-aafa06f1cdff tempest-HypervisorAdminTestJSON-427842350 tempest-HypervisorAdminTestJSON-427842350-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:50.154203 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a99ddece-73e5-4272-811c-aafa06f1cdff tempest-HypervisorAdminTestJSON-427842350 tempest-HypervisorAdminTestJSON-427842350-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:50.170649 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a99ddece-73e5-4272-811c-aafa06f1cdff tempest-HypervisorAdminTestJSON-427842350 tempest-HypervisorAdminTestJSON-427842350-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.417980 Aug 27 02:39:50.174196 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 10/25] 10.222.0.70 () {58 vars in 1146 bytes} [Sat Aug 27 02:39:49 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:39:50.185286 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0cd1298c-4710-41c0-96bc-74c5f4582e90 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:50.187962 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-0cd1298c-4710-41c0-96bc-74c5f4582e90 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] [instance: 459d7a41-f50d-4ffe-a184-c0a12437669a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:39:50.199799 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0cd1298c-4710-41c0-96bc-74c5f4582e90 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:50.200503 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0cd1298c-4710-41c0-96bc-74c5f4582e90 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:50.206182 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0cd1298c-4710-41c0-96bc-74c5f4582e90 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:50.207105 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0cd1298c-4710-41c0-96bc-74c5f4582e90 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:50.210242 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0cd1298c-4710-41c0-96bc-74c5f4582e90 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:50.211230 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0cd1298c-4710-41c0-96bc-74c5f4582e90 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:50.405298 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-53e123d4-ba3c-4f06-ba36-325e69da5f43 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Flavor limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:39:50.406018 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-53e123d4-ba3c-4f06-ba36-325e69da5f43 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Image limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:39:50.406650 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-53e123d4-ba3c-4f06-ba36-325e69da5f43 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Flavor pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:39:50.407269 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-53e123d4-ba3c-4f06-ba36-325e69da5f43 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Image pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:39:50.407841 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-53e123d4-ba3c-4f06-ba36-325e69da5f43 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:39:50.453591 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-53e123d4-ba3c-4f06-ba36-325e69da5f43 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:50.455085 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-53e123d4-ba3c-4f06-ba36-325e69da5f43 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:50.455702 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-53e123d4-ba3c-4f06-ba36-325e69da5f43 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:50.456700 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-53e123d4-ba3c-4f06-ba36-325e69da5f43 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:50.457473 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-53e123d4-ba3c-4f06-ba36-325e69da5f43 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:50.458078 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-53e123d4-ba3c-4f06-ba36-325e69da5f43 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:50.499714 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0cd1298c-4710-41c0-96bc-74c5f4582e90 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772e2e66c92e44f8838ce325437d5a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b2f4a529a3e4ea0937ca903dd5924bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:50.517424 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-53e123d4-ba3c-4f06-ba36-325e69da5f43 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Getting quotas for project 13b427157c9f406da72d9b29af734987. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:39:50.522444 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-0cd1298c-4710-41c0-96bc-74c5f4582e90 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] 10.222.0.70 "GET /compute/v2.1/servers/459d7a41-f50d-4ffe-a184-c0a12437669a" status: 200 len: 1215 microversion: 2.1 time: 0.346990 Aug 27 02:39:50.537041 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 11/26] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:39:50 2022] GET /compute/v2.1/servers/459d7a41-f50d-4ffe-a184-c0a12437669a => generated 1215 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:39:50.537041 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b8a436ff-034f-4397-88f5-45da6df872c6 tempest-HypervisorAdminTestJSON-427842350 tempest-HypervisorAdminTestJSON-427842350-project-admin] Calling method '.version_select at 0x7f5ee3efae50>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:50.538581 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b8a436ff-034f-4397-88f5-45da6df872c6 tempest-HypervisorAdminTestJSON-427842350 tempest-HypervisorAdminTestJSON-427842350-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:50.539130 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b8a436ff-034f-4397-88f5-45da6df872c6 tempest-HypervisorAdminTestJSON-427842350 tempest-HypervisorAdminTestJSON-427842350-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:50.539508 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b8a436ff-034f-4397-88f5-45da6df872c6 tempest-HypervisorAdminTestJSON-427842350 tempest-HypervisorAdminTestJSON-427842350-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:50.545348 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=3,nova_api:SAVEPOINT=7,nova_api:RELEASE=7,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:39:50.553220 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-53e123d4-ba3c-4f06-ba36-325e69da5f43 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Getting quotas for user be5f4e86197e4175b223f20cacce792d and project 13b427157c9f406da72d9b29af734987. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:39:50.578910 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b8a436ff-034f-4397-88f5-45da6df872c6 tempest-HypervisorAdminTestJSON-427842350 tempest-HypervisorAdminTestJSON-427842350-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:50.579449 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b8a436ff-034f-4397-88f5-45da6df872c6 tempest-HypervisorAdminTestJSON-427842350 tempest-HypervisorAdminTestJSON-427842350-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:50.579975 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-53e123d4-ba3c-4f06-ba36-325e69da5f43 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Going to run 1 instances... {{(pid=134051) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:39:50.582374 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b8a436ff-034f-4397-88f5-45da6df872c6 tempest-HypervisorAdminTestJSON-427842350 tempest-HypervisorAdminTestJSON-427842350-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:50.584859 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-53e123d4-ba3c-4f06-ba36-325e69da5f43 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] [instance: b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134051) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:39:50.617180 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b8a436ff-034f-4397-88f5-45da6df872c6 tempest-HypervisorAdminTestJSON-427842350 tempest-HypervisorAdminTestJSON-427842350-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:50.621036 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b8a436ff-034f-4397-88f5-45da6df872c6 tempest-HypervisorAdminTestJSON-427842350 tempest-HypervisorAdminTestJSON-427842350-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:50.621667 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b8a436ff-034f-4397-88f5-45da6df872c6 tempest-HypervisorAdminTestJSON-427842350 tempest-HypervisorAdminTestJSON-427842350-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:50.634941 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b8a436ff-034f-4397-88f5-45da6df872c6 tempest-HypervisorAdminTestJSON-427842350 tempest-HypervisorAdminTestJSON-427842350-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 0.101836 Aug 27 02:39:50.637280 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 12/27] 10.222.0.70 () {58 vars in 1167 bytes} [Sat Aug 27 02:39:50 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:39:50.657861 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-266535a3-2815-4375-9602-57f80d15e16f tempest-HypervisorAdminTestJSON-427842350 tempest-HypervisorAdminTestJSON-427842350-project-admin] Calling method '.version_select at 0x7f5ee3f07b80>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:50.660120 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-266535a3-2815-4375-9602-57f80d15e16f tempest-HypervisorAdminTestJSON-427842350 tempest-HypervisorAdminTestJSON-427842350-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:50.660793 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-266535a3-2815-4375-9602-57f80d15e16f tempest-HypervisorAdminTestJSON-427842350 tempest-HypervisorAdminTestJSON-427842350-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:50.661361 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-266535a3-2815-4375-9602-57f80d15e16f tempest-HypervisorAdminTestJSON-427842350 tempest-HypervisorAdminTestJSON-427842350-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:50.673205 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-53e123d4-ba3c-4f06-ba36-325e69da5f43 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.316205 Aug 27 02:39:50.679566 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 16/28] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 02:39:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 2323 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:39:50.692697 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ea57b938-c9ed-40ab-b03a-1199ceda4b07 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:50.693354 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-ea57b938-c9ed-40ab-b03a-1199ceda4b07 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] [instance: b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:39:50.741450 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-266535a3-2815-4375-9602-57f80d15e16f tempest-HypervisorAdminTestJSON-427842350 tempest-HypervisorAdminTestJSON-427842350-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:50.742001 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-266535a3-2815-4375-9602-57f80d15e16f tempest-HypervisorAdminTestJSON-427842350 tempest-HypervisorAdminTestJSON-427842350-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:50.742582 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-266535a3-2815-4375-9602-57f80d15e16f tempest-HypervisorAdminTestJSON-427842350 tempest-HypervisorAdminTestJSON-427842350-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:50.781524 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-266535a3-2815-4375-9602-57f80d15e16f tempest-HypervisorAdminTestJSON-427842350 tempest-HypervisorAdminTestJSON-427842350-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:50.782236 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-266535a3-2815-4375-9602-57f80d15e16f tempest-HypervisorAdminTestJSON-427842350 tempest-HypervisorAdminTestJSON-427842350-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:50.782687 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-266535a3-2815-4375-9602-57f80d15e16f tempest-HypervisorAdminTestJSON-427842350 tempest-HypervisorAdminTestJSON-427842350-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:50.801461 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-266535a3-2815-4375-9602-57f80d15e16f tempest-HypervisorAdminTestJSON-427842350 tempest-HypervisorAdminTestJSON-427842350-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.147429 Aug 27 02:39:50.802903 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 13/29] 10.222.0.70 () {58 vars in 1146 bytes} [Sat Aug 27 02:39:50 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:39:50.818603 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-98b73def-ff31-4a37-8f1d-15b76ced4582 tempest-HypervisorAdminTestJSON-427842350 tempest-HypervisorAdminTestJSON-427842350-project-admin] Calling method '.version_select at 0x7f5ee489f1f0>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:50.821726 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-98b73def-ff31-4a37-8f1d-15b76ced4582 tempest-HypervisorAdminTestJSON-427842350 tempest-HypervisorAdminTestJSON-427842350-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:50.823239 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-ea57b938-c9ed-40ab-b03a-1199ceda4b07 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5f4e86197e4175b223f20cacce792d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b427157c9f406da72d9b29af734987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:50.825095 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-98b73def-ff31-4a37-8f1d-15b76ced4582 tempest-HypervisorAdminTestJSON-427842350 tempest-HypervisorAdminTestJSON-427842350-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:50.826281 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-98b73def-ff31-4a37-8f1d-15b76ced4582 tempest-HypervisorAdminTestJSON-427842350 tempest-HypervisorAdminTestJSON-427842350-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:50.857346 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-98b73def-ff31-4a37-8f1d-15b76ced4582 tempest-HypervisorAdminTestJSON-427842350 tempest-HypervisorAdminTestJSON-427842350-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:50.858209 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-98b73def-ff31-4a37-8f1d-15b76ced4582 tempest-HypervisorAdminTestJSON-427842350 tempest-HypervisorAdminTestJSON-427842350-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:50.858981 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-98b73def-ff31-4a37-8f1d-15b76ced4582 tempest-HypervisorAdminTestJSON-427842350 tempest-HypervisorAdminTestJSON-427842350-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:50.860357 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ea57b938-c9ed-40ab-b03a-1199ceda4b07 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] 10.222.0.70 "GET /compute/v2.1/servers/b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe" status: 200 len: 1242 microversion: 2.1 time: 0.161130 Aug 27 02:39:50.867803 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-98b73def-ff31-4a37-8f1d-15b76ced4582 tempest-HypervisorAdminTestJSON-427842350 tempest-HypervisorAdminTestJSON-427842350-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 757 microversion: 2.1 time: 0.056137 Aug 27 02:39:50.868837 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 14/30] 10.222.0.70 () {58 vars in 1152 bytes} [Sat Aug 27 02:39:50 2022] GET /compute/v2.1/os-hypervisors/1 => generated 757 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:39:50.872444 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 17/31] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:39:50 2022] GET /compute/v2.1/servers/b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe => generated 1242 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:39:50.886391 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-29d7c366-1694-4bd4-976e-38cb6f772e95 tempest-HypervisorAdminTestJSON-427842350 tempest-HypervisorAdminTestJSON-427842350-project-admin] Calling method '.version_select at 0x7f5ee3f078b0>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:50.888656 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-29d7c366-1694-4bd4-976e-38cb6f772e95 tempest-HypervisorAdminTestJSON-427842350 tempest-HypervisorAdminTestJSON-427842350-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:50.889486 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-29d7c366-1694-4bd4-976e-38cb6f772e95 tempest-HypervisorAdminTestJSON-427842350 tempest-HypervisorAdminTestJSON-427842350-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:50.890133 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-29d7c366-1694-4bd4-976e-38cb6f772e95 tempest-HypervisorAdminTestJSON-427842350 tempest-HypervisorAdminTestJSON-427842350-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:50.912306 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-29d7c366-1694-4bd4-976e-38cb6f772e95 tempest-HypervisorAdminTestJSON-427842350 tempest-HypervisorAdminTestJSON-427842350-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.029397 Aug 27 02:39:50.913558 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 15/32] 10.222.0.70 () {58 vars in 1179 bytes} [Sat Aug 27 02:39:50 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:39:50.929432 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-83841dd5-ccca-49ff-9a8c-26e8835f777e tempest-HypervisorAdminTestJSON-427842350 tempest-HypervisorAdminTestJSON-427842350-project-admin] Calling method '.version_select at 0x7f5edfff3d30>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:50.931409 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-83841dd5-ccca-49ff-9a8c-26e8835f777e tempest-HypervisorAdminTestJSON-427842350 tempest-HypervisorAdminTestJSON-427842350-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:50.931889 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-83841dd5-ccca-49ff-9a8c-26e8835f777e tempest-HypervisorAdminTestJSON-427842350 tempest-HypervisorAdminTestJSON-427842350-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:50.932378 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-83841dd5-ccca-49ff-9a8c-26e8835f777e tempest-HypervisorAdminTestJSON-427842350 tempest-HypervisorAdminTestJSON-427842350-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:51.005654 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-83841dd5-ccca-49ff-9a8c-26e8835f777e tempest-HypervisorAdminTestJSON-427842350 tempest-HypervisorAdminTestJSON-427842350-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:51.020631 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-83841dd5-ccca-49ff-9a8c-26e8835f777e tempest-HypervisorAdminTestJSON-427842350 tempest-HypervisorAdminTestJSON-427842350-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:51.022675 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-83841dd5-ccca-49ff-9a8c-26e8835f777e tempest-HypervisorAdminTestJSON-427842350 tempest-HypervisorAdminTestJSON-427842350-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:51.066881 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-83841dd5-ccca-49ff-9a8c-26e8835f777e tempest-HypervisorAdminTestJSON-427842350 tempest-HypervisorAdminTestJSON-427842350-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:51.071788 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-83841dd5-ccca-49ff-9a8c-26e8835f777e tempest-HypervisorAdminTestJSON-427842350 tempest-HypervisorAdminTestJSON-427842350-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:51.072503 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-83841dd5-ccca-49ff-9a8c-26e8835f777e tempest-HypervisorAdminTestJSON-427842350 tempest-HypervisorAdminTestJSON-427842350-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:51.136915 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-83841dd5-ccca-49ff-9a8c-26e8835f777e tempest-HypervisorAdminTestJSON-427842350 tempest-HypervisorAdminTestJSON-427842350-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.212295 Aug 27 02:39:51.149207 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 18/33] 10.222.0.70 () {58 vars in 1146 bytes} [Sat Aug 27 02:39:50 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:39:51.156147 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-cc7fa92e-4a12-437d-9506-0e6e42399e34 tempest-HypervisorAdminTestJSON-427842350 tempest-HypervisorAdminTestJSON-427842350-project-admin] Calling method '.version_select at 0x7f5ee3e8fc10>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:51.160685 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cc7fa92e-4a12-437d-9506-0e6e42399e34 tempest-HypervisorAdminTestJSON-427842350 tempest-HypervisorAdminTestJSON-427842350-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:51.161529 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cc7fa92e-4a12-437d-9506-0e6e42399e34 tempest-HypervisorAdminTestJSON-427842350 tempest-HypervisorAdminTestJSON-427842350-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:51.162266 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cc7fa92e-4a12-437d-9506-0e6e42399e34 tempest-HypervisorAdminTestJSON-427842350 tempest-HypervisorAdminTestJSON-427842350-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:51.182498 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cc7fa92e-4a12-437d-9506-0e6e42399e34 tempest-HypervisorAdminTestJSON-427842350 tempest-HypervisorAdminTestJSON-427842350-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:51.183231 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cc7fa92e-4a12-437d-9506-0e6e42399e34 tempest-HypervisorAdminTestJSON-427842350 tempest-HypervisorAdminTestJSON-427842350-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:51.183861 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cc7fa92e-4a12-437d-9506-0e6e42399e34 tempest-HypervisorAdminTestJSON-427842350 tempest-HypervisorAdminTestJSON-427842350-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:51.192967 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-cc7fa92e-4a12-437d-9506-0e6e42399e34 tempest-HypervisorAdminTestJSON-427842350 tempest-HypervisorAdminTestJSON-427842350-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 757 microversion: 2.1 time: 0.043209 Aug 27 02:39:51.194917 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 16/34] 10.222.0.70 () {58 vars in 1152 bytes} [Sat Aug 27 02:39:51 2022] GET /compute/v2.1/os-hypervisors/1 => generated 757 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:39:51.218137 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f7328417-529d-44ee-a7ab-dd67dc6aa016 tempest-HypervisorAdminTestJSON-427842350 tempest-HypervisorAdminTestJSON-427842350-project-admin] Calling method '.version_select at 0x7f5edff3fe50>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:51.223683 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f7328417-529d-44ee-a7ab-dd67dc6aa016 tempest-HypervisorAdminTestJSON-427842350 tempest-HypervisorAdminTestJSON-427842350-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:51.226585 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f7328417-529d-44ee-a7ab-dd67dc6aa016 tempest-HypervisorAdminTestJSON-427842350 tempest-HypervisorAdminTestJSON-427842350-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:51.227033 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f7328417-529d-44ee-a7ab-dd67dc6aa016 tempest-HypervisorAdminTestJSON-427842350 tempest-HypervisorAdminTestJSON-427842350-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:51.263440 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f7328417-529d-44ee-a7ab-dd67dc6aa016 tempest-HypervisorAdminTestJSON-427842350 tempest-HypervisorAdminTestJSON-427842350-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:51.264387 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f7328417-529d-44ee-a7ab-dd67dc6aa016 tempest-HypervisorAdminTestJSON-427842350 tempest-HypervisorAdminTestJSON-427842350-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:51.265807 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f7328417-529d-44ee-a7ab-dd67dc6aa016 tempest-HypervisorAdminTestJSON-427842350 tempest-HypervisorAdminTestJSON-427842350-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:51.274272 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-f7328417-529d-44ee-a7ab-dd67dc6aa016 tempest-HypervisorAdminTestJSON-427842350 tempest-HypervisorAdminTestJSON-427842350-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 758 microversion: 2.1 time: 0.068899 Aug 27 02:39:51.287075 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 19/35] 10.222.0.70 () {58 vars in 1152 bytes} [Sat Aug 27 02:39:51 2022] GET /compute/v2.1/os-hypervisors/2 => generated 758 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:39:51.291196 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-1d5a6c48-33a8-46ae-9b6b-3c46f79cc24f tempest-HypervisorAdminTestJSON-427842350 tempest-HypervisorAdminTestJSON-427842350-project-admin] Calling method '.version_select at 0x7f5ee3e8fdc0>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:51.293225 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1d5a6c48-33a8-46ae-9b6b-3c46f79cc24f tempest-HypervisorAdminTestJSON-427842350 tempest-HypervisorAdminTestJSON-427842350-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:51.293860 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1d5a6c48-33a8-46ae-9b6b-3c46f79cc24f tempest-HypervisorAdminTestJSON-427842350 tempest-HypervisorAdminTestJSON-427842350-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:51.294433 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1d5a6c48-33a8-46ae-9b6b-3c46f79cc24f tempest-HypervisorAdminTestJSON-427842350 tempest-HypervisorAdminTestJSON-427842350-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:51.316592 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1d5a6c48-33a8-46ae-9b6b-3c46f79cc24f tempest-HypervisorAdminTestJSON-427842350 tempest-HypervisorAdminTestJSON-427842350-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:51.317258 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1d5a6c48-33a8-46ae-9b6b-3c46f79cc24f tempest-HypervisorAdminTestJSON-427842350 tempest-HypervisorAdminTestJSON-427842350-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:51.318504 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1d5a6c48-33a8-46ae-9b6b-3c46f79cc24f tempest-HypervisorAdminTestJSON-427842350 tempest-HypervisorAdminTestJSON-427842350-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:51.332802 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1d5a6c48-33a8-46ae-9b6b-3c46f79cc24f tempest-HypervisorAdminTestJSON-427842350 tempest-HypervisorAdminTestJSON-427842350-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:51.333534 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1d5a6c48-33a8-46ae-9b6b-3c46f79cc24f tempest-HypervisorAdminTestJSON-427842350 tempest-HypervisorAdminTestJSON-427842350-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:51.334103 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1d5a6c48-33a8-46ae-9b6b-3c46f79cc24f tempest-HypervisorAdminTestJSON-427842350 tempest-HypervisorAdminTestJSON-427842350-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:51.341496 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1d5a6c48-33a8-46ae-9b6b-3c46f79cc24f tempest-HypervisorAdminTestJSON-427842350 tempest-HypervisorAdminTestJSON-427842350-project-admin] Acquiring lock "compute-rpcapi-router" {{(pid=134052) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 27 02:39:51.342050 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1d5a6c48-33a8-46ae-9b6b-3c46f79cc24f tempest-HypervisorAdminTestJSON-427842350 tempest-HypervisorAdminTestJSON-427842350-project-admin] Acquired lock "compute-rpcapi-router" {{(pid=134052) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 27 02:39:51.343748 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-10698952-32b0-4969-b415-8149717ec2b8 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:51.344463 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-10698952-32b0-4969-b415-8149717ec2b8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:51.345103 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-10698952-32b0-4969-b415-8149717ec2b8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:51.346422 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-10698952-32b0-4969-b415-8149717ec2b8 None None] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:51.347022 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-10698952-32b0-4969-b415-8149717ec2b8 None None] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:51.347924 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-10698952-32b0-4969-b415-8149717ec2b8 None None] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:51.363742 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.compute.rpcapi [None req-10698952-32b0-4969-b415-8149717ec2b8 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 27 02:39:51.364960 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-10698952-32b0-4969-b415-8149717ec2b8 None None] Releasing lock "compute-rpcapi-router" {{(pid=134052) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 27 02:39:51.430487 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-10698952-32b0-4969-b415-8149717ec2b8 None None] 10.222.0.70 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.143618 Aug 27 02:39:51.439605 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 17/36] 10.222.0.70 () {58 vars in 1173 bytes} [Sat Aug 27 02:39:51 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:39:51.548353 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-5417e814-9973-4086-9d63-56241585436d tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:51.549238 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-5417e814-9973-4086-9d63-56241585436d tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] [instance: 459d7a41-f50d-4ffe-a184-c0a12437669a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:39:51.573812 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5417e814-9973-4086-9d63-56241585436d tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:51.586245 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5417e814-9973-4086-9d63-56241585436d tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:51.586945 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5417e814-9973-4086-9d63-56241585436d tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:51.588473 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5417e814-9973-4086-9d63-56241585436d tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:51.590197 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5417e814-9973-4086-9d63-56241585436d tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:51.593916 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5417e814-9973-4086-9d63-56241585436d tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:51.882214 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-73aef042-8cc8-4cd3-9b4e-e60f8588e092 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:51.883152 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-73aef042-8cc8-4cd3-9b4e-e60f8588e092 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] [instance: b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:39:52.008043 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-5417e814-9973-4086-9d63-56241585436d tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772e2e66c92e44f8838ce325437d5a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b2f4a529a3e4ea0937ca903dd5924bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:52.036936 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-5417e814-9973-4086-9d63-56241585436d tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] 10.222.0.70 "GET /compute/v2.1/servers/459d7a41-f50d-4ffe-a184-c0a12437669a" status: 200 len: 1277 microversion: 2.1 time: 0.496883 Aug 27 02:39:52.038661 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 20/37] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:39:51 2022] GET /compute/v2.1/servers/459d7a41-f50d-4ffe-a184-c0a12437669a => generated 1277 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:39:52.181847 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-73aef042-8cc8-4cd3-9b4e-e60f8588e092 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5f4e86197e4175b223f20cacce792d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b427157c9f406da72d9b29af734987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:52.197856 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-73aef042-8cc8-4cd3-9b4e-e60f8588e092 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] 10.222.0.70 "GET /compute/v2.1/servers/b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe" status: 200 len: 1242 microversion: 2.1 time: 0.318031 Aug 27 02:39:52.201494 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 18/38] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:39:51 2022] GET /compute/v2.1/servers/b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe => generated 1242 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:39:53.041864 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-128993a1-4f4e-482c-b516-e8d5286d5b95 tempest-FlavorMetadataValidation-1121232572 tempest-FlavorMetadataValidation-1121232572-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-1338828613", "id": 546236486, "os-flavor-access:is_public": "True"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:39:53.061234 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3b6807d1-72ce-444f-a25d-4df9e7c29fe4 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:53.062007 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-3b6807d1-72ce-444f-a25d-4df9e7c29fe4 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] [instance: 459d7a41-f50d-4ffe-a184-c0a12437669a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:39:53.079188 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3b6807d1-72ce-444f-a25d-4df9e7c29fe4 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:53.080868 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3b6807d1-72ce-444f-a25d-4df9e7c29fe4 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:53.082063 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3b6807d1-72ce-444f-a25d-4df9e7c29fe4 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:53.083392 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3b6807d1-72ce-444f-a25d-4df9e7c29fe4 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:53.086718 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3b6807d1-72ce-444f-a25d-4df9e7c29fe4 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:53.088293 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3b6807d1-72ce-444f-a25d-4df9e7c29fe4 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:53.089834 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-128993a1-4f4e-482c-b516-e8d5286d5b95 tempest-FlavorMetadataValidation-1121232572 tempest-FlavorMetadataValidation-1121232572-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 468 microversion: 2.86 time: 0.247491 Aug 27 02:39:53.091084 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 21/39] 10.222.0.70 () {62 vars in 1188 bytes} [Sat Aug 27 02:39:52 2022] POST /compute/v2.1/flavors => generated 468 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:39:53.104931 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-566f550e-6dd3-4091-9c79-1817de8820e8 tempest-FlavorMetadataValidation-1121232572 tempest-FlavorMetadataValidation-1121232572-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:39:53.347583 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-3b6807d1-72ce-444f-a25d-4df9e7c29fe4 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772e2e66c92e44f8838ce325437d5a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b2f4a529a3e4ea0937ca903dd5924bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:53.363212 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-3b6807d1-72ce-444f-a25d-4df9e7c29fe4 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] 10.222.0.70 "GET /compute/v2.1/servers/459d7a41-f50d-4ffe-a184-c0a12437669a" status: 200 len: 1277 microversion: 2.1 time: 0.306110 Aug 27 02:39:53.380719 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 19/40] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:39:53 2022] GET /compute/v2.1/servers/459d7a41-f50d-4ffe-a184-c0a12437669a => generated 1277 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:39:53.394858 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c07abb5f-964b-45c4-9b64-549496509010 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:53.398088 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-c07abb5f-964b-45c4-9b64-549496509010 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] [instance: b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:39:53.424669 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c07abb5f-964b-45c4-9b64-549496509010 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:53.425790 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c07abb5f-964b-45c4-9b64-549496509010 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:53.426600 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c07abb5f-964b-45c4-9b64-549496509010 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:53.428101 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c07abb5f-964b-45c4-9b64-549496509010 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:53.428729 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c07abb5f-964b-45c4-9b64-549496509010 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:53.429371 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c07abb5f-964b-45c4-9b64-549496509010 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:53.550205 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-566f550e-6dd3-4091-9c79-1817de8820e8 tempest-FlavorMetadataValidation-1121232572 tempest-FlavorMetadataValidation-1121232572-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors/546236486/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.449620 Aug 27 02:39:53.557908 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 22/41] 10.222.0.70 () {62 vars in 1262 bytes} [Sat Aug 27 02:39:53 2022] POST /compute/v2.1/flavors/546236486/os-extra_specs => generated 62 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:39:53.564821 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e6a87c9d-bd1b-4980-a939-3cbd80035276 tempest-FlavorMetadataValidation-1121232572 tempest-FlavorMetadataValidation-1121232572-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:53.633285 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e6a87c9d-bd1b-4980-a939-3cbd80035276 tempest-FlavorMetadataValidation-1121232572 tempest-FlavorMetadataValidation-1121232572-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/546236486" status: 202 len: 0 microversion: 2.86 time: 0.073361 Aug 27 02:39:53.638742 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 23/42] 10.222.0.70 () {60 vars in 1199 bytes} [Sat Aug 27 02:39:53 2022] DELETE /compute/v2.1/flavors/546236486 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 27 02:39:53.645154 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-fc70d4c5-bc71-4fe3-8e54-0199c6ca3494 tempest-FlavorMetadataValidation-1121232572 tempest-FlavorMetadataValidation-1121232572-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:53.707914 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-c07abb5f-964b-45c4-9b64-549496509010 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5f4e86197e4175b223f20cacce792d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b427157c9f406da72d9b29af734987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:53.724504 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-fc70d4c5-bc71-4fe3-8e54-0199c6ca3494 tempest-FlavorMetadataValidation-1121232572 tempest-FlavorMetadataValidation-1121232572-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.86 time: 0.085256 Aug 27 02:39:53.736604 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 24/43] 10.222.0.70 () {60 vars in 1187 bytes} [Sat Aug 27 02:39:53 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:39:53.756091 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c07abb5f-964b-45c4-9b64-549496509010 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] 10.222.0.70 "GET /compute/v2.1/servers/b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe" status: 200 len: 1298 microversion: 2.1 time: 0.372445 Aug 27 02:39:53.761760 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 20/44] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:39:53 2022] GET /compute/v2.1/servers/b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe => generated 1298 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:39:54.386573 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-5a38995b-0153-4777-833a-41adde928478 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:54.387961 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-5a38995b-0153-4777-833a-41adde928478 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] [instance: 459d7a41-f50d-4ffe-a184-c0a12437669a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:39:54.412158 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5a38995b-0153-4777-833a-41adde928478 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:54.414863 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5a38995b-0153-4777-833a-41adde928478 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:54.415512 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5a38995b-0153-4777-833a-41adde928478 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:54.419675 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5a38995b-0153-4777-833a-41adde928478 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:54.420443 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5a38995b-0153-4777-833a-41adde928478 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:54.421017 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5a38995b-0153-4777-833a-41adde928478 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:54.660440 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-5a38995b-0153-4777-833a-41adde928478 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772e2e66c92e44f8838ce325437d5a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b2f4a529a3e4ea0937ca903dd5924bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:54.672347 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-5a38995b-0153-4777-833a-41adde928478 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] 10.222.0.70 "GET /compute/v2.1/servers/459d7a41-f50d-4ffe-a184-c0a12437669a" status: 200 len: 1277 microversion: 2.1 time: 0.289848 Aug 27 02:39:54.694862 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 25/45] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:39:54 2022] GET /compute/v2.1/servers/459d7a41-f50d-4ffe-a184-c0a12437669a => generated 1277 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:39:54.780178 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8348a69b-8ab1-4c45-a90c-ed664abc8667 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:54.781413 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-8348a69b-8ab1-4c45-a90c-ed664abc8667 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] [instance: b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:39:54.798873 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8348a69b-8ab1-4c45-a90c-ed664abc8667 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:54.799832 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8348a69b-8ab1-4c45-a90c-ed664abc8667 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:54.801181 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8348a69b-8ab1-4c45-a90c-ed664abc8667 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:54.804066 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8348a69b-8ab1-4c45-a90c-ed664abc8667 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:54.805263 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8348a69b-8ab1-4c45-a90c-ed664abc8667 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:54.810251 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8348a69b-8ab1-4c45-a90c-ed664abc8667 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:55.147468 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-8348a69b-8ab1-4c45-a90c-ed664abc8667 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5f4e86197e4175b223f20cacce792d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b427157c9f406da72d9b29af734987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:55.163912 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-8348a69b-8ab1-4c45-a90c-ed664abc8667 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] 10.222.0.70 "GET /compute/v2.1/servers/b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe" status: 200 len: 1296 microversion: 2.1 time: 0.388349 Aug 27 02:39:55.176626 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 21/46] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:39:54 2022] GET /compute/v2.1/servers/b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe => generated 1296 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:39:55.697848 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b785437c-cfe1-42e6-8416-69a63e68ef93 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:55.698623 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b785437c-cfe1-42e6-8416-69a63e68ef93 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] [instance: 459d7a41-f50d-4ffe-a184-c0a12437669a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:39:55.710318 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b785437c-cfe1-42e6-8416-69a63e68ef93 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:55.710839 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b785437c-cfe1-42e6-8416-69a63e68ef93 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:55.711289 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b785437c-cfe1-42e6-8416-69a63e68ef93 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:55.712032 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b785437c-cfe1-42e6-8416-69a63e68ef93 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:55.733279 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b785437c-cfe1-42e6-8416-69a63e68ef93 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:55.733936 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b785437c-cfe1-42e6-8416-69a63e68ef93 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:56.198046 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c3513fcf-95a3-4293-8fa4-5f71a355b56f tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:56.198742 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-c3513fcf-95a3-4293-8fa4-5f71a355b56f tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] [instance: b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:39:56.221512 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c3513fcf-95a3-4293-8fa4-5f71a355b56f tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:56.222144 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c3513fcf-95a3-4293-8fa4-5f71a355b56f tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:56.231872 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c3513fcf-95a3-4293-8fa4-5f71a355b56f tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:56.232630 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c3513fcf-95a3-4293-8fa4-5f71a355b56f tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:56.233926 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c3513fcf-95a3-4293-8fa4-5f71a355b56f tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:56.235022 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c3513fcf-95a3-4293-8fa4-5f71a355b56f tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:56.815338 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-c3513fcf-95a3-4293-8fa4-5f71a355b56f tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5f4e86197e4175b223f20cacce792d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b427157c9f406da72d9b29af734987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:56.823501 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c3513fcf-95a3-4293-8fa4-5f71a355b56f tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] 10.222.0.70 "GET /compute/v2.1/servers/b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe" status: 200 len: 1296 microversion: 2.1 time: 0.629759 Aug 27 02:39:56.824094 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 22/47] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:39:56 2022] GET /compute/v2.1/servers/b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe => generated 1296 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:39:57.008249 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-b785437c-cfe1-42e6-8416-69a63e68ef93 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772e2e66c92e44f8838ce325437d5a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b2f4a529a3e4ea0937ca903dd5924bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:57.017252 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b785437c-cfe1-42e6-8416-69a63e68ef93 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] 10.222.0.70 "GET /compute/v2.1/servers/459d7a41-f50d-4ffe-a184-c0a12437669a" status: 200 len: 1319 microversion: 2.1 time: 1.325377 Aug 27 02:39:57.038229 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 26/48] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:39:55 2022] GET /compute/v2.1/servers/459d7a41-f50d-4ffe-a184-c0a12437669a => generated 1319 bytes in 1347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:39:57.856181 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-626e0ada-d81c-46d4-b1cd-de546419ec87 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:57.856828 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-626e0ada-d81c-46d4-b1cd-de546419ec87 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] [instance: b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:39:57.873472 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-626e0ada-d81c-46d4-b1cd-de546419ec87 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:57.883697 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-626e0ada-d81c-46d4-b1cd-de546419ec87 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:57.888822 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-626e0ada-d81c-46d4-b1cd-de546419ec87 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:57.893005 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-626e0ada-d81c-46d4-b1cd-de546419ec87 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:57.893488 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-626e0ada-d81c-46d4-b1cd-de546419ec87 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:57.893928 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-626e0ada-d81c-46d4-b1cd-de546419ec87 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:58.352459 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c7d991aa-3889-4cba-8198-6726a70ee95c tempest-HostsAdminTestJSON-1190581969 tempest-HostsAdminTestJSON-1190581969-project-admin] Calling method '.version_select at 0x7f5ee3e9df70>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:58.364810 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c7d991aa-3889-4cba-8198-6726a70ee95c tempest-HostsAdminTestJSON-1190581969 tempest-HostsAdminTestJSON-1190581969-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:58.365370 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c7d991aa-3889-4cba-8198-6726a70ee95c tempest-HostsAdminTestJSON-1190581969 tempest-HostsAdminTestJSON-1190581969-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:58.373181 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c7d991aa-3889-4cba-8198-6726a70ee95c tempest-HostsAdminTestJSON-1190581969 tempest-HostsAdminTestJSON-1190581969-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:58.374971 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c7d991aa-3889-4cba-8198-6726a70ee95c tempest-HostsAdminTestJSON-1190581969 tempest-HostsAdminTestJSON-1190581969-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:58.381152 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c7d991aa-3889-4cba-8198-6726a70ee95c tempest-HostsAdminTestJSON-1190581969 tempest-HostsAdminTestJSON-1190581969-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:58.385773 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c7d991aa-3889-4cba-8198-6726a70ee95c tempest-HostsAdminTestJSON-1190581969 tempest-HostsAdminTestJSON-1190581969-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:58.503594 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c7d991aa-3889-4cba-8198-6726a70ee95c tempest-HostsAdminTestJSON-1190581969 tempest-HostsAdminTestJSON-1190581969-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hosts" status: 200 len: 398 microversion: 2.1 time: 0.865097 Aug 27 02:39:58.508645 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 23/49] 10.222.0.70 () {58 vars in 1128 bytes} [Sat Aug 27 02:39:57 2022] GET /compute/v2.1/os-hosts => generated 398 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:39:58.515320 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d96f9ed7-ebeb-48c4-9a36-d1545d7fde37 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:58.520001 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d96f9ed7-ebeb-48c4-9a36-d1545d7fde37 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] [instance: 459d7a41-f50d-4ffe-a184-c0a12437669a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:39:58.534449 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d96f9ed7-ebeb-48c4-9a36-d1545d7fde37 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:58.535324 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d96f9ed7-ebeb-48c4-9a36-d1545d7fde37 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:58.535972 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d96f9ed7-ebeb-48c4-9a36-d1545d7fde37 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:58.536920 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d96f9ed7-ebeb-48c4-9a36-d1545d7fde37 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:58.537588 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d96f9ed7-ebeb-48c4-9a36-d1545d7fde37 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:58.538229 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d96f9ed7-ebeb-48c4-9a36-d1545d7fde37 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:58.645602 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-626e0ada-d81c-46d4-b1cd-de546419ec87 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5f4e86197e4175b223f20cacce792d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b427157c9f406da72d9b29af734987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:58.685334 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-626e0ada-d81c-46d4-b1cd-de546419ec87 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] 10.222.0.70 "GET /compute/v2.1/servers/b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe" status: 200 len: 1296 microversion: 2.1 time: 0.833919 Aug 27 02:39:58.689347 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 27/50] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:39:57 2022] GET /compute/v2.1/servers/b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe => generated 1296 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:39:58.708043 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0ab9e728-f3e7-4629-b571-ea7e4ddd45c3 tempest-HostsAdminTestJSON-1190581969 tempest-HostsAdminTestJSON-1190581969-project-admin] Calling method '.version_select at 0x7f5edfe29280>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:58.719006 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0ab9e728-f3e7-4629-b571-ea7e4ddd45c3 tempest-HostsAdminTestJSON-1190581969 tempest-HostsAdminTestJSON-1190581969-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:58.724860 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0ab9e728-f3e7-4629-b571-ea7e4ddd45c3 tempest-HostsAdminTestJSON-1190581969 tempest-HostsAdminTestJSON-1190581969-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:58.725871 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0ab9e728-f3e7-4629-b571-ea7e4ddd45c3 tempest-HostsAdminTestJSON-1190581969 tempest-HostsAdminTestJSON-1190581969-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:58.726932 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0ab9e728-f3e7-4629-b571-ea7e4ddd45c3 tempest-HostsAdminTestJSON-1190581969 tempest-HostsAdminTestJSON-1190581969-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:58.728488 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0ab9e728-f3e7-4629-b571-ea7e4ddd45c3 tempest-HostsAdminTestJSON-1190581969 tempest-HostsAdminTestJSON-1190581969-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:58.731159 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0ab9e728-f3e7-4629-b571-ea7e4ddd45c3 tempest-HostsAdminTestJSON-1190581969 tempest-HostsAdminTestJSON-1190581969-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:58.866098 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-0ab9e728-f3e7-4629-b571-ea7e4ddd45c3 tempest-HostsAdminTestJSON-1190581969 tempest-HostsAdminTestJSON-1190581969-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 398 microversion: 2.1 time: 0.167742 Aug 27 02:39:58.869183 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 28/51] 10.222.0.70 () {58 vars in 1139 bytes} [Sat Aug 27 02:39:58 2022] GET /compute/v2.1/os-hosts?zone= => generated 398 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:39:58.885536 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3b388b33-85d6-4cf8-b1b9-69e057a3af1e tempest-HostsAdminTestJSON-1190581969 tempest-HostsAdminTestJSON-1190581969-project-admin] Calling method '.version_select at 0x7f5edfdd7ca0>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:58.890342 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3b388b33-85d6-4cf8-b1b9-69e057a3af1e tempest-HostsAdminTestJSON-1190581969 tempest-HostsAdminTestJSON-1190581969-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:58.891163 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3b388b33-85d6-4cf8-b1b9-69e057a3af1e tempest-HostsAdminTestJSON-1190581969 tempest-HostsAdminTestJSON-1190581969-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:58.891838 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3b388b33-85d6-4cf8-b1b9-69e057a3af1e tempest-HostsAdminTestJSON-1190581969 tempest-HostsAdminTestJSON-1190581969-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:58.893020 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3b388b33-85d6-4cf8-b1b9-69e057a3af1e tempest-HostsAdminTestJSON-1190581969 tempest-HostsAdminTestJSON-1190581969-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:58.893710 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3b388b33-85d6-4cf8-b1b9-69e057a3af1e tempest-HostsAdminTestJSON-1190581969 tempest-HostsAdminTestJSON-1190581969-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:58.894291 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3b388b33-85d6-4cf8-b1b9-69e057a3af1e tempest-HostsAdminTestJSON-1190581969 tempest-HostsAdminTestJSON-1190581969-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:58.944241 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-3b388b33-85d6-4cf8-b1b9-69e057a3af1e tempest-HostsAdminTestJSON-1190581969 tempest-HostsAdminTestJSON-1190581969-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.066700 Aug 27 02:39:58.948416 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 29/52] 10.222.0.70 () {58 vars in 1145 bytes} [Sat Aug 27 02:39:58 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:39:59.112282 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-d96f9ed7-ebeb-48c4-9a36-d1545d7fde37 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772e2e66c92e44f8838ce325437d5a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b2f4a529a3e4ea0937ca903dd5924bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:59.121527 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d96f9ed7-ebeb-48c4-9a36-d1545d7fde37 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] 10.222.0.70 "GET /compute/v2.1/servers/459d7a41-f50d-4ffe-a184-c0a12437669a" status: 200 len: 1319 microversion: 2.1 time: 0.610660 Aug 27 02:39:59.121527 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 24/53] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:39:58 2022] GET /compute/v2.1/servers/459d7a41-f50d-4ffe-a184-c0a12437669a => generated 1319 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:39:59.712966 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-717871a3-0ea5-49bd-a391-ed2072cfe444 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:59.713579 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-717871a3-0ea5-49bd-a391-ed2072cfe444 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] [instance: b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:39:59.729767 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-717871a3-0ea5-49bd-a391-ed2072cfe444 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:59.739004 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-717871a3-0ea5-49bd-a391-ed2072cfe444 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:59.739780 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-717871a3-0ea5-49bd-a391-ed2072cfe444 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:59.740743 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-717871a3-0ea5-49bd-a391-ed2072cfe444 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:59.741220 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-717871a3-0ea5-49bd-a391-ed2072cfe444 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:59.741745 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-717871a3-0ea5-49bd-a391-ed2072cfe444 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:00.144217 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e803cd9a-bec3-4c71-97af-511f2235ef32 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:00.144968 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-e803cd9a-bec3-4c71-97af-511f2235ef32 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] [instance: 459d7a41-f50d-4ffe-a184-c0a12437669a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:00.166162 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e803cd9a-bec3-4c71-97af-511f2235ef32 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:00.166661 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e803cd9a-bec3-4c71-97af-511f2235ef32 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:00.167101 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e803cd9a-bec3-4c71-97af-511f2235ef32 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:00.173801 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e803cd9a-bec3-4c71-97af-511f2235ef32 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:00.174292 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e803cd9a-bec3-4c71-97af-511f2235ef32 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:00.174794 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e803cd9a-bec3-4c71-97af-511f2235ef32 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:00.742697 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-717871a3-0ea5-49bd-a391-ed2072cfe444 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5f4e86197e4175b223f20cacce792d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b427157c9f406da72d9b29af734987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:00.755772 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-717871a3-0ea5-49bd-a391-ed2072cfe444 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] 10.222.0.70 "GET /compute/v2.1/servers/b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe" status: 200 len: 1338 microversion: 2.1 time: 1.047020 Aug 27 02:40:00.782708 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 30/54] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:39:59 2022] GET /compute/v2.1/servers/b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe => generated 1338 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:01.003237 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-e803cd9a-bec3-4c71-97af-511f2235ef32 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772e2e66c92e44f8838ce325437d5a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b2f4a529a3e4ea0937ca903dd5924bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:01.011625 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e803cd9a-bec3-4c71-97af-511f2235ef32 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] 10.222.0.70 "GET /compute/v2.1/servers/459d7a41-f50d-4ffe-a184-c0a12437669a" status: 200 len: 1319 microversion: 2.1 time: 0.872421 Aug 27 02:40:01.023010 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 25/55] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:00 2022] GET /compute/v2.1/servers/459d7a41-f50d-4ffe-a184-c0a12437669a => generated 1319 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:40:01.786710 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-aefc407f-e934-432f-a9a9-7b1f71929899 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:01.788705 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-aefc407f-e934-432f-a9a9-7b1f71929899 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] [instance: b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:01.799336 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=8 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:40:01.822335 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-aefc407f-e934-432f-a9a9-7b1f71929899 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:01.824176 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-aefc407f-e934-432f-a9a9-7b1f71929899 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:01.826985 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-aefc407f-e934-432f-a9a9-7b1f71929899 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:01.835201 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-aefc407f-e934-432f-a9a9-7b1f71929899 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:01.836182 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-aefc407f-e934-432f-a9a9-7b1f71929899 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:01.836946 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-aefc407f-e934-432f-a9a9-7b1f71929899 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:02.188247 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=10 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:40:02.633517 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-a75a1d28-14d0-4e7d-b578-1de26870052b req-3935a01d-57e5-440f-bbdf-844f5e2cc6d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "459d7a41-f50d-4ffe-a184-c0a12437669a", "tag": "44d32ad2-6a1e-4fa9-814e-6eea70c41884"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:02.680288 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-a75a1d28-14d0-4e7d-b578-1de26870052b req-3935a01d-57e5-440f-bbdf-844f5e2cc6d9 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:02.683301 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-a75a1d28-14d0-4e7d-b578-1de26870052b req-3935a01d-57e5-440f-bbdf-844f5e2cc6d9 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:02.684364 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-a75a1d28-14d0-4e7d-b578-1de26870052b req-3935a01d-57e5-440f-bbdf-844f5e2cc6d9 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:02.766728 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-a75a1d28-14d0-4e7d-b578-1de26870052b req-3935a01d-57e5-440f-bbdf-844f5e2cc6d9 service nova] Creating event network-changed:44d32ad2-6a1e-4fa9-814e-6eea70c41884 for instance 459d7a41-f50d-4ffe-a184-c0a12437669a on n-h1-852278-4 Aug 27 02:40:02.792337 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-a75a1d28-14d0-4e7d-b578-1de26870052b req-3935a01d-57e5-440f-bbdf-844f5e2cc6d9 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.799051 Aug 27 02:40:02.797762 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 26/56] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:40:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:40:02.824752 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-889ef483-15f2-4788-806f-27b62bb906a1 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:02.828270 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-889ef483-15f2-4788-806f-27b62bb906a1 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] [instance: 459d7a41-f50d-4ffe-a184-c0a12437669a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:02.851178 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=6,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:DELETE=3 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:40:02.857372 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-889ef483-15f2-4788-806f-27b62bb906a1 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:02.859953 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-889ef483-15f2-4788-806f-27b62bb906a1 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:02.862903 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-889ef483-15f2-4788-806f-27b62bb906a1 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:02.865673 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-889ef483-15f2-4788-806f-27b62bb906a1 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:02.870013 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-889ef483-15f2-4788-806f-27b62bb906a1 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:02.870969 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-889ef483-15f2-4788-806f-27b62bb906a1 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:03.068462 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-aefc407f-e934-432f-a9a9-7b1f71929899 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5f4e86197e4175b223f20cacce792d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b427157c9f406da72d9b29af734987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:03.091632 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-aefc407f-e934-432f-a9a9-7b1f71929899 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] 10.222.0.70 "GET /compute/v2.1/servers/b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe" status: 200 len: 1338 microversion: 2.1 time: 1.309980 Aug 27 02:40:03.100225 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 31/57] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:01 2022] GET /compute/v2.1/servers/b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe => generated 1338 bytes in 1319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:04.621329 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-889ef483-15f2-4788-806f-27b62bb906a1 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772e2e66c92e44f8838ce325437d5a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b2f4a529a3e4ea0937ca903dd5924bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:04.629476 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-889ef483-15f2-4788-806f-27b62bb906a1 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] 10.222.0.70 "GET /compute/v2.1/servers/459d7a41-f50d-4ffe-a184-c0a12437669a" status: 200 len: 1319 microversion: 2.1 time: 1.829249 Aug 27 02:40:04.636015 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ec93adb3-b63d-4c24-86df-7692e722960c tempest-InstanceUsageAuditLogNegativeTestJSON-1272998101 tempest-InstanceUsageAuditLogNegativeTestJSON-1272998101-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:04.637609 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 27/58] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:02 2022] GET /compute/v2.1/servers/459d7a41-f50d-4ffe-a184-c0a12437669a => generated 1319 bytes in 1838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:04.639739 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-ec93adb3-b63d-4c24-86df-7692e722960c tempest-InstanceUsageAuditLogNegativeTestJSON-1272998101 tempest-InstanceUsageAuditLogNegativeTestJSON-1272998101-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Aug 27 02:40:04.647367 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e963dd3c-7f5e-4545-a845-5869b54ea8ea tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:04.650438 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ec93adb3-b63d-4c24-86df-7692e722960c tempest-InstanceUsageAuditLogNegativeTestJSON-1272998101 tempest-InstanceUsageAuditLogNegativeTestJSON-1272998101-project-admin] Request method failure captured: Aug 27 02:40:04.650438 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Aug 27 02:40:04.650438 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:40:04.650438 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:40:04.650438 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:40:04.650438 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:40:04.650438 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:40:04.650438 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:40:04.650438 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:40:04.650438 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:40:04.650438 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYQDeLYva1zZ6yMiYtkRps7e12-qCwAC02gX48bahpvPFMMsnN4_1cS66QRll5IA9TZjk9DGb0yb6tlQ7FdJ-zIHcv82sdaiZeLySmarTYhDz-98rBASBmagNAylZw3CvaqaWv39JhmulnD_HqX0otgaprrnbm3tnMYXVBkpL9FJtns Aug 27 02:40:04.650438 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:40:04.650438 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:40:04.650438 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:40:04.650438 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:40:04.650438 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:40:04.650438 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:40:04.650438 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 8f6d8ad9ba974d7f8faab199d39eedc1 Aug 27 02:40:04.650438 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1272998101 Aug 27 02:40:04.650438 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,admin,member Aug 27 02:40:04.650438 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,admin,member Aug 27 02:40:04.651718 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8f6d8ad9ba974d7f8faab199d39eedc1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8f6d8ad9ba974d7f8faab199d39eedc1", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8f6d8ad9ba974d7f8faab199d39eedc1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8f6d8ad9ba974d7f8faab199d39eedc1"}]}] Aug 27 02:40:04.651718 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1272998101 Aug 27 02:40:04.651718 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 8f6d8ad9ba974d7f8faab199d39eedc1 Aug 27 02:40:04.651718 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1272998101 Aug 27 02:40:04.651718 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1272998101-project-admin Aug 27 02:40:04.651718 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:40:04.651718 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:40:04.651718 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: b7b926c9ff504ecfbb3f67243902be23 Aug 27 02:40:04.651718 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1272998101-project-admin Aug 27 02:40:04.651718 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 02:40:04.651718 n-d-852278-4 devstack@n-api.service[134051]: exception: Invalid timestamp for date invalid_time Aug 27 02:40:04.652446 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': 'invalid_time'} Aug 27 02:40:04.652446 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:40:04.652446 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:04.652446 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Aug 27 02:40:04.652446 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Aug 27 02:40:04.652446 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Aug 27 02:40:04.652446 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Aug 27 02:40:04.652446 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Aug 27 02:40:04.652446 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Aug 27 02:40:04.652446 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Aug 27 02:40:04.652446 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:04.652446 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:04.652446 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:04.652446 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:04.652446 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:04.652446 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:04.652446 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:40:04.652446 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:40:04.652446 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:40:04.652446 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:40:04.653587 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Aug 27 02:40:04.653587 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Aug 27 02:40:04.653587 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Aug 27 02:40:04.653587 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:04.653587 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:04.653587 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:04.653587 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:04.653587 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:04.653587 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:04.653587 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:40:04.653587 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:40:04.653587 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Aug 27 02:40:04.653587 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:04.655182 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ec93adb3-b63d-4c24-86df-7692e722960c tempest-InstanceUsageAuditLogNegativeTestJSON-1272998101 tempest-InstanceUsageAuditLogNegativeTestJSON-1272998101-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:40:04.656343 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ec93adb3-b63d-4c24-86df-7692e722960c tempest-InstanceUsageAuditLogNegativeTestJSON-1272998101 tempest-InstanceUsageAuditLogNegativeTestJSON-1272998101-project-admin] 10.222.0.70 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.610307 Aug 27 02:40:04.657599 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 32/59] 10.222.0.70 () {58 vars in 1224 bytes} [Sat Aug 27 02:40:04 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 612 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 27 02:40:04.659733 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-e963dd3c-7f5e-4545-a845-5869b54ea8ea tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] [instance: b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:04.697548 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e963dd3c-7f5e-4545-a845-5869b54ea8ea tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:04.699438 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e963dd3c-7f5e-4545-a845-5869b54ea8ea tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:04.699891 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e963dd3c-7f5e-4545-a845-5869b54ea8ea tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:04.706048 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e963dd3c-7f5e-4545-a845-5869b54ea8ea tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:04.706577 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e963dd3c-7f5e-4545-a845-5869b54ea8ea tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:04.707027 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e963dd3c-7f5e-4545-a845-5869b54ea8ea tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:04.786992 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c72186ef-48e1-46d9-bdb0-9c53ac5cb187 tempest-FlavorsV255TestJSON-1063127344 tempest-FlavorsV255TestJSON-1063127344-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-1778707390", "id": 1407691075, "os-flavor-access:is_public": "True"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:04.787175 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=100 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:40:04.882532 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c72186ef-48e1-46d9-bdb0-9c53ac5cb187 tempest-FlavorsV255TestJSON-1063127344 tempest-FlavorsV255TestJSON-1063127344-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 449 microversion: 2.55 time: 0.223413 Aug 27 02:40:04.895452 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 33/60] 10.222.0.70 () {62 vars in 1188 bytes} [Sat Aug 27 02:40:04 2022] POST /compute/v2.1/flavors => generated 449 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:40:05.302132 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-1f4e0098-a0bf-4eb5-a2a5-a6723efadf87 tempest-InstanceUsageAuditLogNegativeTestJSON-494130755 tempest-InstanceUsageAuditLogNegativeTestJSON-494130755-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:05.307054 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-1f4e0098-a0bf-4eb5-a2a5-a6723efadf87 tempest-InstanceUsageAuditLogNegativeTestJSON-494130755 tempest-InstanceUsageAuditLogNegativeTestJSON-494130755-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '3ab4a518113d4ed89cf4d2d629fb7a4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9bff2a3d824bf6a035e6b832cae96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:05.310012 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-1f4e0098-a0bf-4eb5-a2a5-a6723efadf87 tempest-InstanceUsageAuditLogNegativeTestJSON-494130755 tempest-InstanceUsageAuditLogNegativeTestJSON-494130755-project] Request method failure captured: Aug 27 02:40:05.310012 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Aug 27 02:40:05.310012 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:40:05.310012 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:40:05.310012 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:40:05.310012 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:40:05.310012 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:40:05.310012 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:40:05.310012 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:40:05.310012 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:40:05.310012 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYQBI2EaWIsYwU-Bk0CfqQAR1zdmehjtVSdl1HYz0fTOdhDYmaeiM0sHY0DbJ-1y7xeQb5XfBJ2q6BWDFf6eAwgmH50kXwMfrlZGb-c2e7Du_79yGqOJwBc6lyZczQgnXUyj-4G1GcpMMw2BeZ6Os-UoKHGObXq1UpscjtAZjt6AWXI Aug 27 02:40:05.310012 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:40:05.310012 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:40:05.310012 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:40:05.310012 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:40:05.310012 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:40:05.310012 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:40:05.310012 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 2b9bff2a3d824bf6a035e6b832cae96e Aug 27 02:40:05.310012 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-494130755 Aug 27 02:40:05.310012 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:40:05.310012 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:40:05.311235 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2b9bff2a3d824bf6a035e6b832cae96e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_2b9bff2a3d824bf6a035e6b832cae96e", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2b9bff2a3d824bf6a035e6b832cae96e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/2b9bff2a3d824bf6a035e6b832cae96e"}]}] Aug 27 02:40:05.311235 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-494130755 Aug 27 02:40:05.311235 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 2b9bff2a3d824bf6a035e6b832cae96e Aug 27 02:40:05.311235 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-494130755 Aug 27 02:40:05.311235 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-494130755-project Aug 27 02:40:05.311235 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:40:05.311235 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:40:05.311235 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 3ab4a518113d4ed89cf4d2d629fb7a4c Aug 27 02:40:05.311235 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-494130755-project Aug 27 02:40:05.311235 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 02:40:05.311781 n-d-852278-4 devstack@n-api.service[134051]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 27 02:40:05.311781 n-d-852278-4 devstack@n-api.service[134051]: action_args: {} Aug 27 02:40:05.311781 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:40:05.311781 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:05.311781 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:05.311781 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:05.311781 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:40:05.311781 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:40:05.311781 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:40:05.311781 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:40:05.311781 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Aug 27 02:40:05.311781 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Aug 27 02:40:05.311781 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 02:40:05.311781 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 02:40:05.311781 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 02:40:05.311781 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 02:40:05.311781 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 02:40:05.311781 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 02:40:05.311781 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 02:40:05.311781 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 02:40:05.312826 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 02:40:05.312826 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 02:40:05.312826 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 02:40:05.312826 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 02:40:05.312826 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 02:40:05.312826 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 02:40:05.312826 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 27 02:40:05.312826 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:05.312826 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:05.312826 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:05.312826 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:05.312826 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:05.312826 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:05.312826 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 02:40:05.312826 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 02:40:05.312826 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 27 02:40:05.312826 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:05.315081 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-1f4e0098-a0bf-4eb5-a2a5-a6723efadf87 tempest-InstanceUsageAuditLogNegativeTestJSON-494130755 tempest-InstanceUsageAuditLogNegativeTestJSON-494130755-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:40:05.315081 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-1f4e0098-a0bf-4eb5-a2a5-a6723efadf87 tempest-InstanceUsageAuditLogNegativeTestJSON-494130755 tempest-InstanceUsageAuditLogNegativeTestJSON-494130755-project] 10.222.0.70 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.414346 Aug 27 02:40:05.329061 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 34/61] 10.222.0.70 () {58 vars in 1185 bytes} [Sat Aug 27 02:40:04 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 428 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:40:05.448439 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-e963dd3c-7f5e-4545-a845-5869b54ea8ea tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5f4e86197e4175b223f20cacce792d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b427157c9f406da72d9b29af734987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:05.460607 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e963dd3c-7f5e-4545-a845-5869b54ea8ea tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] 10.222.0.70 "GET /compute/v2.1/servers/b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe" status: 200 len: 1338 microversion: 2.1 time: 0.818274 Aug 27 02:40:05.477876 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 28/62] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:04 2022] GET /compute/v2.1/servers/b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe => generated 1338 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:05.493818 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-928a6e9d-34bf-4a9b-a737-47a22ed0b1aa tempest-InstanceUsageAuditLogNegativeTestJSON-494130755 tempest-InstanceUsageAuditLogNegativeTestJSON-494130755-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:05.503976 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-928a6e9d-34bf-4a9b-a737-47a22ed0b1aa tempest-InstanceUsageAuditLogNegativeTestJSON-494130755 tempest-InstanceUsageAuditLogNegativeTestJSON-494130755-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '3ab4a518113d4ed89cf4d2d629fb7a4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9bff2a3d824bf6a035e6b832cae96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:05.506704 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-928a6e9d-34bf-4a9b-a737-47a22ed0b1aa tempest-InstanceUsageAuditLogNegativeTestJSON-494130755 tempest-InstanceUsageAuditLogNegativeTestJSON-494130755-project] Request method failure captured: Aug 27 02:40:05.506704 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-08-27%2002:40:05 HTTP/1.1 Aug 27 02:40:05.506704 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:40:05.506704 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:40:05.506704 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:40:05.506704 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:40:05.506704 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:40:05.506704 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:40:05.506704 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:40:05.506704 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:40:05.506704 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYQBI2EaWIsYwU-Bk0CfqQAR1zdmehjtVSdl1HYz0fTOdhDYmaeiM0sHY0DbJ-1y7xeQb5XfBJ2q6BWDFf6eAwgmH50kXwMfrlZGb-c2e7Du_79yGqOJwBc6lyZczQgnXUyj-4G1GcpMMw2BeZ6Os-UoKHGObXq1UpscjtAZjt6AWXI Aug 27 02:40:05.506704 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:40:05.506704 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:40:05.506704 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:40:05.506704 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:40:05.506704 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:40:05.506704 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:40:05.506704 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 2b9bff2a3d824bf6a035e6b832cae96e Aug 27 02:40:05.506704 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-494130755 Aug 27 02:40:05.506704 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:40:05.506704 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:40:05.507956 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2b9bff2a3d824bf6a035e6b832cae96e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_2b9bff2a3d824bf6a035e6b832cae96e", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2b9bff2a3d824bf6a035e6b832cae96e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/2b9bff2a3d824bf6a035e6b832cae96e"}]}] Aug 27 02:40:05.507956 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-494130755 Aug 27 02:40:05.507956 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 2b9bff2a3d824bf6a035e6b832cae96e Aug 27 02:40:05.507956 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-494130755 Aug 27 02:40:05.507956 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-494130755-project Aug 27 02:40:05.507956 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:40:05.507956 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:40:05.507956 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 3ab4a518113d4ed89cf4d2d629fb7a4c Aug 27 02:40:05.507956 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-494130755-project Aug 27 02:40:05.507956 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 02:40:05.508557 n-d-852278-4 devstack@n-api.service[134052]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 27 02:40:05.508557 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '2022-08-27 02:40:05'} Aug 27 02:40:05.508557 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:40:05.508557 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:05.508557 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:05.508557 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:05.508557 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:40:05.508557 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:40:05.508557 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:40:05.508557 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:40:05.508557 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Aug 27 02:40:05.508557 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Aug 27 02:40:05.508557 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 02:40:05.508557 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 02:40:05.508557 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 02:40:05.508557 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 02:40:05.508557 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 02:40:05.508557 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 02:40:05.508557 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 02:40:05.508557 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 02:40:05.511775 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 02:40:05.511775 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 02:40:05.511775 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 02:40:05.511775 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 02:40:05.511775 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 02:40:05.511775 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 02:40:05.511775 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 27 02:40:05.511775 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:05.511775 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:05.511775 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:05.511775 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:05.511775 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:05.511775 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:05.511775 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 02:40:05.511775 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 02:40:05.511775 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 27 02:40:05.511775 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:05.513568 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-928a6e9d-34bf-4a9b-a737-47a22ed0b1aa tempest-InstanceUsageAuditLogNegativeTestJSON-494130755 tempest-InstanceUsageAuditLogNegativeTestJSON-494130755-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:40:05.513568 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-928a6e9d-34bf-4a9b-a737-47a22ed0b1aa tempest-InstanceUsageAuditLogNegativeTestJSON-494130755 tempest-InstanceUsageAuditLogNegativeTestJSON-494130755-project] 10.222.0.70 "GET /compute/v2.1/os-instance_usage_audit_log/2022-08-27 02:40:05" status: 403 len: 128 microversion: 2.1 time: 0.027400 Aug 27 02:40:05.513568 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 29/63] 10.222.0.70 () {58 vars in 1251 bytes} [Sat Aug 27 02:40:05 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-08-27%2002%3A40%3A05 => generated 128 bytes in 33 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:40:05.664852 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-570ed2f0-95b6-4704-8972-423a41cb6706 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:05.669906 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-570ed2f0-95b6-4704-8972-423a41cb6706 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] [instance: 459d7a41-f50d-4ffe-a184-c0a12437669a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:05.709076 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-570ed2f0-95b6-4704-8972-423a41cb6706 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:05.710475 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-570ed2f0-95b6-4704-8972-423a41cb6706 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:05.711716 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-570ed2f0-95b6-4704-8972-423a41cb6706 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:05.718740 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-570ed2f0-95b6-4704-8972-423a41cb6706 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:05.722873 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-570ed2f0-95b6-4704-8972-423a41cb6706 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:05.726555 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-570ed2f0-95b6-4704-8972-423a41cb6706 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:05.795275 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ff006b31-b379-4605-af9b-457d6dda595c tempest-FlavorsV255TestJSON-1028000657 tempest-FlavorsV255TestJSON-1028000657-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:05.814705 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ff006b31-b379-4605-af9b-457d6dda595c tempest-FlavorsV255TestJSON-1028000657 tempest-FlavorsV255TestJSON-1028000657-project] 10.222.0.70 "GET /compute/v2.1/flavors/1407691075" status: 200 len: 449 microversion: 2.55 time: 0.484339 Aug 27 02:40:05.826409 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 35/64] 10.222.0.70 () {60 vars in 1199 bytes} [Sat Aug 27 02:40:05 2022] GET /compute/v2.1/flavors/1407691075 => generated 449 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:40:05.838427 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-e4eae37e-050b-4052-ba81-51bc069d9aa4 req-5440a3f5-ea05-46b8-b280-893c0ffbf446 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe", "tag": "11ce613c-e2a4-415d-936e-65faca310d53"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:05.895281 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-e4eae37e-050b-4052-ba81-51bc069d9aa4 req-5440a3f5-ea05-46b8-b280-893c0ffbf446 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:05.896483 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-e4eae37e-050b-4052-ba81-51bc069d9aa4 req-5440a3f5-ea05-46b8-b280-893c0ffbf446 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:05.897888 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-e4eae37e-050b-4052-ba81-51bc069d9aa4 req-5440a3f5-ea05-46b8-b280-893c0ffbf446 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:06.003167 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-e4eae37e-050b-4052-ba81-51bc069d9aa4 req-5440a3f5-ea05-46b8-b280-893c0ffbf446 service nova] Creating event network-changed:11ce613c-e2a4-415d-936e-65faca310d53 for instance b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe on n-h2-852278-4 Aug 27 02:40:06.004786 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-e4eae37e-050b-4052-ba81-51bc069d9aa4 req-5440a3f5-ea05-46b8-b280-893c0ffbf446 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=134051) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 27 02:40:06.006181 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-e4eae37e-050b-4052-ba81-51bc069d9aa4 req-5440a3f5-ea05-46b8-b280-893c0ffbf446 service nova] Acquired lock "compute-rpcapi-router" {{(pid=134051) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 27 02:40:06.008121 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-351e4d55-54fe-40e8-bed5-aa7f9844132c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:06.008949 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-351e4d55-54fe-40e8-bed5-aa7f9844132c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:06.011262 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-351e4d55-54fe-40e8-bed5-aa7f9844132c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:06.012899 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-351e4d55-54fe-40e8-bed5-aa7f9844132c None None] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:06.013638 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-351e4d55-54fe-40e8-bed5-aa7f9844132c None None] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:06.014595 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-351e4d55-54fe-40e8-bed5-aa7f9844132c None None] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:06.032270 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.compute.rpcapi [None req-351e4d55-54fe-40e8-bed5-aa7f9844132c None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 27 02:40:06.034336 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-351e4d55-54fe-40e8-bed5-aa7f9844132c None None] Releasing lock "compute-rpcapi-router" {{(pid=134051) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 27 02:40:06.056716 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-351e4d55-54fe-40e8-bed5-aa7f9844132c None None] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.228126 Aug 27 02:40:06.058557 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 36/65] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:40:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:40:06.082146 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-da60bc7d-ff32-42f3-a9fc-eda4a22ee5cb tempest-FlavorsV255TestJSON-1063127344 tempest-FlavorsV255TestJSON-1063127344-project-admin] Action: 'update', calling method: .version_select at 0x7f5ee4e120d0>, body: {"flavor": {"description": "new"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:06.185180 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-da60bc7d-ff32-42f3-a9fc-eda4a22ee5cb tempest-FlavorsV255TestJSON-1063127344 tempest-FlavorsV255TestJSON-1063127344-project-admin] 10.222.0.70 "PUT /compute/v2.1/flavors/1407691075" status: 200 len: 450 microversion: 2.55 time: 0.124804 Aug 27 02:40:06.189635 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 37/66] 10.222.0.70 () {62 vars in 1219 bytes} [Sat Aug 27 02:40:06 2022] PUT /compute/v2.1/flavors/1407691075 => generated 450 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:40:06.221506 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-91592620-0213-46ac-962b-55bb06db1066 tempest-FlavorsV255TestJSON-1028000657 tempest-FlavorsV255TestJSON-1028000657-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:06.298808 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-91592620-0213-46ac-962b-55bb06db1066 tempest-FlavorsV255TestJSON-1028000657 tempest-FlavorsV255TestJSON-1028000657-project] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 5725 microversion: 2.55 time: 0.098006 Aug 27 02:40:06.321613 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 38/67] 10.222.0.70 () {60 vars in 1187 bytes} [Sat Aug 27 02:40:06 2022] GET /compute/v2.1/flavors/detail => generated 5725 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:40:06.334330 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a3908244-0a75-4b94-9351-c9ea494c67d4 tempest-FlavorsV255TestJSON-1028000657 tempest-FlavorsV255TestJSON-1028000657-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:06.382676 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a3908244-0a75-4b94-9351-c9ea494c67d4 tempest-FlavorsV255TestJSON-1028000657 tempest-FlavorsV255TestJSON-1028000657-project] 10.222.0.70 "GET /compute/v2.1/flavors" status: 200 len: 3157 microversion: 2.55 time: 0.059296 Aug 27 02:40:06.396950 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 39/68] 10.222.0.70 () {60 vars in 1166 bytes} [Sat Aug 27 02:40:06 2022] GET /compute/v2.1/flavors => generated 3157 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:40:06.405177 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-5590fa21-9e2c-4329-8fc7-911d3242725e tempest-FlavorsV255TestJSON-1063127344 tempest-FlavorsV255TestJSON-1063127344-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:06.450983 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-5590fa21-9e2c-4329-8fc7-911d3242725e tempest-FlavorsV255TestJSON-1063127344 tempest-FlavorsV255TestJSON-1063127344-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/1407691075" status: 202 len: 0 microversion: 2.55 time: 0.050431 Aug 27 02:40:06.458158 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 40/69] 10.222.0.70 () {60 vars in 1202 bytes} [Sat Aug 27 02:40:06 2022] DELETE /compute/v2.1/flavors/1407691075 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:40:06.475117 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-31db00cc-5fec-4006-9292-fc9e4b3a8bdc tempest-FlavorsV255TestJSON-1063127344 tempest-FlavorsV255TestJSON-1063127344-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:06.515016 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-31db00cc-5fec-4006-9292-fc9e4b3a8bdc tempest-FlavorsV255TestJSON-1063127344 tempest-FlavorsV255TestJSON-1063127344-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 5285 microversion: 2.55 time: 0.053780 Aug 27 02:40:06.529852 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 41/70] 10.222.0.70 () {60 vars in 1187 bytes} [Sat Aug 27 02:40:06 2022] GET /compute/v2.1/flavors/detail => generated 5285 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:40:06.535342 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-79f94d82-39ac-497e-80c8-96c2872acca9 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:06.537256 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-79f94d82-39ac-497e-80c8-96c2872acca9 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] [instance: b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:06.550305 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-79f94d82-39ac-497e-80c8-96c2872acca9 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:06.550807 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-79f94d82-39ac-497e-80c8-96c2872acca9 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:06.551250 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-79f94d82-39ac-497e-80c8-96c2872acca9 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:06.557494 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-79f94d82-39ac-497e-80c8-96c2872acca9 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:06.558013 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-79f94d82-39ac-497e-80c8-96c2872acca9 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:06.558491 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-79f94d82-39ac-497e-80c8-96c2872acca9 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:07.222448 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-79f94d82-39ac-497e-80c8-96c2872acca9 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5f4e86197e4175b223f20cacce792d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b427157c9f406da72d9b29af734987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:07.242060 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-570ed2f0-95b6-4704-8972-423a41cb6706 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772e2e66c92e44f8838ce325437d5a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b2f4a529a3e4ea0937ca903dd5924bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:07.257368 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-570ed2f0-95b6-4704-8972-423a41cb6706 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] 10.222.0.70 "GET /compute/v2.1/servers/459d7a41-f50d-4ffe-a184-c0a12437669a" status: 200 len: 1319 microversion: 2.1 time: 1.606299 Aug 27 02:40:07.257588 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-79f94d82-39ac-497e-80c8-96c2872acca9 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] 10.222.0.70 "GET /compute/v2.1/servers/b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe" status: 200 len: 1338 microversion: 2.1 time: 0.731512 Aug 27 02:40:07.273491 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 42/71] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:06 2022] GET /compute/v2.1/servers/b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe => generated 1338 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:07.277624 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 30/72] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:05 2022] GET /compute/v2.1/servers/459d7a41-f50d-4ffe-a184-c0a12437669a => generated 1319 bytes in 1627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:40:08.280400 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-dbcbebbd-a8cb-4280-a118-2bd712d62436 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:08.281808 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-dbcbebbd-a8cb-4280-a118-2bd712d62436 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] [instance: b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:08.298869 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-55c9ed26-5941-4bdc-bef9-257582fb7ed6 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:08.300267 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-55c9ed26-5941-4bdc-bef9-257582fb7ed6 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] [instance: 459d7a41-f50d-4ffe-a184-c0a12437669a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:08.311465 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dbcbebbd-a8cb-4280-a118-2bd712d62436 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:08.316382 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-55c9ed26-5941-4bdc-bef9-257582fb7ed6 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:08.318887 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dbcbebbd-a8cb-4280-a118-2bd712d62436 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:08.323744 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dbcbebbd-a8cb-4280-a118-2bd712d62436 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:08.325240 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-55c9ed26-5941-4bdc-bef9-257582fb7ed6 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:08.326305 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dbcbebbd-a8cb-4280-a118-2bd712d62436 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:08.327990 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dbcbebbd-a8cb-4280-a118-2bd712d62436 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:08.329479 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-55c9ed26-5941-4bdc-bef9-257582fb7ed6 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:08.330540 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-55c9ed26-5941-4bdc-bef9-257582fb7ed6 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:08.331712 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dbcbebbd-a8cb-4280-a118-2bd712d62436 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:08.332436 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-55c9ed26-5941-4bdc-bef9-257582fb7ed6 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:08.335120 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-55c9ed26-5941-4bdc-bef9-257582fb7ed6 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:08.456778 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=8 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:40:08.901654 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-55c9ed26-5941-4bdc-bef9-257582fb7ed6 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772e2e66c92e44f8838ce325437d5a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b2f4a529a3e4ea0937ca903dd5924bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:08.921563 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-55c9ed26-5941-4bdc-bef9-257582fb7ed6 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] 10.222.0.70 "GET /compute/v2.1/servers/459d7a41-f50d-4ffe-a184-c0a12437669a" status: 200 len: 1319 microversion: 2.1 time: 0.626768 Aug 27 02:40:08.930405 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 31/73] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:08 2022] GET /compute/v2.1/servers/459d7a41-f50d-4ffe-a184-c0a12437669a => generated 1319 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:09.147464 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-dbcbebbd-a8cb-4280-a118-2bd712d62436 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5f4e86197e4175b223f20cacce792d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b427157c9f406da72d9b29af734987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:09.184072 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-dbcbebbd-a8cb-4280-a118-2bd712d62436 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] 10.222.0.70 "GET /compute/v2.1/servers/b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe" status: 200 len: 1338 microversion: 2.1 time: 0.889499 Aug 27 02:40:09.184072 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 43/74] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:08 2022] GET /compute/v2.1/servers/b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe => generated 1338 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:09.956936 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-5cda0dc9-4329-44d2-b2b4-b108f97fa262 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:09.957877 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-5cda0dc9-4329-44d2-b2b4-b108f97fa262 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] [instance: 459d7a41-f50d-4ffe-a184-c0a12437669a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:09.998566 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5cda0dc9-4329-44d2-b2b4-b108f97fa262 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:10.004186 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5cda0dc9-4329-44d2-b2b4-b108f97fa262 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:10.004335 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-43b6f4eb-22da-4bf2-a58b-1d6af0d0058c tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-190733677", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "networks": [{"uuid": "b0edff77-134a-4e34-8600-26bed9e15888"}]}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:10.013324 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5cda0dc9-4329-44d2-b2b4-b108f97fa262 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:10.020255 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5cda0dc9-4329-44d2-b2b4-b108f97fa262 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:10.029026 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5cda0dc9-4329-44d2-b2b4-b108f97fa262 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:10.034950 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5cda0dc9-4329-44d2-b2b4-b108f97fa262 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:10.376074 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-5cda0dc9-4329-44d2-b2b4-b108f97fa262 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772e2e66c92e44f8838ce325437d5a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b2f4a529a3e4ea0937ca903dd5924bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:10.407081 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-5cda0dc9-4329-44d2-b2b4-b108f97fa262 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] 10.222.0.70 "GET /compute/v2.1/servers/459d7a41-f50d-4ffe-a184-c0a12437669a" status: 200 len: 1319 microversion: 2.1 time: 0.452555 Aug 27 02:40:10.425859 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 44/75] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:09 2022] GET /compute/v2.1/servers/459d7a41-f50d-4ffe-a184-c0a12437669a => generated 1319 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:10.445768 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4587da26-edce-463e-ba3b-320edff6668a tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:10.457264 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-4587da26-edce-463e-ba3b-320edff6668a tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] [instance: b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:10.472122 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4587da26-edce-463e-ba3b-320edff6668a tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:10.480104 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4587da26-edce-463e-ba3b-320edff6668a tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:10.480642 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4587da26-edce-463e-ba3b-320edff6668a tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:10.481523 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4587da26-edce-463e-ba3b-320edff6668a tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:10.482040 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4587da26-edce-463e-ba3b-320edff6668a tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:10.482486 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4587da26-edce-463e-ba3b-320edff6668a tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:10.824232 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-4587da26-edce-463e-ba3b-320edff6668a tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5f4e86197e4175b223f20cacce792d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b427157c9f406da72d9b29af734987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:10.837082 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-4587da26-edce-463e-ba3b-320edff6668a tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] 10.222.0.70 "GET /compute/v2.1/servers/b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe" status: 200 len: 1338 microversion: 2.1 time: 0.419503 Aug 27 02:40:10.842575 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 45/76] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:10 2022] GET /compute/v2.1/servers/b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe => generated 1338 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:11.434286 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-60a9903f-2b03-4418-941e-ddf534f894b8 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:11.434874 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-60a9903f-2b03-4418-941e-ddf534f894b8 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] [instance: 459d7a41-f50d-4ffe-a184-c0a12437669a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:11.437147 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=7,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:DELETE=6,nova_api:UPDATE=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:40:11.451058 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-60a9903f-2b03-4418-941e-ddf534f894b8 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:11.451600 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-60a9903f-2b03-4418-941e-ddf534f894b8 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:11.452042 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-60a9903f-2b03-4418-941e-ddf534f894b8 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:11.465715 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-60a9903f-2b03-4418-941e-ddf534f894b8 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:11.466272 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-60a9903f-2b03-4418-941e-ddf534f894b8 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:11.481564 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-60a9903f-2b03-4418-941e-ddf534f894b8 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:12.103475 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-60a9903f-2b03-4418-941e-ddf534f894b8 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772e2e66c92e44f8838ce325437d5a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b2f4a529a3e4ea0937ca903dd5924bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:12.107036 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=100 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:40:12.122004 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-60a9903f-2b03-4418-941e-ddf534f894b8 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] 10.222.0.70 "GET /compute/v2.1/servers/459d7a41-f50d-4ffe-a184-c0a12437669a" status: 200 len: 1319 microversion: 2.1 time: 0.691991 Aug 27 02:40:12.130292 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 46/77] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:11 2022] GET /compute/v2.1/servers/459d7a41-f50d-4ffe-a184-c0a12437669a => generated 1319 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:12.146917 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-49ccf799-f46f-4207-b632-c8babdce28c4 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:12.154771 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-49ccf799-f46f-4207-b632-c8babdce28c4 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] [instance: b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:12.156268 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.network.neutron [None req-43b6f4eb-22da-4bf2-a58b-1d6af0d0058c tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] validate_networks() for [('b0edff77-134a-4e34-8600-26bed9e15888', None, None, None, None, None)] {{(pid=134052) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:40:12.166073 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-49ccf799-f46f-4207-b632-c8babdce28c4 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:12.168578 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-49ccf799-f46f-4207-b632-c8babdce28c4 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:12.169200 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-49ccf799-f46f-4207-b632-c8babdce28c4 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:12.178075 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-49ccf799-f46f-4207-b632-c8babdce28c4 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:12.178934 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-49ccf799-f46f-4207-b632-c8babdce28c4 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:12.179577 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-49ccf799-f46f-4207-b632-c8babdce28c4 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:13.409200 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-49ccf799-f46f-4207-b632-c8babdce28c4 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5f4e86197e4175b223f20cacce792d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b427157c9f406da72d9b29af734987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:13.429782 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-49ccf799-f46f-4207-b632-c8babdce28c4 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] 10.222.0.70 "GET /compute/v2.1/servers/b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe" status: 200 len: 1338 microversion: 2.1 time: 1.298097 Aug 27 02:40:13.432920 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 47/78] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:12 2022] GET /compute/v2.1/servers/b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe => generated 1338 bytes in 1302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:13.448558 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ac95e4f8-5c28-4ee8-81f1-095082172558 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:13.453954 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-ac95e4f8-5c28-4ee8-81f1-095082172558 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] [instance: 459d7a41-f50d-4ffe-a184-c0a12437669a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:13.474573 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ac95e4f8-5c28-4ee8-81f1-095082172558 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:13.475072 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ac95e4f8-5c28-4ee8-81f1-095082172558 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:13.475545 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ac95e4f8-5c28-4ee8-81f1-095082172558 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:13.476256 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ac95e4f8-5c28-4ee8-81f1-095082172558 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:13.476739 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ac95e4f8-5c28-4ee8-81f1-095082172558 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:13.477152 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ac95e4f8-5c28-4ee8-81f1-095082172558 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:13.924553 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-ac95e4f8-5c28-4ee8-81f1-095082172558 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772e2e66c92e44f8838ce325437d5a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b2f4a529a3e4ea0937ca903dd5924bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:13.941421 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ac95e4f8-5c28-4ee8-81f1-095082172558 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] 10.222.0.70 "GET /compute/v2.1/servers/459d7a41-f50d-4ffe-a184-c0a12437669a" status: 200 len: 1319 microversion: 2.1 time: 0.504836 Aug 27 02:40:13.958233 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 48/79] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:13 2022] GET /compute/v2.1/servers/459d7a41-f50d-4ffe-a184-c0a12437669a => generated 1319 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:14.455419 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b5078ec6-e012-4ce2-be6e-c3d29820184e tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:14.456040 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b5078ec6-e012-4ce2-be6e-c3d29820184e tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] [instance: b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:14.465255 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b5078ec6-e012-4ce2-be6e-c3d29820184e tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:14.465817 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b5078ec6-e012-4ce2-be6e-c3d29820184e tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:14.466177 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b5078ec6-e012-4ce2-be6e-c3d29820184e tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:14.468815 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b5078ec6-e012-4ce2-be6e-c3d29820184e tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:14.471325 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b5078ec6-e012-4ce2-be6e-c3d29820184e tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:14.473106 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b5078ec6-e012-4ce2-be6e-c3d29820184e tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:14.706523 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-43b6f4eb-22da-4bf2-a58b-1d6af0d0058c tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Flavor limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:40:14.707084 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-43b6f4eb-22da-4bf2-a58b-1d6af0d0058c tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Image limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:40:14.707809 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-43b6f4eb-22da-4bf2-a58b-1d6af0d0058c tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Flavor pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:40:14.708505 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-43b6f4eb-22da-4bf2-a58b-1d6af0d0058c tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Image pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:40:14.709005 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-43b6f4eb-22da-4bf2-a58b-1d6af0d0058c tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:40:14.730149 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-43b6f4eb-22da-4bf2-a58b-1d6af0d0058c tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:14.731479 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-43b6f4eb-22da-4bf2-a58b-1d6af0d0058c tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:14.734076 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-43b6f4eb-22da-4bf2-a58b-1d6af0d0058c tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:14.735437 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-43b6f4eb-22da-4bf2-a58b-1d6af0d0058c tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:14.736968 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-43b6f4eb-22da-4bf2-a58b-1d6af0d0058c tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:14.738676 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-43b6f4eb-22da-4bf2-a58b-1d6af0d0058c tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:14.771862 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-b5078ec6-e012-4ce2-be6e-c3d29820184e tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5f4e86197e4175b223f20cacce792d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b427157c9f406da72d9b29af734987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:14.780461 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b5078ec6-e012-4ce2-be6e-c3d29820184e tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] 10.222.0.70 "GET /compute/v2.1/servers/b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe" status: 200 len: 1338 microversion: 2.1 time: 0.329949 Aug 27 02:40:14.783126 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 49/80] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:14 2022] GET /compute/v2.1/servers/b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe => generated 1338 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:40:14.793715 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-43b6f4eb-22da-4bf2-a58b-1d6af0d0058c tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Getting quotas for project e78b498dced14d1d822e7d0c27f57215. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:40:14.800500 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-43b6f4eb-22da-4bf2-a58b-1d6af0d0058c tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Getting quotas for user 774ce37f4c6b4f72ad494ea40a3e238d and project e78b498dced14d1d822e7d0c27f57215. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:40:14.835699 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-43b6f4eb-22da-4bf2-a58b-1d6af0d0058c tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Going to run 1 instances... {{(pid=134052) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:40:14.839850 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-43b6f4eb-22da-4bf2-a58b-1d6af0d0058c tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: 12acf567-09ef-4971-b085-8b5566fd1b79] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134052) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:40:14.952847 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-43b6f4eb-22da-4bf2-a58b-1d6af0d0058c tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 5.305394 Aug 27 02:40:14.954144 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 32/81] 10.222.0.70 () {62 vars in 1188 bytes} [Sat Aug 27 02:40:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 5308 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 27 02:40:14.965892 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a5482e4b-1138-492a-814b-dc1476faf935 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:14.966512 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-a5482e4b-1138-492a-814b-dc1476faf935 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] [instance: 459d7a41-f50d-4ffe-a184-c0a12437669a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:14.976749 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a5482e4b-1138-492a-814b-dc1476faf935 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:14.977134 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a5482e4b-1138-492a-814b-dc1476faf935 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:14.981821 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a5482e4b-1138-492a-814b-dc1476faf935 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:14.988140 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a5482e4b-1138-492a-814b-dc1476faf935 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:14.988988 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a5482e4b-1138-492a-814b-dc1476faf935 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:14.989436 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a5482e4b-1138-492a-814b-dc1476faf935 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:15.007466 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ce7a80b4-f4ba-47c0-aaf6-31fa4d9366d7 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:15.008265 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-ce7a80b4-f4ba-47c0-aaf6-31fa4d9366d7 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: 12acf567-09ef-4971-b085-8b5566fd1b79] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:15.170307 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-ce7a80b4-f4ba-47c0-aaf6-31fa4d9366d7 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:15.182131 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-ce7a80b4-f4ba-47c0-aaf6-31fa4d9366d7 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:15.185850 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-ce7a80b4-f4ba-47c0-aaf6-31fa4d9366d7 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:15.190294 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ce7a80b4-f4ba-47c0-aaf6-31fa4d9366d7 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/12acf567-09ef-4971-b085-8b5566fd1b79" status: 200 len: 1261 microversion: 2.25 time: 0.217259 Aug 27 02:40:15.193292 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 33/82] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:40:14 2022] GET /compute/v2.1/servers/12acf567-09ef-4971-b085-8b5566fd1b79 => generated 1261 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:40:15.268507 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-a5482e4b-1138-492a-814b-dc1476faf935 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772e2e66c92e44f8838ce325437d5a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b2f4a529a3e4ea0937ca903dd5924bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:15.278379 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a5482e4b-1138-492a-814b-dc1476faf935 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] 10.222.0.70 "GET /compute/v2.1/servers/459d7a41-f50d-4ffe-a184-c0a12437669a" status: 200 len: 1319 microversion: 2.1 time: 0.316735 Aug 27 02:40:15.281045 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 50/83] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:14 2022] GET /compute/v2.1/servers/459d7a41-f50d-4ffe-a184-c0a12437669a => generated 1319 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:15.801665 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e74ace78-8fb0-46c7-8102-1091e67e8f06 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:15.802364 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-e74ace78-8fb0-46c7-8102-1091e67e8f06 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] [instance: b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:15.810257 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e74ace78-8fb0-46c7-8102-1091e67e8f06 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:15.810862 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e74ace78-8fb0-46c7-8102-1091e67e8f06 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:15.811387 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e74ace78-8fb0-46c7-8102-1091e67e8f06 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:15.812303 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e74ace78-8fb0-46c7-8102-1091e67e8f06 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:15.812860 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e74ace78-8fb0-46c7-8102-1091e67e8f06 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:15.813512 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e74ace78-8fb0-46c7-8102-1091e67e8f06 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:16.031552 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=12 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:40:16.052948 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e74ace78-8fb0-46c7-8102-1091e67e8f06 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5f4e86197e4175b223f20cacce792d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b427157c9f406da72d9b29af734987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:16.061567 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e74ace78-8fb0-46c7-8102-1091e67e8f06 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] 10.222.0.70 "GET /compute/v2.1/servers/b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe" status: 200 len: 1338 microversion: 2.1 time: 0.263852 Aug 27 02:40:16.064494 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 51/84] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:15 2022] GET /compute/v2.1/servers/b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe => generated 1338 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:40:16.118928 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-1110c12b-d872-43e7-bb37-3799a5eb2600 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1467816478", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:16.213708 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ca25098d-3263-4142-976d-9ff75efa11bb tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:16.214598 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-ca25098d-3263-4142-976d-9ff75efa11bb tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: 12acf567-09ef-4971-b085-8b5566fd1b79] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:16.224103 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ca25098d-3263-4142-976d-9ff75efa11bb tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:16.224631 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ca25098d-3263-4142-976d-9ff75efa11bb tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:16.225068 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ca25098d-3263-4142-976d-9ff75efa11bb tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:16.225784 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ca25098d-3263-4142-976d-9ff75efa11bb tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:16.226232 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ca25098d-3263-4142-976d-9ff75efa11bb tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:16.228868 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ca25098d-3263-4142-976d-9ff75efa11bb tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:16.230053 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.network.neutron [None req-1110c12b-d872-43e7-bb37-3799a5eb2600 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] validate_networks() for None {{(pid=134052) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:40:16.341115 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-ca25098d-3263-4142-976d-9ff75efa11bb tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:16.355177 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-ca25098d-3263-4142-976d-9ff75efa11bb tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:16.356758 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-ca25098d-3263-4142-976d-9ff75efa11bb tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:16.358520 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ca25098d-3263-4142-976d-9ff75efa11bb tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/12acf567-09ef-4971-b085-8b5566fd1b79" status: 200 len: 1313 microversion: 2.25 time: 0.148883 Aug 27 02:40:16.359728 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 52/85] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:40:16 2022] GET /compute/v2.1/servers/12acf567-09ef-4971-b085-8b5566fd1b79 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:40:16.365482 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e019a4b0-4fca-4fbb-a449-9ed0a7ba958b tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:16.366029 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-e019a4b0-4fca-4fbb-a449-9ed0a7ba958b tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] [instance: 459d7a41-f50d-4ffe-a184-c0a12437669a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:16.372370 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e019a4b0-4fca-4fbb-a449-9ed0a7ba958b tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:16.373037 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e019a4b0-4fca-4fbb-a449-9ed0a7ba958b tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:16.373642 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e019a4b0-4fca-4fbb-a449-9ed0a7ba958b tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:16.374494 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e019a4b0-4fca-4fbb-a449-9ed0a7ba958b tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:16.374978 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e019a4b0-4fca-4fbb-a449-9ed0a7ba958b tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:16.375399 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e019a4b0-4fca-4fbb-a449-9ed0a7ba958b tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:16.632579 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e019a4b0-4fca-4fbb-a449-9ed0a7ba958b tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772e2e66c92e44f8838ce325437d5a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b2f4a529a3e4ea0937ca903dd5924bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:16.642552 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e019a4b0-4fca-4fbb-a449-9ed0a7ba958b tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] 10.222.0.70 "GET /compute/v2.1/servers/459d7a41-f50d-4ffe-a184-c0a12437669a" status: 200 len: 1319 microversion: 2.1 time: 0.281334 Aug 27 02:40:16.644631 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 53/86] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:16 2022] GET /compute/v2.1/servers/459d7a41-f50d-4ffe-a184-c0a12437669a => generated 1319 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:16.689965 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-1110c12b-d872-43e7-bb37-3799a5eb2600 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Flavor limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:40:16.690389 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-1110c12b-d872-43e7-bb37-3799a5eb2600 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Image limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:40:16.690957 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-1110c12b-d872-43e7-bb37-3799a5eb2600 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Flavor pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:40:16.691382 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-1110c12b-d872-43e7-bb37-3799a5eb2600 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Image pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:40:16.691826 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-1110c12b-d872-43e7-bb37-3799a5eb2600 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:40:16.701868 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1110c12b-d872-43e7-bb37-3799a5eb2600 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:16.702621 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1110c12b-d872-43e7-bb37-3799a5eb2600 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:16.703518 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1110c12b-d872-43e7-bb37-3799a5eb2600 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:16.704606 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1110c12b-d872-43e7-bb37-3799a5eb2600 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:16.705254 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1110c12b-d872-43e7-bb37-3799a5eb2600 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:16.706420 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1110c12b-d872-43e7-bb37-3799a5eb2600 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:16.726326 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-1110c12b-d872-43e7-bb37-3799a5eb2600 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Getting quotas for project 82ae179f416c451e92e270d2cb0f4400. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:40:16.731779 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-1110c12b-d872-43e7-bb37-3799a5eb2600 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Getting quotas for user d68711ff38ec41c0b051124527c7ac35 and project 82ae179f416c451e92e270d2cb0f4400. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:40:16.744923 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-1110c12b-d872-43e7-bb37-3799a5eb2600 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Going to run 1 instances... {{(pid=134052) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:40:16.747282 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-1110c12b-d872-43e7-bb37-3799a5eb2600 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] [instance: e231e897-7343-415a-a4ff-dfe3df4fb62c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134052) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:40:16.816398 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-1110c12b-d872-43e7-bb37-3799a5eb2600 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.050190 Aug 27 02:40:16.817717 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 34/87] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 02:40:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1053 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:40:16.831654 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c12b75f4-7977-445c-a45c-3914abbc8a29 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:16.833511 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-c12b75f4-7977-445c-a45c-3914abbc8a29 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] [instance: e231e897-7343-415a-a4ff-dfe3df4fb62c] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:16.954749 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-c12b75f4-7977-445c-a45c-3914abbc8a29 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68711ff38ec41c0b051124527c7ac35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae179f416c451e92e270d2cb0f4400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:16.990324 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c12b75f4-7977-445c-a45c-3914abbc8a29 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] 10.222.0.70 "GET /compute/v2.1/servers/e231e897-7343-415a-a4ff-dfe3df4fb62c" status: 200 len: 1219 microversion: 2.1 time: 0.164307 Aug 27 02:40:16.992791 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-45e0f612-6955-446a-84f2-7777716d0217 tempest-FlavorsV261TestJSON-1515823504 tempest-FlavorsV261TestJSON-1515823504-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-1150222995", "id": 1084439513, "os-flavor-access:is_public": "True"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:17.008257 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 35/88] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:16 2022] GET /compute/v2.1/servers/e231e897-7343-415a-a4ff-dfe3df4fb62c => generated 1219 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:17.019370 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-45e0f612-6955-446a-84f2-7777716d0217 tempest-FlavorsV261TestJSON-1515823504 tempest-FlavorsV261TestJSON-1515823504-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 468 microversion: 2.61 time: 0.373295 Aug 27 02:40:17.020429 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 54/89] 10.222.0.70 () {62 vars in 1188 bytes} [Sat Aug 27 02:40:16 2022] POST /compute/v2.1/flavors => generated 468 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:40:17.084572 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-93638263-f68e-4edd-b9d7-e4f819d8702d tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:17.085273 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-93638263-f68e-4edd-b9d7-e4f819d8702d tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] [instance: b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:17.094906 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-93638263-f68e-4edd-b9d7-e4f819d8702d tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:17.095392 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-93638263-f68e-4edd-b9d7-e4f819d8702d tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:17.096531 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-93638263-f68e-4edd-b9d7-e4f819d8702d tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:17.097239 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-93638263-f68e-4edd-b9d7-e4f819d8702d tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:17.100564 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-93638263-f68e-4edd-b9d7-e4f819d8702d tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:17.102132 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-93638263-f68e-4edd-b9d7-e4f819d8702d tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:17.187064 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e44a9318-4cad-48e8-85a7-4ec693f5dd93 tempest-FlavorsV261TestJSON-327083872 tempest-FlavorsV261TestJSON-327083872-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:17.217253 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e44a9318-4cad-48e8-85a7-4ec693f5dd93 tempest-FlavorsV261TestJSON-327083872 tempest-FlavorsV261TestJSON-327083872-project] 10.222.0.70 "GET /compute/v2.1/flavors/1084439513" status: 200 len: 468 microversion: 2.61 time: 0.187277 Aug 27 02:40:17.228196 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 36/90] 10.222.0.70 () {60 vars in 1199 bytes} [Sat Aug 27 02:40:17 2022] GET /compute/v2.1/flavors/1084439513 => generated 468 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:40:17.240212 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f1dd3e9f-8427-436b-bd82-18bd60450aa0 tempest-FlavorsV261TestJSON-1515823504 tempest-FlavorsV261TestJSON-1515823504-project-admin] Action: 'update', calling method: .version_select at 0x7f5ee4e140d0>, body: {"flavor": {"description": "new"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:17.345510 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f1dd3e9f-8427-436b-bd82-18bd60450aa0 tempest-FlavorsV261TestJSON-1515823504 tempest-FlavorsV261TestJSON-1515823504-project-admin] 10.222.0.70 "PUT /compute/v2.1/flavors/1084439513" status: 200 len: 469 microversion: 2.61 time: 0.114371 Aug 27 02:40:17.346585 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 37/91] 10.222.0.70 () {62 vars in 1219 bytes} [Sat Aug 27 02:40:17 2022] PUT /compute/v2.1/flavors/1084439513 => generated 469 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:40:17.360945 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4739db1e-da00-4f58-96a2-15cb5e19bc3c tempest-FlavorsV261TestJSON-327083872 tempest-FlavorsV261TestJSON-327083872-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:17.400615 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-93638263-f68e-4edd-b9d7-e4f819d8702d tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5f4e86197e4175b223f20cacce792d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b427157c9f406da72d9b29af734987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:17.415360 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-4739db1e-da00-4f58-96a2-15cb5e19bc3c tempest-FlavorsV261TestJSON-327083872 tempest-FlavorsV261TestJSON-327083872-project] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 6250 microversion: 2.61 time: 0.059354 Aug 27 02:40:17.416475 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-93638263-f68e-4edd-b9d7-e4f819d8702d tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] 10.222.0.70 "GET /compute/v2.1/servers/b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe" status: 200 len: 1338 microversion: 2.1 time: 0.334668 Aug 27 02:40:17.420331 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 38/92] 10.222.0.70 () {60 vars in 1187 bytes} [Sat Aug 27 02:40:17 2022] GET /compute/v2.1/flavors/detail => generated 6250 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:40:17.426602 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 55/93] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:17 2022] GET /compute/v2.1/servers/b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe => generated 1338 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:17.437762 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ef3c6f42-a513-4710-87b2-168b4defe227 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:17.438719 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-ef3c6f42-a513-4710-87b2-168b4defe227 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: 12acf567-09ef-4971-b085-8b5566fd1b79] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:17.454773 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ef3c6f42-a513-4710-87b2-168b4defe227 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:17.455290 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ef3c6f42-a513-4710-87b2-168b4defe227 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:17.462051 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-2e913cc8-487a-496f-af4a-abcc8b1c9c40 tempest-FlavorsV261TestJSON-327083872 tempest-FlavorsV261TestJSON-327083872-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:17.480018 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ef3c6f42-a513-4710-87b2-168b4defe227 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:17.481189 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ef3c6f42-a513-4710-87b2-168b4defe227 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:17.481819 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ef3c6f42-a513-4710-87b2-168b4defe227 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:17.482147 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ef3c6f42-a513-4710-87b2-168b4defe227 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:17.523184 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-2e913cc8-487a-496f-af4a-abcc8b1c9c40 tempest-FlavorsV261TestJSON-327083872 tempest-FlavorsV261TestJSON-327083872-project] 10.222.0.70 "GET /compute/v2.1/flavors" status: 200 len: 3157 microversion: 2.61 time: 0.065296 Aug 27 02:40:17.533272 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 56/94] 10.222.0.70 () {60 vars in 1166 bytes} [Sat Aug 27 02:40:17 2022] GET /compute/v2.1/flavors => generated 3157 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:40:17.552610 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-ef3c6f42-a513-4710-87b2-168b4defe227 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:17.553366 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-6cc0ee27-13c3-4e5b-a8e4-86246ea0e7a2 tempest-FlavorsV261TestJSON-1515823504 tempest-FlavorsV261TestJSON-1515823504-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:17.579074 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-ef3c6f42-a513-4710-87b2-168b4defe227 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:17.586521 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-6cc0ee27-13c3-4e5b-a8e4-86246ea0e7a2 tempest-FlavorsV261TestJSON-1515823504 tempest-FlavorsV261TestJSON-1515823504-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/1084439513" status: 202 len: 0 microversion: 2.61 time: 0.039686 Aug 27 02:40:17.587505 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-ef3c6f42-a513-4710-87b2-168b4defe227 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:17.587655 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 57/95] 10.222.0.70 () {60 vars in 1202 bytes} [Sat Aug 27 02:40:17 2022] DELETE /compute/v2.1/flavors/1084439513 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 27 02:40:17.590957 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ef3c6f42-a513-4710-87b2-168b4defe227 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/12acf567-09ef-4971-b085-8b5566fd1b79" status: 200 len: 1319 microversion: 2.25 time: 0.169272 Aug 27 02:40:17.602561 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f70368fd-06e6-4c2f-ba65-37d920a96771 tempest-FlavorsV261TestJSON-1515823504 tempest-FlavorsV261TestJSON-1515823504-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:17.605348 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 39/96] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:40:17 2022] GET /compute/v2.1/servers/12acf567-09ef-4971-b085-8b5566fd1b79 => generated 1319 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:40:17.653113 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-f70368fd-06e6-4c2f-ba65-37d920a96771 tempest-FlavorsV261TestJSON-1515823504 tempest-FlavorsV261TestJSON-1515823504-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 5791 microversion: 2.61 time: 0.056393 Aug 27 02:40:17.654249 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 58/97] 10.222.0.70 () {60 vars in 1187 bytes} [Sat Aug 27 02:40:17 2022] GET /compute/v2.1/flavors/detail => generated 5791 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:40:17.671949 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-465a1a99-c6d3-4515-9ea1-a2e62235638e tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:17.673014 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-465a1a99-c6d3-4515-9ea1-a2e62235638e tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] [instance: 459d7a41-f50d-4ffe-a184-c0a12437669a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:17.698068 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-465a1a99-c6d3-4515-9ea1-a2e62235638e tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:17.701263 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-465a1a99-c6d3-4515-9ea1-a2e62235638e tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:17.702000 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-465a1a99-c6d3-4515-9ea1-a2e62235638e tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:17.708912 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-465a1a99-c6d3-4515-9ea1-a2e62235638e tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:17.713571 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-465a1a99-c6d3-4515-9ea1-a2e62235638e tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:17.714403 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-465a1a99-c6d3-4515-9ea1-a2e62235638e tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:18.011224 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-6fe08c1e-e924-4613-a8e0-d5a820d59df7 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:18.011837 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-6fe08c1e-e924-4613-a8e0-d5a820d59df7 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] [instance: e231e897-7343-415a-a4ff-dfe3df4fb62c] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:18.034086 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6fe08c1e-e924-4613-a8e0-d5a820d59df7 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:18.034580 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6fe08c1e-e924-4613-a8e0-d5a820d59df7 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:18.035023 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6fe08c1e-e924-4613-a8e0-d5a820d59df7 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:18.044973 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6fe08c1e-e924-4613-a8e0-d5a820d59df7 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:18.048066 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6fe08c1e-e924-4613-a8e0-d5a820d59df7 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:18.052487 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6fe08c1e-e924-4613-a8e0-d5a820d59df7 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:18.249335 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-6fe08c1e-e924-4613-a8e0-d5a820d59df7 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68711ff38ec41c0b051124527c7ac35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae179f416c451e92e270d2cb0f4400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:18.259543 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-6fe08c1e-e924-4613-a8e0-d5a820d59df7 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] 10.222.0.70 "GET /compute/v2.1/servers/e231e897-7343-415a-a4ff-dfe3df4fb62c" status: 200 len: 1293 microversion: 2.1 time: 0.251987 Aug 27 02:40:18.274651 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 59/98] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:18 2022] GET /compute/v2.1/servers/e231e897-7343-415a-a4ff-dfe3df4fb62c => generated 1293 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:18.353636 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-465a1a99-c6d3-4515-9ea1-a2e62235638e tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772e2e66c92e44f8838ce325437d5a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b2f4a529a3e4ea0937ca903dd5924bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:18.370469 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-465a1a99-c6d3-4515-9ea1-a2e62235638e tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] 10.222.0.70 "GET /compute/v2.1/servers/459d7a41-f50d-4ffe-a184-c0a12437669a" status: 200 len: 1319 microversion: 2.1 time: 0.710021 Aug 27 02:40:18.373450 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 40/99] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:17 2022] GET /compute/v2.1/servers/459d7a41-f50d-4ffe-a184-c0a12437669a => generated 1319 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:18.459141 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-82507bc8-d15c-451e-b74d-ea1f82fd2ec9 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:18.459963 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-82507bc8-d15c-451e-b74d-ea1f82fd2ec9 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] [instance: b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:18.477141 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-82507bc8-d15c-451e-b74d-ea1f82fd2ec9 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:18.477981 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-82507bc8-d15c-451e-b74d-ea1f82fd2ec9 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:18.478658 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-82507bc8-d15c-451e-b74d-ea1f82fd2ec9 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:18.479634 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-82507bc8-d15c-451e-b74d-ea1f82fd2ec9 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:18.489434 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-82507bc8-d15c-451e-b74d-ea1f82fd2ec9 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:18.490124 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-82507bc8-d15c-451e-b74d-ea1f82fd2ec9 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:18.616339 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-aec0e522-fe4b-4a45-86cf-0903e515a000 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:18.626009 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-aec0e522-fe4b-4a45-86cf-0903e515a000 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: 12acf567-09ef-4971-b085-8b5566fd1b79] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:18.642479 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-aec0e522-fe4b-4a45-86cf-0903e515a000 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:18.644107 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-aec0e522-fe4b-4a45-86cf-0903e515a000 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:18.644813 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-aec0e522-fe4b-4a45-86cf-0903e515a000 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:18.645916 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-aec0e522-fe4b-4a45-86cf-0903e515a000 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:18.646607 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-aec0e522-fe4b-4a45-86cf-0903e515a000 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:18.647783 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-aec0e522-fe4b-4a45-86cf-0903e515a000 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:18.782831 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-aec0e522-fe4b-4a45-86cf-0903e515a000 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:18.792149 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-82507bc8-d15c-451e-b74d-ea1f82fd2ec9 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5f4e86197e4175b223f20cacce792d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b427157c9f406da72d9b29af734987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:18.796131 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-aec0e522-fe4b-4a45-86cf-0903e515a000 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:18.797679 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-aec0e522-fe4b-4a45-86cf-0903e515a000 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:18.799007 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-aec0e522-fe4b-4a45-86cf-0903e515a000 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/12acf567-09ef-4971-b085-8b5566fd1b79" status: 200 len: 1319 microversion: 2.25 time: 0.186742 Aug 27 02:40:18.808851 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-82507bc8-d15c-451e-b74d-ea1f82fd2ec9 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] 10.222.0.70 "GET /compute/v2.1/servers/b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe" status: 200 len: 1338 microversion: 2.1 time: 0.353443 Aug 27 02:40:18.816681 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 41/100] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:40:18 2022] GET /compute/v2.1/servers/12acf567-09ef-4971-b085-8b5566fd1b79 => generated 1319 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:40:18.823689 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 60/101] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:18 2022] GET /compute/v2.1/servers/b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe => generated 1338 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:19.283632 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3f6917dc-6808-4276-aea0-da9a34832e8b tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:19.284585 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-3f6917dc-6808-4276-aea0-da9a34832e8b tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] [instance: e231e897-7343-415a-a4ff-dfe3df4fb62c] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:19.291530 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3f6917dc-6808-4276-aea0-da9a34832e8b tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:19.292177 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3f6917dc-6808-4276-aea0-da9a34832e8b tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:19.292772 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3f6917dc-6808-4276-aea0-da9a34832e8b tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:19.293474 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3f6917dc-6808-4276-aea0-da9a34832e8b tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:19.293920 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3f6917dc-6808-4276-aea0-da9a34832e8b tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:19.294331 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3f6917dc-6808-4276-aea0-da9a34832e8b tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:19.369493 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-3f6917dc-6808-4276-aea0-da9a34832e8b tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68711ff38ec41c0b051124527c7ac35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae179f416c451e92e270d2cb0f4400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:19.380188 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-3f6917dc-6808-4276-aea0-da9a34832e8b tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] 10.222.0.70 "GET /compute/v2.1/servers/e231e897-7343-415a-a4ff-dfe3df4fb62c" status: 200 len: 1299 microversion: 2.1 time: 0.100371 Aug 27 02:40:19.382108 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 42/102] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:19 2022] GET /compute/v2.1/servers/e231e897-7343-415a-a4ff-dfe3df4fb62c => generated 1299 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:19.397522 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-59860f6b-409c-43dc-b6aa-b8875bd98f4b tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:19.398774 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-59860f6b-409c-43dc-b6aa-b8875bd98f4b tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] [instance: 459d7a41-f50d-4ffe-a184-c0a12437669a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:19.406318 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-59860f6b-409c-43dc-b6aa-b8875bd98f4b tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:19.407067 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-59860f6b-409c-43dc-b6aa-b8875bd98f4b tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:19.407662 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-59860f6b-409c-43dc-b6aa-b8875bd98f4b tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:19.408757 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-59860f6b-409c-43dc-b6aa-b8875bd98f4b tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:19.409348 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-59860f6b-409c-43dc-b6aa-b8875bd98f4b tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:19.409908 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-59860f6b-409c-43dc-b6aa-b8875bd98f4b tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:19.642230 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-59860f6b-409c-43dc-b6aa-b8875bd98f4b tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772e2e66c92e44f8838ce325437d5a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b2f4a529a3e4ea0937ca903dd5924bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:19.651157 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-59860f6b-409c-43dc-b6aa-b8875bd98f4b tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] 10.222.0.70 "GET /compute/v2.1/servers/459d7a41-f50d-4ffe-a184-c0a12437669a" status: 200 len: 1319 microversion: 2.1 time: 0.257366 Aug 27 02:40:19.665327 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 61/103] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:19 2022] GET /compute/v2.1/servers/459d7a41-f50d-4ffe-a184-c0a12437669a => generated 1319 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:19.832714 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3801aae3-046f-41c8-9271-bd5046c9ee90 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:19.833970 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a5face3b-909d-4ce0-a4c3-c925fb30c0f0 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:19.834335 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-3801aae3-046f-41c8-9271-bd5046c9ee90 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] [instance: b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:19.834587 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a5face3b-909d-4ce0-a4c3-c925fb30c0f0 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: 12acf567-09ef-4971-b085-8b5566fd1b79] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:19.842443 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3801aae3-046f-41c8-9271-bd5046c9ee90 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:19.843082 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3801aae3-046f-41c8-9271-bd5046c9ee90 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:19.843621 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3801aae3-046f-41c8-9271-bd5046c9ee90 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:19.844820 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3801aae3-046f-41c8-9271-bd5046c9ee90 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:19.845396 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3801aae3-046f-41c8-9271-bd5046c9ee90 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:19.845908 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3801aae3-046f-41c8-9271-bd5046c9ee90 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:19.847275 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a5face3b-909d-4ce0-a4c3-c925fb30c0f0 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:19.848220 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a5face3b-909d-4ce0-a4c3-c925fb30c0f0 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:19.849095 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a5face3b-909d-4ce0-a4c3-c925fb30c0f0 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:19.850408 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a5face3b-909d-4ce0-a4c3-c925fb30c0f0 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:19.851330 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a5face3b-909d-4ce0-a4c3-c925fb30c0f0 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:19.852177 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a5face3b-909d-4ce0-a4c3-c925fb30c0f0 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:20.132653 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-a5face3b-909d-4ce0-a4c3-c925fb30c0f0 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:20.158710 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-a5face3b-909d-4ce0-a4c3-c925fb30c0f0 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:20.160791 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-a5face3b-909d-4ce0-a4c3-c925fb30c0f0 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:20.164943 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a5face3b-909d-4ce0-a4c3-c925fb30c0f0 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/12acf567-09ef-4971-b085-8b5566fd1b79" status: 200 len: 1361 microversion: 2.25 time: 0.339850 Aug 27 02:40:20.175837 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-3801aae3-046f-41c8-9271-bd5046c9ee90 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5f4e86197e4175b223f20cacce792d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b427157c9f406da72d9b29af734987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:20.180762 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 43/104] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:40:19 2022] GET /compute/v2.1/servers/12acf567-09ef-4971-b085-8b5566fd1b79 => generated 1361 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:40:20.186124 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-3801aae3-046f-41c8-9271-bd5046c9ee90 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] 10.222.0.70 "GET /compute/v2.1/servers/b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe" status: 200 len: 1338 microversion: 2.1 time: 0.358415 Aug 27 02:40:20.200337 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 62/105] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:19 2022] GET /compute/v2.1/servers/b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe => generated 1338 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:20.408896 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-de91f955-7bd2-4f29-976f-3d44f6bfc386 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:20.410354 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-de91f955-7bd2-4f29-976f-3d44f6bfc386 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] [instance: e231e897-7343-415a-a4ff-dfe3df4fb62c] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:20.417514 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-de91f955-7bd2-4f29-976f-3d44f6bfc386 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:20.418009 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-de91f955-7bd2-4f29-976f-3d44f6bfc386 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:20.418437 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-de91f955-7bd2-4f29-976f-3d44f6bfc386 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:20.421176 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-de91f955-7bd2-4f29-976f-3d44f6bfc386 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:20.422991 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-de91f955-7bd2-4f29-976f-3d44f6bfc386 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:20.423449 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-de91f955-7bd2-4f29-976f-3d44f6bfc386 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:20.527412 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-de91f955-7bd2-4f29-976f-3d44f6bfc386 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68711ff38ec41c0b051124527c7ac35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae179f416c451e92e270d2cb0f4400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:20.537422 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-de91f955-7bd2-4f29-976f-3d44f6bfc386 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] 10.222.0.70 "GET /compute/v2.1/servers/e231e897-7343-415a-a4ff-dfe3df4fb62c" status: 200 len: 1299 microversion: 2.1 time: 0.137930 Aug 27 02:40:20.538027 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 44/106] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:20 2022] GET /compute/v2.1/servers/e231e897-7343-415a-a4ff-dfe3df4fb62c => generated 1299 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:20.673432 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c554f716-adbb-4e38-9b67-ee0bf308a9b3 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:20.674666 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-c554f716-adbb-4e38-9b67-ee0bf308a9b3 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] [instance: 459d7a41-f50d-4ffe-a184-c0a12437669a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:20.683162 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c554f716-adbb-4e38-9b67-ee0bf308a9b3 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:20.683956 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c554f716-adbb-4e38-9b67-ee0bf308a9b3 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:20.684712 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c554f716-adbb-4e38-9b67-ee0bf308a9b3 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:20.686457 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c554f716-adbb-4e38-9b67-ee0bf308a9b3 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:20.687472 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c554f716-adbb-4e38-9b67-ee0bf308a9b3 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:20.688769 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c554f716-adbb-4e38-9b67-ee0bf308a9b3 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:20.908577 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-c554f716-adbb-4e38-9b67-ee0bf308a9b3 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772e2e66c92e44f8838ce325437d5a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b2f4a529a3e4ea0937ca903dd5924bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:20.917779 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c554f716-adbb-4e38-9b67-ee0bf308a9b3 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] 10.222.0.70 "GET /compute/v2.1/servers/459d7a41-f50d-4ffe-a184-c0a12437669a" status: 200 len: 1319 microversion: 2.1 time: 0.247209 Aug 27 02:40:20.928592 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 63/107] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:20 2022] GET /compute/v2.1/servers/459d7a41-f50d-4ffe-a184-c0a12437669a => generated 1319 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:21.190949 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-928a92f0-69a9-4db9-a634-4b7dc591dcd4 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:21.191971 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-928a92f0-69a9-4db9-a634-4b7dc591dcd4 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: 12acf567-09ef-4971-b085-8b5566fd1b79] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:21.199589 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-928a92f0-69a9-4db9-a634-4b7dc591dcd4 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:21.200539 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-928a92f0-69a9-4db9-a634-4b7dc591dcd4 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:21.201185 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-928a92f0-69a9-4db9-a634-4b7dc591dcd4 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:21.202329 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-928a92f0-69a9-4db9-a634-4b7dc591dcd4 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:21.207558 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-928a92f0-69a9-4db9-a634-4b7dc591dcd4 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:21.208866 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-928a92f0-69a9-4db9-a634-4b7dc591dcd4 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:21.210057 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e1c32ccf-36c8-4c50-ae5a-b3902deda28d tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:21.210678 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-e1c32ccf-36c8-4c50-ae5a-b3902deda28d tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] [instance: b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:21.217162 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e1c32ccf-36c8-4c50-ae5a-b3902deda28d tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:21.217651 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e1c32ccf-36c8-4c50-ae5a-b3902deda28d tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:21.218254 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e1c32ccf-36c8-4c50-ae5a-b3902deda28d tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:21.219119 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e1c32ccf-36c8-4c50-ae5a-b3902deda28d tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:21.219779 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e1c32ccf-36c8-4c50-ae5a-b3902deda28d tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:21.220376 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e1c32ccf-36c8-4c50-ae5a-b3902deda28d tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:21.449312 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-928a92f0-69a9-4db9-a634-4b7dc591dcd4 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:21.461426 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-928a92f0-69a9-4db9-a634-4b7dc591dcd4 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:21.463167 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-928a92f0-69a9-4db9-a634-4b7dc591dcd4 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:21.464691 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-928a92f0-69a9-4db9-a634-4b7dc591dcd4 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/12acf567-09ef-4971-b085-8b5566fd1b79" status: 200 len: 1361 microversion: 2.25 time: 0.278516 Aug 27 02:40:21.481205 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 45/108] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:40:21 2022] GET /compute/v2.1/servers/12acf567-09ef-4971-b085-8b5566fd1b79 => generated 1361 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:40:21.528640 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e1c32ccf-36c8-4c50-ae5a-b3902deda28d tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5f4e86197e4175b223f20cacce792d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b427157c9f406da72d9b29af734987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:21.537958 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e1c32ccf-36c8-4c50-ae5a-b3902deda28d tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] 10.222.0.70 "GET /compute/v2.1/servers/b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe" status: 200 len: 1338 microversion: 2.1 time: 0.332049 Aug 27 02:40:21.540525 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 64/109] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:21 2022] GET /compute/v2.1/servers/b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe => generated 1338 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:21.558404 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-36b599d9-878b-45d1-b49c-503f92fbacbe tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:21.559013 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-36b599d9-878b-45d1-b49c-503f92fbacbe tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] [instance: e231e897-7343-415a-a4ff-dfe3df4fb62c] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:21.570539 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-36b599d9-878b-45d1-b49c-503f92fbacbe tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:21.571040 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-36b599d9-878b-45d1-b49c-503f92fbacbe tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:21.571481 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-36b599d9-878b-45d1-b49c-503f92fbacbe tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:21.572191 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-36b599d9-878b-45d1-b49c-503f92fbacbe tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:21.572805 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-36b599d9-878b-45d1-b49c-503f92fbacbe tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:21.573389 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-36b599d9-878b-45d1-b49c-503f92fbacbe tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:21.577660 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-6c9a16f6-f06d-45f5-8ac4-24e9b00c7a1f req-8edb7d6d-771a-4220-b192-269b5b65d82c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12acf567-09ef-4971-b085-8b5566fd1b79", "tag": "44ed9f75-528d-4d72-891d-705dbadec7a2"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:21.590230 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-6c9a16f6-f06d-45f5-8ac4-24e9b00c7a1f req-8edb7d6d-771a-4220-b192-269b5b65d82c service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:21.590851 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-6c9a16f6-f06d-45f5-8ac4-24e9b00c7a1f req-8edb7d6d-771a-4220-b192-269b5b65d82c service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:21.591282 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-6c9a16f6-f06d-45f5-8ac4-24e9b00c7a1f req-8edb7d6d-771a-4220-b192-269b5b65d82c service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:21.621825 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-6c9a16f6-f06d-45f5-8ac4-24e9b00c7a1f req-8edb7d6d-771a-4220-b192-269b5b65d82c service nova] Creating event network-changed:44ed9f75-528d-4d72-891d-705dbadec7a2 for instance 12acf567-09ef-4971-b085-8b5566fd1b79 on n-h1-852278-4 Aug 27 02:40:21.627574 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-6c9a16f6-f06d-45f5-8ac4-24e9b00c7a1f req-8edb7d6d-771a-4220-b192-269b5b65d82c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053930 Aug 27 02:40:21.628668 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 65/110] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:40:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:40:21.846441 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-36b599d9-878b-45d1-b49c-503f92fbacbe tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68711ff38ec41c0b051124527c7ac35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae179f416c451e92e270d2cb0f4400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:21.859789 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-36b599d9-878b-45d1-b49c-503f92fbacbe tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] 10.222.0.70 "GET /compute/v2.1/servers/e231e897-7343-415a-a4ff-dfe3df4fb62c" status: 200 len: 1341 microversion: 2.1 time: 0.305189 Aug 27 02:40:21.862699 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 46/111] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:21 2022] GET /compute/v2.1/servers/e231e897-7343-415a-a4ff-dfe3df4fb62c => generated 1341 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:21.942247 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-55b98c96-444c-424f-884c-76ed3b572c07 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:21.943575 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-55b98c96-444c-424f-884c-76ed3b572c07 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] [instance: 459d7a41-f50d-4ffe-a184-c0a12437669a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:21.958719 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-55b98c96-444c-424f-884c-76ed3b572c07 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:21.959530 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-55b98c96-444c-424f-884c-76ed3b572c07 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:21.960354 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-55b98c96-444c-424f-884c-76ed3b572c07 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:21.962368 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-55b98c96-444c-424f-884c-76ed3b572c07 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:21.963092 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-55b98c96-444c-424f-884c-76ed3b572c07 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:21.963805 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-55b98c96-444c-424f-884c-76ed3b572c07 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:22.175933 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-55b98c96-444c-424f-884c-76ed3b572c07 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772e2e66c92e44f8838ce325437d5a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b2f4a529a3e4ea0937ca903dd5924bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:22.187328 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-55b98c96-444c-424f-884c-76ed3b572c07 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] 10.222.0.70 "GET /compute/v2.1/servers/459d7a41-f50d-4ffe-a184-c0a12437669a" status: 200 len: 1319 microversion: 2.1 time: 0.250855 Aug 27 02:40:22.197934 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 66/112] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:21 2022] GET /compute/v2.1/servers/459d7a41-f50d-4ffe-a184-c0a12437669a => generated 1319 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:22.338234 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-18b09b9f-700e-418f-ae08-539bc7ea18a4 req-fb6b5ce9-1d7c-4875-820f-5e26e9cc965c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe", "name": "network-vif-plugged", "status": "completed", "tag": "11ce613c-e2a4-415d-936e-65faca310d53"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:22.359566 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-18b09b9f-700e-418f-ae08-539bc7ea18a4 req-fb6b5ce9-1d7c-4875-820f-5e26e9cc965c service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:22.364495 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-18b09b9f-700e-418f-ae08-539bc7ea18a4 req-fb6b5ce9-1d7c-4875-820f-5e26e9cc965c service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:22.365017 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-18b09b9f-700e-418f-ae08-539bc7ea18a4 req-fb6b5ce9-1d7c-4875-820f-5e26e9cc965c service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:22.379539 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-18b09b9f-700e-418f-ae08-539bc7ea18a4 req-fb6b5ce9-1d7c-4875-820f-5e26e9cc965c service nova] Creating event network-vif-plugged:11ce613c-e2a4-415d-936e-65faca310d53 for instance b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe on n-h2-852278-4 Aug 27 02:40:22.387080 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-18b09b9f-700e-418f-ae08-539bc7ea18a4 req-fb6b5ce9-1d7c-4875-820f-5e26e9cc965c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.156102 Aug 27 02:40:22.389395 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 47/113] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:40:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:40:22.489821 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ca17d93a-ed80-4f4a-b6e1-93fd47dbfa45 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:22.491128 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-ca17d93a-ed80-4f4a-b6e1-93fd47dbfa45 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: 12acf567-09ef-4971-b085-8b5566fd1b79] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:22.499071 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ca17d93a-ed80-4f4a-b6e1-93fd47dbfa45 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:22.500042 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ca17d93a-ed80-4f4a-b6e1-93fd47dbfa45 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:22.501100 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ca17d93a-ed80-4f4a-b6e1-93fd47dbfa45 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:22.502308 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ca17d93a-ed80-4f4a-b6e1-93fd47dbfa45 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:22.502947 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ca17d93a-ed80-4f4a-b6e1-93fd47dbfa45 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:22.503562 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ca17d93a-ed80-4f4a-b6e1-93fd47dbfa45 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:22.560430 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3f231ee3-b9f8-4c78-91cf-93205ccf42e7 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:22.561249 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-3f231ee3-b9f8-4c78-91cf-93205ccf42e7 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] [instance: b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:22.569501 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3f231ee3-b9f8-4c78-91cf-93205ccf42e7 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:22.569987 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3f231ee3-b9f8-4c78-91cf-93205ccf42e7 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:22.570417 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3f231ee3-b9f8-4c78-91cf-93205ccf42e7 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:22.571264 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3f231ee3-b9f8-4c78-91cf-93205ccf42e7 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:22.571710 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3f231ee3-b9f8-4c78-91cf-93205ccf42e7 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:22.572120 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3f231ee3-b9f8-4c78-91cf-93205ccf42e7 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:22.864813 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-ca17d93a-ed80-4f4a-b6e1-93fd47dbfa45 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:22.876682 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-ca17d93a-ed80-4f4a-b6e1-93fd47dbfa45 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:22.880873 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-ca17d93a-ed80-4f4a-b6e1-93fd47dbfa45 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:22.884904 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ca17d93a-ed80-4f4a-b6e1-93fd47dbfa45 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/12acf567-09ef-4971-b085-8b5566fd1b79" status: 200 len: 1361 microversion: 2.25 time: 0.397761 Aug 27 02:40:22.887871 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 67/114] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:40:22 2022] GET /compute/v2.1/servers/12acf567-09ef-4971-b085-8b5566fd1b79 => generated 1361 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:40:22.900766 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-3f231ee3-b9f8-4c78-91cf-93205ccf42e7 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5f4e86197e4175b223f20cacce792d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b427157c9f406da72d9b29af734987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:22.919664 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-3f231ee3-b9f8-4c78-91cf-93205ccf42e7 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] 10.222.0.70 "GET /compute/v2.1/servers/b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe" status: 200 len: 1338 microversion: 2.1 time: 0.363995 Aug 27 02:40:22.931144 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 48/115] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:22 2022] GET /compute/v2.1/servers/b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe => generated 1338 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:22.940525 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-51acba3a-159c-459a-8aae-d6d6eeb466c0 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:22.946412 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-51acba3a-159c-459a-8aae-d6d6eeb466c0 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] [instance: e231e897-7343-415a-a4ff-dfe3df4fb62c] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:22.963053 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-51acba3a-159c-459a-8aae-d6d6eeb466c0 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:22.965426 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-51acba3a-159c-459a-8aae-d6d6eeb466c0 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:22.966140 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-51acba3a-159c-459a-8aae-d6d6eeb466c0 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:22.970795 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-51acba3a-159c-459a-8aae-d6d6eeb466c0 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:22.971513 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-51acba3a-159c-459a-8aae-d6d6eeb466c0 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:22.972156 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-51acba3a-159c-459a-8aae-d6d6eeb466c0 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:23.183949 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3c4747b6-8a97-4f41-9a30-637c5b7f570d tempest-HostsAdminNegativeTestJSON-1838383586 tempest-HostsAdminNegativeTestJSON-1838383586-project-admin] Calling method '.version_select at 0x7f5edfe291f0>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:23.187945 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3c4747b6-8a97-4f41-9a30-637c5b7f570d tempest-HostsAdminNegativeTestJSON-1838383586 tempest-HostsAdminNegativeTestJSON-1838383586-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:23.188514 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3c4747b6-8a97-4f41-9a30-637c5b7f570d tempest-HostsAdminNegativeTestJSON-1838383586 tempest-HostsAdminNegativeTestJSON-1838383586-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:23.189490 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3c4747b6-8a97-4f41-9a30-637c5b7f570d tempest-HostsAdminNegativeTestJSON-1838383586 tempest-HostsAdminNegativeTestJSON-1838383586-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:23.190231 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3c4747b6-8a97-4f41-9a30-637c5b7f570d tempest-HostsAdminNegativeTestJSON-1838383586 tempest-HostsAdminNegativeTestJSON-1838383586-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:23.190678 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3c4747b6-8a97-4f41-9a30-637c5b7f570d tempest-HostsAdminNegativeTestJSON-1838383586 tempest-HostsAdminNegativeTestJSON-1838383586-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:23.191423 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3c4747b6-8a97-4f41-9a30-637c5b7f570d tempest-HostsAdminNegativeTestJSON-1838383586 tempest-HostsAdminNegativeTestJSON-1838383586-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:23.214217 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=100 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:40:23.230861 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-3c4747b6-8a97-4f41-9a30-637c5b7f570d tempest-HostsAdminNegativeTestJSON-1838383586 tempest-HostsAdminNegativeTestJSON-1838383586-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hosts" status: 200 len: 398 microversion: 2.1 time: 0.340926 Aug 27 02:40:23.232174 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 68/116] 10.222.0.70 () {58 vars in 1128 bytes} [Sat Aug 27 02:40:22 2022] GET /compute/v2.1/os-hosts => generated 398 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:40:23.237459 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-38e1b958-2c39-48bb-b3db-ee1cae977d1f tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:23.238408 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-38e1b958-2c39-48bb-b3db-ee1cae977d1f tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] [instance: 459d7a41-f50d-4ffe-a184-c0a12437669a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:23.247671 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-38e1b958-2c39-48bb-b3db-ee1cae977d1f tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:23.249187 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-38e1b958-2c39-48bb-b3db-ee1cae977d1f tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:23.249665 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-38e1b958-2c39-48bb-b3db-ee1cae977d1f tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:23.250637 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-38e1b958-2c39-48bb-b3db-ee1cae977d1f tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:23.251404 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-38e1b958-2c39-48bb-b3db-ee1cae977d1f tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:23.252165 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-38e1b958-2c39-48bb-b3db-ee1cae977d1f tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:23.260292 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-51acba3a-159c-459a-8aae-d6d6eeb466c0 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68711ff38ec41c0b051124527c7ac35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae179f416c451e92e270d2cb0f4400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:23.273739 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-51acba3a-159c-459a-8aae-d6d6eeb466c0 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] 10.222.0.70 "GET /compute/v2.1/servers/e231e897-7343-415a-a4ff-dfe3df4fb62c" status: 200 len: 1341 microversion: 2.1 time: 0.341053 Aug 27 02:40:23.284132 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 49/117] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:22 2022] GET /compute/v2.1/servers/e231e897-7343-415a-a4ff-dfe3df4fb62c => generated 1341 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:23.433102 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-65d8dfda-6117-4dcb-b8dd-8ff7bf1a66fd tempest-HostsAdminNegativeTestJSON-1401394244 tempest-HostsAdminNegativeTestJSON-1401394244-project] Calling method '.version_select at 0x7f5ee3d3c940>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:23.437060 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-38e1b958-2c39-48bb-b3db-ee1cae977d1f tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772e2e66c92e44f8838ce325437d5a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b2f4a529a3e4ea0937ca903dd5924bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:23.438978 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-65d8dfda-6117-4dcb-b8dd-8ff7bf1a66fd tempest-HostsAdminNegativeTestJSON-1401394244 tempest-HostsAdminNegativeTestJSON-1401394244-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': 'b2edbeaadbcb4758b276ab12f0b7d287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e48d6726b74102ba2c98ca132292c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:23.446375 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-38e1b958-2c39-48bb-b3db-ee1cae977d1f tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] 10.222.0.70 "GET /compute/v2.1/servers/459d7a41-f50d-4ffe-a184-c0a12437669a" status: 200 len: 1319 microversion: 2.1 time: 0.212864 Aug 27 02:40:23.447818 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 69/118] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:23 2022] GET /compute/v2.1/servers/459d7a41-f50d-4ffe-a184-c0a12437669a => generated 1319 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:23.452055 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-65d8dfda-6117-4dcb-b8dd-8ff7bf1a66fd tempest-HostsAdminNegativeTestJSON-1401394244 tempest-HostsAdminNegativeTestJSON-1401394244-project] Request method failure captured: Aug 27 02:40:23.452055 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Aug 27 02:40:23.452055 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:40:23.452055 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:40:23.452055 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:40:23.452055 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:40:23.452055 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:40:23.452055 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:40:23.452055 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:40:23.452055 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:40:23.452055 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYQVcdF1RT1iYDHxcnwxx6QDI48Tuuf95Roc_GJ-tnnKabMvZRcdzaFxmJaA2ObDHsyknK5SFbHcO64yb_Uf15byGNHP_3IXKZAgLi02BWnA1Jp3aqeQzTb_WlDc-i_giQ9Ry_A5R8tkuez7e_9VCznACs-Kj2K4Gvtgi0UTrI3hQL8 Aug 27 02:40:23.452055 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:40:23.452055 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:40:23.452055 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:40:23.452055 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:40:23.452055 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:40:23.452055 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:40:23.452055 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: d0e48d6726b74102ba2c98ca132292c2 Aug 27 02:40:23.452055 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1401394244 Aug 27 02:40:23.452055 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:40:23.452055 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:40:23.453641 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d0e48d6726b74102ba2c98ca132292c2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d0e48d6726b74102ba2c98ca132292c2", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d0e48d6726b74102ba2c98ca132292c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d0e48d6726b74102ba2c98ca132292c2"}]}] Aug 27 02:40:23.453641 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1401394244 Aug 27 02:40:23.453641 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: d0e48d6726b74102ba2c98ca132292c2 Aug 27 02:40:23.453641 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1401394244 Aug 27 02:40:23.453641 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-HostsAdminNegativeTestJSON-1401394244-project Aug 27 02:40:23.453641 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:40:23.453641 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:40:23.453641 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: b2edbeaadbcb4758b276ab12f0b7d287 Aug 27 02:40:23.453641 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1401394244-project Aug 27 02:40:23.453641 n-d-852278-4 devstack@n-api.service[134052]: method: Aug 27 02:40:23.453641 n-d-852278-4 devstack@n-api.service[134052]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 27 02:40:23.453641 n-d-852278-4 devstack@n-api.service[134052]: action_args: {} Aug 27 02:40:23.453641 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:40:23.454518 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:23.454518 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:23.454518 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:23.454518 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:40:23.454518 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:40:23.454518 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:40:23.454518 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:40:23.454518 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 02:40:23.454518 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:40:23.454518 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:40:23.454518 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:40:23.454518 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Aug 27 02:40:23.454518 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Aug 27 02:40:23.454518 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 02:40:23.454518 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 02:40:23.454518 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 02:40:23.454518 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 02:40:23.454518 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 02:40:23.454518 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 02:40:23.455956 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 02:40:23.455956 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 02:40:23.455956 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 02:40:23.455956 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 02:40:23.455956 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 02:40:23.455956 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 02:40:23.455956 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 02:40:23.455956 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 02:40:23.455956 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 27 02:40:23.455956 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:23.455956 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:23.455956 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:23.455956 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:23.455956 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:23.455956 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:23.455956 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 02:40:23.455956 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 02:40:23.455956 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 27 02:40:23.455956 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:23.458634 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-65d8dfda-6117-4dcb-b8dd-8ff7bf1a66fd tempest-HostsAdminNegativeTestJSON-1401394244 tempest-HostsAdminNegativeTestJSON-1401394244-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:40:23.459883 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-65d8dfda-6117-4dcb-b8dd-8ff7bf1a66fd tempest-HostsAdminNegativeTestJSON-1401394244 tempest-HostsAdminNegativeTestJSON-1401394244-project] 10.222.0.70 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.174299 Aug 27 02:40:23.460861 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 50/119] 10.222.0.70 () {58 vars in 1128 bytes} [Sat Aug 27 02:40:23 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 176 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:40:23.471115 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0775edcb-8876-4b23-b74f-40a10e8a9d75 tempest-HostsAdminNegativeTestJSON-1401394244 tempest-HostsAdminNegativeTestJSON-1401394244-project] Calling method '.version_select at 0x7f5edfe290d0>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:23.473058 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-0775edcb-8876-4b23-b74f-40a10e8a9d75 tempest-HostsAdminNegativeTestJSON-1401394244 tempest-HostsAdminNegativeTestJSON-1401394244-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': 'b2edbeaadbcb4758b276ab12f0b7d287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e48d6726b74102ba2c98ca132292c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:23.475195 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0775edcb-8876-4b23-b74f-40a10e8a9d75 tempest-HostsAdminNegativeTestJSON-1401394244 tempest-HostsAdminNegativeTestJSON-1401394244-project] Request method failure captured: Aug 27 02:40:23.475195 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/os-hosts/n-d-852278-4/reboot HTTP/1.1 Aug 27 02:40:23.475195 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:40:23.475195 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:40:23.475195 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:40:23.475195 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:40:23.475195 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:40:23.475195 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:40:23.475195 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:40:23.475195 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:40:23.475195 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYQVcdF1RT1iYDHxcnwxx6QDI48Tuuf95Roc_GJ-tnnKabMvZRcdzaFxmJaA2ObDHsyknK5SFbHcO64yb_Uf15byGNHP_3IXKZAgLi02BWnA1Jp3aqeQzTb_WlDc-i_giQ9Ry_A5R8tkuez7e_9VCznACs-Kj2K4Gvtgi0UTrI3hQL8 Aug 27 02:40:23.475195 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:40:23.475195 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:40:23.475195 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:40:23.475195 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:40:23.475195 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:40:23.475195 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:40:23.475195 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: d0e48d6726b74102ba2c98ca132292c2 Aug 27 02:40:23.475195 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1401394244 Aug 27 02:40:23.475195 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:40:23.475195 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:40:23.476622 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d0e48d6726b74102ba2c98ca132292c2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d0e48d6726b74102ba2c98ca132292c2", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d0e48d6726b74102ba2c98ca132292c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d0e48d6726b74102ba2c98ca132292c2"}]}] Aug 27 02:40:23.476622 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1401394244 Aug 27 02:40:23.476622 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: d0e48d6726b74102ba2c98ca132292c2 Aug 27 02:40:23.476622 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1401394244 Aug 27 02:40:23.476622 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-HostsAdminNegativeTestJSON-1401394244-project Aug 27 02:40:23.476622 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:40:23.476622 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:40:23.476622 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: b2edbeaadbcb4758b276ab12f0b7d287 Aug 27 02:40:23.476622 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1401394244-project Aug 27 02:40:23.476622 n-d-852278-4 devstack@n-api.service[134051]: method: Aug 27 02:40:23.476622 n-d-852278-4 devstack@n-api.service[134051]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 27 02:40:23.476622 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': 'n-d-852278-4'} Aug 27 02:40:23.476622 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:40:23.477467 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:23.477467 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:23.477467 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:23.477467 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:40:23.477467 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:40:23.477467 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:40:23.477467 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:40:23.477467 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:40:23.477467 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:40:23.477467 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Aug 27 02:40:23.477467 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Aug 27 02:40:23.477467 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 02:40:23.477467 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 02:40:23.477467 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 02:40:23.477467 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 02:40:23.477467 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 02:40:23.477467 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 02:40:23.477467 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 02:40:23.477467 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 02:40:23.478706 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 02:40:23.478706 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 02:40:23.478706 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 02:40:23.478706 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 02:40:23.478706 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 02:40:23.478706 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 02:40:23.478706 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 27 02:40:23.478706 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:23.478706 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:23.478706 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:23.478706 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:23.478706 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:23.478706 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:23.478706 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 02:40:23.478706 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 02:40:23.478706 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 27 02:40:23.478706 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:23.479820 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0775edcb-8876-4b23-b74f-40a10e8a9d75 tempest-HostsAdminNegativeTestJSON-1401394244 tempest-HostsAdminNegativeTestJSON-1401394244-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:40:23.480650 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-0775edcb-8876-4b23-b74f-40a10e8a9d75 tempest-HostsAdminNegativeTestJSON-1401394244 tempest-HostsAdminNegativeTestJSON-1401394244-project] 10.222.0.70 "GET /compute/v2.1/os-hosts/n-d-852278-4/reboot" status: 403 len: 111 microversion: 2.1 time: 0.013905 Aug 27 02:40:23.481372 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 70/120] 10.222.0.70 () {58 vars in 1188 bytes} [Sat Aug 27 02:40:23 2022] GET /compute/v2.1/os-hosts/n-d-852278-4/reboot => generated 111 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:40:23.490989 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-1d586db4-6d6c-4c96-a421-0e93ca0913d8 tempest-HostsAdminNegativeTestJSON-1838383586 tempest-HostsAdminNegativeTestJSON-1838383586-project-admin] Calling method '.version_select at 0x7f5ee3dca670>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:23.521117 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-1d586db4-6d6c-4c96-a421-0e93ca0913d8 tempest-HostsAdminNegativeTestJSON-1838383586 tempest-HostsAdminNegativeTestJSON-1838383586-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 02:40:23.526598 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-1d586db4-6d6c-4c96-a421-0e93ca0913d8 tempest-HostsAdminNegativeTestJSON-1838383586 tempest-HostsAdminNegativeTestJSON-1838383586-project-admin] Request method failure captured: Aug 27 02:40:23.526598 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Aug 27 02:40:23.526598 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:40:23.526598 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:40:23.526598 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:40:23.526598 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:40:23.526598 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:40:23.526598 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:40:23.526598 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:40:23.526598 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:40:23.526598 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYQWfBjR5CIDSVnC4xQdb7zSv_GuzvX6kfFVLycPmmed0DkD9nNApINbS-T0DBbzlcV2uSSrs2A8WFLxSK3EomA6a71QGluOmdDibV2Q0YTYEXm1T3X8LeV-wmn19NTEeIJVn86LUnvhnkf0KQL3EvDElg4oeOqlGfZXWYw8JH1c1SU Aug 27 02:40:23.526598 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:40:23.526598 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:40:23.526598 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:40:23.526598 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:40:23.526598 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:40:23.526598 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:40:23.526598 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 9cb0e3dfa123465892c5c3267439c8fc Aug 27 02:40:23.526598 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1838383586 Aug 27 02:40:23.526598 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,admin,member Aug 27 02:40:23.526598 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,admin,member Aug 27 02:40:23.528074 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9cb0e3dfa123465892c5c3267439c8fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_9cb0e3dfa123465892c5c3267439c8fc", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9cb0e3dfa123465892c5c3267439c8fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/9cb0e3dfa123465892c5c3267439c8fc"}]}] Aug 27 02:40:23.528074 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1838383586 Aug 27 02:40:23.528074 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 9cb0e3dfa123465892c5c3267439c8fc Aug 27 02:40:23.528074 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1838383586 Aug 27 02:40:23.528074 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-HostsAdminNegativeTestJSON-1838383586-project-admin Aug 27 02:40:23.528074 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:40:23.528074 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:40:23.528074 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 2379712218a8413ea3f1360a330eb669 Aug 27 02:40:23.528074 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1838383586-project-admin Aug 27 02:40:23.528074 n-d-852278-4 devstack@n-api.service[134052]: method: Aug 27 02:40:23.528074 n-d-852278-4 devstack@n-api.service[134052]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 02:40:23.528074 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': 'nonexistent_hostname'} Aug 27 02:40:23.528074 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:40:23.529132 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:23.529132 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 27 02:40:23.529132 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 27 02:40:23.529132 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 27 02:40:23.529132 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 27 02:40:23.529132 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 02:40:23.529132 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 02:40:23.529132 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 02:40:23.529132 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 02:40:23.529132 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 27 02:40:23.529132 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 27 02:40:23.529132 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5988, in targeted Aug 27 02:40:23.529132 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 27 02:40:23.529132 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 02:40:23.529132 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 02:40:23.529132 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 27 02:40:23.529132 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 27 02:40:23.529132 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 02:40:23.529132 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 02:40:23.530408 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 27 02:40:23.530408 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 27 02:40:23.530408 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 02:40:23.530408 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:23.530408 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:23.530408 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:23.530408 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:23.530408 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:23.530408 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:23.530408 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:40:23.530408 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:40:23.530408 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:40:23.530408 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:40:23.530408 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:40:23.530408 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:40:23.530408 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Aug 27 02:40:23.530408 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Aug 27 02:40:23.530408 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 27 02:40:23.530408 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:40:23.533709 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 02:40:23.533709 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:23.533709 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:23.533709 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:23.533709 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:23.533709 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:23.533709 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:23.533709 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:40:23.533709 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:40:23.533709 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 02:40:23.533709 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:23.533709 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-1d586db4-6d6c-4c96-a421-0e93ca0913d8 tempest-HostsAdminNegativeTestJSON-1838383586 tempest-HostsAdminNegativeTestJSON-1838383586-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:40:23.533709 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-1d586db4-6d6c-4c96-a421-0e93ca0913d8 tempest-HostsAdminNegativeTestJSON-1838383586 tempest-HostsAdminNegativeTestJSON-1838383586-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.041093 Aug 27 02:40:23.533709 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 51/121] 10.222.0.70 () {58 vars in 1212 bytes} [Sat Aug 27 02:40:23 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 02:40:23.538387 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-21bd49bf-af17-46f7-9a9a-42d2488caa47 tempest-HostsAdminNegativeTestJSON-1401394244 tempest-HostsAdminNegativeTestJSON-1401394244-project] Calling method '.version_select at 0x7f5edfc994c0>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:23.540406 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-21bd49bf-af17-46f7-9a9a-42d2488caa47 tempest-HostsAdminNegativeTestJSON-1401394244 tempest-HostsAdminNegativeTestJSON-1401394244-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': 'b2edbeaadbcb4758b276ab12f0b7d287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e48d6726b74102ba2c98ca132292c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:23.541953 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-21bd49bf-af17-46f7-9a9a-42d2488caa47 tempest-HostsAdminNegativeTestJSON-1401394244 tempest-HostsAdminNegativeTestJSON-1401394244-project] Request method failure captured: Aug 27 02:40:23.541953 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/os-hosts/n-d-852278-4 HTTP/1.1 Aug 27 02:40:23.541953 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:40:23.541953 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:40:23.541953 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:40:23.541953 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:40:23.541953 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:40:23.541953 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:40:23.541953 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:40:23.541953 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:40:23.541953 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYQVcdF1RT1iYDHxcnwxx6QDI48Tuuf95Roc_GJ-tnnKabMvZRcdzaFxmJaA2ObDHsyknK5SFbHcO64yb_Uf15byGNHP_3IXKZAgLi02BWnA1Jp3aqeQzTb_WlDc-i_giQ9Ry_A5R8tkuez7e_9VCznACs-Kj2K4Gvtgi0UTrI3hQL8 Aug 27 02:40:23.541953 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:40:23.541953 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:40:23.541953 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:40:23.541953 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:40:23.541953 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:40:23.541953 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:40:23.541953 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: d0e48d6726b74102ba2c98ca132292c2 Aug 27 02:40:23.541953 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1401394244 Aug 27 02:40:23.541953 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:40:23.541953 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:40:23.543252 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d0e48d6726b74102ba2c98ca132292c2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d0e48d6726b74102ba2c98ca132292c2", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d0e48d6726b74102ba2c98ca132292c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d0e48d6726b74102ba2c98ca132292c2"}]}] Aug 27 02:40:23.543252 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1401394244 Aug 27 02:40:23.543252 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: d0e48d6726b74102ba2c98ca132292c2 Aug 27 02:40:23.543252 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1401394244 Aug 27 02:40:23.543252 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-HostsAdminNegativeTestJSON-1401394244-project Aug 27 02:40:23.543252 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:40:23.543252 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:40:23.543252 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: b2edbeaadbcb4758b276ab12f0b7d287 Aug 27 02:40:23.543252 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1401394244-project Aug 27 02:40:23.543252 n-d-852278-4 devstack@n-api.service[134051]: method: Aug 27 02:40:23.543252 n-d-852278-4 devstack@n-api.service[134051]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 27 02:40:23.543252 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': 'n-d-852278-4'} Aug 27 02:40:23.543252 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:40:23.543974 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:23.543974 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:23.543974 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:23.543974 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:40:23.543974 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:40:23.543974 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:40:23.543974 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:40:23.543974 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:40:23.543974 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:40:23.543974 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Aug 27 02:40:23.543974 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Aug 27 02:40:23.543974 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 02:40:23.543974 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 02:40:23.543974 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 02:40:23.543974 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 02:40:23.543974 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 02:40:23.543974 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 02:40:23.543974 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 02:40:23.543974 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 02:40:23.545030 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 02:40:23.545030 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 02:40:23.545030 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 02:40:23.545030 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 02:40:23.545030 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 02:40:23.545030 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 02:40:23.545030 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 27 02:40:23.545030 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:23.545030 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:23.545030 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:23.545030 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:23.545030 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:23.545030 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:23.545030 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 02:40:23.545030 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 02:40:23.545030 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 27 02:40:23.545030 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:23.547584 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-21bd49bf-af17-46f7-9a9a-42d2488caa47 tempest-HostsAdminNegativeTestJSON-1401394244 tempest-HostsAdminNegativeTestJSON-1401394244-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:40:23.547584 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-21bd49bf-af17-46f7-9a9a-42d2488caa47 tempest-HostsAdminNegativeTestJSON-1401394244 tempest-HostsAdminNegativeTestJSON-1401394244-project] 10.222.0.70 "GET /compute/v2.1/os-hosts/n-d-852278-4" status: 403 len: 109 microversion: 2.1 time: 0.008754 Aug 27 02:40:23.547584 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 71/122] 10.222.0.70 () {58 vars in 1167 bytes} [Sat Aug 27 02:40:23 2022] GET /compute/v2.1/os-hosts/n-d-852278-4 => generated 109 bytes in 10 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:40:23.553620 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-2e906d14-c20a-43c2-8d26-593cef79bf00 tempest-HostsAdminNegativeTestJSON-1838383586 tempest-HostsAdminNegativeTestJSON-1838383586-project-admin] Calling method '.version_select at 0x7f5ee3bbb3a0>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:23.561977 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-2e906d14-c20a-43c2-8d26-593cef79bf00 tempest-HostsAdminNegativeTestJSON-1838383586 tempest-HostsAdminNegativeTestJSON-1838383586-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 02:40:23.563774 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-2e906d14-c20a-43c2-8d26-593cef79bf00 tempest-HostsAdminNegativeTestJSON-1838383586 tempest-HostsAdminNegativeTestJSON-1838383586-project-admin] Request method failure captured: Aug 27 02:40:23.563774 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Aug 27 02:40:23.563774 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:40:23.563774 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:40:23.563774 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:40:23.563774 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:40:23.563774 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:40:23.563774 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:40:23.563774 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:40:23.563774 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:40:23.563774 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYQWfBjR5CIDSVnC4xQdb7zSv_GuzvX6kfFVLycPmmed0DkD9nNApINbS-T0DBbzlcV2uSSrs2A8WFLxSK3EomA6a71QGluOmdDibV2Q0YTYEXm1T3X8LeV-wmn19NTEeIJVn86LUnvhnkf0KQL3EvDElg4oeOqlGfZXWYw8JH1c1SU Aug 27 02:40:23.563774 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:40:23.563774 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:40:23.563774 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:40:23.563774 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:40:23.563774 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:40:23.563774 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:40:23.563774 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 9cb0e3dfa123465892c5c3267439c8fc Aug 27 02:40:23.563774 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1838383586 Aug 27 02:40:23.563774 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,admin,member Aug 27 02:40:23.563774 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,admin,member Aug 27 02:40:23.565221 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9cb0e3dfa123465892c5c3267439c8fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_9cb0e3dfa123465892c5c3267439c8fc", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9cb0e3dfa123465892c5c3267439c8fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/9cb0e3dfa123465892c5c3267439c8fc"}]}] Aug 27 02:40:23.565221 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1838383586 Aug 27 02:40:23.565221 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 9cb0e3dfa123465892c5c3267439c8fc Aug 27 02:40:23.565221 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1838383586 Aug 27 02:40:23.565221 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-HostsAdminNegativeTestJSON-1838383586-project-admin Aug 27 02:40:23.565221 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:40:23.565221 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:40:23.565221 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 2379712218a8413ea3f1360a330eb669 Aug 27 02:40:23.565221 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1838383586-project-admin Aug 27 02:40:23.565221 n-d-852278-4 devstack@n-api.service[134052]: method: Aug 27 02:40:23.565221 n-d-852278-4 devstack@n-api.service[134052]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 02:40:23.565221 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': 'nonexistent_hostname'} Aug 27 02:40:23.565221 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:40:23.566062 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:23.566062 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Aug 27 02:40:23.566062 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 27 02:40:23.566062 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 02:40:23.566062 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 02:40:23.566062 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 27 02:40:23.566062 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 27 02:40:23.566062 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 02:40:23.566062 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 02:40:23.566062 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 27 02:40:23.566062 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 27 02:40:23.566062 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 02:40:23.566062 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:23.566062 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:23.566062 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:23.566062 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:23.566062 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:23.566062 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:23.566062 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:40:23.567240 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:40:23.567240 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:40:23.567240 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:40:23.567240 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:40:23.567240 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:40:23.567240 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Aug 27 02:40:23.567240 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:40:23.567240 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 02:40:23.567240 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:23.567240 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:23.567240 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:23.567240 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:23.567240 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:23.567240 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:23.567240 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:40:23.567240 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:40:23.567240 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 02:40:23.567240 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:23.569181 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-2e906d14-c20a-43c2-8d26-593cef79bf00 tempest-HostsAdminNegativeTestJSON-1838383586 tempest-HostsAdminNegativeTestJSON-1838383586-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:40:23.569181 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-2e906d14-c20a-43c2-8d26-593cef79bf00 tempest-HostsAdminNegativeTestJSON-1838383586 tempest-HostsAdminNegativeTestJSON-1838383586-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.018381 Aug 27 02:40:23.569181 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 52/123] 10.222.0.70 () {58 vars in 1191 bytes} [Sat Aug 27 02:40:23 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 02:40:23.579191 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-1f601795-e96d-42be-a4b4-b063f8f25004 tempest-HostsAdminNegativeTestJSON-1401394244 tempest-HostsAdminNegativeTestJSON-1401394244-project] Calling method '.version_select at 0x7f5edfc999d0>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:23.581321 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-1f601795-e96d-42be-a4b4-b063f8f25004 tempest-HostsAdminNegativeTestJSON-1401394244 tempest-HostsAdminNegativeTestJSON-1401394244-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': 'b2edbeaadbcb4758b276ab12f0b7d287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e48d6726b74102ba2c98ca132292c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:23.582935 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-1f601795-e96d-42be-a4b4-b063f8f25004 tempest-HostsAdminNegativeTestJSON-1401394244 tempest-HostsAdminNegativeTestJSON-1401394244-project] Request method failure captured: Aug 27 02:40:23.582935 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/os-hosts/n-d-852278-4/shutdown HTTP/1.1 Aug 27 02:40:23.582935 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:40:23.582935 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:40:23.582935 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:40:23.582935 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:40:23.582935 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:40:23.582935 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:40:23.582935 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:40:23.582935 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:40:23.582935 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYQVcdF1RT1iYDHxcnwxx6QDI48Tuuf95Roc_GJ-tnnKabMvZRcdzaFxmJaA2ObDHsyknK5SFbHcO64yb_Uf15byGNHP_3IXKZAgLi02BWnA1Jp3aqeQzTb_WlDc-i_giQ9Ry_A5R8tkuez7e_9VCznACs-Kj2K4Gvtgi0UTrI3hQL8 Aug 27 02:40:23.582935 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:40:23.582935 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:40:23.582935 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:40:23.582935 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:40:23.582935 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:40:23.582935 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:40:23.582935 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: d0e48d6726b74102ba2c98ca132292c2 Aug 27 02:40:23.582935 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1401394244 Aug 27 02:40:23.582935 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:40:23.582935 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:40:23.584101 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d0e48d6726b74102ba2c98ca132292c2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d0e48d6726b74102ba2c98ca132292c2", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d0e48d6726b74102ba2c98ca132292c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d0e48d6726b74102ba2c98ca132292c2"}]}] Aug 27 02:40:23.584101 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1401394244 Aug 27 02:40:23.584101 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: d0e48d6726b74102ba2c98ca132292c2 Aug 27 02:40:23.584101 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1401394244 Aug 27 02:40:23.584101 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-HostsAdminNegativeTestJSON-1401394244-project Aug 27 02:40:23.584101 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:40:23.584101 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:40:23.584101 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: b2edbeaadbcb4758b276ab12f0b7d287 Aug 27 02:40:23.584101 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1401394244-project Aug 27 02:40:23.584101 n-d-852278-4 devstack@n-api.service[134051]: method: Aug 27 02:40:23.584101 n-d-852278-4 devstack@n-api.service[134051]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 27 02:40:23.584101 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': 'n-d-852278-4'} Aug 27 02:40:23.584101 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:40:23.584822 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:23.584822 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:23.584822 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:23.584822 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:40:23.584822 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:40:23.584822 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:40:23.584822 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:40:23.584822 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:40:23.584822 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:40:23.584822 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Aug 27 02:40:23.584822 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Aug 27 02:40:23.584822 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 02:40:23.584822 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 02:40:23.584822 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 02:40:23.584822 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 02:40:23.584822 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 02:40:23.584822 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 02:40:23.584822 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 02:40:23.584822 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 02:40:23.585823 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 02:40:23.585823 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 02:40:23.585823 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 02:40:23.585823 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 02:40:23.585823 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 02:40:23.585823 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 02:40:23.585823 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 27 02:40:23.585823 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:23.585823 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:23.585823 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:23.585823 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:23.585823 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:23.585823 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:23.585823 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 02:40:23.585823 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 02:40:23.585823 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 27 02:40:23.585823 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:23.586817 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-1f601795-e96d-42be-a4b4-b063f8f25004 tempest-HostsAdminNegativeTestJSON-1401394244 tempest-HostsAdminNegativeTestJSON-1401394244-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:40:23.586817 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-1f601795-e96d-42be-a4b4-b063f8f25004 tempest-HostsAdminNegativeTestJSON-1401394244 tempest-HostsAdminNegativeTestJSON-1401394244-project] 10.222.0.70 "GET /compute/v2.1/os-hosts/n-d-852278-4/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.009961 Aug 27 02:40:23.586817 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 72/124] 10.222.0.70 () {58 vars in 1194 bytes} [Sat Aug 27 02:40:23 2022] GET /compute/v2.1/os-hosts/n-d-852278-4/shutdown => generated 113 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:40:23.594481 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6323f5b1-2ae3-4d1b-a9f1-1cd563b6e37a tempest-HostsAdminNegativeTestJSON-1838383586 tempest-HostsAdminNegativeTestJSON-1838383586-project-admin] Calling method '.version_select at 0x7f5ee3cfd430>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:23.603357 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-6323f5b1-2ae3-4d1b-a9f1-1cd563b6e37a tempest-HostsAdminNegativeTestJSON-1838383586 tempest-HostsAdminNegativeTestJSON-1838383586-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 02:40:23.605425 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6323f5b1-2ae3-4d1b-a9f1-1cd563b6e37a tempest-HostsAdminNegativeTestJSON-1838383586 tempest-HostsAdminNegativeTestJSON-1838383586-project-admin] Request method failure captured: Aug 27 02:40:23.605425 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Aug 27 02:40:23.605425 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:40:23.605425 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:40:23.605425 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:40:23.605425 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:40:23.605425 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:40:23.605425 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:40:23.605425 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:40:23.605425 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:40:23.605425 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYQWfBjR5CIDSVnC4xQdb7zSv_GuzvX6kfFVLycPmmed0DkD9nNApINbS-T0DBbzlcV2uSSrs2A8WFLxSK3EomA6a71QGluOmdDibV2Q0YTYEXm1T3X8LeV-wmn19NTEeIJVn86LUnvhnkf0KQL3EvDElg4oeOqlGfZXWYw8JH1c1SU Aug 27 02:40:23.605425 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:40:23.605425 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:40:23.605425 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:40:23.605425 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:40:23.605425 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:40:23.605425 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:40:23.605425 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 9cb0e3dfa123465892c5c3267439c8fc Aug 27 02:40:23.605425 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1838383586 Aug 27 02:40:23.605425 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,admin,member Aug 27 02:40:23.605425 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,admin,member Aug 27 02:40:23.607161 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9cb0e3dfa123465892c5c3267439c8fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_9cb0e3dfa123465892c5c3267439c8fc", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9cb0e3dfa123465892c5c3267439c8fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/9cb0e3dfa123465892c5c3267439c8fc"}]}] Aug 27 02:40:23.607161 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1838383586 Aug 27 02:40:23.607161 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 9cb0e3dfa123465892c5c3267439c8fc Aug 27 02:40:23.607161 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1838383586 Aug 27 02:40:23.607161 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-HostsAdminNegativeTestJSON-1838383586-project-admin Aug 27 02:40:23.607161 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:40:23.607161 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:40:23.607161 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 2379712218a8413ea3f1360a330eb669 Aug 27 02:40:23.607161 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1838383586-project-admin Aug 27 02:40:23.607161 n-d-852278-4 devstack@n-api.service[134052]: method: Aug 27 02:40:23.607161 n-d-852278-4 devstack@n-api.service[134052]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 02:40:23.607161 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': 'nonexistent_hostname'} Aug 27 02:40:23.607161 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:40:23.607941 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:23.607941 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 27 02:40:23.607941 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 27 02:40:23.607941 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 27 02:40:23.607941 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 27 02:40:23.607941 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 02:40:23.607941 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 02:40:23.607941 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 02:40:23.607941 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 02:40:23.607941 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 27 02:40:23.607941 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 27 02:40:23.607941 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5988, in targeted Aug 27 02:40:23.607941 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 27 02:40:23.607941 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 02:40:23.607941 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 02:40:23.607941 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 27 02:40:23.607941 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 27 02:40:23.607941 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 02:40:23.607941 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 02:40:23.609268 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 27 02:40:23.609268 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 27 02:40:23.609268 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 02:40:23.609268 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:23.609268 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:23.609268 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:23.609268 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:23.609268 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:23.609268 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:23.609268 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:40:23.609268 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:40:23.609268 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:40:23.609268 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:40:23.609268 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:40:23.609268 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:40:23.609268 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Aug 27 02:40:23.609268 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Aug 27 02:40:23.609268 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 27 02:40:23.609268 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:40:23.610627 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 02:40:23.610627 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:23.610627 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:23.610627 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:23.610627 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:23.610627 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:23.610627 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:23.610627 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:40:23.610627 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:40:23.610627 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 02:40:23.610627 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:23.610627 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6323f5b1-2ae3-4d1b-a9f1-1cd563b6e37a tempest-HostsAdminNegativeTestJSON-1838383586 tempest-HostsAdminNegativeTestJSON-1838383586-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:40:23.610627 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-6323f5b1-2ae3-4d1b-a9f1-1cd563b6e37a tempest-HostsAdminNegativeTestJSON-1838383586 tempest-HostsAdminNegativeTestJSON-1838383586-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.017116 Aug 27 02:40:23.614182 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 53/125] 10.222.0.70 () {58 vars in 1218 bytes} [Sat Aug 27 02:40:23 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 02:40:23.620074 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e1a1d95c-7bd8-40d0-a451-e8af84782bc4 tempest-HostsAdminNegativeTestJSON-1401394244 tempest-HostsAdminNegativeTestJSON-1401394244-project] Calling method '.version_select at 0x7f5edfe29280>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:23.622083 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e1a1d95c-7bd8-40d0-a451-e8af84782bc4 tempest-HostsAdminNegativeTestJSON-1401394244 tempest-HostsAdminNegativeTestJSON-1401394244-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': 'b2edbeaadbcb4758b276ab12f0b7d287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e48d6726b74102ba2c98ca132292c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:23.623687 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e1a1d95c-7bd8-40d0-a451-e8af84782bc4 tempest-HostsAdminNegativeTestJSON-1401394244 tempest-HostsAdminNegativeTestJSON-1401394244-project] Request method failure captured: Aug 27 02:40:23.623687 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/os-hosts/n-d-852278-4/startup HTTP/1.1 Aug 27 02:40:23.623687 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:40:23.623687 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:40:23.623687 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:40:23.623687 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:40:23.623687 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:40:23.623687 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:40:23.623687 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:40:23.623687 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:40:23.623687 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYQVcdF1RT1iYDHxcnwxx6QDI48Tuuf95Roc_GJ-tnnKabMvZRcdzaFxmJaA2ObDHsyknK5SFbHcO64yb_Uf15byGNHP_3IXKZAgLi02BWnA1Jp3aqeQzTb_WlDc-i_giQ9Ry_A5R8tkuez7e_9VCznACs-Kj2K4Gvtgi0UTrI3hQL8 Aug 27 02:40:23.623687 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:40:23.623687 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:40:23.623687 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:40:23.623687 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:40:23.623687 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:40:23.623687 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:40:23.623687 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: d0e48d6726b74102ba2c98ca132292c2 Aug 27 02:40:23.623687 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1401394244 Aug 27 02:40:23.623687 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:40:23.623687 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:40:23.624908 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d0e48d6726b74102ba2c98ca132292c2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d0e48d6726b74102ba2c98ca132292c2", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d0e48d6726b74102ba2c98ca132292c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d0e48d6726b74102ba2c98ca132292c2"}]}] Aug 27 02:40:23.624908 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1401394244 Aug 27 02:40:23.624908 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: d0e48d6726b74102ba2c98ca132292c2 Aug 27 02:40:23.624908 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1401394244 Aug 27 02:40:23.624908 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-HostsAdminNegativeTestJSON-1401394244-project Aug 27 02:40:23.624908 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:40:23.624908 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:40:23.624908 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: b2edbeaadbcb4758b276ab12f0b7d287 Aug 27 02:40:23.624908 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1401394244-project Aug 27 02:40:23.624908 n-d-852278-4 devstack@n-api.service[134051]: method: Aug 27 02:40:23.624908 n-d-852278-4 devstack@n-api.service[134051]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 27 02:40:23.624908 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': 'n-d-852278-4'} Aug 27 02:40:23.624908 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:40:23.625702 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:23.625702 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:23.625702 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:23.625702 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:40:23.625702 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:40:23.625702 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:40:23.625702 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:40:23.625702 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:40:23.625702 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:40:23.625702 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Aug 27 02:40:23.625702 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Aug 27 02:40:23.625702 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 02:40:23.625702 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 02:40:23.625702 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 02:40:23.625702 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 02:40:23.625702 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 02:40:23.625702 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 02:40:23.625702 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 02:40:23.625702 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 02:40:23.627358 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 02:40:23.627358 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 02:40:23.627358 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 02:40:23.627358 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 02:40:23.627358 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 02:40:23.627358 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 02:40:23.627358 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 27 02:40:23.627358 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:23.627358 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:23.627358 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:23.627358 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:23.627358 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:23.627358 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:23.627358 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 02:40:23.627358 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 02:40:23.627358 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 27 02:40:23.627358 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:23.629567 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e1a1d95c-7bd8-40d0-a451-e8af84782bc4 tempest-HostsAdminNegativeTestJSON-1401394244 tempest-HostsAdminNegativeTestJSON-1401394244-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:40:23.629567 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e1a1d95c-7bd8-40d0-a451-e8af84782bc4 tempest-HostsAdminNegativeTestJSON-1401394244 tempest-HostsAdminNegativeTestJSON-1401394244-project] 10.222.0.70 "GET /compute/v2.1/os-hosts/n-d-852278-4/startup" status: 403 len: 110 microversion: 2.1 time: 0.010194 Aug 27 02:40:23.629567 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 73/126] 10.222.0.70 () {58 vars in 1191 bytes} [Sat Aug 27 02:40:23 2022] GET /compute/v2.1/os-hosts/n-d-852278-4/startup => generated 110 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:40:23.637500 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-2e9bc84e-2c73-4ab6-b240-45109b198aa8 tempest-HostsAdminNegativeTestJSON-1838383586 tempest-HostsAdminNegativeTestJSON-1838383586-project-admin] Calling method '.version_select at 0x7f5ee3bbbd30>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:23.650636 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-2e9bc84e-2c73-4ab6-b240-45109b198aa8 tempest-HostsAdminNegativeTestJSON-1838383586 tempest-HostsAdminNegativeTestJSON-1838383586-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 02:40:23.652612 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-2e9bc84e-2c73-4ab6-b240-45109b198aa8 tempest-HostsAdminNegativeTestJSON-1838383586 tempest-HostsAdminNegativeTestJSON-1838383586-project-admin] Request method failure captured: Aug 27 02:40:23.652612 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Aug 27 02:40:23.652612 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:40:23.652612 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:40:23.652612 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:40:23.652612 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:40:23.652612 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:40:23.652612 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:40:23.652612 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:40:23.652612 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:40:23.652612 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYQWfBjR5CIDSVnC4xQdb7zSv_GuzvX6kfFVLycPmmed0DkD9nNApINbS-T0DBbzlcV2uSSrs2A8WFLxSK3EomA6a71QGluOmdDibV2Q0YTYEXm1T3X8LeV-wmn19NTEeIJVn86LUnvhnkf0KQL3EvDElg4oeOqlGfZXWYw8JH1c1SU Aug 27 02:40:23.652612 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:40:23.652612 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:40:23.652612 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:40:23.652612 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:40:23.652612 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:40:23.652612 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:40:23.652612 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 9cb0e3dfa123465892c5c3267439c8fc Aug 27 02:40:23.652612 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1838383586 Aug 27 02:40:23.652612 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,admin,member Aug 27 02:40:23.652612 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,admin,member Aug 27 02:40:23.653756 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9cb0e3dfa123465892c5c3267439c8fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_9cb0e3dfa123465892c5c3267439c8fc", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9cb0e3dfa123465892c5c3267439c8fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/9cb0e3dfa123465892c5c3267439c8fc"}]}] Aug 27 02:40:23.653756 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1838383586 Aug 27 02:40:23.653756 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 9cb0e3dfa123465892c5c3267439c8fc Aug 27 02:40:23.653756 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1838383586 Aug 27 02:40:23.653756 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-HostsAdminNegativeTestJSON-1838383586-project-admin Aug 27 02:40:23.653756 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:40:23.653756 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:40:23.653756 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 2379712218a8413ea3f1360a330eb669 Aug 27 02:40:23.653756 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1838383586-project-admin Aug 27 02:40:23.653756 n-d-852278-4 devstack@n-api.service[134052]: method: Aug 27 02:40:23.653756 n-d-852278-4 devstack@n-api.service[134052]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 02:40:23.653756 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': 'nonexistent_hostname'} Aug 27 02:40:23.653756 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:40:23.654448 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:23.654448 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 27 02:40:23.654448 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 27 02:40:23.654448 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 27 02:40:23.654448 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 27 02:40:23.654448 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 02:40:23.654448 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 02:40:23.654448 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 02:40:23.654448 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 02:40:23.654448 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 27 02:40:23.654448 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 27 02:40:23.654448 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5988, in targeted Aug 27 02:40:23.654448 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 27 02:40:23.654448 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 02:40:23.654448 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 02:40:23.654448 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 27 02:40:23.654448 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 27 02:40:23.654448 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 02:40:23.654448 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 02:40:23.655483 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 27 02:40:23.655483 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 27 02:40:23.655483 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 02:40:23.655483 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:23.655483 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:23.655483 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:23.655483 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:23.655483 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:23.655483 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:23.655483 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:40:23.655483 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:40:23.655483 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:40:23.655483 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:40:23.655483 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:40:23.655483 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:40:23.655483 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Aug 27 02:40:23.655483 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Aug 27 02:40:23.655483 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 27 02:40:23.655483 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:40:23.657203 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 02:40:23.657203 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:23.657203 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:23.657203 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:23.657203 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:23.657203 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:23.657203 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:23.657203 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:40:23.657203 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:40:23.657203 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 02:40:23.657203 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:23.657203 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-2e9bc84e-2c73-4ab6-b240-45109b198aa8 tempest-HostsAdminNegativeTestJSON-1838383586 tempest-HostsAdminNegativeTestJSON-1838383586-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:40:23.657203 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-2e9bc84e-2c73-4ab6-b240-45109b198aa8 tempest-HostsAdminNegativeTestJSON-1838383586 tempest-HostsAdminNegativeTestJSON-1838383586-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.021399 Aug 27 02:40:23.657203 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 54/127] 10.222.0.70 () {58 vars in 1215 bytes} [Sat Aug 27 02:40:23 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 02:40:23.665761 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-393ec92e-55c5-42d4-ac63-3480157aa8f1 tempest-HostsAdminNegativeTestJSON-1838383586 tempest-HostsAdminNegativeTestJSON-1838383586-project-admin] Action: 'update', calling method: .version_select at 0x7f5edfd738b0>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:23.698461 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-393ec92e-55c5-42d4-ac63-3480157aa8f1 tempest-HostsAdminNegativeTestJSON-1838383586 tempest-HostsAdminNegativeTestJSON-1838383586-project-admin] Request method failure captured: Aug 27 02:40:23.698461 n-d-852278-4 devstack@n-api.service[134051]: request: PUT /compute/v2.1/os-hosts/n-d-852278-4 HTTP/1.1 Aug 27 02:40:23.698461 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:40:23.698461 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:40:23.698461 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:40:23.698461 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 51 Aug 27 02:40:23.698461 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:40:23.698461 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:40:23.698461 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:40:23.698461 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:40:23.698461 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYQWfBjR5CIDSVnC4xQdb7zSv_GuzvX6kfFVLycPmmed0DkD9nNApINbS-T0DBbzlcV2uSSrs2A8WFLxSK3EomA6a71QGluOmdDibV2Q0YTYEXm1T3X8LeV-wmn19NTEeIJVn86LUnvhnkf0KQL3EvDElg4oeOqlGfZXWYw8JH1c1SU Aug 27 02:40:23.698461 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:40:23.698461 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:40:23.698461 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:40:23.698461 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:40:23.698461 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:40:23.698461 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:40:23.698461 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 9cb0e3dfa123465892c5c3267439c8fc Aug 27 02:40:23.698461 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1838383586 Aug 27 02:40:23.698461 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,admin,member Aug 27 02:40:23.698461 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,admin,member Aug 27 02:40:23.699925 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9cb0e3dfa123465892c5c3267439c8fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_9cb0e3dfa123465892c5c3267439c8fc", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9cb0e3dfa123465892c5c3267439c8fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/9cb0e3dfa123465892c5c3267439c8fc"}]}] Aug 27 02:40:23.699925 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1838383586 Aug 27 02:40:23.699925 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 9cb0e3dfa123465892c5c3267439c8fc Aug 27 02:40:23.699925 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1838383586 Aug 27 02:40:23.699925 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-HostsAdminNegativeTestJSON-1838383586-project-admin Aug 27 02:40:23.699925 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:40:23.699925 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:40:23.699925 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 2379712218a8413ea3f1360a330eb669 Aug 27 02:40:23.699925 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1838383586-project-admin Aug 27 02:40:23.699925 n-d-852278-4 devstack@n-api.service[134051]: Aug 27 02:40:23.699925 n-d-852278-4 devstack@n-api.service[134051]: {"status": "enable", "maintenance_mode": "invalid"} Aug 27 02:40:23.699925 n-d-852278-4 devstack@n-api.service[134051]: method: Aug 27 02:40:23.699925 n-d-852278-4 devstack@n-api.service[134051]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 27 02:40:23.700824 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': 'n-d-852278-4', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Aug 27 02:40:23.700824 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:40:23.700824 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:23.700824 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 02:40:23.700824 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 02:40:23.700824 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 02:40:23.700824 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise error Aug 27 02:40:23.700824 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 27 02:40:23.700824 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:23.700824 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Aug 27 02:40:23.700824 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 27 02:40:23.700824 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi 'disable', Aug 27 02:40:23.700824 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi 'Enable', Aug 27 02:40:23.700824 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi 'Disable', Aug 27 02:40:23.700824 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 27 02:40:23.700824 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 27 02:40:23.700824 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 27 02:40:23.700824 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:23.700824 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi On instance: Aug 27 02:40:23.700824 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi 'invalid' Aug 27 02:40:23.700824 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:23.700824 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:23.700824 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:23.700824 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:23.700824 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:23.702403 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:23.702403 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:40:23.702403 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:40:23.702403 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:40:23.702403 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:40:23.702403 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:40:23.702403 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:40:23.702403 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 02:40:23.702403 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 02:40:23.702403 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 02:40:23.702403 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 02:40:23.702403 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 02:40:23.702403 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 02:40:23.702403 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 27 02:40:23.702403 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:23.702403 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:23.702403 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:23.702403 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:23.702403 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:23.703738 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:23.703738 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 02:40:23.703738 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 02:40:23.703738 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 27 02:40:23.703738 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:23.704208 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-393ec92e-55c5-42d4-ac63-3480157aa8f1 tempest-HostsAdminNegativeTestJSON-1838383586 tempest-HostsAdminNegativeTestJSON-1838383586-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:40:23.705214 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-393ec92e-55c5-42d4-ac63-3480157aa8f1 tempest-HostsAdminNegativeTestJSON-1838383586 tempest-HostsAdminNegativeTestJSON-1838383586-project-admin] 10.222.0.70 "PUT /compute/v2.1/os-hosts/n-d-852278-4" status: 400 len: 199 microversion: 2.1 time: 0.043613 Aug 27 02:40:23.705882 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 74/128] 10.222.0.70 () {60 vars in 1187 bytes} [Sat Aug 27 02:40:23 2022] PUT /compute/v2.1/os-hosts/n-d-852278-4 => generated 199 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 02:40:23.715855 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-2343ce2a-b9ca-40b3-8d39-50bfd8555213 tempest-HostsAdminNegativeTestJSON-1838383586 tempest-HostsAdminNegativeTestJSON-1838383586-project-admin] Action: 'update', calling method: .version_select at 0x7f5ee3dd0ee0>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:23.723916 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-2343ce2a-b9ca-40b3-8d39-50bfd8555213 tempest-HostsAdminNegativeTestJSON-1838383586 tempest-HostsAdminNegativeTestJSON-1838383586-project-admin] Request method failure captured: Aug 27 02:40:23.723916 n-d-852278-4 devstack@n-api.service[134052]: request: PUT /compute/v2.1/os-hosts/n-d-852278-4 HTTP/1.1 Aug 27 02:40:23.723916 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:40:23.723916 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:40:23.723916 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:40:23.723916 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 51 Aug 27 02:40:23.723916 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:40:23.723916 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:40:23.723916 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:40:23.723916 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:40:23.723916 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYQWfBjR5CIDSVnC4xQdb7zSv_GuzvX6kfFVLycPmmed0DkD9nNApINbS-T0DBbzlcV2uSSrs2A8WFLxSK3EomA6a71QGluOmdDibV2Q0YTYEXm1T3X8LeV-wmn19NTEeIJVn86LUnvhnkf0KQL3EvDElg4oeOqlGfZXWYw8JH1c1SU Aug 27 02:40:23.723916 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:40:23.723916 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:40:23.723916 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:40:23.723916 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:40:23.723916 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:40:23.723916 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:40:23.723916 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 9cb0e3dfa123465892c5c3267439c8fc Aug 27 02:40:23.723916 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1838383586 Aug 27 02:40:23.723916 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,admin,member Aug 27 02:40:23.723916 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,admin,member Aug 27 02:40:23.725206 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9cb0e3dfa123465892c5c3267439c8fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_9cb0e3dfa123465892c5c3267439c8fc", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9cb0e3dfa123465892c5c3267439c8fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/9cb0e3dfa123465892c5c3267439c8fc"}]}] Aug 27 02:40:23.725206 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1838383586 Aug 27 02:40:23.725206 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 9cb0e3dfa123465892c5c3267439c8fc Aug 27 02:40:23.725206 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1838383586 Aug 27 02:40:23.725206 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-HostsAdminNegativeTestJSON-1838383586-project-admin Aug 27 02:40:23.725206 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:40:23.725206 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:40:23.725206 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 2379712218a8413ea3f1360a330eb669 Aug 27 02:40:23.725206 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1838383586-project-admin Aug 27 02:40:23.725206 n-d-852278-4 devstack@n-api.service[134052]: Aug 27 02:40:23.725206 n-d-852278-4 devstack@n-api.service[134052]: {"status": "invalid", "maintenance_mode": "enable"} Aug 27 02:40:23.725206 n-d-852278-4 devstack@n-api.service[134052]: method: Aug 27 02:40:23.725206 n-d-852278-4 devstack@n-api.service[134052]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 27 02:40:23.726052 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': 'n-d-852278-4', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Aug 27 02:40:23.726052 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:40:23.726052 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:23.726052 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 02:40:23.726052 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 02:40:23.726052 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 02:40:23.726052 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise error Aug 27 02:40:23.726052 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 27 02:40:23.726052 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:23.726052 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Aug 27 02:40:23.726052 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 27 02:40:23.726052 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi 'disable', Aug 27 02:40:23.726052 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi 'Enable', Aug 27 02:40:23.726052 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi 'Disable', Aug 27 02:40:23.726052 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 27 02:40:23.726052 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 27 02:40:23.726052 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 27 02:40:23.726052 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:23.726052 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi On instance: Aug 27 02:40:23.726052 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi 'invalid' Aug 27 02:40:23.726052 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:23.726052 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:23.726052 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:23.726052 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:23.726052 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:23.729597 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:23.729597 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:40:23.729597 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:40:23.729597 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:40:23.729597 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:40:23.729597 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:40:23.729597 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:40:23.729597 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 02:40:23.729597 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 02:40:23.729597 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 02:40:23.729597 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 02:40:23.729597 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 02:40:23.729597 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 02:40:23.729597 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 27 02:40:23.729597 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:23.729597 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:23.729597 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:23.729597 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:23.729597 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:23.730634 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:23.730634 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 02:40:23.730634 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 02:40:23.730634 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 27 02:40:23.730634 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:23.730634 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-2343ce2a-b9ca-40b3-8d39-50bfd8555213 tempest-HostsAdminNegativeTestJSON-1838383586 tempest-HostsAdminNegativeTestJSON-1838383586-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:40:23.730634 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-2343ce2a-b9ca-40b3-8d39-50bfd8555213 tempest-HostsAdminNegativeTestJSON-1838383586 tempest-HostsAdminNegativeTestJSON-1838383586-project-admin] 10.222.0.70 "PUT /compute/v2.1/os-hosts/n-d-852278-4" status: 400 len: 189 microversion: 2.1 time: 0.014169 Aug 27 02:40:23.730634 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 55/129] 10.222.0.70 () {60 vars in 1187 bytes} [Sat Aug 27 02:40:23 2022] PUT /compute/v2.1/os-hosts/n-d-852278-4 => generated 189 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 02:40:23.738596 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-83d933db-e89b-4b5f-b350-b22d50f0c1ad tempest-HostsAdminNegativeTestJSON-1401394244 tempest-HostsAdminNegativeTestJSON-1401394244-project] Action: 'update', calling method: .version_select at 0x7f5edfe290d0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:23.742608 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-83d933db-e89b-4b5f-b350-b22d50f0c1ad tempest-HostsAdminNegativeTestJSON-1401394244 tempest-HostsAdminNegativeTestJSON-1401394244-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': 'b2edbeaadbcb4758b276ab12f0b7d287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e48d6726b74102ba2c98ca132292c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:23.744716 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-83d933db-e89b-4b5f-b350-b22d50f0c1ad tempest-HostsAdminNegativeTestJSON-1401394244 tempest-HostsAdminNegativeTestJSON-1401394244-project] Request method failure captured: Aug 27 02:40:23.744716 n-d-852278-4 devstack@n-api.service[134051]: request: PUT /compute/v2.1/os-hosts/n-d-852278-4 HTTP/1.1 Aug 27 02:40:23.744716 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:40:23.744716 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:40:23.744716 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:40:23.744716 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 50 Aug 27 02:40:23.744716 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:40:23.744716 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:40:23.744716 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:40:23.744716 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:40:23.744716 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYQVcdF1RT1iYDHxcnwxx6QDI48Tuuf95Roc_GJ-tnnKabMvZRcdzaFxmJaA2ObDHsyknK5SFbHcO64yb_Uf15byGNHP_3IXKZAgLi02BWnA1Jp3aqeQzTb_WlDc-i_giQ9Ry_A5R8tkuez7e_9VCznACs-Kj2K4Gvtgi0UTrI3hQL8 Aug 27 02:40:23.744716 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:40:23.744716 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:40:23.744716 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:40:23.744716 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:40:23.744716 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:40:23.744716 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:40:23.744716 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: d0e48d6726b74102ba2c98ca132292c2 Aug 27 02:40:23.744716 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1401394244 Aug 27 02:40:23.744716 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:40:23.744716 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:40:23.745879 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d0e48d6726b74102ba2c98ca132292c2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d0e48d6726b74102ba2c98ca132292c2", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d0e48d6726b74102ba2c98ca132292c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d0e48d6726b74102ba2c98ca132292c2"}]}] Aug 27 02:40:23.745879 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1401394244 Aug 27 02:40:23.745879 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: d0e48d6726b74102ba2c98ca132292c2 Aug 27 02:40:23.745879 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1401394244 Aug 27 02:40:23.745879 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-HostsAdminNegativeTestJSON-1401394244-project Aug 27 02:40:23.745879 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:40:23.745879 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:40:23.745879 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: b2edbeaadbcb4758b276ab12f0b7d287 Aug 27 02:40:23.745879 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1401394244-project Aug 27 02:40:23.745879 n-d-852278-4 devstack@n-api.service[134051]: Aug 27 02:40:23.745879 n-d-852278-4 devstack@n-api.service[134051]: {"status": "enable", "maintenance_mode": "enable"} Aug 27 02:40:23.745879 n-d-852278-4 devstack@n-api.service[134051]: method: Aug 27 02:40:23.745879 n-d-852278-4 devstack@n-api.service[134051]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 27 02:40:23.745879 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': 'n-d-852278-4', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Aug 27 02:40:23.746606 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:40:23.746606 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:23.746606 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:23.746606 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:23.746606 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:40:23.746606 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:40:23.746606 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:40:23.746606 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:40:23.746606 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:40:23.746606 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:40:23.746606 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:40:23.746606 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:40:23.746606 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Aug 27 02:40:23.746606 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Aug 27 02:40:23.746606 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 02:40:23.746606 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 02:40:23.746606 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 02:40:23.746606 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 02:40:23.746606 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 02:40:23.746606 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 02:40:23.747670 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 02:40:23.747670 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 02:40:23.747670 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 02:40:23.747670 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 02:40:23.747670 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 02:40:23.747670 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 02:40:23.747670 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 02:40:23.747670 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 02:40:23.747670 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 27 02:40:23.747670 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:23.747670 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:23.747670 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:23.747670 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:23.747670 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:23.747670 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:23.747670 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 02:40:23.747670 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 02:40:23.747670 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 27 02:40:23.747670 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:23.748696 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-83d933db-e89b-4b5f-b350-b22d50f0c1ad tempest-HostsAdminNegativeTestJSON-1401394244 tempest-HostsAdminNegativeTestJSON-1401394244-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:40:23.748696 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-83d933db-e89b-4b5f-b350-b22d50f0c1ad tempest-HostsAdminNegativeTestJSON-1401394244 tempest-HostsAdminNegativeTestJSON-1401394244-project] 10.222.0.70 "PUT /compute/v2.1/os-hosts/n-d-852278-4" status: 403 len: 111 microversion: 2.1 time: 0.013309 Aug 27 02:40:23.748696 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 75/130] 10.222.0.70 () {60 vars in 1187 bytes} [Sat Aug 27 02:40:23 2022] PUT /compute/v2.1/os-hosts/n-d-852278-4 => generated 111 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:40:23.756857 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-67f15afb-a568-447d-a9e4-e196f189825b tempest-HostsAdminNegativeTestJSON-1838383586 tempest-HostsAdminNegativeTestJSON-1838383586-project-admin] Action: 'update', calling method: .version_select at 0x7f5ee3bc39d0>, body: {"status": null, "maintenance_mode": null} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:23.763045 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-67f15afb-a568-447d-a9e4-e196f189825b tempest-HostsAdminNegativeTestJSON-1838383586 tempest-HostsAdminNegativeTestJSON-1838383586-project-admin] Request method failure captured: Aug 27 02:40:23.763045 n-d-852278-4 devstack@n-api.service[134052]: request: PUT /compute/v2.1/os-hosts/n-d-852278-4 HTTP/1.1 Aug 27 02:40:23.763045 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:40:23.763045 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:40:23.763045 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:40:23.763045 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 42 Aug 27 02:40:23.763045 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:40:23.763045 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:40:23.763045 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:40:23.763045 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:40:23.763045 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYQWfBjR5CIDSVnC4xQdb7zSv_GuzvX6kfFVLycPmmed0DkD9nNApINbS-T0DBbzlcV2uSSrs2A8WFLxSK3EomA6a71QGluOmdDibV2Q0YTYEXm1T3X8LeV-wmn19NTEeIJVn86LUnvhnkf0KQL3EvDElg4oeOqlGfZXWYw8JH1c1SU Aug 27 02:40:23.763045 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:40:23.763045 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:40:23.763045 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:40:23.763045 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:40:23.763045 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:40:23.763045 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:40:23.763045 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 9cb0e3dfa123465892c5c3267439c8fc Aug 27 02:40:23.763045 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1838383586 Aug 27 02:40:23.763045 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,admin,member Aug 27 02:40:23.763045 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,admin,member Aug 27 02:40:23.764411 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9cb0e3dfa123465892c5c3267439c8fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_9cb0e3dfa123465892c5c3267439c8fc", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9cb0e3dfa123465892c5c3267439c8fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/9cb0e3dfa123465892c5c3267439c8fc"}]}] Aug 27 02:40:23.764411 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1838383586 Aug 27 02:40:23.764411 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 9cb0e3dfa123465892c5c3267439c8fc Aug 27 02:40:23.764411 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1838383586 Aug 27 02:40:23.764411 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-HostsAdminNegativeTestJSON-1838383586-project-admin Aug 27 02:40:23.764411 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:40:23.764411 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:40:23.764411 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 2379712218a8413ea3f1360a330eb669 Aug 27 02:40:23.764411 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1838383586-project-admin Aug 27 02:40:23.764411 n-d-852278-4 devstack@n-api.service[134052]: Aug 27 02:40:23.764411 n-d-852278-4 devstack@n-api.service[134052]: {"status": null, "maintenance_mode": null} Aug 27 02:40:23.764411 n-d-852278-4 devstack@n-api.service[134052]: method: Aug 27 02:40:23.764411 n-d-852278-4 devstack@n-api.service[134052]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 27 02:40:23.764411 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': 'n-d-852278-4', 'body': {'status': None, 'maintenance_mode': None}} Aug 27 02:40:23.765145 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:40:23.765145 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:23.765145 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 02:40:23.765145 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 02:40:23.765145 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 02:40:23.765145 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise error Aug 27 02:40:23.765145 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Aug 27 02:40:23.765145 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:23.765145 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Aug 27 02:40:23.765145 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 27 02:40:23.765145 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi 'disable', Aug 27 02:40:23.765145 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi 'Enable', Aug 27 02:40:23.765145 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi 'Disable', Aug 27 02:40:23.765145 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 27 02:40:23.765145 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 27 02:40:23.765145 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 27 02:40:23.765145 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:23.765145 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi On instance: Aug 27 02:40:23.765145 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi None Aug 27 02:40:23.765145 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:23.765145 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:23.765145 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:23.765145 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:23.765145 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:23.765145 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:23.766450 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:40:23.766450 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:40:23.766450 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:40:23.766450 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:40:23.766450 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:40:23.766450 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:40:23.766450 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 02:40:23.766450 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 02:40:23.766450 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 02:40:23.766450 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 02:40:23.766450 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 02:40:23.766450 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 02:40:23.766450 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 27 02:40:23.766450 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:23.766450 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:23.766450 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:23.766450 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:23.766450 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:23.766450 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:23.768101 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 02:40:23.768101 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 02:40:23.768101 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 27 02:40:23.768101 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:23.768101 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-67f15afb-a568-447d-a9e4-e196f189825b tempest-HostsAdminNegativeTestJSON-1838383586 tempest-HostsAdminNegativeTestJSON-1838383586-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:40:23.768101 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-67f15afb-a568-447d-a9e4-e196f189825b tempest-HostsAdminNegativeTestJSON-1838383586 tempest-HostsAdminNegativeTestJSON-1838383586-project-admin] 10.222.0.70 "PUT /compute/v2.1/os-hosts/n-d-852278-4" status: 400 len: 127 microversion: 2.1 time: 0.012276 Aug 27 02:40:23.768101 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 56/131] 10.222.0.70 () {60 vars in 1187 bytes} [Sat Aug 27 02:40:23 2022] PUT /compute/v2.1/os-hosts/n-d-852278-4 => generated 127 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 02:40:23.777940 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-6108cd34-1046-44f6-a602-e610c8c90853 tempest-HostsAdminNegativeTestJSON-1838383586 tempest-HostsAdminNegativeTestJSON-1838383586-project-admin] Action: 'update', calling method: .version_select at 0x7f5edfbd6160>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:23.781189 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.hosts [None req-6108cd34-1046-44f6-a602-e610c8c90853 tempest-HostsAdminNegativeTestJSON-1838383586 tempest-HostsAdminNegativeTestJSON-1838383586-project-admin] Enabling host nonexistent_hostname. Aug 27 02:40:23.793246 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-6108cd34-1046-44f6-a602-e610c8c90853 tempest-HostsAdminNegativeTestJSON-1838383586 tempest-HostsAdminNegativeTestJSON-1838383586-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 02:40:23.799906 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-6108cd34-1046-44f6-a602-e610c8c90853 tempest-HostsAdminNegativeTestJSON-1838383586 tempest-HostsAdminNegativeTestJSON-1838383586-project-admin] Request method failure captured: Aug 27 02:40:23.799906 n-d-852278-4 devstack@n-api.service[134051]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Aug 27 02:40:23.799906 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:40:23.799906 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:40:23.799906 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:40:23.799906 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 50 Aug 27 02:40:23.799906 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:40:23.799906 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:40:23.799906 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:40:23.799906 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:40:23.799906 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYQWfBjR5CIDSVnC4xQdb7zSv_GuzvX6kfFVLycPmmed0DkD9nNApINbS-T0DBbzlcV2uSSrs2A8WFLxSK3EomA6a71QGluOmdDibV2Q0YTYEXm1T3X8LeV-wmn19NTEeIJVn86LUnvhnkf0KQL3EvDElg4oeOqlGfZXWYw8JH1c1SU Aug 27 02:40:23.799906 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:40:23.799906 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:40:23.799906 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:40:23.799906 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:40:23.799906 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:40:23.799906 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:40:23.799906 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 9cb0e3dfa123465892c5c3267439c8fc Aug 27 02:40:23.799906 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1838383586 Aug 27 02:40:23.799906 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,admin,member Aug 27 02:40:23.799906 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,admin,member Aug 27 02:40:23.801294 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9cb0e3dfa123465892c5c3267439c8fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_9cb0e3dfa123465892c5c3267439c8fc", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9cb0e3dfa123465892c5c3267439c8fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/9cb0e3dfa123465892c5c3267439c8fc"}]}] Aug 27 02:40:23.801294 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1838383586 Aug 27 02:40:23.801294 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 9cb0e3dfa123465892c5c3267439c8fc Aug 27 02:40:23.801294 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1838383586 Aug 27 02:40:23.801294 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-HostsAdminNegativeTestJSON-1838383586-project-admin Aug 27 02:40:23.801294 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:40:23.801294 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:40:23.801294 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 2379712218a8413ea3f1360a330eb669 Aug 27 02:40:23.801294 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1838383586-project-admin Aug 27 02:40:23.801294 n-d-852278-4 devstack@n-api.service[134051]: Aug 27 02:40:23.801294 n-d-852278-4 devstack@n-api.service[134051]: {"status": "enable", "maintenance_mode": "enable"} Aug 27 02:40:23.801294 n-d-852278-4 devstack@n-api.service[134051]: method: Aug 27 02:40:23.801294 n-d-852278-4 devstack@n-api.service[134051]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 02:40:23.801294 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Aug 27 02:40:23.802188 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:40:23.802188 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:23.802188 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Aug 27 02:40:23.802188 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Aug 27 02:40:23.802188 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 27 02:40:23.802188 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 27 02:40:23.802188 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 02:40:23.802188 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 02:40:23.802188 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 02:40:23.802188 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 02:40:23.802188 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 27 02:40:23.802188 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 27 02:40:23.802188 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5988, in targeted Aug 27 02:40:23.802188 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 27 02:40:23.802188 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 02:40:23.802188 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 02:40:23.802188 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 27 02:40:23.802188 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 27 02:40:23.803748 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 02:40:23.803748 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 02:40:23.803748 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 27 02:40:23.803748 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 27 02:40:23.803748 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 02:40:23.803748 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:23.803748 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:23.803748 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:23.803748 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:23.803748 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:23.803748 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:23.803748 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:40:23.803748 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:40:23.803748 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:40:23.803748 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:40:23.803748 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:40:23.803748 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:40:23.803748 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:40:23.803748 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:40:23.803748 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Aug 27 02:40:23.805117 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Aug 27 02:40:23.805117 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Aug 27 02:40:23.805117 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:40:23.805117 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 02:40:23.805117 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:23.805117 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:23.805117 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:23.805117 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:23.805117 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:23.805117 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:23.805117 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:40:23.805117 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:40:23.805117 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 02:40:23.805117 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:23.808333 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-6108cd34-1046-44f6-a602-e610c8c90853 tempest-HostsAdminNegativeTestJSON-1838383586 tempest-HostsAdminNegativeTestJSON-1838383586-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:40:23.808333 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-6108cd34-1046-44f6-a602-e610c8c90853 tempest-HostsAdminNegativeTestJSON-1838383586 tempest-HostsAdminNegativeTestJSON-1838383586-project-admin] 10.222.0.70 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.034749 Aug 27 02:40:23.809080 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 76/132] 10.222.0.70 () {60 vars in 1211 bytes} [Sat Aug 27 02:40:23 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 02:40:23.899186 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-f3fc4ccc-ea88-4e17-a949-4ad8cd46f6d8 req-c7e25d0b-7149-45e0-83de-97db07dbad09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e231e897-7343-415a-a4ff-dfe3df4fb62c", "tag": "f06c3585-fe39-4c4c-91e7-6abc3d16d4bb"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:23.908460 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-37e26f8f-e9f9-4297-8932-8314fee6fb8a tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:23.909518 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-37e26f8f-e9f9-4297-8932-8314fee6fb8a tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: 12acf567-09ef-4971-b085-8b5566fd1b79] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:23.930347 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-37e26f8f-e9f9-4297-8932-8314fee6fb8a tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:23.931045 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-37e26f8f-e9f9-4297-8932-8314fee6fb8a tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:23.931633 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-37e26f8f-e9f9-4297-8932-8314fee6fb8a tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:23.932930 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-37e26f8f-e9f9-4297-8932-8314fee6fb8a tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:23.933531 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-37e26f8f-e9f9-4297-8932-8314fee6fb8a tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:23.934097 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-37e26f8f-e9f9-4297-8932-8314fee6fb8a tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:23.936686 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-f3fc4ccc-ea88-4e17-a949-4ad8cd46f6d8 req-c7e25d0b-7149-45e0-83de-97db07dbad09 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:23.937381 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-f3fc4ccc-ea88-4e17-a949-4ad8cd46f6d8 req-c7e25d0b-7149-45e0-83de-97db07dbad09 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:23.940112 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-f3fc4ccc-ea88-4e17-a949-4ad8cd46f6d8 req-c7e25d0b-7149-45e0-83de-97db07dbad09 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:23.965087 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-f3fc4ccc-ea88-4e17-a949-4ad8cd46f6d8 req-c7e25d0b-7149-45e0-83de-97db07dbad09 service nova] Creating event network-changed:f06c3585-fe39-4c4c-91e7-6abc3d16d4bb for instance e231e897-7343-415a-a4ff-dfe3df4fb62c on n-h2-852278-4 Aug 27 02:40:23.977372 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-f3fc4ccc-ea88-4e17-a949-4ad8cd46f6d8 req-c7e25d0b-7149-45e0-83de-97db07dbad09 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085237 Aug 27 02:40:23.984297 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 57/133] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:40:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:40:23.998489 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-fe143bd6-e86d-42f3-ac67-f4f0a6619d37 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:23.999212 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-fe143bd6-e86d-42f3-ac67-f4f0a6619d37 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] [instance: b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:24.009387 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fe143bd6-e86d-42f3-ac67-f4f0a6619d37 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:24.009878 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fe143bd6-e86d-42f3-ac67-f4f0a6619d37 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:24.010320 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fe143bd6-e86d-42f3-ac67-f4f0a6619d37 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:24.015747 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fe143bd6-e86d-42f3-ac67-f4f0a6619d37 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:24.017771 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fe143bd6-e86d-42f3-ac67-f4f0a6619d37 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:24.022726 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fe143bd6-e86d-42f3-ac67-f4f0a6619d37 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:24.253245 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-37e26f8f-e9f9-4297-8932-8314fee6fb8a tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:24.266195 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-37e26f8f-e9f9-4297-8932-8314fee6fb8a tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:24.271792 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-37e26f8f-e9f9-4297-8932-8314fee6fb8a tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:24.273293 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-37e26f8f-e9f9-4297-8932-8314fee6fb8a tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/12acf567-09ef-4971-b085-8b5566fd1b79" status: 200 len: 1361 microversion: 2.25 time: 0.369579 Aug 27 02:40:24.277264 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 77/134] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:40:23 2022] GET /compute/v2.1/servers/12acf567-09ef-4971-b085-8b5566fd1b79 => generated 1361 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:40:24.308453 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-57676783-cd42-483f-b103-3ce4ded91356 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:24.309503 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-57676783-cd42-483f-b103-3ce4ded91356 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] [instance: e231e897-7343-415a-a4ff-dfe3df4fb62c] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:24.318659 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-57676783-cd42-483f-b103-3ce4ded91356 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:24.320731 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-57676783-cd42-483f-b103-3ce4ded91356 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:24.321414 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-57676783-cd42-483f-b103-3ce4ded91356 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:24.322359 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-57676783-cd42-483f-b103-3ce4ded91356 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:24.323024 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-57676783-cd42-483f-b103-3ce4ded91356 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:24.323646 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-57676783-cd42-483f-b103-3ce4ded91356 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:24.343118 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-fe143bd6-e86d-42f3-ac67-f4f0a6619d37 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5f4e86197e4175b223f20cacce792d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b427157c9f406da72d9b29af734987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:24.354268 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-fe143bd6-e86d-42f3-ac67-f4f0a6619d37 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] 10.222.0.70 "GET /compute/v2.1/servers/b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe" status: 200 len: 1338 microversion: 2.1 time: 0.365624 Aug 27 02:40:24.356466 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 58/135] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:23 2022] GET /compute/v2.1/servers/b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe => generated 1338 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:24.413238 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-38192133-13fb-482d-b037-293591d295d1 req-ec3ed773-2774-4845-9aa7-9a21fca38a1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "459d7a41-f50d-4ffe-a184-c0a12437669a", "name": "network-vif-plugged", "status": "completed", "tag": "44d32ad2-6a1e-4fa9-814e-6eea70c41884"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:24.429431 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-38192133-13fb-482d-b037-293591d295d1 req-ec3ed773-2774-4845-9aa7-9a21fca38a1a service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:24.430118 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-38192133-13fb-482d-b037-293591d295d1 req-ec3ed773-2774-4845-9aa7-9a21fca38a1a service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:24.430560 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-38192133-13fb-482d-b037-293591d295d1 req-ec3ed773-2774-4845-9aa7-9a21fca38a1a service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:24.445465 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-38192133-13fb-482d-b037-293591d295d1 req-ec3ed773-2774-4845-9aa7-9a21fca38a1a service nova] Creating event network-vif-plugged:44d32ad2-6a1e-4fa9-814e-6eea70c41884 for instance 459d7a41-f50d-4ffe-a184-c0a12437669a on n-h1-852278-4 Aug 27 02:40:24.452521 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-38192133-13fb-482d-b037-293591d295d1 req-ec3ed773-2774-4845-9aa7-9a21fca38a1a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046996 Aug 27 02:40:24.453829 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 59/136] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:40:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:40:24.475938 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-61304242-0d5d-4a8c-acb6-8a14711e20a9 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:24.477611 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-61304242-0d5d-4a8c-acb6-8a14711e20a9 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] [instance: 459d7a41-f50d-4ffe-a184-c0a12437669a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:24.486199 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-61304242-0d5d-4a8c-acb6-8a14711e20a9 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:24.486963 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-61304242-0d5d-4a8c-acb6-8a14711e20a9 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:24.487572 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-61304242-0d5d-4a8c-acb6-8a14711e20a9 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:24.488550 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-61304242-0d5d-4a8c-acb6-8a14711e20a9 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:24.489141 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-61304242-0d5d-4a8c-acb6-8a14711e20a9 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:24.489707 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-61304242-0d5d-4a8c-acb6-8a14711e20a9 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:24.542084 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-57676783-cd42-483f-b103-3ce4ded91356 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68711ff38ec41c0b051124527c7ac35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae179f416c451e92e270d2cb0f4400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:24.557361 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-57676783-cd42-483f-b103-3ce4ded91356 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] 10.222.0.70 "GET /compute/v2.1/servers/e231e897-7343-415a-a4ff-dfe3df4fb62c" status: 200 len: 1341 microversion: 2.1 time: 0.254008 Aug 27 02:40:24.559260 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 78/137] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:24 2022] GET /compute/v2.1/servers/e231e897-7343-415a-a4ff-dfe3df4fb62c => generated 1341 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:40:24.814574 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-61304242-0d5d-4a8c-acb6-8a14711e20a9 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772e2e66c92e44f8838ce325437d5a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b2f4a529a3e4ea0937ca903dd5924bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:24.827398 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-61304242-0d5d-4a8c-acb6-8a14711e20a9 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] 10.222.0.70 "GET /compute/v2.1/servers/459d7a41-f50d-4ffe-a184-c0a12437669a" status: 200 len: 1319 microversion: 2.1 time: 0.363253 Aug 27 02:40:24.831204 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 60/138] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:24 2022] GET /compute/v2.1/servers/459d7a41-f50d-4ffe-a184-c0a12437669a => generated 1319 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:40:25.296002 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-bc3c9f77-3462-4fd0-99c1-b79128876d6a tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:25.296654 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-bc3c9f77-3462-4fd0-99c1-b79128876d6a tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: 12acf567-09ef-4971-b085-8b5566fd1b79] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:25.311775 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bc3c9f77-3462-4fd0-99c1-b79128876d6a tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:25.313835 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bc3c9f77-3462-4fd0-99c1-b79128876d6a tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:25.314593 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bc3c9f77-3462-4fd0-99c1-b79128876d6a tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:25.315659 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bc3c9f77-3462-4fd0-99c1-b79128876d6a tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:25.316432 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bc3c9f77-3462-4fd0-99c1-b79128876d6a tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:25.317072 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bc3c9f77-3462-4fd0-99c1-b79128876d6a tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:25.378072 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0d51bb3f-81de-4257-b5f5-35360763cbba tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:25.378885 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-0d51bb3f-81de-4257-b5f5-35360763cbba tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] [instance: b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:25.386450 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0d51bb3f-81de-4257-b5f5-35360763cbba tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:25.387116 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0d51bb3f-81de-4257-b5f5-35360763cbba tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:25.391098 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0d51bb3f-81de-4257-b5f5-35360763cbba tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:25.393339 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0d51bb3f-81de-4257-b5f5-35360763cbba tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:25.394151 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0d51bb3f-81de-4257-b5f5-35360763cbba tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:25.395187 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0d51bb3f-81de-4257-b5f5-35360763cbba tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:25.401623 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=100 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:40:25.564493 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-bc3c9f77-3462-4fd0-99c1-b79128876d6a tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:25.577530 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-bc3c9f77-3462-4fd0-99c1-b79128876d6a tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:25.579372 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-bc3c9f77-3462-4fd0-99c1-b79128876d6a tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:25.580983 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-bc3c9f77-3462-4fd0-99c1-b79128876d6a tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/12acf567-09ef-4971-b085-8b5566fd1b79" status: 200 len: 1361 microversion: 2.25 time: 0.288939 Aug 27 02:40:25.582230 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 79/139] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:40:25 2022] GET /compute/v2.1/servers/12acf567-09ef-4971-b085-8b5566fd1b79 => generated 1361 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:40:25.592245 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d44a4faf-6a67-4b43-b7f0-cb0aee564853 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:25.594443 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d44a4faf-6a67-4b43-b7f0-cb0aee564853 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] [instance: e231e897-7343-415a-a4ff-dfe3df4fb62c] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:25.607903 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d44a4faf-6a67-4b43-b7f0-cb0aee564853 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:25.608552 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d44a4faf-6a67-4b43-b7f0-cb0aee564853 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:25.609448 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d44a4faf-6a67-4b43-b7f0-cb0aee564853 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:25.610610 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d44a4faf-6a67-4b43-b7f0-cb0aee564853 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:25.611788 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d44a4faf-6a67-4b43-b7f0-cb0aee564853 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:25.615878 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d44a4faf-6a67-4b43-b7f0-cb0aee564853 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:25.652698 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0d51bb3f-81de-4257-b5f5-35360763cbba tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5f4e86197e4175b223f20cacce792d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b427157c9f406da72d9b29af734987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:25.662327 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-0d51bb3f-81de-4257-b5f5-35360763cbba tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] 10.222.0.70 "GET /compute/v2.1/servers/b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe" status: 200 len: 1488 microversion: 2.1 time: 0.289633 Aug 27 02:40:25.669583 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 61/140] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:25 2022] GET /compute/v2.1/servers/b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe => generated 1488 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:40:25.694042 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-fa3a5084-51ff-4d59-a086-64f87aeb5bf9 tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:25.694655 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-fa3a5084-51ff-4d59-a086-64f87aeb5bf9 tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] [instance: b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:25.702197 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:40:25.704281 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fa3a5084-51ff-4d59-a086-64f87aeb5bf9 tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:25.704988 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fa3a5084-51ff-4d59-a086-64f87aeb5bf9 tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:25.705427 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fa3a5084-51ff-4d59-a086-64f87aeb5bf9 tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:25.706140 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fa3a5084-51ff-4d59-a086-64f87aeb5bf9 tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:25.709489 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fa3a5084-51ff-4d59-a086-64f87aeb5bf9 tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:25.709952 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fa3a5084-51ff-4d59-a086-64f87aeb5bf9 tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:25.956354 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d44a4faf-6a67-4b43-b7f0-cb0aee564853 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68711ff38ec41c0b051124527c7ac35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae179f416c451e92e270d2cb0f4400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:25.965571 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d44a4faf-6a67-4b43-b7f0-cb0aee564853 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] 10.222.0.70 "GET /compute/v2.1/servers/e231e897-7343-415a-a4ff-dfe3df4fb62c" status: 200 len: 1341 microversion: 2.1 time: 0.381711 Aug 27 02:40:25.966158 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 80/141] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:25 2022] GET /compute/v2.1/servers/e231e897-7343-415a-a4ff-dfe3df4fb62c => generated 1341 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:25.976518 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-51ba64df-fa86-477e-87de-36cecd3296d6 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:25.976518 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-51ba64df-fa86-477e-87de-36cecd3296d6 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] [instance: 459d7a41-f50d-4ffe-a184-c0a12437669a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:25.982706 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-51ba64df-fa86-477e-87de-36cecd3296d6 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:25.982706 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-51ba64df-fa86-477e-87de-36cecd3296d6 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:25.982706 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-51ba64df-fa86-477e-87de-36cecd3296d6 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:25.982706 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-51ba64df-fa86-477e-87de-36cecd3296d6 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:25.983103 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-51ba64df-fa86-477e-87de-36cecd3296d6 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:25.983103 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-51ba64df-fa86-477e-87de-36cecd3296d6 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:26.241793 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-51ba64df-fa86-477e-87de-36cecd3296d6 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772e2e66c92e44f8838ce325437d5a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b2f4a529a3e4ea0937ca903dd5924bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:26.254304 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-51ba64df-fa86-477e-87de-36cecd3296d6 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] 10.222.0.70 "GET /compute/v2.1/servers/459d7a41-f50d-4ffe-a184-c0a12437669a" status: 200 len: 1319 microversion: 2.1 time: 0.286693 Aug 27 02:40:26.270329 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 81/142] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:25 2022] GET /compute/v2.1/servers/459d7a41-f50d-4ffe-a184-c0a12437669a => generated 1319 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:26.314500 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-fa3a5084-51ff-4d59-a086-64f87aeb5bf9 tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe" status: 200 len: 1639 microversion: 2.1 time: 0.622484 Aug 27 02:40:26.316225 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 62/143] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:25 2022] GET /compute/v2.1/servers/b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe => generated 1639 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:26.335451 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-632b3d24-d662-4405-a89c-45514f46a6f9 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:26.335925 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-632b3d24-d662-4405-a89c-45514f46a6f9 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] [instance: b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:26.343094 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-632b3d24-d662-4405-a89c-45514f46a6f9 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:26.343802 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-632b3d24-d662-4405-a89c-45514f46a6f9 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:26.344662 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-632b3d24-d662-4405-a89c-45514f46a6f9 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:26.345820 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-632b3d24-d662-4405-a89c-45514f46a6f9 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:26.346515 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-632b3d24-d662-4405-a89c-45514f46a6f9 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:26.347149 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-632b3d24-d662-4405-a89c-45514f46a6f9 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:26.381420 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-632b3d24-d662-4405-a89c-45514f46a6f9 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] [instance: b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe] Going to try to terminate instance {{(pid=134051) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:40:26.575780 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-632b3d24-d662-4405-a89c-45514f46a6f9 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] 10.222.0.70 "DELETE /compute/v2.1/servers/b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe" status: 204 len: 0 microversion: 2.1 time: 0.243850 Aug 27 02:40:26.580498 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 82/144] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:40:26 2022] DELETE /compute/v2.1/servers/b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:40:26.588996 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-1cca85ee-38ca-4de0-9161-f8dbb4f10874 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:26.589830 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-1cca85ee-38ca-4de0-9161-f8dbb4f10874 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] [instance: b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:26.597844 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1cca85ee-38ca-4de0-9161-f8dbb4f10874 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:26.598019 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1cca85ee-38ca-4de0-9161-f8dbb4f10874 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:26.598350 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1cca85ee-38ca-4de0-9161-f8dbb4f10874 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:26.599705 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1cca85ee-38ca-4de0-9161-f8dbb4f10874 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:26.600268 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1cca85ee-38ca-4de0-9161-f8dbb4f10874 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:26.600897 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1cca85ee-38ca-4de0-9161-f8dbb4f10874 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:26.607809 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-1d7171f4-b616-404c-9c22-8bce4d6dcfcb tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:26.609053 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-1d7171f4-b616-404c-9c22-8bce4d6dcfcb tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: 12acf567-09ef-4971-b085-8b5566fd1b79] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:26.617035 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1d7171f4-b616-404c-9c22-8bce4d6dcfcb tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:26.617677 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1d7171f4-b616-404c-9c22-8bce4d6dcfcb tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:26.618120 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1d7171f4-b616-404c-9c22-8bce4d6dcfcb tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:26.621905 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1d7171f4-b616-404c-9c22-8bce4d6dcfcb tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:26.622400 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1d7171f4-b616-404c-9c22-8bce4d6dcfcb tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:26.622913 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1d7171f4-b616-404c-9c22-8bce4d6dcfcb tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:26.718527 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=4 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:40:26.949414 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-1cca85ee-38ca-4de0-9161-f8dbb4f10874 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5f4e86197e4175b223f20cacce792d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b427157c9f406da72d9b29af734987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:26.958887 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=16 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:40:26.961694 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-1cca85ee-38ca-4de0-9161-f8dbb4f10874 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] 10.222.0.70 "GET /compute/v2.1/servers/b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe" status: 200 len: 1494 microversion: 2.1 time: 0.379391 Aug 27 02:40:26.962274 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 63/145] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:26 2022] GET /compute/v2.1/servers/b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe => generated 1494 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:26.984478 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-1d7171f4-b616-404c-9c22-8bce4d6dcfcb tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:26.991854 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4353450b-7075-4f99-8a4d-54c5e4ea26e8 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:26.992743 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-4353450b-7075-4f99-8a4d-54c5e4ea26e8 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] [instance: e231e897-7343-415a-a4ff-dfe3df4fb62c] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:26.998203 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-1d7171f4-b616-404c-9c22-8bce4d6dcfcb tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:27.003989 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4353450b-7075-4f99-8a4d-54c5e4ea26e8 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:27.004258 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-1d7171f4-b616-404c-9c22-8bce4d6dcfcb tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:27.004725 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4353450b-7075-4f99-8a4d-54c5e4ea26e8 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:27.004930 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4353450b-7075-4f99-8a4d-54c5e4ea26e8 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:27.005634 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4353450b-7075-4f99-8a4d-54c5e4ea26e8 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:27.006069 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4353450b-7075-4f99-8a4d-54c5e4ea26e8 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:27.006603 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4353450b-7075-4f99-8a4d-54c5e4ea26e8 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:27.008133 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-1d7171f4-b616-404c-9c22-8bce4d6dcfcb tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/12acf567-09ef-4971-b085-8b5566fd1b79" status: 200 len: 1361 microversion: 2.25 time: 0.407836 Aug 27 02:40:27.010492 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 83/146] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:40:26 2022] GET /compute/v2.1/servers/12acf567-09ef-4971-b085-8b5566fd1b79 => generated 1361 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:40:27.339251 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-4353450b-7075-4f99-8a4d-54c5e4ea26e8 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68711ff38ec41c0b051124527c7ac35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae179f416c451e92e270d2cb0f4400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:27.348021 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-4353450b-7075-4f99-8a4d-54c5e4ea26e8 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] 10.222.0.70 "GET /compute/v2.1/servers/e231e897-7343-415a-a4ff-dfe3df4fb62c" status: 200 len: 1341 microversion: 2.1 time: 0.360542 Aug 27 02:40:27.349960 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 64/147] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:26 2022] GET /compute/v2.1/servers/e231e897-7343-415a-a4ff-dfe3df4fb62c => generated 1341 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:27.355468 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a04d68b1-a552-40de-86d8-3107faf4e694 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:27.356325 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a04d68b1-a552-40de-86d8-3107faf4e694 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] [instance: 459d7a41-f50d-4ffe-a184-c0a12437669a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:27.363191 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a04d68b1-a552-40de-86d8-3107faf4e694 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:27.363671 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a04d68b1-a552-40de-86d8-3107faf4e694 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:27.364101 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a04d68b1-a552-40de-86d8-3107faf4e694 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:27.364863 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a04d68b1-a552-40de-86d8-3107faf4e694 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:27.365306 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a04d68b1-a552-40de-86d8-3107faf4e694 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:27.365718 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a04d68b1-a552-40de-86d8-3107faf4e694 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:27.465491 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a739d021-9ca7-4df6-994f-243e58743502 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:27.475343 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a739d021-9ca7-4df6-994f-243e58743502 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] 10.222.0.70 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.260328 Aug 27 02:40:27.475928 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 84/148] 10.222.0.70 () {58 vars in 1137 bytes} [Sat Aug 27 02:40:27 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:40:27.519638 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-a04d68b1-a552-40de-86d8-3107faf4e694 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772e2e66c92e44f8838ce325437d5a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b2f4a529a3e4ea0937ca903dd5924bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:27.529003 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a04d68b1-a552-40de-86d8-3107faf4e694 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] 10.222.0.70 "GET /compute/v2.1/servers/459d7a41-f50d-4ffe-a184-c0a12437669a" status: 200 len: 1468 microversion: 2.1 time: 0.177889 Aug 27 02:40:27.529993 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 65/149] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:27 2022] GET /compute/v2.1/servers/459d7a41-f50d-4ffe-a184-c0a12437669a => generated 1468 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:27.702460 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-40548c21-17fa-4934-8d03-5e924f66492e tempest-ServersWithSpecificFlavorTestJSON-168055090 tempest-ServersWithSpecificFlavorTestJSON-168055090-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-152046830", "id": 185355050, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:27.724164 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-40548c21-17fa-4934-8d03-5e924f66492e tempest-ServersWithSpecificFlavorTestJSON-168055090 tempest-ServersWithSpecificFlavorTestJSON-168055090-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 421 microversion: 2.1 time: 0.238102 Aug 27 02:40:27.725129 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 85/150] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 02:40:27 2022] POST /compute/v2.1/flavors => generated 421 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:40:27.733663 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6c140290-9205-4d28-8d16-d6a554e172b5 tempest-DeleteServersAdminTestJSON-1271703002 tempest-DeleteServersAdminTestJSON-1271703002-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:27.734272 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-6c140290-9205-4d28-8d16-d6a554e172b5 tempest-DeleteServersAdminTestJSON-1271703002 tempest-DeleteServersAdminTestJSON-1271703002-project-admin] [instance: 459d7a41-f50d-4ffe-a184-c0a12437669a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:27.741127 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-33b71dc2-230c-4d22-b8a8-7411c0df6a6e tempest-ServersWithSpecificFlavorTestJSON-168055090 tempest-ServersWithSpecificFlavorTestJSON-168055090-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:27.749125 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6c140290-9205-4d28-8d16-d6a554e172b5 tempest-DeleteServersAdminTestJSON-1271703002 tempest-DeleteServersAdminTestJSON-1271703002-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:27.749606 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6c140290-9205-4d28-8d16-d6a554e172b5 tempest-DeleteServersAdminTestJSON-1271703002 tempest-DeleteServersAdminTestJSON-1271703002-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:27.750194 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6c140290-9205-4d28-8d16-d6a554e172b5 tempest-DeleteServersAdminTestJSON-1271703002 tempest-DeleteServersAdminTestJSON-1271703002-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:27.751350 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6c140290-9205-4d28-8d16-d6a554e172b5 tempest-DeleteServersAdminTestJSON-1271703002 tempest-DeleteServersAdminTestJSON-1271703002-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:27.751947 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6c140290-9205-4d28-8d16-d6a554e172b5 tempest-DeleteServersAdminTestJSON-1271703002 tempest-DeleteServersAdminTestJSON-1271703002-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:27.752726 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6c140290-9205-4d28-8d16-d6a554e172b5 tempest-DeleteServersAdminTestJSON-1271703002 tempest-DeleteServersAdminTestJSON-1271703002-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:27.764901 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-33b71dc2-230c-4d22-b8a8-7411c0df6a6e tempest-ServersWithSpecificFlavorTestJSON-168055090 tempest-ServersWithSpecificFlavorTestJSON-168055090-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.026821 Aug 27 02:40:27.770173 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 86/151] 10.222.0.70 () {58 vars in 1182 bytes} [Sat Aug 27 02:40:27 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:40:27.776211 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-41f0a068-34e6-411b-824f-b0bfcc6f7c04 tempest-ServersWithSpecificFlavorTestJSON-168055090 tempest-ServersWithSpecificFlavorTestJSON-168055090-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-1517092327", "id": 131754674, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:27.790737 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-6c140290-9205-4d28-8d16-d6a554e172b5 tempest-DeleteServersAdminTestJSON-1271703002 tempest-DeleteServersAdminTestJSON-1271703002-project-admin] [instance: 459d7a41-f50d-4ffe-a184-c0a12437669a] Going to try to terminate instance {{(pid=134052) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:40:27.799787 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-41f0a068-34e6-411b-824f-b0bfcc6f7c04 tempest-ServersWithSpecificFlavorTestJSON-168055090 tempest-ServersWithSpecificFlavorTestJSON-168055090-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 422 microversion: 2.1 time: 0.028299 Aug 27 02:40:27.800756 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 87/152] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 02:40:27 2022] POST /compute/v2.1/flavors => generated 422 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:40:27.812503 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ba812c03-a283-4ca5-b319-4ba2be518abf tempest-ServersWithSpecificFlavorTestJSON-168055090 tempest-ServersWithSpecificFlavorTestJSON-168055090-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:27.823443 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ba812c03-a283-4ca5-b319-4ba2be518abf tempest-ServersWithSpecificFlavorTestJSON-168055090 tempest-ServersWithSpecificFlavorTestJSON-168055090-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.015087 Aug 27 02:40:27.825081 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 88/153] 10.222.0.70 () {58 vars in 1182 bytes} [Sat Aug 27 02:40:27 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:40:27.839466 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-95a2c29a-c907-4f9e-b6d1-a9d0bbac6f43 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Action: 'create', calling method: .version_select at 0x7f5edfd73a60>, body: {"keypair": {"name": "tempest-keypair-1094053635", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMCQWBttScoOeW+aO+lKScKQ8SdmN/zHlawzaU7WUAANVesgpHV5aNhOrhWbQDq5FFdn1KBzkpSTbAxQ5FGwk6uC3OLcpyshi/5cMmB1UnVivQf1L+bQUwA7e75ayGtViQ=="}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:27.870623 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-95a2c29a-c907-4f9e-b6d1-a9d0bbac6f43 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Getting quotas for project 72992d9dba564526b223533398a94dea. Resources: {'key_pairs'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:40:27.878136 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-95a2c29a-c907-4f9e-b6d1-a9d0bbac6f43 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Getting quotas for user c4c850104e6d430397bb54d0e3730a73 and project 72992d9dba564526b223533398a94dea. Resources: {'key_pairs'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:40:27.881048 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:40:27.912590 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-95a2c29a-c907-4f9e-b6d1-a9d0bbac6f43 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.077275 Aug 27 02:40:27.913313 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 89/154] 10.222.0.70 () {60 vars in 1159 bytes} [Sat Aug 27 02:40:27 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:40:27.962530 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-6c140290-9205-4d28-8d16-d6a554e172b5 tempest-DeleteServersAdminTestJSON-1271703002 tempest-DeleteServersAdminTestJSON-1271703002-project-admin] 10.222.0.70 "DELETE /compute/v2.1/servers/459d7a41-f50d-4ffe-a184-c0a12437669a" status: 204 len: 0 microversion: 2.1 time: 0.412826 Aug 27 02:40:27.963367 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 66/155] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:40:27 2022] DELETE /compute/v2.1/servers/459d7a41-f50d-4ffe-a184-c0a12437669a => generated 0 bytes in 415 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 02:40:27.973250 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-83ed5435-9804-4d0d-9e89-e278fe8966e9 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:27.974068 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-83ed5435-9804-4d0d-9e89-e278fe8966e9 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] [instance: 459d7a41-f50d-4ffe-a184-c0a12437669a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:27.981143 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-83ed5435-9804-4d0d-9e89-e278fe8966e9 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:27.981808 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-83ed5435-9804-4d0d-9e89-e278fe8966e9 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:27.982395 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-83ed5435-9804-4d0d-9e89-e278fe8966e9 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:27.983226 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-83ed5435-9804-4d0d-9e89-e278fe8966e9 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:27.983788 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-83ed5435-9804-4d0d-9e89-e278fe8966e9 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:27.984393 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-83ed5435-9804-4d0d-9e89-e278fe8966e9 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:27.994399 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b8c2555c-77d7-490e-88b2-c74bbd7cec4a tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:27.995485 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b8c2555c-77d7-490e-88b2-c74bbd7cec4a tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] [instance: b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:28.003880 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b8c2555c-77d7-490e-88b2-c74bbd7cec4a tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:28.004767 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b8c2555c-77d7-490e-88b2-c74bbd7cec4a tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:28.005599 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b8c2555c-77d7-490e-88b2-c74bbd7cec4a tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:28.007436 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b8c2555c-77d7-490e-88b2-c74bbd7cec4a tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:28.009449 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b8c2555c-77d7-490e-88b2-c74bbd7cec4a tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:28.010707 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b8c2555c-77d7-490e-88b2-c74bbd7cec4a tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:28.350126 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b8c2555c-77d7-490e-88b2-c74bbd7cec4a tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5f4e86197e4175b223f20cacce792d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b427157c9f406da72d9b29af734987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:28.358834 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b8c2555c-77d7-490e-88b2-c74bbd7cec4a tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] 10.222.0.70 "GET /compute/v2.1/servers/b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe" status: 200 len: 1494 microversion: 2.1 time: 0.380763 Aug 27 02:40:28.374285 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 67/156] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:27 2022] GET /compute/v2.1/servers/b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe => generated 1494 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:28.380718 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-716f02a5-8869-445c-a9eb-d4a7dfaf2c9c tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:28.381666 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-716f02a5-8869-445c-a9eb-d4a7dfaf2c9c tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: 12acf567-09ef-4971-b085-8b5566fd1b79] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:28.388169 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-716f02a5-8869-445c-a9eb-d4a7dfaf2c9c tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:28.388677 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-716f02a5-8869-445c-a9eb-d4a7dfaf2c9c tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:28.389107 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-716f02a5-8869-445c-a9eb-d4a7dfaf2c9c tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:28.389801 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-716f02a5-8869-445c-a9eb-d4a7dfaf2c9c tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:28.390244 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-716f02a5-8869-445c-a9eb-d4a7dfaf2c9c tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:28.390656 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-716f02a5-8869-445c-a9eb-d4a7dfaf2c9c tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:28.423731 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-83ed5435-9804-4d0d-9e89-e278fe8966e9 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772e2e66c92e44f8838ce325437d5a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b2f4a529a3e4ea0937ca903dd5924bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:28.441083 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-83ed5435-9804-4d0d-9e89-e278fe8966e9 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] 10.222.0.70 "GET /compute/v2.1/servers/459d7a41-f50d-4ffe-a184-c0a12437669a" status: 200 len: 1474 microversion: 2.1 time: 0.473092 Aug 27 02:40:28.441890 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 90/157] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:27 2022] GET /compute/v2.1/servers/459d7a41-f50d-4ffe-a184-c0a12437669a => generated 1474 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:28.446058 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-ebf3f134-ecac-4dfe-92ee-34cf5ae6a581 req-ddca6685-2d4a-4c73-9ca2-6484506e30fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12acf567-09ef-4971-b085-8b5566fd1b79", "name": "network-vif-plugged", "status": "completed", "tag": "44ed9f75-528d-4d72-891d-705dbadec7a2"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:28.460294 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-ebf3f134-ecac-4dfe-92ee-34cf5ae6a581 req-ddca6685-2d4a-4c73-9ca2-6484506e30fa service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:28.460991 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-ebf3f134-ecac-4dfe-92ee-34cf5ae6a581 req-ddca6685-2d4a-4c73-9ca2-6484506e30fa service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:28.461575 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-ebf3f134-ecac-4dfe-92ee-34cf5ae6a581 req-ddca6685-2d4a-4c73-9ca2-6484506e30fa service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:28.477300 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-ebf3f134-ecac-4dfe-92ee-34cf5ae6a581 req-ddca6685-2d4a-4c73-9ca2-6484506e30fa service nova] Creating event network-vif-plugged:44ed9f75-528d-4d72-891d-705dbadec7a2 for instance 12acf567-09ef-4971-b085-8b5566fd1b79 on n-h1-852278-4 Aug 27 02:40:28.482615 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-ebf3f134-ecac-4dfe-92ee-34cf5ae6a581 req-ddca6685-2d4a-4c73-9ca2-6484506e30fa service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039810 Aug 27 02:40:28.483204 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 91/158] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:40:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:40:28.490045 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-752e78d0-9467-4d50-967f-babb4dd0efa8 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:28.490917 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-752e78d0-9467-4d50-967f-babb4dd0efa8 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] [instance: e231e897-7343-415a-a4ff-dfe3df4fb62c] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:28.497632 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-752e78d0-9467-4d50-967f-babb4dd0efa8 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:28.498446 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-752e78d0-9467-4d50-967f-babb4dd0efa8 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:28.499018 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-752e78d0-9467-4d50-967f-babb4dd0efa8 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:28.499892 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-752e78d0-9467-4d50-967f-babb4dd0efa8 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:28.500532 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-752e78d0-9467-4d50-967f-babb4dd0efa8 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:28.501119 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-752e78d0-9467-4d50-967f-babb4dd0efa8 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:28.538232 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-716f02a5-8869-445c-a9eb-d4a7dfaf2c9c tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:28.548748 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-716f02a5-8869-445c-a9eb-d4a7dfaf2c9c tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:28.550560 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-716f02a5-8869-445c-a9eb-d4a7dfaf2c9c tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:28.551890 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-716f02a5-8869-445c-a9eb-d4a7dfaf2c9c tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/12acf567-09ef-4971-b085-8b5566fd1b79" status: 200 len: 1361 microversion: 2.25 time: 0.175994 Aug 27 02:40:28.568780 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 68/159] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:40:28 2022] GET /compute/v2.1/servers/12acf567-09ef-4971-b085-8b5566fd1b79 => generated 1361 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:40:28.675805 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-752e78d0-9467-4d50-967f-babb4dd0efa8 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68711ff38ec41c0b051124527c7ac35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae179f416c451e92e270d2cb0f4400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:28.687811 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-752e78d0-9467-4d50-967f-babb4dd0efa8 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] 10.222.0.70 "GET /compute/v2.1/servers/e231e897-7343-415a-a4ff-dfe3df4fb62c" status: 200 len: 1341 microversion: 2.1 time: 0.203058 Aug 27 02:40:28.689424 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 92/160] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:28 2022] GET /compute/v2.1/servers/e231e897-7343-415a-a4ff-dfe3df4fb62c => generated 1341 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:28.736303 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a625d65a-0efd-4f4b-b23c-7de97ae99759 tempest-HypervisorAdminV253TestBase-239581519 tempest-HypervisorAdminV253TestBase-239581519-project-admin] Calling method '.version_select at 0x7f5ee3e9d550>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:28.745358 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a625d65a-0efd-4f4b-b23c-7de97ae99759 tempest-HypervisorAdminV253TestBase-239581519 tempest-HypervisorAdminV253TestBase-239581519-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:28.746109 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a625d65a-0efd-4f4b-b23c-7de97ae99759 tempest-HypervisorAdminV253TestBase-239581519 tempest-HypervisorAdminV253TestBase-239581519-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:28.749190 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a625d65a-0efd-4f4b-b23c-7de97ae99759 tempest-HypervisorAdminV253TestBase-239581519 tempest-HypervisorAdminV253TestBase-239581519-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:28.786259 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a625d65a-0efd-4f4b-b23c-7de97ae99759 tempest-HypervisorAdminV253TestBase-239581519 tempest-HypervisorAdminV253TestBase-239581519-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:28.786748 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a625d65a-0efd-4f4b-b23c-7de97ae99759 tempest-HypervisorAdminV253TestBase-239581519 tempest-HypervisorAdminV253TestBase-239581519-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:28.787187 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a625d65a-0efd-4f4b-b23c-7de97ae99759 tempest-HypervisorAdminV253TestBase-239581519 tempest-HypervisorAdminV253TestBase-239581519-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:28.825015 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a625d65a-0efd-4f4b-b23c-7de97ae99759 tempest-HypervisorAdminV253TestBase-239581519 tempest-HypervisorAdminV253TestBase-239581519-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:28.825499 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a625d65a-0efd-4f4b-b23c-7de97ae99759 tempest-HypervisorAdminV253TestBase-239581519 tempest-HypervisorAdminV253TestBase-239581519-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:28.825947 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a625d65a-0efd-4f4b-b23c-7de97ae99759 tempest-HypervisorAdminV253TestBase-239581519 tempest-HypervisorAdminV253TestBase-239581519-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:28.837336 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a625d65a-0efd-4f4b-b23c-7de97ae99759 tempest-HypervisorAdminV253TestBase-239581519 tempest-HypervisorAdminV253TestBase-239581519-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:28.838161 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a625d65a-0efd-4f4b-b23c-7de97ae99759 tempest-HypervisorAdminV253TestBase-239581519 tempest-HypervisorAdminV253TestBase-239581519-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:28.838965 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a625d65a-0efd-4f4b-b23c-7de97ae99759 tempest-HypervisorAdminV253TestBase-239581519 tempest-HypervisorAdminV253TestBase-239581519-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:28.861996 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a625d65a-0efd-4f4b-b23c-7de97ae99759 tempest-HypervisorAdminV253TestBase-239581519 tempest-HypervisorAdminV253TestBase-239581519-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:28.862677 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a625d65a-0efd-4f4b-b23c-7de97ae99759 tempest-HypervisorAdminV253TestBase-239581519 tempest-HypervisorAdminV253TestBase-239581519-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:28.863112 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a625d65a-0efd-4f4b-b23c-7de97ae99759 tempest-HypervisorAdminV253TestBase-239581519 tempest-HypervisorAdminV253TestBase-239581519-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:28.870170 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a625d65a-0efd-4f4b-b23c-7de97ae99759 tempest-HypervisorAdminV253TestBase-239581519 tempest-HypervisorAdminV253TestBase-239581519-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1915 microversion: 2.53 time: 0.299901 Aug 27 02:40:28.870973 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 69/161] 10.222.0.70 () {60 vars in 1243 bytes} [Sat Aug 27 02:40:28 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1915 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:40:28.887283 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-2f8171f6-c209-4000-9f6e-d0c7c5ff8600 tempest-HypervisorAdminV253TestBase-239581519 tempest-HypervisorAdminV253TestBase-239581519-project-admin] Calling method '.version_select at 0x7f5edfc705e0>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:28.890992 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2f8171f6-c209-4000-9f6e-d0c7c5ff8600 tempest-HypervisorAdminV253TestBase-239581519 tempest-HypervisorAdminV253TestBase-239581519-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:28.891516 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2f8171f6-c209-4000-9f6e-d0c7c5ff8600 tempest-HypervisorAdminV253TestBase-239581519 tempest-HypervisorAdminV253TestBase-239581519-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:28.891947 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2f8171f6-c209-4000-9f6e-d0c7c5ff8600 tempest-HypervisorAdminV253TestBase-239581519 tempest-HypervisorAdminV253TestBase-239581519-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:28.909704 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2f8171f6-c209-4000-9f6e-d0c7c5ff8600 tempest-HypervisorAdminV253TestBase-239581519 tempest-HypervisorAdminV253TestBase-239581519-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:28.910242 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2f8171f6-c209-4000-9f6e-d0c7c5ff8600 tempest-HypervisorAdminV253TestBase-239581519 tempest-HypervisorAdminV253TestBase-239581519-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:28.910676 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2f8171f6-c209-4000-9f6e-d0c7c5ff8600 tempest-HypervisorAdminV253TestBase-239581519 tempest-HypervisorAdminV253TestBase-239581519-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:28.949230 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2f8171f6-c209-4000-9f6e-d0c7c5ff8600 tempest-HypervisorAdminV253TestBase-239581519 tempest-HypervisorAdminV253TestBase-239581519-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:28.950437 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2f8171f6-c209-4000-9f6e-d0c7c5ff8600 tempest-HypervisorAdminV253TestBase-239581519 tempest-HypervisorAdminV253TestBase-239581519-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:28.950904 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2f8171f6-c209-4000-9f6e-d0c7c5ff8600 tempest-HypervisorAdminV253TestBase-239581519 tempest-HypervisorAdminV253TestBase-239581519-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:28.964214 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2f8171f6-c209-4000-9f6e-d0c7c5ff8600 tempest-HypervisorAdminV253TestBase-239581519 tempest-HypervisorAdminV253TestBase-239581519-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:28.964758 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2f8171f6-c209-4000-9f6e-d0c7c5ff8600 tempest-HypervisorAdminV253TestBase-239581519 tempest-HypervisorAdminV253TestBase-239581519-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:28.965201 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2f8171f6-c209-4000-9f6e-d0c7c5ff8600 tempest-HypervisorAdminV253TestBase-239581519 tempest-HypervisorAdminV253TestBase-239581519-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:28.993265 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2f8171f6-c209-4000-9f6e-d0c7c5ff8600 tempest-HypervisorAdminV253TestBase-239581519 tempest-HypervisorAdminV253TestBase-239581519-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:28.993668 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2f8171f6-c209-4000-9f6e-d0c7c5ff8600 tempest-HypervisorAdminV253TestBase-239581519 tempest-HypervisorAdminV253TestBase-239581519-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:28.994098 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2f8171f6-c209-4000-9f6e-d0c7c5ff8600 tempest-HypervisorAdminV253TestBase-239581519 tempest-HypervisorAdminV253TestBase-239581519-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:29.000413 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-2f8171f6-c209-4000-9f6e-d0c7c5ff8600 tempest-HypervisorAdminV253TestBase-239581519 tempest-HypervisorAdminV253TestBase-239581519-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 607 microversion: 2.53 time: 0.116870 Aug 27 02:40:29.001286 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 93/162] 10.222.0.70 () {60 vars in 1222 bytes} [Sat Aug 27 02:40:28 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 607 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:40:29.013201 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-7bfb457d-75d6-4522-ba0d-8506858549d0 tempest-HypervisorAdminV253TestBase-239581519 tempest-HypervisorAdminV253TestBase-239581519-project-admin] Calling method '.version_select at 0x7f5ee3b15550>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:29.017004 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7bfb457d-75d6-4522-ba0d-8506858549d0 tempest-HypervisorAdminV253TestBase-239581519 tempest-HypervisorAdminV253TestBase-239581519-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:29.017604 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7bfb457d-75d6-4522-ba0d-8506858549d0 tempest-HypervisorAdminV253TestBase-239581519 tempest-HypervisorAdminV253TestBase-239581519-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:29.018213 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7bfb457d-75d6-4522-ba0d-8506858549d0 tempest-HypervisorAdminV253TestBase-239581519 tempest-HypervisorAdminV253TestBase-239581519-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:29.037694 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7bfb457d-75d6-4522-ba0d-8506858549d0 tempest-HypervisorAdminV253TestBase-239581519 tempest-HypervisorAdminV253TestBase-239581519-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:29.038322 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7bfb457d-75d6-4522-ba0d-8506858549d0 tempest-HypervisorAdminV253TestBase-239581519 tempest-HypervisorAdminV253TestBase-239581519-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:29.038758 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7bfb457d-75d6-4522-ba0d-8506858549d0 tempest-HypervisorAdminV253TestBase-239581519 tempest-HypervisorAdminV253TestBase-239581519-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:29.059400 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-7bfb457d-75d6-4522-ba0d-8506858549d0 tempest-HypervisorAdminV253TestBase-239581519 tempest-HypervisorAdminV253TestBase-239581519-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors/2adeb535-c4fe-4059-8eb3-6131ec95ecf7" status: 200 len: 792 microversion: 2.53 time: 0.049892 Aug 27 02:40:29.060045 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 70/163] 10.222.0.70 () {60 vars in 1298 bytes} [Sat Aug 27 02:40:29 2022] GET /compute/v2.1/os-hypervisors/2adeb535-c4fe-4059-8eb3-6131ec95ecf7 => generated 792 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 02:40:29.383139 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-536eb7ce-3710-4f23-9068-c7695b51fd28 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:29.383965 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-536eb7ce-3710-4f23-9068-c7695b51fd28 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] [instance: b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:29.393974 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-536eb7ce-3710-4f23-9068-c7695b51fd28 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:29.394596 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-536eb7ce-3710-4f23-9068-c7695b51fd28 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:29.395116 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-536eb7ce-3710-4f23-9068-c7695b51fd28 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:29.395905 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-536eb7ce-3710-4f23-9068-c7695b51fd28 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:29.396428 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-536eb7ce-3710-4f23-9068-c7695b51fd28 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:29.396849 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-536eb7ce-3710-4f23-9068-c7695b51fd28 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:29.461994 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f06ca138-ead6-4fb0-a2a1-9cab95b67c13 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:29.463207 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-f06ca138-ead6-4fb0-a2a1-9cab95b67c13 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] [instance: 459d7a41-f50d-4ffe-a184-c0a12437669a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:29.472554 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f06ca138-ead6-4fb0-a2a1-9cab95b67c13 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:29.473041 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f06ca138-ead6-4fb0-a2a1-9cab95b67c13 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:29.474344 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f06ca138-ead6-4fb0-a2a1-9cab95b67c13 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:29.476966 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f06ca138-ead6-4fb0-a2a1-9cab95b67c13 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:29.478391 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f06ca138-ead6-4fb0-a2a1-9cab95b67c13 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:29.480201 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f06ca138-ead6-4fb0-a2a1-9cab95b67c13 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:29.806422 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-536eb7ce-3710-4f23-9068-c7695b51fd28 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5f4e86197e4175b223f20cacce792d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b427157c9f406da72d9b29af734987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:29.815355 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-536eb7ce-3710-4f23-9068-c7695b51fd28 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] 10.222.0.70 "GET /compute/v2.1/servers/b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe" status: 200 len: 1494 microversion: 2.1 time: 0.438610 Aug 27 02:40:29.816557 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 94/164] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:29 2022] GET /compute/v2.1/servers/b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe => generated 1494 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:29.821346 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d099cd99-bd51-4a4a-bf1d-13f24ace7808 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:29.822122 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d099cd99-bd51-4a4a-bf1d-13f24ace7808 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: 12acf567-09ef-4971-b085-8b5566fd1b79] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:29.830532 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d099cd99-bd51-4a4a-bf1d-13f24ace7808 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:29.831277 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d099cd99-bd51-4a4a-bf1d-13f24ace7808 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:29.831860 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d099cd99-bd51-4a4a-bf1d-13f24ace7808 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:29.832751 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d099cd99-bd51-4a4a-bf1d-13f24ace7808 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:29.833358 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d099cd99-bd51-4a4a-bf1d-13f24ace7808 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:29.833905 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d099cd99-bd51-4a4a-bf1d-13f24ace7808 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:29.911272 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-f06ca138-ead6-4fb0-a2a1-9cab95b67c13 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772e2e66c92e44f8838ce325437d5a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b2f4a529a3e4ea0937ca903dd5924bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:29.924250 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f06ca138-ead6-4fb0-a2a1-9cab95b67c13 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] 10.222.0.70 "GET /compute/v2.1/servers/459d7a41-f50d-4ffe-a184-c0a12437669a" status: 200 len: 1474 microversion: 2.1 time: 0.466155 Aug 27 02:40:29.925712 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 71/165] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:29 2022] GET /compute/v2.1/servers/459d7a41-f50d-4ffe-a184-c0a12437669a => generated 1474 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:40:29.930854 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a76dd66f-3047-4001-ba1c-1ebc94a4fcad tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:29.931643 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a76dd66f-3047-4001-ba1c-1ebc94a4fcad tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] [instance: e231e897-7343-415a-a4ff-dfe3df4fb62c] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:29.943488 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a76dd66f-3047-4001-ba1c-1ebc94a4fcad tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:29.944220 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a76dd66f-3047-4001-ba1c-1ebc94a4fcad tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:29.944841 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a76dd66f-3047-4001-ba1c-1ebc94a4fcad tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:29.945693 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a76dd66f-3047-4001-ba1c-1ebc94a4fcad tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:29.946328 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a76dd66f-3047-4001-ba1c-1ebc94a4fcad tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:29.946885 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a76dd66f-3047-4001-ba1c-1ebc94a4fcad tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:30.254996 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d099cd99-bd51-4a4a-bf1d-13f24ace7808 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:30.266273 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d099cd99-bd51-4a4a-bf1d-13f24ace7808 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:30.268863 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d099cd99-bd51-4a4a-bf1d-13f24ace7808 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:30.270652 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d099cd99-bd51-4a4a-bf1d-13f24ace7808 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/12acf567-09ef-4971-b085-8b5566fd1b79" status: 200 len: 1361 microversion: 2.25 time: 0.452946 Aug 27 02:40:30.271390 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 95/166] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:40:29 2022] GET /compute/v2.1/servers/12acf567-09ef-4971-b085-8b5566fd1b79 => generated 1361 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:40:30.357565 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-a76dd66f-3047-4001-ba1c-1ebc94a4fcad tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68711ff38ec41c0b051124527c7ac35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae179f416c451e92e270d2cb0f4400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:30.376606 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a76dd66f-3047-4001-ba1c-1ebc94a4fcad tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] 10.222.0.70 "GET /compute/v2.1/servers/e231e897-7343-415a-a4ff-dfe3df4fb62c" status: 200 len: 1341 microversion: 2.1 time: 0.449475 Aug 27 02:40:30.377367 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 72/167] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:29 2022] GET /compute/v2.1/servers/e231e897-7343-415a-a4ff-dfe3df4fb62c => generated 1341 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:30.503250 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-5a543f52-c417-4ca2-bbba-1b3d663bd29a req-b1a54ae2-5d60-47d2-a426-8aa63052a8b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe", "name": "network-vif-deleted", "tag": "11ce613c-e2a4-415d-936e-65faca310d53"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:30.522664 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-5a543f52-c417-4ca2-bbba-1b3d663bd29a req-b1a54ae2-5d60-47d2-a426-8aa63052a8b7 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:30.531918 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-5a543f52-c417-4ca2-bbba-1b3d663bd29a req-b1a54ae2-5d60-47d2-a426-8aa63052a8b7 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:30.534279 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-5a543f52-c417-4ca2-bbba-1b3d663bd29a req-b1a54ae2-5d60-47d2-a426-8aa63052a8b7 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:30.573697 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:40:30.575668 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-5a543f52-c417-4ca2-bbba-1b3d663bd29a req-b1a54ae2-5d60-47d2-a426-8aa63052a8b7 service nova] Creating event network-vif-deleted:11ce613c-e2a4-415d-936e-65faca310d53 for instance b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe on n-h2-852278-4 Aug 27 02:40:30.592987 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-5a543f52-c417-4ca2-bbba-1b3d663bd29a req-b1a54ae2-5d60-47d2-a426-8aa63052a8b7 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095063 Aug 27 02:40:30.593396 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 96/168] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:40:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:40:30.836066 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-994a7520-cce6-45bc-894e-a67aae90ea7a tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:30.839409 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-994a7520-cce6-45bc-894e-a67aae90ea7a tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] [instance: b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:30.847154 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-994a7520-cce6-45bc-894e-a67aae90ea7a tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:30.849924 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-994a7520-cce6-45bc-894e-a67aae90ea7a tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:30.854106 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-994a7520-cce6-45bc-894e-a67aae90ea7a tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:30.855148 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-994a7520-cce6-45bc-894e-a67aae90ea7a tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:30.855993 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-994a7520-cce6-45bc-894e-a67aae90ea7a tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:30.856853 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-994a7520-cce6-45bc-894e-a67aae90ea7a tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:30.914905 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-994a7520-cce6-45bc-894e-a67aae90ea7a tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:30.915974 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-994a7520-cce6-45bc-894e-a67aae90ea7a tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:30.917134 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-994a7520-cce6-45bc-894e-a67aae90ea7a tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:30.917855 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.instance [None req-994a7520-cce6-45bc-894e-a67aae90ea7a tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lazy-loading 'fault' on Instance uuid b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe {{(pid=134052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:40:30.947638 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-6914b34c-3a76-4453-9cb8-cd2f88c57f84 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:30.949092 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-6914b34c-3a76-4453-9cb8-cd2f88c57f84 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] [instance: 459d7a41-f50d-4ffe-a184-c0a12437669a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:30.972286 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6914b34c-3a76-4453-9cb8-cd2f88c57f84 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:30.973969 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6914b34c-3a76-4453-9cb8-cd2f88c57f84 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:30.974738 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6914b34c-3a76-4453-9cb8-cd2f88c57f84 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:30.975662 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6914b34c-3a76-4453-9cb8-cd2f88c57f84 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:30.976496 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6914b34c-3a76-4453-9cb8-cd2f88c57f84 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:30.978043 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6914b34c-3a76-4453-9cb8-cd2f88c57f84 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:31.065519 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-994a7520-cce6-45bc-894e-a67aae90ea7a tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5f4e86197e4175b223f20cacce792d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b427157c9f406da72d9b29af734987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:31.081530 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-994a7520-cce6-45bc-894e-a67aae90ea7a tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] 10.222.0.70 "GET /compute/v2.1/servers/b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe" status: 200 len: 1328 microversion: 2.1 time: 0.245198 Aug 27 02:40:31.084240 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 73/169] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:30 2022] GET /compute/v2.1/servers/b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe => generated 1328 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:31.136784 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-6914b34c-3a76-4453-9cb8-cd2f88c57f84 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772e2e66c92e44f8838ce325437d5a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b2f4a529a3e4ea0937ca903dd5924bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:31.146090 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-6914b34c-3a76-4453-9cb8-cd2f88c57f84 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] 10.222.0.70 "GET /compute/v2.1/servers/459d7a41-f50d-4ffe-a184-c0a12437669a" status: 200 len: 1432 microversion: 2.1 time: 0.203331 Aug 27 02:40:31.172201 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 97/170] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:30 2022] GET /compute/v2.1/servers/459d7a41-f50d-4ffe-a184-c0a12437669a => generated 1432 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:40:31.295268 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-41f7b033-7266-46c6-84c1-93da2070c7fe tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:31.296000 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-41f7b033-7266-46c6-84c1-93da2070c7fe tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: 12acf567-09ef-4971-b085-8b5566fd1b79] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:31.305278 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-41f7b033-7266-46c6-84c1-93da2070c7fe tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:31.305990 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-41f7b033-7266-46c6-84c1-93da2070c7fe tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:31.306513 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-41f7b033-7266-46c6-84c1-93da2070c7fe tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:31.307512 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-41f7b033-7266-46c6-84c1-93da2070c7fe tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:31.308101 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-41f7b033-7266-46c6-84c1-93da2070c7fe tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:31.308601 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-41f7b033-7266-46c6-84c1-93da2070c7fe tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:31.369012 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-4ebf8a1e-a413-427f-895b-58c15f3f68af req-d028568e-185c-49eb-9ef6-911dcb7c06d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "459d7a41-f50d-4ffe-a184-c0a12437669a", "name": "network-vif-deleted", "tag": "44d32ad2-6a1e-4fa9-814e-6eea70c41884"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:31.386393 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-4ebf8a1e-a413-427f-895b-58c15f3f68af req-d028568e-185c-49eb-9ef6-911dcb7c06d6 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:31.387343 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-4ebf8a1e-a413-427f-895b-58c15f3f68af req-d028568e-185c-49eb-9ef6-911dcb7c06d6 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:31.388715 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-4ebf8a1e-a413-427f-895b-58c15f3f68af req-d028568e-185c-49eb-9ef6-911dcb7c06d6 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:31.416522 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-4ebf8a1e-a413-427f-895b-58c15f3f68af req-d028568e-185c-49eb-9ef6-911dcb7c06d6 service nova] Creating event network-vif-deleted:44d32ad2-6a1e-4fa9-814e-6eea70c41884 for instance 459d7a41-f50d-4ffe-a184-c0a12437669a on n-h1-852278-4 Aug 27 02:40:31.436565 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-4ebf8a1e-a413-427f-895b-58c15f3f68af req-d028568e-185c-49eb-9ef6-911dcb7c06d6 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.289870 Aug 27 02:40:31.438576 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 74/171] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:40:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:40:31.447355 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f493c96e-f076-496b-a859-dc0196c55ecc tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:31.448051 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-f493c96e-f076-496b-a859-dc0196c55ecc tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] [instance: e231e897-7343-415a-a4ff-dfe3df4fb62c] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:31.457566 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f493c96e-f076-496b-a859-dc0196c55ecc tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:31.458048 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f493c96e-f076-496b-a859-dc0196c55ecc tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:31.458852 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f493c96e-f076-496b-a859-dc0196c55ecc tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:31.459835 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f493c96e-f076-496b-a859-dc0196c55ecc tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:31.460451 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f493c96e-f076-496b-a859-dc0196c55ecc tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:31.461010 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f493c96e-f076-496b-a859-dc0196c55ecc tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:31.490009 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-41f7b033-7266-46c6-84c1-93da2070c7fe tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:31.501181 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-41f7b033-7266-46c6-84c1-93da2070c7fe tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:31.503311 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-41f7b033-7266-46c6-84c1-93da2070c7fe tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:31.505238 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-41f7b033-7266-46c6-84c1-93da2070c7fe tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/12acf567-09ef-4971-b085-8b5566fd1b79" status: 200 len: 1556 microversion: 2.25 time: 0.214145 Aug 27 02:40:31.506445 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 98/172] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:40:31 2022] GET /compute/v2.1/servers/12acf567-09ef-4971-b085-8b5566fd1b79 => generated 1556 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:40:31.512882 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-591f3f02-5b36-4254-937f-4aee30761e7e tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-2018026923", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "131754674", "adminPass": "***", "networks": [{"uuid": "03f35903-063c-4d65-9657-789ad66ba106"}], "security_groups": [{"name": "tempest-securitygroup--184061249"}], "key_name": "tempest-keypair-1094053635", "user_data": "}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:31.663079 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:40:31.667386 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.network.neutron [None req-591f3f02-5b36-4254-937f-4aee30761e7e tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] validate_networks() for [('03f35903-063c-4d65-9657-789ad66ba106', None, None, None, None, None)] {{(pid=134051) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:40:32.024164 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-f493c96e-f076-496b-a859-dc0196c55ecc tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68711ff38ec41c0b051124527c7ac35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae179f416c451e92e270d2cb0f4400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:32.036991 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f493c96e-f076-496b-a859-dc0196c55ecc tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] 10.222.0.70 "GET /compute/v2.1/servers/e231e897-7343-415a-a4ff-dfe3df4fb62c" status: 200 len: 1341 microversion: 2.1 time: 0.596978 Aug 27 02:40:32.053642 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 75/173] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:31 2022] GET /compute/v2.1/servers/e231e897-7343-415a-a4ff-dfe3df4fb62c => generated 1341 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:32.273050 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-bcef0c5d-0416-4a15-9c4f-9a10b0976412 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:32.273661 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-bcef0c5d-0416-4a15-9c4f-9a10b0976412 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] [instance: 12acf567-09ef-4971-b085-8b5566fd1b79] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:32.280612 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bcef0c5d-0416-4a15-9c4f-9a10b0976412 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:32.281120 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bcef0c5d-0416-4a15-9c4f-9a10b0976412 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:32.281510 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bcef0c5d-0416-4a15-9c4f-9a10b0976412 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:32.282446 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bcef0c5d-0416-4a15-9c4f-9a10b0976412 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:32.282778 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bcef0c5d-0416-4a15-9c4f-9a10b0976412 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:32.283812 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bcef0c5d-0416-4a15-9c4f-9a10b0976412 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:32.418530 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.instance [None req-bcef0c5d-0416-4a15-9c4f-9a10b0976412 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lazy-loading 'services' on Instance uuid 12acf567-09ef-4971-b085-8b5566fd1b79 {{(pid=134052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:40:32.479486 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-bcef0c5d-0416-4a15-9c4f-9a10b0976412 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/12acf567-09ef-4971-b085-8b5566fd1b79" status: 200 len: 2048 microversion: 2.25 time: 0.424012 Aug 27 02:40:32.481051 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 76/174] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:40:32 2022] GET /compute/v2.1/servers/12acf567-09ef-4971-b085-8b5566fd1b79 => generated 2048 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:40:32.486270 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9d345eca-a5ea-4107-af4c-d26abe29d894 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:32.487210 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-9d345eca-a5ea-4107-af4c-d26abe29d894 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] [instance: b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:32.495014 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9d345eca-a5ea-4107-af4c-d26abe29d894 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:32.495745 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9d345eca-a5ea-4107-af4c-d26abe29d894 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:32.496710 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9d345eca-a5ea-4107-af4c-d26abe29d894 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:32.497883 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9d345eca-a5ea-4107-af4c-d26abe29d894 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:32.498348 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9d345eca-a5ea-4107-af4c-d26abe29d894 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:32.498767 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9d345eca-a5ea-4107-af4c-d26abe29d894 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:32.514994 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-9d345eca-a5ea-4107-af4c-d26abe29d894 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] HTTP exception thrown: Instance b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe could not be found. Aug 27 02:40:32.517966 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9d345eca-a5ea-4107-af4c-d26abe29d894 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Request method failure captured: Aug 27 02:40:32.517966 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/servers/b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe HTTP/1.1 Aug 27 02:40:32.517966 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:40:32.517966 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:40:32.517966 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:40:32.517966 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:40:32.517966 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:40:32.517966 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:40:32.517966 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:40:32.517966 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:40:32.517966 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYPtUtGKFTD1H8qVjq1ImJXu-QHObGwcxq42f1zsL4wCbuU17gcMO9JHpcJcJgTUqMjEoA22YW6nl_88ggfnDu7er6tvIAlk3kWtCSOAoIjCkfX4Ab8-0fdhJ6yrWzGlA6a36prEqxQxxDBGHa_l4x8Z1RUmABwkMSJWmaFSdCZOgnQ Aug 27 02:40:32.517966 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:40:32.517966 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:40:32.517966 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:40:32.517966 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:40:32.517966 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:40:32.517966 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:40:32.517966 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 13b427157c9f406da72d9b29af734987 Aug 27 02:40:32.517966 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-AggregatesAdminTestJSON-1445920633 Aug 27 02:40:32.517966 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:40:32.517966 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:40:32.519466 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/13b427157c9f406da72d9b29af734987"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_13b427157c9f406da72d9b29af734987", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/13b427157c9f406da72d9b29af734987"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/13b427157c9f406da72d9b29af734987"}]}] Aug 27 02:40:32.519466 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-AggregatesAdminTestJSON-1445920633 Aug 27 02:40:32.519466 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 13b427157c9f406da72d9b29af734987 Aug 27 02:40:32.519466 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1445920633 Aug 27 02:40:32.519466 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-AggregatesAdminTestJSON-1445920633-project Aug 27 02:40:32.519466 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:40:32.519466 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:40:32.519466 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: be5f4e86197e4175b223f20cacce792d Aug 27 02:40:32.519466 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-AggregatesAdminTestJSON-1445920633-project Aug 27 02:40:32.519466 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 02:40:32.519466 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe could not be found. Aug 27 02:40:32.519466 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': 'b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe'} Aug 27 02:40:32.520273 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:40:32.520273 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:32.520273 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:40:32.520273 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:40:32.520273 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:40:32.520273 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:40:32.520273 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:40:32.520273 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:40:32.520273 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:40:32.520273 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:40:32.520273 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe could not be found. Aug 27 02:40:32.520273 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:32.520273 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:32.520273 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:32.520273 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:32.520273 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:32.520273 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:32.520273 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:40:32.520273 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:40:32.520273 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:40:32.521555 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:40:32.521555 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:40:32.521555 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:40:32.521555 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:40:32.521555 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:40:32.521555 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:40:32.521555 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:40:32.521555 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe could not be found. Aug 27 02:40:32.521555 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:32.521555 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:32.521555 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:32.521555 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:32.521555 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:32.521555 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:32.521555 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:40:32.521555 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:40:32.521555 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe could not be found. Aug 27 02:40:32.521555 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:32.522776 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9d345eca-a5ea-4107-af4c-d26abe29d894 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Returning 404 to user: Instance b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:40:32.522776 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9d345eca-a5ea-4107-af4c-d26abe29d894 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] 10.222.0.70 "GET /compute/v2.1/servers/b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe" status: 404 len: 111 microversion: 2.1 time: 0.037176 Aug 27 02:40:32.522776 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 77/175] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:32 2022] GET /compute/v2.1/servers/b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:40:32.528983 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9c260607-d577-4f3c-94e9-ddcf30e68b2f tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:32.529618 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-9c260607-d577-4f3c-94e9-ddcf30e68b2f tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] [instance: 459d7a41-f50d-4ffe-a184-c0a12437669a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:32.544152 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9c260607-d577-4f3c-94e9-ddcf30e68b2f tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:32.545171 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9c260607-d577-4f3c-94e9-ddcf30e68b2f tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:32.546205 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9c260607-d577-4f3c-94e9-ddcf30e68b2f tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:32.546926 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9c260607-d577-4f3c-94e9-ddcf30e68b2f tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:32.547819 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9c260607-d577-4f3c-94e9-ddcf30e68b2f tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:32.548247 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9c260607-d577-4f3c-94e9-ddcf30e68b2f tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:32.563462 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-9c260607-d577-4f3c-94e9-ddcf30e68b2f tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] HTTP exception thrown: Instance 459d7a41-f50d-4ffe-a184-c0a12437669a could not be found. Aug 27 02:40:32.565001 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9c260607-d577-4f3c-94e9-ddcf30e68b2f tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Request method failure captured: Aug 27 02:40:32.565001 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/servers/459d7a41-f50d-4ffe-a184-c0a12437669a HTTP/1.1 Aug 27 02:40:32.565001 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:40:32.565001 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:40:32.565001 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:40:32.565001 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:40:32.565001 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:40:32.565001 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:40:32.565001 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:40:32.565001 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:40:32.565001 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYPuRVcXli1neNmLk_RDz1m6kWIRhIJgpH_2sAx_hcvk788F2tryHwfFm_mCTMiMPnCU-8UQd9jca0EPx7ySPTLVUyKEa0Fz3Hcz_RvhKExHa_SEi5Bexy1V2ASEgYmSppLGPQflpqpOyx7eNx7sayhnmD8E4in1T5xGAGExva-F61w Aug 27 02:40:32.565001 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:40:32.565001 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:40:32.565001 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:40:32.565001 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:40:32.565001 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:40:32.565001 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:40:32.565001 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 5b2f4a529a3e4ea0937ca903dd5924bf Aug 27 02:40:32.565001 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1720754315 Aug 27 02:40:32.565001 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:40:32.565001 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:40:32.566140 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5b2f4a529a3e4ea0937ca903dd5924bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_5b2f4a529a3e4ea0937ca903dd5924bf", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5b2f4a529a3e4ea0937ca903dd5924bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/5b2f4a529a3e4ea0937ca903dd5924bf"}]}] Aug 27 02:40:32.566140 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-DeleteServersAdminTestJSON-1720754315 Aug 27 02:40:32.566140 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 5b2f4a529a3e4ea0937ca903dd5924bf Aug 27 02:40:32.566140 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1720754315 Aug 27 02:40:32.566140 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-DeleteServersAdminTestJSON-1720754315-project Aug 27 02:40:32.566140 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:40:32.566140 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:40:32.566140 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 772e2e66c92e44f8838ce325437d5a48 Aug 27 02:40:32.566140 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-DeleteServersAdminTestJSON-1720754315-project Aug 27 02:40:32.566140 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 02:40:32.566140 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance 459d7a41-f50d-4ffe-a184-c0a12437669a could not be found. Aug 27 02:40:32.566140 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '459d7a41-f50d-4ffe-a184-c0a12437669a'} Aug 27 02:40:32.566807 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:40:32.566807 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:32.566807 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:40:32.566807 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:40:32.566807 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:40:32.566807 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:40:32.566807 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:40:32.566807 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:40:32.566807 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:40:32.566807 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:40:32.566807 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 459d7a41-f50d-4ffe-a184-c0a12437669a could not be found. Aug 27 02:40:32.566807 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:32.566807 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:32.566807 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:32.566807 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:32.566807 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:32.566807 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:32.566807 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:40:32.566807 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:40:32.566807 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:40:32.568023 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:40:32.568023 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:40:32.568023 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:40:32.568023 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:40:32.568023 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:40:32.568023 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:40:32.568023 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:40:32.568023 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 459d7a41-f50d-4ffe-a184-c0a12437669a could not be found. Aug 27 02:40:32.568023 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:32.568023 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:32.568023 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:32.568023 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:32.568023 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:32.568023 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:32.568023 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:40:32.568023 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:40:32.568023 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 459d7a41-f50d-4ffe-a184-c0a12437669a could not be found. Aug 27 02:40:32.568023 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:32.569183 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9c260607-d577-4f3c-94e9-ddcf30e68b2f tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Returning 404 to user: Instance 459d7a41-f50d-4ffe-a184-c0a12437669a could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:40:32.569183 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9c260607-d577-4f3c-94e9-ddcf30e68b2f tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] 10.222.0.70 "GET /compute/v2.1/servers/459d7a41-f50d-4ffe-a184-c0a12437669a" status: 404 len: 111 microversion: 2.1 time: 0.042071 Aug 27 02:40:32.569183 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 78/176] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:32 2022] GET /compute/v2.1/servers/459d7a41-f50d-4ffe-a184-c0a12437669a => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:40:32.571291 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-344534cb-7c91-46d5-93cc-83dbc966453f tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:32.571898 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-344534cb-7c91-46d5-93cc-83dbc966453f tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] [instance: 12acf567-09ef-4971-b085-8b5566fd1b79] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:32.589407 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-344534cb-7c91-46d5-93cc-83dbc966453f tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:32.590728 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-344534cb-7c91-46d5-93cc-83dbc966453f tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:32.591468 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-344534cb-7c91-46d5-93cc-83dbc966453f tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:32.593222 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-344534cb-7c91-46d5-93cc-83dbc966453f tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:32.593688 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-344534cb-7c91-46d5-93cc-83dbc966453f tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:32.594450 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-344534cb-7c91-46d5-93cc-83dbc966453f tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:32.683045 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-591f3f02-5b36-4254-937f-4aee30761e7e tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Flavor limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:40:32.686310 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-591f3f02-5b36-4254-937f-4aee30761e7e tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Image limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:40:32.687506 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-591f3f02-5b36-4254-937f-4aee30761e7e tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Flavor pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:40:32.688072 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-591f3f02-5b36-4254-937f-4aee30761e7e tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Image pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:40:32.688566 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-591f3f02-5b36-4254-937f-4aee30761e7e tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:40:32.705410 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-591f3f02-5b36-4254-937f-4aee30761e7e tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:32.705888 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-591f3f02-5b36-4254-937f-4aee30761e7e tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:32.706641 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-591f3f02-5b36-4254-937f-4aee30761e7e tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:32.707356 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-591f3f02-5b36-4254-937f-4aee30761e7e tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:32.707798 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-591f3f02-5b36-4254-937f-4aee30761e7e tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:32.708210 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-591f3f02-5b36-4254-937f-4aee30761e7e tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:32.728101 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-591f3f02-5b36-4254-937f-4aee30761e7e tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Getting quotas for project 72992d9dba564526b223533398a94dea. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:40:32.734061 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-591f3f02-5b36-4254-937f-4aee30761e7e tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Getting quotas for user c4c850104e6d430397bb54d0e3730a73 and project 72992d9dba564526b223533398a94dea. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:40:32.747057 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-591f3f02-5b36-4254-937f-4aee30761e7e tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Going to run 1 instances... {{(pid=134051) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:40:32.749938 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-591f3f02-5b36-4254-937f-4aee30761e7e tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] [instance: f5d6ba67-b815-4ec1-9d75-ee5436f5e3c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134051) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:40:32.767550 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.instance [None req-344534cb-7c91-46d5-93cc-83dbc966453f tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lazy-loading 'services' on Instance uuid 12acf567-09ef-4971-b085-8b5566fd1b79 {{(pid=134052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:40:32.786071 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-344534cb-7c91-46d5-93cc-83dbc966453f tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/12acf567-09ef-4971-b085-8b5566fd1b79" status: 200 len: 2048 microversion: 2.25 time: 0.217962 Aug 27 02:40:32.786831 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 79/177] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:40:32 2022] GET /compute/v2.1/servers/12acf567-09ef-4971-b085-8b5566fd1b79 => generated 2048 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:40:32.792830 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c418f309-4249-4d0e-9bed-7307d4112cea tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-852278-4"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:32.817356 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c418f309-4249-4d0e-9bed-7307d4112cea tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:32.817870 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c418f309-4249-4d0e-9bed-7307d4112cea tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:32.818354 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c418f309-4249-4d0e-9bed-7307d4112cea tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:32.828471 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-591f3f02-5b36-4254-937f-4aee30761e7e tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.320540 Aug 27 02:40:32.829909 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 99/178] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 02:40:31 2022] POST /compute/v2.1/servers => generated 401 bytes in 1323 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:40:32.835611 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-1f20bde0-141d-4649-947a-2d4e3a9e7b37 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1492570801", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:32.950688 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.network.neutron [None req-1f20bde0-141d-4649-947a-2d4e3a9e7b37 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] validate_networks() for None {{(pid=134051) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:40:33.291859 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-1f20bde0-141d-4649-947a-2d4e3a9e7b37 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Flavor limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:40:33.292530 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-1f20bde0-141d-4649-947a-2d4e3a9e7b37 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Image limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:40:33.293198 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-1f20bde0-141d-4649-947a-2d4e3a9e7b37 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Flavor pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:40:33.293607 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-1f20bde0-141d-4649-947a-2d4e3a9e7b37 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Image pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:40:33.294191 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-1f20bde0-141d-4649-947a-2d4e3a9e7b37 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:40:33.306501 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1f20bde0-141d-4649-947a-2d4e3a9e7b37 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:33.306987 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1f20bde0-141d-4649-947a-2d4e3a9e7b37 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:33.307419 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1f20bde0-141d-4649-947a-2d4e3a9e7b37 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:33.308219 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1f20bde0-141d-4649-947a-2d4e3a9e7b37 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:33.308604 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1f20bde0-141d-4649-947a-2d4e3a9e7b37 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:33.309023 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1f20bde0-141d-4649-947a-2d4e3a9e7b37 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:33.333056 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-1f20bde0-141d-4649-947a-2d4e3a9e7b37 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Getting quotas for project 5b2f4a529a3e4ea0937ca903dd5924bf. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:40:33.337628 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-1f20bde0-141d-4649-947a-2d4e3a9e7b37 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Getting quotas for user 772e2e66c92e44f8838ce325437d5a48 and project 5b2f4a529a3e4ea0937ca903dd5924bf. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:40:33.350618 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-1f20bde0-141d-4649-947a-2d4e3a9e7b37 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Going to run 1 instances... {{(pid=134051) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:40:33.353461 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-1f20bde0-141d-4649-947a-2d4e3a9e7b37 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] [instance: 11661332-bcfc-46f3-a5ba-30eb82448817] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134051) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:40:33.354317 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c418f309-4249-4d0e-9bed-7307d4112cea tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 300 microversion: 2.1 time: 0.565824 Aug 27 02:40:33.355889 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 80/179] 10.222.0.70 () {60 vars in 1191 bytes} [Sat Aug 27 02:40:32 2022] POST /compute/v2.1/os-aggregates/1/action => generated 300 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:40:33.365321 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5a5e32cd-6fb1-49a3-b0bb-cafe95ce4caa tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:33.373236 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5a5e32cd-6fb1-49a3-b0bb-cafe95ce4caa tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:33.373924 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5a5e32cd-6fb1-49a3-b0bb-cafe95ce4caa tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:33.374674 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5a5e32cd-6fb1-49a3-b0bb-cafe95ce4caa tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:33.375865 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5a5e32cd-6fb1-49a3-b0bb-cafe95ce4caa tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:33.376951 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5a5e32cd-6fb1-49a3-b0bb-cafe95ce4caa tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:33.377456 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5a5e32cd-6fb1-49a3-b0bb-cafe95ce4caa tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:33.409056 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-5a5e32cd-6fb1-49a3-b0bb-cafe95ce4caa tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] 10.222.0.70 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.051714 Aug 27 02:40:33.409904 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 81/180] 10.222.0.70 () {60 vars in 1217 bytes} [Sat Aug 27 02:40:33 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:40:33.414963 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-76a0c529-4800-40ec-bb15-3e3b059b3381 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:33.416416 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-76a0c529-4800-40ec-bb15-3e3b059b3381 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] [instance: f5d6ba67-b815-4ec1-9d75-ee5436f5e3c7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:33.437723 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-1f20bde0-141d-4649-947a-2d4e3a9e7b37 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.606393 Aug 27 02:40:33.438713 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 100/181] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 02:40:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 608 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:40:33.443557 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-65842dec-2014-4305-8a9d-036bb2d5073d tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:33.444173 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-65842dec-2014-4305-8a9d-036bb2d5073d tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] [instance: e231e897-7343-415a-a4ff-dfe3df4fb62c] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:33.451129 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-65842dec-2014-4305-8a9d-036bb2d5073d tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:33.451623 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-65842dec-2014-4305-8a9d-036bb2d5073d tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:33.452059 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-65842dec-2014-4305-8a9d-036bb2d5073d tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:33.452831 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-65842dec-2014-4305-8a9d-036bb2d5073d tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:33.453288 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-65842dec-2014-4305-8a9d-036bb2d5073d tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:33.453909 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-65842dec-2014-4305-8a9d-036bb2d5073d tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:33.529852 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-76a0c529-4800-40ec-bb15-3e3b059b3381 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c850104e6d430397bb54d0e3730a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72992d9dba564526b223533398a94dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:33.538825 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-76a0c529-4800-40ec-bb15-3e3b059b3381 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] 10.222.0.70 "GET /compute/v2.1/servers/f5d6ba67-b815-4ec1-9d75-ee5436f5e3c7" status: 200 len: 1263 microversion: 2.1 time: 0.127497 Aug 27 02:40:33.539499 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 82/182] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:33 2022] GET /compute/v2.1/servers/f5d6ba67-b815-4ec1-9d75-ee5436f5e3c7 => generated 1263 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:33.544731 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-af6c6325-d2aa-4321-aa4f-2a52d80cd8a1 req-777c49da-d62b-4861-8f5d-12797d0081c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e231e897-7343-415a-a4ff-dfe3df4fb62c", "name": "network-vif-plugged", "status": "completed", "tag": "f06c3585-fe39-4c4c-91e7-6abc3d16d4bb"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:33.557310 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-af6c6325-d2aa-4321-aa4f-2a52d80cd8a1 req-777c49da-d62b-4861-8f5d-12797d0081c9 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:33.557799 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-af6c6325-d2aa-4321-aa4f-2a52d80cd8a1 req-777c49da-d62b-4861-8f5d-12797d0081c9 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:33.558235 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-af6c6325-d2aa-4321-aa4f-2a52d80cd8a1 req-777c49da-d62b-4861-8f5d-12797d0081c9 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:33.571994 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-af6c6325-d2aa-4321-aa4f-2a52d80cd8a1 req-777c49da-d62b-4861-8f5d-12797d0081c9 service nova] Creating event network-vif-plugged:f06c3585-fe39-4c4c-91e7-6abc3d16d4bb for instance e231e897-7343-415a-a4ff-dfe3df4fb62c on n-h2-852278-4 Aug 27 02:40:33.578145 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-af6c6325-d2aa-4321-aa4f-2a52d80cd8a1 req-777c49da-d62b-4861-8f5d-12797d0081c9 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037507 Aug 27 02:40:33.579053 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 83/183] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:40:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:40:33.584146 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a79996ed-9b7f-40be-a776-8514fae3b084 tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:33.622561 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a79996ed-9b7f-40be-a776-8514fae3b084 tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] 10.222.0.70 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.042217 Aug 27 02:40:33.623177 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 84/184] 10.222.0.70 () {58 vars in 1152 bytes} [Sat Aug 27 02:40:33 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 27 02:40:33.628967 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-110fe605-ffed-4f4c-b7d6-600007d7d775 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-852278-4", "block_migration": "auto"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:33.631850 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-110fe605-ffed-4f4c-b7d6-600007d7d775 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] [instance: 12acf567-09ef-4971-b085-8b5566fd1b79] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:33.645538 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-110fe605-ffed-4f4c-b7d6-600007d7d775 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:33.645696 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-110fe605-ffed-4f4c-b7d6-600007d7d775 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:33.646064 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-110fe605-ffed-4f4c-b7d6-600007d7d775 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:33.646787 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-110fe605-ffed-4f4c-b7d6-600007d7d775 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:33.647237 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-110fe605-ffed-4f4c-b7d6-600007d7d775 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:33.647661 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-110fe605-ffed-4f4c-b7d6-600007d7d775 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:33.771996 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-65842dec-2014-4305-8a9d-036bb2d5073d tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68711ff38ec41c0b051124527c7ac35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae179f416c451e92e270d2cb0f4400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:33.784138 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-65842dec-2014-4305-8a9d-036bb2d5073d tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] 10.222.0.70 "GET /compute/v2.1/servers/e231e897-7343-415a-a4ff-dfe3df4fb62c" status: 200 len: 1319 microversion: 2.1 time: 0.343077 Aug 27 02:40:33.784778 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 101/185] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:33 2022] GET /compute/v2.1/servers/e231e897-7343-415a-a4ff-dfe3df4fb62c => generated 1319 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:33.795313 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.instance [None req-110fe605-ffed-4f4c-b7d6-600007d7d775 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lazy-loading 'flavor' on Instance uuid 12acf567-09ef-4971-b085-8b5566fd1b79 {{(pid=134052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:40:33.796536 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-78b2c192-f139-4182-98de-ada03881b4a4 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:33.797148 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-78b2c192-f139-4182-98de-ada03881b4a4 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] [instance: 11661332-bcfc-46f3-a5ba-30eb82448817] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:33.871409 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-110fe605-ffed-4f4c-b7d6-600007d7d775 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] [instance: 12acf567-09ef-4971-b085-8b5566fd1b79] Going to try to live migrate instance to n-h2-852278-4 {{(pid=134052) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 27 02:40:33.895790 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-78b2c192-f139-4182-98de-ada03881b4a4 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772e2e66c92e44f8838ce325437d5a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b2f4a529a3e4ea0937ca903dd5924bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:33.917268 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-78b2c192-f139-4182-98de-ada03881b4a4 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] 10.222.0.70 "GET /compute/v2.1/servers/11661332-bcfc-46f3-a5ba-30eb82448817" status: 200 len: 1220 microversion: 2.1 time: 0.129340 Aug 27 02:40:33.932087 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 102/186] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:33 2022] GET /compute/v2.1/servers/11661332-bcfc-46f3-a5ba-30eb82448817 => generated 1220 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:33.937428 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e94a9ef7-9d9c-49ec-8c72-4bf9f538b7ab tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1590073976"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:33.950080 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.objects.aggregate [None req-e94a9ef7-9d9c-49ec-8c72-4bf9f538b7ab tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] Generated uuid 1cc74252-98ff-4d6b-94bc-fc077bebde82 for aggregate {{(pid=134051) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 02:40:33.995250 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e94a9ef7-9d9c-49ec-8c72-4bf9f538b7ab tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.068830 Aug 27 02:40:33.997602 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 103/187] 10.222.0.70 () {60 vars in 1164 bytes} [Sat Aug 27 02:40:33 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:40:34.236665 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-df7eae6f-523a-41c4-a846-0d3bd5c9c550 tempest-HypervisorAdminNegativeTestJSON-1344240451 tempest-HypervisorAdminNegativeTestJSON-1344240451-project] Calling method '.version_select at 0x7f5edfc99790>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:34.238459 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-df7eae6f-523a-41c4-a846-0d3bd5c9c550 tempest-HypervisorAdminNegativeTestJSON-1344240451 tempest-HypervisorAdminNegativeTestJSON-1344240451-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': '57cb032f11da47b09da4bb80f1953f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def18a47833544c2b0da9eb0edaa352c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:34.243768 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-df7eae6f-523a-41c4-a846-0d3bd5c9c550 tempest-HypervisorAdminNegativeTestJSON-1344240451 tempest-HypervisorAdminNegativeTestJSON-1344240451-project] Request method failure captured: Aug 27 02:40:34.243768 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Aug 27 02:40:34.243768 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:40:34.243768 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:40:34.243768 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:40:34.243768 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:40:34.243768 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:40:34.243768 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:40:34.243768 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:40:34.243768 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:40:34.243768 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYQgsSuVNSMAsrSAx8URMFnfgqfBpUrdM3qDRPIEioozD8tYGEB4iC280D4jWsmauP-fubq-lwX3Dj87LxPzC26XDvshMtMm-6poef05SP5YnIjYWKJT91zjGtDk0q6Pb4tR5C6CuGfeaGHMwDJrdlhdGPMil67isVWEuAzw2Rxm47M Aug 27 02:40:34.243768 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:40:34.243768 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:40:34.243768 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:40:34.243768 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:40:34.243768 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:40:34.243768 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:40:34.243768 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: def18a47833544c2b0da9eb0edaa352c Aug 27 02:40:34.243768 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1344240451 Aug 27 02:40:34.243768 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:40:34.243768 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:40:34.245061 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/def18a47833544c2b0da9eb0edaa352c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_def18a47833544c2b0da9eb0edaa352c", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/def18a47833544c2b0da9eb0edaa352c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/def18a47833544c2b0da9eb0edaa352c"}]}] Aug 27 02:40:34.245061 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1344240451 Aug 27 02:40:34.245061 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: def18a47833544c2b0da9eb0edaa352c Aug 27 02:40:34.245061 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1344240451 Aug 27 02:40:34.245061 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-HypervisorAdminNegativeTestJSON-1344240451-project Aug 27 02:40:34.245061 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:40:34.245061 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:40:34.245061 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 57cb032f11da47b09da4bb80f1953f57 Aug 27 02:40:34.245061 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1344240451-project Aug 27 02:40:34.245061 n-d-852278-4 devstack@n-api.service[134051]: method: Aug 27 02:40:34.245061 n-d-852278-4 devstack@n-api.service[134051]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 27 02:40:34.245061 n-d-852278-4 devstack@n-api.service[134051]: action_args: {} Aug 27 02:40:34.245061 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:40:34.246171 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:34.246171 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:34.246171 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:34.246171 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:40:34.246171 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:40:34.246171 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:40:34.246171 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:40:34.246171 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:40:34.246171 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:40:34.246171 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Aug 27 02:40:34.246171 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self._detail(req) Aug 27 02:40:34.246171 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Aug 27 02:40:34.246171 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Aug 27 02:40:34.246171 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 02:40:34.246171 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 02:40:34.246171 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 02:40:34.246171 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 02:40:34.246171 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 02:40:34.246171 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 02:40:34.247652 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 02:40:34.247652 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 02:40:34.247652 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 02:40:34.247652 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 02:40:34.247652 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 02:40:34.247652 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 02:40:34.247652 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 02:40:34.247652 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 02:40:34.247652 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 27 02:40:34.247652 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:34.247652 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:34.247652 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:34.247652 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:34.247652 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:34.247652 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:34.247652 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 02:40:34.247652 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 02:40:34.247652 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 27 02:40:34.247652 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:34.251476 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-df7eae6f-523a-41c4-a846-0d3bd5c9c550 tempest-HypervisorAdminNegativeTestJSON-1344240451 tempest-HypervisorAdminNegativeTestJSON-1344240451-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:40:34.251476 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-df7eae6f-523a-41c4-a846-0d3bd5c9c550 tempest-HypervisorAdminNegativeTestJSON-1344240451 tempest-HypervisorAdminNegativeTestJSON-1344240451-project] 10.222.0.70 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.246497 Aug 27 02:40:34.251476 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 104/188] 10.222.0.70 () {58 vars in 1167 bytes} [Sat Aug 27 02:40:33 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 248 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:40:34.251476 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d4e3f45d-cc31-4970-8e38-dd4ad9138822 tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-852278-4"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:34.262581 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d4e3f45d-cc31-4970-8e38-dd4ad9138822 tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:34.263069 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d4e3f45d-cc31-4970-8e38-dd4ad9138822 tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:34.263524 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d4e3f45d-cc31-4970-8e38-dd4ad9138822 tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:34.378225 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d4e3f45d-cc31-4970-8e38-dd4ad9138822 tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 242 microversion: 2.1 time: 0.131038 Aug 27 02:40:34.378810 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 105/189] 10.222.0.70 () {60 vars in 1191 bytes} [Sat Aug 27 02:40:34 2022] POST /compute/v2.1/os-aggregates/2/action => generated 242 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:40:34.383269 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e825cfdf-fc5d-4289-ae29-c97ad9dbe835 tempest-HypervisorAdminNegativeTestJSON-1344240451 tempest-HypervisorAdminNegativeTestJSON-1344240451-project] Calling method '.version_select at 0x7f5edfad41f0>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:34.385338 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e825cfdf-fc5d-4289-ae29-c97ad9dbe835 tempest-HypervisorAdminNegativeTestJSON-1344240451 tempest-HypervisorAdminNegativeTestJSON-1344240451-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': '57cb032f11da47b09da4bb80f1953f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def18a47833544c2b0da9eb0edaa352c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:34.386910 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e825cfdf-fc5d-4289-ae29-c97ad9dbe835 tempest-HypervisorAdminNegativeTestJSON-1344240451 tempest-HypervisorAdminNegativeTestJSON-1344240451-project] Request method failure captured: Aug 27 02:40:34.386910 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Aug 27 02:40:34.386910 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:40:34.386910 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:40:34.386910 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:40:34.386910 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:40:34.386910 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:40:34.386910 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:40:34.386910 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:40:34.386910 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:40:34.386910 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYQgsSuVNSMAsrSAx8URMFnfgqfBpUrdM3qDRPIEioozD8tYGEB4iC280D4jWsmauP-fubq-lwX3Dj87LxPzC26XDvshMtMm-6poef05SP5YnIjYWKJT91zjGtDk0q6Pb4tR5C6CuGfeaGHMwDJrdlhdGPMil67isVWEuAzw2Rxm47M Aug 27 02:40:34.386910 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:40:34.386910 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:40:34.386910 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:40:34.386910 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:40:34.386910 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:40:34.386910 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:40:34.386910 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: def18a47833544c2b0da9eb0edaa352c Aug 27 02:40:34.386910 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1344240451 Aug 27 02:40:34.386910 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:40:34.386910 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:40:34.388256 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/def18a47833544c2b0da9eb0edaa352c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_def18a47833544c2b0da9eb0edaa352c", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/def18a47833544c2b0da9eb0edaa352c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/def18a47833544c2b0da9eb0edaa352c"}]}] Aug 27 02:40:34.388256 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1344240451 Aug 27 02:40:34.388256 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: def18a47833544c2b0da9eb0edaa352c Aug 27 02:40:34.388256 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1344240451 Aug 27 02:40:34.388256 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-HypervisorAdminNegativeTestJSON-1344240451-project Aug 27 02:40:34.388256 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:40:34.388256 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:40:34.388256 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 57cb032f11da47b09da4bb80f1953f57 Aug 27 02:40:34.388256 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1344240451-project Aug 27 02:40:34.388256 n-d-852278-4 devstack@n-api.service[134051]: method: Aug 27 02:40:34.388256 n-d-852278-4 devstack@n-api.service[134051]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 27 02:40:34.388256 n-d-852278-4 devstack@n-api.service[134051]: action_args: {} Aug 27 02:40:34.388256 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:40:34.389108 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:34.389108 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:34.389108 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:34.389108 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:40:34.389108 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:40:34.389108 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:40:34.389108 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:40:34.389108 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:40:34.389108 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:40:34.389108 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Aug 27 02:40:34.389108 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self._index(req) Aug 27 02:40:34.389108 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Aug 27 02:40:34.389108 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Aug 27 02:40:34.389108 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 02:40:34.389108 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 02:40:34.389108 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 02:40:34.389108 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 02:40:34.389108 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 02:40:34.389108 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 02:40:34.390083 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 02:40:34.390083 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 02:40:34.390083 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 02:40:34.390083 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 02:40:34.390083 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 02:40:34.390083 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 02:40:34.390083 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 02:40:34.390083 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 02:40:34.390083 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 27 02:40:34.390083 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:34.390083 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:34.390083 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:34.390083 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:34.390083 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:34.390083 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:34.390083 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 02:40:34.390083 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 02:40:34.390083 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 27 02:40:34.390083 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:34.391127 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e825cfdf-fc5d-4289-ae29-c97ad9dbe835 tempest-HypervisorAdminNegativeTestJSON-1344240451 tempest-HypervisorAdminNegativeTestJSON-1344240451-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:40:34.391127 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e825cfdf-fc5d-4289-ae29-c97ad9dbe835 tempest-HypervisorAdminNegativeTestJSON-1344240451 tempest-HypervisorAdminNegativeTestJSON-1344240451-project] 10.222.0.70 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.008534 Aug 27 02:40:34.392920 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 106/190] 10.222.0.70 () {58 vars in 1146 bytes} [Sat Aug 27 02:40:34 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 13 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:40:34.397320 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f71adb8c-a4fe-4f26-9444-90d27df0095c tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:34.406982 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-f71adb8c-a4fe-4f26-9444-90d27df0095c tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] 10.222.0.70 "GET /compute/v2.1/os-aggregates/2" status: 200 len: 242 microversion: 2.1 time: 0.013091 Aug 27 02:40:34.407550 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 107/191] 10.222.0.70 () {58 vars in 1149 bytes} [Sat Aug 27 02:40:34 2022] GET /compute/v2.1/os-aggregates/2 => generated 242 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:40:34.412167 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-bff61ce2-e272-4a7d-bea7-fbae34a850d4 tempest-HypervisorAdminNegativeTestJSON-1344240451 tempest-HypervisorAdminNegativeTestJSON-1344240451-project] Calling method '.version_select at 0x7f5edfd7fb80>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:34.414012 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-bff61ce2-e272-4a7d-bea7-fbae34a850d4 tempest-HypervisorAdminNegativeTestJSON-1344240451 tempest-HypervisorAdminNegativeTestJSON-1344240451-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': '57cb032f11da47b09da4bb80f1953f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def18a47833544c2b0da9eb0edaa352c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:34.415731 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-bff61ce2-e272-4a7d-bea7-fbae34a850d4 tempest-HypervisorAdminNegativeTestJSON-1344240451 tempest-HypervisorAdminNegativeTestJSON-1344240451-project] Request method failure captured: Aug 27 02:40:34.415731 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Aug 27 02:40:34.415731 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:40:34.415731 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:40:34.415731 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:40:34.415731 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:40:34.415731 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:40:34.415731 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:40:34.415731 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:40:34.415731 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:40:34.415731 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYQgsSuVNSMAsrSAx8URMFnfgqfBpUrdM3qDRPIEioozD8tYGEB4iC280D4jWsmauP-fubq-lwX3Dj87LxPzC26XDvshMtMm-6poef05SP5YnIjYWKJT91zjGtDk0q6Pb4tR5C6CuGfeaGHMwDJrdlhdGPMil67isVWEuAzw2Rxm47M Aug 27 02:40:34.415731 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:40:34.415731 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:40:34.415731 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:40:34.415731 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:40:34.415731 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:40:34.415731 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:40:34.415731 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: def18a47833544c2b0da9eb0edaa352c Aug 27 02:40:34.415731 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1344240451 Aug 27 02:40:34.415731 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:40:34.415731 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:40:34.416932 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/def18a47833544c2b0da9eb0edaa352c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_def18a47833544c2b0da9eb0edaa352c", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/def18a47833544c2b0da9eb0edaa352c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/def18a47833544c2b0da9eb0edaa352c"}]}] Aug 27 02:40:34.416932 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1344240451 Aug 27 02:40:34.416932 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: def18a47833544c2b0da9eb0edaa352c Aug 27 02:40:34.416932 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1344240451 Aug 27 02:40:34.416932 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-HypervisorAdminNegativeTestJSON-1344240451-project Aug 27 02:40:34.416932 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:40:34.416932 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:40:34.416932 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 57cb032f11da47b09da4bb80f1953f57 Aug 27 02:40:34.416932 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1344240451-project Aug 27 02:40:34.416932 n-d-852278-4 devstack@n-api.service[134051]: method: Aug 27 02:40:34.416932 n-d-852278-4 devstack@n-api.service[134051]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 27 02:40:34.416932 n-d-852278-4 devstack@n-api.service[134051]: action_args: {} Aug 27 02:40:34.416932 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:40:34.417647 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:34.417647 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:34.417647 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:34.417647 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:40:34.417647 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:40:34.417647 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:40:34.417647 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:40:34.417647 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:40:34.417647 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:40:34.417647 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Aug 27 02:40:34.417647 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Aug 27 02:40:34.417647 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 02:40:34.417647 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 02:40:34.417647 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 02:40:34.417647 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 02:40:34.417647 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 02:40:34.417647 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 02:40:34.417647 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 02:40:34.417647 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 02:40:34.418645 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 02:40:34.418645 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 02:40:34.418645 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 02:40:34.418645 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 02:40:34.418645 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 02:40:34.418645 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 02:40:34.418645 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 27 02:40:34.418645 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:34.418645 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:34.418645 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:34.418645 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:34.418645 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:34.418645 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:34.418645 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 02:40:34.418645 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 02:40:34.418645 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 27 02:40:34.418645 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:34.419729 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-bff61ce2-e272-4a7d-bea7-fbae34a850d4 tempest-HypervisorAdminNegativeTestJSON-1344240451 tempest-HypervisorAdminNegativeTestJSON-1344240451-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:40:34.419729 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-bff61ce2-e272-4a7d-bea7-fbae34a850d4 tempest-HypervisorAdminNegativeTestJSON-1344240451 tempest-HypervisorAdminNegativeTestJSON-1344240451-project] 10.222.0.70 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.008654 Aug 27 02:40:34.419729 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 108/192] 10.222.0.70 () {58 vars in 1179 bytes} [Sat Aug 27 02:40:34 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 9 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:40:34.426671 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-703b1bad-a51e-43c1-aaa6-a8c4251a5d40 tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-852278-4"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:34.438721 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-703b1bad-a51e-43c1-aaa6-a8c4251a5d40 tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:34.439206 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-703b1bad-a51e-43c1-aaa6-a8c4251a5d40 tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:34.439632 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-703b1bad-a51e-43c1-aaa6-a8c4251a5d40 tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:34.551086 n-d-852278-4 devstack@n-api.service[134051]: WARNING nova.scheduler.client.report [None req-703b1bad-a51e-43c1-aaa6-a8c4251a5d40 tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] [req-498d8dfd-0e66-4b99-9dcd-3d2fe67192d6] Failed to update aggregates to [] for resource provider with UUID 2adeb535-c4fe-4059-8eb3-6131ec95ecf7. Got 409: {"errors": [{"status": 409, "title": "Conflict", "detail": "There was a conflict when trying to complete your request.\n\n Resource provider's generation already changed. Please update the generation and try again. ", "request_id": "req-498d8dfd-0e66-4b99-9dcd-3d2fe67192d6"}]} Aug 27 02:40:34.687907 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-703b1bad-a51e-43c1-aaa6-a8c4251a5d40 tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 227 microversion: 2.1 time: 0.263845 Aug 27 02:40:34.689475 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 109/193] 10.222.0.70 () {60 vars in 1191 bytes} [Sat Aug 27 02:40:34 2022] POST /compute/v2.1/os-aggregates/2/action => generated 227 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:40:34.766233 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8a54a381-dd63-45b6-8924-1c527e6e2331 tempest-HypervisorAdminNegativeTestJSON-262563124 tempest-HypervisorAdminNegativeTestJSON-262563124-project-admin] Calling method '.version_select at 0x7f5edfaf1310>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:34.768075 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8a54a381-dd63-45b6-8924-1c527e6e2331 tempest-HypervisorAdminNegativeTestJSON-262563124 tempest-HypervisorAdminNegativeTestJSON-262563124-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:34.768584 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8a54a381-dd63-45b6-8924-1c527e6e2331 tempest-HypervisorAdminNegativeTestJSON-262563124 tempest-HypervisorAdminNegativeTestJSON-262563124-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:34.769011 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8a54a381-dd63-45b6-8924-1c527e6e2331 tempest-HypervisorAdminNegativeTestJSON-262563124 tempest-HypervisorAdminNegativeTestJSON-262563124-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:34.795631 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8a54a381-dd63-45b6-8924-1c527e6e2331 tempest-HypervisorAdminNegativeTestJSON-262563124 tempest-HypervisorAdminNegativeTestJSON-262563124-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:34.796264 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8a54a381-dd63-45b6-8924-1c527e6e2331 tempest-HypervisorAdminNegativeTestJSON-262563124 tempest-HypervisorAdminNegativeTestJSON-262563124-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:34.796574 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8a54a381-dd63-45b6-8924-1c527e6e2331 tempest-HypervisorAdminNegativeTestJSON-262563124 tempest-HypervisorAdminNegativeTestJSON-262563124-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:34.808479 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8a54a381-dd63-45b6-8924-1c527e6e2331 tempest-HypervisorAdminNegativeTestJSON-262563124 tempest-HypervisorAdminNegativeTestJSON-262563124-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:34.808972 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8a54a381-dd63-45b6-8924-1c527e6e2331 tempest-HypervisorAdminNegativeTestJSON-262563124 tempest-HypervisorAdminNegativeTestJSON-262563124-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:34.809425 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8a54a381-dd63-45b6-8924-1c527e6e2331 tempest-HypervisorAdminNegativeTestJSON-262563124 tempest-HypervisorAdminNegativeTestJSON-262563124-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:34.815798 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-8a54a381-dd63-45b6-8924-1c527e6e2331 tempest-HypervisorAdminNegativeTestJSON-262563124 tempest-HypervisorAdminNegativeTestJSON-262563124-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.123787 Aug 27 02:40:34.816401 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 110/194] 10.222.0.70 () {58 vars in 1146 bytes} [Sat Aug 27 02:40:34 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:40:34.822673 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-9c053dd8-9fa0-4dbd-ac0d-fee3d6312918 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:34.824540 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-9c053dd8-9fa0-4dbd-ac0d-fee3d6312918 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] [instance: f5d6ba67-b815-4ec1-9d75-ee5436f5e3c7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:34.832383 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9c053dd8-9fa0-4dbd-ac0d-fee3d6312918 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:34.833042 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9c053dd8-9fa0-4dbd-ac0d-fee3d6312918 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:34.833477 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9c053dd8-9fa0-4dbd-ac0d-fee3d6312918 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:34.834173 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9c053dd8-9fa0-4dbd-ac0d-fee3d6312918 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:34.834760 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9c053dd8-9fa0-4dbd-ac0d-fee3d6312918 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:34.835185 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9c053dd8-9fa0-4dbd-ac0d-fee3d6312918 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:34.985274 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-9c053dd8-9fa0-4dbd-ac0d-fee3d6312918 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c850104e6d430397bb54d0e3730a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72992d9dba564526b223533398a94dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:34.997417 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-9c053dd8-9fa0-4dbd-ac0d-fee3d6312918 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] 10.222.0.70 "GET /compute/v2.1/servers/f5d6ba67-b815-4ec1-9d75-ee5436f5e3c7" status: 200 len: 1321 microversion: 2.1 time: 0.177809 Aug 27 02:40:34.999119 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 111/195] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:34 2022] GET /compute/v2.1/servers/f5d6ba67-b815-4ec1-9d75-ee5436f5e3c7 => generated 1321 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:35.004160 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-bae736e0-5a35-43e6-b74f-6dc0aac63cf4 tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:35.016130 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:DELETE=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:40:35.028948 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-bae736e0-5a35-43e6-b74f-6dc0aac63cf4 tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] 10.222.0.70 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.028517 Aug 27 02:40:35.029861 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 112/196] 10.222.0.70 () {58 vars in 1152 bytes} [Sat Aug 27 02:40:34 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 27 02:40:35.035784 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3450b5fb-d894-4c08-85bf-09c0eafe1547 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:35.036761 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-3450b5fb-d894-4c08-85bf-09c0eafe1547 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] [instance: e231e897-7343-415a-a4ff-dfe3df4fb62c] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:35.046515 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3450b5fb-d894-4c08-85bf-09c0eafe1547 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:35.047326 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3450b5fb-d894-4c08-85bf-09c0eafe1547 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:35.048279 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3450b5fb-d894-4c08-85bf-09c0eafe1547 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:35.049043 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3450b5fb-d894-4c08-85bf-09c0eafe1547 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:35.049495 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3450b5fb-d894-4c08-85bf-09c0eafe1547 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:35.049916 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3450b5fb-d894-4c08-85bf-09c0eafe1547 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:35.284079 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-3450b5fb-d894-4c08-85bf-09c0eafe1547 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68711ff38ec41c0b051124527c7ac35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae179f416c451e92e270d2cb0f4400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:35.297649 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-3450b5fb-d894-4c08-85bf-09c0eafe1547 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] 10.222.0.70 "GET /compute/v2.1/servers/e231e897-7343-415a-a4ff-dfe3df4fb62c" status: 200 len: 1468 microversion: 2.1 time: 0.266299 Aug 27 02:40:35.308912 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 113/197] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:35 2022] GET /compute/v2.1/servers/e231e897-7343-415a-a4ff-dfe3df4fb62c => generated 1468 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:35.315641 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-08c56ebb-877b-4d8b-b507-4c424c755da6 tempest-HypervisorAdminNegativeTestJSON-1344240451 tempest-HypervisorAdminNegativeTestJSON-1344240451-project] Calling method '.version_select at 0x7f5edfb3e790>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:35.317878 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-08c56ebb-877b-4d8b-b507-4c424c755da6 tempest-HypervisorAdminNegativeTestJSON-1344240451 tempest-HypervisorAdminNegativeTestJSON-1344240451-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': '57cb032f11da47b09da4bb80f1953f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def18a47833544c2b0da9eb0edaa352c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:35.324788 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-08c56ebb-877b-4d8b-b507-4c424c755da6 tempest-HypervisorAdminNegativeTestJSON-1344240451 tempest-HypervisorAdminNegativeTestJSON-1344240451-project] Request method failure captured: Aug 27 02:40:35.324788 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Aug 27 02:40:35.324788 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:40:35.324788 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:40:35.324788 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:40:35.324788 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:40:35.324788 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:40:35.324788 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:40:35.324788 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:40:35.324788 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:40:35.324788 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYQgsSuVNSMAsrSAx8URMFnfgqfBpUrdM3qDRPIEioozD8tYGEB4iC280D4jWsmauP-fubq-lwX3Dj87LxPzC26XDvshMtMm-6poef05SP5YnIjYWKJT91zjGtDk0q6Pb4tR5C6CuGfeaGHMwDJrdlhdGPMil67isVWEuAzw2Rxm47M Aug 27 02:40:35.324788 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:40:35.324788 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:40:35.324788 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:40:35.324788 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:40:35.324788 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:40:35.324788 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:40:35.324788 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: def18a47833544c2b0da9eb0edaa352c Aug 27 02:40:35.324788 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1344240451 Aug 27 02:40:35.324788 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:40:35.324788 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:40:35.326436 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/def18a47833544c2b0da9eb0edaa352c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_def18a47833544c2b0da9eb0edaa352c", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/def18a47833544c2b0da9eb0edaa352c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/def18a47833544c2b0da9eb0edaa352c"}]}] Aug 27 02:40:35.326436 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1344240451 Aug 27 02:40:35.326436 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: def18a47833544c2b0da9eb0edaa352c Aug 27 02:40:35.326436 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1344240451 Aug 27 02:40:35.326436 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-HypervisorAdminNegativeTestJSON-1344240451-project Aug 27 02:40:35.326436 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:40:35.326436 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:40:35.326436 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 57cb032f11da47b09da4bb80f1953f57 Aug 27 02:40:35.326436 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1344240451-project Aug 27 02:40:35.326436 n-d-852278-4 devstack@n-api.service[134051]: method: Aug 27 02:40:35.326436 n-d-852278-4 devstack@n-api.service[134051]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 27 02:40:35.326436 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '1'} Aug 27 02:40:35.326436 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:40:35.327455 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:35.327455 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:35.327455 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:35.327455 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:40:35.327455 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:40:35.327455 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:40:35.327455 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:40:35.327455 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:40:35.327455 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:40:35.327455 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Aug 27 02:40:35.327455 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Aug 27 02:40:35.327455 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 02:40:35.327455 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 02:40:35.327455 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 02:40:35.327455 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 02:40:35.327455 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 02:40:35.327455 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 02:40:35.327455 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 02:40:35.327455 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 02:40:35.328747 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 02:40:35.328747 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 02:40:35.328747 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 02:40:35.328747 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 02:40:35.328747 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 02:40:35.328747 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 02:40:35.328747 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 27 02:40:35.328747 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:35.328747 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:35.328747 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:35.328747 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:35.328747 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:35.328747 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:35.328747 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 02:40:35.328747 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 02:40:35.328747 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 27 02:40:35.328747 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:35.331299 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-08c56ebb-877b-4d8b-b507-4c424c755da6 tempest-HypervisorAdminNegativeTestJSON-1344240451 tempest-HypervisorAdminNegativeTestJSON-1344240451-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:40:35.332680 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-08c56ebb-877b-4d8b-b507-4c424c755da6 tempest-HypervisorAdminNegativeTestJSON-1344240451 tempest-HypervisorAdminNegativeTestJSON-1344240451-project] 10.222.0.70 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.022214 Aug 27 02:40:35.334717 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 114/198] 10.222.0.70 () {58 vars in 1173 bytes} [Sat Aug 27 02:40:35 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 25 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:40:35.341631 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-9f4fe22f-0ea1-4fbd-93a8-8a62c44a5e84 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:35.344909 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-9f4fe22f-0ea1-4fbd-93a8-8a62c44a5e84 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] [instance: 11661332-bcfc-46f3-a5ba-30eb82448817] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:35.355036 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9f4fe22f-0ea1-4fbd-93a8-8a62c44a5e84 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:35.356419 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9f4fe22f-0ea1-4fbd-93a8-8a62c44a5e84 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:35.357114 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9f4fe22f-0ea1-4fbd-93a8-8a62c44a5e84 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:35.358025 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9f4fe22f-0ea1-4fbd-93a8-8a62c44a5e84 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:35.359042 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9f4fe22f-0ea1-4fbd-93a8-8a62c44a5e84 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:35.359644 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9f4fe22f-0ea1-4fbd-93a8-8a62c44a5e84 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:35.469673 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-9f4fe22f-0ea1-4fbd-93a8-8a62c44a5e84 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772e2e66c92e44f8838ce325437d5a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b2f4a529a3e4ea0937ca903dd5924bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:35.478704 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-9f4fe22f-0ea1-4fbd-93a8-8a62c44a5e84 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] 10.222.0.70 "GET /compute/v2.1/servers/11661332-bcfc-46f3-a5ba-30eb82448817" status: 200 len: 1280 microversion: 2.1 time: 0.142507 Aug 27 02:40:35.479824 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 115/199] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:35 2022] GET /compute/v2.1/servers/11661332-bcfc-46f3-a5ba-30eb82448817 => generated 1280 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:35.492382 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3b3a9041-6768-4918-8e31-49f80afd39c8 tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-440926648"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:35.497876 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.objects.aggregate [None req-3b3a9041-6768-4918-8e31-49f80afd39c8 tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] Generated uuid 61215f49-6c1a-4823-abb7-3d9e067f30eb for aggregate {{(pid=134051) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 02:40:35.525803 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-3b3a9041-6768-4918-8e31-49f80afd39c8 tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.044877 Aug 27 02:40:35.526457 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 116/200] 10.222.0.70 () {60 vars in 1164 bytes} [Sat Aug 27 02:40:35 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:40:35.670063 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ca6d666c-5a14-44ba-96e6-ecb17f3d2d57 tempest-LiveMigrationNegativeTest-1402864585 tempest-LiveMigrationNegativeTest-1402864585-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-505171598", "block_migration": true, "disk_over_commit": false}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:35.672765 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-ca6d666c-5a14-44ba-96e6-ecb17f3d2d57 tempest-LiveMigrationNegativeTest-1402864585 tempest-LiveMigrationNegativeTest-1402864585-project-admin] [instance: e231e897-7343-415a-a4ff-dfe3df4fb62c] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:35.680120 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ca6d666c-5a14-44ba-96e6-ecb17f3d2d57 tempest-LiveMigrationNegativeTest-1402864585 tempest-LiveMigrationNegativeTest-1402864585-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:35.680652 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ca6d666c-5a14-44ba-96e6-ecb17f3d2d57 tempest-LiveMigrationNegativeTest-1402864585 tempest-LiveMigrationNegativeTest-1402864585-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:35.681069 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ca6d666c-5a14-44ba-96e6-ecb17f3d2d57 tempest-LiveMigrationNegativeTest-1402864585 tempest-LiveMigrationNegativeTest-1402864585-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:35.681769 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ca6d666c-5a14-44ba-96e6-ecb17f3d2d57 tempest-LiveMigrationNegativeTest-1402864585 tempest-LiveMigrationNegativeTest-1402864585-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:35.682534 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ca6d666c-5a14-44ba-96e6-ecb17f3d2d57 tempest-LiveMigrationNegativeTest-1402864585 tempest-LiveMigrationNegativeTest-1402864585-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:35.682877 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ca6d666c-5a14-44ba-96e6-ecb17f3d2d57 tempest-LiveMigrationNegativeTest-1402864585 tempest-LiveMigrationNegativeTest-1402864585-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:35.789861 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.objects.instance [None req-ca6d666c-5a14-44ba-96e6-ecb17f3d2d57 tempest-LiveMigrationNegativeTest-1402864585 tempest-LiveMigrationNegativeTest-1402864585-project-admin] Lazy-loading 'flavor' on Instance uuid e231e897-7343-415a-a4ff-dfe3df4fb62c {{(pid=134051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:40:35.859298 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-ca6d666c-5a14-44ba-96e6-ecb17f3d2d57 tempest-LiveMigrationNegativeTest-1402864585 tempest-LiveMigrationNegativeTest-1402864585-project-admin] [instance: e231e897-7343-415a-a4ff-dfe3df4fb62c] Going to try to live migrate instance to tempest-host-505171598 {{(pid=134051) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 27 02:40:35.873525 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-ca6d666c-5a14-44ba-96e6-ecb17f3d2d57 tempest-LiveMigrationNegativeTest-1402864585 tempest-LiveMigrationNegativeTest-1402864585-project-admin] HTTP exception thrown: Compute host tempest-host-505171598 could not be found. Aug 27 02:40:35.882256 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ca6d666c-5a14-44ba-96e6-ecb17f3d2d57 tempest-LiveMigrationNegativeTest-1402864585 tempest-LiveMigrationNegativeTest-1402864585-project-admin] Request method failure captured: Aug 27 02:40:35.882256 n-d-852278-4 devstack@n-api.service[134051]: request: POST /compute/v2.1/servers/e231e897-7343-415a-a4ff-dfe3df4fb62c/action HTTP/1.1 Aug 27 02:40:35.882256 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:40:35.882256 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:40:35.882256 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:40:35.882256 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 106 Aug 27 02:40:35.882256 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:40:35.882256 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:40:35.882256 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:40:35.882256 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:40:35.882256 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYQPZ8e0RiVnzadiVTo5YSeRkqlQNwqY4o5OtR3yWoxkRgQY1f6hUnaxVIBJc0iAB8_tufVnR38_j9AdwXY02SU6BYlZ2YXgK0eBr1B2vRIAFcL1nkrElNTramIWMKfmZihnwPfuEk44R_BqNeX3vbjcyr_CI67kTdJYDYboO0aPW54 Aug 27 02:40:35.882256 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:40:35.882256 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:40:35.882256 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:40:35.882256 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:40:35.882256 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:40:35.882256 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:40:35.882256 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: ebbdf41a68db45799fced441024c45f6 Aug 27 02:40:35.882256 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-LiveMigrationNegativeTest-1402864585 Aug 27 02:40:35.882256 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,admin,member Aug 27 02:40:35.882256 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,admin,member Aug 27 02:40:35.883447 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ebbdf41a68db45799fced441024c45f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_ebbdf41a68db45799fced441024c45f6", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ebbdf41a68db45799fced441024c45f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/ebbdf41a68db45799fced441024c45f6"}]}] Aug 27 02:40:35.883447 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-LiveMigrationNegativeTest-1402864585 Aug 27 02:40:35.883447 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: ebbdf41a68db45799fced441024c45f6 Aug 27 02:40:35.883447 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1402864585 Aug 27 02:40:35.883447 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-LiveMigrationNegativeTest-1402864585-project-admin Aug 27 02:40:35.883447 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:40:35.883447 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:40:35.883447 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 3380475a366f4b8aa2d8512f2244863a Aug 27 02:40:35.883447 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-LiveMigrationNegativeTest-1402864585-project-admin Aug 27 02:40:35.883447 n-d-852278-4 devstack@n-api.service[134051]: Aug 27 02:40:35.883447 n-d-852278-4 devstack@n-api.service[134051]: {"os-migrateLive": {"host": "tempest-host-505171598", "block_migration": true, "disk_over_commit": false}} Aug 27 02:40:35.883447 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 02:40:35.884275 n-d-852278-4 devstack@n-api.service[134051]: exception: Compute host tempest-host-505171598 could not be found. Aug 27 02:40:35.884275 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': 'e231e897-7343-415a-a4ff-dfe3df4fb62c', 'body': {'os-migrateLive': {'host': 'tempest-host-505171598', 'block_migration': True, 'disk_over_commit': False}}} Aug 27 02:40:35.884275 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:40:35.884275 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:35.884275 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Aug 27 02:40:35.884275 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Aug 27 02:40:35.884275 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 27 02:40:35.884275 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 02:40:35.884275 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 27 02:40:35.884275 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 27 02:40:35.884275 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Aug 27 02:40:35.884275 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 27 02:40:35.884275 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 27 02:40:35.884275 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 27 02:40:35.884275 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Aug 27 02:40:35.884275 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 27 02:40:35.884275 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Aug 27 02:40:35.884275 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 27 02:40:35.884275 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 02:40:35.885435 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 02:40:35.885435 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 27 02:40:35.885435 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 27 02:40:35.885435 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5486, in live_migrate Aug 27 02:40:35.885435 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Aug 27 02:40:35.885435 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 02:40:35.885435 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 02:40:35.885435 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Aug 27 02:40:35.885435 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Aug 27 02:40:35.885435 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Aug 27 02:40:35.885435 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:40:35.885435 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Aug 27 02:40:35.885435 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Aug 27 02:40:35.885435 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Aug 27 02:40:35.885435 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Aug 27 02:40:35.885435 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Aug 27 02:40:35.885435 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Aug 27 02:40:35.885435 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-505171598 could not be found. Aug 27 02:40:35.885435 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:35.886625 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:35.886625 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:35.886625 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:35.886625 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:35.886625 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:35.886625 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:40:35.886625 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:40:35.886625 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:40:35.886625 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:40:35.886625 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:40:35.886625 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:40:35.886625 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:40:35.886625 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:40:35.886625 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:40:35.886625 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:40:35.886625 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 27 02:40:35.886625 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Aug 27 02:40:35.886625 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 27 02:40:35.886625 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-505171598 could not be found. Aug 27 02:40:35.886625 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:35.887717 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:35.887717 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:35.887717 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:35.887717 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:35.887717 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:35.887717 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:40:35.887717 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:40:35.887717 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-505171598 could not be found. Aug 27 02:40:35.887717 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:35.887717 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ca6d666c-5a14-44ba-96e6-ecb17f3d2d57 tempest-LiveMigrationNegativeTest-1402864585 tempest-LiveMigrationNegativeTest-1402864585-project-admin] Returning 400 to user: Compute host tempest-host-505171598 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:40:35.887717 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ca6d666c-5a14-44ba-96e6-ecb17f3d2d57 tempest-LiveMigrationNegativeTest-1402864585 tempest-LiveMigrationNegativeTest-1402864585-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/e231e897-7343-415a-a4ff-dfe3df4fb62c/action" status: 400 len: 99 microversion: 2.1 time: 0.357703 Aug 27 02:40:35.887717 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 117/201] 10.222.0.70 () {60 vars in 1279 bytes} [Sat Aug 27 02:40:35 2022] POST /compute/v2.1/servers/e231e897-7343-415a-a4ff-dfe3df4fb62c/action => generated 99 bytes in 359 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 27 02:40:35.891334 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-cce8e41e-f34f-4c91-b90c-5ce2a207916c tempest-HypervisorAdminNegativeTestJSON-262563124 tempest-HypervisorAdminNegativeTestJSON-262563124-project-admin] Calling method '.version_select at 0x7f5edfa64670>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:35.893313 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-cce8e41e-f34f-4c91-b90c-5ce2a207916c tempest-HypervisorAdminNegativeTestJSON-262563124 tempest-HypervisorAdminNegativeTestJSON-262563124-project-admin] HTTP exception thrown: Hypervisor with ID '04e4af22-16d5-4caf-a2d2-ffe023c95681' could not be found. Aug 27 02:40:35.907234 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-cce8e41e-f34f-4c91-b90c-5ce2a207916c tempest-HypervisorAdminNegativeTestJSON-262563124 tempest-HypervisorAdminNegativeTestJSON-262563124-project-admin] Request method failure captured: Aug 27 02:40:35.907234 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/os-hypervisors/04e4af22-16d5-4caf-a2d2-ffe023c95681/uptime HTTP/1.1 Aug 27 02:40:35.907234 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:40:35.907234 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:40:35.907234 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:40:35.907234 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:40:35.907234 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:40:35.907234 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:40:35.907234 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:40:35.907234 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:40:35.907234 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYQhuJIqO-t3tEsuWzmW2PjJSYGgsahlfIGKbagskGtaW7qVunBE2hdNI2ozypOwb_q-KmCWhNLl-lVntppTE8aWBVAOspxCFBR63t-_LlfTr25GZLsGhQzkUN4pscMzeNQfw-CZEMfnh_ilPR-nszArLAoU6OLnpNEuewk1uIeAbgE Aug 27 02:40:35.907234 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:40:35.907234 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:40:35.907234 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:40:35.907234 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:40:35.907234 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:40:35.907234 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:40:35.907234 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 3b301a65231a459fa24875b05924f2f0 Aug 27 02:40:35.907234 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-262563124 Aug 27 02:40:35.907234 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,admin,member Aug 27 02:40:35.907234 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,admin,member Aug 27 02:40:35.908743 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3b301a65231a459fa24875b05924f2f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3b301a65231a459fa24875b05924f2f0", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3b301a65231a459fa24875b05924f2f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3b301a65231a459fa24875b05924f2f0"}]}] Aug 27 02:40:35.908743 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-262563124 Aug 27 02:40:35.908743 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 3b301a65231a459fa24875b05924f2f0 Aug 27 02:40:35.908743 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-262563124 Aug 27 02:40:35.908743 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-HypervisorAdminNegativeTestJSON-262563124-project-admin Aug 27 02:40:35.908743 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:40:35.908743 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:40:35.908743 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 615ab1a3d2b7410fae232d71e7fee965 Aug 27 02:40:35.908743 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-262563124-project-admin Aug 27 02:40:35.908743 n-d-852278-4 devstack@n-api.service[134051]: method: Aug 27 02:40:35.908743 n-d-852278-4 devstack@n-api.service[134051]: exception: Hypervisor with ID '04e4af22-16d5-4caf-a2d2-ffe023c95681' could not be found. Aug 27 02:40:35.908743 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '04e4af22-16d5-4caf-a2d2-ffe023c95681'} Aug 27 02:40:35.909746 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:40:35.909746 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:35.909746 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Aug 27 02:40:35.909746 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi value = int(str(value)) Aug 27 02:40:35.909746 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '04e4af22-16d5-4caf-a2d2-ffe023c95681' Aug 27 02:40:35.909746 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:35.909746 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:35.909746 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:35.909746 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:35.909746 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Aug 27 02:40:35.909746 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Aug 27 02:40:35.909746 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Aug 27 02:40:35.909746 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Aug 27 02:40:35.909746 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Aug 27 02:40:35.909746 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:35.909746 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:35.909746 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:35.909746 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:35.909746 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Aug 27 02:40:35.909746 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Aug 27 02:40:35.909746 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Aug 27 02:40:35.909746 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Aug 27 02:40:35.911263 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Aug 27 02:40:35.911263 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:35.911263 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:35.911263 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:35.911263 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:35.911263 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:35.911263 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:35.911263 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:40:35.911263 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:40:35.911263 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:40:35.911263 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:40:35.911263 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:40:35.911263 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:40:35.911263 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Aug 27 02:40:35.911263 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Aug 27 02:40:35.911263 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Aug 27 02:40:35.911263 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 27 02:40:35.911263 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '04e4af22-16d5-4caf-a2d2-ffe023c95681' could not be found. Aug 27 02:40:35.911263 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:35.911263 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:35.911263 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:35.913495 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:35.913495 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:35.913495 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:35.913495 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:40:35.913495 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:40:35.913495 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '04e4af22-16d5-4caf-a2d2-ffe023c95681' could not be found. Aug 27 02:40:35.913495 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:35.918051 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-cce8e41e-f34f-4c91-b90c-5ce2a207916c tempest-HypervisorAdminNegativeTestJSON-262563124 tempest-HypervisorAdminNegativeTestJSON-262563124-project-admin] Returning 404 to user: Hypervisor with ID '04e4af22-16d5-4caf-a2d2-ffe023c95681' could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:40:35.919937 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-cce8e41e-f34f-4c91-b90c-5ce2a207916c tempest-HypervisorAdminNegativeTestJSON-262563124 tempest-HypervisorAdminNegativeTestJSON-262563124-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors/04e4af22-16d5-4caf-a2d2-ffe023c95681/uptime" status: 404 len: 123 microversion: 2.1 time: 0.032910 Aug 27 02:40:35.921143 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 118/202] 10.222.0.70 () {58 vars in 1278 bytes} [Sat Aug 27 02:40:35 2022] GET /compute/v2.1/os-hypervisors/04e4af22-16d5-4caf-a2d2-ffe023c95681/uptime => generated 123 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:40:35.930731 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a33a6a43-5c20-4553-87b2-42ce417c6146 tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-852278-4"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:35.952991 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a33a6a43-5c20-4553-87b2-42ce417c6146 tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:35.960778 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a33a6a43-5c20-4553-87b2-42ce417c6146 tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:35.961510 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a33a6a43-5c20-4553-87b2-42ce417c6146 tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:36.113959 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a33a6a43-5c20-4553-87b2-42ce417c6146 tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 241 microversion: 2.1 time: 0.191404 Aug 27 02:40:36.122160 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 119/203] 10.222.0.70 () {60 vars in 1191 bytes} [Sat Aug 27 02:40:35 2022] POST /compute/v2.1/os-aggregates/3/action => generated 241 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:40:36.127190 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-1386a6ca-fd95-46ee-9d7e-5cda4aa156ba tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:36.127801 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-1386a6ca-fd95-46ee-9d7e-5cda4aa156ba tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] [instance: e231e897-7343-415a-a4ff-dfe3df4fb62c] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:36.134673 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1386a6ca-fd95-46ee-9d7e-5cda4aa156ba tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:36.135538 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1386a6ca-fd95-46ee-9d7e-5cda4aa156ba tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:36.136051 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1386a6ca-fd95-46ee-9d7e-5cda4aa156ba tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:36.136845 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1386a6ca-fd95-46ee-9d7e-5cda4aa156ba tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:36.137354 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1386a6ca-fd95-46ee-9d7e-5cda4aa156ba tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:36.137839 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1386a6ca-fd95-46ee-9d7e-5cda4aa156ba tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:36.323598 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-110fe605-ffed-4f4c-b7d6-600007d7d775 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/12acf567-09ef-4971-b085-8b5566fd1b79/action" status: 202 len: 0 microversion: 2.25 time: 2.698912 Aug 27 02:40:36.324974 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 85/204] 10.222.0.70 () {62 vars in 1319 bytes} [Sat Aug 27 02:40:33 2022] POST /compute/v2.1/servers/12acf567-09ef-4971-b085-8b5566fd1b79/action => generated 0 bytes in 2701 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:40:36.333410 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3359fedd-5ce8-4dad-9448-a6709bdb6851 tempest-HypervisorAdminNegativeTestJSON-262563124 tempest-HypervisorAdminNegativeTestJSON-262563124-project-admin] Calling method '.version_select at 0x7f5ee3a2a430>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:36.337749 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3359fedd-5ce8-4dad-9448-a6709bdb6851 tempest-HypervisorAdminNegativeTestJSON-262563124 tempest-HypervisorAdminNegativeTestJSON-262563124-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:36.338376 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3359fedd-5ce8-4dad-9448-a6709bdb6851 tempest-HypervisorAdminNegativeTestJSON-262563124 tempest-HypervisorAdminNegativeTestJSON-262563124-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:36.339459 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3359fedd-5ce8-4dad-9448-a6709bdb6851 tempest-HypervisorAdminNegativeTestJSON-262563124 tempest-HypervisorAdminNegativeTestJSON-262563124-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:36.360709 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3359fedd-5ce8-4dad-9448-a6709bdb6851 tempest-HypervisorAdminNegativeTestJSON-262563124 tempest-HypervisorAdminNegativeTestJSON-262563124-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:36.362452 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3359fedd-5ce8-4dad-9448-a6709bdb6851 tempest-HypervisorAdminNegativeTestJSON-262563124 tempest-HypervisorAdminNegativeTestJSON-262563124-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:36.363421 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3359fedd-5ce8-4dad-9448-a6709bdb6851 tempest-HypervisorAdminNegativeTestJSON-262563124 tempest-HypervisorAdminNegativeTestJSON-262563124-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:36.378681 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3359fedd-5ce8-4dad-9448-a6709bdb6851 tempest-HypervisorAdminNegativeTestJSON-262563124 tempest-HypervisorAdminNegativeTestJSON-262563124-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:36.379509 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3359fedd-5ce8-4dad-9448-a6709bdb6851 tempest-HypervisorAdminNegativeTestJSON-262563124 tempest-HypervisorAdminNegativeTestJSON-262563124-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:36.380131 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3359fedd-5ce8-4dad-9448-a6709bdb6851 tempest-HypervisorAdminNegativeTestJSON-262563124 tempest-HypervisorAdminNegativeTestJSON-262563124-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:36.390625 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-3359fedd-5ce8-4dad-9448-a6709bdb6851 tempest-HypervisorAdminNegativeTestJSON-262563124 tempest-HypervisorAdminNegativeTestJSON-262563124-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.064063 Aug 27 02:40:36.399903 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 86/205] 10.222.0.70 () {58 vars in 1146 bytes} [Sat Aug 27 02:40:36 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:40:36.408384 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-fe8b035e-40bf-4c19-8d58-75c2ef5027e3 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:36.410065 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-fe8b035e-40bf-4c19-8d58-75c2ef5027e3 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] [instance: f5d6ba67-b815-4ec1-9d75-ee5436f5e3c7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:36.418412 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fe8b035e-40bf-4c19-8d58-75c2ef5027e3 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:36.419399 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fe8b035e-40bf-4c19-8d58-75c2ef5027e3 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:36.420707 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fe8b035e-40bf-4c19-8d58-75c2ef5027e3 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:36.421696 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fe8b035e-40bf-4c19-8d58-75c2ef5027e3 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:36.423455 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fe8b035e-40bf-4c19-8d58-75c2ef5027e3 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:36.424756 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fe8b035e-40bf-4c19-8d58-75c2ef5027e3 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:36.470958 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-1386a6ca-fd95-46ee-9d7e-5cda4aa156ba tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68711ff38ec41c0b051124527c7ac35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae179f416c451e92e270d2cb0f4400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:36.480912 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-1386a6ca-fd95-46ee-9d7e-5cda4aa156ba tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] 10.222.0.70 "GET /compute/v2.1/servers/e231e897-7343-415a-a4ff-dfe3df4fb62c" status: 200 len: 1468 microversion: 2.1 time: 0.357540 Aug 27 02:40:36.487600 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 120/206] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:36 2022] GET /compute/v2.1/servers/e231e897-7343-415a-a4ff-dfe3df4fb62c => generated 1468 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:36.501345 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-2268915c-f222-4521-a7e9-9b422699ad9a tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:36.549849 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-2268915c-f222-4521-a7e9-9b422699ad9a tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] 10.222.0.70 "GET /compute/v2.1/os-aggregates" status: 200 len: 244 microversion: 2.1 time: 0.061302 Aug 27 02:40:36.557435 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 121/207] 10.222.0.70 () {58 vars in 1143 bytes} [Sat Aug 27 02:40:36 2022] GET /compute/v2.1/os-aggregates => generated 244 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:40:36.576224 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-727789e0-b9df-4d7c-aba5-b231fecfaff6 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:36.578951 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-727789e0-b9df-4d7c-aba5-b231fecfaff6 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: 12acf567-09ef-4971-b085-8b5566fd1b79] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:36.593307 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-727789e0-b9df-4d7c-aba5-b231fecfaff6 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:36.593798 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-727789e0-b9df-4d7c-aba5-b231fecfaff6 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:36.594263 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-727789e0-b9df-4d7c-aba5-b231fecfaff6 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:36.595162 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-727789e0-b9df-4d7c-aba5-b231fecfaff6 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:36.595621 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-727789e0-b9df-4d7c-aba5-b231fecfaff6 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:36.596055 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-727789e0-b9df-4d7c-aba5-b231fecfaff6 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:36.786011 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-fe8b035e-40bf-4c19-8d58-75c2ef5027e3 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c850104e6d430397bb54d0e3730a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72992d9dba564526b223533398a94dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:36.794786 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-fe8b035e-40bf-4c19-8d58-75c2ef5027e3 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] 10.222.0.70 "GET /compute/v2.1/servers/f5d6ba67-b815-4ec1-9d75-ee5436f5e3c7" status: 200 len: 1388 microversion: 2.1 time: 0.393076 Aug 27 02:40:36.795534 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 87/208] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:36 2022] GET /compute/v2.1/servers/f5d6ba67-b815-4ec1-9d75-ee5436f5e3c7 => generated 1388 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:36.814088 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-51be80c8-49b1-4043-953e-3f2751246b61 tempest-HypervisorAdminNegativeTestJSON-1344240451 tempest-HypervisorAdminNegativeTestJSON-1344240451-project] Calling method '.version_select at 0x7f5ee38e55e0>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:36.816116 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-51be80c8-49b1-4043-953e-3f2751246b61 tempest-HypervisorAdminNegativeTestJSON-1344240451 tempest-HypervisorAdminNegativeTestJSON-1344240451-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': '57cb032f11da47b09da4bb80f1953f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def18a47833544c2b0da9eb0edaa352c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:36.818810 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-51be80c8-49b1-4043-953e-3f2751246b61 tempest-HypervisorAdminNegativeTestJSON-1344240451 tempest-HypervisorAdminNegativeTestJSON-1344240451-project] Request method failure captured: Aug 27 02:40:36.818810 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Aug 27 02:40:36.818810 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:40:36.818810 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:40:36.818810 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:40:36.818810 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:40:36.818810 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:40:36.818810 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:40:36.818810 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:40:36.818810 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:40:36.818810 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYQgsSuVNSMAsrSAx8URMFnfgqfBpUrdM3qDRPIEioozD8tYGEB4iC280D4jWsmauP-fubq-lwX3Dj87LxPzC26XDvshMtMm-6poef05SP5YnIjYWKJT91zjGtDk0q6Pb4tR5C6CuGfeaGHMwDJrdlhdGPMil67isVWEuAzw2Rxm47M Aug 27 02:40:36.818810 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:40:36.818810 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:40:36.818810 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:40:36.818810 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:40:36.818810 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:40:36.818810 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:40:36.818810 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: def18a47833544c2b0da9eb0edaa352c Aug 27 02:40:36.818810 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1344240451 Aug 27 02:40:36.818810 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:40:36.818810 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:40:36.820179 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/def18a47833544c2b0da9eb0edaa352c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_def18a47833544c2b0da9eb0edaa352c", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/def18a47833544c2b0da9eb0edaa352c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/def18a47833544c2b0da9eb0edaa352c"}]}] Aug 27 02:40:36.820179 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1344240451 Aug 27 02:40:36.820179 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: def18a47833544c2b0da9eb0edaa352c Aug 27 02:40:36.820179 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1344240451 Aug 27 02:40:36.820179 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-HypervisorAdminNegativeTestJSON-1344240451-project Aug 27 02:40:36.820179 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:40:36.820179 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:40:36.820179 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 57cb032f11da47b09da4bb80f1953f57 Aug 27 02:40:36.820179 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1344240451-project Aug 27 02:40:36.820179 n-d-852278-4 devstack@n-api.service[134052]: method: Aug 27 02:40:36.820179 n-d-852278-4 devstack@n-api.service[134052]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 27 02:40:36.820179 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '1'} Aug 27 02:40:36.820179 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:40:36.820910 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:36.820910 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:36.820910 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:36.820910 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:40:36.820910 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:40:36.820910 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:40:36.820910 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:40:36.820910 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:40:36.820910 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:40:36.820910 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Aug 27 02:40:36.820910 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 27 02:40:36.820910 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Aug 27 02:40:36.820910 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Aug 27 02:40:36.820910 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 02:40:36.820910 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 02:40:36.820910 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 02:40:36.820910 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 02:40:36.820910 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 02:40:36.820910 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 02:40:36.822000 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 02:40:36.822000 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 02:40:36.822000 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 02:40:36.822000 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 02:40:36.822000 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 02:40:36.822000 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 02:40:36.822000 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 02:40:36.822000 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 02:40:36.822000 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 27 02:40:36.822000 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:36.822000 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:36.822000 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:36.822000 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:36.822000 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:36.822000 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:36.822000 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 02:40:36.822000 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 02:40:36.822000 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 27 02:40:36.822000 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:36.824159 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-51be80c8-49b1-4043-953e-3f2751246b61 tempest-HypervisorAdminNegativeTestJSON-1344240451 tempest-HypervisorAdminNegativeTestJSON-1344240451-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:40:36.825052 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-51be80c8-49b1-4043-953e-3f2751246b61 tempest-HypervisorAdminNegativeTestJSON-1344240451 tempest-HypervisorAdminNegativeTestJSON-1344240451-project] 10.222.0.70 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.015454 Aug 27 02:40:36.825910 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 88/209] 10.222.0.70 () {58 vars in 1152 bytes} [Sat Aug 27 02:40:36 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:40:36.831486 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0c4f968a-4414-4845-8f40-edd814370a2e tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:36.832874 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-0c4f968a-4414-4845-8f40-edd814370a2e tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] [instance: 11661332-bcfc-46f3-a5ba-30eb82448817] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:36.840880 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0c4f968a-4414-4845-8f40-edd814370a2e tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:36.841731 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0c4f968a-4414-4845-8f40-edd814370a2e tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:36.843508 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0c4f968a-4414-4845-8f40-edd814370a2e tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:36.844943 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0c4f968a-4414-4845-8f40-edd814370a2e tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:36.845403 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0c4f968a-4414-4845-8f40-edd814370a2e tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:36.845821 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0c4f968a-4414-4845-8f40-edd814370a2e tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:36.869477 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-727789e0-b9df-4d7c-aba5-b231fecfaff6 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:36.881088 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-727789e0-b9df-4d7c-aba5-b231fecfaff6 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:36.882795 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-727789e0-b9df-4d7c-aba5-b231fecfaff6 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:36.884019 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-727789e0-b9df-4d7c-aba5-b231fecfaff6 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/12acf567-09ef-4971-b085-8b5566fd1b79" status: 200 len: 1566 microversion: 2.25 time: 0.320252 Aug 27 02:40:36.889879 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 122/210] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:40:36 2022] GET /compute/v2.1/servers/12acf567-09ef-4971-b085-8b5566fd1b79 => generated 1566 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:40:36.899276 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-9d82187b-673c-4e61-af13-d4d7227944ae tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-852278-4"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:36.917044 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9d82187b-673c-4e61-af13-d4d7227944ae tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:36.917912 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9d82187b-673c-4e61-af13-d4d7227944ae tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:36.918558 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9d82187b-673c-4e61-af13-d4d7227944ae tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:37.072417 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-9d82187b-673c-4e61-af13-d4d7227944ae tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 226 microversion: 2.1 time: 0.181172 Aug 27 02:40:37.073369 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 123/211] 10.222.0.70 () {60 vars in 1191 bytes} [Sat Aug 27 02:40:36 2022] POST /compute/v2.1/os-aggregates/3/action => generated 226 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:40:37.080723 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c77fc37f-1cc6-4516-9252-b93aeb5ddedc tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1303456829", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:37.112403 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0c4f968a-4414-4845-8f40-edd814370a2e tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772e2e66c92e44f8838ce325437d5a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b2f4a529a3e4ea0937ca903dd5924bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:37.122010 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-0c4f968a-4414-4845-8f40-edd814370a2e tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] 10.222.0.70 "GET /compute/v2.1/servers/11661332-bcfc-46f3-a5ba-30eb82448817" status: 200 len: 1320 microversion: 2.1 time: 0.294801 Aug 27 02:40:37.122976 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 89/212] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:36 2022] GET /compute/v2.1/servers/11661332-bcfc-46f3-a5ba-30eb82448817 => generated 1320 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:37.128635 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-fc3b1c51-07be-4367-b82f-3d8fc796560e tempest-HypervisorAdminNegativeTestJSON-262563124 tempest-HypervisorAdminNegativeTestJSON-262563124-project-admin] Calling method '.version_select at 0x7f5ee3b15e50>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:37.130530 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-fc3b1c51-07be-4367-b82f-3d8fc796560e tempest-HypervisorAdminNegativeTestJSON-262563124 tempest-HypervisorAdminNegativeTestJSON-262563124-project-admin] HTTP exception thrown: Hypervisor with ID '787a4d8d-edd5-4eba-a9e7-3777b5948c49' could not be found. Aug 27 02:40:37.133291 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-fc3b1c51-07be-4367-b82f-3d8fc796560e tempest-HypervisorAdminNegativeTestJSON-262563124 tempest-HypervisorAdminNegativeTestJSON-262563124-project-admin] Request method failure captured: Aug 27 02:40:37.133291 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/os-hypervisors/787a4d8d-edd5-4eba-a9e7-3777b5948c49 HTTP/1.1 Aug 27 02:40:37.133291 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:40:37.133291 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:40:37.133291 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:40:37.133291 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:40:37.133291 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:40:37.133291 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:40:37.133291 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:40:37.133291 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:40:37.133291 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYQhuJIqO-t3tEsuWzmW2PjJSYGgsahlfIGKbagskGtaW7qVunBE2hdNI2ozypOwb_q-KmCWhNLl-lVntppTE8aWBVAOspxCFBR63t-_LlfTr25GZLsGhQzkUN4pscMzeNQfw-CZEMfnh_ilPR-nszArLAoU6OLnpNEuewk1uIeAbgE Aug 27 02:40:37.133291 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:40:37.133291 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:40:37.133291 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:40:37.133291 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:40:37.133291 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:40:37.133291 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:40:37.133291 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 3b301a65231a459fa24875b05924f2f0 Aug 27 02:40:37.133291 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-262563124 Aug 27 02:40:37.133291 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,admin,member Aug 27 02:40:37.133291 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,admin,member Aug 27 02:40:37.134499 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3b301a65231a459fa24875b05924f2f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3b301a65231a459fa24875b05924f2f0", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3b301a65231a459fa24875b05924f2f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3b301a65231a459fa24875b05924f2f0"}]}] Aug 27 02:40:37.134499 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-262563124 Aug 27 02:40:37.134499 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 3b301a65231a459fa24875b05924f2f0 Aug 27 02:40:37.134499 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-262563124 Aug 27 02:40:37.134499 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-HypervisorAdminNegativeTestJSON-262563124-project-admin Aug 27 02:40:37.134499 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:40:37.134499 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:40:37.134499 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 615ab1a3d2b7410fae232d71e7fee965 Aug 27 02:40:37.134499 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-262563124-project-admin Aug 27 02:40:37.134499 n-d-852278-4 devstack@n-api.service[134052]: method: Aug 27 02:40:37.134499 n-d-852278-4 devstack@n-api.service[134052]: exception: Hypervisor with ID '787a4d8d-edd5-4eba-a9e7-3777b5948c49' could not be found. Aug 27 02:40:37.134499 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '787a4d8d-edd5-4eba-a9e7-3777b5948c49'} Aug 27 02:40:37.135130 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:40:37.135130 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:37.135130 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Aug 27 02:40:37.135130 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi value = int(str(value)) Aug 27 02:40:37.135130 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '787a4d8d-edd5-4eba-a9e7-3777b5948c49' Aug 27 02:40:37.135130 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:37.135130 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:37.135130 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:37.135130 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:37.135130 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Aug 27 02:40:37.135130 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Aug 27 02:40:37.135130 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Aug 27 02:40:37.135130 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Aug 27 02:40:37.135130 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Aug 27 02:40:37.135130 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:37.135130 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:37.135130 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:37.135130 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:37.135130 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Aug 27 02:40:37.135130 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Aug 27 02:40:37.135130 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Aug 27 02:40:37.135130 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Aug 27 02:40:37.136247 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Aug 27 02:40:37.136247 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:37.136247 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:37.136247 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:37.136247 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:37.136247 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:37.136247 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:37.136247 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:40:37.136247 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:40:37.136247 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:40:37.136247 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:40:37.136247 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:40:37.136247 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:40:37.136247 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Aug 27 02:40:37.136247 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 27 02:40:37.136247 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Aug 27 02:40:37.136247 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Aug 27 02:40:37.136247 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Aug 27 02:40:37.136247 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 27 02:40:37.136247 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '787a4d8d-edd5-4eba-a9e7-3777b5948c49' could not be found. Aug 27 02:40:37.137635 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:37.137635 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:37.137635 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:37.137635 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:37.137635 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:37.137635 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:37.137635 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:40:37.137635 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:40:37.137635 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '787a4d8d-edd5-4eba-a9e7-3777b5948c49' could not be found. Aug 27 02:40:37.137635 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:37.139523 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-fc3b1c51-07be-4367-b82f-3d8fc796560e tempest-HypervisorAdminNegativeTestJSON-262563124 tempest-HypervisorAdminNegativeTestJSON-262563124-project-admin] Returning 404 to user: Hypervisor with ID '787a4d8d-edd5-4eba-a9e7-3777b5948c49' could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:40:37.141247 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-fc3b1c51-07be-4367-b82f-3d8fc796560e tempest-HypervisorAdminNegativeTestJSON-262563124 tempest-HypervisorAdminNegativeTestJSON-262563124-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors/787a4d8d-edd5-4eba-a9e7-3777b5948c49" status: 404 len: 123 microversion: 2.1 time: 0.016848 Aug 27 02:40:37.141972 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 90/213] 10.222.0.70 () {58 vars in 1257 bytes} [Sat Aug 27 02:40:37 2022] GET /compute/v2.1/os-hypervisors/787a4d8d-edd5-4eba-a9e7-3777b5948c49 => generated 123 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:40:37.153931 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9c0c9da9-e7b4-4804-a235-3b76af3ba82c tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:37.163654 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.network.neutron [None req-c77fc37f-1cc6-4516-9252-b93aeb5ddedc tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] validate_networks() for None {{(pid=134051) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:40:37.198510 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9c0c9da9-e7b4-4804-a235-3b76af3ba82c tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] 10.222.0.70 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.055038 Aug 27 02:40:37.199895 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 91/214] 10.222.0.70 () {58 vars in 1152 bytes} [Sat Aug 27 02:40:37 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 27 02:40:37.211464 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-1c3aa740-5a7c-4cd9-8e8e-ecf75784b7f0 tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1301270228"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:37.215261 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.aggregate [None req-1c3aa740-5a7c-4cd9-8e8e-ecf75784b7f0 tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] Generated uuid 11dbc79f-e4ba-403e-90cb-fe757d3a45b1 for aggregate {{(pid=134052) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 02:40:37.246638 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-1c3aa740-5a7c-4cd9-8e8e-ecf75784b7f0 tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.038911 Aug 27 02:40:37.254297 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 92/215] 10.222.0.70 () {60 vars in 1164 bytes} [Sat Aug 27 02:40:37 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:40:37.262184 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0921eaa2-659b-4d44-ae77-b656a4615692 tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-852278-4"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:37.274788 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0921eaa2-659b-4d44-ae77-b656a4615692 tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:37.275494 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0921eaa2-659b-4d44-ae77-b656a4615692 tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:37.276097 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0921eaa2-659b-4d44-ae77-b656a4615692 tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:37.295214 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:DELETE=5,nova_api:INSERT=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:40:37.485887 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-0921eaa2-659b-4d44-ae77-b656a4615692 tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 242 microversion: 2.1 time: 0.230192 Aug 27 02:40:37.486865 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 93/216] 10.222.0.70 () {60 vars in 1191 bytes} [Sat Aug 27 02:40:37 2022] POST /compute/v2.1/os-aggregates/4/action => generated 242 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:40:37.500269 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-b66af9ec-d7c2-436c-868f-31eac79cf6e7 req-ec3a4c38-4bea-4607-8012-c32323fd278b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5d6ba67-b815-4ec1-9d75-ee5436f5e3c7", "tag": "0684103c-d1c3-4cad-be37-7a7306355319"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:37.510593 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-b66af9ec-d7c2-436c-868f-31eac79cf6e7 req-ec3a4c38-4bea-4607-8012-c32323fd278b service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:37.510792 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-b66af9ec-d7c2-436c-868f-31eac79cf6e7 req-ec3a4c38-4bea-4607-8012-c32323fd278b service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:37.511094 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-b66af9ec-d7c2-436c-868f-31eac79cf6e7 req-ec3a4c38-4bea-4607-8012-c32323fd278b service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:37.522941 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-b66af9ec-d7c2-436c-868f-31eac79cf6e7 req-ec3a4c38-4bea-4607-8012-c32323fd278b service nova] Creating event network-changed:0684103c-d1c3-4cad-be37-7a7306355319 for instance f5d6ba67-b815-4ec1-9d75-ee5436f5e3c7 on n-h1-852278-4 Aug 27 02:40:37.528074 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-b66af9ec-d7c2-436c-868f-31eac79cf6e7 req-ec3a4c38-4bea-4607-8012-c32323fd278b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031689 Aug 27 02:40:37.529038 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 94/217] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:40:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:40:37.534164 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-698420df-f0b1-44fa-978e-f49594b8ffeb tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-852278-4"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:37.545168 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-698420df-f0b1-44fa-978e-f49594b8ffeb tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:37.545647 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-698420df-f0b1-44fa-978e-f49594b8ffeb tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:37.546353 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-698420df-f0b1-44fa-978e-f49594b8ffeb tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:37.711391 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-c77fc37f-1cc6-4516-9252-b93aeb5ddedc tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Flavor limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:40:37.711814 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-c77fc37f-1cc6-4516-9252-b93aeb5ddedc tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Image limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:40:37.712281 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-c77fc37f-1cc6-4516-9252-b93aeb5ddedc tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Flavor pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:40:37.712798 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-c77fc37f-1cc6-4516-9252-b93aeb5ddedc tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Image pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:40:37.713105 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-c77fc37f-1cc6-4516-9252-b93aeb5ddedc tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:40:37.732172 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c77fc37f-1cc6-4516-9252-b93aeb5ddedc tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:37.732686 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c77fc37f-1cc6-4516-9252-b93aeb5ddedc tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:37.733118 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c77fc37f-1cc6-4516-9252-b93aeb5ddedc tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:37.733846 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c77fc37f-1cc6-4516-9252-b93aeb5ddedc tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:37.734292 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c77fc37f-1cc6-4516-9252-b93aeb5ddedc tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:37.734713 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c77fc37f-1cc6-4516-9252-b93aeb5ddedc tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:37.780538 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-c77fc37f-1cc6-4516-9252-b93aeb5ddedc tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Getting quotas for project 82ae179f416c451e92e270d2cb0f4400. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:40:37.787907 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-c77fc37f-1cc6-4516-9252-b93aeb5ddedc tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Getting quotas for user d68711ff38ec41c0b051124527c7ac35 and project 82ae179f416c451e92e270d2cb0f4400. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:40:37.801456 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-698420df-f0b1-44fa-978e-f49594b8ffeb tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 227 microversion: 2.1 time: 0.271141 Aug 27 02:40:37.802401 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 95/218] 10.222.0.70 () {60 vars in 1191 bytes} [Sat Aug 27 02:40:37 2022] POST /compute/v2.1/os-aggregates/4/action => generated 227 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:40:37.808609 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-c77fc37f-1cc6-4516-9252-b93aeb5ddedc tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Going to run 1 instances... {{(pid=134051) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:40:37.815474 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-c77fc37f-1cc6-4516-9252-b93aeb5ddedc tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] [instance: 96881762-a0a0-425f-a3b6-cc87adbae319] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134051) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:40:37.816084 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f79bc88f-d6ad-486e-a22d-468cf815ca9f tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:37.853676 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f79bc88f-d6ad-486e-a22d-468cf815ca9f tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] 10.222.0.70 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.043190 Aug 27 02:40:37.854273 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 96/219] 10.222.0.70 () {58 vars in 1152 bytes} [Sat Aug 27 02:40:37 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 27 02:40:37.863502 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f90d418a-9713-41bb-8638-e552f91e7e20 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:37.864417 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-f90d418a-9713-41bb-8638-e552f91e7e20 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] [instance: f5d6ba67-b815-4ec1-9d75-ee5436f5e3c7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:37.871586 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f90d418a-9713-41bb-8638-e552f91e7e20 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:37.872284 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f90d418a-9713-41bb-8638-e552f91e7e20 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:37.873019 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f90d418a-9713-41bb-8638-e552f91e7e20 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:37.873917 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f90d418a-9713-41bb-8638-e552f91e7e20 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:37.874533 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f90d418a-9713-41bb-8638-e552f91e7e20 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:37.875228 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f90d418a-9713-41bb-8638-e552f91e7e20 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:37.883006 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c77fc37f-1cc6-4516-9252-b93aeb5ddedc tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.806574 Aug 27 02:40:37.884159 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 124/220] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 02:40:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 810 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:40:37.889409 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c740e414-15e6-4971-89d4-e4e4644eb7fc tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-584264269"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:37.893314 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.objects.aggregate [None req-c740e414-15e6-4971-89d4-e4e4644eb7fc tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] Generated uuid 4dc7e86a-44b0-43dd-ac50-ddd1a6172e73 for aggregate {{(pid=134051) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 02:40:37.919052 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c740e414-15e6-4971-89d4-e4e4644eb7fc tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.033621 Aug 27 02:40:37.920426 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 125/221] 10.222.0.70 () {60 vars in 1164 bytes} [Sat Aug 27 02:40:37 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:40:37.931350 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8f9a7f9d-0da7-4cd0-9fba-5c929d3e2962 tempest-HostsAdminTestJSON-1190581969 tempest-HostsAdminTestJSON-1190581969-project-admin] Calling method '.version_select at 0x7f5edfa2e940>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:37.935864 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8f9a7f9d-0da7-4cd0-9fba-5c929d3e2962 tempest-HostsAdminTestJSON-1190581969 tempest-HostsAdminTestJSON-1190581969-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:37.936534 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8f9a7f9d-0da7-4cd0-9fba-5c929d3e2962 tempest-HostsAdminTestJSON-1190581969 tempest-HostsAdminTestJSON-1190581969-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:37.937407 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8f9a7f9d-0da7-4cd0-9fba-5c929d3e2962 tempest-HostsAdminTestJSON-1190581969 tempest-HostsAdminTestJSON-1190581969-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:37.938539 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8f9a7f9d-0da7-4cd0-9fba-5c929d3e2962 tempest-HostsAdminTestJSON-1190581969 tempest-HostsAdminTestJSON-1190581969-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:37.939133 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8f9a7f9d-0da7-4cd0-9fba-5c929d3e2962 tempest-HostsAdminTestJSON-1190581969 tempest-HostsAdminTestJSON-1190581969-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:37.939750 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8f9a7f9d-0da7-4cd0-9fba-5c929d3e2962 tempest-HostsAdminTestJSON-1190581969 tempest-HostsAdminTestJSON-1190581969-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:37.978897 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-8f9a7f9d-0da7-4cd0-9fba-5c929d3e2962 tempest-HostsAdminTestJSON-1190581969 tempest-HostsAdminTestJSON-1190581969-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.057093 Aug 27 02:40:37.979825 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 126/222] 10.222.0.70 () {58 vars in 1128 bytes} [Sat Aug 27 02:40:37 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:40:37.990546 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-bd561d00-d03e-4fc7-8c85-149b1335064d tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:37.991537 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-bd561d00-d03e-4fc7-8c85-149b1335064d tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] [instance: 96881762-a0a0-425f-a3b6-cc87adbae319] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:38.131874 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-bd561d00-d03e-4fc7-8c85-149b1335064d tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68711ff38ec41c0b051124527c7ac35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae179f416c451e92e270d2cb0f4400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:38.147607 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-bd561d00-d03e-4fc7-8c85-149b1335064d tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] 10.222.0.70 "GET /compute/v2.1/servers/96881762-a0a0-425f-a3b6-cc87adbae319" status: 200 len: 1219 microversion: 2.1 time: 0.166499 Aug 27 02:40:38.148962 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 127/223] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:37 2022] GET /compute/v2.1/servers/96881762-a0a0-425f-a3b6-cc87adbae319 => generated 1219 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:38.158874 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-16f41c8e-077d-4cb5-b18d-0dec070f4d2b tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:38.160204 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-16f41c8e-077d-4cb5-b18d-0dec070f4d2b tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: 12acf567-09ef-4971-b085-8b5566fd1b79] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:38.169127 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-16f41c8e-077d-4cb5-b18d-0dec070f4d2b tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:38.170621 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-16f41c8e-077d-4cb5-b18d-0dec070f4d2b tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:38.171177 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-16f41c8e-077d-4cb5-b18d-0dec070f4d2b tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:38.171958 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-16f41c8e-077d-4cb5-b18d-0dec070f4d2b tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:38.172802 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-16f41c8e-077d-4cb5-b18d-0dec070f4d2b tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:38.173337 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-16f41c8e-077d-4cb5-b18d-0dec070f4d2b tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:38.195501 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-f90d418a-9713-41bb-8638-e552f91e7e20 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c850104e6d430397bb54d0e3730a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72992d9dba564526b223533398a94dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:38.204890 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f90d418a-9713-41bb-8638-e552f91e7e20 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] 10.222.0.70 "GET /compute/v2.1/servers/f5d6ba67-b815-4ec1-9d75-ee5436f5e3c7" status: 200 len: 1388 microversion: 2.1 time: 0.349492 Aug 27 02:40:38.227441 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 97/224] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:37 2022] GET /compute/v2.1/servers/f5d6ba67-b815-4ec1-9d75-ee5436f5e3c7 => generated 1388 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:38.232586 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ccd119c3-9d45-4ef2-ac84-728b4b9a083a tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:38.274366 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ccd119c3-9d45-4ef2-ac84-728b4b9a083a tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] 10.222.0.70 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.045637 Aug 27 02:40:38.278506 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 98/225] 10.222.0.70 () {58 vars in 1152 bytes} [Sat Aug 27 02:40:38 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 27 02:40:38.283121 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-201a2129-d5e5-4c53-a381-e2772dd6880a tempest-HostsAdminTestJSON-1190581969 tempest-HostsAdminTestJSON-1190581969-project-admin] Calling method '.version_select at 0x7f5ee3efae50>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:38.290012 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-201a2129-d5e5-4c53-a381-e2772dd6880a tempest-HostsAdminTestJSON-1190581969 tempest-HostsAdminTestJSON-1190581969-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:38.290585 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-201a2129-d5e5-4c53-a381-e2772dd6880a tempest-HostsAdminTestJSON-1190581969 tempest-HostsAdminTestJSON-1190581969-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:38.291078 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-201a2129-d5e5-4c53-a381-e2772dd6880a tempest-HostsAdminTestJSON-1190581969 tempest-HostsAdminTestJSON-1190581969-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:38.291882 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-201a2129-d5e5-4c53-a381-e2772dd6880a tempest-HostsAdminTestJSON-1190581969 tempest-HostsAdminTestJSON-1190581969-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:38.292408 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-201a2129-d5e5-4c53-a381-e2772dd6880a tempest-HostsAdminTestJSON-1190581969 tempest-HostsAdminTestJSON-1190581969-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:38.293089 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-201a2129-d5e5-4c53-a381-e2772dd6880a tempest-HostsAdminTestJSON-1190581969 tempest-HostsAdminTestJSON-1190581969-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:38.360815 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-201a2129-d5e5-4c53-a381-e2772dd6880a tempest-HostsAdminTestJSON-1190581969 tempest-HostsAdminTestJSON-1190581969-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 236 microversion: 2.1 time: 0.081009 Aug 27 02:40:38.371915 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 99/226] 10.222.0.70 () {58 vars in 1155 bytes} [Sat Aug 27 02:40:38 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 236 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:40:38.377603 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-49e81231-1388-4978-aeaa-e3e2b522f39f tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:38.378297 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-49e81231-1388-4978-aeaa-e3e2b522f39f tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] [instance: 11661332-bcfc-46f3-a5ba-30eb82448817] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:38.386678 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-49e81231-1388-4978-aeaa-e3e2b522f39f tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:38.387233 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-49e81231-1388-4978-aeaa-e3e2b522f39f tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:38.387726 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-49e81231-1388-4978-aeaa-e3e2b522f39f tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:38.388537 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-49e81231-1388-4978-aeaa-e3e2b522f39f tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:38.389073 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-49e81231-1388-4978-aeaa-e3e2b522f39f tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:38.389570 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-49e81231-1388-4978-aeaa-e3e2b522f39f tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:38.676641 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-16f41c8e-077d-4cb5-b18d-0dec070f4d2b tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:38.689068 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-16f41c8e-077d-4cb5-b18d-0dec070f4d2b tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:38.694286 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-16f41c8e-077d-4cb5-b18d-0dec070f4d2b tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:38.696378 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-16f41c8e-077d-4cb5-b18d-0dec070f4d2b tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/12acf567-09ef-4971-b085-8b5566fd1b79" status: 200 len: 1566 microversion: 2.25 time: 0.544566 Aug 27 02:40:38.697327 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 128/227] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:40:38 2022] GET /compute/v2.1/servers/12acf567-09ef-4971-b085-8b5566fd1b79 => generated 1566 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:40:38.709697 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-49e81231-1388-4978-aeaa-e3e2b522f39f tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772e2e66c92e44f8838ce325437d5a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b2f4a529a3e4ea0937ca903dd5924bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:38.718504 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-49e81231-1388-4978-aeaa-e3e2b522f39f tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] 10.222.0.70 "GET /compute/v2.1/servers/11661332-bcfc-46f3-a5ba-30eb82448817" status: 200 len: 1320 microversion: 2.1 time: 0.345070 Aug 27 02:40:38.719334 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 100/228] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:38 2022] GET /compute/v2.1/servers/11661332-bcfc-46f3-a5ba-30eb82448817 => generated 1320 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:38.722207 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c09b0bbf-6dcc-477d-8633-cd83ed0f2a97 tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:38.732910 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-720dee0b-df2c-4bef-b4a2-2f8924197114 req-fc8108df-e9f0-4405-9355-b8b41a9fe13b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11661332-bcfc-46f3-a5ba-30eb82448817", "tag": "87995537-cd43-4eb1-9587-fbfb300e5d56"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:38.733193 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-c09b0bbf-6dcc-477d-8633-cd83ed0f2a97 tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Aug 27 02:40:38.739147 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c09b0bbf-6dcc-477d-8633-cd83ed0f2a97 tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] Request method failure captured: Aug 27 02:40:38.739147 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/os-aggregates/5 HTTP/1.1 Aug 27 02:40:38.739147 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:40:38.739147 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:40:38.739147 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:40:38.739147 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:40:38.739147 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:40:38.739147 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:40:38.739147 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:40:38.739147 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:40:38.739147 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYPvY8K8EabXI9Pf_P2ki44Sh7p9EJXnL1s8nd20TcCA8dwixgO8SopznjwA-jVFQfoerHpFiq7sQvwARyRDf9izyAzjA99ZWe3XryFzQXI-FZpUdDnWTBUSkN2vsCZj5cJDeScwp803ilO7CA_bk5cinOzEuhyQtdlbMl2sip1dzFM Aug 27 02:40:38.739147 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:40:38.739147 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:40:38.739147 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:40:38.739147 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:40:38.739147 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:40:38.739147 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:40:38.739147 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: b6d3e320c13b40738791925da64b64c4 Aug 27 02:40:38.739147 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-AggregatesAdminTestJSON-1170478554 Aug 27 02:40:38.739147 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,admin,member Aug 27 02:40:38.739147 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,admin,member Aug 27 02:40:38.740406 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b6d3e320c13b40738791925da64b64c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_b6d3e320c13b40738791925da64b64c4", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b6d3e320c13b40738791925da64b64c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/b6d3e320c13b40738791925da64b64c4"}]}] Aug 27 02:40:38.740406 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-AggregatesAdminTestJSON-1170478554 Aug 27 02:40:38.740406 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: b6d3e320c13b40738791925da64b64c4 Aug 27 02:40:38.740406 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1170478554 Aug 27 02:40:38.740406 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-AggregatesAdminTestJSON-1170478554-project-admin Aug 27 02:40:38.740406 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:40:38.740406 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:40:38.740406 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 48f03be1064c4867b1050325d5808d69 Aug 27 02:40:38.740406 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-AggregatesAdminTestJSON-1170478554-project-admin Aug 27 02:40:38.740406 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 02:40:38.740406 n-d-852278-4 devstack@n-api.service[134051]: exception: Aggregate 5 could not be found. Aug 27 02:40:38.740406 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '5'} Aug 27 02:40:38.740406 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:40:38.741220 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:38.741220 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 27 02:40:38.741220 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 27 02:40:38.741220 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6462, in get_aggregate Aug 27 02:40:38.741220 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 27 02:40:38.741220 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 02:40:38.741220 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 02:40:38.741220 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 27 02:40:38.741220 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 27 02:40:38.741220 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 02:40:38.741220 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 02:40:38.741220 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 27 02:40:38.741220 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 27 02:40:38.741220 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Aug 27 02:40:38.741220 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:38.741220 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:38.741220 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:38.741220 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:38.741220 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:38.742292 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:38.742292 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:40:38.742292 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:40:38.742292 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:40:38.742292 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:40:38.742292 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 27 02:40:38.742292 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:40:38.742292 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Aug 27 02:40:38.742292 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:38.742292 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:38.742292 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:38.742292 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:38.742292 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:38.742292 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:38.742292 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:40:38.742292 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:40:38.742292 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Aug 27 02:40:38.742292 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:38.743270 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c09b0bbf-6dcc-477d-8633-cd83ed0f2a97 tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:40:38.743270 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c09b0bbf-6dcc-477d-8633-cd83ed0f2a97 tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] 10.222.0.70 "GET /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.033180 Aug 27 02:40:38.743270 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 129/229] 10.222.0.70 () {58 vars in 1149 bytes} [Sat Aug 27 02:40:38 2022] GET /compute/v2.1/os-aggregates/5 => generated 77 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 02:40:38.745930 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-720dee0b-df2c-4bef-b4a2-2f8924197114 req-fc8108df-e9f0-4405-9355-b8b41a9fe13b service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:38.746495 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-720dee0b-df2c-4bef-b4a2-2f8924197114 req-fc8108df-e9f0-4405-9355-b8b41a9fe13b service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:38.746929 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-720dee0b-df2c-4bef-b4a2-2f8924197114 req-fc8108df-e9f0-4405-9355-b8b41a9fe13b service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:38.763629 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-720dee0b-df2c-4bef-b4a2-2f8924197114 req-fc8108df-e9f0-4405-9355-b8b41a9fe13b service nova] Creating event network-changed:87995537-cd43-4eb1-9587-fbfb300e5d56 for instance 11661332-bcfc-46f3-a5ba-30eb82448817 on n-h1-852278-4 Aug 27 02:40:38.766250 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-40f6c7ca-4f74-499c-8995-8f3cdf55eca2 tempest-HostsAdminTestJSON-1190581969 tempest-HostsAdminTestJSON-1190581969-project-admin] Calling method '.version_select at 0x7f5edfa2e670>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:38.770004 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-40f6c7ca-4f74-499c-8995-8f3cdf55eca2 tempest-HostsAdminTestJSON-1190581969 tempest-HostsAdminTestJSON-1190581969-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:38.770353 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-720dee0b-df2c-4bef-b4a2-2f8924197114 req-fc8108df-e9f0-4405-9355-b8b41a9fe13b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049894 Aug 27 02:40:38.770742 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-40f6c7ca-4f74-499c-8995-8f3cdf55eca2 tempest-HostsAdminTestJSON-1190581969 tempest-HostsAdminTestJSON-1190581969-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:38.771167 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-40f6c7ca-4f74-499c-8995-8f3cdf55eca2 tempest-HostsAdminTestJSON-1190581969 tempest-HostsAdminTestJSON-1190581969-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:38.771344 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 101/230] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:40:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:40:38.771954 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-40f6c7ca-4f74-499c-8995-8f3cdf55eca2 tempest-HostsAdminTestJSON-1190581969 tempest-HostsAdminTestJSON-1190581969-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:38.772636 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-40f6c7ca-4f74-499c-8995-8f3cdf55eca2 tempest-HostsAdminTestJSON-1190581969 tempest-HostsAdminTestJSON-1190581969-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:38.773198 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-40f6c7ca-4f74-499c-8995-8f3cdf55eca2 tempest-HostsAdminTestJSON-1190581969 tempest-HostsAdminTestJSON-1190581969-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:38.776242 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a546ca5c-3754-4fb1-8629-5b2048ac2f4e tempest-AggregatesAdminTestV241-333737186 tempest-AggregatesAdminTestV241-333737186-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1769237657"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:38.779725 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.aggregate [None req-a546ca5c-3754-4fb1-8629-5b2048ac2f4e tempest-AggregatesAdminTestV241-333737186 tempest-AggregatesAdminTestV241-333737186-project-admin] Generated uuid b1185daa-740d-453d-b30e-4062fbd8c90a for aggregate {{(pid=134052) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 02:40:38.798966 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-40f6c7ca-4f74-499c-8995-8f3cdf55eca2 tempest-HostsAdminTestJSON-1190581969 tempest-HostsAdminTestJSON-1190581969-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.036234 Aug 27 02:40:38.799582 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 130/231] 10.222.0.70 () {58 vars in 1128 bytes} [Sat Aug 27 02:40:38 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:40:38.804993 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3d5fcb7f-3245-452b-8cb1-6616c100bbfb tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:38.809886 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a546ca5c-3754-4fb1-8629-5b2048ac2f4e tempest-AggregatesAdminTestV241-333737186 tempest-AggregatesAdminTestV241-333737186-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.41 time: 0.037308 Aug 27 02:40:38.817874 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 102/232] 10.222.0.70 () {62 vars in 1205 bytes} [Sat Aug 27 02:40:38 2022] POST /compute/v2.1/os-aggregates => generated 246 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:40:38.839501 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-fcd157cf-8a60-4263-bbec-7ff8350f192c tempest-HostsAdminTestJSON-1190581969 tempest-HostsAdminTestJSON-1190581969-project-admin] Calling method '.version_select at 0x7f5ee3a2aa60>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:38.846340 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-3d5fcb7f-3245-452b-8cb1-6616c100bbfb tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Aug 27 02:40:38.849047 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fcd157cf-8a60-4263-bbec-7ff8350f192c tempest-HostsAdminTestJSON-1190581969 tempest-HostsAdminTestJSON-1190581969-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:38.851780 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3d5fcb7f-3245-452b-8cb1-6616c100bbfb tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] Request method failure captured: Aug 27 02:40:38.851780 n-d-852278-4 devstack@n-api.service[134051]: request: DELETE /compute/v2.1/os-aggregates/5 HTTP/1.1 Aug 27 02:40:38.851780 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:40:38.851780 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:40:38.851780 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:40:38.851780 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:40:38.851780 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:40:38.851780 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:40:38.851780 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:40:38.851780 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:40:38.851780 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYPvY8K8EabXI9Pf_P2ki44Sh7p9EJXnL1s8nd20TcCA8dwixgO8SopznjwA-jVFQfoerHpFiq7sQvwARyRDf9izyAzjA99ZWe3XryFzQXI-FZpUdDnWTBUSkN2vsCZj5cJDeScwp803ilO7CA_bk5cinOzEuhyQtdlbMl2sip1dzFM Aug 27 02:40:38.851780 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:40:38.851780 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:40:38.851780 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:40:38.851780 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:40:38.851780 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:40:38.851780 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:40:38.851780 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: b6d3e320c13b40738791925da64b64c4 Aug 27 02:40:38.851780 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-AggregatesAdminTestJSON-1170478554 Aug 27 02:40:38.851780 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,admin,member Aug 27 02:40:38.851780 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,admin,member Aug 27 02:40:38.853006 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b6d3e320c13b40738791925da64b64c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_b6d3e320c13b40738791925da64b64c4", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b6d3e320c13b40738791925da64b64c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/b6d3e320c13b40738791925da64b64c4"}]}] Aug 27 02:40:38.853006 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-AggregatesAdminTestJSON-1170478554 Aug 27 02:40:38.853006 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: b6d3e320c13b40738791925da64b64c4 Aug 27 02:40:38.853006 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1170478554 Aug 27 02:40:38.853006 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-AggregatesAdminTestJSON-1170478554-project-admin Aug 27 02:40:38.853006 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:40:38.853006 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:40:38.853006 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 48f03be1064c4867b1050325d5808d69 Aug 27 02:40:38.853006 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-AggregatesAdminTestJSON-1170478554-project-admin Aug 27 02:40:38.853006 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 02:40:38.853006 n-d-852278-4 devstack@n-api.service[134051]: exception: Aggregate 5 could not be found. Aug 27 02:40:38.853006 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '5'} Aug 27 02:40:38.853006 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:40:38.853715 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:38.853715 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 27 02:40:38.853715 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 27 02:40:38.853715 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 27 02:40:38.853715 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 27 02:40:38.853715 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 02:40:38.853715 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 02:40:38.853715 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 02:40:38.853715 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 02:40:38.853715 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 27 02:40:38.853715 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 27 02:40:38.853715 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6515, in delete_aggregate Aug 27 02:40:38.853715 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 27 02:40:38.853715 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 02:40:38.853715 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 02:40:38.853715 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 27 02:40:38.853715 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 27 02:40:38.853715 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 02:40:38.853715 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 02:40:38.854744 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 27 02:40:38.854744 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 27 02:40:38.854744 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Aug 27 02:40:38.854744 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:38.854744 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:38.854744 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:38.854744 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:38.854744 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:38.854744 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:38.854744 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:40:38.854744 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:40:38.854744 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:40:38.854744 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:40:38.854744 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 27 02:40:38.854744 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:40:38.854744 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Aug 27 02:40:38.854744 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:38.854744 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:38.854744 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:38.854744 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:38.854744 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:38.857058 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:38.857058 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:40:38.857058 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:40:38.857058 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Aug 27 02:40:38.857058 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:38.857058 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3d5fcb7f-3245-452b-8cb1-6616c100bbfb tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:40:38.857058 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-3d5fcb7f-3245-452b-8cb1-6616c100bbfb tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] 10.222.0.70 "DELETE /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.053505 Aug 27 02:40:38.858485 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fcd157cf-8a60-4263-bbec-7ff8350f192c tempest-HostsAdminTestJSON-1190581969 tempest-HostsAdminTestJSON-1190581969-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:38.859305 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fcd157cf-8a60-4263-bbec-7ff8350f192c tempest-HostsAdminTestJSON-1190581969 tempest-HostsAdminTestJSON-1190581969-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:38.863059 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 131/233] 10.222.0.70 () {58 vars in 1152 bytes} [Sat Aug 27 02:40:38 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 77 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 02:40:38.867802 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-46869c9b-1349-4e92-a17d-121ce7d7494a tempest-AggregatesAdminTestV241-333737186 tempest-AggregatesAdminTestV241-333737186-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-968211514"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:38.894782 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fcd157cf-8a60-4263-bbec-7ff8350f192c tempest-HostsAdminTestJSON-1190581969 tempest-HostsAdminTestJSON-1190581969-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:38.895271 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fcd157cf-8a60-4263-bbec-7ff8350f192c tempest-HostsAdminTestJSON-1190581969 tempest-HostsAdminTestJSON-1190581969-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:38.895689 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fcd157cf-8a60-4263-bbec-7ff8350f192c tempest-HostsAdminTestJSON-1190581969 tempest-HostsAdminTestJSON-1190581969-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:38.934335 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-fcd157cf-8a60-4263-bbec-7ff8350f192c tempest-HostsAdminTestJSON-1190581969 tempest-HostsAdminTestJSON-1190581969-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hosts/n-h2-852278-4" status: 200 len: 467 microversion: 2.1 time: 0.119506 Aug 27 02:40:38.935343 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 103/234] 10.222.0.70 () {58 vars in 1170 bytes} [Sat Aug 27 02:40:38 2022] GET /compute/v2.1/os-hosts/n-h2-852278-4 => generated 467 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:40:38.943845 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-81a60183-4b04-47fe-af0b-b60be517ff85 tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-460635070", "name": "tempest-test_aggregate-189350063"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:38.968830 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.aggregate [None req-81a60183-4b04-47fe-af0b-b60be517ff85 tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] Generated uuid 107f6392-ca3b-4c3a-a03a-437e7432ada0 for aggregate {{(pid=134052) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 02:40:38.994851 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-46869c9b-1349-4e92-a17d-121ce7d7494a tempest-AggregatesAdminTestV241-333737186 tempest-AggregatesAdminTestV241-333737186-project-admin] 10.222.0.70 "PUT /compute/v2.1/os-aggregates/6" status: 200 len: 298 microversion: 2.41 time: 0.130660 Aug 27 02:40:38.996270 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 132/235] 10.222.0.70 () {62 vars in 1210 bytes} [Sat Aug 27 02:40:38 2022] PUT /compute/v2.1/os-aggregates/6 => generated 298 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:40:39.001060 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e64dd83d-aea1-400f-8339-b72aa5f9a2c1 tempest-HostsAdminTestJSON-1190581969 tempest-HostsAdminTestJSON-1190581969-project-admin] Calling method '.version_select at 0x7f5edf92f5e0>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:39.009128 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-81a60183-4b04-47fe-af0b-b60be517ff85 tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates" status: 200 len: 220 microversion: 2.1 time: 0.072235 Aug 27 02:40:39.010006 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 104/236] 10.222.0.70 () {60 vars in 1165 bytes} [Sat Aug 27 02:40:38 2022] POST /compute/v2.1/os-aggregates => generated 220 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:40:39.019727 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e64dd83d-aea1-400f-8339-b72aa5f9a2c1 tempest-HostsAdminTestJSON-1190581969 tempest-HostsAdminTestJSON-1190581969-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:39.020680 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e64dd83d-aea1-400f-8339-b72aa5f9a2c1 tempest-HostsAdminTestJSON-1190581969 tempest-HostsAdminTestJSON-1190581969-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:39.020812 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8dd801bd-509a-4a4f-992f-37dc7d7b8af0 tempest-AggregatesAdminTestV241-333737186 tempest-AggregatesAdminTestV241-333737186-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:39.021192 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e64dd83d-aea1-400f-8339-b72aa5f9a2c1 tempest-HostsAdminTestJSON-1190581969 tempest-HostsAdminTestJSON-1190581969-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:39.037537 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e64dd83d-aea1-400f-8339-b72aa5f9a2c1 tempest-HostsAdminTestJSON-1190581969 tempest-HostsAdminTestJSON-1190581969-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:39.038082 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e64dd83d-aea1-400f-8339-b72aa5f9a2c1 tempest-HostsAdminTestJSON-1190581969 tempest-HostsAdminTestJSON-1190581969-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:39.038626 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e64dd83d-aea1-400f-8339-b72aa5f9a2c1 tempest-HostsAdminTestJSON-1190581969 tempest-HostsAdminTestJSON-1190581969-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:39.049213 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-8dd801bd-509a-4a4f-992f-37dc7d7b8af0 tempest-AggregatesAdminTestV241-333737186 tempest-AggregatesAdminTestV241-333737186-project-admin] 10.222.0.70 "GET /compute/v2.1/os-aggregates/6" status: 200 len: 298 microversion: 2.41 time: 0.036855 Aug 27 02:40:39.051044 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 105/237] 10.222.0.70 () {60 vars in 1190 bytes} [Sat Aug 27 02:40:39 2022] GET /compute/v2.1/os-aggregates/6 => generated 298 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:40:39.059897 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-1d83979d-5c26-4d17-b102-4d8a0601ce95 tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:39.063102 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=100 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:40:39.074896 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e64dd83d-aea1-400f-8339-b72aa5f9a2c1 tempest-HostsAdminTestJSON-1190581969 tempest-HostsAdminTestJSON-1190581969-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hosts/n-h1-852278-4" status: 200 len: 729 microversion: 2.1 time: 0.077335 Aug 27 02:40:39.075654 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 133/238] 10.222.0.70 () {58 vars in 1170 bytes} [Sat Aug 27 02:40:38 2022] GET /compute/v2.1/os-hosts/n-h1-852278-4 => generated 729 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:40:39.081769 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-35cc15f5-4e4d-4546-b7d9-c96bf45bdbe5 tempest-AggregatesAdminTestV241-333737186 tempest-AggregatesAdminTestV241-333737186-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-852278-4"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:39.087793 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-1d83979d-5c26-4d17-b102-4d8a0601ce95 tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] 10.222.0.70 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.031768 Aug 27 02:40:39.088776 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 106/239] 10.222.0.70 () {58 vars in 1152 bytes} [Sat Aug 27 02:40:39 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 27 02:40:39.097640 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e6d27bd5-d1e2-4da5-9405-dcf184226d7c tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:39.100113 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-35cc15f5-4e4d-4546-b7d9-c96bf45bdbe5 tempest-AggregatesAdminTestV241-333737186 tempest-AggregatesAdminTestV241-333737186-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:39.100992 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-35cc15f5-4e4d-4546-b7d9-c96bf45bdbe5 tempest-AggregatesAdminTestV241-333737186 tempest-AggregatesAdminTestV241-333737186-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:39.101674 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-35cc15f5-4e4d-4546-b7d9-c96bf45bdbe5 tempest-AggregatesAdminTestV241-333737186 tempest-AggregatesAdminTestV241-333737186-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:39.111110 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-e6d27bd5-d1e2-4da5-9405-dcf184226d7c tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Aug 27 02:40:39.113925 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e6d27bd5-d1e2-4da5-9405-dcf184226d7c tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] Request method failure captured: Aug 27 02:40:39.113925 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/os-aggregates/7 HTTP/1.1 Aug 27 02:40:39.113925 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:40:39.113925 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:40:39.113925 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:40:39.113925 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:40:39.113925 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:40:39.113925 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:40:39.113925 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:40:39.113925 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:40:39.113925 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYPvY8K8EabXI9Pf_P2ki44Sh7p9EJXnL1s8nd20TcCA8dwixgO8SopznjwA-jVFQfoerHpFiq7sQvwARyRDf9izyAzjA99ZWe3XryFzQXI-FZpUdDnWTBUSkN2vsCZj5cJDeScwp803ilO7CA_bk5cinOzEuhyQtdlbMl2sip1dzFM Aug 27 02:40:39.113925 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:40:39.113925 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:40:39.113925 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:40:39.113925 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:40:39.113925 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:40:39.113925 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:40:39.113925 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: b6d3e320c13b40738791925da64b64c4 Aug 27 02:40:39.113925 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-AggregatesAdminTestJSON-1170478554 Aug 27 02:40:39.113925 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,admin,member Aug 27 02:40:39.113925 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,admin,member Aug 27 02:40:39.115133 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b6d3e320c13b40738791925da64b64c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_b6d3e320c13b40738791925da64b64c4", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b6d3e320c13b40738791925da64b64c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/b6d3e320c13b40738791925da64b64c4"}]}] Aug 27 02:40:39.115133 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-AggregatesAdminTestJSON-1170478554 Aug 27 02:40:39.115133 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: b6d3e320c13b40738791925da64b64c4 Aug 27 02:40:39.115133 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1170478554 Aug 27 02:40:39.115133 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-AggregatesAdminTestJSON-1170478554-project-admin Aug 27 02:40:39.115133 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:40:39.115133 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:40:39.115133 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 48f03be1064c4867b1050325d5808d69 Aug 27 02:40:39.115133 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-AggregatesAdminTestJSON-1170478554-project-admin Aug 27 02:40:39.115133 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 02:40:39.115133 n-d-852278-4 devstack@n-api.service[134052]: exception: Aggregate 7 could not be found. Aug 27 02:40:39.115133 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '7'} Aug 27 02:40:39.115133 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:40:39.115810 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:39.115810 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 27 02:40:39.115810 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 27 02:40:39.115810 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6462, in get_aggregate Aug 27 02:40:39.115810 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 27 02:40:39.115810 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 02:40:39.115810 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 02:40:39.115810 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 27 02:40:39.115810 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 27 02:40:39.115810 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 02:40:39.115810 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 02:40:39.115810 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 27 02:40:39.115810 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 27 02:40:39.115810 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Aug 27 02:40:39.115810 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:39.115810 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:39.115810 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:39.115810 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:39.115810 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:39.116832 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:39.116832 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:40:39.116832 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:40:39.116832 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:40:39.116832 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:40:39.116832 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 27 02:40:39.116832 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:40:39.116832 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Aug 27 02:40:39.116832 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:39.116832 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:39.116832 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:39.116832 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:39.116832 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:39.116832 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:39.116832 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:40:39.116832 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:40:39.116832 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Aug 27 02:40:39.116832 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:39.122903 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e6d27bd5-d1e2-4da5-9405-dcf184226d7c tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:40:39.125140 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e6d27bd5-d1e2-4da5-9405-dcf184226d7c tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] 10.222.0.70 "GET /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.031168 Aug 27 02:40:39.125843 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 107/240] 10.222.0.70 () {58 vars in 1149 bytes} [Sat Aug 27 02:40:39 2022] GET /compute/v2.1/os-aggregates/7 => generated 77 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 02:40:39.140771 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-80360561-7254-4e8b-8de7-36a765470b00 tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:39.160770 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-80360561-7254-4e8b-8de7-36a765470b00 tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Aug 27 02:40:39.162812 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-80360561-7254-4e8b-8de7-36a765470b00 tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] Request method failure captured: Aug 27 02:40:39.162812 n-d-852278-4 devstack@n-api.service[134052]: request: DELETE /compute/v2.1/os-aggregates/7 HTTP/1.1 Aug 27 02:40:39.162812 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:40:39.162812 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:40:39.162812 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:40:39.162812 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:40:39.162812 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:40:39.162812 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:40:39.162812 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:40:39.162812 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:40:39.162812 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYPvY8K8EabXI9Pf_P2ki44Sh7p9EJXnL1s8nd20TcCA8dwixgO8SopznjwA-jVFQfoerHpFiq7sQvwARyRDf9izyAzjA99ZWe3XryFzQXI-FZpUdDnWTBUSkN2vsCZj5cJDeScwp803ilO7CA_bk5cinOzEuhyQtdlbMl2sip1dzFM Aug 27 02:40:39.162812 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:40:39.162812 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:40:39.162812 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:40:39.162812 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:40:39.162812 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:40:39.162812 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:40:39.162812 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: b6d3e320c13b40738791925da64b64c4 Aug 27 02:40:39.162812 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-AggregatesAdminTestJSON-1170478554 Aug 27 02:40:39.162812 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,admin,member Aug 27 02:40:39.162812 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,admin,member Aug 27 02:40:39.164209 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b6d3e320c13b40738791925da64b64c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_b6d3e320c13b40738791925da64b64c4", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b6d3e320c13b40738791925da64b64c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/b6d3e320c13b40738791925da64b64c4"}]}] Aug 27 02:40:39.164209 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-AggregatesAdminTestJSON-1170478554 Aug 27 02:40:39.164209 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: b6d3e320c13b40738791925da64b64c4 Aug 27 02:40:39.164209 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1170478554 Aug 27 02:40:39.164209 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-AggregatesAdminTestJSON-1170478554-project-admin Aug 27 02:40:39.164209 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:40:39.164209 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:40:39.164209 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 48f03be1064c4867b1050325d5808d69 Aug 27 02:40:39.164209 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-AggregatesAdminTestJSON-1170478554-project-admin Aug 27 02:40:39.164209 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 02:40:39.164209 n-d-852278-4 devstack@n-api.service[134052]: exception: Aggregate 7 could not be found. Aug 27 02:40:39.164209 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '7'} Aug 27 02:40:39.164209 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:40:39.167463 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:39.167463 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 27 02:40:39.167463 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 27 02:40:39.167463 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 27 02:40:39.167463 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 27 02:40:39.167463 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 02:40:39.167463 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 02:40:39.167463 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 02:40:39.167463 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 02:40:39.167463 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 27 02:40:39.167463 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 27 02:40:39.167463 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6515, in delete_aggregate Aug 27 02:40:39.167463 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 27 02:40:39.167463 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 02:40:39.167463 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 02:40:39.167463 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 27 02:40:39.167463 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 27 02:40:39.167463 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 02:40:39.167463 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 02:40:39.168682 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 27 02:40:39.168682 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 27 02:40:39.168682 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Aug 27 02:40:39.168682 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:39.168682 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:39.168682 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:39.168682 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:39.168682 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:39.168682 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:39.168682 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:40:39.168682 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:40:39.168682 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:40:39.168682 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:40:39.168682 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 27 02:40:39.168682 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:40:39.168682 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Aug 27 02:40:39.168682 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:39.168682 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:39.168682 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:39.168682 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:39.168682 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:39.169773 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:39.169773 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:40:39.169773 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:40:39.169773 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Aug 27 02:40:39.169773 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:39.169773 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-80360561-7254-4e8b-8de7-36a765470b00 tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:40:39.180694 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-80360561-7254-4e8b-8de7-36a765470b00 tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] 10.222.0.70 "DELETE /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.050272 Aug 27 02:40:39.184460 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 108/241] 10.222.0.70 () {58 vars in 1152 bytes} [Sat Aug 27 02:40:39 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 77 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 02:40:39.196262 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-58e38870-41a0-4182-8692-daad370105c4 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:39.199176 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-58e38870-41a0-4182-8692-daad370105c4 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] [instance: 96881762-a0a0-425f-a3b6-cc87adbae319] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:39.210788 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-58e38870-41a0-4182-8692-daad370105c4 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:39.211616 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-58e38870-41a0-4182-8692-daad370105c4 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:39.212353 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-58e38870-41a0-4182-8692-daad370105c4 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:39.213324 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-58e38870-41a0-4182-8692-daad370105c4 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:39.213992 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-58e38870-41a0-4182-8692-daad370105c4 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:39.215250 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-58e38870-41a0-4182-8692-daad370105c4 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:39.220183 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:40:39.334865 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-35cc15f5-4e4d-4546-b7d9-c96bf45bdbe5 tempest-AggregatesAdminTestV241-333737186 tempest-AggregatesAdminTestV241-333737186-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 313 microversion: 2.41 time: 0.257533 Aug 27 02:40:39.335951 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 134/242] 10.222.0.70 () {62 vars in 1232 bytes} [Sat Aug 27 02:40:39 2022] POST /compute/v2.1/os-aggregates/6/action => generated 313 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:40:39.350899 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-57f94406-7c20-419e-9056-5889fce0fd6c tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-612329439"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:39.357384 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.objects.aggregate [None req-57f94406-7c20-419e-9056-5889fce0fd6c tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] Generated uuid 7518fbb5-dfae-4781-8382-36ef9bb9107b for aggregate {{(pid=134051) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 02:40:39.395771 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-58e38870-41a0-4182-8692-daad370105c4 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68711ff38ec41c0b051124527c7ac35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae179f416c451e92e270d2cb0f4400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:39.395989 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-57f94406-7c20-419e-9056-5889fce0fd6c tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.049119 Aug 27 02:40:39.399500 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 135/243] 10.222.0.70 () {60 vars in 1164 bytes} [Sat Aug 27 02:40:39 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:40:39.408516 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-979980f4-7d17-4f96-ab3b-a67507fc20bf tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:39.409826 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-979980f4-7d17-4f96-ab3b-a67507fc20bf tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] [instance: f5d6ba67-b815-4ec1-9d75-ee5436f5e3c7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:39.412070 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-58e38870-41a0-4182-8692-daad370105c4 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] 10.222.0.70 "GET /compute/v2.1/servers/96881762-a0a0-425f-a3b6-cc87adbae319" status: 200 len: 1279 microversion: 2.1 time: 0.224721 Aug 27 02:40:39.416793 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:DELETE=3,nova_api:SELECT=88,nova_api:INSERT=8,nova_api:UPDATE=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:40:39.430522 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 109/244] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:39 2022] GET /compute/v2.1/servers/96881762-a0a0-425f-a3b6-cc87adbae319 => generated 1279 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:39.431489 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-979980f4-7d17-4f96-ab3b-a67507fc20bf tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:39.432115 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-979980f4-7d17-4f96-ab3b-a67507fc20bf tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:39.433657 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-979980f4-7d17-4f96-ab3b-a67507fc20bf tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:39.439417 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-979980f4-7d17-4f96-ab3b-a67507fc20bf tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:39.441092 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-7960e27a-9955-4efd-adab-4be1711de8b4 tempest-AggregatesAdminTestV241-333737186 tempest-AggregatesAdminTestV241-333737186-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-852278-4"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:39.442692 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-979980f4-7d17-4f96-ab3b-a67507fc20bf tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:39.443400 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-979980f4-7d17-4f96-ab3b-a67507fc20bf tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:39.470593 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7960e27a-9955-4efd-adab-4be1711de8b4 tempest-AggregatesAdminTestV241-333737186 tempest-AggregatesAdminTestV241-333737186-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:39.471390 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7960e27a-9955-4efd-adab-4be1711de8b4 tempest-AggregatesAdminTestV241-333737186 tempest-AggregatesAdminTestV241-333737186-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:39.471785 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7960e27a-9955-4efd-adab-4be1711de8b4 tempest-AggregatesAdminTestV241-333737186 tempest-AggregatesAdminTestV241-333737186-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:39.667534 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-7960e27a-9955-4efd-adab-4be1711de8b4 tempest-AggregatesAdminTestV241-333737186 tempest-AggregatesAdminTestV241-333737186-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 298 microversion: 2.41 time: 0.235612 Aug 27 02:40:39.674717 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 110/245] 10.222.0.70 () {62 vars in 1232 bytes} [Sat Aug 27 02:40:39 2022] POST /compute/v2.1/os-aggregates/6/action => generated 298 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:40:39.676027 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6b3f236a-ae98-410f-a27f-9260c1b7a50f tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:39.697078 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-6b3f236a-ae98-410f-a27f-9260c1b7a50f tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] 10.222.0.70 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 226 microversion: 2.1 time: 0.025925 Aug 27 02:40:39.705306 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 111/246] 10.222.0.70 () {58 vars in 1149 bytes} [Sat Aug 27 02:40:39 2022] GET /compute/v2.1/os-aggregates/8 => generated 226 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:40:39.710626 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ecf6c984-bac3-4ab0-98b5-cad7352dfdc9 tempest-AggregatesAdminTestV241-333737186 tempest-AggregatesAdminTestV241-333737186-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:39.745742 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ecf6c984-bac3-4ab0-98b5-cad7352dfdc9 tempest-AggregatesAdminTestV241-333737186 tempest-AggregatesAdminTestV241-333737186-project-admin] 10.222.0.70 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.41 time: 0.038285 Aug 27 02:40:39.746340 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 112/247] 10.222.0.70 () {60 vars in 1193 bytes} [Sat Aug 27 02:40:39 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:40:39.760626 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-531137ca-6f34-4873-aa41-a679956e0815 tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:39.826128 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-531137ca-6f34-4873-aa41-a679956e0815 tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 264 microversion: 2.1 time: 0.078419 Aug 27 02:40:39.834869 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 113/248] 10.222.0.70 () {60 vars in 1191 bytes} [Sat Aug 27 02:40:39 2022] POST /compute/v2.1/os-aggregates/8/action => generated 264 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:40:39.849561 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c988e184-ec22-4ab5-84ff-0b5e119a1b4f tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:39.852824 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-c988e184-ec22-4ab5-84ff-0b5e119a1b4f tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: 12acf567-09ef-4971-b085-8b5566fd1b79] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:39.860778 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c988e184-ec22-4ab5-84ff-0b5e119a1b4f tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:39.861903 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c988e184-ec22-4ab5-84ff-0b5e119a1b4f tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:39.862582 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c988e184-ec22-4ab5-84ff-0b5e119a1b4f tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:39.864272 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c988e184-ec22-4ab5-84ff-0b5e119a1b4f tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:39.865104 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c988e184-ec22-4ab5-84ff-0b5e119a1b4f tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:39.865922 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c988e184-ec22-4ab5-84ff-0b5e119a1b4f tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:39.912629 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-979980f4-7d17-4f96-ab3b-a67507fc20bf tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c850104e6d430397bb54d0e3730a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72992d9dba564526b223533398a94dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:39.928550 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-979980f4-7d17-4f96-ab3b-a67507fc20bf tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] 10.222.0.70 "GET /compute/v2.1/servers/f5d6ba67-b815-4ec1-9d75-ee5436f5e3c7" status: 200 len: 1388 microversion: 2.1 time: 0.526155 Aug 27 02:40:39.930573 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 136/249] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:39 2022] GET /compute/v2.1/servers/f5d6ba67-b815-4ec1-9d75-ee5436f5e3c7 => generated 1388 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:39.943391 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-77a604cc-0f0f-45db-9066-23ed9ca36979 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:39.944060 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-77a604cc-0f0f-45db-9066-23ed9ca36979 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] [instance: 11661332-bcfc-46f3-a5ba-30eb82448817] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:39.958988 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-77a604cc-0f0f-45db-9066-23ed9ca36979 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:39.959507 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-77a604cc-0f0f-45db-9066-23ed9ca36979 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:39.960082 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-77a604cc-0f0f-45db-9066-23ed9ca36979 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:39.960867 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-77a604cc-0f0f-45db-9066-23ed9ca36979 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:39.961591 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-77a604cc-0f0f-45db-9066-23ed9ca36979 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:39.962162 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-77a604cc-0f0f-45db-9066-23ed9ca36979 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:40.366333 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-c988e184-ec22-4ab5-84ff-0b5e119a1b4f tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:40.392814 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-c988e184-ec22-4ab5-84ff-0b5e119a1b4f tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:40.395087 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-c988e184-ec22-4ab5-84ff-0b5e119a1b4f tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:40.396934 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c988e184-ec22-4ab5-84ff-0b5e119a1b4f tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/12acf567-09ef-4971-b085-8b5566fd1b79" status: 200 len: 1566 microversion: 2.25 time: 0.559867 Aug 27 02:40:40.397614 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 114/250] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:40:39 2022] GET /compute/v2.1/servers/12acf567-09ef-4971-b085-8b5566fd1b79 => generated 1566 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:40:40.402519 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-399c8b5d-6dba-4051-8709-2619e4602498 tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:40.425380 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-399c8b5d-6dba-4051-8709-2619e4602498 tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] 10.222.0.70 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 240 microversion: 2.1 time: 0.026558 Aug 27 02:40:40.425992 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 115/251] 10.222.0.70 () {58 vars in 1149 bytes} [Sat Aug 27 02:40:40 2022] GET /compute/v2.1/os-aggregates/8 => generated 240 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:40:40.434405 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-98616dd1-1461-447e-9152-5a49258b53cb tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:40.435033 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-98616dd1-1461-447e-9152-5a49258b53cb tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] [instance: 96881762-a0a0-425f-a3b6-cc87adbae319] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:40.451313 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-98616dd1-1461-447e-9152-5a49258b53cb tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:40.451885 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-98616dd1-1461-447e-9152-5a49258b53cb tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:40.452419 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-98616dd1-1461-447e-9152-5a49258b53cb tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:40.453158 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-98616dd1-1461-447e-9152-5a49258b53cb tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:40.458734 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-98616dd1-1461-447e-9152-5a49258b53cb tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:40.459173 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-98616dd1-1461-447e-9152-5a49258b53cb tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:40.537315 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-77a604cc-0f0f-45db-9066-23ed9ca36979 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772e2e66c92e44f8838ce325437d5a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b2f4a529a3e4ea0937ca903dd5924bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:40.549686 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-77a604cc-0f0f-45db-9066-23ed9ca36979 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] 10.222.0.70 "GET /compute/v2.1/servers/11661332-bcfc-46f3-a5ba-30eb82448817" status: 200 len: 1320 microversion: 2.1 time: 0.616908 Aug 27 02:40:40.551633 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 137/252] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:39 2022] GET /compute/v2.1/servers/11661332-bcfc-46f3-a5ba-30eb82448817 => generated 1320 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:40.561084 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-25876024-676f-4ced-bc0e-2c50e1000647 tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:40.598386 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-25876024-676f-4ced-bc0e-2c50e1000647 tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] 10.222.0.70 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.044809 Aug 27 02:40:40.599300 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 138/253] 10.222.0.70 () {58 vars in 1152 bytes} [Sat Aug 27 02:40:40 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 27 02:40:40.611195 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a4e21256-b47e-481f-baf2-d4eb35c72ee7 tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-291413873", "availability_zone": "tempest-test_az-1144145393"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:40.629678 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-98616dd1-1461-447e-9152-5a49258b53cb tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68711ff38ec41c0b051124527c7ac35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae179f416c451e92e270d2cb0f4400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:40.640495 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-98616dd1-1461-447e-9152-5a49258b53cb tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] 10.222.0.70 "GET /compute/v2.1/servers/96881762-a0a0-425f-a3b6-cc87adbae319" status: 200 len: 1277 microversion: 2.1 time: 0.209837 Aug 27 02:40:40.643150 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 116/254] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:40 2022] GET /compute/v2.1/servers/96881762-a0a0-425f-a3b6-cc87adbae319 => generated 1277 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:40:40.651435 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.objects.aggregate [None req-a4e21256-b47e-481f-baf2-d4eb35c72ee7 tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] Generated uuid 38127fee-124e-4ff9-9fa3-4a37b5210d70 for aggregate {{(pid=134051) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 02:40:40.709872 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a4e21256-b47e-481f-baf2-d4eb35c72ee7 tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.102268 Aug 27 02:40:40.717849 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 139/255] 10.222.0.70 () {60 vars in 1165 bytes} [Sat Aug 27 02:40:40 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:40:40.722103 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0f785bbe-a24b-4e46-bc47-1527b8377b2e tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-291413873_new", "availability_zone": "tempest-test_az-1144145393_new"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:40.820413 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-1389120c-1319-43ee-a423-5b5440499e9e req-24c71bac-9046-4cd7-9ed0-21e455fc5a07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12acf567-09ef-4971-b085-8b5566fd1b79", "name": "network-vif-unplugged", "status": "completed", "tag": "44ed9f75-528d-4d72-891d-705dbadec7a2"}, {"name": "network-changed", "server_uuid": "12acf567-09ef-4971-b085-8b5566fd1b79", "tag": "44ed9f75-528d-4d72-891d-705dbadec7a2"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:40.839211 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-1389120c-1319-43ee-a423-5b5440499e9e req-24c71bac-9046-4cd7-9ed0-21e455fc5a07 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:40.839707 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-1389120c-1319-43ee-a423-5b5440499e9e req-24c71bac-9046-4cd7-9ed0-21e455fc5a07 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:40.840152 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-1389120c-1319-43ee-a423-5b5440499e9e req-24c71bac-9046-4cd7-9ed0-21e455fc5a07 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:40.870031 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-1389120c-1319-43ee-a423-5b5440499e9e req-24c71bac-9046-4cd7-9ed0-21e455fc5a07 service nova] Creating event network-vif-unplugged:44ed9f75-528d-4d72-891d-705dbadec7a2 for instance 12acf567-09ef-4971-b085-8b5566fd1b79 on n-h1-852278-4 Aug 27 02:40:40.870545 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-1389120c-1319-43ee-a423-5b5440499e9e req-24c71bac-9046-4cd7-9ed0-21e455fc5a07 service nova] Creating event network-changed:44ed9f75-528d-4d72-891d-705dbadec7a2 for instance 12acf567-09ef-4971-b085-8b5566fd1b79 on n-h1-852278-4 Aug 27 02:40:40.884663 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-1389120c-1319-43ee-a423-5b5440499e9e req-24c71bac-9046-4cd7-9ed0-21e455fc5a07 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.068421 Aug 27 02:40:40.887943 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 140/256] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:40:40 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:40:40.936543 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0f785bbe-a24b-4e46-bc47-1527b8377b2e tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:40.941710 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0f785bbe-a24b-4e46-bc47-1527b8377b2e tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:40.942598 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0f785bbe-a24b-4e46-bc47-1527b8377b2e tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:40.955928 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c075893f-3159-41b2-bb03-96e16291d77c tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:40.957289 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-c075893f-3159-41b2-bb03-96e16291d77c tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] [instance: f5d6ba67-b815-4ec1-9d75-ee5436f5e3c7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:40.968024 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c075893f-3159-41b2-bb03-96e16291d77c tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:40.971385 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c075893f-3159-41b2-bb03-96e16291d77c tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:40.972060 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c075893f-3159-41b2-bb03-96e16291d77c tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:40.973338 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c075893f-3159-41b2-bb03-96e16291d77c tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:40.975631 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c075893f-3159-41b2-bb03-96e16291d77c tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:40.981353 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c075893f-3159-41b2-bb03-96e16291d77c tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:41.029733 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-0f785bbe-a24b-4e46-bc47-1527b8377b2e tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] 10.222.0.70 "PUT /compute/v2.1/os-aggregates/9" status: 200 len: 335 microversion: 2.1 time: 0.311271 Aug 27 02:40:41.031286 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 117/257] 10.222.0.70 () {60 vars in 1170 bytes} [Sat Aug 27 02:40:40 2022] PUT /compute/v2.1/os-aggregates/9 => generated 335 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:40:41.043938 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b56c67cb-0c2a-4d34-8e63-0c549cacb487 tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:41.106612 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b56c67cb-0c2a-4d34-8e63-0c549cacb487 tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] 10.222.0.70 "GET /compute/v2.1/os-aggregates" status: 200 len: 338 microversion: 2.1 time: 0.066045 Aug 27 02:40:41.108974 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 118/258] 10.222.0.70 () {58 vars in 1143 bytes} [Sat Aug 27 02:40:41 2022] GET /compute/v2.1/os-aggregates => generated 338 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:40:41.130624 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-079bde99-f748-4896-8cf3-ac339d550525 tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:41.179121 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=83,nova_api:DELETE=10,nova_api:UPDATE=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:40:41.217426 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-079bde99-f748-4896-8cf3-ac339d550525 tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] 10.222.0.70 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.096137 Aug 27 02:40:41.220825 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 119/259] 10.222.0.70 () {58 vars in 1152 bytes} [Sat Aug 27 02:40:41 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 27 02:40:41.237056 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ccc202f2-14e5-48cc-b331-8e4ebe98a146 tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-83327742"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:41.250021 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.aggregate [None req-ccc202f2-14e5-48cc-b331-8e4ebe98a146 tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] Generated uuid 53ebc1e5-950b-4656-bc09-19ed38c20434 for aggregate {{(pid=134052) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 02:40:41.309091 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ccc202f2-14e5-48cc-b331-8e4ebe98a146 tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.082094 Aug 27 02:40:41.319311 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 120/260] 10.222.0.70 () {60 vars in 1164 bytes} [Sat Aug 27 02:40:41 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:40:41.344825 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-35d31a11-4c52-4b61-9670-7cfe4b9f83f3 tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:41.366155 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-c075893f-3159-41b2-bb03-96e16291d77c tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c850104e6d430397bb54d0e3730a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72992d9dba564526b223533398a94dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:41.368285 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-35d31a11-4c52-4b61-9670-7cfe4b9f83f3 tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] 10.222.0.70 "GET /compute/v2.1/os-aggregates" status: 200 len: 229 microversion: 2.1 time: 0.047726 Aug 27 02:40:41.370569 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 121/261] 10.222.0.70 () {58 vars in 1143 bytes} [Sat Aug 27 02:40:41 2022] GET /compute/v2.1/os-aggregates => generated 229 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:40:41.384387 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0b6aee55-8d81-4d10-8c12-a435aafdd4e0 tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:41.386128 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c075893f-3159-41b2-bb03-96e16291d77c tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] 10.222.0.70 "GET /compute/v2.1/servers/f5d6ba67-b815-4ec1-9d75-ee5436f5e3c7" status: 200 len: 1388 microversion: 2.1 time: 0.435276 Aug 27 02:40:41.387185 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 141/262] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:40 2022] GET /compute/v2.1/servers/f5d6ba67-b815-4ec1-9d75-ee5436f5e3c7 => generated 1388 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:41.434113 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-64e016bc-3c2c-4132-9e8e-5d8beba3ddb2 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:41.435725 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-64e016bc-3c2c-4132-9e8e-5d8beba3ddb2 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: 12acf567-09ef-4971-b085-8b5566fd1b79] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:41.441266 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-0b6aee55-8d81-4d10-8c12-a435aafdd4e0 tempest-AggregatesAdminTestJSON-1170478554 tempest-AggregatesAdminTestJSON-1170478554-project-admin] 10.222.0.70 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.061267 Aug 27 02:40:41.442478 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 122/263] 10.222.0.70 () {58 vars in 1155 bytes} [Sat Aug 27 02:40:41 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 27 02:40:41.460916 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ec8b2d6c-685e-487e-aa2b-b05d6b2a5fb2 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:41.462040 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-ec8b2d6c-685e-487e-aa2b-b05d6b2a5fb2 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] [instance: b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:41.463863 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-64e016bc-3c2c-4132-9e8e-5d8beba3ddb2 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:41.464595 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-64e016bc-3c2c-4132-9e8e-5d8beba3ddb2 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:41.467676 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-64e016bc-3c2c-4132-9e8e-5d8beba3ddb2 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:41.469064 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-64e016bc-3c2c-4132-9e8e-5d8beba3ddb2 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:41.470109 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-64e016bc-3c2c-4132-9e8e-5d8beba3ddb2 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:41.472907 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-64e016bc-3c2c-4132-9e8e-5d8beba3ddb2 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:41.491003 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ec8b2d6c-685e-487e-aa2b-b05d6b2a5fb2 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:41.492848 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ec8b2d6c-685e-487e-aa2b-b05d6b2a5fb2 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:41.494102 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ec8b2d6c-685e-487e-aa2b-b05d6b2a5fb2 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:41.495925 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ec8b2d6c-685e-487e-aa2b-b05d6b2a5fb2 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:41.496664 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ec8b2d6c-685e-487e-aa2b-b05d6b2a5fb2 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:41.497300 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ec8b2d6c-685e-487e-aa2b-b05d6b2a5fb2 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:41.526737 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-ec8b2d6c-685e-487e-aa2b-b05d6b2a5fb2 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] HTTP exception thrown: Instance b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe could not be found. Aug 27 02:40:41.529859 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ec8b2d6c-685e-487e-aa2b-b05d6b2a5fb2 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Request method failure captured: Aug 27 02:40:41.529859 n-d-852278-4 devstack@n-api.service[134052]: request: DELETE /compute/v2.1/servers/b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe HTTP/1.1 Aug 27 02:40:41.529859 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:40:41.529859 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:40:41.529859 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:40:41.529859 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:40:41.529859 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:40:41.529859 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:40:41.529859 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:40:41.529859 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:40:41.529859 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYPtUtGKFTD1H8qVjq1ImJXu-QHObGwcxq42f1zsL4wCbuU17gcMO9JHpcJcJgTUqMjEoA22YW6nl_88ggfnDu7er6tvIAlk3kWtCSOAoIjCkfX4Ab8-0fdhJ6yrWzGlA6a36prEqxQxxDBGHa_l4x8Z1RUmABwkMSJWmaFSdCZOgnQ Aug 27 02:40:41.529859 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:40:41.529859 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:40:41.529859 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:40:41.529859 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:40:41.529859 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:40:41.529859 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:40:41.529859 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 13b427157c9f406da72d9b29af734987 Aug 27 02:40:41.529859 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-AggregatesAdminTestJSON-1445920633 Aug 27 02:40:41.529859 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:40:41.529859 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:40:41.531039 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/13b427157c9f406da72d9b29af734987"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_13b427157c9f406da72d9b29af734987", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/13b427157c9f406da72d9b29af734987"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/13b427157c9f406da72d9b29af734987"}]}] Aug 27 02:40:41.531039 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-AggregatesAdminTestJSON-1445920633 Aug 27 02:40:41.531039 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 13b427157c9f406da72d9b29af734987 Aug 27 02:40:41.531039 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1445920633 Aug 27 02:40:41.531039 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-AggregatesAdminTestJSON-1445920633-project Aug 27 02:40:41.531039 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:40:41.531039 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:40:41.531039 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: be5f4e86197e4175b223f20cacce792d Aug 27 02:40:41.531039 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-AggregatesAdminTestJSON-1445920633-project Aug 27 02:40:41.531039 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 02:40:41.531039 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe could not be found. Aug 27 02:40:41.531039 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': 'b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe'} Aug 27 02:40:41.531785 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:40:41.531785 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:41.531785 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:40:41.531785 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:40:41.531785 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:40:41.531785 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:40:41.531785 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:40:41.531785 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:40:41.531785 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:40:41.531785 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:40:41.531785 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe could not be found. Aug 27 02:40:41.531785 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:41.531785 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:41.531785 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:41.531785 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:41.531785 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:41.531785 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:41.531785 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:40:41.531785 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:40:41.531785 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:40:41.533076 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:40:41.533076 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 02:40:41.533076 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 02:40:41.533076 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 02:40:41.533076 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 02:40:41.533076 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:40:41.533076 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:40:41.533076 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:40:41.533076 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:40:41.533076 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe could not be found. Aug 27 02:40:41.533076 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:41.533076 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:41.533076 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:41.533076 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:41.533076 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:41.533076 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:41.533076 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:40:41.533076 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:40:41.533076 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe could not be found. Aug 27 02:40:41.533076 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:41.537341 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ec8b2d6c-685e-487e-aa2b-b05d6b2a5fb2 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Returning 404 to user: Instance b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:40:41.541134 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ec8b2d6c-685e-487e-aa2b-b05d6b2a5fb2 tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] 10.222.0.70 "DELETE /compute/v2.1/servers/b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe" status: 404 len: 111 microversion: 2.1 time: 0.093536 Aug 27 02:40:41.542533 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 123/264] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:40:41 2022] DELETE /compute/v2.1/servers/b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:40:41.551287 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-39b9eb5b-c631-4bc9-a25c-2403605b3fae tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:41.562015 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-39b9eb5b-c631-4bc9-a25c-2403605b3fae tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] [instance: b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:41.587231 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-39b9eb5b-c631-4bc9-a25c-2403605b3fae tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:41.587912 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-39b9eb5b-c631-4bc9-a25c-2403605b3fae tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:41.593116 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-39b9eb5b-c631-4bc9-a25c-2403605b3fae tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:41.594018 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-39b9eb5b-c631-4bc9-a25c-2403605b3fae tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:41.596985 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-39b9eb5b-c631-4bc9-a25c-2403605b3fae tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:41.597641 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-39b9eb5b-c631-4bc9-a25c-2403605b3fae tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:41.633052 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-39b9eb5b-c631-4bc9-a25c-2403605b3fae tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] HTTP exception thrown: Instance b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe could not be found. Aug 27 02:40:41.646122 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-39b9eb5b-c631-4bc9-a25c-2403605b3fae tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Request method failure captured: Aug 27 02:40:41.646122 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/servers/b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe HTTP/1.1 Aug 27 02:40:41.646122 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:40:41.646122 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:40:41.646122 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:40:41.646122 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:40:41.646122 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:40:41.646122 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:40:41.646122 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:40:41.646122 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:40:41.646122 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYPtUtGKFTD1H8qVjq1ImJXu-QHObGwcxq42f1zsL4wCbuU17gcMO9JHpcJcJgTUqMjEoA22YW6nl_88ggfnDu7er6tvIAlk3kWtCSOAoIjCkfX4Ab8-0fdhJ6yrWzGlA6a36prEqxQxxDBGHa_l4x8Z1RUmABwkMSJWmaFSdCZOgnQ Aug 27 02:40:41.646122 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:40:41.646122 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:40:41.646122 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:40:41.646122 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:40:41.646122 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:40:41.646122 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:40:41.646122 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 13b427157c9f406da72d9b29af734987 Aug 27 02:40:41.646122 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-AggregatesAdminTestJSON-1445920633 Aug 27 02:40:41.646122 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:40:41.646122 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:40:41.647522 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/13b427157c9f406da72d9b29af734987"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_13b427157c9f406da72d9b29af734987", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/13b427157c9f406da72d9b29af734987"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/13b427157c9f406da72d9b29af734987"}]}] Aug 27 02:40:41.647522 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-AggregatesAdminTestJSON-1445920633 Aug 27 02:40:41.647522 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 13b427157c9f406da72d9b29af734987 Aug 27 02:40:41.647522 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1445920633 Aug 27 02:40:41.647522 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-AggregatesAdminTestJSON-1445920633-project Aug 27 02:40:41.647522 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:40:41.647522 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:40:41.647522 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: be5f4e86197e4175b223f20cacce792d Aug 27 02:40:41.647522 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-AggregatesAdminTestJSON-1445920633-project Aug 27 02:40:41.647522 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 02:40:41.647522 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe could not be found. Aug 27 02:40:41.647522 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': 'b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe'} Aug 27 02:40:41.648368 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:40:41.648368 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:41.648368 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:40:41.648368 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:40:41.648368 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:40:41.648368 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:40:41.648368 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:40:41.648368 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:40:41.648368 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:40:41.648368 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:40:41.648368 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe could not be found. Aug 27 02:40:41.648368 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:41.648368 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:41.648368 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:41.648368 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:41.648368 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:41.648368 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:41.648368 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:40:41.648368 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:40:41.648368 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:40:41.649698 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:40:41.649698 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:40:41.649698 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:40:41.649698 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:40:41.649698 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:40:41.649698 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:40:41.649698 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:40:41.649698 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe could not be found. Aug 27 02:40:41.649698 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:41.649698 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:41.649698 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:41.649698 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:41.649698 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:41.649698 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:41.649698 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:40:41.649698 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:40:41.649698 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe could not be found. Aug 27 02:40:41.649698 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:41.651888 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-39b9eb5b-c631-4bc9-a25c-2403605b3fae tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] Returning 404 to user: Instance b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:40:41.651888 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-39b9eb5b-c631-4bc9-a25c-2403605b3fae tempest-AggregatesAdminTestJSON-1445920633 tempest-AggregatesAdminTestJSON-1445920633-project] 10.222.0.70 "GET /compute/v2.1/servers/b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe" status: 404 len: 111 microversion: 2.1 time: 0.103702 Aug 27 02:40:41.657187 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 124/265] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:41 2022] GET /compute/v2.1/servers/b9a14b3b-d07c-4d8c-9a7a-d03fb5cf8ffe => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:40:41.669685 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9b3e85a5-d49c-4b3f-9971-90a92656a4c4 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:41.672634 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-9b3e85a5-d49c-4b3f-9971-90a92656a4c4 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] [instance: 11661332-bcfc-46f3-a5ba-30eb82448817] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:41.697464 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9b3e85a5-d49c-4b3f-9971-90a92656a4c4 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:41.699829 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9b3e85a5-d49c-4b3f-9971-90a92656a4c4 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:41.700379 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9b3e85a5-d49c-4b3f-9971-90a92656a4c4 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:41.706597 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9b3e85a5-d49c-4b3f-9971-90a92656a4c4 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:41.707137 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9b3e85a5-d49c-4b3f-9971-90a92656a4c4 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:41.707567 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9b3e85a5-d49c-4b3f-9971-90a92656a4c4 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:42.156445 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-64e016bc-3c2c-4132-9e8e-5d8beba3ddb2 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:42.173988 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-64e016bc-3c2c-4132-9e8e-5d8beba3ddb2 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:42.179044 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-64e016bc-3c2c-4132-9e8e-5d8beba3ddb2 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:42.183121 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-64e016bc-3c2c-4132-9e8e-5d8beba3ddb2 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/12acf567-09ef-4971-b085-8b5566fd1b79" status: 200 len: 1566 microversion: 2.25 time: 0.755513 Aug 27 02:40:42.196470 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 142/266] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:40:41 2022] GET /compute/v2.1/servers/12acf567-09ef-4971-b085-8b5566fd1b79 => generated 1566 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:40:42.229794 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-bfb93d2e-6cfc-4aba-af9a-3fadea91227b tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:42.231745 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-bfb93d2e-6cfc-4aba-af9a-3fadea91227b tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] [instance: 96881762-a0a0-425f-a3b6-cc87adbae319] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:42.247725 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bfb93d2e-6cfc-4aba-af9a-3fadea91227b tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:42.248266 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bfb93d2e-6cfc-4aba-af9a-3fadea91227b tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:42.248762 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bfb93d2e-6cfc-4aba-af9a-3fadea91227b tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:42.249617 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bfb93d2e-6cfc-4aba-af9a-3fadea91227b tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:42.250207 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bfb93d2e-6cfc-4aba-af9a-3fadea91227b tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:42.250826 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bfb93d2e-6cfc-4aba-af9a-3fadea91227b tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:42.323157 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-9b3e85a5-d49c-4b3f-9971-90a92656a4c4 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772e2e66c92e44f8838ce325437d5a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b2f4a529a3e4ea0937ca903dd5924bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:42.344682 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9b3e85a5-d49c-4b3f-9971-90a92656a4c4 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] 10.222.0.70 "GET /compute/v2.1/servers/11661332-bcfc-46f3-a5ba-30eb82448817" status: 200 len: 1320 microversion: 2.1 time: 0.684059 Aug 27 02:40:42.345705 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 125/267] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:41 2022] GET /compute/v2.1/servers/11661332-bcfc-46f3-a5ba-30eb82448817 => generated 1320 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:42.409335 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-89ab0ace-92c2-4268-a3fc-0a9b3f5bef9e tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:42.410063 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-89ab0ace-92c2-4268-a3fc-0a9b3f5bef9e tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] [instance: f5d6ba67-b815-4ec1-9d75-ee5436f5e3c7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:42.419823 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-89ab0ace-92c2-4268-a3fc-0a9b3f5bef9e tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:42.424659 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-89ab0ace-92c2-4268-a3fc-0a9b3f5bef9e tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:42.425211 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-89ab0ace-92c2-4268-a3fc-0a9b3f5bef9e tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:42.426045 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-89ab0ace-92c2-4268-a3fc-0a9b3f5bef9e tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:42.426668 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-89ab0ace-92c2-4268-a3fc-0a9b3f5bef9e tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:42.427159 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-89ab0ace-92c2-4268-a3fc-0a9b3f5bef9e tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:43.117381 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-bfb93d2e-6cfc-4aba-af9a-3fadea91227b tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68711ff38ec41c0b051124527c7ac35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae179f416c451e92e270d2cb0f4400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:43.147074 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-bfb93d2e-6cfc-4aba-af9a-3fadea91227b tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] 10.222.0.70 "GET /compute/v2.1/servers/96881762-a0a0-425f-a3b6-cc87adbae319" status: 200 len: 1319 microversion: 2.1 time: 0.946771 Aug 27 02:40:43.160344 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 143/268] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:42 2022] GET /compute/v2.1/servers/96881762-a0a0-425f-a3b6-cc87adbae319 => generated 1319 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:43.215488 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7b351280-a832-49ab-9607-eb7b0fc99a02 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:43.216531 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-7b351280-a832-49ab-9607-eb7b0fc99a02 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: 12acf567-09ef-4971-b085-8b5566fd1b79] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:43.233190 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7b351280-a832-49ab-9607-eb7b0fc99a02 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:43.234196 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7b351280-a832-49ab-9607-eb7b0fc99a02 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:43.234649 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-89ab0ace-92c2-4268-a3fc-0a9b3f5bef9e tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c850104e6d430397bb54d0e3730a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72992d9dba564526b223533398a94dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:43.235065 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7b351280-a832-49ab-9607-eb7b0fc99a02 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:43.236958 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7b351280-a832-49ab-9607-eb7b0fc99a02 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:43.237600 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7b351280-a832-49ab-9607-eb7b0fc99a02 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:43.238036 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7b351280-a832-49ab-9607-eb7b0fc99a02 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:43.253381 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-89ab0ace-92c2-4268-a3fc-0a9b3f5bef9e tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] 10.222.0.70 "GET /compute/v2.1/servers/f5d6ba67-b815-4ec1-9d75-ee5436f5e3c7" status: 200 len: 1388 microversion: 2.1 time: 0.848167 Aug 27 02:40:43.254189 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 126/269] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:42 2022] GET /compute/v2.1/servers/f5d6ba67-b815-4ec1-9d75-ee5436f5e3c7 => generated 1388 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:40:43.367450 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9ea88f40-aaa8-4e70-beb3-0eebb2135c17 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:43.368857 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-9ea88f40-aaa8-4e70-beb3-0eebb2135c17 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] [instance: 11661332-bcfc-46f3-a5ba-30eb82448817] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:43.402229 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9ea88f40-aaa8-4e70-beb3-0eebb2135c17 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:43.403815 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9ea88f40-aaa8-4e70-beb3-0eebb2135c17 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:43.404515 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9ea88f40-aaa8-4e70-beb3-0eebb2135c17 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:43.405711 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9ea88f40-aaa8-4e70-beb3-0eebb2135c17 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:43.406919 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9ea88f40-aaa8-4e70-beb3-0eebb2135c17 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:43.407043 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9ea88f40-aaa8-4e70-beb3-0eebb2135c17 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:43.538942 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:40:43.710397 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-7b351280-a832-49ab-9607-eb7b0fc99a02 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:43.729566 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-7b351280-a832-49ab-9607-eb7b0fc99a02 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:43.732285 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-7b351280-a832-49ab-9607-eb7b0fc99a02 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:43.734126 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-7b351280-a832-49ab-9607-eb7b0fc99a02 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/12acf567-09ef-4971-b085-8b5566fd1b79" status: 200 len: 1566 microversion: 2.25 time: 0.530555 Aug 27 02:40:43.734892 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 144/270] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:40:43 2022] GET /compute/v2.1/servers/12acf567-09ef-4971-b085-8b5566fd1b79 => generated 1566 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:40:43.810216 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-9ea88f40-aaa8-4e70-beb3-0eebb2135c17 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772e2e66c92e44f8838ce325437d5a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b2f4a529a3e4ea0937ca903dd5924bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:43.819341 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9ea88f40-aaa8-4e70-beb3-0eebb2135c17 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] 10.222.0.70 "GET /compute/v2.1/servers/11661332-bcfc-46f3-a5ba-30eb82448817" status: 200 len: 1320 microversion: 2.1 time: 0.456928 Aug 27 02:40:43.823368 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 127/271] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:43 2022] GET /compute/v2.1/servers/11661332-bcfc-46f3-a5ba-30eb82448817 => generated 1320 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:40:44.000491 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-d5731e11-3a23-4fa8-88b5-94311d9bf28b req-3bce55e2-5caf-4110-a7bf-36e4d013ef8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96881762-a0a0-425f-a3b6-cc87adbae319", "tag": "43725a41-1e0e-4350-8a03-16c133420308"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:44.019890 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-d5731e11-3a23-4fa8-88b5-94311d9bf28b req-3bce55e2-5caf-4110-a7bf-36e4d013ef8e service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:44.020421 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-d5731e11-3a23-4fa8-88b5-94311d9bf28b req-3bce55e2-5caf-4110-a7bf-36e4d013ef8e service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:44.023156 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-d5731e11-3a23-4fa8-88b5-94311d9bf28b req-3bce55e2-5caf-4110-a7bf-36e4d013ef8e service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:44.048096 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-d5731e11-3a23-4fa8-88b5-94311d9bf28b req-3bce55e2-5caf-4110-a7bf-36e4d013ef8e service nova] Creating event network-changed:43725a41-1e0e-4350-8a03-16c133420308 for instance 96881762-a0a0-425f-a3b6-cc87adbae319 on n-h2-852278-4 Aug 27 02:40:44.061276 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-d5731e11-3a23-4fa8-88b5-94311d9bf28b req-3bce55e2-5caf-4110-a7bf-36e4d013ef8e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064486 Aug 27 02:40:44.064851 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 145/272] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:40:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:40:44.174112 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6bf34fe0-bb08-44a3-a8f9-61711885e750 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:44.175230 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-6bf34fe0-bb08-44a3-a8f9-61711885e750 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] [instance: 96881762-a0a0-425f-a3b6-cc87adbae319] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:44.189257 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6bf34fe0-bb08-44a3-a8f9-61711885e750 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:44.192547 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6bf34fe0-bb08-44a3-a8f9-61711885e750 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:44.199808 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6bf34fe0-bb08-44a3-a8f9-61711885e750 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:44.200856 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6bf34fe0-bb08-44a3-a8f9-61711885e750 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:44.201529 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6bf34fe0-bb08-44a3-a8f9-61711885e750 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:44.202201 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6bf34fe0-bb08-44a3-a8f9-61711885e750 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:44.277022 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-76ddfb75-3db1-4597-ab9d-d0ed73571519 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:44.278397 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-76ddfb75-3db1-4597-ab9d-d0ed73571519 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] [instance: f5d6ba67-b815-4ec1-9d75-ee5436f5e3c7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:44.292926 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-76ddfb75-3db1-4597-ab9d-d0ed73571519 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:44.300296 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-76ddfb75-3db1-4597-ab9d-d0ed73571519 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:44.301743 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-76ddfb75-3db1-4597-ab9d-d0ed73571519 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:44.302759 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-76ddfb75-3db1-4597-ab9d-d0ed73571519 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:44.303837 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-76ddfb75-3db1-4597-ab9d-d0ed73571519 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:44.309409 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-76ddfb75-3db1-4597-ab9d-d0ed73571519 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:44.714586 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-6bf34fe0-bb08-44a3-a8f9-61711885e750 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68711ff38ec41c0b051124527c7ac35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae179f416c451e92e270d2cb0f4400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:44.743428 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-6bf34fe0-bb08-44a3-a8f9-61711885e750 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] 10.222.0.70 "GET /compute/v2.1/servers/96881762-a0a0-425f-a3b6-cc87adbae319" status: 200 len: 1319 microversion: 2.1 time: 0.569639 Aug 27 02:40:44.747555 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 128/273] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:44 2022] GET /compute/v2.1/servers/96881762-a0a0-425f-a3b6-cc87adbae319 => generated 1319 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:44.775250 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-76ddfb75-3db1-4597-ab9d-d0ed73571519 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c850104e6d430397bb54d0e3730a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72992d9dba564526b223533398a94dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:44.780588 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e80072c2-94fd-4122-b7fc-d3d8ed2bd03d tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:44.781161 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-e80072c2-94fd-4122-b7fc-d3d8ed2bd03d tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: 12acf567-09ef-4971-b085-8b5566fd1b79] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:44.799132 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e80072c2-94fd-4122-b7fc-d3d8ed2bd03d tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:44.799901 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-76ddfb75-3db1-4597-ab9d-d0ed73571519 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] 10.222.0.70 "GET /compute/v2.1/servers/f5d6ba67-b815-4ec1-9d75-ee5436f5e3c7" status: 200 len: 1388 microversion: 2.1 time: 0.515135 Aug 27 02:40:44.802106 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 146/274] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:44 2022] GET /compute/v2.1/servers/f5d6ba67-b815-4ec1-9d75-ee5436f5e3c7 => generated 1388 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:40:44.814997 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e80072c2-94fd-4122-b7fc-d3d8ed2bd03d tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:44.822198 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e80072c2-94fd-4122-b7fc-d3d8ed2bd03d tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:44.823180 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e80072c2-94fd-4122-b7fc-d3d8ed2bd03d tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:44.823779 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e80072c2-94fd-4122-b7fc-d3d8ed2bd03d tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:44.834371 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e80072c2-94fd-4122-b7fc-d3d8ed2bd03d tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:44.842438 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-05bdb4d4-21c1-4bcd-9c55-bb496ecc005b tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:44.843393 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-05bdb4d4-21c1-4bcd-9c55-bb496ecc005b tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] [instance: 11661332-bcfc-46f3-a5ba-30eb82448817] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:44.852125 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-05bdb4d4-21c1-4bcd-9c55-bb496ecc005b tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:44.855649 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-05bdb4d4-21c1-4bcd-9c55-bb496ecc005b tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:44.861884 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-05bdb4d4-21c1-4bcd-9c55-bb496ecc005b tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:44.863663 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-05bdb4d4-21c1-4bcd-9c55-bb496ecc005b tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:44.864577 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-05bdb4d4-21c1-4bcd-9c55-bb496ecc005b tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:44.866001 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-05bdb4d4-21c1-4bcd-9c55-bb496ecc005b tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:45.186644 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-e80072c2-94fd-4122-b7fc-d3d8ed2bd03d tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:45.202066 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-e80072c2-94fd-4122-b7fc-d3d8ed2bd03d tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:45.205066 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-e80072c2-94fd-4122-b7fc-d3d8ed2bd03d tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:45.209037 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e80072c2-94fd-4122-b7fc-d3d8ed2bd03d tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/12acf567-09ef-4971-b085-8b5566fd1b79" status: 200 len: 1566 microversion: 2.25 time: 0.441862 Aug 27 02:40:45.213042 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 129/275] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:40:44 2022] GET /compute/v2.1/servers/12acf567-09ef-4971-b085-8b5566fd1b79 => generated 1566 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:40:45.231571 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-b7ed660f-13b5-42fd-8584-b6c3a61bb860 req-3295459a-7b57-468b-ade6-71c0f66dfbd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5d6ba67-b815-4ec1-9d75-ee5436f5e3c7", "name": "network-vif-plugged", "status": "completed", "tag": "0684103c-d1c3-4cad-be37-7a7306355319"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:45.258289 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-05bdb4d4-21c1-4bcd-9c55-bb496ecc005b tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772e2e66c92e44f8838ce325437d5a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b2f4a529a3e4ea0937ca903dd5924bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:45.266824 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-05bdb4d4-21c1-4bcd-9c55-bb496ecc005b tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] 10.222.0.70 "GET /compute/v2.1/servers/11661332-bcfc-46f3-a5ba-30eb82448817" status: 200 len: 1320 microversion: 2.1 time: 0.428722 Aug 27 02:40:45.269677 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 147/276] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:44 2022] GET /compute/v2.1/servers/11661332-bcfc-46f3-a5ba-30eb82448817 => generated 1320 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:40:45.270204 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-b7ed660f-13b5-42fd-8584-b6c3a61bb860 req-3295459a-7b57-468b-ade6-71c0f66dfbd6 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:45.270673 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-b7ed660f-13b5-42fd-8584-b6c3a61bb860 req-3295459a-7b57-468b-ade6-71c0f66dfbd6 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:45.271091 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-b7ed660f-13b5-42fd-8584-b6c3a61bb860 req-3295459a-7b57-468b-ade6-71c0f66dfbd6 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:45.329387 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-b7ed660f-13b5-42fd-8584-b6c3a61bb860 req-3295459a-7b57-468b-ade6-71c0f66dfbd6 service nova] Creating event network-vif-plugged:0684103c-d1c3-4cad-be37-7a7306355319 for instance f5d6ba67-b815-4ec1-9d75-ee5436f5e3c7 on n-h1-852278-4 Aug 27 02:40:45.349743 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-b7ed660f-13b5-42fd-8584-b6c3a61bb860 req-3295459a-7b57-468b-ade6-71c0f66dfbd6 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132807 Aug 27 02:40:45.350856 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 130/277] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:40:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:40:45.770651 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b39eb268-578a-4e2c-a92f-bd60e6d25cf5 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:45.771265 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b39eb268-578a-4e2c-a92f-bd60e6d25cf5 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] [instance: 96881762-a0a0-425f-a3b6-cc87adbae319] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:45.787929 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b39eb268-578a-4e2c-a92f-bd60e6d25cf5 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:45.790594 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b39eb268-578a-4e2c-a92f-bd60e6d25cf5 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:45.791381 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b39eb268-578a-4e2c-a92f-bd60e6d25cf5 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:45.795046 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b39eb268-578a-4e2c-a92f-bd60e6d25cf5 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:45.796263 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b39eb268-578a-4e2c-a92f-bd60e6d25cf5 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:45.799435 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b39eb268-578a-4e2c-a92f-bd60e6d25cf5 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:45.826313 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-62776de4-32d2-4f6e-9391-cb6910fa52d1 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:45.827088 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-62776de4-32d2-4f6e-9391-cb6910fa52d1 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] [instance: f5d6ba67-b815-4ec1-9d75-ee5436f5e3c7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:45.843877 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-62776de4-32d2-4f6e-9391-cb6910fa52d1 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:45.847885 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-62776de4-32d2-4f6e-9391-cb6910fa52d1 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:45.850791 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-62776de4-32d2-4f6e-9391-cb6910fa52d1 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:45.851575 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-62776de4-32d2-4f6e-9391-cb6910fa52d1 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:45.852042 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-62776de4-32d2-4f6e-9391-cb6910fa52d1 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:45.856731 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-62776de4-32d2-4f6e-9391-cb6910fa52d1 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:46.122014 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-b39eb268-578a-4e2c-a92f-bd60e6d25cf5 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68711ff38ec41c0b051124527c7ac35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae179f416c451e92e270d2cb0f4400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:46.135921 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b39eb268-578a-4e2c-a92f-bd60e6d25cf5 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] 10.222.0.70 "GET /compute/v2.1/servers/96881762-a0a0-425f-a3b6-cc87adbae319" status: 200 len: 1319 microversion: 2.1 time: 0.370660 Aug 27 02:40:46.153239 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 148/278] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:45 2022] GET /compute/v2.1/servers/96881762-a0a0-425f-a3b6-cc87adbae319 => generated 1319 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:46.187734 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-62776de4-32d2-4f6e-9391-cb6910fa52d1 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c850104e6d430397bb54d0e3730a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72992d9dba564526b223533398a94dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:46.199804 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-62776de4-32d2-4f6e-9391-cb6910fa52d1 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] 10.222.0.70 "GET /compute/v2.1/servers/f5d6ba67-b815-4ec1-9d75-ee5436f5e3c7" status: 200 len: 1388 microversion: 2.1 time: 0.378688 Aug 27 02:40:46.203366 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 131/279] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:45 2022] GET /compute/v2.1/servers/f5d6ba67-b815-4ec1-9d75-ee5436f5e3c7 => generated 1388 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:46.242985 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3516d9d4-3128-4a54-ab89-0297b63aedb2 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:46.243458 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-3516d9d4-3128-4a54-ab89-0297b63aedb2 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: 12acf567-09ef-4971-b085-8b5566fd1b79] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:46.252388 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3516d9d4-3128-4a54-ab89-0297b63aedb2 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:46.253433 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3516d9d4-3128-4a54-ab89-0297b63aedb2 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:46.254142 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3516d9d4-3128-4a54-ab89-0297b63aedb2 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:46.255018 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3516d9d4-3128-4a54-ab89-0297b63aedb2 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:46.255615 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3516d9d4-3128-4a54-ab89-0297b63aedb2 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:46.256541 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3516d9d4-3128-4a54-ab89-0297b63aedb2 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:46.294347 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-09e4da51-a762-4987-bf50-a8fc8446d6f1 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:46.295420 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-09e4da51-a762-4987-bf50-a8fc8446d6f1 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] [instance: 11661332-bcfc-46f3-a5ba-30eb82448817] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:46.307033 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-09e4da51-a762-4987-bf50-a8fc8446d6f1 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:46.308598 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-09e4da51-a762-4987-bf50-a8fc8446d6f1 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:46.311398 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-09e4da51-a762-4987-bf50-a8fc8446d6f1 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:46.313618 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-09e4da51-a762-4987-bf50-a8fc8446d6f1 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:46.316263 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-09e4da51-a762-4987-bf50-a8fc8446d6f1 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:46.318667 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-09e4da51-a762-4987-bf50-a8fc8446d6f1 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:46.878181 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-3516d9d4-3128-4a54-ab89-0297b63aedb2 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:46.889376 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-3516d9d4-3128-4a54-ab89-0297b63aedb2 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:46.897573 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-3516d9d4-3128-4a54-ab89-0297b63aedb2 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:46.906240 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-3516d9d4-3128-4a54-ab89-0297b63aedb2 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/12acf567-09ef-4971-b085-8b5566fd1b79" status: 200 len: 1566 microversion: 2.25 time: 0.664579 Aug 27 02:40:46.907446 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 149/280] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:40:46 2022] GET /compute/v2.1/servers/12acf567-09ef-4971-b085-8b5566fd1b79 => generated 1566 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:40:46.913183 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-09e4da51-a762-4987-bf50-a8fc8446d6f1 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772e2e66c92e44f8838ce325437d5a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b2f4a529a3e4ea0937ca903dd5924bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:46.926393 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-09e4da51-a762-4987-bf50-a8fc8446d6f1 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] 10.222.0.70 "GET /compute/v2.1/servers/11661332-bcfc-46f3-a5ba-30eb82448817" status: 200 len: 1320 microversion: 2.1 time: 0.637487 Aug 27 02:40:46.926992 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 132/281] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:46 2022] GET /compute/v2.1/servers/11661332-bcfc-46f3-a5ba-30eb82448817 => generated 1320 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:47.159021 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-037f5d3f-07b4-4ff6-acaf-f3f98f3dac67 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:47.160292 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-037f5d3f-07b4-4ff6-acaf-f3f98f3dac67 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] [instance: 96881762-a0a0-425f-a3b6-cc87adbae319] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:47.179015 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-037f5d3f-07b4-4ff6-acaf-f3f98f3dac67 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:47.179684 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-037f5d3f-07b4-4ff6-acaf-f3f98f3dac67 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:47.180245 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-037f5d3f-07b4-4ff6-acaf-f3f98f3dac67 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:47.182767 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-037f5d3f-07b4-4ff6-acaf-f3f98f3dac67 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:47.183494 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-037f5d3f-07b4-4ff6-acaf-f3f98f3dac67 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:47.184015 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-037f5d3f-07b4-4ff6-acaf-f3f98f3dac67 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:47.223134 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-fe72eefb-ff03-47b6-8b33-e6d9a5acbd4c tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:47.224216 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-fe72eefb-ff03-47b6-8b33-e6d9a5acbd4c tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] [instance: f5d6ba67-b815-4ec1-9d75-ee5436f5e3c7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:47.232772 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fe72eefb-ff03-47b6-8b33-e6d9a5acbd4c tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:47.239642 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fe72eefb-ff03-47b6-8b33-e6d9a5acbd4c tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:47.240338 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fe72eefb-ff03-47b6-8b33-e6d9a5acbd4c tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:47.242573 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fe72eefb-ff03-47b6-8b33-e6d9a5acbd4c tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:47.244277 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fe72eefb-ff03-47b6-8b33-e6d9a5acbd4c tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:47.248960 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fe72eefb-ff03-47b6-8b33-e6d9a5acbd4c tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:48.078297 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-037f5d3f-07b4-4ff6-acaf-f3f98f3dac67 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68711ff38ec41c0b051124527c7ac35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae179f416c451e92e270d2cb0f4400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:48.089901 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-037f5d3f-07b4-4ff6-acaf-f3f98f3dac67 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] 10.222.0.70 "GET /compute/v2.1/servers/96881762-a0a0-425f-a3b6-cc87adbae319" status: 200 len: 1319 microversion: 2.1 time: 0.936245 Aug 27 02:40:48.099315 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 150/282] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:47 2022] GET /compute/v2.1/servers/96881762-a0a0-425f-a3b6-cc87adbae319 => generated 1319 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:48.113080 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-fe72eefb-ff03-47b6-8b33-e6d9a5acbd4c tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c850104e6d430397bb54d0e3730a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72992d9dba564526b223533398a94dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:48.123092 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-fe72eefb-ff03-47b6-8b33-e6d9a5acbd4c tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] 10.222.0.70 "GET /compute/v2.1/servers/f5d6ba67-b815-4ec1-9d75-ee5436f5e3c7" status: 200 len: 1587 microversion: 2.1 time: 0.903726 Aug 27 02:40:48.127803 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 133/283] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:47 2022] GET /compute/v2.1/servers/f5d6ba67-b815-4ec1-9d75-ee5436f5e3c7 => generated 1587 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:48.135032 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3d0d0ddc-23ce-401e-8161-20063082843d tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:48.139971 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-3d0d0ddc-23ce-401e-8161-20063082843d tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: 12acf567-09ef-4971-b085-8b5566fd1b79] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:48.146254 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=26 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:40:48.158473 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3d0d0ddc-23ce-401e-8161-20063082843d tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:48.161480 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3d0d0ddc-23ce-401e-8161-20063082843d tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:48.162894 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3d0d0ddc-23ce-401e-8161-20063082843d tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:48.164475 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3d0d0ddc-23ce-401e-8161-20063082843d tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:48.166360 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3d0d0ddc-23ce-401e-8161-20063082843d tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:48.166894 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3d0d0ddc-23ce-401e-8161-20063082843d tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:48.312972 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=4 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:40:48.361180 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-3d0d0ddc-23ce-401e-8161-20063082843d tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:48.372774 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-3d0d0ddc-23ce-401e-8161-20063082843d tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:48.374558 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-3d0d0ddc-23ce-401e-8161-20063082843d tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:48.377363 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-3d0d0ddc-23ce-401e-8161-20063082843d tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/12acf567-09ef-4971-b085-8b5566fd1b79" status: 200 len: 1566 microversion: 2.25 time: 0.248124 Aug 27 02:40:48.406007 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 134/284] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:40:48 2022] GET /compute/v2.1/servers/12acf567-09ef-4971-b085-8b5566fd1b79 => generated 1566 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:40:48.418619 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5b883150-772e-44c0-b69a-42c90f37fc44 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:48.419363 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-5b883150-772e-44c0-b69a-42c90f37fc44 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] [instance: 11661332-bcfc-46f3-a5ba-30eb82448817] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:48.433840 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5b883150-772e-44c0-b69a-42c90f37fc44 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:48.436728 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5b883150-772e-44c0-b69a-42c90f37fc44 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:48.438085 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5b883150-772e-44c0-b69a-42c90f37fc44 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:48.440250 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5b883150-772e-44c0-b69a-42c90f37fc44 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:48.440934 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5b883150-772e-44c0-b69a-42c90f37fc44 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:48.443930 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5b883150-772e-44c0-b69a-42c90f37fc44 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:48.698905 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-be543190-5d08-4de7-ab15-0f3534f2d286 tempest-InstanceUsageAuditLogTestJSON-1419706424 tempest-InstanceUsageAuditLogTestJSON-1419706424-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:48.728941 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-5b883150-772e-44c0-b69a-42c90f37fc44 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772e2e66c92e44f8838ce325437d5a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b2f4a529a3e4ea0937ca903dd5924bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:48.745866 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-5b883150-772e-44c0-b69a-42c90f37fc44 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] 10.222.0.70 "GET /compute/v2.1/servers/11661332-bcfc-46f3-a5ba-30eb82448817" status: 200 len: 1320 microversion: 2.1 time: 0.336094 Aug 27 02:40:48.747520 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-be543190-5d08-4de7-ab15-0f3534f2d286 tempest-InstanceUsageAuditLogTestJSON-1419706424 tempest-InstanceUsageAuditLogTestJSON-1419706424-project-admin] 10.222.0.70 "GET /compute/v2.1/os-instance_usage_audit_log/2022-08-27 02:40:47" status: 200 len: 318 microversion: 2.1 time: 0.646550 Aug 27 02:40:48.749923 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 151/285] 10.222.0.70 () {58 vars in 1251 bytes} [Sat Aug 27 02:40:48 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-08-27%2002%3A40%3A47 => generated 318 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:40:48.756677 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 135/286] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:48 2022] GET /compute/v2.1/servers/11661332-bcfc-46f3-a5ba-30eb82448817 => generated 1320 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:48.775737 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-79b3dd78-7278-4c03-8e62-3fa2eabb5c51 req-b2eba013-2ba7-49e8-be17-e78ed0889962 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11661332-bcfc-46f3-a5ba-30eb82448817", "name": "network-vif-plugged", "status": "completed", "tag": "87995537-cd43-4eb1-9587-fbfb300e5d56"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:48.778982 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d9e5a53b-3143-4679-a09a-b75c81a9d39d tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:48.785105 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d9e5a53b-3143-4679-a09a-b75c81a9d39d tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] [instance: f5d6ba67-b815-4ec1-9d75-ee5436f5e3c7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:48.788274 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=12 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:40:48.799107 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-79b3dd78-7278-4c03-8e62-3fa2eabb5c51 req-b2eba013-2ba7-49e8-be17-e78ed0889962 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:48.800228 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-79b3dd78-7278-4c03-8e62-3fa2eabb5c51 req-b2eba013-2ba7-49e8-be17-e78ed0889962 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:48.800886 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-79b3dd78-7278-4c03-8e62-3fa2eabb5c51 req-b2eba013-2ba7-49e8-be17-e78ed0889962 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:48.805585 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d9e5a53b-3143-4679-a09a-b75c81a9d39d tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:48.806081 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d9e5a53b-3143-4679-a09a-b75c81a9d39d tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:48.808758 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d9e5a53b-3143-4679-a09a-b75c81a9d39d tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:48.810431 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d9e5a53b-3143-4679-a09a-b75c81a9d39d tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:48.810893 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d9e5a53b-3143-4679-a09a-b75c81a9d39d tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:48.811331 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d9e5a53b-3143-4679-a09a-b75c81a9d39d tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:48.816843 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-79b3dd78-7278-4c03-8e62-3fa2eabb5c51 req-b2eba013-2ba7-49e8-be17-e78ed0889962 service nova] Creating event network-vif-plugged:87995537-cd43-4eb1-9587-fbfb300e5d56 for instance 11661332-bcfc-46f3-a5ba-30eb82448817 on n-h1-852278-4 Aug 27 02:40:48.825412 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-79b3dd78-7278-4c03-8e62-3fa2eabb5c51 req-b2eba013-2ba7-49e8-be17-e78ed0889962 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066358 Aug 27 02:40:48.827980 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 136/287] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:40:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:40:48.838154 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-14c81083-d9b9-4ff4-95d5-ff1098cf3289 tempest-InstanceUsageAuditLogTestJSON-1419706424 tempest-InstanceUsageAuditLogTestJSON-1419706424-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:48.866031 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-14c81083-d9b9-4ff4-95d5-ff1098cf3289 tempest-InstanceUsageAuditLogTestJSON-1419706424 tempest-InstanceUsageAuditLogTestJSON-1419706424-project-admin] 10.222.0.70 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.036384 Aug 27 02:40:48.874802 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 137/288] 10.222.0.70 () {58 vars in 1185 bytes} [Sat Aug 27 02:40:48 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:40:48.945532 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d9e5a53b-3143-4679-a09a-b75c81a9d39d tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] 10.222.0.70 "GET /compute/v2.1/servers/f5d6ba67-b815-4ec1-9d75-ee5436f5e3c7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.194340 Aug 27 02:40:48.953952 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 152/289] 10.222.0.70 () {58 vars in 1275 bytes} [Sat Aug 27 02:40:48 2022] GET /compute/v2.1/servers/f5d6ba67-b815-4ec1-9d75-ee5436f5e3c7/os-interface => generated 285 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:40:49.299490 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-205f395d-4d96-43a6-a26c-258ce0066316 tempest-FlavorsAccessNegativeTestJSON-1848628100 tempest-FlavorsAccessNegativeTestJSON-1848628100-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-77343229", "id": 1323657754, "os-flavor-access:is_public": "False"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:49.355494 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-205f395d-4d96-43a6-a26c-258ce0066316 tempest-FlavorsAccessNegativeTestJSON-1848628100 tempest-FlavorsAccessNegativeTestJSON-1848628100-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.475351 Aug 27 02:40:49.357114 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 138/290] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 02:40:48 2022] POST /compute/v2.1/flavors => generated 437 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:40:49.379223 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a89a46f9-a394-448a-930a-80bbfc9f1da1 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:49.380853 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a89a46f9-a394-448a-930a-80bbfc9f1da1 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] [instance: 96881762-a0a0-425f-a3b6-cc87adbae319] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:49.407662 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a89a46f9-a394-448a-930a-80bbfc9f1da1 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:49.410396 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a89a46f9-a394-448a-930a-80bbfc9f1da1 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:49.413004 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a89a46f9-a394-448a-930a-80bbfc9f1da1 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:49.415119 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a89a46f9-a394-448a-930a-80bbfc9f1da1 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:49.417187 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a89a46f9-a394-448a-930a-80bbfc9f1da1 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:49.418654 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a89a46f9-a394-448a-930a-80bbfc9f1da1 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:49.678833 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-bd351ecd-4b44-478c-be5d-bc2c657467c0 tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:49.686286 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bd351ecd-4b44-478c-be5d-bc2c657467c0 tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:49.687539 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bd351ecd-4b44-478c-be5d-bc2c657467c0 tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:49.688910 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bd351ecd-4b44-478c-be5d-bc2c657467c0 tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:49.691995 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bd351ecd-4b44-478c-be5d-bc2c657467c0 tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:49.693040 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bd351ecd-4b44-478c-be5d-bc2c657467c0 tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:49.698042 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bd351ecd-4b44-478c-be5d-bc2c657467c0 tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:49.762112 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-bd351ecd-4b44-478c-be5d-bc2c657467c0 tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] 10.222.0.70 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.776504 Aug 27 02:40:49.776168 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 153/291] 10.222.0.70 () {58 vars in 1176 bytes} [Sat Aug 27 02:40:48 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:40:49.781855 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3869876f-65f5-4212-8609-a6964dba5518 tempest-FlavorsAccessNegativeTestJSON-1848628100 tempest-FlavorsAccessNegativeTestJSON-1848628100-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "25bedfbe5fe7471c9c580374770c9a4f"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:50.096379 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-3869876f-65f5-4212-8609-a6964dba5518 tempest-FlavorsAccessNegativeTestJSON-1848628100 tempest-FlavorsAccessNegativeTestJSON-1848628100-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors/1323657754/action" status: 200 len: 97 microversion: 2.1 time: 0.318647 Aug 27 02:40:50.101963 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 154/292] 10.222.0.70 () {60 vars in 1200 bytes} [Sat Aug 27 02:40:49 2022] POST /compute/v2.1/flavors/1323657754/action => generated 97 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:40:50.107403 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-1c4de759-0e04-423e-9f13-d1c3d55ffa2f tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:50.124289 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-1c4de759-0e04-423e-9f13-d1c3d55ffa2f tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: 12acf567-09ef-4971-b085-8b5566fd1b79] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:50.132513 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1c4de759-0e04-423e-9f13-d1c3d55ffa2f tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:50.133095 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1c4de759-0e04-423e-9f13-d1c3d55ffa2f tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:50.133597 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1c4de759-0e04-423e-9f13-d1c3d55ffa2f tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:50.134604 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1c4de759-0e04-423e-9f13-d1c3d55ffa2f tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:50.135144 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1c4de759-0e04-423e-9f13-d1c3d55ffa2f tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:50.135635 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1c4de759-0e04-423e-9f13-d1c3d55ffa2f tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:50.612623 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-a89a46f9-a394-448a-930a-80bbfc9f1da1 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68711ff38ec41c0b051124527c7ac35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae179f416c451e92e270d2cb0f4400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:50.626639 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a89a46f9-a394-448a-930a-80bbfc9f1da1 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] 10.222.0.70 "GET /compute/v2.1/servers/96881762-a0a0-425f-a3b6-cc87adbae319" status: 200 len: 1319 microversion: 2.1 time: 1.267267 Aug 27 02:40:50.628480 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 139/293] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:49 2022] GET /compute/v2.1/servers/96881762-a0a0-425f-a3b6-cc87adbae319 => generated 1319 bytes in 1271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:50.648258 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5b110fc4-b0b2-4707-8e84-df1fcf108638 tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-18352416"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:50.653181 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.aggregate [None req-5b110fc4-b0b2-4707-8e84-df1fcf108638 tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] Generated uuid 80a27abe-0345-46ca-b063-cbe552232f43 for aggregate {{(pid=134052) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 02:40:50.681973 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-5b110fc4-b0b2-4707-8e84-df1fcf108638 tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.051542 Aug 27 02:40:50.689671 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 140/294] 10.222.0.70 () {60 vars in 1164 bytes} [Sat Aug 27 02:40:50 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:40:50.697179 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-2cabc009-abff-4e73-b8e1-7f94532d3860 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:50.698149 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-2cabc009-abff-4e73-b8e1-7f94532d3860 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] [instance: 11661332-bcfc-46f3-a5ba-30eb82448817] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:50.701587 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-1c4de759-0e04-423e-9f13-d1c3d55ffa2f tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:50.711753 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-1c4de759-0e04-423e-9f13-d1c3d55ffa2f tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:50.712105 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2cabc009-abff-4e73-b8e1-7f94532d3860 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:50.712837 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2cabc009-abff-4e73-b8e1-7f94532d3860 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:50.713460 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2cabc009-abff-4e73-b8e1-7f94532d3860 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:50.714367 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2cabc009-abff-4e73-b8e1-7f94532d3860 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:50.715022 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2cabc009-abff-4e73-b8e1-7f94532d3860 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:50.716285 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2cabc009-abff-4e73-b8e1-7f94532d3860 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:50.717951 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-1c4de759-0e04-423e-9f13-d1c3d55ffa2f tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:50.719207 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-1c4de759-0e04-423e-9f13-d1c3d55ffa2f tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/12acf567-09ef-4971-b085-8b5566fd1b79" status: 200 len: 1566 microversion: 2.25 time: 0.615831 Aug 27 02:40:50.719784 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 155/295] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:40:50 2022] GET /compute/v2.1/servers/12acf567-09ef-4971-b085-8b5566fd1b79 => generated 1566 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:40:50.724825 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e25e290d-8954-41f0-bad5-7ae7ce4a4be8 tempest-FlavorsAccessNegativeTestJSON-1848628100 tempest-FlavorsAccessNegativeTestJSON-1848628100-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "25bedfbe5fe7471c9c580374770c9a4f"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:50.768773 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=100 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:40:50.858792 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-e25e290d-8954-41f0-bad5-7ae7ce4a4be8 tempest-FlavorsAccessNegativeTestJSON-1848628100 tempest-FlavorsAccessNegativeTestJSON-1848628100-project-admin] HTTP exception thrown: Flavor access already exists for flavor 21 and project 25bedfbe5fe7471c9c580374770c9a4f combination. Aug 27 02:40:50.893584 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e25e290d-8954-41f0-bad5-7ae7ce4a4be8 tempest-FlavorsAccessNegativeTestJSON-1848628100 tempest-FlavorsAccessNegativeTestJSON-1848628100-project-admin] Request method failure captured: Aug 27 02:40:50.893584 n-d-852278-4 devstack@n-api.service[134051]: request: POST /compute/v2.1/flavors/1323657754/action HTTP/1.1 Aug 27 02:40:50.893584 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:40:50.893584 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:40:50.893584 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:40:50.893584 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 67 Aug 27 02:40:50.893584 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:40:50.893584 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:40:50.893584 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:40:50.893584 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:40:50.893584 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYQv-Qo2nD0DZmwo74KEbOar9UhVMStGPnEfUtlqkgKbmsS7tDG51Uo4nxV8BzWj0HtuqldxEdGCifRhVOVtII25Pv508SHDambR_EP_xOqFSEfOWqRPZOp0jgc86QrHkAlhnJzVba0AcyUtqS4FwsUhBWJ74-CYDYJ5C-gqsc42mn4 Aug 27 02:40:50.893584 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:40:50.893584 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:40:50.893584 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:40:50.893584 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:40:50.893584 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:40:50.893584 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:40:50.893584 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: dbaf80924427449d928467206546ae36 Aug 27 02:40:50.893584 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1848628100 Aug 27 02:40:50.893584 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,admin,member Aug 27 02:40:50.893584 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,admin,member Aug 27 02:40:50.895211 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/dbaf80924427449d928467206546ae36"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_dbaf80924427449d928467206546ae36", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/dbaf80924427449d928467206546ae36"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/dbaf80924427449d928467206546ae36"}]}] Aug 27 02:40:50.895211 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1848628100 Aug 27 02:40:50.895211 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: dbaf80924427449d928467206546ae36 Aug 27 02:40:50.895211 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1848628100 Aug 27 02:40:50.895211 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-FlavorsAccessNegativeTestJSON-1848628100-project-admin Aug 27 02:40:50.895211 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:40:50.895211 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:40:50.895211 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 0f31ca6e917e46f2a6c985beed2732df Aug 27 02:40:50.895211 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1848628100-project-admin Aug 27 02:40:50.895211 n-d-852278-4 devstack@n-api.service[134051]: Aug 27 02:40:50.895211 n-d-852278-4 devstack@n-api.service[134051]: {"addTenantAccess": {"tenant": "25bedfbe5fe7471c9c580374770c9a4f"}} Aug 27 02:40:50.895211 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 02:40:50.896048 n-d-852278-4 devstack@n-api.service[134051]: exception: Flavor access already exists for flavor 21 and project 25bedfbe5fe7471c9c580374770c9a4f combination. Aug 27 02:40:50.896048 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '1323657754', 'body': {'addTenantAccess': {'tenant': '25bedfbe5fe7471c9c580374770c9a4f'}}} Aug 27 02:40:50.896048 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:40:50.896048 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:50.896048 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 27 02:40:50.896048 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 27 02:40:50.896048 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 27 02:40:50.896048 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 27 02:40:50.896048 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 27 02:40:50.896048 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 27 02:40:50.896048 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 27 02:40:50.896048 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 27 02:40:50.896048 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 27 02:40:50.896048 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 27 02:40:50.896048 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 27 02:40:50.896048 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi result.read() Aug 27 02:40:50.896048 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 27 02:40:50.896048 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 27 02:40:50.897136 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 27 02:40:50.897136 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 27 02:40:50.897136 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 27 02:40:50.897136 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 27 02:40:50.897136 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 27 02:40:50.897136 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 27 02:40:50.897136 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '21-25bedfbe5fe7471c9c580374770c9a4f' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Aug 27 02:40:50.897136 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:50.897136 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 27 02:40:50.897136 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:50.897136 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:50.897136 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Aug 27 02:40:50.897136 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi project.save(context.session) Aug 27 02:40:50.897136 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 27 02:40:50.897136 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi session.flush() Aug 27 02:40:50.897136 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 27 02:40:50.897136 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 27 02:40:50.897136 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 27 02:40:50.897136 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 27 02:40:50.898571 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 27 02:40:50.898571 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 27 02:40:50.898571 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 27 02:40:50.898571 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception Aug 27 02:40:50.898571 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 27 02:40:50.898571 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 27 02:40:50.898571 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 27 02:40:50.898571 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 27 02:40:50.898571 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 27 02:40:50.898571 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 27 02:40:50.898571 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 27 02:40:50.898571 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 27 02:40:50.898571 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 27 02:40:50.898571 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 27 02:40:50.898571 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 27 02:40:50.898571 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 27 02:40:50.898571 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 27 02:40:50.898571 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 27 02:40:50.902444 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 27 02:40:50.902444 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 27 02:40:50.902444 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 27 02:40:50.902444 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 27 02:40:50.902444 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 27 02:40:50.902444 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 27 02:40:50.902444 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 27 02:40:50.902444 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception Aug 27 02:40:50.902444 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 27 02:40:50.902444 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 27 02:40:50.902444 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 27 02:40:50.902444 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 27 02:40:50.902444 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 27 02:40:50.902444 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 27 02:40:50.902444 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 27 02:40:50.902444 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 27 02:40:50.902444 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 27 02:40:50.902444 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 27 02:40:50.903755 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 27 02:40:50.903755 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi result.read() Aug 27 02:40:50.903755 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 27 02:40:50.903755 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 27 02:40:50.903755 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 27 02:40:50.903755 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 27 02:40:50.903755 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 27 02:40:50.903755 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 27 02:40:50.903755 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 27 02:40:50.903755 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 27 02:40:50.903755 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '21-25bedfbe5fe7471c9c580374770c9a4f' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Aug 27 02:40:50.903755 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Aug 27 02:40:50.903755 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 27, 2, 40, 50, 850571), 'updated_at': None, 'flavor_id': 21, 'project_id': '25bedfbe5fe7471c9c580374770c9a4f'}] Aug 27 02:40:50.903755 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 27 02:40:50.903755 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:50.903755 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:50.903755 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:50.904893 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:50.904893 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Aug 27 02:40:50.904893 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Aug 27 02:40:50.904893 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 27 02:40:50.904893 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 27 02:40:50.904893 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Aug 27 02:40:50.904893 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Aug 27 02:40:50.904893 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Aug 27 02:40:50.904893 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Aug 27 02:40:50.904893 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Aug 27 02:40:50.904893 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Aug 27 02:40:50.904893 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 02:40:50.904893 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 02:40:50.904893 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Aug 27 02:40:50.904893 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Aug 27 02:40:50.904893 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 21 and project 25bedfbe5fe7471c9c580374770c9a4f combination. Aug 27 02:40:50.904893 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:50.904893 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:50.904893 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:50.905987 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:50.905987 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:50.905987 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:50.905987 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:40:50.905987 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:40:50.905987 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:40:50.905987 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:40:50.905987 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:40:50.905987 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:40:50.905987 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Aug 27 02:40:50.905987 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Aug 27 02:40:50.905987 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 21 and project 25bedfbe5fe7471c9c580374770c9a4f combination. Aug 27 02:40:50.905987 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:50.905987 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:50.905987 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:50.905987 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:50.905987 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:50.905987 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:50.905987 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:40:50.905987 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:40:50.908596 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 21 and project 25bedfbe5fe7471c9c580374770c9a4f combination. Aug 27 02:40:50.908596 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:50.908596 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e25e290d-8954-41f0-bad5-7ae7ce4a4be8 tempest-FlavorsAccessNegativeTestJSON-1848628100 tempest-FlavorsAccessNegativeTestJSON-1848628100-project-admin] Returning 409 to user: Flavor access already exists for flavor 21 and project 25bedfbe5fe7471c9c580374770c9a4f combination. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:40:50.908596 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e25e290d-8954-41f0-bad5-7ae7ce4a4be8 tempest-FlavorsAccessNegativeTestJSON-1848628100 tempest-FlavorsAccessNegativeTestJSON-1848628100-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors/1323657754/action" status: 409 len: 152 microversion: 2.1 time: 0.177441 Aug 27 02:40:50.908596 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 156/296] 10.222.0.70 () {60 vars in 1200 bytes} [Sat Aug 27 02:40:50 2022] POST /compute/v2.1/flavors/1323657754/action => generated 152 bytes in 180 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 27 02:40:50.910318 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f7a35487-ef4e-44c2-86ed-19e8641124de tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-852278-4"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:50.928983 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f7a35487-ef4e-44c2-86ed-19e8641124de tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:50.929529 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f7a35487-ef4e-44c2-86ed-19e8641124de tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:50.930024 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f7a35487-ef4e-44c2-86ed-19e8641124de tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:51.042705 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-2cabc009-abff-4e73-b8e1-7f94532d3860 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772e2e66c92e44f8838ce325437d5a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b2f4a529a3e4ea0937ca903dd5924bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:51.062232 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-2cabc009-abff-4e73-b8e1-7f94532d3860 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] 10.222.0.70 "GET /compute/v2.1/servers/11661332-bcfc-46f3-a5ba-30eb82448817" status: 200 len: 1470 microversion: 2.1 time: 0.370569 Aug 27 02:40:51.064112 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 141/297] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:50 2022] GET /compute/v2.1/servers/11661332-bcfc-46f3-a5ba-30eb82448817 => generated 1470 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:51.070698 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b0ba209e-dac5-4313-9538-5e81ab365137 tempest-FlavorsAccessNegativeTestJSON-1848628100 tempest-FlavorsAccessNegativeTestJSON-1848628100-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "25bedfbe5fe7471c9c580374770c9a4f"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:51.095058 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-f7a35487-ef4e-44c2-86ed-19e8641124de tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 241 microversion: 2.1 time: 0.192652 Aug 27 02:40:51.096371 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 157/298] 10.222.0.70 () {60 vars in 1194 bytes} [Sat Aug 27 02:40:50 2022] POST /compute/v2.1/os-aggregates/11/action => generated 241 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:40:51.105210 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b2ce36f6-478b-445b-b9dc-d30a693d9dce tempest-DeleteServersAdminTestJSON-1271703002 tempest-DeleteServersAdminTestJSON-1271703002-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:51.112095 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b2ce36f6-478b-445b-b9dc-d30a693d9dce tempest-DeleteServersAdminTestJSON-1271703002 tempest-DeleteServersAdminTestJSON-1271703002-project-admin] [instance: 11661332-bcfc-46f3-a5ba-30eb82448817] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:51.121086 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b2ce36f6-478b-445b-b9dc-d30a693d9dce tempest-DeleteServersAdminTestJSON-1271703002 tempest-DeleteServersAdminTestJSON-1271703002-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:51.121798 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b2ce36f6-478b-445b-b9dc-d30a693d9dce tempest-DeleteServersAdminTestJSON-1271703002 tempest-DeleteServersAdminTestJSON-1271703002-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:51.122383 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b2ce36f6-478b-445b-b9dc-d30a693d9dce tempest-DeleteServersAdminTestJSON-1271703002 tempest-DeleteServersAdminTestJSON-1271703002-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:51.123762 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b2ce36f6-478b-445b-b9dc-d30a693d9dce tempest-DeleteServersAdminTestJSON-1271703002 tempest-DeleteServersAdminTestJSON-1271703002-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:51.124388 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b2ce36f6-478b-445b-b9dc-d30a693d9dce tempest-DeleteServersAdminTestJSON-1271703002 tempest-DeleteServersAdminTestJSON-1271703002-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:51.124999 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b2ce36f6-478b-445b-b9dc-d30a693d9dce tempest-DeleteServersAdminTestJSON-1271703002 tempest-DeleteServersAdminTestJSON-1271703002-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:51.227092 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b0ba209e-dac5-4313-9538-5e81ab365137 tempest-FlavorsAccessNegativeTestJSON-1848628100 tempest-FlavorsAccessNegativeTestJSON-1848628100-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors/1323657754/action" status: 200 len: 21 microversion: 2.1 time: 0.160933 Aug 27 02:40:51.228184 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 142/299] 10.222.0.70 () {60 vars in 1200 bytes} [Sat Aug 27 02:40:51 2022] POST /compute/v2.1/flavors/1323657754/action => generated 21 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:40:51.243567 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-03c9027e-5eac-4271-84d0-fe78a4873045 tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-852278-4"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:51.252232 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:40:51.270979 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-03c9027e-5eac-4271-84d0-fe78a4873045 tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:51.271920 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-03c9027e-5eac-4271-84d0-fe78a4873045 tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:51.272609 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-03c9027e-5eac-4271-84d0-fe78a4873045 tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:51.304022 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b2ce36f6-478b-445b-b9dc-d30a693d9dce tempest-DeleteServersAdminTestJSON-1271703002 tempest-DeleteServersAdminTestJSON-1271703002-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/11661332-bcfc-46f3-a5ba-30eb82448817/action" status: 202 len: 0 microversion: 2.1 time: 0.202574 Aug 27 02:40:51.304775 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 158/300] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 02:40:51 2022] POST /compute/v2.1/servers/11661332-bcfc-46f3-a5ba-30eb82448817/action => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:40:51.307971 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-03c9027e-5eac-4271-84d0-fe78a4873045 tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] HTTP exception thrown: Aggregate 11 already has host n-h2-852278-4. Aug 27 02:40:51.314256 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-1af78bba-094c-4849-bb06-22407e190c5a tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:51.315451 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-1af78bba-094c-4849-bb06-22407e190c5a tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] [instance: f5d6ba67-b815-4ec1-9d75-ee5436f5e3c7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:51.320799 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-03c9027e-5eac-4271-84d0-fe78a4873045 tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] Request method failure captured: Aug 27 02:40:51.320799 n-d-852278-4 devstack@n-api.service[134052]: request: POST /compute/v2.1/os-aggregates/11/action HTTP/1.1 Aug 27 02:40:51.320799 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:40:51.320799 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:40:51.320799 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:40:51.320799 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 39 Aug 27 02:40:51.320799 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:40:51.320799 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:40:51.320799 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:40:51.320799 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:40:51.320799 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYQw_VNUmSCv_20TpMEP3_ppldhnIWLmU69XDcYQfj67tX_lE5lVDHgben_DcmvPHwnav4XS3W4R4Pcupx9OYq1E9oH9whRQ2L4RdZtHHBeKr7_pa2Rd9kvWlVmmOKLMcwgvL_46OZuuQeojuAOZIflbS0TzoMt1ZAIyQEXBhZJKuaU Aug 27 02:40:51.320799 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:40:51.320799 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:40:51.320799 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:40:51.320799 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:40:51.320799 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:40:51.320799 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:40:51.320799 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: f7fc8497b19948e8a50cea73d1c73f33 Aug 27 02:40:51.320799 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2116589466 Aug 27 02:40:51.320799 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,admin,member Aug 27 02:40:51.320799 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,admin,member Aug 27 02:40:51.322013 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f7fc8497b19948e8a50cea73d1c73f33"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f7fc8497b19948e8a50cea73d1c73f33", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f7fc8497b19948e8a50cea73d1c73f33"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f7fc8497b19948e8a50cea73d1c73f33"}]}] Aug 27 02:40:51.322013 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2116589466 Aug 27 02:40:51.322013 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: f7fc8497b19948e8a50cea73d1c73f33 Aug 27 02:40:51.322013 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2116589466 Aug 27 02:40:51.322013 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin Aug 27 02:40:51.322013 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:40:51.322013 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:40:51.322013 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: cbedd631dd394e8885bde3503028d3d9 Aug 27 02:40:51.322013 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin Aug 27 02:40:51.322013 n-d-852278-4 devstack@n-api.service[134052]: Aug 27 02:40:51.322013 n-d-852278-4 devstack@n-api.service[134052]: {"add_host": {"host": "n-h2-852278-4"}} Aug 27 02:40:51.322013 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 02:40:51.322013 n-d-852278-4 devstack@n-api.service[134052]: exception: Aggregate 11 already has host n-h2-852278-4. Aug 27 02:40:51.322798 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '11', 'body': {'add_host': {'host': 'n-h2-852278-4'}}} Aug 27 02:40:51.322798 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:40:51.322798 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:51.322798 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 27 02:40:51.322798 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 27 02:40:51.322798 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 27 02:40:51.322798 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 27 02:40:51.322798 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 27 02:40:51.322798 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 27 02:40:51.322798 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 27 02:40:51.322798 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 27 02:40:51.322798 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 27 02:40:51.322798 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 27 02:40:51.322798 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 27 02:40:51.322798 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi result.read() Aug 27 02:40:51.322798 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 27 02:40:51.322798 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 27 02:40:51.322798 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 27 02:40:51.322798 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 27 02:40:51.323839 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 27 02:40:51.323839 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 27 02:40:51.323839 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 27 02:40:51.323839 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 27 02:40:51.323839 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h2-852278-4-11' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Aug 27 02:40:51.323839 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:51.323839 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 27 02:40:51.323839 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:51.323839 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:51.323839 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Aug 27 02:40:51.323839 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Aug 27 02:40:51.323839 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 27 02:40:51.323839 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi session.flush() Aug 27 02:40:51.323839 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 27 02:40:51.323839 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 27 02:40:51.323839 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 27 02:40:51.323839 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 27 02:40:51.323839 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 27 02:40:51.323839 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 27 02:40:51.324947 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 27 02:40:51.324947 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception Aug 27 02:40:51.324947 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 27 02:40:51.324947 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 27 02:40:51.324947 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 27 02:40:51.324947 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 27 02:40:51.324947 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 27 02:40:51.324947 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 27 02:40:51.324947 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 27 02:40:51.324947 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 27 02:40:51.324947 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 27 02:40:51.324947 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 27 02:40:51.324947 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 27 02:40:51.324947 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 27 02:40:51.324947 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 27 02:40:51.324947 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 27 02:40:51.324947 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 27 02:40:51.324947 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 27 02:40:51.325902 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 27 02:40:51.325902 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 27 02:40:51.325902 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 27 02:40:51.325902 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 27 02:40:51.325902 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 27 02:40:51.325902 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception Aug 27 02:40:51.325902 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 27 02:40:51.325902 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 27 02:40:51.325902 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 27 02:40:51.325902 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 27 02:40:51.325902 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 27 02:40:51.325902 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 27 02:40:51.325902 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 27 02:40:51.325902 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 27 02:40:51.325902 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 27 02:40:51.325902 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 27 02:40:51.325902 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 27 02:40:51.325902 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi result.read() Aug 27 02:40:51.326953 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 27 02:40:51.326953 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 27 02:40:51.326953 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 27 02:40:51.326953 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 27 02:40:51.326953 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 27 02:40:51.326953 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 27 02:40:51.326953 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 27 02:40:51.326953 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 27 02:40:51.326953 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h2-852278-4-11' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Aug 27 02:40:51.326953 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Aug 27 02:40:51.326953 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 27, 2, 40, 51, 297801), 'updated_at': None, 'host': 'n-h2-852278-4', 'aggregate_id': 11}] Aug 27 02:40:51.326953 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 27 02:40:51.326953 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:51.326953 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:51.326953 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:51.326953 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:51.326953 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Aug 27 02:40:51.327910 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Aug 27 02:40:51.327910 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 27 02:40:51.327910 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 27 02:40:51.327910 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 02:40:51.327910 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 02:40:51.327910 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 02:40:51.327910 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 02:40:51.327910 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 27 02:40:51.327910 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 27 02:40:51.327910 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6639, in add_host_to_aggregate Aug 27 02:40:51.327910 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Aug 27 02:40:51.327910 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 27 02:40:51.327910 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 27 02:40:51.327910 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Aug 27 02:40:51.327910 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Aug 27 02:40:51.327910 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Aug 27 02:40:51.327910 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Aug 27 02:40:51.327910 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 11 already has host n-h2-852278-4. Aug 27 02:40:51.327910 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:51.327910 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:51.332068 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:51.332068 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:51.332068 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:51.332068 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:51.332068 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:40:51.332068 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:40:51.332068 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:40:51.332068 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:40:51.332068 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:40:51.332068 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:40:51.332068 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Aug 27 02:40:51.332068 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Aug 27 02:40:51.332068 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 11 already has host n-h2-852278-4. Aug 27 02:40:51.332068 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:51.332068 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:51.332068 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:51.332068 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:51.332068 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:51.332068 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:51.332068 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:40:51.332068 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:40:51.336490 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 11 already has host n-h2-852278-4. Aug 27 02:40:51.336490 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:51.336773 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1af78bba-094c-4849-bb06-22407e190c5a tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:51.336773 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1af78bba-094c-4849-bb06-22407e190c5a tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:51.336773 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1af78bba-094c-4849-bb06-22407e190c5a tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:51.336773 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1af78bba-094c-4849-bb06-22407e190c5a tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:51.337064 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1af78bba-094c-4849-bb06-22407e190c5a tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:51.337064 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1af78bba-094c-4849-bb06-22407e190c5a tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:51.337214 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-03c9027e-5eac-4271-84d0-fe78a4873045 tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] Returning 409 to user: Aggregate 11 already has host n-h2-852278-4. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:40:51.337214 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-03c9027e-5eac-4271-84d0-fe78a4873045 tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates/11/action" status: 409 len: 96 microversion: 2.1 time: 0.104898 Aug 27 02:40:51.341262 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 143/301] 10.222.0.70 () {60 vars in 1194 bytes} [Sat Aug 27 02:40:51 2022] POST /compute/v2.1/os-aggregates/11/action => generated 96 bytes in 112 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Aug 27 02:40:51.348102 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-53c630f2-acf3-4ce3-b9d1-9faf93782aa6 req-12d67731-6ade-4995-a692-9bb9df9c8c3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5d6ba67-b815-4ec1-9d75-ee5436f5e3c7", "tag": "0684103c-d1c3-4cad-be37-7a7306355319"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:51.363634 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-53c630f2-acf3-4ce3-b9d1-9faf93782aa6 req-12d67731-6ade-4995-a692-9bb9df9c8c3f service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:51.364562 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-53c630f2-acf3-4ce3-b9d1-9faf93782aa6 req-12d67731-6ade-4995-a692-9bb9df9c8c3f service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:51.365130 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-53c630f2-acf3-4ce3-b9d1-9faf93782aa6 req-12d67731-6ade-4995-a692-9bb9df9c8c3f service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:51.379003 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-53c630f2-acf3-4ce3-b9d1-9faf93782aa6 req-12d67731-6ade-4995-a692-9bb9df9c8c3f service nova] Creating event network-changed:0684103c-d1c3-4cad-be37-7a7306355319 for instance f5d6ba67-b815-4ec1-9d75-ee5436f5e3c7 on n-h1-852278-4 Aug 27 02:40:51.385452 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-53c630f2-acf3-4ce3-b9d1-9faf93782aa6 req-12d67731-6ade-4995-a692-9bb9df9c8c3f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042449 Aug 27 02:40:51.386582 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 144/302] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:40:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:40:51.392905 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-db74ddf6-047d-4057-9ee8-974c55f0a452 tempest-FlavorsAccessNegativeTestJSON-1848628100 tempest-FlavorsAccessNegativeTestJSON-1848628100-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:51.418537 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-db74ddf6-047d-4057-9ee8-974c55f0a452 tempest-FlavorsAccessNegativeTestJSON-1848628100 tempest-FlavorsAccessNegativeTestJSON-1848628100-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/1323657754" status: 202 len: 0 microversion: 2.1 time: 0.030211 Aug 27 02:40:51.419799 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 145/303] 10.222.0.70 () {58 vars in 1161 bytes} [Sat Aug 27 02:40:51 2022] DELETE /compute/v2.1/flavors/1323657754 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:40:51.426739 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d0236ad8-75fc-4b36-b1c5-3ce90df39acc tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:51.428625 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d0236ad8-75fc-4b36-b1c5-3ce90df39acc tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] [instance: 11661332-bcfc-46f3-a5ba-30eb82448817] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:51.436392 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d0236ad8-75fc-4b36-b1c5-3ce90df39acc tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:51.437260 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d0236ad8-75fc-4b36-b1c5-3ce90df39acc tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:51.437892 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d0236ad8-75fc-4b36-b1c5-3ce90df39acc tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:51.439383 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d0236ad8-75fc-4b36-b1c5-3ce90df39acc tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:51.440048 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d0236ad8-75fc-4b36-b1c5-3ce90df39acc tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:51.440507 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d0236ad8-75fc-4b36-b1c5-3ce90df39acc tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:51.476500 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d0236ad8-75fc-4b36-b1c5-3ce90df39acc tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:51.476969 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d0236ad8-75fc-4b36-b1c5-3ce90df39acc tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:51.477593 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d0236ad8-75fc-4b36-b1c5-3ce90df39acc tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:51.478183 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.instance [None req-d0236ad8-75fc-4b36-b1c5-3ce90df39acc tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lazy-loading 'fault' on Instance uuid 11661332-bcfc-46f3-a5ba-30eb82448817 {{(pid=134052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:40:51.725786 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-d0236ad8-75fc-4b36-b1c5-3ce90df39acc tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772e2e66c92e44f8838ce325437d5a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b2f4a529a3e4ea0937ca903dd5924bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:51.737430 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d0236ad8-75fc-4b36-b1c5-3ce90df39acc tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] 10.222.0.70 "GET /compute/v2.1/servers/11661332-bcfc-46f3-a5ba-30eb82448817" status: 200 len: 1453 microversion: 2.1 time: 0.315702 Aug 27 02:40:51.738034 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 146/304] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:51 2022] GET /compute/v2.1/servers/11661332-bcfc-46f3-a5ba-30eb82448817 => generated 1453 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:51.754150 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-cd141391-e70d-4975-846a-bee9cc9c07bf tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-852278-4"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:51.788266 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cd141391-e70d-4975-846a-bee9cc9c07bf tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:51.788801 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cd141391-e70d-4975-846a-bee9cc9c07bf tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:51.789221 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cd141391-e70d-4975-846a-bee9cc9c07bf tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:51.809322 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-1af78bba-094c-4849-bb06-22407e190c5a tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c850104e6d430397bb54d0e3730a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72992d9dba564526b223533398a94dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:51.821710 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-1af78bba-094c-4849-bb06-22407e190c5a tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] 10.222.0.70 "GET /compute/v2.1/servers/f5d6ba67-b815-4ec1-9d75-ee5436f5e3c7" status: 200 len: 1587 microversion: 2.1 time: 0.510334 Aug 27 02:40:51.837036 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 159/305] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:51 2022] GET /compute/v2.1/servers/f5d6ba67-b815-4ec1-9d75-ee5436f5e3c7 => generated 1587 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:51.841939 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-71df553b-31d4-4c6e-badd-bae0aa1728bf tempest-FlavorsAccessNegativeTestJSON-1848628100 tempest-FlavorsAccessNegativeTestJSON-1848628100-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:51.896995 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-71df553b-31d4-4c6e-badd-bae0aa1728bf tempest-FlavorsAccessNegativeTestJSON-1848628100 tempest-FlavorsAccessNegativeTestJSON-1848628100-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.048264 Aug 27 02:40:51.898172 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 160/306] 10.222.0.70 () {58 vars in 1146 bytes} [Sat Aug 27 02:40:51 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:51.903105 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-9ac4263b-535e-498c-969c-3232161d38a9 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:51.903885 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-9ac4263b-535e-498c-969c-3232161d38a9 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] [instance: 96881762-a0a0-425f-a3b6-cc87adbae319] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:51.929284 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9ac4263b-535e-498c-969c-3232161d38a9 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:51.930726 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9ac4263b-535e-498c-969c-3232161d38a9 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:51.931459 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9ac4263b-535e-498c-969c-3232161d38a9 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:51.932792 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9ac4263b-535e-498c-969c-3232161d38a9 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:51.933484 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9ac4263b-535e-498c-969c-3232161d38a9 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:51.935885 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9ac4263b-535e-498c-969c-3232161d38a9 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:52.090942 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-cd141391-e70d-4975-846a-bee9cc9c07bf tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 226 microversion: 2.1 time: 0.351836 Aug 27 02:40:52.092397 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 147/307] 10.222.0.70 () {60 vars in 1194 bytes} [Sat Aug 27 02:40:51 2022] POST /compute/v2.1/os-aggregates/11/action => generated 226 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:40:52.105339 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-17860b17-e33d-40ff-adab-9d456e588c00 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:52.106020 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-17860b17-e33d-40ff-adab-9d456e588c00 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: 12acf567-09ef-4971-b085-8b5566fd1b79] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:52.126486 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-17860b17-e33d-40ff-adab-9d456e588c00 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:52.126987 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-17860b17-e33d-40ff-adab-9d456e588c00 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:52.127425 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-17860b17-e33d-40ff-adab-9d456e588c00 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:52.128133 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-17860b17-e33d-40ff-adab-9d456e588c00 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:52.135909 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-17860b17-e33d-40ff-adab-9d456e588c00 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:52.136667 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-17860b17-e33d-40ff-adab-9d456e588c00 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:52.398624 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-9ac4263b-535e-498c-969c-3232161d38a9 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68711ff38ec41c0b051124527c7ac35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae179f416c451e92e270d2cb0f4400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:52.406432 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-9ac4263b-535e-498c-969c-3232161d38a9 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] 10.222.0.70 "GET /compute/v2.1/servers/96881762-a0a0-425f-a3b6-cc87adbae319" status: 200 len: 1319 microversion: 2.1 time: 0.507049 Aug 27 02:40:52.407303 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 161/308] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:51 2022] GET /compute/v2.1/servers/96881762-a0a0-425f-a3b6-cc87adbae319 => generated 1319 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:52.412135 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-05040f26-a48b-45c6-8198-53014288043a tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:52.413073 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-05040f26-a48b-45c6-8198-53014288043a tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] [instance: 11661332-bcfc-46f3-a5ba-30eb82448817] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:52.426385 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-05040f26-a48b-45c6-8198-53014288043a tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:52.427269 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-05040f26-a48b-45c6-8198-53014288043a tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:52.427946 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-05040f26-a48b-45c6-8198-53014288043a tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:52.429440 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-05040f26-a48b-45c6-8198-53014288043a tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:52.430083 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-05040f26-a48b-45c6-8198-53014288043a tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:52.430600 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-05040f26-a48b-45c6-8198-53014288043a tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:52.469033 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-05040f26-a48b-45c6-8198-53014288043a tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] [instance: 11661332-bcfc-46f3-a5ba-30eb82448817] Going to try to terminate instance {{(pid=134051) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:40:52.575530 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-17860b17-e33d-40ff-adab-9d456e588c00 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:52.594596 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-17860b17-e33d-40ff-adab-9d456e588c00 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:52.601335 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-17860b17-e33d-40ff-adab-9d456e588c00 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:52.625059 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-17860b17-e33d-40ff-adab-9d456e588c00 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/12acf567-09ef-4971-b085-8b5566fd1b79" status: 200 len: 1556 microversion: 2.25 time: 0.525465 Aug 27 02:40:52.626774 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 148/309] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:40:52 2022] GET /compute/v2.1/servers/12acf567-09ef-4971-b085-8b5566fd1b79 => generated 1556 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:40:52.642361 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3ce6b453-ac8f-407e-b009-6998881da91d tempest-FlavorsAccessNegativeTestJSON-1848628100 tempest-FlavorsAccessNegativeTestJSON-1848628100-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1553171182", "id": 1645608287, "os-flavor-access:is_public": "True"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:52.654303 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-05040f26-a48b-45c6-8198-53014288043a tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] 10.222.0.70 "DELETE /compute/v2.1/servers/11661332-bcfc-46f3-a5ba-30eb82448817" status: 204 len: 0 microversion: 2.1 time: 0.241370 Aug 27 02:40:52.654951 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 162/310] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:40:52 2022] DELETE /compute/v2.1/servers/11661332-bcfc-46f3-a5ba-30eb82448817 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:40:52.672195 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-f9890d6b-473a-40f4-a905-a6b4fa429f31 req-8fa3ce5c-d691-410f-9969-52d888af3f28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96881762-a0a0-425f-a3b6-cc87adbae319", "name": "network-vif-plugged", "status": "completed", "tag": "43725a41-1e0e-4350-8a03-16c133420308"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:52.686689 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-f9890d6b-473a-40f4-a905-a6b4fa429f31 req-8fa3ce5c-d691-410f-9969-52d888af3f28 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:52.687274 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-f9890d6b-473a-40f4-a905-a6b4fa429f31 req-8fa3ce5c-d691-410f-9969-52d888af3f28 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:52.687826 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-f9890d6b-473a-40f4-a905-a6b4fa429f31 req-8fa3ce5c-d691-410f-9969-52d888af3f28 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:52.697435 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-3ce6b453-ac8f-407e-b009-6998881da91d tempest-FlavorsAccessNegativeTestJSON-1848628100 tempest-FlavorsAccessNegativeTestJSON-1848628100-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.065162 Aug 27 02:40:52.704646 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 149/311] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 02:40:52 2022] POST /compute/v2.1/flavors => generated 438 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:40:52.705521 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-f9890d6b-473a-40f4-a905-a6b4fa429f31 req-8fa3ce5c-d691-410f-9969-52d888af3f28 service nova] Creating event network-vif-plugged:43725a41-1e0e-4350-8a03-16c133420308 for instance 96881762-a0a0-425f-a3b6-cc87adbae319 on n-h2-852278-4 Aug 27 02:40:52.710381 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9c000dd1-96f5-4167-9614-b20792d8c309 tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:52.711973 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-f9890d6b-473a-40f4-a905-a6b4fa429f31 req-8fa3ce5c-d691-410f-9969-52d888af3f28 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052028 Aug 27 02:40:52.712936 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 163/312] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:40:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:40:52.719369 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c6836b49-dcf6-42c2-91a4-4f70de033fbe tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Calling method '.version_select at 0x7f5edfad4c10>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:52.723820 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c6836b49-dcf6-42c2-91a4-4f70de033fbe tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:52.724714 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c6836b49-dcf6-42c2-91a4-4f70de033fbe tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:52.725359 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c6836b49-dcf6-42c2-91a4-4f70de033fbe tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:52.742402 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=84,nova_api:DELETE=11,nova_api:INSERT=5 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:40:52.752824 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c6836b49-dcf6-42c2-91a4-4f70de033fbe tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] 10.222.0.70 "GET /compute/v2.1/os-migrations" status: 200 len: 436 microversion: 2.25 time: 0.037766 Aug 27 02:40:52.769793 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 164/313] 10.222.0.70 () {60 vars in 1184 bytes} [Sat Aug 27 02:40:52 2022] GET /compute/v2.1/os-migrations => generated 436 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:40:52.777908 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9c000dd1-96f5-4167-9614-b20792d8c309 tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] 10.222.0.70 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.076560 Aug 27 02:40:52.780408 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 150/314] 10.222.0.70 () {58 vars in 1155 bytes} [Sat Aug 27 02:40:52 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 27 02:40:52.785215 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8bbf3b53-b7c1-42e6-ba1a-74b89c2f8dc3 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:52.788498 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-8bbf3b53-b7c1-42e6-ba1a-74b89c2f8dc3 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] [instance: 11661332-bcfc-46f3-a5ba-30eb82448817] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:52.794879 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a69fbd0f-13c6-44d7-a191-b2fbad9e4740 tempest-FlavorsAccessNegativeTestJSON-1848628100 tempest-FlavorsAccessNegativeTestJSON-1848628100-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:52.806733 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8bbf3b53-b7c1-42e6-ba1a-74b89c2f8dc3 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:52.807272 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8bbf3b53-b7c1-42e6-ba1a-74b89c2f8dc3 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:52.807714 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8bbf3b53-b7c1-42e6-ba1a-74b89c2f8dc3 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:52.811184 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8bbf3b53-b7c1-42e6-ba1a-74b89c2f8dc3 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:52.811748 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8bbf3b53-b7c1-42e6-ba1a-74b89c2f8dc3 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:52.812556 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8bbf3b53-b7c1-42e6-ba1a-74b89c2f8dc3 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:52.816075 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-a69fbd0f-13c6-44d7-a191-b2fbad9e4740 tempest-FlavorsAccessNegativeTestJSON-1848628100 tempest-FlavorsAccessNegativeTestJSON-1848628100-project-admin] HTTP exception thrown: Access list not available for public flavors. Aug 27 02:40:52.826222 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a69fbd0f-13c6-44d7-a191-b2fbad9e4740 tempest-FlavorsAccessNegativeTestJSON-1848628100 tempest-FlavorsAccessNegativeTestJSON-1848628100-project-admin] Request method failure captured: Aug 27 02:40:52.826222 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/flavors/1645608287/os-flavor-access HTTP/1.1 Aug 27 02:40:52.826222 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:40:52.826222 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:40:52.826222 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:40:52.826222 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:40:52.826222 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:40:52.826222 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:40:52.826222 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:40:52.826222 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:40:52.826222 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYQv-Qo2nD0DZmwo74KEbOar9UhVMStGPnEfUtlqkgKbmsS7tDG51Uo4nxV8BzWj0HtuqldxEdGCifRhVOVtII25Pv508SHDambR_EP_xOqFSEfOWqRPZOp0jgc86QrHkAlhnJzVba0AcyUtqS4FwsUhBWJ74-CYDYJ5C-gqsc42mn4 Aug 27 02:40:52.826222 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:40:52.826222 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:40:52.826222 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:40:52.826222 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:40:52.826222 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:40:52.826222 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:40:52.826222 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: dbaf80924427449d928467206546ae36 Aug 27 02:40:52.826222 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1848628100 Aug 27 02:40:52.826222 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,admin,member Aug 27 02:40:52.826222 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,admin,member Aug 27 02:40:52.827693 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/dbaf80924427449d928467206546ae36"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_dbaf80924427449d928467206546ae36", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/dbaf80924427449d928467206546ae36"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/dbaf80924427449d928467206546ae36"}]}] Aug 27 02:40:52.827693 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1848628100 Aug 27 02:40:52.827693 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: dbaf80924427449d928467206546ae36 Aug 27 02:40:52.827693 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1848628100 Aug 27 02:40:52.827693 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-FlavorsAccessNegativeTestJSON-1848628100-project-admin Aug 27 02:40:52.827693 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:40:52.827693 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:40:52.827693 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 0f31ca6e917e46f2a6c985beed2732df Aug 27 02:40:52.827693 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1848628100-project-admin Aug 27 02:40:52.827693 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 02:40:52.827693 n-d-852278-4 devstack@n-api.service[134052]: exception: Access list not available for public flavors. Aug 27 02:40:52.827693 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'flavor_id': '1645608287'} Aug 27 02:40:52.828652 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:40:52.828652 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:52.828652 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:52.828652 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:52.828652 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:40:52.828652 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:40:52.828652 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:40:52.828652 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:40:52.828652 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Aug 27 02:40:52.828652 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 27 02:40:52.828652 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Aug 27 02:40:52.828652 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:52.828652 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:52.828652 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:52.828652 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:52.828652 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:52.828652 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:52.828652 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:40:52.828652 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:40:52.828652 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Aug 27 02:40:52.828652 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:52.831251 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a69fbd0f-13c6-44d7-a191-b2fbad9e4740 tempest-FlavorsAccessNegativeTestJSON-1848628100 tempest-FlavorsAccessNegativeTestJSON-1848628100-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:40:52.833993 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a69fbd0f-13c6-44d7-a191-b2fbad9e4740 tempest-FlavorsAccessNegativeTestJSON-1848628100 tempest-FlavorsAccessNegativeTestJSON-1848628100-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/1645608287/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.051836 Aug 27 02:40:52.837176 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 151/315] 10.222.0.70 () {58 vars in 1209 bytes} [Sat Aug 27 02:40:52 2022] GET /compute/v2.1/flavors/1645608287/os-flavor-access => generated 91 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 02:40:52.848030 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c810eb3c-a129-4e09-9990-fd0e9011aaa5 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:52.850265 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-c810eb3c-a129-4e09-9990-fd0e9011aaa5 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] [instance: 12acf567-09ef-4971-b085-8b5566fd1b79] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:52.866745 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c810eb3c-a129-4e09-9990-fd0e9011aaa5 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:52.867581 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c810eb3c-a129-4e09-9990-fd0e9011aaa5 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:52.868687 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c810eb3c-a129-4e09-9990-fd0e9011aaa5 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:52.870273 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c810eb3c-a129-4e09-9990-fd0e9011aaa5 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:52.872229 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c810eb3c-a129-4e09-9990-fd0e9011aaa5 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:52.873252 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c810eb3c-a129-4e09-9990-fd0e9011aaa5 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:52.902739 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8bbf3b53-b7c1-42e6-ba1a-74b89c2f8dc3 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:52.904864 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8bbf3b53-b7c1-42e6-ba1a-74b89c2f8dc3 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:52.906088 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8bbf3b53-b7c1-42e6-ba1a-74b89c2f8dc3 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:52.910373 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.objects.instance [None req-8bbf3b53-b7c1-42e6-ba1a-74b89c2f8dc3 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lazy-loading 'fault' on Instance uuid 11661332-bcfc-46f3-a5ba-30eb82448817 {{(pid=134051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:40:53.218319 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-8bbf3b53-b7c1-42e6-ba1a-74b89c2f8dc3 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772e2e66c92e44f8838ce325437d5a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b2f4a529a3e4ea0937ca903dd5924bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:53.226978 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-8bbf3b53-b7c1-42e6-ba1a-74b89c2f8dc3 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] 10.222.0.70 "GET /compute/v2.1/servers/11661332-bcfc-46f3-a5ba-30eb82448817" status: 200 len: 1459 microversion: 2.1 time: 0.454594 Aug 27 02:40:53.228625 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.instance [None req-c810eb3c-a129-4e09-9990-fd0e9011aaa5 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lazy-loading 'services' on Instance uuid 12acf567-09ef-4971-b085-8b5566fd1b79 {{(pid=134052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:40:53.232711 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 165/316] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:52 2022] GET /compute/v2.1/servers/11661332-bcfc-46f3-a5ba-30eb82448817 => generated 1459 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:53.242922 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0589ad75-c05b-49a7-be9c-d2aa591ce0e4 tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2144589111"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:53.248256 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.objects.aggregate [None req-0589ad75-c05b-49a7-be9c-d2aa591ce0e4 tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] Generated uuid 89860c30-84b1-442f-8103-16fa71f5d355 for aggregate {{(pid=134051) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 02:40:53.256605 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c810eb3c-a129-4e09-9990-fd0e9011aaa5 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/12acf567-09ef-4971-b085-8b5566fd1b79" status: 200 len: 2048 microversion: 2.25 time: 0.417957 Aug 27 02:40:53.257754 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 152/317] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:40:52 2022] GET /compute/v2.1/servers/12acf567-09ef-4971-b085-8b5566fd1b79 => generated 2048 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:40:53.262955 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-741f52ba-36b6-4a3d-9650-d568eeaa11e4 tempest-FlavorsAccessNegativeTestJSON-1848628100 tempest-FlavorsAccessNegativeTestJSON-1848628100-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:53.302735 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-741f52ba-36b6-4a3d-9650-d568eeaa11e4 tempest-FlavorsAccessNegativeTestJSON-1848628100 tempest-FlavorsAccessNegativeTestJSON-1848628100-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/1645608287" status: 202 len: 0 microversion: 2.1 time: 0.036443 Aug 27 02:40:53.304209 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 153/318] 10.222.0.70 () {58 vars in 1161 bytes} [Sat Aug 27 02:40:53 2022] DELETE /compute/v2.1/flavors/1645608287 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:40:53.315317 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-058045be-ae3f-4d07-b091-2d3d4b208c67 tempest-FlavorsAccessNegativeTestJSON-1848628100 tempest-FlavorsAccessNegativeTestJSON-1848628100-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:53.333121 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-0589ad75-c05b-49a7-be9c-d2aa591ce0e4 tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.098828 Aug 27 02:40:53.334382 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 166/319] 10.222.0.70 () {60 vars in 1164 bytes} [Sat Aug 27 02:40:53 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:40:53.355442 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-058045be-ae3f-4d07-b091-2d3d4b208c67 tempest-FlavorsAccessNegativeTestJSON-1848628100 tempest-FlavorsAccessNegativeTestJSON-1848628100-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.045642 Aug 27 02:40:53.365386 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 154/320] 10.222.0.70 () {58 vars in 1146 bytes} [Sat Aug 27 02:40:53 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:53.380869 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-2d18f787-53b7-4ad3-b44c-618b5f8221af tempest-FlavorsAccessNegativeTestJSON-1848628100 tempest-FlavorsAccessNegativeTestJSON-1848628100-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-588227766", "id": 1158693099, "os-flavor-access:is_public": "False"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:53.417698 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-2d18f787-53b7-4ad3-b44c-618b5f8221af tempest-FlavorsAccessNegativeTestJSON-1848628100 tempest-FlavorsAccessNegativeTestJSON-1848628100-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.043781 Aug 27 02:40:53.420520 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 155/321] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 02:40:53 2022] POST /compute/v2.1/flavors => generated 438 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:40:53.435107 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c5ba04e0-9dec-4787-a205-670c03038216 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:53.437314 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-c5ba04e0-9dec-4787-a205-670c03038216 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] [instance: 96881762-a0a0-425f-a3b6-cc87adbae319] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:53.449271 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c5ba04e0-9dec-4787-a205-670c03038216 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:53.450571 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c5ba04e0-9dec-4787-a205-670c03038216 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:53.451652 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c5ba04e0-9dec-4787-a205-670c03038216 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:53.453701 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c5ba04e0-9dec-4787-a205-670c03038216 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:53.459045 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c5ba04e0-9dec-4787-a205-670c03038216 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:53.461941 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c5ba04e0-9dec-4787-a205-670c03038216 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:53.667657 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-c5ba04e0-9dec-4787-a205-670c03038216 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68711ff38ec41c0b051124527c7ac35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae179f416c451e92e270d2cb0f4400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:53.677739 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c5ba04e0-9dec-4787-a205-670c03038216 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] 10.222.0.70 "GET /compute/v2.1/servers/96881762-a0a0-425f-a3b6-cc87adbae319" status: 200 len: 1319 microversion: 2.1 time: 0.254095 Aug 27 02:40:53.692359 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 156/322] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:53 2022] GET /compute/v2.1/servers/96881762-a0a0-425f-a3b6-cc87adbae319 => generated 1319 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:53.787631 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-954a163d-bedf-4858-86b1-93cac0e55866 tempest-AggregatesAdminNegativeTestJSON-807895525 tempest-AggregatesAdminNegativeTestJSON-807895525-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-852278-4"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:53.791597 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-954a163d-bedf-4858-86b1-93cac0e55866 tempest-AggregatesAdminNegativeTestJSON-807895525 tempest-AggregatesAdminNegativeTestJSON-807895525-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': 'f17b5fa988d64acdbf5e0ffb3d8295c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b33d870157341ba9ba278c0419e5646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:53.802305 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-954a163d-bedf-4858-86b1-93cac0e55866 tempest-AggregatesAdminNegativeTestJSON-807895525 tempest-AggregatesAdminNegativeTestJSON-807895525-project] Request method failure captured: Aug 27 02:40:53.802305 n-d-852278-4 devstack@n-api.service[134051]: request: POST /compute/v2.1/os-aggregates/12/action HTTP/1.1 Aug 27 02:40:53.802305 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:40:53.802305 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:40:53.802305 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:40:53.802305 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 39 Aug 27 02:40:53.802305 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:40:53.802305 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:40:53.802305 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:40:53.802305 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:40:53.802305 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYQvuBv6JQonbVquACW5BfJW03Ok7r9cJWaXBSlWenevdcBmUT6NxHe3ISG90l2Au4FTBVbAdKM3n3MgDPiXOLiixJXNloA1Wjh-GyV1vQC5fOrAmbbI-kR7SiNYuturGL7Z_pz2sSXrToir2T2cHQmfMhzhLhOBfpVVvaIcHgwvlZI Aug 27 02:40:53.802305 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:40:53.802305 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:40:53.802305 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:40:53.802305 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:40:53.802305 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:40:53.802305 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:40:53.802305 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 8b33d870157341ba9ba278c0419e5646 Aug 27 02:40:53.802305 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-807895525 Aug 27 02:40:53.802305 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:40:53.802305 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:40:53.803825 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8b33d870157341ba9ba278c0419e5646"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8b33d870157341ba9ba278c0419e5646", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8b33d870157341ba9ba278c0419e5646"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8b33d870157341ba9ba278c0419e5646"}]}] Aug 27 02:40:53.803825 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-807895525 Aug 27 02:40:53.803825 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 8b33d870157341ba9ba278c0419e5646 Aug 27 02:40:53.803825 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-807895525 Aug 27 02:40:53.803825 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-AggregatesAdminNegativeTestJSON-807895525-project Aug 27 02:40:53.803825 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:40:53.803825 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:40:53.803825 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: f17b5fa988d64acdbf5e0ffb3d8295c8 Aug 27 02:40:53.803825 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-807895525-project Aug 27 02:40:53.803825 n-d-852278-4 devstack@n-api.service[134051]: Aug 27 02:40:53.803825 n-d-852278-4 devstack@n-api.service[134051]: {"add_host": {"host": "n-h2-852278-4"}} Aug 27 02:40:53.803825 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 02:40:53.803825 n-d-852278-4 devstack@n-api.service[134051]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 27 02:40:53.804588 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '12', 'body': {'add_host': {'host': 'n-h2-852278-4'}}} Aug 27 02:40:53.804588 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:40:53.804588 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:53.804588 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:53.804588 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:53.804588 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:40:53.804588 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:40:53.804588 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:40:53.804588 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:40:53.804588 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:40:53.804588 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:40:53.804588 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Aug 27 02:40:53.804588 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Aug 27 02:40:53.804588 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 02:40:53.804588 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 02:40:53.804588 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 02:40:53.804588 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 02:40:53.804588 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 02:40:53.804588 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 02:40:53.805674 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 02:40:53.805674 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 02:40:53.805674 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 02:40:53.805674 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 02:40:53.805674 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 02:40:53.805674 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 02:40:53.805674 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 02:40:53.805674 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 02:40:53.805674 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 27 02:40:53.805674 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:53.805674 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:53.805674 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:53.805674 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:53.805674 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:53.805674 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:53.805674 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 02:40:53.805674 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 02:40:53.805674 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 27 02:40:53.805674 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:53.807980 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-954a163d-bedf-4858-86b1-93cac0e55866 tempest-AggregatesAdminNegativeTestJSON-807895525 tempest-AggregatesAdminNegativeTestJSON-807895525-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:40:53.809236 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-954a163d-bedf-4858-86b1-93cac0e55866 tempest-AggregatesAdminNegativeTestJSON-807895525 tempest-AggregatesAdminNegativeTestJSON-807895525-project] 10.222.0.70 "POST /compute/v2.1/os-aggregates/12/action" status: 403 len: 118 microversion: 2.1 time: 0.467479 Aug 27 02:40:53.811092 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 167/323] 10.222.0.70 () {60 vars in 1194 bytes} [Sat Aug 27 02:40:53 2022] POST /compute/v2.1/os-aggregates/12/action => generated 118 bytes in 470 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 27 02:40:53.816071 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-07debccf-8c22-4206-8b3c-3c86ac737ccc tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1039456961", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "networks": [{"uuid": "b0edff77-134a-4e34-8600-26bed9e15888"}]}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:53.928909 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.network.neutron [None req-07debccf-8c22-4206-8b3c-3c86ac737ccc tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] validate_networks() for [('b0edff77-134a-4e34-8600-26bed9e15888', None, None, None, None, None)] {{(pid=134051) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:40:54.095081 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5c24eea0-c52e-48bd-9fcc-65278756179a tempest-FlavorsAccessNegativeTestJSON-471942415 tempest-FlavorsAccessNegativeTestJSON-471942415-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "25bedfbe5fe7471c9c580374770c9a4f"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:54.112968 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-5c24eea0-c52e-48bd-9fcc-65278756179a tempest-FlavorsAccessNegativeTestJSON-471942415 tempest-FlavorsAccessNegativeTestJSON-471942415-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '75e4e8c0bc9d49e7a5c5b7c2770a4ed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bedfbe5fe7471c9c580374770c9a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:54.117452 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5c24eea0-c52e-48bd-9fcc-65278756179a tempest-FlavorsAccessNegativeTestJSON-471942415 tempest-FlavorsAccessNegativeTestJSON-471942415-project] Request method failure captured: Aug 27 02:40:54.117452 n-d-852278-4 devstack@n-api.service[134052]: request: POST /compute/v2.1/flavors/1158693099/action HTTP/1.1 Aug 27 02:40:54.117452 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:40:54.117452 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:40:54.117452 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:40:54.117452 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 67 Aug 27 02:40:54.117452 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:40:54.117452 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:40:54.117452 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:40:54.117452 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:40:54.117452 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYQtESRE6XIQDWys7Iq7L_aXP5_HwV31xAFE9_rOG_S_emDxpjScClh2ItMgTX9-Y96-phpgz9S8rx8nS2aIlGZ5vxG8h0f7JqdWltUqyCtwtWnlzDhi1dYAlUkmYMebHN9-cx856IthpZBhNBjlfdxFKOh2q5KA1tRTkqZ7HREofcs Aug 27 02:40:54.117452 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:40:54.117452 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:40:54.117452 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:40:54.117452 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:40:54.117452 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:40:54.117452 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:40:54.117452 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 25bedfbe5fe7471c9c580374770c9a4f Aug 27 02:40:54.117452 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-471942415 Aug 27 02:40:54.117452 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:40:54.117452 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:40:54.118688 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/25bedfbe5fe7471c9c580374770c9a4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_25bedfbe5fe7471c9c580374770c9a4f", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/25bedfbe5fe7471c9c580374770c9a4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/25bedfbe5fe7471c9c580374770c9a4f"}]}] Aug 27 02:40:54.118688 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-471942415 Aug 27 02:40:54.118688 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 25bedfbe5fe7471c9c580374770c9a4f Aug 27 02:40:54.118688 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-471942415 Aug 27 02:40:54.118688 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-FlavorsAccessNegativeTestJSON-471942415-project Aug 27 02:40:54.118688 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:40:54.118688 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:40:54.118688 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 75e4e8c0bc9d49e7a5c5b7c2770a4ed3 Aug 27 02:40:54.118688 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-471942415-project Aug 27 02:40:54.118688 n-d-852278-4 devstack@n-api.service[134052]: Aug 27 02:40:54.118688 n-d-852278-4 devstack@n-api.service[134052]: {"addTenantAccess": {"tenant": "25bedfbe5fe7471c9c580374770c9a4f"}} Aug 27 02:40:54.118688 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 02:40:54.119552 n-d-852278-4 devstack@n-api.service[134052]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 27 02:40:54.119552 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '1158693099', 'body': {'addTenantAccess': {'tenant': '25bedfbe5fe7471c9c580374770c9a4f'}}} Aug 27 02:40:54.119552 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:40:54.119552 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:54.119552 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:54.119552 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:54.119552 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:40:54.119552 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:40:54.119552 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:40:54.119552 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:40:54.119552 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:40:54.119552 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:40:54.119552 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Aug 27 02:40:54.119552 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Aug 27 02:40:54.119552 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 02:40:54.119552 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 02:40:54.119552 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 02:40:54.119552 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 02:40:54.119552 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 02:40:54.120801 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 02:40:54.120801 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 02:40:54.120801 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 02:40:54.120801 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 02:40:54.120801 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 02:40:54.120801 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 02:40:54.120801 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 02:40:54.120801 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 02:40:54.120801 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 02:40:54.120801 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 27 02:40:54.120801 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:54.120801 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:54.120801 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:54.120801 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:54.120801 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:54.120801 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:54.120801 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 02:40:54.120801 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 02:40:54.120801 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 27 02:40:54.120801 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:54.128171 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5c24eea0-c52e-48bd-9fcc-65278756179a tempest-FlavorsAccessNegativeTestJSON-471942415 tempest-FlavorsAccessNegativeTestJSON-471942415-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:40:54.135773 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-5c24eea0-c52e-48bd-9fcc-65278756179a tempest-FlavorsAccessNegativeTestJSON-471942415 tempest-FlavorsAccessNegativeTestJSON-471942415-project] 10.222.0.70 "POST /compute/v2.1/flavors/1158693099/action" status: 403 len: 130 microversion: 2.1 time: 0.444393 Aug 27 02:40:54.142698 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 157/324] 10.222.0.70 () {60 vars in 1200 bytes} [Sat Aug 27 02:40:53 2022] POST /compute/v2.1/flavors/1158693099/action => generated 130 bytes in 453 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:40:54.159221 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ff936acb-a86b-42b0-9df7-e539178d2121 tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:54.224938 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ff936acb-a86b-42b0-9df7-e539178d2121 tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] 10.222.0.70 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.077899 Aug 27 02:40:54.227885 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 158/325] 10.222.0.70 () {58 vars in 1155 bytes} [Sat Aug 27 02:40:54 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 27 02:40:54.243071 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-466a23a5-989f-424a-ba71-530e4afd9b18 tempest-FlavorsAccessNegativeTestJSON-1848628100 tempest-FlavorsAccessNegativeTestJSON-1848628100-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:54.295401 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-466a23a5-989f-424a-ba71-530e4afd9b18 tempest-FlavorsAccessNegativeTestJSON-1848628100 tempest-FlavorsAccessNegativeTestJSON-1848628100-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/1158693099" status: 202 len: 0 microversion: 2.1 time: 0.064367 Aug 27 02:40:54.300741 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 159/326] 10.222.0.70 () {58 vars in 1161 bytes} [Sat Aug 27 02:40:54 2022] DELETE /compute/v2.1/flavors/1158693099 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:40:54.323443 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-401e36c2-ddf0-48ce-a5b5-931e1b3b1964 tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1260424856"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:54.327157 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.aggregate [None req-401e36c2-ddf0-48ce-a5b5-931e1b3b1964 tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] Generated uuid e940df38-e3a1-4a07-993b-cc4cea235711 for aggregate {{(pid=134052) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 02:40:54.381781 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-401e36c2-ddf0-48ce-a5b5-931e1b3b1964 tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.079702 Aug 27 02:40:54.382847 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 160/327] 10.222.0.70 () {60 vars in 1164 bytes} [Sat Aug 27 02:40:54 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:40:54.392397 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-35f7aa5a-69bf-4d71-abec-bc6e397c0a02 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:54.416685 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-35f7aa5a-69bf-4d71-abec-bc6e397c0a02 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] [instance: 11661332-bcfc-46f3-a5ba-30eb82448817] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:54.433806 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-35f7aa5a-69bf-4d71-abec-bc6e397c0a02 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:54.436242 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-35f7aa5a-69bf-4d71-abec-bc6e397c0a02 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:54.437942 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-35f7aa5a-69bf-4d71-abec-bc6e397c0a02 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:54.438893 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-35f7aa5a-69bf-4d71-abec-bc6e397c0a02 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:54.439347 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-35f7aa5a-69bf-4d71-abec-bc6e397c0a02 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:54.439767 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-35f7aa5a-69bf-4d71-abec-bc6e397c0a02 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:54.527438 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-35f7aa5a-69bf-4d71-abec-bc6e397c0a02 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:54.528242 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-35f7aa5a-69bf-4d71-abec-bc6e397c0a02 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:54.528847 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-35f7aa5a-69bf-4d71-abec-bc6e397c0a02 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:54.529566 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.instance [None req-35f7aa5a-69bf-4d71-abec-bc6e397c0a02 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lazy-loading 'fault' on Instance uuid 11661332-bcfc-46f3-a5ba-30eb82448817 {{(pid=134052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:40:54.994468 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-35f7aa5a-69bf-4d71-abec-bc6e397c0a02 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772e2e66c92e44f8838ce325437d5a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b2f4a529a3e4ea0937ca903dd5924bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:55.009472 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-35f7aa5a-69bf-4d71-abec-bc6e397c0a02 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] 10.222.0.70 "GET /compute/v2.1/servers/11661332-bcfc-46f3-a5ba-30eb82448817" status: 200 len: 1459 microversion: 2.1 time: 0.625388 Aug 27 02:40:55.010240 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 161/328] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:54 2022] GET /compute/v2.1/servers/11661332-bcfc-46f3-a5ba-30eb82448817 => generated 1459 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:55.015103 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f243ff1d-7205-439a-af20-e02517120090 tempest-FlavorsAccessNegativeTestJSON-1848628100 tempest-FlavorsAccessNegativeTestJSON-1848628100-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:55.042071 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f243ff1d-7205-439a-af20-e02517120090 tempest-FlavorsAccessNegativeTestJSON-1848628100 tempest-FlavorsAccessNegativeTestJSON-1848628100-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.030577 Aug 27 02:40:55.058244 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 162/329] 10.222.0.70 () {58 vars in 1146 bytes} [Sat Aug 27 02:40:55 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:55.064451 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-26fd1aab-c01a-4fcf-a261-d62e5354478d tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-1253834010"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:55.079552 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-26fd1aab-c01a-4fcf-a261-d62e5354478d tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:55.080302 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-26fd1aab-c01a-4fcf-a261-d62e5354478d tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:55.081106 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-26fd1aab-c01a-4fcf-a261-d62e5354478d tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:55.091769 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-26fd1aab-c01a-4fcf-a261-d62e5354478d tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:55.092787 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-26fd1aab-c01a-4fcf-a261-d62e5354478d tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:55.093322 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-26fd1aab-c01a-4fcf-a261-d62e5354478d tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:55.101664 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-07debccf-8c22-4206-8b3c-3c86ac737ccc tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Flavor limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:40:55.102168 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-07debccf-8c22-4206-8b3c-3c86ac737ccc tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Image limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:40:55.102536 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-07debccf-8c22-4206-8b3c-3c86ac737ccc tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Flavor pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:40:55.102934 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-07debccf-8c22-4206-8b3c-3c86ac737ccc tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Image pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:40:55.103342 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-07debccf-8c22-4206-8b3c-3c86ac737ccc tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:40:55.108125 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-26fd1aab-c01a-4fcf-a261-d62e5354478d tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-1253834010 could not be found. Aug 27 02:40:55.111120 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-26fd1aab-c01a-4fcf-a261-d62e5354478d tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] Request method failure captured: Aug 27 02:40:55.111120 n-d-852278-4 devstack@n-api.service[134052]: request: POST /compute/v2.1/os-aggregates/13/action HTTP/1.1 Aug 27 02:40:55.111120 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:40:55.111120 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:40:55.111120 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:40:55.111120 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 58 Aug 27 02:40:55.111120 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:40:55.111120 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:40:55.111120 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:40:55.111120 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:40:55.111120 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYQw_VNUmSCv_20TpMEP3_ppldhnIWLmU69XDcYQfj67tX_lE5lVDHgben_DcmvPHwnav4XS3W4R4Pcupx9OYq1E9oH9whRQ2L4RdZtHHBeKr7_pa2Rd9kvWlVmmOKLMcwgvL_46OZuuQeojuAOZIflbS0TzoMt1ZAIyQEXBhZJKuaU Aug 27 02:40:55.111120 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:40:55.111120 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:40:55.111120 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:40:55.111120 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:40:55.111120 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:40:55.111120 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:40:55.111120 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: f7fc8497b19948e8a50cea73d1c73f33 Aug 27 02:40:55.111120 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2116589466 Aug 27 02:40:55.111120 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,admin,member Aug 27 02:40:55.111120 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,admin,member Aug 27 02:40:55.112614 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f7fc8497b19948e8a50cea73d1c73f33"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f7fc8497b19948e8a50cea73d1c73f33", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f7fc8497b19948e8a50cea73d1c73f33"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f7fc8497b19948e8a50cea73d1c73f33"}]}] Aug 27 02:40:55.112614 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2116589466 Aug 27 02:40:55.112614 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: f7fc8497b19948e8a50cea73d1c73f33 Aug 27 02:40:55.112614 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2116589466 Aug 27 02:40:55.112614 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin Aug 27 02:40:55.112614 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:40:55.112614 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:40:55.112614 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: cbedd631dd394e8885bde3503028d3d9 Aug 27 02:40:55.112614 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin Aug 27 02:40:55.112614 n-d-852278-4 devstack@n-api.service[134052]: Aug 27 02:40:55.112614 n-d-852278-4 devstack@n-api.service[134052]: {"add_host": {"host": "tempest-nonexist_host-1253834010"}} Aug 27 02:40:55.112614 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 02:40:55.113363 n-d-852278-4 devstack@n-api.service[134052]: exception: Compute host tempest-nonexist_host-1253834010 could not be found. Aug 27 02:40:55.113363 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '13', 'body': {'add_host': {'host': 'tempest-nonexist_host-1253834010'}}} Aug 27 02:40:55.113363 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:40:55.113363 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:55.113363 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5997, in _get_service_in_cell_by_host Aug 27 02:40:55.113363 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 27 02:40:55.113363 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 02:40:55.113363 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 02:40:55.113363 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 27 02:40:55.113363 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 27 02:40:55.113363 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 02:40:55.113363 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 02:40:55.113363 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 27 02:40:55.113363 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 27 02:40:55.113363 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-1253834010' is not mapped to any cell Aug 27 02:40:55.113363 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:55.113363 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:55.113363 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:55.113363 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:55.113363 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6003, in _get_service_in_cell_by_host Aug 27 02:40:55.115137 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Aug 27 02:40:55.115137 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6065, in _find_service_in_cell Aug 27 02:40:55.115137 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 27 02:40:55.115137 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 27 02:40:55.115137 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:55.115137 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:55.115137 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:55.115137 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:55.115137 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Aug 27 02:40:55.115137 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Aug 27 02:40:55.115137 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 27 02:40:55.115137 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 27 02:40:55.115137 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 02:40:55.115137 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 02:40:55.115137 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 02:40:55.115137 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 02:40:55.115137 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 27 02:40:55.115137 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 27 02:40:55.115137 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6619, in add_host_to_aggregate Aug 27 02:40:55.115137 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Aug 27 02:40:55.116185 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Aug 27 02:40:55.116185 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Aug 27 02:40:55.116185 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-1253834010 could not be found. Aug 27 02:40:55.116185 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:55.116185 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:55.116185 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:55.116185 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:55.116185 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:55.116185 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:55.116185 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:40:55.116185 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:40:55.116185 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:40:55.116185 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:40:55.116185 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:40:55.116185 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:40:55.116185 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Aug 27 02:40:55.116185 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:40:55.116185 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-1253834010 could not be found. Aug 27 02:40:55.116185 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:55.116185 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:55.116185 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:55.118936 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:55.118936 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:55.118936 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:55.118936 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:40:55.118936 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:40:55.118936 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-1253834010 could not be found. Aug 27 02:40:55.118936 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:55.118936 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-26fd1aab-c01a-4fcf-a261-d62e5354478d tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-1253834010 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:40:55.118936 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-26fd1aab-c01a-4fcf-a261-d62e5354478d tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates/13/action" status: 404 len: 111 microversion: 2.1 time: 0.053256 Aug 27 02:40:55.118936 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 163/330] 10.222.0.70 () {60 vars in 1194 bytes} [Sat Aug 27 02:40:55 2022] POST /compute/v2.1/os-aggregates/13/action => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:40:55.120227 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c769b375-430e-4481-b043-9839d58bc019 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:55.120227 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-c769b375-430e-4481-b043-9839d58bc019 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] [instance: 96881762-a0a0-425f-a3b6-cc87adbae319] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:55.124362 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-07debccf-8c22-4206-8b3c-3c86ac737ccc tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:55.124852 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-07debccf-8c22-4206-8b3c-3c86ac737ccc tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:55.125465 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-07debccf-8c22-4206-8b3c-3c86ac737ccc tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:55.126048 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-07debccf-8c22-4206-8b3c-3c86ac737ccc tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:55.126496 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-07debccf-8c22-4206-8b3c-3c86ac737ccc tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:55.126913 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-07debccf-8c22-4206-8b3c-3c86ac737ccc tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:55.127584 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c769b375-430e-4481-b043-9839d58bc019 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:55.128219 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c769b375-430e-4481-b043-9839d58bc019 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:55.129012 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c769b375-430e-4481-b043-9839d58bc019 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:55.130065 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c769b375-430e-4481-b043-9839d58bc019 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:55.130633 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c769b375-430e-4481-b043-9839d58bc019 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:55.130937 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c769b375-430e-4481-b043-9839d58bc019 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:55.193659 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-07debccf-8c22-4206-8b3c-3c86ac737ccc tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Getting quotas for project e78b498dced14d1d822e7d0c27f57215. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:40:55.198700 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-07debccf-8c22-4206-8b3c-3c86ac737ccc tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Getting quotas for user 774ce37f4c6b4f72ad494ea40a3e238d and project e78b498dced14d1d822e7d0c27f57215. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:40:55.210716 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=2,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:40:55.217602 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-07debccf-8c22-4206-8b3c-3c86ac737ccc tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Going to run 1 instances... {{(pid=134051) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:40:55.225789 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-07debccf-8c22-4206-8b3c-3c86ac737ccc tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: bb513027-efc1-4201-812f-39c88b423a9d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134051) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:40:55.289886 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-07debccf-8c22-4206-8b3c-3c86ac737ccc tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.477377 Aug 27 02:40:55.290862 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 168/331] 10.222.0.70 () {62 vars in 1188 bytes} [Sat Aug 27 02:40:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1479 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 27 02:40:55.295558 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c7f067d9-c4fa-4795-b996-5131c7853b00 tempest-FlavorsAccessNegativeTestJSON-1848628100 tempest-FlavorsAccessNegativeTestJSON-1848628100-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1707808524", "id": 166114223, "os-flavor-access:is_public": "False"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:55.330096 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c7f067d9-c4fa-4795-b996-5131c7853b00 tempest-FlavorsAccessNegativeTestJSON-1848628100 tempest-FlavorsAccessNegativeTestJSON-1848628100-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.038010 Aug 27 02:40:55.331088 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 169/332] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 02:40:55 2022] POST /compute/v2.1/flavors => generated 436 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:40:55.335575 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b34d2ecd-9f49-4815-9051-37ccbfaf688c tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:55.391178 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b34d2ecd-9f49-4815-9051-37ccbfaf688c tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] 10.222.0.70 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.058880 Aug 27 02:40:55.396198 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 170/333] 10.222.0.70 () {58 vars in 1155 bytes} [Sat Aug 27 02:40:55 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 27 02:40:55.402722 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e469d2a9-40af-40ee-80d6-ac1f3e9ec634 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:55.403542 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-e469d2a9-40af-40ee-80d6-ac1f3e9ec634 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: bb513027-efc1-4201-812f-39c88b423a9d] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:55.558573 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e469d2a9-40af-40ee-80d6-ac1f3e9ec634 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:55.567731 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e469d2a9-40af-40ee-80d6-ac1f3e9ec634 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:55.570321 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e469d2a9-40af-40ee-80d6-ac1f3e9ec634 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:55.572151 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e469d2a9-40af-40ee-80d6-ac1f3e9ec634 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/bb513027-efc1-4201-812f-39c88b423a9d" status: 200 len: 1262 microversion: 2.25 time: 0.174662 Aug 27 02:40:55.573214 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 171/334] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:40:55 2022] GET /compute/v2.1/servers/bb513027-efc1-4201-812f-39c88b423a9d => generated 1262 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:40:55.579147 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-2e0ccf27-36ea-4737-b469-e066e524a97b tempest-FlavorsAccessNegativeTestJSON-1848628100 tempest-FlavorsAccessNegativeTestJSON-1848628100-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "25bedfbe5fe7471c9c580374770c9a4f"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:55.629278 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-c769b375-430e-4481-b043-9839d58bc019 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68711ff38ec41c0b051124527c7ac35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae179f416c451e92e270d2cb0f4400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:55.645716 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c769b375-430e-4481-b043-9839d58bc019 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] 10.222.0.70 "GET /compute/v2.1/servers/96881762-a0a0-425f-a3b6-cc87adbae319" status: 200 len: 1468 microversion: 2.1 time: 0.531137 Aug 27 02:40:55.661069 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 164/335] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:55 2022] GET /compute/v2.1/servers/96881762-a0a0-425f-a3b6-cc87adbae319 => generated 1468 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:55.672957 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0732d6d2-22b6-45d6-9325-047b30e222f6 tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:55.680476 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0732d6d2-22b6-45d6-9325-047b30e222f6 tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] Request method failure captured: Aug 27 02:40:55.680476 n-d-852278-4 devstack@n-api.service[134052]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 27 02:40:55.680476 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:40:55.680476 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:40:55.680476 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:40:55.680476 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 283 Aug 27 02:40:55.680476 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:40:55.680476 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:40:55.680476 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:40:55.680476 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:40:55.680476 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYQw_VNUmSCv_20TpMEP3_ppldhnIWLmU69XDcYQfj67tX_lE5lVDHgben_DcmvPHwnav4XS3W4R4Pcupx9OYq1E9oH9whRQ2L4RdZtHHBeKr7_pa2Rd9kvWlVmmOKLMcwgvL_46OZuuQeojuAOZIflbS0TzoMt1ZAIyQEXBhZJKuaU Aug 27 02:40:55.680476 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:40:55.680476 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:40:55.680476 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:40:55.680476 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:40:55.680476 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:40:55.680476 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:40:55.680476 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: f7fc8497b19948e8a50cea73d1c73f33 Aug 27 02:40:55.680476 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2116589466 Aug 27 02:40:55.680476 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,admin,member Aug 27 02:40:55.680476 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,admin,member Aug 27 02:40:55.681707 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f7fc8497b19948e8a50cea73d1c73f33"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f7fc8497b19948e8a50cea73d1c73f33", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f7fc8497b19948e8a50cea73d1c73f33"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f7fc8497b19948e8a50cea73d1c73f33"}]}] Aug 27 02:40:55.681707 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2116589466 Aug 27 02:40:55.681707 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: f7fc8497b19948e8a50cea73d1c73f33 Aug 27 02:40:55.681707 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2116589466 Aug 27 02:40:55.681707 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin Aug 27 02:40:55.681707 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:40:55.681707 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:40:55.681707 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: cbedd631dd394e8885bde3503028d3d9 Aug 27 02:40:55.681707 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin Aug 27 02:40:55.681707 n-d-852278-4 devstack@n-api.service[134052]: Aug 27 02:40:55.682240 n-d-852278-4 devstack@n-api.service[134052]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 27 02:40:55.682240 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 02:40:55.682240 n-d-852278-4 devstack@n-api.service[134052]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 27 02:40:55.682240 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 27 02:40:55.682240 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:40:55.682240 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:55.682240 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 02:40:55.682240 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 02:40:55.682240 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 02:40:55.682240 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise error Aug 27 02:40:55.682906 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 27 02:40:55.682906 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:55.682906 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Aug 27 02:40:55.682906 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 27 02:40:55.682906 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:55.682906 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Aug 27 02:40:55.682906 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 27 02:40:55.682906 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:55.682906 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:55.682906 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:55.682906 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:55.682906 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:55.682906 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:55.682906 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:40:55.682906 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:40:55.682906 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:40:55.682906 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:40:55.683788 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:40:55.683788 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:40:55.683788 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 02:40:55.683788 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 02:40:55.683788 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 02:40:55.683788 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 02:40:55.683788 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 02:40:55.683788 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 02:40:55.683788 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 27 02:40:55.683788 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:55.683788 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:55.683788 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:55.683788 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:55.683788 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:55.683788 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:55.684657 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 02:40:55.684657 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 02:40:55.684657 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 27 02:40:55.684657 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:55.684657 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0732d6d2-22b6-45d6-9325-047b30e222f6 tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:40:55.685076 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-0732d6d2-22b6-45d6-9325-047b30e222f6 tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.022312 Aug 27 02:40:55.686469 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 165/336] 10.222.0.70 () {60 vars in 1165 bytes} [Sat Aug 27 02:40:55 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 02:40:55.906563 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c1df78d4-27cb-4c05-9527-8dd69c966f00 tempest-KeyPairsV210TestJSON-338379082 tempest-KeyPairsV210TestJSON-338379082-project-admin] Action: 'create', calling method: .version_select at 0x7f5ee35b3700>, body: {"keypair": {"name": "tempest-keypair-1229631881", "type": "ssh", "user_id": "79888bb342b24463b959752bba54cec1", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFBoSsChoahmk/1ZeGDyeje5boAPqz9DmbxJqhLir1/lExsh7Dq0mUuSlZXytGEkpjhb+BeFDNxx2++F79ainfh/ezyhUubHAjusMBPryTdJaB9UKyKHqbQxW2Qc184pxQ=="}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:55.957044 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-c1df78d4-27cb-4c05-9527-8dd69c966f00 tempest-KeyPairsV210TestJSON-338379082 tempest-KeyPairsV210TestJSON-338379082-project-admin] Getting quotas for project ae234ea69b204cd4bccca6bd95f268ee. Resources: {'key_pairs'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:40:55.970925 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-c1df78d4-27cb-4c05-9527-8dd69c966f00 tempest-KeyPairsV210TestJSON-338379082 tempest-KeyPairsV210TestJSON-338379082-project-admin] Getting quotas for user ba45c00ff3c14574bb4edf9b22e305f4 and project ae234ea69b204cd4bccca6bd95f268ee. Resources: {'key_pairs'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:40:56.051361 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c1df78d4-27cb-4c05-9527-8dd69c966f00 tempest-KeyPairsV210TestJSON-338379082 tempest-KeyPairsV210TestJSON-338379082-project-admin] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.363686 Aug 27 02:40:56.052043 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 166/337] 10.222.0.70 () {62 vars in 1200 bytes} [Sat Aug 27 02:40:55 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 365 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 27 02:40:56.069587 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-cd33b991-9a63-464f-8590-584c6878043f tempest-LiveMigrationNegativeTest-1402864585 tempest-LiveMigrationNegativeTest-1402864585-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:56.070203 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-cd33b991-9a63-464f-8590-584c6878043f tempest-LiveMigrationNegativeTest-1402864585 tempest-LiveMigrationNegativeTest-1402864585-project-admin] [instance: 96881762-a0a0-425f-a3b6-cc87adbae319] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:56.082487 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cd33b991-9a63-464f-8590-584c6878043f tempest-LiveMigrationNegativeTest-1402864585 tempest-LiveMigrationNegativeTest-1402864585-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:56.083457 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cd33b991-9a63-464f-8590-584c6878043f tempest-LiveMigrationNegativeTest-1402864585 tempest-LiveMigrationNegativeTest-1402864585-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:56.084254 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cd33b991-9a63-464f-8590-584c6878043f tempest-LiveMigrationNegativeTest-1402864585 tempest-LiveMigrationNegativeTest-1402864585-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:56.085409 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cd33b991-9a63-464f-8590-584c6878043f tempest-LiveMigrationNegativeTest-1402864585 tempest-LiveMigrationNegativeTest-1402864585-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:56.087030 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cd33b991-9a63-464f-8590-584c6878043f tempest-LiveMigrationNegativeTest-1402864585 tempest-LiveMigrationNegativeTest-1402864585-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:56.087629 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cd33b991-9a63-464f-8590-584c6878043f tempest-LiveMigrationNegativeTest-1402864585 tempest-LiveMigrationNegativeTest-1402864585-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:56.090527 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-2e0ccf27-36ea-4737-b469-e066e524a97b tempest-FlavorsAccessNegativeTestJSON-1848628100 tempest-FlavorsAccessNegativeTestJSON-1848628100-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors/166114223/action" status: 200 len: 96 microversion: 2.1 time: 0.515601 Aug 27 02:40:56.094122 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 172/338] 10.222.0.70 () {60 vars in 1197 bytes} [Sat Aug 27 02:40:55 2022] POST /compute/v2.1/flavors/166114223/action => generated 96 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:40:56.114117 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0abb108e-3869-40d7-9c6a-970fb5b67e23 tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:56.123092 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0abb108e-3869-40d7-9c6a-970fb5b67e23 tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] Request method failure captured: Aug 27 02:40:56.123092 n-d-852278-4 devstack@n-api.service[134051]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 27 02:40:56.123092 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:40:56.123092 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:40:56.123092 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:40:56.123092 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 27 Aug 27 02:40:56.123092 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:40:56.123092 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:40:56.123092 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:40:56.123092 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:40:56.123092 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYQw_VNUmSCv_20TpMEP3_ppldhnIWLmU69XDcYQfj67tX_lE5lVDHgben_DcmvPHwnav4XS3W4R4Pcupx9OYq1E9oH9whRQ2L4RdZtHHBeKr7_pa2Rd9kvWlVmmOKLMcwgvL_46OZuuQeojuAOZIflbS0TzoMt1ZAIyQEXBhZJKuaU Aug 27 02:40:56.123092 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:40:56.123092 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:40:56.123092 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:40:56.123092 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:40:56.123092 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:40:56.123092 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:40:56.123092 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: f7fc8497b19948e8a50cea73d1c73f33 Aug 27 02:40:56.123092 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2116589466 Aug 27 02:40:56.123092 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,admin,member Aug 27 02:40:56.123092 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,admin,member Aug 27 02:40:56.124880 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f7fc8497b19948e8a50cea73d1c73f33"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f7fc8497b19948e8a50cea73d1c73f33", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f7fc8497b19948e8a50cea73d1c73f33"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f7fc8497b19948e8a50cea73d1c73f33"}]}] Aug 27 02:40:56.124880 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2116589466 Aug 27 02:40:56.124880 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: f7fc8497b19948e8a50cea73d1c73f33 Aug 27 02:40:56.124880 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2116589466 Aug 27 02:40:56.124880 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin Aug 27 02:40:56.124880 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:40:56.124880 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:40:56.124880 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: cbedd631dd394e8885bde3503028d3d9 Aug 27 02:40:56.124880 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin Aug 27 02:40:56.124880 n-d-852278-4 devstack@n-api.service[134051]: Aug 27 02:40:56.124880 n-d-852278-4 devstack@n-api.service[134051]: {"aggregate": {"name": ""}} Aug 27 02:40:56.124880 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 02:40:56.124880 n-d-852278-4 devstack@n-api.service[134051]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 27 02:40:56.125746 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'body': {'aggregate': {'name': ''}}} Aug 27 02:40:56.125746 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:40:56.125746 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:56.125746 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 02:40:56.125746 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 02:40:56.125746 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 02:40:56.125746 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise error Aug 27 02:40:56.125746 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 27 02:40:56.125746 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:56.125746 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Aug 27 02:40:56.125746 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 27 02:40:56.125746 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:56.125746 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Aug 27 02:40:56.125746 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi '' Aug 27 02:40:56.125746 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:56.125746 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:56.125746 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:56.125746 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:56.125746 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:56.125746 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:56.125746 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:40:56.125746 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:40:56.125746 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:40:56.127538 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:40:56.127538 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:40:56.127538 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:40:56.127538 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 02:40:56.127538 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 02:40:56.127538 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 02:40:56.127538 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 02:40:56.127538 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 02:40:56.127538 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 02:40:56.127538 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 27 02:40:56.127538 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:56.127538 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:56.127538 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:56.127538 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:56.127538 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:56.127538 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:56.127538 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 02:40:56.127538 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 02:40:56.127538 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 27 02:40:56.127538 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:56.129970 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0abb108e-3869-40d7-9c6a-970fb5b67e23 tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:40:56.131593 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.instance [None req-cd33b991-9a63-464f-8590-584c6878043f tempest-LiveMigrationNegativeTest-1402864585 tempest-LiveMigrationNegativeTest-1402864585-project-admin] Lazy-loading 'flavor' on Instance uuid 96881762-a0a0-425f-a3b6-cc87adbae319 {{(pid=134052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:40:56.133314 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-0abb108e-3869-40d7-9c6a-970fb5b67e23 tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.019367 Aug 27 02:40:56.134767 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 173/339] 10.222.0.70 () {60 vars in 1164 bytes} [Sat Aug 27 02:40:56 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 02:40:56.143432 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-bc3fca2e-49b3-4c2d-82cb-538b6e674aa8 req-0291bfd2-959c-4984-9376-92572413b4f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11661332-bcfc-46f3-a5ba-30eb82448817", "name": "network-vif-deleted", "tag": "87995537-cd43-4eb1-9587-fbfb300e5d56"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:56.154256 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-bc3fca2e-49b3-4c2d-82cb-538b6e674aa8 req-0291bfd2-959c-4984-9376-92572413b4f5 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:56.154975 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-bc3fca2e-49b3-4c2d-82cb-538b6e674aa8 req-0291bfd2-959c-4984-9376-92572413b4f5 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:56.155699 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-bc3fca2e-49b3-4c2d-82cb-538b6e674aa8 req-0291bfd2-959c-4984-9376-92572413b4f5 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:56.177662 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-bc3fca2e-49b3-4c2d-82cb-538b6e674aa8 req-0291bfd2-959c-4984-9376-92572413b4f5 service nova] Creating event network-vif-deleted:87995537-cd43-4eb1-9587-fbfb300e5d56 for instance 11661332-bcfc-46f3-a5ba-30eb82448817 on n-h1-852278-4 Aug 27 02:40:56.188213 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-bc3fca2e-49b3-4c2d-82cb-538b6e674aa8 req-0291bfd2-959c-4984-9376-92572413b4f5 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051587 Aug 27 02:40:56.190305 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 174/340] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:40:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:40:56.203181 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-81e96f1f-354d-45df-af8b-4e5bb9d807e8 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:56.216031 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-81e96f1f-354d-45df-af8b-4e5bb9d807e8 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] [instance: 11661332-bcfc-46f3-a5ba-30eb82448817] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:56.233954 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-81e96f1f-354d-45df-af8b-4e5bb9d807e8 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:56.236810 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-81e96f1f-354d-45df-af8b-4e5bb9d807e8 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:56.237485 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-81e96f1f-354d-45df-af8b-4e5bb9d807e8 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:56.239881 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-81e96f1f-354d-45df-af8b-4e5bb9d807e8 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:56.253505 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-81e96f1f-354d-45df-af8b-4e5bb9d807e8 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:56.255602 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-81e96f1f-354d-45df-af8b-4e5bb9d807e8 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:56.279728 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-cd33b991-9a63-464f-8590-584c6878043f tempest-LiveMigrationNegativeTest-1402864585 tempest-LiveMigrationNegativeTest-1402864585-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/96881762-a0a0-425f-a3b6-cc87adbae319/action" status: 202 len: 0 microversion: 2.1 time: 0.225054 Aug 27 02:40:56.281678 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 167/341] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 02:40:56 2022] POST /compute/v2.1/servers/96881762-a0a0-425f-a3b6-cc87adbae319/action => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:40:56.294083 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3a1662a9-4326-476c-b56f-2ce02cab6a47 tempest-KeyPairsV210TestJSON-338379082 tempest-KeyPairsV210TestJSON-338379082-project-admin] Action: 'create', calling method: .version_select at 0x7f5ee35e2e50>, body: {"keypair": {"name": "tempest-keypair-1003491843", "type": "ssh", "user_id": "79888bb342b24463b959752bba54cec1", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKt8MCfNwSQViSHp1CxEkxqm7S2RudzmlSg/+oAPnp1C+djn0F23STOV2CikyKExOT6/x5YGYJlRqqSddU7FGkUaXnm4V3zrYLJN4Bu4NjcGLV5cnmwg56O5EPbCY0773w=="}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:56.338155 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-81e96f1f-354d-45df-af8b-4e5bb9d807e8 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:56.338814 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-81e96f1f-354d-45df-af8b-4e5bb9d807e8 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:56.339392 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-81e96f1f-354d-45df-af8b-4e5bb9d807e8 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:56.340036 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.objects.instance [None req-81e96f1f-354d-45df-af8b-4e5bb9d807e8 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lazy-loading 'fault' on Instance uuid 11661332-bcfc-46f3-a5ba-30eb82448817 {{(pid=134051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:40:56.351986 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-3a1662a9-4326-476c-b56f-2ce02cab6a47 tempest-KeyPairsV210TestJSON-338379082 tempest-KeyPairsV210TestJSON-338379082-project-admin] Getting quotas for project ae234ea69b204cd4bccca6bd95f268ee. Resources: {'key_pairs'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:40:56.357769 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-3a1662a9-4326-476c-b56f-2ce02cab6a47 tempest-KeyPairsV210TestJSON-338379082 tempest-KeyPairsV210TestJSON-338379082-project-admin] Getting quotas for user ba45c00ff3c14574bb4edf9b22e305f4 and project ae234ea69b204cd4bccca6bd95f268ee. Resources: {'key_pairs'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:40:56.405222 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-3a1662a9-4326-476c-b56f-2ce02cab6a47 tempest-KeyPairsV210TestJSON-338379082 tempest-KeyPairsV210TestJSON-338379082-project-admin] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.122084 Aug 27 02:40:56.408429 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-81e96f1f-354d-45df-af8b-4e5bb9d807e8 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772e2e66c92e44f8838ce325437d5a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b2f4a529a3e4ea0937ca903dd5924bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:56.417272 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-81e96f1f-354d-45df-af8b-4e5bb9d807e8 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] 10.222.0.70 "GET /compute/v2.1/servers/11661332-bcfc-46f3-a5ba-30eb82448817" status: 200 len: 1310 microversion: 2.1 time: 0.225639 Aug 27 02:40:56.417769 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 168/342] 10.222.0.70 () {62 vars in 1200 bytes} [Sat Aug 27 02:40:56 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 135 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 27 02:40:56.432825 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 175/343] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:56 2022] GET /compute/v2.1/servers/11661332-bcfc-46f3-a5ba-30eb82448817 => generated 1310 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:56.441513 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b6abb6bf-5e20-461b-a76a-ff804a09bdf2 tempest-FlavorsAccessNegativeTestJSON-471942415 tempest-FlavorsAccessNegativeTestJSON-471942415-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "25bedfbe5fe7471c9c580374770c9a4f"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:56.445102 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8f57c252-3e0b-4e72-ab16-b4a886b9c40c tempest-AggregatesAdminNegativeTestJSON-807895525 tempest-AggregatesAdminNegativeTestJSON-807895525-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1657040268"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:56.447321 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b6abb6bf-5e20-461b-a76a-ff804a09bdf2 tempest-FlavorsAccessNegativeTestJSON-471942415 tempest-FlavorsAccessNegativeTestJSON-471942415-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '75e4e8c0bc9d49e7a5c5b7c2770a4ed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bedfbe5fe7471c9c580374770c9a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:56.451108 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-8f57c252-3e0b-4e72-ab16-b4a886b9c40c tempest-AggregatesAdminNegativeTestJSON-807895525 tempest-AggregatesAdminNegativeTestJSON-807895525-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': 'f17b5fa988d64acdbf5e0ffb3d8295c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b33d870157341ba9ba278c0419e5646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:56.453321 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b6abb6bf-5e20-461b-a76a-ff804a09bdf2 tempest-FlavorsAccessNegativeTestJSON-471942415 tempest-FlavorsAccessNegativeTestJSON-471942415-project] Request method failure captured: Aug 27 02:40:56.453321 n-d-852278-4 devstack@n-api.service[134052]: request: POST /compute/v2.1/flavors/166114223/action HTTP/1.1 Aug 27 02:40:56.453321 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:40:56.453321 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:40:56.453321 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:40:56.453321 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 70 Aug 27 02:40:56.453321 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:40:56.453321 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:40:56.453321 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:40:56.453321 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:40:56.453321 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYQtESRE6XIQDWys7Iq7L_aXP5_HwV31xAFE9_rOG_S_emDxpjScClh2ItMgTX9-Y96-phpgz9S8rx8nS2aIlGZ5vxG8h0f7JqdWltUqyCtwtWnlzDhi1dYAlUkmYMebHN9-cx856IthpZBhNBjlfdxFKOh2q5KA1tRTkqZ7HREofcs Aug 27 02:40:56.453321 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:40:56.453321 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:40:56.453321 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:40:56.453321 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:40:56.453321 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:40:56.453321 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:40:56.453321 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 25bedfbe5fe7471c9c580374770c9a4f Aug 27 02:40:56.453321 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-471942415 Aug 27 02:40:56.453321 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:40:56.453321 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:40:56.454794 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/25bedfbe5fe7471c9c580374770c9a4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_25bedfbe5fe7471c9c580374770c9a4f", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/25bedfbe5fe7471c9c580374770c9a4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/25bedfbe5fe7471c9c580374770c9a4f"}]}] Aug 27 02:40:56.454794 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-471942415 Aug 27 02:40:56.454794 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 25bedfbe5fe7471c9c580374770c9a4f Aug 27 02:40:56.454794 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-471942415 Aug 27 02:40:56.454794 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-FlavorsAccessNegativeTestJSON-471942415-project Aug 27 02:40:56.454794 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:40:56.454794 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:40:56.454794 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 75e4e8c0bc9d49e7a5c5b7c2770a4ed3 Aug 27 02:40:56.454794 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-471942415-project Aug 27 02:40:56.454794 n-d-852278-4 devstack@n-api.service[134052]: Aug 27 02:40:56.454794 n-d-852278-4 devstack@n-api.service[134052]: {"removeTenantAccess": {"tenant": "25bedfbe5fe7471c9c580374770c9a4f"}} Aug 27 02:40:56.454794 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 02:40:56.455575 n-d-852278-4 devstack@n-api.service[134052]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 27 02:40:56.455575 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '166114223', 'body': {'removeTenantAccess': {'tenant': '25bedfbe5fe7471c9c580374770c9a4f'}}} Aug 27 02:40:56.455575 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:40:56.455575 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:56.455575 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:56.455575 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:56.455575 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:40:56.455575 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:40:56.455575 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:40:56.455575 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:40:56.455575 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:40:56.455575 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:40:56.455575 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Aug 27 02:40:56.455575 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi context.can( Aug 27 02:40:56.455575 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 02:40:56.455575 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 02:40:56.455575 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 02:40:56.455575 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 02:40:56.455575 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 02:40:56.455575 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 02:40:56.456894 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 02:40:56.456894 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 02:40:56.456894 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 02:40:56.456894 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 02:40:56.456894 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 02:40:56.456894 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 02:40:56.456894 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 02:40:56.456894 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 02:40:56.456894 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 27 02:40:56.456894 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:56.456894 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:56.456894 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:56.456894 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:56.456894 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:56.456894 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:56.456894 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 02:40:56.456894 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 02:40:56.456894 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 27 02:40:56.456894 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:56.460107 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8f57c252-3e0b-4e72-ab16-b4a886b9c40c tempest-AggregatesAdminNegativeTestJSON-807895525 tempest-AggregatesAdminNegativeTestJSON-807895525-project] Request method failure captured: Aug 27 02:40:56.460107 n-d-852278-4 devstack@n-api.service[134051]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 27 02:40:56.460107 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:40:56.460107 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:40:56.460107 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:40:56.460107 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 60 Aug 27 02:40:56.460107 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:40:56.460107 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:40:56.460107 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:40:56.460107 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:40:56.460107 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYQvuBv6JQonbVquACW5BfJW03Ok7r9cJWaXBSlWenevdcBmUT6NxHe3ISG90l2Au4FTBVbAdKM3n3MgDPiXOLiixJXNloA1Wjh-GyV1vQC5fOrAmbbI-kR7SiNYuturGL7Z_pz2sSXrToir2T2cHQmfMhzhLhOBfpVVvaIcHgwvlZI Aug 27 02:40:56.460107 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:40:56.460107 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:40:56.460107 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:40:56.460107 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:40:56.460107 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:40:56.460107 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:40:56.460107 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 8b33d870157341ba9ba278c0419e5646 Aug 27 02:40:56.460107 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-807895525 Aug 27 02:40:56.460107 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:40:56.460107 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:40:56.461549 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8b33d870157341ba9ba278c0419e5646"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8b33d870157341ba9ba278c0419e5646", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8b33d870157341ba9ba278c0419e5646"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8b33d870157341ba9ba278c0419e5646"}]}] Aug 27 02:40:56.461549 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-807895525 Aug 27 02:40:56.461549 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 8b33d870157341ba9ba278c0419e5646 Aug 27 02:40:56.461549 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-807895525 Aug 27 02:40:56.461549 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-AggregatesAdminNegativeTestJSON-807895525-project Aug 27 02:40:56.461549 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:40:56.461549 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:40:56.461549 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: f17b5fa988d64acdbf5e0ffb3d8295c8 Aug 27 02:40:56.461549 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-807895525-project Aug 27 02:40:56.461549 n-d-852278-4 devstack@n-api.service[134051]: Aug 27 02:40:56.461549 n-d-852278-4 devstack@n-api.service[134051]: {"aggregate": {"name": "tempest-test_aggregate-1657040268"}} Aug 27 02:40:56.461549 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 02:40:56.461549 n-d-852278-4 devstack@n-api.service[134051]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 27 02:40:56.462415 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1657040268'}}} Aug 27 02:40:56.462415 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:40:56.462415 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:56.462415 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:56.462415 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:56.462415 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:40:56.462415 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:40:56.462415 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:40:56.462415 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:40:56.462415 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:40:56.462415 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:40:56.462415 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:40:56.462415 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:40:56.462415 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Aug 27 02:40:56.462415 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Aug 27 02:40:56.462415 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 02:40:56.462415 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 02:40:56.462415 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 02:40:56.462415 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 02:40:56.463663 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 02:40:56.463663 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 02:40:56.463663 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 02:40:56.463663 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 02:40:56.463663 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 02:40:56.463663 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 02:40:56.463663 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 02:40:56.463663 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 02:40:56.463663 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 02:40:56.463663 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 02:40:56.463663 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 27 02:40:56.463663 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:56.463663 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:56.463663 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:56.463663 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:56.463663 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:56.463663 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:56.463663 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 02:40:56.463663 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 02:40:56.463663 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 27 02:40:56.464952 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:56.465925 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b6abb6bf-5e20-461b-a76a-ff804a09bdf2 tempest-FlavorsAccessNegativeTestJSON-471942415 tempest-FlavorsAccessNegativeTestJSON-471942415-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:40:56.467112 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b6abb6bf-5e20-461b-a76a-ff804a09bdf2 tempest-FlavorsAccessNegativeTestJSON-471942415 tempest-FlavorsAccessNegativeTestJSON-471942415-project] 10.222.0.70 "POST /compute/v2.1/flavors/166114223/action" status: 403 len: 133 microversion: 2.1 time: 0.048040 Aug 27 02:40:56.467914 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8f57c252-3e0b-4e72-ab16-b4a886b9c40c tempest-AggregatesAdminNegativeTestJSON-807895525 tempest-AggregatesAdminNegativeTestJSON-807895525-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:40:56.468675 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 169/344] 10.222.0.70 () {60 vars in 1197 bytes} [Sat Aug 27 02:40:56 2022] POST /compute/v2.1/flavors/166114223/action => generated 133 bytes in 50 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:40:56.469763 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-8f57c252-3e0b-4e72-ab16-b4a886b9c40c tempest-AggregatesAdminNegativeTestJSON-807895525 tempest-AggregatesAdminNegativeTestJSON-807895525-project] 10.222.0.70 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.035615 Aug 27 02:40:56.476462 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 176/345] 10.222.0.70 () {60 vars in 1164 bytes} [Sat Aug 27 02:40:56 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 43 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:40:56.483382 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d6d2810f-a5bb-4148-b204-92df23417be6 tempest-KeyPairsV210TestJSON-338379082 tempest-KeyPairsV210TestJSON-338379082-project-admin] Calling method '.version_select at 0x7f5edf604160>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:56.486957 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ecaddda5-1ce4-4304-adc8-67e8f22323f6 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:56.489266 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-ecaddda5-1ce4-4304-adc8-67e8f22323f6 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] [instance: 96881762-a0a0-425f-a3b6-cc87adbae319] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:56.502021 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ecaddda5-1ce4-4304-adc8-67e8f22323f6 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:56.505183 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d6d2810f-a5bb-4148-b204-92df23417be6 tempest-KeyPairsV210TestJSON-338379082 tempest-KeyPairsV210TestJSON-338379082-project-admin] 10.222.0.70 "GET /compute/v2.1/os-keypairs/tempest-keypair-1229631881?user_id=79888bb342b24463b959752bba54cec1" status: 200 len: 512 microversion: 2.10 time: 0.027372 Aug 27 02:40:56.505928 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ecaddda5-1ce4-4304-adc8-67e8f22323f6 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:56.506948 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ecaddda5-1ce4-4304-adc8-67e8f22323f6 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:56.507860 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ecaddda5-1ce4-4304-adc8-67e8f22323f6 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:56.509270 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ecaddda5-1ce4-4304-adc8-67e8f22323f6 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:56.509707 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 177/346] 10.222.0.70 () {60 vars in 1340 bytes} [Sat Aug 27 02:40:56 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1229631881?user_id=79888bb342b24463b959752bba54cec1 => generated 512 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:40:56.510324 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ecaddda5-1ce4-4304-adc8-67e8f22323f6 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:56.519841 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-935a2fae-e124-4c16-b1e0-61fc81b7f6ba tempest-FlavorsAccessNegativeTestJSON-1848628100 tempest-FlavorsAccessNegativeTestJSON-1848628100-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "25bedfbe5fe7471c9c580374770c9a4f"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:56.654550 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-935a2fae-e124-4c16-b1e0-61fc81b7f6ba tempest-FlavorsAccessNegativeTestJSON-1848628100 tempest-FlavorsAccessNegativeTestJSON-1848628100-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors/166114223/action" status: 200 len: 21 microversion: 2.1 time: 0.142962 Aug 27 02:40:56.655788 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 178/347] 10.222.0.70 () {60 vars in 1197 bytes} [Sat Aug 27 02:40:56 2022] POST /compute/v2.1/flavors/166114223/action => generated 21 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:40:56.660696 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0ba0335c-da12-48f8-b480-ebdc4868d49d tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-183114918"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:56.664384 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.objects.aggregate [None req-0ba0335c-da12-48f8-b480-ebdc4868d49d tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] Generated uuid d0d041a1-e635-4cc5-a372-e027ea4563a4 for aggregate {{(pid=134051) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 02:40:56.688612 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-0ba0335c-da12-48f8-b480-ebdc4868d49d tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.030896 Aug 27 02:40:56.689517 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 179/348] 10.222.0.70 () {60 vars in 1164 bytes} [Sat Aug 27 02:40:56 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:40:56.696696 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ad9a379c-6262-45fd-afcb-4f1cfcca7326 tempest-KeyPairsV210TestJSON-338379082 tempest-KeyPairsV210TestJSON-338379082-project-admin] Action: 'create', calling method: .version_select at 0x7f5edf5e7280>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-63939000", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOCK4Mf4stcrbcmvKI6WEyWFd3cd2VvtTBDDVd4Ut13YGX49WscyihbSx5YSIPZbdhLF9G/OmksJm67UxO3A15axU8FH0Agh+9kqdaV/KfPkueC/pwnE4NDfYylEgHYuYA=="}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:56.718400 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-ad9a379c-6262-45fd-afcb-4f1cfcca7326 tempest-KeyPairsV210TestJSON-338379082 tempest-KeyPairsV210TestJSON-338379082-project-admin] Getting quotas for project ae234ea69b204cd4bccca6bd95f268ee. Resources: {'key_pairs'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:40:56.727099 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-ad9a379c-6262-45fd-afcb-4f1cfcca7326 tempest-KeyPairsV210TestJSON-338379082 tempest-KeyPairsV210TestJSON-338379082-project-admin] Getting quotas for user ba45c00ff3c14574bb4edf9b22e305f4 and project ae234ea69b204cd4bccca6bd95f268ee. Resources: {'key_pairs'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:40:56.759828 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ad9a379c-6262-45fd-afcb-4f1cfcca7326 tempest-KeyPairsV210TestJSON-338379082 tempest-KeyPairsV210TestJSON-338379082-project-admin] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.10 time: 0.067906 Aug 27 02:40:56.766163 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-ecaddda5-1ce4-4304-adc8-67e8f22323f6 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68711ff38ec41c0b051124527c7ac35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae179f416c451e92e270d2cb0f4400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:56.767074 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 180/349] 10.222.0.70 () {62 vars in 1200 bytes} [Sat Aug 27 02:40:56 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 77 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 27 02:40:56.780926 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ecaddda5-1ce4-4304-adc8-67e8f22323f6 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] 10.222.0.70 "GET /compute/v2.1/servers/96881762-a0a0-425f-a3b6-cc87adbae319" status: 200 len: 1476 microversion: 2.1 time: 0.306617 Aug 27 02:40:56.783287 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 170/350] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:56 2022] GET /compute/v2.1/servers/96881762-a0a0-425f-a3b6-cc87adbae319 => generated 1476 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:56.793331 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-172cb3e6-89c8-4990-8bce-1208bc499e1a tempest-FlavorsAccessNegativeTestJSON-1848628100 tempest-FlavorsAccessNegativeTestJSON-1848628100-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:56.802146 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-794ee1af-c138-4af2-ba2b-428857596eba tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:56.802765 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-794ee1af-c138-4af2-ba2b-428857596eba tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: bb513027-efc1-4201-812f-39c88b423a9d] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:56.809786 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-794ee1af-c138-4af2-ba2b-428857596eba tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:56.810377 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-794ee1af-c138-4af2-ba2b-428857596eba tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:56.810868 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-794ee1af-c138-4af2-ba2b-428857596eba tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:56.811973 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-794ee1af-c138-4af2-ba2b-428857596eba tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:56.812678 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-794ee1af-c138-4af2-ba2b-428857596eba tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:56.813297 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-794ee1af-c138-4af2-ba2b-428857596eba tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:56.848582 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-172cb3e6-89c8-4990-8bce-1208bc499e1a tempest-FlavorsAccessNegativeTestJSON-1848628100 tempest-FlavorsAccessNegativeTestJSON-1848628100-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/166114223" status: 202 len: 0 microversion: 2.1 time: 0.062177 Aug 27 02:40:56.854515 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 171/351] 10.222.0.70 () {58 vars in 1158 bytes} [Sat Aug 27 02:40:56 2022] DELETE /compute/v2.1/flavors/166114223 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:40:56.860229 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-927fc4d5-37a6-4db1-8fdc-90f4af6d7956 tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-183114918"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:56.868134 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.aggregate [None req-927fc4d5-37a6-4db1-8fdc-90f4af6d7956 tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] Generated uuid be316d2e-f926-4959-8699-4407c6211e93 for aggregate {{(pid=134052) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 02:40:56.895164 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-927fc4d5-37a6-4db1-8fdc-90f4af6d7956 tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-183114918 already exists. Aug 27 02:40:56.899754 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-927fc4d5-37a6-4db1-8fdc-90f4af6d7956 tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] Request method failure captured: Aug 27 02:40:56.899754 n-d-852278-4 devstack@n-api.service[134052]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 27 02:40:56.899754 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:40:56.899754 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:40:56.899754 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:40:56.899754 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 59 Aug 27 02:40:56.899754 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:40:56.899754 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:40:56.899754 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:40:56.899754 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:40:56.899754 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYQw_VNUmSCv_20TpMEP3_ppldhnIWLmU69XDcYQfj67tX_lE5lVDHgben_DcmvPHwnav4XS3W4R4Pcupx9OYq1E9oH9whRQ2L4RdZtHHBeKr7_pa2Rd9kvWlVmmOKLMcwgvL_46OZuuQeojuAOZIflbS0TzoMt1ZAIyQEXBhZJKuaU Aug 27 02:40:56.899754 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:40:56.899754 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:40:56.899754 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:40:56.899754 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:40:56.899754 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:40:56.899754 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:40:56.899754 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: f7fc8497b19948e8a50cea73d1c73f33 Aug 27 02:40:56.899754 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2116589466 Aug 27 02:40:56.899754 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,admin,member Aug 27 02:40:56.899754 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,admin,member Aug 27 02:40:56.900976 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f7fc8497b19948e8a50cea73d1c73f33"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f7fc8497b19948e8a50cea73d1c73f33", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f7fc8497b19948e8a50cea73d1c73f33"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f7fc8497b19948e8a50cea73d1c73f33"}]}] Aug 27 02:40:56.900976 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2116589466 Aug 27 02:40:56.900976 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: f7fc8497b19948e8a50cea73d1c73f33 Aug 27 02:40:56.900976 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2116589466 Aug 27 02:40:56.900976 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin Aug 27 02:40:56.900976 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:40:56.900976 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:40:56.900976 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: cbedd631dd394e8885bde3503028d3d9 Aug 27 02:40:56.900976 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin Aug 27 02:40:56.900976 n-d-852278-4 devstack@n-api.service[134052]: Aug 27 02:40:56.900976 n-d-852278-4 devstack@n-api.service[134052]: {"aggregate": {"name": "tempest-test_aggregate-183114918"}} Aug 27 02:40:56.900976 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 02:40:56.900976 n-d-852278-4 devstack@n-api.service[134052]: exception: Aggregate tempest-test_aggregate-183114918 already exists. Aug 27 02:40:56.901677 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-183114918'}}} Aug 27 02:40:56.901677 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:40:56.901677 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:56.901677 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Aug 27 02:40:56.901677 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Aug 27 02:40:56.901677 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 27 02:40:56.901677 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 27 02:40:56.901677 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 02:40:56.901677 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 02:40:56.901677 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 02:40:56.901677 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 02:40:56.901677 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 27 02:40:56.901677 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 27 02:40:56.901677 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6456, in create_aggregate Aug 27 02:40:56.901677 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi aggregate.create() Aug 27 02:40:56.901677 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 27 02:40:56.901677 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 27 02:40:56.901677 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Aug 27 02:40:56.901677 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Aug 27 02:40:56.903420 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 02:40:56.903420 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 02:40:56.903420 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Aug 27 02:40:56.903420 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Aug 27 02:40:56.903420 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-183114918 already exists. Aug 27 02:40:56.903420 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:56.903420 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:56.903420 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:56.903420 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:56.903420 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:56.903420 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:56.903420 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:40:56.903420 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:40:56.903420 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:40:56.903420 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:40:56.903420 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:40:56.903420 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:40:56.903420 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:40:56.903420 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:40:56.903420 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Aug 27 02:40:56.906357 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Aug 27 02:40:56.906357 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-183114918 already exists. Aug 27 02:40:56.906357 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:56.906357 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:56.906357 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:56.906357 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:56.906357 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:56.906357 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:56.906357 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:40:56.906357 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:40:56.906357 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-183114918 already exists. Aug 27 02:40:56.906357 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:56.910265 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-927fc4d5-37a6-4db1-8fdc-90f4af6d7956 tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-183114918 already exists. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:40:56.913295 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-927fc4d5-37a6-4db1-8fdc-90f4af6d7956 tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates" status: 409 len: 110 microversion: 2.1 time: 0.057432 Aug 27 02:40:56.914244 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 172/352] 10.222.0.70 () {60 vars in 1164 bytes} [Sat Aug 27 02:40:56 2022] POST /compute/v2.1/os-aggregates => generated 110 bytes in 59 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 27 02:40:56.923293 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ae880462-8c30-4dc2-9f53-d0c80b8a415a tempest-KeyPairsV210TestJSON-338379082 tempest-KeyPairsV210TestJSON-338379082-project-admin] Calling method '.version_select at 0x7f5ee3811550>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:56.942022 n-d-852278-4 devstack@n-api.service[134052]: WARNING oslo_db.sqlalchemy.utils [None req-ae880462-8c30-4dc2-9f53-d0c80b8a415a tempest-KeyPairsV210TestJSON-338379082 tempest-KeyPairsV210TestJSON-338379082-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Aug 27 02:40:56.961213 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ae880462-8c30-4dc2-9f53-d0c80b8a415a tempest-KeyPairsV210TestJSON-338379082 tempest-KeyPairsV210TestJSON-338379082-project-admin] 10.222.0.70 "GET /compute/v2.1/os-keypairs?user_id=79888bb342b24463b959752bba54cec1" status: 200 len: 726 microversion: 2.10 time: 0.044981 Aug 27 02:40:56.962037 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 173/353] 10.222.0.70 () {60 vars in 1259 bytes} [Sat Aug 27 02:40:56 2022] GET /compute/v2.1/os-keypairs?user_id=79888bb342b24463b959752bba54cec1 => generated 726 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:40:56.966980 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b4780379-c206-4ccf-b3ed-b751e1bbae0c tempest-FlavorsAccessNegativeTestJSON-1848628100 tempest-FlavorsAccessNegativeTestJSON-1848628100-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:57.018038 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-794ee1af-c138-4af2-ba2b-428857596eba tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:57.020158 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b4780379-c206-4ccf-b3ed-b751e1bbae0c tempest-FlavorsAccessNegativeTestJSON-1848628100 tempest-FlavorsAccessNegativeTestJSON-1848628100-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.054925 Aug 27 02:40:57.033035 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 174/354] 10.222.0.70 () {58 vars in 1146 bytes} [Sat Aug 27 02:40:56 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:57.042896 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-794ee1af-c138-4af2-ba2b-428857596eba tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:57.044834 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c8257fad-a931-4c37-b9e2-f3e43ebd5389 tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:57.045179 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-794ee1af-c138-4af2-ba2b-428857596eba tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:57.046643 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-794ee1af-c138-4af2-ba2b-428857596eba tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/bb513027-efc1-4201-812f-39c88b423a9d" status: 200 len: 1314 microversion: 2.25 time: 0.278200 Aug 27 02:40:57.062774 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 181/355] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:40:56 2022] GET /compute/v2.1/servers/bb513027-efc1-4201-812f-39c88b423a9d => generated 1314 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:40:57.076486 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3e2a6f20-9542-46dd-ae63-e4c55f5c8def tempest-KeyPairsV210TestJSON-338379082 tempest-KeyPairsV210TestJSON-338379082-project-admin] Calling method '.version_select at 0x7f5edf5e18b0>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:57.081768 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c8257fad-a931-4c37-b9e2-f3e43ebd5389 tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] 10.222.0.70 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.047502 Aug 27 02:40:57.082337 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 175/356] 10.222.0.70 () {58 vars in 1155 bytes} [Sat Aug 27 02:40:57 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 27 02:40:57.095111 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f0e64565-0d5c-4a1d-946d-a8b3e4fbfe29 tempest-FlavorsAccessNegativeTestJSON-1848628100 tempest-FlavorsAccessNegativeTestJSON-1848628100-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1698866003", "id": 1016450748, "os-flavor-access:is_public": "False"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:57.105796 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-3e2a6f20-9542-46dd-ae63-e4c55f5c8def tempest-KeyPairsV210TestJSON-338379082 tempest-KeyPairsV210TestJSON-338379082-project-admin] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-63939000" status: 204 len: 0 microversion: 2.10 time: 0.033415 Aug 27 02:40:57.106747 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 182/357] 10.222.0.70 () {60 vars in 1319 bytes} [Sat Aug 27 02:40:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-63939000 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 02:40:57.116758 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ea926c2f-b2fe-4ef9-a096-41e28df8f3d0 tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1166495325"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:57.124858 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.objects.aggregate [None req-ea926c2f-b2fe-4ef9-a096-41e28df8f3d0 tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] Generated uuid b1410c04-6eac-4b7f-9668-d5d024fe2bf9 for aggregate {{(pid=134051) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 02:40:57.129604 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f0e64565-0d5c-4a1d-946d-a8b3e4fbfe29 tempest-FlavorsAccessNegativeTestJSON-1848628100 tempest-FlavorsAccessNegativeTestJSON-1848628100-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.045957 Aug 27 02:40:57.134112 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 176/358] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 02:40:57 2022] POST /compute/v2.1/flavors => generated 439 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:40:57.141276 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-509faa26-d751-4150-82c5-c675ce7bc9c1 tempest-KeyPairsV210TestJSON-338379082 tempest-KeyPairsV210TestJSON-338379082-project-admin] Calling method '.version_select at 0x7f5ee36135e0>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:57.167839 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ea926c2f-b2fe-4ef9-a096-41e28df8f3d0 tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.059352 Aug 27 02:40:57.174816 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=81,nova_api:DELETE=14,nova_api:INSERT=5 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:40:57.177025 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 183/359] 10.222.0.70 () {60 vars in 1164 bytes} [Sat Aug 27 02:40:57 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:40:57.184285 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3898678f-f909-472a-b1a7-772b647bfdb6 tempest-FlavorsAccessNegativeTestJSON-1848628100 tempest-FlavorsAccessNegativeTestJSON-1848628100-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "5137597b7885454f9e2b1f150dd3590e"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:57.189708 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-509faa26-d751-4150-82c5-c675ce7bc9c1 tempest-KeyPairsV210TestJSON-338379082 tempest-KeyPairsV210TestJSON-338379082-project-admin] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1003491843?user_id=79888bb342b24463b959752bba54cec1" status: 204 len: 0 microversion: 2.10 time: 0.053714 Aug 27 02:40:57.190300 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 177/360] 10.222.0.70 () {60 vars in 1343 bytes} [Sat Aug 27 02:40:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1003491843?user_id=79888bb342b24463b959752bba54cec1 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 02:40:57.198407 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-cf102ad0-34d4-428a-9356-5272e859f274 tempest-AggregatesAdminNegativeTestJSON-807895525 tempest-AggregatesAdminNegativeTestJSON-807895525-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:57.202728 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-cf102ad0-34d4-428a-9356-5272e859f274 tempest-AggregatesAdminNegativeTestJSON-807895525 tempest-AggregatesAdminNegativeTestJSON-807895525-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': 'f17b5fa988d64acdbf5e0ffb3d8295c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b33d870157341ba9ba278c0419e5646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:57.204369 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-cf102ad0-34d4-428a-9356-5272e859f274 tempest-AggregatesAdminNegativeTestJSON-807895525 tempest-AggregatesAdminNegativeTestJSON-807895525-project] Request method failure captured: Aug 27 02:40:57.204369 n-d-852278-4 devstack@n-api.service[134052]: request: DELETE /compute/v2.1/os-aggregates/15 HTTP/1.1 Aug 27 02:40:57.204369 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:40:57.204369 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:40:57.204369 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:40:57.204369 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:40:57.204369 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:40:57.204369 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:40:57.204369 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:40:57.204369 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:40:57.204369 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYQvuBv6JQonbVquACW5BfJW03Ok7r9cJWaXBSlWenevdcBmUT6NxHe3ISG90l2Au4FTBVbAdKM3n3MgDPiXOLiixJXNloA1Wjh-GyV1vQC5fOrAmbbI-kR7SiNYuturGL7Z_pz2sSXrToir2T2cHQmfMhzhLhOBfpVVvaIcHgwvlZI Aug 27 02:40:57.204369 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:40:57.204369 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:40:57.204369 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:40:57.204369 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:40:57.204369 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:40:57.204369 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:40:57.204369 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 8b33d870157341ba9ba278c0419e5646 Aug 27 02:40:57.204369 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-807895525 Aug 27 02:40:57.204369 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:40:57.204369 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:40:57.205797 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8b33d870157341ba9ba278c0419e5646"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8b33d870157341ba9ba278c0419e5646", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8b33d870157341ba9ba278c0419e5646"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8b33d870157341ba9ba278c0419e5646"}]}] Aug 27 02:40:57.205797 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-807895525 Aug 27 02:40:57.205797 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 8b33d870157341ba9ba278c0419e5646 Aug 27 02:40:57.205797 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-807895525 Aug 27 02:40:57.205797 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-AggregatesAdminNegativeTestJSON-807895525-project Aug 27 02:40:57.205797 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:40:57.205797 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:40:57.205797 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: f17b5fa988d64acdbf5e0ffb3d8295c8 Aug 27 02:40:57.205797 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-807895525-project Aug 27 02:40:57.205797 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 02:40:57.205797 n-d-852278-4 devstack@n-api.service[134052]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 27 02:40:57.205797 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '15'} Aug 27 02:40:57.206484 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:40:57.206484 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:57.206484 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:57.206484 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:57.206484 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:40:57.206484 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:40:57.206484 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:40:57.206484 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:40:57.206484 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Aug 27 02:40:57.206484 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Aug 27 02:40:57.206484 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 02:40:57.206484 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 02:40:57.206484 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 02:40:57.206484 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 02:40:57.206484 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 02:40:57.206484 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 02:40:57.206484 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 02:40:57.206484 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 02:40:57.206484 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 02:40:57.212528 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 02:40:57.212528 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 02:40:57.212528 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 02:40:57.212528 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 02:40:57.212528 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 02:40:57.212528 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 27 02:40:57.212528 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:57.212528 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:57.212528 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:57.212528 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:57.212528 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:57.212528 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:57.212528 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 02:40:57.212528 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 02:40:57.212528 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 27 02:40:57.212528 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:57.212528 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-cf102ad0-34d4-428a-9356-5272e859f274 tempest-AggregatesAdminNegativeTestJSON-807895525 tempest-AggregatesAdminNegativeTestJSON-807895525-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:40:57.213757 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-cf102ad0-34d4-428a-9356-5272e859f274 tempest-AggregatesAdminNegativeTestJSON-807895525 tempest-AggregatesAdminNegativeTestJSON-807895525-project] 10.222.0.70 "DELETE /compute/v2.1/os-aggregates/15" status: 403 len: 116 microversion: 2.1 time: 0.013503 Aug 27 02:40:57.213757 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 178/361] 10.222.0.70 () {58 vars in 1155 bytes} [Sat Aug 27 02:40:57 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 116 bytes in 14 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:40:57.222440 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-27e75c02-6e30-44e8-806e-af6b7bfe7ee6 tempest-KeyPairsV210TestJSON-338379082 tempest-KeyPairsV210TestJSON-338379082-project-admin] Calling method '.version_select at 0x7f5ee3e4d940>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:57.246339 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-27e75c02-6e30-44e8-806e-af6b7bfe7ee6 tempest-KeyPairsV210TestJSON-338379082 tempest-KeyPairsV210TestJSON-338379082-project-admin] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1229631881?user_id=79888bb342b24463b959752bba54cec1" status: 204 len: 0 microversion: 2.10 time: 0.038734 Aug 27 02:40:57.247309 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 179/362] 10.222.0.70 () {60 vars in 1343 bytes} [Sat Aug 27 02:40:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1229631881?user_id=79888bb342b24463b959752bba54cec1 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 02:40:57.271585 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-bced0c8a-fd15-4aa2-98c7-24e44070cbd1 tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:57.311180 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-3898678f-f909-472a-b1a7-772b647bfdb6 tempest-FlavorsAccessNegativeTestJSON-1848628100 tempest-FlavorsAccessNegativeTestJSON-1848628100-project-admin] HTTP exception thrown: Flavor access not found for 25 / 5137597b7885454f9e2b1f150dd3590e combination. Aug 27 02:40:57.315523 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3898678f-f909-472a-b1a7-772b647bfdb6 tempest-FlavorsAccessNegativeTestJSON-1848628100 tempest-FlavorsAccessNegativeTestJSON-1848628100-project-admin] Request method failure captured: Aug 27 02:40:57.315523 n-d-852278-4 devstack@n-api.service[134051]: request: POST /compute/v2.1/flavors/1016450748/action HTTP/1.1 Aug 27 02:40:57.315523 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:40:57.315523 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:40:57.315523 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:40:57.315523 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 70 Aug 27 02:40:57.315523 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:40:57.315523 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:40:57.315523 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:40:57.315523 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:40:57.315523 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYQv-Qo2nD0DZmwo74KEbOar9UhVMStGPnEfUtlqkgKbmsS7tDG51Uo4nxV8BzWj0HtuqldxEdGCifRhVOVtII25Pv508SHDambR_EP_xOqFSEfOWqRPZOp0jgc86QrHkAlhnJzVba0AcyUtqS4FwsUhBWJ74-CYDYJ5C-gqsc42mn4 Aug 27 02:40:57.315523 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:40:57.315523 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:40:57.315523 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:40:57.315523 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:40:57.315523 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:40:57.315523 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:40:57.315523 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: dbaf80924427449d928467206546ae36 Aug 27 02:40:57.315523 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1848628100 Aug 27 02:40:57.315523 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,admin,member Aug 27 02:40:57.315523 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,admin,member Aug 27 02:40:57.317024 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/dbaf80924427449d928467206546ae36"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_dbaf80924427449d928467206546ae36", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/dbaf80924427449d928467206546ae36"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/dbaf80924427449d928467206546ae36"}]}] Aug 27 02:40:57.317024 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1848628100 Aug 27 02:40:57.317024 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: dbaf80924427449d928467206546ae36 Aug 27 02:40:57.317024 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1848628100 Aug 27 02:40:57.317024 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-FlavorsAccessNegativeTestJSON-1848628100-project-admin Aug 27 02:40:57.317024 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:40:57.317024 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:40:57.317024 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 0f31ca6e917e46f2a6c985beed2732df Aug 27 02:40:57.317024 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1848628100-project-admin Aug 27 02:40:57.317024 n-d-852278-4 devstack@n-api.service[134051]: Aug 27 02:40:57.317024 n-d-852278-4 devstack@n-api.service[134051]: {"removeTenantAccess": {"tenant": "5137597b7885454f9e2b1f150dd3590e"}} Aug 27 02:40:57.317024 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 02:40:57.317862 n-d-852278-4 devstack@n-api.service[134051]: exception: Flavor access not found for 25 / 5137597b7885454f9e2b1f150dd3590e combination. Aug 27 02:40:57.317862 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '1016450748', 'body': {'removeTenantAccess': {'tenant': '5137597b7885454f9e2b1f150dd3590e'}}} Aug 27 02:40:57.317862 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:40:57.317862 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:57.317862 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Aug 27 02:40:57.317862 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Aug 27 02:40:57.317862 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 27 02:40:57.317862 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 27 02:40:57.317862 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Aug 27 02:40:57.317862 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Aug 27 02:40:57.317862 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Aug 27 02:40:57.317862 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Aug 27 02:40:57.317862 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Aug 27 02:40:57.317862 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Aug 27 02:40:57.317862 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 02:40:57.317862 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 02:40:57.317862 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Aug 27 02:40:57.317862 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Aug 27 02:40:57.321418 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 25 / 5137597b7885454f9e2b1f150dd3590e combination. Aug 27 02:40:57.321418 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:57.321418 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:57.321418 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:57.321418 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:57.321418 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:57.321418 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:57.321418 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:40:57.321418 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:40:57.321418 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:40:57.321418 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:40:57.321418 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:40:57.321418 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:40:57.321418 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Aug 27 02:40:57.321418 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:40:57.321418 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 25 / 5137597b7885454f9e2b1f150dd3590e combination. Aug 27 02:40:57.321418 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:57.321418 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:57.321418 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:57.321418 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:57.322752 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:57.322752 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:57.322752 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:40:57.322752 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:40:57.322752 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 25 / 5137597b7885454f9e2b1f150dd3590e combination. Aug 27 02:40:57.322752 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:57.322752 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3898678f-f909-472a-b1a7-772b647bfdb6 tempest-FlavorsAccessNegativeTestJSON-1848628100 tempest-FlavorsAccessNegativeTestJSON-1848628100-project-admin] Returning 404 to user: Flavor access not found for 25 / 5137597b7885454f9e2b1f150dd3590e combination. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:40:57.322752 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-3898678f-f909-472a-b1a7-772b647bfdb6 tempest-FlavorsAccessNegativeTestJSON-1848628100 tempest-FlavorsAccessNegativeTestJSON-1848628100-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors/1016450748/action" status: 404 len: 124 microversion: 2.1 time: 0.139746 Aug 27 02:40:57.322752 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 184/363] 10.222.0.70 () {60 vars in 1200 bytes} [Sat Aug 27 02:40:57 2022] POST /compute/v2.1/flavors/1016450748/action => generated 124 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:40:57.326699 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-6d670070-fa08-4650-854b-b34efda95735 tempest-FlavorsAccessNegativeTestJSON-1848628100 tempest-FlavorsAccessNegativeTestJSON-1848628100-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:57.354063 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-bced0c8a-fd15-4aa2-98c7-24e44070cbd1 tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] 10.222.0.70 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.104197 Aug 27 02:40:57.355923 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 180/364] 10.222.0.70 () {58 vars in 1155 bytes} [Sat Aug 27 02:40:57 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 27 02:40:57.366380 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-6d670070-fa08-4650-854b-b34efda95735 tempest-FlavorsAccessNegativeTestJSON-1848628100 tempest-FlavorsAccessNegativeTestJSON-1848628100-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/1016450748" status: 202 len: 0 microversion: 2.1 time: 0.043196 Aug 27 02:40:57.367820 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 185/365] 10.222.0.70 () {58 vars in 1161 bytes} [Sat Aug 27 02:40:57 2022] DELETE /compute/v2.1/flavors/1016450748 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:40:57.369120 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a6cb02da-5856-4edd-bf7f-407c3bb67651 tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:57.380340 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4ed64ac7-09b1-46da-973b-aad160f0b0ec tempest-FlavorsAccessNegativeTestJSON-1848628100 tempest-FlavorsAccessNegativeTestJSON-1848628100-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:57.392906 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-a6cb02da-5856-4edd-bf7f-407c3bb67651 tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Aug 27 02:40:57.399691 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a6cb02da-5856-4edd-bf7f-407c3bb67651 tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] Request method failure captured: Aug 27 02:40:57.399691 n-d-852278-4 devstack@n-api.service[134052]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Aug 27 02:40:57.399691 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:40:57.399691 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:40:57.399691 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:40:57.399691 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:40:57.399691 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:40:57.399691 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:40:57.399691 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:40:57.399691 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:40:57.399691 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYQw_VNUmSCv_20TpMEP3_ppldhnIWLmU69XDcYQfj67tX_lE5lVDHgben_DcmvPHwnav4XS3W4R4Pcupx9OYq1E9oH9whRQ2L4RdZtHHBeKr7_pa2Rd9kvWlVmmOKLMcwgvL_46OZuuQeojuAOZIflbS0TzoMt1ZAIyQEXBhZJKuaU Aug 27 02:40:57.399691 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:40:57.399691 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:40:57.399691 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:40:57.399691 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:40:57.399691 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:40:57.399691 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:40:57.399691 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: f7fc8497b19948e8a50cea73d1c73f33 Aug 27 02:40:57.399691 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2116589466 Aug 27 02:40:57.399691 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,admin,member Aug 27 02:40:57.399691 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,admin,member Aug 27 02:40:57.401210 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f7fc8497b19948e8a50cea73d1c73f33"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f7fc8497b19948e8a50cea73d1c73f33", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f7fc8497b19948e8a50cea73d1c73f33"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f7fc8497b19948e8a50cea73d1c73f33"}]}] Aug 27 02:40:57.401210 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2116589466 Aug 27 02:40:57.401210 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: f7fc8497b19948e8a50cea73d1c73f33 Aug 27 02:40:57.401210 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2116589466 Aug 27 02:40:57.401210 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin Aug 27 02:40:57.401210 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:40:57.401210 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:40:57.401210 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: cbedd631dd394e8885bde3503028d3d9 Aug 27 02:40:57.401210 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin Aug 27 02:40:57.401210 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 02:40:57.401210 n-d-852278-4 devstack@n-api.service[134052]: exception: Aggregate -1 could not be found. Aug 27 02:40:57.401210 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '-1'} Aug 27 02:40:57.402060 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:40:57.402060 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:57.402060 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 27 02:40:57.402060 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 27 02:40:57.402060 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 27 02:40:57.402060 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 27 02:40:57.402060 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 02:40:57.402060 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 02:40:57.402060 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 02:40:57.402060 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 02:40:57.402060 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 27 02:40:57.402060 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 27 02:40:57.402060 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6515, in delete_aggregate Aug 27 02:40:57.402060 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 27 02:40:57.402060 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 02:40:57.402060 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 02:40:57.402060 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 27 02:40:57.402060 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 27 02:40:57.402060 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 02:40:57.407386 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 02:40:57.407386 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 27 02:40:57.407386 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 27 02:40:57.407386 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Aug 27 02:40:57.407386 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:57.407386 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:57.407386 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:57.407386 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:57.407386 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:57.407386 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:57.407386 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:40:57.407386 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:40:57.407386 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:40:57.407386 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:40:57.407386 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 27 02:40:57.407386 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:40:57.407386 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Aug 27 02:40:57.407386 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:57.407386 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:57.407386 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:57.407386 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:57.408888 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:57.408888 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:57.408888 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:40:57.408888 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:40:57.408888 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Aug 27 02:40:57.408888 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:57.408888 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a6cb02da-5856-4edd-bf7f-407c3bb67651 tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:40:57.408888 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a6cb02da-5856-4edd-bf7f-407c3bb67651 tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] 10.222.0.70 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.040655 Aug 27 02:40:57.408888 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 181/366] 10.222.0.70 () {58 vars in 1155 bytes} [Sat Aug 27 02:40:57 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 02:40:57.418286 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-4ed64ac7-09b1-46da-973b-aad160f0b0ec tempest-FlavorsAccessNegativeTestJSON-1848628100 tempest-FlavorsAccessNegativeTestJSON-1848628100-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.044510 Aug 27 02:40:57.418434 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-118a52c1-07dc-472d-adf4-19635bd61dc1 tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-280160435"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:57.423459 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 186/367] 10.222.0.70 () {58 vars in 1146 bytes} [Sat Aug 27 02:40:57 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:57.424010 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.aggregate [None req-118a52c1-07dc-472d-adf4-19635bd61dc1 tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] Generated uuid eafd32c2-d2c3-426f-b470-114bdbe36518 for aggregate {{(pid=134052) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 02:40:57.446890 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-87650af3-0604-40cf-8d8c-30accaad4bf6 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:57.447501 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-87650af3-0604-40cf-8d8c-30accaad4bf6 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] [instance: 11661332-bcfc-46f3-a5ba-30eb82448817] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:57.454099 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-87650af3-0604-40cf-8d8c-30accaad4bf6 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:57.454862 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-87650af3-0604-40cf-8d8c-30accaad4bf6 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:57.455291 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-87650af3-0604-40cf-8d8c-30accaad4bf6 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:57.456136 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-87650af3-0604-40cf-8d8c-30accaad4bf6 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:57.456774 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-87650af3-0604-40cf-8d8c-30accaad4bf6 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:57.457335 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-87650af3-0604-40cf-8d8c-30accaad4bf6 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:57.468056 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-118a52c1-07dc-472d-adf4-19635bd61dc1 tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.059363 Aug 27 02:40:57.469618 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 182/368] 10.222.0.70 () {60 vars in 1164 bytes} [Sat Aug 27 02:40:57 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:40:57.485035 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-87650af3-0604-40cf-8d8c-30accaad4bf6 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] HTTP exception thrown: Instance 11661332-bcfc-46f3-a5ba-30eb82448817 could not be found. Aug 27 02:40:57.489934 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-87650af3-0604-40cf-8d8c-30accaad4bf6 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Request method failure captured: Aug 27 02:40:57.489934 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/11661332-bcfc-46f3-a5ba-30eb82448817 HTTP/1.1 Aug 27 02:40:57.489934 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:40:57.489934 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:40:57.489934 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:40:57.489934 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:40:57.489934 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:40:57.489934 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:40:57.489934 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:40:57.489934 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:40:57.489934 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYPuRVcXli1neNmLk_RDz1m6kWIRhIJgpH_2sAx_hcvk788F2tryHwfFm_mCTMiMPnCU-8UQd9jca0EPx7ySPTLVUyKEa0Fz3Hcz_RvhKExHa_SEi5Bexy1V2ASEgYmSppLGPQflpqpOyx7eNx7sayhnmD8E4in1T5xGAGExva-F61w Aug 27 02:40:57.489934 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:40:57.489934 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:40:57.489934 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:40:57.489934 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:40:57.489934 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:40:57.489934 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:40:57.489934 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 5b2f4a529a3e4ea0937ca903dd5924bf Aug 27 02:40:57.489934 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1720754315 Aug 27 02:40:57.489934 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:40:57.489934 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:40:57.491240 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5b2f4a529a3e4ea0937ca903dd5924bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_5b2f4a529a3e4ea0937ca903dd5924bf", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5b2f4a529a3e4ea0937ca903dd5924bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/5b2f4a529a3e4ea0937ca903dd5924bf"}]}] Aug 27 02:40:57.491240 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-DeleteServersAdminTestJSON-1720754315 Aug 27 02:40:57.491240 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 5b2f4a529a3e4ea0937ca903dd5924bf Aug 27 02:40:57.491240 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1720754315 Aug 27 02:40:57.491240 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-DeleteServersAdminTestJSON-1720754315-project Aug 27 02:40:57.491240 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:40:57.491240 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:40:57.491240 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 772e2e66c92e44f8838ce325437d5a48 Aug 27 02:40:57.491240 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-DeleteServersAdminTestJSON-1720754315-project Aug 27 02:40:57.491240 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 02:40:57.491240 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance 11661332-bcfc-46f3-a5ba-30eb82448817 could not be found. Aug 27 02:40:57.491240 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '11661332-bcfc-46f3-a5ba-30eb82448817'} Aug 27 02:40:57.491931 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:40:57.491931 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:57.491931 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:40:57.491931 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:40:57.491931 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:40:57.491931 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:40:57.491931 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:40:57.491931 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:40:57.491931 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:40:57.491931 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:40:57.491931 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11661332-bcfc-46f3-a5ba-30eb82448817 could not be found. Aug 27 02:40:57.491931 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:57.491931 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:57.491931 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:57.491931 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:57.491931 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:57.491931 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:57.491931 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:40:57.491931 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:40:57.491931 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:40:57.493020 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:40:57.493020 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:40:57.493020 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:40:57.493020 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:40:57.493020 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:40:57.493020 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:40:57.493020 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:40:57.493020 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11661332-bcfc-46f3-a5ba-30eb82448817 could not be found. Aug 27 02:40:57.493020 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:57.493020 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:57.493020 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:57.493020 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:57.493020 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:57.493020 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:57.493020 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:40:57.493020 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:40:57.493020 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11661332-bcfc-46f3-a5ba-30eb82448817 could not be found. Aug 27 02:40:57.493020 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:57.494038 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-03039a9d-5545-44de-8418-fcc546bfbde3 tempest-AggregatesAdminNegativeTestJSON-807895525 tempest-AggregatesAdminNegativeTestJSON-807895525-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:57.496582 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-03039a9d-5545-44de-8418-fcc546bfbde3 tempest-AggregatesAdminNegativeTestJSON-807895525 tempest-AggregatesAdminNegativeTestJSON-807895525-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': 'f17b5fa988d64acdbf5e0ffb3d8295c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b33d870157341ba9ba278c0419e5646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:57.499996 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-87650af3-0604-40cf-8d8c-30accaad4bf6 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Returning 404 to user: Instance 11661332-bcfc-46f3-a5ba-30eb82448817 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:40:57.502197 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-03039a9d-5545-44de-8418-fcc546bfbde3 tempest-AggregatesAdminNegativeTestJSON-807895525 tempest-AggregatesAdminNegativeTestJSON-807895525-project] Request method failure captured: Aug 27 02:40:57.502197 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/os-aggregates/16 HTTP/1.1 Aug 27 02:40:57.502197 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:40:57.502197 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:40:57.502197 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:40:57.502197 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:40:57.502197 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:40:57.502197 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:40:57.502197 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:40:57.502197 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:40:57.502197 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYQvuBv6JQonbVquACW5BfJW03Ok7r9cJWaXBSlWenevdcBmUT6NxHe3ISG90l2Au4FTBVbAdKM3n3MgDPiXOLiixJXNloA1Wjh-GyV1vQC5fOrAmbbI-kR7SiNYuturGL7Z_pz2sSXrToir2T2cHQmfMhzhLhOBfpVVvaIcHgwvlZI Aug 27 02:40:57.502197 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:40:57.502197 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:40:57.502197 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:40:57.502197 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:40:57.502197 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:40:57.502197 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:40:57.502197 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 8b33d870157341ba9ba278c0419e5646 Aug 27 02:40:57.502197 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-807895525 Aug 27 02:40:57.502197 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:40:57.502197 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:40:57.503533 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8b33d870157341ba9ba278c0419e5646"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8b33d870157341ba9ba278c0419e5646", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8b33d870157341ba9ba278c0419e5646"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8b33d870157341ba9ba278c0419e5646"}]}] Aug 27 02:40:57.503533 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-807895525 Aug 27 02:40:57.503533 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 8b33d870157341ba9ba278c0419e5646 Aug 27 02:40:57.503533 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-807895525 Aug 27 02:40:57.503533 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-AggregatesAdminNegativeTestJSON-807895525-project Aug 27 02:40:57.503533 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:40:57.503533 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:40:57.503533 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: f17b5fa988d64acdbf5e0ffb3d8295c8 Aug 27 02:40:57.503533 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-807895525-project Aug 27 02:40:57.503533 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 02:40:57.503533 n-d-852278-4 devstack@n-api.service[134052]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 27 02:40:57.503533 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '16'} Aug 27 02:40:57.505698 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:40:57.505698 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:57.505698 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:57.505698 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:57.505698 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:40:57.505698 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:40:57.505698 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:40:57.505698 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:40:57.505698 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Aug 27 02:40:57.505698 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Aug 27 02:40:57.505698 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 02:40:57.505698 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 02:40:57.505698 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 02:40:57.505698 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 02:40:57.505698 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 02:40:57.505698 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 02:40:57.505698 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 02:40:57.505698 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 02:40:57.505698 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 02:40:57.506752 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 02:40:57.506752 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 02:40:57.506752 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 02:40:57.506752 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 02:40:57.506752 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 02:40:57.506752 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 27 02:40:57.506752 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:57.506752 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:57.506752 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:57.506752 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:57.506752 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:57.506752 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:57.506752 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 02:40:57.506752 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 02:40:57.506752 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 27 02:40:57.506752 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:57.506752 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-03039a9d-5545-44de-8418-fcc546bfbde3 tempest-AggregatesAdminNegativeTestJSON-807895525 tempest-AggregatesAdminNegativeTestJSON-807895525-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:40:57.509037 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-03039a9d-5545-44de-8418-fcc546bfbde3 tempest-AggregatesAdminNegativeTestJSON-807895525 tempest-AggregatesAdminNegativeTestJSON-807895525-project] 10.222.0.70 "GET /compute/v2.1/os-aggregates/16" status: 403 len: 114 microversion: 2.1 time: 0.027152 Aug 27 02:40:57.509037 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 183/369] 10.222.0.70 () {58 vars in 1152 bytes} [Sat Aug 27 02:40:57 2022] GET /compute/v2.1/os-aggregates/16 => generated 114 bytes in 28 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:40:57.510126 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-87650af3-0604-40cf-8d8c-30accaad4bf6 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] 10.222.0.70 "GET /compute/v2.1/servers/11661332-bcfc-46f3-a5ba-30eb82448817" status: 404 len: 111 microversion: 2.1 time: 0.067357 Aug 27 02:40:57.511466 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 187/370] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:57 2022] GET /compute/v2.1/servers/11661332-bcfc-46f3-a5ba-30eb82448817 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 02:40:57.522744 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-84534d88-3288-4de6-8e81-6dc69a788fef tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:57.523232 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-84534d88-3288-4de6-8e81-6dc69a788fef tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] [instance: 11661332-bcfc-46f3-a5ba-30eb82448817] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:57.534171 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4d5b665d-b996-44e0-92b2-73f4cb1508c1 tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:57.554403 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-84534d88-3288-4de6-8e81-6dc69a788fef tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:57.554913 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-84534d88-3288-4de6-8e81-6dc69a788fef tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:57.555568 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-84534d88-3288-4de6-8e81-6dc69a788fef tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:57.567255 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-84534d88-3288-4de6-8e81-6dc69a788fef tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:57.567802 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-84534d88-3288-4de6-8e81-6dc69a788fef tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:57.568249 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-84534d88-3288-4de6-8e81-6dc69a788fef tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:57.615219 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-4d5b665d-b996-44e0-92b2-73f4cb1508c1 tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] 10.222.0.70 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.101144 Aug 27 02:40:57.625336 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 184/371] 10.222.0.70 () {58 vars in 1155 bytes} [Sat Aug 27 02:40:57 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 27 02:40:57.637744 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-84534d88-3288-4de6-8e81-6dc69a788fef tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] HTTP exception thrown: Instance 11661332-bcfc-46f3-a5ba-30eb82448817 could not be found. Aug 27 02:40:57.639344 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-84534d88-3288-4de6-8e81-6dc69a788fef tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Request method failure captured: Aug 27 02:40:57.639344 n-d-852278-4 devstack@n-api.service[134051]: request: DELETE /compute/v2.1/servers/11661332-bcfc-46f3-a5ba-30eb82448817 HTTP/1.1 Aug 27 02:40:57.639344 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:40:57.639344 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:40:57.639344 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:40:57.639344 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:40:57.639344 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:40:57.639344 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:40:57.639344 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:40:57.639344 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:40:57.639344 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYPuRVcXli1neNmLk_RDz1m6kWIRhIJgpH_2sAx_hcvk788F2tryHwfFm_mCTMiMPnCU-8UQd9jca0EPx7ySPTLVUyKEa0Fz3Hcz_RvhKExHa_SEi5Bexy1V2ASEgYmSppLGPQflpqpOyx7eNx7sayhnmD8E4in1T5xGAGExva-F61w Aug 27 02:40:57.639344 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:40:57.639344 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:40:57.639344 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:40:57.639344 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:40:57.639344 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:40:57.639344 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:40:57.639344 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 5b2f4a529a3e4ea0937ca903dd5924bf Aug 27 02:40:57.639344 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1720754315 Aug 27 02:40:57.639344 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:40:57.639344 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:40:57.640762 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5b2f4a529a3e4ea0937ca903dd5924bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_5b2f4a529a3e4ea0937ca903dd5924bf", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5b2f4a529a3e4ea0937ca903dd5924bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/5b2f4a529a3e4ea0937ca903dd5924bf"}]}] Aug 27 02:40:57.640762 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-DeleteServersAdminTestJSON-1720754315 Aug 27 02:40:57.640762 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 5b2f4a529a3e4ea0937ca903dd5924bf Aug 27 02:40:57.640762 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1720754315 Aug 27 02:40:57.640762 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-DeleteServersAdminTestJSON-1720754315-project Aug 27 02:40:57.640762 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:40:57.640762 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:40:57.640762 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 772e2e66c92e44f8838ce325437d5a48 Aug 27 02:40:57.640762 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-DeleteServersAdminTestJSON-1720754315-project Aug 27 02:40:57.640762 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 02:40:57.640762 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance 11661332-bcfc-46f3-a5ba-30eb82448817 could not be found. Aug 27 02:40:57.640762 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '11661332-bcfc-46f3-a5ba-30eb82448817'} Aug 27 02:40:57.641656 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:40:57.641656 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:57.641656 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:40:57.641656 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:40:57.641656 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:40:57.641656 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:40:57.641656 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:40:57.641656 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:40:57.641656 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:40:57.641656 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:40:57.641656 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11661332-bcfc-46f3-a5ba-30eb82448817 could not be found. Aug 27 02:40:57.641656 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:57.641656 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:57.641656 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:57.641656 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:57.641656 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:57.641656 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:57.641656 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:40:57.641656 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:40:57.641656 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:40:57.642914 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:40:57.642914 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 02:40:57.642914 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 02:40:57.642914 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 02:40:57.642914 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 02:40:57.642914 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:40:57.642914 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:40:57.642914 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:40:57.642914 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:40:57.642914 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11661332-bcfc-46f3-a5ba-30eb82448817 could not be found. Aug 27 02:40:57.642914 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:57.642914 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:57.642914 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:57.642914 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:57.642914 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:57.642914 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:57.642914 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:40:57.642914 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:40:57.642914 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11661332-bcfc-46f3-a5ba-30eb82448817 could not be found. Aug 27 02:40:57.642914 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:57.644168 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-84534d88-3288-4de6-8e81-6dc69a788fef tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Returning 404 to user: Instance 11661332-bcfc-46f3-a5ba-30eb82448817 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:40:57.644168 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-84534d88-3288-4de6-8e81-6dc69a788fef tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] 10.222.0.70 "DELETE /compute/v2.1/servers/11661332-bcfc-46f3-a5ba-30eb82448817" status: 404 len: 111 microversion: 2.1 time: 0.121892 Aug 27 02:40:57.648483 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8a9bf158-1695-4df2-818a-597089ba76dc tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:57.653085 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 188/372] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:40:57 2022] DELETE /compute/v2.1/servers/11661332-bcfc-46f3-a5ba-30eb82448817 => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:40:57.658391 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-069bf144-a835-4a87-b56b-1effc6dec211 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:57.659136 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-069bf144-a835-4a87-b56b-1effc6dec211 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] [instance: 11661332-bcfc-46f3-a5ba-30eb82448817] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:57.670766 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-8a9bf158-1695-4df2-818a-597089ba76dc tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Aug 27 02:40:57.676215 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8a9bf158-1695-4df2-818a-597089ba76dc tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] Request method failure captured: Aug 27 02:40:57.676215 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Aug 27 02:40:57.676215 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:40:57.676215 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:40:57.676215 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:40:57.676215 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:40:57.676215 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:40:57.676215 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:40:57.676215 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:40:57.676215 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:40:57.676215 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYQw_VNUmSCv_20TpMEP3_ppldhnIWLmU69XDcYQfj67tX_lE5lVDHgben_DcmvPHwnav4XS3W4R4Pcupx9OYq1E9oH9whRQ2L4RdZtHHBeKr7_pa2Rd9kvWlVmmOKLMcwgvL_46OZuuQeojuAOZIflbS0TzoMt1ZAIyQEXBhZJKuaU Aug 27 02:40:57.676215 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:40:57.676215 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:40:57.676215 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:40:57.676215 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:40:57.676215 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:40:57.676215 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:40:57.676215 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: f7fc8497b19948e8a50cea73d1c73f33 Aug 27 02:40:57.676215 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2116589466 Aug 27 02:40:57.676215 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,admin,member Aug 27 02:40:57.676215 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,admin,member Aug 27 02:40:57.677647 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f7fc8497b19948e8a50cea73d1c73f33"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f7fc8497b19948e8a50cea73d1c73f33", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f7fc8497b19948e8a50cea73d1c73f33"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f7fc8497b19948e8a50cea73d1c73f33"}]}] Aug 27 02:40:57.677647 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2116589466 Aug 27 02:40:57.677647 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: f7fc8497b19948e8a50cea73d1c73f33 Aug 27 02:40:57.677647 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2116589466 Aug 27 02:40:57.677647 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin Aug 27 02:40:57.677647 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:40:57.677647 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:40:57.677647 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: cbedd631dd394e8885bde3503028d3d9 Aug 27 02:40:57.677647 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin Aug 27 02:40:57.677647 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 02:40:57.677647 n-d-852278-4 devstack@n-api.service[134052]: exception: Aggregate -1 could not be found. Aug 27 02:40:57.677647 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '-1'} Aug 27 02:40:57.678610 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:40:57.678610 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:57.678610 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 27 02:40:57.678610 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 27 02:40:57.678610 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6462, in get_aggregate Aug 27 02:40:57.678610 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 27 02:40:57.678610 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 02:40:57.678610 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 02:40:57.678610 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 27 02:40:57.678610 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 27 02:40:57.678610 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 02:40:57.678610 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 02:40:57.678610 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 27 02:40:57.678610 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 27 02:40:57.678610 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Aug 27 02:40:57.678610 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:57.678610 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:57.678610 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:57.678610 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:57.678610 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:57.679844 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:57.679844 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:40:57.679844 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:40:57.679844 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:40:57.679844 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:40:57.679844 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 27 02:40:57.679844 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:40:57.679844 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Aug 27 02:40:57.679844 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:57.679844 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:57.679844 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:57.679844 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:57.679844 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:57.679844 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:57.679844 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:40:57.679844 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:40:57.679844 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Aug 27 02:40:57.679844 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:57.682121 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8a9bf158-1695-4df2-818a-597089ba76dc tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:40:57.685205 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-8a9bf158-1695-4df2-818a-597089ba76dc tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] 10.222.0.70 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.056904 Aug 27 02:40:57.693007 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 185/373] 10.222.0.70 () {58 vars in 1152 bytes} [Sat Aug 27 02:40:57 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 02:40:57.701143 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-069bf144-a835-4a87-b56b-1effc6dec211 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:57.705029 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-18a68d86-2757-4dd3-941c-2b9ad2cd3e11 tempest-AggregatesAdminNegativeTestJSON-807895525 tempest-AggregatesAdminNegativeTestJSON-807895525-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:57.706031 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-069bf144-a835-4a87-b56b-1effc6dec211 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:57.706663 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-069bf144-a835-4a87-b56b-1effc6dec211 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:57.707576 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-069bf144-a835-4a87-b56b-1effc6dec211 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:57.708896 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-069bf144-a835-4a87-b56b-1effc6dec211 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:57.712629 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-069bf144-a835-4a87-b56b-1effc6dec211 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:57.717476 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-18a68d86-2757-4dd3-941c-2b9ad2cd3e11 tempest-AggregatesAdminNegativeTestJSON-807895525 tempest-AggregatesAdminNegativeTestJSON-807895525-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': 'f17b5fa988d64acdbf5e0ffb3d8295c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b33d870157341ba9ba278c0419e5646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:57.723505 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-18a68d86-2757-4dd3-941c-2b9ad2cd3e11 tempest-AggregatesAdminNegativeTestJSON-807895525 tempest-AggregatesAdminNegativeTestJSON-807895525-project] Request method failure captured: Aug 27 02:40:57.723505 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Aug 27 02:40:57.723505 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:40:57.723505 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:40:57.723505 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:40:57.723505 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:40:57.723505 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:40:57.723505 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:40:57.723505 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:40:57.723505 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:40:57.723505 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYQvuBv6JQonbVquACW5BfJW03Ok7r9cJWaXBSlWenevdcBmUT6NxHe3ISG90l2Au4FTBVbAdKM3n3MgDPiXOLiixJXNloA1Wjh-GyV1vQC5fOrAmbbI-kR7SiNYuturGL7Z_pz2sSXrToir2T2cHQmfMhzhLhOBfpVVvaIcHgwvlZI Aug 27 02:40:57.723505 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:40:57.723505 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:40:57.723505 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:40:57.723505 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:40:57.723505 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:40:57.723505 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:40:57.723505 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 8b33d870157341ba9ba278c0419e5646 Aug 27 02:40:57.723505 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-807895525 Aug 27 02:40:57.723505 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:40:57.723505 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:40:57.724872 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8b33d870157341ba9ba278c0419e5646"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8b33d870157341ba9ba278c0419e5646", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8b33d870157341ba9ba278c0419e5646"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8b33d870157341ba9ba278c0419e5646"}]}] Aug 27 02:40:57.724872 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-807895525 Aug 27 02:40:57.724872 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 8b33d870157341ba9ba278c0419e5646 Aug 27 02:40:57.724872 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-807895525 Aug 27 02:40:57.724872 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-AggregatesAdminNegativeTestJSON-807895525-project Aug 27 02:40:57.724872 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:40:57.724872 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:40:57.724872 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: f17b5fa988d64acdbf5e0ffb3d8295c8 Aug 27 02:40:57.724872 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-807895525-project Aug 27 02:40:57.724872 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 02:40:57.724872 n-d-852278-4 devstack@n-api.service[134052]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 27 02:40:57.724872 n-d-852278-4 devstack@n-api.service[134052]: action_args: {} Aug 27 02:40:57.725523 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:40:57.725523 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:57.725523 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:57.725523 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:57.725523 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:40:57.725523 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:40:57.725523 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:40:57.725523 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:40:57.725523 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Aug 27 02:40:57.725523 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Aug 27 02:40:57.725523 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 02:40:57.725523 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 02:40:57.725523 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 02:40:57.725523 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 02:40:57.725523 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 02:40:57.725523 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 02:40:57.725523 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 02:40:57.725523 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 02:40:57.725523 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 02:40:57.726534 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 02:40:57.726534 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 02:40:57.726534 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 02:40:57.726534 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 02:40:57.726534 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 02:40:57.726534 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 27 02:40:57.726534 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:57.726534 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:57.726534 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:57.726534 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:57.726534 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:57.726534 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:57.726534 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 02:40:57.726534 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 02:40:57.726534 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 27 02:40:57.726534 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:57.733200 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-18a68d86-2757-4dd3-941c-2b9ad2cd3e11 tempest-AggregatesAdminNegativeTestJSON-807895525 tempest-AggregatesAdminNegativeTestJSON-807895525-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:40:57.736226 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-18a68d86-2757-4dd3-941c-2b9ad2cd3e11 tempest-AggregatesAdminNegativeTestJSON-807895525 tempest-AggregatesAdminNegativeTestJSON-807895525-project] 10.222.0.70 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.037036 Aug 27 02:40:57.744879 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 186/374] 10.222.0.70 () {58 vars in 1143 bytes} [Sat Aug 27 02:40:57 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 51 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:40:57.752732 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-1af484d4-fb9a-4164-9223-f9d7eeafb09c tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1363859766"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:57.757047 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.aggregate [None req-1af484d4-fb9a-4164-9223-f9d7eeafb09c tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] Generated uuid a33c795b-c4ff-4f25-b4af-b4bf6b22556c for aggregate {{(pid=134052) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 02:40:57.762604 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-069bf144-a835-4a87-b56b-1effc6dec211 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] HTTP exception thrown: Instance 11661332-bcfc-46f3-a5ba-30eb82448817 could not be found. Aug 27 02:40:57.768853 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-069bf144-a835-4a87-b56b-1effc6dec211 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Request method failure captured: Aug 27 02:40:57.768853 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/11661332-bcfc-46f3-a5ba-30eb82448817 HTTP/1.1 Aug 27 02:40:57.768853 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:40:57.768853 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:40:57.768853 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:40:57.768853 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:40:57.768853 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:40:57.768853 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:40:57.768853 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:40:57.768853 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:40:57.768853 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYPuRVcXli1neNmLk_RDz1m6kWIRhIJgpH_2sAx_hcvk788F2tryHwfFm_mCTMiMPnCU-8UQd9jca0EPx7ySPTLVUyKEa0Fz3Hcz_RvhKExHa_SEi5Bexy1V2ASEgYmSppLGPQflpqpOyx7eNx7sayhnmD8E4in1T5xGAGExva-F61w Aug 27 02:40:57.768853 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:40:57.768853 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:40:57.768853 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:40:57.768853 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:40:57.768853 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:40:57.768853 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:40:57.768853 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 5b2f4a529a3e4ea0937ca903dd5924bf Aug 27 02:40:57.768853 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1720754315 Aug 27 02:40:57.768853 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:40:57.768853 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:40:57.770071 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5b2f4a529a3e4ea0937ca903dd5924bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_5b2f4a529a3e4ea0937ca903dd5924bf", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5b2f4a529a3e4ea0937ca903dd5924bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/5b2f4a529a3e4ea0937ca903dd5924bf"}]}] Aug 27 02:40:57.770071 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-DeleteServersAdminTestJSON-1720754315 Aug 27 02:40:57.770071 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 5b2f4a529a3e4ea0937ca903dd5924bf Aug 27 02:40:57.770071 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1720754315 Aug 27 02:40:57.770071 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-DeleteServersAdminTestJSON-1720754315-project Aug 27 02:40:57.770071 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:40:57.770071 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:40:57.770071 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 772e2e66c92e44f8838ce325437d5a48 Aug 27 02:40:57.770071 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-DeleteServersAdminTestJSON-1720754315-project Aug 27 02:40:57.770071 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 02:40:57.770071 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance 11661332-bcfc-46f3-a5ba-30eb82448817 could not be found. Aug 27 02:40:57.770071 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '11661332-bcfc-46f3-a5ba-30eb82448817'} Aug 27 02:40:57.770800 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:40:57.770800 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:57.770800 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:40:57.770800 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:40:57.770800 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:40:57.770800 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:40:57.770800 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:40:57.770800 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:40:57.770800 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:40:57.770800 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:40:57.770800 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11661332-bcfc-46f3-a5ba-30eb82448817 could not be found. Aug 27 02:40:57.770800 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:57.770800 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:57.770800 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:57.770800 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:57.770800 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:57.770800 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:57.770800 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:40:57.770800 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:40:57.770800 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:40:57.771849 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:40:57.771849 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:40:57.771849 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:40:57.771849 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:40:57.771849 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:40:57.771849 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:40:57.771849 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:40:57.771849 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11661332-bcfc-46f3-a5ba-30eb82448817 could not be found. Aug 27 02:40:57.771849 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:57.771849 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:57.771849 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:57.771849 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:57.771849 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:57.771849 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:57.771849 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:40:57.771849 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:40:57.771849 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11661332-bcfc-46f3-a5ba-30eb82448817 could not be found. Aug 27 02:40:57.771849 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:57.772857 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-069bf144-a835-4a87-b56b-1effc6dec211 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Returning 404 to user: Instance 11661332-bcfc-46f3-a5ba-30eb82448817 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:40:57.772857 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-069bf144-a835-4a87-b56b-1effc6dec211 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] 10.222.0.70 "GET /compute/v2.1/servers/11661332-bcfc-46f3-a5ba-30eb82448817" status: 404 len: 111 microversion: 2.1 time: 0.118159 Aug 27 02:40:57.784781 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 189/375] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:57 2022] GET /compute/v2.1/servers/11661332-bcfc-46f3-a5ba-30eb82448817 => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:40:57.801116 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-1af484d4-fb9a-4164-9223-f9d7eeafb09c tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.054129 Aug 27 02:40:57.801523 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-276d0c48-5bc2-4447-af99-58fe028c3210 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:57.803084 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-276d0c48-5bc2-4447-af99-58fe028c3210 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] [instance: 459d7a41-f50d-4ffe-a184-c0a12437669a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:57.809571 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 187/376] 10.222.0.70 () {60 vars in 1164 bytes} [Sat Aug 27 02:40:57 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:40:57.824636 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e633acad-634b-4f08-9fd6-054c1498c89f tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:57.825829 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-e633acad-634b-4f08-9fd6-054c1498c89f tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] [instance: 96881762-a0a0-425f-a3b6-cc87adbae319] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:57.842661 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e633acad-634b-4f08-9fd6-054c1498c89f tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:57.843698 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-276d0c48-5bc2-4447-af99-58fe028c3210 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:57.845306 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e633acad-634b-4f08-9fd6-054c1498c89f tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:57.846434 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e633acad-634b-4f08-9fd6-054c1498c89f tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:57.847854 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e633acad-634b-4f08-9fd6-054c1498c89f tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:57.850409 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-276d0c48-5bc2-4447-af99-58fe028c3210 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:57.851163 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e633acad-634b-4f08-9fd6-054c1498c89f tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:57.851817 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e633acad-634b-4f08-9fd6-054c1498c89f tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:57.852727 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-276d0c48-5bc2-4447-af99-58fe028c3210 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:57.853493 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-276d0c48-5bc2-4447-af99-58fe028c3210 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:57.861227 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-276d0c48-5bc2-4447-af99-58fe028c3210 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:57.861765 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-276d0c48-5bc2-4447-af99-58fe028c3210 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:57.924682 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-276d0c48-5bc2-4447-af99-58fe028c3210 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] HTTP exception thrown: Instance 459d7a41-f50d-4ffe-a184-c0a12437669a could not be found. Aug 27 02:40:57.930540 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-276d0c48-5bc2-4447-af99-58fe028c3210 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Request method failure captured: Aug 27 02:40:57.930540 n-d-852278-4 devstack@n-api.service[134051]: request: DELETE /compute/v2.1/servers/459d7a41-f50d-4ffe-a184-c0a12437669a HTTP/1.1 Aug 27 02:40:57.930540 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:40:57.930540 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:40:57.930540 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:40:57.930540 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:40:57.930540 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:40:57.930540 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:40:57.930540 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:40:57.930540 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:40:57.930540 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYPuRVcXli1neNmLk_RDz1m6kWIRhIJgpH_2sAx_hcvk788F2tryHwfFm_mCTMiMPnCU-8UQd9jca0EPx7ySPTLVUyKEa0Fz3Hcz_RvhKExHa_SEi5Bexy1V2ASEgYmSppLGPQflpqpOyx7eNx7sayhnmD8E4in1T5xGAGExva-F61w Aug 27 02:40:57.930540 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:40:57.930540 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:40:57.930540 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:40:57.930540 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:40:57.930540 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:40:57.930540 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:40:57.930540 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 5b2f4a529a3e4ea0937ca903dd5924bf Aug 27 02:40:57.930540 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1720754315 Aug 27 02:40:57.930540 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:40:57.930540 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:40:57.931977 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5b2f4a529a3e4ea0937ca903dd5924bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_5b2f4a529a3e4ea0937ca903dd5924bf", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5b2f4a529a3e4ea0937ca903dd5924bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/5b2f4a529a3e4ea0937ca903dd5924bf"}]}] Aug 27 02:40:57.931977 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-DeleteServersAdminTestJSON-1720754315 Aug 27 02:40:57.931977 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 5b2f4a529a3e4ea0937ca903dd5924bf Aug 27 02:40:57.931977 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1720754315 Aug 27 02:40:57.931977 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-DeleteServersAdminTestJSON-1720754315-project Aug 27 02:40:57.931977 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:40:57.931977 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:40:57.931977 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 772e2e66c92e44f8838ce325437d5a48 Aug 27 02:40:57.931977 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-DeleteServersAdminTestJSON-1720754315-project Aug 27 02:40:57.931977 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 02:40:57.931977 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance 459d7a41-f50d-4ffe-a184-c0a12437669a could not be found. Aug 27 02:40:57.931977 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '459d7a41-f50d-4ffe-a184-c0a12437669a'} Aug 27 02:40:57.932813 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:40:57.932813 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:57.932813 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:40:57.932813 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:40:57.932813 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:40:57.932813 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:40:57.932813 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:40:57.932813 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:40:57.932813 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:40:57.932813 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:40:57.932813 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 459d7a41-f50d-4ffe-a184-c0a12437669a could not be found. Aug 27 02:40:57.932813 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:57.932813 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:57.932813 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:57.932813 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:57.932813 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:57.932813 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:57.932813 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:40:57.932813 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:40:57.932813 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:40:57.934141 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:40:57.934141 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 02:40:57.934141 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 02:40:57.934141 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 02:40:57.934141 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 02:40:57.934141 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:40:57.934141 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:40:57.934141 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:40:57.934141 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:40:57.934141 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 459d7a41-f50d-4ffe-a184-c0a12437669a could not be found. Aug 27 02:40:57.934141 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:57.934141 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:57.934141 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:57.934141 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:57.934141 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:57.934141 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:57.934141 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:40:57.934141 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:40:57.934141 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 459d7a41-f50d-4ffe-a184-c0a12437669a could not be found. Aug 27 02:40:57.934141 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:57.938151 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-276d0c48-5bc2-4447-af99-58fe028c3210 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Returning 404 to user: Instance 459d7a41-f50d-4ffe-a184-c0a12437669a could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:40:57.941671 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-276d0c48-5bc2-4447-af99-58fe028c3210 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] 10.222.0.70 "DELETE /compute/v2.1/servers/459d7a41-f50d-4ffe-a184-c0a12437669a" status: 404 len: 111 microversion: 2.1 time: 0.153145 Aug 27 02:40:57.942812 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 190/377] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:40:57 2022] DELETE /compute/v2.1/servers/459d7a41-f50d-4ffe-a184-c0a12437669a => generated 111 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 02:40:57.953835 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-14478789-ba42-417f-a94f-978ec4b466ad tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-852278-4"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:58.002285 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-14478789-ba42-417f-a94f-978ec4b466ad tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:58.002285 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-14478789-ba42-417f-a94f-978ec4b466ad tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:58.002285 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-14478789-ba42-417f-a94f-978ec4b466ad tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:58.239969 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-e633acad-634b-4f08-9fd6-054c1498c89f tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68711ff38ec41c0b051124527c7ac35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae179f416c451e92e270d2cb0f4400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:58.241161 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-14478789-ba42-417f-a94f-978ec4b466ad tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 243 microversion: 2.1 time: 0.295152 Aug 27 02:40:58.241847 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 191/378] 10.222.0.70 () {60 vars in 1194 bytes} [Sat Aug 27 02:40:57 2022] POST /compute/v2.1/os-aggregates/17/action => generated 243 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:40:58.247996 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e939b392-b810-4b13-b925-f24960de5069 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:58.247996 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-e939b392-b810-4b13-b925-f24960de5069 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] [instance: 459d7a41-f50d-4ffe-a184-c0a12437669a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:58.258586 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e633acad-634b-4f08-9fd6-054c1498c89f tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] 10.222.0.70 "GET /compute/v2.1/servers/96881762-a0a0-425f-a3b6-cc87adbae319" status: 200 len: 1459 microversion: 2.1 time: 0.447643 Aug 27 02:40:58.259055 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e939b392-b810-4b13-b925-f24960de5069 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:58.259547 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e939b392-b810-4b13-b925-f24960de5069 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:58.259981 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e939b392-b810-4b13-b925-f24960de5069 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:58.260886 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e939b392-b810-4b13-b925-f24960de5069 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:58.261335 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e939b392-b810-4b13-b925-f24960de5069 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:58.261754 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e939b392-b810-4b13-b925-f24960de5069 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:58.264676 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 188/379] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:57 2022] GET /compute/v2.1/servers/96881762-a0a0-425f-a3b6-cc87adbae319 => generated 1459 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:58.276906 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-e939b392-b810-4b13-b925-f24960de5069 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] HTTP exception thrown: Instance 459d7a41-f50d-4ffe-a184-c0a12437669a could not be found. Aug 27 02:40:58.278551 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e939b392-b810-4b13-b925-f24960de5069 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Request method failure captured: Aug 27 02:40:58.278551 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/459d7a41-f50d-4ffe-a184-c0a12437669a HTTP/1.1 Aug 27 02:40:58.278551 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:40:58.278551 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:40:58.278551 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:40:58.278551 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:40:58.278551 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:40:58.278551 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:40:58.278551 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:40:58.278551 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:40:58.278551 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYPuRVcXli1neNmLk_RDz1m6kWIRhIJgpH_2sAx_hcvk788F2tryHwfFm_mCTMiMPnCU-8UQd9jca0EPx7ySPTLVUyKEa0Fz3Hcz_RvhKExHa_SEi5Bexy1V2ASEgYmSppLGPQflpqpOyx7eNx7sayhnmD8E4in1T5xGAGExva-F61w Aug 27 02:40:58.278551 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:40:58.278551 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:40:58.278551 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:40:58.278551 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:40:58.278551 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:40:58.278551 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:40:58.278551 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 5b2f4a529a3e4ea0937ca903dd5924bf Aug 27 02:40:58.278551 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1720754315 Aug 27 02:40:58.278551 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:40:58.278551 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:40:58.279761 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5b2f4a529a3e4ea0937ca903dd5924bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_5b2f4a529a3e4ea0937ca903dd5924bf", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5b2f4a529a3e4ea0937ca903dd5924bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/5b2f4a529a3e4ea0937ca903dd5924bf"}]}] Aug 27 02:40:58.279761 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-DeleteServersAdminTestJSON-1720754315 Aug 27 02:40:58.279761 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 5b2f4a529a3e4ea0937ca903dd5924bf Aug 27 02:40:58.279761 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1720754315 Aug 27 02:40:58.279761 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-DeleteServersAdminTestJSON-1720754315-project Aug 27 02:40:58.279761 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:40:58.279761 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:40:58.279761 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 772e2e66c92e44f8838ce325437d5a48 Aug 27 02:40:58.279761 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-DeleteServersAdminTestJSON-1720754315-project Aug 27 02:40:58.279761 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 02:40:58.279761 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance 459d7a41-f50d-4ffe-a184-c0a12437669a could not be found. Aug 27 02:40:58.279761 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '459d7a41-f50d-4ffe-a184-c0a12437669a'} Aug 27 02:40:58.283843 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:40:58.283843 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:58.283843 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:40:58.283843 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:40:58.283843 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:40:58.283843 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:40:58.283843 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:40:58.283843 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:40:58.283843 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:40:58.283843 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:40:58.283843 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 459d7a41-f50d-4ffe-a184-c0a12437669a could not be found. Aug 27 02:40:58.283843 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:58.283843 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:58.283843 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:58.283843 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:58.283843 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:58.283843 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:58.283843 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:40:58.283843 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:40:58.283843 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:40:58.285285 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:40:58.285285 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:40:58.285285 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:40:58.285285 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:40:58.285285 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:40:58.285285 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:40:58.285285 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:40:58.285285 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 459d7a41-f50d-4ffe-a184-c0a12437669a could not be found. Aug 27 02:40:58.285285 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:58.285285 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:58.285285 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:58.285285 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:58.285285 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:58.285285 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:58.285285 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:40:58.285285 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:40:58.285285 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 459d7a41-f50d-4ffe-a184-c0a12437669a could not be found. Aug 27 02:40:58.285285 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:58.286648 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e939b392-b810-4b13-b925-f24960de5069 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] Returning 404 to user: Instance 459d7a41-f50d-4ffe-a184-c0a12437669a could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:40:58.286648 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e939b392-b810-4b13-b925-f24960de5069 tempest-DeleteServersAdminTestJSON-1720754315 tempest-DeleteServersAdminTestJSON-1720754315-project] 10.222.0.70 "GET /compute/v2.1/servers/459d7a41-f50d-4ffe-a184-c0a12437669a" status: 404 len: 111 microversion: 2.1 time: 0.037133 Aug 27 02:40:58.286648 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 192/380] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:58 2022] GET /compute/v2.1/servers/459d7a41-f50d-4ffe-a184-c0a12437669a => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:40:58.286648 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-de4cdbba-c6f3-45ac-86b1-737e54cc511c tempest-AggregatesAdminNegativeTestJSON-807895525 tempest-AggregatesAdminNegativeTestJSON-807895525-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-852278-4"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:58.289416 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-de4cdbba-c6f3-45ac-86b1-737e54cc511c tempest-AggregatesAdminNegativeTestJSON-807895525 tempest-AggregatesAdminNegativeTestJSON-807895525-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': 'f17b5fa988d64acdbf5e0ffb3d8295c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b33d870157341ba9ba278c0419e5646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:58.291156 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-de4cdbba-c6f3-45ac-86b1-737e54cc511c tempest-AggregatesAdminNegativeTestJSON-807895525 tempest-AggregatesAdminNegativeTestJSON-807895525-project] Request method failure captured: Aug 27 02:40:58.291156 n-d-852278-4 devstack@n-api.service[134051]: request: POST /compute/v2.1/os-aggregates/17/action HTTP/1.1 Aug 27 02:40:58.291156 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:40:58.291156 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:40:58.291156 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:40:58.291156 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 42 Aug 27 02:40:58.291156 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:40:58.291156 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:40:58.291156 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:40:58.291156 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:40:58.291156 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYQvuBv6JQonbVquACW5BfJW03Ok7r9cJWaXBSlWenevdcBmUT6NxHe3ISG90l2Au4FTBVbAdKM3n3MgDPiXOLiixJXNloA1Wjh-GyV1vQC5fOrAmbbI-kR7SiNYuturGL7Z_pz2sSXrToir2T2cHQmfMhzhLhOBfpVVvaIcHgwvlZI Aug 27 02:40:58.291156 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:40:58.291156 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:40:58.291156 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:40:58.291156 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:40:58.291156 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:40:58.291156 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:40:58.291156 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 8b33d870157341ba9ba278c0419e5646 Aug 27 02:40:58.291156 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-807895525 Aug 27 02:40:58.291156 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:40:58.291156 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:40:58.292382 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8b33d870157341ba9ba278c0419e5646"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8b33d870157341ba9ba278c0419e5646", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8b33d870157341ba9ba278c0419e5646"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8b33d870157341ba9ba278c0419e5646"}]}] Aug 27 02:40:58.292382 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-807895525 Aug 27 02:40:58.292382 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 8b33d870157341ba9ba278c0419e5646 Aug 27 02:40:58.292382 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-807895525 Aug 27 02:40:58.292382 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-AggregatesAdminNegativeTestJSON-807895525-project Aug 27 02:40:58.292382 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:40:58.292382 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:40:58.292382 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: f17b5fa988d64acdbf5e0ffb3d8295c8 Aug 27 02:40:58.292382 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-807895525-project Aug 27 02:40:58.292382 n-d-852278-4 devstack@n-api.service[134051]: Aug 27 02:40:58.292382 n-d-852278-4 devstack@n-api.service[134051]: {"remove_host": {"host": "n-h2-852278-4"}} Aug 27 02:40:58.292382 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 02:40:58.292382 n-d-852278-4 devstack@n-api.service[134051]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 27 02:40:58.296575 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '17', 'body': {'remove_host': {'host': 'n-h2-852278-4'}}} Aug 27 02:40:58.296575 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:40:58.296575 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:58.296575 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:58.296575 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:58.296575 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:40:58.296575 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:40:58.296575 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:40:58.296575 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:40:58.296575 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:40:58.296575 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:40:58.296575 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Aug 27 02:40:58.296575 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Aug 27 02:40:58.296575 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 02:40:58.296575 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 02:40:58.296575 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 02:40:58.296575 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 02:40:58.296575 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 02:40:58.296575 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 02:40:58.297795 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 02:40:58.297795 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 02:40:58.297795 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 02:40:58.297795 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 02:40:58.297795 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 02:40:58.297795 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 02:40:58.297795 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 02:40:58.297795 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 02:40:58.297795 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 27 02:40:58.297795 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:58.297795 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:58.297795 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:58.297795 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:58.297795 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:58.297795 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:58.297795 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 02:40:58.297795 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 02:40:58.297795 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 27 02:40:58.297795 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:40:58.298835 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-de4cdbba-c6f3-45ac-86b1-737e54cc511c tempest-AggregatesAdminNegativeTestJSON-807895525 tempest-AggregatesAdminNegativeTestJSON-807895525-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:40:58.298835 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-de4cdbba-c6f3-45ac-86b1-737e54cc511c tempest-AggregatesAdminNegativeTestJSON-807895525 tempest-AggregatesAdminNegativeTestJSON-807895525-project] 10.222.0.70 "POST /compute/v2.1/os-aggregates/17/action" status: 403 len: 121 microversion: 2.1 time: 0.010507 Aug 27 02:40:58.298835 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 193/381] 10.222.0.70 () {60 vars in 1194 bytes} [Sat Aug 27 02:40:58 2022] POST /compute/v2.1/os-aggregates/17/action => generated 121 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:40:58.298835 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-eaeff5d2-935e-4acf-a6b4-2d0e5124a29b tempest-LiveMigrationNegativeTest-1402864585 tempest-LiveMigrationNegativeTest-1402864585-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:58.299083 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-eaeff5d2-935e-4acf-a6b4-2d0e5124a29b tempest-LiveMigrationNegativeTest-1402864585 tempest-LiveMigrationNegativeTest-1402864585-project-admin] [instance: 96881762-a0a0-425f-a3b6-cc87adbae319] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:58.304264 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c0aa34d1-fd7a-43ee-82b2-ea5adeba73da tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:58.305625 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-c0aa34d1-fd7a-43ee-82b2-ea5adeba73da tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: bb513027-efc1-4201-812f-39c88b423a9d] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:58.307013 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eaeff5d2-935e-4acf-a6b4-2d0e5124a29b tempest-LiveMigrationNegativeTest-1402864585 tempest-LiveMigrationNegativeTest-1402864585-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:58.307507 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eaeff5d2-935e-4acf-a6b4-2d0e5124a29b tempest-LiveMigrationNegativeTest-1402864585 tempest-LiveMigrationNegativeTest-1402864585-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:58.307947 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eaeff5d2-935e-4acf-a6b4-2d0e5124a29b tempest-LiveMigrationNegativeTest-1402864585 tempest-LiveMigrationNegativeTest-1402864585-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:58.308866 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eaeff5d2-935e-4acf-a6b4-2d0e5124a29b tempest-LiveMigrationNegativeTest-1402864585 tempest-LiveMigrationNegativeTest-1402864585-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:58.309327 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eaeff5d2-935e-4acf-a6b4-2d0e5124a29b tempest-LiveMigrationNegativeTest-1402864585 tempest-LiveMigrationNegativeTest-1402864585-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:58.309804 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eaeff5d2-935e-4acf-a6b4-2d0e5124a29b tempest-LiveMigrationNegativeTest-1402864585 tempest-LiveMigrationNegativeTest-1402864585-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:58.317542 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c0aa34d1-fd7a-43ee-82b2-ea5adeba73da tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:58.322411 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c0aa34d1-fd7a-43ee-82b2-ea5adeba73da tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:58.326231 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c0aa34d1-fd7a-43ee-82b2-ea5adeba73da tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:58.327377 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c0aa34d1-fd7a-43ee-82b2-ea5adeba73da tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:58.328051 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c0aa34d1-fd7a-43ee-82b2-ea5adeba73da tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:58.328756 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c0aa34d1-fd7a-43ee-82b2-ea5adeba73da tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:58.467013 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-c0aa34d1-fd7a-43ee-82b2-ea5adeba73da tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:58.478081 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-c0aa34d1-fd7a-43ee-82b2-ea5adeba73da tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:58.479483 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-c0aa34d1-fd7a-43ee-82b2-ea5adeba73da tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:58.481754 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c0aa34d1-fd7a-43ee-82b2-ea5adeba73da tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/bb513027-efc1-4201-812f-39c88b423a9d" status: 200 len: 1320 microversion: 2.25 time: 0.215876 Aug 27 02:40:58.483961 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 189/382] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:40:58 2022] GET /compute/v2.1/servers/bb513027-efc1-4201-812f-39c88b423a9d => generated 1320 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:40:58.499554 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f764e31e-83bc-4288-b9b2-d5a78e4eda07 tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-852278-4"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:58.521323 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f764e31e-83bc-4288-b9b2-d5a78e4eda07 tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:58.522346 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f764e31e-83bc-4288-b9b2-d5a78e4eda07 tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:58.523002 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f764e31e-83bc-4288-b9b2-d5a78e4eda07 tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:58.710073 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f764e31e-83bc-4288-b9b2-d5a78e4eda07 tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 228 microversion: 2.1 time: 0.223123 Aug 27 02:40:58.710700 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 190/383] 10.222.0.70 () {60 vars in 1194 bytes} [Sat Aug 27 02:40:58 2022] POST /compute/v2.1/os-aggregates/17/action => generated 228 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:40:58.723276 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3b412f7f-1a24-4c3f-9d98-929fbdc1ebfc tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:58.756807 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-3b412f7f-1a24-4c3f-9d98-929fbdc1ebfc tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] 10.222.0.70 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.037972 Aug 27 02:40:58.757609 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 191/384] 10.222.0.70 () {58 vars in 1155 bytes} [Sat Aug 27 02:40:58 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Aug 27 02:40:58.771297 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-371aa034-1537-474d-8174-6cf71252f32e tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1346664475"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:58.776875 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.aggregate [None req-371aa034-1537-474d-8174-6cf71252f32e tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] Generated uuid 01b2e5b2-e5f2-4a5f-b6ef-a3e45f09729e for aggregate {{(pid=134052) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 02:40:58.830098 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-371aa034-1537-474d-8174-6cf71252f32e tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.062622 Aug 27 02:40:58.831339 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 192/385] 10.222.0.70 () {60 vars in 1164 bytes} [Sat Aug 27 02:40:58 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:40:58.854658 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d1a6dafc-c5d7-4971-97f5-3ed16b5fc557 tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:58.884507 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d1a6dafc-c5d7-4971-97f5-3ed16b5fc557 tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:58.885228 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d1a6dafc-c5d7-4971-97f5-3ed16b5fc557 tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:58.885699 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d1a6dafc-c5d7-4971-97f5-3ed16b5fc557 tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:58.896453 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d1a6dafc-c5d7-4971-97f5-3ed16b5fc557 tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:58.897205 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d1a6dafc-c5d7-4971-97f5-3ed16b5fc557 tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:58.897804 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d1a6dafc-c5d7-4971-97f5-3ed16b5fc557 tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:58.921656 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.compute.aggregates [None req-d1a6dafc-c5d7-4971-97f5-3ed16b5fc557 tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] Failed to remove host nonexist_host from aggregate 18. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Aug 27 02:40:58.922219 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-d1a6dafc-c5d7-4971-97f5-3ed16b5fc557 tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 18 Aug 27 02:40:58.924137 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d1a6dafc-c5d7-4971-97f5-3ed16b5fc557 tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] Request method failure captured: Aug 27 02:40:58.924137 n-d-852278-4 devstack@n-api.service[134052]: request: POST /compute/v2.1/os-aggregates/18/action HTTP/1.1 Aug 27 02:40:58.924137 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:40:58.924137 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:40:58.924137 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:40:58.924137 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 42 Aug 27 02:40:58.924137 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:40:58.924137 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:40:58.924137 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:40:58.924137 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:40:58.924137 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYQw_VNUmSCv_20TpMEP3_ppldhnIWLmU69XDcYQfj67tX_lE5lVDHgben_DcmvPHwnav4XS3W4R4Pcupx9OYq1E9oH9whRQ2L4RdZtHHBeKr7_pa2Rd9kvWlVmmOKLMcwgvL_46OZuuQeojuAOZIflbS0TzoMt1ZAIyQEXBhZJKuaU Aug 27 02:40:58.924137 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:40:58.924137 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:40:58.924137 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:40:58.924137 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:40:58.924137 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:40:58.924137 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:40:58.924137 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: f7fc8497b19948e8a50cea73d1c73f33 Aug 27 02:40:58.924137 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2116589466 Aug 27 02:40:58.924137 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,admin,member Aug 27 02:40:58.924137 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,admin,member Aug 27 02:40:58.925467 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f7fc8497b19948e8a50cea73d1c73f33"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f7fc8497b19948e8a50cea73d1c73f33", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f7fc8497b19948e8a50cea73d1c73f33"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f7fc8497b19948e8a50cea73d1c73f33"}]}] Aug 27 02:40:58.925467 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2116589466 Aug 27 02:40:58.925467 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: f7fc8497b19948e8a50cea73d1c73f33 Aug 27 02:40:58.925467 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2116589466 Aug 27 02:40:58.925467 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin Aug 27 02:40:58.925467 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:40:58.925467 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:40:58.925467 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: cbedd631dd394e8885bde3503028d3d9 Aug 27 02:40:58.925467 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin Aug 27 02:40:58.925467 n-d-852278-4 devstack@n-api.service[134052]: Aug 27 02:40:58.925467 n-d-852278-4 devstack@n-api.service[134052]: {"remove_host": {"host": "nonexist_host"}} Aug 27 02:40:58.925467 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 02:40:58.925467 n-d-852278-4 devstack@n-api.service[134052]: exception: Cannot remove host nonexist_host in aggregate 18 Aug 27 02:40:58.926675 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '18', 'body': {'remove_host': {'host': 'nonexist_host'}}} Aug 27 02:40:58.926675 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:40:58.926675 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:58.926675 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5997, in _get_service_in_cell_by_host Aug 27 02:40:58.926675 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 27 02:40:58.926675 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 02:40:58.926675 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 02:40:58.926675 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 27 02:40:58.926675 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 27 02:40:58.926675 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 02:40:58.926675 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 02:40:58.926675 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 27 02:40:58.926675 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 27 02:40:58.926675 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Aug 27 02:40:58.926675 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:58.926675 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:58.926675 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:58.926675 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:58.926675 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6003, in _get_service_in_cell_by_host Aug 27 02:40:58.926675 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Aug 27 02:40:58.931641 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6065, in _find_service_in_cell Aug 27 02:40:58.931641 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 27 02:40:58.931641 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 27 02:40:58.931641 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:58.931641 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:58.931641 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:58.931641 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:58.931641 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Aug 27 02:40:58.931641 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Aug 27 02:40:58.931641 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 27 02:40:58.931641 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 27 02:40:58.931641 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 02:40:58.931641 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 02:40:58.931641 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 02:40:58.931641 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 02:40:58.931641 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 27 02:40:58.931641 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 27 02:40:58.931641 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6681, in remove_host_from_aggregate Aug 27 02:40:58.931641 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Aug 27 02:40:58.931641 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Aug 27 02:40:58.933789 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Aug 27 02:40:58.933789 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Aug 27 02:40:58.933789 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:58.933789 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:58.933789 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:58.933789 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:58.933789 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:58.933789 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:58.933789 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:40:58.933789 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:40:58.933789 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:40:58.933789 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:40:58.933789 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:40:58.933789 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:40:58.933789 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Aug 27 02:40:58.933789 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 27 02:40:58.933789 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 18 Aug 27 02:40:58.933789 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:58.933789 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:58.933789 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:58.933789 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:58.935960 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:58.935960 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:58.935960 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:40:58.935960 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:40:58.935960 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 18 Aug 27 02:40:58.935960 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:40:58.935960 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d1a6dafc-c5d7-4971-97f5-3ed16b5fc557 tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 18 {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:40:58.935960 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d1a6dafc-c5d7-4971-97f5-3ed16b5fc557 tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates/18/action" status: 404 len: 94 microversion: 2.1 time: 0.086462 Aug 27 02:40:58.935960 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 193/386] 10.222.0.70 () {60 vars in 1194 bytes} [Sat Aug 27 02:40:58 2022] POST /compute/v2.1/os-aggregates/18/action => generated 94 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 27 02:40:58.938383 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-96310f37-ee0e-4816-bd30-1bd9785fede9 tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:58.979771 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-96310f37-ee0e-4816-bd30-1bd9785fede9 tempest-AggregatesAdminNegativeTestJSON-2116589466 tempest-AggregatesAdminNegativeTestJSON-2116589466-project-admin] 10.222.0.70 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.048839 Aug 27 02:40:58.981142 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 194/387] 10.222.0.70 () {58 vars in 1155 bytes} [Sat Aug 27 02:40:58 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Aug 27 02:40:59.513669 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4cb2f226-04a1-47ce-ad60-4e93d3b1a72a tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:59.515409 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-4cb2f226-04a1-47ce-ad60-4e93d3b1a72a tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: bb513027-efc1-4201-812f-39c88b423a9d] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:59.536784 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4cb2f226-04a1-47ce-ad60-4e93d3b1a72a tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:59.539132 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4cb2f226-04a1-47ce-ad60-4e93d3b1a72a tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:59.540730 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4cb2f226-04a1-47ce-ad60-4e93d3b1a72a tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:59.541650 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4cb2f226-04a1-47ce-ad60-4e93d3b1a72a tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:59.543546 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4cb2f226-04a1-47ce-ad60-4e93d3b1a72a tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:59.545633 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4cb2f226-04a1-47ce-ad60-4e93d3b1a72a tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:00.259016 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-eaeff5d2-935e-4acf-a6b4-2d0e5124a29b tempest-LiveMigrationNegativeTest-1402864585 tempest-LiveMigrationNegativeTest-1402864585-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/96881762-a0a0-425f-a3b6-cc87adbae319" status: 200 len: 1610 microversion: 2.1 time: 1.964440 Aug 27 02:41:00.262827 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 194/388] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:58 2022] GET /compute/v2.1/servers/96881762-a0a0-425f-a3b6-cc87adbae319 => generated 1610 bytes in 1969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:00.280151 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0e14fd2e-36a1-4d52-8b8c-c7f92a103b5c tempest-LiveMigrationNegativeTest-1402864585 tempest-LiveMigrationNegativeTest-1402864585-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:00.292420 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0e14fd2e-36a1-4d52-8b8c-c7f92a103b5c tempest-LiveMigrationNegativeTest-1402864585 tempest-LiveMigrationNegativeTest-1402864585-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:00.292920 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0e14fd2e-36a1-4d52-8b8c-c7f92a103b5c tempest-LiveMigrationNegativeTest-1402864585 tempest-LiveMigrationNegativeTest-1402864585-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:00.304685 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0e14fd2e-36a1-4d52-8b8c-c7f92a103b5c tempest-LiveMigrationNegativeTest-1402864585 tempest-LiveMigrationNegativeTest-1402864585-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:00.305673 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0e14fd2e-36a1-4d52-8b8c-c7f92a103b5c tempest-LiveMigrationNegativeTest-1402864585 tempest-LiveMigrationNegativeTest-1402864585-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:00.306326 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0e14fd2e-36a1-4d52-8b8c-c7f92a103b5c tempest-LiveMigrationNegativeTest-1402864585 tempest-LiveMigrationNegativeTest-1402864585-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:00.307048 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0e14fd2e-36a1-4d52-8b8c-c7f92a103b5c tempest-LiveMigrationNegativeTest-1402864585 tempest-LiveMigrationNegativeTest-1402864585-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:00.338302 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=9,nova_api:DELETE=8 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:41:00.370570 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-0e14fd2e-36a1-4d52-8b8c-c7f92a103b5c tempest-LiveMigrationNegativeTest-1402864585 tempest-LiveMigrationNegativeTest-1402864585-project-admin] 10.222.0.70 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.094167 Aug 27 02:41:00.371756 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 195/389] 10.222.0.70 () {58 vars in 1176 bytes} [Sat Aug 27 02:41:00 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:41:00.384224 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-dcc61c43-c4c6-4bcf-a95e-618046138215 tempest-LiveMigrationNegativeTest-1402864585 tempest-LiveMigrationNegativeTest-1402864585-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-852278-4", "block_migration": true, "disk_over_commit": false}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:41:00.386951 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-dcc61c43-c4c6-4bcf-a95e-618046138215 tempest-LiveMigrationNegativeTest-1402864585 tempest-LiveMigrationNegativeTest-1402864585-project-admin] [instance: 96881762-a0a0-425f-a3b6-cc87adbae319] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:00.403014 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dcc61c43-c4c6-4bcf-a95e-618046138215 tempest-LiveMigrationNegativeTest-1402864585 tempest-LiveMigrationNegativeTest-1402864585-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:00.404901 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dcc61c43-c4c6-4bcf-a95e-618046138215 tempest-LiveMigrationNegativeTest-1402864585 tempest-LiveMigrationNegativeTest-1402864585-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:00.405577 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dcc61c43-c4c6-4bcf-a95e-618046138215 tempest-LiveMigrationNegativeTest-1402864585 tempest-LiveMigrationNegativeTest-1402864585-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:00.406572 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dcc61c43-c4c6-4bcf-a95e-618046138215 tempest-LiveMigrationNegativeTest-1402864585 tempest-LiveMigrationNegativeTest-1402864585-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:00.408476 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dcc61c43-c4c6-4bcf-a95e-618046138215 tempest-LiveMigrationNegativeTest-1402864585 tempest-LiveMigrationNegativeTest-1402864585-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:00.413101 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dcc61c43-c4c6-4bcf-a95e-618046138215 tempest-LiveMigrationNegativeTest-1402864585 tempest-LiveMigrationNegativeTest-1402864585-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:00.483552 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.objects.instance [None req-dcc61c43-c4c6-4bcf-a95e-618046138215 tempest-LiveMigrationNegativeTest-1402864585 tempest-LiveMigrationNegativeTest-1402864585-project-admin] Lazy-loading 'flavor' on Instance uuid 96881762-a0a0-425f-a3b6-cc87adbae319 {{(pid=134051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:41:00.512825 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-4cb2f226-04a1-47ce-ad60-4e93d3b1a72a tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:00.514799 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-dcc61c43-c4c6-4bcf-a95e-618046138215 tempest-LiveMigrationNegativeTest-1402864585 tempest-LiveMigrationNegativeTest-1402864585-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance 96881762-a0a0-425f-a3b6-cc87adbae319 while it is in vm_state suspended Aug 27 02:41:00.516421 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:41:00.517725 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-dcc61c43-c4c6-4bcf-a95e-618046138215 tempest-LiveMigrationNegativeTest-1402864585 tempest-LiveMigrationNegativeTest-1402864585-project-admin] Request method failure captured: Aug 27 02:41:00.517725 n-d-852278-4 devstack@n-api.service[134051]: request: POST /compute/v2.1/servers/96881762-a0a0-425f-a3b6-cc87adbae319/action HTTP/1.1 Aug 27 02:41:00.517725 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:41:00.517725 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:41:00.517725 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:41:00.517725 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 97 Aug 27 02:41:00.517725 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:41:00.517725 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:41:00.517725 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:41:00.517725 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:41:00.517725 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYQPZ8e0RiVnzadiVTo5YSeRkqlQNwqY4o5OtR3yWoxkRgQY1f6hUnaxVIBJc0iAB8_tufVnR38_j9AdwXY02SU6BYlZ2YXgK0eBr1B2vRIAFcL1nkrElNTramIWMKfmZihnwPfuEk44R_BqNeX3vbjcyr_CI67kTdJYDYboO0aPW54 Aug 27 02:41:00.517725 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:41:00.517725 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:41:00.517725 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:41:00.517725 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:41:00.517725 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:41:00.517725 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:41:00.517725 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: ebbdf41a68db45799fced441024c45f6 Aug 27 02:41:00.517725 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-LiveMigrationNegativeTest-1402864585 Aug 27 02:41:00.517725 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,admin,member Aug 27 02:41:00.517725 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,admin,member Aug 27 02:41:00.518960 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ebbdf41a68db45799fced441024c45f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_ebbdf41a68db45799fced441024c45f6", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ebbdf41a68db45799fced441024c45f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/ebbdf41a68db45799fced441024c45f6"}]}] Aug 27 02:41:00.518960 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-LiveMigrationNegativeTest-1402864585 Aug 27 02:41:00.518960 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: ebbdf41a68db45799fced441024c45f6 Aug 27 02:41:00.518960 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1402864585 Aug 27 02:41:00.518960 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-LiveMigrationNegativeTest-1402864585-project-admin Aug 27 02:41:00.518960 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:41:00.518960 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:41:00.518960 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 3380475a366f4b8aa2d8512f2244863a Aug 27 02:41:00.518960 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-LiveMigrationNegativeTest-1402864585-project-admin Aug 27 02:41:00.518960 n-d-852278-4 devstack@n-api.service[134051]: Aug 27 02:41:00.518960 n-d-852278-4 devstack@n-api.service[134051]: {"os-migrateLive": {"host": "n-h1-852278-4", "block_migration": true, "disk_over_commit": false}} Aug 27 02:41:00.518960 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 02:41:00.519865 n-d-852278-4 devstack@n-api.service[134051]: exception: Cannot 'os-migrateLive' instance 96881762-a0a0-425f-a3b6-cc87adbae319 while it is in vm_state suspended Aug 27 02:41:00.519865 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '96881762-a0a0-425f-a3b6-cc87adbae319', 'body': {'os-migrateLive': {'host': 'n-h1-852278-4', 'block_migration': True, 'disk_over_commit': False}}} Aug 27 02:41:00.519865 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:41:00.519865 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:41:00.519865 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Aug 27 02:41:00.519865 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Aug 27 02:41:00.519865 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 27 02:41:00.519865 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 02:41:00.519865 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 27 02:41:00.519865 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 27 02:41:00.519865 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Aug 27 02:41:00.519865 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 27 02:41:00.519865 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 27 02:41:00.519865 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 27 02:41:00.519865 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Aug 27 02:41:00.519865 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 27 02:41:00.519865 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Aug 27 02:41:00.519865 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 27 02:41:00.521174 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 02:41:00.521174 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 02:41:00.521174 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 27 02:41:00.521174 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 27 02:41:00.521174 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 96881762-a0a0-425f-a3b6-cc87adbae319 in vm_state suspended. Cannot live_migrate while the instance is in this state. Aug 27 02:41:00.521174 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:41:00.521174 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:41:00.521174 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:41:00.521174 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:41:00.521174 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:41:00.521174 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:41:00.521174 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:41:00.521174 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:41:00.521174 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:41:00.521174 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:41:00.521174 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:41:00.521174 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:41:00.521174 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:41:00.521174 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:41:00.521174 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:41:00.522228 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:41:00.522228 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 27 02:41:00.522228 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Aug 27 02:41:00.522228 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 27 02:41:00.522228 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 27 02:41:00.522228 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 27 02:41:00.522228 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance 96881762-a0a0-425f-a3b6-cc87adbae319 while it is in vm_state suspended Aug 27 02:41:00.522228 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:41:00.522228 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:41:00.522228 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:41:00.522228 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:41:00.522228 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:41:00.522228 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:41:00.522228 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:41:00.522228 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:41:00.522228 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance 96881762-a0a0-425f-a3b6-cc87adbae319 while it is in vm_state suspended Aug 27 02:41:00.522228 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:41:00.525401 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-dcc61c43-c4c6-4bcf-a95e-618046138215 tempest-LiveMigrationNegativeTest-1402864585 tempest-LiveMigrationNegativeTest-1402864585-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance 96881762-a0a0-425f-a3b6-cc87adbae319 while it is in vm_state suspended {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:41:00.526822 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-dcc61c43-c4c6-4bcf-a95e-618046138215 tempest-LiveMigrationNegativeTest-1402864585 tempest-LiveMigrationNegativeTest-1402864585-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/96881762-a0a0-425f-a3b6-cc87adbae319/action" status: 409 len: 155 microversion: 2.1 time: 0.146899 Aug 27 02:41:00.527977 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 196/390] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 02:41:00 2022] POST /compute/v2.1/servers/96881762-a0a0-425f-a3b6-cc87adbae319/action => generated 155 bytes in 148 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 27 02:41:00.532647 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-4cb2f226-04a1-47ce-ad60-4e93d3b1a72a tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:00.534643 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-4cb2f226-04a1-47ce-ad60-4e93d3b1a72a tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:00.537443 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-4cb2f226-04a1-47ce-ad60-4e93d3b1a72a tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/bb513027-efc1-4201-812f-39c88b423a9d" status: 200 len: 1362 microversion: 2.25 time: 1.031376 Aug 27 02:41:00.544073 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-df473700-3db4-49d2-bdab-b386155313dc tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:00.544617 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-df473700-3db4-49d2-bdab-b386155313dc tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] [instance: 96881762-a0a0-425f-a3b6-cc87adbae319] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:00.556616 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 195/391] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:40:59 2022] GET /compute/v2.1/servers/bb513027-efc1-4201-812f-39c88b423a9d => generated 1362 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:41:00.558426 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-df473700-3db4-49d2-bdab-b386155313dc tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:00.558921 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-df473700-3db4-49d2-bdab-b386155313dc tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:00.561453 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-df473700-3db4-49d2-bdab-b386155313dc tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:00.562187 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-df473700-3db4-49d2-bdab-b386155313dc tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:00.562647 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-df473700-3db4-49d2-bdab-b386155313dc tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:00.563112 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-df473700-3db4-49d2-bdab-b386155313dc tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:00.608471 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-df473700-3db4-49d2-bdab-b386155313dc tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] [instance: 96881762-a0a0-425f-a3b6-cc87adbae319] Going to try to terminate instance {{(pid=134051) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:41:00.645966 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=96,nova_cell1:INSERT=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:41:00.819384 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-df473700-3db4-49d2-bdab-b386155313dc tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] 10.222.0.70 "DELETE /compute/v2.1/servers/96881762-a0a0-425f-a3b6-cc87adbae319" status: 204 len: 0 microversion: 2.1 time: 0.283661 Aug 27 02:41:00.824342 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 197/392] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:41:00 2022] DELETE /compute/v2.1/servers/96881762-a0a0-425f-a3b6-cc87adbae319 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:41:00.832937 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-cd4b3f03-699e-4a6d-8db9-d8b857bed81f tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:00.833861 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-cd4b3f03-699e-4a6d-8db9-d8b857bed81f tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] [instance: 96881762-a0a0-425f-a3b6-cc87adbae319] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:00.857391 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cd4b3f03-699e-4a6d-8db9-d8b857bed81f tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:00.861748 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cd4b3f03-699e-4a6d-8db9-d8b857bed81f tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:00.867038 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cd4b3f03-699e-4a6d-8db9-d8b857bed81f tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:00.868089 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cd4b3f03-699e-4a6d-8db9-d8b857bed81f tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:00.868770 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cd4b3f03-699e-4a6d-8db9-d8b857bed81f tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:00.869387 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cd4b3f03-699e-4a6d-8db9-d8b857bed81f tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:01.571929 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-cd4b3f03-699e-4a6d-8db9-d8b857bed81f tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68711ff38ec41c0b051124527c7ac35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae179f416c451e92e270d2cb0f4400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:01.583216 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b4a67a26-bb15-439a-8c6d-153c918d0cb2 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:01.586847 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b4a67a26-bb15-439a-8c6d-153c918d0cb2 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: bb513027-efc1-4201-812f-39c88b423a9d] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:01.595704 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-cd4b3f03-699e-4a6d-8db9-d8b857bed81f tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] 10.222.0.70 "GET /compute/v2.1/servers/96881762-a0a0-425f-a3b6-cc87adbae319" status: 200 len: 1465 microversion: 2.1 time: 0.767359 Aug 27 02:41:01.610956 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 196/393] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:00 2022] GET /compute/v2.1/servers/96881762-a0a0-425f-a3b6-cc87adbae319 => generated 1465 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:01.618178 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b4a67a26-bb15-439a-8c6d-153c918d0cb2 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:01.619048 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b4a67a26-bb15-439a-8c6d-153c918d0cb2 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:01.619643 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b4a67a26-bb15-439a-8c6d-153c918d0cb2 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:01.620842 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b4a67a26-bb15-439a-8c6d-153c918d0cb2 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:01.621327 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b4a67a26-bb15-439a-8c6d-153c918d0cb2 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:01.621751 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b4a67a26-bb15-439a-8c6d-153c918d0cb2 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:02.141404 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-b4a67a26-bb15-439a-8c6d-153c918d0cb2 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:02.154673 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-b4a67a26-bb15-439a-8c6d-153c918d0cb2 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:02.162439 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-b4a67a26-bb15-439a-8c6d-153c918d0cb2 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:02.164654 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b4a67a26-bb15-439a-8c6d-153c918d0cb2 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/bb513027-efc1-4201-812f-39c88b423a9d" status: 200 len: 1362 microversion: 2.25 time: 0.604230 Aug 27 02:41:02.167419 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 198/394] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:41:01 2022] GET /compute/v2.1/servers/bb513027-efc1-4201-812f-39c88b423a9d => generated 1362 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:41:02.379233 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-23715254-f6e1-4fb1-82c0-acd7c57713ba req-c134ffd9-06ed-4374-934d-217afe6d099b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb513027-efc1-4201-812f-39c88b423a9d", "tag": "00564c24-5898-44ae-8c51-440ac80fc61e"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:41:02.392593 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-23715254-f6e1-4fb1-82c0-acd7c57713ba req-c134ffd9-06ed-4374-934d-217afe6d099b service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:02.393379 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-23715254-f6e1-4fb1-82c0-acd7c57713ba req-c134ffd9-06ed-4374-934d-217afe6d099b service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:02.393952 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-23715254-f6e1-4fb1-82c0-acd7c57713ba req-c134ffd9-06ed-4374-934d-217afe6d099b service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:02.412808 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-23715254-f6e1-4fb1-82c0-acd7c57713ba req-c134ffd9-06ed-4374-934d-217afe6d099b service nova] Creating event network-changed:00564c24-5898-44ae-8c51-440ac80fc61e for instance bb513027-efc1-4201-812f-39c88b423a9d on n-h1-852278-4 Aug 27 02:41:02.418577 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-23715254-f6e1-4fb1-82c0-acd7c57713ba req-c134ffd9-06ed-4374-934d-217afe6d099b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043718 Aug 27 02:41:02.419437 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 197/395] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:41:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:41:02.626747 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3375db48-a219-4603-a87b-8eaaafa7b9d2 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:02.628032 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-3375db48-a219-4603-a87b-8eaaafa7b9d2 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] [instance: 96881762-a0a0-425f-a3b6-cc87adbae319] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:02.635091 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3375db48-a219-4603-a87b-8eaaafa7b9d2 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:02.635872 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3375db48-a219-4603-a87b-8eaaafa7b9d2 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:02.636575 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3375db48-a219-4603-a87b-8eaaafa7b9d2 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:02.637506 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3375db48-a219-4603-a87b-8eaaafa7b9d2 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:02.638168 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3375db48-a219-4603-a87b-8eaaafa7b9d2 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:02.638836 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3375db48-a219-4603-a87b-8eaaafa7b9d2 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:03.098354 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-3375db48-a219-4603-a87b-8eaaafa7b9d2 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68711ff38ec41c0b051124527c7ac35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae179f416c451e92e270d2cb0f4400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:03.116735 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-3375db48-a219-4603-a87b-8eaaafa7b9d2 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] 10.222.0.70 "GET /compute/v2.1/servers/96881762-a0a0-425f-a3b6-cc87adbae319" status: 200 len: 1465 microversion: 2.1 time: 0.489960 Aug 27 02:41:03.138016 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 199/396] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:02 2022] GET /compute/v2.1/servers/96881762-a0a0-425f-a3b6-cc87adbae319 => generated 1465 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:03.188197 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9e5a9a0c-d2ef-40e8-b562-9fe6d4141cf7 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:03.188954 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-9e5a9a0c-d2ef-40e8-b562-9fe6d4141cf7 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: bb513027-efc1-4201-812f-39c88b423a9d] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:03.209442 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9e5a9a0c-d2ef-40e8-b562-9fe6d4141cf7 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:03.209962 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9e5a9a0c-d2ef-40e8-b562-9fe6d4141cf7 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:03.210408 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9e5a9a0c-d2ef-40e8-b562-9fe6d4141cf7 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:03.211132 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9e5a9a0c-d2ef-40e8-b562-9fe6d4141cf7 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:03.211591 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9e5a9a0c-d2ef-40e8-b562-9fe6d4141cf7 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:03.212002 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9e5a9a0c-d2ef-40e8-b562-9fe6d4141cf7 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:03.459803 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-9e5a9a0c-d2ef-40e8-b562-9fe6d4141cf7 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:03.476127 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-9e5a9a0c-d2ef-40e8-b562-9fe6d4141cf7 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:03.477846 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-9e5a9a0c-d2ef-40e8-b562-9fe6d4141cf7 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:03.481186 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9e5a9a0c-d2ef-40e8-b562-9fe6d4141cf7 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/bb513027-efc1-4201-812f-39c88b423a9d" status: 200 len: 1362 microversion: 2.25 time: 0.296057 Aug 27 02:41:03.496256 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 198/397] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:41:03 2022] GET /compute/v2.1/servers/bb513027-efc1-4201-812f-39c88b423a9d => generated 1362 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:41:04.143196 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a5918283-9faa-4d36-9b1c-eb1d6008b7f6 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:04.143789 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-a5918283-9faa-4d36-9b1c-eb1d6008b7f6 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] [instance: 96881762-a0a0-425f-a3b6-cc87adbae319] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:04.157060 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a5918283-9faa-4d36-9b1c-eb1d6008b7f6 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:04.158108 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a5918283-9faa-4d36-9b1c-eb1d6008b7f6 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:04.160157 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a5918283-9faa-4d36-9b1c-eb1d6008b7f6 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:04.162605 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a5918283-9faa-4d36-9b1c-eb1d6008b7f6 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:04.163269 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a5918283-9faa-4d36-9b1c-eb1d6008b7f6 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:04.165524 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a5918283-9faa-4d36-9b1c-eb1d6008b7f6 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:04.314914 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-a5918283-9faa-4d36-9b1c-eb1d6008b7f6 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68711ff38ec41c0b051124527c7ac35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae179f416c451e92e270d2cb0f4400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:04.329079 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a5918283-9faa-4d36-9b1c-eb1d6008b7f6 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] 10.222.0.70 "GET /compute/v2.1/servers/96881762-a0a0-425f-a3b6-cc87adbae319" status: 200 len: 1423 microversion: 2.1 time: 0.189725 Aug 27 02:41:04.329662 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 200/398] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:04 2022] GET /compute/v2.1/servers/96881762-a0a0-425f-a3b6-cc87adbae319 => generated 1423 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:04.403174 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-a9c7810f-43a2-482f-a0f4-30d0864277b7 req-fd54e60d-5e66-4ea0-a25a-ad20d7117f78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96881762-a0a0-425f-a3b6-cc87adbae319", "name": "network-vif-deleted", "tag": "43725a41-1e0e-4350-8a03-16c133420308"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:41:04.419504 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-a9c7810f-43a2-482f-a0f4-30d0864277b7 req-fd54e60d-5e66-4ea0-a25a-ad20d7117f78 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:04.421917 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-a9c7810f-43a2-482f-a0f4-30d0864277b7 req-fd54e60d-5e66-4ea0-a25a-ad20d7117f78 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:04.423470 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-a9c7810f-43a2-482f-a0f4-30d0864277b7 req-fd54e60d-5e66-4ea0-a25a-ad20d7117f78 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:04.454960 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-a9c7810f-43a2-482f-a0f4-30d0864277b7 req-fd54e60d-5e66-4ea0-a25a-ad20d7117f78 service nova] Creating event network-vif-deleted:43725a41-1e0e-4350-8a03-16c133420308 for instance 96881762-a0a0-425f-a3b6-cc87adbae319 on n-h2-852278-4 Aug 27 02:41:04.469498 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-a9c7810f-43a2-482f-a0f4-30d0864277b7 req-fd54e60d-5e66-4ea0-a25a-ad20d7117f78 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069757 Aug 27 02:41:04.471842 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 199/399] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:41:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:41:04.503020 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-2b8ea4dd-60cc-4f19-877d-c3cdcedb221e tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:04.503634 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-2b8ea4dd-60cc-4f19-877d-c3cdcedb221e tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: bb513027-efc1-4201-812f-39c88b423a9d] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:04.517334 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2b8ea4dd-60cc-4f19-877d-c3cdcedb221e tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:04.517839 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2b8ea4dd-60cc-4f19-877d-c3cdcedb221e tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:04.519363 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2b8ea4dd-60cc-4f19-877d-c3cdcedb221e tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:04.521248 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2b8ea4dd-60cc-4f19-877d-c3cdcedb221e tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:04.525090 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2b8ea4dd-60cc-4f19-877d-c3cdcedb221e tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:04.525853 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2b8ea4dd-60cc-4f19-877d-c3cdcedb221e tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:04.818474 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-2b8ea4dd-60cc-4f19-877d-c3cdcedb221e tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:04.831689 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-2b8ea4dd-60cc-4f19-877d-c3cdcedb221e tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:04.833412 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-2b8ea4dd-60cc-4f19-877d-c3cdcedb221e tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:04.834727 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-2b8ea4dd-60cc-4f19-877d-c3cdcedb221e tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/bb513027-efc1-4201-812f-39c88b423a9d" status: 200 len: 1362 microversion: 2.25 time: 0.335645 Aug 27 02:41:04.837216 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 201/400] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:41:04 2022] GET /compute/v2.1/servers/bb513027-efc1-4201-812f-39c88b423a9d => generated 1362 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:41:05.352417 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-24f9a4ed-0b54-4826-85b0-2715f6c3dbda tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:05.353058 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-24f9a4ed-0b54-4826-85b0-2715f6c3dbda tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] [instance: 96881762-a0a0-425f-a3b6-cc87adbae319] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:05.362352 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-24f9a4ed-0b54-4826-85b0-2715f6c3dbda tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:05.362889 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-24f9a4ed-0b54-4826-85b0-2715f6c3dbda tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:05.363327 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-24f9a4ed-0b54-4826-85b0-2715f6c3dbda tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:05.364044 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-24f9a4ed-0b54-4826-85b0-2715f6c3dbda tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:05.364569 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-24f9a4ed-0b54-4826-85b0-2715f6c3dbda tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:05.365147 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-24f9a4ed-0b54-4826-85b0-2715f6c3dbda tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:05.391400 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-24f9a4ed-0b54-4826-85b0-2715f6c3dbda tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] HTTP exception thrown: Instance 96881762-a0a0-425f-a3b6-cc87adbae319 could not be found. Aug 27 02:41:05.394145 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-24f9a4ed-0b54-4826-85b0-2715f6c3dbda tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Request method failure captured: Aug 27 02:41:05.394145 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/96881762-a0a0-425f-a3b6-cc87adbae319 HTTP/1.1 Aug 27 02:41:05.394145 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:41:05.394145 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:41:05.394145 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:41:05.394145 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:41:05.394145 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:41:05.394145 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:41:05.394145 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:41:05.394145 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:41:05.394145 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYQNxGW88PeewB6jo1ZCIlfVrzvtuNyiSxvMtqjpVtU2xPmO5OhfiF1zvx2Mr4b4K1bd3aDXzbhXR7WdAjyWjEi_MVi0gI_CvaBfii-ZfFG5Fnmf3GQCvT2foaEOZ_5k4VImtt1zZoNrdnnmAHpE_iSYhJ1gtWtPl3wBfsco4TcOlts Aug 27 02:41:05.394145 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:41:05.394145 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:41:05.394145 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:41:05.394145 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:41:05.394145 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:41:05.394145 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:41:05.394145 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 82ae179f416c451e92e270d2cb0f4400 Aug 27 02:41:05.394145 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-LiveMigrationNegativeTest-1452605987 Aug 27 02:41:05.394145 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:41:05.394145 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:41:05.395645 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/82ae179f416c451e92e270d2cb0f4400"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_82ae179f416c451e92e270d2cb0f4400", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/82ae179f416c451e92e270d2cb0f4400"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/82ae179f416c451e92e270d2cb0f4400"}]}] Aug 27 02:41:05.395645 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-LiveMigrationNegativeTest-1452605987 Aug 27 02:41:05.395645 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 82ae179f416c451e92e270d2cb0f4400 Aug 27 02:41:05.395645 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1452605987 Aug 27 02:41:05.395645 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-LiveMigrationNegativeTest-1452605987-project Aug 27 02:41:05.395645 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:41:05.395645 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:41:05.395645 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: d68711ff38ec41c0b051124527c7ac35 Aug 27 02:41:05.395645 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-LiveMigrationNegativeTest-1452605987-project Aug 27 02:41:05.395645 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 02:41:05.395645 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance 96881762-a0a0-425f-a3b6-cc87adbae319 could not be found. Aug 27 02:41:05.395645 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '96881762-a0a0-425f-a3b6-cc87adbae319'} Aug 27 02:41:05.396556 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:41:05.396556 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:41:05.396556 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:41:05.396556 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:41:05.396556 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:41:05.396556 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:41:05.396556 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:41:05.396556 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:41:05.396556 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:41:05.396556 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:41:05.396556 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96881762-a0a0-425f-a3b6-cc87adbae319 could not be found. Aug 27 02:41:05.396556 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:41:05.396556 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:41:05.396556 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:41:05.396556 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:41:05.396556 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:41:05.396556 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:41:05.396556 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:41:05.396556 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:41:05.396556 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:41:05.397696 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:41:05.397696 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:41:05.397696 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:41:05.397696 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:41:05.397696 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:41:05.397696 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:41:05.397696 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:41:05.397696 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96881762-a0a0-425f-a3b6-cc87adbae319 could not be found. Aug 27 02:41:05.397696 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:41:05.397696 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:41:05.397696 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:41:05.397696 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:41:05.397696 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:41:05.397696 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:41:05.397696 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:41:05.397696 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:41:05.397696 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96881762-a0a0-425f-a3b6-cc87adbae319 could not be found. Aug 27 02:41:05.397696 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:41:05.401654 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-24f9a4ed-0b54-4826-85b0-2715f6c3dbda tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Returning 404 to user: Instance 96881762-a0a0-425f-a3b6-cc87adbae319 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:41:05.401979 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-24f9a4ed-0b54-4826-85b0-2715f6c3dbda tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] 10.222.0.70 "GET /compute/v2.1/servers/96881762-a0a0-425f-a3b6-cc87adbae319" status: 404 len: 111 microversion: 2.1 time: 0.054781 Aug 27 02:41:05.402934 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 202/401] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:05 2022] GET /compute/v2.1/servers/96881762-a0a0-425f-a3b6-cc87adbae319 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 02:41:05.416476 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-9f3184e5-4e10-4954-9735-83a5a65ba676 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:05.416967 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-9f3184e5-4e10-4954-9735-83a5a65ba676 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] [instance: e231e897-7343-415a-a4ff-dfe3df4fb62c] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:05.425780 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9f3184e5-4e10-4954-9735-83a5a65ba676 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:05.426821 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9f3184e5-4e10-4954-9735-83a5a65ba676 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:05.427558 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9f3184e5-4e10-4954-9735-83a5a65ba676 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:05.428773 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9f3184e5-4e10-4954-9735-83a5a65ba676 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:05.429372 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9f3184e5-4e10-4954-9735-83a5a65ba676 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:05.430146 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9f3184e5-4e10-4954-9735-83a5a65ba676 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:05.458480 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-9f3184e5-4e10-4954-9735-83a5a65ba676 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] [instance: e231e897-7343-415a-a4ff-dfe3df4fb62c] Going to try to terminate instance {{(pid=134051) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:41:05.563023 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-9f3184e5-4e10-4954-9735-83a5a65ba676 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] 10.222.0.70 "DELETE /compute/v2.1/servers/e231e897-7343-415a-a4ff-dfe3df4fb62c" status: 204 len: 0 microversion: 2.1 time: 0.149934 Aug 27 02:41:05.567824 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 203/402] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:41:05 2022] DELETE /compute/v2.1/servers/e231e897-7343-415a-a4ff-dfe3df4fb62c => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:41:05.573623 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-92444b84-7ca8-4c75-a439-269fbdd0f523 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:05.574537 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-92444b84-7ca8-4c75-a439-269fbdd0f523 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] [instance: e231e897-7343-415a-a4ff-dfe3df4fb62c] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:05.581990 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-92444b84-7ca8-4c75-a439-269fbdd0f523 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:05.582810 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-92444b84-7ca8-4c75-a439-269fbdd0f523 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:05.583326 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-92444b84-7ca8-4c75-a439-269fbdd0f523 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:05.584371 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-cdd877e6-acec-4f13-8ef8-37a5da26a3f6 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1379197834", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "networks": [{"uuid": "fca9b1d3-694a-4672-8678-5d39e71afa11"}]}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:41:05.586056 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-92444b84-7ca8-4c75-a439-269fbdd0f523 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:05.586806 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-92444b84-7ca8-4c75-a439-269fbdd0f523 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:05.587892 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-92444b84-7ca8-4c75-a439-269fbdd0f523 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:05.682941 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.network.neutron [None req-cdd877e6-acec-4f13-8ef8-37a5da26a3f6 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] validate_networks() for [('fca9b1d3-694a-4672-8678-5d39e71afa11', None, None, None, None, None)] {{(pid=134052) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:41:05.885189 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-92444b84-7ca8-4c75-a439-269fbdd0f523 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68711ff38ec41c0b051124527c7ac35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae179f416c451e92e270d2cb0f4400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:05.894907 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-92444b84-7ca8-4c75-a439-269fbdd0f523 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] 10.222.0.70 "GET /compute/v2.1/servers/e231e897-7343-415a-a4ff-dfe3df4fb62c" status: 200 len: 1474 microversion: 2.1 time: 0.325554 Aug 27 02:41:05.898074 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 204/403] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:05 2022] GET /compute/v2.1/servers/e231e897-7343-415a-a4ff-dfe3df4fb62c => generated 1474 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:05.926244 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8d781274-6121-473d-889f-b0d4326723c7 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:05.927046 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-8d781274-6121-473d-889f-b0d4326723c7 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: bb513027-efc1-4201-812f-39c88b423a9d] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:05.933516 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8d781274-6121-473d-889f-b0d4326723c7 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:05.934188 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8d781274-6121-473d-889f-b0d4326723c7 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:05.934803 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8d781274-6121-473d-889f-b0d4326723c7 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:05.935732 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8d781274-6121-473d-889f-b0d4326723c7 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:05.936326 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8d781274-6121-473d-889f-b0d4326723c7 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:05.936955 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8d781274-6121-473d-889f-b0d4326723c7 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:06.207169 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-8d781274-6121-473d-889f-b0d4326723c7 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:06.218310 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-8d781274-6121-473d-889f-b0d4326723c7 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:06.222621 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-8d781274-6121-473d-889f-b0d4326723c7 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:06.226053 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-8d781274-6121-473d-889f-b0d4326723c7 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/bb513027-efc1-4201-812f-39c88b423a9d" status: 200 len: 1362 microversion: 2.25 time: 0.310091 Aug 27 02:41:06.229230 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 205/404] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:41:05 2022] GET /compute/v2.1/servers/bb513027-efc1-4201-812f-39c88b423a9d => generated 1362 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:41:06.367064 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=12 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:41:06.385634 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-cdd877e6-acec-4f13-8ef8-37a5da26a3f6 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Flavor limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:41:06.386954 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-cdd877e6-acec-4f13-8ef8-37a5da26a3f6 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Image limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:41:06.387623 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-cdd877e6-acec-4f13-8ef8-37a5da26a3f6 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Flavor pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:41:06.388093 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-cdd877e6-acec-4f13-8ef8-37a5da26a3f6 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Image pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:41:06.388544 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-cdd877e6-acec-4f13-8ef8-37a5da26a3f6 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:41:06.398285 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cdd877e6-acec-4f13-8ef8-37a5da26a3f6 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:06.399041 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cdd877e6-acec-4f13-8ef8-37a5da26a3f6 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:06.399475 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cdd877e6-acec-4f13-8ef8-37a5da26a3f6 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:06.400367 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cdd877e6-acec-4f13-8ef8-37a5da26a3f6 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:06.401683 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cdd877e6-acec-4f13-8ef8-37a5da26a3f6 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:06.402327 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cdd877e6-acec-4f13-8ef8-37a5da26a3f6 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:06.424166 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-cdd877e6-acec-4f13-8ef8-37a5da26a3f6 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Getting quotas for project 42ec913a638c4c8c8749be73705d2c65. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:41:06.430887 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-cdd877e6-acec-4f13-8ef8-37a5da26a3f6 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Getting quotas for user 6305debcc9294643bbed97f08de171bc and project 42ec913a638c4c8c8749be73705d2c65. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:41:06.456291 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-cdd877e6-acec-4f13-8ef8-37a5da26a3f6 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Going to run 1 instances... {{(pid=134052) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:41:06.461975 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-cdd877e6-acec-4f13-8ef8-37a5da26a3f6 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 29b88730-7871-4923-832e-a02d67f0314b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134052) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:41:06.526499 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-cdd877e6-acec-4f13-8ef8-37a5da26a3f6 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.460035 Aug 27 02:41:06.527966 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 200/405] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 02:41:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1462 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:41:06.536198 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3202c744-74b9-4ffb-9b9c-0fbe77e2f49f tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-198479680", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:41:06.556570 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b38b3374-a1e6-4ede-b190-8fc62c969bbb tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:06.558089 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b38b3374-a1e6-4ede-b190-8fc62c969bbb tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 29b88730-7871-4923-832e-a02d67f0314b] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:06.647714 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.network.neutron [None req-3202c744-74b9-4ffb-9b9c-0fbe77e2f49f tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] validate_networks() for None {{(pid=134051) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:41:06.727063 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b38b3374-a1e6-4ede-b190-8fc62c969bbb tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:06.739116 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=16 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:41:06.740487 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b38b3374-a1e6-4ede-b190-8fc62c969bbb tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/29b88730-7871-4923-832e-a02d67f0314b" status: 200 len: 1211 microversion: 2.1 time: 0.192979 Aug 27 02:41:06.752339 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 201/406] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:06 2022] GET /compute/v2.1/servers/29b88730-7871-4923-832e-a02d67f0314b => generated 1211 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:06.931313 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-7d0881c7-b497-4582-b665-dff236b70742 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:06.931923 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-7d0881c7-b497-4582-b665-dff236b70742 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] [instance: e231e897-7343-415a-a4ff-dfe3df4fb62c] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:06.950787 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7d0881c7-b497-4582-b665-dff236b70742 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:06.961110 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7d0881c7-b497-4582-b665-dff236b70742 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:06.961774 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7d0881c7-b497-4582-b665-dff236b70742 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:06.969535 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7d0881c7-b497-4582-b665-dff236b70742 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:06.970205 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7d0881c7-b497-4582-b665-dff236b70742 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:06.970780 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7d0881c7-b497-4582-b665-dff236b70742 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:07.098263 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-3202c744-74b9-4ffb-9b9c-0fbe77e2f49f tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Flavor limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:41:07.099211 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-3202c744-74b9-4ffb-9b9c-0fbe77e2f49f tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Image limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:41:07.099641 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-3202c744-74b9-4ffb-9b9c-0fbe77e2f49f tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Flavor pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:41:07.100142 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-3202c744-74b9-4ffb-9b9c-0fbe77e2f49f tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Image pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:41:07.100680 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-3202c744-74b9-4ffb-9b9c-0fbe77e2f49f tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:41:07.112493 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3202c744-74b9-4ffb-9b9c-0fbe77e2f49f tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:07.113416 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3202c744-74b9-4ffb-9b9c-0fbe77e2f49f tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:07.114133 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3202c744-74b9-4ffb-9b9c-0fbe77e2f49f tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:07.115437 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3202c744-74b9-4ffb-9b9c-0fbe77e2f49f tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:07.117050 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3202c744-74b9-4ffb-9b9c-0fbe77e2f49f tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:07.117743 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3202c744-74b9-4ffb-9b9c-0fbe77e2f49f tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:07.170157 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-3202c744-74b9-4ffb-9b9c-0fbe77e2f49f tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Getting quotas for project e4c28ddbdb164f01bb82235c6d49717b. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:41:07.184213 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-3202c744-74b9-4ffb-9b9c-0fbe77e2f49f tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Getting quotas for user 30abbf3afe304291981a6a9b85952aa3 and project e4c28ddbdb164f01bb82235c6d49717b. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:41:07.206183 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-3202c744-74b9-4ffb-9b9c-0fbe77e2f49f tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Going to run 1 instances... {{(pid=134051) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:41:07.210374 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-3202c744-74b9-4ffb-9b9c-0fbe77e2f49f tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] [instance: 3ee4d4db-a1bb-4567-a20d-29003e67a295] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134051) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:41:07.294268 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-3202c744-74b9-4ffb-9b9c-0fbe77e2f49f tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.063772 Aug 27 02:41:07.296803 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 206/407] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 02:41:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1067 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:41:07.319659 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-88d4990f-db76-4410-96de-a710557c5261 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:07.323478 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-88d4990f-db76-4410-96de-a710557c5261 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: bb513027-efc1-4201-812f-39c88b423a9d] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:07.352649 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-88d4990f-db76-4410-96de-a710557c5261 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:07.353190 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-88d4990f-db76-4410-96de-a710557c5261 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:07.353637 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-88d4990f-db76-4410-96de-a710557c5261 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:07.354388 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-88d4990f-db76-4410-96de-a710557c5261 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:07.354841 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-88d4990f-db76-4410-96de-a710557c5261 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:07.355263 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-88d4990f-db76-4410-96de-a710557c5261 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:07.374314 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-7d0881c7-b497-4582-b665-dff236b70742 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68711ff38ec41c0b051124527c7ac35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae179f416c451e92e270d2cb0f4400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:07.386583 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-7d0881c7-b497-4582-b665-dff236b70742 tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] 10.222.0.70 "GET /compute/v2.1/servers/e231e897-7343-415a-a4ff-dfe3df4fb62c" status: 200 len: 1474 microversion: 2.1 time: 0.459248 Aug 27 02:41:07.388288 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 202/408] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:06 2022] GET /compute/v2.1/servers/e231e897-7343-415a-a4ff-dfe3df4fb62c => generated 1474 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:07.764267 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-eb1e1671-d560-492a-a30d-f6f9772ae52c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:07.765859 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-eb1e1671-d560-492a-a30d-f6f9772ae52c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 29b88730-7871-4923-832e-a02d67f0314b] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:07.782562 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-eb1e1671-d560-492a-a30d-f6f9772ae52c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:07.782811 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-88d4990f-db76-4410-96de-a710557c5261 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:07.783923 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-eb1e1671-d560-492a-a30d-f6f9772ae52c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:07.785135 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-eb1e1671-d560-492a-a30d-f6f9772ae52c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:07.786599 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-eb1e1671-d560-492a-a30d-f6f9772ae52c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:07.788154 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-eb1e1671-d560-492a-a30d-f6f9772ae52c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:07.789802 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-eb1e1671-d560-492a-a30d-f6f9772ae52c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:07.814019 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-88d4990f-db76-4410-96de-a710557c5261 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:07.828247 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-88d4990f-db76-4410-96de-a710557c5261 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:07.829471 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-88d4990f-db76-4410-96de-a710557c5261 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/bb513027-efc1-4201-812f-39c88b423a9d" status: 200 len: 1362 microversion: 2.25 time: 0.531487 Aug 27 02:41:07.838679 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 207/409] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:41:07 2022] GET /compute/v2.1/servers/bb513027-efc1-4201-812f-39c88b423a9d => generated 1362 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:41:07.874666 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-26cd2b39-8629-4a2f-8ec9-1d9916095af3 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-332587377", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:41:07.962504 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-eb1e1671-d560-492a-a30d-f6f9772ae52c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:07.965399 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-eb1e1671-d560-492a-a30d-f6f9772ae52c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/29b88730-7871-4923-832e-a02d67f0314b" status: 200 len: 1263 microversion: 2.1 time: 0.205440 Aug 27 02:41:07.966198 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 203/410] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:07 2022] GET /compute/v2.1/servers/29b88730-7871-4923-832e-a02d67f0314b => generated 1263 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:41:08.026831 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.network.neutron [None req-26cd2b39-8629-4a2f-8ec9-1d9916095af3 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] validate_networks() for None {{(pid=134051) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:41:08.139446 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-3d4c7984-b541-4d1a-8b48-44fae52c0117 req-a52ed81e-20bf-4375-b8d9-a05b7a9c671e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e231e897-7343-415a-a4ff-dfe3df4fb62c", "name": "network-vif-deleted", "tag": "f06c3585-fe39-4c4c-91e7-6abc3d16d4bb"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:41:08.177634 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-3d4c7984-b541-4d1a-8b48-44fae52c0117 req-a52ed81e-20bf-4375-b8d9-a05b7a9c671e service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:08.178115 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-3d4c7984-b541-4d1a-8b48-44fae52c0117 req-a52ed81e-20bf-4375-b8d9-a05b7a9c671e service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:08.178841 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-3d4c7984-b541-4d1a-8b48-44fae52c0117 req-a52ed81e-20bf-4375-b8d9-a05b7a9c671e service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:08.230300 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-3d4c7984-b541-4d1a-8b48-44fae52c0117 req-a52ed81e-20bf-4375-b8d9-a05b7a9c671e service nova] Creating event network-vif-deleted:f06c3585-fe39-4c4c-91e7-6abc3d16d4bb for instance e231e897-7343-415a-a4ff-dfe3df4fb62c on n-h2-852278-4 Aug 27 02:41:08.255848 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-3d4c7984-b541-4d1a-8b48-44fae52c0117 req-a52ed81e-20bf-4375-b8d9-a05b7a9c671e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115258 Aug 27 02:41:08.258886 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 204/411] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:41:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:41:08.415310 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-06aa54f9-b7f5-4526-856b-08dc6307f5bb tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:08.416138 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-06aa54f9-b7f5-4526-856b-08dc6307f5bb tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] [instance: e231e897-7343-415a-a4ff-dfe3df4fb62c] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:08.443441 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-06aa54f9-b7f5-4526-856b-08dc6307f5bb tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:08.443938 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-06aa54f9-b7f5-4526-856b-08dc6307f5bb tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:08.446602 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-06aa54f9-b7f5-4526-856b-08dc6307f5bb tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:08.449169 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-06aa54f9-b7f5-4526-856b-08dc6307f5bb tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:08.449649 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-06aa54f9-b7f5-4526-856b-08dc6307f5bb tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:08.450080 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-06aa54f9-b7f5-4526-856b-08dc6307f5bb tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:08.599126 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-26cd2b39-8629-4a2f-8ec9-1d9916095af3 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Flavor limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:41:08.599552 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-26cd2b39-8629-4a2f-8ec9-1d9916095af3 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Image limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:41:08.600073 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-26cd2b39-8629-4a2f-8ec9-1d9916095af3 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Flavor pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:41:08.600672 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-26cd2b39-8629-4a2f-8ec9-1d9916095af3 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Image pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:41:08.601040 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-26cd2b39-8629-4a2f-8ec9-1d9916095af3 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:41:08.641438 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-26cd2b39-8629-4a2f-8ec9-1d9916095af3 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:08.645040 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-26cd2b39-8629-4a2f-8ec9-1d9916095af3 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:08.648296 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-26cd2b39-8629-4a2f-8ec9-1d9916095af3 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:08.649488 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-26cd2b39-8629-4a2f-8ec9-1d9916095af3 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:08.650871 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-26cd2b39-8629-4a2f-8ec9-1d9916095af3 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:08.651535 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-26cd2b39-8629-4a2f-8ec9-1d9916095af3 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:08.681562 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-06aa54f9-b7f5-4526-856b-08dc6307f5bb tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68711ff38ec41c0b051124527c7ac35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae179f416c451e92e270d2cb0f4400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:08.700001 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-26cd2b39-8629-4a2f-8ec9-1d9916095af3 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Getting quotas for project e4c28ddbdb164f01bb82235c6d49717b. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:41:08.705774 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-26cd2b39-8629-4a2f-8ec9-1d9916095af3 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Getting quotas for user 30abbf3afe304291981a6a9b85952aa3 and project e4c28ddbdb164f01bb82235c6d49717b. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:41:08.706076 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-06aa54f9-b7f5-4526-856b-08dc6307f5bb tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] 10.222.0.70 "GET /compute/v2.1/servers/e231e897-7343-415a-a4ff-dfe3df4fb62c" status: 200 len: 1304 microversion: 2.1 time: 0.293919 Aug 27 02:41:08.708192 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 205/412] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:08 2022] GET /compute/v2.1/servers/e231e897-7343-415a-a4ff-dfe3df4fb62c => generated 1304 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:41:08.720476 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-306ddaa8-4443-4cad-b962-9a706439cd80 req-ce2d5655-8010-4452-a061-7a336886c59a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb513027-efc1-4201-812f-39c88b423a9d", "name": "network-vif-plugged", "status": "completed", "tag": "00564c24-5898-44ae-8c51-440ac80fc61e"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:41:08.732659 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-26cd2b39-8629-4a2f-8ec9-1d9916095af3 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Going to run 1 instances... {{(pid=134051) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:41:08.735186 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-26cd2b39-8629-4a2f-8ec9-1d9916095af3 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] [instance: 9a6c0a3a-6693-4061-8765-cc07d3a5a1a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134051) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:41:08.756304 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=84,nova_api:DELETE=10,nova_api:INSERT=6 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:41:08.774011 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-306ddaa8-4443-4cad-b962-9a706439cd80 req-ce2d5655-8010-4452-a061-7a336886c59a service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:08.780972 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-306ddaa8-4443-4cad-b962-9a706439cd80 req-ce2d5655-8010-4452-a061-7a336886c59a service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:08.787581 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-306ddaa8-4443-4cad-b962-9a706439cd80 req-ce2d5655-8010-4452-a061-7a336886c59a service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:08.836804 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-306ddaa8-4443-4cad-b962-9a706439cd80 req-ce2d5655-8010-4452-a061-7a336886c59a service nova] Creating event network-vif-plugged:00564c24-5898-44ae-8c51-440ac80fc61e for instance bb513027-efc1-4201-812f-39c88b423a9d on n-h1-852278-4 Aug 27 02:41:08.846435 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-26cd2b39-8629-4a2f-8ec9-1d9916095af3 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.005526 Aug 27 02:41:08.860617 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 208/413] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 02:41:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1021 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:41:08.879992 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-306ddaa8-4443-4cad-b962-9a706439cd80 req-ce2d5655-8010-4452-a061-7a336886c59a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.167838 Aug 27 02:41:08.886393 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 206/414] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:41:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:41:08.898528 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-94f0f3f6-958b-4b1f-8d38-8be470cd8e96 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:08.901809 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-94f0f3f6-958b-4b1f-8d38-8be470cd8e96 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: bb513027-efc1-4201-812f-39c88b423a9d] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:08.935769 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-94f0f3f6-958b-4b1f-8d38-8be470cd8e96 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:08.938845 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-94f0f3f6-958b-4b1f-8d38-8be470cd8e96 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:08.939307 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-94f0f3f6-958b-4b1f-8d38-8be470cd8e96 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:08.940035 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-94f0f3f6-958b-4b1f-8d38-8be470cd8e96 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:08.943187 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-94f0f3f6-958b-4b1f-8d38-8be470cd8e96 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:08.944055 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-94f0f3f6-958b-4b1f-8d38-8be470cd8e96 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:09.409647 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-967716ae-c8df-4d04-acfb-59180387c15e tempest-FlavorsAdminTestJSON-467331089 tempest-FlavorsAdminTestJSON-467331089-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-723160567", "id": 1092161242, "os-flavor-access:is_public": "True"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:41:09.478724 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-967716ae-c8df-4d04-acfb-59180387c15e tempest-FlavorsAdminTestJSON-467331089 tempest-FlavorsAdminTestJSON-467331089-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.612859 Aug 27 02:41:09.481029 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 209/415] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 02:41:08 2022] POST /compute/v2.1/flavors => generated 429 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:41:09.489667 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b5bd57e2-a7db-4541-a8d9-a7337855bff9 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:09.497069 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b5bd57e2-a7db-4541-a8d9-a7337855bff9 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] [instance: 9a6c0a3a-6693-4061-8765-cc07d3a5a1a0] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:09.692662 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-94f0f3f6-958b-4b1f-8d38-8be470cd8e96 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:09.704228 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-b5bd57e2-a7db-4541-a8d9-a7337855bff9 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30abbf3afe304291981a6a9b85952aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c28ddbdb164f01bb82235c6d49717b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:09.707710 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-94f0f3f6-958b-4b1f-8d38-8be470cd8e96 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:09.709418 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-94f0f3f6-958b-4b1f-8d38-8be470cd8e96 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:09.710953 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-94f0f3f6-958b-4b1f-8d38-8be470cd8e96 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/bb513027-efc1-4201-812f-39c88b423a9d" status: 200 len: 1362 microversion: 2.25 time: 0.822675 Aug 27 02:41:09.712044 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 207/416] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:41:08 2022] GET /compute/v2.1/servers/bb513027-efc1-4201-812f-39c88b423a9d => generated 1362 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:41:09.723445 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b5bd57e2-a7db-4541-a8d9-a7337855bff9 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] 10.222.0.70 "GET /compute/v2.1/servers/9a6c0a3a-6693-4061-8765-cc07d3a5a1a0" status: 200 len: 1213 microversion: 2.1 time: 0.237725 Aug 27 02:41:09.724337 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 210/417] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:09 2022] GET /compute/v2.1/servers/9a6c0a3a-6693-4061-8765-cc07d3a5a1a0 => generated 1213 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:09.729364 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4a011df8-8397-4c48-814f-45d2bb60e05c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:09.730649 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-4a011df8-8397-4c48-814f-45d2bb60e05c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 29b88730-7871-4923-832e-a02d67f0314b] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:09.741394 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4a011df8-8397-4c48-814f-45d2bb60e05c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:09.742090 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4a011df8-8397-4c48-814f-45d2bb60e05c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:09.743050 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4a011df8-8397-4c48-814f-45d2bb60e05c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:09.743987 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4a011df8-8397-4c48-814f-45d2bb60e05c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:09.744717 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4a011df8-8397-4c48-814f-45d2bb60e05c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:09.745328 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4a011df8-8397-4c48-814f-45d2bb60e05c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:09.832461 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-4a011df8-8397-4c48-814f-45d2bb60e05c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:09.846335 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-4a011df8-8397-4c48-814f-45d2bb60e05c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/29b88730-7871-4923-832e-a02d67f0314b" status: 200 len: 1269 microversion: 2.1 time: 0.120366 Aug 27 02:41:09.848160 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 211/418] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:09 2022] GET /compute/v2.1/servers/29b88730-7871-4923-832e-a02d67f0314b => generated 1269 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:09.925900 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ef1a4814-9f24-43c4-8035-ce0e04fb3bb4 tempest-FlavorsAccessTestJSON-2099208019 tempest-FlavorsAccessTestJSON-2099208019-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-886748211", "id": 964641502, "os-flavor-access:is_public": "False"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:41:09.934873 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-1c22638d-3055-4acc-91e8-d3aefb312226 tempest-FlavorsExtraSpecsNegativeTestJSON-568325687 tempest-FlavorsExtraSpecsNegativeTestJSON-568325687-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-143673753", "ram": 512, "vcpus": 1, "disk": 10, "id": 1437512396, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:41:09.956175 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ef1a4814-9f24-43c4-8035-ce0e04fb3bb4 tempest-FlavorsAccessTestJSON-2099208019 tempest-FlavorsAccessTestJSON-2099208019-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.105430 Aug 27 02:41:09.959202 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-1c22638d-3055-4acc-91e8-d3aefb312226 tempest-FlavorsExtraSpecsNegativeTestJSON-568325687 tempest-FlavorsExtraSpecsNegativeTestJSON-568325687-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.245885 Aug 27 02:41:09.959792 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 208/419] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 02:41:09 2022] POST /compute/v2.1/flavors => generated 415 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:41:09.965534 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e94df808-f6f8-49ad-bd07-cbf178b6c3a2 tempest-FlavorsAdminTestJSON-467331089 tempest-FlavorsAdminTestJSON-467331089-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:09.966913 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 212/420] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 02:41:09 2022] POST /compute/v2.1/flavors => generated 427 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:41:09.974630 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ad49f370-f945-4a75-8736-e9b59ec2317f tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:09.975444 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-ad49f370-f945-4a75-8736-e9b59ec2317f tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] [instance: e231e897-7343-415a-a4ff-dfe3df4fb62c] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:09.985547 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ad49f370-f945-4a75-8736-e9b59ec2317f tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:09.989385 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ad49f370-f945-4a75-8736-e9b59ec2317f tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:09.990393 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ad49f370-f945-4a75-8736-e9b59ec2317f tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:09.991710 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ad49f370-f945-4a75-8736-e9b59ec2317f tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:09.992610 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ad49f370-f945-4a75-8736-e9b59ec2317f tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:09.993410 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ad49f370-f945-4a75-8736-e9b59ec2317f tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:09.994039 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e94df808-f6f8-49ad-bd07-cbf178b6c3a2 tempest-FlavorsAdminTestJSON-467331089 tempest-FlavorsAdminTestJSON-467331089-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/1092161242" status: 202 len: 0 microversion: 2.1 time: 0.032978 Aug 27 02:41:09.995307 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 209/421] 10.222.0.70 () {58 vars in 1161 bytes} [Sat Aug 27 02:41:09 2022] DELETE /compute/v2.1/flavors/1092161242 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:41:10.000760 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-7a7c4dbc-e06a-4e02-8a5d-cfa068ede322 tempest-FlavorsAccessTestJSON-2099208019 tempest-FlavorsAccessTestJSON-2099208019-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "28577d5ee4d14026a73ac8f515ed34fb"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:41:10.022660 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-ad49f370-f945-4a75-8736-e9b59ec2317f tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] HTTP exception thrown: Instance e231e897-7343-415a-a4ff-dfe3df4fb62c could not be found. Aug 27 02:41:10.024796 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ad49f370-f945-4a75-8736-e9b59ec2317f tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Request method failure captured: Aug 27 02:41:10.024796 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/e231e897-7343-415a-a4ff-dfe3df4fb62c HTTP/1.1 Aug 27 02:41:10.024796 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:41:10.024796 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:41:10.024796 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:41:10.024796 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:41:10.024796 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:41:10.024796 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:41:10.024796 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:41:10.024796 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:41:10.024796 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYQNxGW88PeewB6jo1ZCIlfVrzvtuNyiSxvMtqjpVtU2xPmO5OhfiF1zvx2Mr4b4K1bd3aDXzbhXR7WdAjyWjEi_MVi0gI_CvaBfii-ZfFG5Fnmf3GQCvT2foaEOZ_5k4VImtt1zZoNrdnnmAHpE_iSYhJ1gtWtPl3wBfsco4TcOlts Aug 27 02:41:10.024796 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:41:10.024796 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:41:10.024796 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:41:10.024796 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:41:10.024796 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:41:10.024796 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:41:10.024796 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 82ae179f416c451e92e270d2cb0f4400 Aug 27 02:41:10.024796 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-LiveMigrationNegativeTest-1452605987 Aug 27 02:41:10.024796 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:41:10.024796 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:41:10.026271 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/82ae179f416c451e92e270d2cb0f4400"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_82ae179f416c451e92e270d2cb0f4400", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/82ae179f416c451e92e270d2cb0f4400"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/82ae179f416c451e92e270d2cb0f4400"}]}] Aug 27 02:41:10.026271 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-LiveMigrationNegativeTest-1452605987 Aug 27 02:41:10.026271 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 82ae179f416c451e92e270d2cb0f4400 Aug 27 02:41:10.026271 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1452605987 Aug 27 02:41:10.026271 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-LiveMigrationNegativeTest-1452605987-project Aug 27 02:41:10.026271 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:41:10.026271 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:41:10.026271 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: d68711ff38ec41c0b051124527c7ac35 Aug 27 02:41:10.026271 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-LiveMigrationNegativeTest-1452605987-project Aug 27 02:41:10.026271 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 02:41:10.026271 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance e231e897-7343-415a-a4ff-dfe3df4fb62c could not be found. Aug 27 02:41:10.026271 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': 'e231e897-7343-415a-a4ff-dfe3df4fb62c'} Aug 27 02:41:10.027055 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:41:10.027055 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:41:10.027055 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:41:10.027055 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:41:10.027055 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:41:10.027055 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:41:10.027055 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:41:10.027055 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:41:10.027055 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:41:10.027055 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:41:10.027055 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e231e897-7343-415a-a4ff-dfe3df4fb62c could not be found. Aug 27 02:41:10.027055 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:41:10.027055 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:41:10.027055 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:41:10.027055 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:41:10.027055 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:41:10.027055 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:41:10.027055 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:41:10.027055 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:41:10.027055 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:41:10.028340 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:41:10.028340 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:41:10.028340 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:41:10.028340 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:41:10.028340 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:41:10.028340 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:41:10.028340 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:41:10.028340 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e231e897-7343-415a-a4ff-dfe3df4fb62c could not be found. Aug 27 02:41:10.028340 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:41:10.028340 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:41:10.028340 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:41:10.028340 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:41:10.028340 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:41:10.028340 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:41:10.028340 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:41:10.028340 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:41:10.028340 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e231e897-7343-415a-a4ff-dfe3df4fb62c could not be found. Aug 27 02:41:10.028340 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:41:10.030526 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ad49f370-f945-4a75-8736-e9b59ec2317f tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] Returning 404 to user: Instance e231e897-7343-415a-a4ff-dfe3df4fb62c could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:41:10.031906 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ad49f370-f945-4a75-8736-e9b59ec2317f tempest-LiveMigrationNegativeTest-1452605987 tempest-LiveMigrationNegativeTest-1452605987-project] 10.222.0.70 "GET /compute/v2.1/servers/e231e897-7343-415a-a4ff-dfe3df4fb62c" status: 404 len: 111 microversion: 2.1 time: 0.063458 Aug 27 02:41:10.033072 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 213/422] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:09 2022] GET /compute/v2.1/servers/e231e897-7343-415a-a4ff-dfe3df4fb62c => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:41:10.170373 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-7a7c4dbc-e06a-4e02-8a5d-cfa068ede322 tempest-FlavorsAccessTestJSON-2099208019 tempest-FlavorsAccessTestJSON-2099208019-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors/964641502/action" status: 200 len: 96 microversion: 2.1 time: 0.173750 Aug 27 02:41:10.175213 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 210/423] 10.222.0.70 () {60 vars in 1197 bytes} [Sat Aug 27 02:41:09 2022] POST /compute/v2.1/flavors/964641502/action => generated 96 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:41:10.181924 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-88f1fee5-c013-4f17-af34-df99681381c4 tempest-FlavorsAdminTestJSON-467331089 tempest-FlavorsAdminTestJSON-467331089-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:10.251186 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-88f1fee5-c013-4f17-af34-df99681381c4 tempest-FlavorsAdminTestJSON-467331089 tempest-FlavorsAdminTestJSON-467331089-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 6219 microversion: 2.1 time: 0.074621 Aug 27 02:41:10.269677 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 211/424] 10.222.0.70 () {58 vars in 1146 bytes} [Sat Aug 27 02:41:10 2022] GET /compute/v2.1/flavors/detail => generated 6219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:10.453612 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-aea7fd37-7829-49d9-91ec-e6e8c71966c4 tempest-FlavorsExtraSpecsNegativeTestJSON-1205481843 tempest-FlavorsExtraSpecsNegativeTestJSON-1205481843-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:10.477791 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-aea7fd37-7829-49d9-91ec-e6e8c71966c4 tempest-FlavorsExtraSpecsNegativeTestJSON-1205481843 tempest-FlavorsExtraSpecsNegativeTestJSON-1205481843-project] HTTP exception thrown: Flavor 1437512396 has no extra specs with key hw:cpu_thread_policy. Aug 27 02:41:10.488197 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-aea7fd37-7829-49d9-91ec-e6e8c71966c4 tempest-FlavorsExtraSpecsNegativeTestJSON-1205481843 tempest-FlavorsExtraSpecsNegativeTestJSON-1205481843-project] Request method failure captured: Aug 27 02:41:10.488197 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/flavors/1437512396/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Aug 27 02:41:10.488197 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:41:10.488197 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:41:10.488197 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:41:10.488197 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:41:10.488197 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:41:10.488197 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:41:10.488197 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:41:10.488197 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:41:10.488197 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYRCayRpn28NooPgO0-Q0TzdeLKr4iHwScIbH1uS_efEUoORFq8Ii_cl3rHXRNEA_V0IFF4OUDT89r6abS4aw_7Vvz1f1wXW324uxa5XNijKU8gMar5HTrnR6waZI9qP-eW21N4CgHspFacOXkK1LL5qtxnSxxQ-zKMM-5vlBzKJqOc Aug 27 02:41:10.488197 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:41:10.488197 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:41:10.488197 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:41:10.488197 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:41:10.488197 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:41:10.488197 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:41:10.488197 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: e85d7774925941de88eedc5666fbd81f Aug 27 02:41:10.488197 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1205481843 Aug 27 02:41:10.488197 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:41:10.488197 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:41:10.489692 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e85d7774925941de88eedc5666fbd81f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_e85d7774925941de88eedc5666fbd81f", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e85d7774925941de88eedc5666fbd81f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/e85d7774925941de88eedc5666fbd81f"}]}] Aug 27 02:41:10.489692 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1205481843 Aug 27 02:41:10.489692 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: e85d7774925941de88eedc5666fbd81f Aug 27 02:41:10.489692 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1205481843 Aug 27 02:41:10.489692 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1205481843-project Aug 27 02:41:10.489692 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:41:10.489692 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:41:10.489692 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 13e90f8e6dde40dcaa05dc4ee62975b1 Aug 27 02:41:10.489692 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1205481843-project Aug 27 02:41:10.489692 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 02:41:10.489692 n-d-852278-4 devstack@n-api.service[134051]: exception: Flavor 1437512396 has no extra specs with key hw:cpu_thread_policy. Aug 27 02:41:10.490469 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'flavor_id': '1437512396', 'id': 'hw:cpu_thread_policy'} Aug 27 02:41:10.490469 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:41:10.490469 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:41:10.490469 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Aug 27 02:41:10.490469 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Aug 27 02:41:10.490469 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Aug 27 02:41:10.490469 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:41:10.490469 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:41:10.490469 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:41:10.490469 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:41:10.490469 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:41:10.490469 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:41:10.490469 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:41:10.490469 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:41:10.490469 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:41:10.490469 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:41:10.490469 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Aug 27 02:41:10.490469 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 27 02:41:10.490469 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1437512396 has no extra specs with key hw:cpu_thread_policy. Aug 27 02:41:10.490469 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:41:10.490469 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:41:10.490469 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:41:10.491936 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:41:10.491936 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:41:10.491936 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:41:10.491936 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:41:10.491936 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:41:10.491936 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1437512396 has no extra specs with key hw:cpu_thread_policy. Aug 27 02:41:10.491936 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:41:10.491936 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-aea7fd37-7829-49d9-91ec-e6e8c71966c4 tempest-FlavorsExtraSpecsNegativeTestJSON-1205481843 tempest-FlavorsExtraSpecsNegativeTestJSON-1205481843-project] Returning 404 to user: Flavor 1437512396 has no extra specs with key hw:cpu_thread_policy. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:41:10.491936 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-aea7fd37-7829-49d9-91ec-e6e8c71966c4 tempest-FlavorsExtraSpecsNegativeTestJSON-1205481843 tempest-FlavorsExtraSpecsNegativeTestJSON-1205481843-project] 10.222.0.70 "GET /compute/v2.1/flavors/1437512396/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.455501 Aug 27 02:41:10.500571 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 214/425] 10.222.0.70 () {58 vars in 1266 bytes} [Sat Aug 27 02:41:10 2022] GET /compute/v2.1/flavors/1437512396/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 467 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:41:10.519357 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-cf21145d-8400-4d11-8ae5-bc9efa20b77d tempest-FlavorsAdminTestJSON-467331089 tempest-FlavorsAdminTestJSON-467331089-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-828776780", "id": 19623043, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:41:10.595806 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-cf21145d-8400-4d11-8ae5-bc9efa20b77d tempest-FlavorsAdminTestJSON-467331089 tempest-FlavorsAdminTestJSON-467331089-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.090289 Aug 27 02:41:10.606561 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 215/426] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 02:41:10 2022] POST /compute/v2.1/flavors => generated 410 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:41:10.623610 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-bb56833e-f1ad-4354-ade7-8f0782c9c23f tempest-FlavorsExtraSpecsNegativeTestJSON-1205481843 tempest-FlavorsExtraSpecsNegativeTestJSON-1205481843-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:41:10.635196 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-bb56833e-f1ad-4354-ade7-8f0782c9c23f tempest-FlavorsExtraSpecsNegativeTestJSON-1205481843 tempest-FlavorsExtraSpecsNegativeTestJSON-1205481843-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '13e90f8e6dde40dcaa05dc4ee62975b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85d7774925941de88eedc5666fbd81f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:10.638650 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-bb56833e-f1ad-4354-ade7-8f0782c9c23f tempest-FlavorsExtraSpecsNegativeTestJSON-1205481843 tempest-FlavorsExtraSpecsNegativeTestJSON-1205481843-project] Request method failure captured: Aug 27 02:41:10.638650 n-d-852278-4 devstack@n-api.service[134051]: request: POST /compute/v2.1/flavors/1437512396/os-extra_specs HTTP/1.1 Aug 27 02:41:10.638650 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:41:10.638650 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:41:10.638650 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:41:10.638650 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 66 Aug 27 02:41:10.638650 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:41:10.638650 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:41:10.638650 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:41:10.638650 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:41:10.638650 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYRCayRpn28NooPgO0-Q0TzdeLKr4iHwScIbH1uS_efEUoORFq8Ii_cl3rHXRNEA_V0IFF4OUDT89r6abS4aw_7Vvz1f1wXW324uxa5XNijKU8gMar5HTrnR6waZI9qP-eW21N4CgHspFacOXkK1LL5qtxnSxxQ-zKMM-5vlBzKJqOc Aug 27 02:41:10.638650 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:41:10.638650 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:41:10.638650 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:41:10.638650 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:41:10.638650 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:41:10.638650 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:41:10.638650 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: e85d7774925941de88eedc5666fbd81f Aug 27 02:41:10.638650 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1205481843 Aug 27 02:41:10.638650 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:41:10.638650 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:41:10.640898 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e85d7774925941de88eedc5666fbd81f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_e85d7774925941de88eedc5666fbd81f", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e85d7774925941de88eedc5666fbd81f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/e85d7774925941de88eedc5666fbd81f"}]}] Aug 27 02:41:10.640898 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1205481843 Aug 27 02:41:10.640898 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: e85d7774925941de88eedc5666fbd81f Aug 27 02:41:10.640898 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1205481843 Aug 27 02:41:10.640898 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1205481843-project Aug 27 02:41:10.640898 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:41:10.640898 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:41:10.640898 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 13e90f8e6dde40dcaa05dc4ee62975b1 Aug 27 02:41:10.640898 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1205481843-project Aug 27 02:41:10.640898 n-d-852278-4 devstack@n-api.service[134051]: Aug 27 02:41:10.640898 n-d-852278-4 devstack@n-api.service[134051]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Aug 27 02:41:10.640898 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 02:41:10.641780 n-d-852278-4 devstack@n-api.service[134051]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 27 02:41:10.641780 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'flavor_id': '1437512396', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Aug 27 02:41:10.641780 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:41:10.641780 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:41:10.641780 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:41:10.641780 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:41:10.641780 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:41:10.641780 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:41:10.641780 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:41:10.641780 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:41:10.641780 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:41:10.641780 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:41:10.641780 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Aug 27 02:41:10.641780 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Aug 27 02:41:10.641780 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 02:41:10.641780 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 02:41:10.641780 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 02:41:10.641780 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 02:41:10.641780 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 02:41:10.643024 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 02:41:10.643024 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 02:41:10.643024 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 02:41:10.643024 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 02:41:10.643024 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 02:41:10.643024 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 02:41:10.643024 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 02:41:10.643024 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 02:41:10.643024 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 02:41:10.643024 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 27 02:41:10.643024 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:41:10.643024 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:41:10.643024 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:41:10.643024 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:41:10.643024 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:41:10.643024 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:41:10.643024 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 02:41:10.643024 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 02:41:10.643024 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 27 02:41:10.643024 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:41:10.651008 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-bb56833e-f1ad-4354-ade7-8f0782c9c23f tempest-FlavorsExtraSpecsNegativeTestJSON-1205481843 tempest-FlavorsExtraSpecsNegativeTestJSON-1205481843-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:41:10.652162 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-bb56833e-f1ad-4354-ade7-8f0782c9c23f tempest-FlavorsExtraSpecsNegativeTestJSON-1205481843 tempest-FlavorsExtraSpecsNegativeTestJSON-1205481843-project] 10.222.0.70 "POST /compute/v2.1/flavors/1437512396/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.043220 Aug 27 02:41:10.657459 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 216/427] 10.222.0.70 () {60 vars in 1224 bytes} [Sat Aug 27 02:41:10 2022] POST /compute/v2.1/flavors/1437512396/os-extra_specs => generated 124 bytes in 50 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:41:10.662682 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-cb26dc8d-7e71-404d-b540-c563a59d2ea1 tempest-FlavorsAdminTestJSON-467331089 tempest-FlavorsAdminTestJSON-467331089-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:10.690895 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-cb26dc8d-7e71-404d-b540-c563a59d2ea1 tempest-FlavorsAdminTestJSON-467331089 tempest-FlavorsAdminTestJSON-467331089-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 6619 microversion: 2.1 time: 0.031184 Aug 27 02:41:10.705131 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 217/428] 10.222.0.70 () {58 vars in 1146 bytes} [Sat Aug 27 02:41:10 2022] GET /compute/v2.1/flavors/detail => generated 6619 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:10.717589 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-79102b72-c6c5-42bd-a243-2d84f5cbc72b tempest-FlavorsExtraSpecsNegativeTestJSON-568325687 tempest-FlavorsExtraSpecsNegativeTestJSON-568325687-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:41:10.781124 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=2,nova_api:INSERT=10,nova_api:SAVEPOINT=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:41:10.832006 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-79102b72-c6c5-42bd-a243-2d84f5cbc72b tempest-FlavorsExtraSpecsNegativeTestJSON-568325687 tempest-FlavorsExtraSpecsNegativeTestJSON-568325687-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors/1437512396/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.131318 Aug 27 02:41:10.832792 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 218/429] 10.222.0.70 () {60 vars in 1224 bytes} [Sat Aug 27 02:41:10 2022] POST /compute/v2.1/flavors/1437512396/os-extra_specs => generated 66 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:41:10.869359 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c4141fd4-1c6e-4fec-bd70-79ea0a538b1a tempest-FlavorsAdminTestJSON-467331089 tempest-FlavorsAdminTestJSON-467331089-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:10.937282 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b31d0269-a921-474b-a81c-131ba87e6be2 tempest-FlavorsAccessTestJSON-139417142 tempest-FlavorsAccessTestJSON-139417142-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:10.955202 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c4141fd4-1c6e-4fec-bd70-79ea0a538b1a tempest-FlavorsAdminTestJSON-467331089 tempest-FlavorsAdminTestJSON-467331089-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/19623043" status: 202 len: 0 microversion: 2.1 time: 0.115944 Aug 27 02:41:10.955867 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 219/430] 10.222.0.70 () {58 vars in 1155 bytes} [Sat Aug 27 02:41:10 2022] DELETE /compute/v2.1/flavors/19623043 => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:41:10.965227 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-32220b28-9f00-4573-b1ed-31ab20f81da5 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:10.966076 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-32220b28-9f00-4573-b1ed-31ab20f81da5 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: bb513027-efc1-4201-812f-39c88b423a9d] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:10.974632 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-32220b28-9f00-4573-b1ed-31ab20f81da5 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:10.975300 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-32220b28-9f00-4573-b1ed-31ab20f81da5 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:10.975916 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-32220b28-9f00-4573-b1ed-31ab20f81da5 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:10.976799 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-32220b28-9f00-4573-b1ed-31ab20f81da5 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:10.977621 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-32220b28-9f00-4573-b1ed-31ab20f81da5 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:10.978220 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-32220b28-9f00-4573-b1ed-31ab20f81da5 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:11.029960 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b31d0269-a921-474b-a81c-131ba87e6be2 tempest-FlavorsAccessTestJSON-139417142 tempest-FlavorsAccessTestJSON-139417142-project] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 6636 microversion: 2.1 time: 0.757356 Aug 27 02:41:11.040647 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 212/431] 10.222.0.70 () {58 vars in 1146 bytes} [Sat Aug 27 02:41:10 2022] GET /compute/v2.1/flavors/detail => generated 6636 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:11.048652 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f36acb8e-441f-4df8-a802-792805d67fb9 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:11.049504 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-f36acb8e-441f-4df8-a802-792805d67fb9 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] [instance: 9a6c0a3a-6693-4061-8765-cc07d3a5a1a0] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:11.066414 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f36acb8e-441f-4df8-a802-792805d67fb9 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:11.068255 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f36acb8e-441f-4df8-a802-792805d67fb9 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:11.068963 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f36acb8e-441f-4df8-a802-792805d67fb9 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:11.073587 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f36acb8e-441f-4df8-a802-792805d67fb9 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:11.074284 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f36acb8e-441f-4df8-a802-792805d67fb9 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:11.075163 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f36acb8e-441f-4df8-a802-792805d67fb9 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:11.288940 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-f36acb8e-441f-4df8-a802-792805d67fb9 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30abbf3afe304291981a6a9b85952aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c28ddbdb164f01bb82235c6d49717b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:11.301327 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f36acb8e-441f-4df8-a802-792805d67fb9 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] 10.222.0.70 "GET /compute/v2.1/servers/9a6c0a3a-6693-4061-8765-cc07d3a5a1a0" status: 200 len: 1265 microversion: 2.1 time: 0.259238 Aug 27 02:41:11.302907 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 213/432] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:11 2022] GET /compute/v2.1/servers/9a6c0a3a-6693-4061-8765-cc07d3a5a1a0 => generated 1265 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:11.319721 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4c831fce-7828-478f-ac13-40d876607737 tempest-FlavorsExtraSpecsNegativeTestJSON-1205481843 tempest-FlavorsExtraSpecsNegativeTestJSON-1205481843-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:11.321686 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-4c831fce-7828-478f-ac13-40d876607737 tempest-FlavorsExtraSpecsNegativeTestJSON-1205481843 tempest-FlavorsExtraSpecsNegativeTestJSON-1205481843-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '13e90f8e6dde40dcaa05dc4ee62975b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85d7774925941de88eedc5666fbd81f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:11.324127 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4c831fce-7828-478f-ac13-40d876607737 tempest-FlavorsExtraSpecsNegativeTestJSON-1205481843 tempest-FlavorsExtraSpecsNegativeTestJSON-1205481843-project] Request method failure captured: Aug 27 02:41:11.324127 n-d-852278-4 devstack@n-api.service[134052]: request: DELETE /compute/v2.1/flavors/1437512396/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 27 02:41:11.324127 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:41:11.324127 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:41:11.324127 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:41:11.324127 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:41:11.324127 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:41:11.324127 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:41:11.324127 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:41:11.324127 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:41:11.324127 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYRCayRpn28NooPgO0-Q0TzdeLKr4iHwScIbH1uS_efEUoORFq8Ii_cl3rHXRNEA_V0IFF4OUDT89r6abS4aw_7Vvz1f1wXW324uxa5XNijKU8gMar5HTrnR6waZI9qP-eW21N4CgHspFacOXkK1LL5qtxnSxxQ-zKMM-5vlBzKJqOc Aug 27 02:41:11.324127 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:41:11.324127 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:41:11.324127 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:41:11.324127 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:41:11.324127 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:41:11.324127 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:41:11.324127 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: e85d7774925941de88eedc5666fbd81f Aug 27 02:41:11.324127 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1205481843 Aug 27 02:41:11.324127 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:41:11.324127 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:41:11.325396 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e85d7774925941de88eedc5666fbd81f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_e85d7774925941de88eedc5666fbd81f", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e85d7774925941de88eedc5666fbd81f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/e85d7774925941de88eedc5666fbd81f"}]}] Aug 27 02:41:11.325396 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1205481843 Aug 27 02:41:11.325396 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: e85d7774925941de88eedc5666fbd81f Aug 27 02:41:11.325396 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1205481843 Aug 27 02:41:11.325396 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1205481843-project Aug 27 02:41:11.325396 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:41:11.325396 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:41:11.325396 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 13e90f8e6dde40dcaa05dc4ee62975b1 Aug 27 02:41:11.325396 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1205481843-project Aug 27 02:41:11.325396 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 02:41:11.325396 n-d-852278-4 devstack@n-api.service[134052]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 27 02:41:11.326004 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'flavor_id': '1437512396', 'id': 'hw:numa_nodes'} Aug 27 02:41:11.326004 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:41:11.326004 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:41:11.326004 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:41:11.326004 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:41:11.326004 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:41:11.326004 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:41:11.326004 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:41:11.326004 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:41:11.326004 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Aug 27 02:41:11.326004 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Aug 27 02:41:11.326004 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 02:41:11.326004 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 02:41:11.326004 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 02:41:11.326004 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 02:41:11.326004 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 02:41:11.326004 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 02:41:11.326004 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 02:41:11.326004 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 02:41:11.326004 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 02:41:11.327128 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 02:41:11.327128 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 02:41:11.327128 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 02:41:11.327128 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 02:41:11.327128 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 02:41:11.327128 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 27 02:41:11.327128 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:41:11.327128 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:41:11.327128 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:41:11.327128 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:41:11.327128 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:41:11.327128 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:41:11.327128 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 02:41:11.327128 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 02:41:11.327128 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 27 02:41:11.327128 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:41:11.333961 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4c831fce-7828-478f-ac13-40d876607737 tempest-FlavorsExtraSpecsNegativeTestJSON-1205481843 tempest-FlavorsExtraSpecsNegativeTestJSON-1205481843-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:41:11.340976 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-4c831fce-7828-478f-ac13-40d876607737 tempest-FlavorsExtraSpecsNegativeTestJSON-1205481843 tempest-FlavorsExtraSpecsNegativeTestJSON-1205481843-project] 10.222.0.70 "DELETE /compute/v2.1/flavors/1437512396/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.034108 Aug 27 02:41:11.341952 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 214/433] 10.222.0.70 () {58 vars in 1248 bytes} [Sat Aug 27 02:41:11 2022] DELETE /compute/v2.1/flavors/1437512396/os-extra_specs/hw:numa_nodes => generated 124 bytes in 36 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:41:11.353110 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-949fefc2-9d9c-4ab5-b9ae-d5708d081a67 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:11.354113 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-949fefc2-9d9c-4ab5-b9ae-d5708d081a67 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 29b88730-7871-4923-832e-a02d67f0314b] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:11.372700 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-949fefc2-9d9c-4ab5-b9ae-d5708d081a67 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:11.373362 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-949fefc2-9d9c-4ab5-b9ae-d5708d081a67 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:11.378692 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-949fefc2-9d9c-4ab5-b9ae-d5708d081a67 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:11.379672 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-949fefc2-9d9c-4ab5-b9ae-d5708d081a67 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:11.380401 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-949fefc2-9d9c-4ab5-b9ae-d5708d081a67 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:11.381088 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-949fefc2-9d9c-4ab5-b9ae-d5708d081a67 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:11.411410 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-32220b28-9f00-4573-b1ed-31ab20f81da5 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:11.422683 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-32220b28-9f00-4573-b1ed-31ab20f81da5 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:11.424199 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-32220b28-9f00-4573-b1ed-31ab20f81da5 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:11.425436 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-32220b28-9f00-4573-b1ed-31ab20f81da5 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/bb513027-efc1-4201-812f-39c88b423a9d" status: 200 len: 1558 microversion: 2.25 time: 0.464334 Aug 27 02:41:11.430107 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 220/434] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:41:10 2022] GET /compute/v2.1/servers/bb513027-efc1-4201-812f-39c88b423a9d => generated 1558 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:41:11.446970 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-590245c3-af66-492f-8509-27a5f14cb816 tempest-FlavorsAdminTestJSON-467331089 tempest-FlavorsAdminTestJSON-467331089-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:11.483290 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-590245c3-af66-492f-8509-27a5f14cb816 tempest-FlavorsAdminTestJSON-467331089 tempest-FlavorsAdminTestJSON-467331089-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 6219 microversion: 2.1 time: 0.051821 Aug 27 02:41:11.487424 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 221/435] 10.222.0.70 () {58 vars in 1146 bytes} [Sat Aug 27 02:41:11 2022] GET /compute/v2.1/flavors/detail => generated 6219 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:11.499728 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3970d610-851d-4921-a655-e3edf1abb8cc tempest-FlavorsAccessTestJSON-2099208019 tempest-FlavorsAccessTestJSON-2099208019-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "28577d5ee4d14026a73ac8f515ed34fb"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:41:11.686842 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-3970d610-851d-4921-a655-e3edf1abb8cc tempest-FlavorsAccessTestJSON-2099208019 tempest-FlavorsAccessTestJSON-2099208019-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors/964641502/action" status: 200 len: 21 microversion: 2.1 time: 0.195555 Aug 27 02:41:11.689324 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 222/436] 10.222.0.70 () {60 vars in 1197 bytes} [Sat Aug 27 02:41:11 2022] POST /compute/v2.1/flavors/964641502/action => generated 21 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:41:11.702899 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8be11cd6-f2a8-43da-9418-85504fbd74b9 tempest-FlavorsExtraSpecsNegativeTestJSON-568325687 tempest-FlavorsExtraSpecsNegativeTestJSON-568325687-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:41:11.731906 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-8be11cd6-f2a8-43da-9418-85504fbd74b9 tempest-FlavorsExtraSpecsNegativeTestJSON-568325687 tempest-FlavorsExtraSpecsNegativeTestJSON-568325687-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors/1437512396/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.041252 Aug 27 02:41:11.733136 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 223/437] 10.222.0.70 () {60 vars in 1224 bytes} [Sat Aug 27 02:41:11 2022] POST /compute/v2.1/flavors/1437512396/os-extra_specs => generated 66 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:41:11.739105 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-564d5224-43f4-4420-959d-e686013cec85 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:11.739980 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-564d5224-43f4-4420-959d-e686013cec85 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] [instance: bb513027-efc1-4201-812f-39c88b423a9d] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:11.752636 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-564d5224-43f4-4420-959d-e686013cec85 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:11.754785 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-564d5224-43f4-4420-959d-e686013cec85 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:11.755341 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-564d5224-43f4-4420-959d-e686013cec85 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:11.756871 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-564d5224-43f4-4420-959d-e686013cec85 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:11.760367 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-564d5224-43f4-4420-959d-e686013cec85 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:11.761031 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-564d5224-43f4-4420-959d-e686013cec85 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:11.992283 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-949fefc2-9d9c-4ab5-b9ae-d5708d081a67 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:12.005868 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-949fefc2-9d9c-4ab5-b9ae-d5708d081a67 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/29b88730-7871-4923-832e-a02d67f0314b" status: 200 len: 1311 microversion: 2.1 time: 0.662395 Aug 27 02:41:12.020803 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 215/438] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:11 2022] GET /compute/v2.1/servers/29b88730-7871-4923-832e-a02d67f0314b => generated 1311 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:12.029716 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-beb79bda-07f2-4e32-8daa-dff562266599 tempest-FlavorsAdminTestJSON-467331089 tempest-FlavorsAdminTestJSON-467331089-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-320967342", "id": 138146387, "os-flavor-access:is_public": "True"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:41:12.055097 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-beb79bda-07f2-4e32-8daa-dff562266599 tempest-FlavorsAdminTestJSON-467331089 tempest-FlavorsAdminTestJSON-467331089-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.032715 Aug 27 02:41:12.057865 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 216/439] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 02:41:12 2022] POST /compute/v2.1/flavors => generated 425 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:41:12.064689 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-c8992b7e-24bc-478f-9c6d-9668927dbfa8 req-c910364c-01e6-4c7e-812d-7197e6e62fe2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29b88730-7871-4923-832e-a02d67f0314b", "tag": "9106e9cc-88c9-45f9-89cd-bb38806e1943"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:41:12.078873 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-c8992b7e-24bc-478f-9c6d-9668927dbfa8 req-c910364c-01e6-4c7e-812d-7197e6e62fe2 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:12.079527 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-c8992b7e-24bc-478f-9c6d-9668927dbfa8 req-c910364c-01e6-4c7e-812d-7197e6e62fe2 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:12.080259 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-c8992b7e-24bc-478f-9c6d-9668927dbfa8 req-c910364c-01e6-4c7e-812d-7197e6e62fe2 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:12.095194 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-c8992b7e-24bc-478f-9c6d-9668927dbfa8 req-c910364c-01e6-4c7e-812d-7197e6e62fe2 service nova] Creating event network-changed:9106e9cc-88c9-45f9-89cd-bb38806e1943 for instance 29b88730-7871-4923-832e-a02d67f0314b on n-h2-852278-4 Aug 27 02:41:12.101276 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-c8992b7e-24bc-478f-9c6d-9668927dbfa8 req-c910364c-01e6-4c7e-812d-7197e6e62fe2 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041969 Aug 27 02:41:12.102356 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 217/440] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:41:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:41:12.108919 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ed8a5545-708e-4a02-a1a6-c212d4443535 tempest-FlavorsAccessTestJSON-139417142 tempest-FlavorsAccessTestJSON-139417142-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:12.139694 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ed8a5545-708e-4a02-a1a6-c212d4443535 tempest-FlavorsAccessTestJSON-139417142 tempest-FlavorsAccessTestJSON-139417142-project] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 6634 microversion: 2.1 time: 0.035641 Aug 27 02:41:12.140934 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 218/441] 10.222.0.70 () {58 vars in 1146 bytes} [Sat Aug 27 02:41:12 2022] GET /compute/v2.1/flavors/detail => generated 6634 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:12.161213 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3fdb8a5c-852a-41c7-b621-43220e5a1c5e tempest-FlavorsExtraSpecsNegativeTestJSON-1205481843 tempest-FlavorsExtraSpecsNegativeTestJSON-1205481843-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:41:12.165752 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-3fdb8a5c-852a-41c7-b621-43220e5a1c5e tempest-FlavorsExtraSpecsNegativeTestJSON-1205481843 tempest-FlavorsExtraSpecsNegativeTestJSON-1205481843-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '13e90f8e6dde40dcaa05dc4ee62975b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85d7774925941de88eedc5666fbd81f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:12.166794 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.objects.instance [None req-564d5224-43f4-4420-959d-e686013cec85 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lazy-loading 'services' on Instance uuid bb513027-efc1-4201-812f-39c88b423a9d {{(pid=134051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:41:12.167752 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3fdb8a5c-852a-41c7-b621-43220e5a1c5e tempest-FlavorsExtraSpecsNegativeTestJSON-1205481843 tempest-FlavorsExtraSpecsNegativeTestJSON-1205481843-project] Request method failure captured: Aug 27 02:41:12.167752 n-d-852278-4 devstack@n-api.service[134052]: request: PUT /compute/v2.1/flavors/1437512396/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 27 02:41:12.167752 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:41:12.167752 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:41:12.167752 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:41:12.167752 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 22 Aug 27 02:41:12.167752 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:41:12.167752 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:41:12.167752 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:41:12.167752 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:41:12.167752 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYRCayRpn28NooPgO0-Q0TzdeLKr4iHwScIbH1uS_efEUoORFq8Ii_cl3rHXRNEA_V0IFF4OUDT89r6abS4aw_7Vvz1f1wXW324uxa5XNijKU8gMar5HTrnR6waZI9qP-eW21N4CgHspFacOXkK1LL5qtxnSxxQ-zKMM-5vlBzKJqOc Aug 27 02:41:12.167752 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:41:12.167752 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:41:12.167752 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:41:12.167752 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:41:12.167752 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:41:12.167752 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:41:12.167752 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: e85d7774925941de88eedc5666fbd81f Aug 27 02:41:12.167752 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1205481843 Aug 27 02:41:12.167752 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:41:12.167752 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:41:12.169239 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e85d7774925941de88eedc5666fbd81f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_e85d7774925941de88eedc5666fbd81f", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e85d7774925941de88eedc5666fbd81f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/e85d7774925941de88eedc5666fbd81f"}]}] Aug 27 02:41:12.169239 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1205481843 Aug 27 02:41:12.169239 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: e85d7774925941de88eedc5666fbd81f Aug 27 02:41:12.169239 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1205481843 Aug 27 02:41:12.169239 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1205481843-project Aug 27 02:41:12.169239 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:41:12.169239 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:41:12.169239 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 13e90f8e6dde40dcaa05dc4ee62975b1 Aug 27 02:41:12.169239 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1205481843-project Aug 27 02:41:12.169239 n-d-852278-4 devstack@n-api.service[134052]: Aug 27 02:41:12.169239 n-d-852278-4 devstack@n-api.service[134052]: {"hw:numa_nodes": "1"} Aug 27 02:41:12.169239 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 02:41:12.169239 n-d-852278-4 devstack@n-api.service[134052]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 27 02:41:12.170168 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'flavor_id': '1437512396', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Aug 27 02:41:12.170168 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:41:12.170168 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:41:12.170168 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:41:12.170168 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:41:12.170168 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:41:12.170168 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:41:12.170168 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:41:12.170168 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:41:12.170168 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:41:12.170168 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:41:12.170168 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Aug 27 02:41:12.170168 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Aug 27 02:41:12.170168 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 02:41:12.170168 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 02:41:12.170168 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 02:41:12.170168 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 02:41:12.170168 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 02:41:12.170168 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 02:41:12.172187 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 02:41:12.172187 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 02:41:12.172187 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 02:41:12.172187 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 02:41:12.172187 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 02:41:12.172187 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 02:41:12.172187 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 02:41:12.172187 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 02:41:12.172187 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 27 02:41:12.172187 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:41:12.172187 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:41:12.172187 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:41:12.172187 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:41:12.172187 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:41:12.172187 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:41:12.172187 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 02:41:12.172187 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 02:41:12.172187 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 27 02:41:12.172187 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:41:12.176018 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3fdb8a5c-852a-41c7-b621-43220e5a1c5e tempest-FlavorsExtraSpecsNegativeTestJSON-1205481843 tempest-FlavorsExtraSpecsNegativeTestJSON-1205481843-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:41:12.176946 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-3fdb8a5c-852a-41c7-b621-43220e5a1c5e tempest-FlavorsExtraSpecsNegativeTestJSON-1205481843 tempest-FlavorsExtraSpecsNegativeTestJSON-1205481843-project] 10.222.0.70 "PUT /compute/v2.1/flavors/1437512396/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.034865 Aug 27 02:41:12.177539 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 219/442] 10.222.0.70 () {60 vars in 1265 bytes} [Sat Aug 27 02:41:12 2022] PUT /compute/v2.1/flavors/1437512396/os-extra_specs/hw:numa_nodes => generated 124 bytes in 36 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:41:12.186204 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f04ea33c-acdc-402f-acb2-f3d964da5244 tempest-FlavorsAdminTestJSON-467331089 tempest-FlavorsAdminTestJSON-467331089-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:12.230286 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f04ea33c-acdc-402f-acb2-f3d964da5244 tempest-FlavorsAdminTestJSON-467331089 tempest-FlavorsAdminTestJSON-467331089-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/138146387" status: 202 len: 0 microversion: 2.1 time: 0.048862 Aug 27 02:41:12.231568 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 220/443] 10.222.0.70 () {58 vars in 1158 bytes} [Sat Aug 27 02:41:12 2022] DELETE /compute/v2.1/flavors/138146387 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:41:12.245070 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-bb69c854-ca40-4672-8032-0a1164bbc8e7 tempest-FlavorsAccessTestJSON-2099208019 tempest-FlavorsAccessTestJSON-2099208019-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:12.254756 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-564d5224-43f4-4420-959d-e686013cec85 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/bb513027-efc1-4201-812f-39c88b423a9d" status: 200 len: 2051 microversion: 2.25 time: 0.519990 Aug 27 02:41:12.260694 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 224/444] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:41:11 2022] GET /compute/v2.1/servers/bb513027-efc1-4201-812f-39c88b423a9d => generated 2051 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:41:12.268236 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-9bfe73d9-bcf3-4dd2-95fb-8ffe19956550 tempest-FlavorsExtraSpecsNegativeTestJSON-568325687 tempest-FlavorsExtraSpecsNegativeTestJSON-568325687-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:12.269643 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-bb69c854-ca40-4672-8032-0a1164bbc8e7 tempest-FlavorsAccessTestJSON-2099208019 tempest-FlavorsAccessTestJSON-2099208019-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/964641502" status: 202 len: 0 microversion: 2.1 time: 0.036275 Aug 27 02:41:12.274058 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 221/445] 10.222.0.70 () {58 vars in 1158 bytes} [Sat Aug 27 02:41:12 2022] DELETE /compute/v2.1/flavors/964641502 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:41:12.277708 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-9bfe73d9-bcf3-4dd2-95fb-8ffe19956550 tempest-FlavorsExtraSpecsNegativeTestJSON-568325687 tempest-FlavorsExtraSpecsNegativeTestJSON-568325687-project-admin] HTTP exception thrown: Flavor 1437512396 has no extra specs with key hw:cpu_thread_policy. Aug 27 02:41:12.279247 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-9bfe73d9-bcf3-4dd2-95fb-8ffe19956550 tempest-FlavorsExtraSpecsNegativeTestJSON-568325687 tempest-FlavorsExtraSpecsNegativeTestJSON-568325687-project-admin] Request method failure captured: Aug 27 02:41:12.279247 n-d-852278-4 devstack@n-api.service[134051]: request: DELETE /compute/v2.1/flavors/1437512396/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Aug 27 02:41:12.279247 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:41:12.279247 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:41:12.279247 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:41:12.279247 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:41:12.279247 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:41:12.279247 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:41:12.279247 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:41:12.279247 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:41:12.279247 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYREk34EIgnjPvG9ZqLyNP0lchJrA2qstJdaj32OTZIswAgN9MlwxkT0439iEI39AbYx3zYEc3gBrW7fEDN1PoZccLQptsMZ3lidEP5IDgtWi6WouM5MSPNzoQn4T9WqchtVJufEYG037cTdhS0OiP6xP7aERPMmx40238GoEHmhYCo Aug 27 02:41:12.279247 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:41:12.279247 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:41:12.279247 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:41:12.279247 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:41:12.279247 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:41:12.279247 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:41:12.279247 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: ee1751d010c0456299607422725d18d4 Aug 27 02:41:12.279247 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-568325687 Aug 27 02:41:12.279247 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,admin,member Aug 27 02:41:12.279247 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,admin,member Aug 27 02:41:12.280578 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ee1751d010c0456299607422725d18d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_ee1751d010c0456299607422725d18d4", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ee1751d010c0456299607422725d18d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/ee1751d010c0456299607422725d18d4"}]}] Aug 27 02:41:12.280578 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-568325687 Aug 27 02:41:12.280578 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: ee1751d010c0456299607422725d18d4 Aug 27 02:41:12.280578 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-568325687 Aug 27 02:41:12.280578 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-568325687-project-admin Aug 27 02:41:12.280578 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:41:12.280578 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:41:12.280578 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: fd875470db1a4997b46cc678d46591e8 Aug 27 02:41:12.280578 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-568325687-project-admin Aug 27 02:41:12.280578 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 02:41:12.280578 n-d-852278-4 devstack@n-api.service[134051]: exception: Flavor 1437512396 has no extra specs with key hw:cpu_thread_policy. Aug 27 02:41:12.281351 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'flavor_id': '1437512396', 'id': 'hw:cpu_thread_policy'} Aug 27 02:41:12.281351 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:41:12.281351 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:41:12.281351 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Aug 27 02:41:12.281351 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Aug 27 02:41:12.281351 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Aug 27 02:41:12.281351 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:41:12.281351 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:41:12.281351 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:41:12.281351 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:41:12.281351 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:41:12.281351 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:41:12.281351 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:41:12.281351 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:41:12.281351 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:41:12.281351 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:41:12.281351 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Aug 27 02:41:12.281351 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 27 02:41:12.281351 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1437512396 has no extra specs with key hw:cpu_thread_policy. Aug 27 02:41:12.281351 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:41:12.281351 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:41:12.281351 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:41:12.287933 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:41:12.287933 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:41:12.287933 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:41:12.287933 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:41:12.287933 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:41:12.287933 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1437512396 has no extra specs with key hw:cpu_thread_policy. Aug 27 02:41:12.287933 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:41:12.288939 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9e736a17-8f5f-4cb2-8a2b-e4a6337b5a1f tempest-FlavorsAdminTestJSON-467331089 tempest-FlavorsAdminTestJSON-467331089-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:12.289133 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-9bfe73d9-bcf3-4dd2-95fb-8ffe19956550 tempest-FlavorsExtraSpecsNegativeTestJSON-568325687 tempest-FlavorsExtraSpecsNegativeTestJSON-568325687-project-admin] Returning 404 to user: Flavor 1437512396 has no extra specs with key hw:cpu_thread_policy. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:41:12.289133 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-9bfe73d9-bcf3-4dd2-95fb-8ffe19956550 tempest-FlavorsExtraSpecsNegativeTestJSON-568325687 tempest-FlavorsExtraSpecsNegativeTestJSON-568325687-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/1437512396/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.019052 Aug 27 02:41:12.289133 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 225/446] 10.222.0.70 () {58 vars in 1269 bytes} [Sat Aug 27 02:41:12 2022] DELETE /compute/v2.1/flavors/1437512396/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:41:12.289133 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-2952436c-e8e1-46ea-b2f5-bbb18a8f85b6 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:12.289133 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-2952436c-e8e1-46ea-b2f5-bbb18a8f85b6 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] [instance: bb513027-efc1-4201-812f-39c88b423a9d] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:12.295771 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2952436c-e8e1-46ea-b2f5-bbb18a8f85b6 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:12.296282 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2952436c-e8e1-46ea-b2f5-bbb18a8f85b6 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:12.297261 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2952436c-e8e1-46ea-b2f5-bbb18a8f85b6 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:12.297535 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2952436c-e8e1-46ea-b2f5-bbb18a8f85b6 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:12.297984 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2952436c-e8e1-46ea-b2f5-bbb18a8f85b6 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:12.298411 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2952436c-e8e1-46ea-b2f5-bbb18a8f85b6 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:12.310580 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9e736a17-8f5f-4cb2-8a2b-e4a6337b5a1f tempest-FlavorsAdminTestJSON-467331089 tempest-FlavorsAdminTestJSON-467331089-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 6219 microversion: 2.1 time: 0.035277 Aug 27 02:41:12.311279 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 222/447] 10.222.0.70 () {58 vars in 1146 bytes} [Sat Aug 27 02:41:12 2022] GET /compute/v2.1/flavors/detail => generated 6219 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:12.326651 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-891de408-682d-4cee-896e-470b789d4cc5 tempest-FlavorsAccessTestJSON-2099208019 tempest-FlavorsAccessTestJSON-2099208019-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:12.350427 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-891de408-682d-4cee-896e-470b789d4cc5 tempest-FlavorsAccessTestJSON-2099208019 tempest-FlavorsAccessTestJSON-2099208019-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 6219 microversion: 2.1 time: 0.037723 Aug 27 02:41:12.351035 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 223/448] 10.222.0.70 () {58 vars in 1146 bytes} [Sat Aug 27 02:41:12 2022] GET /compute/v2.1/flavors/detail => generated 6219 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:12.355746 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-124dd1e4-f865-4fec-960c-00a7cf8c6eae tempest-FlavorsExtraSpecsNegativeTestJSON-568325687 tempest-FlavorsExtraSpecsNegativeTestJSON-568325687-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:41:12.359396 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-124dd1e4-f865-4fec-960c-00a7cf8c6eae tempest-FlavorsExtraSpecsNegativeTestJSON-568325687 tempest-FlavorsExtraSpecsNegativeTestJSON-568325687-project-admin] HTTP exception thrown: Request body and URI mismatch Aug 27 02:41:12.360815 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-124dd1e4-f865-4fec-960c-00a7cf8c6eae tempest-FlavorsExtraSpecsNegativeTestJSON-568325687 tempest-FlavorsExtraSpecsNegativeTestJSON-568325687-project-admin] Request method failure captured: Aug 27 02:41:12.360815 n-d-852278-4 devstack@n-api.service[134052]: request: PUT /compute/v2.1/flavors/1437512396/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 27 02:41:12.360815 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:41:12.360815 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:41:12.360815 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:41:12.360815 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 27 Aug 27 02:41:12.360815 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:41:12.360815 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:41:12.360815 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:41:12.360815 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:41:12.360815 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYREk34EIgnjPvG9ZqLyNP0lchJrA2qstJdaj32OTZIswAgN9MlwxkT0439iEI39AbYx3zYEc3gBrW7fEDN1PoZccLQptsMZ3lidEP5IDgtWi6WouM5MSPNzoQn4T9WqchtVJufEYG037cTdhS0OiP6xP7aERPMmx40238GoEHmhYCo Aug 27 02:41:12.360815 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:41:12.360815 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:41:12.360815 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:41:12.360815 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:41:12.360815 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:41:12.360815 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:41:12.360815 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: ee1751d010c0456299607422725d18d4 Aug 27 02:41:12.360815 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-568325687 Aug 27 02:41:12.360815 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,admin,member Aug 27 02:41:12.360815 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,admin,member Aug 27 02:41:12.362118 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ee1751d010c0456299607422725d18d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_ee1751d010c0456299607422725d18d4", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ee1751d010c0456299607422725d18d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/ee1751d010c0456299607422725d18d4"}]}] Aug 27 02:41:12.362118 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-568325687 Aug 27 02:41:12.362118 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: ee1751d010c0456299607422725d18d4 Aug 27 02:41:12.362118 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-568325687 Aug 27 02:41:12.362118 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-568325687-project-admin Aug 27 02:41:12.362118 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:41:12.362118 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:41:12.362118 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: fd875470db1a4997b46cc678d46591e8 Aug 27 02:41:12.362118 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-568325687-project-admin Aug 27 02:41:12.362118 n-d-852278-4 devstack@n-api.service[134052]: Aug 27 02:41:12.362118 n-d-852278-4 devstack@n-api.service[134052]: {"hw:cpu_policy": "shared"} Aug 27 02:41:12.362118 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 02:41:12.362118 n-d-852278-4 devstack@n-api.service[134052]: exception: Request body and URI mismatch Aug 27 02:41:12.362858 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'flavor_id': '1437512396', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Aug 27 02:41:12.362858 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:41:12.362858 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:41:12.362858 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:41:12.362858 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:41:12.362858 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:41:12.362858 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:41:12.362858 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:41:12.362858 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:41:12.362858 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:41:12.362858 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:41:12.362858 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Aug 27 02:41:12.362858 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Aug 27 02:41:12.362858 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Aug 27 02:41:12.362858 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:41:12.362858 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:41:12.362858 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:41:12.362858 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:41:12.362858 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:41:12.362858 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:41:12.365535 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:41:12.365535 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:41:12.365535 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Aug 27 02:41:12.365535 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:41:12.365535 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-124dd1e4-f865-4fec-960c-00a7cf8c6eae tempest-FlavorsExtraSpecsNegativeTestJSON-568325687 tempest-FlavorsExtraSpecsNegativeTestJSON-568325687-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:41:12.365535 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-124dd1e4-f865-4fec-960c-00a7cf8c6eae tempest-FlavorsExtraSpecsNegativeTestJSON-568325687 tempest-FlavorsExtraSpecsNegativeTestJSON-568325687-project-admin] 10.222.0.70 "PUT /compute/v2.1/flavors/1437512396/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.010015 Aug 27 02:41:12.365535 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 224/449] 10.222.0.70 () {60 vars in 1265 bytes} [Sat Aug 27 02:41:12 2022] PUT /compute/v2.1/flavors/1437512396/os-extra_specs/hw:numa_nodes => generated 73 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 27 02:41:12.367541 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c737a34c-f37a-430e-a4d3-8f87d09411a7 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:12.369064 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-c737a34c-f37a-430e-a4d3-8f87d09411a7 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] [instance: 9a6c0a3a-6693-4061-8765-cc07d3a5a1a0] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:12.376846 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c737a34c-f37a-430e-a4d3-8f87d09411a7 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:12.377416 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c737a34c-f37a-430e-a4d3-8f87d09411a7 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:12.378084 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c737a34c-f37a-430e-a4d3-8f87d09411a7 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:12.378908 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c737a34c-f37a-430e-a4d3-8f87d09411a7 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:12.379556 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c737a34c-f37a-430e-a4d3-8f87d09411a7 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:12.380051 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c737a34c-f37a-430e-a4d3-8f87d09411a7 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:12.491248 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-c737a34c-f37a-430e-a4d3-8f87d09411a7 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30abbf3afe304291981a6a9b85952aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c28ddbdb164f01bb82235c6d49717b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:12.500954 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c737a34c-f37a-430e-a4d3-8f87d09411a7 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] 10.222.0.70 "GET /compute/v2.1/servers/9a6c0a3a-6693-4061-8765-cc07d3a5a1a0" status: 200 len: 1271 microversion: 2.1 time: 0.136832 Aug 27 02:41:12.501935 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 225/450] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:12 2022] GET /compute/v2.1/servers/9a6c0a3a-6693-4061-8765-cc07d3a5a1a0 => generated 1271 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:12.507984 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-cf49c7ac-848b-458f-8797-92004d25fc29 tempest-FlavorsAdminTestJSON-467331089 tempest-FlavorsAdminTestJSON-467331089-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1564326666", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:41:12.539642 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-cf49c7ac-848b-458f-8797-92004d25fc29 tempest-FlavorsAdminTestJSON-467331089 tempest-FlavorsAdminTestJSON-467331089-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.034485 Aug 27 02:41:12.540568 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 226/451] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 02:41:12 2022] POST /compute/v2.1/flavors => generated 507 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:41:12.545852 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-818ea12c-b4db-400b-b934-cfbc98833c3f tempest-FlavorsExtraSpecsNegativeTestJSON-568325687 tempest-FlavorsExtraSpecsNegativeTestJSON-568325687-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:41:12.551938 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-818ea12c-b4db-400b-b934-cfbc98833c3f tempest-FlavorsExtraSpecsNegativeTestJSON-568325687 tempest-FlavorsExtraSpecsNegativeTestJSON-568325687-project-admin] Request method failure captured: Aug 27 02:41:12.551938 n-d-852278-4 devstack@n-api.service[134052]: request: PUT /compute/v2.1/flavors/1437512396/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 27 02:41:12.551938 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:41:12.551938 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:41:12.551938 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:41:12.551938 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 49 Aug 27 02:41:12.551938 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:41:12.551938 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:41:12.551938 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:41:12.551938 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:41:12.551938 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYREk34EIgnjPvG9ZqLyNP0lchJrA2qstJdaj32OTZIswAgN9MlwxkT0439iEI39AbYx3zYEc3gBrW7fEDN1PoZccLQptsMZ3lidEP5IDgtWi6WouM5MSPNzoQn4T9WqchtVJufEYG037cTdhS0OiP6xP7aERPMmx40238GoEHmhYCo Aug 27 02:41:12.551938 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:41:12.551938 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:41:12.551938 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:41:12.551938 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:41:12.551938 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:41:12.551938 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:41:12.551938 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: ee1751d010c0456299607422725d18d4 Aug 27 02:41:12.551938 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-568325687 Aug 27 02:41:12.551938 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,admin,member Aug 27 02:41:12.551938 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,admin,member Aug 27 02:41:12.553293 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ee1751d010c0456299607422725d18d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_ee1751d010c0456299607422725d18d4", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ee1751d010c0456299607422725d18d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/ee1751d010c0456299607422725d18d4"}]}] Aug 27 02:41:12.553293 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-568325687 Aug 27 02:41:12.553293 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: ee1751d010c0456299607422725d18d4 Aug 27 02:41:12.553293 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-568325687 Aug 27 02:41:12.553293 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-568325687-project-admin Aug 27 02:41:12.553293 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:41:12.553293 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:41:12.553293 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: fd875470db1a4997b46cc678d46591e8 Aug 27 02:41:12.553293 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-568325687-project-admin Aug 27 02:41:12.553293 n-d-852278-4 devstack@n-api.service[134052]: Aug 27 02:41:12.553293 n-d-852278-4 devstack@n-api.service[134052]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Aug 27 02:41:12.553293 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 02:41:12.554297 n-d-852278-4 devstack@n-api.service[134052]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 27 02:41:12.554297 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'flavor_id': '1437512396', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Aug 27 02:41:12.554297 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:41:12.554297 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:41:12.554297 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 02:41:12.554297 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 02:41:12.554297 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 02:41:12.554297 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise error Aug 27 02:41:12.554297 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 27 02:41:12.554297 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:41:12.554297 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Aug 27 02:41:12.554297 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 27 02:41:12.554297 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Aug 27 02:41:12.554297 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Aug 27 02:41:12.554297 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 27 02:41:12.554297 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi 'type': ['string', Aug 27 02:41:12.554297 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi 'number']}}, Aug 27 02:41:12.554297 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 27 02:41:12.554297 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:41:12.554297 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi On instance: Aug 27 02:41:12.554297 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Aug 27 02:41:12.554297 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:41:12.555552 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:41:12.555552 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:41:12.555552 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:41:12.555552 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:41:12.555552 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:41:12.555552 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:41:12.555552 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:41:12.555552 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:41:12.555552 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:41:12.555552 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 02:41:12.555552 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 02:41:12.555552 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 02:41:12.555552 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 02:41:12.555552 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 02:41:12.555552 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 02:41:12.555552 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 27 02:41:12.555552 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:41:12.555552 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:41:12.555552 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:41:12.555552 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:41:12.556661 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:41:12.556661 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:41:12.556661 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 02:41:12.556661 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 02:41:12.556661 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 27 02:41:12.556661 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:41:12.558543 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-818ea12c-b4db-400b-b934-cfbc98833c3f tempest-FlavorsExtraSpecsNegativeTestJSON-568325687 tempest-FlavorsExtraSpecsNegativeTestJSON-568325687-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:41:12.559591 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-818ea12c-b4db-400b-b934-cfbc98833c3f tempest-FlavorsExtraSpecsNegativeTestJSON-568325687 tempest-FlavorsExtraSpecsNegativeTestJSON-568325687-project-admin] 10.222.0.70 "PUT /compute/v2.1/flavors/1437512396/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.017900 Aug 27 02:41:12.560353 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 227/452] 10.222.0.70 () {60 vars in 1265 bytes} [Sat Aug 27 02:41:12 2022] PUT /compute/v2.1/flavors/1437512396/os-extra_specs/hw:numa_nodes => generated 117 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 02:41:12.565434 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5e59a010-a284-4bf0-90bc-e9a82d0ea184 tempest-FlavorsAccessTestJSON-2099208019 tempest-FlavorsAccessTestJSON-2099208019-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1029852943", "id": 2029368660, "os-flavor-access:is_public": "False"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:41:12.586394 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-5e59a010-a284-4bf0-90bc-e9a82d0ea184 tempest-FlavorsAccessTestJSON-2099208019 tempest-FlavorsAccessTestJSON-2099208019-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.024570 Aug 27 02:41:12.587259 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 228/453] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 02:41:12 2022] POST /compute/v2.1/flavors => generated 431 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:41:12.597520 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d7b6319f-5de6-4bcf-b9d8-6d5cf60bf353 tempest-FlavorsAdminTestJSON-467331089 tempest-FlavorsAdminTestJSON-467331089-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:12.613523 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.objects.instance [None req-2952436c-e8e1-46ea-b2f5-bbb18a8f85b6 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lazy-loading 'services' on Instance uuid bb513027-efc1-4201-812f-39c88b423a9d {{(pid=134051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:41:12.617191 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:41:12.620632 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d7b6319f-5de6-4bcf-b9d8-6d5cf60bf353 tempest-FlavorsAdminTestJSON-467331089 tempest-FlavorsAdminTestJSON-467331089-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/40a96d90-5882-41ee-813d-9f6c12d1df2c" status: 202 len: 0 microversion: 2.1 time: 0.032037 Aug 27 02:41:12.621737 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 229/454] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:41:12 2022] DELETE /compute/v2.1/flavors/40a96d90-5882-41ee-813d-9f6c12d1df2c => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:41:12.627408 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-7d8dd328-6333-4419-8fca-e70b707eb71f tempest-FlavorsExtraSpecsNegativeTestJSON-568325687 tempest-FlavorsExtraSpecsNegativeTestJSON-568325687-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:12.629371 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-2952436c-e8e1-46ea-b2f5-bbb18a8f85b6 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/bb513027-efc1-4201-812f-39c88b423a9d" status: 200 len: 2051 microversion: 2.25 time: 0.345679 Aug 27 02:41:12.630412 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 226/455] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:41:12 2022] GET /compute/v2.1/servers/bb513027-efc1-4201-812f-39c88b423a9d => generated 2051 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:41:12.634956 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0ec0f96b-8a2c-44d2-939d-74abeafc178a tempest-FlavorsAccessTestJSON-2099208019 tempest-FlavorsAccessTestJSON-2099208019-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:12.659788 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-7d8dd328-6333-4419-8fca-e70b707eb71f tempest-FlavorsExtraSpecsNegativeTestJSON-568325687 tempest-FlavorsExtraSpecsNegativeTestJSON-568325687-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/1437512396" status: 202 len: 0 microversion: 2.1 time: 0.036636 Aug 27 02:41:12.660814 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-0ec0f96b-8a2c-44d2-939d-74abeafc178a tempest-FlavorsAccessTestJSON-2099208019 tempest-FlavorsAccessTestJSON-2099208019-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/2029368660/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.029022 Aug 27 02:41:12.662978 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 227/456] 10.222.0.70 () {58 vars in 1209 bytes} [Sat Aug 27 02:41:12 2022] GET /compute/v2.1/flavors/2029368660/os-flavor-access => generated 21 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:41:12.664148 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 230/457] 10.222.0.70 () {58 vars in 1161 bytes} [Sat Aug 27 02:41:12 2022] DELETE /compute/v2.1/flavors/1437512396 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:41:12.671913 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-24f516da-d3ff-4ca9-91dd-2f4c7571915b tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:12.676735 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-24f516da-d3ff-4ca9-91dd-2f4c7571915b tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:12.677431 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-24f516da-d3ff-4ca9-91dd-2f4c7571915b tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:12.678256 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-24f516da-d3ff-4ca9-91dd-2f4c7571915b tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:12.680145 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-24f516da-d3ff-4ca9-91dd-2f4c7571915b tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:12.680923 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-24f516da-d3ff-4ca9-91dd-2f4c7571915b tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:12.681497 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-24f516da-d3ff-4ca9-91dd-2f4c7571915b tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:12.683677 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-076e4dcd-70d5-4af5-b231-ee5299d257bd tempest-FlavorsAdminTestJSON-467331089 tempest-FlavorsAdminTestJSON-467331089-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:12.731397 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-076e4dcd-70d5-4af5-b231-ee5299d257bd tempest-FlavorsAdminTestJSON-467331089 tempest-FlavorsAdminTestJSON-467331089-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.066757 Aug 27 02:41:12.732897 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 228/458] 10.222.0.70 () {58 vars in 1146 bytes} [Sat Aug 27 02:41:12 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:12.738206 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b8c34afc-47b6-4d1e-bd24-d60b71de3496 tempest-FlavorsExtraSpecsNegativeTestJSON-568325687 tempest-FlavorsExtraSpecsNegativeTestJSON-568325687-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:12.750971 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-24f516da-d3ff-4ca9-91dd-2f4c7571915b tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] 10.222.0.70 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.082978 Aug 27 02:41:12.760040 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 231/459] 10.222.0.70 () {60 vars in 1217 bytes} [Sat Aug 27 02:41:12 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:41:12.765717 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-bedb33a7-9720-4c2b-894f-56a2c6dcf764 tempest-FlavorsAccessTestJSON-2099208019 tempest-FlavorsAccessTestJSON-2099208019-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:12.784019 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b8c34afc-47b6-4d1e-bd24-d60b71de3496 tempest-FlavorsExtraSpecsNegativeTestJSON-568325687 tempest-FlavorsExtraSpecsNegativeTestJSON-568325687-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.049624 Aug 27 02:41:12.786301 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 229/460] 10.222.0.70 () {58 vars in 1146 bytes} [Sat Aug 27 02:41:12 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:12.793750 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ee2a04e4-15bf-4a52-a25d-038cfea47fb3 tempest-FlavorsAdminTestJSON-467331089 tempest-FlavorsAdminTestJSON-467331089-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1601886521", "id": "b83cce94-ecc2-4742-bae0-f3d4cd8aff56", "os-flavor-access:is_public": "True"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:41:12.809615 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-bedb33a7-9720-4c2b-894f-56a2c6dcf764 tempest-FlavorsAccessTestJSON-2099208019 tempest-FlavorsAccessTestJSON-2099208019-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/2029368660" status: 202 len: 0 microversion: 2.1 time: 0.048271 Aug 27 02:41:12.810660 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 232/461] 10.222.0.70 () {58 vars in 1161 bytes} [Sat Aug 27 02:41:12 2022] DELETE /compute/v2.1/flavors/2029368660 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:41:12.822768 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ee2a04e4-15bf-4a52-a25d-038cfea47fb3 tempest-FlavorsAdminTestJSON-467331089 tempest-FlavorsAdminTestJSON-467331089-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.034909 Aug 27 02:41:12.823379 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-7043cecb-9d6a-4e71-b3e0-de7e6e0b5d54 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:41:12.824040 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-7043cecb-9d6a-4e71-b3e0-de7e6e0b5d54 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] [instance: bb513027-efc1-4201-812f-39c88b423a9d] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:12.825905 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 230/462] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 02:41:12 2022] POST /compute/v2.1/flavors => generated 507 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:41:12.832580 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-17016864-786b-4030-8e3d-3daebbf214b6 tempest-FlavorsAccessTestJSON-2099208019 tempest-FlavorsAccessTestJSON-2099208019-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:12.838758 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7043cecb-9d6a-4e71-b3e0-de7e6e0b5d54 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:12.840863 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7043cecb-9d6a-4e71-b3e0-de7e6e0b5d54 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:12.842712 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7043cecb-9d6a-4e71-b3e0-de7e6e0b5d54 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:12.843566 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7043cecb-9d6a-4e71-b3e0-de7e6e0b5d54 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:12.845711 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7043cecb-9d6a-4e71-b3e0-de7e6e0b5d54 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:12.846269 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7043cecb-9d6a-4e71-b3e0-de7e6e0b5d54 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:12.880794 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-17016864-786b-4030-8e3d-3daebbf214b6 tempest-FlavorsAccessTestJSON-2099208019 tempest-FlavorsAccessTestJSON-2099208019-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 6311 microversion: 2.1 time: 0.053348 Aug 27 02:41:12.884646 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 231/463] 10.222.0.70 () {58 vars in 1146 bytes} [Sat Aug 27 02:41:12 2022] GET /compute/v2.1/flavors/detail => generated 6311 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:12.894889 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-00b7a3e9-027f-4ff2-bd47-5ea1f0f37b9c tempest-FlavorsAdminTestJSON-467331089 tempest-FlavorsAdminTestJSON-467331089-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:12.943780 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-00b7a3e9-027f-4ff2-bd47-5ea1f0f37b9c tempest-FlavorsAdminTestJSON-467331089 tempest-FlavorsAdminTestJSON-467331089-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/b83cce94-ecc2-4742-bae0-f3d4cd8aff56" status: 202 len: 0 microversion: 2.1 time: 0.057029 Aug 27 02:41:12.944922 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 232/464] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:41:12 2022] DELETE /compute/v2.1/flavors/b83cce94-ecc2-4742-bae0-f3d4cd8aff56 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:41:12.955845 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f4f0f8c7-adf6-41fb-b3b7-aca15f17295f tempest-FlavorsAdminTestJSON-467331089 tempest-FlavorsAdminTestJSON-467331089-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:13.002783 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-f4f0f8c7-adf6-41fb-b3b7-aca15f17295f tempest-FlavorsAdminTestJSON-467331089 tempest-FlavorsAdminTestJSON-467331089-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.052983 Aug 27 02:41:13.004118 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 233/465] 10.222.0.70 () {58 vars in 1146 bytes} [Sat Aug 27 02:41:12 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:13.009702 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-7043cecb-9d6a-4e71-b3e0-de7e6e0b5d54 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/bb513027-efc1-4201-812f-39c88b423a9d/action" status: 202 len: 0 microversion: 2.25 time: 0.196923 Aug 27 02:41:13.015040 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 233/466] 10.222.0.70 () {62 vars in 1319 bytes} [Sat Aug 27 02:41:12 2022] POST /compute/v2.1/servers/bb513027-efc1-4201-812f-39c88b423a9d/action => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:41:13.036730 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-90ea7ffe-e577-4a84-b502-d7f80dfcb8f7 tempest-FlavorsAdminTestJSON-467331089 tempest-FlavorsAdminTestJSON-467331089-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-2025291749", "id": 1203218729, "os-flavor-access:is_public": "True"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:41:13.040066 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c7455fdd-5978-4391-adad-d85d4c66ee61 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:13.041003 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-c7455fdd-5978-4391-adad-d85d4c66ee61 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] [instance: bb513027-efc1-4201-812f-39c88b423a9d] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:13.055875 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c7455fdd-5978-4391-adad-d85d4c66ee61 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:13.057463 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c7455fdd-5978-4391-adad-d85d4c66ee61 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:13.058954 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c7455fdd-5978-4391-adad-d85d4c66ee61 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:13.060527 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c7455fdd-5978-4391-adad-d85d4c66ee61 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:13.062165 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c7455fdd-5978-4391-adad-d85d4c66ee61 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:13.062831 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c7455fdd-5978-4391-adad-d85d4c66ee61 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:13.097482 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-90ea7ffe-e577-4a84-b502-d7f80dfcb8f7 tempest-FlavorsAdminTestJSON-467331089 tempest-FlavorsAdminTestJSON-467331089-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.063450 Aug 27 02:41:13.098133 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 234/467] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 02:41:13 2022] POST /compute/v2.1/flavors => generated 414 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:41:13.109902 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6bcea3f7-6ca5-4cda-bc1c-5b8b7a1bb0f1 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:13.111031 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-6bcea3f7-6ca5-4cda-bc1c-5b8b7a1bb0f1 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 29b88730-7871-4923-832e-a02d67f0314b] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:13.117936 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6bcea3f7-6ca5-4cda-bc1c-5b8b7a1bb0f1 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:13.118654 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6bcea3f7-6ca5-4cda-bc1c-5b8b7a1bb0f1 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:13.119246 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6bcea3f7-6ca5-4cda-bc1c-5b8b7a1bb0f1 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:13.120103 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6bcea3f7-6ca5-4cda-bc1c-5b8b7a1bb0f1 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:13.120920 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6bcea3f7-6ca5-4cda-bc1c-5b8b7a1bb0f1 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:13.121497 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6bcea3f7-6ca5-4cda-bc1c-5b8b7a1bb0f1 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:13.523173 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-6bcea3f7-6ca5-4cda-bc1c-5b8b7a1bb0f1 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:13.535045 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-6bcea3f7-6ca5-4cda-bc1c-5b8b7a1bb0f1 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/29b88730-7871-4923-832e-a02d67f0314b" status: 200 len: 1311 microversion: 2.1 time: 0.429004 Aug 27 02:41:13.538061 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 235/468] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:13 2022] GET /compute/v2.1/servers/29b88730-7871-4923-832e-a02d67f0314b => generated 1311 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:13.552993 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4b3f62d9-d109-41e5-8b3e-e5c1ce825b93 tempest-FlavorsAdminTestJSON-467331089 tempest-FlavorsAdminTestJSON-467331089-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:13.577701 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-4b3f62d9-d109-41e5-8b3e-e5c1ce825b93 tempest-FlavorsAdminTestJSON-467331089 tempest-FlavorsAdminTestJSON-467331089-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/1203218729" status: 200 len: 414 microversion: 2.1 time: 0.036068 Aug 27 02:41:13.585715 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 236/469] 10.222.0.70 () {58 vars in 1158 bytes} [Sat Aug 27 02:41:13 2022] GET /compute/v2.1/flavors/1203218729 => generated 414 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:41:13.599157 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-16fab9eb-96e0-4ab0-8cf7-4d4d319b1361 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:13.601395 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-16fab9eb-96e0-4ab0-8cf7-4d4d319b1361 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] [instance: 9a6c0a3a-6693-4061-8765-cc07d3a5a1a0] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:13.612656 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.objects.instance [None req-c7455fdd-5978-4391-adad-d85d4c66ee61 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lazy-loading 'services' on Instance uuid bb513027-efc1-4201-812f-39c88b423a9d {{(pid=134051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:41:13.622848 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=6,nova_api:DELETE=18 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:41:13.624778 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-16fab9eb-96e0-4ab0-8cf7-4d4d319b1361 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:13.625618 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-16fab9eb-96e0-4ab0-8cf7-4d4d319b1361 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:13.625618 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-16fab9eb-96e0-4ab0-8cf7-4d4d319b1361 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:13.626261 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-16fab9eb-96e0-4ab0-8cf7-4d4d319b1361 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:13.626710 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-16fab9eb-96e0-4ab0-8cf7-4d4d319b1361 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:13.627128 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-16fab9eb-96e0-4ab0-8cf7-4d4d319b1361 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:13.654868 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c7455fdd-5978-4391-adad-d85d4c66ee61 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/bb513027-efc1-4201-812f-39c88b423a9d" status: 200 len: 2056 microversion: 2.25 time: 0.622771 Aug 27 02:41:13.655890 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 234/470] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:41:13 2022] GET /compute/v2.1/servers/bb513027-efc1-4201-812f-39c88b423a9d => generated 2056 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:41:14.148801 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c037a4c3-d186-4dfd-ba54-f9e7b2bd790b tempest-FlavorsAdminTestJSON-571417788 tempest-FlavorsAdminTestJSON-571417788-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:14.172651 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c037a4c3-d186-4dfd-ba54-f9e7b2bd790b tempest-FlavorsAdminTestJSON-571417788 tempest-FlavorsAdminTestJSON-571417788-project] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 6218 microversion: 2.1 time: 0.515141 Aug 27 02:41:14.173241 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 235/471] 10.222.0.70 () {58 vars in 1146 bytes} [Sat Aug 27 02:41:13 2022] GET /compute/v2.1/flavors/detail => generated 6218 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:14.194660 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-bf6a2962-6908-493d-b527-bdd74f82383f tempest-FlavorsAdminTestJSON-467331089 tempest-FlavorsAdminTestJSON-467331089-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:14.213485 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-bf6a2962-6908-493d-b527-bdd74f82383f tempest-FlavorsAdminTestJSON-467331089 tempest-FlavorsAdminTestJSON-467331089-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/1203218729" status: 202 len: 0 microversion: 2.1 time: 0.024493 Aug 27 02:41:14.214414 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 236/472] 10.222.0.70 () {58 vars in 1161 bytes} [Sat Aug 27 02:41:14 2022] DELETE /compute/v2.1/flavors/1203218729 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 02:41:14.222152 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-38d192ea-959a-49fa-84ff-d36a07fa9f43 tempest-FlavorsAdminTestJSON-467331089 tempest-FlavorsAdminTestJSON-467331089-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:14.244399 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-38d192ea-959a-49fa-84ff-d36a07fa9f43 tempest-FlavorsAdminTestJSON-467331089 tempest-FlavorsAdminTestJSON-467331089-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.025854 Aug 27 02:41:14.245278 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 237/473] 10.222.0.70 () {58 vars in 1146 bytes} [Sat Aug 27 02:41:14 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:41:14.267219 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-9f6141ce-8ecd-4a84-bb23-0eb45e3bf14f tempest-FlavorsAdminTestJSON-467331089 tempest-FlavorsAdminTestJSON-467331089-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1512344382", "id": 1945688510, "os-flavor-access:is_public": "False"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:41:14.287255 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-9f6141ce-8ecd-4a84-bb23-0eb45e3bf14f tempest-FlavorsAdminTestJSON-467331089 tempest-FlavorsAdminTestJSON-467331089-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.024321 Aug 27 02:41:14.288035 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 238/474] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 02:41:14 2022] POST /compute/v2.1/flavors => generated 430 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:41:14.300655 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f779fc0a-6118-4387-ab6a-aee59f1f054e tempest-FlavorsAdminTestJSON-571417788 tempest-FlavorsAdminTestJSON-571417788-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "1945688510"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:41:14.312249 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-f779fc0a-6118-4387-ab6a-aee59f1f054e tempest-FlavorsAdminTestJSON-571417788 tempest-FlavorsAdminTestJSON-571417788-project] HTTP exception thrown: Flavor 1945688510 could not be found. Aug 27 02:41:14.314807 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f779fc0a-6118-4387-ab6a-aee59f1f054e tempest-FlavorsAdminTestJSON-571417788 tempest-FlavorsAdminTestJSON-571417788-project] Request method failure captured: Aug 27 02:41:14.314807 n-d-852278-4 devstack@n-api.service[134051]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 02:41:14.314807 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:41:14.314807 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:41:14.314807 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:41:14.314807 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 107 Aug 27 02:41:14.314807 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:41:14.314807 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:41:14.314807 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:41:14.314807 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:41:14.314807 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYRCCem5vP3UWl2GRSXbYnhWcdAMjz5QjQDQ9BC_GEDjdXbc5BiSmB6yd_MMcHjXwP1WkPcBrPGcG-2BTrs-85GMxaUKyya6kodcKC_bgCVFDE2mRCDB8EQJcx4-7ZB1BTSM1JKFFlMyo35VJxcyRPnaBIh40ZGsdpt--_MgY56NT1k Aug 27 02:41:14.314807 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:41:14.314807 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:41:14.314807 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:41:14.314807 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:41:14.314807 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:41:14.314807 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:41:14.314807 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 5783bc006d1a4d9199554247d75e9668 Aug 27 02:41:14.314807 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-FlavorsAdminTestJSON-571417788 Aug 27 02:41:14.314807 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:41:14.314807 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:41:14.316792 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5783bc006d1a4d9199554247d75e9668"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_5783bc006d1a4d9199554247d75e9668", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5783bc006d1a4d9199554247d75e9668"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/5783bc006d1a4d9199554247d75e9668"}]}] Aug 27 02:41:14.316792 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-FlavorsAdminTestJSON-571417788 Aug 27 02:41:14.316792 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 5783bc006d1a4d9199554247d75e9668 Aug 27 02:41:14.316792 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-571417788 Aug 27 02:41:14.316792 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-FlavorsAdminTestJSON-571417788-project Aug 27 02:41:14.316792 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:41:14.316792 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:41:14.316792 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 00e09c6032a54e7cb4fe49fd08f54a94 Aug 27 02:41:14.316792 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-FlavorsAdminTestJSON-571417788-project Aug 27 02:41:14.316792 n-d-852278-4 devstack@n-api.service[134051]: Aug 27 02:41:14.316792 n-d-852278-4 devstack@n-api.service[134051]: {"server": {"name": "test", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "1945688510"}} Aug 27 02:41:14.316792 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 02:41:14.316792 n-d-852278-4 devstack@n-api.service[134051]: exception: Flavor 1945688510 could not be found. Aug 27 02:41:14.317789 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'body': {'server': {'name': 'test', 'imageRef': '1552acd0-176a-4c81-b680-29d74105e9d6', 'flavorRef': '1945688510'}}} Aug 27 02:41:14.317789 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:41:14.317789 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:41:14.317789 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Aug 27 02:41:14.317789 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Aug 27 02:41:14.317789 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 27 02:41:14.317789 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 27 02:41:14.317789 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 02:41:14.317789 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 02:41:14.317789 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 27 02:41:14.317789 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 27 02:41:14.317789 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 27 02:41:14.317789 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:41:14.317789 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 27 02:41:14.317789 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 27 02:41:14.317789 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 1945688510 could not be found. Aug 27 02:41:14.317789 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:41:14.317789 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:41:14.317789 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:41:14.317789 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:41:14.319412 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:41:14.319412 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:41:14.319412 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:41:14.319412 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:41:14.319412 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:41:14.319412 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:41:14.319412 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:41:14.319412 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:41:14.319412 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:41:14.319412 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:41:14.319412 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:41:14.319412 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:41:14.319412 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 27 02:41:14.319412 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 27 02:41:14.319412 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 27 02:41:14.319412 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 1945688510 could not be found. Aug 27 02:41:14.319412 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:41:14.319412 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:41:14.319412 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:41:14.319412 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:41:14.319412 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:41:14.320932 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:41:14.320932 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:41:14.320932 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:41:14.320932 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1945688510 could not be found. Aug 27 02:41:14.320932 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:41:14.320932 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f779fc0a-6118-4387-ab6a-aee59f1f054e tempest-FlavorsAdminTestJSON-571417788 tempest-FlavorsAdminTestJSON-571417788-project] Returning 400 to user: Flavor 1945688510 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:41:14.321472 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-f779fc0a-6118-4387-ab6a-aee59f1f054e tempest-FlavorsAdminTestJSON-571417788 tempest-FlavorsAdminTestJSON-571417788-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.023382 Aug 27 02:41:14.322251 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 239/475] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 02:41:14 2022] POST /compute/v2.1/servers => generated 81 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 27 02:41:14.331162 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-bd089627-e781-48e4-9967-df6e1257766e tempest-FlavorsAdminTestJSON-467331089 tempest-FlavorsAdminTestJSON-467331089-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:14.351881 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-bd089627-e781-48e4-9967-df6e1257766e tempest-FlavorsAdminTestJSON-467331089 tempest-FlavorsAdminTestJSON-467331089-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/1945688510" status: 202 len: 0 microversion: 2.1 time: 0.025122 Aug 27 02:41:14.352839 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 240/476] 10.222.0.70 () {58 vars in 1161 bytes} [Sat Aug 27 02:41:14 2022] DELETE /compute/v2.1/flavors/1945688510 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:41:14.360125 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-16fab9eb-96e0-4ab0-8cf7-4d4d319b1361 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30abbf3afe304291981a6a9b85952aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c28ddbdb164f01bb82235c6d49717b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:14.361069 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d0216957-4fae-4728-9e44-9459b83debf0 tempest-FlavorsAdminTestJSON-467331089 tempest-FlavorsAdminTestJSON-467331089-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:14.375402 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-16fab9eb-96e0-4ab0-8cf7-4d4d319b1361 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] 10.222.0.70 "GET /compute/v2.1/servers/9a6c0a3a-6693-4061-8765-cc07d3a5a1a0" status: 200 len: 1313 microversion: 2.1 time: 0.786390 Aug 27 02:41:14.377116 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 237/477] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:13 2022] GET /compute/v2.1/servers/9a6c0a3a-6693-4061-8765-cc07d3a5a1a0 => generated 1313 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:14.399120 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d0216957-4fae-4728-9e44-9459b83debf0 tempest-FlavorsAdminTestJSON-467331089 tempest-FlavorsAdminTestJSON-467331089-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.041914 Aug 27 02:41:14.399861 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 241/478] 10.222.0.70 () {58 vars in 1146 bytes} [Sat Aug 27 02:41:14 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:14.422627 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5dcc91bc-7a13-452c-8188-b82c4f8c1819 tempest-FlavorsAdminTestJSON-467331089 tempest-FlavorsAdminTestJSON-467331089-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-304682605", "id": 524163414, "os-flavor-access:is_public": "False"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:41:14.443723 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-5dcc91bc-7a13-452c-8188-b82c4f8c1819 tempest-FlavorsAdminTestJSON-467331089 tempest-FlavorsAdminTestJSON-467331089-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.025542 Aug 27 02:41:14.444430 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 238/479] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 02:41:14 2022] POST /compute/v2.1/flavors => generated 411 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:41:14.458079 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d5255b25-c610-432c-8c46-b7fcd1b1966c tempest-FlavorsAdminTestJSON-467331089 tempest-FlavorsAdminTestJSON-467331089-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-198231550", "id": 10698274, "os-flavor-access:is_public": "True"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:41:14.481506 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d5255b25-c610-432c-8c46-b7fcd1b1966c tempest-FlavorsAdminTestJSON-467331089 tempest-FlavorsAdminTestJSON-467331089-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.1 time: 0.027936 Aug 27 02:41:14.484975 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 242/480] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 02:41:14 2022] POST /compute/v2.1/flavors => generated 407 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:41:14.497943 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3c036ab9-9493-43d5-88a3-466230889dfb tempest-FlavorsAdminTestJSON-467331089 tempest-FlavorsAdminTestJSON-467331089-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:14.519200 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-3c036ab9-9493-43d5-88a3-466230889dfb tempest-FlavorsAdminTestJSON-467331089 tempest-FlavorsAdminTestJSON-467331089-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 414 microversion: 2.1 time: 0.027295 Aug 27 02:41:14.520209 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 239/481] 10.222.0.70 () {58 vars in 1169 bytes} [Sat Aug 27 02:41:14 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 414 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:41:14.533188 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b4d2e8d8-9715-4301-a87f-533dfe5b8949 tempest-FlavorsAdminTestJSON-467331089 tempest-FlavorsAdminTestJSON-467331089-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:14.551867 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b4d2e8d8-9715-4301-a87f-533dfe5b8949 tempest-FlavorsAdminTestJSON-467331089 tempest-FlavorsAdminTestJSON-467331089-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 414 microversion: 2.1 time: 0.022679 Aug 27 02:41:14.552600 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 243/482] 10.222.0.70 () {58 vars in 1177 bytes} [Sat Aug 27 02:41:14 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 414 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:41:14.567036 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-95b8da36-4800-4712-a049-f9a5222ef467 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:14.567730 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-95b8da36-4800-4712-a049-f9a5222ef467 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 29b88730-7871-4923-832e-a02d67f0314b] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:14.573246 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-49ad89c7-28e8-4a17-9393-fc8f48e85960 tempest-FlavorsAdminTestJSON-467331089 tempest-FlavorsAdminTestJSON-467331089-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:14.574184 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-95b8da36-4800-4712-a049-f9a5222ef467 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:14.575049 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-95b8da36-4800-4712-a049-f9a5222ef467 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:14.575855 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-95b8da36-4800-4712-a049-f9a5222ef467 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:14.576956 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-95b8da36-4800-4712-a049-f9a5222ef467 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:14.577775 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-95b8da36-4800-4712-a049-f9a5222ef467 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:14.578616 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-95b8da36-4800-4712-a049-f9a5222ef467 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:14.585920 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-49ad89c7-28e8-4a17-9393-fc8f48e85960 tempest-FlavorsAdminTestJSON-467331089 tempest-FlavorsAdminTestJSON-467331089-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 414 microversion: 2.1 time: 0.016338 Aug 27 02:41:14.587115 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 244/483] 10.222.0.70 () {58 vars in 1171 bytes} [Sat Aug 27 02:41:14 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 414 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:41:14.601151 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e89c2308-f80c-4e16-990b-8dacb7369c7b tempest-FlavorsAdminTestJSON-467331089 tempest-FlavorsAdminTestJSON-467331089-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:14.607630 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:RELEASE=4,nova_api:SAVEPOINT=3,nova_api:INSERT=4,nova_api:SELECT=76,nova_api:DELETE=13 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:41:14.615224 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e89c2308-f80c-4e16-990b-8dacb7369c7b tempest-FlavorsAdminTestJSON-467331089 tempest-FlavorsAdminTestJSON-467331089-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 414 microversion: 2.1 time: 0.019651 Aug 27 02:41:14.618285 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 245/484] 10.222.0.70 () {58 vars in 1169 bytes} [Sat Aug 27 02:41:14 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 414 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:41:14.630512 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-dfec04e6-a59f-4131-95d8-91daa1613dec tempest-FlavorsAdminTestJSON-467331089 tempest-FlavorsAdminTestJSON-467331089-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:14.665454 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-dfec04e6-a59f-4131-95d8-91daa1613dec tempest-FlavorsAdminTestJSON-467331089 tempest-FlavorsAdminTestJSON-467331089-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 6211 microversion: 2.1 time: 0.039753 Aug 27 02:41:14.667614 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 246/485] 10.222.0.70 () {58 vars in 1169 bytes} [Sat Aug 27 02:41:14 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 6211 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:14.686115 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4f6c8a9a-21ff-44f9-9316-4625413bd970 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:14.689303 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-4f6c8a9a-21ff-44f9-9316-4625413bd970 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] [instance: bb513027-efc1-4201-812f-39c88b423a9d] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:14.701136 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4f6c8a9a-21ff-44f9-9316-4625413bd970 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:14.702446 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4f6c8a9a-21ff-44f9-9316-4625413bd970 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:14.704612 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4f6c8a9a-21ff-44f9-9316-4625413bd970 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:14.707583 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4f6c8a9a-21ff-44f9-9316-4625413bd970 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:14.709495 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4f6c8a9a-21ff-44f9-9316-4625413bd970 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:14.710390 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4f6c8a9a-21ff-44f9-9316-4625413bd970 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:15.073829 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-95b8da36-4800-4712-a049-f9a5222ef467 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:15.086082 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-95b8da36-4800-4712-a049-f9a5222ef467 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/29b88730-7871-4923-832e-a02d67f0314b" status: 200 len: 1311 microversion: 2.1 time: 0.523532 Aug 27 02:41:15.099854 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 240/486] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:14 2022] GET /compute/v2.1/servers/29b88730-7871-4923-832e-a02d67f0314b => generated 1311 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:15.105660 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f33d620b-6fc7-4fa0-9a4c-bd91918cfd0d tempest-FlavorsAdminTestJSON-467331089 tempest-FlavorsAdminTestJSON-467331089-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:15.130215 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f33d620b-6fc7-4fa0-9a4c-bd91918cfd0d tempest-FlavorsAdminTestJSON-467331089 tempest-FlavorsAdminTestJSON-467331089-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 6211 microversion: 2.1 time: 0.028888 Aug 27 02:41:15.130773 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 241/487] 10.222.0.70 () {58 vars in 1175 bytes} [Sat Aug 27 02:41:15 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 6211 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:15.155410 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.objects.instance [None req-4f6c8a9a-21ff-44f9-9316-4625413bd970 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lazy-loading 'services' on Instance uuid bb513027-efc1-4201-812f-39c88b423a9d {{(pid=134051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:41:15.172505 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-4f6c8a9a-21ff-44f9-9316-4625413bd970 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/bb513027-efc1-4201-812f-39c88b423a9d" status: 200 len: 2036 microversion: 2.25 time: 0.491134 Aug 27 02:41:15.173325 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 247/488] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:41:14 2022] GET /compute/v2.1/servers/bb513027-efc1-4201-812f-39c88b423a9d => generated 2036 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:41:15.178974 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-bc8427fc-1b38-4050-8724-aee3dfe128be tempest-FlavorsAdminTestJSON-467331089 tempest-FlavorsAdminTestJSON-467331089-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:15.215394 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-bc8427fc-1b38-4050-8724-aee3dfe128be tempest-FlavorsAdminTestJSON-467331089 tempest-FlavorsAdminTestJSON-467331089-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 6211 microversion: 2.1 time: 0.040257 Aug 27 02:41:15.217258 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 248/489] 10.222.0.70 () {58 vars in 1173 bytes} [Sat Aug 27 02:41:15 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 6211 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:15.224471 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b7cbd5ba-1063-46bd-b166-dfc3323b81d7 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-852278-4", "block_migration": "auto"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:41:15.227494 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b7cbd5ba-1063-46bd-b166-dfc3323b81d7 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] [instance: bb513027-efc1-4201-812f-39c88b423a9d] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:15.234925 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b7cbd5ba-1063-46bd-b166-dfc3323b81d7 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:15.235942 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b7cbd5ba-1063-46bd-b166-dfc3323b81d7 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:15.236588 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b7cbd5ba-1063-46bd-b166-dfc3323b81d7 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:15.237620 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b7cbd5ba-1063-46bd-b166-dfc3323b81d7 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:15.238203 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b7cbd5ba-1063-46bd-b166-dfc3323b81d7 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:15.238698 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b7cbd5ba-1063-46bd-b166-dfc3323b81d7 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:15.279105 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.objects.instance [None req-b7cbd5ba-1063-46bd-b166-dfc3323b81d7 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lazy-loading 'flavor' on Instance uuid bb513027-efc1-4201-812f-39c88b423a9d {{(pid=134051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:41:15.298727 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b7cbd5ba-1063-46bd-b166-dfc3323b81d7 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] [instance: bb513027-efc1-4201-812f-39c88b423a9d] Going to try to live migrate instance to n-h2-852278-4 {{(pid=134051) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 27 02:41:15.488624 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a3297ff1-90f8-44b6-90df-12664cffcb3c tempest-QuotaClassesAdmin257Test-2114547555 tempest-QuotaClassesAdmin257Test-2114547555-project-admin] Calling method '.version_select at 0x7f5ee3610670>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:15.516059 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a3297ff1-90f8-44b6-90df-12664cffcb3c tempest-QuotaClassesAdmin257Test-2114547555 tempest-QuotaClassesAdmin257Test-2114547555-project-admin] 10.222.0.70 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.384141 Aug 27 02:41:15.519162 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 242/490] 10.222.0.70 () {60 vars in 1226 bytes} [Sat Aug 27 02:41:15 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:41:15.525843 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-ab683c48-a892-4641-b2bd-69f1a1efefa8 req-492cd824-2cd2-45f3-b443-905d50922c5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ee4d4db-a1bb-4567-a20d-29003e67a295", "tag": "cb37d724-8fd4-499e-a131-e0d13d7b8f95"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:41:15.546003 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-ab683c48-a892-4641-b2bd-69f1a1efefa8 req-492cd824-2cd2-45f3-b443-905d50922c5d service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:15.546781 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-ab683c48-a892-4641-b2bd-69f1a1efefa8 req-492cd824-2cd2-45f3-b443-905d50922c5d service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:15.547473 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-ab683c48-a892-4641-b2bd-69f1a1efefa8 req-492cd824-2cd2-45f3-b443-905d50922c5d service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:15.552720 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:41:15.562027 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-ab683c48-a892-4641-b2bd-69f1a1efefa8 req-492cd824-2cd2-45f3-b443-905d50922c5d service nova] Creating event network-changed:cb37d724-8fd4-499e-a131-e0d13d7b8f95 for instance 3ee4d4db-a1bb-4567-a20d-29003e67a295 on n-h2-852278-4 Aug 27 02:41:15.568768 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-ab683c48-a892-4641-b2bd-69f1a1efefa8 req-492cd824-2cd2-45f3-b443-905d50922c5d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047798 Aug 27 02:41:15.570135 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 243/491] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:41:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:41:15.577465 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-43d56513-b515-4450-aee0-294f541f923b tempest-FlavorsAdminTestJSON-467331089 tempest-FlavorsAdminTestJSON-467331089-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:15.606578 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-43d56513-b515-4450-aee0-294f541f923b tempest-FlavorsAdminTestJSON-467331089 tempest-FlavorsAdminTestJSON-467331089-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 6211 microversion: 2.1 time: 0.034683 Aug 27 02:41:15.607515 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 244/492] 10.222.0.70 () {58 vars in 1169 bytes} [Sat Aug 27 02:41:15 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 6211 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:15.614422 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-91420e8c-a0a2-4769-ac04-80c7b66e8ac2 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:15.616345 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-91420e8c-a0a2-4769-ac04-80c7b66e8ac2 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] [instance: 9a6c0a3a-6693-4061-8765-cc07d3a5a1a0] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:15.622956 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-91420e8c-a0a2-4769-ac04-80c7b66e8ac2 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:15.623641 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-91420e8c-a0a2-4769-ac04-80c7b66e8ac2 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:15.624276 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-91420e8c-a0a2-4769-ac04-80c7b66e8ac2 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:15.625206 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-91420e8c-a0a2-4769-ac04-80c7b66e8ac2 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:15.625795 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-91420e8c-a0a2-4769-ac04-80c7b66e8ac2 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:15.626360 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-91420e8c-a0a2-4769-ac04-80c7b66e8ac2 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:16.068575 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-91420e8c-a0a2-4769-ac04-80c7b66e8ac2 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30abbf3afe304291981a6a9b85952aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c28ddbdb164f01bb82235c6d49717b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:16.083360 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-91420e8c-a0a2-4769-ac04-80c7b66e8ac2 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] 10.222.0.70 "GET /compute/v2.1/servers/9a6c0a3a-6693-4061-8765-cc07d3a5a1a0" status: 200 len: 1313 microversion: 2.1 time: 0.474549 Aug 27 02:41:16.098428 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 245/493] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:15 2022] GET /compute/v2.1/servers/9a6c0a3a-6693-4061-8765-cc07d3a5a1a0 => generated 1313 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:16.105390 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c1bb26c1-e40d-4f54-aa5c-428a84cd85d1 tempest-QuotaClassesAdmin257Test-2114547555 tempest-QuotaClassesAdmin257Test-2114547555-project-admin] Action: 'update', calling method: .version_select at 0x7f5ee3610b80>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:41:16.370794 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c1bb26c1-e40d-4f54-aa5c-428a84cd85d1 tempest-QuotaClassesAdmin257Test-2114547555 tempest-QuotaClassesAdmin257Test-2114547555-project-admin] 10.222.0.70 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.269583 Aug 27 02:41:16.374055 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 246/494] 10.222.0.70 () {62 vars in 1247 bytes} [Sat Aug 27 02:41:16 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:41:16.383368 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-95367255-23e4-4b84-bc15-c067f7fbc8e0 tempest-FlavorsAdminTestJSON-467331089 tempest-FlavorsAdminTestJSON-467331089-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:16.407778 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-95367255-23e4-4b84-bc15-c067f7fbc8e0 tempest-FlavorsAdminTestJSON-467331089 tempest-FlavorsAdminTestJSON-467331089-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/10698274" status: 202 len: 0 microversion: 2.1 time: 0.032565 Aug 27 02:41:16.408506 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 247/495] 10.222.0.70 () {58 vars in 1155 bytes} [Sat Aug 27 02:41:16 2022] DELETE /compute/v2.1/flavors/10698274 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:41:16.413714 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-301e91dd-1d88-4999-8150-1cedf9ce383d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:16.414663 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-301e91dd-1d88-4999-8150-1cedf9ce383d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 29b88730-7871-4923-832e-a02d67f0314b] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:16.421717 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-301e91dd-1d88-4999-8150-1cedf9ce383d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:16.422696 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-301e91dd-1d88-4999-8150-1cedf9ce383d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:16.422991 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-301e91dd-1d88-4999-8150-1cedf9ce383d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:16.423682 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-301e91dd-1d88-4999-8150-1cedf9ce383d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:16.424121 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-301e91dd-1d88-4999-8150-1cedf9ce383d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:16.424557 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-301e91dd-1d88-4999-8150-1cedf9ce383d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:16.578006 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-301e91dd-1d88-4999-8150-1cedf9ce383d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:16.585885 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-301e91dd-1d88-4999-8150-1cedf9ce383d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/29b88730-7871-4923-832e-a02d67f0314b" status: 200 len: 1311 microversion: 2.1 time: 0.175996 Aug 27 02:41:16.586484 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 248/496] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:16 2022] GET /compute/v2.1/servers/29b88730-7871-4923-832e-a02d67f0314b => generated 1311 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:16.593681 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-cae5b37e-579b-4530-aa45-9fbf1815c691 tempest-QuotaClassesAdmin257Test-2114547555 tempest-QuotaClassesAdmin257Test-2114547555-project-admin] Calling method '.version_select at 0x7f5ee355fca0>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:16.604864 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-cae5b37e-579b-4530-aa45-9fbf1815c691 tempest-QuotaClassesAdmin257Test-2114547555 tempest-QuotaClassesAdmin257Test-2114547555-project-admin] 10.222.0.70 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.016991 Aug 27 02:41:16.605751 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 249/497] 10.222.0.70 () {60 vars in 1226 bytes} [Sat Aug 27 02:41:16 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:41:16.612671 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-feb9cb14-ff31-4c02-85e7-69c634ab584e tempest-FlavorsAdminTestJSON-467331089 tempest-FlavorsAdminTestJSON-467331089-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:16.635370 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-feb9cb14-ff31-4c02-85e7-69c634ab584e tempest-FlavorsAdminTestJSON-467331089 tempest-FlavorsAdminTestJSON-467331089-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.028369 Aug 27 02:41:16.644662 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 250/498] 10.222.0.70 () {58 vars in 1146 bytes} [Sat Aug 27 02:41:16 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:16.655670 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5ee9f495-fb65-4f23-9243-110d78b85167 tempest-QuotaClassesAdmin257Test-2114547555 tempest-QuotaClassesAdmin257Test-2114547555-project-admin] Action: 'update', calling method: .version_select at 0x7f5ee35891f0>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:41:16.730777 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-5ee9f495-fb65-4f23-9243-110d78b85167 tempest-QuotaClassesAdmin257Test-2114547555 tempest-QuotaClassesAdmin257Test-2114547555-project-admin] 10.222.0.70 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.081434 Aug 27 02:41:16.731438 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 251/499] 10.222.0.70 () {62 vars in 1247 bytes} [Sat Aug 27 02:41:16 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:41:16.736155 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-2cf7f76f-dac7-46b2-8e59-3620b24a741c tempest-FlavorsAdminTestJSON-467331089 tempest-FlavorsAdminTestJSON-467331089-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:16.754908 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-2cf7f76f-dac7-46b2-8e59-3620b24a741c tempest-FlavorsAdminTestJSON-467331089 tempest-FlavorsAdminTestJSON-467331089-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/524163414" status: 202 len: 0 microversion: 2.1 time: 0.022143 Aug 27 02:41:16.755598 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 252/500] 10.222.0.70 () {58 vars in 1158 bytes} [Sat Aug 27 02:41:16 2022] DELETE /compute/v2.1/flavors/524163414 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:41:16.765319 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9607a3f0-2048-4eb6-9997-3111f53cffeb tempest-FlavorsAdminTestJSON-467331089 tempest-FlavorsAdminTestJSON-467331089-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:16.789037 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9607a3f0-2048-4eb6-9997-3111f53cffeb tempest-FlavorsAdminTestJSON-467331089 tempest-FlavorsAdminTestJSON-467331089-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.028327 Aug 27 02:41:16.790280 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 253/501] 10.222.0.70 () {58 vars in 1146 bytes} [Sat Aug 27 02:41:16 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:41:16.809824 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-43dd090b-0735-421a-8c93-d6fb04c7deb3 tempest-FlavorsAdminTestJSON-467331089 tempest-FlavorsAdminTestJSON-467331089-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-369989298", "id": 1949491926, "os-flavor-access:is_public": "False"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:41:16.828146 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-43dd090b-0735-421a-8c93-d6fb04c7deb3 tempest-FlavorsAdminTestJSON-467331089 tempest-FlavorsAdminTestJSON-467331089-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.022005 Aug 27 02:41:16.835503 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 254/502] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 02:41:16 2022] POST /compute/v2.1/flavors => generated 414 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:41:16.839856 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3a9025b7-81f6-41a0-9b35-301afb0539a4 tempest-FlavorsAdminTestJSON-467331089 tempest-FlavorsAdminTestJSON-467331089-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:16.871245 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-3a9025b7-81f6-41a0-9b35-301afb0539a4 tempest-FlavorsAdminTestJSON-467331089 tempest-FlavorsAdminTestJSON-467331089-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.034444 Aug 27 02:41:16.872131 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 255/503] 10.222.0.70 () {58 vars in 1146 bytes} [Sat Aug 27 02:41:16 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:16.890493 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-433bae16-c2c2-4801-bd94-386893e2e30e tempest-FlavorsAdminTestJSON-571417788 tempest-FlavorsAdminTestJSON-571417788-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:16.898536 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=9,nova_api:UPDATE=14,nova_api:DELETE=6 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:41:16.920980 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-433bae16-c2c2-4801-bd94-386893e2e30e tempest-FlavorsAdminTestJSON-571417788 tempest-FlavorsAdminTestJSON-571417788-project] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.031506 Aug 27 02:41:16.920980 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 256/504] 10.222.0.70 () {58 vars in 1146 bytes} [Sat Aug 27 02:41:16 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:41:16.936689 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-58a8bed2-0234-43fd-a05b-8ec1599ff029 tempest-FlavorsAdminTestJSON-467331089 tempest-FlavorsAdminTestJSON-467331089-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:16.955207 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-58a8bed2-0234-43fd-a05b-8ec1599ff029 tempest-FlavorsAdminTestJSON-467331089 tempest-FlavorsAdminTestJSON-467331089-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/1949491926" status: 202 len: 0 microversion: 2.1 time: 0.022430 Aug 27 02:41:16.959416 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 257/505] 10.222.0.70 () {58 vars in 1161 bytes} [Sat Aug 27 02:41:16 2022] DELETE /compute/v2.1/flavors/1949491926 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:41:16.965738 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8f985bcd-0f68-445b-b0ad-1631834ab787 tempest-FlavorsAdminTestJSON-467331089 tempest-FlavorsAdminTestJSON-467331089-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:16.988252 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-8f985bcd-0f68-445b-b0ad-1631834ab787 tempest-FlavorsAdminTestJSON-467331089 tempest-FlavorsAdminTestJSON-467331089-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.026139 Aug 27 02:41:16.992355 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 258/506] 10.222.0.70 () {58 vars in 1146 bytes} [Sat Aug 27 02:41:16 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:17.009164 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f8f18015-8052-4e57-9aed-01d098728384 tempest-FlavorsAdminTestJSON-467331089 tempest-FlavorsAdminTestJSON-467331089-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-909119975", "id": 866862140, "os-flavor-access:is_public": "True"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:41:17.029153 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f8f18015-8052-4e57-9aed-01d098728384 tempest-FlavorsAdminTestJSON-467331089 tempest-FlavorsAdminTestJSON-467331089-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.024156 Aug 27 02:41:17.038236 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 259/507] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 02:41:17 2022] POST /compute/v2.1/flavors => generated 410 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:41:17.043356 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-72de123f-3814-42a1-8e3b-7c8e605164a5 tempest-FlavorsAdminTestJSON-571417788 tempest-FlavorsAdminTestJSON-571417788-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:17.069051 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-72de123f-3814-42a1-8e3b-7c8e605164a5 tempest-FlavorsAdminTestJSON-571417788 tempest-FlavorsAdminTestJSON-571417788-project] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 6214 microversion: 2.1 time: 0.030126 Aug 27 02:41:17.069694 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 260/508] 10.222.0.70 () {58 vars in 1146 bytes} [Sat Aug 27 02:41:17 2022] GET /compute/v2.1/flavors/detail => generated 6214 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:17.087734 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-42338a44-a4d3-4a19-8a26-c2206e166a27 tempest-FlavorsAdminTestJSON-467331089 tempest-FlavorsAdminTestJSON-467331089-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:17.107938 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-42338a44-a4d3-4a19-8a26-c2206e166a27 tempest-FlavorsAdminTestJSON-467331089 tempest-FlavorsAdminTestJSON-467331089-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/866862140" status: 202 len: 0 microversion: 2.1 time: 0.024313 Aug 27 02:41:17.108814 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 261/509] 10.222.0.70 () {58 vars in 1158 bytes} [Sat Aug 27 02:41:17 2022] DELETE /compute/v2.1/flavors/866862140 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 02:41:17.114771 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-96f5bea9-b2c4-4bbf-9c9f-a40fba7f6c48 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:17.115390 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-96f5bea9-b2c4-4bbf-9c9f-a40fba7f6c48 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] [instance: 9a6c0a3a-6693-4061-8765-cc07d3a5a1a0] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:17.122708 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-96f5bea9-b2c4-4bbf-9c9f-a40fba7f6c48 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:17.123352 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-96f5bea9-b2c4-4bbf-9c9f-a40fba7f6c48 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:17.123797 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-96f5bea9-b2c4-4bbf-9c9f-a40fba7f6c48 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:17.124530 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-96f5bea9-b2c4-4bbf-9c9f-a40fba7f6c48 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:17.124984 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-96f5bea9-b2c4-4bbf-9c9f-a40fba7f6c48 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:17.125433 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-96f5bea9-b2c4-4bbf-9c9f-a40fba7f6c48 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:17.357892 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-96f5bea9-b2c4-4bbf-9c9f-a40fba7f6c48 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30abbf3afe304291981a6a9b85952aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c28ddbdb164f01bb82235c6d49717b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:17.367173 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-96f5bea9-b2c4-4bbf-9c9f-a40fba7f6c48 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] 10.222.0.70 "GET /compute/v2.1/servers/9a6c0a3a-6693-4061-8765-cc07d3a5a1a0" status: 200 len: 1313 microversion: 2.1 time: 0.257061 Aug 27 02:41:17.372171 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 262/510] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:17 2022] GET /compute/v2.1/servers/9a6c0a3a-6693-4061-8765-cc07d3a5a1a0 => generated 1313 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:17.378160 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-af984167-1660-4986-bd34-499d7631b955 tempest-FlavorsAdminTestJSON-467331089 tempest-FlavorsAdminTestJSON-467331089-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:17.429703 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-af984167-1660-4986-bd34-499d7631b955 tempest-FlavorsAdminTestJSON-467331089 tempest-FlavorsAdminTestJSON-467331089-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.054399 Aug 27 02:41:17.434778 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 263/511] 10.222.0.70 () {58 vars in 1146 bytes} [Sat Aug 27 02:41:17 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:17.576084 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-b5d7a5c7-06c2-48ad-8528-b7721a328f06 req-1dc85399-9475-4a59-873d-2fdb519f250a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29b88730-7871-4923-832e-a02d67f0314b", "name": "network-vif-plugged", "status": "completed", "tag": "9106e9cc-88c9-45f9-89cd-bb38806e1943"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:41:17.603453 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-b5d7a5c7-06c2-48ad-8528-b7721a328f06 req-1dc85399-9475-4a59-873d-2fdb519f250a service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:17.606305 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-b5d7a5c7-06c2-48ad-8528-b7721a328f06 req-1dc85399-9475-4a59-873d-2fdb519f250a service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:17.608720 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-b5d7a5c7-06c2-48ad-8528-b7721a328f06 req-1dc85399-9475-4a59-873d-2fdb519f250a service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:17.647838 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-b5d7a5c7-06c2-48ad-8528-b7721a328f06 req-1dc85399-9475-4a59-873d-2fdb519f250a service nova] Creating event network-vif-plugged:9106e9cc-88c9-45f9-89cd-bb38806e1943 for instance 29b88730-7871-4923-832e-a02d67f0314b on n-h2-852278-4 Aug 27 02:41:17.657980 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-b5d7a5c7-06c2-48ad-8528-b7721a328f06 req-1dc85399-9475-4a59-873d-2fdb519f250a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088106 Aug 27 02:41:17.661085 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 264/512] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:41:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:41:17.670334 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-c7e32760-c1c9-464c-ae8f-dbc12f171849 req-4576f576-bfc8-4895-8add-29346615fd97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a6c0a3a-6693-4061-8765-cc07d3a5a1a0", "tag": "407758c7-cef6-48bb-a19a-31c45ab4f2fd"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:41:17.692490 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-c7e32760-c1c9-464c-ae8f-dbc12f171849 req-4576f576-bfc8-4895-8add-29346615fd97 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:17.693335 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-c7e32760-c1c9-464c-ae8f-dbc12f171849 req-4576f576-bfc8-4895-8add-29346615fd97 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:17.693920 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-c7e32760-c1c9-464c-ae8f-dbc12f171849 req-4576f576-bfc8-4895-8add-29346615fd97 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:17.729242 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-c7e32760-c1c9-464c-ae8f-dbc12f171849 req-4576f576-bfc8-4895-8add-29346615fd97 service nova] Creating event network-changed:407758c7-cef6-48bb-a19a-31c45ab4f2fd for instance 9a6c0a3a-6693-4061-8765-cc07d3a5a1a0 on n-h2-852278-4 Aug 27 02:41:17.735497 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-c7e32760-c1c9-464c-ae8f-dbc12f171849 req-4576f576-bfc8-4895-8add-29346615fd97 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072670 Aug 27 02:41:17.737101 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 265/513] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:41:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:41:17.744798 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e140a3c0-e38b-4cc8-9c7b-a9bfbc2f826d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:17.745709 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-e140a3c0-e38b-4cc8-9c7b-a9bfbc2f826d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 29b88730-7871-4923-832e-a02d67f0314b] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:17.770139 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b7cbd5ba-1063-46bd-b166-dfc3323b81d7 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/bb513027-efc1-4201-812f-39c88b423a9d/action" status: 202 len: 0 microversion: 2.25 time: 2.551525 Aug 27 02:41:17.771893 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e140a3c0-e38b-4cc8-9c7b-a9bfbc2f826d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:17.772859 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e140a3c0-e38b-4cc8-9c7b-a9bfbc2f826d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:17.773480 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e140a3c0-e38b-4cc8-9c7b-a9bfbc2f826d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:17.774350 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e140a3c0-e38b-4cc8-9c7b-a9bfbc2f826d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:17.775058 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e140a3c0-e38b-4cc8-9c7b-a9bfbc2f826d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:17.775616 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e140a3c0-e38b-4cc8-9c7b-a9bfbc2f826d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:17.781541 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 249/514] 10.222.0.70 () {62 vars in 1319 bytes} [Sat Aug 27 02:41:15 2022] POST /compute/v2.1/servers/bb513027-efc1-4201-812f-39c88b423a9d/action => generated 0 bytes in 2564 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:41:17.794587 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-bbbdacab-ba4c-4779-811e-c9d8b0c9fb93 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:17.797381 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-bbbdacab-ba4c-4779-811e-c9d8b0c9fb93 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: bb513027-efc1-4201-812f-39c88b423a9d] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:17.821861 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bbbdacab-ba4c-4779-811e-c9d8b0c9fb93 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:17.825270 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bbbdacab-ba4c-4779-811e-c9d8b0c9fb93 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:17.826697 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bbbdacab-ba4c-4779-811e-c9d8b0c9fb93 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:17.829039 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bbbdacab-ba4c-4779-811e-c9d8b0c9fb93 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:17.831204 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bbbdacab-ba4c-4779-811e-c9d8b0c9fb93 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:17.831880 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bbbdacab-ba4c-4779-811e-c9d8b0c9fb93 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:18.018611 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-e140a3c0-e38b-4cc8-9c7b-a9bfbc2f826d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:18.030121 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e140a3c0-e38b-4cc8-9c7b-a9bfbc2f826d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/29b88730-7871-4923-832e-a02d67f0314b" status: 200 len: 1311 microversion: 2.1 time: 0.288668 Aug 27 02:41:18.042357 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 266/515] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:17 2022] GET /compute/v2.1/servers/29b88730-7871-4923-832e-a02d67f0314b => generated 1311 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:18.055517 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-bbbdacab-ba4c-4779-811e-c9d8b0c9fb93 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:18.064952 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-bbbdacab-ba4c-4779-811e-c9d8b0c9fb93 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:18.066647 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-bbbdacab-ba4c-4779-811e-c9d8b0c9fb93 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:18.067981 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-bbbdacab-ba4c-4779-811e-c9d8b0c9fb93 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/bb513027-efc1-4201-812f-39c88b423a9d" status: 200 len: 1568 microversion: 2.25 time: 0.283012 Aug 27 02:41:18.071922 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 250/516] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:41:17 2022] GET /compute/v2.1/servers/bb513027-efc1-4201-812f-39c88b423a9d => generated 1568 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:41:18.396873 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-94f057ae-d949-44c7-8888-17e7238e66bd tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:18.397713 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-94f057ae-d949-44c7-8888-17e7238e66bd tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] [instance: 9a6c0a3a-6693-4061-8765-cc07d3a5a1a0] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:18.407625 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-94f057ae-d949-44c7-8888-17e7238e66bd tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:18.408516 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-94f057ae-d949-44c7-8888-17e7238e66bd tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:18.409154 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-94f057ae-d949-44c7-8888-17e7238e66bd tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:18.411810 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-94f057ae-d949-44c7-8888-17e7238e66bd tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:18.412704 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-94f057ae-d949-44c7-8888-17e7238e66bd tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:18.414135 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-94f057ae-d949-44c7-8888-17e7238e66bd tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:18.720967 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-94f057ae-d949-44c7-8888-17e7238e66bd tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30abbf3afe304291981a6a9b85952aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c28ddbdb164f01bb82235c6d49717b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:18.731929 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-94f057ae-d949-44c7-8888-17e7238e66bd tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] 10.222.0.70 "GET /compute/v2.1/servers/9a6c0a3a-6693-4061-8765-cc07d3a5a1a0" status: 200 len: 1313 microversion: 2.1 time: 0.342572 Aug 27 02:41:18.732566 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 267/517] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:18 2022] GET /compute/v2.1/servers/9a6c0a3a-6693-4061-8765-cc07d3a5a1a0 => generated 1313 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:19.049634 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b55c9204-70c2-4081-b81e-fb8d4c9cab87 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:19.050231 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b55c9204-70c2-4081-b81e-fb8d4c9cab87 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 29b88730-7871-4923-832e-a02d67f0314b] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:19.053235 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=10 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:41:19.062946 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b55c9204-70c2-4081-b81e-fb8d4c9cab87 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:19.063442 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b55c9204-70c2-4081-b81e-fb8d4c9cab87 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:19.063877 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b55c9204-70c2-4081-b81e-fb8d4c9cab87 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:19.064620 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b55c9204-70c2-4081-b81e-fb8d4c9cab87 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:19.065235 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b55c9204-70c2-4081-b81e-fb8d4c9cab87 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:19.065798 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b55c9204-70c2-4081-b81e-fb8d4c9cab87 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:19.091164 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4f12fed3-3c0d-4c34-b675-507b3a5089fe tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:19.091748 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-4f12fed3-3c0d-4c34-b675-507b3a5089fe tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: bb513027-efc1-4201-812f-39c88b423a9d] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:19.106531 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4f12fed3-3c0d-4c34-b675-507b3a5089fe tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:19.107041 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4f12fed3-3c0d-4c34-b675-507b3a5089fe tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:19.107481 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4f12fed3-3c0d-4c34-b675-507b3a5089fe tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:19.108204 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4f12fed3-3c0d-4c34-b675-507b3a5089fe tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:19.108681 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4f12fed3-3c0d-4c34-b675-507b3a5089fe tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:19.109098 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4f12fed3-3c0d-4c34-b675-507b3a5089fe tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:19.714451 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=14 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:41:19.944925 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-4f12fed3-3c0d-4c34-b675-507b3a5089fe tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:19.957452 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-4f12fed3-3c0d-4c34-b675-507b3a5089fe tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:19.959140 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-4f12fed3-3c0d-4c34-b675-507b3a5089fe tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:19.962480 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-4f12fed3-3c0d-4c34-b675-507b3a5089fe tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/bb513027-efc1-4201-812f-39c88b423a9d" status: 200 len: 1568 microversion: 2.25 time: 0.874143 Aug 27 02:41:19.964798 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 268/518] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:41:19 2022] GET /compute/v2.1/servers/bb513027-efc1-4201-812f-39c88b423a9d => generated 1568 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:41:20.107103 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-b55c9204-70c2-4081-b81e-fb8d4c9cab87 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:20.120399 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b55c9204-70c2-4081-b81e-fb8d4c9cab87 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/29b88730-7871-4923-832e-a02d67f0314b" status: 200 len: 1311 microversion: 2.1 time: 1.070190 Aug 27 02:41:20.122368 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 251/519] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:19 2022] GET /compute/v2.1/servers/29b88730-7871-4923-832e-a02d67f0314b => generated 1311 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:20.129123 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-493baa92-1d47-4396-9138-04f417aab0b8 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:20.134332 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-493baa92-1d47-4396-9138-04f417aab0b8 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] [instance: 9a6c0a3a-6693-4061-8765-cc07d3a5a1a0] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:20.153954 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-493baa92-1d47-4396-9138-04f417aab0b8 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:20.155330 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-493baa92-1d47-4396-9138-04f417aab0b8 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:20.155992 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-493baa92-1d47-4396-9138-04f417aab0b8 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:20.159529 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-493baa92-1d47-4396-9138-04f417aab0b8 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:20.167807 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-493baa92-1d47-4396-9138-04f417aab0b8 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:20.168863 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-493baa92-1d47-4396-9138-04f417aab0b8 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:20.388779 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-db634675-4b93-4f77-9664-b70051ce354c tempest-HypervisorAdminV228Test-900211256 tempest-HypervisorAdminV228Test-900211256-project-admin] Calling method '.version_select at 0x7f5ee3596160>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:20.391000 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-db634675-4b93-4f77-9664-b70051ce354c tempest-HypervisorAdminV228Test-900211256 tempest-HypervisorAdminV228Test-900211256-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:20.391907 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-db634675-4b93-4f77-9664-b70051ce354c tempest-HypervisorAdminV228Test-900211256 tempest-HypervisorAdminV228Test-900211256-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:20.392595 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-db634675-4b93-4f77-9664-b70051ce354c tempest-HypervisorAdminV228Test-900211256 tempest-HypervisorAdminV228Test-900211256-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:20.409567 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-db634675-4b93-4f77-9664-b70051ce354c tempest-HypervisorAdminV228Test-900211256 tempest-HypervisorAdminV228Test-900211256-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:20.410337 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-db634675-4b93-4f77-9664-b70051ce354c tempest-HypervisorAdminV228Test-900211256 tempest-HypervisorAdminV228Test-900211256-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:20.410975 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-db634675-4b93-4f77-9664-b70051ce354c tempest-HypervisorAdminV228Test-900211256 tempest-HypervisorAdminV228Test-900211256-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:20.424346 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-db634675-4b93-4f77-9664-b70051ce354c tempest-HypervisorAdminV228Test-900211256 tempest-HypervisorAdminV228Test-900211256-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:20.425183 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-db634675-4b93-4f77-9664-b70051ce354c tempest-HypervisorAdminV228Test-900211256 tempest-HypervisorAdminV228Test-900211256-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:20.425950 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-db634675-4b93-4f77-9664-b70051ce354c tempest-HypervisorAdminV228Test-900211256 tempest-HypervisorAdminV228Test-900211256-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:20.433471 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-db634675-4b93-4f77-9664-b70051ce354c tempest-HypervisorAdminV228Test-900211256 tempest-HypervisorAdminV228Test-900211256-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.467520 Aug 27 02:41:20.434588 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 269/520] 10.222.0.70 () {60 vars in 1187 bytes} [Sat Aug 27 02:41:19 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:41:20.439481 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-6e5df224-2e41-4786-ad6d-f8270a08d2c2 req-d832eda8-742a-4904-98b8-d5f1c7ef64c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb513027-efc1-4201-812f-39c88b423a9d", "name": "network-vif-unplugged", "status": "completed", "tag": "00564c24-5898-44ae-8c51-440ac80fc61e"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:41:20.449684 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-6e5df224-2e41-4786-ad6d-f8270a08d2c2 req-d832eda8-742a-4904-98b8-d5f1c7ef64c3 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:20.450533 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-6e5df224-2e41-4786-ad6d-f8270a08d2c2 req-d832eda8-742a-4904-98b8-d5f1c7ef64c3 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:20.451182 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-6e5df224-2e41-4786-ad6d-f8270a08d2c2 req-d832eda8-742a-4904-98b8-d5f1c7ef64c3 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:20.465335 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-6e5df224-2e41-4786-ad6d-f8270a08d2c2 req-d832eda8-742a-4904-98b8-d5f1c7ef64c3 service nova] Creating event network-vif-unplugged:00564c24-5898-44ae-8c51-440ac80fc61e for instance bb513027-efc1-4201-812f-39c88b423a9d on n-h1-852278-4 Aug 27 02:41:20.471211 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-6e5df224-2e41-4786-ad6d-f8270a08d2c2 req-d832eda8-742a-4904-98b8-d5f1c7ef64c3 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035126 Aug 27 02:41:20.475403 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 270/521] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:41:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:41:20.513720 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-493baa92-1d47-4396-9138-04f417aab0b8 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30abbf3afe304291981a6a9b85952aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c28ddbdb164f01bb82235c6d49717b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:20.522168 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-493baa92-1d47-4396-9138-04f417aab0b8 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] 10.222.0.70 "GET /compute/v2.1/servers/9a6c0a3a-6693-4061-8765-cc07d3a5a1a0" status: 200 len: 1313 microversion: 2.1 time: 0.398488 Aug 27 02:41:20.522747 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 252/522] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:20 2022] GET /compute/v2.1/servers/9a6c0a3a-6693-4061-8765-cc07d3a5a1a0 => generated 1313 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:20.536370 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-db375ea0-efc1-43a5-a9a6-cfebfc8a649f tempest-HypervisorAdminV228Test-900211256 tempest-HypervisorAdminV228Test-900211256-project-admin] Calling method '.version_select at 0x7f5edf6b0430>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:20.538527 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-db375ea0-efc1-43a5-a9a6-cfebfc8a649f tempest-HypervisorAdminV228Test-900211256 tempest-HypervisorAdminV228Test-900211256-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:20.541840 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-db375ea0-efc1-43a5-a9a6-cfebfc8a649f tempest-HypervisorAdminV228Test-900211256 tempest-HypervisorAdminV228Test-900211256-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:20.542489 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-db375ea0-efc1-43a5-a9a6-cfebfc8a649f tempest-HypervisorAdminV228Test-900211256 tempest-HypervisorAdminV228Test-900211256-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:20.590532 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-db375ea0-efc1-43a5-a9a6-cfebfc8a649f tempest-HypervisorAdminV228Test-900211256 tempest-HypervisorAdminV228Test-900211256-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:20.591517 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-db375ea0-efc1-43a5-a9a6-cfebfc8a649f tempest-HypervisorAdminV228Test-900211256 tempest-HypervisorAdminV228Test-900211256-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:20.593173 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-db375ea0-efc1-43a5-a9a6-cfebfc8a649f tempest-HypervisorAdminV228Test-900211256 tempest-HypervisorAdminV228Test-900211256-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:20.600568 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-af469db5-acdf-4ca7-ad80-280295872982 tempest-QuotasAdminTestV236-1005590904 tempest-QuotasAdminTestV236-1005590904-project-admin] Action: 'update', calling method: .version_select at 0x7f5ee34f4310>, body: {"quota_set": {"ram": "5120"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:41:20.607343 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-db375ea0-efc1-43a5-a9a6-cfebfc8a649f tempest-HypervisorAdminV228Test-900211256 tempest-HypervisorAdminV228Test-900211256-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.077818 Aug 27 02:41:20.611892 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 253/523] 10.222.0.70 () {60 vars in 1193 bytes} [Sat Aug 27 02:41:20 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:41:20.993599 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a4aaa05d-11c6-4a13-a1cc-3a525624b4fe tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:20.994198 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-a4aaa05d-11c6-4a13-a1cc-3a525624b4fe tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: bb513027-efc1-4201-812f-39c88b423a9d] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:21.001325 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a4aaa05d-11c6-4a13-a1cc-3a525624b4fe tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:21.001798 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a4aaa05d-11c6-4a13-a1cc-3a525624b4fe tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:21.002422 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a4aaa05d-11c6-4a13-a1cc-3a525624b4fe tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:21.003114 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a4aaa05d-11c6-4a13-a1cc-3a525624b4fe tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:21.003770 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a4aaa05d-11c6-4a13-a1cc-3a525624b4fe tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:21.004430 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a4aaa05d-11c6-4a13-a1cc-3a525624b4fe tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:21.127144 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-af469db5-acdf-4ca7-ad80-280295872982 tempest-QuotasAdminTestV236-1005590904 tempest-QuotasAdminTestV236-1005590904-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:21.128972 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-af469db5-acdf-4ca7-ad80-280295872982 tempest-QuotasAdminTestV236-1005590904 tempest-QuotasAdminTestV236-1005590904-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:21.129798 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-af469db5-acdf-4ca7-ad80-280295872982 tempest-QuotasAdminTestV236-1005590904 tempest-QuotasAdminTestV236-1005590904-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:21.130745 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-af469db5-acdf-4ca7-ad80-280295872982 tempest-QuotasAdminTestV236-1005590904 tempest-QuotasAdminTestV236-1005590904-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:21.131200 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-af469db5-acdf-4ca7-ad80-280295872982 tempest-QuotasAdminTestV236-1005590904 tempest-QuotasAdminTestV236-1005590904-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:21.132516 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-af469db5-acdf-4ca7-ad80-280295872982 tempest-QuotasAdminTestV236-1005590904 tempest-QuotasAdminTestV236-1005590904-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:21.141809 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=9 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:41:21.167808 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-a4aaa05d-11c6-4a13-a1cc-3a525624b4fe tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:21.179520 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-a4aaa05d-11c6-4a13-a1cc-3a525624b4fe tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:21.182124 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-a4aaa05d-11c6-4a13-a1cc-3a525624b4fe tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:21.186251 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a4aaa05d-11c6-4a13-a1cc-3a525624b4fe tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/bb513027-efc1-4201-812f-39c88b423a9d" status: 200 len: 1568 microversion: 2.25 time: 0.200023 Aug 27 02:41:21.197237 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 254/524] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:41:20 2022] GET /compute/v2.1/servers/bb513027-efc1-4201-812f-39c88b423a9d => generated 1568 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:41:21.204553 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a34e6e1b-5228-44f5-9b86-2c15b602737c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:21.205892 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-a34e6e1b-5228-44f5-9b86-2c15b602737c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 29b88730-7871-4923-832e-a02d67f0314b] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:21.212776 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a34e6e1b-5228-44f5-9b86-2c15b602737c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:21.213895 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a34e6e1b-5228-44f5-9b86-2c15b602737c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:21.214741 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a34e6e1b-5228-44f5-9b86-2c15b602737c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:21.215844 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a34e6e1b-5228-44f5-9b86-2c15b602737c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:21.216479 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a34e6e1b-5228-44f5-9b86-2c15b602737c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:21.217050 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a34e6e1b-5228-44f5-9b86-2c15b602737c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:21.255748 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-af469db5-acdf-4ca7-ad80-280295872982 tempest-QuotasAdminTestV236-1005590904 tempest-QuotasAdminTestV236-1005590904-project-admin] 10.222.0.70 "PUT /compute/v2.1/os-quota-sets/2202ce16c3794357bbe7404790d443c7" status: 200 len: 240 microversion: 2.36 time: 0.778646 Aug 27 02:41:21.261879 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 271/525] 10.222.0.70 () {62 vars in 1303 bytes} [Sat Aug 27 02:41:20 2022] PUT /compute/v2.1/os-quota-sets/2202ce16c3794357bbe7404790d443c7 => generated 240 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:41:21.275641 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6cb8339b-29a3-4a95-9b4f-59a7c27410dd tempest-QuotasAdminTestV236-1005590904 tempest-QuotasAdminTestV236-1005590904-project-admin] Calling method '.version_select at 0x7f5ee3522e50>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:21.405365 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-a34e6e1b-5228-44f5-9b86-2c15b602737c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:21.412864 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a34e6e1b-5228-44f5-9b86-2c15b602737c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/29b88730-7871-4923-832e-a02d67f0314b" status: 200 len: 1493 microversion: 2.1 time: 0.214181 Aug 27 02:41:21.429741 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 255/526] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:21 2022] GET /compute/v2.1/servers/29b88730-7871-4923-832e-a02d67f0314b => generated 1493 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:21.682408 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ff26899f-ea8f-4a05-8432-4abaab389105 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:21.683201 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-ff26899f-ea8f-4a05-8432-4abaab389105 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] [instance: 29b88730-7871-4923-832e-a02d67f0314b] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:21.690206 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ff26899f-ea8f-4a05-8432-4abaab389105 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:21.690696 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ff26899f-ea8f-4a05-8432-4abaab389105 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:21.691128 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ff26899f-ea8f-4a05-8432-4abaab389105 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:21.691823 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ff26899f-ea8f-4a05-8432-4abaab389105 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:21.692273 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ff26899f-ea8f-4a05-8432-4abaab389105 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:21.692722 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ff26899f-ea8f-4a05-8432-4abaab389105 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:21.821506 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6cb8339b-29a3-4a95-9b4f-59a7c27410dd tempest-QuotasAdminTestV236-1005590904 tempest-QuotasAdminTestV236-1005590904-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:21.821981 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6cb8339b-29a3-4a95-9b4f-59a7c27410dd tempest-QuotasAdminTestV236-1005590904 tempest-QuotasAdminTestV236-1005590904-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:21.822408 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6cb8339b-29a3-4a95-9b4f-59a7c27410dd tempest-QuotasAdminTestV236-1005590904 tempest-QuotasAdminTestV236-1005590904-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:21.824354 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6cb8339b-29a3-4a95-9b4f-59a7c27410dd tempest-QuotasAdminTestV236-1005590904 tempest-QuotasAdminTestV236-1005590904-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:21.825103 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6cb8339b-29a3-4a95-9b4f-59a7c27410dd tempest-QuotasAdminTestV236-1005590904 tempest-QuotasAdminTestV236-1005590904-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:21.825529 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6cb8339b-29a3-4a95-9b4f-59a7c27410dd tempest-QuotasAdminTestV236-1005590904 tempest-QuotasAdminTestV236-1005590904-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:21.858131 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-6cb8339b-29a3-4a95-9b4f-59a7c27410dd tempest-QuotasAdminTestV236-1005590904 tempest-QuotasAdminTestV236-1005590904-project-admin] 10.222.0.70 "GET /compute/v2.1/os-quota-sets/2202ce16c3794357bbe7404790d443c7/detail" status: 200 len: 672 microversion: 2.36 time: 0.588695 Aug 27 02:41:21.860348 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 272/527] 10.222.0.70 () {60 vars in 1304 bytes} [Sat Aug 27 02:41:21 2022] GET /compute/v2.1/os-quota-sets/2202ce16c3794357bbe7404790d443c7/detail => generated 672 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:41:21.866406 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-dbe1ea21-12f0-4d6c-99a3-23248d7aee95 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:21.867385 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-dbe1ea21-12f0-4d6c-99a3-23248d7aee95 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] [instance: 9a6c0a3a-6693-4061-8765-cc07d3a5a1a0] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:21.892982 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dbe1ea21-12f0-4d6c-99a3-23248d7aee95 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:21.893469 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dbe1ea21-12f0-4d6c-99a3-23248d7aee95 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:21.893903 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dbe1ea21-12f0-4d6c-99a3-23248d7aee95 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:21.908886 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dbe1ea21-12f0-4d6c-99a3-23248d7aee95 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:21.909374 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dbe1ea21-12f0-4d6c-99a3-23248d7aee95 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:21.910426 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ff26899f-ea8f-4a05-8432-4abaab389105 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/29b88730-7871-4923-832e-a02d67f0314b" status: 200 len: 1644 microversion: 2.1 time: 0.473206 Aug 27 02:41:21.911161 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 256/528] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:21 2022] GET /compute/v2.1/servers/29b88730-7871-4923-832e-a02d67f0314b => generated 1644 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:41:21.926673 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dbe1ea21-12f0-4d6c-99a3-23248d7aee95 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:21.937182 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-8f971e06-108f-47f5-8abe-097cb67abcd9 req-965a2e2f-2a85-49dc-8b8e-58ceed85383b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ee4d4db-a1bb-4567-a20d-29003e67a295", "name": "network-vif-plugged", "status": "completed", "tag": "cb37d724-8fd4-499e-a131-e0d13d7b8f95"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:41:21.947088 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-8f971e06-108f-47f5-8abe-097cb67abcd9 req-965a2e2f-2a85-49dc-8b8e-58ceed85383b service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:21.947551 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-8f971e06-108f-47f5-8abe-097cb67abcd9 req-965a2e2f-2a85-49dc-8b8e-58ceed85383b service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:21.948174 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-8f971e06-108f-47f5-8abe-097cb67abcd9 req-965a2e2f-2a85-49dc-8b8e-58ceed85383b service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:21.963282 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-8f971e06-108f-47f5-8abe-097cb67abcd9 req-965a2e2f-2a85-49dc-8b8e-58ceed85383b service nova] Creating event network-vif-plugged:cb37d724-8fd4-499e-a131-e0d13d7b8f95 for instance 3ee4d4db-a1bb-4567-a20d-29003e67a295 on n-h2-852278-4 Aug 27 02:41:21.984185 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-8f971e06-108f-47f5-8abe-097cb67abcd9 req-965a2e2f-2a85-49dc-8b8e-58ceed85383b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048291 Aug 27 02:41:21.985508 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 257/529] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:41:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:41:22.024515 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-39df5f19-1d71-4eb3-9738-f9bdffa14431 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:22.026119 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-39df5f19-1d71-4eb3-9738-f9bdffa14431 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] [instance: 29b88730-7871-4923-832e-a02d67f0314b] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:22.035073 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-39df5f19-1d71-4eb3-9738-f9bdffa14431 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:22.036783 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-39df5f19-1d71-4eb3-9738-f9bdffa14431 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:22.037433 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-39df5f19-1d71-4eb3-9738-f9bdffa14431 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:22.038324 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-39df5f19-1d71-4eb3-9738-f9bdffa14431 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:22.038952 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-39df5f19-1d71-4eb3-9738-f9bdffa14431 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:22.039653 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-39df5f19-1d71-4eb3-9738-f9bdffa14431 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:22.207117 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-dbe1ea21-12f0-4d6c-99a3-23248d7aee95 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30abbf3afe304291981a6a9b85952aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c28ddbdb164f01bb82235c6d49717b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:22.218168 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-dbe1ea21-12f0-4d6c-99a3-23248d7aee95 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] 10.222.0.70 "GET /compute/v2.1/servers/9a6c0a3a-6693-4061-8765-cc07d3a5a1a0" status: 200 len: 1313 microversion: 2.1 time: 0.356072 Aug 27 02:41:22.218804 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 273/530] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:21 2022] GET /compute/v2.1/servers/9a6c0a3a-6693-4061-8765-cc07d3a5a1a0 => generated 1313 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:22.236907 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-014fbdc9-7ad4-4a0d-98bc-0aee06624dd5 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:22.237675 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-014fbdc9-7ad4-4a0d-98bc-0aee06624dd5 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: bb513027-efc1-4201-812f-39c88b423a9d] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:22.251061 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-014fbdc9-7ad4-4a0d-98bc-0aee06624dd5 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:22.251605 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-014fbdc9-7ad4-4a0d-98bc-0aee06624dd5 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:22.252245 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-014fbdc9-7ad4-4a0d-98bc-0aee06624dd5 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:22.253692 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-014fbdc9-7ad4-4a0d-98bc-0aee06624dd5 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:22.254326 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-014fbdc9-7ad4-4a0d-98bc-0aee06624dd5 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:22.255621 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-014fbdc9-7ad4-4a0d-98bc-0aee06624dd5 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:22.309533 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-39df5f19-1d71-4eb3-9738-f9bdffa14431 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/29b88730-7871-4923-832e-a02d67f0314b" status: 200 len: 1644 microversion: 2.1 time: 0.321534 Aug 27 02:41:22.320571 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 258/531] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:21 2022] GET /compute/v2.1/servers/29b88730-7871-4923-832e-a02d67f0314b => generated 1644 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:22.340430 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b8fbfd17-662c-4fa0-8fbf-96c40d44a3a6 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:22.344624 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b8fbfd17-662c-4fa0-8fbf-96c40d44a3a6 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:22.345291 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b8fbfd17-662c-4fa0-8fbf-96c40d44a3a6 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:22.345515 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b8fbfd17-662c-4fa0-8fbf-96c40d44a3a6 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:22.346340 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b8fbfd17-662c-4fa0-8fbf-96c40d44a3a6 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:22.346666 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b8fbfd17-662c-4fa0-8fbf-96c40d44a3a6 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:22.347078 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b8fbfd17-662c-4fa0-8fbf-96c40d44a3a6 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:22.372767 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b8fbfd17-662c-4fa0-8fbf-96c40d44a3a6 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] 10.222.0.70 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.046595 Aug 27 02:41:22.380987 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 259/532] 10.222.0.70 () {58 vars in 1176 bytes} [Sat Aug 27 02:41:22 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:41:22.391053 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-1a7ecafc-7323-4db0-b858-dda4242448b3 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-852278-4", "block_migration": true, "disk_over_commit": false}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:41:22.400984 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-1a7ecafc-7323-4db0-b858-dda4242448b3 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] [instance: 29b88730-7871-4923-832e-a02d67f0314b] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:22.416822 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1a7ecafc-7323-4db0-b858-dda4242448b3 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:22.417248 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1a7ecafc-7323-4db0-b858-dda4242448b3 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:22.418045 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1a7ecafc-7323-4db0-b858-dda4242448b3 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:22.418927 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1a7ecafc-7323-4db0-b858-dda4242448b3 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:22.419535 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1a7ecafc-7323-4db0-b858-dda4242448b3 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:22.420190 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1a7ecafc-7323-4db0-b858-dda4242448b3 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:22.474827 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.objects.instance [None req-1a7ecafc-7323-4db0-b858-dda4242448b3 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Lazy-loading 'flavor' on Instance uuid 29b88730-7871-4923-832e-a02d67f0314b {{(pid=134051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:41:22.488164 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-1a7ecafc-7323-4db0-b858-dda4242448b3 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] [instance: 29b88730-7871-4923-832e-a02d67f0314b] Going to try to live migrate instance to n-h1-852278-4 {{(pid=134051) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 27 02:41:22.536097 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-014fbdc9-7ad4-4a0d-98bc-0aee06624dd5 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:22.566676 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-014fbdc9-7ad4-4a0d-98bc-0aee06624dd5 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:22.568956 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=4,nova_cell1:INSERT=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:41:22.575587 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-014fbdc9-7ad4-4a0d-98bc-0aee06624dd5 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:22.579557 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-014fbdc9-7ad4-4a0d-98bc-0aee06624dd5 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/bb513027-efc1-4201-812f-39c88b423a9d" status: 200 len: 1568 microversion: 2.25 time: 0.358031 Aug 27 02:41:22.596673 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 274/533] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:41:22 2022] GET /compute/v2.1/servers/bb513027-efc1-4201-812f-39c88b423a9d => generated 1568 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:41:22.611227 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-6cea07de-bb4d-4e71-b3b9-da299ee1f308 req-7c813f18-5233-46e5-9437-490308179ee6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb513027-efc1-4201-812f-39c88b423a9d", "tag": "00564c24-5898-44ae-8c51-440ac80fc61e"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:41:22.622772 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-6cea07de-bb4d-4e71-b3b9-da299ee1f308 req-7c813f18-5233-46e5-9437-490308179ee6 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:22.625918 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-6cea07de-bb4d-4e71-b3b9-da299ee1f308 req-7c813f18-5233-46e5-9437-490308179ee6 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:22.626719 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-6cea07de-bb4d-4e71-b3b9-da299ee1f308 req-7c813f18-5233-46e5-9437-490308179ee6 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:22.646842 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-6cea07de-bb4d-4e71-b3b9-da299ee1f308 req-7c813f18-5233-46e5-9437-490308179ee6 service nova] Creating event network-changed:00564c24-5898-44ae-8c51-440ac80fc61e for instance bb513027-efc1-4201-812f-39c88b423a9d on n-h1-852278-4 Aug 27 02:41:22.659397 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-6cea07de-bb4d-4e71-b3b9-da299ee1f308 req-7c813f18-5233-46e5-9437-490308179ee6 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057533 Aug 27 02:41:22.660117 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 275/534] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:41:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:41:22.742857 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d30641db-82b6-4cd9-9c59-fbd3939d2979 tempest-QuotasAdminTestV236-1005590904 tempest-QuotasAdminTestV236-1005590904-project-admin] Action: 'update', calling method: .version_select at 0x7f5ee34b9430>, body: {"quota_set": {"ram": "2048"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:41:23.079539 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d30641db-82b6-4cd9-9c59-fbd3939d2979 tempest-QuotasAdminTestV236-1005590904 tempest-QuotasAdminTestV236-1005590904-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:23.082682 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d30641db-82b6-4cd9-9c59-fbd3939d2979 tempest-QuotasAdminTestV236-1005590904 tempest-QuotasAdminTestV236-1005590904-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:23.083666 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d30641db-82b6-4cd9-9c59-fbd3939d2979 tempest-QuotasAdminTestV236-1005590904 tempest-QuotasAdminTestV236-1005590904-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:23.084672 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d30641db-82b6-4cd9-9c59-fbd3939d2979 tempest-QuotasAdminTestV236-1005590904 tempest-QuotasAdminTestV236-1005590904-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:23.085150 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d30641db-82b6-4cd9-9c59-fbd3939d2979 tempest-QuotasAdminTestV236-1005590904 tempest-QuotasAdminTestV236-1005590904-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:23.085587 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d30641db-82b6-4cd9-9c59-fbd3939d2979 tempest-QuotasAdminTestV236-1005590904 tempest-QuotasAdminTestV236-1005590904-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:23.153928 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d30641db-82b6-4cd9-9c59-fbd3939d2979 tempest-QuotasAdminTestV236-1005590904 tempest-QuotasAdminTestV236-1005590904-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:23.154712 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d30641db-82b6-4cd9-9c59-fbd3939d2979 tempest-QuotasAdminTestV236-1005590904 tempest-QuotasAdminTestV236-1005590904-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:23.155313 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d30641db-82b6-4cd9-9c59-fbd3939d2979 tempest-QuotasAdminTestV236-1005590904 tempest-QuotasAdminTestV236-1005590904-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:23.156981 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d30641db-82b6-4cd9-9c59-fbd3939d2979 tempest-QuotasAdminTestV236-1005590904 tempest-QuotasAdminTestV236-1005590904-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:23.157604 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d30641db-82b6-4cd9-9c59-fbd3939d2979 tempest-QuotasAdminTestV236-1005590904 tempest-QuotasAdminTestV236-1005590904-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:23.158200 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d30641db-82b6-4cd9-9c59-fbd3939d2979 tempest-QuotasAdminTestV236-1005590904 tempest-QuotasAdminTestV236-1005590904-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:23.241038 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d30641db-82b6-4cd9-9c59-fbd3939d2979 tempest-QuotasAdminTestV236-1005590904 tempest-QuotasAdminTestV236-1005590904-project-admin] 10.222.0.70 "PUT /compute/v2.1/os-quota-sets/2202ce16c3794357bbe7404790d443c7?user_id=539475638c704644bde464f387535586" status: 200 len: 240 microversion: 2.36 time: 0.503731 Aug 27 02:41:23.242974 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 276/535] 10.222.0.70 () {62 vars in 1384 bytes} [Sat Aug 27 02:41:22 2022] PUT /compute/v2.1/os-quota-sets/2202ce16c3794357bbe7404790d443c7?user_id=539475638c704644bde464f387535586 => generated 240 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 02:41:23.248204 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5d7185a9-9c73-487c-8514-c26a69d10800 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:23.249120 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-5d7185a9-9c73-487c-8514-c26a69d10800 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] [instance: 9a6c0a3a-6693-4061-8765-cc07d3a5a1a0] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:23.265465 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5d7185a9-9c73-487c-8514-c26a69d10800 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:23.266021 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5d7185a9-9c73-487c-8514-c26a69d10800 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:23.267360 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5d7185a9-9c73-487c-8514-c26a69d10800 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:23.268077 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5d7185a9-9c73-487c-8514-c26a69d10800 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:23.269278 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5d7185a9-9c73-487c-8514-c26a69d10800 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:23.269714 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5d7185a9-9c73-487c-8514-c26a69d10800 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:23.545789 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-5d7185a9-9c73-487c-8514-c26a69d10800 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30abbf3afe304291981a6a9b85952aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c28ddbdb164f01bb82235c6d49717b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:23.565564 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-5d7185a9-9c73-487c-8514-c26a69d10800 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] 10.222.0.70 "GET /compute/v2.1/servers/9a6c0a3a-6693-4061-8765-cc07d3a5a1a0" status: 200 len: 1313 microversion: 2.1 time: 0.310892 Aug 27 02:41:23.567104 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 277/536] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:23 2022] GET /compute/v2.1/servers/9a6c0a3a-6693-4061-8765-cc07d3a5a1a0 => generated 1313 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:23.575058 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b8b0aae6-025b-4515-8783-96016f6a217d tempest-QuotasAdminTestV236-1005590904 tempest-QuotasAdminTestV236-1005590904-project-admin] Calling method '.version_select at 0x7f5ee3596160>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:24.025899 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=6,nova_api:INSERT=3 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:41:24.029403 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b8b0aae6-025b-4515-8783-96016f6a217d tempest-QuotasAdminTestV236-1005590904 tempest-QuotasAdminTestV236-1005590904-project-admin] 10.222.0.70 "GET /compute/v2.1/os-quota-sets/2202ce16c3794357bbe7404790d443c7?user_id=539475638c704644bde464f387535586" status: 200 len: 282 microversion: 2.36 time: 0.461275 Aug 27 02:41:24.029982 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 278/537] 10.222.0.70 () {60 vars in 1364 bytes} [Sat Aug 27 02:41:23 2022] GET /compute/v2.1/os-quota-sets/2202ce16c3794357bbe7404790d443c7?user_id=539475638c704644bde464f387535586 => generated 282 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:41:24.356665 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-2cc46261-3bef-45b9-b647-b8a3b4f2fc6f tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-521001441", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:41:24.420775 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.network.neutron [None req-2cc46261-3bef-45b9-b647-b8a3b4f2fc6f tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] validate_networks() for None {{(pid=134052) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:41:24.748899 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-2cc46261-3bef-45b9-b647-b8a3b4f2fc6f tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Flavor limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:41:24.750073 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-2cc46261-3bef-45b9-b647-b8a3b4f2fc6f tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Image limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:41:24.752184 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-2cc46261-3bef-45b9-b647-b8a3b4f2fc6f tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Flavor pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:41:24.752981 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-2cc46261-3bef-45b9-b647-b8a3b4f2fc6f tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Image pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:41:24.754046 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-2cc46261-3bef-45b9-b647-b8a3b4f2fc6f tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:41:24.807295 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2cc46261-3bef-45b9-b647-b8a3b4f2fc6f tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:24.810058 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2cc46261-3bef-45b9-b647-b8a3b4f2fc6f tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:24.810885 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2cc46261-3bef-45b9-b647-b8a3b4f2fc6f tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:24.811913 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2cc46261-3bef-45b9-b647-b8a3b4f2fc6f tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:24.812582 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2cc46261-3bef-45b9-b647-b8a3b4f2fc6f tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:24.813712 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2cc46261-3bef-45b9-b647-b8a3b4f2fc6f tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:24.846855 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-2cc46261-3bef-45b9-b647-b8a3b4f2fc6f tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Getting quotas for project f7a009f79d954838abb0566d86b97f2e. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:41:24.853096 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-2cc46261-3bef-45b9-b647-b8a3b4f2fc6f tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Getting quotas for user 8f2ff9f8745c4dda8b04fbeb95d9988a and project f7a009f79d954838abb0566d86b97f2e. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:41:24.867297 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-2cc46261-3bef-45b9-b647-b8a3b4f2fc6f tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Going to run 1 instances... {{(pid=134052) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:41:24.870046 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-2cc46261-3bef-45b9-b647-b8a3b4f2fc6f tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] [instance: 2e8baa0f-02cd-43f0-8919-e9bfbe6f1d01] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134052) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:41:24.932185 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-2cc46261-3bef-45b9-b647-b8a3b4f2fc6f tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.900872 Aug 27 02:41:24.933512 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 279/538] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 02:41:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 903 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:41:24.945341 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c72926aa-7227-4869-92a1-dfd0896f81fc tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:24.946063 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-c72926aa-7227-4869-92a1-dfd0896f81fc tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: bb513027-efc1-4201-812f-39c88b423a9d] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:24.986186 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c72926aa-7227-4869-92a1-dfd0896f81fc tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:24.986679 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c72926aa-7227-4869-92a1-dfd0896f81fc tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:24.987107 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c72926aa-7227-4869-92a1-dfd0896f81fc tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:24.987801 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c72926aa-7227-4869-92a1-dfd0896f81fc tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:24.988255 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c72926aa-7227-4869-92a1-dfd0896f81fc tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:24.989059 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c72926aa-7227-4869-92a1-dfd0896f81fc tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:25.758691 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-c72926aa-7227-4869-92a1-dfd0896f81fc tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:25.768384 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-c72926aa-7227-4869-92a1-dfd0896f81fc tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:25.770231 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-c72926aa-7227-4869-92a1-dfd0896f81fc tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:25.771420 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c72926aa-7227-4869-92a1-dfd0896f81fc tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/bb513027-efc1-4201-812f-39c88b423a9d" status: 200 len: 1568 microversion: 2.25 time: 0.836627 Aug 27 02:41:25.771965 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 280/539] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:41:24 2022] GET /compute/v2.1/servers/bb513027-efc1-4201-812f-39c88b423a9d => generated 1568 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:41:25.793706 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-80e14a8b-f26d-4517-9db8-cc66ac64d56e req-0a9f65ed-5898-4c4e-8d5c-c014756e61d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a6c0a3a-6693-4061-8765-cc07d3a5a1a0", "name": "network-vif-plugged", "status": "completed", "tag": "407758c7-cef6-48bb-a19a-31c45ab4f2fd"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:41:25.806048 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-80e14a8b-f26d-4517-9db8-cc66ac64d56e req-0a9f65ed-5898-4c4e-8d5c-c014756e61d8 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:25.806529 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-80e14a8b-f26d-4517-9db8-cc66ac64d56e req-0a9f65ed-5898-4c4e-8d5c-c014756e61d8 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:25.806958 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-80e14a8b-f26d-4517-9db8-cc66ac64d56e req-0a9f65ed-5898-4c4e-8d5c-c014756e61d8 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:25.819642 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-80e14a8b-f26d-4517-9db8-cc66ac64d56e req-0a9f65ed-5898-4c4e-8d5c-c014756e61d8 service nova] Creating event network-vif-plugged:407758c7-cef6-48bb-a19a-31c45ab4f2fd for instance 9a6c0a3a-6693-4061-8765-cc07d3a5a1a0 on n-h2-852278-4 Aug 27 02:41:25.826139 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-80e14a8b-f26d-4517-9db8-cc66ac64d56e req-0a9f65ed-5898-4c4e-8d5c-c014756e61d8 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039916 Aug 27 02:41:25.826677 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 281/540] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:41:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:41:26.109375 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-7e4ff0f6-5cd2-4a3b-89c5-dda9d8161fbd tempest-HypervisorAdminUnderV252Test-492703142 tempest-HypervisorAdminUnderV252Test-492703142-project-admin] Calling method '.version_select at 0x7f5ee34b9ee0>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:26.111252 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7e4ff0f6-5cd2-4a3b-89c5-dda9d8161fbd tempest-HypervisorAdminUnderV252Test-492703142 tempest-HypervisorAdminUnderV252Test-492703142-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:26.111728 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7e4ff0f6-5cd2-4a3b-89c5-dda9d8161fbd tempest-HypervisorAdminUnderV252Test-492703142 tempest-HypervisorAdminUnderV252Test-492703142-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:26.112161 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7e4ff0f6-5cd2-4a3b-89c5-dda9d8161fbd tempest-HypervisorAdminUnderV252Test-492703142 tempest-HypervisorAdminUnderV252Test-492703142-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:26.127378 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7e4ff0f6-5cd2-4a3b-89c5-dda9d8161fbd tempest-HypervisorAdminUnderV252Test-492703142 tempest-HypervisorAdminUnderV252Test-492703142-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:26.127879 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7e4ff0f6-5cd2-4a3b-89c5-dda9d8161fbd tempest-HypervisorAdminUnderV252Test-492703142 tempest-HypervisorAdminUnderV252Test-492703142-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:26.128322 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7e4ff0f6-5cd2-4a3b-89c5-dda9d8161fbd tempest-HypervisorAdminUnderV252Test-492703142 tempest-HypervisorAdminUnderV252Test-492703142-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:26.140025 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7e4ff0f6-5cd2-4a3b-89c5-dda9d8161fbd tempest-HypervisorAdminUnderV252Test-492703142 tempest-HypervisorAdminUnderV252Test-492703142-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:26.140546 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7e4ff0f6-5cd2-4a3b-89c5-dda9d8161fbd tempest-HypervisorAdminUnderV252Test-492703142 tempest-HypervisorAdminUnderV252Test-492703142-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:26.141085 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7e4ff0f6-5cd2-4a3b-89c5-dda9d8161fbd tempest-HypervisorAdminUnderV252Test-492703142 tempest-HypervisorAdminUnderV252Test-492703142-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:26.147626 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-7e4ff0f6-5cd2-4a3b-89c5-dda9d8161fbd tempest-HypervisorAdminUnderV252Test-492703142 tempest-HypervisorAdminUnderV252Test-492703142-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.319583 Aug 27 02:41:26.148236 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 282/541] 10.222.0.70 () {58 vars in 1146 bytes} [Sat Aug 27 02:41:25 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:41:26.154347 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a5355d21-9f42-4dc3-ab97-e581ae668860 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:26.154979 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a5355d21-9f42-4dc3-ab97-e581ae668860 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] [instance: 9a6c0a3a-6693-4061-8765-cc07d3a5a1a0] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:26.164666 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a5355d21-9f42-4dc3-ab97-e581ae668860 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:26.164968 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a5355d21-9f42-4dc3-ab97-e581ae668860 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:26.165328 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a5355d21-9f42-4dc3-ab97-e581ae668860 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:26.166084 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a5355d21-9f42-4dc3-ab97-e581ae668860 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:26.166571 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a5355d21-9f42-4dc3-ab97-e581ae668860 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:26.167074 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a5355d21-9f42-4dc3-ab97-e581ae668860 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:26.268297 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-1a7ecafc-7323-4db0-b858-dda4242448b3 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/29b88730-7871-4923-832e-a02d67f0314b/action" status: 202 len: 0 microversion: 2.1 time: 3.884770 Aug 27 02:41:26.272389 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 260/542] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 02:41:22 2022] POST /compute/v2.1/servers/29b88730-7871-4923-832e-a02d67f0314b/action => generated 0 bytes in 3889 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:41:26.277967 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-df7168f0-14e9-4a23-a31f-a8af36dafb2c tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:26.278600 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-df7168f0-14e9-4a23-a31f-a8af36dafb2c tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] [instance: 2e8baa0f-02cd-43f0-8919-e9bfbe6f1d01] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:26.288122 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-df7168f0-14e9-4a23-a31f-a8af36dafb2c tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:26.288665 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-df7168f0-14e9-4a23-a31f-a8af36dafb2c tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:26.290115 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-df7168f0-14e9-4a23-a31f-a8af36dafb2c tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:26.291082 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-df7168f0-14e9-4a23-a31f-a8af36dafb2c tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:26.292360 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-df7168f0-14e9-4a23-a31f-a8af36dafb2c tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:26.293121 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-df7168f0-14e9-4a23-a31f-a8af36dafb2c tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:26.435150 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-df7168f0-14e9-4a23-a31f-a8af36dafb2c tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2ff9f8745c4dda8b04fbeb95d9988a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a009f79d954838abb0566d86b97f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:26.449082 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-df7168f0-14e9-4a23-a31f-a8af36dafb2c tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] 10.222.0.70 "GET /compute/v2.1/servers/2e8baa0f-02cd-43f0-8919-e9bfbe6f1d01" status: 200 len: 1265 microversion: 2.1 time: 0.173928 Aug 27 02:41:26.452608 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 261/543] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:26 2022] GET /compute/v2.1/servers/2e8baa0f-02cd-43f0-8919-e9bfbe6f1d01 => generated 1265 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:26.682342 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-a5355d21-9f42-4dc3-ab97-e581ae668860 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30abbf3afe304291981a6a9b85952aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c28ddbdb164f01bb82235c6d49717b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:26.693254 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a5355d21-9f42-4dc3-ab97-e581ae668860 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] 10.222.0.70 "GET /compute/v2.1/servers/9a6c0a3a-6693-4061-8765-cc07d3a5a1a0" status: 200 len: 1313 microversion: 2.1 time: 0.542266 Aug 27 02:41:26.693884 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 283/544] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:26 2022] GET /compute/v2.1/servers/9a6c0a3a-6693-4061-8765-cc07d3a5a1a0 => generated 1313 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:26.717421 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5687d5aa-dfe8-4e3b-af57-adccfd65f834 tempest-HypervisorAdminUnderV252Test-492703142 tempest-HypervisorAdminUnderV252Test-492703142-project-admin] Calling method '.version_select at 0x7f5ee3467f70>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:26.719888 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5687d5aa-dfe8-4e3b-af57-adccfd65f834 tempest-HypervisorAdminUnderV252Test-492703142 tempest-HypervisorAdminUnderV252Test-492703142-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:26.723860 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5687d5aa-dfe8-4e3b-af57-adccfd65f834 tempest-HypervisorAdminUnderV252Test-492703142 tempest-HypervisorAdminUnderV252Test-492703142-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:26.724674 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5687d5aa-dfe8-4e3b-af57-adccfd65f834 tempest-HypervisorAdminUnderV252Test-492703142 tempest-HypervisorAdminUnderV252Test-492703142-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:26.732324 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=100 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:41:26.753912 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5687d5aa-dfe8-4e3b-af57-adccfd65f834 tempest-HypervisorAdminUnderV252Test-492703142 tempest-HypervisorAdminUnderV252Test-492703142-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:26.754941 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5687d5aa-dfe8-4e3b-af57-adccfd65f834 tempest-HypervisorAdminUnderV252Test-492703142 tempest-HypervisorAdminUnderV252Test-492703142-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:26.755534 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5687d5aa-dfe8-4e3b-af57-adccfd65f834 tempest-HypervisorAdminUnderV252Test-492703142 tempest-HypervisorAdminUnderV252Test-492703142-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:26.766761 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3f367598-8b11-480e-8291-2b974ae32b4d tempest-QuotaClassesAdminTestJSON-1600479612 tempest-QuotaClassesAdminTestJSON-1600479612-project-admin] Calling method '.version_select at 0x7f5edf511670>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:26.790657 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-3f367598-8b11-480e-8291-2b974ae32b4d tempest-QuotaClassesAdminTestJSON-1600479612 tempest-QuotaClassesAdminTestJSON-1600479612-project-admin] 10.222.0.70 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.334537 Aug 27 02:41:26.792400 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5687d5aa-dfe8-4e3b-af57-adccfd65f834 tempest-HypervisorAdminUnderV252Test-492703142 tempest-HypervisorAdminUnderV252Test-492703142-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:26.793479 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5687d5aa-dfe8-4e3b-af57-adccfd65f834 tempest-HypervisorAdminUnderV252Test-492703142 tempest-HypervisorAdminUnderV252Test-492703142-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:26.794270 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5687d5aa-dfe8-4e3b-af57-adccfd65f834 tempest-HypervisorAdminUnderV252Test-492703142 tempest-HypervisorAdminUnderV252Test-492703142-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:26.797533 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 262/545] 10.222.0.70 () {58 vars in 1185 bytes} [Sat Aug 27 02:41:26 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:41:26.805388 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-42ac963f-b96a-42e3-8e86-149aa1d15cd2 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:26.808510 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-5687d5aa-dfe8-4e3b-af57-adccfd65f834 tempest-HypervisorAdminUnderV252Test-492703142 tempest-HypervisorAdminUnderV252Test-492703142-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors/n-h2-852278-4/servers" status: 200 len: 433 microversion: 2.1 time: 0.102890 Aug 27 02:41:26.810084 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-42ac963f-b96a-42e3-8e86-149aa1d15cd2 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 29b88730-7871-4923-832e-a02d67f0314b] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:26.816690 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 284/546] 10.222.0.70 () {58 vars in 1212 bytes} [Sat Aug 27 02:41:26 2022] GET /compute/v2.1/os-hypervisors/n-h2-852278-4/servers => generated 433 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:41:26.821534 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-42ac963f-b96a-42e3-8e86-149aa1d15cd2 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:26.822882 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-1132c301-a20f-46c6-9ffb-cabc9a9546a3 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:26.823566 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-1132c301-a20f-46c6-9ffb-cabc9a9546a3 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] [instance: f5d6ba67-b815-4ec1-9d75-ee5436f5e3c7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:26.825700 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-42ac963f-b96a-42e3-8e86-149aa1d15cd2 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:26.826187 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-42ac963f-b96a-42e3-8e86-149aa1d15cd2 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:26.826949 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-42ac963f-b96a-42e3-8e86-149aa1d15cd2 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:26.827407 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-42ac963f-b96a-42e3-8e86-149aa1d15cd2 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:26.830644 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1132c301-a20f-46c6-9ffb-cabc9a9546a3 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:26.831129 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1132c301-a20f-46c6-9ffb-cabc9a9546a3 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:26.831738 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1132c301-a20f-46c6-9ffb-cabc9a9546a3 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:26.832483 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1132c301-a20f-46c6-9ffb-cabc9a9546a3 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:26.833291 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1132c301-a20f-46c6-9ffb-cabc9a9546a3 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:26.833866 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1132c301-a20f-46c6-9ffb-cabc9a9546a3 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:26.834283 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-42ac963f-b96a-42e3-8e86-149aa1d15cd2 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:26.862779 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-1132c301-a20f-46c6-9ffb-cabc9a9546a3 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] [instance: f5d6ba67-b815-4ec1-9d75-ee5436f5e3c7] Going to try to terminate instance {{(pid=134052) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:41:26.997156 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-1132c301-a20f-46c6-9ffb-cabc9a9546a3 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] 10.222.0.70 "DELETE /compute/v2.1/servers/f5d6ba67-b815-4ec1-9d75-ee5436f5e3c7" status: 204 len: 0 microversion: 2.1 time: 0.178618 Aug 27 02:41:27.000061 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 285/547] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:41:26 2022] DELETE /compute/v2.1/servers/f5d6ba67-b815-4ec1-9d75-ee5436f5e3c7 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:41:27.006794 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-da4118e8-80bf-4336-b4c5-e4578a44c909 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:27.007558 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-da4118e8-80bf-4336-b4c5-e4578a44c909 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: bb513027-efc1-4201-812f-39c88b423a9d] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:27.027961 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-da4118e8-80bf-4336-b4c5-e4578a44c909 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:27.029308 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-da4118e8-80bf-4336-b4c5-e4578a44c909 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:27.030891 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-da4118e8-80bf-4336-b4c5-e4578a44c909 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:27.031956 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-da4118e8-80bf-4336-b4c5-e4578a44c909 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:27.032684 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-da4118e8-80bf-4336-b4c5-e4578a44c909 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:27.033452 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-da4118e8-80bf-4336-b4c5-e4578a44c909 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:27.244267 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-42ac963f-b96a-42e3-8e86-149aa1d15cd2 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:27.253406 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-42ac963f-b96a-42e3-8e86-149aa1d15cd2 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/29b88730-7871-4923-832e-a02d67f0314b" status: 200 len: 1503 microversion: 2.1 time: 0.454695 Aug 27 02:41:27.267608 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 263/548] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:26 2022] GET /compute/v2.1/servers/29b88730-7871-4923-832e-a02d67f0314b => generated 1503 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:27.272637 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-34667147-0f45-4d0e-a60a-4d0657b0f234 tempest-QuotaClassesAdminTestJSON-1600479612 tempest-QuotaClassesAdminTestJSON-1600479612-project-admin] Action: 'update', calling method: .version_select at 0x7f5edf5c8310>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:41:27.377706 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-da4118e8-80bf-4336-b4c5-e4578a44c909 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:27.386187 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-da4118e8-80bf-4336-b4c5-e4578a44c909 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:27.388178 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-da4118e8-80bf-4336-b4c5-e4578a44c909 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:27.389906 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-da4118e8-80bf-4336-b4c5-e4578a44c909 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/bb513027-efc1-4201-812f-39c88b423a9d" status: 200 len: 1568 microversion: 2.25 time: 0.388498 Aug 27 02:41:27.400941 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 286/549] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:41:27 2022] GET /compute/v2.1/servers/bb513027-efc1-4201-812f-39c88b423a9d => generated 1568 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:41:27.414206 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8b68cc13-5330-4808-bda8-7b2bdf0c7eb5 tempest-HypervisorAdminUnderV252Test-492703142 tempest-HypervisorAdminUnderV252Test-492703142-project-admin] Calling method '.version_select at 0x7f5ee3522550>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:27.416101 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8b68cc13-5330-4808-bda8-7b2bdf0c7eb5 tempest-HypervisorAdminUnderV252Test-492703142 tempest-HypervisorAdminUnderV252Test-492703142-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:27.416613 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8b68cc13-5330-4808-bda8-7b2bdf0c7eb5 tempest-HypervisorAdminUnderV252Test-492703142 tempest-HypervisorAdminUnderV252Test-492703142-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:27.417044 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8b68cc13-5330-4808-bda8-7b2bdf0c7eb5 tempest-HypervisorAdminUnderV252Test-492703142 tempest-HypervisorAdminUnderV252Test-492703142-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:27.433753 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8b68cc13-5330-4808-bda8-7b2bdf0c7eb5 tempest-HypervisorAdminUnderV252Test-492703142 tempest-HypervisorAdminUnderV252Test-492703142-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:27.434601 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8b68cc13-5330-4808-bda8-7b2bdf0c7eb5 tempest-HypervisorAdminUnderV252Test-492703142 tempest-HypervisorAdminUnderV252Test-492703142-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:27.435431 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8b68cc13-5330-4808-bda8-7b2bdf0c7eb5 tempest-HypervisorAdminUnderV252Test-492703142 tempest-HypervisorAdminUnderV252Test-492703142-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:27.446719 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8b68cc13-5330-4808-bda8-7b2bdf0c7eb5 tempest-HypervisorAdminUnderV252Test-492703142 tempest-HypervisorAdminUnderV252Test-492703142-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:27.447318 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8b68cc13-5330-4808-bda8-7b2bdf0c7eb5 tempest-HypervisorAdminUnderV252Test-492703142 tempest-HypervisorAdminUnderV252Test-492703142-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:27.447849 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8b68cc13-5330-4808-bda8-7b2bdf0c7eb5 tempest-HypervisorAdminUnderV252Test-492703142 tempest-HypervisorAdminUnderV252Test-492703142-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:27.454595 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-8b68cc13-5330-4808-bda8-7b2bdf0c7eb5 tempest-HypervisorAdminUnderV252Test-492703142 tempest-HypervisorAdminUnderV252Test-492703142-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.052373 Aug 27 02:41:27.455639 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 287/550] 10.222.0.70 () {58 vars in 1146 bytes} [Sat Aug 27 02:41:27 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:41:27.466015 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-89efdb3c-c051-48b2-918f-a38d1aa6e37b tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1450531171", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "185355050", "adminPass": "***", "networks": [{"uuid": "03f35903-063c-4d65-9657-789ad66ba106"}], "security_groups": [{"name": "tempest-securitygroup--184061249"}], "key_name": "tempest-keypair-1094053635", "user_data": "}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:41:27.557991 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-34667147-0f45-4d0e-a60a-4d0657b0f234 tempest-QuotaClassesAdminTestJSON-1600479612 tempest-QuotaClassesAdminTestJSON-1600479612-project-admin] 10.222.0.70 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.288969 Aug 27 02:41:27.558607 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 264/551] 10.222.0.70 () {60 vars in 1206 bytes} [Sat Aug 27 02:41:27 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:41:27.563290 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-10bff930-ad0e-47cf-a004-cf25c86696c5 tempest-HypervisorAdminUnderV252Test-492703142 tempest-HypervisorAdminUnderV252Test-492703142-project-admin] Calling method '.version_select at 0x7f5edf5c8040>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:27.565242 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-10bff930-ad0e-47cf-a004-cf25c86696c5 tempest-HypervisorAdminUnderV252Test-492703142 tempest-HypervisorAdminUnderV252Test-492703142-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:27.566192 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-10bff930-ad0e-47cf-a004-cf25c86696c5 tempest-HypervisorAdminUnderV252Test-492703142 tempest-HypervisorAdminUnderV252Test-492703142-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:27.566891 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-10bff930-ad0e-47cf-a004-cf25c86696c5 tempest-HypervisorAdminUnderV252Test-492703142 tempest-HypervisorAdminUnderV252Test-492703142-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:27.587429 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-10bff930-ad0e-47cf-a004-cf25c86696c5 tempest-HypervisorAdminUnderV252Test-492703142 tempest-HypervisorAdminUnderV252Test-492703142-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:27.588032 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-10bff930-ad0e-47cf-a004-cf25c86696c5 tempest-HypervisorAdminUnderV252Test-492703142 tempest-HypervisorAdminUnderV252Test-492703142-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:27.588369 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-10bff930-ad0e-47cf-a004-cf25c86696c5 tempest-HypervisorAdminUnderV252Test-492703142 tempest-HypervisorAdminUnderV252Test-492703142-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:27.595211 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-10bff930-ad0e-47cf-a004-cf25c86696c5 tempest-HypervisorAdminUnderV252Test-492703142 tempest-HypervisorAdminUnderV252Test-492703142-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors/n-h2-852278-4/search" status: 200 len: 104 microversion: 2.1 time: 0.035398 Aug 27 02:41:27.597392 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 265/552] 10.222.0.70 () {58 vars in 1209 bytes} [Sat Aug 27 02:41:27 2022] GET /compute/v2.1/os-hypervisors/n-h2-852278-4/search => generated 104 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:41:27.604686 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-cff90162-4c48-4eb1-a6ad-59071832a48b tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:27.605452 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-cff90162-4c48-4eb1-a6ad-59071832a48b tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] [instance: 2e8baa0f-02cd-43f0-8919-e9bfbe6f1d01] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:27.622474 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cff90162-4c48-4eb1-a6ad-59071832a48b tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:27.622873 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cff90162-4c48-4eb1-a6ad-59071832a48b tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:27.623646 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cff90162-4c48-4eb1-a6ad-59071832a48b tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:27.635831 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cff90162-4c48-4eb1-a6ad-59071832a48b tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:27.637336 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cff90162-4c48-4eb1-a6ad-59071832a48b tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:27.637819 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cff90162-4c48-4eb1-a6ad-59071832a48b tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:27.734734 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.network.neutron [None req-89efdb3c-c051-48b2-918f-a38d1aa6e37b tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] validate_networks() for [('03f35903-063c-4d65-9657-789ad66ba106', None, None, None, None, None)] {{(pid=134052) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:41:27.796493 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-cff90162-4c48-4eb1-a6ad-59071832a48b tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2ff9f8745c4dda8b04fbeb95d9988a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a009f79d954838abb0566d86b97f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:27.805847 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-cff90162-4c48-4eb1-a6ad-59071832a48b tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] 10.222.0.70 "GET /compute/v2.1/servers/2e8baa0f-02cd-43f0-8919-e9bfbe6f1d01" status: 200 len: 1271 microversion: 2.1 time: 0.206758 Aug 27 02:41:27.821999 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 266/553] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:27 2022] GET /compute/v2.1/servers/2e8baa0f-02cd-43f0-8919-e9bfbe6f1d01 => generated 1271 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:27.827794 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d4986478-763d-47a9-85b1-50be05a56b0e tempest-QuotaClassesAdminTestJSON-1600479612 tempest-QuotaClassesAdminTestJSON-1600479612-project-admin] Calling method '.version_select at 0x7f5edf4a1790>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:27.840435 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d4986478-763d-47a9-85b1-50be05a56b0e tempest-QuotaClassesAdminTestJSON-1600479612 tempest-QuotaClassesAdminTestJSON-1600479612-project-admin] 10.222.0.70 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.016722 Aug 27 02:41:27.841618 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 267/554] 10.222.0.70 () {58 vars in 1185 bytes} [Sat Aug 27 02:41:27 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:41:27.847177 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8ebcd62f-15eb-4db7-8591-5522df6bc559 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:27.849954 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-8ebcd62f-15eb-4db7-8591-5522df6bc559 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] [instance: 9a6c0a3a-6693-4061-8765-cc07d3a5a1a0] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:27.856820 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8ebcd62f-15eb-4db7-8591-5522df6bc559 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:27.858057 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8ebcd62f-15eb-4db7-8591-5522df6bc559 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:27.858839 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8ebcd62f-15eb-4db7-8591-5522df6bc559 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:27.859626 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8ebcd62f-15eb-4db7-8591-5522df6bc559 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:27.860108 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8ebcd62f-15eb-4db7-8591-5522df6bc559 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:27.860566 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8ebcd62f-15eb-4db7-8591-5522df6bc559 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:28.374046 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-8ebcd62f-15eb-4db7-8591-5522df6bc559 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30abbf3afe304291981a6a9b85952aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c28ddbdb164f01bb82235c6d49717b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:28.384104 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-8ebcd62f-15eb-4db7-8591-5522df6bc559 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] 10.222.0.70 "GET /compute/v2.1/servers/9a6c0a3a-6693-4061-8765-cc07d3a5a1a0" status: 200 len: 1313 microversion: 2.1 time: 0.541035 Aug 27 02:41:28.385143 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 268/555] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:27 2022] GET /compute/v2.1/servers/9a6c0a3a-6693-4061-8765-cc07d3a5a1a0 => generated 1313 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:28.391373 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-38ec942d-254c-48ac-8035-d629e7adcf63 tempest-QuotaClassesAdminTestJSON-1600479612 tempest-QuotaClassesAdminTestJSON-1600479612-project-admin] Action: 'update', calling method: .version_select at 0x7f5edf44e280>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:41:28.413961 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=13,nova_api:INSERT=7 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:41:28.573148 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-38ec942d-254c-48ac-8035-d629e7adcf63 tempest-QuotaClassesAdminTestJSON-1600479612 tempest-QuotaClassesAdminTestJSON-1600479612-project-admin] 10.222.0.70 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.186445 Aug 27 02:41:28.574933 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 269/556] 10.222.0.70 () {60 vars in 1206 bytes} [Sat Aug 27 02:41:28 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:41:28.588514 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-abf74330-90e4-45ae-84da-aff1b3e56ec6 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:28.596274 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-abf74330-90e4-45ae-84da-aff1b3e56ec6 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 29b88730-7871-4923-832e-a02d67f0314b] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:28.603709 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-abf74330-90e4-45ae-84da-aff1b3e56ec6 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:28.605885 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-abf74330-90e4-45ae-84da-aff1b3e56ec6 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:28.607053 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-abf74330-90e4-45ae-84da-aff1b3e56ec6 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:28.617528 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-abf74330-90e4-45ae-84da-aff1b3e56ec6 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:28.618544 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-abf74330-90e4-45ae-84da-aff1b3e56ec6 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:28.619288 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-abf74330-90e4-45ae-84da-aff1b3e56ec6 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:28.664865 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-89efdb3c-c051-48b2-918f-a38d1aa6e37b tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Flavor limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:41:28.665954 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-89efdb3c-c051-48b2-918f-a38d1aa6e37b tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Image limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:41:28.666631 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-89efdb3c-c051-48b2-918f-a38d1aa6e37b tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Flavor pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:41:28.667249 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-89efdb3c-c051-48b2-918f-a38d1aa6e37b tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Image pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:41:28.669028 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-89efdb3c-c051-48b2-918f-a38d1aa6e37b tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:41:28.688504 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-89efdb3c-c051-48b2-918f-a38d1aa6e37b tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:28.689224 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-89efdb3c-c051-48b2-918f-a38d1aa6e37b tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:28.689807 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-89efdb3c-c051-48b2-918f-a38d1aa6e37b tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:28.690698 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-89efdb3c-c051-48b2-918f-a38d1aa6e37b tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:28.692908 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-89efdb3c-c051-48b2-918f-a38d1aa6e37b tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:28.693509 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-89efdb3c-c051-48b2-918f-a38d1aa6e37b tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:28.753773 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-89efdb3c-c051-48b2-918f-a38d1aa6e37b tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Getting quotas for project 72992d9dba564526b223533398a94dea. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:41:28.768430 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-89efdb3c-c051-48b2-918f-a38d1aa6e37b tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Getting quotas for user c4c850104e6d430397bb54d0e3730a73 and project 72992d9dba564526b223533398a94dea. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:41:28.812943 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-89efdb3c-c051-48b2-918f-a38d1aa6e37b tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Going to run 1 instances... {{(pid=134052) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:41:28.819462 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-89efdb3c-c051-48b2-918f-a38d1aa6e37b tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] [instance: 7c1f28aa-64fe-4517-88e2-b2e677baea24] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=134052) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:41:28.826057 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-abf74330-90e4-45ae-84da-aff1b3e56ec6 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:28.837899 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-abf74330-90e4-45ae-84da-aff1b3e56ec6 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/29b88730-7871-4923-832e-a02d67f0314b" status: 200 len: 1503 microversion: 2.1 time: 0.261562 Aug 27 02:41:28.839046 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 270/557] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:28 2022] GET /compute/v2.1/servers/29b88730-7871-4923-832e-a02d67f0314b => generated 1503 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:28.845300 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e9dff560-ad5e-4ed6-9822-7125578bb547 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:28.846536 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-e9dff560-ad5e-4ed6-9822-7125578bb547 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: bb513027-efc1-4201-812f-39c88b423a9d] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:28.863809 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e9dff560-ad5e-4ed6-9822-7125578bb547 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:28.864738 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e9dff560-ad5e-4ed6-9822-7125578bb547 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:28.865560 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e9dff560-ad5e-4ed6-9822-7125578bb547 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:28.866977 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e9dff560-ad5e-4ed6-9822-7125578bb547 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:28.867892 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e9dff560-ad5e-4ed6-9822-7125578bb547 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:28.868735 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e9dff560-ad5e-4ed6-9822-7125578bb547 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:28.958051 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-89efdb3c-c051-48b2-918f-a38d1aa6e37b tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.500842 Aug 27 02:41:28.960458 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 288/558] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 02:41:27 2022] POST /compute/v2.1/servers => generated 401 bytes in 1502 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:41:28.963875 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0a14ef59-9318-4c92-8195-e6812c2998b7 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:28.964752 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-0a14ef59-9318-4c92-8195-e6812c2998b7 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] [instance: 2e8baa0f-02cd-43f0-8919-e9bfbe6f1d01] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:28.978363 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0a14ef59-9318-4c92-8195-e6812c2998b7 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:28.979248 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0a14ef59-9318-4c92-8195-e6812c2998b7 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:28.979786 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0a14ef59-9318-4c92-8195-e6812c2998b7 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:28.990484 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0a14ef59-9318-4c92-8195-e6812c2998b7 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:28.991398 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0a14ef59-9318-4c92-8195-e6812c2998b7 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:28.992131 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0a14ef59-9318-4c92-8195-e6812c2998b7 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:29.544045 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e9dff560-ad5e-4ed6-9822-7125578bb547 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:29.561056 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e9dff560-ad5e-4ed6-9822-7125578bb547 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:29.567756 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e9dff560-ad5e-4ed6-9822-7125578bb547 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:29.570675 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e9dff560-ad5e-4ed6-9822-7125578bb547 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/bb513027-efc1-4201-812f-39c88b423a9d" status: 200 len: 1543 microversion: 2.25 time: 0.730369 Aug 27 02:41:29.573168 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 271/559] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:41:28 2022] GET /compute/v2.1/servers/bb513027-efc1-4201-812f-39c88b423a9d => generated 1543 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:41:29.607753 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d5c9e77c-c983-4d0d-bbad-e77f1bb918e7 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:29.611121 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d5c9e77c-c983-4d0d-bbad-e77f1bb918e7 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] [instance: 7c1f28aa-64fe-4517-88e2-b2e677baea24] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:30.051480 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d5c9e77c-c983-4d0d-bbad-e77f1bb918e7 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c850104e6d430397bb54d0e3730a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72992d9dba564526b223533398a94dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:30.065885 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d5c9e77c-c983-4d0d-bbad-e77f1bb918e7 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] 10.222.0.70 "GET /compute/v2.1/servers/7c1f28aa-64fe-4517-88e2-b2e677baea24" status: 200 len: 1263 microversion: 2.1 time: 0.476030 Aug 27 02:41:30.070486 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0a14ef59-9318-4c92-8195-e6812c2998b7 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2ff9f8745c4dda8b04fbeb95d9988a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a009f79d954838abb0566d86b97f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:30.079081 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-0a14ef59-9318-4c92-8195-e6812c2998b7 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] 10.222.0.70 "GET /compute/v2.1/servers/2e8baa0f-02cd-43f0-8919-e9bfbe6f1d01" status: 200 len: 1313 microversion: 2.1 time: 1.119024 Aug 27 02:41:30.081317 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 272/560] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:29 2022] GET /compute/v2.1/servers/7c1f28aa-64fe-4517-88e2-b2e677baea24 => generated 1263 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:30.082048 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 289/561] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:28 2022] GET /compute/v2.1/servers/2e8baa0f-02cd-43f0-8919-e9bfbe6f1d01 => generated 1313 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:30.094516 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e9de1929-0757-483e-b476-77904aadae47 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:30.094516 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-e9de1929-0757-483e-b476-77904aadae47 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] [instance: 9a6c0a3a-6693-4061-8765-cc07d3a5a1a0] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:30.094844 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c0093a69-6404-4d33-8195-6298523384d9 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Calling method '.version_select at 0x7f5ee3482160>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:30.094951 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e9de1929-0757-483e-b476-77904aadae47 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:30.094951 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e9de1929-0757-483e-b476-77904aadae47 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:30.095395 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e9de1929-0757-483e-b476-77904aadae47 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:30.096128 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e9de1929-0757-483e-b476-77904aadae47 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:30.099400 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c0093a69-6404-4d33-8195-6298523384d9 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:30.099400 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c0093a69-6404-4d33-8195-6298523384d9 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:30.100495 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e9de1929-0757-483e-b476-77904aadae47 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:30.101803 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e9de1929-0757-483e-b476-77904aadae47 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:30.111372 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c0093a69-6404-4d33-8195-6298523384d9 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:30.137794 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c0093a69-6404-4d33-8195-6298523384d9 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] 10.222.0.70 "GET /compute/v2.1/os-migrations" status: 200 len: 1522 microversion: 2.25 time: 0.053856 Aug 27 02:41:30.142849 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 290/562] 10.222.0.70 () {60 vars in 1184 bytes} [Sat Aug 27 02:41:30 2022] GET /compute/v2.1/os-migrations => generated 1522 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:41:30.155012 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-c93f0d6b-b5bd-4a75-a72a-7e94d401633b req-8b9e9073-5460-4c9f-a52e-1320bd0cdf72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29b88730-7871-4923-832e-a02d67f0314b", "name": "network-vif-unplugged", "status": "completed", "tag": "9106e9cc-88c9-45f9-89cd-bb38806e1943"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:41:30.173423 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-c93f0d6b-b5bd-4a75-a72a-7e94d401633b req-8b9e9073-5460-4c9f-a52e-1320bd0cdf72 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:30.173904 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-c93f0d6b-b5bd-4a75-a72a-7e94d401633b req-8b9e9073-5460-4c9f-a52e-1320bd0cdf72 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:30.174329 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-c93f0d6b-b5bd-4a75-a72a-7e94d401633b req-8b9e9073-5460-4c9f-a52e-1320bd0cdf72 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:30.194000 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-c93f0d6b-b5bd-4a75-a72a-7e94d401633b req-8b9e9073-5460-4c9f-a52e-1320bd0cdf72 service nova] Creating event network-vif-unplugged:9106e9cc-88c9-45f9-89cd-bb38806e1943 for instance 29b88730-7871-4923-832e-a02d67f0314b on n-h2-852278-4 Aug 27 02:41:30.199751 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-c93f0d6b-b5bd-4a75-a72a-7e94d401633b req-8b9e9073-5460-4c9f-a52e-1320bd0cdf72 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055624 Aug 27 02:41:30.200784 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 291/563] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:41:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:41:30.206199 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-29aa5cb4-bb0e-4176-84fb-28a259864ceb tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:30.207088 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-29aa5cb4-bb0e-4176-84fb-28a259864ceb tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 29b88730-7871-4923-832e-a02d67f0314b] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:30.214376 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-29aa5cb4-bb0e-4176-84fb-28a259864ceb tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:30.215708 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-29aa5cb4-bb0e-4176-84fb-28a259864ceb tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:30.216342 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-29aa5cb4-bb0e-4176-84fb-28a259864ceb tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:30.217227 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-29aa5cb4-bb0e-4176-84fb-28a259864ceb tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:30.217897 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-29aa5cb4-bb0e-4176-84fb-28a259864ceb tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:30.218617 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-29aa5cb4-bb0e-4176-84fb-28a259864ceb tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:30.473501 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e9de1929-0757-483e-b476-77904aadae47 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30abbf3afe304291981a6a9b85952aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c28ddbdb164f01bb82235c6d49717b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:30.485387 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e9de1929-0757-483e-b476-77904aadae47 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] 10.222.0.70 "GET /compute/v2.1/servers/9a6c0a3a-6693-4061-8765-cc07d3a5a1a0" status: 200 len: 1462 microversion: 2.1 time: 0.402848 Aug 27 02:41:30.487915 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 273/564] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:30 2022] GET /compute/v2.1/servers/9a6c0a3a-6693-4061-8765-cc07d3a5a1a0 => generated 1462 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:30.494015 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b3ac7946-659d-478b-b359-c51204755a1d tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:30.496298 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b3ac7946-659d-478b-b359-c51204755a1d tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] [instance: bb513027-efc1-4201-812f-39c88b423a9d] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:30.504149 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b3ac7946-659d-478b-b359-c51204755a1d tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:30.505180 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b3ac7946-659d-478b-b359-c51204755a1d tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:30.506923 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b3ac7946-659d-478b-b359-c51204755a1d tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:30.508477 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b3ac7946-659d-478b-b359-c51204755a1d tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:30.509227 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b3ac7946-659d-478b-b359-c51204755a1d tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:30.509750 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b3ac7946-659d-478b-b359-c51204755a1d tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:30.896344 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-29aa5cb4-bb0e-4176-84fb-28a259864ceb tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:30.925299 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.objects.instance [None req-b3ac7946-659d-478b-b359-c51204755a1d tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lazy-loading 'services' on Instance uuid bb513027-efc1-4201-812f-39c88b423a9d {{(pid=134051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:41:30.949841 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b3ac7946-659d-478b-b359-c51204755a1d tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/bb513027-efc1-4201-812f-39c88b423a9d" status: 200 len: 2036 microversion: 2.25 time: 0.460525 Aug 27 02:41:30.968430 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-29aa5cb4-bb0e-4176-84fb-28a259864ceb tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/29b88730-7871-4923-832e-a02d67f0314b" status: 200 len: 1503 microversion: 2.1 time: 0.757379 Aug 27 02:41:30.969598 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 274/565] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:41:30 2022] GET /compute/v2.1/servers/bb513027-efc1-4201-812f-39c88b423a9d => generated 2036 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:41:30.970783 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 292/566] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:30 2022] GET /compute/v2.1/servers/29b88730-7871-4923-832e-a02d67f0314b => generated 1503 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:31.004679 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ca7df38a-f7c0-4bdc-81f6-325decc5cfdf tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:31.005979 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-ca7df38a-f7c0-4bdc-81f6-325decc5cfdf tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] [instance: 3ee4d4db-a1bb-4567-a20d-29003e67a295] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:31.013558 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ca7df38a-f7c0-4bdc-81f6-325decc5cfdf tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:31.014372 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ca7df38a-f7c0-4bdc-81f6-325decc5cfdf tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:31.015001 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ca7df38a-f7c0-4bdc-81f6-325decc5cfdf tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:31.015932 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ca7df38a-f7c0-4bdc-81f6-325decc5cfdf tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:31.016616 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ca7df38a-f7c0-4bdc-81f6-325decc5cfdf tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:31.017598 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ca7df38a-f7c0-4bdc-81f6-325decc5cfdf tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:31.276443 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-7588f61c-bc40-4eb3-b521-0e974a765691 tempest-QuotasAdminTestV257-1893778565 tempest-QuotasAdminTestV257-1893778565-project-admin] Action: 'update', calling method: .version_select at 0x7f5ee3522dc0>, body: {"quota_set": {"ram": "5120"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:41:31.428235 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7588f61c-bc40-4eb3-b521-0e974a765691 tempest-QuotasAdminTestV257-1893778565 tempest-QuotasAdminTestV257-1893778565-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:31.430916 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7588f61c-bc40-4eb3-b521-0e974a765691 tempest-QuotasAdminTestV257-1893778565 tempest-QuotasAdminTestV257-1893778565-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:31.431823 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7588f61c-bc40-4eb3-b521-0e974a765691 tempest-QuotasAdminTestV257-1893778565 tempest-QuotasAdminTestV257-1893778565-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:31.433155 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7588f61c-bc40-4eb3-b521-0e974a765691 tempest-QuotasAdminTestV257-1893778565 tempest-QuotasAdminTestV257-1893778565-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:31.433620 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7588f61c-bc40-4eb3-b521-0e974a765691 tempest-QuotasAdminTestV257-1893778565 tempest-QuotasAdminTestV257-1893778565-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:31.434224 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7588f61c-bc40-4eb3-b521-0e974a765691 tempest-QuotasAdminTestV257-1893778565 tempest-QuotasAdminTestV257-1893778565-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:31.532706 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-7588f61c-bc40-4eb3-b521-0e974a765691 tempest-QuotasAdminTestV257-1893778565 tempest-QuotasAdminTestV257-1893778565-project-admin] 10.222.0.70 "PUT /compute/v2.1/os-quota-sets/96e2d490f9ca4b53ad9da659c240ae8a" status: 200 len: 148 microversion: 2.57 time: 0.560301 Aug 27 02:41:31.535030 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 293/567] 10.222.0.70 () {62 vars in 1303 bytes} [Sat Aug 27 02:41:30 2022] PUT /compute/v2.1/os-quota-sets/96e2d490f9ca4b53ad9da659c240ae8a => generated 148 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:41:31.543144 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8c3bfae9-66f8-4a65-81c3-80ff9df76a7c tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Action: 'create', calling method: .version_select at 0x7f5ee34014c0>, body: {"keypair": {"name": "tempest-keypair-294981480", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG1danBk8ajgDS+s2Z/ygDy4o2ci1mdTAXl1M+/IaG/5OjTrQDOBL3kSuRI5eQtiUqPFwJkgv+yKHbUviS5xeEXpsqL5j7j/Aw/9KXzhuBHYy5ow/r/00nN7sphNBbVBSw=="}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:41:31.563085 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-8c3bfae9-66f8-4a65-81c3-80ff9df76a7c tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Getting quotas for project e78b498dced14d1d822e7d0c27f57215. Resources: {'key_pairs'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:41:31.573015 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-8c3bfae9-66f8-4a65-81c3-80ff9df76a7c tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Getting quotas for user 774ce37f4c6b4f72ad494ea40a3e238d and project e78b498dced14d1d822e7d0c27f57215. Resources: {'key_pairs'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:41:31.624978 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-8c3bfae9-66f8-4a65-81c3-80ff9df76a7c tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.25 time: 0.086807 Aug 27 02:41:31.635017 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 294/568] 10.222.0.70 () {62 vars in 1200 bytes} [Sat Aug 27 02:41:31 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 99 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 27 02:41:31.641230 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-00317889-3834-4292-ad87-4fc303892831 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:31.642166 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-00317889-3834-4292-ad87-4fc303892831 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] [instance: 7c1f28aa-64fe-4517-88e2-b2e677baea24] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:31.650784 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-00317889-3834-4292-ad87-4fc303892831 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:31.651993 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-00317889-3834-4292-ad87-4fc303892831 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:31.653018 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-00317889-3834-4292-ad87-4fc303892831 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:31.654110 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-00317889-3834-4292-ad87-4fc303892831 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:31.654782 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-00317889-3834-4292-ad87-4fc303892831 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:31.655893 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-00317889-3834-4292-ad87-4fc303892831 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:31.847751 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-ca7df38a-f7c0-4bdc-81f6-325decc5cfdf tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30abbf3afe304291981a6a9b85952aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c28ddbdb164f01bb82235c6d49717b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:31.875885 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ca7df38a-f7c0-4bdc-81f6-325decc5cfdf tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] 10.222.0.70 "GET /compute/v2.1/servers/3ee4d4db-a1bb-4567-a20d-29003e67a295" status: 200 len: 1463 microversion: 2.1 time: 0.903597 Aug 27 02:41:31.877556 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 275/569] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:30 2022] GET /compute/v2.1/servers/3ee4d4db-a1bb-4567-a20d-29003e67a295 => generated 1463 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:31.888427 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-cef73eee-963f-44fd-b36d-b09db21fb3f7 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:31.889071 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-cef73eee-963f-44fd-b36d-b09db21fb3f7 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] [instance: 2e8baa0f-02cd-43f0-8919-e9bfbe6f1d01] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:31.916039 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cef73eee-963f-44fd-b36d-b09db21fb3f7 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:31.929829 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cef73eee-963f-44fd-b36d-b09db21fb3f7 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:31.931606 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cef73eee-963f-44fd-b36d-b09db21fb3f7 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:31.933958 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cef73eee-963f-44fd-b36d-b09db21fb3f7 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:31.936123 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cef73eee-963f-44fd-b36d-b09db21fb3f7 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:31.936933 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cef73eee-963f-44fd-b36d-b09db21fb3f7 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:32.191716 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-00317889-3834-4292-ad87-4fc303892831 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c850104e6d430397bb54d0e3730a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72992d9dba564526b223533398a94dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:32.208579 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-00317889-3834-4292-ad87-4fc303892831 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] 10.222.0.70 "GET /compute/v2.1/servers/7c1f28aa-64fe-4517-88e2-b2e677baea24" status: 200 len: 1333 microversion: 2.1 time: 0.563795 Aug 27 02:41:32.209248 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 295/570] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:31 2022] GET /compute/v2.1/servers/7c1f28aa-64fe-4517-88e2-b2e677baea24 => generated 1333 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:32.214102 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c8b59f12-2233-42ce-8405-ec5ed0dba2a1 tempest-QuotasAdminTestV257-1893778565 tempest-QuotasAdminTestV257-1893778565-project-admin] Calling method '.version_select at 0x7f5ee3490dc0>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:32.357251 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:41:32.713262 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c8b59f12-2233-42ce-8405-ec5ed0dba2a1 tempest-QuotasAdminTestV257-1893778565 tempest-QuotasAdminTestV257-1893778565-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:32.713820 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c8b59f12-2233-42ce-8405-ec5ed0dba2a1 tempest-QuotasAdminTestV257-1893778565 tempest-QuotasAdminTestV257-1893778565-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:32.714153 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c8b59f12-2233-42ce-8405-ec5ed0dba2a1 tempest-QuotasAdminTestV257-1893778565 tempest-QuotasAdminTestV257-1893778565-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:32.714874 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c8b59f12-2233-42ce-8405-ec5ed0dba2a1 tempest-QuotasAdminTestV257-1893778565 tempest-QuotasAdminTestV257-1893778565-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:32.715313 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c8b59f12-2233-42ce-8405-ec5ed0dba2a1 tempest-QuotasAdminTestV257-1893778565 tempest-QuotasAdminTestV257-1893778565-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:32.715725 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c8b59f12-2233-42ce-8405-ec5ed0dba2a1 tempest-QuotasAdminTestV257-1893778565 tempest-QuotasAdminTestV257-1893778565-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:32.751149 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=8,nova_api:UPDATE=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:41:32.778155 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c8b59f12-2233-42ce-8405-ec5ed0dba2a1 tempest-QuotasAdminTestV257-1893778565 tempest-QuotasAdminTestV257-1893778565-project-admin] 10.222.0.70 "GET /compute/v2.1/os-quota-sets/96e2d490f9ca4b53ad9da659c240ae8a/detail" status: 200 len: 463 microversion: 2.57 time: 0.567551 Aug 27 02:41:32.785686 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-cef73eee-963f-44fd-b36d-b09db21fb3f7 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2ff9f8745c4dda8b04fbeb95d9988a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a009f79d954838abb0566d86b97f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:32.789516 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 296/571] 10.222.0.70 () {60 vars in 1304 bytes} [Sat Aug 27 02:41:32 2022] GET /compute/v2.1/os-quota-sets/96e2d490f9ca4b53ad9da659c240ae8a/detail => generated 463 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:41:32.799366 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-cef73eee-963f-44fd-b36d-b09db21fb3f7 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] 10.222.0.70 "GET /compute/v2.1/servers/2e8baa0f-02cd-43f0-8919-e9bfbe6f1d01" status: 200 len: 1313 microversion: 2.1 time: 0.920154 Aug 27 02:41:32.800009 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 276/572] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:31 2022] GET /compute/v2.1/servers/2e8baa0f-02cd-43f0-8919-e9bfbe6f1d01 => generated 1313 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:32.820144 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-dbac7bc3-9127-4918-918a-2f181f8ab594 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:32.821080 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-dbac7bc3-9127-4918-918a-2f181f8ab594 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 29b88730-7871-4923-832e-a02d67f0314b] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:32.831681 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4c21e0f7-1548-4a86-8022-40347aefec76 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-583130407", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "3ee4d4db-a1bb-4567-a20d-29003e67a295"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:41:32.853114 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dbac7bc3-9127-4918-918a-2f181f8ab594 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:32.860257 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dbac7bc3-9127-4918-918a-2f181f8ab594 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:32.869125 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dbac7bc3-9127-4918-918a-2f181f8ab594 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:32.870022 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dbac7bc3-9127-4918-918a-2f181f8ab594 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:32.870551 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dbac7bc3-9127-4918-918a-2f181f8ab594 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:32.871009 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dbac7bc3-9127-4918-918a-2f181f8ab594 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:32.959688 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.network.neutron [None req-4c21e0f7-1548-4a86-8022-40347aefec76 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] validate_networks() for None {{(pid=134051) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:41:33.653818 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-dbac7bc3-9127-4918-918a-2f181f8ab594 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:33.670802 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-dbac7bc3-9127-4918-918a-2f181f8ab594 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/29b88730-7871-4923-832e-a02d67f0314b" status: 200 len: 1503 microversion: 2.1 time: 0.879948 Aug 27 02:41:33.673500 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 297/573] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:32 2022] GET /compute/v2.1/servers/29b88730-7871-4923-832e-a02d67f0314b => generated 1503 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:33.688748 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-e6b34145-e3ae-49ab-95ab-c1598748046a req-8c2075c4-de64-410d-b6d5-e81043b4ee5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29b88730-7871-4923-832e-a02d67f0314b", "tag": "9106e9cc-88c9-45f9-89cd-bb38806e1943"}, {"server_uuid": "f5d6ba67-b815-4ec1-9d75-ee5436f5e3c7", "name": "network-vif-deleted", "tag": "0684103c-d1c3-4cad-be37-7a7306355319"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:41:33.719402 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-e6b34145-e3ae-49ab-95ab-c1598748046a req-8c2075c4-de64-410d-b6d5-e81043b4ee5f service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:33.721748 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-e6b34145-e3ae-49ab-95ab-c1598748046a req-8c2075c4-de64-410d-b6d5-e81043b4ee5f service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:33.723686 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-e6b34145-e3ae-49ab-95ab-c1598748046a req-8c2075c4-de64-410d-b6d5-e81043b4ee5f service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:33.749957 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-e6b34145-e3ae-49ab-95ab-c1598748046a req-8c2075c4-de64-410d-b6d5-e81043b4ee5f service nova] Creating event network-changed:9106e9cc-88c9-45f9-89cd-bb38806e1943 for instance 29b88730-7871-4923-832e-a02d67f0314b on n-h2-852278-4 Aug 27 02:41:33.751492 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-e6b34145-e3ae-49ab-95ab-c1598748046a req-8c2075c4-de64-410d-b6d5-e81043b4ee5f service nova] Creating event network-vif-deleted:0684103c-d1c3-4cad-be37-7a7306355319 for instance f5d6ba67-b815-4ec1-9d75-ee5436f5e3c7 on n-h1-852278-4 Aug 27 02:41:33.789869 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-e6b34145-e3ae-49ab-95ab-c1598748046a req-8c2075c4-de64-410d-b6d5-e81043b4ee5f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.104742 Aug 27 02:41:33.789869 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 298/574] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:41:33 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:41:33.789869 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-7493b4fa-2399-4ee0-9b32-c441bd031ec1 req-7ed3ce2c-d61e-48b7-b0bc-a136693b0197 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e8baa0f-02cd-43f0-8919-e9bfbe6f1d01", "tag": "852fadc7-febc-45c6-bd61-2ec79939f173"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:41:33.799575 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-7493b4fa-2399-4ee0-9b32-c441bd031ec1 req-7ed3ce2c-d61e-48b7-b0bc-a136693b0197 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:33.800068 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-7493b4fa-2399-4ee0-9b32-c441bd031ec1 req-7ed3ce2c-d61e-48b7-b0bc-a136693b0197 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:33.800538 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-7493b4fa-2399-4ee0-9b32-c441bd031ec1 req-7ed3ce2c-d61e-48b7-b0bc-a136693b0197 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:33.815811 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-7493b4fa-2399-4ee0-9b32-c441bd031ec1 req-7ed3ce2c-d61e-48b7-b0bc-a136693b0197 service nova] Creating event network-changed:852fadc7-febc-45c6-bd61-2ec79939f173 for instance 2e8baa0f-02cd-43f0-8919-e9bfbe6f1d01 on n-h1-852278-4 Aug 27 02:41:33.822335 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-7493b4fa-2399-4ee0-9b32-c441bd031ec1 req-7ed3ce2c-d61e-48b7-b0bc-a136693b0197 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037933 Aug 27 02:41:33.823317 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 299/575] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:41:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:41:33.830354 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-abe34f3c-9f5b-4e8d-9739-01579e06da53 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:33.831584 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-abe34f3c-9f5b-4e8d-9739-01579e06da53 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] [instance: 7c1f28aa-64fe-4517-88e2-b2e677baea24] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:33.841132 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-abe34f3c-9f5b-4e8d-9739-01579e06da53 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:33.842455 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-abe34f3c-9f5b-4e8d-9739-01579e06da53 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:33.844101 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-abe34f3c-9f5b-4e8d-9739-01579e06da53 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:33.845028 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-abe34f3c-9f5b-4e8d-9739-01579e06da53 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:33.845615 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-abe34f3c-9f5b-4e8d-9739-01579e06da53 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:33.846814 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-abe34f3c-9f5b-4e8d-9739-01579e06da53 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:34.014135 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-abe34f3c-9f5b-4e8d-9739-01579e06da53 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c850104e6d430397bb54d0e3730a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72992d9dba564526b223533398a94dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:34.024812 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-abe34f3c-9f5b-4e8d-9739-01579e06da53 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] 10.222.0.70 "GET /compute/v2.1/servers/7c1f28aa-64fe-4517-88e2-b2e677baea24" status: 200 len: 1321 microversion: 2.1 time: 0.199728 Aug 27 02:41:34.025402 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 300/576] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:33 2022] GET /compute/v2.1/servers/7c1f28aa-64fe-4517-88e2-b2e677baea24 => generated 1321 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:34.031922 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b2f5dc51-480e-4f3c-80da-6b4f3086bf0c tempest-QuotasAdminTestV257-1893778565 tempest-QuotasAdminTestV257-1893778565-project-admin] Action: 'update', calling method: .version_select at 0x7f5ee33f85e0>, body: {"quota_set": {"ram": "2048"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:41:34.046689 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-4c21e0f7-1548-4a86-8022-40347aefec76 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Flavor limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:41:34.047204 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-4c21e0f7-1548-4a86-8022-40347aefec76 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Image limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:41:34.047565 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-4c21e0f7-1548-4a86-8022-40347aefec76 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Flavor pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:41:34.047958 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-4c21e0f7-1548-4a86-8022-40347aefec76 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Image pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:41:34.048409 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-4c21e0f7-1548-4a86-8022-40347aefec76 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:41:34.069864 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4c21e0f7-1548-4a86-8022-40347aefec76 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:34.070361 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4c21e0f7-1548-4a86-8022-40347aefec76 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:34.070790 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4c21e0f7-1548-4a86-8022-40347aefec76 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:34.071520 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4c21e0f7-1548-4a86-8022-40347aefec76 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:34.072057 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4c21e0f7-1548-4a86-8022-40347aefec76 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:34.072556 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4c21e0f7-1548-4a86-8022-40347aefec76 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:34.110128 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-4c21e0f7-1548-4a86-8022-40347aefec76 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Getting quotas for project e4c28ddbdb164f01bb82235c6d49717b. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:41:34.119006 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-4c21e0f7-1548-4a86-8022-40347aefec76 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Getting quotas for user 30abbf3afe304291981a6a9b85952aa3 and project e4c28ddbdb164f01bb82235c6d49717b. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:41:34.152335 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-4c21e0f7-1548-4a86-8022-40347aefec76 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Going to run 1 instances... {{(pid=134051) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:41:34.154944 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-4c21e0f7-1548-4a86-8022-40347aefec76 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] [instance: ccf87867-fb85-4b52-93f4-283450f636a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134051) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:41:34.223240 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-4c21e0f7-1548-4a86-8022-40347aefec76 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.408932 Aug 27 02:41:34.224072 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 277/577] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 02:41:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1423 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:41:34.229092 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c3cd1383-10c7-43c2-bf71-ef57d3d4bfc2 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:34.229970 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-c3cd1383-10c7-43c2-bf71-ef57d3d4bfc2 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] [instance: 2e8baa0f-02cd-43f0-8919-e9bfbe6f1d01] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:34.236399 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c3cd1383-10c7-43c2-bf71-ef57d3d4bfc2 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:34.237265 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c3cd1383-10c7-43c2-bf71-ef57d3d4bfc2 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:34.237876 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c3cd1383-10c7-43c2-bf71-ef57d3d4bfc2 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:34.238697 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c3cd1383-10c7-43c2-bf71-ef57d3d4bfc2 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:34.239241 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c3cd1383-10c7-43c2-bf71-ef57d3d4bfc2 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:34.239877 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c3cd1383-10c7-43c2-bf71-ef57d3d4bfc2 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:34.488332 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b2f5dc51-480e-4f3c-80da-6b4f3086bf0c tempest-QuotasAdminTestV257-1893778565 tempest-QuotasAdminTestV257-1893778565-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:34.488934 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b2f5dc51-480e-4f3c-80da-6b4f3086bf0c tempest-QuotasAdminTestV257-1893778565 tempest-QuotasAdminTestV257-1893778565-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:34.489458 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b2f5dc51-480e-4f3c-80da-6b4f3086bf0c tempest-QuotasAdminTestV257-1893778565 tempest-QuotasAdminTestV257-1893778565-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:34.495493 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b2f5dc51-480e-4f3c-80da-6b4f3086bf0c tempest-QuotasAdminTestV257-1893778565 tempest-QuotasAdminTestV257-1893778565-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:34.496208 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b2f5dc51-480e-4f3c-80da-6b4f3086bf0c tempest-QuotasAdminTestV257-1893778565 tempest-QuotasAdminTestV257-1893778565-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:34.496739 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b2f5dc51-480e-4f3c-80da-6b4f3086bf0c tempest-QuotasAdminTestV257-1893778565 tempest-QuotasAdminTestV257-1893778565-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:34.531740 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=93,nova_cell0:UPDATE=7 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:41:34.541082 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b2f5dc51-480e-4f3c-80da-6b4f3086bf0c tempest-QuotasAdminTestV257-1893778565 tempest-QuotasAdminTestV257-1893778565-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:34.541647 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b2f5dc51-480e-4f3c-80da-6b4f3086bf0c tempest-QuotasAdminTestV257-1893778565 tempest-QuotasAdminTestV257-1893778565-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:34.542076 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b2f5dc51-480e-4f3c-80da-6b4f3086bf0c tempest-QuotasAdminTestV257-1893778565 tempest-QuotasAdminTestV257-1893778565-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:34.542916 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b2f5dc51-480e-4f3c-80da-6b4f3086bf0c tempest-QuotasAdminTestV257-1893778565 tempest-QuotasAdminTestV257-1893778565-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:34.543422 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b2f5dc51-480e-4f3c-80da-6b4f3086bf0c tempest-QuotasAdminTestV257-1893778565 tempest-QuotasAdminTestV257-1893778565-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:34.543917 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b2f5dc51-480e-4f3c-80da-6b4f3086bf0c tempest-QuotasAdminTestV257-1893778565 tempest-QuotasAdminTestV257-1893778565-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:34.618960 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b2f5dc51-480e-4f3c-80da-6b4f3086bf0c tempest-QuotasAdminTestV257-1893778565 tempest-QuotasAdminTestV257-1893778565-project-admin] 10.222.0.70 "PUT /compute/v2.1/os-quota-sets/96e2d490f9ca4b53ad9da659c240ae8a?user_id=6e9ca160f1f641ad9e3d852d7085826c" status: 200 len: 148 microversion: 2.57 time: 0.591418 Aug 27 02:41:34.619143 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-c3cd1383-10c7-43c2-bf71-ef57d3d4bfc2 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2ff9f8745c4dda8b04fbeb95d9988a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a009f79d954838abb0566d86b97f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:34.620416 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 301/578] 10.222.0.70 () {62 vars in 1384 bytes} [Sat Aug 27 02:41:34 2022] PUT /compute/v2.1/os-quota-sets/96e2d490f9ca4b53ad9da659c240ae8a?user_id=6e9ca160f1f641ad9e3d852d7085826c => generated 148 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:41:34.633627 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c3cd1383-10c7-43c2-bf71-ef57d3d4bfc2 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] 10.222.0.70 "GET /compute/v2.1/servers/2e8baa0f-02cd-43f0-8919-e9bfbe6f1d01" status: 200 len: 1313 microversion: 2.1 time: 0.405303 Aug 27 02:41:34.644992 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 278/579] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:34 2022] GET /compute/v2.1/servers/2e8baa0f-02cd-43f0-8919-e9bfbe6f1d01 => generated 1313 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:34.651423 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f93b2697-602d-488c-9280-21138dfc6d60 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-717922083", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "networks": [{"uuid": "b0edff77-134a-4e34-8600-26bed9e15888"}], "security_groups": [{"name": "tempest-securitygroup--1223844036"}], "key_name": "tempest-keypair-294981480", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:41:34.921037 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-00ea132a-bccb-4628-8c6b-14a49969c5b1 tempest-HypervisorAdminNegativeUnderV252Test-1099824327 tempest-HypervisorAdminNegativeUnderV252Test-1099824327-project-admin] Calling method '.version_select at 0x7f5ee3401d30>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:34.922704 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-00ea132a-bccb-4628-8c6b-14a49969c5b1 tempest-HypervisorAdminNegativeUnderV252Test-1099824327 tempest-HypervisorAdminNegativeUnderV252Test-1099824327-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:34.923630 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-00ea132a-bccb-4628-8c6b-14a49969c5b1 tempest-HypervisorAdminNegativeUnderV252Test-1099824327 tempest-HypervisorAdminNegativeUnderV252Test-1099824327-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:34.924412 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-00ea132a-bccb-4628-8c6b-14a49969c5b1 tempest-HypervisorAdminNegativeUnderV252Test-1099824327 tempest-HypervisorAdminNegativeUnderV252Test-1099824327-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:34.948725 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-00ea132a-bccb-4628-8c6b-14a49969c5b1 tempest-HypervisorAdminNegativeUnderV252Test-1099824327 tempest-HypervisorAdminNegativeUnderV252Test-1099824327-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:34.949458 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-00ea132a-bccb-4628-8c6b-14a49969c5b1 tempest-HypervisorAdminNegativeUnderV252Test-1099824327 tempest-HypervisorAdminNegativeUnderV252Test-1099824327-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:34.950036 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-00ea132a-bccb-4628-8c6b-14a49969c5b1 tempest-HypervisorAdminNegativeUnderV252Test-1099824327 tempest-HypervisorAdminNegativeUnderV252Test-1099824327-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:34.951724 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.network.neutron [None req-f93b2697-602d-488c-9280-21138dfc6d60 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] validate_networks() for [('b0edff77-134a-4e34-8600-26bed9e15888', None, None, None, None, None)] {{(pid=134051) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:41:34.963764 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-00ea132a-bccb-4628-8c6b-14a49969c5b1 tempest-HypervisorAdminNegativeUnderV252Test-1099824327 tempest-HypervisorAdminNegativeUnderV252Test-1099824327-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:34.964577 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-00ea132a-bccb-4628-8c6b-14a49969c5b1 tempest-HypervisorAdminNegativeUnderV252Test-1099824327 tempest-HypervisorAdminNegativeUnderV252Test-1099824327-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:34.965222 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-00ea132a-bccb-4628-8c6b-14a49969c5b1 tempest-HypervisorAdminNegativeUnderV252Test-1099824327 tempest-HypervisorAdminNegativeUnderV252Test-1099824327-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:34.974857 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-00ea132a-bccb-4628-8c6b-14a49969c5b1 tempest-HypervisorAdminNegativeUnderV252Test-1099824327 tempest-HypervisorAdminNegativeUnderV252Test-1099824327-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.352881 Aug 27 02:41:34.976002 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 302/580] 10.222.0.70 () {58 vars in 1146 bytes} [Sat Aug 27 02:41:34 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:41:34.981009 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-7a6ebca1-47c0-4196-a9ca-84ebbc0e204d tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:34.981868 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-7a6ebca1-47c0-4196-a9ca-84ebbc0e204d tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] [instance: ccf87867-fb85-4b52-93f4-283450f636a4] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:34.988982 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7a6ebca1-47c0-4196-a9ca-84ebbc0e204d tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:34.989733 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7a6ebca1-47c0-4196-a9ca-84ebbc0e204d tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:34.990342 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7a6ebca1-47c0-4196-a9ca-84ebbc0e204d tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:34.991247 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7a6ebca1-47c0-4196-a9ca-84ebbc0e204d tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:34.992063 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7a6ebca1-47c0-4196-a9ca-84ebbc0e204d tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:34.992825 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7a6ebca1-47c0-4196-a9ca-84ebbc0e204d tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:35.136792 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-7a6ebca1-47c0-4196-a9ca-84ebbc0e204d tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30abbf3afe304291981a6a9b85952aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c28ddbdb164f01bb82235c6d49717b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:35.162896 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-7a6ebca1-47c0-4196-a9ca-84ebbc0e204d tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] 10.222.0.70 "GET /compute/v2.1/servers/ccf87867-fb85-4b52-93f4-283450f636a4" status: 200 len: 1217 microversion: 2.1 time: 0.184746 Aug 27 02:41:35.164833 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 303/581] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:34 2022] GET /compute/v2.1/servers/ccf87867-fb85-4b52-93f4-283450f636a4 => generated 1217 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:35.171161 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ed068e1c-b638-4105-baec-41414b49c329 tempest-QuotasAdminTestV257-1893778565 tempest-QuotasAdminTestV257-1893778565-project-admin] Calling method '.version_select at 0x7f5ee345fa60>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:35.449479 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ed068e1c-b638-4105-baec-41414b49c329 tempest-QuotasAdminTestV257-1893778565 tempest-QuotasAdminTestV257-1893778565-project-admin] 10.222.0.70 "GET /compute/v2.1/os-quota-sets/96e2d490f9ca4b53ad9da659c240ae8a?user_id=6e9ca160f1f641ad9e3d852d7085826c" status: 200 len: 190 microversion: 2.57 time: 0.283046 Aug 27 02:41:35.450391 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 304/582] 10.222.0.70 () {60 vars in 1364 bytes} [Sat Aug 27 02:41:35 2022] GET /compute/v2.1/os-quota-sets/96e2d490f9ca4b53ad9da659c240ae8a?user_id=6e9ca160f1f641ad9e3d852d7085826c => generated 190 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:41:35.464972 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a65e6a78-6fea-4065-99a6-bcb6138fc2f1 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:35.470039 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a65e6a78-6fea-4065-99a6-bcb6138fc2f1 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 29b88730-7871-4923-832e-a02d67f0314b] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:35.479567 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a65e6a78-6fea-4065-99a6-bcb6138fc2f1 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:35.480061 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a65e6a78-6fea-4065-99a6-bcb6138fc2f1 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:35.480526 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a65e6a78-6fea-4065-99a6-bcb6138fc2f1 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:35.481535 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a65e6a78-6fea-4065-99a6-bcb6138fc2f1 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:35.482303 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a65e6a78-6fea-4065-99a6-bcb6138fc2f1 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:35.482972 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a65e6a78-6fea-4065-99a6-bcb6138fc2f1 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:35.508039 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:41:35.981045 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-a65e6a78-6fea-4065-99a6-bcb6138fc2f1 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:35.998804 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a65e6a78-6fea-4065-99a6-bcb6138fc2f1 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/29b88730-7871-4923-832e-a02d67f0314b" status: 200 len: 1503 microversion: 2.1 time: 0.547324 Aug 27 02:41:36.014349 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 305/583] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:35 2022] GET /compute/v2.1/servers/29b88730-7871-4923-832e-a02d67f0314b => generated 1503 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:36.277936 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ce39dade-b5cf-4282-bacf-5903925d42c1 tempest-HypervisorAdminNegativeUnderV252Test-1251566595 tempest-HypervisorAdminNegativeUnderV252Test-1251566595-project] Calling method '.version_select at 0x7f5ee3589ee0>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:36.279851 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-ce39dade-b5cf-4282-bacf-5903925d42c1 tempest-HypervisorAdminNegativeUnderV252Test-1251566595 tempest-HypervisorAdminNegativeUnderV252Test-1251566595-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '3a7723cbd2cb4143922339a5b4e75ad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2647706c496f47ef8ffe50f9e69c5ffe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:36.281874 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ce39dade-b5cf-4282-bacf-5903925d42c1 tempest-HypervisorAdminNegativeUnderV252Test-1251566595 tempest-HypervisorAdminNegativeUnderV252Test-1251566595-project] Request method failure captured: Aug 27 02:41:36.281874 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/os-hypervisors/n-h2-852278-4/search HTTP/1.1 Aug 27 02:41:36.281874 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:41:36.281874 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:41:36.281874 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:41:36.281874 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:41:36.281874 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:41:36.281874 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:41:36.281874 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:41:36.281874 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:41:36.281874 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYRcCEg_vKeVNxQOAKmN3RMFX77oBF5Ifpm2aqg5kgN0_y_dKqEl9uB5NEMwU7rmtZFA9L-yAUdbuyiW10twwzCLXejh3tgl6hEao2_U8vG7aCw3Yp4RFtwAqbk-yBr8_rSjRZT4IRcyH-7v4CNAGcESCLN39IyvUSZTA65aqeRG5mA Aug 27 02:41:36.281874 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:41:36.281874 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:41:36.281874 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:41:36.281874 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:41:36.281874 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:41:36.281874 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:41:36.281874 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 2647706c496f47ef8ffe50f9e69c5ffe Aug 27 02:41:36.281874 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1251566595 Aug 27 02:41:36.281874 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:41:36.281874 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:41:36.283297 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2647706c496f47ef8ffe50f9e69c5ffe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_2647706c496f47ef8ffe50f9e69c5ffe", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2647706c496f47ef8ffe50f9e69c5ffe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/2647706c496f47ef8ffe50f9e69c5ffe"}]}] Aug 27 02:41:36.283297 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1251566595 Aug 27 02:41:36.283297 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 2647706c496f47ef8ffe50f9e69c5ffe Aug 27 02:41:36.283297 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1251566595 Aug 27 02:41:36.283297 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1251566595-project Aug 27 02:41:36.283297 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:41:36.283297 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:41:36.283297 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 3a7723cbd2cb4143922339a5b4e75ad3 Aug 27 02:41:36.283297 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1251566595-project Aug 27 02:41:36.283297 n-d-852278-4 devstack@n-api.service[134052]: method: Aug 27 02:41:36.283297 n-d-852278-4 devstack@n-api.service[134052]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 27 02:41:36.283297 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': 'n-h2-852278-4'} Aug 27 02:41:36.284015 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:41:36.284015 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:41:36.284015 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:41:36.284015 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:41:36.284015 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:41:36.284015 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:41:36.284015 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:41:36.284015 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:41:36.284015 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:41:36.284015 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:41:36.284015 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Aug 27 02:41:36.284015 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Aug 27 02:41:36.284015 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 02:41:36.284015 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 02:41:36.284015 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 02:41:36.284015 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 02:41:36.284015 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 02:41:36.284015 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 02:41:36.284015 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 02:41:36.285128 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 02:41:36.285128 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 02:41:36.285128 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 02:41:36.285128 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 02:41:36.285128 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 02:41:36.285128 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 02:41:36.285128 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 02:41:36.285128 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 27 02:41:36.285128 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:41:36.285128 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:41:36.285128 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:41:36.285128 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:41:36.285128 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:41:36.285128 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:41:36.285128 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 02:41:36.285128 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 02:41:36.285128 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 27 02:41:36.285128 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:41:36.289223 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ce39dade-b5cf-4282-bacf-5903925d42c1 tempest-HypervisorAdminNegativeUnderV252Test-1251566595 tempest-HypervisorAdminNegativeUnderV252Test-1251566595-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:41:36.292729 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ce39dade-b5cf-4282-bacf-5903925d42c1 tempest-HypervisorAdminNegativeUnderV252Test-1251566595 tempest-HypervisorAdminNegativeUnderV252Test-1251566595-project] 10.222.0.70 "GET /compute/v2.1/os-hypervisors/n-h2-852278-4/search" status: 403 len: 117 microversion: 2.1 time: 0.276100 Aug 27 02:41:36.295508 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 306/584] 10.222.0.70 () {58 vars in 1209 bytes} [Sat Aug 27 02:41:36 2022] GET /compute/v2.1/os-hypervisors/n-h2-852278-4/search => generated 117 bytes in 281 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:41:36.303306 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4bbea857-9727-4561-8de1-2a04567b11be tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:36.305126 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-4bbea857-9727-4561-8de1-2a04567b11be tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] [instance: 7c1f28aa-64fe-4517-88e2-b2e677baea24] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:36.314775 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4bbea857-9727-4561-8de1-2a04567b11be tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:36.315548 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4bbea857-9727-4561-8de1-2a04567b11be tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:36.316166 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4bbea857-9727-4561-8de1-2a04567b11be tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:36.317604 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4bbea857-9727-4561-8de1-2a04567b11be tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:36.318239 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4bbea857-9727-4561-8de1-2a04567b11be tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:36.318838 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4bbea857-9727-4561-8de1-2a04567b11be tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:36.528459 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-f93b2697-602d-488c-9280-21138dfc6d60 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Flavor limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:41:36.530044 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-f93b2697-602d-488c-9280-21138dfc6d60 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Image limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:41:36.530734 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-f93b2697-602d-488c-9280-21138dfc6d60 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Flavor pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:41:36.531562 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-f93b2697-602d-488c-9280-21138dfc6d60 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Image pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:41:36.533005 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-f93b2697-602d-488c-9280-21138dfc6d60 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:41:36.551687 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f93b2697-602d-488c-9280-21138dfc6d60 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:36.552448 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f93b2697-602d-488c-9280-21138dfc6d60 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:36.553468 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f93b2697-602d-488c-9280-21138dfc6d60 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:36.554768 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f93b2697-602d-488c-9280-21138dfc6d60 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:36.555423 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f93b2697-602d-488c-9280-21138dfc6d60 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:36.556015 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f93b2697-602d-488c-9280-21138dfc6d60 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:36.584406 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-f93b2697-602d-488c-9280-21138dfc6d60 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Getting quotas for project e78b498dced14d1d822e7d0c27f57215. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:41:36.591204 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-f93b2697-602d-488c-9280-21138dfc6d60 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Getting quotas for user 774ce37f4c6b4f72ad494ea40a3e238d and project e78b498dced14d1d822e7d0c27f57215. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:41:36.608504 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-f93b2697-602d-488c-9280-21138dfc6d60 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Going to run 1 instances... {{(pid=134051) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:41:36.611069 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-f93b2697-602d-488c-9280-21138dfc6d60 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: 7eded9ca-c7bc-499a-bb53-a28d2c332402] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134051) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:41:36.668004 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-f93b2697-602d-488c-9280-21138dfc6d60 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.25 time: 2.021753 Aug 27 02:41:36.668920 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 279/585] 10.222.0.70 () {62 vars in 1188 bytes} [Sat Aug 27 02:41:34 2022] POST /compute/v2.1/servers => generated 406 bytes in 2023 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 27 02:41:36.680059 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ecb89fc2-6202-4817-81a8-b68b53658c4d tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:36.680924 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-ecb89fc2-6202-4817-81a8-b68b53658c4d tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] [instance: 2e8baa0f-02cd-43f0-8919-e9bfbe6f1d01] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:36.687329 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ecb89fc2-6202-4817-81a8-b68b53658c4d tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:36.688033 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ecb89fc2-6202-4817-81a8-b68b53658c4d tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:36.688638 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ecb89fc2-6202-4817-81a8-b68b53658c4d tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:36.689508 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ecb89fc2-6202-4817-81a8-b68b53658c4d tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:36.690092 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ecb89fc2-6202-4817-81a8-b68b53658c4d tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:36.690650 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ecb89fc2-6202-4817-81a8-b68b53658c4d tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:36.886520 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-4bbea857-9727-4561-8de1-2a04567b11be tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c850104e6d430397bb54d0e3730a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72992d9dba564526b223533398a94dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:36.897120 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-4bbea857-9727-4561-8de1-2a04567b11be tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] 10.222.0.70 "GET /compute/v2.1/servers/7c1f28aa-64fe-4517-88e2-b2e677baea24" status: 200 len: 1388 microversion: 2.1 time: 0.599926 Aug 27 02:41:36.910770 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 307/586] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:36 2022] GET /compute/v2.1/servers/7c1f28aa-64fe-4517-88e2-b2e677baea24 => generated 1388 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:37.173238 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-fc8e80ef-eb28-4f7d-910a-ee005e10505e tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-711128654", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:41:37.246269 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.network.neutron [None req-fc8e80ef-eb28-4f7d-910a-ee005e10505e tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] validate_networks() for None {{(pid=134052) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:41:37.493020 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-ecb89fc2-6202-4817-81a8-b68b53658c4d tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2ff9f8745c4dda8b04fbeb95d9988a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a009f79d954838abb0566d86b97f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:37.505185 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ecb89fc2-6202-4817-81a8-b68b53658c4d tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] 10.222.0.70 "GET /compute/v2.1/servers/2e8baa0f-02cd-43f0-8919-e9bfbe6f1d01" status: 200 len: 1313 microversion: 2.1 time: 0.829199 Aug 27 02:41:37.506179 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 280/587] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:36 2022] GET /compute/v2.1/servers/2e8baa0f-02cd-43f0-8919-e9bfbe6f1d01 => generated 1313 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:37.511195 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-1b786ed9-6614-41d3-a031-41580232e7b6 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:37.511978 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-1b786ed9-6614-41d3-a031-41580232e7b6 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] [instance: ccf87867-fb85-4b52-93f4-283450f636a4] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:37.521777 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1b786ed9-6614-41d3-a031-41580232e7b6 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:37.522468 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1b786ed9-6614-41d3-a031-41580232e7b6 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:37.522996 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1b786ed9-6614-41d3-a031-41580232e7b6 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:37.523651 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1b786ed9-6614-41d3-a031-41580232e7b6 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:37.524148 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1b786ed9-6614-41d3-a031-41580232e7b6 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:37.524701 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1b786ed9-6614-41d3-a031-41580232e7b6 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:37.691145 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-1b786ed9-6614-41d3-a031-41580232e7b6 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30abbf3afe304291981a6a9b85952aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c28ddbdb164f01bb82235c6d49717b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:37.699689 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-1b786ed9-6614-41d3-a031-41580232e7b6 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] 10.222.0.70 "GET /compute/v2.1/servers/ccf87867-fb85-4b52-93f4-283450f636a4" status: 200 len: 1271 microversion: 2.1 time: 0.192250 Aug 27 02:41:37.700651 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 281/588] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:37 2022] GET /compute/v2.1/servers/ccf87867-fb85-4b52-93f4-283450f636a4 => generated 1271 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:37.708097 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-eb25f897-4016-47b2-aca2-c672c33c51a1 tempest-HypervisorAdminNegativeUnderV252Test-1099824327 tempest-HypervisorAdminNegativeUnderV252Test-1099824327-project-admin] Calling method '.version_select at 0x7f5edf44e3a0>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:37.710883 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eb25f897-4016-47b2-aca2-c672c33c51a1 tempest-HypervisorAdminNegativeUnderV252Test-1099824327 tempest-HypervisorAdminNegativeUnderV252Test-1099824327-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:37.711625 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eb25f897-4016-47b2-aca2-c672c33c51a1 tempest-HypervisorAdminNegativeUnderV252Test-1099824327 tempest-HypervisorAdminNegativeUnderV252Test-1099824327-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:37.712448 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eb25f897-4016-47b2-aca2-c672c33c51a1 tempest-HypervisorAdminNegativeUnderV252Test-1099824327 tempest-HypervisorAdminNegativeUnderV252Test-1099824327-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:37.721339 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-eb25f897-4016-47b2-aca2-c672c33c51a1 tempest-HypervisorAdminNegativeUnderV252Test-1099824327 tempest-HypervisorAdminNegativeUnderV252Test-1099824327-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 27 02:41:37.722811 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-eb25f897-4016-47b2-aca2-c672c33c51a1 tempest-HypervisorAdminNegativeUnderV252Test-1099824327 tempest-HypervisorAdminNegativeUnderV252Test-1099824327-project-admin] Request method failure captured: Aug 27 02:41:37.722811 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Aug 27 02:41:37.722811 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:41:37.722811 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:41:37.722811 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:41:37.722811 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:41:37.722811 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:41:37.722811 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:41:37.722811 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:41:37.722811 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:41:37.722811 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYRdAhz-dG3lJw9mql5W5Nuy43ZrCHCJO7D8V7EUPP0hqQbsUL0helZySQfkbleGVRVlq1_TeZ-bvvVlZZRyEgB41kJuaeHO3VLgjgl4puHruT7TYPd_7gYcvzGkTiw7islMmMIHFsxAE3eWooGYqDgfU5ZzeGLCbPDAAWCIUKshIGQ Aug 27 02:41:37.722811 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:41:37.722811 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:41:37.722811 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:41:37.722811 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:41:37.722811 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:41:37.722811 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:41:37.722811 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: c022e01a8c6a48ffb7036afda19f1e49 Aug 27 02:41:37.722811 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1099824327 Aug 27 02:41:37.722811 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,admin,member Aug 27 02:41:37.722811 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,admin,member Aug 27 02:41:37.724477 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c022e01a8c6a48ffb7036afda19f1e49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c022e01a8c6a48ffb7036afda19f1e49", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c022e01a8c6a48ffb7036afda19f1e49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c022e01a8c6a48ffb7036afda19f1e49"}]}] Aug 27 02:41:37.724477 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1099824327 Aug 27 02:41:37.724477 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: c022e01a8c6a48ffb7036afda19f1e49 Aug 27 02:41:37.724477 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1099824327 Aug 27 02:41:37.724477 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1099824327-project-admin Aug 27 02:41:37.724477 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:41:37.724477 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:41:37.724477 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: c5a5c943f8774928b57a9b981c50c74d Aug 27 02:41:37.724477 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1099824327-project-admin Aug 27 02:41:37.724477 n-d-852278-4 devstack@n-api.service[134051]: method: Aug 27 02:41:37.724477 n-d-852278-4 devstack@n-api.service[134051]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 27 02:41:37.724477 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': 'nonexistent_hypervisor_name'} Aug 27 02:41:37.725315 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:41:37.725315 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:41:37.725315 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:41:37.725315 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:41:37.725315 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:41:37.725315 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:41:37.725315 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:41:37.725315 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:41:37.725315 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:41:37.725315 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:41:37.725315 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Aug 27 02:41:37.725315 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Aug 27 02:41:37.725315 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Aug 27 02:41:37.725315 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 27 02:41:37.725315 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 27 02:41:37.725315 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:41:37.725315 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:41:37.725315 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:41:37.725315 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:41:37.725315 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:41:37.726489 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:41:37.726489 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:41:37.726489 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:41:37.726489 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 27 02:41:37.726489 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:41:37.726489 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-eb25f897-4016-47b2-aca2-c672c33c51a1 tempest-HypervisorAdminNegativeUnderV252Test-1099824327 tempest-HypervisorAdminNegativeUnderV252Test-1099824327-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:41:37.726489 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-eb25f897-4016-47b2-aca2-c672c33c51a1 tempest-HypervisorAdminNegativeUnderV252Test-1099824327 tempest-HypervisorAdminNegativeUnderV252Test-1099824327-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.022249 Aug 27 02:41:37.726489 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 282/589] 10.222.0.70 () {58 vars in 1251 bytes} [Sat Aug 27 02:41:37 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:41:37.731628 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-df71a7e3-d3e3-401e-ba32-9dbcd1c5e525 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:37.732364 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-df71a7e3-d3e3-401e-ba32-9dbcd1c5e525 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: 7eded9ca-c7bc-499a-bb53-a28d2c332402] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:37.740913 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-df71a7e3-d3e3-401e-ba32-9dbcd1c5e525 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:37.741483 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-df71a7e3-d3e3-401e-ba32-9dbcd1c5e525 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:37.741996 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-df71a7e3-d3e3-401e-ba32-9dbcd1c5e525 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:37.742759 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-df71a7e3-d3e3-401e-ba32-9dbcd1c5e525 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:37.743269 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-df71a7e3-d3e3-401e-ba32-9dbcd1c5e525 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:37.743866 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-df71a7e3-d3e3-401e-ba32-9dbcd1c5e525 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:37.944629 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-df71a7e3-d3e3-401e-ba32-9dbcd1c5e525 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:37.966021 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-df71a7e3-d3e3-401e-ba32-9dbcd1c5e525 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:37.968074 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-df71a7e3-d3e3-401e-ba32-9dbcd1c5e525 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:37.970393 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-df71a7e3-d3e3-401e-ba32-9dbcd1c5e525 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/7eded9ca-c7bc-499a-bb53-a28d2c332402" status: 200 len: 1336 microversion: 2.25 time: 0.243290 Aug 27 02:41:37.972176 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 283/590] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:41:37 2022] GET /compute/v2.1/servers/7eded9ca-c7bc-499a-bb53-a28d2c332402 => generated 1336 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:41:37.978879 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7f9ed8e0-98b4-4796-8e0c-c23449cfe7f7 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:37.979919 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-7f9ed8e0-98b4-4796-8e0c-c23449cfe7f7 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 29b88730-7871-4923-832e-a02d67f0314b] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:37.997319 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7f9ed8e0-98b4-4796-8e0c-c23449cfe7f7 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:38.000721 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7f9ed8e0-98b4-4796-8e0c-c23449cfe7f7 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:38.001411 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7f9ed8e0-98b4-4796-8e0c-c23449cfe7f7 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:38.003533 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7f9ed8e0-98b4-4796-8e0c-c23449cfe7f7 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:38.006401 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7f9ed8e0-98b4-4796-8e0c-c23449cfe7f7 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:38.007171 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7f9ed8e0-98b4-4796-8e0c-c23449cfe7f7 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:38.070753 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:41:38.213270 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-fc8e80ef-eb28-4f7d-910a-ee005e10505e tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Flavor limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:41:38.213810 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-fc8e80ef-eb28-4f7d-910a-ee005e10505e tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Image limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:41:38.214761 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-fc8e80ef-eb28-4f7d-910a-ee005e10505e tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Flavor pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:41:38.215951 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-fc8e80ef-eb28-4f7d-910a-ee005e10505e tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Image pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:41:38.216525 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-fc8e80ef-eb28-4f7d-910a-ee005e10505e tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:41:38.241117 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fc8e80ef-eb28-4f7d-910a-ee005e10505e tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:38.241717 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fc8e80ef-eb28-4f7d-910a-ee005e10505e tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:38.242259 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fc8e80ef-eb28-4f7d-910a-ee005e10505e tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:38.243105 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fc8e80ef-eb28-4f7d-910a-ee005e10505e tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:38.244437 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fc8e80ef-eb28-4f7d-910a-ee005e10505e tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:38.245274 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fc8e80ef-eb28-4f7d-910a-ee005e10505e tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:38.299135 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-fc8e80ef-eb28-4f7d-910a-ee005e10505e tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Getting quotas for project 25afdc85b9aa4c86bd4f8e2e4a22ff3e. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:41:38.315780 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-fc8e80ef-eb28-4f7d-910a-ee005e10505e tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Getting quotas for user 7bb3ac70d5084c9c826b5722e5302ea4 and project 25afdc85b9aa4c86bd4f8e2e4a22ff3e. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:41:38.339027 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-fc8e80ef-eb28-4f7d-910a-ee005e10505e tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Going to run 1 instances... {{(pid=134052) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:41:38.341669 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-fc8e80ef-eb28-4f7d-910a-ee005e10505e tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] [instance: 50597771-779f-426a-9cdc-17a6f2fb01fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134052) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:41:38.393214 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-fc8e80ef-eb28-4f7d-910a-ee005e10505e tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.481095 Aug 27 02:41:38.393892 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 308/591] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 02:41:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1482 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:41:38.398511 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-40b3120e-7916-4ada-b54f-8222ed0edf4d tempest-HypervisorAdminNegativeUnderV252Test-1099824327 tempest-HypervisorAdminNegativeUnderV252Test-1099824327-project-admin] Calling method '.version_select at 0x7f5ee3410dc0>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:38.400740 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-40b3120e-7916-4ada-b54f-8222ed0edf4d tempest-HypervisorAdminNegativeUnderV252Test-1099824327 tempest-HypervisorAdminNegativeUnderV252Test-1099824327-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:38.401432 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-40b3120e-7916-4ada-b54f-8222ed0edf4d tempest-HypervisorAdminNegativeUnderV252Test-1099824327 tempest-HypervisorAdminNegativeUnderV252Test-1099824327-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:38.402039 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-40b3120e-7916-4ada-b54f-8222ed0edf4d tempest-HypervisorAdminNegativeUnderV252Test-1099824327 tempest-HypervisorAdminNegativeUnderV252Test-1099824327-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:38.432918 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-40b3120e-7916-4ada-b54f-8222ed0edf4d tempest-HypervisorAdminNegativeUnderV252Test-1099824327 tempest-HypervisorAdminNegativeUnderV252Test-1099824327-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:38.433409 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-40b3120e-7916-4ada-b54f-8222ed0edf4d tempest-HypervisorAdminNegativeUnderV252Test-1099824327 tempest-HypervisorAdminNegativeUnderV252Test-1099824327-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:38.433831 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-40b3120e-7916-4ada-b54f-8222ed0edf4d tempest-HypervisorAdminNegativeUnderV252Test-1099824327 tempest-HypervisorAdminNegativeUnderV252Test-1099824327-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:38.463480 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-40b3120e-7916-4ada-b54f-8222ed0edf4d tempest-HypervisorAdminNegativeUnderV252Test-1099824327 tempest-HypervisorAdminNegativeUnderV252Test-1099824327-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:38.464008 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-40b3120e-7916-4ada-b54f-8222ed0edf4d tempest-HypervisorAdminNegativeUnderV252Test-1099824327 tempest-HypervisorAdminNegativeUnderV252Test-1099824327-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:38.464433 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-40b3120e-7916-4ada-b54f-8222ed0edf4d tempest-HypervisorAdminNegativeUnderV252Test-1099824327 tempest-HypervisorAdminNegativeUnderV252Test-1099824327-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:38.484967 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-40b3120e-7916-4ada-b54f-8222ed0edf4d tempest-HypervisorAdminNegativeUnderV252Test-1099824327 tempest-HypervisorAdminNegativeUnderV252Test-1099824327-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.089975 Aug 27 02:41:38.485825 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 309/592] 10.222.0.70 () {58 vars in 1146 bytes} [Sat Aug 27 02:41:38 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:41:38.491036 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-b6e2523f-13de-4bab-a47b-46059f945bc5 req-8b87cb66-1d5e-4df7-a0c9-aac180765fc6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c1f28aa-64fe-4517-88e2-b2e677baea24", "tag": "fdce9d3d-6208-43e7-9296-22fd6029a735"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:41:38.503021 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-b6e2523f-13de-4bab-a47b-46059f945bc5 req-8b87cb66-1d5e-4df7-a0c9-aac180765fc6 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:38.517103 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-b6e2523f-13de-4bab-a47b-46059f945bc5 req-8b87cb66-1d5e-4df7-a0c9-aac180765fc6 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:38.518044 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-b6e2523f-13de-4bab-a47b-46059f945bc5 req-8b87cb66-1d5e-4df7-a0c9-aac180765fc6 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:38.531097 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-b6e2523f-13de-4bab-a47b-46059f945bc5 req-8b87cb66-1d5e-4df7-a0c9-aac180765fc6 service nova] Creating event network-changed:fdce9d3d-6208-43e7-9296-22fd6029a735 for instance 7c1f28aa-64fe-4517-88e2-b2e677baea24 on n-h2-852278-4 Aug 27 02:41:38.536674 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-b6e2523f-13de-4bab-a47b-46059f945bc5 req-8b87cb66-1d5e-4df7-a0c9-aac180765fc6 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049034 Aug 27 02:41:38.537780 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 310/593] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:41:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:41:38.549682 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b0270341-dd06-499d-84bc-4c7ec93fe7d0 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:38.551978 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b0270341-dd06-499d-84bc-4c7ec93fe7d0 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] [instance: 7c1f28aa-64fe-4517-88e2-b2e677baea24] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:38.563108 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b0270341-dd06-499d-84bc-4c7ec93fe7d0 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:38.564156 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b0270341-dd06-499d-84bc-4c7ec93fe7d0 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:38.564848 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b0270341-dd06-499d-84bc-4c7ec93fe7d0 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:38.566190 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b0270341-dd06-499d-84bc-4c7ec93fe7d0 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:38.566973 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b0270341-dd06-499d-84bc-4c7ec93fe7d0 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:38.567645 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b0270341-dd06-499d-84bc-4c7ec93fe7d0 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:38.948120 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-7f9ed8e0-98b4-4796-8e0c-c23449cfe7f7 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:38.960447 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-7f9ed8e0-98b4-4796-8e0c-c23449cfe7f7 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/29b88730-7871-4923-832e-a02d67f0314b" status: 200 len: 1503 microversion: 2.1 time: 0.986487 Aug 27 02:41:38.961823 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 284/594] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:37 2022] GET /compute/v2.1/servers/29b88730-7871-4923-832e-a02d67f0314b => generated 1503 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:38.967348 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-722a7fee-48f0-4d4f-8b87-228d8c250152 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:38.968139 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-722a7fee-48f0-4d4f-8b87-228d8c250152 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] [instance: 50597771-779f-426a-9cdc-17a6f2fb01fd] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:39.158273 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-722a7fee-48f0-4d4f-8b87-228d8c250152 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb3ac70d5084c9c826b5722e5302ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25afdc85b9aa4c86bd4f8e2e4a22ff3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:39.194624 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-722a7fee-48f0-4d4f-8b87-228d8c250152 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] 10.222.0.70 "GET /compute/v2.1/servers/50597771-779f-426a-9cdc-17a6f2fb01fd" status: 200 len: 1221 microversion: 2.1 time: 0.230566 Aug 27 02:41:39.197542 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 285/595] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:38 2022] GET /compute/v2.1/servers/50597771-779f-426a-9cdc-17a6f2fb01fd => generated 1221 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:39.203640 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-985fc152-81dd-4d8f-9646-42b244a8b9cd tempest-HypervisorAdminNegativeUnderV252Test-1251566595 tempest-HypervisorAdminNegativeUnderV252Test-1251566595-project] Calling method '.version_select at 0x7f5edf4450d0>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:39.206471 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-985fc152-81dd-4d8f-9646-42b244a8b9cd tempest-HypervisorAdminNegativeUnderV252Test-1251566595 tempest-HypervisorAdminNegativeUnderV252Test-1251566595-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '3a7723cbd2cb4143922339a5b4e75ad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2647706c496f47ef8ffe50f9e69c5ffe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:39.208772 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b0270341-dd06-499d-84bc-4c7ec93fe7d0 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c850104e6d430397bb54d0e3730a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72992d9dba564526b223533398a94dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:39.211382 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-985fc152-81dd-4d8f-9646-42b244a8b9cd tempest-HypervisorAdminNegativeUnderV252Test-1251566595 tempest-HypervisorAdminNegativeUnderV252Test-1251566595-project] Request method failure captured: Aug 27 02:41:39.211382 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Aug 27 02:41:39.211382 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:41:39.211382 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:41:39.211382 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:41:39.211382 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:41:39.211382 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:41:39.211382 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:41:39.211382 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:41:39.211382 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:41:39.211382 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYRcCEg_vKeVNxQOAKmN3RMFX77oBF5Ifpm2aqg5kgN0_y_dKqEl9uB5NEMwU7rmtZFA9L-yAUdbuyiW10twwzCLXejh3tgl6hEao2_U8vG7aCw3Yp4RFtwAqbk-yBr8_rSjRZT4IRcyH-7v4CNAGcESCLN39IyvUSZTA65aqeRG5mA Aug 27 02:41:39.211382 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:41:39.211382 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:41:39.211382 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:41:39.211382 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:41:39.211382 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:41:39.211382 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:41:39.211382 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 2647706c496f47ef8ffe50f9e69c5ffe Aug 27 02:41:39.211382 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1251566595 Aug 27 02:41:39.211382 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:41:39.211382 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:41:39.213670 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2647706c496f47ef8ffe50f9e69c5ffe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_2647706c496f47ef8ffe50f9e69c5ffe", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2647706c496f47ef8ffe50f9e69c5ffe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/2647706c496f47ef8ffe50f9e69c5ffe"}]}] Aug 27 02:41:39.213670 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1251566595 Aug 27 02:41:39.213670 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 2647706c496f47ef8ffe50f9e69c5ffe Aug 27 02:41:39.213670 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1251566595 Aug 27 02:41:39.213670 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1251566595-project Aug 27 02:41:39.213670 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:41:39.213670 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:41:39.213670 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 3a7723cbd2cb4143922339a5b4e75ad3 Aug 27 02:41:39.213670 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1251566595-project Aug 27 02:41:39.213670 n-d-852278-4 devstack@n-api.service[134051]: method: Aug 27 02:41:39.213670 n-d-852278-4 devstack@n-api.service[134051]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 27 02:41:39.213670 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '1'} Aug 27 02:41:39.214718 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:41:39.214718 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:41:39.214718 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:41:39.214718 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:41:39.214718 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:41:39.214718 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:41:39.214718 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:41:39.214718 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:41:39.214718 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:41:39.214718 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:41:39.214718 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Aug 27 02:41:39.214718 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Aug 27 02:41:39.214718 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 02:41:39.214718 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 02:41:39.214718 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 02:41:39.214718 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 02:41:39.214718 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 02:41:39.214718 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 02:41:39.214718 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 02:41:39.216004 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 02:41:39.216004 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 02:41:39.216004 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 02:41:39.216004 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 02:41:39.216004 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 02:41:39.216004 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 02:41:39.216004 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 02:41:39.216004 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 27 02:41:39.216004 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:41:39.216004 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:41:39.216004 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:41:39.216004 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:41:39.216004 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:41:39.216004 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:41:39.216004 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 02:41:39.216004 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 02:41:39.216004 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 27 02:41:39.216004 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:41:39.218703 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b0270341-dd06-499d-84bc-4c7ec93fe7d0 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] 10.222.0.70 "GET /compute/v2.1/servers/7c1f28aa-64fe-4517-88e2-b2e677baea24" status: 200 len: 1388 microversion: 2.1 time: 0.679408 Aug 27 02:41:39.220168 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-985fc152-81dd-4d8f-9646-42b244a8b9cd tempest-HypervisorAdminNegativeUnderV252Test-1251566595 tempest-HypervisorAdminNegativeUnderV252Test-1251566595-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:41:39.221073 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 311/596] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:38 2022] GET /compute/v2.1/servers/7c1f28aa-64fe-4517-88e2-b2e677baea24 => generated 1388 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:39.221372 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-985fc152-81dd-4d8f-9646-42b244a8b9cd tempest-HypervisorAdminNegativeUnderV252Test-1251566595 tempest-HypervisorAdminNegativeUnderV252Test-1251566595-project] 10.222.0.70 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.022588 Aug 27 02:41:39.222295 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 286/597] 10.222.0.70 () {58 vars in 1176 bytes} [Sat Aug 27 02:41:39 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:41:39.231133 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4914b301-fadf-4706-a511-012a8f223ac3 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:39.232524 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-4914b301-fadf-4706-a511-012a8f223ac3 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] [instance: 2e8baa0f-02cd-43f0-8919-e9bfbe6f1d01] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:39.234537 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ffea595b-1808-4199-bde8-6f910a86c5fc tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:39.240173 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-ffea595b-1808-4199-bde8-6f910a86c5fc tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] [instance: ccf87867-fb85-4b52-93f4-283450f636a4] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:39.240351 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4914b301-fadf-4706-a511-012a8f223ac3 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:39.240970 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4914b301-fadf-4706-a511-012a8f223ac3 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:39.241355 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4914b301-fadf-4706-a511-012a8f223ac3 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:39.242345 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4914b301-fadf-4706-a511-012a8f223ac3 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:39.242796 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4914b301-fadf-4706-a511-012a8f223ac3 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:39.243215 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4914b301-fadf-4706-a511-012a8f223ac3 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:39.255373 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ffea595b-1808-4199-bde8-6f910a86c5fc tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:39.256040 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ffea595b-1808-4199-bde8-6f910a86c5fc tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:39.256645 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ffea595b-1808-4199-bde8-6f910a86c5fc tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:39.257499 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ffea595b-1808-4199-bde8-6f910a86c5fc tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:39.258136 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ffea595b-1808-4199-bde8-6f910a86c5fc tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:39.258704 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ffea595b-1808-4199-bde8-6f910a86c5fc tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:39.832787 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-ffea595b-1808-4199-bde8-6f910a86c5fc tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30abbf3afe304291981a6a9b85952aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c28ddbdb164f01bb82235c6d49717b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:39.853448 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-4914b301-fadf-4706-a511-012a8f223ac3 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2ff9f8745c4dda8b04fbeb95d9988a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a009f79d954838abb0566d86b97f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:39.855100 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ffea595b-1808-4199-bde8-6f910a86c5fc tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] 10.222.0.70 "GET /compute/v2.1/servers/ccf87867-fb85-4b52-93f4-283450f636a4" status: 200 len: 1313 microversion: 2.1 time: 0.629555 Aug 27 02:41:39.856891 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 312/598] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:39 2022] GET /compute/v2.1/servers/ccf87867-fb85-4b52-93f4-283450f636a4 => generated 1313 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:39.874587 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-4914b301-fadf-4706-a511-012a8f223ac3 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] 10.222.0.70 "GET /compute/v2.1/servers/2e8baa0f-02cd-43f0-8919-e9bfbe6f1d01" status: 200 len: 1313 microversion: 2.1 time: 0.651179 Aug 27 02:41:39.875407 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 287/599] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:39 2022] GET /compute/v2.1/servers/2e8baa0f-02cd-43f0-8919-e9bfbe6f1d01 => generated 1313 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:39.877545 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-220d8714-f664-45de-b2a4-6de3ef4dda6d tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:39.878514 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-220d8714-f664-45de-b2a4-6de3ef4dda6d tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: 7eded9ca-c7bc-499a-bb53-a28d2c332402] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:39.880111 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0070763f-8cf7-43f8-a139-80f80f6992e7 tempest-HypervisorAdminNegativeUnderV252Test-1099824327 tempest-HypervisorAdminNegativeUnderV252Test-1099824327-project-admin] Calling method '.version_select at 0x7f5edf42a0d0>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:39.885674 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0070763f-8cf7-43f8-a139-80f80f6992e7 tempest-HypervisorAdminNegativeUnderV252Test-1099824327 tempest-HypervisorAdminNegativeUnderV252Test-1099824327-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:39.886190 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0070763f-8cf7-43f8-a139-80f80f6992e7 tempest-HypervisorAdminNegativeUnderV252Test-1099824327 tempest-HypervisorAdminNegativeUnderV252Test-1099824327-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:39.886629 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0070763f-8cf7-43f8-a139-80f80f6992e7 tempest-HypervisorAdminNegativeUnderV252Test-1099824327 tempest-HypervisorAdminNegativeUnderV252Test-1099824327-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:39.899414 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-220d8714-f664-45de-b2a4-6de3ef4dda6d tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:39.901858 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-220d8714-f664-45de-b2a4-6de3ef4dda6d tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:39.903608 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-220d8714-f664-45de-b2a4-6de3ef4dda6d tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:39.905543 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-220d8714-f664-45de-b2a4-6de3ef4dda6d tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:39.907396 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-220d8714-f664-45de-b2a4-6de3ef4dda6d tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:39.909644 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-220d8714-f664-45de-b2a4-6de3ef4dda6d tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:39.911613 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-0070763f-8cf7-43f8-a139-80f80f6992e7 tempest-HypervisorAdminNegativeUnderV252Test-1099824327 tempest-HypervisorAdminNegativeUnderV252Test-1099824327-project-admin] HTTP exception thrown: No hypervisor matching '87be435a-23c9-49ab-9c91-43f2c420a94f' could be found. Aug 27 02:41:39.913126 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0070763f-8cf7-43f8-a139-80f80f6992e7 tempest-HypervisorAdminNegativeUnderV252Test-1099824327 tempest-HypervisorAdminNegativeUnderV252Test-1099824327-project-admin] Request method failure captured: Aug 27 02:41:39.913126 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/os-hypervisors/87be435a-23c9-49ab-9c91-43f2c420a94f/servers HTTP/1.1 Aug 27 02:41:39.913126 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:41:39.913126 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:41:39.913126 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:41:39.913126 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:41:39.913126 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:41:39.913126 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:41:39.913126 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:41:39.913126 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:41:39.913126 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYRdAhz-dG3lJw9mql5W5Nuy43ZrCHCJO7D8V7EUPP0hqQbsUL0helZySQfkbleGVRVlq1_TeZ-bvvVlZZRyEgB41kJuaeHO3VLgjgl4puHruT7TYPd_7gYcvzGkTiw7islMmMIHFsxAE3eWooGYqDgfU5ZzeGLCbPDAAWCIUKshIGQ Aug 27 02:41:39.913126 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:41:39.913126 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:41:39.913126 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:41:39.913126 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:41:39.913126 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:41:39.913126 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:41:39.913126 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: c022e01a8c6a48ffb7036afda19f1e49 Aug 27 02:41:39.913126 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1099824327 Aug 27 02:41:39.913126 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,admin,member Aug 27 02:41:39.913126 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,admin,member Aug 27 02:41:39.914629 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c022e01a8c6a48ffb7036afda19f1e49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c022e01a8c6a48ffb7036afda19f1e49", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c022e01a8c6a48ffb7036afda19f1e49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c022e01a8c6a48ffb7036afda19f1e49"}]}] Aug 27 02:41:39.914629 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1099824327 Aug 27 02:41:39.914629 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: c022e01a8c6a48ffb7036afda19f1e49 Aug 27 02:41:39.914629 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1099824327 Aug 27 02:41:39.914629 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1099824327-project-admin Aug 27 02:41:39.914629 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:41:39.914629 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:41:39.914629 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: c5a5c943f8774928b57a9b981c50c74d Aug 27 02:41:39.914629 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1099824327-project-admin Aug 27 02:41:39.914629 n-d-852278-4 devstack@n-api.service[134051]: method: Aug 27 02:41:39.914629 n-d-852278-4 devstack@n-api.service[134051]: exception: No hypervisor matching '87be435a-23c9-49ab-9c91-43f2c420a94f' could be found. Aug 27 02:41:39.914629 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '87be435a-23c9-49ab-9c91-43f2c420a94f'} Aug 27 02:41:39.915485 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:41:39.915485 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:41:39.915485 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:41:39.915485 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:41:39.915485 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:41:39.915485 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:41:39.915485 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:41:39.915485 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:41:39.915485 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:41:39.915485 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:41:39.915485 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Aug 27 02:41:39.915485 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Aug 27 02:41:39.915485 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Aug 27 02:41:39.915485 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 27 02:41:39.915485 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '87be435a-23c9-49ab-9c91-43f2c420a94f' could be found. Aug 27 02:41:39.915485 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:41:39.915485 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:41:39.915485 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:41:39.915485 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:41:39.916841 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:41:39.916841 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:41:39.916841 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:41:39.916841 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:41:39.916841 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '87be435a-23c9-49ab-9c91-43f2c420a94f' could be found. Aug 27 02:41:39.916841 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:41:39.916841 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0070763f-8cf7-43f8-a139-80f80f6992e7 tempest-HypervisorAdminNegativeUnderV252Test-1099824327 tempest-HypervisorAdminNegativeUnderV252Test-1099824327-project-admin] Returning 404 to user: No hypervisor matching '87be435a-23c9-49ab-9c91-43f2c420a94f' could be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:41:39.916841 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-0070763f-8cf7-43f8-a139-80f80f6992e7 tempest-HypervisorAdminNegativeUnderV252Test-1099824327 tempest-HypervisorAdminNegativeUnderV252Test-1099824327-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors/87be435a-23c9-49ab-9c91-43f2c420a94f/servers" status: 404 len: 123 microversion: 2.1 time: 0.037996 Aug 27 02:41:39.916841 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 288/600] 10.222.0.70 () {58 vars in 1281 bytes} [Sat Aug 27 02:41:39 2022] GET /compute/v2.1/os-hypervisors/87be435a-23c9-49ab-9c91-43f2c420a94f/servers => generated 123 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:41:39.985117 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-2b7bfaca-1bb9-4d9b-afb8-4f1dee3753e3 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:39.986475 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-2b7bfaca-1bb9-4d9b-afb8-4f1dee3753e3 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 29b88730-7871-4923-832e-a02d67f0314b] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:40.002137 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2b7bfaca-1bb9-4d9b-afb8-4f1dee3753e3 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:40.002997 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2b7bfaca-1bb9-4d9b-afb8-4f1dee3753e3 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:40.003781 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2b7bfaca-1bb9-4d9b-afb8-4f1dee3753e3 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:40.004863 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2b7bfaca-1bb9-4d9b-afb8-4f1dee3753e3 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:40.005975 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2b7bfaca-1bb9-4d9b-afb8-4f1dee3753e3 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:40.006551 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2b7bfaca-1bb9-4d9b-afb8-4f1dee3753e3 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:40.194569 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-220d8714-f664-45de-b2a4-6de3ef4dda6d tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:40.207526 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-220d8714-f664-45de-b2a4-6de3ef4dda6d tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:40.211650 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-220d8714-f664-45de-b2a4-6de3ef4dda6d tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:40.213838 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-220d8714-f664-45de-b2a4-6de3ef4dda6d tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/7eded9ca-c7bc-499a-bb53-a28d2c332402" status: 200 len: 1342 microversion: 2.25 time: 0.354535 Aug 27 02:41:40.214451 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 313/601] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:41:39 2022] GET /compute/v2.1/servers/7eded9ca-c7bc-499a-bb53-a28d2c332402 => generated 1342 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:41:40.224899 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-27a3fac4-83be-49fb-b56a-98e50486d63f tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:40.230403 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-27a3fac4-83be-49fb-b56a-98e50486d63f tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] [instance: 50597771-779f-426a-9cdc-17a6f2fb01fd] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:40.245229 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-27a3fac4-83be-49fb-b56a-98e50486d63f tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:40.259478 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-27a3fac4-83be-49fb-b56a-98e50486d63f tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:40.260007 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-27a3fac4-83be-49fb-b56a-98e50486d63f tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:40.263576 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-27a3fac4-83be-49fb-b56a-98e50486d63f tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:40.265865 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-27a3fac4-83be-49fb-b56a-98e50486d63f tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:40.266319 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-27a3fac4-83be-49fb-b56a-98e50486d63f tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:40.407621 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-2b7bfaca-1bb9-4d9b-afb8-4f1dee3753e3 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:40.419092 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-2b7bfaca-1bb9-4d9b-afb8-4f1dee3753e3 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/29b88730-7871-4923-832e-a02d67f0314b" status: 200 len: 1493 microversion: 2.1 time: 0.435463 Aug 27 02:41:40.419925 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 289/602] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:39 2022] GET /compute/v2.1/servers/29b88730-7871-4923-832e-a02d67f0314b => generated 1493 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:41:40.431236 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-57f49c18-3258-41f4-aa3c-fca60d14b086 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:40.432182 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-57f49c18-3258-41f4-aa3c-fca60d14b086 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] [instance: 7c1f28aa-64fe-4517-88e2-b2e677baea24] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:40.444174 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-57f49c18-3258-41f4-aa3c-fca60d14b086 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:40.448952 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-57f49c18-3258-41f4-aa3c-fca60d14b086 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:40.454896 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-57f49c18-3258-41f4-aa3c-fca60d14b086 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:40.455946 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-57f49c18-3258-41f4-aa3c-fca60d14b086 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:40.456638 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-57f49c18-3258-41f4-aa3c-fca60d14b086 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:40.457256 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-57f49c18-3258-41f4-aa3c-fca60d14b086 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:40.529817 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-27a3fac4-83be-49fb-b56a-98e50486d63f tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb3ac70d5084c9c826b5722e5302ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25afdc85b9aa4c86bd4f8e2e4a22ff3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:40.541626 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-27a3fac4-83be-49fb-b56a-98e50486d63f tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] 10.222.0.70 "GET /compute/v2.1/servers/50597771-779f-426a-9cdc-17a6f2fb01fd" status: 200 len: 1281 microversion: 2.1 time: 0.323088 Aug 27 02:41:40.542999 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 314/603] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:40 2022] GET /compute/v2.1/servers/50597771-779f-426a-9cdc-17a6f2fb01fd => generated 1281 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:40.552076 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-3eeae4fc-2408-49b7-b3d0-3e69e57a8da3 req-d979c129-1125-4064-87d8-76da4d1c7696 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e8baa0f-02cd-43f0-8919-e9bfbe6f1d01", "name": "network-vif-plugged", "status": "completed", "tag": "852fadc7-febc-45c6-bd61-2ec79939f173"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:41:40.564636 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-3eeae4fc-2408-49b7-b3d0-3e69e57a8da3 req-d979c129-1125-4064-87d8-76da4d1c7696 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:40.565404 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-3eeae4fc-2408-49b7-b3d0-3e69e57a8da3 req-d979c129-1125-4064-87d8-76da4d1c7696 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:40.566220 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-3eeae4fc-2408-49b7-b3d0-3e69e57a8da3 req-d979c129-1125-4064-87d8-76da4d1c7696 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:40.586267 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-3eeae4fc-2408-49b7-b3d0-3e69e57a8da3 req-d979c129-1125-4064-87d8-76da4d1c7696 service nova] Creating event network-vif-plugged:852fadc7-febc-45c6-bd61-2ec79939f173 for instance 2e8baa0f-02cd-43f0-8919-e9bfbe6f1d01 on n-h1-852278-4 Aug 27 02:41:40.591256 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-3eeae4fc-2408-49b7-b3d0-3e69e57a8da3 req-d979c129-1125-4064-87d8-76da4d1c7696 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047052 Aug 27 02:41:40.592159 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 315/604] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:41:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:41:40.597309 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e8470134-0db5-4e41-bfde-531ea8b9a91e tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Calling method '.version_select at 0x7f5ee3482160>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:40.602050 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e8470134-0db5-4e41-bfde-531ea8b9a91e tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:40.602459 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e8470134-0db5-4e41-bfde-531ea8b9a91e tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:40.602897 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e8470134-0db5-4e41-bfde-531ea8b9a91e tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:40.613301 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e8470134-0db5-4e41-bfde-531ea8b9a91e tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] 10.222.0.70 "GET /compute/v2.1/os-migrations" status: 200 len: 1166 microversion: 2.1 time: 0.019343 Aug 27 02:41:40.635511 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 316/605] 10.222.0.70 () {58 vars in 1143 bytes} [Sat Aug 27 02:41:40 2022] GET /compute/v2.1/os-migrations => generated 1166 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:40.650815 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-aea32413-efc4-42a2-9bde-ba37c7b7a6f2 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:40.653119 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-aea32413-efc4-42a2-9bde-ba37c7b7a6f2 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] [instance: 29b88730-7871-4923-832e-a02d67f0314b] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:40.665962 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-aea32413-efc4-42a2-9bde-ba37c7b7a6f2 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:40.666550 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-aea32413-efc4-42a2-9bde-ba37c7b7a6f2 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:40.667049 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-aea32413-efc4-42a2-9bde-ba37c7b7a6f2 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:40.668172 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-aea32413-efc4-42a2-9bde-ba37c7b7a6f2 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:40.668796 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-aea32413-efc4-42a2-9bde-ba37c7b7a6f2 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:40.669617 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-aea32413-efc4-42a2-9bde-ba37c7b7a6f2 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:40.895772 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-57f49c18-3258-41f4-aa3c-fca60d14b086 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c850104e6d430397bb54d0e3730a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72992d9dba564526b223533398a94dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:40.903941 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-57f49c18-3258-41f4-aa3c-fca60d14b086 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] 10.222.0.70 "GET /compute/v2.1/servers/7c1f28aa-64fe-4517-88e2-b2e677baea24" status: 200 len: 1388 microversion: 2.1 time: 0.482176 Aug 27 02:41:40.904544 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 290/606] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:40 2022] GET /compute/v2.1/servers/7c1f28aa-64fe-4517-88e2-b2e677baea24 => generated 1388 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:40.921350 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-2ad42ccb-64d5-4928-aa7f-2156d97a7746 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:40.922405 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-2ad42ccb-64d5-4928-aa7f-2156d97a7746 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] [instance: ccf87867-fb85-4b52-93f4-283450f636a4] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:40.929074 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2ad42ccb-64d5-4928-aa7f-2156d97a7746 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:40.929584 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2ad42ccb-64d5-4928-aa7f-2156d97a7746 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:40.929998 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2ad42ccb-64d5-4928-aa7f-2156d97a7746 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:40.930734 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2ad42ccb-64d5-4928-aa7f-2156d97a7746 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:40.931178 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2ad42ccb-64d5-4928-aa7f-2156d97a7746 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:40.931592 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2ad42ccb-64d5-4928-aa7f-2156d97a7746 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:41.244634 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-aea32413-efc4-42a2-9bde-ba37c7b7a6f2 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/29b88730-7871-4923-832e-a02d67f0314b" status: 200 len: 1644 microversion: 2.1 time: 0.604142 Aug 27 02:41:41.250087 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 317/607] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:40 2022] GET /compute/v2.1/servers/29b88730-7871-4923-832e-a02d67f0314b => generated 1644 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:41.260772 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-53446a3b-835a-4d69-8e3b-379b0e94ef29 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:41.261386 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-53446a3b-835a-4d69-8e3b-379b0e94ef29 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] [instance: 2e8baa0f-02cd-43f0-8919-e9bfbe6f1d01] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:41.279013 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-53446a3b-835a-4d69-8e3b-379b0e94ef29 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:41.279511 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-53446a3b-835a-4d69-8e3b-379b0e94ef29 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:41.279928 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-53446a3b-835a-4d69-8e3b-379b0e94ef29 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:41.280651 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-53446a3b-835a-4d69-8e3b-379b0e94ef29 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:41.281116 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-53446a3b-835a-4d69-8e3b-379b0e94ef29 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:41.281535 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-53446a3b-835a-4d69-8e3b-379b0e94ef29 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:41.346539 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-2ad42ccb-64d5-4928-aa7f-2156d97a7746 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30abbf3afe304291981a6a9b85952aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c28ddbdb164f01bb82235c6d49717b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:41.354925 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-2ad42ccb-64d5-4928-aa7f-2156d97a7746 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] 10.222.0.70 "GET /compute/v2.1/servers/ccf87867-fb85-4b52-93f4-283450f636a4" status: 200 len: 1313 microversion: 2.1 time: 0.437392 Aug 27 02:41:41.357462 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 291/608] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:40 2022] GET /compute/v2.1/servers/ccf87867-fb85-4b52-93f4-283450f636a4 => generated 1313 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:41.368892 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-6cc9af2e-b719-42dc-a36d-0209df937781 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:41.369542 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-6cc9af2e-b719-42dc-a36d-0209df937781 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: 7eded9ca-c7bc-499a-bb53-a28d2c332402] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:41.389003 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6cc9af2e-b719-42dc-a36d-0209df937781 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:41.389615 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6cc9af2e-b719-42dc-a36d-0209df937781 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:41.390300 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6cc9af2e-b719-42dc-a36d-0209df937781 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:41.391285 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6cc9af2e-b719-42dc-a36d-0209df937781 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:41.392026 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6cc9af2e-b719-42dc-a36d-0209df937781 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:41.392569 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6cc9af2e-b719-42dc-a36d-0209df937781 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:42.226559 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-53446a3b-835a-4d69-8e3b-379b0e94ef29 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2ff9f8745c4dda8b04fbeb95d9988a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a009f79d954838abb0566d86b97f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:42.238679 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-53446a3b-835a-4d69-8e3b-379b0e94ef29 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] 10.222.0.70 "GET /compute/v2.1/servers/2e8baa0f-02cd-43f0-8919-e9bfbe6f1d01" status: 200 len: 1313 microversion: 2.1 time: 0.986690 Aug 27 02:41:42.239863 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 318/609] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:41 2022] GET /compute/v2.1/servers/2e8baa0f-02cd-43f0-8919-e9bfbe6f1d01 => generated 1313 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:42.246963 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-1153c446-9d11-41b2-bb97-2a30e1fb7027 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1052250174", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "networks": [{"uuid": "fca9b1d3-694a-4672-8678-5d39e71afa11"}]}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:41:42.333717 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.network.neutron [None req-1153c446-9d11-41b2-bb97-2a30e1fb7027 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] validate_networks() for [('fca9b1d3-694a-4672-8678-5d39e71afa11', None, None, None, None, None)] {{(pid=134052) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:41:42.349055 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-6cc9af2e-b719-42dc-a36d-0209df937781 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:42.365152 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-6cc9af2e-b719-42dc-a36d-0209df937781 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:42.369276 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-6cc9af2e-b719-42dc-a36d-0209df937781 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:42.377845 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-6cc9af2e-b719-42dc-a36d-0209df937781 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/7eded9ca-c7bc-499a-bb53-a28d2c332402" status: 200 len: 1410 microversion: 2.25 time: 1.010973 Aug 27 02:41:42.379075 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 292/610] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:41:41 2022] GET /compute/v2.1/servers/7eded9ca-c7bc-499a-bb53-a28d2c332402 => generated 1410 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:41:42.395285 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-6e522df0-73e2-49a2-a898-4aae07561b25 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:42.396153 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-6e522df0-73e2-49a2-a898-4aae07561b25 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] [instance: 50597771-779f-426a-9cdc-17a6f2fb01fd] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:42.404013 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6e522df0-73e2-49a2-a898-4aae07561b25 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:42.404968 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6e522df0-73e2-49a2-a898-4aae07561b25 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:42.406117 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6e522df0-73e2-49a2-a898-4aae07561b25 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:42.409091 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6e522df0-73e2-49a2-a898-4aae07561b25 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:42.410565 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6e522df0-73e2-49a2-a898-4aae07561b25 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:42.412125 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6e522df0-73e2-49a2-a898-4aae07561b25 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:43.085122 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-6e522df0-73e2-49a2-a898-4aae07561b25 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb3ac70d5084c9c826b5722e5302ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25afdc85b9aa4c86bd4f8e2e4a22ff3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:43.098056 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-6e522df0-73e2-49a2-a898-4aae07561b25 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] 10.222.0.70 "GET /compute/v2.1/servers/50597771-779f-426a-9cdc-17a6f2fb01fd" status: 200 len: 1321 microversion: 2.1 time: 0.713090 Aug 27 02:41:43.099371 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 293/611] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:42 2022] GET /compute/v2.1/servers/50597771-779f-426a-9cdc-17a6f2fb01fd => generated 1321 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:43.104632 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a816e3a7-d993-41bb-92f6-776ac9a17174 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:43.106416 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-a816e3a7-d993-41bb-92f6-776ac9a17174 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] [instance: 7c1f28aa-64fe-4517-88e2-b2e677baea24] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:43.114367 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:UPDATE=11,nova_api:SELECT=83,nova_api:INSERT=6 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:41:43.116938 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a816e3a7-d993-41bb-92f6-776ac9a17174 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:43.117821 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a816e3a7-d993-41bb-92f6-776ac9a17174 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:43.118605 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a816e3a7-d993-41bb-92f6-776ac9a17174 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:43.119545 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a816e3a7-d993-41bb-92f6-776ac9a17174 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:43.120190 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a816e3a7-d993-41bb-92f6-776ac9a17174 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:43.120864 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a816e3a7-d993-41bb-92f6-776ac9a17174 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:43.887003 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-a816e3a7-d993-41bb-92f6-776ac9a17174 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c850104e6d430397bb54d0e3730a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72992d9dba564526b223533398a94dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:43.918339 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a816e3a7-d993-41bb-92f6-776ac9a17174 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] 10.222.0.70 "GET /compute/v2.1/servers/7c1f28aa-64fe-4517-88e2-b2e677baea24" status: 200 len: 1388 microversion: 2.1 time: 0.817293 Aug 27 02:41:43.919355 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 294/612] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:43 2022] GET /compute/v2.1/servers/7c1f28aa-64fe-4517-88e2-b2e677baea24 => generated 1388 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:43.926378 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c706df6b-c357-4738-b878-8dca33b3fd27 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:43.927692 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-c706df6b-c357-4738-b878-8dca33b3fd27 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] [instance: ccf87867-fb85-4b52-93f4-283450f636a4] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:43.941720 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c706df6b-c357-4738-b878-8dca33b3fd27 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:43.943341 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c706df6b-c357-4738-b878-8dca33b3fd27 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:43.946941 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c706df6b-c357-4738-b878-8dca33b3fd27 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:43.948613 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c706df6b-c357-4738-b878-8dca33b3fd27 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:43.949433 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c706df6b-c357-4738-b878-8dca33b3fd27 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:43.950139 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c706df6b-c357-4738-b878-8dca33b3fd27 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:44.599488 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-1153c446-9d11-41b2-bb97-2a30e1fb7027 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Flavor limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:41:44.603555 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-1153c446-9d11-41b2-bb97-2a30e1fb7027 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Image limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:41:44.604055 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-1153c446-9d11-41b2-bb97-2a30e1fb7027 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Flavor pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:41:44.604982 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-1153c446-9d11-41b2-bb97-2a30e1fb7027 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Image pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:41:44.606517 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-1153c446-9d11-41b2-bb97-2a30e1fb7027 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:41:44.632097 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1153c446-9d11-41b2-bb97-2a30e1fb7027 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:44.633015 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1153c446-9d11-41b2-bb97-2a30e1fb7027 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:44.636249 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1153c446-9d11-41b2-bb97-2a30e1fb7027 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:44.638865 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1153c446-9d11-41b2-bb97-2a30e1fb7027 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:44.642414 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1153c446-9d11-41b2-bb97-2a30e1fb7027 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:44.643044 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1153c446-9d11-41b2-bb97-2a30e1fb7027 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:44.688021 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-1153c446-9d11-41b2-bb97-2a30e1fb7027 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Getting quotas for project 42ec913a638c4c8c8749be73705d2c65. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:41:44.695707 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-1153c446-9d11-41b2-bb97-2a30e1fb7027 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Getting quotas for user 6305debcc9294643bbed97f08de171bc and project 42ec913a638c4c8c8749be73705d2c65. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:41:44.701019 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-c706df6b-c357-4738-b878-8dca33b3fd27 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30abbf3afe304291981a6a9b85952aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c28ddbdb164f01bb82235c6d49717b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:44.712010 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-1153c446-9d11-41b2-bb97-2a30e1fb7027 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Going to run 1 instances... {{(pid=134052) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:41:44.715278 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-1153c446-9d11-41b2-bb97-2a30e1fb7027 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 14e68153-ad1e-4028-8580-dcb179346f31] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134052) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:41:44.770205 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:41:44.778178 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c706df6b-c357-4738-b878-8dca33b3fd27 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] 10.222.0.70 "GET /compute/v2.1/servers/ccf87867-fb85-4b52-93f4-283450f636a4" status: 200 len: 1313 microversion: 2.1 time: 0.855075 Aug 27 02:41:44.820392 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-1153c446-9d11-41b2-bb97-2a30e1fb7027 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.571808 Aug 27 02:41:44.827753 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 295/613] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:43 2022] GET /compute/v2.1/servers/ccf87867-fb85-4b52-93f4-283450f636a4 => generated 1313 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:44.829188 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 319/614] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 02:41:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 2588 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:41:44.839061 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-65147e03-e662-4438-87cc-d380f7019ae0 req-db79cf8e-1d96-458c-8675-806291af5f82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ccf87867-fb85-4b52-93f4-283450f636a4", "tag": "457ff7f9-caf8-461a-a54b-310371560c75"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:41:44.848631 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8b924b3d-f1ff-4abd-a273-60efc82c3513 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:44.849479 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-8b924b3d-f1ff-4abd-a273-60efc82c3513 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] [instance: 2e8baa0f-02cd-43f0-8919-e9bfbe6f1d01] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:44.859891 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8b924b3d-f1ff-4abd-a273-60efc82c3513 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:44.860872 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8b924b3d-f1ff-4abd-a273-60efc82c3513 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:44.864724 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8b924b3d-f1ff-4abd-a273-60efc82c3513 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:44.871572 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8b924b3d-f1ff-4abd-a273-60efc82c3513 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:44.872248 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8b924b3d-f1ff-4abd-a273-60efc82c3513 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:44.873442 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8b924b3d-f1ff-4abd-a273-60efc82c3513 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:44.921769 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-65147e03-e662-4438-87cc-d380f7019ae0 req-db79cf8e-1d96-458c-8675-806291af5f82 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:44.923095 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-65147e03-e662-4438-87cc-d380f7019ae0 req-db79cf8e-1d96-458c-8675-806291af5f82 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:44.924818 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-65147e03-e662-4438-87cc-d380f7019ae0 req-db79cf8e-1d96-458c-8675-806291af5f82 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:44.959134 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-65147e03-e662-4438-87cc-d380f7019ae0 req-db79cf8e-1d96-458c-8675-806291af5f82 service nova] Creating event network-changed:457ff7f9-caf8-461a-a54b-310371560c75 for instance ccf87867-fb85-4b52-93f4-283450f636a4 on n-h2-852278-4 Aug 27 02:41:44.973092 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-65147e03-e662-4438-87cc-d380f7019ae0 req-db79cf8e-1d96-458c-8675-806291af5f82 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142678 Aug 27 02:41:44.976658 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 296/615] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:41:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:41:44.988945 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-37351b06-f145-4887-bd63-6df7b766bab4 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:44.991655 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-37351b06-f145-4887-bd63-6df7b766bab4 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: 7eded9ca-c7bc-499a-bb53-a28d2c332402] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:45.015853 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-37351b06-f145-4887-bd63-6df7b766bab4 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:45.017824 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-37351b06-f145-4887-bd63-6df7b766bab4 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:45.018300 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-37351b06-f145-4887-bd63-6df7b766bab4 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:45.019057 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-37351b06-f145-4887-bd63-6df7b766bab4 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:45.019510 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-37351b06-f145-4887-bd63-6df7b766bab4 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:45.019925 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-37351b06-f145-4887-bd63-6df7b766bab4 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:45.286278 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-8b924b3d-f1ff-4abd-a273-60efc82c3513 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2ff9f8745c4dda8b04fbeb95d9988a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a009f79d954838abb0566d86b97f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:45.311610 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-8b924b3d-f1ff-4abd-a273-60efc82c3513 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] 10.222.0.70 "GET /compute/v2.1/servers/2e8baa0f-02cd-43f0-8919-e9bfbe6f1d01" status: 200 len: 1463 microversion: 2.1 time: 0.476927 Aug 27 02:41:45.312969 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 320/616] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:44 2022] GET /compute/v2.1/servers/2e8baa0f-02cd-43f0-8919-e9bfbe6f1d01 => generated 1463 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:45.323859 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-0131895c-6e1d-46df-9995-361de6764f70 req-223922d0-f4ef-4e5c-a032-64d1363d0386 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50597771-779f-426a-9cdc-17a6f2fb01fd", "tag": "5d4a954d-d8fd-4d2d-9c40-fd2bf505d3ae"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:41:45.337866 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-0131895c-6e1d-46df-9995-361de6764f70 req-223922d0-f4ef-4e5c-a032-64d1363d0386 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:45.338825 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-0131895c-6e1d-46df-9995-361de6764f70 req-223922d0-f4ef-4e5c-a032-64d1363d0386 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:45.340061 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-0131895c-6e1d-46df-9995-361de6764f70 req-223922d0-f4ef-4e5c-a032-64d1363d0386 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:45.357920 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-0131895c-6e1d-46df-9995-361de6764f70 req-223922d0-f4ef-4e5c-a032-64d1363d0386 service nova] Creating event network-changed:5d4a954d-d8fd-4d2d-9c40-fd2bf505d3ae for instance 50597771-779f-426a-9cdc-17a6f2fb01fd on n-h1-852278-4 Aug 27 02:41:45.366183 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-0131895c-6e1d-46df-9995-361de6764f70 req-223922d0-f4ef-4e5c-a032-64d1363d0386 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051470 Aug 27 02:41:45.367911 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 321/617] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:41:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:41:45.385514 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-fb39d0db-316c-4edf-b6de-5adc664e9ce8 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:45.386228 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-fb39d0db-316c-4edf-b6de-5adc664e9ce8 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] [instance: 50597771-779f-426a-9cdc-17a6f2fb01fd] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:45.396443 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-37351b06-f145-4887-bd63-6df7b766bab4 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:45.403783 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fb39d0db-316c-4edf-b6de-5adc664e9ce8 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:45.404531 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fb39d0db-316c-4edf-b6de-5adc664e9ce8 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:45.405269 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fb39d0db-316c-4edf-b6de-5adc664e9ce8 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:45.407541 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fb39d0db-316c-4edf-b6de-5adc664e9ce8 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:45.408039 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fb39d0db-316c-4edf-b6de-5adc664e9ce8 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:45.408727 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fb39d0db-316c-4edf-b6de-5adc664e9ce8 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:45.428218 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-37351b06-f145-4887-bd63-6df7b766bab4 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:45.430684 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-37351b06-f145-4887-bd63-6df7b766bab4 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:45.436855 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-37351b06-f145-4887-bd63-6df7b766bab4 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/7eded9ca-c7bc-499a-bb53-a28d2c332402" status: 200 len: 1410 microversion: 2.25 time: 0.458021 Aug 27 02:41:45.440553 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 297/618] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:41:44 2022] GET /compute/v2.1/servers/7eded9ca-c7bc-499a-bb53-a28d2c332402 => generated 1410 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:41:45.458791 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-1d5cdd5a-35a7-4b41-bb11-ddafd2526409 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:45.459585 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-1d5cdd5a-35a7-4b41-bb11-ddafd2526409 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 14e68153-ad1e-4028-8580-dcb179346f31] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:45.593178 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-1d5cdd5a-35a7-4b41-bb11-ddafd2526409 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:45.611560 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-1d5cdd5a-35a7-4b41-bb11-ddafd2526409 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/14e68153-ad1e-4028-8580-dcb179346f31" status: 200 len: 1211 microversion: 2.1 time: 0.167718 Aug 27 02:41:45.613121 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 298/619] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:45 2022] GET /compute/v2.1/servers/14e68153-ad1e-4028-8580-dcb179346f31 => generated 1211 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:45.619206 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-56de3592-6c09-4fd4-9981-c64f3fb831ea tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:45.620278 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-56de3592-6c09-4fd4-9981-c64f3fb831ea tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] [instance: 7c1f28aa-64fe-4517-88e2-b2e677baea24] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:45.630849 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-56de3592-6c09-4fd4-9981-c64f3fb831ea tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:45.631570 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-56de3592-6c09-4fd4-9981-c64f3fb831ea tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:45.632239 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-56de3592-6c09-4fd4-9981-c64f3fb831ea tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:45.633454 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-56de3592-6c09-4fd4-9981-c64f3fb831ea tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:45.634367 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-56de3592-6c09-4fd4-9981-c64f3fb831ea tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:45.634816 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-56de3592-6c09-4fd4-9981-c64f3fb831ea tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:45.801214 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-fb39d0db-316c-4edf-b6de-5adc664e9ce8 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb3ac70d5084c9c826b5722e5302ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25afdc85b9aa4c86bd4f8e2e4a22ff3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:45.815793 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-fb39d0db-316c-4edf-b6de-5adc664e9ce8 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] 10.222.0.70 "GET /compute/v2.1/servers/50597771-779f-426a-9cdc-17a6f2fb01fd" status: 200 len: 1321 microversion: 2.1 time: 0.446330 Aug 27 02:41:45.822365 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 322/620] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:45 2022] GET /compute/v2.1/servers/50597771-779f-426a-9cdc-17a6f2fb01fd => generated 1321 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:46.136503 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-56de3592-6c09-4fd4-9981-c64f3fb831ea tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c850104e6d430397bb54d0e3730a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72992d9dba564526b223533398a94dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:46.146001 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-56de3592-6c09-4fd4-9981-c64f3fb831ea tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] 10.222.0.70 "GET /compute/v2.1/servers/7c1f28aa-64fe-4517-88e2-b2e677baea24" status: 200 len: 1388 microversion: 2.1 time: 0.531361 Aug 27 02:41:46.149083 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 299/621] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:45 2022] GET /compute/v2.1/servers/7c1f28aa-64fe-4517-88e2-b2e677baea24 => generated 1388 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:46.169472 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-9e995187-c9da-479a-85d1-470e511d0375 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:46.170652 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-9e995187-c9da-479a-85d1-470e511d0375 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] [instance: ccf87867-fb85-4b52-93f4-283450f636a4] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:46.179423 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9e995187-c9da-479a-85d1-470e511d0375 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:46.180258 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9e995187-c9da-479a-85d1-470e511d0375 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:46.181238 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9e995187-c9da-479a-85d1-470e511d0375 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:46.182770 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9e995187-c9da-479a-85d1-470e511d0375 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:46.184098 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9e995187-c9da-479a-85d1-470e511d0375 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:46.184782 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9e995187-c9da-479a-85d1-470e511d0375 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:46.278968 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-aba021db-c675-4003-8c1e-b4f5711ad79f tempest-TenantUsagesTestJSON-1309931092 tempest-TenantUsagesTestJSON-1309931092-project-admin] Calling method '.version_select at 0x7f5ee3401f70>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:46.309914 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-aba021db-c675-4003-8c1e-b4f5711ad79f tempest-TenantUsagesTestJSON-1309931092 tempest-TenantUsagesTestJSON-1309931092-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:46.310780 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-aba021db-c675-4003-8c1e-b4f5711ad79f tempest-TenantUsagesTestJSON-1309931092 tempest-TenantUsagesTestJSON-1309931092-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:46.311379 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-aba021db-c675-4003-8c1e-b4f5711ad79f tempest-TenantUsagesTestJSON-1309931092 tempest-TenantUsagesTestJSON-1309931092-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:46.338225 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-aba021db-c675-4003-8c1e-b4f5711ad79f tempest-TenantUsagesTestJSON-1309931092 tempest-TenantUsagesTestJSON-1309931092-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:46.339037 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-aba021db-c675-4003-8c1e-b4f5711ad79f tempest-TenantUsagesTestJSON-1309931092 tempest-TenantUsagesTestJSON-1309931092-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:46.339695 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-aba021db-c675-4003-8c1e-b4f5711ad79f tempest-TenantUsagesTestJSON-1309931092 tempest-TenantUsagesTestJSON-1309931092-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:46.360675 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-aba021db-c675-4003-8c1e-b4f5711ad79f tempest-TenantUsagesTestJSON-1309931092 tempest-TenantUsagesTestJSON-1309931092-project-admin] 10.222.0.70 "GET /compute/v2.1/os-simple-tenant-usage/f7a009f79d954838abb0566d86b97f2e?start=2022-08-26T02%3A41%3A45.329927&end=2022-08-28T02%3A41%3A45.329927" status: 200 len: 694 microversion: 2.1 time: 0.525781 Aug 27 02:41:46.362009 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 323/622] 10.222.0.70 () {58 vars in 1412 bytes} [Sat Aug 27 02:41:45 2022] GET /compute/v2.1/os-simple-tenant-usage/f7a009f79d954838abb0566d86b97f2e?start=2022-08-26T02%3A41%3A45.329927&end=2022-08-28T02%3A41%3A45.329927 => generated 694 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:41:46.378628 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-46238103-f982-45e0-94f0-77b7684ce0d9 req-96b3cd02-a056-437b-a9eb-0e7610a4b663 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c1f28aa-64fe-4517-88e2-b2e677baea24", "name": "network-vif-plugged", "status": "completed", "tag": "fdce9d3d-6208-43e7-9296-22fd6029a735"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:41:46.389664 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-46238103-f982-45e0-94f0-77b7684ce0d9 req-96b3cd02-a056-437b-a9eb-0e7610a4b663 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:46.390867 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-46238103-f982-45e0-94f0-77b7684ce0d9 req-96b3cd02-a056-437b-a9eb-0e7610a4b663 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:46.391372 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-46238103-f982-45e0-94f0-77b7684ce0d9 req-96b3cd02-a056-437b-a9eb-0e7610a4b663 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:46.403667 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-46238103-f982-45e0-94f0-77b7684ce0d9 req-96b3cd02-a056-437b-a9eb-0e7610a4b663 service nova] Creating event network-vif-plugged:fdce9d3d-6208-43e7-9296-22fd6029a735 for instance 7c1f28aa-64fe-4517-88e2-b2e677baea24 on n-h2-852278-4 Aug 27 02:41:46.408720 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-46238103-f982-45e0-94f0-77b7684ce0d9 req-96b3cd02-a056-437b-a9eb-0e7610a4b663 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046163 Aug 27 02:41:46.409897 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 324/623] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:41:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:41:46.415034 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c10e947c-cc9b-44a3-9ae7-3668a8de4cc1 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Calling method '.version_select at 0x7f5ee3542790>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:46.424761 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c10e947c-cc9b-44a3-9ae7-3668a8de4cc1 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:46.425512 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c10e947c-cc9b-44a3-9ae7-3668a8de4cc1 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:46.426111 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c10e947c-cc9b-44a3-9ae7-3668a8de4cc1 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:46.438631 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c10e947c-cc9b-44a3-9ae7-3668a8de4cc1 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:46.439419 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c10e947c-cc9b-44a3-9ae7-3668a8de4cc1 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:46.440004 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c10e947c-cc9b-44a3-9ae7-3668a8de4cc1 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:46.469483 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c10e947c-cc9b-44a3-9ae7-3668a8de4cc1 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] 10.222.0.70 "GET /compute/v2.1/os-simple-tenant-usage/f7a009f79d954838abb0566d86b97f2e?start=2022-08-26T02%3A41%3A45.329927&end=2022-08-28T02%3A41%3A45.329927" status: 200 len: 694 microversion: 2.1 time: 0.047466 Aug 27 02:41:46.472653 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 325/624] 10.222.0.70 () {58 vars in 1412 bytes} [Sat Aug 27 02:41:46 2022] GET /compute/v2.1/os-simple-tenant-usage/f7a009f79d954838abb0566d86b97f2e?start=2022-08-26T02%3A41%3A45.329927&end=2022-08-28T02%3A41%3A45.329927 => generated 694 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:41:46.484658 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-659ccbc4-cb65-4c37-94c7-32258cb94e11 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:46.489791 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-659ccbc4-cb65-4c37-94c7-32258cb94e11 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: 7eded9ca-c7bc-499a-bb53-a28d2c332402] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:46.504698 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-659ccbc4-cb65-4c37-94c7-32258cb94e11 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:46.507409 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-659ccbc4-cb65-4c37-94c7-32258cb94e11 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:46.508110 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-659ccbc4-cb65-4c37-94c7-32258cb94e11 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:46.509122 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-659ccbc4-cb65-4c37-94c7-32258cb94e11 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:46.509809 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-659ccbc4-cb65-4c37-94c7-32258cb94e11 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:46.510626 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-659ccbc4-cb65-4c37-94c7-32258cb94e11 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:46.568033 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=4 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:41:46.709779 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-9e995187-c9da-479a-85d1-470e511d0375 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30abbf3afe304291981a6a9b85952aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c28ddbdb164f01bb82235c6d49717b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:46.729431 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-9e995187-c9da-479a-85d1-470e511d0375 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] 10.222.0.70 "GET /compute/v2.1/servers/ccf87867-fb85-4b52-93f4-283450f636a4" status: 200 len: 1313 microversion: 2.1 time: 0.559366 Aug 27 02:41:46.733101 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 300/625] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:46 2022] GET /compute/v2.1/servers/ccf87867-fb85-4b52-93f4-283450f636a4 => generated 1313 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:46.744915 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-18a8d543-95d1-40bf-9629-be65a151bdd7 tempest-TenantUsagesTestJSON-1309931092 tempest-TenantUsagesTestJSON-1309931092-project-admin] Calling method '.version_select at 0x7f5edf4268b0>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:46.783984 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-18a8d543-95d1-40bf-9629-be65a151bdd7 tempest-TenantUsagesTestJSON-1309931092 tempest-TenantUsagesTestJSON-1309931092-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:46.784525 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-18a8d543-95d1-40bf-9629-be65a151bdd7 tempest-TenantUsagesTestJSON-1309931092 tempest-TenantUsagesTestJSON-1309931092-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:46.784948 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-18a8d543-95d1-40bf-9629-be65a151bdd7 tempest-TenantUsagesTestJSON-1309931092 tempest-TenantUsagesTestJSON-1309931092-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:46.834151 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-18a8d543-95d1-40bf-9629-be65a151bdd7 tempest-TenantUsagesTestJSON-1309931092 tempest-TenantUsagesTestJSON-1309931092-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:46.834848 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-18a8d543-95d1-40bf-9629-be65a151bdd7 tempest-TenantUsagesTestJSON-1309931092 tempest-TenantUsagesTestJSON-1309931092-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:46.835326 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-18a8d543-95d1-40bf-9629-be65a151bdd7 tempest-TenantUsagesTestJSON-1309931092 tempest-TenantUsagesTestJSON-1309931092-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:46.894497 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-18a8d543-95d1-40bf-9629-be65a151bdd7 tempest-TenantUsagesTestJSON-1309931092 tempest-TenantUsagesTestJSON-1309931092-project-admin] 10.222.0.70 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-26T02%3A41%3A45.329927&end=2022-08-28T02%3A41%3A45.329927&detailed=1" status: 200 len: 7042 microversion: 2.1 time: 0.158006 Aug 27 02:41:46.895876 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 301/626] 10.222.0.70 () {58 vars in 1335 bytes} [Sat Aug 27 02:41:46 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-26T02%3A41%3A45.329927&end=2022-08-28T02%3A41%3A45.329927&detailed=1 => generated 7042 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:46.900889 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-bfe0516c-c146-4769-817a-3e3599aa6d1c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:46.908443 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-bfe0516c-c146-4769-817a-3e3599aa6d1c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 14e68153-ad1e-4028-8580-dcb179346f31] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:46.944614 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bfe0516c-c146-4769-817a-3e3599aa6d1c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:46.946213 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bfe0516c-c146-4769-817a-3e3599aa6d1c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:46.946819 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bfe0516c-c146-4769-817a-3e3599aa6d1c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:46.949931 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bfe0516c-c146-4769-817a-3e3599aa6d1c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:46.950422 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bfe0516c-c146-4769-817a-3e3599aa6d1c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:46.950855 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bfe0516c-c146-4769-817a-3e3599aa6d1c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:47.231807 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-bfe0516c-c146-4769-817a-3e3599aa6d1c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:47.242052 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-bfe0516c-c146-4769-817a-3e3599aa6d1c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/14e68153-ad1e-4028-8580-dcb179346f31" status: 200 len: 1271 microversion: 2.1 time: 0.344790 Aug 27 02:41:47.255264 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 302/627] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:46 2022] GET /compute/v2.1/servers/14e68153-ad1e-4028-8580-dcb179346f31 => generated 1271 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:47.261838 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e41aff7e-25da-4db2-b503-4d0efab48fff tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:47.262449 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-e41aff7e-25da-4db2-b503-4d0efab48fff tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] [instance: 50597771-779f-426a-9cdc-17a6f2fb01fd] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:47.269057 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e41aff7e-25da-4db2-b503-4d0efab48fff tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:47.269283 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e41aff7e-25da-4db2-b503-4d0efab48fff tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:47.269553 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e41aff7e-25da-4db2-b503-4d0efab48fff tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:47.270308 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e41aff7e-25da-4db2-b503-4d0efab48fff tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:47.271466 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e41aff7e-25da-4db2-b503-4d0efab48fff tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:47.271466 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e41aff7e-25da-4db2-b503-4d0efab48fff tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:47.295960 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-659ccbc4-cb65-4c37-94c7-32258cb94e11 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:47.305108 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-659ccbc4-cb65-4c37-94c7-32258cb94e11 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:47.306692 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-659ccbc4-cb65-4c37-94c7-32258cb94e11 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:47.307961 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-659ccbc4-cb65-4c37-94c7-32258cb94e11 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/7eded9ca-c7bc-499a-bb53-a28d2c332402" status: 200 len: 1410 microversion: 2.25 time: 0.834074 Aug 27 02:41:47.320808 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 326/628] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:41:46 2022] GET /compute/v2.1/servers/7eded9ca-c7bc-499a-bb53-a28d2c332402 => generated 1410 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:41:47.328291 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a5af4915-ea9f-4b37-bd10-ab7557f48301 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:47.328965 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a5af4915-ea9f-4b37-bd10-ab7557f48301 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] [instance: 2e8baa0f-02cd-43f0-8919-e9bfbe6f1d01] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:47.335365 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a5af4915-ea9f-4b37-bd10-ab7557f48301 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:47.335933 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a5af4915-ea9f-4b37-bd10-ab7557f48301 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:47.336476 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a5af4915-ea9f-4b37-bd10-ab7557f48301 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:47.337247 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a5af4915-ea9f-4b37-bd10-ab7557f48301 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:47.337895 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a5af4915-ea9f-4b37-bd10-ab7557f48301 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:47.338366 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a5af4915-ea9f-4b37-bd10-ab7557f48301 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:47.373180 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a5af4915-ea9f-4b37-bd10-ab7557f48301 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] [instance: 2e8baa0f-02cd-43f0-8919-e9bfbe6f1d01] Going to try to terminate instance {{(pid=134052) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:41:47.439328 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:41:47.467056 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e41aff7e-25da-4db2-b503-4d0efab48fff tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb3ac70d5084c9c826b5722e5302ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25afdc85b9aa4c86bd4f8e2e4a22ff3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:47.483246 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e41aff7e-25da-4db2-b503-4d0efab48fff tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] 10.222.0.70 "GET /compute/v2.1/servers/50597771-779f-426a-9cdc-17a6f2fb01fd" status: 200 len: 1321 microversion: 2.1 time: 0.236244 Aug 27 02:41:47.484204 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 303/629] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:47 2022] GET /compute/v2.1/servers/50597771-779f-426a-9cdc-17a6f2fb01fd => generated 1321 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:47.489347 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-d3804a7a-db74-46ff-90ad-b936c4e8edd1 req-f6db96a9-edae-42cc-828d-cbafba589377 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7eded9ca-c7bc-499a-bb53-a28d2c332402", "tag": "e0130326-860c-4234-8b0f-db61efc2a95a"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:41:47.501240 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-d3804a7a-db74-46ff-90ad-b936c4e8edd1 req-f6db96a9-edae-42cc-828d-cbafba589377 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:47.502464 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-d3804a7a-db74-46ff-90ad-b936c4e8edd1 req-f6db96a9-edae-42cc-828d-cbafba589377 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:47.503155 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-d3804a7a-db74-46ff-90ad-b936c4e8edd1 req-f6db96a9-edae-42cc-828d-cbafba589377 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:47.518873 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a5af4915-ea9f-4b37-bd10-ab7557f48301 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] 10.222.0.70 "DELETE /compute/v2.1/servers/2e8baa0f-02cd-43f0-8919-e9bfbe6f1d01" status: 204 len: 0 microversion: 2.1 time: 0.196552 Aug 27 02:41:47.519406 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-d3804a7a-db74-46ff-90ad-b936c4e8edd1 req-f6db96a9-edae-42cc-828d-cbafba589377 service nova] Creating event network-changed:e0130326-860c-4234-8b0f-db61efc2a95a for instance 7eded9ca-c7bc-499a-bb53-a28d2c332402 on n-h1-852278-4 Aug 27 02:41:47.519532 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 327/630] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:41:47 2022] DELETE /compute/v2.1/servers/2e8baa0f-02cd-43f0-8919-e9bfbe6f1d01 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:41:47.529614 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-d3804a7a-db74-46ff-90ad-b936c4e8edd1 req-f6db96a9-edae-42cc-828d-cbafba589377 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043730 Aug 27 02:41:47.531420 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 304/631] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:41:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:41:47.537316 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c424377e-0558-461f-a0df-62121a2e04a0 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:47.539599 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-c424377e-0558-461f-a0df-62121a2e04a0 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] [instance: 2e8baa0f-02cd-43f0-8919-e9bfbe6f1d01] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:47.544449 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f4658753-ff08-4d5b-b63d-4ab17d97a542 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:47.545492 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-f4658753-ff08-4d5b-b63d-4ab17d97a542 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] [instance: 7c1f28aa-64fe-4517-88e2-b2e677baea24] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:47.558187 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c424377e-0558-461f-a0df-62121a2e04a0 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:47.558406 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f4658753-ff08-4d5b-b63d-4ab17d97a542 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:47.558750 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f4658753-ff08-4d5b-b63d-4ab17d97a542 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:47.560600 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c424377e-0558-461f-a0df-62121a2e04a0 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:47.561518 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c424377e-0558-461f-a0df-62121a2e04a0 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:47.563781 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c424377e-0558-461f-a0df-62121a2e04a0 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:47.564664 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c424377e-0558-461f-a0df-62121a2e04a0 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:47.564936 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f4658753-ff08-4d5b-b63d-4ab17d97a542 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:47.565856 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f4658753-ff08-4d5b-b63d-4ab17d97a542 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:47.566630 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c424377e-0558-461f-a0df-62121a2e04a0 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:47.570884 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f4658753-ff08-4d5b-b63d-4ab17d97a542 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:47.571948 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f4658753-ff08-4d5b-b63d-4ab17d97a542 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:47.896806 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-f4658753-ff08-4d5b-b63d-4ab17d97a542 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c850104e6d430397bb54d0e3730a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72992d9dba564526b223533398a94dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:47.915039 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f4658753-ff08-4d5b-b63d-4ab17d97a542 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] 10.222.0.70 "GET /compute/v2.1/servers/7c1f28aa-64fe-4517-88e2-b2e677baea24" status: 200 len: 1388 microversion: 2.1 time: 0.387327 Aug 27 02:41:47.916985 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 328/632] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:47 2022] GET /compute/v2.1/servers/7c1f28aa-64fe-4517-88e2-b2e677baea24 => generated 1388 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:47.940072 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-1be277fd-045c-477d-85ab-d1719584c2db tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:47.940398 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-c424377e-0558-461f-a0df-62121a2e04a0 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2ff9f8745c4dda8b04fbeb95d9988a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a009f79d954838abb0566d86b97f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:47.943882 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-1be277fd-045c-477d-85ab-d1719584c2db tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] [instance: ccf87867-fb85-4b52-93f4-283450f636a4] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:47.949367 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c424377e-0558-461f-a0df-62121a2e04a0 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] 10.222.0.70 "GET /compute/v2.1/servers/2e8baa0f-02cd-43f0-8919-e9bfbe6f1d01" status: 200 len: 1469 microversion: 2.1 time: 0.416326 Aug 27 02:41:47.950206 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 305/633] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:47 2022] GET /compute/v2.1/servers/2e8baa0f-02cd-43f0-8919-e9bfbe6f1d01 => generated 1469 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:47.964254 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1be277fd-045c-477d-85ab-d1719584c2db tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:47.964254 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1be277fd-045c-477d-85ab-d1719584c2db tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:47.964254 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1be277fd-045c-477d-85ab-d1719584c2db tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:47.964254 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1be277fd-045c-477d-85ab-d1719584c2db tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:47.964644 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1be277fd-045c-477d-85ab-d1719584c2db tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:47.964644 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1be277fd-045c-477d-85ab-d1719584c2db tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:48.131102 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-1be277fd-045c-477d-85ab-d1719584c2db tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30abbf3afe304291981a6a9b85952aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c28ddbdb164f01bb82235c6d49717b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:48.148837 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-1be277fd-045c-477d-85ab-d1719584c2db tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] 10.222.0.70 "GET /compute/v2.1/servers/ccf87867-fb85-4b52-93f4-283450f636a4" status: 200 len: 1313 microversion: 2.1 time: 0.221354 Aug 27 02:41:48.149652 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 329/634] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:47 2022] GET /compute/v2.1/servers/ccf87867-fb85-4b52-93f4-283450f636a4 => generated 1313 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:48.263028 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-be07b0c2-a70b-4fbb-b89b-24718b1f10ab tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:48.263655 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-be07b0c2-a70b-4fbb-b89b-24718b1f10ab tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 14e68153-ad1e-4028-8580-dcb179346f31] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:48.325869 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-be07b0c2-a70b-4fbb-b89b-24718b1f10ab tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:48.326394 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-be07b0c2-a70b-4fbb-b89b-24718b1f10ab tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:48.326952 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-be07b0c2-a70b-4fbb-b89b-24718b1f10ab tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:48.333648 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-fac008b8-7e3a-4fbc-9c6b-8057c70196b4 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:48.334248 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-fac008b8-7e3a-4fbc-9c6b-8057c70196b4 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: 7eded9ca-c7bc-499a-bb53-a28d2c332402] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:48.338057 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-be07b0c2-a70b-4fbb-b89b-24718b1f10ab tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:48.341497 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fac008b8-7e3a-4fbc-9c6b-8057c70196b4 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:48.342335 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-be07b0c2-a70b-4fbb-b89b-24718b1f10ab tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:48.342996 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-be07b0c2-a70b-4fbb-b89b-24718b1f10ab tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:48.347291 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fac008b8-7e3a-4fbc-9c6b-8057c70196b4 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:48.350340 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fac008b8-7e3a-4fbc-9c6b-8057c70196b4 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:48.351987 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fac008b8-7e3a-4fbc-9c6b-8057c70196b4 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:48.353673 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fac008b8-7e3a-4fbc-9c6b-8057c70196b4 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:48.354307 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fac008b8-7e3a-4fbc-9c6b-8057c70196b4 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:48.381085 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=100 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:41:48.538983 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-be07b0c2-a70b-4fbb-b89b-24718b1f10ab tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:48.561304 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-be07b0c2-a70b-4fbb-b89b-24718b1f10ab tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/14e68153-ad1e-4028-8580-dcb179346f31" status: 200 len: 1269 microversion: 2.1 time: 0.300919 Aug 27 02:41:48.563637 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 306/635] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:48 2022] GET /compute/v2.1/servers/14e68153-ad1e-4028-8580-dcb179346f31 => generated 1269 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:48.579868 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-1a5ca2ba-420a-4a71-899f-a409a13e6d18 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:48.580646 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-1a5ca2ba-420a-4a71-899f-a409a13e6d18 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] [instance: 50597771-779f-426a-9cdc-17a6f2fb01fd] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:48.587525 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1a5ca2ba-420a-4a71-899f-a409a13e6d18 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:48.588354 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1a5ca2ba-420a-4a71-899f-a409a13e6d18 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:48.588986 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1a5ca2ba-420a-4a71-899f-a409a13e6d18 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:48.589915 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1a5ca2ba-420a-4a71-899f-a409a13e6d18 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:48.590568 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1a5ca2ba-420a-4a71-899f-a409a13e6d18 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:48.591205 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1a5ca2ba-420a-4a71-899f-a409a13e6d18 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:48.734703 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-fac008b8-7e3a-4fbc-9c6b-8057c70196b4 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:48.748594 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-fac008b8-7e3a-4fbc-9c6b-8057c70196b4 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:48.750498 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-fac008b8-7e3a-4fbc-9c6b-8057c70196b4 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:48.757148 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-fac008b8-7e3a-4fbc-9c6b-8057c70196b4 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/7eded9ca-c7bc-499a-bb53-a28d2c332402" status: 200 len: 1410 microversion: 2.25 time: 0.427069 Aug 27 02:41:48.759918 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 330/636] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:41:48 2022] GET /compute/v2.1/servers/7eded9ca-c7bc-499a-bb53-a28d2c332402 => generated 1410 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:41:48.906455 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-1a5ca2ba-420a-4a71-899f-a409a13e6d18 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb3ac70d5084c9c826b5722e5302ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25afdc85b9aa4c86bd4f8e2e4a22ff3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:48.915873 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-1a5ca2ba-420a-4a71-899f-a409a13e6d18 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] 10.222.0.70 "GET /compute/v2.1/servers/50597771-779f-426a-9cdc-17a6f2fb01fd" status: 200 len: 1321 microversion: 2.1 time: 0.350529 Aug 27 02:41:48.924674 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 307/637] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:48 2022] GET /compute/v2.1/servers/50597771-779f-426a-9cdc-17a6f2fb01fd => generated 1321 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:48.938573 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-27825962-2967-4a96-ace3-c351b19e39e3 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:48.939189 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-27825962-2967-4a96-ace3-c351b19e39e3 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] [instance: 7c1f28aa-64fe-4517-88e2-b2e677baea24] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:48.946469 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-27825962-2967-4a96-ace3-c351b19e39e3 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:48.947017 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-27825962-2967-4a96-ace3-c351b19e39e3 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:48.963072 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-27825962-2967-4a96-ace3-c351b19e39e3 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:48.964173 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-27825962-2967-4a96-ace3-c351b19e39e3 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:48.971109 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-afd78d56-4b78-4c15-bb15-e6196f043032 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:48.971956 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-afd78d56-4b78-4c15-bb15-e6196f043032 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] [instance: 2e8baa0f-02cd-43f0-8919-e9bfbe6f1d01] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:48.977080 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-27825962-2967-4a96-ace3-c351b19e39e3 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:48.977554 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-27825962-2967-4a96-ace3-c351b19e39e3 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:48.990682 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-afd78d56-4b78-4c15-bb15-e6196f043032 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:48.991187 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-afd78d56-4b78-4c15-bb15-e6196f043032 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:48.991652 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-afd78d56-4b78-4c15-bb15-e6196f043032 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:48.992344 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-afd78d56-4b78-4c15-bb15-e6196f043032 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:48.992795 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-afd78d56-4b78-4c15-bb15-e6196f043032 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:48.993281 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-afd78d56-4b78-4c15-bb15-e6196f043032 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:49.382339 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-afd78d56-4b78-4c15-bb15-e6196f043032 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2ff9f8745c4dda8b04fbeb95d9988a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a009f79d954838abb0566d86b97f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:49.409030 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-27825962-2967-4a96-ace3-c351b19e39e3 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c850104e6d430397bb54d0e3730a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72992d9dba564526b223533398a94dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:49.413650 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-afd78d56-4b78-4c15-bb15-e6196f043032 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] 10.222.0.70 "GET /compute/v2.1/servers/2e8baa0f-02cd-43f0-8919-e9bfbe6f1d01" status: 200 len: 1469 microversion: 2.1 time: 0.446332 Aug 27 02:41:49.429790 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-27825962-2967-4a96-ace3-c351b19e39e3 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] 10.222.0.70 "GET /compute/v2.1/servers/7c1f28aa-64fe-4517-88e2-b2e677baea24" status: 200 len: 1586 microversion: 2.1 time: 0.490960 Aug 27 02:41:49.445046 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 331/638] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:48 2022] GET /compute/v2.1/servers/7c1f28aa-64fe-4517-88e2-b2e677baea24 => generated 1586 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:49.445268 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 308/639] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:48 2022] GET /compute/v2.1/servers/2e8baa0f-02cd-43f0-8919-e9bfbe6f1d01 => generated 1469 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:41:49.449712 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-fb0d93f6-32be-4575-a516-007dfcaf4fda tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:49.450021 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7e6792a1-085f-49af-844a-5676e0bb6bcc tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:49.450318 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-fb0d93f6-32be-4575-a516-007dfcaf4fda tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] [instance: ccf87867-fb85-4b52-93f4-283450f636a4] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:49.450501 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-7e6792a1-085f-49af-844a-5676e0bb6bcc tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] [instance: 7c1f28aa-64fe-4517-88e2-b2e677baea24] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:49.465989 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7e6792a1-085f-49af-844a-5676e0bb6bcc tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:49.468068 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fb0d93f6-32be-4575-a516-007dfcaf4fda tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:49.468735 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fb0d93f6-32be-4575-a516-007dfcaf4fda tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:49.469283 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7e6792a1-085f-49af-844a-5676e0bb6bcc tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:49.469541 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fb0d93f6-32be-4575-a516-007dfcaf4fda tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:49.469744 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7e6792a1-085f-49af-844a-5676e0bb6bcc tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:49.470493 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7e6792a1-085f-49af-844a-5676e0bb6bcc tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:49.470781 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fb0d93f6-32be-4575-a516-007dfcaf4fda tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:49.470915 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7e6792a1-085f-49af-844a-5676e0bb6bcc tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:49.471329 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7e6792a1-085f-49af-844a-5676e0bb6bcc tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:49.471749 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fb0d93f6-32be-4575-a516-007dfcaf4fda tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:49.473168 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fb0d93f6-32be-4575-a516-007dfcaf4fda tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:50.156551 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-7e6792a1-085f-49af-844a-5676e0bb6bcc tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] 10.222.0.70 "GET /compute/v2.1/servers/7c1f28aa-64fe-4517-88e2-b2e677baea24/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.710228 Aug 27 02:41:50.157916 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 309/640] 10.222.0.70 () {58 vars in 1275 bytes} [Sat Aug 27 02:41:49 2022] GET /compute/v2.1/servers/7c1f28aa-64fe-4517-88e2-b2e677baea24/os-interface => generated 284 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:41:50.170480 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-eb91a47f-8fb8-4a2f-bcbf-d1de5f18df6f tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:50.171267 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-eb91a47f-8fb8-4a2f-bcbf-d1de5f18df6f tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 14e68153-ad1e-4028-8580-dcb179346f31] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:50.182456 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eb91a47f-8fb8-4a2f-bcbf-d1de5f18df6f tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:50.183146 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eb91a47f-8fb8-4a2f-bcbf-d1de5f18df6f tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:50.183742 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eb91a47f-8fb8-4a2f-bcbf-d1de5f18df6f tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:50.185756 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eb91a47f-8fb8-4a2f-bcbf-d1de5f18df6f tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:50.187234 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eb91a47f-8fb8-4a2f-bcbf-d1de5f18df6f tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:50.194151 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eb91a47f-8fb8-4a2f-bcbf-d1de5f18df6f tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:50.318228 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-fb0d93f6-32be-4575-a516-007dfcaf4fda tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30abbf3afe304291981a6a9b85952aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c28ddbdb164f01bb82235c6d49717b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:50.330789 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-fb0d93f6-32be-4575-a516-007dfcaf4fda tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] 10.222.0.70 "GET /compute/v2.1/servers/ccf87867-fb85-4b52-93f4-283450f636a4" status: 200 len: 1313 microversion: 2.1 time: 0.884795 Aug 27 02:41:50.332757 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 332/641] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:49 2022] GET /compute/v2.1/servers/ccf87867-fb85-4b52-93f4-283450f636a4 => generated 1313 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:50.347945 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e59ca31c-53a0-4f1e-9032-1e7da8857e04 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:50.354320 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-e59ca31c-53a0-4f1e-9032-1e7da8857e04 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: 7eded9ca-c7bc-499a-bb53-a28d2c332402] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:50.371757 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e59ca31c-53a0-4f1e-9032-1e7da8857e04 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:50.372507 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e59ca31c-53a0-4f1e-9032-1e7da8857e04 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:50.373124 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e59ca31c-53a0-4f1e-9032-1e7da8857e04 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:50.373854 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e59ca31c-53a0-4f1e-9032-1e7da8857e04 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:50.374308 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e59ca31c-53a0-4f1e-9032-1e7da8857e04 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:50.374731 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e59ca31c-53a0-4f1e-9032-1e7da8857e04 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:50.839919 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-eb91a47f-8fb8-4a2f-bcbf-d1de5f18df6f tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:50.851554 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-eb91a47f-8fb8-4a2f-bcbf-d1de5f18df6f tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/14e68153-ad1e-4028-8580-dcb179346f31" status: 200 len: 1311 microversion: 2.1 time: 0.692293 Aug 27 02:41:50.852666 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 310/642] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:50 2022] GET /compute/v2.1/servers/14e68153-ad1e-4028-8580-dcb179346f31 => generated 1311 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:50.862931 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-35d95fbf-062c-485f-931e-ceb8c06e5c34 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:50.867208 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-35d95fbf-062c-485f-931e-ceb8c06e5c34 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] [instance: 50597771-779f-426a-9cdc-17a6f2fb01fd] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:50.877118 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-35d95fbf-062c-485f-931e-ceb8c06e5c34 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:50.877945 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-35d95fbf-062c-485f-931e-ceb8c06e5c34 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:50.878617 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-35d95fbf-062c-485f-931e-ceb8c06e5c34 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:50.880231 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-35d95fbf-062c-485f-931e-ceb8c06e5c34 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:50.880983 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-35d95fbf-062c-485f-931e-ceb8c06e5c34 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:50.881678 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-35d95fbf-062c-485f-931e-ceb8c06e5c34 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:50.891696 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-e59ca31c-53a0-4f1e-9032-1e7da8857e04 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:50.907270 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-e59ca31c-53a0-4f1e-9032-1e7da8857e04 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:50.909762 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-e59ca31c-53a0-4f1e-9032-1e7da8857e04 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:50.911799 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e59ca31c-53a0-4f1e-9032-1e7da8857e04 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/7eded9ca-c7bc-499a-bb53-a28d2c332402" status: 200 len: 1410 microversion: 2.25 time: 0.577766 Aug 27 02:41:50.914068 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 333/643] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:41:50 2022] GET /compute/v2.1/servers/7eded9ca-c7bc-499a-bb53-a28d2c332402 => generated 1410 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:41:50.921886 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-1aac7565-ca45-4536-8d47-072aad331dcb req-30a173a3-a031-4c04-a4a2-34af65f4fc90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccf87867-fb85-4b52-93f4-283450f636a4", "name": "network-vif-plugged", "status": "completed", "tag": "457ff7f9-caf8-461a-a54b-310371560c75"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:41:50.932221 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-1aac7565-ca45-4536-8d47-072aad331dcb req-30a173a3-a031-4c04-a4a2-34af65f4fc90 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:50.933038 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-1aac7565-ca45-4536-8d47-072aad331dcb req-30a173a3-a031-4c04-a4a2-34af65f4fc90 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:50.933655 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-1aac7565-ca45-4536-8d47-072aad331dcb req-30a173a3-a031-4c04-a4a2-34af65f4fc90 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:50.949471 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-1aac7565-ca45-4536-8d47-072aad331dcb req-30a173a3-a031-4c04-a4a2-34af65f4fc90 service nova] Creating event network-vif-plugged:457ff7f9-caf8-461a-a54b-310371560c75 for instance ccf87867-fb85-4b52-93f4-283450f636a4 on n-h2-852278-4 Aug 27 02:41:50.956158 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-1aac7565-ca45-4536-8d47-072aad331dcb req-30a173a3-a031-4c04-a4a2-34af65f4fc90 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037633 Aug 27 02:41:50.957579 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 334/644] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:41:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:41:50.964280 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-22398e9a-3d43-4b0e-b263-2536420d11ec tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:50.965285 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-22398e9a-3d43-4b0e-b263-2536420d11ec tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] [instance: 2e8baa0f-02cd-43f0-8919-e9bfbe6f1d01] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:50.973149 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-22398e9a-3d43-4b0e-b263-2536420d11ec tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:50.989215 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-22398e9a-3d43-4b0e-b263-2536420d11ec tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:50.990055 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-22398e9a-3d43-4b0e-b263-2536420d11ec tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:51.005860 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-22398e9a-3d43-4b0e-b263-2536420d11ec tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:51.008211 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-22398e9a-3d43-4b0e-b263-2536420d11ec tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:51.009317 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-22398e9a-3d43-4b0e-b263-2536420d11ec tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:51.357855 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-35d95fbf-062c-485f-931e-ceb8c06e5c34 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb3ac70d5084c9c826b5722e5302ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25afdc85b9aa4c86bd4f8e2e4a22ff3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:51.367064 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-35d95fbf-062c-485f-931e-ceb8c06e5c34 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] 10.222.0.70 "GET /compute/v2.1/servers/50597771-779f-426a-9cdc-17a6f2fb01fd" status: 200 len: 1321 microversion: 2.1 time: 0.512572 Aug 27 02:41:51.370658 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 311/645] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:50 2022] GET /compute/v2.1/servers/50597771-779f-426a-9cdc-17a6f2fb01fd => generated 1321 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:51.378980 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4393ad26-2966-4197-bd65-d831fee5400d tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:51.386745 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-4393ad26-2966-4197-bd65-d831fee5400d tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] [instance: ccf87867-fb85-4b52-93f4-283450f636a4] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:51.398341 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4393ad26-2966-4197-bd65-d831fee5400d tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:51.402828 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4393ad26-2966-4197-bd65-d831fee5400d tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:51.403296 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4393ad26-2966-4197-bd65-d831fee5400d tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:51.404079 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4393ad26-2966-4197-bd65-d831fee5400d tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:51.406992 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4393ad26-2966-4197-bd65-d831fee5400d tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:51.407466 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4393ad26-2966-4197-bd65-d831fee5400d tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:51.570195 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-22398e9a-3d43-4b0e-b263-2536420d11ec tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2ff9f8745c4dda8b04fbeb95d9988a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a009f79d954838abb0566d86b97f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:51.580366 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-22398e9a-3d43-4b0e-b263-2536420d11ec tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] 10.222.0.70 "GET /compute/v2.1/servers/2e8baa0f-02cd-43f0-8919-e9bfbe6f1d01" status: 200 len: 1469 microversion: 2.1 time: 0.621310 Aug 27 02:41:51.581453 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 335/646] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:50 2022] GET /compute/v2.1/servers/2e8baa0f-02cd-43f0-8919-e9bfbe6f1d01 => generated 1469 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:51.797770 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-4393ad26-2966-4197-bd65-d831fee5400d tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30abbf3afe304291981a6a9b85952aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c28ddbdb164f01bb82235c6d49717b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:51.840813 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-4393ad26-2966-4197-bd65-d831fee5400d tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] 10.222.0.70 "GET /compute/v2.1/servers/ccf87867-fb85-4b52-93f4-283450f636a4" status: 200 len: 1313 microversion: 2.1 time: 0.460918 Aug 27 02:41:51.859441 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 312/647] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:51 2022] GET /compute/v2.1/servers/ccf87867-fb85-4b52-93f4-283450f636a4 => generated 1313 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:51.872331 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a8dc3418-5b9e-4797-af66-1b5b2dc5501e tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:51.873588 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a8dc3418-5b9e-4797-af66-1b5b2dc5501e tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 14e68153-ad1e-4028-8580-dcb179346f31] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:51.883462 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a8dc3418-5b9e-4797-af66-1b5b2dc5501e tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:51.885103 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a8dc3418-5b9e-4797-af66-1b5b2dc5501e tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:51.885908 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a8dc3418-5b9e-4797-af66-1b5b2dc5501e tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:51.886863 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a8dc3418-5b9e-4797-af66-1b5b2dc5501e tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:51.887642 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a8dc3418-5b9e-4797-af66-1b5b2dc5501e tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:51.890906 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a8dc3418-5b9e-4797-af66-1b5b2dc5501e tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:51.953130 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-9651b2f3-64e5-4c11-9a9e-f08014c0c69c tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:51.953742 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-9651b2f3-64e5-4c11-9a9e-f08014c0c69c tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: 7eded9ca-c7bc-499a-bb53-a28d2c332402] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:51.962069 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9651b2f3-64e5-4c11-9a9e-f08014c0c69c tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:51.962815 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9651b2f3-64e5-4c11-9a9e-f08014c0c69c tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:51.963432 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9651b2f3-64e5-4c11-9a9e-f08014c0c69c tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:51.964336 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9651b2f3-64e5-4c11-9a9e-f08014c0c69c tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:51.964949 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9651b2f3-64e5-4c11-9a9e-f08014c0c69c tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:51.965358 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9651b2f3-64e5-4c11-9a9e-f08014c0c69c tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:52.269092 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-a8dc3418-5b9e-4797-af66-1b5b2dc5501e tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:52.292633 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-9651b2f3-64e5-4c11-9a9e-f08014c0c69c tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:52.307143 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a8dc3418-5b9e-4797-af66-1b5b2dc5501e tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/14e68153-ad1e-4028-8580-dcb179346f31" status: 200 len: 1311 microversion: 2.1 time: 0.438601 Aug 27 02:41:52.307775 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 336/648] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:51 2022] GET /compute/v2.1/servers/14e68153-ad1e-4028-8580-dcb179346f31 => generated 1311 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:52.309651 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-9651b2f3-64e5-4c11-9a9e-f08014c0c69c tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:52.311090 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-9651b2f3-64e5-4c11-9a9e-f08014c0c69c tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:52.312350 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-9651b2f3-64e5-4c11-9a9e-f08014c0c69c tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/7eded9ca-c7bc-499a-bb53-a28d2c332402" status: 200 len: 1410 microversion: 2.25 time: 0.375612 Aug 27 02:41:52.312908 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 313/649] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:41:51 2022] GET /compute/v2.1/servers/7eded9ca-c7bc-499a-bb53-a28d2c332402 => generated 1410 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:41:52.391082 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-241f4fcb-157a-4f4d-b3bf-7f730861e5ae tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:52.391671 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-241f4fcb-157a-4f4d-b3bf-7f730861e5ae tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] [instance: 50597771-779f-426a-9cdc-17a6f2fb01fd] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:52.400072 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-241f4fcb-157a-4f4d-b3bf-7f730861e5ae tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:52.400822 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-241f4fcb-157a-4f4d-b3bf-7f730861e5ae tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:52.401629 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-241f4fcb-157a-4f4d-b3bf-7f730861e5ae tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:52.402600 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-241f4fcb-157a-4f4d-b3bf-7f730861e5ae tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:52.403197 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-241f4fcb-157a-4f4d-b3bf-7f730861e5ae tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:52.403783 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-241f4fcb-157a-4f4d-b3bf-7f730861e5ae tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:52.602328 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-73378749-0afa-4c58-a8da-6a18f6a7814c tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:52.603832 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-73378749-0afa-4c58-a8da-6a18f6a7814c tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] [instance: 2e8baa0f-02cd-43f0-8919-e9bfbe6f1d01] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:52.611288 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-73378749-0afa-4c58-a8da-6a18f6a7814c tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:52.612081 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-73378749-0afa-4c58-a8da-6a18f6a7814c tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:52.612770 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-73378749-0afa-4c58-a8da-6a18f6a7814c tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:52.614089 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-73378749-0afa-4c58-a8da-6a18f6a7814c tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:52.614715 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-73378749-0afa-4c58-a8da-6a18f6a7814c tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:52.615314 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-73378749-0afa-4c58-a8da-6a18f6a7814c tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:53.082428 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-241f4fcb-157a-4f4d-b3bf-7f730861e5ae tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb3ac70d5084c9c826b5722e5302ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25afdc85b9aa4c86bd4f8e2e4a22ff3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:53.090510 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-241f4fcb-157a-4f4d-b3bf-7f730861e5ae tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] 10.222.0.70 "GET /compute/v2.1/servers/50597771-779f-426a-9cdc-17a6f2fb01fd" status: 200 len: 1321 microversion: 2.1 time: 0.703232 Aug 27 02:41:53.104233 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 337/650] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:52 2022] GET /compute/v2.1/servers/50597771-779f-426a-9cdc-17a6f2fb01fd => generated 1321 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:53.109692 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d3511f72-4eec-4e85-af30-4bb2ba24919a tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:53.110560 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d3511f72-4eec-4e85-af30-4bb2ba24919a tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] [instance: ccf87867-fb85-4b52-93f4-283450f636a4] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:53.117360 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d3511f72-4eec-4e85-af30-4bb2ba24919a tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:53.118182 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d3511f72-4eec-4e85-af30-4bb2ba24919a tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:53.118775 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d3511f72-4eec-4e85-af30-4bb2ba24919a tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:53.119646 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d3511f72-4eec-4e85-af30-4bb2ba24919a tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:53.120298 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d3511f72-4eec-4e85-af30-4bb2ba24919a tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:53.120903 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d3511f72-4eec-4e85-af30-4bb2ba24919a tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:53.150276 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-73378749-0afa-4c58-a8da-6a18f6a7814c tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2ff9f8745c4dda8b04fbeb95d9988a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a009f79d954838abb0566d86b97f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:53.164383 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-73378749-0afa-4c58-a8da-6a18f6a7814c tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] 10.222.0.70 "GET /compute/v2.1/servers/2e8baa0f-02cd-43f0-8919-e9bfbe6f1d01" status: 200 len: 1469 microversion: 2.1 time: 0.565943 Aug 27 02:41:53.165622 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 314/651] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:52 2022] GET /compute/v2.1/servers/2e8baa0f-02cd-43f0-8919-e9bfbe6f1d01 => generated 1469 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:41:53.239408 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e84b08e8-a934-4692-8c55-8f11eae5f03d tempest-FloatingIPDetailsNegativeTestJSON-1005200227 tempest-FloatingIPDetailsNegativeTestJSON-1005200227-project] Calling method '.version_select at 0x7f5edf384ca0>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:53.320596 n-d-852278-4 devstack@n-api.service[134051]: DEBUG neutronclient.v2_0.client [None req-e84b08e8-a934-4692-8c55-8f11eae5f03d tempest-FloatingIPDetailsNegativeTestJSON-1005200227 tempest-FloatingIPDetailsNegativeTestJSON-1005200227-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP f9a5d6a8-ed70-4bf9-bb66-290ddb2ca0cd could not be found", "detail": ""}} {{(pid=134051) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 02:41:53.323180 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-e84b08e8-a934-4692-8c55-8f11eae5f03d tempest-FloatingIPDetailsNegativeTestJSON-1005200227 tempest-FloatingIPDetailsNegativeTestJSON-1005200227-project] HTTP exception thrown: Floating IP not found for ID f9a5d6a8-ed70-4bf9-bb66-290ddb2ca0cd Aug 27 02:41:53.348643 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e84b08e8-a934-4692-8c55-8f11eae5f03d tempest-FloatingIPDetailsNegativeTestJSON-1005200227 tempest-FloatingIPDetailsNegativeTestJSON-1005200227-project] Request method failure captured: Aug 27 02:41:53.348643 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/os-floating-ips/f9a5d6a8-ed70-4bf9-bb66-290ddb2ca0cd HTTP/1.1 Aug 27 02:41:53.348643 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:41:53.348643 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:41:53.348643 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:41:53.348643 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:41:53.348643 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:41:53.348643 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:41:53.348643 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:41:53.348643 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:41:53.348643 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYRwO4tuMBSfqOUjligHA6_9KEgTZIpAT5jcibHCxT0nJlEXTOguQLhN-mdm8HAu_BK6OMrhYpzebccQA7H-C9ICHgGdu5TWS5ORFPkSjgRpG6s8PMVQ_pItLbgWeqkcfnCJ74n3t0FqFzdv1_6-UPkIJA_pGz78jVDsJH6_dNSvJDk Aug 27 02:41:53.348643 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:41:53.348643 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:41:53.348643 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:41:53.348643 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:41:53.348643 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:41:53.348643 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:41:53.348643 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: bc5dea6c57934de48c156fda6baf25ef Aug 27 02:41:53.348643 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-1005200227 Aug 27 02:41:53.348643 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:41:53.348643 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:41:53.350154 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/bc5dea6c57934de48c156fda6baf25ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_bc5dea6c57934de48c156fda6baf25ef", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/bc5dea6c57934de48c156fda6baf25ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/bc5dea6c57934de48c156fda6baf25ef"}]}] Aug 27 02:41:53.350154 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-1005200227 Aug 27 02:41:53.350154 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: bc5dea6c57934de48c156fda6baf25ef Aug 27 02:41:53.350154 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-1005200227 Aug 27 02:41:53.350154 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-1005200227-project Aug 27 02:41:53.350154 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:41:53.350154 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:41:53.350154 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 65195e1acb734109a057fae70f419391 Aug 27 02:41:53.350154 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-1005200227-project Aug 27 02:41:53.350154 n-d-852278-4 devstack@n-api.service[134051]: method: Aug 27 02:41:53.350154 n-d-852278-4 devstack@n-api.service[134051]: exception: Floating IP not found for ID f9a5d6a8-ed70-4bf9-bb66-290ddb2ca0cd Aug 27 02:41:53.350154 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': 'f9a5d6a8-ed70-4bf9-bb66-290ddb2ca0cd'} Aug 27 02:41:53.350912 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:41:53.350912 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:41:53.350912 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 27 02:41:53.350912 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 27 02:41:53.350912 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:41:53.350912 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:41:53.350912 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 27 02:41:53.350912 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 27 02:41:53.350912 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:41:53.350912 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:41:53.350912 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 02:41:53.350912 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 02:41:53.350912 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:41:53.350912 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:41:53.350912 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 02:41:53.350912 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 02:41:53.350912 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:41:53.350912 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:41:53.350912 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 02:41:53.352019 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 02:41:53.352019 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:41:53.352019 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:41:53.352019 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 02:41:53.352019 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 02:41:53.352019 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 02:41:53.352019 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 02:41:53.352019 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP f9a5d6a8-ed70-4bf9-bb66-290ddb2ca0cd could not be found Aug 27 02:41:53.352019 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ef311c35-7723-4d87-91be-f21888be17eb'] Aug 27 02:41:53.352019 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:41:53.352019 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:41:53.352019 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:41:53.352019 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:41:53.352019 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Aug 27 02:41:53.352019 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 27 02:41:53.352019 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 27 02:41:53.352019 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 27 02:41:53.352019 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID f9a5d6a8-ed70-4bf9-bb66-290ddb2ca0cd. Aug 27 02:41:53.352019 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:41:53.355998 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:41:53.355998 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:41:53.355998 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:41:53.355998 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:41:53.355998 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:41:53.355998 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:41:53.355998 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:41:53.355998 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:41:53.355998 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:41:53.355998 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:41:53.355998 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:41:53.355998 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Aug 27 02:41:53.355998 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 27 02:41:53.355998 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID f9a5d6a8-ed70-4bf9-bb66-290ddb2ca0cd Aug 27 02:41:53.355998 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:41:53.355998 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:41:53.355998 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:41:53.355998 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:41:53.355998 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:41:53.355998 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:41:53.355998 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:41:53.359832 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:41:53.359832 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID f9a5d6a8-ed70-4bf9-bb66-290ddb2ca0cd Aug 27 02:41:53.359832 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:41:53.359832 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e84b08e8-a934-4692-8c55-8f11eae5f03d tempest-FloatingIPDetailsNegativeTestJSON-1005200227 tempest-FloatingIPDetailsNegativeTestJSON-1005200227-project] Returning 404 to user: Floating IP not found for ID f9a5d6a8-ed70-4bf9-bb66-290ddb2ca0cd {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:41:53.359832 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e84b08e8-a934-4692-8c55-8f11eae5f03d tempest-FloatingIPDetailsNegativeTestJSON-1005200227 tempest-FloatingIPDetailsNegativeTestJSON-1005200227-project] 10.222.0.70 "GET /compute/v2.1/os-floating-ips/f9a5d6a8-ed70-4bf9-bb66-290ddb2ca0cd" status: 404 len: 111 microversion: 2.1 time: 0.183428 Aug 27 02:41:53.359832 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 315/652] 10.222.0.70 () {58 vars in 1260 bytes} [Sat Aug 27 02:41:53 2022] GET /compute/v2.1/os-floating-ips/f9a5d6a8-ed70-4bf9-bb66-290ddb2ca0cd => generated 111 bytes in 185 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:41:53.359832 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-33644c3d-abd8-4c44-8436-849ccaa57e06 req-e9729688-a0b0-41ff-9d44-9eff36646281 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7eded9ca-c7bc-499a-bb53-a28d2c332402", "name": "network-vif-plugged", "status": "completed", "tag": "e0130326-860c-4234-8b0f-db61efc2a95a"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:41:53.388222 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-33644c3d-abd8-4c44-8436-849ccaa57e06 req-e9729688-a0b0-41ff-9d44-9eff36646281 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:53.389892 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-33644c3d-abd8-4c44-8436-849ccaa57e06 req-e9729688-a0b0-41ff-9d44-9eff36646281 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:53.391311 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-33644c3d-abd8-4c44-8436-849ccaa57e06 req-e9729688-a0b0-41ff-9d44-9eff36646281 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:53.422890 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-d3511f72-4eec-4e85-af30-4bb2ba24919a tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30abbf3afe304291981a6a9b85952aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c28ddbdb164f01bb82235c6d49717b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:53.434207 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-33644c3d-abd8-4c44-8436-849ccaa57e06 req-e9729688-a0b0-41ff-9d44-9eff36646281 service nova] Creating event network-vif-plugged:e0130326-860c-4234-8b0f-db61efc2a95a for instance 7eded9ca-c7bc-499a-bb53-a28d2c332402 on n-h1-852278-4 Aug 27 02:41:53.440724 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d3511f72-4eec-4e85-af30-4bb2ba24919a tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] 10.222.0.70 "GET /compute/v2.1/servers/ccf87867-fb85-4b52-93f4-283450f636a4" status: 200 len: 1463 microversion: 2.1 time: 0.332261 Aug 27 02:41:53.451094 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 338/653] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:53 2022] GET /compute/v2.1/servers/ccf87867-fb85-4b52-93f4-283450f636a4 => generated 1463 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:53.459776 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-33644c3d-abd8-4c44-8436-849ccaa57e06 req-e9729688-a0b0-41ff-9d44-9eff36646281 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107533 Aug 27 02:41:53.465346 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 316/654] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:41:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:41:53.467590 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e4f1232f-6197-4785-8c6a-ac7b5e11946d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:53.473182 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-dedd31f5-6a9c-4b28-a287-d0485e614f24 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:53.474105 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-e4f1232f-6197-4785-8c6a-ac7b5e11946d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 14e68153-ad1e-4028-8580-dcb179346f31] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:53.479723 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-dedd31f5-6a9c-4b28-a287-d0485e614f24 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: 7eded9ca-c7bc-499a-bb53-a28d2c332402] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:53.483266 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e4f1232f-6197-4785-8c6a-ac7b5e11946d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:53.485393 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e4f1232f-6197-4785-8c6a-ac7b5e11946d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:53.486059 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e4f1232f-6197-4785-8c6a-ac7b5e11946d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:53.488814 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e4f1232f-6197-4785-8c6a-ac7b5e11946d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:53.490404 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e4f1232f-6197-4785-8c6a-ac7b5e11946d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:53.491052 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e4f1232f-6197-4785-8c6a-ac7b5e11946d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:53.493123 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dedd31f5-6a9c-4b28-a287-d0485e614f24 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:53.498290 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dedd31f5-6a9c-4b28-a287-d0485e614f24 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:53.499029 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dedd31f5-6a9c-4b28-a287-d0485e614f24 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:53.501127 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dedd31f5-6a9c-4b28-a287-d0485e614f24 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:53.501829 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dedd31f5-6a9c-4b28-a287-d0485e614f24 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:53.502472 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dedd31f5-6a9c-4b28-a287-d0485e614f24 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:53.860025 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-dedd31f5-6a9c-4b28-a287-d0485e614f24 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:53.876162 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-dedd31f5-6a9c-4b28-a287-d0485e614f24 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:53.877319 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-e4f1232f-6197-4785-8c6a-ac7b5e11946d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:53.878463 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-dedd31f5-6a9c-4b28-a287-d0485e614f24 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:53.879907 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-dedd31f5-6a9c-4b28-a287-d0485e614f24 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/7eded9ca-c7bc-499a-bb53-a28d2c332402" status: 200 len: 1410 microversion: 2.25 time: 0.411086 Aug 27 02:41:53.881079 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 317/655] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:41:53 2022] GET /compute/v2.1/servers/7eded9ca-c7bc-499a-bb53-a28d2c332402 => generated 1410 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:41:53.899149 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e4f1232f-6197-4785-8c6a-ac7b5e11946d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/14e68153-ad1e-4028-8580-dcb179346f31" status: 200 len: 1311 microversion: 2.1 time: 0.437215 Aug 27 02:41:53.901004 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 339/656] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:53 2022] GET /compute/v2.1/servers/14e68153-ad1e-4028-8580-dcb179346f31 => generated 1311 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:54.111121 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4b0f6f72-457c-4741-ad77-e75a4e5192ce tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:54.111742 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-4b0f6f72-457c-4741-ad77-e75a4e5192ce tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] [instance: 50597771-779f-426a-9cdc-17a6f2fb01fd] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:54.136127 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4b0f6f72-457c-4741-ad77-e75a4e5192ce tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:54.139230 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7140f107-c50c-46ae-ab76-644544062520 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:54.140552 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4b0f6f72-457c-4741-ad77-e75a4e5192ce tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:54.141195 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4b0f6f72-457c-4741-ad77-e75a4e5192ce tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:54.149344 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4b0f6f72-457c-4741-ad77-e75a4e5192ce tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:54.149938 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4b0f6f72-457c-4741-ad77-e75a4e5192ce tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:54.150378 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4b0f6f72-457c-4741-ad77-e75a4e5192ce tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:54.151151 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-7140f107-c50c-46ae-ab76-644544062520 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Searching by: {'deleted': False, 'project_id': 'cff163a789634a4684435ad6cd39cd25'} {{(pid=134051) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 02:41:54.166464 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7140f107-c50c-46ae-ab76-644544062520 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:54.169377 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7140f107-c50c-46ae-ab76-644544062520 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:54.170055 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7140f107-c50c-46ae-ab76-644544062520 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:54.171005 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7140f107-c50c-46ae-ab76-644544062520 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:54.173292 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7140f107-c50c-46ae-ab76-644544062520 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:54.178075 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7140f107-c50c-46ae-ab76-644544062520 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:54.393249 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-7140f107-c50c-46ae-ab76-644544062520 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.508679 Aug 27 02:41:54.395133 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 318/657] 10.222.0.70 () {58 vars in 1146 bytes} [Sat Aug 27 02:41:53 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:41:54.413398 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8a6700d6-1be0-4b9f-9af3-38c9249418c9 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:54.414906 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-8a6700d6-1be0-4b9f-9af3-38c9249418c9 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] [instance: 2e8baa0f-02cd-43f0-8919-e9bfbe6f1d01] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:54.434988 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8a6700d6-1be0-4b9f-9af3-38c9249418c9 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:54.435664 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8a6700d6-1be0-4b9f-9af3-38c9249418c9 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:54.436205 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8a6700d6-1be0-4b9f-9af3-38c9249418c9 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:54.437058 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8a6700d6-1be0-4b9f-9af3-38c9249418c9 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:54.439910 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8a6700d6-1be0-4b9f-9af3-38c9249418c9 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:54.444940 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8a6700d6-1be0-4b9f-9af3-38c9249418c9 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:54.485172 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-4b0f6f72-457c-4741-ad77-e75a4e5192ce tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb3ac70d5084c9c826b5722e5302ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25afdc85b9aa4c86bd4f8e2e4a22ff3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:54.498226 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-4b0f6f72-457c-4741-ad77-e75a4e5192ce tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] 10.222.0.70 "GET /compute/v2.1/servers/50597771-779f-426a-9cdc-17a6f2fb01fd" status: 200 len: 1321 microversion: 2.1 time: 0.390919 Aug 27 02:41:54.502686 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 340/658] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:54 2022] GET /compute/v2.1/servers/50597771-779f-426a-9cdc-17a6f2fb01fd => generated 1321 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:41:54.514798 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-db7a0d60-3e34-4de1-8240-88a21bff3d9a req-8770a285-6704-4580-aab4-633208ebfe62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14e68153-ad1e-4028-8580-dcb179346f31", "tag": "a809e218-d2b7-4a52-83bd-7fc04b36e71e"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:41:54.540751 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-db7a0d60-3e34-4de1-8240-88a21bff3d9a req-8770a285-6704-4580-aab4-633208ebfe62 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:54.541251 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-db7a0d60-3e34-4de1-8240-88a21bff3d9a req-8770a285-6704-4580-aab4-633208ebfe62 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:54.541695 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-db7a0d60-3e34-4de1-8240-88a21bff3d9a req-8770a285-6704-4580-aab4-633208ebfe62 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:54.568641 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-db7a0d60-3e34-4de1-8240-88a21bff3d9a req-8770a285-6704-4580-aab4-633208ebfe62 service nova] Creating event network-changed:a809e218-d2b7-4a52-83bd-7fc04b36e71e for instance 14e68153-ad1e-4028-8580-dcb179346f31 on n-h2-852278-4 Aug 27 02:41:54.592526 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-db7a0d60-3e34-4de1-8240-88a21bff3d9a req-8770a285-6704-4580-aab4-633208ebfe62 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088298 Aug 27 02:41:54.593156 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 341/659] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:41:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:41:54.606273 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f89385f5-ce4e-466f-a9ef-94614446ea70 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:54.619435 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-f89385f5-ce4e-466f-a9ef-94614446ea70 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Searching by: {'deleted': False} {{(pid=134052) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 02:41:54.631341 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-8a6700d6-1be0-4b9f-9af3-38c9249418c9 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2ff9f8745c4dda8b04fbeb95d9988a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a009f79d954838abb0566d86b97f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:54.634923 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f89385f5-ce4e-466f-a9ef-94614446ea70 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:54.635408 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f89385f5-ce4e-466f-a9ef-94614446ea70 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:54.635843 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f89385f5-ce4e-466f-a9ef-94614446ea70 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:54.636602 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f89385f5-ce4e-466f-a9ef-94614446ea70 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:54.641462 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-8a6700d6-1be0-4b9f-9af3-38c9249418c9 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] 10.222.0.70 "GET /compute/v2.1/servers/2e8baa0f-02cd-43f0-8919-e9bfbe6f1d01" status: 200 len: 1427 microversion: 2.1 time: 0.244639 Aug 27 02:41:54.641725 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f89385f5-ce4e-466f-a9ef-94614446ea70 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:54.642555 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f89385f5-ce4e-466f-a9ef-94614446ea70 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:54.644247 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 319/660] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:54 2022] GET /compute/v2.1/servers/2e8baa0f-02cd-43f0-8919-e9bfbe6f1d01 => generated 1427 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:54.706951 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=30 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:41:54.707615 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=24 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:41:54.784649 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.multi_cell_list [None req-f89385f5-ce4e-466f-a9ef-94614446ea70 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Listed batch of 11 results from cell out of 1000 limit. Returned 11 total so far. {{(pid=134052) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 02:41:54.906543 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3193c9df-e4b0-47a1-850c-0b297812541d tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:54.907580 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-3193c9df-e4b0-47a1-850c-0b297812541d tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: 7eded9ca-c7bc-499a-bb53-a28d2c332402] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:54.918410 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3193c9df-e4b0-47a1-850c-0b297812541d tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:54.921031 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3193c9df-e4b0-47a1-850c-0b297812541d tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:54.922426 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3193c9df-e4b0-47a1-850c-0b297812541d tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:54.924596 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3193c9df-e4b0-47a1-850c-0b297812541d tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:54.929320 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3193c9df-e4b0-47a1-850c-0b297812541d tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:54.934663 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3193c9df-e4b0-47a1-850c-0b297812541d tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:55.034187 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f89385f5-ce4e-466f-a9ef-94614446ea70 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:55.036354 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f89385f5-ce4e-466f-a9ef-94614446ea70 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:55.039164 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f89385f5-ce4e-466f-a9ef-94614446ea70 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:55.321860 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-3193c9df-e4b0-47a1-850c-0b297812541d tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:55.337436 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-3193c9df-e4b0-47a1-850c-0b297812541d tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:55.338995 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-3193c9df-e4b0-47a1-850c-0b297812541d tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:55.345444 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-3193c9df-e4b0-47a1-850c-0b297812541d tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/7eded9ca-c7bc-499a-bb53-a28d2c332402" status: 200 len: 1410 microversion: 2.25 time: 0.442864 Aug 27 02:41:55.361620 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 320/661] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:41:54 2022] GET /compute/v2.1/servers/7eded9ca-c7bc-499a-bb53-a28d2c332402 => generated 1410 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:41:55.368140 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a4bc4175-ba7a-4285-8071-7d9d8e539f8c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:55.368769 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-a4bc4175-ba7a-4285-8071-7d9d8e539f8c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 14e68153-ad1e-4028-8580-dcb179346f31] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:55.375049 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a4bc4175-ba7a-4285-8071-7d9d8e539f8c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:55.375824 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a4bc4175-ba7a-4285-8071-7d9d8e539f8c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:55.376456 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a4bc4175-ba7a-4285-8071-7d9d8e539f8c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:55.377349 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a4bc4175-ba7a-4285-8071-7d9d8e539f8c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:55.377974 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a4bc4175-ba7a-4285-8071-7d9d8e539f8c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:55.378551 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a4bc4175-ba7a-4285-8071-7d9d8e539f8c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:55.607072 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=47,nova_cell0:UPDATE=7 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:41:56.166769 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f89385f5-ce4e-466f-a9ef-94614446ea70 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 17361 microversion: 2.1 time: 1.572303 Aug 27 02:41:56.168140 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 342/662] 10.222.0.70 () {58 vars in 1171 bytes} [Sat Aug 27 02:41:54 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 17361 bytes in 1574 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:41:56.174314 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f1c26d1c-3e78-4165-aea3-f9d2b7cbd3a0 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:56.187677 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-f1c26d1c-3e78-4165-aea3-f9d2b7cbd3a0 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] [instance: 7c1f28aa-64fe-4517-88e2-b2e677baea24] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:56.222864 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-a4bc4175-ba7a-4285-8071-7d9d8e539f8c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:56.230789 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a4bc4175-ba7a-4285-8071-7d9d8e539f8c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/14e68153-ad1e-4028-8580-dcb179346f31" status: 200 len: 1311 microversion: 2.1 time: 0.867929 Aug 27 02:41:56.239320 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f1c26d1c-3e78-4165-aea3-f9d2b7cbd3a0 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:56.240151 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f1c26d1c-3e78-4165-aea3-f9d2b7cbd3a0 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:56.240839 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f1c26d1c-3e78-4165-aea3-f9d2b7cbd3a0 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:56.242904 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f1c26d1c-3e78-4165-aea3-f9d2b7cbd3a0 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:56.248891 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f1c26d1c-3e78-4165-aea3-f9d2b7cbd3a0 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:56.249654 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f1c26d1c-3e78-4165-aea3-f9d2b7cbd3a0 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:56.266036 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 321/663] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:55 2022] GET /compute/v2.1/servers/14e68153-ad1e-4028-8580-dcb179346f31 => generated 1311 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:56.292222 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-6a2fd7d9-5fa3-4f14-8f57-8f1b8257b4fe tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:56.297856 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-6a2fd7d9-5fa3-4f14-8f57-8f1b8257b4fe tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] [instance: 50597771-779f-426a-9cdc-17a6f2fb01fd] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:56.320268 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6a2fd7d9-5fa3-4f14-8f57-8f1b8257b4fe tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:56.323096 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6a2fd7d9-5fa3-4f14-8f57-8f1b8257b4fe tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:56.323665 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6a2fd7d9-5fa3-4f14-8f57-8f1b8257b4fe tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:56.324550 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6a2fd7d9-5fa3-4f14-8f57-8f1b8257b4fe tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:56.325237 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6a2fd7d9-5fa3-4f14-8f57-8f1b8257b4fe tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:56.327702 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6a2fd7d9-5fa3-4f14-8f57-8f1b8257b4fe tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:57.177289 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-f1c26d1c-3e78-4165-aea3-f9d2b7cbd3a0 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c850104e6d430397bb54d0e3730a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72992d9dba564526b223533398a94dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:57.191526 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f1c26d1c-3e78-4165-aea3-f9d2b7cbd3a0 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] 10.222.0.70 "GET /compute/v2.1/servers/7c1f28aa-64fe-4517-88e2-b2e677baea24" status: 200 len: 1586 microversion: 2.1 time: 1.021473 Aug 27 02:41:57.194839 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 343/664] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:56 2022] GET /compute/v2.1/servers/7c1f28aa-64fe-4517-88e2-b2e677baea24 => generated 1586 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:57.204804 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-f7a0f374-4348-4ca9-bc2f-db5a335e2454 req-7b9f69e2-22d8-41e0-8446-c5c985781afa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50597771-779f-426a-9cdc-17a6f2fb01fd", "name": "network-vif-plugged", "status": "completed", "tag": "5d4a954d-d8fd-4d2d-9c40-fd2bf505d3ae"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:41:57.209136 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-6a2fd7d9-5fa3-4f14-8f57-8f1b8257b4fe tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb3ac70d5084c9c826b5722e5302ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25afdc85b9aa4c86bd4f8e2e4a22ff3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:57.222026 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-6a2fd7d9-5fa3-4f14-8f57-8f1b8257b4fe tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] 10.222.0.70 "GET /compute/v2.1/servers/50597771-779f-426a-9cdc-17a6f2fb01fd" status: 200 len: 1321 microversion: 2.1 time: 0.953630 Aug 27 02:41:57.223328 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 322/665] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:56 2022] GET /compute/v2.1/servers/50597771-779f-426a-9cdc-17a6f2fb01fd => generated 1321 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:57.232372 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-f7a0f374-4348-4ca9-bc2f-db5a335e2454 req-7b9f69e2-22d8-41e0-8446-c5c985781afa service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:57.232844 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-f7a0f374-4348-4ca9-bc2f-db5a335e2454 req-7b9f69e2-22d8-41e0-8446-c5c985781afa service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:57.234247 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f25815f9-84e7-4455-9796-22c565c2e747 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:57.234707 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-f7a0f374-4348-4ca9-bc2f-db5a335e2454 req-7b9f69e2-22d8-41e0-8446-c5c985781afa service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:57.234929 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-f25815f9-84e7-4455-9796-22c565c2e747 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] [instance: 2e8baa0f-02cd-43f0-8919-e9bfbe6f1d01] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:57.257607 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f25815f9-84e7-4455-9796-22c565c2e747 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:57.258443 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f25815f9-84e7-4455-9796-22c565c2e747 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:57.259090 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f25815f9-84e7-4455-9796-22c565c2e747 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:57.260074 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f25815f9-84e7-4455-9796-22c565c2e747 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:57.261191 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f25815f9-84e7-4455-9796-22c565c2e747 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:57.261863 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f25815f9-84e7-4455-9796-22c565c2e747 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:57.267872 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-f7a0f374-4348-4ca9-bc2f-db5a335e2454 req-7b9f69e2-22d8-41e0-8446-c5c985781afa service nova] Creating event network-vif-plugged:5d4a954d-d8fd-4d2d-9c40-fd2bf505d3ae for instance 50597771-779f-426a-9cdc-17a6f2fb01fd on n-h1-852278-4 Aug 27 02:41:57.279463 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-f7a0f374-4348-4ca9-bc2f-db5a335e2454 req-7b9f69e2-22d8-41e0-8446-c5c985781afa service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083210 Aug 27 02:41:57.282480 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 344/666] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:41:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:41:57.286619 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-f25815f9-84e7-4455-9796-22c565c2e747 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] HTTP exception thrown: Instance 2e8baa0f-02cd-43f0-8919-e9bfbe6f1d01 could not be found. Aug 27 02:41:57.289673 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f25815f9-84e7-4455-9796-22c565c2e747 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Request method failure captured: Aug 27 02:41:57.289673 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/2e8baa0f-02cd-43f0-8919-e9bfbe6f1d01 HTTP/1.1 Aug 27 02:41:57.289673 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:41:57.289673 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:41:57.289673 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:41:57.289673 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:41:57.289673 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:41:57.289673 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:41:57.289673 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:41:57.289673 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:41:57.289673 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYRRrzzib5pEQ22cZHpPdqPsm2kuVOMKOBN-dKjbWAJGUmatFeXbRaSxIx1zO07PJx4reL4ppdVowqz3vX9gxYqdgw5Z5gpH-13V43BHwPk9J2Oo28SeRZnE9FkXt1C74Y-WEJtO62foCkEYiJAkuyk7bbVN5ME04YGKGyaFJwFhud0 Aug 27 02:41:57.289673 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:41:57.289673 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:41:57.289673 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:41:57.289673 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:41:57.289673 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:41:57.289673 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:41:57.289673 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: f7a009f79d954838abb0566d86b97f2e Aug 27 02:41:57.289673 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-TenantUsagesTestJSON-1172592807 Aug 27 02:41:57.289673 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:41:57.289673 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:41:57.291228 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f7a009f79d954838abb0566d86b97f2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f7a009f79d954838abb0566d86b97f2e", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f7a009f79d954838abb0566d86b97f2e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f7a009f79d954838abb0566d86b97f2e"}]}] Aug 27 02:41:57.291228 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-TenantUsagesTestJSON-1172592807 Aug 27 02:41:57.291228 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: f7a009f79d954838abb0566d86b97f2e Aug 27 02:41:57.291228 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-TenantUsagesTestJSON-1172592807 Aug 27 02:41:57.291228 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-TenantUsagesTestJSON-1172592807-project Aug 27 02:41:57.291228 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:41:57.291228 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:41:57.291228 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 8f2ff9f8745c4dda8b04fbeb95d9988a Aug 27 02:41:57.291228 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-TenantUsagesTestJSON-1172592807-project Aug 27 02:41:57.291228 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 02:41:57.291228 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance 2e8baa0f-02cd-43f0-8919-e9bfbe6f1d01 could not be found. Aug 27 02:41:57.291228 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '2e8baa0f-02cd-43f0-8919-e9bfbe6f1d01'} Aug 27 02:41:57.292634 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:41:57.292634 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:41:57.292634 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:41:57.292634 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:41:57.292634 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:41:57.292634 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:41:57.292634 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:41:57.292634 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:41:57.292634 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:41:57.292634 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:41:57.292634 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e8baa0f-02cd-43f0-8919-e9bfbe6f1d01 could not be found. Aug 27 02:41:57.292634 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:41:57.292634 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:41:57.292634 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:41:57.292634 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:41:57.292634 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:41:57.292634 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:41:57.292634 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:41:57.292634 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:41:57.292634 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:41:57.294172 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:41:57.294172 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:41:57.294172 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:41:57.294172 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:41:57.294172 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:41:57.294172 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:41:57.294172 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:41:57.294172 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e8baa0f-02cd-43f0-8919-e9bfbe6f1d01 could not be found. Aug 27 02:41:57.294172 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:41:57.294172 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:41:57.294172 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:41:57.294172 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:41:57.294172 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:41:57.294172 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:41:57.294172 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:41:57.294172 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:41:57.294172 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e8baa0f-02cd-43f0-8919-e9bfbe6f1d01 could not be found. Aug 27 02:41:57.294172 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:41:57.296081 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-238ad16a-0aa0-4685-b04b-5fe61408d753 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:57.298096 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f25815f9-84e7-4455-9796-22c565c2e747 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] Returning 404 to user: Instance 2e8baa0f-02cd-43f0-8919-e9bfbe6f1d01 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:41:57.299588 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-f25815f9-84e7-4455-9796-22c565c2e747 tempest-TenantUsagesTestJSON-1172592807 tempest-TenantUsagesTestJSON-1172592807-project] 10.222.0.70 "GET /compute/v2.1/servers/2e8baa0f-02cd-43f0-8919-e9bfbe6f1d01" status: 404 len: 111 microversion: 2.1 time: 0.074987 Aug 27 02:41:57.300932 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 323/667] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:57 2022] GET /compute/v2.1/servers/2e8baa0f-02cd-43f0-8919-e9bfbe6f1d01 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:41:57.316535 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-238ad16a-0aa0-4685-b04b-5fe61408d753 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Searching by: {'deleted': False, 'project_id': 'cff163a789634a4684435ad6cd39cd25'} {{(pid=134052) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 02:41:57.322716 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-2013bdc2-a2a4-4ce6-8e21-01ac170dc238 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:57.323622 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-2013bdc2-a2a4-4ce6-8e21-01ac170dc238 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: 7eded9ca-c7bc-499a-bb53-a28d2c332402] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:57.336578 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2013bdc2-a2a4-4ce6-8e21-01ac170dc238 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:57.337942 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2013bdc2-a2a4-4ce6-8e21-01ac170dc238 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:57.338715 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2013bdc2-a2a4-4ce6-8e21-01ac170dc238 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:57.339330 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-238ad16a-0aa0-4685-b04b-5fe61408d753 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:57.340414 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2013bdc2-a2a4-4ce6-8e21-01ac170dc238 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:57.341041 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2013bdc2-a2a4-4ce6-8e21-01ac170dc238 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:57.341670 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-238ad16a-0aa0-4685-b04b-5fe61408d753 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:57.342299 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2013bdc2-a2a4-4ce6-8e21-01ac170dc238 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:57.347023 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-238ad16a-0aa0-4685-b04b-5fe61408d753 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:57.349221 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-238ad16a-0aa0-4685-b04b-5fe61408d753 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:57.351935 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-238ad16a-0aa0-4685-b04b-5fe61408d753 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:57.352528 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-238ad16a-0aa0-4685-b04b-5fe61408d753 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:57.622463 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-238ad16a-0aa0-4685-b04b-5fe61408d753 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/detail?tenant_id=e4c28ddbdb164f01bb82235c6d49717b" status: 200 len: 15 microversion: 2.1 time: 0.335699 Aug 27 02:41:57.627855 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 345/668] 10.222.0.70 () {58 vars in 1231 bytes} [Sat Aug 27 02:41:57 2022] GET /compute/v2.1/servers/detail?tenant_id=e4c28ddbdb164f01bb82235c6d49717b => generated 15 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:41:57.632960 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-c7869483-68ee-46b7-a501-b68c12f116bc req-39492560-a853-4b81-ac02-102cfad3063f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e8baa0f-02cd-43f0-8919-e9bfbe6f1d01", "name": "network-vif-deleted", "tag": "852fadc7-febc-45c6-bd61-2ec79939f173"}, {"name": "network-changed", "server_uuid": "7c1f28aa-64fe-4517-88e2-b2e677baea24", "tag": "fdce9d3d-6208-43e7-9296-22fd6029a735"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:41:57.660130 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-c7869483-68ee-46b7-a501-b68c12f116bc req-39492560-a853-4b81-ac02-102cfad3063f service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:57.669080 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-c7869483-68ee-46b7-a501-b68c12f116bc req-39492560-a853-4b81-ac02-102cfad3063f service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:57.669895 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-c7869483-68ee-46b7-a501-b68c12f116bc req-39492560-a853-4b81-ac02-102cfad3063f service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:57.679880 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:41:57.702160 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-c7869483-68ee-46b7-a501-b68c12f116bc req-39492560-a853-4b81-ac02-102cfad3063f service nova] Creating event network-vif-deleted:852fadc7-febc-45c6-bd61-2ec79939f173 for instance 2e8baa0f-02cd-43f0-8919-e9bfbe6f1d01 on n-h1-852278-4 Aug 27 02:41:57.705277 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-c7869483-68ee-46b7-a501-b68c12f116bc req-39492560-a853-4b81-ac02-102cfad3063f service nova] Creating event network-changed:fdce9d3d-6208-43e7-9296-22fd6029a735 for instance 7c1f28aa-64fe-4517-88e2-b2e677baea24 on n-h2-852278-4 Aug 27 02:41:57.732724 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-c7869483-68ee-46b7-a501-b68c12f116bc req-39492560-a853-4b81-ac02-102cfad3063f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.103235 Aug 27 02:41:57.735603 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 346/669] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:41:57 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:41:57.747254 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-1af834e4-c4f9-49a0-8648-f33ad87a316b tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:57.749519 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-1af834e4-c4f9-49a0-8648-f33ad87a316b tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 14e68153-ad1e-4028-8580-dcb179346f31] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:57.765853 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1af834e4-c4f9-49a0-8648-f33ad87a316b tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:57.766493 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1af834e4-c4f9-49a0-8648-f33ad87a316b tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:57.767030 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1af834e4-c4f9-49a0-8648-f33ad87a316b tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:57.769946 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1af834e4-c4f9-49a0-8648-f33ad87a316b tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:57.770530 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1af834e4-c4f9-49a0-8648-f33ad87a316b tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:57.771056 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1af834e4-c4f9-49a0-8648-f33ad87a316b tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:58.003283 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-2013bdc2-a2a4-4ce6-8e21-01ac170dc238 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:58.013708 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-2013bdc2-a2a4-4ce6-8e21-01ac170dc238 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:58.015782 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-2013bdc2-a2a4-4ce6-8e21-01ac170dc238 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:58.017263 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-2013bdc2-a2a4-4ce6-8e21-01ac170dc238 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/7eded9ca-c7bc-499a-bb53-a28d2c332402" status: 200 len: 1605 microversion: 2.25 time: 0.715066 Aug 27 02:41:58.018686 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 324/670] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:41:57 2022] GET /compute/v2.1/servers/7eded9ca-c7bc-499a-bb53-a28d2c332402 => generated 1605 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:41:58.023956 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f0d3e026-3b63-42da-b499-0700c758d7d3 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:58.031679 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-f0d3e026-3b63-42da-b499-0700c758d7d3 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Searching by: {'tenant_id': 'e4c28ddbdb164f01bb82235c6d49717b', 'deleted': False} {{(pid=134051) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 02:41:58.037768 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f0d3e026-3b63-42da-b499-0700c758d7d3 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:58.038431 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f0d3e026-3b63-42da-b499-0700c758d7d3 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:58.039175 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f0d3e026-3b63-42da-b499-0700c758d7d3 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:58.040051 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f0d3e026-3b63-42da-b499-0700c758d7d3 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:58.040521 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f0d3e026-3b63-42da-b499-0700c758d7d3 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:58.040959 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f0d3e026-3b63-42da-b499-0700c758d7d3 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:58.073283 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.multi_cell_list [None req-f0d3e026-3b63-42da-b499-0700c758d7d3 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=134051) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 02:41:58.191595 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f0d3e026-3b63-42da-b499-0700c758d7d3 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:58.192072 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f0d3e026-3b63-42da-b499-0700c758d7d3 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:58.192525 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f0d3e026-3b63-42da-b499-0700c758d7d3 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:58.194491 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=100 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:41:58.369420 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-1af834e4-c4f9-49a0-8648-f33ad87a316b tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:58.379133 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-1af834e4-c4f9-49a0-8648-f33ad87a316b tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/14e68153-ad1e-4028-8580-dcb179346f31" status: 200 len: 1311 microversion: 2.1 time: 0.641896 Aug 27 02:41:58.380424 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 347/671] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:57 2022] GET /compute/v2.1/servers/14e68153-ad1e-4028-8580-dcb179346f31 => generated 1311 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:58.385709 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-53a5d0e2-b045-4e26-ac1d-f446566968d6 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:58.386302 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-53a5d0e2-b045-4e26-ac1d-f446566968d6 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: 7eded9ca-c7bc-499a-bb53-a28d2c332402] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:58.393456 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-53a5d0e2-b045-4e26-ac1d-f446566968d6 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:58.394107 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-53a5d0e2-b045-4e26-ac1d-f446566968d6 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:58.394635 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-53a5d0e2-b045-4e26-ac1d-f446566968d6 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:58.395500 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-53a5d0e2-b045-4e26-ac1d-f446566968d6 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:58.396124 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-53a5d0e2-b045-4e26-ac1d-f446566968d6 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:58.396637 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-53a5d0e2-b045-4e26-ac1d-f446566968d6 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:58.638478 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-53a5d0e2-b045-4e26-ac1d-f446566968d6 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/7eded9ca-c7bc-499a-bb53-a28d2c332402/os-interface" status: 200 len: 284 microversion: 2.25 time: 0.256811 Aug 27 02:41:58.639572 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 348/672] 10.222.0.70 () {60 vars in 1316 bytes} [Sat Aug 27 02:41:58 2022] GET /compute/v2.1/servers/7eded9ca-c7bc-499a-bb53-a28d2c332402/os-interface => generated 284 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:41:58.658137 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9127d699-ecef-4001-80c0-d76e75ba3781 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:58.658767 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-9127d699-ecef-4001-80c0-d76e75ba3781 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] [instance: 50597771-779f-426a-9cdc-17a6f2fb01fd] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:58.664659 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-f0d3e026-3b63-42da-b499-0700c758d7d3 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=e4c28ddbdb164f01bb82235c6d49717b" status: 200 len: 4824 microversion: 2.1 time: 0.644522 Aug 27 02:41:58.665264 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 325/673] 10.222.0.70 () {58 vars in 1257 bytes} [Sat Aug 27 02:41:58 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=e4c28ddbdb164f01bb82235c6d49717b => generated 4824 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:58.678241 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9127d699-ecef-4001-80c0-d76e75ba3781 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:58.679361 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9127d699-ecef-4001-80c0-d76e75ba3781 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:58.679808 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9127d699-ecef-4001-80c0-d76e75ba3781 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:58.680732 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9127d699-ecef-4001-80c0-d76e75ba3781 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:58.681336 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9127d699-ecef-4001-80c0-d76e75ba3781 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:58.681937 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9127d699-ecef-4001-80c0-d76e75ba3781 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:58.695430 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-85b131cf-e71e-4762-878c-4a7ff111d8ad tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:58.704294 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-85b131cf-e71e-4762-878c-4a7ff111d8ad tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Searching by: {'tenant_id': 'cff163a789634a4684435ad6cd39cd25', 'deleted': False} {{(pid=134051) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 02:41:58.711282 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-85b131cf-e71e-4762-878c-4a7ff111d8ad tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:58.712033 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-85b131cf-e71e-4762-878c-4a7ff111d8ad tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:58.712678 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-85b131cf-e71e-4762-878c-4a7ff111d8ad tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:58.714586 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-85b131cf-e71e-4762-878c-4a7ff111d8ad tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:58.715216 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-85b131cf-e71e-4762-878c-4a7ff111d8ad tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:58.715896 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-85b131cf-e71e-4762-878c-4a7ff111d8ad tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:58.750848 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-85b131cf-e71e-4762-878c-4a7ff111d8ad tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=cff163a789634a4684435ad6cd39cd25" status: 200 len: 15 microversion: 2.1 time: 0.060062 Aug 27 02:41:58.762211 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 326/674] 10.222.0.70 () {58 vars in 1257 bytes} [Sat Aug 27 02:41:58 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=cff163a789634a4684435ad6cd39cd25 => generated 15 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:41:58.775289 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8fa469d9-30b8-4580-a894-245c90f814e6 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:58.792133 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-8fa469d9-30b8-4580-a894-245c90f814e6 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.009841 Aug 27 02:41:58.800372 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 327/675] 10.222.0.70 () {58 vars in 1189 bytes} [Sat Aug 27 02:41:58 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 27 02:41:58.815136 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7d56cccd-6cbc-428e-8e0b-c2bc558ef71a tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:41:58.818008 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-7d56cccd-6cbc-428e-8e0b-c2bc558ef71a tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] [instance: 3ee4d4db-a1bb-4567-a20d-29003e67a295] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:58.831512 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7d56cccd-6cbc-428e-8e0b-c2bc558ef71a tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:58.832130 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7d56cccd-6cbc-428e-8e0b-c2bc558ef71a tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:58.832704 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7d56cccd-6cbc-428e-8e0b-c2bc558ef71a tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:58.833755 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7d56cccd-6cbc-428e-8e0b-c2bc558ef71a tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:58.834205 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7d56cccd-6cbc-428e-8e0b-c2bc558ef71a tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:58.834624 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7d56cccd-6cbc-428e-8e0b-c2bc558ef71a tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:58.956363 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-7d56cccd-6cbc-428e-8e0b-c2bc558ef71a tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/3ee4d4db-a1bb-4567-a20d-29003e67a295/action" status: 202 len: 0 microversion: 2.1 time: 0.146269 Aug 27 02:41:58.961507 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 328/676] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 02:41:58 2022] POST /compute/v2.1/servers/3ee4d4db-a1bb-4567-a20d-29003e67a295/action => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 02:41:58.970497 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a8ba68d6-bf03-460c-80b9-448076311f72 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:58.978888 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-a8ba68d6-bf03-460c-80b9-448076311f72 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '30abbf3afe304291981a6a9b85952aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c28ddbdb164f01bb82235c6d49717b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:58.980019 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-a8ba68d6-bf03-460c-80b9-448076311f72 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': 'e4c28ddbdb164f01bb82235c6d49717b'} {{(pid=134051) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 02:41:58.989062 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a8ba68d6-bf03-460c-80b9-448076311f72 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:58.990061 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a8ba68d6-bf03-460c-80b9-448076311f72 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:58.990828 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a8ba68d6-bf03-460c-80b9-448076311f72 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:58.991979 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a8ba68d6-bf03-460c-80b9-448076311f72 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:58.993103 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a8ba68d6-bf03-460c-80b9-448076311f72 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:58.994392 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a8ba68d6-bf03-460c-80b9-448076311f72 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:59.221591 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.multi_cell_list [None req-a8ba68d6-bf03-460c-80b9-448076311f72 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=134051) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 02:41:59.296302 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a8ba68d6-bf03-460c-80b9-448076311f72 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] 10.222.0.70 "GET /compute/v2.1/servers?status=error" status: 200 len: 338 microversion: 2.1 time: 0.332721 Aug 27 02:41:59.303107 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 329/677] 10.222.0.70 () {58 vars in 1150 bytes} [Sat Aug 27 02:41:58 2022] GET /compute/v2.1/servers?status=error => generated 338 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:41:59.310013 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c2445af2-6087-4b46-acf7-6335eccedb85 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:41:59.316532 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-c2445af2-6087-4b46-acf7-6335eccedb85 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] [instance: 3ee4d4db-a1bb-4567-a20d-29003e67a295] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:59.316672 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-9127d699-ecef-4001-80c0-d76e75ba3781 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb3ac70d5084c9c826b5722e5302ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25afdc85b9aa4c86bd4f8e2e4a22ff3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:59.323544 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c2445af2-6087-4b46-acf7-6335eccedb85 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:59.324029 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c2445af2-6087-4b46-acf7-6335eccedb85 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:59.324850 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c2445af2-6087-4b46-acf7-6335eccedb85 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:59.325811 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c2445af2-6087-4b46-acf7-6335eccedb85 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:59.325955 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9127d699-ecef-4001-80c0-d76e75ba3781 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] 10.222.0.70 "GET /compute/v2.1/servers/50597771-779f-426a-9cdc-17a6f2fb01fd" status: 200 len: 1321 microversion: 2.1 time: 0.685144 Aug 27 02:41:59.326557 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c2445af2-6087-4b46-acf7-6335eccedb85 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:59.327139 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c2445af2-6087-4b46-acf7-6335eccedb85 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:59.328160 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 349/678] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:58 2022] GET /compute/v2.1/servers/50597771-779f-426a-9cdc-17a6f2fb01fd => generated 1321 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:59.403861 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c9be2ec2-6bdc-41c7-95bc-bb506049297e tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:59.404961 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-c9be2ec2-6bdc-41c7-95bc-bb506049297e tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 14e68153-ad1e-4028-8580-dcb179346f31] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:59.413207 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c9be2ec2-6bdc-41c7-95bc-bb506049297e tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:59.414163 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c9be2ec2-6bdc-41c7-95bc-bb506049297e tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:59.414995 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c9be2ec2-6bdc-41c7-95bc-bb506049297e tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:59.427079 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c2445af2-6087-4b46-acf7-6335eccedb85 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/3ee4d4db-a1bb-4567-a20d-29003e67a295/action" status: 202 len: 0 microversion: 2.1 time: 0.120630 Aug 27 02:41:59.429594 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 330/679] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 02:41:59 2022] POST /compute/v2.1/servers/3ee4d4db-a1bb-4567-a20d-29003e67a295/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:41:59.432724 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c9be2ec2-6bdc-41c7-95bc-bb506049297e tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:59.433969 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c9be2ec2-6bdc-41c7-95bc-bb506049297e tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:59.434643 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c9be2ec2-6bdc-41c7-95bc-bb506049297e tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:59.445384 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-eac86a45-01aa-4448-bfc7-7bb34fdf38d2 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:59.446088 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-eac86a45-01aa-4448-bfc7-7bb34fdf38d2 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] [instance: 3ee4d4db-a1bb-4567-a20d-29003e67a295] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:59.464467 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eac86a45-01aa-4448-bfc7-7bb34fdf38d2 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:59.464991 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eac86a45-01aa-4448-bfc7-7bb34fdf38d2 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:59.465439 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eac86a45-01aa-4448-bfc7-7bb34fdf38d2 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:59.466160 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eac86a45-01aa-4448-bfc7-7bb34fdf38d2 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:59.466616 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eac86a45-01aa-4448-bfc7-7bb34fdf38d2 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:59.467037 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eac86a45-01aa-4448-bfc7-7bb34fdf38d2 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:00.149728 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-eac86a45-01aa-4448-bfc7-7bb34fdf38d2 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/3ee4d4db-a1bb-4567-a20d-29003e67a295" status: 200 len: 1614 microversion: 2.1 time: 0.714159 Aug 27 02:42:00.159768 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 331/680] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:59 2022] GET /compute/v2.1/servers/3ee4d4db-a1bb-4567-a20d-29003e67a295 => generated 1614 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:00.173694 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3914bf52-75ca-40f3-8f3e-8f7e83da2656 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:00.174372 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-3914bf52-75ca-40f3-8f3e-8f7e83da2656 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] [instance: 3ee4d4db-a1bb-4567-a20d-29003e67a295] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:00.185070 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3914bf52-75ca-40f3-8f3e-8f7e83da2656 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:00.185561 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3914bf52-75ca-40f3-8f3e-8f7e83da2656 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:00.185989 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3914bf52-75ca-40f3-8f3e-8f7e83da2656 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:00.188821 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3914bf52-75ca-40f3-8f3e-8f7e83da2656 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:00.190434 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3914bf52-75ca-40f3-8f3e-8f7e83da2656 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:00.190910 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3914bf52-75ca-40f3-8f3e-8f7e83da2656 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:00.303444 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-c9be2ec2-6bdc-41c7-95bc-bb506049297e tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:00.328245 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c9be2ec2-6bdc-41c7-95bc-bb506049297e tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/14e68153-ad1e-4028-8580-dcb179346f31" status: 200 len: 1311 microversion: 2.1 time: 0.925653 Aug 27 02:42:00.344842 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 350/681] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:59 2022] GET /compute/v2.1/servers/14e68153-ad1e-4028-8580-dcb179346f31 => generated 1311 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:42:00.354470 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-790fa559-bea3-4aa6-b826-2a59e9a5d6fc tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:00.358497 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-790fa559-bea3-4aa6-b826-2a59e9a5d6fc tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] [instance: 50597771-779f-426a-9cdc-17a6f2fb01fd] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:00.375628 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-790fa559-bea3-4aa6-b826-2a59e9a5d6fc tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:00.376159 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-790fa559-bea3-4aa6-b826-2a59e9a5d6fc tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:00.376731 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-790fa559-bea3-4aa6-b826-2a59e9a5d6fc tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:00.377478 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-790fa559-bea3-4aa6-b826-2a59e9a5d6fc tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:00.377923 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-790fa559-bea3-4aa6-b826-2a59e9a5d6fc tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:00.380587 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-790fa559-bea3-4aa6-b826-2a59e9a5d6fc tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:00.864364 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-790fa559-bea3-4aa6-b826-2a59e9a5d6fc tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb3ac70d5084c9c826b5722e5302ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25afdc85b9aa4c86bd4f8e2e4a22ff3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:00.874910 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-790fa559-bea3-4aa6-b826-2a59e9a5d6fc tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] 10.222.0.70 "GET /compute/v2.1/servers/50597771-779f-426a-9cdc-17a6f2fb01fd" status: 200 len: 1471 microversion: 2.1 time: 0.528550 Aug 27 02:42:00.893382 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 351/682] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:00 2022] GET /compute/v2.1/servers/50597771-779f-426a-9cdc-17a6f2fb01fd => generated 1471 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:00.926539 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-5abac42b-2304-470b-8ed8-c385a91f9ca2 req-9035e760-f88b-4e24-94fb-b24d558f2c44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7eded9ca-c7bc-499a-bb53-a28d2c332402", "tag": "e0130326-860c-4234-8b0f-db61efc2a95a"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:42:00.950135 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-5abac42b-2304-470b-8ed8-c385a91f9ca2 req-9035e760-f88b-4e24-94fb-b24d558f2c44 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:00.950618 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-5abac42b-2304-470b-8ed8-c385a91f9ca2 req-9035e760-f88b-4e24-94fb-b24d558f2c44 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:00.951032 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-5abac42b-2304-470b-8ed8-c385a91f9ca2 req-9035e760-f88b-4e24-94fb-b24d558f2c44 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:00.972425 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-5abac42b-2304-470b-8ed8-c385a91f9ca2 req-9035e760-f88b-4e24-94fb-b24d558f2c44 service nova] Creating event network-changed:e0130326-860c-4234-8b0f-db61efc2a95a for instance 7eded9ca-c7bc-499a-bb53-a28d2c332402 on n-h1-852278-4 Aug 27 02:42:00.979802 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-5abac42b-2304-470b-8ed8-c385a91f9ca2 req-9035e760-f88b-4e24-94fb-b24d558f2c44 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084491 Aug 27 02:42:00.987224 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 352/683] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:42:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:42:01.236777 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-3914bf52-75ca-40f3-8f3e-8f7e83da2656 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/3ee4d4db-a1bb-4567-a20d-29003e67a295" status: 200 len: 1614 microversion: 2.1 time: 1.063640 Aug 27 02:42:01.238309 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 332/684] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:00 2022] GET /compute/v2.1/servers/3ee4d4db-a1bb-4567-a20d-29003e67a295 => generated 1614 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:01.262072 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3f7e6a49-1872-4400-8a00-d01d321fa999 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:01.271454 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-3f7e6a49-1872-4400-8a00-d01d321fa999 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Searching by: {'host': 'n-h2-852278-4', 'deleted': False} {{(pid=134051) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 02:42:01.273592 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-71d4a594-590a-428b-a900-6b26ba8db41c tempest-ServersAdminNegativeTestJSON-1848621224 tempest-ServersAdminNegativeTestJSON-1848621224-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:42:01.275804 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-71d4a594-590a-428b-a900-6b26ba8db41c tempest-ServersAdminNegativeTestJSON-1848621224 tempest-ServersAdminNegativeTestJSON-1848621224-project-admin] [instance: 3691b754-096f-4790-a9ea-ffbf85e6c5e4] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:01.284424 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3f7e6a49-1872-4400-8a00-d01d321fa999 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:01.285875 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3f7e6a49-1872-4400-8a00-d01d321fa999 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:01.286466 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3f7e6a49-1872-4400-8a00-d01d321fa999 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:01.289288 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3f7e6a49-1872-4400-8a00-d01d321fa999 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:01.289962 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3f7e6a49-1872-4400-8a00-d01d321fa999 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:01.290541 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3f7e6a49-1872-4400-8a00-d01d321fa999 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:01.295651 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-71d4a594-590a-428b-a900-6b26ba8db41c tempest-ServersAdminNegativeTestJSON-1848621224 tempest-ServersAdminNegativeTestJSON-1848621224-project-admin] HTTP exception thrown: Instance 3691b754-096f-4790-a9ea-ffbf85e6c5e4 could not be found. Aug 27 02:42:01.301726 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-71d4a594-590a-428b-a900-6b26ba8db41c tempest-ServersAdminNegativeTestJSON-1848621224 tempest-ServersAdminNegativeTestJSON-1848621224-project-admin] Request method failure captured: Aug 27 02:42:01.301726 n-d-852278-4 devstack@n-api.service[134052]: request: POST /compute/v2.1/servers/3691b754-096f-4790-a9ea-ffbf85e6c5e4/action HTTP/1.1 Aug 27 02:42:01.301726 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:42:01.301726 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:42:01.301726 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:42:01.301726 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 15 Aug 27 02:42:01.301726 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:42:01.301726 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:42:01.301726 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:42:01.301726 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:42:01.301726 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYRfmJQ7LKRbtw-EihFC8U-37QKAHIZHJXkTVMOFTZJqBmJwgITjdj4-6sWSF8auxXAWNA-IenfLRlp5BjYi11N3NdNM6YNg39_gQL3SAbXJLlGobybe3DjFkwaKrs2xRatnH3R2Yk8gUlhaa_zoO2EYPuwVNi9Hce_YPknP95LRvSo Aug 27 02:42:01.301726 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:42:01.301726 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:42:01.301726 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:42:01.301726 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:42:01.301726 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:42:01.301726 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:42:01.301726 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 53a0eb63030642f18ebe81429a5fc515 Aug 27 02:42:01.301726 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1848621224 Aug 27 02:42:01.301726 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,admin,member Aug 27 02:42:01.301726 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,admin,member Aug 27 02:42:01.303054 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/53a0eb63030642f18ebe81429a5fc515"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_53a0eb63030642f18ebe81429a5fc515", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/53a0eb63030642f18ebe81429a5fc515"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/53a0eb63030642f18ebe81429a5fc515"}]}] Aug 27 02:42:01.303054 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1848621224 Aug 27 02:42:01.303054 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 53a0eb63030642f18ebe81429a5fc515 Aug 27 02:42:01.303054 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1848621224 Aug 27 02:42:01.303054 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ServersAdminNegativeTestJSON-1848621224-project-admin Aug 27 02:42:01.303054 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:42:01.303054 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:42:01.303054 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 255c2c3ba3bb4b72ac8c6d59f0116ed3 Aug 27 02:42:01.303054 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1848621224-project-admin Aug 27 02:42:01.303054 n-d-852278-4 devstack@n-api.service[134052]: Aug 27 02:42:01.303054 n-d-852278-4 devstack@n-api.service[134052]: {"migrate": {}} Aug 27 02:42:01.303054 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 02:42:01.303054 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance 3691b754-096f-4790-a9ea-ffbf85e6c5e4 could not be found. Aug 27 02:42:01.303852 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '3691b754-096f-4790-a9ea-ffbf85e6c5e4', 'body': {'migrate': {}}} Aug 27 02:42:01.303852 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:42:01.303852 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:42:01.303852 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:42:01.303852 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:42:01.303852 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:42:01.303852 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:42:01.303852 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 02:42:01.303852 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 02:42:01.303852 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3691b754-096f-4790-a9ea-ffbf85e6c5e4 could not be found. Aug 27 02:42:01.303852 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:42:01.303852 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:42:01.303852 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:42:01.303852 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:42:01.303852 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:42:01.303852 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:42:01.303852 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:42:01.303852 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:42:01.303852 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:42:01.303852 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:42:01.305383 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:42:01.305383 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:42:01.305383 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Aug 27 02:42:01.305383 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Aug 27 02:42:01.305383 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:42:01.305383 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:42:01.305383 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3691b754-096f-4790-a9ea-ffbf85e6c5e4 could not be found. Aug 27 02:42:01.305383 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:42:01.305383 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:42:01.305383 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:42:01.305383 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:42:01.305383 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:42:01.305383 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:42:01.305383 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:42:01.305383 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:42:01.305383 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3691b754-096f-4790-a9ea-ffbf85e6c5e4 could not be found. Aug 27 02:42:01.305383 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:42:01.306382 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-71d4a594-590a-428b-a900-6b26ba8db41c tempest-ServersAdminNegativeTestJSON-1848621224 tempest-ServersAdminNegativeTestJSON-1848621224-project-admin] Returning 404 to user: Instance 3691b754-096f-4790-a9ea-ffbf85e6c5e4 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:42:01.306382 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-71d4a594-590a-428b-a900-6b26ba8db41c tempest-ServersAdminNegativeTestJSON-1848621224 tempest-ServersAdminNegativeTestJSON-1848621224-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/3691b754-096f-4790-a9ea-ffbf85e6c5e4/action" status: 404 len: 111 microversion: 2.1 time: 0.316772 Aug 27 02:42:01.308166 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 353/685] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 02:42:00 2022] POST /compute/v2.1/servers/3691b754-096f-4790-a9ea-ffbf85e6c5e4/action => generated 111 bytes in 320 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:42:01.372510 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ae9985e0-deba-484d-9ee5-02820aa720e4 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:01.373175 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-ae9985e0-deba-484d-9ee5-02820aa720e4 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 14e68153-ad1e-4028-8580-dcb179346f31] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:01.389692 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ae9985e0-deba-484d-9ee5-02820aa720e4 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:01.391066 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ae9985e0-deba-484d-9ee5-02820aa720e4 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:01.392694 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ae9985e0-deba-484d-9ee5-02820aa720e4 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:01.394480 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ae9985e0-deba-484d-9ee5-02820aa720e4 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:01.395352 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ae9985e0-deba-484d-9ee5-02820aa720e4 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:01.396006 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ae9985e0-deba-484d-9ee5-02820aa720e4 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:01.562568 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.multi_cell_list [None req-3f7e6a49-1872-4400-8a00-d01d321fa999 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Listed batch of 7 results from cell out of 1000 limit. Returned 7 total so far. {{(pid=134051) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 02:42:01.697566 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-3f7e6a49-1872-4400-8a00-d01d321fa999 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] 10.222.0.70 "GET /compute/v2.1/servers?host=n-h2-852278-4&all_tenants=1" status: 200 len: 2321 microversion: 2.1 time: 0.439757 Aug 27 02:42:01.713746 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 333/686] 10.222.0.70 () {58 vars in 1190 bytes} [Sat Aug 27 02:42:01 2022] GET /compute/v2.1/servers?host=n-h2-852278-4&all_tenants=1 => generated 2321 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:42:01.719148 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-beb66d32-81d0-40ce-9250-179dba42165f tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1190565340", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:42:01.749741 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-ae9985e0-deba-484d-9ee5-02820aa720e4 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:01.760383 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ae9985e0-deba-484d-9ee5-02820aa720e4 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/14e68153-ad1e-4028-8580-dcb179346f31" status: 200 len: 1311 microversion: 2.1 time: 0.395159 Aug 27 02:42:01.762564 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 354/687] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:01 2022] GET /compute/v2.1/servers/14e68153-ad1e-4028-8580-dcb179346f31 => generated 1311 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:42:01.794744 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-49cca02b-b74b-4006-9e70-8501b81252d5 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:01.802575 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-49cca02b-b74b-4006-9e70-8501b81252d5 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=134052) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 02:42:01.814879 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-49cca02b-b74b-4006-9e70-8501b81252d5 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:01.815707 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-49cca02b-b74b-4006-9e70-8501b81252d5 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:01.818167 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-49cca02b-b74b-4006-9e70-8501b81252d5 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:01.821067 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.network.neutron [None req-beb66d32-81d0-40ce-9250-179dba42165f tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] validate_networks() for None {{(pid=134051) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:42:01.821771 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-49cca02b-b74b-4006-9e70-8501b81252d5 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:01.822471 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-49cca02b-b74b-4006-9e70-8501b81252d5 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:01.823361 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-49cca02b-b74b-4006-9e70-8501b81252d5 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:02.009051 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-49cca02b-b74b-4006-9e70-8501b81252d5 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] 10.222.0.70 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.227940 Aug 27 02:42:02.010875 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 355/688] 10.222.0.70 () {58 vars in 1196 bytes} [Sat Aug 27 02:42:01 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:42:02.026463 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-269851fc-3aa6-4b40-9e88-624bde2a0803 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:42:02.031608 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-269851fc-3aa6-4b40-9e88-624bde2a0803 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] [instance: 3ee4d4db-a1bb-4567-a20d-29003e67a295] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:02.053805 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-269851fc-3aa6-4b40-9e88-624bde2a0803 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:02.058946 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-269851fc-3aa6-4b40-9e88-624bde2a0803 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:02.059465 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-269851fc-3aa6-4b40-9e88-624bde2a0803 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:02.060430 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-269851fc-3aa6-4b40-9e88-624bde2a0803 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:02.060892 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-269851fc-3aa6-4b40-9e88-624bde2a0803 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:02.061311 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-269851fc-3aa6-4b40-9e88-624bde2a0803 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:02.210662 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-269851fc-3aa6-4b40-9e88-624bde2a0803 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/3ee4d4db-a1bb-4567-a20d-29003e67a295/action" status: 202 len: 0 microversion: 2.1 time: 0.190682 Aug 27 02:42:02.212153 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 356/689] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 02:42:02 2022] POST /compute/v2.1/servers/3ee4d4db-a1bb-4567-a20d-29003e67a295/action => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 02:42:02.223487 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b0c18858-1069-4730-94f3-065469d53155 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:42:02.232946 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b0c18858-1069-4730-94f3-065469d53155 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] [instance: 3ee4d4db-a1bb-4567-a20d-29003e67a295] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:02.249084 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b0c18858-1069-4730-94f3-065469d53155 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:02.250999 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b0c18858-1069-4730-94f3-065469d53155 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:02.251374 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b0c18858-1069-4730-94f3-065469d53155 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:02.253352 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b0c18858-1069-4730-94f3-065469d53155 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:02.257550 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b0c18858-1069-4730-94f3-065469d53155 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:02.258567 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b0c18858-1069-4730-94f3-065469d53155 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:02.318904 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-beb66d32-81d0-40ce-9250-179dba42165f tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Flavor limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:42:02.319415 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-beb66d32-81d0-40ce-9250-179dba42165f tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Image limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:42:02.320286 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-beb66d32-81d0-40ce-9250-179dba42165f tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Flavor pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:42:02.320731 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-beb66d32-81d0-40ce-9250-179dba42165f tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Image pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:42:02.321324 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-beb66d32-81d0-40ce-9250-179dba42165f tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:42:02.360722 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-beb66d32-81d0-40ce-9250-179dba42165f tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:02.361774 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-beb66d32-81d0-40ce-9250-179dba42165f tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:02.362229 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-beb66d32-81d0-40ce-9250-179dba42165f tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:02.363305 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-beb66d32-81d0-40ce-9250-179dba42165f tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:02.363765 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-beb66d32-81d0-40ce-9250-179dba42165f tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:02.367801 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-beb66d32-81d0-40ce-9250-179dba42165f tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:02.409335 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-b0c18858-1069-4730-94f3-065469d53155 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Flavor limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:42:02.411681 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-b0c18858-1069-4730-94f3-065469d53155 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Image limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:42:02.412457 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-b0c18858-1069-4730-94f3-065469d53155 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Flavor pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:42:02.413194 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-b0c18858-1069-4730-94f3-065469d53155 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Image pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:42:02.413458 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-beb66d32-81d0-40ce-9250-179dba42165f tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Getting quotas for project 25afdc85b9aa4c86bd4f8e2e4a22ff3e. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:42:02.415235 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-b0c18858-1069-4730-94f3-065469d53155 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:42:02.428991 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-beb66d32-81d0-40ce-9250-179dba42165f tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Getting quotas for user 7bb3ac70d5084c9c826b5722e5302ea4 and project 25afdc85b9aa4c86bd4f8e2e4a22ff3e. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:42:02.445411 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-beb66d32-81d0-40ce-9250-179dba42165f tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Going to run 1 instances... {{(pid=134051) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:42:02.451002 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-beb66d32-81d0-40ce-9250-179dba42165f tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] [instance: b14cde49-7c38-4d62-853b-deb3a4239460] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134051) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:42:02.544499 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-beb66d32-81d0-40ce-9250-179dba42165f tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.829203 Aug 27 02:42:02.549586 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 334/690] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 02:42:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 835 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:42:02.562924 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-1e228c9d-b6a4-41df-94be-341ba2861fc7 req-0e82883b-ec8f-411e-aa9a-64bd3983326b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14e68153-ad1e-4028-8580-dcb179346f31", "name": "network-vif-plugged", "status": "completed", "tag": "a809e218-d2b7-4a52-83bd-7fc04b36e71e"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:42:02.564391 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b0c18858-1069-4730-94f3-065469d53155 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] [instance: 3ee4d4db-a1bb-4567-a20d-29003e67a295] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:02.575093 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:42:02.578835 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b0c18858-1069-4730-94f3-065469d53155 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:02.579502 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b0c18858-1069-4730-94f3-065469d53155 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:02.579962 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b0c18858-1069-4730-94f3-065469d53155 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:02.580938 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b0c18858-1069-4730-94f3-065469d53155 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:02.581178 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b0c18858-1069-4730-94f3-065469d53155 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:02.581607 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b0c18858-1069-4730-94f3-065469d53155 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:02.635716 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b0c18858-1069-4730-94f3-065469d53155 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] 10.222.0.70 "POST /compute/v2.1/servers/3ee4d4db-a1bb-4567-a20d-29003e67a295/action" status: 202 len: 1067 microversion: 2.1 time: 0.417604 Aug 27 02:42:02.637918 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 357/691] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 02:42:02 2022] POST /compute/v2.1/servers/3ee4d4db-a1bb-4567-a20d-29003e67a295/action => generated 1067 bytes in 422 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 27 02:42:02.650944 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5be048fd-0b05-40c0-b8ad-1011b0266693 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:02.651637 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-5be048fd-0b05-40c0-b8ad-1011b0266693 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] [instance: b14cde49-7c38-4d62-853b-deb3a4239460] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:02.748351 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-5be048fd-0b05-40c0-b8ad-1011b0266693 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb3ac70d5084c9c826b5722e5302ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25afdc85b9aa4c86bd4f8e2e4a22ff3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:02.770646 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-5be048fd-0b05-40c0-b8ad-1011b0266693 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] 10.222.0.70 "GET /compute/v2.1/servers/b14cde49-7c38-4d62-853b-deb3a4239460" status: 200 len: 1222 microversion: 2.1 time: 0.131327 Aug 27 02:42:02.771479 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 358/692] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:02 2022] GET /compute/v2.1/servers/b14cde49-7c38-4d62-853b-deb3a4239460 => generated 1222 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:02.810085 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c8a6aef1-c105-4411-97ac-0fb4b0558aa5 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:02.812522 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-c8a6aef1-c105-4411-97ac-0fb4b0558aa5 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] [instance: 3ee4d4db-a1bb-4567-a20d-29003e67a295] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:02.830984 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c8a6aef1-c105-4411-97ac-0fb4b0558aa5 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:02.832095 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c8a6aef1-c105-4411-97ac-0fb4b0558aa5 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:02.832927 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c8a6aef1-c105-4411-97ac-0fb4b0558aa5 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:02.835674 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c8a6aef1-c105-4411-97ac-0fb4b0558aa5 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:02.836442 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c8a6aef1-c105-4411-97ac-0fb4b0558aa5 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:02.838803 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c8a6aef1-c105-4411-97ac-0fb4b0558aa5 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:03.056650 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-1e228c9d-b6a4-41df-94be-341ba2861fc7 req-0e82883b-ec8f-411e-aa9a-64bd3983326b service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:03.057401 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-1e228c9d-b6a4-41df-94be-341ba2861fc7 req-0e82883b-ec8f-411e-aa9a-64bd3983326b service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:03.057980 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-1e228c9d-b6a4-41df-94be-341ba2861fc7 req-0e82883b-ec8f-411e-aa9a-64bd3983326b service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:03.077363 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-1e228c9d-b6a4-41df-94be-341ba2861fc7 req-0e82883b-ec8f-411e-aa9a-64bd3983326b service nova] Creating event network-vif-plugged:a809e218-d2b7-4a52-83bd-7fc04b36e71e for instance 14e68153-ad1e-4028-8580-dcb179346f31 on n-h2-852278-4 Aug 27 02:42:03.102326 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-1e228c9d-b6a4-41df-94be-341ba2861fc7 req-0e82883b-ec8f-411e-aa9a-64bd3983326b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.550154 Aug 27 02:42:03.104038 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 335/693] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:42:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:42:03.120428 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-19b48cc8-b01a-4250-b8a2-f7047619fd7d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:03.121770 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-19b48cc8-b01a-4250-b8a2-f7047619fd7d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 14e68153-ad1e-4028-8580-dcb179346f31] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:03.138703 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-19b48cc8-b01a-4250-b8a2-f7047619fd7d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:03.139994 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-19b48cc8-b01a-4250-b8a2-f7047619fd7d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:03.140545 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-19b48cc8-b01a-4250-b8a2-f7047619fd7d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:03.141344 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-19b48cc8-b01a-4250-b8a2-f7047619fd7d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:03.141726 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-19b48cc8-b01a-4250-b8a2-f7047619fd7d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:03.142148 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-19b48cc8-b01a-4250-b8a2-f7047619fd7d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:03.384877 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-c8a6aef1-c105-4411-97ac-0fb4b0558aa5 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30abbf3afe304291981a6a9b85952aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c28ddbdb164f01bb82235c6d49717b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:03.394905 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c8a6aef1-c105-4411-97ac-0fb4b0558aa5 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] 10.222.0.70 "GET /compute/v2.1/servers/3ee4d4db-a1bb-4567-a20d-29003e67a295" status: 200 len: 1471 microversion: 2.1 time: 0.604982 Aug 27 02:42:03.398093 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 359/694] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:02 2022] GET /compute/v2.1/servers/3ee4d4db-a1bb-4567-a20d-29003e67a295 => generated 1471 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:03.593466 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-19b48cc8-b01a-4250-b8a2-f7047619fd7d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:03.602357 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-19b48cc8-b01a-4250-b8a2-f7047619fd7d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/14e68153-ad1e-4028-8580-dcb179346f31" status: 200 len: 1311 microversion: 2.1 time: 0.493416 Aug 27 02:42:03.633002 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 336/695] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:03 2022] GET /compute/v2.1/servers/14e68153-ad1e-4028-8580-dcb179346f31 => generated 1311 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:03.796209 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c52be57f-9995-4a8b-a46a-a8a168e2f9c9 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:03.797409 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-c52be57f-9995-4a8b-a46a-a8a168e2f9c9 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] [instance: b14cde49-7c38-4d62-853b-deb3a4239460] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:03.810493 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c52be57f-9995-4a8b-a46a-a8a168e2f9c9 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:03.812878 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c52be57f-9995-4a8b-a46a-a8a168e2f9c9 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:03.813545 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c52be57f-9995-4a8b-a46a-a8a168e2f9c9 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:03.816131 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c52be57f-9995-4a8b-a46a-a8a168e2f9c9 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:03.818788 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c52be57f-9995-4a8b-a46a-a8a168e2f9c9 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:03.819668 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c52be57f-9995-4a8b-a46a-a8a168e2f9c9 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:04.045046 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-c52be57f-9995-4a8b-a46a-a8a168e2f9c9 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb3ac70d5084c9c826b5722e5302ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25afdc85b9aa4c86bd4f8e2e4a22ff3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:04.058719 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c52be57f-9995-4a8b-a46a-a8a168e2f9c9 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] 10.222.0.70 "GET /compute/v2.1/servers/b14cde49-7c38-4d62-853b-deb3a4239460" status: 200 len: 1218 microversion: 2.1 time: 0.267149 Aug 27 02:42:04.060053 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 360/696] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:03 2022] GET /compute/v2.1/servers/b14cde49-7c38-4d62-853b-deb3a4239460 => generated 1218 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:04.418056 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-5f735929-db0e-4d36-bd63-835b37f09f8e tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:04.418736 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-5f735929-db0e-4d36-bd63-835b37f09f8e tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] [instance: 3ee4d4db-a1bb-4567-a20d-29003e67a295] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:04.427864 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5f735929-db0e-4d36-bd63-835b37f09f8e tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:04.428387 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5f735929-db0e-4d36-bd63-835b37f09f8e tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:04.428834 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5f735929-db0e-4d36-bd63-835b37f09f8e tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:04.429900 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5f735929-db0e-4d36-bd63-835b37f09f8e tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:04.430370 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5f735929-db0e-4d36-bd63-835b37f09f8e tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:04.430791 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5f735929-db0e-4d36-bd63-835b37f09f8e tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:04.637593 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c6d35f5d-e668-4e8f-9e5d-c85cfd182b99 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:04.638440 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-c6d35f5d-e668-4e8f-9e5d-c85cfd182b99 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 14e68153-ad1e-4028-8580-dcb179346f31] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:04.640856 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=98,nova_api:UPDATE=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:42:04.650101 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c6d35f5d-e668-4e8f-9e5d-c85cfd182b99 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:04.652108 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c6d35f5d-e668-4e8f-9e5d-c85cfd182b99 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:04.657073 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c6d35f5d-e668-4e8f-9e5d-c85cfd182b99 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:04.658430 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c6d35f5d-e668-4e8f-9e5d-c85cfd182b99 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:04.659053 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c6d35f5d-e668-4e8f-9e5d-c85cfd182b99 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:04.659625 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c6d35f5d-e668-4e8f-9e5d-c85cfd182b99 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:05.404014 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-5f735929-db0e-4d36-bd63-835b37f09f8e tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30abbf3afe304291981a6a9b85952aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c28ddbdb164f01bb82235c6d49717b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:05.425692 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-5f735929-db0e-4d36-bd63-835b37f09f8e tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] 10.222.0.70 "GET /compute/v2.1/servers/3ee4d4db-a1bb-4567-a20d-29003e67a295" status: 200 len: 1471 microversion: 2.1 time: 1.008476 Aug 27 02:42:05.440651 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 337/697] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:04 2022] GET /compute/v2.1/servers/3ee4d4db-a1bb-4567-a20d-29003e67a295 => generated 1471 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:05.458424 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-029f723e-e690-42f7-813a-3833a4b69018 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:05.459787 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-029f723e-e690-42f7-813a-3833a4b69018 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] [instance: b14cde49-7c38-4d62-853b-deb3a4239460] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:05.469748 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-029f723e-e690-42f7-813a-3833a4b69018 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:05.470594 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-029f723e-e690-42f7-813a-3833a4b69018 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:05.471504 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-029f723e-e690-42f7-813a-3833a4b69018 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:05.472533 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-029f723e-e690-42f7-813a-3833a4b69018 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:05.473273 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-029f723e-e690-42f7-813a-3833a4b69018 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:05.474090 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-029f723e-e690-42f7-813a-3833a4b69018 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:05.502954 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-c6d35f5d-e668-4e8f-9e5d-c85cfd182b99 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:05.515907 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c6d35f5d-e668-4e8f-9e5d-c85cfd182b99 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/14e68153-ad1e-4028-8580-dcb179346f31" status: 200 len: 1311 microversion: 2.1 time: 0.888423 Aug 27 02:42:05.517153 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 361/698] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:04 2022] GET /compute/v2.1/servers/14e68153-ad1e-4028-8580-dcb179346f31 => generated 1311 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:05.667999 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-029f723e-e690-42f7-813a-3833a4b69018 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb3ac70d5084c9c826b5722e5302ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25afdc85b9aa4c86bd4f8e2e4a22ff3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:05.678931 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-029f723e-e690-42f7-813a-3833a4b69018 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] 10.222.0.70 "GET /compute/v2.1/servers/b14cde49-7c38-4d62-853b-deb3a4239460" status: 200 len: 1280 microversion: 2.1 time: 0.234914 Aug 27 02:42:05.694439 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 338/699] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:05 2022] GET /compute/v2.1/servers/b14cde49-7c38-4d62-853b-deb3a4239460 => generated 1280 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:06.455177 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-7b31e5e7-fbc8-4105-afc3-0cfef205125c tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:06.461478 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-7b31e5e7-fbc8-4105-afc3-0cfef205125c tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] [instance: 3ee4d4db-a1bb-4567-a20d-29003e67a295] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:06.477840 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7b31e5e7-fbc8-4105-afc3-0cfef205125c tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:06.478447 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7b31e5e7-fbc8-4105-afc3-0cfef205125c tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:06.479124 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7b31e5e7-fbc8-4105-afc3-0cfef205125c tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:06.480241 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7b31e5e7-fbc8-4105-afc3-0cfef205125c tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:06.480798 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7b31e5e7-fbc8-4105-afc3-0cfef205125c tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:06.481333 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7b31e5e7-fbc8-4105-afc3-0cfef205125c tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:06.539672 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-1d72b0ff-ec19-4591-83ba-055912af87de tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:06.540422 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-1d72b0ff-ec19-4591-83ba-055912af87de tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 14e68153-ad1e-4028-8580-dcb179346f31] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:06.554086 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1d72b0ff-ec19-4591-83ba-055912af87de tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:06.559109 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1d72b0ff-ec19-4591-83ba-055912af87de tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:06.562876 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1d72b0ff-ec19-4591-83ba-055912af87de tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:06.564826 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1d72b0ff-ec19-4591-83ba-055912af87de tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:06.565408 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1d72b0ff-ec19-4591-83ba-055912af87de tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:06.566070 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1d72b0ff-ec19-4591-83ba-055912af87de tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:07.534964 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-7b31e5e7-fbc8-4105-afc3-0cfef205125c tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30abbf3afe304291981a6a9b85952aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c28ddbdb164f01bb82235c6d49717b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:07.552273 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-1d72b0ff-ec19-4591-83ba-055912af87de tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:07.580461 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-7b31e5e7-fbc8-4105-afc3-0cfef205125c tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] 10.222.0.70 "GET /compute/v2.1/servers/3ee4d4db-a1bb-4567-a20d-29003e67a295" status: 200 len: 1471 microversion: 2.1 time: 1.134870 Aug 27 02:42:07.599110 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-1d72b0ff-ec19-4591-83ba-055912af87de tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/14e68153-ad1e-4028-8580-dcb179346f31" status: 200 len: 1493 microversion: 2.1 time: 1.056295 Aug 27 02:42:07.599798 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 339/700] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:06 2022] GET /compute/v2.1/servers/14e68153-ad1e-4028-8580-dcb179346f31 => generated 1493 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:42:07.603085 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 362/701] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:06 2022] GET /compute/v2.1/servers/3ee4d4db-a1bb-4567-a20d-29003e67a295 => generated 1471 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:07.605408 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-9bf7729a-fe9a-4a82-80a6-1f6063a65d44 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:07.606016 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-9bf7729a-fe9a-4a82-80a6-1f6063a65d44 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] [instance: b14cde49-7c38-4d62-853b-deb3a4239460] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:07.613025 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9bf7729a-fe9a-4a82-80a6-1f6063a65d44 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:07.613753 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9bf7729a-fe9a-4a82-80a6-1f6063a65d44 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:07.614410 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9bf7729a-fe9a-4a82-80a6-1f6063a65d44 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:07.615365 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9bf7729a-fe9a-4a82-80a6-1f6063a65d44 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:07.616033 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9bf7729a-fe9a-4a82-80a6-1f6063a65d44 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:07.616715 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9bf7729a-fe9a-4a82-80a6-1f6063a65d44 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:07.631970 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a0cc0cc6-0023-45b4-80da-f86e9fc87de4 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:07.640096 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a0cc0cc6-0023-45b4-80da-f86e9fc87de4 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] [instance: 14e68153-ad1e-4028-8580-dcb179346f31] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:07.662212 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a0cc0cc6-0023-45b4-80da-f86e9fc87de4 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:07.662709 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a0cc0cc6-0023-45b4-80da-f86e9fc87de4 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:07.664910 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a0cc0cc6-0023-45b4-80da-f86e9fc87de4 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:07.667033 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a0cc0cc6-0023-45b4-80da-f86e9fc87de4 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:07.670046 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a0cc0cc6-0023-45b4-80da-f86e9fc87de4 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:07.672158 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a0cc0cc6-0023-45b4-80da-f86e9fc87de4 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:08.166372 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-9bf7729a-fe9a-4a82-80a6-1f6063a65d44 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb3ac70d5084c9c826b5722e5302ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25afdc85b9aa4c86bd4f8e2e4a22ff3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:08.183425 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-9bf7729a-fe9a-4a82-80a6-1f6063a65d44 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] 10.222.0.70 "GET /compute/v2.1/servers/b14cde49-7c38-4d62-853b-deb3a4239460" status: 200 len: 1322 microversion: 2.1 time: 0.582126 Aug 27 02:42:08.188368 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 340/702] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:07 2022] GET /compute/v2.1/servers/b14cde49-7c38-4d62-853b-deb3a4239460 => generated 1322 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:08.302896 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:42:08.315837 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a0cc0cc6-0023-45b4-80da-f86e9fc87de4 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/14e68153-ad1e-4028-8580-dcb179346f31" status: 200 len: 1644 microversion: 2.1 time: 0.690154 Aug 27 02:42:08.319356 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 363/703] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:07 2022] GET /compute/v2.1/servers/14e68153-ad1e-4028-8580-dcb179346f31 => generated 1644 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:08.351189 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a6ca2ac0-8e97-46f2-97b4-20cd4a0393a1 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:08.352243 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-a6ca2ac0-8e97-46f2-97b4-20cd4a0393a1 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] [instance: 14e68153-ad1e-4028-8580-dcb179346f31] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:08.372199 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a6ca2ac0-8e97-46f2-97b4-20cd4a0393a1 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:08.373153 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a6ca2ac0-8e97-46f2-97b4-20cd4a0393a1 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:08.373819 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a6ca2ac0-8e97-46f2-97b4-20cd4a0393a1 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:08.374684 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a6ca2ac0-8e97-46f2-97b4-20cd4a0393a1 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:08.375278 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a6ca2ac0-8e97-46f2-97b4-20cd4a0393a1 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:08.376134 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a6ca2ac0-8e97-46f2-97b4-20cd4a0393a1 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:08.608763 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-066011d5-2d14-4292-9a2d-9628903ff267 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:08.610168 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-066011d5-2d14-4292-9a2d-9628903ff267 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] [instance: 3ee4d4db-a1bb-4567-a20d-29003e67a295] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:08.634026 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-066011d5-2d14-4292-9a2d-9628903ff267 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:08.635032 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-066011d5-2d14-4292-9a2d-9628903ff267 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:08.636047 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-066011d5-2d14-4292-9a2d-9628903ff267 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:08.637757 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-066011d5-2d14-4292-9a2d-9628903ff267 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:08.638808 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-066011d5-2d14-4292-9a2d-9628903ff267 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:08.639782 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-066011d5-2d14-4292-9a2d-9628903ff267 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:08.908429 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:42:08.917930 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a6ca2ac0-8e97-46f2-97b4-20cd4a0393a1 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/14e68153-ad1e-4028-8580-dcb179346f31" status: 200 len: 1644 microversion: 2.1 time: 0.579866 Aug 27 02:42:08.919066 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 341/704] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:08 2022] GET /compute/v2.1/servers/14e68153-ad1e-4028-8580-dcb179346f31 => generated 1644 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:08.932909 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-92086aac-11a4-46ae-9b2b-df6422f3c52c req-bae8849d-8239-4559-889b-57406a25ed3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b14cde49-7c38-4d62-853b-deb3a4239460", "tag": "b29d061d-90e0-4745-abd4-b2821ee2d04e"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:42:08.958342 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-92086aac-11a4-46ae-9b2b-df6422f3c52c req-bae8849d-8239-4559-889b-57406a25ed3e service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:08.959422 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-92086aac-11a4-46ae-9b2b-df6422f3c52c req-bae8849d-8239-4559-889b-57406a25ed3e service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:08.960088 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-92086aac-11a4-46ae-9b2b-df6422f3c52c req-bae8849d-8239-4559-889b-57406a25ed3e service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:08.991318 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-92086aac-11a4-46ae-9b2b-df6422f3c52c req-bae8849d-8239-4559-889b-57406a25ed3e service nova] Creating event network-changed:b29d061d-90e0-4745-abd4-b2821ee2d04e for instance b14cde49-7c38-4d62-853b-deb3a4239460 on n-h1-852278-4 Aug 27 02:42:08.999533 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-92086aac-11a4-46ae-9b2b-df6422f3c52c req-bae8849d-8239-4559-889b-57406a25ed3e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078522 Aug 27 02:42:09.000826 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 342/705] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:42:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:42:09.008702 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7082b54e-147e-48d7-ac96-3be1604c8de7 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:09.013956 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7082b54e-147e-48d7-ac96-3be1604c8de7 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:09.014656 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7082b54e-147e-48d7-ac96-3be1604c8de7 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:09.015894 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7082b54e-147e-48d7-ac96-3be1604c8de7 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:09.016947 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7082b54e-147e-48d7-ac96-3be1604c8de7 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:09.017629 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7082b54e-147e-48d7-ac96-3be1604c8de7 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:09.018269 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7082b54e-147e-48d7-ac96-3be1604c8de7 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:09.058397 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-7082b54e-147e-48d7-ac96-3be1604c8de7 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] 10.222.0.70 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.056018 Aug 27 02:42:09.059793 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 343/706] 10.222.0.70 () {58 vars in 1176 bytes} [Sat Aug 27 02:42:09 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:42:09.071321 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4d822626-62e4-4ada-98e0-574d7cf892ac tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:42:09.072954 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-4d822626-62e4-4ada-98e0-574d7cf892ac tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] [instance: 14e68153-ad1e-4028-8580-dcb179346f31] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:09.083200 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4d822626-62e4-4ada-98e0-574d7cf892ac tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:09.084088 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4d822626-62e4-4ada-98e0-574d7cf892ac tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:09.084826 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4d822626-62e4-4ada-98e0-574d7cf892ac tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:09.085820 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4d822626-62e4-4ada-98e0-574d7cf892ac tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:09.086485 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4d822626-62e4-4ada-98e0-574d7cf892ac tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:09.087381 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4d822626-62e4-4ada-98e0-574d7cf892ac tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:09.209540 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-4d822626-62e4-4ada-98e0-574d7cf892ac tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/14e68153-ad1e-4028-8580-dcb179346f31/action" status: 202 len: 0 microversion: 2.1 time: 0.142011 Aug 27 02:42:09.211628 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 344/707] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 02:42:09 2022] POST /compute/v2.1/servers/14e68153-ad1e-4028-8580-dcb179346f31/action => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 02:42:09.231176 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-1ee1f3c7-fea5-4e8c-acbc-079ec6a2107c tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:09.232890 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-1ee1f3c7-fea5-4e8c-acbc-079ec6a2107c tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] [instance: b14cde49-7c38-4d62-853b-deb3a4239460] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:09.256734 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-066011d5-2d14-4292-9a2d-9628903ff267 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30abbf3afe304291981a6a9b85952aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c28ddbdb164f01bb82235c6d49717b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:09.264969 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1ee1f3c7-fea5-4e8c-acbc-079ec6a2107c tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:09.265586 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-066011d5-2d14-4292-9a2d-9628903ff267 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] 10.222.0.70 "GET /compute/v2.1/servers/3ee4d4db-a1bb-4567-a20d-29003e67a295" status: 200 len: 1471 microversion: 2.1 time: 0.661258 Aug 27 02:42:09.266122 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1ee1f3c7-fea5-4e8c-acbc-079ec6a2107c tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:09.267508 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1ee1f3c7-fea5-4e8c-acbc-079ec6a2107c tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:09.268851 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1ee1f3c7-fea5-4e8c-acbc-079ec6a2107c tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:09.270999 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1ee1f3c7-fea5-4e8c-acbc-079ec6a2107c tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:09.272193 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1ee1f3c7-fea5-4e8c-acbc-079ec6a2107c tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:09.281976 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 364/708] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:08 2022] GET /compute/v2.1/servers/3ee4d4db-a1bb-4567-a20d-29003e67a295 => generated 1471 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:42:09.294385 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5223792a-fcfb-4221-9387-aff8ac14062e tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:09.294996 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-5223792a-fcfb-4221-9387-aff8ac14062e tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] [instance: 14e68153-ad1e-4028-8580-dcb179346f31] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:09.323642 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5223792a-fcfb-4221-9387-aff8ac14062e tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:09.324506 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5223792a-fcfb-4221-9387-aff8ac14062e tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:09.325116 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5223792a-fcfb-4221-9387-aff8ac14062e tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:09.326385 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5223792a-fcfb-4221-9387-aff8ac14062e tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:09.327088 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5223792a-fcfb-4221-9387-aff8ac14062e tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:09.327759 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5223792a-fcfb-4221-9387-aff8ac14062e tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:10.108386 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-1ee1f3c7-fea5-4e8c-acbc-079ec6a2107c tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb3ac70d5084c9c826b5722e5302ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25afdc85b9aa4c86bd4f8e2e4a22ff3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:10.127702 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-1ee1f3c7-fea5-4e8c-acbc-079ec6a2107c tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] 10.222.0.70 "GET /compute/v2.1/servers/b14cde49-7c38-4d62-853b-deb3a4239460" status: 200 len: 1322 microversion: 2.1 time: 0.913781 Aug 27 02:42:10.130110 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 345/709] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:09 2022] GET /compute/v2.1/servers/b14cde49-7c38-4d62-853b-deb3a4239460 => generated 1322 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:10.188303 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-5223792a-fcfb-4221-9387-aff8ac14062e tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/14e68153-ad1e-4028-8580-dcb179346f31" status: 200 len: 1649 microversion: 2.1 time: 0.901217 Aug 27 02:42:10.200492 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 365/710] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:09 2022] GET /compute/v2.1/servers/14e68153-ad1e-4028-8580-dcb179346f31 => generated 1649 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:10.293005 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4f11ac81-1a0d-4c51-9ade-f6871cdba0cc tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:10.294067 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-4f11ac81-1a0d-4c51-9ade-f6871cdba0cc tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] [instance: 3ee4d4db-a1bb-4567-a20d-29003e67a295] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:10.308487 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4f11ac81-1a0d-4c51-9ade-f6871cdba0cc tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:10.309508 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4f11ac81-1a0d-4c51-9ade-f6871cdba0cc tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:10.310179 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4f11ac81-1a0d-4c51-9ade-f6871cdba0cc tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:10.312814 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4f11ac81-1a0d-4c51-9ade-f6871cdba0cc tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:10.324085 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4f11ac81-1a0d-4c51-9ade-f6871cdba0cc tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:10.324794 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4f11ac81-1a0d-4c51-9ade-f6871cdba0cc tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:10.850919 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-4f11ac81-1a0d-4c51-9ade-f6871cdba0cc tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30abbf3afe304291981a6a9b85952aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c28ddbdb164f01bb82235c6d49717b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:10.860160 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-4f11ac81-1a0d-4c51-9ade-f6871cdba0cc tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] 10.222.0.70 "GET /compute/v2.1/servers/3ee4d4db-a1bb-4567-a20d-29003e67a295" status: 200 len: 1471 microversion: 2.1 time: 0.572270 Aug 27 02:42:10.863901 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 346/711] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:10 2022] GET /compute/v2.1/servers/3ee4d4db-a1bb-4567-a20d-29003e67a295 => generated 1471 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:11.150071 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-fbb213df-eff7-42e8-86e4-d6bbd2e85cb0 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:11.150686 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-fbb213df-eff7-42e8-86e4-d6bbd2e85cb0 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] [instance: b14cde49-7c38-4d62-853b-deb3a4239460] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:11.166722 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fbb213df-eff7-42e8-86e4-d6bbd2e85cb0 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:11.167247 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fbb213df-eff7-42e8-86e4-d6bbd2e85cb0 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:11.167695 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fbb213df-eff7-42e8-86e4-d6bbd2e85cb0 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:11.168461 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fbb213df-eff7-42e8-86e4-d6bbd2e85cb0 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:11.173235 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fbb213df-eff7-42e8-86e4-d6bbd2e85cb0 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:11.174070 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fbb213df-eff7-42e8-86e4-d6bbd2e85cb0 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:11.214428 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-5f96d47b-bf42-4400-a259-548e7cae2033 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:11.215743 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-5f96d47b-bf42-4400-a259-548e7cae2033 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] [instance: 14e68153-ad1e-4028-8580-dcb179346f31] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:11.224647 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5f96d47b-bf42-4400-a259-548e7cae2033 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:11.227559 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5f96d47b-bf42-4400-a259-548e7cae2033 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:11.228069 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5f96d47b-bf42-4400-a259-548e7cae2033 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:11.230995 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5f96d47b-bf42-4400-a259-548e7cae2033 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:11.231579 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5f96d47b-bf42-4400-a259-548e7cae2033 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:11.232902 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5f96d47b-bf42-4400-a259-548e7cae2033 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:11.881496 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-fbb213df-eff7-42e8-86e4-d6bbd2e85cb0 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb3ac70d5084c9c826b5722e5302ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25afdc85b9aa4c86bd4f8e2e4a22ff3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:11.894033 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-fbb213df-eff7-42e8-86e4-d6bbd2e85cb0 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] 10.222.0.70 "GET /compute/v2.1/servers/b14cde49-7c38-4d62-853b-deb3a4239460" status: 200 len: 1322 microversion: 2.1 time: 0.747896 Aug 27 02:42:11.894963 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 366/712] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:11 2022] GET /compute/v2.1/servers/b14cde49-7c38-4d62-853b-deb3a4239460 => generated 1322 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:11.917201 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-04a5a24f-5950-4102-834d-0f5fab1df0f9 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:11.918207 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-04a5a24f-5950-4102-834d-0f5fab1df0f9 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] [instance: 3ee4d4db-a1bb-4567-a20d-29003e67a295] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:11.930188 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=5 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:42:11.931815 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-04a5a24f-5950-4102-834d-0f5fab1df0f9 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:11.935093 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-04a5a24f-5950-4102-834d-0f5fab1df0f9 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:11.935629 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-04a5a24f-5950-4102-834d-0f5fab1df0f9 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:11.936427 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-04a5a24f-5950-4102-834d-0f5fab1df0f9 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:11.936903 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-04a5a24f-5950-4102-834d-0f5fab1df0f9 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:11.941045 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-5f96d47b-bf42-4400-a259-548e7cae2033 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/14e68153-ad1e-4028-8580-dcb179346f31" status: 200 len: 1629 microversion: 2.1 time: 0.730589 Aug 27 02:42:11.956374 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 347/713] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:11 2022] GET /compute/v2.1/servers/14e68153-ad1e-4028-8580-dcb179346f31 => generated 1629 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:11.956802 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-04a5a24f-5950-4102-834d-0f5fab1df0f9 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:11.965432 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e73a8824-8022-4136-abc1-411c10540466 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-852278-4", "block_migration": true, "disk_over_commit": false}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:42:11.968618 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-e73a8824-8022-4136-abc1-411c10540466 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] [instance: 14e68153-ad1e-4028-8580-dcb179346f31] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:11.978902 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e73a8824-8022-4136-abc1-411c10540466 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:11.979404 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e73a8824-8022-4136-abc1-411c10540466 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:11.979994 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e73a8824-8022-4136-abc1-411c10540466 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:11.980752 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e73a8824-8022-4136-abc1-411c10540466 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:11.989695 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e73a8824-8022-4136-abc1-411c10540466 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:11.990149 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e73a8824-8022-4136-abc1-411c10540466 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:12.061887 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.objects.instance [None req-e73a8824-8022-4136-abc1-411c10540466 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Lazy-loading 'flavor' on Instance uuid 14e68153-ad1e-4028-8580-dcb179346f31 {{(pid=134051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:42:12.080346 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-e73a8824-8022-4136-abc1-411c10540466 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] [instance: 14e68153-ad1e-4028-8580-dcb179346f31] Going to try to live migrate instance to n-h1-852278-4 {{(pid=134051) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 27 02:42:12.424957 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-04a5a24f-5950-4102-834d-0f5fab1df0f9 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30abbf3afe304291981a6a9b85952aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c28ddbdb164f01bb82235c6d49717b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:12.438648 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-04a5a24f-5950-4102-834d-0f5fab1df0f9 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] 10.222.0.70 "GET /compute/v2.1/servers/3ee4d4db-a1bb-4567-a20d-29003e67a295" status: 200 len: 1471 microversion: 2.1 time: 0.540099 Aug 27 02:42:12.440897 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 367/714] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:11 2022] GET /compute/v2.1/servers/3ee4d4db-a1bb-4567-a20d-29003e67a295 => generated 1471 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:12.441038 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=8 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:42:12.930362 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-87b858e6-0d1b-48a8-ab8c-6d7aef8bbf3b tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:12.930362 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-87b858e6-0d1b-48a8-ab8c-6d7aef8bbf3b tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] [instance: b14cde49-7c38-4d62-853b-deb3a4239460] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:12.933579 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=4 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:42:12.942953 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-87b858e6-0d1b-48a8-ab8c-6d7aef8bbf3b tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:12.944118 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-87b858e6-0d1b-48a8-ab8c-6d7aef8bbf3b tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:12.952182 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-87b858e6-0d1b-48a8-ab8c-6d7aef8bbf3b tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:12.962226 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-87b858e6-0d1b-48a8-ab8c-6d7aef8bbf3b tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:12.962873 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-87b858e6-0d1b-48a8-ab8c-6d7aef8bbf3b tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:12.963321 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-87b858e6-0d1b-48a8-ab8c-6d7aef8bbf3b tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:13.410478 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-87b858e6-0d1b-48a8-ab8c-6d7aef8bbf3b tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb3ac70d5084c9c826b5722e5302ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25afdc85b9aa4c86bd4f8e2e4a22ff3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:13.431175 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-87b858e6-0d1b-48a8-ab8c-6d7aef8bbf3b tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] 10.222.0.70 "GET /compute/v2.1/servers/b14cde49-7c38-4d62-853b-deb3a4239460" status: 200 len: 1322 microversion: 2.1 time: 0.515425 Aug 27 02:42:13.436460 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 368/715] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:12 2022] GET /compute/v2.1/servers/b14cde49-7c38-4d62-853b-deb3a4239460 => generated 1322 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:42:13.462110 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ae22e75c-2bc3-4ea7-bba7-365ac8827ae7 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:13.463055 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-ae22e75c-2bc3-4ea7-bba7-365ac8827ae7 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] [instance: 3ee4d4db-a1bb-4567-a20d-29003e67a295] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:13.478350 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ae22e75c-2bc3-4ea7-bba7-365ac8827ae7 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:13.481258 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ae22e75c-2bc3-4ea7-bba7-365ac8827ae7 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:13.483721 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ae22e75c-2bc3-4ea7-bba7-365ac8827ae7 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:13.485033 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ae22e75c-2bc3-4ea7-bba7-365ac8827ae7 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:13.485657 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ae22e75c-2bc3-4ea7-bba7-365ac8827ae7 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:13.486821 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ae22e75c-2bc3-4ea7-bba7-365ac8827ae7 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:14.005366 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e73a8824-8022-4136-abc1-411c10540466 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/14e68153-ad1e-4028-8580-dcb179346f31/action" status: 202 len: 0 microversion: 2.1 time: 2.046218 Aug 27 02:42:14.006531 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 348/716] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 02:42:11 2022] POST /compute/v2.1/servers/14e68153-ad1e-4028-8580-dcb179346f31/action => generated 0 bytes in 2049 msecs (HTTP/1.1 202) 9 headers in 361 bytes (3 switches on core 0) Aug 27 02:42:14.016095 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-06b4cd96-d1a5-472c-82c5-07fd307e3cd2 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:14.019017 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-06b4cd96-d1a5-472c-82c5-07fd307e3cd2 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 14e68153-ad1e-4028-8580-dcb179346f31] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:14.041008 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-06b4cd96-d1a5-472c-82c5-07fd307e3cd2 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:14.041518 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-06b4cd96-d1a5-472c-82c5-07fd307e3cd2 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:14.041957 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-06b4cd96-d1a5-472c-82c5-07fd307e3cd2 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:14.042683 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-06b4cd96-d1a5-472c-82c5-07fd307e3cd2 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:14.043135 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-06b4cd96-d1a5-472c-82c5-07fd307e3cd2 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:14.043560 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-06b4cd96-d1a5-472c-82c5-07fd307e3cd2 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:14.352516 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-ae22e75c-2bc3-4ea7-bba7-365ac8827ae7 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30abbf3afe304291981a6a9b85952aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c28ddbdb164f01bb82235c6d49717b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:14.362304 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ae22e75c-2bc3-4ea7-bba7-365ac8827ae7 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] 10.222.0.70 "GET /compute/v2.1/servers/3ee4d4db-a1bb-4567-a20d-29003e67a295" status: 200 len: 1471 microversion: 2.1 time: 0.904458 Aug 27 02:42:14.363641 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 369/717] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:13 2022] GET /compute/v2.1/servers/3ee4d4db-a1bb-4567-a20d-29003e67a295 => generated 1471 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:14.456144 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-386ea41a-00bd-46b3-94ab-ff9af163174c tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:14.456900 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-386ea41a-00bd-46b3-94ab-ff9af163174c tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] [instance: b14cde49-7c38-4d62-853b-deb3a4239460] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:14.480961 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-386ea41a-00bd-46b3-94ab-ff9af163174c tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:14.482344 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-386ea41a-00bd-46b3-94ab-ff9af163174c tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:14.483046 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-386ea41a-00bd-46b3-94ab-ff9af163174c tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:14.486154 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-386ea41a-00bd-46b3-94ab-ff9af163174c tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:14.503459 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-386ea41a-00bd-46b3-94ab-ff9af163174c tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:14.504522 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-386ea41a-00bd-46b3-94ab-ff9af163174c tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:14.550494 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-06b4cd96-d1a5-472c-82c5-07fd307e3cd2 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:14.570392 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-06b4cd96-d1a5-472c-82c5-07fd307e3cd2 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/14e68153-ad1e-4028-8580-dcb179346f31" status: 200 len: 1503 microversion: 2.1 time: 0.555643 Aug 27 02:42:14.584490 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 349/718] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:14 2022] GET /compute/v2.1/servers/14e68153-ad1e-4028-8580-dcb179346f31 => generated 1503 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:15.285704 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-386ea41a-00bd-46b3-94ab-ff9af163174c tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb3ac70d5084c9c826b5722e5302ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25afdc85b9aa4c86bd4f8e2e4a22ff3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:15.295392 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-386ea41a-00bd-46b3-94ab-ff9af163174c tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] 10.222.0.70 "GET /compute/v2.1/servers/b14cde49-7c38-4d62-853b-deb3a4239460" status: 200 len: 1322 microversion: 2.1 time: 0.843859 Aug 27 02:42:15.299893 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 370/719] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:14 2022] GET /compute/v2.1/servers/b14cde49-7c38-4d62-853b-deb3a4239460 => generated 1322 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:42:15.384134 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7d3d7fe0-d8b7-426d-9956-b52d9ff54cbe tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:15.384781 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-7d3d7fe0-d8b7-426d-9956-b52d9ff54cbe tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] [instance: 3ee4d4db-a1bb-4567-a20d-29003e67a295] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:15.397344 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7d3d7fe0-d8b7-426d-9956-b52d9ff54cbe tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:15.398093 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7d3d7fe0-d8b7-426d-9956-b52d9ff54cbe tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:15.398719 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7d3d7fe0-d8b7-426d-9956-b52d9ff54cbe tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:15.403283 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7d3d7fe0-d8b7-426d-9956-b52d9ff54cbe tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:15.406373 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7d3d7fe0-d8b7-426d-9956-b52d9ff54cbe tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:15.407274 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7d3d7fe0-d8b7-426d-9956-b52d9ff54cbe tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:15.608583 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-654369aa-eb0c-4349-aece-55edf6d0b9cd tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:15.609945 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-654369aa-eb0c-4349-aece-55edf6d0b9cd tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 14e68153-ad1e-4028-8580-dcb179346f31] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:15.622303 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-654369aa-eb0c-4349-aece-55edf6d0b9cd tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:15.624330 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-654369aa-eb0c-4349-aece-55edf6d0b9cd tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:15.625034 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-654369aa-eb0c-4349-aece-55edf6d0b9cd tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:15.627846 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-654369aa-eb0c-4349-aece-55edf6d0b9cd tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:15.629215 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-654369aa-eb0c-4349-aece-55edf6d0b9cd tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:15.631757 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-654369aa-eb0c-4349-aece-55edf6d0b9cd tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:16.337041 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-654369aa-eb0c-4349-aece-55edf6d0b9cd tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:16.346307 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-654369aa-eb0c-4349-aece-55edf6d0b9cd tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/14e68153-ad1e-4028-8580-dcb179346f31" status: 200 len: 1503 microversion: 2.1 time: 0.753216 Aug 27 02:42:16.349010 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 371/720] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:15 2022] GET /compute/v2.1/servers/14e68153-ad1e-4028-8580-dcb179346f31 => generated 1503 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:16.357254 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-552e319c-f551-47c8-ad4d-31f8db652dbd req-eadda276-8e64-4c05-98cc-918f15e3445d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14e68153-ad1e-4028-8580-dcb179346f31", "name": "network-vif-unplugged", "status": "completed", "tag": "a809e218-d2b7-4a52-83bd-7fc04b36e71e"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:42:16.378298 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-552e319c-f551-47c8-ad4d-31f8db652dbd req-eadda276-8e64-4c05-98cc-918f15e3445d service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:16.378784 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-552e319c-f551-47c8-ad4d-31f8db652dbd req-eadda276-8e64-4c05-98cc-918f15e3445d service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:16.388997 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-552e319c-f551-47c8-ad4d-31f8db652dbd req-eadda276-8e64-4c05-98cc-918f15e3445d service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:16.402532 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-7d3d7fe0-d8b7-426d-9956-b52d9ff54cbe tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30abbf3afe304291981a6a9b85952aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c28ddbdb164f01bb82235c6d49717b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:16.415138 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-7d3d7fe0-d8b7-426d-9956-b52d9ff54cbe tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] 10.222.0.70 "GET /compute/v2.1/servers/3ee4d4db-a1bb-4567-a20d-29003e67a295" status: 200 len: 1471 microversion: 2.1 time: 1.035905 Aug 27 02:42:16.416874 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 350/721] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:15 2022] GET /compute/v2.1/servers/3ee4d4db-a1bb-4567-a20d-29003e67a295 => generated 1471 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:16.428221 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e2d72b65-6ba1-4058-9518-887d35f89d33 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:16.429174 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-e2d72b65-6ba1-4058-9518-887d35f89d33 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] [instance: b14cde49-7c38-4d62-853b-deb3a4239460] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:16.443907 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-552e319c-f551-47c8-ad4d-31f8db652dbd req-eadda276-8e64-4c05-98cc-918f15e3445d service nova] Creating event network-vif-unplugged:a809e218-d2b7-4a52-83bd-7fc04b36e71e for instance 14e68153-ad1e-4028-8580-dcb179346f31 on n-h2-852278-4 Aug 27 02:42:16.447906 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e2d72b65-6ba1-4058-9518-887d35f89d33 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:16.448562 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e2d72b65-6ba1-4058-9518-887d35f89d33 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:16.449223 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e2d72b65-6ba1-4058-9518-887d35f89d33 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:16.449945 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e2d72b65-6ba1-4058-9518-887d35f89d33 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:16.452072 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-552e319c-f551-47c8-ad4d-31f8db652dbd req-eadda276-8e64-4c05-98cc-918f15e3445d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.101576 Aug 27 02:42:16.452845 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e2d72b65-6ba1-4058-9518-887d35f89d33 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:16.453560 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 372/722] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:42:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:42:16.457057 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e2d72b65-6ba1-4058-9518-887d35f89d33 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:16.774787 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-ab6db253-00ec-44a2-a063-3fc7fe9b45eb req-ed889193-637a-4771-b660-55114fa0040a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b14cde49-7c38-4d62-853b-deb3a4239460", "name": "network-vif-plugged", "status": "completed", "tag": "b29d061d-90e0-4745-abd4-b2821ee2d04e"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:42:16.793822 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-ab6db253-00ec-44a2-a063-3fc7fe9b45eb req-ed889193-637a-4771-b660-55114fa0040a service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:16.794657 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-ab6db253-00ec-44a2-a063-3fc7fe9b45eb req-ed889193-637a-4771-b660-55114fa0040a service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:16.795487 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-ab6db253-00ec-44a2-a063-3fc7fe9b45eb req-ed889193-637a-4771-b660-55114fa0040a service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:16.810371 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-ab6db253-00ec-44a2-a063-3fc7fe9b45eb req-ed889193-637a-4771-b660-55114fa0040a service nova] Creating event network-vif-plugged:b29d061d-90e0-4745-abd4-b2821ee2d04e for instance b14cde49-7c38-4d62-853b-deb3a4239460 on n-h1-852278-4 Aug 27 02:42:16.816782 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-ab6db253-00ec-44a2-a063-3fc7fe9b45eb req-ed889193-637a-4771-b660-55114fa0040a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046839 Aug 27 02:42:16.818112 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 373/723] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:42:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:42:17.157058 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e2d72b65-6ba1-4058-9518-887d35f89d33 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb3ac70d5084c9c826b5722e5302ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25afdc85b9aa4c86bd4f8e2e4a22ff3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:17.165392 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e2d72b65-6ba1-4058-9518-887d35f89d33 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] 10.222.0.70 "GET /compute/v2.1/servers/b14cde49-7c38-4d62-853b-deb3a4239460" status: 200 len: 1322 microversion: 2.1 time: 0.747370 Aug 27 02:42:17.166169 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 351/724] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:16 2022] GET /compute/v2.1/servers/b14cde49-7c38-4d62-853b-deb3a4239460 => generated 1322 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:17.376941 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-edc04295-4eac-47e3-9067-39d1a3622d13 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:17.378554 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-edc04295-4eac-47e3-9067-39d1a3622d13 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 14e68153-ad1e-4028-8580-dcb179346f31] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:17.393741 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-edc04295-4eac-47e3-9067-39d1a3622d13 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:17.394570 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-edc04295-4eac-47e3-9067-39d1a3622d13 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:17.395192 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-edc04295-4eac-47e3-9067-39d1a3622d13 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:17.396189 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-edc04295-4eac-47e3-9067-39d1a3622d13 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:17.397235 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-edc04295-4eac-47e3-9067-39d1a3622d13 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:17.397810 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-edc04295-4eac-47e3-9067-39d1a3622d13 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:17.440576 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-24e748a2-1adf-4229-92f0-e6f83258c961 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:17.440576 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-24e748a2-1adf-4229-92f0-e6f83258c961 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] [instance: 3ee4d4db-a1bb-4567-a20d-29003e67a295] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:17.451173 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-24e748a2-1adf-4229-92f0-e6f83258c961 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:17.451829 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-24e748a2-1adf-4229-92f0-e6f83258c961 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:17.453208 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-24e748a2-1adf-4229-92f0-e6f83258c961 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:17.458536 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-24e748a2-1adf-4229-92f0-e6f83258c961 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:17.459160 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-24e748a2-1adf-4229-92f0-e6f83258c961 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:17.459908 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-24e748a2-1adf-4229-92f0-e6f83258c961 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:17.949207 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-edc04295-4eac-47e3-9067-39d1a3622d13 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:17.964441 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-edc04295-4eac-47e3-9067-39d1a3622d13 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/14e68153-ad1e-4028-8580-dcb179346f31" status: 200 len: 1503 microversion: 2.1 time: 0.591030 Aug 27 02:42:17.969774 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-24e748a2-1adf-4229-92f0-e6f83258c961 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30abbf3afe304291981a6a9b85952aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c28ddbdb164f01bb82235c6d49717b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:17.974243 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 374/725] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:17 2022] GET /compute/v2.1/servers/14e68153-ad1e-4028-8580-dcb179346f31 => generated 1503 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:17.979483 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-24e748a2-1adf-4229-92f0-e6f83258c961 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] 10.222.0.70 "GET /compute/v2.1/servers/3ee4d4db-a1bb-4567-a20d-29003e67a295" status: 200 len: 1471 microversion: 2.1 time: 0.544172 Aug 27 02:42:17.997126 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 352/726] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:17 2022] GET /compute/v2.1/servers/3ee4d4db-a1bb-4567-a20d-29003e67a295 => generated 1471 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:18.187111 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-eb442baa-dead-4a1c-9ca4-e9ffec847ca0 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:18.187748 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-eb442baa-dead-4a1c-9ca4-e9ffec847ca0 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] [instance: b14cde49-7c38-4d62-853b-deb3a4239460] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:18.199401 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eb442baa-dead-4a1c-9ca4-e9ffec847ca0 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:18.200218 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eb442baa-dead-4a1c-9ca4-e9ffec847ca0 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:18.200890 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eb442baa-dead-4a1c-9ca4-e9ffec847ca0 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:18.201798 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eb442baa-dead-4a1c-9ca4-e9ffec847ca0 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:18.204213 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eb442baa-dead-4a1c-9ca4-e9ffec847ca0 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:18.206855 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eb442baa-dead-4a1c-9ca4-e9ffec847ca0 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:18.414538 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-2c83ff5e-d6a9-4911-920e-ac1af15faba2 tempest-FloatingIPDetailsTestJSON-1296090266 tempest-FloatingIPDetailsTestJSON-1296090266-project] Action: 'create', calling method: .version_select at 0x7f5ee359ac10>, body: {"pool": null} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:42:18.936546 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-eb442baa-dead-4a1c-9ca4-e9ffec847ca0 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb3ac70d5084c9c826b5722e5302ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25afdc85b9aa4c86bd4f8e2e4a22ff3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:18.947795 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-eb442baa-dead-4a1c-9ca4-e9ffec847ca0 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] 10.222.0.70 "GET /compute/v2.1/servers/b14cde49-7c38-4d62-853b-deb3a4239460" status: 200 len: 1322 microversion: 2.1 time: 0.764938 Aug 27 02:42:18.953281 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 353/727] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:18 2022] GET /compute/v2.1/servers/b14cde49-7c38-4d62-853b-deb3a4239460 => generated 1322 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:18.958461 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-cb5241bd-7f66-4c30-84ba-aaeec3015376 req-5352cfa7-feec-4c2d-ba7f-1d7bb73b6527 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14e68153-ad1e-4028-8580-dcb179346f31", "tag": "a809e218-d2b7-4a52-83bd-7fc04b36e71e"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:42:18.978926 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-cb5241bd-7f66-4c30-84ba-aaeec3015376 req-5352cfa7-feec-4c2d-ba7f-1d7bb73b6527 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:18.984407 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-cb5241bd-7f66-4c30-84ba-aaeec3015376 req-5352cfa7-feec-4c2d-ba7f-1d7bb73b6527 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:18.985088 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-cb5241bd-7f66-4c30-84ba-aaeec3015376 req-5352cfa7-feec-4c2d-ba7f-1d7bb73b6527 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:19.011811 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-cb5241bd-7f66-4c30-84ba-aaeec3015376 req-5352cfa7-feec-4c2d-ba7f-1d7bb73b6527 service nova] Creating event network-changed:a809e218-d2b7-4a52-83bd-7fc04b36e71e for instance 14e68153-ad1e-4028-8580-dcb179346f31 on n-h2-852278-4 Aug 27 02:42:19.024093 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-cb5241bd-7f66-4c30-84ba-aaeec3015376 req-5352cfa7-feec-4c2d-ba7f-1d7bb73b6527 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069422 Aug 27 02:42:19.025188 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 354/728] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:42:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:42:19.027269 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=16 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:42:19.031964 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-59e332f2-9332-4e25-8563-05976ec73aff tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:19.045895 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-59e332f2-9332-4e25-8563-05976ec73aff tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 14e68153-ad1e-4028-8580-dcb179346f31] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:19.053126 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-59e332f2-9332-4e25-8563-05976ec73aff tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:19.054082 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-59e332f2-9332-4e25-8563-05976ec73aff tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:19.055198 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-59e332f2-9332-4e25-8563-05976ec73aff tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:19.057259 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-59e332f2-9332-4e25-8563-05976ec73aff tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:19.057875 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-59e332f2-9332-4e25-8563-05976ec73aff tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:19.058618 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-59e332f2-9332-4e25-8563-05976ec73aff tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:19.412925 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-59e332f2-9332-4e25-8563-05976ec73aff tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:19.426407 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-59e332f2-9332-4e25-8563-05976ec73aff tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/14e68153-ad1e-4028-8580-dcb179346f31" status: 200 len: 1503 microversion: 2.1 time: 0.397619 Aug 27 02:42:19.427067 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 355/729] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:19 2022] GET /compute/v2.1/servers/14e68153-ad1e-4028-8580-dcb179346f31 => generated 1503 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:19.436296 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-61bfa988-2915-462d-88ae-3c8296ae5a7f tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:19.441487 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-61bfa988-2915-462d-88ae-3c8296ae5a7f tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] [instance: 3ee4d4db-a1bb-4567-a20d-29003e67a295] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:19.454928 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-61bfa988-2915-462d-88ae-3c8296ae5a7f tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:19.455821 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-61bfa988-2915-462d-88ae-3c8296ae5a7f tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:19.456631 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-61bfa988-2915-462d-88ae-3c8296ae5a7f tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:19.457547 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-61bfa988-2915-462d-88ae-3c8296ae5a7f tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:19.458157 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-61bfa988-2915-462d-88ae-3c8296ae5a7f tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:19.458734 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-61bfa988-2915-462d-88ae-3c8296ae5a7f tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:19.858328 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-61bfa988-2915-462d-88ae-3c8296ae5a7f tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30abbf3afe304291981a6a9b85952aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c28ddbdb164f01bb82235c6d49717b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:19.870963 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-61bfa988-2915-462d-88ae-3c8296ae5a7f tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] 10.222.0.70 "GET /compute/v2.1/servers/3ee4d4db-a1bb-4567-a20d-29003e67a295" status: 200 len: 1471 microversion: 2.1 time: 0.442385 Aug 27 02:42:19.871762 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 356/730] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:19 2022] GET /compute/v2.1/servers/3ee4d4db-a1bb-4567-a20d-29003e67a295 => generated 1471 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:19.970591 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-673a4a1a-623f-44d0-9b8f-b1f52194252c tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:19.972409 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-673a4a1a-623f-44d0-9b8f-b1f52194252c tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] [instance: b14cde49-7c38-4d62-853b-deb3a4239460] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:19.986705 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-673a4a1a-623f-44d0-9b8f-b1f52194252c tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:19.987459 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-673a4a1a-623f-44d0-9b8f-b1f52194252c tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:19.988213 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-673a4a1a-623f-44d0-9b8f-b1f52194252c tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:19.989664 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-673a4a1a-623f-44d0-9b8f-b1f52194252c tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:19.992712 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-673a4a1a-623f-44d0-9b8f-b1f52194252c tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:19.993374 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-673a4a1a-623f-44d0-9b8f-b1f52194252c tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:20.060052 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:42:20.468177 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-673a4a1a-623f-44d0-9b8f-b1f52194252c tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb3ac70d5084c9c826b5722e5302ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25afdc85b9aa4c86bd4f8e2e4a22ff3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:20.480750 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-673a4a1a-623f-44d0-9b8f-b1f52194252c tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] 10.222.0.70 "GET /compute/v2.1/servers/b14cde49-7c38-4d62-853b-deb3a4239460" status: 200 len: 1471 microversion: 2.1 time: 0.511016 Aug 27 02:42:20.481773 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 357/731] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:19 2022] GET /compute/v2.1/servers/b14cde49-7c38-4d62-853b-deb3a4239460 => generated 1471 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:42:20.492634 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-aea2b7c2-a375-4763-b749-d40be2880384 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:20.493504 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-aea2b7c2-a375-4763-b749-d40be2880384 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 14e68153-ad1e-4028-8580-dcb179346f31] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:20.509097 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-aea2b7c2-a375-4763-b749-d40be2880384 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:20.509715 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-aea2b7c2-a375-4763-b749-d40be2880384 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:20.510034 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-aea2b7c2-a375-4763-b749-d40be2880384 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:20.510766 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-aea2b7c2-a375-4763-b749-d40be2880384 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:20.521141 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-aea2b7c2-a375-4763-b749-d40be2880384 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:20.521608 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-aea2b7c2-a375-4763-b749-d40be2880384 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:20.780841 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-aea2b7c2-a375-4763-b749-d40be2880384 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:20.815548 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-aea2b7c2-a375-4763-b749-d40be2880384 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/14e68153-ad1e-4028-8580-dcb179346f31" status: 200 len: 1503 microversion: 2.1 time: 0.332378 Aug 27 02:42:20.820459 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 358/732] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:20 2022] GET /compute/v2.1/servers/14e68153-ad1e-4028-8580-dcb179346f31 => generated 1503 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:20.849047 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-6c79bbf3-def0-4b7e-8447-2bec4f1d6c73 tempest-ServersAdminNegativeTestJSON-1848621224 tempest-ServersAdminNegativeTestJSON-1848621224-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:42:20.850193 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-6c79bbf3-def0-4b7e-8447-2bec4f1d6c73 tempest-ServersAdminNegativeTestJSON-1848621224 tempest-ServersAdminNegativeTestJSON-1848621224-project-admin] [instance: b14cde49-7c38-4d62-853b-deb3a4239460] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:20.872378 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6c79bbf3-def0-4b7e-8447-2bec4f1d6c73 tempest-ServersAdminNegativeTestJSON-1848621224 tempest-ServersAdminNegativeTestJSON-1848621224-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:20.877947 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6c79bbf3-def0-4b7e-8447-2bec4f1d6c73 tempest-ServersAdminNegativeTestJSON-1848621224 tempest-ServersAdminNegativeTestJSON-1848621224-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:20.878451 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6c79bbf3-def0-4b7e-8447-2bec4f1d6c73 tempest-ServersAdminNegativeTestJSON-1848621224 tempest-ServersAdminNegativeTestJSON-1848621224-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:20.879219 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6c79bbf3-def0-4b7e-8447-2bec4f1d6c73 tempest-ServersAdminNegativeTestJSON-1848621224 tempest-ServersAdminNegativeTestJSON-1848621224-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:20.882608 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6c79bbf3-def0-4b7e-8447-2bec4f1d6c73 tempest-ServersAdminNegativeTestJSON-1848621224 tempest-ServersAdminNegativeTestJSON-1848621224-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:20.883053 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6c79bbf3-def0-4b7e-8447-2bec4f1d6c73 tempest-ServersAdminNegativeTestJSON-1848621224 tempest-ServersAdminNegativeTestJSON-1848621224-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:20.919188 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.objects.instance [None req-6c79bbf3-def0-4b7e-8447-2bec4f1d6c73 tempest-ServersAdminNegativeTestJSON-1848621224 tempest-ServersAdminNegativeTestJSON-1848621224-project-admin] Lazy-loading 'flavor' on Instance uuid b14cde49-7c38-4d62-853b-deb3a4239460 {{(pid=134051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:42:21.065968 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-6c79bbf3-def0-4b7e-8447-2bec4f1d6c73 tempest-ServersAdminNegativeTestJSON-1848621224 tempest-ServersAdminNegativeTestJSON-1848621224-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/b14cde49-7c38-4d62-853b-deb3a4239460/action" status: 202 len: 0 microversion: 2.1 time: 0.243659 Aug 27 02:42:21.068016 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 359/733] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 02:42:20 2022] POST /compute/v2.1/servers/b14cde49-7c38-4d62-853b-deb3a4239460/action => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:42:21.075642 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-37176f8e-e96b-4ba0-9850-cf5d20b6d16e tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:21.076676 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-37176f8e-e96b-4ba0-9850-cf5d20b6d16e tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] [instance: 3ee4d4db-a1bb-4567-a20d-29003e67a295] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:21.083577 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-37176f8e-e96b-4ba0-9850-cf5d20b6d16e tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:21.084021 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-37176f8e-e96b-4ba0-9850-cf5d20b6d16e tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:21.084582 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-37176f8e-e96b-4ba0-9850-cf5d20b6d16e tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:21.086123 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-37176f8e-e96b-4ba0-9850-cf5d20b6d16e tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:21.086590 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-37176f8e-e96b-4ba0-9850-cf5d20b6d16e tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:21.087214 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-37176f8e-e96b-4ba0-9850-cf5d20b6d16e tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:21.546339 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-37176f8e-e96b-4ba0-9850-cf5d20b6d16e tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30abbf3afe304291981a6a9b85952aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c28ddbdb164f01bb82235c6d49717b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:21.561830 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-37176f8e-e96b-4ba0-9850-cf5d20b6d16e tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] 10.222.0.70 "GET /compute/v2.1/servers/3ee4d4db-a1bb-4567-a20d-29003e67a295" status: 200 len: 1471 microversion: 2.1 time: 0.491714 Aug 27 02:42:21.563665 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 360/734] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:21 2022] GET /compute/v2.1/servers/3ee4d4db-a1bb-4567-a20d-29003e67a295 => generated 1471 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:21.568789 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7c8e16ca-35dc-4430-b8ad-7252fda81f09 tempest-ServersAdminNegativeTestJSON-1848621224 tempest-ServersAdminNegativeTestJSON-1848621224-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:21.569724 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-7c8e16ca-35dc-4430-b8ad-7252fda81f09 tempest-ServersAdminNegativeTestJSON-1848621224 tempest-ServersAdminNegativeTestJSON-1848621224-project-admin] [instance: b14cde49-7c38-4d62-853b-deb3a4239460] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:21.576898 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7c8e16ca-35dc-4430-b8ad-7252fda81f09 tempest-ServersAdminNegativeTestJSON-1848621224 tempest-ServersAdminNegativeTestJSON-1848621224-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:21.578146 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7c8e16ca-35dc-4430-b8ad-7252fda81f09 tempest-ServersAdminNegativeTestJSON-1848621224 tempest-ServersAdminNegativeTestJSON-1848621224-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:21.578808 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7c8e16ca-35dc-4430-b8ad-7252fda81f09 tempest-ServersAdminNegativeTestJSON-1848621224 tempest-ServersAdminNegativeTestJSON-1848621224-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:21.579731 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7c8e16ca-35dc-4430-b8ad-7252fda81f09 tempest-ServersAdminNegativeTestJSON-1848621224 tempest-ServersAdminNegativeTestJSON-1848621224-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:21.580733 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7c8e16ca-35dc-4430-b8ad-7252fda81f09 tempest-ServersAdminNegativeTestJSON-1848621224 tempest-ServersAdminNegativeTestJSON-1848621224-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:21.581477 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7c8e16ca-35dc-4430-b8ad-7252fda81f09 tempest-ServersAdminNegativeTestJSON-1848621224 tempest-ServersAdminNegativeTestJSON-1848621224-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:22.122626 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-2c83ff5e-d6a9-4911-920e-ac1af15faba2 tempest-FloatingIPDetailsTestJSON-1296090266 tempest-FloatingIPDetailsTestJSON-1296090266-project] 10.222.0.70 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.977053 Aug 27 02:42:22.132666 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 375/735] 10.222.0.70 () {60 vars in 1170 bytes} [Sat Aug 27 02:42:18 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3988 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:42:22.153023 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ae085410-4913-4243-89ee-e1fc3c270b0d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:22.158278 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-ae085410-4913-4243-89ee-e1fc3c270b0d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 14e68153-ad1e-4028-8580-dcb179346f31] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:22.167678 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ae085410-4913-4243-89ee-e1fc3c270b0d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:22.168684 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ae085410-4913-4243-89ee-e1fc3c270b0d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:22.169398 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ae085410-4913-4243-89ee-e1fc3c270b0d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:22.170375 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ae085410-4913-4243-89ee-e1fc3c270b0d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:22.171046 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ae085410-4913-4243-89ee-e1fc3c270b0d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:22.171700 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ae085410-4913-4243-89ee-e1fc3c270b0d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:22.304788 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-7c8e16ca-35dc-4430-b8ad-7252fda81f09 tempest-ServersAdminNegativeTestJSON-1848621224 tempest-ServersAdminNegativeTestJSON-1848621224-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/b14cde49-7c38-4d62-853b-deb3a4239460" status: 200 len: 1630 microversion: 2.1 time: 0.739147 Aug 27 02:42:22.305819 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 361/736] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:21 2022] GET /compute/v2.1/servers/b14cde49-7c38-4d62-853b-deb3a4239460 => generated 1630 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:22.317941 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-1d660351-7dc7-4c03-b4a0-05cadec3b7f2 tempest-FloatingIPDetailsTestJSON-1296090266 tempest-FloatingIPDetailsTestJSON-1296090266-project] Action: 'create', calling method: .version_select at 0x7f5edf384040>, body: {"pool": null} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:42:22.507423 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-ae085410-4913-4243-89ee-e1fc3c270b0d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:22.517416 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ae085410-4913-4243-89ee-e1fc3c270b0d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/14e68153-ad1e-4028-8580-dcb179346f31" status: 200 len: 1503 microversion: 2.1 time: 0.380321 Aug 27 02:42:22.518411 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 376/737] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:22 2022] GET /compute/v2.1/servers/14e68153-ad1e-4028-8580-dcb179346f31 => generated 1503 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:22.583516 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e8a1ef8b-9839-4acf-8c3a-79ef3e82698c tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:22.584531 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-e8a1ef8b-9839-4acf-8c3a-79ef3e82698c tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] [instance: 3ee4d4db-a1bb-4567-a20d-29003e67a295] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:22.591494 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e8a1ef8b-9839-4acf-8c3a-79ef3e82698c tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:22.592209 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e8a1ef8b-9839-4acf-8c3a-79ef3e82698c tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:22.592864 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e8a1ef8b-9839-4acf-8c3a-79ef3e82698c tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:22.593854 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e8a1ef8b-9839-4acf-8c3a-79ef3e82698c tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:22.594504 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e8a1ef8b-9839-4acf-8c3a-79ef3e82698c tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:22.595113 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e8a1ef8b-9839-4acf-8c3a-79ef3e82698c tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:22.861391 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-e8a1ef8b-9839-4acf-8c3a-79ef3e82698c tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30abbf3afe304291981a6a9b85952aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c28ddbdb164f01bb82235c6d49717b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:22.871340 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e8a1ef8b-9839-4acf-8c3a-79ef3e82698c tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] 10.222.0.70 "GET /compute/v2.1/servers/3ee4d4db-a1bb-4567-a20d-29003e67a295" status: 200 len: 1471 microversion: 2.1 time: 0.291751 Aug 27 02:42:22.871958 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 377/738] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:22 2022] GET /compute/v2.1/servers/3ee4d4db-a1bb-4567-a20d-29003e67a295 => generated 1471 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:23.334017 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-cd2659a7-1351-47aa-be32-fdf7437e1fa5 tempest-ServersAdminNegativeTestJSON-1848621224 tempest-ServersAdminNegativeTestJSON-1848621224-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:23.336689 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-cd2659a7-1351-47aa-be32-fdf7437e1fa5 tempest-ServersAdminNegativeTestJSON-1848621224 tempest-ServersAdminNegativeTestJSON-1848621224-project-admin] [instance: b14cde49-7c38-4d62-853b-deb3a4239460] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:23.349403 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cd2659a7-1351-47aa-be32-fdf7437e1fa5 tempest-ServersAdminNegativeTestJSON-1848621224 tempest-ServersAdminNegativeTestJSON-1848621224-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:23.350282 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cd2659a7-1351-47aa-be32-fdf7437e1fa5 tempest-ServersAdminNegativeTestJSON-1848621224 tempest-ServersAdminNegativeTestJSON-1848621224-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:23.350945 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cd2659a7-1351-47aa-be32-fdf7437e1fa5 tempest-ServersAdminNegativeTestJSON-1848621224 tempest-ServersAdminNegativeTestJSON-1848621224-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:23.352893 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cd2659a7-1351-47aa-be32-fdf7437e1fa5 tempest-ServersAdminNegativeTestJSON-1848621224 tempest-ServersAdminNegativeTestJSON-1848621224-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:23.353932 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cd2659a7-1351-47aa-be32-fdf7437e1fa5 tempest-ServersAdminNegativeTestJSON-1848621224 tempest-ServersAdminNegativeTestJSON-1848621224-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:23.355142 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cd2659a7-1351-47aa-be32-fdf7437e1fa5 tempest-ServersAdminNegativeTestJSON-1848621224 tempest-ServersAdminNegativeTestJSON-1848621224-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:23.846686 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-cd2659a7-1351-47aa-be32-fdf7437e1fa5 tempest-ServersAdminNegativeTestJSON-1848621224 tempest-ServersAdminNegativeTestJSON-1848621224-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/b14cde49-7c38-4d62-853b-deb3a4239460" status: 200 len: 1613 microversion: 2.1 time: 0.517058 Aug 27 02:42:23.849030 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 378/739] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:23 2022] GET /compute/v2.1/servers/b14cde49-7c38-4d62-853b-deb3a4239460 => generated 1613 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:23.867796 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-7c8beeb9-f97a-4d83-868e-ad4ebc43294c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:23.868867 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-7c8beeb9-f97a-4d83-868e-ad4ebc43294c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 14e68153-ad1e-4028-8580-dcb179346f31] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:23.886485 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7c8beeb9-f97a-4d83-868e-ad4ebc43294c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:23.890625 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7c8beeb9-f97a-4d83-868e-ad4ebc43294c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:23.894154 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7c8beeb9-f97a-4d83-868e-ad4ebc43294c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:23.895053 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7c8beeb9-f97a-4d83-868e-ad4ebc43294c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:23.895547 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7c8beeb9-f97a-4d83-868e-ad4ebc43294c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:23.896159 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7c8beeb9-f97a-4d83-868e-ad4ebc43294c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:24.270249 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-7c8beeb9-f97a-4d83-868e-ad4ebc43294c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:24.284469 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-7c8beeb9-f97a-4d83-868e-ad4ebc43294c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/14e68153-ad1e-4028-8580-dcb179346f31" status: 200 len: 1503 microversion: 2.1 time: 0.433933 Aug 27 02:42:24.285340 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 379/740] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:23 2022] GET /compute/v2.1/servers/14e68153-ad1e-4028-8580-dcb179346f31 => generated 1503 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:24.303744 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-afd72087-3056-4484-b71d-2d2906eb66b1 tempest-ServersAdminNegativeTestJSON-1848621224 tempest-ServersAdminNegativeTestJSON-1848621224-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:42:24.305101 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-afd72087-3056-4484-b71d-2d2906eb66b1 tempest-ServersAdminNegativeTestJSON-1848621224 tempest-ServersAdminNegativeTestJSON-1848621224-project-admin] [instance: b14cde49-7c38-4d62-853b-deb3a4239460] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:24.322717 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-afd72087-3056-4484-b71d-2d2906eb66b1 tempest-ServersAdminNegativeTestJSON-1848621224 tempest-ServersAdminNegativeTestJSON-1848621224-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:24.323448 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-afd72087-3056-4484-b71d-2d2906eb66b1 tempest-ServersAdminNegativeTestJSON-1848621224 tempest-ServersAdminNegativeTestJSON-1848621224-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:24.324063 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-afd72087-3056-4484-b71d-2d2906eb66b1 tempest-ServersAdminNegativeTestJSON-1848621224 tempest-ServersAdminNegativeTestJSON-1848621224-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:24.326656 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-afd72087-3056-4484-b71d-2d2906eb66b1 tempest-ServersAdminNegativeTestJSON-1848621224 tempest-ServersAdminNegativeTestJSON-1848621224-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:24.327321 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-afd72087-3056-4484-b71d-2d2906eb66b1 tempest-ServersAdminNegativeTestJSON-1848621224 tempest-ServersAdminNegativeTestJSON-1848621224-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:24.328199 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-afd72087-3056-4484-b71d-2d2906eb66b1 tempest-ServersAdminNegativeTestJSON-1848621224 tempest-ServersAdminNegativeTestJSON-1848621224-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:24.448611 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-afd72087-3056-4484-b71d-2d2906eb66b1 tempest-ServersAdminNegativeTestJSON-1848621224 tempest-ServersAdminNegativeTestJSON-1848621224-project-admin] HTTP exception thrown: Cannot 'migrate' instance b14cde49-7c38-4d62-853b-deb3a4239460 while it is in vm_state suspended Aug 27 02:42:24.450434 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-afd72087-3056-4484-b71d-2d2906eb66b1 tempest-ServersAdminNegativeTestJSON-1848621224 tempest-ServersAdminNegativeTestJSON-1848621224-project-admin] Request method failure captured: Aug 27 02:42:24.450434 n-d-852278-4 devstack@n-api.service[134052]: request: POST /compute/v2.1/servers/b14cde49-7c38-4d62-853b-deb3a4239460/action HTTP/1.1 Aug 27 02:42:24.450434 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:42:24.450434 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:42:24.450434 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:42:24.450434 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 15 Aug 27 02:42:24.450434 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:42:24.450434 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:42:24.450434 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:42:24.450434 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:42:24.450434 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYRfmJQ7LKRbtw-EihFC8U-37QKAHIZHJXkTVMOFTZJqBmJwgITjdj4-6sWSF8auxXAWNA-IenfLRlp5BjYi11N3NdNM6YNg39_gQL3SAbXJLlGobybe3DjFkwaKrs2xRatnH3R2Yk8gUlhaa_zoO2EYPuwVNi9Hce_YPknP95LRvSo Aug 27 02:42:24.450434 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:42:24.450434 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:42:24.450434 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:42:24.450434 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:42:24.450434 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:42:24.450434 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:42:24.450434 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 53a0eb63030642f18ebe81429a5fc515 Aug 27 02:42:24.450434 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1848621224 Aug 27 02:42:24.450434 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,admin,member Aug 27 02:42:24.450434 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,admin,member Aug 27 02:42:24.452158 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/53a0eb63030642f18ebe81429a5fc515"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_53a0eb63030642f18ebe81429a5fc515", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/53a0eb63030642f18ebe81429a5fc515"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/53a0eb63030642f18ebe81429a5fc515"}]}] Aug 27 02:42:24.452158 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1848621224 Aug 27 02:42:24.452158 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 53a0eb63030642f18ebe81429a5fc515 Aug 27 02:42:24.452158 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1848621224 Aug 27 02:42:24.452158 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ServersAdminNegativeTestJSON-1848621224-project-admin Aug 27 02:42:24.452158 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:42:24.452158 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:42:24.452158 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 255c2c3ba3bb4b72ac8c6d59f0116ed3 Aug 27 02:42:24.452158 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1848621224-project-admin Aug 27 02:42:24.452158 n-d-852278-4 devstack@n-api.service[134052]: Aug 27 02:42:24.452158 n-d-852278-4 devstack@n-api.service[134052]: {"migrate": {}} Aug 27 02:42:24.452158 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 02:42:24.452158 n-d-852278-4 devstack@n-api.service[134052]: exception: Cannot 'migrate' instance b14cde49-7c38-4d62-853b-deb3a4239460 while it is in vm_state suspended Aug 27 02:42:24.453352 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': 'b14cde49-7c38-4d62-853b-deb3a4239460', 'body': {'migrate': {}}} Aug 27 02:42:24.453352 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:42:24.453352 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:42:24.453352 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Aug 27 02:42:24.453352 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Aug 27 02:42:24.453352 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 27 02:42:24.453352 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 02:42:24.453352 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 27 02:42:24.453352 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 27 02:42:24.453352 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 27 02:42:24.453352 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 27 02:42:24.453352 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 02:42:24.453352 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 02:42:24.453352 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 27 02:42:24.453352 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 27 02:42:24.453352 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b14cde49-7c38-4d62-853b-deb3a4239460 in vm_state suspended. Cannot resize while the instance is in this state. Aug 27 02:42:24.453352 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:42:24.453352 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:42:24.453352 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:42:24.453352 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:42:24.461152 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:42:24.461152 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:42:24.461152 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:42:24.461152 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:42:24.461152 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:42:24.461152 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:42:24.461152 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:42:24.461152 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:42:24.461152 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Aug 27 02:42:24.461152 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 27 02:42:24.461152 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 27 02:42:24.461152 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 27 02:42:24.461152 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance b14cde49-7c38-4d62-853b-deb3a4239460 while it is in vm_state suspended Aug 27 02:42:24.461152 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:42:24.461152 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:42:24.461152 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:42:24.461152 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:42:24.461152 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:42:24.461152 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:42:24.462605 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:42:24.462605 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:42:24.462605 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance b14cde49-7c38-4d62-853b-deb3a4239460 while it is in vm_state suspended Aug 27 02:42:24.462605 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:42:24.462605 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-afd72087-3056-4484-b71d-2d2906eb66b1 tempest-ServersAdminNegativeTestJSON-1848621224 tempest-ServersAdminNegativeTestJSON-1848621224-project-admin] Returning 409 to user: Cannot 'migrate' instance b14cde49-7c38-4d62-853b-deb3a4239460 while it is in vm_state suspended {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:42:24.462605 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-afd72087-3056-4484-b71d-2d2906eb66b1 tempest-ServersAdminNegativeTestJSON-1848621224 tempest-ServersAdminNegativeTestJSON-1848621224-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/b14cde49-7c38-4d62-853b-deb3a4239460/action" status: 409 len: 148 microversion: 2.1 time: 0.154255 Aug 27 02:42:24.462605 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 380/741] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 02:42:24 2022] POST /compute/v2.1/servers/b14cde49-7c38-4d62-853b-deb3a4239460/action => generated 148 bytes in 155 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 27 02:42:24.462605 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b6a49251-f96e-46ae-b612-f5b3adf89d5a tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:24.463390 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b6a49251-f96e-46ae-b612-f5b3adf89d5a tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] [instance: 3ee4d4db-a1bb-4567-a20d-29003e67a295] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:24.468437 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b6a49251-f96e-46ae-b612-f5b3adf89d5a tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:24.468935 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b6a49251-f96e-46ae-b612-f5b3adf89d5a tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:24.469422 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b6a49251-f96e-46ae-b612-f5b3adf89d5a tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:24.470131 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b6a49251-f96e-46ae-b612-f5b3adf89d5a tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:24.470574 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b6a49251-f96e-46ae-b612-f5b3adf89d5a tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:24.471007 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b6a49251-f96e-46ae-b612-f5b3adf89d5a tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:24.495552 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-1d660351-7dc7-4c03-b4a0-05cadec3b7f2 tempest-FloatingIPDetailsTestJSON-1296090266 tempest-FloatingIPDetailsTestJSON-1296090266-project] 10.222.0.70 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.188444 Aug 27 02:42:24.496526 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 362/742] 10.222.0.70 () {60 vars in 1170 bytes} [Sat Aug 27 02:42:22 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:42:24.501598 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-09db3db5-223d-4009-83bf-cd822baff7af tempest-ServersAdminNegativeTestJSON-1848621224 tempest-ServersAdminNegativeTestJSON-1848621224-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:42:24.507764 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-09db3db5-223d-4009-83bf-cd822baff7af tempest-ServersAdminNegativeTestJSON-1848621224 tempest-ServersAdminNegativeTestJSON-1848621224-project-admin] Request method failure captured: Aug 27 02:42:24.507764 n-d-852278-4 devstack@n-api.service[134051]: request: POST /compute/v2.1/servers/50597771-779f-426a-9cdc-17a6f2fb01fd/action HTTP/1.1 Aug 27 02:42:24.507764 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:42:24.507764 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:42:24.507764 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:42:24.507764 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 39 Aug 27 02:42:24.507764 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:42:24.507764 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:42:24.507764 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:42:24.507764 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:42:24.507764 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYRfmJQ7LKRbtw-EihFC8U-37QKAHIZHJXkTVMOFTZJqBmJwgITjdj4-6sWSF8auxXAWNA-IenfLRlp5BjYi11N3NdNM6YNg39_gQL3SAbXJLlGobybe3DjFkwaKrs2xRatnH3R2Yk8gUlhaa_zoO2EYPuwVNi9Hce_YPknP95LRvSo Aug 27 02:42:24.507764 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:42:24.507764 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:42:24.507764 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:42:24.507764 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:42:24.507764 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:42:24.507764 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:42:24.507764 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 53a0eb63030642f18ebe81429a5fc515 Aug 27 02:42:24.507764 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1848621224 Aug 27 02:42:24.507764 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,admin,member Aug 27 02:42:24.507764 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,admin,member Aug 27 02:42:24.509311 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/53a0eb63030642f18ebe81429a5fc515"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_53a0eb63030642f18ebe81429a5fc515", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/53a0eb63030642f18ebe81429a5fc515"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/53a0eb63030642f18ebe81429a5fc515"}]}] Aug 27 02:42:24.509311 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1848621224 Aug 27 02:42:24.509311 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 53a0eb63030642f18ebe81429a5fc515 Aug 27 02:42:24.509311 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1848621224 Aug 27 02:42:24.509311 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ServersAdminNegativeTestJSON-1848621224-project-admin Aug 27 02:42:24.509311 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:42:24.509311 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:42:24.509311 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 255c2c3ba3bb4b72ac8c6d59f0116ed3 Aug 27 02:42:24.509311 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1848621224-project-admin Aug 27 02:42:24.509311 n-d-852278-4 devstack@n-api.service[134051]: Aug 27 02:42:24.509311 n-d-852278-4 devstack@n-api.service[134051]: {"os-resetState": {"state": "invalid"}} Aug 27 02:42:24.509311 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 02:42:24.510142 n-d-852278-4 devstack@n-api.service[134051]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 27 02:42:24.510142 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '50597771-779f-426a-9cdc-17a6f2fb01fd', 'body': {'os-resetState': {'state': 'invalid'}}} Aug 27 02:42:24.510142 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:42:24.510142 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:42:24.510142 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 02:42:24.510142 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 02:42:24.510142 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 02:42:24.510142 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise error Aug 27 02:42:24.510142 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Aug 27 02:42:24.510142 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:42:24.510142 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Aug 27 02:42:24.510142 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Aug 27 02:42:24.510142 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:42:24.510142 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Aug 27 02:42:24.510142 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi 'invalid' Aug 27 02:42:24.510142 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:42:24.510142 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:42:24.510142 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:42:24.510142 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:42:24.510142 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:42:24.510142 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:42:24.510142 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:42:24.512598 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:42:24.512598 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:42:24.512598 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:42:24.512598 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 02:42:24.512598 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 02:42:24.512598 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 02:42:24.512598 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 02:42:24.512598 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 02:42:24.512598 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 02:42:24.512598 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 27 02:42:24.512598 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:42:24.512598 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:42:24.512598 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:42:24.512598 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:42:24.512598 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:42:24.512598 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:42:24.512598 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 02:42:24.512598 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 02:42:24.512598 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 27 02:42:24.515023 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:42:24.515023 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-09db3db5-223d-4009-83bf-cd822baff7af tempest-ServersAdminNegativeTestJSON-1848621224 tempest-ServersAdminNegativeTestJSON-1848621224-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:42:24.515023 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-09db3db5-223d-4009-83bf-cd822baff7af tempest-ServersAdminNegativeTestJSON-1848621224 tempest-ServersAdminNegativeTestJSON-1848621224-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/50597771-779f-426a-9cdc-17a6f2fb01fd/action" status: 400 len: 144 microversion: 2.1 time: 0.015971 Aug 27 02:42:24.518342 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 363/743] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 02:42:24 2022] POST /compute/v2.1/servers/50597771-779f-426a-9cdc-17a6f2fb01fd/action => generated 144 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 02:42:24.527435 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-666a177d-8714-4d39-9cef-e2021f1c865e tempest-FloatingIPDetailsTestJSON-1296090266 tempest-FloatingIPDetailsTestJSON-1296090266-project] Action: 'create', calling method: .version_select at 0x7f5edf426c10>, body: {"pool": null} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:42:24.883836 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b6a49251-f96e-46ae-b612-f5b3adf89d5a tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30abbf3afe304291981a6a9b85952aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c28ddbdb164f01bb82235c6d49717b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:24.891915 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b6a49251-f96e-46ae-b612-f5b3adf89d5a tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] 10.222.0.70 "GET /compute/v2.1/servers/3ee4d4db-a1bb-4567-a20d-29003e67a295" status: 200 len: 1471 microversion: 2.1 time: 0.438222 Aug 27 02:42:24.899620 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 381/744] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:24 2022] GET /compute/v2.1/servers/3ee4d4db-a1bb-4567-a20d-29003e67a295 => generated 1471 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:24.904614 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d49babce-086a-450e-b97d-48d433939f9b tempest-ServersAdminNegativeTestJSON-1848621224 tempest-ServersAdminNegativeTestJSON-1848621224-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:42:24.908834 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d49babce-086a-450e-b97d-48d433939f9b tempest-ServersAdminNegativeTestJSON-1848621224 tempest-ServersAdminNegativeTestJSON-1848621224-project-admin] Request method failure captured: Aug 27 02:42:24.908834 n-d-852278-4 devstack@n-api.service[134052]: request: POST /compute/v2.1/servers/50597771-779f-426a-9cdc-17a6f2fb01fd/action HTTP/1.1 Aug 27 02:42:24.908834 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:42:24.908834 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:42:24.908834 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:42:24.908834 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 31 Aug 27 02:42:24.908834 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:42:24.908834 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:42:24.908834 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:42:24.908834 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:42:24.908834 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYRfmJQ7LKRbtw-EihFC8U-37QKAHIZHJXkTVMOFTZJqBmJwgITjdj4-6sWSF8auxXAWNA-IenfLRlp5BjYi11N3NdNM6YNg39_gQL3SAbXJLlGobybe3DjFkwaKrs2xRatnH3R2Yk8gUlhaa_zoO2EYPuwVNi9Hce_YPknP95LRvSo Aug 27 02:42:24.908834 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:42:24.908834 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:42:24.908834 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:42:24.908834 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:42:24.908834 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:42:24.908834 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:42:24.908834 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 53a0eb63030642f18ebe81429a5fc515 Aug 27 02:42:24.908834 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1848621224 Aug 27 02:42:24.908834 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,admin,member Aug 27 02:42:24.908834 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,admin,member Aug 27 02:42:24.910227 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/53a0eb63030642f18ebe81429a5fc515"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_53a0eb63030642f18ebe81429a5fc515", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/53a0eb63030642f18ebe81429a5fc515"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/53a0eb63030642f18ebe81429a5fc515"}]}] Aug 27 02:42:24.910227 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1848621224 Aug 27 02:42:24.910227 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 53a0eb63030642f18ebe81429a5fc515 Aug 27 02:42:24.910227 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1848621224 Aug 27 02:42:24.910227 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ServersAdminNegativeTestJSON-1848621224-project-admin Aug 27 02:42:24.910227 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:42:24.910227 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:42:24.910227 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 255c2c3ba3bb4b72ac8c6d59f0116ed3 Aug 27 02:42:24.910227 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1848621224-project-admin Aug 27 02:42:24.910227 n-d-852278-4 devstack@n-api.service[134052]: Aug 27 02:42:24.910227 n-d-852278-4 devstack@n-api.service[134052]: {"os-resetState": {"state": 1}} Aug 27 02:42:24.910227 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 02:42:24.910227 n-d-852278-4 devstack@n-api.service[134052]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 27 02:42:24.910995 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '50597771-779f-426a-9cdc-17a6f2fb01fd', 'body': {'os-resetState': {'state': 1}}} Aug 27 02:42:24.910995 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:42:24.910995 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:42:24.910995 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 02:42:24.910995 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 02:42:24.910995 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 02:42:24.910995 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise error Aug 27 02:42:24.910995 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Aug 27 02:42:24.910995 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:42:24.910995 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Aug 27 02:42:24.910995 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Aug 27 02:42:24.910995 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:42:24.910995 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Aug 27 02:42:24.910995 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi 1 Aug 27 02:42:24.910995 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:42:24.910995 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:42:24.910995 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:42:24.910995 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:42:24.910995 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:42:24.910995 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:42:24.910995 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:42:24.910995 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:42:24.912421 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:42:24.912421 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:42:24.912421 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 02:42:24.912421 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 02:42:24.912421 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 02:42:24.912421 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 02:42:24.912421 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 02:42:24.912421 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 02:42:24.912421 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 27 02:42:24.912421 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:42:24.912421 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:42:24.912421 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:42:24.912421 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:42:24.912421 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:42:24.912421 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:42:24.912421 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 02:42:24.912421 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 02:42:24.912421 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 27 02:42:24.912421 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:42:24.915133 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d49babce-086a-450e-b97d-48d433939f9b tempest-ServersAdminNegativeTestJSON-1848621224 tempest-ServersAdminNegativeTestJSON-1848621224-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:42:24.916247 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d49babce-086a-450e-b97d-48d433939f9b tempest-ServersAdminNegativeTestJSON-1848621224 tempest-ServersAdminNegativeTestJSON-1848621224-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/50597771-779f-426a-9cdc-17a6f2fb01fd/action" status: 400 len: 120 microversion: 2.1 time: 0.015575 Aug 27 02:42:24.917473 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 382/745] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 02:42:24 2022] POST /compute/v2.1/servers/50597771-779f-426a-9cdc-17a6f2fb01fd/action => generated 120 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 02:42:24.936155 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-938c878b-7346-4078-a384-424d4d122e96 tempest-ServersAdminNegativeTestJSON-1848621224 tempest-ServersAdminNegativeTestJSON-1848621224-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:42:24.940172 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-938c878b-7346-4078-a384-424d4d122e96 tempest-ServersAdminNegativeTestJSON-1848621224 tempest-ServersAdminNegativeTestJSON-1848621224-project-admin] Failed to fetch instance by id 999 {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 27 02:42:24.941017 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-938c878b-7346-4078-a384-424d4d122e96 tempest-ServersAdminNegativeTestJSON-1848621224 tempest-ServersAdminNegativeTestJSON-1848621224-project-admin] HTTP exception thrown: Instance 999 could not be found. Aug 27 02:42:24.943130 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-938c878b-7346-4078-a384-424d4d122e96 tempest-ServersAdminNegativeTestJSON-1848621224 tempest-ServersAdminNegativeTestJSON-1848621224-project-admin] Request method failure captured: Aug 27 02:42:24.943130 n-d-852278-4 devstack@n-api.service[134052]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Aug 27 02:42:24.943130 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:42:24.943130 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:42:24.943130 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:42:24.943130 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 37 Aug 27 02:42:24.943130 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:42:24.943130 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:42:24.943130 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:42:24.943130 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:42:24.943130 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYRfmJQ7LKRbtw-EihFC8U-37QKAHIZHJXkTVMOFTZJqBmJwgITjdj4-6sWSF8auxXAWNA-IenfLRlp5BjYi11N3NdNM6YNg39_gQL3SAbXJLlGobybe3DjFkwaKrs2xRatnH3R2Yk8gUlhaa_zoO2EYPuwVNi9Hce_YPknP95LRvSo Aug 27 02:42:24.943130 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:42:24.943130 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:42:24.943130 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:42:24.943130 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:42:24.943130 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:42:24.943130 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:42:24.943130 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 53a0eb63030642f18ebe81429a5fc515 Aug 27 02:42:24.943130 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1848621224 Aug 27 02:42:24.943130 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,admin,member Aug 27 02:42:24.943130 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,admin,member Aug 27 02:42:24.944531 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/53a0eb63030642f18ebe81429a5fc515"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_53a0eb63030642f18ebe81429a5fc515", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/53a0eb63030642f18ebe81429a5fc515"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/53a0eb63030642f18ebe81429a5fc515"}]}] Aug 27 02:42:24.944531 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1848621224 Aug 27 02:42:24.944531 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 53a0eb63030642f18ebe81429a5fc515 Aug 27 02:42:24.944531 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1848621224 Aug 27 02:42:24.944531 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ServersAdminNegativeTestJSON-1848621224-project-admin Aug 27 02:42:24.944531 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:42:24.944531 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:42:24.944531 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 255c2c3ba3bb4b72ac8c6d59f0116ed3 Aug 27 02:42:24.944531 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1848621224-project-admin Aug 27 02:42:24.944531 n-d-852278-4 devstack@n-api.service[134052]: Aug 27 02:42:24.944531 n-d-852278-4 devstack@n-api.service[134052]: {"os-resetState": {"state": "error"}} Aug 27 02:42:24.944531 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 02:42:24.944531 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance 999 could not be found. Aug 27 02:42:24.945324 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Aug 27 02:42:24.945324 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:42:24.945324 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:42:24.945324 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:42:24.945324 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:42:24.945324 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 27 02:42:24.945324 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 27 02:42:24.945324 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Aug 27 02:42:24.945324 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:42:24.945324 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:42:24.945324 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:42:24.945324 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:42:24.945324 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:42:24.945324 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:42:24.945324 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:42:24.945324 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:42:24.945324 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:42:24.945324 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:42:24.945324 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:42:24.945324 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:42:24.945324 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Aug 27 02:42:24.946613 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 27 02:42:24.946613 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:42:24.946613 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:42:24.946613 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Aug 27 02:42:24.946613 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:42:24.946613 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:42:24.946613 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:42:24.946613 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:42:24.946613 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:42:24.946613 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:42:24.946613 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:42:24.946613 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:42:24.946613 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Aug 27 02:42:24.946613 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:42:24.949271 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-938c878b-7346-4078-a384-424d4d122e96 tempest-ServersAdminNegativeTestJSON-1848621224 tempest-ServersAdminNegativeTestJSON-1848621224-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:42:24.950716 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-938c878b-7346-4078-a384-424d4d122e96 tempest-ServersAdminNegativeTestJSON-1848621224 tempest-ServersAdminNegativeTestJSON-1848621224-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.027168 Aug 27 02:42:24.951729 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 383/746] 10.222.0.70 () {60 vars in 1179 bytes} [Sat Aug 27 02:42:24 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 02:42:24.977553 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5e8a9110-9241-459e-b506-c6d77ff9cec5 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:24.978686 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-5e8a9110-9241-459e-b506-c6d77ff9cec5 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] [instance: b14cde49-7c38-4d62-853b-deb3a4239460] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:24.986345 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5e8a9110-9241-459e-b506-c6d77ff9cec5 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:24.987446 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5e8a9110-9241-459e-b506-c6d77ff9cec5 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:24.988432 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5e8a9110-9241-459e-b506-c6d77ff9cec5 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:24.989328 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5e8a9110-9241-459e-b506-c6d77ff9cec5 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:24.990004 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5e8a9110-9241-459e-b506-c6d77ff9cec5 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:24.990601 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5e8a9110-9241-459e-b506-c6d77ff9cec5 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:25.025459 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-5e8a9110-9241-459e-b506-c6d77ff9cec5 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] [instance: b14cde49-7c38-4d62-853b-deb3a4239460] Going to try to terminate instance {{(pid=134052) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:42:25.042144 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=100 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:42:25.128672 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-5e8a9110-9241-459e-b506-c6d77ff9cec5 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] 10.222.0.70 "DELETE /compute/v2.1/servers/b14cde49-7c38-4d62-853b-deb3a4239460" status: 204 len: 0 microversion: 2.1 time: 0.171671 Aug 27 02:42:25.130797 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 384/747] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:42:24 2022] DELETE /compute/v2.1/servers/b14cde49-7c38-4d62-853b-deb3a4239460 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 02:42:25.163285 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8ccbe23f-97f7-43cd-9bd9-e70d345c9a9c tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:25.166936 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-8ccbe23f-97f7-43cd-9bd9-e70d345c9a9c tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] [instance: b14cde49-7c38-4d62-853b-deb3a4239460] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:25.186068 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8ccbe23f-97f7-43cd-9bd9-e70d345c9a9c tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:25.186572 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8ccbe23f-97f7-43cd-9bd9-e70d345c9a9c tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:25.187164 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8ccbe23f-97f7-43cd-9bd9-e70d345c9a9c tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:25.202840 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8ccbe23f-97f7-43cd-9bd9-e70d345c9a9c tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:25.203871 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8ccbe23f-97f7-43cd-9bd9-e70d345c9a9c tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:25.204589 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8ccbe23f-97f7-43cd-9bd9-e70d345c9a9c tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:26.124386 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-8ccbe23f-97f7-43cd-9bd9-e70d345c9a9c tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb3ac70d5084c9c826b5722e5302ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25afdc85b9aa4c86bd4f8e2e4a22ff3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:26.133450 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-8ccbe23f-97f7-43cd-9bd9-e70d345c9a9c tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] 10.222.0.70 "GET /compute/v2.1/servers/b14cde49-7c38-4d62-853b-deb3a4239460" status: 200 len: 1468 microversion: 2.1 time: 0.997926 Aug 27 02:42:26.134035 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 385/748] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:25 2022] GET /compute/v2.1/servers/b14cde49-7c38-4d62-853b-deb3a4239460 => generated 1468 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:26.156258 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-eed12e8e-c2c2-43aa-aedf-aab409e8974d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:26.165412 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-eed12e8e-c2c2-43aa-aedf-aab409e8974d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 14e68153-ad1e-4028-8580-dcb179346f31] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:26.187228 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-eed12e8e-c2c2-43aa-aedf-aab409e8974d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:26.187767 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-eed12e8e-c2c2-43aa-aedf-aab409e8974d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:26.188209 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-eed12e8e-c2c2-43aa-aedf-aab409e8974d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:26.189881 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-eed12e8e-c2c2-43aa-aedf-aab409e8974d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:26.192438 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-eed12e8e-c2c2-43aa-aedf-aab409e8974d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:26.194610 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-eed12e8e-c2c2-43aa-aedf-aab409e8974d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:26.485761 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-eed12e8e-c2c2-43aa-aedf-aab409e8974d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:26.499610 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-eed12e8e-c2c2-43aa-aedf-aab409e8974d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/14e68153-ad1e-4028-8580-dcb179346f31" status: 200 len: 1478 microversion: 2.1 time: 0.347896 Aug 27 02:42:26.502354 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 386/749] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:26 2022] GET /compute/v2.1/servers/14e68153-ad1e-4028-8580-dcb179346f31 => generated 1478 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:26.535211 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-050a92d2-788e-450a-b97c-4562b4ba5f43 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:26.536732 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-050a92d2-788e-450a-b97c-4562b4ba5f43 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] [instance: 3ee4d4db-a1bb-4567-a20d-29003e67a295] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:26.550608 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-050a92d2-788e-450a-b97c-4562b4ba5f43 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:26.551528 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-050a92d2-788e-450a-b97c-4562b4ba5f43 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:26.552161 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-050a92d2-788e-450a-b97c-4562b4ba5f43 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:26.553326 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-050a92d2-788e-450a-b97c-4562b4ba5f43 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:26.557706 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-050a92d2-788e-450a-b97c-4562b4ba5f43 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:26.564939 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-050a92d2-788e-450a-b97c-4562b4ba5f43 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:26.983184 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-050a92d2-788e-450a-b97c-4562b4ba5f43 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30abbf3afe304291981a6a9b85952aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c28ddbdb164f01bb82235c6d49717b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:26.999604 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-050a92d2-788e-450a-b97c-4562b4ba5f43 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] 10.222.0.70 "GET /compute/v2.1/servers/3ee4d4db-a1bb-4567-a20d-29003e67a295" status: 200 len: 1477 microversion: 2.1 time: 0.475145 Aug 27 02:42:27.020092 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 387/750] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:26 2022] GET /compute/v2.1/servers/3ee4d4db-a1bb-4567-a20d-29003e67a295 => generated 1477 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:27.028997 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f3299040-7690-41c6-88b6-155b21d7b54c tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1446574680", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "networks": [{"uuid": "58e81615-c8bf-4364-8115-f623371ebb07"}, {"uuid": "7fe061d7-1c62-4393-8cd8-568b11725f8c"}, {"uuid": "58e81615-c8bf-4364-8115-f623371ebb07"}]}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:42:27.217944 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.network.neutron [None req-f3299040-7690-41c6-88b6-155b21d7b54c tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] validate_networks() for [('58e81615-c8bf-4364-8115-f623371ebb07', None, None, None, None, None), ('7fe061d7-1c62-4393-8cd8-568b11725f8c', None, None, None, None, None), ('58e81615-c8bf-4364-8115-f623371ebb07', None, None, None, None, None)] {{(pid=134052) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:42:28.731493 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-666a177d-8714-4d39-9cef-e2021f1c865e tempest-FloatingIPDetailsTestJSON-1296090266 tempest-FloatingIPDetailsTestJSON-1296090266-project] 10.222.0.70 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.211709 Aug 27 02:42:28.732215 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 364/751] 10.222.0.70 () {60 vars in 1170 bytes} [Sat Aug 27 02:42:24 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:42:28.736871 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f57e5e7e-3071-4382-8bea-67b257f339ca tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Calling method '.version_select at 0x7f5edf3160d0>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:28.748082 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f57e5e7e-3071-4382-8bea-67b257f339ca tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:28.748944 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f57e5e7e-3071-4382-8bea-67b257f339ca tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:28.749836 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f57e5e7e-3071-4382-8bea-67b257f339ca tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:28.770270 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-f57e5e7e-3071-4382-8bea-67b257f339ca tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] 10.222.0.70 "GET /compute/v2.1/os-migrations" status: 200 len: 1552 microversion: 2.1 time: 0.036782 Aug 27 02:42:28.771227 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 365/752] 10.222.0.70 () {58 vars in 1143 bytes} [Sat Aug 27 02:42:28 2022] GET /compute/v2.1/os-migrations => generated 1552 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:28.785037 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-61cebc79-0419-4e14-939d-44f00f16df23 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:28.785765 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-61cebc79-0419-4e14-939d-44f00f16df23 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] [instance: b14cde49-7c38-4d62-853b-deb3a4239460] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:28.801636 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-61cebc79-0419-4e14-939d-44f00f16df23 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:28.802282 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-61cebc79-0419-4e14-939d-44f00f16df23 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:28.802821 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-61cebc79-0419-4e14-939d-44f00f16df23 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:28.803658 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-61cebc79-0419-4e14-939d-44f00f16df23 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:28.806902 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-61cebc79-0419-4e14-939d-44f00f16df23 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:28.807455 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-61cebc79-0419-4e14-939d-44f00f16df23 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:29.018843 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-61cebc79-0419-4e14-939d-44f00f16df23 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb3ac70d5084c9c826b5722e5302ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25afdc85b9aa4c86bd4f8e2e4a22ff3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:29.040132 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-61cebc79-0419-4e14-939d-44f00f16df23 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] 10.222.0.70 "GET /compute/v2.1/servers/b14cde49-7c38-4d62-853b-deb3a4239460" status: 200 len: 1426 microversion: 2.1 time: 0.258955 Aug 27 02:42:29.042242 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 366/753] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:28 2022] GET /compute/v2.1/servers/b14cde49-7c38-4d62-853b-deb3a4239460 => generated 1426 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:29.058650 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c2eb7f10-6c88-4e20-985e-8a325eb52472 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:29.059492 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-c2eb7f10-6c88-4e20-985e-8a325eb52472 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] [instance: 3ee4d4db-a1bb-4567-a20d-29003e67a295] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:29.069245 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c2eb7f10-6c88-4e20-985e-8a325eb52472 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:29.069732 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c2eb7f10-6c88-4e20-985e-8a325eb52472 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:29.070373 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c2eb7f10-6c88-4e20-985e-8a325eb52472 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:29.071399 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c2eb7f10-6c88-4e20-985e-8a325eb52472 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:29.071992 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c2eb7f10-6c88-4e20-985e-8a325eb52472 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:29.072916 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c2eb7f10-6c88-4e20-985e-8a325eb52472 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:29.422781 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-c2eb7f10-6c88-4e20-985e-8a325eb52472 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30abbf3afe304291981a6a9b85952aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c28ddbdb164f01bb82235c6d49717b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:29.436753 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c2eb7f10-6c88-4e20-985e-8a325eb52472 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] 10.222.0.70 "GET /compute/v2.1/servers/3ee4d4db-a1bb-4567-a20d-29003e67a295" status: 200 len: 1477 microversion: 2.1 time: 0.391216 Aug 27 02:42:29.452029 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 367/754] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:29 2022] GET /compute/v2.1/servers/3ee4d4db-a1bb-4567-a20d-29003e67a295 => generated 1477 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:29.473029 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b98ae9a8-5132-474c-8959-fc132450ecc0 tempest-FloatingIPDetailsTestJSON-1296090266 tempest-FloatingIPDetailsTestJSON-1296090266-project] Action: 'create', calling method: .version_select at 0x7f5edf214c10>, body: {"pool": null} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:42:29.532082 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-f3299040-7690-41c6-88b6-155b21d7b54c tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Flavor limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:42:29.533730 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-f3299040-7690-41c6-88b6-155b21d7b54c tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Image limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:42:29.534368 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-f3299040-7690-41c6-88b6-155b21d7b54c tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Flavor pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:42:29.535064 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-f3299040-7690-41c6-88b6-155b21d7b54c tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Image pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:42:29.536080 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-f3299040-7690-41c6-88b6-155b21d7b54c tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:42:29.573253 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f3299040-7690-41c6-88b6-155b21d7b54c tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:29.573743 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f3299040-7690-41c6-88b6-155b21d7b54c tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:29.575309 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f3299040-7690-41c6-88b6-155b21d7b54c tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:29.578547 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f3299040-7690-41c6-88b6-155b21d7b54c tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:29.580507 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f3299040-7690-41c6-88b6-155b21d7b54c tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:29.582206 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f3299040-7690-41c6-88b6-155b21d7b54c tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:29.643134 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-f3299040-7690-41c6-88b6-155b21d7b54c tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Getting quotas for project de3ac0c66c5b4bc787d2d6e12a957099. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:42:29.660466 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-f3299040-7690-41c6-88b6-155b21d7b54c tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Getting quotas for user 9653dac89d2648b285fd71c1b349e642 and project de3ac0c66c5b4bc787d2d6e12a957099. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:42:29.697473 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-f3299040-7690-41c6-88b6-155b21d7b54c tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Going to run 1 instances... {{(pid=134052) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:42:29.699841 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-f3299040-7690-41c6-88b6-155b21d7b54c tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] [instance: 74d41279-27ab-492f-88ac-85f22b11b9ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134052) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:42:29.833126 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f3299040-7690-41c6-88b6-155b21d7b54c tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.810638 Aug 27 02:42:29.834845 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 388/755] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 02:42:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 2814 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:42:29.841843 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6d870723-aa37-4435-9ce8-4e349c253410 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:29.842561 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-6d870723-aa37-4435-9ce8-4e349c253410 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] [instance: 14e68153-ad1e-4028-8580-dcb179346f31] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:29.851937 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6d870723-aa37-4435-9ce8-4e349c253410 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:29.852510 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6d870723-aa37-4435-9ce8-4e349c253410 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:29.855742 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6d870723-aa37-4435-9ce8-4e349c253410 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:29.857355 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6d870723-aa37-4435-9ce8-4e349c253410 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:29.857981 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6d870723-aa37-4435-9ce8-4e349c253410 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:29.859079 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6d870723-aa37-4435-9ce8-4e349c253410 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:30.359307 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-6d870723-aa37-4435-9ce8-4e349c253410 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/14e68153-ad1e-4028-8580-dcb179346f31" status: 200 len: 1629 microversion: 2.1 time: 0.522918 Aug 27 02:42:30.375207 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 389/756] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:29 2022] GET /compute/v2.1/servers/14e68153-ad1e-4028-8580-dcb179346f31 => generated 1629 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:30.375207 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-e47b4c4b-ff1c-4fef-a4f3-f7b099bf1036 req-0467443f-4162-4561-b4d7-39f8073eb065 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b14cde49-7c38-4d62-853b-deb3a4239460", "name": "network-vif-deleted", "tag": "b29d061d-90e0-4745-abd4-b2821ee2d04e"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:42:30.420592 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-e47b4c4b-ff1c-4fef-a4f3-f7b099bf1036 req-0467443f-4162-4561-b4d7-39f8073eb065 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:30.421098 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-e47b4c4b-ff1c-4fef-a4f3-f7b099bf1036 req-0467443f-4162-4561-b4d7-39f8073eb065 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:30.421615 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-e47b4c4b-ff1c-4fef-a4f3-f7b099bf1036 req-0467443f-4162-4561-b4d7-39f8073eb065 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:30.451133 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-e47b4c4b-ff1c-4fef-a4f3-f7b099bf1036 req-0467443f-4162-4561-b4d7-39f8073eb065 service nova] Creating event network-vif-deleted:b29d061d-90e0-4745-abd4-b2821ee2d04e for instance b14cde49-7c38-4d62-853b-deb3a4239460 on n-h1-852278-4 Aug 27 02:42:30.457833 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-e47b4c4b-ff1c-4fef-a4f3-f7b099bf1036 req-0467443f-4162-4561-b4d7-39f8073eb065 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094622 Aug 27 02:42:30.458470 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 390/757] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:42:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:42:30.465502 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a3a789f5-b0c6-481a-afe1-b65cef713db6 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:30.466453 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a3a789f5-b0c6-481a-afe1-b65cef713db6 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] [instance: 74d41279-27ab-492f-88ac-85f22b11b9ae] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:30.543472 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-a3a789f5-b0c6-481a-afe1-b65cef713db6 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9653dac89d2648b285fd71c1b349e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3ac0c66c5b4bc787d2d6e12a957099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:30.553889 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a3a789f5-b0c6-481a-afe1-b65cef713db6 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] 10.222.0.70 "GET /compute/v2.1/servers/74d41279-27ab-492f-88ac-85f22b11b9ae" status: 200 len: 1213 microversion: 2.1 time: 0.093860 Aug 27 02:42:30.555262 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 391/758] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:30 2022] GET /compute/v2.1/servers/74d41279-27ab-492f-88ac-85f22b11b9ae => generated 1213 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:30.564826 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3a1f80b2-44a9-4696-b8ad-b86943f1b377 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:30.568264 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-3a1f80b2-44a9-4696-b8ad-b86943f1b377 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] [instance: b14cde49-7c38-4d62-853b-deb3a4239460] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:30.579019 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3a1f80b2-44a9-4696-b8ad-b86943f1b377 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:30.581350 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3a1f80b2-44a9-4696-b8ad-b86943f1b377 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:30.583323 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3a1f80b2-44a9-4696-b8ad-b86943f1b377 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:30.584272 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3a1f80b2-44a9-4696-b8ad-b86943f1b377 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:30.586052 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3a1f80b2-44a9-4696-b8ad-b86943f1b377 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:30.587599 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3a1f80b2-44a9-4696-b8ad-b86943f1b377 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:30.617227 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-3a1f80b2-44a9-4696-b8ad-b86943f1b377 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] HTTP exception thrown: Instance b14cde49-7c38-4d62-853b-deb3a4239460 could not be found. Aug 27 02:42:30.619105 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3a1f80b2-44a9-4696-b8ad-b86943f1b377 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Request method failure captured: Aug 27 02:42:30.619105 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/servers/b14cde49-7c38-4d62-853b-deb3a4239460 HTTP/1.1 Aug 27 02:42:30.619105 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:42:30.619105 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:42:30.619105 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:42:30.619105 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:42:30.619105 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:42:30.619105 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:42:30.619105 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:42:30.619105 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:42:30.619105 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYRebx9vcIws-eCh6V9SRVJ_Py6JYj9hNIKtfOsxe9k7bZX4Su2BWk_wjsk2_BN3-H7P6rY96DDYmqLZCJN5btzDBAWPoLaO1Zz1CM5uyzLys1gJM5zG7Jrl1su_PDMukfTgUhvR3MTUBZEo31OkiwMwh4Xq0iJjs4j5s8nPzIwxEOg Aug 27 02:42:30.619105 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:42:30.619105 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:42:30.619105 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:42:30.619105 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:42:30.619105 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:42:30.619105 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:42:30.619105 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 25afdc85b9aa4c86bd4f8e2e4a22ff3e Aug 27 02:42:30.619105 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1078422441 Aug 27 02:42:30.619105 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:42:30.619105 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:42:30.620714 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/25afdc85b9aa4c86bd4f8e2e4a22ff3e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_25afdc85b9aa4c86bd4f8e2e4a22ff3e", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/25afdc85b9aa4c86bd4f8e2e4a22ff3e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/25afdc85b9aa4c86bd4f8e2e4a22ff3e"}]}] Aug 27 02:42:30.620714 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1078422441 Aug 27 02:42:30.620714 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 25afdc85b9aa4c86bd4f8e2e4a22ff3e Aug 27 02:42:30.620714 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1078422441 Aug 27 02:42:30.620714 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ServersAdminNegativeTestJSON-1078422441-project Aug 27 02:42:30.620714 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:42:30.620714 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:42:30.620714 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 7bb3ac70d5084c9c826b5722e5302ea4 Aug 27 02:42:30.620714 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1078422441-project Aug 27 02:42:30.620714 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 02:42:30.620714 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance b14cde49-7c38-4d62-853b-deb3a4239460 could not be found. Aug 27 02:42:30.620714 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': 'b14cde49-7c38-4d62-853b-deb3a4239460'} Aug 27 02:42:30.621719 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:42:30.621719 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:42:30.621719 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:42:30.621719 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:42:30.621719 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:42:30.621719 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:42:30.621719 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:42:30.621719 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:42:30.621719 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:42:30.621719 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:42:30.621719 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b14cde49-7c38-4d62-853b-deb3a4239460 could not be found. Aug 27 02:42:30.621719 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:42:30.621719 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:42:30.621719 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:42:30.621719 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:42:30.621719 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:42:30.621719 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:42:30.621719 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:42:30.621719 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:42:30.621719 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:42:30.623788 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:42:30.623788 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:42:30.623788 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:42:30.623788 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:42:30.623788 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:42:30.623788 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:42:30.623788 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:42:30.623788 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b14cde49-7c38-4d62-853b-deb3a4239460 could not be found. Aug 27 02:42:30.623788 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:42:30.623788 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:42:30.623788 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:42:30.623788 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:42:30.623788 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:42:30.623788 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:42:30.623788 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:42:30.623788 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:42:30.623788 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b14cde49-7c38-4d62-853b-deb3a4239460 could not be found. Aug 27 02:42:30.623788 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:42:30.625498 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3a1f80b2-44a9-4696-b8ad-b86943f1b377 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Returning 404 to user: Instance b14cde49-7c38-4d62-853b-deb3a4239460 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:42:30.625498 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-3a1f80b2-44a9-4696-b8ad-b86943f1b377 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] 10.222.0.70 "GET /compute/v2.1/servers/b14cde49-7c38-4d62-853b-deb3a4239460" status: 404 len: 111 microversion: 2.1 time: 0.064264 Aug 27 02:42:30.629927 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 392/759] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:30 2022] GET /compute/v2.1/servers/b14cde49-7c38-4d62-853b-deb3a4239460 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:42:30.646270 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-dd498b0e-8136-4a4d-a482-7e848469f174 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Action: 'create', calling method: .version_select at 0x7f5ee33e1c10>, body: {"keypair": {"name": "tempest-keypair-295401307", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC7CO3y5yUrxU8y908q9ogQdz1rEhpqkOIlTmPkq0tIjw8QCtshaX/EzSPOKBZvjJDOkkX26s2sXsvmXx/1Q2nrWXXi24OYCjx/FJMJjpckhxJUSuSV7wivw0yBq9//pyQ=="}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:42:30.712268 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-dd498b0e-8136-4a4d-a482-7e848469f174 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Getting quotas for project 42ec913a638c4c8c8749be73705d2c65. Resources: {'key_pairs'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:42:30.746055 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-dd498b0e-8136-4a4d-a482-7e848469f174 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Getting quotas for user 6305debcc9294643bbed97f08de171bc and project 42ec913a638c4c8c8749be73705d2c65. Resources: {'key_pairs'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:42:30.821826 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-dd498b0e-8136-4a4d-a482-7e848469f174 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.190584 Aug 27 02:42:30.825757 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 393/760] 10.222.0.70 () {60 vars in 1159 bytes} [Sat Aug 27 02:42:30 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:42:30.840387 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f83dd663-ff0c-439e-bee2-2eaf0f56ff07 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:30.841332 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-f83dd663-ff0c-439e-bee2-2eaf0f56ff07 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] [instance: 3ee4d4db-a1bb-4567-a20d-29003e67a295] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:30.871053 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f83dd663-ff0c-439e-bee2-2eaf0f56ff07 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:30.871562 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f83dd663-ff0c-439e-bee2-2eaf0f56ff07 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:30.872010 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f83dd663-ff0c-439e-bee2-2eaf0f56ff07 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:30.872768 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f83dd663-ff0c-439e-bee2-2eaf0f56ff07 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:30.879355 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f83dd663-ff0c-439e-bee2-2eaf0f56ff07 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:30.887021 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f83dd663-ff0c-439e-bee2-2eaf0f56ff07 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:31.405088 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-f83dd663-ff0c-439e-bee2-2eaf0f56ff07 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30abbf3afe304291981a6a9b85952aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c28ddbdb164f01bb82235c6d49717b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:31.417341 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f83dd663-ff0c-439e-bee2-2eaf0f56ff07 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] 10.222.0.70 "GET /compute/v2.1/servers/3ee4d4db-a1bb-4567-a20d-29003e67a295" status: 200 len: 1477 microversion: 2.1 time: 0.587971 Aug 27 02:42:31.417921 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 394/761] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:30 2022] GET /compute/v2.1/servers/3ee4d4db-a1bb-4567-a20d-29003e67a295 => generated 1477 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:31.449906 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-01e5ea84-f750-4763-b773-ba4f628e07fd tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:31.450417 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-01e5ea84-f750-4763-b773-ba4f628e07fd tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] [instance: 50597771-779f-426a-9cdc-17a6f2fb01fd] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:31.471327 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-01e5ea84-f750-4763-b773-ba4f628e07fd tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:31.472409 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-01e5ea84-f750-4763-b773-ba4f628e07fd tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:31.472886 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-01e5ea84-f750-4763-b773-ba4f628e07fd tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:31.473675 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-01e5ea84-f750-4763-b773-ba4f628e07fd tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:31.474142 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-01e5ea84-f750-4763-b773-ba4f628e07fd tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:31.474568 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-01e5ea84-f750-4763-b773-ba4f628e07fd tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:31.528093 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-01e5ea84-f750-4763-b773-ba4f628e07fd tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] [instance: 50597771-779f-426a-9cdc-17a6f2fb01fd] Going to try to terminate instance {{(pid=134052) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:42:31.691360 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:42:31.710004 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-01e5ea84-f750-4763-b773-ba4f628e07fd tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] 10.222.0.70 "DELETE /compute/v2.1/servers/50597771-779f-426a-9cdc-17a6f2fb01fd" status: 204 len: 0 microversion: 2.1 time: 0.271516 Aug 27 02:42:31.716012 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 395/762] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:42:31 2022] DELETE /compute/v2.1/servers/50597771-779f-426a-9cdc-17a6f2fb01fd => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:42:31.731637 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0c42af02-f131-4e02-818f-5165ba18ab84 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:31.734468 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-0c42af02-f131-4e02-818f-5165ba18ab84 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] [instance: 74d41279-27ab-492f-88ac-85f22b11b9ae] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:31.743178 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0c42af02-f131-4e02-818f-5165ba18ab84 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:31.743925 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0c42af02-f131-4e02-818f-5165ba18ab84 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:31.745271 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0c42af02-f131-4e02-818f-5165ba18ab84 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:31.747071 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0c42af02-f131-4e02-818f-5165ba18ab84 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:31.747856 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0c42af02-f131-4e02-818f-5165ba18ab84 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:31.749311 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0c42af02-f131-4e02-818f-5165ba18ab84 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:31.946205 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0c42af02-f131-4e02-818f-5165ba18ab84 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9653dac89d2648b285fd71c1b349e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3ac0c66c5b4bc787d2d6e12a957099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:31.959470 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-0c42af02-f131-4e02-818f-5165ba18ab84 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] 10.222.0.70 "GET /compute/v2.1/servers/74d41279-27ab-492f-88ac-85f22b11b9ae" status: 200 len: 1265 microversion: 2.1 time: 0.237964 Aug 27 02:42:31.962125 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 396/763] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:31 2022] GET /compute/v2.1/servers/74d41279-27ab-492f-88ac-85f22b11b9ae => generated 1265 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:31.968299 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9da70a80-4665-4a0c-9156-61870003dcc2 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:31.969384 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-9da70a80-4665-4a0c-9156-61870003dcc2 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] [instance: 50597771-779f-426a-9cdc-17a6f2fb01fd] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:32.010823 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9da70a80-4665-4a0c-9156-61870003dcc2 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:32.011784 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9da70a80-4665-4a0c-9156-61870003dcc2 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:32.014016 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9da70a80-4665-4a0c-9156-61870003dcc2 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:32.017774 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9da70a80-4665-4a0c-9156-61870003dcc2 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:32.018612 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9da70a80-4665-4a0c-9156-61870003dcc2 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:32.020735 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9da70a80-4665-4a0c-9156-61870003dcc2 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:32.299638 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-9da70a80-4665-4a0c-9156-61870003dcc2 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb3ac70d5084c9c826b5722e5302ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25afdc85b9aa4c86bd4f8e2e4a22ff3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:32.311540 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9da70a80-4665-4a0c-9156-61870003dcc2 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] 10.222.0.70 "GET /compute/v2.1/servers/50597771-779f-426a-9cdc-17a6f2fb01fd" status: 200 len: 1477 microversion: 2.1 time: 0.347631 Aug 27 02:42:32.328104 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 397/764] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:31 2022] GET /compute/v2.1/servers/50597771-779f-426a-9cdc-17a6f2fb01fd => generated 1477 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:32.349476 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b98ae9a8-5132-474c-8959-fc132450ecc0 tempest-FloatingIPDetailsTestJSON-1296090266 tempest-FloatingIPDetailsTestJSON-1296090266-project] 10.222.0.70 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.892949 Aug 27 02:42:32.350414 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 368/765] 10.222.0.70 () {60 vars in 1170 bytes} [Sat Aug 27 02:42:29 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2895 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:42:32.365364 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0d74ddd6-e847-467a-8cf2-8f6cd22362ff tempest-FloatingIPDetailsTestJSON-1296090266 tempest-FloatingIPDetailsTestJSON-1296090266-project] Calling method '.version_select at 0x7f5ee3371160>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:32.416476 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-fb4823ab-6108-4600-ba97-f4f8a75f3b2f req-4e85e2d3-e40d-4bcb-b7e9-f011d387bbe9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ee4d4db-a1bb-4567-a20d-29003e67a295", "name": "network-vif-plugged", "status": "completed", "tag": "cb37d724-8fd4-499e-a131-e0d13d7b8f95"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:42:32.438838 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-fb4823ab-6108-4600-ba97-f4f8a75f3b2f req-4e85e2d3-e40d-4bcb-b7e9-f011d387bbe9 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:32.439891 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-fb4823ab-6108-4600-ba97-f4f8a75f3b2f req-4e85e2d3-e40d-4bcb-b7e9-f011d387bbe9 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:32.440572 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-fb4823ab-6108-4600-ba97-f4f8a75f3b2f req-4e85e2d3-e40d-4bcb-b7e9-f011d387bbe9 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:32.455382 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-fb4823ab-6108-4600-ba97-f4f8a75f3b2f req-4e85e2d3-e40d-4bcb-b7e9-f011d387bbe9 service nova] Creating event network-vif-plugged:cb37d724-8fd4-499e-a131-e0d13d7b8f95 for instance 3ee4d4db-a1bb-4567-a20d-29003e67a295 on n-h2-852278-4 Aug 27 02:42:32.461157 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-fb4823ab-6108-4600-ba97-f4f8a75f3b2f req-4e85e2d3-e40d-4bcb-b7e9-f011d387bbe9 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048419 Aug 27 02:42:32.463760 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 369/766] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:42:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:42:32.472017 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-6cfd57a4-3b16-49f3-a347-669736c6e4f5 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:32.473028 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-6cfd57a4-3b16-49f3-a347-669736c6e4f5 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] [instance: 3ee4d4db-a1bb-4567-a20d-29003e67a295] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:32.493658 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6cfd57a4-3b16-49f3-a347-669736c6e4f5 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:32.495719 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6cfd57a4-3b16-49f3-a347-669736c6e4f5 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:32.496425 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6cfd57a4-3b16-49f3-a347-669736c6e4f5 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:32.497376 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6cfd57a4-3b16-49f3-a347-669736c6e4f5 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:32.498849 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6cfd57a4-3b16-49f3-a347-669736c6e4f5 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:32.499574 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6cfd57a4-3b16-49f3-a347-669736c6e4f5 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:32.754100 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-0d74ddd6-e847-467a-8cf2-8f6cd22362ff tempest-FloatingIPDetailsTestJSON-1296090266 tempest-FloatingIPDetailsTestJSON-1296090266-project] 10.222.0.70 "GET /compute/v2.1/os-floating-ips/1fdba0e3-8bd1-4813-99dc-a8efd4540ec9" status: 200 len: 142 microversion: 2.1 time: 0.394670 Aug 27 02:42:32.755331 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 398/767] 10.222.0.70 () {58 vars in 1260 bytes} [Sat Aug 27 02:42:32 2022] GET /compute/v2.1/os-floating-ips/1fdba0e3-8bd1-4813-99dc-a8efd4540ec9 => generated 142 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:42:32.767804 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-505e7af1-dee9-470f-8cbd-7ac6da99830d tempest-FloatingIPDetailsTestJSON-1296090266 tempest-FloatingIPDetailsTestJSON-1296090266-project] Calling method '.version_select at 0x7f5ee359ab80>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:33.201489 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-6cfd57a4-3b16-49f3-a347-669736c6e4f5 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30abbf3afe304291981a6a9b85952aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c28ddbdb164f01bb82235c6d49717b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:33.221075 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-6cfd57a4-3b16-49f3-a347-669736c6e4f5 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] 10.222.0.70 "GET /compute/v2.1/servers/3ee4d4db-a1bb-4567-a20d-29003e67a295" status: 200 len: 1477 microversion: 2.1 time: 0.755100 Aug 27 02:42:33.226737 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 370/768] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:32 2022] GET /compute/v2.1/servers/3ee4d4db-a1bb-4567-a20d-29003e67a295 => generated 1477 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:33.237510 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-1b866a07-0c4d-48b9-b2d3-837154a05912 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:33.238864 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-1b866a07-0c4d-48b9-b2d3-837154a05912 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] [instance: 74d41279-27ab-492f-88ac-85f22b11b9ae] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:33.249742 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=66 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:42:33.254144 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1b866a07-0c4d-48b9-b2d3-837154a05912 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:33.254911 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1b866a07-0c4d-48b9-b2d3-837154a05912 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:33.255585 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1b866a07-0c4d-48b9-b2d3-837154a05912 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:33.258393 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1b866a07-0c4d-48b9-b2d3-837154a05912 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:33.259177 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1b866a07-0c4d-48b9-b2d3-837154a05912 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:33.259858 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1b866a07-0c4d-48b9-b2d3-837154a05912 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:33.352742 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-1b866a07-0c4d-48b9-b2d3-837154a05912 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9653dac89d2648b285fd71c1b349e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3ac0c66c5b4bc787d2d6e12a957099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:33.364130 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-1b866a07-0c4d-48b9-b2d3-837154a05912 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] 10.222.0.70 "GET /compute/v2.1/servers/74d41279-27ab-492f-88ac-85f22b11b9ae" status: 200 len: 1271 microversion: 2.1 time: 0.135626 Aug 27 02:42:33.365100 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 371/769] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:33 2022] GET /compute/v2.1/servers/74d41279-27ab-492f-88ac-85f22b11b9ae => generated 1271 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:33.384051 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-68378581-9845-44a0-b14f-8288a6cd14cf tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:33.384836 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-68378581-9845-44a0-b14f-8288a6cd14cf tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] [instance: 7c1f28aa-64fe-4517-88e2-b2e677baea24] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:33.391877 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-68378581-9845-44a0-b14f-8288a6cd14cf tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:33.392536 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-68378581-9845-44a0-b14f-8288a6cd14cf tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:33.393075 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-68378581-9845-44a0-b14f-8288a6cd14cf tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:33.393896 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-68378581-9845-44a0-b14f-8288a6cd14cf tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:33.394443 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-68378581-9845-44a0-b14f-8288a6cd14cf tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:33.394940 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-68378581-9845-44a0-b14f-8288a6cd14cf tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:33.421932 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-68378581-9845-44a0-b14f-8288a6cd14cf tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] [instance: 7c1f28aa-64fe-4517-88e2-b2e677baea24] Going to try to terminate instance {{(pid=134051) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:42:33.514011 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-68378581-9845-44a0-b14f-8288a6cd14cf tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] 10.222.0.70 "DELETE /compute/v2.1/servers/7c1f28aa-64fe-4517-88e2-b2e677baea24" status: 204 len: 0 microversion: 2.1 time: 0.133351 Aug 27 02:42:33.515168 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 372/770] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:42:33 2022] DELETE /compute/v2.1/servers/7c1f28aa-64fe-4517-88e2-b2e677baea24 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:42:33.670774 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-757960bd-55ff-4d86-90ca-407e1a14b324 tempest-NetworksTest-1658193290 tempest-NetworksTest-1658193290-project-admin] Calling method '.version_select at 0x7f5edf445040>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:33.912621 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-757960bd-55ff-4d86-90ca-407e1a14b324 tempest-NetworksTest-1658193290 tempest-NetworksTest-1658193290-project-admin] 10.222.0.70 "GET /compute/v2.1/os-networks" status: 200 len: 8774 microversion: 2.1 time: 0.395340 Aug 27 02:42:33.913999 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 373/771] 10.222.0.70 () {58 vars in 1137 bytes} [Sat Aug 27 02:42:33 2022] GET /compute/v2.1/os-networks => generated 8774 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:33.932875 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-6658552f-5345-412d-be57-399f63412754 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:33.933871 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-6658552f-5345-412d-be57-399f63412754 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] [instance: 50597771-779f-426a-9cdc-17a6f2fb01fd] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:33.947728 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6658552f-5345-412d-be57-399f63412754 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:33.948939 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6658552f-5345-412d-be57-399f63412754 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:33.951227 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6658552f-5345-412d-be57-399f63412754 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:33.954028 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6658552f-5345-412d-be57-399f63412754 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:33.954512 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6658552f-5345-412d-be57-399f63412754 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:33.954976 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6658552f-5345-412d-be57-399f63412754 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:34.234309 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-6658552f-5345-412d-be57-399f63412754 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb3ac70d5084c9c826b5722e5302ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25afdc85b9aa4c86bd4f8e2e4a22ff3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:34.237891 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-505e7af1-dee9-470f-8cbd-7ac6da99830d tempest-FloatingIPDetailsTestJSON-1296090266 tempest-FloatingIPDetailsTestJSON-1296090266-project] 10.222.0.70 "DELETE /compute/v2.1/os-floating-ips/1fdba0e3-8bd1-4813-99dc-a8efd4540ec9" status: 202 len: 0 microversion: 2.1 time: 1.474063 Aug 27 02:42:34.239387 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 399/772] 10.222.0.70 () {58 vars in 1263 bytes} [Sat Aug 27 02:42:32 2022] DELETE /compute/v2.1/os-floating-ips/1fdba0e3-8bd1-4813-99dc-a8efd4540ec9 => generated 0 bytes in 1476 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 02:42:34.245206 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-03303bb3-546d-4089-b1de-e520cd92f6f6 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:34.246104 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-03303bb3-546d-4089-b1de-e520cd92f6f6 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] [instance: 7c1f28aa-64fe-4517-88e2-b2e677baea24] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:34.247304 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-6658552f-5345-412d-be57-399f63412754 tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] 10.222.0.70 "GET /compute/v2.1/servers/50597771-779f-426a-9cdc-17a6f2fb01fd" status: 200 len: 1477 microversion: 2.1 time: 0.331789 Aug 27 02:42:34.247900 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 374/773] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:33 2022] GET /compute/v2.1/servers/50597771-779f-426a-9cdc-17a6f2fb01fd => generated 1477 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:34.253192 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-03303bb3-546d-4089-b1de-e520cd92f6f6 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:34.253626 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-5d460b30-8e56-48c7-b32a-f06473f251af tempest-NetworksTest-1658193290 tempest-NetworksTest-1658193290-project-admin] Calling method '.version_select at 0x7f5edf898670>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:34.253875 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-03303bb3-546d-4089-b1de-e520cd92f6f6 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:34.254435 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-03303bb3-546d-4089-b1de-e520cd92f6f6 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:34.255259 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-03303bb3-546d-4089-b1de-e520cd92f6f6 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:34.255805 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-03303bb3-546d-4089-b1de-e520cd92f6f6 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:34.256476 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-03303bb3-546d-4089-b1de-e520cd92f6f6 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:34.418851 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-5d460b30-8e56-48c7-b32a-f06473f251af tempest-NetworksTest-1658193290 tempest-NetworksTest-1658193290-project-admin] 10.222.0.70 "GET /compute/v2.1/os-networks/65cca408-d0e3-41ef-a7be-f6f3ea292ba5" status: 200 len: 652 microversion: 2.1 time: 0.169399 Aug 27 02:42:34.421941 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 375/774] 10.222.0.70 () {58 vars in 1248 bytes} [Sat Aug 27 02:42:34 2022] GET /compute/v2.1/os-networks/65cca408-d0e3-41ef-a7be-f6f3ea292ba5 => generated 652 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:42:34.424762 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ccaf9adf-538b-406d-a568-108f54ca1cd5 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1036418794", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "networks": [{"uuid": "fca9b1d3-694a-4672-8678-5d39e71afa11"}], "security_groups": [{"name": "tempest-securitygroup--1541574534"}], "key_name": "tempest-keypair-295401307", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:42:34.444024 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-03303bb3-546d-4089-b1de-e520cd92f6f6 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c850104e6d430397bb54d0e3730a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72992d9dba564526b223533398a94dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:34.453078 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-03303bb3-546d-4089-b1de-e520cd92f6f6 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] 10.222.0.70 "GET /compute/v2.1/servers/7c1f28aa-64fe-4517-88e2-b2e677baea24" status: 200 len: 1711 microversion: 2.1 time: 0.212384 Aug 27 02:42:34.453859 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 400/775] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:34 2022] GET /compute/v2.1/servers/7c1f28aa-64fe-4517-88e2-b2e677baea24 => generated 1711 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:34.459378 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-c1be9f05-c38e-4025-8460-fe988472ee89 req-7d7fcc97-bd30-4ac2-9ee9-dcbb0d341ee7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50597771-779f-426a-9cdc-17a6f2fb01fd", "name": "network-vif-deleted", "tag": "5d4a954d-d8fd-4d2d-9c40-fd2bf505d3ae"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:42:34.477154 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-c1be9f05-c38e-4025-8460-fe988472ee89 req-7d7fcc97-bd30-4ac2-9ee9-dcbb0d341ee7 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:34.477706 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-c1be9f05-c38e-4025-8460-fe988472ee89 req-7d7fcc97-bd30-4ac2-9ee9-dcbb0d341ee7 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:34.478393 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-c1be9f05-c38e-4025-8460-fe988472ee89 req-7d7fcc97-bd30-4ac2-9ee9-dcbb0d341ee7 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:34.501643 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-c1be9f05-c38e-4025-8460-fe988472ee89 req-7d7fcc97-bd30-4ac2-9ee9-dcbb0d341ee7 service nova] Creating event network-vif-deleted:5d4a954d-d8fd-4d2d-9c40-fd2bf505d3ae for instance 50597771-779f-426a-9cdc-17a6f2fb01fd on n-h1-852278-4 Aug 27 02:42:34.510435 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-c1be9f05-c38e-4025-8460-fe988472ee89 req-7d7fcc97-bd30-4ac2-9ee9-dcbb0d341ee7 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054908 Aug 27 02:42:34.511081 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 401/776] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:42:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:42:34.516633 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-773e6922-f16a-4b12-aceb-55c1af05cd01 tempest-FloatingIPDetailsTestJSON-1296090266 tempest-FloatingIPDetailsTestJSON-1296090266-project] Calling method '.version_select at 0x7f5ee35e2dc0>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:34.625573 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.network.neutron [None req-ccaf9adf-538b-406d-a568-108f54ca1cd5 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] validate_networks() for [('fca9b1d3-694a-4672-8678-5d39e71afa11', None, None, None, None, None)] {{(pid=134051) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:42:34.792270 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-773e6922-f16a-4b12-aceb-55c1af05cd01 tempest-FloatingIPDetailsTestJSON-1296090266 tempest-FloatingIPDetailsTestJSON-1296090266-project] 10.222.0.70 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.279934 Aug 27 02:42:34.793114 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 402/777] 10.222.0.70 () {58 vars in 1164 bytes} [Sat Aug 27 02:42:34 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:42:34.803211 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8d32451e-462d-4637-ac8a-3366e0b0c98c tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:34.803937 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-8d32451e-462d-4637-ac8a-3366e0b0c98c tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] [instance: 3ee4d4db-a1bb-4567-a20d-29003e67a295] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:34.815229 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8d32451e-462d-4637-ac8a-3366e0b0c98c tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:34.815962 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8d32451e-462d-4637-ac8a-3366e0b0c98c tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:34.816619 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8d32451e-462d-4637-ac8a-3366e0b0c98c tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:34.817479 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8d32451e-462d-4637-ac8a-3366e0b0c98c tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:34.818077 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8d32451e-462d-4637-ac8a-3366e0b0c98c tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:34.818664 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8d32451e-462d-4637-ac8a-3366e0b0c98c tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:35.088326 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-8d32451e-462d-4637-ac8a-3366e0b0c98c tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30abbf3afe304291981a6a9b85952aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c28ddbdb164f01bb82235c6d49717b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:35.096853 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-8d32451e-462d-4637-ac8a-3366e0b0c98c tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] 10.222.0.70 "GET /compute/v2.1/servers/3ee4d4db-a1bb-4567-a20d-29003e67a295" status: 200 len: 1477 microversion: 2.1 time: 0.297290 Aug 27 02:42:35.097875 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 403/778] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:34 2022] GET /compute/v2.1/servers/3ee4d4db-a1bb-4567-a20d-29003e67a295 => generated 1477 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:35.103214 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e3cefa19-cc77-4d27-b638-81756c24c531 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:35.103835 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-e3cefa19-cc77-4d27-b638-81756c24c531 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] [instance: 74d41279-27ab-492f-88ac-85f22b11b9ae] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:35.110711 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e3cefa19-cc77-4d27-b638-81756c24c531 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:35.111808 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e3cefa19-cc77-4d27-b638-81756c24c531 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:35.112411 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e3cefa19-cc77-4d27-b638-81756c24c531 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:35.113159 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e3cefa19-cc77-4d27-b638-81756c24c531 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:35.113605 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e3cefa19-cc77-4d27-b638-81756c24c531 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:35.114491 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e3cefa19-cc77-4d27-b638-81756c24c531 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:35.265420 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-ccaf9adf-538b-406d-a568-108f54ca1cd5 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Flavor limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:42:35.265915 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-ccaf9adf-538b-406d-a568-108f54ca1cd5 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Image limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:42:35.266614 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-ccaf9adf-538b-406d-a568-108f54ca1cd5 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Flavor pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:42:35.266866 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-ccaf9adf-538b-406d-a568-108f54ca1cd5 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Image pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:42:35.267285 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-ccaf9adf-538b-406d-a568-108f54ca1cd5 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:42:35.276750 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ccaf9adf-538b-406d-a568-108f54ca1cd5 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:35.277243 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ccaf9adf-538b-406d-a568-108f54ca1cd5 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:35.277874 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ccaf9adf-538b-406d-a568-108f54ca1cd5 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:35.278650 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ccaf9adf-538b-406d-a568-108f54ca1cd5 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:35.279290 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ccaf9adf-538b-406d-a568-108f54ca1cd5 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:35.279935 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ccaf9adf-538b-406d-a568-108f54ca1cd5 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:35.299420 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-ccaf9adf-538b-406d-a568-108f54ca1cd5 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Getting quotas for project 42ec913a638c4c8c8749be73705d2c65. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:42:35.305633 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-ccaf9adf-538b-406d-a568-108f54ca1cd5 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Getting quotas for user 6305debcc9294643bbed97f08de171bc and project 42ec913a638c4c8c8749be73705d2c65. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:42:35.311411 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-e3cefa19-cc77-4d27-b638-81756c24c531 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9653dac89d2648b285fd71c1b349e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3ac0c66c5b4bc787d2d6e12a957099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:35.319301 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e3cefa19-cc77-4d27-b638-81756c24c531 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] 10.222.0.70 "GET /compute/v2.1/servers/74d41279-27ab-492f-88ac-85f22b11b9ae" status: 200 len: 1313 microversion: 2.1 time: 0.220072 Aug 27 02:42:35.319654 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-ccaf9adf-538b-406d-a568-108f54ca1cd5 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Going to run 1 instances... {{(pid=134051) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:42:35.322034 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-ccaf9adf-538b-406d-a568-108f54ca1cd5 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 3095a9f9-6769-4107-94a5-beac6415694c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134051) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:42:35.326707 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 404/779] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:35 2022] GET /compute/v2.1/servers/74d41279-27ab-492f-88ac-85f22b11b9ae => generated 1313 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:35.334810 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a620b6d0-2fe7-4640-86de-f869fd13f4a7 tempest-NetworksTest-1658193290 tempest-NetworksTest-1658193290-project-admin] Calling method '.version_select at 0x7f5ee3610940>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:35.385585 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ccaf9adf-538b-406d-a568-108f54ca1cd5 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.964853 Aug 27 02:42:35.393860 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 376/780] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 02:42:34 2022] POST /compute/v2.1/servers => generated 406 bytes in 973 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:42:35.400641 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-51114daa-0c0a-48ff-926a-c759e4bf2194 tempest-FloatingIPDetailsTestJSON-1296090266 tempest-FloatingIPDetailsTestJSON-1296090266-project] Calling method '.version_select at 0x7f5edf445940>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:35.767886 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a620b6d0-2fe7-4640-86de-f869fd13f4a7 tempest-NetworksTest-1658193290 tempest-NetworksTest-1658193290-project-admin] 10.222.0.70 "GET /compute/v2.1/os-networks" status: 200 len: 8774 microversion: 2.1 time: 0.439793 Aug 27 02:42:35.769291 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 405/781] 10.222.0.70 () {58 vars in 1137 bytes} [Sat Aug 27 02:42:35 2022] GET /compute/v2.1/os-networks => generated 8774 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:35.781533 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-2d1278de-5b03-4711-8b5b-4caabee3baaf tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:35.786411 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-2d1278de-5b03-4711-8b5b-4caabee3baaf tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] [instance: 7eded9ca-c7bc-499a-bb53-a28d2c332402] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:35.810248 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2d1278de-5b03-4711-8b5b-4caabee3baaf tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:35.812463 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2d1278de-5b03-4711-8b5b-4caabee3baaf tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:35.813096 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2d1278de-5b03-4711-8b5b-4caabee3baaf tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:35.813863 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2d1278de-5b03-4711-8b5b-4caabee3baaf tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:35.814341 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2d1278de-5b03-4711-8b5b-4caabee3baaf tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:35.814771 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2d1278de-5b03-4711-8b5b-4caabee3baaf tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:35.877206 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-51114daa-0c0a-48ff-926a-c759e4bf2194 tempest-FloatingIPDetailsTestJSON-1296090266 tempest-FloatingIPDetailsTestJSON-1296090266-project] 10.222.0.70 "GET /compute/v2.1/os-floating-ips" status: 200 len: 399 microversion: 2.1 time: 0.481143 Aug 27 02:42:35.878056 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 377/782] 10.222.0.70 () {58 vars in 1149 bytes} [Sat Aug 27 02:42:35 2022] GET /compute/v2.1/os-floating-ips => generated 399 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:42:35.897200 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d64744f5-bfa4-4dff-94e2-6068abab6b4b tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:35.897832 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d64744f5-bfa4-4dff-94e2-6068abab6b4b tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] [instance: 50597771-779f-426a-9cdc-17a6f2fb01fd] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:35.912204 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d64744f5-bfa4-4dff-94e2-6068abab6b4b tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:35.912724 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d64744f5-bfa4-4dff-94e2-6068abab6b4b tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:35.913161 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d64744f5-bfa4-4dff-94e2-6068abab6b4b tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:35.918501 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d64744f5-bfa4-4dff-94e2-6068abab6b4b tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:35.920259 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d64744f5-bfa4-4dff-94e2-6068abab6b4b tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:35.922111 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d64744f5-bfa4-4dff-94e2-6068abab6b4b tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:35.952043 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-d64744f5-bfa4-4dff-94e2-6068abab6b4b tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] HTTP exception thrown: Instance 50597771-779f-426a-9cdc-17a6f2fb01fd could not be found. Aug 27 02:42:35.954075 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d64744f5-bfa4-4dff-94e2-6068abab6b4b tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Request method failure captured: Aug 27 02:42:35.954075 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/50597771-779f-426a-9cdc-17a6f2fb01fd HTTP/1.1 Aug 27 02:42:35.954075 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:42:35.954075 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:42:35.954075 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:42:35.954075 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:42:35.954075 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:42:35.954075 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:42:35.954075 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:42:35.954075 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:42:35.954075 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYRebx9vcIws-eCh6V9SRVJ_Py6JYj9hNIKtfOsxe9k7bZX4Su2BWk_wjsk2_BN3-H7P6rY96DDYmqLZCJN5btzDBAWPoLaO1Zz1CM5uyzLys1gJM5zG7Jrl1su_PDMukfTgUhvR3MTUBZEo31OkiwMwh4Xq0iJjs4j5s8nPzIwxEOg Aug 27 02:42:35.954075 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:42:35.954075 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:42:35.954075 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:42:35.954075 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:42:35.954075 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:42:35.954075 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:42:35.954075 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 25afdc85b9aa4c86bd4f8e2e4a22ff3e Aug 27 02:42:35.954075 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1078422441 Aug 27 02:42:35.954075 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:42:35.954075 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:42:35.955688 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/25afdc85b9aa4c86bd4f8e2e4a22ff3e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_25afdc85b9aa4c86bd4f8e2e4a22ff3e", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/25afdc85b9aa4c86bd4f8e2e4a22ff3e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/25afdc85b9aa4c86bd4f8e2e4a22ff3e"}]}] Aug 27 02:42:35.955688 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1078422441 Aug 27 02:42:35.955688 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 25afdc85b9aa4c86bd4f8e2e4a22ff3e Aug 27 02:42:35.955688 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1078422441 Aug 27 02:42:35.955688 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ServersAdminNegativeTestJSON-1078422441-project Aug 27 02:42:35.955688 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:42:35.955688 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:42:35.955688 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 7bb3ac70d5084c9c826b5722e5302ea4 Aug 27 02:42:35.955688 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1078422441-project Aug 27 02:42:35.955688 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 02:42:35.955688 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance 50597771-779f-426a-9cdc-17a6f2fb01fd could not be found. Aug 27 02:42:35.955688 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '50597771-779f-426a-9cdc-17a6f2fb01fd'} Aug 27 02:42:35.956678 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:42:35.956678 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:42:35.956678 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:42:35.956678 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:42:35.956678 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:42:35.956678 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:42:35.956678 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:42:35.956678 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:42:35.956678 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:42:35.956678 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:42:35.956678 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50597771-779f-426a-9cdc-17a6f2fb01fd could not be found. Aug 27 02:42:35.956678 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:42:35.956678 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:42:35.956678 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:42:35.956678 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:42:35.956678 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:42:35.956678 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:42:35.956678 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:42:35.956678 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:42:35.956678 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:42:35.958087 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:42:35.958087 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:42:35.958087 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:42:35.958087 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:42:35.958087 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:42:35.958087 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:42:35.958087 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:42:35.958087 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50597771-779f-426a-9cdc-17a6f2fb01fd could not be found. Aug 27 02:42:35.958087 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:42:35.958087 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:42:35.958087 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:42:35.958087 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:42:35.958087 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:42:35.958087 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:42:35.958087 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:42:35.958087 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:42:35.958087 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50597771-779f-426a-9cdc-17a6f2fb01fd could not be found. Aug 27 02:42:35.958087 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:42:35.959638 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d64744f5-bfa4-4dff-94e2-6068abab6b4b tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] Returning 404 to user: Instance 50597771-779f-426a-9cdc-17a6f2fb01fd could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:42:35.959638 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d64744f5-bfa4-4dff-94e2-6068abab6b4b tempest-ServersAdminNegativeTestJSON-1078422441 tempest-ServersAdminNegativeTestJSON-1078422441-project] 10.222.0.70 "GET /compute/v2.1/servers/50597771-779f-426a-9cdc-17a6f2fb01fd" status: 404 len: 111 microversion: 2.1 time: 0.076046 Aug 27 02:42:35.960554 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 378/783] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:35 2022] GET /compute/v2.1/servers/50597771-779f-426a-9cdc-17a6f2fb01fd => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:42:35.965533 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4db481b7-2e2c-436a-b820-a014b9958f43 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:35.966272 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-4db481b7-2e2c-436a-b820-a014b9958f43 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 3095a9f9-6769-4107-94a5-beac6415694c] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:36.099933 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-4db481b7-2e2c-436a-b820-a014b9958f43 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:36.107513 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-4db481b7-2e2c-436a-b820-a014b9958f43 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/3095a9f9-6769-4107-94a5-beac6415694c" status: 200 len: 1234 microversion: 2.1 time: 0.145830 Aug 27 02:42:36.108119 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 379/784] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:35 2022] GET /compute/v2.1/servers/3095a9f9-6769-4107-94a5-beac6415694c => generated 1234 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:36.126906 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8ad44171-7ebb-4bff-9ce7-34cd5a582304 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:36.127816 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-8ad44171-7ebb-4bff-9ce7-34cd5a582304 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] [instance: 7c1f28aa-64fe-4517-88e2-b2e677baea24] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:36.136555 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8ad44171-7ebb-4bff-9ce7-34cd5a582304 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:36.137395 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8ad44171-7ebb-4bff-9ce7-34cd5a582304 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:36.138042 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8ad44171-7ebb-4bff-9ce7-34cd5a582304 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:36.139088 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8ad44171-7ebb-4bff-9ce7-34cd5a582304 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:36.139739 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8ad44171-7ebb-4bff-9ce7-34cd5a582304 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:36.140510 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8ad44171-7ebb-4bff-9ce7-34cd5a582304 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:36.716617 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.instance [None req-2d1278de-5b03-4711-8b5b-4caabee3baaf tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lazy-loading 'services' on Instance uuid 7eded9ca-c7bc-499a-bb53-a28d2c332402 {{(pid=134052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:42:36.722164 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:42:36.742366 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-2d1278de-5b03-4711-8b5b-4caabee3baaf tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/7eded9ca-c7bc-499a-bb53-a28d2c332402" status: 200 len: 2342 microversion: 2.25 time: 0.968805 Aug 27 02:42:36.754697 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 406/785] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:42:35 2022] GET /compute/v2.1/servers/7eded9ca-c7bc-499a-bb53-a28d2c332402 => generated 2342 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:42:36.762591 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-43a794e3-601f-405d-8bc6-56ead75a129c tempest-FloatingIPDetailsTestJSON-1296090266 tempest-FloatingIPDetailsTestJSON-1296090266-project] Calling method '.version_select at 0x7f5ee37a6310>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:36.938354 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-8ad44171-7ebb-4bff-9ce7-34cd5a582304 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c850104e6d430397bb54d0e3730a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72992d9dba564526b223533398a94dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:36.948120 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-8ad44171-7ebb-4bff-9ce7-34cd5a582304 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] 10.222.0.70 "GET /compute/v2.1/servers/7c1f28aa-64fe-4517-88e2-b2e677baea24" status: 200 len: 1711 microversion: 2.1 time: 0.824917 Aug 27 02:42:36.949369 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 380/786] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:36 2022] GET /compute/v2.1/servers/7c1f28aa-64fe-4517-88e2-b2e677baea24 => generated 1711 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:36.957442 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b57dc042-f4b0-401a-8345-60d3fa298ab6 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:36.958615 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b57dc042-f4b0-401a-8345-60d3fa298ab6 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] [instance: 3ee4d4db-a1bb-4567-a20d-29003e67a295] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:36.965477 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b57dc042-f4b0-401a-8345-60d3fa298ab6 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:36.966433 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b57dc042-f4b0-401a-8345-60d3fa298ab6 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:36.967020 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b57dc042-f4b0-401a-8345-60d3fa298ab6 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:36.967971 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b57dc042-f4b0-401a-8345-60d3fa298ab6 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:36.968845 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b57dc042-f4b0-401a-8345-60d3fa298ab6 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:36.969276 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b57dc042-f4b0-401a-8345-60d3fa298ab6 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:36.991093 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:42:37.330727 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-b57dc042-f4b0-401a-8345-60d3fa298ab6 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30abbf3afe304291981a6a9b85952aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c28ddbdb164f01bb82235c6d49717b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:37.342727 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b57dc042-f4b0-401a-8345-60d3fa298ab6 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] 10.222.0.70 "GET /compute/v2.1/servers/3ee4d4db-a1bb-4567-a20d-29003e67a295" status: 200 len: 1463 microversion: 2.1 time: 0.391526 Aug 27 02:42:37.347920 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 381/787] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:36 2022] GET /compute/v2.1/servers/3ee4d4db-a1bb-4567-a20d-29003e67a295 => generated 1463 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:37.363247 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f11ef049-3acb-4d32-8a76-20f186cc755f tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:37.364119 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-f11ef049-3acb-4d32-8a76-20f186cc755f tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] [instance: 74d41279-27ab-492f-88ac-85f22b11b9ae] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:37.370839 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f11ef049-3acb-4d32-8a76-20f186cc755f tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:37.371564 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f11ef049-3acb-4d32-8a76-20f186cc755f tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:37.372402 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f11ef049-3acb-4d32-8a76-20f186cc755f tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:37.373550 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f11ef049-3acb-4d32-8a76-20f186cc755f tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:37.374884 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f11ef049-3acb-4d32-8a76-20f186cc755f tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:37.375495 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f11ef049-3acb-4d32-8a76-20f186cc755f tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:37.837636 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-f11ef049-3acb-4d32-8a76-20f186cc755f tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9653dac89d2648b285fd71c1b349e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3ac0c66c5b4bc787d2d6e12a957099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:37.845974 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-f11ef049-3acb-4d32-8a76-20f186cc755f tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] 10.222.0.70 "GET /compute/v2.1/servers/74d41279-27ab-492f-88ac-85f22b11b9ae" status: 200 len: 1355 microversion: 2.1 time: 0.496979 Aug 27 02:42:37.860245 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 382/788] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:37 2022] GET /compute/v2.1/servers/74d41279-27ab-492f-88ac-85f22b11b9ae => generated 1355 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:37.867487 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-506a0798-1f3f-46f7-aa83-1b7594c0b334 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:37.871921 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-506a0798-1f3f-46f7-aa83-1b7594c0b334 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:37.872676 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-506a0798-1f3f-46f7-aa83-1b7594c0b334 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:37.873386 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-506a0798-1f3f-46f7-aa83-1b7594c0b334 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:37.874440 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-506a0798-1f3f-46f7-aa83-1b7594c0b334 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:37.875354 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-506a0798-1f3f-46f7-aa83-1b7594c0b334 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:37.875940 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-506a0798-1f3f-46f7-aa83-1b7594c0b334 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:37.904155 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-506a0798-1f3f-46f7-aa83-1b7594c0b334 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] 10.222.0.70 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.042528 Aug 27 02:42:37.905066 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 383/789] 10.222.0.70 () {60 vars in 1217 bytes} [Sat Aug 27 02:42:37 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:42:37.924565 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4cae781a-bb41-4038-a0f7-9b91157c6cfa tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:37.926468 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-4cae781a-bb41-4038-a0f7-9b91157c6cfa tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 3095a9f9-6769-4107-94a5-beac6415694c] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:37.934619 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4cae781a-bb41-4038-a0f7-9b91157c6cfa tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:37.935320 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4cae781a-bb41-4038-a0f7-9b91157c6cfa tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:37.935897 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4cae781a-bb41-4038-a0f7-9b91157c6cfa tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:37.936786 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4cae781a-bb41-4038-a0f7-9b91157c6cfa tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:37.937443 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4cae781a-bb41-4038-a0f7-9b91157c6cfa tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:37.938728 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4cae781a-bb41-4038-a0f7-9b91157c6cfa tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:38.077130 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-4cae781a-bb41-4038-a0f7-9b91157c6cfa tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:38.090170 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-4cae781a-bb41-4038-a0f7-9b91157c6cfa tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/3095a9f9-6769-4107-94a5-beac6415694c" status: 200 len: 1292 microversion: 2.1 time: 0.179371 Aug 27 02:42:38.091020 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 384/790] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:37 2022] GET /compute/v2.1/servers/3095a9f9-6769-4107-94a5-beac6415694c => generated 1292 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:38.103755 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f5455f2e-c453-48a4-8fa9-4fb374f63c1b tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:38.104661 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-f5455f2e-c453-48a4-8fa9-4fb374f63c1b tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] [instance: 3ee4d4db-a1bb-4567-a20d-29003e67a295] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:38.117899 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f5455f2e-c453-48a4-8fa9-4fb374f63c1b tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:38.121345 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f5455f2e-c453-48a4-8fa9-4fb374f63c1b tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:38.124295 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f5455f2e-c453-48a4-8fa9-4fb374f63c1b tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:38.130376 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f5455f2e-c453-48a4-8fa9-4fb374f63c1b tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:38.131423 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f5455f2e-c453-48a4-8fa9-4fb374f63c1b tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:38.132776 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f5455f2e-c453-48a4-8fa9-4fb374f63c1b tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:38.658098 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-f5455f2e-c453-48a4-8fa9-4fb374f63c1b tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30abbf3afe304291981a6a9b85952aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c28ddbdb164f01bb82235c6d49717b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:38.667269 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-f5455f2e-c453-48a4-8fa9-4fb374f63c1b tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] 10.222.0.70 "GET /compute/v2.1/servers/3ee4d4db-a1bb-4567-a20d-29003e67a295" status: 200 len: 1463 microversion: 2.1 time: 0.574616 Aug 27 02:42:38.672645 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 385/791] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:38 2022] GET /compute/v2.1/servers/3ee4d4db-a1bb-4567-a20d-29003e67a295 => generated 1463 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:38.702349 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-dca344e3-dde4-453d-81e0-9a4c740ae5db tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:38.704988 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-dca344e3-dde4-453d-81e0-9a4c740ae5db tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] [instance: 7c1f28aa-64fe-4517-88e2-b2e677baea24] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:38.725643 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dca344e3-dde4-453d-81e0-9a4c740ae5db tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:38.726612 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dca344e3-dde4-453d-81e0-9a4c740ae5db tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:38.729932 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dca344e3-dde4-453d-81e0-9a4c740ae5db tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:38.730907 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dca344e3-dde4-453d-81e0-9a4c740ae5db tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:38.731574 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dca344e3-dde4-453d-81e0-9a4c740ae5db tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:38.733660 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dca344e3-dde4-453d-81e0-9a4c740ae5db tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:38.816136 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dca344e3-dde4-453d-81e0-9a4c740ae5db tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:38.817377 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dca344e3-dde4-453d-81e0-9a4c740ae5db tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:38.818278 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dca344e3-dde4-453d-81e0-9a4c740ae5db tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:38.842946 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.objects.instance [None req-dca344e3-dde4-453d-81e0-9a4c740ae5db tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lazy-loading 'fault' on Instance uuid 7c1f28aa-64fe-4517-88e2-b2e677baea24 {{(pid=134051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:42:38.980662 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-dca344e3-dde4-453d-81e0-9a4c740ae5db tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c850104e6d430397bb54d0e3730a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72992d9dba564526b223533398a94dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:38.990008 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-dca344e3-dde4-453d-81e0-9a4c740ae5db tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] 10.222.0.70 "GET /compute/v2.1/servers/7c1f28aa-64fe-4517-88e2-b2e677baea24" status: 200 len: 1353 microversion: 2.1 time: 0.316064 Aug 27 02:42:38.990596 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 386/792] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:38 2022] GET /compute/v2.1/servers/7c1f28aa-64fe-4517-88e2-b2e677baea24 => generated 1353 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:39.009099 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-edde7be7-d7be-46d9-ba67-e98549461552 req-d68a734b-7cb6-4968-995a-1d358cea9ffc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c1f28aa-64fe-4517-88e2-b2e677baea24", "name": "network-vif-deleted", "tag": "fdce9d3d-6208-43e7-9296-22fd6029a735"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:42:39.019437 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-edde7be7-d7be-46d9-ba67-e98549461552 req-d68a734b-7cb6-4968-995a-1d358cea9ffc service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:39.019922 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-edde7be7-d7be-46d9-ba67-e98549461552 req-d68a734b-7cb6-4968-995a-1d358cea9ffc service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:39.020386 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-edde7be7-d7be-46d9-ba67-e98549461552 req-d68a734b-7cb6-4968-995a-1d358cea9ffc service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:39.033493 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-edde7be7-d7be-46d9-ba67-e98549461552 req-d68a734b-7cb6-4968-995a-1d358cea9ffc service nova] Creating event network-vif-deleted:fdce9d3d-6208-43e7-9296-22fd6029a735 for instance 7c1f28aa-64fe-4517-88e2-b2e677baea24 on n-h2-852278-4 Aug 27 02:42:39.039349 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-edde7be7-d7be-46d9-ba67-e98549461552 req-d68a734b-7cb6-4968-995a-1d358cea9ffc service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033741 Aug 27 02:42:39.040262 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 387/793] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:42:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:42:39.046045 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-9ea5776f-a6cc-4eac-bad3-6b85947df0df req-ebf5971c-266b-49cb-bb23-509dfa66aa32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74d41279-27ab-492f-88ac-85f22b11b9ae", "tag": "c8e2f032-12c4-4c96-8d52-eafe91d1f3f2"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:42:39.057767 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-9ea5776f-a6cc-4eac-bad3-6b85947df0df req-ebf5971c-266b-49cb-bb23-509dfa66aa32 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:39.058453 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-9ea5776f-a6cc-4eac-bad3-6b85947df0df req-ebf5971c-266b-49cb-bb23-509dfa66aa32 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:39.059032 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-9ea5776f-a6cc-4eac-bad3-6b85947df0df req-ebf5971c-266b-49cb-bb23-509dfa66aa32 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:39.073695 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-9ea5776f-a6cc-4eac-bad3-6b85947df0df req-ebf5971c-266b-49cb-bb23-509dfa66aa32 service nova] Creating event network-changed:c8e2f032-12c4-4c96-8d52-eafe91d1f3f2 for instance 74d41279-27ab-492f-88ac-85f22b11b9ae on n-h2-852278-4 Aug 27 02:42:39.090917 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-9ea5776f-a6cc-4eac-bad3-6b85947df0df req-ebf5971c-266b-49cb-bb23-509dfa66aa32 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047202 Aug 27 02:42:39.095439 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 388/794] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:42:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:42:39.105973 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3ef101ce-1128-4153-824e-0c9f1bdff76d tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:42:39.113920 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-3ef101ce-1128-4153-824e-0c9f1bdff76d tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] [instance: 3ee4d4db-a1bb-4567-a20d-29003e67a295] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:39.127795 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3ef101ce-1128-4153-824e-0c9f1bdff76d tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:39.128295 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3ef101ce-1128-4153-824e-0c9f1bdff76d tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:39.129042 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3ef101ce-1128-4153-824e-0c9f1bdff76d tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:39.130067 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3ef101ce-1128-4153-824e-0c9f1bdff76d tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:39.130673 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3ef101ce-1128-4153-824e-0c9f1bdff76d tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:39.131794 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3ef101ce-1128-4153-824e-0c9f1bdff76d tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:39.302286 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-3ef101ce-1128-4153-824e-0c9f1bdff76d tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Flavor limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:42:39.302724 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-3ef101ce-1128-4153-824e-0c9f1bdff76d tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Image limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:42:39.303191 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-3ef101ce-1128-4153-824e-0c9f1bdff76d tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Flavor pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:42:39.313017 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-3ef101ce-1128-4153-824e-0c9f1bdff76d tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Image pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:42:39.315734 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-3ef101ce-1128-4153-824e-0c9f1bdff76d tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:42:39.459865 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-3ef101ce-1128-4153-824e-0c9f1bdff76d tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] [instance: 3ee4d4db-a1bb-4567-a20d-29003e67a295] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:39.481471 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3ef101ce-1128-4153-824e-0c9f1bdff76d tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:39.482408 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3ef101ce-1128-4153-824e-0c9f1bdff76d tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:39.484676 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3ef101ce-1128-4153-824e-0c9f1bdff76d tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:39.486383 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3ef101ce-1128-4153-824e-0c9f1bdff76d tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:39.489009 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3ef101ce-1128-4153-824e-0c9f1bdff76d tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:39.491914 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3ef101ce-1128-4153-824e-0c9f1bdff76d tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:39.571675 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-3ef101ce-1128-4153-824e-0c9f1bdff76d tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] 10.222.0.70 "POST /compute/v2.1/servers/3ee4d4db-a1bb-4567-a20d-29003e67a295/action" status: 202 len: 1067 microversion: 2.1 time: 0.474968 Aug 27 02:42:39.572816 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 389/795] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 02:42:39 2022] POST /compute/v2.1/servers/3ee4d4db-a1bb-4567-a20d-29003e67a295/action => generated 1067 bytes in 477 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 27 02:42:39.578339 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-00903094-0d17-414d-a616-e4889cf36453 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:39.579644 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-00903094-0d17-414d-a616-e4889cf36453 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] [instance: 74d41279-27ab-492f-88ac-85f22b11b9ae] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:39.586612 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-00903094-0d17-414d-a616-e4889cf36453 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:39.587424 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-00903094-0d17-414d-a616-e4889cf36453 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:39.589265 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-00903094-0d17-414d-a616-e4889cf36453 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:39.590256 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-00903094-0d17-414d-a616-e4889cf36453 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:39.595332 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-00903094-0d17-414d-a616-e4889cf36453 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:39.596300 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-00903094-0d17-414d-a616-e4889cf36453 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:39.609991 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:42:39.679202 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-43a794e3-601f-405d-8bc6-56ead75a129c tempest-FloatingIPDetailsTestJSON-1296090266 tempest-FloatingIPDetailsTestJSON-1296090266-project] 10.222.0.70 "DELETE /compute/v2.1/os-floating-ips/38528aeb-7665-4554-b9e6-800e6c2641ac" status: 202 len: 0 microversion: 2.1 time: 2.922815 Aug 27 02:42:39.680439 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 407/796] 10.222.0.70 () {58 vars in 1263 bytes} [Sat Aug 27 02:42:36 2022] DELETE /compute/v2.1/os-floating-ips/38528aeb-7665-4554-b9e6-800e6c2641ac => generated 0 bytes in 2925 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:42:39.686420 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c3175913-7f9c-4dc3-918b-e0d38e581bbe tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:39.690987 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-c3175913-7f9c-4dc3-918b-e0d38e581bbe tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 3095a9f9-6769-4107-94a5-beac6415694c] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:39.725322 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c3175913-7f9c-4dc3-918b-e0d38e581bbe tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:39.730741 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c3175913-7f9c-4dc3-918b-e0d38e581bbe tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:39.731395 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c3175913-7f9c-4dc3-918b-e0d38e581bbe tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:39.735035 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c3175913-7f9c-4dc3-918b-e0d38e581bbe tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:39.735524 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c3175913-7f9c-4dc3-918b-e0d38e581bbe tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:39.735939 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c3175913-7f9c-4dc3-918b-e0d38e581bbe tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:40.118573 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-c3175913-7f9c-4dc3-918b-e0d38e581bbe tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:40.143728 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c3175913-7f9c-4dc3-918b-e0d38e581bbe tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/3095a9f9-6769-4107-94a5-beac6415694c" status: 200 len: 1292 microversion: 2.1 time: 0.459839 Aug 27 02:42:40.145427 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 408/797] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:39 2022] GET /compute/v2.1/servers/3095a9f9-6769-4107-94a5-beac6415694c => generated 1292 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:40.166890 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9ad6174a-ffed-48a6-b64a-54fb7b6ac468 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:40.169501 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-9ad6174a-ffed-48a6-b64a-54fb7b6ac468 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] [instance: 3ee4d4db-a1bb-4567-a20d-29003e67a295] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:40.191390 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9ad6174a-ffed-48a6-b64a-54fb7b6ac468 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:40.192840 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9ad6174a-ffed-48a6-b64a-54fb7b6ac468 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:40.195020 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9ad6174a-ffed-48a6-b64a-54fb7b6ac468 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:40.195963 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9ad6174a-ffed-48a6-b64a-54fb7b6ac468 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:40.198517 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9ad6174a-ffed-48a6-b64a-54fb7b6ac468 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:40.201389 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9ad6174a-ffed-48a6-b64a-54fb7b6ac468 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:40.777180 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=12 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:42:40.929041 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-00903094-0d17-414d-a616-e4889cf36453 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9653dac89d2648b285fd71c1b349e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3ac0c66c5b4bc787d2d6e12a957099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:40.942956 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-00903094-0d17-414d-a616-e4889cf36453 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] 10.222.0.70 "GET /compute/v2.1/servers/74d41279-27ab-492f-88ac-85f22b11b9ae" status: 200 len: 1355 microversion: 2.1 time: 1.368944 Aug 27 02:42:40.943553 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 390/798] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:39 2022] GET /compute/v2.1/servers/74d41279-27ab-492f-88ac-85f22b11b9ae => generated 1355 bytes in 1370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:40.957473 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c7ab7f46-88ab-407a-9465-51f0d8d35768 tempest-FloatingIPDetailsTestJSON-1296090266 tempest-FloatingIPDetailsTestJSON-1296090266-project] Calling method '.version_select at 0x7f5edf4b9820>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:41.124741 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-9ad6174a-ffed-48a6-b64a-54fb7b6ac468 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30abbf3afe304291981a6a9b85952aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c28ddbdb164f01bb82235c6d49717b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:41.147942 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9ad6174a-ffed-48a6-b64a-54fb7b6ac468 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] 10.222.0.70 "GET /compute/v2.1/servers/3ee4d4db-a1bb-4567-a20d-29003e67a295" status: 200 len: 1472 microversion: 2.1 time: 0.988980 Aug 27 02:42:41.161639 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 409/799] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:40 2022] GET /compute/v2.1/servers/3ee4d4db-a1bb-4567-a20d-29003e67a295 => generated 1472 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:41.165981 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-977de308-c5c6-4719-be83-a1c53b4ee4e5 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:41.172934 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-977de308-c5c6-4719-be83-a1c53b4ee4e5 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] [instance: 7c1f28aa-64fe-4517-88e2-b2e677baea24] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:41.199533 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-977de308-c5c6-4719-be83-a1c53b4ee4e5 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:41.202673 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-977de308-c5c6-4719-be83-a1c53b4ee4e5 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:41.203136 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-977de308-c5c6-4719-be83-a1c53b4ee4e5 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:41.203872 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-977de308-c5c6-4719-be83-a1c53b4ee4e5 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:41.204340 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-977de308-c5c6-4719-be83-a1c53b4ee4e5 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:41.204762 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-977de308-c5c6-4719-be83-a1c53b4ee4e5 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:41.296551 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-977de308-c5c6-4719-be83-a1c53b4ee4e5 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] HTTP exception thrown: Instance 7c1f28aa-64fe-4517-88e2-b2e677baea24 could not be found. Aug 27 02:42:41.300075 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-977de308-c5c6-4719-be83-a1c53b4ee4e5 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Request method failure captured: Aug 27 02:42:41.300075 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/servers/7c1f28aa-64fe-4517-88e2-b2e677baea24 HTTP/1.1 Aug 27 02:42:41.300075 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:42:41.300075 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:42:41.300075 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:42:41.300075 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:42:41.300075 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:42:41.300075 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:42:41.300075 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:42:41.300075 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:42:41.300075 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYQOKECPKKpQ4qTsAxKF1HQoZNPstXz_5R0rIWnBk14HMZ8zIBdA-csxRoLUKyHdW16JJH6IEZArv_q5kgq9TL6XAA3YeA7hB8J7TT2eT8DjnxVwL0VmMhW1R7MT5lqqEYOA10hdDZWqUx36p1AFqg2E3wPw0b1v5eH2o1iNk3byZ9w Aug 27 02:42:41.300075 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:42:41.300075 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:42:41.300075 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:42:41.300075 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:42:41.300075 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:42:41.300075 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:42:41.300075 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 72992d9dba564526b223533398a94dea Aug 27 02:42:41.300075 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1738708986 Aug 27 02:42:41.300075 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:42:41.300075 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:42:41.301661 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/72992d9dba564526b223533398a94dea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_72992d9dba564526b223533398a94dea", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/72992d9dba564526b223533398a94dea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/72992d9dba564526b223533398a94dea"}]}] Aug 27 02:42:41.301661 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1738708986 Aug 27 02:42:41.301661 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 72992d9dba564526b223533398a94dea Aug 27 02:42:41.301661 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1738708986 Aug 27 02:42:41.301661 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1738708986-project Aug 27 02:42:41.301661 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:42:41.301661 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:42:41.301661 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: c4c850104e6d430397bb54d0e3730a73 Aug 27 02:42:41.301661 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1738708986-project Aug 27 02:42:41.301661 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 02:42:41.301661 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance 7c1f28aa-64fe-4517-88e2-b2e677baea24 could not be found. Aug 27 02:42:41.301661 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '7c1f28aa-64fe-4517-88e2-b2e677baea24'} Aug 27 02:42:41.302543 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:42:41.302543 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:42:41.302543 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:42:41.302543 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:42:41.302543 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:42:41.302543 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:42:41.302543 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:42:41.302543 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:42:41.302543 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:42:41.302543 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:42:41.302543 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c1f28aa-64fe-4517-88e2-b2e677baea24 could not be found. Aug 27 02:42:41.302543 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:42:41.302543 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:42:41.302543 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:42:41.302543 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:42:41.302543 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:42:41.302543 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:42:41.302543 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:42:41.302543 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:42:41.302543 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:42:41.303752 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:42:41.303752 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:42:41.303752 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:42:41.303752 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:42:41.303752 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:42:41.303752 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:42:41.303752 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:42:41.303752 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c1f28aa-64fe-4517-88e2-b2e677baea24 could not be found. Aug 27 02:42:41.303752 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:42:41.303752 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:42:41.303752 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:42:41.303752 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:42:41.303752 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:42:41.303752 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:42:41.303752 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:42:41.303752 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:42:41.303752 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c1f28aa-64fe-4517-88e2-b2e677baea24 could not be found. Aug 27 02:42:41.303752 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:42:41.305133 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-977de308-c5c6-4719-be83-a1c53b4ee4e5 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Returning 404 to user: Instance 7c1f28aa-64fe-4517-88e2-b2e677baea24 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:42:41.305133 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-977de308-c5c6-4719-be83-a1c53b4ee4e5 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] 10.222.0.70 "GET /compute/v2.1/servers/7c1f28aa-64fe-4517-88e2-b2e677baea24" status: 404 len: 111 microversion: 2.1 time: 0.147537 Aug 27 02:42:41.305133 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 410/800] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:41 2022] GET /compute/v2.1/servers/7c1f28aa-64fe-4517-88e2-b2e677baea24 => generated 111 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:42:41.310544 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-80c3057f-fd12-45a6-8a15-7136fc229188 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:41.311252 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-80c3057f-fd12-45a6-8a15-7136fc229188 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 3095a9f9-6769-4107-94a5-beac6415694c] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:41.319780 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-80c3057f-fd12-45a6-8a15-7136fc229188 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:41.320686 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-80c3057f-fd12-45a6-8a15-7136fc229188 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:41.321213 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-80c3057f-fd12-45a6-8a15-7136fc229188 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:41.321969 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-80c3057f-fd12-45a6-8a15-7136fc229188 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:41.322507 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-80c3057f-fd12-45a6-8a15-7136fc229188 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:41.323433 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-80c3057f-fd12-45a6-8a15-7136fc229188 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:41.689873 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-80c3057f-fd12-45a6-8a15-7136fc229188 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:41.708660 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-80c3057f-fd12-45a6-8a15-7136fc229188 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/3095a9f9-6769-4107-94a5-beac6415694c" status: 200 len: 1360 microversion: 2.1 time: 0.404621 Aug 27 02:42:41.710861 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 411/801] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:41 2022] GET /compute/v2.1/servers/3095a9f9-6769-4107-94a5-beac6415694c => generated 1360 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:41.721795 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5773a5e8-a425-419e-9eb6-48861e504b08 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:41.722462 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-5773a5e8-a425-419e-9eb6-48861e504b08 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] [instance: f5d6ba67-b815-4ec1-9d75-ee5436f5e3c7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:41.731328 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5773a5e8-a425-419e-9eb6-48861e504b08 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:41.732084 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5773a5e8-a425-419e-9eb6-48861e504b08 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:41.735571 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5773a5e8-a425-419e-9eb6-48861e504b08 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:41.736444 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5773a5e8-a425-419e-9eb6-48861e504b08 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:41.736912 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5773a5e8-a425-419e-9eb6-48861e504b08 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:41.737338 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5773a5e8-a425-419e-9eb6-48861e504b08 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:41.790173 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-5773a5e8-a425-419e-9eb6-48861e504b08 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] HTTP exception thrown: Instance f5d6ba67-b815-4ec1-9d75-ee5436f5e3c7 could not be found. Aug 27 02:42:41.796537 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5773a5e8-a425-419e-9eb6-48861e504b08 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Request method failure captured: Aug 27 02:42:41.796537 n-d-852278-4 devstack@n-api.service[134052]: request: DELETE /compute/v2.1/servers/f5d6ba67-b815-4ec1-9d75-ee5436f5e3c7 HTTP/1.1 Aug 27 02:42:41.796537 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:42:41.796537 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:42:41.796537 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:42:41.796537 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:42:41.796537 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:42:41.796537 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:42:41.796537 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:42:41.796537 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:42:41.796537 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYQOKECPKKpQ4qTsAxKF1HQoZNPstXz_5R0rIWnBk14HMZ8zIBdA-csxRoLUKyHdW16JJH6IEZArv_q5kgq9TL6XAA3YeA7hB8J7TT2eT8DjnxVwL0VmMhW1R7MT5lqqEYOA10hdDZWqUx36p1AFqg2E3wPw0b1v5eH2o1iNk3byZ9w Aug 27 02:42:41.796537 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:42:41.796537 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:42:41.796537 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:42:41.796537 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:42:41.796537 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:42:41.796537 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:42:41.796537 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 72992d9dba564526b223533398a94dea Aug 27 02:42:41.796537 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1738708986 Aug 27 02:42:41.796537 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:42:41.796537 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:42:41.798113 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/72992d9dba564526b223533398a94dea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_72992d9dba564526b223533398a94dea", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/72992d9dba564526b223533398a94dea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/72992d9dba564526b223533398a94dea"}]}] Aug 27 02:42:41.798113 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1738708986 Aug 27 02:42:41.798113 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 72992d9dba564526b223533398a94dea Aug 27 02:42:41.798113 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1738708986 Aug 27 02:42:41.798113 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1738708986-project Aug 27 02:42:41.798113 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:42:41.798113 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:42:41.798113 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: c4c850104e6d430397bb54d0e3730a73 Aug 27 02:42:41.798113 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1738708986-project Aug 27 02:42:41.798113 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 02:42:41.798113 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance f5d6ba67-b815-4ec1-9d75-ee5436f5e3c7 could not be found. Aug 27 02:42:41.798113 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': 'f5d6ba67-b815-4ec1-9d75-ee5436f5e3c7'} Aug 27 02:42:41.799020 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:42:41.799020 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:42:41.799020 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:42:41.799020 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:42:41.799020 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:42:41.799020 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:42:41.799020 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:42:41.799020 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:42:41.799020 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:42:41.799020 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:42:41.799020 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5d6ba67-b815-4ec1-9d75-ee5436f5e3c7 could not be found. Aug 27 02:42:41.799020 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:42:41.799020 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:42:41.799020 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:42:41.799020 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:42:41.799020 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:42:41.799020 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:42:41.799020 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:42:41.799020 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:42:41.799020 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:42:41.800431 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:42:41.800431 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 02:42:41.800431 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 02:42:41.800431 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 02:42:41.800431 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 02:42:41.800431 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:42:41.800431 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:42:41.800431 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:42:41.800431 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:42:41.800431 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5d6ba67-b815-4ec1-9d75-ee5436f5e3c7 could not be found. Aug 27 02:42:41.800431 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:42:41.800431 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:42:41.800431 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:42:41.800431 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:42:41.800431 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:42:41.800431 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:42:41.800431 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:42:41.800431 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:42:41.800431 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5d6ba67-b815-4ec1-9d75-ee5436f5e3c7 could not be found. Aug 27 02:42:41.800431 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:42:41.802761 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5773a5e8-a425-419e-9eb6-48861e504b08 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Returning 404 to user: Instance f5d6ba67-b815-4ec1-9d75-ee5436f5e3c7 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:42:41.808266 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-5773a5e8-a425-419e-9eb6-48861e504b08 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] 10.222.0.70 "DELETE /compute/v2.1/servers/f5d6ba67-b815-4ec1-9d75-ee5436f5e3c7" status: 404 len: 111 microversion: 2.1 time: 0.096163 Aug 27 02:42:41.809875 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 412/802] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:42:41 2022] DELETE /compute/v2.1/servers/f5d6ba67-b815-4ec1-9d75-ee5436f5e3c7 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:42:41.827159 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-66b824ba-1989-415d-a3d6-e56fa88b6981 req-9793fcf4-e342-44a1-8cc6-863d0c0c3944 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74d41279-27ab-492f-88ac-85f22b11b9ae", "tag": "2a55b3f5-8bd4-452d-8257-6bd29ed05f0e"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:42:41.858292 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-66b824ba-1989-415d-a3d6-e56fa88b6981 req-9793fcf4-e342-44a1-8cc6-863d0c0c3944 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:41.858832 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-66b824ba-1989-415d-a3d6-e56fa88b6981 req-9793fcf4-e342-44a1-8cc6-863d0c0c3944 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:41.859287 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-66b824ba-1989-415d-a3d6-e56fa88b6981 req-9793fcf4-e342-44a1-8cc6-863d0c0c3944 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:41.894639 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-66b824ba-1989-415d-a3d6-e56fa88b6981 req-9793fcf4-e342-44a1-8cc6-863d0c0c3944 service nova] Creating event network-changed:2a55b3f5-8bd4-452d-8257-6bd29ed05f0e for instance 74d41279-27ab-492f-88ac-85f22b11b9ae on n-h2-852278-4 Aug 27 02:42:41.903055 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-66b824ba-1989-415d-a3d6-e56fa88b6981 req-9793fcf4-e342-44a1-8cc6-863d0c0c3944 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087458 Aug 27 02:42:41.903727 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 413/803] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:42:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:42:41.922369 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d123e243-bda8-439a-91dd-b3ce60d1c366 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:41.922592 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d123e243-bda8-439a-91dd-b3ce60d1c366 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] [instance: f5d6ba67-b815-4ec1-9d75-ee5436f5e3c7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:41.936096 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d123e243-bda8-439a-91dd-b3ce60d1c366 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:41.938567 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d123e243-bda8-439a-91dd-b3ce60d1c366 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:41.940703 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d123e243-bda8-439a-91dd-b3ce60d1c366 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:41.945330 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d123e243-bda8-439a-91dd-b3ce60d1c366 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:41.946165 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d123e243-bda8-439a-91dd-b3ce60d1c366 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:41.946165 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d123e243-bda8-439a-91dd-b3ce60d1c366 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:41.963377 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-d123e243-bda8-439a-91dd-b3ce60d1c366 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] HTTP exception thrown: Instance f5d6ba67-b815-4ec1-9d75-ee5436f5e3c7 could not be found. Aug 27 02:42:41.965221 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d123e243-bda8-439a-91dd-b3ce60d1c366 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Request method failure captured: Aug 27 02:42:41.965221 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/servers/f5d6ba67-b815-4ec1-9d75-ee5436f5e3c7 HTTP/1.1 Aug 27 02:42:41.965221 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:42:41.965221 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:42:41.965221 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:42:41.965221 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:42:41.965221 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:42:41.965221 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:42:41.965221 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:42:41.965221 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:42:41.965221 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYQOKECPKKpQ4qTsAxKF1HQoZNPstXz_5R0rIWnBk14HMZ8zIBdA-csxRoLUKyHdW16JJH6IEZArv_q5kgq9TL6XAA3YeA7hB8J7TT2eT8DjnxVwL0VmMhW1R7MT5lqqEYOA10hdDZWqUx36p1AFqg2E3wPw0b1v5eH2o1iNk3byZ9w Aug 27 02:42:41.965221 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:42:41.965221 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:42:41.965221 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:42:41.965221 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:42:41.965221 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:42:41.965221 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:42:41.965221 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 72992d9dba564526b223533398a94dea Aug 27 02:42:41.965221 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1738708986 Aug 27 02:42:41.965221 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:42:41.965221 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:42:41.966799 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/72992d9dba564526b223533398a94dea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_72992d9dba564526b223533398a94dea", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/72992d9dba564526b223533398a94dea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/72992d9dba564526b223533398a94dea"}]}] Aug 27 02:42:41.966799 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1738708986 Aug 27 02:42:41.966799 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 72992d9dba564526b223533398a94dea Aug 27 02:42:41.966799 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1738708986 Aug 27 02:42:41.966799 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1738708986-project Aug 27 02:42:41.966799 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:42:41.966799 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:42:41.966799 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: c4c850104e6d430397bb54d0e3730a73 Aug 27 02:42:41.966799 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1738708986-project Aug 27 02:42:41.966799 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 02:42:41.966799 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance f5d6ba67-b815-4ec1-9d75-ee5436f5e3c7 could not be found. Aug 27 02:42:41.966799 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': 'f5d6ba67-b815-4ec1-9d75-ee5436f5e3c7'} Aug 27 02:42:41.967637 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:42:41.967637 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:42:41.967637 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:42:41.967637 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:42:41.967637 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:42:41.967637 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:42:41.967637 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:42:41.967637 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:42:41.967637 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:42:41.967637 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:42:41.967637 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5d6ba67-b815-4ec1-9d75-ee5436f5e3c7 could not be found. Aug 27 02:42:41.967637 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:42:41.967637 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:42:41.967637 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:42:41.967637 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:42:41.967637 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:42:41.967637 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:42:41.967637 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:42:41.967637 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:42:41.967637 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:42:41.969144 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:42:41.969144 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:42:41.969144 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:42:41.969144 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:42:41.969144 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:42:41.969144 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:42:41.969144 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:42:41.969144 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5d6ba67-b815-4ec1-9d75-ee5436f5e3c7 could not be found. Aug 27 02:42:41.969144 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:42:41.969144 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:42:41.969144 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:42:41.969144 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:42:41.969144 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:42:41.969144 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:42:41.969144 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:42:41.969144 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:42:41.969144 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5d6ba67-b815-4ec1-9d75-ee5436f5e3c7 could not be found. Aug 27 02:42:41.969144 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:42:41.971330 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d123e243-bda8-439a-91dd-b3ce60d1c366 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Returning 404 to user: Instance f5d6ba67-b815-4ec1-9d75-ee5436f5e3c7 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:42:41.972655 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d123e243-bda8-439a-91dd-b3ce60d1c366 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] 10.222.0.70 "GET /compute/v2.1/servers/f5d6ba67-b815-4ec1-9d75-ee5436f5e3c7" status: 404 len: 111 microversion: 2.1 time: 0.065225 Aug 27 02:42:41.973867 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 414/804] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:41 2022] GET /compute/v2.1/servers/f5d6ba67-b815-4ec1-9d75-ee5436f5e3c7 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:42:42.556669 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-366c7222-bd29-4ac5-957a-8b6fd8501a9b tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1959924703", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:42:42.675165 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.network.neutron [None req-366c7222-bd29-4ac5-957a-8b6fd8501a9b tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] validate_networks() for None {{(pid=134052) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:42:42.837285 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c7ab7f46-88ab-407a-9465-51f0d8d35768 tempest-FloatingIPDetailsTestJSON-1296090266 tempest-FloatingIPDetailsTestJSON-1296090266-project] 10.222.0.70 "DELETE /compute/v2.1/os-floating-ips/54786794-5979-478d-b705-7d47d6f98676" status: 202 len: 0 microversion: 2.1 time: 1.892505 Aug 27 02:42:42.837880 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 391/805] 10.222.0.70 () {58 vars in 1263 bytes} [Sat Aug 27 02:42:40 2022] DELETE /compute/v2.1/os-floating-ips/54786794-5979-478d-b705-7d47d6f98676 => generated 0 bytes in 1894 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:42:42.846002 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-6239198d-9016-4235-8793-aeaf82d87451 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:42.846637 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-6239198d-9016-4235-8793-aeaf82d87451 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] [instance: 74d41279-27ab-492f-88ac-85f22b11b9ae] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:42.860197 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6239198d-9016-4235-8793-aeaf82d87451 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:42.860979 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6239198d-9016-4235-8793-aeaf82d87451 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:42.861420 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6239198d-9016-4235-8793-aeaf82d87451 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:42.865029 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6239198d-9016-4235-8793-aeaf82d87451 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:42.865501 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6239198d-9016-4235-8793-aeaf82d87451 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:42.865935 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6239198d-9016-4235-8793-aeaf82d87451 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:43.053582 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-366c7222-bd29-4ac5-957a-8b6fd8501a9b tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Flavor limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:42:43.054059 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-366c7222-bd29-4ac5-957a-8b6fd8501a9b tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Image limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:42:43.054472 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-366c7222-bd29-4ac5-957a-8b6fd8501a9b tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Flavor pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:42:43.055354 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-366c7222-bd29-4ac5-957a-8b6fd8501a9b tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Image pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:42:43.055839 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-366c7222-bd29-4ac5-957a-8b6fd8501a9b tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:42:43.069644 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-366c7222-bd29-4ac5-957a-8b6fd8501a9b tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:43.070242 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-366c7222-bd29-4ac5-957a-8b6fd8501a9b tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:43.070858 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-366c7222-bd29-4ac5-957a-8b6fd8501a9b tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:43.071792 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-366c7222-bd29-4ac5-957a-8b6fd8501a9b tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:43.072494 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-366c7222-bd29-4ac5-957a-8b6fd8501a9b tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:43.073097 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-366c7222-bd29-4ac5-957a-8b6fd8501a9b tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:43.094957 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-6239198d-9016-4235-8793-aeaf82d87451 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9653dac89d2648b285fd71c1b349e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3ac0c66c5b4bc787d2d6e12a957099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:43.104471 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-6239198d-9016-4235-8793-aeaf82d87451 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] 10.222.0.70 "GET /compute/v2.1/servers/74d41279-27ab-492f-88ac-85f22b11b9ae" status: 200 len: 1355 microversion: 2.1 time: 0.262342 Aug 27 02:42:43.105145 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 392/806] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:42 2022] GET /compute/v2.1/servers/74d41279-27ab-492f-88ac-85f22b11b9ae => generated 1355 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:43.105691 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-366c7222-bd29-4ac5-957a-8b6fd8501a9b tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Getting quotas for project b105816fd4e54b9da4973ff721e1fb92. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:42:43.112539 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-366c7222-bd29-4ac5-957a-8b6fd8501a9b tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Getting quotas for user eb6d1646ec094e3297f6f3c51dd72e85 and project b105816fd4e54b9da4973ff721e1fb92. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:42:43.113313 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7edeb558-7542-4d9c-85dc-1ba006b8c109 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Calling method '.version_select at 0x7f5edf416f70>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:43.127288 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-366c7222-bd29-4ac5-957a-8b6fd8501a9b tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Going to run 1 instances... {{(pid=134052) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:42:43.130531 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-366c7222-bd29-4ac5-957a-8b6fd8501a9b tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: 2e16c5b3-ff3c-4afe-ae65-97b9be1b14b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134052) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:42:43.153318 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-7edeb558-7542-4d9c-85dc-1ba006b8c109 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1094053635" status: 202 len: 0 microversion: 2.1 time: 0.046269 Aug 27 02:42:43.154170 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 393/807] 10.222.0.70 () {58 vars in 1221 bytes} [Sat Aug 27 02:42:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1094053635 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:42:43.178247 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a41b11f4-5086-4429-9300-53debeb107c1 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:43.179470 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-a41b11f4-5086-4429-9300-53debeb107c1 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] [instance: 3ee4d4db-a1bb-4567-a20d-29003e67a295] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:43.198718 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a41b11f4-5086-4429-9300-53debeb107c1 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:43.200604 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-366c7222-bd29-4ac5-957a-8b6fd8501a9b tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.225074 Aug 27 02:42:43.201272 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a41b11f4-5086-4429-9300-53debeb107c1 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:43.201446 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 415/808] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 02:42:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1227 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:42:43.202023 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a41b11f4-5086-4429-9300-53debeb107c1 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:43.204706 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a41b11f4-5086-4429-9300-53debeb107c1 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:43.205359 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a41b11f4-5086-4429-9300-53debeb107c1 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:43.207038 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a41b11f4-5086-4429-9300-53debeb107c1 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:43.211851 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-71339d80-e6d5-4e36-a840-0111a3cfbdc0 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7020d9af-f24e-4ab9-86ef-07df5451039b", "device": "/dev/xvdb"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:42:43.220890 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-71339d80-e6d5-4e36-a840-0111a3cfbdc0 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: 7eded9ca-c7bc-499a-bb53-a28d2c332402] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:43.229493 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-71339d80-e6d5-4e36-a840-0111a3cfbdc0 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:43.230197 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-71339d80-e6d5-4e36-a840-0111a3cfbdc0 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:43.230942 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-71339d80-e6d5-4e36-a840-0111a3cfbdc0 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:43.231814 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-71339d80-e6d5-4e36-a840-0111a3cfbdc0 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:43.232475 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-71339d80-e6d5-4e36-a840-0111a3cfbdc0 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:43.233053 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-71339d80-e6d5-4e36-a840-0111a3cfbdc0 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:43.469063 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-a41b11f4-5086-4429-9300-53debeb107c1 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30abbf3afe304291981a6a9b85952aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c28ddbdb164f01bb82235c6d49717b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:43.479572 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a41b11f4-5086-4429-9300-53debeb107c1 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] 10.222.0.70 "GET /compute/v2.1/servers/3ee4d4db-a1bb-4567-a20d-29003e67a295" status: 200 len: 1472 microversion: 2.1 time: 0.323649 Aug 27 02:42:43.481113 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 394/809] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:43 2022] GET /compute/v2.1/servers/3ee4d4db-a1bb-4567-a20d-29003e67a295 => generated 1472 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:43.488886 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-aba3542c-fe76-4510-b073-6a4d70fe6892 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:43.489798 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-aba3542c-fe76-4510-b073-6a4d70fe6892 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 3095a9f9-6769-4107-94a5-beac6415694c] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:43.498168 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-aba3542c-fe76-4510-b073-6a4d70fe6892 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:43.499486 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-aba3542c-fe76-4510-b073-6a4d70fe6892 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:43.500301 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-aba3542c-fe76-4510-b073-6a4d70fe6892 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:43.501381 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-aba3542c-fe76-4510-b073-6a4d70fe6892 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:43.502144 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-aba3542c-fe76-4510-b073-6a4d70fe6892 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:43.502835 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-aba3542c-fe76-4510-b073-6a4d70fe6892 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:43.770677 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-71339d80-e6d5-4e36-a840-0111a3cfbdc0 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "POST /compute/v2.1/servers/7eded9ca-c7bc-499a-bb53-a28d2c332402/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.566777 Aug 27 02:42:43.778544 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 416/810] 10.222.0.70 () {62 vars in 1364 bytes} [Sat Aug 27 02:42:43 2022] POST /compute/v2.1/servers/7eded9ca-c7bc-499a-bb53-a28d2c332402/os-volume_attachments => generated 194 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:42:43.791915 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8dca6ca4-233e-400a-b307-4571c605c708 tempest-FloatingIPDetailsTestJSON-1296090266 tempest-FloatingIPDetailsTestJSON-1296090266-project] Calling method '.version_select at 0x7f5ee345f430>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:44.040594 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-aba3542c-fe76-4510-b073-6a4d70fe6892 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:44.052985 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-aba3542c-fe76-4510-b073-6a4d70fe6892 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/3095a9f9-6769-4107-94a5-beac6415694c" status: 200 len: 1360 microversion: 2.1 time: 0.570249 Aug 27 02:42:44.065069 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 395/811] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:43 2022] GET /compute/v2.1/servers/3095a9f9-6769-4107-94a5-beac6415694c => generated 1360 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:44.072138 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-01308deb-8e98-4c05-961f-0bfc4a8868b3 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:44.072965 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-01308deb-8e98-4c05-961f-0bfc4a8868b3 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: 2e16c5b3-ff3c-4afe-ae65-97b9be1b14b0] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:44.079608 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-01308deb-8e98-4c05-961f-0bfc4a8868b3 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:44.080357 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-01308deb-8e98-4c05-961f-0bfc4a8868b3 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:44.080934 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-01308deb-8e98-4c05-961f-0bfc4a8868b3 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:44.081779 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-01308deb-8e98-4c05-961f-0bfc4a8868b3 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:44.082360 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-01308deb-8e98-4c05-961f-0bfc4a8868b3 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:44.082922 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-01308deb-8e98-4c05-961f-0bfc4a8868b3 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:44.201805 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-01308deb-8e98-4c05-961f-0bfc4a8868b3 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6d1646ec094e3297f6f3c51dd72e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b105816fd4e54b9da4973ff721e1fb92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:44.211213 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-01308deb-8e98-4c05-961f-0bfc4a8868b3 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "GET /compute/v2.1/servers/2e16c5b3-ff3c-4afe-ae65-97b9be1b14b0" status: 200 len: 1213 microversion: 2.1 time: 0.144316 Aug 27 02:42:44.220439 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 396/812] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:44 2022] GET /compute/v2.1/servers/2e16c5b3-ff3c-4afe-ae65-97b9be1b14b0 => generated 1213 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:44.431082 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c33842c1-46e0-4cb4-9e15-aa78da600941 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-1906527562", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:42:44.484699 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.network.neutron [None req-c33842c1-46e0-4cb4-9e15-aa78da600941 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] validate_networks() for None {{(pid=134051) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:42:45.029218 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-c33842c1-46e0-4cb4-9e15-aa78da600941 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Flavor limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:42:45.029682 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-c33842c1-46e0-4cb4-9e15-aa78da600941 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Image limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:42:45.030246 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-c33842c1-46e0-4cb4-9e15-aa78da600941 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Flavor pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:42:45.030823 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-c33842c1-46e0-4cb4-9e15-aa78da600941 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Image pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:42:45.031240 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-c33842c1-46e0-4cb4-9e15-aa78da600941 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:42:45.044377 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c33842c1-46e0-4cb4-9e15-aa78da600941 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:45.045035 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c33842c1-46e0-4cb4-9e15-aa78da600941 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:45.045297 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c33842c1-46e0-4cb4-9e15-aa78da600941 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:45.046029 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c33842c1-46e0-4cb4-9e15-aa78da600941 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:45.046575 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c33842c1-46e0-4cb4-9e15-aa78da600941 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:45.047000 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c33842c1-46e0-4cb4-9e15-aa78da600941 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:45.066485 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-c33842c1-46e0-4cb4-9e15-aa78da600941 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Getting quotas for project 1ba4a21f99f04c75977496fd544c628c. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:42:45.071875 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-c33842c1-46e0-4cb4-9e15-aa78da600941 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Getting quotas for user 7ec609246fd74d08a04e693343e6a569 and project 1ba4a21f99f04c75977496fd544c628c. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:42:45.085525 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-c33842c1-46e0-4cb4-9e15-aa78da600941 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Going to run 1 instances... {{(pid=134051) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:42:45.087785 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-c33842c1-46e0-4cb4-9e15-aa78da600941 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] [instance: 1aa76851-fc87-44aa-97a1-5c01cc76e758] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134051) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:42:45.131154 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c33842c1-46e0-4cb4-9e15-aa78da600941 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.917763 Aug 27 02:42:45.137728 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 397/813] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 02:42:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 919 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:42:45.141370 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-7bb38ce8-2058-409a-bbfc-6b0c161ed324 req-ea07a043-08b1-469c-8b8f-20fe125b5a4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3095a9f9-6769-4107-94a5-beac6415694c", "tag": "ccabb4f8-adfb-4fa5-a578-1d53c8d1dc89"}, {"name": "network-changed", "server_uuid": "74d41279-27ab-492f-88ac-85f22b11b9ae", "tag": "9bdbf58b-76f2-4a6d-85cc-3cc9d7478aa1"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:42:45.152657 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-7bb38ce8-2058-409a-bbfc-6b0c161ed324 req-ea07a043-08b1-469c-8b8f-20fe125b5a4b service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:45.153138 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-7bb38ce8-2058-409a-bbfc-6b0c161ed324 req-ea07a043-08b1-469c-8b8f-20fe125b5a4b service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:45.153902 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-7bb38ce8-2058-409a-bbfc-6b0c161ed324 req-ea07a043-08b1-469c-8b8f-20fe125b5a4b service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:45.168970 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-7bb38ce8-2058-409a-bbfc-6b0c161ed324 req-ea07a043-08b1-469c-8b8f-20fe125b5a4b service nova] Creating event network-changed:ccabb4f8-adfb-4fa5-a578-1d53c8d1dc89 for instance 3095a9f9-6769-4107-94a5-beac6415694c on n-h1-852278-4 Aug 27 02:42:45.169446 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-7bb38ce8-2058-409a-bbfc-6b0c161ed324 req-ea07a043-08b1-469c-8b8f-20fe125b5a4b service nova] Creating event network-changed:9bdbf58b-76f2-4a6d-85cc-3cc9d7478aa1 for instance 74d41279-27ab-492f-88ac-85f22b11b9ae on n-h2-852278-4 Aug 27 02:42:45.180054 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-7bb38ce8-2058-409a-bbfc-6b0c161ed324 req-ea07a043-08b1-469c-8b8f-20fe125b5a4b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.046303 Aug 27 02:42:45.180431 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 398/814] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:42:45 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:42:45.191723 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-698204a2-37d1-4bb1-951a-867a1095a44f tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:45.192392 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-698204a2-37d1-4bb1-951a-867a1095a44f tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] [instance: 74d41279-27ab-492f-88ac-85f22b11b9ae] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:45.199852 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-698204a2-37d1-4bb1-951a-867a1095a44f tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:45.200368 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-698204a2-37d1-4bb1-951a-867a1095a44f tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:45.200813 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-698204a2-37d1-4bb1-951a-867a1095a44f tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:45.201577 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-698204a2-37d1-4bb1-951a-867a1095a44f tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:45.202037 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-698204a2-37d1-4bb1-951a-867a1095a44f tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:45.202581 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-698204a2-37d1-4bb1-951a-867a1095a44f tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:45.328963 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-8dca6ca4-233e-400a-b307-4571c605c708 tempest-FloatingIPDetailsTestJSON-1296090266 tempest-FloatingIPDetailsTestJSON-1296090266-project] 10.222.0.70 "DELETE /compute/v2.1/os-floating-ips/dd43d822-41ce-49be-a160-e986649e639d" status: 202 len: 0 microversion: 2.1 time: 1.547824 Aug 27 02:42:45.330056 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 417/815] 10.222.0.70 () {58 vars in 1263 bytes} [Sat Aug 27 02:42:43 2022] DELETE /compute/v2.1/os-floating-ips/dd43d822-41ce-49be-a160-e986649e639d => generated 0 bytes in 1551 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:42:45.336174 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-72a8f728-79c5-4744-9dff-00c889301442 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:45.337686 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-72a8f728-79c5-4744-9dff-00c889301442 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] [instance: 3ee4d4db-a1bb-4567-a20d-29003e67a295] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:45.346296 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-72a8f728-79c5-4744-9dff-00c889301442 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:45.346801 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-72a8f728-79c5-4744-9dff-00c889301442 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:45.347241 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-72a8f728-79c5-4744-9dff-00c889301442 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:45.347956 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-72a8f728-79c5-4744-9dff-00c889301442 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:45.348460 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-72a8f728-79c5-4744-9dff-00c889301442 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:45.348870 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-72a8f728-79c5-4744-9dff-00c889301442 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:45.392265 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-698204a2-37d1-4bb1-951a-867a1095a44f tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9653dac89d2648b285fd71c1b349e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3ac0c66c5b4bc787d2d6e12a957099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:45.401300 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-698204a2-37d1-4bb1-951a-867a1095a44f tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] 10.222.0.70 "GET /compute/v2.1/servers/74d41279-27ab-492f-88ac-85f22b11b9ae" status: 200 len: 1355 microversion: 2.1 time: 0.219669 Aug 27 02:42:45.402161 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 399/816] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:45 2022] GET /compute/v2.1/servers/74d41279-27ab-492f-88ac-85f22b11b9ae => generated 1355 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:45.410624 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b0d6c73b-d3ba-4670-9106-2bff6edfc6c4 tempest-ServersWithSpecificFlavorTestJSON-168055090 tempest-ServersWithSpecificFlavorTestJSON-168055090-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:45.423227 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1,nova_api:INSERT=6,nova_api:DELETE=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:42:45.448257 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b0d6c73b-d3ba-4670-9106-2bff6edfc6c4 tempest-ServersWithSpecificFlavorTestJSON-168055090 tempest-ServersWithSpecificFlavorTestJSON-168055090-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/131754674" status: 202 len: 0 microversion: 2.1 time: 0.044539 Aug 27 02:42:45.449990 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 400/817] 10.222.0.70 () {58 vars in 1158 bytes} [Sat Aug 27 02:42:45 2022] DELETE /compute/v2.1/flavors/131754674 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:42:45.460895 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-6ba61560-b6e9-47f6-8706-630a8ab4d9fd tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:45.463752 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-6ba61560-b6e9-47f6-8706-630a8ab4d9fd tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 3095a9f9-6769-4107-94a5-beac6415694c] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:45.479038 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6ba61560-b6e9-47f6-8706-630a8ab4d9fd tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:45.485050 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6ba61560-b6e9-47f6-8706-630a8ab4d9fd tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:45.485623 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6ba61560-b6e9-47f6-8706-630a8ab4d9fd tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:45.486562 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6ba61560-b6e9-47f6-8706-630a8ab4d9fd tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:45.487023 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6ba61560-b6e9-47f6-8706-630a8ab4d9fd tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:45.487705 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6ba61560-b6e9-47f6-8706-630a8ab4d9fd tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:46.019505 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-72a8f728-79c5-4744-9dff-00c889301442 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30abbf3afe304291981a6a9b85952aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c28ddbdb164f01bb82235c6d49717b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:46.028651 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-72a8f728-79c5-4744-9dff-00c889301442 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] 10.222.0.70 "GET /compute/v2.1/servers/3ee4d4db-a1bb-4567-a20d-29003e67a295" status: 200 len: 1472 microversion: 2.1 time: 0.697315 Aug 27 02:42:46.042617 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 418/818] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:45 2022] GET /compute/v2.1/servers/3ee4d4db-a1bb-4567-a20d-29003e67a295 => generated 1472 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:46.048598 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ea410268-d6be-4143-bdc2-c83b74954e40 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:46.049507 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-ea410268-d6be-4143-bdc2-c83b74954e40 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] [instance: 1aa76851-fc87-44aa-97a1-5c01cc76e758] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:46.057033 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ea410268-d6be-4143-bdc2-c83b74954e40 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:46.057787 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ea410268-d6be-4143-bdc2-c83b74954e40 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:46.058466 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ea410268-d6be-4143-bdc2-c83b74954e40 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:46.059505 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ea410268-d6be-4143-bdc2-c83b74954e40 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:46.060123 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ea410268-d6be-4143-bdc2-c83b74954e40 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:46.060737 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ea410268-d6be-4143-bdc2-c83b74954e40 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:46.159533 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-ea410268-d6be-4143-bdc2-c83b74954e40 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec609246fd74d08a04e693343e6a569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba4a21f99f04c75977496fd544c628c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:46.166613 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-6ba61560-b6e9-47f6-8706-630a8ab4d9fd tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:46.168475 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ea410268-d6be-4143-bdc2-c83b74954e40 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] 10.222.0.70 "GET /compute/v2.1/servers/1aa76851-fc87-44aa-97a1-5c01cc76e758" status: 200 len: 1219 microversion: 2.1 time: 0.124306 Aug 27 02:42:46.182027 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 419/819] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:46 2022] GET /compute/v2.1/servers/1aa76851-fc87-44aa-97a1-5c01cc76e758 => generated 1219 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:46.182140 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-6ba61560-b6e9-47f6-8706-630a8ab4d9fd tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/3095a9f9-6769-4107-94a5-beac6415694c" status: 200 len: 1360 microversion: 2.1 time: 0.728279 Aug 27 02:42:46.182140 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 401/820] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:45 2022] GET /compute/v2.1/servers/3095a9f9-6769-4107-94a5-beac6415694c => generated 1360 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:46.188820 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c42082d8-faf0-488a-bb30-8420b35488ad tempest-ServersWithSpecificFlavorTestJSON-168055090 tempest-ServersWithSpecificFlavorTestJSON-168055090-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:46.205525 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ef2f8deb-e7a1-4cdb-a59f-fe2ce595b5aa tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:46.206132 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-ef2f8deb-e7a1-4cdb-a59f-fe2ce595b5aa tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: 2e16c5b3-ff3c-4afe-ae65-97b9be1b14b0] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:46.216676 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ef2f8deb-e7a1-4cdb-a59f-fe2ce595b5aa tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:46.217160 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ef2f8deb-e7a1-4cdb-a59f-fe2ce595b5aa tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:46.217514 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c42082d8-faf0-488a-bb30-8420b35488ad tempest-ServersWithSpecificFlavorTestJSON-168055090 tempest-ServersWithSpecificFlavorTestJSON-168055090-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 5402 microversion: 2.1 time: 0.034222 Aug 27 02:42:46.217662 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ef2f8deb-e7a1-4cdb-a59f-fe2ce595b5aa tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:46.218334 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ef2f8deb-e7a1-4cdb-a59f-fe2ce595b5aa tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:46.218772 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ef2f8deb-e7a1-4cdb-a59f-fe2ce595b5aa tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:46.219142 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 402/821] 10.222.0.70 () {58 vars in 1146 bytes} [Sat Aug 27 02:42:46 2022] GET /compute/v2.1/flavors/detail => generated 5402 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:46.221946 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ef2f8deb-e7a1-4cdb-a59f-fe2ce595b5aa tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:46.272618 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-944b8beb-bf26-40c6-becd-3319b3b09d7a tempest-ServersWithSpecificFlavorTestJSON-168055090 tempest-ServersWithSpecificFlavorTestJSON-168055090-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:46.294495 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-944b8beb-bf26-40c6-becd-3319b3b09d7a tempest-ServersWithSpecificFlavorTestJSON-168055090 tempest-ServersWithSpecificFlavorTestJSON-168055090-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/185355050" status: 202 len: 0 microversion: 2.1 time: 0.025421 Aug 27 02:42:46.295326 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 403/822] 10.222.0.70 () {58 vars in 1158 bytes} [Sat Aug 27 02:42:46 2022] DELETE /compute/v2.1/flavors/185355050 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:42:46.303367 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c2680341-d09a-470e-8677-471fac0d2007 tempest-ServersWithSpecificFlavorTestJSON-168055090 tempest-ServersWithSpecificFlavorTestJSON-168055090-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:46.328113 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c2680341-d09a-470e-8677-471fac0d2007 tempest-ServersWithSpecificFlavorTestJSON-168055090 tempest-ServersWithSpecificFlavorTestJSON-168055090-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.028097 Aug 27 02:42:46.329035 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 404/823] 10.222.0.70 () {58 vars in 1146 bytes} [Sat Aug 27 02:42:46 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:46.350822 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-594367de-8748-49e9-b861-faad9ce1131e tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:46.351315 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-594367de-8748-49e9-b861-faad9ce1131e tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] [instance: 7c1f28aa-64fe-4517-88e2-b2e677baea24] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:46.359471 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-594367de-8748-49e9-b861-faad9ce1131e tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:46.359952 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-594367de-8748-49e9-b861-faad9ce1131e tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:46.360403 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-594367de-8748-49e9-b861-faad9ce1131e tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:46.361143 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-594367de-8748-49e9-b861-faad9ce1131e tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:46.361583 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-594367de-8748-49e9-b861-faad9ce1131e tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:46.361996 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-594367de-8748-49e9-b861-faad9ce1131e tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:46.373055 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-ef2f8deb-e7a1-4cdb-a59f-fe2ce595b5aa tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6d1646ec094e3297f6f3c51dd72e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b105816fd4e54b9da4973ff721e1fb92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:46.386915 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ef2f8deb-e7a1-4cdb-a59f-fe2ce595b5aa tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "GET /compute/v2.1/servers/2e16c5b3-ff3c-4afe-ae65-97b9be1b14b0" status: 200 len: 1275 microversion: 2.1 time: 0.206195 Aug 27 02:42:46.389454 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 420/824] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:46 2022] GET /compute/v2.1/servers/2e16c5b3-ff3c-4afe-ae65-97b9be1b14b0 => generated 1275 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:46.404168 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:42:46.407379 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-594367de-8748-49e9-b861-faad9ce1131e tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] HTTP exception thrown: Instance 7c1f28aa-64fe-4517-88e2-b2e677baea24 could not be found. Aug 27 02:42:46.414541 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-594367de-8748-49e9-b861-faad9ce1131e tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Request method failure captured: Aug 27 02:42:46.414541 n-d-852278-4 devstack@n-api.service[134051]: request: DELETE /compute/v2.1/servers/7c1f28aa-64fe-4517-88e2-b2e677baea24 HTTP/1.1 Aug 27 02:42:46.414541 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:42:46.414541 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:42:46.414541 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:42:46.414541 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:42:46.414541 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:42:46.414541 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:42:46.414541 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:42:46.414541 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:42:46.414541 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYQOKECPKKpQ4qTsAxKF1HQoZNPstXz_5R0rIWnBk14HMZ8zIBdA-csxRoLUKyHdW16JJH6IEZArv_q5kgq9TL6XAA3YeA7hB8J7TT2eT8DjnxVwL0VmMhW1R7MT5lqqEYOA10hdDZWqUx36p1AFqg2E3wPw0b1v5eH2o1iNk3byZ9w Aug 27 02:42:46.414541 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:42:46.414541 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:42:46.414541 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:42:46.414541 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:42:46.414541 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:42:46.414541 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:42:46.414541 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 72992d9dba564526b223533398a94dea Aug 27 02:42:46.414541 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1738708986 Aug 27 02:42:46.414541 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:42:46.414541 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:42:46.416133 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/72992d9dba564526b223533398a94dea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_72992d9dba564526b223533398a94dea", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/72992d9dba564526b223533398a94dea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/72992d9dba564526b223533398a94dea"}]}] Aug 27 02:42:46.416133 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1738708986 Aug 27 02:42:46.416133 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 72992d9dba564526b223533398a94dea Aug 27 02:42:46.416133 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1738708986 Aug 27 02:42:46.416133 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1738708986-project Aug 27 02:42:46.416133 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:42:46.416133 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:42:46.416133 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: c4c850104e6d430397bb54d0e3730a73 Aug 27 02:42:46.416133 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1738708986-project Aug 27 02:42:46.416133 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 02:42:46.416133 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance 7c1f28aa-64fe-4517-88e2-b2e677baea24 could not be found. Aug 27 02:42:46.416133 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '7c1f28aa-64fe-4517-88e2-b2e677baea24'} Aug 27 02:42:46.416965 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:42:46.416965 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:42:46.416965 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:42:46.416965 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:42:46.416965 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:42:46.416965 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:42:46.416965 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:42:46.416965 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:42:46.416965 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:42:46.416965 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:42:46.416965 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c1f28aa-64fe-4517-88e2-b2e677baea24 could not be found. Aug 27 02:42:46.416965 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:42:46.416965 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:42:46.416965 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:42:46.416965 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:42:46.416965 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:42:46.416965 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:42:46.416965 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:42:46.416965 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:42:46.416965 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:42:46.422311 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:42:46.422311 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 02:42:46.422311 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 02:42:46.422311 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 02:42:46.422311 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 02:42:46.422311 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:42:46.422311 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:42:46.422311 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:42:46.422311 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:42:46.422311 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c1f28aa-64fe-4517-88e2-b2e677baea24 could not be found. Aug 27 02:42:46.422311 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:42:46.422311 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:42:46.422311 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:42:46.422311 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:42:46.422311 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:42:46.422311 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:42:46.422311 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:42:46.422311 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:42:46.422311 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c1f28aa-64fe-4517-88e2-b2e677baea24 could not be found. Aug 27 02:42:46.422311 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:42:46.423653 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-594367de-8748-49e9-b861-faad9ce1131e tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Returning 404 to user: Instance 7c1f28aa-64fe-4517-88e2-b2e677baea24 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:42:46.423653 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-594367de-8748-49e9-b861-faad9ce1131e tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] 10.222.0.70 "DELETE /compute/v2.1/servers/7c1f28aa-64fe-4517-88e2-b2e677baea24" status: 404 len: 111 microversion: 2.1 time: 0.069160 Aug 27 02:42:46.423653 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 405/825] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:42:46 2022] DELETE /compute/v2.1/servers/7c1f28aa-64fe-4517-88e2-b2e677baea24 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:42:46.424409 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f75ea45f-e84a-4d30-92ec-568c7ee7f5f3 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:46.425208 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-f75ea45f-e84a-4d30-92ec-568c7ee7f5f3 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] [instance: 74d41279-27ab-492f-88ac-85f22b11b9ae] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:46.438367 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-547bb416-babb-4e51-9b3b-a17ed2c7a04f tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:46.440118 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-547bb416-babb-4e51-9b3b-a17ed2c7a04f tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] [instance: 7c1f28aa-64fe-4517-88e2-b2e677baea24] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:46.441560 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f75ea45f-e84a-4d30-92ec-568c7ee7f5f3 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:46.442052 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f75ea45f-e84a-4d30-92ec-568c7ee7f5f3 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:46.442484 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f75ea45f-e84a-4d30-92ec-568c7ee7f5f3 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:46.443174 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f75ea45f-e84a-4d30-92ec-568c7ee7f5f3 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:46.443796 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f75ea45f-e84a-4d30-92ec-568c7ee7f5f3 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:46.444384 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f75ea45f-e84a-4d30-92ec-568c7ee7f5f3 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:46.486243 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-547bb416-babb-4e51-9b3b-a17ed2c7a04f tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:46.487520 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-547bb416-babb-4e51-9b3b-a17ed2c7a04f tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:46.493316 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-547bb416-babb-4e51-9b3b-a17ed2c7a04f tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:46.496959 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-547bb416-babb-4e51-9b3b-a17ed2c7a04f tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:46.497928 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-547bb416-babb-4e51-9b3b-a17ed2c7a04f tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:46.498755 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-547bb416-babb-4e51-9b3b-a17ed2c7a04f tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:46.525232 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-547bb416-babb-4e51-9b3b-a17ed2c7a04f tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] HTTP exception thrown: Instance 7c1f28aa-64fe-4517-88e2-b2e677baea24 could not be found. Aug 27 02:42:46.527094 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-547bb416-babb-4e51-9b3b-a17ed2c7a04f tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Request method failure captured: Aug 27 02:42:46.527094 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/7c1f28aa-64fe-4517-88e2-b2e677baea24 HTTP/1.1 Aug 27 02:42:46.527094 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:42:46.527094 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:42:46.527094 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:42:46.527094 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:42:46.527094 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:42:46.527094 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:42:46.527094 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:42:46.527094 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:42:46.527094 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYQOKECPKKpQ4qTsAxKF1HQoZNPstXz_5R0rIWnBk14HMZ8zIBdA-csxRoLUKyHdW16JJH6IEZArv_q5kgq9TL6XAA3YeA7hB8J7TT2eT8DjnxVwL0VmMhW1R7MT5lqqEYOA10hdDZWqUx36p1AFqg2E3wPw0b1v5eH2o1iNk3byZ9w Aug 27 02:42:46.527094 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:42:46.527094 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:42:46.527094 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:42:46.527094 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:42:46.527094 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:42:46.527094 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:42:46.527094 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 72992d9dba564526b223533398a94dea Aug 27 02:42:46.527094 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1738708986 Aug 27 02:42:46.527094 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:42:46.527094 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:42:46.528424 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/72992d9dba564526b223533398a94dea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_72992d9dba564526b223533398a94dea", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/72992d9dba564526b223533398a94dea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/72992d9dba564526b223533398a94dea"}]}] Aug 27 02:42:46.528424 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1738708986 Aug 27 02:42:46.528424 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 72992d9dba564526b223533398a94dea Aug 27 02:42:46.528424 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1738708986 Aug 27 02:42:46.528424 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1738708986-project Aug 27 02:42:46.528424 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:42:46.528424 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:42:46.528424 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: c4c850104e6d430397bb54d0e3730a73 Aug 27 02:42:46.528424 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1738708986-project Aug 27 02:42:46.528424 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 02:42:46.528424 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance 7c1f28aa-64fe-4517-88e2-b2e677baea24 could not be found. Aug 27 02:42:46.528424 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '7c1f28aa-64fe-4517-88e2-b2e677baea24'} Aug 27 02:42:46.529240 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:42:46.529240 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:42:46.529240 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:42:46.529240 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:42:46.529240 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:42:46.529240 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:42:46.529240 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:42:46.529240 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:42:46.529240 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:42:46.529240 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:42:46.529240 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c1f28aa-64fe-4517-88e2-b2e677baea24 could not be found. Aug 27 02:42:46.529240 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:42:46.529240 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:42:46.529240 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:42:46.529240 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:42:46.529240 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:42:46.529240 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:42:46.529240 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:42:46.529240 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:42:46.529240 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:42:46.532005 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:42:46.532005 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:42:46.532005 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:42:46.532005 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:42:46.532005 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:42:46.532005 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:42:46.532005 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:42:46.532005 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c1f28aa-64fe-4517-88e2-b2e677baea24 could not be found. Aug 27 02:42:46.532005 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:42:46.532005 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:42:46.532005 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:42:46.532005 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:42:46.532005 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:42:46.532005 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:42:46.532005 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:42:46.532005 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:42:46.532005 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c1f28aa-64fe-4517-88e2-b2e677baea24 could not be found. Aug 27 02:42:46.532005 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:42:46.539203 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-547bb416-babb-4e51-9b3b-a17ed2c7a04f tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Returning 404 to user: Instance 7c1f28aa-64fe-4517-88e2-b2e677baea24 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:42:46.539543 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-547bb416-babb-4e51-9b3b-a17ed2c7a04f tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] 10.222.0.70 "GET /compute/v2.1/servers/7c1f28aa-64fe-4517-88e2-b2e677baea24" status: 404 len: 111 microversion: 2.1 time: 0.109580 Aug 27 02:42:46.541919 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 406/826] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:46 2022] GET /compute/v2.1/servers/7c1f28aa-64fe-4517-88e2-b2e677baea24 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:42:46.561203 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-08ba3a12-e45e-45d4-bcd9-570f20bef640 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:46.568066 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-08ba3a12-e45e-45d4-bcd9-570f20bef640 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] [instance: f5d6ba67-b815-4ec1-9d75-ee5436f5e3c7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:46.583239 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-08ba3a12-e45e-45d4-bcd9-570f20bef640 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:46.585730 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-08ba3a12-e45e-45d4-bcd9-570f20bef640 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:46.588088 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-08ba3a12-e45e-45d4-bcd9-570f20bef640 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:46.589583 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-08ba3a12-e45e-45d4-bcd9-570f20bef640 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:46.591415 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-08ba3a12-e45e-45d4-bcd9-570f20bef640 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:46.597336 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-08ba3a12-e45e-45d4-bcd9-570f20bef640 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:46.636461 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-08ba3a12-e45e-45d4-bcd9-570f20bef640 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] HTTP exception thrown: Instance f5d6ba67-b815-4ec1-9d75-ee5436f5e3c7 could not be found. Aug 27 02:42:46.642428 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-08ba3a12-e45e-45d4-bcd9-570f20bef640 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Request method failure captured: Aug 27 02:42:46.642428 n-d-852278-4 devstack@n-api.service[134051]: request: DELETE /compute/v2.1/servers/f5d6ba67-b815-4ec1-9d75-ee5436f5e3c7 HTTP/1.1 Aug 27 02:42:46.642428 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:42:46.642428 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:42:46.642428 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:42:46.642428 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:42:46.642428 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:42:46.642428 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:42:46.642428 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:42:46.642428 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:42:46.642428 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYQOKECPKKpQ4qTsAxKF1HQoZNPstXz_5R0rIWnBk14HMZ8zIBdA-csxRoLUKyHdW16JJH6IEZArv_q5kgq9TL6XAA3YeA7hB8J7TT2eT8DjnxVwL0VmMhW1R7MT5lqqEYOA10hdDZWqUx36p1AFqg2E3wPw0b1v5eH2o1iNk3byZ9w Aug 27 02:42:46.642428 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:42:46.642428 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:42:46.642428 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:42:46.642428 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:42:46.642428 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:42:46.642428 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:42:46.642428 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 72992d9dba564526b223533398a94dea Aug 27 02:42:46.642428 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1738708986 Aug 27 02:42:46.642428 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:42:46.642428 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:42:46.644092 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/72992d9dba564526b223533398a94dea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_72992d9dba564526b223533398a94dea", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/72992d9dba564526b223533398a94dea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/72992d9dba564526b223533398a94dea"}]}] Aug 27 02:42:46.644092 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1738708986 Aug 27 02:42:46.644092 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 72992d9dba564526b223533398a94dea Aug 27 02:42:46.644092 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1738708986 Aug 27 02:42:46.644092 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1738708986-project Aug 27 02:42:46.644092 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:42:46.644092 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:42:46.644092 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: c4c850104e6d430397bb54d0e3730a73 Aug 27 02:42:46.644092 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1738708986-project Aug 27 02:42:46.644092 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 02:42:46.644092 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance f5d6ba67-b815-4ec1-9d75-ee5436f5e3c7 could not be found. Aug 27 02:42:46.644092 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': 'f5d6ba67-b815-4ec1-9d75-ee5436f5e3c7'} Aug 27 02:42:46.644945 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:42:46.644945 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:42:46.644945 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:42:46.644945 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:42:46.644945 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:42:46.644945 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:42:46.644945 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:42:46.644945 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:42:46.644945 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:42:46.644945 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:42:46.644945 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5d6ba67-b815-4ec1-9d75-ee5436f5e3c7 could not be found. Aug 27 02:42:46.644945 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:42:46.644945 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:42:46.644945 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:42:46.644945 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:42:46.644945 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:42:46.644945 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:42:46.644945 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:42:46.644945 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:42:46.644945 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:42:46.646855 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:42:46.646855 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 02:42:46.646855 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 02:42:46.646855 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 02:42:46.646855 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 02:42:46.646855 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:42:46.646855 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:42:46.646855 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:42:46.646855 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:42:46.646855 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5d6ba67-b815-4ec1-9d75-ee5436f5e3c7 could not be found. Aug 27 02:42:46.646855 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:42:46.646855 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:42:46.646855 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:42:46.646855 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:42:46.646855 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:42:46.646855 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:42:46.646855 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:42:46.646855 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:42:46.646855 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5d6ba67-b815-4ec1-9d75-ee5436f5e3c7 could not be found. Aug 27 02:42:46.646855 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:42:46.648234 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-08ba3a12-e45e-45d4-bcd9-570f20bef640 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Returning 404 to user: Instance f5d6ba67-b815-4ec1-9d75-ee5436f5e3c7 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:42:46.649144 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-08ba3a12-e45e-45d4-bcd9-570f20bef640 tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] 10.222.0.70 "DELETE /compute/v2.1/servers/f5d6ba67-b815-4ec1-9d75-ee5436f5e3c7" status: 404 len: 111 microversion: 2.1 time: 0.098944 Aug 27 02:42:46.650823 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 407/827] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:42:46 2022] DELETE /compute/v2.1/servers/f5d6ba67-b815-4ec1-9d75-ee5436f5e3c7 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:42:46.669238 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-36b8e2c8-f759-4a06-b5e8-da575550d77c tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:46.670060 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-36b8e2c8-f759-4a06-b5e8-da575550d77c tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] [instance: f5d6ba67-b815-4ec1-9d75-ee5436f5e3c7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:46.689707 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-36b8e2c8-f759-4a06-b5e8-da575550d77c tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:46.690199 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-36b8e2c8-f759-4a06-b5e8-da575550d77c tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:46.690625 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-36b8e2c8-f759-4a06-b5e8-da575550d77c tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:46.691346 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-36b8e2c8-f759-4a06-b5e8-da575550d77c tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:46.691775 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-36b8e2c8-f759-4a06-b5e8-da575550d77c tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:46.692190 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-36b8e2c8-f759-4a06-b5e8-da575550d77c tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:46.718986 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-36b8e2c8-f759-4a06-b5e8-da575550d77c tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] HTTP exception thrown: Instance f5d6ba67-b815-4ec1-9d75-ee5436f5e3c7 could not be found. Aug 27 02:42:46.724718 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-36b8e2c8-f759-4a06-b5e8-da575550d77c tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Request method failure captured: Aug 27 02:42:46.724718 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/f5d6ba67-b815-4ec1-9d75-ee5436f5e3c7 HTTP/1.1 Aug 27 02:42:46.724718 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:42:46.724718 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:42:46.724718 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:42:46.724718 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:42:46.724718 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:42:46.724718 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:42:46.724718 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:42:46.724718 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:42:46.724718 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYQOKECPKKpQ4qTsAxKF1HQoZNPstXz_5R0rIWnBk14HMZ8zIBdA-csxRoLUKyHdW16JJH6IEZArv_q5kgq9TL6XAA3YeA7hB8J7TT2eT8DjnxVwL0VmMhW1R7MT5lqqEYOA10hdDZWqUx36p1AFqg2E3wPw0b1v5eH2o1iNk3byZ9w Aug 27 02:42:46.724718 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:42:46.724718 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:42:46.724718 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:42:46.724718 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:42:46.724718 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:42:46.724718 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:42:46.724718 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 72992d9dba564526b223533398a94dea Aug 27 02:42:46.724718 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1738708986 Aug 27 02:42:46.724718 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:42:46.724718 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:42:46.726415 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/72992d9dba564526b223533398a94dea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_72992d9dba564526b223533398a94dea", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/72992d9dba564526b223533398a94dea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/72992d9dba564526b223533398a94dea"}]}] Aug 27 02:42:46.726415 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1738708986 Aug 27 02:42:46.726415 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 72992d9dba564526b223533398a94dea Aug 27 02:42:46.726415 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1738708986 Aug 27 02:42:46.726415 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1738708986-project Aug 27 02:42:46.726415 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:42:46.726415 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:42:46.726415 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: c4c850104e6d430397bb54d0e3730a73 Aug 27 02:42:46.726415 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1738708986-project Aug 27 02:42:46.726415 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 02:42:46.726415 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance f5d6ba67-b815-4ec1-9d75-ee5436f5e3c7 could not be found. Aug 27 02:42:46.726415 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': 'f5d6ba67-b815-4ec1-9d75-ee5436f5e3c7'} Aug 27 02:42:46.727485 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:42:46.727485 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:42:46.727485 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:42:46.727485 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:42:46.727485 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:42:46.727485 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:42:46.727485 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:42:46.727485 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:42:46.727485 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:42:46.727485 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:42:46.727485 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5d6ba67-b815-4ec1-9d75-ee5436f5e3c7 could not be found. Aug 27 02:42:46.727485 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:42:46.727485 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:42:46.727485 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:42:46.727485 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:42:46.727485 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:42:46.727485 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:42:46.727485 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:42:46.727485 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:42:46.727485 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:42:46.729798 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:42:46.729798 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:42:46.729798 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:42:46.729798 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:42:46.729798 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:42:46.729798 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:42:46.729798 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:42:46.729798 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5d6ba67-b815-4ec1-9d75-ee5436f5e3c7 could not be found. Aug 27 02:42:46.729798 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:42:46.729798 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:42:46.729798 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:42:46.729798 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:42:46.729798 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:42:46.729798 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:42:46.729798 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:42:46.729798 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:42:46.729798 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5d6ba67-b815-4ec1-9d75-ee5436f5e3c7 could not be found. Aug 27 02:42:46.729798 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:42:46.731375 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-36b8e2c8-f759-4a06-b5e8-da575550d77c tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] Returning 404 to user: Instance f5d6ba67-b815-4ec1-9d75-ee5436f5e3c7 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:42:46.733401 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-36b8e2c8-f759-4a06-b5e8-da575550d77c tempest-ServersWithSpecificFlavorTestJSON-1738708986 tempest-ServersWithSpecificFlavorTestJSON-1738708986-project] 10.222.0.70 "GET /compute/v2.1/servers/f5d6ba67-b815-4ec1-9d75-ee5436f5e3c7" status: 404 len: 111 microversion: 2.1 time: 0.077292 Aug 27 02:42:46.734908 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 408/828] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:46 2022] GET /compute/v2.1/servers/f5d6ba67-b815-4ec1-9d75-ee5436f5e3c7 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:42:46.916454 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-f75ea45f-e84a-4d30-92ec-568c7ee7f5f3 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9653dac89d2648b285fd71c1b349e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3ac0c66c5b4bc787d2d6e12a957099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:46.932461 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f75ea45f-e84a-4d30-92ec-568c7ee7f5f3 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] 10.222.0.70 "GET /compute/v2.1/servers/74d41279-27ab-492f-88ac-85f22b11b9ae" status: 200 len: 1355 microversion: 2.1 time: 0.511816 Aug 27 02:42:46.945845 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 421/829] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:46 2022] GET /compute/v2.1/servers/74d41279-27ab-492f-88ac-85f22b11b9ae => generated 1355 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:47.052440 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-6f7d8c09-abd0-4758-815a-34edd0b7d012 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:47.053249 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-6f7d8c09-abd0-4758-815a-34edd0b7d012 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] [instance: 3ee4d4db-a1bb-4567-a20d-29003e67a295] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:47.061373 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6f7d8c09-abd0-4758-815a-34edd0b7d012 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:47.062416 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6f7d8c09-abd0-4758-815a-34edd0b7d012 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:47.063083 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6f7d8c09-abd0-4758-815a-34edd0b7d012 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:47.075097 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6f7d8c09-abd0-4758-815a-34edd0b7d012 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:47.076960 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6f7d8c09-abd0-4758-815a-34edd0b7d012 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:47.079162 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6f7d8c09-abd0-4758-815a-34edd0b7d012 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:47.193761 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-99f1b5ec-24c9-447e-b24d-ae19fc2deb0c tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:47.195291 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-99f1b5ec-24c9-447e-b24d-ae19fc2deb0c tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] [instance: 1aa76851-fc87-44aa-97a1-5c01cc76e758] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:47.211142 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-99f1b5ec-24c9-447e-b24d-ae19fc2deb0c tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:47.211913 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-99f1b5ec-24c9-447e-b24d-ae19fc2deb0c tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:47.212679 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-99f1b5ec-24c9-447e-b24d-ae19fc2deb0c tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:47.214123 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-99f1b5ec-24c9-447e-b24d-ae19fc2deb0c tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:47.217285 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-99f1b5ec-24c9-447e-b24d-ae19fc2deb0c tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:47.218203 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-99f1b5ec-24c9-447e-b24d-ae19fc2deb0c tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:47.424716 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-99f1b5ec-24c9-447e-b24d-ae19fc2deb0c tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec609246fd74d08a04e693343e6a569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba4a21f99f04c75977496fd544c628c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:47.433841 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-99f1b5ec-24c9-447e-b24d-ae19fc2deb0c tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] 10.222.0.70 "GET /compute/v2.1/servers/1aa76851-fc87-44aa-97a1-5c01cc76e758" status: 200 len: 1293 microversion: 2.1 time: 0.245042 Aug 27 02:42:47.434441 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 422/830] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:47 2022] GET /compute/v2.1/servers/1aa76851-fc87-44aa-97a1-5c01cc76e758 => generated 1293 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:47.452836 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-bee31c33-a5ec-4411-bb15-e377026aaa73 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:47.453456 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-bee31c33-a5ec-4411-bb15-e377026aaa73 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 3095a9f9-6769-4107-94a5-beac6415694c] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:47.468506 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bee31c33-a5ec-4411-bb15-e377026aaa73 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:47.469015 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bee31c33-a5ec-4411-bb15-e377026aaa73 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:47.469452 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bee31c33-a5ec-4411-bb15-e377026aaa73 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:47.470184 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bee31c33-a5ec-4411-bb15-e377026aaa73 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:47.470638 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bee31c33-a5ec-4411-bb15-e377026aaa73 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:47.471056 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bee31c33-a5ec-4411-bb15-e377026aaa73 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:47.625124 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-6f7d8c09-abd0-4758-815a-34edd0b7d012 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30abbf3afe304291981a6a9b85952aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c28ddbdb164f01bb82235c6d49717b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:47.646485 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-6f7d8c09-abd0-4758-815a-34edd0b7d012 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] 10.222.0.70 "GET /compute/v2.1/servers/3ee4d4db-a1bb-4567-a20d-29003e67a295" status: 200 len: 1472 microversion: 2.1 time: 0.600901 Aug 27 02:42:47.647871 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 409/831] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:47 2022] GET /compute/v2.1/servers/3ee4d4db-a1bb-4567-a20d-29003e67a295 => generated 1472 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:42:47.654803 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0b2c0cc8-7e9d-4cb0-b9f1-b2c97420534a tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:47.655897 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-0b2c0cc8-7e9d-4cb0-b9f1-b2c97420534a tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: 2e16c5b3-ff3c-4afe-ae65-97b9be1b14b0] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:47.667408 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0b2c0cc8-7e9d-4cb0-b9f1-b2c97420534a tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:47.668297 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0b2c0cc8-7e9d-4cb0-b9f1-b2c97420534a tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:47.669018 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0b2c0cc8-7e9d-4cb0-b9f1-b2c97420534a tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:47.671177 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0b2c0cc8-7e9d-4cb0-b9f1-b2c97420534a tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:47.671829 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0b2c0cc8-7e9d-4cb0-b9f1-b2c97420534a tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:47.672528 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0b2c0cc8-7e9d-4cb0-b9f1-b2c97420534a tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:47.798644 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-bee31c33-a5ec-4411-bb15-e377026aaa73 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:47.812500 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-bee31c33-a5ec-4411-bb15-e377026aaa73 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/3095a9f9-6769-4107-94a5-beac6415694c" status: 200 len: 1360 microversion: 2.1 time: 0.363338 Aug 27 02:42:47.813930 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 423/832] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:47 2022] GET /compute/v2.1/servers/3095a9f9-6769-4107-94a5-beac6415694c => generated 1360 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:47.955980 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-1e73f275-3b9a-428d-9118-a9506ee1e904 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:47.957419 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-1e73f275-3b9a-428d-9118-a9506ee1e904 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] [instance: 74d41279-27ab-492f-88ac-85f22b11b9ae] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:47.965243 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1e73f275-3b9a-428d-9118-a9506ee1e904 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:47.966127 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1e73f275-3b9a-428d-9118-a9506ee1e904 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:47.966799 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1e73f275-3b9a-428d-9118-a9506ee1e904 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:47.969071 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1e73f275-3b9a-428d-9118-a9506ee1e904 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:47.969781 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1e73f275-3b9a-428d-9118-a9506ee1e904 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:47.970741 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1e73f275-3b9a-428d-9118-a9506ee1e904 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:48.026022 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-0b2c0cc8-7e9d-4cb0-b9f1-b2c97420534a tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6d1646ec094e3297f6f3c51dd72e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b105816fd4e54b9da4973ff721e1fb92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:48.034721 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-0b2c0cc8-7e9d-4cb0-b9f1-b2c97420534a tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "GET /compute/v2.1/servers/2e16c5b3-ff3c-4afe-ae65-97b9be1b14b0" status: 200 len: 1317 microversion: 2.1 time: 0.385336 Aug 27 02:42:48.038595 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 410/833] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:47 2022] GET /compute/v2.1/servers/2e16c5b3-ff3c-4afe-ae65-97b9be1b14b0 => generated 1317 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:48.459603 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-9e8ab59e-95c8-49e4-8a3d-35b6cdae31a9 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:48.470156 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-9e8ab59e-95c8-49e4-8a3d-35b6cdae31a9 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] [instance: 1aa76851-fc87-44aa-97a1-5c01cc76e758] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:48.483352 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9e8ab59e-95c8-49e4-8a3d-35b6cdae31a9 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:48.490784 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9e8ab59e-95c8-49e4-8a3d-35b6cdae31a9 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:48.491917 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9e8ab59e-95c8-49e4-8a3d-35b6cdae31a9 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:48.493250 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9e8ab59e-95c8-49e4-8a3d-35b6cdae31a9 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:48.494222 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9e8ab59e-95c8-49e4-8a3d-35b6cdae31a9 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:48.500814 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9e8ab59e-95c8-49e4-8a3d-35b6cdae31a9 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:48.674919 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-1e73f275-3b9a-428d-9118-a9506ee1e904 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9653dac89d2648b285fd71c1b349e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3ac0c66c5b4bc787d2d6e12a957099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:48.697659 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-1e73f275-3b9a-428d-9118-a9506ee1e904 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] 10.222.0.70 "GET /compute/v2.1/servers/74d41279-27ab-492f-88ac-85f22b11b9ae" status: 200 len: 1355 microversion: 2.1 time: 0.747908 Aug 27 02:42:48.707992 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 424/834] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:47 2022] GET /compute/v2.1/servers/74d41279-27ab-492f-88ac-85f22b11b9ae => generated 1355 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:48.731435 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-860d4013-e7ac-44ff-84e5-d2dc650caa5c tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:48.732770 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-860d4013-e7ac-44ff-84e5-d2dc650caa5c tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] [instance: 3ee4d4db-a1bb-4567-a20d-29003e67a295] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:48.753007 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-860d4013-e7ac-44ff-84e5-d2dc650caa5c tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:48.754065 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-860d4013-e7ac-44ff-84e5-d2dc650caa5c tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:48.754988 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-860d4013-e7ac-44ff-84e5-d2dc650caa5c tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:48.756414 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-860d4013-e7ac-44ff-84e5-d2dc650caa5c tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:48.761996 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-860d4013-e7ac-44ff-84e5-d2dc650caa5c tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:48.762941 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-860d4013-e7ac-44ff-84e5-d2dc650caa5c tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:48.915729 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-9e8ab59e-95c8-49e4-8a3d-35b6cdae31a9 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec609246fd74d08a04e693343e6a569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba4a21f99f04c75977496fd544c628c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:48.941261 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-9e8ab59e-95c8-49e4-8a3d-35b6cdae31a9 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] 10.222.0.70 "GET /compute/v2.1/servers/1aa76851-fc87-44aa-97a1-5c01cc76e758" status: 200 len: 1281 microversion: 2.1 time: 0.486767 Aug 27 02:42:48.942482 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 411/835] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:48 2022] GET /compute/v2.1/servers/1aa76851-fc87-44aa-97a1-5c01cc76e758 => generated 1281 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:42:48.942482 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-21c48604-7c3f-45b2-a254-f5579918ee6e tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:48.942482 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-21c48604-7c3f-45b2-a254-f5579918ee6e tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 3095a9f9-6769-4107-94a5-beac6415694c] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:48.983595 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-21c48604-7c3f-45b2-a254-f5579918ee6e tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:48.984917 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-21c48604-7c3f-45b2-a254-f5579918ee6e tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:48.986742 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-21c48604-7c3f-45b2-a254-f5579918ee6e tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:48.997944 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-21c48604-7c3f-45b2-a254-f5579918ee6e tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:48.999403 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-21c48604-7c3f-45b2-a254-f5579918ee6e tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:49.000559 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-21c48604-7c3f-45b2-a254-f5579918ee6e tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:49.232578 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-860d4013-e7ac-44ff-84e5-d2dc650caa5c tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30abbf3afe304291981a6a9b85952aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c28ddbdb164f01bb82235c6d49717b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:49.243954 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-860d4013-e7ac-44ff-84e5-d2dc650caa5c tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] 10.222.0.70 "GET /compute/v2.1/servers/3ee4d4db-a1bb-4567-a20d-29003e67a295" status: 200 len: 1472 microversion: 2.1 time: 0.534077 Aug 27 02:42:49.245708 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 425/836] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:48 2022] GET /compute/v2.1/servers/3ee4d4db-a1bb-4567-a20d-29003e67a295 => generated 1472 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:49.257303 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-0cd88516-77bf-452e-ac1a-893daa8632ca req-ac144a78-124e-4e3e-baad-3241450f6862 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3095a9f9-6769-4107-94a5-beac6415694c", "name": "network-vif-plugged", "status": "completed", "tag": "ccabb4f8-adfb-4fa5-a578-1d53c8d1dc89"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:42:49.278242 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-0cd88516-77bf-452e-ac1a-893daa8632ca req-ac144a78-124e-4e3e-baad-3241450f6862 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:49.284302 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-0cd88516-77bf-452e-ac1a-893daa8632ca req-ac144a78-124e-4e3e-baad-3241450f6862 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:49.284975 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-0cd88516-77bf-452e-ac1a-893daa8632ca req-ac144a78-124e-4e3e-baad-3241450f6862 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:49.311487 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-0cd88516-77bf-452e-ac1a-893daa8632ca req-ac144a78-124e-4e3e-baad-3241450f6862 service nova] Creating event network-vif-plugged:ccabb4f8-adfb-4fa5-a578-1d53c8d1dc89 for instance 3095a9f9-6769-4107-94a5-beac6415694c on n-h1-852278-4 Aug 27 02:42:49.329323 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-0cd88516-77bf-452e-ac1a-893daa8632ca req-ac144a78-124e-4e3e-baad-3241450f6862 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082130 Aug 27 02:42:49.340661 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 426/837] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:42:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:42:49.346114 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-01ec4798-9559-476f-a70d-8be5864a08f9 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:49.347049 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-01ec4798-9559-476f-a70d-8be5864a08f9 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: 2e16c5b3-ff3c-4afe-ae65-97b9be1b14b0] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:49.370086 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-01ec4798-9559-476f-a70d-8be5864a08f9 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:49.373134 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-01ec4798-9559-476f-a70d-8be5864a08f9 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:49.376394 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-01ec4798-9559-476f-a70d-8be5864a08f9 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:49.391864 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-01ec4798-9559-476f-a70d-8be5864a08f9 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:49.394765 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-01ec4798-9559-476f-a70d-8be5864a08f9 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:49.397804 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-01ec4798-9559-476f-a70d-8be5864a08f9 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:49.438956 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-21c48604-7c3f-45b2-a254-f5579918ee6e tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:49.449763 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-21c48604-7c3f-45b2-a254-f5579918ee6e tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/3095a9f9-6769-4107-94a5-beac6415694c" status: 200 len: 1360 microversion: 2.1 time: 0.505852 Aug 27 02:42:49.453946 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 412/838] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:48 2022] GET /compute/v2.1/servers/3095a9f9-6769-4107-94a5-beac6415694c => generated 1360 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:49.609216 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-f3ca5637-da32-403b-974a-388939dffe60 req-e61cffb1-2c63-43a4-aa2f-2e58722d83d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e16c5b3-ff3c-4afe-ae65-97b9be1b14b0", "tag": "12048ca5-6824-4f98-acbb-443024b10a21"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:42:49.620895 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-f3ca5637-da32-403b-974a-388939dffe60 req-e61cffb1-2c63-43a4-aa2f-2e58722d83d4 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:49.622387 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-f3ca5637-da32-403b-974a-388939dffe60 req-e61cffb1-2c63-43a4-aa2f-2e58722d83d4 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:49.635487 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-f3ca5637-da32-403b-974a-388939dffe60 req-e61cffb1-2c63-43a4-aa2f-2e58722d83d4 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:49.655645 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-f3ca5637-da32-403b-974a-388939dffe60 req-e61cffb1-2c63-43a4-aa2f-2e58722d83d4 service nova] Creating event network-changed:12048ca5-6824-4f98-acbb-443024b10a21 for instance 2e16c5b3-ff3c-4afe-ae65-97b9be1b14b0 on n-h2-852278-4 Aug 27 02:42:49.661628 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-f3ca5637-da32-403b-974a-388939dffe60 req-e61cffb1-2c63-43a4-aa2f-2e58722d83d4 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056252 Aug 27 02:42:49.662280 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 413/839] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:42:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:42:49.733036 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-5b48eed4-7d99-4ae0-bf9e-c6659af52d15 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:49.733834 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-5b48eed4-7d99-4ae0-bf9e-c6659af52d15 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] [instance: 74d41279-27ab-492f-88ac-85f22b11b9ae] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:49.755572 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5b48eed4-7d99-4ae0-bf9e-c6659af52d15 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:49.756072 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5b48eed4-7d99-4ae0-bf9e-c6659af52d15 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:49.757424 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5b48eed4-7d99-4ae0-bf9e-c6659af52d15 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:49.757424 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5b48eed4-7d99-4ae0-bf9e-c6659af52d15 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:49.757713 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5b48eed4-7d99-4ae0-bf9e-c6659af52d15 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:49.758138 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5b48eed4-7d99-4ae0-bf9e-c6659af52d15 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:49.794671 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-01ec4798-9559-476f-a70d-8be5864a08f9 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6d1646ec094e3297f6f3c51dd72e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b105816fd4e54b9da4973ff721e1fb92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:49.816446 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-01ec4798-9559-476f-a70d-8be5864a08f9 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "GET /compute/v2.1/servers/2e16c5b3-ff3c-4afe-ae65-97b9be1b14b0" status: 200 len: 1317 microversion: 2.1 time: 0.464878 Aug 27 02:42:49.817166 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 427/840] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:49 2022] GET /compute/v2.1/servers/2e16c5b3-ff3c-4afe-ae65-97b9be1b14b0 => generated 1317 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:49.983107 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f054c7ea-bcb3-41a1-8ce2-35586cc0b29b tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:49.984129 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-f054c7ea-bcb3-41a1-8ce2-35586cc0b29b tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] [instance: 1aa76851-fc87-44aa-97a1-5c01cc76e758] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:49.991436 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f054c7ea-bcb3-41a1-8ce2-35586cc0b29b tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:49.992161 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f054c7ea-bcb3-41a1-8ce2-35586cc0b29b tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:49.992855 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f054c7ea-bcb3-41a1-8ce2-35586cc0b29b tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:49.993842 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f054c7ea-bcb3-41a1-8ce2-35586cc0b29b tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:49.994503 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f054c7ea-bcb3-41a1-8ce2-35586cc0b29b tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:49.995197 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f054c7ea-bcb3-41a1-8ce2-35586cc0b29b tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:49.999986 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:42:50.221333 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-5b48eed4-7d99-4ae0-bf9e-c6659af52d15 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9653dac89d2648b285fd71c1b349e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3ac0c66c5b4bc787d2d6e12a957099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:50.233978 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-5b48eed4-7d99-4ae0-bf9e-c6659af52d15 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] 10.222.0.70 "GET /compute/v2.1/servers/74d41279-27ab-492f-88ac-85f22b11b9ae" status: 200 len: 1355 microversion: 2.1 time: 0.509383 Aug 27 02:42:50.234594 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 414/841] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:49 2022] GET /compute/v2.1/servers/74d41279-27ab-492f-88ac-85f22b11b9ae => generated 1355 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:50.268116 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-76cc342e-6ae9-44c1-8d50-9914c649b004 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:50.268709 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-76cc342e-6ae9-44c1-8d50-9914c649b004 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] [instance: 3ee4d4db-a1bb-4567-a20d-29003e67a295] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:50.280609 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-76cc342e-6ae9-44c1-8d50-9914c649b004 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:50.281124 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-76cc342e-6ae9-44c1-8d50-9914c649b004 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:50.281569 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-76cc342e-6ae9-44c1-8d50-9914c649b004 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:50.283542 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-76cc342e-6ae9-44c1-8d50-9914c649b004 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:50.285318 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-76cc342e-6ae9-44c1-8d50-9914c649b004 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:50.285936 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-76cc342e-6ae9-44c1-8d50-9914c649b004 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:50.355581 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-f054c7ea-bcb3-41a1-8ce2-35586cc0b29b tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec609246fd74d08a04e693343e6a569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba4a21f99f04c75977496fd544c628c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:50.366246 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f054c7ea-bcb3-41a1-8ce2-35586cc0b29b tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] 10.222.0.70 "GET /compute/v2.1/servers/1aa76851-fc87-44aa-97a1-5c01cc76e758" status: 200 len: 1323 microversion: 2.1 time: 0.386910 Aug 27 02:42:50.369074 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 428/842] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:49 2022] GET /compute/v2.1/servers/1aa76851-fc87-44aa-97a1-5c01cc76e758 => generated 1323 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:42:50.474076 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-250568e6-fa5f-4804-a83a-8caca59de46d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:50.475100 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-250568e6-fa5f-4804-a83a-8caca59de46d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 3095a9f9-6769-4107-94a5-beac6415694c] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:50.487896 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-250568e6-fa5f-4804-a83a-8caca59de46d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:50.488797 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-250568e6-fa5f-4804-a83a-8caca59de46d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:50.489449 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-250568e6-fa5f-4804-a83a-8caca59de46d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:50.490409 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-250568e6-fa5f-4804-a83a-8caca59de46d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:50.491086 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-250568e6-fa5f-4804-a83a-8caca59de46d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:50.491733 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-250568e6-fa5f-4804-a83a-8caca59de46d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:50.591225 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-76cc342e-6ae9-44c1-8d50-9914c649b004 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30abbf3afe304291981a6a9b85952aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c28ddbdb164f01bb82235c6d49717b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:50.601327 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-76cc342e-6ae9-44c1-8d50-9914c649b004 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] 10.222.0.70 "GET /compute/v2.1/servers/3ee4d4db-a1bb-4567-a20d-29003e67a295" status: 200 len: 1472 microversion: 2.1 time: 0.337702 Aug 27 02:42:50.602910 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 415/843] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:50 2022] GET /compute/v2.1/servers/3ee4d4db-a1bb-4567-a20d-29003e67a295 => generated 1472 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:50.759914 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-250568e6-fa5f-4804-a83a-8caca59de46d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:50.768759 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-250568e6-fa5f-4804-a83a-8caca59de46d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/3095a9f9-6769-4107-94a5-beac6415694c" status: 200 len: 1360 microversion: 2.1 time: 0.298588 Aug 27 02:42:50.769855 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 429/844] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:50 2022] GET /compute/v2.1/servers/3095a9f9-6769-4107-94a5-beac6415694c => generated 1360 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:50.838488 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b3b85770-15e7-42b2-9ee9-ef53cde8140a tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:50.839437 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b3b85770-15e7-42b2-9ee9-ef53cde8140a tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: 2e16c5b3-ff3c-4afe-ae65-97b9be1b14b0] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:50.850676 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b3b85770-15e7-42b2-9ee9-ef53cde8140a tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:50.851476 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b3b85770-15e7-42b2-9ee9-ef53cde8140a tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:50.852125 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b3b85770-15e7-42b2-9ee9-ef53cde8140a tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:50.853041 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b3b85770-15e7-42b2-9ee9-ef53cde8140a tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:50.853667 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b3b85770-15e7-42b2-9ee9-ef53cde8140a tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:50.854262 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b3b85770-15e7-42b2-9ee9-ef53cde8140a tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:51.036134 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-b3b85770-15e7-42b2-9ee9-ef53cde8140a tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6d1646ec094e3297f6f3c51dd72e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b105816fd4e54b9da4973ff721e1fb92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:51.060433 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b3b85770-15e7-42b2-9ee9-ef53cde8140a tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "GET /compute/v2.1/servers/2e16c5b3-ff3c-4afe-ae65-97b9be1b14b0" status: 200 len: 1317 microversion: 2.1 time: 0.226774 Aug 27 02:42:51.063222 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 416/845] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:50 2022] GET /compute/v2.1/servers/2e16c5b3-ff3c-4afe-ae65-97b9be1b14b0 => generated 1317 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:51.255249 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0ed608fe-7da3-4ba3-a656-b63b06c2cee4 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:51.256562 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-0ed608fe-7da3-4ba3-a656-b63b06c2cee4 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] [instance: 74d41279-27ab-492f-88ac-85f22b11b9ae] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:51.263706 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0ed608fe-7da3-4ba3-a656-b63b06c2cee4 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:51.264520 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0ed608fe-7da3-4ba3-a656-b63b06c2cee4 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:51.265183 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0ed608fe-7da3-4ba3-a656-b63b06c2cee4 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:51.266134 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0ed608fe-7da3-4ba3-a656-b63b06c2cee4 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:51.266766 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0ed608fe-7da3-4ba3-a656-b63b06c2cee4 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:51.267383 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0ed608fe-7da3-4ba3-a656-b63b06c2cee4 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:51.390366 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3d2d4290-ad39-4087-8d2f-bbe38ce2f598 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:51.391652 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-3d2d4290-ad39-4087-8d2f-bbe38ce2f598 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] [instance: 1aa76851-fc87-44aa-97a1-5c01cc76e758] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:51.399223 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3d2d4290-ad39-4087-8d2f-bbe38ce2f598 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:51.400035 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3d2d4290-ad39-4087-8d2f-bbe38ce2f598 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:51.400728 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3d2d4290-ad39-4087-8d2f-bbe38ce2f598 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:51.401663 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3d2d4290-ad39-4087-8d2f-bbe38ce2f598 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:51.402322 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3d2d4290-ad39-4087-8d2f-bbe38ce2f598 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:51.402998 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3d2d4290-ad39-4087-8d2f-bbe38ce2f598 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:51.452085 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0ed608fe-7da3-4ba3-a656-b63b06c2cee4 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9653dac89d2648b285fd71c1b349e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3ac0c66c5b4bc787d2d6e12a957099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:51.460632 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-0ed608fe-7da3-4ba3-a656-b63b06c2cee4 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] 10.222.0.70 "GET /compute/v2.1/servers/74d41279-27ab-492f-88ac-85f22b11b9ae" status: 200 len: 1355 microversion: 2.1 time: 0.209280 Aug 27 02:42:51.472036 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 430/846] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:51 2022] GET /compute/v2.1/servers/74d41279-27ab-492f-88ac-85f22b11b9ae => generated 1355 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:51.611372 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-3d2d4290-ad39-4087-8d2f-bbe38ce2f598 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec609246fd74d08a04e693343e6a569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba4a21f99f04c75977496fd544c628c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:51.623555 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8cf7174e-5020-45b8-a721-758c3d5d57a2 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:51.624577 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-8cf7174e-5020-45b8-a721-758c3d5d57a2 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] [instance: 3ee4d4db-a1bb-4567-a20d-29003e67a295] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:51.636805 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-3d2d4290-ad39-4087-8d2f-bbe38ce2f598 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] 10.222.0.70 "GET /compute/v2.1/servers/1aa76851-fc87-44aa-97a1-5c01cc76e758" status: 200 len: 1323 microversion: 2.1 time: 0.247500 Aug 27 02:42:51.638167 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 417/847] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:51 2022] GET /compute/v2.1/servers/1aa76851-fc87-44aa-97a1-5c01cc76e758 => generated 1323 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:42:51.640564 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8cf7174e-5020-45b8-a721-758c3d5d57a2 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:51.641101 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8cf7174e-5020-45b8-a721-758c3d5d57a2 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:51.641505 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8cf7174e-5020-45b8-a721-758c3d5d57a2 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:51.645274 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8cf7174e-5020-45b8-a721-758c3d5d57a2 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:51.654169 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8cf7174e-5020-45b8-a721-758c3d5d57a2 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:51.654974 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8cf7174e-5020-45b8-a721-758c3d5d57a2 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:51.792439 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-be1d469c-44df-4d34-abb0-0f07072cc773 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:51.793267 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-be1d469c-44df-4d34-abb0-0f07072cc773 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 3095a9f9-6769-4107-94a5-beac6415694c] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:51.807006 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-be1d469c-44df-4d34-abb0-0f07072cc773 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:51.807584 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-be1d469c-44df-4d34-abb0-0f07072cc773 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:51.810463 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-be1d469c-44df-4d34-abb0-0f07072cc773 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:51.811288 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-be1d469c-44df-4d34-abb0-0f07072cc773 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:51.812218 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-be1d469c-44df-4d34-abb0-0f07072cc773 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:51.814187 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-be1d469c-44df-4d34-abb0-0f07072cc773 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:51.835949 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-8cf7174e-5020-45b8-a721-758c3d5d57a2 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30abbf3afe304291981a6a9b85952aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c28ddbdb164f01bb82235c6d49717b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:51.849016 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-8cf7174e-5020-45b8-a721-758c3d5d57a2 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] 10.222.0.70 "GET /compute/v2.1/servers/3ee4d4db-a1bb-4567-a20d-29003e67a295" status: 200 len: 1472 microversion: 2.1 time: 0.230035 Aug 27 02:42:51.865693 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 431/848] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:51 2022] GET /compute/v2.1/servers/3ee4d4db-a1bb-4567-a20d-29003e67a295 => generated 1472 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:42:52.083992 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-2ccf65b2-03ae-49a0-885b-4482a51b6dd9 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:52.085050 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-2ccf65b2-03ae-49a0-885b-4482a51b6dd9 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: 2e16c5b3-ff3c-4afe-ae65-97b9be1b14b0] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:52.098542 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-be1d469c-44df-4d34-abb0-0f07072cc773 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:52.106558 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-be1d469c-44df-4d34-abb0-0f07072cc773 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/3095a9f9-6769-4107-94a5-beac6415694c" status: 200 len: 1542 microversion: 2.1 time: 0.320102 Aug 27 02:42:52.107148 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 418/849] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:51 2022] GET /compute/v2.1/servers/3095a9f9-6769-4107-94a5-beac6415694c => generated 1542 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:52.107978 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2ccf65b2-03ae-49a0-885b-4482a51b6dd9 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:52.108930 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2ccf65b2-03ae-49a0-885b-4482a51b6dd9 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:52.109551 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2ccf65b2-03ae-49a0-885b-4482a51b6dd9 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:52.110481 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2ccf65b2-03ae-49a0-885b-4482a51b6dd9 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:52.111200 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2ccf65b2-03ae-49a0-885b-4482a51b6dd9 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:52.111779 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2ccf65b2-03ae-49a0-885b-4482a51b6dd9 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:52.128272 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-36ab6c97-1d41-46cc-9397-76fa8cfe71f0 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:52.128780 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-36ab6c97-1d41-46cc-9397-76fa8cfe71f0 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 3095a9f9-6769-4107-94a5-beac6415694c] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:52.134714 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-36ab6c97-1d41-46cc-9397-76fa8cfe71f0 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:52.135193 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-36ab6c97-1d41-46cc-9397-76fa8cfe71f0 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:52.135615 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-36ab6c97-1d41-46cc-9397-76fa8cfe71f0 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:52.136304 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-36ab6c97-1d41-46cc-9397-76fa8cfe71f0 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:52.136767 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-36ab6c97-1d41-46cc-9397-76fa8cfe71f0 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:52.137172 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-36ab6c97-1d41-46cc-9397-76fa8cfe71f0 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:52.300547 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-36ab6c97-1d41-46cc-9397-76fa8cfe71f0 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/3095a9f9-6769-4107-94a5-beac6415694c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.175943 Aug 27 02:42:52.301142 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 419/850] 10.222.0.70 () {58 vars in 1275 bytes} [Sat Aug 27 02:42:52 2022] GET /compute/v2.1/servers/3095a9f9-6769-4107-94a5-beac6415694c/os-interface => generated 284 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:42:52.383769 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-2ccf65b2-03ae-49a0-885b-4482a51b6dd9 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6d1646ec094e3297f6f3c51dd72e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b105816fd4e54b9da4973ff721e1fb92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:52.392029 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-2ccf65b2-03ae-49a0-885b-4482a51b6dd9 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "GET /compute/v2.1/servers/2e16c5b3-ff3c-4afe-ae65-97b9be1b14b0" status: 200 len: 1317 microversion: 2.1 time: 0.312533 Aug 27 02:42:52.392650 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 432/851] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:52 2022] GET /compute/v2.1/servers/2e16c5b3-ff3c-4afe-ae65-97b9be1b14b0 => generated 1317 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:42:52.496200 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-33eefca6-430f-4ad6-be7b-cc71bbbf2d6b tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:52.496817 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-33eefca6-430f-4ad6-be7b-cc71bbbf2d6b tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] [instance: 74d41279-27ab-492f-88ac-85f22b11b9ae] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:52.503571 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-33eefca6-430f-4ad6-be7b-cc71bbbf2d6b tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:52.504093 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-33eefca6-430f-4ad6-be7b-cc71bbbf2d6b tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:52.504554 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-33eefca6-430f-4ad6-be7b-cc71bbbf2d6b tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:52.505262 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-33eefca6-430f-4ad6-be7b-cc71bbbf2d6b tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:52.505726 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-33eefca6-430f-4ad6-be7b-cc71bbbf2d6b tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:52.506164 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-33eefca6-430f-4ad6-be7b-cc71bbbf2d6b tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:52.540635 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-54379901-64e6-4eb4-b1cf-a82610b575be req-17468a93-b6c6-4717-a172-cfa0d7594027 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1aa76851-fc87-44aa-97a1-5c01cc76e758", "tag": "dbf35e96-698c-4955-adc5-75c4ce70b202"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:42:52.567802 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-54379901-64e6-4eb4-b1cf-a82610b575be req-17468a93-b6c6-4717-a172-cfa0d7594027 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:52.576330 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-54379901-64e6-4eb4-b1cf-a82610b575be req-17468a93-b6c6-4717-a172-cfa0d7594027 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:52.577888 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-54379901-64e6-4eb4-b1cf-a82610b575be req-17468a93-b6c6-4717-a172-cfa0d7594027 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:52.592039 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-54379901-64e6-4eb4-b1cf-a82610b575be req-17468a93-b6c6-4717-a172-cfa0d7594027 service nova] Creating event network-changed:dbf35e96-698c-4955-adc5-75c4ce70b202 for instance 1aa76851-fc87-44aa-97a1-5c01cc76e758 on n-h1-852278-4 Aug 27 02:42:52.608683 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-54379901-64e6-4eb4-b1cf-a82610b575be req-17468a93-b6c6-4717-a172-cfa0d7594027 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074620 Aug 27 02:42:52.609619 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 433/852] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:42:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:42:52.661134 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-05389303-4275-4298-a183-4e6367074754 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:52.662056 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-05389303-4275-4298-a183-4e6367074754 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] [instance: 1aa76851-fc87-44aa-97a1-5c01cc76e758] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:52.675441 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-05389303-4275-4298-a183-4e6367074754 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:52.676236 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-05389303-4275-4298-a183-4e6367074754 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:52.677329 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-05389303-4275-4298-a183-4e6367074754 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:52.678304 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-05389303-4275-4298-a183-4e6367074754 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:52.679026 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-05389303-4275-4298-a183-4e6367074754 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:52.680283 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-05389303-4275-4298-a183-4e6367074754 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:52.728519 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-33eefca6-430f-4ad6-be7b-cc71bbbf2d6b tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9653dac89d2648b285fd71c1b349e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3ac0c66c5b4bc787d2d6e12a957099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:52.737414 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-33eefca6-430f-4ad6-be7b-cc71bbbf2d6b tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] 10.222.0.70 "GET /compute/v2.1/servers/74d41279-27ab-492f-88ac-85f22b11b9ae" status: 200 len: 1355 microversion: 2.1 time: 0.245717 Aug 27 02:42:52.738737 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 420/853] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:52 2022] GET /compute/v2.1/servers/74d41279-27ab-492f-88ac-85f22b11b9ae => generated 1355 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:52.872461 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0987157c-6bd1-4155-9ed0-956950edb5ec tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:52.873380 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-0987157c-6bd1-4155-9ed0-956950edb5ec tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] [instance: 3ee4d4db-a1bb-4567-a20d-29003e67a295] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:52.883377 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0987157c-6bd1-4155-9ed0-956950edb5ec tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:52.885458 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0987157c-6bd1-4155-9ed0-956950edb5ec tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:52.886102 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0987157c-6bd1-4155-9ed0-956950edb5ec tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:52.887100 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0987157c-6bd1-4155-9ed0-956950edb5ec tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:52.887740 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0987157c-6bd1-4155-9ed0-956950edb5ec tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:52.888369 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0987157c-6bd1-4155-9ed0-956950edb5ec tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:53.087570 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:42:53.122065 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=6 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:42:53.493063 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-05389303-4275-4298-a183-4e6367074754 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec609246fd74d08a04e693343e6a569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba4a21f99f04c75977496fd544c628c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:53.508029 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-05389303-4275-4298-a183-4e6367074754 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] 10.222.0.70 "GET /compute/v2.1/servers/1aa76851-fc87-44aa-97a1-5c01cc76e758" status: 200 len: 1323 microversion: 2.1 time: 0.852185 Aug 27 02:42:53.513126 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 434/854] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:52 2022] GET /compute/v2.1/servers/1aa76851-fc87-44aa-97a1-5c01cc76e758 => generated 1323 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:42:53.524671 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-f4624055-38f4-4c71-8535-26896c6d05da req-fb3af4ab-b78f-4f05-801d-3a13677dd4b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74d41279-27ab-492f-88ac-85f22b11b9ae", "name": "network-vif-plugged", "status": "completed", "tag": "9bdbf58b-76f2-4a6d-85cc-3cc9d7478aa1"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:42:53.534772 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-f4624055-38f4-4c71-8535-26896c6d05da req-fb3af4ab-b78f-4f05-801d-3a13677dd4b3 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:53.535250 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-f4624055-38f4-4c71-8535-26896c6d05da req-fb3af4ab-b78f-4f05-801d-3a13677dd4b3 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:53.535677 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-f4624055-38f4-4c71-8535-26896c6d05da req-fb3af4ab-b78f-4f05-801d-3a13677dd4b3 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:53.553981 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-f4624055-38f4-4c71-8535-26896c6d05da req-fb3af4ab-b78f-4f05-801d-3a13677dd4b3 service nova] Creating event network-vif-plugged:9bdbf58b-76f2-4a6d-85cc-3cc9d7478aa1 for instance 74d41279-27ab-492f-88ac-85f22b11b9ae on n-h2-852278-4 Aug 27 02:42:53.562057 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-f4624055-38f4-4c71-8535-26896c6d05da req-fb3af4ab-b78f-4f05-801d-3a13677dd4b3 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051231 Aug 27 02:42:53.563488 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 435/855] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:42:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:42:53.570743 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-21715341-c80b-4aee-9dcc-1c284cce38bb tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:53.571701 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-21715341-c80b-4aee-9dcc-1c284cce38bb tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: 2e16c5b3-ff3c-4afe-ae65-97b9be1b14b0] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:53.579542 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-21715341-c80b-4aee-9dcc-1c284cce38bb tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:53.580528 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-21715341-c80b-4aee-9dcc-1c284cce38bb tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:53.581851 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-21715341-c80b-4aee-9dcc-1c284cce38bb tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:53.582799 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-21715341-c80b-4aee-9dcc-1c284cce38bb tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:53.583594 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-21715341-c80b-4aee-9dcc-1c284cce38bb tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:53.584208 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-21715341-c80b-4aee-9dcc-1c284cce38bb tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:53.613712 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-0987157c-6bd1-4155-9ed0-956950edb5ec tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30abbf3afe304291981a6a9b85952aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c28ddbdb164f01bb82235c6d49717b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:53.626087 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-0987157c-6bd1-4155-9ed0-956950edb5ec tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] 10.222.0.70 "GET /compute/v2.1/servers/3ee4d4db-a1bb-4567-a20d-29003e67a295" status: 200 len: 1472 microversion: 2.1 time: 0.758603 Aug 27 02:42:53.642180 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 421/856] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:52 2022] GET /compute/v2.1/servers/3ee4d4db-a1bb-4567-a20d-29003e67a295 => generated 1472 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:42:53.759144 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-bd8c0898-63dc-4865-b819-fe2aaa448a3c tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:53.760177 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-bd8c0898-63dc-4865-b819-fe2aaa448a3c tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] [instance: 74d41279-27ab-492f-88ac-85f22b11b9ae] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:53.768547 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bd8c0898-63dc-4865-b819-fe2aaa448a3c tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:53.769998 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bd8c0898-63dc-4865-b819-fe2aaa448a3c tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:53.770720 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bd8c0898-63dc-4865-b819-fe2aaa448a3c tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:53.771913 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bd8c0898-63dc-4865-b819-fe2aaa448a3c tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:53.772695 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bd8c0898-63dc-4865-b819-fe2aaa448a3c tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:53.773575 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bd8c0898-63dc-4865-b819-fe2aaa448a3c tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:53.823147 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-21715341-c80b-4aee-9dcc-1c284cce38bb tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6d1646ec094e3297f6f3c51dd72e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b105816fd4e54b9da4973ff721e1fb92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:53.832553 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-21715341-c80b-4aee-9dcc-1c284cce38bb tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "GET /compute/v2.1/servers/2e16c5b3-ff3c-4afe-ae65-97b9be1b14b0" status: 200 len: 1317 microversion: 2.1 time: 0.267097 Aug 27 02:42:53.833514 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 436/857] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:53 2022] GET /compute/v2.1/servers/2e16c5b3-ff3c-4afe-ae65-97b9be1b14b0 => generated 1317 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:54.025639 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-bd8c0898-63dc-4865-b819-fe2aaa448a3c tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9653dac89d2648b285fd71c1b349e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3ac0c66c5b4bc787d2d6e12a957099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:54.034319 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-bd8c0898-63dc-4865-b819-fe2aaa448a3c tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] 10.222.0.70 "GET /compute/v2.1/servers/74d41279-27ab-492f-88ac-85f22b11b9ae" status: 200 len: 1355 microversion: 2.1 time: 0.279793 Aug 27 02:42:54.035586 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 422/858] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:53 2022] GET /compute/v2.1/servers/74d41279-27ab-492f-88ac-85f22b11b9ae => generated 1355 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:42:54.529521 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4d1055fc-ee7c-4390-a556-3ac890195602 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:54.532091 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-4d1055fc-ee7c-4390-a556-3ac890195602 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] [instance: 1aa76851-fc87-44aa-97a1-5c01cc76e758] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:54.541366 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4d1055fc-ee7c-4390-a556-3ac890195602 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:54.542787 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4d1055fc-ee7c-4390-a556-3ac890195602 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:54.543426 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4d1055fc-ee7c-4390-a556-3ac890195602 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:54.544346 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4d1055fc-ee7c-4390-a556-3ac890195602 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:54.545573 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4d1055fc-ee7c-4390-a556-3ac890195602 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:54.546797 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4d1055fc-ee7c-4390-a556-3ac890195602 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:54.650631 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e458da0e-a55c-49f2-82af-ce3a411076e5 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:54.651268 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-e458da0e-a55c-49f2-82af-ce3a411076e5 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] [instance: 3ee4d4db-a1bb-4567-a20d-29003e67a295] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:54.659114 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e458da0e-a55c-49f2-82af-ce3a411076e5 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:54.659611 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e458da0e-a55c-49f2-82af-ce3a411076e5 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:54.660050 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e458da0e-a55c-49f2-82af-ce3a411076e5 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:54.660807 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e458da0e-a55c-49f2-82af-ce3a411076e5 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:54.661471 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e458da0e-a55c-49f2-82af-ce3a411076e5 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:54.661905 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e458da0e-a55c-49f2-82af-ce3a411076e5 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:54.858443 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-4d1055fc-ee7c-4390-a556-3ac890195602 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec609246fd74d08a04e693343e6a569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba4a21f99f04c75977496fd544c628c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:54.867374 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-4d1055fc-ee7c-4390-a556-3ac890195602 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] 10.222.0.70 "GET /compute/v2.1/servers/1aa76851-fc87-44aa-97a1-5c01cc76e758" status: 200 len: 1323 microversion: 2.1 time: 0.341883 Aug 27 02:42:54.870945 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 437/859] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:54 2022] GET /compute/v2.1/servers/1aa76851-fc87-44aa-97a1-5c01cc76e758 => generated 1323 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:54.879483 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e3f98f88-5cfc-42c9-81d5-b0d0695df72b tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:54.901107 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-e3f98f88-5cfc-42c9-81d5-b0d0695df72b tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: 2e16c5b3-ff3c-4afe-ae65-97b9be1b14b0] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:54.924577 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e3f98f88-5cfc-42c9-81d5-b0d0695df72b tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:54.927264 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e3f98f88-5cfc-42c9-81d5-b0d0695df72b tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:54.928575 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e3f98f88-5cfc-42c9-81d5-b0d0695df72b tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:54.929520 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e3f98f88-5cfc-42c9-81d5-b0d0695df72b tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:54.931356 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e3f98f88-5cfc-42c9-81d5-b0d0695df72b tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:54.931975 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e3f98f88-5cfc-42c9-81d5-b0d0695df72b tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:55.056699 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=6 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:42:55.079579 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=14 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:42:55.128557 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e458da0e-a55c-49f2-82af-ce3a411076e5 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30abbf3afe304291981a6a9b85952aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c28ddbdb164f01bb82235c6d49717b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:55.137281 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e458da0e-a55c-49f2-82af-ce3a411076e5 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] 10.222.0.70 "GET /compute/v2.1/servers/3ee4d4db-a1bb-4567-a20d-29003e67a295" status: 200 len: 1472 microversion: 2.1 time: 0.491832 Aug 27 02:42:55.152396 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 423/860] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:54 2022] GET /compute/v2.1/servers/3ee4d4db-a1bb-4567-a20d-29003e67a295 => generated 1472 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:42:55.160352 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-b83696bc-4ae6-444f-8956-58a3c2410623 req-949a448c-81e5-4085-b618-766dc54f2ed5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3095a9f9-6769-4107-94a5-beac6415694c", "tag": "ccabb4f8-adfb-4fa5-a578-1d53c8d1dc89"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:42:55.171192 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-b83696bc-4ae6-444f-8956-58a3c2410623 req-949a448c-81e5-4085-b618-766dc54f2ed5 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:55.172232 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-b83696bc-4ae6-444f-8956-58a3c2410623 req-949a448c-81e5-4085-b618-766dc54f2ed5 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:55.172806 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-b83696bc-4ae6-444f-8956-58a3c2410623 req-949a448c-81e5-4085-b618-766dc54f2ed5 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:55.196135 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-b83696bc-4ae6-444f-8956-58a3c2410623 req-949a448c-81e5-4085-b618-766dc54f2ed5 service nova] Creating event network-changed:ccabb4f8-adfb-4fa5-a578-1d53c8d1dc89 for instance 3095a9f9-6769-4107-94a5-beac6415694c on n-h1-852278-4 Aug 27 02:42:55.201428 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-b83696bc-4ae6-444f-8956-58a3c2410623 req-949a448c-81e5-4085-b618-766dc54f2ed5 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046850 Aug 27 02:42:55.202409 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 424/861] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:42:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:42:55.208332 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3d4b3d0a-f316-4c59-906b-8745da559946 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:55.209072 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-3d4b3d0a-f316-4c59-906b-8745da559946 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] [instance: 74d41279-27ab-492f-88ac-85f22b11b9ae] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:55.216271 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3d4b3d0a-f316-4c59-906b-8745da559946 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:55.216789 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3d4b3d0a-f316-4c59-906b-8745da559946 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:55.217407 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3d4b3d0a-f316-4c59-906b-8745da559946 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:55.218754 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3d4b3d0a-f316-4c59-906b-8745da559946 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:55.219356 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3d4b3d0a-f316-4c59-906b-8745da559946 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:55.220049 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3d4b3d0a-f316-4c59-906b-8745da559946 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:55.282101 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-e3f98f88-5cfc-42c9-81d5-b0d0695df72b tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6d1646ec094e3297f6f3c51dd72e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b105816fd4e54b9da4973ff721e1fb92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:55.293001 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e3f98f88-5cfc-42c9-81d5-b0d0695df72b tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "GET /compute/v2.1/servers/2e16c5b3-ff3c-4afe-ae65-97b9be1b14b0" status: 200 len: 1317 microversion: 2.1 time: 0.419300 Aug 27 02:42:55.295036 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 438/862] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:54 2022] GET /compute/v2.1/servers/2e16c5b3-ff3c-4afe-ae65-97b9be1b14b0 => generated 1317 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:55.516012 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-3d4b3d0a-f316-4c59-906b-8745da559946 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9653dac89d2648b285fd71c1b349e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3ac0c66c5b4bc787d2d6e12a957099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:55.534636 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-3d4b3d0a-f316-4c59-906b-8745da559946 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] 10.222.0.70 "GET /compute/v2.1/servers/74d41279-27ab-492f-88ac-85f22b11b9ae" status: 200 len: 1355 microversion: 2.1 time: 0.329044 Aug 27 02:42:55.536694 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 425/863] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:55 2022] GET /compute/v2.1/servers/74d41279-27ab-492f-88ac-85f22b11b9ae => generated 1355 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:55.597144 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-608cc01b-ec11-42c4-9240-0bf64d70bc89 req-93145c1d-dfe7-4d5e-9296-715733cdebdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74d41279-27ab-492f-88ac-85f22b11b9ae", "name": "network-vif-plugged", "status": "completed", "tag": "2a55b3f5-8bd4-452d-8257-6bd29ed05f0e"}, {"server_uuid": "74d41279-27ab-492f-88ac-85f22b11b9ae", "name": "network-vif-plugged", "status": "completed", "tag": "c8e2f032-12c4-4c96-8d52-eafe91d1f3f2"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:42:55.607368 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-608cc01b-ec11-42c4-9240-0bf64d70bc89 req-93145c1d-dfe7-4d5e-9296-715733cdebdd service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:55.608192 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-608cc01b-ec11-42c4-9240-0bf64d70bc89 req-93145c1d-dfe7-4d5e-9296-715733cdebdd service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:55.608921 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-608cc01b-ec11-42c4-9240-0bf64d70bc89 req-93145c1d-dfe7-4d5e-9296-715733cdebdd service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:55.622467 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-608cc01b-ec11-42c4-9240-0bf64d70bc89 req-93145c1d-dfe7-4d5e-9296-715733cdebdd service nova] Creating event network-vif-plugged:2a55b3f5-8bd4-452d-8257-6bd29ed05f0e for instance 74d41279-27ab-492f-88ac-85f22b11b9ae on n-h2-852278-4 Aug 27 02:42:55.623273 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-608cc01b-ec11-42c4-9240-0bf64d70bc89 req-93145c1d-dfe7-4d5e-9296-715733cdebdd service nova] Creating event network-vif-plugged:c8e2f032-12c4-4c96-8d52-eafe91d1f3f2 for instance 74d41279-27ab-492f-88ac-85f22b11b9ae on n-h2-852278-4 Aug 27 02:42:55.629529 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-608cc01b-ec11-42c4-9240-0bf64d70bc89 req-93145c1d-dfe7-4d5e-9296-715733cdebdd service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.036060 Aug 27 02:42:55.630794 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 439/864] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:42:55 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:42:55.894268 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-1dfd27bc-375c-41af-9d3c-d93c3e2899af tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:55.894874 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-1dfd27bc-375c-41af-9d3c-d93c3e2899af tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] [instance: 1aa76851-fc87-44aa-97a1-5c01cc76e758] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:55.908612 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1dfd27bc-375c-41af-9d3c-d93c3e2899af tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:55.909496 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1dfd27bc-375c-41af-9d3c-d93c3e2899af tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:55.910123 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1dfd27bc-375c-41af-9d3c-d93c3e2899af tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:55.916275 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1dfd27bc-375c-41af-9d3c-d93c3e2899af tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:55.917049 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1dfd27bc-375c-41af-9d3c-d93c3e2899af tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:55.917720 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1dfd27bc-375c-41af-9d3c-d93c3e2899af tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:55.921555 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=100 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:42:56.161293 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-abae8f35-f355-4660-bf83-b2bddb353c73 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:56.161930 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-abae8f35-f355-4660-bf83-b2bddb353c73 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] [instance: 3ee4d4db-a1bb-4567-a20d-29003e67a295] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:56.176128 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-abae8f35-f355-4660-bf83-b2bddb353c73 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:56.177139 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-abae8f35-f355-4660-bf83-b2bddb353c73 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:56.177968 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-abae8f35-f355-4660-bf83-b2bddb353c73 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:56.181486 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-abae8f35-f355-4660-bf83-b2bddb353c73 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:56.182658 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-abae8f35-f355-4660-bf83-b2bddb353c73 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:56.183549 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-abae8f35-f355-4660-bf83-b2bddb353c73 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:56.233157 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-1dfd27bc-375c-41af-9d3c-d93c3e2899af tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec609246fd74d08a04e693343e6a569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba4a21f99f04c75977496fd544c628c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:56.280090 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-1dfd27bc-375c-41af-9d3c-d93c3e2899af tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] 10.222.0.70 "GET /compute/v2.1/servers/1aa76851-fc87-44aa-97a1-5c01cc76e758" status: 200 len: 1323 microversion: 2.1 time: 0.388115 Aug 27 02:42:56.296789 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 426/865] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:55 2022] GET /compute/v2.1/servers/1aa76851-fc87-44aa-97a1-5c01cc76e758 => generated 1323 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:56.314732 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-6b5a2f13-fc50-4afb-a2b6-bfc10e741534 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:56.315729 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-6b5a2f13-fc50-4afb-a2b6-bfc10e741534 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: 2e16c5b3-ff3c-4afe-ae65-97b9be1b14b0] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:56.322448 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6b5a2f13-fc50-4afb-a2b6-bfc10e741534 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:56.323312 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6b5a2f13-fc50-4afb-a2b6-bfc10e741534 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:56.323959 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6b5a2f13-fc50-4afb-a2b6-bfc10e741534 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:56.325165 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6b5a2f13-fc50-4afb-a2b6-bfc10e741534 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:56.326328 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6b5a2f13-fc50-4afb-a2b6-bfc10e741534 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:56.327139 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6b5a2f13-fc50-4afb-a2b6-bfc10e741534 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:56.539784 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-abae8f35-f355-4660-bf83-b2bddb353c73 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30abbf3afe304291981a6a9b85952aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c28ddbdb164f01bb82235c6d49717b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:56.555334 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-abae8f35-f355-4660-bf83-b2bddb353c73 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] 10.222.0.70 "GET /compute/v2.1/servers/3ee4d4db-a1bb-4567-a20d-29003e67a295" status: 200 len: 1472 microversion: 2.1 time: 0.399206 Aug 27 02:42:56.556598 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 440/866] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:56 2022] GET /compute/v2.1/servers/3ee4d4db-a1bb-4567-a20d-29003e67a295 => generated 1472 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:56.570257 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-7084eed9-9ac6-46f0-aea0-bf041a42e042 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:56.571514 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-7084eed9-9ac6-46f0-aea0-bf041a42e042 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] [instance: 74d41279-27ab-492f-88ac-85f22b11b9ae] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:56.581120 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7084eed9-9ac6-46f0-aea0-bf041a42e042 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:56.582152 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7084eed9-9ac6-46f0-aea0-bf041a42e042 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:56.582785 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7084eed9-9ac6-46f0-aea0-bf041a42e042 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:56.583740 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7084eed9-9ac6-46f0-aea0-bf041a42e042 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:56.584196 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7084eed9-9ac6-46f0-aea0-bf041a42e042 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:56.584668 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7084eed9-9ac6-46f0-aea0-bf041a42e042 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:56.635542 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-6b5a2f13-fc50-4afb-a2b6-bfc10e741534 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6d1646ec094e3297f6f3c51dd72e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b105816fd4e54b9da4973ff721e1fb92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:56.649031 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-6b5a2f13-fc50-4afb-a2b6-bfc10e741534 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "GET /compute/v2.1/servers/2e16c5b3-ff3c-4afe-ae65-97b9be1b14b0" status: 200 len: 1317 microversion: 2.1 time: 0.337759 Aug 27 02:42:56.650744 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 427/867] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:56 2022] GET /compute/v2.1/servers/2e16c5b3-ff3c-4afe-ae65-97b9be1b14b0 => generated 1317 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:56.911955 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-7084eed9-9ac6-46f0-aea0-bf041a42e042 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9653dac89d2648b285fd71c1b349e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3ac0c66c5b4bc787d2d6e12a957099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:56.939898 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-7084eed9-9ac6-46f0-aea0-bf041a42e042 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] 10.222.0.70 "GET /compute/v2.1/servers/74d41279-27ab-492f-88ac-85f22b11b9ae" status: 200 len: 1355 microversion: 2.1 time: 0.381482 Aug 27 02:42:56.948200 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 441/868] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:56 2022] GET /compute/v2.1/servers/74d41279-27ab-492f-88ac-85f22b11b9ae => generated 1355 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:57.302722 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-056afe50-f006-4056-86db-f9667da85e40 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:57.304202 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-056afe50-f006-4056-86db-f9667da85e40 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] [instance: 1aa76851-fc87-44aa-97a1-5c01cc76e758] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:57.311901 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-056afe50-f006-4056-86db-f9667da85e40 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:57.312782 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-056afe50-f006-4056-86db-f9667da85e40 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:57.313524 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-056afe50-f006-4056-86db-f9667da85e40 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:57.314788 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-056afe50-f006-4056-86db-f9667da85e40 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:57.315520 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-056afe50-f006-4056-86db-f9667da85e40 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:57.316168 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-056afe50-f006-4056-86db-f9667da85e40 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:57.585529 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-2f24d29a-d211-489f-8cd0-97b304242fc0 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:57.586776 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-2f24d29a-d211-489f-8cd0-97b304242fc0 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] [instance: 3ee4d4db-a1bb-4567-a20d-29003e67a295] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:57.599688 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2f24d29a-d211-489f-8cd0-97b304242fc0 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:57.601110 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2f24d29a-d211-489f-8cd0-97b304242fc0 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:57.601826 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2f24d29a-d211-489f-8cd0-97b304242fc0 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:57.604380 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2f24d29a-d211-489f-8cd0-97b304242fc0 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:57.605123 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2f24d29a-d211-489f-8cd0-97b304242fc0 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:57.605786 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2f24d29a-d211-489f-8cd0-97b304242fc0 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:57.839139 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-056afe50-f006-4056-86db-f9667da85e40 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec609246fd74d08a04e693343e6a569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba4a21f99f04c75977496fd544c628c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:57.848095 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-056afe50-f006-4056-86db-f9667da85e40 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] 10.222.0.70 "GET /compute/v2.1/servers/1aa76851-fc87-44aa-97a1-5c01cc76e758" status: 200 len: 1323 microversion: 2.1 time: 0.549249 Aug 27 02:42:57.849052 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 428/869] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:57 2022] GET /compute/v2.1/servers/1aa76851-fc87-44aa-97a1-5c01cc76e758 => generated 1323 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:57.860431 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7f3ca50b-4506-42aa-b31b-d9a163b76173 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:57.861346 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-7f3ca50b-4506-42aa-b31b-d9a163b76173 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: 2e16c5b3-ff3c-4afe-ae65-97b9be1b14b0] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:57.868054 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7f3ca50b-4506-42aa-b31b-d9a163b76173 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:57.868692 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7f3ca50b-4506-42aa-b31b-d9a163b76173 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:57.869539 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7f3ca50b-4506-42aa-b31b-d9a163b76173 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:57.870348 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7f3ca50b-4506-42aa-b31b-d9a163b76173 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:57.871034 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7f3ca50b-4506-42aa-b31b-d9a163b76173 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:57.871498 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7f3ca50b-4506-42aa-b31b-d9a163b76173 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:57.902062 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-2f24d29a-d211-489f-8cd0-97b304242fc0 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30abbf3afe304291981a6a9b85952aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c28ddbdb164f01bb82235c6d49717b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:57.910949 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-2f24d29a-d211-489f-8cd0-97b304242fc0 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] 10.222.0.70 "GET /compute/v2.1/servers/3ee4d4db-a1bb-4567-a20d-29003e67a295" status: 200 len: 1472 microversion: 2.1 time: 0.337912 Aug 27 02:42:57.912795 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 442/870] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:57 2022] GET /compute/v2.1/servers/3ee4d4db-a1bb-4567-a20d-29003e67a295 => generated 1472 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:42:57.929378 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-695dc599-f3a3-4356-b724-d9bba271ab8f req-904adb28-503c-4dec-afc0-4dcf62c2fd58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e16c5b3-ff3c-4afe-ae65-97b9be1b14b0", "name": "network-vif-plugged", "status": "completed", "tag": "12048ca5-6824-4f98-acbb-443024b10a21"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:42:57.942701 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-695dc599-f3a3-4356-b724-d9bba271ab8f req-904adb28-503c-4dec-afc0-4dcf62c2fd58 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:57.943460 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-695dc599-f3a3-4356-b724-d9bba271ab8f req-904adb28-503c-4dec-afc0-4dcf62c2fd58 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:57.944044 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-695dc599-f3a3-4356-b724-d9bba271ab8f req-904adb28-503c-4dec-afc0-4dcf62c2fd58 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:57.961876 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-695dc599-f3a3-4356-b724-d9bba271ab8f req-904adb28-503c-4dec-afc0-4dcf62c2fd58 service nova] Creating event network-vif-plugged:12048ca5-6824-4f98-acbb-443024b10a21 for instance 2e16c5b3-ff3c-4afe-ae65-97b9be1b14b0 on n-h2-852278-4 Aug 27 02:42:57.971274 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-695dc599-f3a3-4356-b724-d9bba271ab8f req-904adb28-503c-4dec-afc0-4dcf62c2fd58 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056640 Aug 27 02:42:57.971900 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 443/871] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:42:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:42:58.003067 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f56f4af9-35a9-43dd-91e9-e354e779b3fe tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:58.003776 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-f56f4af9-35a9-43dd-91e9-e354e779b3fe tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] [instance: 74d41279-27ab-492f-88ac-85f22b11b9ae] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:58.018615 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:42:58.029108 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f56f4af9-35a9-43dd-91e9-e354e779b3fe tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:58.029881 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f56f4af9-35a9-43dd-91e9-e354e779b3fe tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:58.030936 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f56f4af9-35a9-43dd-91e9-e354e779b3fe tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:58.032010 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f56f4af9-35a9-43dd-91e9-e354e779b3fe tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:58.034307 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f56f4af9-35a9-43dd-91e9-e354e779b3fe tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:58.036834 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f56f4af9-35a9-43dd-91e9-e354e779b3fe tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:58.194547 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-7f3ca50b-4506-42aa-b31b-d9a163b76173 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6d1646ec094e3297f6f3c51dd72e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b105816fd4e54b9da4973ff721e1fb92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:58.204983 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-7f3ca50b-4506-42aa-b31b-d9a163b76173 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "GET /compute/v2.1/servers/2e16c5b3-ff3c-4afe-ae65-97b9be1b14b0" status: 200 len: 1317 microversion: 2.1 time: 0.354111 Aug 27 02:42:58.205756 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 429/872] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:57 2022] GET /compute/v2.1/servers/2e16c5b3-ff3c-4afe-ae65-97b9be1b14b0 => generated 1317 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:58.362396 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-f56f4af9-35a9-43dd-91e9-e354e779b3fe tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9653dac89d2648b285fd71c1b349e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3ac0c66c5b4bc787d2d6e12a957099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:58.371166 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f56f4af9-35a9-43dd-91e9-e354e779b3fe tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] 10.222.0.70 "GET /compute/v2.1/servers/74d41279-27ab-492f-88ac-85f22b11b9ae" status: 200 len: 1802 microversion: 2.1 time: 0.394953 Aug 27 02:42:58.371824 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 444/873] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:57 2022] GET /compute/v2.1/servers/74d41279-27ab-492f-88ac-85f22b11b9ae => generated 1802 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:58.392632 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-9e951abc-5572-41ab-a390-61b5177efc11 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:58.393257 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-9e951abc-5572-41ab-a390-61b5177efc11 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] [instance: 74d41279-27ab-492f-88ac-85f22b11b9ae] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:58.399864 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9e951abc-5572-41ab-a390-61b5177efc11 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:58.400614 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9e951abc-5572-41ab-a390-61b5177efc11 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:58.401202 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9e951abc-5572-41ab-a390-61b5177efc11 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:58.401917 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9e951abc-5572-41ab-a390-61b5177efc11 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:58.402463 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9e951abc-5572-41ab-a390-61b5177efc11 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:58.403123 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9e951abc-5572-41ab-a390-61b5177efc11 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:58.463362 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-9e951abc-5572-41ab-a390-61b5177efc11 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] 10.222.0.70 "GET /compute/v2.1/servers/74d41279-27ab-492f-88ac-85f22b11b9ae/ips" status: 200 len: 215 microversion: 2.1 time: 0.075045 Aug 27 02:42:58.464377 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 430/874] 10.222.0.70 () {58 vars in 1248 bytes} [Sat Aug 27 02:42:58 2022] GET /compute/v2.1/servers/74d41279-27ab-492f-88ac-85f22b11b9ae/ips => generated 215 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:42:58.476727 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b3959271-5e29-4a60-9c85-0a3f12361a53 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:58.477863 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b3959271-5e29-4a60-9c85-0a3f12361a53 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] [instance: 74d41279-27ab-492f-88ac-85f22b11b9ae] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:58.485798 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b3959271-5e29-4a60-9c85-0a3f12361a53 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:58.486334 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b3959271-5e29-4a60-9c85-0a3f12361a53 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:58.487033 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b3959271-5e29-4a60-9c85-0a3f12361a53 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:58.487961 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b3959271-5e29-4a60-9c85-0a3f12361a53 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:58.488444 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b3959271-5e29-4a60-9c85-0a3f12361a53 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:58.488920 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b3959271-5e29-4a60-9c85-0a3f12361a53 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:58.554140 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b3959271-5e29-4a60-9c85-0a3f12361a53 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] [instance: 74d41279-27ab-492f-88ac-85f22b11b9ae] Going to try to terminate instance {{(pid=134052) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:42:58.674252 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:42:58.735017 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b3959271-5e29-4a60-9c85-0a3f12361a53 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] 10.222.0.70 "DELETE /compute/v2.1/servers/74d41279-27ab-492f-88ac-85f22b11b9ae" status: 204 len: 0 microversion: 2.1 time: 0.262511 Aug 27 02:42:58.735641 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 445/875] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:42:58 2022] DELETE /compute/v2.1/servers/74d41279-27ab-492f-88ac-85f22b11b9ae => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:42:58.746344 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-6d24f2c4-7fe0-4a7b-bd3b-98bdc887219f tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:58.747320 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-6d24f2c4-7fe0-4a7b-bd3b-98bdc887219f tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] [instance: 74d41279-27ab-492f-88ac-85f22b11b9ae] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:58.761622 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6d24f2c4-7fe0-4a7b-bd3b-98bdc887219f tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:58.768734 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6d24f2c4-7fe0-4a7b-bd3b-98bdc887219f tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:58.769358 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6d24f2c4-7fe0-4a7b-bd3b-98bdc887219f tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:58.770169 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6d24f2c4-7fe0-4a7b-bd3b-98bdc887219f tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:58.770845 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6d24f2c4-7fe0-4a7b-bd3b-98bdc887219f tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:58.771477 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6d24f2c4-7fe0-4a7b-bd3b-98bdc887219f tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:58.880072 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-2e89e460-3cd2-45b2-804b-15dfbdab0d9e tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:58.881188 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-2e89e460-3cd2-45b2-804b-15dfbdab0d9e tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] [instance: 1aa76851-fc87-44aa-97a1-5c01cc76e758] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:58.889736 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2e89e460-3cd2-45b2-804b-15dfbdab0d9e tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:58.890370 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2e89e460-3cd2-45b2-804b-15dfbdab0d9e tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:58.890811 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2e89e460-3cd2-45b2-804b-15dfbdab0d9e tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:58.891615 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2e89e460-3cd2-45b2-804b-15dfbdab0d9e tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:58.892365 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2e89e460-3cd2-45b2-804b-15dfbdab0d9e tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:58.893103 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2e89e460-3cd2-45b2-804b-15dfbdab0d9e tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:59.121172 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-6d24f2c4-7fe0-4a7b-bd3b-98bdc887219f tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9653dac89d2648b285fd71c1b349e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3ac0c66c5b4bc787d2d6e12a957099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:59.129332 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-6d24f2c4-7fe0-4a7b-bd3b-98bdc887219f tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] 10.222.0.70 "GET /compute/v2.1/servers/74d41279-27ab-492f-88ac-85f22b11b9ae" status: 200 len: 1808 microversion: 2.1 time: 0.389109 Aug 27 02:42:59.130163 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 431/876] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:58 2022] GET /compute/v2.1/servers/74d41279-27ab-492f-88ac-85f22b11b9ae => generated 1808 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:59.137728 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e33366e3-8617-420b-8353-61b5d3965801 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:59.138415 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-e33366e3-8617-420b-8353-61b5d3965801 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] [instance: 3ee4d4db-a1bb-4567-a20d-29003e67a295] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:59.148414 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e33366e3-8617-420b-8353-61b5d3965801 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:59.148983 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e33366e3-8617-420b-8353-61b5d3965801 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:59.149481 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e33366e3-8617-420b-8353-61b5d3965801 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:59.150242 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e33366e3-8617-420b-8353-61b5d3965801 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:59.150909 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e33366e3-8617-420b-8353-61b5d3965801 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:59.151544 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e33366e3-8617-420b-8353-61b5d3965801 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:59.257718 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-2e89e460-3cd2-45b2-804b-15dfbdab0d9e tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec609246fd74d08a04e693343e6a569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba4a21f99f04c75977496fd544c628c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:59.266527 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-2e89e460-3cd2-45b2-804b-15dfbdab0d9e tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] 10.222.0.70 "GET /compute/v2.1/servers/1aa76851-fc87-44aa-97a1-5c01cc76e758" status: 200 len: 1323 microversion: 2.1 time: 0.400962 Aug 27 02:42:59.267233 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 446/877] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:58 2022] GET /compute/v2.1/servers/1aa76851-fc87-44aa-97a1-5c01cc76e758 => generated 1323 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:42:59.272549 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b30f409f-0f2d-4329-a6e5-347ba3ba776c tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:59.273352 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b30f409f-0f2d-4329-a6e5-347ba3ba776c tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] [instance: 7eded9ca-c7bc-499a-bb53-a28d2c332402] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:59.281031 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b30f409f-0f2d-4329-a6e5-347ba3ba776c tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:59.281734 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b30f409f-0f2d-4329-a6e5-347ba3ba776c tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:59.282346 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b30f409f-0f2d-4329-a6e5-347ba3ba776c tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:59.283214 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b30f409f-0f2d-4329-a6e5-347ba3ba776c tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:59.283894 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b30f409f-0f2d-4329-a6e5-347ba3ba776c tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:59.284597 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b30f409f-0f2d-4329-a6e5-347ba3ba776c tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:59.524431 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e33366e3-8617-420b-8353-61b5d3965801 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30abbf3afe304291981a6a9b85952aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c28ddbdb164f01bb82235c6d49717b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:59.533423 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e33366e3-8617-420b-8353-61b5d3965801 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] 10.222.0.70 "GET /compute/v2.1/servers/3ee4d4db-a1bb-4567-a20d-29003e67a295" status: 200 len: 1472 microversion: 2.1 time: 0.399798 Aug 27 02:42:59.533990 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 432/878] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:59 2022] GET /compute/v2.1/servers/3ee4d4db-a1bb-4567-a20d-29003e67a295 => generated 1472 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:59.538930 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7fbf7311-04d4-4ee6-868c-df3f497c6389 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:59.539582 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-7fbf7311-04d4-4ee6-868c-df3f497c6389 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: 2e16c5b3-ff3c-4afe-ae65-97b9be1b14b0] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:59.546083 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7fbf7311-04d4-4ee6-868c-df3f497c6389 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:59.546260 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7fbf7311-04d4-4ee6-868c-df3f497c6389 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:59.546611 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7fbf7311-04d4-4ee6-868c-df3f497c6389 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:59.547324 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7fbf7311-04d4-4ee6-868c-df3f497c6389 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:59.547756 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7fbf7311-04d4-4ee6-868c-df3f497c6389 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:59.548429 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7fbf7311-04d4-4ee6-868c-df3f497c6389 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:59.672046 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.instance [None req-b30f409f-0f2d-4329-a6e5-347ba3ba776c tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lazy-loading 'services' on Instance uuid 7eded9ca-c7bc-499a-bb53-a28d2c332402 {{(pid=134052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:42:59.687191 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b30f409f-0f2d-4329-a6e5-347ba3ba776c tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/7eded9ca-c7bc-499a-bb53-a28d2c332402" status: 200 len: 2420 microversion: 2.25 time: 0.418651 Aug 27 02:42:59.687786 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 447/879] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:42:59 2022] GET /compute/v2.1/servers/7eded9ca-c7bc-499a-bb53-a28d2c332402 => generated 2420 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:42:59.709362 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f623968c-7db1-4701-9ff2-6b509c3ce979 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-852278-4", "block_migration": "auto"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:42:59.712093 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-f623968c-7db1-4701-9ff2-6b509c3ce979 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] [instance: 7eded9ca-c7bc-499a-bb53-a28d2c332402] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:59.718377 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f623968c-7db1-4701-9ff2-6b509c3ce979 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:59.718875 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f623968c-7db1-4701-9ff2-6b509c3ce979 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:59.719310 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f623968c-7db1-4701-9ff2-6b509c3ce979 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:59.720064 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f623968c-7db1-4701-9ff2-6b509c3ce979 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:59.720549 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f623968c-7db1-4701-9ff2-6b509c3ce979 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:59.720994 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f623968c-7db1-4701-9ff2-6b509c3ce979 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:59.745884 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.instance [None req-f623968c-7db1-4701-9ff2-6b509c3ce979 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lazy-loading 'flavor' on Instance uuid 7eded9ca-c7bc-499a-bb53-a28d2c332402 {{(pid=134052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:42:59.760224 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-f623968c-7db1-4701-9ff2-6b509c3ce979 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] [instance: 7eded9ca-c7bc-499a-bb53-a28d2c332402] Going to try to live migrate instance to n-h2-852278-4 {{(pid=134052) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 27 02:42:59.881582 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-7fbf7311-04d4-4ee6-868c-df3f497c6389 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6d1646ec094e3297f6f3c51dd72e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b105816fd4e54b9da4973ff721e1fb92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:59.895150 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-7fbf7311-04d4-4ee6-868c-df3f497c6389 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "GET /compute/v2.1/servers/2e16c5b3-ff3c-4afe-ae65-97b9be1b14b0" status: 200 len: 1317 microversion: 2.1 time: 0.358110 Aug 27 02:42:59.897028 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 433/880] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:59 2022] GET /compute/v2.1/servers/2e16c5b3-ff3c-4afe-ae65-97b9be1b14b0 => generated 1317 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:00.152571 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-48ead6a0-04f8-4f7a-af72-d916c3660861 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:00.154318 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-48ead6a0-04f8-4f7a-af72-d916c3660861 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] [instance: 74d41279-27ab-492f-88ac-85f22b11b9ae] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:00.170504 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-48ead6a0-04f8-4f7a-af72-d916c3660861 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:00.173883 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-48ead6a0-04f8-4f7a-af72-d916c3660861 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:00.175216 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-48ead6a0-04f8-4f7a-af72-d916c3660861 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:00.176998 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-48ead6a0-04f8-4f7a-af72-d916c3660861 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:00.177428 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-48ead6a0-04f8-4f7a-af72-d916c3660861 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:00.177932 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-48ead6a0-04f8-4f7a-af72-d916c3660861 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:00.451861 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-48ead6a0-04f8-4f7a-af72-d916c3660861 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9653dac89d2648b285fd71c1b349e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3ac0c66c5b4bc787d2d6e12a957099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:00.465592 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-48ead6a0-04f8-4f7a-af72-d916c3660861 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] 10.222.0.70 "GET /compute/v2.1/servers/74d41279-27ab-492f-88ac-85f22b11b9ae" status: 200 len: 1808 microversion: 2.1 time: 0.317246 Aug 27 02:43:00.468020 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 434/881] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:00 2022] GET /compute/v2.1/servers/74d41279-27ab-492f-88ac-85f22b11b9ae => generated 1808 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:43:00.474688 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7aeda775-f2d0-4e71-a3ff-456df5cc1f6b tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:00.476919 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-7aeda775-f2d0-4e71-a3ff-456df5cc1f6b tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] [instance: 1aa76851-fc87-44aa-97a1-5c01cc76e758] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:00.486395 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7aeda775-f2d0-4e71-a3ff-456df5cc1f6b tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:00.487419 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7aeda775-f2d0-4e71-a3ff-456df5cc1f6b tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:00.488502 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7aeda775-f2d0-4e71-a3ff-456df5cc1f6b tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:00.489489 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7aeda775-f2d0-4e71-a3ff-456df5cc1f6b tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:00.490209 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7aeda775-f2d0-4e71-a3ff-456df5cc1f6b tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:00.490843 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7aeda775-f2d0-4e71-a3ff-456df5cc1f6b tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:00.795372 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-7aeda775-f2d0-4e71-a3ff-456df5cc1f6b tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec609246fd74d08a04e693343e6a569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba4a21f99f04c75977496fd544c628c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:00.808117 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-7aeda775-f2d0-4e71-a3ff-456df5cc1f6b tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] 10.222.0.70 "GET /compute/v2.1/servers/1aa76851-fc87-44aa-97a1-5c01cc76e758" status: 200 len: 1323 microversion: 2.1 time: 0.338688 Aug 27 02:43:00.827155 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 435/882] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:00 2022] GET /compute/v2.1/servers/1aa76851-fc87-44aa-97a1-5c01cc76e758 => generated 1323 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:00.837822 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-19308e52-a3c3-436b-a94b-236a43743453 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:00.838590 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-19308e52-a3c3-436b-a94b-236a43743453 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] [instance: 3ee4d4db-a1bb-4567-a20d-29003e67a295] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:00.846388 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-19308e52-a3c3-436b-a94b-236a43743453 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:00.846884 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-19308e52-a3c3-436b-a94b-236a43743453 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:00.847321 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-19308e52-a3c3-436b-a94b-236a43743453 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:00.848042 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-19308e52-a3c3-436b-a94b-236a43743453 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:00.848523 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-19308e52-a3c3-436b-a94b-236a43743453 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:00.849037 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-19308e52-a3c3-436b-a94b-236a43743453 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:01.756134 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-19308e52-a3c3-436b-a94b-236a43743453 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30abbf3afe304291981a6a9b85952aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c28ddbdb164f01bb82235c6d49717b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:01.794892 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-19308e52-a3c3-436b-a94b-236a43743453 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] 10.222.0.70 "GET /compute/v2.1/servers/3ee4d4db-a1bb-4567-a20d-29003e67a295" status: 200 len: 1472 microversion: 2.1 time: 0.966408 Aug 27 02:43:01.795970 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 436/883] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:00 2022] GET /compute/v2.1/servers/3ee4d4db-a1bb-4567-a20d-29003e67a295 => generated 1472 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:01.805988 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c7a64d3c-3a1e-4ef2-838e-f8ab5bbbfdd4 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:01.807242 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-c7a64d3c-3a1e-4ef2-838e-f8ab5bbbfdd4 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: 2e16c5b3-ff3c-4afe-ae65-97b9be1b14b0] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:01.822282 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c7a64d3c-3a1e-4ef2-838e-f8ab5bbbfdd4 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:01.826510 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c7a64d3c-3a1e-4ef2-838e-f8ab5bbbfdd4 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:01.827325 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c7a64d3c-3a1e-4ef2-838e-f8ab5bbbfdd4 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:01.828612 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c7a64d3c-3a1e-4ef2-838e-f8ab5bbbfdd4 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:01.829247 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c7a64d3c-3a1e-4ef2-838e-f8ab5bbbfdd4 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:01.830607 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c7a64d3c-3a1e-4ef2-838e-f8ab5bbbfdd4 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:02.056117 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f623968c-7db1-4701-9ff2-6b509c3ce979 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/7eded9ca-c7bc-499a-bb53-a28d2c332402/action" status: 202 len: 0 microversion: 2.25 time: 2.350398 Aug 27 02:43:02.060048 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 448/884] 10.222.0.70 () {62 vars in 1319 bytes} [Sat Aug 27 02:42:59 2022] POST /compute/v2.1/servers/7eded9ca-c7bc-499a-bb53-a28d2c332402/action => generated 0 bytes in 2355 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:43:02.065093 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-8e475845-abd2-4dfd-9a44-cd4b7b061530 req-63515557-06a1-4bf3-8757-a91384dcde46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1aa76851-fc87-44aa-97a1-5c01cc76e758", "name": "network-vif-plugged", "status": "completed", "tag": "dbf35e96-698c-4955-adc5-75c4ce70b202"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:43:02.082675 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-8e475845-abd2-4dfd-9a44-cd4b7b061530 req-63515557-06a1-4bf3-8757-a91384dcde46 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:02.084282 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-8e475845-abd2-4dfd-9a44-cd4b7b061530 req-63515557-06a1-4bf3-8757-a91384dcde46 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:02.085008 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-8e475845-abd2-4dfd-9a44-cd4b7b061530 req-63515557-06a1-4bf3-8757-a91384dcde46 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:02.099756 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-8e475845-abd2-4dfd-9a44-cd4b7b061530 req-63515557-06a1-4bf3-8757-a91384dcde46 service nova] Creating event network-vif-plugged:dbf35e96-698c-4955-adc5-75c4ce70b202 for instance 1aa76851-fc87-44aa-97a1-5c01cc76e758 on n-h1-852278-4 Aug 27 02:43:02.105767 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-8e475845-abd2-4dfd-9a44-cd4b7b061530 req-63515557-06a1-4bf3-8757-a91384dcde46 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044410 Aug 27 02:43:02.110733 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 449/885] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:43:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:43:02.117043 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d9ca83e4-86c5-4fe0-a266-c7b089010ee0 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:02.118097 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d9ca83e4-86c5-4fe0-a266-c7b089010ee0 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] [instance: 74d41279-27ab-492f-88ac-85f22b11b9ae] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:02.127806 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d9ca83e4-86c5-4fe0-a266-c7b089010ee0 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:02.130069 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d9ca83e4-86c5-4fe0-a266-c7b089010ee0 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:02.130767 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d9ca83e4-86c5-4fe0-a266-c7b089010ee0 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:02.131658 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d9ca83e4-86c5-4fe0-a266-c7b089010ee0 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:02.132190 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d9ca83e4-86c5-4fe0-a266-c7b089010ee0 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:02.133248 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d9ca83e4-86c5-4fe0-a266-c7b089010ee0 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:02.224219 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-c7a64d3c-3a1e-4ef2-838e-f8ab5bbbfdd4 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6d1646ec094e3297f6f3c51dd72e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b105816fd4e54b9da4973ff721e1fb92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:02.239164 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c7a64d3c-3a1e-4ef2-838e-f8ab5bbbfdd4 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "GET /compute/v2.1/servers/2e16c5b3-ff3c-4afe-ae65-97b9be1b14b0" status: 200 len: 1467 microversion: 2.1 time: 0.440665 Aug 27 02:43:02.239770 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 437/886] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:01 2022] GET /compute/v2.1/servers/2e16c5b3-ff3c-4afe-ae65-97b9be1b14b0 => generated 1467 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:02.253080 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-db201508-1c60-410f-9964-1141f7fb7369 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:02.254616 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-db201508-1c60-410f-9964-1141f7fb7369 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] [instance: 1aa76851-fc87-44aa-97a1-5c01cc76e758] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:02.262965 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-db201508-1c60-410f-9964-1141f7fb7369 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:02.263842 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-db201508-1c60-410f-9964-1141f7fb7369 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:02.264530 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-db201508-1c60-410f-9964-1141f7fb7369 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:02.268994 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-db201508-1c60-410f-9964-1141f7fb7369 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:02.269789 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-db201508-1c60-410f-9964-1141f7fb7369 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:02.270475 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-db201508-1c60-410f-9964-1141f7fb7369 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:02.937969 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-d9ca83e4-86c5-4fe0-a266-c7b089010ee0 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9653dac89d2648b285fd71c1b349e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3ac0c66c5b4bc787d2d6e12a957099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:02.950457 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d9ca83e4-86c5-4fe0-a266-c7b089010ee0 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] 10.222.0.70 "GET /compute/v2.1/servers/74d41279-27ab-492f-88ac-85f22b11b9ae" status: 200 len: 1808 microversion: 2.1 time: 0.837646 Aug 27 02:43:02.951932 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 450/887] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:02 2022] GET /compute/v2.1/servers/74d41279-27ab-492f-88ac-85f22b11b9ae => generated 1808 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:02.968657 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-83c50733-9be3-412d-9827-a13cf40d4ff3 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:02.969725 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-83c50733-9be3-412d-9827-a13cf40d4ff3 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: 7eded9ca-c7bc-499a-bb53-a28d2c332402] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:02.988380 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-83c50733-9be3-412d-9827-a13cf40d4ff3 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:02.991727 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-83c50733-9be3-412d-9827-a13cf40d4ff3 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:02.992522 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-83c50733-9be3-412d-9827-a13cf40d4ff3 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:02.993647 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-83c50733-9be3-412d-9827-a13cf40d4ff3 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:02.994417 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-83c50733-9be3-412d-9827-a13cf40d4ff3 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:02.995212 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-83c50733-9be3-412d-9827-a13cf40d4ff3 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:03.012643 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-db201508-1c60-410f-9964-1141f7fb7369 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec609246fd74d08a04e693343e6a569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba4a21f99f04c75977496fd544c628c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:03.026785 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-db201508-1c60-410f-9964-1141f7fb7369 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] 10.222.0.70 "GET /compute/v2.1/servers/1aa76851-fc87-44aa-97a1-5c01cc76e758" status: 200 len: 1323 microversion: 2.1 time: 0.785914 Aug 27 02:43:03.045186 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 438/888] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:02 2022] GET /compute/v2.1/servers/1aa76851-fc87-44aa-97a1-5c01cc76e758 => generated 1323 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:03.391343 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0d3aa10d-bfde-44bf-a1d0-7a71eac8eadd tempest-ServersOnMultiNodesTest-986315705 tempest-ServersOnMultiNodesTest-986315705-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:03.392412 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-0d3aa10d-bfde-44bf-a1d0-7a71eac8eadd tempest-ServersOnMultiNodesTest-986315705 tempest-ServersOnMultiNodesTest-986315705-project-admin] [instance: 2e16c5b3-ff3c-4afe-ae65-97b9be1b14b0] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:03.410431 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0d3aa10d-bfde-44bf-a1d0-7a71eac8eadd tempest-ServersOnMultiNodesTest-986315705 tempest-ServersOnMultiNodesTest-986315705-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:03.411952 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0d3aa10d-bfde-44bf-a1d0-7a71eac8eadd tempest-ServersOnMultiNodesTest-986315705 tempest-ServersOnMultiNodesTest-986315705-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:03.415041 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0d3aa10d-bfde-44bf-a1d0-7a71eac8eadd tempest-ServersOnMultiNodesTest-986315705 tempest-ServersOnMultiNodesTest-986315705-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:03.416024 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0d3aa10d-bfde-44bf-a1d0-7a71eac8eadd tempest-ServersOnMultiNodesTest-986315705 tempest-ServersOnMultiNodesTest-986315705-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:03.417808 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0d3aa10d-bfde-44bf-a1d0-7a71eac8eadd tempest-ServersOnMultiNodesTest-986315705 tempest-ServersOnMultiNodesTest-986315705-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:03.418462 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0d3aa10d-bfde-44bf-a1d0-7a71eac8eadd tempest-ServersOnMultiNodesTest-986315705 tempest-ServersOnMultiNodesTest-986315705-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:03.681750 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-83c50733-9be3-412d-9827-a13cf40d4ff3 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:03.694159 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-83c50733-9be3-412d-9827-a13cf40d4ff3 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:03.695612 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-83c50733-9be3-412d-9827-a13cf40d4ff3 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:03.701874 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-83c50733-9be3-412d-9827-a13cf40d4ff3 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/7eded9ca-c7bc-499a-bb53-a28d2c332402" status: 200 len: 1812 microversion: 2.25 time: 0.747498 Aug 27 02:43:03.702935 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 451/889] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:43:02 2022] GET /compute/v2.1/servers/7eded9ca-c7bc-499a-bb53-a28d2c332402 => generated 1812 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:43:03.707769 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0cc06555-64a9-4d95-86a3-a426c27cdf83 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:03.718109 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-0cc06555-64a9-4d95-86a3-a426c27cdf83 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] [instance: 3ee4d4db-a1bb-4567-a20d-29003e67a295] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:03.728951 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0cc06555-64a9-4d95-86a3-a426c27cdf83 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:03.729876 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0cc06555-64a9-4d95-86a3-a426c27cdf83 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:03.730550 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0cc06555-64a9-4d95-86a3-a426c27cdf83 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:03.741464 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0cc06555-64a9-4d95-86a3-a426c27cdf83 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:03.742385 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0cc06555-64a9-4d95-86a3-a426c27cdf83 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:03.743123 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0cc06555-64a9-4d95-86a3-a426c27cdf83 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:04.534637 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0cc06555-64a9-4d95-86a3-a426c27cdf83 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30abbf3afe304291981a6a9b85952aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c28ddbdb164f01bb82235c6d49717b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:04.544648 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-0cc06555-64a9-4d95-86a3-a426c27cdf83 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] 10.222.0.70 "GET /compute/v2.1/servers/3ee4d4db-a1bb-4567-a20d-29003e67a295" status: 200 len: 1472 microversion: 2.1 time: 0.840404 Aug 27 02:43:04.545247 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 452/890] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:03 2022] GET /compute/v2.1/servers/3ee4d4db-a1bb-4567-a20d-29003e67a295 => generated 1472 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:04.569240 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-e6546ccf-f0ae-451b-808d-25a89edf68ff req-6360db33-5473-4f9b-b509-6999396c3df7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74d41279-27ab-492f-88ac-85f22b11b9ae", "name": "network-vif-deleted", "tag": "9bdbf58b-76f2-4a6d-85cc-3cc9d7478aa1"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:43:04.592746 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-e6546ccf-f0ae-451b-808d-25a89edf68ff req-6360db33-5473-4f9b-b509-6999396c3df7 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:04.593272 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-e6546ccf-f0ae-451b-808d-25a89edf68ff req-6360db33-5473-4f9b-b509-6999396c3df7 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:04.603250 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-e6546ccf-f0ae-451b-808d-25a89edf68ff req-6360db33-5473-4f9b-b509-6999396c3df7 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:04.631161 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-e6546ccf-f0ae-451b-808d-25a89edf68ff req-6360db33-5473-4f9b-b509-6999396c3df7 service nova] Creating event network-vif-deleted:9bdbf58b-76f2-4a6d-85cc-3cc9d7478aa1 for instance 74d41279-27ab-492f-88ac-85f22b11b9ae on n-h2-852278-4 Aug 27 02:43:04.655496 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-e6546ccf-f0ae-451b-808d-25a89edf68ff req-6360db33-5473-4f9b-b509-6999396c3df7 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105010 Aug 27 02:43:04.656161 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 453/891] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:43:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:43:04.677960 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ea6ff4ef-7b92-4f21-a781-93978b799aca tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:04.681421 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-ea6ff4ef-7b92-4f21-a781-93978b799aca tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] [instance: 74d41279-27ab-492f-88ac-85f22b11b9ae] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:04.689581 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ea6ff4ef-7b92-4f21-a781-93978b799aca tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:04.690830 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ea6ff4ef-7b92-4f21-a781-93978b799aca tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:04.691977 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ea6ff4ef-7b92-4f21-a781-93978b799aca tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:04.692890 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ea6ff4ef-7b92-4f21-a781-93978b799aca tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:04.693544 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ea6ff4ef-7b92-4f21-a781-93978b799aca tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:04.694192 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ea6ff4ef-7b92-4f21-a781-93978b799aca tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:04.746171 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-0d3aa10d-bfde-44bf-a1d0-7a71eac8eadd tempest-ServersOnMultiNodesTest-986315705 tempest-ServersOnMultiNodesTest-986315705-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/2e16c5b3-ff3c-4afe-ae65-97b9be1b14b0" status: 200 len: 1618 microversion: 2.1 time: 1.711102 Aug 27 02:43:04.747542 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 439/892] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:03 2022] GET /compute/v2.1/servers/2e16c5b3-ff3c-4afe-ae65-97b9be1b14b0 => generated 1618 bytes in 1715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:04.758207 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ce6b08c1-a1cd-429e-be5e-d2b966d9ae1a tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:04.761352 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-ce6b08c1-a1cd-429e-be5e-d2b966d9ae1a tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] [instance: 1aa76851-fc87-44aa-97a1-5c01cc76e758] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:04.774782 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ce6b08c1-a1cd-429e-be5e-d2b966d9ae1a tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:04.775279 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ce6b08c1-a1cd-429e-be5e-d2b966d9ae1a tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:04.780850 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ce6b08c1-a1cd-429e-be5e-d2b966d9ae1a tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:04.781687 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ce6b08c1-a1cd-429e-be5e-d2b966d9ae1a tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:04.782156 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ce6b08c1-a1cd-429e-be5e-d2b966d9ae1a tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:04.782583 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ce6b08c1-a1cd-429e-be5e-d2b966d9ae1a tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:05.306903 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-ea6ff4ef-7b92-4f21-a781-93978b799aca tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9653dac89d2648b285fd71c1b349e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3ac0c66c5b4bc787d2d6e12a957099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:05.353694 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ea6ff4ef-7b92-4f21-a781-93978b799aca tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] 10.222.0.70 "GET /compute/v2.1/servers/74d41279-27ab-492f-88ac-85f22b11b9ae" status: 200 len: 1673 microversion: 2.1 time: 0.695635 Aug 27 02:43:05.357353 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 454/893] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:04 2022] GET /compute/v2.1/servers/74d41279-27ab-492f-88ac-85f22b11b9ae => generated 1673 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:05.385775 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-36e95c5c-a9a0-48fe-be10-ea4956a4c6a7 req-97a6cfbc-4423-4bb3-b92b-1cf658c71a48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74d41279-27ab-492f-88ac-85f22b11b9ae", "name": "network-vif-unplugged", "status": "completed", "tag": "2a55b3f5-8bd4-452d-8257-6bd29ed05f0e"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:43:05.403431 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-36e95c5c-a9a0-48fe-be10-ea4956a4c6a7 req-97a6cfbc-4423-4bb3-b92b-1cf658c71a48 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:05.404722 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-36e95c5c-a9a0-48fe-be10-ea4956a4c6a7 req-97a6cfbc-4423-4bb3-b92b-1cf658c71a48 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:05.405270 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-36e95c5c-a9a0-48fe-be10-ea4956a4c6a7 req-97a6cfbc-4423-4bb3-b92b-1cf658c71a48 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:05.426416 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-36e95c5c-a9a0-48fe-be10-ea4956a4c6a7 req-97a6cfbc-4423-4bb3-b92b-1cf658c71a48 service nova] Creating event network-vif-unplugged:2a55b3f5-8bd4-452d-8257-6bd29ed05f0e for instance 74d41279-27ab-492f-88ac-85f22b11b9ae on n-h2-852278-4 Aug 27 02:43:05.434901 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-36e95c5c-a9a0-48fe-be10-ea4956a4c6a7 req-97a6cfbc-4423-4bb3-b92b-1cf658c71a48 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055880 Aug 27 02:43:05.439097 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 455/894] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:43:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:43:05.452704 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-2da76798-dae8-4d15-8751-27c8c714e8e4 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:05.454283 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-2da76798-dae8-4d15-8751-27c8c714e8e4 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: 7eded9ca-c7bc-499a-bb53-a28d2c332402] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:05.465828 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2da76798-dae8-4d15-8751-27c8c714e8e4 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:05.470311 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-ce6b08c1-a1cd-429e-be5e-d2b966d9ae1a tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec609246fd74d08a04e693343e6a569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba4a21f99f04c75977496fd544c628c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:05.485422 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2da76798-dae8-4d15-8751-27c8c714e8e4 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:05.486373 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2da76798-dae8-4d15-8751-27c8c714e8e4 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:05.487352 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2da76798-dae8-4d15-8751-27c8c714e8e4 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:05.489237 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ce6b08c1-a1cd-429e-be5e-d2b966d9ae1a tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] 10.222.0.70 "GET /compute/v2.1/servers/1aa76851-fc87-44aa-97a1-5c01cc76e758" status: 200 len: 1473 microversion: 2.1 time: 0.734748 Aug 27 02:43:05.489922 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2da76798-dae8-4d15-8751-27c8c714e8e4 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:05.493165 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2da76798-dae8-4d15-8751-27c8c714e8e4 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:05.494837 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 440/895] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:04 2022] GET /compute/v2.1/servers/1aa76851-fc87-44aa-97a1-5c01cc76e758 => generated 1473 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:05.509699 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-1cbe3d8c-e481-4f82-b18e-c00295a2d35a tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Action: 'create', calling method: .version_select at 0x7f5edf046dc0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-804829306", "policies": ["affinity"]}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:43:05.572360 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-1cbe3d8c-e481-4f82-b18e-c00295a2d35a tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Getting quotas for project b105816fd4e54b9da4973ff721e1fb92. Resources: {'server_groups'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:43:05.586503 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-1cbe3d8c-e481-4f82-b18e-c00295a2d35a tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Getting quotas for user eb6d1646ec094e3297f6f3c51dd72e85 and project b105816fd4e54b9da4973ff721e1fb92. Resources: {'server_groups'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:43:05.610871 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:DELETE=5,nova_api:SELECT=95 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:43:05.686474 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-1cbe3d8c-e481-4f82-b18e-c00295a2d35a tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Getting quotas for project b105816fd4e54b9da4973ff721e1fb92. Resources: {'server_groups'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:43:05.693542 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-1cbe3d8c-e481-4f82-b18e-c00295a2d35a tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Getting quotas for user eb6d1646ec094e3297f6f3c51dd72e85 and project b105816fd4e54b9da4973ff721e1fb92. Resources: {'server_groups'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:43:05.713750 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-1cbe3d8c-e481-4f82-b18e-c00295a2d35a tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "POST /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.216776 Aug 27 02:43:05.715208 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 441/896] 10.222.0.70 () {60 vars in 1174 bytes} [Sat Aug 27 02:43:05 2022] POST /compute/v2.1/os-server-groups => generated 187 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:43:05.723050 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8ec7e4fa-c2a9-4a12-bdd8-ef6e042200b7 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:05.724250 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-8ec7e4fa-c2a9-4a12-bdd8-ef6e042200b7 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] [instance: 1aa76851-fc87-44aa-97a1-5c01cc76e758] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:05.732545 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8ec7e4fa-c2a9-4a12-bdd8-ef6e042200b7 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:05.733363 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8ec7e4fa-c2a9-4a12-bdd8-ef6e042200b7 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:05.734198 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8ec7e4fa-c2a9-4a12-bdd8-ef6e042200b7 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:05.735130 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8ec7e4fa-c2a9-4a12-bdd8-ef6e042200b7 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:05.735789 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8ec7e4fa-c2a9-4a12-bdd8-ef6e042200b7 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:05.737236 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8ec7e4fa-c2a9-4a12-bdd8-ef6e042200b7 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:05.768174 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-8ec7e4fa-c2a9-4a12-bdd8-ef6e042200b7 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '7ec609246fd74d08a04e693343e6a569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba4a21f99f04c75977496fd544c628c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:05.770449 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8ec7e4fa-c2a9-4a12-bdd8-ef6e042200b7 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Request method failure captured: Aug 27 02:43:05.770449 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/1aa76851-fc87-44aa-97a1-5c01cc76e758/diagnostics HTTP/1.1 Aug 27 02:43:05.770449 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:43:05.770449 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:43:05.770449 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:43:05.770449 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:43:05.770449 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:43:05.770449 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:43:05.770449 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:43:05.770449 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:43:05.770449 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYSiYnQyrws8IMAfLU8CyyRRS3U_YLAWd4tuhoza267u-P6_0L8jmTeTVOBn4oAAbTZKdqv0AeYFygEzrD88ZDKoaysC9QCtdcz7MEEeJnScZr8L9E2Xtu8oyd8c_U2VQIcBdQc-ZgbZA0GSo4ZZEr_S7xWneJQyO3kYzFC0jKRvIkU Aug 27 02:43:05.770449 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:43:05.770449 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:43:05.770449 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:43:05.770449 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:43:05.770449 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:43:05.770449 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:43:05.770449 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 1ba4a21f99f04c75977496fd544c628c Aug 27 02:43:05.770449 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1521290106 Aug 27 02:43:05.770449 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:43:05.770449 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:43:05.771976 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/1ba4a21f99f04c75977496fd544c628c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_1ba4a21f99f04c75977496fd544c628c", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/1ba4a21f99f04c75977496fd544c628c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/1ba4a21f99f04c75977496fd544c628c"}]}] Aug 27 02:43:05.771976 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1521290106 Aug 27 02:43:05.771976 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 1ba4a21f99f04c75977496fd544c628c Aug 27 02:43:05.771976 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1521290106 Aug 27 02:43:05.771976 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ServerDiagnosticsNegativeTest-1521290106-project Aug 27 02:43:05.771976 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:43:05.771976 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:43:05.771976 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 7ec609246fd74d08a04e693343e6a569 Aug 27 02:43:05.771976 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1521290106-project Aug 27 02:43:05.771976 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 02:43:05.771976 n-d-852278-4 devstack@n-api.service[134051]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 27 02:43:05.772787 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'server_id': '1aa76851-fc87-44aa-97a1-5c01cc76e758'} Aug 27 02:43:05.772787 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:43:05.772787 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:43:05.772787 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:43:05.772787 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:43:05.772787 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:43:05.772787 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:43:05.772787 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:43:05.772787 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:43:05.772787 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Aug 27 02:43:05.772787 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Aug 27 02:43:05.772787 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 02:43:05.772787 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 02:43:05.772787 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 02:43:05.772787 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 02:43:05.772787 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 02:43:05.772787 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 02:43:05.772787 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 02:43:05.772787 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 02:43:05.772787 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 02:43:05.774208 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 02:43:05.774208 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 02:43:05.774208 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 02:43:05.774208 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 02:43:05.774208 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 02:43:05.774208 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 27 02:43:05.774208 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:43:05.774208 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:43:05.774208 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:43:05.774208 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:43:05.774208 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:43:05.774208 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:43:05.774208 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 02:43:05.774208 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 02:43:05.774208 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 27 02:43:05.774208 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:43:05.774208 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8ec7e4fa-c2a9-4a12-bdd8-ef6e042200b7 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:43:05.775649 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-8ec7e4fa-c2a9-4a12-bdd8-ef6e042200b7 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] 10.222.0.70 "GET /compute/v2.1/servers/1aa76851-fc87-44aa-97a1-5c01cc76e758/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.055784 Aug 27 02:43:05.775649 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 442/897] 10.222.0.70 () {58 vars in 1272 bytes} [Sat Aug 27 02:43:05 2022] GET /compute/v2.1/servers/1aa76851-fc87-44aa-97a1-5c01cc76e758/diagnostics => generated 117 bytes in 57 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:43:05.781991 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-380a2ce1-230a-4752-8f5f-71a2518524fa tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:05.782861 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-380a2ce1-230a-4752-8f5f-71a2518524fa tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] [instance: 3ee4d4db-a1bb-4567-a20d-29003e67a295] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:05.792607 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-380a2ce1-230a-4752-8f5f-71a2518524fa tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:05.793157 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-380a2ce1-230a-4752-8f5f-71a2518524fa tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:05.793596 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-380a2ce1-230a-4752-8f5f-71a2518524fa tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:05.794348 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-380a2ce1-230a-4752-8f5f-71a2518524fa tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:05.795023 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-380a2ce1-230a-4752-8f5f-71a2518524fa tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:05.795597 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-380a2ce1-230a-4752-8f5f-71a2518524fa tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:06.021032 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-2da76798-dae8-4d15-8751-27c8c714e8e4 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:06.037947 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-2da76798-dae8-4d15-8751-27c8c714e8e4 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:06.039513 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-2da76798-dae8-4d15-8751-27c8c714e8e4 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:06.044538 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-2da76798-dae8-4d15-8751-27c8c714e8e4 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/7eded9ca-c7bc-499a-bb53-a28d2c332402" status: 200 len: 1812 microversion: 2.25 time: 0.598524 Aug 27 02:43:06.061570 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 456/898] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:43:05 2022] GET /compute/v2.1/servers/7eded9ca-c7bc-499a-bb53-a28d2c332402 => generated 1812 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:43:06.061570 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f236816a-0d74-4897-9e77-a83f26100e72 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:06.061570 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-f236816a-0d74-4897-9e77-a83f26100e72 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] [instance: 1aa76851-fc87-44aa-97a1-5c01cc76e758] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:06.076857 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f236816a-0d74-4897-9e77-a83f26100e72 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:06.077593 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f236816a-0d74-4897-9e77-a83f26100e72 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:06.078650 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f236816a-0d74-4897-9e77-a83f26100e72 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:06.082245 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f236816a-0d74-4897-9e77-a83f26100e72 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:06.082831 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f236816a-0d74-4897-9e77-a83f26100e72 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:06.083381 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f236816a-0d74-4897-9e77-a83f26100e72 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:06.146504 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-f236816a-0d74-4897-9e77-a83f26100e72 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] [instance: 1aa76851-fc87-44aa-97a1-5c01cc76e758] Going to try to terminate instance {{(pid=134052) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:43:06.266077 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-380a2ce1-230a-4752-8f5f-71a2518524fa tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30abbf3afe304291981a6a9b85952aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c28ddbdb164f01bb82235c6d49717b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:06.282400 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-380a2ce1-230a-4752-8f5f-71a2518524fa tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] 10.222.0.70 "GET /compute/v2.1/servers/3ee4d4db-a1bb-4567-a20d-29003e67a295" status: 200 len: 1472 microversion: 2.1 time: 0.506459 Aug 27 02:43:06.286186 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 443/899] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:05 2022] GET /compute/v2.1/servers/3ee4d4db-a1bb-4567-a20d-29003e67a295 => generated 1472 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:06.316858 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-eb83d0f2-bba6-4f76-a18b-6eb37b0ae257 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-981642552", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "d6951e38-a1eb-49d7-a141-12a7a22c2fe4"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:43:06.338784 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f236816a-0d74-4897-9e77-a83f26100e72 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] 10.222.0.70 "DELETE /compute/v2.1/servers/1aa76851-fc87-44aa-97a1-5c01cc76e758" status: 204 len: 0 microversion: 2.1 time: 0.288888 Aug 27 02:43:06.340917 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 457/900] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:43:06 2022] DELETE /compute/v2.1/servers/1aa76851-fc87-44aa-97a1-5c01cc76e758 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:43:06.359375 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f1c7454f-aaa0-4f52-9e65-9aa661c317a0 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:06.360104 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-f1c7454f-aaa0-4f52-9e65-9aa661c317a0 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] [instance: 1aa76851-fc87-44aa-97a1-5c01cc76e758] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:06.379937 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f1c7454f-aaa0-4f52-9e65-9aa661c317a0 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:06.380872 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f1c7454f-aaa0-4f52-9e65-9aa661c317a0 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:06.381487 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f1c7454f-aaa0-4f52-9e65-9aa661c317a0 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:06.382466 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f1c7454f-aaa0-4f52-9e65-9aa661c317a0 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:06.383143 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f1c7454f-aaa0-4f52-9e65-9aa661c317a0 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:06.383741 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f1c7454f-aaa0-4f52-9e65-9aa661c317a0 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:06.407153 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.network.neutron [None req-eb83d0f2-bba6-4f76-a18b-6eb37b0ae257 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] validate_networks() for None {{(pid=134051) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:43:06.803382 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-f1c7454f-aaa0-4f52-9e65-9aa661c317a0 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec609246fd74d08a04e693343e6a569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba4a21f99f04c75977496fd544c628c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:06.822416 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f1c7454f-aaa0-4f52-9e65-9aa661c317a0 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] 10.222.0.70 "GET /compute/v2.1/servers/1aa76851-fc87-44aa-97a1-5c01cc76e758" status: 200 len: 1479 microversion: 2.1 time: 0.476055 Aug 27 02:43:06.825481 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 458/901] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:06 2022] GET /compute/v2.1/servers/1aa76851-fc87-44aa-97a1-5c01cc76e758 => generated 1479 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:06.828212 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-7a543cab-aec6-4dcc-961c-23243ac8b58a tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:06.829060 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-7a543cab-aec6-4dcc-961c-23243ac8b58a tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] [instance: 74d41279-27ab-492f-88ac-85f22b11b9ae] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:06.847311 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7a543cab-aec6-4dcc-961c-23243ac8b58a tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:06.848036 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7a543cab-aec6-4dcc-961c-23243ac8b58a tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:06.848698 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7a543cab-aec6-4dcc-961c-23243ac8b58a tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:06.849566 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7a543cab-aec6-4dcc-961c-23243ac8b58a tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:06.850170 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7a543cab-aec6-4dcc-961c-23243ac8b58a tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:06.850742 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7a543cab-aec6-4dcc-961c-23243ac8b58a tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:07.020154 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-7a543cab-aec6-4dcc-961c-23243ac8b58a tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9653dac89d2648b285fd71c1b349e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3ac0c66c5b4bc787d2d6e12a957099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:07.031860 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-7a543cab-aec6-4dcc-961c-23243ac8b58a tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] 10.222.0.70 "GET /compute/v2.1/servers/74d41279-27ab-492f-88ac-85f22b11b9ae" status: 200 len: 1610 microversion: 2.1 time: 0.207241 Aug 27 02:43:07.042098 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 459/902] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:06 2022] GET /compute/v2.1/servers/74d41279-27ab-492f-88ac-85f22b11b9ae => generated 1610 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:07.205502 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-eb83d0f2-bba6-4f76-a18b-6eb37b0ae257 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Flavor limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:43:07.206499 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-eb83d0f2-bba6-4f76-a18b-6eb37b0ae257 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Image limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:43:07.207337 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-eb83d0f2-bba6-4f76-a18b-6eb37b0ae257 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Flavor pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:43:07.210802 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-eb83d0f2-bba6-4f76-a18b-6eb37b0ae257 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Image pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:43:07.211460 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-eb83d0f2-bba6-4f76-a18b-6eb37b0ae257 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:43:07.269199 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a3d9ea33-3a5f-41c0-8f39-455771a5785d tempest-SecurityGroupRulesNegativeTestJSON-2027306543 tempest-SecurityGroupRulesNegativeTestJSON-2027306543-project] Action: 'create', calling method: .version_select at 0x7f5ee309a670>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1636496498", "description": "tempest-description-1402655373"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:43:07.284160 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eb83d0f2-bba6-4f76-a18b-6eb37b0ae257 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:07.284957 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eb83d0f2-bba6-4f76-a18b-6eb37b0ae257 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:07.285677 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eb83d0f2-bba6-4f76-a18b-6eb37b0ae257 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:07.286651 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eb83d0f2-bba6-4f76-a18b-6eb37b0ae257 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:07.287762 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eb83d0f2-bba6-4f76-a18b-6eb37b0ae257 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:07.290232 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eb83d0f2-bba6-4f76-a18b-6eb37b0ae257 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:07.315987 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-eb83d0f2-bba6-4f76-a18b-6eb37b0ae257 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Getting quotas for project b105816fd4e54b9da4973ff721e1fb92. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:43:07.323032 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-eb83d0f2-bba6-4f76-a18b-6eb37b0ae257 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Getting quotas for user eb6d1646ec094e3297f6f3c51dd72e85 and project b105816fd4e54b9da4973ff721e1fb92. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:43:07.338942 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-eb83d0f2-bba6-4f76-a18b-6eb37b0ae257 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Going to run 2 instances... {{(pid=134051) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:43:07.355899 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-eb83d0f2-bba6-4f76-a18b-6eb37b0ae257 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: 0ae31518-b08f-4255-a850-2b90b48ae7d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134051) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:43:07.405646 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-eb83d0f2-bba6-4f76-a18b-6eb37b0ae257 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=134051) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Aug 27 02:43:07.431996 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-eb83d0f2-bba6-4f76-a18b-6eb37b0ae257 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Getting quotas for project b105816fd4e54b9da4973ff721e1fb92. Resources: {'server_group_members'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:43:07.444045 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-eb83d0f2-bba6-4f76-a18b-6eb37b0ae257 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Getting quotas for user eb6d1646ec094e3297f6f3c51dd72e85 and project b105816fd4e54b9da4973ff721e1fb92. Resources: {'server_group_members'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:43:07.521933 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-eb83d0f2-bba6-4f76-a18b-6eb37b0ae257 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Getting quotas for project b105816fd4e54b9da4973ff721e1fb92. Resources: {'server_group_members'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:43:07.540028 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-eb83d0f2-bba6-4f76-a18b-6eb37b0ae257 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Getting quotas for user eb6d1646ec094e3297f6f3c51dd72e85 and project b105816fd4e54b9da4973ff721e1fb92. Resources: {'server_group_members'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:43:07.564018 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-eb83d0f2-bba6-4f76-a18b-6eb37b0ae257 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: 84d00bab-3efd-4f19-8f48-8c4b2fba864a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=0ae31518-b08f-4255-a850-2b90b48ae7d4,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134051) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:43:07.598880 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a3d9ea33-3a5f-41c0-8f39-455771a5785d tempest-SecurityGroupRulesNegativeTestJSON-2027306543 tempest-SecurityGroupRulesNegativeTestJSON-2027306543-project] 10.222.0.70 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.555343 Aug 27 02:43:07.607286 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 460/903] 10.222.0.70 () {60 vars in 1180 bytes} [Sat Aug 27 02:43:07 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:43:07.608531 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-1589dbe3-dc15-4518-bd5e-3ee455502802 req-2e01a185-d987-4636-bf79-a601aee469bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74d41279-27ab-492f-88ac-85f22b11b9ae", "name": "network-vif-deleted", "tag": "2a55b3f5-8bd4-452d-8257-6bd29ed05f0e"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:43:07.631272 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-1589dbe3-dc15-4518-bd5e-3ee455502802 req-2e01a185-d987-4636-bf79-a601aee469bd service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:07.633116 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-1589dbe3-dc15-4518-bd5e-3ee455502802 req-2e01a185-d987-4636-bf79-a601aee469bd service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:07.633644 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-1589dbe3-dc15-4518-bd5e-3ee455502802 req-2e01a185-d987-4636-bf79-a601aee469bd service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:07.649692 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-1589dbe3-dc15-4518-bd5e-3ee455502802 req-2e01a185-d987-4636-bf79-a601aee469bd service nova] Creating event network-vif-deleted:2a55b3f5-8bd4-452d-8257-6bd29ed05f0e for instance 74d41279-27ab-492f-88ac-85f22b11b9ae on n-h2-852278-4 Aug 27 02:43:07.656809 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-1589dbe3-dc15-4518-bd5e-3ee455502802 req-2e01a185-d987-4636-bf79-a601aee469bd service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054524 Aug 27 02:43:07.657809 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 461/904] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:43:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:43:07.667638 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8ecab590-29ed-48ab-a621-c3ccb767c426 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:07.668725 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-8ecab590-29ed-48ab-a621-c3ccb767c426 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: 7eded9ca-c7bc-499a-bb53-a28d2c332402] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:07.675612 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8ecab590-29ed-48ab-a621-c3ccb767c426 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:07.676503 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8ecab590-29ed-48ab-a621-c3ccb767c426 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:07.677161 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8ecab590-29ed-48ab-a621-c3ccb767c426 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:07.681252 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8ecab590-29ed-48ab-a621-c3ccb767c426 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:07.681948 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8ecab590-29ed-48ab-a621-c3ccb767c426 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:07.682530 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8ecab590-29ed-48ab-a621-c3ccb767c426 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:07.684457 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-eb83d0f2-bba6-4f76-a18b-6eb37b0ae257 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Getting quotas for project b105816fd4e54b9da4973ff721e1fb92. Resources: {'server_group_members'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:43:07.696797 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-eb83d0f2-bba6-4f76-a18b-6eb37b0ae257 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Getting quotas for user eb6d1646ec094e3297f6f3c51dd72e85 and project b105816fd4e54b9da4973ff721e1fb92. Resources: {'server_group_members'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:43:07.729962 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=94,nova_cell1:UPDATE=3 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:43:07.798337 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-eb83d0f2-bba6-4f76-a18b-6eb37b0ae257 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Getting quotas for project b105816fd4e54b9da4973ff721e1fb92. Resources: {'server_group_members'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:43:07.814241 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-eb83d0f2-bba6-4f76-a18b-6eb37b0ae257 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Getting quotas for user eb6d1646ec094e3297f6f3c51dd72e85 and project b105816fd4e54b9da4973ff721e1fb92. Resources: {'server_group_members'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:43:07.924067 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-eb83d0f2-bba6-4f76-a18b-6eb37b0ae257 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.625357 Aug 27 02:43:07.925025 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 444/905] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 02:43:06 2022] POST /compute/v2.1/servers => generated 32 bytes in 1638 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Aug 27 02:43:07.936715 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d90a3316-7a9c-4eca-a8b9-cd4ac6ef7dd3 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:07.937404 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d90a3316-7a9c-4eca-a8b9-cd4ac6ef7dd3 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] [instance: 3ee4d4db-a1bb-4567-a20d-29003e67a295] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:07.939280 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-8ecab590-29ed-48ab-a621-c3ccb767c426 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:07.946355 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d90a3316-7a9c-4eca-a8b9-cd4ac6ef7dd3 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:07.946867 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d90a3316-7a9c-4eca-a8b9-cd4ac6ef7dd3 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:07.947305 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d90a3316-7a9c-4eca-a8b9-cd4ac6ef7dd3 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:07.948025 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d90a3316-7a9c-4eca-a8b9-cd4ac6ef7dd3 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:07.948514 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d90a3316-7a9c-4eca-a8b9-cd4ac6ef7dd3 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:07.948934 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d90a3316-7a9c-4eca-a8b9-cd4ac6ef7dd3 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:07.957499 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=100 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:43:07.957653 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-8ecab590-29ed-48ab-a621-c3ccb767c426 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:07.958436 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-8ecab590-29ed-48ab-a621-c3ccb767c426 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:07.972498 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-8ecab590-29ed-48ab-a621-c3ccb767c426 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/7eded9ca-c7bc-499a-bb53-a28d2c332402" status: 200 len: 1812 microversion: 2.25 time: 0.296640 Aug 27 02:43:07.972498 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 462/906] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:43:07 2022] GET /compute/v2.1/servers/7eded9ca-c7bc-499a-bb53-a28d2c332402 => generated 1812 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:43:07.980021 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-154c0944-2614-4479-b9d0-ad9df698c264 req-1c24b6fd-ffa0-43b3-bd2f-deaea328c9b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74d41279-27ab-492f-88ac-85f22b11b9ae", "name": "network-vif-unplugged", "status": "completed", "tag": "c8e2f032-12c4-4c96-8d52-eafe91d1f3f2"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:43:07.990687 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-154c0944-2614-4479-b9d0-ad9df698c264 req-1c24b6fd-ffa0-43b3-bd2f-deaea328c9b0 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:07.993506 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-154c0944-2614-4479-b9d0-ad9df698c264 req-1c24b6fd-ffa0-43b3-bd2f-deaea328c9b0 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:07.994116 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-154c0944-2614-4479-b9d0-ad9df698c264 req-1c24b6fd-ffa0-43b3-bd2f-deaea328c9b0 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:08.025906 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-154c0944-2614-4479-b9d0-ad9df698c264 req-1c24b6fd-ffa0-43b3-bd2f-deaea328c9b0 service nova] Creating event network-vif-unplugged:c8e2f032-12c4-4c96-8d52-eafe91d1f3f2 for instance 74d41279-27ab-492f-88ac-85f22b11b9ae on n-h2-852278-4 Aug 27 02:43:08.038452 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-154c0944-2614-4479-b9d0-ad9df698c264 req-1c24b6fd-ffa0-43b3-bd2f-deaea328c9b0 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.076697 Aug 27 02:43:08.040285 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 463/907] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:43:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:43:08.048721 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-215db1e5-82aa-48e7-ab88-c93f217a080a tempest-SecurityGroupRulesNegativeTestJSON-2027306543 tempest-SecurityGroupRulesNegativeTestJSON-2027306543-project] Action: 'create', calling method: .version_select at 0x7f5ee30ee430>, body: {"security_group_rule": {"parent_group_id": "b8ba73fe-d50e-4b5c-90cf-da555d5da9da", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:43:08.231787 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d90a3316-7a9c-4eca-a8b9-cd4ac6ef7dd3 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30abbf3afe304291981a6a9b85952aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c28ddbdb164f01bb82235c6d49717b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:08.243945 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d90a3316-7a9c-4eca-a8b9-cd4ac6ef7dd3 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] 10.222.0.70 "GET /compute/v2.1/servers/3ee4d4db-a1bb-4567-a20d-29003e67a295" status: 200 len: 1478 microversion: 2.1 time: 0.317836 Aug 27 02:43:08.260688 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 445/908] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:07 2022] GET /compute/v2.1/servers/3ee4d4db-a1bb-4567-a20d-29003e67a295 => generated 1478 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:08.262714 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e16c23c0-bbb6-4ac6-80e7-c6af37a69a65 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:08.268624 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-e16c23c0-bbb6-4ac6-80e7-c6af37a69a65 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] [instance: 1aa76851-fc87-44aa-97a1-5c01cc76e758] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:08.292366 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e16c23c0-bbb6-4ac6-80e7-c6af37a69a65 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:08.297376 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e16c23c0-bbb6-4ac6-80e7-c6af37a69a65 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:08.297867 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e16c23c0-bbb6-4ac6-80e7-c6af37a69a65 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:08.302112 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e16c23c0-bbb6-4ac6-80e7-c6af37a69a65 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:08.306784 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e16c23c0-bbb6-4ac6-80e7-c6af37a69a65 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:08.307456 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e16c23c0-bbb6-4ac6-80e7-c6af37a69a65 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:08.917787 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e16c23c0-bbb6-4ac6-80e7-c6af37a69a65 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec609246fd74d08a04e693343e6a569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba4a21f99f04c75977496fd544c628c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:08.932132 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e16c23c0-bbb6-4ac6-80e7-c6af37a69a65 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] 10.222.0.70 "GET /compute/v2.1/servers/1aa76851-fc87-44aa-97a1-5c01cc76e758" status: 200 len: 1437 microversion: 2.1 time: 0.682616 Aug 27 02:43:08.934835 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 446/909] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:08 2022] GET /compute/v2.1/servers/1aa76851-fc87-44aa-97a1-5c01cc76e758 => generated 1437 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:08.941502 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e92089fc-ea92-4d2e-bbd5-6a185df8c0ff tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:08.947494 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e92089fc-ea92-4d2e-bbd5-6a185df8c0ff tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'eb6d1646ec094e3297f6f3c51dd72e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b105816fd4e54b9da4973ff721e1fb92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:08.958233 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-e92089fc-ea92-4d2e-bbd5-6a185df8c0ff tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Searching by: {'deleted': False, 'project_id': 'b105816fd4e54b9da4973ff721e1fb92'} {{(pid=134051) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 02:43:08.995401 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e92089fc-ea92-4d2e-bbd5-6a185df8c0ff tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:08.995898 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e92089fc-ea92-4d2e-bbd5-6a185df8c0ff tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:08.996708 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e92089fc-ea92-4d2e-bbd5-6a185df8c0ff tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:08.997148 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e92089fc-ea92-4d2e-bbd5-6a185df8c0ff tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:08.997965 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e92089fc-ea92-4d2e-bbd5-6a185df8c0ff tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:09.009327 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e92089fc-ea92-4d2e-bbd5-6a185df8c0ff tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:09.064424 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-215db1e5-82aa-48e7-ab88-c93f217a080a tempest-SecurityGroupRulesNegativeTestJSON-2027306543 tempest-SecurityGroupRulesNegativeTestJSON-2027306543-project] 10.222.0.70 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.022489 Aug 27 02:43:09.065194 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 464/910] 10.222.0.70 () {60 vars in 1195 bytes} [Sat Aug 27 02:43:08 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:43:09.076693 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e44074fe-b5bc-40d3-98e3-ff945ae9c5f0 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:09.076693 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-e44074fe-b5bc-40d3-98e3-ff945ae9c5f0 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] [instance: 74d41279-27ab-492f-88ac-85f22b11b9ae] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:09.101819 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e44074fe-b5bc-40d3-98e3-ff945ae9c5f0 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:09.102314 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e44074fe-b5bc-40d3-98e3-ff945ae9c5f0 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:09.102752 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e44074fe-b5bc-40d3-98e3-ff945ae9c5f0 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:09.103462 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e44074fe-b5bc-40d3-98e3-ff945ae9c5f0 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:09.103910 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e44074fe-b5bc-40d3-98e3-ff945ae9c5f0 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:09.105233 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e44074fe-b5bc-40d3-98e3-ff945ae9c5f0 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:09.186046 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e44074fe-b5bc-40d3-98e3-ff945ae9c5f0 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:09.194499 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e44074fe-b5bc-40d3-98e3-ff945ae9c5f0 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:09.195169 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e44074fe-b5bc-40d3-98e3-ff945ae9c5f0 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:09.195809 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.instance [None req-e44074fe-b5bc-40d3-98e3-ff945ae9c5f0 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lazy-loading 'fault' on Instance uuid 74d41279-27ab-492f-88ac-85f22b11b9ae {{(pid=134052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:43:09.282736 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.multi_cell_list [None req-e92089fc-ea92-4d2e-bbd5-6a185df8c0ff tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=134051) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 02:43:09.295808 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-e44074fe-b5bc-40d3-98e3-ff945ae9c5f0 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9653dac89d2648b285fd71c1b349e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3ac0c66c5b4bc787d2d6e12a957099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:09.304037 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e44074fe-b5bc-40d3-98e3-ff945ae9c5f0 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] 10.222.0.70 "GET /compute/v2.1/servers/74d41279-27ab-492f-88ac-85f22b11b9ae" status: 200 len: 1303 microversion: 2.1 time: 0.237564 Aug 27 02:43:09.308888 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 465/911] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:09 2022] GET /compute/v2.1/servers/74d41279-27ab-492f-88ac-85f22b11b9ae => generated 1303 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:09.314686 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9117bec5-0208-4a09-bfb2-e798f8abec15 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:09.325867 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-9117bec5-0208-4a09-bfb2-e798f8abec15 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: 7eded9ca-c7bc-499a-bb53-a28d2c332402] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:09.336336 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9117bec5-0208-4a09-bfb2-e798f8abec15 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:09.337037 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9117bec5-0208-4a09-bfb2-e798f8abec15 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:09.337439 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9117bec5-0208-4a09-bfb2-e798f8abec15 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:09.338145 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9117bec5-0208-4a09-bfb2-e798f8abec15 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:09.338593 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9117bec5-0208-4a09-bfb2-e798f8abec15 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:09.339011 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9117bec5-0208-4a09-bfb2-e798f8abec15 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:09.565154 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e92089fc-ea92-4d2e-bbd5-6a185df8c0ff tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "GET /compute/v2.1/servers" status: 200 len: 1002 microversion: 2.1 time: 0.626656 Aug 27 02:43:09.566747 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 447/912] 10.222.0.70 () {58 vars in 1125 bytes} [Sat Aug 27 02:43:08 2022] GET /compute/v2.1/servers => generated 1002 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:09.591838 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e6e734f6-7ef5-4dde-a55f-e54121c7e723 tempest-SecurityGroupRulesNegativeTestJSON-2027306543 tempest-SecurityGroupRulesNegativeTestJSON-2027306543-project] Action: 'create', calling method: .version_select at 0x7f5edf4260d0>, body: {"security_group_rule": {"parent_group_id": "b8ba73fe-d50e-4b5c-90cf-da555d5da9da", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:43:09.615582 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-9117bec5-0208-4a09-bfb2-e798f8abec15 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:09.625908 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-9117bec5-0208-4a09-bfb2-e798f8abec15 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:09.642378 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-9117bec5-0208-4a09-bfb2-e798f8abec15 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:09.643604 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9117bec5-0208-4a09-bfb2-e798f8abec15 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/7eded9ca-c7bc-499a-bb53-a28d2c332402" status: 200 len: 1812 microversion: 2.25 time: 0.332917 Aug 27 02:43:09.647649 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 466/913] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:43:09 2022] GET /compute/v2.1/servers/7eded9ca-c7bc-499a-bb53-a28d2c332402 => generated 1812 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:43:09.661300 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-0a2f1d16-78ce-44ce-a177-060cbf23f66a req-713334c9-fc6b-4838-8493-cf7ed9ad5b3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1aa76851-fc87-44aa-97a1-5c01cc76e758", "name": "network-vif-deleted", "tag": "dbf35e96-698c-4955-adc5-75c4ce70b202"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:43:09.691079 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-0a2f1d16-78ce-44ce-a177-060cbf23f66a req-713334c9-fc6b-4838-8493-cf7ed9ad5b3a service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:09.691566 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-0a2f1d16-78ce-44ce-a177-060cbf23f66a req-713334c9-fc6b-4838-8493-cf7ed9ad5b3a service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:09.692001 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-0a2f1d16-78ce-44ce-a177-060cbf23f66a req-713334c9-fc6b-4838-8493-cf7ed9ad5b3a service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:09.732029 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-0a2f1d16-78ce-44ce-a177-060cbf23f66a req-713334c9-fc6b-4838-8493-cf7ed9ad5b3a service nova] Creating event network-vif-deleted:dbf35e96-698c-4955-adc5-75c4ce70b202 for instance 1aa76851-fc87-44aa-97a1-5c01cc76e758 on n-h1-852278-4 Aug 27 02:43:09.744060 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-0a2f1d16-78ce-44ce-a177-060cbf23f66a req-713334c9-fc6b-4838-8493-cf7ed9ad5b3a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086288 Aug 27 02:43:09.744978 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 467/914] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:43:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:43:09.752939 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0a4b875d-4e02-4e48-aec0-308c7c872fd4 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:09.758855 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-0a4b875d-4e02-4e48-aec0-308c7c872fd4 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] [instance: 3ee4d4db-a1bb-4567-a20d-29003e67a295] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:09.759907 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-e6e734f6-7ef5-4dde-a55f-e54121c7e723 tempest-SecurityGroupRulesNegativeTestJSON-2027306543 tempest-SecurityGroupRulesNegativeTestJSON-2027306543-project] HTTP exception thrown: This rule already exists in group b8ba73fe-d50e-4b5c-90cf-da555d5da9da Aug 27 02:43:09.762326 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e6e734f6-7ef5-4dde-a55f-e54121c7e723 tempest-SecurityGroupRulesNegativeTestJSON-2027306543 tempest-SecurityGroupRulesNegativeTestJSON-2027306543-project] Request method failure captured: Aug 27 02:43:09.762326 n-d-852278-4 devstack@n-api.service[134051]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 27 02:43:09.762326 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:43:09.762326 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:43:09.762326 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:43:09.762326 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 138 Aug 27 02:43:09.762326 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:43:09.762326 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:43:09.762326 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:43:09.762326 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:43:09.762326 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYS63FkjjJHT4Ma02bMhrV4wosLl-wVTdANX4pwroXOPVlQb6HN_JPUFBY_SBpBrCVRrMsssrYGrCdjqTFyHB6J0C4l2R0ziMfUacYhe-4MF_KV9JyuqOR29jtm0rnlRealhwQCLhzMdUSXX5Vgg8pmbFw3TeAm8_mPHP6NmRmUlawQ Aug 27 02:43:09.762326 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:43:09.762326 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:43:09.762326 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:43:09.762326 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:43:09.762326 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:43:09.762326 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:43:09.762326 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: cd8c95d7eddf4a5dafd9883ad7da7409 Aug 27 02:43:09.762326 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-2027306543 Aug 27 02:43:09.762326 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:43:09.762326 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:43:09.763716 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cd8c95d7eddf4a5dafd9883ad7da7409"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_cd8c95d7eddf4a5dafd9883ad7da7409", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cd8c95d7eddf4a5dafd9883ad7da7409"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/cd8c95d7eddf4a5dafd9883ad7da7409"}]}] Aug 27 02:43:09.763716 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-2027306543 Aug 27 02:43:09.763716 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: cd8c95d7eddf4a5dafd9883ad7da7409 Aug 27 02:43:09.763716 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-2027306543 Aug 27 02:43:09.763716 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-2027306543-project Aug 27 02:43:09.763716 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:43:09.763716 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:43:09.763716 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 8a9b22562817432f8af0e7ec4130f928 Aug 27 02:43:09.763716 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-2027306543-project Aug 27 02:43:09.763716 n-d-852278-4 devstack@n-api.service[134051]: Aug 27 02:43:09.763716 n-d-852278-4 devstack@n-api.service[134051]: {"security_group_rule": {"parent_group_id": "b8ba73fe-d50e-4b5c-90cf-da555d5da9da", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 27 02:43:09.763716 n-d-852278-4 devstack@n-api.service[134051]: method: Aug 27 02:43:09.764505 n-d-852278-4 devstack@n-api.service[134051]: exception: This rule already exists in group b8ba73fe-d50e-4b5c-90cf-da555d5da9da Aug 27 02:43:09.764505 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'b8ba73fe-d50e-4b5c-90cf-da555d5da9da', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 27 02:43:09.764505 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:43:09.764505 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:43:09.764505 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Aug 27 02:43:09.764505 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Aug 27 02:43:09.764505 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Aug 27 02:43:09.764505 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Aug 27 02:43:09.764505 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group b8ba73fe-d50e-4b5c-90cf-da555d5da9da Aug 27 02:43:09.764505 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:43:09.764505 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:43:09.764505 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:43:09.764505 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:43:09.764505 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:43:09.764505 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:43:09.764505 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:43:09.764505 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:43:09.764505 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:43:09.764505 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:43:09.764505 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:43:09.765808 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:43:09.765808 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Aug 27 02:43:09.765808 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 27 02:43:09.765808 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group b8ba73fe-d50e-4b5c-90cf-da555d5da9da Aug 27 02:43:09.765808 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:43:09.765808 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:43:09.765808 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:43:09.765808 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:43:09.765808 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:43:09.765808 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:43:09.765808 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:43:09.765808 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:43:09.765808 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group b8ba73fe-d50e-4b5c-90cf-da555d5da9da Aug 27 02:43:09.765808 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:43:09.765808 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e6e734f6-7ef5-4dde-a55f-e54121c7e723 tempest-SecurityGroupRulesNegativeTestJSON-2027306543 tempest-SecurityGroupRulesNegativeTestJSON-2027306543-project] Returning 400 to user: This rule already exists in group b8ba73fe-d50e-4b5c-90cf-da555d5da9da {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:43:09.768141 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e6e734f6-7ef5-4dde-a55f-e54121c7e723 tempest-SecurityGroupRulesNegativeTestJSON-2027306543 tempest-SecurityGroupRulesNegativeTestJSON-2027306543-project] 10.222.0.70 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.196255 Aug 27 02:43:09.768141 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 448/915] 10.222.0.70 () {60 vars in 1195 bytes} [Sat Aug 27 02:43:09 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 197 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 02:43:09.773249 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-55f29718-64e0-43c6-a044-c281b072a456 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:09.773897 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-55f29718-64e0-43c6-a044-c281b072a456 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: 84d00bab-3efd-4f19-8f48-8c4b2fba864a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:09.774250 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0a4b875d-4e02-4e48-aec0-308c7c872fd4 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:09.774926 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0a4b875d-4e02-4e48-aec0-308c7c872fd4 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:09.775696 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0a4b875d-4e02-4e48-aec0-308c7c872fd4 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:09.776626 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0a4b875d-4e02-4e48-aec0-308c7c872fd4 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:09.777262 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0a4b875d-4e02-4e48-aec0-308c7c872fd4 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:09.777869 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0a4b875d-4e02-4e48-aec0-308c7c872fd4 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:09.799615 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:43:09.823306 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-55f29718-64e0-43c6-a044-c281b072a456 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:09.824118 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-55f29718-64e0-43c6-a044-c281b072a456 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:09.827572 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-55f29718-64e0-43c6-a044-c281b072a456 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:09.830050 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-55f29718-64e0-43c6-a044-c281b072a456 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:09.830747 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-55f29718-64e0-43c6-a044-c281b072a456 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:09.833078 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-55f29718-64e0-43c6-a044-c281b072a456 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:10.081773 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-55f29718-64e0-43c6-a044-c281b072a456 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6d1646ec094e3297f6f3c51dd72e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b105816fd4e54b9da4973ff721e1fb92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:10.097494 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-55f29718-64e0-43c6-a044-c281b072a456 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "GET /compute/v2.1/servers/84d00bab-3efd-4f19-8f48-8c4b2fba864a" status: 200 len: 1214 microversion: 2.1 time: 0.331589 Aug 27 02:43:10.098503 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 449/916] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:09 2022] GET /compute/v2.1/servers/84d00bab-3efd-4f19-8f48-8c4b2fba864a => generated 1214 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:10.106541 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-5bdc8ebf-29c2-46f8-a998-01fce8767cd6 req-da3463b7-ef0c-4aac-b2ac-776e3a2abb4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74d41279-27ab-492f-88ac-85f22b11b9ae", "name": "network-vif-deleted", "tag": "c8e2f032-12c4-4c96-8d52-eafe91d1f3f2"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:43:10.125153 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-5bdc8ebf-29c2-46f8-a998-01fce8767cd6 req-da3463b7-ef0c-4aac-b2ac-776e3a2abb4a service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:10.128726 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-5bdc8ebf-29c2-46f8-a998-01fce8767cd6 req-da3463b7-ef0c-4aac-b2ac-776e3a2abb4a service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:10.133049 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-5bdc8ebf-29c2-46f8-a998-01fce8767cd6 req-da3463b7-ef0c-4aac-b2ac-776e3a2abb4a service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:10.155394 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0a4b875d-4e02-4e48-aec0-308c7c872fd4 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30abbf3afe304291981a6a9b85952aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c28ddbdb164f01bb82235c6d49717b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:10.163432 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-0a4b875d-4e02-4e48-aec0-308c7c872fd4 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] 10.222.0.70 "GET /compute/v2.1/servers/3ee4d4db-a1bb-4567-a20d-29003e67a295" status: 200 len: 1478 microversion: 2.1 time: 0.417081 Aug 27 02:43:10.169533 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-5bdc8ebf-29c2-46f8-a998-01fce8767cd6 req-da3463b7-ef0c-4aac-b2ac-776e3a2abb4a service nova] Creating event network-vif-deleted:c8e2f032-12c4-4c96-8d52-eafe91d1f3f2 for instance 74d41279-27ab-492f-88ac-85f22b11b9ae on n-h2-852278-4 Aug 27 02:43:10.170060 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 468/917] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:09 2022] GET /compute/v2.1/servers/3ee4d4db-a1bb-4567-a20d-29003e67a295 => generated 1478 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:10.175039 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b41c050c-ade6-4991-a6f7-c60964b3a396 tempest-SecurityGroupRulesNegativeTestJSON-2027306543 tempest-SecurityGroupRulesNegativeTestJSON-2027306543-project] Calling method '.version_select at 0x7f5ee309ad30>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:10.183756 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-5bdc8ebf-29c2-46f8-a998-01fce8767cd6 req-da3463b7-ef0c-4aac-b2ac-776e3a2abb4a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079879 Aug 27 02:43:10.186809 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 450/918] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:43:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:43:10.211411 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-6cd8dd38-b5ac-4ab0-8b9e-52ad85eead65 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:10.213162 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-6cd8dd38-b5ac-4ab0-8b9e-52ad85eead65 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] [instance: 1aa76851-fc87-44aa-97a1-5c01cc76e758] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:10.228038 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6cd8dd38-b5ac-4ab0-8b9e-52ad85eead65 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:10.229994 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6cd8dd38-b5ac-4ab0-8b9e-52ad85eead65 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:10.231690 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6cd8dd38-b5ac-4ab0-8b9e-52ad85eead65 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:10.233010 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6cd8dd38-b5ac-4ab0-8b9e-52ad85eead65 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:10.235199 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6cd8dd38-b5ac-4ab0-8b9e-52ad85eead65 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:10.235987 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6cd8dd38-b5ac-4ab0-8b9e-52ad85eead65 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:10.319632 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6cd8dd38-b5ac-4ab0-8b9e-52ad85eead65 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:10.320234 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6cd8dd38-b5ac-4ab0-8b9e-52ad85eead65 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:10.323792 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6cd8dd38-b5ac-4ab0-8b9e-52ad85eead65 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:10.324917 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.objects.instance [None req-6cd8dd38-b5ac-4ab0-8b9e-52ad85eead65 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Lazy-loading 'fault' on Instance uuid 1aa76851-fc87-44aa-97a1-5c01cc76e758 {{(pid=134051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:43:10.437175 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-6cd8dd38-b5ac-4ab0-8b9e-52ad85eead65 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec609246fd74d08a04e693343e6a569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba4a21f99f04c75977496fd544c628c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:10.446161 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-6cd8dd38-b5ac-4ab0-8b9e-52ad85eead65 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] 10.222.0.70 "GET /compute/v2.1/servers/1aa76851-fc87-44aa-97a1-5c01cc76e758" status: 200 len: 1313 microversion: 2.1 time: 0.255809 Aug 27 02:43:10.446738 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 451/919] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:10 2022] GET /compute/v2.1/servers/1aa76851-fc87-44aa-97a1-5c01cc76e758 => generated 1313 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:10.455972 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-f57fa166-2882-4045-b990-a8df7efa0b14 req-ed9876d1-100f-4e24-976c-b9b8a5d4f323 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ee4d4db-a1bb-4567-a20d-29003e67a295", "name": "network-vif-unplugged", "status": "completed", "tag": "cb37d724-8fd4-499e-a131-e0d13d7b8f95"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:43:10.477207 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-f57fa166-2882-4045-b990-a8df7efa0b14 req-ed9876d1-100f-4e24-976c-b9b8a5d4f323 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:10.479266 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-f57fa166-2882-4045-b990-a8df7efa0b14 req-ed9876d1-100f-4e24-976c-b9b8a5d4f323 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:10.481305 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-f57fa166-2882-4045-b990-a8df7efa0b14 req-ed9876d1-100f-4e24-976c-b9b8a5d4f323 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:10.500019 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-f57fa166-2882-4045-b990-a8df7efa0b14 req-ed9876d1-100f-4e24-976c-b9b8a5d4f323 service nova] Creating event network-vif-unplugged:cb37d724-8fd4-499e-a131-e0d13d7b8f95 for instance 3ee4d4db-a1bb-4567-a20d-29003e67a295 on n-h2-852278-4 Aug 27 02:43:10.505708 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-f57fa166-2882-4045-b990-a8df7efa0b14 req-ed9876d1-100f-4e24-976c-b9b8a5d4f323 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055141 Aug 27 02:43:10.506697 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 452/920] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:43:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:43:10.508158 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-f57fa166-2882-4045-b990-a8df7efa0b14 req-ed9876d1-100f-4e24-976c-b9b8a5d4f323 service nova] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:10.509454 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-f57fa166-2882-4045-b990-a8df7efa0b14 req-ed9876d1-100f-4e24-976c-b9b8a5d4f323 service nova] 10.222.0.70 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001607 Aug 27 02:43:10.510022 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 453/921] 10.222.0.70 () {56 vars in 886 bytes} [Sat Aug 27 02:43:10 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 27 02:43:10.521068 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b41c050c-ade6-4991-a6f7-c60964b3a396 tempest-SecurityGroupRulesNegativeTestJSON-2027306543 tempest-SecurityGroupRulesNegativeTestJSON-2027306543-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-group-rules/327183ad-5660-42a0-a6b1-bf9959a5e79a" status: 202 len: 0 microversion: 2.1 time: 0.349833 Aug 27 02:43:10.526369 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 469/922] 10.222.0.70 () {58 vars in 1287 bytes} [Sat Aug 27 02:43:10 2022] DELETE /compute/v2.1/os-security-group-rules/327183ad-5660-42a0-a6b1-bf9959a5e79a => generated 0 bytes in 351 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:43:10.526648 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b24a751a-3e48-4ef6-8466-c87701090046 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:10.526648 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b24a751a-3e48-4ef6-8466-c87701090046 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] [instance: 74d41279-27ab-492f-88ac-85f22b11b9ae] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:10.531190 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5db1c073-aa2d-4204-9355-d1f0949b0159 tempest-SecurityGroupRulesNegativeTestJSON-2027306543 tempest-SecurityGroupRulesNegativeTestJSON-2027306543-project] Action: 'create', calling method: .version_select at 0x7f5ee30d3b80>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1964629240", "description": "tempest-description-802274684"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:43:10.535212 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b24a751a-3e48-4ef6-8466-c87701090046 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:10.535807 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b24a751a-3e48-4ef6-8466-c87701090046 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:10.536567 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b24a751a-3e48-4ef6-8466-c87701090046 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:10.538556 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b24a751a-3e48-4ef6-8466-c87701090046 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:10.539602 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b24a751a-3e48-4ef6-8466-c87701090046 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:10.540133 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b24a751a-3e48-4ef6-8466-c87701090046 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:10.574132 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-b24a751a-3e48-4ef6-8466-c87701090046 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] HTTP exception thrown: Instance 74d41279-27ab-492f-88ac-85f22b11b9ae could not be found. Aug 27 02:43:10.580813 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b24a751a-3e48-4ef6-8466-c87701090046 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Request method failure captured: Aug 27 02:43:10.580813 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/74d41279-27ab-492f-88ac-85f22b11b9ae HTTP/1.1 Aug 27 02:43:10.580813 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:43:10.580813 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:43:10.580813 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:43:10.580813 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:43:10.580813 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:43:10.580813 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:43:10.580813 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:43:10.580813 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:43:10.580813 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYSPKBSAK1RBsjO1oN1WggQRmMhpUngggs4TV2dXU8cbBDlW4DmT9rfqH5xamQYSsmI1WCKnfNA2wlGzcSHbeGNdrtQOH_6bp51ZZcFRJSifhxvJ93QGKsImv__aWsju5fdnOri3cIl7bCJ1EfIj-gEp6hjWPkd3cLreqiL4ImjG6yo Aug 27 02:43:10.580813 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:43:10.580813 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:43:10.580813 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:43:10.580813 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:43:10.580813 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:43:10.580813 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:43:10.580813 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: de3ac0c66c5b4bc787d2d6e12a957099 Aug 27 02:43:10.580813 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ServersTestMultiNic-264021201 Aug 27 02:43:10.580813 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:43:10.580813 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:43:10.582499 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/de3ac0c66c5b4bc787d2d6e12a957099"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_de3ac0c66c5b4bc787d2d6e12a957099", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/de3ac0c66c5b4bc787d2d6e12a957099"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/de3ac0c66c5b4bc787d2d6e12a957099"}]}] Aug 27 02:43:10.582499 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ServersTestMultiNic-264021201 Aug 27 02:43:10.582499 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: de3ac0c66c5b4bc787d2d6e12a957099 Aug 27 02:43:10.582499 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ServersTestMultiNic-264021201 Aug 27 02:43:10.582499 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ServersTestMultiNic-264021201-project Aug 27 02:43:10.582499 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:43:10.582499 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:43:10.582499 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 9653dac89d2648b285fd71c1b349e642 Aug 27 02:43:10.582499 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ServersTestMultiNic-264021201-project Aug 27 02:43:10.582499 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 02:43:10.582499 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance 74d41279-27ab-492f-88ac-85f22b11b9ae could not be found. Aug 27 02:43:10.582499 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '74d41279-27ab-492f-88ac-85f22b11b9ae'} Aug 27 02:43:10.583412 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:43:10.583412 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:43:10.583412 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:43:10.583412 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:43:10.583412 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:43:10.583412 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:43:10.583412 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:43:10.583412 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:43:10.583412 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:43:10.583412 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:43:10.583412 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74d41279-27ab-492f-88ac-85f22b11b9ae could not be found. Aug 27 02:43:10.583412 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:43:10.583412 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:43:10.583412 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:43:10.583412 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:43:10.583412 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:43:10.583412 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:43:10.583412 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:43:10.583412 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:43:10.583412 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:43:10.584952 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:43:10.584952 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:43:10.584952 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:43:10.584952 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:43:10.584952 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:43:10.584952 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:43:10.584952 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:43:10.584952 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74d41279-27ab-492f-88ac-85f22b11b9ae could not be found. Aug 27 02:43:10.584952 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:43:10.584952 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:43:10.584952 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:43:10.584952 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:43:10.584952 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:43:10.584952 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:43:10.584952 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:43:10.584952 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:43:10.584952 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74d41279-27ab-492f-88ac-85f22b11b9ae could not be found. Aug 27 02:43:10.584952 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:43:10.586196 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b24a751a-3e48-4ef6-8466-c87701090046 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Returning 404 to user: Instance 74d41279-27ab-492f-88ac-85f22b11b9ae could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:43:10.586196 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b24a751a-3e48-4ef6-8466-c87701090046 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] 10.222.0.70 "GET /compute/v2.1/servers/74d41279-27ab-492f-88ac-85f22b11b9ae" status: 404 len: 111 microversion: 2.1 time: 0.072337 Aug 27 02:43:10.586196 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 454/923] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:10 2022] GET /compute/v2.1/servers/74d41279-27ab-492f-88ac-85f22b11b9ae => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:43:10.677642 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-bacddff4-6a04-4dde-80c0-ce1ce2b91d62 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:10.679564 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-bacddff4-6a04-4dde-80c0-ce1ce2b91d62 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: 7eded9ca-c7bc-499a-bb53-a28d2c332402] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:10.701052 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bacddff4-6a04-4dde-80c0-ce1ce2b91d62 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:10.702845 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bacddff4-6a04-4dde-80c0-ce1ce2b91d62 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:10.704859 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bacddff4-6a04-4dde-80c0-ce1ce2b91d62 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:10.710096 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bacddff4-6a04-4dde-80c0-ce1ce2b91d62 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:10.712331 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bacddff4-6a04-4dde-80c0-ce1ce2b91d62 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:10.714843 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bacddff4-6a04-4dde-80c0-ce1ce2b91d62 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:10.949961 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-5db1c073-aa2d-4204-9355-d1f0949b0159 tempest-SecurityGroupRulesNegativeTestJSON-2027306543 tempest-SecurityGroupRulesNegativeTestJSON-2027306543-project] 10.222.0.70 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.422451 Aug 27 02:43:10.950942 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 470/924] 10.222.0.70 () {60 vars in 1180 bytes} [Sat Aug 27 02:43:10 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:43:10.964407 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-1c87424d-4bed-4756-afa0-052df7264c76 tempest-SecurityGroupRulesNegativeTestJSON-2027306543 tempest-SecurityGroupRulesNegativeTestJSON-2027306543-project] Action: 'create', calling method: .version_select at 0x7f5ee3159160>, body: {"security_group_rule": {"parent_group_id": "ea2691f7-a02d-42f7-ba50-e43e25fe99f6", "ip_protocol": "tcp", "from_port": 1715026720, "to_port": 22}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:43:11.300560 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-bacddff4-6a04-4dde-80c0-ce1ce2b91d62 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:11.312385 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-1c87424d-4bed-4756-afa0-052df7264c76 tempest-SecurityGroupRulesNegativeTestJSON-2027306543 tempest-SecurityGroupRulesNegativeTestJSON-2027306543-project] HTTP exception thrown: Invalid port range 1715026720:22. Former value cannot be greater than the later Aug 27 02:43:11.315519 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-bacddff4-6a04-4dde-80c0-ce1ce2b91d62 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:11.316996 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-bacddff4-6a04-4dde-80c0-ce1ce2b91d62 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:11.318180 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-bacddff4-6a04-4dde-80c0-ce1ce2b91d62 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/7eded9ca-c7bc-499a-bb53-a28d2c332402" status: 200 len: 1812 microversion: 2.25 time: 0.651929 Aug 27 02:43:11.321491 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 455/925] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:43:10 2022] GET /compute/v2.1/servers/7eded9ca-c7bc-499a-bb53-a28d2c332402 => generated 1812 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:43:11.338064 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-1c87424d-4bed-4756-afa0-052df7264c76 tempest-SecurityGroupRulesNegativeTestJSON-2027306543 tempest-SecurityGroupRulesNegativeTestJSON-2027306543-project] Request method failure captured: Aug 27 02:43:11.338064 n-d-852278-4 devstack@n-api.service[134052]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 27 02:43:11.338064 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:43:11.338064 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:43:11.338064 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:43:11.338064 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 146 Aug 27 02:43:11.338064 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:43:11.338064 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:43:11.338064 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:43:11.338064 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:43:11.338064 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYS63FkjjJHT4Ma02bMhrV4wosLl-wVTdANX4pwroXOPVlQb6HN_JPUFBY_SBpBrCVRrMsssrYGrCdjqTFyHB6J0C4l2R0ziMfUacYhe-4MF_KV9JyuqOR29jtm0rnlRealhwQCLhzMdUSXX5Vgg8pmbFw3TeAm8_mPHP6NmRmUlawQ Aug 27 02:43:11.338064 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:43:11.338064 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:43:11.338064 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:43:11.338064 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:43:11.338064 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:43:11.338064 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:43:11.338064 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: cd8c95d7eddf4a5dafd9883ad7da7409 Aug 27 02:43:11.338064 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-2027306543 Aug 27 02:43:11.338064 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:43:11.338064 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:43:11.339536 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cd8c95d7eddf4a5dafd9883ad7da7409"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_cd8c95d7eddf4a5dafd9883ad7da7409", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cd8c95d7eddf4a5dafd9883ad7da7409"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/cd8c95d7eddf4a5dafd9883ad7da7409"}]}] Aug 27 02:43:11.339536 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-2027306543 Aug 27 02:43:11.339536 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: cd8c95d7eddf4a5dafd9883ad7da7409 Aug 27 02:43:11.339536 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-2027306543 Aug 27 02:43:11.339536 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-2027306543-project Aug 27 02:43:11.339536 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:43:11.339536 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:43:11.339536 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 8a9b22562817432f8af0e7ec4130f928 Aug 27 02:43:11.339536 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-2027306543-project Aug 27 02:43:11.339536 n-d-852278-4 devstack@n-api.service[134052]: Aug 27 02:43:11.339536 n-d-852278-4 devstack@n-api.service[134052]: {"security_group_rule": {"parent_group_id": "ea2691f7-a02d-42f7-ba50-e43e25fe99f6", "ip_protocol": "tcp", "from_port": 1715026720, "to_port": 22}} Aug 27 02:43:11.339536 n-d-852278-4 devstack@n-api.service[134052]: method: Aug 27 02:43:11.340350 n-d-852278-4 devstack@n-api.service[134052]: exception: Invalid port range 1715026720:22. Former value cannot be greater than the later Aug 27 02:43:11.340350 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'ea2691f7-a02d-42f7-ba50-e43e25fe99f6', 'ip_protocol': 'tcp', 'from_port': 1715026720, 'to_port': 22}}} Aug 27 02:43:11.340350 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:43:11.340350 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:43:11.340350 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 27 02:43:11.340350 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 27 02:43:11.340350 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 27 02:43:11.340350 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 27 02:43:11.340350 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 27 02:43:11.340350 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 27 02:43:11.340350 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Aug 27 02:43:11.340350 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 27 02:43:11.340350 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 1715026720:22. Former value cannot be greater than the later Aug 27 02:43:11.340350 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:43:11.340350 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:43:11.340350 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:43:11.340350 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:43:11.340350 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:43:11.340350 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:43:11.341901 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:43:11.341901 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:43:11.341901 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:43:11.341901 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:43:11.341901 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:43:11.341901 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:43:11.341901 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 27 02:43:11.341901 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 27 02:43:11.341901 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 1715026720:22. Former value cannot be greater than the later Aug 27 02:43:11.341901 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:43:11.341901 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:43:11.341901 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:43:11.341901 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:43:11.341901 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:43:11.341901 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:43:11.341901 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:43:11.341901 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:43:11.341901 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 1715026720:22. Former value cannot be greater than the later Aug 27 02:43:11.341901 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:43:11.343338 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-1209f7d4-7b9b-45c3-b4b0-9ba1a793456d tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:11.343338 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-1209f7d4-7b9b-45c3-b4b0-9ba1a793456d tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: 84d00bab-3efd-4f19-8f48-8c4b2fba864a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:11.347111 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-1c87424d-4bed-4756-afa0-052df7264c76 tempest-SecurityGroupRulesNegativeTestJSON-2027306543 tempest-SecurityGroupRulesNegativeTestJSON-2027306543-project] Returning 400 to user: Invalid port range 1715026720:22. Former value cannot be greater than the later {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:43:11.348940 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-1c87424d-4bed-4756-afa0-052df7264c76 tempest-SecurityGroupRulesNegativeTestJSON-2027306543 tempest-SecurityGroupRulesNegativeTestJSON-2027306543-project] 10.222.0.70 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 123 microversion: 2.1 time: 0.389212 Aug 27 02:43:11.354246 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 471/926] 10.222.0.70 () {60 vars in 1195 bytes} [Sat Aug 27 02:43:10 2022] POST /compute/v2.1/os-security-group-rules => generated 123 bytes in 394 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 02:43:11.363435 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1209f7d4-7b9b-45c3-b4b0-9ba1a793456d tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:11.363703 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5358c128-1c50-4d5b-acde-6ca5fbd9c2d4 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:11.363934 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1209f7d4-7b9b-45c3-b4b0-9ba1a793456d tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:11.364394 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1209f7d4-7b9b-45c3-b4b0-9ba1a793456d tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:11.365113 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1209f7d4-7b9b-45c3-b4b0-9ba1a793456d tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:11.365568 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1209f7d4-7b9b-45c3-b4b0-9ba1a793456d tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:11.365714 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-5358c128-1c50-4d5b-acde-6ca5fbd9c2d4 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] [instance: 3ee4d4db-a1bb-4567-a20d-29003e67a295] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:11.365985 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1209f7d4-7b9b-45c3-b4b0-9ba1a793456d tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:11.375864 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5358c128-1c50-4d5b-acde-6ca5fbd9c2d4 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:11.377333 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5358c128-1c50-4d5b-acde-6ca5fbd9c2d4 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:11.378786 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5358c128-1c50-4d5b-acde-6ca5fbd9c2d4 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:11.380284 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5358c128-1c50-4d5b-acde-6ca5fbd9c2d4 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:11.381005 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5358c128-1c50-4d5b-acde-6ca5fbd9c2d4 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:11.382583 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5358c128-1c50-4d5b-acde-6ca5fbd9c2d4 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:11.628924 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-1209f7d4-7b9b-45c3-b4b0-9ba1a793456d tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6d1646ec094e3297f6f3c51dd72e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b105816fd4e54b9da4973ff721e1fb92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:11.638767 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-1209f7d4-7b9b-45c3-b4b0-9ba1a793456d tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "GET /compute/v2.1/servers/84d00bab-3efd-4f19-8f48-8c4b2fba864a" status: 200 len: 1278 microversion: 2.1 time: 0.315513 Aug 27 02:43:11.641238 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 456/927] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:11 2022] GET /compute/v2.1/servers/84d00bab-3efd-4f19-8f48-8c4b2fba864a => generated 1278 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:11.672993 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ba06d411-2779-4477-a51d-07fd5dc075ba tempest-SecurityGroupRulesNegativeTestJSON-2027306543 tempest-SecurityGroupRulesNegativeTestJSON-2027306543-project] Action: 'create', calling method: .version_select at 0x7f5edef5b160>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-818042303", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:43:11.679448 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-ba06d411-2779-4477-a51d-07fd5dc075ba tempest-SecurityGroupRulesNegativeTestJSON-2027306543 tempest-SecurityGroupRulesNegativeTestJSON-2027306543-project] HTTP exception thrown: Security group id should be uuid Aug 27 02:43:11.685899 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ba06d411-2779-4477-a51d-07fd5dc075ba tempest-SecurityGroupRulesNegativeTestJSON-2027306543 tempest-SecurityGroupRulesNegativeTestJSON-2027306543-project] Request method failure captured: Aug 27 02:43:11.685899 n-d-852278-4 devstack@n-api.service[134051]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 27 02:43:11.685899 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:43:11.685899 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:43:11.685899 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:43:11.685899 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 130 Aug 27 02:43:11.685899 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:43:11.685899 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:43:11.685899 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:43:11.685899 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:43:11.685899 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYS63FkjjJHT4Ma02bMhrV4wosLl-wVTdANX4pwroXOPVlQb6HN_JPUFBY_SBpBrCVRrMsssrYGrCdjqTFyHB6J0C4l2R0ziMfUacYhe-4MF_KV9JyuqOR29jtm0rnlRealhwQCLhzMdUSXX5Vgg8pmbFw3TeAm8_mPHP6NmRmUlawQ Aug 27 02:43:11.685899 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:43:11.685899 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:43:11.685899 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:43:11.685899 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:43:11.685899 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:43:11.685899 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:43:11.685899 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: cd8c95d7eddf4a5dafd9883ad7da7409 Aug 27 02:43:11.685899 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-2027306543 Aug 27 02:43:11.685899 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:43:11.685899 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:43:11.687613 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cd8c95d7eddf4a5dafd9883ad7da7409"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_cd8c95d7eddf4a5dafd9883ad7da7409", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cd8c95d7eddf4a5dafd9883ad7da7409"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/cd8c95d7eddf4a5dafd9883ad7da7409"}]}] Aug 27 02:43:11.687613 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-2027306543 Aug 27 02:43:11.687613 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: cd8c95d7eddf4a5dafd9883ad7da7409 Aug 27 02:43:11.687613 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-2027306543 Aug 27 02:43:11.687613 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-2027306543-project Aug 27 02:43:11.687613 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:43:11.687613 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:43:11.687613 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 8a9b22562817432f8af0e7ec4130f928 Aug 27 02:43:11.687613 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-2027306543-project Aug 27 02:43:11.687613 n-d-852278-4 devstack@n-api.service[134051]: Aug 27 02:43:11.687613 n-d-852278-4 devstack@n-api.service[134051]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-818042303", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 27 02:43:11.687613 n-d-852278-4 devstack@n-api.service[134051]: method: Aug 27 02:43:11.687613 n-d-852278-4 devstack@n-api.service[134051]: exception: Security group id should be uuid Aug 27 02:43:11.688482 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-818042303', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 27 02:43:11.688482 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:43:11.688482 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:43:11.688482 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Aug 27 02:43:11.688482 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Aug 27 02:43:11.688482 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Aug 27 02:43:11.688482 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Aug 27 02:43:11.688482 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Aug 27 02:43:11.688482 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:43:11.688482 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:43:11.688482 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:43:11.688482 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:43:11.688482 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:43:11.688482 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:43:11.688482 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:43:11.688482 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:43:11.688482 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:43:11.688482 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:43:11.688482 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:43:11.688482 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:43:11.689699 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 27 02:43:11.689699 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 27 02:43:11.689699 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Aug 27 02:43:11.689699 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:43:11.689699 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:43:11.689699 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:43:11.689699 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:43:11.689699 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:43:11.689699 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:43:11.689699 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:43:11.689699 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:43:11.689699 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Aug 27 02:43:11.689699 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:43:11.692428 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ba06d411-2779-4477-a51d-07fd5dc075ba tempest-SecurityGroupRulesNegativeTestJSON-2027306543 tempest-SecurityGroupRulesNegativeTestJSON-2027306543-project] Returning 400 to user: Security group id should be uuid {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:43:11.693521 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ba06d411-2779-4477-a51d-07fd5dc075ba tempest-SecurityGroupRulesNegativeTestJSON-2027306543 tempest-SecurityGroupRulesNegativeTestJSON-2027306543-project] 10.222.0.70 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.049886 Aug 27 02:43:11.697384 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 457/928] 10.222.0.70 () {60 vars in 1195 bytes} [Sat Aug 27 02:43:11 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 53 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 27 02:43:11.704374 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c7fec484-7129-4ebf-8a00-7b3a221239c5 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:11.705309 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-c7fec484-7129-4ebf-8a00-7b3a221239c5 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] [instance: 1aa76851-fc87-44aa-97a1-5c01cc76e758] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:11.722614 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c7fec484-7129-4ebf-8a00-7b3a221239c5 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:11.724896 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c7fec484-7129-4ebf-8a00-7b3a221239c5 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:11.725556 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c7fec484-7129-4ebf-8a00-7b3a221239c5 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:11.726897 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c7fec484-7129-4ebf-8a00-7b3a221239c5 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:11.727606 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c7fec484-7129-4ebf-8a00-7b3a221239c5 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:11.728190 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c7fec484-7129-4ebf-8a00-7b3a221239c5 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:11.755893 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-c7fec484-7129-4ebf-8a00-7b3a221239c5 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] HTTP exception thrown: Instance 1aa76851-fc87-44aa-97a1-5c01cc76e758 could not be found. Aug 27 02:43:11.759764 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c7fec484-7129-4ebf-8a00-7b3a221239c5 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Request method failure captured: Aug 27 02:43:11.759764 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/1aa76851-fc87-44aa-97a1-5c01cc76e758 HTTP/1.1 Aug 27 02:43:11.759764 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:43:11.759764 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:43:11.759764 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:43:11.759764 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:43:11.759764 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:43:11.759764 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:43:11.759764 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:43:11.759764 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:43:11.759764 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYSiYnQyrws8IMAfLU8CyyRRS3U_YLAWd4tuhoza267u-P6_0L8jmTeTVOBn4oAAbTZKdqv0AeYFygEzrD88ZDKoaysC9QCtdcz7MEEeJnScZr8L9E2Xtu8oyd8c_U2VQIcBdQc-ZgbZA0GSo4ZZEr_S7xWneJQyO3kYzFC0jKRvIkU Aug 27 02:43:11.759764 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:43:11.759764 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:43:11.759764 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:43:11.759764 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:43:11.759764 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:43:11.759764 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:43:11.759764 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 1ba4a21f99f04c75977496fd544c628c Aug 27 02:43:11.759764 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1521290106 Aug 27 02:43:11.759764 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:43:11.759764 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:43:11.761463 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/1ba4a21f99f04c75977496fd544c628c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_1ba4a21f99f04c75977496fd544c628c", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/1ba4a21f99f04c75977496fd544c628c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/1ba4a21f99f04c75977496fd544c628c"}]}] Aug 27 02:43:11.761463 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1521290106 Aug 27 02:43:11.761463 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 1ba4a21f99f04c75977496fd544c628c Aug 27 02:43:11.761463 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1521290106 Aug 27 02:43:11.761463 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ServerDiagnosticsNegativeTest-1521290106-project Aug 27 02:43:11.761463 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:43:11.761463 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:43:11.761463 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 7ec609246fd74d08a04e693343e6a569 Aug 27 02:43:11.761463 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1521290106-project Aug 27 02:43:11.761463 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 02:43:11.761463 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance 1aa76851-fc87-44aa-97a1-5c01cc76e758 could not be found. Aug 27 02:43:11.761463 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '1aa76851-fc87-44aa-97a1-5c01cc76e758'} Aug 27 02:43:11.762374 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:43:11.762374 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:43:11.762374 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:43:11.762374 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:43:11.762374 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:43:11.762374 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:43:11.762374 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:43:11.762374 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:43:11.762374 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:43:11.762374 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:43:11.762374 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1aa76851-fc87-44aa-97a1-5c01cc76e758 could not be found. Aug 27 02:43:11.762374 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:43:11.762374 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:43:11.762374 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:43:11.762374 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:43:11.762374 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:43:11.762374 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:43:11.762374 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:43:11.762374 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:43:11.762374 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:43:11.763916 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:43:11.763916 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:43:11.763916 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:43:11.763916 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:43:11.763916 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:43:11.763916 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:43:11.763916 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:43:11.763916 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1aa76851-fc87-44aa-97a1-5c01cc76e758 could not be found. Aug 27 02:43:11.763916 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:43:11.763916 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:43:11.763916 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:43:11.763916 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:43:11.763916 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:43:11.763916 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:43:11.763916 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:43:11.763916 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:43:11.763916 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1aa76851-fc87-44aa-97a1-5c01cc76e758 could not be found. Aug 27 02:43:11.763916 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:43:11.766457 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c7fec484-7129-4ebf-8a00-7b3a221239c5 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] Returning 404 to user: Instance 1aa76851-fc87-44aa-97a1-5c01cc76e758 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:43:11.767569 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c7fec484-7129-4ebf-8a00-7b3a221239c5 tempest-ServerDiagnosticsNegativeTest-1521290106 tempest-ServerDiagnosticsNegativeTest-1521290106-project] 10.222.0.70 "GET /compute/v2.1/servers/1aa76851-fc87-44aa-97a1-5c01cc76e758" status: 404 len: 111 microversion: 2.1 time: 0.068845 Aug 27 02:43:11.771978 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 458/929] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:11 2022] GET /compute/v2.1/servers/1aa76851-fc87-44aa-97a1-5c01cc76e758 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:43:11.794186 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8cf1a002-339b-4747-a21f-6f57fbf7fb54 tempest-SecurityGroupRulesNegativeTestJSON-2027306543 tempest-SecurityGroupRulesNegativeTestJSON-2027306543-project] Action: 'create', calling method: .version_select at 0x7f5edef7fdc0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1639305865", "description": "tempest-description-1023099677"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:43:12.022948 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-5358c128-1c50-4d5b-acde-6ca5fbd9c2d4 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30abbf3afe304291981a6a9b85952aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c28ddbdb164f01bb82235c6d49717b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:12.038452 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-5358c128-1c50-4d5b-acde-6ca5fbd9c2d4 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] 10.222.0.70 "GET /compute/v2.1/servers/3ee4d4db-a1bb-4567-a20d-29003e67a295" status: 200 len: 1478 microversion: 2.1 time: 0.680112 Aug 27 02:43:12.040631 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 472/930] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:11 2022] GET /compute/v2.1/servers/3ee4d4db-a1bb-4567-a20d-29003e67a295 => generated 1478 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:12.343217 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-2b3d241c-a85d-47fb-a8a5-cb17b518eacf tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:12.345027 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-2b3d241c-a85d-47fb-a8a5-cb17b518eacf tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: 7eded9ca-c7bc-499a-bb53-a28d2c332402] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:12.357026 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2b3d241c-a85d-47fb-a8a5-cb17b518eacf tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:12.363966 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2b3d241c-a85d-47fb-a8a5-cb17b518eacf tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:12.364903 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2b3d241c-a85d-47fb-a8a5-cb17b518eacf tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:12.366251 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2b3d241c-a85d-47fb-a8a5-cb17b518eacf tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:12.366961 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2b3d241c-a85d-47fb-a8a5-cb17b518eacf tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:12.367670 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2b3d241c-a85d-47fb-a8a5-cb17b518eacf tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:12.509804 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-8cf1a002-339b-4747-a21f-6f57fbf7fb54 tempest-SecurityGroupRulesNegativeTestJSON-2027306543 tempest-SecurityGroupRulesNegativeTestJSON-2027306543-project] 10.222.0.70 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.736412 Aug 27 02:43:12.510397 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 459/931] 10.222.0.70 () {60 vars in 1180 bytes} [Sat Aug 27 02:43:11 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:43:12.523769 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b7b24d70-8f90-473d-980a-c231d6fbc912 tempest-SecurityGroupRulesNegativeTestJSON-2027306543 tempest-SecurityGroupRulesNegativeTestJSON-2027306543-project] Action: 'create', calling method: .version_select at 0x7f5edef5baf0>, body: {"security_group_rule": {"parent_group_id": "faa7d27e-935f-4c9e-bfdc-26019b6cb388", "ip_protocol": "tempest-999-128559681", "from_port": 22, "to_port": 22}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:43:12.808023 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-b7b24d70-8f90-473d-980a-c231d6fbc912 tempest-SecurityGroupRulesNegativeTestJSON-2027306543 tempest-SecurityGroupRulesNegativeTestJSON-2027306543-project] HTTP exception thrown: Invalid IP protocol tempest-999-128559681. Aug 27 02:43:12.810510 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b7b24d70-8f90-473d-980a-c231d6fbc912 tempest-SecurityGroupRulesNegativeTestJSON-2027306543 tempest-SecurityGroupRulesNegativeTestJSON-2027306543-project] Request method failure captured: Aug 27 02:43:12.810510 n-d-852278-4 devstack@n-api.service[134051]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 27 02:43:12.810510 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:43:12.810510 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:43:12.810510 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:43:12.810510 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 156 Aug 27 02:43:12.810510 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:43:12.810510 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:43:12.810510 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:43:12.810510 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:43:12.810510 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYS63FkjjJHT4Ma02bMhrV4wosLl-wVTdANX4pwroXOPVlQb6HN_JPUFBY_SBpBrCVRrMsssrYGrCdjqTFyHB6J0C4l2R0ziMfUacYhe-4MF_KV9JyuqOR29jtm0rnlRealhwQCLhzMdUSXX5Vgg8pmbFw3TeAm8_mPHP6NmRmUlawQ Aug 27 02:43:12.810510 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:43:12.810510 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:43:12.810510 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:43:12.810510 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:43:12.810510 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:43:12.810510 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:43:12.810510 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: cd8c95d7eddf4a5dafd9883ad7da7409 Aug 27 02:43:12.810510 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-2027306543 Aug 27 02:43:12.810510 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:43:12.810510 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:43:12.812165 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cd8c95d7eddf4a5dafd9883ad7da7409"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_cd8c95d7eddf4a5dafd9883ad7da7409", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cd8c95d7eddf4a5dafd9883ad7da7409"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/cd8c95d7eddf4a5dafd9883ad7da7409"}]}] Aug 27 02:43:12.812165 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-2027306543 Aug 27 02:43:12.812165 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: cd8c95d7eddf4a5dafd9883ad7da7409 Aug 27 02:43:12.812165 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-2027306543 Aug 27 02:43:12.812165 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-2027306543-project Aug 27 02:43:12.812165 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:43:12.812165 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:43:12.812165 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 8a9b22562817432f8af0e7ec4130f928 Aug 27 02:43:12.812165 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-2027306543-project Aug 27 02:43:12.812165 n-d-852278-4 devstack@n-api.service[134051]: Aug 27 02:43:12.812165 n-d-852278-4 devstack@n-api.service[134051]: {"security_group_rule": {"parent_group_id": "faa7d27e-935f-4c9e-bfdc-26019b6cb388", "ip_protocol": "tempest-999-128559681", "from_port": 22, "to_port": 22}} Aug 27 02:43:12.812165 n-d-852278-4 devstack@n-api.service[134051]: method: Aug 27 02:43:12.814527 n-d-852278-4 devstack@n-api.service[134051]: exception: Invalid IP protocol tempest-999-128559681. Aug 27 02:43:12.814527 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'faa7d27e-935f-4c9e-bfdc-26019b6cb388', 'ip_protocol': 'tempest-999-128559681', 'from_port': 22, 'to_port': 22}}} Aug 27 02:43:12.814527 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:43:12.814527 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:43:12.814527 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 27 02:43:12.814527 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 27 02:43:12.814527 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 27 02:43:12.814527 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 27 02:43:12.814527 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 27 02:43:12.814527 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 27 02:43:12.814527 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Aug 27 02:43:12.814527 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Aug 27 02:43:12.814527 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-128559681. Aug 27 02:43:12.814527 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:43:12.814527 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:43:12.814527 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:43:12.814527 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:43:12.814527 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:43:12.814527 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:43:12.817885 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:43:12.817885 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:43:12.817885 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:43:12.817885 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:43:12.817885 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:43:12.817885 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:43:12.817885 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 27 02:43:12.817885 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 27 02:43:12.817885 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-128559681. Aug 27 02:43:12.817885 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:43:12.817885 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:43:12.817885 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:43:12.817885 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:43:12.817885 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:43:12.817885 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:43:12.817885 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:43:12.817885 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:43:12.817885 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-128559681. Aug 27 02:43:12.817885 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:43:12.819401 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b7b24d70-8f90-473d-980a-c231d6fbc912 tempest-SecurityGroupRulesNegativeTestJSON-2027306543 tempest-SecurityGroupRulesNegativeTestJSON-2027306543-project] Returning 400 to user: Invalid IP protocol tempest-999-128559681. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:43:12.819401 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b7b24d70-8f90-473d-980a-c231d6fbc912 tempest-SecurityGroupRulesNegativeTestJSON-2027306543 tempest-SecurityGroupRulesNegativeTestJSON-2027306543-project] 10.222.0.70 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 86 microversion: 2.1 time: 0.293245 Aug 27 02:43:12.819401 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 460/932] 10.222.0.70 () {60 vars in 1195 bytes} [Sat Aug 27 02:43:12 2022] POST /compute/v2.1/os-security-group-rules => generated 86 bytes in 300 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 27 02:43:12.833064 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0fcc7545-cb5f-42da-95d8-21049802beb1 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:12.833064 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-0fcc7545-cb5f-42da-95d8-21049802beb1 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: 84d00bab-3efd-4f19-8f48-8c4b2fba864a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:12.844260 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0fcc7545-cb5f-42da-95d8-21049802beb1 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:12.847646 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0fcc7545-cb5f-42da-95d8-21049802beb1 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:12.849448 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0fcc7545-cb5f-42da-95d8-21049802beb1 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:12.852622 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0fcc7545-cb5f-42da-95d8-21049802beb1 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:12.855306 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0fcc7545-cb5f-42da-95d8-21049802beb1 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:12.857262 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0fcc7545-cb5f-42da-95d8-21049802beb1 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:13.070463 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-2b3d241c-a85d-47fb-a8a5-cb17b518eacf tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:13.074049 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-0fcc7545-cb5f-42da-95d8-21049802beb1 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6d1646ec094e3297f6f3c51dd72e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b105816fd4e54b9da4973ff721e1fb92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:13.083566 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-0fcc7545-cb5f-42da-95d8-21049802beb1 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "GET /compute/v2.1/servers/84d00bab-3efd-4f19-8f48-8c4b2fba864a" status: 200 len: 1276 microversion: 2.1 time: 0.263929 Aug 27 02:43:13.084230 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-2b3d241c-a85d-47fb-a8a5-cb17b518eacf tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:13.084376 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 461/933] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:12 2022] GET /compute/v2.1/servers/84d00bab-3efd-4f19-8f48-8c4b2fba864a => generated 1276 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:13.101204 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4bef208a-6abc-43d3-b17d-0d9f482fb256 tempest-SecurityGroupRulesNegativeTestJSON-2027306543 tempest-SecurityGroupRulesNegativeTestJSON-2027306543-project] Action: 'create', calling method: .version_select at 0x7f5edef5b1f0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1824954277", "description": "tempest-description-1939312461"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:43:13.103590 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-2b3d241c-a85d-47fb-a8a5-cb17b518eacf tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:13.110929 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-2b3d241c-a85d-47fb-a8a5-cb17b518eacf tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/7eded9ca-c7bc-499a-bb53-a28d2c332402" status: 200 len: 1812 microversion: 2.25 time: 0.768046 Aug 27 02:43:13.130838 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 473/934] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:43:12 2022] GET /compute/v2.1/servers/7eded9ca-c7bc-499a-bb53-a28d2c332402 => generated 1812 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:43:13.140409 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4aa8a4cc-ebea-466a-9e20-e08ae54abd33 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:13.144168 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-4aa8a4cc-ebea-466a-9e20-e08ae54abd33 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] [instance: 3ee4d4db-a1bb-4567-a20d-29003e67a295] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:13.150994 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4aa8a4cc-ebea-466a-9e20-e08ae54abd33 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:13.151699 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4aa8a4cc-ebea-466a-9e20-e08ae54abd33 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:13.152332 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4aa8a4cc-ebea-466a-9e20-e08ae54abd33 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:13.153989 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4aa8a4cc-ebea-466a-9e20-e08ae54abd33 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:13.154444 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4aa8a4cc-ebea-466a-9e20-e08ae54abd33 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:13.154872 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4aa8a4cc-ebea-466a-9e20-e08ae54abd33 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:14.136755 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-4aa8a4cc-ebea-466a-9e20-e08ae54abd33 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30abbf3afe304291981a6a9b85952aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c28ddbdb164f01bb82235c6d49717b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:14.153970 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-4aa8a4cc-ebea-466a-9e20-e08ae54abd33 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] 10.222.0.70 "GET /compute/v2.1/servers/3ee4d4db-a1bb-4567-a20d-29003e67a295" status: 200 len: 1478 microversion: 2.1 time: 1.015755 Aug 27 02:43:14.156388 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 474/935] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:13 2022] GET /compute/v2.1/servers/3ee4d4db-a1bb-4567-a20d-29003e67a295 => generated 1478 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:14.175164 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-e4fa9a05-45d9-4ec8-a2d2-b816d0deddfb req-0678783b-e914-4b4f-997e-3446f9873b5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ee4d4db-a1bb-4567-a20d-29003e67a295", "name": "network-vif-plugged", "status": "completed", "tag": "cb37d724-8fd4-499e-a131-e0d13d7b8f95"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:43:14.211729 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-e4fa9a05-45d9-4ec8-a2d2-b816d0deddfb req-0678783b-e914-4b4f-997e-3446f9873b5c service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:14.215097 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-e4fa9a05-45d9-4ec8-a2d2-b816d0deddfb req-0678783b-e914-4b4f-997e-3446f9873b5c service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:14.217040 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-e4fa9a05-45d9-4ec8-a2d2-b816d0deddfb req-0678783b-e914-4b4f-997e-3446f9873b5c service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:14.264081 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-e4fa9a05-45d9-4ec8-a2d2-b816d0deddfb req-0678783b-e914-4b4f-997e-3446f9873b5c service nova] Creating event network-vif-plugged:cb37d724-8fd4-499e-a131-e0d13d7b8f95 for instance 3ee4d4db-a1bb-4567-a20d-29003e67a295 on n-h2-852278-4 Aug 27 02:43:14.287565 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-e4fa9a05-45d9-4ec8-a2d2-b816d0deddfb req-0678783b-e914-4b4f-997e-3446f9873b5c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127480 Aug 27 02:43:14.288517 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 475/936] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:43:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:43:14.295893 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-843fc882-0d5e-4600-a372-cb2cd69825b5 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:14.305490 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-843fc882-0d5e-4600-a372-cb2cd69825b5 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: 84d00bab-3efd-4f19-8f48-8c4b2fba864a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:14.336138 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-843fc882-0d5e-4600-a372-cb2cd69825b5 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:14.336791 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-843fc882-0d5e-4600-a372-cb2cd69825b5 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:14.337246 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-843fc882-0d5e-4600-a372-cb2cd69825b5 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:14.337993 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-843fc882-0d5e-4600-a372-cb2cd69825b5 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:14.338445 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-843fc882-0d5e-4600-a372-cb2cd69825b5 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:14.345287 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-843fc882-0d5e-4600-a372-cb2cd69825b5 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:14.365981 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-4bef208a-6abc-43d3-b17d-0d9f482fb256 tempest-SecurityGroupRulesNegativeTestJSON-2027306543 tempest-SecurityGroupRulesNegativeTestJSON-2027306543-project] 10.222.0.70 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 1.275159 Aug 27 02:43:14.367181 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 462/937] 10.222.0.70 () {60 vars in 1180 bytes} [Sat Aug 27 02:43:13 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:43:14.376480 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-83cfa28d-6acb-4f7f-ab5b-415ed32e9746 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:14.377482 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-83cfa28d-6acb-4f7f-ab5b-415ed32e9746 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: 7eded9ca-c7bc-499a-bb53-a28d2c332402] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:14.401645 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-83cfa28d-6acb-4f7f-ab5b-415ed32e9746 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:14.403628 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-83cfa28d-6acb-4f7f-ab5b-415ed32e9746 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:14.405439 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-83cfa28d-6acb-4f7f-ab5b-415ed32e9746 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:14.408469 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-83cfa28d-6acb-4f7f-ab5b-415ed32e9746 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:14.410216 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-83cfa28d-6acb-4f7f-ab5b-415ed32e9746 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:14.411407 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-83cfa28d-6acb-4f7f-ab5b-415ed32e9746 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:14.638899 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-843fc882-0d5e-4600-a372-cb2cd69825b5 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6d1646ec094e3297f6f3c51dd72e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b105816fd4e54b9da4973ff721e1fb92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:14.648990 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-843fc882-0d5e-4600-a372-cb2cd69825b5 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "GET /compute/v2.1/servers/84d00bab-3efd-4f19-8f48-8c4b2fba864a" status: 200 len: 1276 microversion: 2.1 time: 0.359226 Aug 27 02:43:14.669261 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 476/938] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:14 2022] GET /compute/v2.1/servers/84d00bab-3efd-4f19-8f48-8c4b2fba864a => generated 1276 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:14.674741 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9d3a6c14-b9f5-4e82-b4d0-909c9105ed11 tempest-SecurityGroupRulesNegativeTestJSON-2027306543 tempest-SecurityGroupRulesNegativeTestJSON-2027306543-project] Action: 'create', calling method: .version_select at 0x7f5ee309fb80>, body: {"security_group_rule": {"parent_group_id": "de55d4f0-99fe-425b-a8c7-b0fc63dc17ee", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:43:14.938789 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-9d3a6c14-b9f5-4e82-b4d0-909c9105ed11 tempest-SecurityGroupRulesNegativeTestJSON-2027306543 tempest-SecurityGroupRulesNegativeTestJSON-2027306543-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Aug 27 02:43:14.941556 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-83cfa28d-6acb-4f7f-ab5b-415ed32e9746 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:14.942747 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9d3a6c14-b9f5-4e82-b4d0-909c9105ed11 tempest-SecurityGroupRulesNegativeTestJSON-2027306543 tempest-SecurityGroupRulesNegativeTestJSON-2027306543-project] Request method failure captured: Aug 27 02:43:14.942747 n-d-852278-4 devstack@n-api.service[134052]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 27 02:43:14.942747 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:43:14.942747 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:43:14.942747 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:43:14.942747 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 138 Aug 27 02:43:14.942747 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:43:14.942747 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:43:14.942747 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:43:14.942747 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:43:14.942747 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYS63FkjjJHT4Ma02bMhrV4wosLl-wVTdANX4pwroXOPVlQb6HN_JPUFBY_SBpBrCVRrMsssrYGrCdjqTFyHB6J0C4l2R0ziMfUacYhe-4MF_KV9JyuqOR29jtm0rnlRealhwQCLhzMdUSXX5Vgg8pmbFw3TeAm8_mPHP6NmRmUlawQ Aug 27 02:43:14.942747 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:43:14.942747 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:43:14.942747 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:43:14.942747 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:43:14.942747 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:43:14.942747 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:43:14.942747 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: cd8c95d7eddf4a5dafd9883ad7da7409 Aug 27 02:43:14.942747 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-2027306543 Aug 27 02:43:14.942747 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:43:14.942747 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:43:14.944092 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cd8c95d7eddf4a5dafd9883ad7da7409"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_cd8c95d7eddf4a5dafd9883ad7da7409", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cd8c95d7eddf4a5dafd9883ad7da7409"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/cd8c95d7eddf4a5dafd9883ad7da7409"}]}] Aug 27 02:43:14.944092 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-2027306543 Aug 27 02:43:14.944092 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: cd8c95d7eddf4a5dafd9883ad7da7409 Aug 27 02:43:14.944092 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-2027306543 Aug 27 02:43:14.944092 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-2027306543-project Aug 27 02:43:14.944092 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:43:14.944092 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:43:14.944092 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 8a9b22562817432f8af0e7ec4130f928 Aug 27 02:43:14.944092 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-2027306543-project Aug 27 02:43:14.944092 n-d-852278-4 devstack@n-api.service[134052]: Aug 27 02:43:14.944092 n-d-852278-4 devstack@n-api.service[134052]: {"security_group_rule": {"parent_group_id": "de55d4f0-99fe-425b-a8c7-b0fc63dc17ee", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Aug 27 02:43:14.944092 n-d-852278-4 devstack@n-api.service[134052]: method: Aug 27 02:43:14.944989 n-d-852278-4 devstack@n-api.service[134052]: exception: Invalid port range 22:21. Former value cannot be greater than the later Aug 27 02:43:14.944989 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'de55d4f0-99fe-425b-a8c7-b0fc63dc17ee', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Aug 27 02:43:14.944989 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:43:14.944989 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:43:14.944989 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 27 02:43:14.944989 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 27 02:43:14.944989 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 27 02:43:14.944989 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 27 02:43:14.944989 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 27 02:43:14.944989 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 27 02:43:14.944989 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Aug 27 02:43:14.944989 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 27 02:43:14.944989 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Aug 27 02:43:14.944989 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:43:14.944989 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:43:14.944989 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:43:14.944989 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:43:14.944989 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:43:14.944989 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:43:14.950535 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:43:14.950535 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:43:14.950535 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:43:14.950535 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:43:14.950535 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:43:14.950535 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:43:14.950535 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 27 02:43:14.950535 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 27 02:43:14.950535 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Aug 27 02:43:14.950535 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:43:14.950535 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:43:14.950535 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:43:14.950535 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:43:14.950535 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:43:14.950535 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:43:14.950535 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:43:14.950535 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:43:14.950535 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Aug 27 02:43:14.950535 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:43:14.957442 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-83cfa28d-6acb-4f7f-ab5b-415ed32e9746 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:14.960135 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-83cfa28d-6acb-4f7f-ab5b-415ed32e9746 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:14.960501 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9d3a6c14-b9f5-4e82-b4d0-909c9105ed11 tempest-SecurityGroupRulesNegativeTestJSON-2027306543 tempest-SecurityGroupRulesNegativeTestJSON-2027306543-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:43:14.961351 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-83cfa28d-6acb-4f7f-ab5b-415ed32e9746 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/7eded9ca-c7bc-499a-bb53-a28d2c332402" status: 200 len: 1812 microversion: 2.25 time: 0.592811 Aug 27 02:43:14.963010 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9d3a6c14-b9f5-4e82-b4d0-909c9105ed11 tempest-SecurityGroupRulesNegativeTestJSON-2027306543 tempest-SecurityGroupRulesNegativeTestJSON-2027306543-project] 10.222.0.70 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.292127 Aug 27 02:43:14.965393 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 463/939] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:43:14 2022] GET /compute/v2.1/servers/7eded9ca-c7bc-499a-bb53-a28d2c332402 => generated 1812 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:43:14.969065 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 477/940] 10.222.0.70 () {60 vars in 1195 bytes} [Sat Aug 27 02:43:14 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 296 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 02:43:14.982846 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-5be0ae6a-5e32-4628-a155-3b8d9fe34d89 tempest-SecurityGroupRulesNegativeTestJSON-2027306543 tempest-SecurityGroupRulesNegativeTestJSON-2027306543-project] Action: 'create', calling method: .version_select at 0x7f5edef5b040>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-576276934", "description": "tempest-description-977915621"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:43:15.181225 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4005a2e3-33dd-4c9b-a642-4277af5d163f tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:15.182809 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-4005a2e3-33dd-4c9b-a642-4277af5d163f tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] [instance: 3ee4d4db-a1bb-4567-a20d-29003e67a295] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:15.196591 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4005a2e3-33dd-4c9b-a642-4277af5d163f tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:15.197543 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4005a2e3-33dd-4c9b-a642-4277af5d163f tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:15.199821 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4005a2e3-33dd-4c9b-a642-4277af5d163f tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:15.201025 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4005a2e3-33dd-4c9b-a642-4277af5d163f tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:15.203040 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4005a2e3-33dd-4c9b-a642-4277af5d163f tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:15.204000 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4005a2e3-33dd-4c9b-a642-4277af5d163f tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:15.363307 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-5be0ae6a-5e32-4628-a155-3b8d9fe34d89 tempest-SecurityGroupRulesNegativeTestJSON-2027306543 tempest-SecurityGroupRulesNegativeTestJSON-2027306543-project] 10.222.0.70 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.391263 Aug 27 02:43:15.363912 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 464/941] 10.222.0.70 () {60 vars in 1180 bytes} [Sat Aug 27 02:43:14 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:43:15.377184 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-234ef812-8b2f-4d9d-95ab-b06282e79396 tempest-SecurityGroupRulesNegativeTestJSON-2027306543 tempest-SecurityGroupRulesNegativeTestJSON-2027306543-project] Action: 'create', calling method: .version_select at 0x7f5edef51820>, body: {"security_group_rule": {"parent_group_id": "a6591ac4-76d3-4085-b8cf-0be7b544a8ff", "ip_protocol": "tcp", "from_port": 22, "to_port": 508591961}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:43:15.549521 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-234ef812-8b2f-4d9d-95ab-b06282e79396 tempest-SecurityGroupRulesNegativeTestJSON-2027306543 tempest-SecurityGroupRulesNegativeTestJSON-2027306543-project] HTTP exception thrown: Invalid port range 22:508591961. Valid TCP ports should be between 1-65535 Aug 27 02:43:15.551586 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-234ef812-8b2f-4d9d-95ab-b06282e79396 tempest-SecurityGroupRulesNegativeTestJSON-2027306543 tempest-SecurityGroupRulesNegativeTestJSON-2027306543-project] Request method failure captured: Aug 27 02:43:15.551586 n-d-852278-4 devstack@n-api.service[134051]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 27 02:43:15.551586 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:43:15.551586 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:43:15.551586 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:43:15.551586 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 145 Aug 27 02:43:15.551586 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:43:15.551586 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:43:15.551586 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:43:15.551586 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:43:15.551586 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYS63FkjjJHT4Ma02bMhrV4wosLl-wVTdANX4pwroXOPVlQb6HN_JPUFBY_SBpBrCVRrMsssrYGrCdjqTFyHB6J0C4l2R0ziMfUacYhe-4MF_KV9JyuqOR29jtm0rnlRealhwQCLhzMdUSXX5Vgg8pmbFw3TeAm8_mPHP6NmRmUlawQ Aug 27 02:43:15.551586 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:43:15.551586 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:43:15.551586 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:43:15.551586 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:43:15.551586 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:43:15.551586 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:43:15.551586 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: cd8c95d7eddf4a5dafd9883ad7da7409 Aug 27 02:43:15.551586 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-2027306543 Aug 27 02:43:15.551586 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:43:15.551586 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:43:15.553174 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cd8c95d7eddf4a5dafd9883ad7da7409"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_cd8c95d7eddf4a5dafd9883ad7da7409", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cd8c95d7eddf4a5dafd9883ad7da7409"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/cd8c95d7eddf4a5dafd9883ad7da7409"}]}] Aug 27 02:43:15.553174 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-2027306543 Aug 27 02:43:15.553174 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: cd8c95d7eddf4a5dafd9883ad7da7409 Aug 27 02:43:15.553174 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-2027306543 Aug 27 02:43:15.553174 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-2027306543-project Aug 27 02:43:15.553174 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:43:15.553174 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:43:15.553174 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 8a9b22562817432f8af0e7ec4130f928 Aug 27 02:43:15.553174 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-2027306543-project Aug 27 02:43:15.553174 n-d-852278-4 devstack@n-api.service[134051]: Aug 27 02:43:15.553174 n-d-852278-4 devstack@n-api.service[134051]: {"security_group_rule": {"parent_group_id": "a6591ac4-76d3-4085-b8cf-0be7b544a8ff", "ip_protocol": "tcp", "from_port": 22, "to_port": 508591961}} Aug 27 02:43:15.553174 n-d-852278-4 devstack@n-api.service[134051]: method: Aug 27 02:43:15.553948 n-d-852278-4 devstack@n-api.service[134051]: exception: Invalid port range 22:508591961. Valid TCP ports should be between 1-65535 Aug 27 02:43:15.553948 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'a6591ac4-76d3-4085-b8cf-0be7b544a8ff', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 508591961}}} Aug 27 02:43:15.553948 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:43:15.553948 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:43:15.553948 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 27 02:43:15.553948 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 27 02:43:15.553948 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 27 02:43:15.553948 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 27 02:43:15.553948 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 27 02:43:15.553948 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 27 02:43:15.553948 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Aug 27 02:43:15.553948 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 27 02:43:15.553948 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:508591961. Valid TCP ports should be between 1-65535 Aug 27 02:43:15.553948 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:43:15.553948 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:43:15.553948 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:43:15.553948 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:43:15.553948 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:43:15.553948 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:43:15.555097 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:43:15.555097 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:43:15.555097 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:43:15.555097 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:43:15.555097 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:43:15.555097 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:43:15.555097 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 27 02:43:15.555097 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 27 02:43:15.555097 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:508591961. Valid TCP ports should be between 1-65535 Aug 27 02:43:15.555097 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:43:15.555097 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:43:15.555097 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:43:15.555097 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:43:15.555097 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:43:15.555097 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:43:15.555097 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:43:15.555097 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:43:15.555097 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:508591961. Valid TCP ports should be between 1-65535 Aug 27 02:43:15.555097 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:43:15.559870 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-234ef812-8b2f-4d9d-95ab-b06282e79396 tempest-SecurityGroupRulesNegativeTestJSON-2027306543 tempest-SecurityGroupRulesNegativeTestJSON-2027306543-project] Returning 400 to user: Invalid port range 22:508591961. Valid TCP ports should be between 1-65535 {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:43:15.561076 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-234ef812-8b2f-4d9d-95ab-b06282e79396 tempest-SecurityGroupRulesNegativeTestJSON-2027306543 tempest-SecurityGroupRulesNegativeTestJSON-2027306543-project] 10.222.0.70 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 118 microversion: 2.1 time: 0.188548 Aug 27 02:43:15.567443 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 465/942] 10.222.0.70 () {60 vars in 1195 bytes} [Sat Aug 27 02:43:15 2022] POST /compute/v2.1/os-security-group-rules => generated 118 bytes in 193 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 27 02:43:15.574736 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-63638440-4236-43a8-af60-01b2e31a313c tempest-SecurityGroupRulesNegativeTestJSON-2027306543 tempest-SecurityGroupRulesNegativeTestJSON-2027306543-project] Action: 'create', calling method: .version_select at 0x7f5edef1b670>, body: {"security_group_rule": {"parent_group_id": "837c67ae-89af-40c9-958a-a195ff8aaf3d", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:43:15.585440 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-4005a2e3-33dd-4c9b-a642-4277af5d163f tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30abbf3afe304291981a6a9b85952aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c28ddbdb164f01bb82235c6d49717b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:15.597196 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-4005a2e3-33dd-4c9b-a642-4277af5d163f tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] 10.222.0.70 "GET /compute/v2.1/servers/3ee4d4db-a1bb-4567-a20d-29003e67a295" status: 200 len: 1478 microversion: 2.1 time: 0.422647 Aug 27 02:43:15.611674 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 478/943] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:15 2022] GET /compute/v2.1/servers/3ee4d4db-a1bb-4567-a20d-29003e67a295 => generated 1478 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:15.642324 n-d-852278-4 devstack@n-api.service[134051]: DEBUG neutronclient.v2_0.client [None req-63638440-4236-43a8-af60-01b2e31a313c tempest-SecurityGroupRulesNegativeTestJSON-2027306543 tempest-SecurityGroupRulesNegativeTestJSON-2027306543-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 837c67ae-89af-40c9-958a-a195ff8aaf3d does not exist", "detail": ""}} {{(pid=134051) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 02:43:15.642931 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.network.security_group_api [None req-63638440-4236-43a8-af60-01b2e31a313c tempest-SecurityGroupRulesNegativeTestJSON-2027306543 tempest-SecurityGroupRulesNegativeTestJSON-2027306543-project] Neutron security group 837c67ae-89af-40c9-958a-a195ff8aaf3d not found {{(pid=134051) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 27 02:43:15.644198 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-63638440-4236-43a8-af60-01b2e31a313c tempest-SecurityGroupRulesNegativeTestJSON-2027306543 tempest-SecurityGroupRulesNegativeTestJSON-2027306543-project] HTTP exception thrown: Security group 837c67ae-89af-40c9-958a-a195ff8aaf3d does not exist Aug 27 02:43:15.644198 n-d-852278-4 devstack@n-api.service[134051]: Neutron server returns request_ids: ['req-e38c1187-b0bd-41c0-b9eb-ead5e23c4891'] Aug 27 02:43:15.646485 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-63638440-4236-43a8-af60-01b2e31a313c tempest-SecurityGroupRulesNegativeTestJSON-2027306543 tempest-SecurityGroupRulesNegativeTestJSON-2027306543-project] Request method failure captured: Aug 27 02:43:15.646485 n-d-852278-4 devstack@n-api.service[134051]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 27 02:43:15.646485 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:43:15.646485 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:43:15.646485 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:43:15.646485 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 138 Aug 27 02:43:15.646485 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:43:15.646485 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:43:15.646485 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:43:15.646485 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:43:15.646485 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYS63FkjjJHT4Ma02bMhrV4wosLl-wVTdANX4pwroXOPVlQb6HN_JPUFBY_SBpBrCVRrMsssrYGrCdjqTFyHB6J0C4l2R0ziMfUacYhe-4MF_KV9JyuqOR29jtm0rnlRealhwQCLhzMdUSXX5Vgg8pmbFw3TeAm8_mPHP6NmRmUlawQ Aug 27 02:43:15.646485 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:43:15.646485 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:43:15.646485 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:43:15.646485 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:43:15.646485 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:43:15.646485 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:43:15.646485 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: cd8c95d7eddf4a5dafd9883ad7da7409 Aug 27 02:43:15.646485 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-2027306543 Aug 27 02:43:15.646485 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:43:15.646485 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:43:15.647794 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cd8c95d7eddf4a5dafd9883ad7da7409"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_cd8c95d7eddf4a5dafd9883ad7da7409", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cd8c95d7eddf4a5dafd9883ad7da7409"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/cd8c95d7eddf4a5dafd9883ad7da7409"}]}] Aug 27 02:43:15.647794 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-2027306543 Aug 27 02:43:15.647794 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: cd8c95d7eddf4a5dafd9883ad7da7409 Aug 27 02:43:15.647794 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-2027306543 Aug 27 02:43:15.647794 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-2027306543-project Aug 27 02:43:15.647794 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:43:15.647794 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:43:15.647794 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 8a9b22562817432f8af0e7ec4130f928 Aug 27 02:43:15.647794 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-2027306543-project Aug 27 02:43:15.647794 n-d-852278-4 devstack@n-api.service[134051]: Aug 27 02:43:15.647794 n-d-852278-4 devstack@n-api.service[134051]: {"security_group_rule": {"parent_group_id": "837c67ae-89af-40c9-958a-a195ff8aaf3d", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 27 02:43:15.647794 n-d-852278-4 devstack@n-api.service[134051]: method: Aug 27 02:43:15.653935 n-d-852278-4 devstack@n-api.service[134051]: exception: Security group 837c67ae-89af-40c9-958a-a195ff8aaf3d does not exist Aug 27 02:43:15.653935 n-d-852278-4 devstack@n-api.service[134051]: Neutron server returns request_ids: ['req-e38c1187-b0bd-41c0-b9eb-ead5e23c4891'] Aug 27 02:43:15.653935 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'body': {'security_group_rule': {'parent_group_id': '837c67ae-89af-40c9-958a-a195ff8aaf3d', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 27 02:43:15.653935 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:43:15.653935 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:43:15.653935 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 27 02:43:15.653935 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 27 02:43:15.653935 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:43:15.653935 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:43:15.653935 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 27 02:43:15.653935 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 27 02:43:15.653935 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:43:15.653935 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:43:15.653935 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 02:43:15.653935 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 02:43:15.653935 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:43:15.653935 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:43:15.653935 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 02:43:15.653935 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 02:43:15.655401 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:43:15.655401 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:43:15.655401 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 02:43:15.655401 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 02:43:15.655401 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:43:15.655401 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:43:15.655401 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 02:43:15.655401 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 02:43:15.655401 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 02:43:15.655401 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 02:43:15.655401 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 837c67ae-89af-40c9-958a-a195ff8aaf3d does not exist Aug 27 02:43:15.655401 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e38c1187-b0bd-41c0-b9eb-ead5e23c4891'] Aug 27 02:43:15.655401 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:43:15.655401 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:43:15.655401 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:43:15.655401 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:43:15.655401 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Aug 27 02:43:15.655401 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Aug 27 02:43:15.655401 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 27 02:43:15.656858 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 27 02:43:15.656858 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 837c67ae-89af-40c9-958a-a195ff8aaf3d does not exist Aug 27 02:43:15.656858 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e38c1187-b0bd-41c0-b9eb-ead5e23c4891'] Aug 27 02:43:15.656858 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:43:15.656858 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:43:15.656858 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:43:15.656858 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:43:15.656858 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:43:15.656858 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:43:15.656858 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:43:15.656858 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:43:15.656858 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:43:15.656858 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:43:15.656858 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:43:15.656858 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:43:15.656858 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Aug 27 02:43:15.656858 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 27 02:43:15.656858 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 837c67ae-89af-40c9-958a-a195ff8aaf3d does not exist Aug 27 02:43:15.656858 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e38c1187-b0bd-41c0-b9eb-ead5e23c4891'] Aug 27 02:43:15.656858 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:43:15.659029 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:43:15.659029 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:43:15.659029 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:43:15.659029 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:43:15.659029 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:43:15.659029 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:43:15.659029 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:43:15.659029 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 837c67ae-89af-40c9-958a-a195ff8aaf3d does not exist Aug 27 02:43:15.659029 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e38c1187-b0bd-41c0-b9eb-ead5e23c4891'] Aug 27 02:43:15.659029 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:43:15.659029 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-63638440-4236-43a8-af60-01b2e31a313c tempest-SecurityGroupRulesNegativeTestJSON-2027306543 tempest-SecurityGroupRulesNegativeTestJSON-2027306543-project] Returning 404 to user: Security group 837c67ae-89af-40c9-958a-a195ff8aaf3d does not exist Aug 27 02:43:15.659029 n-d-852278-4 devstack@n-api.service[134051]: Neutron server returns request_ids: ['req-e38c1187-b0bd-41c0-b9eb-ead5e23c4891'] {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:43:15.659029 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-63638440-4236-43a8-af60-01b2e31a313c tempest-SecurityGroupRulesNegativeTestJSON-2027306543 tempest-SecurityGroupRulesNegativeTestJSON-2027306543-project] 10.222.0.70 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.078482 Aug 27 02:43:15.659985 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 466/944] 10.222.0.70 () {60 vars in 1195 bytes} [Sat Aug 27 02:43:15 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:43:15.667208 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-1dbdf55b-817c-44b2-8f9d-7456e23055ff tempest-SecurityGroupRulesNegativeTestJSON-2027306543 tempest-SecurityGroupRulesNegativeTestJSON-2027306543-project] Calling method '.version_select at 0x7f5ee30c5a60>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:15.696631 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-70f29af3-9a48-42b3-a569-107a00f3e3bc tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:15.697380 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-70f29af3-9a48-42b3-a569-107a00f3e3bc tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: 84d00bab-3efd-4f19-8f48-8c4b2fba864a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:15.706539 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-70f29af3-9a48-42b3-a569-107a00f3e3bc tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:15.707116 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-70f29af3-9a48-42b3-a569-107a00f3e3bc tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:15.707607 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-70f29af3-9a48-42b3-a569-107a00f3e3bc tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:15.708582 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-70f29af3-9a48-42b3-a569-107a00f3e3bc tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:15.709030 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-70f29af3-9a48-42b3-a569-107a00f3e3bc tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:15.709448 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-70f29af3-9a48-42b3-a569-107a00f3e3bc tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:15.724754 n-d-852278-4 devstack@n-api.service[134052]: DEBUG neutronclient.v2_0.client [None req-1dbdf55b-817c-44b2-8f9d-7456e23055ff tempest-SecurityGroupRulesNegativeTestJSON-2027306543 tempest-SecurityGroupRulesNegativeTestJSON-2027306543-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule f1d93f0b-1e53-43db-87a4-4d143b6a797d does not exist", "detail": ""}} {{(pid=134052) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 02:43:15.725524 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.network.security_group_api [None req-1dbdf55b-817c-44b2-8f9d-7456e23055ff tempest-SecurityGroupRulesNegativeTestJSON-2027306543 tempest-SecurityGroupRulesNegativeTestJSON-2027306543-project] Neutron security group rule f1d93f0b-1e53-43db-87a4-4d143b6a797d not found {{(pid=134052) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Aug 27 02:43:15.726700 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-1dbdf55b-817c-44b2-8f9d-7456e23055ff tempest-SecurityGroupRulesNegativeTestJSON-2027306543 tempest-SecurityGroupRulesNegativeTestJSON-2027306543-project] HTTP exception thrown: Security group rule f1d93f0b-1e53-43db-87a4-4d143b6a797d does not exist Aug 27 02:43:15.726700 n-d-852278-4 devstack@n-api.service[134052]: Neutron server returns request_ids: ['req-7fa044a0-df97-40d5-b426-7652c2edfc66'] Aug 27 02:43:15.731274 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-1dbdf55b-817c-44b2-8f9d-7456e23055ff tempest-SecurityGroupRulesNegativeTestJSON-2027306543 tempest-SecurityGroupRulesNegativeTestJSON-2027306543-project] Request method failure captured: Aug 27 02:43:15.731274 n-d-852278-4 devstack@n-api.service[134052]: request: DELETE /compute/v2.1/os-security-group-rules/f1d93f0b-1e53-43db-87a4-4d143b6a797d HTTP/1.1 Aug 27 02:43:15.731274 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:43:15.731274 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:43:15.731274 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:43:15.731274 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:43:15.731274 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:43:15.731274 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:43:15.731274 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:43:15.731274 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:43:15.731274 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYS63FkjjJHT4Ma02bMhrV4wosLl-wVTdANX4pwroXOPVlQb6HN_JPUFBY_SBpBrCVRrMsssrYGrCdjqTFyHB6J0C4l2R0ziMfUacYhe-4MF_KV9JyuqOR29jtm0rnlRealhwQCLhzMdUSXX5Vgg8pmbFw3TeAm8_mPHP6NmRmUlawQ Aug 27 02:43:15.731274 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:43:15.731274 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:43:15.731274 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:43:15.731274 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:43:15.731274 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:43:15.731274 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:43:15.731274 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: cd8c95d7eddf4a5dafd9883ad7da7409 Aug 27 02:43:15.731274 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-2027306543 Aug 27 02:43:15.731274 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:43:15.731274 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:43:15.732934 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cd8c95d7eddf4a5dafd9883ad7da7409"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_cd8c95d7eddf4a5dafd9883ad7da7409", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cd8c95d7eddf4a5dafd9883ad7da7409"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/cd8c95d7eddf4a5dafd9883ad7da7409"}]}] Aug 27 02:43:15.732934 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-2027306543 Aug 27 02:43:15.732934 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: cd8c95d7eddf4a5dafd9883ad7da7409 Aug 27 02:43:15.732934 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-2027306543 Aug 27 02:43:15.732934 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-2027306543-project Aug 27 02:43:15.732934 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:43:15.732934 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:43:15.732934 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 8a9b22562817432f8af0e7ec4130f928 Aug 27 02:43:15.732934 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-2027306543-project Aug 27 02:43:15.732934 n-d-852278-4 devstack@n-api.service[134052]: method: Aug 27 02:43:15.732934 n-d-852278-4 devstack@n-api.service[134052]: exception: Security group rule f1d93f0b-1e53-43db-87a4-4d143b6a797d does not exist Aug 27 02:43:15.732934 n-d-852278-4 devstack@n-api.service[134052]: Neutron server returns request_ids: ['req-7fa044a0-df97-40d5-b426-7652c2edfc66'] Aug 27 02:43:15.733846 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': 'f1d93f0b-1e53-43db-87a4-4d143b6a797d'} Aug 27 02:43:15.733846 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:43:15.733846 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:43:15.733846 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Aug 27 02:43:15.733846 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Aug 27 02:43:15.733846 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:43:15.733846 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:43:15.733846 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1064, in show_security_group_rule Aug 27 02:43:15.733846 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Aug 27 02:43:15.733846 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:43:15.733846 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:43:15.733846 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 02:43:15.733846 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 02:43:15.733846 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:43:15.733846 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:43:15.733846 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 02:43:15.733846 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 02:43:15.733846 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:43:15.733846 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:43:15.735431 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 02:43:15.735431 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 02:43:15.735431 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:43:15.735431 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:43:15.735431 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 02:43:15.735431 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 02:43:15.735431 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 02:43:15.735431 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 02:43:15.735431 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule f1d93f0b-1e53-43db-87a4-4d143b6a797d does not exist Aug 27 02:43:15.735431 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7fa044a0-df97-40d5-b426-7652c2edfc66'] Aug 27 02:43:15.735431 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:43:15.735431 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:43:15.735431 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:43:15.735431 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:43:15.735431 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Aug 27 02:43:15.735431 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Aug 27 02:43:15.735431 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Aug 27 02:43:15.735431 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 27 02:43:15.736772 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule f1d93f0b-1e53-43db-87a4-4d143b6a797d does not exist Aug 27 02:43:15.736772 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7fa044a0-df97-40d5-b426-7652c2edfc66'] Aug 27 02:43:15.736772 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:43:15.736772 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:43:15.736772 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:43:15.736772 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:43:15.736772 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:43:15.736772 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:43:15.736772 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:43:15.736772 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:43:15.736772 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:43:15.736772 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:43:15.736772 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:43:15.736772 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:43:15.736772 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Aug 27 02:43:15.736772 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 27 02:43:15.736772 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule f1d93f0b-1e53-43db-87a4-4d143b6a797d does not exist Aug 27 02:43:15.736772 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7fa044a0-df97-40d5-b426-7652c2edfc66'] Aug 27 02:43:15.736772 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:43:15.736772 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:43:15.738225 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:43:15.738225 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:43:15.738225 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:43:15.738225 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:43:15.738225 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:43:15.738225 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:43:15.738225 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule f1d93f0b-1e53-43db-87a4-4d143b6a797d does not exist Aug 27 02:43:15.738225 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7fa044a0-df97-40d5-b426-7652c2edfc66'] Aug 27 02:43:15.738225 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:43:15.740230 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-1dbdf55b-817c-44b2-8f9d-7456e23055ff tempest-SecurityGroupRulesNegativeTestJSON-2027306543 tempest-SecurityGroupRulesNegativeTestJSON-2027306543-project] Returning 404 to user: Security group rule f1d93f0b-1e53-43db-87a4-4d143b6a797d does not exist Aug 27 02:43:15.740230 n-d-852278-4 devstack@n-api.service[134052]: Neutron server returns request_ids: ['req-7fa044a0-df97-40d5-b426-7652c2edfc66'] {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:43:15.741433 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-1dbdf55b-817c-44b2-8f9d-7456e23055ff tempest-SecurityGroupRulesNegativeTestJSON-2027306543 tempest-SecurityGroupRulesNegativeTestJSON-2027306543-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-group-rules/f1d93f0b-1e53-43db-87a4-4d143b6a797d" status: 404 len: 199 microversion: 2.1 time: 0.079766 Aug 27 02:43:15.746557 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 479/945] 10.222.0.70 () {58 vars in 1287 bytes} [Sat Aug 27 02:43:15 2022] DELETE /compute/v2.1/os-security-group-rules/f1d93f0b-1e53-43db-87a4-4d143b6a797d => generated 199 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:43:15.752630 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4a5fb922-5cc7-44bb-acb7-b221a9149cd1 tempest-SecurityGroupRulesNegativeTestJSON-2027306543 tempest-SecurityGroupRulesNegativeTestJSON-2027306543-project] Calling method '.version_select at 0x7f5ee2f7b310>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:16.106156 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-70f29af3-9a48-42b3-a569-107a00f3e3bc tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6d1646ec094e3297f6f3c51dd72e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b105816fd4e54b9da4973ff721e1fb92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:16.115757 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-70f29af3-9a48-42b3-a569-107a00f3e3bc tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "GET /compute/v2.1/servers/84d00bab-3efd-4f19-8f48-8c4b2fba864a" status: 200 len: 1318 microversion: 2.1 time: 0.443241 Aug 27 02:43:16.116410 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 467/946] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:15 2022] GET /compute/v2.1/servers/84d00bab-3efd-4f19-8f48-8c4b2fba864a => generated 1318 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:16.127732 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-96f0871d-3655-4476-96c4-bd6b67939927 req-a2c6daae-e378-4533-a1e2-771bf43da137 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ae31518-b08f-4255-a850-2b90b48ae7d4", "tag": "f5817098-1c90-4342-856e-1a55c19b7e1a"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:43:16.142375 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-96f0871d-3655-4476-96c4-bd6b67939927 req-a2c6daae-e378-4533-a1e2-771bf43da137 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:16.143124 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-96f0871d-3655-4476-96c4-bd6b67939927 req-a2c6daae-e378-4533-a1e2-771bf43da137 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:16.143704 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-96f0871d-3655-4476-96c4-bd6b67939927 req-a2c6daae-e378-4533-a1e2-771bf43da137 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:16.173440 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-96f0871d-3655-4476-96c4-bd6b67939927 req-a2c6daae-e378-4533-a1e2-771bf43da137 service nova] Creating event network-changed:f5817098-1c90-4342-856e-1a55c19b7e1a for instance 0ae31518-b08f-4255-a850-2b90b48ae7d4 on n-h2-852278-4 Aug 27 02:43:16.182661 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-96f0871d-3655-4476-96c4-bd6b67939927 req-a2c6daae-e378-4533-a1e2-771bf43da137 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060958 Aug 27 02:43:16.184017 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 468/947] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:43:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:43:16.207968 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-19eadc5d-7a14-4088-ab91-651e220c95a5 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:16.208864 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-19eadc5d-7a14-4088-ab91-651e220c95a5 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: 7eded9ca-c7bc-499a-bb53-a28d2c332402] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:16.219611 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-19eadc5d-7a14-4088-ab91-651e220c95a5 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:16.223546 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-19eadc5d-7a14-4088-ab91-651e220c95a5 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:16.228461 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-19eadc5d-7a14-4088-ab91-651e220c95a5 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:16.229553 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-19eadc5d-7a14-4088-ab91-651e220c95a5 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:16.230119 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-19eadc5d-7a14-4088-ab91-651e220c95a5 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:16.230628 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-19eadc5d-7a14-4088-ab91-651e220c95a5 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:16.616395 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-4a5fb922-5cc7-44bb-acb7-b221a9149cd1 tempest-SecurityGroupRulesNegativeTestJSON-2027306543 tempest-SecurityGroupRulesNegativeTestJSON-2027306543-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/a6591ac4-76d3-4085-b8cf-0be7b544a8ff" status: 202 len: 0 microversion: 2.1 time: 0.868486 Aug 27 02:43:16.616973 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 480/948] 10.222.0.70 () {58 vars in 1272 bytes} [Sat Aug 27 02:43:15 2022] DELETE /compute/v2.1/os-security-groups/a6591ac4-76d3-4085-b8cf-0be7b544a8ff => generated 0 bytes in 870 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:43:16.649366 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e9540e97-4fef-4ce5-99c9-3bced64388b7 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:16.650533 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-e9540e97-4fef-4ce5-99c9-3bced64388b7 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] [instance: 3ee4d4db-a1bb-4567-a20d-29003e67a295] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:16.682290 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e9540e97-4fef-4ce5-99c9-3bced64388b7 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:16.685613 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e9540e97-4fef-4ce5-99c9-3bced64388b7 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:16.686158 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e9540e97-4fef-4ce5-99c9-3bced64388b7 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:16.687081 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e9540e97-4fef-4ce5-99c9-3bced64388b7 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:16.687598 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e9540e97-4fef-4ce5-99c9-3bced64388b7 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:16.688031 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e9540e97-4fef-4ce5-99c9-3bced64388b7 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:16.694946 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-19eadc5d-7a14-4088-ab91-651e220c95a5 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:16.714594 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-19eadc5d-7a14-4088-ab91-651e220c95a5 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:16.721195 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-19eadc5d-7a14-4088-ab91-651e220c95a5 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:16.724687 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-19eadc5d-7a14-4088-ab91-651e220c95a5 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/7eded9ca-c7bc-499a-bb53-a28d2c332402" status: 200 len: 1812 microversion: 2.25 time: 0.525917 Aug 27 02:43:16.726694 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 469/949] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:43:16 2022] GET /compute/v2.1/servers/7eded9ca-c7bc-499a-bb53-a28d2c332402 => generated 1812 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:43:16.743341 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-435798ea-ed90-4e99-baa7-1f7cbe1241e8 tempest-SecurityGroupRulesNegativeTestJSON-2027306543 tempest-SecurityGroupRulesNegativeTestJSON-2027306543-project] Calling method '.version_select at 0x7f5edef1b790>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:17.323484 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-e9540e97-4fef-4ce5-99c9-3bced64388b7 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30abbf3afe304291981a6a9b85952aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c28ddbdb164f01bb82235c6d49717b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:17.341330 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e9540e97-4fef-4ce5-99c9-3bced64388b7 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] 10.222.0.70 "GET /compute/v2.1/servers/3ee4d4db-a1bb-4567-a20d-29003e67a295" status: 200 len: 1463 microversion: 2.1 time: 0.723056 Aug 27 02:43:17.356340 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 481/950] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:16 2022] GET /compute/v2.1/servers/3ee4d4db-a1bb-4567-a20d-29003e67a295 => generated 1463 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:17.362889 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-b25ab4c5-c4ad-4ea6-9e6a-cfa7c7b94e46 req-239e34d8-3a45-40a9-abea-47341c4bb3d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84d00bab-3efd-4f19-8f48-8c4b2fba864a", "tag": "205ec2a5-ab75-4573-8598-101ecb5de5df"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:43:17.390606 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-b25ab4c5-c4ad-4ea6-9e6a-cfa7c7b94e46 req-239e34d8-3a45-40a9-abea-47341c4bb3d3 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:17.392366 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-b25ab4c5-c4ad-4ea6-9e6a-cfa7c7b94e46 req-239e34d8-3a45-40a9-abea-47341c4bb3d3 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:17.393203 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-b25ab4c5-c4ad-4ea6-9e6a-cfa7c7b94e46 req-239e34d8-3a45-40a9-abea-47341c4bb3d3 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:17.442729 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-b25ab4c5-c4ad-4ea6-9e6a-cfa7c7b94e46 req-239e34d8-3a45-40a9-abea-47341c4bb3d3 service nova] Creating event network-changed:205ec2a5-ab75-4573-8598-101ecb5de5df for instance 84d00bab-3efd-4f19-8f48-8c4b2fba864a on n-h2-852278-4 Aug 27 02:43:17.455944 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-b25ab4c5-c4ad-4ea6-9e6a-cfa7c7b94e46 req-239e34d8-3a45-40a9-abea-47341c4bb3d3 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108776 Aug 27 02:43:17.459087 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 482/951] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:43:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:43:17.479843 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ff459663-4850-4493-98fd-6c11bbc078d7 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:17.483453 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-ff459663-4850-4493-98fd-6c11bbc078d7 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: 84d00bab-3efd-4f19-8f48-8c4b2fba864a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:17.492824 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ff459663-4850-4493-98fd-6c11bbc078d7 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:17.493805 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ff459663-4850-4493-98fd-6c11bbc078d7 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:17.499168 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ff459663-4850-4493-98fd-6c11bbc078d7 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:17.499325 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ff459663-4850-4493-98fd-6c11bbc078d7 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:17.499731 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ff459663-4850-4493-98fd-6c11bbc078d7 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:17.500168 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ff459663-4850-4493-98fd-6c11bbc078d7 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:17.842701 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=30 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:43:17.888011 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-435798ea-ed90-4e99-baa7-1f7cbe1241e8 tempest-SecurityGroupRulesNegativeTestJSON-2027306543 tempest-SecurityGroupRulesNegativeTestJSON-2027306543-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/de55d4f0-99fe-425b-a8c7-b0fc63dc17ee" status: 202 len: 0 microversion: 2.1 time: 1.158386 Aug 27 02:43:17.888641 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 470/952] 10.222.0.70 () {58 vars in 1272 bytes} [Sat Aug 27 02:43:16 2022] DELETE /compute/v2.1/os-security-groups/de55d4f0-99fe-425b-a8c7-b0fc63dc17ee => generated 0 bytes in 1160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:43:17.893486 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8a265783-bfd3-4eb2-828b-07754d58adc9 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:43:17.897012 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-8a265783-bfd3-4eb2-828b-07754d58adc9 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] [instance: 3ee4d4db-a1bb-4567-a20d-29003e67a295] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:17.910595 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8a265783-bfd3-4eb2-828b-07754d58adc9 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:17.913156 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8a265783-bfd3-4eb2-828b-07754d58adc9 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:17.914161 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8a265783-bfd3-4eb2-828b-07754d58adc9 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:17.917423 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8a265783-bfd3-4eb2-828b-07754d58adc9 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:17.918097 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8a265783-bfd3-4eb2-828b-07754d58adc9 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:17.922753 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8a265783-bfd3-4eb2-828b-07754d58adc9 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:17.962206 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-ff459663-4850-4493-98fd-6c11bbc078d7 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6d1646ec094e3297f6f3c51dd72e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b105816fd4e54b9da4973ff721e1fb92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:17.975559 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ff459663-4850-4493-98fd-6c11bbc078d7 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "GET /compute/v2.1/servers/84d00bab-3efd-4f19-8f48-8c4b2fba864a" status: 200 len: 1318 microversion: 2.1 time: 0.508272 Aug 27 02:43:17.976418 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 483/953] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:17 2022] GET /compute/v2.1/servers/84d00bab-3efd-4f19-8f48-8c4b2fba864a => generated 1318 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:17.982245 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0647a918-f0ea-4bc2-b9ba-430ec8b21c03 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:17.983074 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-0647a918-f0ea-4bc2-b9ba-430ec8b21c03 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: 7eded9ca-c7bc-499a-bb53-a28d2c332402] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:17.994097 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0647a918-f0ea-4bc2-b9ba-430ec8b21c03 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:17.995847 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0647a918-f0ea-4bc2-b9ba-430ec8b21c03 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:17.996500 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0647a918-f0ea-4bc2-b9ba-430ec8b21c03 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:17.997443 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0647a918-f0ea-4bc2-b9ba-430ec8b21c03 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:17.998038 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0647a918-f0ea-4bc2-b9ba-430ec8b21c03 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:17.998601 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0647a918-f0ea-4bc2-b9ba-430ec8b21c03 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:18.082692 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-8a265783-bfd3-4eb2-828b-07754d58adc9 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/3ee4d4db-a1bb-4567-a20d-29003e67a295/action" status: 202 len: 0 microversion: 2.1 time: 0.192776 Aug 27 02:43:18.083429 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 471/954] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 02:43:17 2022] POST /compute/v2.1/servers/3ee4d4db-a1bb-4567-a20d-29003e67a295/action => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:43:18.091273 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d6a228c1-869b-4146-b27b-b80fbbbafe2a tempest-SecurityGroupRulesNegativeTestJSON-2027306543 tempest-SecurityGroupRulesNegativeTestJSON-2027306543-project] Calling method '.version_select at 0x7f5edf0b74c0>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:18.188704 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0647a918-f0ea-4bc2-b9ba-430ec8b21c03 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:18.204643 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0647a918-f0ea-4bc2-b9ba-430ec8b21c03 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:18.208139 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0647a918-f0ea-4bc2-b9ba-430ec8b21c03 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:18.210272 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-0647a918-f0ea-4bc2-b9ba-430ec8b21c03 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/7eded9ca-c7bc-499a-bb53-a28d2c332402" status: 200 len: 1812 microversion: 2.25 time: 0.232551 Aug 27 02:43:18.217690 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 484/955] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:43:17 2022] GET /compute/v2.1/servers/7eded9ca-c7bc-499a-bb53-a28d2c332402 => generated 1812 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:43:18.242468 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9f12838c-ec73-4d14-bb6e-f0fc7e41f742 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:18.243376 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-9f12838c-ec73-4d14-bb6e-f0fc7e41f742 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] [instance: 3ee4d4db-a1bb-4567-a20d-29003e67a295] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:18.252480 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9f12838c-ec73-4d14-bb6e-f0fc7e41f742 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:18.257209 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9f12838c-ec73-4d14-bb6e-f0fc7e41f742 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:18.258400 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9f12838c-ec73-4d14-bb6e-f0fc7e41f742 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:18.259415 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9f12838c-ec73-4d14-bb6e-f0fc7e41f742 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:18.260071 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9f12838c-ec73-4d14-bb6e-f0fc7e41f742 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:18.260734 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9f12838c-ec73-4d14-bb6e-f0fc7e41f742 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:18.337597 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9f12838c-ec73-4d14-bb6e-f0fc7e41f742 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:18.337980 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9f12838c-ec73-4d14-bb6e-f0fc7e41f742 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:18.338610 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9f12838c-ec73-4d14-bb6e-f0fc7e41f742 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:18.339212 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.instance [None req-9f12838c-ec73-4d14-bb6e-f0fc7e41f742 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Lazy-loading 'fault' on Instance uuid 3ee4d4db-a1bb-4567-a20d-29003e67a295 {{(pid=134052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:43:18.609853 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d6a228c1-869b-4146-b27b-b80fbbbafe2a tempest-SecurityGroupRulesNegativeTestJSON-2027306543 tempest-SecurityGroupRulesNegativeTestJSON-2027306543-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/faa7d27e-935f-4c9e-bfdc-26019b6cb388" status: 202 len: 0 microversion: 2.1 time: 0.525315 Aug 27 02:43:18.611221 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 472/956] 10.222.0.70 () {58 vars in 1272 bytes} [Sat Aug 27 02:43:18 2022] DELETE /compute/v2.1/os-security-groups/faa7d27e-935f-4c9e-bfdc-26019b6cb388 => generated 0 bytes in 527 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:43:18.620528 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-10371c10-5338-4769-88c7-2bd732d8681a tempest-SecurityGroupRulesNegativeTestJSON-2027306543 tempest-SecurityGroupRulesNegativeTestJSON-2027306543-project] Calling method '.version_select at 0x7f5edef5bee0>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:18.653522 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9f12838c-ec73-4d14-bb6e-f0fc7e41f742 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/3ee4d4db-a1bb-4567-a20d-29003e67a295" status: 200 len: 1597 microversion: 2.1 time: 0.422467 Aug 27 02:43:18.656248 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 485/957] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:18 2022] GET /compute/v2.1/servers/3ee4d4db-a1bb-4567-a20d-29003e67a295 => generated 1597 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:18.678652 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d1b69293-2479-4e7c-8ccf-a5066237814f tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:43:18.689940 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d1b69293-2479-4e7c-8ccf-a5066237814f tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] [instance: 3ee4d4db-a1bb-4567-a20d-29003e67a295] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:18.712765 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d1b69293-2479-4e7c-8ccf-a5066237814f tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:18.713982 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d1b69293-2479-4e7c-8ccf-a5066237814f tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:18.716119 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d1b69293-2479-4e7c-8ccf-a5066237814f tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:18.717237 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d1b69293-2479-4e7c-8ccf-a5066237814f tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:18.721318 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d1b69293-2479-4e7c-8ccf-a5066237814f tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:18.721995 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d1b69293-2479-4e7c-8ccf-a5066237814f tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:18.868286 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:43:18.914061 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d1b69293-2479-4e7c-8ccf-a5066237814f tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/3ee4d4db-a1bb-4567-a20d-29003e67a295/action" status: 202 len: 0 microversion: 2.1 time: 0.239819 Aug 27 02:43:18.915177 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 486/958] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 02:43:18 2022] POST /compute/v2.1/servers/3ee4d4db-a1bb-4567-a20d-29003e67a295/action => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:43:18.928527 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d1eda0d9-747e-42b4-b78d-ed281660eb35 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:18.933180 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d1eda0d9-747e-42b4-b78d-ed281660eb35 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] [instance: 3ee4d4db-a1bb-4567-a20d-29003e67a295] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:18.941049 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d1eda0d9-747e-42b4-b78d-ed281660eb35 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:18.944977 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d1eda0d9-747e-42b4-b78d-ed281660eb35 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:18.945729 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d1eda0d9-747e-42b4-b78d-ed281660eb35 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:18.946652 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d1eda0d9-747e-42b4-b78d-ed281660eb35 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:18.947335 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d1eda0d9-747e-42b4-b78d-ed281660eb35 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:18.947945 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d1eda0d9-747e-42b4-b78d-ed281660eb35 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:18.979563 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-10371c10-5338-4769-88c7-2bd732d8681a tempest-SecurityGroupRulesNegativeTestJSON-2027306543 tempest-SecurityGroupRulesNegativeTestJSON-2027306543-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/ea2691f7-a02d-42f7-ba50-e43e25fe99f6" status: 202 len: 0 microversion: 2.1 time: 0.364074 Aug 27 02:43:18.980344 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 473/959] 10.222.0.70 () {58 vars in 1272 bytes} [Sat Aug 27 02:43:18 2022] DELETE /compute/v2.1/os-security-groups/ea2691f7-a02d-42f7-ba50-e43e25fe99f6 => generated 0 bytes in 365 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:43:19.145159 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d1eda0d9-747e-42b4-b78d-ed281660eb35 tempest-ServersAdminTestJSON-1989597414 tempest-ServersAdminTestJSON-1989597414-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/3ee4d4db-a1bb-4567-a20d-29003e67a295" status: 200 len: 1614 microversion: 2.1 time: 0.224782 Aug 27 02:43:19.148159 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 487/960] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:18 2022] GET /compute/v2.1/servers/3ee4d4db-a1bb-4567-a20d-29003e67a295 => generated 1614 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:19.149477 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=4 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:43:19.169873 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e31d43ba-ba6b-4c82-a160-217f07db2bf2 tempest-SecurityGroupRulesNegativeTestJSON-2027306543 tempest-SecurityGroupRulesNegativeTestJSON-2027306543-project] Calling method '.version_select at 0x7f5ee30f5670>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:19.245265 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b958422e-e209-403b-ab81-a744ac63f14e tempest-ServicesAdminNegativeTestJSON-482144179 tempest-ServicesAdminNegativeTestJSON-482144179-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:19.249796 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b958422e-e209-403b-ab81-a744ac63f14e tempest-ServicesAdminNegativeTestJSON-482144179 tempest-ServicesAdminNegativeTestJSON-482144179-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:19.250285 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b958422e-e209-403b-ab81-a744ac63f14e tempest-ServicesAdminNegativeTestJSON-482144179 tempest-ServicesAdminNegativeTestJSON-482144179-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:19.252165 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b958422e-e209-403b-ab81-a744ac63f14e tempest-ServicesAdminNegativeTestJSON-482144179 tempest-ServicesAdminNegativeTestJSON-482144179-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:19.253173 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b958422e-e209-403b-ab81-a744ac63f14e tempest-ServicesAdminNegativeTestJSON-482144179 tempest-ServicesAdminNegativeTestJSON-482144179-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:19.254288 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b958422e-e209-403b-ab81-a744ac63f14e tempest-ServicesAdminNegativeTestJSON-482144179 tempest-ServicesAdminNegativeTestJSON-482144179-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:19.254717 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b958422e-e209-403b-ab81-a744ac63f14e tempest-ServicesAdminNegativeTestJSON-482144179 tempest-ServicesAdminNegativeTestJSON-482144179-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:19.325140 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b958422e-e209-403b-ab81-a744ac63f14e tempest-ServicesAdminNegativeTestJSON-482144179 tempest-ServicesAdminNegativeTestJSON-482144179-project-admin] 10.222.0.70 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.341168 Aug 27 02:43:19.326927 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 474/961] 10.222.0.70 () {58 vars in 1137 bytes} [Sat Aug 27 02:43:18 2022] GET /compute/v2.1/os-services => generated 944 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:43:19.334853 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-25fa8ba2-8c08-49dd-a179-0a44fb68f886 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:19.335720 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-25fa8ba2-8c08-49dd-a179-0a44fb68f886 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: 84d00bab-3efd-4f19-8f48-8c4b2fba864a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:19.346501 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-25fa8ba2-8c08-49dd-a179-0a44fb68f886 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:19.348050 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-25fa8ba2-8c08-49dd-a179-0a44fb68f886 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:19.349672 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-25fa8ba2-8c08-49dd-a179-0a44fb68f886 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:19.350530 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-25fa8ba2-8c08-49dd-a179-0a44fb68f886 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:19.351508 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-25fa8ba2-8c08-49dd-a179-0a44fb68f886 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:19.353560 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-25fa8ba2-8c08-49dd-a179-0a44fb68f886 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:19.390113 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:43:19.471747 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e31d43ba-ba6b-4c82-a160-217f07db2bf2 tempest-SecurityGroupRulesNegativeTestJSON-2027306543 tempest-SecurityGroupRulesNegativeTestJSON-2027306543-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/b8ba73fe-d50e-4b5c-90cf-da555d5da9da" status: 202 len: 0 microversion: 2.1 time: 0.322325 Aug 27 02:43:19.475957 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 488/962] 10.222.0.70 () {58 vars in 1272 bytes} [Sat Aug 27 02:43:19 2022] DELETE /compute/v2.1/os-security-groups/b8ba73fe-d50e-4b5c-90cf-da555d5da9da => generated 0 bytes in 324 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:43:19.488083 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-bb4b7c53-732e-4e3f-9db6-bb237e4c9faa tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:19.488083 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-bb4b7c53-732e-4e3f-9db6-bb237e4c9faa tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] [instance: ccf87867-fb85-4b52-93f4-283450f636a4] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:19.501683 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bb4b7c53-732e-4e3f-9db6-bb237e4c9faa tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:19.502179 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bb4b7c53-732e-4e3f-9db6-bb237e4c9faa tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:19.502601 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bb4b7c53-732e-4e3f-9db6-bb237e4c9faa tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:19.503303 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bb4b7c53-732e-4e3f-9db6-bb237e4c9faa tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:19.503828 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bb4b7c53-732e-4e3f-9db6-bb237e4c9faa tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:19.513197 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bb4b7c53-732e-4e3f-9db6-bb237e4c9faa tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:19.568160 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-bb4b7c53-732e-4e3f-9db6-bb237e4c9faa tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] [instance: ccf87867-fb85-4b52-93f4-283450f636a4] Going to try to terminate instance {{(pid=134052) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:43:19.642428 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-25fa8ba2-8c08-49dd-a179-0a44fb68f886 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6d1646ec094e3297f6f3c51dd72e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b105816fd4e54b9da4973ff721e1fb92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:19.653444 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-25fa8ba2-8c08-49dd-a179-0a44fb68f886 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "GET /compute/v2.1/servers/84d00bab-3efd-4f19-8f48-8c4b2fba864a" status: 200 len: 1318 microversion: 2.1 time: 0.324040 Aug 27 02:43:19.654283 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 475/963] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:19 2022] GET /compute/v2.1/servers/84d00bab-3efd-4f19-8f48-8c4b2fba864a => generated 1318 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:19.669980 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-9acca199-271f-40c3-9044-799ab6f7f7ce tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:19.670602 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-9acca199-271f-40c3-9044-799ab6f7f7ce tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: 7eded9ca-c7bc-499a-bb53-a28d2c332402] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:19.678342 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9acca199-271f-40c3-9044-799ab6f7f7ce tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:19.678867 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9acca199-271f-40c3-9044-799ab6f7f7ce tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:19.679548 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9acca199-271f-40c3-9044-799ab6f7f7ce tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:19.684492 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9acca199-271f-40c3-9044-799ab6f7f7ce tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:19.686423 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9acca199-271f-40c3-9044-799ab6f7f7ce tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:19.687095 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9acca199-271f-40c3-9044-799ab6f7f7ce tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:19.720607 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-bb4b7c53-732e-4e3f-9db6-bb237e4c9faa tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] 10.222.0.70 "DELETE /compute/v2.1/servers/ccf87867-fb85-4b52-93f4-283450f636a4" status: 204 len: 0 microversion: 2.1 time: 0.243695 Aug 27 02:43:19.721422 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 489/964] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:43:19 2022] DELETE /compute/v2.1/servers/ccf87867-fb85-4b52-93f4-283450f636a4 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:43:19.727602 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a3bdb282-913c-4b04-b337-5e4a03dda129 tempest-ServicesAdminNegativeTestJSON-482144179 tempest-ServicesAdminNegativeTestJSON-482144179-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:19.731880 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a3bdb282-913c-4b04-b337-5e4a03dda129 tempest-ServicesAdminNegativeTestJSON-482144179 tempest-ServicesAdminNegativeTestJSON-482144179-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:19.733205 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a3bdb282-913c-4b04-b337-5e4a03dda129 tempest-ServicesAdminNegativeTestJSON-482144179 tempest-ServicesAdminNegativeTestJSON-482144179-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:19.734126 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a3bdb282-913c-4b04-b337-5e4a03dda129 tempest-ServicesAdminNegativeTestJSON-482144179 tempest-ServicesAdminNegativeTestJSON-482144179-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:19.735033 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a3bdb282-913c-4b04-b337-5e4a03dda129 tempest-ServicesAdminNegativeTestJSON-482144179 tempest-ServicesAdminNegativeTestJSON-482144179-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:19.735629 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a3bdb282-913c-4b04-b337-5e4a03dda129 tempest-ServicesAdminNegativeTestJSON-482144179 tempest-ServicesAdminNegativeTestJSON-482144179-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:19.736474 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a3bdb282-913c-4b04-b337-5e4a03dda129 tempest-ServicesAdminNegativeTestJSON-482144179 tempest-ServicesAdminNegativeTestJSON-482144179-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:19.753205 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:43:19.768998 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a3bdb282-913c-4b04-b337-5e4a03dda129 tempest-ServicesAdminNegativeTestJSON-482144179 tempest-ServicesAdminNegativeTestJSON-482144179-project-admin] 10.222.0.70 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.045927 Aug 27 02:43:19.769898 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 490/965] 10.222.0.70 () {58 vars in 1170 bytes} [Sat Aug 27 02:43:19 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 944 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:43:19.775946 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-277fdef7-1483-4a7b-8f7b-c78bbc15fd9a tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1469946939", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "networks": [{"uuid": "0864633e-8095-4abe-9831-60b636d1f344"}, {"uuid": "5a2f4e34-1df7-44ec-977e-11da27dc8875"}]}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:43:19.840228 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.network.neutron [None req-277fdef7-1483-4a7b-8f7b-c78bbc15fd9a tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] validate_networks() for [('0864633e-8095-4abe-9831-60b636d1f344', None, None, None, None, None), ('5a2f4e34-1df7-44ec-977e-11da27dc8875', None, None, None, None, None)] {{(pid=134052) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:43:19.979599 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-9acca199-271f-40c3-9044-799ab6f7f7ce tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:19.991286 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-9acca199-271f-40c3-9044-799ab6f7f7ce tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:19.993865 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-9acca199-271f-40c3-9044-799ab6f7f7ce tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:19.995651 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-9acca199-271f-40c3-9044-799ab6f7f7ce tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/7eded9ca-c7bc-499a-bb53-a28d2c332402" status: 200 len: 1812 microversion: 2.25 time: 0.331192 Aug 27 02:43:19.996736 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 476/966] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:43:19 2022] GET /compute/v2.1/servers/7eded9ca-c7bc-499a-bb53-a28d2c332402 => generated 1812 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:43:20.023497 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-bce46763-98d1-4d7b-b989-33c29f57ef92 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:20.025216 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-bce46763-98d1-4d7b-b989-33c29f57ef92 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] [instance: ccf87867-fb85-4b52-93f4-283450f636a4] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:20.042638 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bce46763-98d1-4d7b-b989-33c29f57ef92 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:20.043654 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bce46763-98d1-4d7b-b989-33c29f57ef92 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:20.044783 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bce46763-98d1-4d7b-b989-33c29f57ef92 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:20.046293 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bce46763-98d1-4d7b-b989-33c29f57ef92 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:20.047372 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bce46763-98d1-4d7b-b989-33c29f57ef92 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:20.048359 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bce46763-98d1-4d7b-b989-33c29f57ef92 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:20.722634 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-bce46763-98d1-4d7b-b989-33c29f57ef92 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30abbf3afe304291981a6a9b85952aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c28ddbdb164f01bb82235c6d49717b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:20.737672 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-bce46763-98d1-4d7b-b989-33c29f57ef92 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] 10.222.0.70 "GET /compute/v2.1/servers/ccf87867-fb85-4b52-93f4-283450f636a4" status: 200 len: 1469 microversion: 2.1 time: 0.739596 Aug 27 02:43:20.740770 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 477/967] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:19 2022] GET /compute/v2.1/servers/ccf87867-fb85-4b52-93f4-283450f636a4 => generated 1469 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:20.746687 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-1222cc2a-893f-40b1-8a24-8956aa865a78 tempest-ServicesAdminNegativeTestJSON-482144179 tempest-ServicesAdminNegativeTestJSON-482144179-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:20.753698 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1222cc2a-893f-40b1-8a24-8956aa865a78 tempest-ServicesAdminNegativeTestJSON-482144179 tempest-ServicesAdminNegativeTestJSON-482144179-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:20.754412 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1222cc2a-893f-40b1-8a24-8956aa865a78 tempest-ServicesAdminNegativeTestJSON-482144179 tempest-ServicesAdminNegativeTestJSON-482144179-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:20.755210 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1222cc2a-893f-40b1-8a24-8956aa865a78 tempest-ServicesAdminNegativeTestJSON-482144179 tempest-ServicesAdminNegativeTestJSON-482144179-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:20.757456 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1222cc2a-893f-40b1-8a24-8956aa865a78 tempest-ServicesAdminNegativeTestJSON-482144179 tempest-ServicesAdminNegativeTestJSON-482144179-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:20.759482 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1222cc2a-893f-40b1-8a24-8956aa865a78 tempest-ServicesAdminNegativeTestJSON-482144179 tempest-ServicesAdminNegativeTestJSON-482144179-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:20.761136 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1222cc2a-893f-40b1-8a24-8956aa865a78 tempest-ServicesAdminNegativeTestJSON-482144179 tempest-ServicesAdminNegativeTestJSON-482144179-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:20.816452 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-1222cc2a-893f-40b1-8a24-8956aa865a78 tempest-ServicesAdminNegativeTestJSON-482144179 tempest-ServicesAdminNegativeTestJSON-482144179-project-admin] 10.222.0.70 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.073725 Aug 27 02:43:20.818532 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 478/968] 10.222.0.70 () {58 vars in 1137 bytes} [Sat Aug 27 02:43:20 2022] GET /compute/v2.1/os-services => generated 944 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:43:20.858849 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-78877f81-f371-4230-bc4f-e32916c7f179 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:20.859651 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-78877f81-f371-4230-bc4f-e32916c7f179 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: 84d00bab-3efd-4f19-8f48-8c4b2fba864a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:20.869508 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-78877f81-f371-4230-bc4f-e32916c7f179 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:20.870339 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-78877f81-f371-4230-bc4f-e32916c7f179 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:20.870953 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-78877f81-f371-4230-bc4f-e32916c7f179 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:20.872474 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-78877f81-f371-4230-bc4f-e32916c7f179 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:20.873267 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-78877f81-f371-4230-bc4f-e32916c7f179 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:20.873904 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-78877f81-f371-4230-bc4f-e32916c7f179 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:21.015809 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-277fdef7-1483-4a7b-8f7b-c78bbc15fd9a tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Flavor limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:43:21.016376 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-277fdef7-1483-4a7b-8f7b-c78bbc15fd9a tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Image limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:43:21.016744 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-277fdef7-1483-4a7b-8f7b-c78bbc15fd9a tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Flavor pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:43:21.017386 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-277fdef7-1483-4a7b-8f7b-c78bbc15fd9a tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Image pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:43:21.017976 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-277fdef7-1483-4a7b-8f7b-c78bbc15fd9a tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:43:21.037200 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-277fdef7-1483-4a7b-8f7b-c78bbc15fd9a tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:21.038068 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-277fdef7-1483-4a7b-8f7b-c78bbc15fd9a tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:21.038724 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-277fdef7-1483-4a7b-8f7b-c78bbc15fd9a tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:21.039674 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-277fdef7-1483-4a7b-8f7b-c78bbc15fd9a tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:21.040385 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-277fdef7-1483-4a7b-8f7b-c78bbc15fd9a tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:21.041033 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-277fdef7-1483-4a7b-8f7b-c78bbc15fd9a tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:21.081914 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-277fdef7-1483-4a7b-8f7b-c78bbc15fd9a tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Getting quotas for project de3ac0c66c5b4bc787d2d6e12a957099. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:43:21.088233 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-277fdef7-1483-4a7b-8f7b-c78bbc15fd9a tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Getting quotas for user 9653dac89d2648b285fd71c1b349e642 and project de3ac0c66c5b4bc787d2d6e12a957099. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:43:21.132729 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-277fdef7-1483-4a7b-8f7b-c78bbc15fd9a tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Going to run 1 instances... {{(pid=134052) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:43:21.137337 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-277fdef7-1483-4a7b-8f7b-c78bbc15fd9a tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] [instance: c03f5d7e-1851-47a0-9ec2-4b8b56e07c54] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134052) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:43:21.144279 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-78877f81-f371-4230-bc4f-e32916c7f179 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6d1646ec094e3297f6f3c51dd72e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b105816fd4e54b9da4973ff721e1fb92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:21.167794 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-78877f81-f371-4230-bc4f-e32916c7f179 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "GET /compute/v2.1/servers/84d00bab-3efd-4f19-8f48-8c4b2fba864a" status: 200 len: 1318 microversion: 2.1 time: 0.345086 Aug 27 02:43:21.171104 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 479/969] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:20 2022] GET /compute/v2.1/servers/84d00bab-3efd-4f19-8f48-8c4b2fba864a => generated 1318 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:21.179983 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ac7f2f9a-c301-4c94-b021-8b280ada9c7b tempest-ServicesAdminNegativeTestJSON-482144179 tempest-ServicesAdminNegativeTestJSON-482144179-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:21.187212 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ac7f2f9a-c301-4c94-b021-8b280ada9c7b tempest-ServicesAdminNegativeTestJSON-482144179 tempest-ServicesAdminNegativeTestJSON-482144179-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:21.187697 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ac7f2f9a-c301-4c94-b021-8b280ada9c7b tempest-ServicesAdminNegativeTestJSON-482144179 tempest-ServicesAdminNegativeTestJSON-482144179-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:21.188139 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ac7f2f9a-c301-4c94-b021-8b280ada9c7b tempest-ServicesAdminNegativeTestJSON-482144179 tempest-ServicesAdminNegativeTestJSON-482144179-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:21.188924 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ac7f2f9a-c301-4c94-b021-8b280ada9c7b tempest-ServicesAdminNegativeTestJSON-482144179 tempest-ServicesAdminNegativeTestJSON-482144179-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:21.189373 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ac7f2f9a-c301-4c94-b021-8b280ada9c7b tempest-ServicesAdminNegativeTestJSON-482144179 tempest-ServicesAdminNegativeTestJSON-482144179-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:21.198477 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ac7f2f9a-c301-4c94-b021-8b280ada9c7b tempest-ServicesAdminNegativeTestJSON-482144179 tempest-ServicesAdminNegativeTestJSON-482144179-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:21.236567 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ac7f2f9a-c301-4c94-b021-8b280ada9c7b tempest-ServicesAdminNegativeTestJSON-482144179 tempest-ServicesAdminNegativeTestJSON-482144179-project-admin] 10.222.0.70 "GET /compute/v2.1/os-services?host=n-d-852278-4&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.064141 Aug 27 02:43:21.237407 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 480/970] 10.222.0.70 () {58 vars in 1194 bytes} [Sat Aug 27 02:43:21 2022] GET /compute/v2.1/os-services?host=n-d-852278-4&binary=xxx => generated 16 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:43:21.252128 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-1973ec0c-3096-470c-9dde-1a91d3b93c3b tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:21.252945 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-1973ec0c-3096-470c-9dde-1a91d3b93c3b tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: 7eded9ca-c7bc-499a-bb53-a28d2c332402] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:21.261549 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1973ec0c-3096-470c-9dde-1a91d3b93c3b tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:21.262304 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1973ec0c-3096-470c-9dde-1a91d3b93c3b tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:21.262938 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1973ec0c-3096-470c-9dde-1a91d3b93c3b tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:21.264379 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1973ec0c-3096-470c-9dde-1a91d3b93c3b tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:21.265170 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1973ec0c-3096-470c-9dde-1a91d3b93c3b tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:21.265905 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1973ec0c-3096-470c-9dde-1a91d3b93c3b tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:21.271956 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-277fdef7-1483-4a7b-8f7b-c78bbc15fd9a tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.500646 Aug 27 02:43:21.272662 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 491/971] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 02:43:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1502 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:43:21.288584 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a492d959-b000-4a20-bf79-7dd74dc64a6e tempest-ServicesAdminNegativeTestJSON-482144179 tempest-ServicesAdminNegativeTestJSON-482144179-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:21.298285 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a492d959-b000-4a20-bf79-7dd74dc64a6e tempest-ServicesAdminNegativeTestJSON-482144179 tempest-ServicesAdminNegativeTestJSON-482144179-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:21.300951 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a492d959-b000-4a20-bf79-7dd74dc64a6e tempest-ServicesAdminNegativeTestJSON-482144179 tempest-ServicesAdminNegativeTestJSON-482144179-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:21.301375 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a492d959-b000-4a20-bf79-7dd74dc64a6e tempest-ServicesAdminNegativeTestJSON-482144179 tempest-ServicesAdminNegativeTestJSON-482144179-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:21.302134 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a492d959-b000-4a20-bf79-7dd74dc64a6e tempest-ServicesAdminNegativeTestJSON-482144179 tempest-ServicesAdminNegativeTestJSON-482144179-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:21.302585 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a492d959-b000-4a20-bf79-7dd74dc64a6e tempest-ServicesAdminNegativeTestJSON-482144179 tempest-ServicesAdminNegativeTestJSON-482144179-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:21.302995 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a492d959-b000-4a20-bf79-7dd74dc64a6e tempest-ServicesAdminNegativeTestJSON-482144179 tempest-ServicesAdminNegativeTestJSON-482144179-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:21.380637 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a492d959-b000-4a20-bf79-7dd74dc64a6e tempest-ServicesAdminNegativeTestJSON-482144179 tempest-ServicesAdminNegativeTestJSON-482144179-project-admin] 10.222.0.70 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.103489 Aug 27 02:43:21.384048 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 492/972] 10.222.0.70 () {58 vars in 1137 bytes} [Sat Aug 27 02:43:21 2022] GET /compute/v2.1/os-services => generated 944 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:43:21.396000 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b7de955b-4445-4979-8f54-e1e147bab5d9 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:21.397169 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b7de955b-4445-4979-8f54-e1e147bab5d9 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] [instance: c03f5d7e-1851-47a0-9ec2-4b8b56e07c54] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:21.544849 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b7de955b-4445-4979-8f54-e1e147bab5d9 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9653dac89d2648b285fd71c1b349e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3ac0c66c5b4bc787d2d6e12a957099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:21.561435 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b7de955b-4445-4979-8f54-e1e147bab5d9 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] 10.222.0.70 "GET /compute/v2.1/servers/c03f5d7e-1851-47a0-9ec2-4b8b56e07c54" status: 200 len: 1213 microversion: 2.1 time: 0.175967 Aug 27 02:43:21.564843 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 493/973] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:21 2022] GET /compute/v2.1/servers/c03f5d7e-1851-47a0-9ec2-4b8b56e07c54 => generated 1213 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:21.569829 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d7898f64-522f-4ab5-a105-174b4046b932 tempest-ServicesAdminNegativeTestJSON-482144179 tempest-ServicesAdminNegativeTestJSON-482144179-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:21.584761 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d7898f64-522f-4ab5-a105-174b4046b932 tempest-ServicesAdminNegativeTestJSON-482144179 tempest-ServicesAdminNegativeTestJSON-482144179-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:21.585262 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d7898f64-522f-4ab5-a105-174b4046b932 tempest-ServicesAdminNegativeTestJSON-482144179 tempest-ServicesAdminNegativeTestJSON-482144179-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:21.585704 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d7898f64-522f-4ab5-a105-174b4046b932 tempest-ServicesAdminNegativeTestJSON-482144179 tempest-ServicesAdminNegativeTestJSON-482144179-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:21.586447 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d7898f64-522f-4ab5-a105-174b4046b932 tempest-ServicesAdminNegativeTestJSON-482144179 tempest-ServicesAdminNegativeTestJSON-482144179-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:21.590229 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d7898f64-522f-4ab5-a105-174b4046b932 tempest-ServicesAdminNegativeTestJSON-482144179 tempest-ServicesAdminNegativeTestJSON-482144179-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:21.596452 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d7898f64-522f-4ab5-a105-174b4046b932 tempest-ServicesAdminNegativeTestJSON-482144179 tempest-ServicesAdminNegativeTestJSON-482144179-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:21.617976 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-1973ec0c-3096-470c-9dde-1a91d3b93c3b tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:21.631960 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-1973ec0c-3096-470c-9dde-1a91d3b93c3b tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:21.633442 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-1973ec0c-3096-470c-9dde-1a91d3b93c3b tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:21.634683 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-1973ec0c-3096-470c-9dde-1a91d3b93c3b tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/7eded9ca-c7bc-499a-bb53-a28d2c332402" status: 200 len: 1812 microversion: 2.25 time: 0.388836 Aug 27 02:43:21.646108 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 481/974] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:43:21 2022] GET /compute/v2.1/servers/7eded9ca-c7bc-499a-bb53-a28d2c332402 => generated 1812 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:43:21.663432 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d7898f64-522f-4ab5-a105-174b4046b932 tempest-ServicesAdminNegativeTestJSON-482144179 tempest-ServicesAdminNegativeTestJSON-482144179-project-admin] 10.222.0.70 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.097121 Aug 27 02:43:21.673228 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 494/975] 10.222.0.70 () {58 vars in 1198 bytes} [Sat Aug 27 02:43:21 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:43:21.770006 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-163849d1-4239-43fc-9914-905ac2089549 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:21.771468 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-163849d1-4239-43fc-9914-905ac2089549 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] [instance: ccf87867-fb85-4b52-93f4-283450f636a4] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:21.780609 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-163849d1-4239-43fc-9914-905ac2089549 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:21.785723 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-163849d1-4239-43fc-9914-905ac2089549 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:21.786385 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-163849d1-4239-43fc-9914-905ac2089549 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:21.789298 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-163849d1-4239-43fc-9914-905ac2089549 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:21.789963 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-163849d1-4239-43fc-9914-905ac2089549 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:21.790571 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-163849d1-4239-43fc-9914-905ac2089549 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:22.094917 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-163849d1-4239-43fc-9914-905ac2089549 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30abbf3afe304291981a6a9b85952aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c28ddbdb164f01bb82235c6d49717b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:22.108668 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-163849d1-4239-43fc-9914-905ac2089549 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] 10.222.0.70 "GET /compute/v2.1/servers/ccf87867-fb85-4b52-93f4-283450f636a4" status: 200 len: 1469 microversion: 2.1 time: 0.347492 Aug 27 02:43:22.112592 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 495/976] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:21 2022] GET /compute/v2.1/servers/ccf87867-fb85-4b52-93f4-283450f636a4 => generated 1469 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:22.162125 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-251a4a17-2c51-4992-987e-0bde6e86ee86 tempest-ServicesAdminNegativeTestJSON-382338931 tempest-ServicesAdminNegativeTestJSON-382338931-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:22.173124 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-251a4a17-2c51-4992-987e-0bde6e86ee86 tempest-ServicesAdminNegativeTestJSON-382338931 tempest-ServicesAdminNegativeTestJSON-382338931-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '843a3247b0c24f55a03e83d3b5a8e8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe421ae8551d4e289fe5c660ef0f06c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:22.175322 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-251a4a17-2c51-4992-987e-0bde6e86ee86 tempest-ServicesAdminNegativeTestJSON-382338931 tempest-ServicesAdminNegativeTestJSON-382338931-project] Request method failure captured: Aug 27 02:43:22.175322 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/os-services HTTP/1.1 Aug 27 02:43:22.175322 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:43:22.175322 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:43:22.175322 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:43:22.175322 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:43:22.175322 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:43:22.175322 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:43:22.175322 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:43:22.175322 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:43:22.175322 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYTFL9ESyoKPG6oKlDTM5Jdh8fOBrrgLDdHIJb9Ii0QKhsno_LeSmsHYwNblMjk0OwRUI81wPkaifJLGaHvc4NGiEyR_eFbRS1c9gasy5rIpC90flFVCeQz4xSIsFxstcZJHg_ASp3WfyqsbSYW4Vs5_jEeySKXKKUfXOM8etv8aYWM Aug 27 02:43:22.175322 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:43:22.175322 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:43:22.175322 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:43:22.175322 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:43:22.175322 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:43:22.175322 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:43:22.175322 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: fe421ae8551d4e289fe5c660ef0f06c1 Aug 27 02:43:22.175322 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-382338931 Aug 27 02:43:22.175322 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:43:22.175322 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:43:22.176858 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/fe421ae8551d4e289fe5c660ef0f06c1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_fe421ae8551d4e289fe5c660ef0f06c1", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/fe421ae8551d4e289fe5c660ef0f06c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/fe421ae8551d4e289fe5c660ef0f06c1"}]}] Aug 27 02:43:22.176858 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-382338931 Aug 27 02:43:22.176858 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: fe421ae8551d4e289fe5c660ef0f06c1 Aug 27 02:43:22.176858 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-382338931 Aug 27 02:43:22.176858 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ServicesAdminNegativeTestJSON-382338931-project Aug 27 02:43:22.176858 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:43:22.176858 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:43:22.176858 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 843a3247b0c24f55a03e83d3b5a8e8c1 Aug 27 02:43:22.176858 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-382338931-project Aug 27 02:43:22.176858 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 02:43:22.176858 n-d-852278-4 devstack@n-api.service[134051]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 27 02:43:22.176858 n-d-852278-4 devstack@n-api.service[134051]: action_args: {} Aug 27 02:43:22.177685 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:43:22.177685 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:43:22.177685 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:43:22.177685 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:43:22.177685 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:43:22.177685 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:43:22.177685 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 02:43:22.177685 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:43:22.177685 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 02:43:22.177685 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:43:22.177685 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:43:22.177685 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:43:22.177685 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Aug 27 02:43:22.177685 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Aug 27 02:43:22.177685 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 02:43:22.177685 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 02:43:22.177685 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 02:43:22.177685 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 02:43:22.177685 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 02:43:22.178960 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 02:43:22.178960 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 02:43:22.178960 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 02:43:22.178960 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 02:43:22.178960 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 02:43:22.178960 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 02:43:22.178960 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 02:43:22.178960 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 02:43:22.178960 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 02:43:22.178960 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 27 02:43:22.178960 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:43:22.178960 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:43:22.178960 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:43:22.178960 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:43:22.178960 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:43:22.178960 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:43:22.178960 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 02:43:22.178960 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 02:43:22.178960 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 27 02:43:22.178960 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:43:22.183515 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-251a4a17-2c51-4992-987e-0bde6e86ee86 tempest-ServicesAdminNegativeTestJSON-382338931 tempest-ServicesAdminNegativeTestJSON-382338931-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:43:22.183515 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-251a4a17-2c51-4992-987e-0bde6e86ee86 tempest-ServicesAdminNegativeTestJSON-382338931 tempest-ServicesAdminNegativeTestJSON-382338931-project] 10.222.0.70 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.495462 Aug 27 02:43:22.185321 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-3101e726-a2c4-4ff0-9aa8-99a1fc34727d req-8287b2ea-254e-461e-9c9f-8222bf431722 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84d00bab-3efd-4f19-8f48-8c4b2fba864a", "name": "network-vif-plugged", "status": "completed", "tag": "205ec2a5-ab75-4573-8598-101ecb5de5df"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:43:22.188134 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 482/977] 10.222.0.70 () {58 vars in 1137 bytes} [Sat Aug 27 02:43:21 2022] GET /compute/v2.1/os-services => generated 112 bytes in 505 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 27 02:43:22.204103 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f4437eae-8a2f-4e22-8209-636cc21212e3 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:22.205635 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-3101e726-a2c4-4ff0-9aa8-99a1fc34727d req-8287b2ea-254e-461e-9c9f-8222bf431722 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:22.209029 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-f4437eae-8a2f-4e22-8209-636cc21212e3 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: 84d00bab-3efd-4f19-8f48-8c4b2fba864a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:22.210784 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-3101e726-a2c4-4ff0-9aa8-99a1fc34727d req-8287b2ea-254e-461e-9c9f-8222bf431722 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:22.211722 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-3101e726-a2c4-4ff0-9aa8-99a1fc34727d req-8287b2ea-254e-461e-9c9f-8222bf431722 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:22.238052 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f4437eae-8a2f-4e22-8209-636cc21212e3 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:22.238626 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f4437eae-8a2f-4e22-8209-636cc21212e3 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:22.239070 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f4437eae-8a2f-4e22-8209-636cc21212e3 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:22.239809 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f4437eae-8a2f-4e22-8209-636cc21212e3 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:22.240253 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f4437eae-8a2f-4e22-8209-636cc21212e3 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:22.248633 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f4437eae-8a2f-4e22-8209-636cc21212e3 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:22.266465 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-3101e726-a2c4-4ff0-9aa8-99a1fc34727d req-8287b2ea-254e-461e-9c9f-8222bf431722 service nova] Creating event network-vif-plugged:205ec2a5-ab75-4573-8598-101ecb5de5df for instance 84d00bab-3efd-4f19-8f48-8c4b2fba864a on n-h2-852278-4 Aug 27 02:43:22.278778 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-3101e726-a2c4-4ff0-9aa8-99a1fc34727d req-8287b2ea-254e-461e-9c9f-8222bf431722 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106033 Aug 27 02:43:22.281703 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 496/978] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:43:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:43:22.584105 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f2c23234-4e37-418a-9d0d-989fe36e014f tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:22.585949 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-f2c23234-4e37-418a-9d0d-989fe36e014f tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] [instance: c03f5d7e-1851-47a0-9ec2-4b8b56e07c54] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:22.601263 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f2c23234-4e37-418a-9d0d-989fe36e014f tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:22.603542 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f2c23234-4e37-418a-9d0d-989fe36e014f tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:22.605194 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f2c23234-4e37-418a-9d0d-989fe36e014f tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:22.605359 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-f4437eae-8a2f-4e22-8209-636cc21212e3 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6d1646ec094e3297f6f3c51dd72e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b105816fd4e54b9da4973ff721e1fb92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:22.608129 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f2c23234-4e37-418a-9d0d-989fe36e014f tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:22.608959 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f2c23234-4e37-418a-9d0d-989fe36e014f tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:22.610108 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f2c23234-4e37-418a-9d0d-989fe36e014f tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:22.616892 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-f4437eae-8a2f-4e22-8209-636cc21212e3 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "GET /compute/v2.1/servers/84d00bab-3efd-4f19-8f48-8c4b2fba864a" status: 200 len: 1318 microversion: 2.1 time: 0.427508 Aug 27 02:43:22.628483 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 483/979] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:22 2022] GET /compute/v2.1/servers/84d00bab-3efd-4f19-8f48-8c4b2fba864a => generated 1318 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:22.673295 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d8d80018-6426-4103-87e4-869501746218 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:22.675302 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d8d80018-6426-4103-87e4-869501746218 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: 7eded9ca-c7bc-499a-bb53-a28d2c332402] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:22.694383 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d8d80018-6426-4103-87e4-869501746218 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:22.698388 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d8d80018-6426-4103-87e4-869501746218 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:22.699939 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d8d80018-6426-4103-87e4-869501746218 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:22.700752 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d8d80018-6426-4103-87e4-869501746218 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:22.701472 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d8d80018-6426-4103-87e4-869501746218 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:22.702133 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d8d80018-6426-4103-87e4-869501746218 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:22.815293 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-f2c23234-4e37-418a-9d0d-989fe36e014f tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9653dac89d2648b285fd71c1b349e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3ac0c66c5b4bc787d2d6e12a957099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:22.832715 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f2c23234-4e37-418a-9d0d-989fe36e014f tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] 10.222.0.70 "GET /compute/v2.1/servers/c03f5d7e-1851-47a0-9ec2-4b8b56e07c54" status: 200 len: 1209 microversion: 2.1 time: 0.251767 Aug 27 02:43:22.836391 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 497/980] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:22 2022] GET /compute/v2.1/servers/c03f5d7e-1851-47a0-9ec2-4b8b56e07c54 => generated 1209 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:43:23.133868 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-06f40f1a-66af-426c-a105-b0e56742e789 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:23.134495 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-06f40f1a-66af-426c-a105-b0e56742e789 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] [instance: ccf87867-fb85-4b52-93f4-283450f636a4] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:23.153251 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-06f40f1a-66af-426c-a105-b0e56742e789 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:23.153917 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-06f40f1a-66af-426c-a105-b0e56742e789 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:23.154531 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-06f40f1a-66af-426c-a105-b0e56742e789 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:23.155460 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-06f40f1a-66af-426c-a105-b0e56742e789 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:23.156294 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-06f40f1a-66af-426c-a105-b0e56742e789 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:23.157065 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-06f40f1a-66af-426c-a105-b0e56742e789 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:23.163240 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d8d80018-6426-4103-87e4-869501746218 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:23.174810 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d8d80018-6426-4103-87e4-869501746218 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:23.183811 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d8d80018-6426-4103-87e4-869501746218 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:23.188375 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d8d80018-6426-4103-87e4-869501746218 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/7eded9ca-c7bc-499a-bb53-a28d2c332402" status: 200 len: 1812 microversion: 2.25 time: 0.519176 Aug 27 02:43:23.192793 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 484/981] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:43:22 2022] GET /compute/v2.1/servers/7eded9ca-c7bc-499a-bb53-a28d2c332402 => generated 1812 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:43:23.644966 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-bad29f8c-7462-4d0c-839a-69b3285558db tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:23.646224 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-bad29f8c-7462-4d0c-839a-69b3285558db tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: 84d00bab-3efd-4f19-8f48-8c4b2fba864a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:23.659152 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bad29f8c-7462-4d0c-839a-69b3285558db tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:23.668716 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bad29f8c-7462-4d0c-839a-69b3285558db tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:23.669587 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bad29f8c-7462-4d0c-839a-69b3285558db tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:23.672485 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bad29f8c-7462-4d0c-839a-69b3285558db tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:23.673211 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bad29f8c-7462-4d0c-839a-69b3285558db tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:23.683166 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bad29f8c-7462-4d0c-839a-69b3285558db tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:24.402962 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-06f40f1a-66af-426c-a105-b0e56742e789 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30abbf3afe304291981a6a9b85952aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c28ddbdb164f01bb82235c6d49717b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:24.416253 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-06f40f1a-66af-426c-a105-b0e56742e789 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] 10.222.0.70 "GET /compute/v2.1/servers/ccf87867-fb85-4b52-93f4-283450f636a4" status: 200 len: 1469 microversion: 2.1 time: 1.289768 Aug 27 02:43:24.437050 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 498/982] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:23 2022] GET /compute/v2.1/servers/ccf87867-fb85-4b52-93f4-283450f636a4 => generated 1469 bytes in 1311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:24.443804 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b23a7a9f-fc35-42b4-a3b4-e237e1668f7b tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:24.445441 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b23a7a9f-fc35-42b4-a3b4-e237e1668f7b tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] [instance: c03f5d7e-1851-47a0-9ec2-4b8b56e07c54] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:24.453984 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b23a7a9f-fc35-42b4-a3b4-e237e1668f7b tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:24.455179 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b23a7a9f-fc35-42b4-a3b4-e237e1668f7b tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:24.455771 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b23a7a9f-fc35-42b4-a3b4-e237e1668f7b tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:24.457839 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b23a7a9f-fc35-42b4-a3b4-e237e1668f7b tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:24.458617 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b23a7a9f-fc35-42b4-a3b4-e237e1668f7b tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:24.459604 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b23a7a9f-fc35-42b4-a3b4-e237e1668f7b tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:25.269215 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b23a7a9f-fc35-42b4-a3b4-e237e1668f7b tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9653dac89d2648b285fd71c1b349e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3ac0c66c5b4bc787d2d6e12a957099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:25.285632 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b23a7a9f-fc35-42b4-a3b4-e237e1668f7b tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] 10.222.0.70 "GET /compute/v2.1/servers/c03f5d7e-1851-47a0-9ec2-4b8b56e07c54" status: 200 len: 1271 microversion: 2.1 time: 0.847095 Aug 27 02:43:25.286591 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 499/983] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:24 2022] GET /compute/v2.1/servers/c03f5d7e-1851-47a0-9ec2-4b8b56e07c54 => generated 1271 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:25.291399 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-40f1f34a-88d7-43aa-94dd-2a7bd51fa379 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:25.291963 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-40f1f34a-88d7-43aa-94dd-2a7bd51fa379 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: 7eded9ca-c7bc-499a-bb53-a28d2c332402] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:25.310984 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-40f1f34a-88d7-43aa-94dd-2a7bd51fa379 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:25.311770 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-40f1f34a-88d7-43aa-94dd-2a7bd51fa379 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:25.312428 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-40f1f34a-88d7-43aa-94dd-2a7bd51fa379 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:25.313324 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-40f1f34a-88d7-43aa-94dd-2a7bd51fa379 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:25.313929 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-40f1f34a-88d7-43aa-94dd-2a7bd51fa379 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:25.314533 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-40f1f34a-88d7-43aa-94dd-2a7bd51fa379 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:25.414920 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-bad29f8c-7462-4d0c-839a-69b3285558db tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6d1646ec094e3297f6f3c51dd72e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b105816fd4e54b9da4973ff721e1fb92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:25.426754 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-bad29f8c-7462-4d0c-839a-69b3285558db tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "GET /compute/v2.1/servers/84d00bab-3efd-4f19-8f48-8c4b2fba864a" status: 200 len: 1318 microversion: 2.1 time: 1.786596 Aug 27 02:43:25.446236 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 485/984] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:23 2022] GET /compute/v2.1/servers/84d00bab-3efd-4f19-8f48-8c4b2fba864a => generated 1318 bytes in 1807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:43:25.768667 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-40f1f34a-88d7-43aa-94dd-2a7bd51fa379 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:25.781616 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-40f1f34a-88d7-43aa-94dd-2a7bd51fa379 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:25.783090 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-40f1f34a-88d7-43aa-94dd-2a7bd51fa379 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:25.790186 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-40f1f34a-88d7-43aa-94dd-2a7bd51fa379 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/7eded9ca-c7bc-499a-bb53-a28d2c332402" status: 200 len: 1812 microversion: 2.25 time: 0.502035 Aug 27 02:43:25.792658 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 500/985] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:43:25 2022] GET /compute/v2.1/servers/7eded9ca-c7bc-499a-bb53-a28d2c332402 => generated 1812 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:43:25.805959 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-51361ac7-d142-4f7f-910a-e56137047808 req-56158b5a-4d80-4a38-ada2-5106d8c958d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccf87867-fb85-4b52-93f4-283450f636a4", "name": "network-vif-deleted", "tag": "457ff7f9-caf8-461a-a54b-310371560c75"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:43:25.818445 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-51361ac7-d142-4f7f-910a-e56137047808 req-56158b5a-4d80-4a38-ada2-5106d8c958d7 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:25.821885 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-51361ac7-d142-4f7f-910a-e56137047808 req-56158b5a-4d80-4a38-ada2-5106d8c958d7 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:25.822697 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-51361ac7-d142-4f7f-910a-e56137047808 req-56158b5a-4d80-4a38-ada2-5106d8c958d7 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:25.850381 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-51361ac7-d142-4f7f-910a-e56137047808 req-56158b5a-4d80-4a38-ada2-5106d8c958d7 service nova] Creating event network-vif-deleted:457ff7f9-caf8-461a-a54b-310371560c75 for instance ccf87867-fb85-4b52-93f4-283450f636a4 on n-h2-852278-4 Aug 27 02:43:25.855826 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-51361ac7-d142-4f7f-910a-e56137047808 req-56158b5a-4d80-4a38-ada2-5106d8c958d7 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061941 Aug 27 02:43:25.856540 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 501/986] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:43:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:43:25.873460 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-932d209a-db55-40a5-9d4b-9b47cecc2df4 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:25.881089 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-932d209a-db55-40a5-9d4b-9b47cecc2df4 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] [instance: ccf87867-fb85-4b52-93f4-283450f636a4] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:25.894079 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-932d209a-db55-40a5-9d4b-9b47cecc2df4 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:25.894985 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-932d209a-db55-40a5-9d4b-9b47cecc2df4 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:25.895625 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-932d209a-db55-40a5-9d4b-9b47cecc2df4 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:25.896599 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-932d209a-db55-40a5-9d4b-9b47cecc2df4 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:25.897214 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-932d209a-db55-40a5-9d4b-9b47cecc2df4 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:25.897820 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-932d209a-db55-40a5-9d4b-9b47cecc2df4 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:25.949713 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-932d209a-db55-40a5-9d4b-9b47cecc2df4 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:25.950330 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-932d209a-db55-40a5-9d4b-9b47cecc2df4 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:25.950867 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-932d209a-db55-40a5-9d4b-9b47cecc2df4 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:25.951586 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.instance [None req-932d209a-db55-40a5-9d4b-9b47cecc2df4 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lazy-loading 'fault' on Instance uuid ccf87867-fb85-4b52-93f4-283450f636a4 {{(pid=134052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:43:26.004165 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-80727fd7-cac3-435b-b5a1-8e36e70366f0 tempest-ServicesAdminTestJSON-557739221 tempest-ServicesAdminTestJSON-557739221-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:26.007731 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-80727fd7-cac3-435b-b5a1-8e36e70366f0 tempest-ServicesAdminTestJSON-557739221 tempest-ServicesAdminTestJSON-557739221-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:26.008205 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-80727fd7-cac3-435b-b5a1-8e36e70366f0 tempest-ServicesAdminTestJSON-557739221 tempest-ServicesAdminTestJSON-557739221-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:26.008668 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-80727fd7-cac3-435b-b5a1-8e36e70366f0 tempest-ServicesAdminTestJSON-557739221 tempest-ServicesAdminTestJSON-557739221-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:26.009937 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-80727fd7-cac3-435b-b5a1-8e36e70366f0 tempest-ServicesAdminTestJSON-557739221 tempest-ServicesAdminTestJSON-557739221-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:26.010402 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-80727fd7-cac3-435b-b5a1-8e36e70366f0 tempest-ServicesAdminTestJSON-557739221 tempest-ServicesAdminTestJSON-557739221-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:26.011490 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-80727fd7-cac3-435b-b5a1-8e36e70366f0 tempest-ServicesAdminTestJSON-557739221 tempest-ServicesAdminTestJSON-557739221-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:26.044163 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-80727fd7-cac3-435b-b5a1-8e36e70366f0 tempest-ServicesAdminTestJSON-557739221 tempest-ServicesAdminTestJSON-557739221-project-admin] 10.222.0.70 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.596212 Aug 27 02:43:26.054022 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 486/987] 10.222.0.70 () {58 vars in 1137 bytes} [Sat Aug 27 02:43:25 2022] GET /compute/v2.1/os-services => generated 944 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:43:26.060113 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-c6a08565-6b16-4b1f-bcab-380cc0009060 req-8dbd1d8e-99f9-4bab-b7cf-15a67d7e7dad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7eded9ca-c7bc-499a-bb53-a28d2c332402", "name": "network-vif-unplugged", "status": "completed", "tag": "e0130326-860c-4234-8b0f-db61efc2a95a"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:43:26.070967 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-c6a08565-6b16-4b1f-bcab-380cc0009060 req-8dbd1d8e-99f9-4bab-b7cf-15a67d7e7dad service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:26.071831 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-c6a08565-6b16-4b1f-bcab-380cc0009060 req-8dbd1d8e-99f9-4bab-b7cf-15a67d7e7dad service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:26.072524 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-c6a08565-6b16-4b1f-bcab-380cc0009060 req-8dbd1d8e-99f9-4bab-b7cf-15a67d7e7dad service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:26.087229 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-c6a08565-6b16-4b1f-bcab-380cc0009060 req-8dbd1d8e-99f9-4bab-b7cf-15a67d7e7dad service nova] Creating event network-vif-unplugged:e0130326-860c-4234-8b0f-db61efc2a95a for instance 7eded9ca-c7bc-499a-bb53-a28d2c332402 on n-h1-852278-4 Aug 27 02:43:26.098892 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-932d209a-db55-40a5-9d4b-9b47cecc2df4 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30abbf3afe304291981a6a9b85952aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c28ddbdb164f01bb82235c6d49717b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:26.113558 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-c6a08565-6b16-4b1f-bcab-380cc0009060 req-8dbd1d8e-99f9-4bab-b7cf-15a67d7e7dad service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057675 Aug 27 02:43:26.114247 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-932d209a-db55-40a5-9d4b-9b47cecc2df4 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] 10.222.0.70 "GET /compute/v2.1/servers/ccf87867-fb85-4b52-93f4-283450f636a4" status: 200 len: 1303 microversion: 2.1 time: 0.252754 Aug 27 02:43:26.114928 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 502/988] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:25 2022] GET /compute/v2.1/servers/ccf87867-fb85-4b52-93f4-283450f636a4 => generated 1303 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:26.115442 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 487/989] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:43:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:43:26.120357 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e37b8d2f-cad4-4f17-bf71-2e8b9c6fe944 tempest-ServicesAdminTestJSON-557739221 tempest-ServicesAdminTestJSON-557739221-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:26.126920 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e37b8d2f-cad4-4f17-bf71-2e8b9c6fe944 tempest-ServicesAdminTestJSON-557739221 tempest-ServicesAdminTestJSON-557739221-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:26.127422 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e37b8d2f-cad4-4f17-bf71-2e8b9c6fe944 tempest-ServicesAdminTestJSON-557739221 tempest-ServicesAdminTestJSON-557739221-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:26.127914 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e37b8d2f-cad4-4f17-bf71-2e8b9c6fe944 tempest-ServicesAdminTestJSON-557739221 tempest-ServicesAdminTestJSON-557739221-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:26.128673 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e37b8d2f-cad4-4f17-bf71-2e8b9c6fe944 tempest-ServicesAdminTestJSON-557739221 tempest-ServicesAdminTestJSON-557739221-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:26.129373 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e37b8d2f-cad4-4f17-bf71-2e8b9c6fe944 tempest-ServicesAdminTestJSON-557739221 tempest-ServicesAdminTestJSON-557739221-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:26.129791 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e37b8d2f-cad4-4f17-bf71-2e8b9c6fe944 tempest-ServicesAdminTestJSON-557739221 tempest-ServicesAdminTestJSON-557739221-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:26.160505 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e37b8d2f-cad4-4f17-bf71-2e8b9c6fe944 tempest-ServicesAdminTestJSON-557739221 tempest-ServicesAdminTestJSON-557739221-project-admin] 10.222.0.70 "GET /compute/v2.1/os-services?host=n-d-852278-4" status: 200 len: 578 microversion: 2.1 time: 0.043860 Aug 27 02:43:26.161426 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 503/990] 10.222.0.70 () {58 vars in 1172 bytes} [Sat Aug 27 02:43:26 2022] GET /compute/v2.1/os-services?host=n-d-852278-4 => generated 578 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:43:26.175398 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d81e51ce-552c-4b89-8440-e801e04d0325 tempest-ServicesAdminTestJSON-557739221 tempest-ServicesAdminTestJSON-557739221-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:26.181810 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d81e51ce-552c-4b89-8440-e801e04d0325 tempest-ServicesAdminTestJSON-557739221 tempest-ServicesAdminTestJSON-557739221-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:26.183667 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d81e51ce-552c-4b89-8440-e801e04d0325 tempest-ServicesAdminTestJSON-557739221 tempest-ServicesAdminTestJSON-557739221-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:26.185281 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d81e51ce-552c-4b89-8440-e801e04d0325 tempest-ServicesAdminTestJSON-557739221 tempest-ServicesAdminTestJSON-557739221-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:26.186024 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d81e51ce-552c-4b89-8440-e801e04d0325 tempest-ServicesAdminTestJSON-557739221 tempest-ServicesAdminTestJSON-557739221-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:26.188048 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d81e51ce-552c-4b89-8440-e801e04d0325 tempest-ServicesAdminTestJSON-557739221 tempest-ServicesAdminTestJSON-557739221-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:26.188543 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d81e51ce-552c-4b89-8440-e801e04d0325 tempest-ServicesAdminTestJSON-557739221 tempest-ServicesAdminTestJSON-557739221-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:26.218927 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d81e51ce-552c-4b89-8440-e801e04d0325 tempest-ServicesAdminTestJSON-557739221 tempest-ServicesAdminTestJSON-557739221-project-admin] 10.222.0.70 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.048557 Aug 27 02:43:26.235340 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-51f1a2ab-3e32-4d2d-9e55-99617893a700 tempest-ServicesAdminTestJSON-557739221 tempest-ServicesAdminTestJSON-557739221-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:26.239535 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 488/991] 10.222.0.70 () {58 vars in 1176 bytes} [Sat Aug 27 02:43:26 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:43:26.240396 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-51f1a2ab-3e32-4d2d-9e55-99617893a700 tempest-ServicesAdminTestJSON-557739221 tempest-ServicesAdminTestJSON-557739221-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:26.241094 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-51f1a2ab-3e32-4d2d-9e55-99617893a700 tempest-ServicesAdminTestJSON-557739221 tempest-ServicesAdminTestJSON-557739221-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:26.242201 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-51f1a2ab-3e32-4d2d-9e55-99617893a700 tempest-ServicesAdminTestJSON-557739221 tempest-ServicesAdminTestJSON-557739221-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:26.243173 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-51f1a2ab-3e32-4d2d-9e55-99617893a700 tempest-ServicesAdminTestJSON-557739221 tempest-ServicesAdminTestJSON-557739221-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:26.243823 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-51f1a2ab-3e32-4d2d-9e55-99617893a700 tempest-ServicesAdminTestJSON-557739221 tempest-ServicesAdminTestJSON-557739221-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:26.244490 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-51f1a2ab-3e32-4d2d-9e55-99617893a700 tempest-ServicesAdminTestJSON-557739221 tempest-ServicesAdminTestJSON-557739221-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:26.299383 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-51f1a2ab-3e32-4d2d-9e55-99617893a700 tempest-ServicesAdminTestJSON-557739221 tempest-ServicesAdminTestJSON-557739221-project-admin] 10.222.0.70 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.068801 Aug 27 02:43:26.310900 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 504/992] 10.222.0.70 () {58 vars in 1137 bytes} [Sat Aug 27 02:43:26 2022] GET /compute/v2.1/os-services => generated 944 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:43:26.325387 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e63236f4-2ecd-485e-aafe-a163c3da3d68 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:26.326437 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-e63236f4-2ecd-485e-aafe-a163c3da3d68 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] [instance: c03f5d7e-1851-47a0-9ec2-4b8b56e07c54] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:26.340697 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e63236f4-2ecd-485e-aafe-a163c3da3d68 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:26.342877 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e63236f4-2ecd-485e-aafe-a163c3da3d68 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:26.343798 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e63236f4-2ecd-485e-aafe-a163c3da3d68 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:26.345407 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e63236f4-2ecd-485e-aafe-a163c3da3d68 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:26.347608 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e63236f4-2ecd-485e-aafe-a163c3da3d68 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:26.348224 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e63236f4-2ecd-485e-aafe-a163c3da3d68 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:26.452688 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-7e2c7cea-8639-48d1-84b7-9db5599c475c tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:26.453332 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-7e2c7cea-8639-48d1-84b7-9db5599c475c tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: 84d00bab-3efd-4f19-8f48-8c4b2fba864a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:26.459495 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7e2c7cea-8639-48d1-84b7-9db5599c475c tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:26.459981 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7e2c7cea-8639-48d1-84b7-9db5599c475c tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:26.460436 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7e2c7cea-8639-48d1-84b7-9db5599c475c tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:26.464548 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7e2c7cea-8639-48d1-84b7-9db5599c475c tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:26.465233 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7e2c7cea-8639-48d1-84b7-9db5599c475c tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:26.466458 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7e2c7cea-8639-48d1-84b7-9db5599c475c tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:26.938742 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e63236f4-2ecd-485e-aafe-a163c3da3d68 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9653dac89d2648b285fd71c1b349e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3ac0c66c5b4bc787d2d6e12a957099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:26.953095 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e63236f4-2ecd-485e-aafe-a163c3da3d68 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] 10.222.0.70 "GET /compute/v2.1/servers/c03f5d7e-1851-47a0-9ec2-4b8b56e07c54" status: 200 len: 1313 microversion: 2.1 time: 0.633654 Aug 27 02:43:26.955080 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 489/993] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:26 2022] GET /compute/v2.1/servers/c03f5d7e-1851-47a0-9ec2-4b8b56e07c54 => generated 1313 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:26.963051 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-de69ea69-5085-4350-afe6-83b42203db17 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:26.964758 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-de69ea69-5085-4350-afe6-83b42203db17 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: 7eded9ca-c7bc-499a-bb53-a28d2c332402] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:26.999344 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-de69ea69-5085-4350-afe6-83b42203db17 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:27.002259 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-de69ea69-5085-4350-afe6-83b42203db17 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:27.003505 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-de69ea69-5085-4350-afe6-83b42203db17 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:27.005437 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-de69ea69-5085-4350-afe6-83b42203db17 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:27.006301 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-de69ea69-5085-4350-afe6-83b42203db17 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:27.009532 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-de69ea69-5085-4350-afe6-83b42203db17 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:27.219663 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-7e2c7cea-8639-48d1-84b7-9db5599c475c tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6d1646ec094e3297f6f3c51dd72e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b105816fd4e54b9da4973ff721e1fb92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:27.236620 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-7e2c7cea-8639-48d1-84b7-9db5599c475c tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "GET /compute/v2.1/servers/84d00bab-3efd-4f19-8f48-8c4b2fba864a" status: 200 len: 1318 microversion: 2.1 time: 0.787723 Aug 27 02:43:27.252634 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 505/994] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:26 2022] GET /compute/v2.1/servers/84d00bab-3efd-4f19-8f48-8c4b2fba864a => generated 1318 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:27.270718 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e0f5cfa5-00fe-415e-a957-f023a020ef21 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:27.287763 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-e0f5cfa5-00fe-415e-a957-f023a020ef21 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] [instance: ccf87867-fb85-4b52-93f4-283450f636a4] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:27.302616 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e0f5cfa5-00fe-415e-a957-f023a020ef21 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:27.303119 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e0f5cfa5-00fe-415e-a957-f023a020ef21 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:27.304300 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e0f5cfa5-00fe-415e-a957-f023a020ef21 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:27.305057 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e0f5cfa5-00fe-415e-a957-f023a020ef21 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:27.310241 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e0f5cfa5-00fe-415e-a957-f023a020ef21 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:27.310747 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e0f5cfa5-00fe-415e-a957-f023a020ef21 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:27.345662 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-e0f5cfa5-00fe-415e-a957-f023a020ef21 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] HTTP exception thrown: Instance ccf87867-fb85-4b52-93f4-283450f636a4 could not be found. Aug 27 02:43:27.362538 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e0f5cfa5-00fe-415e-a957-f023a020ef21 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Request method failure captured: Aug 27 02:43:27.362538 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/servers/ccf87867-fb85-4b52-93f4-283450f636a4 HTTP/1.1 Aug 27 02:43:27.362538 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:43:27.362538 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:43:27.362538 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:43:27.362538 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:43:27.362538 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:43:27.362538 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:43:27.362538 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:43:27.362538 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:43:27.362538 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYQ_X2punHF_ZxGR-cMMRaQF9z7nniMIv7grBJe2MivnGKiSfINTqfzkubACrNLGS05TMfkwkrjuYnYuyHjS9wb-DVil3RxTI_0lghiii9USoln4Muadq-xMiAvvjYSpga6IL6TvwOawukSKMIiHPiVpnIcxnh3ceJfNC1YQ9qDSJRc Aug 27 02:43:27.362538 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:43:27.362538 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:43:27.362538 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:43:27.362538 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:43:27.362538 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:43:27.362538 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:43:27.362538 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: e4c28ddbdb164f01bb82235c6d49717b Aug 27 02:43:27.362538 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ServersAdminTestJSON-789816986 Aug 27 02:43:27.362538 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:43:27.362538 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:43:27.364047 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e4c28ddbdb164f01bb82235c6d49717b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_e4c28ddbdb164f01bb82235c6d49717b", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e4c28ddbdb164f01bb82235c6d49717b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/e4c28ddbdb164f01bb82235c6d49717b"}]}] Aug 27 02:43:27.364047 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ServersAdminTestJSON-789816986 Aug 27 02:43:27.364047 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: e4c28ddbdb164f01bb82235c6d49717b Aug 27 02:43:27.364047 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ServersAdminTestJSON-789816986 Aug 27 02:43:27.364047 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ServersAdminTestJSON-789816986-project Aug 27 02:43:27.364047 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:43:27.364047 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:43:27.364047 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 30abbf3afe304291981a6a9b85952aa3 Aug 27 02:43:27.364047 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ServersAdminTestJSON-789816986-project Aug 27 02:43:27.364047 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 02:43:27.364047 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance ccf87867-fb85-4b52-93f4-283450f636a4 could not be found. Aug 27 02:43:27.364047 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': 'ccf87867-fb85-4b52-93f4-283450f636a4'} Aug 27 02:43:27.365011 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:43:27.365011 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:43:27.365011 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:43:27.365011 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:43:27.365011 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:43:27.365011 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:43:27.365011 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:43:27.365011 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:43:27.365011 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:43:27.365011 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:43:27.365011 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ccf87867-fb85-4b52-93f4-283450f636a4 could not be found. Aug 27 02:43:27.365011 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:43:27.365011 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:43:27.365011 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:43:27.365011 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:43:27.365011 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:43:27.365011 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:43:27.365011 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:43:27.365011 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:43:27.365011 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:43:27.367044 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:43:27.367044 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:43:27.367044 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:43:27.367044 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:43:27.367044 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:43:27.367044 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:43:27.367044 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:43:27.367044 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ccf87867-fb85-4b52-93f4-283450f636a4 could not be found. Aug 27 02:43:27.367044 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:43:27.367044 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:43:27.367044 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:43:27.367044 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:43:27.367044 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:43:27.367044 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:43:27.367044 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:43:27.367044 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:43:27.367044 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ccf87867-fb85-4b52-93f4-283450f636a4 could not be found. Aug 27 02:43:27.367044 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:43:27.371572 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e0f5cfa5-00fe-415e-a957-f023a020ef21 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Returning 404 to user: Instance ccf87867-fb85-4b52-93f4-283450f636a4 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:43:27.373059 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e0f5cfa5-00fe-415e-a957-f023a020ef21 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] 10.222.0.70 "GET /compute/v2.1/servers/ccf87867-fb85-4b52-93f4-283450f636a4" status: 404 len: 111 microversion: 2.1 time: 0.116022 Aug 27 02:43:27.379928 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 506/995] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:27 2022] GET /compute/v2.1/servers/ccf87867-fb85-4b52-93f4-283450f636a4 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:43:27.394454 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ceedfbf8-793c-4e91-8f49-e0ef3cb143d9 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:27.395356 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-ceedfbf8-793c-4e91-8f49-e0ef3cb143d9 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] [instance: 9a6c0a3a-6693-4061-8765-cc07d3a5a1a0] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:27.414041 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ceedfbf8-793c-4e91-8f49-e0ef3cb143d9 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:27.414919 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ceedfbf8-793c-4e91-8f49-e0ef3cb143d9 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:27.415577 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ceedfbf8-793c-4e91-8f49-e0ef3cb143d9 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:27.417877 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ceedfbf8-793c-4e91-8f49-e0ef3cb143d9 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:27.419063 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ceedfbf8-793c-4e91-8f49-e0ef3cb143d9 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:27.421084 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ceedfbf8-793c-4e91-8f49-e0ef3cb143d9 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:27.496017 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-ceedfbf8-793c-4e91-8f49-e0ef3cb143d9 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] [instance: 9a6c0a3a-6693-4061-8765-cc07d3a5a1a0] Going to try to terminate instance {{(pid=134052) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:43:27.571890 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-de69ea69-5085-4350-afe6-83b42203db17 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:27.587040 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-de69ea69-5085-4350-afe6-83b42203db17 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:27.591612 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-de69ea69-5085-4350-afe6-83b42203db17 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:27.594498 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-de69ea69-5085-4350-afe6-83b42203db17 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/7eded9ca-c7bc-499a-bb53-a28d2c332402" status: 200 len: 1812 microversion: 2.25 time: 0.636203 Aug 27 02:43:27.597545 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 490/996] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:43:26 2022] GET /compute/v2.1/servers/7eded9ca-c7bc-499a-bb53-a28d2c332402 => generated 1812 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:43:27.631498 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:43:27.732757 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ceedfbf8-793c-4e91-8f49-e0ef3cb143d9 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] 10.222.0.70 "DELETE /compute/v2.1/servers/9a6c0a3a-6693-4061-8765-cc07d3a5a1a0" status: 204 len: 0 microversion: 2.1 time: 0.349186 Aug 27 02:43:27.733840 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 507/997] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:43:27 2022] DELETE /compute/v2.1/servers/9a6c0a3a-6693-4061-8765-cc07d3a5a1a0 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:43:27.742340 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-269b4662-d679-4a85-9b6d-5ce585272b6f tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:27.742952 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-269b4662-d679-4a85-9b6d-5ce585272b6f tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] [instance: 9a6c0a3a-6693-4061-8765-cc07d3a5a1a0] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:27.750984 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-269b4662-d679-4a85-9b6d-5ce585272b6f tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:27.756449 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-269b4662-d679-4a85-9b6d-5ce585272b6f tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:27.757062 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-269b4662-d679-4a85-9b6d-5ce585272b6f tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:27.763232 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-cf0cdf20-efdf-43cd-aa34-d92c55a9184b req-76152895-bc64-4fba-98f2-c492270b19c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ae31518-b08f-4255-a850-2b90b48ae7d4", "name": "network-vif-plugged", "status": "completed", "tag": "f5817098-1c90-4342-856e-1a55c19b7e1a"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:43:27.773892 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-269b4662-d679-4a85-9b6d-5ce585272b6f tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:27.774383 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-269b4662-d679-4a85-9b6d-5ce585272b6f tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:27.775262 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-269b4662-d679-4a85-9b6d-5ce585272b6f tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:27.787483 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-cf0cdf20-efdf-43cd-aa34-d92c55a9184b req-76152895-bc64-4fba-98f2-c492270b19c3 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:27.787984 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-cf0cdf20-efdf-43cd-aa34-d92c55a9184b req-76152895-bc64-4fba-98f2-c492270b19c3 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:27.791761 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-cf0cdf20-efdf-43cd-aa34-d92c55a9184b req-76152895-bc64-4fba-98f2-c492270b19c3 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:27.818115 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-cf0cdf20-efdf-43cd-aa34-d92c55a9184b req-76152895-bc64-4fba-98f2-c492270b19c3 service nova] Creating event network-vif-plugged:f5817098-1c90-4342-856e-1a55c19b7e1a for instance 0ae31518-b08f-4255-a850-2b90b48ae7d4 on n-h2-852278-4 Aug 27 02:43:27.828884 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-cf0cdf20-efdf-43cd-aa34-d92c55a9184b req-76152895-bc64-4fba-98f2-c492270b19c3 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069479 Aug 27 02:43:27.829795 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 508/998] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:43:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:43:27.980995 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f6fe6776-6318-4aaf-965f-b071fa80d2c1 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:27.982294 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-f6fe6776-6318-4aaf-965f-b071fa80d2c1 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] [instance: c03f5d7e-1851-47a0-9ec2-4b8b56e07c54] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:27.992178 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f6fe6776-6318-4aaf-965f-b071fa80d2c1 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:27.992656 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f6fe6776-6318-4aaf-965f-b071fa80d2c1 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:27.993013 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f6fe6776-6318-4aaf-965f-b071fa80d2c1 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:27.993667 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f6fe6776-6318-4aaf-965f-b071fa80d2c1 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:27.994139 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f6fe6776-6318-4aaf-965f-b071fa80d2c1 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:27.994512 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f6fe6776-6318-4aaf-965f-b071fa80d2c1 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:28.084811 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-269b4662-d679-4a85-9b6d-5ce585272b6f tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30abbf3afe304291981a6a9b85952aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c28ddbdb164f01bb82235c6d49717b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:28.099150 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-269b4662-d679-4a85-9b6d-5ce585272b6f tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] 10.222.0.70 "GET /compute/v2.1/servers/9a6c0a3a-6693-4061-8765-cc07d3a5a1a0" status: 200 len: 1468 microversion: 2.1 time: 0.359381 Aug 27 02:43:28.101037 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 491/999] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:27 2022] GET /compute/v2.1/servers/9a6c0a3a-6693-4061-8765-cc07d3a5a1a0 => generated 1468 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:28.152763 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-360dd779-161d-4276-aad2-05e744f01d7d req-1f89974d-888f-4757-85c5-e50818c5b905 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7eded9ca-c7bc-499a-bb53-a28d2c332402", "tag": "e0130326-860c-4234-8b0f-db61efc2a95a"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:43:28.177671 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-360dd779-161d-4276-aad2-05e744f01d7d req-1f89974d-888f-4757-85c5-e50818c5b905 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:28.179792 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-360dd779-161d-4276-aad2-05e744f01d7d req-1f89974d-888f-4757-85c5-e50818c5b905 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:28.182696 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-360dd779-161d-4276-aad2-05e744f01d7d req-1f89974d-888f-4757-85c5-e50818c5b905 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:28.213218 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-360dd779-161d-4276-aad2-05e744f01d7d req-1f89974d-888f-4757-85c5-e50818c5b905 service nova] Creating event network-changed:e0130326-860c-4234-8b0f-db61efc2a95a for instance 7eded9ca-c7bc-499a-bb53-a28d2c332402 on n-h1-852278-4 Aug 27 02:43:28.225713 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-360dd779-161d-4276-aad2-05e744f01d7d req-1f89974d-888f-4757-85c5-e50818c5b905 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078546 Aug 27 02:43:28.226734 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 492/1000] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:43:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:43:28.260193 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-30b2ccc4-9590-4e46-ab8d-215b5bb594f2 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:28.261452 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-30b2ccc4-9590-4e46-ab8d-215b5bb594f2 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: 84d00bab-3efd-4f19-8f48-8c4b2fba864a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:28.274181 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-30b2ccc4-9590-4e46-ab8d-215b5bb594f2 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:28.280006 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-30b2ccc4-9590-4e46-ab8d-215b5bb594f2 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:28.281387 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-30b2ccc4-9590-4e46-ab8d-215b5bb594f2 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:28.284774 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-30b2ccc4-9590-4e46-ab8d-215b5bb594f2 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:28.288134 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-30b2ccc4-9590-4e46-ab8d-215b5bb594f2 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:28.289498 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-30b2ccc4-9590-4e46-ab8d-215b5bb594f2 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:28.314093 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-f6fe6776-6318-4aaf-965f-b071fa80d2c1 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9653dac89d2648b285fd71c1b349e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3ac0c66c5b4bc787d2d6e12a957099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:28.324774 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f6fe6776-6318-4aaf-965f-b071fa80d2c1 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] 10.222.0.70 "GET /compute/v2.1/servers/c03f5d7e-1851-47a0-9ec2-4b8b56e07c54" status: 200 len: 1334 microversion: 2.1 time: 0.345886 Aug 27 02:43:28.327578 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 509/1001] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:27 2022] GET /compute/v2.1/servers/c03f5d7e-1851-47a0-9ec2-4b8b56e07c54 => generated 1334 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:43:28.543552 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-30b2ccc4-9590-4e46-ab8d-215b5bb594f2 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6d1646ec094e3297f6f3c51dd72e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b105816fd4e54b9da4973ff721e1fb92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:28.566035 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-30b2ccc4-9590-4e46-ab8d-215b5bb594f2 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "GET /compute/v2.1/servers/84d00bab-3efd-4f19-8f48-8c4b2fba864a" status: 200 len: 1468 microversion: 2.1 time: 0.308880 Aug 27 02:43:28.567924 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 493/1002] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:28 2022] GET /compute/v2.1/servers/84d00bab-3efd-4f19-8f48-8c4b2fba864a => generated 1468 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:43:28.599546 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-38aabe93-e749-4a22-80f2-f88fed022c6b tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:28.602213 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-38aabe93-e749-4a22-80f2-f88fed022c6b tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: 0ae31518-b08f-4255-a850-2b90b48ae7d4] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:28.611469 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-38aabe93-e749-4a22-80f2-f88fed022c6b tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:28.612131 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-38aabe93-e749-4a22-80f2-f88fed022c6b tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:28.612957 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-38aabe93-e749-4a22-80f2-f88fed022c6b tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:28.614541 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-38aabe93-e749-4a22-80f2-f88fed022c6b tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:28.615151 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-38aabe93-e749-4a22-80f2-f88fed022c6b tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:28.616172 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-38aabe93-e749-4a22-80f2-f88fed022c6b tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:28.625115 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ea89fd7f-bcbc-4030-83f3-781a717b6648 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:28.626272 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-ea89fd7f-bcbc-4030-83f3-781a717b6648 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: 7eded9ca-c7bc-499a-bb53-a28d2c332402] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:28.641464 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ea89fd7f-bcbc-4030-83f3-781a717b6648 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:28.646175 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ea89fd7f-bcbc-4030-83f3-781a717b6648 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:28.646721 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ea89fd7f-bcbc-4030-83f3-781a717b6648 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:28.648482 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ea89fd7f-bcbc-4030-83f3-781a717b6648 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:28.649324 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ea89fd7f-bcbc-4030-83f3-781a717b6648 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:28.649769 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ea89fd7f-bcbc-4030-83f3-781a717b6648 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:28.997615 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-ea89fd7f-bcbc-4030-83f3-781a717b6648 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:29.000773 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-38aabe93-e749-4a22-80f2-f88fed022c6b tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6d1646ec094e3297f6f3c51dd72e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b105816fd4e54b9da4973ff721e1fb92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:29.009425 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-ea89fd7f-bcbc-4030-83f3-781a717b6648 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:29.011270 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-ea89fd7f-bcbc-4030-83f3-781a717b6648 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:29.012579 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ea89fd7f-bcbc-4030-83f3-781a717b6648 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/7eded9ca-c7bc-499a-bb53-a28d2c332402" status: 200 len: 1812 microversion: 2.25 time: 0.393207 Aug 27 02:43:29.012954 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-38aabe93-e749-4a22-80f2-f88fed022c6b tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "GET /compute/v2.1/servers/0ae31518-b08f-4255-a850-2b90b48ae7d4" status: 200 len: 1318 microversion: 2.1 time: 0.426447 Aug 27 02:43:29.014018 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 510/1003] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:28 2022] GET /compute/v2.1/servers/0ae31518-b08f-4255-a850-2b90b48ae7d4 => generated 1318 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:29.026331 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 494/1004] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:43:28 2022] GET /compute/v2.1/servers/7eded9ca-c7bc-499a-bb53-a28d2c332402 => generated 1812 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:43:29.127431 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-2eaf51b8-1cf4-49cf-a0b1-acd591889cbe tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:29.129501 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-2eaf51b8-1cf4-49cf-a0b1-acd591889cbe tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] [instance: 9a6c0a3a-6693-4061-8765-cc07d3a5a1a0] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:29.139658 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2eaf51b8-1cf4-49cf-a0b1-acd591889cbe tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:29.154032 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2eaf51b8-1cf4-49cf-a0b1-acd591889cbe tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:29.154908 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2eaf51b8-1cf4-49cf-a0b1-acd591889cbe tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:29.155716 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2eaf51b8-1cf4-49cf-a0b1-acd591889cbe tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:29.168300 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2eaf51b8-1cf4-49cf-a0b1-acd591889cbe tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:29.168970 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2eaf51b8-1cf4-49cf-a0b1-acd591889cbe tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:29.347354 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f3a973a2-b08f-4084-88e3-b5c0f5bc3e7c tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:29.348604 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-f3a973a2-b08f-4084-88e3-b5c0f5bc3e7c tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] [instance: c03f5d7e-1851-47a0-9ec2-4b8b56e07c54] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:29.355555 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f3a973a2-b08f-4084-88e3-b5c0f5bc3e7c tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:29.356988 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f3a973a2-b08f-4084-88e3-b5c0f5bc3e7c tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:29.357549 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f3a973a2-b08f-4084-88e3-b5c0f5bc3e7c tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:29.358656 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f3a973a2-b08f-4084-88e3-b5c0f5bc3e7c tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:29.359385 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f3a973a2-b08f-4084-88e3-b5c0f5bc3e7c tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:29.359880 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f3a973a2-b08f-4084-88e3-b5c0f5bc3e7c tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:29.742742 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-2eaf51b8-1cf4-49cf-a0b1-acd591889cbe tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30abbf3afe304291981a6a9b85952aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c28ddbdb164f01bb82235c6d49717b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:29.757080 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-2eaf51b8-1cf4-49cf-a0b1-acd591889cbe tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] 10.222.0.70 "GET /compute/v2.1/servers/9a6c0a3a-6693-4061-8765-cc07d3a5a1a0" status: 200 len: 1468 microversion: 2.1 time: 0.640109 Aug 27 02:43:29.757976 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 511/1005] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:29 2022] GET /compute/v2.1/servers/9a6c0a3a-6693-4061-8765-cc07d3a5a1a0 => generated 1468 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:43:29.790759 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-3b0d2bcc-913d-43b4-a477-4d6359d7ecff req-022216e6-2950-4ed0-9b70-83905c3dd155 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c03f5d7e-1851-47a0-9ec2-4b8b56e07c54", "tag": "bfb5266d-2a65-4d40-b632-0d451d4e6526"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:43:29.807005 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-3b0d2bcc-913d-43b4-a477-4d6359d7ecff req-022216e6-2950-4ed0-9b70-83905c3dd155 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:29.808038 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-3b0d2bcc-913d-43b4-a477-4d6359d7ecff req-022216e6-2950-4ed0-9b70-83905c3dd155 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:29.808983 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-3b0d2bcc-913d-43b4-a477-4d6359d7ecff req-022216e6-2950-4ed0-9b70-83905c3dd155 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:29.838109 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-3b0d2bcc-913d-43b4-a477-4d6359d7ecff req-022216e6-2950-4ed0-9b70-83905c3dd155 service nova] Creating event network-changed:bfb5266d-2a65-4d40-b632-0d451d4e6526 for instance c03f5d7e-1851-47a0-9ec2-4b8b56e07c54 on n-h1-852278-4 Aug 27 02:43:29.844181 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-3b0d2bcc-913d-43b4-a477-4d6359d7ecff req-022216e6-2950-4ed0-9b70-83905c3dd155 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082944 Aug 27 02:43:29.845407 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 512/1006] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:43:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:43:29.863964 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-f3a973a2-b08f-4084-88e3-b5c0f5bc3e7c tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9653dac89d2648b285fd71c1b349e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3ac0c66c5b4bc787d2d6e12a957099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:29.875747 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-f3a973a2-b08f-4084-88e3-b5c0f5bc3e7c tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] 10.222.0.70 "GET /compute/v2.1/servers/c03f5d7e-1851-47a0-9ec2-4b8b56e07c54" status: 200 len: 1334 microversion: 2.1 time: 0.532166 Aug 27 02:43:29.890252 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 495/1007] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:29 2022] GET /compute/v2.1/servers/c03f5d7e-1851-47a0-9ec2-4b8b56e07c54 => generated 1334 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:29.959327 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-51824283-d706-4303-94d8-9fe123e95d8b tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:29.961579 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-51824283-d706-4303-94d8-9fe123e95d8b tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] [instance: 3095a9f9-6769-4107-94a5-beac6415694c] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:29.970493 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-51824283-d706-4303-94d8-9fe123e95d8b tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:29.972121 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-51824283-d706-4303-94d8-9fe123e95d8b tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:29.972851 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-51824283-d706-4303-94d8-9fe123e95d8b tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:29.974118 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-51824283-d706-4303-94d8-9fe123e95d8b tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:29.974968 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-51824283-d706-4303-94d8-9fe123e95d8b tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:29.976032 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-51824283-d706-4303-94d8-9fe123e95d8b tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:30.042571 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-672f8034-351d-4c5f-9dd4-b40a91514eae tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:30.045002 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-672f8034-351d-4c5f-9dd4-b40a91514eae tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: 0ae31518-b08f-4255-a850-2b90b48ae7d4] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:30.077873 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-672f8034-351d-4c5f-9dd4-b40a91514eae tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:30.080636 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-672f8034-351d-4c5f-9dd4-b40a91514eae tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:30.082352 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-672f8034-351d-4c5f-9dd4-b40a91514eae tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:30.085741 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-672f8034-351d-4c5f-9dd4-b40a91514eae tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:30.087919 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-672f8034-351d-4c5f-9dd4-b40a91514eae tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:30.089842 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-672f8034-351d-4c5f-9dd4-b40a91514eae tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:31.000899 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-51824283-d706-4303-94d8-9fe123e95d8b tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/3095a9f9-6769-4107-94a5-beac6415694c" status: 200 len: 1812 microversion: 2.1 time: 1.045760 Aug 27 02:43:31.002335 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 513/1008] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:29 2022] GET /compute/v2.1/servers/3095a9f9-6769-4107-94a5-beac6415694c => generated 1812 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:31.009825 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5e12a216-d707-489a-b6fa-67c98f3e3ae7 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:31.010951 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-5e12a216-d707-489a-b6fa-67c98f3e3ae7 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: 7eded9ca-c7bc-499a-bb53-a28d2c332402] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:31.021275 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-672f8034-351d-4c5f-9dd4-b40a91514eae tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6d1646ec094e3297f6f3c51dd72e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b105816fd4e54b9da4973ff721e1fb92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:31.027056 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5e12a216-d707-489a-b6fa-67c98f3e3ae7 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:31.027799 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5e12a216-d707-489a-b6fa-67c98f3e3ae7 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:31.029441 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5e12a216-d707-489a-b6fa-67c98f3e3ae7 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:31.034451 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5e12a216-d707-489a-b6fa-67c98f3e3ae7 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:31.035079 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-672f8034-351d-4c5f-9dd4-b40a91514eae tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "GET /compute/v2.1/servers/0ae31518-b08f-4255-a850-2b90b48ae7d4" status: 200 len: 1318 microversion: 2.1 time: 1.000673 Aug 27 02:43:31.036750 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 496/1009] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:30 2022] GET /compute/v2.1/servers/0ae31518-b08f-4255-a850-2b90b48ae7d4 => generated 1318 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:31.041503 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5e12a216-d707-489a-b6fa-67c98f3e3ae7 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:31.043017 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5e12a216-d707-489a-b6fa-67c98f3e3ae7 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:31.058466 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-fb0f503b-e7c9-4c9f-8abd-da2a0fb319c5 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:31.059638 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-fb0f503b-e7c9-4c9f-8abd-da2a0fb319c5 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] [instance: 9a6c0a3a-6693-4061-8765-cc07d3a5a1a0] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:31.079834 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fb0f503b-e7c9-4c9f-8abd-da2a0fb319c5 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:31.081240 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fb0f503b-e7c9-4c9f-8abd-da2a0fb319c5 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:31.083615 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fb0f503b-e7c9-4c9f-8abd-da2a0fb319c5 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:31.085637 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fb0f503b-e7c9-4c9f-8abd-da2a0fb319c5 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:31.086246 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fb0f503b-e7c9-4c9f-8abd-da2a0fb319c5 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:31.088985 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fb0f503b-e7c9-4c9f-8abd-da2a0fb319c5 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:31.162880 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=100 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:43:31.556337 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=8 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:43:32.131469 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-fb0f503b-e7c9-4c9f-8abd-da2a0fb319c5 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30abbf3afe304291981a6a9b85952aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c28ddbdb164f01bb82235c6d49717b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:32.145513 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-fb0f503b-e7c9-4c9f-8abd-da2a0fb319c5 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] 10.222.0.70 "GET /compute/v2.1/servers/9a6c0a3a-6693-4061-8765-cc07d3a5a1a0" status: 200 len: 1468 microversion: 2.1 time: 1.106310 Aug 27 02:43:32.147168 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 497/1010] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:31 2022] GET /compute/v2.1/servers/9a6c0a3a-6693-4061-8765-cc07d3a5a1a0 => generated 1468 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:32.153215 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d70c7945-7f4b-4449-99dc-793d63b180fe tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:32.154033 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d70c7945-7f4b-4449-99dc-793d63b180fe tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] [instance: c03f5d7e-1851-47a0-9ec2-4b8b56e07c54] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:32.175526 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d70c7945-7f4b-4449-99dc-793d63b180fe tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:32.176768 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d70c7945-7f4b-4449-99dc-793d63b180fe tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:32.178614 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d70c7945-7f4b-4449-99dc-793d63b180fe tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:32.183032 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d70c7945-7f4b-4449-99dc-793d63b180fe tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:32.183754 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d70c7945-7f4b-4449-99dc-793d63b180fe tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:32.185120 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d70c7945-7f4b-4449-99dc-793d63b180fe tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:32.221365 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-5e12a216-d707-489a-b6fa-67c98f3e3ae7 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:32.237363 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-5e12a216-d707-489a-b6fa-67c98f3e3ae7 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:32.253832 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-5e12a216-d707-489a-b6fa-67c98f3e3ae7 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:32.255142 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-5e12a216-d707-489a-b6fa-67c98f3e3ae7 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/7eded9ca-c7bc-499a-bb53-a28d2c332402" status: 200 len: 1812 microversion: 2.25 time: 1.251666 Aug 27 02:43:32.269741 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 514/1011] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:43:31 2022] GET /compute/v2.1/servers/7eded9ca-c7bc-499a-bb53-a28d2c332402 => generated 1812 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:43:32.277854 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d8d6e91d-e99d-4edc-b2c1-99e78c8e3627 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:32.281965 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d8d6e91d-e99d-4edc-b2c1-99e78c8e3627 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:32.282445 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d8d6e91d-e99d-4edc-b2c1-99e78c8e3627 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:32.282876 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d8d6e91d-e99d-4edc-b2c1-99e78c8e3627 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:32.283597 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d8d6e91d-e99d-4edc-b2c1-99e78c8e3627 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:32.284033 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d8d6e91d-e99d-4edc-b2c1-99e78c8e3627 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:32.284472 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d8d6e91d-e99d-4edc-b2c1-99e78c8e3627 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:32.348370 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d8d6e91d-e99d-4edc-b2c1-99e78c8e3627 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] 10.222.0.70 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.077344 Aug 27 02:43:32.348979 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 515/1012] 10.222.0.70 () {58 vars in 1176 bytes} [Sat Aug 27 02:43:32 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:43:32.362951 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a6fb8fd9-5630-4619-af6f-b92f3f5035f5 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:32.363570 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a6fb8fd9-5630-4619-af6f-b92f3f5035f5 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: 0ae31518-b08f-4255-a850-2b90b48ae7d4] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:32.380034 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a6fb8fd9-5630-4619-af6f-b92f3f5035f5 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:32.380553 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a6fb8fd9-5630-4619-af6f-b92f3f5035f5 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:32.380989 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a6fb8fd9-5630-4619-af6f-b92f3f5035f5 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:32.382200 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a6fb8fd9-5630-4619-af6f-b92f3f5035f5 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:32.382648 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a6fb8fd9-5630-4619-af6f-b92f3f5035f5 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:32.383062 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a6fb8fd9-5630-4619-af6f-b92f3f5035f5 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:33.171798 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-a6fb8fd9-5630-4619-af6f-b92f3f5035f5 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6d1646ec094e3297f6f3c51dd72e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b105816fd4e54b9da4973ff721e1fb92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:33.191765 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a6fb8fd9-5630-4619-af6f-b92f3f5035f5 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "GET /compute/v2.1/servers/0ae31518-b08f-4255-a850-2b90b48ae7d4" status: 200 len: 1468 microversion: 2.1 time: 0.841617 Aug 27 02:43:33.197998 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 516/1013] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:32 2022] GET /compute/v2.1/servers/0ae31518-b08f-4255-a850-2b90b48ae7d4 => generated 1468 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:33.206576 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d70c7945-7f4b-4449-99dc-793d63b180fe tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9653dac89d2648b285fd71c1b349e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3ac0c66c5b4bc787d2d6e12a957099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:33.225089 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-a09932fb-61cf-43b6-b2b4-a0ad8d88d0da req-2d6a9bc3-122c-4b3b-adbe-6635362b0745 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c03f5d7e-1851-47a0-9ec2-4b8b56e07c54", "tag": "c82cc2ac-43bc-4d6c-95ff-a1c1bd45069c"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:43:33.226141 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d70c7945-7f4b-4449-99dc-793d63b180fe tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] 10.222.0.70 "GET /compute/v2.1/servers/c03f5d7e-1851-47a0-9ec2-4b8b56e07c54" status: 200 len: 1334 microversion: 2.1 time: 1.077691 Aug 27 02:43:33.236225 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 498/1014] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:32 2022] GET /compute/v2.1/servers/c03f5d7e-1851-47a0-9ec2-4b8b56e07c54 => generated 1334 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:33.241157 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-94c965f4-ed4d-4437-82e2-a4e9cddce205 req-11afe8b5-59a7-4a0a-9778-80f1d3ee640a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a6c0a3a-6693-4061-8765-cc07d3a5a1a0", "name": "network-vif-deleted", "tag": "407758c7-cef6-48bb-a19a-31c45ab4f2fd"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:43:33.284163 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-a09932fb-61cf-43b6-b2b4-a0ad8d88d0da req-2d6a9bc3-122c-4b3b-adbe-6635362b0745 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:33.285176 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-a09932fb-61cf-43b6-b2b4-a0ad8d88d0da req-2d6a9bc3-122c-4b3b-adbe-6635362b0745 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:33.285643 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-a09932fb-61cf-43b6-b2b4-a0ad8d88d0da req-2d6a9bc3-122c-4b3b-adbe-6635362b0745 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:33.285790 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-94c965f4-ed4d-4437-82e2-a4e9cddce205 req-11afe8b5-59a7-4a0a-9778-80f1d3ee640a service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:33.286178 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-94c965f4-ed4d-4437-82e2-a4e9cddce205 req-11afe8b5-59a7-4a0a-9778-80f1d3ee640a service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:33.286610 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-94c965f4-ed4d-4437-82e2-a4e9cddce205 req-11afe8b5-59a7-4a0a-9778-80f1d3ee640a service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:33.312606 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-94c965f4-ed4d-4437-82e2-a4e9cddce205 req-11afe8b5-59a7-4a0a-9778-80f1d3ee640a service nova] Creating event network-vif-deleted:407758c7-cef6-48bb-a19a-31c45ab4f2fd for instance 9a6c0a3a-6693-4061-8765-cc07d3a5a1a0 on n-h2-852278-4 Aug 27 02:43:33.315506 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-a09932fb-61cf-43b6-b2b4-a0ad8d88d0da req-2d6a9bc3-122c-4b3b-adbe-6635362b0745 service nova] Creating event network-changed:c82cc2ac-43bc-4d6c-95ff-a1c1bd45069c for instance c03f5d7e-1851-47a0-9ec2-4b8b56e07c54 on n-h1-852278-4 Aug 27 02:43:33.332591 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-a09932fb-61cf-43b6-b2b4-a0ad8d88d0da req-2d6a9bc3-122c-4b3b-adbe-6635362b0745 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131228 Aug 27 02:43:33.333267 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-94c965f4-ed4d-4437-82e2-a4e9cddce205 req-11afe8b5-59a7-4a0a-9778-80f1d3ee640a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095672 Aug 27 02:43:33.334704 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 517/1015] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:43:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:43:33.337585 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 499/1016] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:43:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:43:33.344301 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-20b67702-d8ce-49c6-900e-64a207f13428 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:33.351013 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-20b67702-d8ce-49c6-900e-64a207f13428 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] [instance: 9a6c0a3a-6693-4061-8765-cc07d3a5a1a0] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:33.354552 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b8b86850-9d1d-4a91-9caa-f3cd3a08bc4c tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:33.364635 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-b8b86850-9d1d-4a91-9caa-f3cd3a08bc4c tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'eb6d1646ec094e3297f6f3c51dd72e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b105816fd4e54b9da4973ff721e1fb92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:33.365513 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b8b86850-9d1d-4a91-9caa-f3cd3a08bc4c tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Searching by: {'reservation_id': 'r-4t90d2gc', 'deleted': False, 'project_id': 'b105816fd4e54b9da4973ff721e1fb92'} {{(pid=134051) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 02:43:33.368374 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-20b67702-d8ce-49c6-900e-64a207f13428 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:33.369054 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-20b67702-d8ce-49c6-900e-64a207f13428 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:33.371746 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-20b67702-d8ce-49c6-900e-64a207f13428 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:33.372868 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-20b67702-d8ce-49c6-900e-64a207f13428 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:33.373521 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-20b67702-d8ce-49c6-900e-64a207f13428 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:33.382230 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-20b67702-d8ce-49c6-900e-64a207f13428 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:33.386505 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b8b86850-9d1d-4a91-9caa-f3cd3a08bc4c tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:33.386985 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b8b86850-9d1d-4a91-9caa-f3cd3a08bc4c tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:33.387408 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b8b86850-9d1d-4a91-9caa-f3cd3a08bc4c tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:33.388115 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b8b86850-9d1d-4a91-9caa-f3cd3a08bc4c tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:33.388583 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b8b86850-9d1d-4a91-9caa-f3cd3a08bc4c tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:33.388994 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b8b86850-9d1d-4a91-9caa-f3cd3a08bc4c tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:33.509598 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-20b67702-d8ce-49c6-900e-64a207f13428 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30abbf3afe304291981a6a9b85952aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c28ddbdb164f01bb82235c6d49717b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:33.521998 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-20b67702-d8ce-49c6-900e-64a207f13428 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] 10.222.0.70 "GET /compute/v2.1/servers/9a6c0a3a-6693-4061-8765-cc07d3a5a1a0" status: 200 len: 1298 microversion: 2.1 time: 0.184417 Aug 27 02:43:33.525556 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 518/1017] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:33 2022] GET /compute/v2.1/servers/9a6c0a3a-6693-4061-8765-cc07d3a5a1a0 => generated 1298 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:33.536898 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3422cc9a-086a-4d50-8341-bf08f75f6b65 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:33.538402 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-3422cc9a-086a-4d50-8341-bf08f75f6b65 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: 7eded9ca-c7bc-499a-bb53-a28d2c332402] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:33.553663 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3422cc9a-086a-4d50-8341-bf08f75f6b65 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:33.556803 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3422cc9a-086a-4d50-8341-bf08f75f6b65 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:33.557455 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3422cc9a-086a-4d50-8341-bf08f75f6b65 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:33.558556 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3422cc9a-086a-4d50-8341-bf08f75f6b65 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:33.559479 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3422cc9a-086a-4d50-8341-bf08f75f6b65 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:33.560813 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3422cc9a-086a-4d50-8341-bf08f75f6b65 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:33.598235 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.multi_cell_list [None req-b8b86850-9d1d-4a91-9caa-f3cd3a08bc4c tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=134051) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 02:43:33.762406 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-b8b86850-9d1d-4a91-9caa-f3cd3a08bc4c tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6d1646ec094e3297f6f3c51dd72e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b105816fd4e54b9da4973ff721e1fb92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:33.794098 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b8b86850-9d1d-4a91-9caa-f3cd3a08bc4c tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:33.794723 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b8b86850-9d1d-4a91-9caa-f3cd3a08bc4c tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:33.796350 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b8b86850-9d1d-4a91-9caa-f3cd3a08bc4c tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:34.201567 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b8b86850-9d1d-4a91-9caa-f3cd3a08bc4c tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "GET /compute/v2.1/servers/detail?reservation_id=r-4t90d2gc" status: 200 len: 2929 microversion: 2.1 time: 0.862632 Aug 27 02:43:34.202399 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 500/1018] 10.222.0.70 () {58 vars in 1197 bytes} [Sat Aug 27 02:43:33 2022] GET /compute/v2.1/servers/detail?reservation_id=r-4t90d2gc => generated 2929 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:34.232508 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8325e042-5163-466b-b7cf-f48f5580411d tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:34.271701 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.compute.server_groups [None req-8325e042-5163-466b-b7cf-f48f5580411d tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Querying cell 9e3f7cc8-d9cf-4064-9831-4fdba8cfa839(cell1) for 2 instances {{(pid=134051) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 27 02:43:34.273647 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8325e042-5163-466b-b7cf-f48f5580411d tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:34.274492 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8325e042-5163-466b-b7cf-f48f5580411d tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:34.274934 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8325e042-5163-466b-b7cf-f48f5580411d tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:34.276102 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-3422cc9a-086a-4d50-8341-bf08f75f6b65 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:34.288498 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-3422cc9a-086a-4d50-8341-bf08f75f6b65 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:34.300552 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-3422cc9a-086a-4d50-8341-bf08f75f6b65 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:34.302007 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-3422cc9a-086a-4d50-8341-bf08f75f6b65 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/7eded9ca-c7bc-499a-bb53-a28d2c332402" status: 200 len: 1812 microversion: 2.25 time: 0.775091 Aug 27 02:43:34.307002 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 519/1019] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:43:33 2022] GET /compute/v2.1/servers/7eded9ca-c7bc-499a-bb53-a28d2c332402 => generated 1812 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:43:34.313387 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f671a8df-db8b-42b4-9a74-bb3fb8876736 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:34.321917 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-f671a8df-db8b-42b4-9a74-bb3fb8876736 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] [instance: c03f5d7e-1851-47a0-9ec2-4b8b56e07c54] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:34.334496 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f671a8df-db8b-42b4-9a74-bb3fb8876736 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:34.335301 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f671a8df-db8b-42b4-9a74-bb3fb8876736 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:34.336048 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f671a8df-db8b-42b4-9a74-bb3fb8876736 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:34.342565 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f671a8df-db8b-42b4-9a74-bb3fb8876736 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:34.355145 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f671a8df-db8b-42b4-9a74-bb3fb8876736 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:34.356249 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f671a8df-db8b-42b4-9a74-bb3fb8876736 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:34.389677 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-8325e042-5163-466b-b7cf-f48f5580411d tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "GET /compute/v2.1/os-server-groups/d6951e38-a1eb-49d7-a141-12a7a22c2fe4" status: 200 len: 265 microversion: 2.1 time: 0.159226 Aug 27 02:43:34.391425 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 501/1020] 10.222.0.70 () {58 vars in 1263 bytes} [Sat Aug 27 02:43:34 2022] GET /compute/v2.1/os-server-groups/d6951e38-a1eb-49d7-a141-12a7a22c2fe4 => generated 265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:43:34.424105 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-5e4f666d-8098-4684-badc-5d2f3ebd84c2 tempest-ServersOnMultiNodesTest-986315705 tempest-ServersOnMultiNodesTest-986315705-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:34.424938 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-5e4f666d-8098-4684-badc-5d2f3ebd84c2 tempest-ServersOnMultiNodesTest-986315705 tempest-ServersOnMultiNodesTest-986315705-project-admin] [instance: 0ae31518-b08f-4255-a850-2b90b48ae7d4] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:34.463800 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5e4f666d-8098-4684-badc-5d2f3ebd84c2 tempest-ServersOnMultiNodesTest-986315705 tempest-ServersOnMultiNodesTest-986315705-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:34.468988 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5e4f666d-8098-4684-badc-5d2f3ebd84c2 tempest-ServersOnMultiNodesTest-986315705 tempest-ServersOnMultiNodesTest-986315705-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:34.469671 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5e4f666d-8098-4684-badc-5d2f3ebd84c2 tempest-ServersOnMultiNodesTest-986315705 tempest-ServersOnMultiNodesTest-986315705-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:34.470613 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5e4f666d-8098-4684-badc-5d2f3ebd84c2 tempest-ServersOnMultiNodesTest-986315705 tempest-ServersOnMultiNodesTest-986315705-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:34.471428 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5e4f666d-8098-4684-badc-5d2f3ebd84c2 tempest-ServersOnMultiNodesTest-986315705 tempest-ServersOnMultiNodesTest-986315705-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:34.472390 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5e4f666d-8098-4684-badc-5d2f3ebd84c2 tempest-ServersOnMultiNodesTest-986315705 tempest-ServersOnMultiNodesTest-986315705-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:35.235926 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-f671a8df-db8b-42b4-9a74-bb3fb8876736 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9653dac89d2648b285fd71c1b349e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3ac0c66c5b4bc787d2d6e12a957099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:35.248381 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f671a8df-db8b-42b4-9a74-bb3fb8876736 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] 10.222.0.70 "GET /compute/v2.1/servers/c03f5d7e-1851-47a0-9ec2-4b8b56e07c54" status: 200 len: 1334 microversion: 2.1 time: 0.937042 Aug 27 02:43:35.250311 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 520/1021] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:34 2022] GET /compute/v2.1/servers/c03f5d7e-1851-47a0-9ec2-4b8b56e07c54 => generated 1334 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:35.270111 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-5e4f666d-8098-4684-badc-5d2f3ebd84c2 tempest-ServersOnMultiNodesTest-986315705 tempest-ServersOnMultiNodesTest-986315705-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/0ae31518-b08f-4255-a850-2b90b48ae7d4" status: 200 len: 1619 microversion: 2.1 time: 0.870903 Aug 27 02:43:35.271126 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 502/1022] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:34 2022] GET /compute/v2.1/servers/0ae31518-b08f-4255-a850-2b90b48ae7d4 => generated 1619 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:35.274549 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9d38208b-43a5-45ca-a40b-17ddc2cb3fbc tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:35.276553 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-9d38208b-43a5-45ca-a40b-17ddc2cb3fbc tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] [instance: 9a6c0a3a-6693-4061-8765-cc07d3a5a1a0] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:35.290942 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9d38208b-43a5-45ca-a40b-17ddc2cb3fbc tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:35.292805 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9d38208b-43a5-45ca-a40b-17ddc2cb3fbc tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:35.293568 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9d38208b-43a5-45ca-a40b-17ddc2cb3fbc tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:35.299738 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e41abcca-827e-4e85-8210-6ae0b4468b1f tempest-ServersOnMultiNodesTest-986315705 tempest-ServersOnMultiNodesTest-986315705-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:35.300664 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-e41abcca-827e-4e85-8210-6ae0b4468b1f tempest-ServersOnMultiNodesTest-986315705 tempest-ServersOnMultiNodesTest-986315705-project-admin] [instance: 84d00bab-3efd-4f19-8f48-8c4b2fba864a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:35.305008 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=100 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:43:35.307392 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9d38208b-43a5-45ca-a40b-17ddc2cb3fbc tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:35.318601 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9d38208b-43a5-45ca-a40b-17ddc2cb3fbc tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:35.321959 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e41abcca-827e-4e85-8210-6ae0b4468b1f tempest-ServersOnMultiNodesTest-986315705 tempest-ServersOnMultiNodesTest-986315705-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:35.322722 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9d38208b-43a5-45ca-a40b-17ddc2cb3fbc tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:35.328914 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e41abcca-827e-4e85-8210-6ae0b4468b1f tempest-ServersOnMultiNodesTest-986315705 tempest-ServersOnMultiNodesTest-986315705-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:35.334566 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e41abcca-827e-4e85-8210-6ae0b4468b1f tempest-ServersOnMultiNodesTest-986315705 tempest-ServersOnMultiNodesTest-986315705-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:35.335704 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e41abcca-827e-4e85-8210-6ae0b4468b1f tempest-ServersOnMultiNodesTest-986315705 tempest-ServersOnMultiNodesTest-986315705-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:35.336941 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e41abcca-827e-4e85-8210-6ae0b4468b1f tempest-ServersOnMultiNodesTest-986315705 tempest-ServersOnMultiNodesTest-986315705-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:35.337617 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e41abcca-827e-4e85-8210-6ae0b4468b1f tempest-ServersOnMultiNodesTest-986315705 tempest-ServersOnMultiNodesTest-986315705-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:35.433328 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9d38208b-43a5-45ca-a40b-17ddc2cb3fbc tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:35.434977 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9d38208b-43a5-45ca-a40b-17ddc2cb3fbc tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:35.437539 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9d38208b-43a5-45ca-a40b-17ddc2cb3fbc tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:35.438915 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.instance [None req-9d38208b-43a5-45ca-a40b-17ddc2cb3fbc tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lazy-loading 'fault' on Instance uuid 9a6c0a3a-6693-4061-8765-cc07d3a5a1a0 {{(pid=134052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:43:35.619736 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-9d38208b-43a5-45ca-a40b-17ddc2cb3fbc tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30abbf3afe304291981a6a9b85952aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c28ddbdb164f01bb82235c6d49717b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:35.640378 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e41abcca-827e-4e85-8210-6ae0b4468b1f tempest-ServersOnMultiNodesTest-986315705 tempest-ServersOnMultiNodesTest-986315705-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/84d00bab-3efd-4f19-8f48-8c4b2fba864a" status: 200 len: 1619 microversion: 2.1 time: 0.343065 Aug 27 02:43:35.644409 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 503/1023] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:35 2022] GET /compute/v2.1/servers/84d00bab-3efd-4f19-8f48-8c4b2fba864a => generated 1619 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:35.662637 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8ea2f0d8-ea3a-4af3-b9cb-fc8fab3274ae tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:35.663347 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-8ea2f0d8-ea3a-4af3-b9cb-fc8fab3274ae tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: 7eded9ca-c7bc-499a-bb53-a28d2c332402] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:35.665696 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9d38208b-43a5-45ca-a40b-17ddc2cb3fbc tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] 10.222.0.70 "GET /compute/v2.1/servers/9a6c0a3a-6693-4061-8765-cc07d3a5a1a0" status: 200 len: 1303 microversion: 2.1 time: 0.411571 Aug 27 02:43:35.666385 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 521/1024] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:35 2022] GET /compute/v2.1/servers/9a6c0a3a-6693-4061-8765-cc07d3a5a1a0 => generated 1303 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:35.690324 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e52b72c4-8138-4a75-979c-33614a59be90 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Action: 'create', calling method: .version_select at 0x7f5ee2f9d3a0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1810000805", "policies": ["anti-affinity"]}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:43:35.700119 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8ea2f0d8-ea3a-4af3-b9cb-fc8fab3274ae tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:35.700861 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8ea2f0d8-ea3a-4af3-b9cb-fc8fab3274ae tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:35.701496 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8ea2f0d8-ea3a-4af3-b9cb-fc8fab3274ae tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:35.702798 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8ea2f0d8-ea3a-4af3-b9cb-fc8fab3274ae tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:35.703552 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8ea2f0d8-ea3a-4af3-b9cb-fc8fab3274ae tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:35.704286 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8ea2f0d8-ea3a-4af3-b9cb-fc8fab3274ae tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:35.746179 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:43:35.783102 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-e52b72c4-8138-4a75-979c-33614a59be90 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Getting quotas for project b105816fd4e54b9da4973ff721e1fb92. Resources: {'server_groups'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:43:35.806093 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-e52b72c4-8138-4a75-979c-33614a59be90 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Getting quotas for user eb6d1646ec094e3297f6f3c51dd72e85 and project b105816fd4e54b9da4973ff721e1fb92. Resources: {'server_groups'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:43:35.906292 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-e52b72c4-8138-4a75-979c-33614a59be90 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Getting quotas for project b105816fd4e54b9da4973ff721e1fb92. Resources: {'server_groups'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:43:35.912574 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-e52b72c4-8138-4a75-979c-33614a59be90 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Getting quotas for user eb6d1646ec094e3297f6f3c51dd72e85 and project b105816fd4e54b9da4973ff721e1fb92. Resources: {'server_groups'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:43:35.930846 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e52b72c4-8138-4a75-979c-33614a59be90 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.258964 Aug 27 02:43:35.932526 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 522/1025] 10.222.0.70 () {60 vars in 1174 bytes} [Sat Aug 27 02:43:35 2022] POST /compute/v2.1/os-server-groups => generated 193 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:43:36.095520 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0d878c3f-0baf-469c-ba26-8bc69dcde080 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1617241523", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "8c76dad9-8b1d-4581-a97a-c6ecd0a004e4"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:43:36.181658 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.network.neutron [None req-0d878c3f-0baf-469c-ba26-8bc69dcde080 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] validate_networks() for None {{(pid=134052) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:43:36.542437 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-8ea2f0d8-ea3a-4af3-b9cb-fc8fab3274ae tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:36.556077 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-8ea2f0d8-ea3a-4af3-b9cb-fc8fab3274ae tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:36.559400 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-8ea2f0d8-ea3a-4af3-b9cb-fc8fab3274ae tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:36.565554 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-8ea2f0d8-ea3a-4af3-b9cb-fc8fab3274ae tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/7eded9ca-c7bc-499a-bb53-a28d2c332402" status: 200 len: 1812 microversion: 2.25 time: 0.914919 Aug 27 02:43:36.567031 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 504/1026] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:43:35 2022] GET /compute/v2.1/servers/7eded9ca-c7bc-499a-bb53-a28d2c332402 => generated 1812 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:43:36.573190 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-9b33c268-9938-4257-8702-57ab10958934 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:36.577974 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-9b33c268-9938-4257-8702-57ab10958934 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] [instance: c03f5d7e-1851-47a0-9ec2-4b8b56e07c54] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:36.596278 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9b33c268-9938-4257-8702-57ab10958934 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:36.603356 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9b33c268-9938-4257-8702-57ab10958934 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:36.603814 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9b33c268-9938-4257-8702-57ab10958934 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:36.604688 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9b33c268-9938-4257-8702-57ab10958934 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:36.605345 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9b33c268-9938-4257-8702-57ab10958934 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:36.605970 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9b33c268-9938-4257-8702-57ab10958934 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:37.171376 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-9b33c268-9938-4257-8702-57ab10958934 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9653dac89d2648b285fd71c1b349e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3ac0c66c5b4bc787d2d6e12a957099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:37.187259 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-9b33c268-9938-4257-8702-57ab10958934 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] 10.222.0.70 "GET /compute/v2.1/servers/c03f5d7e-1851-47a0-9ec2-4b8b56e07c54" status: 200 len: 1334 microversion: 2.1 time: 0.618862 Aug 27 02:43:37.205384 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 505/1027] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:36 2022] GET /compute/v2.1/servers/c03f5d7e-1851-47a0-9ec2-4b8b56e07c54 => generated 1334 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:37.220757 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e148504a-d0b7-41ea-a47d-a7212642775d tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:37.221789 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-e148504a-d0b7-41ea-a47d-a7212642775d tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] [instance: 9a6c0a3a-6693-4061-8765-cc07d3a5a1a0] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:37.233308 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e148504a-d0b7-41ea-a47d-a7212642775d tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:37.236917 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e148504a-d0b7-41ea-a47d-a7212642775d tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:37.238025 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e148504a-d0b7-41ea-a47d-a7212642775d tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:37.238932 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e148504a-d0b7-41ea-a47d-a7212642775d tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:37.239542 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e148504a-d0b7-41ea-a47d-a7212642775d tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:37.240264 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e148504a-d0b7-41ea-a47d-a7212642775d tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:37.261564 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-0d878c3f-0baf-469c-ba26-8bc69dcde080 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Flavor limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:43:37.262057 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-0d878c3f-0baf-469c-ba26-8bc69dcde080 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Image limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:43:37.262453 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-0d878c3f-0baf-469c-ba26-8bc69dcde080 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Flavor pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:43:37.262853 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-0d878c3f-0baf-469c-ba26-8bc69dcde080 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Image pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:43:37.263256 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-0d878c3f-0baf-469c-ba26-8bc69dcde080 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:43:37.276982 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-e148504a-d0b7-41ea-a47d-a7212642775d tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] HTTP exception thrown: Instance 9a6c0a3a-6693-4061-8765-cc07d3a5a1a0 could not be found. Aug 27 02:43:37.279034 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e148504a-d0b7-41ea-a47d-a7212642775d tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Request method failure captured: Aug 27 02:43:37.279034 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/9a6c0a3a-6693-4061-8765-cc07d3a5a1a0 HTTP/1.1 Aug 27 02:43:37.279034 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:43:37.279034 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:43:37.279034 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:43:37.279034 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:43:37.279034 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:43:37.279034 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:43:37.279034 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:43:37.279034 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:43:37.279034 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYQ_X2punHF_ZxGR-cMMRaQF9z7nniMIv7grBJe2MivnGKiSfINTqfzkubACrNLGS05TMfkwkrjuYnYuyHjS9wb-DVil3RxTI_0lghiii9USoln4Muadq-xMiAvvjYSpga6IL6TvwOawukSKMIiHPiVpnIcxnh3ceJfNC1YQ9qDSJRc Aug 27 02:43:37.279034 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:43:37.279034 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:43:37.279034 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:43:37.279034 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:43:37.279034 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:43:37.279034 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:43:37.279034 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: e4c28ddbdb164f01bb82235c6d49717b Aug 27 02:43:37.279034 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ServersAdminTestJSON-789816986 Aug 27 02:43:37.279034 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:43:37.279034 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:43:37.280839 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e4c28ddbdb164f01bb82235c6d49717b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_e4c28ddbdb164f01bb82235c6d49717b", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e4c28ddbdb164f01bb82235c6d49717b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/e4c28ddbdb164f01bb82235c6d49717b"}]}] Aug 27 02:43:37.280839 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ServersAdminTestJSON-789816986 Aug 27 02:43:37.280839 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: e4c28ddbdb164f01bb82235c6d49717b Aug 27 02:43:37.280839 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ServersAdminTestJSON-789816986 Aug 27 02:43:37.280839 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ServersAdminTestJSON-789816986-project Aug 27 02:43:37.280839 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:43:37.280839 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:43:37.280839 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 30abbf3afe304291981a6a9b85952aa3 Aug 27 02:43:37.280839 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ServersAdminTestJSON-789816986-project Aug 27 02:43:37.280839 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 02:43:37.280839 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance 9a6c0a3a-6693-4061-8765-cc07d3a5a1a0 could not be found. Aug 27 02:43:37.280839 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '9a6c0a3a-6693-4061-8765-cc07d3a5a1a0'} Aug 27 02:43:37.282028 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:43:37.282028 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:43:37.282028 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:43:37.282028 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:43:37.282028 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:43:37.282028 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:43:37.282028 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:43:37.282028 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:43:37.282028 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:43:37.282028 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:43:37.282028 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a6c0a3a-6693-4061-8765-cc07d3a5a1a0 could not be found. Aug 27 02:43:37.282028 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:43:37.282028 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:43:37.282028 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:43:37.282028 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:43:37.282028 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:43:37.282028 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:43:37.282028 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:43:37.282028 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:43:37.282028 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:43:37.283253 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:43:37.283253 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:43:37.283253 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:43:37.283253 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:43:37.283253 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:43:37.283253 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:43:37.283253 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:43:37.283253 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a6c0a3a-6693-4061-8765-cc07d3a5a1a0 could not be found. Aug 27 02:43:37.283253 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:43:37.283253 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:43:37.283253 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:43:37.283253 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:43:37.283253 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:43:37.283253 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:43:37.283253 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:43:37.283253 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:43:37.283253 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a6c0a3a-6693-4061-8765-cc07d3a5a1a0 could not be found. Aug 27 02:43:37.283253 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:43:37.285056 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e148504a-d0b7-41ea-a47d-a7212642775d tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Returning 404 to user: Instance 9a6c0a3a-6693-4061-8765-cc07d3a5a1a0 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:43:37.286094 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e148504a-d0b7-41ea-a47d-a7212642775d tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] 10.222.0.70 "GET /compute/v2.1/servers/9a6c0a3a-6693-4061-8765-cc07d3a5a1a0" status: 404 len: 111 microversion: 2.1 time: 0.079433 Aug 27 02:43:37.300476 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 506/1028] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:37 2022] GET /compute/v2.1/servers/9a6c0a3a-6693-4061-8765-cc07d3a5a1a0 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:43:37.306622 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0d878c3f-0baf-469c-ba26-8bc69dcde080 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:37.307740 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c7781888-74c5-411f-ba6f-3a120cdf354d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3edb4671-7829-4740-aae5-987034a684d6", "device": "/dev/xvdb"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:43:37.307913 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0d878c3f-0baf-469c-ba26-8bc69dcde080 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:37.309813 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0d878c3f-0baf-469c-ba26-8bc69dcde080 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:37.310762 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0d878c3f-0baf-469c-ba26-8bc69dcde080 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:37.311144 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-c7781888-74c5-411f-ba6f-3a120cdf354d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 3095a9f9-6769-4107-94a5-beac6415694c] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:37.311645 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0d878c3f-0baf-469c-ba26-8bc69dcde080 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:37.312257 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0d878c3f-0baf-469c-ba26-8bc69dcde080 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:37.330249 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c7781888-74c5-411f-ba6f-3a120cdf354d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:37.330601 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c7781888-74c5-411f-ba6f-3a120cdf354d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:37.331022 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c7781888-74c5-411f-ba6f-3a120cdf354d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:37.331751 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c7781888-74c5-411f-ba6f-3a120cdf354d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:37.332180 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c7781888-74c5-411f-ba6f-3a120cdf354d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:37.332623 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c7781888-74c5-411f-ba6f-3a120cdf354d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:37.341154 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-0d878c3f-0baf-469c-ba26-8bc69dcde080 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Getting quotas for project b105816fd4e54b9da4973ff721e1fb92. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:43:37.347717 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-0d878c3f-0baf-469c-ba26-8bc69dcde080 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Getting quotas for user eb6d1646ec094e3297f6f3c51dd72e85 and project b105816fd4e54b9da4973ff721e1fb92. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:43:37.364597 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-0d878c3f-0baf-469c-ba26-8bc69dcde080 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Going to run 2 instances... {{(pid=134052) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:43:37.367659 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-0d878c3f-0baf-469c-ba26-8bc69dcde080 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: 38a900db-3d56-4836-a2a9-a39fe28ab481] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134052) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:43:37.430200 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-0d878c3f-0baf-469c-ba26-8bc69dcde080 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=134052) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Aug 27 02:43:37.469485 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-0d878c3f-0baf-469c-ba26-8bc69dcde080 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Getting quotas for project b105816fd4e54b9da4973ff721e1fb92. Resources: {'server_group_members'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:43:37.479520 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-0d878c3f-0baf-469c-ba26-8bc69dcde080 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Getting quotas for user eb6d1646ec094e3297f6f3c51dd72e85 and project b105816fd4e54b9da4973ff721e1fb92. Resources: {'server_group_members'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:43:37.578727 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-0d878c3f-0baf-469c-ba26-8bc69dcde080 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Getting quotas for project b105816fd4e54b9da4973ff721e1fb92. Resources: {'server_group_members'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:43:37.586186 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-0d878c3f-0baf-469c-ba26-8bc69dcde080 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Getting quotas for user eb6d1646ec094e3297f6f3c51dd72e85 and project b105816fd4e54b9da4973ff721e1fb92. Resources: {'server_group_members'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:43:37.603760 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-0d878c3f-0baf-469c-ba26-8bc69dcde080 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: 9d4a6e6e-c4d0-4397-bf32-429ae2a252ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=38a900db-3d56-4836-a2a9-a39fe28ab481,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134052) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:43:37.674439 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-0d878c3f-0baf-469c-ba26-8bc69dcde080 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Getting quotas for project b105816fd4e54b9da4973ff721e1fb92. Resources: {'server_group_members'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:43:37.682233 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-0d878c3f-0baf-469c-ba26-8bc69dcde080 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Getting quotas for user eb6d1646ec094e3297f6f3c51dd72e85 and project b105816fd4e54b9da4973ff721e1fb92. Resources: {'server_group_members'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:43:37.779914 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-0d878c3f-0baf-469c-ba26-8bc69dcde080 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Getting quotas for project b105816fd4e54b9da4973ff721e1fb92. Resources: {'server_group_members'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:43:37.797562 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-0d878c3f-0baf-469c-ba26-8bc69dcde080 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Getting quotas for user eb6d1646ec094e3297f6f3c51dd72e85 and project b105816fd4e54b9da4973ff721e1fb92. Resources: {'server_group_members'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:43:37.877008 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-0d878c3f-0baf-469c-ba26-8bc69dcde080 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.788113 Aug 27 02:43:37.877951 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 523/1029] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 02:43:36 2022] POST /compute/v2.1/servers => generated 32 bytes in 1790 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Aug 27 02:43:37.884286 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-26330bc0-a29d-417c-8c45-339be091a82f tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:37.884807 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-26330bc0-a29d-417c-8c45-339be091a82f tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] [instance: 3ee4d4db-a1bb-4567-a20d-29003e67a295] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:37.908992 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:43:37.920570 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-26330bc0-a29d-417c-8c45-339be091a82f tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:37.921464 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-26330bc0-a29d-417c-8c45-339be091a82f tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:37.921920 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-26330bc0-a29d-417c-8c45-339be091a82f tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:37.922741 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-26330bc0-a29d-417c-8c45-339be091a82f tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:37.923188 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-26330bc0-a29d-417c-8c45-339be091a82f tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:37.923609 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-26330bc0-a29d-417c-8c45-339be091a82f tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:37.931806 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c7781888-74c5-411f-ba6f-3a120cdf354d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "POST /compute/v2.1/servers/3095a9f9-6769-4107-94a5-beac6415694c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.629708 Aug 27 02:43:37.935103 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 507/1030] 10.222.0.70 () {60 vars in 1323 bytes} [Sat Aug 27 02:43:37 2022] POST /compute/v2.1/servers/3095a9f9-6769-4107-94a5-beac6415694c/os-volume_attachments => generated 194 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:43:37.970663 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-03827dbd-a341-4863-b201-2802b7c99e96 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:37.974040 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-03827dbd-a341-4863-b201-2802b7c99e96 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: 7eded9ca-c7bc-499a-bb53-a28d2c332402] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:37.991858 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-26330bc0-a29d-417c-8c45-339be091a82f tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] [instance: 3ee4d4db-a1bb-4567-a20d-29003e67a295] Going to try to terminate instance {{(pid=134052) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:43:38.024163 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-03827dbd-a341-4863-b201-2802b7c99e96 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:38.024971 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-03827dbd-a341-4863-b201-2802b7c99e96 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:38.036191 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-03827dbd-a341-4863-b201-2802b7c99e96 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:38.038571 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-03827dbd-a341-4863-b201-2802b7c99e96 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:38.043797 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-03827dbd-a341-4863-b201-2802b7c99e96 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:38.045349 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-03827dbd-a341-4863-b201-2802b7c99e96 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:38.260160 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-26330bc0-a29d-417c-8c45-339be091a82f tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] 10.222.0.70 "DELETE /compute/v2.1/servers/3ee4d4db-a1bb-4567-a20d-29003e67a295" status: 204 len: 0 microversion: 2.1 time: 0.380833 Aug 27 02:43:38.263902 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 524/1031] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:43:37 2022] DELETE /compute/v2.1/servers/3ee4d4db-a1bb-4567-a20d-29003e67a295 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:43:38.269494 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-7b45285d-d2d8-4178-8055-14db74d68648 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:38.274372 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-7b45285d-d2d8-4178-8055-14db74d68648 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'eb6d1646ec094e3297f6f3c51dd72e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b105816fd4e54b9da4973ff721e1fb92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:38.275158 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-7b45285d-d2d8-4178-8055-14db74d68648 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Searching by: {'deleted': False, 'project_id': 'b105816fd4e54b9da4973ff721e1fb92'} {{(pid=134052) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 02:43:38.311698 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7b45285d-d2d8-4178-8055-14db74d68648 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:38.312723 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7b45285d-d2d8-4178-8055-14db74d68648 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:38.313158 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7b45285d-d2d8-4178-8055-14db74d68648 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:38.313914 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7b45285d-d2d8-4178-8055-14db74d68648 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:38.314356 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7b45285d-d2d8-4178-8055-14db74d68648 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:38.314767 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7b45285d-d2d8-4178-8055-14db74d68648 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:38.522039 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.multi_cell_list [None req-7b45285d-d2d8-4178-8055-14db74d68648 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=134052) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 02:43:38.615196 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:43:38.656596 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-7b45285d-d2d8-4178-8055-14db74d68648 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "GET /compute/v2.1/servers" status: 200 len: 1664 microversion: 2.1 time: 0.391174 Aug 27 02:43:38.657478 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 525/1032] 10.222.0.70 () {58 vars in 1125 bytes} [Sat Aug 27 02:43:38 2022] GET /compute/v2.1/servers => generated 1664 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:38.675513 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-28a7989f-a36f-4c51-8f12-dcf99f5a58a5 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:38.678211 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-28a7989f-a36f-4c51-8f12-dcf99f5a58a5 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] [instance: c03f5d7e-1851-47a0-9ec2-4b8b56e07c54] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:38.697878 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-28a7989f-a36f-4c51-8f12-dcf99f5a58a5 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:38.699714 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-28a7989f-a36f-4c51-8f12-dcf99f5a58a5 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:38.701692 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-28a7989f-a36f-4c51-8f12-dcf99f5a58a5 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:38.704545 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-28a7989f-a36f-4c51-8f12-dcf99f5a58a5 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:38.705929 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-28a7989f-a36f-4c51-8f12-dcf99f5a58a5 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:38.706563 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-28a7989f-a36f-4c51-8f12-dcf99f5a58a5 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:39.235116 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-03827dbd-a341-4863-b201-2802b7c99e96 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:39.258625 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-03827dbd-a341-4863-b201-2802b7c99e96 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:39.260090 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-03827dbd-a341-4863-b201-2802b7c99e96 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:39.262683 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-03827dbd-a341-4863-b201-2802b7c99e96 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/7eded9ca-c7bc-499a-bb53-a28d2c332402" status: 200 len: 1812 microversion: 2.25 time: 1.326230 Aug 27 02:43:39.266209 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 508/1033] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:43:37 2022] GET /compute/v2.1/servers/7eded9ca-c7bc-499a-bb53-a28d2c332402 => generated 1812 bytes in 1330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:43:39.280471 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-5d5cb8b4-7c1c-4a5e-b315-5d4e206dcced tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:39.281574 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-5d5cb8b4-7c1c-4a5e-b315-5d4e206dcced tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] [instance: 3ee4d4db-a1bb-4567-a20d-29003e67a295] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:39.308345 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5d5cb8b4-7c1c-4a5e-b315-5d4e206dcced tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:39.317245 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5d5cb8b4-7c1c-4a5e-b315-5d4e206dcced tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:39.317698 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5d5cb8b4-7c1c-4a5e-b315-5d4e206dcced tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:39.318467 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5d5cb8b4-7c1c-4a5e-b315-5d4e206dcced tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:39.318920 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5d5cb8b4-7c1c-4a5e-b315-5d4e206dcced tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:39.319344 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5d5cb8b4-7c1c-4a5e-b315-5d4e206dcced tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:40.254193 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-28a7989f-a36f-4c51-8f12-dcf99f5a58a5 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9653dac89d2648b285fd71c1b349e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3ac0c66c5b4bc787d2d6e12a957099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:40.275529 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-28a7989f-a36f-4c51-8f12-dcf99f5a58a5 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] 10.222.0.70 "GET /compute/v2.1/servers/c03f5d7e-1851-47a0-9ec2-4b8b56e07c54" status: 200 len: 1334 microversion: 2.1 time: 1.598504 Aug 27 02:43:40.281145 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 526/1034] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:38 2022] GET /compute/v2.1/servers/c03f5d7e-1851-47a0-9ec2-4b8b56e07c54 => generated 1334 bytes in 1623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:40.299527 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-fca3dbb7-f51f-4b2e-84f1-e41591a8f53e tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:40.300160 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-fca3dbb7-f51f-4b2e-84f1-e41591a8f53e tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: 9d4a6e6e-c4d0-4397-bf32-429ae2a252ba] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:40.315816 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fca3dbb7-f51f-4b2e-84f1-e41591a8f53e tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:40.320901 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fca3dbb7-f51f-4b2e-84f1-e41591a8f53e tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:40.321364 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fca3dbb7-f51f-4b2e-84f1-e41591a8f53e tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:40.326336 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fca3dbb7-f51f-4b2e-84f1-e41591a8f53e tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:40.327516 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fca3dbb7-f51f-4b2e-84f1-e41591a8f53e tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:40.328223 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fca3dbb7-f51f-4b2e-84f1-e41591a8f53e tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:40.621362 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-5d5cb8b4-7c1c-4a5e-b315-5d4e206dcced tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30abbf3afe304291981a6a9b85952aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c28ddbdb164f01bb82235c6d49717b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:40.640728 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-5d5cb8b4-7c1c-4a5e-b315-5d4e206dcced tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] 10.222.0.70 "GET /compute/v2.1/servers/3ee4d4db-a1bb-4567-a20d-29003e67a295" status: 200 len: 1469 microversion: 2.1 time: 1.373067 Aug 27 02:43:40.655740 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 509/1035] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:39 2022] GET /compute/v2.1/servers/3ee4d4db-a1bb-4567-a20d-29003e67a295 => generated 1469 bytes in 1389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:40.681754 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3e18891e-7173-4861-909c-e8b6c0163fee tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:40.682888 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-3e18891e-7173-4861-909c-e8b6c0163fee tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: 7eded9ca-c7bc-499a-bb53-a28d2c332402] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:40.710505 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3e18891e-7173-4861-909c-e8b6c0163fee tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:40.712625 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3e18891e-7173-4861-909c-e8b6c0163fee tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:40.717372 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3e18891e-7173-4861-909c-e8b6c0163fee tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:40.721887 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3e18891e-7173-4861-909c-e8b6c0163fee tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:40.723676 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3e18891e-7173-4861-909c-e8b6c0163fee tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:40.737157 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3e18891e-7173-4861-909c-e8b6c0163fee tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:41.992837 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-fca3dbb7-f51f-4b2e-84f1-e41591a8f53e tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6d1646ec094e3297f6f3c51dd72e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b105816fd4e54b9da4973ff721e1fb92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:42.004603 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-fca3dbb7-f51f-4b2e-84f1-e41591a8f53e tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "GET /compute/v2.1/servers/9d4a6e6e-c4d0-4397-bf32-429ae2a252ba" status: 200 len: 1271 microversion: 2.1 time: 1.721399 Aug 27 02:43:42.023640 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 527/1036] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:40 2022] GET /compute/v2.1/servers/9d4a6e6e-c4d0-4397-bf32-429ae2a252ba => generated 1271 bytes in 1738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:42.035050 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-eadaa271-f18e-4644-bc4e-3e59bef45f67 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:42.035685 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-eadaa271-f18e-4644-bc4e-3e59bef45f67 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] [instance: c03f5d7e-1851-47a0-9ec2-4b8b56e07c54] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:42.048209 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-eadaa271-f18e-4644-bc4e-3e59bef45f67 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:42.048954 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-eadaa271-f18e-4644-bc4e-3e59bef45f67 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:42.049382 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-eadaa271-f18e-4644-bc4e-3e59bef45f67 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:42.050088 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-eadaa271-f18e-4644-bc4e-3e59bef45f67 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:42.061869 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-eadaa271-f18e-4644-bc4e-3e59bef45f67 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:42.062566 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-eadaa271-f18e-4644-bc4e-3e59bef45f67 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:43.463956 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=12 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:43:43.751150 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:43:44.397250 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-3e18891e-7173-4861-909c-e8b6c0163fee tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:44.403321 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-eadaa271-f18e-4644-bc4e-3e59bef45f67 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9653dac89d2648b285fd71c1b349e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3ac0c66c5b4bc787d2d6e12a957099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:44.425678 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-eadaa271-f18e-4644-bc4e-3e59bef45f67 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] 10.222.0.70 "GET /compute/v2.1/servers/c03f5d7e-1851-47a0-9ec2-4b8b56e07c54" status: 200 len: 1334 microversion: 2.1 time: 2.400663 Aug 27 02:43:44.426302 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 528/1037] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:42 2022] GET /compute/v2.1/servers/c03f5d7e-1851-47a0-9ec2-4b8b56e07c54 => generated 1334 bytes in 2402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:44.432627 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-3e18891e-7173-4861-909c-e8b6c0163fee tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:44.434190 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-3e18891e-7173-4861-909c-e8b6c0163fee tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:44.445943 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-3e18891e-7173-4861-909c-e8b6c0163fee tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/7eded9ca-c7bc-499a-bb53-a28d2c332402" status: 200 len: 1812 microversion: 2.25 time: 3.788710 Aug 27 02:43:44.447350 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 510/1038] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:43:40 2022] GET /compute/v2.1/servers/7eded9ca-c7bc-499a-bb53-a28d2c332402 => generated 1812 bytes in 3791 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:43:44.456354 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-738f82a8-d824-4cb1-92c0-4f91ef82c324 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:44.459768 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-738f82a8-d824-4cb1-92c0-4f91ef82c324 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] [instance: 3ee4d4db-a1bb-4567-a20d-29003e67a295] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:44.481023 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7e1b6d06-c5d2-4a47-9447-5cda0b554ddc tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:44.482751 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-7e1b6d06-c5d2-4a47-9447-5cda0b554ddc tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: 9d4a6e6e-c4d0-4397-bf32-429ae2a252ba] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:44.496285 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7e1b6d06-c5d2-4a47-9447-5cda0b554ddc tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:44.496849 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7e1b6d06-c5d2-4a47-9447-5cda0b554ddc tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:44.497266 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7e1b6d06-c5d2-4a47-9447-5cda0b554ddc tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:44.500385 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7e1b6d06-c5d2-4a47-9447-5cda0b554ddc tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:44.501252 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-738f82a8-d824-4cb1-92c0-4f91ef82c324 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:44.501927 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7e1b6d06-c5d2-4a47-9447-5cda0b554ddc tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:44.503891 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-738f82a8-d824-4cb1-92c0-4f91ef82c324 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:44.504602 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7e1b6d06-c5d2-4a47-9447-5cda0b554ddc tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:44.506125 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-738f82a8-d824-4cb1-92c0-4f91ef82c324 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:44.515649 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-738f82a8-d824-4cb1-92c0-4f91ef82c324 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:44.516506 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-738f82a8-d824-4cb1-92c0-4f91ef82c324 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:44.519191 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-738f82a8-d824-4cb1-92c0-4f91ef82c324 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:44.980806 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-738f82a8-d824-4cb1-92c0-4f91ef82c324 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30abbf3afe304291981a6a9b85952aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c28ddbdb164f01bb82235c6d49717b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:44.999412 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-738f82a8-d824-4cb1-92c0-4f91ef82c324 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] 10.222.0.70 "GET /compute/v2.1/servers/3ee4d4db-a1bb-4567-a20d-29003e67a295" status: 200 len: 1298 microversion: 2.1 time: 0.570220 Aug 27 02:43:45.000912 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 529/1039] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:44 2022] GET /compute/v2.1/servers/3ee4d4db-a1bb-4567-a20d-29003e67a295 => generated 1298 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:45.261077 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-13e45a26-f892-4098-b3c3-8703854ed7bd tempest-FloatingIPsTestJSON-487986886 tempest-FloatingIPsTestJSON-487986886-project] Action: 'create', calling method: .version_select at 0x7f5ee2e30dc0>, body: {"pool": null} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:43:46.032275 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-7e1b6d06-c5d2-4a47-9447-5cda0b554ddc tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6d1646ec094e3297f6f3c51dd72e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b105816fd4e54b9da4973ff721e1fb92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:46.052686 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-7e1b6d06-c5d2-4a47-9447-5cda0b554ddc tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "GET /compute/v2.1/servers/9d4a6e6e-c4d0-4397-bf32-429ae2a252ba" status: 200 len: 1319 microversion: 2.1 time: 1.601212 Aug 27 02:43:46.057053 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 511/1040] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:44 2022] GET /compute/v2.1/servers/9d4a6e6e-c4d0-4397-bf32-429ae2a252ba => generated 1319 bytes in 1608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:46.072863 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-8fc8b4fd-4e6a-43f6-91d6-8fd53f0e246d req-635a6154-ebeb-4202-a2ce-28149ae6801e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ee4d4db-a1bb-4567-a20d-29003e67a295", "name": "network-vif-deleted", "tag": "cb37d724-8fd4-499e-a131-e0d13d7b8f95"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:43:46.085206 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-8fc8b4fd-4e6a-43f6-91d6-8fd53f0e246d req-635a6154-ebeb-4202-a2ce-28149ae6801e service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:46.085969 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-8fc8b4fd-4e6a-43f6-91d6-8fd53f0e246d req-635a6154-ebeb-4202-a2ce-28149ae6801e service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:46.086817 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-8fc8b4fd-4e6a-43f6-91d6-8fd53f0e246d req-635a6154-ebeb-4202-a2ce-28149ae6801e service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:46.102524 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-8fc8b4fd-4e6a-43f6-91d6-8fd53f0e246d req-635a6154-ebeb-4202-a2ce-28149ae6801e service nova] Creating event network-vif-deleted:cb37d724-8fd4-499e-a131-e0d13d7b8f95 for instance 3ee4d4db-a1bb-4567-a20d-29003e67a295 on n-h2-852278-4 Aug 27 02:43:46.118923 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-8fc8b4fd-4e6a-43f6-91d6-8fd53f0e246d req-635a6154-ebeb-4202-a2ce-28149ae6801e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054883 Aug 27 02:43:46.120828 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 512/1041] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:43:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:43:46.143271 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-4fe72a0c-ca1e-42c5-97d6-af0845e1036e req-b7194534-20be-4729-9289-d81ad8c5a2eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d4a6e6e-c4d0-4397-bf32-429ae2a252ba", "tag": "1771be5b-38e4-4698-b32c-eae8637cc438"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:43:46.159195 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-4fe72a0c-ca1e-42c5-97d6-af0845e1036e req-b7194534-20be-4729-9289-d81ad8c5a2eb service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:46.159972 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-4fe72a0c-ca1e-42c5-97d6-af0845e1036e req-b7194534-20be-4729-9289-d81ad8c5a2eb service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:46.160835 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-4fe72a0c-ca1e-42c5-97d6-af0845e1036e req-b7194534-20be-4729-9289-d81ad8c5a2eb service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:46.178865 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-4fe72a0c-ca1e-42c5-97d6-af0845e1036e req-b7194534-20be-4729-9289-d81ad8c5a2eb service nova] Creating event network-changed:1771be5b-38e4-4698-b32c-eae8637cc438 for instance 9d4a6e6e-c4d0-4397-bf32-429ae2a252ba on n-h1-852278-4 Aug 27 02:43:46.188344 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-4fe72a0c-ca1e-42c5-97d6-af0845e1036e req-b7194534-20be-4729-9289-d81ad8c5a2eb service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065355 Aug 27 02:43:46.189626 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 513/1042] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:43:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:43:46.196449 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e6a2e527-58ac-46a8-874e-130706c641cc tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:46.198257 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-e6a2e527-58ac-46a8-874e-130706c641cc tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] [instance: c03f5d7e-1851-47a0-9ec2-4b8b56e07c54] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:46.211743 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e6a2e527-58ac-46a8-874e-130706c641cc tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:46.213172 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e6a2e527-58ac-46a8-874e-130706c641cc tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:46.215118 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e6a2e527-58ac-46a8-874e-130706c641cc tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:46.216532 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e6a2e527-58ac-46a8-874e-130706c641cc tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:46.218000 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e6a2e527-58ac-46a8-874e-130706c641cc tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:46.218749 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e6a2e527-58ac-46a8-874e-130706c641cc tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:47.805154 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=30 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:43:47.944380 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e6a2e527-58ac-46a8-874e-130706c641cc tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9653dac89d2648b285fd71c1b349e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3ac0c66c5b4bc787d2d6e12a957099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:47.953464 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:43:47.965081 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e6a2e527-58ac-46a8-874e-130706c641cc tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] 10.222.0.70 "GET /compute/v2.1/servers/c03f5d7e-1851-47a0-9ec2-4b8b56e07c54" status: 200 len: 1334 microversion: 2.1 time: 1.773911 Aug 27 02:43:47.968496 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 514/1043] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:46 2022] GET /compute/v2.1/servers/c03f5d7e-1851-47a0-9ec2-4b8b56e07c54 => generated 1334 bytes in 1778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:47.988687 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-306c6316-296b-417e-b99b-05c1d4960b5d tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:47.989868 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-306c6316-296b-417e-b99b-05c1d4960b5d tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: 7eded9ca-c7bc-499a-bb53-a28d2c332402] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:47.997164 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-306c6316-296b-417e-b99b-05c1d4960b5d tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:47.997713 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-306c6316-296b-417e-b99b-05c1d4960b5d tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:48.000946 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-306c6316-296b-417e-b99b-05c1d4960b5d tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:48.001692 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-306c6316-296b-417e-b99b-05c1d4960b5d tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:48.002166 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-306c6316-296b-417e-b99b-05c1d4960b5d tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:48.002557 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-306c6316-296b-417e-b99b-05c1d4960b5d tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:48.410962 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=18 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:43:48.634423 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-306c6316-296b-417e-b99b-05c1d4960b5d tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:48.647302 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-306c6316-296b-417e-b99b-05c1d4960b5d tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:48.649191 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-306c6316-296b-417e-b99b-05c1d4960b5d tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:48.650479 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-306c6316-296b-417e-b99b-05c1d4960b5d tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/7eded9ca-c7bc-499a-bb53-a28d2c332402" status: 200 len: 1812 microversion: 2.25 time: 0.680722 Aug 27 02:43:48.651120 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 515/1044] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:43:47 2022] GET /compute/v2.1/servers/7eded9ca-c7bc-499a-bb53-a28d2c332402 => generated 1812 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:43:48.656029 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-264904e8-e027-4678-b667-eb0e3b88f351 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:48.656897 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-264904e8-e027-4678-b667-eb0e3b88f351 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] [instance: 3ee4d4db-a1bb-4567-a20d-29003e67a295] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:48.663435 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-264904e8-e027-4678-b667-eb0e3b88f351 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:48.665439 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-264904e8-e027-4678-b667-eb0e3b88f351 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:48.666317 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-264904e8-e027-4678-b667-eb0e3b88f351 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:48.667082 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-264904e8-e027-4678-b667-eb0e3b88f351 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:48.667591 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-264904e8-e027-4678-b667-eb0e3b88f351 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:48.668014 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-264904e8-e027-4678-b667-eb0e3b88f351 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:48.685773 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-264904e8-e027-4678-b667-eb0e3b88f351 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] HTTP exception thrown: Instance 3ee4d4db-a1bb-4567-a20d-29003e67a295 could not be found. Aug 27 02:43:48.687600 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-264904e8-e027-4678-b667-eb0e3b88f351 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Request method failure captured: Aug 27 02:43:48.687600 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/3ee4d4db-a1bb-4567-a20d-29003e67a295 HTTP/1.1 Aug 27 02:43:48.687600 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:43:48.687600 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:43:48.687600 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:43:48.687600 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:43:48.687600 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:43:48.687600 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:43:48.687600 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:43:48.687600 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:43:48.687600 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYQ_X2punHF_ZxGR-cMMRaQF9z7nniMIv7grBJe2MivnGKiSfINTqfzkubACrNLGS05TMfkwkrjuYnYuyHjS9wb-DVil3RxTI_0lghiii9USoln4Muadq-xMiAvvjYSpga6IL6TvwOawukSKMIiHPiVpnIcxnh3ceJfNC1YQ9qDSJRc Aug 27 02:43:48.687600 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:43:48.687600 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:43:48.687600 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:43:48.687600 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:43:48.687600 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:43:48.687600 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:43:48.687600 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: e4c28ddbdb164f01bb82235c6d49717b Aug 27 02:43:48.687600 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ServersAdminTestJSON-789816986 Aug 27 02:43:48.687600 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:43:48.687600 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:43:48.689154 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e4c28ddbdb164f01bb82235c6d49717b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_e4c28ddbdb164f01bb82235c6d49717b", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e4c28ddbdb164f01bb82235c6d49717b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/e4c28ddbdb164f01bb82235c6d49717b"}]}] Aug 27 02:43:48.689154 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ServersAdminTestJSON-789816986 Aug 27 02:43:48.689154 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: e4c28ddbdb164f01bb82235c6d49717b Aug 27 02:43:48.689154 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ServersAdminTestJSON-789816986 Aug 27 02:43:48.689154 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ServersAdminTestJSON-789816986-project Aug 27 02:43:48.689154 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:43:48.689154 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:43:48.689154 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 30abbf3afe304291981a6a9b85952aa3 Aug 27 02:43:48.689154 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ServersAdminTestJSON-789816986-project Aug 27 02:43:48.689154 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 02:43:48.689154 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance 3ee4d4db-a1bb-4567-a20d-29003e67a295 could not be found. Aug 27 02:43:48.689154 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '3ee4d4db-a1bb-4567-a20d-29003e67a295'} Aug 27 02:43:48.690042 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:43:48.690042 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:43:48.690042 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:43:48.690042 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:43:48.690042 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:43:48.690042 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:43:48.690042 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:43:48.690042 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:43:48.690042 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:43:48.690042 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:43:48.690042 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ee4d4db-a1bb-4567-a20d-29003e67a295 could not be found. Aug 27 02:43:48.690042 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:43:48.690042 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:43:48.690042 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:43:48.690042 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:43:48.690042 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:43:48.690042 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:43:48.690042 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:43:48.690042 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:43:48.690042 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:43:48.691768 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:43:48.691768 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:43:48.691768 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:43:48.691768 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:43:48.691768 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:43:48.691768 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:43:48.691768 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:43:48.691768 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ee4d4db-a1bb-4567-a20d-29003e67a295 could not be found. Aug 27 02:43:48.691768 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:43:48.691768 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:43:48.691768 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:43:48.691768 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:43:48.691768 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:43:48.691768 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:43:48.691768 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:43:48.691768 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:43:48.691768 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ee4d4db-a1bb-4567-a20d-29003e67a295 could not be found. Aug 27 02:43:48.691768 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:43:48.698696 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-264904e8-e027-4678-b667-eb0e3b88f351 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] Returning 404 to user: Instance 3ee4d4db-a1bb-4567-a20d-29003e67a295 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:43:48.699592 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-264904e8-e027-4678-b667-eb0e3b88f351 tempest-ServersAdminTestJSON-789816986 tempest-ServersAdminTestJSON-789816986-project] 10.222.0.70 "GET /compute/v2.1/servers/3ee4d4db-a1bb-4567-a20d-29003e67a295" status: 404 len: 111 microversion: 2.1 time: 0.047155 Aug 27 02:43:48.700175 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 516/1045] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:48 2022] GET /compute/v2.1/servers/3ee4d4db-a1bb-4567-a20d-29003e67a295 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:43:48.715932 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-8bea2e98-8f47-49da-b75f-6efd8a27f201 req-fbfd9b2e-2d27-44e8-a7d8-fc8924d8c56b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c03f5d7e-1851-47a0-9ec2-4b8b56e07c54", "name": "network-vif-plugged", "status": "completed", "tag": "c82cc2ac-43bc-4d6c-95ff-a1c1bd45069c"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:43:48.739750 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-8bea2e98-8f47-49da-b75f-6efd8a27f201 req-fbfd9b2e-2d27-44e8-a7d8-fc8924d8c56b service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:48.740245 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-8bea2e98-8f47-49da-b75f-6efd8a27f201 req-fbfd9b2e-2d27-44e8-a7d8-fc8924d8c56b service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:48.740708 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-8bea2e98-8f47-49da-b75f-6efd8a27f201 req-fbfd9b2e-2d27-44e8-a7d8-fc8924d8c56b service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:48.769268 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-8bea2e98-8f47-49da-b75f-6efd8a27f201 req-fbfd9b2e-2d27-44e8-a7d8-fc8924d8c56b service nova] Creating event network-vif-plugged:c82cc2ac-43bc-4d6c-95ff-a1c1bd45069c for instance c03f5d7e-1851-47a0-9ec2-4b8b56e07c54 on n-h1-852278-4 Aug 27 02:43:48.775633 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-8bea2e98-8f47-49da-b75f-6efd8a27f201 req-fbfd9b2e-2d27-44e8-a7d8-fc8924d8c56b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068855 Aug 27 02:43:48.776958 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 517/1046] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:43:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:43:48.783420 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-19458256-6f2e-431a-bda6-7764c63a8ea0 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:48.784402 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-19458256-6f2e-431a-bda6-7764c63a8ea0 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: 9d4a6e6e-c4d0-4397-bf32-429ae2a252ba] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:48.794983 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-19458256-6f2e-431a-bda6-7764c63a8ea0 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:48.796142 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-19458256-6f2e-431a-bda6-7764c63a8ea0 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:48.797132 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-19458256-6f2e-431a-bda6-7764c63a8ea0 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:48.798231 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-19458256-6f2e-431a-bda6-7764c63a8ea0 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:48.798985 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-19458256-6f2e-431a-bda6-7764c63a8ea0 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:48.799805 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-19458256-6f2e-431a-bda6-7764c63a8ea0 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:49.305207 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-19458256-6f2e-431a-bda6-7764c63a8ea0 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6d1646ec094e3297f6f3c51dd72e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b105816fd4e54b9da4973ff721e1fb92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:49.318095 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-19458256-6f2e-431a-bda6-7764c63a8ea0 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "GET /compute/v2.1/servers/9d4a6e6e-c4d0-4397-bf32-429ae2a252ba" status: 200 len: 1319 microversion: 2.1 time: 0.539489 Aug 27 02:43:49.318681 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 518/1047] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:48 2022] GET /compute/v2.1/servers/9d4a6e6e-c4d0-4397-bf32-429ae2a252ba => generated 1319 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:49.332676 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-2a8aac77-beaf-42d2-ac60-98b1c1d9857f tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:49.334820 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-2a8aac77-beaf-42d2-ac60-98b1c1d9857f tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] [instance: c03f5d7e-1851-47a0-9ec2-4b8b56e07c54] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:49.351642 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2a8aac77-beaf-42d2-ac60-98b1c1d9857f tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:49.352138 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2a8aac77-beaf-42d2-ac60-98b1c1d9857f tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:49.352600 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2a8aac77-beaf-42d2-ac60-98b1c1d9857f tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:49.353310 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2a8aac77-beaf-42d2-ac60-98b1c1d9857f tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:49.356970 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2a8aac77-beaf-42d2-ac60-98b1c1d9857f tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:49.360170 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2a8aac77-beaf-42d2-ac60-98b1c1d9857f tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:50.821726 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-2a8aac77-beaf-42d2-ac60-98b1c1d9857f tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9653dac89d2648b285fd71c1b349e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3ac0c66c5b4bc787d2d6e12a957099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:50.833305 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-2a8aac77-beaf-42d2-ac60-98b1c1d9857f tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] 10.222.0.70 "GET /compute/v2.1/servers/c03f5d7e-1851-47a0-9ec2-4b8b56e07c54" status: 200 len: 1334 microversion: 2.1 time: 1.510970 Aug 27 02:43:50.840074 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 519/1048] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:49 2022] GET /compute/v2.1/servers/c03f5d7e-1851-47a0-9ec2-4b8b56e07c54 => generated 1334 bytes in 1518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:50.856649 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a0622555-2de1-4918-8111-db3ce53d6288 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:50.859595 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-a0622555-2de1-4918-8111-db3ce53d6288 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: 7eded9ca-c7bc-499a-bb53-a28d2c332402] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:50.880282 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a0622555-2de1-4918-8111-db3ce53d6288 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:50.880762 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a0622555-2de1-4918-8111-db3ce53d6288 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:50.881192 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a0622555-2de1-4918-8111-db3ce53d6288 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:50.894077 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a0622555-2de1-4918-8111-db3ce53d6288 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:50.894646 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a0622555-2de1-4918-8111-db3ce53d6288 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:50.897777 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a0622555-2de1-4918-8111-db3ce53d6288 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:52.375870 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-a0622555-2de1-4918-8111-db3ce53d6288 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:52.399542 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-a0622555-2de1-4918-8111-db3ce53d6288 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:52.403791 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-a0622555-2de1-4918-8111-db3ce53d6288 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:52.406336 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a0622555-2de1-4918-8111-db3ce53d6288 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/7eded9ca-c7bc-499a-bb53-a28d2c332402" status: 200 len: 1802 microversion: 2.25 time: 1.563217 Aug 27 02:43:52.409900 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 520/1049] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:43:50 2022] GET /compute/v2.1/servers/7eded9ca-c7bc-499a-bb53-a28d2c332402 => generated 1802 bytes in 1567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:43:52.416689 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c0fb5e99-363a-4399-8c95-d7c802599954 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:52.417302 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-c0fb5e99-363a-4399-8c95-d7c802599954 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: 9d4a6e6e-c4d0-4397-bf32-429ae2a252ba] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:52.426975 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c0fb5e99-363a-4399-8c95-d7c802599954 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:52.429440 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c0fb5e99-363a-4399-8c95-d7c802599954 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:52.430064 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c0fb5e99-363a-4399-8c95-d7c802599954 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:52.431443 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c0fb5e99-363a-4399-8c95-d7c802599954 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:52.438890 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c0fb5e99-363a-4399-8c95-d7c802599954 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:52.440571 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c0fb5e99-363a-4399-8c95-d7c802599954 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:52.689321 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-13e45a26-f892-4098-b3c3-8703854ed7bd tempest-FloatingIPsTestJSON-487986886 tempest-FloatingIPsTestJSON-487986886-project] 10.222.0.70 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 7.686291 Aug 27 02:43:52.689959 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 530/1050] 10.222.0.70 () {60 vars in 1170 bytes} [Sat Aug 27 02:43:45 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 7688 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:43:52.705366 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-3a69bea0-cf75-4e77-ac37-f2ba0439ab71 req-f3b08c82-ceae-4a42-a67c-1d402ebbe324 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c03f5d7e-1851-47a0-9ec2-4b8b56e07c54", "name": "network-vif-plugged", "status": "completed", "tag": "bfb5266d-2a65-4d40-b632-0d451d4e6526"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:43:52.743215 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-3a69bea0-cf75-4e77-ac37-f2ba0439ab71 req-f3b08c82-ceae-4a42-a67c-1d402ebbe324 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:52.743700 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-3a69bea0-cf75-4e77-ac37-f2ba0439ab71 req-f3b08c82-ceae-4a42-a67c-1d402ebbe324 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:52.744131 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-3a69bea0-cf75-4e77-ac37-f2ba0439ab71 req-f3b08c82-ceae-4a42-a67c-1d402ebbe324 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:52.782147 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-3a69bea0-cf75-4e77-ac37-f2ba0439ab71 req-f3b08c82-ceae-4a42-a67c-1d402ebbe324 service nova] Creating event network-vif-plugged:bfb5266d-2a65-4d40-b632-0d451d4e6526 for instance c03f5d7e-1851-47a0-9ec2-4b8b56e07c54 on n-h1-852278-4 Aug 27 02:43:52.799358 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-3a69bea0-cf75-4e77-ac37-f2ba0439ab71 req-f3b08c82-ceae-4a42-a67c-1d402ebbe324 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107833 Aug 27 02:43:52.800397 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 531/1051] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:43:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:43:52.811691 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a6d0f8fd-be05-4a67-b81c-94606d57d85f tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:52.817628 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a6d0f8fd-be05-4a67-b81c-94606d57d85f tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] [instance: c03f5d7e-1851-47a0-9ec2-4b8b56e07c54] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:52.828871 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a6d0f8fd-be05-4a67-b81c-94606d57d85f tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:52.829615 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a6d0f8fd-be05-4a67-b81c-94606d57d85f tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:52.830379 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a6d0f8fd-be05-4a67-b81c-94606d57d85f tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:52.831276 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a6d0f8fd-be05-4a67-b81c-94606d57d85f tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:52.847317 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a6d0f8fd-be05-4a67-b81c-94606d57d85f tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:52.847947 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a6d0f8fd-be05-4a67-b81c-94606d57d85f tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:53.139162 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-c0fb5e99-363a-4399-8c95-d7c802599954 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6d1646ec094e3297f6f3c51dd72e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b105816fd4e54b9da4973ff721e1fb92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:53.164473 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c0fb5e99-363a-4399-8c95-d7c802599954 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "GET /compute/v2.1/servers/9d4a6e6e-c4d0-4397-bf32-429ae2a252ba" status: 200 len: 1319 microversion: 2.1 time: 0.748949 Aug 27 02:43:53.188789 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 521/1052] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:52 2022] GET /compute/v2.1/servers/9d4a6e6e-c4d0-4397-bf32-429ae2a252ba => generated 1319 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:53.200363 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-571652ff-25ca-4057-a532-237fa40dfd4a tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Calling method '.version_select at 0x7f5eded95dc0>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:53.214880 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-571652ff-25ca-4057-a532-237fa40dfd4a tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:53.215576 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-571652ff-25ca-4057-a532-237fa40dfd4a tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:53.219996 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-571652ff-25ca-4057-a532-237fa40dfd4a tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:53.239055 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-571652ff-25ca-4057-a532-237fa40dfd4a tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] 10.222.0.70 "GET /compute/v2.1/os-migrations" status: 200 len: 2116 microversion: 2.25 time: 0.049031 Aug 27 02:43:53.239683 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 522/1053] 10.222.0.70 () {60 vars in 1184 bytes} [Sat Aug 27 02:43:53 2022] GET /compute/v2.1/os-migrations => generated 2116 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:43:53.268633 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e1519697-6543-47dc-bcea-72a275f096d4 tempest-FloatingIPsTestJSON-487986886 tempest-FloatingIPsTestJSON-487986886-project] Calling method '.version_select at 0x7f5ededfcee0>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:53.429983 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-a6d0f8fd-be05-4a67-b81c-94606d57d85f tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9653dac89d2648b285fd71c1b349e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3ac0c66c5b4bc787d2d6e12a957099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:53.444663 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a6d0f8fd-be05-4a67-b81c-94606d57d85f tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] 10.222.0.70 "GET /compute/v2.1/servers/c03f5d7e-1851-47a0-9ec2-4b8b56e07c54" status: 200 len: 1334 microversion: 2.1 time: 0.640325 Aug 27 02:43:53.445860 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 532/1054] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:52 2022] GET /compute/v2.1/servers/c03f5d7e-1851-47a0-9ec2-4b8b56e07c54 => generated 1334 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:53.469067 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-bd8cac32-7faf-440e-8e08-eb72b3a66796 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:53.479023 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-bd8cac32-7faf-440e-8e08-eb72b3a66796 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] [instance: 7eded9ca-c7bc-499a-bb53-a28d2c332402] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:53.499772 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bd8cac32-7faf-440e-8e08-eb72b3a66796 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:53.500278 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bd8cac32-7faf-440e-8e08-eb72b3a66796 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:53.500895 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bd8cac32-7faf-440e-8e08-eb72b3a66796 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:53.501821 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bd8cac32-7faf-440e-8e08-eb72b3a66796 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:53.502278 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bd8cac32-7faf-440e-8e08-eb72b3a66796 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:53.503361 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bd8cac32-7faf-440e-8e08-eb72b3a66796 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:54.261771 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.instance [None req-bd8cac32-7faf-440e-8e08-eb72b3a66796 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lazy-loading 'services' on Instance uuid 7eded9ca-c7bc-499a-bb53-a28d2c332402 {{(pid=134052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:43:54.299242 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-bd8cac32-7faf-440e-8e08-eb72b3a66796 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/7eded9ca-c7bc-499a-bb53-a28d2c332402" status: 200 len: 2420 microversion: 2.25 time: 0.839375 Aug 27 02:43:54.300628 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 533/1055] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:43:53 2022] GET /compute/v2.1/servers/7eded9ca-c7bc-499a-bb53-a28d2c332402 => generated 2420 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:43:54.400246 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e1519697-6543-47dc-bcea-72a275f096d4 tempest-FloatingIPsTestJSON-487986886 tempest-FloatingIPsTestJSON-487986886-project] 10.222.0.70 "GET /compute/v2.1/os-floating-ips/94ac35fd-ad67-4df8-b898-f7f635ad8e5e" status: 200 len: 142 microversion: 2.1 time: 1.159166 Aug 27 02:43:54.401535 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 523/1056] 10.222.0.70 () {58 vars in 1260 bytes} [Sat Aug 27 02:43:53 2022] GET /compute/v2.1/os-floating-ips/94ac35fd-ad67-4df8-b898-f7f635ad8e5e => generated 142 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:43:54.408920 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-14d3cf12-2533-4e29-b779-f67cb9cceac6 req-d966df97-f561-45a0-87ea-a809e65706f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38a900db-3d56-4836-a2a9-a39fe28ab481", "tag": "8509ffd4-5c61-44af-8b1e-301681acca1a"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:43:54.435838 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-14d3cf12-2533-4e29-b779-f67cb9cceac6 req-d966df97-f561-45a0-87ea-a809e65706f9 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:54.440473 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-14d3cf12-2533-4e29-b779-f67cb9cceac6 req-d966df97-f561-45a0-87ea-a809e65706f9 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:54.442525 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-14d3cf12-2533-4e29-b779-f67cb9cceac6 req-d966df97-f561-45a0-87ea-a809e65706f9 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:54.473475 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-14d3cf12-2533-4e29-b779-f67cb9cceac6 req-d966df97-f561-45a0-87ea-a809e65706f9 service nova] Creating event network-changed:8509ffd4-5c61-44af-8b1e-301681acca1a for instance 38a900db-3d56-4836-a2a9-a39fe28ab481 on n-h2-852278-4 Aug 27 02:43:54.499804 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-14d3cf12-2533-4e29-b779-f67cb9cceac6 req-d966df97-f561-45a0-87ea-a809e65706f9 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096051 Aug 27 02:43:54.501712 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 524/1057] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:43:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:43:54.513457 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-58d4014d-184b-453e-a700-c92e9ee54bb4 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:54.518115 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-58d4014d-184b-453e-a700-c92e9ee54bb4 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] [instance: 3095a9f9-6769-4107-94a5-beac6415694c] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:54.537302 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-58d4014d-184b-453e-a700-c92e9ee54bb4 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:54.539640 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-58d4014d-184b-453e-a700-c92e9ee54bb4 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:54.540994 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-58d4014d-184b-453e-a700-c92e9ee54bb4 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:54.543051 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-58d4014d-184b-453e-a700-c92e9ee54bb4 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:54.543768 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-58d4014d-184b-453e-a700-c92e9ee54bb4 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:54.544610 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-58d4014d-184b-453e-a700-c92e9ee54bb4 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:54.728934 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9c30b2e8-8708-4122-b91f-5c0502301359 tempest-TenantUsagesNegativeTestJSON-386210751 tempest-TenantUsagesNegativeTestJSON-386210751-project-admin] 10.222.0.70 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-08-26T02%3A43%3A53.493076&end=2022-08-28T02%3A43%3A53.493076" status: 404 len: 112 microversion: - time: 0.426216 Aug 27 02:43:54.729694 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 534/1058] 10.222.0.70 () {58 vars in 1316 bytes} [Sat Aug 27 02:43:54 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-08-26T02%3A43%3A53.493076&end=2022-08-28T02%3A43%3A53.493076 => generated 112 bytes in 429 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 27 02:43:54.741628 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4a1d54e4-3cb6-4253-a5ce-801a15bf65b1 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:54.743110 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-4a1d54e4-3cb6-4253-a5ce-801a15bf65b1 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: 9d4a6e6e-c4d0-4397-bf32-429ae2a252ba] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:54.761283 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4a1d54e4-3cb6-4253-a5ce-801a15bf65b1 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:54.763860 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4a1d54e4-3cb6-4253-a5ce-801a15bf65b1 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:54.764686 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4a1d54e4-3cb6-4253-a5ce-801a15bf65b1 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:54.765752 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4a1d54e4-3cb6-4253-a5ce-801a15bf65b1 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:54.772834 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4a1d54e4-3cb6-4253-a5ce-801a15bf65b1 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:54.773549 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4a1d54e4-3cb6-4253-a5ce-801a15bf65b1 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:55.063509 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-58d4014d-184b-453e-a700-c92e9ee54bb4 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/3095a9f9-6769-4107-94a5-beac6415694c" status: 200 len: 1858 microversion: 2.1 time: 0.559898 Aug 27 02:43:55.065114 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 525/1059] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:54 2022] GET /compute/v2.1/servers/3095a9f9-6769-4107-94a5-beac6415694c => generated 1858 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:55.069631 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-cb8ad4d9-7fbf-461b-9c4e-7bd8b474960c tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:55.077434 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-cb8ad4d9-7fbf-461b-9c4e-7bd8b474960c tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] [instance: 7eded9ca-c7bc-499a-bb53-a28d2c332402] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:55.085810 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cb8ad4d9-7fbf-461b-9c4e-7bd8b474960c tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:55.086302 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cb8ad4d9-7fbf-461b-9c4e-7bd8b474960c tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:55.086728 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cb8ad4d9-7fbf-461b-9c4e-7bd8b474960c tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:55.087439 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cb8ad4d9-7fbf-461b-9c4e-7bd8b474960c tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:55.087886 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cb8ad4d9-7fbf-461b-9c4e-7bd8b474960c tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:55.088304 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cb8ad4d9-7fbf-461b-9c4e-7bd8b474960c tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:55.194181 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-4a1d54e4-3cb6-4253-a5ce-801a15bf65b1 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6d1646ec094e3297f6f3c51dd72e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b105816fd4e54b9da4973ff721e1fb92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:55.208847 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-4a1d54e4-3cb6-4253-a5ce-801a15bf65b1 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "GET /compute/v2.1/servers/9d4a6e6e-c4d0-4397-bf32-429ae2a252ba" status: 200 len: 1319 microversion: 2.1 time: 0.477820 Aug 27 02:43:55.212263 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 535/1060] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:54 2022] GET /compute/v2.1/servers/9d4a6e6e-c4d0-4397-bf32-429ae2a252ba => generated 1319 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:55.224706 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-7eecdd7d-4d74-4823-9045-fe5d74bf7769 tempest-FloatingIPsTestJSON-487986886 tempest-FloatingIPsTestJSON-487986886-project] Calling method '.version_select at 0x7f5ee2ea1670>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:55.342804 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.objects.instance [None req-cb8ad4d9-7fbf-461b-9c4e-7bd8b474960c tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lazy-loading 'services' on Instance uuid 7eded9ca-c7bc-499a-bb53-a28d2c332402 {{(pid=134051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:43:55.372097 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-cb8ad4d9-7fbf-461b-9c4e-7bd8b474960c tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/7eded9ca-c7bc-499a-bb53-a28d2c332402" status: 200 len: 2420 microversion: 2.25 time: 0.305663 Aug 27 02:43:55.373574 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 526/1061] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:43:55 2022] GET /compute/v2.1/servers/7eded9ca-c7bc-499a-bb53-a28d2c332402 => generated 2420 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:43:55.385513 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-127a7b51-a7b5-4ff7-a05a-455bc0a37f93 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:55.388474 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-127a7b51-a7b5-4ff7-a05a-455bc0a37f93 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] [instance: c03f5d7e-1851-47a0-9ec2-4b8b56e07c54] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:55.402661 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-127a7b51-a7b5-4ff7-a05a-455bc0a37f93 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:55.403236 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-127a7b51-a7b5-4ff7-a05a-455bc0a37f93 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:55.405238 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-127a7b51-a7b5-4ff7-a05a-455bc0a37f93 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:55.407192 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-127a7b51-a7b5-4ff7-a05a-455bc0a37f93 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:55.408404 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-127a7b51-a7b5-4ff7-a05a-455bc0a37f93 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:55.409359 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-127a7b51-a7b5-4ff7-a05a-455bc0a37f93 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:55.581087 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-7eecdd7d-4d74-4823-9045-fe5d74bf7769 tempest-FloatingIPsTestJSON-487986886 tempest-FloatingIPsTestJSON-487986886-project] 10.222.0.70 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 0.366286 Aug 27 02:43:55.588564 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 536/1062] 10.222.0.70 () {58 vars in 1149 bytes} [Sat Aug 27 02:43:55 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:43:55.588564 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e65cdb21-6e27-4ce4-8019-91056d49c8c9 tempest-TenantUsagesNegativeTestJSON-386210751 tempest-TenantUsagesNegativeTestJSON-386210751-project-admin] Calling method '.version_select at 0x7f5ee2ea1b80>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:55.600129 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-e65cdb21-6e27-4ce4-8019-91056d49c8c9 tempest-TenantUsagesNegativeTestJSON-386210751 tempest-TenantUsagesNegativeTestJSON-386210751-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Aug 27 02:43:55.610113 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e65cdb21-6e27-4ce4-8019-91056d49c8c9 tempest-TenantUsagesNegativeTestJSON-386210751 tempest-TenantUsagesNegativeTestJSON-386210751-project-admin] Request method failure captured: Aug 27 02:43:55.610113 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/os-simple-tenant-usage/b8c60b5e864340df94ac3c2d393573c5?start=2022-08-28T02%3A43%3A53.493076&end=2022-08-26T02%3A43%3A53.493076 HTTP/1.1 Aug 27 02:43:55.610113 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:43:55.610113 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:43:55.610113 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:43:55.610113 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:43:55.610113 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:43:55.610113 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:43:55.610113 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:43:55.610113 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:43:55.610113 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYTp1P9MuhYhtZ2BOgLsypuhQKj_bcRz1fBwN2eZ-3T4tkCca5LWjvVnG67OO7VmmpRgLH-Lqhzc_AN8VR961NBGKVQvlMdkI5lDWwskwnoGYrrpoqIuZnkBxUYV7Xsat4_3SQaEOghlE_XP0LrG3Q8bfBgDuaFj3DVZ8TNp2TiBDpA Aug 27 02:43:55.610113 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:43:55.610113 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:43:55.610113 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:43:55.610113 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:43:55.610113 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:43:55.610113 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:43:55.610113 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: c06e73e3954a48edb1e020094532bd05 Aug 27 02:43:55.610113 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-386210751 Aug 27 02:43:55.610113 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,admin,member Aug 27 02:43:55.610113 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,admin,member Aug 27 02:43:55.611863 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c06e73e3954a48edb1e020094532bd05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c06e73e3954a48edb1e020094532bd05", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c06e73e3954a48edb1e020094532bd05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c06e73e3954a48edb1e020094532bd05"}]}] Aug 27 02:43:55.611863 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-386210751 Aug 27 02:43:55.611863 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: c06e73e3954a48edb1e020094532bd05 Aug 27 02:43:55.611863 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-386210751 Aug 27 02:43:55.611863 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-TenantUsagesNegativeTestJSON-386210751-project-admin Aug 27 02:43:55.611863 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:43:55.611863 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:43:55.611863 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 4f1a303e622e4b91a1f495846b7855bf Aug 27 02:43:55.611863 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-386210751-project-admin Aug 27 02:43:55.611863 n-d-852278-4 devstack@n-api.service[134052]: method: Aug 27 02:43:55.611863 n-d-852278-4 devstack@n-api.service[134052]: exception: Invalid start time. The start time cannot occur after the end time. Aug 27 02:43:55.611863 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': 'b8c60b5e864340df94ac3c2d393573c5'} Aug 27 02:43:55.612903 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:43:55.612903 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:43:55.612903 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:43:55.612903 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:43:55.612903 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:43:55.612903 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:43:55.612903 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:43:55.612903 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:43:55.612903 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 02:43:55.612903 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:43:55.612903 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:43:55.612903 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:43:55.612903 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Aug 27 02:43:55.612903 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 27 02:43:55.612903 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Aug 27 02:43:55.612903 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Aug 27 02:43:55.612903 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Aug 27 02:43:55.612903 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 27 02:43:55.612903 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Aug 27 02:43:55.614359 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:43:55.614359 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:43:55.614359 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:43:55.614359 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:43:55.614359 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:43:55.614359 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:43:55.614359 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:43:55.614359 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:43:55.614359 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Aug 27 02:43:55.614359 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:43:55.619718 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e65cdb21-6e27-4ce4-8019-91056d49c8c9 tempest-TenantUsagesNegativeTestJSON-386210751 tempest-TenantUsagesNegativeTestJSON-386210751-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:43:55.620715 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e65cdb21-6e27-4ce4-8019-91056d49c8c9 tempest-TenantUsagesNegativeTestJSON-386210751 tempest-TenantUsagesNegativeTestJSON-386210751-project-admin] 10.222.0.70 "GET /compute/v2.1/os-simple-tenant-usage/b8c60b5e864340df94ac3c2d393573c5?start=2022-08-28T02%3A43%3A53.493076&end=2022-08-26T02%3A43%3A53.493076" status: 400 len: 111 microversion: 2.1 time: 0.038430 Aug 27 02:43:55.627498 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 537/1063] 10.222.0.70 () {58 vars in 1412 bytes} [Sat Aug 27 02:43:55 2022] GET /compute/v2.1/os-simple-tenant-usage/b8c60b5e864340df94ac3c2d393573c5?start=2022-08-28T02%3A43%3A53.493076&end=2022-08-26T02%3A43%3A53.493076 => generated 111 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 02:43:55.630319 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0888bbd2-b2af-48d8-ac86-ca0a0b5e46ef tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-852278-4", "block_migration": true, "disk_over_commit": false}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:43:55.635765 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-0888bbd2-b2af-48d8-ac86-ca0a0b5e46ef tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] [instance: 3095a9f9-6769-4107-94a5-beac6415694c] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:55.651537 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0888bbd2-b2af-48d8-ac86-ca0a0b5e46ef tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:55.658294 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0888bbd2-b2af-48d8-ac86-ca0a0b5e46ef tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:55.659017 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0888bbd2-b2af-48d8-ac86-ca0a0b5e46ef tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:55.659936 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0888bbd2-b2af-48d8-ac86-ca0a0b5e46ef tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:55.661799 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0888bbd2-b2af-48d8-ac86-ca0a0b5e46ef tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:55.666032 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0888bbd2-b2af-48d8-ac86-ca0a0b5e46ef tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:55.709120 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-127a7b51-a7b5-4ff7-a05a-455bc0a37f93 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9653dac89d2648b285fd71c1b349e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3ac0c66c5b4bc787d2d6e12a957099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:55.720469 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-127a7b51-a7b5-4ff7-a05a-455bc0a37f93 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] 10.222.0.70 "GET /compute/v2.1/servers/c03f5d7e-1851-47a0-9ec2-4b8b56e07c54" status: 200 len: 1668 microversion: 2.1 time: 0.345755 Aug 27 02:43:55.721697 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 527/1064] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:55 2022] GET /compute/v2.1/servers/c03f5d7e-1851-47a0-9ec2-4b8b56e07c54 => generated 1668 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:55.723802 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.instance [None req-0888bbd2-b2af-48d8-ac86-ca0a0b5e46ef tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Lazy-loading 'flavor' on Instance uuid 3095a9f9-6769-4107-94a5-beac6415694c {{(pid=134052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:43:55.728646 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-641ec65e-10fc-42c3-8b71-5a1730c4c79d tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:55.729458 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-641ec65e-10fc-42c3-8b71-5a1730c4c79d tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: 7eded9ca-c7bc-499a-bb53-a28d2c332402] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:55.738370 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-641ec65e-10fc-42c3-8b71-5a1730c4c79d tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:55.739218 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-641ec65e-10fc-42c3-8b71-5a1730c4c79d tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:55.739937 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-641ec65e-10fc-42c3-8b71-5a1730c4c79d tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:55.740913 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-641ec65e-10fc-42c3-8b71-5a1730c4c79d tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:55.741578 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-641ec65e-10fc-42c3-8b71-5a1730c4c79d tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:55.742215 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-641ec65e-10fc-42c3-8b71-5a1730c4c79d tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:55.750149 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-0888bbd2-b2af-48d8-ac86-ca0a0b5e46ef tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] [instance: 3095a9f9-6769-4107-94a5-beac6415694c] Going to try to live migrate instance to n-h2-852278-4 {{(pid=134052) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 27 02:43:55.989125 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.objects.instance [None req-641ec65e-10fc-42c3-8b71-5a1730c4c79d tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lazy-loading 'services' on Instance uuid 7eded9ca-c7bc-499a-bb53-a28d2c332402 {{(pid=134051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:43:56.225924 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-641ec65e-10fc-42c3-8b71-5a1730c4c79d tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "DELETE /compute/v2.1/servers/7eded9ca-c7bc-499a-bb53-a28d2c332402/os-volume_attachments/7020d9af-f24e-4ab9-86ef-07df5451039b" status: 202 len: 0 microversion: 2.25 time: 0.502656 Aug 27 02:43:56.226783 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 528/1065] 10.222.0.70 () {60 vars in 1457 bytes} [Sat Aug 27 02:43:55 2022] DELETE /compute/v2.1/servers/7eded9ca-c7bc-499a-bb53-a28d2c332402/os-volume_attachments/7020d9af-f24e-4ab9-86ef-07df5451039b => generated 0 bytes in 504 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:43:56.235604 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8bc23a66-9503-4ecc-9730-303c2cc6b793 tempest-FloatingIPsTestJSON-487986886 tempest-FloatingIPsTestJSON-487986886-project] Calling method '.version_select at 0x7f5ededaeca0>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:58.171131 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-0888bbd2-b2af-48d8-ac86-ca0a0b5e46ef tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/3095a9f9-6769-4107-94a5-beac6415694c/action" status: 202 len: 0 microversion: 2.1 time: 2.547896 Aug 27 02:43:58.172554 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 538/1066] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 02:43:55 2022] POST /compute/v2.1/servers/3095a9f9-6769-4107-94a5-beac6415694c/action => generated 0 bytes in 2550 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:43:58.644247 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ea3cd91e-037b-4d2e-ae9b-ad7c6d14bf0b tempest-TenantUsagesNegativeTestJSON-14529541 tempest-TenantUsagesNegativeTestJSON-14529541-project] Calling method '.version_select at 0x7f5ee2f599d0>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:58.648186 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-ea3cd91e-037b-4d2e-ae9b-ad7c6d14bf0b tempest-TenantUsagesNegativeTestJSON-14529541 tempest-TenantUsagesNegativeTestJSON-14529541-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '0a1df562a7074daea7539daa80d36861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c60b5e864340df94ac3c2d393573c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:58.652851 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ea3cd91e-037b-4d2e-ae9b-ad7c6d14bf0b tempest-TenantUsagesNegativeTestJSON-14529541 tempest-TenantUsagesNegativeTestJSON-14529541-project] Request method failure captured: Aug 27 02:43:58.652851 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-26T02%3A43%3A53.493076&end=2022-08-28T02%3A43%3A53.493076&detailed=1 HTTP/1.1 Aug 27 02:43:58.652851 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:43:58.652851 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:43:58.652851 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:43:58.652851 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:43:58.652851 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:43:58.652851 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:43:58.652851 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:43:58.652851 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:43:58.652851 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYToJSqVZkO6Ovs72Q3qwvQlGW5FKoG1Rhgun9aOixfzkK6XIo2Toy1M4ytuMF81nu1Ea3-PU6lUrBD2gE9XKsUaVtJTJVYWPJimYdDjjb-QZop7W3AOZ1ANATX_pFR2Xt_QNqkts9U2_nPI4EmIP6vvLHf6FkOBPbDiAcsOT5n0OPs Aug 27 02:43:58.652851 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:43:58.652851 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:43:58.652851 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:43:58.652851 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:43:58.652851 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:43:58.652851 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:43:58.652851 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: b8c60b5e864340df94ac3c2d393573c5 Aug 27 02:43:58.652851 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-14529541 Aug 27 02:43:58.652851 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:43:58.652851 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:43:58.654494 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b8c60b5e864340df94ac3c2d393573c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_b8c60b5e864340df94ac3c2d393573c5", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b8c60b5e864340df94ac3c2d393573c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/b8c60b5e864340df94ac3c2d393573c5"}]}] Aug 27 02:43:58.654494 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-14529541 Aug 27 02:43:58.654494 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: b8c60b5e864340df94ac3c2d393573c5 Aug 27 02:43:58.654494 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-14529541 Aug 27 02:43:58.654494 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-TenantUsagesNegativeTestJSON-14529541-project Aug 27 02:43:58.654494 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:43:58.654494 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:43:58.654494 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 0a1df562a7074daea7539daa80d36861 Aug 27 02:43:58.654494 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-14529541-project Aug 27 02:43:58.654494 n-d-852278-4 devstack@n-api.service[134052]: method: Aug 27 02:43:58.654494 n-d-852278-4 devstack@n-api.service[134052]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 27 02:43:58.654494 n-d-852278-4 devstack@n-api.service[134052]: action_args: {} Aug 27 02:43:58.654494 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:43:58.655610 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:43:58.655610 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:43:58.655610 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:43:58.655610 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:43:58.655610 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:43:58.655610 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:43:58.655610 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:43:58.655610 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 02:43:58.655610 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:43:58.655610 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:43:58.655610 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:43:58.655610 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Aug 27 02:43:58.655610 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return self._index(req) Aug 27 02:43:58.655610 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Aug 27 02:43:58.655610 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Aug 27 02:43:58.655610 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 02:43:58.655610 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 02:43:58.655610 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 02:43:58.655610 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 02:43:58.657146 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 02:43:58.657146 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 02:43:58.657146 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 02:43:58.657146 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 02:43:58.657146 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 02:43:58.657146 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 02:43:58.657146 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 02:43:58.657146 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 02:43:58.657146 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 02:43:58.657146 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 02:43:58.657146 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 27 02:43:58.657146 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:43:58.657146 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:43:58.657146 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:43:58.657146 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:43:58.657146 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:43:58.657146 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:43:58.657146 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 02:43:58.657146 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 02:43:58.658767 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 27 02:43:58.658767 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:43:58.661233 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ea3cd91e-037b-4d2e-ae9b-ad7c6d14bf0b tempest-TenantUsagesNegativeTestJSON-14529541 tempest-TenantUsagesNegativeTestJSON-14529541-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:43:58.662858 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ea3cd91e-037b-4d2e-ae9b-ad7c6d14bf0b tempest-TenantUsagesNegativeTestJSON-14529541 tempest-TenantUsagesNegativeTestJSON-14529541-project] 10.222.0.70 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-26T02%3A43%3A53.493076&end=2022-08-28T02%3A43%3A53.493076&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.488815 Aug 27 02:43:58.666604 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 539/1067] 10.222.0.70 () {58 vars in 1335 bytes} [Sat Aug 27 02:43:58 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-26T02%3A43%3A53.493076&end=2022-08-28T02%3A43%3A53.493076&detailed=1 => generated 123 bytes in 493 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:43:58.679530 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-10cfbda4-fbce-4a4d-bb2f-f3052e39175e tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:58.680327 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-10cfbda4-fbce-4a4d-bb2f-f3052e39175e tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] [instance: c03f5d7e-1851-47a0-9ec2-4b8b56e07c54] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:58.694764 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-10cfbda4-fbce-4a4d-bb2f-f3052e39175e tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:58.695709 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-10cfbda4-fbce-4a4d-bb2f-f3052e39175e tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:58.696389 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-10cfbda4-fbce-4a4d-bb2f-f3052e39175e tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:58.697359 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-10cfbda4-fbce-4a4d-bb2f-f3052e39175e tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:58.698570 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-10cfbda4-fbce-4a4d-bb2f-f3052e39175e tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:58.700184 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-10cfbda4-fbce-4a4d-bb2f-f3052e39175e tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:58.771116 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-10cfbda4-fbce-4a4d-bb2f-f3052e39175e tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] 10.222.0.70 "GET /compute/v2.1/servers/c03f5d7e-1851-47a0-9ec2-4b8b56e07c54/ips" status: 200 len: 178 microversion: 2.1 time: 0.099309 Aug 27 02:43:58.783713 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 540/1068] 10.222.0.70 () {58 vars in 1248 bytes} [Sat Aug 27 02:43:58 2022] GET /compute/v2.1/servers/c03f5d7e-1851-47a0-9ec2-4b8b56e07c54/ips => generated 178 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:43:58.798405 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-85fe2ff5-b4c0-41c0-ad1a-0cfb4b3477c9 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:58.803387 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-85fe2ff5-b4c0-41c0-ad1a-0cfb4b3477c9 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: 9d4a6e6e-c4d0-4397-bf32-429ae2a252ba] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:58.817446 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-85fe2ff5-b4c0-41c0-ad1a-0cfb4b3477c9 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:58.818336 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-85fe2ff5-b4c0-41c0-ad1a-0cfb4b3477c9 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:58.823195 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-85fe2ff5-b4c0-41c0-ad1a-0cfb4b3477c9 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:58.824544 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-85fe2ff5-b4c0-41c0-ad1a-0cfb4b3477c9 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:58.825228 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-85fe2ff5-b4c0-41c0-ad1a-0cfb4b3477c9 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:58.825861 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-85fe2ff5-b4c0-41c0-ad1a-0cfb4b3477c9 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:59.416429 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-8bc23a66-9503-4ecc-9730-303c2cc6b793 tempest-FloatingIPsTestJSON-487986886 tempest-FloatingIPsTestJSON-487986886-project] 10.222.0.70 "DELETE /compute/v2.1/os-floating-ips/94ac35fd-ad67-4df8-b898-f7f635ad8e5e" status: 202 len: 0 microversion: 2.1 time: 3.186947 Aug 27 02:43:59.417574 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 529/1069] 10.222.0.70 () {58 vars in 1263 bytes} [Sat Aug 27 02:43:56 2022] DELETE /compute/v2.1/os-floating-ips/94ac35fd-ad67-4df8-b898-f7f635ad8e5e => generated 0 bytes in 3189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:43:59.424621 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-1bed4a02-4ec8-485b-b3b4-92a525bce61b tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:59.433601 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-1bed4a02-4ec8-485b-b3b4-92a525bce61b tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: 7eded9ca-c7bc-499a-bb53-a28d2c332402] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:59.452159 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1bed4a02-4ec8-485b-b3b4-92a525bce61b tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:59.453456 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1bed4a02-4ec8-485b-b3b4-92a525bce61b tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:59.454227 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1bed4a02-4ec8-485b-b3b4-92a525bce61b tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:59.459933 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1bed4a02-4ec8-485b-b3b4-92a525bce61b tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:59.462058 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1bed4a02-4ec8-485b-b3b4-92a525bce61b tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:59.464575 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1bed4a02-4ec8-485b-b3b4-92a525bce61b tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:59.560586 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-1bed4a02-4ec8-485b-b3b4-92a525bce61b tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/7eded9ca-c7bc-499a-bb53-a28d2c332402/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.140386 Aug 27 02:43:59.562620 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 530/1070] 10.222.0.70 () {60 vars in 1343 bytes} [Sat Aug 27 02:43:59 2022] GET /compute/v2.1/servers/7eded9ca-c7bc-499a-bb53-a28d2c332402/os-volume_attachments => generated 197 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:43:59.577784 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-1994ba99-23ce-4398-b684-7cf553ba878a req-6d42e23e-67d7-4e3c-8119-c97ccd925052 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d4a6e6e-c4d0-4397-bf32-429ae2a252ba", "name": "network-vif-plugged", "status": "completed", "tag": "1771be5b-38e4-4698-b32c-eae8637cc438"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:43:59.607441 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-1994ba99-23ce-4398-b684-7cf553ba878a req-6d42e23e-67d7-4e3c-8119-c97ccd925052 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:59.609094 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-1994ba99-23ce-4398-b684-7cf553ba878a req-6d42e23e-67d7-4e3c-8119-c97ccd925052 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:59.610554 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-1994ba99-23ce-4398-b684-7cf553ba878a req-6d42e23e-67d7-4e3c-8119-c97ccd925052 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:59.662788 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-1994ba99-23ce-4398-b684-7cf553ba878a req-6d42e23e-67d7-4e3c-8119-c97ccd925052 service nova] Creating event network-vif-plugged:1771be5b-38e4-4698-b32c-eae8637cc438 for instance 9d4a6e6e-c4d0-4397-bf32-429ae2a252ba on n-h1-852278-4 Aug 27 02:43:59.677377 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-1994ba99-23ce-4398-b684-7cf553ba878a req-6d42e23e-67d7-4e3c-8119-c97ccd925052 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113249 Aug 27 02:43:59.679816 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 531/1071] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:43:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:43:59.694575 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-5e1df8db-6420-4d1b-915a-acbbec2f850d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:59.695402 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-5e1df8db-6420-4d1b-915a-acbbec2f850d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 3095a9f9-6769-4107-94a5-beac6415694c] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:59.697105 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-85fe2ff5-b4c0-41c0-ad1a-0cfb4b3477c9 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6d1646ec094e3297f6f3c51dd72e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b105816fd4e54b9da4973ff721e1fb92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:59.708760 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-85fe2ff5-b4c0-41c0-ad1a-0cfb4b3477c9 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "GET /compute/v2.1/servers/9d4a6e6e-c4d0-4397-bf32-429ae2a252ba" status: 200 len: 1319 microversion: 2.1 time: 0.922387 Aug 27 02:43:59.710549 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 541/1072] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:58 2022] GET /compute/v2.1/servers/9d4a6e6e-c4d0-4397-bf32-429ae2a252ba => generated 1319 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:59.712248 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5e1df8db-6420-4d1b-915a-acbbec2f850d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:59.712800 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5e1df8db-6420-4d1b-915a-acbbec2f850d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:59.713366 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5e1df8db-6420-4d1b-915a-acbbec2f850d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:59.715424 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5e1df8db-6420-4d1b-915a-acbbec2f850d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:59.716092 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5e1df8db-6420-4d1b-915a-acbbec2f850d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:59.718530 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5e1df8db-6420-4d1b-915a-acbbec2f850d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:59.719473 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ed2767d9-bbc6-470f-bd1c-be466e66c74b tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:59.720540 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-ed2767d9-bbc6-470f-bd1c-be466e66c74b tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] [instance: c03f5d7e-1851-47a0-9ec2-4b8b56e07c54] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:59.729703 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ed2767d9-bbc6-470f-bd1c-be466e66c74b tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:59.731043 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ed2767d9-bbc6-470f-bd1c-be466e66c74b tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:59.731797 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ed2767d9-bbc6-470f-bd1c-be466e66c74b tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:59.733092 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ed2767d9-bbc6-470f-bd1c-be466e66c74b tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:59.733794 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ed2767d9-bbc6-470f-bd1c-be466e66c74b tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:59.734638 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ed2767d9-bbc6-470f-bd1c-be466e66c74b tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:59.780413 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-ed2767d9-bbc6-470f-bd1c-be466e66c74b tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] [instance: c03f5d7e-1851-47a0-9ec2-4b8b56e07c54] Going to try to terminate instance {{(pid=134052) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:43:59.966262 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ed2767d9-bbc6-470f-bd1c-be466e66c74b tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] 10.222.0.70 "DELETE /compute/v2.1/servers/c03f5d7e-1851-47a0-9ec2-4b8b56e07c54" status: 204 len: 0 microversion: 2.1 time: 0.248886 Aug 27 02:43:59.967910 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 542/1073] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:43:59 2022] DELETE /compute/v2.1/servers/c03f5d7e-1851-47a0-9ec2-4b8b56e07c54 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:43:59.974536 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c4fe02fb-5b89-4b37-a481-e405797b2d7e tempest-FloatingIPsTestJSON-487986886 tempest-FloatingIPsTestJSON-487986886-project] Action: 'create', calling method: .version_select at 0x7f5ee2f81040>, body: {"pool": null} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:44:00.542044 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-5e1df8db-6420-4d1b-915a-acbbec2f850d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:00.566497 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-5e1df8db-6420-4d1b-915a-acbbec2f850d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/3095a9f9-6769-4107-94a5-beac6415694c" status: 200 len: 1717 microversion: 2.1 time: 0.885377 Aug 27 02:44:00.569009 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 532/1074] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:59 2022] GET /compute/v2.1/servers/3095a9f9-6769-4107-94a5-beac6415694c => generated 1717 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:00.575146 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-11f96a7f-bf3c-4b38-ab4f-6e70ea379a9a tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:00.576684 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-11f96a7f-bf3c-4b38-ab4f-6e70ea379a9a tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] [instance: c03f5d7e-1851-47a0-9ec2-4b8b56e07c54] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:00.587684 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-11f96a7f-bf3c-4b38-ab4f-6e70ea379a9a tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:00.588815 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-11f96a7f-bf3c-4b38-ab4f-6e70ea379a9a tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:00.589818 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-11f96a7f-bf3c-4b38-ab4f-6e70ea379a9a tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:00.590851 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-11f96a7f-bf3c-4b38-ab4f-6e70ea379a9a tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:00.591704 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-11f96a7f-bf3c-4b38-ab4f-6e70ea379a9a tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:00.592303 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-11f96a7f-bf3c-4b38-ab4f-6e70ea379a9a tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:01.213735 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-11f96a7f-bf3c-4b38-ab4f-6e70ea379a9a tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9653dac89d2648b285fd71c1b349e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3ac0c66c5b4bc787d2d6e12a957099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:01.223782 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-11f96a7f-bf3c-4b38-ab4f-6e70ea379a9a tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] 10.222.0.70 "GET /compute/v2.1/servers/c03f5d7e-1851-47a0-9ec2-4b8b56e07c54" status: 200 len: 1674 microversion: 2.1 time: 0.653282 Aug 27 02:44:01.240101 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 533/1075] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:00 2022] GET /compute/v2.1/servers/c03f5d7e-1851-47a0-9ec2-4b8b56e07c54 => generated 1674 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:01.240371 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-29a91681-8ced-4961-ab40-8ab376113e23 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:01.242577 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-29a91681-8ced-4961-ab40-8ab376113e23 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: 7eded9ca-c7bc-499a-bb53-a28d2c332402] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:01.258019 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-29a91681-8ced-4961-ab40-8ab376113e23 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:01.258517 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-29a91681-8ced-4961-ab40-8ab376113e23 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:01.259057 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-29a91681-8ced-4961-ab40-8ab376113e23 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:01.263644 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-29a91681-8ced-4961-ab40-8ab376113e23 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:01.264124 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-29a91681-8ced-4961-ab40-8ab376113e23 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:01.264677 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-29a91681-8ced-4961-ab40-8ab376113e23 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:01.350607 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-29a91681-8ced-4961-ab40-8ab376113e23 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/7eded9ca-c7bc-499a-bb53-a28d2c332402/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.116750 Aug 27 02:44:01.353025 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 534/1076] 10.222.0.70 () {60 vars in 1343 bytes} [Sat Aug 27 02:44:01 2022] GET /compute/v2.1/servers/7eded9ca-c7bc-499a-bb53-a28d2c332402/os-volume_attachments => generated 197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:44:01.374131 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-9894dabd-cbd5-451e-83d5-2251d2df923e tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:01.374812 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-9894dabd-cbd5-451e-83d5-2251d2df923e tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: 9d4a6e6e-c4d0-4397-bf32-429ae2a252ba] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:01.392814 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9894dabd-cbd5-451e-83d5-2251d2df923e tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:01.393317 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9894dabd-cbd5-451e-83d5-2251d2df923e tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:01.393753 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9894dabd-cbd5-451e-83d5-2251d2df923e tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:01.394522 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9894dabd-cbd5-451e-83d5-2251d2df923e tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:01.394973 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9894dabd-cbd5-451e-83d5-2251d2df923e tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:01.395395 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9894dabd-cbd5-451e-83d5-2251d2df923e tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:02.081253 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-9894dabd-cbd5-451e-83d5-2251d2df923e tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6d1646ec094e3297f6f3c51dd72e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b105816fd4e54b9da4973ff721e1fb92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:02.088728 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:44:02.093621 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-9894dabd-cbd5-451e-83d5-2251d2df923e tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "GET /compute/v2.1/servers/9d4a6e6e-c4d0-4397-bf32-429ae2a252ba" status: 200 len: 1319 microversion: 2.1 time: 0.737260 Aug 27 02:44:02.096488 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 535/1077] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:01 2022] GET /compute/v2.1/servers/9d4a6e6e-c4d0-4397-bf32-429ae2a252ba => generated 1319 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:02.108332 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-5fe1030a-225d-4bd5-88bd-00e4bd3e3be2 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:02.109244 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-5fe1030a-225d-4bd5-88bd-00e4bd3e3be2 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 3095a9f9-6769-4107-94a5-beac6415694c] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:02.122247 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5fe1030a-225d-4bd5-88bd-00e4bd3e3be2 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:02.123306 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5fe1030a-225d-4bd5-88bd-00e4bd3e3be2 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:02.123942 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5fe1030a-225d-4bd5-88bd-00e4bd3e3be2 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:02.124846 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5fe1030a-225d-4bd5-88bd-00e4bd3e3be2 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:02.125449 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5fe1030a-225d-4bd5-88bd-00e4bd3e3be2 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:02.126021 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5fe1030a-225d-4bd5-88bd-00e4bd3e3be2 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:02.507238 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-5fe1030a-225d-4bd5-88bd-00e4bd3e3be2 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:02.534244 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-5fe1030a-225d-4bd5-88bd-00e4bd3e3be2 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/3095a9f9-6769-4107-94a5-beac6415694c" status: 200 len: 1717 microversion: 2.1 time: 0.434854 Aug 27 02:44:02.567126 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 536/1078] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:02 2022] GET /compute/v2.1/servers/3095a9f9-6769-4107-94a5-beac6415694c => generated 1717 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:02.635540 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-990b494b-cf20-4843-b125-4ed9f856c0c1 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:02.636250 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-990b494b-cf20-4843-b125-4ed9f856c0c1 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] [instance: c03f5d7e-1851-47a0-9ec2-4b8b56e07c54] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:02.770070 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-990b494b-cf20-4843-b125-4ed9f856c0c1 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:02.771166 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-990b494b-cf20-4843-b125-4ed9f856c0c1 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:02.775757 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-990b494b-cf20-4843-b125-4ed9f856c0c1 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:02.776603 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-990b494b-cf20-4843-b125-4ed9f856c0c1 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:02.779089 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-990b494b-cf20-4843-b125-4ed9f856c0c1 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:02.780067 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-990b494b-cf20-4843-b125-4ed9f856c0c1 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:03.884429 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-990b494b-cf20-4843-b125-4ed9f856c0c1 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9653dac89d2648b285fd71c1b349e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3ac0c66c5b4bc787d2d6e12a957099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:03.897552 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-990b494b-cf20-4843-b125-4ed9f856c0c1 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] 10.222.0.70 "GET /compute/v2.1/servers/c03f5d7e-1851-47a0-9ec2-4b8b56e07c54" status: 200 len: 1674 microversion: 2.1 time: 1.301793 Aug 27 02:44:03.898246 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 537/1079] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:02 2022] GET /compute/v2.1/servers/c03f5d7e-1851-47a0-9ec2-4b8b56e07c54 => generated 1674 bytes in 1331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:03.903550 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-81d7021a-c470-4fcb-84e9-6dcc12545fe5 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:03.945481 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-81d7021a-c470-4fcb-84e9-6dcc12545fe5 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: 7eded9ca-c7bc-499a-bb53-a28d2c332402] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:03.972926 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-81d7021a-c470-4fcb-84e9-6dcc12545fe5 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:03.976616 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-81d7021a-c470-4fcb-84e9-6dcc12545fe5 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:03.977262 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-81d7021a-c470-4fcb-84e9-6dcc12545fe5 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:03.978029 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-81d7021a-c470-4fcb-84e9-6dcc12545fe5 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:03.989162 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-81d7021a-c470-4fcb-84e9-6dcc12545fe5 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:03.993141 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-81d7021a-c470-4fcb-84e9-6dcc12545fe5 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:04.112723 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-81d7021a-c470-4fcb-84e9-6dcc12545fe5 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/7eded9ca-c7bc-499a-bb53-a28d2c332402/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.212785 Aug 27 02:44:04.120767 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 538/1080] 10.222.0.70 () {60 vars in 1343 bytes} [Sat Aug 27 02:44:03 2022] GET /compute/v2.1/servers/7eded9ca-c7bc-499a-bb53-a28d2c332402/os-volume_attachments => generated 197 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:44:04.129844 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-2223add5-83f0-4734-b3cc-627cfb73149e tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:04.130560 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-2223add5-83f0-4734-b3cc-627cfb73149e tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: 9d4a6e6e-c4d0-4397-bf32-429ae2a252ba] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:04.150831 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2223add5-83f0-4734-b3cc-627cfb73149e tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:04.153303 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2223add5-83f0-4734-b3cc-627cfb73149e tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:04.154336 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2223add5-83f0-4734-b3cc-627cfb73149e tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:04.156693 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2223add5-83f0-4734-b3cc-627cfb73149e tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:04.157586 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2223add5-83f0-4734-b3cc-627cfb73149e tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:04.158155 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2223add5-83f0-4734-b3cc-627cfb73149e tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:06.767434 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-2223add5-83f0-4734-b3cc-627cfb73149e tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6d1646ec094e3297f6f3c51dd72e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b105816fd4e54b9da4973ff721e1fb92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:06.803417 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-2223add5-83f0-4734-b3cc-627cfb73149e tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "GET /compute/v2.1/servers/9d4a6e6e-c4d0-4397-bf32-429ae2a252ba" status: 200 len: 1469 microversion: 2.1 time: 2.660989 Aug 27 02:44:06.839590 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 539/1081] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:04 2022] GET /compute/v2.1/servers/9d4a6e6e-c4d0-4397-bf32-429ae2a252ba => generated 1469 bytes in 2718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:06.853700 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-21d62c1a-a110-429a-8d10-7f0fd3a1c93e tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:06.854773 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-21d62c1a-a110-429a-8d10-7f0fd3a1c93e tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 3095a9f9-6769-4107-94a5-beac6415694c] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:06.871970 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=67 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:44:06.875482 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-21d62c1a-a110-429a-8d10-7f0fd3a1c93e tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:06.876332 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-21d62c1a-a110-429a-8d10-7f0fd3a1c93e tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:06.881993 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-21d62c1a-a110-429a-8d10-7f0fd3a1c93e tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:06.883002 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-21d62c1a-a110-429a-8d10-7f0fd3a1c93e tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:06.885296 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-21d62c1a-a110-429a-8d10-7f0fd3a1c93e tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:06.888726 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-21d62c1a-a110-429a-8d10-7f0fd3a1c93e tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:08.062813 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-21d62c1a-a110-429a-8d10-7f0fd3a1c93e tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:08.092849 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-21d62c1a-a110-429a-8d10-7f0fd3a1c93e tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/3095a9f9-6769-4107-94a5-beac6415694c" status: 200 len: 1717 microversion: 2.1 time: 1.249775 Aug 27 02:44:08.094796 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 540/1082] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:06 2022] GET /compute/v2.1/servers/3095a9f9-6769-4107-94a5-beac6415694c => generated 1717 bytes in 1254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:08.104896 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-76830139-ab29-415d-8899-231380c46e47 req-9e67a148-ae6e-4844-ba9f-680c452063c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38a900db-3d56-4836-a2a9-a39fe28ab481", "name": "network-vif-plugged", "status": "completed", "tag": "8509ffd4-5c61-44af-8b1e-301681acca1a"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:44:08.171826 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-76830139-ab29-415d-8899-231380c46e47 req-9e67a148-ae6e-4844-ba9f-680c452063c7 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:08.180374 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-76830139-ab29-415d-8899-231380c46e47 req-9e67a148-ae6e-4844-ba9f-680c452063c7 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:08.180836 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-76830139-ab29-415d-8899-231380c46e47 req-9e67a148-ae6e-4844-ba9f-680c452063c7 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:08.241442 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-76830139-ab29-415d-8899-231380c46e47 req-9e67a148-ae6e-4844-ba9f-680c452063c7 service nova] Creating event network-vif-plugged:8509ffd4-5c61-44af-8b1e-301681acca1a for instance 38a900db-3d56-4836-a2a9-a39fe28ab481 on n-h2-852278-4 Aug 27 02:44:08.272845 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-76830139-ab29-415d-8899-231380c46e47 req-9e67a148-ae6e-4844-ba9f-680c452063c7 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.169798 Aug 27 02:44:08.273769 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 541/1083] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:44:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:44:08.304441 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8583825b-1147-46b9-ac7a-5dc60cc6869a tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:08.310355 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-8583825b-1147-46b9-ac7a-5dc60cc6869a tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] [instance: c03f5d7e-1851-47a0-9ec2-4b8b56e07c54] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:08.328776 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8583825b-1147-46b9-ac7a-5dc60cc6869a tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:08.336124 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8583825b-1147-46b9-ac7a-5dc60cc6869a tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:08.338918 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8583825b-1147-46b9-ac7a-5dc60cc6869a tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:08.341871 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8583825b-1147-46b9-ac7a-5dc60cc6869a tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:08.342378 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8583825b-1147-46b9-ac7a-5dc60cc6869a tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:08.352097 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8583825b-1147-46b9-ac7a-5dc60cc6869a tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:08.929691 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-8583825b-1147-46b9-ac7a-5dc60cc6869a tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9653dac89d2648b285fd71c1b349e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3ac0c66c5b4bc787d2d6e12a957099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:08.944550 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-8583825b-1147-46b9-ac7a-5dc60cc6869a tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] 10.222.0.70 "GET /compute/v2.1/servers/c03f5d7e-1851-47a0-9ec2-4b8b56e07c54" status: 200 len: 1611 microversion: 2.1 time: 0.665368 Aug 27 02:44:08.953692 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 542/1084] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:08 2022] GET /compute/v2.1/servers/c03f5d7e-1851-47a0-9ec2-4b8b56e07c54 => generated 1611 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:08.967660 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-69ba468e-01f0-4e56-a73d-fbb3b6e409c8 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:08.970219 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-69ba468e-01f0-4e56-a73d-fbb3b6e409c8 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: 7eded9ca-c7bc-499a-bb53-a28d2c332402] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:08.976744 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-69ba468e-01f0-4e56-a73d-fbb3b6e409c8 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:08.977483 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-69ba468e-01f0-4e56-a73d-fbb3b6e409c8 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:08.978134 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-69ba468e-01f0-4e56-a73d-fbb3b6e409c8 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:08.979066 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-69ba468e-01f0-4e56-a73d-fbb3b6e409c8 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:08.979724 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-69ba468e-01f0-4e56-a73d-fbb3b6e409c8 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:08.980424 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-69ba468e-01f0-4e56-a73d-fbb3b6e409c8 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:09.014751 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-69ba468e-01f0-4e56-a73d-fbb3b6e409c8 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/7eded9ca-c7bc-499a-bb53-a28d2c332402/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.058937 Aug 27 02:44:09.021015 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 543/1085] 10.222.0.70 () {60 vars in 1343 bytes} [Sat Aug 27 02:44:08 2022] GET /compute/v2.1/servers/7eded9ca-c7bc-499a-bb53-a28d2c332402/os-volume_attachments => generated 25 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:09.054954 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-52305f53-f8fd-4a93-b869-6949c818daf4 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:09.061120 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-52305f53-f8fd-4a93-b869-6949c818daf4 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: 38a900db-3d56-4836-a2a9-a39fe28ab481] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:09.078084 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-52305f53-f8fd-4a93-b869-6949c818daf4 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:09.078648 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-52305f53-f8fd-4a93-b869-6949c818daf4 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:09.079748 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-52305f53-f8fd-4a93-b869-6949c818daf4 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:09.082522 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-52305f53-f8fd-4a93-b869-6949c818daf4 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:09.083204 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-52305f53-f8fd-4a93-b869-6949c818daf4 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:09.083837 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-52305f53-f8fd-4a93-b869-6949c818daf4 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:09.637897 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-52305f53-f8fd-4a93-b869-6949c818daf4 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6d1646ec094e3297f6f3c51dd72e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b105816fd4e54b9da4973ff721e1fb92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:09.647418 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-52305f53-f8fd-4a93-b869-6949c818daf4 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "GET /compute/v2.1/servers/38a900db-3d56-4836-a2a9-a39fe28ab481" status: 200 len: 1319 microversion: 2.1 time: 0.625026 Aug 27 02:44:09.671416 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 544/1086] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:09 2022] GET /compute/v2.1/servers/38a900db-3d56-4836-a2a9-a39fe28ab481 => generated 1319 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:09.676707 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-47deea9c-f576-4640-b74e-0b204c1a39c2 req-8e7bcebb-fe31-4b0d-a49f-bad53806b4d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c03f5d7e-1851-47a0-9ec2-4b8b56e07c54", "name": "network-vif-deleted", "tag": "c82cc2ac-43bc-4d6c-95ff-a1c1bd45069c"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:44:09.709394 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-47deea9c-f576-4640-b74e-0b204c1a39c2 req-8e7bcebb-fe31-4b0d-a49f-bad53806b4d0 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:09.718472 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-47deea9c-f576-4640-b74e-0b204c1a39c2 req-8e7bcebb-fe31-4b0d-a49f-bad53806b4d0 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:09.719444 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-47deea9c-f576-4640-b74e-0b204c1a39c2 req-8e7bcebb-fe31-4b0d-a49f-bad53806b4d0 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:09.761756 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-47deea9c-f576-4640-b74e-0b204c1a39c2 req-8e7bcebb-fe31-4b0d-a49f-bad53806b4d0 service nova] Creating event network-vif-deleted:c82cc2ac-43bc-4d6c-95ff-a1c1bd45069c for instance c03f5d7e-1851-47a0-9ec2-4b8b56e07c54 on n-h1-852278-4 Aug 27 02:44:09.777815 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-47deea9c-f576-4640-b74e-0b204c1a39c2 req-8e7bcebb-fe31-4b0d-a49f-bad53806b4d0 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104644 Aug 27 02:44:09.788667 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 545/1087] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:44:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:44:09.800219 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4630416a-ed5f-42ff-91a5-ae88082ec4b5 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:09.801198 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-4630416a-ed5f-42ff-91a5-ae88082ec4b5 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 3095a9f9-6769-4107-94a5-beac6415694c] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:09.824166 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4630416a-ed5f-42ff-91a5-ae88082ec4b5 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:09.827217 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4630416a-ed5f-42ff-91a5-ae88082ec4b5 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:09.829195 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4630416a-ed5f-42ff-91a5-ae88082ec4b5 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:09.831591 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4630416a-ed5f-42ff-91a5-ae88082ec4b5 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:09.834814 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4630416a-ed5f-42ff-91a5-ae88082ec4b5 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:09.837161 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4630416a-ed5f-42ff-91a5-ae88082ec4b5 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:09.903204 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:44:09.958396 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:44:10.794596 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-4630416a-ed5f-42ff-91a5-ae88082ec4b5 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:10.804638 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-4630416a-ed5f-42ff-91a5-ae88082ec4b5 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/3095a9f9-6769-4107-94a5-beac6415694c" status: 200 len: 1717 microversion: 2.1 time: 1.014465 Aug 27 02:44:10.840600 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 546/1088] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:09 2022] GET /compute/v2.1/servers/3095a9f9-6769-4107-94a5-beac6415694c => generated 1717 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:10.885336 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-16a65a7d-a0bf-42f7-a490-5b46ce71c435 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:10.888273 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-16a65a7d-a0bf-42f7-a490-5b46ce71c435 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] [instance: c03f5d7e-1851-47a0-9ec2-4b8b56e07c54] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:10.929769 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-16a65a7d-a0bf-42f7-a490-5b46ce71c435 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:10.933080 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-16a65a7d-a0bf-42f7-a490-5b46ce71c435 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:10.937315 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-16a65a7d-a0bf-42f7-a490-5b46ce71c435 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:10.939217 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-16a65a7d-a0bf-42f7-a490-5b46ce71c435 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:10.952899 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-16a65a7d-a0bf-42f7-a490-5b46ce71c435 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:10.953755 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-16a65a7d-a0bf-42f7-a490-5b46ce71c435 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:10.991109 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c4fe02fb-5b89-4b37-a481-e405797b2d7e tempest-FloatingIPsTestJSON-487986886 tempest-FloatingIPsTestJSON-487986886-project] 10.222.0.70 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 11.021389 Aug 27 02:44:10.996943 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 543/1089] 10.222.0.70 () {60 vars in 1170 bytes} [Sat Aug 27 02:43:59 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 11028 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:44:11.004961 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-752c474d-9dce-46a7-9676-e976033c3408 req-c90ea302-6023-4293-be29-8e8495e79661 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c03f5d7e-1851-47a0-9ec2-4b8b56e07c54", "name": "network-vif-unplugged", "status": "completed", "tag": "bfb5266d-2a65-4d40-b632-0d451d4e6526"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:44:11.070359 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-752c474d-9dce-46a7-9676-e976033c3408 req-c90ea302-6023-4293-be29-8e8495e79661 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:11.082914 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-16a65a7d-a0bf-42f7-a490-5b46ce71c435 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] HTTP exception thrown: Instance c03f5d7e-1851-47a0-9ec2-4b8b56e07c54 could not be found. Aug 27 02:44:11.092955 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-16a65a7d-a0bf-42f7-a490-5b46ce71c435 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Request method failure captured: Aug 27 02:44:11.092955 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/c03f5d7e-1851-47a0-9ec2-4b8b56e07c54 HTTP/1.1 Aug 27 02:44:11.092955 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:44:11.092955 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:44:11.092955 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:44:11.092955 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:44:11.092955 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:44:11.092955 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:44:11.092955 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:44:11.092955 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:44:11.092955 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYSPKBSAK1RBsjO1oN1WggQRmMhpUngggs4TV2dXU8cbBDlW4DmT9rfqH5xamQYSsmI1WCKnfNA2wlGzcSHbeGNdrtQOH_6bp51ZZcFRJSifhxvJ93QGKsImv__aWsju5fdnOri3cIl7bCJ1EfIj-gEp6hjWPkd3cLreqiL4ImjG6yo Aug 27 02:44:11.092955 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:44:11.092955 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:44:11.092955 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:44:11.092955 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:44:11.092955 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:44:11.092955 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:44:11.092955 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: de3ac0c66c5b4bc787d2d6e12a957099 Aug 27 02:44:11.092955 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ServersTestMultiNic-264021201 Aug 27 02:44:11.092955 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:44:11.092955 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:44:11.094553 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/de3ac0c66c5b4bc787d2d6e12a957099"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_de3ac0c66c5b4bc787d2d6e12a957099", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/de3ac0c66c5b4bc787d2d6e12a957099"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/de3ac0c66c5b4bc787d2d6e12a957099"}]}] Aug 27 02:44:11.094553 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ServersTestMultiNic-264021201 Aug 27 02:44:11.094553 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: de3ac0c66c5b4bc787d2d6e12a957099 Aug 27 02:44:11.094553 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ServersTestMultiNic-264021201 Aug 27 02:44:11.094553 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ServersTestMultiNic-264021201-project Aug 27 02:44:11.094553 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:44:11.094553 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:44:11.094553 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 9653dac89d2648b285fd71c1b349e642 Aug 27 02:44:11.094553 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ServersTestMultiNic-264021201-project Aug 27 02:44:11.094553 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 02:44:11.094553 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance c03f5d7e-1851-47a0-9ec2-4b8b56e07c54 could not be found. Aug 27 02:44:11.094553 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': 'c03f5d7e-1851-47a0-9ec2-4b8b56e07c54'} Aug 27 02:44:11.095468 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:44:11.095468 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:44:11.095468 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:44:11.095468 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:44:11.095468 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:44:11.095468 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:44:11.095468 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:44:11.095468 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:44:11.095468 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:44:11.095468 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:44:11.095468 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c03f5d7e-1851-47a0-9ec2-4b8b56e07c54 could not be found. Aug 27 02:44:11.095468 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:44:11.095468 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:44:11.095468 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:44:11.095468 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:44:11.095468 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:44:11.095468 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:44:11.095468 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:44:11.095468 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:44:11.095468 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:44:11.098838 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:44:11.098838 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:44:11.098838 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:44:11.098838 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:44:11.098838 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:44:11.098838 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:44:11.098838 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:44:11.098838 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c03f5d7e-1851-47a0-9ec2-4b8b56e07c54 could not be found. Aug 27 02:44:11.098838 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:44:11.098838 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:44:11.098838 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:44:11.098838 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:44:11.098838 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:44:11.098838 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:44:11.098838 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:44:11.098838 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:44:11.098838 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c03f5d7e-1851-47a0-9ec2-4b8b56e07c54 could not be found. Aug 27 02:44:11.098838 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:44:11.100027 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-16a65a7d-a0bf-42f7-a490-5b46ce71c435 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Returning 404 to user: Instance c03f5d7e-1851-47a0-9ec2-4b8b56e07c54 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:44:11.100027 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-16a65a7d-a0bf-42f7-a490-5b46ce71c435 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] 10.222.0.70 "GET /compute/v2.1/servers/c03f5d7e-1851-47a0-9ec2-4b8b56e07c54" status: 404 len: 111 microversion: 2.1 time: 0.252598 Aug 27 02:44:11.100179 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-752c474d-9dce-46a7-9676-e976033c3408 req-c90ea302-6023-4293-be29-8e8495e79661 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:11.100179 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-752c474d-9dce-46a7-9676-e976033c3408 req-c90ea302-6023-4293-be29-8e8495e79661 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:11.107845 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 547/1090] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:10 2022] GET /compute/v2.1/servers/c03f5d7e-1851-47a0-9ec2-4b8b56e07c54 => generated 111 bytes in 266 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:44:11.136772 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-eb289ca3-2b4f-4889-9000-1338ac932764 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:11.139950 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-eb289ca3-2b4f-4889-9000-1338ac932764 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: 38a900db-3d56-4836-a2a9-a39fe28ab481] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:11.156053 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-752c474d-9dce-46a7-9676-e976033c3408 req-c90ea302-6023-4293-be29-8e8495e79661 service nova] Creating event network-vif-unplugged:bfb5266d-2a65-4d40-b632-0d451d4e6526 for instance c03f5d7e-1851-47a0-9ec2-4b8b56e07c54 on n-h1-852278-4 Aug 27 02:44:11.174196 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eb289ca3-2b4f-4889-9000-1338ac932764 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:11.178529 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-752c474d-9dce-46a7-9676-e976033c3408 req-c90ea302-6023-4293-be29-8e8495e79661 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.179962 Aug 27 02:44:11.179141 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 544/1091] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:44:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:44:11.179478 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eb289ca3-2b4f-4889-9000-1338ac932764 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:11.181913 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eb289ca3-2b4f-4889-9000-1338ac932764 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:11.183674 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eb289ca3-2b4f-4889-9000-1338ac932764 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:11.184924 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eb289ca3-2b4f-4889-9000-1338ac932764 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:11.188257 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eb289ca3-2b4f-4889-9000-1338ac932764 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:11.200841 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-083e6c5e-b9ba-43aa-a095-290b27c50ce6 tempest-FloatingIPsTestJSON-487986886 tempest-FloatingIPsTestJSON-487986886-project] Calling method '.version_select at 0x7f5ee2f9d9d0>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:12.535294 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-eb289ca3-2b4f-4889-9000-1338ac932764 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6d1646ec094e3297f6f3c51dd72e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b105816fd4e54b9da4973ff721e1fb92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:12.544614 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-eb289ca3-2b4f-4889-9000-1338ac932764 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "GET /compute/v2.1/servers/38a900db-3d56-4836-a2a9-a39fe28ab481" status: 200 len: 1468 microversion: 2.1 time: 1.435203 Aug 27 02:44:12.570375 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 548/1092] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:11 2022] GET /compute/v2.1/servers/38a900db-3d56-4836-a2a9-a39fe28ab481 => generated 1468 bytes in 1462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:12.577762 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-756d4c91-1b14-4a18-96c9-22015fb14f61 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:12.578367 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-756d4c91-1b14-4a18-96c9-22015fb14f61 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 3095a9f9-6769-4107-94a5-beac6415694c] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:12.615511 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-756d4c91-1b14-4a18-96c9-22015fb14f61 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:12.622443 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-756d4c91-1b14-4a18-96c9-22015fb14f61 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:12.624162 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-756d4c91-1b14-4a18-96c9-22015fb14f61 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:12.626493 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-756d4c91-1b14-4a18-96c9-22015fb14f61 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:12.631685 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-756d4c91-1b14-4a18-96c9-22015fb14f61 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:12.633347 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-756d4c91-1b14-4a18-96c9-22015fb14f61 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:13.716235 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-756d4c91-1b14-4a18-96c9-22015fb14f61 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:13.742830 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-756d4c91-1b14-4a18-96c9-22015fb14f61 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/3095a9f9-6769-4107-94a5-beac6415694c" status: 200 len: 1717 microversion: 2.1 time: 1.171246 Aug 27 02:44:13.746717 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 549/1093] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:12 2022] GET /compute/v2.1/servers/3095a9f9-6769-4107-94a5-beac6415694c => generated 1717 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:13.765136 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-e2ec6bd0-c70b-4d20-ba5b-a361ad577dfa req-0d559033-812f-417e-a805-c182a61fd2a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c03f5d7e-1851-47a0-9ec2-4b8b56e07c54", "name": "network-vif-deleted", "tag": "bfb5266d-2a65-4d40-b632-0d451d4e6526"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:44:13.812626 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-e2ec6bd0-c70b-4d20-ba5b-a361ad577dfa req-0d559033-812f-417e-a805-c182a61fd2a1 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:13.822080 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-e2ec6bd0-c70b-4d20-ba5b-a361ad577dfa req-0d559033-812f-417e-a805-c182a61fd2a1 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:13.825112 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-e2ec6bd0-c70b-4d20-ba5b-a361ad577dfa req-0d559033-812f-417e-a805-c182a61fd2a1 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:13.883102 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-e2ec6bd0-c70b-4d20-ba5b-a361ad577dfa req-0d559033-812f-417e-a805-c182a61fd2a1 service nova] Creating event network-vif-deleted:bfb5266d-2a65-4d40-b632-0d451d4e6526 for instance c03f5d7e-1851-47a0-9ec2-4b8b56e07c54 on n-h1-852278-4 Aug 27 02:44:13.903483 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-e2ec6bd0-c70b-4d20-ba5b-a361ad577dfa req-0d559033-812f-417e-a805-c182a61fd2a1 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154457 Aug 27 02:44:13.914442 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 550/1094] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:44:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:44:13.937309 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b4415db3-7a63-4f18-bd9a-2d775fe2dc2e tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:13.968672 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-b4415db3-7a63-4f18-bd9a-2d775fe2dc2e tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'eb6d1646ec094e3297f6f3c51dd72e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b105816fd4e54b9da4973ff721e1fb92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:13.971386 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b4415db3-7a63-4f18-bd9a-2d775fe2dc2e tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Searching by: {'reservation_id': 'r-1jex04ld', 'deleted': False, 'project_id': 'b105816fd4e54b9da4973ff721e1fb92'} {{(pid=134051) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 02:44:14.006262 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b4415db3-7a63-4f18-bd9a-2d775fe2dc2e tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:14.007041 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b4415db3-7a63-4f18-bd9a-2d775fe2dc2e tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:14.007640 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b4415db3-7a63-4f18-bd9a-2d775fe2dc2e tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:14.011331 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b4415db3-7a63-4f18-bd9a-2d775fe2dc2e tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:14.014537 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b4415db3-7a63-4f18-bd9a-2d775fe2dc2e tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:14.016107 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b4415db3-7a63-4f18-bd9a-2d775fe2dc2e tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:14.453891 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.multi_cell_list [None req-b4415db3-7a63-4f18-bd9a-2d775fe2dc2e tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=134051) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 02:44:14.654851 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-b4415db3-7a63-4f18-bd9a-2d775fe2dc2e tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6d1646ec094e3297f6f3c51dd72e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b105816fd4e54b9da4973ff721e1fb92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:14.715459 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b4415db3-7a63-4f18-bd9a-2d775fe2dc2e tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:14.715970 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b4415db3-7a63-4f18-bd9a-2d775fe2dc2e tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:14.716440 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b4415db3-7a63-4f18-bd9a-2d775fe2dc2e tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:16.509332 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b4415db3-7a63-4f18-bd9a-2d775fe2dc2e tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "GET /compute/v2.1/servers/detail?reservation_id=r-1jex04ld" status: 200 len: 2930 microversion: 2.1 time: 2.593100 Aug 27 02:44:16.524508 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 551/1095] 10.222.0.70 () {58 vars in 1197 bytes} [Sat Aug 27 02:44:13 2022] GET /compute/v2.1/servers/detail?reservation_id=r-1jex04ld => generated 2930 bytes in 2595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:16.524508 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d6876d71-42d0-41c4-8cee-e19a30f99a95 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:16.524508 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d6876d71-42d0-41c4-8cee-e19a30f99a95 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 3095a9f9-6769-4107-94a5-beac6415694c] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:16.550276 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d6876d71-42d0-41c4-8cee-e19a30f99a95 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:16.550876 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d6876d71-42d0-41c4-8cee-e19a30f99a95 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:16.551326 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d6876d71-42d0-41c4-8cee-e19a30f99a95 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:16.556841 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d6876d71-42d0-41c4-8cee-e19a30f99a95 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:16.560211 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d6876d71-42d0-41c4-8cee-e19a30f99a95 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:16.560708 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d6876d71-42d0-41c4-8cee-e19a30f99a95 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:16.885587 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d6876d71-42d0-41c4-8cee-e19a30f99a95 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:16.895628 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d6876d71-42d0-41c4-8cee-e19a30f99a95 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/3095a9f9-6769-4107-94a5-beac6415694c" status: 200 len: 1717 microversion: 2.1 time: 0.383890 Aug 27 02:44:16.918466 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 552/1096] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:16 2022] GET /compute/v2.1/servers/3095a9f9-6769-4107-94a5-beac6415694c => generated 1717 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:16.932141 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-470c2468-28e5-4aeb-969d-370f9f30cf1e tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:16.971685 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.compute.server_groups [None req-470c2468-28e5-4aeb-969d-370f9f30cf1e tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Querying cell 9e3f7cc8-d9cf-4064-9831-4fdba8cfa839(cell1) for 2 instances {{(pid=134051) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 27 02:44:16.977362 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-470c2468-28e5-4aeb-969d-370f9f30cf1e tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:16.978804 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-470c2468-28e5-4aeb-969d-370f9f30cf1e tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:16.980793 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-470c2468-28e5-4aeb-969d-370f9f30cf1e tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:17.053166 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-470c2468-28e5-4aeb-969d-370f9f30cf1e tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "GET /compute/v2.1/os-server-groups/8c76dad9-8b1d-4581-a97a-c6ecd0a004e4" status: 200 len: 271 microversion: 2.1 time: 0.133109 Aug 27 02:44:17.058667 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 553/1097] 10.222.0.70 () {58 vars in 1263 bytes} [Sat Aug 27 02:44:16 2022] GET /compute/v2.1/os-server-groups/8c76dad9-8b1d-4581-a97a-c6ecd0a004e4 => generated 271 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:44:17.076503 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-43ddab5b-7566-4d04-8bc1-a111d2af25d5 tempest-ServersOnMultiNodesTest-986315705 tempest-ServersOnMultiNodesTest-986315705-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:17.077639 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-43ddab5b-7566-4d04-8bc1-a111d2af25d5 tempest-ServersOnMultiNodesTest-986315705 tempest-ServersOnMultiNodesTest-986315705-project-admin] [instance: 38a900db-3d56-4836-a2a9-a39fe28ab481] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:17.090292 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-43ddab5b-7566-4d04-8bc1-a111d2af25d5 tempest-ServersOnMultiNodesTest-986315705 tempest-ServersOnMultiNodesTest-986315705-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:17.091075 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-43ddab5b-7566-4d04-8bc1-a111d2af25d5 tempest-ServersOnMultiNodesTest-986315705 tempest-ServersOnMultiNodesTest-986315705-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:17.091678 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-43ddab5b-7566-4d04-8bc1-a111d2af25d5 tempest-ServersOnMultiNodesTest-986315705 tempest-ServersOnMultiNodesTest-986315705-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:17.093156 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-43ddab5b-7566-4d04-8bc1-a111d2af25d5 tempest-ServersOnMultiNodesTest-986315705 tempest-ServersOnMultiNodesTest-986315705-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:17.093803 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-43ddab5b-7566-4d04-8bc1-a111d2af25d5 tempest-ServersOnMultiNodesTest-986315705 tempest-ServersOnMultiNodesTest-986315705-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:17.094583 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-43ddab5b-7566-4d04-8bc1-a111d2af25d5 tempest-ServersOnMultiNodesTest-986315705 tempest-ServersOnMultiNodesTest-986315705-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:17.368703 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=100 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:44:17.378011 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-43ddab5b-7566-4d04-8bc1-a111d2af25d5 tempest-ServersOnMultiNodesTest-986315705 tempest-ServersOnMultiNodesTest-986315705-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/38a900db-3d56-4836-a2a9-a39fe28ab481" status: 200 len: 1619 microversion: 2.1 time: 0.311405 Aug 27 02:44:17.378613 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 554/1098] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:17 2022] GET /compute/v2.1/servers/38a900db-3d56-4836-a2a9-a39fe28ab481 => generated 1619 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:17.410618 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-083e6c5e-b9ba-43aa-a095-290b27c50ce6 tempest-FloatingIPsTestJSON-487986886 tempest-FloatingIPsTestJSON-487986886-project] 10.222.0.70 "DELETE /compute/v2.1/os-floating-ips/f3320b77-3955-45b5-bb2f-1eab9da230bd" status: 202 len: 0 microversion: 2.1 time: 6.220624 Aug 27 02:44:17.411515 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 545/1099] 10.222.0.70 () {58 vars in 1263 bytes} [Sat Aug 27 02:44:11 2022] DELETE /compute/v2.1/os-floating-ips/f3320b77-3955-45b5-bb2f-1eab9da230bd => generated 0 bytes in 6222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:44:17.417090 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-1d82343d-777d-4513-b751-c34f79b98d79 tempest-ServersOnMultiNodesTest-986315705 tempest-ServersOnMultiNodesTest-986315705-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:17.419158 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-1d82343d-777d-4513-b751-c34f79b98d79 tempest-ServersOnMultiNodesTest-986315705 tempest-ServersOnMultiNodesTest-986315705-project-admin] [instance: 9d4a6e6e-c4d0-4397-bf32-429ae2a252ba] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:17.419465 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-88518edf-dfcf-4620-871e-ec98bf5d60f6 tempest-FloatingIPsTestJSON-487986886 tempest-FloatingIPsTestJSON-487986886-project] Calling method '.version_select at 0x7f5ee2dffe50>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:17.443604 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1d82343d-777d-4513-b751-c34f79b98d79 tempest-ServersOnMultiNodesTest-986315705 tempest-ServersOnMultiNodesTest-986315705-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:17.444122 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1d82343d-777d-4513-b751-c34f79b98d79 tempest-ServersOnMultiNodesTest-986315705 tempest-ServersOnMultiNodesTest-986315705-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:17.444593 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1d82343d-777d-4513-b751-c34f79b98d79 tempest-ServersOnMultiNodesTest-986315705 tempest-ServersOnMultiNodesTest-986315705-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:17.445324 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1d82343d-777d-4513-b751-c34f79b98d79 tempest-ServersOnMultiNodesTest-986315705 tempest-ServersOnMultiNodesTest-986315705-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:17.445778 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1d82343d-777d-4513-b751-c34f79b98d79 tempest-ServersOnMultiNodesTest-986315705 tempest-ServersOnMultiNodesTest-986315705-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:17.453151 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1d82343d-777d-4513-b751-c34f79b98d79 tempest-ServersOnMultiNodesTest-986315705 tempest-ServersOnMultiNodesTest-986315705-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:17.571414 n-d-852278-4 devstack@n-api.service[134052]: DEBUG neutronclient.v2_0.client [None req-88518edf-dfcf-4620-871e-ec98bf5d60f6 tempest-FloatingIPsTestJSON-487986886 tempest-FloatingIPsTestJSON-487986886-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP f3320b77-3955-45b5-bb2f-1eab9da230bd could not be found", "detail": ""}} {{(pid=134052) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 02:44:17.572456 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-88518edf-dfcf-4620-871e-ec98bf5d60f6 tempest-FloatingIPsTestJSON-487986886 tempest-FloatingIPsTestJSON-487986886-project] HTTP exception thrown: Floating IP not found for ID f3320b77-3955-45b5-bb2f-1eab9da230bd Aug 27 02:44:17.576011 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-88518edf-dfcf-4620-871e-ec98bf5d60f6 tempest-FloatingIPsTestJSON-487986886 tempest-FloatingIPsTestJSON-487986886-project] Request method failure captured: Aug 27 02:44:17.576011 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/os-floating-ips/f3320b77-3955-45b5-bb2f-1eab9da230bd HTTP/1.1 Aug 27 02:44:17.576011 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:44:17.576011 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:44:17.576011 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:44:17.576011 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:44:17.576011 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:44:17.576011 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:44:17.576011 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:44:17.576011 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:44:17.576011 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYTfOfuxsgTCmB9EUbhY7v1U8Rjs0Jku7gLf3PwwWXvZgC-B7-xxmsymDoG080mkiBYWnOVAHgDPIr37b-Ch0J2YoPhJmq-4oAbvb1RWhv-SMq9_p-4JgmR28EB_rSGLg5dsB1eqzFui1zGix7H8J6J-m50q-4SZj-vVbFy7EruvzrY Aug 27 02:44:17.576011 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:44:17.576011 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:44:17.576011 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:44:17.576011 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:44:17.576011 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:44:17.576011 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:44:17.576011 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: c28ad2d8b9b548639adba1bcf43e5df2 Aug 27 02:44:17.576011 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-FloatingIPsTestJSON-487986886 Aug 27 02:44:17.576011 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:44:17.576011 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:44:17.577605 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c28ad2d8b9b548639adba1bcf43e5df2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c28ad2d8b9b548639adba1bcf43e5df2", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c28ad2d8b9b548639adba1bcf43e5df2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c28ad2d8b9b548639adba1bcf43e5df2"}]}] Aug 27 02:44:17.577605 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-FloatingIPsTestJSON-487986886 Aug 27 02:44:17.577605 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: c28ad2d8b9b548639adba1bcf43e5df2 Aug 27 02:44:17.577605 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-FloatingIPsTestJSON-487986886 Aug 27 02:44:17.577605 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-FloatingIPsTestJSON-487986886-project Aug 27 02:44:17.577605 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:44:17.577605 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:44:17.577605 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: e747768350654478a948d349e3650151 Aug 27 02:44:17.577605 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-FloatingIPsTestJSON-487986886-project Aug 27 02:44:17.577605 n-d-852278-4 devstack@n-api.service[134052]: method: Aug 27 02:44:17.577605 n-d-852278-4 devstack@n-api.service[134052]: exception: Floating IP not found for ID f3320b77-3955-45b5-bb2f-1eab9da230bd Aug 27 02:44:17.577605 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': 'f3320b77-3955-45b5-bb2f-1eab9da230bd'} Aug 27 02:44:17.577605 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:44:17.578546 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:44:17.578546 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 27 02:44:17.578546 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 27 02:44:17.578546 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:44:17.578546 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:44:17.578546 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 27 02:44:17.578546 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 27 02:44:17.578546 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:44:17.578546 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:44:17.578546 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 02:44:17.578546 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 02:44:17.578546 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:44:17.578546 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:44:17.578546 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 02:44:17.578546 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 02:44:17.578546 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:44:17.578546 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:44:17.578546 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 02:44:17.578546 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 02:44:17.580098 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:44:17.580098 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:44:17.580098 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 02:44:17.580098 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 02:44:17.580098 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 02:44:17.580098 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 02:44:17.580098 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP f3320b77-3955-45b5-bb2f-1eab9da230bd could not be found Aug 27 02:44:17.580098 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ea9212d8-2e2a-4a08-a6ac-f863b4907ec1'] Aug 27 02:44:17.580098 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:44:17.580098 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:44:17.580098 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:44:17.580098 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:44:17.580098 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Aug 27 02:44:17.580098 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 27 02:44:17.580098 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 27 02:44:17.580098 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 27 02:44:17.580098 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID f3320b77-3955-45b5-bb2f-1eab9da230bd. Aug 27 02:44:17.580098 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:44:17.580098 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:44:17.580098 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:44:17.583010 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:44:17.583010 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:44:17.583010 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:44:17.583010 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:44:17.583010 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:44:17.583010 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:44:17.583010 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:44:17.583010 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:44:17.583010 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:44:17.583010 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Aug 27 02:44:17.583010 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 27 02:44:17.583010 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID f3320b77-3955-45b5-bb2f-1eab9da230bd Aug 27 02:44:17.583010 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:44:17.583010 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:44:17.583010 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:44:17.583010 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:44:17.583010 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:44:17.583010 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:44:17.583010 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:44:17.583010 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:44:17.585713 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID f3320b77-3955-45b5-bb2f-1eab9da230bd Aug 27 02:44:17.585713 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:44:17.585713 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-88518edf-dfcf-4620-871e-ec98bf5d60f6 tempest-FloatingIPsTestJSON-487986886 tempest-FloatingIPsTestJSON-487986886-project] Returning 404 to user: Floating IP not found for ID f3320b77-3955-45b5-bb2f-1eab9da230bd {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:44:17.585713 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-88518edf-dfcf-4620-871e-ec98bf5d60f6 tempest-FloatingIPsTestJSON-487986886 tempest-FloatingIPsTestJSON-487986886-project] 10.222.0.70 "GET /compute/v2.1/os-floating-ips/f3320b77-3955-45b5-bb2f-1eab9da230bd" status: 404 len: 111 microversion: 2.1 time: 0.161955 Aug 27 02:44:17.585713 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 546/1100] 10.222.0.70 () {58 vars in 1260 bytes} [Sat Aug 27 02:44:17 2022] GET /compute/v2.1/os-floating-ips/f3320b77-3955-45b5-bb2f-1eab9da230bd => generated 111 bytes in 167 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 02:44:17.604068 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-14cdb8b4-4880-4173-92eb-5fdbd47fe4f5 tempest-FloatingIPsTestJSON-487986886 tempest-FloatingIPsTestJSON-487986886-project] Calling method '.version_select at 0x7f5ee2ef7f70>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:17.932613 n-d-852278-4 devstack@n-api.service[134052]: DEBUG neutronclient.v2_0.client [None req-14cdb8b4-4880-4173-92eb-5fdbd47fe4f5 tempest-FloatingIPsTestJSON-487986886 tempest-FloatingIPsTestJSON-487986886-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP f3320b77-3955-45b5-bb2f-1eab9da230bd could not be found", "detail": ""}} {{(pid=134052) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 02:44:17.933275 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-14cdb8b4-4880-4173-92eb-5fdbd47fe4f5 tempest-FloatingIPsTestJSON-487986886 tempest-FloatingIPsTestJSON-487986886-project] HTTP exception thrown: Floating IP not found for ID f3320b77-3955-45b5-bb2f-1eab9da230bd Aug 27 02:44:17.935061 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-14cdb8b4-4880-4173-92eb-5fdbd47fe4f5 tempest-FloatingIPsTestJSON-487986886 tempest-FloatingIPsTestJSON-487986886-project] Request method failure captured: Aug 27 02:44:17.935061 n-d-852278-4 devstack@n-api.service[134052]: request: DELETE /compute/v2.1/os-floating-ips/f3320b77-3955-45b5-bb2f-1eab9da230bd HTTP/1.1 Aug 27 02:44:17.935061 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:44:17.935061 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:44:17.935061 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:44:17.935061 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:44:17.935061 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:44:17.935061 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:44:17.935061 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:44:17.935061 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:44:17.935061 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYTfOfuxsgTCmB9EUbhY7v1U8Rjs0Jku7gLf3PwwWXvZgC-B7-xxmsymDoG080mkiBYWnOVAHgDPIr37b-Ch0J2YoPhJmq-4oAbvb1RWhv-SMq9_p-4JgmR28EB_rSGLg5dsB1eqzFui1zGix7H8J6J-m50q-4SZj-vVbFy7EruvzrY Aug 27 02:44:17.935061 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:44:17.935061 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:44:17.935061 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:44:17.935061 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:44:17.935061 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:44:17.935061 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:44:17.935061 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: c28ad2d8b9b548639adba1bcf43e5df2 Aug 27 02:44:17.935061 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-FloatingIPsTestJSON-487986886 Aug 27 02:44:17.935061 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:44:17.935061 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:44:17.936463 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c28ad2d8b9b548639adba1bcf43e5df2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c28ad2d8b9b548639adba1bcf43e5df2", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c28ad2d8b9b548639adba1bcf43e5df2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c28ad2d8b9b548639adba1bcf43e5df2"}]}] Aug 27 02:44:17.936463 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-FloatingIPsTestJSON-487986886 Aug 27 02:44:17.936463 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: c28ad2d8b9b548639adba1bcf43e5df2 Aug 27 02:44:17.936463 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-FloatingIPsTestJSON-487986886 Aug 27 02:44:17.936463 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-FloatingIPsTestJSON-487986886-project Aug 27 02:44:17.936463 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:44:17.936463 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:44:17.936463 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: e747768350654478a948d349e3650151 Aug 27 02:44:17.936463 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-FloatingIPsTestJSON-487986886-project Aug 27 02:44:17.936463 n-d-852278-4 devstack@n-api.service[134052]: method: Aug 27 02:44:17.936463 n-d-852278-4 devstack@n-api.service[134052]: exception: Floating IP not found for ID f3320b77-3955-45b5-bb2f-1eab9da230bd Aug 27 02:44:17.936463 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': 'f3320b77-3955-45b5-bb2f-1eab9da230bd'} Aug 27 02:44:17.936463 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:44:17.937310 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:44:17.937310 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 27 02:44:17.937310 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 27 02:44:17.937310 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:44:17.937310 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:44:17.937310 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 27 02:44:17.937310 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 27 02:44:17.937310 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:44:17.937310 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:44:17.937310 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 02:44:17.937310 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 02:44:17.937310 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:44:17.937310 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:44:17.937310 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 02:44:17.937310 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 02:44:17.937310 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:44:17.937310 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:44:17.937310 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 02:44:17.937310 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 02:44:17.938465 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:44:17.938465 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:44:17.938465 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 02:44:17.938465 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 02:44:17.938465 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 02:44:17.938465 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 02:44:17.938465 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP f3320b77-3955-45b5-bb2f-1eab9da230bd could not be found Aug 27 02:44:17.938465 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5e5d9bb2-c685-44fd-98a3-f644d3a38cbf'] Aug 27 02:44:17.938465 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:44:17.938465 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:44:17.938465 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:44:17.938465 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:44:17.938465 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Aug 27 02:44:17.938465 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 27 02:44:17.938465 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 27 02:44:17.938465 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 27 02:44:17.938465 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID f3320b77-3955-45b5-bb2f-1eab9da230bd. Aug 27 02:44:17.938465 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:44:17.938465 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:44:17.938465 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:44:17.939872 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:44:17.939872 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:44:17.939872 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:44:17.939872 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:44:17.939872 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:44:17.939872 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:44:17.939872 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:44:17.939872 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:44:17.939872 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:44:17.939872 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Aug 27 02:44:17.939872 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 27 02:44:17.939872 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID f3320b77-3955-45b5-bb2f-1eab9da230bd Aug 27 02:44:17.939872 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:44:17.939872 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:44:17.939872 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:44:17.939872 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:44:17.939872 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:44:17.939872 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:44:17.939872 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:44:17.939872 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:44:17.941154 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID f3320b77-3955-45b5-bb2f-1eab9da230bd Aug 27 02:44:17.941154 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:44:17.945099 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-14cdb8b4-4880-4173-92eb-5fdbd47fe4f5 tempest-FloatingIPsTestJSON-487986886 tempest-FloatingIPsTestJSON-487986886-project] Returning 404 to user: Floating IP not found for ID f3320b77-3955-45b5-bb2f-1eab9da230bd {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:44:17.945099 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-14cdb8b4-4880-4173-92eb-5fdbd47fe4f5 tempest-FloatingIPsTestJSON-487986886 tempest-FloatingIPsTestJSON-487986886-project] 10.222.0.70 "DELETE /compute/v2.1/os-floating-ips/f3320b77-3955-45b5-bb2f-1eab9da230bd" status: 404 len: 111 microversion: 2.1 time: 0.359083 Aug 27 02:44:17.945099 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 547/1101] 10.222.0.70 () {58 vars in 1263 bytes} [Sat Aug 27 02:44:17 2022] DELETE /compute/v2.1/os-floating-ips/f3320b77-3955-45b5-bb2f-1eab9da230bd => generated 111 bytes in 360 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:44:17.959895 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-bc3a589b-ef91-47f8-adbc-8c345f0e11df tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:17.963157 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-bc3a589b-ef91-47f8-adbc-8c345f0e11df tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 3095a9f9-6769-4107-94a5-beac6415694c] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:17.990043 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bc3a589b-ef91-47f8-adbc-8c345f0e11df tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:17.990520 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bc3a589b-ef91-47f8-adbc-8c345f0e11df tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:17.990950 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bc3a589b-ef91-47f8-adbc-8c345f0e11df tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:17.991654 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bc3a589b-ef91-47f8-adbc-8c345f0e11df tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:17.992091 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bc3a589b-ef91-47f8-adbc-8c345f0e11df tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:17.992541 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bc3a589b-ef91-47f8-adbc-8c345f0e11df tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:18.067165 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-1d82343d-777d-4513-b751-c34f79b98d79 tempest-ServersOnMultiNodesTest-986315705 tempest-ServersOnMultiNodesTest-986315705-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/9d4a6e6e-c4d0-4397-bf32-429ae2a252ba" status: 200 len: 1620 microversion: 2.1 time: 0.668949 Aug 27 02:44:18.074311 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 555/1102] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:17 2022] GET /compute/v2.1/servers/9d4a6e6e-c4d0-4397-bf32-429ae2a252ba => generated 1620 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:18.384641 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-bc3a589b-ef91-47f8-adbc-8c345f0e11df tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:18.395879 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-bc3a589b-ef91-47f8-adbc-8c345f0e11df tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/3095a9f9-6769-4107-94a5-beac6415694c" status: 200 len: 1717 microversion: 2.1 time: 0.451747 Aug 27 02:44:18.401471 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 548/1103] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:17 2022] GET /compute/v2.1/servers/3095a9f9-6769-4107-94a5-beac6415694c => generated 1717 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:18.460706 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b0ef4019-7e6f-437e-ab92-bb57b49810b5 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-463971218", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "2e16c5b3-ff3c-4afe-ae65-97b9be1b14b0"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:44:19.424760 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-72c3f050-778b-4b2e-808d-6a3e7d04e03a tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:19.426106 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-72c3f050-778b-4b2e-808d-6a3e7d04e03a tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 3095a9f9-6769-4107-94a5-beac6415694c] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:19.445771 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-72c3f050-778b-4b2e-808d-6a3e7d04e03a tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:19.450685 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-72c3f050-778b-4b2e-808d-6a3e7d04e03a tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:19.454392 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-72c3f050-778b-4b2e-808d-6a3e7d04e03a tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:19.455298 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-72c3f050-778b-4b2e-808d-6a3e7d04e03a tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:19.464785 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-72c3f050-778b-4b2e-808d-6a3e7d04e03a tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:19.465571 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-72c3f050-778b-4b2e-808d-6a3e7d04e03a tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:20.336519 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-72c3f050-778b-4b2e-808d-6a3e7d04e03a tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:20.349172 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-72c3f050-778b-4b2e-808d-6a3e7d04e03a tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/3095a9f9-6769-4107-94a5-beac6415694c" status: 200 len: 1717 microversion: 2.1 time: 0.929938 Aug 27 02:44:20.358180 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 549/1104] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:19 2022] GET /compute/v2.1/servers/3095a9f9-6769-4107-94a5-beac6415694c => generated 1717 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:44:21.378493 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-7d9c4ec8-bdc7-4ff6-aa42-960a8d22eae0 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:21.379893 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-7d9c4ec8-bdc7-4ff6-aa42-960a8d22eae0 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 3095a9f9-6769-4107-94a5-beac6415694c] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:21.409336 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7d9c4ec8-bdc7-4ff6-aa42-960a8d22eae0 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:21.417628 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7d9c4ec8-bdc7-4ff6-aa42-960a8d22eae0 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:21.419042 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7d9c4ec8-bdc7-4ff6-aa42-960a8d22eae0 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:21.422646 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7d9c4ec8-bdc7-4ff6-aa42-960a8d22eae0 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:21.426101 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7d9c4ec8-bdc7-4ff6-aa42-960a8d22eae0 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:21.429211 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7d9c4ec8-bdc7-4ff6-aa42-960a8d22eae0 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:22.279553 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-7d9c4ec8-bdc7-4ff6-aa42-960a8d22eae0 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:22.294038 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-7d9c4ec8-bdc7-4ff6-aa42-960a8d22eae0 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/3095a9f9-6769-4107-94a5-beac6415694c" status: 200 len: 1717 microversion: 2.1 time: 0.919817 Aug 27 02:44:22.297082 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 550/1105] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:21 2022] GET /compute/v2.1/servers/3095a9f9-6769-4107-94a5-beac6415694c => generated 1717 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:44:23.319014 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c1c17e1f-bde0-42d1-8b6e-65f4df2bbe80 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:23.319798 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-c1c17e1f-bde0-42d1-8b6e-65f4df2bbe80 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 3095a9f9-6769-4107-94a5-beac6415694c] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:23.332834 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c1c17e1f-bde0-42d1-8b6e-65f4df2bbe80 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:23.335510 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c1c17e1f-bde0-42d1-8b6e-65f4df2bbe80 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:23.336264 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c1c17e1f-bde0-42d1-8b6e-65f4df2bbe80 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:23.349312 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c1c17e1f-bde0-42d1-8b6e-65f4df2bbe80 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:23.350227 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c1c17e1f-bde0-42d1-8b6e-65f4df2bbe80 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:23.351096 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c1c17e1f-bde0-42d1-8b6e-65f4df2bbe80 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:23.890465 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-c1c17e1f-bde0-42d1-8b6e-65f4df2bbe80 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:23.903912 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c1c17e1f-bde0-42d1-8b6e-65f4df2bbe80 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/3095a9f9-6769-4107-94a5-beac6415694c" status: 200 len: 1717 microversion: 2.1 time: 0.589447 Aug 27 02:44:23.907864 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 551/1106] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:23 2022] GET /compute/v2.1/servers/3095a9f9-6769-4107-94a5-beac6415694c => generated 1717 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:44:23.932857 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d32d62c2-7016-4a1a-8c5f-19c3fe67e871 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:23.938405 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d32d62c2-7016-4a1a-8c5f-19c3fe67e871 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] [instance: c03f5d7e-1851-47a0-9ec2-4b8b56e07c54] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:23.949184 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d32d62c2-7016-4a1a-8c5f-19c3fe67e871 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:23.949675 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d32d62c2-7016-4a1a-8c5f-19c3fe67e871 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:23.951294 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d32d62c2-7016-4a1a-8c5f-19c3fe67e871 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:23.965218 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d32d62c2-7016-4a1a-8c5f-19c3fe67e871 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:23.966151 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d32d62c2-7016-4a1a-8c5f-19c3fe67e871 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:23.966617 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d32d62c2-7016-4a1a-8c5f-19c3fe67e871 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:24.005442 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-d32d62c2-7016-4a1a-8c5f-19c3fe67e871 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] HTTP exception thrown: Instance c03f5d7e-1851-47a0-9ec2-4b8b56e07c54 could not be found. Aug 27 02:44:24.008911 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d32d62c2-7016-4a1a-8c5f-19c3fe67e871 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Request method failure captured: Aug 27 02:44:24.008911 n-d-852278-4 devstack@n-api.service[134052]: request: DELETE /compute/v2.1/servers/c03f5d7e-1851-47a0-9ec2-4b8b56e07c54 HTTP/1.1 Aug 27 02:44:24.008911 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:44:24.008911 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:44:24.008911 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:44:24.008911 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:44:24.008911 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:44:24.008911 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:44:24.008911 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:44:24.008911 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:44:24.008911 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYSPKBSAK1RBsjO1oN1WggQRmMhpUngggs4TV2dXU8cbBDlW4DmT9rfqH5xamQYSsmI1WCKnfNA2wlGzcSHbeGNdrtQOH_6bp51ZZcFRJSifhxvJ93QGKsImv__aWsju5fdnOri3cIl7bCJ1EfIj-gEp6hjWPkd3cLreqiL4ImjG6yo Aug 27 02:44:24.008911 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:44:24.008911 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:44:24.008911 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:44:24.008911 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:44:24.008911 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:44:24.008911 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:44:24.008911 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: de3ac0c66c5b4bc787d2d6e12a957099 Aug 27 02:44:24.008911 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ServersTestMultiNic-264021201 Aug 27 02:44:24.008911 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:44:24.008911 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:44:24.010667 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/de3ac0c66c5b4bc787d2d6e12a957099"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_de3ac0c66c5b4bc787d2d6e12a957099", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/de3ac0c66c5b4bc787d2d6e12a957099"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/de3ac0c66c5b4bc787d2d6e12a957099"}]}] Aug 27 02:44:24.010667 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ServersTestMultiNic-264021201 Aug 27 02:44:24.010667 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: de3ac0c66c5b4bc787d2d6e12a957099 Aug 27 02:44:24.010667 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ServersTestMultiNic-264021201 Aug 27 02:44:24.010667 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ServersTestMultiNic-264021201-project Aug 27 02:44:24.010667 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:44:24.010667 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:44:24.010667 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 9653dac89d2648b285fd71c1b349e642 Aug 27 02:44:24.010667 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ServersTestMultiNic-264021201-project Aug 27 02:44:24.010667 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 02:44:24.010667 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance c03f5d7e-1851-47a0-9ec2-4b8b56e07c54 could not be found. Aug 27 02:44:24.010667 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': 'c03f5d7e-1851-47a0-9ec2-4b8b56e07c54'} Aug 27 02:44:24.011603 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:44:24.011603 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:44:24.011603 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:44:24.011603 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:44:24.011603 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:44:24.011603 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:44:24.011603 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:44:24.011603 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:44:24.011603 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:44:24.011603 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:44:24.011603 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c03f5d7e-1851-47a0-9ec2-4b8b56e07c54 could not be found. Aug 27 02:44:24.011603 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:44:24.011603 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:44:24.011603 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:44:24.011603 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:44:24.011603 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:44:24.011603 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:44:24.011603 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:44:24.011603 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:44:24.011603 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:44:24.013193 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:44:24.013193 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 02:44:24.013193 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 02:44:24.013193 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 02:44:24.013193 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 02:44:24.013193 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:44:24.013193 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:44:24.013193 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:44:24.013193 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:44:24.013193 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c03f5d7e-1851-47a0-9ec2-4b8b56e07c54 could not be found. Aug 27 02:44:24.013193 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:44:24.013193 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:44:24.013193 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:44:24.013193 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:44:24.013193 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:44:24.013193 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:44:24.013193 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:44:24.013193 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:44:24.013193 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c03f5d7e-1851-47a0-9ec2-4b8b56e07c54 could not be found. Aug 27 02:44:24.013193 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:44:24.014620 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d32d62c2-7016-4a1a-8c5f-19c3fe67e871 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Returning 404 to user: Instance c03f5d7e-1851-47a0-9ec2-4b8b56e07c54 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:44:24.014620 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d32d62c2-7016-4a1a-8c5f-19c3fe67e871 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] 10.222.0.70 "DELETE /compute/v2.1/servers/c03f5d7e-1851-47a0-9ec2-4b8b56e07c54" status: 404 len: 111 microversion: 2.1 time: 0.100537 Aug 27 02:44:24.014620 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 552/1107] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:44:23 2022] DELETE /compute/v2.1/servers/c03f5d7e-1851-47a0-9ec2-4b8b56e07c54 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:44:24.024642 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-572e4927-7b22-4e13-bc25-6efd12c0e927 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:24.026878 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-572e4927-7b22-4e13-bc25-6efd12c0e927 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] [instance: c03f5d7e-1851-47a0-9ec2-4b8b56e07c54] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:24.048111 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-572e4927-7b22-4e13-bc25-6efd12c0e927 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:24.049207 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-572e4927-7b22-4e13-bc25-6efd12c0e927 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:24.050004 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-572e4927-7b22-4e13-bc25-6efd12c0e927 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:24.054447 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-572e4927-7b22-4e13-bc25-6efd12c0e927 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:24.055699 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-572e4927-7b22-4e13-bc25-6efd12c0e927 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:24.057219 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-572e4927-7b22-4e13-bc25-6efd12c0e927 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:24.097884 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-572e4927-7b22-4e13-bc25-6efd12c0e927 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] HTTP exception thrown: Instance c03f5d7e-1851-47a0-9ec2-4b8b56e07c54 could not be found. Aug 27 02:44:24.099905 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-572e4927-7b22-4e13-bc25-6efd12c0e927 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Request method failure captured: Aug 27 02:44:24.099905 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/servers/c03f5d7e-1851-47a0-9ec2-4b8b56e07c54 HTTP/1.1 Aug 27 02:44:24.099905 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:44:24.099905 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:44:24.099905 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:44:24.099905 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:44:24.099905 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:44:24.099905 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:44:24.099905 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:44:24.099905 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:44:24.099905 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYSPKBSAK1RBsjO1oN1WggQRmMhpUngggs4TV2dXU8cbBDlW4DmT9rfqH5xamQYSsmI1WCKnfNA2wlGzcSHbeGNdrtQOH_6bp51ZZcFRJSifhxvJ93QGKsImv__aWsju5fdnOri3cIl7bCJ1EfIj-gEp6hjWPkd3cLreqiL4ImjG6yo Aug 27 02:44:24.099905 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:44:24.099905 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:44:24.099905 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:44:24.099905 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:44:24.099905 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:44:24.099905 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:44:24.099905 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: de3ac0c66c5b4bc787d2d6e12a957099 Aug 27 02:44:24.099905 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ServersTestMultiNic-264021201 Aug 27 02:44:24.099905 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:44:24.099905 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:44:24.101621 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/de3ac0c66c5b4bc787d2d6e12a957099"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_de3ac0c66c5b4bc787d2d6e12a957099", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/de3ac0c66c5b4bc787d2d6e12a957099"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/de3ac0c66c5b4bc787d2d6e12a957099"}]}] Aug 27 02:44:24.101621 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ServersTestMultiNic-264021201 Aug 27 02:44:24.101621 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: de3ac0c66c5b4bc787d2d6e12a957099 Aug 27 02:44:24.101621 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ServersTestMultiNic-264021201 Aug 27 02:44:24.101621 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ServersTestMultiNic-264021201-project Aug 27 02:44:24.101621 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:44:24.101621 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:44:24.101621 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 9653dac89d2648b285fd71c1b349e642 Aug 27 02:44:24.101621 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ServersTestMultiNic-264021201-project Aug 27 02:44:24.101621 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 02:44:24.101621 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance c03f5d7e-1851-47a0-9ec2-4b8b56e07c54 could not be found. Aug 27 02:44:24.101621 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': 'c03f5d7e-1851-47a0-9ec2-4b8b56e07c54'} Aug 27 02:44:24.102518 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:44:24.102518 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:44:24.102518 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:44:24.102518 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:44:24.102518 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:44:24.102518 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:44:24.102518 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:44:24.102518 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:44:24.102518 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:44:24.102518 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:44:24.102518 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c03f5d7e-1851-47a0-9ec2-4b8b56e07c54 could not be found. Aug 27 02:44:24.102518 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:44:24.102518 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:44:24.102518 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:44:24.102518 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:44:24.102518 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:44:24.102518 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:44:24.102518 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:44:24.102518 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:44:24.102518 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:44:24.103998 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:44:24.103998 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:44:24.103998 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:44:24.103998 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:44:24.103998 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:44:24.103998 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:44:24.103998 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:44:24.103998 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c03f5d7e-1851-47a0-9ec2-4b8b56e07c54 could not be found. Aug 27 02:44:24.103998 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:44:24.103998 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:44:24.103998 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:44:24.103998 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:44:24.103998 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:44:24.103998 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:44:24.103998 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:44:24.103998 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:44:24.103998 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c03f5d7e-1851-47a0-9ec2-4b8b56e07c54 could not be found. Aug 27 02:44:24.103998 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:44:24.112644 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-572e4927-7b22-4e13-bc25-6efd12c0e927 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Returning 404 to user: Instance c03f5d7e-1851-47a0-9ec2-4b8b56e07c54 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:44:24.114142 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-572e4927-7b22-4e13-bc25-6efd12c0e927 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] 10.222.0.70 "GET /compute/v2.1/servers/c03f5d7e-1851-47a0-9ec2-4b8b56e07c54" status: 404 len: 111 microversion: 2.1 time: 0.094856 Aug 27 02:44:24.120805 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 553/1108] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:24 2022] GET /compute/v2.1/servers/c03f5d7e-1851-47a0-9ec2-4b8b56e07c54 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:44:24.133121 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-fad91fa3-d9a5-4b74-89f6-17359ab8cb66 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:24.135507 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-fad91fa3-d9a5-4b74-89f6-17359ab8cb66 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] [instance: 74d41279-27ab-492f-88ac-85f22b11b9ae] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:24.158163 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fad91fa3-d9a5-4b74-89f6-17359ab8cb66 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:24.159934 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fad91fa3-d9a5-4b74-89f6-17359ab8cb66 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:24.161222 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fad91fa3-d9a5-4b74-89f6-17359ab8cb66 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:24.163909 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fad91fa3-d9a5-4b74-89f6-17359ab8cb66 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:24.164646 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fad91fa3-d9a5-4b74-89f6-17359ab8cb66 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:24.165920 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fad91fa3-d9a5-4b74-89f6-17359ab8cb66 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:24.205526 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-fad91fa3-d9a5-4b74-89f6-17359ab8cb66 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] HTTP exception thrown: Instance 74d41279-27ab-492f-88ac-85f22b11b9ae could not be found. Aug 27 02:44:24.211023 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-fad91fa3-d9a5-4b74-89f6-17359ab8cb66 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Request method failure captured: Aug 27 02:44:24.211023 n-d-852278-4 devstack@n-api.service[134052]: request: DELETE /compute/v2.1/servers/74d41279-27ab-492f-88ac-85f22b11b9ae HTTP/1.1 Aug 27 02:44:24.211023 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:44:24.211023 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:44:24.211023 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:44:24.211023 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:44:24.211023 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:44:24.211023 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:44:24.211023 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:44:24.211023 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:44:24.211023 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYSPKBSAK1RBsjO1oN1WggQRmMhpUngggs4TV2dXU8cbBDlW4DmT9rfqH5xamQYSsmI1WCKnfNA2wlGzcSHbeGNdrtQOH_6bp51ZZcFRJSifhxvJ93QGKsImv__aWsju5fdnOri3cIl7bCJ1EfIj-gEp6hjWPkd3cLreqiL4ImjG6yo Aug 27 02:44:24.211023 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:44:24.211023 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:44:24.211023 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:44:24.211023 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:44:24.211023 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:44:24.211023 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:44:24.211023 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: de3ac0c66c5b4bc787d2d6e12a957099 Aug 27 02:44:24.211023 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ServersTestMultiNic-264021201 Aug 27 02:44:24.211023 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:44:24.211023 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:44:24.212816 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/de3ac0c66c5b4bc787d2d6e12a957099"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_de3ac0c66c5b4bc787d2d6e12a957099", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/de3ac0c66c5b4bc787d2d6e12a957099"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/de3ac0c66c5b4bc787d2d6e12a957099"}]}] Aug 27 02:44:24.212816 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ServersTestMultiNic-264021201 Aug 27 02:44:24.212816 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: de3ac0c66c5b4bc787d2d6e12a957099 Aug 27 02:44:24.212816 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ServersTestMultiNic-264021201 Aug 27 02:44:24.212816 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ServersTestMultiNic-264021201-project Aug 27 02:44:24.212816 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:44:24.212816 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:44:24.212816 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 9653dac89d2648b285fd71c1b349e642 Aug 27 02:44:24.212816 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ServersTestMultiNic-264021201-project Aug 27 02:44:24.212816 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 02:44:24.212816 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance 74d41279-27ab-492f-88ac-85f22b11b9ae could not be found. Aug 27 02:44:24.212816 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '74d41279-27ab-492f-88ac-85f22b11b9ae'} Aug 27 02:44:24.213715 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:44:24.213715 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:44:24.213715 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:44:24.213715 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:44:24.213715 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:44:24.213715 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:44:24.213715 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:44:24.213715 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:44:24.213715 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:44:24.213715 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:44:24.213715 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74d41279-27ab-492f-88ac-85f22b11b9ae could not be found. Aug 27 02:44:24.213715 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:44:24.213715 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:44:24.213715 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:44:24.213715 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:44:24.213715 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:44:24.213715 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:44:24.213715 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:44:24.213715 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:44:24.213715 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:44:24.215172 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:44:24.215172 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 02:44:24.215172 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 02:44:24.215172 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 02:44:24.215172 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 02:44:24.215172 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:44:24.215172 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:44:24.215172 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:44:24.215172 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:44:24.215172 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74d41279-27ab-492f-88ac-85f22b11b9ae could not be found. Aug 27 02:44:24.215172 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:44:24.215172 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:44:24.215172 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:44:24.215172 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:44:24.215172 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:44:24.215172 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:44:24.215172 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:44:24.215172 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:44:24.215172 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74d41279-27ab-492f-88ac-85f22b11b9ae could not be found. Aug 27 02:44:24.215172 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:44:24.218009 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-fad91fa3-d9a5-4b74-89f6-17359ab8cb66 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Returning 404 to user: Instance 74d41279-27ab-492f-88ac-85f22b11b9ae could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:44:24.221923 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-fad91fa3-d9a5-4b74-89f6-17359ab8cb66 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] 10.222.0.70 "DELETE /compute/v2.1/servers/74d41279-27ab-492f-88ac-85f22b11b9ae" status: 404 len: 111 microversion: 2.1 time: 0.098323 Aug 27 02:44:24.226139 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 554/1109] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:44:24 2022] DELETE /compute/v2.1/servers/74d41279-27ab-492f-88ac-85f22b11b9ae => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:44:24.235095 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0bd6b112-a9aa-4642-80a0-3a66a3e0b988 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:24.236766 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:44:24.241713 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-0bd6b112-a9aa-4642-80a0-3a66a3e0b988 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] [instance: 74d41279-27ab-492f-88ac-85f22b11b9ae] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:24.263138 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0bd6b112-a9aa-4642-80a0-3a66a3e0b988 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:24.263922 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0bd6b112-a9aa-4642-80a0-3a66a3e0b988 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:24.264635 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0bd6b112-a9aa-4642-80a0-3a66a3e0b988 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:24.266016 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0bd6b112-a9aa-4642-80a0-3a66a3e0b988 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:24.267911 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0bd6b112-a9aa-4642-80a0-3a66a3e0b988 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:24.268535 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0bd6b112-a9aa-4642-80a0-3a66a3e0b988 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:24.303502 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-0bd6b112-a9aa-4642-80a0-3a66a3e0b988 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] HTTP exception thrown: Instance 74d41279-27ab-492f-88ac-85f22b11b9ae could not be found. Aug 27 02:44:24.308786 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0bd6b112-a9aa-4642-80a0-3a66a3e0b988 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Request method failure captured: Aug 27 02:44:24.308786 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/servers/74d41279-27ab-492f-88ac-85f22b11b9ae HTTP/1.1 Aug 27 02:44:24.308786 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:44:24.308786 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:44:24.308786 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:44:24.308786 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:44:24.308786 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:44:24.308786 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:44:24.308786 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:44:24.308786 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:44:24.308786 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYSPKBSAK1RBsjO1oN1WggQRmMhpUngggs4TV2dXU8cbBDlW4DmT9rfqH5xamQYSsmI1WCKnfNA2wlGzcSHbeGNdrtQOH_6bp51ZZcFRJSifhxvJ93QGKsImv__aWsju5fdnOri3cIl7bCJ1EfIj-gEp6hjWPkd3cLreqiL4ImjG6yo Aug 27 02:44:24.308786 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:44:24.308786 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:44:24.308786 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:44:24.308786 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:44:24.308786 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:44:24.308786 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:44:24.308786 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: de3ac0c66c5b4bc787d2d6e12a957099 Aug 27 02:44:24.308786 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ServersTestMultiNic-264021201 Aug 27 02:44:24.308786 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:44:24.308786 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:44:24.310574 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/de3ac0c66c5b4bc787d2d6e12a957099"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_de3ac0c66c5b4bc787d2d6e12a957099", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/de3ac0c66c5b4bc787d2d6e12a957099"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/de3ac0c66c5b4bc787d2d6e12a957099"}]}] Aug 27 02:44:24.310574 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ServersTestMultiNic-264021201 Aug 27 02:44:24.310574 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: de3ac0c66c5b4bc787d2d6e12a957099 Aug 27 02:44:24.310574 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ServersTestMultiNic-264021201 Aug 27 02:44:24.310574 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ServersTestMultiNic-264021201-project Aug 27 02:44:24.310574 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:44:24.310574 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:44:24.310574 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 9653dac89d2648b285fd71c1b349e642 Aug 27 02:44:24.310574 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ServersTestMultiNic-264021201-project Aug 27 02:44:24.310574 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 02:44:24.310574 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance 74d41279-27ab-492f-88ac-85f22b11b9ae could not be found. Aug 27 02:44:24.310574 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '74d41279-27ab-492f-88ac-85f22b11b9ae'} Aug 27 02:44:24.311549 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:44:24.311549 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:44:24.311549 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:44:24.311549 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:44:24.311549 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:44:24.311549 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:44:24.311549 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:44:24.311549 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:44:24.311549 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:44:24.311549 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:44:24.311549 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74d41279-27ab-492f-88ac-85f22b11b9ae could not be found. Aug 27 02:44:24.311549 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:44:24.311549 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:44:24.311549 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:44:24.311549 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:44:24.311549 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:44:24.311549 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:44:24.311549 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:44:24.311549 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:44:24.311549 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:44:24.313072 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:44:24.313072 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:44:24.313072 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:44:24.313072 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:44:24.313072 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:44:24.313072 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:44:24.313072 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:44:24.313072 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74d41279-27ab-492f-88ac-85f22b11b9ae could not be found. Aug 27 02:44:24.313072 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:44:24.313072 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:44:24.313072 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:44:24.313072 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:44:24.313072 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:44:24.313072 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:44:24.313072 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:44:24.313072 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:44:24.313072 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74d41279-27ab-492f-88ac-85f22b11b9ae could not be found. Aug 27 02:44:24.313072 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:44:24.317540 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0bd6b112-a9aa-4642-80a0-3a66a3e0b988 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] Returning 404 to user: Instance 74d41279-27ab-492f-88ac-85f22b11b9ae could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:44:24.320831 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-0bd6b112-a9aa-4642-80a0-3a66a3e0b988 tempest-ServersTestMultiNic-264021201 tempest-ServersTestMultiNic-264021201-project] 10.222.0.70 "GET /compute/v2.1/servers/74d41279-27ab-492f-88ac-85f22b11b9ae" status: 404 len: 111 microversion: 2.1 time: 0.090156 Aug 27 02:44:24.327884 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 555/1110] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:24 2022] GET /compute/v2.1/servers/74d41279-27ab-492f-88ac-85f22b11b9ae => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 02:44:24.653756 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:44:24.932915 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8d26c0d1-7baf-4b6b-8405-05eeebff5556 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:24.933512 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-8d26c0d1-7baf-4b6b-8405-05eeebff5556 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 3095a9f9-6769-4107-94a5-beac6415694c] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:24.943887 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8d26c0d1-7baf-4b6b-8405-05eeebff5556 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:24.958444 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8d26c0d1-7baf-4b6b-8405-05eeebff5556 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:24.959830 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8d26c0d1-7baf-4b6b-8405-05eeebff5556 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:24.960654 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8d26c0d1-7baf-4b6b-8405-05eeebff5556 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:24.961120 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8d26c0d1-7baf-4b6b-8405-05eeebff5556 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:24.961545 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8d26c0d1-7baf-4b6b-8405-05eeebff5556 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:26.970058 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-8d26c0d1-7baf-4b6b-8405-05eeebff5556 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:27.000758 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-8d26c0d1-7baf-4b6b-8405-05eeebff5556 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/3095a9f9-6769-4107-94a5-beac6415694c" status: 200 len: 1717 microversion: 2.1 time: 2.072805 Aug 27 02:44:27.028356 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 556/1111] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:24 2022] GET /compute/v2.1/servers/3095a9f9-6769-4107-94a5-beac6415694c => generated 1717 bytes in 2089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:27.752948 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-b6c88156-8794-4ec2-895f-167fa62800b8 req-dcd1e792-e548-4596-b2e5-97f2efb7656b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3095a9f9-6769-4107-94a5-beac6415694c", "name": "network-vif-unplugged", "status": "completed", "tag": "ccabb4f8-adfb-4fa5-a578-1d53c8d1dc89"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:44:27.771924 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-b6c88156-8794-4ec2-895f-167fa62800b8 req-dcd1e792-e548-4596-b2e5-97f2efb7656b service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:27.779273 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-b6c88156-8794-4ec2-895f-167fa62800b8 req-dcd1e792-e548-4596-b2e5-97f2efb7656b service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:27.780581 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-b6c88156-8794-4ec2-895f-167fa62800b8 req-dcd1e792-e548-4596-b2e5-97f2efb7656b service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:27.827264 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-b6c88156-8794-4ec2-895f-167fa62800b8 req-dcd1e792-e548-4596-b2e5-97f2efb7656b service nova] Creating event network-vif-unplugged:ccabb4f8-adfb-4fa5-a578-1d53c8d1dc89 for instance 3095a9f9-6769-4107-94a5-beac6415694c on n-h1-852278-4 Aug 27 02:44:27.845195 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-b6c88156-8794-4ec2-895f-167fa62800b8 req-dcd1e792-e548-4596-b2e5-97f2efb7656b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.097995 Aug 27 02:44:27.848390 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 557/1112] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:44:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:44:28.043022 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-642f87a1-19e0-49a8-909b-0a7007e27e65 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:28.043891 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-642f87a1-19e0-49a8-909b-0a7007e27e65 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 3095a9f9-6769-4107-94a5-beac6415694c] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:28.069873 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=6 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:44:28.080453 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-642f87a1-19e0-49a8-909b-0a7007e27e65 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:28.082359 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-642f87a1-19e0-49a8-909b-0a7007e27e65 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:28.084856 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-642f87a1-19e0-49a8-909b-0a7007e27e65 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:28.085857 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-642f87a1-19e0-49a8-909b-0a7007e27e65 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:28.086430 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-642f87a1-19e0-49a8-909b-0a7007e27e65 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:28.087009 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-642f87a1-19e0-49a8-909b-0a7007e27e65 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:28.514888 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=37 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:44:28.957834 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-642f87a1-19e0-49a8-909b-0a7007e27e65 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:28.986118 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-642f87a1-19e0-49a8-909b-0a7007e27e65 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/3095a9f9-6769-4107-94a5-beac6415694c" status: 200 len: 1717 microversion: 2.1 time: 0.948031 Aug 27 02:44:29.006079 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 558/1113] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:28 2022] GET /compute/v2.1/servers/3095a9f9-6769-4107-94a5-beac6415694c => generated 1717 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:29.991245 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-3e48f319-907e-440c-b84c-6fc9cbbd9585 req-f179c215-b126-49b2-a96a-dfe87e209fed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3095a9f9-6769-4107-94a5-beac6415694c", "tag": "ccabb4f8-adfb-4fa5-a578-1d53c8d1dc89"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:44:30.023600 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-3e48f319-907e-440c-b84c-6fc9cbbd9585 req-f179c215-b126-49b2-a96a-dfe87e209fed service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:30.032670 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-3e48f319-907e-440c-b84c-6fc9cbbd9585 req-f179c215-b126-49b2-a96a-dfe87e209fed service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:30.033784 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-3e48f319-907e-440c-b84c-6fc9cbbd9585 req-f179c215-b126-49b2-a96a-dfe87e209fed service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:30.077342 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-3e48f319-907e-440c-b84c-6fc9cbbd9585 req-f179c215-b126-49b2-a96a-dfe87e209fed service nova] Creating event network-changed:ccabb4f8-adfb-4fa5-a578-1d53c8d1dc89 for instance 3095a9f9-6769-4107-94a5-beac6415694c on n-h1-852278-4 Aug 27 02:44:30.101936 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-3e48f319-907e-440c-b84c-6fc9cbbd9585 req-f179c215-b126-49b2-a96a-dfe87e209fed service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115485 Aug 27 02:44:30.108598 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 559/1114] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:44:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:44:30.115474 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8bfb172d-8f4b-4cae-a9d3-09547397cfba tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:30.128921 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-8bfb172d-8f4b-4cae-a9d3-09547397cfba tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 3095a9f9-6769-4107-94a5-beac6415694c] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:30.163850 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8bfb172d-8f4b-4cae-a9d3-09547397cfba tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:30.164487 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8bfb172d-8f4b-4cae-a9d3-09547397cfba tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:30.168392 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8bfb172d-8f4b-4cae-a9d3-09547397cfba tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:30.171645 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8bfb172d-8f4b-4cae-a9d3-09547397cfba tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:30.172125 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8bfb172d-8f4b-4cae-a9d3-09547397cfba tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:30.172586 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8bfb172d-8f4b-4cae-a9d3-09547397cfba tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:31.273332 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-8bfb172d-8f4b-4cae-a9d3-09547397cfba tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:31.294222 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-8bfb172d-8f4b-4cae-a9d3-09547397cfba tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/3095a9f9-6769-4107-94a5-beac6415694c" status: 200 len: 1717 microversion: 2.1 time: 1.183879 Aug 27 02:44:31.297525 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 560/1115] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:30 2022] GET /compute/v2.1/servers/3095a9f9-6769-4107-94a5-beac6415694c => generated 1717 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:32.321468 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-220ad35a-3696-4375-be66-91b26878ce50 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:32.323112 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-220ad35a-3696-4375-be66-91b26878ce50 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 3095a9f9-6769-4107-94a5-beac6415694c] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:32.334139 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-220ad35a-3696-4375-be66-91b26878ce50 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:32.337398 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-220ad35a-3696-4375-be66-91b26878ce50 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:32.339542 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-220ad35a-3696-4375-be66-91b26878ce50 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:32.340992 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-220ad35a-3696-4375-be66-91b26878ce50 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:32.341604 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-220ad35a-3696-4375-be66-91b26878ce50 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:32.342220 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-220ad35a-3696-4375-be66-91b26878ce50 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:32.952850 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-220ad35a-3696-4375-be66-91b26878ce50 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:32.967677 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-220ad35a-3696-4375-be66-91b26878ce50 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/3095a9f9-6769-4107-94a5-beac6415694c" status: 200 len: 1717 microversion: 2.1 time: 0.652561 Aug 27 02:44:32.989407 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 561/1116] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:32 2022] GET /compute/v2.1/servers/3095a9f9-6769-4107-94a5-beac6415694c => generated 1717 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:33.995451 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b5abe16f-0643-4ecf-99f8-3712530ffb9f tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:33.997637 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b5abe16f-0643-4ecf-99f8-3712530ffb9f tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 3095a9f9-6769-4107-94a5-beac6415694c] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:34.038937 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b5abe16f-0643-4ecf-99f8-3712530ffb9f tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:34.046804 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b5abe16f-0643-4ecf-99f8-3712530ffb9f tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:34.050018 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b5abe16f-0643-4ecf-99f8-3712530ffb9f tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:34.058361 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b5abe16f-0643-4ecf-99f8-3712530ffb9f tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:34.059303 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b5abe16f-0643-4ecf-99f8-3712530ffb9f tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:34.062635 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b5abe16f-0643-4ecf-99f8-3712530ffb9f tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:34.668948 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b5abe16f-0643-4ecf-99f8-3712530ffb9f tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:34.688799 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b5abe16f-0643-4ecf-99f8-3712530ffb9f tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/3095a9f9-6769-4107-94a5-beac6415694c" status: 200 len: 1717 microversion: 2.1 time: 0.698092 Aug 27 02:44:34.695956 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 562/1117] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:33 2022] GET /compute/v2.1/servers/3095a9f9-6769-4107-94a5-beac6415694c => generated 1717 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:34.870542 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.network.neutron [None req-b0ef4019-7e6f-437e-ab92-bb57b49810b5 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] validate_networks() for None {{(pid=134051) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:44:35.710362 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-1bbf413b-70b9-4d0c-8e40-cdb332cb1dca tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:35.710973 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-1bbf413b-70b9-4d0c-8e40-cdb332cb1dca tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 3095a9f9-6769-4107-94a5-beac6415694c] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:35.723985 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1bbf413b-70b9-4d0c-8e40-cdb332cb1dca tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:35.746253 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1bbf413b-70b9-4d0c-8e40-cdb332cb1dca tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:35.747386 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1bbf413b-70b9-4d0c-8e40-cdb332cb1dca tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:35.748194 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1bbf413b-70b9-4d0c-8e40-cdb332cb1dca tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:35.748971 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1bbf413b-70b9-4d0c-8e40-cdb332cb1dca tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:35.749662 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1bbf413b-70b9-4d0c-8e40-cdb332cb1dca tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:36.246930 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-b0ef4019-7e6f-437e-ab92-bb57b49810b5 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Flavor limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:44:36.247422 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-b0ef4019-7e6f-437e-ab92-bb57b49810b5 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Image limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:44:36.251042 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-b0ef4019-7e6f-437e-ab92-bb57b49810b5 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Flavor pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:44:36.253576 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-b0ef4019-7e6f-437e-ab92-bb57b49810b5 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Image pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:44:36.254026 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-b0ef4019-7e6f-437e-ab92-bb57b49810b5 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:44:36.294063 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b0ef4019-7e6f-437e-ab92-bb57b49810b5 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:36.294532 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b0ef4019-7e6f-437e-ab92-bb57b49810b5 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:36.294973 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b0ef4019-7e6f-437e-ab92-bb57b49810b5 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:36.295800 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b0ef4019-7e6f-437e-ab92-bb57b49810b5 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:36.300463 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b0ef4019-7e6f-437e-ab92-bb57b49810b5 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:36.300913 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b0ef4019-7e6f-437e-ab92-bb57b49810b5 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:36.429640 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-b0ef4019-7e6f-437e-ab92-bb57b49810b5 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Getting quotas for project b105816fd4e54b9da4973ff721e1fb92. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:44:36.477039 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-b0ef4019-7e6f-437e-ab92-bb57b49810b5 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Getting quotas for user eb6d1646ec094e3297f6f3c51dd72e85 and project b105816fd4e54b9da4973ff721e1fb92. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:44:36.563384 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-1bbf413b-70b9-4d0c-8e40-cdb332cb1dca tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:36.588458 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-1bbf413b-70b9-4d0c-8e40-cdb332cb1dca tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/3095a9f9-6769-4107-94a5-beac6415694c" status: 200 len: 1717 microversion: 2.1 time: 0.881975 Aug 27 02:44:36.608341 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b0ef4019-7e6f-437e-ab92-bb57b49810b5 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Going to run 1 instances... {{(pid=134051) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:44:36.608700 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 563/1118] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:35 2022] GET /compute/v2.1/servers/3095a9f9-6769-4107-94a5-beac6415694c => generated 1717 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:36.622322 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b0ef4019-7e6f-437e-ab92-bb57b49810b5 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: c7391538-81d0-4eb1-bff9-e151e2ee4c3a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134051) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:44:36.844588 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b0ef4019-7e6f-437e-ab92-bb57b49810b5 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 18.378972 Aug 27 02:44:36.848710 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 556/1119] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 02:44:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 18391 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:44:36.852789 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f9259978-6c56-4e36-b6b6-4e54a66d3087 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:36.853414 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-f9259978-6c56-4e36-b6b6-4e54a66d3087 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: c7391538-81d0-4eb1-bff9-e151e2ee4c3a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:37.039823 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-f9259978-6c56-4e36-b6b6-4e54a66d3087 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6d1646ec094e3297f6f3c51dd72e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b105816fd4e54b9da4973ff721e1fb92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:37.052421 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f9259978-6c56-4e36-b6b6-4e54a66d3087 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "GET /compute/v2.1/servers/c7391538-81d0-4eb1-bff9-e151e2ee4c3a" status: 200 len: 1216 microversion: 2.1 time: 0.203869 Aug 27 02:44:37.079545 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 564/1120] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:36 2022] GET /compute/v2.1/servers/c7391538-81d0-4eb1-bff9-e151e2ee4c3a => generated 1216 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:37.624448 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-26f38e5c-3f19-4d3f-8982-08531bfeebd2 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:37.625151 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-26f38e5c-3f19-4d3f-8982-08531bfeebd2 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 3095a9f9-6769-4107-94a5-beac6415694c] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:37.646555 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-26f38e5c-3f19-4d3f-8982-08531bfeebd2 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:37.649847 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-26f38e5c-3f19-4d3f-8982-08531bfeebd2 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:37.651966 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-26f38e5c-3f19-4d3f-8982-08531bfeebd2 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:37.653773 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-26f38e5c-3f19-4d3f-8982-08531bfeebd2 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:37.655196 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-26f38e5c-3f19-4d3f-8982-08531bfeebd2 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:37.656678 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-26f38e5c-3f19-4d3f-8982-08531bfeebd2 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:38.083710 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9180a6c2-42ac-4e4a-a569-a3bc375c51bb tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:38.084350 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-9180a6c2-42ac-4e4a-a569-a3bc375c51bb tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: c7391538-81d0-4eb1-bff9-e151e2ee4c3a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:38.148416 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-26f38e5c-3f19-4d3f-8982-08531bfeebd2 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:38.169752 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-26f38e5c-3f19-4d3f-8982-08531bfeebd2 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/3095a9f9-6769-4107-94a5-beac6415694c" status: 200 len: 1717 microversion: 2.1 time: 0.549290 Aug 27 02:44:38.170800 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 557/1121] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:37 2022] GET /compute/v2.1/servers/3095a9f9-6769-4107-94a5-beac6415694c => generated 1717 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:38.249077 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-9180a6c2-42ac-4e4a-a569-a3bc375c51bb tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6d1646ec094e3297f6f3c51dd72e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b105816fd4e54b9da4973ff721e1fb92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:38.257775 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9180a6c2-42ac-4e4a-a569-a3bc375c51bb tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "GET /compute/v2.1/servers/c7391538-81d0-4eb1-bff9-e151e2ee4c3a" status: 200 len: 1216 microversion: 2.1 time: 0.178348 Aug 27 02:44:38.276078 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 565/1122] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:38 2022] GET /compute/v2.1/servers/c7391538-81d0-4eb1-bff9-e151e2ee4c3a => generated 1216 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:39.191499 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ec9ea0cb-be18-4ea5-97cf-f877c642ebc2 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:39.192154 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-ec9ea0cb-be18-4ea5-97cf-f877c642ebc2 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 3095a9f9-6769-4107-94a5-beac6415694c] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:39.212609 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ec9ea0cb-be18-4ea5-97cf-f877c642ebc2 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:39.213110 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ec9ea0cb-be18-4ea5-97cf-f877c642ebc2 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:39.213547 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ec9ea0cb-be18-4ea5-97cf-f877c642ebc2 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:39.216823 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ec9ea0cb-be18-4ea5-97cf-f877c642ebc2 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:39.217384 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ec9ea0cb-be18-4ea5-97cf-f877c642ebc2 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:39.217815 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ec9ea0cb-be18-4ea5-97cf-f877c642ebc2 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:39.278321 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-2132f253-f338-4339-bc2f-ffa72ce4a470 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:39.279525 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-2132f253-f338-4339-bc2f-ffa72ce4a470 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: c7391538-81d0-4eb1-bff9-e151e2ee4c3a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:39.291096 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2132f253-f338-4339-bc2f-ffa72ce4a470 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:39.292876 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2132f253-f338-4339-bc2f-ffa72ce4a470 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:39.293509 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2132f253-f338-4339-bc2f-ffa72ce4a470 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:39.297141 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2132f253-f338-4339-bc2f-ffa72ce4a470 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:39.297808 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2132f253-f338-4339-bc2f-ffa72ce4a470 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:39.298533 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2132f253-f338-4339-bc2f-ffa72ce4a470 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:39.921008 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-2132f253-f338-4339-bc2f-ffa72ce4a470 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6d1646ec094e3297f6f3c51dd72e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b105816fd4e54b9da4973ff721e1fb92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:39.925366 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=79 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:44:39.930813 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-2132f253-f338-4339-bc2f-ffa72ce4a470 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "GET /compute/v2.1/servers/c7391538-81d0-4eb1-bff9-e151e2ee4c3a" status: 200 len: 1268 microversion: 2.1 time: 0.656470 Aug 27 02:44:39.938025 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 566/1123] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:39 2022] GET /compute/v2.1/servers/c7391538-81d0-4eb1-bff9-e151e2ee4c3a => generated 1268 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:44:40.960923 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-034cb09f-0076-4e86-b126-22a701082fbd tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:40.962489 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-034cb09f-0076-4e86-b126-22a701082fbd tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: c7391538-81d0-4eb1-bff9-e151e2ee4c3a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:40.983708 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=45 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:44:40.989647 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-034cb09f-0076-4e86-b126-22a701082fbd tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:40.995648 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-034cb09f-0076-4e86-b126-22a701082fbd tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:41.001574 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-034cb09f-0076-4e86-b126-22a701082fbd tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:41.003494 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-034cb09f-0076-4e86-b126-22a701082fbd tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:41.007679 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-034cb09f-0076-4e86-b126-22a701082fbd tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:41.010278 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-034cb09f-0076-4e86-b126-22a701082fbd tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:41.929067 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-034cb09f-0076-4e86-b126-22a701082fbd tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6d1646ec094e3297f6f3c51dd72e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b105816fd4e54b9da4973ff721e1fb92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:41.945820 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-034cb09f-0076-4e86-b126-22a701082fbd tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "GET /compute/v2.1/servers/c7391538-81d0-4eb1-bff9-e151e2ee4c3a" status: 200 len: 1274 microversion: 2.1 time: 0.991298 Aug 27 02:44:41.948674 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 567/1124] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:40 2022] GET /compute/v2.1/servers/c7391538-81d0-4eb1-bff9-e151e2ee4c3a => generated 1274 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:42.081433 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-ec9ea0cb-be18-4ea5-97cf-f877c642ebc2 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:42.103644 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ec9ea0cb-be18-4ea5-97cf-f877c642ebc2 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/3095a9f9-6769-4107-94a5-beac6415694c" status: 200 len: 1717 microversion: 2.1 time: 2.913321 Aug 27 02:44:42.121445 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 558/1125] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:39 2022] GET /compute/v2.1/servers/3095a9f9-6769-4107-94a5-beac6415694c => generated 1717 bytes in 2935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:42.540168 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6aa93367-a9cb-44f1-a673-d9ade8c53245 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Action: 'create', calling method: .version_select at 0x7f5ee2e30af0>, body: {"keypair": {"name": "tempest-keypair-1418880326", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJzOoVZPKtQL8Al5gB4Z+uRzKruYkNXloHK6TPsPSA7vei71Z7wHKXENRcV4+OP/AakNfjAxUuWNnLzHUGgOgHqSU3VkZ4oNKxUSkcTIpLhb/7g2RdHKAZYP6k2qS5Ng5w=="}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:44:42.608546 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-6aa93367-a9cb-44f1-a673-d9ade8c53245 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Getting quotas for project 256b67be18c246b186e09a313db08a7e. Resources: {'key_pairs'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:44:42.627459 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-6aa93367-a9cb-44f1-a673-d9ade8c53245 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Getting quotas for user cfec6c2f34f94d66ab1cc982c5bb5bbd and project 256b67be18c246b186e09a313db08a7e. Resources: {'key_pairs'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:44:42.712516 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-6aa93367-a9cb-44f1-a673-d9ade8c53245 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.760669 Aug 27 02:44:42.717178 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 568/1126] 10.222.0.70 () {60 vars in 1159 bytes} [Sat Aug 27 02:44:41 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:44:42.971521 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0b730641-ff25-446d-8118-3687f9f5eb65 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:42.972155 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-0b730641-ff25-446d-8118-3687f9f5eb65 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: c7391538-81d0-4eb1-bff9-e151e2ee4c3a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:43.001412 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0b730641-ff25-446d-8118-3687f9f5eb65 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:43.001965 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0b730641-ff25-446d-8118-3687f9f5eb65 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:43.002402 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0b730641-ff25-446d-8118-3687f9f5eb65 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:43.003123 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0b730641-ff25-446d-8118-3687f9f5eb65 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:43.003579 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0b730641-ff25-446d-8118-3687f9f5eb65 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:43.004001 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0b730641-ff25-446d-8118-3687f9f5eb65 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:43.127823 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-bbd6b694-1e21-4f89-8a33-6781f5df4477 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:43.128919 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-bbd6b694-1e21-4f89-8a33-6781f5df4477 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 3095a9f9-6769-4107-94a5-beac6415694c] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:43.142234 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bbd6b694-1e21-4f89-8a33-6781f5df4477 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:43.143517 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bbd6b694-1e21-4f89-8a33-6781f5df4477 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:43.144548 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bbd6b694-1e21-4f89-8a33-6781f5df4477 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:43.147315 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bbd6b694-1e21-4f89-8a33-6781f5df4477 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:43.148768 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bbd6b694-1e21-4f89-8a33-6781f5df4477 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:43.152902 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bbd6b694-1e21-4f89-8a33-6781f5df4477 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:43.416477 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-0b730641-ff25-446d-8118-3687f9f5eb65 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6d1646ec094e3297f6f3c51dd72e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b105816fd4e54b9da4973ff721e1fb92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:43.450561 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-0b730641-ff25-446d-8118-3687f9f5eb65 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "GET /compute/v2.1/servers/c7391538-81d0-4eb1-bff9-e151e2ee4c3a" status: 200 len: 1274 microversion: 2.1 time: 0.472393 Aug 27 02:44:43.467208 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 559/1127] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:42 2022] GET /compute/v2.1/servers/c7391538-81d0-4eb1-bff9-e151e2ee4c3a => generated 1274 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:43.871529 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-bbd6b694-1e21-4f89-8a33-6781f5df4477 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:43.884064 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-bbd6b694-1e21-4f89-8a33-6781f5df4477 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/3095a9f9-6769-4107-94a5-beac6415694c" status: 200 len: 1717 microversion: 2.1 time: 0.761602 Aug 27 02:44:43.891750 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 569/1128] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:43 2022] GET /compute/v2.1/servers/3095a9f9-6769-4107-94a5-beac6415694c => generated 1717 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:44.471460 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0de5f29d-3fcb-4023-b154-4f5cfbd5a4a3 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:44.473136 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-0de5f29d-3fcb-4023-b154-4f5cfbd5a4a3 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: c7391538-81d0-4eb1-bff9-e151e2ee4c3a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:44.489082 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0de5f29d-3fcb-4023-b154-4f5cfbd5a4a3 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:44.496482 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0de5f29d-3fcb-4023-b154-4f5cfbd5a4a3 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:44.497917 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0de5f29d-3fcb-4023-b154-4f5cfbd5a4a3 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:44.498951 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0de5f29d-3fcb-4023-b154-4f5cfbd5a4a3 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:44.502063 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0de5f29d-3fcb-4023-b154-4f5cfbd5a4a3 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:44.503678 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0de5f29d-3fcb-4023-b154-4f5cfbd5a4a3 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:44.809504 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-0de5f29d-3fcb-4023-b154-4f5cfbd5a4a3 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6d1646ec094e3297f6f3c51dd72e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b105816fd4e54b9da4973ff721e1fb92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:44.824909 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-0de5f29d-3fcb-4023-b154-4f5cfbd5a4a3 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "GET /compute/v2.1/servers/c7391538-81d0-4eb1-bff9-e151e2ee4c3a" status: 200 len: 1274 microversion: 2.1 time: 0.357292 Aug 27 02:44:44.840353 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 560/1129] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:44 2022] GET /compute/v2.1/servers/c7391538-81d0-4eb1-bff9-e151e2ee4c3a => generated 1274 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:44.911445 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3f34d71f-ab3e-46be-b89c-a4d58c2eae70 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:44.913684 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-3f34d71f-ab3e-46be-b89c-a4d58c2eae70 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 3095a9f9-6769-4107-94a5-beac6415694c] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:44.930301 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3f34d71f-ab3e-46be-b89c-a4d58c2eae70 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:44.933789 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3f34d71f-ab3e-46be-b89c-a4d58c2eae70 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:44.938749 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3f34d71f-ab3e-46be-b89c-a4d58c2eae70 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:44.944387 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3f34d71f-ab3e-46be-b89c-a4d58c2eae70 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:44.946172 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3f34d71f-ab3e-46be-b89c-a4d58c2eae70 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:44.946883 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3f34d71f-ab3e-46be-b89c-a4d58c2eae70 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:45.722155 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-3f34d71f-ab3e-46be-b89c-a4d58c2eae70 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:45.738241 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-3f34d71f-ab3e-46be-b89c-a4d58c2eae70 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/3095a9f9-6769-4107-94a5-beac6415694c" status: 200 len: 1717 microversion: 2.1 time: 0.830570 Aug 27 02:44:45.762185 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 570/1130] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:44 2022] GET /compute/v2.1/servers/3095a9f9-6769-4107-94a5-beac6415694c => generated 1717 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:45.847380 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ecb30deb-1735-4ece-a816-8dba4f3ceabf tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:45.847984 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-ecb30deb-1735-4ece-a816-8dba4f3ceabf tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: c7391538-81d0-4eb1-bff9-e151e2ee4c3a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:45.866883 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ecb30deb-1735-4ece-a816-8dba4f3ceabf tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:45.871281 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ecb30deb-1735-4ece-a816-8dba4f3ceabf tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:45.878861 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ecb30deb-1735-4ece-a816-8dba4f3ceabf tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:45.879637 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ecb30deb-1735-4ece-a816-8dba4f3ceabf tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:45.880104 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ecb30deb-1735-4ece-a816-8dba4f3ceabf tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:45.890391 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ecb30deb-1735-4ece-a816-8dba4f3ceabf tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:46.341478 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:44:46.535167 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=6 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:44:46.765397 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-552b7528-589b-4259-b917-ca1ae8aa26ab tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:46.766707 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-552b7528-589b-4259-b917-ca1ae8aa26ab tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 3095a9f9-6769-4107-94a5-beac6415694c] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:46.779277 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-552b7528-589b-4259-b917-ca1ae8aa26ab tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:46.786241 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-552b7528-589b-4259-b917-ca1ae8aa26ab tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:46.793129 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-552b7528-589b-4259-b917-ca1ae8aa26ab tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:46.795794 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-552b7528-589b-4259-b917-ca1ae8aa26ab tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:46.797066 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-552b7528-589b-4259-b917-ca1ae8aa26ab tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:46.798498 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-552b7528-589b-4259-b917-ca1ae8aa26ab tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:47.937775 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-552b7528-589b-4259-b917-ca1ae8aa26ab tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:47.952187 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-552b7528-589b-4259-b917-ca1ae8aa26ab tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/3095a9f9-6769-4107-94a5-beac6415694c" status: 200 len: 1717 microversion: 2.1 time: 1.192662 Aug 27 02:44:47.953459 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 571/1131] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:46 2022] GET /compute/v2.1/servers/3095a9f9-6769-4107-94a5-beac6415694c => generated 1717 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:48.066978 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-ecb30deb-1735-4ece-a816-8dba4f3ceabf tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6d1646ec094e3297f6f3c51dd72e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b105816fd4e54b9da4973ff721e1fb92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:48.091271 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ecb30deb-1735-4ece-a816-8dba4f3ceabf tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "GET /compute/v2.1/servers/c7391538-81d0-4eb1-bff9-e151e2ee4c3a" status: 200 len: 1316 microversion: 2.1 time: 2.248065 Aug 27 02:44:48.092205 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 561/1132] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:45 2022] GET /compute/v2.1/servers/c7391538-81d0-4eb1-bff9-e151e2ee4c3a => generated 1316 bytes in 2250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:48.607931 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-822978d1-8044-4b35-badb-1f0fac3990b5 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Action: 'create', calling method: .version_select at 0x7f5ee309f550>, body: {"keypair": {"name": "tempest-keypair-526447408", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMCx/s9vrrklYcr14C/MhHjQAOsn6LveNYxgNm2QC1fLDOVIqkL6A47T77WzgOEQRBDitr2Gacx9YAZFbFV27iBm0mtMwE1CSFiuGiac5NEwPik+Ts6/q1FVxuM5DT/d3A=="}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:44:48.640303 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-822978d1-8044-4b35-badb-1f0fac3990b5 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Getting quotas for project ebe9e2cfe40746dd8af1792468a57a2c. Resources: {'key_pairs'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:44:48.661603 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-822978d1-8044-4b35-badb-1f0fac3990b5 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Getting quotas for user 32514a813c0a4031a1d1effc807db17d and project ebe9e2cfe40746dd8af1792468a57a2c. Resources: {'key_pairs'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:44:48.723390 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-822978d1-8044-4b35-badb-1f0fac3990b5 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.517338 Aug 27 02:44:48.731325 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 572/1133] 10.222.0.70 () {60 vars in 1159 bytes} [Sat Aug 27 02:44:48 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:44:48.977215 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-54337d40-bc52-493f-b03c-6fd5c561dd45 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:48.977842 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-54337d40-bc52-493f-b03c-6fd5c561dd45 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 3095a9f9-6769-4107-94a5-beac6415694c] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:49.007824 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-9177d8d6-e4f1-40b3-83f0-5c2d887b6f30 req-d4d7f224-7fab-4aad-9cfb-c9048578003f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7391538-81d0-4eb1-bff9-e151e2ee4c3a", "tag": "d64f53fe-e8c7-4c7b-a9e7-a14d8feb01e0"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:44:49.019253 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-54337d40-bc52-493f-b03c-6fd5c561dd45 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:49.019758 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-54337d40-bc52-493f-b03c-6fd5c561dd45 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:49.025802 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-54337d40-bc52-493f-b03c-6fd5c561dd45 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:49.030810 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-54337d40-bc52-493f-b03c-6fd5c561dd45 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:49.031533 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-54337d40-bc52-493f-b03c-6fd5c561dd45 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:49.032432 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-54337d40-bc52-493f-b03c-6fd5c561dd45 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:49.050142 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-9177d8d6-e4f1-40b3-83f0-5c2d887b6f30 req-d4d7f224-7fab-4aad-9cfb-c9048578003f service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:49.052758 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-9177d8d6-e4f1-40b3-83f0-5c2d887b6f30 req-d4d7f224-7fab-4aad-9cfb-c9048578003f service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:49.053415 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-9177d8d6-e4f1-40b3-83f0-5c2d887b6f30 req-d4d7f224-7fab-4aad-9cfb-c9048578003f service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:49.094060 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-9177d8d6-e4f1-40b3-83f0-5c2d887b6f30 req-d4d7f224-7fab-4aad-9cfb-c9048578003f service nova] Creating event network-changed:d64f53fe-e8c7-4c7b-a9e7-a14d8feb01e0 for instance c7391538-81d0-4eb1-bff9-e151e2ee4c3a on n-h1-852278-4 Aug 27 02:44:49.104015 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-9177d8d6-e4f1-40b3-83f0-5c2d887b6f30 req-d4d7f224-7fab-4aad-9cfb-c9048578003f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101462 Aug 27 02:44:49.105251 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 573/1134] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:44:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:44:49.116167 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-82b87f10-58af-4d45-860e-f7240ad153c6 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:49.120665 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-82b87f10-58af-4d45-860e-f7240ad153c6 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: c7391538-81d0-4eb1-bff9-e151e2ee4c3a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:49.153641 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-82b87f10-58af-4d45-860e-f7240ad153c6 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:49.158677 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-82b87f10-58af-4d45-860e-f7240ad153c6 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:49.161580 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-82b87f10-58af-4d45-860e-f7240ad153c6 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:49.163507 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-82b87f10-58af-4d45-860e-f7240ad153c6 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:49.166072 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-82b87f10-58af-4d45-860e-f7240ad153c6 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:49.168573 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-82b87f10-58af-4d45-860e-f7240ad153c6 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:50.908827 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-82b87f10-58af-4d45-860e-f7240ad153c6 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6d1646ec094e3297f6f3c51dd72e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b105816fd4e54b9da4973ff721e1fb92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:50.929648 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-82b87f10-58af-4d45-860e-f7240ad153c6 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "GET /compute/v2.1/servers/c7391538-81d0-4eb1-bff9-e151e2ee4c3a" status: 200 len: 1316 microversion: 2.1 time: 1.818199 Aug 27 02:44:50.930273 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 574/1135] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:49 2022] GET /compute/v2.1/servers/c7391538-81d0-4eb1-bff9-e151e2ee4c3a => generated 1316 bytes in 1821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:44:51.071357 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-54337d40-bc52-493f-b03c-6fd5c561dd45 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:51.080300 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-54337d40-bc52-493f-b03c-6fd5c561dd45 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/3095a9f9-6769-4107-94a5-beac6415694c" status: 200 len: 1717 microversion: 2.1 time: 2.110154 Aug 27 02:44:51.086410 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 562/1136] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:48 2022] GET /compute/v2.1/servers/3095a9f9-6769-4107-94a5-beac6415694c => generated 1717 bytes in 2117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:51.952454 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-15cac39b-fb11-4fa5-84d0-7c60d77b5391 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:51.954845 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-15cac39b-fb11-4fa5-84d0-7c60d77b5391 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: c7391538-81d0-4eb1-bff9-e151e2ee4c3a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:51.962650 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-15cac39b-fb11-4fa5-84d0-7c60d77b5391 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:51.977272 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-15cac39b-fb11-4fa5-84d0-7c60d77b5391 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:51.979599 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-15cac39b-fb11-4fa5-84d0-7c60d77b5391 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:51.979599 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-15cac39b-fb11-4fa5-84d0-7c60d77b5391 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:51.979599 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-15cac39b-fb11-4fa5-84d0-7c60d77b5391 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:51.979599 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-15cac39b-fb11-4fa5-84d0-7c60d77b5391 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:52.107789 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ca80865a-3d30-43c5-abbe-846852ff1aef tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:52.108259 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-ca80865a-3d30-43c5-abbe-846852ff1aef tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 3095a9f9-6769-4107-94a5-beac6415694c] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:52.152267 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ca80865a-3d30-43c5-abbe-846852ff1aef tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:52.155059 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ca80865a-3d30-43c5-abbe-846852ff1aef tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:52.158409 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ca80865a-3d30-43c5-abbe-846852ff1aef tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:52.159188 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ca80865a-3d30-43c5-abbe-846852ff1aef tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:52.159657 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ca80865a-3d30-43c5-abbe-846852ff1aef tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:52.168409 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ca80865a-3d30-43c5-abbe-846852ff1aef tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:52.527440 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-15cac39b-fb11-4fa5-84d0-7c60d77b5391 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6d1646ec094e3297f6f3c51dd72e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b105816fd4e54b9da4973ff721e1fb92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:52.541920 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-15cac39b-fb11-4fa5-84d0-7c60d77b5391 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "GET /compute/v2.1/servers/c7391538-81d0-4eb1-bff9-e151e2ee4c3a" status: 200 len: 1316 microversion: 2.1 time: 0.593947 Aug 27 02:44:52.543097 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 575/1137] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:51 2022] GET /compute/v2.1/servers/c7391538-81d0-4eb1-bff9-e151e2ee4c3a => generated 1316 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:52.591941 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-60e608fd-70cb-4706-a535-549023d59123 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1903456155", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "networks": [{"uuid": "fd17a619-097d-4901-804a-3a9fcc87db54"}], "security_groups": [{"name": "tempest-securitygroup--733130793"}], "key_name": "tempest-keypair-1418880326", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:44:52.594845 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-ca80865a-3d30-43c5-abbe-846852ff1aef tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:52.607627 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ca80865a-3d30-43c5-abbe-846852ff1aef tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/3095a9f9-6769-4107-94a5-beac6415694c" status: 200 len: 1707 microversion: 2.1 time: 0.503882 Aug 27 02:44:52.609090 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 563/1138] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:52 2022] GET /compute/v2.1/servers/3095a9f9-6769-4107-94a5-beac6415694c => generated 1707 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:52.631301 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0844eb66-d8ae-48ce-9bd0-41684a657477 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Calling method '.version_select at 0x7f5edeb509d0>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:52.646733 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0844eb66-d8ae-48ce-9bd0-41684a657477 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:52.650299 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0844eb66-d8ae-48ce-9bd0-41684a657477 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:52.651550 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0844eb66-d8ae-48ce-9bd0-41684a657477 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:52.681031 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-0844eb66-d8ae-48ce-9bd0-41684a657477 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] 10.222.0.70 "GET /compute/v2.1/os-migrations" status: 200 len: 2318 microversion: 2.1 time: 0.054839 Aug 27 02:44:52.683770 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 564/1139] 10.222.0.70 () {58 vars in 1143 bytes} [Sat Aug 27 02:44:52 2022] GET /compute/v2.1/os-migrations => generated 2318 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:44:52.707328 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e00ad28c-4b07-4367-859f-fca8a1bf6d7f tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:52.708938 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-e00ad28c-4b07-4367-859f-fca8a1bf6d7f tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] [instance: 3095a9f9-6769-4107-94a5-beac6415694c] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:52.734977 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e00ad28c-4b07-4367-859f-fca8a1bf6d7f tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:52.735835 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e00ad28c-4b07-4367-859f-fca8a1bf6d7f tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:52.736539 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e00ad28c-4b07-4367-859f-fca8a1bf6d7f tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:52.737468 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e00ad28c-4b07-4367-859f-fca8a1bf6d7f tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:52.743828 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e00ad28c-4b07-4367-859f-fca8a1bf6d7f tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:52.745526 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e00ad28c-4b07-4367-859f-fca8a1bf6d7f tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:52.999314 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.network.neutron [None req-60e608fd-70cb-4706-a535-549023d59123 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] validate_networks() for [('fd17a619-097d-4901-804a-3a9fcc87db54', None, None, None, None, None)] {{(pid=134052) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:44:53.412224 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e00ad28c-4b07-4367-859f-fca8a1bf6d7f tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/3095a9f9-6769-4107-94a5-beac6415694c" status: 200 len: 1858 microversion: 2.1 time: 0.712134 Aug 27 02:44:53.414622 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 565/1140] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:52 2022] GET /compute/v2.1/servers/3095a9f9-6769-4107-94a5-beac6415694c => generated 1858 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:53.441414 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-1f60666f-0808-40a9-ab6d-7ebbd5d6f4ba tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:53.442296 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-1f60666f-0808-40a9-ab6d-7ebbd5d6f4ba tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] [instance: 3095a9f9-6769-4107-94a5-beac6415694c] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:53.453173 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1f60666f-0808-40a9-ab6d-7ebbd5d6f4ba tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:53.453752 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1f60666f-0808-40a9-ab6d-7ebbd5d6f4ba tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:53.456178 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1f60666f-0808-40a9-ab6d-7ebbd5d6f4ba tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:53.457039 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1f60666f-0808-40a9-ab6d-7ebbd5d6f4ba tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:53.457583 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1f60666f-0808-40a9-ab6d-7ebbd5d6f4ba tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:53.459873 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1f60666f-0808-40a9-ab6d-7ebbd5d6f4ba tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:53.885702 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-1f60666f-0808-40a9-ab6d-7ebbd5d6f4ba tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/3095a9f9-6769-4107-94a5-beac6415694c" status: 200 len: 1858 microversion: 2.1 time: 0.449240 Aug 27 02:44:53.890509 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 566/1141] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:53 2022] GET /compute/v2.1/servers/3095a9f9-6769-4107-94a5-beac6415694c => generated 1858 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:44:53.903970 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-9c7a0e8c-45b2-45cd-afc1-66e23a63b433 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:53.904718 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-9c7a0e8c-45b2-45cd-afc1-66e23a63b433 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: c7391538-81d0-4eb1-bff9-e151e2ee4c3a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:53.921122 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9c7a0e8c-45b2-45cd-afc1-66e23a63b433 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:53.921122 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9c7a0e8c-45b2-45cd-afc1-66e23a63b433 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:53.923052 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9c7a0e8c-45b2-45cd-afc1-66e23a63b433 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:53.924077 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9c7a0e8c-45b2-45cd-afc1-66e23a63b433 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:53.924784 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9c7a0e8c-45b2-45cd-afc1-66e23a63b433 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:53.926590 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9c7a0e8c-45b2-45cd-afc1-66e23a63b433 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:54.372877 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-9c7a0e8c-45b2-45cd-afc1-66e23a63b433 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6d1646ec094e3297f6f3c51dd72e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b105816fd4e54b9da4973ff721e1fb92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:54.376397 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-60e608fd-70cb-4706-a535-549023d59123 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Flavor limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:44:54.376954 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-60e608fd-70cb-4706-a535-549023d59123 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Image limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:44:54.377273 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-60e608fd-70cb-4706-a535-549023d59123 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Flavor pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:44:54.380695 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-60e608fd-70cb-4706-a535-549023d59123 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Image pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:44:54.381338 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-60e608fd-70cb-4706-a535-549023d59123 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:44:54.401744 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-9c7a0e8c-45b2-45cd-afc1-66e23a63b433 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "GET /compute/v2.1/servers/c7391538-81d0-4eb1-bff9-e151e2ee4c3a" status: 200 len: 1316 microversion: 2.1 time: 0.504463 Aug 27 02:44:54.405936 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 567/1142] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:53 2022] GET /compute/v2.1/servers/c7391538-81d0-4eb1-bff9-e151e2ee4c3a => generated 1316 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:54.417225 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-60e608fd-70cb-4706-a535-549023d59123 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:54.418398 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-60e608fd-70cb-4706-a535-549023d59123 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:54.419311 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-60e608fd-70cb-4706-a535-549023d59123 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:54.420479 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-60e608fd-70cb-4706-a535-549023d59123 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:54.421485 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-69e017fd-3fc7-4e5f-98ed-2973afc18a1f tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:54.422549 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-60e608fd-70cb-4706-a535-549023d59123 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:54.423712 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-69e017fd-3fc7-4e5f-98ed-2973afc18a1f tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 3095a9f9-6769-4107-94a5-beac6415694c] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:54.424742 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-60e608fd-70cb-4706-a535-549023d59123 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:54.441516 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-69e017fd-3fc7-4e5f-98ed-2973afc18a1f tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:54.446437 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-69e017fd-3fc7-4e5f-98ed-2973afc18a1f tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:54.447818 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-69e017fd-3fc7-4e5f-98ed-2973afc18a1f tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:54.451681 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-69e017fd-3fc7-4e5f-98ed-2973afc18a1f tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:54.452590 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-69e017fd-3fc7-4e5f-98ed-2973afc18a1f tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:54.453463 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-69e017fd-3fc7-4e5f-98ed-2973afc18a1f tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:54.479542 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-60e608fd-70cb-4706-a535-549023d59123 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Getting quotas for project 256b67be18c246b186e09a313db08a7e. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:44:54.493281 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-60e608fd-70cb-4706-a535-549023d59123 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Getting quotas for user cfec6c2f34f94d66ab1cc982c5bb5bbd and project 256b67be18c246b186e09a313db08a7e. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:44:54.527347 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-60e608fd-70cb-4706-a535-549023d59123 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Going to run 1 instances... {{(pid=134052) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:44:54.538418 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-60e608fd-70cb-4706-a535-549023d59123 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] [instance: a00dd6f6-d48c-4938-84b1-71bec3877ad9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134052) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:44:54.653750 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-60e608fd-70cb-4706-a535-549023d59123 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.065647 Aug 27 02:44:54.665517 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.objects.instance [None req-69e017fd-3fc7-4e5f-98ed-2973afc18a1f tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lazy-loading 'services' on Instance uuid 3095a9f9-6769-4107-94a5-beac6415694c {{(pid=134051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:44:54.670118 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 576/1143] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 02:44:52 2022] POST /compute/v2.1/servers => generated 405 bytes in 2083 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:44:54.692193 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4021de1c-3d2d-484c-8ab8-38808c64537d tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:54.692855 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-4021de1c-3d2d-484c-8ab8-38808c64537d tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] [instance: a00dd6f6-d48c-4938-84b1-71bec3877ad9] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:54.848736 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-69e017fd-3fc7-4e5f-98ed-2973afc18a1f tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "DELETE /compute/v2.1/servers/3095a9f9-6769-4107-94a5-beac6415694c/os-volume_attachments/3edb4671-7829-4740-aae5-987034a684d6" status: 202 len: 0 microversion: 2.1 time: 0.430218 Aug 27 02:44:54.849675 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 568/1144] 10.222.0.70 () {58 vars in 1416 bytes} [Sat Aug 27 02:44:54 2022] DELETE /compute/v2.1/servers/3095a9f9-6769-4107-94a5-beac6415694c/os-volume_attachments/3edb4671-7829-4740-aae5-987034a684d6 => generated 0 bytes in 443 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:44:54.871657 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-082a7c8d-c709-4799-a8c6-be29cd017b17 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:54.881073 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-082a7c8d-c709-4799-a8c6-be29cd017b17 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 3095a9f9-6769-4107-94a5-beac6415694c] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:54.910322 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-082a7c8d-c709-4799-a8c6-be29cd017b17 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:54.910956 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-082a7c8d-c709-4799-a8c6-be29cd017b17 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:54.912967 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-082a7c8d-c709-4799-a8c6-be29cd017b17 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:54.913673 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-4021de1c-3d2d-484c-8ab8-38808c64537d tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfec6c2f34f94d66ab1cc982c5bb5bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256b67be18c246b186e09a313db08a7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:54.915602 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-082a7c8d-c709-4799-a8c6-be29cd017b17 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:54.918436 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-082a7c8d-c709-4799-a8c6-be29cd017b17 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:54.919106 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-082a7c8d-c709-4799-a8c6-be29cd017b17 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:54.933626 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-4021de1c-3d2d-484c-8ab8-38808c64537d tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] 10.222.0.70 "GET /compute/v2.1/servers/a00dd6f6-d48c-4938-84b1-71bec3877ad9" status: 200 len: 1242 microversion: 2.1 time: 0.250295 Aug 27 02:44:54.934622 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 577/1145] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:54 2022] GET /compute/v2.1/servers/a00dd6f6-d48c-4938-84b1-71bec3877ad9 => generated 1242 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:54.972524 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-082a7c8d-c709-4799-a8c6-be29cd017b17 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/3095a9f9-6769-4107-94a5-beac6415694c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.116662 Aug 27 02:44:54.973112 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 569/1146] 10.222.0.70 () {58 vars in 1302 bytes} [Sat Aug 27 02:44:54 2022] GET /compute/v2.1/servers/3095a9f9-6769-4107-94a5-beac6415694c/os-volume_attachments => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:44:55.426524 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8bdeb6d2-caf7-4586-9cac-9cd36a737713 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:55.427613 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-8bdeb6d2-caf7-4586-9cac-9cd36a737713 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: c7391538-81d0-4eb1-bff9-e151e2ee4c3a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:55.443186 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8bdeb6d2-caf7-4586-9cac-9cd36a737713 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:55.450425 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8bdeb6d2-caf7-4586-9cac-9cd36a737713 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:55.450878 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8bdeb6d2-caf7-4586-9cac-9cd36a737713 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:55.451686 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8bdeb6d2-caf7-4586-9cac-9cd36a737713 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:55.452304 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8bdeb6d2-caf7-4586-9cac-9cd36a737713 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:55.454269 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8bdeb6d2-caf7-4586-9cac-9cd36a737713 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:55.872499 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-8bdeb6d2-caf7-4586-9cac-9cd36a737713 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6d1646ec094e3297f6f3c51dd72e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b105816fd4e54b9da4973ff721e1fb92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:55.881485 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-8bdeb6d2-caf7-4586-9cac-9cd36a737713 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "GET /compute/v2.1/servers/c7391538-81d0-4eb1-bff9-e151e2ee4c3a" status: 200 len: 1316 microversion: 2.1 time: 0.459156 Aug 27 02:44:55.886848 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 578/1147] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:55 2022] GET /compute/v2.1/servers/c7391538-81d0-4eb1-bff9-e151e2ee4c3a => generated 1316 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:55.958322 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3043663d-5ed7-46c9-8a8b-0f61ab6ab2b5 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:55.958998 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-3043663d-5ed7-46c9-8a8b-0f61ab6ab2b5 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] [instance: a00dd6f6-d48c-4938-84b1-71bec3877ad9] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:55.978182 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3043663d-5ed7-46c9-8a8b-0f61ab6ab2b5 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:55.980382 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3043663d-5ed7-46c9-8a8b-0f61ab6ab2b5 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:55.981922 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3043663d-5ed7-46c9-8a8b-0f61ab6ab2b5 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:55.983773 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3043663d-5ed7-46c9-8a8b-0f61ab6ab2b5 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:55.984846 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3043663d-5ed7-46c9-8a8b-0f61ab6ab2b5 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:55.987189 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3043663d-5ed7-46c9-8a8b-0f61ab6ab2b5 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:55.991412 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-99526341-2bc1-43af-b189-ff8f1e507c0e tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:55.993936 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-99526341-2bc1-43af-b189-ff8f1e507c0e tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 3095a9f9-6769-4107-94a5-beac6415694c] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:56.019237 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-99526341-2bc1-43af-b189-ff8f1e507c0e tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:56.040612 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-99526341-2bc1-43af-b189-ff8f1e507c0e tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:56.041552 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-99526341-2bc1-43af-b189-ff8f1e507c0e tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:56.042498 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-99526341-2bc1-43af-b189-ff8f1e507c0e tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:56.043132 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-99526341-2bc1-43af-b189-ff8f1e507c0e tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:56.054207 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-99526341-2bc1-43af-b189-ff8f1e507c0e tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:56.151656 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-3043663d-5ed7-46c9-8a8b-0f61ab6ab2b5 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfec6c2f34f94d66ab1cc982c5bb5bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256b67be18c246b186e09a313db08a7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:56.174299 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-3043663d-5ed7-46c9-8a8b-0f61ab6ab2b5 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] 10.222.0.70 "GET /compute/v2.1/servers/a00dd6f6-d48c-4938-84b1-71bec3877ad9" status: 200 len: 1246 microversion: 2.1 time: 0.219820 Aug 27 02:44:56.183612 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 570/1148] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:55 2022] GET /compute/v2.1/servers/a00dd6f6-d48c-4938-84b1-71bec3877ad9 => generated 1246 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:56.191959 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-99526341-2bc1-43af-b189-ff8f1e507c0e tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/3095a9f9-6769-4107-94a5-beac6415694c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.210500 Aug 27 02:44:56.201260 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 579/1149] 10.222.0.70 () {58 vars in 1302 bytes} [Sat Aug 27 02:44:55 2022] GET /compute/v2.1/servers/3095a9f9-6769-4107-94a5-beac6415694c/os-volume_attachments => generated 197 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:44:56.909170 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-72a2862c-339f-4056-a6b6-454000a38381 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:56.909800 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-72a2862c-339f-4056-a6b6-454000a38381 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: c7391538-81d0-4eb1-bff9-e151e2ee4c3a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:56.923632 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-72a2862c-339f-4056-a6b6-454000a38381 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:56.924143 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-72a2862c-339f-4056-a6b6-454000a38381 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:56.924618 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-72a2862c-339f-4056-a6b6-454000a38381 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:56.925345 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-72a2862c-339f-4056-a6b6-454000a38381 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:56.925798 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-72a2862c-339f-4056-a6b6-454000a38381 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:56.937908 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-72a2862c-339f-4056-a6b6-454000a38381 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:56.995430 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c81a13a7-8f5c-453b-8150-d88481d99bbd tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-555737879", "imageRef": "ae19a3eb-2ed5-4284-8505-c81a7a74b165", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "b65154a1-cdd7-472e-a59f-045db7072ad0"}], "security_groups": [{"name": "tempest-securitygroup--899019089"}], "key_name": "tempest-keypair-526447408", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:44:57.742078 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-72a2862c-339f-4056-a6b6-454000a38381 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6d1646ec094e3297f6f3c51dd72e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b105816fd4e54b9da4973ff721e1fb92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:57.780439 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-72a2862c-339f-4056-a6b6-454000a38381 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "GET /compute/v2.1/servers/c7391538-81d0-4eb1-bff9-e151e2ee4c3a" status: 200 len: 1316 microversion: 2.1 time: 0.872504 Aug 27 02:44:57.803017 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 571/1150] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:56 2022] GET /compute/v2.1/servers/c7391538-81d0-4eb1-bff9-e151e2ee4c3a => generated 1316 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:57.815368 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-37b38471-ea1a-46ae-b0c8-b60af9c2e9cd tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:57.816287 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-37b38471-ea1a-46ae-b0c8-b60af9c2e9cd tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] [instance: a00dd6f6-d48c-4938-84b1-71bec3877ad9] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:57.829816 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-37b38471-ea1a-46ae-b0c8-b60af9c2e9cd tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:57.832152 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-37b38471-ea1a-46ae-b0c8-b60af9c2e9cd tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:57.834308 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-37b38471-ea1a-46ae-b0c8-b60af9c2e9cd tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:57.835324 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-37b38471-ea1a-46ae-b0c8-b60af9c2e9cd tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:57.837105 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-37b38471-ea1a-46ae-b0c8-b60af9c2e9cd tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:57.839463 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-37b38471-ea1a-46ae-b0c8-b60af9c2e9cd tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:57.950891 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.network.neutron [None req-c81a13a7-8f5c-453b-8150-d88481d99bbd tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] validate_networks() for [('b65154a1-cdd7-472e-a59f-045db7072ad0', None, None, None, None, None)] {{(pid=134052) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:44:58.522589 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-37b38471-ea1a-46ae-b0c8-b60af9c2e9cd tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfec6c2f34f94d66ab1cc982c5bb5bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256b67be18c246b186e09a313db08a7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:58.524936 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:44:58.534249 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-37b38471-ea1a-46ae-b0c8-b60af9c2e9cd tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] 10.222.0.70 "GET /compute/v2.1/servers/a00dd6f6-d48c-4938-84b1-71bec3877ad9" status: 200 len: 1312 microversion: 2.1 time: 0.729807 Aug 27 02:44:58.537525 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 572/1151] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:57 2022] GET /compute/v2.1/servers/a00dd6f6-d48c-4938-84b1-71bec3877ad9 => generated 1312 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:58.550795 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3f8f5383-64a9-42a7-8c45-d2b091727ec4 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:58.555418 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-3f8f5383-64a9-42a7-8c45-d2b091727ec4 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 3095a9f9-6769-4107-94a5-beac6415694c] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:58.572144 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:44:58.603367 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3f8f5383-64a9-42a7-8c45-d2b091727ec4 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:58.603982 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3f8f5383-64a9-42a7-8c45-d2b091727ec4 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:58.604452 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3f8f5383-64a9-42a7-8c45-d2b091727ec4 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:58.605217 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3f8f5383-64a9-42a7-8c45-d2b091727ec4 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:58.605665 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3f8f5383-64a9-42a7-8c45-d2b091727ec4 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:58.606084 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3f8f5383-64a9-42a7-8c45-d2b091727ec4 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:58.698277 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-3f8f5383-64a9-42a7-8c45-d2b091727ec4 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/3095a9f9-6769-4107-94a5-beac6415694c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.155118 Aug 27 02:44:58.703856 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 573/1152] 10.222.0.70 () {58 vars in 1302 bytes} [Sat Aug 27 02:44:58 2022] GET /compute/v2.1/servers/3095a9f9-6769-4107-94a5-beac6415694c/os-volume_attachments => generated 197 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:44:58.716625 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-7f6ee7ed-adfe-493b-bd80-09110d490eb3 req-f7ceac11-719a-4f13-ac0a-936b06c9b2c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7391538-81d0-4eb1-bff9-e151e2ee4c3a", "name": "network-vif-plugged", "status": "completed", "tag": "d64f53fe-e8c7-4c7b-a9e7-a14d8feb01e0"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:44:58.747324 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-7f6ee7ed-adfe-493b-bd80-09110d490eb3 req-f7ceac11-719a-4f13-ac0a-936b06c9b2c3 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:58.748012 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-7f6ee7ed-adfe-493b-bd80-09110d490eb3 req-f7ceac11-719a-4f13-ac0a-936b06c9b2c3 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:58.755899 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-7f6ee7ed-adfe-493b-bd80-09110d490eb3 req-f7ceac11-719a-4f13-ac0a-936b06c9b2c3 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:58.773280 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-7f6ee7ed-adfe-493b-bd80-09110d490eb3 req-f7ceac11-719a-4f13-ac0a-936b06c9b2c3 service nova] Creating event network-vif-plugged:d64f53fe-e8c7-4c7b-a9e7-a14d8feb01e0 for instance c7391538-81d0-4eb1-bff9-e151e2ee4c3a on n-h1-852278-4 Aug 27 02:44:58.791148 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-7f6ee7ed-adfe-493b-bd80-09110d490eb3 req-f7ceac11-719a-4f13-ac0a-936b06c9b2c3 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085963 Aug 27 02:44:58.792492 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 574/1153] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:44:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:44:58.906194 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-5cc3d011-b58b-4b84-937d-e54f6be4f88d tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1697530736", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "networks": [{"uuid": "48fc4806-56c1-4954-8212-e1e78b76e094"}]}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:44:59.047110 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.network.neutron [None req-5cc3d011-b58b-4b84-937d-e54f6be4f88d tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] validate_networks() for [('48fc4806-56c1-4954-8212-e1e78b76e094', None, None, None, None, None)] {{(pid=134051) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:45:01.607001 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-c81a13a7-8f5c-453b-8150-d88481d99bbd tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Flavor limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:45:01.608105 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-c81a13a7-8f5c-453b-8150-d88481d99bbd tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Image limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:45:01.608831 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-c81a13a7-8f5c-453b-8150-d88481d99bbd tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Flavor pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:45:01.609879 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-c81a13a7-8f5c-453b-8150-d88481d99bbd tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Image pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:45:01.611007 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-c81a13a7-8f5c-453b-8150-d88481d99bbd tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:45:01.625726 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=21 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:45:01.633591 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c81a13a7-8f5c-453b-8150-d88481d99bbd tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:01.636533 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c81a13a7-8f5c-453b-8150-d88481d99bbd tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:01.637225 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c81a13a7-8f5c-453b-8150-d88481d99bbd tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:01.638432 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c81a13a7-8f5c-453b-8150-d88481d99bbd tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:01.640688 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c81a13a7-8f5c-453b-8150-d88481d99bbd tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:01.642807 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c81a13a7-8f5c-453b-8150-d88481d99bbd tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:01.689444 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-c81a13a7-8f5c-453b-8150-d88481d99bbd tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Getting quotas for project ebe9e2cfe40746dd8af1792468a57a2c. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:45:01.703450 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-c81a13a7-8f5c-453b-8150-d88481d99bbd tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Getting quotas for user 32514a813c0a4031a1d1effc807db17d and project ebe9e2cfe40746dd8af1792468a57a2c. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:45:01.739283 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-c81a13a7-8f5c-453b-8150-d88481d99bbd tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Going to run 1 instances... {{(pid=134052) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:45:01.747846 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-c81a13a7-8f5c-453b-8150-d88481d99bbd tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] [instance: 582ea86f-befd-4c47-95d9-2eba872eb8c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ae19a3eb-2ed5-4284-8505-c81a7a74b165',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134052) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:45:01.874845 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c81a13a7-8f5c-453b-8150-d88481d99bbd tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 4.886404 Aug 27 02:45:01.887184 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 580/1154] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 02:44:56 2022] POST /compute/v2.1/servers => generated 405 bytes in 4899 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:45:01.897878 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-30c1f930-8287-407b-a271-81596164b072 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:01.903963 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-30c1f930-8287-407b-a271-81596164b072 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: c7391538-81d0-4eb1-bff9-e151e2ee4c3a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:01.917366 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-30c1f930-8287-407b-a271-81596164b072 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:01.917990 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-30c1f930-8287-407b-a271-81596164b072 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:01.918306 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-30c1f930-8287-407b-a271-81596164b072 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:01.919022 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-30c1f930-8287-407b-a271-81596164b072 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:01.919475 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-30c1f930-8287-407b-a271-81596164b072 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:01.919897 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-30c1f930-8287-407b-a271-81596164b072 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:02.121627 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-5cc3d011-b58b-4b84-937d-e54f6be4f88d tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Flavor limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:45:02.122153 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-5cc3d011-b58b-4b84-937d-e54f6be4f88d tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Image limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:45:02.122545 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-5cc3d011-b58b-4b84-937d-e54f6be4f88d tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Flavor pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:45:02.123115 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-5cc3d011-b58b-4b84-937d-e54f6be4f88d tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Image pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:45:02.123563 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-5cc3d011-b58b-4b84-937d-e54f6be4f88d tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:45:02.178761 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5cc3d011-b58b-4b84-937d-e54f6be4f88d tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:02.180755 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5cc3d011-b58b-4b84-937d-e54f6be4f88d tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:02.181462 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5cc3d011-b58b-4b84-937d-e54f6be4f88d tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:02.183005 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5cc3d011-b58b-4b84-937d-e54f6be4f88d tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:02.183699 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5cc3d011-b58b-4b84-937d-e54f6be4f88d tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:02.201176 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5cc3d011-b58b-4b84-937d-e54f6be4f88d tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:02.319224 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-5cc3d011-b58b-4b84-937d-e54f6be4f88d tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Getting quotas for project f5668e6d96694c62b83f7e8381fe86e1. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:45:02.364000 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-5cc3d011-b58b-4b84-937d-e54f6be4f88d tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Getting quotas for user 0e86c17fe83848e2bc96b7c83ff1cf14 and project f5668e6d96694c62b83f7e8381fe86e1. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:45:02.429072 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-5cc3d011-b58b-4b84-937d-e54f6be4f88d tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Going to run 1 instances... {{(pid=134051) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:45:02.433378 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-5cc3d011-b58b-4b84-937d-e54f6be4f88d tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] [instance: 98a9933e-6c22-491a-90bb-d1d2c0bb7df9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134051) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:45:02.536157 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-5cc3d011-b58b-4b84-937d-e54f6be4f88d tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.742192 Aug 27 02:45:02.545010 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 575/1155] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 02:44:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 3752 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:45:02.550619 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a9a8f21c-d050-4787-a35c-764bc0583352 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:02.559988 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-a9a8f21c-d050-4787-a35c-764bc0583352 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] [instance: a00dd6f6-d48c-4938-84b1-71bec3877ad9] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:02.582336 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a9a8f21c-d050-4787-a35c-764bc0583352 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:02.583538 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a9a8f21c-d050-4787-a35c-764bc0583352 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:02.587778 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a9a8f21c-d050-4787-a35c-764bc0583352 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:02.588916 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a9a8f21c-d050-4787-a35c-764bc0583352 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:02.589894 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a9a8f21c-d050-4787-a35c-764bc0583352 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:02.596646 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a9a8f21c-d050-4787-a35c-764bc0583352 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:03.369502 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-30c1f930-8287-407b-a271-81596164b072 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6d1646ec094e3297f6f3c51dd72e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b105816fd4e54b9da4973ff721e1fb92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:03.381783 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-30c1f930-8287-407b-a271-81596164b072 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "GET /compute/v2.1/servers/c7391538-81d0-4eb1-bff9-e151e2ee4c3a" status: 200 len: 1316 microversion: 2.1 time: 1.492483 Aug 27 02:45:03.384489 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 581/1156] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:01 2022] GET /compute/v2.1/servers/c7391538-81d0-4eb1-bff9-e151e2ee4c3a => generated 1316 bytes in 1497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:03.398963 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-7ad17087-b8d0-499d-aa23-63568071eabb tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:03.402960 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-7ad17087-b8d0-499d-aa23-63568071eabb tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 3095a9f9-6769-4107-94a5-beac6415694c] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:03.420641 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7ad17087-b8d0-499d-aa23-63568071eabb tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:03.423378 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7ad17087-b8d0-499d-aa23-63568071eabb tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:03.425176 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7ad17087-b8d0-499d-aa23-63568071eabb tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:03.426328 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7ad17087-b8d0-499d-aa23-63568071eabb tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:03.428152 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7ad17087-b8d0-499d-aa23-63568071eabb tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:03.430677 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7ad17087-b8d0-499d-aa23-63568071eabb tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:03.521296 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-a9a8f21c-d050-4787-a35c-764bc0583352 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfec6c2f34f94d66ab1cc982c5bb5bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256b67be18c246b186e09a313db08a7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:03.532019 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-7ad17087-b8d0-499d-aa23-63568071eabb tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/3095a9f9-6769-4107-94a5-beac6415694c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.144389 Aug 27 02:45:03.533386 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 582/1157] 10.222.0.70 () {58 vars in 1302 bytes} [Sat Aug 27 02:45:03 2022] GET /compute/v2.1/servers/3095a9f9-6769-4107-94a5-beac6415694c/os-volume_attachments => generated 197 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:45:03.543439 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a9a8f21c-d050-4787-a35c-764bc0583352 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] 10.222.0.70 "GET /compute/v2.1/servers/a00dd6f6-d48c-4938-84b1-71bec3877ad9" status: 200 len: 1367 microversion: 2.1 time: 0.992499 Aug 27 02:45:03.544615 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 576/1158] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:02 2022] GET /compute/v2.1/servers/a00dd6f6-d48c-4938-84b1-71bec3877ad9 => generated 1367 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:03.550653 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-15d61cb3-0d86-42ff-9fde-b8a30e60ba17 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:03.563329 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-15d61cb3-0d86-42ff-9fde-b8a30e60ba17 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] [instance: 582ea86f-befd-4c47-95d9-2eba872eb8c8] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:03.565042 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-aa822171-de24-4547-b387-c9a7469c54fd tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1735990077", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "b0edff77-134a-4e34-8600-26bed9e15888"}], "block_device_mapping_v2": [{"uuid": "68b13980-dee4-42cd-98d4-813e42f086f2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:45:03.578685 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-15d61cb3-0d86-42ff-9fde-b8a30e60ba17 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:03.580933 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-15d61cb3-0d86-42ff-9fde-b8a30e60ba17 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:03.581544 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-15d61cb3-0d86-42ff-9fde-b8a30e60ba17 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:03.594942 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-15d61cb3-0d86-42ff-9fde-b8a30e60ba17 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:03.595555 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-15d61cb3-0d86-42ff-9fde-b8a30e60ba17 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:03.596104 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-15d61cb3-0d86-42ff-9fde-b8a30e60ba17 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:03.670947 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.network.neutron [None req-aa822171-de24-4547-b387-c9a7469c54fd tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] validate_networks() for [('b0edff77-134a-4e34-8600-26bed9e15888', None, None, None, None, None)] {{(pid=134052) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:45:03.866090 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-15d61cb3-0d86-42ff-9fde-b8a30e60ba17 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32514a813c0a4031a1d1effc807db17d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe9e2cfe40746dd8af1792468a57a2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:03.882618 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-15d61cb3-0d86-42ff-9fde-b8a30e60ba17 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] 10.222.0.70 "GET /compute/v2.1/servers/582ea86f-befd-4c47-95d9-2eba872eb8c8" status: 200 len: 1296 microversion: 2.1 time: 0.336547 Aug 27 02:45:03.883360 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 577/1159] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:03 2022] GET /compute/v2.1/servers/582ea86f-befd-4c47-95d9-2eba872eb8c8 => generated 1296 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:03.888153 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-334c6084-657a-4931-a381-77b27801b05e tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:03.893111 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-334c6084-657a-4931-a381-77b27801b05e tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] [instance: 98a9933e-6c22-491a-90bb-d1d2c0bb7df9] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:03.910374 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-334c6084-657a-4931-a381-77b27801b05e tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:03.911226 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-334c6084-657a-4931-a381-77b27801b05e tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:03.911864 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-334c6084-657a-4931-a381-77b27801b05e tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:03.912827 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-334c6084-657a-4931-a381-77b27801b05e tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:03.913500 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-334c6084-657a-4931-a381-77b27801b05e tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:03.914116 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-334c6084-657a-4931-a381-77b27801b05e tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:04.096912 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-334c6084-657a-4931-a381-77b27801b05e tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e86c17fe83848e2bc96b7c83ff1cf14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5668e6d96694c62b83f7e8381fe86e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:04.105442 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-334c6084-657a-4931-a381-77b27801b05e tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] 10.222.0.70 "GET /compute/v2.1/servers/98a9933e-6c22-491a-90bb-d1d2c0bb7df9" status: 200 len: 1221 microversion: 2.1 time: 0.220766 Aug 27 02:45:04.112073 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 578/1160] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:03 2022] GET /compute/v2.1/servers/98a9933e-6c22-491a-90bb-d1d2c0bb7df9 => generated 1221 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:04.410519 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4ecc5322-2d47-4778-b79c-c28cb42d6b1a tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:04.411890 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-4ecc5322-2d47-4778-b79c-c28cb42d6b1a tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: c7391538-81d0-4eb1-bff9-e151e2ee4c3a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:04.425909 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4ecc5322-2d47-4778-b79c-c28cb42d6b1a tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:04.427053 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4ecc5322-2d47-4778-b79c-c28cb42d6b1a tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:04.430567 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4ecc5322-2d47-4778-b79c-c28cb42d6b1a tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:04.434623 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4ecc5322-2d47-4778-b79c-c28cb42d6b1a tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:04.435386 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4ecc5322-2d47-4778-b79c-c28cb42d6b1a tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:04.436656 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4ecc5322-2d47-4778-b79c-c28cb42d6b1a tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:05.689729 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-aa822171-de24-4547-b387-c9a7469c54fd tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Flavor limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:45:05.690541 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-aa822171-de24-4547-b387-c9a7469c54fd tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Image limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:45:05.691482 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-aa822171-de24-4547-b387-c9a7469c54fd tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Flavor pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:45:05.692668 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-aa822171-de24-4547-b387-c9a7469c54fd tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Image pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:45:05.694632 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-aa822171-de24-4547-b387-c9a7469c54fd tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:45:05.723732 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-aa822171-de24-4547-b387-c9a7469c54fd tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:05.724856 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-aa822171-de24-4547-b387-c9a7469c54fd tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:05.726699 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-aa822171-de24-4547-b387-c9a7469c54fd tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:05.737162 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-aa822171-de24-4547-b387-c9a7469c54fd tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:05.742265 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-aa822171-de24-4547-b387-c9a7469c54fd tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:05.742972 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-aa822171-de24-4547-b387-c9a7469c54fd tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:05.798025 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-aa822171-de24-4547-b387-c9a7469c54fd tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Getting quotas for project e78b498dced14d1d822e7d0c27f57215. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:45:05.809712 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-aa822171-de24-4547-b387-c9a7469c54fd tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Getting quotas for user 774ce37f4c6b4f72ad494ea40a3e238d and project e78b498dced14d1d822e7d0c27f57215. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:45:05.951414 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-aa822171-de24-4547-b387-c9a7469c54fd tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Going to run 1 instances... {{(pid=134052) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:45:05.954246 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-aa822171-de24-4547-b387-c9a7469c54fd tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: f620f083-7230-471a-87d0-f6d85f8ad087] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='68b13980-dee4-42cd-98d4-813e42f086f2',volume_size=None,volume_type=None)] {{(pid=134052) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:45:06.170928 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:45:06.205345 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-aa822171-de24-4547-b387-c9a7469c54fd tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.668640 Aug 27 02:45:06.207525 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 583/1161] 10.222.0.70 () {62 vars in 1188 bytes} [Sat Aug 27 02:45:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 2672 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 27 02:45:06.215252 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-15ca55a1-341c-495e-8b08-69b4d1af3aa8 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:06.219739 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-15ca55a1-341c-495e-8b08-69b4d1af3aa8 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 3095a9f9-6769-4107-94a5-beac6415694c] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:06.231663 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-15ca55a1-341c-495e-8b08-69b4d1af3aa8 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:06.232639 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-15ca55a1-341c-495e-8b08-69b4d1af3aa8 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:06.233570 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-15ca55a1-341c-495e-8b08-69b4d1af3aa8 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:06.235227 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-15ca55a1-341c-495e-8b08-69b4d1af3aa8 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:06.237178 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-15ca55a1-341c-495e-8b08-69b4d1af3aa8 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:06.237944 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-15ca55a1-341c-495e-8b08-69b4d1af3aa8 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:06.401389 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-15ca55a1-341c-495e-8b08-69b4d1af3aa8 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/3095a9f9-6769-4107-94a5-beac6415694c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.192219 Aug 27 02:45:06.404396 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 584/1162] 10.222.0.70 () {58 vars in 1302 bytes} [Sat Aug 27 02:45:06 2022] GET /compute/v2.1/servers/3095a9f9-6769-4107-94a5-beac6415694c/os-volume_attachments => generated 25 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:45:06.418202 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-09213332-4f36-4eda-b880-edc0a8609959 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:06.418823 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-09213332-4f36-4eda-b880-edc0a8609959 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] [instance: a00dd6f6-d48c-4938-84b1-71bec3877ad9] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:06.450104 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-09213332-4f36-4eda-b880-edc0a8609959 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:06.451131 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-09213332-4f36-4eda-b880-edc0a8609959 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:06.451641 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-09213332-4f36-4eda-b880-edc0a8609959 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:06.470180 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-09213332-4f36-4eda-b880-edc0a8609959 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:06.472686 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-09213332-4f36-4eda-b880-edc0a8609959 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:06.473171 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-09213332-4f36-4eda-b880-edc0a8609959 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:06.550138 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-4ecc5322-2d47-4778-b79c-c28cb42d6b1a tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6d1646ec094e3297f6f3c51dd72e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b105816fd4e54b9da4973ff721e1fb92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:06.562678 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-4ecc5322-2d47-4778-b79c-c28cb42d6b1a tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "GET /compute/v2.1/servers/c7391538-81d0-4eb1-bff9-e151e2ee4c3a" status: 200 len: 1466 microversion: 2.1 time: 2.158313 Aug 27 02:45:06.568222 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 579/1163] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:04 2022] GET /compute/v2.1/servers/c7391538-81d0-4eb1-bff9-e151e2ee4c3a => generated 1466 bytes in 2165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:06.577942 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b5ac5f45-7b0d-4709-aed7-5f99cd9d3d32 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:06.582098 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b5ac5f45-7b0d-4709-aed7-5f99cd9d3d32 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] [instance: 582ea86f-befd-4c47-95d9-2eba872eb8c8] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:06.598156 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b5ac5f45-7b0d-4709-aed7-5f99cd9d3d32 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:06.598659 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b5ac5f45-7b0d-4709-aed7-5f99cd9d3d32 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:06.599097 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b5ac5f45-7b0d-4709-aed7-5f99cd9d3d32 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:06.602831 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b5ac5f45-7b0d-4709-aed7-5f99cd9d3d32 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:06.604072 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b5ac5f45-7b0d-4709-aed7-5f99cd9d3d32 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:06.604544 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b5ac5f45-7b0d-4709-aed7-5f99cd9d3d32 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:06.988145 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-b5ac5f45-7b0d-4709-aed7-5f99cd9d3d32 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32514a813c0a4031a1d1effc807db17d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe9e2cfe40746dd8af1792468a57a2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:07.014589 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b5ac5f45-7b0d-4709-aed7-5f99cd9d3d32 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] 10.222.0.70 "GET /compute/v2.1/servers/582ea86f-befd-4c47-95d9-2eba872eb8c8" status: 200 len: 1302 microversion: 2.1 time: 0.444196 Aug 27 02:45:07.020167 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 580/1164] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:06 2022] GET /compute/v2.1/servers/582ea86f-befd-4c47-95d9-2eba872eb8c8 => generated 1302 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:07.058801 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-38d9bc52-1990-4e79-9dc9-879f30cca135 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:07.059929 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-38d9bc52-1990-4e79-9dc9-879f30cca135 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] [instance: 98a9933e-6c22-491a-90bb-d1d2c0bb7df9] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:07.091591 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-38d9bc52-1990-4e79-9dc9-879f30cca135 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:07.092159 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-38d9bc52-1990-4e79-9dc9-879f30cca135 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:07.092635 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-38d9bc52-1990-4e79-9dc9-879f30cca135 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:07.093386 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-38d9bc52-1990-4e79-9dc9-879f30cca135 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:07.093821 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-38d9bc52-1990-4e79-9dc9-879f30cca135 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:07.094243 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-38d9bc52-1990-4e79-9dc9-879f30cca135 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:07.617478 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-09213332-4f36-4eda-b880-edc0a8609959 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfec6c2f34f94d66ab1cc982c5bb5bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256b67be18c246b186e09a313db08a7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:07.633339 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-09213332-4f36-4eda-b880-edc0a8609959 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] 10.222.0.70 "GET /compute/v2.1/servers/a00dd6f6-d48c-4938-84b1-71bec3877ad9" status: 200 len: 1367 microversion: 2.1 time: 1.223694 Aug 27 02:45:07.643134 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 585/1165] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:06 2022] GET /compute/v2.1/servers/a00dd6f6-d48c-4938-84b1-71bec3877ad9 => generated 1367 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:07.652228 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0bae2423-c952-4b48-ad32-8f5deb14820d tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:07.662843 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-0bae2423-c952-4b48-ad32-8f5deb14820d tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: f620f083-7230-471a-87d0-f6d85f8ad087] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:07.685977 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0bae2423-c952-4b48-ad32-8f5deb14820d tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:07.689643 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0bae2423-c952-4b48-ad32-8f5deb14820d tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:07.690310 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0bae2423-c952-4b48-ad32-8f5deb14820d tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:07.693215 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0bae2423-c952-4b48-ad32-8f5deb14820d tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:07.703994 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0bae2423-c952-4b48-ad32-8f5deb14820d tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:07.704904 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0bae2423-c952-4b48-ad32-8f5deb14820d tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:08.110974 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0bae2423-c952-4b48-ad32-8f5deb14820d tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:08.125628 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0bae2423-c952-4b48-ad32-8f5deb14820d tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:08.131724 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0bae2423-c952-4b48-ad32-8f5deb14820d tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:08.144628 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-0bae2423-c952-4b48-ad32-8f5deb14820d tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/f620f083-7230-471a-87d0-f6d85f8ad087" status: 200 len: 1185 microversion: 2.25 time: 0.488544 Aug 27 02:45:08.146725 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 586/1166] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:45:07 2022] GET /compute/v2.1/servers/f620f083-7230-471a-87d0-f6d85f8ad087 => generated 1185 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:45:08.167527 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c3acc784-c568-48f3-bbe5-e751fe1099a3 tempest-ServersOnMultiNodesTest-986315705 tempest-ServersOnMultiNodesTest-986315705-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:08.172980 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-c3acc784-c568-48f3-bbe5-e751fe1099a3 tempest-ServersOnMultiNodesTest-986315705 tempest-ServersOnMultiNodesTest-986315705-project-admin] [instance: c7391538-81d0-4eb1-bff9-e151e2ee4c3a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:08.215637 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c3acc784-c568-48f3-bbe5-e751fe1099a3 tempest-ServersOnMultiNodesTest-986315705 tempest-ServersOnMultiNodesTest-986315705-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:08.216068 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c3acc784-c568-48f3-bbe5-e751fe1099a3 tempest-ServersOnMultiNodesTest-986315705 tempest-ServersOnMultiNodesTest-986315705-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:08.226366 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c3acc784-c568-48f3-bbe5-e751fe1099a3 tempest-ServersOnMultiNodesTest-986315705 tempest-ServersOnMultiNodesTest-986315705-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:08.229914 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c3acc784-c568-48f3-bbe5-e751fe1099a3 tempest-ServersOnMultiNodesTest-986315705 tempest-ServersOnMultiNodesTest-986315705-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:08.233146 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c3acc784-c568-48f3-bbe5-e751fe1099a3 tempest-ServersOnMultiNodesTest-986315705 tempest-ServersOnMultiNodesTest-986315705-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:08.234028 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c3acc784-c568-48f3-bbe5-e751fe1099a3 tempest-ServersOnMultiNodesTest-986315705 tempest-ServersOnMultiNodesTest-986315705-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:09.045897 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-38d9bc52-1990-4e79-9dc9-879f30cca135 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e86c17fe83848e2bc96b7c83ff1cf14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5668e6d96694c62b83f7e8381fe86e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:09.055300 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-38d9bc52-1990-4e79-9dc9-879f30cca135 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] 10.222.0.70 "GET /compute/v2.1/servers/98a9933e-6c22-491a-90bb-d1d2c0bb7df9" status: 200 len: 1325 microversion: 2.1 time: 2.027799 Aug 27 02:45:09.061517 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 581/1167] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:07 2022] GET /compute/v2.1/servers/98a9933e-6c22-491a-90bb-d1d2c0bb7df9 => generated 1325 bytes in 2041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:09.077746 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-24d10123-8480-4bf9-b607-bf15af4b3a45 req-5bcc6060-6a85-4460-a209-fc28e28432a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a00dd6f6-d48c-4938-84b1-71bec3877ad9", "tag": "829c63ac-805f-401e-b2ab-43eae4e821bb"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:45:09.128477 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c3acc784-c568-48f3-bbe5-e751fe1099a3 tempest-ServersOnMultiNodesTest-986315705 tempest-ServersOnMultiNodesTest-986315705-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/c7391538-81d0-4eb1-bff9-e151e2ee4c3a" status: 200 len: 1617 microversion: 2.1 time: 0.979016 Aug 27 02:45:09.145154 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 587/1168] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:08 2022] GET /compute/v2.1/servers/c7391538-81d0-4eb1-bff9-e151e2ee4c3a => generated 1617 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:09.152914 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-24d10123-8480-4bf9-b607-bf15af4b3a45 req-5bcc6060-6a85-4460-a209-fc28e28432a2 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:09.154160 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-24d10123-8480-4bf9-b607-bf15af4b3a45 req-5bcc6060-6a85-4460-a209-fc28e28432a2 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:09.158556 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-24d10123-8480-4bf9-b607-bf15af4b3a45 req-5bcc6060-6a85-4460-a209-fc28e28432a2 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:09.162534 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-68124c67-ef16-4954-bc26-d5f5de55ecf2 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:09.167677 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-68124c67-ef16-4954-bc26-d5f5de55ecf2 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] [instance: 582ea86f-befd-4c47-95d9-2eba872eb8c8] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:09.190510 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-68124c67-ef16-4954-bc26-d5f5de55ecf2 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:09.192972 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-68124c67-ef16-4954-bc26-d5f5de55ecf2 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:09.195562 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-68124c67-ef16-4954-bc26-d5f5de55ecf2 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:09.196536 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-68124c67-ef16-4954-bc26-d5f5de55ecf2 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:09.197174 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-68124c67-ef16-4954-bc26-d5f5de55ecf2 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:09.198391 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-24d10123-8480-4bf9-b607-bf15af4b3a45 req-5bcc6060-6a85-4460-a209-fc28e28432a2 service nova] Creating event network-changed:829c63ac-805f-401e-b2ab-43eae4e821bb for instance a00dd6f6-d48c-4938-84b1-71bec3877ad9 on n-h2-852278-4 Aug 27 02:45:09.203895 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-68124c67-ef16-4954-bc26-d5f5de55ecf2 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:09.218093 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-24d10123-8480-4bf9-b607-bf15af4b3a45 req-5bcc6060-6a85-4460-a209-fc28e28432a2 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.152409 Aug 27 02:45:09.226775 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 582/1169] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:45:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:45:09.376676 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-dc8bc996-cc3e-4cbb-a198-587641ac5c40 req-1df9b8f0-5819-454f-9cde-075b206cb335 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98a9933e-6c22-491a-90bb-d1d2c0bb7df9", "tag": "bb051cf4-2ed9-43d4-ae67-717a893d0979"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:45:09.389099 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-dc8bc996-cc3e-4cbb-a198-587641ac5c40 req-1df9b8f0-5819-454f-9cde-075b206cb335 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:09.389585 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-dc8bc996-cc3e-4cbb-a198-587641ac5c40 req-1df9b8f0-5819-454f-9cde-075b206cb335 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:09.402228 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-dc8bc996-cc3e-4cbb-a198-587641ac5c40 req-1df9b8f0-5819-454f-9cde-075b206cb335 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:09.432993 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-dc8bc996-cc3e-4cbb-a198-587641ac5c40 req-1df9b8f0-5819-454f-9cde-075b206cb335 service nova] Creating event network-changed:bb051cf4-2ed9-43d4-ae67-717a893d0979 for instance 98a9933e-6c22-491a-90bb-d1d2c0bb7df9 on n-h1-852278-4 Aug 27 02:45:09.450196 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-dc8bc996-cc3e-4cbb-a198-587641ac5c40 req-1df9b8f0-5819-454f-9cde-075b206cb335 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.214292 Aug 27 02:45:09.451656 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 583/1170] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:45:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:45:09.457608 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-25320f4a-8f85-4bd8-b3ce-52aec6b209f9 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:09.461834 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-25320f4a-8f85-4bd8-b3ce-52aec6b209f9 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] [instance: a00dd6f6-d48c-4938-84b1-71bec3877ad9] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:09.477919 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-25320f4a-8f85-4bd8-b3ce-52aec6b209f9 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:09.478632 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-25320f4a-8f85-4bd8-b3ce-52aec6b209f9 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:09.479257 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-25320f4a-8f85-4bd8-b3ce-52aec6b209f9 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:09.480159 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-25320f4a-8f85-4bd8-b3ce-52aec6b209f9 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:09.483017 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-25320f4a-8f85-4bd8-b3ce-52aec6b209f9 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:09.483480 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-25320f4a-8f85-4bd8-b3ce-52aec6b209f9 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:09.982233 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-68124c67-ef16-4954-bc26-d5f5de55ecf2 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32514a813c0a4031a1d1effc807db17d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe9e2cfe40746dd8af1792468a57a2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:09.991611 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-68124c67-ef16-4954-bc26-d5f5de55ecf2 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] 10.222.0.70 "GET /compute/v2.1/servers/582ea86f-befd-4c47-95d9-2eba872eb8c8" status: 200 len: 1302 microversion: 2.1 time: 0.845217 Aug 27 02:45:09.992230 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 588/1171] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:09 2022] GET /compute/v2.1/servers/582ea86f-befd-4c47-95d9-2eba872eb8c8 => generated 1302 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:10.016970 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-225edc0d-7072-4654-a0fb-43636c092fe6 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:10.017567 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-225edc0d-7072-4654-a0fb-43636c092fe6 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: f620f083-7230-471a-87d0-f6d85f8ad087] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:10.034728 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-225edc0d-7072-4654-a0fb-43636c092fe6 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:10.035493 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-225edc0d-7072-4654-a0fb-43636c092fe6 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:10.036118 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-225edc0d-7072-4654-a0fb-43636c092fe6 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:10.038085 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-225edc0d-7072-4654-a0fb-43636c092fe6 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:10.038809 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-225edc0d-7072-4654-a0fb-43636c092fe6 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:10.039425 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-225edc0d-7072-4654-a0fb-43636c092fe6 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:10.089901 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=100 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:45:10.261875 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-225edc0d-7072-4654-a0fb-43636c092fe6 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:10.270900 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-225edc0d-7072-4654-a0fb-43636c092fe6 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:10.277117 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-225edc0d-7072-4654-a0fb-43636c092fe6 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:10.278556 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-225edc0d-7072-4654-a0fb-43636c092fe6 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/f620f083-7230-471a-87d0-f6d85f8ad087" status: 200 len: 1251 microversion: 2.25 time: 0.285359 Aug 27 02:45:10.300344 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 589/1172] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:45:09 2022] GET /compute/v2.1/servers/f620f083-7230-471a-87d0-f6d85f8ad087 => generated 1251 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:45:10.305828 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b870ea05-0d11-47e8-ab99-9e02d8b41053 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1396616912", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["2e16c5b3-ff3c-4afe-ae65-97b9be1b14b0"]}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:45:10.428534 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-25320f4a-8f85-4bd8-b3ce-52aec6b209f9 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfec6c2f34f94d66ab1cc982c5bb5bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256b67be18c246b186e09a313db08a7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:10.439866 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-25320f4a-8f85-4bd8-b3ce-52aec6b209f9 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] 10.222.0.70 "GET /compute/v2.1/servers/a00dd6f6-d48c-4938-84b1-71bec3877ad9" status: 200 len: 1367 microversion: 2.1 time: 0.984526 Aug 27 02:45:10.456547 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 584/1173] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:09 2022] GET /compute/v2.1/servers/a00dd6f6-d48c-4938-84b1-71bec3877ad9 => generated 1367 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:10.545046 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d1dc8a89-5c0a-4fde-8ebf-c3f82dd2232e tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-1562343429", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "62ebb3a0-b7ab-42bd-ac4b-910ad62ac496"}]}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:45:12.240283 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:45:12.411302 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=6 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:45:15.776528 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=6 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:45:15.833741 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=11 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:45:19.463420 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.network.neutron [None req-b870ea05-0d11-47e8-ab99-9e02d8b41053 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] validate_networks() for None {{(pid=134052) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:45:19.475169 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.network.neutron [None req-d1dc8a89-5c0a-4fde-8ebf-c3f82dd2232e tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] validate_networks() for [('62ebb3a0-b7ab-42bd-ac4b-910ad62ac496', None, None, None, None, None)] {{(pid=134051) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:45:20.270059 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=5 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:45:20.327653 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=14 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:45:20.382240 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-b870ea05-0d11-47e8-ab99-9e02d8b41053 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Flavor limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:45:20.384250 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-b870ea05-0d11-47e8-ab99-9e02d8b41053 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Image limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:45:20.384761 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-b870ea05-0d11-47e8-ab99-9e02d8b41053 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Flavor pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:45:20.385168 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-b870ea05-0d11-47e8-ab99-9e02d8b41053 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Image pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:45:20.391227 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-b870ea05-0d11-47e8-ab99-9e02d8b41053 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:45:20.401807 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b870ea05-0d11-47e8-ab99-9e02d8b41053 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:20.402339 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b870ea05-0d11-47e8-ab99-9e02d8b41053 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:20.402772 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b870ea05-0d11-47e8-ab99-9e02d8b41053 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:20.403504 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b870ea05-0d11-47e8-ab99-9e02d8b41053 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:20.403957 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b870ea05-0d11-47e8-ab99-9e02d8b41053 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:20.404460 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b870ea05-0d11-47e8-ab99-9e02d8b41053 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:20.426340 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-b870ea05-0d11-47e8-ab99-9e02d8b41053 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Getting quotas for project b105816fd4e54b9da4973ff721e1fb92. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:45:20.431547 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-b870ea05-0d11-47e8-ab99-9e02d8b41053 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Getting quotas for user eb6d1646ec094e3297f6f3c51dd72e85 and project b105816fd4e54b9da4973ff721e1fb92. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:45:20.436537 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=57 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:45:20.448567 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b870ea05-0d11-47e8-ab99-9e02d8b41053 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Going to run 1 instances... {{(pid=134052) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:45:20.451160 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b870ea05-0d11-47e8-ab99-9e02d8b41053 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: cc853ecf-2145-4d0b-a41b-c1d892332490] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134052) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:45:20.505254 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b870ea05-0d11-47e8-ab99-9e02d8b41053 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 10.215728 Aug 27 02:45:20.511542 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 590/1174] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 02:45:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 10223 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:45:20.517877 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-04fcbdad-13a6-4993-9c5c-87a1ecadf3c3 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:20.518699 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-04fcbdad-13a6-4993-9c5c-87a1ecadf3c3 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] [instance: 98a9933e-6c22-491a-90bb-d1d2c0bb7df9] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:20.529184 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-04fcbdad-13a6-4993-9c5c-87a1ecadf3c3 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:20.529864 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-04fcbdad-13a6-4993-9c5c-87a1ecadf3c3 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:20.530396 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-04fcbdad-13a6-4993-9c5c-87a1ecadf3c3 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:20.531129 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-04fcbdad-13a6-4993-9c5c-87a1ecadf3c3 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:20.531999 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-04fcbdad-13a6-4993-9c5c-87a1ecadf3c3 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:20.533208 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-04fcbdad-13a6-4993-9c5c-87a1ecadf3c3 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:20.569163 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=3 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:45:20.763401 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-d1dc8a89-5c0a-4fde-8ebf-c3f82dd2232e tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Flavor limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:45:20.764244 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-d1dc8a89-5c0a-4fde-8ebf-c3f82dd2232e tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Image limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:45:20.764908 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-d1dc8a89-5c0a-4fde-8ebf-c3f82dd2232e tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Flavor pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:45:20.765451 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-d1dc8a89-5c0a-4fde-8ebf-c3f82dd2232e tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Image pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:45:20.766021 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-d1dc8a89-5c0a-4fde-8ebf-c3f82dd2232e tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:45:20.783378 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-04fcbdad-13a6-4993-9c5c-87a1ecadf3c3 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e86c17fe83848e2bc96b7c83ff1cf14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5668e6d96694c62b83f7e8381fe86e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:20.797907 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-04fcbdad-13a6-4993-9c5c-87a1ecadf3c3 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] 10.222.0.70 "GET /compute/v2.1/servers/98a9933e-6c22-491a-90bb-d1d2c0bb7df9" status: 200 len: 1325 microversion: 2.1 time: 0.279014 Aug 27 02:45:20.799851 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 591/1175] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:20 2022] GET /compute/v2.1/servers/98a9933e-6c22-491a-90bb-d1d2c0bb7df9 => generated 1325 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:20.802624 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d1dc8a89-5c0a-4fde-8ebf-c3f82dd2232e tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:20.803117 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d1dc8a89-5c0a-4fde-8ebf-c3f82dd2232e tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:20.803554 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d1dc8a89-5c0a-4fde-8ebf-c3f82dd2232e tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:20.815854 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d1dc8a89-5c0a-4fde-8ebf-c3f82dd2232e tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:20.816403 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d1dc8a89-5c0a-4fde-8ebf-c3f82dd2232e tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:20.816842 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d1dc8a89-5c0a-4fde-8ebf-c3f82dd2232e tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:20.817994 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-110db56c-20d3-436e-9588-cfc6200bfc8f tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:20.818624 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-110db56c-20d3-436e-9588-cfc6200bfc8f tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] [instance: 582ea86f-befd-4c47-95d9-2eba872eb8c8] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:20.834245 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-110db56c-20d3-436e-9588-cfc6200bfc8f tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:20.834890 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-110db56c-20d3-436e-9588-cfc6200bfc8f tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:20.835786 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-110db56c-20d3-436e-9588-cfc6200bfc8f tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:20.836548 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-110db56c-20d3-436e-9588-cfc6200bfc8f tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:20.837554 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-d1dc8a89-5c0a-4fde-8ebf-c3f82dd2232e tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Getting quotas for project 5d563fb57d1644ea9f14603151d0d089. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:45:20.838653 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-110db56c-20d3-436e-9588-cfc6200bfc8f tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:20.839096 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-110db56c-20d3-436e-9588-cfc6200bfc8f tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:20.844001 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-d1dc8a89-5c0a-4fde-8ebf-c3f82dd2232e tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Getting quotas for user a20f8524b5e042fa9968287ab9257c84 and project 5d563fb57d1644ea9f14603151d0d089. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:45:20.863327 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d1dc8a89-5c0a-4fde-8ebf-c3f82dd2232e tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Going to run 3 instances... {{(pid=134051) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:45:20.865772 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d1dc8a89-5c0a-4fde-8ebf-c3f82dd2232e tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] [instance: 4351cb89-8e57-47d5-9870-87a43e21ea57] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134051) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:45:20.933093 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d1dc8a89-5c0a-4fde-8ebf-c3f82dd2232e tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] [instance: 4eaf21fb-2b59-4e0e-abd4-72c8e422534d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=4351cb89-8e57-47d5-9870-87a43e21ea57,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134051) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:45:21.019451 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d1dc8a89-5c0a-4fde-8ebf-c3f82dd2232e tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] [instance: ad971605-1da6-4df8-ae39-be0b82b9dad7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=4eaf21fb-2b59-4e0e-abd4-72c8e422534d,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134051) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:45:21.076724 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-110db56c-20d3-436e-9588-cfc6200bfc8f tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32514a813c0a4031a1d1effc807db17d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe9e2cfe40746dd8af1792468a57a2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:21.095740 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-110db56c-20d3-436e-9588-cfc6200bfc8f tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] 10.222.0.70 "GET /compute/v2.1/servers/582ea86f-befd-4c47-95d9-2eba872eb8c8" status: 200 len: 1369 microversion: 2.1 time: 0.286324 Aug 27 02:45:21.097079 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 592/1176] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:20 2022] GET /compute/v2.1/servers/582ea86f-befd-4c47-95d9-2eba872eb8c8 => generated 1369 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:21.102929 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5031c427-aa7f-4c2a-b161-27cf1a34c100 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:21.103585 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-5031c427-aa7f-4c2a-b161-27cf1a34c100 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: f620f083-7230-471a-87d0-f6d85f8ad087] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:21.127115 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5031c427-aa7f-4c2a-b161-27cf1a34c100 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:21.128132 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5031c427-aa7f-4c2a-b161-27cf1a34c100 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:21.128788 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5031c427-aa7f-4c2a-b161-27cf1a34c100 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:21.130010 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5031c427-aa7f-4c2a-b161-27cf1a34c100 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:21.130617 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5031c427-aa7f-4c2a-b161-27cf1a34c100 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:21.132159 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5031c427-aa7f-4c2a-b161-27cf1a34c100 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:21.142109 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d1dc8a89-5c0a-4fde-8ebf-c3f82dd2232e tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 10.683820 Aug 27 02:45:21.143186 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 585/1177] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 02:45:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 10686 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:45:21.148127 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a08792e9-c762-4ba6-be74-b62ccc551bf1 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:21.149642 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-a08792e9-c762-4ba6-be74-b62ccc551bf1 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] [instance: a00dd6f6-d48c-4938-84b1-71bec3877ad9] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:21.156954 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a08792e9-c762-4ba6-be74-b62ccc551bf1 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:21.158188 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a08792e9-c762-4ba6-be74-b62ccc551bf1 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:21.158835 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a08792e9-c762-4ba6-be74-b62ccc551bf1 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:21.160528 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a08792e9-c762-4ba6-be74-b62ccc551bf1 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:21.161204 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a08792e9-c762-4ba6-be74-b62ccc551bf1 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:21.161947 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a08792e9-c762-4ba6-be74-b62ccc551bf1 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:21.541311 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-5031c427-aa7f-4c2a-b161-27cf1a34c100 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:21.551733 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-5031c427-aa7f-4c2a-b161-27cf1a34c100 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:21.553759 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-5031c427-aa7f-4c2a-b161-27cf1a34c100 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:21.555315 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-5031c427-aa7f-4c2a-b161-27cf1a34c100 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/f620f083-7230-471a-87d0-f6d85f8ad087" status: 200 len: 1281 microversion: 2.25 time: 0.457143 Aug 27 02:45:21.557976 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 593/1178] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:45:21 2022] GET /compute/v2.1/servers/f620f083-7230-471a-87d0-f6d85f8ad087 => generated 1281 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:45:21.562010 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-a08792e9-c762-4ba6-be74-b62ccc551bf1 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfec6c2f34f94d66ab1cc982c5bb5bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256b67be18c246b186e09a313db08a7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:21.577922 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-5cb339ff-5109-40e0-8a3c-5cd0fbc601fc req-883cbf8c-7569-4e04-8742-76277dce11a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "582ea86f-befd-4c47-95d9-2eba872eb8c8", "tag": "b922fb84-aa28-4e90-bfa4-e07f1dd81a47"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:45:21.579821 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a08792e9-c762-4ba6-be74-b62ccc551bf1 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] 10.222.0.70 "GET /compute/v2.1/servers/a00dd6f6-d48c-4938-84b1-71bec3877ad9" status: 200 len: 1367 microversion: 2.1 time: 0.435383 Aug 27 02:45:21.581104 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 586/1179] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:21 2022] GET /compute/v2.1/servers/a00dd6f6-d48c-4938-84b1-71bec3877ad9 => generated 1367 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:21.599367 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-edf5157c-8357-4b3e-bef3-e416b2f81d3e req-90b1c7d6-3b36-4442-b813-c7165bf6c190 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98a9933e-6c22-491a-90bb-d1d2c0bb7df9", "name": "network-vif-plugged", "status": "completed", "tag": "bb051cf4-2ed9-43d4-ae67-717a893d0979"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:45:21.610197 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-5cb339ff-5109-40e0-8a3c-5cd0fbc601fc req-883cbf8c-7569-4e04-8742-76277dce11a6 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:21.610767 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-5cb339ff-5109-40e0-8a3c-5cd0fbc601fc req-883cbf8c-7569-4e04-8742-76277dce11a6 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:21.611223 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-5cb339ff-5109-40e0-8a3c-5cd0fbc601fc req-883cbf8c-7569-4e04-8742-76277dce11a6 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:21.618557 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-edf5157c-8357-4b3e-bef3-e416b2f81d3e req-90b1c7d6-3b36-4442-b813-c7165bf6c190 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:21.619038 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-edf5157c-8357-4b3e-bef3-e416b2f81d3e req-90b1c7d6-3b36-4442-b813-c7165bf6c190 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:21.620545 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-edf5157c-8357-4b3e-bef3-e416b2f81d3e req-90b1c7d6-3b36-4442-b813-c7165bf6c190 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:21.641134 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-5cb339ff-5109-40e0-8a3c-5cd0fbc601fc req-883cbf8c-7569-4e04-8742-76277dce11a6 service nova] Creating event network-changed:b922fb84-aa28-4e90-bfa4-e07f1dd81a47 for instance 582ea86f-befd-4c47-95d9-2eba872eb8c8 on n-h1-852278-4 Aug 27 02:45:21.650235 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-edf5157c-8357-4b3e-bef3-e416b2f81d3e req-90b1c7d6-3b36-4442-b813-c7165bf6c190 service nova] Creating event network-vif-plugged:bb051cf4-2ed9-43d4-ae67-717a893d0979 for instance 98a9933e-6c22-491a-90bb-d1d2c0bb7df9 on n-h1-852278-4 Aug 27 02:45:21.659282 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-5cb339ff-5109-40e0-8a3c-5cd0fbc601fc req-883cbf8c-7569-4e04-8742-76277dce11a6 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097751 Aug 27 02:45:21.660184 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 594/1180] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:45:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:45:21.671964 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-edf5157c-8357-4b3e-bef3-e416b2f81d3e req-90b1c7d6-3b36-4442-b813-c7165bf6c190 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088324 Aug 27 02:45:21.673421 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 587/1181] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:45:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:45:21.675496 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-93836a75-792d-4f88-96c0-80dbfea36b65 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:21.676628 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-93836a75-792d-4f88-96c0-80dbfea36b65 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: cc853ecf-2145-4d0b-a41b-c1d892332490] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:21.686216 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-93836a75-792d-4f88-96c0-80dbfea36b65 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:21.686930 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-93836a75-792d-4f88-96c0-80dbfea36b65 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:21.687546 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-93836a75-792d-4f88-96c0-80dbfea36b65 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:21.688454 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-93836a75-792d-4f88-96c0-80dbfea36b65 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:21.688851 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-40ef8843-d8c0-4437-8b3c-d897db341112 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:21.689235 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-93836a75-792d-4f88-96c0-80dbfea36b65 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:21.689816 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-93836a75-792d-4f88-96c0-80dbfea36b65 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:21.705369 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-40ef8843-d8c0-4437-8b3c-d897db341112 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a20f8524b5e042fa9968287ab9257c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d563fb57d1644ea9f14603151d0d089', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:21.707831 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-40ef8843-d8c0-4437-8b3c-d897db341112 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Searching by: {'deleted': False, 'project_id': '5d563fb57d1644ea9f14603151d0d089'} {{(pid=134051) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 02:45:21.760161 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-40ef8843-d8c0-4437-8b3c-d897db341112 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:21.761046 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-40ef8843-d8c0-4437-8b3c-d897db341112 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:21.763049 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-93836a75-792d-4f88-96c0-80dbfea36b65 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6d1646ec094e3297f6f3c51dd72e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b105816fd4e54b9da4973ff721e1fb92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:21.766769 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-40ef8843-d8c0-4437-8b3c-d897db341112 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:21.775135 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-93836a75-792d-4f88-96c0-80dbfea36b65 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "GET /compute/v2.1/servers/cc853ecf-2145-4d0b-a41b-c1d892332490" status: 200 len: 1213 microversion: 2.1 time: 0.113381 Aug 27 02:45:21.775624 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-40ef8843-d8c0-4437-8b3c-d897db341112 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:21.777175 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-40ef8843-d8c0-4437-8b3c-d897db341112 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:21.778937 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 595/1182] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:21 2022] GET /compute/v2.1/servers/cc853ecf-2145-4d0b-a41b-c1d892332490 => generated 1213 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:21.779270 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-40ef8843-d8c0-4437-8b3c-d897db341112 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:21.819621 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-11f6f6f6-48e5-4f31-a3b8-4f963367711f tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:21.820819 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-11f6f6f6-48e5-4f31-a3b8-4f963367711f tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] [instance: 98a9933e-6c22-491a-90bb-d1d2c0bb7df9] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:21.834244 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-11f6f6f6-48e5-4f31-a3b8-4f963367711f tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:21.834747 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-11f6f6f6-48e5-4f31-a3b8-4f963367711f tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:21.835187 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-11f6f6f6-48e5-4f31-a3b8-4f963367711f tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:21.835902 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-11f6f6f6-48e5-4f31-a3b8-4f963367711f tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:21.847704 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-11f6f6f6-48e5-4f31-a3b8-4f963367711f tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:21.848171 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-11f6f6f6-48e5-4f31-a3b8-4f963367711f tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:21.851085 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-40ef8843-d8c0-4437-8b3c-d897db341112 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] 10.222.0.70 "GET /compute/v2.1/servers" status: 200 len: 1018 microversion: 2.1 time: 0.174160 Aug 27 02:45:21.864982 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 588/1183] 10.222.0.70 () {58 vars in 1125 bytes} [Sat Aug 27 02:45:21 2022] GET /compute/v2.1/servers => generated 1018 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:21.878079 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c18b0f21-84dd-4ddf-8d32-2f9594fd652c tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:21.879476 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-c18b0f21-84dd-4ddf-8d32-2f9594fd652c tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] [instance: ad971605-1da6-4df8-ae39-be0b82b9dad7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:22.187412 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-c18b0f21-84dd-4ddf-8d32-2f9594fd652c tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20f8524b5e042fa9968287ab9257c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d563fb57d1644ea9f14603151d0d089', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:22.212603 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c18b0f21-84dd-4ddf-8d32-2f9594fd652c tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] 10.222.0.70 "GET /compute/v2.1/servers/ad971605-1da6-4df8-ae39-be0b82b9dad7" status: 200 len: 1223 microversion: 2.1 time: 0.330931 Aug 27 02:45:22.214930 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 589/1184] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:21 2022] GET /compute/v2.1/servers/ad971605-1da6-4df8-ae39-be0b82b9dad7 => generated 1223 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:45:22.226871 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-6e0bcf80-ec63-44b4-ae1a-dad8f17f3db5 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:22.227923 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-6e0bcf80-ec63-44b4-ae1a-dad8f17f3db5 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] [instance: 582ea86f-befd-4c47-95d9-2eba872eb8c8] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:22.254007 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6e0bcf80-ec63-44b4-ae1a-dad8f17f3db5 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:22.260029 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6e0bcf80-ec63-44b4-ae1a-dad8f17f3db5 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:22.262671 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6e0bcf80-ec63-44b4-ae1a-dad8f17f3db5 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:22.265484 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6e0bcf80-ec63-44b4-ae1a-dad8f17f3db5 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:22.265960 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6e0bcf80-ec63-44b4-ae1a-dad8f17f3db5 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:22.267597 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6e0bcf80-ec63-44b4-ae1a-dad8f17f3db5 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:22.356928 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-11f6f6f6-48e5-4f31-a3b8-4f963367711f tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e86c17fe83848e2bc96b7c83ff1cf14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5668e6d96694c62b83f7e8381fe86e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:22.367848 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-11f6f6f6-48e5-4f31-a3b8-4f963367711f tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] 10.222.0.70 "GET /compute/v2.1/servers/98a9933e-6c22-491a-90bb-d1d2c0bb7df9" status: 200 len: 1325 microversion: 2.1 time: 0.552457 Aug 27 02:45:22.372278 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 596/1185] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:21 2022] GET /compute/v2.1/servers/98a9933e-6c22-491a-90bb-d1d2c0bb7df9 => generated 1325 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:45:22.579580 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-14926d36-4545-4d5e-a448-85d4e760ae69 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:22.581128 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-14926d36-4545-4d5e-a448-85d4e760ae69 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: f620f083-7230-471a-87d0-f6d85f8ad087] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:22.588431 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-14926d36-4545-4d5e-a448-85d4e760ae69 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:22.592960 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-14926d36-4545-4d5e-a448-85d4e760ae69 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:22.593821 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-14926d36-4545-4d5e-a448-85d4e760ae69 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:22.594833 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-14926d36-4545-4d5e-a448-85d4e760ae69 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:22.596716 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-14926d36-4545-4d5e-a448-85d4e760ae69 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:22.597552 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-14926d36-4545-4d5e-a448-85d4e760ae69 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:22.962905 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-6e0bcf80-ec63-44b4-ae1a-dad8f17f3db5 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32514a813c0a4031a1d1effc807db17d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe9e2cfe40746dd8af1792468a57a2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:22.974443 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-6e0bcf80-ec63-44b4-ae1a-dad8f17f3db5 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] 10.222.0.70 "GET /compute/v2.1/servers/582ea86f-befd-4c47-95d9-2eba872eb8c8" status: 200 len: 1369 microversion: 2.1 time: 0.756305 Aug 27 02:45:22.975269 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 590/1186] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:22 2022] GET /compute/v2.1/servers/582ea86f-befd-4c47-95d9-2eba872eb8c8 => generated 1369 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:22.979981 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3ac8fd84-84e1-4291-a4a9-15a537115305 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:22.981409 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-3ac8fd84-84e1-4291-a4a9-15a537115305 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] [instance: a00dd6f6-d48c-4938-84b1-71bec3877ad9] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:23.003116 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3ac8fd84-84e1-4291-a4a9-15a537115305 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:23.003630 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3ac8fd84-84e1-4291-a4a9-15a537115305 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:23.004073 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3ac8fd84-84e1-4291-a4a9-15a537115305 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:23.004818 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3ac8fd84-84e1-4291-a4a9-15a537115305 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:23.005269 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3ac8fd84-84e1-4291-a4a9-15a537115305 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:23.005690 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3ac8fd84-84e1-4291-a4a9-15a537115305 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:23.235027 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-14926d36-4545-4d5e-a448-85d4e760ae69 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:23.249075 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-14926d36-4545-4d5e-a448-85d4e760ae69 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:23.250543 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-14926d36-4545-4d5e-a448-85d4e760ae69 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:23.257534 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-14926d36-4545-4d5e-a448-85d4e760ae69 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/f620f083-7230-471a-87d0-f6d85f8ad087" status: 200 len: 1281 microversion: 2.25 time: 0.682066 Aug 27 02:45:23.273340 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 597/1187] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:45:22 2022] GET /compute/v2.1/servers/f620f083-7230-471a-87d0-f6d85f8ad087 => generated 1281 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:45:23.285904 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6369d6fb-9f15-4583-b53e-e032aac29bfd tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:23.287000 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-6369d6fb-9f15-4583-b53e-e032aac29bfd tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: cc853ecf-2145-4d0b-a41b-c1d892332490] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:23.303028 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6369d6fb-9f15-4583-b53e-e032aac29bfd tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:23.311270 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6369d6fb-9f15-4583-b53e-e032aac29bfd tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:23.312036 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6369d6fb-9f15-4583-b53e-e032aac29bfd tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:23.313026 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6369d6fb-9f15-4583-b53e-e032aac29bfd tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:23.313675 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6369d6fb-9f15-4583-b53e-e032aac29bfd tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:23.314345 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6369d6fb-9f15-4583-b53e-e032aac29bfd tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:23.760576 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-6369d6fb-9f15-4583-b53e-e032aac29bfd tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6d1646ec094e3297f6f3c51dd72e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b105816fd4e54b9da4973ff721e1fb92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:23.784967 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-6369d6fb-9f15-4583-b53e-e032aac29bfd tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "GET /compute/v2.1/servers/cc853ecf-2145-4d0b-a41b-c1d892332490" status: 200 len: 1269 microversion: 2.1 time: 0.510280 Aug 27 02:45:23.791882 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 598/1188] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:23 2022] GET /compute/v2.1/servers/cc853ecf-2145-4d0b-a41b-c1d892332490 => generated 1269 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:23.805153 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3a18108d-7b58-4ac9-bd67-ff75ee8d1ba7 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:23.805810 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-3a18108d-7b58-4ac9-bd67-ff75ee8d1ba7 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] [instance: ad971605-1da6-4df8-ae39-be0b82b9dad7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:23.828841 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3a18108d-7b58-4ac9-bd67-ff75ee8d1ba7 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:23.830252 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3a18108d-7b58-4ac9-bd67-ff75ee8d1ba7 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:23.835733 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3a18108d-7b58-4ac9-bd67-ff75ee8d1ba7 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:23.841827 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3a18108d-7b58-4ac9-bd67-ff75ee8d1ba7 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:23.844106 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3a18108d-7b58-4ac9-bd67-ff75ee8d1ba7 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:23.845487 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-3ac8fd84-84e1-4291-a4a9-15a537115305 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfec6c2f34f94d66ab1cc982c5bb5bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256b67be18c246b186e09a313db08a7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:23.846844 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3a18108d-7b58-4ac9-bd67-ff75ee8d1ba7 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:23.873449 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-3ac8fd84-84e1-4291-a4a9-15a537115305 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] 10.222.0.70 "GET /compute/v2.1/servers/a00dd6f6-d48c-4938-84b1-71bec3877ad9" status: 200 len: 1367 microversion: 2.1 time: 0.896893 Aug 27 02:45:23.878911 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 591/1189] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:22 2022] GET /compute/v2.1/servers/a00dd6f6-d48c-4938-84b1-71bec3877ad9 => generated 1367 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:23.899025 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c3b5ac87-7e58-44b8-a27f-31aa9a12554d tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:23.899669 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-c3b5ac87-7e58-44b8-a27f-31aa9a12554d tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] [instance: 98a9933e-6c22-491a-90bb-d1d2c0bb7df9] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:23.933329 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c3b5ac87-7e58-44b8-a27f-31aa9a12554d tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:23.933864 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c3b5ac87-7e58-44b8-a27f-31aa9a12554d tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:23.934368 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c3b5ac87-7e58-44b8-a27f-31aa9a12554d tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:23.942496 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c3b5ac87-7e58-44b8-a27f-31aa9a12554d tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:23.943026 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c3b5ac87-7e58-44b8-a27f-31aa9a12554d tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:23.943474 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c3b5ac87-7e58-44b8-a27f-31aa9a12554d tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:24.353783 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-3a18108d-7b58-4ac9-bd67-ff75ee8d1ba7 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20f8524b5e042fa9968287ab9257c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d563fb57d1644ea9f14603151d0d089', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:24.373206 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-3a18108d-7b58-4ac9-bd67-ff75ee8d1ba7 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] 10.222.0.70 "GET /compute/v2.1/servers/ad971605-1da6-4df8-ae39-be0b82b9dad7" status: 200 len: 1219 microversion: 2.1 time: 0.569617 Aug 27 02:45:24.394163 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 599/1190] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:23 2022] GET /compute/v2.1/servers/ad971605-1da6-4df8-ae39-be0b82b9dad7 => generated 1219 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:24.559963 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-686dc12e-c8c3-464d-a283-3d7d1f882418 req-4f3587a1-92a3-4f32-ae75-ede16c438fdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a00dd6f6-d48c-4938-84b1-71bec3877ad9", "name": "network-vif-plugged", "status": "completed", "tag": "829c63ac-805f-401e-b2ab-43eae4e821bb"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:45:24.595129 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-686dc12e-c8c3-464d-a283-3d7d1f882418 req-4f3587a1-92a3-4f32-ae75-ede16c438fdf service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:24.595899 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-686dc12e-c8c3-464d-a283-3d7d1f882418 req-4f3587a1-92a3-4f32-ae75-ede16c438fdf service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:24.596477 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-686dc12e-c8c3-464d-a283-3d7d1f882418 req-4f3587a1-92a3-4f32-ae75-ede16c438fdf service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:24.624361 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-686dc12e-c8c3-464d-a283-3d7d1f882418 req-4f3587a1-92a3-4f32-ae75-ede16c438fdf service nova] Creating event network-vif-plugged:829c63ac-805f-401e-b2ab-43eae4e821bb for instance a00dd6f6-d48c-4938-84b1-71bec3877ad9 on n-h2-852278-4 Aug 27 02:45:24.635621 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-686dc12e-c8c3-464d-a283-3d7d1f882418 req-4f3587a1-92a3-4f32-ae75-ede16c438fdf service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.239424 Aug 27 02:45:24.638253 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 600/1191] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:45:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:45:24.658357 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-dd6f3724-c9a8-4e95-88ab-81bf1452cc64 req-81909104-ab15-49c7-98fc-b2da8d6a2d99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f620f083-7230-471a-87d0-f6d85f8ad087", "tag": "9bf0e2d8-ba4e-4067-bcf4-ca6ddddb7811"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:45:24.683911 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-dd6f3724-c9a8-4e95-88ab-81bf1452cc64 req-81909104-ab15-49c7-98fc-b2da8d6a2d99 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:24.685078 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-dd6f3724-c9a8-4e95-88ab-81bf1452cc64 req-81909104-ab15-49c7-98fc-b2da8d6a2d99 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:24.685777 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-dd6f3724-c9a8-4e95-88ab-81bf1452cc64 req-81909104-ab15-49c7-98fc-b2da8d6a2d99 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:24.708563 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-dd6f3724-c9a8-4e95-88ab-81bf1452cc64 req-81909104-ab15-49c7-98fc-b2da8d6a2d99 service nova] Creating event network-changed:9bf0e2d8-ba4e-4067-bcf4-ca6ddddb7811 for instance f620f083-7230-471a-87d0-f6d85f8ad087 on n-h2-852278-4 Aug 27 02:45:24.714800 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-dd6f3724-c9a8-4e95-88ab-81bf1452cc64 req-81909104-ab15-49c7-98fc-b2da8d6a2d99 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074698 Aug 27 02:45:24.716143 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 601/1192] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:45:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:45:24.721961 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8b5c9664-9a36-4844-af7b-727bcee1e02b tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:24.722973 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-8b5c9664-9a36-4844-af7b-727bcee1e02b tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] [instance: 582ea86f-befd-4c47-95d9-2eba872eb8c8] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:24.738683 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8b5c9664-9a36-4844-af7b-727bcee1e02b tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:24.739475 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8b5c9664-9a36-4844-af7b-727bcee1e02b tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:24.740835 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8b5c9664-9a36-4844-af7b-727bcee1e02b tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:24.741667 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8b5c9664-9a36-4844-af7b-727bcee1e02b tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:24.742344 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8b5c9664-9a36-4844-af7b-727bcee1e02b tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:24.743153 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8b5c9664-9a36-4844-af7b-727bcee1e02b tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:24.875571 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-c3b5ac87-7e58-44b8-a27f-31aa9a12554d tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e86c17fe83848e2bc96b7c83ff1cf14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5668e6d96694c62b83f7e8381fe86e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:24.923930 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c3b5ac87-7e58-44b8-a27f-31aa9a12554d tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] 10.222.0.70 "GET /compute/v2.1/servers/98a9933e-6c22-491a-90bb-d1d2c0bb7df9" status: 200 len: 1522 microversion: 2.1 time: 1.043866 Aug 27 02:45:24.940581 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 592/1193] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:23 2022] GET /compute/v2.1/servers/98a9933e-6c22-491a-90bb-d1d2c0bb7df9 => generated 1522 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:24.957269 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-20003f37-6387-4342-8c4c-a32075ae198d tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:24.957889 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-20003f37-6387-4342-8c4c-a32075ae198d tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: f620f083-7230-471a-87d0-f6d85f8ad087] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:24.972943 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-20003f37-6387-4342-8c4c-a32075ae198d tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:24.978365 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-20003f37-6387-4342-8c4c-a32075ae198d tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:24.979834 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-20003f37-6387-4342-8c4c-a32075ae198d tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:24.982120 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-20003f37-6387-4342-8c4c-a32075ae198d tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:24.983142 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-20003f37-6387-4342-8c4c-a32075ae198d tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:24.983844 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-20003f37-6387-4342-8c4c-a32075ae198d tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:26.084274 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-20003f37-6387-4342-8c4c-a32075ae198d tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:26.101291 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-20003f37-6387-4342-8c4c-a32075ae198d tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:26.108122 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-20003f37-6387-4342-8c4c-a32075ae198d tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:26.111008 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-20003f37-6387-4342-8c4c-a32075ae198d tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/f620f083-7230-471a-87d0-f6d85f8ad087" status: 200 len: 1281 microversion: 2.25 time: 1.168561 Aug 27 02:45:26.112817 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 593/1194] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:45:24 2022] GET /compute/v2.1/servers/f620f083-7230-471a-87d0-f6d85f8ad087 => generated 1281 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:45:26.125493 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-59971eef-63b5-4b96-a1cf-92c286a56dc1 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:26.126557 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-59971eef-63b5-4b96-a1cf-92c286a56dc1 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: cc853ecf-2145-4d0b-a41b-c1d892332490] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:26.141501 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-8b5c9664-9a36-4844-af7b-727bcee1e02b tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32514a813c0a4031a1d1effc807db17d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe9e2cfe40746dd8af1792468a57a2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:26.144016 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-59971eef-63b5-4b96-a1cf-92c286a56dc1 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:26.144868 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-59971eef-63b5-4b96-a1cf-92c286a56dc1 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:26.146352 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-59971eef-63b5-4b96-a1cf-92c286a56dc1 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:26.147327 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-59971eef-63b5-4b96-a1cf-92c286a56dc1 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:26.149238 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-59971eef-63b5-4b96-a1cf-92c286a56dc1 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:26.152115 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-59971eef-63b5-4b96-a1cf-92c286a56dc1 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:26.154290 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-8b5c9664-9a36-4844-af7b-727bcee1e02b tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] 10.222.0.70 "GET /compute/v2.1/servers/582ea86f-befd-4c47-95d9-2eba872eb8c8" status: 200 len: 1369 microversion: 2.1 time: 1.436566 Aug 27 02:45:26.172495 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 602/1195] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:24 2022] GET /compute/v2.1/servers/582ea86f-befd-4c47-95d9-2eba872eb8c8 => generated 1369 bytes in 1454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:26.177310 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8a352bdd-070a-4316-a264-57ac9216c8e8 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:26.180193 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-8a352bdd-070a-4316-a264-57ac9216c8e8 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] [instance: a00dd6f6-d48c-4938-84b1-71bec3877ad9] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:26.207411 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8a352bdd-070a-4316-a264-57ac9216c8e8 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:26.207765 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8a352bdd-070a-4316-a264-57ac9216c8e8 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:26.208209 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8a352bdd-070a-4316-a264-57ac9216c8e8 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:26.209087 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8a352bdd-070a-4316-a264-57ac9216c8e8 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:26.209923 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8a352bdd-070a-4316-a264-57ac9216c8e8 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:26.210505 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8a352bdd-070a-4316-a264-57ac9216c8e8 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:26.415299 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-59971eef-63b5-4b96-a1cf-92c286a56dc1 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6d1646ec094e3297f6f3c51dd72e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b105816fd4e54b9da4973ff721e1fb92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:26.427432 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-59971eef-63b5-4b96-a1cf-92c286a56dc1 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "GET /compute/v2.1/servers/cc853ecf-2145-4d0b-a41b-c1d892332490" status: 200 len: 1275 microversion: 2.1 time: 0.312075 Aug 27 02:45:26.446273 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 594/1196] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:26 2022] GET /compute/v2.1/servers/cc853ecf-2145-4d0b-a41b-c1d892332490 => generated 1275 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:26.453959 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c9e561cc-d4f4-407f-99fe-5edebe83841e tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:26.457008 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-c9e561cc-d4f4-407f-99fe-5edebe83841e tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] [instance: 98a9933e-6c22-491a-90bb-d1d2c0bb7df9] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:26.465555 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c9e561cc-d4f4-407f-99fe-5edebe83841e tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:26.466324 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c9e561cc-d4f4-407f-99fe-5edebe83841e tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:26.466996 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c9e561cc-d4f4-407f-99fe-5edebe83841e tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:26.467964 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c9e561cc-d4f4-407f-99fe-5edebe83841e tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:26.468628 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c9e561cc-d4f4-407f-99fe-5edebe83841e tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:26.469416 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c9e561cc-d4f4-407f-99fe-5edebe83841e tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:26.933041 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-8a352bdd-070a-4316-a264-57ac9216c8e8 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfec6c2f34f94d66ab1cc982c5bb5bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256b67be18c246b186e09a313db08a7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:26.952714 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-8a352bdd-070a-4316-a264-57ac9216c8e8 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] 10.222.0.70 "GET /compute/v2.1/servers/a00dd6f6-d48c-4938-84b1-71bec3877ad9" status: 200 len: 1367 microversion: 2.1 time: 0.780291 Aug 27 02:45:26.966523 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 603/1197] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:26 2022] GET /compute/v2.1/servers/a00dd6f6-d48c-4938-84b1-71bec3877ad9 => generated 1367 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:26.968108 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-af7801b2-482e-421b-9eec-cea7c5193030 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:26.970239 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-af7801b2-482e-421b-9eec-cea7c5193030 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] [instance: ad971605-1da6-4df8-ae39-be0b82b9dad7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:26.990496 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-af7801b2-482e-421b-9eec-cea7c5193030 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:26.990987 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-af7801b2-482e-421b-9eec-cea7c5193030 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:26.991427 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-af7801b2-482e-421b-9eec-cea7c5193030 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:26.992130 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-af7801b2-482e-421b-9eec-cea7c5193030 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:26.993196 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-af7801b2-482e-421b-9eec-cea7c5193030 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:26.993838 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-af7801b2-482e-421b-9eec-cea7c5193030 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:26.997953 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-c9e561cc-d4f4-407f-99fe-5edebe83841e tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e86c17fe83848e2bc96b7c83ff1cf14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5668e6d96694c62b83f7e8381fe86e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:27.011229 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c9e561cc-d4f4-407f-99fe-5edebe83841e tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] 10.222.0.70 "GET /compute/v2.1/servers/98a9933e-6c22-491a-90bb-d1d2c0bb7df9" status: 200 len: 1522 microversion: 2.1 time: 0.563716 Aug 27 02:45:27.012101 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 595/1198] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:26 2022] GET /compute/v2.1/servers/98a9933e-6c22-491a-90bb-d1d2c0bb7df9 => generated 1522 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:27.033057 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-1160daf9-ea2b-4463-b923-9849c6b04ec9 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1395699283", "metadata": {"": ""}}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:45:27.054997 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-1160daf9-ea2b-4463-b923-9849c6b04ec9 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Request method failure captured: Aug 27 02:45:27.054997 n-d-852278-4 devstack@n-api.service[134051]: request: POST /compute/v2.1/servers/98a9933e-6c22-491a-90bb-d1d2c0bb7df9/action HTTP/1.1 Aug 27 02:45:27.054997 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:45:27.054997 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:45:27.054997 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:45:27.054997 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 107 Aug 27 02:45:27.054997 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:45:27.054997 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:45:27.054997 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:45:27.054997 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:45:27.054997 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYUqULQp-YhXHHCl2hngi9BMJm7wP1pGZCcaxudoyUu4YXudXmRdmBYAkbX0-TS9pqFDwaRuY82uqdOXUJwRWB1ajZ46tfQo1tc4MJsIVgVqim1Pvb2Il-ejDehbyoer8P643aveyI0JrfbznxBx8aFYmMJz3n8FX81wfpLT5u3cMYE Aug 27 02:45:27.054997 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:45:27.054997 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:45:27.054997 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:45:27.054997 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:45:27.054997 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:45:27.054997 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:45:27.054997 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: f5668e6d96694c62b83f7e8381fe86e1 Aug 27 02:45:27.054997 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-94227302 Aug 27 02:45:27.054997 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:45:27.054997 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:45:27.056915 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f5668e6d96694c62b83f7e8381fe86e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f5668e6d96694c62b83f7e8381fe86e1", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f5668e6d96694c62b83f7e8381fe86e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f5668e6d96694c62b83f7e8381fe86e1"}]}] Aug 27 02:45:27.056915 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-94227302 Aug 27 02:45:27.056915 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: f5668e6d96694c62b83f7e8381fe86e1 Aug 27 02:45:27.056915 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-94227302 Aug 27 02:45:27.056915 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ImagesOneServerNegativeTestJSON-94227302-project Aug 27 02:45:27.056915 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:45:27.056915 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:45:27.056915 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 0e86c17fe83848e2bc96b7c83ff1cf14 Aug 27 02:45:27.056915 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-94227302-project Aug 27 02:45:27.056915 n-d-852278-4 devstack@n-api.service[134051]: Aug 27 02:45:27.056915 n-d-852278-4 devstack@n-api.service[134051]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1395699283", "metadata": {"": ""}}} Aug 27 02:45:27.056915 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 02:45:27.058350 n-d-852278-4 devstack@n-api.service[134051]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 02:45:27.058350 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '98a9933e-6c22-491a-90bb-d1d2c0bb7df9', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1395699283', 'metadata': {'': ''}}}} Aug 27 02:45:27.058350 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:45:27.058350 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:27.058350 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 02:45:27.058350 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 02:45:27.058350 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 02:45:27.058350 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise error Aug 27 02:45:27.058350 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 02:45:27.058350 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:45:27.058350 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Aug 27 02:45:27.058350 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 27 02:45:27.058350 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 27 02:45:27.058350 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 27 02:45:27.058350 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 27 02:45:27.058350 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:45:27.058350 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi On instance['createImage']: Aug 27 02:45:27.058350 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi {'': ''} Aug 27 02:45:27.058350 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:45:27.058350 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:45:27.058350 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:45:27.060061 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:27.060061 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:45:27.060061 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:45:27.060061 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:45:27.060061 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:45:27.060061 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:45:27.060061 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:45:27.060061 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:45:27.060061 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:45:27.060061 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 02:45:27.060061 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 02:45:27.060061 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 02:45:27.060061 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 02:45:27.060061 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 02:45:27.060061 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 02:45:27.060061 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 02:45:27.060061 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:45:27.060061 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:45:27.060061 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:45:27.060061 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:27.062083 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:45:27.062083 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:45:27.062083 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 02:45:27.062083 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 02:45:27.062083 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 02:45:27.062083 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:45:27.065474 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-1160daf9-ea2b-4463-b923-9849c6b04ec9 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:45:27.067235 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-1160daf9-ea2b-4463-b923-9849c6b04ec9 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] 10.222.0.70 "POST /compute/v2.1/servers/98a9933e-6c22-491a-90bb-d1d2c0bb7df9/action" status: 400 len: 170 microversion: 2.1 time: 0.038944 Aug 27 02:45:27.070932 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 596/1199] 10.222.0.70 () {60 vars in 1279 bytes} [Sat Aug 27 02:45:27 2022] POST /compute/v2.1/servers/98a9933e-6c22-491a-90bb-d1d2c0bb7df9/action => generated 170 bytes in 43 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 27 02:45:27.080275 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-5a4544ef-c3a2-4984-9925-12a6df5acd36 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Action: 'create', calling method: .version_select at 0x7f5eded219d0>, body: {"keypair": {"name": "tempest-keypair-1303823778", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDjDpat450w565pdCjS8K+HDWvDWuimZwgCkGdoffJtOk+EOyTHwNvuwH/G1wRvorFZ2JruFgmrLQEOMRZXjSXeI1xHcF4Xppwescko5gXVK5I2YnUt9eEwpJii2tfGThw=="}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:45:27.110148 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-5a4544ef-c3a2-4984-9925-12a6df5acd36 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Getting quotas for project ae35c895f49f4d31a4137dd3392f65bf. Resources: {'key_pairs'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:45:27.127029 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-5a4544ef-c3a2-4984-9925-12a6df5acd36 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Getting quotas for user 585803c75b454475993d2189c88cc6d7 and project ae35c895f49f4d31a4137dd3392f65bf. Resources: {'key_pairs'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:45:27.137005 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-af7801b2-482e-421b-9eec-cea7c5193030 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20f8524b5e042fa9968287ab9257c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d563fb57d1644ea9f14603151d0d089', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:27.151448 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-af7801b2-482e-421b-9eec-cea7c5193030 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] 10.222.0.70 "GET /compute/v2.1/servers/ad971605-1da6-4df8-ae39-be0b82b9dad7" status: 200 len: 1281 microversion: 2.1 time: 0.188432 Aug 27 02:45:27.152899 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 604/1200] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:26 2022] GET /compute/v2.1/servers/ad971605-1da6-4df8-ae39-be0b82b9dad7 => generated 1281 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:27.166857 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-fdda42da-d0d6-4548-b29d-74a013452415 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:27.170018 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-fdda42da-d0d6-4548-b29d-74a013452415 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] [instance: 98a9933e-6c22-491a-90bb-d1d2c0bb7df9] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:27.182070 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fdda42da-d0d6-4548-b29d-74a013452415 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:27.186383 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fdda42da-d0d6-4548-b29d-74a013452415 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:27.187114 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fdda42da-d0d6-4548-b29d-74a013452415 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:27.189429 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fdda42da-d0d6-4548-b29d-74a013452415 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:27.191909 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fdda42da-d0d6-4548-b29d-74a013452415 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:27.192618 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fdda42da-d0d6-4548-b29d-74a013452415 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:27.202320 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-5a4544ef-c3a2-4984-9925-12a6df5acd36 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.129105 Aug 27 02:45:27.206799 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 597/1201] 10.222.0.70 () {62 vars in 1200 bytes} [Sat Aug 27 02:45:27 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 135 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 27 02:45:27.215206 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-217f7894-8799-42d5-a146-ec81eeeb8865 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:27.215844 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-217f7894-8799-42d5-a146-ec81eeeb8865 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: f620f083-7230-471a-87d0-f6d85f8ad087] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:27.228076 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-217f7894-8799-42d5-a146-ec81eeeb8865 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:27.230693 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-217f7894-8799-42d5-a146-ec81eeeb8865 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:27.231133 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-217f7894-8799-42d5-a146-ec81eeeb8865 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:27.231880 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-217f7894-8799-42d5-a146-ec81eeeb8865 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:27.232347 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-217f7894-8799-42d5-a146-ec81eeeb8865 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:27.232807 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-217f7894-8799-42d5-a146-ec81eeeb8865 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:28.479691 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-fdda42da-d0d6-4548-b29d-74a013452415 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e86c17fe83848e2bc96b7c83ff1cf14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5668e6d96694c62b83f7e8381fe86e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:28.483504 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-217f7894-8799-42d5-a146-ec81eeeb8865 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:28.507788 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-217f7894-8799-42d5-a146-ec81eeeb8865 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:28.515400 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-217f7894-8799-42d5-a146-ec81eeeb8865 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:28.519925 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-217f7894-8799-42d5-a146-ec81eeeb8865 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/f620f083-7230-471a-87d0-f6d85f8ad087" status: 200 len: 1281 microversion: 2.25 time: 1.312027 Aug 27 02:45:28.520869 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 598/1202] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:45:27 2022] GET /compute/v2.1/servers/f620f083-7230-471a-87d0-f6d85f8ad087 => generated 1281 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:45:28.528355 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0a47153d-a8fe-4fa3-a7ad-9ff46933c5ba tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:28.529801 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-fdda42da-d0d6-4548-b29d-74a013452415 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] 10.222.0.70 "GET /compute/v2.1/servers/98a9933e-6c22-491a-90bb-d1d2c0bb7df9" status: 200 len: 1522 microversion: 2.1 time: 1.374244 Aug 27 02:45:28.534795 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-0a47153d-a8fe-4fa3-a7ad-9ff46933c5ba tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] [instance: 582ea86f-befd-4c47-95d9-2eba872eb8c8] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:28.537082 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 605/1203] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:27 2022] GET /compute/v2.1/servers/98a9933e-6c22-491a-90bb-d1d2c0bb7df9 => generated 1522 bytes in 1382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:28.551472 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0a47153d-a8fe-4fa3-a7ad-9ff46933c5ba tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:28.552275 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0a47153d-a8fe-4fa3-a7ad-9ff46933c5ba tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:28.553136 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0a47153d-a8fe-4fa3-a7ad-9ff46933c5ba tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:28.554439 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0a47153d-a8fe-4fa3-a7ad-9ff46933c5ba tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:28.556553 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-33b82919-c6fd-450a-bbe0-bdccde583d12 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:28.557033 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0a47153d-a8fe-4fa3-a7ad-9ff46933c5ba tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:28.557502 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-33b82919-c6fd-450a-bbe0-bdccde583d12 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: cc853ecf-2145-4d0b-a41b-c1d892332490] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:28.562560 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0a47153d-a8fe-4fa3-a7ad-9ff46933c5ba tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:28.583022 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-33b82919-c6fd-450a-bbe0-bdccde583d12 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:28.583523 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-33b82919-c6fd-450a-bbe0-bdccde583d12 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:28.583953 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-33b82919-c6fd-450a-bbe0-bdccde583d12 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:28.594509 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-33b82919-c6fd-450a-bbe0-bdccde583d12 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:28.595498 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-33b82919-c6fd-450a-bbe0-bdccde583d12 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:28.595693 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-33b82919-c6fd-450a-bbe0-bdccde583d12 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:29.166598 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-33b82919-c6fd-450a-bbe0-bdccde583d12 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6d1646ec094e3297f6f3c51dd72e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b105816fd4e54b9da4973ff721e1fb92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:29.175834 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-33b82919-c6fd-450a-bbe0-bdccde583d12 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "GET /compute/v2.1/servers/cc853ecf-2145-4d0b-a41b-c1d892332490" status: 200 len: 1317 microversion: 2.1 time: 0.636059 Aug 27 02:45:29.179377 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 606/1204] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:28 2022] GET /compute/v2.1/servers/cc853ecf-2145-4d0b-a41b-c1d892332490 => generated 1317 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:29.189466 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c6891424-d03b-40c6-a2e9-d4f947b5d3ac tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:29.193302 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-c6891424-d03b-40c6-a2e9-d4f947b5d3ac tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] [instance: a00dd6f6-d48c-4938-84b1-71bec3877ad9] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:29.200543 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-0a47153d-a8fe-4fa3-a7ad-9ff46933c5ba tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32514a813c0a4031a1d1effc807db17d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe9e2cfe40746dd8af1792468a57a2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:29.209054 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-0a47153d-a8fe-4fa3-a7ad-9ff46933c5ba tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] 10.222.0.70 "GET /compute/v2.1/servers/582ea86f-befd-4c47-95d9-2eba872eb8c8" status: 200 len: 1369 microversion: 2.1 time: 0.686813 Aug 27 02:45:29.213188 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 599/1205] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:28 2022] GET /compute/v2.1/servers/582ea86f-befd-4c47-95d9-2eba872eb8c8 => generated 1369 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:29.221397 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c6891424-d03b-40c6-a2e9-d4f947b5d3ac tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:29.225207 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-41112465-738d-4e7b-b52e-0e877e088352 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:29.225886 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c6891424-d03b-40c6-a2e9-d4f947b5d3ac tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:29.226487 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c6891424-d03b-40c6-a2e9-d4f947b5d3ac tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:29.227568 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c6891424-d03b-40c6-a2e9-d4f947b5d3ac tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:29.228857 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c6891424-d03b-40c6-a2e9-d4f947b5d3ac tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:29.229297 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c6891424-d03b-40c6-a2e9-d4f947b5d3ac tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:29.231292 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-41112465-738d-4e7b-b52e-0e877e088352 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] [instance: ad971605-1da6-4df8-ae39-be0b82b9dad7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:29.246796 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-41112465-738d-4e7b-b52e-0e877e088352 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:29.247777 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-41112465-738d-4e7b-b52e-0e877e088352 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:29.248462 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-41112465-738d-4e7b-b52e-0e877e088352 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:29.251038 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-41112465-738d-4e7b-b52e-0e877e088352 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:29.251679 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-41112465-738d-4e7b-b52e-0e877e088352 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:29.252265 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-41112465-738d-4e7b-b52e-0e877e088352 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:29.769213 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-c6891424-d03b-40c6-a2e9-d4f947b5d3ac tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfec6c2f34f94d66ab1cc982c5bb5bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256b67be18c246b186e09a313db08a7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:29.781172 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c6891424-d03b-40c6-a2e9-d4f947b5d3ac tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] 10.222.0.70 "GET /compute/v2.1/servers/a00dd6f6-d48c-4938-84b1-71bec3877ad9" status: 200 len: 1557 microversion: 2.1 time: 0.600110 Aug 27 02:45:29.807029 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 607/1206] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:29 2022] GET /compute/v2.1/servers/a00dd6f6-d48c-4938-84b1-71bec3877ad9 => generated 1557 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:29.812439 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-251cad87-8f6f-40a0-9c4c-d8ce102d4ffc req-af06ee9e-0c2f-4501-9263-a42c82c35c35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "582ea86f-befd-4c47-95d9-2eba872eb8c8", "name": "network-vif-plugged", "status": "completed", "tag": "b922fb84-aa28-4e90-bfa4-e07f1dd81a47"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:45:29.831896 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-251cad87-8f6f-40a0-9c4c-d8ce102d4ffc req-af06ee9e-0c2f-4501-9263-a42c82c35c35 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:29.832768 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-251cad87-8f6f-40a0-9c4c-d8ce102d4ffc req-af06ee9e-0c2f-4501-9263-a42c82c35c35 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:29.833422 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-251cad87-8f6f-40a0-9c4c-d8ce102d4ffc req-af06ee9e-0c2f-4501-9263-a42c82c35c35 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:29.855658 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-251cad87-8f6f-40a0-9c4c-d8ce102d4ffc req-af06ee9e-0c2f-4501-9263-a42c82c35c35 service nova] Creating event network-vif-plugged:b922fb84-aa28-4e90-bfa4-e07f1dd81a47 for instance 582ea86f-befd-4c47-95d9-2eba872eb8c8 on n-h1-852278-4 Aug 27 02:45:29.870394 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-251cad87-8f6f-40a0-9c4c-d8ce102d4ffc req-af06ee9e-0c2f-4501-9263-a42c82c35c35 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059810 Aug 27 02:45:29.871550 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 608/1207] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:45:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:45:29.877955 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-41112465-738d-4e7b-b52e-0e877e088352 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20f8524b5e042fa9968287ab9257c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d563fb57d1644ea9f14603151d0d089', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:29.879001 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e9494c02-e780-4e19-aad9-a4c9e44507cc tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:29.880917 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-e9494c02-e780-4e19-aad9-a4c9e44507cc tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] [instance: 98a9933e-6c22-491a-90bb-d1d2c0bb7df9] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:29.889454 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-41112465-738d-4e7b-b52e-0e877e088352 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] 10.222.0.70 "GET /compute/v2.1/servers/ad971605-1da6-4df8-ae39-be0b82b9dad7" status: 200 len: 1323 microversion: 2.1 time: 0.673127 Aug 27 02:45:29.890061 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 600/1208] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:29 2022] GET /compute/v2.1/servers/ad971605-1da6-4df8-ae39-be0b82b9dad7 => generated 1323 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:29.900604 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e9494c02-e780-4e19-aad9-a4c9e44507cc tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:29.902282 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-4f219a86-2cf5-4e3c-804e-9d8be4a9c69c req-54b7d40a-1ae4-492b-8ef9-3648babe33e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc853ecf-2145-4d0b-a41b-c1d892332490", "tag": "55047b0d-ee1c-461b-ba5b-3579aec5e757"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:45:29.904629 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e9494c02-e780-4e19-aad9-a4c9e44507cc tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:29.905353 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e9494c02-e780-4e19-aad9-a4c9e44507cc tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:29.907014 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e9494c02-e780-4e19-aad9-a4c9e44507cc tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:29.907631 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e9494c02-e780-4e19-aad9-a4c9e44507cc tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:29.908206 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e9494c02-e780-4e19-aad9-a4c9e44507cc tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:29.933337 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-4f219a86-2cf5-4e3c-804e-9d8be4a9c69c req-54b7d40a-1ae4-492b-8ef9-3648babe33e9 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:29.934353 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-4f219a86-2cf5-4e3c-804e-9d8be4a9c69c req-54b7d40a-1ae4-492b-8ef9-3648babe33e9 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:29.935332 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-4f219a86-2cf5-4e3c-804e-9d8be4a9c69c req-54b7d40a-1ae4-492b-8ef9-3648babe33e9 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:29.949318 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-4f219a86-2cf5-4e3c-804e-9d8be4a9c69c req-54b7d40a-1ae4-492b-8ef9-3648babe33e9 service nova] Creating event network-changed:55047b0d-ee1c-461b-ba5b-3579aec5e757 for instance cc853ecf-2145-4d0b-a41b-c1d892332490 on n-h1-852278-4 Aug 27 02:45:29.955602 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-4f219a86-2cf5-4e3c-804e-9d8be4a9c69c req-54b7d40a-1ae4-492b-8ef9-3648babe33e9 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063340 Aug 27 02:45:29.956978 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 601/1209] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:45:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:45:29.968026 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c55ee699-a100-4104-820a-d32306da853f tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:29.970217 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-c55ee699-a100-4104-820a-d32306da853f tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: f620f083-7230-471a-87d0-f6d85f8ad087] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:29.990482 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c55ee699-a100-4104-820a-d32306da853f tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:29.991104 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c55ee699-a100-4104-820a-d32306da853f tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:29.991618 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c55ee699-a100-4104-820a-d32306da853f tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:29.992458 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c55ee699-a100-4104-820a-d32306da853f tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:29.993009 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c55ee699-a100-4104-820a-d32306da853f tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:29.993478 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c55ee699-a100-4104-820a-d32306da853f tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:30.297032 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-e9494c02-e780-4e19-aad9-a4c9e44507cc tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e86c17fe83848e2bc96b7c83ff1cf14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5668e6d96694c62b83f7e8381fe86e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:30.306444 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=100 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:45:30.321130 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-c55ee699-a100-4104-820a-d32306da853f tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:30.366504 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e9494c02-e780-4e19-aad9-a4c9e44507cc tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] 10.222.0.70 "GET /compute/v2.1/servers/98a9933e-6c22-491a-90bb-d1d2c0bb7df9" status: 200 len: 1522 microversion: 2.1 time: 0.493407 Aug 27 02:45:30.370241 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-c55ee699-a100-4104-820a-d32306da853f tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:30.371895 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-c55ee699-a100-4104-820a-d32306da853f tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:30.375213 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 609/1210] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:29 2022] GET /compute/v2.1/servers/98a9933e-6c22-491a-90bb-d1d2c0bb7df9 => generated 1522 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:30.381073 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c55ee699-a100-4104-820a-d32306da853f tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/f620f083-7230-471a-87d0-f6d85f8ad087" status: 200 len: 1281 microversion: 2.25 time: 0.422644 Aug 27 02:45:30.383787 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 602/1211] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:45:29 2022] GET /compute/v2.1/servers/f620f083-7230-471a-87d0-f6d85f8ad087 => generated 1281 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:45:30.389447 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3810e4f2-887e-4a9c-a8f1-4cf4ace3ad0c tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:30.389943 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-3810e4f2-887e-4a9c-a8f1-4cf4ace3ad0c tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] [instance: a00dd6f6-d48c-4938-84b1-71bec3877ad9] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:30.398369 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-194250f8-6ac7-48e8-bfb2-9b43e068e90f tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:30.398980 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-194250f8-6ac7-48e8-bfb2-9b43e068e90f tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: cc853ecf-2145-4d0b-a41b-c1d892332490] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:30.406968 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3810e4f2-887e-4a9c-a8f1-4cf4ace3ad0c tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:30.407453 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3810e4f2-887e-4a9c-a8f1-4cf4ace3ad0c tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:30.407875 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3810e4f2-887e-4a9c-a8f1-4cf4ace3ad0c tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:30.408609 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3810e4f2-887e-4a9c-a8f1-4cf4ace3ad0c tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:30.409066 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3810e4f2-887e-4a9c-a8f1-4cf4ace3ad0c tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:30.409459 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3810e4f2-887e-4a9c-a8f1-4cf4ace3ad0c tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:30.421310 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-194250f8-6ac7-48e8-bfb2-9b43e068e90f tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:30.424700 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-194250f8-6ac7-48e8-bfb2-9b43e068e90f tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:30.425378 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-194250f8-6ac7-48e8-bfb2-9b43e068e90f tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:30.428233 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-194250f8-6ac7-48e8-bfb2-9b43e068e90f tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:30.428876 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-194250f8-6ac7-48e8-bfb2-9b43e068e90f tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:30.429857 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-194250f8-6ac7-48e8-bfb2-9b43e068e90f tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:30.431501 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:45:30.470264 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=6 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:45:30.738232 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-3810e4f2-887e-4a9c-a8f1-4cf4ace3ad0c tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] 10.222.0.70 "GET /compute/v2.1/servers/a00dd6f6-d48c-4938-84b1-71bec3877ad9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.361828 Aug 27 02:45:30.739071 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 610/1212] 10.222.0.70 () {58 vars in 1275 bytes} [Sat Aug 27 02:45:30 2022] GET /compute/v2.1/servers/a00dd6f6-d48c-4938-84b1-71bec3877ad9/os-interface => generated 284 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:45:30.744216 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-44b6d074-837d-46d9-a671-9a7a1a743bc0 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:30.745028 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-44b6d074-837d-46d9-a671-9a7a1a743bc0 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] [instance: 582ea86f-befd-4c47-95d9-2eba872eb8c8] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:30.765155 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-44b6d074-837d-46d9-a671-9a7a1a743bc0 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:30.768923 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-44b6d074-837d-46d9-a671-9a7a1a743bc0 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:30.769996 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-44b6d074-837d-46d9-a671-9a7a1a743bc0 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:30.772695 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-44b6d074-837d-46d9-a671-9a7a1a743bc0 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:30.773347 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-44b6d074-837d-46d9-a671-9a7a1a743bc0 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:30.775377 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-44b6d074-837d-46d9-a671-9a7a1a743bc0 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:31.075605 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-194250f8-6ac7-48e8-bfb2-9b43e068e90f tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6d1646ec094e3297f6f3c51dd72e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b105816fd4e54b9da4973ff721e1fb92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:31.099994 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-194250f8-6ac7-48e8-bfb2-9b43e068e90f tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "GET /compute/v2.1/servers/cc853ecf-2145-4d0b-a41b-c1d892332490" status: 200 len: 1317 microversion: 2.1 time: 0.714545 Aug 27 02:45:31.103650 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 603/1213] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:30 2022] GET /compute/v2.1/servers/cc853ecf-2145-4d0b-a41b-c1d892332490 => generated 1317 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:31.113779 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-33ff18d3-302a-4fe1-89b9-8cd4513305b2 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1717410388", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:45:31.142443 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-33ff18d3-302a-4fe1-89b9-8cd4513305b2 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Request method failure captured: Aug 27 02:45:31.142443 n-d-852278-4 devstack@n-api.service[134051]: request: POST /compute/v2.1/servers/98a9933e-6c22-491a-90bb-d1d2c0bb7df9/action HTTP/1.1 Aug 27 02:45:31.142443 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:45:31.142443 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:45:31.142443 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:45:31.142443 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 619 Aug 27 02:45:31.142443 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:45:31.142443 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:45:31.142443 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:45:31.142443 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:45:31.142443 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYUqULQp-YhXHHCl2hngi9BMJm7wP1pGZCcaxudoyUu4YXudXmRdmBYAkbX0-TS9pqFDwaRuY82uqdOXUJwRWB1ajZ46tfQo1tc4MJsIVgVqim1Pvb2Il-ejDehbyoer8P643aveyI0JrfbznxBx8aFYmMJz3n8FX81wfpLT5u3cMYE Aug 27 02:45:31.142443 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:45:31.142443 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:45:31.142443 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:45:31.142443 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:45:31.142443 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:45:31.142443 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:45:31.142443 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: f5668e6d96694c62b83f7e8381fe86e1 Aug 27 02:45:31.142443 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-94227302 Aug 27 02:45:31.142443 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:45:31.142443 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:45:31.144524 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f5668e6d96694c62b83f7e8381fe86e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f5668e6d96694c62b83f7e8381fe86e1", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f5668e6d96694c62b83f7e8381fe86e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f5668e6d96694c62b83f7e8381fe86e1"}]}] Aug 27 02:45:31.144524 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-94227302 Aug 27 02:45:31.144524 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: f5668e6d96694c62b83f7e8381fe86e1 Aug 27 02:45:31.144524 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-94227302 Aug 27 02:45:31.144524 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ImagesOneServerNegativeTestJSON-94227302-project Aug 27 02:45:31.144524 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:45:31.144524 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:45:31.144524 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 0e86c17fe83848e2bc96b7c83ff1cf14 Aug 27 02:45:31.144524 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-94227302-project Aug 27 02:45:31.144524 n-d-852278-4 devstack@n-api.service[134051]: Aug 27 02:45:31.145199 n-d-852278-4 devstack@n-api.service[134051]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1717410388", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Aug 27 02:45:31.145199 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 02:45:31.145199 n-d-852278-4 devstack@n-api.service[134051]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 02:45:31.145544 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '98a9933e-6c22-491a-90bb-d1d2c0bb7df9', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1717410388', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Aug 27 02:45:31.145544 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:45:31.145544 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:31.145544 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 02:45:31.145544 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 02:45:31.145544 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 02:45:31.145544 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise error Aug 27 02:45:31.145544 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 02:45:31.145544 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:45:31.145544 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Aug 27 02:45:31.145544 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 27 02:45:31.146322 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 27 02:45:31.146322 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 27 02:45:31.146322 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 27 02:45:31.146322 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:45:31.146322 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi On instance['createImage']: Aug 27 02:45:31.146322 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Aug 27 02:45:31.146322 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:45:31.146322 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:45:31.146322 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:45:31.146322 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:31.146322 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:45:31.146322 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:45:31.146322 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:45:31.146322 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:45:31.146322 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:45:31.146322 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:45:31.146322 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:45:31.147447 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:45:31.147447 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 02:45:31.147447 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 02:45:31.147447 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 02:45:31.147447 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 02:45:31.147447 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 02:45:31.147447 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 02:45:31.147447 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 02:45:31.147447 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:45:31.147447 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:45:31.147447 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:45:31.147447 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:31.148234 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:45:31.148234 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:45:31.148234 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 02:45:31.148234 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 02:45:31.148234 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 02:45:31.148234 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:45:31.150198 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-33ff18d3-302a-4fe1-89b9-8cd4513305b2 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:45:31.151066 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-33ff18d3-302a-4fe1-89b9-8cd4513305b2 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] 10.222.0.70 "POST /compute/v2.1/servers/98a9933e-6c22-491a-90bb-d1d2c0bb7df9/action" status: 400 len: 938 microversion: 2.1 time: 0.043537 Aug 27 02:45:31.151651 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 604/1214] 10.222.0.70 () {60 vars in 1279 bytes} [Sat Aug 27 02:45:31 2022] POST /compute/v2.1/servers/98a9933e-6c22-491a-90bb-d1d2c0bb7df9/action => generated 938 bytes in 47 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 02:45:31.158016 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0b973465-78c2-45ef-a3a0-d87dfad9e111 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:31.158842 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-0b973465-78c2-45ef-a3a0-d87dfad9e111 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] [instance: ad971605-1da6-4df8-ae39-be0b82b9dad7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:31.166965 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0b973465-78c2-45ef-a3a0-d87dfad9e111 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:31.167826 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0b973465-78c2-45ef-a3a0-d87dfad9e111 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:31.168530 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0b973465-78c2-45ef-a3a0-d87dfad9e111 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:31.169462 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0b973465-78c2-45ef-a3a0-d87dfad9e111 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:31.170366 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0b973465-78c2-45ef-a3a0-d87dfad9e111 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:31.171024 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0b973465-78c2-45ef-a3a0-d87dfad9e111 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:31.572749 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-44b6d074-837d-46d9-a671-9a7a1a743bc0 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32514a813c0a4031a1d1effc807db17d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe9e2cfe40746dd8af1792468a57a2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:31.581178 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-44b6d074-837d-46d9-a671-9a7a1a743bc0 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] 10.222.0.70 "GET /compute/v2.1/servers/582ea86f-befd-4c47-95d9-2eba872eb8c8" status: 200 len: 1369 microversion: 2.1 time: 0.840077 Aug 27 02:45:31.587014 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 611/1215] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:30 2022] GET /compute/v2.1/servers/582ea86f-befd-4c47-95d9-2eba872eb8c8 => generated 1369 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:31.594049 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e9b113f9-4675-4a65-8c59-0384bef80386 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:31.595167 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-e9b113f9-4675-4a65-8c59-0384bef80386 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] [instance: 98a9933e-6c22-491a-90bb-d1d2c0bb7df9] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:31.609435 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e9b113f9-4675-4a65-8c59-0384bef80386 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:31.609936 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e9b113f9-4675-4a65-8c59-0384bef80386 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:31.611988 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e9b113f9-4675-4a65-8c59-0384bef80386 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:31.613000 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e9b113f9-4675-4a65-8c59-0384bef80386 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:31.613744 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e9b113f9-4675-4a65-8c59-0384bef80386 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:31.614315 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e9b113f9-4675-4a65-8c59-0384bef80386 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:31.816087 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=4 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:45:32.215425 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-0b973465-78c2-45ef-a3a0-d87dfad9e111 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20f8524b5e042fa9968287ab9257c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d563fb57d1644ea9f14603151d0d089', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:32.227108 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-0b973465-78c2-45ef-a3a0-d87dfad9e111 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] 10.222.0.70 "GET /compute/v2.1/servers/ad971605-1da6-4df8-ae39-be0b82b9dad7" status: 200 len: 1323 microversion: 2.1 time: 1.074140 Aug 27 02:45:32.227695 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 605/1216] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:31 2022] GET /compute/v2.1/servers/ad971605-1da6-4df8-ae39-be0b82b9dad7 => generated 1323 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:32.247335 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-273c012f-0ae8-49ce-801d-3f51a904c42d tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:32.248195 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-273c012f-0ae8-49ce-801d-3f51a904c42d tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: f620f083-7230-471a-87d0-f6d85f8ad087] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:32.256421 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-273c012f-0ae8-49ce-801d-3f51a904c42d tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:32.257094 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-273c012f-0ae8-49ce-801d-3f51a904c42d tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:32.259142 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-273c012f-0ae8-49ce-801d-3f51a904c42d tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:32.260065 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-273c012f-0ae8-49ce-801d-3f51a904c42d tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:32.262271 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-273c012f-0ae8-49ce-801d-3f51a904c42d tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:32.262694 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-273c012f-0ae8-49ce-801d-3f51a904c42d tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:32.549912 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-e9b113f9-4675-4a65-8c59-0384bef80386 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e86c17fe83848e2bc96b7c83ff1cf14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5668e6d96694c62b83f7e8381fe86e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:32.563877 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e9b113f9-4675-4a65-8c59-0384bef80386 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] 10.222.0.70 "GET /compute/v2.1/servers/98a9933e-6c22-491a-90bb-d1d2c0bb7df9" status: 200 len: 1522 microversion: 2.1 time: 0.975437 Aug 27 02:45:32.569653 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 612/1217] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:31 2022] GET /compute/v2.1/servers/98a9933e-6c22-491a-90bb-d1d2c0bb7df9 => generated 1522 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:32.579337 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4a9280e7-07e6-4416-94d7-e2c992a43be8 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1004731676", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "6b3cb06c-c95b-4750-bf14-7cd8c9fd813a"}, {"port": "31906b49-e77a-4b8f-98ad-bdd9406fe852", "tag": "port-1"}, {"port": "6958a0bc-b02e-4619-a95c-6bd7e0759d6c", "tag": "port-2"}, {"uuid": "cabd00f5-cdc3-4066-afe6-2763b976eb4c", "tag": "net-1"}, {"uuid": "cabd00f5-cdc3-4066-afe6-2763b976eb4c"}, {"uuid": "0dc1e5cb-3739-4906-90d2-6aa42e4cadf9", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "0dc1e5cb-3739-4906-90d2-6aa42e4cadf9", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "c072f411-3ae1-4908-b3c9-da9312576b77", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "2b280341-60f1-4fe5-bd37-b38f6b62f2d2", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "2bca6f2b-3e45-4e45-b7c2-2c94947a37e4", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--640329199"}], "key_name": "tempest-keypair-1303823778", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:45:32.756867 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-273c012f-0ae8-49ce-801d-3f51a904c42d tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:32.778543 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-273c012f-0ae8-49ce-801d-3f51a904c42d tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:32.785641 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-273c012f-0ae8-49ce-801d-3f51a904c42d tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:32.787412 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-273c012f-0ae8-49ce-801d-3f51a904c42d tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/f620f083-7230-471a-87d0-f6d85f8ad087" status: 200 len: 1281 microversion: 2.25 time: 0.544266 Aug 27 02:45:32.788008 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 606/1218] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:45:32 2022] GET /compute/v2.1/servers/f620f083-7230-471a-87d0-f6d85f8ad087 => generated 1281 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:45:32.793052 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-52ce3b73-8228-44a7-b025-5b519d17fbf4 req-0f3a5cfd-e41c-45df-a197-fcf8ff7ca633 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4351cb89-8e57-47d5-9870-87a43e21ea57", "tag": "662b64e3-e137-4b0d-9b60-87340e041f05"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:45:32.823423 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-52ce3b73-8228-44a7-b025-5b519d17fbf4 req-0f3a5cfd-e41c-45df-a197-fcf8ff7ca633 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:32.824174 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-52ce3b73-8228-44a7-b025-5b519d17fbf4 req-0f3a5cfd-e41c-45df-a197-fcf8ff7ca633 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:32.825589 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-52ce3b73-8228-44a7-b025-5b519d17fbf4 req-0f3a5cfd-e41c-45df-a197-fcf8ff7ca633 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:32.854401 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-52ce3b73-8228-44a7-b025-5b519d17fbf4 req-0f3a5cfd-e41c-45df-a197-fcf8ff7ca633 service nova] Creating event network-changed:662b64e3-e137-4b0d-9b60-87340e041f05 for instance 4351cb89-8e57-47d5-9870-87a43e21ea57 on n-h1-852278-4 Aug 27 02:45:32.868421 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-52ce3b73-8228-44a7-b025-5b519d17fbf4 req-0f3a5cfd-e41c-45df-a197-fcf8ff7ca633 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078700 Aug 27 02:45:32.871248 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 607/1219] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:45:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:45:32.877696 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b9c2d699-ea3f-4024-b1f3-10f7277e8a7f tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:32.878402 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b9c2d699-ea3f-4024-b1f3-10f7277e8a7f tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: cc853ecf-2145-4d0b-a41b-c1d892332490] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:32.887255 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b9c2d699-ea3f-4024-b1f3-10f7277e8a7f tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:32.887747 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b9c2d699-ea3f-4024-b1f3-10f7277e8a7f tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:32.888767 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b9c2d699-ea3f-4024-b1f3-10f7277e8a7f tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:32.890094 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b9c2d699-ea3f-4024-b1f3-10f7277e8a7f tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:32.890754 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b9c2d699-ea3f-4024-b1f3-10f7277e8a7f tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:32.891390 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b9c2d699-ea3f-4024-b1f3-10f7277e8a7f tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:33.508663 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.network.neutron [None req-4a9280e7-07e6-4416-94d7-e2c992a43be8 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] validate_networks() for [('6b3cb06c-c95b-4750-bf14-7cd8c9fd813a', None, None, None, None, None), (None, None, '31906b49-e77a-4b8f-98ad-bdd9406fe852', None, None, None), (None, None, '6958a0bc-b02e-4619-a95c-6bd7e0759d6c', None, None, None), ('cabd00f5-cdc3-4066-afe6-2763b976eb4c', None, None, None, None, None), ('cabd00f5-cdc3-4066-afe6-2763b976eb4c', None, None, None, None, None), ('0dc1e5cb-3739-4906-90d2-6aa42e4cadf9', '10.2.2.100', None, None, None, None), ('0dc1e5cb-3739-4906-90d2-6aa42e4cadf9', '10.2.2.200', None, None, None, None)] {{(pid=134052) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:45:33.781636 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-b9c2d699-ea3f-4024-b1f3-10f7277e8a7f tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6d1646ec094e3297f6f3c51dd72e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b105816fd4e54b9da4973ff721e1fb92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:33.788147 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=100 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:45:33.794205 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b9c2d699-ea3f-4024-b1f3-10f7277e8a7f tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "GET /compute/v2.1/servers/cc853ecf-2145-4d0b-a41b-c1d892332490" status: 200 len: 1317 microversion: 2.1 time: 0.921651 Aug 27 02:45:33.808031 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 608/1220] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:32 2022] GET /compute/v2.1/servers/cc853ecf-2145-4d0b-a41b-c1d892332490 => generated 1317 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:33.814736 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-1f588900-3b48-4326-91dd-31776d3785d6 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:33.815479 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-1f588900-3b48-4326-91dd-31776d3785d6 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] [instance: 98a9933e-6c22-491a-90bb-d1d2c0bb7df9] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:33.824288 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1f588900-3b48-4326-91dd-31776d3785d6 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:33.824961 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1f588900-3b48-4326-91dd-31776d3785d6 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:33.825519 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1f588900-3b48-4326-91dd-31776d3785d6 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:33.826565 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1f588900-3b48-4326-91dd-31776d3785d6 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:33.827064 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1f588900-3b48-4326-91dd-31776d3785d6 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:33.827587 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1f588900-3b48-4326-91dd-31776d3785d6 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:34.487991 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-1f588900-3b48-4326-91dd-31776d3785d6 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e86c17fe83848e2bc96b7c83ff1cf14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5668e6d96694c62b83f7e8381fe86e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:34.496463 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-1f588900-3b48-4326-91dd-31776d3785d6 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] 10.222.0.70 "GET /compute/v2.1/servers/98a9933e-6c22-491a-90bb-d1d2c0bb7df9" status: 200 len: 1522 microversion: 2.1 time: 0.687153 Aug 27 02:45:34.497033 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 609/1221] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:33 2022] GET /compute/v2.1/servers/98a9933e-6c22-491a-90bb-d1d2c0bb7df9 => generated 1522 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:34.501656 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ad8a88be-2fd9-4de8-9cb6-b0611d3b5298 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:34.502474 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-ad8a88be-2fd9-4de8-9cb6-b0611d3b5298 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] [instance: 582ea86f-befd-4c47-95d9-2eba872eb8c8] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:34.508526 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ad8a88be-2fd9-4de8-9cb6-b0611d3b5298 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:34.509199 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ad8a88be-2fd9-4de8-9cb6-b0611d3b5298 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:34.509797 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ad8a88be-2fd9-4de8-9cb6-b0611d3b5298 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:34.510658 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ad8a88be-2fd9-4de8-9cb6-b0611d3b5298 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:34.511253 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ad8a88be-2fd9-4de8-9cb6-b0611d3b5298 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:34.511819 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ad8a88be-2fd9-4de8-9cb6-b0611d3b5298 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:35.580654 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-ad8a88be-2fd9-4de8-9cb6-b0611d3b5298 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32514a813c0a4031a1d1effc807db17d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe9e2cfe40746dd8af1792468a57a2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:35.592149 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ad8a88be-2fd9-4de8-9cb6-b0611d3b5298 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] 10.222.0.70 "GET /compute/v2.1/servers/582ea86f-befd-4c47-95d9-2eba872eb8c8" status: 200 len: 1554 microversion: 2.1 time: 1.093772 Aug 27 02:45:35.592798 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 610/1222] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:34 2022] GET /compute/v2.1/servers/582ea86f-befd-4c47-95d9-2eba872eb8c8 => generated 1554 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:35.597852 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-6434bbc5-d7ae-4e44-a855-c5c83fe3e1dc req-d722b580-37b1-4d0c-ac1b-fac7a032c26d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f620f083-7230-471a-87d0-f6d85f8ad087", "name": "network-vif-plugged", "status": "completed", "tag": "9bf0e2d8-ba4e-4067-bcf4-ca6ddddb7811"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:45:35.608477 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-6434bbc5-d7ae-4e44-a855-c5c83fe3e1dc req-d722b580-37b1-4d0c-ac1b-fac7a032c26d service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:35.609197 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-6434bbc5-d7ae-4e44-a855-c5c83fe3e1dc req-d722b580-37b1-4d0c-ac1b-fac7a032c26d service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:35.611431 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-6434bbc5-d7ae-4e44-a855-c5c83fe3e1dc req-d722b580-37b1-4d0c-ac1b-fac7a032c26d service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:35.626564 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-6434bbc5-d7ae-4e44-a855-c5c83fe3e1dc req-d722b580-37b1-4d0c-ac1b-fac7a032c26d service nova] Creating event network-vif-plugged:9bf0e2d8-ba4e-4067-bcf4-ca6ddddb7811 for instance f620f083-7230-471a-87d0-f6d85f8ad087 on n-h2-852278-4 Aug 27 02:45:35.632477 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-6434bbc5-d7ae-4e44-a855-c5c83fe3e1dc req-d722b580-37b1-4d0c-ac1b-fac7a032c26d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038211 Aug 27 02:45:35.633323 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 611/1223] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:45:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:45:35.639108 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d40de66d-d80e-4c8d-905d-1eb3c7c41a7b tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:35.639663 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d40de66d-d80e-4c8d-905d-1eb3c7c41a7b tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] [instance: ad971605-1da6-4df8-ae39-be0b82b9dad7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:35.647999 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d40de66d-d80e-4c8d-905d-1eb3c7c41a7b tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:35.648285 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d40de66d-d80e-4c8d-905d-1eb3c7c41a7b tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:35.649176 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d40de66d-d80e-4c8d-905d-1eb3c7c41a7b tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:35.650387 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d40de66d-d80e-4c8d-905d-1eb3c7c41a7b tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:35.651162 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d40de66d-d80e-4c8d-905d-1eb3c7c41a7b tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:35.651751 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d40de66d-d80e-4c8d-905d-1eb3c7c41a7b tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:36.251122 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d40de66d-d80e-4c8d-905d-1eb3c7c41a7b tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20f8524b5e042fa9968287ab9257c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d563fb57d1644ea9f14603151d0d089', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:36.262476 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d40de66d-d80e-4c8d-905d-1eb3c7c41a7b tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] 10.222.0.70 "GET /compute/v2.1/servers/ad971605-1da6-4df8-ae39-be0b82b9dad7" status: 200 len: 1323 microversion: 2.1 time: 0.627180 Aug 27 02:45:36.263376 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 612/1224] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:35 2022] GET /compute/v2.1/servers/ad971605-1da6-4df8-ae39-be0b82b9dad7 => generated 1323 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:36.270411 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b7deeb56-432c-4019-bda9-45083f9751cb tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:36.271348 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b7deeb56-432c-4019-bda9-45083f9751cb tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: f620f083-7230-471a-87d0-f6d85f8ad087] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:36.280100 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b7deeb56-432c-4019-bda9-45083f9751cb tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:36.281808 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b7deeb56-432c-4019-bda9-45083f9751cb tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:36.283207 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b7deeb56-432c-4019-bda9-45083f9751cb tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:36.284880 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b7deeb56-432c-4019-bda9-45083f9751cb tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:36.285756 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b7deeb56-432c-4019-bda9-45083f9751cb tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:36.286592 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b7deeb56-432c-4019-bda9-45083f9751cb tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:36.702300 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-b7deeb56-432c-4019-bda9-45083f9751cb tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:36.711646 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-b7deeb56-432c-4019-bda9-45083f9751cb tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:36.713231 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-b7deeb56-432c-4019-bda9-45083f9751cb tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:36.714496 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b7deeb56-432c-4019-bda9-45083f9751cb tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/f620f083-7230-471a-87d0-f6d85f8ad087" status: 200 len: 1281 microversion: 2.25 time: 0.449720 Aug 27 02:45:36.728978 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 613/1225] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:45:36 2022] GET /compute/v2.1/servers/f620f083-7230-471a-87d0-f6d85f8ad087 => generated 1281 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:45:36.734632 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3a56c937-f325-46ae-8a90-6cf2d2ceb069 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:45:36.738847 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3a56c937-f325-46ae-8a90-6cf2d2ceb069 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Request method failure captured: Aug 27 02:45:36.738847 n-d-852278-4 devstack@n-api.service[134051]: request: POST /compute/v2.1/servers/98a9933e-6c22-491a-90bb-d1d2c0bb7df9/action HTTP/1.1 Aug 27 02:45:36.738847 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:45:36.738847 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:45:36.738847 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:45:36.738847 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 285 Aug 27 02:45:36.738847 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:45:36.738847 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:45:36.738847 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:45:36.738847 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:45:36.738847 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYUqULQp-YhXHHCl2hngi9BMJm7wP1pGZCcaxudoyUu4YXudXmRdmBYAkbX0-TS9pqFDwaRuY82uqdOXUJwRWB1ajZ46tfQo1tc4MJsIVgVqim1Pvb2Il-ejDehbyoer8P643aveyI0JrfbznxBx8aFYmMJz3n8FX81wfpLT5u3cMYE Aug 27 02:45:36.738847 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:45:36.738847 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:45:36.738847 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:45:36.738847 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:45:36.738847 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:45:36.738847 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:45:36.738847 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: f5668e6d96694c62b83f7e8381fe86e1 Aug 27 02:45:36.738847 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-94227302 Aug 27 02:45:36.738847 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:45:36.738847 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:45:36.740559 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f5668e6d96694c62b83f7e8381fe86e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f5668e6d96694c62b83f7e8381fe86e1", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f5668e6d96694c62b83f7e8381fe86e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f5668e6d96694c62b83f7e8381fe86e1"}]}] Aug 27 02:45:36.740559 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-94227302 Aug 27 02:45:36.740559 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: f5668e6d96694c62b83f7e8381fe86e1 Aug 27 02:45:36.740559 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-94227302 Aug 27 02:45:36.740559 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ImagesOneServerNegativeTestJSON-94227302-project Aug 27 02:45:36.740559 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:45:36.740559 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:45:36.740559 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 0e86c17fe83848e2bc96b7c83ff1cf14 Aug 27 02:45:36.740559 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-94227302-project Aug 27 02:45:36.740559 n-d-852278-4 devstack@n-api.service[134051]: Aug 27 02:45:36.740559 n-d-852278-4 devstack@n-api.service[134051]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 27 02:45:36.741371 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 02:45:36.741371 n-d-852278-4 devstack@n-api.service[134051]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 27 02:45:36.741371 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '98a9933e-6c22-491a-90bb-d1d2c0bb7df9', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 27 02:45:36.741371 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:45:36.741371 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:36.741371 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 02:45:36.741371 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 02:45:36.741371 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 02:45:36.741371 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise error Aug 27 02:45:36.741371 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 27 02:45:36.742124 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:45:36.742124 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Aug 27 02:45:36.742124 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 27 02:45:36.742124 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:45:36.742124 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi On instance['createImage']: Aug 27 02:45:36.742124 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 27 02:45:36.742124 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:45:36.742124 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:45:36.742124 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:45:36.742124 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:36.742124 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:45:36.742124 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:45:36.742124 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:45:36.742124 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:45:36.742124 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:45:36.742124 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:45:36.742124 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:45:36.742124 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:45:36.742124 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 02:45:36.742124 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 02:45:36.743446 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 02:45:36.743446 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 02:45:36.743446 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 02:45:36.743446 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 02:45:36.743446 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 27 02:45:36.743446 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:45:36.743446 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:45:36.743446 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:45:36.743446 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:36.743446 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:45:36.743446 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:45:36.743446 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 02:45:36.743446 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 02:45:36.744506 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 27 02:45:36.744506 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:45:36.745529 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3a56c937-f325-46ae-8a90-6cf2d2ceb069 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:45:36.746530 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-3a56c937-f325-46ae-8a90-6cf2d2ceb069 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] 10.222.0.70 "POST /compute/v2.1/servers/98a9933e-6c22-491a-90bb-d1d2c0bb7df9/action" status: 400 len: 619 microversion: 2.1 time: 0.016123 Aug 27 02:45:36.747244 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 614/1226] 10.222.0.70 () {60 vars in 1279 bytes} [Sat Aug 27 02:45:36 2022] POST /compute/v2.1/servers/98a9933e-6c22-491a-90bb-d1d2c0bb7df9/action => generated 619 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 02:45:36.813696 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-c310ae75-b288-4f9d-a9a3-665c4c4b028b req-f3889610-72e4-44f6-9463-0f3d8f475ecc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4eaf21fb-2b59-4e0e-abd4-72c8e422534d", "tag": "4197b222-b5b8-42bf-b892-f890792d4ddf"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:45:36.824662 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-c310ae75-b288-4f9d-a9a3-665c4c4b028b req-f3889610-72e4-44f6-9463-0f3d8f475ecc service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:36.825401 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-c310ae75-b288-4f9d-a9a3-665c4c4b028b req-f3889610-72e4-44f6-9463-0f3d8f475ecc service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:36.825828 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-c310ae75-b288-4f9d-a9a3-665c4c4b028b req-f3889610-72e4-44f6-9463-0f3d8f475ecc service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:36.837108 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-c310ae75-b288-4f9d-a9a3-665c4c4b028b req-f3889610-72e4-44f6-9463-0f3d8f475ecc service nova] Creating event network-changed:4197b222-b5b8-42bf-b892-f890792d4ddf for instance 4eaf21fb-2b59-4e0e-abd4-72c8e422534d on n-h2-852278-4 Aug 27 02:45:36.842497 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-c310ae75-b288-4f9d-a9a3-665c4c4b028b req-f3889610-72e4-44f6-9463-0f3d8f475ecc service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093868 Aug 27 02:45:36.843015 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 615/1227] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:45:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:45:36.848418 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f833858c-3c4a-4136-b247-7cb5982ea62a tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:36.849101 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-f833858c-3c4a-4136-b247-7cb5982ea62a tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: cc853ecf-2145-4d0b-a41b-c1d892332490] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:36.855254 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f833858c-3c4a-4136-b247-7cb5982ea62a tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:36.855972 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f833858c-3c4a-4136-b247-7cb5982ea62a tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:36.856882 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f833858c-3c4a-4136-b247-7cb5982ea62a tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:36.857646 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f833858c-3c4a-4136-b247-7cb5982ea62a tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:36.858146 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f833858c-3c4a-4136-b247-7cb5982ea62a tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:36.858479 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f833858c-3c4a-4136-b247-7cb5982ea62a tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:37.155875 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=12 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:45:37.175174 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-f833858c-3c4a-4136-b247-7cb5982ea62a tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6d1646ec094e3297f6f3c51dd72e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b105816fd4e54b9da4973ff721e1fb92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:37.192382 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-f833858c-3c4a-4136-b247-7cb5982ea62a tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "GET /compute/v2.1/servers/cc853ecf-2145-4d0b-a41b-c1d892332490" status: 200 len: 1317 microversion: 2.1 time: 0.347699 Aug 27 02:45:37.193627 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 616/1228] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:36 2022] GET /compute/v2.1/servers/cc853ecf-2145-4d0b-a41b-c1d892332490 => generated 1317 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:37.200052 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a01c0293-0ef7-45b4-85d6-d40246b38346 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:37.200837 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-a01c0293-0ef7-45b4-85d6-d40246b38346 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] [instance: 582ea86f-befd-4c47-95d9-2eba872eb8c8] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:37.208529 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a01c0293-0ef7-45b4-85d6-d40246b38346 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:37.209288 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a01c0293-0ef7-45b4-85d6-d40246b38346 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:37.210747 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a01c0293-0ef7-45b4-85d6-d40246b38346 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:37.211654 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a01c0293-0ef7-45b4-85d6-d40246b38346 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:37.212396 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a01c0293-0ef7-45b4-85d6-d40246b38346 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:37.212989 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a01c0293-0ef7-45b4-85d6-d40246b38346 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:37.315307 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a01c0293-0ef7-45b4-85d6-d40246b38346 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] 10.222.0.70 "GET /compute/v2.1/servers/582ea86f-befd-4c47-95d9-2eba872eb8c8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.120286 Aug 27 02:45:37.315933 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 617/1229] 10.222.0.70 () {58 vars in 1275 bytes} [Sat Aug 27 02:45:37 2022] GET /compute/v2.1/servers/582ea86f-befd-4c47-95d9-2eba872eb8c8/os-interface => generated 284 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:45:37.321908 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0c280eaf-fae6-4f5f-8a69-6aac80baaac0 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:37.322520 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-0c280eaf-fae6-4f5f-8a69-6aac80baaac0 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] [instance: 98a9933e-6c22-491a-90bb-d1d2c0bb7df9] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:37.329134 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0c280eaf-fae6-4f5f-8a69-6aac80baaac0 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:37.329523 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0c280eaf-fae6-4f5f-8a69-6aac80baaac0 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:37.329964 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0c280eaf-fae6-4f5f-8a69-6aac80baaac0 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:37.330685 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0c280eaf-fae6-4f5f-8a69-6aac80baaac0 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:37.331136 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0c280eaf-fae6-4f5f-8a69-6aac80baaac0 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:37.331565 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0c280eaf-fae6-4f5f-8a69-6aac80baaac0 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:37.551369 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-0c280eaf-fae6-4f5f-8a69-6aac80baaac0 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e86c17fe83848e2bc96b7c83ff1cf14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5668e6d96694c62b83f7e8381fe86e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:37.569724 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-0c280eaf-fae6-4f5f-8a69-6aac80baaac0 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] 10.222.0.70 "GET /compute/v2.1/servers/98a9933e-6c22-491a-90bb-d1d2c0bb7df9" status: 200 len: 1522 microversion: 2.1 time: 0.250497 Aug 27 02:45:37.585207 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 618/1230] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:37 2022] GET /compute/v2.1/servers/98a9933e-6c22-491a-90bb-d1d2c0bb7df9 => generated 1522 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:37.592919 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-cc103329-de01-41b4-9048-1f9f8e71c0b8 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:37.594780 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-cc103329-de01-41b4-9048-1f9f8e71c0b8 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] [instance: ad971605-1da6-4df8-ae39-be0b82b9dad7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:37.602364 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cc103329-de01-41b4-9048-1f9f8e71c0b8 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:37.603096 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cc103329-de01-41b4-9048-1f9f8e71c0b8 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:37.603730 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cc103329-de01-41b4-9048-1f9f8e71c0b8 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:37.604616 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cc103329-de01-41b4-9048-1f9f8e71c0b8 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:37.605067 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cc103329-de01-41b4-9048-1f9f8e71c0b8 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:37.605815 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cc103329-de01-41b4-9048-1f9f8e71c0b8 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:37.839148 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-cc103329-de01-41b4-9048-1f9f8e71c0b8 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20f8524b5e042fa9968287ab9257c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d563fb57d1644ea9f14603151d0d089', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:37.847916 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-cc103329-de01-41b4-9048-1f9f8e71c0b8 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] 10.222.0.70 "GET /compute/v2.1/servers/ad971605-1da6-4df8-ae39-be0b82b9dad7" status: 200 len: 1323 microversion: 2.1 time: 0.261242 Aug 27 02:45:37.848765 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 619/1231] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:37 2022] GET /compute/v2.1/servers/ad971605-1da6-4df8-ae39-be0b82b9dad7 => generated 1323 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:37.854266 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-5db28242-04af-4d56-a5c6-a651f72a5fff tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-46441094", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "fca9b1d3-694a-4672-8678-5d39e71afa11"}], "block_device_mapping_v2": [{"uuid": "543d78a3-a0ec-42eb-a39b-dd90b05a85d5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:45:37.929614 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.network.neutron [None req-5db28242-04af-4d56-a5c6-a651f72a5fff tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] validate_networks() for [('fca9b1d3-694a-4672-8678-5d39e71afa11', None, None, None, None, None)] {{(pid=134051) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:45:39.174540 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-5db28242-04af-4d56-a5c6-a651f72a5fff tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Flavor limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:45:39.175587 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-5db28242-04af-4d56-a5c6-a651f72a5fff tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Image limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:45:39.176265 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-5db28242-04af-4d56-a5c6-a651f72a5fff tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Flavor pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:45:39.176937 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-5db28242-04af-4d56-a5c6-a651f72a5fff tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Image pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:45:39.177431 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-5db28242-04af-4d56-a5c6-a651f72a5fff tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:45:39.180943 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:45:39.190578 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5db28242-04af-4d56-a5c6-a651f72a5fff tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:39.191084 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5db28242-04af-4d56-a5c6-a651f72a5fff tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:39.191516 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5db28242-04af-4d56-a5c6-a651f72a5fff tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:39.192535 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5db28242-04af-4d56-a5c6-a651f72a5fff tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:39.193623 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5db28242-04af-4d56-a5c6-a651f72a5fff tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:39.194245 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5db28242-04af-4d56-a5c6-a651f72a5fff tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:39.213575 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-5db28242-04af-4d56-a5c6-a651f72a5fff tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Getting quotas for project 42ec913a638c4c8c8749be73705d2c65. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:45:39.219272 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-5db28242-04af-4d56-a5c6-a651f72a5fff tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Getting quotas for user 6305debcc9294643bbed97f08de171bc and project 42ec913a638c4c8c8749be73705d2c65. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:45:39.287516 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-5db28242-04af-4d56-a5c6-a651f72a5fff tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Going to run 1 instances... {{(pid=134051) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:45:39.289929 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-5db28242-04af-4d56-a5c6-a651f72a5fff tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 70acfe32-deea-46fc-a214-8fdbb9f6cb7b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='543d78a3-a0ec-42eb-a39b-dd90b05a85d5',volume_size=None,volume_type=None)] {{(pid=134051) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:45:39.450034 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-5db28242-04af-4d56-a5c6-a651f72a5fff tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.599776 Aug 27 02:45:39.451363 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 620/1232] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 02:45:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1602 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:45:39.456914 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-4a9280e7-07e6-4416-94d7-e2c992a43be8 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Flavor limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:45:39.458028 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-4a9280e7-07e6-4416-94d7-e2c992a43be8 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Image limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:45:39.458726 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-4a9280e7-07e6-4416-94d7-e2c992a43be8 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Flavor pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:45:39.459477 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-4a9280e7-07e6-4416-94d7-e2c992a43be8 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Image pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:45:39.460085 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-4a9280e7-07e6-4416-94d7-e2c992a43be8 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:45:39.466940 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ed87e06e-9f0f-49d0-8bb4-92f112224e58 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:39.472156 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-ed87e06e-9f0f-49d0-8bb4-92f112224e58 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] [instance: 98a9933e-6c22-491a-90bb-d1d2c0bb7df9] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:39.477947 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4a9280e7-07e6-4416-94d7-e2c992a43be8 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:39.478437 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4a9280e7-07e6-4416-94d7-e2c992a43be8 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:39.478841 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4a9280e7-07e6-4416-94d7-e2c992a43be8 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:39.479541 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4a9280e7-07e6-4416-94d7-e2c992a43be8 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:39.481077 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ed87e06e-9f0f-49d0-8bb4-92f112224e58 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:39.481792 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ed87e06e-9f0f-49d0-8bb4-92f112224e58 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:39.482509 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ed87e06e-9f0f-49d0-8bb4-92f112224e58 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:39.483370 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ed87e06e-9f0f-49d0-8bb4-92f112224e58 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:39.483897 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ed87e06e-9f0f-49d0-8bb4-92f112224e58 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:39.484514 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ed87e06e-9f0f-49d0-8bb4-92f112224e58 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:39.487278 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4a9280e7-07e6-4416-94d7-e2c992a43be8 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:39.487898 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4a9280e7-07e6-4416-94d7-e2c992a43be8 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:39.532510 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-4a9280e7-07e6-4416-94d7-e2c992a43be8 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Getting quotas for project ae35c895f49f4d31a4137dd3392f65bf. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:45:39.538633 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-4a9280e7-07e6-4416-94d7-e2c992a43be8 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Getting quotas for user 585803c75b454475993d2189c88cc6d7 and project ae35c895f49f4d31a4137dd3392f65bf. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:45:39.677008 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-ed87e06e-9f0f-49d0-8bb4-92f112224e58 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e86c17fe83848e2bc96b7c83ff1cf14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5668e6d96694c62b83f7e8381fe86e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:39.686909 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ed87e06e-9f0f-49d0-8bb4-92f112224e58 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] 10.222.0.70 "GET /compute/v2.1/servers/98a9933e-6c22-491a-90bb-d1d2c0bb7df9" status: 200 len: 1522 microversion: 2.1 time: 0.233587 Aug 27 02:45:39.687925 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 621/1233] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:39 2022] GET /compute/v2.1/servers/98a9933e-6c22-491a-90bb-d1d2c0bb7df9 => generated 1522 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:39.694074 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-b0cfe3af-710a-4fd2-bb50-12037c8ff2d8 req-1c87be56-a3f2-4372-9e53-debaf8d652c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc853ecf-2145-4d0b-a41b-c1d892332490", "name": "network-vif-plugged", "status": "completed", "tag": "55047b0d-ee1c-461b-ba5b-3579aec5e757"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:45:39.704896 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-b0cfe3af-710a-4fd2-bb50-12037c8ff2d8 req-1c87be56-a3f2-4372-9e53-debaf8d652c3 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:39.705590 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-b0cfe3af-710a-4fd2-bb50-12037c8ff2d8 req-1c87be56-a3f2-4372-9e53-debaf8d652c3 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:39.706172 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-b0cfe3af-710a-4fd2-bb50-12037c8ff2d8 req-1c87be56-a3f2-4372-9e53-debaf8d652c3 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:39.719816 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-b0cfe3af-710a-4fd2-bb50-12037c8ff2d8 req-1c87be56-a3f2-4372-9e53-debaf8d652c3 service nova] Creating event network-vif-plugged:55047b0d-ee1c-461b-ba5b-3579aec5e757 for instance cc853ecf-2145-4d0b-a41b-c1d892332490 on n-h1-852278-4 Aug 27 02:45:39.727302 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-b0cfe3af-710a-4fd2-bb50-12037c8ff2d8 req-1c87be56-a3f2-4372-9e53-debaf8d652c3 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037840 Aug 27 02:45:39.728434 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 622/1234] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:45:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:45:39.733640 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-bbf645cc-5b20-4436-83a8-4a90e86cb429 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:39.734328 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-bbf645cc-5b20-4436-83a8-4a90e86cb429 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: f620f083-7230-471a-87d0-f6d85f8ad087] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:39.744449 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bbf645cc-5b20-4436-83a8-4a90e86cb429 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:39.745153 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bbf645cc-5b20-4436-83a8-4a90e86cb429 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:39.745817 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bbf645cc-5b20-4436-83a8-4a90e86cb429 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:39.747093 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bbf645cc-5b20-4436-83a8-4a90e86cb429 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:39.747771 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bbf645cc-5b20-4436-83a8-4a90e86cb429 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:39.749034 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bbf645cc-5b20-4436-83a8-4a90e86cb429 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:39.773092 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-4a9280e7-07e6-4416-94d7-e2c992a43be8 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Going to run 1 instances... {{(pid=134052) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:45:39.776836 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-4a9280e7-07e6-4416-94d7-e2c992a43be8 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] [instance: 484e03a9-aef3-4179-980c-0e7292a05b5a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='c072f411-3ae1-4908-b3c9-da9312576b77',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='2b280341-60f1-4fe5-bd37-b38f6b62f2d2',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2bca6f2b-3e45-4e45-b7c2-2c94947a37e4',volume_size=None,volume_type=None)] {{(pid=134052) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:45:40.050356 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-bbf645cc-5b20-4436-83a8-4a90e86cb429 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:40.063002 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-bbf645cc-5b20-4436-83a8-4a90e86cb429 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:40.064594 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-bbf645cc-5b20-4436-83a8-4a90e86cb429 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:40.066002 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-bbf645cc-5b20-4436-83a8-4a90e86cb429 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/f620f083-7230-471a-87d0-f6d85f8ad087" status: 200 len: 1477 microversion: 2.25 time: 0.336349 Aug 27 02:45:40.075348 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 623/1235] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:45:39 2022] GET /compute/v2.1/servers/f620f083-7230-471a-87d0-f6d85f8ad087 => generated 1477 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:45:40.092147 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a01c1406-b6da-47f3-a44b-f550950634f6 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:40.094900 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-a01c1406-b6da-47f3-a44b-f550950634f6 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: cc853ecf-2145-4d0b-a41b-c1d892332490] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:40.106363 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a01c1406-b6da-47f3-a44b-f550950634f6 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:40.107303 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a01c1406-b6da-47f3-a44b-f550950634f6 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:40.108566 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a01c1406-b6da-47f3-a44b-f550950634f6 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:40.109408 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a01c1406-b6da-47f3-a44b-f550950634f6 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:40.109797 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a01c1406-b6da-47f3-a44b-f550950634f6 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:40.111313 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a01c1406-b6da-47f3-a44b-f550950634f6 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:40.267380 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-4a9280e7-07e6-4416-94d7-e2c992a43be8 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.42 time: 7.695510 Aug 27 02:45:40.273682 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 613/1236] 10.222.0.70 () {62 vars in 1189 bytes} [Sat Aug 27 02:45:32 2022] POST /compute/v2.1/servers => generated 405 bytes in 7703 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 27 02:45:40.284791 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-74526580-6bcf-43aa-8415-4bb827fb36ba req-d93a13c2-c4a4-4f80-9ed0-7d5a18bf4fbb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "582ea86f-befd-4c47-95d9-2eba872eb8c8", "tag": "b922fb84-aa28-4e90-bfa4-e07f1dd81a47"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:45:40.312197 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-74526580-6bcf-43aa-8415-4bb827fb36ba req-d93a13c2-c4a4-4f80-9ed0-7d5a18bf4fbb service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:40.316748 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-74526580-6bcf-43aa-8415-4bb827fb36ba req-d93a13c2-c4a4-4f80-9ed0-7d5a18bf4fbb service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:40.317481 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-74526580-6bcf-43aa-8415-4bb827fb36ba req-d93a13c2-c4a4-4f80-9ed0-7d5a18bf4fbb service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:40.338977 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-74526580-6bcf-43aa-8415-4bb827fb36ba req-d93a13c2-c4a4-4f80-9ed0-7d5a18bf4fbb service nova] Creating event network-changed:b922fb84-aa28-4e90-bfa4-e07f1dd81a47 for instance 582ea86f-befd-4c47-95d9-2eba872eb8c8 on n-h1-852278-4 Aug 27 02:45:40.355589 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-74526580-6bcf-43aa-8415-4bb827fb36ba req-d93a13c2-c4a4-4f80-9ed0-7d5a18bf4fbb service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080287 Aug 27 02:45:40.358712 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 614/1237] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:45:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:45:40.367754 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-a01c1406-b6da-47f3-a44b-f550950634f6 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6d1646ec094e3297f6f3c51dd72e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b105816fd4e54b9da4973ff721e1fb92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:40.368856 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-2432a5de-9e08-409e-8e1e-b9ce2378a82c tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:40.369734 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-2432a5de-9e08-409e-8e1e-b9ce2378a82c tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] [instance: ad971605-1da6-4df8-ae39-be0b82b9dad7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:40.376728 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2432a5de-9e08-409e-8e1e-b9ce2378a82c tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:40.378001 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2432a5de-9e08-409e-8e1e-b9ce2378a82c tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:40.378463 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2432a5de-9e08-409e-8e1e-b9ce2378a82c tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:40.379219 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2432a5de-9e08-409e-8e1e-b9ce2378a82c tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:40.379674 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2432a5de-9e08-409e-8e1e-b9ce2378a82c tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:40.380660 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2432a5de-9e08-409e-8e1e-b9ce2378a82c tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:40.391796 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a01c1406-b6da-47f3-a44b-f550950634f6 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "GET /compute/v2.1/servers/cc853ecf-2145-4d0b-a41b-c1d892332490" status: 200 len: 1317 microversion: 2.1 time: 0.304953 Aug 27 02:45:40.404340 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 624/1238] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:40 2022] GET /compute/v2.1/servers/cc853ecf-2145-4d0b-a41b-c1d892332490 => generated 1317 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:40.405496 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-51459484-f48c-4737-b3a2-9d42f18770f0 req-fde660d7-5b94-4285-9d4a-124184cf2598 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a00dd6f6-d48c-4938-84b1-71bec3877ad9", "tag": "829c63ac-805f-401e-b2ab-43eae4e821bb"}, {"name": "network-changed", "server_uuid": "ad971605-1da6-4df8-ae39-be0b82b9dad7", "tag": "68307369-dc29-4bcb-ac64-aa4ad2c62cec"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:45:40.441967 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-51459484-f48c-4737-b3a2-9d42f18770f0 req-fde660d7-5b94-4285-9d4a-124184cf2598 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:40.451457 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-51459484-f48c-4737-b3a2-9d42f18770f0 req-fde660d7-5b94-4285-9d4a-124184cf2598 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:40.452664 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-51459484-f48c-4737-b3a2-9d42f18770f0 req-fde660d7-5b94-4285-9d4a-124184cf2598 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:40.503862 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-51459484-f48c-4737-b3a2-9d42f18770f0 req-fde660d7-5b94-4285-9d4a-124184cf2598 service nova] Creating event network-changed:829c63ac-805f-401e-b2ab-43eae4e821bb for instance a00dd6f6-d48c-4938-84b1-71bec3877ad9 on n-h2-852278-4 Aug 27 02:45:40.504756 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-51459484-f48c-4737-b3a2-9d42f18770f0 req-fde660d7-5b94-4285-9d4a-124184cf2598 service nova] Creating event network-changed:68307369-dc29-4bcb-ac64-aa4ad2c62cec for instance ad971605-1da6-4df8-ae39-be0b82b9dad7 on n-h1-852278-4 Aug 27 02:45:40.522891 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-51459484-f48c-4737-b3a2-9d42f18770f0 req-fde660d7-5b94-4285-9d4a-124184cf2598 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.127649 Aug 27 02:45:40.523855 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 625/1239] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:45:40 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:45:40.536062 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-90efec1e-a401-4440-9270-27079083727c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:40.540501 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-90efec1e-a401-4440-9270-27079083727c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 70acfe32-deea-46fc-a214-8fdbb9f6cb7b] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:40.567164 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-90efec1e-a401-4440-9270-27079083727c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:40.571655 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-90efec1e-a401-4440-9270-27079083727c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:40.572373 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-90efec1e-a401-4440-9270-27079083727c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:40.574762 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-90efec1e-a401-4440-9270-27079083727c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:40.579858 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-90efec1e-a401-4440-9270-27079083727c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:40.582786 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-90efec1e-a401-4440-9270-27079083727c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:40.720788 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-90efec1e-a401-4440-9270-27079083727c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:40.727393 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-2432a5de-9e08-409e-8e1e-b9ce2378a82c tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20f8524b5e042fa9968287ab9257c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d563fb57d1644ea9f14603151d0d089', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:40.735609 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-90efec1e-a401-4440-9270-27079083727c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b" status: 200 len: 1149 microversion: 2.1 time: 0.208544 Aug 27 02:45:40.736913 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 626/1240] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:40 2022] GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b => generated 1149 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:40.749811 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ad1a2720-1139-46a6-984b-cd363539afd5 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1683955303"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:45:40.753323 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-ad1a2720-1139-46a6-984b-cd363539afd5 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] [instance: 98a9933e-6c22-491a-90bb-d1d2c0bb7df9] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:40.755535 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-2432a5de-9e08-409e-8e1e-b9ce2378a82c tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] 10.222.0.70 "GET /compute/v2.1/servers/ad971605-1da6-4df8-ae39-be0b82b9dad7" status: 200 len: 1323 microversion: 2.1 time: 0.391556 Aug 27 02:45:40.758944 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 615/1241] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:40 2022] GET /compute/v2.1/servers/ad971605-1da6-4df8-ae39-be0b82b9dad7 => generated 1323 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:40.770879 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ad1a2720-1139-46a6-984b-cd363539afd5 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:40.771378 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ad1a2720-1139-46a6-984b-cd363539afd5 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:40.771809 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ad1a2720-1139-46a6-984b-cd363539afd5 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:40.772550 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ad1a2720-1139-46a6-984b-cd363539afd5 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:40.776962 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ad1a2720-1139-46a6-984b-cd363539afd5 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:40.780557 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ad1a2720-1139-46a6-984b-cd363539afd5 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:41.030049 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-eca42597-6342-4eba-b50a-165bb2afc70e tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:41.030636 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-eca42597-6342-4eba-b50a-165bb2afc70e tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] [instance: f620f083-7230-471a-87d0-f6d85f8ad087] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:41.054222 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-eca42597-6342-4eba-b50a-165bb2afc70e tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:41.054725 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-eca42597-6342-4eba-b50a-165bb2afc70e tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:41.055242 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-eca42597-6342-4eba-b50a-165bb2afc70e tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:41.055970 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-eca42597-6342-4eba-b50a-165bb2afc70e tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:41.056466 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-eca42597-6342-4eba-b50a-165bb2afc70e tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:41.056893 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-eca42597-6342-4eba-b50a-165bb2afc70e tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:41.458517 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ad1a2720-1139-46a6-984b-cd363539afd5 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] 10.222.0.70 "POST /compute/v2.1/servers/98a9933e-6c22-491a-90bb-d1d2c0bb7df9/action" status: 202 len: 0 microversion: 2.1 time: 0.720001 Aug 27 02:45:41.461436 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 627/1242] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 02:45:40 2022] POST /compute/v2.1/servers/98a9933e-6c22-491a-90bb-d1d2c0bb7df9/action => generated 0 bytes in 724 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 27 02:45:41.468961 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-9658156f-0d05-4402-beb6-4c47e932ad26 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:41.470584 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-9658156f-0d05-4402-beb6-4c47e932ad26 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] [instance: 484e03a9-aef3-4179-980c-0e7292a05b5a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:41.485086 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.instance [None req-eca42597-6342-4eba-b50a-165bb2afc70e tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lazy-loading 'services' on Instance uuid f620f083-7230-471a-87d0-f6d85f8ad087 {{(pid=134052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:45:41.510782 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-eca42597-6342-4eba-b50a-165bb2afc70e tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/f620f083-7230-471a-87d0-f6d85f8ad087" status: 200 len: 1970 microversion: 2.25 time: 0.750142 Aug 27 02:45:41.529055 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 616/1243] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:45:40 2022] GET /compute/v2.1/servers/f620f083-7230-471a-87d0-f6d85f8ad087 => generated 1970 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:45:41.538787 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-edd15b82-01de-4246-99e9-e3de8b10636e tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:41.540150 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-edd15b82-01de-4246-99e9-e3de8b10636e tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: cc853ecf-2145-4d0b-a41b-c1d892332490] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:41.548043 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-edd15b82-01de-4246-99e9-e3de8b10636e tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:41.549446 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-edd15b82-01de-4246-99e9-e3de8b10636e tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:41.550127 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-edd15b82-01de-4246-99e9-e3de8b10636e tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:41.551471 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-edd15b82-01de-4246-99e9-e3de8b10636e tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:41.552137 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-edd15b82-01de-4246-99e9-e3de8b10636e tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:41.552763 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-edd15b82-01de-4246-99e9-e3de8b10636e tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:41.803669 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-9658156f-0d05-4402-beb6-4c47e932ad26 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:41.814775 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-9658156f-0d05-4402-beb6-4c47e932ad26 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:41.816466 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-9658156f-0d05-4402-beb6-4c47e932ad26 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:41.817972 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-9658156f-0d05-4402-beb6-4c47e932ad26 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] 10.222.0.70 "GET /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a" status: 200 len: 1286 microversion: 2.42 time: 0.355013 Aug 27 02:45:41.818772 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 628/1244] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:45:41 2022] GET /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a => generated 1286 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:45:41.824436 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8f81e1b1-d67c-479d-b892-d708040ca796 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-2071205627"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:45:41.827825 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-8f81e1b1-d67c-479d-b892-d708040ca796 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] [instance: 98a9933e-6c22-491a-90bb-d1d2c0bb7df9] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:41.837812 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8f81e1b1-d67c-479d-b892-d708040ca796 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:41.838570 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8f81e1b1-d67c-479d-b892-d708040ca796 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:41.839387 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8f81e1b1-d67c-479d-b892-d708040ca796 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:41.840400 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8f81e1b1-d67c-479d-b892-d708040ca796 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:41.841035 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8f81e1b1-d67c-479d-b892-d708040ca796 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:41.841672 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8f81e1b1-d67c-479d-b892-d708040ca796 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:41.904636 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:45:41.908589 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-8f81e1b1-d67c-479d-b892-d708040ca796 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] HTTP exception thrown: Cannot 'createImage' instance 98a9933e-6c22-491a-90bb-d1d2c0bb7df9 while it is in task_state image_snapshot Aug 27 02:45:41.910582 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8f81e1b1-d67c-479d-b892-d708040ca796 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Request method failure captured: Aug 27 02:45:41.910582 n-d-852278-4 devstack@n-api.service[134051]: request: POST /compute/v2.1/servers/98a9933e-6c22-491a-90bb-d1d2c0bb7df9/action HTTP/1.1 Aug 27 02:45:41.910582 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:45:41.910582 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:45:41.910582 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:45:41.910582 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 85 Aug 27 02:45:41.910582 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:45:41.910582 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:45:41.910582 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:45:41.910582 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:45:41.910582 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYUqULQp-YhXHHCl2hngi9BMJm7wP1pGZCcaxudoyUu4YXudXmRdmBYAkbX0-TS9pqFDwaRuY82uqdOXUJwRWB1ajZ46tfQo1tc4MJsIVgVqim1Pvb2Il-ejDehbyoer8P643aveyI0JrfbznxBx8aFYmMJz3n8FX81wfpLT5u3cMYE Aug 27 02:45:41.910582 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:45:41.910582 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:45:41.910582 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:45:41.910582 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:45:41.910582 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:45:41.910582 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:45:41.910582 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: f5668e6d96694c62b83f7e8381fe86e1 Aug 27 02:45:41.910582 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-94227302 Aug 27 02:45:41.910582 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:45:41.910582 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:45:41.912269 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f5668e6d96694c62b83f7e8381fe86e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f5668e6d96694c62b83f7e8381fe86e1", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f5668e6d96694c62b83f7e8381fe86e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f5668e6d96694c62b83f7e8381fe86e1"}]}] Aug 27 02:45:41.912269 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-94227302 Aug 27 02:45:41.912269 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: f5668e6d96694c62b83f7e8381fe86e1 Aug 27 02:45:41.912269 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-94227302 Aug 27 02:45:41.912269 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ImagesOneServerNegativeTestJSON-94227302-project Aug 27 02:45:41.912269 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:45:41.912269 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:45:41.912269 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 0e86c17fe83848e2bc96b7c83ff1cf14 Aug 27 02:45:41.912269 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-94227302-project Aug 27 02:45:41.912269 n-d-852278-4 devstack@n-api.service[134051]: Aug 27 02:45:41.912269 n-d-852278-4 devstack@n-api.service[134051]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-2071205627"}} Aug 27 02:45:41.912269 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 02:45:41.914587 n-d-852278-4 devstack@n-api.service[134051]: exception: Cannot 'createImage' instance 98a9933e-6c22-491a-90bb-d1d2c0bb7df9 while it is in task_state image_snapshot Aug 27 02:45:41.914587 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '98a9933e-6c22-491a-90bb-d1d2c0bb7df9', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-2071205627'}}} Aug 27 02:45:41.914587 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:45:41.914587 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:41.914587 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1346, in _action_create_image Aug 27 02:45:41.914587 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Aug 27 02:45:41.914587 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Aug 27 02:45:41.914587 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 27 02:45:41.914587 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 98a9933e-6c22-491a-90bb-d1d2c0bb7df9 in task_state image_snapshot. Cannot snapshot while the instance is in this state. Aug 27 02:45:41.914587 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:45:41.914587 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:45:41.914587 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:45:41.914587 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:41.914587 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:45:41.914587 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:45:41.914587 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:45:41.914587 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:45:41.914587 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:45:41.914587 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:45:41.916304 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:45:41.916304 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:45:41.916304 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:45:41.916304 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:45:41.916304 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1351, in _action_create_image Aug 27 02:45:41.916304 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 27 02:45:41.916304 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 27 02:45:41.916304 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 27 02:45:41.916304 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance 98a9933e-6c22-491a-90bb-d1d2c0bb7df9 while it is in task_state image_snapshot Aug 27 02:45:41.916304 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:45:41.916304 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:45:41.916304 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:45:41.916304 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:41.916304 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:45:41.916304 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:45:41.916304 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:45:41.916304 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:45:41.916304 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance 98a9933e-6c22-491a-90bb-d1d2c0bb7df9 while it is in task_state image_snapshot Aug 27 02:45:41.916304 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:45:41.918810 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8f81e1b1-d67c-479d-b892-d708040ca796 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Returning 409 to user: Cannot 'createImage' instance 98a9933e-6c22-491a-90bb-d1d2c0bb7df9 while it is in task_state image_snapshot {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:45:41.920110 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-8f81e1b1-d67c-479d-b892-d708040ca796 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] 10.222.0.70 "POST /compute/v2.1/servers/98a9933e-6c22-491a-90bb-d1d2c0bb7df9/action" status: 409 len: 159 microversion: 2.1 time: 0.100163 Aug 27 02:45:41.921202 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 629/1245] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 02:45:41 2022] POST /compute/v2.1/servers/98a9933e-6c22-491a-90bb-d1d2c0bb7df9/action => generated 159 bytes in 102 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 27 02:45:41.927131 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-1abe92a3-3eae-48ef-aff1-c50cc794bff2 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:41.928300 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-1abe92a3-3eae-48ef-aff1-c50cc794bff2 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] [instance: f620f083-7230-471a-87d0-f6d85f8ad087] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:41.937918 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1abe92a3-3eae-48ef-aff1-c50cc794bff2 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:41.938738 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1abe92a3-3eae-48ef-aff1-c50cc794bff2 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:41.939178 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1abe92a3-3eae-48ef-aff1-c50cc794bff2 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:41.939918 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1abe92a3-3eae-48ef-aff1-c50cc794bff2 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:41.940415 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1abe92a3-3eae-48ef-aff1-c50cc794bff2 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:41.940842 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1abe92a3-3eae-48ef-aff1-c50cc794bff2 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:42.142130 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-edd15b82-01de-4246-99e9-e3de8b10636e tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6d1646ec094e3297f6f3c51dd72e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b105816fd4e54b9da4973ff721e1fb92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:42.159943 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-edd15b82-01de-4246-99e9-e3de8b10636e tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "GET /compute/v2.1/servers/cc853ecf-2145-4d0b-a41b-c1d892332490" status: 200 len: 1317 microversion: 2.1 time: 0.629262 Aug 27 02:45:42.172466 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 617/1246] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:41 2022] GET /compute/v2.1/servers/cc853ecf-2145-4d0b-a41b-c1d892332490 => generated 1317 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:42.172466 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-876d41d7-fc70-4ba6-a6d5-4ddcb7fdf622 req-c97e2ef7-01e4-4a91-b15e-260c194d6e1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4351cb89-8e57-47d5-9870-87a43e21ea57", "name": "network-vif-plugged", "status": "completed", "tag": "662b64e3-e137-4b0d-9b60-87340e041f05"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:45:42.184148 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-876d41d7-fc70-4ba6-a6d5-4ddcb7fdf622 req-c97e2ef7-01e4-4a91-b15e-260c194d6e1b service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:42.189572 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-876d41d7-fc70-4ba6-a6d5-4ddcb7fdf622 req-c97e2ef7-01e4-4a91-b15e-260c194d6e1b service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:42.190120 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-876d41d7-fc70-4ba6-a6d5-4ddcb7fdf622 req-c97e2ef7-01e4-4a91-b15e-260c194d6e1b service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:42.204201 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-876d41d7-fc70-4ba6-a6d5-4ddcb7fdf622 req-c97e2ef7-01e4-4a91-b15e-260c194d6e1b service nova] Creating event network-vif-plugged:662b64e3-e137-4b0d-9b60-87340e041f05 for instance 4351cb89-8e57-47d5-9870-87a43e21ea57 on n-h1-852278-4 Aug 27 02:45:42.210444 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-876d41d7-fc70-4ba6-a6d5-4ddcb7fdf622 req-c97e2ef7-01e4-4a91-b15e-260c194d6e1b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043827 Aug 27 02:45:42.218433 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 618/1247] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:45:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:45:42.224881 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3c697271-6c3f-4918-80b0-3f5e731ac18c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:42.226988 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-3c697271-6c3f-4918-80b0-3f5e731ac18c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 70acfe32-deea-46fc-a214-8fdbb9f6cb7b] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:42.236035 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3c697271-6c3f-4918-80b0-3f5e731ac18c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:42.237135 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3c697271-6c3f-4918-80b0-3f5e731ac18c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:42.237842 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3c697271-6c3f-4918-80b0-3f5e731ac18c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:42.239088 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3c697271-6c3f-4918-80b0-3f5e731ac18c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:42.241555 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3c697271-6c3f-4918-80b0-3f5e731ac18c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:42.242600 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3c697271-6c3f-4918-80b0-3f5e731ac18c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:42.370849 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-3c697271-6c3f-4918-80b0-3f5e731ac18c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:42.389480 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-3c697271-6c3f-4918-80b0-3f5e731ac18c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b" status: 200 len: 1167 microversion: 2.1 time: 0.168785 Aug 27 02:45:42.393254 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 619/1248] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:42 2022] GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b => generated 1167 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:42.405452 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-22c1d547-7e88-451f-b93f-d5afd0ae3a19 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:42.406245 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-22c1d547-7e88-451f-b93f-d5afd0ae3a19 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] [instance: ad971605-1da6-4df8-ae39-be0b82b9dad7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:42.416869 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-22c1d547-7e88-451f-b93f-d5afd0ae3a19 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:42.417807 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-22c1d547-7e88-451f-b93f-d5afd0ae3a19 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:42.418471 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-22c1d547-7e88-451f-b93f-d5afd0ae3a19 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:42.419418 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-22c1d547-7e88-451f-b93f-d5afd0ae3a19 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:42.421464 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-22c1d547-7e88-451f-b93f-d5afd0ae3a19 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:42.421464 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-22c1d547-7e88-451f-b93f-d5afd0ae3a19 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:42.463590 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.objects.instance [None req-1abe92a3-3eae-48ef-aff1-c50cc794bff2 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lazy-loading 'services' on Instance uuid f620f083-7230-471a-87d0-f6d85f8ad087 {{(pid=134051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:45:42.497001 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-1abe92a3-3eae-48ef-aff1-c50cc794bff2 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/f620f083-7230-471a-87d0-f6d85f8ad087" status: 200 len: 1970 microversion: 2.25 time: 0.574120 Aug 27 02:45:42.498155 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 630/1249] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:45:41 2022] GET /compute/v2.1/servers/f620f083-7230-471a-87d0-f6d85f8ad087 => generated 1970 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:45:42.529792 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-6335e61c-33e9-484b-ab1e-e57f23f4b90c tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Calling method '.version_select at 0x7f5edeacf040>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:42.822727 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-6335e61c-33e9-484b-ab1e-e57f23f4b90c tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] 10.222.0.70 "DELETE /compute/v2.1/images/06c254e5-271a-4049-9b57-9f07f052b1e8" status: 204 len: 0 microversion: 2.1 time: 0.323315 Aug 27 02:45:42.822897 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-22c1d547-7e88-451f-b93f-d5afd0ae3a19 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20f8524b5e042fa9968287ab9257c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d563fb57d1644ea9f14603151d0d089', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:42.823993 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 631/1250] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:42 2022] DELETE /compute/v2.1/images/06c254e5-271a-4049-9b57-9f07f052b1e8 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:45:42.829138 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-67dfd0a4-c39d-40bd-8017-054395a08282 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:42.832559 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-22c1d547-7e88-451f-b93f-d5afd0ae3a19 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] 10.222.0.70 "GET /compute/v2.1/servers/ad971605-1da6-4df8-ae39-be0b82b9dad7" status: 200 len: 1323 microversion: 2.1 time: 0.437953 Aug 27 02:45:42.833540 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 620/1251] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:42 2022] GET /compute/v2.1/servers/ad971605-1da6-4df8-ae39-be0b82b9dad7 => generated 1323 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:42.846029 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-67dfd0a4-c39d-40bd-8017-054395a08282 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:42.850370 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-67dfd0a4-c39d-40bd-8017-054395a08282 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:42.851335 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-67dfd0a4-c39d-40bd-8017-054395a08282 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:42.852612 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-67dfd0a4-c39d-40bd-8017-054395a08282 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:42.853714 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-67dfd0a4-c39d-40bd-8017-054395a08282 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:42.854440 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-67dfd0a4-c39d-40bd-8017-054395a08282 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:42.854755 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-09cf2bd7-4764-417b-9e0f-2de39b198ef3 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:42.857973 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-09cf2bd7-4764-417b-9e0f-2de39b198ef3 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] [instance: 98a9933e-6c22-491a-90bb-d1d2c0bb7df9] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:42.869180 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-09cf2bd7-4764-417b-9e0f-2de39b198ef3 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:42.869785 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-09cf2bd7-4764-417b-9e0f-2de39b198ef3 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:42.870375 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-09cf2bd7-4764-417b-9e0f-2de39b198ef3 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:42.871155 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-09cf2bd7-4764-417b-9e0f-2de39b198ef3 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:42.871879 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-09cf2bd7-4764-417b-9e0f-2de39b198ef3 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:42.873788 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-09cf2bd7-4764-417b-9e0f-2de39b198ef3 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:42.892111 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-67dfd0a4-c39d-40bd-8017-054395a08282 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] 10.222.0.70 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.066716 Aug 27 02:45:42.893798 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 632/1252] 10.222.0.70 () {60 vars in 1217 bytes} [Sat Aug 27 02:45:42 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:45:42.898993 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-32132f9d-d298-411d-942c-d14069044518 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:42.899876 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-32132f9d-d298-411d-942c-d14069044518 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] [instance: 484e03a9-aef3-4179-980c-0e7292a05b5a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:42.909279 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-32132f9d-d298-411d-942c-d14069044518 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:42.910749 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-32132f9d-d298-411d-942c-d14069044518 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:42.911553 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-32132f9d-d298-411d-942c-d14069044518 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:42.912824 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-32132f9d-d298-411d-942c-d14069044518 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:42.913789 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-32132f9d-d298-411d-942c-d14069044518 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:42.914795 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-32132f9d-d298-411d-942c-d14069044518 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:43.075292 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-32132f9d-d298-411d-942c-d14069044518 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:43.090218 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-32132f9d-d298-411d-942c-d14069044518 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:43.092118 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-32132f9d-d298-411d-942c-d14069044518 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:43.094206 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-32132f9d-d298-411d-942c-d14069044518 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] 10.222.0.70 "GET /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a" status: 200 len: 1576 microversion: 2.42 time: 0.199189 Aug 27 02:45:43.094944 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 633/1253] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:45:42 2022] GET /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a => generated 1576 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:45:43.100143 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-37b27efc-b7b4-459d-915b-9ccc11530664 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-852278-4", "block_migration": "auto"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:45:43.102993 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-37b27efc-b7b4-459d-915b-9ccc11530664 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] [instance: f620f083-7230-471a-87d0-f6d85f8ad087] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:43.110089 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-37b27efc-b7b4-459d-915b-9ccc11530664 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:43.111039 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-37b27efc-b7b4-459d-915b-9ccc11530664 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:43.111675 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-37b27efc-b7b4-459d-915b-9ccc11530664 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:43.113277 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-37b27efc-b7b4-459d-915b-9ccc11530664 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:43.114352 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-37b27efc-b7b4-459d-915b-9ccc11530664 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:43.114352 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-37b27efc-b7b4-459d-915b-9ccc11530664 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:43.140385 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.objects.instance [None req-37b27efc-b7b4-459d-915b-9ccc11530664 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lazy-loading 'flavor' on Instance uuid f620f083-7230-471a-87d0-f6d85f8ad087 {{(pid=134051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:45:43.154227 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-37b27efc-b7b4-459d-915b-9ccc11530664 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] [instance: f620f083-7230-471a-87d0-f6d85f8ad087] Going to try to live migrate instance to n-h1-852278-4 {{(pid=134051) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 27 02:45:43.216597 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-09cf2bd7-4764-417b-9e0f-2de39b198ef3 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e86c17fe83848e2bc96b7c83ff1cf14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5668e6d96694c62b83f7e8381fe86e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:43.227713 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-09cf2bd7-4764-417b-9e0f-2de39b198ef3 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] 10.222.0.70 "GET /compute/v2.1/servers/98a9933e-6c22-491a-90bb-d1d2c0bb7df9" status: 200 len: 1534 microversion: 2.1 time: 0.390816 Aug 27 02:45:43.241502 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 621/1254] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:42 2022] GET /compute/v2.1/servers/98a9933e-6c22-491a-90bb-d1d2c0bb7df9 => generated 1534 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:43.247838 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-1d6f5170-5826-4098-9a4a-63f84485f7fe tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:43.248544 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-1d6f5170-5826-4098-9a4a-63f84485f7fe tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: cc853ecf-2145-4d0b-a41b-c1d892332490] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:43.255527 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1d6f5170-5826-4098-9a4a-63f84485f7fe tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:43.256016 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1d6f5170-5826-4098-9a4a-63f84485f7fe tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:43.256619 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1d6f5170-5826-4098-9a4a-63f84485f7fe tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:43.257325 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1d6f5170-5826-4098-9a4a-63f84485f7fe tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:43.257791 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1d6f5170-5826-4098-9a4a-63f84485f7fe tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:43.258193 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1d6f5170-5826-4098-9a4a-63f84485f7fe tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:43.477595 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-1d6f5170-5826-4098-9a4a-63f84485f7fe tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6d1646ec094e3297f6f3c51dd72e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b105816fd4e54b9da4973ff721e1fb92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:43.495308 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-1d6f5170-5826-4098-9a4a-63f84485f7fe tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "GET /compute/v2.1/servers/cc853ecf-2145-4d0b-a41b-c1d892332490" status: 200 len: 1467 microversion: 2.1 time: 0.252629 Aug 27 02:45:43.508393 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 622/1255] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:43 2022] GET /compute/v2.1/servers/cc853ecf-2145-4d0b-a41b-c1d892332490 => generated 1467 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:43.515016 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-25844c95-b8d7-4f9a-ad5f-ada3dd57cb75 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:43.515890 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-25844c95-b8d7-4f9a-ad5f-ada3dd57cb75 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 70acfe32-deea-46fc-a214-8fdbb9f6cb7b] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:43.523412 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-25844c95-b8d7-4f9a-ad5f-ada3dd57cb75 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:43.524014 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-25844c95-b8d7-4f9a-ad5f-ada3dd57cb75 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:43.530383 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-25844c95-b8d7-4f9a-ad5f-ada3dd57cb75 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:43.531472 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-25844c95-b8d7-4f9a-ad5f-ada3dd57cb75 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:43.532437 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-25844c95-b8d7-4f9a-ad5f-ada3dd57cb75 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:43.533218 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-25844c95-b8d7-4f9a-ad5f-ada3dd57cb75 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:44.139544 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-25844c95-b8d7-4f9a-ad5f-ada3dd57cb75 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:44.157449 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-25844c95-b8d7-4f9a-ad5f-ada3dd57cb75 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b" status: 200 len: 1209 microversion: 2.1 time: 0.647847 Aug 27 02:45:44.158007 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 623/1256] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:43 2022] GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b => generated 1209 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:44.172492 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f5748b23-25bb-4f7a-9523-2aa5d42e7a1e tempest-ServersOnMultiNodesTest-986315705 tempest-ServersOnMultiNodesTest-986315705-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:44.173249 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-f5748b23-25bb-4f7a-9523-2aa5d42e7a1e tempest-ServersOnMultiNodesTest-986315705 tempest-ServersOnMultiNodesTest-986315705-project-admin] [instance: cc853ecf-2145-4d0b-a41b-c1d892332490] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:44.182136 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f5748b23-25bb-4f7a-9523-2aa5d42e7a1e tempest-ServersOnMultiNodesTest-986315705 tempest-ServersOnMultiNodesTest-986315705-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:44.183164 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f5748b23-25bb-4f7a-9523-2aa5d42e7a1e tempest-ServersOnMultiNodesTest-986315705 tempest-ServersOnMultiNodesTest-986315705-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:44.183605 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f5748b23-25bb-4f7a-9523-2aa5d42e7a1e tempest-ServersOnMultiNodesTest-986315705 tempest-ServersOnMultiNodesTest-986315705-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:44.184331 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f5748b23-25bb-4f7a-9523-2aa5d42e7a1e tempest-ServersOnMultiNodesTest-986315705 tempest-ServersOnMultiNodesTest-986315705-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:44.184772 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f5748b23-25bb-4f7a-9523-2aa5d42e7a1e tempest-ServersOnMultiNodesTest-986315705 tempest-ServersOnMultiNodesTest-986315705-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:44.185398 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f5748b23-25bb-4f7a-9523-2aa5d42e7a1e tempest-ServersOnMultiNodesTest-986315705 tempest-ServersOnMultiNodesTest-986315705-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:44.399495 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f5748b23-25bb-4f7a-9523-2aa5d42e7a1e tempest-ServersOnMultiNodesTest-986315705 tempest-ServersOnMultiNodesTest-986315705-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/cc853ecf-2145-4d0b-a41b-c1d892332490" status: 200 len: 1618 microversion: 2.1 time: 0.237628 Aug 27 02:45:44.404949 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 624/1257] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:44 2022] GET /compute/v2.1/servers/cc853ecf-2145-4d0b-a41b-c1d892332490 => generated 1618 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:44.406081 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-69afbf7e-f566-407e-a0ac-ff16b7482198 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:44.406922 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-69afbf7e-f566-407e-a0ac-ff16b7482198 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] [instance: ad971605-1da6-4df8-ae39-be0b82b9dad7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:44.410178 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:45:44.427964 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-69afbf7e-f566-407e-a0ac-ff16b7482198 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:44.434768 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-69afbf7e-f566-407e-a0ac-ff16b7482198 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:44.435691 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-69afbf7e-f566-407e-a0ac-ff16b7482198 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:44.436776 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-69afbf7e-f566-407e-a0ac-ff16b7482198 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:44.450522 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-69afbf7e-f566-407e-a0ac-ff16b7482198 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:44.451333 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-69afbf7e-f566-407e-a0ac-ff16b7482198 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:44.718338 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-69afbf7e-f566-407e-a0ac-ff16b7482198 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20f8524b5e042fa9968287ab9257c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d563fb57d1644ea9f14603151d0d089', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:44.727650 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-69afbf7e-f566-407e-a0ac-ff16b7482198 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] 10.222.0.70 "GET /compute/v2.1/servers/ad971605-1da6-4df8-ae39-be0b82b9dad7" status: 200 len: 1323 microversion: 2.1 time: 0.325888 Aug 27 02:45:44.728767 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 625/1258] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:44 2022] GET /compute/v2.1/servers/ad971605-1da6-4df8-ae39-be0b82b9dad7 => generated 1323 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:44.734144 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-91365837-3fde-4558-a5a7-24896678e486 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:44.734891 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-91365837-3fde-4558-a5a7-24896678e486 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] [instance: 484e03a9-aef3-4179-980c-0e7292a05b5a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:44.742129 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-91365837-3fde-4558-a5a7-24896678e486 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:44.742616 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-91365837-3fde-4558-a5a7-24896678e486 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:44.743056 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-91365837-3fde-4558-a5a7-24896678e486 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:44.744044 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-91365837-3fde-4558-a5a7-24896678e486 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:44.744635 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-91365837-3fde-4558-a5a7-24896678e486 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:44.745145 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-91365837-3fde-4558-a5a7-24896678e486 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:44.918306 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-91365837-3fde-4558-a5a7-24896678e486 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:44.930110 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-91365837-3fde-4558-a5a7-24896678e486 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:44.940982 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-91365837-3fde-4558-a5a7-24896678e486 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:44.942463 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-91365837-3fde-4558-a5a7-24896678e486 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] 10.222.0.70 "GET /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a" status: 200 len: 1584 microversion: 2.42 time: 0.212578 Aug 27 02:45:44.956359 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 626/1259] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:45:44 2022] GET /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a => generated 1584 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:45:44.956359 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-1a3dfc38-d529-4c43-91b5-89040017ad81 req-b48cb0df-e388-451b-8f08-a74cb0c72aab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad971605-1da6-4df8-ae39-be0b82b9dad7", "name": "network-vif-plugged", "status": "completed", "tag": "68307369-dc29-4bcb-ac64-aa4ad2c62cec"}, {"server_uuid": "4eaf21fb-2b59-4e0e-abd4-72c8e422534d", "name": "network-vif-plugged", "status": "completed", "tag": "4197b222-b5b8-42bf-b892-f890792d4ddf"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:45:44.989204 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-1a3dfc38-d529-4c43-91b5-89040017ad81 req-b48cb0df-e388-451b-8f08-a74cb0c72aab service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:44.991131 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-1a3dfc38-d529-4c43-91b5-89040017ad81 req-b48cb0df-e388-451b-8f08-a74cb0c72aab service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:44.991886 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-1a3dfc38-d529-4c43-91b5-89040017ad81 req-b48cb0df-e388-451b-8f08-a74cb0c72aab service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:45.019699 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-1a3dfc38-d529-4c43-91b5-89040017ad81 req-b48cb0df-e388-451b-8f08-a74cb0c72aab service nova] Creating event network-vif-plugged:68307369-dc29-4bcb-ac64-aa4ad2c62cec for instance ad971605-1da6-4df8-ae39-be0b82b9dad7 on n-h1-852278-4 Aug 27 02:45:45.020202 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-1a3dfc38-d529-4c43-91b5-89040017ad81 req-b48cb0df-e388-451b-8f08-a74cb0c72aab service nova] Creating event network-vif-plugged:4197b222-b5b8-42bf-b892-f890792d4ddf for instance 4eaf21fb-2b59-4e0e-abd4-72c8e422534d on n-h2-852278-4 Aug 27 02:45:45.038562 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-1a3dfc38-d529-4c43-91b5-89040017ad81 req-b48cb0df-e388-451b-8f08-a74cb0c72aab service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.093888 Aug 27 02:45:45.040375 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 627/1260] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:45:44 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:45:45.048248 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ccc5d0cc-c45a-40c6-870e-bf2316a93c9c tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:45.049240 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-ccc5d0cc-c45a-40c6-870e-bf2316a93c9c tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] [instance: 98a9933e-6c22-491a-90bb-d1d2c0bb7df9] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:45.086533 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ccc5d0cc-c45a-40c6-870e-bf2316a93c9c tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:45.087030 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ccc5d0cc-c45a-40c6-870e-bf2316a93c9c tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:45.087468 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ccc5d0cc-c45a-40c6-870e-bf2316a93c9c tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:45.088178 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ccc5d0cc-c45a-40c6-870e-bf2316a93c9c tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:45.101185 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ccc5d0cc-c45a-40c6-870e-bf2316a93c9c tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:45.101717 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ccc5d0cc-c45a-40c6-870e-bf2316a93c9c tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:45.491535 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-37b27efc-b7b4-459d-915b-9ccc11530664 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/f620f083-7230-471a-87d0-f6d85f8ad087/action" status: 202 len: 0 microversion: 2.25 time: 2.395052 Aug 27 02:45:45.493323 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 634/1261] 10.222.0.70 () {62 vars in 1319 bytes} [Sat Aug 27 02:45:43 2022] POST /compute/v2.1/servers/f620f083-7230-471a-87d0-f6d85f8ad087/action => generated 0 bytes in 2398 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:45:45.503088 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-bb0475bc-2768-4172-828b-52cb0f7f33b7 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-2090640881", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "2e16c5b3-ff3c-4afe-ae65-97b9be1b14b0"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:45:45.566554 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-ccc5d0cc-c45a-40c6-870e-bf2316a93c9c tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e86c17fe83848e2bc96b7c83ff1cf14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5668e6d96694c62b83f7e8381fe86e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:45.581354 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.network.neutron [None req-bb0475bc-2768-4172-828b-52cb0f7f33b7 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] validate_networks() for None {{(pid=134051) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:45:45.585356 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ccc5d0cc-c45a-40c6-870e-bf2316a93c9c tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] 10.222.0.70 "GET /compute/v2.1/servers/98a9933e-6c22-491a-90bb-d1d2c0bb7df9" status: 200 len: 1540 microversion: 2.1 time: 0.541248 Aug 27 02:45:45.586542 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 628/1262] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:45 2022] GET /compute/v2.1/servers/98a9933e-6c22-491a-90bb-d1d2c0bb7df9 => generated 1540 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:45.604637 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-8012e925-3c7f-42d0-a5d7-d3ffafe54ef0 req-e6ec60ba-3e44-460d-aa02-8c062d61a9ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70acfe32-deea-46fc-a214-8fdbb9f6cb7b", "tag": "2644ae8b-0546-435d-ae4e-79c3fb9a12cc"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:45:45.615336 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-8012e925-3c7f-42d0-a5d7-d3ffafe54ef0 req-e6ec60ba-3e44-460d-aa02-8c062d61a9ef service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:45.615824 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-8012e925-3c7f-42d0-a5d7-d3ffafe54ef0 req-e6ec60ba-3e44-460d-aa02-8c062d61a9ef service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:45.616258 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-8012e925-3c7f-42d0-a5d7-d3ffafe54ef0 req-e6ec60ba-3e44-460d-aa02-8c062d61a9ef service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:45.627146 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=100 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:45:45.629639 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-8012e925-3c7f-42d0-a5d7-d3ffafe54ef0 req-e6ec60ba-3e44-460d-aa02-8c062d61a9ef service nova] Creating event network-changed:2644ae8b-0546-435d-ae4e-79c3fb9a12cc for instance 70acfe32-deea-46fc-a214-8fdbb9f6cb7b on n-h2-852278-4 Aug 27 02:45:45.635645 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-8012e925-3c7f-42d0-a5d7-d3ffafe54ef0 req-e6ec60ba-3e44-460d-aa02-8c062d61a9ef service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045963 Aug 27 02:45:45.636438 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 629/1263] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:45:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:45:45.641549 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-67760deb-1b60-4f75-b3ef-8b4a97e9c17c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:45.642267 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-67760deb-1b60-4f75-b3ef-8b4a97e9c17c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 70acfe32-deea-46fc-a214-8fdbb9f6cb7b] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:45.649209 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-67760deb-1b60-4f75-b3ef-8b4a97e9c17c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:45.649689 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-67760deb-1b60-4f75-b3ef-8b4a97e9c17c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:45.650129 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-67760deb-1b60-4f75-b3ef-8b4a97e9c17c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:45.650833 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-67760deb-1b60-4f75-b3ef-8b4a97e9c17c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:45.651282 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-67760deb-1b60-4f75-b3ef-8b4a97e9c17c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:45.651704 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-67760deb-1b60-4f75-b3ef-8b4a97e9c17c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:46.067756 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-67760deb-1b60-4f75-b3ef-8b4a97e9c17c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:46.077141 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-67760deb-1b60-4f75-b3ef-8b4a97e9c17c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b" status: 200 len: 1209 microversion: 2.1 time: 0.439351 Aug 27 02:45:46.077881 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 630/1264] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:45 2022] GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b => generated 1209 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:46.084273 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-65d45c55-62f9-4e8e-b1e2-390cc1f181bf tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:46.085228 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-65d45c55-62f9-4e8e-b1e2-390cc1f181bf tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: f620f083-7230-471a-87d0-f6d85f8ad087] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:46.092461 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-65d45c55-62f9-4e8e-b1e2-390cc1f181bf tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:46.093031 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-65d45c55-62f9-4e8e-b1e2-390cc1f181bf tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:46.093540 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-65d45c55-62f9-4e8e-b1e2-390cc1f181bf tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:46.094319 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-65d45c55-62f9-4e8e-b1e2-390cc1f181bf tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:46.095636 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-65d45c55-62f9-4e8e-b1e2-390cc1f181bf tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:46.096071 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-65d45c55-62f9-4e8e-b1e2-390cc1f181bf tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:46.226131 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-bb0475bc-2768-4172-828b-52cb0f7f33b7 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Flavor limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:45:46.226706 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-bb0475bc-2768-4172-828b-52cb0f7f33b7 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Image limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:45:46.227247 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-bb0475bc-2768-4172-828b-52cb0f7f33b7 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Flavor pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:45:46.227925 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-bb0475bc-2768-4172-828b-52cb0f7f33b7 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Image pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:45:46.228433 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-bb0475bc-2768-4172-828b-52cb0f7f33b7 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:45:46.238553 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bb0475bc-2768-4172-828b-52cb0f7f33b7 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:46.239224 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bb0475bc-2768-4172-828b-52cb0f7f33b7 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:46.239682 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bb0475bc-2768-4172-828b-52cb0f7f33b7 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:46.240600 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bb0475bc-2768-4172-828b-52cb0f7f33b7 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:46.241146 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bb0475bc-2768-4172-828b-52cb0f7f33b7 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:46.241734 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bb0475bc-2768-4172-828b-52cb0f7f33b7 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:46.262314 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-bb0475bc-2768-4172-828b-52cb0f7f33b7 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Getting quotas for project b105816fd4e54b9da4973ff721e1fb92. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:45:46.268649 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-bb0475bc-2768-4172-828b-52cb0f7f33b7 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Getting quotas for user eb6d1646ec094e3297f6f3c51dd72e85 and project b105816fd4e54b9da4973ff721e1fb92. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:45:46.285339 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-bb0475bc-2768-4172-828b-52cb0f7f33b7 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Going to run 1 instances... {{(pid=134051) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:45:46.288594 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-bb0475bc-2768-4172-828b-52cb0f7f33b7 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: eb11f5d3-ce63-461d-a83f-04f33ce7c16b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134051) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:45:46.308968 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-65d45c55-62f9-4e8e-b1e2-390cc1f181bf tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:46.318841 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-65d45c55-62f9-4e8e-b1e2-390cc1f181bf tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:46.320639 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-65d45c55-62f9-4e8e-b1e2-390cc1f181bf tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:46.321797 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-65d45c55-62f9-4e8e-b1e2-390cc1f181bf tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/f620f083-7230-471a-87d0-f6d85f8ad087" status: 200 len: 1487 microversion: 2.25 time: 0.241990 Aug 27 02:45:46.328385 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 631/1265] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:45:46 2022] GET /compute/v2.1/servers/f620f083-7230-471a-87d0-f6d85f8ad087 => generated 1487 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:45:46.328385 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-26e570e0-5b8e-452a-88fc-2a589d68ddcb tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:46.328620 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-26e570e0-5b8e-452a-88fc-2a589d68ddcb tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] [instance: ad971605-1da6-4df8-ae39-be0b82b9dad7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:46.334844 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-26e570e0-5b8e-452a-88fc-2a589d68ddcb tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:46.335348 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-26e570e0-5b8e-452a-88fc-2a589d68ddcb tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:46.335782 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-26e570e0-5b8e-452a-88fc-2a589d68ddcb tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:46.336705 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-26e570e0-5b8e-452a-88fc-2a589d68ddcb tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:46.337049 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-26e570e0-5b8e-452a-88fc-2a589d68ddcb tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:46.337558 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-26e570e0-5b8e-452a-88fc-2a589d68ddcb tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:46.366565 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-bb0475bc-2768-4172-828b-52cb0f7f33b7 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.870599 Aug 27 02:45:46.368010 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 635/1266] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 02:45:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 873 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:45:46.382075 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d7946b30-3e28-4d1c-98a6-997fbd24f4a9 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:46.392431 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d7946b30-3e28-4d1c-98a6-997fbd24f4a9 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] [instance: 484e03a9-aef3-4179-980c-0e7292a05b5a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:46.400696 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d7946b30-3e28-4d1c-98a6-997fbd24f4a9 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:46.401213 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d7946b30-3e28-4d1c-98a6-997fbd24f4a9 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:46.401661 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d7946b30-3e28-4d1c-98a6-997fbd24f4a9 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:46.402568 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d7946b30-3e28-4d1c-98a6-997fbd24f4a9 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:46.403034 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d7946b30-3e28-4d1c-98a6-997fbd24f4a9 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:46.403460 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d7946b30-3e28-4d1c-98a6-997fbd24f4a9 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:46.589406 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d7946b30-3e28-4d1c-98a6-997fbd24f4a9 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:46.610488 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d7946b30-3e28-4d1c-98a6-997fbd24f4a9 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:46.614928 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d7946b30-3e28-4d1c-98a6-997fbd24f4a9 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:46.616305 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d7946b30-3e28-4d1c-98a6-997fbd24f4a9 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] 10.222.0.70 "GET /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a" status: 200 len: 1594 microversion: 2.42 time: 0.247175 Aug 27 02:45:46.618035 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 636/1267] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:45:46 2022] GET /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a => generated 1594 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:45:46.625457 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c70a39c0-902d-4688-a643-05e8d3e061c7 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:46.626302 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-c70a39c0-902d-4688-a643-05e8d3e061c7 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: eb11f5d3-ce63-461d-a83f-04f33ce7c16b] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:46.862278 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-c70a39c0-902d-4688-a643-05e8d3e061c7 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6d1646ec094e3297f6f3c51dd72e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b105816fd4e54b9da4973ff721e1fb92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:46.870518 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c70a39c0-902d-4688-a643-05e8d3e061c7 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "GET /compute/v2.1/servers/eb11f5d3-ce63-461d-a83f-04f33ce7c16b" status: 200 len: 1217 microversion: 2.1 time: 0.250853 Aug 27 02:45:46.883765 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 637/1268] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:46 2022] GET /compute/v2.1/servers/eb11f5d3-ce63-461d-a83f-04f33ce7c16b => generated 1217 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:46.884113 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-6e01dca1-95ff-4098-a3ec-4a3169e8c097 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:46.886322 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-6e01dca1-95ff-4098-a3ec-4a3169e8c097 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] [instance: 98a9933e-6c22-491a-90bb-d1d2c0bb7df9] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:46.905645 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-26e570e0-5b8e-452a-88fc-2a589d68ddcb tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20f8524b5e042fa9968287ab9257c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d563fb57d1644ea9f14603151d0d089', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:46.915927 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6e01dca1-95ff-4098-a3ec-4a3169e8c097 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:46.917928 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6e01dca1-95ff-4098-a3ec-4a3169e8c097 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:46.919391 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-26e570e0-5b8e-452a-88fc-2a589d68ddcb tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] 10.222.0.70 "GET /compute/v2.1/servers/ad971605-1da6-4df8-ae39-be0b82b9dad7" status: 200 len: 1323 microversion: 2.1 time: 0.595294 Aug 27 02:45:46.920862 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6e01dca1-95ff-4098-a3ec-4a3169e8c097 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:46.923166 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 632/1269] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:46 2022] GET /compute/v2.1/servers/ad971605-1da6-4df8-ae39-be0b82b9dad7 => generated 1323 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:46.923437 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6e01dca1-95ff-4098-a3ec-4a3169e8c097 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:46.928019 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6e01dca1-95ff-4098-a3ec-4a3169e8c097 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:46.928758 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6e01dca1-95ff-4098-a3ec-4a3169e8c097 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:47.099360 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-018d944a-ad61-4e0e-a07b-be8dc290fbf3 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:47.101101 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-018d944a-ad61-4e0e-a07b-be8dc290fbf3 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 70acfe32-deea-46fc-a214-8fdbb9f6cb7b] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:47.119562 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-018d944a-ad61-4e0e-a07b-be8dc290fbf3 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:47.130391 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-018d944a-ad61-4e0e-a07b-be8dc290fbf3 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:47.131173 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-018d944a-ad61-4e0e-a07b-be8dc290fbf3 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:47.132599 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-018d944a-ad61-4e0e-a07b-be8dc290fbf3 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:47.133387 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-018d944a-ad61-4e0e-a07b-be8dc290fbf3 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:47.134462 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-018d944a-ad61-4e0e-a07b-be8dc290fbf3 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:47.513795 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-6e01dca1-95ff-4098-a3ec-4a3169e8c097 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e86c17fe83848e2bc96b7c83ff1cf14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5668e6d96694c62b83f7e8381fe86e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:47.521681 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-6e01dca1-95ff-4098-a3ec-4a3169e8c097 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] 10.222.0.70 "GET /compute/v2.1/servers/98a9933e-6c22-491a-90bb-d1d2c0bb7df9" status: 200 len: 1522 microversion: 2.1 time: 0.647046 Aug 27 02:45:47.525150 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 638/1270] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:46 2022] GET /compute/v2.1/servers/98a9933e-6c22-491a-90bb-d1d2c0bb7df9 => generated 1522 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:47.530366 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c365caea-bec7-4ec9-ac26-dafc3c77c5e0 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:47.531366 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-c365caea-bec7-4ec9-ac26-dafc3c77c5e0 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: f620f083-7230-471a-87d0-f6d85f8ad087] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:47.538060 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c365caea-bec7-4ec9-ac26-dafc3c77c5e0 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:47.538951 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c365caea-bec7-4ec9-ac26-dafc3c77c5e0 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:47.539570 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c365caea-bec7-4ec9-ac26-dafc3c77c5e0 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:47.540564 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c365caea-bec7-4ec9-ac26-dafc3c77c5e0 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:47.541175 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c365caea-bec7-4ec9-ac26-dafc3c77c5e0 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:47.542079 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c365caea-bec7-4ec9-ac26-dafc3c77c5e0 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:47.603994 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-018d944a-ad61-4e0e-a07b-be8dc290fbf3 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:47.615573 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-018d944a-ad61-4e0e-a07b-be8dc290fbf3 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b" status: 200 len: 1209 microversion: 2.1 time: 0.520483 Aug 27 02:45:47.617047 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 633/1271] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:47 2022] GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b => generated 1209 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:47.622057 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3cb710dd-9e36-4ce2-8297-7997c9ef8859 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:47.622738 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-3cb710dd-9e36-4ce2-8297-7997c9ef8859 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] [instance: 98a9933e-6c22-491a-90bb-d1d2c0bb7df9] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:47.635658 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3cb710dd-9e36-4ce2-8297-7997c9ef8859 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:47.641109 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3cb710dd-9e36-4ce2-8297-7997c9ef8859 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:47.641569 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3cb710dd-9e36-4ce2-8297-7997c9ef8859 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:47.642320 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3cb710dd-9e36-4ce2-8297-7997c9ef8859 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:47.642778 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3cb710dd-9e36-4ce2-8297-7997c9ef8859 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:47.645077 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3cb710dd-9e36-4ce2-8297-7997c9ef8859 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:47.731211 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-3cb710dd-9e36-4ce2-8297-7997c9ef8859 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] [instance: 98a9933e-6c22-491a-90bb-d1d2c0bb7df9] Going to try to terminate instance {{(pid=134052) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:45:47.917513 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-3cb710dd-9e36-4ce2-8297-7997c9ef8859 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] 10.222.0.70 "DELETE /compute/v2.1/servers/98a9933e-6c22-491a-90bb-d1d2c0bb7df9" status: 204 len: 0 microversion: 2.1 time: 0.297578 Aug 27 02:45:47.921469 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 634/1272] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:45:47 2022] DELETE /compute/v2.1/servers/98a9933e-6c22-491a-90bb-d1d2c0bb7df9 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:45:47.950713 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0cec611c-02ab-4122-b2d6-fe2c79a89d88 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:47.951460 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-0cec611c-02ab-4122-b2d6-fe2c79a89d88 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] [instance: 484e03a9-aef3-4179-980c-0e7292a05b5a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:47.965560 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0cec611c-02ab-4122-b2d6-fe2c79a89d88 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:47.966098 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0cec611c-02ab-4122-b2d6-fe2c79a89d88 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:47.966746 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0cec611c-02ab-4122-b2d6-fe2c79a89d88 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:47.975774 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0cec611c-02ab-4122-b2d6-fe2c79a89d88 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:47.977824 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0cec611c-02ab-4122-b2d6-fe2c79a89d88 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:47.979910 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0cec611c-02ab-4122-b2d6-fe2c79a89d88 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:47.994741 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-c365caea-bec7-4ec9-ac26-dafc3c77c5e0 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:48.006742 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-c365caea-bec7-4ec9-ac26-dafc3c77c5e0 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:48.010007 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-c365caea-bec7-4ec9-ac26-dafc3c77c5e0 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:48.013451 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c365caea-bec7-4ec9-ac26-dafc3c77c5e0 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/f620f083-7230-471a-87d0-f6d85f8ad087" status: 200 len: 1487 microversion: 2.25 time: 0.486470 Aug 27 02:45:48.015586 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 639/1273] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:45:47 2022] GET /compute/v2.1/servers/f620f083-7230-471a-87d0-f6d85f8ad087 => generated 1487 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:45:48.027188 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-706b4ff2-3cbb-4494-bca5-28b54d66e4f3 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:48.030549 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-706b4ff2-3cbb-4494-bca5-28b54d66e4f3 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: eb11f5d3-ce63-461d-a83f-04f33ce7c16b] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:48.043066 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-706b4ff2-3cbb-4494-bca5-28b54d66e4f3 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:48.048974 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-706b4ff2-3cbb-4494-bca5-28b54d66e4f3 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:48.049943 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-706b4ff2-3cbb-4494-bca5-28b54d66e4f3 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:48.052614 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-706b4ff2-3cbb-4494-bca5-28b54d66e4f3 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:48.053245 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-706b4ff2-3cbb-4494-bca5-28b54d66e4f3 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:48.056375 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-706b4ff2-3cbb-4494-bca5-28b54d66e4f3 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:48.189509 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0cec611c-02ab-4122-b2d6-fe2c79a89d88 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:48.197201 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-706b4ff2-3cbb-4494-bca5-28b54d66e4f3 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6d1646ec094e3297f6f3c51dd72e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b105816fd4e54b9da4973ff721e1fb92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:48.200991 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0cec611c-02ab-4122-b2d6-fe2c79a89d88 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:48.203176 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0cec611c-02ab-4122-b2d6-fe2c79a89d88 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:48.204949 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-0cec611c-02ab-4122-b2d6-fe2c79a89d88 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] 10.222.0.70 "GET /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a" status: 200 len: 1594 microversion: 2.42 time: 0.260642 Aug 27 02:45:48.206891 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 635/1274] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:45:47 2022] GET /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a => generated 1594 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:45:48.208878 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-706b4ff2-3cbb-4494-bca5-28b54d66e4f3 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "GET /compute/v2.1/servers/eb11f5d3-ce63-461d-a83f-04f33ce7c16b" status: 200 len: 1269 microversion: 2.1 time: 0.188377 Aug 27 02:45:48.210605 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 640/1275] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:48 2022] GET /compute/v2.1/servers/eb11f5d3-ce63-461d-a83f-04f33ce7c16b => generated 1269 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:48.225447 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-5a4dfe46-3844-4ce5-a615-f0db09fc441f tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:48.227092 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-5a4dfe46-3844-4ce5-a615-f0db09fc441f tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] [instance: ad971605-1da6-4df8-ae39-be0b82b9dad7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:48.227863 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-64f941e8-b5cf-4a58-af2c-fac66d0e1266 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:48.228735 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-64f941e8-b5cf-4a58-af2c-fac66d0e1266 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] [instance: 98a9933e-6c22-491a-90bb-d1d2c0bb7df9] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:48.235278 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5a4dfe46-3844-4ce5-a615-f0db09fc441f tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:48.235911 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5a4dfe46-3844-4ce5-a615-f0db09fc441f tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:48.236906 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-64f941e8-b5cf-4a58-af2c-fac66d0e1266 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:48.237070 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5a4dfe46-3844-4ce5-a615-f0db09fc441f tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:48.237756 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-64f941e8-b5cf-4a58-af2c-fac66d0e1266 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:48.237990 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5a4dfe46-3844-4ce5-a615-f0db09fc441f tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:48.238521 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-64f941e8-b5cf-4a58-af2c-fac66d0e1266 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:48.238664 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5a4dfe46-3844-4ce5-a615-f0db09fc441f tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:48.239115 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5a4dfe46-3844-4ce5-a615-f0db09fc441f tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:48.239716 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-64f941e8-b5cf-4a58-af2c-fac66d0e1266 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:48.240339 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-64f941e8-b5cf-4a58-af2c-fac66d0e1266 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:48.240963 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-64f941e8-b5cf-4a58-af2c-fac66d0e1266 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:48.739626 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-64f941e8-b5cf-4a58-af2c-fac66d0e1266 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e86c17fe83848e2bc96b7c83ff1cf14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5668e6d96694c62b83f7e8381fe86e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:48.750325 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-64f941e8-b5cf-4a58-af2c-fac66d0e1266 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] 10.222.0.70 "GET /compute/v2.1/servers/98a9933e-6c22-491a-90bb-d1d2c0bb7df9" status: 200 len: 1528 microversion: 2.1 time: 0.540690 Aug 27 02:45:48.751479 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 636/1276] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:48 2022] GET /compute/v2.1/servers/98a9933e-6c22-491a-90bb-d1d2c0bb7df9 => generated 1528 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:48.757916 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b28a6183-c085-413d-8e95-4b89a79eba71 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:48.759404 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b28a6183-c085-413d-8e95-4b89a79eba71 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 70acfe32-deea-46fc-a214-8fdbb9f6cb7b] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:48.764969 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-5a4dfe46-3844-4ce5-a615-f0db09fc441f tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20f8524b5e042fa9968287ab9257c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d563fb57d1644ea9f14603151d0d089', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:48.770040 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b28a6183-c085-413d-8e95-4b89a79eba71 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:48.770613 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b28a6183-c085-413d-8e95-4b89a79eba71 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:48.771054 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b28a6183-c085-413d-8e95-4b89a79eba71 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:48.772549 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b28a6183-c085-413d-8e95-4b89a79eba71 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:48.773004 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b28a6183-c085-413d-8e95-4b89a79eba71 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:48.773438 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b28a6183-c085-413d-8e95-4b89a79eba71 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:48.776125 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-5a4dfe46-3844-4ce5-a615-f0db09fc441f tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] 10.222.0.70 "GET /compute/v2.1/servers/ad971605-1da6-4df8-ae39-be0b82b9dad7" status: 200 len: 1517 microversion: 2.1 time: 0.563861 Aug 27 02:45:48.777378 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 641/1277] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:48 2022] GET /compute/v2.1/servers/ad971605-1da6-4df8-ae39-be0b82b9dad7 => generated 1517 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:48.782387 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-00257c51-76e6-465b-b4cc-8b6e29c0dda0 req-bb3951ff-2564-45eb-a933-b64ef16f36ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98a9933e-6c22-491a-90bb-d1d2c0bb7df9", "name": "network-vif-plugged", "status": "completed", "tag": "bb051cf4-2ed9-43d4-ae67-717a893d0979"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:45:48.792799 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-00257c51-76e6-465b-b4cc-8b6e29c0dda0 req-bb3951ff-2564-45eb-a933-b64ef16f36ad service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:48.794091 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-00257c51-76e6-465b-b4cc-8b6e29c0dda0 req-bb3951ff-2564-45eb-a933-b64ef16f36ad service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:48.794726 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-00257c51-76e6-465b-b4cc-8b6e29c0dda0 req-bb3951ff-2564-45eb-a933-b64ef16f36ad service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:48.810894 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-00257c51-76e6-465b-b4cc-8b6e29c0dda0 req-bb3951ff-2564-45eb-a933-b64ef16f36ad service nova] Creating event network-vif-plugged:bb051cf4-2ed9-43d4-ae67-717a893d0979 for instance 98a9933e-6c22-491a-90bb-d1d2c0bb7df9 on n-h1-852278-4 Aug 27 02:45:48.815984 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-00257c51-76e6-465b-b4cc-8b6e29c0dda0 req-bb3951ff-2564-45eb-a933-b64ef16f36ad service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037168 Aug 27 02:45:48.817028 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 642/1278] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:45:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:45:48.822865 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e1f611f0-6557-4fa2-84b9-243aea5e7fe2 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:48.823654 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-e1f611f0-6557-4fa2-84b9-243aea5e7fe2 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] [instance: 4eaf21fb-2b59-4e0e-abd4-72c8e422534d] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:48.831045 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e1f611f0-6557-4fa2-84b9-243aea5e7fe2 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:48.831805 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e1f611f0-6557-4fa2-84b9-243aea5e7fe2 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:48.832472 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e1f611f0-6557-4fa2-84b9-243aea5e7fe2 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:48.833363 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e1f611f0-6557-4fa2-84b9-243aea5e7fe2 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:48.833989 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e1f611f0-6557-4fa2-84b9-243aea5e7fe2 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:48.834577 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e1f611f0-6557-4fa2-84b9-243aea5e7fe2 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:48.966849 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b28a6183-c085-413d-8e95-4b89a79eba71 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:48.979839 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b28a6183-c085-413d-8e95-4b89a79eba71 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b" status: 200 len: 1197 microversion: 2.1 time: 0.226645 Aug 27 02:45:49.001039 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 637/1279] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:48 2022] GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b => generated 1197 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:49.031445 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e1f611f0-6557-4fa2-84b9-243aea5e7fe2 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20f8524b5e042fa9968287ab9257c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d563fb57d1644ea9f14603151d0d089', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:49.037970 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e8adffa5-e223-4cc9-8dfe-6c395952f487 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:49.038634 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-e8adffa5-e223-4cc9-8dfe-6c395952f487 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: f620f083-7230-471a-87d0-f6d85f8ad087] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:49.040354 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e1f611f0-6557-4fa2-84b9-243aea5e7fe2 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] 10.222.0.70 "GET /compute/v2.1/servers/4eaf21fb-2b59-4e0e-abd4-72c8e422534d" status: 200 len: 1516 microversion: 2.1 time: 0.221959 Aug 27 02:45:49.041104 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 643/1280] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:48 2022] GET /compute/v2.1/servers/4eaf21fb-2b59-4e0e-abd4-72c8e422534d => generated 1516 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:49.045265 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e8adffa5-e223-4cc9-8dfe-6c395952f487 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:49.045765 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e8adffa5-e223-4cc9-8dfe-6c395952f487 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:49.046199 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e8adffa5-e223-4cc9-8dfe-6c395952f487 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:49.046926 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e8adffa5-e223-4cc9-8dfe-6c395952f487 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:49.047375 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e8adffa5-e223-4cc9-8dfe-6c395952f487 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:49.047796 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e8adffa5-e223-4cc9-8dfe-6c395952f487 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:49.061021 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-07777f82-91f7-497a-b33b-b51e3416e435 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:49.061896 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-07777f82-91f7-497a-b33b-b51e3416e435 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] [instance: 4351cb89-8e57-47d5-9870-87a43e21ea57] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:49.068278 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-07777f82-91f7-497a-b33b-b51e3416e435 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:49.068806 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-07777f82-91f7-497a-b33b-b51e3416e435 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:49.069244 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-07777f82-91f7-497a-b33b-b51e3416e435 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:49.069950 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-07777f82-91f7-497a-b33b-b51e3416e435 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:49.070632 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-07777f82-91f7-497a-b33b-b51e3416e435 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:49.071055 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-07777f82-91f7-497a-b33b-b51e3416e435 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:49.510098 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:45:49.546507 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=6 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:45:49.644625 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-e8adffa5-e223-4cc9-8dfe-6c395952f487 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:49.653611 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-e8adffa5-e223-4cc9-8dfe-6c395952f487 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:49.655263 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-e8adffa5-e223-4cc9-8dfe-6c395952f487 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:49.656792 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e8adffa5-e223-4cc9-8dfe-6c395952f487 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/f620f083-7230-471a-87d0-f6d85f8ad087" status: 200 len: 1487 microversion: 2.25 time: 0.623035 Aug 27 02:45:49.657730 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 638/1281] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:45:49 2022] GET /compute/v2.1/servers/f620f083-7230-471a-87d0-f6d85f8ad087 => generated 1487 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:45:49.665395 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-07777f82-91f7-497a-b33b-b51e3416e435 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20f8524b5e042fa9968287ab9257c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d563fb57d1644ea9f14603151d0d089', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:49.669270 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c93a21df-b40c-4095-9015-bc9b1ac51b8d tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:49.670239 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-c93a21df-b40c-4095-9015-bc9b1ac51b8d tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: eb11f5d3-ce63-461d-a83f-04f33ce7c16b] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:49.675268 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-07777f82-91f7-497a-b33b-b51e3416e435 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] 10.222.0.70 "GET /compute/v2.1/servers/4351cb89-8e57-47d5-9870-87a43e21ea57" status: 200 len: 1516 microversion: 2.1 time: 0.619009 Aug 27 02:45:49.688347 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 644/1282] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:49 2022] GET /compute/v2.1/servers/4351cb89-8e57-47d5-9870-87a43e21ea57 => generated 1516 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:45:49.688569 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c93a21df-b40c-4095-9015-bc9b1ac51b8d tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:49.688569 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c93a21df-b40c-4095-9015-bc9b1ac51b8d tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:49.688569 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c93a21df-b40c-4095-9015-bc9b1ac51b8d tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:49.691493 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c93a21df-b40c-4095-9015-bc9b1ac51b8d tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:49.691973 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c93a21df-b40c-4095-9015-bc9b1ac51b8d tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:49.692498 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c93a21df-b40c-4095-9015-bc9b1ac51b8d tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:49.694183 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d4dfeb55-6696-4e84-b19a-54562374ffe7 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:49.694881 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d4dfeb55-6696-4e84-b19a-54562374ffe7 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] [instance: 484e03a9-aef3-4179-980c-0e7292a05b5a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:49.701272 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d4dfeb55-6696-4e84-b19a-54562374ffe7 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:49.702679 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d4dfeb55-6696-4e84-b19a-54562374ffe7 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:49.703915 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d4dfeb55-6696-4e84-b19a-54562374ffe7 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:49.704883 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d4dfeb55-6696-4e84-b19a-54562374ffe7 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:49.705544 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d4dfeb55-6696-4e84-b19a-54562374ffe7 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:49.706200 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d4dfeb55-6696-4e84-b19a-54562374ffe7 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:49.860045 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-c93a21df-b40c-4095-9015-bc9b1ac51b8d tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6d1646ec094e3297f6f3c51dd72e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b105816fd4e54b9da4973ff721e1fb92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:49.868252 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c93a21df-b40c-4095-9015-bc9b1ac51b8d tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "GET /compute/v2.1/servers/eb11f5d3-ce63-461d-a83f-04f33ce7c16b" status: 200 len: 1275 microversion: 2.1 time: 0.204669 Aug 27 02:45:49.869143 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 639/1283] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:49 2022] GET /compute/v2.1/servers/eb11f5d3-ce63-461d-a83f-04f33ce7c16b => generated 1275 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:49.873779 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-7dd9bfe8-1a0c-4a72-b75e-84c591929421 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:49.874338 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-7dd9bfe8-1a0c-4a72-b75e-84c591929421 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] [instance: 4351cb89-8e57-47d5-9870-87a43e21ea57] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:49.888230 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7dd9bfe8-1a0c-4a72-b75e-84c591929421 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:49.888912 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7dd9bfe8-1a0c-4a72-b75e-84c591929421 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:49.889764 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7dd9bfe8-1a0c-4a72-b75e-84c591929421 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:49.890201 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7dd9bfe8-1a0c-4a72-b75e-84c591929421 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:49.890710 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7dd9bfe8-1a0c-4a72-b75e-84c591929421 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:49.891199 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7dd9bfe8-1a0c-4a72-b75e-84c591929421 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:49.926415 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-7dd9bfe8-1a0c-4a72-b75e-84c591929421 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] [instance: 4351cb89-8e57-47d5-9870-87a43e21ea57] Going to try to terminate instance {{(pid=134052) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:45:50.033406 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-7dd9bfe8-1a0c-4a72-b75e-84c591929421 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] 10.222.0.70 "DELETE /compute/v2.1/servers/4351cb89-8e57-47d5-9870-87a43e21ea57" status: 204 len: 0 microversion: 2.1 time: 0.162987 Aug 27 02:45:50.034148 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 640/1284] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:45:49 2022] DELETE /compute/v2.1/servers/4351cb89-8e57-47d5-9870-87a43e21ea57 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:45:50.039491 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-7659f0e6-9895-45bf-a68c-85d583335871 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:50.040178 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-7659f0e6-9895-45bf-a68c-85d583335871 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] [instance: 98a9933e-6c22-491a-90bb-d1d2c0bb7df9] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:50.046624 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7659f0e6-9895-45bf-a68c-85d583335871 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:50.047110 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7659f0e6-9895-45bf-a68c-85d583335871 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:50.047533 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7659f0e6-9895-45bf-a68c-85d583335871 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:50.048281 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7659f0e6-9895-45bf-a68c-85d583335871 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:50.048750 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7659f0e6-9895-45bf-a68c-85d583335871 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:50.049192 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7659f0e6-9895-45bf-a68c-85d583335871 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:50.083142 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d4dfeb55-6696-4e84-b19a-54562374ffe7 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:50.146178 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d4dfeb55-6696-4e84-b19a-54562374ffe7 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:50.151357 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d4dfeb55-6696-4e84-b19a-54562374ffe7 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:50.152885 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d4dfeb55-6696-4e84-b19a-54562374ffe7 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] 10.222.0.70 "GET /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a" status: 200 len: 1661 microversion: 2.42 time: 0.465928 Aug 27 02:45:50.157616 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 645/1285] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:45:49 2022] GET /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a => generated 1661 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:45:50.170531 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-10ad8a76-2c8d-44c8-a67f-bfa8ce471390 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:50.173714 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-10ad8a76-2c8d-44c8-a67f-bfa8ce471390 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 70acfe32-deea-46fc-a214-8fdbb9f6cb7b] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:50.183707 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-10ad8a76-2c8d-44c8-a67f-bfa8ce471390 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:50.184458 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-10ad8a76-2c8d-44c8-a67f-bfa8ce471390 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:50.185067 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-10ad8a76-2c8d-44c8-a67f-bfa8ce471390 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:50.186192 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-10ad8a76-2c8d-44c8-a67f-bfa8ce471390 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:50.187266 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-10ad8a76-2c8d-44c8-a67f-bfa8ce471390 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:50.187887 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-10ad8a76-2c8d-44c8-a67f-bfa8ce471390 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:50.445782 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-7659f0e6-9895-45bf-a68c-85d583335871 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e86c17fe83848e2bc96b7c83ff1cf14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5668e6d96694c62b83f7e8381fe86e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:50.479978 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-7659f0e6-9895-45bf-a68c-85d583335871 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] 10.222.0.70 "GET /compute/v2.1/servers/98a9933e-6c22-491a-90bb-d1d2c0bb7df9" status: 200 len: 1528 microversion: 2.1 time: 0.424286 Aug 27 02:45:50.482577 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 641/1286] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:50 2022] GET /compute/v2.1/servers/98a9933e-6c22-491a-90bb-d1d2c0bb7df9 => generated 1528 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:50.493523 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-42e03c40-aa8e-4d4d-b6b7-2c19bfbef628 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:50.496709 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-42e03c40-aa8e-4d4d-b6b7-2c19bfbef628 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] [instance: 4351cb89-8e57-47d5-9870-87a43e21ea57] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:50.517517 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-42e03c40-aa8e-4d4d-b6b7-2c19bfbef628 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:50.519135 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-42e03c40-aa8e-4d4d-b6b7-2c19bfbef628 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:50.521568 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-42e03c40-aa8e-4d4d-b6b7-2c19bfbef628 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:50.523711 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-42e03c40-aa8e-4d4d-b6b7-2c19bfbef628 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:50.526243 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-42e03c40-aa8e-4d4d-b6b7-2c19bfbef628 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:50.526966 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-42e03c40-aa8e-4d4d-b6b7-2c19bfbef628 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:50.570283 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-10ad8a76-2c8d-44c8-a67f-bfa8ce471390 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:50.578572 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-10ad8a76-2c8d-44c8-a67f-bfa8ce471390 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b" status: 200 len: 1197 microversion: 2.1 time: 0.415665 Aug 27 02:45:50.589623 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 646/1287] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:50 2022] GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b => generated 1197 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:50.679434 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7c8b87f9-abb8-40dd-9a9d-323cbcc0f7f7 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:50.680383 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-7c8b87f9-abb8-40dd-9a9d-323cbcc0f7f7 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: f620f083-7230-471a-87d0-f6d85f8ad087] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:50.696664 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7c8b87f9-abb8-40dd-9a9d-323cbcc0f7f7 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:50.697506 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7c8b87f9-abb8-40dd-9a9d-323cbcc0f7f7 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:50.698110 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7c8b87f9-abb8-40dd-9a9d-323cbcc0f7f7 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:50.699038 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7c8b87f9-abb8-40dd-9a9d-323cbcc0f7f7 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:50.699643 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7c8b87f9-abb8-40dd-9a9d-323cbcc0f7f7 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:50.700222 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7c8b87f9-abb8-40dd-9a9d-323cbcc0f7f7 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:51.071672 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-42e03c40-aa8e-4d4d-b6b7-2c19bfbef628 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20f8524b5e042fa9968287ab9257c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d563fb57d1644ea9f14603151d0d089', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:51.080773 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-42e03c40-aa8e-4d4d-b6b7-2c19bfbef628 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] 10.222.0.70 "GET /compute/v2.1/servers/4351cb89-8e57-47d5-9870-87a43e21ea57" status: 200 len: 1522 microversion: 2.1 time: 0.595927 Aug 27 02:45:51.088009 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 642/1288] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:50 2022] GET /compute/v2.1/servers/4351cb89-8e57-47d5-9870-87a43e21ea57 => generated 1522 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:51.088009 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-01d69b70-7ebe-4272-b043-177631702059 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:51.088009 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-01d69b70-7ebe-4272-b043-177631702059 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: eb11f5d3-ce63-461d-a83f-04f33ce7c16b] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:51.094061 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-01d69b70-7ebe-4272-b043-177631702059 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:51.094562 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-01d69b70-7ebe-4272-b043-177631702059 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:51.095040 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-01d69b70-7ebe-4272-b043-177631702059 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:51.095778 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-01d69b70-7ebe-4272-b043-177631702059 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:51.096232 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-01d69b70-7ebe-4272-b043-177631702059 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:51.096676 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-01d69b70-7ebe-4272-b043-177631702059 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:51.102778 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:45:51.115635 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-7c8b87f9-abb8-40dd-9a9d-323cbcc0f7f7 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:51.131464 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-7c8b87f9-abb8-40dd-9a9d-323cbcc0f7f7 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:51.134567 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-7c8b87f9-abb8-40dd-9a9d-323cbcc0f7f7 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:51.136680 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-7c8b87f9-abb8-40dd-9a9d-323cbcc0f7f7 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/f620f083-7230-471a-87d0-f6d85f8ad087" status: 200 len: 1487 microversion: 2.25 time: 0.461088 Aug 27 02:45:51.148348 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 647/1289] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:45:50 2022] GET /compute/v2.1/servers/f620f083-7230-471a-87d0-f6d85f8ad087 => generated 1487 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:45:51.153664 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-7c94ae46-2ae4-4ad7-a26a-41c2ed9d278b req-9acae247-ed1c-44ae-9404-9135c0f2bc36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98a9933e-6c22-491a-90bb-d1d2c0bb7df9", "name": "network-vif-unplugged", "status": "completed", "tag": "bb051cf4-2ed9-43d4-ae67-717a893d0979"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:45:51.170198 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-7c94ae46-2ae4-4ad7-a26a-41c2ed9d278b req-9acae247-ed1c-44ae-9404-9135c0f2bc36 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:51.170941 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-7c94ae46-2ae4-4ad7-a26a-41c2ed9d278b req-9acae247-ed1c-44ae-9404-9135c0f2bc36 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:51.171555 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-7c94ae46-2ae4-4ad7-a26a-41c2ed9d278b req-9acae247-ed1c-44ae-9404-9135c0f2bc36 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:51.176083 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:45:51.185789 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-7c94ae46-2ae4-4ad7-a26a-41c2ed9d278b req-9acae247-ed1c-44ae-9404-9135c0f2bc36 service nova] Creating event network-vif-unplugged:bb051cf4-2ed9-43d4-ae67-717a893d0979 for instance 98a9933e-6c22-491a-90bb-d1d2c0bb7df9 on n-h1-852278-4 Aug 27 02:45:51.193806 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-7c94ae46-2ae4-4ad7-a26a-41c2ed9d278b req-9acae247-ed1c-44ae-9404-9135c0f2bc36 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048502 Aug 27 02:45:51.194580 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 648/1290] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:45:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:45:51.201703 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4fa4ff6f-a30a-4983-931a-25559db768f0 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:51.202644 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-4fa4ff6f-a30a-4983-931a-25559db768f0 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] [instance: 484e03a9-aef3-4179-980c-0e7292a05b5a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:51.210677 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4fa4ff6f-a30a-4983-931a-25559db768f0 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:51.211680 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4fa4ff6f-a30a-4983-931a-25559db768f0 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:51.212275 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4fa4ff6f-a30a-4983-931a-25559db768f0 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:51.213165 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4fa4ff6f-a30a-4983-931a-25559db768f0 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:51.213771 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4fa4ff6f-a30a-4983-931a-25559db768f0 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:51.214346 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4fa4ff6f-a30a-4983-931a-25559db768f0 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:51.693218 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-01d69b70-7ebe-4272-b043-177631702059 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6d1646ec094e3297f6f3c51dd72e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b105816fd4e54b9da4973ff721e1fb92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:51.719735 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-01d69b70-7ebe-4272-b043-177631702059 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "GET /compute/v2.1/servers/eb11f5d3-ce63-461d-a83f-04f33ce7c16b" status: 200 len: 1317 microversion: 2.1 time: 0.636985 Aug 27 02:45:51.726878 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 643/1291] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:51 2022] GET /compute/v2.1/servers/eb11f5d3-ce63-461d-a83f-04f33ce7c16b => generated 1317 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:51.733549 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d31e03b9-0393-4b91-ba3f-4767323e6207 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:51.734273 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d31e03b9-0393-4b91-ba3f-4767323e6207 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] [instance: 98a9933e-6c22-491a-90bb-d1d2c0bb7df9] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:51.764666 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d31e03b9-0393-4b91-ba3f-4767323e6207 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:51.765532 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d31e03b9-0393-4b91-ba3f-4767323e6207 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:51.766110 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d31e03b9-0393-4b91-ba3f-4767323e6207 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:51.767059 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d31e03b9-0393-4b91-ba3f-4767323e6207 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:51.767560 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d31e03b9-0393-4b91-ba3f-4767323e6207 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:51.768199 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d31e03b9-0393-4b91-ba3f-4767323e6207 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:51.843166 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-4fa4ff6f-a30a-4983-931a-25559db768f0 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:51.856736 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-4fa4ff6f-a30a-4983-931a-25559db768f0 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:51.865865 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-4fa4ff6f-a30a-4983-931a-25559db768f0 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:51.867554 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-4fa4ff6f-a30a-4983-931a-25559db768f0 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] 10.222.0.70 "GET /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a" status: 200 len: 1707 microversion: 2.42 time: 0.671455 Aug 27 02:45:51.869928 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 649/1292] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:45:51 2022] GET /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a => generated 1707 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:45:51.876264 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-07da8b49-73e5-46be-a8c6-02a13e622d57 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:51.877461 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-07da8b49-73e5-46be-a8c6-02a13e622d57 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 70acfe32-deea-46fc-a214-8fdbb9f6cb7b] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:51.885698 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-07da8b49-73e5-46be-a8c6-02a13e622d57 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:51.886730 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-07da8b49-73e5-46be-a8c6-02a13e622d57 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:51.887435 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-07da8b49-73e5-46be-a8c6-02a13e622d57 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:51.888426 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-07da8b49-73e5-46be-a8c6-02a13e622d57 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:51.889220 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-07da8b49-73e5-46be-a8c6-02a13e622d57 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:51.889862 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-07da8b49-73e5-46be-a8c6-02a13e622d57 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:52.296345 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-d31e03b9-0393-4b91-ba3f-4767323e6207 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e86c17fe83848e2bc96b7c83ff1cf14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5668e6d96694c62b83f7e8381fe86e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:52.310459 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d31e03b9-0393-4b91-ba3f-4767323e6207 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] 10.222.0.70 "GET /compute/v2.1/servers/98a9933e-6c22-491a-90bb-d1d2c0bb7df9" status: 200 len: 1528 microversion: 2.1 time: 0.582265 Aug 27 02:45:52.311418 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 644/1293] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:51 2022] GET /compute/v2.1/servers/98a9933e-6c22-491a-90bb-d1d2c0bb7df9 => generated 1528 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:52.322000 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-753e9591-43ab-4753-abb3-3e03b66f7c4c tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:52.322559 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-753e9591-43ab-4753-abb3-3e03b66f7c4c tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] [instance: 4351cb89-8e57-47d5-9870-87a43e21ea57] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:52.340485 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-753e9591-43ab-4753-abb3-3e03b66f7c4c tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:52.340976 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-753e9591-43ab-4753-abb3-3e03b66f7c4c tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:52.341400 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-753e9591-43ab-4753-abb3-3e03b66f7c4c tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:52.345694 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-753e9591-43ab-4753-abb3-3e03b66f7c4c tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:52.346368 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-753e9591-43ab-4753-abb3-3e03b66f7c4c tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:52.346963 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-753e9591-43ab-4753-abb3-3e03b66f7c4c tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:52.488112 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-07da8b49-73e5-46be-a8c6-02a13e622d57 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:52.499746 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-07da8b49-73e5-46be-a8c6-02a13e622d57 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b" status: 200 len: 1197 microversion: 2.1 time: 0.627956 Aug 27 02:45:52.504018 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 650/1294] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:51 2022] GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b => generated 1197 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:52.515066 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8c1bb4fd-47b6-4be0-8e68-0e796727f52a tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:52.518045 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-8c1bb4fd-47b6-4be0-8e68-0e796727f52a tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: f620f083-7230-471a-87d0-f6d85f8ad087] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:52.532453 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8c1bb4fd-47b6-4be0-8e68-0e796727f52a tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:52.535769 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8c1bb4fd-47b6-4be0-8e68-0e796727f52a tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:52.536674 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8c1bb4fd-47b6-4be0-8e68-0e796727f52a tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:52.541424 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8c1bb4fd-47b6-4be0-8e68-0e796727f52a tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:52.542261 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8c1bb4fd-47b6-4be0-8e68-0e796727f52a tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:52.543308 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8c1bb4fd-47b6-4be0-8e68-0e796727f52a tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:52.775573 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-753e9591-43ab-4753-abb3-3e03b66f7c4c tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20f8524b5e042fa9968287ab9257c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d563fb57d1644ea9f14603151d0d089', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:52.789006 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-753e9591-43ab-4753-abb3-3e03b66f7c4c tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] 10.222.0.70 "GET /compute/v2.1/servers/4351cb89-8e57-47d5-9870-87a43e21ea57" status: 200 len: 1522 microversion: 2.1 time: 0.476040 Aug 27 02:45:52.795360 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 645/1295] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:52 2022] GET /compute/v2.1/servers/4351cb89-8e57-47d5-9870-87a43e21ea57 => generated 1522 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:52.800353 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-c922cc8d-2fff-449d-9e6e-46a9eed446d9 req-a9bbfde9-3d92-4efd-8b23-614a195deab5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98a9933e-6c22-491a-90bb-d1d2c0bb7df9", "name": "network-vif-deleted", "tag": "bb051cf4-2ed9-43d4-ae67-717a893d0979"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:45:52.821134 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-c922cc8d-2fff-449d-9e6e-46a9eed446d9 req-a9bbfde9-3d92-4efd-8b23-614a195deab5 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:52.821618 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-c922cc8d-2fff-449d-9e6e-46a9eed446d9 req-a9bbfde9-3d92-4efd-8b23-614a195deab5 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:52.822055 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-c922cc8d-2fff-449d-9e6e-46a9eed446d9 req-a9bbfde9-3d92-4efd-8b23-614a195deab5 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:52.842840 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-c922cc8d-2fff-449d-9e6e-46a9eed446d9 req-a9bbfde9-3d92-4efd-8b23-614a195deab5 service nova] Creating event network-vif-deleted:bb051cf4-2ed9-43d4-ae67-717a893d0979 for instance 98a9933e-6c22-491a-90bb-d1d2c0bb7df9 on n-h1-852278-4 Aug 27 02:45:52.848712 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-c922cc8d-2fff-449d-9e6e-46a9eed446d9 req-a9bbfde9-3d92-4efd-8b23-614a195deab5 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051770 Aug 27 02:45:52.849836 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 646/1296] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:45:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:45:52.856983 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ba3d5fcc-eddc-4b11-8f82-7a3e63e3c0fd tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:52.858102 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-ba3d5fcc-eddc-4b11-8f82-7a3e63e3c0fd tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: eb11f5d3-ce63-461d-a83f-04f33ce7c16b] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:52.866196 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ba3d5fcc-eddc-4b11-8f82-7a3e63e3c0fd tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:52.867129 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ba3d5fcc-eddc-4b11-8f82-7a3e63e3c0fd tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:52.867736 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ba3d5fcc-eddc-4b11-8f82-7a3e63e3c0fd tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:52.868858 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ba3d5fcc-eddc-4b11-8f82-7a3e63e3c0fd tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:52.869319 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ba3d5fcc-eddc-4b11-8f82-7a3e63e3c0fd tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:52.869739 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ba3d5fcc-eddc-4b11-8f82-7a3e63e3c0fd tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:53.113447 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-8c1bb4fd-47b6-4be0-8e68-0e796727f52a tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:53.127337 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-8c1bb4fd-47b6-4be0-8e68-0e796727f52a tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:53.129470 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-8c1bb4fd-47b6-4be0-8e68-0e796727f52a tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:53.130847 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-8c1bb4fd-47b6-4be0-8e68-0e796727f52a tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/f620f083-7230-471a-87d0-f6d85f8ad087" status: 200 len: 1487 microversion: 2.25 time: 0.625401 Aug 27 02:45:53.144339 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 651/1297] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:45:52 2022] GET /compute/v2.1/servers/f620f083-7230-471a-87d0-f6d85f8ad087 => generated 1487 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:45:53.157948 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a6fe5523-c33d-40c6-930f-28dc01d075e8 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:53.158828 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-a6fe5523-c33d-40c6-930f-28dc01d075e8 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] [instance: 484e03a9-aef3-4179-980c-0e7292a05b5a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:53.181983 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a6fe5523-c33d-40c6-930f-28dc01d075e8 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:53.184773 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a6fe5523-c33d-40c6-930f-28dc01d075e8 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:53.185693 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a6fe5523-c33d-40c6-930f-28dc01d075e8 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:53.188483 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a6fe5523-c33d-40c6-930f-28dc01d075e8 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:53.189675 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a6fe5523-c33d-40c6-930f-28dc01d075e8 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:53.190252 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a6fe5523-c33d-40c6-930f-28dc01d075e8 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:53.386094 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-ba3d5fcc-eddc-4b11-8f82-7a3e63e3c0fd tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6d1646ec094e3297f6f3c51dd72e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b105816fd4e54b9da4973ff721e1fb92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:53.395961 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ba3d5fcc-eddc-4b11-8f82-7a3e63e3c0fd tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "GET /compute/v2.1/servers/eb11f5d3-ce63-461d-a83f-04f33ce7c16b" status: 200 len: 1317 microversion: 2.1 time: 0.543856 Aug 27 02:45:53.411137 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 647/1298] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:52 2022] GET /compute/v2.1/servers/eb11f5d3-ce63-461d-a83f-04f33ce7c16b => generated 1317 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:53.412287 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-2e6be4e3-7b1b-4107-91a3-d62ffa684744 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:53.413204 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-2e6be4e3-7b1b-4107-91a3-d62ffa684744 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] [instance: 98a9933e-6c22-491a-90bb-d1d2c0bb7df9] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:53.420964 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2e6be4e3-7b1b-4107-91a3-d62ffa684744 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:53.421948 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2e6be4e3-7b1b-4107-91a3-d62ffa684744 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:53.423705 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2e6be4e3-7b1b-4107-91a3-d62ffa684744 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:53.425165 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2e6be4e3-7b1b-4107-91a3-d62ffa684744 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:53.425853 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2e6be4e3-7b1b-4107-91a3-d62ffa684744 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:53.426379 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2e6be4e3-7b1b-4107-91a3-d62ffa684744 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:53.470776 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2e6be4e3-7b1b-4107-91a3-d62ffa684744 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:53.472183 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2e6be4e3-7b1b-4107-91a3-d62ffa684744 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:53.472928 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2e6be4e3-7b1b-4107-91a3-d62ffa684744 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:53.473920 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.instance [None req-2e6be4e3-7b1b-4107-91a3-d62ffa684744 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lazy-loading 'fault' on Instance uuid 98a9933e-6c22-491a-90bb-d1d2c0bb7df9 {{(pid=134052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:45:53.563123 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-2e6be4e3-7b1b-4107-91a3-d62ffa684744 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e86c17fe83848e2bc96b7c83ff1cf14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5668e6d96694c62b83f7e8381fe86e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:53.572259 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-2e6be4e3-7b1b-4107-91a3-d62ffa684744 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] 10.222.0.70 "GET /compute/v2.1/servers/98a9933e-6c22-491a-90bb-d1d2c0bb7df9" status: 200 len: 1315 microversion: 2.1 time: 0.165415 Aug 27 02:45:53.572779 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 648/1299] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:53 2022] GET /compute/v2.1/servers/98a9933e-6c22-491a-90bb-d1d2c0bb7df9 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:53.577933 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-40eafc0a-eca0-4ec4-bc0f-d24ad6793a50 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:53.578815 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-40eafc0a-eca0-4ec4-bc0f-d24ad6793a50 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 70acfe32-deea-46fc-a214-8fdbb9f6cb7b] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:53.586446 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-40eafc0a-eca0-4ec4-bc0f-d24ad6793a50 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:53.600449 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-40eafc0a-eca0-4ec4-bc0f-d24ad6793a50 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:53.601363 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-40eafc0a-eca0-4ec4-bc0f-d24ad6793a50 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:53.602388 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-40eafc0a-eca0-4ec4-bc0f-d24ad6793a50 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:53.606913 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-40eafc0a-eca0-4ec4-bc0f-d24ad6793a50 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:53.608337 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-40eafc0a-eca0-4ec4-bc0f-d24ad6793a50 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:53.717887 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-a6fe5523-c33d-40c6-930f-28dc01d075e8 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:53.732674 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-a6fe5523-c33d-40c6-930f-28dc01d075e8 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:53.736818 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-a6fe5523-c33d-40c6-930f-28dc01d075e8 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:53.738869 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a6fe5523-c33d-40c6-930f-28dc01d075e8 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] 10.222.0.70 "GET /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a" status: 200 len: 1707 microversion: 2.42 time: 0.605563 Aug 27 02:45:53.757873 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 652/1300] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:45:53 2022] GET /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a => generated 1707 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:45:53.817251 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-210c7572-1bdf-4872-9648-68f0e0f81998 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:53.818283 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-210c7572-1bdf-4872-9648-68f0e0f81998 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] [instance: 4351cb89-8e57-47d5-9870-87a43e21ea57] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:53.827729 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-210c7572-1bdf-4872-9648-68f0e0f81998 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:53.828418 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-210c7572-1bdf-4872-9648-68f0e0f81998 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:53.828985 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-210c7572-1bdf-4872-9648-68f0e0f81998 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:53.831855 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-210c7572-1bdf-4872-9648-68f0e0f81998 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:53.832843 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-210c7572-1bdf-4872-9648-68f0e0f81998 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:53.833561 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-210c7572-1bdf-4872-9648-68f0e0f81998 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:53.895178 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:45:53.899821 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-210c7572-1bdf-4872-9648-68f0e0f81998 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:53.900921 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-210c7572-1bdf-4872-9648-68f0e0f81998 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:53.901781 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-210c7572-1bdf-4872-9648-68f0e0f81998 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:53.902311 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.objects.instance [None req-210c7572-1bdf-4872-9648-68f0e0f81998 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lazy-loading 'fault' on Instance uuid 4351cb89-8e57-47d5-9870-87a43e21ea57 {{(pid=134051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:45:54.217855 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-210c7572-1bdf-4872-9648-68f0e0f81998 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20f8524b5e042fa9968287ab9257c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d563fb57d1644ea9f14603151d0d089', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:54.235581 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-210c7572-1bdf-4872-9648-68f0e0f81998 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] 10.222.0.70 "GET /compute/v2.1/servers/4351cb89-8e57-47d5-9870-87a43e21ea57" status: 200 len: 1313 microversion: 2.1 time: 0.428107 Aug 27 02:45:54.236958 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 653/1301] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:53 2022] GET /compute/v2.1/servers/4351cb89-8e57-47d5-9870-87a43e21ea57 => generated 1313 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:54.253887 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-71cbdcc8-4fa3-4d8e-bc48-92295ffd2045 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:54.254750 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-71cbdcc8-4fa3-4d8e-bc48-92295ffd2045 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: f620f083-7230-471a-87d0-f6d85f8ad087] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:54.263507 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-71cbdcc8-4fa3-4d8e-bc48-92295ffd2045 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:54.264286 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-71cbdcc8-4fa3-4d8e-bc48-92295ffd2045 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:54.264928 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-71cbdcc8-4fa3-4d8e-bc48-92295ffd2045 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:54.266018 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-71cbdcc8-4fa3-4d8e-bc48-92295ffd2045 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:54.266653 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-71cbdcc8-4fa3-4d8e-bc48-92295ffd2045 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:54.267232 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-71cbdcc8-4fa3-4d8e-bc48-92295ffd2045 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:54.329171 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-40eafc0a-eca0-4ec4-bc0f-d24ad6793a50 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:54.341831 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-40eafc0a-eca0-4ec4-bc0f-d24ad6793a50 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b" status: 200 len: 1197 microversion: 2.1 time: 0.767192 Aug 27 02:45:54.343855 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 649/1302] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:53 2022] GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b => generated 1197 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:54.418747 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-dff5e10e-4d52-4fa6-b2d5-532b9eebd9db tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:54.420266 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-dff5e10e-4d52-4fa6-b2d5-532b9eebd9db tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: eb11f5d3-ce63-461d-a83f-04f33ce7c16b] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:54.446610 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dff5e10e-4d52-4fa6-b2d5-532b9eebd9db tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:54.446961 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dff5e10e-4d52-4fa6-b2d5-532b9eebd9db tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:54.447594 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dff5e10e-4d52-4fa6-b2d5-532b9eebd9db tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:54.448882 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dff5e10e-4d52-4fa6-b2d5-532b9eebd9db tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:54.449493 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dff5e10e-4d52-4fa6-b2d5-532b9eebd9db tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:54.450060 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dff5e10e-4d52-4fa6-b2d5-532b9eebd9db tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:54.754302 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-71cbdcc8-4fa3-4d8e-bc48-92295ffd2045 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:54.772241 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-71cbdcc8-4fa3-4d8e-bc48-92295ffd2045 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:54.775661 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-71cbdcc8-4fa3-4d8e-bc48-92295ffd2045 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:54.777025 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-71cbdcc8-4fa3-4d8e-bc48-92295ffd2045 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/f620f083-7230-471a-87d0-f6d85f8ad087" status: 200 len: 1487 microversion: 2.25 time: 0.538843 Aug 27 02:45:54.788763 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 654/1303] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:45:54 2022] GET /compute/v2.1/servers/f620f083-7230-471a-87d0-f6d85f8ad087 => generated 1487 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:45:54.798616 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-bd17c3a9-4188-44b5-b705-fe940bab11e8 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:54.799553 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-bd17c3a9-4188-44b5-b705-fe940bab11e8 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] [instance: 98a9933e-6c22-491a-90bb-d1d2c0bb7df9] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:54.806740 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bd17c3a9-4188-44b5-b705-fe940bab11e8 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:54.807443 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bd17c3a9-4188-44b5-b705-fe940bab11e8 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:54.808517 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bd17c3a9-4188-44b5-b705-fe940bab11e8 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:54.809408 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bd17c3a9-4188-44b5-b705-fe940bab11e8 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:54.810026 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bd17c3a9-4188-44b5-b705-fe940bab11e8 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:54.810730 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bd17c3a9-4188-44b5-b705-fe940bab11e8 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:54.836877 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-bd17c3a9-4188-44b5-b705-fe940bab11e8 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] HTTP exception thrown: Instance 98a9933e-6c22-491a-90bb-d1d2c0bb7df9 could not be found. Aug 27 02:45:54.838501 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-bd17c3a9-4188-44b5-b705-fe940bab11e8 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Request method failure captured: Aug 27 02:45:54.838501 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/98a9933e-6c22-491a-90bb-d1d2c0bb7df9 HTTP/1.1 Aug 27 02:45:54.838501 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:45:54.838501 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:45:54.838501 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:45:54.838501 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:45:54.838501 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:45:54.838501 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:45:54.838501 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:45:54.838501 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:45:54.838501 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYUqULQp-YhXHHCl2hngi9BMJm7wP1pGZCcaxudoyUu4YXudXmRdmBYAkbX0-TS9pqFDwaRuY82uqdOXUJwRWB1ajZ46tfQo1tc4MJsIVgVqim1Pvb2Il-ejDehbyoer8P643aveyI0JrfbznxBx8aFYmMJz3n8FX81wfpLT5u3cMYE Aug 27 02:45:54.838501 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:45:54.838501 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:45:54.838501 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:45:54.838501 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:45:54.838501 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:45:54.838501 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:45:54.838501 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: f5668e6d96694c62b83f7e8381fe86e1 Aug 27 02:45:54.838501 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-94227302 Aug 27 02:45:54.838501 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:45:54.838501 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:45:54.840223 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f5668e6d96694c62b83f7e8381fe86e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f5668e6d96694c62b83f7e8381fe86e1", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f5668e6d96694c62b83f7e8381fe86e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f5668e6d96694c62b83f7e8381fe86e1"}]}] Aug 27 02:45:54.840223 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-94227302 Aug 27 02:45:54.840223 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: f5668e6d96694c62b83f7e8381fe86e1 Aug 27 02:45:54.840223 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-94227302 Aug 27 02:45:54.840223 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ImagesOneServerNegativeTestJSON-94227302-project Aug 27 02:45:54.840223 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:45:54.840223 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:45:54.840223 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 0e86c17fe83848e2bc96b7c83ff1cf14 Aug 27 02:45:54.840223 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-94227302-project Aug 27 02:45:54.840223 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 02:45:54.840223 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance 98a9933e-6c22-491a-90bb-d1d2c0bb7df9 could not be found. Aug 27 02:45:54.840223 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '98a9933e-6c22-491a-90bb-d1d2c0bb7df9'} Aug 27 02:45:54.841150 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:45:54.841150 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:54.841150 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:45:54.841150 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:45:54.841150 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:45:54.841150 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:45:54.841150 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:45:54.841150 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:45:54.841150 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:45:54.841150 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:45:54.841150 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98a9933e-6c22-491a-90bb-d1d2c0bb7df9 could not be found. Aug 27 02:45:54.841150 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:45:54.841150 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:45:54.841150 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:45:54.841150 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:54.841150 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:45:54.841150 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:45:54.841150 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:45:54.841150 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:45:54.841150 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:45:54.843523 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:45:54.843523 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:45:54.843523 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:45:54.843523 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:45:54.843523 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:45:54.843523 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:45:54.843523 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:45:54.843523 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98a9933e-6c22-491a-90bb-d1d2c0bb7df9 could not be found. Aug 27 02:45:54.843523 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:45:54.843523 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:45:54.843523 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:45:54.843523 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:54.843523 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:45:54.843523 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:45:54.843523 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:45:54.843523 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:45:54.843523 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98a9933e-6c22-491a-90bb-d1d2c0bb7df9 could not be found. Aug 27 02:45:54.843523 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:45:54.846941 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-bd17c3a9-4188-44b5-b705-fe940bab11e8 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Returning 404 to user: Instance 98a9933e-6c22-491a-90bb-d1d2c0bb7df9 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:45:54.846941 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-bd17c3a9-4188-44b5-b705-fe940bab11e8 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] 10.222.0.70 "GET /compute/v2.1/servers/98a9933e-6c22-491a-90bb-d1d2c0bb7df9" status: 404 len: 111 microversion: 2.1 time: 0.049795 Aug 27 02:45:54.847266 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 655/1304] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:54 2022] GET /compute/v2.1/servers/98a9933e-6c22-491a-90bb-d1d2c0bb7df9 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:45:54.850379 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-dff5e10e-4d52-4fa6-b2d5-532b9eebd9db tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6d1646ec094e3297f6f3c51dd72e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b105816fd4e54b9da4973ff721e1fb92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:54.852223 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4860f2c1-3010-4279-81f6-213c3be986eb tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:54.853055 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-4860f2c1-3010-4279-81f6-213c3be986eb tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] [instance: 484e03a9-aef3-4179-980c-0e7292a05b5a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:54.859780 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4860f2c1-3010-4279-81f6-213c3be986eb tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:54.860288 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4860f2c1-3010-4279-81f6-213c3be986eb tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:54.860776 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4860f2c1-3010-4279-81f6-213c3be986eb tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:54.861483 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4860f2c1-3010-4279-81f6-213c3be986eb tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:54.861931 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4860f2c1-3010-4279-81f6-213c3be986eb tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:54.862358 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4860f2c1-3010-4279-81f6-213c3be986eb tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:54.862655 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-dff5e10e-4d52-4fa6-b2d5-532b9eebd9db tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "GET /compute/v2.1/servers/eb11f5d3-ce63-461d-a83f-04f33ce7c16b" status: 200 len: 1317 microversion: 2.1 time: 0.448857 Aug 27 02:45:54.863250 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 650/1305] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:54 2022] GET /compute/v2.1/servers/eb11f5d3-ce63-461d-a83f-04f33ce7c16b => generated 1317 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:45:54.875705 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-91774eb3-514f-4a78-bec8-3093128d825c tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Action: 'create', calling method: .version_select at 0x7f5ee2e13af0>, body: {"keypair": {"name": "tempest-keypair-1592412541", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBID2Nj/hV9bFgZw86TyqlMGDRqNcAedukMar3Qr5n85xq66VtpUyUqXvokioD9T73524Mijmd+8ugMBcKuQlH439TzZ9aXWKj9Ngo10IlFuIpVWrdr8SYuBQs1r7BnLNTw=="}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:45:54.919191 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-91774eb3-514f-4a78-bec8-3093128d825c tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Getting quotas for project f5668e6d96694c62b83f7e8381fe86e1. Resources: {'key_pairs'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:45:54.925800 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-91774eb3-514f-4a78-bec8-3093128d825c tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Getting quotas for user 0e86c17fe83848e2bc96b7c83ff1cf14 and project f5668e6d96694c62b83f7e8381fe86e1. Resources: {'key_pairs'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:45:54.956531 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-91774eb3-514f-4a78-bec8-3093128d825c tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.092172 Aug 27 02:45:54.957597 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 651/1306] 10.222.0.70 () {60 vars in 1159 bytes} [Sat Aug 27 02:45:54 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:45:54.963588 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-e08835f4-5bf2-49a5-afed-53d1d8c49bfc req-520fddcf-83f8-48a1-9955-0590766aaf5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4351cb89-8e57-47d5-9870-87a43e21ea57", "name": "network-vif-deleted", "tag": "662b64e3-e137-4b0d-9b60-87340e041f05"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:45:54.974357 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-e08835f4-5bf2-49a5-afed-53d1d8c49bfc req-520fddcf-83f8-48a1-9955-0590766aaf5a service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:54.974840 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-e08835f4-5bf2-49a5-afed-53d1d8c49bfc req-520fddcf-83f8-48a1-9955-0590766aaf5a service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:54.975656 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-e08835f4-5bf2-49a5-afed-53d1d8c49bfc req-520fddcf-83f8-48a1-9955-0590766aaf5a service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:54.999392 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-e08835f4-5bf2-49a5-afed-53d1d8c49bfc req-520fddcf-83f8-48a1-9955-0590766aaf5a service nova] Creating event network-vif-deleted:662b64e3-e137-4b0d-9b60-87340e041f05 for instance 4351cb89-8e57-47d5-9870-87a43e21ea57 on n-h1-852278-4 Aug 27 02:45:55.004549 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-e08835f4-5bf2-49a5-afed-53d1d8c49bfc req-520fddcf-83f8-48a1-9955-0590766aaf5a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045651 Aug 27 02:45:55.005492 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 652/1307] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:45:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:45:55.010693 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-33d8d793-3e46-4ac8-9274-c632afc27224 req-9f9155bb-e860-48f3-9b5e-39aa2dc5b6b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb11f5d3-ce63-461d-a83f-04f33ce7c16b", "tag": "2bb69a1e-db5b-4c04-9ed8-8205dd668b84"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:45:55.021830 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-33d8d793-3e46-4ac8-9274-c632afc27224 req-9f9155bb-e860-48f3-9b5e-39aa2dc5b6b8 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:55.022627 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-33d8d793-3e46-4ac8-9274-c632afc27224 req-9f9155bb-e860-48f3-9b5e-39aa2dc5b6b8 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:55.023373 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-33d8d793-3e46-4ac8-9274-c632afc27224 req-9f9155bb-e860-48f3-9b5e-39aa2dc5b6b8 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:55.036634 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-33d8d793-3e46-4ac8-9274-c632afc27224 req-9f9155bb-e860-48f3-9b5e-39aa2dc5b6b8 service nova] Creating event network-changed:2bb69a1e-db5b-4c04-9ed8-8205dd668b84 for instance eb11f5d3-ce63-461d-a83f-04f33ce7c16b on n-h2-852278-4 Aug 27 02:45:55.042885 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-33d8d793-3e46-4ac8-9274-c632afc27224 req-9f9155bb-e860-48f3-9b5e-39aa2dc5b6b8 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036053 Aug 27 02:45:55.044994 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 653/1308] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:45:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:45:55.197816 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-4860f2c1-3010-4279-81f6-213c3be986eb tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:55.210253 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-4860f2c1-3010-4279-81f6-213c3be986eb tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:55.211675 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-4860f2c1-3010-4279-81f6-213c3be986eb tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:55.212872 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-4860f2c1-3010-4279-81f6-213c3be986eb tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] 10.222.0.70 "GET /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a" status: 200 len: 1753 microversion: 2.42 time: 0.364592 Aug 27 02:45:55.229371 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 656/1309] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:45:54 2022] GET /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a => generated 1753 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:45:55.258881 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d46e7560-8b53-4cbc-b3af-afd4e5eaf17d tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:55.260017 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d46e7560-8b53-4cbc-b3af-afd4e5eaf17d tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] [instance: 4351cb89-8e57-47d5-9870-87a43e21ea57] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:55.267272 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d46e7560-8b53-4cbc-b3af-afd4e5eaf17d tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:55.268204 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d46e7560-8b53-4cbc-b3af-afd4e5eaf17d tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:55.268897 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d46e7560-8b53-4cbc-b3af-afd4e5eaf17d tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:55.269908 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d46e7560-8b53-4cbc-b3af-afd4e5eaf17d tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:55.270505 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d46e7560-8b53-4cbc-b3af-afd4e5eaf17d tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:55.271162 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d46e7560-8b53-4cbc-b3af-afd4e5eaf17d tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:55.289305 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-d46e7560-8b53-4cbc-b3af-afd4e5eaf17d tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] HTTP exception thrown: Instance 4351cb89-8e57-47d5-9870-87a43e21ea57 could not be found. Aug 27 02:45:55.291941 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d46e7560-8b53-4cbc-b3af-afd4e5eaf17d tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Request method failure captured: Aug 27 02:45:55.291941 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/servers/4351cb89-8e57-47d5-9870-87a43e21ea57 HTTP/1.1 Aug 27 02:45:55.291941 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:45:55.291941 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:45:55.291941 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:45:55.291941 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:45:55.291941 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:45:55.291941 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:45:55.291941 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:45:55.291941 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:45:55.291941 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYU1uWDgJ2S3i8wnm38tKLwEsEd6GPcBWEaaoD2Xah7z574RssgOAwJiB8CshvFHNvcIICfPORJAASNhmpvWgqIN53Vezocd1McLDL_uz2RfIqgooaaRqJRt5-jwaNEga7kMv1yBvyL_j7aHlJRlOwXXEJQhohRHKjELpSYbPD8PLJc Aug 27 02:45:55.291941 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:45:55.291941 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:45:55.291941 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:45:55.291941 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:45:55.291941 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:45:55.291941 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:45:55.291941 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 5d563fb57d1644ea9f14603151d0d089 Aug 27 02:45:55.291941 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ListServersNegativeTestJSON-1549884191 Aug 27 02:45:55.291941 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:45:55.291941 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:45:55.293754 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5d563fb57d1644ea9f14603151d0d089"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_5d563fb57d1644ea9f14603151d0d089", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5d563fb57d1644ea9f14603151d0d089"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/5d563fb57d1644ea9f14603151d0d089"}]}] Aug 27 02:45:55.293754 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ListServersNegativeTestJSON-1549884191 Aug 27 02:45:55.293754 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 5d563fb57d1644ea9f14603151d0d089 Aug 27 02:45:55.293754 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1549884191 Aug 27 02:45:55.293754 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ListServersNegativeTestJSON-1549884191-project Aug 27 02:45:55.293754 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:45:55.293754 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:45:55.293754 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: a20f8524b5e042fa9968287ab9257c84 Aug 27 02:45:55.293754 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ListServersNegativeTestJSON-1549884191-project Aug 27 02:45:55.293754 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 02:45:55.293754 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance 4351cb89-8e57-47d5-9870-87a43e21ea57 could not be found. Aug 27 02:45:55.293754 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '4351cb89-8e57-47d5-9870-87a43e21ea57'} Aug 27 02:45:55.294766 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:45:55.294766 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:55.294766 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:45:55.294766 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:45:55.294766 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:45:55.294766 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:45:55.294766 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:45:55.294766 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:45:55.294766 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:45:55.294766 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:45:55.294766 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4351cb89-8e57-47d5-9870-87a43e21ea57 could not be found. Aug 27 02:45:55.294766 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:45:55.294766 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:45:55.294766 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:45:55.294766 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:55.294766 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:45:55.294766 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:45:55.294766 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:45:55.294766 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:45:55.294766 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:45:55.296268 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:45:55.296268 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:45:55.296268 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:45:55.296268 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:45:55.296268 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:45:55.296268 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:45:55.296268 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:45:55.296268 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4351cb89-8e57-47d5-9870-87a43e21ea57 could not be found. Aug 27 02:45:55.296268 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:45:55.296268 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:45:55.296268 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:45:55.296268 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:55.296268 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:45:55.296268 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:45:55.296268 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:45:55.296268 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:45:55.296268 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4351cb89-8e57-47d5-9870-87a43e21ea57 could not be found. Aug 27 02:45:55.296268 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:45:55.298684 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d46e7560-8b53-4cbc-b3af-afd4e5eaf17d tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Returning 404 to user: Instance 4351cb89-8e57-47d5-9870-87a43e21ea57 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:45:55.299721 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d46e7560-8b53-4cbc-b3af-afd4e5eaf17d tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] 10.222.0.70 "GET /compute/v2.1/servers/4351cb89-8e57-47d5-9870-87a43e21ea57" status: 404 len: 111 microversion: 2.1 time: 0.046128 Aug 27 02:45:55.306597 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 654/1310] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:55 2022] GET /compute/v2.1/servers/4351cb89-8e57-47d5-9870-87a43e21ea57 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:45:55.313073 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c477a930-ff54-42d1-a37e-2453e984b850 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:55.319380 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-c477a930-ff54-42d1-a37e-2453e984b850 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a20f8524b5e042fa9968287ab9257c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d563fb57d1644ea9f14603151d0d089', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:55.320658 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-c477a930-ff54-42d1-a37e-2453e984b850 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': '5d563fb57d1644ea9f14603151d0d089'} {{(pid=134051) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 02:45:55.327061 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c477a930-ff54-42d1-a37e-2453e984b850 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:55.327816 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c477a930-ff54-42d1-a37e-2453e984b850 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:55.328669 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c477a930-ff54-42d1-a37e-2453e984b850 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:55.329879 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c477a930-ff54-42d1-a37e-2453e984b850 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:55.331261 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c477a930-ff54-42d1-a37e-2453e984b850 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:55.332247 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c477a930-ff54-42d1-a37e-2453e984b850 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:55.363255 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-215f138b-a353-456a-9bc3-34aaa634a426 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:55.363851 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-215f138b-a353-456a-9bc3-34aaa634a426 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 70acfe32-deea-46fc-a214-8fdbb9f6cb7b] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:55.372553 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-215f138b-a353-456a-9bc3-34aaa634a426 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:55.373325 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-215f138b-a353-456a-9bc3-34aaa634a426 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:55.374029 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-215f138b-a353-456a-9bc3-34aaa634a426 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:55.374945 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-215f138b-a353-456a-9bc3-34aaa634a426 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:55.375556 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-215f138b-a353-456a-9bc3-34aaa634a426 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:55.376384 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-215f138b-a353-456a-9bc3-34aaa634a426 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:55.427789 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c477a930-ff54-42d1-a37e-2453e984b850 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] 10.222.0.70 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.121681 Aug 27 02:45:55.428414 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 657/1311] 10.222.0.70 () {58 vars in 1230 bytes} [Sat Aug 27 02:45:55 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:45:55.440950 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c7dc6f00-a643-4e58-ba14-96aec84f2f3d tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:55.445785 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c7dc6f00-a643-4e58-ba14-96aec84f2f3d tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Request method failure captured: Aug 27 02:45:55.445785 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Aug 27 02:45:55.445785 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:45:55.445785 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:45:55.445785 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:45:55.445785 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:45:55.445785 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:45:55.445785 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:45:55.445785 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:45:55.445785 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:45:55.445785 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYU1uWDgJ2S3i8wnm38tKLwEsEd6GPcBWEaaoD2Xah7z574RssgOAwJiB8CshvFHNvcIICfPORJAASNhmpvWgqIN53Vezocd1McLDL_uz2RfIqgooaaRqJRt5-jwaNEga7kMv1yBvyL_j7aHlJRlOwXXEJQhohRHKjELpSYbPD8PLJc Aug 27 02:45:55.445785 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:45:55.445785 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:45:55.445785 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:45:55.445785 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:45:55.445785 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:45:55.445785 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:45:55.445785 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 5d563fb57d1644ea9f14603151d0d089 Aug 27 02:45:55.445785 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ListServersNegativeTestJSON-1549884191 Aug 27 02:45:55.445785 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:45:55.445785 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:45:55.447616 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5d563fb57d1644ea9f14603151d0d089"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_5d563fb57d1644ea9f14603151d0d089", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5d563fb57d1644ea9f14603151d0d089"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/5d563fb57d1644ea9f14603151d0d089"}]}] Aug 27 02:45:55.447616 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ListServersNegativeTestJSON-1549884191 Aug 27 02:45:55.447616 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 5d563fb57d1644ea9f14603151d0d089 Aug 27 02:45:55.447616 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1549884191 Aug 27 02:45:55.447616 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ListServersNegativeTestJSON-1549884191-project Aug 27 02:45:55.447616 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:45:55.447616 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:45:55.447616 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: a20f8524b5e042fa9968287ab9257c84 Aug 27 02:45:55.447616 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ListServersNegativeTestJSON-1549884191-project Aug 27 02:45:55.447616 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 02:45:55.447616 n-d-852278-4 devstack@n-api.service[134051]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Aug 27 02:45:55.447616 n-d-852278-4 devstack@n-api.service[134051]: action_args: {} Aug 27 02:45:55.448654 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:45:55.448654 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:55.448654 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 02:45:55.448654 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 02:45:55.448654 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 02:45:55.448654 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise error Aug 27 02:45:55.448654 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Aug 27 02:45:55.448654 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:45:55.448654 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Aug 27 02:45:55.448654 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Aug 27 02:45:55.448654 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:45:55.448654 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi On instance[0]: Aug 27 02:45:55.448654 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi '2011/01/01' Aug 27 02:45:55.448654 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:45:55.448654 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:45:55.448654 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:45:55.448654 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:55.448654 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:45:55.448654 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:45:55.448654 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:45:55.448654 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:45:55.448654 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:45:55.448654 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:45:55.450481 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 02:45:55.450481 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:45:55.450481 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 02:45:55.450481 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:45:55.450481 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 02:45:55.450481 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:45:55.450481 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 27 02:45:55.450481 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Aug 27 02:45:55.450481 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Aug 27 02:45:55.450481 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 02:45:55.450481 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 02:45:55.450481 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 02:45:55.450481 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 02:45:55.450481 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Aug 27 02:45:55.450481 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:45:55.450481 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:45:55.450481 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:45:55.450481 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:55.450481 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:45:55.450481 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:45:55.452297 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 02:45:55.452297 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 02:45:55.452297 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Aug 27 02:45:55.452297 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:45:55.452297 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c7dc6f00-a643-4e58-ba14-96aec84f2f3d tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:45:55.452297 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c7dc6f00-a643-4e58-ba14-96aec84f2f3d tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] 10.222.0.70 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.011763 Aug 27 02:45:55.452297 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 658/1312] 10.222.0.70 () {58 vars in 1182 bytes} [Sat Aug 27 02:45:55 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 02:45:55.460552 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3a451f98-9068-4e51-a01d-e89233a588e0 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:55.466105 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-3a451f98-9068-4e51-a01d-e89233a588e0 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a20f8524b5e042fa9968287ab9257c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d563fb57d1644ea9f14603151d0d089', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:55.466890 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-3a451f98-9068-4e51-a01d-e89233a588e0 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Searching by: {'deleted': False, 'project_id': '5d563fb57d1644ea9f14603151d0d089'} {{(pid=134051) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 02:45:55.473481 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3a451f98-9068-4e51-a01d-e89233a588e0 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:55.474050 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3a451f98-9068-4e51-a01d-e89233a588e0 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:55.474556 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3a451f98-9068-4e51-a01d-e89233a588e0 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:55.475348 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3a451f98-9068-4e51-a01d-e89233a588e0 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:55.476025 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3a451f98-9068-4e51-a01d-e89233a588e0 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:55.476532 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3a451f98-9068-4e51-a01d-e89233a588e0 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:55.505446 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.multi_cell_list [None req-3a451f98-9068-4e51-a01d-e89233a588e0 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=134051) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 02:45:55.542287 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-3a451f98-9068-4e51-a01d-e89233a588e0 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] 10.222.0.70 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.085702 Aug 27 02:45:55.546466 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 659/1313] 10.222.0.70 () {58 vars in 1125 bytes} [Sat Aug 27 02:45:55 2022] GET /compute/v2.1/servers => generated 683 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:45:55.554355 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-da55cc2e-1c2c-439e-a35a-7ff418f364f0 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:55.560137 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-da55cc2e-1c2c-439e-a35a-7ff418f364f0 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a20f8524b5e042fa9968287ab9257c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d563fb57d1644ea9f14603151d0d089', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:55.560692 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.compute.servers [None req-da55cc2e-1c2c-439e-a35a-7ff418f364f0 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Removing options 'limit' from query {{(pid=134051) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 27 02:45:55.561351 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-da55cc2e-1c2c-439e-a35a-7ff418f364f0 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Searching by: {'deleted': False, 'project_id': '5d563fb57d1644ea9f14603151d0d089'} {{(pid=134051) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 02:45:55.566577 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-da55cc2e-1c2c-439e-a35a-7ff418f364f0 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:55.567067 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-da55cc2e-1c2c-439e-a35a-7ff418f364f0 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:55.567635 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-da55cc2e-1c2c-439e-a35a-7ff418f364f0 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:55.568511 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-da55cc2e-1c2c-439e-a35a-7ff418f364f0 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:55.568965 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-da55cc2e-1c2c-439e-a35a-7ff418f364f0 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:55.569384 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-da55cc2e-1c2c-439e-a35a-7ff418f364f0 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:55.596946 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.multi_cell_list [None req-da55cc2e-1c2c-439e-a35a-7ff418f364f0 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=134051) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 02:45:55.628900 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-da55cc2e-1c2c-439e-a35a-7ff418f364f0 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] 10.222.0.70 "GET /compute/v2.1/servers?limit=102" status: 200 len: 683 microversion: 2.1 time: 0.078141 Aug 27 02:45:55.629853 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 660/1314] 10.222.0.70 () {58 vars in 1144 bytes} [Sat Aug 27 02:45:55 2022] GET /compute/v2.1/servers?limit=102 => generated 683 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:45:55.643079 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-53f540c2-3873-4a65-a72a-afac5d370a86 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:55.647275 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-53f540c2-3873-4a65-a72a-afac5d370a86 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Request method failure captured: Aug 27 02:45:55.647275 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Aug 27 02:45:55.647275 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:45:55.647275 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:45:55.647275 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:45:55.647275 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:45:55.647275 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:45:55.647275 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:45:55.647275 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:45:55.647275 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:45:55.647275 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYU1uWDgJ2S3i8wnm38tKLwEsEd6GPcBWEaaoD2Xah7z574RssgOAwJiB8CshvFHNvcIICfPORJAASNhmpvWgqIN53Vezocd1McLDL_uz2RfIqgooaaRqJRt5-jwaNEga7kMv1yBvyL_j7aHlJRlOwXXEJQhohRHKjELpSYbPD8PLJc Aug 27 02:45:55.647275 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:45:55.647275 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:45:55.647275 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:45:55.647275 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:45:55.647275 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:45:55.647275 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:45:55.647275 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 5d563fb57d1644ea9f14603151d0d089 Aug 27 02:45:55.647275 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ListServersNegativeTestJSON-1549884191 Aug 27 02:45:55.647275 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:45:55.647275 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:45:55.649113 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5d563fb57d1644ea9f14603151d0d089"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_5d563fb57d1644ea9f14603151d0d089", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5d563fb57d1644ea9f14603151d0d089"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/5d563fb57d1644ea9f14603151d0d089"}]}] Aug 27 02:45:55.649113 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ListServersNegativeTestJSON-1549884191 Aug 27 02:45:55.649113 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 5d563fb57d1644ea9f14603151d0d089 Aug 27 02:45:55.649113 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1549884191 Aug 27 02:45:55.649113 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ListServersNegativeTestJSON-1549884191-project Aug 27 02:45:55.649113 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:45:55.649113 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:45:55.649113 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: a20f8524b5e042fa9968287ab9257c84 Aug 27 02:45:55.649113 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ListServersNegativeTestJSON-1549884191-project Aug 27 02:45:55.649113 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 02:45:55.649113 n-d-852278-4 devstack@n-api.service[134051]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Aug 27 02:45:55.649113 n-d-852278-4 devstack@n-api.service[134051]: action_args: {} Aug 27 02:45:55.650157 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:45:55.650157 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:55.650157 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 02:45:55.650157 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 02:45:55.650157 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 02:45:55.650157 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise error Aug 27 02:45:55.650157 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Aug 27 02:45:55.650157 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:45:55.650157 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Aug 27 02:45:55.650157 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 27 02:45:55.650157 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi 'minimum': 0, Aug 27 02:45:55.650157 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 27 02:45:55.650157 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 27 02:45:55.650157 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:45:55.650157 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi On instance[0]: Aug 27 02:45:55.650157 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi '-1' Aug 27 02:45:55.650157 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:45:55.650157 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:45:55.650157 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:45:55.650157 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:55.650157 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:45:55.650157 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:45:55.650157 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:45:55.650157 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:45:55.652122 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:45:55.652122 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:45:55.652122 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 02:45:55.652122 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:45:55.652122 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 02:45:55.652122 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:45:55.652122 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 02:45:55.652122 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:45:55.652122 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 27 02:45:55.652122 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Aug 27 02:45:55.652122 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Aug 27 02:45:55.652122 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 02:45:55.652122 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 02:45:55.652122 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 02:45:55.652122 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 02:45:55.652122 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Aug 27 02:45:55.652122 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:45:55.652122 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:45:55.652122 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:45:55.652122 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:55.653837 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:45:55.653837 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:45:55.653837 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 02:45:55.653837 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 02:45:55.653837 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Aug 27 02:45:55.653837 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:45:55.653837 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-53f540c2-3873-4a65-a72a-afac5d370a86 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:45:55.653837 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-53f540c2-3873-4a65-a72a-afac5d370a86 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] 10.222.0.70 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.013185 Aug 27 02:45:55.659008 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 661/1315] 10.222.0.70 () {58 vars in 1142 bytes} [Sat Aug 27 02:45:55 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 02:45:55.664208 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-abbdb56a-58a0-4c94-947e-89c92edd83ec tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:55.668108 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-abbdb56a-58a0-4c94-947e-89c92edd83ec tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Request method failure captured: Aug 27 02:45:55.668108 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Aug 27 02:45:55.668108 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:45:55.668108 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:45:55.668108 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:45:55.668108 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:45:55.668108 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:45:55.668108 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:45:55.668108 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:45:55.668108 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:45:55.668108 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYU1uWDgJ2S3i8wnm38tKLwEsEd6GPcBWEaaoD2Xah7z574RssgOAwJiB8CshvFHNvcIICfPORJAASNhmpvWgqIN53Vezocd1McLDL_uz2RfIqgooaaRqJRt5-jwaNEga7kMv1yBvyL_j7aHlJRlOwXXEJQhohRHKjELpSYbPD8PLJc Aug 27 02:45:55.668108 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:45:55.668108 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:45:55.668108 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:45:55.668108 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:45:55.668108 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:45:55.668108 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:45:55.668108 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 5d563fb57d1644ea9f14603151d0d089 Aug 27 02:45:55.668108 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ListServersNegativeTestJSON-1549884191 Aug 27 02:45:55.668108 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:45:55.668108 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:45:55.671102 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5d563fb57d1644ea9f14603151d0d089"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_5d563fb57d1644ea9f14603151d0d089", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5d563fb57d1644ea9f14603151d0d089"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/5d563fb57d1644ea9f14603151d0d089"}]}] Aug 27 02:45:55.671102 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ListServersNegativeTestJSON-1549884191 Aug 27 02:45:55.671102 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 5d563fb57d1644ea9f14603151d0d089 Aug 27 02:45:55.671102 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1549884191 Aug 27 02:45:55.671102 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ListServersNegativeTestJSON-1549884191-project Aug 27 02:45:55.671102 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:45:55.671102 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:45:55.671102 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: a20f8524b5e042fa9968287ab9257c84 Aug 27 02:45:55.671102 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ListServersNegativeTestJSON-1549884191-project Aug 27 02:45:55.671102 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 02:45:55.671102 n-d-852278-4 devstack@n-api.service[134051]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Aug 27 02:45:55.671102 n-d-852278-4 devstack@n-api.service[134051]: action_args: {} Aug 27 02:45:55.676278 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:45:55.676278 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:55.676278 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 02:45:55.676278 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 02:45:55.676278 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 02:45:55.676278 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise error Aug 27 02:45:55.676278 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Aug 27 02:45:55.676278 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:45:55.676278 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Aug 27 02:45:55.676278 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 27 02:45:55.676278 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi 'minimum': 0, Aug 27 02:45:55.676278 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 27 02:45:55.676278 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 27 02:45:55.676278 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:45:55.676278 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi On instance[0]: Aug 27 02:45:55.676278 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi 'testing' Aug 27 02:45:55.676278 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:45:55.676278 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:45:55.676278 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:45:55.676278 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:55.676278 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:45:55.676278 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:45:55.676278 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:45:55.676278 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:45:55.678206 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:45:55.678206 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:45:55.678206 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 02:45:55.678206 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:45:55.678206 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 02:45:55.678206 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:45:55.678206 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 02:45:55.678206 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:45:55.678206 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 27 02:45:55.678206 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Aug 27 02:45:55.678206 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Aug 27 02:45:55.678206 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 02:45:55.678206 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 02:45:55.678206 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 02:45:55.678206 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 02:45:55.678206 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Aug 27 02:45:55.678206 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:45:55.678206 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:45:55.678206 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:45:55.678206 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:55.681257 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:45:55.681257 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:45:55.681257 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 02:45:55.681257 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 02:45:55.681257 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Aug 27 02:45:55.681257 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:45:55.681257 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-abbdb56a-58a0-4c94-947e-89c92edd83ec tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:45:55.681257 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-abbdb56a-58a0-4c94-947e-89c92edd83ec tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] 10.222.0.70 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.010032 Aug 27 02:45:55.681257 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 662/1316] 10.222.0.70 () {58 vars in 1152 bytes} [Sat Aug 27 02:45:55 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 02:45:55.693413 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f9a05bd6-1b9a-44f1-8ff8-3340b86b2169 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:55.699048 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-f9a05bd6-1b9a-44f1-8ff8-3340b86b2169 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a20f8524b5e042fa9968287ab9257c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d563fb57d1644ea9f14603151d0d089', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:55.699721 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-f9a05bd6-1b9a-44f1-8ff8-3340b86b2169 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': '5d563fb57d1644ea9f14603151d0d089'} {{(pid=134051) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 02:45:55.708004 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.compute.servers [None req-f9a05bd6-1b9a-44f1-8ff8-3340b86b2169 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Flavor 'non_existing_flavor' could not be found {{(pid=134051) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Aug 27 02:45:55.709094 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-f9a05bd6-1b9a-44f1-8ff8-3340b86b2169 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] 10.222.0.70 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.023648 Aug 27 02:45:55.712366 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 663/1317] 10.222.0.70 () {58 vars in 1178 bytes} [Sat Aug 27 02:45:55 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:45:55.722166 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d2d321af-af63-4578-8d2c-05ae1bc8c345 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:55.727378 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d2d321af-af63-4578-8d2c-05ae1bc8c345 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a20f8524b5e042fa9968287ab9257c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d563fb57d1644ea9f14603151d0d089', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:55.728045 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d2d321af-af63-4578-8d2c-05ae1bc8c345 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': '5d563fb57d1644ea9f14603151d0d089'} {{(pid=134051) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 02:45:55.733399 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d2d321af-af63-4578-8d2c-05ae1bc8c345 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:55.733885 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d2d321af-af63-4578-8d2c-05ae1bc8c345 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:55.734320 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d2d321af-af63-4578-8d2c-05ae1bc8c345 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:55.735614 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d2d321af-af63-4578-8d2c-05ae1bc8c345 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:55.735614 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d2d321af-af63-4578-8d2c-05ae1bc8c345 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:55.736350 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d2d321af-af63-4578-8d2c-05ae1bc8c345 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:55.824873 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d2d321af-af63-4578-8d2c-05ae1bc8c345 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] 10.222.0.70 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.106529 Aug 27 02:45:55.826202 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 664/1318] 10.222.0.70 () {58 vars in 1174 bytes} [Sat Aug 27 02:45:55 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:45:55.838265 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d9a8167a-31cc-438e-8c30-07b0613329f0 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:55.839142 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d9a8167a-31cc-438e-8c30-07b0613329f0 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: f620f083-7230-471a-87d0-f6d85f8ad087] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:55.846316 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d9a8167a-31cc-438e-8c30-07b0613329f0 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:55.847132 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d9a8167a-31cc-438e-8c30-07b0613329f0 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:55.847756 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d9a8167a-31cc-438e-8c30-07b0613329f0 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:55.849557 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-215f138b-a353-456a-9bc3-34aaa634a426 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:55.851317 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d9a8167a-31cc-438e-8c30-07b0613329f0 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:55.851813 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d9a8167a-31cc-438e-8c30-07b0613329f0 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:55.852201 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d9a8167a-31cc-438e-8c30-07b0613329f0 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:55.866329 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-215f138b-a353-456a-9bc3-34aaa634a426 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b" status: 200 len: 1197 microversion: 2.1 time: 0.506176 Aug 27 02:45:55.868900 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 655/1319] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:55 2022] GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b => generated 1197 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:45:55.874995 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d7325eba-d564-4cdd-838e-a657b35c4ef8 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:55.883772 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-d7325eba-d564-4cdd-838e-a657b35c4ef8 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a20f8524b5e042fa9968287ab9257c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d563fb57d1644ea9f14603151d0d089', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:55.884641 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d7325eba-d564-4cdd-838e-a657b35c4ef8 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': '5d563fb57d1644ea9f14603151d0d089'} {{(pid=134052) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 02:45:55.892620 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d7325eba-d564-4cdd-838e-a657b35c4ef8 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:55.893394 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d7325eba-d564-4cdd-838e-a657b35c4ef8 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:55.894250 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d7325eba-d564-4cdd-838e-a657b35c4ef8 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:55.895665 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d7325eba-d564-4cdd-838e-a657b35c4ef8 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:55.897193 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d7325eba-d564-4cdd-838e-a657b35c4ef8 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:55.898260 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d7325eba-d564-4cdd-838e-a657b35c4ef8 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:56.024461 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d7325eba-d564-4cdd-838e-a657b35c4ef8 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] 10.222.0.70 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.153881 Aug 27 02:45:56.025060 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 656/1320] 10.222.0.70 () {58 vars in 1184 bytes} [Sat Aug 27 02:45:55 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:45:56.029920 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-7112a05a-01d4-449d-a459-cb41a2a721c1 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:56.031157 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-7112a05a-01d4-449d-a459-cb41a2a721c1 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: eb11f5d3-ce63-461d-a83f-04f33ce7c16b] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:56.037799 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7112a05a-01d4-449d-a459-cb41a2a721c1 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:56.038511 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7112a05a-01d4-449d-a459-cb41a2a721c1 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:56.039145 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7112a05a-01d4-449d-a459-cb41a2a721c1 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:56.040959 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7112a05a-01d4-449d-a459-cb41a2a721c1 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:56.041882 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7112a05a-01d4-449d-a459-cb41a2a721c1 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:56.042473 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7112a05a-01d4-449d-a459-cb41a2a721c1 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:56.258586 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d9a8167a-31cc-438e-8c30-07b0613329f0 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:56.268430 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d9a8167a-31cc-438e-8c30-07b0613329f0 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:56.272797 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d9a8167a-31cc-438e-8c30-07b0613329f0 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:56.275678 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d9a8167a-31cc-438e-8c30-07b0613329f0 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/f620f083-7230-471a-87d0-f6d85f8ad087" status: 200 len: 1487 microversion: 2.25 time: 0.448196 Aug 27 02:45:56.276268 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 665/1321] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:45:55 2022] GET /compute/v2.1/servers/f620f083-7230-471a-87d0-f6d85f8ad087 => generated 1487 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:45:56.291736 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-67532f20-bdcd-4d70-9810-b69eadd33754 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:56.297361 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-67532f20-bdcd-4d70-9810-b69eadd33754 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a20f8524b5e042fa9968287ab9257c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d563fb57d1644ea9f14603151d0d089', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:56.298386 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-67532f20-bdcd-4d70-9810-b69eadd33754 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Searching by: {'deleted': False, 'project_id': '5d563fb57d1644ea9f14603151d0d089'} {{(pid=134051) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 02:45:56.304222 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-67532f20-bdcd-4d70-9810-b69eadd33754 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:56.304975 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-67532f20-bdcd-4d70-9810-b69eadd33754 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:56.305571 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-67532f20-bdcd-4d70-9810-b69eadd33754 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:56.306516 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-67532f20-bdcd-4d70-9810-b69eadd33754 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:56.307140 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-67532f20-bdcd-4d70-9810-b69eadd33754 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:56.308131 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-67532f20-bdcd-4d70-9810-b69eadd33754 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:56.342775 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.multi_cell_list [None req-67532f20-bdcd-4d70-9810-b69eadd33754 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=134051) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 02:45:56.361860 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-7112a05a-01d4-449d-a459-cb41a2a721c1 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6d1646ec094e3297f6f3c51dd72e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b105816fd4e54b9da4973ff721e1fb92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:56.377849 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-7112a05a-01d4-449d-a459-cb41a2a721c1 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "GET /compute/v2.1/servers/eb11f5d3-ce63-461d-a83f-04f33ce7c16b" status: 200 len: 1317 microversion: 2.1 time: 0.347564 Aug 27 02:45:56.378908 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 657/1322] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:56 2022] GET /compute/v2.1/servers/eb11f5d3-ce63-461d-a83f-04f33ce7c16b => generated 1317 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:56.391867 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a716f9ab-0a38-49fc-a687-c415d429e8a5 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:56.392971 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a716f9ab-0a38-49fc-a687-c415d429e8a5 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] [instance: 484e03a9-aef3-4179-980c-0e7292a05b5a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:56.408049 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a716f9ab-0a38-49fc-a687-c415d429e8a5 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:56.409002 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a716f9ab-0a38-49fc-a687-c415d429e8a5 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:56.409629 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a716f9ab-0a38-49fc-a687-c415d429e8a5 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:56.410531 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a716f9ab-0a38-49fc-a687-c415d429e8a5 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:56.411144 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a716f9ab-0a38-49fc-a687-c415d429e8a5 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:56.411728 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a716f9ab-0a38-49fc-a687-c415d429e8a5 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:56.443679 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-67532f20-bdcd-4d70-9810-b69eadd33754 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20f8524b5e042fa9968287ab9257c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d563fb57d1644ea9f14603151d0d089', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:56.455236 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-67532f20-bdcd-4d70-9810-b69eadd33754 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:56.459446 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-67532f20-bdcd-4d70-9810-b69eadd33754 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:56.460147 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-67532f20-bdcd-4d70-9810-b69eadd33754 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:56.924612 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-67532f20-bdcd-4d70-9810-b69eadd33754 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] 10.222.0.70 "GET /compute/v2.1/servers/detail" status: 200 len: 3026 microversion: 2.1 time: 0.647080 Aug 27 02:45:56.926498 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 666/1323] 10.222.0.70 () {58 vars in 1146 bytes} [Sat Aug 27 02:45:56 2022] GET /compute/v2.1/servers/detail => generated 3026 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:56.932420 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-2c5e6e02-72bd-45ef-b8a8-d7a82f6359fe tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:56.934000 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-2c5e6e02-72bd-45ef-b8a8-d7a82f6359fe tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 70acfe32-deea-46fc-a214-8fdbb9f6cb7b] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:56.944907 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-a716f9ab-0a38-49fc-a687-c415d429e8a5 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:56.962050 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-a716f9ab-0a38-49fc-a687-c415d429e8a5 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:56.963477 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-a716f9ab-0a38-49fc-a687-c415d429e8a5 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:56.964648 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a716f9ab-0a38-49fc-a687-c415d429e8a5 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] 10.222.0.70 "GET /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a" status: 200 len: 1799 microversion: 2.42 time: 0.584568 Aug 27 02:45:56.965250 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 658/1324] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:45:56 2022] GET /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a => generated 1799 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:45:56.983023 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2c5e6e02-72bd-45ef-b8a8-d7a82f6359fe tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:56.983714 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2c5e6e02-72bd-45ef-b8a8-d7a82f6359fe tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:56.984342 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2c5e6e02-72bd-45ef-b8a8-d7a82f6359fe tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:56.985232 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2c5e6e02-72bd-45ef-b8a8-d7a82f6359fe tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:56.985835 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2c5e6e02-72bd-45ef-b8a8-d7a82f6359fe tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:56.986406 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2c5e6e02-72bd-45ef-b8a8-d7a82f6359fe tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:56.993304 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-83f9be64-77c6-4c25-ad1a-9ef5f709dfd0 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:57.001425 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-83f9be64-77c6-4c25-ad1a-9ef5f709dfd0 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a20f8524b5e042fa9968287ab9257c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d563fb57d1644ea9f14603151d0d089', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:57.013187 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-83f9be64-77c6-4c25-ad1a-9ef5f709dfd0 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] 10.222.0.70 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.023555 Aug 27 02:45:57.014105 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 659/1325] 10.222.0.70 () {58 vars in 1178 bytes} [Sat Aug 27 02:45:56 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:45:57.025750 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-454a2dce-8977-4b01-aa28-47c55ef851c8 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:57.039529 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-454a2dce-8977-4b01-aa28-47c55ef851c8 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a20f8524b5e042fa9968287ab9257c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d563fb57d1644ea9f14603151d0d089', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:57.040473 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-454a2dce-8977-4b01-aa28-47c55ef851c8 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Searching by: {'deleted': False, 'project_id': '5d563fb57d1644ea9f14603151d0d089'} {{(pid=134052) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 02:45:57.049866 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-454a2dce-8977-4b01-aa28-47c55ef851c8 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:57.050629 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-454a2dce-8977-4b01-aa28-47c55ef851c8 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:57.051221 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-454a2dce-8977-4b01-aa28-47c55ef851c8 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:57.052102 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-454a2dce-8977-4b01-aa28-47c55ef851c8 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:57.052754 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-454a2dce-8977-4b01-aa28-47c55ef851c8 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:57.053346 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-454a2dce-8977-4b01-aa28-47c55ef851c8 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:57.080128 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.multi_cell_list [None req-454a2dce-8977-4b01-aa28-47c55ef851c8 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=134052) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 02:45:57.113720 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-454a2dce-8977-4b01-aa28-47c55ef851c8 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] 10.222.0.70 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.091593 Aug 27 02:45:57.114952 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 660/1326] 10.222.0.70 () {58 vars in 1125 bytes} [Sat Aug 27 02:45:57 2022] GET /compute/v2.1/servers => generated 683 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:45:57.130290 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0c1334ef-a8da-4797-b168-e496713fff3b tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:57.131048 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-0c1334ef-a8da-4797-b168-e496713fff3b tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] [instance: 4351cb89-8e57-47d5-9870-87a43e21ea57] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:57.159315 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0c1334ef-a8da-4797-b168-e496713fff3b tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:57.160099 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0c1334ef-a8da-4797-b168-e496713fff3b tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:57.160722 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0c1334ef-a8da-4797-b168-e496713fff3b tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:57.161620 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0c1334ef-a8da-4797-b168-e496713fff3b tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:57.162211 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0c1334ef-a8da-4797-b168-e496713fff3b tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:57.166899 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0c1334ef-a8da-4797-b168-e496713fff3b tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:57.190126 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-0c1334ef-a8da-4797-b168-e496713fff3b tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] HTTP exception thrown: Instance 4351cb89-8e57-47d5-9870-87a43e21ea57 could not be found. Aug 27 02:45:57.192150 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0c1334ef-a8da-4797-b168-e496713fff3b tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Request method failure captured: Aug 27 02:45:57.192150 n-d-852278-4 devstack@n-api.service[134052]: request: DELETE /compute/v2.1/servers/4351cb89-8e57-47d5-9870-87a43e21ea57 HTTP/1.1 Aug 27 02:45:57.192150 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:45:57.192150 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:45:57.192150 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:45:57.192150 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:45:57.192150 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:45:57.192150 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:45:57.192150 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:45:57.192150 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:45:57.192150 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYU1uWDgJ2S3i8wnm38tKLwEsEd6GPcBWEaaoD2Xah7z574RssgOAwJiB8CshvFHNvcIICfPORJAASNhmpvWgqIN53Vezocd1McLDL_uz2RfIqgooaaRqJRt5-jwaNEga7kMv1yBvyL_j7aHlJRlOwXXEJQhohRHKjELpSYbPD8PLJc Aug 27 02:45:57.192150 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:45:57.192150 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:45:57.192150 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:45:57.192150 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:45:57.192150 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:45:57.192150 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:45:57.192150 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 5d563fb57d1644ea9f14603151d0d089 Aug 27 02:45:57.192150 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ListServersNegativeTestJSON-1549884191 Aug 27 02:45:57.192150 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:45:57.192150 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:45:57.193886 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5d563fb57d1644ea9f14603151d0d089"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_5d563fb57d1644ea9f14603151d0d089", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5d563fb57d1644ea9f14603151d0d089"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/5d563fb57d1644ea9f14603151d0d089"}]}] Aug 27 02:45:57.193886 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ListServersNegativeTestJSON-1549884191 Aug 27 02:45:57.193886 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 5d563fb57d1644ea9f14603151d0d089 Aug 27 02:45:57.193886 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1549884191 Aug 27 02:45:57.193886 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ListServersNegativeTestJSON-1549884191-project Aug 27 02:45:57.193886 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:45:57.193886 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:45:57.193886 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: a20f8524b5e042fa9968287ab9257c84 Aug 27 02:45:57.193886 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ListServersNegativeTestJSON-1549884191-project Aug 27 02:45:57.193886 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 02:45:57.193886 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance 4351cb89-8e57-47d5-9870-87a43e21ea57 could not be found. Aug 27 02:45:57.193886 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '4351cb89-8e57-47d5-9870-87a43e21ea57'} Aug 27 02:45:57.194792 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:45:57.194792 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:57.194792 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:45:57.194792 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:45:57.194792 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:45:57.194792 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:45:57.194792 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:45:57.194792 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:45:57.194792 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:45:57.194792 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:45:57.194792 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4351cb89-8e57-47d5-9870-87a43e21ea57 could not be found. Aug 27 02:45:57.194792 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:45:57.194792 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:45:57.194792 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:45:57.194792 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:57.194792 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:45:57.194792 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:45:57.194792 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:45:57.194792 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:45:57.194792 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:45:57.196292 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:45:57.196292 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 02:45:57.196292 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 02:45:57.196292 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 02:45:57.196292 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 02:45:57.196292 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:45:57.196292 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:45:57.196292 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:45:57.196292 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:45:57.196292 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4351cb89-8e57-47d5-9870-87a43e21ea57 could not be found. Aug 27 02:45:57.196292 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:45:57.196292 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:45:57.196292 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:45:57.196292 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:57.196292 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:45:57.196292 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:45:57.196292 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:45:57.196292 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:45:57.196292 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4351cb89-8e57-47d5-9870-87a43e21ea57 could not be found. Aug 27 02:45:57.196292 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:45:57.200527 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0c1334ef-a8da-4797-b168-e496713fff3b tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Returning 404 to user: Instance 4351cb89-8e57-47d5-9870-87a43e21ea57 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:45:57.201707 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-0c1334ef-a8da-4797-b168-e496713fff3b tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] 10.222.0.70 "DELETE /compute/v2.1/servers/4351cb89-8e57-47d5-9870-87a43e21ea57" status: 404 len: 111 microversion: 2.1 time: 0.077399 Aug 27 02:45:57.202872 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 661/1327] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:45:57 2022] DELETE /compute/v2.1/servers/4351cb89-8e57-47d5-9870-87a43e21ea57 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:45:57.220160 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-94b92d9b-6789-4b0b-be40-79258ded010e tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:57.220781 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-94b92d9b-6789-4b0b-be40-79258ded010e tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] [instance: 4eaf21fb-2b59-4e0e-abd4-72c8e422534d] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:57.237022 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-2c5e6e02-72bd-45ef-b8a8-d7a82f6359fe tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:57.252159 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-2c5e6e02-72bd-45ef-b8a8-d7a82f6359fe tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b" status: 200 len: 1197 microversion: 2.1 time: 0.323408 Aug 27 02:45:57.252339 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-94b92d9b-6789-4b0b-be40-79258ded010e tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:57.252784 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-94b92d9b-6789-4b0b-be40-79258ded010e tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:57.253384 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-94b92d9b-6789-4b0b-be40-79258ded010e tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:57.255022 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 667/1328] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:56 2022] GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b => generated 1197 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:57.262780 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-94b92d9b-6789-4b0b-be40-79258ded010e tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:57.263625 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-94b92d9b-6789-4b0b-be40-79258ded010e tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:57.264346 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-94b92d9b-6789-4b0b-be40-79258ded010e tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:57.294717 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-94b92d9b-6789-4b0b-be40-79258ded010e tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] [instance: 4eaf21fb-2b59-4e0e-abd4-72c8e422534d] Going to try to terminate instance {{(pid=134052) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:45:57.299593 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-bdb611b9-1081-41ba-80f6-bcdcd3532d3c tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:57.300195 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-bdb611b9-1081-41ba-80f6-bcdcd3532d3c tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: f620f083-7230-471a-87d0-f6d85f8ad087] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:57.317709 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bdb611b9-1081-41ba-80f6-bcdcd3532d3c tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:57.318494 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bdb611b9-1081-41ba-80f6-bcdcd3532d3c tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:57.319820 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bdb611b9-1081-41ba-80f6-bcdcd3532d3c tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:57.321144 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bdb611b9-1081-41ba-80f6-bcdcd3532d3c tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:57.321611 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bdb611b9-1081-41ba-80f6-bcdcd3532d3c tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:57.322150 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bdb611b9-1081-41ba-80f6-bcdcd3532d3c tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:57.388233 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:45:57.401979 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-94b92d9b-6789-4b0b-be40-79258ded010e tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] 10.222.0.70 "DELETE /compute/v2.1/servers/4eaf21fb-2b59-4e0e-abd4-72c8e422534d" status: 204 len: 0 microversion: 2.1 time: 0.194996 Aug 27 02:45:57.402870 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 662/1329] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:45:57 2022] DELETE /compute/v2.1/servers/4eaf21fb-2b59-4e0e-abd4-72c8e422534d => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:45:57.410743 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6477a634-6b7c-4a87-8307-43321dc88fed tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1201761228", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:45:57.468551 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.network.neutron [None req-6477a634-6b7c-4a87-8307-43321dc88fed tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] validate_networks() for [('48fc4806-56c1-4954-8212-e1e78b76e094', None, None, None, None, None)] {{(pid=134052) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:45:57.624997 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-bdb611b9-1081-41ba-80f6-bcdcd3532d3c tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:57.634791 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-bdb611b9-1081-41ba-80f6-bcdcd3532d3c tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:57.636426 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-bdb611b9-1081-41ba-80f6-bcdcd3532d3c tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:57.637669 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-bdb611b9-1081-41ba-80f6-bcdcd3532d3c tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/f620f083-7230-471a-87d0-f6d85f8ad087" status: 200 len: 1487 microversion: 2.25 time: 0.343565 Aug 27 02:45:57.638531 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 668/1330] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:45:57 2022] GET /compute/v2.1/servers/f620f083-7230-471a-87d0-f6d85f8ad087 => generated 1487 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:45:57.658578 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-9337569e-4bcf-4726-8d3b-bfd500bac14e tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:57.659315 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-9337569e-4bcf-4726-8d3b-bfd500bac14e tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: eb11f5d3-ce63-461d-a83f-04f33ce7c16b] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:57.666021 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9337569e-4bcf-4726-8d3b-bfd500bac14e tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:57.666599 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9337569e-4bcf-4726-8d3b-bfd500bac14e tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:57.667104 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9337569e-4bcf-4726-8d3b-bfd500bac14e tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:57.668177 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9337569e-4bcf-4726-8d3b-bfd500bac14e tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:57.668331 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9337569e-4bcf-4726-8d3b-bfd500bac14e tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:57.668861 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9337569e-4bcf-4726-8d3b-bfd500bac14e tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:57.988161 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-9337569e-4bcf-4726-8d3b-bfd500bac14e tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6d1646ec094e3297f6f3c51dd72e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b105816fd4e54b9da4973ff721e1fb92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:57.989580 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=100 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:45:57.995190 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-9337569e-4bcf-4726-8d3b-bfd500bac14e tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "GET /compute/v2.1/servers/eb11f5d3-ce63-461d-a83f-04f33ce7c16b" status: 200 len: 1317 microversion: 2.1 time: 0.341364 Aug 27 02:45:57.997267 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 669/1331] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:57 2022] GET /compute/v2.1/servers/eb11f5d3-ce63-461d-a83f-04f33ce7c16b => generated 1317 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:58.007227 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-26885a80-8644-4881-8789-a388ea735c80 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:58.007962 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-26885a80-8644-4881-8789-a388ea735c80 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] [instance: ad971605-1da6-4df8-ae39-be0b82b9dad7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:58.018313 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-26885a80-8644-4881-8789-a388ea735c80 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:58.018518 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-26885a80-8644-4881-8789-a388ea735c80 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:58.018872 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-26885a80-8644-4881-8789-a388ea735c80 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:58.019579 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-26885a80-8644-4881-8789-a388ea735c80 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:58.020025 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-26885a80-8644-4881-8789-a388ea735c80 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:58.020488 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-26885a80-8644-4881-8789-a388ea735c80 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:58.049125 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-26885a80-8644-4881-8789-a388ea735c80 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] [instance: ad971605-1da6-4df8-ae39-be0b82b9dad7] Going to try to terminate instance {{(pid=134051) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:45:58.148372 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-26885a80-8644-4881-8789-a388ea735c80 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] 10.222.0.70 "DELETE /compute/v2.1/servers/ad971605-1da6-4df8-ae39-be0b82b9dad7" status: 204 len: 0 microversion: 2.1 time: 0.149494 Aug 27 02:45:58.149318 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 670/1332] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:45:57 2022] DELETE /compute/v2.1/servers/ad971605-1da6-4df8-ae39-be0b82b9dad7 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:45:58.158463 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-751eb65b-0508-4cb5-afd3-9b0e0f532ee7 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:58.159452 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-751eb65b-0508-4cb5-afd3-9b0e0f532ee7 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] [instance: 484e03a9-aef3-4179-980c-0e7292a05b5a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:58.166201 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-751eb65b-0508-4cb5-afd3-9b0e0f532ee7 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:58.166795 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-751eb65b-0508-4cb5-afd3-9b0e0f532ee7 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:58.167491 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-751eb65b-0508-4cb5-afd3-9b0e0f532ee7 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:58.168576 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-751eb65b-0508-4cb5-afd3-9b0e0f532ee7 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:58.169285 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-751eb65b-0508-4cb5-afd3-9b0e0f532ee7 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:58.169978 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-751eb65b-0508-4cb5-afd3-9b0e0f532ee7 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:58.275812 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-6477a634-6b7c-4a87-8307-43321dc88fed tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Flavor limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:45:58.277293 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-6477a634-6b7c-4a87-8307-43321dc88fed tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Image limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:45:58.277982 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-6477a634-6b7c-4a87-8307-43321dc88fed tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Flavor pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:45:58.279870 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-6477a634-6b7c-4a87-8307-43321dc88fed tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Image pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:45:58.280648 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-6477a634-6b7c-4a87-8307-43321dc88fed tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:45:58.295638 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6477a634-6b7c-4a87-8307-43321dc88fed tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:58.296482 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6477a634-6b7c-4a87-8307-43321dc88fed tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:58.297136 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6477a634-6b7c-4a87-8307-43321dc88fed tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:58.298244 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6477a634-6b7c-4a87-8307-43321dc88fed tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:58.298920 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6477a634-6b7c-4a87-8307-43321dc88fed tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:58.299554 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6477a634-6b7c-4a87-8307-43321dc88fed tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:58.325161 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-6477a634-6b7c-4a87-8307-43321dc88fed tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Getting quotas for project f5668e6d96694c62b83f7e8381fe86e1. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:45:58.346859 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-6477a634-6b7c-4a87-8307-43321dc88fed tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Getting quotas for user 0e86c17fe83848e2bc96b7c83ff1cf14 and project f5668e6d96694c62b83f7e8381fe86e1. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:45:58.376057 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-6477a634-6b7c-4a87-8307-43321dc88fed tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Going to run 1 instances... {{(pid=134052) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:45:58.379759 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-6477a634-6b7c-4a87-8307-43321dc88fed tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] [instance: 4b798950-60e1-4097-a7e0-365dd0976cb5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134052) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:45:58.416262 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-751eb65b-0508-4cb5-afd3-9b0e0f532ee7 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:58.426837 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-751eb65b-0508-4cb5-afd3-9b0e0f532ee7 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:58.428110 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-751eb65b-0508-4cb5-afd3-9b0e0f532ee7 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:58.429379 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-751eb65b-0508-4cb5-afd3-9b0e0f532ee7 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] 10.222.0.70 "GET /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a" status: 200 len: 1845 microversion: 2.42 time: 0.278545 Aug 27 02:45:58.430266 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 671/1333] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:45:58 2022] GET /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a => generated 1845 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:45:58.435097 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-382fd029-d251-4292-8035-743cf8c5cfc1 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:58.435753 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-382fd029-d251-4292-8035-743cf8c5cfc1 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] [instance: 4351cb89-8e57-47d5-9870-87a43e21ea57] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:58.440040 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-6477a634-6b7c-4a87-8307-43321dc88fed tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.035748 Aug 27 02:45:58.441452 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 663/1334] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 02:45:57 2022] POST /compute/v2.1/servers => generated 383 bytes in 1038 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:45:58.446280 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5bf814ff-9ec3-4f8f-8aad-f574cd0d9c76 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:58.447424 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-5bf814ff-9ec3-4f8f-8aad-f574cd0d9c76 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 70acfe32-deea-46fc-a214-8fdbb9f6cb7b] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:58.455575 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5bf814ff-9ec3-4f8f-8aad-f574cd0d9c76 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:58.456465 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5bf814ff-9ec3-4f8f-8aad-f574cd0d9c76 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:58.457054 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5bf814ff-9ec3-4f8f-8aad-f574cd0d9c76 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:58.457921 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5bf814ff-9ec3-4f8f-8aad-f574cd0d9c76 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:58.458584 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5bf814ff-9ec3-4f8f-8aad-f574cd0d9c76 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:58.459159 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5bf814ff-9ec3-4f8f-8aad-f574cd0d9c76 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:58.464531 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-382fd029-d251-4292-8035-743cf8c5cfc1 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:58.465351 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-382fd029-d251-4292-8035-743cf8c5cfc1 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:58.467187 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-382fd029-d251-4292-8035-743cf8c5cfc1 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:58.469435 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-382fd029-d251-4292-8035-743cf8c5cfc1 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:58.471879 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-382fd029-d251-4292-8035-743cf8c5cfc1 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:58.472585 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-382fd029-d251-4292-8035-743cf8c5cfc1 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:58.498108 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:45:58.509567 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-382fd029-d251-4292-8035-743cf8c5cfc1 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] HTTP exception thrown: Instance 4351cb89-8e57-47d5-9870-87a43e21ea57 could not be found. Aug 27 02:45:58.511360 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-382fd029-d251-4292-8035-743cf8c5cfc1 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Request method failure captured: Aug 27 02:45:58.511360 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/4351cb89-8e57-47d5-9870-87a43e21ea57 HTTP/1.1 Aug 27 02:45:58.511360 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:45:58.511360 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:45:58.511360 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:45:58.511360 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:45:58.511360 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:45:58.511360 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:45:58.511360 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:45:58.511360 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:45:58.511360 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYU1uWDgJ2S3i8wnm38tKLwEsEd6GPcBWEaaoD2Xah7z574RssgOAwJiB8CshvFHNvcIICfPORJAASNhmpvWgqIN53Vezocd1McLDL_uz2RfIqgooaaRqJRt5-jwaNEga7kMv1yBvyL_j7aHlJRlOwXXEJQhohRHKjELpSYbPD8PLJc Aug 27 02:45:58.511360 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:45:58.511360 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:45:58.511360 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:45:58.511360 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:45:58.511360 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:45:58.511360 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:45:58.511360 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 5d563fb57d1644ea9f14603151d0d089 Aug 27 02:45:58.511360 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ListServersNegativeTestJSON-1549884191 Aug 27 02:45:58.511360 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:45:58.511360 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:45:58.513093 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5d563fb57d1644ea9f14603151d0d089"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_5d563fb57d1644ea9f14603151d0d089", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5d563fb57d1644ea9f14603151d0d089"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/5d563fb57d1644ea9f14603151d0d089"}]}] Aug 27 02:45:58.513093 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ListServersNegativeTestJSON-1549884191 Aug 27 02:45:58.513093 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 5d563fb57d1644ea9f14603151d0d089 Aug 27 02:45:58.513093 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1549884191 Aug 27 02:45:58.513093 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ListServersNegativeTestJSON-1549884191-project Aug 27 02:45:58.513093 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:45:58.513093 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:45:58.513093 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: a20f8524b5e042fa9968287ab9257c84 Aug 27 02:45:58.513093 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ListServersNegativeTestJSON-1549884191-project Aug 27 02:45:58.513093 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 02:45:58.513093 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance 4351cb89-8e57-47d5-9870-87a43e21ea57 could not be found. Aug 27 02:45:58.513093 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '4351cb89-8e57-47d5-9870-87a43e21ea57'} Aug 27 02:45:58.514145 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:45:58.514145 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:58.514145 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:45:58.514145 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:45:58.514145 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:45:58.514145 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:45:58.514145 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:45:58.514145 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:45:58.514145 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:45:58.514145 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:45:58.514145 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4351cb89-8e57-47d5-9870-87a43e21ea57 could not be found. Aug 27 02:45:58.514145 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:45:58.514145 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:45:58.514145 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:45:58.514145 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:58.514145 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:45:58.514145 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:45:58.514145 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:45:58.514145 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:45:58.514145 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:45:58.515707 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:45:58.515707 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:45:58.515707 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:45:58.515707 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:45:58.515707 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:45:58.515707 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:45:58.515707 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:45:58.515707 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4351cb89-8e57-47d5-9870-87a43e21ea57 could not be found. Aug 27 02:45:58.515707 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:45:58.515707 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:45:58.515707 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:45:58.515707 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:58.515707 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:45:58.515707 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:45:58.515707 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:45:58.515707 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:45:58.515707 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4351cb89-8e57-47d5-9870-87a43e21ea57 could not be found. Aug 27 02:45:58.515707 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:45:58.517141 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-382fd029-d251-4292-8035-743cf8c5cfc1 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Returning 404 to user: Instance 4351cb89-8e57-47d5-9870-87a43e21ea57 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:45:58.517141 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-382fd029-d251-4292-8035-743cf8c5cfc1 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] 10.222.0.70 "GET /compute/v2.1/servers/4351cb89-8e57-47d5-9870-87a43e21ea57" status: 404 len: 111 microversion: 2.1 time: 0.084577 Aug 27 02:45:58.517934 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 672/1335] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:58 2022] GET /compute/v2.1/servers/4351cb89-8e57-47d5-9870-87a43e21ea57 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:45:58.523909 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4bf0428a-aed8-42f0-99e0-1d7b0d97aee2 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:58.525200 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-4bf0428a-aed8-42f0-99e0-1d7b0d97aee2 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] [instance: 4b798950-60e1-4097-a7e0-365dd0976cb5] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:58.645398 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-4bf0428a-aed8-42f0-99e0-1d7b0d97aee2 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e86c17fe83848e2bc96b7c83ff1cf14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5668e6d96694c62b83f7e8381fe86e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:58.652682 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-4bf0428a-aed8-42f0-99e0-1d7b0d97aee2 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] 10.222.0.70 "GET /compute/v2.1/servers/4b798950-60e1-4097-a7e0-365dd0976cb5" status: 200 len: 1225 microversion: 2.1 time: 0.133580 Aug 27 02:45:58.653255 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 673/1336] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:58 2022] GET /compute/v2.1/servers/4b798950-60e1-4097-a7e0-365dd0976cb5 => generated 1225 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:58.669087 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-5e250b90-3b91-491b-95d3-bd3972ab1f7e tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:58.669087 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-5e250b90-3b91-491b-95d3-bd3972ab1f7e tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] [instance: 4eaf21fb-2b59-4e0e-abd4-72c8e422534d] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:58.679854 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5e250b90-3b91-491b-95d3-bd3972ab1f7e tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:58.680275 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5e250b90-3b91-491b-95d3-bd3972ab1f7e tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:58.680728 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5e250b90-3b91-491b-95d3-bd3972ab1f7e tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:58.691408 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5e250b90-3b91-491b-95d3-bd3972ab1f7e tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:58.692633 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5e250b90-3b91-491b-95d3-bd3972ab1f7e tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:58.693098 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5e250b90-3b91-491b-95d3-bd3972ab1f7e tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:58.724553 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-5bf814ff-9ec3-4f8f-8aad-f574cd0d9c76 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:58.734347 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-5bf814ff-9ec3-4f8f-8aad-f574cd0d9c76 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b" status: 200 len: 1197 microversion: 2.1 time: 0.291585 Aug 27 02:45:58.738142 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 664/1337] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:58 2022] GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b => generated 1197 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:58.745307 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-515f0442-0cd2-43fc-80bc-6d18601c5a00 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:58.746221 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-515f0442-0cd2-43fc-80bc-6d18601c5a00 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: f620f083-7230-471a-87d0-f6d85f8ad087] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:58.761033 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-515f0442-0cd2-43fc-80bc-6d18601c5a00 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:58.762001 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-515f0442-0cd2-43fc-80bc-6d18601c5a00 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:58.762818 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-515f0442-0cd2-43fc-80bc-6d18601c5a00 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:58.764602 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-515f0442-0cd2-43fc-80bc-6d18601c5a00 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:58.765455 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-515f0442-0cd2-43fc-80bc-6d18601c5a00 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:58.766101 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-515f0442-0cd2-43fc-80bc-6d18601c5a00 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:58.951827 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-5e250b90-3b91-491b-95d3-bd3972ab1f7e tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20f8524b5e042fa9968287ab9257c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d563fb57d1644ea9f14603151d0d089', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:58.964511 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-5e250b90-3b91-491b-95d3-bd3972ab1f7e tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] 10.222.0.70 "GET /compute/v2.1/servers/4eaf21fb-2b59-4e0e-abd4-72c8e422534d" status: 200 len: 1522 microversion: 2.1 time: 0.307180 Aug 27 02:45:58.965339 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 674/1338] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:58 2022] GET /compute/v2.1/servers/4eaf21fb-2b59-4e0e-abd4-72c8e422534d => generated 1522 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:58.981423 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-515f0442-0cd2-43fc-80bc-6d18601c5a00 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:58.990356 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-515f0442-0cd2-43fc-80bc-6d18601c5a00 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:58.991806 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-515f0442-0cd2-43fc-80bc-6d18601c5a00 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:58.993191 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-515f0442-0cd2-43fc-80bc-6d18601c5a00 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/f620f083-7230-471a-87d0-f6d85f8ad087" status: 200 len: 1487 microversion: 2.25 time: 0.253748 Aug 27 02:45:58.994248 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 665/1339] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:45:58 2022] GET /compute/v2.1/servers/f620f083-7230-471a-87d0-f6d85f8ad087 => generated 1487 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:45:59.017264 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-1830ee4a-eb99-4b04-8379-b671715dabd2 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:59.017967 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-1830ee4a-eb99-4b04-8379-b671715dabd2 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: eb11f5d3-ce63-461d-a83f-04f33ce7c16b] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:59.024511 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1830ee4a-eb99-4b04-8379-b671715dabd2 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:59.024892 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1830ee4a-eb99-4b04-8379-b671715dabd2 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:59.025327 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1830ee4a-eb99-4b04-8379-b671715dabd2 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:59.026226 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1830ee4a-eb99-4b04-8379-b671715dabd2 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:59.026676 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1830ee4a-eb99-4b04-8379-b671715dabd2 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:59.027098 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1830ee4a-eb99-4b04-8379-b671715dabd2 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:59.164602 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-1830ee4a-eb99-4b04-8379-b671715dabd2 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6d1646ec094e3297f6f3c51dd72e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b105816fd4e54b9da4973ff721e1fb92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:59.174230 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-1830ee4a-eb99-4b04-8379-b671715dabd2 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "GET /compute/v2.1/servers/eb11f5d3-ce63-461d-a83f-04f33ce7c16b" status: 200 len: 1317 microversion: 2.1 time: 0.160994 Aug 27 02:45:59.175421 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 675/1340] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:59 2022] GET /compute/v2.1/servers/eb11f5d3-ce63-461d-a83f-04f33ce7c16b => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:59.461145 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4d07e822-bb0e-405c-872f-ba7c31a369b4 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:59.462062 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-4d07e822-bb0e-405c-872f-ba7c31a369b4 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] [instance: 484e03a9-aef3-4179-980c-0e7292a05b5a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:59.470284 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4d07e822-bb0e-405c-872f-ba7c31a369b4 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:59.471071 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4d07e822-bb0e-405c-872f-ba7c31a369b4 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:59.472960 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4d07e822-bb0e-405c-872f-ba7c31a369b4 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:59.473729 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4d07e822-bb0e-405c-872f-ba7c31a369b4 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:59.474424 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4d07e822-bb0e-405c-872f-ba7c31a369b4 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:59.474952 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4d07e822-bb0e-405c-872f-ba7c31a369b4 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:59.677050 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e890e8f1-1786-41ae-b4e4-4a5324ed9ee6 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:59.677673 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-e890e8f1-1786-41ae-b4e4-4a5324ed9ee6 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] [instance: 4b798950-60e1-4097-a7e0-365dd0976cb5] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:59.684651 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e890e8f1-1786-41ae-b4e4-4a5324ed9ee6 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:59.685247 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e890e8f1-1786-41ae-b4e4-4a5324ed9ee6 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:59.690270 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e890e8f1-1786-41ae-b4e4-4a5324ed9ee6 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:59.690860 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e890e8f1-1786-41ae-b4e4-4a5324ed9ee6 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:59.691395 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e890e8f1-1786-41ae-b4e4-4a5324ed9ee6 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:59.691900 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e890e8f1-1786-41ae-b4e4-4a5324ed9ee6 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:59.750946 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-4d07e822-bb0e-405c-872f-ba7c31a369b4 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:59.763852 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-4d07e822-bb0e-405c-872f-ba7c31a369b4 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:59.766119 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-4d07e822-bb0e-405c-872f-ba7c31a369b4 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:59.767770 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-4d07e822-bb0e-405c-872f-ba7c31a369b4 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] 10.222.0.70 "GET /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a" status: 200 len: 1845 microversion: 2.42 time: 0.313270 Aug 27 02:45:59.780841 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 666/1341] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:45:59 2022] GET /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a => generated 1845 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:45:59.791539 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b13cfc65-9747-4790-a367-e88bce4e69fe tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:59.791539 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b13cfc65-9747-4790-a367-e88bce4e69fe tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 70acfe32-deea-46fc-a214-8fdbb9f6cb7b] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:59.792056 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e890e8f1-1786-41ae-b4e4-4a5324ed9ee6 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e86c17fe83848e2bc96b7c83ff1cf14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5668e6d96694c62b83f7e8381fe86e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:59.810054 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b13cfc65-9747-4790-a367-e88bce4e69fe tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:59.810869 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b13cfc65-9747-4790-a367-e88bce4e69fe tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:59.811940 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b13cfc65-9747-4790-a367-e88bce4e69fe tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:59.813589 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b13cfc65-9747-4790-a367-e88bce4e69fe tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:59.813914 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b13cfc65-9747-4790-a367-e88bce4e69fe tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:59.814656 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b13cfc65-9747-4790-a367-e88bce4e69fe tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:59.835249 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e890e8f1-1786-41ae-b4e4-4a5324ed9ee6 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] 10.222.0.70 "GET /compute/v2.1/servers/4b798950-60e1-4097-a7e0-365dd0976cb5" status: 200 len: 1221 microversion: 2.1 time: 0.161891 Aug 27 02:45:59.847451 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 676/1342] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:59 2022] GET /compute/v2.1/servers/4b798950-60e1-4097-a7e0-365dd0976cb5 => generated 1221 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:45:59.997250 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d552999d-3dd4-428c-b48c-0d920aa5af70 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:00.001598 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d552999d-3dd4-428c-b48c-0d920aa5af70 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] [instance: 4eaf21fb-2b59-4e0e-abd4-72c8e422534d] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:00.021703 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d552999d-3dd4-428c-b48c-0d920aa5af70 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:00.022962 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d552999d-3dd4-428c-b48c-0d920aa5af70 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:00.023587 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d552999d-3dd4-428c-b48c-0d920aa5af70 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:00.024537 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d552999d-3dd4-428c-b48c-0d920aa5af70 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:00.025154 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d552999d-3dd4-428c-b48c-0d920aa5af70 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:00.027952 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d552999d-3dd4-428c-b48c-0d920aa5af70 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:00.909082 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b13cfc65-9747-4790-a367-e88bce4e69fe tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:00.926573 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b13cfc65-9747-4790-a367-e88bce4e69fe tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b" status: 200 len: 1197 microversion: 2.1 time: 1.147915 Aug 27 02:46:00.930386 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 667/1343] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:59 2022] GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b => generated 1197 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:00.944190 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6fd2eaef-fd59-40b8-81aa-c18c1977bd45 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:00.945641 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-6fd2eaef-fd59-40b8-81aa-c18c1977bd45 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: f620f083-7230-471a-87d0-f6d85f8ad087] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:00.955249 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6fd2eaef-fd59-40b8-81aa-c18c1977bd45 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:00.956524 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6fd2eaef-fd59-40b8-81aa-c18c1977bd45 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:00.957160 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6fd2eaef-fd59-40b8-81aa-c18c1977bd45 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:00.958536 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6fd2eaef-fd59-40b8-81aa-c18c1977bd45 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:00.959312 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6fd2eaef-fd59-40b8-81aa-c18c1977bd45 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:00.959952 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6fd2eaef-fd59-40b8-81aa-c18c1977bd45 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:01.138953 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d552999d-3dd4-428c-b48c-0d920aa5af70 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20f8524b5e042fa9968287ab9257c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d563fb57d1644ea9f14603151d0d089', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:01.156970 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d552999d-3dd4-428c-b48c-0d920aa5af70 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] 10.222.0.70 "GET /compute/v2.1/servers/4eaf21fb-2b59-4e0e-abd4-72c8e422534d" status: 200 len: 1522 microversion: 2.1 time: 1.173605 Aug 27 02:46:01.157693 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 677/1344] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:59 2022] GET /compute/v2.1/servers/4eaf21fb-2b59-4e0e-abd4-72c8e422534d => generated 1522 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:46:01.175448 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-5f4c9669-5c07-4c59-a580-7cd258087f0b tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:01.176377 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-5f4c9669-5c07-4c59-a580-7cd258087f0b tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: eb11f5d3-ce63-461d-a83f-04f33ce7c16b] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:01.183909 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5f4c9669-5c07-4c59-a580-7cd258087f0b tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:01.184708 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5f4c9669-5c07-4c59-a580-7cd258087f0b tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:01.185414 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5f4c9669-5c07-4c59-a580-7cd258087f0b tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:01.186360 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5f4c9669-5c07-4c59-a580-7cd258087f0b tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:01.187006 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5f4c9669-5c07-4c59-a580-7cd258087f0b tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:01.187635 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5f4c9669-5c07-4c59-a580-7cd258087f0b tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:01.378501 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-6fd2eaef-fd59-40b8-81aa-c18c1977bd45 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:01.387485 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-6fd2eaef-fd59-40b8-81aa-c18c1977bd45 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:01.389518 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-6fd2eaef-fd59-40b8-81aa-c18c1977bd45 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:01.391249 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-6fd2eaef-fd59-40b8-81aa-c18c1977bd45 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/f620f083-7230-471a-87d0-f6d85f8ad087" status: 200 len: 1487 microversion: 2.25 time: 0.459302 Aug 27 02:46:01.418431 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 668/1345] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:46:00 2022] GET /compute/v2.1/servers/f620f083-7230-471a-87d0-f6d85f8ad087 => generated 1487 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:46:01.426249 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-367adb47-bd48-4e7c-a626-64edeb52411d req-82949835-8fbd-434e-bf81-e3c61f5ed690 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70acfe32-deea-46fc-a214-8fdbb9f6cb7b", "name": "network-vif-plugged", "status": "completed", "tag": "2644ae8b-0546-435d-ae4e-79c3fb9a12cc"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:46:01.493570 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-367adb47-bd48-4e7c-a626-64edeb52411d req-82949835-8fbd-434e-bf81-e3c61f5ed690 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:01.498781 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-367adb47-bd48-4e7c-a626-64edeb52411d req-82949835-8fbd-434e-bf81-e3c61f5ed690 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:01.500248 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-367adb47-bd48-4e7c-a626-64edeb52411d req-82949835-8fbd-434e-bf81-e3c61f5ed690 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:01.546258 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-5f4c9669-5c07-4c59-a580-7cd258087f0b tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6d1646ec094e3297f6f3c51dd72e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b105816fd4e54b9da4973ff721e1fb92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:01.559468 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-367adb47-bd48-4e7c-a626-64edeb52411d req-82949835-8fbd-434e-bf81-e3c61f5ed690 service nova] Creating event network-vif-plugged:2644ae8b-0546-435d-ae4e-79c3fb9a12cc for instance 70acfe32-deea-46fc-a214-8fdbb9f6cb7b on n-h2-852278-4 Aug 27 02:46:01.560543 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-5f4c9669-5c07-4c59-a580-7cd258087f0b tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "GET /compute/v2.1/servers/eb11f5d3-ce63-461d-a83f-04f33ce7c16b" status: 200 len: 1317 microversion: 2.1 time: 0.388687 Aug 27 02:46:01.562392 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 678/1346] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:01 2022] GET /compute/v2.1/servers/eb11f5d3-ce63-461d-a83f-04f33ce7c16b => generated 1317 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:01.572345 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-367adb47-bd48-4e7c-a626-64edeb52411d req-82949835-8fbd-434e-bf81-e3c61f5ed690 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150977 Aug 27 02:46:01.572942 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 669/1347] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:46:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:46:01.574084 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-298dbb20-b3e5-4000-868d-3b45d859336e req-2161c8d9-d527-4de7-ab2f-deb8c353c485 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad971605-1da6-4df8-ae39-be0b82b9dad7", "name": "network-vif-deleted", "tag": "68307369-dc29-4bcb-ac64-aa4ad2c62cec"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:46:01.584290 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-cc8df377-6030-455e-b7b5-5d03b0bd551d tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:01.589534 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-cc8df377-6030-455e-b7b5-5d03b0bd551d tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] [instance: 484e03a9-aef3-4179-980c-0e7292a05b5a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:01.597871 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-298dbb20-b3e5-4000-868d-3b45d859336e req-2161c8d9-d527-4de7-ab2f-deb8c353c485 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:01.599997 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-298dbb20-b3e5-4000-868d-3b45d859336e req-2161c8d9-d527-4de7-ab2f-deb8c353c485 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:01.603522 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-298dbb20-b3e5-4000-868d-3b45d859336e req-2161c8d9-d527-4de7-ab2f-deb8c353c485 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:01.610903 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cc8df377-6030-455e-b7b5-5d03b0bd551d tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:01.613306 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cc8df377-6030-455e-b7b5-5d03b0bd551d tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:01.616669 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cc8df377-6030-455e-b7b5-5d03b0bd551d tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:01.617676 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cc8df377-6030-455e-b7b5-5d03b0bd551d tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:01.620875 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cc8df377-6030-455e-b7b5-5d03b0bd551d tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:01.621491 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cc8df377-6030-455e-b7b5-5d03b0bd551d tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:01.640996 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-298dbb20-b3e5-4000-868d-3b45d859336e req-2161c8d9-d527-4de7-ab2f-deb8c353c485 service nova] Creating event network-vif-deleted:68307369-dc29-4bcb-ac64-aa4ad2c62cec for instance ad971605-1da6-4df8-ae39-be0b82b9dad7 on n-h1-852278-4 Aug 27 02:46:01.660253 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-298dbb20-b3e5-4000-868d-3b45d859336e req-2161c8d9-d527-4de7-ab2f-deb8c353c485 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096576 Aug 27 02:46:01.665734 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 679/1348] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:46:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:46:01.686566 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a853b913-9437-49f1-a49f-06c8090d9f3a tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:01.687439 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-a853b913-9437-49f1-a49f-06c8090d9f3a tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] [instance: 4b798950-60e1-4097-a7e0-365dd0976cb5] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:01.700060 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a853b913-9437-49f1-a49f-06c8090d9f3a tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:01.700590 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a853b913-9437-49f1-a49f-06c8090d9f3a tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:01.701074 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a853b913-9437-49f1-a49f-06c8090d9f3a tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:01.701783 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a853b913-9437-49f1-a49f-06c8090d9f3a tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:01.702242 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a853b913-9437-49f1-a49f-06c8090d9f3a tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:01.702676 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a853b913-9437-49f1-a49f-06c8090d9f3a tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:01.868434 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-a853b913-9437-49f1-a49f-06c8090d9f3a tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e86c17fe83848e2bc96b7c83ff1cf14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5668e6d96694c62b83f7e8381fe86e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:01.882099 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a853b913-9437-49f1-a49f-06c8090d9f3a tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] 10.222.0.70 "GET /compute/v2.1/servers/4b798950-60e1-4097-a7e0-365dd0976cb5" status: 200 len: 1283 microversion: 2.1 time: 0.214686 Aug 27 02:46:01.883752 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 680/1349] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:01 2022] GET /compute/v2.1/servers/4b798950-60e1-4097-a7e0-365dd0976cb5 => generated 1283 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:01.890799 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-1771eaed-2e74-4d12-a598-9332822a9844 req-5ce57b12-c410-4265-ba26-2347342c7581 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "484e03a9-aef3-4179-980c-0e7292a05b5a", "tag": "cd7a0d56-e84b-4f98-9baf-449824810d8d"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:46:01.907932 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-1771eaed-2e74-4d12-a598-9332822a9844 req-5ce57b12-c410-4265-ba26-2347342c7581 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:01.908750 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-1771eaed-2e74-4d12-a598-9332822a9844 req-5ce57b12-c410-4265-ba26-2347342c7581 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:01.909480 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-1771eaed-2e74-4d12-a598-9332822a9844 req-5ce57b12-c410-4265-ba26-2347342c7581 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:01.927350 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-1771eaed-2e74-4d12-a598-9332822a9844 req-5ce57b12-c410-4265-ba26-2347342c7581 service nova] Creating event network-changed:cd7a0d56-e84b-4f98-9baf-449824810d8d for instance 484e03a9-aef3-4179-980c-0e7292a05b5a on n-h1-852278-4 Aug 27 02:46:01.933938 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-1771eaed-2e74-4d12-a598-9332822a9844 req-5ce57b12-c410-4265-ba26-2347342c7581 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047312 Aug 27 02:46:01.935600 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 681/1350] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:46:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:46:01.965343 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f6545bc4-aa84-47d8-99e5-89c88dd7a592 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:01.966703 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-f6545bc4-aa84-47d8-99e5-89c88dd7a592 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 70acfe32-deea-46fc-a214-8fdbb9f6cb7b] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:01.982464 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f6545bc4-aa84-47d8-99e5-89c88dd7a592 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:01.982971 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f6545bc4-aa84-47d8-99e5-89c88dd7a592 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:01.983407 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f6545bc4-aa84-47d8-99e5-89c88dd7a592 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:01.984356 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f6545bc4-aa84-47d8-99e5-89c88dd7a592 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:01.984821 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f6545bc4-aa84-47d8-99e5-89c88dd7a592 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:01.985245 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f6545bc4-aa84-47d8-99e5-89c88dd7a592 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:02.264039 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-cc8df377-6030-455e-b7b5-5d03b0bd551d tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:02.282950 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-cc8df377-6030-455e-b7b5-5d03b0bd551d tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:02.284733 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-cc8df377-6030-455e-b7b5-5d03b0bd551d tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:02.286091 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-cc8df377-6030-455e-b7b5-5d03b0bd551d tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] 10.222.0.70 "GET /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a" status: 200 len: 1845 microversion: 2.42 time: 0.707597 Aug 27 02:46:02.288923 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 670/1351] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:46:01 2022] GET /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a => generated 1845 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:46:02.301040 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6396ad3a-4017-4c07-b04a-20c1d3337bc9 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:02.302034 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-6396ad3a-4017-4c07-b04a-20c1d3337bc9 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] [instance: 4eaf21fb-2b59-4e0e-abd4-72c8e422534d] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:02.327786 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6396ad3a-4017-4c07-b04a-20c1d3337bc9 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:02.328560 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6396ad3a-4017-4c07-b04a-20c1d3337bc9 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:02.329159 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6396ad3a-4017-4c07-b04a-20c1d3337bc9 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:02.330061 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6396ad3a-4017-4c07-b04a-20c1d3337bc9 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:02.330659 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6396ad3a-4017-4c07-b04a-20c1d3337bc9 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:02.331232 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6396ad3a-4017-4c07-b04a-20c1d3337bc9 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:02.471252 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-6396ad3a-4017-4c07-b04a-20c1d3337bc9 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20f8524b5e042fa9968287ab9257c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d563fb57d1644ea9f14603151d0d089', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:02.482998 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-6396ad3a-4017-4c07-b04a-20c1d3337bc9 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] 10.222.0.70 "GET /compute/v2.1/servers/4eaf21fb-2b59-4e0e-abd4-72c8e422534d" status: 200 len: 1480 microversion: 2.1 time: 0.192575 Aug 27 02:46:02.500060 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 671/1352] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:02 2022] GET /compute/v2.1/servers/4eaf21fb-2b59-4e0e-abd4-72c8e422534d => generated 1480 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:02.523309 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-1b3dca71-ccf3-4644-bdda-365faf09a873 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:02.524921 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-1b3dca71-ccf3-4644-bdda-365faf09a873 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: f620f083-7230-471a-87d0-f6d85f8ad087] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:02.540566 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1b3dca71-ccf3-4644-bdda-365faf09a873 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:02.541751 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1b3dca71-ccf3-4644-bdda-365faf09a873 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:02.542835 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1b3dca71-ccf3-4644-bdda-365faf09a873 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:02.543912 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1b3dca71-ccf3-4644-bdda-365faf09a873 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:02.545213 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1b3dca71-ccf3-4644-bdda-365faf09a873 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:02.545918 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1b3dca71-ccf3-4644-bdda-365faf09a873 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:02.641966 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-f6545bc4-aa84-47d8-99e5-89c88dd7a592 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:02.659830 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-f6545bc4-aa84-47d8-99e5-89c88dd7a592 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b" status: 200 len: 1197 microversion: 2.1 time: 0.701007 Aug 27 02:46:02.669172 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 682/1353] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:01 2022] GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b => generated 1197 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:02.686803 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b8c71441-0095-406a-ab2c-42cdb06fa716 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:02.688924 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b8c71441-0095-406a-ab2c-42cdb06fa716 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: eb11f5d3-ce63-461d-a83f-04f33ce7c16b] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:02.710849 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b8c71441-0095-406a-ab2c-42cdb06fa716 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:02.711711 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b8c71441-0095-406a-ab2c-42cdb06fa716 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:02.712571 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b8c71441-0095-406a-ab2c-42cdb06fa716 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:02.714127 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b8c71441-0095-406a-ab2c-42cdb06fa716 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:02.715206 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b8c71441-0095-406a-ab2c-42cdb06fa716 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:02.715967 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b8c71441-0095-406a-ab2c-42cdb06fa716 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:03.156490 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-b8c71441-0095-406a-ab2c-42cdb06fa716 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6d1646ec094e3297f6f3c51dd72e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b105816fd4e54b9da4973ff721e1fb92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:03.164204 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b8c71441-0095-406a-ab2c-42cdb06fa716 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "GET /compute/v2.1/servers/eb11f5d3-ce63-461d-a83f-04f33ce7c16b" status: 200 len: 1317 microversion: 2.1 time: 0.493102 Aug 27 02:46:03.174608 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 683/1354] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:02 2022] GET /compute/v2.1/servers/eb11f5d3-ce63-461d-a83f-04f33ce7c16b => generated 1317 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:03.184064 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-1b3dca71-ccf3-4644-bdda-365faf09a873 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:03.192947 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-1b3dca71-ccf3-4644-bdda-365faf09a873 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:03.194753 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-1b3dca71-ccf3-4644-bdda-365faf09a873 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:03.196178 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-1b3dca71-ccf3-4644-bdda-365faf09a873 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/f620f083-7230-471a-87d0-f6d85f8ad087" status: 200 len: 1487 microversion: 2.25 time: 0.694046 Aug 27 02:46:03.200215 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-621625da-8fbf-4802-9bc5-4c913f8a0459 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:03.200890 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-621625da-8fbf-4802-9bc5-4c913f8a0459 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] [instance: 4b798950-60e1-4097-a7e0-365dd0976cb5] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:03.201716 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 672/1355] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:46:02 2022] GET /compute/v2.1/servers/f620f083-7230-471a-87d0-f6d85f8ad087 => generated 1487 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:46:03.209998 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-621625da-8fbf-4802-9bc5-4c913f8a0459 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:03.210540 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-621625da-8fbf-4802-9bc5-4c913f8a0459 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:03.211635 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-621625da-8fbf-4802-9bc5-4c913f8a0459 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:03.212355 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-621625da-8fbf-4802-9bc5-4c913f8a0459 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:03.212957 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-621625da-8fbf-4802-9bc5-4c913f8a0459 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:03.213385 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-621625da-8fbf-4802-9bc5-4c913f8a0459 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:03.322017 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-345f74f3-b4fc-4da6-9f2a-357409f61870 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:03.323814 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-345f74f3-b4fc-4da6-9f2a-357409f61870 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] [instance: 484e03a9-aef3-4179-980c-0e7292a05b5a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:03.332508 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-345f74f3-b4fc-4da6-9f2a-357409f61870 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:03.332976 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-345f74f3-b4fc-4da6-9f2a-357409f61870 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:03.333455 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-345f74f3-b4fc-4da6-9f2a-357409f61870 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:03.334375 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-345f74f3-b4fc-4da6-9f2a-357409f61870 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:03.334860 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-345f74f3-b4fc-4da6-9f2a-357409f61870 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:03.335283 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-345f74f3-b4fc-4da6-9f2a-357409f61870 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:03.588802 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-621625da-8fbf-4802-9bc5-4c913f8a0459 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e86c17fe83848e2bc96b7c83ff1cf14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5668e6d96694c62b83f7e8381fe86e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:03.600911 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-621625da-8fbf-4802-9bc5-4c913f8a0459 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] 10.222.0.70 "GET /compute/v2.1/servers/4b798950-60e1-4097-a7e0-365dd0976cb5" status: 200 len: 1325 microversion: 2.1 time: 0.408538 Aug 27 02:46:03.612405 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 684/1356] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:03 2022] GET /compute/v2.1/servers/4b798950-60e1-4097-a7e0-365dd0976cb5 => generated 1325 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:03.617351 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a6d85b0f-8d87-432d-b012-17cf4d1d05c3 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:03.618058 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-a6d85b0f-8d87-432d-b012-17cf4d1d05c3 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] [instance: 4eaf21fb-2b59-4e0e-abd4-72c8e422534d] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:03.631928 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a6d85b0f-8d87-432d-b012-17cf4d1d05c3 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:03.632459 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a6d85b0f-8d87-432d-b012-17cf4d1d05c3 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:03.636562 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a6d85b0f-8d87-432d-b012-17cf4d1d05c3 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:03.637323 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a6d85b0f-8d87-432d-b012-17cf4d1d05c3 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:03.639515 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a6d85b0f-8d87-432d-b012-17cf4d1d05c3 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:03.640335 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a6d85b0f-8d87-432d-b012-17cf4d1d05c3 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:03.679839 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-345f74f3-b4fc-4da6-9f2a-357409f61870 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:03.699814 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-345f74f3-b4fc-4da6-9f2a-357409f61870 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:03.708789 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-345f74f3-b4fc-4da6-9f2a-357409f61870 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:03.713377 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-345f74f3-b4fc-4da6-9f2a-357409f61870 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] 10.222.0.70 "GET /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a" status: 200 len: 1866 microversion: 2.42 time: 0.399869 Aug 27 02:46:03.728341 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a6d85b0f-8d87-432d-b012-17cf4d1d05c3 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:03.728341 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a6d85b0f-8d87-432d-b012-17cf4d1d05c3 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:03.728341 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a6d85b0f-8d87-432d-b012-17cf4d1d05c3 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:03.728341 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.objects.instance [None req-a6d85b0f-8d87-432d-b012-17cf4d1d05c3 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lazy-loading 'fault' on Instance uuid 4eaf21fb-2b59-4e0e-abd4-72c8e422534d {{(pid=134051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:46:03.729731 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 673/1357] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:46:03 2022] GET /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a => generated 1866 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:46:03.737751 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d06924df-4c00-43ff-b82e-07ae5ad58616 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:03.738702 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d06924df-4c00-43ff-b82e-07ae5ad58616 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 70acfe32-deea-46fc-a214-8fdbb9f6cb7b] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:03.745222 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d06924df-4c00-43ff-b82e-07ae5ad58616 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:03.746100 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d06924df-4c00-43ff-b82e-07ae5ad58616 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:03.746838 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d06924df-4c00-43ff-b82e-07ae5ad58616 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:03.747767 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d06924df-4c00-43ff-b82e-07ae5ad58616 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:03.748456 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d06924df-4c00-43ff-b82e-07ae5ad58616 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:03.749073 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d06924df-4c00-43ff-b82e-07ae5ad58616 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:03.858413 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-a6d85b0f-8d87-432d-b012-17cf4d1d05c3 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20f8524b5e042fa9968287ab9257c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d563fb57d1644ea9f14603151d0d089', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:03.871443 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a6d85b0f-8d87-432d-b012-17cf4d1d05c3 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] 10.222.0.70 "GET /compute/v2.1/servers/4eaf21fb-2b59-4e0e-abd4-72c8e422534d" status: 200 len: 1313 microversion: 2.1 time: 0.266095 Aug 27 02:46:03.873095 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 685/1358] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:03 2022] GET /compute/v2.1/servers/4eaf21fb-2b59-4e0e-abd4-72c8e422534d => generated 1313 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:03.878303 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-81087593-da82-4f29-94e6-28b0a21f4103 req-d1c96588-66e7-4a61-a82f-5e5821fff033 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b798950-60e1-4097-a7e0-365dd0976cb5", "tag": "0f6894dc-0ae0-41d0-a29d-eb2fa732abbd"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:46:03.890164 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-81087593-da82-4f29-94e6-28b0a21f4103 req-d1c96588-66e7-4a61-a82f-5e5821fff033 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:03.891511 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-81087593-da82-4f29-94e6-28b0a21f4103 req-d1c96588-66e7-4a61-a82f-5e5821fff033 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:03.892145 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-81087593-da82-4f29-94e6-28b0a21f4103 req-d1c96588-66e7-4a61-a82f-5e5821fff033 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:03.907418 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-81087593-da82-4f29-94e6-28b0a21f4103 req-d1c96588-66e7-4a61-a82f-5e5821fff033 service nova] Creating event network-changed:0f6894dc-0ae0-41d0-a29d-eb2fa732abbd for instance 4b798950-60e1-4097-a7e0-365dd0976cb5 on n-h1-852278-4 Aug 27 02:46:03.913521 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-81087593-da82-4f29-94e6-28b0a21f4103 req-d1c96588-66e7-4a61-a82f-5e5821fff033 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038240 Aug 27 02:46:03.936060 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 686/1359] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:46:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:46:04.017447 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-a774c9b6-8a76-4829-ba45-40d60be0ac0e req-f7d45840-36fb-40eb-bb71-d21336d3faca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4eaf21fb-2b59-4e0e-abd4-72c8e422534d", "name": "network-vif-deleted", "tag": "4197b222-b5b8-42bf-b892-f890792d4ddf"}, {"name": "network-changed", "server_uuid": "484e03a9-aef3-4179-980c-0e7292a05b5a", "tag": "31906b49-e77a-4b8f-98ad-bdd9406fe852"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:46:04.031334 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-a774c9b6-8a76-4829-ba45-40d60be0ac0e req-f7d45840-36fb-40eb-bb71-d21336d3faca service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:04.032036 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-a774c9b6-8a76-4829-ba45-40d60be0ac0e req-f7d45840-36fb-40eb-bb71-d21336d3faca service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:04.033524 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-a774c9b6-8a76-4829-ba45-40d60be0ac0e req-f7d45840-36fb-40eb-bb71-d21336d3faca service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:04.046944 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-d06924df-4c00-43ff-b82e-07ae5ad58616 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:04.050642 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-a774c9b6-8a76-4829-ba45-40d60be0ac0e req-f7d45840-36fb-40eb-bb71-d21336d3faca service nova] Creating event network-vif-deleted:4197b222-b5b8-42bf-b892-f890792d4ddf for instance 4eaf21fb-2b59-4e0e-abd4-72c8e422534d on n-h2-852278-4 Aug 27 02:46:04.050966 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-a774c9b6-8a76-4829-ba45-40d60be0ac0e req-f7d45840-36fb-40eb-bb71-d21336d3faca service nova] Creating event network-changed:31906b49-e77a-4b8f-98ad-bdd9406fe852 for instance 484e03a9-aef3-4179-980c-0e7292a05b5a on n-h1-852278-4 Aug 27 02:46:04.061355 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d06924df-4c00-43ff-b82e-07ae5ad58616 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b" status: 200 len: 1380 microversion: 2.1 time: 0.329807 Aug 27 02:46:04.062258 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 674/1360] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:03 2022] GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b => generated 1380 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:04.067090 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-a774c9b6-8a76-4829-ba45-40d60be0ac0e req-f7d45840-36fb-40eb-bb71-d21336d3faca service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.057989 Aug 27 02:46:04.067706 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 687/1361] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:46:04 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:46:04.083904 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-bb3eaca7-e11f-44a7-b38e-4280719fd22c tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:04.084571 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-bb3eaca7-e11f-44a7-b38e-4280719fd22c tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] [instance: 70acfe32-deea-46fc-a214-8fdbb9f6cb7b] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:04.092833 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bb3eaca7-e11f-44a7-b38e-4280719fd22c tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:04.093332 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bb3eaca7-e11f-44a7-b38e-4280719fd22c tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:04.093769 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bb3eaca7-e11f-44a7-b38e-4280719fd22c tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:04.094787 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bb3eaca7-e11f-44a7-b38e-4280719fd22c tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:04.095409 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bb3eaca7-e11f-44a7-b38e-4280719fd22c tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:04.095995 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bb3eaca7-e11f-44a7-b38e-4280719fd22c tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:04.201697 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4af04ffd-4130-4e2d-862e-3045a6b75c47 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:04.202743 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-4af04ffd-4130-4e2d-862e-3045a6b75c47 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: eb11f5d3-ce63-461d-a83f-04f33ce7c16b] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:04.215949 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4af04ffd-4130-4e2d-862e-3045a6b75c47 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:04.216759 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4af04ffd-4130-4e2d-862e-3045a6b75c47 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:04.217189 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4af04ffd-4130-4e2d-862e-3045a6b75c47 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:04.217890 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4af04ffd-4130-4e2d-862e-3045a6b75c47 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:04.218331 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4af04ffd-4130-4e2d-862e-3045a6b75c47 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:04.218738 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4af04ffd-4130-4e2d-862e-3045a6b75c47 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:04.426294 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-bb3eaca7-e11f-44a7-b38e-4280719fd22c tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b" status: 200 len: 1531 microversion: 2.1 time: 0.346083 Aug 27 02:46:04.426882 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 675/1362] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:04 2022] GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b => generated 1531 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:04.459543 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a582e52c-f90d-434c-85f4-bb77f8a82a2e tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:04.461175 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a582e52c-f90d-434c-85f4-bb77f8a82a2e tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: f620f083-7230-471a-87d0-f6d85f8ad087] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:04.483158 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a582e52c-f90d-434c-85f4-bb77f8a82a2e tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:04.485965 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a582e52c-f90d-434c-85f4-bb77f8a82a2e tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:04.486747 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a582e52c-f90d-434c-85f4-bb77f8a82a2e tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:04.488760 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a582e52c-f90d-434c-85f4-bb77f8a82a2e tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:04.490843 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a582e52c-f90d-434c-85f4-bb77f8a82a2e tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:04.492787 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a582e52c-f90d-434c-85f4-bb77f8a82a2e tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:04.560263 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-4af04ffd-4130-4e2d-862e-3045a6b75c47 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6d1646ec094e3297f6f3c51dd72e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b105816fd4e54b9da4973ff721e1fb92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:04.565009 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:46:04.570298 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-4af04ffd-4130-4e2d-862e-3045a6b75c47 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "GET /compute/v2.1/servers/eb11f5d3-ce63-461d-a83f-04f33ce7c16b" status: 200 len: 1317 microversion: 2.1 time: 0.377108 Aug 27 02:46:04.570882 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 688/1363] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:04 2022] GET /compute/v2.1/servers/eb11f5d3-ce63-461d-a83f-04f33ce7c16b => generated 1317 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:04.587667 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-724e7148-857a-4003-860c-210f09cdd4a3 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:04.588259 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-724e7148-857a-4003-860c-210f09cdd4a3 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] [instance: 70acfe32-deea-46fc-a214-8fdbb9f6cb7b] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:04.607238 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-724e7148-857a-4003-860c-210f09cdd4a3 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:04.607791 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-724e7148-857a-4003-860c-210f09cdd4a3 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:04.608473 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-724e7148-857a-4003-860c-210f09cdd4a3 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:04.609195 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-724e7148-857a-4003-860c-210f09cdd4a3 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:04.609826 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-724e7148-857a-4003-860c-210f09cdd4a3 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:04.610248 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-724e7148-857a-4003-860c-210f09cdd4a3 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:04.866985 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-a582e52c-f90d-434c-85f4-bb77f8a82a2e tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:04.876368 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-a582e52c-f90d-434c-85f4-bb77f8a82a2e tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:04.877802 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-a582e52c-f90d-434c-85f4-bb77f8a82a2e tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:04.878979 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a582e52c-f90d-434c-85f4-bb77f8a82a2e tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/f620f083-7230-471a-87d0-f6d85f8ad087" status: 200 len: 1487 microversion: 2.25 time: 0.431398 Aug 27 02:46:04.879543 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 676/1364] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:46:04 2022] GET /compute/v2.1/servers/f620f083-7230-471a-87d0-f6d85f8ad087 => generated 1487 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:46:04.884719 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-7f25859a-c1fb-4987-96da-3bb3decff015 req-872accb2-40a5-4380-b61f-0f4a42b8cabf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb11f5d3-ce63-461d-a83f-04f33ce7c16b", "name": "network-vif-plugged", "status": "completed", "tag": "2bb69a1e-db5b-4c04-9ed8-8205dd668b84"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:46:04.898795 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-7f25859a-c1fb-4987-96da-3bb3decff015 req-872accb2-40a5-4380-b61f-0f4a42b8cabf service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:04.899627 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-7f25859a-c1fb-4987-96da-3bb3decff015 req-872accb2-40a5-4380-b61f-0f4a42b8cabf service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:04.900581 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-7f25859a-c1fb-4987-96da-3bb3decff015 req-872accb2-40a5-4380-b61f-0f4a42b8cabf service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:04.916415 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-7f25859a-c1fb-4987-96da-3bb3decff015 req-872accb2-40a5-4380-b61f-0f4a42b8cabf service nova] Creating event network-vif-plugged:2bb69a1e-db5b-4c04-9ed8-8205dd668b84 for instance eb11f5d3-ce63-461d-a83f-04f33ce7c16b on n-h2-852278-4 Aug 27 02:46:04.922555 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-7f25859a-c1fb-4987-96da-3bb3decff015 req-872accb2-40a5-4380-b61f-0f4a42b8cabf service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041327 Aug 27 02:46:04.926925 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 677/1365] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:46:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:46:04.937394 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d60e55b2-6815-47c3-9199-a80615e712ba tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:04.938330 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d60e55b2-6815-47c3-9199-a80615e712ba tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] [instance: 4b798950-60e1-4097-a7e0-365dd0976cb5] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:04.946678 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d60e55b2-6815-47c3-9199-a80615e712ba tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:04.947633 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d60e55b2-6815-47c3-9199-a80615e712ba tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:04.949016 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d60e55b2-6815-47c3-9199-a80615e712ba tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:04.950092 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d60e55b2-6815-47c3-9199-a80615e712ba tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:04.950556 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d60e55b2-6815-47c3-9199-a80615e712ba tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:04.951022 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d60e55b2-6815-47c3-9199-a80615e712ba tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:04.996443 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-724e7148-857a-4003-860c-210f09cdd4a3 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b" status: 200 len: 1531 microversion: 2.1 time: 0.417363 Aug 27 02:46:04.998143 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 689/1366] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:04 2022] GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b => generated 1531 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:05.004792 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-6077862d-8031-45ac-9bf2-b030f4f8c1c1 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:05.009293 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-6077862d-8031-45ac-9bf2-b030f4f8c1c1 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] [instance: 484e03a9-aef3-4179-980c-0e7292a05b5a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:05.019396 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6077862d-8031-45ac-9bf2-b030f4f8c1c1 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:05.019886 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6077862d-8031-45ac-9bf2-b030f4f8c1c1 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:05.020366 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6077862d-8031-45ac-9bf2-b030f4f8c1c1 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:05.021497 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6077862d-8031-45ac-9bf2-b030f4f8c1c1 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:05.022212 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6077862d-8031-45ac-9bf2-b030f4f8c1c1 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:05.022977 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6077862d-8031-45ac-9bf2-b030f4f8c1c1 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:05.356853 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-d60e55b2-6815-47c3-9199-a80615e712ba tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e86c17fe83848e2bc96b7c83ff1cf14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5668e6d96694c62b83f7e8381fe86e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:05.365282 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d60e55b2-6815-47c3-9199-a80615e712ba tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] 10.222.0.70 "GET /compute/v2.1/servers/4b798950-60e1-4097-a7e0-365dd0976cb5" status: 200 len: 1325 microversion: 2.1 time: 0.436871 Aug 27 02:46:05.366215 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 678/1367] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:04 2022] GET /compute/v2.1/servers/4b798950-60e1-4097-a7e0-365dd0976cb5 => generated 1325 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:05.371235 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-642a4000-a0be-43d0-983b-aa1196157c1e tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:05.372127 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-642a4000-a0be-43d0-983b-aa1196157c1e tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] [instance: 4eaf21fb-2b59-4e0e-abd4-72c8e422534d] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:05.379085 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-642a4000-a0be-43d0-983b-aa1196157c1e tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:05.379902 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-642a4000-a0be-43d0-983b-aa1196157c1e tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:05.380868 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-642a4000-a0be-43d0-983b-aa1196157c1e tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:05.381646 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-642a4000-a0be-43d0-983b-aa1196157c1e tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:05.382753 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-642a4000-a0be-43d0-983b-aa1196157c1e tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:05.382753 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-642a4000-a0be-43d0-983b-aa1196157c1e tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:05.383709 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-6077862d-8031-45ac-9bf2-b030f4f8c1c1 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:05.394099 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-6077862d-8031-45ac-9bf2-b030f4f8c1c1 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:05.395516 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-6077862d-8031-45ac-9bf2-b030f4f8c1c1 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:05.397099 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-6077862d-8031-45ac-9bf2-b030f4f8c1c1 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] 10.222.0.70 "GET /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a" status: 200 len: 1887 microversion: 2.42 time: 0.397563 Aug 27 02:46:05.397993 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 690/1368] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:46:04 2022] GET /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a => generated 1887 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:46:05.398609 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-642a4000-a0be-43d0-983b-aa1196157c1e tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] HTTP exception thrown: Instance 4eaf21fb-2b59-4e0e-abd4-72c8e422534d could not be found. Aug 27 02:46:05.400687 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-642a4000-a0be-43d0-983b-aa1196157c1e tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Request method failure captured: Aug 27 02:46:05.400687 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/servers/4eaf21fb-2b59-4e0e-abd4-72c8e422534d HTTP/1.1 Aug 27 02:46:05.400687 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:46:05.400687 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:46:05.400687 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:46:05.400687 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:46:05.400687 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:46:05.400687 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:46:05.400687 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:46:05.400687 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:46:05.400687 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYU1uWDgJ2S3i8wnm38tKLwEsEd6GPcBWEaaoD2Xah7z574RssgOAwJiB8CshvFHNvcIICfPORJAASNhmpvWgqIN53Vezocd1McLDL_uz2RfIqgooaaRqJRt5-jwaNEga7kMv1yBvyL_j7aHlJRlOwXXEJQhohRHKjELpSYbPD8PLJc Aug 27 02:46:05.400687 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:46:05.400687 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:46:05.400687 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:46:05.400687 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:46:05.400687 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:46:05.400687 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:46:05.400687 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 5d563fb57d1644ea9f14603151d0d089 Aug 27 02:46:05.400687 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ListServersNegativeTestJSON-1549884191 Aug 27 02:46:05.400687 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:46:05.400687 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:46:05.403144 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5d563fb57d1644ea9f14603151d0d089"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_5d563fb57d1644ea9f14603151d0d089", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5d563fb57d1644ea9f14603151d0d089"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/5d563fb57d1644ea9f14603151d0d089"}]}] Aug 27 02:46:05.403144 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ListServersNegativeTestJSON-1549884191 Aug 27 02:46:05.403144 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 5d563fb57d1644ea9f14603151d0d089 Aug 27 02:46:05.403144 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1549884191 Aug 27 02:46:05.403144 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ListServersNegativeTestJSON-1549884191-project Aug 27 02:46:05.403144 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:46:05.403144 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:46:05.403144 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: a20f8524b5e042fa9968287ab9257c84 Aug 27 02:46:05.403144 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ListServersNegativeTestJSON-1549884191-project Aug 27 02:46:05.403144 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 02:46:05.403144 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance 4eaf21fb-2b59-4e0e-abd4-72c8e422534d could not be found. Aug 27 02:46:05.403144 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '4eaf21fb-2b59-4e0e-abd4-72c8e422534d'} Aug 27 02:46:05.404585 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:46:05.404585 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:46:05.404585 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:46:05.404585 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:46:05.404585 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:46:05.404585 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:46:05.404585 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:46:05.404585 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:46:05.404585 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:46:05.404585 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:46:05.404585 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4eaf21fb-2b59-4e0e-abd4-72c8e422534d could not be found. Aug 27 02:46:05.404585 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:46:05.404585 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:46:05.404585 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:46:05.404585 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:46:05.404585 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:46:05.404585 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:46:05.404585 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:46:05.404585 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:46:05.404585 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:46:05.406051 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:46:05.406051 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:46:05.406051 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:46:05.406051 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:46:05.406051 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:46:05.406051 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:46:05.406051 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:46:05.406051 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4eaf21fb-2b59-4e0e-abd4-72c8e422534d could not be found. Aug 27 02:46:05.406051 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:46:05.406051 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:46:05.406051 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:46:05.406051 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:46:05.406051 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:46:05.406051 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:46:05.406051 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:46:05.406051 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:46:05.406051 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4eaf21fb-2b59-4e0e-abd4-72c8e422534d could not be found. Aug 27 02:46:05.406051 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:46:05.408731 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-642a4000-a0be-43d0-983b-aa1196157c1e tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Returning 404 to user: Instance 4eaf21fb-2b59-4e0e-abd4-72c8e422534d could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:46:05.408731 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-642a4000-a0be-43d0-983b-aa1196157c1e tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] 10.222.0.70 "GET /compute/v2.1/servers/4eaf21fb-2b59-4e0e-abd4-72c8e422534d" status: 404 len: 111 microversion: 2.1 time: 0.034470 Aug 27 02:46:05.408731 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 679/1369] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:05 2022] GET /compute/v2.1/servers/4eaf21fb-2b59-4e0e-abd4-72c8e422534d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:46:05.409146 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-db85c201-bf25-41c9-9df2-279d160f6501 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:05.410464 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-db85c201-bf25-41c9-9df2-279d160f6501 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:05.410681 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-db85c201-bf25-41c9-9df2-279d160f6501 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:05.411025 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-db85c201-bf25-41c9-9df2-279d160f6501 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:05.411634 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-df56ab5d-813b-4e08-8ca9-210b50ede422 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:05.411807 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-db85c201-bf25-41c9-9df2-279d160f6501 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:05.412221 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-db85c201-bf25-41c9-9df2-279d160f6501 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:05.412578 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-df56ab5d-813b-4e08-8ca9-210b50ede422 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] [instance: ad971605-1da6-4df8-ae39-be0b82b9dad7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:05.412771 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-db85c201-bf25-41c9-9df2-279d160f6501 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:05.417346 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=17 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:46:05.419275 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-df56ab5d-813b-4e08-8ca9-210b50ede422 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:05.419745 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-df56ab5d-813b-4e08-8ca9-210b50ede422 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:05.420494 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-df56ab5d-813b-4e08-8ca9-210b50ede422 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:05.421499 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-df56ab5d-813b-4e08-8ca9-210b50ede422 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:05.422325 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-df56ab5d-813b-4e08-8ca9-210b50ede422 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:05.423005 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-df56ab5d-813b-4e08-8ca9-210b50ede422 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:05.449985 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-df56ab5d-813b-4e08-8ca9-210b50ede422 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] HTTP exception thrown: Instance ad971605-1da6-4df8-ae39-be0b82b9dad7 could not be found. Aug 27 02:46:05.452274 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-df56ab5d-813b-4e08-8ca9-210b50ede422 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Request method failure captured: Aug 27 02:46:05.452274 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/servers/ad971605-1da6-4df8-ae39-be0b82b9dad7 HTTP/1.1 Aug 27 02:46:05.452274 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:46:05.452274 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:46:05.452274 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:46:05.452274 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:46:05.452274 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:46:05.452274 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:46:05.452274 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:46:05.452274 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:46:05.452274 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYU1uWDgJ2S3i8wnm38tKLwEsEd6GPcBWEaaoD2Xah7z574RssgOAwJiB8CshvFHNvcIICfPORJAASNhmpvWgqIN53Vezocd1McLDL_uz2RfIqgooaaRqJRt5-jwaNEga7kMv1yBvyL_j7aHlJRlOwXXEJQhohRHKjELpSYbPD8PLJc Aug 27 02:46:05.452274 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:46:05.452274 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:46:05.452274 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:46:05.452274 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:46:05.452274 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:46:05.452274 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:46:05.452274 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 5d563fb57d1644ea9f14603151d0d089 Aug 27 02:46:05.452274 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ListServersNegativeTestJSON-1549884191 Aug 27 02:46:05.452274 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:46:05.452274 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:46:05.453770 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5d563fb57d1644ea9f14603151d0d089"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_5d563fb57d1644ea9f14603151d0d089", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5d563fb57d1644ea9f14603151d0d089"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/5d563fb57d1644ea9f14603151d0d089"}]}] Aug 27 02:46:05.453770 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ListServersNegativeTestJSON-1549884191 Aug 27 02:46:05.453770 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 5d563fb57d1644ea9f14603151d0d089 Aug 27 02:46:05.453770 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1549884191 Aug 27 02:46:05.453770 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ListServersNegativeTestJSON-1549884191-project Aug 27 02:46:05.453770 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:46:05.453770 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:46:05.453770 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: a20f8524b5e042fa9968287ab9257c84 Aug 27 02:46:05.453770 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ListServersNegativeTestJSON-1549884191-project Aug 27 02:46:05.453770 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 02:46:05.453770 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance ad971605-1da6-4df8-ae39-be0b82b9dad7 could not be found. Aug 27 02:46:05.453770 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': 'ad971605-1da6-4df8-ae39-be0b82b9dad7'} Aug 27 02:46:05.454583 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:46:05.454583 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:46:05.454583 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:46:05.454583 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:46:05.454583 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:46:05.454583 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:46:05.454583 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:46:05.454583 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:46:05.454583 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:46:05.454583 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:46:05.454583 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad971605-1da6-4df8-ae39-be0b82b9dad7 could not be found. Aug 27 02:46:05.454583 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:46:05.454583 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:46:05.454583 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:46:05.454583 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:46:05.454583 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:46:05.454583 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:46:05.454583 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:46:05.454583 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:46:05.454583 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:46:05.455909 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:46:05.455909 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:46:05.455909 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:46:05.455909 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:46:05.455909 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:46:05.455909 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:46:05.455909 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:46:05.455909 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad971605-1da6-4df8-ae39-be0b82b9dad7 could not be found. Aug 27 02:46:05.455909 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:46:05.455909 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:46:05.455909 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:46:05.455909 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:46:05.455909 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:46:05.455909 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:46:05.455909 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:46:05.455909 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:46:05.455909 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad971605-1da6-4df8-ae39-be0b82b9dad7 could not be found. Aug 27 02:46:05.455909 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:46:05.457271 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-df56ab5d-813b-4e08-8ca9-210b50ede422 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] Returning 404 to user: Instance ad971605-1da6-4df8-ae39-be0b82b9dad7 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:46:05.457271 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-df56ab5d-813b-4e08-8ca9-210b50ede422 tempest-ListServersNegativeTestJSON-1549884191 tempest-ListServersNegativeTestJSON-1549884191-project] 10.222.0.70 "GET /compute/v2.1/servers/ad971605-1da6-4df8-ae39-be0b82b9dad7" status: 404 len: 111 microversion: 2.1 time: 0.047183 Aug 27 02:46:05.457271 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 680/1370] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:05 2022] GET /compute/v2.1/servers/ad971605-1da6-4df8-ae39-be0b82b9dad7 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:46:05.477702 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-db85c201-bf25-41c9-9df2-279d160f6501 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] 10.222.0.70 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.078260 Aug 27 02:46:05.479134 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 691/1371] 10.222.0.70 () {58 vars in 1176 bytes} [Sat Aug 27 02:46:05 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:46:05.491396 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-92a2d38b-97ff-479f-b7fc-5f78e2341495 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-852278-4", "block_migration": false, "disk_over_commit": false}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:46:05.494510 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-92a2d38b-97ff-479f-b7fc-5f78e2341495 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] [instance: 70acfe32-deea-46fc-a214-8fdbb9f6cb7b] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:05.501678 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-92a2d38b-97ff-479f-b7fc-5f78e2341495 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:05.502299 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-92a2d38b-97ff-479f-b7fc-5f78e2341495 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:05.502806 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-92a2d38b-97ff-479f-b7fc-5f78e2341495 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:05.503870 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-92a2d38b-97ff-479f-b7fc-5f78e2341495 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:05.504443 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-92a2d38b-97ff-479f-b7fc-5f78e2341495 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:05.505110 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-92a2d38b-97ff-479f-b7fc-5f78e2341495 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:05.532834 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.instance [None req-92a2d38b-97ff-479f-b7fc-5f78e2341495 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Lazy-loading 'flavor' on Instance uuid 70acfe32-deea-46fc-a214-8fdbb9f6cb7b {{(pid=134052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:46:05.548071 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-92a2d38b-97ff-479f-b7fc-5f78e2341495 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] [instance: 70acfe32-deea-46fc-a214-8fdbb9f6cb7b] Going to try to live migrate instance to n-h1-852278-4 {{(pid=134052) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 27 02:46:05.595486 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-aee9dcf7-804d-42a9-909a-1ee1500f77cf tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:05.596418 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-aee9dcf7-804d-42a9-909a-1ee1500f77cf tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: eb11f5d3-ce63-461d-a83f-04f33ce7c16b] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:05.603661 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-aee9dcf7-804d-42a9-909a-1ee1500f77cf tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:05.604422 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-aee9dcf7-804d-42a9-909a-1ee1500f77cf tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:05.605271 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-aee9dcf7-804d-42a9-909a-1ee1500f77cf tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:05.606417 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-aee9dcf7-804d-42a9-909a-1ee1500f77cf tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:05.606623 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:46:05.607677 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-aee9dcf7-804d-42a9-909a-1ee1500f77cf tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:05.608543 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-aee9dcf7-804d-42a9-909a-1ee1500f77cf tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:05.796970 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-aee9dcf7-804d-42a9-909a-1ee1500f77cf tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6d1646ec094e3297f6f3c51dd72e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b105816fd4e54b9da4973ff721e1fb92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:05.807127 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-aee9dcf7-804d-42a9-909a-1ee1500f77cf tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "GET /compute/v2.1/servers/eb11f5d3-ce63-461d-a83f-04f33ce7c16b" status: 200 len: 1317 microversion: 2.1 time: 0.215815 Aug 27 02:46:05.822599 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 692/1372] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:05 2022] GET /compute/v2.1/servers/eb11f5d3-ce63-461d-a83f-04f33ce7c16b => generated 1317 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:05.904516 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-edb4e98a-b6c2-40c4-8a80-2212cbe396fb tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:05.905412 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-edb4e98a-b6c2-40c4-8a80-2212cbe396fb tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: f620f083-7230-471a-87d0-f6d85f8ad087] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:05.915414 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-edb4e98a-b6c2-40c4-8a80-2212cbe396fb tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:05.917106 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-edb4e98a-b6c2-40c4-8a80-2212cbe396fb tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:05.918064 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-edb4e98a-b6c2-40c4-8a80-2212cbe396fb tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:05.919155 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-edb4e98a-b6c2-40c4-8a80-2212cbe396fb tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:05.921380 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-edb4e98a-b6c2-40c4-8a80-2212cbe396fb tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:05.922046 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-edb4e98a-b6c2-40c4-8a80-2212cbe396fb tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:06.237758 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-edb4e98a-b6c2-40c4-8a80-2212cbe396fb tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:06.250883 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-edb4e98a-b6c2-40c4-8a80-2212cbe396fb tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:06.253323 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-edb4e98a-b6c2-40c4-8a80-2212cbe396fb tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:06.255029 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-edb4e98a-b6c2-40c4-8a80-2212cbe396fb tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/f620f083-7230-471a-87d0-f6d85f8ad087" status: 200 len: 1487 microversion: 2.25 time: 0.357003 Aug 27 02:46:06.255949 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 693/1373] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:46:05 2022] GET /compute/v2.1/servers/f620f083-7230-471a-87d0-f6d85f8ad087 => generated 1487 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:46:06.261672 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-44e86008-0fe4-455e-b535-3fb4e33e64b5 req-0f16555f-6718-481f-a3c1-76ea0973984d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "484e03a9-aef3-4179-980c-0e7292a05b5a", "tag": "6958a0bc-b02e-4619-a95c-6bd7e0759d6c"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:46:06.275873 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-44e86008-0fe4-455e-b535-3fb4e33e64b5 req-0f16555f-6718-481f-a3c1-76ea0973984d service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:06.277268 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-44e86008-0fe4-455e-b535-3fb4e33e64b5 req-0f16555f-6718-481f-a3c1-76ea0973984d service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:06.277940 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-44e86008-0fe4-455e-b535-3fb4e33e64b5 req-0f16555f-6718-481f-a3c1-76ea0973984d service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:06.294568 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-44e86008-0fe4-455e-b535-3fb4e33e64b5 req-0f16555f-6718-481f-a3c1-76ea0973984d service nova] Creating event network-changed:6958a0bc-b02e-4619-a95c-6bd7e0759d6c for instance 484e03a9-aef3-4179-980c-0e7292a05b5a on n-h1-852278-4 Aug 27 02:46:06.302628 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-44e86008-0fe4-455e-b535-3fb4e33e64b5 req-0f16555f-6718-481f-a3c1-76ea0973984d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043509 Aug 27 02:46:06.303912 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 694/1374] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:46:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:46:06.390382 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0fd4937b-49aa-4c3d-b175-f97a630a5ec7 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:06.392016 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-0fd4937b-49aa-4c3d-b175-f97a630a5ec7 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] [instance: 4b798950-60e1-4097-a7e0-365dd0976cb5] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:06.409071 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0fd4937b-49aa-4c3d-b175-f97a630a5ec7 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:06.410172 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0fd4937b-49aa-4c3d-b175-f97a630a5ec7 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:06.410894 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0fd4937b-49aa-4c3d-b175-f97a630a5ec7 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:06.412302 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0fd4937b-49aa-4c3d-b175-f97a630a5ec7 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:06.415259 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0fd4937b-49aa-4c3d-b175-f97a630a5ec7 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:06.418309 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0fd4937b-49aa-4c3d-b175-f97a630a5ec7 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:06.814715 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-0fd4937b-49aa-4c3d-b175-f97a630a5ec7 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e86c17fe83848e2bc96b7c83ff1cf14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5668e6d96694c62b83f7e8381fe86e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:06.829776 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-0fd4937b-49aa-4c3d-b175-f97a630a5ec7 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] 10.222.0.70 "GET /compute/v2.1/servers/4b798950-60e1-4097-a7e0-365dd0976cb5" status: 200 len: 1325 microversion: 2.1 time: 0.444913 Aug 27 02:46:06.831343 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 695/1375] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:06 2022] GET /compute/v2.1/servers/4b798950-60e1-4097-a7e0-365dd0976cb5 => generated 1325 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:46:06.836859 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-05cbdfb6-7c92-4686-a0a1-48a0e405ba04 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:06.837732 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-05cbdfb6-7c92-4686-a0a1-48a0e405ba04 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] [instance: 484e03a9-aef3-4179-980c-0e7292a05b5a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:06.846413 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-05cbdfb6-7c92-4686-a0a1-48a0e405ba04 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:06.847549 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-05cbdfb6-7c92-4686-a0a1-48a0e405ba04 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:06.848552 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-05cbdfb6-7c92-4686-a0a1-48a0e405ba04 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:06.850616 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-05cbdfb6-7c92-4686-a0a1-48a0e405ba04 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:06.851332 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-05cbdfb6-7c92-4686-a0a1-48a0e405ba04 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:06.852924 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-05cbdfb6-7c92-4686-a0a1-48a0e405ba04 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:07.734485 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-05cbdfb6-7c92-4686-a0a1-48a0e405ba04 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:07.744753 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-05cbdfb6-7c92-4686-a0a1-48a0e405ba04 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:07.746613 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-05cbdfb6-7c92-4686-a0a1-48a0e405ba04 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:07.748042 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-05cbdfb6-7c92-4686-a0a1-48a0e405ba04 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] 10.222.0.70 "GET /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a" status: 200 len: 1887 microversion: 2.42 time: 0.915355 Aug 27 02:46:07.764769 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 696/1376] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:46:06 2022] GET /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a => generated 1887 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:46:07.771240 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-38a0376f-2eee-4289-a69f-4c77850a1a1a tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:07.772136 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-38a0376f-2eee-4289-a69f-4c77850a1a1a tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: eb11f5d3-ce63-461d-a83f-04f33ce7c16b] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:07.780581 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-38a0376f-2eee-4289-a69f-4c77850a1a1a tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:07.781237 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-38a0376f-2eee-4289-a69f-4c77850a1a1a tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:07.781773 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-38a0376f-2eee-4289-a69f-4c77850a1a1a tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:07.782594 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-38a0376f-2eee-4289-a69f-4c77850a1a1a tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:07.783147 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-38a0376f-2eee-4289-a69f-4c77850a1a1a tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:07.783667 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-38a0376f-2eee-4289-a69f-4c77850a1a1a tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:07.858567 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-92a2d38b-97ff-479f-b7fc-5f78e2341495 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b/action" status: 202 len: 0 microversion: 2.1 time: 2.371232 Aug 27 02:46:07.862608 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 681/1377] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 02:46:05 2022] POST /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b/action => generated 0 bytes in 2376 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:46:07.867880 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-7bcd3986-802a-449a-a91b-07c6a19738fa tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:07.868618 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-7bcd3986-802a-449a-a91b-07c6a19738fa tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: f620f083-7230-471a-87d0-f6d85f8ad087] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:07.881350 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7bcd3986-802a-449a-a91b-07c6a19738fa tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:07.882227 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7bcd3986-802a-449a-a91b-07c6a19738fa tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:07.883067 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7bcd3986-802a-449a-a91b-07c6a19738fa tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:07.884523 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7bcd3986-802a-449a-a91b-07c6a19738fa tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:07.885752 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7bcd3986-802a-449a-a91b-07c6a19738fa tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:07.886466 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7bcd3986-802a-449a-a91b-07c6a19738fa tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:08.038887 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-38a0376f-2eee-4289-a69f-4c77850a1a1a tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6d1646ec094e3297f6f3c51dd72e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b105816fd4e54b9da4973ff721e1fb92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:08.047305 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-38a0376f-2eee-4289-a69f-4c77850a1a1a tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "GET /compute/v2.1/servers/eb11f5d3-ce63-461d-a83f-04f33ce7c16b" status: 200 len: 1317 microversion: 2.1 time: 0.281152 Aug 27 02:46:08.053047 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 697/1378] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:07 2022] GET /compute/v2.1/servers/eb11f5d3-ce63-461d-a83f-04f33ce7c16b => generated 1317 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:08.063466 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-da221526-b256-48e2-95fe-949c1c9a82d6 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:08.063466 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-da221526-b256-48e2-95fe-949c1c9a82d6 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] [instance: 4b798950-60e1-4097-a7e0-365dd0976cb5] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:08.090346 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-da221526-b256-48e2-95fe-949c1c9a82d6 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:08.090771 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-da221526-b256-48e2-95fe-949c1c9a82d6 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:08.091278 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-da221526-b256-48e2-95fe-949c1c9a82d6 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:08.092293 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-da221526-b256-48e2-95fe-949c1c9a82d6 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:08.093032 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-da221526-b256-48e2-95fe-949c1c9a82d6 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:08.099246 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-da221526-b256-48e2-95fe-949c1c9a82d6 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:08.249882 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-7bcd3986-802a-449a-a91b-07c6a19738fa tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:08.263672 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-7bcd3986-802a-449a-a91b-07c6a19738fa tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:08.265182 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-7bcd3986-802a-449a-a91b-07c6a19738fa tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:08.266377 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-7bcd3986-802a-449a-a91b-07c6a19738fa tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/f620f083-7230-471a-87d0-f6d85f8ad087" status: 200 len: 1487 microversion: 2.25 time: 0.402770 Aug 27 02:46:08.266940 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 682/1379] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:46:07 2022] GET /compute/v2.1/servers/f620f083-7230-471a-87d0-f6d85f8ad087 => generated 1487 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:46:08.311334 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=6 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:46:08.365010 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=10 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:46:08.380337 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6fa4e1d7-8140-4ff7-bf79-07fb3746f0aa tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:08.381487 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-6fa4e1d7-8140-4ff7-bf79-07fb3746f0aa tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 70acfe32-deea-46fc-a214-8fdbb9f6cb7b] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:08.390042 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6fa4e1d7-8140-4ff7-bf79-07fb3746f0aa tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:08.390837 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6fa4e1d7-8140-4ff7-bf79-07fb3746f0aa tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:08.391584 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6fa4e1d7-8140-4ff7-bf79-07fb3746f0aa tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:08.392642 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6fa4e1d7-8140-4ff7-bf79-07fb3746f0aa tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:08.393394 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6fa4e1d7-8140-4ff7-bf79-07fb3746f0aa tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:08.394053 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6fa4e1d7-8140-4ff7-bf79-07fb3746f0aa tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:08.437017 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-da221526-b256-48e2-95fe-949c1c9a82d6 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e86c17fe83848e2bc96b7c83ff1cf14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5668e6d96694c62b83f7e8381fe86e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:08.446372 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-da221526-b256-48e2-95fe-949c1c9a82d6 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] 10.222.0.70 "GET /compute/v2.1/servers/4b798950-60e1-4097-a7e0-365dd0976cb5" status: 200 len: 1325 microversion: 2.1 time: 0.392170 Aug 27 02:46:08.451411 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 698/1380] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:08 2022] GET /compute/v2.1/servers/4b798950-60e1-4097-a7e0-365dd0976cb5 => generated 1325 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:08.461201 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-62f9212e-4944-45a4-9961-1f5f5e54345c req-b6e77297-c901-4b43-90d5-d4b394e00b21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "484e03a9-aef3-4179-980c-0e7292a05b5a", "tag": "1689be35-623f-4a81-9df4-0846ddac5f37"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:46:08.474551 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:46:08.477591 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-62f9212e-4944-45a4-9961-1f5f5e54345c req-b6e77297-c901-4b43-90d5-d4b394e00b21 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:08.478759 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-62f9212e-4944-45a4-9961-1f5f5e54345c req-b6e77297-c901-4b43-90d5-d4b394e00b21 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:08.479480 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-62f9212e-4944-45a4-9961-1f5f5e54345c req-b6e77297-c901-4b43-90d5-d4b394e00b21 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:08.495835 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-62f9212e-4944-45a4-9961-1f5f5e54345c req-b6e77297-c901-4b43-90d5-d4b394e00b21 service nova] Creating event network-changed:1689be35-623f-4a81-9df4-0846ddac5f37 for instance 484e03a9-aef3-4179-980c-0e7292a05b5a on n-h1-852278-4 Aug 27 02:46:08.508089 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-62f9212e-4944-45a4-9961-1f5f5e54345c req-b6e77297-c901-4b43-90d5-d4b394e00b21 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055141 Aug 27 02:46:08.509546 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 699/1381] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:46:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:46:08.712112 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-6fa4e1d7-8140-4ff7-bf79-07fb3746f0aa tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:08.726666 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-6fa4e1d7-8140-4ff7-bf79-07fb3746f0aa tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b" status: 200 len: 1390 microversion: 2.1 time: 0.447640 Aug 27 02:46:08.737140 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 683/1382] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:08 2022] GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b => generated 1390 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:08.772144 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=20 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:46:08.777132 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a7f9f23e-2eac-4d3c-ad6c-f14ae9c20607 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:08.777910 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-a7f9f23e-2eac-4d3c-ad6c-f14ae9c20607 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] [instance: 484e03a9-aef3-4179-980c-0e7292a05b5a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:08.786786 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a7f9f23e-2eac-4d3c-ad6c-f14ae9c20607 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:08.787337 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a7f9f23e-2eac-4d3c-ad6c-f14ae9c20607 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:08.788060 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a7f9f23e-2eac-4d3c-ad6c-f14ae9c20607 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:08.790258 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a7f9f23e-2eac-4d3c-ad6c-f14ae9c20607 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:08.790816 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a7f9f23e-2eac-4d3c-ad6c-f14ae9c20607 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:08.791317 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a7f9f23e-2eac-4d3c-ad6c-f14ae9c20607 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:09.076942 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e21369fb-2819-4fe2-8807-5d80671f9bc3 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:09.078845 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-e21369fb-2819-4fe2-8807-5d80671f9bc3 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: eb11f5d3-ce63-461d-a83f-04f33ce7c16b] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:09.088505 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e21369fb-2819-4fe2-8807-5d80671f9bc3 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:09.089221 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e21369fb-2819-4fe2-8807-5d80671f9bc3 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:09.089928 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e21369fb-2819-4fe2-8807-5d80671f9bc3 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:09.090810 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e21369fb-2819-4fe2-8807-5d80671f9bc3 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:09.091489 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e21369fb-2819-4fe2-8807-5d80671f9bc3 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:09.092086 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e21369fb-2819-4fe2-8807-5d80671f9bc3 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:09.113139 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-a7f9f23e-2eac-4d3c-ad6c-f14ae9c20607 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:09.129620 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-a7f9f23e-2eac-4d3c-ad6c-f14ae9c20607 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:09.131114 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-a7f9f23e-2eac-4d3c-ad6c-f14ae9c20607 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:09.132287 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a7f9f23e-2eac-4d3c-ad6c-f14ae9c20607 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] 10.222.0.70 "GET /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a" status: 200 len: 1887 microversion: 2.42 time: 0.361731 Aug 27 02:46:09.132934 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 700/1383] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:46:08 2022] GET /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a => generated 1887 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:46:09.295331 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8c19562f-f042-4cca-b058-40cd3a200705 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:09.296525 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-8c19562f-f042-4cca-b058-40cd3a200705 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: f620f083-7230-471a-87d0-f6d85f8ad087] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:09.310993 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8c19562f-f042-4cca-b058-40cd3a200705 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:09.312457 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8c19562f-f042-4cca-b058-40cd3a200705 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:09.314197 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8c19562f-f042-4cca-b058-40cd3a200705 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:09.315567 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8c19562f-f042-4cca-b058-40cd3a200705 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:09.318385 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8c19562f-f042-4cca-b058-40cd3a200705 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:09.321129 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8c19562f-f042-4cca-b058-40cd3a200705 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:09.374734 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-e21369fb-2819-4fe2-8807-5d80671f9bc3 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6d1646ec094e3297f6f3c51dd72e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b105816fd4e54b9da4973ff721e1fb92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:09.383944 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e21369fb-2819-4fe2-8807-5d80671f9bc3 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "GET /compute/v2.1/servers/eb11f5d3-ce63-461d-a83f-04f33ce7c16b" status: 200 len: 1317 microversion: 2.1 time: 0.312051 Aug 27 02:46:09.401467 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 684/1384] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:09 2022] GET /compute/v2.1/servers/eb11f5d3-ce63-461d-a83f-04f33ce7c16b => generated 1317 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:09.475408 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-82117d65-e2ec-444f-a0c9-8c003132610f tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:09.476018 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-82117d65-e2ec-444f-a0c9-8c003132610f tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] [instance: 4b798950-60e1-4097-a7e0-365dd0976cb5] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:09.500225 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-82117d65-e2ec-444f-a0c9-8c003132610f tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:09.500745 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-82117d65-e2ec-444f-a0c9-8c003132610f tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:09.501278 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-82117d65-e2ec-444f-a0c9-8c003132610f tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:09.503923 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-82117d65-e2ec-444f-a0c9-8c003132610f tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:09.503923 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-82117d65-e2ec-444f-a0c9-8c003132610f tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:09.503923 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-82117d65-e2ec-444f-a0c9-8c003132610f tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:09.603424 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-8c19562f-f042-4cca-b058-40cd3a200705 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:09.618801 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-8c19562f-f042-4cca-b058-40cd3a200705 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:09.620736 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-8c19562f-f042-4cca-b058-40cd3a200705 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:09.625374 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-8c19562f-f042-4cca-b058-40cd3a200705 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/f620f083-7230-471a-87d0-f6d85f8ad087" status: 200 len: 1487 microversion: 2.25 time: 0.337273 Aug 27 02:46:09.626204 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 701/1385] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:46:09 2022] GET /compute/v2.1/servers/f620f083-7230-471a-87d0-f6d85f8ad087 => generated 1487 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:46:09.635361 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-54aa36c8-9555-4f27-9360-8a43212b32b0 req-991921ef-cedd-45a6-8a2b-d54c701819c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b798950-60e1-4097-a7e0-365dd0976cb5", "name": "network-vif-plugged", "status": "completed", "tag": "0f6894dc-0ae0-41d0-a29d-eb2fa732abbd"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:46:09.673687 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-54aa36c8-9555-4f27-9360-8a43212b32b0 req-991921ef-cedd-45a6-8a2b-d54c701819c7 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:09.674439 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-54aa36c8-9555-4f27-9360-8a43212b32b0 req-991921ef-cedd-45a6-8a2b-d54c701819c7 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:09.675110 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-54aa36c8-9555-4f27-9360-8a43212b32b0 req-991921ef-cedd-45a6-8a2b-d54c701819c7 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:09.699132 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-54aa36c8-9555-4f27-9360-8a43212b32b0 req-991921ef-cedd-45a6-8a2b-d54c701819c7 service nova] Creating event network-vif-plugged:0f6894dc-0ae0-41d0-a29d-eb2fa732abbd for instance 4b798950-60e1-4097-a7e0-365dd0976cb5 on n-h1-852278-4 Aug 27 02:46:09.713610 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-54aa36c8-9555-4f27-9360-8a43212b32b0 req-991921ef-cedd-45a6-8a2b-d54c701819c7 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085040 Aug 27 02:46:09.717016 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 702/1386] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:46:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:46:09.725701 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-1f377304-3f01-4ba0-818d-4d31788f2bad req-65a0f3da-a4e1-48f7-a4f4-0e80c3a71898 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f620f083-7230-471a-87d0-f6d85f8ad087", "name": "network-vif-unplugged", "status": "completed", "tag": "9bf0e2d8-ba4e-4067-bcf4-ca6ddddb7811"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:46:09.736099 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-1f377304-3f01-4ba0-818d-4d31788f2bad req-65a0f3da-a4e1-48f7-a4f4-0e80c3a71898 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:09.736567 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-1f377304-3f01-4ba0-818d-4d31788f2bad req-65a0f3da-a4e1-48f7-a4f4-0e80c3a71898 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:09.737001 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-1f377304-3f01-4ba0-818d-4d31788f2bad req-65a0f3da-a4e1-48f7-a4f4-0e80c3a71898 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:09.751608 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-1f377304-3f01-4ba0-818d-4d31788f2bad req-65a0f3da-a4e1-48f7-a4f4-0e80c3a71898 service nova] Creating event network-vif-unplugged:9bf0e2d8-ba4e-4067-bcf4-ca6ddddb7811 for instance f620f083-7230-471a-87d0-f6d85f8ad087 on n-h2-852278-4 Aug 27 02:46:09.760047 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-1f377304-3f01-4ba0-818d-4d31788f2bad req-65a0f3da-a4e1-48f7-a4f4-0e80c3a71898 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042346 Aug 27 02:46:09.761912 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 703/1387] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:46:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:46:09.783014 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-466a2723-7c96-4216-b538-273ba709351f tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:09.784998 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-466a2723-7c96-4216-b538-273ba709351f tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 70acfe32-deea-46fc-a214-8fdbb9f6cb7b] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:09.807469 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-466a2723-7c96-4216-b538-273ba709351f tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:09.809076 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-466a2723-7c96-4216-b538-273ba709351f tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:09.809686 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-466a2723-7c96-4216-b538-273ba709351f tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:09.810477 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-466a2723-7c96-4216-b538-273ba709351f tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:09.829346 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-466a2723-7c96-4216-b538-273ba709351f tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:09.830356 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-466a2723-7c96-4216-b538-273ba709351f tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:09.885103 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-82117d65-e2ec-444f-a0c9-8c003132610f tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e86c17fe83848e2bc96b7c83ff1cf14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5668e6d96694c62b83f7e8381fe86e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:09.899241 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-82117d65-e2ec-444f-a0c9-8c003132610f tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] 10.222.0.70 "GET /compute/v2.1/servers/4b798950-60e1-4097-a7e0-365dd0976cb5" status: 200 len: 1325 microversion: 2.1 time: 0.430443 Aug 27 02:46:09.912343 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 685/1388] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:09 2022] GET /compute/v2.1/servers/4b798950-60e1-4097-a7e0-365dd0976cb5 => generated 1325 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:46:10.156762 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e20a4c76-44b0-422d-9ee7-ff34c3057a48 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:10.158528 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-e20a4c76-44b0-422d-9ee7-ff34c3057a48 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] [instance: 484e03a9-aef3-4179-980c-0e7292a05b5a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:10.170428 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e20a4c76-44b0-422d-9ee7-ff34c3057a48 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:10.173116 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e20a4c76-44b0-422d-9ee7-ff34c3057a48 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:10.176050 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e20a4c76-44b0-422d-9ee7-ff34c3057a48 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:10.176251 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-466a2723-7c96-4216-b538-273ba709351f tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:10.177241 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e20a4c76-44b0-422d-9ee7-ff34c3057a48 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:10.179658 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e20a4c76-44b0-422d-9ee7-ff34c3057a48 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:10.183073 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e20a4c76-44b0-422d-9ee7-ff34c3057a48 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:10.187356 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-466a2723-7c96-4216-b538-273ba709351f tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b" status: 200 len: 1390 microversion: 2.1 time: 0.423728 Aug 27 02:46:10.190339 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 704/1389] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:09 2022] GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b => generated 1390 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:10.409932 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0a46e9d2-42a2-415b-8bba-d1162f58ce6b tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:10.410950 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-0a46e9d2-42a2-415b-8bba-d1162f58ce6b tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: eb11f5d3-ce63-461d-a83f-04f33ce7c16b] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:10.424513 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0a46e9d2-42a2-415b-8bba-d1162f58ce6b tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:10.425246 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0a46e9d2-42a2-415b-8bba-d1162f58ce6b tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:10.426054 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0a46e9d2-42a2-415b-8bba-d1162f58ce6b tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:10.426594 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0a46e9d2-42a2-415b-8bba-d1162f58ce6b tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:10.427049 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0a46e9d2-42a2-415b-8bba-d1162f58ce6b tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:10.427630 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0a46e9d2-42a2-415b-8bba-d1162f58ce6b tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:11.183235 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-0a46e9d2-42a2-415b-8bba-d1162f58ce6b tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6d1646ec094e3297f6f3c51dd72e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b105816fd4e54b9da4973ff721e1fb92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:11.196798 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-0a46e9d2-42a2-415b-8bba-d1162f58ce6b tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "GET /compute/v2.1/servers/eb11f5d3-ce63-461d-a83f-04f33ce7c16b" status: 200 len: 1317 microversion: 2.1 time: 0.790548 Aug 27 02:46:11.197136 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 705/1390] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:10 2022] GET /compute/v2.1/servers/eb11f5d3-ce63-461d-a83f-04f33ce7c16b => generated 1317 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:46:11.208500 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ae5b46ec-a092-4215-b448-9fc9b3b1f2b1 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:11.211064 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-ae5b46ec-a092-4215-b448-9fc9b3b1f2b1 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: f620f083-7230-471a-87d0-f6d85f8ad087] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:11.224373 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ae5b46ec-a092-4215-b448-9fc9b3b1f2b1 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:11.239914 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ae5b46ec-a092-4215-b448-9fc9b3b1f2b1 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:11.245306 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ae5b46ec-a092-4215-b448-9fc9b3b1f2b1 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:11.255234 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ae5b46ec-a092-4215-b448-9fc9b3b1f2b1 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:11.257610 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ae5b46ec-a092-4215-b448-9fc9b3b1f2b1 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:11.259950 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ae5b46ec-a092-4215-b448-9fc9b3b1f2b1 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:11.304961 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-e20a4c76-44b0-422d-9ee7-ff34c3057a48 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:11.330887 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-e20a4c76-44b0-422d-9ee7-ff34c3057a48 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:11.334438 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-e20a4c76-44b0-422d-9ee7-ff34c3057a48 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:11.335553 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e20a4c76-44b0-422d-9ee7-ff34c3057a48 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] 10.222.0.70 "GET /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a" status: 200 len: 1887 microversion: 2.42 time: 1.184456 Aug 27 02:46:11.340990 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 686/1391] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:46:10 2022] GET /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a => generated 1887 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:46:11.358046 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-6176a181-18c8-4973-b35a-1f89cdd4694f req-a0b7000e-61d2-46cf-8d68-6e074429b4e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "484e03a9-aef3-4179-980c-0e7292a05b5a", "tag": "c90fb304-b679-479a-ba4f-cede7f0a36e7"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:46:11.385572 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-6176a181-18c8-4973-b35a-1f89cdd4694f req-a0b7000e-61d2-46cf-8d68-6e074429b4e6 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:11.390618 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-6176a181-18c8-4973-b35a-1f89cdd4694f req-a0b7000e-61d2-46cf-8d68-6e074429b4e6 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:11.392126 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-6176a181-18c8-4973-b35a-1f89cdd4694f req-a0b7000e-61d2-46cf-8d68-6e074429b4e6 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:11.424340 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-6176a181-18c8-4973-b35a-1f89cdd4694f req-a0b7000e-61d2-46cf-8d68-6e074429b4e6 service nova] Creating event network-changed:c90fb304-b679-479a-ba4f-cede7f0a36e7 for instance 484e03a9-aef3-4179-980c-0e7292a05b5a on n-h1-852278-4 Aug 27 02:46:11.442520 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-6176a181-18c8-4973-b35a-1f89cdd4694f req-a0b7000e-61d2-46cf-8d68-6e074429b4e6 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098465 Aug 27 02:46:11.443660 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 687/1392] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:46:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:46:11.449083 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-09ef6b75-46af-46c5-8ce8-e80d879e819e tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:11.449878 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-09ef6b75-46af-46c5-8ce8-e80d879e819e tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] [instance: 4b798950-60e1-4097-a7e0-365dd0976cb5] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:11.466339 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-09ef6b75-46af-46c5-8ce8-e80d879e819e tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:11.466894 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-09ef6b75-46af-46c5-8ce8-e80d879e819e tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:11.467335 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-09ef6b75-46af-46c5-8ce8-e80d879e819e tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:11.468063 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-09ef6b75-46af-46c5-8ce8-e80d879e819e tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:11.468629 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-09ef6b75-46af-46c5-8ce8-e80d879e819e tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:11.468973 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-09ef6b75-46af-46c5-8ce8-e80d879e819e tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:11.779256 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-ae5b46ec-a092-4215-b448-9fc9b3b1f2b1 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:11.791775 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-ae5b46ec-a092-4215-b448-9fc9b3b1f2b1 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:11.799724 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-ae5b46ec-a092-4215-b448-9fc9b3b1f2b1 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:11.801281 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ae5b46ec-a092-4215-b448-9fc9b3b1f2b1 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/f620f083-7230-471a-87d0-f6d85f8ad087" status: 200 len: 1487 microversion: 2.25 time: 0.598695 Aug 27 02:46:11.802438 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 706/1393] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:46:11 2022] GET /compute/v2.1/servers/f620f083-7230-471a-87d0-f6d85f8ad087 => generated 1487 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:46:11.809633 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0b37c9c4-e8fd-4810-ac35-e6cef6d97fa9 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:11.810499 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-0b37c9c4-e8fd-4810-ac35-e6cef6d97fa9 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 70acfe32-deea-46fc-a214-8fdbb9f6cb7b] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:11.818826 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0b37c9c4-e8fd-4810-ac35-e6cef6d97fa9 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:11.820482 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0b37c9c4-e8fd-4810-ac35-e6cef6d97fa9 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:11.821114 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0b37c9c4-e8fd-4810-ac35-e6cef6d97fa9 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:11.822199 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0b37c9c4-e8fd-4810-ac35-e6cef6d97fa9 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:11.822814 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0b37c9c4-e8fd-4810-ac35-e6cef6d97fa9 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:11.823584 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0b37c9c4-e8fd-4810-ac35-e6cef6d97fa9 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:12.003526 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-09ef6b75-46af-46c5-8ce8-e80d879e819e tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e86c17fe83848e2bc96b7c83ff1cf14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5668e6d96694c62b83f7e8381fe86e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:12.016060 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-09ef6b75-46af-46c5-8ce8-e80d879e819e tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] 10.222.0.70 "GET /compute/v2.1/servers/4b798950-60e1-4097-a7e0-365dd0976cb5" status: 200 len: 1325 microversion: 2.1 time: 0.568774 Aug 27 02:46:12.018919 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 688/1394] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:11 2022] GET /compute/v2.1/servers/4b798950-60e1-4097-a7e0-365dd0976cb5 => generated 1325 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:12.030676 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-838b4a88-f6b3-4fe5-ac8e-8e0d7a186144 req-e0e05598-6e4e-4514-b582-fb87a125c6c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f620f083-7230-471a-87d0-f6d85f8ad087", "tag": "9bf0e2d8-ba4e-4067-bcf4-ca6ddddb7811"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:46:12.045455 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-838b4a88-f6b3-4fe5-ac8e-8e0d7a186144 req-e0e05598-6e4e-4514-b582-fb87a125c6c1 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:12.046314 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-838b4a88-f6b3-4fe5-ac8e-8e0d7a186144 req-e0e05598-6e4e-4514-b582-fb87a125c6c1 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:12.046794 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-838b4a88-f6b3-4fe5-ac8e-8e0d7a186144 req-e0e05598-6e4e-4514-b582-fb87a125c6c1 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:12.062242 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-838b4a88-f6b3-4fe5-ac8e-8e0d7a186144 req-e0e05598-6e4e-4514-b582-fb87a125c6c1 service nova] Creating event network-changed:9bf0e2d8-ba4e-4067-bcf4-ca6ddddb7811 for instance f620f083-7230-471a-87d0-f6d85f8ad087 on n-h2-852278-4 Aug 27 02:46:12.069012 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-838b4a88-f6b3-4fe5-ac8e-8e0d7a186144 req-e0e05598-6e4e-4514-b582-fb87a125c6c1 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047786 Aug 27 02:46:12.070609 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 689/1395] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:46:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:46:12.205875 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-0b37c9c4-e8fd-4810-ac35-e6cef6d97fa9 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:12.214775 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-0b37c9c4-e8fd-4810-ac35-e6cef6d97fa9 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b" status: 200 len: 1390 microversion: 2.1 time: 0.410979 Aug 27 02:46:12.222958 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9e2ce055-49f4-465c-b4fd-a96c5660a472 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:12.223668 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-9e2ce055-49f4-465c-b4fd-a96c5660a472 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: eb11f5d3-ce63-461d-a83f-04f33ce7c16b] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:12.227079 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 707/1396] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:11 2022] GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b => generated 1390 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:12.230885 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9e2ce055-49f4-465c-b4fd-a96c5660a472 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:12.232172 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9e2ce055-49f4-465c-b4fd-a96c5660a472 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:12.232961 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9e2ce055-49f4-465c-b4fd-a96c5660a472 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:12.233874 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9e2ce055-49f4-465c-b4fd-a96c5660a472 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:12.234986 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9e2ce055-49f4-465c-b4fd-a96c5660a472 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:12.235594 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9e2ce055-49f4-465c-b4fd-a96c5660a472 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:12.305892 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-cc3fdb45-da1c-4a6c-8a0b-40a3524ebb4d tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8ee14fe0-9753-426c-ba11-4a2796c791de"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:46:12.309098 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-cc3fdb45-da1c-4a6c-8a0b-40a3524ebb4d tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] [instance: a00dd6f6-d48c-4938-84b1-71bec3877ad9] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:12.315617 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cc3fdb45-da1c-4a6c-8a0b-40a3524ebb4d tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:12.316043 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cc3fdb45-da1c-4a6c-8a0b-40a3524ebb4d tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:12.316607 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cc3fdb45-da1c-4a6c-8a0b-40a3524ebb4d tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:12.317317 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cc3fdb45-da1c-4a6c-8a0b-40a3524ebb4d tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:12.318103 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cc3fdb45-da1c-4a6c-8a0b-40a3524ebb4d tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:12.318542 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cc3fdb45-da1c-4a6c-8a0b-40a3524ebb4d tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:12.405974 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=100 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:46:12.472395 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-9e2ce055-49f4-465c-b4fd-a96c5660a472 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6d1646ec094e3297f6f3c51dd72e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b105816fd4e54b9da4973ff721e1fb92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:12.481046 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9e2ce055-49f4-465c-b4fd-a96c5660a472 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "GET /compute/v2.1/servers/eb11f5d3-ce63-461d-a83f-04f33ce7c16b" status: 200 len: 1317 microversion: 2.1 time: 0.263466 Aug 27 02:46:12.481830 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 690/1397] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:12 2022] GET /compute/v2.1/servers/eb11f5d3-ce63-461d-a83f-04f33ce7c16b => generated 1317 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:12.487724 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d4973ad9-f4ba-43f6-a6aa-4d177b29f7c1 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:12.488723 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d4973ad9-f4ba-43f6-a6aa-4d177b29f7c1 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] [instance: 484e03a9-aef3-4179-980c-0e7292a05b5a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:12.496621 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d4973ad9-f4ba-43f6-a6aa-4d177b29f7c1 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:12.497315 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d4973ad9-f4ba-43f6-a6aa-4d177b29f7c1 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:12.497787 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d4973ad9-f4ba-43f6-a6aa-4d177b29f7c1 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:12.498560 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d4973ad9-f4ba-43f6-a6aa-4d177b29f7c1 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:12.498957 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d4973ad9-f4ba-43f6-a6aa-4d177b29f7c1 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:12.499641 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d4973ad9-f4ba-43f6-a6aa-4d177b29f7c1 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:12.696833 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-d4973ad9-f4ba-43f6-a6aa-4d177b29f7c1 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:12.707318 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-d4973ad9-f4ba-43f6-a6aa-4d177b29f7c1 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:12.708882 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-d4973ad9-f4ba-43f6-a6aa-4d177b29f7c1 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:12.710231 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d4973ad9-f4ba-43f6-a6aa-4d177b29f7c1 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] 10.222.0.70 "GET /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a" status: 200 len: 1875 microversion: 2.42 time: 0.227221 Aug 27 02:46:12.710787 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 691/1398] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:46:12 2022] GET /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a => generated 1875 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:46:12.826296 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b5e83fba-fe0d-41ad-b178-fc99d160f4e6 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:12.827236 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b5e83fba-fe0d-41ad-b178-fc99d160f4e6 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: f620f083-7230-471a-87d0-f6d85f8ad087] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:12.834499 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b5e83fba-fe0d-41ad-b178-fc99d160f4e6 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:12.835122 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b5e83fba-fe0d-41ad-b178-fc99d160f4e6 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:12.835684 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b5e83fba-fe0d-41ad-b178-fc99d160f4e6 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:12.836572 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b5e83fba-fe0d-41ad-b178-fc99d160f4e6 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:12.837112 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b5e83fba-fe0d-41ad-b178-fc99d160f4e6 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:12.837753 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b5e83fba-fe0d-41ad-b178-fc99d160f4e6 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:13.006946 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b5e83fba-fe0d-41ad-b178-fc99d160f4e6 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:13.015428 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b5e83fba-fe0d-41ad-b178-fc99d160f4e6 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:13.016952 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b5e83fba-fe0d-41ad-b178-fc99d160f4e6 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:13.018309 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b5e83fba-fe0d-41ad-b178-fc99d160f4e6 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/f620f083-7230-471a-87d0-f6d85f8ad087" status: 200 len: 1487 microversion: 2.25 time: 0.197374 Aug 27 02:46:13.018762 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 692/1399] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:46:12 2022] GET /compute/v2.1/servers/f620f083-7230-471a-87d0-f6d85f8ad087 => generated 1487 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:46:13.044015 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-21919453-07f3-4a80-82a0-afafb43fc14b tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:13.044761 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-21919453-07f3-4a80-82a0-afafb43fc14b tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] [instance: 4b798950-60e1-4097-a7e0-365dd0976cb5] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:13.051069 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-21919453-07f3-4a80-82a0-afafb43fc14b tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:13.051932 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-21919453-07f3-4a80-82a0-afafb43fc14b tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:13.052565 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-21919453-07f3-4a80-82a0-afafb43fc14b tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:13.058564 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-21919453-07f3-4a80-82a0-afafb43fc14b tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:13.059069 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-21919453-07f3-4a80-82a0-afafb43fc14b tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:13.059506 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-21919453-07f3-4a80-82a0-afafb43fc14b tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:13.237205 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-21919453-07f3-4a80-82a0-afafb43fc14b tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e86c17fe83848e2bc96b7c83ff1cf14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5668e6d96694c62b83f7e8381fe86e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:13.257190 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-21919453-07f3-4a80-82a0-afafb43fc14b tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] 10.222.0.70 "GET /compute/v2.1/servers/4b798950-60e1-4097-a7e0-365dd0976cb5" status: 200 len: 1522 microversion: 2.1 time: 0.217465 Aug 27 02:46:13.258444 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 693/1400] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:13 2022] GET /compute/v2.1/servers/4b798950-60e1-4097-a7e0-365dd0976cb5 => generated 1522 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:46:13.264254 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-7da01b0b-4d5f-42e4-9111-b5e0358d192c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:13.264922 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-7da01b0b-4d5f-42e4-9111-b5e0358d192c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 70acfe32-deea-46fc-a214-8fdbb9f6cb7b] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:13.272583 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7da01b0b-4d5f-42e4-9111-b5e0358d192c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:13.273370 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7da01b0b-4d5f-42e4-9111-b5e0358d192c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:13.274425 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7da01b0b-4d5f-42e4-9111-b5e0358d192c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:13.275311 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7da01b0b-4d5f-42e4-9111-b5e0358d192c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:13.276004 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7da01b0b-4d5f-42e4-9111-b5e0358d192c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:13.277296 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7da01b0b-4d5f-42e4-9111-b5e0358d192c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:13.431158 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-cc3fdb45-da1c-4a6c-8a0b-40a3524ebb4d tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] 10.222.0.70 "POST /compute/v2.1/servers/a00dd6f6-d48c-4938-84b1-71bec3877ad9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.129629 Aug 27 02:46:13.438647 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 708/1401] 10.222.0.70 () {60 vars in 1323 bytes} [Sat Aug 27 02:46:12 2022] POST /compute/v2.1/servers/a00dd6f6-d48c-4938-84b1-71bec3877ad9/os-volume_attachments => generated 194 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:46:13.440437 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-5a1d0806-dc0b-46e1-ad2e-b27f0ab44dd3 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:13.441085 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-5a1d0806-dc0b-46e1-ad2e-b27f0ab44dd3 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] [instance: 4b798950-60e1-4097-a7e0-365dd0976cb5] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:13.448766 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5a1d0806-dc0b-46e1-ad2e-b27f0ab44dd3 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:13.449261 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5a1d0806-dc0b-46e1-ad2e-b27f0ab44dd3 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:13.449701 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5a1d0806-dc0b-46e1-ad2e-b27f0ab44dd3 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:13.450581 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5a1d0806-dc0b-46e1-ad2e-b27f0ab44dd3 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:13.451118 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5a1d0806-dc0b-46e1-ad2e-b27f0ab44dd3 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:13.451546 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5a1d0806-dc0b-46e1-ad2e-b27f0ab44dd3 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:13.490193 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-7da01b0b-4d5f-42e4-9111-b5e0358d192c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:13.500775 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-7da01b0b-4d5f-42e4-9111-b5e0358d192c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b" status: 200 len: 1390 microversion: 2.1 time: 0.241256 Aug 27 02:46:13.522420 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 694/1402] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:13 2022] GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b => generated 1390 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:13.527243 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-5a185106-7ec7-40d6-9849-d0a319ad5292 req-6f73f784-caf8-4bad-a505-0a0fdc41447f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "484e03a9-aef3-4179-980c-0e7292a05b5a", "tag": "d59ac6c7-2440-450a-955f-48c4271b051e"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:46:13.553994 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-5a185106-7ec7-40d6-9849-d0a319ad5292 req-6f73f784-caf8-4bad-a505-0a0fdc41447f service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:13.554408 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-5a185106-7ec7-40d6-9849-d0a319ad5292 req-6f73f784-caf8-4bad-a505-0a0fdc41447f service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:13.556904 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-5a185106-7ec7-40d6-9849-d0a319ad5292 req-6f73f784-caf8-4bad-a505-0a0fdc41447f service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:13.571814 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-5a185106-7ec7-40d6-9849-d0a319ad5292 req-6f73f784-caf8-4bad-a505-0a0fdc41447f service nova] Creating event network-changed:d59ac6c7-2440-450a-955f-48c4271b051e for instance 484e03a9-aef3-4179-980c-0e7292a05b5a on n-h1-852278-4 Aug 27 02:46:13.577657 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-5a185106-7ec7-40d6-9849-d0a319ad5292 req-6f73f784-caf8-4bad-a505-0a0fdc41447f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053940 Aug 27 02:46:13.578758 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 695/1403] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:46:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:46:13.584673 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-015f8654-e95e-4283-a5e6-bc28283d98b0 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:13.585554 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-015f8654-e95e-4283-a5e6-bc28283d98b0 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: eb11f5d3-ce63-461d-a83f-04f33ce7c16b] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:13.593664 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-015f8654-e95e-4283-a5e6-bc28283d98b0 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:13.594453 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-015f8654-e95e-4283-a5e6-bc28283d98b0 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:13.594638 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-015f8654-e95e-4283-a5e6-bc28283d98b0 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:13.595336 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-015f8654-e95e-4283-a5e6-bc28283d98b0 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:13.595948 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-015f8654-e95e-4283-a5e6-bc28283d98b0 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:13.596560 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-015f8654-e95e-4283-a5e6-bc28283d98b0 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:13.719071 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-5a1d0806-dc0b-46e1-ad2e-b27f0ab44dd3 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e86c17fe83848e2bc96b7c83ff1cf14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5668e6d96694c62b83f7e8381fe86e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:13.744095 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-5a1d0806-dc0b-46e1-ad2e-b27f0ab44dd3 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] 10.222.0.70 "GET /compute/v2.1/servers/4b798950-60e1-4097-a7e0-365dd0976cb5" status: 200 len: 1522 microversion: 2.1 time: 0.308595 Aug 27 02:46:13.745583 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 709/1404] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:13 2022] GET /compute/v2.1/servers/4b798950-60e1-4097-a7e0-365dd0976cb5 => generated 1522 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:13.758663 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8aabbf74-ca54-4dcd-b9f1-a34b7272244d tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:13.760327 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-8aabbf74-ca54-4dcd-b9f1-a34b7272244d tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] [instance: 484e03a9-aef3-4179-980c-0e7292a05b5a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:13.769764 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8aabbf74-ca54-4dcd-b9f1-a34b7272244d tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:13.770636 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8aabbf74-ca54-4dcd-b9f1-a34b7272244d tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:13.772239 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8aabbf74-ca54-4dcd-b9f1-a34b7272244d tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:13.773568 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8aabbf74-ca54-4dcd-b9f1-a34b7272244d tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:13.774030 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8aabbf74-ca54-4dcd-b9f1-a34b7272244d tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:13.775014 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8aabbf74-ca54-4dcd-b9f1-a34b7272244d tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:13.821590 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-015f8654-e95e-4283-a5e6-bc28283d98b0 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6d1646ec094e3297f6f3c51dd72e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b105816fd4e54b9da4973ff721e1fb92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:13.837165 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-015f8654-e95e-4283-a5e6-bc28283d98b0 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "GET /compute/v2.1/servers/eb11f5d3-ce63-461d-a83f-04f33ce7c16b" status: 200 len: 1317 microversion: 2.1 time: 0.252347 Aug 27 02:46:13.837911 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 696/1405] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:13 2022] GET /compute/v2.1/servers/eb11f5d3-ce63-461d-a83f-04f33ce7c16b => generated 1317 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:13.845702 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-579baa3f-448b-4540-bdc3-cddb1fc4e1f9 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-2146522712"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:46:13.850854 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-579baa3f-448b-4540-bdc3-cddb1fc4e1f9 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] [instance: 4b798950-60e1-4097-a7e0-365dd0976cb5] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:13.865659 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-579baa3f-448b-4540-bdc3-cddb1fc4e1f9 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:13.867685 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-579baa3f-448b-4540-bdc3-cddb1fc4e1f9 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:13.869128 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-579baa3f-448b-4540-bdc3-cddb1fc4e1f9 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:13.870647 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-579baa3f-448b-4540-bdc3-cddb1fc4e1f9 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:13.872019 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-579baa3f-448b-4540-bdc3-cddb1fc4e1f9 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:13.872763 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-579baa3f-448b-4540-bdc3-cddb1fc4e1f9 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:14.163900 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-8aabbf74-ca54-4dcd-b9f1-a34b7272244d tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:14.178198 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-579baa3f-448b-4540-bdc3-cddb1fc4e1f9 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] 10.222.0.70 "POST /compute/v2.1/servers/4b798950-60e1-4097-a7e0-365dd0976cb5/action" status: 202 len: 0 microversion: 2.1 time: 0.338557 Aug 27 02:46:14.179281 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 697/1406] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 02:46:13 2022] POST /compute/v2.1/servers/4b798950-60e1-4097-a7e0-365dd0976cb5/action => generated 0 bytes in 340 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 27 02:46:14.185494 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-1da87786-7127-45fb-9848-652b95b983d7 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:14.186519 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-1da87786-7127-45fb-9848-652b95b983d7 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: f620f083-7230-471a-87d0-f6d85f8ad087] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:14.210177 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1da87786-7127-45fb-9848-652b95b983d7 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:14.212172 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-8aabbf74-ca54-4dcd-b9f1-a34b7272244d tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:14.212910 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1da87786-7127-45fb-9848-652b95b983d7 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:14.213180 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1da87786-7127-45fb-9848-652b95b983d7 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:14.215149 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1da87786-7127-45fb-9848-652b95b983d7 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:14.215557 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-8aabbf74-ca54-4dcd-b9f1-a34b7272244d tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:14.215721 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1da87786-7127-45fb-9848-652b95b983d7 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:14.217739 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1da87786-7127-45fb-9848-652b95b983d7 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:14.235319 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-8aabbf74-ca54-4dcd-b9f1-a34b7272244d tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] 10.222.0.70 "GET /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a" status: 200 len: 1875 microversion: 2.42 time: 0.484496 Aug 27 02:46:14.236807 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 710/1407] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:46:13 2022] GET /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a => generated 1875 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:46:14.253231 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-2c86206e-fe67-4d9f-8415-a99390cf883e req-9e414691-dce2-4134-ade8-ccf8fc06d8d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "484e03a9-aef3-4179-980c-0e7292a05b5a", "tag": "d8eb72ae-98e1-459d-a013-766f76a30e3d"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:46:14.287233 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-2c86206e-fe67-4d9f-8415-a99390cf883e req-9e414691-dce2-4134-ade8-ccf8fc06d8d3 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:14.287747 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-2c86206e-fe67-4d9f-8415-a99390cf883e req-9e414691-dce2-4134-ade8-ccf8fc06d8d3 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:14.288348 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-2c86206e-fe67-4d9f-8415-a99390cf883e req-9e414691-dce2-4134-ade8-ccf8fc06d8d3 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:14.314990 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-2c86206e-fe67-4d9f-8415-a99390cf883e req-9e414691-dce2-4134-ade8-ccf8fc06d8d3 service nova] Creating event network-changed:d8eb72ae-98e1-459d-a013-766f76a30e3d for instance 484e03a9-aef3-4179-980c-0e7292a05b5a on n-h1-852278-4 Aug 27 02:46:14.333678 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-2c86206e-fe67-4d9f-8415-a99390cf883e req-9e414691-dce2-4134-ade8-ccf8fc06d8d3 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089829 Aug 27 02:46:14.335809 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 711/1408] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:46:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:46:14.343407 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-9e62bbd4-bf8a-4b6c-bc75-8f3ca099c633 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Calling method '.version_select at 0x7f5eded9f790>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:14.512455 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-9e62bbd4-bf8a-4b6c-bc75-8f3ca099c633 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] 10.222.0.70 "DELETE /compute/v2.1/images/1f1b1cc5-a39e-455a-b8ee-513e915591bb" status: 204 len: 0 microversion: 2.1 time: 0.174656 Aug 27 02:46:14.517408 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 712/1409] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:14 2022] DELETE /compute/v2.1/images/1f1b1cc5-a39e-455a-b8ee-513e915591bb => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:46:14.525826 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f6a4d4c1-5c61-436c-b5d2-89e2d00a774d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:14.527168 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-f6a4d4c1-5c61-436c-b5d2-89e2d00a774d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 70acfe32-deea-46fc-a214-8fdbb9f6cb7b] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:14.552410 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f6a4d4c1-5c61-436c-b5d2-89e2d00a774d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:14.554723 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f6a4d4c1-5c61-436c-b5d2-89e2d00a774d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:14.557009 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f6a4d4c1-5c61-436c-b5d2-89e2d00a774d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:14.559602 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f6a4d4c1-5c61-436c-b5d2-89e2d00a774d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:14.563129 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f6a4d4c1-5c61-436c-b5d2-89e2d00a774d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:14.563780 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f6a4d4c1-5c61-436c-b5d2-89e2d00a774d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:14.711101 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-1da87786-7127-45fb-9848-652b95b983d7 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:14.716937 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:46:14.724575 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-1da87786-7127-45fb-9848-652b95b983d7 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:14.726310 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-1da87786-7127-45fb-9848-652b95b983d7 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:14.727663 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-1da87786-7127-45fb-9848-652b95b983d7 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/f620f083-7230-471a-87d0-f6d85f8ad087" status: 200 len: 1487 microversion: 2.25 time: 0.546835 Aug 27 02:46:14.728357 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 698/1410] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:46:14 2022] GET /compute/v2.1/servers/f620f083-7230-471a-87d0-f6d85f8ad087 => generated 1487 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:46:14.753367 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-239578d4-9f16-4f25-84a9-80f664324ea0 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Calling method '.version_select at 0x7f5ee2ddcaf0>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:14.785632 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-239578d4-9f16-4f25-84a9-80f664324ea0 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] HTTP exception thrown: Image not found. Aug 27 02:46:14.814871 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-f6a4d4c1-5c61-436c-b5d2-89e2d00a774d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:14.821792 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-239578d4-9f16-4f25-84a9-80f664324ea0 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Request method failure captured: Aug 27 02:46:14.821792 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/images/1f1b1cc5-a39e-455a-b8ee-513e915591bb HTTP/1.1 Aug 27 02:46:14.821792 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:46:14.821792 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:46:14.821792 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:46:14.821792 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:46:14.821792 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:46:14.821792 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:46:14.821792 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:46:14.821792 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:46:14.821792 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYUqULQp-YhXHHCl2hngi9BMJm7wP1pGZCcaxudoyUu4YXudXmRdmBYAkbX0-TS9pqFDwaRuY82uqdOXUJwRWB1ajZ46tfQo1tc4MJsIVgVqim1Pvb2Il-ejDehbyoer8P643aveyI0JrfbznxBx8aFYmMJz3n8FX81wfpLT5u3cMYE Aug 27 02:46:14.821792 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:46:14.821792 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:46:14.821792 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:46:14.821792 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:46:14.821792 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:46:14.821792 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:46:14.821792 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: f5668e6d96694c62b83f7e8381fe86e1 Aug 27 02:46:14.821792 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-94227302 Aug 27 02:46:14.821792 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:46:14.821792 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:46:14.824757 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f5668e6d96694c62b83f7e8381fe86e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f5668e6d96694c62b83f7e8381fe86e1", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f5668e6d96694c62b83f7e8381fe86e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f5668e6d96694c62b83f7e8381fe86e1"}]}] Aug 27 02:46:14.824757 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-94227302 Aug 27 02:46:14.824757 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: f5668e6d96694c62b83f7e8381fe86e1 Aug 27 02:46:14.824757 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-94227302 Aug 27 02:46:14.824757 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ImagesOneServerNegativeTestJSON-94227302-project Aug 27 02:46:14.824757 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:46:14.824757 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:46:14.824757 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 0e86c17fe83848e2bc96b7c83ff1cf14 Aug 27 02:46:14.824757 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-94227302-project Aug 27 02:46:14.824757 n-d-852278-4 devstack@n-api.service[134052]: method: Aug 27 02:46:14.824757 n-d-852278-4 devstack@n-api.service[134052]: exception: Image not found. Aug 27 02:46:14.824757 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '1f1b1cc5-a39e-455a-b8ee-513e915591bb'} Aug 27 02:46:14.824757 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:46:14.826009 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:46:14.826009 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 02:46:14.826009 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 02:46:14.826009 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 02:46:14.826009 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 02:46:14.826009 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 02:46:14.826009 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 02:46:14.826009 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 02:46:14.826009 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 02:46:14.826009 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 02:46:14.826009 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 02:46:14.826009 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 02:46:14.826009 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 02:46:14.826009 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 02:46:14.826009 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 02:46:14.826009 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 02:46:14.826009 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 02:46:14.826009 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 1f1b1cc5-a39e-455a-b8ee-513e915591bb Aug 27 02:46:14.827240 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:46:14.827240 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:46:14.827240 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:46:14.827240 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:46:14.827240 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 27 02:46:14.827240 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 27 02:46:14.827240 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 27 02:46:14.827240 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 27 02:46:14.827240 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 27 02:46:14.827240 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 27 02:46:14.827240 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 27 02:46:14.827240 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 27 02:46:14.827240 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 02:46:14.827240 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 02:46:14.827240 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 02:46:14.827240 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 02:46:14.827240 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 02:46:14.827240 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 02:46:14.827240 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 02:46:14.827240 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 02:46:14.830618 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 02:46:14.830618 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 02:46:14.830618 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 02:46:14.830618 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 02:46:14.830618 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 02:46:14.830618 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 02:46:14.830618 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 02:46:14.830618 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 02:46:14.830618 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 1f1b1cc5-a39e-455a-b8ee-513e915591bb could not be found. Aug 27 02:46:14.830618 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:46:14.830618 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:46:14.830618 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:46:14.830618 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:46:14.830618 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:46:14.830618 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:46:14.830618 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:46:14.830618 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:46:14.830618 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:46:14.830618 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:46:14.833739 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:46:14.833739 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:46:14.833739 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 27 02:46:14.833739 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 27 02:46:14.833739 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 02:46:14.833739 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:46:14.833739 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:46:14.833739 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:46:14.833739 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:46:14.833739 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:46:14.833739 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:46:14.833739 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:46:14.833739 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:46:14.833739 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 02:46:14.833739 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:46:14.833739 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-239578d4-9f16-4f25-84a9-80f664324ea0 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Returning 404 to user: Image not found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:46:14.837012 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-239578d4-9f16-4f25-84a9-80f664324ea0 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] 10.222.0.70 "GET /compute/v2.1/images/1f1b1cc5-a39e-455a-b8ee-513e915591bb" status: 404 len: 62 microversion: 2.1 time: 0.093944 Aug 27 02:46:14.837012 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 699/1411] 10.222.0.70 () {58 vars in 1233 bytes} [Sat Aug 27 02:46:14 2022] GET /compute/v2.1/images/1f1b1cc5-a39e-455a-b8ee-513e915591bb => generated 62 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 02:46:14.837012 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3e9d4c3e-981e-4979-aa58-63cfe6928730 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:14.837012 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-3e9d4c3e-981e-4979-aa58-63cfe6928730 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] [instance: 4b798950-60e1-4097-a7e0-365dd0976cb5] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:14.841887 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-f6a4d4c1-5c61-436c-b5d2-89e2d00a774d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b" status: 200 len: 1390 microversion: 2.1 time: 0.319698 Aug 27 02:46:14.842263 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3e9d4c3e-981e-4979-aa58-63cfe6928730 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:14.842762 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3e9d4c3e-981e-4979-aa58-63cfe6928730 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:14.843197 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3e9d4c3e-981e-4979-aa58-63cfe6928730 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:14.843598 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 713/1412] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:14 2022] GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b => generated 1390 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:14.843916 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3e9d4c3e-981e-4979-aa58-63cfe6928730 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:14.844420 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3e9d4c3e-981e-4979-aa58-63cfe6928730 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:14.844846 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3e9d4c3e-981e-4979-aa58-63cfe6928730 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:14.863444 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0b91c5ff-fbe4-45da-8016-7722df90e3ee tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:14.864382 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-0b91c5ff-fbe4-45da-8016-7722df90e3ee tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: eb11f5d3-ce63-461d-a83f-04f33ce7c16b] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:14.872417 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0b91c5ff-fbe4-45da-8016-7722df90e3ee tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:14.873842 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0b91c5ff-fbe4-45da-8016-7722df90e3ee tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:14.874283 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0b91c5ff-fbe4-45da-8016-7722df90e3ee tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:14.875001 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0b91c5ff-fbe4-45da-8016-7722df90e3ee tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:14.876519 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0b91c5ff-fbe4-45da-8016-7722df90e3ee tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:14.876960 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0b91c5ff-fbe4-45da-8016-7722df90e3ee tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:15.252241 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-3e9d4c3e-981e-4979-aa58-63cfe6928730 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e86c17fe83848e2bc96b7c83ff1cf14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5668e6d96694c62b83f7e8381fe86e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:15.261801 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-0b91c5ff-fbe4-45da-8016-7722df90e3ee tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6d1646ec094e3297f6f3c51dd72e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b105816fd4e54b9da4973ff721e1fb92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:15.270173 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-0b91c5ff-fbe4-45da-8016-7722df90e3ee tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "GET /compute/v2.1/servers/eb11f5d3-ce63-461d-a83f-04f33ce7c16b" status: 200 len: 1317 microversion: 2.1 time: 0.412031 Aug 27 02:46:15.271405 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-3e9d4c3e-981e-4979-aa58-63cfe6928730 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] 10.222.0.70 "GET /compute/v2.1/servers/4b798950-60e1-4097-a7e0-365dd0976cb5" status: 200 len: 1534 microversion: 2.1 time: 0.442681 Aug 27 02:46:15.272112 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 714/1413] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:14 2022] GET /compute/v2.1/servers/eb11f5d3-ce63-461d-a83f-04f33ce7c16b => generated 1317 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:46:15.284001 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-9ffe1fbf-17f1-439a-8b72-91bc562b1328 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:15.284776 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 700/1414] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:14 2022] GET /compute/v2.1/servers/4b798950-60e1-4097-a7e0-365dd0976cb5 => generated 1534 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:46:15.285417 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-9ffe1fbf-17f1-439a-8b72-91bc562b1328 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] [instance: 484e03a9-aef3-4179-980c-0e7292a05b5a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:15.301121 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9ffe1fbf-17f1-439a-8b72-91bc562b1328 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:15.301924 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9ffe1fbf-17f1-439a-8b72-91bc562b1328 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:15.302463 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9ffe1fbf-17f1-439a-8b72-91bc562b1328 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:15.303446 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9ffe1fbf-17f1-439a-8b72-91bc562b1328 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:15.304137 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9ffe1fbf-17f1-439a-8b72-91bc562b1328 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:15.304921 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9ffe1fbf-17f1-439a-8b72-91bc562b1328 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:15.435258 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:46:15.738399 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-9ffe1fbf-17f1-439a-8b72-91bc562b1328 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:15.754384 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5bdf41b7-e127-4b6f-aa72-7ada6e037672 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:15.755132 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-5bdf41b7-e127-4b6f-aa72-7ada6e037672 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: f620f083-7230-471a-87d0-f6d85f8ad087] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:15.761718 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-9ffe1fbf-17f1-439a-8b72-91bc562b1328 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:15.766409 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5bdf41b7-e127-4b6f-aa72-7ada6e037672 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:15.771446 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5bdf41b7-e127-4b6f-aa72-7ada6e037672 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:15.772234 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5bdf41b7-e127-4b6f-aa72-7ada6e037672 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:15.773280 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5bdf41b7-e127-4b6f-aa72-7ada6e037672 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:15.773988 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5bdf41b7-e127-4b6f-aa72-7ada6e037672 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:15.774662 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5bdf41b7-e127-4b6f-aa72-7ada6e037672 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:15.785414 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-9ffe1fbf-17f1-439a-8b72-91bc562b1328 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:15.791063 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-9ffe1fbf-17f1-439a-8b72-91bc562b1328 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] 10.222.0.70 "GET /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a" status: 200 len: 1875 microversion: 2.42 time: 0.512915 Aug 27 02:46:15.793857 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 715/1415] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:46:15 2022] GET /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a => generated 1875 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:46:15.876717 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-eb39ee9a-7c1b-4098-a6f3-6bba565c9461 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:15.877579 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-eb39ee9a-7c1b-4098-a6f3-6bba565c9461 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 70acfe32-deea-46fc-a214-8fdbb9f6cb7b] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:15.897421 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eb39ee9a-7c1b-4098-a6f3-6bba565c9461 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:15.900217 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eb39ee9a-7c1b-4098-a6f3-6bba565c9461 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:15.901021 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eb39ee9a-7c1b-4098-a6f3-6bba565c9461 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:15.904896 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eb39ee9a-7c1b-4098-a6f3-6bba565c9461 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:15.908495 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eb39ee9a-7c1b-4098-a6f3-6bba565c9461 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:15.909726 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eb39ee9a-7c1b-4098-a6f3-6bba565c9461 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:16.826602 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-5bdf41b7-e127-4b6f-aa72-7ada6e037672 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:16.841957 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-5bdf41b7-e127-4b6f-aa72-7ada6e037672 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:16.843780 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-5bdf41b7-e127-4b6f-aa72-7ada6e037672 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:16.848796 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-5bdf41b7-e127-4b6f-aa72-7ada6e037672 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/f620f083-7230-471a-87d0-f6d85f8ad087" status: 200 len: 1487 microversion: 2.25 time: 1.097224 Aug 27 02:46:16.851453 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 701/1416] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:46:15 2022] GET /compute/v2.1/servers/f620f083-7230-471a-87d0-f6d85f8ad087 => generated 1487 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:46:16.865769 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-740ecb31-c582-4494-a6c2-b7050108666a tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:16.866555 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-740ecb31-c582-4494-a6c2-b7050108666a tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: eb11f5d3-ce63-461d-a83f-04f33ce7c16b] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:16.873255 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-740ecb31-c582-4494-a6c2-b7050108666a tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:16.873758 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-740ecb31-c582-4494-a6c2-b7050108666a tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:16.874189 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-740ecb31-c582-4494-a6c2-b7050108666a tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:16.874905 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-740ecb31-c582-4494-a6c2-b7050108666a tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:16.875450 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-740ecb31-c582-4494-a6c2-b7050108666a tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:16.875775 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-740ecb31-c582-4494-a6c2-b7050108666a tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:16.967237 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-eb39ee9a-7c1b-4098-a6f3-6bba565c9461 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:16.993086 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-eb39ee9a-7c1b-4098-a6f3-6bba565c9461 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b" status: 200 len: 1390 microversion: 2.1 time: 1.123570 Aug 27 02:46:17.006047 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 716/1417] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:15 2022] GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b => generated 1390 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:17.020170 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a0084bc4-3def-4ed7-8a0c-3cc3558e51b8 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:17.021161 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-a0084bc4-3def-4ed7-8a0c-3cc3558e51b8 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] [instance: 4b798950-60e1-4097-a7e0-365dd0976cb5] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:17.028829 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a0084bc4-3def-4ed7-8a0c-3cc3558e51b8 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:17.029695 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a0084bc4-3def-4ed7-8a0c-3cc3558e51b8 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:17.030431 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a0084bc4-3def-4ed7-8a0c-3cc3558e51b8 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:17.032159 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a0084bc4-3def-4ed7-8a0c-3cc3558e51b8 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:17.032969 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a0084bc4-3def-4ed7-8a0c-3cc3558e51b8 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:17.033723 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a0084bc4-3def-4ed7-8a0c-3cc3558e51b8 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:17.305880 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-740ecb31-c582-4494-a6c2-b7050108666a tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6d1646ec094e3297f6f3c51dd72e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b105816fd4e54b9da4973ff721e1fb92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:17.319096 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-740ecb31-c582-4494-a6c2-b7050108666a tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "GET /compute/v2.1/servers/eb11f5d3-ce63-461d-a83f-04f33ce7c16b" status: 200 len: 1317 microversion: 2.1 time: 0.466304 Aug 27 02:46:17.319702 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 702/1418] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:16 2022] GET /compute/v2.1/servers/eb11f5d3-ce63-461d-a83f-04f33ce7c16b => generated 1317 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:17.334171 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-621925fc-2065-4a3d-bc54-6db8b435509c tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:17.336690 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-621925fc-2065-4a3d-bc54-6db8b435509c tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] [instance: 484e03a9-aef3-4179-980c-0e7292a05b5a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:17.361946 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-621925fc-2065-4a3d-bc54-6db8b435509c tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:17.362449 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-621925fc-2065-4a3d-bc54-6db8b435509c tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:17.362888 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-621925fc-2065-4a3d-bc54-6db8b435509c tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:17.363616 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-621925fc-2065-4a3d-bc54-6db8b435509c tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:17.364070 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-621925fc-2065-4a3d-bc54-6db8b435509c tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:17.364594 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-621925fc-2065-4a3d-bc54-6db8b435509c tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:17.771937 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-a0084bc4-3def-4ed7-8a0c-3cc3558e51b8 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e86c17fe83848e2bc96b7c83ff1cf14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5668e6d96694c62b83f7e8381fe86e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:17.781045 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a0084bc4-3def-4ed7-8a0c-3cc3558e51b8 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] 10.222.0.70 "GET /compute/v2.1/servers/4b798950-60e1-4097-a7e0-365dd0976cb5" status: 200 len: 1540 microversion: 2.1 time: 0.768256 Aug 27 02:46:17.781872 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 717/1419] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:17 2022] GET /compute/v2.1/servers/4b798950-60e1-4097-a7e0-365dd0976cb5 => generated 1540 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:17.873814 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8a0c100d-b6b5-4e3c-8f90-99997928993c tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:17.874684 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-8a0c100d-b6b5-4e3c-8f90-99997928993c tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: f620f083-7230-471a-87d0-f6d85f8ad087] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:17.882000 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8a0c100d-b6b5-4e3c-8f90-99997928993c tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:17.882797 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8a0c100d-b6b5-4e3c-8f90-99997928993c tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:17.883425 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8a0c100d-b6b5-4e3c-8f90-99997928993c tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:17.884473 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8a0c100d-b6b5-4e3c-8f90-99997928993c tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:17.885090 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8a0c100d-b6b5-4e3c-8f90-99997928993c tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:17.885681 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8a0c100d-b6b5-4e3c-8f90-99997928993c tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:17.910147 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-621925fc-2065-4a3d-bc54-6db8b435509c tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:17.931109 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-621925fc-2065-4a3d-bc54-6db8b435509c tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:17.933409 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-621925fc-2065-4a3d-bc54-6db8b435509c tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:17.942596 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-621925fc-2065-4a3d-bc54-6db8b435509c tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] 10.222.0.70 "GET /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a" status: 200 len: 1875 microversion: 2.42 time: 0.621827 Aug 27 02:46:17.943422 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 703/1420] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:46:17 2022] GET /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a => generated 1875 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:46:18.021878 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a715f880-0c82-4896-94cc-48653863e9a8 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:18.022730 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a715f880-0c82-4896-94cc-48653863e9a8 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 70acfe32-deea-46fc-a214-8fdbb9f6cb7b] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:18.027041 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:UPDATE=1,nova_api:SELECT=96,nova_api:INSERT=3 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:46:18.049619 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a715f880-0c82-4896-94cc-48653863e9a8 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:18.050226 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a715f880-0c82-4896-94cc-48653863e9a8 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:18.051212 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a715f880-0c82-4896-94cc-48653863e9a8 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:18.051952 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a715f880-0c82-4896-94cc-48653863e9a8 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:18.052488 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a715f880-0c82-4896-94cc-48653863e9a8 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:18.054900 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a715f880-0c82-4896-94cc-48653863e9a8 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:18.332788 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-a715f880-0c82-4896-94cc-48653863e9a8 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:18.344511 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a715f880-0c82-4896-94cc-48653863e9a8 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b" status: 200 len: 1390 microversion: 2.1 time: 0.326354 Aug 27 02:46:18.345660 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 704/1421] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:18 2022] GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b => generated 1390 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:18.350581 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d12396db-2adf-47ad-bd44-9c913418c06d tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:18.351195 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d12396db-2adf-47ad-bd44-9c913418c06d tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: eb11f5d3-ce63-461d-a83f-04f33ce7c16b] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:18.365813 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d12396db-2adf-47ad-bd44-9c913418c06d tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:18.366616 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d12396db-2adf-47ad-bd44-9c913418c06d tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:18.367223 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d12396db-2adf-47ad-bd44-9c913418c06d tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:18.368824 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d12396db-2adf-47ad-bd44-9c913418c06d tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:18.369540 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d12396db-2adf-47ad-bd44-9c913418c06d tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:18.373997 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d12396db-2adf-47ad-bd44-9c913418c06d tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:18.403459 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-8a0c100d-b6b5-4e3c-8f90-99997928993c tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:18.418373 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-8a0c100d-b6b5-4e3c-8f90-99997928993c tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:18.419965 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-8a0c100d-b6b5-4e3c-8f90-99997928993c tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:18.421420 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-8a0c100d-b6b5-4e3c-8f90-99997928993c tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/f620f083-7230-471a-87d0-f6d85f8ad087" status: 200 len: 1487 microversion: 2.25 time: 0.551757 Aug 27 02:46:18.423401 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 718/1422] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:46:17 2022] GET /compute/v2.1/servers/f620f083-7230-471a-87d0-f6d85f8ad087 => generated 1487 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:46:18.632121 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-d12396db-2adf-47ad-bd44-9c913418c06d tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6d1646ec094e3297f6f3c51dd72e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b105816fd4e54b9da4973ff721e1fb92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:18.640891 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d12396db-2adf-47ad-bd44-9c913418c06d tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "GET /compute/v2.1/servers/eb11f5d3-ce63-461d-a83f-04f33ce7c16b" status: 200 len: 1466 microversion: 2.1 time: 0.294117 Aug 27 02:46:18.642083 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 705/1423] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:18 2022] GET /compute/v2.1/servers/eb11f5d3-ce63-461d-a83f-04f33ce7c16b => generated 1466 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:18.662204 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e88e999d-a8db-4bbe-ac7f-27f83be1374d tempest-ServersOnMultiNodesTest-986315705 tempest-ServersOnMultiNodesTest-986315705-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:18.663559 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-e88e999d-a8db-4bbe-ac7f-27f83be1374d tempest-ServersOnMultiNodesTest-986315705 tempest-ServersOnMultiNodesTest-986315705-project-admin] [instance: eb11f5d3-ce63-461d-a83f-04f33ce7c16b] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:18.671568 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e88e999d-a8db-4bbe-ac7f-27f83be1374d tempest-ServersOnMultiNodesTest-986315705 tempest-ServersOnMultiNodesTest-986315705-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:18.672471 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e88e999d-a8db-4bbe-ac7f-27f83be1374d tempest-ServersOnMultiNodesTest-986315705 tempest-ServersOnMultiNodesTest-986315705-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:18.673055 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e88e999d-a8db-4bbe-ac7f-27f83be1374d tempest-ServersOnMultiNodesTest-986315705 tempest-ServersOnMultiNodesTest-986315705-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:18.674012 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e88e999d-a8db-4bbe-ac7f-27f83be1374d tempest-ServersOnMultiNodesTest-986315705 tempest-ServersOnMultiNodesTest-986315705-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:18.674614 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e88e999d-a8db-4bbe-ac7f-27f83be1374d tempest-ServersOnMultiNodesTest-986315705 tempest-ServersOnMultiNodesTest-986315705-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:18.675227 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e88e999d-a8db-4bbe-ac7f-27f83be1374d tempest-ServersOnMultiNodesTest-986315705 tempest-ServersOnMultiNodesTest-986315705-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:18.806981 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a356b555-6710-43e6-bd48-001d9f17f980 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:18.807842 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a356b555-6710-43e6-bd48-001d9f17f980 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] [instance: 4b798950-60e1-4097-a7e0-365dd0976cb5] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:18.822611 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a356b555-6710-43e6-bd48-001d9f17f980 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:18.823441 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a356b555-6710-43e6-bd48-001d9f17f980 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:18.824006 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a356b555-6710-43e6-bd48-001d9f17f980 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:18.826813 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a356b555-6710-43e6-bd48-001d9f17f980 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:18.828897 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a356b555-6710-43e6-bd48-001d9f17f980 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:18.829335 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a356b555-6710-43e6-bd48-001d9f17f980 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:18.866996 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e88e999d-a8db-4bbe-ac7f-27f83be1374d tempest-ServersOnMultiNodesTest-986315705 tempest-ServersOnMultiNodesTest-986315705-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/eb11f5d3-ce63-461d-a83f-04f33ce7c16b" status: 200 len: 1617 microversion: 2.1 time: 0.208806 Aug 27 02:46:18.867839 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 719/1424] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:18 2022] GET /compute/v2.1/servers/eb11f5d3-ce63-461d-a83f-04f33ce7c16b => generated 1617 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:46:18.905394 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-cc64cf97-e5d8-43d7-aca6-c3500dc83f04 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:18.906278 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-cc64cf97-e5d8-43d7-aca6-c3500dc83f04 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: eb11f5d3-ce63-461d-a83f-04f33ce7c16b] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:18.918613 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cc64cf97-e5d8-43d7-aca6-c3500dc83f04 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:18.919399 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cc64cf97-e5d8-43d7-aca6-c3500dc83f04 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:18.920041 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cc64cf97-e5d8-43d7-aca6-c3500dc83f04 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:18.920954 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cc64cf97-e5d8-43d7-aca6-c3500dc83f04 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:18.922729 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cc64cf97-e5d8-43d7-aca6-c3500dc83f04 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:18.923372 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cc64cf97-e5d8-43d7-aca6-c3500dc83f04 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:18.987604 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-cc64cf97-e5d8-43d7-aca6-c3500dc83f04 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: eb11f5d3-ce63-461d-a83f-04f33ce7c16b] Going to try to terminate instance {{(pid=134051) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:46:19.137518 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-cc64cf97-e5d8-43d7-aca6-c3500dc83f04 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "DELETE /compute/v2.1/servers/eb11f5d3-ce63-461d-a83f-04f33ce7c16b" status: 204 len: 0 microversion: 2.1 time: 0.232928 Aug 27 02:46:19.138730 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 720/1425] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:46:18 2022] DELETE /compute/v2.1/servers/eb11f5d3-ce63-461d-a83f-04f33ce7c16b => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:46:19.152372 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ea621112-b3e8-4735-96ad-9c02ff6b8b4a tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:19.156499 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-ea621112-b3e8-4735-96ad-9c02ff6b8b4a tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] [instance: 484e03a9-aef3-4179-980c-0e7292a05b5a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:19.172088 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ea621112-b3e8-4735-96ad-9c02ff6b8b4a tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:19.172631 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ea621112-b3e8-4735-96ad-9c02ff6b8b4a tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:19.176068 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ea621112-b3e8-4735-96ad-9c02ff6b8b4a tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:19.176925 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ea621112-b3e8-4735-96ad-9c02ff6b8b4a tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:19.177337 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ea621112-b3e8-4735-96ad-9c02ff6b8b4a tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:19.178843 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ea621112-b3e8-4735-96ad-9c02ff6b8b4a tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:19.220375 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-a356b555-6710-43e6-bd48-001d9f17f980 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e86c17fe83848e2bc96b7c83ff1cf14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5668e6d96694c62b83f7e8381fe86e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:19.230869 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a356b555-6710-43e6-bd48-001d9f17f980 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] 10.222.0.70 "GET /compute/v2.1/servers/4b798950-60e1-4097-a7e0-365dd0976cb5" status: 200 len: 1535 microversion: 2.1 time: 0.428619 Aug 27 02:46:19.232139 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 706/1426] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:18 2022] GET /compute/v2.1/servers/4b798950-60e1-4097-a7e0-365dd0976cb5 => generated 1535 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:19.237554 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-93bb9cbd-fa23-4ad9-923b-c46a857621f8 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:19.238365 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-93bb9cbd-fa23-4ad9-923b-c46a857621f8 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: eb11f5d3-ce63-461d-a83f-04f33ce7c16b] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:19.251861 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-93bb9cbd-fa23-4ad9-923b-c46a857621f8 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:19.252468 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-93bb9cbd-fa23-4ad9-923b-c46a857621f8 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:19.253121 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-93bb9cbd-fa23-4ad9-923b-c46a857621f8 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:19.254049 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-93bb9cbd-fa23-4ad9-923b-c46a857621f8 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:19.254682 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-93bb9cbd-fa23-4ad9-923b-c46a857621f8 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:19.255433 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-93bb9cbd-fa23-4ad9-923b-c46a857621f8 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:19.623670 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-ea621112-b3e8-4735-96ad-9c02ff6b8b4a tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:19.633515 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-ea621112-b3e8-4735-96ad-9c02ff6b8b4a tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:19.635248 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-ea621112-b3e8-4735-96ad-9c02ff6b8b4a tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:19.636643 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ea621112-b3e8-4735-96ad-9c02ff6b8b4a tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] 10.222.0.70 "GET /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a" status: 200 len: 1875 microversion: 2.42 time: 0.496063 Aug 27 02:46:19.637399 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 721/1427] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:46:19 2022] GET /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a => generated 1875 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:46:19.642711 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b191ac29-6aec-488c-96e4-9e8ce87dcfd3 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:19.643696 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b191ac29-6aec-488c-96e4-9e8ce87dcfd3 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 70acfe32-deea-46fc-a214-8fdbb9f6cb7b] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:19.650546 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b191ac29-6aec-488c-96e4-9e8ce87dcfd3 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:19.651270 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b191ac29-6aec-488c-96e4-9e8ce87dcfd3 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:19.651899 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b191ac29-6aec-488c-96e4-9e8ce87dcfd3 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:19.658051 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b191ac29-6aec-488c-96e4-9e8ce87dcfd3 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:19.658826 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b191ac29-6aec-488c-96e4-9e8ce87dcfd3 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:19.659462 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b191ac29-6aec-488c-96e4-9e8ce87dcfd3 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:19.713137 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-93bb9cbd-fa23-4ad9-923b-c46a857621f8 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6d1646ec094e3297f6f3c51dd72e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b105816fd4e54b9da4973ff721e1fb92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:19.728364 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-93bb9cbd-fa23-4ad9-923b-c46a857621f8 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "GET /compute/v2.1/servers/eb11f5d3-ce63-461d-a83f-04f33ce7c16b" status: 200 len: 1472 microversion: 2.1 time: 0.494776 Aug 27 02:46:19.729087 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 707/1428] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:19 2022] GET /compute/v2.1/servers/eb11f5d3-ce63-461d-a83f-04f33ce7c16b => generated 1472 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:19.734060 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-90db89ac-170e-4429-a1ff-744785725f56 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:19.736951 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-90db89ac-170e-4429-a1ff-744785725f56 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: f620f083-7230-471a-87d0-f6d85f8ad087] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:19.752930 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-90db89ac-170e-4429-a1ff-744785725f56 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:19.753947 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-90db89ac-170e-4429-a1ff-744785725f56 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:19.754401 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-90db89ac-170e-4429-a1ff-744785725f56 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:19.755409 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-90db89ac-170e-4429-a1ff-744785725f56 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:19.756077 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-90db89ac-170e-4429-a1ff-744785725f56 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:19.756883 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-90db89ac-170e-4429-a1ff-744785725f56 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:19.974386 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-b191ac29-6aec-488c-96e4-9e8ce87dcfd3 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:19.993286 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b191ac29-6aec-488c-96e4-9e8ce87dcfd3 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b" status: 200 len: 1390 microversion: 2.1 time: 0.354446 Aug 27 02:46:20.007934 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 722/1429] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:19 2022] GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b => generated 1390 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:20.014868 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-92050162-e296-4c74-ac73-12ea92f0a25f req-4d37547d-a09d-4e37-b4db-cb3195e1943d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b798950-60e1-4097-a7e0-365dd0976cb5", "name": "network-vif-plugged", "status": "completed", "tag": "0f6894dc-0ae0-41d0-a29d-eb2fa732abbd"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:46:20.025676 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-92050162-e296-4c74-ac73-12ea92f0a25f req-4d37547d-a09d-4e37-b4db-cb3195e1943d service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:20.026494 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-92050162-e296-4c74-ac73-12ea92f0a25f req-4d37547d-a09d-4e37-b4db-cb3195e1943d service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:20.027131 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-92050162-e296-4c74-ac73-12ea92f0a25f req-4d37547d-a09d-4e37-b4db-cb3195e1943d service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:20.039793 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-92050162-e296-4c74-ac73-12ea92f0a25f req-4d37547d-a09d-4e37-b4db-cb3195e1943d service nova] Creating event network-vif-plugged:0f6894dc-0ae0-41d0-a29d-eb2fa732abbd for instance 4b798950-60e1-4097-a7e0-365dd0976cb5 on n-h1-852278-4 Aug 27 02:46:20.046519 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-90db89ac-170e-4429-a1ff-744785725f56 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:20.058301 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-92050162-e296-4c74-ac73-12ea92f0a25f req-4d37547d-a09d-4e37-b4db-cb3195e1943d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050159 Aug 27 02:46:20.058976 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-90db89ac-170e-4429-a1ff-744785725f56 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:20.063088 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 723/1430] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:46:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:46:20.063720 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-90db89ac-170e-4429-a1ff-744785725f56 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:20.066505 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-90db89ac-170e-4429-a1ff-744785725f56 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/f620f083-7230-471a-87d0-f6d85f8ad087" status: 200 len: 1487 microversion: 2.25 time: 0.335804 Aug 27 02:46:20.067018 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 708/1431] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:46:19 2022] GET /compute/v2.1/servers/f620f083-7230-471a-87d0-f6d85f8ad087 => generated 1487 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:46:20.254196 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-75ccef93-640e-4a3c-ab3d-31eca1b4c66c tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:20.254908 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-75ccef93-640e-4a3c-ab3d-31eca1b4c66c tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] [instance: 4b798950-60e1-4097-a7e0-365dd0976cb5] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:20.262424 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-75ccef93-640e-4a3c-ab3d-31eca1b4c66c tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:20.264067 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-75ccef93-640e-4a3c-ab3d-31eca1b4c66c tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:20.264820 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-75ccef93-640e-4a3c-ab3d-31eca1b4c66c tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:20.266163 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-75ccef93-640e-4a3c-ab3d-31eca1b4c66c tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:20.266863 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-75ccef93-640e-4a3c-ab3d-31eca1b4c66c tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:20.267354 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-75ccef93-640e-4a3c-ab3d-31eca1b4c66c tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:20.464005 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-75ccef93-640e-4a3c-ab3d-31eca1b4c66c tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e86c17fe83848e2bc96b7c83ff1cf14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5668e6d96694c62b83f7e8381fe86e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:20.468124 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:46:20.474803 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-75ccef93-640e-4a3c-ab3d-31eca1b4c66c tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] 10.222.0.70 "GET /compute/v2.1/servers/4b798950-60e1-4097-a7e0-365dd0976cb5" status: 200 len: 1522 microversion: 2.1 time: 0.225740 Aug 27 02:46:20.475587 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 724/1432] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:20 2022] GET /compute/v2.1/servers/4b798950-60e1-4097-a7e0-365dd0976cb5 => generated 1522 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:20.495202 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4d440b52-d61e-47de-8ce3-133d2634edff tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:20.495779 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-4d440b52-d61e-47de-8ce3-133d2634edff tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] [instance: 4b798950-60e1-4097-a7e0-365dd0976cb5] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:20.501953 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4d440b52-d61e-47de-8ce3-133d2634edff tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:20.502749 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4d440b52-d61e-47de-8ce3-133d2634edff tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:20.503431 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4d440b52-d61e-47de-8ce3-133d2634edff tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:20.504186 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4d440b52-d61e-47de-8ce3-133d2634edff tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:20.504898 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4d440b52-d61e-47de-8ce3-133d2634edff tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:20.505407 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4d440b52-d61e-47de-8ce3-133d2634edff tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:20.545890 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-4d440b52-d61e-47de-8ce3-133d2634edff tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] [instance: 4b798950-60e1-4097-a7e0-365dd0976cb5] Going to try to terminate instance {{(pid=134052) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:46:20.651890 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-4d440b52-d61e-47de-8ce3-133d2634edff tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] 10.222.0.70 "DELETE /compute/v2.1/servers/4b798950-60e1-4097-a7e0-365dd0976cb5" status: 204 len: 0 microversion: 2.1 time: 0.159750 Aug 27 02:46:20.655822 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 709/1433] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:46:20 2022] DELETE /compute/v2.1/servers/4b798950-60e1-4097-a7e0-365dd0976cb5 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:46:20.661558 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7064b607-abeb-49d0-9bc3-d639c8d07fc2 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:20.662310 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-7064b607-abeb-49d0-9bc3-d639c8d07fc2 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] [instance: 484e03a9-aef3-4179-980c-0e7292a05b5a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:20.662445 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-64ac3998-1f7f-4990-a590-3f938a9d9f30 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:20.663052 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-64ac3998-1f7f-4990-a590-3f938a9d9f30 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] [instance: 4b798950-60e1-4097-a7e0-365dd0976cb5] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:20.672062 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-64ac3998-1f7f-4990-a590-3f938a9d9f30 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:20.672637 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-64ac3998-1f7f-4990-a590-3f938a9d9f30 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:20.673098 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-64ac3998-1f7f-4990-a590-3f938a9d9f30 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:20.674546 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-64ac3998-1f7f-4990-a590-3f938a9d9f30 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:20.675388 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-64ac3998-1f7f-4990-a590-3f938a9d9f30 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:20.675982 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-64ac3998-1f7f-4990-a590-3f938a9d9f30 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:20.676150 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7064b607-abeb-49d0-9bc3-d639c8d07fc2 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:20.676675 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7064b607-abeb-49d0-9bc3-d639c8d07fc2 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:20.677124 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7064b607-abeb-49d0-9bc3-d639c8d07fc2 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:20.677829 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7064b607-abeb-49d0-9bc3-d639c8d07fc2 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:20.678274 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7064b607-abeb-49d0-9bc3-d639c8d07fc2 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:20.682873 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7064b607-abeb-49d0-9bc3-d639c8d07fc2 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:21.087388 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-64ac3998-1f7f-4990-a590-3f938a9d9f30 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e86c17fe83848e2bc96b7c83ff1cf14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5668e6d96694c62b83f7e8381fe86e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:21.097420 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-64ac3998-1f7f-4990-a590-3f938a9d9f30 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] 10.222.0.70 "GET /compute/v2.1/servers/4b798950-60e1-4097-a7e0-365dd0976cb5" status: 200 len: 1528 microversion: 2.1 time: 0.439600 Aug 27 02:46:21.098772 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 710/1434] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:20 2022] GET /compute/v2.1/servers/4b798950-60e1-4097-a7e0-365dd0976cb5 => generated 1528 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:21.103817 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f1bb1ec1-d468-4dd0-9a0d-617935272e7a tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:21.104771 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-f1bb1ec1-d468-4dd0-9a0d-617935272e7a tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: eb11f5d3-ce63-461d-a83f-04f33ce7c16b] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:21.114043 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f1bb1ec1-d468-4dd0-9a0d-617935272e7a tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:21.114534 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f1bb1ec1-d468-4dd0-9a0d-617935272e7a tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:21.116876 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f1bb1ec1-d468-4dd0-9a0d-617935272e7a tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:21.118009 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f1bb1ec1-d468-4dd0-9a0d-617935272e7a tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:21.119248 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f1bb1ec1-d468-4dd0-9a0d-617935272e7a tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:21.119896 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f1bb1ec1-d468-4dd0-9a0d-617935272e7a tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:21.273483 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-7064b607-abeb-49d0-9bc3-d639c8d07fc2 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:21.291389 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-7064b607-abeb-49d0-9bc3-d639c8d07fc2 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:21.294111 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-7064b607-abeb-49d0-9bc3-d639c8d07fc2 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:21.298296 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-7064b607-abeb-49d0-9bc3-d639c8d07fc2 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] 10.222.0.70 "GET /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a" status: 200 len: 1875 microversion: 2.42 time: 0.639444 Aug 27 02:46:21.299153 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 725/1435] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:46:20 2022] GET /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a => generated 1875 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:46:21.304605 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c484e7be-e2a8-4e69-863c-a4efea0bde66 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5fd52db8-e8d9-48c2-9e84-26ab53a2f631"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:46:21.307902 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-c484e7be-e2a8-4e69-863c-a4efea0bde66 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] [instance: 582ea86f-befd-4c47-95d9-2eba872eb8c8] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:21.317179 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c484e7be-e2a8-4e69-863c-a4efea0bde66 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:21.318377 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c484e7be-e2a8-4e69-863c-a4efea0bde66 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:21.320335 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c484e7be-e2a8-4e69-863c-a4efea0bde66 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:21.321593 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c484e7be-e2a8-4e69-863c-a4efea0bde66 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:21.322287 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c484e7be-e2a8-4e69-863c-a4efea0bde66 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:21.322923 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c484e7be-e2a8-4e69-863c-a4efea0bde66 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:21.864096 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-f1bb1ec1-d468-4dd0-9a0d-617935272e7a tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6d1646ec094e3297f6f3c51dd72e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b105816fd4e54b9da4973ff721e1fb92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:21.876932 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f1bb1ec1-d468-4dd0-9a0d-617935272e7a tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "GET /compute/v2.1/servers/eb11f5d3-ce63-461d-a83f-04f33ce7c16b" status: 200 len: 1472 microversion: 2.1 time: 0.776885 Aug 27 02:46:21.878256 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 711/1436] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:21 2022] GET /compute/v2.1/servers/eb11f5d3-ce63-461d-a83f-04f33ce7c16b => generated 1472 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:21.884634 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a674ec76-9613-405b-a456-cea39e639d9d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:21.886461 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a674ec76-9613-405b-a456-cea39e639d9d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 70acfe32-deea-46fc-a214-8fdbb9f6cb7b] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:21.897933 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a674ec76-9613-405b-a456-cea39e639d9d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:21.899395 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a674ec76-9613-405b-a456-cea39e639d9d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:21.900066 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a674ec76-9613-405b-a456-cea39e639d9d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:21.901360 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a674ec76-9613-405b-a456-cea39e639d9d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:21.902042 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a674ec76-9613-405b-a456-cea39e639d9d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:21.902951 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a674ec76-9613-405b-a456-cea39e639d9d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:22.244160 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-a674ec76-9613-405b-a456-cea39e639d9d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:22.252460 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a674ec76-9613-405b-a456-cea39e639d9d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b" status: 200 len: 1390 microversion: 2.1 time: 0.372776 Aug 27 02:46:22.253030 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 712/1437] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:21 2022] GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b => generated 1390 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:22.261790 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0cca97fa-5e1c-4409-a561-17e6f50ee07c tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:22.262582 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-0cca97fa-5e1c-4409-a561-17e6f50ee07c tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: f620f083-7230-471a-87d0-f6d85f8ad087] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:22.270390 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0cca97fa-5e1c-4409-a561-17e6f50ee07c tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:22.271119 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0cca97fa-5e1c-4409-a561-17e6f50ee07c tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:22.272338 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0cca97fa-5e1c-4409-a561-17e6f50ee07c tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:22.275095 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0cca97fa-5e1c-4409-a561-17e6f50ee07c tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:22.277732 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0cca97fa-5e1c-4409-a561-17e6f50ee07c tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:22.278692 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0cca97fa-5e1c-4409-a561-17e6f50ee07c tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:22.519266 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c484e7be-e2a8-4e69-863c-a4efea0bde66 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] 10.222.0.70 "POST /compute/v2.1/servers/582ea86f-befd-4c47-95d9-2eba872eb8c8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.218474 Aug 27 02:46:22.524434 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 726/1438] 10.222.0.70 () {60 vars in 1323 bytes} [Sat Aug 27 02:46:21 2022] POST /compute/v2.1/servers/582ea86f-befd-4c47-95d9-2eba872eb8c8/os-volume_attachments => generated 194 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:46:22.529264 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-2e16d4c4-a4bf-442f-bd59-9db37a65ad68 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:22.529975 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-2e16d4c4-a4bf-442f-bd59-9db37a65ad68 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] [instance: 4b798950-60e1-4097-a7e0-365dd0976cb5] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:22.542462 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2e16d4c4-a4bf-442f-bd59-9db37a65ad68 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:22.542972 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2e16d4c4-a4bf-442f-bd59-9db37a65ad68 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:22.543410 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2e16d4c4-a4bf-442f-bd59-9db37a65ad68 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:22.544435 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2e16d4c4-a4bf-442f-bd59-9db37a65ad68 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:22.551147 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2e16d4c4-a4bf-442f-bd59-9db37a65ad68 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:22.551930 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2e16d4c4-a4bf-442f-bd59-9db37a65ad68 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:22.848685 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0cca97fa-5e1c-4409-a561-17e6f50ee07c tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:22.870326 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0cca97fa-5e1c-4409-a561-17e6f50ee07c tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:22.872103 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0cca97fa-5e1c-4409-a561-17e6f50ee07c tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:22.876911 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-0cca97fa-5e1c-4409-a561-17e6f50ee07c tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/f620f083-7230-471a-87d0-f6d85f8ad087" status: 200 len: 1487 microversion: 2.25 time: 0.618534 Aug 27 02:46:22.892349 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 713/1439] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:46:22 2022] GET /compute/v2.1/servers/f620f083-7230-471a-87d0-f6d85f8ad087 => generated 1487 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:46:22.895111 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-48e0a776-78ba-46cb-acf7-32a7aef53b3e tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:22.896711 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-48e0a776-78ba-46cb-acf7-32a7aef53b3e tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] [instance: 484e03a9-aef3-4179-980c-0e7292a05b5a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:22.913268 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-48e0a776-78ba-46cb-acf7-32a7aef53b3e tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:22.916149 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-48e0a776-78ba-46cb-acf7-32a7aef53b3e tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:22.925200 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-48e0a776-78ba-46cb-acf7-32a7aef53b3e tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:22.925200 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-48e0a776-78ba-46cb-acf7-32a7aef53b3e tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:22.925200 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-48e0a776-78ba-46cb-acf7-32a7aef53b3e tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:22.925200 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-48e0a776-78ba-46cb-acf7-32a7aef53b3e tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:23.296349 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-2e16d4c4-a4bf-442f-bd59-9db37a65ad68 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e86c17fe83848e2bc96b7c83ff1cf14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5668e6d96694c62b83f7e8381fe86e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:23.308628 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-2e16d4c4-a4bf-442f-bd59-9db37a65ad68 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] 10.222.0.70 "GET /compute/v2.1/servers/4b798950-60e1-4097-a7e0-365dd0976cb5" status: 200 len: 1528 microversion: 2.1 time: 0.783781 Aug 27 02:46:23.312815 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 727/1440] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:22 2022] GET /compute/v2.1/servers/4b798950-60e1-4097-a7e0-365dd0976cb5 => generated 1528 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:23.322328 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7cc7f6be-e101-4179-8aff-1561a97f93f6 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:23.323202 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-7cc7f6be-e101-4179-8aff-1561a97f93f6 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: eb11f5d3-ce63-461d-a83f-04f33ce7c16b] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:23.337681 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7cc7f6be-e101-4179-8aff-1561a97f93f6 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:23.338745 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7cc7f6be-e101-4179-8aff-1561a97f93f6 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:23.339384 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7cc7f6be-e101-4179-8aff-1561a97f93f6 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:23.340643 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7cc7f6be-e101-4179-8aff-1561a97f93f6 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:23.341954 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7cc7f6be-e101-4179-8aff-1561a97f93f6 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:23.342613 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7cc7f6be-e101-4179-8aff-1561a97f93f6 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:23.536073 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-7cc7f6be-e101-4179-8aff-1561a97f93f6 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6d1646ec094e3297f6f3c51dd72e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b105816fd4e54b9da4973ff721e1fb92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:23.551800 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-7cc7f6be-e101-4179-8aff-1561a97f93f6 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "GET /compute/v2.1/servers/eb11f5d3-ce63-461d-a83f-04f33ce7c16b" status: 200 len: 1430 microversion: 2.1 time: 0.233156 Aug 27 02:46:23.553093 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 728/1441] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:23 2022] GET /compute/v2.1/servers/eb11f5d3-ce63-461d-a83f-04f33ce7c16b => generated 1430 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:23.563603 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d2847587-775f-4dc0-bb49-fa75e3ecdca7 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:23.564504 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d2847587-775f-4dc0-bb49-fa75e3ecdca7 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 70acfe32-deea-46fc-a214-8fdbb9f6cb7b] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:23.576701 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d2847587-775f-4dc0-bb49-fa75e3ecdca7 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:23.581444 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d2847587-775f-4dc0-bb49-fa75e3ecdca7 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:23.582135 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d2847587-775f-4dc0-bb49-fa75e3ecdca7 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:23.584323 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d2847587-775f-4dc0-bb49-fa75e3ecdca7 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:23.584985 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d2847587-775f-4dc0-bb49-fa75e3ecdca7 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:23.586290 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d2847587-775f-4dc0-bb49-fa75e3ecdca7 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:23.912157 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-48e0a776-78ba-46cb-acf7-32a7aef53b3e tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:23.919469 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:46:23.930546 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-48e0a776-78ba-46cb-acf7-32a7aef53b3e tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:23.937086 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-48e0a776-78ba-46cb-acf7-32a7aef53b3e tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:23.938628 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-48e0a776-78ba-46cb-acf7-32a7aef53b3e tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] 10.222.0.70 "GET /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a" status: 200 len: 1875 microversion: 2.42 time: 1.055837 Aug 27 02:46:23.944816 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 714/1442] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:46:22 2022] GET /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a => generated 1875 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:46:23.952747 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-c84cd507-9200-4732-a3e5-8a3bd7288c1b req-56995d1f-03ab-4d30-837b-7389d6cc5e4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b798950-60e1-4097-a7e0-365dd0976cb5", "name": "network-vif-deleted", "tag": "0f6894dc-0ae0-41d0-a29d-eb2fa732abbd"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:46:23.975874 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-c84cd507-9200-4732-a3e5-8a3bd7288c1b req-56995d1f-03ab-4d30-837b-7389d6cc5e4b service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:23.980370 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-c84cd507-9200-4732-a3e5-8a3bd7288c1b req-56995d1f-03ab-4d30-837b-7389d6cc5e4b service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:23.981364 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-c84cd507-9200-4732-a3e5-8a3bd7288c1b req-56995d1f-03ab-4d30-837b-7389d6cc5e4b service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:24.032137 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-c84cd507-9200-4732-a3e5-8a3bd7288c1b req-56995d1f-03ab-4d30-837b-7389d6cc5e4b service nova] Creating event network-vif-deleted:0f6894dc-0ae0-41d0-a29d-eb2fa732abbd for instance 4b798950-60e1-4097-a7e0-365dd0976cb5 on n-h1-852278-4 Aug 27 02:46:24.053183 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-c84cd507-9200-4732-a3e5-8a3bd7288c1b req-56995d1f-03ab-4d30-837b-7389d6cc5e4b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105631 Aug 27 02:46:24.060366 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 715/1443] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:46:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:46:24.067812 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-df6ff575-08e1-4a88-a05b-7f5ef4cb67c7 req-37637019-e999-4da0-9c84-4daad0707a73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb11f5d3-ce63-461d-a83f-04f33ce7c16b", "name": "network-vif-deleted", "tag": "2bb69a1e-db5b-4c04-9ed8-8205dd668b84"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:46:24.082047 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d2847587-775f-4dc0-bb49-fa75e3ecdca7 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:24.090744 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d2847587-775f-4dc0-bb49-fa75e3ecdca7 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b" status: 200 len: 1390 microversion: 2.1 time: 0.536340 Aug 27 02:46:24.103252 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 729/1444] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:23 2022] GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b => generated 1390 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:24.108460 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4a83afc1-7d34-4ffb-80d5-045168b2b089 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:24.109077 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-4a83afc1-7d34-4ffb-80d5-045168b2b089 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: f620f083-7230-471a-87d0-f6d85f8ad087] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:24.111854 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-df6ff575-08e1-4a88-a05b-7f5ef4cb67c7 req-37637019-e999-4da0-9c84-4daad0707a73 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:24.120094 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-df6ff575-08e1-4a88-a05b-7f5ef4cb67c7 req-37637019-e999-4da0-9c84-4daad0707a73 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:24.120681 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-df6ff575-08e1-4a88-a05b-7f5ef4cb67c7 req-37637019-e999-4da0-9c84-4daad0707a73 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:24.126859 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4a83afc1-7d34-4ffb-80d5-045168b2b089 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:24.127356 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4a83afc1-7d34-4ffb-80d5-045168b2b089 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:24.127783 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4a83afc1-7d34-4ffb-80d5-045168b2b089 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:24.128598 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4a83afc1-7d34-4ffb-80d5-045168b2b089 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:24.129073 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4a83afc1-7d34-4ffb-80d5-045168b2b089 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:24.129492 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4a83afc1-7d34-4ffb-80d5-045168b2b089 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:24.151293 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-df6ff575-08e1-4a88-a05b-7f5ef4cb67c7 req-37637019-e999-4da0-9c84-4daad0707a73 service nova] Creating event network-vif-deleted:2bb69a1e-db5b-4c04-9ed8-8205dd668b84 for instance eb11f5d3-ce63-461d-a83f-04f33ce7c16b on n-h2-852278-4 Aug 27 02:46:24.167390 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-df6ff575-08e1-4a88-a05b-7f5ef4cb67c7 req-37637019-e999-4da0-9c84-4daad0707a73 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103737 Aug 27 02:46:24.171053 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 716/1445] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:46:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:46:24.335011 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-98013d18-a322-48d6-8576-66a068b9a5f0 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:24.336178 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-98013d18-a322-48d6-8576-66a068b9a5f0 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] [instance: 4b798950-60e1-4097-a7e0-365dd0976cb5] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:24.350631 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-98013d18-a322-48d6-8576-66a068b9a5f0 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:24.351135 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-98013d18-a322-48d6-8576-66a068b9a5f0 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:24.351565 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-98013d18-a322-48d6-8576-66a068b9a5f0 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:24.360378 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-98013d18-a322-48d6-8576-66a068b9a5f0 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:24.360995 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-98013d18-a322-48d6-8576-66a068b9a5f0 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:24.361566 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-98013d18-a322-48d6-8576-66a068b9a5f0 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:24.439876 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-98013d18-a322-48d6-8576-66a068b9a5f0 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:24.444969 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-98013d18-a322-48d6-8576-66a068b9a5f0 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:24.445468 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-98013d18-a322-48d6-8576-66a068b9a5f0 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:24.445948 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.instance [None req-98013d18-a322-48d6-8576-66a068b9a5f0 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lazy-loading 'fault' on Instance uuid 4b798950-60e1-4097-a7e0-365dd0976cb5 {{(pid=134052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:46:24.629849 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-98013d18-a322-48d6-8576-66a068b9a5f0 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e86c17fe83848e2bc96b7c83ff1cf14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5668e6d96694c62b83f7e8381fe86e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:24.643354 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-98013d18-a322-48d6-8576-66a068b9a5f0 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] 10.222.0.70 "GET /compute/v2.1/servers/4b798950-60e1-4097-a7e0-365dd0976cb5" status: 200 len: 1315 microversion: 2.1 time: 0.315028 Aug 27 02:46:24.644789 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 717/1446] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:24 2022] GET /compute/v2.1/servers/4b798950-60e1-4097-a7e0-365dd0976cb5 => generated 1315 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:46:24.656632 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-77a7f639-47bd-4447-9180-8d14f3eff50a tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:24.659975 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-77a7f639-47bd-4447-9180-8d14f3eff50a tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: eb11f5d3-ce63-461d-a83f-04f33ce7c16b] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:24.692574 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-77a7f639-47bd-4447-9180-8d14f3eff50a tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:24.693169 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-77a7f639-47bd-4447-9180-8d14f3eff50a tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:24.693789 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-77a7f639-47bd-4447-9180-8d14f3eff50a tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:24.694849 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-77a7f639-47bd-4447-9180-8d14f3eff50a tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:24.695466 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-77a7f639-47bd-4447-9180-8d14f3eff50a tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:24.696066 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-77a7f639-47bd-4447-9180-8d14f3eff50a tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:24.758431 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-77a7f639-47bd-4447-9180-8d14f3eff50a tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:24.760678 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-77a7f639-47bd-4447-9180-8d14f3eff50a tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:24.761183 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-77a7f639-47bd-4447-9180-8d14f3eff50a tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:24.761654 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.instance [None req-77a7f639-47bd-4447-9180-8d14f3eff50a tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lazy-loading 'fault' on Instance uuid eb11f5d3-ce63-461d-a83f-04f33ce7c16b {{(pid=134052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:46:24.955983 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-77a7f639-47bd-4447-9180-8d14f3eff50a tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6d1646ec094e3297f6f3c51dd72e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b105816fd4e54b9da4973ff721e1fb92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:24.966653 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-77a7f639-47bd-4447-9180-8d14f3eff50a tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "GET /compute/v2.1/servers/eb11f5d3-ce63-461d-a83f-04f33ce7c16b" status: 200 len: 1307 microversion: 2.1 time: 0.320210 Aug 27 02:46:24.978590 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-4a83afc1-7d34-4ffb-80d5-045168b2b089 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:24.983670 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 718/1447] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:24 2022] GET /compute/v2.1/servers/eb11f5d3-ce63-461d-a83f-04f33ce7c16b => generated 1307 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:24.989264 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3c5259e0-2fce-4074-97b1-71c0e11a1dbd tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:24.991780 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-4a83afc1-7d34-4ffb-80d5-045168b2b089 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:24.995171 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-4a83afc1-7d34-4ffb-80d5-045168b2b089 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:24.996630 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-4a83afc1-7d34-4ffb-80d5-045168b2b089 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/f620f083-7230-471a-87d0-f6d85f8ad087" status: 200 len: 1487 microversion: 2.25 time: 0.901235 Aug 27 02:46:25.002102 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-3c5259e0-2fce-4074-97b1-71c0e11a1dbd tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] [instance: 484e03a9-aef3-4179-980c-0e7292a05b5a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:25.006473 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 730/1448] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:46:24 2022] GET /compute/v2.1/servers/f620f083-7230-471a-87d0-f6d85f8ad087 => generated 1487 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:46:25.018739 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3c5259e0-2fce-4074-97b1-71c0e11a1dbd tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:25.019244 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3c5259e0-2fce-4074-97b1-71c0e11a1dbd tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:25.019687 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3c5259e0-2fce-4074-97b1-71c0e11a1dbd tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:25.020440 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3c5259e0-2fce-4074-97b1-71c0e11a1dbd tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:25.020892 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3c5259e0-2fce-4074-97b1-71c0e11a1dbd tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:25.021316 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3c5259e0-2fce-4074-97b1-71c0e11a1dbd tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:25.114889 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-163806b4-d146-4b48-b546-c24a575b3442 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:25.115814 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-163806b4-d146-4b48-b546-c24a575b3442 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 70acfe32-deea-46fc-a214-8fdbb9f6cb7b] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:25.126778 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-163806b4-d146-4b48-b546-c24a575b3442 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:25.128988 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-163806b4-d146-4b48-b546-c24a575b3442 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:25.130297 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-163806b4-d146-4b48-b546-c24a575b3442 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:25.133230 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-163806b4-d146-4b48-b546-c24a575b3442 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:25.134795 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-163806b4-d146-4b48-b546-c24a575b3442 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:25.135519 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-163806b4-d146-4b48-b546-c24a575b3442 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:25.476106 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-3c5259e0-2fce-4074-97b1-71c0e11a1dbd tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:25.510248 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-3c5259e0-2fce-4074-97b1-71c0e11a1dbd tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:25.514128 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-3c5259e0-2fce-4074-97b1-71c0e11a1dbd tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:25.522518 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-163806b4-d146-4b48-b546-c24a575b3442 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:25.524077 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-3c5259e0-2fce-4074-97b1-71c0e11a1dbd tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] 10.222.0.70 "GET /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a" status: 200 len: 1875 microversion: 2.42 time: 0.534635 Aug 27 02:46:25.535352 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 719/1449] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:46:24 2022] GET /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a => generated 1875 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:46:25.566853 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-163806b4-d146-4b48-b546-c24a575b3442 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b" status: 200 len: 1390 microversion: 2.1 time: 0.453607 Aug 27 02:46:25.567889 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 731/1450] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:25 2022] GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b => generated 1390 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:46:25.666181 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ac6fa92c-11bf-4049-b174-e6b8c8161cc7 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:25.666794 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-ac6fa92c-11bf-4049-b174-e6b8c8161cc7 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] [instance: 4b798950-60e1-4097-a7e0-365dd0976cb5] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:25.678224 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ac6fa92c-11bf-4049-b174-e6b8c8161cc7 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:25.678733 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ac6fa92c-11bf-4049-b174-e6b8c8161cc7 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:25.679178 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ac6fa92c-11bf-4049-b174-e6b8c8161cc7 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:25.689915 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ac6fa92c-11bf-4049-b174-e6b8c8161cc7 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:25.690803 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ac6fa92c-11bf-4049-b174-e6b8c8161cc7 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:25.691411 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ac6fa92c-11bf-4049-b174-e6b8c8161cc7 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:25.710347 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-ac6fa92c-11bf-4049-b174-e6b8c8161cc7 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] HTTP exception thrown: Instance 4b798950-60e1-4097-a7e0-365dd0976cb5 could not be found. Aug 27 02:46:25.720505 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ac6fa92c-11bf-4049-b174-e6b8c8161cc7 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Request method failure captured: Aug 27 02:46:25.720505 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/servers/4b798950-60e1-4097-a7e0-365dd0976cb5 HTTP/1.1 Aug 27 02:46:25.720505 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:46:25.720505 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:46:25.720505 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:46:25.720505 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:46:25.720505 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:46:25.720505 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:46:25.720505 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:46:25.720505 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:46:25.720505 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYUqULQp-YhXHHCl2hngi9BMJm7wP1pGZCcaxudoyUu4YXudXmRdmBYAkbX0-TS9pqFDwaRuY82uqdOXUJwRWB1ajZ46tfQo1tc4MJsIVgVqim1Pvb2Il-ejDehbyoer8P643aveyI0JrfbznxBx8aFYmMJz3n8FX81wfpLT5u3cMYE Aug 27 02:46:25.720505 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:46:25.720505 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:46:25.720505 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:46:25.720505 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:46:25.720505 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:46:25.720505 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:46:25.720505 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: f5668e6d96694c62b83f7e8381fe86e1 Aug 27 02:46:25.720505 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-94227302 Aug 27 02:46:25.720505 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:46:25.720505 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:46:25.722313 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f5668e6d96694c62b83f7e8381fe86e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f5668e6d96694c62b83f7e8381fe86e1", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f5668e6d96694c62b83f7e8381fe86e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f5668e6d96694c62b83f7e8381fe86e1"}]}] Aug 27 02:46:25.722313 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-94227302 Aug 27 02:46:25.722313 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: f5668e6d96694c62b83f7e8381fe86e1 Aug 27 02:46:25.722313 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-94227302 Aug 27 02:46:25.722313 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ImagesOneServerNegativeTestJSON-94227302-project Aug 27 02:46:25.722313 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:46:25.722313 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:46:25.722313 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 0e86c17fe83848e2bc96b7c83ff1cf14 Aug 27 02:46:25.722313 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-94227302-project Aug 27 02:46:25.722313 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 02:46:25.722313 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance 4b798950-60e1-4097-a7e0-365dd0976cb5 could not be found. Aug 27 02:46:25.722313 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '4b798950-60e1-4097-a7e0-365dd0976cb5'} Aug 27 02:46:25.723365 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:46:25.723365 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:46:25.723365 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:46:25.723365 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:46:25.723365 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:46:25.723365 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:46:25.723365 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:46:25.723365 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:46:25.723365 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:46:25.723365 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:46:25.723365 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b798950-60e1-4097-a7e0-365dd0976cb5 could not be found. Aug 27 02:46:25.723365 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:46:25.723365 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:46:25.723365 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:46:25.723365 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:46:25.723365 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:46:25.723365 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:46:25.723365 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:46:25.723365 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:46:25.723365 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:46:25.724984 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:46:25.724984 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:46:25.724984 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:46:25.724984 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:46:25.724984 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:46:25.724984 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:46:25.724984 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:46:25.724984 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b798950-60e1-4097-a7e0-365dd0976cb5 could not be found. Aug 27 02:46:25.724984 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:46:25.724984 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:46:25.724984 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:46:25.724984 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:46:25.724984 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:46:25.724984 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:46:25.724984 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:46:25.724984 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:46:25.724984 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b798950-60e1-4097-a7e0-365dd0976cb5 could not be found. Aug 27 02:46:25.724984 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:46:25.729286 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ac6fa92c-11bf-4049-b174-e6b8c8161cc7 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Returning 404 to user: Instance 4b798950-60e1-4097-a7e0-365dd0976cb5 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:46:25.730398 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ac6fa92c-11bf-4049-b174-e6b8c8161cc7 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] 10.222.0.70 "GET /compute/v2.1/servers/4b798950-60e1-4097-a7e0-365dd0976cb5" status: 404 len: 111 microversion: 2.1 time: 0.068666 Aug 27 02:46:25.734617 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 720/1451] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:25 2022] GET /compute/v2.1/servers/4b798950-60e1-4097-a7e0-365dd0976cb5 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:46:25.999050 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c77fda59-f82c-4fd3-b06b-84cd9509e4ea tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:25.999689 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-c77fda59-f82c-4fd3-b06b-84cd9509e4ea tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: eb11f5d3-ce63-461d-a83f-04f33ce7c16b] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:26.018048 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c77fda59-f82c-4fd3-b06b-84cd9509e4ea tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:26.018552 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c77fda59-f82c-4fd3-b06b-84cd9509e4ea tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:26.018990 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c77fda59-f82c-4fd3-b06b-84cd9509e4ea tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:26.019716 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c77fda59-f82c-4fd3-b06b-84cd9509e4ea tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:26.020169 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c77fda59-f82c-4fd3-b06b-84cd9509e4ea tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:26.020624 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c77fda59-f82c-4fd3-b06b-84cd9509e4ea tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:26.033563 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d4e26197-92bb-4868-afc3-7c77b381f508 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:26.036437 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d4e26197-92bb-4868-afc3-7c77b381f508 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: f620f083-7230-471a-87d0-f6d85f8ad087] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:26.072888 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d4e26197-92bb-4868-afc3-7c77b381f508 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:26.073391 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d4e26197-92bb-4868-afc3-7c77b381f508 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:26.073835 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d4e26197-92bb-4868-afc3-7c77b381f508 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:26.074563 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d4e26197-92bb-4868-afc3-7c77b381f508 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:26.075017 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d4e26197-92bb-4868-afc3-7c77b381f508 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:26.075455 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d4e26197-92bb-4868-afc3-7c77b381f508 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:26.076739 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-c77fda59-f82c-4fd3-b06b-84cd9509e4ea tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] HTTP exception thrown: Instance eb11f5d3-ce63-461d-a83f-04f33ce7c16b could not be found. Aug 27 02:46:26.085235 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c77fda59-f82c-4fd3-b06b-84cd9509e4ea tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Request method failure captured: Aug 27 02:46:26.085235 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/eb11f5d3-ce63-461d-a83f-04f33ce7c16b HTTP/1.1 Aug 27 02:46:26.085235 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:46:26.085235 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:46:26.085235 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:46:26.085235 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:46:26.085235 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:46:26.085235 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:46:26.085235 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:46:26.085235 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:46:26.085235 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYSgO5iP2Rj0OnjMZjg06AspC2AGCawaQncXH6RR0w6SmRKlRtLBLi7PcPgHNU9vdqMkMafrqdLcVHKkwB4D8nTCptd_7hF6weX6SAII7uRF-eRfBaai4y8PcTnfOVHHGeDAMA19n6IWPYlb4txBKWYFlublH5xab2iApkdg2a67esA Aug 27 02:46:26.085235 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:46:26.085235 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:46:26.085235 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:46:26.085235 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:46:26.085235 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:46:26.085235 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:46:26.085235 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: b105816fd4e54b9da4973ff721e1fb92 Aug 27 02:46:26.085235 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ServersOnMultiNodesTest-355465396 Aug 27 02:46:26.085235 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:46:26.085235 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:46:26.087093 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b105816fd4e54b9da4973ff721e1fb92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_b105816fd4e54b9da4973ff721e1fb92", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b105816fd4e54b9da4973ff721e1fb92"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/b105816fd4e54b9da4973ff721e1fb92"}]}] Aug 27 02:46:26.087093 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ServersOnMultiNodesTest-355465396 Aug 27 02:46:26.087093 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: b105816fd4e54b9da4973ff721e1fb92 Aug 27 02:46:26.087093 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-355465396 Aug 27 02:46:26.087093 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ServersOnMultiNodesTest-355465396-project Aug 27 02:46:26.087093 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:46:26.087093 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:46:26.087093 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: eb6d1646ec094e3297f6f3c51dd72e85 Aug 27 02:46:26.087093 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ServersOnMultiNodesTest-355465396-project Aug 27 02:46:26.087093 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 02:46:26.087093 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance eb11f5d3-ce63-461d-a83f-04f33ce7c16b could not be found. Aug 27 02:46:26.087093 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': 'eb11f5d3-ce63-461d-a83f-04f33ce7c16b'} Aug 27 02:46:26.088117 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:46:26.088117 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:46:26.088117 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:46:26.088117 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:46:26.088117 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:46:26.088117 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:46:26.088117 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:46:26.088117 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:46:26.088117 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:46:26.088117 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:46:26.088117 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb11f5d3-ce63-461d-a83f-04f33ce7c16b could not be found. Aug 27 02:46:26.088117 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:46:26.088117 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:46:26.088117 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:46:26.088117 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:46:26.088117 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:46:26.088117 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:46:26.088117 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:46:26.088117 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:46:26.088117 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:46:26.089781 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:46:26.089781 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:46:26.089781 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:46:26.089781 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:46:26.089781 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:46:26.089781 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:46:26.089781 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:46:26.089781 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb11f5d3-ce63-461d-a83f-04f33ce7c16b could not be found. Aug 27 02:46:26.089781 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:46:26.089781 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:46:26.089781 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:46:26.089781 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:46:26.089781 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:46:26.089781 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:46:26.089781 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:46:26.089781 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:46:26.089781 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb11f5d3-ce63-461d-a83f-04f33ce7c16b could not be found. Aug 27 02:46:26.089781 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:46:26.092096 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c77fda59-f82c-4fd3-b06b-84cd9509e4ea tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Returning 404 to user: Instance eb11f5d3-ce63-461d-a83f-04f33ce7c16b could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:46:26.093771 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c77fda59-f82c-4fd3-b06b-84cd9509e4ea tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "GET /compute/v2.1/servers/eb11f5d3-ce63-461d-a83f-04f33ce7c16b" status: 404 len: 111 microversion: 2.1 time: 0.098740 Aug 27 02:46:26.094918 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 732/1452] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:25 2022] GET /compute/v2.1/servers/eb11f5d3-ce63-461d-a83f-04f33ce7c16b => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:46:26.101745 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-cfebf49d-17c6-4f5f-9e40-944051446b0a tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-2012342478", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:46:26.185851 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.network.neutron [None req-cfebf49d-17c6-4f5f-9e40-944051446b0a tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] validate_networks() for [('48fc4806-56c1-4954-8212-e1e78b76e094', None, None, None, None, None)] {{(pid=134051) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:46:26.456657 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-d4e26197-92bb-4868-afc3-7c77b381f508 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:26.471516 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-d4e26197-92bb-4868-afc3-7c77b381f508 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:26.478214 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-d4e26197-92bb-4868-afc3-7c77b381f508 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:26.484680 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d4e26197-92bb-4868-afc3-7c77b381f508 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/f620f083-7230-471a-87d0-f6d85f8ad087" status: 200 len: 1487 microversion: 2.25 time: 0.453449 Aug 27 02:46:26.486727 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 721/1453] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:46:26 2022] GET /compute/v2.1/servers/f620f083-7230-471a-87d0-f6d85f8ad087 => generated 1487 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:46:26.502864 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-69e1786e-93a8-4afb-b010-c653f7c9cafe tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:26.505538 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-69e1786e-93a8-4afb-b010-c653f7c9cafe tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: cc853ecf-2145-4d0b-a41b-c1d892332490] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:26.529740 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-69e1786e-93a8-4afb-b010-c653f7c9cafe tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:26.530903 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-69e1786e-93a8-4afb-b010-c653f7c9cafe tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:26.531454 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-69e1786e-93a8-4afb-b010-c653f7c9cafe tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:26.532464 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-69e1786e-93a8-4afb-b010-c653f7c9cafe tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:26.533170 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-69e1786e-93a8-4afb-b010-c653f7c9cafe tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:26.533841 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-69e1786e-93a8-4afb-b010-c653f7c9cafe tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:26.601144 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-69e1786e-93a8-4afb-b010-c653f7c9cafe tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: cc853ecf-2145-4d0b-a41b-c1d892332490] Going to try to terminate instance {{(pid=134052) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:46:26.745831 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-69e1786e-93a8-4afb-b010-c653f7c9cafe tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "DELETE /compute/v2.1/servers/cc853ecf-2145-4d0b-a41b-c1d892332490" status: 204 len: 0 microversion: 2.1 time: 0.255543 Aug 27 02:46:26.749638 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 722/1454] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:46:26 2022] DELETE /compute/v2.1/servers/cc853ecf-2145-4d0b-a41b-c1d892332490 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:46:26.762611 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a9d26d43-d7d6-48bd-8eee-64fffd97d2ea tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:26.763615 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a9d26d43-d7d6-48bd-8eee-64fffd97d2ea tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] [instance: 484e03a9-aef3-4179-980c-0e7292a05b5a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:26.775691 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a9d26d43-d7d6-48bd-8eee-64fffd97d2ea tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:26.776499 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a9d26d43-d7d6-48bd-8eee-64fffd97d2ea tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:26.780657 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a9d26d43-d7d6-48bd-8eee-64fffd97d2ea tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:26.781713 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a9d26d43-d7d6-48bd-8eee-64fffd97d2ea tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:26.782421 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a9d26d43-d7d6-48bd-8eee-64fffd97d2ea tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:26.783074 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a9d26d43-d7d6-48bd-8eee-64fffd97d2ea tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:27.022332 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-cfebf49d-17c6-4f5f-9e40-944051446b0a tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Flavor limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:46:27.023729 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-cfebf49d-17c6-4f5f-9e40-944051446b0a tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Image limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:46:27.024519 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-cfebf49d-17c6-4f5f-9e40-944051446b0a tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Flavor pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:46:27.025291 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-cfebf49d-17c6-4f5f-9e40-944051446b0a tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Image pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:46:27.026227 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-cfebf49d-17c6-4f5f-9e40-944051446b0a tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:46:27.038623 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cfebf49d-17c6-4f5f-9e40-944051446b0a tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:27.039652 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cfebf49d-17c6-4f5f-9e40-944051446b0a tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:27.040543 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cfebf49d-17c6-4f5f-9e40-944051446b0a tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:27.041628 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cfebf49d-17c6-4f5f-9e40-944051446b0a tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:27.042292 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cfebf49d-17c6-4f5f-9e40-944051446b0a tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:27.042991 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cfebf49d-17c6-4f5f-9e40-944051446b0a tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:27.066173 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-a9d26d43-d7d6-48bd-8eee-64fffd97d2ea tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:27.083584 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-cfebf49d-17c6-4f5f-9e40-944051446b0a tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Getting quotas for project f5668e6d96694c62b83f7e8381fe86e1. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:46:27.083835 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-a9d26d43-d7d6-48bd-8eee-64fffd97d2ea tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:27.089542 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-a9d26d43-d7d6-48bd-8eee-64fffd97d2ea tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:27.092852 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a9d26d43-d7d6-48bd-8eee-64fffd97d2ea tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] 10.222.0.70 "GET /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a" status: 200 len: 1875 microversion: 2.42 time: 0.339595 Aug 27 02:46:27.104618 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 723/1455] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:46:26 2022] GET /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a => generated 1875 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:46:27.104946 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-cfebf49d-17c6-4f5f-9e40-944051446b0a tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Getting quotas for user 0e86c17fe83848e2bc96b7c83ff1cf14 and project f5668e6d96694c62b83f7e8381fe86e1. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:46:27.116987 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ff1cf195-64d3-4c69-a23e-5ade7a373474 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:27.117598 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-ff1cf195-64d3-4c69-a23e-5ade7a373474 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 70acfe32-deea-46fc-a214-8fdbb9f6cb7b] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:27.125224 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ff1cf195-64d3-4c69-a23e-5ade7a373474 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:27.125796 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ff1cf195-64d3-4c69-a23e-5ade7a373474 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:27.126321 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ff1cf195-64d3-4c69-a23e-5ade7a373474 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:27.127120 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ff1cf195-64d3-4c69-a23e-5ade7a373474 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:27.127882 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ff1cf195-64d3-4c69-a23e-5ade7a373474 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:27.128634 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ff1cf195-64d3-4c69-a23e-5ade7a373474 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:27.130102 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-cfebf49d-17c6-4f5f-9e40-944051446b0a tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Going to run 1 instances... {{(pid=134051) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:46:27.136479 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-cfebf49d-17c6-4f5f-9e40-944051446b0a tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] [instance: 13799829-bea9-44c8-9993-89cdc60e7d74] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134051) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:46:27.220291 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-cfebf49d-17c6-4f5f-9e40-944051446b0a tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.123905 Aug 27 02:46:27.221228 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 733/1456] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 02:46:26 2022] POST /compute/v2.1/servers => generated 383 bytes in 1125 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:46:27.222186 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-cfebf49d-17c6-4f5f-9e40-944051446b0a tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:27.223248 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-cfebf49d-17c6-4f5f-9e40-944051446b0a tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] 10.222.0.70 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001086 Aug 27 02:46:27.230691 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 734/1457] 10.222.0.70 () {56 vars in 886 bytes} [Sat Aug 27 02:46:27 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 27 02:46:27.230691 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-dab93e57-3d88-495b-b658-2b58b80c6e8e tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:27.230691 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-dab93e57-3d88-495b-b658-2b58b80c6e8e tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: cc853ecf-2145-4d0b-a41b-c1d892332490] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:27.237964 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dab93e57-3d88-495b-b658-2b58b80c6e8e tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:27.238608 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dab93e57-3d88-495b-b658-2b58b80c6e8e tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:27.239050 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dab93e57-3d88-495b-b658-2b58b80c6e8e tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:27.239761 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dab93e57-3d88-495b-b658-2b58b80c6e8e tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:27.240213 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dab93e57-3d88-495b-b658-2b58b80c6e8e tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:27.240661 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dab93e57-3d88-495b-b658-2b58b80c6e8e tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:27.877522 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-ff1cf195-64d3-4c69-a23e-5ade7a373474 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:27.894020 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ff1cf195-64d3-4c69-a23e-5ade7a373474 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b" status: 200 len: 1390 microversion: 2.1 time: 0.784669 Aug 27 02:46:27.896271 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 724/1458] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:27 2022] GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b => generated 1390 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:27.912797 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e1625a5a-801b-4bb8-98af-e28841a24160 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:27.913666 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-e1625a5a-801b-4bb8-98af-e28841a24160 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] [instance: 13799829-bea9-44c8-9993-89cdc60e7d74] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:27.931439 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-dab93e57-3d88-495b-b658-2b58b80c6e8e tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6d1646ec094e3297f6f3c51dd72e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b105816fd4e54b9da4973ff721e1fb92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:27.941629 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-dab93e57-3d88-495b-b658-2b58b80c6e8e tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "GET /compute/v2.1/servers/cc853ecf-2145-4d0b-a41b-c1d892332490" status: 200 len: 1473 microversion: 2.1 time: 0.716941 Aug 27 02:46:27.942899 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 735/1459] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:27 2022] GET /compute/v2.1/servers/cc853ecf-2145-4d0b-a41b-c1d892332490 => generated 1473 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:27.947722 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e9e72e6d-6a17-4308-9e7a-6fd9d460a825 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:27.948705 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-e9e72e6d-6a17-4308-9e7a-6fd9d460a825 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: f620f083-7230-471a-87d0-f6d85f8ad087] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:27.957063 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e1625a5a-801b-4bb8-98af-e28841a24160 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:27.961133 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e9e72e6d-6a17-4308-9e7a-6fd9d460a825 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:27.961589 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e1625a5a-801b-4bb8-98af-e28841a24160 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:27.962221 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e9e72e6d-6a17-4308-9e7a-6fd9d460a825 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:27.962920 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e9e72e6d-6a17-4308-9e7a-6fd9d460a825 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:27.963225 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e1625a5a-801b-4bb8-98af-e28841a24160 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:27.964160 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e9e72e6d-6a17-4308-9e7a-6fd9d460a825 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:27.965045 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e9e72e6d-6a17-4308-9e7a-6fd9d460a825 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:27.965686 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e9e72e6d-6a17-4308-9e7a-6fd9d460a825 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:27.968107 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e1625a5a-801b-4bb8-98af-e28841a24160 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:27.968703 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e1625a5a-801b-4bb8-98af-e28841a24160 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:27.969900 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e1625a5a-801b-4bb8-98af-e28841a24160 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:28.083436 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-e1625a5a-801b-4bb8-98af-e28841a24160 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e86c17fe83848e2bc96b7c83ff1cf14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5668e6d96694c62b83f7e8381fe86e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:28.094364 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e1625a5a-801b-4bb8-98af-e28841a24160 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] 10.222.0.70 "GET /compute/v2.1/servers/13799829-bea9-44c8-9993-89cdc60e7d74" status: 200 len: 1229 microversion: 2.1 time: 0.196999 Aug 27 02:46:28.108340 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 725/1460] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:27 2022] GET /compute/v2.1/servers/13799829-bea9-44c8-9993-89cdc60e7d74 => generated 1229 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:28.125222 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4b4df07f-3e30-4f63-ac74-dd8e51e5fa83 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:28.130039 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-4b4df07f-3e30-4f63-ac74-dd8e51e5fa83 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] [instance: 484e03a9-aef3-4179-980c-0e7292a05b5a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:28.141994 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4b4df07f-3e30-4f63-ac74-dd8e51e5fa83 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:28.142476 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4b4df07f-3e30-4f63-ac74-dd8e51e5fa83 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:28.142914 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4b4df07f-3e30-4f63-ac74-dd8e51e5fa83 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:28.143629 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4b4df07f-3e30-4f63-ac74-dd8e51e5fa83 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:28.144080 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4b4df07f-3e30-4f63-ac74-dd8e51e5fa83 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:28.144531 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4b4df07f-3e30-4f63-ac74-dd8e51e5fa83 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:28.169756 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e9e72e6d-6a17-4308-9e7a-6fd9d460a825 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:28.182686 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e9e72e6d-6a17-4308-9e7a-6fd9d460a825 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:28.184903 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e9e72e6d-6a17-4308-9e7a-6fd9d460a825 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:28.186607 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e9e72e6d-6a17-4308-9e7a-6fd9d460a825 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/f620f083-7230-471a-87d0-f6d85f8ad087" status: 200 len: 1477 microversion: 2.25 time: 0.242428 Aug 27 02:46:28.188000 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 736/1461] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:46:27 2022] GET /compute/v2.1/servers/f620f083-7230-471a-87d0-f6d85f8ad087 => generated 1477 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:46:28.213453 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b1601823-adda-4f10-828b-060ab52b13ad tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Calling method '.version_select at 0x7f5edf4b9dc0>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:28.219737 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b1601823-adda-4f10-828b-060ab52b13ad tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:28.221904 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b1601823-adda-4f10-828b-060ab52b13ad tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:28.223563 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b1601823-adda-4f10-828b-060ab52b13ad tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:28.257400 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b1601823-adda-4f10-828b-060ab52b13ad tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] 10.222.0.70 "GET /compute/v2.1/os-migrations" status: 200 len: 3863 microversion: 2.25 time: 0.047588 Aug 27 02:46:28.258879 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 737/1462] 10.222.0.70 () {60 vars in 1184 bytes} [Sat Aug 27 02:46:28 2022] GET /compute/v2.1/os-migrations => generated 3863 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:46:28.285105 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-183ed4ce-771b-4181-8423-dd0dd4bfe953 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:28.289720 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-183ed4ce-771b-4181-8423-dd0dd4bfe953 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] [instance: f620f083-7230-471a-87d0-f6d85f8ad087] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:28.310459 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-183ed4ce-771b-4181-8423-dd0dd4bfe953 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:28.311013 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-183ed4ce-771b-4181-8423-dd0dd4bfe953 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:28.322347 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-183ed4ce-771b-4181-8423-dd0dd4bfe953 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:28.328525 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-183ed4ce-771b-4181-8423-dd0dd4bfe953 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:28.329028 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-183ed4ce-771b-4181-8423-dd0dd4bfe953 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:28.329526 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-183ed4ce-771b-4181-8423-dd0dd4bfe953 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:28.601945 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-4b4df07f-3e30-4f63-ac74-dd8e51e5fa83 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:28.613715 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-4b4df07f-3e30-4f63-ac74-dd8e51e5fa83 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:28.616666 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-4b4df07f-3e30-4f63-ac74-dd8e51e5fa83 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:28.619121 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-4b4df07f-3e30-4f63-ac74-dd8e51e5fa83 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] 10.222.0.70 "GET /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a" status: 200 len: 1875 microversion: 2.42 time: 0.499925 Aug 27 02:46:28.624502 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 726/1463] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:46:28 2022] GET /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a => generated 1875 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:46:28.738009 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.objects.instance [None req-183ed4ce-771b-4181-8423-dd0dd4bfe953 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] Lazy-loading 'services' on Instance uuid f620f083-7230-471a-87d0-f6d85f8ad087 {{(pid=134051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:46:28.757340 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-183ed4ce-771b-4181-8423-dd0dd4bfe953 tempest-LiveAutoBlockMigrationV225Test-1696819837 tempest-LiveAutoBlockMigrationV225Test-1696819837-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/f620f083-7230-471a-87d0-f6d85f8ad087" status: 200 len: 1970 microversion: 2.25 time: 0.483834 Aug 27 02:46:28.772889 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 738/1464] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:46:28 2022] GET /compute/v2.1/servers/f620f083-7230-471a-87d0-f6d85f8ad087 => generated 1970 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:46:28.819669 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5b5b28c2-4bf9-486c-a61b-b9b4ec491074 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:28.820449 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-5b5b28c2-4bf9-486c-a61b-b9b4ec491074 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: f620f083-7230-471a-87d0-f6d85f8ad087] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:28.828236 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5b5b28c2-4bf9-486c-a61b-b9b4ec491074 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:28.828859 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5b5b28c2-4bf9-486c-a61b-b9b4ec491074 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:28.829252 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5b5b28c2-4bf9-486c-a61b-b9b4ec491074 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:28.829950 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5b5b28c2-4bf9-486c-a61b-b9b4ec491074 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:28.830983 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5b5b28c2-4bf9-486c-a61b-b9b4ec491074 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:28.831928 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5b5b28c2-4bf9-486c-a61b-b9b4ec491074 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:28.889714 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-5b5b28c2-4bf9-486c-a61b-b9b4ec491074 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: f620f083-7230-471a-87d0-f6d85f8ad087] Going to try to terminate instance {{(pid=134052) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:46:28.920908 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-47673dc6-b03b-4a0f-a3fc-da08d9caff70 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:28.922101 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-47673dc6-b03b-4a0f-a3fc-da08d9caff70 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 70acfe32-deea-46fc-a214-8fdbb9f6cb7b] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:28.934675 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-47673dc6-b03b-4a0f-a3fc-da08d9caff70 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:28.940497 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-47673dc6-b03b-4a0f-a3fc-da08d9caff70 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:28.941819 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-47673dc6-b03b-4a0f-a3fc-da08d9caff70 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:28.946252 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-47673dc6-b03b-4a0f-a3fc-da08d9caff70 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:28.947097 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-47673dc6-b03b-4a0f-a3fc-da08d9caff70 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:28.947804 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-47673dc6-b03b-4a0f-a3fc-da08d9caff70 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:29.068068 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-5b5b28c2-4bf9-486c-a61b-b9b4ec491074 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "DELETE /compute/v2.1/servers/f620f083-7230-471a-87d0-f6d85f8ad087" status: 204 len: 0 microversion: 2.25 time: 0.252367 Aug 27 02:46:29.069363 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 727/1465] 10.222.0.70 () {60 vars in 1280 bytes} [Sat Aug 27 02:46:28 2022] DELETE /compute/v2.1/servers/f620f083-7230-471a-87d0-f6d85f8ad087 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 02:46:29.076937 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c35f2343-427d-47ce-8849-58eb2ee7ad93 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:29.078254 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-c35f2343-427d-47ce-8849-58eb2ee7ad93 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: cc853ecf-2145-4d0b-a41b-c1d892332490] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:29.099374 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c35f2343-427d-47ce-8849-58eb2ee7ad93 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:29.100132 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c35f2343-427d-47ce-8849-58eb2ee7ad93 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:29.102641 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c35f2343-427d-47ce-8849-58eb2ee7ad93 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:29.104716 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c35f2343-427d-47ce-8849-58eb2ee7ad93 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:29.106688 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c35f2343-427d-47ce-8849-58eb2ee7ad93 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:29.107781 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c35f2343-427d-47ce-8849-58eb2ee7ad93 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:29.283389 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-47673dc6-b03b-4a0f-a3fc-da08d9caff70 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:29.299171 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-47673dc6-b03b-4a0f-a3fc-da08d9caff70 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b" status: 200 len: 1390 microversion: 2.1 time: 0.383565 Aug 27 02:46:29.302266 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 739/1466] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:28 2022] GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b => generated 1390 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:29.314513 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-54a27c6b-b748-4541-9d1f-a4c57f5cd304 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:29.316949 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-54a27c6b-b748-4541-9d1f-a4c57f5cd304 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: f620f083-7230-471a-87d0-f6d85f8ad087] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:29.335471 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-54a27c6b-b748-4541-9d1f-a4c57f5cd304 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:29.336377 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-54a27c6b-b748-4541-9d1f-a4c57f5cd304 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:29.337867 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-54a27c6b-b748-4541-9d1f-a4c57f5cd304 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:29.340660 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-54a27c6b-b748-4541-9d1f-a4c57f5cd304 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:29.341190 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-54a27c6b-b748-4541-9d1f-a4c57f5cd304 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:29.341648 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-54a27c6b-b748-4541-9d1f-a4c57f5cd304 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:29.406638 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-c35f2343-427d-47ce-8849-58eb2ee7ad93 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6d1646ec094e3297f6f3c51dd72e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b105816fd4e54b9da4973ff721e1fb92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:29.418804 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c35f2343-427d-47ce-8849-58eb2ee7ad93 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "GET /compute/v2.1/servers/cc853ecf-2145-4d0b-a41b-c1d892332490" status: 200 len: 1473 microversion: 2.1 time: 0.347839 Aug 27 02:46:29.429513 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 728/1467] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:29 2022] GET /compute/v2.1/servers/cc853ecf-2145-4d0b-a41b-c1d892332490 => generated 1473 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:29.429513 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9f75eac6-e6e8-4038-87fb-ed690fc2e564 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:29.429513 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-9f75eac6-e6e8-4038-87fb-ed690fc2e564 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] [instance: 13799829-bea9-44c8-9993-89cdc60e7d74] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:29.450636 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9f75eac6-e6e8-4038-87fb-ed690fc2e564 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:29.450636 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9f75eac6-e6e8-4038-87fb-ed690fc2e564 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:29.450636 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9f75eac6-e6e8-4038-87fb-ed690fc2e564 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:29.450636 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9f75eac6-e6e8-4038-87fb-ed690fc2e564 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:29.456059 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9f75eac6-e6e8-4038-87fb-ed690fc2e564 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:29.458352 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9f75eac6-e6e8-4038-87fb-ed690fc2e564 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:29.515020 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:46:29.621435 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-9f75eac6-e6e8-4038-87fb-ed690fc2e564 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e86c17fe83848e2bc96b7c83ff1cf14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5668e6d96694c62b83f7e8381fe86e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:29.645517 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9f75eac6-e6e8-4038-87fb-ed690fc2e564 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] 10.222.0.70 "GET /compute/v2.1/servers/13799829-bea9-44c8-9993-89cdc60e7d74" status: 200 len: 1277 microversion: 2.1 time: 0.224325 Aug 27 02:46:29.647420 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 729/1468] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:29 2022] GET /compute/v2.1/servers/13799829-bea9-44c8-9993-89cdc60e7d74 => generated 1277 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:29.664582 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-54a27c6b-b748-4541-9d1f-a4c57f5cd304 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:29.674063 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6d71dd13-3234-43b8-a0e0-895dd2cdfc33 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:29.676827 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-6d71dd13-3234-43b8-a0e0-895dd2cdfc33 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] [instance: 484e03a9-aef3-4179-980c-0e7292a05b5a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:29.678090 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-54a27c6b-b748-4541-9d1f-a4c57f5cd304 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:29.685005 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-54a27c6b-b748-4541-9d1f-a4c57f5cd304 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:29.689922 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-54a27c6b-b748-4541-9d1f-a4c57f5cd304 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/f620f083-7230-471a-87d0-f6d85f8ad087" status: 200 len: 1483 microversion: 2.25 time: 0.386344 Aug 27 02:46:29.692449 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 740/1469] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:46:29 2022] GET /compute/v2.1/servers/f620f083-7230-471a-87d0-f6d85f8ad087 => generated 1483 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:46:29.693634 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6d71dd13-3234-43b8-a0e0-895dd2cdfc33 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:29.694025 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6d71dd13-3234-43b8-a0e0-895dd2cdfc33 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:29.694632 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6d71dd13-3234-43b8-a0e0-895dd2cdfc33 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:29.695465 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6d71dd13-3234-43b8-a0e0-895dd2cdfc33 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:29.696009 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6d71dd13-3234-43b8-a0e0-895dd2cdfc33 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:29.702982 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6d71dd13-3234-43b8-a0e0-895dd2cdfc33 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:30.208350 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-6d71dd13-3234-43b8-a0e0-895dd2cdfc33 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:30.257791 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-6d71dd13-3234-43b8-a0e0-895dd2cdfc33 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:30.267650 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-6d71dd13-3234-43b8-a0e0-895dd2cdfc33 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:30.273928 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-6d71dd13-3234-43b8-a0e0-895dd2cdfc33 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] 10.222.0.70 "GET /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a" status: 200 len: 1875 microversion: 2.42 time: 0.608927 Aug 27 02:46:30.295009 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 730/1470] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:46:29 2022] GET /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a => generated 1875 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:46:30.301114 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-f042daac-272a-4d2e-bb54-13c902051067 req-4d628307-dcad-42b1-ad63-653d5353479f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc853ecf-2145-4d0b-a41b-c1d892332490", "name": "network-vif-deleted", "tag": "55047b0d-ee1c-461b-ba5b-3579aec5e757"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:46:30.385606 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-f042daac-272a-4d2e-bb54-13c902051067 req-4d628307-dcad-42b1-ad63-653d5353479f service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:30.386190 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-f042daac-272a-4d2e-bb54-13c902051067 req-4d628307-dcad-42b1-ad63-653d5353479f service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:30.386632 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-f042daac-272a-4d2e-bb54-13c902051067 req-4d628307-dcad-42b1-ad63-653d5353479f service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:30.431001 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-f042daac-272a-4d2e-bb54-13c902051067 req-4d628307-dcad-42b1-ad63-653d5353479f service nova] Creating event network-vif-deleted:55047b0d-ee1c-461b-ba5b-3579aec5e757 for instance cc853ecf-2145-4d0b-a41b-c1d892332490 on n-h1-852278-4 Aug 27 02:46:30.448691 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-f042daac-272a-4d2e-bb54-13c902051067 req-4d628307-dcad-42b1-ad63-653d5353479f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152170 Aug 27 02:46:30.449516 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 731/1471] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:46:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:46:30.474572 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9c73c954-bf14-4f27-b0fc-b9bd15cffaae tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:30.475276 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-9c73c954-bf14-4f27-b0fc-b9bd15cffaae tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 70acfe32-deea-46fc-a214-8fdbb9f6cb7b] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:30.547403 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9c73c954-bf14-4f27-b0fc-b9bd15cffaae tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:30.554108 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9c73c954-bf14-4f27-b0fc-b9bd15cffaae tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:30.555889 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9c73c954-bf14-4f27-b0fc-b9bd15cffaae tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:30.558929 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9c73c954-bf14-4f27-b0fc-b9bd15cffaae tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:30.560707 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9c73c954-bf14-4f27-b0fc-b9bd15cffaae tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:30.563178 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9c73c954-bf14-4f27-b0fc-b9bd15cffaae tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:30.753936 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-71b1cf20-368c-4333-8e0b-fe4a379799aa tempest-VolumesAdminNegativeTest-179591489 tempest-VolumesAdminNegativeTest-179591489-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "333c7e34-9774-497c-acc5-3246239fe27d"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:46:30.756481 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-71b1cf20-368c-4333-8e0b-fe4a379799aa tempest-VolumesAdminNegativeTest-179591489 tempest-VolumesAdminNegativeTest-179591489-project-admin] [instance: a00dd6f6-d48c-4938-84b1-71bec3877ad9] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:30.767170 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-71b1cf20-368c-4333-8e0b-fe4a379799aa tempest-VolumesAdminNegativeTest-179591489 tempest-VolumesAdminNegativeTest-179591489-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:30.767656 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-71b1cf20-368c-4333-8e0b-fe4a379799aa tempest-VolumesAdminNegativeTest-179591489 tempest-VolumesAdminNegativeTest-179591489-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:30.768081 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-71b1cf20-368c-4333-8e0b-fe4a379799aa tempest-VolumesAdminNegativeTest-179591489 tempest-VolumesAdminNegativeTest-179591489-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:30.779261 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-71b1cf20-368c-4333-8e0b-fe4a379799aa tempest-VolumesAdminNegativeTest-179591489 tempest-VolumesAdminNegativeTest-179591489-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:30.779737 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-71b1cf20-368c-4333-8e0b-fe4a379799aa tempest-VolumesAdminNegativeTest-179591489 tempest-VolumesAdminNegativeTest-179591489-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:30.780168 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-71b1cf20-368c-4333-8e0b-fe4a379799aa tempest-VolumesAdminNegativeTest-179591489 tempest-VolumesAdminNegativeTest-179591489-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:30.948801 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-71b1cf20-368c-4333-8e0b-fe4a379799aa tempest-VolumesAdminNegativeTest-179591489 tempest-VolumesAdminNegativeTest-179591489-project-admin] HTTP exception thrown: Volume 333c7e34-9774-497c-acc5-3246239fe27d could not be found. Aug 27 02:46:30.965687 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-9c73c954-bf14-4f27-b0fc-b9bd15cffaae tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:30.978969 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9c73c954-bf14-4f27-b0fc-b9bd15cffaae tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b" status: 200 len: 1390 microversion: 2.1 time: 0.522945 Aug 27 02:46:30.981992 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 732/1472] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:30 2022] GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b => generated 1390 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:30.985882 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-71b1cf20-368c-4333-8e0b-fe4a379799aa tempest-VolumesAdminNegativeTest-179591489 tempest-VolumesAdminNegativeTest-179591489-project-admin] Request method failure captured: Aug 27 02:46:30.985882 n-d-852278-4 devstack@n-api.service[134051]: request: PUT /compute/v2.1/servers/a00dd6f6-d48c-4938-84b1-71bec3877ad9/os-volume_attachments/8ee14fe0-9753-426c-ba11-4a2796c791de HTTP/1.1 Aug 27 02:46:30.985882 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:46:30.985882 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:46:30.985882 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:46:30.985882 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 74 Aug 27 02:46:30.985882 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:46:30.985882 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:46:30.985882 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:46:30.985882 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:46:30.985882 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYUZZ8ipNEBGoDtkffjVSoD0M3HvBWEHQ1U8BYnM3rEw6XXcGvFNA6fZU9-gjjnb4naiBEehHx1l80LmbouH727nq3h-zexMK5G5iPF5vdqwirFbde8-yLrGWOkv76LdPKtmmKTDLhZQ-LKSPX_bcGyX0Rs8WIMTUzD4vFEaebxSj-c Aug 27 02:46:30.985882 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:46:30.985882 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:46:30.985882 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:46:30.985882 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:46:30.985882 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:46:30.985882 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:46:30.985882 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 2577e6cd88d344ce93532f11a7df8e5d Aug 27 02:46:30.985882 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-VolumesAdminNegativeTest-179591489 Aug 27 02:46:30.985882 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,admin,member Aug 27 02:46:30.985882 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,admin,member Aug 27 02:46:30.987925 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2577e6cd88d344ce93532f11a7df8e5d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_2577e6cd88d344ce93532f11a7df8e5d", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2577e6cd88d344ce93532f11a7df8e5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/2577e6cd88d344ce93532f11a7df8e5d"}]}] Aug 27 02:46:30.987925 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-VolumesAdminNegativeTest-179591489 Aug 27 02:46:30.987925 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 2577e6cd88d344ce93532f11a7df8e5d Aug 27 02:46:30.987925 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-179591489 Aug 27 02:46:30.987925 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-VolumesAdminNegativeTest-179591489-project-admin Aug 27 02:46:30.987925 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:46:30.987925 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:46:30.987925 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: d6df76df57094a90934a6aa1ce482a5b Aug 27 02:46:30.987925 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-VolumesAdminNegativeTest-179591489-project-admin Aug 27 02:46:30.987925 n-d-852278-4 devstack@n-api.service[134051]: Aug 27 02:46:30.987925 n-d-852278-4 devstack@n-api.service[134051]: {"volumeAttachment": {"volumeId": "333c7e34-9774-497c-acc5-3246239fe27d"}} Aug 27 02:46:30.987925 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 02:46:30.987925 n-d-852278-4 devstack@n-api.service[134051]: exception: Volume 333c7e34-9774-497c-acc5-3246239fe27d could not be found. Aug 27 02:46:30.989049 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'server_id': 'a00dd6f6-d48c-4938-84b1-71bec3877ad9', 'id': '8ee14fe0-9753-426c-ba11-4a2796c791de', 'body': {'volumeAttachment': {'volumeId': '333c7e34-9774-497c-acc5-3246239fe27d'}}} Aug 27 02:46:30.989049 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:46:30.989049 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:46:30.989049 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 02:46:30.989049 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 02:46:30.989049 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 27 02:46:30.989049 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 27 02:46:30.989049 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 27 02:46:30.989049 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 27 02:46:30.989049 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 27 02:46:30.989049 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 27 02:46:30.989049 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 27 02:46:30.989049 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 27 02:46:30.989049 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 02:46:30.989049 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 02:46:30.989049 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 02:46:30.989049 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 02:46:30.990440 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 333c7e34-9774-497c-acc5-3246239fe27d could not be found. (HTTP 404) (Request-ID: req-5d37db8b-847d-486d-b4eb-92dd4e10ec8a) Aug 27 02:46:30.990440 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:46:30.990440 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:46:30.990440 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:46:30.990440 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:46:30.990440 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Aug 27 02:46:30.990440 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Aug 27 02:46:30.990440 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 27 02:46:30.990440 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 27 02:46:30.990440 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 27 02:46:30.990440 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 27 02:46:30.990440 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 27 02:46:30.990440 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 27 02:46:30.990440 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 02:46:30.990440 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 02:46:30.990440 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 27 02:46:30.990440 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 27 02:46:30.990440 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 27 02:46:30.990440 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 27 02:46:30.991979 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 27 02:46:30.991979 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 27 02:46:30.991979 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 27 02:46:30.991979 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 27 02:46:30.991979 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 02:46:30.991979 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 02:46:30.991979 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 02:46:30.991979 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 02:46:30.991979 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 333c7e34-9774-497c-acc5-3246239fe27d could not be found. Aug 27 02:46:30.991979 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:46:30.991979 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:46:30.991979 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:46:30.991979 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:46:30.991979 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:46:30.991979 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:46:30.991979 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:46:30.991979 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:46:30.991979 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:46:30.991979 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:46:30.993392 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:46:30.993392 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:46:30.993392 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:46:30.993392 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:46:30.993392 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Aug 27 02:46:30.993392 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Aug 27 02:46:30.993392 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Aug 27 02:46:30.993392 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 27 02:46:30.993392 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 333c7e34-9774-497c-acc5-3246239fe27d could not be found. Aug 27 02:46:30.993392 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:46:30.993392 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:46:30.993392 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:46:30.993392 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:46:30.993392 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:46:30.993392 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:46:30.993392 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:46:30.993392 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:46:30.993392 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 333c7e34-9774-497c-acc5-3246239fe27d could not be found. Aug 27 02:46:30.993392 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:46:30.996252 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-71b1cf20-368c-4333-8e0b-fe4a379799aa tempest-VolumesAdminNegativeTest-179591489 tempest-VolumesAdminNegativeTest-179591489-project-admin] Returning 400 to user: Volume 333c7e34-9774-497c-acc5-3246239fe27d could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:46:30.996787 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-7ea714fe-e74d-4660-b614-e85f7be58223 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:30.998376 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-71b1cf20-368c-4333-8e0b-fe4a379799aa tempest-VolumesAdminNegativeTest-179591489 tempest-VolumesAdminNegativeTest-179591489-project-admin] 10.222.0.70 "PUT /compute/v2.1/servers/a00dd6f6-d48c-4938-84b1-71bec3877ad9/os-volume_attachments/8ee14fe0-9753-426c-ba11-4a2796c791de" status: 400 len: 107 microversion: 2.1 time: 0.979681 Aug 27 02:46:30.999152 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-7ea714fe-e74d-4660-b614-e85f7be58223 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: cc853ecf-2145-4d0b-a41b-c1d892332490] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:30.999457 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 741/1473] 10.222.0.70 () {60 vars in 1433 bytes} [Sat Aug 27 02:46:30 2022] PUT /compute/v2.1/servers/a00dd6f6-d48c-4938-84b1-71bec3877ad9/os-volume_attachments/8ee14fe0-9753-426c-ba11-4a2796c791de => generated 107 bytes in 982 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 02:46:31.005992 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-28e6b961-2034-46d0-b0fa-95e394239095 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:31.008558 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-28e6b961-2034-46d0-b0fa-95e394239095 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] [instance: 13799829-bea9-44c8-9993-89cdc60e7d74] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:31.011919 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:46:31.017619 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7ea714fe-e74d-4660-b614-e85f7be58223 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:31.018282 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7ea714fe-e74d-4660-b614-e85f7be58223 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:31.019000 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7ea714fe-e74d-4660-b614-e85f7be58223 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:31.019813 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7ea714fe-e74d-4660-b614-e85f7be58223 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:31.020660 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7ea714fe-e74d-4660-b614-e85f7be58223 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:31.021174 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7ea714fe-e74d-4660-b614-e85f7be58223 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:31.029913 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-28e6b961-2034-46d0-b0fa-95e394239095 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:31.030422 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-28e6b961-2034-46d0-b0fa-95e394239095 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:31.031160 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-28e6b961-2034-46d0-b0fa-95e394239095 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:31.031893 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-28e6b961-2034-46d0-b0fa-95e394239095 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:31.032379 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-28e6b961-2034-46d0-b0fa-95e394239095 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:31.032809 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-28e6b961-2034-46d0-b0fa-95e394239095 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:31.098178 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7ea714fe-e74d-4660-b614-e85f7be58223 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:31.098666 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7ea714fe-e74d-4660-b614-e85f7be58223 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:31.099097 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7ea714fe-e74d-4660-b614-e85f7be58223 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:31.112360 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.instance [None req-7ea714fe-e74d-4660-b614-e85f7be58223 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lazy-loading 'fault' on Instance uuid cc853ecf-2145-4d0b-a41b-c1d892332490 {{(pid=134052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:46:31.179461 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-28e6b961-2034-46d0-b0fa-95e394239095 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e86c17fe83848e2bc96b7c83ff1cf14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5668e6d96694c62b83f7e8381fe86e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:31.192204 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-28e6b961-2034-46d0-b0fa-95e394239095 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] 10.222.0.70 "GET /compute/v2.1/servers/13799829-bea9-44c8-9993-89cdc60e7d74" status: 200 len: 1295 microversion: 2.1 time: 0.190095 Aug 27 02:46:31.196494 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 742/1474] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:30 2022] GET /compute/v2.1/servers/13799829-bea9-44c8-9993-89cdc60e7d74 => generated 1295 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:31.202724 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-7ea714fe-e74d-4660-b614-e85f7be58223 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6d1646ec094e3297f6f3c51dd72e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b105816fd4e54b9da4973ff721e1fb92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:31.205941 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f8ba02da-3e57-4ac8-88b1-4fe837d1e97e tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:31.206568 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-f8ba02da-3e57-4ac8-88b1-4fe837d1e97e tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: f620f083-7230-471a-87d0-f6d85f8ad087] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:31.216499 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-7ea714fe-e74d-4660-b614-e85f7be58223 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "GET /compute/v2.1/servers/cc853ecf-2145-4d0b-a41b-c1d892332490" status: 200 len: 1307 microversion: 2.1 time: 0.230672 Aug 27 02:46:31.217842 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 733/1475] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:30 2022] GET /compute/v2.1/servers/cc853ecf-2145-4d0b-a41b-c1d892332490 => generated 1307 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:31.223622 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f8ba02da-3e57-4ac8-88b1-4fe837d1e97e tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:31.224127 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f8ba02da-3e57-4ac8-88b1-4fe837d1e97e tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:31.224588 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f8ba02da-3e57-4ac8-88b1-4fe837d1e97e tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:31.224758 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-487ea2ac-f4c7-4238-bba5-3ee5a1f10480 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:31.225082 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-487ea2ac-f4c7-4238-bba5-3ee5a1f10480 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] [instance: a00dd6f6-d48c-4938-84b1-71bec3877ad9] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:31.228920 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f8ba02da-3e57-4ac8-88b1-4fe837d1e97e tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:31.229488 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f8ba02da-3e57-4ac8-88b1-4fe837d1e97e tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:31.229968 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f8ba02da-3e57-4ac8-88b1-4fe837d1e97e tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:31.240410 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:46:31.244100 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-487ea2ac-f4c7-4238-bba5-3ee5a1f10480 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:31.246098 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-487ea2ac-f4c7-4238-bba5-3ee5a1f10480 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:31.248366 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-487ea2ac-f4c7-4238-bba5-3ee5a1f10480 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:31.249457 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-487ea2ac-f4c7-4238-bba5-3ee5a1f10480 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:31.250103 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-487ea2ac-f4c7-4238-bba5-3ee5a1f10480 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:31.253504 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-487ea2ac-f4c7-4238-bba5-3ee5a1f10480 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:31.559308 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.instance [None req-487ea2ac-f4c7-4238-bba5-3ee5a1f10480 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lazy-loading 'services' on Instance uuid a00dd6f6-d48c-4938-84b1-71bec3877ad9 {{(pid=134052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:46:31.781275 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-f8ba02da-3e57-4ac8-88b1-4fe837d1e97e tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:31.792600 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-f8ba02da-3e57-4ac8-88b1-4fe837d1e97e tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:31.794047 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-f8ba02da-3e57-4ac8-88b1-4fe837d1e97e tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:31.795264 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-f8ba02da-3e57-4ac8-88b1-4fe837d1e97e tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/f620f083-7230-471a-87d0-f6d85f8ad087" status: 200 len: 1483 microversion: 2.25 time: 0.597570 Aug 27 02:46:31.795822 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 743/1476] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:46:31 2022] GET /compute/v2.1/servers/f620f083-7230-471a-87d0-f6d85f8ad087 => generated 1483 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:46:31.836618 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ed8b7ff0-3696-448f-a374-a1e55bdf9831 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:31.838525 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-ed8b7ff0-3696-448f-a374-a1e55bdf9831 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] [instance: 484e03a9-aef3-4179-980c-0e7292a05b5a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:31.850934 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ed8b7ff0-3696-448f-a374-a1e55bdf9831 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:31.851704 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ed8b7ff0-3696-448f-a374-a1e55bdf9831 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:31.852254 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ed8b7ff0-3696-448f-a374-a1e55bdf9831 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:31.852410 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-487ea2ac-f4c7-4238-bba5-3ee5a1f10480 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] 10.222.0.70 "DELETE /compute/v2.1/servers/a00dd6f6-d48c-4938-84b1-71bec3877ad9/os-volume_attachments/8ee14fe0-9753-426c-ba11-4a2796c791de" status: 202 len: 0 microversion: 2.1 time: 0.631371 Aug 27 02:46:31.854261 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ed8b7ff0-3696-448f-a374-a1e55bdf9831 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:31.854713 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 734/1477] 10.222.0.70 () {58 vars in 1416 bytes} [Sat Aug 27 02:46:31 2022] DELETE /compute/v2.1/servers/a00dd6f6-d48c-4938-84b1-71bec3877ad9/os-volume_attachments/8ee14fe0-9753-426c-ba11-4a2796c791de => generated 0 bytes in 636 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:46:31.855621 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ed8b7ff0-3696-448f-a374-a1e55bdf9831 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:31.856898 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ed8b7ff0-3696-448f-a374-a1e55bdf9831 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:31.876680 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8eceec03-852e-4777-a3d2-54ca48966130 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:31.881557 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-8eceec03-852e-4777-a3d2-54ca48966130 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] [instance: a00dd6f6-d48c-4938-84b1-71bec3877ad9] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:31.901057 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8eceec03-852e-4777-a3d2-54ca48966130 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:31.902299 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8eceec03-852e-4777-a3d2-54ca48966130 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:31.904210 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8eceec03-852e-4777-a3d2-54ca48966130 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:31.905140 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8eceec03-852e-4777-a3d2-54ca48966130 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:31.907994 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8eceec03-852e-4777-a3d2-54ca48966130 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:31.908753 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8eceec03-852e-4777-a3d2-54ca48966130 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:31.979058 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-8eceec03-852e-4777-a3d2-54ca48966130 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] 10.222.0.70 "GET /compute/v2.1/servers/a00dd6f6-d48c-4938-84b1-71bec3877ad9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.118785 Aug 27 02:46:31.984775 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 735/1478] 10.222.0.70 () {58 vars in 1302 bytes} [Sat Aug 27 02:46:31 2022] GET /compute/v2.1/servers/a00dd6f6-d48c-4938-84b1-71bec3877ad9/os-volume_attachments => generated 197 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:46:32.002798 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-237dbe02-9aac-44f1-8c69-36997626a609 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:32.003792 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-237dbe02-9aac-44f1-8c69-36997626a609 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 70acfe32-deea-46fc-a214-8fdbb9f6cb7b] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:32.014534 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-237dbe02-9aac-44f1-8c69-36997626a609 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:32.015358 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-237dbe02-9aac-44f1-8c69-36997626a609 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:32.016105 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-237dbe02-9aac-44f1-8c69-36997626a609 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:32.017033 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-237dbe02-9aac-44f1-8c69-36997626a609 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:32.019521 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-237dbe02-9aac-44f1-8c69-36997626a609 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:32.020152 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-237dbe02-9aac-44f1-8c69-36997626a609 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:32.525319 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-ed8b7ff0-3696-448f-a374-a1e55bdf9831 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:32.539460 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-ed8b7ff0-3696-448f-a374-a1e55bdf9831 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:32.542964 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-ed8b7ff0-3696-448f-a374-a1e55bdf9831 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:32.545562 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ed8b7ff0-3696-448f-a374-a1e55bdf9831 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] 10.222.0.70 "GET /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a" status: 200 len: 1875 microversion: 2.42 time: 0.721005 Aug 27 02:46:32.562392 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 744/1479] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:46:31 2022] GET /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a => generated 1875 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:46:32.576373 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-9fef3ce4-aab1-4a05-803f-2171fdd7cd04 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:32.597101 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-9fef3ce4-aab1-4a05-803f-2171fdd7cd04 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] [instance: 13799829-bea9-44c8-9993-89cdc60e7d74] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:32.614012 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9fef3ce4-aab1-4a05-803f-2171fdd7cd04 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:32.616804 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9fef3ce4-aab1-4a05-803f-2171fdd7cd04 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:32.617486 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9fef3ce4-aab1-4a05-803f-2171fdd7cd04 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:32.619961 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9fef3ce4-aab1-4a05-803f-2171fdd7cd04 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:32.622292 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9fef3ce4-aab1-4a05-803f-2171fdd7cd04 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:32.623098 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9fef3ce4-aab1-4a05-803f-2171fdd7cd04 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:32.884577 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-237dbe02-9aac-44f1-8c69-36997626a609 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:32.895621 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-237dbe02-9aac-44f1-8c69-36997626a609 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b" status: 200 len: 1390 microversion: 2.1 time: 0.897105 Aug 27 02:46:32.903108 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 736/1480] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:31 2022] GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b => generated 1390 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:46:32.919517 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3526a501-c35f-45a1-963d-ffb4e6af1d42 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:32.922188 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-3526a501-c35f-45a1-963d-ffb4e6af1d42 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: cc853ecf-2145-4d0b-a41b-c1d892332490] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:32.947055 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3526a501-c35f-45a1-963d-ffb4e6af1d42 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:32.947651 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3526a501-c35f-45a1-963d-ffb4e6af1d42 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:32.948202 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3526a501-c35f-45a1-963d-ffb4e6af1d42 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:32.949480 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3526a501-c35f-45a1-963d-ffb4e6af1d42 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:32.950143 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3526a501-c35f-45a1-963d-ffb4e6af1d42 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:32.950983 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3526a501-c35f-45a1-963d-ffb4e6af1d42 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:32.972659 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-9fef3ce4-aab1-4a05-803f-2171fdd7cd04 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e86c17fe83848e2bc96b7c83ff1cf14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5668e6d96694c62b83f7e8381fe86e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:32.977535 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-3526a501-c35f-45a1-963d-ffb4e6af1d42 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] HTTP exception thrown: Instance cc853ecf-2145-4d0b-a41b-c1d892332490 could not be found. Aug 27 02:46:32.979518 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3526a501-c35f-45a1-963d-ffb4e6af1d42 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Request method failure captured: Aug 27 02:46:32.979518 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/servers/cc853ecf-2145-4d0b-a41b-c1d892332490 HTTP/1.1 Aug 27 02:46:32.979518 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:46:32.979518 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:46:32.979518 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:46:32.979518 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:46:32.979518 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:46:32.979518 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:46:32.979518 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:46:32.979518 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:46:32.979518 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYSgO5iP2Rj0OnjMZjg06AspC2AGCawaQncXH6RR0w6SmRKlRtLBLi7PcPgHNU9vdqMkMafrqdLcVHKkwB4D8nTCptd_7hF6weX6SAII7uRF-eRfBaai4y8PcTnfOVHHGeDAMA19n6IWPYlb4txBKWYFlublH5xab2iApkdg2a67esA Aug 27 02:46:32.979518 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:46:32.979518 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:46:32.979518 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:46:32.979518 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:46:32.979518 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:46:32.979518 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:46:32.979518 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: b105816fd4e54b9da4973ff721e1fb92 Aug 27 02:46:32.979518 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ServersOnMultiNodesTest-355465396 Aug 27 02:46:32.979518 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:46:32.979518 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:46:32.981349 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b105816fd4e54b9da4973ff721e1fb92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_b105816fd4e54b9da4973ff721e1fb92", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b105816fd4e54b9da4973ff721e1fb92"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/b105816fd4e54b9da4973ff721e1fb92"}]}] Aug 27 02:46:32.981349 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ServersOnMultiNodesTest-355465396 Aug 27 02:46:32.981349 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: b105816fd4e54b9da4973ff721e1fb92 Aug 27 02:46:32.981349 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-355465396 Aug 27 02:46:32.981349 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ServersOnMultiNodesTest-355465396-project Aug 27 02:46:32.981349 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:46:32.981349 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:46:32.981349 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: eb6d1646ec094e3297f6f3c51dd72e85 Aug 27 02:46:32.981349 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ServersOnMultiNodesTest-355465396-project Aug 27 02:46:32.981349 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 02:46:32.981349 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance cc853ecf-2145-4d0b-a41b-c1d892332490 could not be found. Aug 27 02:46:32.981349 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': 'cc853ecf-2145-4d0b-a41b-c1d892332490'} Aug 27 02:46:32.982396 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:46:32.982396 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:46:32.982396 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:46:32.982396 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:46:32.982396 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:46:32.982396 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:46:32.982396 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:46:32.982396 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:46:32.982396 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:46:32.982396 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:46:32.982396 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc853ecf-2145-4d0b-a41b-c1d892332490 could not be found. Aug 27 02:46:32.982396 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:46:32.982396 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:46:32.982396 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:46:32.982396 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:46:32.982396 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:46:32.982396 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:46:32.982396 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:46:32.982396 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:46:32.982396 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:46:32.984192 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:46:32.984192 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:46:32.984192 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:46:32.984192 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:46:32.984192 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:46:32.984192 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:46:32.984192 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:46:32.984192 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc853ecf-2145-4d0b-a41b-c1d892332490 could not be found. Aug 27 02:46:32.984192 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:46:32.984192 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:46:32.984192 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:46:32.984192 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:46:32.984192 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:46:32.984192 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:46:32.984192 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:46:32.984192 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:46:32.984192 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc853ecf-2145-4d0b-a41b-c1d892332490 could not be found. Aug 27 02:46:32.984192 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:46:32.999916 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3526a501-c35f-45a1-963d-ffb4e6af1d42 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Returning 404 to user: Instance cc853ecf-2145-4d0b-a41b-c1d892332490 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:46:33.000046 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-9fef3ce4-aab1-4a05-803f-2171fdd7cd04 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] 10.222.0.70 "GET /compute/v2.1/servers/13799829-bea9-44c8-9993-89cdc60e7d74" status: 200 len: 1283 microversion: 2.1 time: 0.415564 Aug 27 02:46:33.000046 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 745/1481] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:32 2022] GET /compute/v2.1/servers/13799829-bea9-44c8-9993-89cdc60e7d74 => generated 1283 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:33.000257 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-3526a501-c35f-45a1-963d-ffb4e6af1d42 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "GET /compute/v2.1/servers/cc853ecf-2145-4d0b-a41b-c1d892332490" status: 404 len: 111 microversion: 2.1 time: 0.081894 Aug 27 02:46:33.000257 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 737/1482] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:32 2022] GET /compute/v2.1/servers/cc853ecf-2145-4d0b-a41b-c1d892332490 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:46:33.003397 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4b865b90-65d5-48cf-803b-89388694f123 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:33.003397 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-4b865b90-65d5-48cf-803b-89388694f123 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: f620f083-7230-471a-87d0-f6d85f8ad087] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:33.003764 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c6c34dbf-b097-42ad-8562-0851cb9a91b0 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:33.003764 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-c6c34dbf-b097-42ad-8562-0851cb9a91b0 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] [instance: a00dd6f6-d48c-4938-84b1-71bec3877ad9] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:33.010840 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c6c34dbf-b097-42ad-8562-0851cb9a91b0 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:33.010840 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c6c34dbf-b097-42ad-8562-0851cb9a91b0 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:33.011298 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c6c34dbf-b097-42ad-8562-0851cb9a91b0 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:33.012501 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c6c34dbf-b097-42ad-8562-0851cb9a91b0 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:33.013803 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c6c34dbf-b097-42ad-8562-0851cb9a91b0 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:33.016737 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c6c34dbf-b097-42ad-8562-0851cb9a91b0 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:33.017123 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4b865b90-65d5-48cf-803b-89388694f123 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:33.017823 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4b865b90-65d5-48cf-803b-89388694f123 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:33.018279 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4b865b90-65d5-48cf-803b-89388694f123 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:33.019137 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4b865b90-65d5-48cf-803b-89388694f123 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:33.019710 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4b865b90-65d5-48cf-803b-89388694f123 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:33.020482 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4b865b90-65d5-48cf-803b-89388694f123 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:33.098308 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c6c34dbf-b097-42ad-8562-0851cb9a91b0 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] 10.222.0.70 "GET /compute/v2.1/servers/a00dd6f6-d48c-4938-84b1-71bec3877ad9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.105113 Aug 27 02:46:33.099676 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 738/1483] 10.222.0.70 () {58 vars in 1302 bytes} [Sat Aug 27 02:46:32 2022] GET /compute/v2.1/servers/a00dd6f6-d48c-4938-84b1-71bec3877ad9/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:46:33.111234 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5aba2593-48aa-4d82-a1de-9bdc78c6fbb1 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:33.112057 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-5aba2593-48aa-4d82-a1de-9bdc78c6fbb1 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: c7391538-81d0-4eb1-bff9-e151e2ee4c3a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:33.120223 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5aba2593-48aa-4d82-a1de-9bdc78c6fbb1 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:33.121019 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5aba2593-48aa-4d82-a1de-9bdc78c6fbb1 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:33.121648 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5aba2593-48aa-4d82-a1de-9bdc78c6fbb1 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:33.122615 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5aba2593-48aa-4d82-a1de-9bdc78c6fbb1 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:33.123364 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5aba2593-48aa-4d82-a1de-9bdc78c6fbb1 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:33.124478 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5aba2593-48aa-4d82-a1de-9bdc78c6fbb1 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:33.174107 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-5aba2593-48aa-4d82-a1de-9bdc78c6fbb1 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: c7391538-81d0-4eb1-bff9-e151e2ee4c3a] Going to try to terminate instance {{(pid=134052) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:46:33.342007 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=4 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:46:33.361195 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-5aba2593-48aa-4d82-a1de-9bdc78c6fbb1 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "DELETE /compute/v2.1/servers/c7391538-81d0-4eb1-bff9-e151e2ee4c3a" status: 204 len: 0 microversion: 2.1 time: 0.259589 Aug 27 02:46:33.362704 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 739/1484] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:46:33 2022] DELETE /compute/v2.1/servers/c7391538-81d0-4eb1-bff9-e151e2ee4c3a => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:46:33.374193 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d9432feb-95eb-4a1f-adca-9e231daeb862 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:33.375562 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d9432feb-95eb-4a1f-adca-9e231daeb862 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: c7391538-81d0-4eb1-bff9-e151e2ee4c3a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:33.384863 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d9432feb-95eb-4a1f-adca-9e231daeb862 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:33.385721 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d9432feb-95eb-4a1f-adca-9e231daeb862 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:33.386609 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d9432feb-95eb-4a1f-adca-9e231daeb862 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:33.389555 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d9432feb-95eb-4a1f-adca-9e231daeb862 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:33.390257 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d9432feb-95eb-4a1f-adca-9e231daeb862 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:33.391134 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d9432feb-95eb-4a1f-adca-9e231daeb862 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:33.459827 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-4b865b90-65d5-48cf-803b-89388694f123 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:33.473992 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-4b865b90-65d5-48cf-803b-89388694f123 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:33.482392 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-4b865b90-65d5-48cf-803b-89388694f123 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:33.483870 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-4b865b90-65d5-48cf-803b-89388694f123 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/f620f083-7230-471a-87d0-f6d85f8ad087" status: 200 len: 1441 microversion: 2.25 time: 0.498305 Aug 27 02:46:33.484954 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 746/1485] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:46:32 2022] GET /compute/v2.1/servers/f620f083-7230-471a-87d0-f6d85f8ad087 => generated 1441 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:46:33.542366 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-0d12414a-56ff-46db-b716-23ed3b56d74d req-7b1d6b83-c006-44bf-b0a8-72c00a090313 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f620f083-7230-471a-87d0-f6d85f8ad087", "name": "network-vif-deleted", "tag": "9bf0e2d8-ba4e-4067-bcf4-ca6ddddb7811"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:46:33.601480 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-0d12414a-56ff-46db-b716-23ed3b56d74d req-7b1d6b83-c006-44bf-b0a8-72c00a090313 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:33.605211 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-0d12414a-56ff-46db-b716-23ed3b56d74d req-7b1d6b83-c006-44bf-b0a8-72c00a090313 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:33.606668 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-0d12414a-56ff-46db-b716-23ed3b56d74d req-7b1d6b83-c006-44bf-b0a8-72c00a090313 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:33.655155 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-0d12414a-56ff-46db-b716-23ed3b56d74d req-7b1d6b83-c006-44bf-b0a8-72c00a090313 service nova] Creating event network-vif-deleted:9bf0e2d8-ba4e-4067-bcf4-ca6ddddb7811 for instance f620f083-7230-471a-87d0-f6d85f8ad087 on n-h1-852278-4 Aug 27 02:46:33.672506 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-0d12414a-56ff-46db-b716-23ed3b56d74d req-7b1d6b83-c006-44bf-b0a8-72c00a090313 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135675 Aug 27 02:46:33.685130 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 747/1486] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:46:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:46:33.698730 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4e29875e-8270-4d09-a6fe-ed153ca49c2d tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:33.703353 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-4e29875e-8270-4d09-a6fe-ed153ca49c2d tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] [instance: 484e03a9-aef3-4179-980c-0e7292a05b5a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:33.722531 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4e29875e-8270-4d09-a6fe-ed153ca49c2d tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:33.726482 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4e29875e-8270-4d09-a6fe-ed153ca49c2d tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:33.728691 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4e29875e-8270-4d09-a6fe-ed153ca49c2d tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:33.732820 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4e29875e-8270-4d09-a6fe-ed153ca49c2d tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:33.733163 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4e29875e-8270-4d09-a6fe-ed153ca49c2d tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:33.733622 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4e29875e-8270-4d09-a6fe-ed153ca49c2d tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:34.042634 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-d9432feb-95eb-4a1f-adca-9e231daeb862 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6d1646ec094e3297f6f3c51dd72e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b105816fd4e54b9da4973ff721e1fb92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:34.056032 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d9432feb-95eb-4a1f-adca-9e231daeb862 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "GET /compute/v2.1/servers/c7391538-81d0-4eb1-bff9-e151e2ee4c3a" status: 200 len: 1472 microversion: 2.1 time: 0.688262 Aug 27 02:46:34.056862 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 740/1487] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:33 2022] GET /compute/v2.1/servers/c7391538-81d0-4eb1-bff9-e151e2ee4c3a => generated 1472 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:34.063650 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-110623db-0098-4fb8-8050-d10d6807f865 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:34.069520 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-110623db-0098-4fb8-8050-d10d6807f865 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 70acfe32-deea-46fc-a214-8fdbb9f6cb7b] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:34.078493 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-110623db-0098-4fb8-8050-d10d6807f865 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:34.083227 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-110623db-0098-4fb8-8050-d10d6807f865 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:34.085186 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-110623db-0098-4fb8-8050-d10d6807f865 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:34.086290 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-110623db-0098-4fb8-8050-d10d6807f865 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:34.089449 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-110623db-0098-4fb8-8050-d10d6807f865 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:34.090170 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-110623db-0098-4fb8-8050-d10d6807f865 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:34.249887 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-4e29875e-8270-4d09-a6fe-ed153ca49c2d tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:34.264785 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-4e29875e-8270-4d09-a6fe-ed153ca49c2d tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:34.266273 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-4e29875e-8270-4d09-a6fe-ed153ca49c2d tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:34.267506 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-4e29875e-8270-4d09-a6fe-ed153ca49c2d tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] 10.222.0.70 "GET /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a" status: 200 len: 1875 microversion: 2.42 time: 0.580723 Aug 27 02:46:34.268082 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 748/1488] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:46:33 2022] GET /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a => generated 1875 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:46:34.289429 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a7901bfa-8946-493b-9b8a-0fb4959c2a06 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:34.290044 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-a7901bfa-8946-493b-9b8a-0fb4959c2a06 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] [instance: 13799829-bea9-44c8-9993-89cdc60e7d74] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:34.306634 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a7901bfa-8946-493b-9b8a-0fb4959c2a06 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:34.307131 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a7901bfa-8946-493b-9b8a-0fb4959c2a06 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:34.307564 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a7901bfa-8946-493b-9b8a-0fb4959c2a06 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:34.308634 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a7901bfa-8946-493b-9b8a-0fb4959c2a06 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:34.309087 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a7901bfa-8946-493b-9b8a-0fb4959c2a06 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:34.309514 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a7901bfa-8946-493b-9b8a-0fb4959c2a06 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:34.600546 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-110623db-0098-4fb8-8050-d10d6807f865 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:34.613838 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-110623db-0098-4fb8-8050-d10d6807f865 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b" status: 200 len: 1390 microversion: 2.1 time: 0.554518 Aug 27 02:46:34.615512 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 741/1489] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:34 2022] GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b => generated 1390 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:34.625515 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-bbd82c23-81b4-416f-a24d-c98175b856f0 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:34.632031 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-bbd82c23-81b4-416f-a24d-c98175b856f0 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] [instance: a00dd6f6-d48c-4938-84b1-71bec3877ad9] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:34.658700 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bbd82c23-81b4-416f-a24d-c98175b856f0 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:34.660401 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bbd82c23-81b4-416f-a24d-c98175b856f0 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:34.660921 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bbd82c23-81b4-416f-a24d-c98175b856f0 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:34.666508 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bbd82c23-81b4-416f-a24d-c98175b856f0 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:34.667940 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bbd82c23-81b4-416f-a24d-c98175b856f0 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:34.668764 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bbd82c23-81b4-416f-a24d-c98175b856f0 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:34.719879 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-a7901bfa-8946-493b-9b8a-0fb4959c2a06 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e86c17fe83848e2bc96b7c83ff1cf14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5668e6d96694c62b83f7e8381fe86e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:34.735312 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a7901bfa-8946-493b-9b8a-0fb4959c2a06 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] 10.222.0.70 "GET /compute/v2.1/servers/13799829-bea9-44c8-9993-89cdc60e7d74" status: 200 len: 1325 microversion: 2.1 time: 0.458517 Aug 27 02:46:34.735909 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 749/1490] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:34 2022] GET /compute/v2.1/servers/13799829-bea9-44c8-9993-89cdc60e7d74 => generated 1325 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:34.761669 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-fbdca562-41d1-442d-9215-49584eaac7db tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:34.762544 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-fbdca562-41d1-442d-9215-49584eaac7db tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: f620f083-7230-471a-87d0-f6d85f8ad087] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:34.777475 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fbdca562-41d1-442d-9215-49584eaac7db tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:34.778413 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fbdca562-41d1-442d-9215-49584eaac7db tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:34.780563 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fbdca562-41d1-442d-9215-49584eaac7db tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:34.784009 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fbdca562-41d1-442d-9215-49584eaac7db tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:34.785135 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fbdca562-41d1-442d-9215-49584eaac7db tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:34.785786 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fbdca562-41d1-442d-9215-49584eaac7db tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:34.802452 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-bbd82c23-81b4-416f-a24d-c98175b856f0 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] 10.222.0.70 "GET /compute/v2.1/servers/a00dd6f6-d48c-4938-84b1-71bec3877ad9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.183785 Aug 27 02:46:34.803099 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 742/1491] 10.222.0.70 () {58 vars in 1302 bytes} [Sat Aug 27 02:46:34 2022] GET /compute/v2.1/servers/a00dd6f6-d48c-4938-84b1-71bec3877ad9/os-volume_attachments => generated 197 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:46:35.083991 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8e765e7a-7caf-4d64-ba7b-121be83d92be tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:35.084637 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-8e765e7a-7caf-4d64-ba7b-121be83d92be tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: c7391538-81d0-4eb1-bff9-e151e2ee4c3a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:35.084817 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-fbdca562-41d1-442d-9215-49584eaac7db tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:35.096418 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-fbdca562-41d1-442d-9215-49584eaac7db tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:35.098589 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-fbdca562-41d1-442d-9215-49584eaac7db tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:35.100408 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8e765e7a-7caf-4d64-ba7b-121be83d92be tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:35.100869 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8e765e7a-7caf-4d64-ba7b-121be83d92be tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:35.101312 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8e765e7a-7caf-4d64-ba7b-121be83d92be tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:35.104178 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-fbdca562-41d1-442d-9215-49584eaac7db tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/f620f083-7230-471a-87d0-f6d85f8ad087" status: 200 len: 1266 microversion: 2.25 time: 0.363959 Aug 27 02:46:35.104532 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8e765e7a-7caf-4d64-ba7b-121be83d92be tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:35.105008 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8e765e7a-7caf-4d64-ba7b-121be83d92be tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:35.105457 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 750/1492] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:46:34 2022] GET /compute/v2.1/servers/f620f083-7230-471a-87d0-f6d85f8ad087 => generated 1266 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:46:35.121082 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8e765e7a-7caf-4d64-ba7b-121be83d92be tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:35.301879 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-53914343-3c46-4463-a935-4e864c7d46e6 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:35.302503 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-53914343-3c46-4463-a935-4e864c7d46e6 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] [instance: 484e03a9-aef3-4179-980c-0e7292a05b5a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:35.317450 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-53914343-3c46-4463-a935-4e864c7d46e6 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:35.318040 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-53914343-3c46-4463-a935-4e864c7d46e6 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:35.318687 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-53914343-3c46-4463-a935-4e864c7d46e6 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:35.319606 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-53914343-3c46-4463-a935-4e864c7d46e6 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:35.321610 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-53914343-3c46-4463-a935-4e864c7d46e6 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:35.322454 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-53914343-3c46-4463-a935-4e864c7d46e6 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:35.504233 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-8e765e7a-7caf-4d64-ba7b-121be83d92be tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6d1646ec094e3297f6f3c51dd72e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b105816fd4e54b9da4973ff721e1fb92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:35.517882 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-8e765e7a-7caf-4d64-ba7b-121be83d92be tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "GET /compute/v2.1/servers/c7391538-81d0-4eb1-bff9-e151e2ee4c3a" status: 200 len: 1472 microversion: 2.1 time: 0.437885 Aug 27 02:46:35.518670 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 743/1493] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:35 2022] GET /compute/v2.1/servers/c7391538-81d0-4eb1-bff9-e151e2ee4c3a => generated 1472 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:46:35.636464 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-cc94d0d6-0c04-418f-8b39-af36546cb51e tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:35.637085 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-cc94d0d6-0c04-418f-8b39-af36546cb51e tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 70acfe32-deea-46fc-a214-8fdbb9f6cb7b] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:35.646527 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cc94d0d6-0c04-418f-8b39-af36546cb51e tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:35.647031 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cc94d0d6-0c04-418f-8b39-af36546cb51e tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:35.647473 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cc94d0d6-0c04-418f-8b39-af36546cb51e tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:35.648201 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cc94d0d6-0c04-418f-8b39-af36546cb51e tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:35.648680 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cc94d0d6-0c04-418f-8b39-af36546cb51e tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:35.649105 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cc94d0d6-0c04-418f-8b39-af36546cb51e tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:36.066103 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-53914343-3c46-4463-a935-4e864c7d46e6 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:36.085517 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-53914343-3c46-4463-a935-4e864c7d46e6 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:36.089967 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-53914343-3c46-4463-a935-4e864c7d46e6 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:36.092980 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-53914343-3c46-4463-a935-4e864c7d46e6 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] 10.222.0.70 "GET /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a" status: 200 len: 1875 microversion: 2.42 time: 0.800829 Aug 27 02:46:36.093595 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 751/1494] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:46:35 2022] GET /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a => generated 1875 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:46:36.117550 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-20b40655-89a1-4020-946e-7b02dd043161 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:36.118479 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-20b40655-89a1-4020-946e-7b02dd043161 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] [instance: 13799829-bea9-44c8-9993-89cdc60e7d74] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:36.132611 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-20b40655-89a1-4020-946e-7b02dd043161 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:36.137048 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-20b40655-89a1-4020-946e-7b02dd043161 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:36.137772 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-20b40655-89a1-4020-946e-7b02dd043161 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:36.138800 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-20b40655-89a1-4020-946e-7b02dd043161 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:36.141047 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-20b40655-89a1-4020-946e-7b02dd043161 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:36.141843 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-20b40655-89a1-4020-946e-7b02dd043161 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:36.171475 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-cc94d0d6-0c04-418f-8b39-af36546cb51e tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:36.176086 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:46:36.190241 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-cc94d0d6-0c04-418f-8b39-af36546cb51e tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b" status: 200 len: 1390 microversion: 2.1 time: 0.557698 Aug 27 02:46:36.195802 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 744/1495] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:35 2022] GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b => generated 1390 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:46:36.204638 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-43f52f60-b634-4378-b0b5-b66e38937307 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:36.218592 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-43f52f60-b634-4378-b0b5-b66e38937307 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] [instance: a00dd6f6-d48c-4938-84b1-71bec3877ad9] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:36.241382 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-43f52f60-b634-4378-b0b5-b66e38937307 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:36.242179 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-43f52f60-b634-4378-b0b5-b66e38937307 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:36.242803 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-43f52f60-b634-4378-b0b5-b66e38937307 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:36.243775 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-43f52f60-b634-4378-b0b5-b66e38937307 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:36.244407 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-43f52f60-b634-4378-b0b5-b66e38937307 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:36.245063 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-43f52f60-b634-4378-b0b5-b66e38937307 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:36.338632 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-43f52f60-b634-4378-b0b5-b66e38937307 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] 10.222.0.70 "GET /compute/v2.1/servers/a00dd6f6-d48c-4938-84b1-71bec3877ad9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.139655 Aug 27 02:46:36.339306 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 745/1496] 10.222.0.70 () {58 vars in 1302 bytes} [Sat Aug 27 02:46:36 2022] GET /compute/v2.1/servers/a00dd6f6-d48c-4938-84b1-71bec3877ad9/os-volume_attachments => generated 197 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:46:36.352138 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-4586f24f-80b9-4048-be7f-46e26eed77fb req-069eef5e-0cff-49fe-ab36-bec2adee830a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13799829-bea9-44c8-9993-89cdc60e7d74", "tag": "eb05dbaa-e7a5-4676-8fc8-62e2c1ec4d85"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:46:36.374965 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-4586f24f-80b9-4048-be7f-46e26eed77fb req-069eef5e-0cff-49fe-ab36-bec2adee830a service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:36.378299 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-4586f24f-80b9-4048-be7f-46e26eed77fb req-069eef5e-0cff-49fe-ab36-bec2adee830a service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:36.378815 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-4586f24f-80b9-4048-be7f-46e26eed77fb req-069eef5e-0cff-49fe-ab36-bec2adee830a service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:36.402816 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-4586f24f-80b9-4048-be7f-46e26eed77fb req-069eef5e-0cff-49fe-ab36-bec2adee830a service nova] Creating event network-changed:eb05dbaa-e7a5-4676-8fc8-62e2c1ec4d85 for instance 13799829-bea9-44c8-9993-89cdc60e7d74 on n-h1-852278-4 Aug 27 02:46:36.414375 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-4586f24f-80b9-4048-be7f-46e26eed77fb req-069eef5e-0cff-49fe-ab36-bec2adee830a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071959 Aug 27 02:46:36.417516 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 746/1497] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:46:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:46:36.441929 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-958d33d8-980a-4774-8f76-ee61c635fccf tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:36.442572 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-958d33d8-980a-4774-8f76-ee61c635fccf tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: f620f083-7230-471a-87d0-f6d85f8ad087] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:36.449508 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-958d33d8-980a-4774-8f76-ee61c635fccf tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:36.450013 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-958d33d8-980a-4774-8f76-ee61c635fccf tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:36.450458 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-958d33d8-980a-4774-8f76-ee61c635fccf tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:36.451225 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-958d33d8-980a-4774-8f76-ee61c635fccf tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:36.451678 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-958d33d8-980a-4774-8f76-ee61c635fccf tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:36.452109 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-958d33d8-980a-4774-8f76-ee61c635fccf tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:36.556451 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-20b40655-89a1-4020-946e-7b02dd043161 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e86c17fe83848e2bc96b7c83ff1cf14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5668e6d96694c62b83f7e8381fe86e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:36.595399 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-958d33d8-980a-4774-8f76-ee61c635fccf tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:36.604156 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-20b40655-89a1-4020-946e-7b02dd043161 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] 10.222.0.70 "GET /compute/v2.1/servers/13799829-bea9-44c8-9993-89cdc60e7d74" status: 200 len: 1325 microversion: 2.1 time: 0.507396 Aug 27 02:46:36.605102 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 752/1498] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:36 2022] GET /compute/v2.1/servers/13799829-bea9-44c8-9993-89cdc60e7d74 => generated 1325 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:36.605454 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-958d33d8-980a-4774-8f76-ee61c635fccf tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:36.606974 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-958d33d8-980a-4774-8f76-ee61c635fccf tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:36.608135 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-958d33d8-980a-4774-8f76-ee61c635fccf tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/f620f083-7230-471a-87d0-f6d85f8ad087" status: 200 len: 1266 microversion: 2.25 time: 0.188781 Aug 27 02:46:36.619494 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 747/1499] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:46:36 2022] GET /compute/v2.1/servers/f620f083-7230-471a-87d0-f6d85f8ad087 => generated 1266 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:46:36.655784 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-5c401f58-45a1-4e57-ab21-b85fae970833 req-040a0698-1df9-4e7a-b3f1-c2987a0325c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7391538-81d0-4eb1-bff9-e151e2ee4c3a", "name": "network-vif-deleted", "tag": "d64f53fe-e8c7-4c7b-a9e7-a14d8feb01e0"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:46:36.660825 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-eb325de3-cc89-42f5-a2e9-267dfc43ac68 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:36.663041 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-eb325de3-cc89-42f5-a2e9-267dfc43ac68 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: c7391538-81d0-4eb1-bff9-e151e2ee4c3a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:36.675685 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-5c401f58-45a1-4e57-ab21-b85fae970833 req-040a0698-1df9-4e7a-b3f1-c2987a0325c4 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:36.676558 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-5c401f58-45a1-4e57-ab21-b85fae970833 req-040a0698-1df9-4e7a-b3f1-c2987a0325c4 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:36.677240 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-5c401f58-45a1-4e57-ab21-b85fae970833 req-040a0698-1df9-4e7a-b3f1-c2987a0325c4 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:36.679879 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eb325de3-cc89-42f5-a2e9-267dfc43ac68 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:36.681517 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eb325de3-cc89-42f5-a2e9-267dfc43ac68 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:36.681975 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eb325de3-cc89-42f5-a2e9-267dfc43ac68 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:36.682777 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eb325de3-cc89-42f5-a2e9-267dfc43ac68 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:36.683536 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eb325de3-cc89-42f5-a2e9-267dfc43ac68 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:36.692988 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eb325de3-cc89-42f5-a2e9-267dfc43ac68 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:36.698599 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-5c401f58-45a1-4e57-ab21-b85fae970833 req-040a0698-1df9-4e7a-b3f1-c2987a0325c4 service nova] Creating event network-vif-deleted:d64f53fe-e8c7-4c7b-a9e7-a14d8feb01e0 for instance c7391538-81d0-4eb1-bff9-e151e2ee4c3a on n-h1-852278-4 Aug 27 02:46:36.705039 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-5c401f58-45a1-4e57-ab21-b85fae970833 req-040a0698-1df9-4e7a-b3f1-c2987a0325c4 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053216 Aug 27 02:46:36.706042 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 748/1500] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:46:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:46:36.829110 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-eb325de3-cc89-42f5-a2e9-267dfc43ac68 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6d1646ec094e3297f6f3c51dd72e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b105816fd4e54b9da4973ff721e1fb92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:36.854795 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-eb325de3-cc89-42f5-a2e9-267dfc43ac68 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "GET /compute/v2.1/servers/c7391538-81d0-4eb1-bff9-e151e2ee4c3a" status: 200 len: 1301 microversion: 2.1 time: 0.228134 Aug 27 02:46:36.873530 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 753/1501] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:36 2022] GET /compute/v2.1/servers/c7391538-81d0-4eb1-bff9-e151e2ee4c3a => generated 1301 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:37.122969 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9f8b7703-b36f-4582-af00-1b5fac5035b6 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:37.124101 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-9f8b7703-b36f-4582-af00-1b5fac5035b6 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] [instance: 484e03a9-aef3-4179-980c-0e7292a05b5a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:37.140977 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9f8b7703-b36f-4582-af00-1b5fac5035b6 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:37.143549 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9f8b7703-b36f-4582-af00-1b5fac5035b6 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:37.144237 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9f8b7703-b36f-4582-af00-1b5fac5035b6 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:37.147095 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9f8b7703-b36f-4582-af00-1b5fac5035b6 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:37.150397 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9f8b7703-b36f-4582-af00-1b5fac5035b6 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:37.155257 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9f8b7703-b36f-4582-af00-1b5fac5035b6 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:37.220787 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-85e52d49-33b4-46e0-b527-05a1cafe8acd tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:37.222116 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-85e52d49-33b4-46e0-b527-05a1cafe8acd tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 70acfe32-deea-46fc-a214-8fdbb9f6cb7b] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:37.238841 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:46:37.240150 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=6 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:46:37.243115 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-85e52d49-33b4-46e0-b527-05a1cafe8acd tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:37.243817 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-85e52d49-33b4-46e0-b527-05a1cafe8acd tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:37.244468 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-85e52d49-33b4-46e0-b527-05a1cafe8acd tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:37.245372 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-85e52d49-33b4-46e0-b527-05a1cafe8acd tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:37.247850 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-85e52d49-33b4-46e0-b527-05a1cafe8acd tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:37.250556 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-85e52d49-33b4-46e0-b527-05a1cafe8acd tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:37.540825 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-85e52d49-33b4-46e0-b527-05a1cafe8acd tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:37.552262 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-85e52d49-33b4-46e0-b527-05a1cafe8acd tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b" status: 200 len: 1390 microversion: 2.1 time: 0.336946 Aug 27 02:46:37.555873 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 754/1502] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:37 2022] GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b => generated 1390 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:37.571452 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-931f3bb8-f3ad-4e74-8db1-d2731ca256aa tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:37.581508 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-931f3bb8-f3ad-4e74-8db1-d2731ca256aa tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] [instance: a00dd6f6-d48c-4938-84b1-71bec3877ad9] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:37.594443 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-9f8b7703-b36f-4582-af00-1b5fac5035b6 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:37.597698 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-931f3bb8-f3ad-4e74-8db1-d2731ca256aa tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:37.598539 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-931f3bb8-f3ad-4e74-8db1-d2731ca256aa tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:37.601300 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-931f3bb8-f3ad-4e74-8db1-d2731ca256aa tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:37.603500 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-931f3bb8-f3ad-4e74-8db1-d2731ca256aa tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:37.604149 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-931f3bb8-f3ad-4e74-8db1-d2731ca256aa tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:37.605245 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-931f3bb8-f3ad-4e74-8db1-d2731ca256aa tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:37.611193 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-9f8b7703-b36f-4582-af00-1b5fac5035b6 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:37.614360 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-9f8b7703-b36f-4582-af00-1b5fac5035b6 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:37.616002 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9f8b7703-b36f-4582-af00-1b5fac5035b6 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] 10.222.0.70 "GET /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a" status: 200 len: 1875 microversion: 2.42 time: 0.499588 Aug 27 02:46:37.629841 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 749/1503] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:46:37 2022] GET /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a => generated 1875 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:46:37.648728 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-68bb238b-7a54-480b-b283-d0799fccd588 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:37.650482 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-68bb238b-7a54-480b-b283-d0799fccd588 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] [instance: 13799829-bea9-44c8-9993-89cdc60e7d74] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:37.659697 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-68bb238b-7a54-480b-b283-d0799fccd588 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:37.661098 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-68bb238b-7a54-480b-b283-d0799fccd588 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:37.662090 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-68bb238b-7a54-480b-b283-d0799fccd588 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:37.663200 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-68bb238b-7a54-480b-b283-d0799fccd588 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:37.663825 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-68bb238b-7a54-480b-b283-d0799fccd588 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:37.664652 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-68bb238b-7a54-480b-b283-d0799fccd588 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:37.678695 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-931f3bb8-f3ad-4e74-8db1-d2731ca256aa tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] 10.222.0.70 "GET /compute/v2.1/servers/a00dd6f6-d48c-4938-84b1-71bec3877ad9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.117992 Aug 27 02:46:37.679297 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 755/1504] 10.222.0.70 () {58 vars in 1302 bytes} [Sat Aug 27 02:46:37 2022] GET /compute/v2.1/servers/a00dd6f6-d48c-4938-84b1-71bec3877ad9/os-volume_attachments => generated 197 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:46:37.687693 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c7ff09ae-bc97-469d-a0fd-a5d5ca711d3c tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:37.689026 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-c7ff09ae-bc97-469d-a0fd-a5d5ca711d3c tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: f620f083-7230-471a-87d0-f6d85f8ad087] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:37.696374 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c7ff09ae-bc97-469d-a0fd-a5d5ca711d3c tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:37.697124 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c7ff09ae-bc97-469d-a0fd-a5d5ca711d3c tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:37.697772 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c7ff09ae-bc97-469d-a0fd-a5d5ca711d3c tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:37.698699 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c7ff09ae-bc97-469d-a0fd-a5d5ca711d3c tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:37.699403 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c7ff09ae-bc97-469d-a0fd-a5d5ca711d3c tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:37.700821 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c7ff09ae-bc97-469d-a0fd-a5d5ca711d3c tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:37.849600 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-c7ff09ae-bc97-469d-a0fd-a5d5ca711d3c tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:37.859672 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-c7ff09ae-bc97-469d-a0fd-a5d5ca711d3c tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:37.861584 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-c7ff09ae-bc97-469d-a0fd-a5d5ca711d3c tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:37.863438 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c7ff09ae-bc97-469d-a0fd-a5d5ca711d3c tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/f620f083-7230-471a-87d0-f6d85f8ad087" status: 200 len: 1266 microversion: 2.25 time: 0.182552 Aug 27 02:46:37.881268 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 756/1505] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:46:37 2022] GET /compute/v2.1/servers/f620f083-7230-471a-87d0-f6d85f8ad087 => generated 1266 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:46:37.887074 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c181b911-d588-45e8-839c-0ca36e79ddd1 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:37.888209 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-c181b911-d588-45e8-839c-0ca36e79ddd1 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: c7391538-81d0-4eb1-bff9-e151e2ee4c3a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:37.895867 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c181b911-d588-45e8-839c-0ca36e79ddd1 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:37.896886 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c181b911-d588-45e8-839c-0ca36e79ddd1 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:37.897623 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c181b911-d588-45e8-839c-0ca36e79ddd1 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:37.898610 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c181b911-d588-45e8-839c-0ca36e79ddd1 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:37.899491 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c181b911-d588-45e8-839c-0ca36e79ddd1 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:37.900205 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c181b911-d588-45e8-839c-0ca36e79ddd1 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:37.948291 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c181b911-d588-45e8-839c-0ca36e79ddd1 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:37.949398 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c181b911-d588-45e8-839c-0ca36e79ddd1 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:37.950102 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c181b911-d588-45e8-839c-0ca36e79ddd1 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:37.950890 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.objects.instance [None req-c181b911-d588-45e8-839c-0ca36e79ddd1 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lazy-loading 'fault' on Instance uuid c7391538-81d0-4eb1-bff9-e151e2ee4c3a {{(pid=134051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:46:38.022882 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-c181b911-d588-45e8-839c-0ca36e79ddd1 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6d1646ec094e3297f6f3c51dd72e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b105816fd4e54b9da4973ff721e1fb92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:38.025030 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-68bb238b-7a54-480b-b283-d0799fccd588 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e86c17fe83848e2bc96b7c83ff1cf14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5668e6d96694c62b83f7e8381fe86e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:38.033132 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-68bb238b-7a54-480b-b283-d0799fccd588 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] 10.222.0.70 "GET /compute/v2.1/servers/13799829-bea9-44c8-9993-89cdc60e7d74" status: 200 len: 1325 microversion: 2.1 time: 0.394158 Aug 27 02:46:38.033958 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 750/1506] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:37 2022] GET /compute/v2.1/servers/13799829-bea9-44c8-9993-89cdc60e7d74 => generated 1325 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:38.036375 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c181b911-d588-45e8-839c-0ca36e79ddd1 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "GET /compute/v2.1/servers/c7391538-81d0-4eb1-bff9-e151e2ee4c3a" status: 200 len: 1306 microversion: 2.1 time: 0.153208 Aug 27 02:46:38.051808 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 757/1507] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:37 2022] GET /compute/v2.1/servers/c7391538-81d0-4eb1-bff9-e151e2ee4c3a => generated 1306 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:38.579329 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-43839766-d7dc-490d-942b-b8589b8a89bc tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:38.579944 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-43839766-d7dc-490d-942b-b8589b8a89bc tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 70acfe32-deea-46fc-a214-8fdbb9f6cb7b] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:38.586899 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-43839766-d7dc-490d-942b-b8589b8a89bc tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:38.587588 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-43839766-d7dc-490d-942b-b8589b8a89bc tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:38.588069 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-43839766-d7dc-490d-942b-b8589b8a89bc tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:38.589209 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-43839766-d7dc-490d-942b-b8589b8a89bc tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:38.589825 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-43839766-d7dc-490d-942b-b8589b8a89bc tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:38.590493 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-43839766-d7dc-490d-942b-b8589b8a89bc tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:38.655090 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3fe8be73-9f1f-4f6d-b28b-ec61d71ad657 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:38.656018 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-3fe8be73-9f1f-4f6d-b28b-ec61d71ad657 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] [instance: 484e03a9-aef3-4179-980c-0e7292a05b5a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:38.674541 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3fe8be73-9f1f-4f6d-b28b-ec61d71ad657 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:38.682758 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3fe8be73-9f1f-4f6d-b28b-ec61d71ad657 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:38.685764 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3fe8be73-9f1f-4f6d-b28b-ec61d71ad657 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:38.686832 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3fe8be73-9f1f-4f6d-b28b-ec61d71ad657 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:38.695150 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3fe8be73-9f1f-4f6d-b28b-ec61d71ad657 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:38.696044 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3fe8be73-9f1f-4f6d-b28b-ec61d71ad657 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:38.837860 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-43839766-d7dc-490d-942b-b8589b8a89bc tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:38.846720 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-43839766-d7dc-490d-942b-b8589b8a89bc tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b" status: 200 len: 1390 microversion: 2.1 time: 0.271195 Aug 27 02:46:38.848128 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 751/1508] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:38 2022] GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b => generated 1390 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:38.853479 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a43bc333-3af5-43a9-a4db-1676d122def8 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:38.856033 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a43bc333-3af5-43a9-a4db-1676d122def8 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] [instance: a00dd6f6-d48c-4938-84b1-71bec3877ad9] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:38.862828 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a43bc333-3af5-43a9-a4db-1676d122def8 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:38.863475 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a43bc333-3af5-43a9-a4db-1676d122def8 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:38.864006 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a43bc333-3af5-43a9-a4db-1676d122def8 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:38.865044 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a43bc333-3af5-43a9-a4db-1676d122def8 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:38.865726 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a43bc333-3af5-43a9-a4db-1676d122def8 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:38.866370 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a43bc333-3af5-43a9-a4db-1676d122def8 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:38.913817 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a43bc333-3af5-43a9-a4db-1676d122def8 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] 10.222.0.70 "GET /compute/v2.1/servers/a00dd6f6-d48c-4938-84b1-71bec3877ad9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064253 Aug 27 02:46:38.914936 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 752/1509] 10.222.0.70 () {58 vars in 1302 bytes} [Sat Aug 27 02:46:38 2022] GET /compute/v2.1/servers/a00dd6f6-d48c-4938-84b1-71bec3877ad9/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:46:38.929330 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-323672e8-756c-4ab5-a284-ae3bd22896c9 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:38.930171 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-323672e8-756c-4ab5-a284-ae3bd22896c9 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: f620f083-7230-471a-87d0-f6d85f8ad087] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:38.938902 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-323672e8-756c-4ab5-a284-ae3bd22896c9 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:38.939601 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-323672e8-756c-4ab5-a284-ae3bd22896c9 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:38.940449 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-323672e8-756c-4ab5-a284-ae3bd22896c9 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:38.941450 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-323672e8-756c-4ab5-a284-ae3bd22896c9 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:38.942317 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-323672e8-756c-4ab5-a284-ae3bd22896c9 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:38.943166 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-323672e8-756c-4ab5-a284-ae3bd22896c9 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:39.085537 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-323672e8-756c-4ab5-a284-ae3bd22896c9 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:39.112000 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-323672e8-756c-4ab5-a284-ae3bd22896c9 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:39.113240 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-3fe8be73-9f1f-4f6d-b28b-ec61d71ad657 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:39.117497 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-323672e8-756c-4ab5-a284-ae3bd22896c9 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:39.122313 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-323672e8-756c-4ab5-a284-ae3bd22896c9 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/f620f083-7230-471a-87d0-f6d85f8ad087" status: 200 len: 1266 microversion: 2.25 time: 0.204012 Aug 27 02:46:39.127859 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-3fe8be73-9f1f-4f6d-b28b-ec61d71ad657 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:39.129679 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-3fe8be73-9f1f-4f6d-b28b-ec61d71ad657 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:39.132139 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-3fe8be73-9f1f-4f6d-b28b-ec61d71ad657 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] 10.222.0.70 "GET /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a" status: 200 len: 1875 microversion: 2.42 time: 0.490333 Aug 27 02:46:39.144645 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 753/1510] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:46:38 2022] GET /compute/v2.1/servers/f620f083-7230-471a-87d0-f6d85f8ad087 => generated 1266 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:46:39.145284 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 758/1511] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:46:38 2022] GET /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a => generated 1875 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:46:39.156387 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-90dc85ba-a522-4400-bb23-8d366c866ce2 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:39.157396 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-90dc85ba-a522-4400-bb23-8d366c866ce2 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] [instance: 13799829-bea9-44c8-9993-89cdc60e7d74] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:39.164207 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-90dc85ba-a522-4400-bb23-8d366c866ce2 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:39.164961 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-90dc85ba-a522-4400-bb23-8d366c866ce2 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:39.165594 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-90dc85ba-a522-4400-bb23-8d366c866ce2 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:39.166543 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-90dc85ba-a522-4400-bb23-8d366c866ce2 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:39.167149 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-90dc85ba-a522-4400-bb23-8d366c866ce2 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:39.167781 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-90dc85ba-a522-4400-bb23-8d366c866ce2 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:39.344191 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-90dc85ba-a522-4400-bb23-8d366c866ce2 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e86c17fe83848e2bc96b7c83ff1cf14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5668e6d96694c62b83f7e8381fe86e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:39.353336 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-90dc85ba-a522-4400-bb23-8d366c866ce2 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] 10.222.0.70 "GET /compute/v2.1/servers/13799829-bea9-44c8-9993-89cdc60e7d74" status: 200 len: 1325 microversion: 2.1 time: 0.206455 Aug 27 02:46:39.354813 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 759/1512] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:39 2022] GET /compute/v2.1/servers/13799829-bea9-44c8-9993-89cdc60e7d74 => generated 1325 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:39.360163 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-6a00f055-1571-4046-8d0f-149c2de7c24c tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:39.361185 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-6a00f055-1571-4046-8d0f-149c2de7c24c tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: c7391538-81d0-4eb1-bff9-e151e2ee4c3a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:39.363144 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9fb5d7f8-a97d-4d74-8da7-d43fd3ff7d2c tempest-ExtensionsTest-312894358 tempest-ExtensionsTest-312894358-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:39.365128 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9fb5d7f8-a97d-4d74-8da7-d43fd3ff7d2c tempest-ExtensionsTest-312894358 tempest-ExtensionsTest-312894358-project] 10.222.0.70 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.224829 Aug 27 02:46:39.368221 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6a00f055-1571-4046-8d0f-149c2de7c24c tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:39.368927 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6a00f055-1571-4046-8d0f-149c2de7c24c tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:39.369601 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6a00f055-1571-4046-8d0f-149c2de7c24c tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:39.370521 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6a00f055-1571-4046-8d0f-149c2de7c24c tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:39.371013 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6a00f055-1571-4046-8d0f-149c2de7c24c tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:39.371138 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 754/1513] 10.222.0.70 () {58 vars in 1170 bytes} [Sat Aug 27 02:46:39 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:46:39.371554 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6a00f055-1571-4046-8d0f-149c2de7c24c tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:39.376579 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=100 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:46:39.377296 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-477b4f5d-e464-44d4-9641-510f1a0ff5fa tempest-ExtensionsTest-312894358 tempest-ExtensionsTest-312894358-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:39.379758 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-477b4f5d-e464-44d4-9641-510f1a0ff5fa tempest-ExtensionsTest-312894358 tempest-ExtensionsTest-312894358-project] 10.222.0.70 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.007425 Aug 27 02:46:39.389680 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-6a00f055-1571-4046-8d0f-149c2de7c24c tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] HTTP exception thrown: Instance c7391538-81d0-4eb1-bff9-e151e2ee4c3a could not be found. Aug 27 02:46:39.391926 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-6a00f055-1571-4046-8d0f-149c2de7c24c tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Request method failure captured: Aug 27 02:46:39.391926 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/c7391538-81d0-4eb1-bff9-e151e2ee4c3a HTTP/1.1 Aug 27 02:46:39.391926 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:46:39.391926 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:46:39.391926 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:46:39.391926 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:46:39.391926 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:46:39.391926 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:46:39.391926 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:46:39.391926 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:46:39.391926 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYSgO5iP2Rj0OnjMZjg06AspC2AGCawaQncXH6RR0w6SmRKlRtLBLi7PcPgHNU9vdqMkMafrqdLcVHKkwB4D8nTCptd_7hF6weX6SAII7uRF-eRfBaai4y8PcTnfOVHHGeDAMA19n6IWPYlb4txBKWYFlublH5xab2iApkdg2a67esA Aug 27 02:46:39.391926 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:46:39.391926 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:46:39.391926 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:46:39.391926 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:46:39.391926 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:46:39.391926 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:46:39.391926 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: b105816fd4e54b9da4973ff721e1fb92 Aug 27 02:46:39.391926 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ServersOnMultiNodesTest-355465396 Aug 27 02:46:39.391926 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:46:39.391926 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:46:39.393797 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b105816fd4e54b9da4973ff721e1fb92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_b105816fd4e54b9da4973ff721e1fb92", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b105816fd4e54b9da4973ff721e1fb92"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/b105816fd4e54b9da4973ff721e1fb92"}]}] Aug 27 02:46:39.393797 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ServersOnMultiNodesTest-355465396 Aug 27 02:46:39.393797 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: b105816fd4e54b9da4973ff721e1fb92 Aug 27 02:46:39.393797 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-355465396 Aug 27 02:46:39.393797 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ServersOnMultiNodesTest-355465396-project Aug 27 02:46:39.393797 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:46:39.393797 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:46:39.393797 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: eb6d1646ec094e3297f6f3c51dd72e85 Aug 27 02:46:39.393797 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ServersOnMultiNodesTest-355465396-project Aug 27 02:46:39.393797 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 02:46:39.393797 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance c7391538-81d0-4eb1-bff9-e151e2ee4c3a could not be found. Aug 27 02:46:39.393797 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': 'c7391538-81d0-4eb1-bff9-e151e2ee4c3a'} Aug 27 02:46:39.394798 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:46:39.394798 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:46:39.394798 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:46:39.394798 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:46:39.394798 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:46:39.394798 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:46:39.394798 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:46:39.394798 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:46:39.394798 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:46:39.394798 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:46:39.394798 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7391538-81d0-4eb1-bff9-e151e2ee4c3a could not be found. Aug 27 02:46:39.394798 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:46:39.394798 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:46:39.394798 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:46:39.394798 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:46:39.394798 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:46:39.394798 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:46:39.394798 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:46:39.394798 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:46:39.394798 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:46:39.396405 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:46:39.396405 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:46:39.396405 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:46:39.396405 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:46:39.396405 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:46:39.396405 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:46:39.396405 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:46:39.396405 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7391538-81d0-4eb1-bff9-e151e2ee4c3a could not be found. Aug 27 02:46:39.396405 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:46:39.396405 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:46:39.396405 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:46:39.396405 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:46:39.396405 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:46:39.396405 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:46:39.396405 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:46:39.396405 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:46:39.396405 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7391538-81d0-4eb1-bff9-e151e2ee4c3a could not be found. Aug 27 02:46:39.396405 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:46:39.397787 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 755/1514] 10.222.0.70 () {58 vars in 1134 bytes} [Sat Aug 27 02:46:39 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:46:39.398687 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-6a00f055-1571-4046-8d0f-149c2de7c24c tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Returning 404 to user: Instance c7391538-81d0-4eb1-bff9-e151e2ee4c3a could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:46:39.399767 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-6a00f055-1571-4046-8d0f-149c2de7c24c tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "GET /compute/v2.1/servers/c7391538-81d0-4eb1-bff9-e151e2ee4c3a" status: 404 len: 111 microversion: 2.1 time: 0.043856 Aug 27 02:46:39.400837 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 760/1515] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:39 2022] GET /compute/v2.1/servers/c7391538-81d0-4eb1-bff9-e151e2ee4c3a => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:46:39.423515 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0aac0c29-840b-4858-afc7-11418b25eff4 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:39.424558 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-0aac0c29-840b-4858-afc7-11418b25eff4 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: 38a900db-3d56-4836-a2a9-a39fe28ab481] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:39.432497 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0aac0c29-840b-4858-afc7-11418b25eff4 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:39.433548 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0aac0c29-840b-4858-afc7-11418b25eff4 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:39.434212 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0aac0c29-840b-4858-afc7-11418b25eff4 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:39.435320 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0aac0c29-840b-4858-afc7-11418b25eff4 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:39.436203 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0aac0c29-840b-4858-afc7-11418b25eff4 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:39.436910 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0aac0c29-840b-4858-afc7-11418b25eff4 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:39.475912 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-0aac0c29-840b-4858-afc7-11418b25eff4 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: 38a900db-3d56-4836-a2a9-a39fe28ab481] Going to try to terminate instance {{(pid=134052) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:46:39.611234 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-0aac0c29-840b-4858-afc7-11418b25eff4 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "DELETE /compute/v2.1/servers/38a900db-3d56-4836-a2a9-a39fe28ab481" status: 204 len: 0 microversion: 2.1 time: 0.202757 Aug 27 02:46:39.613173 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 756/1516] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:46:39 2022] DELETE /compute/v2.1/servers/38a900db-3d56-4836-a2a9-a39fe28ab481 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:46:39.622189 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ccddf29d-c70f-4bc5-b327-9ada85cfc686 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:39.622729 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-ccddf29d-c70f-4bc5-b327-9ada85cfc686 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: 9d4a6e6e-c4d0-4397-bf32-429ae2a252ba] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:39.630481 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ccddf29d-c70f-4bc5-b327-9ada85cfc686 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:39.631162 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ccddf29d-c70f-4bc5-b327-9ada85cfc686 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:39.632543 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ccddf29d-c70f-4bc5-b327-9ada85cfc686 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:39.635275 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ccddf29d-c70f-4bc5-b327-9ada85cfc686 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:39.635932 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ccddf29d-c70f-4bc5-b327-9ada85cfc686 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:39.636894 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ccddf29d-c70f-4bc5-b327-9ada85cfc686 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:39.673756 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-ccddf29d-c70f-4bc5-b327-9ada85cfc686 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: 9d4a6e6e-c4d0-4397-bf32-429ae2a252ba] Going to try to terminate instance {{(pid=134051) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:46:39.872226 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a0af60f1-50ba-470a-aa7c-6616eefb813a tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:39.873900 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a0af60f1-50ba-470a-aa7c-6616eefb813a tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 70acfe32-deea-46fc-a214-8fdbb9f6cb7b] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:39.874937 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ccddf29d-c70f-4bc5-b327-9ada85cfc686 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "DELETE /compute/v2.1/servers/9d4a6e6e-c4d0-4397-bf32-429ae2a252ba" status: 204 len: 0 microversion: 2.1 time: 0.257326 Aug 27 02:46:39.876359 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 761/1517] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:46:39 2022] DELETE /compute/v2.1/servers/9d4a6e6e-c4d0-4397-bf32-429ae2a252ba => generated 0 bytes in 259 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 02:46:39.886838 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c5860e6d-7171-4765-a8aa-3fc3818a1c6f tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:39.888147 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-c5860e6d-7171-4765-a8aa-3fc3818a1c6f tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: 38a900db-3d56-4836-a2a9-a39fe28ab481] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:39.893865 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a0af60f1-50ba-470a-aa7c-6616eefb813a tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:39.896183 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a0af60f1-50ba-470a-aa7c-6616eefb813a tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:39.897482 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c5860e6d-7171-4765-a8aa-3fc3818a1c6f tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:39.897635 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a0af60f1-50ba-470a-aa7c-6616eefb813a tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:39.898254 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a0af60f1-50ba-470a-aa7c-6616eefb813a tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:39.899220 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c5860e6d-7171-4765-a8aa-3fc3818a1c6f tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:39.899931 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c5860e6d-7171-4765-a8aa-3fc3818a1c6f tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:39.901503 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c5860e6d-7171-4765-a8aa-3fc3818a1c6f tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:39.902538 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c5860e6d-7171-4765-a8aa-3fc3818a1c6f tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:39.902776 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a0af60f1-50ba-470a-aa7c-6616eefb813a tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:39.903285 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a0af60f1-50ba-470a-aa7c-6616eefb813a tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:39.903852 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c5860e6d-7171-4765-a8aa-3fc3818a1c6f tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:40.213466 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-a0af60f1-50ba-470a-aa7c-6616eefb813a tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:40.228079 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a0af60f1-50ba-470a-aa7c-6616eefb813a tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b" status: 200 len: 1390 microversion: 2.1 time: 0.362522 Aug 27 02:46:40.239468 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 757/1518] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:39 2022] GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b => generated 1390 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:46:40.249422 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-1cb5accb-8eb1-474d-90f4-e1ebb5036cb5 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:40.258909 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-c5860e6d-7171-4765-a8aa-3fc3818a1c6f tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6d1646ec094e3297f6f3c51dd72e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b105816fd4e54b9da4973ff721e1fb92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:40.267028 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-1cb5accb-8eb1-474d-90f4-e1ebb5036cb5 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] [instance: a00dd6f6-d48c-4938-84b1-71bec3877ad9] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:40.270146 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c5860e6d-7171-4765-a8aa-3fc3818a1c6f tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "GET /compute/v2.1/servers/38a900db-3d56-4836-a2a9-a39fe28ab481" status: 200 len: 1474 microversion: 2.1 time: 0.388832 Aug 27 02:46:40.283890 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1cb5accb-8eb1-474d-90f4-e1ebb5036cb5 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:40.283890 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1cb5accb-8eb1-474d-90f4-e1ebb5036cb5 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:40.283890 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1cb5accb-8eb1-474d-90f4-e1ebb5036cb5 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:40.283890 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1cb5accb-8eb1-474d-90f4-e1ebb5036cb5 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:40.284747 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1cb5accb-8eb1-474d-90f4-e1ebb5036cb5 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:40.284747 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1cb5accb-8eb1-474d-90f4-e1ebb5036cb5 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:40.286816 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 762/1519] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:39 2022] GET /compute/v2.1/servers/38a900db-3d56-4836-a2a9-a39fe28ab481 => generated 1474 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:46:40.291956 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8bfdb2f8-8db6-4b48-843c-6cf238b75d8c tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:40.292850 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-8bfdb2f8-8db6-4b48-843c-6cf238b75d8c tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: f620f083-7230-471a-87d0-f6d85f8ad087] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:40.301508 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8bfdb2f8-8db6-4b48-843c-6cf238b75d8c tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:40.301890 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8bfdb2f8-8db6-4b48-843c-6cf238b75d8c tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:40.302335 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8bfdb2f8-8db6-4b48-843c-6cf238b75d8c tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:40.303056 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8bfdb2f8-8db6-4b48-843c-6cf238b75d8c tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:40.303508 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8bfdb2f8-8db6-4b48-843c-6cf238b75d8c tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:40.304794 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8bfdb2f8-8db6-4b48-843c-6cf238b75d8c tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:40.321941 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-1cb5accb-8eb1-474d-90f4-e1ebb5036cb5 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] 10.222.0.70 "GET /compute/v2.1/servers/a00dd6f6-d48c-4938-84b1-71bec3877ad9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076563 Aug 27 02:46:40.322941 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 758/1520] 10.222.0.70 () {58 vars in 1302 bytes} [Sat Aug 27 02:46:40 2022] GET /compute/v2.1/servers/a00dd6f6-d48c-4938-84b1-71bec3877ad9/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:46:40.328223 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-df68a244-5a3d-4e2f-bd07-039fd1d98cc8 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:40.328995 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-df68a244-5a3d-4e2f-bd07-039fd1d98cc8 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] [instance: 484e03a9-aef3-4179-980c-0e7292a05b5a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:40.336344 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-df68a244-5a3d-4e2f-bd07-039fd1d98cc8 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:40.336905 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-df68a244-5a3d-4e2f-bd07-039fd1d98cc8 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:40.337499 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-df68a244-5a3d-4e2f-bd07-039fd1d98cc8 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:40.338215 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-df68a244-5a3d-4e2f-bd07-039fd1d98cc8 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:40.338678 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-df68a244-5a3d-4e2f-bd07-039fd1d98cc8 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:40.339587 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-df68a244-5a3d-4e2f-bd07-039fd1d98cc8 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:40.459270 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-8bfdb2f8-8db6-4b48-843c-6cf238b75d8c tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:40.474479 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-8bfdb2f8-8db6-4b48-843c-6cf238b75d8c tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:40.476191 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-8bfdb2f8-8db6-4b48-843c-6cf238b75d8c tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:40.477670 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-8bfdb2f8-8db6-4b48-843c-6cf238b75d8c tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/f620f083-7230-471a-87d0-f6d85f8ad087" status: 200 len: 1266 microversion: 2.25 time: 0.189627 Aug 27 02:46:40.495149 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 763/1521] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:46:40 2022] GET /compute/v2.1/servers/f620f083-7230-471a-87d0-f6d85f8ad087 => generated 1266 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:46:40.501205 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-451373e6-4b3e-47f2-bec3-12f5cb2a4da3 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:40.502456 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-451373e6-4b3e-47f2-bec3-12f5cb2a4da3 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] [instance: 13799829-bea9-44c8-9993-89cdc60e7d74] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:40.509626 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-451373e6-4b3e-47f2-bec3-12f5cb2a4da3 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:40.510385 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-451373e6-4b3e-47f2-bec3-12f5cb2a4da3 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:40.511004 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-451373e6-4b3e-47f2-bec3-12f5cb2a4da3 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:40.511899 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-451373e6-4b3e-47f2-bec3-12f5cb2a4da3 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:40.512540 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-451373e6-4b3e-47f2-bec3-12f5cb2a4da3 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:40.513162 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-451373e6-4b3e-47f2-bec3-12f5cb2a4da3 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:40.796931 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-df68a244-5a3d-4e2f-bd07-039fd1d98cc8 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:40.812736 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-df68a244-5a3d-4e2f-bd07-039fd1d98cc8 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:40.816965 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-df68a244-5a3d-4e2f-bd07-039fd1d98cc8 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:40.819832 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-df68a244-5a3d-4e2f-bd07-039fd1d98cc8 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] 10.222.0.70 "GET /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a" status: 200 len: 1875 microversion: 2.42 time: 0.495636 Aug 27 02:46:40.837476 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 759/1522] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:46:40 2022] GET /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a => generated 1875 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:46:40.862664 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-451373e6-4b3e-47f2-bec3-12f5cb2a4da3 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e86c17fe83848e2bc96b7c83ff1cf14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5668e6d96694c62b83f7e8381fe86e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:40.874794 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-451373e6-4b3e-47f2-bec3-12f5cb2a4da3 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] 10.222.0.70 "GET /compute/v2.1/servers/13799829-bea9-44c8-9993-89cdc60e7d74" status: 200 len: 1325 microversion: 2.1 time: 0.377678 Aug 27 02:46:40.878787 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 764/1523] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:40 2022] GET /compute/v2.1/servers/13799829-bea9-44c8-9993-89cdc60e7d74 => generated 1325 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:41.263618 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-183639a3-59fc-4c04-b812-8addeb7d0881 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:41.265095 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-183639a3-59fc-4c04-b812-8addeb7d0881 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 70acfe32-deea-46fc-a214-8fdbb9f6cb7b] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:41.276222 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-183639a3-59fc-4c04-b812-8addeb7d0881 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:41.279607 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-183639a3-59fc-4c04-b812-8addeb7d0881 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:41.280284 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-183639a3-59fc-4c04-b812-8addeb7d0881 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:41.281901 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-183639a3-59fc-4c04-b812-8addeb7d0881 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:41.285424 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-183639a3-59fc-4c04-b812-8addeb7d0881 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:41.286201 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-183639a3-59fc-4c04-b812-8addeb7d0881 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:41.292035 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-5290ca0a-f6d6-48bb-8e0f-1d092aab3422 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:41.292680 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-5290ca0a-f6d6-48bb-8e0f-1d092aab3422 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: 38a900db-3d56-4836-a2a9-a39fe28ab481] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:41.302746 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5290ca0a-f6d6-48bb-8e0f-1d092aab3422 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:41.303247 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5290ca0a-f6d6-48bb-8e0f-1d092aab3422 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:41.303678 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5290ca0a-f6d6-48bb-8e0f-1d092aab3422 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:41.304431 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5290ca0a-f6d6-48bb-8e0f-1d092aab3422 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:41.304877 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5290ca0a-f6d6-48bb-8e0f-1d092aab3422 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:41.305295 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5290ca0a-f6d6-48bb-8e0f-1d092aab3422 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:41.675120 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-5290ca0a-f6d6-48bb-8e0f-1d092aab3422 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6d1646ec094e3297f6f3c51dd72e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b105816fd4e54b9da4973ff721e1fb92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:41.692305 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-183639a3-59fc-4c04-b812-8addeb7d0881 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:41.693350 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-5290ca0a-f6d6-48bb-8e0f-1d092aab3422 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "GET /compute/v2.1/servers/38a900db-3d56-4836-a2a9-a39fe28ab481" status: 200 len: 1474 microversion: 2.1 time: 0.405154 Aug 27 02:46:41.694555 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 765/1524] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:41 2022] GET /compute/v2.1/servers/38a900db-3d56-4836-a2a9-a39fe28ab481 => generated 1474 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:41.703581 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-183639a3-59fc-4c04-b812-8addeb7d0881 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b" status: 200 len: 1390 microversion: 2.1 time: 0.446029 Aug 27 02:46:41.704243 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 760/1525] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:41 2022] GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b => generated 1390 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:41.712270 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8abcb4e0-788c-46be-8ab5-e43a46f0d89f tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:41.718978 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-8abcb4e0-788c-46be-8ab5-e43a46f0d89f tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] [instance: a00dd6f6-d48c-4938-84b1-71bec3877ad9] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:41.721521 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f9f50f82-743c-4e08-807a-ca896d70f531 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:41.722134 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-f9f50f82-743c-4e08-807a-ca896d70f531 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: f620f083-7230-471a-87d0-f6d85f8ad087] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:41.730539 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f9f50f82-743c-4e08-807a-ca896d70f531 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:41.731414 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f9f50f82-743c-4e08-807a-ca896d70f531 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:41.732166 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f9f50f82-743c-4e08-807a-ca896d70f531 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:41.733214 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f9f50f82-743c-4e08-807a-ca896d70f531 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:41.733964 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f9f50f82-743c-4e08-807a-ca896d70f531 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:41.734626 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f9f50f82-743c-4e08-807a-ca896d70f531 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:41.735891 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8abcb4e0-788c-46be-8ab5-e43a46f0d89f tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:41.736433 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8abcb4e0-788c-46be-8ab5-e43a46f0d89f tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:41.736884 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8abcb4e0-788c-46be-8ab5-e43a46f0d89f tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:41.739201 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8abcb4e0-788c-46be-8ab5-e43a46f0d89f tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:41.741432 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8abcb4e0-788c-46be-8ab5-e43a46f0d89f tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:41.741868 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8abcb4e0-788c-46be-8ab5-e43a46f0d89f tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:41.817692 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-8abcb4e0-788c-46be-8ab5-e43a46f0d89f tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] 10.222.0.70 "GET /compute/v2.1/servers/a00dd6f6-d48c-4938-84b1-71bec3877ad9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.119504 Aug 27 02:46:41.818952 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 766/1526] 10.222.0.70 () {58 vars in 1302 bytes} [Sat Aug 27 02:46:41 2022] GET /compute/v2.1/servers/a00dd6f6-d48c-4938-84b1-71bec3877ad9/os-volume_attachments => generated 25 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:46:41.828512 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-ce4dca1a-212f-40ba-a10a-f448c01d1410 req-d7beb711-9cb9-459e-8eb4-e9414de5b9b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38a900db-3d56-4836-a2a9-a39fe28ab481", "name": "network-vif-deleted", "tag": "8509ffd4-5c61-44af-8b1e-301681acca1a"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:46:41.837871 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-f9f50f82-743c-4e08-807a-ca896d70f531 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:41.842139 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-ce4dca1a-212f-40ba-a10a-f448c01d1410 req-d7beb711-9cb9-459e-8eb4-e9414de5b9b9 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:41.844127 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-ce4dca1a-212f-40ba-a10a-f448c01d1410 req-d7beb711-9cb9-459e-8eb4-e9414de5b9b9 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:41.845129 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-ce4dca1a-212f-40ba-a10a-f448c01d1410 req-d7beb711-9cb9-459e-8eb4-e9414de5b9b9 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:41.850685 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-f9f50f82-743c-4e08-807a-ca896d70f531 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:41.852202 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-f9f50f82-743c-4e08-807a-ca896d70f531 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:41.856464 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f9f50f82-743c-4e08-807a-ca896d70f531 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/f620f083-7230-471a-87d0-f6d85f8ad087" status: 200 len: 1266 microversion: 2.25 time: 0.151191 Aug 27 02:46:41.858969 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 761/1527] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:46:41 2022] GET /compute/v2.1/servers/f620f083-7230-471a-87d0-f6d85f8ad087 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:46:41.862763 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-ce4dca1a-212f-40ba-a10a-f448c01d1410 req-d7beb711-9cb9-459e-8eb4-e9414de5b9b9 service nova] Creating event network-vif-deleted:8509ffd4-5c61-44af-8b1e-301681acca1a for instance 38a900db-3d56-4836-a2a9-a39fe28ab481 on n-h2-852278-4 Aug 27 02:46:41.871855 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-ce4dca1a-212f-40ba-a10a-f448c01d1410 req-d7beb711-9cb9-459e-8eb4-e9414de5b9b9 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051405 Aug 27 02:46:41.876497 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 767/1528] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:46:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:46:41.879677 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9b077f99-ee54-4eef-9587-615ac050df0e tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:41.880395 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-9b077f99-ee54-4eef-9587-615ac050df0e tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] [instance: 484e03a9-aef3-4179-980c-0e7292a05b5a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:41.887875 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9b077f99-ee54-4eef-9587-615ac050df0e tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:41.893572 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9b077f99-ee54-4eef-9587-615ac050df0e tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:41.894031 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9b077f99-ee54-4eef-9587-615ac050df0e tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:41.894781 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9b077f99-ee54-4eef-9587-615ac050df0e tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:41.895234 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9b077f99-ee54-4eef-9587-615ac050df0e tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:41.895657 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9b077f99-ee54-4eef-9587-615ac050df0e tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:41.903448 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4b31e28e-3b39-4530-8a80-8f7650b15b8f tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:41.905437 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-4b31e28e-3b39-4530-8a80-8f7650b15b8f tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] [instance: 13799829-bea9-44c8-9993-89cdc60e7d74] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:41.916655 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4b31e28e-3b39-4530-8a80-8f7650b15b8f tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:41.926767 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4b31e28e-3b39-4530-8a80-8f7650b15b8f tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:41.927429 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4b31e28e-3b39-4530-8a80-8f7650b15b8f tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:41.929541 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4b31e28e-3b39-4530-8a80-8f7650b15b8f tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:41.930929 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4b31e28e-3b39-4530-8a80-8f7650b15b8f tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:41.933013 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4b31e28e-3b39-4530-8a80-8f7650b15b8f tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:42.471257 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-4b31e28e-3b39-4530-8a80-8f7650b15b8f tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e86c17fe83848e2bc96b7c83ff1cf14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5668e6d96694c62b83f7e8381fe86e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:42.493337 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-4b31e28e-3b39-4530-8a80-8f7650b15b8f tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] 10.222.0.70 "GET /compute/v2.1/servers/13799829-bea9-44c8-9993-89cdc60e7d74" status: 200 len: 1325 microversion: 2.1 time: 0.587468 Aug 27 02:46:42.494748 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 768/1529] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:41 2022] GET /compute/v2.1/servers/13799829-bea9-44c8-9993-89cdc60e7d74 => generated 1325 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:42.511583 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-0d6e94f4-aa97-4d93-b2c5-5c425246f15b req-6c64289e-d954-42cb-a444-a0b51d8472a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d4a6e6e-c4d0-4397-bf32-429ae2a252ba", "name": "network-vif-deleted", "tag": "1771be5b-38e4-4698-b32c-eae8637cc438"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:46:42.527935 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-0d6e94f4-aa97-4d93-b2c5-5c425246f15b req-6c64289e-d954-42cb-a444-a0b51d8472a6 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:42.528674 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-0d6e94f4-aa97-4d93-b2c5-5c425246f15b req-6c64289e-d954-42cb-a444-a0b51d8472a6 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:42.530796 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-0d6e94f4-aa97-4d93-b2c5-5c425246f15b req-6c64289e-d954-42cb-a444-a0b51d8472a6 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:42.548968 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-0d6e94f4-aa97-4d93-b2c5-5c425246f15b req-6c64289e-d954-42cb-a444-a0b51d8472a6 service nova] Creating event network-vif-deleted:1771be5b-38e4-4698-b32c-eae8637cc438 for instance 9d4a6e6e-c4d0-4397-bf32-429ae2a252ba on n-h1-852278-4 Aug 27 02:46:42.555303 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-0d6e94f4-aa97-4d93-b2c5-5c425246f15b req-6c64289e-d954-42cb-a444-a0b51d8472a6 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058561 Aug 27 02:46:42.561621 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 769/1530] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:46:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:46:42.619627 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-9b077f99-ee54-4eef-9587-615ac050df0e tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:42.635862 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-9b077f99-ee54-4eef-9587-615ac050df0e tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:42.637527 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-9b077f99-ee54-4eef-9587-615ac050df0e tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:42.641410 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9b077f99-ee54-4eef-9587-615ac050df0e tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] 10.222.0.70 "GET /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a" status: 200 len: 1875 microversion: 2.42 time: 0.779814 Aug 27 02:46:42.642000 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 762/1531] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:46:41 2022] GET /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a => generated 1875 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:46:42.716163 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-1a61cd79-95dc-4235-8f53-17454c581f8a tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:42.717053 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-1a61cd79-95dc-4235-8f53-17454c581f8a tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: 38a900db-3d56-4836-a2a9-a39fe28ab481] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:42.726017 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1a61cd79-95dc-4235-8f53-17454c581f8a tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:42.733076 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-85906f42-3c6f-4625-8cef-58311d8ba056 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:42.734238 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-85906f42-3c6f-4625-8cef-58311d8ba056 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 70acfe32-deea-46fc-a214-8fdbb9f6cb7b] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:42.737091 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1a61cd79-95dc-4235-8f53-17454c581f8a tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:42.739087 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1a61cd79-95dc-4235-8f53-17454c581f8a tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:42.739905 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1a61cd79-95dc-4235-8f53-17454c581f8a tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:42.740724 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1a61cd79-95dc-4235-8f53-17454c581f8a tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:42.742689 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1a61cd79-95dc-4235-8f53-17454c581f8a tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:42.745565 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-85906f42-3c6f-4625-8cef-58311d8ba056 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:42.746074 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-85906f42-3c6f-4625-8cef-58311d8ba056 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:42.746517 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-85906f42-3c6f-4625-8cef-58311d8ba056 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:42.748170 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-85906f42-3c6f-4625-8cef-58311d8ba056 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:42.748904 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-85906f42-3c6f-4625-8cef-58311d8ba056 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:42.749699 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-85906f42-3c6f-4625-8cef-58311d8ba056 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:42.756409 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:46:42.824000 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1a61cd79-95dc-4235-8f53-17454c581f8a tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:42.825518 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1a61cd79-95dc-4235-8f53-17454c581f8a tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:42.827073 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1a61cd79-95dc-4235-8f53-17454c581f8a tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:42.827724 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.objects.instance [None req-1a61cd79-95dc-4235-8f53-17454c581f8a tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lazy-loading 'fault' on Instance uuid 38a900db-3d56-4836-a2a9-a39fe28ab481 {{(pid=134051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:46:42.909397 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-1a61cd79-95dc-4235-8f53-17454c581f8a tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6d1646ec094e3297f6f3c51dd72e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b105816fd4e54b9da4973ff721e1fb92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:42.922231 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-1a61cd79-95dc-4235-8f53-17454c581f8a tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "GET /compute/v2.1/servers/38a900db-3d56-4836-a2a9-a39fe28ab481" status: 200 len: 1309 microversion: 2.1 time: 0.211267 Aug 27 02:46:42.925627 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 770/1532] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:42 2022] GET /compute/v2.1/servers/38a900db-3d56-4836-a2a9-a39fe28ab481 => generated 1309 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:42.938668 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-6a0c7bb3-373d-470d-bbc6-509073af48e9 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:42.940747 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-6a0c7bb3-373d-470d-bbc6-509073af48e9 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: f620f083-7230-471a-87d0-f6d85f8ad087] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:42.957145 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6a0c7bb3-373d-470d-bbc6-509073af48e9 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:42.960917 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6a0c7bb3-373d-470d-bbc6-509073af48e9 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:42.961374 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6a0c7bb3-373d-470d-bbc6-509073af48e9 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:42.962306 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6a0c7bb3-373d-470d-bbc6-509073af48e9 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:42.962765 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6a0c7bb3-373d-470d-bbc6-509073af48e9 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:42.963186 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6a0c7bb3-373d-470d-bbc6-509073af48e9 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:43.002925 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-85906f42-3c6f-4625-8cef-58311d8ba056 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:43.015677 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-85906f42-3c6f-4625-8cef-58311d8ba056 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b" status: 200 len: 1390 microversion: 2.1 time: 0.287377 Aug 27 02:46:43.016630 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 763/1533] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:42 2022] GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b => generated 1390 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:43.056814 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-6a0c7bb3-373d-470d-bbc6-509073af48e9 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:43.067566 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-6a0c7bb3-373d-470d-bbc6-509073af48e9 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:43.070072 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-6a0c7bb3-373d-470d-bbc6-509073af48e9 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:43.080006 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-6a0c7bb3-373d-470d-bbc6-509073af48e9 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/f620f083-7230-471a-87d0-f6d85f8ad087" status: 200 len: 1266 microversion: 2.25 time: 0.144580 Aug 27 02:46:43.082813 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 771/1534] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:46:42 2022] GET /compute/v2.1/servers/f620f083-7230-471a-87d0-f6d85f8ad087 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:46:43.232380 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-27e1e0e6-c60c-4808-b792-3dafbd5a55e1 req-3568cc05-5cec-4a26-a967-08f4dd3b9458 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "484e03a9-aef3-4179-980c-0e7292a05b5a", "name": "network-vif-plugged", "status": "completed", "tag": "cd7a0d56-e84b-4f98-9baf-449824810d8d"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:46:43.246600 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-27e1e0e6-c60c-4808-b792-3dafbd5a55e1 req-3568cc05-5cec-4a26-a967-08f4dd3b9458 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:43.249108 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-27e1e0e6-c60c-4808-b792-3dafbd5a55e1 req-3568cc05-5cec-4a26-a967-08f4dd3b9458 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:43.249674 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-27e1e0e6-c60c-4808-b792-3dafbd5a55e1 req-3568cc05-5cec-4a26-a967-08f4dd3b9458 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:43.265748 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-27e1e0e6-c60c-4808-b792-3dafbd5a55e1 req-3568cc05-5cec-4a26-a967-08f4dd3b9458 service nova] Creating event network-vif-plugged:cd7a0d56-e84b-4f98-9baf-449824810d8d for instance 484e03a9-aef3-4179-980c-0e7292a05b5a on n-h1-852278-4 Aug 27 02:46:43.273843 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-27e1e0e6-c60c-4808-b792-3dafbd5a55e1 req-3568cc05-5cec-4a26-a967-08f4dd3b9458 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044876 Aug 27 02:46:43.275542 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 764/1535] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:46:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:46:43.515724 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-066ee7de-230a-4948-be6d-8964229ce721 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:43.516588 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-066ee7de-230a-4948-be6d-8964229ce721 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] [instance: 13799829-bea9-44c8-9993-89cdc60e7d74] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:43.525625 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-066ee7de-230a-4948-be6d-8964229ce721 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:43.526330 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-066ee7de-230a-4948-be6d-8964229ce721 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:43.526934 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-066ee7de-230a-4948-be6d-8964229ce721 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:43.527886 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-066ee7de-230a-4948-be6d-8964229ce721 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:43.528524 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-066ee7de-230a-4948-be6d-8964229ce721 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:43.529145 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-066ee7de-230a-4948-be6d-8964229ce721 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:43.678849 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b71a049c-f1b3-438f-bc25-bb451272fa5e tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:43.682606 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b71a049c-f1b3-438f-bc25-bb451272fa5e tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] [instance: 484e03a9-aef3-4179-980c-0e7292a05b5a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:43.717640 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-066ee7de-230a-4948-be6d-8964229ce721 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e86c17fe83848e2bc96b7c83ff1cf14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5668e6d96694c62b83f7e8381fe86e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:43.726288 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-066ee7de-230a-4948-be6d-8964229ce721 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] 10.222.0.70 "GET /compute/v2.1/servers/13799829-bea9-44c8-9993-89cdc60e7d74" status: 200 len: 1325 microversion: 2.1 time: 0.214935 Aug 27 02:46:43.726889 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 772/1536] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:43 2022] GET /compute/v2.1/servers/13799829-bea9-44c8-9993-89cdc60e7d74 => generated 1325 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:43.729287 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b71a049c-f1b3-438f-bc25-bb451272fa5e tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:43.730176 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b71a049c-f1b3-438f-bc25-bb451272fa5e tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:43.730783 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b71a049c-f1b3-438f-bc25-bb451272fa5e tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:43.731709 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b71a049c-f1b3-438f-bc25-bb451272fa5e tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:43.732383 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b71a049c-f1b3-438f-bc25-bb451272fa5e tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:43.733055 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b71a049c-f1b3-438f-bc25-bb451272fa5e tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:43.944197 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d5a9c0c8-5a1b-404c-a261-7e8592c0e7a5 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:43.944831 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d5a9c0c8-5a1b-404c-a261-7e8592c0e7a5 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: 38a900db-3d56-4836-a2a9-a39fe28ab481] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:43.952051 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d5a9c0c8-5a1b-404c-a261-7e8592c0e7a5 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:43.952569 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d5a9c0c8-5a1b-404c-a261-7e8592c0e7a5 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:43.953009 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d5a9c0c8-5a1b-404c-a261-7e8592c0e7a5 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:43.953721 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d5a9c0c8-5a1b-404c-a261-7e8592c0e7a5 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:43.954175 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d5a9c0c8-5a1b-404c-a261-7e8592c0e7a5 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:43.954613 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d5a9c0c8-5a1b-404c-a261-7e8592c0e7a5 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:43.985308 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b71a049c-f1b3-438f-bc25-bb451272fa5e tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:43.994099 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-d5a9c0c8-5a1b-404c-a261-7e8592c0e7a5 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] HTTP exception thrown: Instance 38a900db-3d56-4836-a2a9-a39fe28ab481 could not be found. Aug 27 02:46:43.996128 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d5a9c0c8-5a1b-404c-a261-7e8592c0e7a5 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Request method failure captured: Aug 27 02:46:43.996128 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/38a900db-3d56-4836-a2a9-a39fe28ab481 HTTP/1.1 Aug 27 02:46:43.996128 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:46:43.996128 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:46:43.996128 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:46:43.996128 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:46:43.996128 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:46:43.996128 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:46:43.996128 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:46:43.996128 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:46:43.996128 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYSgO5iP2Rj0OnjMZjg06AspC2AGCawaQncXH6RR0w6SmRKlRtLBLi7PcPgHNU9vdqMkMafrqdLcVHKkwB4D8nTCptd_7hF6weX6SAII7uRF-eRfBaai4y8PcTnfOVHHGeDAMA19n6IWPYlb4txBKWYFlublH5xab2iApkdg2a67esA Aug 27 02:46:43.996128 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:46:43.996128 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:46:43.996128 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:46:43.996128 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:46:43.996128 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:46:43.996128 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:46:43.996128 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: b105816fd4e54b9da4973ff721e1fb92 Aug 27 02:46:43.996128 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ServersOnMultiNodesTest-355465396 Aug 27 02:46:43.996128 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:46:43.996128 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:46:43.998058 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b105816fd4e54b9da4973ff721e1fb92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_b105816fd4e54b9da4973ff721e1fb92", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b105816fd4e54b9da4973ff721e1fb92"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/b105816fd4e54b9da4973ff721e1fb92"}]}] Aug 27 02:46:43.998058 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ServersOnMultiNodesTest-355465396 Aug 27 02:46:43.998058 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: b105816fd4e54b9da4973ff721e1fb92 Aug 27 02:46:43.998058 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-355465396 Aug 27 02:46:43.998058 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ServersOnMultiNodesTest-355465396-project Aug 27 02:46:43.998058 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:46:43.998058 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:46:43.998058 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: eb6d1646ec094e3297f6f3c51dd72e85 Aug 27 02:46:43.998058 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ServersOnMultiNodesTest-355465396-project Aug 27 02:46:43.998058 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 02:46:43.998058 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance 38a900db-3d56-4836-a2a9-a39fe28ab481 could not be found. Aug 27 02:46:43.998058 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '38a900db-3d56-4836-a2a9-a39fe28ab481'} Aug 27 02:46:43.999093 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:46:43.999093 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:46:43.999093 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:46:43.999093 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:46:43.999093 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:46:43.999093 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:46:43.999093 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:46:43.999093 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:46:43.999093 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:46:43.999093 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:46:43.999093 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38a900db-3d56-4836-a2a9-a39fe28ab481 could not be found. Aug 27 02:46:43.999093 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:46:43.999093 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:46:43.999093 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:46:43.999093 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:46:43.999093 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:46:43.999093 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:46:43.999093 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:46:43.999093 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:46:43.999093 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:46:44.000730 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:46:44.000730 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:46:44.000730 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:46:44.000730 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:46:44.000730 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:46:44.000730 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:46:44.000730 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:46:44.000730 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38a900db-3d56-4836-a2a9-a39fe28ab481 could not be found. Aug 27 02:46:44.000730 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:46:44.000730 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:46:44.000730 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:46:44.000730 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:46:44.000730 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:46:44.000730 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:46:44.000730 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:46:44.000730 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:46:44.000730 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38a900db-3d56-4836-a2a9-a39fe28ab481 could not be found. Aug 27 02:46:44.000730 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:46:44.002072 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b71a049c-f1b3-438f-bc25-bb451272fa5e tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:44.002072 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b71a049c-f1b3-438f-bc25-bb451272fa5e tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:44.002618 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b71a049c-f1b3-438f-bc25-bb451272fa5e tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] 10.222.0.70 "GET /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a" status: 200 len: 1875 microversion: 2.42 time: 0.336272 Aug 27 02:46:44.003411 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 765/1537] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:46:43 2022] GET /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a => generated 1875 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:46:44.003733 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d5a9c0c8-5a1b-404c-a261-7e8592c0e7a5 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Returning 404 to user: Instance 38a900db-3d56-4836-a2a9-a39fe28ab481 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:46:44.005576 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d5a9c0c8-5a1b-404c-a261-7e8592c0e7a5 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "GET /compute/v2.1/servers/38a900db-3d56-4836-a2a9-a39fe28ab481" status: 404 len: 111 microversion: 2.1 time: 0.065530 Aug 27 02:46:44.006438 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 773/1538] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:43 2022] GET /compute/v2.1/servers/38a900db-3d56-4836-a2a9-a39fe28ab481 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 02:46:44.015924 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-216985a9-51f7-4b28-b932-d0a29976b783 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:44.016801 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-216985a9-51f7-4b28-b932-d0a29976b783 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: 9d4a6e6e-c4d0-4397-bf32-429ae2a252ba] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:44.024520 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-216985a9-51f7-4b28-b932-d0a29976b783 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:44.025017 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-216985a9-51f7-4b28-b932-d0a29976b783 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:44.025450 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-216985a9-51f7-4b28-b932-d0a29976b783 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:44.026413 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-216985a9-51f7-4b28-b932-d0a29976b783 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:44.026862 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-216985a9-51f7-4b28-b932-d0a29976b783 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:44.027279 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-216985a9-51f7-4b28-b932-d0a29976b783 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:44.036875 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-83d522b5-ce08-4d35-b596-b89b27ab84b4 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:44.037891 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-83d522b5-ce08-4d35-b596-b89b27ab84b4 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 70acfe32-deea-46fc-a214-8fdbb9f6cb7b] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:44.044250 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-83d522b5-ce08-4d35-b596-b89b27ab84b4 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:44.045082 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-83d522b5-ce08-4d35-b596-b89b27ab84b4 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:44.045576 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-83d522b5-ce08-4d35-b596-b89b27ab84b4 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:44.046295 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-83d522b5-ce08-4d35-b596-b89b27ab84b4 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:44.046749 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-83d522b5-ce08-4d35-b596-b89b27ab84b4 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:44.047175 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-83d522b5-ce08-4d35-b596-b89b27ab84b4 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:44.058730 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-216985a9-51f7-4b28-b932-d0a29976b783 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] HTTP exception thrown: Instance 9d4a6e6e-c4d0-4397-bf32-429ae2a252ba could not be found. Aug 27 02:46:44.062487 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-216985a9-51f7-4b28-b932-d0a29976b783 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Request method failure captured: Aug 27 02:46:44.062487 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/servers/9d4a6e6e-c4d0-4397-bf32-429ae2a252ba HTTP/1.1 Aug 27 02:46:44.062487 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:46:44.062487 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:46:44.062487 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:46:44.062487 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:46:44.062487 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:46:44.062487 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:46:44.062487 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:46:44.062487 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:46:44.062487 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYSgO5iP2Rj0OnjMZjg06AspC2AGCawaQncXH6RR0w6SmRKlRtLBLi7PcPgHNU9vdqMkMafrqdLcVHKkwB4D8nTCptd_7hF6weX6SAII7uRF-eRfBaai4y8PcTnfOVHHGeDAMA19n6IWPYlb4txBKWYFlublH5xab2iApkdg2a67esA Aug 27 02:46:44.062487 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:46:44.062487 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:46:44.062487 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:46:44.062487 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:46:44.062487 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:46:44.062487 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:46:44.062487 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: b105816fd4e54b9da4973ff721e1fb92 Aug 27 02:46:44.062487 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ServersOnMultiNodesTest-355465396 Aug 27 02:46:44.062487 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:46:44.062487 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:46:44.064043 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b105816fd4e54b9da4973ff721e1fb92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_b105816fd4e54b9da4973ff721e1fb92", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b105816fd4e54b9da4973ff721e1fb92"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/b105816fd4e54b9da4973ff721e1fb92"}]}] Aug 27 02:46:44.064043 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ServersOnMultiNodesTest-355465396 Aug 27 02:46:44.064043 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: b105816fd4e54b9da4973ff721e1fb92 Aug 27 02:46:44.064043 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-355465396 Aug 27 02:46:44.064043 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ServersOnMultiNodesTest-355465396-project Aug 27 02:46:44.064043 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:46:44.064043 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:46:44.064043 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: eb6d1646ec094e3297f6f3c51dd72e85 Aug 27 02:46:44.064043 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ServersOnMultiNodesTest-355465396-project Aug 27 02:46:44.064043 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 02:46:44.064043 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance 9d4a6e6e-c4d0-4397-bf32-429ae2a252ba could not be found. Aug 27 02:46:44.064043 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '9d4a6e6e-c4d0-4397-bf32-429ae2a252ba'} Aug 27 02:46:44.064935 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:46:44.064935 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:46:44.064935 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:46:44.064935 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:46:44.064935 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:46:44.064935 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:46:44.064935 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:46:44.064935 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:46:44.064935 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:46:44.064935 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:46:44.064935 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d4a6e6e-c4d0-4397-bf32-429ae2a252ba could not be found. Aug 27 02:46:44.064935 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:46:44.064935 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:46:44.064935 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:46:44.064935 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:46:44.064935 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:46:44.064935 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:46:44.064935 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:46:44.064935 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:46:44.064935 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:46:44.066871 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:46:44.066871 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:46:44.066871 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:46:44.066871 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:46:44.066871 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:46:44.066871 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:46:44.066871 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:46:44.066871 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d4a6e6e-c4d0-4397-bf32-429ae2a252ba could not be found. Aug 27 02:46:44.066871 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:46:44.066871 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:46:44.066871 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:46:44.066871 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:46:44.066871 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:46:44.066871 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:46:44.066871 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:46:44.066871 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:46:44.066871 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d4a6e6e-c4d0-4397-bf32-429ae2a252ba could not be found. Aug 27 02:46:44.066871 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:46:44.069394 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-216985a9-51f7-4b28-b932-d0a29976b783 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Returning 404 to user: Instance 9d4a6e6e-c4d0-4397-bf32-429ae2a252ba could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:46:44.069394 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-216985a9-51f7-4b28-b932-d0a29976b783 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "GET /compute/v2.1/servers/9d4a6e6e-c4d0-4397-bf32-429ae2a252ba" status: 404 len: 111 microversion: 2.1 time: 0.053391 Aug 27 02:46:44.069394 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 766/1539] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:44 2022] GET /compute/v2.1/servers/9d4a6e6e-c4d0-4397-bf32-429ae2a252ba => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:46:44.075927 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-533646be-a485-4cbe-b08b-b9a2b70ab16e tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:44.132681 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-533646be-a485-4cbe-b08b-b9a2b70ab16e tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "DELETE /compute/v2.1/os-server-groups/8c76dad9-8b1d-4581-a97a-c6ecd0a004e4" status: 204 len: 0 microversion: 2.1 time: 0.060892 Aug 27 02:46:44.139096 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 767/1540] 10.222.0.70 () {58 vars in 1266 bytes} [Sat Aug 27 02:46:44 2022] DELETE /compute/v2.1/os-server-groups/8c76dad9-8b1d-4581-a97a-c6ecd0a004e4 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:46:44.150278 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e0f54f10-b249-494f-9955-4a4bfa19d509 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:44.154116 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-e0f54f10-b249-494f-9955-4a4bfa19d509 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: f620f083-7230-471a-87d0-f6d85f8ad087] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:44.165173 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e0f54f10-b249-494f-9955-4a4bfa19d509 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:44.165662 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e0f54f10-b249-494f-9955-4a4bfa19d509 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:44.166149 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e0f54f10-b249-494f-9955-4a4bfa19d509 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:44.166861 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e0f54f10-b249-494f-9955-4a4bfa19d509 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:44.167540 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e0f54f10-b249-494f-9955-4a4bfa19d509 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:44.168145 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e0f54f10-b249-494f-9955-4a4bfa19d509 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:44.284437 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-e0f54f10-b249-494f-9955-4a4bfa19d509 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:44.301290 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-e0f54f10-b249-494f-9955-4a4bfa19d509 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:44.308232 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-e0f54f10-b249-494f-9955-4a4bfa19d509 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:44.310105 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e0f54f10-b249-494f-9955-4a4bfa19d509 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/f620f083-7230-471a-87d0-f6d85f8ad087" status: 200 len: 1266 microversion: 2.25 time: 0.168977 Aug 27 02:46:44.313255 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 768/1541] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:46:44 2022] GET /compute/v2.1/servers/f620f083-7230-471a-87d0-f6d85f8ad087 => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:46:44.323172 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8e09e6dc-90e3-4616-88c4-fb619383cba7 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:44.326066 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-8e09e6dc-90e3-4616-88c4-fb619383cba7 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: 0ae31518-b08f-4255-a850-2b90b48ae7d4] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:44.340079 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-83d522b5-ce08-4d35-b596-b89b27ab84b4 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:44.353349 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8e09e6dc-90e3-4616-88c4-fb619383cba7 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:44.356590 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-83d522b5-ce08-4d35-b596-b89b27ab84b4 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b" status: 200 len: 1390 microversion: 2.1 time: 0.322024 Aug 27 02:46:44.358117 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8e09e6dc-90e3-4616-88c4-fb619383cba7 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:44.359079 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 774/1542] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:44 2022] GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b => generated 1390 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:46:44.359758 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8e09e6dc-90e3-4616-88c4-fb619383cba7 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:44.360762 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8e09e6dc-90e3-4616-88c4-fb619383cba7 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:44.361514 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8e09e6dc-90e3-4616-88c4-fb619383cba7 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:44.362721 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8e09e6dc-90e3-4616-88c4-fb619383cba7 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:44.403382 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-8e09e6dc-90e3-4616-88c4-fb619383cba7 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: 0ae31518-b08f-4255-a850-2b90b48ae7d4] Going to try to terminate instance {{(pid=134052) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:46:44.547604 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-8e09e6dc-90e3-4616-88c4-fb619383cba7 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "DELETE /compute/v2.1/servers/0ae31518-b08f-4255-a850-2b90b48ae7d4" status: 204 len: 0 microversion: 2.1 time: 0.231730 Aug 27 02:46:44.548282 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 769/1543] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:46:44 2022] DELETE /compute/v2.1/servers/0ae31518-b08f-4255-a850-2b90b48ae7d4 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:46:44.556727 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a963a789-2e46-4de2-b477-0249a6074bbe tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:44.557227 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-a963a789-2e46-4de2-b477-0249a6074bbe tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: 84d00bab-3efd-4f19-8f48-8c4b2fba864a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:44.563860 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a963a789-2e46-4de2-b477-0249a6074bbe tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:44.564404 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a963a789-2e46-4de2-b477-0249a6074bbe tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:44.565101 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a963a789-2e46-4de2-b477-0249a6074bbe tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:44.566014 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a963a789-2e46-4de2-b477-0249a6074bbe tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:44.566729 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a963a789-2e46-4de2-b477-0249a6074bbe tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:44.567340 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a963a789-2e46-4de2-b477-0249a6074bbe tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:44.602772 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-a963a789-2e46-4de2-b477-0249a6074bbe tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: 84d00bab-3efd-4f19-8f48-8c4b2fba864a] Going to try to terminate instance {{(pid=134051) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:46:44.684552 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:46:44.724561 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a963a789-2e46-4de2-b477-0249a6074bbe tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "DELETE /compute/v2.1/servers/84d00bab-3efd-4f19-8f48-8c4b2fba864a" status: 204 len: 0 microversion: 2.1 time: 0.171269 Aug 27 02:46:44.725685 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 775/1544] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:46:44 2022] DELETE /compute/v2.1/servers/84d00bab-3efd-4f19-8f48-8c4b2fba864a => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:46:44.734435 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-7ac99327-2768-4a9c-83b3-5d7ff8087a57 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:44.735823 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-7ac99327-2768-4a9c-83b3-5d7ff8087a57 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: 0ae31518-b08f-4255-a850-2b90b48ae7d4] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:44.748348 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-bff4b5c3-a655-431a-9668-c5568b5dbe71 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:44.750506 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-bff4b5c3-a655-431a-9668-c5568b5dbe71 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] [instance: 13799829-bea9-44c8-9993-89cdc60e7d74] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:44.753326 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7ac99327-2768-4a9c-83b3-5d7ff8087a57 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:44.756916 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7ac99327-2768-4a9c-83b3-5d7ff8087a57 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:44.759086 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7ac99327-2768-4a9c-83b3-5d7ff8087a57 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:44.760092 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7ac99327-2768-4a9c-83b3-5d7ff8087a57 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:44.762969 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7ac99327-2768-4a9c-83b3-5d7ff8087a57 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:44.763746 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7ac99327-2768-4a9c-83b3-5d7ff8087a57 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:44.768242 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bff4b5c3-a655-431a-9668-c5568b5dbe71 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:44.769025 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bff4b5c3-a655-431a-9668-c5568b5dbe71 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:44.770828 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bff4b5c3-a655-431a-9668-c5568b5dbe71 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:44.773288 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bff4b5c3-a655-431a-9668-c5568b5dbe71 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:44.775047 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bff4b5c3-a655-431a-9668-c5568b5dbe71 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:44.776432 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bff4b5c3-a655-431a-9668-c5568b5dbe71 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:45.051236 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-7ac99327-2768-4a9c-83b3-5d7ff8087a57 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6d1646ec094e3297f6f3c51dd72e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b105816fd4e54b9da4973ff721e1fb92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:45.060190 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-7ac99327-2768-4a9c-83b3-5d7ff8087a57 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "GET /compute/v2.1/servers/0ae31518-b08f-4255-a850-2b90b48ae7d4" status: 200 len: 1474 microversion: 2.1 time: 0.330014 Aug 27 02:46:45.060813 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 770/1545] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:44 2022] GET /compute/v2.1/servers/0ae31518-b08f-4255-a850-2b90b48ae7d4 => generated 1474 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:46:45.076873 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-bff4b5c3-a655-431a-9668-c5568b5dbe71 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e86c17fe83848e2bc96b7c83ff1cf14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5668e6d96694c62b83f7e8381fe86e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:45.081927 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4d6f95dd-0a84-4829-9ae5-61deabe3c562 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:45.082754 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-4d6f95dd-0a84-4829-9ae5-61deabe3c562 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] [instance: 484e03a9-aef3-4179-980c-0e7292a05b5a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:45.087292 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-bff4b5c3-a655-431a-9668-c5568b5dbe71 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] 10.222.0.70 "GET /compute/v2.1/servers/13799829-bea9-44c8-9993-89cdc60e7d74" status: 200 len: 1325 microversion: 2.1 time: 0.343529 Aug 27 02:46:45.088440 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 776/1546] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:44 2022] GET /compute/v2.1/servers/13799829-bea9-44c8-9993-89cdc60e7d74 => generated 1325 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:45.102481 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4d6f95dd-0a84-4829-9ae5-61deabe3c562 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:45.103583 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4d6f95dd-0a84-4829-9ae5-61deabe3c562 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:45.104614 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4d6f95dd-0a84-4829-9ae5-61deabe3c562 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:45.105512 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4d6f95dd-0a84-4829-9ae5-61deabe3c562 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:45.106119 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4d6f95dd-0a84-4829-9ae5-61deabe3c562 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:45.106696 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4d6f95dd-0a84-4829-9ae5-61deabe3c562 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:45.332895 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-007963ef-9d13-4b12-8c45-a9d28ee419c6 req-2757510f-41dd-48fc-ab4f-c7e793197416 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "484e03a9-aef3-4179-980c-0e7292a05b5a", "name": "network-vif-plugged", "status": "completed", "tag": "d8eb72ae-98e1-459d-a013-766f76a30e3d"}, {"server_uuid": "484e03a9-aef3-4179-980c-0e7292a05b5a", "name": "network-vif-plugged", "status": "completed", "tag": "c90fb304-b679-479a-ba4f-cede7f0a36e7"}, {"server_uuid": "484e03a9-aef3-4179-980c-0e7292a05b5a", "name": "network-vif-plugged", "status": "completed", "tag": "d59ac6c7-2440-450a-955f-48c4271b051e"}, {"server_uuid": "484e03a9-aef3-4179-980c-0e7292a05b5a", "name": "network-vif-plugged", "status": "completed", "tag": "31906b49-e77a-4b8f-98ad-bdd9406fe852"}, {"server_uuid": "484e03a9-aef3-4179-980c-0e7292a05b5a", "name": "network-vif-plugged", "status": "completed", "tag": "1689be35-623f-4a81-9df4-0846ddac5f37"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:46:45.354152 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-007963ef-9d13-4b12-8c45-a9d28ee419c6 req-2757510f-41dd-48fc-ab4f-c7e793197416 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:45.355801 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-007963ef-9d13-4b12-8c45-a9d28ee419c6 req-2757510f-41dd-48fc-ab4f-c7e793197416 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:45.359418 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-007963ef-9d13-4b12-8c45-a9d28ee419c6 req-2757510f-41dd-48fc-ab4f-c7e793197416 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:45.385617 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-007963ef-9d13-4b12-8c45-a9d28ee419c6 req-2757510f-41dd-48fc-ab4f-c7e793197416 service nova] Creating event network-vif-plugged:d8eb72ae-98e1-459d-a013-766f76a30e3d for instance 484e03a9-aef3-4179-980c-0e7292a05b5a on n-h1-852278-4 Aug 27 02:46:45.386131 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-007963ef-9d13-4b12-8c45-a9d28ee419c6 req-2757510f-41dd-48fc-ab4f-c7e793197416 service nova] Creating event network-vif-plugged:c90fb304-b679-479a-ba4f-cede7f0a36e7 for instance 484e03a9-aef3-4179-980c-0e7292a05b5a on n-h1-852278-4 Aug 27 02:46:45.389792 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-007963ef-9d13-4b12-8c45-a9d28ee419c6 req-2757510f-41dd-48fc-ab4f-c7e793197416 service nova] Creating event network-vif-plugged:d59ac6c7-2440-450a-955f-48c4271b051e for instance 484e03a9-aef3-4179-980c-0e7292a05b5a on n-h1-852278-4 Aug 27 02:46:45.390369 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-007963ef-9d13-4b12-8c45-a9d28ee419c6 req-2757510f-41dd-48fc-ab4f-c7e793197416 service nova] Creating event network-vif-plugged:31906b49-e77a-4b8f-98ad-bdd9406fe852 for instance 484e03a9-aef3-4179-980c-0e7292a05b5a on n-h1-852278-4 Aug 27 02:46:45.392780 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-007963ef-9d13-4b12-8c45-a9d28ee419c6 req-2757510f-41dd-48fc-ab4f-c7e793197416 service nova] Creating event network-vif-plugged:1689be35-623f-4a81-9df4-0846ddac5f37 for instance 484e03a9-aef3-4179-980c-0e7292a05b5a on n-h1-852278-4 Aug 27 02:46:45.399068 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-007963ef-9d13-4b12-8c45-a9d28ee419c6 req-2757510f-41dd-48fc-ab4f-c7e793197416 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 867 microversion: 2.1 time: 0.072328 Aug 27 02:46:45.399999 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 777/1547] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:46:45 2022] POST /compute/v2.1/os-server-external-events => generated 867 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:46:45.405358 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7c338817-fbe9-4257-b4c1-ef54155e57b4 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:45.406349 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-7c338817-fbe9-4257-b4c1-ef54155e57b4 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: f620f083-7230-471a-87d0-f6d85f8ad087] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:45.408691 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-4d6f95dd-0a84-4829-9ae5-61deabe3c562 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:45.414410 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7c338817-fbe9-4257-b4c1-ef54155e57b4 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:45.414894 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7c338817-fbe9-4257-b4c1-ef54155e57b4 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:45.415322 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7c338817-fbe9-4257-b4c1-ef54155e57b4 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:45.416014 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7c338817-fbe9-4257-b4c1-ef54155e57b4 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:45.416505 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7c338817-fbe9-4257-b4c1-ef54155e57b4 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:45.416919 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7c338817-fbe9-4257-b4c1-ef54155e57b4 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:45.423886 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-4d6f95dd-0a84-4829-9ae5-61deabe3c562 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:45.425760 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-4d6f95dd-0a84-4829-9ae5-61deabe3c562 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:45.427296 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-4d6f95dd-0a84-4829-9ae5-61deabe3c562 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] 10.222.0.70 "GET /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a" status: 200 len: 1875 microversion: 2.42 time: 0.353549 Aug 27 02:46:45.447975 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 771/1548] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:46:45 2022] GET /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a => generated 1875 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:46:45.455808 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-dd3c5f51-27d7-42f3-8383-a315649220f4 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:45.457942 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-dd3c5f51-27d7-42f3-8383-a315649220f4 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 70acfe32-deea-46fc-a214-8fdbb9f6cb7b] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:45.467344 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dd3c5f51-27d7-42f3-8383-a315649220f4 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:45.468675 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dd3c5f51-27d7-42f3-8383-a315649220f4 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:45.469352 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dd3c5f51-27d7-42f3-8383-a315649220f4 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:45.470342 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dd3c5f51-27d7-42f3-8383-a315649220f4 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:45.471017 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dd3c5f51-27d7-42f3-8383-a315649220f4 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:45.471647 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dd3c5f51-27d7-42f3-8383-a315649220f4 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:45.532957 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-7c338817-fbe9-4257-b4c1-ef54155e57b4 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:45.550336 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-7c338817-fbe9-4257-b4c1-ef54155e57b4 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:45.551995 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-7c338817-fbe9-4257-b4c1-ef54155e57b4 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:45.553525 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-7c338817-fbe9-4257-b4c1-ef54155e57b4 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/f620f083-7230-471a-87d0-f6d85f8ad087" status: 200 len: 1266 microversion: 2.25 time: 0.152294 Aug 27 02:46:45.554672 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 778/1549] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:46:45 2022] GET /compute/v2.1/servers/f620f083-7230-471a-87d0-f6d85f8ad087 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:46:45.652529 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-dd3c5f51-27d7-42f3-8383-a315649220f4 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:45.664596 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-dd3c5f51-27d7-42f3-8383-a315649220f4 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b" status: 200 len: 1390 microversion: 2.1 time: 0.213118 Aug 27 02:46:45.675893 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 772/1550] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:45 2022] GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b => generated 1390 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:46.088502 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c340b1ea-2ab5-4666-8563-f63b07b7e26c tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:46.089163 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-c340b1ea-2ab5-4666-8563-f63b07b7e26c tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: 0ae31518-b08f-4255-a850-2b90b48ae7d4] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:46.106237 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c340b1ea-2ab5-4666-8563-f63b07b7e26c tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:46.106858 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c340b1ea-2ab5-4666-8563-f63b07b7e26c tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:46.107315 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c340b1ea-2ab5-4666-8563-f63b07b7e26c tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:46.108061 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c340b1ea-2ab5-4666-8563-f63b07b7e26c tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:46.108547 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c340b1ea-2ab5-4666-8563-f63b07b7e26c tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:46.108971 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c340b1ea-2ab5-4666-8563-f63b07b7e26c tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:46.111354 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5b1f070e-c0ce-41a5-8f04-7da7afd27e87 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:46.111972 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-5b1f070e-c0ce-41a5-8f04-7da7afd27e87 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] [instance: 13799829-bea9-44c8-9993-89cdc60e7d74] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:46.130490 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5b1f070e-c0ce-41a5-8f04-7da7afd27e87 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:46.131018 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5b1f070e-c0ce-41a5-8f04-7da7afd27e87 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:46.131440 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5b1f070e-c0ce-41a5-8f04-7da7afd27e87 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:46.132178 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5b1f070e-c0ce-41a5-8f04-7da7afd27e87 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:46.132658 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5b1f070e-c0ce-41a5-8f04-7da7afd27e87 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:46.137164 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5b1f070e-c0ce-41a5-8f04-7da7afd27e87 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:46.504716 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-c340b1ea-2ab5-4666-8563-f63b07b7e26c tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6d1646ec094e3297f6f3c51dd72e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b105816fd4e54b9da4973ff721e1fb92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:46.519645 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c340b1ea-2ab5-4666-8563-f63b07b7e26c tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "GET /compute/v2.1/servers/0ae31518-b08f-4255-a850-2b90b48ae7d4" status: 200 len: 1474 microversion: 2.1 time: 0.435344 Aug 27 02:46:46.520945 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 779/1551] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:46 2022] GET /compute/v2.1/servers/0ae31518-b08f-4255-a850-2b90b48ae7d4 => generated 1474 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:46.525806 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b0e8b943-5e23-48ff-b34b-85c037138f47 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-2023045261", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "networks": [{"uuid": "fd17a619-097d-4901-804a-3a9fcc87db54"}]}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:46:46.542966 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-5b1f070e-c0ce-41a5-8f04-7da7afd27e87 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e86c17fe83848e2bc96b7c83ff1cf14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5668e6d96694c62b83f7e8381fe86e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:46.552931 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-5b1f070e-c0ce-41a5-8f04-7da7afd27e87 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] 10.222.0.70 "GET /compute/v2.1/servers/13799829-bea9-44c8-9993-89cdc60e7d74" status: 200 len: 1325 microversion: 2.1 time: 0.445137 Aug 27 02:46:46.567710 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 773/1552] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:46 2022] GET /compute/v2.1/servers/13799829-bea9-44c8-9993-89cdc60e7d74 => generated 1325 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:46.582947 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-fe3a54d9-44ad-47d1-9138-9922a21845df tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:46.585060 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-fe3a54d9-44ad-47d1-9138-9922a21845df tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] [instance: 582ea86f-befd-4c47-95d9-2eba872eb8c8] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:46.594426 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fe3a54d9-44ad-47d1-9138-9922a21845df tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:46.595278 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fe3a54d9-44ad-47d1-9138-9922a21845df tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:46.595896 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fe3a54d9-44ad-47d1-9138-9922a21845df tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:46.596858 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fe3a54d9-44ad-47d1-9138-9922a21845df tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:46.597460 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fe3a54d9-44ad-47d1-9138-9922a21845df tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:46.598676 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fe3a54d9-44ad-47d1-9138-9922a21845df tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:46.625555 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.network.neutron [None req-b0e8b943-5e23-48ff-b34b-85c037138f47 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] validate_networks() for [('fd17a619-097d-4901-804a-3a9fcc87db54', None, None, None, None, None)] {{(pid=134051) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:46:46.643065 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-fe3a54d9-44ad-47d1-9138-9922a21845df tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] 10.222.0.70 "GET /compute/v2.1/servers/582ea86f-befd-4c47-95d9-2eba872eb8c8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073007 Aug 27 02:46:46.648477 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 774/1553] 10.222.0.70 () {58 vars in 1302 bytes} [Sat Aug 27 02:46:46 2022] GET /compute/v2.1/servers/582ea86f-befd-4c47-95d9-2eba872eb8c8/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:46:46.662242 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c5134d41-af5a-4121-8e97-df874fcec244 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:46.665280 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-c5134d41-af5a-4121-8e97-df874fcec244 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] [instance: 484e03a9-aef3-4179-980c-0e7292a05b5a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:46.681824 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c5134d41-af5a-4121-8e97-df874fcec244 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:46.685024 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c5134d41-af5a-4121-8e97-df874fcec244 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:46.686607 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c5134d41-af5a-4121-8e97-df874fcec244 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:46.687534 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c5134d41-af5a-4121-8e97-df874fcec244 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:46.689044 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c5134d41-af5a-4121-8e97-df874fcec244 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:46.693749 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c5134d41-af5a-4121-8e97-df874fcec244 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:47.706461 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-c5134d41-af5a-4121-8e97-df874fcec244 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:47.720524 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-c5134d41-af5a-4121-8e97-df874fcec244 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:47.723222 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-c5134d41-af5a-4121-8e97-df874fcec244 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:47.724966 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c5134d41-af5a-4121-8e97-df874fcec244 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] 10.222.0.70 "GET /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a" status: 200 len: 1875 microversion: 2.42 time: 1.079557 Aug 27 02:46:47.725609 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 775/1554] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:46:46 2022] GET /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a => generated 1875 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:46:47.731511 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5c6ac556-763b-478d-a661-2abeef12b5e3 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:47.732073 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-5c6ac556-763b-478d-a661-2abeef12b5e3 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: f620f083-7230-471a-87d0-f6d85f8ad087] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:47.742450 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5c6ac556-763b-478d-a661-2abeef12b5e3 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:47.743272 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5c6ac556-763b-478d-a661-2abeef12b5e3 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:47.743848 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5c6ac556-763b-478d-a661-2abeef12b5e3 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:47.745057 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5c6ac556-763b-478d-a661-2abeef12b5e3 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:47.745667 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5c6ac556-763b-478d-a661-2abeef12b5e3 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:47.746559 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5c6ac556-763b-478d-a661-2abeef12b5e3 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:47.775317 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-5c6ac556-763b-478d-a661-2abeef12b5e3 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] HTTP exception thrown: Instance f620f083-7230-471a-87d0-f6d85f8ad087 could not be found. Aug 27 02:46:47.778553 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5c6ac556-763b-478d-a661-2abeef12b5e3 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Request method failure captured: Aug 27 02:46:47.778553 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/servers/f620f083-7230-471a-87d0-f6d85f8ad087 HTTP/1.1 Aug 27 02:46:47.778553 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:46:47.778553 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:46:47.778553 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:46:47.778553 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:46:47.778553 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:46:47.778553 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:46:47.778553 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:46:47.778553 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:46:47.778553 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYP0Zi0u0ongM0ussFZ5AdD5HIyahm-265hjOpwXihY5o3sYNrFwW2sdDUHR31UMPFN-_iaTjzoTr5-4uGtHbE7UfUOBIhfqlIc5fztQ2_0zHQw4-6NQBq47AifpayZLG8jx-nAsD9v_aVVxsEgxa-5qOAfnoiEMvtTyqZRaYWWxzpU Aug 27 02:46:47.778553 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:46:47.778553 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:46:47.778553 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:46:47.778553 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:46:47.778553 n-d-852278-4 devstack@n-api.service[134052]: X-Openstack-Nova-Api-Version: 2.25 Aug 27 02:46:47.778553 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:46:47.778553 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:46:47.778553 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: e78b498dced14d1d822e7d0c27f57215 Aug 27 02:46:47.778553 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-124565651 Aug 27 02:46:47.778553 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:46:47.778553 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:46:47.780236 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e78b498dced14d1d822e7d0c27f57215"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_e78b498dced14d1d822e7d0c27f57215", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e78b498dced14d1d822e7d0c27f57215"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/e78b498dced14d1d822e7d0c27f57215"}]}] Aug 27 02:46:47.780236 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-124565651 Aug 27 02:46:47.780236 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: e78b498dced14d1d822e7d0c27f57215 Aug 27 02:46:47.780236 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-124565651 Aug 27 02:46:47.780236 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-LiveAutoBlockMigrationV225Test-124565651-project Aug 27 02:46:47.780236 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:46:47.780236 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:46:47.780236 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 774ce37f4c6b4f72ad494ea40a3e238d Aug 27 02:46:47.780236 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-124565651-project Aug 27 02:46:47.780236 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 02:46:47.780236 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance f620f083-7230-471a-87d0-f6d85f8ad087 could not be found. Aug 27 02:46:47.780236 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': 'f620f083-7230-471a-87d0-f6d85f8ad087'} Aug 27 02:46:47.781161 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:46:47.781161 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:46:47.781161 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:46:47.781161 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:46:47.781161 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:46:47.781161 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:46:47.781161 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:46:47.781161 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:46:47.781161 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:46:47.781161 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:46:47.781161 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f620f083-7230-471a-87d0-f6d85f8ad087 could not be found. Aug 27 02:46:47.781161 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:46:47.781161 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:46:47.781161 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:46:47.781161 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:46:47.781161 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:46:47.781161 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:46:47.781161 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:46:47.781161 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:46:47.781161 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:46:47.784364 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:46:47.784364 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:46:47.784364 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:46:47.784364 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:46:47.784364 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:46:47.784364 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:46:47.784364 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:46:47.784364 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f620f083-7230-471a-87d0-f6d85f8ad087 could not be found. Aug 27 02:46:47.784364 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:46:47.784364 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:46:47.784364 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:46:47.784364 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:46:47.784364 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:46:47.784364 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:46:47.784364 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:46:47.784364 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:46:47.784364 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f620f083-7230-471a-87d0-f6d85f8ad087 could not be found. Aug 27 02:46:47.784364 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:46:47.787604 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5c6ac556-763b-478d-a661-2abeef12b5e3 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Returning 404 to user: Instance f620f083-7230-471a-87d0-f6d85f8ad087 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:46:47.787604 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-5c6ac556-763b-478d-a661-2abeef12b5e3 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/f620f083-7230-471a-87d0-f6d85f8ad087" status: 404 len: 111 microversion: 2.25 time: 0.053287 Aug 27 02:46:47.793840 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 776/1555] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:46:47 2022] GET /compute/v2.1/servers/f620f083-7230-471a-87d0-f6d85f8ad087 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 02:46:47.799577 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-7878215a-55f7-470c-982f-97cd233e2f4b tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:47.800061 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-7878215a-55f7-470c-982f-97cd233e2f4b tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] [instance: 582ea86f-befd-4c47-95d9-2eba872eb8c8] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:47.806898 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7878215a-55f7-470c-982f-97cd233e2f4b tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:47.808135 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7878215a-55f7-470c-982f-97cd233e2f4b tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:47.808135 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7878215a-55f7-470c-982f-97cd233e2f4b tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:47.809242 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7878215a-55f7-470c-982f-97cd233e2f4b tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:47.809580 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7878215a-55f7-470c-982f-97cd233e2f4b tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:47.810020 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7878215a-55f7-470c-982f-97cd233e2f4b tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:47.976711 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.instance [None req-7878215a-55f7-470c-982f-97cd233e2f4b tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Lazy-loading 'services' on Instance uuid 582ea86f-befd-4c47-95d9-2eba872eb8c8 {{(pid=134052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:46:48.100837 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-7878215a-55f7-470c-982f-97cd233e2f4b tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] 10.222.0.70 "DELETE /compute/v2.1/servers/582ea86f-befd-4c47-95d9-2eba872eb8c8/os-volume_attachments/5fd52db8-e8d9-48c2-9e84-26ab53a2f631" status: 202 len: 0 microversion: 2.1 time: 0.305144 Aug 27 02:46:48.104608 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 777/1556] 10.222.0.70 () {58 vars in 1416 bytes} [Sat Aug 27 02:46:47 2022] DELETE /compute/v2.1/servers/582ea86f-befd-4c47-95d9-2eba872eb8c8/os-volume_attachments/5fd52db8-e8d9-48c2-9e84-26ab53a2f631 => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:46:48.108688 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-203b96b2-044f-4f9a-a66e-5f70ec31a03b tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:48.109613 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-203b96b2-044f-4f9a-a66e-5f70ec31a03b tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 70acfe32-deea-46fc-a214-8fdbb9f6cb7b] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:48.117986 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-203b96b2-044f-4f9a-a66e-5f70ec31a03b tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:48.118405 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-203b96b2-044f-4f9a-a66e-5f70ec31a03b tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:48.118832 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-203b96b2-044f-4f9a-a66e-5f70ec31a03b tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:48.119707 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-203b96b2-044f-4f9a-a66e-5f70ec31a03b tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:48.120228 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-203b96b2-044f-4f9a-a66e-5f70ec31a03b tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:48.120696 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-203b96b2-044f-4f9a-a66e-5f70ec31a03b tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:48.378806 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-b0e8b943-5e23-48ff-b34b-85c037138f47 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Flavor limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:46:48.379342 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-b0e8b943-5e23-48ff-b34b-85c037138f47 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Image limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:46:48.379859 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-b0e8b943-5e23-48ff-b34b-85c037138f47 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Flavor pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:46:48.380458 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-b0e8b943-5e23-48ff-b34b-85c037138f47 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Image pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:46:48.381092 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-b0e8b943-5e23-48ff-b34b-85c037138f47 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:46:48.392399 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b0e8b943-5e23-48ff-b34b-85c037138f47 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:48.395858 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b0e8b943-5e23-48ff-b34b-85c037138f47 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:48.396593 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b0e8b943-5e23-48ff-b34b-85c037138f47 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:48.397935 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b0e8b943-5e23-48ff-b34b-85c037138f47 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:48.399338 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b0e8b943-5e23-48ff-b34b-85c037138f47 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:48.401100 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b0e8b943-5e23-48ff-b34b-85c037138f47 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:48.421025 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-b0e8b943-5e23-48ff-b34b-85c037138f47 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Getting quotas for project 256b67be18c246b186e09a313db08a7e. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:46:48.428394 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-b0e8b943-5e23-48ff-b34b-85c037138f47 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Getting quotas for user cfec6c2f34f94d66ab1cc982c5bb5bbd and project 256b67be18c246b186e09a313db08a7e. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:46:48.432989 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:46:48.448098 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b0e8b943-5e23-48ff-b34b-85c037138f47 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Going to run 1 instances... {{(pid=134051) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:46:48.451582 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b0e8b943-5e23-48ff-b34b-85c037138f47 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] [instance: caf46cf7-50ec-4b59-8589-ebbe4ab383e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134051) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:46:48.470796 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-203b96b2-044f-4f9a-a66e-5f70ec31a03b tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:48.487946 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-203b96b2-044f-4f9a-a66e-5f70ec31a03b tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b" status: 200 len: 1390 microversion: 2.1 time: 0.382895 Aug 27 02:46:48.489542 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 778/1557] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:48 2022] GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b => generated 1390 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:48.503000 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-8f9bb47e-c20d-4073-96ed-242e396f0772 req-088f7077-76af-4a20-86d7-3389784c22de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "484e03a9-aef3-4179-980c-0e7292a05b5a", "name": "network-vif-plugged", "status": "completed", "tag": "6958a0bc-b02e-4619-a95c-6bd7e0759d6c"}, {"server_uuid": "13799829-bea9-44c8-9993-89cdc60e7d74", "name": "network-vif-plugged", "status": "completed", "tag": "eb05dbaa-e7a5-4676-8fc8-62e2c1ec4d85"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:46:48.539926 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b0e8b943-5e23-48ff-b34b-85c037138f47 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.017570 Aug 27 02:46:48.547376 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 780/1558] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 02:46:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 2026 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:46:48.549419 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-8f9bb47e-c20d-4073-96ed-242e396f0772 req-088f7077-76af-4a20-86d7-3389784c22de service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:48.553401 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-8f9bb47e-c20d-4073-96ed-242e396f0772 req-088f7077-76af-4a20-86d7-3389784c22de service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:48.553655 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-8f9bb47e-c20d-4073-96ed-242e396f0772 req-088f7077-76af-4a20-86d7-3389784c22de service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:48.555343 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4b952251-b3b8-43cc-906c-f64926e27d41 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:48.563480 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-4b952251-b3b8-43cc-906c-f64926e27d41 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: 0ae31518-b08f-4255-a850-2b90b48ae7d4] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:48.570280 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4b952251-b3b8-43cc-906c-f64926e27d41 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:48.571160 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4b952251-b3b8-43cc-906c-f64926e27d41 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:48.574036 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4b952251-b3b8-43cc-906c-f64926e27d41 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:48.575022 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4b952251-b3b8-43cc-906c-f64926e27d41 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:48.579972 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4b952251-b3b8-43cc-906c-f64926e27d41 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:48.581826 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4b952251-b3b8-43cc-906c-f64926e27d41 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:48.600507 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-8f9bb47e-c20d-4073-96ed-242e396f0772 req-088f7077-76af-4a20-86d7-3389784c22de service nova] Creating event network-vif-plugged:6958a0bc-b02e-4619-a95c-6bd7e0759d6c for instance 484e03a9-aef3-4179-980c-0e7292a05b5a on n-h1-852278-4 Aug 27 02:46:48.601019 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-8f9bb47e-c20d-4073-96ed-242e396f0772 req-088f7077-76af-4a20-86d7-3389784c22de service nova] Creating event network-vif-plugged:eb05dbaa-e7a5-4676-8fc8-62e2c1ec4d85 for instance 13799829-bea9-44c8-9993-89cdc60e7d74 on n-h1-852278-4 Aug 27 02:46:48.620698 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-8f9bb47e-c20d-4073-96ed-242e396f0772 req-088f7077-76af-4a20-86d7-3389784c22de service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.128667 Aug 27 02:46:48.621439 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 779/1559] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:46:48 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:46:48.627218 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d768d8df-3f4d-4c8c-9d60-5d09a3865ed8 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:48.628229 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d768d8df-3f4d-4c8c-9d60-5d09a3865ed8 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] [instance: 13799829-bea9-44c8-9993-89cdc60e7d74] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:48.642498 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d768d8df-3f4d-4c8c-9d60-5d09a3865ed8 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:48.644371 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d768d8df-3f4d-4c8c-9d60-5d09a3865ed8 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:48.644823 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d768d8df-3f4d-4c8c-9d60-5d09a3865ed8 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:48.645549 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d768d8df-3f4d-4c8c-9d60-5d09a3865ed8 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:48.646002 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d768d8df-3f4d-4c8c-9d60-5d09a3865ed8 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:48.646426 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d768d8df-3f4d-4c8c-9d60-5d09a3865ed8 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:48.867233 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-4b952251-b3b8-43cc-906c-f64926e27d41 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6d1646ec094e3297f6f3c51dd72e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b105816fd4e54b9da4973ff721e1fb92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:48.881794 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-4b952251-b3b8-43cc-906c-f64926e27d41 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "GET /compute/v2.1/servers/0ae31518-b08f-4255-a850-2b90b48ae7d4" status: 200 len: 1432 microversion: 2.1 time: 0.330367 Aug 27 02:46:48.888403 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 781/1560] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:48 2022] GET /compute/v2.1/servers/0ae31518-b08f-4255-a850-2b90b48ae7d4 => generated 1432 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:48.894387 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0892ceb2-6af0-43b6-bd10-69079e3017f5 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:48.899094 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-0892ceb2-6af0-43b6-bd10-69079e3017f5 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] [instance: caf46cf7-50ec-4b59-8589-ebbe4ab383e1] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:49.087747 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-0892ceb2-6af0-43b6-bd10-69079e3017f5 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfec6c2f34f94d66ab1cc982c5bb5bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256b67be18c246b186e09a313db08a7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:49.108190 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-0892ceb2-6af0-43b6-bd10-69079e3017f5 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] 10.222.0.70 "GET /compute/v2.1/servers/caf46cf7-50ec-4b59-8589-ebbe4ab383e1" status: 200 len: 1218 microversion: 2.1 time: 0.212489 Aug 27 02:46:49.121641 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 782/1561] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:48 2022] GET /compute/v2.1/servers/caf46cf7-50ec-4b59-8589-ebbe4ab383e1 => generated 1218 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:49.141316 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-e5265847-fc96-4caf-9fb0-e5cbd6f185a5 req-03422161-9b91-4cd9-ad65-332a9851c9f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84d00bab-3efd-4f19-8f48-8c4b2fba864a", "name": "network-vif-deleted", "tag": "205ec2a5-ab75-4573-8598-101ecb5de5df"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:46:49.173892 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-e5265847-fc96-4caf-9fb0-e5cbd6f185a5 req-03422161-9b91-4cd9-ad65-332a9851c9f9 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:49.179186 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-e5265847-fc96-4caf-9fb0-e5cbd6f185a5 req-03422161-9b91-4cd9-ad65-332a9851c9f9 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:49.181955 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-e5265847-fc96-4caf-9fb0-e5cbd6f185a5 req-03422161-9b91-4cd9-ad65-332a9851c9f9 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:49.214091 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-e5265847-fc96-4caf-9fb0-e5cbd6f185a5 req-03422161-9b91-4cd9-ad65-332a9851c9f9 service nova] Creating event network-vif-deleted:205ec2a5-ab75-4573-8598-101ecb5de5df for instance 84d00bab-3efd-4f19-8f48-8c4b2fba864a on n-h2-852278-4 Aug 27 02:46:49.221554 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-e5265847-fc96-4caf-9fb0-e5cbd6f185a5 req-03422161-9b91-4cd9-ad65-332a9851c9f9 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096156 Aug 27 02:46:49.222970 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 783/1562] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:46:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:46:49.230762 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-2207dbca-b07b-4865-ba39-4a23eef1bad1 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:49.247254 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-2207dbca-b07b-4865-ba39-4a23eef1bad1 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] [instance: 484e03a9-aef3-4179-980c-0e7292a05b5a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:49.266352 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2207dbca-b07b-4865-ba39-4a23eef1bad1 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:49.267401 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2207dbca-b07b-4865-ba39-4a23eef1bad1 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:49.268440 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2207dbca-b07b-4865-ba39-4a23eef1bad1 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:49.271511 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2207dbca-b07b-4865-ba39-4a23eef1bad1 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:49.272452 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2207dbca-b07b-4865-ba39-4a23eef1bad1 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:49.273627 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2207dbca-b07b-4865-ba39-4a23eef1bad1 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:49.485125 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-d768d8df-3f4d-4c8c-9d60-5d09a3865ed8 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e86c17fe83848e2bc96b7c83ff1cf14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5668e6d96694c62b83f7e8381fe86e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:49.501846 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d768d8df-3f4d-4c8c-9d60-5d09a3865ed8 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] 10.222.0.70 "GET /compute/v2.1/servers/13799829-bea9-44c8-9993-89cdc60e7d74" status: 200 len: 1325 microversion: 2.1 time: 0.878052 Aug 27 02:46:49.519239 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 780/1563] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:48 2022] GET /compute/v2.1/servers/13799829-bea9-44c8-9993-89cdc60e7d74 => generated 1325 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:49.541743 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-64c2565a-bfb9-41af-810a-ae19093dbf1d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:49.542364 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-64c2565a-bfb9-41af-810a-ae19093dbf1d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 70acfe32-deea-46fc-a214-8fdbb9f6cb7b] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:49.550691 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-64c2565a-bfb9-41af-810a-ae19093dbf1d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:49.552440 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-64c2565a-bfb9-41af-810a-ae19093dbf1d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:49.553898 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-64c2565a-bfb9-41af-810a-ae19093dbf1d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:49.555062 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-64c2565a-bfb9-41af-810a-ae19093dbf1d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:49.555712 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-64c2565a-bfb9-41af-810a-ae19093dbf1d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:49.556821 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-64c2565a-bfb9-41af-810a-ae19093dbf1d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:49.595214 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:46:49.992893 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-64c2565a-bfb9-41af-810a-ae19093dbf1d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:49.995998 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-2207dbca-b07b-4865-ba39-4a23eef1bad1 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:50.010138 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-64c2565a-bfb9-41af-810a-ae19093dbf1d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b" status: 200 len: 1390 microversion: 2.1 time: 0.473458 Aug 27 02:46:50.013537 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 781/1564] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:49 2022] GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b => generated 1390 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:50.032804 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8321c70a-65e2-4096-87b8-df0597df4162 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:50.035936 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-8321c70a-65e2-4096-87b8-df0597df4162 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: 0ae31518-b08f-4255-a850-2b90b48ae7d4] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:50.038600 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-2207dbca-b07b-4865-ba39-4a23eef1bad1 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:50.042482 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:DELETE=3 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:46:50.049406 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-2207dbca-b07b-4865-ba39-4a23eef1bad1 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:50.055328 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-2207dbca-b07b-4865-ba39-4a23eef1bad1 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] 10.222.0.70 "GET /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a" status: 200 len: 1875 microversion: 2.42 time: 0.826441 Aug 27 02:46:50.057035 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 784/1565] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:46:49 2022] GET /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a => generated 1875 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:46:50.078236 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8321c70a-65e2-4096-87b8-df0597df4162 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:50.079002 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8321c70a-65e2-4096-87b8-df0597df4162 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:50.079776 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8321c70a-65e2-4096-87b8-df0597df4162 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:50.080749 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8321c70a-65e2-4096-87b8-df0597df4162 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:50.081502 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8321c70a-65e2-4096-87b8-df0597df4162 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:50.082715 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8321c70a-65e2-4096-87b8-df0597df4162 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:50.131198 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c89c77f8-e592-4999-8fe2-ad3aaf5c0f0e tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:50.131967 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-c89c77f8-e592-4999-8fe2-ad3aaf5c0f0e tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] [instance: caf46cf7-50ec-4b59-8589-ebbe4ab383e1] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:50.144173 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c89c77f8-e592-4999-8fe2-ad3aaf5c0f0e tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:50.146695 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c89c77f8-e592-4999-8fe2-ad3aaf5c0f0e tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:50.148023 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c89c77f8-e592-4999-8fe2-ad3aaf5c0f0e tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:50.149028 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c89c77f8-e592-4999-8fe2-ad3aaf5c0f0e tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:50.151772 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c89c77f8-e592-4999-8fe2-ad3aaf5c0f0e tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:50.154198 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c89c77f8-e592-4999-8fe2-ad3aaf5c0f0e tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:50.154734 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8321c70a-65e2-4096-87b8-df0597df4162 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:50.155350 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8321c70a-65e2-4096-87b8-df0597df4162 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:50.159439 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8321c70a-65e2-4096-87b8-df0597df4162 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:50.164208 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.instance [None req-8321c70a-65e2-4096-87b8-df0597df4162 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lazy-loading 'fault' on Instance uuid 0ae31518-b08f-4255-a850-2b90b48ae7d4 {{(pid=134052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:46:50.245265 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-8321c70a-65e2-4096-87b8-df0597df4162 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6d1646ec094e3297f6f3c51dd72e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b105816fd4e54b9da4973ff721e1fb92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:50.256798 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-8321c70a-65e2-4096-87b8-df0597df4162 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "GET /compute/v2.1/servers/0ae31518-b08f-4255-a850-2b90b48ae7d4" status: 200 len: 1308 microversion: 2.1 time: 0.239588 Aug 27 02:46:50.261798 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 782/1566] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:50 2022] GET /compute/v2.1/servers/0ae31518-b08f-4255-a850-2b90b48ae7d4 => generated 1308 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:50.301686 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-c89c77f8-e592-4999-8fe2-ad3aaf5c0f0e tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfec6c2f34f94d66ab1cc982c5bb5bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256b67be18c246b186e09a313db08a7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:50.310131 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c89c77f8-e592-4999-8fe2-ad3aaf5c0f0e tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] 10.222.0.70 "GET /compute/v2.1/servers/caf46cf7-50ec-4b59-8589-ebbe4ab383e1" status: 200 len: 1270 microversion: 2.1 time: 0.184680 Aug 27 02:46:50.310758 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 785/1567] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:50 2022] GET /compute/v2.1/servers/caf46cf7-50ec-4b59-8589-ebbe4ab383e1 => generated 1270 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:46:50.543112 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d65cd00e-ee73-45d6-8329-db28a87ba3d7 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:50.543716 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d65cd00e-ee73-45d6-8329-db28a87ba3d7 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] [instance: 13799829-bea9-44c8-9993-89cdc60e7d74] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:50.550400 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d65cd00e-ee73-45d6-8329-db28a87ba3d7 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:50.551241 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d65cd00e-ee73-45d6-8329-db28a87ba3d7 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:50.551856 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d65cd00e-ee73-45d6-8329-db28a87ba3d7 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:50.553403 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d65cd00e-ee73-45d6-8329-db28a87ba3d7 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:50.554011 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d65cd00e-ee73-45d6-8329-db28a87ba3d7 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:50.554761 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d65cd00e-ee73-45d6-8329-db28a87ba3d7 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:50.758184 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-d65cd00e-ee73-45d6-8329-db28a87ba3d7 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e86c17fe83848e2bc96b7c83ff1cf14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5668e6d96694c62b83f7e8381fe86e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:50.778812 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d65cd00e-ee73-45d6-8329-db28a87ba3d7 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] 10.222.0.70 "GET /compute/v2.1/servers/13799829-bea9-44c8-9993-89cdc60e7d74" status: 200 len: 1325 microversion: 2.1 time: 0.237316 Aug 27 02:46:50.781456 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 783/1568] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:50 2022] GET /compute/v2.1/servers/13799829-bea9-44c8-9993-89cdc60e7d74 => generated 1325 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:51.041793 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-49f35690-46ff-449d-9571-99303c56b8f2 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:51.043246 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-49f35690-46ff-449d-9571-99303c56b8f2 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 70acfe32-deea-46fc-a214-8fdbb9f6cb7b] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:51.065169 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-49f35690-46ff-449d-9571-99303c56b8f2 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:51.066765 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-49f35690-46ff-449d-9571-99303c56b8f2 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:51.069208 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-49f35690-46ff-449d-9571-99303c56b8f2 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:51.073222 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-49f35690-46ff-449d-9571-99303c56b8f2 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:51.073905 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-49f35690-46ff-449d-9571-99303c56b8f2 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:51.076532 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-49f35690-46ff-449d-9571-99303c56b8f2 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:51.086835 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e947a5f6-8795-4cd2-b405-926e21361993 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:51.087691 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-e947a5f6-8795-4cd2-b405-926e21361993 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] [instance: 484e03a9-aef3-4179-980c-0e7292a05b5a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:51.118561 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e947a5f6-8795-4cd2-b405-926e21361993 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:51.120764 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e947a5f6-8795-4cd2-b405-926e21361993 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:51.121439 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e947a5f6-8795-4cd2-b405-926e21361993 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:51.125297 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e947a5f6-8795-4cd2-b405-926e21361993 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:51.128953 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e947a5f6-8795-4cd2-b405-926e21361993 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:51.129604 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e947a5f6-8795-4cd2-b405-926e21361993 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:51.661772 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-49f35690-46ff-449d-9571-99303c56b8f2 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:51.673023 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-49f35690-46ff-449d-9571-99303c56b8f2 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b" status: 200 len: 1390 microversion: 2.1 time: 0.641410 Aug 27 02:46:51.675763 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 786/1569] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:51 2022] GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b => generated 1390 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:51.691568 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-5d0ec6d0-feed-4156-9f5b-9a2625fff5d3 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:51.692575 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-5d0ec6d0-feed-4156-9f5b-9a2625fff5d3 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: 0ae31518-b08f-4255-a850-2b90b48ae7d4] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:51.706468 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5d0ec6d0-feed-4156-9f5b-9a2625fff5d3 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:51.707082 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5d0ec6d0-feed-4156-9f5b-9a2625fff5d3 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:51.709867 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5d0ec6d0-feed-4156-9f5b-9a2625fff5d3 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:51.711604 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5d0ec6d0-feed-4156-9f5b-9a2625fff5d3 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:51.716039 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5d0ec6d0-feed-4156-9f5b-9a2625fff5d3 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:51.716905 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5d0ec6d0-feed-4156-9f5b-9a2625fff5d3 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:51.737436 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-5d0ec6d0-feed-4156-9f5b-9a2625fff5d3 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] HTTP exception thrown: Instance 0ae31518-b08f-4255-a850-2b90b48ae7d4 could not be found. Aug 27 02:46:51.754788 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-5d0ec6d0-feed-4156-9f5b-9a2625fff5d3 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Request method failure captured: Aug 27 02:46:51.754788 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/0ae31518-b08f-4255-a850-2b90b48ae7d4 HTTP/1.1 Aug 27 02:46:51.754788 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:46:51.754788 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:46:51.754788 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:46:51.754788 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:46:51.754788 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:46:51.754788 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:46:51.754788 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:46:51.754788 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:46:51.754788 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYSgO5iP2Rj0OnjMZjg06AspC2AGCawaQncXH6RR0w6SmRKlRtLBLi7PcPgHNU9vdqMkMafrqdLcVHKkwB4D8nTCptd_7hF6weX6SAII7uRF-eRfBaai4y8PcTnfOVHHGeDAMA19n6IWPYlb4txBKWYFlublH5xab2iApkdg2a67esA Aug 27 02:46:51.754788 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:46:51.754788 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:46:51.754788 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:46:51.754788 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:46:51.754788 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:46:51.754788 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:46:51.754788 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: b105816fd4e54b9da4973ff721e1fb92 Aug 27 02:46:51.754788 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ServersOnMultiNodesTest-355465396 Aug 27 02:46:51.754788 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:46:51.754788 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:46:51.756476 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b105816fd4e54b9da4973ff721e1fb92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_b105816fd4e54b9da4973ff721e1fb92", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b105816fd4e54b9da4973ff721e1fb92"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/b105816fd4e54b9da4973ff721e1fb92"}]}] Aug 27 02:46:51.756476 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ServersOnMultiNodesTest-355465396 Aug 27 02:46:51.756476 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: b105816fd4e54b9da4973ff721e1fb92 Aug 27 02:46:51.756476 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-355465396 Aug 27 02:46:51.756476 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ServersOnMultiNodesTest-355465396-project Aug 27 02:46:51.756476 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:46:51.756476 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:46:51.756476 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: eb6d1646ec094e3297f6f3c51dd72e85 Aug 27 02:46:51.756476 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ServersOnMultiNodesTest-355465396-project Aug 27 02:46:51.756476 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 02:46:51.756476 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance 0ae31518-b08f-4255-a850-2b90b48ae7d4 could not be found. Aug 27 02:46:51.756476 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '0ae31518-b08f-4255-a850-2b90b48ae7d4'} Aug 27 02:46:51.757323 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:46:51.757323 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:46:51.757323 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:46:51.757323 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:46:51.757323 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:46:51.757323 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:46:51.757323 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:46:51.757323 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:46:51.757323 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:46:51.757323 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:46:51.757323 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ae31518-b08f-4255-a850-2b90b48ae7d4 could not be found. Aug 27 02:46:51.757323 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:46:51.757323 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:46:51.757323 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:46:51.757323 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:46:51.757323 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:46:51.757323 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:46:51.757323 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:46:51.757323 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:46:51.757323 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:46:51.758782 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:46:51.758782 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:46:51.758782 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:46:51.758782 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:46:51.758782 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:46:51.758782 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:46:51.758782 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:46:51.758782 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ae31518-b08f-4255-a850-2b90b48ae7d4 could not be found. Aug 27 02:46:51.758782 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:46:51.758782 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:46:51.758782 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:46:51.758782 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:46:51.758782 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:46:51.758782 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:46:51.758782 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:46:51.758782 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:46:51.758782 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ae31518-b08f-4255-a850-2b90b48ae7d4 could not be found. Aug 27 02:46:51.758782 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:46:51.760025 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-5d0ec6d0-feed-4156-9f5b-9a2625fff5d3 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Returning 404 to user: Instance 0ae31518-b08f-4255-a850-2b90b48ae7d4 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:46:51.760025 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-5d0ec6d0-feed-4156-9f5b-9a2625fff5d3 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "GET /compute/v2.1/servers/0ae31518-b08f-4255-a850-2b90b48ae7d4" status: 404 len: 111 microversion: 2.1 time: 0.078113 Aug 27 02:46:51.760025 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 787/1570] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:51 2022] GET /compute/v2.1/servers/0ae31518-b08f-4255-a850-2b90b48ae7d4 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:46:51.766760 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-bce2323d-90e2-41e8-96dd-f57fce290fdd req-4182378d-0542-47fe-b439-b7031e206828 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ae31518-b08f-4255-a850-2b90b48ae7d4", "name": "network-vif-deleted", "tag": "f5817098-1c90-4342-856e-1a55c19b7e1a"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:46:51.783996 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-bce2323d-90e2-41e8-96dd-f57fce290fdd req-4182378d-0542-47fe-b439-b7031e206828 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:51.784552 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-bce2323d-90e2-41e8-96dd-f57fce290fdd req-4182378d-0542-47fe-b439-b7031e206828 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:51.785132 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-bce2323d-90e2-41e8-96dd-f57fce290fdd req-4182378d-0542-47fe-b439-b7031e206828 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:51.822453 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-bce2323d-90e2-41e8-96dd-f57fce290fdd req-4182378d-0542-47fe-b439-b7031e206828 service nova] Creating event network-vif-deleted:f5817098-1c90-4342-856e-1a55c19b7e1a for instance 0ae31518-b08f-4255-a850-2b90b48ae7d4 on n-h2-852278-4 Aug 27 02:46:51.830590 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-bce2323d-90e2-41e8-96dd-f57fce290fdd req-4182378d-0542-47fe-b439-b7031e206828 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071761 Aug 27 02:46:51.832261 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 788/1571] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:46:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:46:51.839634 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d8a67de3-b863-4d73-8d6f-6942da0e0085 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:51.840492 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d8a67de3-b863-4d73-8d6f-6942da0e0085 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] [instance: caf46cf7-50ec-4b59-8589-ebbe4ab383e1] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:51.849904 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d8a67de3-b863-4d73-8d6f-6942da0e0085 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:51.851231 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d8a67de3-b863-4d73-8d6f-6942da0e0085 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:51.851916 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d8a67de3-b863-4d73-8d6f-6942da0e0085 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:51.853969 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d8a67de3-b863-4d73-8d6f-6942da0e0085 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:51.854639 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d8a67de3-b863-4d73-8d6f-6942da0e0085 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:51.855092 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d8a67de3-b863-4d73-8d6f-6942da0e0085 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:51.942938 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-e947a5f6-8795-4cd2-b405-926e21361993 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:51.964380 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-e947a5f6-8795-4cd2-b405-926e21361993 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:51.966405 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-e947a5f6-8795-4cd2-b405-926e21361993 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:51.967607 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e947a5f6-8795-4cd2-b405-926e21361993 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] 10.222.0.70 "GET /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a" status: 200 len: 1875 microversion: 2.42 time: 0.886432 Aug 27 02:46:51.981407 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 784/1572] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:46:51 2022] GET /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a => generated 1875 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:46:51.990320 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-71a1e61a-6333-4086-a538-cd8529f61905 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:51.997285 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-71a1e61a-6333-4086-a538-cd8529f61905 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: 84d00bab-3efd-4f19-8f48-8c4b2fba864a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:52.010583 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d8a67de3-b863-4d73-8d6f-6942da0e0085 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfec6c2f34f94d66ab1cc982c5bb5bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256b67be18c246b186e09a313db08a7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:52.011498 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-71a1e61a-6333-4086-a538-cd8529f61905 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:52.012190 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-71a1e61a-6333-4086-a538-cd8529f61905 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:52.012839 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-71a1e61a-6333-4086-a538-cd8529f61905 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:52.013779 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-71a1e61a-6333-4086-a538-cd8529f61905 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:52.014403 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-71a1e61a-6333-4086-a538-cd8529f61905 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:52.015116 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-71a1e61a-6333-4086-a538-cd8529f61905 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:52.020084 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d8a67de3-b863-4d73-8d6f-6942da0e0085 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] 10.222.0.70 "GET /compute/v2.1/servers/caf46cf7-50ec-4b59-8589-ebbe4ab383e1" status: 200 len: 1276 microversion: 2.1 time: 0.185498 Aug 27 02:46:52.030513 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 789/1573] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:51 2022] GET /compute/v2.1/servers/caf46cf7-50ec-4b59-8589-ebbe4ab383e1 => generated 1276 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:52.035424 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-790a81cf-a8b8-48ed-8010-b147c0af7e19 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:52.036040 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-790a81cf-a8b8-48ed-8010-b147c0af7e19 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] [instance: 13799829-bea9-44c8-9993-89cdc60e7d74] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:52.045239 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-790a81cf-a8b8-48ed-8010-b147c0af7e19 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:52.045859 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-790a81cf-a8b8-48ed-8010-b147c0af7e19 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:52.046257 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-790a81cf-a8b8-48ed-8010-b147c0af7e19 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:52.051071 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-790a81cf-a8b8-48ed-8010-b147c0af7e19 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:52.051561 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-790a81cf-a8b8-48ed-8010-b147c0af7e19 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:52.052002 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-790a81cf-a8b8-48ed-8010-b147c0af7e19 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:52.055096 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-71a1e61a-6333-4086-a538-cd8529f61905 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] HTTP exception thrown: Instance 84d00bab-3efd-4f19-8f48-8c4b2fba864a could not be found. Aug 27 02:46:52.057541 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-71a1e61a-6333-4086-a538-cd8529f61905 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Request method failure captured: Aug 27 02:46:52.057541 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/servers/84d00bab-3efd-4f19-8f48-8c4b2fba864a HTTP/1.1 Aug 27 02:46:52.057541 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:46:52.057541 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:46:52.057541 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:46:52.057541 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:46:52.057541 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:46:52.057541 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:46:52.057541 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:46:52.057541 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:46:52.057541 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYSgO5iP2Rj0OnjMZjg06AspC2AGCawaQncXH6RR0w6SmRKlRtLBLi7PcPgHNU9vdqMkMafrqdLcVHKkwB4D8nTCptd_7hF6weX6SAII7uRF-eRfBaai4y8PcTnfOVHHGeDAMA19n6IWPYlb4txBKWYFlublH5xab2iApkdg2a67esA Aug 27 02:46:52.057541 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:46:52.057541 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:46:52.057541 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:46:52.057541 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:46:52.057541 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:46:52.057541 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:46:52.057541 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: b105816fd4e54b9da4973ff721e1fb92 Aug 27 02:46:52.057541 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ServersOnMultiNodesTest-355465396 Aug 27 02:46:52.057541 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:46:52.057541 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:46:52.059539 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b105816fd4e54b9da4973ff721e1fb92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_b105816fd4e54b9da4973ff721e1fb92", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b105816fd4e54b9da4973ff721e1fb92"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/b105816fd4e54b9da4973ff721e1fb92"}]}] Aug 27 02:46:52.059539 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ServersOnMultiNodesTest-355465396 Aug 27 02:46:52.059539 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: b105816fd4e54b9da4973ff721e1fb92 Aug 27 02:46:52.059539 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-355465396 Aug 27 02:46:52.059539 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ServersOnMultiNodesTest-355465396-project Aug 27 02:46:52.059539 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:46:52.059539 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:46:52.059539 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: eb6d1646ec094e3297f6f3c51dd72e85 Aug 27 02:46:52.059539 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ServersOnMultiNodesTest-355465396-project Aug 27 02:46:52.059539 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 02:46:52.059539 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance 84d00bab-3efd-4f19-8f48-8c4b2fba864a could not be found. Aug 27 02:46:52.059539 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '84d00bab-3efd-4f19-8f48-8c4b2fba864a'} Aug 27 02:46:52.060490 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:46:52.060490 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:46:52.060490 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:46:52.060490 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:46:52.060490 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:46:52.060490 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:46:52.060490 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:46:52.060490 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:46:52.060490 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:46:52.060490 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:46:52.060490 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84d00bab-3efd-4f19-8f48-8c4b2fba864a could not be found. Aug 27 02:46:52.060490 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:46:52.060490 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:46:52.060490 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:46:52.060490 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:46:52.060490 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:46:52.060490 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:46:52.060490 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:46:52.060490 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:46:52.060490 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:46:52.062158 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:46:52.062158 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:46:52.062158 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:46:52.062158 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:46:52.062158 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:46:52.062158 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:46:52.062158 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:46:52.062158 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84d00bab-3efd-4f19-8f48-8c4b2fba864a could not be found. Aug 27 02:46:52.062158 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:46:52.062158 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:46:52.062158 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:46:52.062158 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:46:52.062158 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:46:52.062158 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:46:52.062158 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:46:52.062158 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:46:52.062158 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84d00bab-3efd-4f19-8f48-8c4b2fba864a could not be found. Aug 27 02:46:52.062158 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:46:52.066811 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-71a1e61a-6333-4086-a538-cd8529f61905 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Returning 404 to user: Instance 84d00bab-3efd-4f19-8f48-8c4b2fba864a could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:46:52.081865 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-71a1e61a-6333-4086-a538-cd8529f61905 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "GET /compute/v2.1/servers/84d00bab-3efd-4f19-8f48-8c4b2fba864a" status: 404 len: 111 microversion: 2.1 time: 0.098404 Aug 27 02:46:52.083128 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 785/1574] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:51 2022] GET /compute/v2.1/servers/84d00bab-3efd-4f19-8f48-8c4b2fba864a => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:46:52.091296 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-71167ac7-79fd-4fc9-b37e-c703ac3f418d tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:52.146257 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-71167ac7-79fd-4fc9-b37e-c703ac3f418d tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "DELETE /compute/v2.1/os-server-groups/d6951e38-a1eb-49d7-a141-12a7a22c2fe4" status: 204 len: 0 microversion: 2.1 time: 0.059045 Aug 27 02:46:52.147206 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 786/1575] 10.222.0.70 () {58 vars in 1266 bytes} [Sat Aug 27 02:46:52 2022] DELETE /compute/v2.1/os-server-groups/d6951e38-a1eb-49d7-a141-12a7a22c2fe4 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 02:46:52.156013 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e9fb06d3-522e-4a50-953f-ad16c63f8ef4 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:52.157718 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-e9fb06d3-522e-4a50-953f-ad16c63f8ef4 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: 2e16c5b3-ff3c-4afe-ae65-97b9be1b14b0] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:52.170825 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e9fb06d3-522e-4a50-953f-ad16c63f8ef4 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:52.172559 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e9fb06d3-522e-4a50-953f-ad16c63f8ef4 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:52.173273 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e9fb06d3-522e-4a50-953f-ad16c63f8ef4 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:52.174241 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e9fb06d3-522e-4a50-953f-ad16c63f8ef4 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:52.174908 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e9fb06d3-522e-4a50-953f-ad16c63f8ef4 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:52.175590 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e9fb06d3-522e-4a50-953f-ad16c63f8ef4 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:52.230127 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-e9fb06d3-522e-4a50-953f-ad16c63f8ef4 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: 2e16c5b3-ff3c-4afe-ae65-97b9be1b14b0] Going to try to terminate instance {{(pid=134052) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:46:52.386773 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e9fb06d3-522e-4a50-953f-ad16c63f8ef4 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "DELETE /compute/v2.1/servers/2e16c5b3-ff3c-4afe-ae65-97b9be1b14b0" status: 204 len: 0 microversion: 2.1 time: 0.234992 Aug 27 02:46:52.387852 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 787/1576] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:46:52 2022] DELETE /compute/v2.1/servers/2e16c5b3-ff3c-4afe-ae65-97b9be1b14b0 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:46:52.399803 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a268618b-cf19-4746-ace8-4239df437e87 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:52.400752 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a268618b-cf19-4746-ace8-4239df437e87 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: 2e16c5b3-ff3c-4afe-ae65-97b9be1b14b0] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:52.416492 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a268618b-cf19-4746-ace8-4239df437e87 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:52.420341 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a268618b-cf19-4746-ace8-4239df437e87 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:52.422584 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a268618b-cf19-4746-ace8-4239df437e87 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:52.425010 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a268618b-cf19-4746-ace8-4239df437e87 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:52.426773 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a268618b-cf19-4746-ace8-4239df437e87 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:52.427733 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a268618b-cf19-4746-ace8-4239df437e87 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:53.100988 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-790a81cf-a8b8-48ed-8010-b147c0af7e19 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e86c17fe83848e2bc96b7c83ff1cf14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5668e6d96694c62b83f7e8381fe86e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:53.110707 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-790a81cf-a8b8-48ed-8010-b147c0af7e19 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] 10.222.0.70 "GET /compute/v2.1/servers/13799829-bea9-44c8-9993-89cdc60e7d74" status: 200 len: 1523 microversion: 2.1 time: 1.078918 Aug 27 02:46:53.123601 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 790/1577] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:52 2022] GET /compute/v2.1/servers/13799829-bea9-44c8-9993-89cdc60e7d74 => generated 1523 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:53.137707 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d10607b7-3e23-4bd3-90e4-61554c76b31b tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:53.137955 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d10607b7-3e23-4bd3-90e4-61554c76b31b tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 70acfe32-deea-46fc-a214-8fdbb9f6cb7b] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:53.146841 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d10607b7-3e23-4bd3-90e4-61554c76b31b tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:53.148924 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d10607b7-3e23-4bd3-90e4-61554c76b31b tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:53.149913 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d10607b7-3e23-4bd3-90e4-61554c76b31b tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:53.151114 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d10607b7-3e23-4bd3-90e4-61554c76b31b tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:53.151794 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d10607b7-3e23-4bd3-90e4-61554c76b31b tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:53.152488 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d10607b7-3e23-4bd3-90e4-61554c76b31b tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:53.177377 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-a268618b-cf19-4746-ace8-4239df437e87 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6d1646ec094e3297f6f3c51dd72e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b105816fd4e54b9da4973ff721e1fb92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:53.190333 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a268618b-cf19-4746-ace8-4239df437e87 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "GET /compute/v2.1/servers/2e16c5b3-ff3c-4afe-ae65-97b9be1b14b0" status: 200 len: 1473 microversion: 2.1 time: 0.795567 Aug 27 02:46:53.191554 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 788/1578] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:52 2022] GET /compute/v2.1/servers/2e16c5b3-ff3c-4afe-ae65-97b9be1b14b0 => generated 1473 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:53.196897 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-09127593-cb4b-4cdc-95a6-9fb14762ab4c tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:53.198430 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-09127593-cb4b-4cdc-95a6-9fb14762ab4c tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] [instance: 484e03a9-aef3-4179-980c-0e7292a05b5a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:53.206548 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-09127593-cb4b-4cdc-95a6-9fb14762ab4c tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:53.207382 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-09127593-cb4b-4cdc-95a6-9fb14762ab4c tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:53.208013 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-09127593-cb4b-4cdc-95a6-9fb14762ab4c tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:53.208995 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-09127593-cb4b-4cdc-95a6-9fb14762ab4c tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:53.210308 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-09127593-cb4b-4cdc-95a6-9fb14762ab4c tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:53.211119 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-09127593-cb4b-4cdc-95a6-9fb14762ab4c tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:53.643453 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-09127593-cb4b-4cdc-95a6-9fb14762ab4c tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:53.658264 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-09127593-cb4b-4cdc-95a6-9fb14762ab4c tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:53.659710 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-09127593-cb4b-4cdc-95a6-9fb14762ab4c tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:53.664416 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-09127593-cb4b-4cdc-95a6-9fb14762ab4c tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] 10.222.0.70 "GET /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a" status: 200 len: 2832 microversion: 2.42 time: 0.471457 Aug 27 02:46:53.665018 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 789/1579] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:46:53 2022] GET /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a => generated 2832 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:46:53.688541 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d10607b7-3e23-4bd3-90e4-61554c76b31b tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:53.689525 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-26fc8728-4884-4d10-800f-e0be1ba457dd tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:53.690193 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-26fc8728-4884-4d10-800f-e0be1ba457dd tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] [instance: caf46cf7-50ec-4b59-8589-ebbe4ab383e1] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:53.696640 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-26fc8728-4884-4d10-800f-e0be1ba457dd tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:53.697127 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-26fc8728-4884-4d10-800f-e0be1ba457dd tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:53.697564 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-26fc8728-4884-4d10-800f-e0be1ba457dd tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:53.698274 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-26fc8728-4884-4d10-800f-e0be1ba457dd tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:53.698721 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-26fc8728-4884-4d10-800f-e0be1ba457dd tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:53.699142 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-26fc8728-4884-4d10-800f-e0be1ba457dd tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:53.702183 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d10607b7-3e23-4bd3-90e4-61554c76b31b tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b" status: 200 len: 1390 microversion: 2.1 time: 0.572035 Aug 27 02:46:53.710791 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 791/1580] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:53 2022] GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b => generated 1390 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:53.720249 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d33aaa35-2f29-42a3-b3f4-3bf7580a7958 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:53.720768 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d33aaa35-2f29-42a3-b3f4-3bf7580a7958 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] [instance: 13799829-bea9-44c8-9993-89cdc60e7d74] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:53.728997 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d33aaa35-2f29-42a3-b3f4-3bf7580a7958 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:53.732626 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d33aaa35-2f29-42a3-b3f4-3bf7580a7958 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:53.733178 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d33aaa35-2f29-42a3-b3f4-3bf7580a7958 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:53.735454 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d33aaa35-2f29-42a3-b3f4-3bf7580a7958 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:53.737214 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d33aaa35-2f29-42a3-b3f4-3bf7580a7958 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:53.738085 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d33aaa35-2f29-42a3-b3f4-3bf7580a7958 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:53.812617 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d33aaa35-2f29-42a3-b3f4-3bf7580a7958 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] [instance: 13799829-bea9-44c8-9993-89cdc60e7d74] Going to try to terminate instance {{(pid=134051) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:46:54.007647 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d33aaa35-2f29-42a3-b3f4-3bf7580a7958 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] 10.222.0.70 "DELETE /compute/v2.1/servers/13799829-bea9-44c8-9993-89cdc60e7d74" status: 204 len: 0 microversion: 2.1 time: 0.295105 Aug 27 02:46:54.008433 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 792/1581] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:46:53 2022] DELETE /compute/v2.1/servers/13799829-bea9-44c8-9993-89cdc60e7d74 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:46:54.018682 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-794b624c-5dfc-43ae-a595-21f254e21e79 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:54.019329 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-794b624c-5dfc-43ae-a595-21f254e21e79 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] [instance: 484e03a9-aef3-4179-980c-0e7292a05b5a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:54.026304 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-794b624c-5dfc-43ae-a595-21f254e21e79 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:54.027237 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-794b624c-5dfc-43ae-a595-21f254e21e79 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:54.028176 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-794b624c-5dfc-43ae-a595-21f254e21e79 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:54.029389 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-794b624c-5dfc-43ae-a595-21f254e21e79 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:54.030052 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-794b624c-5dfc-43ae-a595-21f254e21e79 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:54.030751 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-794b624c-5dfc-43ae-a595-21f254e21e79 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:54.615116 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-794b624c-5dfc-43ae-a595-21f254e21e79 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] 10.222.0.70 "GET /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a/os-interface" status: 200 len: 1830 microversion: 2.42 time: 0.605306 Aug 27 02:46:54.615711 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 793/1582] 10.222.0.70 () {60 vars in 1316 bytes} [Sat Aug 27 02:46:54 2022] GET /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a/os-interface => generated 1830 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:46:54.630070 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-233ada1b-4103-4df5-ac4e-97734b5422c7 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:54.630683 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-233ada1b-4103-4df5-ac4e-97734b5422c7 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] [instance: 13799829-bea9-44c8-9993-89cdc60e7d74] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:54.637968 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-233ada1b-4103-4df5-ac4e-97734b5422c7 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:54.638882 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-233ada1b-4103-4df5-ac4e-97734b5422c7 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:54.639522 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-233ada1b-4103-4df5-ac4e-97734b5422c7 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:54.640500 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-233ada1b-4103-4df5-ac4e-97734b5422c7 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:54.641141 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-233ada1b-4103-4df5-ac4e-97734b5422c7 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:54.641756 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-233ada1b-4103-4df5-ac4e-97734b5422c7 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:55.066736 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-26fc8728-4884-4d10-800f-e0be1ba457dd tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfec6c2f34f94d66ab1cc982c5bb5bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256b67be18c246b186e09a313db08a7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:55.077316 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-26fc8728-4884-4d10-800f-e0be1ba457dd tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] 10.222.0.70 "GET /compute/v2.1/servers/caf46cf7-50ec-4b59-8589-ebbe4ab383e1" status: 200 len: 1318 microversion: 2.1 time: 1.399691 Aug 27 02:46:55.078277 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 790/1583] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:53 2022] GET /compute/v2.1/servers/caf46cf7-50ec-4b59-8589-ebbe4ab383e1 => generated 1318 bytes in 1412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:55.102500 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-79edede6-dca3-4c24-a366-cc51c3ac08bd tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:55.103132 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-79edede6-dca3-4c24-a366-cc51c3ac08bd tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: 2e16c5b3-ff3c-4afe-ae65-97b9be1b14b0] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:55.133018 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-79edede6-dca3-4c24-a366-cc51c3ac08bd tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:55.134177 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-79edede6-dca3-4c24-a366-cc51c3ac08bd tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:55.135578 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-79edede6-dca3-4c24-a366-cc51c3ac08bd tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:55.140810 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-79edede6-dca3-4c24-a366-cc51c3ac08bd tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:55.140810 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-79edede6-dca3-4c24-a366-cc51c3ac08bd tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:55.144712 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-79edede6-dca3-4c24-a366-cc51c3ac08bd tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:55.448153 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-233ada1b-4103-4df5-ac4e-97734b5422c7 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e86c17fe83848e2bc96b7c83ff1cf14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5668e6d96694c62b83f7e8381fe86e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:55.462978 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-233ada1b-4103-4df5-ac4e-97734b5422c7 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] 10.222.0.70 "GET /compute/v2.1/servers/13799829-bea9-44c8-9993-89cdc60e7d74" status: 200 len: 1529 microversion: 2.1 time: 0.836657 Aug 27 02:46:55.466389 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 794/1584] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:54 2022] GET /compute/v2.1/servers/13799829-bea9-44c8-9993-89cdc60e7d74 => generated 1529 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:55.485982 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ae57b991-988e-4a4b-944a-e5f6e4ef9bce tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:55.486598 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-ae57b991-988e-4a4b-944a-e5f6e4ef9bce tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 70acfe32-deea-46fc-a214-8fdbb9f6cb7b] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:55.495671 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ae57b991-988e-4a4b-944a-e5f6e4ef9bce tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:55.502680 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ae57b991-988e-4a4b-944a-e5f6e4ef9bce tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:55.503697 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ae57b991-988e-4a4b-944a-e5f6e4ef9bce tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:55.504996 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ae57b991-988e-4a4b-944a-e5f6e4ef9bce tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:55.506347 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ae57b991-988e-4a4b-944a-e5f6e4ef9bce tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:55.508978 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ae57b991-988e-4a4b-944a-e5f6e4ef9bce tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:55.559156 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:46:55.827790 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-79edede6-dca3-4c24-a366-cc51c3ac08bd tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6d1646ec094e3297f6f3c51dd72e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b105816fd4e54b9da4973ff721e1fb92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:55.845147 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-79edede6-dca3-4c24-a366-cc51c3ac08bd tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "GET /compute/v2.1/servers/2e16c5b3-ff3c-4afe-ae65-97b9be1b14b0" status: 200 len: 1473 microversion: 2.1 time: 0.759172 Aug 27 02:46:55.845810 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 791/1585] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:55 2022] GET /compute/v2.1/servers/2e16c5b3-ff3c-4afe-ae65-97b9be1b14b0 => generated 1473 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:56.098102 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0c2a5757-1915-4a86-8dfc-16405e7ca87f tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:56.098714 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-0c2a5757-1915-4a86-8dfc-16405e7ca87f tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] [instance: caf46cf7-50ec-4b59-8589-ebbe4ab383e1] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:56.110174 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0c2a5757-1915-4a86-8dfc-16405e7ca87f tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:56.110866 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0c2a5757-1915-4a86-8dfc-16405e7ca87f tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:56.111513 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0c2a5757-1915-4a86-8dfc-16405e7ca87f tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:56.112484 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0c2a5757-1915-4a86-8dfc-16405e7ca87f tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:56.117846 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0c2a5757-1915-4a86-8dfc-16405e7ca87f tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:56.118467 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0c2a5757-1915-4a86-8dfc-16405e7ca87f tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:56.120550 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-ae57b991-988e-4a4b-944a-e5f6e4ef9bce tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:56.136944 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ae57b991-988e-4a4b-944a-e5f6e4ef9bce tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b" status: 200 len: 1390 microversion: 2.1 time: 0.669343 Aug 27 02:46:56.139051 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 795/1586] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:55 2022] GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b => generated 1390 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:56.483380 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d3f4b062-3c2d-4d99-81f2-f7d2c7882b14 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:56.484940 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d3f4b062-3c2d-4d99-81f2-f7d2c7882b14 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] [instance: 13799829-bea9-44c8-9993-89cdc60e7d74] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:56.499708 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d3f4b062-3c2d-4d99-81f2-f7d2c7882b14 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:56.501605 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d3f4b062-3c2d-4d99-81f2-f7d2c7882b14 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:56.502295 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d3f4b062-3c2d-4d99-81f2-f7d2c7882b14 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:56.505864 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d3f4b062-3c2d-4d99-81f2-f7d2c7882b14 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:56.507252 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d3f4b062-3c2d-4d99-81f2-f7d2c7882b14 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:56.508942 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d3f4b062-3c2d-4d99-81f2-f7d2c7882b14 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:56.615899 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0c2a5757-1915-4a86-8dfc-16405e7ca87f tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfec6c2f34f94d66ab1cc982c5bb5bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256b67be18c246b186e09a313db08a7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:56.625299 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-0c2a5757-1915-4a86-8dfc-16405e7ca87f tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] 10.222.0.70 "GET /compute/v2.1/servers/caf46cf7-50ec-4b59-8589-ebbe4ab383e1" status: 200 len: 1318 microversion: 2.1 time: 0.531001 Aug 27 02:46:56.628151 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 792/1587] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:56 2022] GET /compute/v2.1/servers/caf46cf7-50ec-4b59-8589-ebbe4ab383e1 => generated 1318 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:46:56.768732 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-e03d9261-1a6a-4d3d-bf90-5c4966448a50 req-cb53ad81-9ee7-45d6-b21f-de1c90a7051a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e16c5b3-ff3c-4afe-ae65-97b9be1b14b0", "name": "network-vif-deleted", "tag": "12048ca5-6824-4f98-acbb-443024b10a21"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:46:56.785926 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-e03d9261-1a6a-4d3d-bf90-5c4966448a50 req-cb53ad81-9ee7-45d6-b21f-de1c90a7051a service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:56.786750 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-e03d9261-1a6a-4d3d-bf90-5c4966448a50 req-cb53ad81-9ee7-45d6-b21f-de1c90a7051a service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:56.788468 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-e03d9261-1a6a-4d3d-bf90-5c4966448a50 req-cb53ad81-9ee7-45d6-b21f-de1c90a7051a service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:56.810638 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-e03d9261-1a6a-4d3d-bf90-5c4966448a50 req-cb53ad81-9ee7-45d6-b21f-de1c90a7051a service nova] Creating event network-vif-deleted:12048ca5-6824-4f98-acbb-443024b10a21 for instance 2e16c5b3-ff3c-4afe-ae65-97b9be1b14b0 on n-h2-852278-4 Aug 27 02:46:56.826374 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-e03d9261-1a6a-4d3d-bf90-5c4966448a50 req-cb53ad81-9ee7-45d6-b21f-de1c90a7051a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061617 Aug 27 02:46:56.828244 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 793/1588] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:46:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:46:56.866755 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-128a0e95-f904-4816-9168-57a8a7d16ba9 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:56.868874 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-128a0e95-f904-4816-9168-57a8a7d16ba9 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: 2e16c5b3-ff3c-4afe-ae65-97b9be1b14b0] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:56.880808 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-128a0e95-f904-4816-9168-57a8a7d16ba9 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:56.881679 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-128a0e95-f904-4816-9168-57a8a7d16ba9 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:56.882470 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-128a0e95-f904-4816-9168-57a8a7d16ba9 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:56.884872 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-128a0e95-f904-4816-9168-57a8a7d16ba9 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:56.886864 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-128a0e95-f904-4816-9168-57a8a7d16ba9 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:56.887854 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-128a0e95-f904-4816-9168-57a8a7d16ba9 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:57.133554 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-128a0e95-f904-4816-9168-57a8a7d16ba9 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6d1646ec094e3297f6f3c51dd72e85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b105816fd4e54b9da4973ff721e1fb92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:57.150560 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-128a0e95-f904-4816-9168-57a8a7d16ba9 tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "GET /compute/v2.1/servers/2e16c5b3-ff3c-4afe-ae65-97b9be1b14b0" status: 200 len: 1302 microversion: 2.1 time: 0.281851 Aug 27 02:46:57.151750 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 794/1589] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:56 2022] GET /compute/v2.1/servers/2e16c5b3-ff3c-4afe-ae65-97b9be1b14b0 => generated 1302 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:46:57.167189 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c0ce5723-23db-42c7-8aa9-536fccc2ad98 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:57.168723 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-c0ce5723-23db-42c7-8aa9-536fccc2ad98 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 70acfe32-deea-46fc-a214-8fdbb9f6cb7b] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:57.189703 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c0ce5723-23db-42c7-8aa9-536fccc2ad98 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:57.194557 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c0ce5723-23db-42c7-8aa9-536fccc2ad98 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:57.210948 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c0ce5723-23db-42c7-8aa9-536fccc2ad98 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:57.219831 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d3f4b062-3c2d-4d99-81f2-f7d2c7882b14 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e86c17fe83848e2bc96b7c83ff1cf14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5668e6d96694c62b83f7e8381fe86e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:57.233370 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c0ce5723-23db-42c7-8aa9-536fccc2ad98 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:57.234367 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c0ce5723-23db-42c7-8aa9-536fccc2ad98 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:57.234995 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d3f4b062-3c2d-4d99-81f2-f7d2c7882b14 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] 10.222.0.70 "GET /compute/v2.1/servers/13799829-bea9-44c8-9993-89cdc60e7d74" status: 200 len: 1529 microversion: 2.1 time: 0.753385 Aug 27 02:46:57.235705 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c0ce5723-23db-42c7-8aa9-536fccc2ad98 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:57.240376 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 796/1590] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:56 2022] GET /compute/v2.1/servers/13799829-bea9-44c8-9993-89cdc60e7d74 => generated 1529 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:46:57.252952 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-1e83a0b9-be03-4458-b361-e00e4313c2e3 req-875f6c9e-4a6f-43c4-a481-81addd80852a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13799829-bea9-44c8-9993-89cdc60e7d74", "name": "network-vif-deleted", "tag": "eb05dbaa-e7a5-4676-8fc8-62e2c1ec4d85"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:46:57.278969 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-1e83a0b9-be03-4458-b361-e00e4313c2e3 req-875f6c9e-4a6f-43c4-a481-81addd80852a service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:57.285716 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-1e83a0b9-be03-4458-b361-e00e4313c2e3 req-875f6c9e-4a6f-43c4-a481-81addd80852a service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:57.286509 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-1e83a0b9-be03-4458-b361-e00e4313c2e3 req-875f6c9e-4a6f-43c4-a481-81addd80852a service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:57.330793 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-1e83a0b9-be03-4458-b361-e00e4313c2e3 req-875f6c9e-4a6f-43c4-a481-81addd80852a service nova] Creating event network-vif-deleted:eb05dbaa-e7a5-4676-8fc8-62e2c1ec4d85 for instance 13799829-bea9-44c8-9993-89cdc60e7d74 on n-h1-852278-4 Aug 27 02:46:57.346836 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-1e83a0b9-be03-4458-b361-e00e4313c2e3 req-875f6c9e-4a6f-43c4-a481-81addd80852a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095798 Aug 27 02:46:57.351130 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 797/1591] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:46:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:46:57.650657 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e094073b-8764-4f57-bcfb-87356279ea5f tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:57.651460 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-e094073b-8764-4f57-bcfb-87356279ea5f tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] [instance: caf46cf7-50ec-4b59-8589-ebbe4ab383e1] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:57.663948 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e094073b-8764-4f57-bcfb-87356279ea5f tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:57.665701 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e094073b-8764-4f57-bcfb-87356279ea5f tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:57.666377 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e094073b-8764-4f57-bcfb-87356279ea5f tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:57.669186 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e094073b-8764-4f57-bcfb-87356279ea5f tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:57.669900 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e094073b-8764-4f57-bcfb-87356279ea5f tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:57.671227 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e094073b-8764-4f57-bcfb-87356279ea5f tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:57.732037 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-c0ce5723-23db-42c7-8aa9-536fccc2ad98 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:57.740260 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c0ce5723-23db-42c7-8aa9-536fccc2ad98 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b" status: 200 len: 1390 microversion: 2.1 time: 0.584232 Aug 27 02:46:57.740881 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 795/1592] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:57 2022] GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b => generated 1390 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:57.984296 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e094073b-8764-4f57-bcfb-87356279ea5f tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfec6c2f34f94d66ab1cc982c5bb5bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256b67be18c246b186e09a313db08a7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:57.998517 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e094073b-8764-4f57-bcfb-87356279ea5f tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] 10.222.0.70 "GET /compute/v2.1/servers/caf46cf7-50ec-4b59-8589-ebbe4ab383e1" status: 200 len: 1318 microversion: 2.1 time: 0.353456 Aug 27 02:46:58.014610 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 798/1593] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:57 2022] GET /compute/v2.1/servers/caf46cf7-50ec-4b59-8589-ebbe4ab383e1 => generated 1318 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:46:58.175030 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0e262636-0672-49d2-8529-6190964945da tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:58.176608 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-0e262636-0672-49d2-8529-6190964945da tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] [instance: 2e16c5b3-ff3c-4afe-ae65-97b9be1b14b0] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:58.191145 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0e262636-0672-49d2-8529-6190964945da tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:58.191635 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0e262636-0672-49d2-8529-6190964945da tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:58.192072 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0e262636-0672-49d2-8529-6190964945da tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:58.192977 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0e262636-0672-49d2-8529-6190964945da tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:58.193679 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0e262636-0672-49d2-8529-6190964945da tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:58.194326 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0e262636-0672-49d2-8529-6190964945da tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:58.210064 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-0e262636-0672-49d2-8529-6190964945da tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] HTTP exception thrown: Instance 2e16c5b3-ff3c-4afe-ae65-97b9be1b14b0 could not be found. Aug 27 02:46:58.212662 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0e262636-0672-49d2-8529-6190964945da tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Request method failure captured: Aug 27 02:46:58.212662 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/servers/2e16c5b3-ff3c-4afe-ae65-97b9be1b14b0 HTTP/1.1 Aug 27 02:46:58.212662 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:46:58.212662 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:46:58.212662 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:46:58.212662 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:46:58.212662 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:46:58.212662 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:46:58.212662 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:46:58.212662 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:46:58.212662 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYSgO5iP2Rj0OnjMZjg06AspC2AGCawaQncXH6RR0w6SmRKlRtLBLi7PcPgHNU9vdqMkMafrqdLcVHKkwB4D8nTCptd_7hF6weX6SAII7uRF-eRfBaai4y8PcTnfOVHHGeDAMA19n6IWPYlb4txBKWYFlublH5xab2iApkdg2a67esA Aug 27 02:46:58.212662 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:46:58.212662 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:46:58.212662 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:46:58.212662 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:46:58.212662 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:46:58.212662 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:46:58.212662 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: b105816fd4e54b9da4973ff721e1fb92 Aug 27 02:46:58.212662 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ServersOnMultiNodesTest-355465396 Aug 27 02:46:58.212662 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:46:58.212662 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:46:58.214450 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b105816fd4e54b9da4973ff721e1fb92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_b105816fd4e54b9da4973ff721e1fb92", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b105816fd4e54b9da4973ff721e1fb92"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/b105816fd4e54b9da4973ff721e1fb92"}]}] Aug 27 02:46:58.214450 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ServersOnMultiNodesTest-355465396 Aug 27 02:46:58.214450 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: b105816fd4e54b9da4973ff721e1fb92 Aug 27 02:46:58.214450 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-355465396 Aug 27 02:46:58.214450 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ServersOnMultiNodesTest-355465396-project Aug 27 02:46:58.214450 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:46:58.214450 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:46:58.214450 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: eb6d1646ec094e3297f6f3c51dd72e85 Aug 27 02:46:58.214450 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ServersOnMultiNodesTest-355465396-project Aug 27 02:46:58.214450 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 02:46:58.214450 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance 2e16c5b3-ff3c-4afe-ae65-97b9be1b14b0 could not be found. Aug 27 02:46:58.214450 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '2e16c5b3-ff3c-4afe-ae65-97b9be1b14b0'} Aug 27 02:46:58.215584 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:46:58.215584 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:46:58.215584 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:46:58.215584 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:46:58.215584 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:46:58.215584 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:46:58.215584 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:46:58.215584 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:46:58.215584 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:46:58.215584 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:46:58.215584 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e16c5b3-ff3c-4afe-ae65-97b9be1b14b0 could not be found. Aug 27 02:46:58.215584 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:46:58.215584 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:46:58.215584 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:46:58.215584 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:46:58.215584 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:46:58.215584 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:46:58.215584 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:46:58.215584 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:46:58.215584 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:46:58.217408 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:46:58.217408 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:46:58.217408 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:46:58.217408 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:46:58.217408 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:46:58.217408 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:46:58.217408 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:46:58.217408 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e16c5b3-ff3c-4afe-ae65-97b9be1b14b0 could not be found. Aug 27 02:46:58.217408 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:46:58.217408 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:46:58.217408 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:46:58.217408 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:46:58.217408 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:46:58.217408 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:46:58.217408 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:46:58.217408 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:46:58.217408 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e16c5b3-ff3c-4afe-ae65-97b9be1b14b0 could not be found. Aug 27 02:46:58.217408 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:46:58.219772 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0e262636-0672-49d2-8529-6190964945da tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] Returning 404 to user: Instance 2e16c5b3-ff3c-4afe-ae65-97b9be1b14b0 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:46:58.220881 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-0e262636-0672-49d2-8529-6190964945da tempest-ServersOnMultiNodesTest-355465396 tempest-ServersOnMultiNodesTest-355465396-project] 10.222.0.70 "GET /compute/v2.1/servers/2e16c5b3-ff3c-4afe-ae65-97b9be1b14b0" status: 404 len: 111 microversion: 2.1 time: 0.052446 Aug 27 02:46:58.221664 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 796/1594] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:58 2022] GET /compute/v2.1/servers/2e16c5b3-ff3c-4afe-ae65-97b9be1b14b0 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:46:58.266116 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-46da21a7-046c-4e5c-ad12-f8fb94ce06c6 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:58.266801 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-46da21a7-046c-4e5c-ad12-f8fb94ce06c6 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] [instance: 13799829-bea9-44c8-9993-89cdc60e7d74] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:58.280965 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-46da21a7-046c-4e5c-ad12-f8fb94ce06c6 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:58.282065 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-46da21a7-046c-4e5c-ad12-f8fb94ce06c6 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:58.282518 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-46da21a7-046c-4e5c-ad12-f8fb94ce06c6 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:58.283264 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-46da21a7-046c-4e5c-ad12-f8fb94ce06c6 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:58.284602 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-46da21a7-046c-4e5c-ad12-f8fb94ce06c6 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:58.288328 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-46da21a7-046c-4e5c-ad12-f8fb94ce06c6 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:58.364285 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-46da21a7-046c-4e5c-ad12-f8fb94ce06c6 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:58.364990 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-46da21a7-046c-4e5c-ad12-f8fb94ce06c6 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:58.365607 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-46da21a7-046c-4e5c-ad12-f8fb94ce06c6 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:58.366420 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.objects.instance [None req-46da21a7-046c-4e5c-ad12-f8fb94ce06c6 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lazy-loading 'fault' on Instance uuid 13799829-bea9-44c8-9993-89cdc60e7d74 {{(pid=134051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:46:58.413488 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:46:58.443426 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-46da21a7-046c-4e5c-ad12-f8fb94ce06c6 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e86c17fe83848e2bc96b7c83ff1cf14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5668e6d96694c62b83f7e8381fe86e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:58.454262 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-46da21a7-046c-4e5c-ad12-f8fb94ce06c6 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] 10.222.0.70 "GET /compute/v2.1/servers/13799829-bea9-44c8-9993-89cdc60e7d74" status: 200 len: 1315 microversion: 2.1 time: 0.195045 Aug 27 02:46:58.455478 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 799/1595] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:58 2022] GET /compute/v2.1/servers/13799829-bea9-44c8-9993-89cdc60e7d74 => generated 1315 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:58.765393 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4f868a81-cba8-4f32-99a5-d33479e3cbbb tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:58.766407 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-4f868a81-cba8-4f32-99a5-d33479e3cbbb tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 70acfe32-deea-46fc-a214-8fdbb9f6cb7b] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:58.779042 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4f868a81-cba8-4f32-99a5-d33479e3cbbb tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:58.779824 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4f868a81-cba8-4f32-99a5-d33479e3cbbb tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:58.780291 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4f868a81-cba8-4f32-99a5-d33479e3cbbb tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:58.781134 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4f868a81-cba8-4f32-99a5-d33479e3cbbb tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:58.781631 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4f868a81-cba8-4f32-99a5-d33479e3cbbb tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:58.782081 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4f868a81-cba8-4f32-99a5-d33479e3cbbb tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:58.885280 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-ba463275-1aaf-4aa8-b2e1-815aec3789c6 req-3593a72b-53cb-49fc-8f5e-ddc29cec88a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "caf46cf7-50ec-4b59-8589-ebbe4ab383e1", "tag": "a2c4a087-351f-4d8b-b0cf-d69f39b3659e"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:46:58.913195 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-ba463275-1aaf-4aa8-b2e1-815aec3789c6 req-3593a72b-53cb-49fc-8f5e-ddc29cec88a0 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:58.914044 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-ba463275-1aaf-4aa8-b2e1-815aec3789c6 req-3593a72b-53cb-49fc-8f5e-ddc29cec88a0 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:58.914470 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-ba463275-1aaf-4aa8-b2e1-815aec3789c6 req-3593a72b-53cb-49fc-8f5e-ddc29cec88a0 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:58.938374 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-ba463275-1aaf-4aa8-b2e1-815aec3789c6 req-3593a72b-53cb-49fc-8f5e-ddc29cec88a0 service nova] Creating event network-changed:a2c4a087-351f-4d8b-b0cf-d69f39b3659e for instance caf46cf7-50ec-4b59-8589-ebbe4ab383e1 on n-h2-852278-4 Aug 27 02:46:58.947211 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-ba463275-1aaf-4aa8-b2e1-815aec3789c6 req-3593a72b-53cb-49fc-8f5e-ddc29cec88a0 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065497 Aug 27 02:46:58.948516 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 800/1596] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:46:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:46:59.024772 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-bd39f86a-5d2e-4942-be58-da55e01fa988 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:59.025489 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-bd39f86a-5d2e-4942-be58-da55e01fa988 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] [instance: caf46cf7-50ec-4b59-8589-ebbe4ab383e1] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:59.038578 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bd39f86a-5d2e-4942-be58-da55e01fa988 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:59.039150 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bd39f86a-5d2e-4942-be58-da55e01fa988 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:59.042064 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bd39f86a-5d2e-4942-be58-da55e01fa988 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:59.044870 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bd39f86a-5d2e-4942-be58-da55e01fa988 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:59.048628 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bd39f86a-5d2e-4942-be58-da55e01fa988 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:59.050246 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bd39f86a-5d2e-4942-be58-da55e01fa988 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:59.076622 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-4f868a81-cba8-4f32-99a5-d33479e3cbbb tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:59.088513 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-4f868a81-cba8-4f32-99a5-d33479e3cbbb tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b" status: 200 len: 1390 microversion: 2.1 time: 0.326470 Aug 27 02:46:59.089635 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 797/1597] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:58 2022] GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b => generated 1390 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:59.102786 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=8 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:46:59.357100 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-48609a8d-bb65-4739-b097-ef3669aa1e80 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:59.357887 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-48609a8d-bb65-4739-b097-ef3669aa1e80 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: 7eded9ca-c7bc-499a-bb53-a28d2c332402] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:59.379357 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-48609a8d-bb65-4739-b097-ef3669aa1e80 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:59.382110 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-48609a8d-bb65-4739-b097-ef3669aa1e80 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:59.382587 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-48609a8d-bb65-4739-b097-ef3669aa1e80 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:59.383418 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-48609a8d-bb65-4739-b097-ef3669aa1e80 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:59.383900 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-48609a8d-bb65-4739-b097-ef3669aa1e80 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:59.385591 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-48609a8d-bb65-4739-b097-ef3669aa1e80 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:59.495335 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-48609a8d-bb65-4739-b097-ef3669aa1e80 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: 7eded9ca-c7bc-499a-bb53-a28d2c332402] Going to try to terminate instance {{(pid=134052) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:46:59.501608 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:46:59.667179 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-48609a8d-bb65-4739-b097-ef3669aa1e80 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "DELETE /compute/v2.1/servers/7eded9ca-c7bc-499a-bb53-a28d2c332402" status: 204 len: 0 microversion: 2.25 time: 0.313744 Aug 27 02:46:59.667763 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-bd39f86a-5d2e-4942-be58-da55e01fa988 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfec6c2f34f94d66ab1cc982c5bb5bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256b67be18c246b186e09a313db08a7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:59.668239 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 798/1598] 10.222.0.70 () {60 vars in 1280 bytes} [Sat Aug 27 02:46:59 2022] DELETE /compute/v2.1/servers/7eded9ca-c7bc-499a-bb53-a28d2c332402 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 02:46:59.674425 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-667bfee0-3cbb-4443-8bb6-c8546cf9a657 req-39374ae8-42ba-4767-b232-c982e39b6b86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "484e03a9-aef3-4179-980c-0e7292a05b5a", "tag": "cd7a0d56-e84b-4f98-9baf-449824810d8d"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:46:59.677959 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-bd39f86a-5d2e-4942-be58-da55e01fa988 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] 10.222.0.70 "GET /compute/v2.1/servers/caf46cf7-50ec-4b59-8589-ebbe4ab383e1" status: 200 len: 1318 microversion: 2.1 time: 0.658550 Aug 27 02:46:59.685134 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 801/1599] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:59 2022] GET /compute/v2.1/servers/caf46cf7-50ec-4b59-8589-ebbe4ab383e1 => generated 1318 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:46:59.688632 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-667bfee0-3cbb-4443-8bb6-c8546cf9a657 req-39374ae8-42ba-4767-b232-c982e39b6b86 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:59.689424 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-667bfee0-3cbb-4443-8bb6-c8546cf9a657 req-39374ae8-42ba-4767-b232-c982e39b6b86 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:59.690035 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-667bfee0-3cbb-4443-8bb6-c8546cf9a657 req-39374ae8-42ba-4767-b232-c982e39b6b86 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:59.699174 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-929b8590-82fa-4da4-ad01-7fe4b8e274df tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:59.705349 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-929b8590-82fa-4da4-ad01-7fe4b8e274df tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] [instance: 582ea86f-befd-4c47-95d9-2eba872eb8c8] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:59.724646 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-929b8590-82fa-4da4-ad01-7fe4b8e274df tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:59.725568 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-929b8590-82fa-4da4-ad01-7fe4b8e274df tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:59.726236 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-929b8590-82fa-4da4-ad01-7fe4b8e274df tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:59.727191 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-929b8590-82fa-4da4-ad01-7fe4b8e274df tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:59.727875 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-929b8590-82fa-4da4-ad01-7fe4b8e274df tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:59.728619 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-929b8590-82fa-4da4-ad01-7fe4b8e274df tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:59.730396 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-667bfee0-3cbb-4443-8bb6-c8546cf9a657 req-39374ae8-42ba-4767-b232-c982e39b6b86 service nova] Creating event network-changed:cd7a0d56-e84b-4f98-9baf-449824810d8d for instance 484e03a9-aef3-4179-980c-0e7292a05b5a on n-h1-852278-4 Aug 27 02:46:59.742746 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-667bfee0-3cbb-4443-8bb6-c8546cf9a657 req-39374ae8-42ba-4767-b232-c982e39b6b86 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073508 Aug 27 02:46:59.743382 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 799/1600] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:46:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:46:59.758094 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-04224466-8b82-4ed0-9ec7-497d776b5c3a tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:59.758663 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-04224466-8b82-4ed0-9ec7-497d776b5c3a tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] [instance: 13799829-bea9-44c8-9993-89cdc60e7d74] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:59.770821 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-04224466-8b82-4ed0-9ec7-497d776b5c3a tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:59.771308 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-04224466-8b82-4ed0-9ec7-497d776b5c3a tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:59.779019 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-04224466-8b82-4ed0-9ec7-497d776b5c3a tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:59.783834 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-04224466-8b82-4ed0-9ec7-497d776b5c3a tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:59.784384 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-04224466-8b82-4ed0-9ec7-497d776b5c3a tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:59.784765 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-04224466-8b82-4ed0-9ec7-497d776b5c3a tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:59.798786 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-929b8590-82fa-4da4-ad01-7fe4b8e274df tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] 10.222.0.70 "GET /compute/v2.1/servers/582ea86f-befd-4c47-95d9-2eba872eb8c8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.112031 Aug 27 02:46:59.799879 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 802/1601] 10.222.0.70 () {58 vars in 1302 bytes} [Sat Aug 27 02:46:59 2022] GET /compute/v2.1/servers/582ea86f-befd-4c47-95d9-2eba872eb8c8/os-volume_attachments => generated 25 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:46:59.806733 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c6708120-f8c9-434f-b355-00465be45d4b tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:59.807945 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-c6708120-f8c9-434f-b355-00465be45d4b tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: 7eded9ca-c7bc-499a-bb53-a28d2c332402] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:59.817863 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c6708120-f8c9-434f-b355-00465be45d4b tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:59.818384 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c6708120-f8c9-434f-b355-00465be45d4b tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:59.818895 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c6708120-f8c9-434f-b355-00465be45d4b tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:59.819640 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c6708120-f8c9-434f-b355-00465be45d4b tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:59.820857 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c6708120-f8c9-434f-b355-00465be45d4b tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:59.821498 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c6708120-f8c9-434f-b355-00465be45d4b tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:59.821743 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-04224466-8b82-4ed0-9ec7-497d776b5c3a tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] HTTP exception thrown: Instance 13799829-bea9-44c8-9993-89cdc60e7d74 could not be found. Aug 27 02:46:59.823558 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-04224466-8b82-4ed0-9ec7-497d776b5c3a tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Request method failure captured: Aug 27 02:46:59.823558 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/servers/13799829-bea9-44c8-9993-89cdc60e7d74 HTTP/1.1 Aug 27 02:46:59.823558 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:46:59.823558 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:46:59.823558 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:46:59.823558 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:46:59.823558 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:46:59.823558 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:46:59.823558 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:46:59.823558 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:46:59.823558 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYUqULQp-YhXHHCl2hngi9BMJm7wP1pGZCcaxudoyUu4YXudXmRdmBYAkbX0-TS9pqFDwaRuY82uqdOXUJwRWB1ajZ46tfQo1tc4MJsIVgVqim1Pvb2Il-ejDehbyoer8P643aveyI0JrfbznxBx8aFYmMJz3n8FX81wfpLT5u3cMYE Aug 27 02:46:59.823558 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:46:59.823558 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:46:59.823558 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:46:59.823558 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:46:59.823558 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:46:59.823558 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:46:59.823558 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: f5668e6d96694c62b83f7e8381fe86e1 Aug 27 02:46:59.823558 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-94227302 Aug 27 02:46:59.823558 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:46:59.823558 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:46:59.825530 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f5668e6d96694c62b83f7e8381fe86e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f5668e6d96694c62b83f7e8381fe86e1", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f5668e6d96694c62b83f7e8381fe86e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f5668e6d96694c62b83f7e8381fe86e1"}]}] Aug 27 02:46:59.825530 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-94227302 Aug 27 02:46:59.825530 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: f5668e6d96694c62b83f7e8381fe86e1 Aug 27 02:46:59.825530 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-94227302 Aug 27 02:46:59.825530 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ImagesOneServerNegativeTestJSON-94227302-project Aug 27 02:46:59.825530 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:46:59.825530 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:46:59.825530 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 0e86c17fe83848e2bc96b7c83ff1cf14 Aug 27 02:46:59.825530 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-94227302-project Aug 27 02:46:59.825530 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 02:46:59.825530 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance 13799829-bea9-44c8-9993-89cdc60e7d74 could not be found. Aug 27 02:46:59.825530 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '13799829-bea9-44c8-9993-89cdc60e7d74'} Aug 27 02:46:59.826764 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:46:59.826764 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:46:59.826764 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:46:59.826764 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:46:59.826764 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:46:59.826764 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:46:59.826764 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:46:59.826764 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:46:59.826764 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:46:59.826764 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:46:59.826764 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13799829-bea9-44c8-9993-89cdc60e7d74 could not be found. Aug 27 02:46:59.826764 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:46:59.826764 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:46:59.826764 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:46:59.826764 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:46:59.826764 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:46:59.826764 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:46:59.826764 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:46:59.826764 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:46:59.826764 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:46:59.828852 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:46:59.828852 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:46:59.828852 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:46:59.828852 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:46:59.828852 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:46:59.828852 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:46:59.828852 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:46:59.828852 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13799829-bea9-44c8-9993-89cdc60e7d74 could not be found. Aug 27 02:46:59.828852 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:46:59.828852 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:46:59.828852 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:46:59.828852 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:46:59.828852 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:46:59.828852 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:46:59.828852 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:46:59.828852 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:46:59.828852 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13799829-bea9-44c8-9993-89cdc60e7d74 could not be found. Aug 27 02:46:59.828852 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:46:59.831438 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-04224466-8b82-4ed0-9ec7-497d776b5c3a tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Returning 404 to user: Instance 13799829-bea9-44c8-9993-89cdc60e7d74 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:46:59.831438 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-04224466-8b82-4ed0-9ec7-497d776b5c3a tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] 10.222.0.70 "GET /compute/v2.1/servers/13799829-bea9-44c8-9993-89cdc60e7d74" status: 404 len: 111 microversion: 2.1 time: 0.079426 Aug 27 02:46:59.831438 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 800/1602] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:59 2022] GET /compute/v2.1/servers/13799829-bea9-44c8-9993-89cdc60e7d74 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:46:59.833516 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6a27853d-c87f-4d32-baf2-377fafcc0a2f tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Calling method '.version_select at 0x7f5ee345f430>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:59.921355 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-6a27853d-c87f-4d32-baf2-377fafcc0a2f tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] HTTP exception thrown: Image not found. Aug 27 02:46:59.923227 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6a27853d-c87f-4d32-baf2-377fafcc0a2f tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Request method failure captured: Aug 27 02:46:59.923227 n-d-852278-4 devstack@n-api.service[134052]: request: DELETE /compute/v2.1/images/1f1b1cc5-a39e-455a-b8ee-513e915591bb HTTP/1.1 Aug 27 02:46:59.923227 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:46:59.923227 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:46:59.923227 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:46:59.923227 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:46:59.923227 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:46:59.923227 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:46:59.923227 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:46:59.923227 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:46:59.923227 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYUqULQp-YhXHHCl2hngi9BMJm7wP1pGZCcaxudoyUu4YXudXmRdmBYAkbX0-TS9pqFDwaRuY82uqdOXUJwRWB1ajZ46tfQo1tc4MJsIVgVqim1Pvb2Il-ejDehbyoer8P643aveyI0JrfbznxBx8aFYmMJz3n8FX81wfpLT5u3cMYE Aug 27 02:46:59.923227 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:46:59.923227 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:46:59.923227 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:46:59.923227 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:46:59.923227 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:46:59.923227 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:46:59.923227 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: f5668e6d96694c62b83f7e8381fe86e1 Aug 27 02:46:59.923227 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-94227302 Aug 27 02:46:59.923227 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:46:59.923227 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:46:59.924836 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f5668e6d96694c62b83f7e8381fe86e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f5668e6d96694c62b83f7e8381fe86e1", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f5668e6d96694c62b83f7e8381fe86e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f5668e6d96694c62b83f7e8381fe86e1"}]}] Aug 27 02:46:59.924836 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-94227302 Aug 27 02:46:59.924836 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: f5668e6d96694c62b83f7e8381fe86e1 Aug 27 02:46:59.924836 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-94227302 Aug 27 02:46:59.924836 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ImagesOneServerNegativeTestJSON-94227302-project Aug 27 02:46:59.924836 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:46:59.924836 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:46:59.924836 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 0e86c17fe83848e2bc96b7c83ff1cf14 Aug 27 02:46:59.924836 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-94227302-project Aug 27 02:46:59.924836 n-d-852278-4 devstack@n-api.service[134052]: method: Aug 27 02:46:59.924836 n-d-852278-4 devstack@n-api.service[134052]: exception: Image not found. Aug 27 02:46:59.924836 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '1f1b1cc5-a39e-455a-b8ee-513e915591bb'} Aug 27 02:46:59.924836 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:46:59.925727 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:46:59.925727 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 27 02:46:59.925727 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 27 02:46:59.925727 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 02:46:59.925727 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 02:46:59.925727 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 02:46:59.925727 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 02:46:59.925727 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 27 02:46:59.925727 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 27 02:46:59.925727 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 27 02:46:59.925727 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 27 02:46:59.925727 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 02:46:59.925727 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 02:46:59.925727 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 02:46:59.925727 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 02:46:59.925727 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 1f1b1cc5-a39e-455a-b8ee-513e915591bb to delete Aug 27 02:46:59.925727 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:46:59.925727 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:46:59.925727 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:46:59.927260 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:46:59.927260 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 27 02:46:59.927260 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 27 02:46:59.927260 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 27 02:46:59.927260 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 27 02:46:59.927260 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 27 02:46:59.927260 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 27 02:46:59.927260 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 1f1b1cc5-a39e-455a-b8ee-513e915591bb could not be found. Aug 27 02:46:59.927260 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:46:59.927260 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:46:59.927260 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:46:59.927260 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:46:59.927260 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:46:59.927260 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:46:59.927260 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:46:59.927260 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:46:59.927260 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:46:59.927260 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:46:59.927260 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:46:59.927260 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:46:59.929422 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 27 02:46:59.929422 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 27 02:46:59.929422 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 02:46:59.929422 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:46:59.929422 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:46:59.929422 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:46:59.929422 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:46:59.929422 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:46:59.929422 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:46:59.929422 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:46:59.929422 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:46:59.929422 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 02:46:59.929422 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:46:59.929422 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6a27853d-c87f-4d32-baf2-377fafcc0a2f tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Returning 404 to user: Image not found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:46:59.929422 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-6a27853d-c87f-4d32-baf2-377fafcc0a2f tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] 10.222.0.70 "DELETE /compute/v2.1/images/1f1b1cc5-a39e-455a-b8ee-513e915591bb" status: 404 len: 62 microversion: 2.1 time: 0.094841 Aug 27 02:46:59.934589 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 801/1603] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:59 2022] DELETE /compute/v2.1/images/1f1b1cc5-a39e-455a-b8ee-513e915591bb => generated 62 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 02:46:59.935856 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d9b327ca-628f-4891-80ea-6f6cdddf4226 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:59.938446 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d9b327ca-628f-4891-80ea-6f6cdddf4226 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] [instance: 4b798950-60e1-4097-a7e0-365dd0976cb5] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:59.952624 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d9b327ca-628f-4891-80ea-6f6cdddf4226 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:59.953392 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d9b327ca-628f-4891-80ea-6f6cdddf4226 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:59.955069 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d9b327ca-628f-4891-80ea-6f6cdddf4226 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:59.957673 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d9b327ca-628f-4891-80ea-6f6cdddf4226 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:59.961219 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d9b327ca-628f-4891-80ea-6f6cdddf4226 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:59.962040 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d9b327ca-628f-4891-80ea-6f6cdddf4226 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:59.997289 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-d9b327ca-628f-4891-80ea-6f6cdddf4226 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] HTTP exception thrown: Instance 4b798950-60e1-4097-a7e0-365dd0976cb5 could not be found. Aug 27 02:46:59.999274 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d9b327ca-628f-4891-80ea-6f6cdddf4226 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Request method failure captured: Aug 27 02:46:59.999274 n-d-852278-4 devstack@n-api.service[134052]: request: DELETE /compute/v2.1/servers/4b798950-60e1-4097-a7e0-365dd0976cb5 HTTP/1.1 Aug 27 02:46:59.999274 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:46:59.999274 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:46:59.999274 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:46:59.999274 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:46:59.999274 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:46:59.999274 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:46:59.999274 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:46:59.999274 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:46:59.999274 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYUqULQp-YhXHHCl2hngi9BMJm7wP1pGZCcaxudoyUu4YXudXmRdmBYAkbX0-TS9pqFDwaRuY82uqdOXUJwRWB1ajZ46tfQo1tc4MJsIVgVqim1Pvb2Il-ejDehbyoer8P643aveyI0JrfbznxBx8aFYmMJz3n8FX81wfpLT5u3cMYE Aug 27 02:46:59.999274 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:46:59.999274 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:46:59.999274 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:46:59.999274 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:46:59.999274 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:46:59.999274 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:46:59.999274 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: f5668e6d96694c62b83f7e8381fe86e1 Aug 27 02:46:59.999274 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-94227302 Aug 27 02:46:59.999274 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:46:59.999274 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:47:00.000968 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f5668e6d96694c62b83f7e8381fe86e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f5668e6d96694c62b83f7e8381fe86e1", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f5668e6d96694c62b83f7e8381fe86e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f5668e6d96694c62b83f7e8381fe86e1"}]}] Aug 27 02:47:00.000968 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-94227302 Aug 27 02:47:00.000968 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: f5668e6d96694c62b83f7e8381fe86e1 Aug 27 02:47:00.000968 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-94227302 Aug 27 02:47:00.000968 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ImagesOneServerNegativeTestJSON-94227302-project Aug 27 02:47:00.000968 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:47:00.000968 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:47:00.000968 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 0e86c17fe83848e2bc96b7c83ff1cf14 Aug 27 02:47:00.000968 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-94227302-project Aug 27 02:47:00.000968 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 02:47:00.000968 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance 4b798950-60e1-4097-a7e0-365dd0976cb5 could not be found. Aug 27 02:47:00.000968 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '4b798950-60e1-4097-a7e0-365dd0976cb5'} Aug 27 02:47:00.001971 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:47:00.001971 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:47:00.001971 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:47:00.001971 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:47:00.001971 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:47:00.001971 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:47:00.001971 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:47:00.001971 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:47:00.001971 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:47:00.001971 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:47:00.001971 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b798950-60e1-4097-a7e0-365dd0976cb5 could not be found. Aug 27 02:47:00.001971 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:47:00.001971 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:47:00.001971 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:47:00.001971 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:47:00.001971 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:47:00.001971 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:47:00.001971 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:47:00.001971 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:47:00.001971 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:47:00.003585 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:47:00.003585 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 02:47:00.003585 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 02:47:00.003585 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 02:47:00.003585 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 02:47:00.003585 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:47:00.003585 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:47:00.003585 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:47:00.003585 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:47:00.003585 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b798950-60e1-4097-a7e0-365dd0976cb5 could not be found. Aug 27 02:47:00.003585 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:47:00.003585 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:47:00.003585 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:47:00.003585 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:47:00.003585 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:47:00.003585 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:47:00.003585 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:47:00.003585 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:47:00.003585 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b798950-60e1-4097-a7e0-365dd0976cb5 could not be found. Aug 27 02:47:00.003585 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:47:00.017198 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d9b327ca-628f-4891-80ea-6f6cdddf4226 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Returning 404 to user: Instance 4b798950-60e1-4097-a7e0-365dd0976cb5 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:47:00.018091 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d9b327ca-628f-4891-80ea-6f6cdddf4226 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] 10.222.0.70 "DELETE /compute/v2.1/servers/4b798950-60e1-4097-a7e0-365dd0976cb5" status: 404 len: 111 microversion: 2.1 time: 0.087533 Aug 27 02:47:00.018686 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 802/1604] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:46:59 2022] DELETE /compute/v2.1/servers/4b798950-60e1-4097-a7e0-365dd0976cb5 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 02:47:00.023482 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-53233ed2-732b-4d6f-bb4f-da8b44eb6390 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:00.025863 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-53233ed2-732b-4d6f-bb4f-da8b44eb6390 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] [instance: 582ea86f-befd-4c47-95d9-2eba872eb8c8] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:00.039403 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-53233ed2-732b-4d6f-bb4f-da8b44eb6390 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:00.042689 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-53233ed2-732b-4d6f-bb4f-da8b44eb6390 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:00.043164 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-53233ed2-732b-4d6f-bb4f-da8b44eb6390 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:00.043897 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-53233ed2-732b-4d6f-bb4f-da8b44eb6390 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:00.048373 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-53233ed2-732b-4d6f-bb4f-da8b44eb6390 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:00.049126 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-53233ed2-732b-4d6f-bb4f-da8b44eb6390 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:00.088971 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-53233ed2-732b-4d6f-bb4f-da8b44eb6390 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] 10.222.0.70 "GET /compute/v2.1/servers/582ea86f-befd-4c47-95d9-2eba872eb8c8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.069211 Aug 27 02:47:00.091466 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 803/1605] 10.222.0.70 () {58 vars in 1302 bytes} [Sat Aug 27 02:47:00 2022] GET /compute/v2.1/servers/582ea86f-befd-4c47-95d9-2eba872eb8c8/os-volume_attachments => generated 25 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:47:00.103436 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5a83d82b-6fc7-4ca6-9472-7a69b7bd4d0d tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:00.104627 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-5a83d82b-6fc7-4ca6-9472-7a69b7bd4d0d tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] [instance: 4b798950-60e1-4097-a7e0-365dd0976cb5] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:00.113935 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5a83d82b-6fc7-4ca6-9472-7a69b7bd4d0d tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:00.114778 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5a83d82b-6fc7-4ca6-9472-7a69b7bd4d0d tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:00.115487 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5a83d82b-6fc7-4ca6-9472-7a69b7bd4d0d tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:00.116458 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5a83d82b-6fc7-4ca6-9472-7a69b7bd4d0d tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:00.117131 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5a83d82b-6fc7-4ca6-9472-7a69b7bd4d0d tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:00.117807 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5a83d82b-6fc7-4ca6-9472-7a69b7bd4d0d tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:00.135088 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-5a83d82b-6fc7-4ca6-9472-7a69b7bd4d0d tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] HTTP exception thrown: Instance 4b798950-60e1-4097-a7e0-365dd0976cb5 could not be found. Aug 27 02:47:00.136925 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5a83d82b-6fc7-4ca6-9472-7a69b7bd4d0d tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Request method failure captured: Aug 27 02:47:00.136925 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/servers/4b798950-60e1-4097-a7e0-365dd0976cb5 HTTP/1.1 Aug 27 02:47:00.136925 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:47:00.136925 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:47:00.136925 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:47:00.136925 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:47:00.136925 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:47:00.136925 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:47:00.136925 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:47:00.136925 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:47:00.136925 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYUqULQp-YhXHHCl2hngi9BMJm7wP1pGZCcaxudoyUu4YXudXmRdmBYAkbX0-TS9pqFDwaRuY82uqdOXUJwRWB1ajZ46tfQo1tc4MJsIVgVqim1Pvb2Il-ejDehbyoer8P643aveyI0JrfbznxBx8aFYmMJz3n8FX81wfpLT5u3cMYE Aug 27 02:47:00.136925 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:47:00.136925 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:47:00.136925 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:47:00.136925 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:47:00.136925 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:47:00.136925 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:47:00.136925 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: f5668e6d96694c62b83f7e8381fe86e1 Aug 27 02:47:00.136925 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-94227302 Aug 27 02:47:00.136925 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:47:00.136925 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:47:00.138512 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f5668e6d96694c62b83f7e8381fe86e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f5668e6d96694c62b83f7e8381fe86e1", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f5668e6d96694c62b83f7e8381fe86e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f5668e6d96694c62b83f7e8381fe86e1"}]}] Aug 27 02:47:00.138512 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-94227302 Aug 27 02:47:00.138512 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: f5668e6d96694c62b83f7e8381fe86e1 Aug 27 02:47:00.138512 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-94227302 Aug 27 02:47:00.138512 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ImagesOneServerNegativeTestJSON-94227302-project Aug 27 02:47:00.138512 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:47:00.138512 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:47:00.138512 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 0e86c17fe83848e2bc96b7c83ff1cf14 Aug 27 02:47:00.138512 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-94227302-project Aug 27 02:47:00.138512 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 02:47:00.138512 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance 4b798950-60e1-4097-a7e0-365dd0976cb5 could not be found. Aug 27 02:47:00.138512 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '4b798950-60e1-4097-a7e0-365dd0976cb5'} Aug 27 02:47:00.139356 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:47:00.139356 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:47:00.139356 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:47:00.139356 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:47:00.139356 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:47:00.139356 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:47:00.139356 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:47:00.139356 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:47:00.139356 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:47:00.139356 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:47:00.139356 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b798950-60e1-4097-a7e0-365dd0976cb5 could not be found. Aug 27 02:47:00.139356 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:47:00.139356 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:47:00.139356 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:47:00.139356 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:47:00.139356 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:47:00.139356 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:47:00.139356 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:47:00.139356 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:47:00.139356 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:47:00.140794 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:47:00.140794 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:47:00.140794 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:47:00.140794 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:47:00.140794 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:47:00.140794 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:47:00.140794 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:47:00.140794 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b798950-60e1-4097-a7e0-365dd0976cb5 could not be found. Aug 27 02:47:00.140794 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:47:00.140794 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:47:00.140794 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:47:00.140794 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:47:00.140794 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:47:00.140794 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:47:00.140794 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:47:00.140794 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:47:00.140794 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b798950-60e1-4097-a7e0-365dd0976cb5 could not be found. Aug 27 02:47:00.140794 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:47:00.143965 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-c6708120-f8c9-434f-b355-00465be45d4b tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:00.145881 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5a83d82b-6fc7-4ca6-9472-7a69b7bd4d0d tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Returning 404 to user: Instance 4b798950-60e1-4097-a7e0-365dd0976cb5 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:47:00.146978 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-5a83d82b-6fc7-4ca6-9472-7a69b7bd4d0d tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] 10.222.0.70 "GET /compute/v2.1/servers/4b798950-60e1-4097-a7e0-365dd0976cb5" status: 404 len: 111 microversion: 2.1 time: 0.049053 Aug 27 02:47:00.148565 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 804/1606] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:00 2022] GET /compute/v2.1/servers/4b798950-60e1-4097-a7e0-365dd0976cb5 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:47:00.154503 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-c6708120-f8c9-434f-b355-00465be45d4b tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:00.155383 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a3c88d8f-3482-48d4-b1eb-731a754c03c0 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:00.155953 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-c6708120-f8c9-434f-b355-00465be45d4b tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:00.156543 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a3c88d8f-3482-48d4-b1eb-731a754c03c0 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 70acfe32-deea-46fc-a214-8fdbb9f6cb7b] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:00.161277 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c6708120-f8c9-434f-b355-00465be45d4b tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/7eded9ca-c7bc-499a-bb53-a28d2c332402" status: 200 len: 1730 microversion: 2.25 time: 0.359737 Aug 27 02:47:00.161879 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 803/1607] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:46:59 2022] GET /compute/v2.1/servers/7eded9ca-c7bc-499a-bb53-a28d2c332402 => generated 1730 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:47:00.173396 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a3c88d8f-3482-48d4-b1eb-731a754c03c0 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:00.173396 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a3c88d8f-3482-48d4-b1eb-731a754c03c0 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:00.173396 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a3c88d8f-3482-48d4-b1eb-731a754c03c0 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:00.173742 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b398c98d-294a-4855-ac8a-6a2e465ed186 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Calling method '.version_select at 0x7f5edeb75e50>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:00.173842 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a3c88d8f-3482-48d4-b1eb-731a754c03c0 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:00.173842 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a3c88d8f-3482-48d4-b1eb-731a754c03c0 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:00.173842 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a3c88d8f-3482-48d4-b1eb-731a754c03c0 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:00.220074 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b398c98d-294a-4855-ac8a-6a2e465ed186 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1592412541" status: 202 len: 0 microversion: 2.1 time: 0.056494 Aug 27 02:47:00.221546 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 804/1608] 10.222.0.70 () {58 vars in 1221 bytes} [Sat Aug 27 02:47:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1592412541 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:47:00.228771 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-2f8f8c51-7c11-48d7-adb7-47e3b603ca08 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:00.229270 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-2f8f8c51-7c11-48d7-adb7-47e3b603ca08 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] [instance: 582ea86f-befd-4c47-95d9-2eba872eb8c8] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:00.242084 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2f8f8c51-7c11-48d7-adb7-47e3b603ca08 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:00.242623 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2f8f8c51-7c11-48d7-adb7-47e3b603ca08 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:00.243066 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2f8f8c51-7c11-48d7-adb7-47e3b603ca08 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:00.243793 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2f8f8c51-7c11-48d7-adb7-47e3b603ca08 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:00.244233 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2f8f8c51-7c11-48d7-adb7-47e3b603ca08 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:00.244690 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2f8f8c51-7c11-48d7-adb7-47e3b603ca08 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:00.274309 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-2f8f8c51-7c11-48d7-adb7-47e3b603ca08 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] [instance: 582ea86f-befd-4c47-95d9-2eba872eb8c8] Going to try to terminate instance {{(pid=134051) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:47:00.381351 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-2f8f8c51-7c11-48d7-adb7-47e3b603ca08 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] 10.222.0.70 "DELETE /compute/v2.1/servers/582ea86f-befd-4c47-95d9-2eba872eb8c8" status: 204 len: 0 microversion: 2.1 time: 0.157885 Aug 27 02:47:00.383539 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 805/1609] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:47:00 2022] DELETE /compute/v2.1/servers/582ea86f-befd-4c47-95d9-2eba872eb8c8 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:47:00.396373 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d95484e2-d37f-4bf3-8083-2b5f71530a01 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:00.397570 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d95484e2-d37f-4bf3-8083-2b5f71530a01 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] [instance: 582ea86f-befd-4c47-95d9-2eba872eb8c8] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:00.406945 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d95484e2-d37f-4bf3-8083-2b5f71530a01 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:00.407788 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d95484e2-d37f-4bf3-8083-2b5f71530a01 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:00.408437 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d95484e2-d37f-4bf3-8083-2b5f71530a01 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:00.409447 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d95484e2-d37f-4bf3-8083-2b5f71530a01 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:00.410475 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d95484e2-d37f-4bf3-8083-2b5f71530a01 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:00.411296 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d95484e2-d37f-4bf3-8083-2b5f71530a01 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:00.764937 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d95484e2-d37f-4bf3-8083-2b5f71530a01 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32514a813c0a4031a1d1effc807db17d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe9e2cfe40746dd8af1792468a57a2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:00.774346 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d95484e2-d37f-4bf3-8083-2b5f71530a01 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] 10.222.0.70 "GET /compute/v2.1/servers/582ea86f-befd-4c47-95d9-2eba872eb8c8" status: 200 len: 1678 microversion: 2.1 time: 0.384067 Aug 27 02:47:00.779726 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 806/1610] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:00 2022] GET /compute/v2.1/servers/582ea86f-befd-4c47-95d9-2eba872eb8c8 => generated 1678 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:47:00.785201 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-a3c88d8f-3482-48d4-b1eb-731a754c03c0 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:00.792494 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-84858785-b6fb-4a9f-9cad-49d2a5bb4f24 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:00.793339 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-84858785-b6fb-4a9f-9cad-49d2a5bb4f24 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] [instance: caf46cf7-50ec-4b59-8589-ebbe4ab383e1] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:00.797675 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a3c88d8f-3482-48d4-b1eb-731a754c03c0 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b" status: 200 len: 1390 microversion: 2.1 time: 0.645891 Aug 27 02:47:00.807840 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-84858785-b6fb-4a9f-9cad-49d2a5bb4f24 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:00.812245 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-84858785-b6fb-4a9f-9cad-49d2a5bb4f24 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:00.812944 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-84858785-b6fb-4a9f-9cad-49d2a5bb4f24 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:00.813206 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 805/1611] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:00 2022] GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b => generated 1390 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:00.816001 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-84858785-b6fb-4a9f-9cad-49d2a5bb4f24 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:00.817346 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-84858785-b6fb-4a9f-9cad-49d2a5bb4f24 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:00.817939 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-84858785-b6fb-4a9f-9cad-49d2a5bb4f24 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:01.187423 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-cc0ab953-24a3-4e05-b38c-91105b1af53a tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:01.188901 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-cc0ab953-24a3-4e05-b38c-91105b1af53a tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: 7eded9ca-c7bc-499a-bb53-a28d2c332402] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:01.198706 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cc0ab953-24a3-4e05-b38c-91105b1af53a tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:01.200010 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cc0ab953-24a3-4e05-b38c-91105b1af53a tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:01.201562 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cc0ab953-24a3-4e05-b38c-91105b1af53a tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:01.203014 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cc0ab953-24a3-4e05-b38c-91105b1af53a tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:01.204060 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cc0ab953-24a3-4e05-b38c-91105b1af53a tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:01.205010 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cc0ab953-24a3-4e05-b38c-91105b1af53a tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:01.409135 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-84858785-b6fb-4a9f-9cad-49d2a5bb4f24 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfec6c2f34f94d66ab1cc982c5bb5bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256b67be18c246b186e09a313db08a7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:01.424221 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-84858785-b6fb-4a9f-9cad-49d2a5bb4f24 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] 10.222.0.70 "GET /compute/v2.1/servers/caf46cf7-50ec-4b59-8589-ebbe4ab383e1" status: 200 len: 1318 microversion: 2.1 time: 0.641695 Aug 27 02:47:01.427354 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 807/1612] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:00 2022] GET /compute/v2.1/servers/caf46cf7-50ec-4b59-8589-ebbe4ab383e1 => generated 1318 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:01.540560 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-cc0ab953-24a3-4e05-b38c-91105b1af53a tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:01.550894 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-38aa63d9-0238-412c-80f6-ea1045c1b905 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Calling method '.version_select at 0x7f5edf384940>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:01.555966 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-cc0ab953-24a3-4e05-b38c-91105b1af53a tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:01.558566 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-cc0ab953-24a3-4e05-b38c-91105b1af53a tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:01.561270 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-cc0ab953-24a3-4e05-b38c-91105b1af53a tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/7eded9ca-c7bc-499a-bb53-a28d2c332402" status: 200 len: 1730 microversion: 2.25 time: 0.378162 Aug 27 02:47:01.579060 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 806/1613] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:47:01 2022] GET /compute/v2.1/servers/7eded9ca-c7bc-499a-bb53-a28d2c332402 => generated 1730 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:47:01.598655 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-38aa63d9-0238-412c-80f6-ea1045c1b905 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] HTTP exception thrown: Image not found. Aug 27 02:47:01.603485 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-38aa63d9-0238-412c-80f6-ea1045c1b905 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Request method failure captured: Aug 27 02:47:01.603485 n-d-852278-4 devstack@n-api.service[134051]: request: DELETE /compute/v2.1/images/06c254e5-271a-4049-9b57-9f07f052b1e8 HTTP/1.1 Aug 27 02:47:01.603485 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:47:01.603485 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:47:01.603485 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:47:01.603485 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:47:01.603485 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:47:01.603485 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:47:01.603485 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:47:01.603485 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:47:01.603485 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYUqULQp-YhXHHCl2hngi9BMJm7wP1pGZCcaxudoyUu4YXudXmRdmBYAkbX0-TS9pqFDwaRuY82uqdOXUJwRWB1ajZ46tfQo1tc4MJsIVgVqim1Pvb2Il-ejDehbyoer8P643aveyI0JrfbznxBx8aFYmMJz3n8FX81wfpLT5u3cMYE Aug 27 02:47:01.603485 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:47:01.603485 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:47:01.603485 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:47:01.603485 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:47:01.603485 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:47:01.603485 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:47:01.603485 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: f5668e6d96694c62b83f7e8381fe86e1 Aug 27 02:47:01.603485 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-94227302 Aug 27 02:47:01.603485 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:47:01.603485 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:47:01.605475 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f5668e6d96694c62b83f7e8381fe86e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f5668e6d96694c62b83f7e8381fe86e1", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f5668e6d96694c62b83f7e8381fe86e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f5668e6d96694c62b83f7e8381fe86e1"}]}] Aug 27 02:47:01.605475 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-94227302 Aug 27 02:47:01.605475 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: f5668e6d96694c62b83f7e8381fe86e1 Aug 27 02:47:01.605475 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-94227302 Aug 27 02:47:01.605475 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ImagesOneServerNegativeTestJSON-94227302-project Aug 27 02:47:01.605475 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:47:01.605475 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:47:01.605475 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 0e86c17fe83848e2bc96b7c83ff1cf14 Aug 27 02:47:01.605475 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-94227302-project Aug 27 02:47:01.605475 n-d-852278-4 devstack@n-api.service[134051]: method: Aug 27 02:47:01.605475 n-d-852278-4 devstack@n-api.service[134051]: exception: Image not found. Aug 27 02:47:01.605475 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '06c254e5-271a-4049-9b57-9f07f052b1e8'} Aug 27 02:47:01.605475 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:47:01.606596 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:47:01.606596 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 27 02:47:01.606596 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 27 02:47:01.606596 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 02:47:01.606596 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 02:47:01.606596 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 02:47:01.606596 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 02:47:01.606596 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 27 02:47:01.606596 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 27 02:47:01.606596 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 27 02:47:01.606596 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 27 02:47:01.606596 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 02:47:01.606596 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 02:47:01.606596 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 02:47:01.606596 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 02:47:01.606596 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 06c254e5-271a-4049-9b57-9f07f052b1e8 to delete Aug 27 02:47:01.606596 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:47:01.606596 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:47:01.606596 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:47:01.608410 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:47:01.608410 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 27 02:47:01.608410 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 27 02:47:01.608410 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 27 02:47:01.608410 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 27 02:47:01.608410 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 27 02:47:01.608410 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 27 02:47:01.608410 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 06c254e5-271a-4049-9b57-9f07f052b1e8 could not be found. Aug 27 02:47:01.608410 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:47:01.608410 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:47:01.608410 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:47:01.608410 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:47:01.608410 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:47:01.608410 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:47:01.608410 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:47:01.608410 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:47:01.608410 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:47:01.608410 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:47:01.608410 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:47:01.608410 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:47:01.610171 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 27 02:47:01.610171 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 27 02:47:01.610171 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 02:47:01.610171 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:47:01.610171 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:47:01.610171 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:47:01.610171 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:47:01.610171 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:47:01.610171 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:47:01.610171 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:47:01.610171 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:47:01.610171 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 02:47:01.610171 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:47:01.612475 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-38aa63d9-0238-412c-80f6-ea1045c1b905 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Returning 404 to user: Image not found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:47:01.615130 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-38aa63d9-0238-412c-80f6-ea1045c1b905 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] 10.222.0.70 "DELETE /compute/v2.1/images/06c254e5-271a-4049-9b57-9f07f052b1e8" status: 404 len: 62 microversion: 2.1 time: 0.067412 Aug 27 02:47:01.617017 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 808/1614] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:01 2022] DELETE /compute/v2.1/images/06c254e5-271a-4049-9b57-9f07f052b1e8 => generated 62 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 02:47:01.624805 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-28fb5cf8-a463-4929-aa60-f03fb04b80ac tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:01.625570 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-28fb5cf8-a463-4929-aa60-f03fb04b80ac tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] [instance: 98a9933e-6c22-491a-90bb-d1d2c0bb7df9] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:01.640436 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-28fb5cf8-a463-4929-aa60-f03fb04b80ac tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:01.641402 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-28fb5cf8-a463-4929-aa60-f03fb04b80ac tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:01.642253 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-28fb5cf8-a463-4929-aa60-f03fb04b80ac tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:01.644008 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-28fb5cf8-a463-4929-aa60-f03fb04b80ac tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:01.644892 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-28fb5cf8-a463-4929-aa60-f03fb04b80ac tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:01.645711 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-28fb5cf8-a463-4929-aa60-f03fb04b80ac tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:01.678663 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-28fb5cf8-a463-4929-aa60-f03fb04b80ac tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] HTTP exception thrown: Instance 98a9933e-6c22-491a-90bb-d1d2c0bb7df9 could not be found. Aug 27 02:47:01.680230 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-28fb5cf8-a463-4929-aa60-f03fb04b80ac tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Request method failure captured: Aug 27 02:47:01.680230 n-d-852278-4 devstack@n-api.service[134052]: request: DELETE /compute/v2.1/servers/98a9933e-6c22-491a-90bb-d1d2c0bb7df9 HTTP/1.1 Aug 27 02:47:01.680230 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:47:01.680230 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:47:01.680230 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:47:01.680230 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:47:01.680230 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:47:01.680230 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:47:01.680230 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:47:01.680230 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:47:01.680230 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYUqULQp-YhXHHCl2hngi9BMJm7wP1pGZCcaxudoyUu4YXudXmRdmBYAkbX0-TS9pqFDwaRuY82uqdOXUJwRWB1ajZ46tfQo1tc4MJsIVgVqim1Pvb2Il-ejDehbyoer8P643aveyI0JrfbznxBx8aFYmMJz3n8FX81wfpLT5u3cMYE Aug 27 02:47:01.680230 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:47:01.680230 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:47:01.680230 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:47:01.680230 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:47:01.680230 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:47:01.680230 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:47:01.680230 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: f5668e6d96694c62b83f7e8381fe86e1 Aug 27 02:47:01.680230 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-94227302 Aug 27 02:47:01.680230 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:47:01.680230 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:47:01.681904 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f5668e6d96694c62b83f7e8381fe86e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f5668e6d96694c62b83f7e8381fe86e1", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f5668e6d96694c62b83f7e8381fe86e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f5668e6d96694c62b83f7e8381fe86e1"}]}] Aug 27 02:47:01.681904 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-94227302 Aug 27 02:47:01.681904 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: f5668e6d96694c62b83f7e8381fe86e1 Aug 27 02:47:01.681904 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-94227302 Aug 27 02:47:01.681904 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ImagesOneServerNegativeTestJSON-94227302-project Aug 27 02:47:01.681904 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:47:01.681904 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:47:01.681904 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 0e86c17fe83848e2bc96b7c83ff1cf14 Aug 27 02:47:01.681904 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-94227302-project Aug 27 02:47:01.681904 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 02:47:01.681904 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance 98a9933e-6c22-491a-90bb-d1d2c0bb7df9 could not be found. Aug 27 02:47:01.681904 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '98a9933e-6c22-491a-90bb-d1d2c0bb7df9'} Aug 27 02:47:01.682789 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:47:01.682789 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:47:01.682789 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:47:01.682789 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:47:01.682789 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:47:01.682789 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:47:01.682789 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:47:01.682789 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:47:01.682789 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:47:01.682789 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:47:01.682789 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98a9933e-6c22-491a-90bb-d1d2c0bb7df9 could not be found. Aug 27 02:47:01.682789 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:47:01.682789 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:47:01.682789 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:47:01.682789 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:47:01.682789 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:47:01.682789 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:47:01.682789 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:47:01.682789 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:47:01.682789 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:47:01.684732 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:47:01.684732 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 02:47:01.684732 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 02:47:01.684732 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 02:47:01.684732 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 02:47:01.684732 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:47:01.684732 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:47:01.684732 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:47:01.684732 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:47:01.684732 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98a9933e-6c22-491a-90bb-d1d2c0bb7df9 could not be found. Aug 27 02:47:01.684732 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:47:01.684732 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:47:01.684732 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:47:01.684732 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:47:01.684732 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:47:01.684732 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:47:01.684732 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:47:01.684732 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:47:01.684732 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98a9933e-6c22-491a-90bb-d1d2c0bb7df9 could not be found. Aug 27 02:47:01.684732 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:47:01.689193 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-28fb5cf8-a463-4929-aa60-f03fb04b80ac tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Returning 404 to user: Instance 98a9933e-6c22-491a-90bb-d1d2c0bb7df9 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:47:01.689193 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-28fb5cf8-a463-4929-aa60-f03fb04b80ac tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] 10.222.0.70 "DELETE /compute/v2.1/servers/98a9933e-6c22-491a-90bb-d1d2c0bb7df9" status: 404 len: 111 microversion: 2.1 time: 0.063264 Aug 27 02:47:01.689193 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 807/1615] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:47:01 2022] DELETE /compute/v2.1/servers/98a9933e-6c22-491a-90bb-d1d2c0bb7df9 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:47:01.693679 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c17e3849-6448-4995-aa25-897472cb7264 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:01.694352 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-c17e3849-6448-4995-aa25-897472cb7264 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] [instance: 98a9933e-6c22-491a-90bb-d1d2c0bb7df9] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:01.707062 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c17e3849-6448-4995-aa25-897472cb7264 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:01.708697 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c17e3849-6448-4995-aa25-897472cb7264 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:01.709145 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c17e3849-6448-4995-aa25-897472cb7264 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:01.712474 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c17e3849-6448-4995-aa25-897472cb7264 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:01.713099 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c17e3849-6448-4995-aa25-897472cb7264 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:01.714064 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c17e3849-6448-4995-aa25-897472cb7264 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:01.751011 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-c17e3849-6448-4995-aa25-897472cb7264 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] HTTP exception thrown: Instance 98a9933e-6c22-491a-90bb-d1d2c0bb7df9 could not be found. Aug 27 02:47:01.769208 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c17e3849-6448-4995-aa25-897472cb7264 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Request method failure captured: Aug 27 02:47:01.769208 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/98a9933e-6c22-491a-90bb-d1d2c0bb7df9 HTTP/1.1 Aug 27 02:47:01.769208 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:47:01.769208 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:47:01.769208 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:47:01.769208 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:47:01.769208 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:47:01.769208 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:47:01.769208 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:47:01.769208 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:47:01.769208 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYUqULQp-YhXHHCl2hngi9BMJm7wP1pGZCcaxudoyUu4YXudXmRdmBYAkbX0-TS9pqFDwaRuY82uqdOXUJwRWB1ajZ46tfQo1tc4MJsIVgVqim1Pvb2Il-ejDehbyoer8P643aveyI0JrfbznxBx8aFYmMJz3n8FX81wfpLT5u3cMYE Aug 27 02:47:01.769208 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:47:01.769208 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:47:01.769208 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:47:01.769208 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:47:01.769208 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:47:01.769208 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:47:01.769208 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: f5668e6d96694c62b83f7e8381fe86e1 Aug 27 02:47:01.769208 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-94227302 Aug 27 02:47:01.769208 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:47:01.769208 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:47:01.771202 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f5668e6d96694c62b83f7e8381fe86e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f5668e6d96694c62b83f7e8381fe86e1", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f5668e6d96694c62b83f7e8381fe86e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f5668e6d96694c62b83f7e8381fe86e1"}]}] Aug 27 02:47:01.771202 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-94227302 Aug 27 02:47:01.771202 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: f5668e6d96694c62b83f7e8381fe86e1 Aug 27 02:47:01.771202 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-94227302 Aug 27 02:47:01.771202 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ImagesOneServerNegativeTestJSON-94227302-project Aug 27 02:47:01.771202 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:47:01.771202 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:47:01.771202 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 0e86c17fe83848e2bc96b7c83ff1cf14 Aug 27 02:47:01.771202 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-94227302-project Aug 27 02:47:01.771202 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 02:47:01.771202 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance 98a9933e-6c22-491a-90bb-d1d2c0bb7df9 could not be found. Aug 27 02:47:01.771202 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '98a9933e-6c22-491a-90bb-d1d2c0bb7df9'} Aug 27 02:47:01.772076 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:47:01.772076 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:47:01.772076 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:47:01.772076 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:47:01.772076 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:47:01.772076 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:47:01.772076 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:47:01.772076 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:47:01.772076 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:47:01.772076 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:47:01.772076 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98a9933e-6c22-491a-90bb-d1d2c0bb7df9 could not be found. Aug 27 02:47:01.772076 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:47:01.772076 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:47:01.772076 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:47:01.772076 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:47:01.772076 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:47:01.772076 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:47:01.772076 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:47:01.772076 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:47:01.772076 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:47:01.775874 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:47:01.775874 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:47:01.775874 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:47:01.775874 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:47:01.775874 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:47:01.775874 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:47:01.775874 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:47:01.775874 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98a9933e-6c22-491a-90bb-d1d2c0bb7df9 could not be found. Aug 27 02:47:01.775874 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:47:01.775874 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:47:01.775874 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:47:01.775874 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:47:01.775874 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:47:01.775874 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:47:01.775874 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:47:01.775874 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:47:01.775874 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98a9933e-6c22-491a-90bb-d1d2c0bb7df9 could not be found. Aug 27 02:47:01.775874 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:47:01.779786 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c17e3849-6448-4995-aa25-897472cb7264 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] Returning 404 to user: Instance 98a9933e-6c22-491a-90bb-d1d2c0bb7df9 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:47:01.779786 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c17e3849-6448-4995-aa25-897472cb7264 tempest-ImagesOneServerNegativeTestJSON-94227302 tempest-ImagesOneServerNegativeTestJSON-94227302-project] 10.222.0.70 "GET /compute/v2.1/servers/98a9933e-6c22-491a-90bb-d1d2c0bb7df9" status: 404 len: 111 microversion: 2.1 time: 0.084898 Aug 27 02:47:01.779786 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 809/1616] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:01 2022] GET /compute/v2.1/servers/98a9933e-6c22-491a-90bb-d1d2c0bb7df9 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:47:01.804739 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-adee3018-1e0d-4d1e-9d06-457208782761 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:01.805423 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-adee3018-1e0d-4d1e-9d06-457208782761 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] [instance: 582ea86f-befd-4c47-95d9-2eba872eb8c8] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:01.823697 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-adee3018-1e0d-4d1e-9d06-457208782761 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:01.824487 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-adee3018-1e0d-4d1e-9d06-457208782761 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:01.825264 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-adee3018-1e0d-4d1e-9d06-457208782761 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:01.828227 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d53c6d10-e972-4e2b-aeb5-00ac7f2f1360 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:01.828991 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d53c6d10-e972-4e2b-aeb5-00ac7f2f1360 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 70acfe32-deea-46fc-a214-8fdbb9f6cb7b] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:01.831437 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-adee3018-1e0d-4d1e-9d06-457208782761 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:01.831969 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-adee3018-1e0d-4d1e-9d06-457208782761 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:01.832454 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-adee3018-1e0d-4d1e-9d06-457208782761 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:01.840715 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d53c6d10-e972-4e2b-aeb5-00ac7f2f1360 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:01.842167 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d53c6d10-e972-4e2b-aeb5-00ac7f2f1360 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:01.842828 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d53c6d10-e972-4e2b-aeb5-00ac7f2f1360 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:01.844620 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d53c6d10-e972-4e2b-aeb5-00ac7f2f1360 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:01.845300 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d53c6d10-e972-4e2b-aeb5-00ac7f2f1360 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:01.845935 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d53c6d10-e972-4e2b-aeb5-00ac7f2f1360 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:03.017036 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d53c6d10-e972-4e2b-aeb5-00ac7f2f1360 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:03.017778 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-adee3018-1e0d-4d1e-9d06-457208782761 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32514a813c0a4031a1d1effc807db17d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe9e2cfe40746dd8af1792468a57a2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:03.026634 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-adee3018-1e0d-4d1e-9d06-457208782761 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] 10.222.0.70 "GET /compute/v2.1/servers/582ea86f-befd-4c47-95d9-2eba872eb8c8" status: 200 len: 1678 microversion: 2.1 time: 1.228930 Aug 27 02:47:03.038845 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d53c6d10-e972-4e2b-aeb5-00ac7f2f1360 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b" status: 200 len: 1390 microversion: 2.1 time: 1.216022 Aug 27 02:47:03.041324 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 810/1618] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:01 2022] GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b => generated 1390 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:03.047704 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 808/1618] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:01 2022] GET /compute/v2.1/servers/582ea86f-befd-4c47-95d9-2eba872eb8c8 => generated 1678 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:03.059121 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4ec4f4eb-3eb2-443b-80a8-d52bc66bde81 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:03.062174 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-4ec4f4eb-3eb2-443b-80a8-d52bc66bde81 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] [instance: caf46cf7-50ec-4b59-8589-ebbe4ab383e1] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:03.062432 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-1f8edc14-2c1a-4ad0-af67-5cbf84150d4b tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:03.065209 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-1f8edc14-2c1a-4ad0-af67-5cbf84150d4b tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: 7eded9ca-c7bc-499a-bb53-a28d2c332402] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:03.080879 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4ec4f4eb-3eb2-443b-80a8-d52bc66bde81 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:03.082034 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4ec4f4eb-3eb2-443b-80a8-d52bc66bde81 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:03.082736 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4ec4f4eb-3eb2-443b-80a8-d52bc66bde81 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:03.082902 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1f8edc14-2c1a-4ad0-af67-5cbf84150d4b tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:03.084808 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4ec4f4eb-3eb2-443b-80a8-d52bc66bde81 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:03.085640 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4ec4f4eb-3eb2-443b-80a8-d52bc66bde81 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:03.086331 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4ec4f4eb-3eb2-443b-80a8-d52bc66bde81 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:03.086629 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1f8edc14-2c1a-4ad0-af67-5cbf84150d4b tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:03.087203 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1f8edc14-2c1a-4ad0-af67-5cbf84150d4b tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:03.087962 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1f8edc14-2c1a-4ad0-af67-5cbf84150d4b tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:03.089583 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1f8edc14-2c1a-4ad0-af67-5cbf84150d4b tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:03.090082 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1f8edc14-2c1a-4ad0-af67-5cbf84150d4b tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:03.376153 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-1f8edc14-2c1a-4ad0-af67-5cbf84150d4b tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:03.392504 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-1f8edc14-2c1a-4ad0-af67-5cbf84150d4b tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:03.395698 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-1f8edc14-2c1a-4ad0-af67-5cbf84150d4b tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:03.397483 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-1f8edc14-2c1a-4ad0-af67-5cbf84150d4b tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/7eded9ca-c7bc-499a-bb53-a28d2c332402" status: 200 len: 1662 microversion: 2.25 time: 0.348580 Aug 27 02:47:03.398330 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 809/1619] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:47:03 2022] GET /compute/v2.1/servers/7eded9ca-c7bc-499a-bb53-a28d2c332402 => generated 1662 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:47:03.720256 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-4ec4f4eb-3eb2-443b-80a8-d52bc66bde81 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfec6c2f34f94d66ab1cc982c5bb5bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256b67be18c246b186e09a313db08a7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:03.730793 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-4ec4f4eb-3eb2-443b-80a8-d52bc66bde81 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] 10.222.0.70 "GET /compute/v2.1/servers/caf46cf7-50ec-4b59-8589-ebbe4ab383e1" status: 200 len: 1318 microversion: 2.1 time: 0.685482 Aug 27 02:47:03.733949 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 811/1620] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:03 2022] GET /compute/v2.1/servers/caf46cf7-50ec-4b59-8589-ebbe4ab383e1 => generated 1318 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:04.052118 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-02bdf1cb-2835-43ed-97a8-7b485ffa4b1e req-3e6a7aa7-d656-4f99-8727-1a9414c8d3a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "caf46cf7-50ec-4b59-8589-ebbe4ab383e1", "name": "network-vif-plugged", "status": "completed", "tag": "a2c4a087-351f-4d8b-b0cf-d69f39b3659e"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:47:04.055337 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-97cbc4af-fea7-4942-b370-12471f6c1620 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:04.056357 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-97cbc4af-fea7-4942-b370-12471f6c1620 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] [instance: 582ea86f-befd-4c47-95d9-2eba872eb8c8] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:04.078347 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-02bdf1cb-2835-43ed-97a8-7b485ffa4b1e req-3e6a7aa7-d656-4f99-8727-1a9414c8d3a1 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:04.079699 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-02bdf1cb-2835-43ed-97a8-7b485ffa4b1e req-3e6a7aa7-d656-4f99-8727-1a9414c8d3a1 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:04.080943 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-97cbc4af-fea7-4942-b370-12471f6c1620 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:04.081627 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-97cbc4af-fea7-4942-b370-12471f6c1620 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:04.082067 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-97cbc4af-fea7-4942-b370-12471f6c1620 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:04.082193 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-02bdf1cb-2835-43ed-97a8-7b485ffa4b1e req-3e6a7aa7-d656-4f99-8727-1a9414c8d3a1 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:04.082779 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-97cbc4af-fea7-4942-b370-12471f6c1620 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:04.083225 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-97cbc4af-fea7-4942-b370-12471f6c1620 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:04.083657 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-97cbc4af-fea7-4942-b370-12471f6c1620 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:04.104093 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-02bdf1cb-2835-43ed-97a8-7b485ffa4b1e req-3e6a7aa7-d656-4f99-8727-1a9414c8d3a1 service nova] Creating event network-vif-plugged:a2c4a087-351f-4d8b-b0cf-d69f39b3659e for instance caf46cf7-50ec-4b59-8589-ebbe4ab383e1 on n-h2-852278-4 Aug 27 02:47:04.114005 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-02bdf1cb-2835-43ed-97a8-7b485ffa4b1e req-3e6a7aa7-d656-4f99-8727-1a9414c8d3a1 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065680 Aug 27 02:47:04.115194 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 810/1621] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:47:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:47:04.129367 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b78ef723-98fe-4319-94f3-eb8aa6067e5c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:04.130658 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b78ef723-98fe-4319-94f3-eb8aa6067e5c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 70acfe32-deea-46fc-a214-8fdbb9f6cb7b] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:04.140342 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b78ef723-98fe-4319-94f3-eb8aa6067e5c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:04.141092 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b78ef723-98fe-4319-94f3-eb8aa6067e5c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:04.141848 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b78ef723-98fe-4319-94f3-eb8aa6067e5c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:04.143068 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b78ef723-98fe-4319-94f3-eb8aa6067e5c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:04.144132 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b78ef723-98fe-4319-94f3-eb8aa6067e5c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:04.144836 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b78ef723-98fe-4319-94f3-eb8aa6067e5c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:04.756871 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-97cbc4af-fea7-4942-b370-12471f6c1620 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32514a813c0a4031a1d1effc807db17d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe9e2cfe40746dd8af1792468a57a2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:04.767741 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b78ef723-98fe-4319-94f3-eb8aa6067e5c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:04.774197 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-97cbc4af-fea7-4942-b370-12471f6c1620 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] 10.222.0.70 "GET /compute/v2.1/servers/582ea86f-befd-4c47-95d9-2eba872eb8c8" status: 200 len: 1678 microversion: 2.1 time: 0.725503 Aug 27 02:47:04.778811 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 812/1622] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:04 2022] GET /compute/v2.1/servers/582ea86f-befd-4c47-95d9-2eba872eb8c8 => generated 1678 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:47:04.788248 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-9a278d2b-3f6f-4045-a4f1-2a8a1379177e req-a741494b-fa84-4dd8-b4f7-d8e6a4394ba0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7eded9ca-c7bc-499a-bb53-a28d2c332402", "name": "network-vif-deleted", "tag": "e0130326-860c-4234-8b0f-db61efc2a95a"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:47:04.793914 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b78ef723-98fe-4319-94f3-eb8aa6067e5c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b" status: 200 len: 1390 microversion: 2.1 time: 0.669289 Aug 27 02:47:04.798087 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 811/1623] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:04 2022] GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b => generated 1390 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:04.811508 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-499c77e2-022b-45c8-96bd-347c47625389 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:04.812206 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-499c77e2-022b-45c8-96bd-347c47625389 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: 7eded9ca-c7bc-499a-bb53-a28d2c332402] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:04.823846 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-9a278d2b-3f6f-4045-a4f1-2a8a1379177e req-a741494b-fa84-4dd8-b4f7-d8e6a4394ba0 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:04.827843 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-9a278d2b-3f6f-4045-a4f1-2a8a1379177e req-a741494b-fa84-4dd8-b4f7-d8e6a4394ba0 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:04.828550 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-9a278d2b-3f6f-4045-a4f1-2a8a1379177e req-a741494b-fa84-4dd8-b4f7-d8e6a4394ba0 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:04.829122 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-499c77e2-022b-45c8-96bd-347c47625389 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:04.829637 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-499c77e2-022b-45c8-96bd-347c47625389 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:04.830082 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-499c77e2-022b-45c8-96bd-347c47625389 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:04.830806 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-499c77e2-022b-45c8-96bd-347c47625389 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:04.831456 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-499c77e2-022b-45c8-96bd-347c47625389 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:04.831869 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-499c77e2-022b-45c8-96bd-347c47625389 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:04.851038 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-9a278d2b-3f6f-4045-a4f1-2a8a1379177e req-a741494b-fa84-4dd8-b4f7-d8e6a4394ba0 service nova] Creating event network-vif-deleted:e0130326-860c-4234-8b0f-db61efc2a95a for instance 7eded9ca-c7bc-499a-bb53-a28d2c332402 on n-h2-852278-4 Aug 27 02:47:04.857755 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-9a278d2b-3f6f-4045-a4f1-2a8a1379177e req-a741494b-fa84-4dd8-b4f7-d8e6a4394ba0 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076052 Aug 27 02:47:04.858709 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 813/1624] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:47:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:47:04.865483 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-36e345d4-55fe-4e8e-b875-b2f9fa6b5419 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:04.866862 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-36e345d4-55fe-4e8e-b875-b2f9fa6b5419 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] [instance: caf46cf7-50ec-4b59-8589-ebbe4ab383e1] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:04.891670 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-36e345d4-55fe-4e8e-b875-b2f9fa6b5419 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:04.893849 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-36e345d4-55fe-4e8e-b875-b2f9fa6b5419 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:04.902182 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-36e345d4-55fe-4e8e-b875-b2f9fa6b5419 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:04.904075 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-499c77e2-022b-45c8-96bd-347c47625389 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:04.904628 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-499c77e2-022b-45c8-96bd-347c47625389 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:04.906236 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-499c77e2-022b-45c8-96bd-347c47625389 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:04.906616 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-36e345d4-55fe-4e8e-b875-b2f9fa6b5419 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:04.906750 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.instance [None req-499c77e2-022b-45c8-96bd-347c47625389 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lazy-loading 'fault' on Instance uuid 7eded9ca-c7bc-499a-bb53-a28d2c332402 {{(pid=134052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:47:04.907869 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-36e345d4-55fe-4e8e-b875-b2f9fa6b5419 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:04.908663 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-36e345d4-55fe-4e8e-b875-b2f9fa6b5419 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:05.017082 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-499c77e2-022b-45c8-96bd-347c47625389 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:05.028711 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-499c77e2-022b-45c8-96bd-347c47625389 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:05.038384 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-499c77e2-022b-45c8-96bd-347c47625389 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:05.040788 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-499c77e2-022b-45c8-96bd-347c47625389 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/7eded9ca-c7bc-499a-bb53-a28d2c332402" status: 200 len: 1374 microversion: 2.25 time: 0.242316 Aug 27 02:47:05.041590 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 812/1625] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:47:04 2022] GET /compute/v2.1/servers/7eded9ca-c7bc-499a-bb53-a28d2c332402 => generated 1374 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:47:05.395388 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-36e345d4-55fe-4e8e-b875-b2f9fa6b5419 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfec6c2f34f94d66ab1cc982c5bb5bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256b67be18c246b186e09a313db08a7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:05.400556 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:47:05.408778 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-36e345d4-55fe-4e8e-b875-b2f9fa6b5419 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] 10.222.0.70 "GET /compute/v2.1/servers/caf46cf7-50ec-4b59-8589-ebbe4ab383e1" status: 200 len: 1318 microversion: 2.1 time: 0.548810 Aug 27 02:47:05.428044 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 814/1626] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:04 2022] GET /compute/v2.1/servers/caf46cf7-50ec-4b59-8589-ebbe4ab383e1 => generated 1318 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:05.801402 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a1e29540-98bc-40e5-af2e-8a46e9f6e4ca tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:05.802136 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a1e29540-98bc-40e5-af2e-8a46e9f6e4ca tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] [instance: 582ea86f-befd-4c47-95d9-2eba872eb8c8] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:05.817100 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a1e29540-98bc-40e5-af2e-8a46e9f6e4ca tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:05.819668 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a1e29540-98bc-40e5-af2e-8a46e9f6e4ca tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:05.822402 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b95a811b-228b-47b4-a494-0c7ca32bcb0f tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:05.823014 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b95a811b-228b-47b4-a494-0c7ca32bcb0f tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 70acfe32-deea-46fc-a214-8fdbb9f6cb7b] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:05.829789 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a1e29540-98bc-40e5-af2e-8a46e9f6e4ca tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:05.830246 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b95a811b-228b-47b4-a494-0c7ca32bcb0f tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:05.830769 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b95a811b-228b-47b4-a494-0c7ca32bcb0f tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:05.831214 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b95a811b-228b-47b4-a494-0c7ca32bcb0f tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:05.831361 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a1e29540-98bc-40e5-af2e-8a46e9f6e4ca tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:05.831921 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b95a811b-228b-47b4-a494-0c7ca32bcb0f tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:05.832050 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a1e29540-98bc-40e5-af2e-8a46e9f6e4ca tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:05.832389 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b95a811b-228b-47b4-a494-0c7ca32bcb0f tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:05.832806 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b95a811b-228b-47b4-a494-0c7ca32bcb0f tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:05.833547 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a1e29540-98bc-40e5-af2e-8a46e9f6e4ca tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:06.109237 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-a1e29540-98bc-40e5-af2e-8a46e9f6e4ca tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32514a813c0a4031a1d1effc807db17d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe9e2cfe40746dd8af1792468a57a2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:06.123912 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a1e29540-98bc-40e5-af2e-8a46e9f6e4ca tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] 10.222.0.70 "GET /compute/v2.1/servers/582ea86f-befd-4c47-95d9-2eba872eb8c8" status: 200 len: 1611 microversion: 2.1 time: 0.326875 Aug 27 02:47:06.127413 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 813/1627] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:05 2022] GET /compute/v2.1/servers/582ea86f-befd-4c47-95d9-2eba872eb8c8 => generated 1611 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:06.137969 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d13a03da-4781-4523-a8f3-ce13abc531ce tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:06.141213 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d13a03da-4781-4523-a8f3-ce13abc531ce tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: 7eded9ca-c7bc-499a-bb53-a28d2c332402] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:06.161361 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d13a03da-4781-4523-a8f3-ce13abc531ce tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:06.161857 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d13a03da-4781-4523-a8f3-ce13abc531ce tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:06.163066 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d13a03da-4781-4523-a8f3-ce13abc531ce tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:06.163918 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d13a03da-4781-4523-a8f3-ce13abc531ce tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:06.171205 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d13a03da-4781-4523-a8f3-ce13abc531ce tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:06.171951 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d13a03da-4781-4523-a8f3-ce13abc531ce tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:06.209357 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-d13a03da-4781-4523-a8f3-ce13abc531ce tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] HTTP exception thrown: Instance 7eded9ca-c7bc-499a-bb53-a28d2c332402 could not be found. Aug 27 02:47:06.215387 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d13a03da-4781-4523-a8f3-ce13abc531ce tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Request method failure captured: Aug 27 02:47:06.215387 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/servers/7eded9ca-c7bc-499a-bb53-a28d2c332402 HTTP/1.1 Aug 27 02:47:06.215387 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:47:06.215387 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:47:06.215387 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:47:06.215387 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:47:06.215387 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:47:06.215387 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:47:06.215387 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:47:06.215387 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:47:06.215387 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYP0Zi0u0ongM0ussFZ5AdD5HIyahm-265hjOpwXihY5o3sYNrFwW2sdDUHR31UMPFN-_iaTjzoTr5-4uGtHbE7UfUOBIhfqlIc5fztQ2_0zHQw4-6NQBq47AifpayZLG8jx-nAsD9v_aVVxsEgxa-5qOAfnoiEMvtTyqZRaYWWxzpU Aug 27 02:47:06.215387 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:47:06.215387 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:47:06.215387 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:47:06.215387 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:47:06.215387 n-d-852278-4 devstack@n-api.service[134052]: X-Openstack-Nova-Api-Version: 2.25 Aug 27 02:47:06.215387 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:47:06.215387 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:47:06.215387 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: e78b498dced14d1d822e7d0c27f57215 Aug 27 02:47:06.215387 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-124565651 Aug 27 02:47:06.215387 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:47:06.215387 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:47:06.217108 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e78b498dced14d1d822e7d0c27f57215"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_e78b498dced14d1d822e7d0c27f57215", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e78b498dced14d1d822e7d0c27f57215"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/e78b498dced14d1d822e7d0c27f57215"}]}] Aug 27 02:47:06.217108 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-124565651 Aug 27 02:47:06.217108 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: e78b498dced14d1d822e7d0c27f57215 Aug 27 02:47:06.217108 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-124565651 Aug 27 02:47:06.217108 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-LiveAutoBlockMigrationV225Test-124565651-project Aug 27 02:47:06.217108 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:47:06.217108 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:47:06.217108 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 774ce37f4c6b4f72ad494ea40a3e238d Aug 27 02:47:06.217108 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-124565651-project Aug 27 02:47:06.217108 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 02:47:06.217108 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance 7eded9ca-c7bc-499a-bb53-a28d2c332402 could not be found. Aug 27 02:47:06.217108 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '7eded9ca-c7bc-499a-bb53-a28d2c332402'} Aug 27 02:47:06.218030 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:47:06.218030 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:47:06.218030 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:47:06.218030 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:47:06.218030 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:47:06.218030 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:47:06.218030 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:47:06.218030 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:47:06.218030 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:47:06.218030 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:47:06.218030 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7eded9ca-c7bc-499a-bb53-a28d2c332402 could not be found. Aug 27 02:47:06.218030 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:47:06.218030 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:47:06.218030 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:47:06.218030 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:47:06.218030 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:47:06.218030 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:47:06.218030 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:47:06.218030 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:47:06.218030 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:47:06.220164 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:47:06.220164 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:47:06.220164 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:47:06.220164 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:47:06.220164 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:47:06.220164 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:47:06.220164 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:47:06.220164 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7eded9ca-c7bc-499a-bb53-a28d2c332402 could not be found. Aug 27 02:47:06.220164 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:47:06.220164 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:47:06.220164 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:47:06.220164 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:47:06.220164 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:47:06.220164 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:47:06.220164 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:47:06.220164 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:47:06.220164 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7eded9ca-c7bc-499a-bb53-a28d2c332402 could not be found. Aug 27 02:47:06.220164 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:47:06.222066 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d13a03da-4781-4523-a8f3-ce13abc531ce tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Returning 404 to user: Instance 7eded9ca-c7bc-499a-bb53-a28d2c332402 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:47:06.222066 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d13a03da-4781-4523-a8f3-ce13abc531ce tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/7eded9ca-c7bc-499a-bb53-a28d2c332402" status: 404 len: 111 microversion: 2.25 time: 0.087549 Aug 27 02:47:06.229841 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 814/1628] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:47:06 2022] GET /compute/v2.1/servers/7eded9ca-c7bc-499a-bb53-a28d2c332402 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 02:47:06.241840 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-127d699f-cc0b-443f-a88d-fbcbfbd9403b tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '.version_select at 0x7f5ee3596ca0>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:06.272066 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-127d699f-cc0b-443f-a88d-fbcbfbd9403b tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-294981480" status: 204 len: 0 microversion: 2.25 time: 0.040070 Aug 27 02:47:06.272849 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 815/1629] 10.222.0.70 () {60 vars in 1259 bytes} [Sat Aug 27 02:47:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-294981480 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 02:47:06.435390 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a871b34e-e7b1-4422-8a83-4f5ecac68422 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:06.436016 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a871b34e-e7b1-4422-8a83-4f5ecac68422 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] [instance: caf46cf7-50ec-4b59-8589-ebbe4ab383e1] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:06.444150 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a871b34e-e7b1-4422-8a83-4f5ecac68422 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:06.451718 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a871b34e-e7b1-4422-8a83-4f5ecac68422 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:06.453232 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a871b34e-e7b1-4422-8a83-4f5ecac68422 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:06.454327 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a871b34e-e7b1-4422-8a83-4f5ecac68422 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:06.457776 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a871b34e-e7b1-4422-8a83-4f5ecac68422 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:06.461416 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a871b34e-e7b1-4422-8a83-4f5ecac68422 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:06.965578 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-b95a811b-228b-47b4-a494-0c7ca32bcb0f tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:06.974040 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b95a811b-228b-47b4-a494-0c7ca32bcb0f tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b" status: 200 len: 1390 microversion: 2.1 time: 1.159244 Aug 27 02:47:06.987729 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 815/1630] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:05 2022] GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b => generated 1390 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:07.152682 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3e6096b3-22f8-4479-bc81-e0d7a5a85072 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:07.157336 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-3e6096b3-22f8-4479-bc81-e0d7a5a85072 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] [instance: 582ea86f-befd-4c47-95d9-2eba872eb8c8] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:07.165365 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3e6096b3-22f8-4479-bc81-e0d7a5a85072 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:07.166340 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3e6096b3-22f8-4479-bc81-e0d7a5a85072 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:07.166987 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3e6096b3-22f8-4479-bc81-e0d7a5a85072 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:07.168248 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3e6096b3-22f8-4479-bc81-e0d7a5a85072 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:07.168934 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3e6096b3-22f8-4479-bc81-e0d7a5a85072 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:07.170181 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3e6096b3-22f8-4479-bc81-e0d7a5a85072 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:07.274488 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-3e6096b3-22f8-4479-bc81-e0d7a5a85072 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32514a813c0a4031a1d1effc807db17d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe9e2cfe40746dd8af1792468a57a2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:07.289752 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-3e6096b3-22f8-4479-bc81-e0d7a5a85072 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] 10.222.0.70 "GET /compute/v2.1/servers/582ea86f-befd-4c47-95d9-2eba872eb8c8" status: 200 len: 1611 microversion: 2.1 time: 0.141015 Aug 27 02:47:07.291522 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 816/1631] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:07 2022] GET /compute/v2.1/servers/582ea86f-befd-4c47-95d9-2eba872eb8c8 => generated 1611 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:07.323388 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-fccca7a0-88d0-4e3f-ac81-d2047c33a4df req-3b688f76-75e2-4efa-b388-fb856b92f0df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "582ea86f-befd-4c47-95d9-2eba872eb8c8", "name": "network-vif-deleted", "tag": "b922fb84-aa28-4e90-bfa4-e07f1dd81a47"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:47:07.348591 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-a871b34e-e7b1-4422-8a83-4f5ecac68422 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfec6c2f34f94d66ab1cc982c5bb5bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256b67be18c246b186e09a313db08a7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:07.358259 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-fccca7a0-88d0-4e3f-ac81-d2047c33a4df req-3b688f76-75e2-4efa-b388-fb856b92f0df service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:07.359447 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-fccca7a0-88d0-4e3f-ac81-d2047c33a4df req-3b688f76-75e2-4efa-b388-fb856b92f0df service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:07.362386 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-fccca7a0-88d0-4e3f-ac81-d2047c33a4df req-3b688f76-75e2-4efa-b388-fb856b92f0df service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:07.362638 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a871b34e-e7b1-4422-8a83-4f5ecac68422 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] 10.222.0.70 "GET /compute/v2.1/servers/caf46cf7-50ec-4b59-8589-ebbe4ab383e1" status: 200 len: 1509 microversion: 2.1 time: 0.931714 Aug 27 02:47:07.363463 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 816/1632] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:06 2022] GET /compute/v2.1/servers/caf46cf7-50ec-4b59-8589-ebbe4ab383e1 => generated 1509 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:07.405012 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-fccca7a0-88d0-4e3f-ac81-d2047c33a4df req-3b688f76-75e2-4efa-b388-fb856b92f0df service nova] Creating event network-vif-deleted:b922fb84-aa28-4e90-bfa4-e07f1dd81a47 for instance 582ea86f-befd-4c47-95d9-2eba872eb8c8 on n-h1-852278-4 Aug 27 02:47:07.419316 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-fccca7a0-88d0-4e3f-ac81-d2047c33a4df req-3b688f76-75e2-4efa-b388-fb856b92f0df service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125733 Aug 27 02:47:07.419935 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 817/1633] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:47:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:47:07.999444 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c0ed0106-b528-40b0-ba6d-ece469e37898 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:08.000498 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-c0ed0106-b528-40b0-ba6d-ece469e37898 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 70acfe32-deea-46fc-a214-8fdbb9f6cb7b] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:08.016080 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c0ed0106-b528-40b0-ba6d-ece469e37898 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:08.016964 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c0ed0106-b528-40b0-ba6d-ece469e37898 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:08.017785 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c0ed0106-b528-40b0-ba6d-ece469e37898 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:08.019262 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c0ed0106-b528-40b0-ba6d-ece469e37898 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:08.022415 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c0ed0106-b528-40b0-ba6d-ece469e37898 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:08.022715 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c0ed0106-b528-40b0-ba6d-ece469e37898 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:08.321773 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-60efba96-a126-4a34-b143-2ff5c24581cd tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:08.326972 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-60efba96-a126-4a34-b143-2ff5c24581cd tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] [instance: 582ea86f-befd-4c47-95d9-2eba872eb8c8] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:08.347317 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-60efba96-a126-4a34-b143-2ff5c24581cd tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:08.351471 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-60efba96-a126-4a34-b143-2ff5c24581cd tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:08.352887 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-60efba96-a126-4a34-b143-2ff5c24581cd tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:08.355724 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-60efba96-a126-4a34-b143-2ff5c24581cd tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:08.358936 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-60efba96-a126-4a34-b143-2ff5c24581cd tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:08.361089 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-60efba96-a126-4a34-b143-2ff5c24581cd tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:08.438294 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:47:08.458622 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-60efba96-a126-4a34-b143-2ff5c24581cd tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:08.459443 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-60efba96-a126-4a34-b143-2ff5c24581cd tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:08.461856 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-60efba96-a126-4a34-b143-2ff5c24581cd tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:08.462782 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.objects.instance [None req-60efba96-a126-4a34-b143-2ff5c24581cd tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Lazy-loading 'fault' on Instance uuid 582ea86f-befd-4c47-95d9-2eba872eb8c8 {{(pid=134051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:47:08.611801 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-60efba96-a126-4a34-b143-2ff5c24581cd tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32514a813c0a4031a1d1effc807db17d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe9e2cfe40746dd8af1792468a57a2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:08.629308 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-60efba96-a126-4a34-b143-2ff5c24581cd tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] 10.222.0.70 "GET /compute/v2.1/servers/582ea86f-befd-4c47-95d9-2eba872eb8c8" status: 200 len: 1330 microversion: 2.1 time: 0.318859 Aug 27 02:47:08.630560 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 818/1634] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:08 2022] GET /compute/v2.1/servers/582ea86f-befd-4c47-95d9-2eba872eb8c8 => generated 1330 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:08.757469 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-c0ed0106-b528-40b0-ba6d-ece469e37898 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:08.776947 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c0ed0106-b528-40b0-ba6d-ece469e37898 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b" status: 200 len: 1390 microversion: 2.1 time: 0.783848 Aug 27 02:47:08.781778 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 817/1635] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:07 2022] GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b => generated 1390 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:09.399988 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f9754c73-dd17-4712-b995-b869f964e88b tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:09.400807 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-f9754c73-dd17-4712-b995-b869f964e88b tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: bb513027-efc1-4201-812f-39c88b423a9d] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:09.414211 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f9754c73-dd17-4712-b995-b869f964e88b tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:09.415519 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f9754c73-dd17-4712-b995-b869f964e88b tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:09.420561 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f9754c73-dd17-4712-b995-b869f964e88b tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:09.421661 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f9754c73-dd17-4712-b995-b869f964e88b tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:09.422426 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f9754c73-dd17-4712-b995-b869f964e88b tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:09.422960 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f9754c73-dd17-4712-b995-b869f964e88b tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:09.484768 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-f9754c73-dd17-4712-b995-b869f964e88b tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: bb513027-efc1-4201-812f-39c88b423a9d] Going to try to terminate instance {{(pid=134051) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:47:09.645386 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-dc8cd7bf-01a2-47e3-9e50-e1ae7c18fbc7 req-986ec64e-99a0-483e-ae15-fd1dda4fa343 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70acfe32-deea-46fc-a214-8fdbb9f6cb7b", "name": "network-vif-unplugged", "status": "completed", "tag": "2644ae8b-0546-435d-ae4e-79c3fb9a12cc"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:47:09.672674 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-f9754c73-dd17-4712-b995-b869f964e88b tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "DELETE /compute/v2.1/servers/bb513027-efc1-4201-812f-39c88b423a9d" status: 204 len: 0 microversion: 2.25 time: 0.273100 Aug 27 02:47:09.674292 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 819/1636] 10.222.0.70 () {60 vars in 1280 bytes} [Sat Aug 27 02:47:09 2022] DELETE /compute/v2.1/servers/bb513027-efc1-4201-812f-39c88b423a9d => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 02:47:09.680369 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-dc8cd7bf-01a2-47e3-9e50-e1ae7c18fbc7 req-986ec64e-99a0-483e-ae15-fd1dda4fa343 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:09.680723 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-dc8cd7bf-01a2-47e3-9e50-e1ae7c18fbc7 req-986ec64e-99a0-483e-ae15-fd1dda4fa343 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:09.682977 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-dc8cd7bf-01a2-47e3-9e50-e1ae7c18fbc7 req-986ec64e-99a0-483e-ae15-fd1dda4fa343 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:09.702216 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-861818a4-dd37-47a6-b8ac-3fff5e5bc5e8 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:09.702922 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-861818a4-dd37-47a6-b8ac-3fff5e5bc5e8 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] [instance: 582ea86f-befd-4c47-95d9-2eba872eb8c8] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:09.718413 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-861818a4-dd37-47a6-b8ac-3fff5e5bc5e8 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:09.720597 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-861818a4-dd37-47a6-b8ac-3fff5e5bc5e8 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:09.722852 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-861818a4-dd37-47a6-b8ac-3fff5e5bc5e8 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:09.723793 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-861818a4-dd37-47a6-b8ac-3fff5e5bc5e8 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:09.724916 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-861818a4-dd37-47a6-b8ac-3fff5e5bc5e8 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:09.726995 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-861818a4-dd37-47a6-b8ac-3fff5e5bc5e8 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:09.734395 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-dc8cd7bf-01a2-47e3-9e50-e1ae7c18fbc7 req-986ec64e-99a0-483e-ae15-fd1dda4fa343 service nova] Creating event network-vif-unplugged:2644ae8b-0546-435d-ae4e-79c3fb9a12cc for instance 70acfe32-deea-46fc-a214-8fdbb9f6cb7b on n-h2-852278-4 Aug 27 02:47:09.754966 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-dc8cd7bf-01a2-47e3-9e50-e1ae7c18fbc7 req-986ec64e-99a0-483e-ae15-fd1dda4fa343 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.112136 Aug 27 02:47:09.756021 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 818/1637] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:47:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:47:09.758777 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-861818a4-dd37-47a6-b8ac-3fff5e5bc5e8 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] HTTP exception thrown: Instance 582ea86f-befd-4c47-95d9-2eba872eb8c8 could not be found. Aug 27 02:47:09.762398 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-861818a4-dd37-47a6-b8ac-3fff5e5bc5e8 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Request method failure captured: Aug 27 02:47:09.762398 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/582ea86f-befd-4c47-95d9-2eba872eb8c8 HTTP/1.1 Aug 27 02:47:09.762398 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:47:09.762398 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:47:09.762398 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:47:09.762398 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:47:09.762398 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:47:09.762398 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:47:09.762398 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:47:09.762398 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:47:09.762398 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYTmzmhj_z_hfRt0sxp2mK0D8Z_R1owjCX43Z0dY9vqcoXCBSDVZUORiQujb9xG3ljjGTo_EIswDTPoSJ4funB2nP_boeLBKzYLymaCG5g9f8hPEgpcKfe-IbfmyIktqsEiKJ3JF4Uy8_oSA3teZNBJ_vIwIpeOUnIQsTUth8C2gi-k Aug 27 02:47:09.762398 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:47:09.762398 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:47:09.762398 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:47:09.762398 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:47:09.762398 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:47:09.762398 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:47:09.762398 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: ebe9e2cfe40746dd8af1792468a57a2c Aug 27 02:47:09.762398 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1378533613 Aug 27 02:47:09.762398 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:47:09.762398 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:47:09.765238 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ebe9e2cfe40746dd8af1792468a57a2c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_ebe9e2cfe40746dd8af1792468a57a2c", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ebe9e2cfe40746dd8af1792468a57a2c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/ebe9e2cfe40746dd8af1792468a57a2c"}]}] Aug 27 02:47:09.765238 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1378533613 Aug 27 02:47:09.765238 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: ebe9e2cfe40746dd8af1792468a57a2c Aug 27 02:47:09.765238 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1378533613 Aug 27 02:47:09.765238 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-AttachSCSIVolumeTestJSON-1378533613-project Aug 27 02:47:09.765238 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:47:09.765238 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:47:09.765238 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 32514a813c0a4031a1d1effc807db17d Aug 27 02:47:09.765238 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1378533613-project Aug 27 02:47:09.765238 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 02:47:09.765238 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance 582ea86f-befd-4c47-95d9-2eba872eb8c8 could not be found. Aug 27 02:47:09.765238 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '582ea86f-befd-4c47-95d9-2eba872eb8c8'} Aug 27 02:47:09.767440 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:47:09.767440 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:47:09.767440 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:47:09.767440 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:47:09.767440 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:47:09.767440 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:47:09.767440 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:47:09.767440 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:47:09.767440 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:47:09.767440 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:47:09.767440 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 582ea86f-befd-4c47-95d9-2eba872eb8c8 could not be found. Aug 27 02:47:09.767440 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:47:09.767440 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:47:09.767440 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:47:09.767440 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:47:09.767440 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:47:09.767440 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:47:09.767440 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:47:09.767440 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:47:09.767440 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:47:09.771386 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:47:09.771386 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:47:09.771386 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:47:09.771386 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:47:09.771386 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:47:09.771386 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:47:09.771386 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:47:09.771386 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 582ea86f-befd-4c47-95d9-2eba872eb8c8 could not be found. Aug 27 02:47:09.771386 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:47:09.771386 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:47:09.771386 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:47:09.771386 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:47:09.771386 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:47:09.771386 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:47:09.771386 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:47:09.771386 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:47:09.771386 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 582ea86f-befd-4c47-95d9-2eba872eb8c8 could not be found. Aug 27 02:47:09.771386 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:47:09.775508 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-861818a4-dd37-47a6-b8ac-3fff5e5bc5e8 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Returning 404 to user: Instance 582ea86f-befd-4c47-95d9-2eba872eb8c8 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:47:09.775508 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-861818a4-dd37-47a6-b8ac-3fff5e5bc5e8 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] 10.222.0.70 "GET /compute/v2.1/servers/582ea86f-befd-4c47-95d9-2eba872eb8c8" status: 404 len: 111 microversion: 2.1 time: 0.094928 Aug 27 02:47:09.778357 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-752a521f-b364-4949-80e4-259a81e8132a tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:09.781665 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-752a521f-b364-4949-80e4-259a81e8132a tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: bb513027-efc1-4201-812f-39c88b423a9d] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:09.782863 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 820/1638] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:09 2022] GET /compute/v2.1/servers/582ea86f-befd-4c47-95d9-2eba872eb8c8 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:47:09.791901 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b130c46b-7de8-494f-b6b3-ca8e11080cdb tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Calling method '.version_select at 0x7f5ede97ad30>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:09.807205 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-752a521f-b364-4949-80e4-259a81e8132a tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:09.811458 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-752a521f-b364-4949-80e4-259a81e8132a tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:09.812101 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-752a521f-b364-4949-80e4-259a81e8132a tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:09.813134 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-752a521f-b364-4949-80e4-259a81e8132a tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:09.813687 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-752a521f-b364-4949-80e4-259a81e8132a tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:09.814176 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-752a521f-b364-4949-80e4-259a81e8132a tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:09.852061 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b130c46b-7de8-494f-b6b3-ca8e11080cdb tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-526447408" status: 202 len: 0 microversion: 2.1 time: 0.071142 Aug 27 02:47:09.853067 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 821/1639] 10.222.0.70 () {58 vars in 1218 bytes} [Sat Aug 27 02:47:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-526447408 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:47:09.872617 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c5895077-63f4-43bc-91bf-1adb8db60e39 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:09.875516 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-c5895077-63f4-43bc-91bf-1adb8db60e39 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 70acfe32-deea-46fc-a214-8fdbb9f6cb7b] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:09.888982 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c5895077-63f4-43bc-91bf-1adb8db60e39 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:09.890925 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c5895077-63f4-43bc-91bf-1adb8db60e39 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:09.891918 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c5895077-63f4-43bc-91bf-1adb8db60e39 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:09.893764 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c5895077-63f4-43bc-91bf-1adb8db60e39 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:09.901093 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c5895077-63f4-43bc-91bf-1adb8db60e39 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:09.902378 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c5895077-63f4-43bc-91bf-1adb8db60e39 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:11.091568 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-c5895077-63f4-43bc-91bf-1adb8db60e39 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:11.113862 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c5895077-63f4-43bc-91bf-1adb8db60e39 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b" status: 200 len: 1390 microversion: 2.1 time: 1.253266 Aug 27 02:47:11.115976 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 822/1640] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:09 2022] GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b => generated 1390 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:11.126605 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a8e4c2db-99cb-4ee8-93e4-f4c9a5a19363 tempest-VolumesAdminNegativeTest-179591489 tempest-VolumesAdminNegativeTest-179591489-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "867ec05e-dd11-4b4f-8619-5d448e147e24"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:47:11.142037 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-a8e4c2db-99cb-4ee8-93e4-f4c9a5a19363 tempest-VolumesAdminNegativeTest-179591489 tempest-VolumesAdminNegativeTest-179591489-project-admin] [instance: caf46cf7-50ec-4b59-8589-ebbe4ab383e1] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:11.155822 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a8e4c2db-99cb-4ee8-93e4-f4c9a5a19363 tempest-VolumesAdminNegativeTest-179591489 tempest-VolumesAdminNegativeTest-179591489-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:11.156744 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a8e4c2db-99cb-4ee8-93e4-f4c9a5a19363 tempest-VolumesAdminNegativeTest-179591489 tempest-VolumesAdminNegativeTest-179591489-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:11.157416 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a8e4c2db-99cb-4ee8-93e4-f4c9a5a19363 tempest-VolumesAdminNegativeTest-179591489 tempest-VolumesAdminNegativeTest-179591489-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:11.161413 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a8e4c2db-99cb-4ee8-93e4-f4c9a5a19363 tempest-VolumesAdminNegativeTest-179591489 tempest-VolumesAdminNegativeTest-179591489-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:11.162277 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a8e4c2db-99cb-4ee8-93e4-f4c9a5a19363 tempest-VolumesAdminNegativeTest-179591489 tempest-VolumesAdminNegativeTest-179591489-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:11.163246 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a8e4c2db-99cb-4ee8-93e4-f4c9a5a19363 tempest-VolumesAdminNegativeTest-179591489 tempest-VolumesAdminNegativeTest-179591489-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:11.205566 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-752a521f-b364-4949-80e4-259a81e8132a tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:11.224596 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-752a521f-b364-4949-80e4-259a81e8132a tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:11.229981 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-752a521f-b364-4949-80e4-259a81e8132a tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:11.234905 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-752a521f-b364-4949-80e4-259a81e8132a tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/bb513027-efc1-4201-812f-39c88b423a9d" status: 200 len: 1549 microversion: 2.25 time: 1.476530 Aug 27 02:47:11.238502 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 819/1641] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:47:09 2022] GET /compute/v2.1/servers/bb513027-efc1-4201-812f-39c88b423a9d => generated 1549 bytes in 1481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:47:11.322212 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-a8e4c2db-99cb-4ee8-93e4-f4c9a5a19363 tempest-VolumesAdminNegativeTest-179591489 tempest-VolumesAdminNegativeTest-179591489-project-admin] HTTP exception thrown: Volume ab7ebecf-9724-44ad-a654-e0df49563fea could not be found. Aug 27 02:47:11.324679 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a8e4c2db-99cb-4ee8-93e4-f4c9a5a19363 tempest-VolumesAdminNegativeTest-179591489 tempest-VolumesAdminNegativeTest-179591489-project-admin] Request method failure captured: Aug 27 02:47:11.324679 n-d-852278-4 devstack@n-api.service[134051]: request: PUT /compute/v2.1/servers/caf46cf7-50ec-4b59-8589-ebbe4ab383e1/os-volume_attachments/ab7ebecf-9724-44ad-a654-e0df49563fea HTTP/1.1 Aug 27 02:47:11.324679 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:47:11.324679 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:47:11.324679 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:47:11.324679 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 74 Aug 27 02:47:11.324679 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:47:11.324679 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:47:11.324679 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:47:11.324679 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:47:11.324679 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYUZZ8ipNEBGoDtkffjVSoD0M3HvBWEHQ1U8BYnM3rEw6XXcGvFNA6fZU9-gjjnb4naiBEehHx1l80LmbouH727nq3h-zexMK5G5iPF5vdqwirFbde8-yLrGWOkv76LdPKtmmKTDLhZQ-LKSPX_bcGyX0Rs8WIMTUzD4vFEaebxSj-c Aug 27 02:47:11.324679 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:47:11.324679 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:47:11.324679 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:47:11.324679 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:47:11.324679 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:47:11.324679 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:47:11.324679 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 2577e6cd88d344ce93532f11a7df8e5d Aug 27 02:47:11.324679 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-VolumesAdminNegativeTest-179591489 Aug 27 02:47:11.324679 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,admin,member Aug 27 02:47:11.324679 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,admin,member Aug 27 02:47:11.326709 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2577e6cd88d344ce93532f11a7df8e5d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_2577e6cd88d344ce93532f11a7df8e5d", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2577e6cd88d344ce93532f11a7df8e5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/2577e6cd88d344ce93532f11a7df8e5d"}]}] Aug 27 02:47:11.326709 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-VolumesAdminNegativeTest-179591489 Aug 27 02:47:11.326709 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 2577e6cd88d344ce93532f11a7df8e5d Aug 27 02:47:11.326709 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-179591489 Aug 27 02:47:11.326709 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-VolumesAdminNegativeTest-179591489-project-admin Aug 27 02:47:11.326709 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:47:11.326709 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:47:11.326709 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: d6df76df57094a90934a6aa1ce482a5b Aug 27 02:47:11.326709 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-VolumesAdminNegativeTest-179591489-project-admin Aug 27 02:47:11.326709 n-d-852278-4 devstack@n-api.service[134051]: Aug 27 02:47:11.326709 n-d-852278-4 devstack@n-api.service[134051]: {"volumeAttachment": {"volumeId": "867ec05e-dd11-4b4f-8619-5d448e147e24"}} Aug 27 02:47:11.326709 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 02:47:11.326709 n-d-852278-4 devstack@n-api.service[134051]: exception: Volume ab7ebecf-9724-44ad-a654-e0df49563fea could not be found. Aug 27 02:47:11.327812 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'server_id': 'caf46cf7-50ec-4b59-8589-ebbe4ab383e1', 'id': 'ab7ebecf-9724-44ad-a654-e0df49563fea', 'body': {'volumeAttachment': {'volumeId': '867ec05e-dd11-4b4f-8619-5d448e147e24'}}} Aug 27 02:47:11.327812 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:47:11.327812 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:47:11.327812 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 02:47:11.327812 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 02:47:11.327812 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 27 02:47:11.327812 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 27 02:47:11.327812 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 27 02:47:11.327812 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 27 02:47:11.327812 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 27 02:47:11.327812 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 27 02:47:11.327812 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 27 02:47:11.327812 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 27 02:47:11.327812 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 02:47:11.327812 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 02:47:11.327812 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 02:47:11.327812 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 02:47:11.329594 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ab7ebecf-9724-44ad-a654-e0df49563fea could not be found. (HTTP 404) (Request-ID: req-e7c930f4-8032-4628-9962-cd5321e80f5d) Aug 27 02:47:11.329594 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:47:11.329594 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:47:11.329594 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:47:11.329594 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:47:11.329594 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Aug 27 02:47:11.329594 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Aug 27 02:47:11.329594 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 27 02:47:11.329594 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 27 02:47:11.329594 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 27 02:47:11.329594 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 27 02:47:11.329594 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 27 02:47:11.329594 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 27 02:47:11.329594 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 02:47:11.329594 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 02:47:11.329594 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 27 02:47:11.329594 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 27 02:47:11.329594 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 27 02:47:11.329594 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 27 02:47:11.331183 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 27 02:47:11.331183 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 27 02:47:11.331183 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 27 02:47:11.331183 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 27 02:47:11.331183 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 02:47:11.331183 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 02:47:11.331183 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 02:47:11.331183 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 02:47:11.331183 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ab7ebecf-9724-44ad-a654-e0df49563fea could not be found. Aug 27 02:47:11.331183 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:47:11.331183 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:47:11.331183 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:47:11.331183 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:47:11.331183 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:47:11.331183 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:47:11.331183 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:47:11.331183 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:47:11.331183 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:47:11.331183 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:47:11.333591 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:47:11.333591 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:47:11.333591 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:47:11.333591 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:47:11.333591 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Aug 27 02:47:11.333591 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Aug 27 02:47:11.333591 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Aug 27 02:47:11.333591 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:47:11.333591 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ab7ebecf-9724-44ad-a654-e0df49563fea could not be found. Aug 27 02:47:11.333591 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:47:11.333591 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:47:11.333591 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:47:11.333591 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:47:11.333591 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:47:11.333591 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:47:11.333591 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:47:11.333591 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:47:11.333591 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ab7ebecf-9724-44ad-a654-e0df49563fea could not be found. Aug 27 02:47:11.333591 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:47:11.335269 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a8e4c2db-99cb-4ee8-93e4-f4c9a5a19363 tempest-VolumesAdminNegativeTest-179591489 tempest-VolumesAdminNegativeTest-179591489-project-admin] Returning 404 to user: Volume ab7ebecf-9724-44ad-a654-e0df49563fea could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:47:11.335269 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a8e4c2db-99cb-4ee8-93e4-f4c9a5a19363 tempest-VolumesAdminNegativeTest-179591489 tempest-VolumesAdminNegativeTest-179591489-project-admin] 10.222.0.70 "PUT /compute/v2.1/servers/caf46cf7-50ec-4b59-8589-ebbe4ab383e1/os-volume_attachments/ab7ebecf-9724-44ad-a654-e0df49563fea" status: 404 len: 109 microversion: 2.1 time: 0.211713 Aug 27 02:47:11.335269 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 823/1642] 10.222.0.70 () {60 vars in 1433 bytes} [Sat Aug 27 02:47:11 2022] PUT /compute/v2.1/servers/caf46cf7-50ec-4b59-8589-ebbe4ab383e1/os-volume_attachments/ab7ebecf-9724-44ad-a654-e0df49563fea => generated 109 bytes in 216 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:47:12.048510 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-cf8864b2-95cc-47fb-979a-96a975b59b1c req-a732d144-d288-4100-8be1-cf2860c8dc4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70acfe32-deea-46fc-a214-8fdbb9f6cb7b", "tag": "2644ae8b-0546-435d-ae4e-79c3fb9a12cc"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:47:12.086579 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-cf8864b2-95cc-47fb-979a-96a975b59b1c req-a732d144-d288-4100-8be1-cf2860c8dc4a service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:12.087729 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-cf8864b2-95cc-47fb-979a-96a975b59b1c req-a732d144-d288-4100-8be1-cf2860c8dc4a service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:12.090294 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-cf8864b2-95cc-47fb-979a-96a975b59b1c req-a732d144-d288-4100-8be1-cf2860c8dc4a service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:12.123795 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-cf8864b2-95cc-47fb-979a-96a975b59b1c req-a732d144-d288-4100-8be1-cf2860c8dc4a service nova] Creating event network-changed:2644ae8b-0546-435d-ae4e-79c3fb9a12cc for instance 70acfe32-deea-46fc-a214-8fdbb9f6cb7b on n-h2-852278-4 Aug 27 02:47:12.133063 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-cf8864b2-95cc-47fb-979a-96a975b59b1c req-a732d144-d288-4100-8be1-cf2860c8dc4a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089523 Aug 27 02:47:12.135119 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 820/1643] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:47:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:47:12.142347 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7dab845a-e87f-4abc-8db4-4cf9748f401b tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:12.143735 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-7dab845a-e87f-4abc-8db4-4cf9748f401b tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 70acfe32-deea-46fc-a214-8fdbb9f6cb7b] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:12.170002 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7dab845a-e87f-4abc-8db4-4cf9748f401b tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:12.170530 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7dab845a-e87f-4abc-8db4-4cf9748f401b tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:12.172516 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7dab845a-e87f-4abc-8db4-4cf9748f401b tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:12.176896 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7dab845a-e87f-4abc-8db4-4cf9748f401b tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:12.178738 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7dab845a-e87f-4abc-8db4-4cf9748f401b tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:12.180054 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7dab845a-e87f-4abc-8db4-4cf9748f401b tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:12.270237 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-bdd61f83-e740-49da-be3c-4877eefdf506 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:12.270938 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-bdd61f83-e740-49da-be3c-4877eefdf506 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: bb513027-efc1-4201-812f-39c88b423a9d] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:12.276110 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=4,nova_api:UPDATE=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:47:12.304234 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bdd61f83-e740-49da-be3c-4877eefdf506 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:12.331060 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bdd61f83-e740-49da-be3c-4877eefdf506 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:12.331523 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bdd61f83-e740-49da-be3c-4877eefdf506 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:12.332288 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bdd61f83-e740-49da-be3c-4877eefdf506 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:12.332873 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bdd61f83-e740-49da-be3c-4877eefdf506 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:12.333240 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bdd61f83-e740-49da-be3c-4877eefdf506 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:12.405534 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:47:12.602359 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-bdd61f83-e740-49da-be3c-4877eefdf506 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:12.617774 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-bdd61f83-e740-49da-be3c-4877eefdf506 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:12.627792 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-bdd61f83-e740-49da-be3c-4877eefdf506 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:12.636329 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-bdd61f83-e740-49da-be3c-4877eefdf506 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/bb513027-efc1-4201-812f-39c88b423a9d" status: 200 len: 1507 microversion: 2.25 time: 0.367259 Aug 27 02:47:12.653165 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 821/1644] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:47:12 2022] GET /compute/v2.1/servers/bb513027-efc1-4201-812f-39c88b423a9d => generated 1507 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:47:13.088994 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-7dab845a-e87f-4abc-8db4-4cf9748f401b tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:13.102817 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-7dab845a-e87f-4abc-8db4-4cf9748f401b tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b" status: 200 len: 1390 microversion: 2.1 time: 0.969377 Aug 27 02:47:13.106384 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 824/1645] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:12 2022] GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b => generated 1390 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:13.544897 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a7a93194-a726-441f-aee9-726b385a23a7 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-27271703", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "networks": [{"uuid": "da23d2c1-6c39-4203-befa-7533dea3f8b6"}]}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:47:13.668055 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7975a78b-5440-4b94-9e9e-b51996fc11e9 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:13.669435 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-7975a78b-5440-4b94-9e9e-b51996fc11e9 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: bb513027-efc1-4201-812f-39c88b423a9d] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:13.685287 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.network.neutron [None req-a7a93194-a726-441f-aee9-726b385a23a7 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] validate_networks() for [('da23d2c1-6c39-4203-befa-7533dea3f8b6', None, None, None, None, None)] {{(pid=134052) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:47:13.690768 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7975a78b-5440-4b94-9e9e-b51996fc11e9 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:13.693114 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7975a78b-5440-4b94-9e9e-b51996fc11e9 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:13.693827 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7975a78b-5440-4b94-9e9e-b51996fc11e9 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:13.702541 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7975a78b-5440-4b94-9e9e-b51996fc11e9 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:13.712538 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7975a78b-5440-4b94-9e9e-b51996fc11e9 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:13.714293 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7975a78b-5440-4b94-9e9e-b51996fc11e9 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:13.775777 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-7975a78b-5440-4b94-9e9e-b51996fc11e9 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] HTTP exception thrown: Instance bb513027-efc1-4201-812f-39c88b423a9d could not be found. Aug 27 02:47:13.786277 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7975a78b-5440-4b94-9e9e-b51996fc11e9 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Request method failure captured: Aug 27 02:47:13.786277 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/bb513027-efc1-4201-812f-39c88b423a9d HTTP/1.1 Aug 27 02:47:13.786277 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:47:13.786277 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:47:13.786277 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:47:13.786277 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:47:13.786277 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:47:13.786277 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:47:13.786277 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:47:13.786277 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:47:13.786277 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYP0Zi0u0ongM0ussFZ5AdD5HIyahm-265hjOpwXihY5o3sYNrFwW2sdDUHR31UMPFN-_iaTjzoTr5-4uGtHbE7UfUOBIhfqlIc5fztQ2_0zHQw4-6NQBq47AifpayZLG8jx-nAsD9v_aVVxsEgxa-5qOAfnoiEMvtTyqZRaYWWxzpU Aug 27 02:47:13.786277 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:47:13.786277 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:47:13.786277 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:47:13.786277 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:47:13.786277 n-d-852278-4 devstack@n-api.service[134051]: X-Openstack-Nova-Api-Version: 2.25 Aug 27 02:47:13.786277 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:47:13.786277 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:47:13.786277 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: e78b498dced14d1d822e7d0c27f57215 Aug 27 02:47:13.786277 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-124565651 Aug 27 02:47:13.786277 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:47:13.786277 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:47:13.788167 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e78b498dced14d1d822e7d0c27f57215"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_e78b498dced14d1d822e7d0c27f57215", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e78b498dced14d1d822e7d0c27f57215"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/e78b498dced14d1d822e7d0c27f57215"}]}] Aug 27 02:47:13.788167 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-124565651 Aug 27 02:47:13.788167 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: e78b498dced14d1d822e7d0c27f57215 Aug 27 02:47:13.788167 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-124565651 Aug 27 02:47:13.788167 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-LiveAutoBlockMigrationV225Test-124565651-project Aug 27 02:47:13.788167 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:47:13.788167 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:47:13.788167 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 774ce37f4c6b4f72ad494ea40a3e238d Aug 27 02:47:13.788167 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-124565651-project Aug 27 02:47:13.788167 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 02:47:13.788167 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance bb513027-efc1-4201-812f-39c88b423a9d could not be found. Aug 27 02:47:13.788167 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': 'bb513027-efc1-4201-812f-39c88b423a9d'} Aug 27 02:47:13.789268 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:47:13.789268 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:47:13.789268 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:47:13.789268 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:47:13.789268 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:47:13.789268 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:47:13.789268 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:47:13.789268 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:47:13.789268 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:47:13.789268 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:47:13.789268 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb513027-efc1-4201-812f-39c88b423a9d could not be found. Aug 27 02:47:13.789268 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:47:13.789268 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:47:13.789268 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:47:13.789268 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:47:13.789268 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:47:13.789268 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:47:13.789268 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:47:13.789268 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:47:13.789268 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:47:13.790982 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:47:13.790982 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:47:13.790982 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:47:13.790982 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:47:13.790982 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:47:13.790982 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:47:13.790982 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:47:13.790982 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb513027-efc1-4201-812f-39c88b423a9d could not be found. Aug 27 02:47:13.790982 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:47:13.790982 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:47:13.790982 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:47:13.790982 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:47:13.790982 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:47:13.790982 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:47:13.790982 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:47:13.790982 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:47:13.790982 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb513027-efc1-4201-812f-39c88b423a9d could not be found. Aug 27 02:47:13.790982 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:47:13.795092 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7975a78b-5440-4b94-9e9e-b51996fc11e9 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Returning 404 to user: Instance bb513027-efc1-4201-812f-39c88b423a9d could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:47:13.797028 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-7975a78b-5440-4b94-9e9e-b51996fc11e9 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/bb513027-efc1-4201-812f-39c88b423a9d" status: 404 len: 111 microversion: 2.25 time: 0.133580 Aug 27 02:47:13.801916 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 825/1646] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:47:13 2022] GET /compute/v2.1/servers/bb513027-efc1-4201-812f-39c88b423a9d => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 02:47:13.830699 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-adb21c28-408e-48b5-b390-d6bfa4cce16b tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:13.832032 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-adb21c28-408e-48b5-b390-d6bfa4cce16b tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: 12acf567-09ef-4971-b085-8b5566fd1b79] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:13.846937 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-adb21c28-408e-48b5-b390-d6bfa4cce16b tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:13.847570 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-adb21c28-408e-48b5-b390-d6bfa4cce16b tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:13.848097 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-adb21c28-408e-48b5-b390-d6bfa4cce16b tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:13.851221 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-adb21c28-408e-48b5-b390-d6bfa4cce16b tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:13.851930 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-adb21c28-408e-48b5-b390-d6bfa4cce16b tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:13.852648 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-adb21c28-408e-48b5-b390-d6bfa4cce16b tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:13.934381 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-adb21c28-408e-48b5-b390-d6bfa4cce16b tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: 12acf567-09ef-4971-b085-8b5566fd1b79] Going to try to terminate instance {{(pid=134051) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:47:14.134712 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-adb21c28-408e-48b5-b390-d6bfa4cce16b tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "DELETE /compute/v2.1/servers/12acf567-09ef-4971-b085-8b5566fd1b79" status: 204 len: 0 microversion: 2.25 time: 0.325131 Aug 27 02:47:14.140451 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 826/1647] 10.222.0.70 () {60 vars in 1280 bytes} [Sat Aug 27 02:47:13 2022] DELETE /compute/v2.1/servers/12acf567-09ef-4971-b085-8b5566fd1b79 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 02:47:14.162713 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0cad49e3-25d4-4ca5-aed1-6b09d7aa6633 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:14.166434 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-0cad49e3-25d4-4ca5-aed1-6b09d7aa6633 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 70acfe32-deea-46fc-a214-8fdbb9f6cb7b] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:14.190198 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0cad49e3-25d4-4ca5-aed1-6b09d7aa6633 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:14.190676 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0cad49e3-25d4-4ca5-aed1-6b09d7aa6633 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:14.191118 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0cad49e3-25d4-4ca5-aed1-6b09d7aa6633 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:14.195275 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0cad49e3-25d4-4ca5-aed1-6b09d7aa6633 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:14.197338 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0cad49e3-25d4-4ca5-aed1-6b09d7aa6633 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:14.202257 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0cad49e3-25d4-4ca5-aed1-6b09d7aa6633 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:15.462874 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-0cad49e3-25d4-4ca5-aed1-6b09d7aa6633 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:15.481385 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-0cad49e3-25d4-4ca5-aed1-6b09d7aa6633 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b" status: 200 len: 1390 microversion: 2.1 time: 1.336815 Aug 27 02:47:15.482888 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 827/1648] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:14 2022] GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b => generated 1390 bytes in 1341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:15.496171 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3c9064a8-2e38-4687-95dc-e37f4c237907 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:15.498973 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-3c9064a8-2e38-4687-95dc-e37f4c237907 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: 12acf567-09ef-4971-b085-8b5566fd1b79] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:15.521213 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3c9064a8-2e38-4687-95dc-e37f4c237907 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:15.521712 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3c9064a8-2e38-4687-95dc-e37f4c237907 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:15.526499 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3c9064a8-2e38-4687-95dc-e37f4c237907 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:15.530964 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3c9064a8-2e38-4687-95dc-e37f4c237907 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:15.531959 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3c9064a8-2e38-4687-95dc-e37f4c237907 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:15.532904 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3c9064a8-2e38-4687-95dc-e37f4c237907 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:16.714718 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-a7a93194-a726-441f-aee9-726b385a23a7 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Flavor limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:47:16.715371 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-a7a93194-a726-441f-aee9-726b385a23a7 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Image limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:47:16.715995 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-a7a93194-a726-441f-aee9-726b385a23a7 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Flavor pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:47:16.716753 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-a7a93194-a726-441f-aee9-726b385a23a7 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Image pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:47:16.717387 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-a7a93194-a726-441f-aee9-726b385a23a7 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:47:16.741588 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a7a93194-a726-441f-aee9-726b385a23a7 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:16.742080 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a7a93194-a726-441f-aee9-726b385a23a7 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:16.742518 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a7a93194-a726-441f-aee9-726b385a23a7 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:16.743257 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a7a93194-a726-441f-aee9-726b385a23a7 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:16.743713 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a7a93194-a726-441f-aee9-726b385a23a7 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:16.744136 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a7a93194-a726-441f-aee9-726b385a23a7 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:16.807498 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-a7a93194-a726-441f-aee9-726b385a23a7 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Getting quotas for project 42b7c879ef5f4e5e8204433a06bdd370. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:47:16.820650 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-a7a93194-a726-441f-aee9-726b385a23a7 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Getting quotas for user a724314a34d2477cac222eeba100840b and project 42b7c879ef5f4e5e8204433a06bdd370. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:47:16.838145 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-3c9064a8-2e38-4687-95dc-e37f4c237907 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:16.854116 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a7a93194-a726-441f-aee9-726b385a23a7 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Going to run 1 instances... {{(pid=134052) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:47:16.855916 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-3c9064a8-2e38-4687-95dc-e37f4c237907 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:16.857566 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-3c9064a8-2e38-4687-95dc-e37f4c237907 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:16.861302 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a7a93194-a726-441f-aee9-726b385a23a7 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] [instance: d2020ea3-b05b-47ca-b9a1-950c028db483] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134052) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:47:16.873832 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-3c9064a8-2e38-4687-95dc-e37f4c237907 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/12acf567-09ef-4971-b085-8b5566fd1b79" status: 200 len: 1562 microversion: 2.25 time: 1.388544 Aug 27 02:47:16.874545 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 828/1649] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:47:15 2022] GET /compute/v2.1/servers/12acf567-09ef-4971-b085-8b5566fd1b79 => generated 1562 bytes in 1391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:47:16.903147 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-7c67bbe4-a4ba-4be9-b42a-60cb535f53ef req-003fe581-1f9a-4aab-bd13-ebbc9c2be489 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb513027-efc1-4201-812f-39c88b423a9d", "name": "network-vif-deleted", "tag": "00564c24-5898-44ae-8c51-440ac80fc61e"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:47:16.952846 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-7c67bbe4-a4ba-4be9-b42a-60cb535f53ef req-003fe581-1f9a-4aab-bd13-ebbc9c2be489 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:16.953355 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-7c67bbe4-a4ba-4be9-b42a-60cb535f53ef req-003fe581-1f9a-4aab-bd13-ebbc9c2be489 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:16.953865 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-7c67bbe4-a4ba-4be9-b42a-60cb535f53ef req-003fe581-1f9a-4aab-bd13-ebbc9c2be489 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:16.966521 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a7a93194-a726-441f-aee9-726b385a23a7 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.147782 Aug 27 02:47:16.967632 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 822/1650] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 02:47:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 4153 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:47:16.978125 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-74932bc2-a3fc-4539-9c8b-13b21fea1af7 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:16.978636 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-74932bc2-a3fc-4539-9c8b-13b21fea1af7 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] [instance: caf46cf7-50ec-4b59-8589-ebbe4ab383e1] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:16.993822 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-74932bc2-a3fc-4539-9c8b-13b21fea1af7 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:16.999921 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-74932bc2-a3fc-4539-9c8b-13b21fea1af7 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:17.000626 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-74932bc2-a3fc-4539-9c8b-13b21fea1af7 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:17.001639 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-74932bc2-a3fc-4539-9c8b-13b21fea1af7 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:17.002395 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-74932bc2-a3fc-4539-9c8b-13b21fea1af7 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:17.002993 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-74932bc2-a3fc-4539-9c8b-13b21fea1af7 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:17.029553 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-7c67bbe4-a4ba-4be9-b42a-60cb535f53ef req-003fe581-1f9a-4aab-bd13-ebbc9c2be489 service nova] Creating event network-vif-deleted:00564c24-5898-44ae-8c51-440ac80fc61e for instance bb513027-efc1-4201-812f-39c88b423a9d on n-h2-852278-4 Aug 27 02:47:17.064293 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-7c67bbe4-a4ba-4be9-b42a-60cb535f53ef req-003fe581-1f9a-4aab-bd13-ebbc9c2be489 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.171614 Aug 27 02:47:17.068426 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 829/1651] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:47:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:47:17.085911 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-30fed248-2ba9-4936-8e36-dd95786b4d48 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:17.105358 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-30fed248-2ba9-4936-8e36-dd95786b4d48 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 70acfe32-deea-46fc-a214-8fdbb9f6cb7b] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:17.116892 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-74932bc2-a3fc-4539-9c8b-13b21fea1af7 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] [instance: caf46cf7-50ec-4b59-8589-ebbe4ab383e1] Going to try to terminate instance {{(pid=134052) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:47:17.117515 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-30fed248-2ba9-4936-8e36-dd95786b4d48 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:17.118535 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-30fed248-2ba9-4936-8e36-dd95786b4d48 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:17.119225 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-30fed248-2ba9-4936-8e36-dd95786b4d48 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:17.120200 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-30fed248-2ba9-4936-8e36-dd95786b4d48 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:17.123307 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-30fed248-2ba9-4936-8e36-dd95786b4d48 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:17.124163 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-30fed248-2ba9-4936-8e36-dd95786b4d48 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:17.432844 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-74932bc2-a3fc-4539-9c8b-13b21fea1af7 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] 10.222.0.70 "DELETE /compute/v2.1/servers/caf46cf7-50ec-4b59-8589-ebbe4ab383e1" status: 204 len: 0 microversion: 2.1 time: 0.463681 Aug 27 02:47:17.435051 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 823/1652] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:47:16 2022] DELETE /compute/v2.1/servers/caf46cf7-50ec-4b59-8589-ebbe4ab383e1 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:47:17.469103 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-2d17437f-d416-4c21-9de1-bd1efa1d9580 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:17.474372 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-2d17437f-d416-4c21-9de1-bd1efa1d9580 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] [instance: d2020ea3-b05b-47ca-b9a1-950c028db483] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:17.596950 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-30fed248-2ba9-4936-8e36-dd95786b4d48 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:17.613317 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-30fed248-2ba9-4936-8e36-dd95786b4d48 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b" status: 200 len: 1390 microversion: 2.1 time: 0.540262 Aug 27 02:47:17.615687 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 830/1653] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:17 2022] GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b => generated 1390 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:17.625542 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a76243ec-7527-402e-9039-194566721f0c tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:17.633370 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-a76243ec-7527-402e-9039-194566721f0c tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] [instance: caf46cf7-50ec-4b59-8589-ebbe4ab383e1] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:17.670930 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a76243ec-7527-402e-9039-194566721f0c tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:17.671803 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a76243ec-7527-402e-9039-194566721f0c tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:17.672560 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a76243ec-7527-402e-9039-194566721f0c tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:17.675857 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a76243ec-7527-402e-9039-194566721f0c tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:17.679800 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a76243ec-7527-402e-9039-194566721f0c tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:17.681260 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a76243ec-7527-402e-9039-194566721f0c tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:17.698538 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-2d17437f-d416-4c21-9de1-bd1efa1d9580 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a724314a34d2477cac222eeba100840b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b7c879ef5f4e5e8204433a06bdd370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:17.709922 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-2d17437f-d416-4c21-9de1-bd1efa1d9580 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] 10.222.0.70 "GET /compute/v2.1/servers/d2020ea3-b05b-47ca-b9a1-950c028db483" status: 200 len: 1214 microversion: 2.1 time: 0.270200 Aug 27 02:47:17.712216 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 824/1654] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:17 2022] GET /compute/v2.1/servers/d2020ea3-b05b-47ca-b9a1-950c028db483 => generated 1214 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:17.898942 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5b16f563-b7fd-470b-b7da-f4bd0e2e89a6 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:17.902912 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-5b16f563-b7fd-470b-b7da-f4bd0e2e89a6 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: 12acf567-09ef-4971-b085-8b5566fd1b79] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:17.950795 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5b16f563-b7fd-470b-b7da-f4bd0e2e89a6 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:17.951372 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5b16f563-b7fd-470b-b7da-f4bd0e2e89a6 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:17.960701 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5b16f563-b7fd-470b-b7da-f4bd0e2e89a6 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:17.961405 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5b16f563-b7fd-470b-b7da-f4bd0e2e89a6 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:17.973581 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5b16f563-b7fd-470b-b7da-f4bd0e2e89a6 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:17.974128 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5b16f563-b7fd-470b-b7da-f4bd0e2e89a6 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:18.144637 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5b16f563-b7fd-470b-b7da-f4bd0e2e89a6 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:18.149023 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5b16f563-b7fd-470b-b7da-f4bd0e2e89a6 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:18.149769 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5b16f563-b7fd-470b-b7da-f4bd0e2e89a6 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:18.152611 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.instance [None req-5b16f563-b7fd-470b-b7da-f4bd0e2e89a6 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lazy-loading 'fault' on Instance uuid 12acf567-09ef-4971-b085-8b5566fd1b79 {{(pid=134052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:47:18.176737 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-a76243ec-7527-402e-9039-194566721f0c tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfec6c2f34f94d66ab1cc982c5bb5bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256b67be18c246b186e09a313db08a7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:18.187829 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:47:18.193314 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a76243ec-7527-402e-9039-194566721f0c tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] 10.222.0.70 "GET /compute/v2.1/servers/caf46cf7-50ec-4b59-8589-ebbe4ab383e1" status: 200 len: 1515 microversion: 2.1 time: 0.575236 Aug 27 02:47:18.210722 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 831/1655] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:17 2022] GET /compute/v2.1/servers/caf46cf7-50ec-4b59-8589-ebbe4ab383e1 => generated 1515 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:18.287556 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-5b16f563-b7fd-470b-b7da-f4bd0e2e89a6 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:18.304761 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-5b16f563-b7fd-470b-b7da-f4bd0e2e89a6 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:18.309656 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-5b16f563-b7fd-470b-b7da-f4bd0e2e89a6 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '774ce37f4c6b4f72ad494ea40a3e238d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78b498dced14d1d822e7d0c27f57215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:18.314025 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-5b16f563-b7fd-470b-b7da-f4bd0e2e89a6 tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/12acf567-09ef-4971-b085-8b5566fd1b79" status: 200 len: 1351 microversion: 2.25 time: 0.420262 Aug 27 02:47:18.318018 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 825/1656] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:47:17 2022] GET /compute/v2.1/servers/12acf567-09ef-4971-b085-8b5566fd1b79 => generated 1351 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:47:18.639233 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-1dc9ab3a-e85b-4cb0-9eb9-3192309b98e3 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:18.639845 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-1dc9ab3a-e85b-4cb0-9eb9-3192309b98e3 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 70acfe32-deea-46fc-a214-8fdbb9f6cb7b] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:18.662534 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1dc9ab3a-e85b-4cb0-9eb9-3192309b98e3 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:18.663153 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1dc9ab3a-e85b-4cb0-9eb9-3192309b98e3 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:18.664962 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1dc9ab3a-e85b-4cb0-9eb9-3192309b98e3 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:18.669807 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1dc9ab3a-e85b-4cb0-9eb9-3192309b98e3 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:18.670277 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1dc9ab3a-e85b-4cb0-9eb9-3192309b98e3 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:18.673944 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1dc9ab3a-e85b-4cb0-9eb9-3192309b98e3 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:18.735754 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-86726c44-04c4-4814-add5-bf4ee2d95e7e tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:18.737004 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-86726c44-04c4-4814-add5-bf4ee2d95e7e tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] [instance: d2020ea3-b05b-47ca-b9a1-950c028db483] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:18.766381 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-86726c44-04c4-4814-add5-bf4ee2d95e7e tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:18.767358 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-86726c44-04c4-4814-add5-bf4ee2d95e7e tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:18.770108 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-86726c44-04c4-4814-add5-bf4ee2d95e7e tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:18.771116 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-86726c44-04c4-4814-add5-bf4ee2d95e7e tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:18.772870 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-86726c44-04c4-4814-add5-bf4ee2d95e7e tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:18.775399 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-86726c44-04c4-4814-add5-bf4ee2d95e7e tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:19.138682 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-86726c44-04c4-4814-add5-bf4ee2d95e7e tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a724314a34d2477cac222eeba100840b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b7c879ef5f4e5e8204433a06bdd370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:19.156245 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-86726c44-04c4-4814-add5-bf4ee2d95e7e tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] 10.222.0.70 "GET /compute/v2.1/servers/d2020ea3-b05b-47ca-b9a1-950c028db483" status: 200 len: 1210 microversion: 2.1 time: 0.425115 Aug 27 02:47:19.157864 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 826/1657] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:18 2022] GET /compute/v2.1/servers/d2020ea3-b05b-47ca-b9a1-950c028db483 => generated 1210 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:47:19.176120 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-80414dad-2c9d-4ebd-ba03-1b3cc1e5c741 req-5c3bc90f-5800-44b2-9944-8f51308e820e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12acf567-09ef-4971-b085-8b5566fd1b79", "name": "network-vif-deleted", "tag": "44ed9f75-528d-4d72-891d-705dbadec7a2"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:47:19.199990 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-80414dad-2c9d-4ebd-ba03-1b3cc1e5c741 req-5c3bc90f-5800-44b2-9944-8f51308e820e service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:19.213757 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-80414dad-2c9d-4ebd-ba03-1b3cc1e5c741 req-5c3bc90f-5800-44b2-9944-8f51308e820e service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:19.214662 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-80414dad-2c9d-4ebd-ba03-1b3cc1e5c741 req-5c3bc90f-5800-44b2-9944-8f51308e820e service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:19.262390 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-80414dad-2c9d-4ebd-ba03-1b3cc1e5c741 req-5c3bc90f-5800-44b2-9944-8f51308e820e service nova] Creating event network-vif-deleted:44ed9f75-528d-4d72-891d-705dbadec7a2 for instance 12acf567-09ef-4971-b085-8b5566fd1b79 on n-h2-852278-4 Aug 27 02:47:19.288200 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-80414dad-2c9d-4ebd-ba03-1b3cc1e5c741 req-5c3bc90f-5800-44b2-9944-8f51308e820e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113862 Aug 27 02:47:19.290750 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 827/1658] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:47:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:47:19.327352 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a2891f7f-c415-4301-9d11-b150bdc732e0 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:19.331723 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a2891f7f-c415-4301-9d11-b150bdc732e0 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] [instance: caf46cf7-50ec-4b59-8589-ebbe4ab383e1] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:19.351350 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a2891f7f-c415-4301-9d11-b150bdc732e0 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:19.352912 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a2891f7f-c415-4301-9d11-b150bdc732e0 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:19.361206 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a2891f7f-c415-4301-9d11-b150bdc732e0 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:19.362078 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a2891f7f-c415-4301-9d11-b150bdc732e0 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:19.362665 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a2891f7f-c415-4301-9d11-b150bdc732e0 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:19.363488 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a2891f7f-c415-4301-9d11-b150bdc732e0 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:19.477548 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-1dc9ab3a-e85b-4cb0-9eb9-3192309b98e3 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:19.502825 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-1dc9ab3a-e85b-4cb0-9eb9-3192309b98e3 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b" status: 200 len: 1390 microversion: 2.1 time: 0.868073 Aug 27 02:47:19.505258 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 832/1659] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:18 2022] GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b => generated 1390 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:19.511591 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a701b68a-48af-44c4-b291-1d94a3651f5a tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:19.512618 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-a701b68a-48af-44c4-b291-1d94a3651f5a tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] [instance: 12acf567-09ef-4971-b085-8b5566fd1b79] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:19.535394 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a701b68a-48af-44c4-b291-1d94a3651f5a tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:19.538831 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a701b68a-48af-44c4-b291-1d94a3651f5a tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:19.541012 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a701b68a-48af-44c4-b291-1d94a3651f5a tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:19.541962 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a701b68a-48af-44c4-b291-1d94a3651f5a tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:19.543673 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a701b68a-48af-44c4-b291-1d94a3651f5a tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:19.545118 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a701b68a-48af-44c4-b291-1d94a3651f5a tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:19.601485 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-a701b68a-48af-44c4-b291-1d94a3651f5a tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] HTTP exception thrown: Instance 12acf567-09ef-4971-b085-8b5566fd1b79 could not be found. Aug 27 02:47:19.602691 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a701b68a-48af-44c4-b291-1d94a3651f5a tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Request method failure captured: Aug 27 02:47:19.602691 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/12acf567-09ef-4971-b085-8b5566fd1b79 HTTP/1.1 Aug 27 02:47:19.602691 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:47:19.602691 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:47:19.602691 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:47:19.602691 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:47:19.602691 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:47:19.602691 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:47:19.602691 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:47:19.602691 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:47:19.602691 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYP0Zi0u0ongM0ussFZ5AdD5HIyahm-265hjOpwXihY5o3sYNrFwW2sdDUHR31UMPFN-_iaTjzoTr5-4uGtHbE7UfUOBIhfqlIc5fztQ2_0zHQw4-6NQBq47AifpayZLG8jx-nAsD9v_aVVxsEgxa-5qOAfnoiEMvtTyqZRaYWWxzpU Aug 27 02:47:19.602691 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:47:19.602691 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:47:19.602691 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:47:19.602691 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:47:19.602691 n-d-852278-4 devstack@n-api.service[134051]: X-Openstack-Nova-Api-Version: 2.25 Aug 27 02:47:19.602691 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:47:19.602691 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:47:19.602691 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: e78b498dced14d1d822e7d0c27f57215 Aug 27 02:47:19.602691 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-124565651 Aug 27 02:47:19.602691 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:47:19.602691 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:47:19.604684 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e78b498dced14d1d822e7d0c27f57215"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_e78b498dced14d1d822e7d0c27f57215", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e78b498dced14d1d822e7d0c27f57215"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/e78b498dced14d1d822e7d0c27f57215"}]}] Aug 27 02:47:19.604684 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-124565651 Aug 27 02:47:19.604684 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: e78b498dced14d1d822e7d0c27f57215 Aug 27 02:47:19.604684 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-124565651 Aug 27 02:47:19.604684 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-LiveAutoBlockMigrationV225Test-124565651-project Aug 27 02:47:19.604684 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:47:19.604684 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:47:19.604684 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 774ce37f4c6b4f72ad494ea40a3e238d Aug 27 02:47:19.604684 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-124565651-project Aug 27 02:47:19.604684 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 02:47:19.604684 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance 12acf567-09ef-4971-b085-8b5566fd1b79 could not be found. Aug 27 02:47:19.604684 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '12acf567-09ef-4971-b085-8b5566fd1b79'} Aug 27 02:47:19.605710 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:47:19.605710 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:47:19.605710 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:47:19.605710 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:47:19.605710 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:47:19.605710 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:47:19.605710 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:47:19.605710 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:47:19.605710 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:47:19.605710 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:47:19.605710 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12acf567-09ef-4971-b085-8b5566fd1b79 could not be found. Aug 27 02:47:19.605710 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:47:19.605710 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:47:19.605710 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:47:19.605710 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:47:19.605710 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:47:19.605710 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:47:19.605710 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:47:19.605710 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:47:19.605710 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:47:19.608919 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:47:19.608919 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:47:19.608919 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:47:19.608919 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:47:19.608919 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:47:19.608919 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:47:19.608919 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:47:19.608919 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12acf567-09ef-4971-b085-8b5566fd1b79 could not be found. Aug 27 02:47:19.608919 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:47:19.608919 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:47:19.608919 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:47:19.608919 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:47:19.608919 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:47:19.608919 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:47:19.608919 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:47:19.608919 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:47:19.608919 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12acf567-09ef-4971-b085-8b5566fd1b79 could not be found. Aug 27 02:47:19.608919 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:47:19.632605 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a701b68a-48af-44c4-b291-1d94a3651f5a tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] Returning 404 to user: Instance 12acf567-09ef-4971-b085-8b5566fd1b79 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:47:19.635855 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a701b68a-48af-44c4-b291-1d94a3651f5a tempest-LiveAutoBlockMigrationV225Test-124565651 tempest-LiveAutoBlockMigrationV225Test-124565651-project] 10.222.0.70 "GET /compute/v2.1/servers/12acf567-09ef-4971-b085-8b5566fd1b79" status: 404 len: 111 microversion: 2.25 time: 0.128436 Aug 27 02:47:19.638656 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 833/1660] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:47:19 2022] GET /compute/v2.1/servers/12acf567-09ef-4971-b085-8b5566fd1b79 => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 02:47:20.179743 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0e40314e-7d00-463e-a510-7b277248c184 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:20.180443 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-0e40314e-7d00-463e-a510-7b277248c184 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] [instance: d2020ea3-b05b-47ca-b9a1-950c028db483] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:20.196177 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0e40314e-7d00-463e-a510-7b277248c184 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:20.196878 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0e40314e-7d00-463e-a510-7b277248c184 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:20.200469 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0e40314e-7d00-463e-a510-7b277248c184 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:20.203674 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0e40314e-7d00-463e-a510-7b277248c184 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:20.205790 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0e40314e-7d00-463e-a510-7b277248c184 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:20.206419 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0e40314e-7d00-463e-a510-7b277248c184 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:20.264914 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-a2891f7f-c415-4301-9d11-b150bdc732e0 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfec6c2f34f94d66ab1cc982c5bb5bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256b67be18c246b186e09a313db08a7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:20.288730 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a2891f7f-c415-4301-9d11-b150bdc732e0 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] 10.222.0.70 "GET /compute/v2.1/servers/caf46cf7-50ec-4b59-8589-ebbe4ab383e1" status: 200 len: 1515 microversion: 2.1 time: 0.991536 Aug 27 02:47:20.291127 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 828/1661] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:19 2022] GET /compute/v2.1/servers/caf46cf7-50ec-4b59-8589-ebbe4ab383e1 => generated 1515 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:20.524168 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6ae96eb5-9a83-4a91-a6d6-74dc261fe6e3 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:20.525037 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-6ae96eb5-9a83-4a91-a6d6-74dc261fe6e3 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 70acfe32-deea-46fc-a214-8fdbb9f6cb7b] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:20.545094 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6ae96eb5-9a83-4a91-a6d6-74dc261fe6e3 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:20.545575 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6ae96eb5-9a83-4a91-a6d6-74dc261fe6e3 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:20.546028 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6ae96eb5-9a83-4a91-a6d6-74dc261fe6e3 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:20.546767 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6ae96eb5-9a83-4a91-a6d6-74dc261fe6e3 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:20.547295 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6ae96eb5-9a83-4a91-a6d6-74dc261fe6e3 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:20.547627 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6ae96eb5-9a83-4a91-a6d6-74dc261fe6e3 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:20.906934 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-0e40314e-7d00-463e-a510-7b277248c184 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a724314a34d2477cac222eeba100840b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b7c879ef5f4e5e8204433a06bdd370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:20.929754 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-0e40314e-7d00-463e-a510-7b277248c184 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] 10.222.0.70 "GET /compute/v2.1/servers/d2020ea3-b05b-47ca-b9a1-950c028db483" status: 200 len: 1272 microversion: 2.1 time: 0.754133 Aug 27 02:47:20.930565 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 834/1662] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:20 2022] GET /compute/v2.1/servers/d2020ea3-b05b-47ca-b9a1-950c028db483 => generated 1272 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:20.941304 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-2c16cbe7-c389-440b-bc79-a31c83218205 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Calling method '.version_select at 0x7f5edeb460d0>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:21.026932 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-2c16cbe7-c389-440b-bc79-a31c83218205 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] 10.222.0.70 "GET /compute/v2.1/images/492b51ec-09ed-4626-9cdd-9d007fada80b" status: 200 len: 662 microversion: 2.1 time: 0.094572 Aug 27 02:47:21.030683 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 835/1663] 10.222.0.70 () {58 vars in 1233 bytes} [Sat Aug 27 02:47:20 2022] GET /compute/v2.1/images/492b51ec-09ed-4626-9cdd-9d007fada80b => generated 662 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:47:21.044788 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-6c77835b-7bcb-4b70-94ec-8b03f02e83a9 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Calling method '.version_select at 0x7f5ede97a5e0>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:21.107666 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-6c77835b-7bcb-4b70-94ec-8b03f02e83a9 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] 10.222.0.70 "GET /compute/v2.1/images/492b51ec-09ed-4626-9cdd-9d007fada80b" status: 200 len: 662 microversion: 2.1 time: 0.067772 Aug 27 02:47:21.116417 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 836/1664] 10.222.0.70 () {58 vars in 1233 bytes} [Sat Aug 27 02:47:21 2022] GET /compute/v2.1/images/492b51ec-09ed-4626-9cdd-9d007fada80b => generated 662 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:47:21.212914 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-6ae96eb5-9a83-4a91-a6d6-74dc261fe6e3 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:21.236215 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-6ae96eb5-9a83-4a91-a6d6-74dc261fe6e3 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b" status: 200 len: 1390 microversion: 2.1 time: 0.715920 Aug 27 02:47:21.239552 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 829/1665] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:20 2022] GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b => generated 1390 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:47:21.312138 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-271e8eb2-e799-480e-940e-032294ba5f0c tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:21.312720 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-271e8eb2-e799-480e-940e-032294ba5f0c tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] [instance: caf46cf7-50ec-4b59-8589-ebbe4ab383e1] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:21.335040 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-271e8eb2-e799-480e-940e-032294ba5f0c tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:21.335543 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-271e8eb2-e799-480e-940e-032294ba5f0c tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:21.335980 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-271e8eb2-e799-480e-940e-032294ba5f0c tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:21.336746 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-271e8eb2-e799-480e-940e-032294ba5f0c tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:21.337202 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-271e8eb2-e799-480e-940e-032294ba5f0c tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:21.337623 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-271e8eb2-e799-480e-940e-032294ba5f0c tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:21.380877 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-b00036a5-5086-4a8b-a609-20da3e023fb8 req-98de7636-2fbb-4c02-a30d-526402de7902 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "caf46cf7-50ec-4b59-8589-ebbe4ab383e1", "name": "network-vif-deleted", "tag": "a2c4a087-351f-4d8b-b0cf-d69f39b3659e"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:47:21.411937 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-b00036a5-5086-4a8b-a609-20da3e023fb8 req-98de7636-2fbb-4c02-a30d-526402de7902 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:21.412741 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-b00036a5-5086-4a8b-a609-20da3e023fb8 req-98de7636-2fbb-4c02-a30d-526402de7902 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:21.413406 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-b00036a5-5086-4a8b-a609-20da3e023fb8 req-98de7636-2fbb-4c02-a30d-526402de7902 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:21.467634 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-b00036a5-5086-4a8b-a609-20da3e023fb8 req-98de7636-2fbb-4c02-a30d-526402de7902 service nova] Creating event network-vif-deleted:a2c4a087-351f-4d8b-b0cf-d69f39b3659e for instance caf46cf7-50ec-4b59-8589-ebbe4ab383e1 on n-h2-852278-4 Aug 27 02:47:21.486888 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-b00036a5-5086-4a8b-a609-20da3e023fb8 req-98de7636-2fbb-4c02-a30d-526402de7902 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110043 Aug 27 02:47:21.492650 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 830/1666] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:47:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:47:21.524289 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-271e8eb2-e799-480e-940e-032294ba5f0c tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfec6c2f34f94d66ab1cc982c5bb5bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256b67be18c246b186e09a313db08a7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:21.546971 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-271e8eb2-e799-480e-940e-032294ba5f0c tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] 10.222.0.70 "GET /compute/v2.1/servers/caf46cf7-50ec-4b59-8589-ebbe4ab383e1" status: 200 len: 1303 microversion: 2.1 time: 0.240076 Aug 27 02:47:21.561394 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 837/1667] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:21 2022] GET /compute/v2.1/servers/caf46cf7-50ec-4b59-8589-ebbe4ab383e1 => generated 1303 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:21.953881 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-1680909a-5890-4e8d-8e50-2ec834a210ac tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:21.955969 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-1680909a-5890-4e8d-8e50-2ec834a210ac tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] [instance: d2020ea3-b05b-47ca-b9a1-950c028db483] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:21.987537 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1680909a-5890-4e8d-8e50-2ec834a210ac tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:21.988754 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1680909a-5890-4e8d-8e50-2ec834a210ac tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:21.989491 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1680909a-5890-4e8d-8e50-2ec834a210ac tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:21.990847 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1680909a-5890-4e8d-8e50-2ec834a210ac tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:21.991543 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1680909a-5890-4e8d-8e50-2ec834a210ac tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:21.996274 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1680909a-5890-4e8d-8e50-2ec834a210ac tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:22.172671 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-1680909a-5890-4e8d-8e50-2ec834a210ac tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a724314a34d2477cac222eeba100840b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b7c879ef5f4e5e8204433a06bdd370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:22.181963 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-1680909a-5890-4e8d-8e50-2ec834a210ac tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] 10.222.0.70 "GET /compute/v2.1/servers/d2020ea3-b05b-47ca-b9a1-950c028db483" status: 200 len: 1272 microversion: 2.1 time: 0.233223 Aug 27 02:47:22.185104 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 831/1668] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:21 2022] GET /compute/v2.1/servers/d2020ea3-b05b-47ca-b9a1-950c028db483 => generated 1272 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:22.261511 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0740e723-0548-4657-8909-f36f48292e06 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:22.263599 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-0740e723-0548-4657-8909-f36f48292e06 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 70acfe32-deea-46fc-a214-8fdbb9f6cb7b] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:22.278177 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0740e723-0548-4657-8909-f36f48292e06 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:22.280747 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0740e723-0548-4657-8909-f36f48292e06 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:22.283124 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0740e723-0548-4657-8909-f36f48292e06 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:22.285979 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0740e723-0548-4657-8909-f36f48292e06 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:22.287078 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0740e723-0548-4657-8909-f36f48292e06 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:22.289508 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0740e723-0548-4657-8909-f36f48292e06 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:22.316302 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-fe213247-3cba-4611-a228-c912bc5f08f7 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:22.316880 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-fe213247-3cba-4611-a228-c912bc5f08f7 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] [instance: 582ea86f-befd-4c47-95d9-2eba872eb8c8] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:22.332111 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fe213247-3cba-4611-a228-c912bc5f08f7 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:22.333779 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fe213247-3cba-4611-a228-c912bc5f08f7 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:22.336506 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fe213247-3cba-4611-a228-c912bc5f08f7 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:22.337732 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fe213247-3cba-4611-a228-c912bc5f08f7 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:22.338406 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fe213247-3cba-4611-a228-c912bc5f08f7 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:22.339661 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fe213247-3cba-4611-a228-c912bc5f08f7 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:22.397978 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-fe213247-3cba-4611-a228-c912bc5f08f7 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] HTTP exception thrown: Instance 582ea86f-befd-4c47-95d9-2eba872eb8c8 could not be found. Aug 27 02:47:22.407742 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-fe213247-3cba-4611-a228-c912bc5f08f7 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Request method failure captured: Aug 27 02:47:22.407742 n-d-852278-4 devstack@n-api.service[134052]: request: DELETE /compute/v2.1/servers/582ea86f-befd-4c47-95d9-2eba872eb8c8 HTTP/1.1 Aug 27 02:47:22.407742 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:47:22.407742 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:47:22.407742 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:47:22.407742 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:47:22.407742 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:47:22.407742 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:47:22.407742 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:47:22.407742 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:47:22.407742 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYTmzmhj_z_hfRt0sxp2mK0D8Z_R1owjCX43Z0dY9vqcoXCBSDVZUORiQujb9xG3ljjGTo_EIswDTPoSJ4funB2nP_boeLBKzYLymaCG5g9f8hPEgpcKfe-IbfmyIktqsEiKJ3JF4Uy8_oSA3teZNBJ_vIwIpeOUnIQsTUth8C2gi-k Aug 27 02:47:22.407742 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:47:22.407742 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:47:22.407742 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:47:22.407742 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:47:22.407742 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:47:22.407742 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:47:22.407742 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: ebe9e2cfe40746dd8af1792468a57a2c Aug 27 02:47:22.407742 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1378533613 Aug 27 02:47:22.407742 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:47:22.407742 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:47:22.409867 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ebe9e2cfe40746dd8af1792468a57a2c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_ebe9e2cfe40746dd8af1792468a57a2c", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ebe9e2cfe40746dd8af1792468a57a2c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/ebe9e2cfe40746dd8af1792468a57a2c"}]}] Aug 27 02:47:22.409867 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1378533613 Aug 27 02:47:22.409867 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: ebe9e2cfe40746dd8af1792468a57a2c Aug 27 02:47:22.409867 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1378533613 Aug 27 02:47:22.409867 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-AttachSCSIVolumeTestJSON-1378533613-project Aug 27 02:47:22.409867 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:47:22.409867 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:47:22.409867 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 32514a813c0a4031a1d1effc807db17d Aug 27 02:47:22.409867 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1378533613-project Aug 27 02:47:22.409867 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 02:47:22.409867 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance 582ea86f-befd-4c47-95d9-2eba872eb8c8 could not be found. Aug 27 02:47:22.409867 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '582ea86f-befd-4c47-95d9-2eba872eb8c8'} Aug 27 02:47:22.411410 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:47:22.411410 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:47:22.411410 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:47:22.411410 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:47:22.411410 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:47:22.411410 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:47:22.411410 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:47:22.411410 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:47:22.411410 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:47:22.411410 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:47:22.411410 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 582ea86f-befd-4c47-95d9-2eba872eb8c8 could not be found. Aug 27 02:47:22.411410 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:47:22.411410 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:47:22.411410 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:47:22.411410 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:47:22.411410 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:47:22.411410 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:47:22.411410 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:47:22.411410 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:47:22.411410 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:47:22.413143 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:47:22.413143 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 02:47:22.413143 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 02:47:22.413143 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 02:47:22.413143 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 02:47:22.413143 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:47:22.413143 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:47:22.413143 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:47:22.413143 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:47:22.413143 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 582ea86f-befd-4c47-95d9-2eba872eb8c8 could not be found. Aug 27 02:47:22.413143 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:47:22.413143 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:47:22.413143 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:47:22.413143 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:47:22.413143 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:47:22.413143 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:47:22.413143 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:47:22.413143 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:47:22.413143 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 582ea86f-befd-4c47-95d9-2eba872eb8c8 could not be found. Aug 27 02:47:22.413143 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:47:22.421143 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-fe213247-3cba-4611-a228-c912bc5f08f7 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Returning 404 to user: Instance 582ea86f-befd-4c47-95d9-2eba872eb8c8 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:47:22.430390 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-fe213247-3cba-4611-a228-c912bc5f08f7 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] 10.222.0.70 "DELETE /compute/v2.1/servers/582ea86f-befd-4c47-95d9-2eba872eb8c8" status: 404 len: 111 microversion: 2.1 time: 0.116574 Aug 27 02:47:22.431746 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 832/1669] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:47:22 2022] DELETE /compute/v2.1/servers/582ea86f-befd-4c47-95d9-2eba872eb8c8 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 02:47:22.445832 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5c7d6d17-10e0-48c0-96ec-f27ade2d6bd2 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:22.448269 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-5c7d6d17-10e0-48c0-96ec-f27ade2d6bd2 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] [instance: 582ea86f-befd-4c47-95d9-2eba872eb8c8] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:22.461602 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5c7d6d17-10e0-48c0-96ec-f27ade2d6bd2 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:22.462513 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5c7d6d17-10e0-48c0-96ec-f27ade2d6bd2 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:22.463330 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5c7d6d17-10e0-48c0-96ec-f27ade2d6bd2 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:22.464483 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5c7d6d17-10e0-48c0-96ec-f27ade2d6bd2 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:22.465271 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5c7d6d17-10e0-48c0-96ec-f27ade2d6bd2 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:22.466049 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5c7d6d17-10e0-48c0-96ec-f27ade2d6bd2 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:22.504636 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-5c7d6d17-10e0-48c0-96ec-f27ade2d6bd2 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] HTTP exception thrown: Instance 582ea86f-befd-4c47-95d9-2eba872eb8c8 could not be found. Aug 27 02:47:22.513177 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5c7d6d17-10e0-48c0-96ec-f27ade2d6bd2 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Request method failure captured: Aug 27 02:47:22.513177 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/servers/582ea86f-befd-4c47-95d9-2eba872eb8c8 HTTP/1.1 Aug 27 02:47:22.513177 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:47:22.513177 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:47:22.513177 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:47:22.513177 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:47:22.513177 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:47:22.513177 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:47:22.513177 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:47:22.513177 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:47:22.513177 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYTmzmhj_z_hfRt0sxp2mK0D8Z_R1owjCX43Z0dY9vqcoXCBSDVZUORiQujb9xG3ljjGTo_EIswDTPoSJ4funB2nP_boeLBKzYLymaCG5g9f8hPEgpcKfe-IbfmyIktqsEiKJ3JF4Uy8_oSA3teZNBJ_vIwIpeOUnIQsTUth8C2gi-k Aug 27 02:47:22.513177 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:47:22.513177 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:47:22.513177 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:47:22.513177 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:47:22.513177 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:47:22.513177 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:47:22.513177 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: ebe9e2cfe40746dd8af1792468a57a2c Aug 27 02:47:22.513177 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1378533613 Aug 27 02:47:22.513177 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:47:22.513177 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:47:22.515303 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ebe9e2cfe40746dd8af1792468a57a2c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_ebe9e2cfe40746dd8af1792468a57a2c", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ebe9e2cfe40746dd8af1792468a57a2c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/ebe9e2cfe40746dd8af1792468a57a2c"}]}] Aug 27 02:47:22.515303 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1378533613 Aug 27 02:47:22.515303 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: ebe9e2cfe40746dd8af1792468a57a2c Aug 27 02:47:22.515303 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1378533613 Aug 27 02:47:22.515303 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-AttachSCSIVolumeTestJSON-1378533613-project Aug 27 02:47:22.515303 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:47:22.515303 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:47:22.515303 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 32514a813c0a4031a1d1effc807db17d Aug 27 02:47:22.515303 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1378533613-project Aug 27 02:47:22.515303 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 02:47:22.515303 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance 582ea86f-befd-4c47-95d9-2eba872eb8c8 could not be found. Aug 27 02:47:22.515303 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '582ea86f-befd-4c47-95d9-2eba872eb8c8'} Aug 27 02:47:22.516328 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:47:22.516328 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:47:22.516328 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:47:22.516328 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:47:22.516328 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:47:22.516328 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:47:22.516328 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:47:22.516328 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:47:22.516328 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:47:22.516328 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:47:22.516328 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 582ea86f-befd-4c47-95d9-2eba872eb8c8 could not be found. Aug 27 02:47:22.516328 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:47:22.516328 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:47:22.516328 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:47:22.516328 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:47:22.516328 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:47:22.516328 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:47:22.516328 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:47:22.516328 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:47:22.516328 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:47:22.518325 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:47:22.518325 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:47:22.518325 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:47:22.518325 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:47:22.518325 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:47:22.518325 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:47:22.518325 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:47:22.518325 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 582ea86f-befd-4c47-95d9-2eba872eb8c8 could not be found. Aug 27 02:47:22.518325 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:47:22.518325 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:47:22.518325 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:47:22.518325 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:47:22.518325 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:47:22.518325 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:47:22.518325 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:47:22.518325 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:47:22.518325 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 582ea86f-befd-4c47-95d9-2eba872eb8c8 could not be found. Aug 27 02:47:22.518325 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:47:22.528385 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5c7d6d17-10e0-48c0-96ec-f27ade2d6bd2 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] Returning 404 to user: Instance 582ea86f-befd-4c47-95d9-2eba872eb8c8 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:47:22.529765 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-5c7d6d17-10e0-48c0-96ec-f27ade2d6bd2 tempest-AttachSCSIVolumeTestJSON-1378533613 tempest-AttachSCSIVolumeTestJSON-1378533613-project] 10.222.0.70 "GET /compute/v2.1/servers/582ea86f-befd-4c47-95d9-2eba872eb8c8" status: 404 len: 111 microversion: 2.1 time: 0.089456 Aug 27 02:47:22.532037 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 833/1670] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:22 2022] GET /compute/v2.1/servers/582ea86f-befd-4c47-95d9-2eba872eb8c8 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:47:22.568931 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5d3d22d6-e8a2-4688-8c79-3333bcc1784b tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:22.571409 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-5d3d22d6-e8a2-4688-8c79-3333bcc1784b tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] [instance: caf46cf7-50ec-4b59-8589-ebbe4ab383e1] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:22.585412 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5d3d22d6-e8a2-4688-8c79-3333bcc1784b tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:22.586441 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5d3d22d6-e8a2-4688-8c79-3333bcc1784b tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:22.587191 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5d3d22d6-e8a2-4688-8c79-3333bcc1784b tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:22.588130 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5d3d22d6-e8a2-4688-8c79-3333bcc1784b tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:22.597176 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5d3d22d6-e8a2-4688-8c79-3333bcc1784b tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:22.597931 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5d3d22d6-e8a2-4688-8c79-3333bcc1784b tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:22.633404 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-5d3d22d6-e8a2-4688-8c79-3333bcc1784b tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] HTTP exception thrown: Instance caf46cf7-50ec-4b59-8589-ebbe4ab383e1 could not be found. Aug 27 02:47:22.635014 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5d3d22d6-e8a2-4688-8c79-3333bcc1784b tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Request method failure captured: Aug 27 02:47:22.635014 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/servers/caf46cf7-50ec-4b59-8589-ebbe4ab383e1 HTTP/1.1 Aug 27 02:47:22.635014 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:47:22.635014 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:47:22.635014 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:47:22.635014 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:47:22.635014 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:47:22.635014 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:47:22.635014 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:47:22.635014 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:47:22.635014 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYUGW-QtHaDyo8GEvWt2qOPgKN9lXPrnUts4oX-PBnorCZOvaTvczxcR_AQmyu4AI76ZdAb5EKuXDwaiHrCf0myU5jfDldRq3vUJdY4w1TYK43bzYSZ1pGkCs9KmqHwsl6vBDqbEnyf5AMfNJL_gvr1_ITR5TI59ASOZr4Pm-5dM7ac Aug 27 02:47:22.635014 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:47:22.635014 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:47:22.635014 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:47:22.635014 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:47:22.635014 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:47:22.635014 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:47:22.635014 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 256b67be18c246b186e09a313db08a7e Aug 27 02:47:22.635014 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-VolumesAdminNegativeTest-976590270 Aug 27 02:47:22.635014 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:47:22.635014 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:47:22.636836 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/256b67be18c246b186e09a313db08a7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_256b67be18c246b186e09a313db08a7e", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/256b67be18c246b186e09a313db08a7e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/256b67be18c246b186e09a313db08a7e"}]}] Aug 27 02:47:22.636836 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-VolumesAdminNegativeTest-976590270 Aug 27 02:47:22.636836 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 256b67be18c246b186e09a313db08a7e Aug 27 02:47:22.636836 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-976590270 Aug 27 02:47:22.636836 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-VolumesAdminNegativeTest-976590270-project Aug 27 02:47:22.636836 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:47:22.636836 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:47:22.636836 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: cfec6c2f34f94d66ab1cc982c5bb5bbd Aug 27 02:47:22.636836 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-VolumesAdminNegativeTest-976590270-project Aug 27 02:47:22.636836 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 02:47:22.636836 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance caf46cf7-50ec-4b59-8589-ebbe4ab383e1 could not be found. Aug 27 02:47:22.636836 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': 'caf46cf7-50ec-4b59-8589-ebbe4ab383e1'} Aug 27 02:47:22.637923 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:47:22.637923 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:47:22.637923 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:47:22.637923 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:47:22.637923 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:47:22.637923 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:47:22.637923 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:47:22.637923 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:47:22.637923 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:47:22.637923 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:47:22.637923 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance caf46cf7-50ec-4b59-8589-ebbe4ab383e1 could not be found. Aug 27 02:47:22.637923 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:47:22.637923 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:47:22.637923 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:47:22.637923 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:47:22.637923 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:47:22.637923 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:47:22.637923 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:47:22.637923 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:47:22.637923 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:47:22.639567 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:47:22.639567 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:47:22.639567 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:47:22.639567 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:47:22.639567 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:47:22.639567 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:47:22.639567 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:47:22.639567 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance caf46cf7-50ec-4b59-8589-ebbe4ab383e1 could not be found. Aug 27 02:47:22.639567 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:47:22.639567 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:47:22.639567 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:47:22.639567 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:47:22.639567 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:47:22.639567 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:47:22.639567 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:47:22.639567 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:47:22.639567 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance caf46cf7-50ec-4b59-8589-ebbe4ab383e1 could not be found. Aug 27 02:47:22.639567 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:47:22.641126 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5d3d22d6-e8a2-4688-8c79-3333bcc1784b tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Returning 404 to user: Instance caf46cf7-50ec-4b59-8589-ebbe4ab383e1 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:47:22.641126 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-5d3d22d6-e8a2-4688-8c79-3333bcc1784b tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] 10.222.0.70 "GET /compute/v2.1/servers/caf46cf7-50ec-4b59-8589-ebbe4ab383e1" status: 404 len: 111 microversion: 2.1 time: 0.072485 Aug 27 02:47:22.649412 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 834/1671] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:22 2022] GET /compute/v2.1/servers/caf46cf7-50ec-4b59-8589-ebbe4ab383e1 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:47:22.897040 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-0740e723-0548-4657-8909-f36f48292e06 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:22.910225 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-0740e723-0548-4657-8909-f36f48292e06 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b" status: 200 len: 1390 microversion: 2.1 time: 0.654811 Aug 27 02:47:22.928629 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 838/1672] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:22 2022] GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b => generated 1390 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:23.205794 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-1d4d3199-237f-4115-851a-80d8da475a59 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:23.206255 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-1d4d3199-237f-4115-851a-80d8da475a59 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] [instance: d2020ea3-b05b-47ca-b9a1-950c028db483] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:23.218236 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1d4d3199-237f-4115-851a-80d8da475a59 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:23.219669 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1d4d3199-237f-4115-851a-80d8da475a59 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:23.221661 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1d4d3199-237f-4115-851a-80d8da475a59 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:23.222623 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1d4d3199-237f-4115-851a-80d8da475a59 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:23.223251 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1d4d3199-237f-4115-851a-80d8da475a59 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:23.223846 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1d4d3199-237f-4115-851a-80d8da475a59 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:23.350599 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-9e387974-d36d-4f36-a946-0459332ae867 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Calling method '.version_select at 0x7f5ede9941f0>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:23.425633 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-9e387974-d36d-4f36-a946-0459332ae867 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] 10.222.0.70 "GET /compute/v2.1/images/ad164dff-00dc-46d7-a144-6b41f4ecabd8" status: 200 len: 662 microversion: 2.1 time: 0.079362 Aug 27 02:47:23.436424 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 839/1673] 10.222.0.70 () {58 vars in 1233 bytes} [Sat Aug 27 02:47:23 2022] GET /compute/v2.1/images/ad164dff-00dc-46d7-a144-6b41f4ecabd8 => generated 662 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:47:23.453998 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a5a99366-23a2-4ec6-928b-fd22975d7da1 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Calling method '.version_select at 0x7f5ede97d040>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:23.510046 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a5a99366-23a2-4ec6-928b-fd22975d7da1 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] 10.222.0.70 "GET /compute/v2.1/images/ad164dff-00dc-46d7-a144-6b41f4ecabd8" status: 200 len: 662 microversion: 2.1 time: 0.072872 Aug 27 02:47:23.510909 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 840/1674] 10.222.0.70 () {58 vars in 1233 bytes} [Sat Aug 27 02:47:23 2022] GET /compute/v2.1/images/ad164dff-00dc-46d7-a144-6b41f4ecabd8 => generated 662 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:47:23.923134 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-1d4d3199-237f-4115-851a-80d8da475a59 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a724314a34d2477cac222eeba100840b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b7c879ef5f4e5e8204433a06bdd370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:23.938643 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-6894b272-df3d-4efe-8456-05550fce217a tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:23.939528 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-6894b272-df3d-4efe-8456-05550fce217a tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 70acfe32-deea-46fc-a214-8fdbb9f6cb7b] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:23.949705 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6894b272-df3d-4efe-8456-05550fce217a tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:23.950942 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-1d4d3199-237f-4115-851a-80d8da475a59 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] 10.222.0.70 "GET /compute/v2.1/servers/d2020ea3-b05b-47ca-b9a1-950c028db483" status: 200 len: 1314 microversion: 2.1 time: 0.749164 Aug 27 02:47:23.956137 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6894b272-df3d-4efe-8456-05550fce217a tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:23.956648 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6894b272-df3d-4efe-8456-05550fce217a tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:23.957697 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6894b272-df3d-4efe-8456-05550fce217a tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:23.958450 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6894b272-df3d-4efe-8456-05550fce217a tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:23.958878 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6894b272-df3d-4efe-8456-05550fce217a tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:23.965411 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 835/1675] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:23 2022] GET /compute/v2.1/servers/d2020ea3-b05b-47ca-b9a1-950c028db483 => generated 1314 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:24.447755 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-6894b272-df3d-4efe-8456-05550fce217a tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:24.465003 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-6894b272-df3d-4efe-8456-05550fce217a tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b" status: 200 len: 1390 microversion: 2.1 time: 0.531906 Aug 27 02:47:24.467405 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 841/1676] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:23 2022] GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b => generated 1390 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:47:24.729100 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-d4544ad4-afcd-4e85-bd0b-c511ba881ae3 req-d1bec9da-c6df-49a1-aca6-4b4035d6cf1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2020ea3-b05b-47ca-b9a1-950c028db483", "tag": "276f206e-96b1-41f8-a246-bfeb80b199fe"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:47:24.759841 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-d4544ad4-afcd-4e85-bd0b-c511ba881ae3 req-d1bec9da-c6df-49a1-aca6-4b4035d6cf1a service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:24.759841 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-d4544ad4-afcd-4e85-bd0b-c511ba881ae3 req-d1bec9da-c6df-49a1-aca6-4b4035d6cf1a service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:24.759841 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-d4544ad4-afcd-4e85-bd0b-c511ba881ae3 req-d1bec9da-c6df-49a1-aca6-4b4035d6cf1a service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:24.783158 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-d4544ad4-afcd-4e85-bd0b-c511ba881ae3 req-d1bec9da-c6df-49a1-aca6-4b4035d6cf1a service nova] Creating event network-changed:276f206e-96b1-41f8-a246-bfeb80b199fe for instance d2020ea3-b05b-47ca-b9a1-950c028db483 on n-h1-852278-4 Aug 27 02:47:24.806196 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-d4544ad4-afcd-4e85-bd0b-c511ba881ae3 req-d1bec9da-c6df-49a1-aca6-4b4035d6cf1a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079799 Aug 27 02:47:24.811232 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 836/1677] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:47:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:47:24.974573 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-157197b4-04c1-49fd-8198-bd769376659e tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:24.975465 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-157197b4-04c1-49fd-8198-bd769376659e tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] [instance: d2020ea3-b05b-47ca-b9a1-950c028db483] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:24.996231 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-157197b4-04c1-49fd-8198-bd769376659e tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:24.998913 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-157197b4-04c1-49fd-8198-bd769376659e tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:25.002909 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-157197b4-04c1-49fd-8198-bd769376659e tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:25.004347 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-157197b4-04c1-49fd-8198-bd769376659e tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:25.004990 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-157197b4-04c1-49fd-8198-bd769376659e tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:25.005602 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-157197b4-04c1-49fd-8198-bd769376659e tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:25.247896 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8c546be1-f008-4e38-a4fb-d02c0b3a36d4 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Calling method '.version_select at 0x7f5ee33e1c10>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:25.312245 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-8c546be1-f008-4e38-a4fb-d02c0b3a36d4 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] 10.222.0.70 "GET /compute/v2.1/images/8020a5cf-898b-4943-890d-dcd7b7876c94" status: 200 len: 662 microversion: 2.1 time: 0.068865 Aug 27 02:47:25.313678 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 837/1678] 10.222.0.70 () {58 vars in 1233 bytes} [Sat Aug 27 02:47:25 2022] GET /compute/v2.1/images/8020a5cf-898b-4943-890d-dcd7b7876c94 => generated 662 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:47:25.327756 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3ead949d-084e-4805-9fab-a8a61b64b5b8 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Calling method '.version_select at 0x7f5ee33f8c10>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:25.369898 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-157197b4-04c1-49fd-8198-bd769376659e tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a724314a34d2477cac222eeba100840b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b7c879ef5f4e5e8204433a06bdd370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:25.378318 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-157197b4-04c1-49fd-8198-bd769376659e tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] 10.222.0.70 "GET /compute/v2.1/servers/d2020ea3-b05b-47ca-b9a1-950c028db483" status: 200 len: 1314 microversion: 2.1 time: 0.408321 Aug 27 02:47:25.388710 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-3ead949d-084e-4805-9fab-a8a61b64b5b8 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] 10.222.0.70 "GET /compute/v2.1/images/8020a5cf-898b-4943-890d-dcd7b7876c94" status: 200 len: 662 microversion: 2.1 time: 0.062315 Aug 27 02:47:25.389515 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 842/1679] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:24 2022] GET /compute/v2.1/servers/d2020ea3-b05b-47ca-b9a1-950c028db483 => generated 1314 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:25.398459 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 838/1680] 10.222.0.70 () {58 vars in 1233 bytes} [Sat Aug 27 02:47:25 2022] GET /compute/v2.1/images/8020a5cf-898b-4943-890d-dcd7b7876c94 => generated 662 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:47:25.490911 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b508a09d-8704-46f8-a27f-1a996abec6de tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:25.491980 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b508a09d-8704-46f8-a27f-1a996abec6de tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 70acfe32-deea-46fc-a214-8fdbb9f6cb7b] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:25.503734 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b508a09d-8704-46f8-a27f-1a996abec6de tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:25.504242 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b508a09d-8704-46f8-a27f-1a996abec6de tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:25.504938 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b508a09d-8704-46f8-a27f-1a996abec6de tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:25.507185 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b508a09d-8704-46f8-a27f-1a996abec6de tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:25.512437 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b508a09d-8704-46f8-a27f-1a996abec6de tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:25.513299 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b508a09d-8704-46f8-a27f-1a996abec6de tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:25.636628 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6a434b18-21ed-4d49-9249-f1bb354af5f8 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-777725928", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:47:25.716953 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.network.neutron [None req-6a434b18-21ed-4d49-9249-f1bb354af5f8 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] validate_networks() for None {{(pid=134052) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:47:25.791192 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-b508a09d-8704-46f8-a27f-1a996abec6de tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:25.799897 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b508a09d-8704-46f8-a27f-1a996abec6de tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b" status: 200 len: 1390 microversion: 2.1 time: 0.313205 Aug 27 02:47:25.811144 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 843/1681] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:25 2022] GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b => generated 1390 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:25.983770 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-6a434b18-21ed-4d49-9249-f1bb354af5f8 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Flavor limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:47:25.984193 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-6a434b18-21ed-4d49-9249-f1bb354af5f8 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Image limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:47:25.984685 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-6a434b18-21ed-4d49-9249-f1bb354af5f8 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Flavor pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:47:25.985303 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-6a434b18-21ed-4d49-9249-f1bb354af5f8 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Image pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:47:25.985765 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-6a434b18-21ed-4d49-9249-f1bb354af5f8 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:47:25.996093 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6a434b18-21ed-4d49-9249-f1bb354af5f8 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:25.996619 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6a434b18-21ed-4d49-9249-f1bb354af5f8 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:25.997680 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6a434b18-21ed-4d49-9249-f1bb354af5f8 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:25.998419 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6a434b18-21ed-4d49-9249-f1bb354af5f8 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:25.998924 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6a434b18-21ed-4d49-9249-f1bb354af5f8 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:25.999548 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6a434b18-21ed-4d49-9249-f1bb354af5f8 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:26.039260 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-6a434b18-21ed-4d49-9249-f1bb354af5f8 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Getting quotas for project 5ae1f9ee6b7e49849b68b3628b76766a. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:47:26.057956 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-6a434b18-21ed-4d49-9249-f1bb354af5f8 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Getting quotas for user 1d626281a9864fe7aed598d4be209137 and project 5ae1f9ee6b7e49849b68b3628b76766a. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:47:26.075269 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-6a434b18-21ed-4d49-9249-f1bb354af5f8 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Going to run 1 instances... {{(pid=134052) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:47:26.078880 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-6a434b18-21ed-4d49-9249-f1bb354af5f8 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] [instance: 191df585-2175-47be-9bd8-29b914535f47] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134052) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:47:26.183867 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-6a434b18-21ed-4d49-9249-f1bb354af5f8 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.553571 Aug 27 02:47:26.193497 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 839/1682] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 02:47:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 564 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 02:47:26.291033 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-cf80287c-2b03-42a2-be97-7b0d782a2a34 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-406606490", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:47:26.402537 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-35e43f0e-1b1a-485d-b7a2-1f6143a67f61 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:26.403491 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-35e43f0e-1b1a-485d-b7a2-1f6143a67f61 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] [instance: d2020ea3-b05b-47ca-b9a1-950c028db483] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:26.403993 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.network.neutron [None req-cf80287c-2b03-42a2-be97-7b0d782a2a34 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] validate_networks() for None {{(pid=134051) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:47:26.411298 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-35e43f0e-1b1a-485d-b7a2-1f6143a67f61 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:26.412123 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-35e43f0e-1b1a-485d-b7a2-1f6143a67f61 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:26.412808 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-35e43f0e-1b1a-485d-b7a2-1f6143a67f61 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:26.414639 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-35e43f0e-1b1a-485d-b7a2-1f6143a67f61 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:26.415315 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-35e43f0e-1b1a-485d-b7a2-1f6143a67f61 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:26.416259 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-35e43f0e-1b1a-485d-b7a2-1f6143a67f61 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:26.956507 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-cf80287c-2b03-42a2-be97-7b0d782a2a34 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Flavor limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:47:26.957123 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-cf80287c-2b03-42a2-be97-7b0d782a2a34 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Image limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:47:26.957366 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-cf80287c-2b03-42a2-be97-7b0d782a2a34 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Flavor pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:47:26.957976 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-cf80287c-2b03-42a2-be97-7b0d782a2a34 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Image pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:47:26.958530 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-cf80287c-2b03-42a2-be97-7b0d782a2a34 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:47:26.977781 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cf80287c-2b03-42a2-be97-7b0d782a2a34 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:26.978666 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cf80287c-2b03-42a2-be97-7b0d782a2a34 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:26.979121 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cf80287c-2b03-42a2-be97-7b0d782a2a34 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:26.979812 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cf80287c-2b03-42a2-be97-7b0d782a2a34 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:26.980253 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cf80287c-2b03-42a2-be97-7b0d782a2a34 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:26.980688 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cf80287c-2b03-42a2-be97-7b0d782a2a34 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:27.047135 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-cf80287c-2b03-42a2-be97-7b0d782a2a34 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Getting quotas for project 5ae1f9ee6b7e49849b68b3628b76766a. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:47:27.068565 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-cf80287c-2b03-42a2-be97-7b0d782a2a34 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Getting quotas for user 1d626281a9864fe7aed598d4be209137 and project 5ae1f9ee6b7e49849b68b3628b76766a. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:47:27.101543 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-cf80287c-2b03-42a2-be97-7b0d782a2a34 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Going to run 1 instances... {{(pid=134051) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:47:27.106330 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-cf80287c-2b03-42a2-be97-7b0d782a2a34 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] [instance: 9d7f8c37-c4a6-400e-9a02-94f9040b780e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134051) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:47:27.136101 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-35e43f0e-1b1a-485d-b7a2-1f6143a67f61 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a724314a34d2477cac222eeba100840b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b7c879ef5f4e5e8204433a06bdd370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:27.152776 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-35e43f0e-1b1a-485d-b7a2-1f6143a67f61 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] 10.222.0.70 "GET /compute/v2.1/servers/d2020ea3-b05b-47ca-b9a1-950c028db483" status: 200 len: 1314 microversion: 2.1 time: 0.755164 Aug 27 02:47:27.155220 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 840/1683] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:26 2022] GET /compute/v2.1/servers/d2020ea3-b05b-47ca-b9a1-950c028db483 => generated 1314 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:47:27.162180 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-96b446eb-5ea7-4569-acbe-8ea8394a6afa tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:27.163075 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-96b446eb-5ea7-4569-acbe-8ea8394a6afa tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 70acfe32-deea-46fc-a214-8fdbb9f6cb7b] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:27.173743 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-96b446eb-5ea7-4569-acbe-8ea8394a6afa tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:27.174629 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-96b446eb-5ea7-4569-acbe-8ea8394a6afa tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:27.175274 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-96b446eb-5ea7-4569-acbe-8ea8394a6afa tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:27.176201 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-96b446eb-5ea7-4569-acbe-8ea8394a6afa tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:27.176896 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-96b446eb-5ea7-4569-acbe-8ea8394a6afa tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:27.177560 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-96b446eb-5ea7-4569-acbe-8ea8394a6afa tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:27.352861 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-cf80287c-2b03-42a2-be97-7b0d782a2a34 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.065935 Aug 27 02:47:27.356809 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 844/1684] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 02:47:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1072 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:47:27.372732 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-aa9d301a-3ff8-49f1-bc97-66589e4ba7c2 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:27.376418 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-aa9d301a-3ff8-49f1-bc97-66589e4ba7c2 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] [instance: 9d7f8c37-c4a6-400e-9a02-94f9040b780e] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:27.664460 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-aa9d301a-3ff8-49f1-bc97-66589e4ba7c2 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d626281a9864fe7aed598d4be209137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ae1f9ee6b7e49849b68b3628b76766a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:27.684712 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-aa9d301a-3ff8-49f1-bc97-66589e4ba7c2 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] 10.222.0.70 "GET /compute/v2.1/servers/9d7f8c37-c4a6-400e-9a02-94f9040b780e" status: 200 len: 1217 microversion: 2.1 time: 0.316716 Aug 27 02:47:27.686110 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 845/1685] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:27 2022] GET /compute/v2.1/servers/9d7f8c37-c4a6-400e-9a02-94f9040b780e => generated 1217 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:28.136205 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-96b446eb-5ea7-4569-acbe-8ea8394a6afa tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:28.177816 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-315f110e-fa5c-4d1c-89f8-d226a30497e6 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:28.178520 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-96b446eb-5ea7-4569-acbe-8ea8394a6afa tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b" status: 200 len: 1390 microversion: 2.1 time: 1.017482 Aug 27 02:47:28.178794 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-315f110e-fa5c-4d1c-89f8-d226a30497e6 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] [instance: d2020ea3-b05b-47ca-b9a1-950c028db483] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:28.187495 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 841/1686] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:27 2022] GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b => generated 1390 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:28.227804 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-315f110e-fa5c-4d1c-89f8-d226a30497e6 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:28.232972 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-315f110e-fa5c-4d1c-89f8-d226a30497e6 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:28.235230 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-315f110e-fa5c-4d1c-89f8-d226a30497e6 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:28.239482 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-315f110e-fa5c-4d1c-89f8-d226a30497e6 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:28.242698 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-315f110e-fa5c-4d1c-89f8-d226a30497e6 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:28.245875 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-315f110e-fa5c-4d1c-89f8-d226a30497e6 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:28.306614 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e13b2ec7-a3d0-4710-b946-88e9d39332c5 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:28.307309 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-e13b2ec7-a3d0-4710-b946-88e9d39332c5 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] [instance: a00dd6f6-d48c-4938-84b1-71bec3877ad9] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:28.345394 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e13b2ec7-a3d0-4710-b946-88e9d39332c5 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:28.354177 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e13b2ec7-a3d0-4710-b946-88e9d39332c5 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:28.358613 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e13b2ec7-a3d0-4710-b946-88e9d39332c5 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:28.359816 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e13b2ec7-a3d0-4710-b946-88e9d39332c5 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:28.362830 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e13b2ec7-a3d0-4710-b946-88e9d39332c5 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:28.363713 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e13b2ec7-a3d0-4710-b946-88e9d39332c5 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:28.459752 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-e13b2ec7-a3d0-4710-b946-88e9d39332c5 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] [instance: a00dd6f6-d48c-4938-84b1-71bec3877ad9] Going to try to terminate instance {{(pid=134052) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:47:28.605153 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:47:28.695896 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e13b2ec7-a3d0-4710-b946-88e9d39332c5 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] 10.222.0.70 "DELETE /compute/v2.1/servers/a00dd6f6-d48c-4938-84b1-71bec3877ad9" status: 204 len: 0 microversion: 2.1 time: 0.395674 Aug 27 02:47:28.700780 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 842/1687] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:47:28 2022] DELETE /compute/v2.1/servers/a00dd6f6-d48c-4938-84b1-71bec3877ad9 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:47:28.720445 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ffe73d2e-133d-48df-be19-537e6e480171 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:28.723676 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-ffe73d2e-133d-48df-be19-537e6e480171 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] [instance: a00dd6f6-d48c-4938-84b1-71bec3877ad9] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:28.743409 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ffe73d2e-133d-48df-be19-537e6e480171 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:28.744991 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ffe73d2e-133d-48df-be19-537e6e480171 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:28.746150 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ffe73d2e-133d-48df-be19-537e6e480171 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:28.752218 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ffe73d2e-133d-48df-be19-537e6e480171 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:28.754561 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ffe73d2e-133d-48df-be19-537e6e480171 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:28.755236 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ffe73d2e-133d-48df-be19-537e6e480171 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:29.736469 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-315f110e-fa5c-4d1c-89f8-d226a30497e6 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a724314a34d2477cac222eeba100840b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b7c879ef5f4e5e8204433a06bdd370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:29.762222 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-315f110e-fa5c-4d1c-89f8-d226a30497e6 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] 10.222.0.70 "GET /compute/v2.1/servers/d2020ea3-b05b-47ca-b9a1-950c028db483" status: 200 len: 1314 microversion: 2.1 time: 1.590296 Aug 27 02:47:29.764244 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 846/1688] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:28 2022] GET /compute/v2.1/servers/d2020ea3-b05b-47ca-b9a1-950c028db483 => generated 1314 bytes in 1593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:29.780541 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a38c6b9a-9c7b-43fa-9314-b836bf7d41de tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:29.783156 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-a38c6b9a-9c7b-43fa-9314-b836bf7d41de tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] [instance: 9d7f8c37-c4a6-400e-9a02-94f9040b780e] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:29.809236 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a38c6b9a-9c7b-43fa-9314-b836bf7d41de tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:29.811428 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a38c6b9a-9c7b-43fa-9314-b836bf7d41de tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:29.812372 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a38c6b9a-9c7b-43fa-9314-b836bf7d41de tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:29.815720 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a38c6b9a-9c7b-43fa-9314-b836bf7d41de tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:29.818149 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a38c6b9a-9c7b-43fa-9314-b836bf7d41de tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:29.820896 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a38c6b9a-9c7b-43fa-9314-b836bf7d41de tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:29.874543 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-ffe73d2e-133d-48df-be19-537e6e480171 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfec6c2f34f94d66ab1cc982c5bb5bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256b67be18c246b186e09a313db08a7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:29.883400 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ffe73d2e-133d-48df-be19-537e6e480171 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] 10.222.0.70 "GET /compute/v2.1/servers/a00dd6f6-d48c-4938-84b1-71bec3877ad9" status: 200 len: 1681 microversion: 2.1 time: 1.177070 Aug 27 02:47:29.893057 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 843/1689] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:28 2022] GET /compute/v2.1/servers/a00dd6f6-d48c-4938-84b1-71bec3877ad9 => generated 1681 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:29.898063 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c44a682d-c936-454d-9311-002284db4808 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:29.898863 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-c44a682d-c936-454d-9311-002284db4808 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 70acfe32-deea-46fc-a214-8fdbb9f6cb7b] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:29.939045 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c44a682d-c936-454d-9311-002284db4808 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:29.939556 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c44a682d-c936-454d-9311-002284db4808 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:29.939997 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c44a682d-c936-454d-9311-002284db4808 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:29.940763 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c44a682d-c936-454d-9311-002284db4808 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:29.941214 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c44a682d-c936-454d-9311-002284db4808 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:29.941632 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c44a682d-c936-454d-9311-002284db4808 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:30.392419 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-a38c6b9a-9c7b-43fa-9314-b836bf7d41de tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d626281a9864fe7aed598d4be209137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ae1f9ee6b7e49849b68b3628b76766a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:30.431695 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a38c6b9a-9c7b-43fa-9314-b836bf7d41de tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] 10.222.0.70 "GET /compute/v2.1/servers/9d7f8c37-c4a6-400e-9a02-94f9040b780e" status: 200 len: 1213 microversion: 2.1 time: 0.657820 Aug 27 02:47:30.441645 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 847/1690] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:29 2022] GET /compute/v2.1/servers/9d7f8c37-c4a6-400e-9a02-94f9040b780e => generated 1213 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:30.723699 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-c44a682d-c936-454d-9311-002284db4808 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:30.751664 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c44a682d-c936-454d-9311-002284db4808 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b" status: 200 len: 1380 microversion: 2.1 time: 0.841757 Aug 27 02:47:30.754370 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 844/1691] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:29 2022] GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b => generated 1380 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:30.777629 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0470c843-152e-436e-900d-846956614a95 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Calling method '.version_select at 0x7f5ede993a60>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:30.783161 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0470c843-152e-436e-900d-846956614a95 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:30.791629 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6cab1c1c-d1d7-4170-80a9-642ce6d7ff6a tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:30.792651 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-6cab1c1c-d1d7-4170-80a9-642ce6d7ff6a tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] [instance: d2020ea3-b05b-47ca-b9a1-950c028db483] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:30.805909 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0470c843-152e-436e-900d-846956614a95 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:30.806793 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0470c843-152e-436e-900d-846956614a95 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:30.814831 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6cab1c1c-d1d7-4170-80a9-642ce6d7ff6a tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:30.819488 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6cab1c1c-d1d7-4170-80a9-642ce6d7ff6a tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:30.820512 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6cab1c1c-d1d7-4170-80a9-642ce6d7ff6a tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:30.821687 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6cab1c1c-d1d7-4170-80a9-642ce6d7ff6a tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:30.822618 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6cab1c1c-d1d7-4170-80a9-642ce6d7ff6a tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:30.828686 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6cab1c1c-d1d7-4170-80a9-642ce6d7ff6a tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:30.833307 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-0470c843-152e-436e-900d-846956614a95 tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] 10.222.0.70 "GET /compute/v2.1/os-migrations" status: 200 len: 1550 microversion: 2.1 time: 0.060406 Aug 27 02:47:30.838499 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 848/1692] 10.222.0.70 () {58 vars in 1143 bytes} [Sat Aug 27 02:47:30 2022] GET /compute/v2.1/os-migrations => generated 1550 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:30.889145 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-17742dae-56f3-4372-9828-08c03cbd990a tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:30.892293 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-17742dae-56f3-4372-9828-08c03cbd990a tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] [instance: 70acfe32-deea-46fc-a214-8fdbb9f6cb7b] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:30.917962 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-17742dae-56f3-4372-9828-08c03cbd990a tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:30.920067 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-17742dae-56f3-4372-9828-08c03cbd990a tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:30.920899 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-17742dae-56f3-4372-9828-08c03cbd990a tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:30.923468 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-17742dae-56f3-4372-9828-08c03cbd990a tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:30.924713 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-17742dae-56f3-4372-9828-08c03cbd990a tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:30.926204 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-17742dae-56f3-4372-9828-08c03cbd990a tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:31.446701 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-6cab1c1c-d1d7-4170-80a9-642ce6d7ff6a tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a724314a34d2477cac222eeba100840b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b7c879ef5f4e5e8204433a06bdd370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:31.463086 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-6cab1c1c-d1d7-4170-80a9-642ce6d7ff6a tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] 10.222.0.70 "GET /compute/v2.1/servers/d2020ea3-b05b-47ca-b9a1-950c028db483" status: 200 len: 1314 microversion: 2.1 time: 0.676737 Aug 27 02:47:31.468555 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 845/1693] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:30 2022] GET /compute/v2.1/servers/d2020ea3-b05b-47ca-b9a1-950c028db483 => generated 1314 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:31.489659 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e4377d8c-f43b-4850-924a-aada398f709a tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:31.490316 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-e4377d8c-f43b-4850-924a-aada398f709a tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] [instance: a00dd6f6-d48c-4938-84b1-71bec3877ad9] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:31.503506 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e4377d8c-f43b-4850-924a-aada398f709a tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:31.509471 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e4377d8c-f43b-4850-924a-aada398f709a tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:31.510051 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e4377d8c-f43b-4850-924a-aada398f709a tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:31.510833 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e4377d8c-f43b-4850-924a-aada398f709a tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:31.511341 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e4377d8c-f43b-4850-924a-aada398f709a tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:31.511719 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e4377d8c-f43b-4850-924a-aada398f709a tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:31.536568 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-17742dae-56f3-4372-9828-08c03cbd990a tempest-LiveMigrationTest-620655646 tempest-LiveMigrationTest-620655646-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b" status: 200 len: 1531 microversion: 2.1 time: 0.663900 Aug 27 02:47:31.551931 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 849/1694] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:30 2022] GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b => generated 1531 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:31.585540 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-675fe019-3fa8-4494-bb90-41168a85d54b tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:31.586179 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-675fe019-3fa8-4494-bb90-41168a85d54b tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] [instance: 9d7f8c37-c4a6-400e-9a02-94f9040b780e] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:31.626415 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-675fe019-3fa8-4494-bb90-41168a85d54b tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:31.629036 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-675fe019-3fa8-4494-bb90-41168a85d54b tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:31.631189 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-675fe019-3fa8-4494-bb90-41168a85d54b tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:31.658874 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-675fe019-3fa8-4494-bb90-41168a85d54b tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:31.659299 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-675fe019-3fa8-4494-bb90-41168a85d54b tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:31.659731 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-675fe019-3fa8-4494-bb90-41168a85d54b tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:31.915758 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-675fe019-3fa8-4494-bb90-41168a85d54b tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d626281a9864fe7aed598d4be209137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ae1f9ee6b7e49849b68b3628b76766a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:31.924905 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-675fe019-3fa8-4494-bb90-41168a85d54b tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] 10.222.0.70 "GET /compute/v2.1/servers/9d7f8c37-c4a6-400e-9a02-94f9040b780e" status: 200 len: 1275 microversion: 2.1 time: 0.371043 Aug 27 02:47:31.925867 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 850/1695] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:31 2022] GET /compute/v2.1/servers/9d7f8c37-c4a6-400e-9a02-94f9040b780e => generated 1275 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:31.941220 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-9df8dc7d-6b4f-4272-89f4-421399080e22 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:31.942177 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-9df8dc7d-6b4f-4272-89f4-421399080e22 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 70acfe32-deea-46fc-a214-8fdbb9f6cb7b] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:31.972393 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9df8dc7d-6b4f-4272-89f4-421399080e22 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:31.973506 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9df8dc7d-6b4f-4272-89f4-421399080e22 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:31.974208 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9df8dc7d-6b4f-4272-89f4-421399080e22 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:31.975200 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9df8dc7d-6b4f-4272-89f4-421399080e22 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:31.975952 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9df8dc7d-6b4f-4272-89f4-421399080e22 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:31.976678 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9df8dc7d-6b4f-4272-89f4-421399080e22 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:32.006025 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-9df8dc7d-6b4f-4272-89f4-421399080e22 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 70acfe32-deea-46fc-a214-8fdbb9f6cb7b] Going to try to terminate instance {{(pid=134051) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:47:32.142943 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-9df8dc7d-6b4f-4272-89f4-421399080e22 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "DELETE /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b" status: 204 len: 0 microversion: 2.1 time: 0.215530 Aug 27 02:47:32.149339 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 851/1696] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:47:31 2022] DELETE /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:47:32.162540 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-ebd176b0-e3ab-4c2b-9556-64742112014f req-d69673b5-4a96-4ee3-887d-cc63243e69c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2020ea3-b05b-47ca-b9a1-950c028db483", "name": "network-vif-plugged", "status": "completed", "tag": "276f206e-96b1-41f8-a246-bfeb80b199fe"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:47:32.181059 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-ebd176b0-e3ab-4c2b-9556-64742112014f req-d69673b5-4a96-4ee3-887d-cc63243e69c9 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:32.182996 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-ebd176b0-e3ab-4c2b-9556-64742112014f req-d69673b5-4a96-4ee3-887d-cc63243e69c9 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:32.184600 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-ebd176b0-e3ab-4c2b-9556-64742112014f req-d69673b5-4a96-4ee3-887d-cc63243e69c9 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:32.203649 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-ebd176b0-e3ab-4c2b-9556-64742112014f req-d69673b5-4a96-4ee3-887d-cc63243e69c9 service nova] Creating event network-vif-plugged:276f206e-96b1-41f8-a246-bfeb80b199fe for instance d2020ea3-b05b-47ca-b9a1-950c028db483 on n-h1-852278-4 Aug 27 02:47:32.213131 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-ebd176b0-e3ab-4c2b-9556-64742112014f req-d69673b5-4a96-4ee3-887d-cc63243e69c9 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060353 Aug 27 02:47:32.219270 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 852/1697] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:47:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:47:32.226775 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b8a2eda7-df87-4d67-bccc-2e14e1b3b78e tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:32.230010 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b8a2eda7-df87-4d67-bccc-2e14e1b3b78e tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 70acfe32-deea-46fc-a214-8fdbb9f6cb7b] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:32.236787 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b8a2eda7-df87-4d67-bccc-2e14e1b3b78e tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:32.237533 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b8a2eda7-df87-4d67-bccc-2e14e1b3b78e tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:32.238152 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b8a2eda7-df87-4d67-bccc-2e14e1b3b78e tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:32.239117 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b8a2eda7-df87-4d67-bccc-2e14e1b3b78e tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:32.239748 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b8a2eda7-df87-4d67-bccc-2e14e1b3b78e tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:32.240354 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b8a2eda7-df87-4d67-bccc-2e14e1b3b78e tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:32.380196 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-e4377d8c-f43b-4850-924a-aada398f709a tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfec6c2f34f94d66ab1cc982c5bb5bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256b67be18c246b186e09a313db08a7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:32.392019 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e4377d8c-f43b-4850-924a-aada398f709a tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] 10.222.0.70 "GET /compute/v2.1/servers/a00dd6f6-d48c-4938-84b1-71bec3877ad9" status: 200 len: 1681 microversion: 2.1 time: 0.920765 Aug 27 02:47:32.393959 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 846/1698] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:31 2022] GET /compute/v2.1/servers/a00dd6f6-d48c-4938-84b1-71bec3877ad9 => generated 1681 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:32.492822 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ee4575ca-0fef-46bd-a2c5-8088127dd54b tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:32.497335 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-ee4575ca-0fef-46bd-a2c5-8088127dd54b tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] [instance: d2020ea3-b05b-47ca-b9a1-950c028db483] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:32.506797 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ee4575ca-0fef-46bd-a2c5-8088127dd54b tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:32.507752 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ee4575ca-0fef-46bd-a2c5-8088127dd54b tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:32.508778 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ee4575ca-0fef-46bd-a2c5-8088127dd54b tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:32.509876 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ee4575ca-0fef-46bd-a2c5-8088127dd54b tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:32.510444 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ee4575ca-0fef-46bd-a2c5-8088127dd54b tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:32.511100 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ee4575ca-0fef-46bd-a2c5-8088127dd54b tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:33.007280 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-b8a2eda7-df87-4d67-bccc-2e14e1b3b78e tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:33.016065 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b8a2eda7-df87-4d67-bccc-2e14e1b3b78e tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b" status: 200 len: 1386 microversion: 2.1 time: 0.794941 Aug 27 02:47:33.017004 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 853/1699] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:32 2022] GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b => generated 1386 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:33.028691 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-5d6cf2f8-e7d1-493d-b1e8-acee0d803fed tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:33.029418 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-5d6cf2f8-e7d1-493d-b1e8-acee0d803fed tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] [instance: 9d7f8c37-c4a6-400e-9a02-94f9040b780e] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:33.036169 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5d6cf2f8-e7d1-493d-b1e8-acee0d803fed tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:33.037146 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5d6cf2f8-e7d1-493d-b1e8-acee0d803fed tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:33.037597 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5d6cf2f8-e7d1-493d-b1e8-acee0d803fed tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:33.038427 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5d6cf2f8-e7d1-493d-b1e8-acee0d803fed tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:33.038891 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5d6cf2f8-e7d1-493d-b1e8-acee0d803fed tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:33.039282 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5d6cf2f8-e7d1-493d-b1e8-acee0d803fed tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:33.061962 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:47:33.241887 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-5d6cf2f8-e7d1-493d-b1e8-acee0d803fed tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d626281a9864fe7aed598d4be209137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ae1f9ee6b7e49849b68b3628b76766a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:33.265602 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-5d6cf2f8-e7d1-493d-b1e8-acee0d803fed tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] 10.222.0.70 "GET /compute/v2.1/servers/9d7f8c37-c4a6-400e-9a02-94f9040b780e" status: 200 len: 1275 microversion: 2.1 time: 0.247282 Aug 27 02:47:33.266789 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 854/1700] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:33 2022] GET /compute/v2.1/servers/9d7f8c37-c4a6-400e-9a02-94f9040b780e => generated 1275 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:33.289456 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-ee4575ca-0fef-46bd-a2c5-8088127dd54b tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a724314a34d2477cac222eeba100840b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b7c879ef5f4e5e8204433a06bdd370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:33.299799 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ee4575ca-0fef-46bd-a2c5-8088127dd54b tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] 10.222.0.70 "GET /compute/v2.1/servers/d2020ea3-b05b-47ca-b9a1-950c028db483" status: 200 len: 1314 microversion: 2.1 time: 0.818354 Aug 27 02:47:33.300498 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 847/1701] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:32 2022] GET /compute/v2.1/servers/d2020ea3-b05b-47ca-b9a1-950c028db483 => generated 1314 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:47:33.414722 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-fa5392d3-7dda-4655-93a4-a28af79cf424 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:33.415523 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-fa5392d3-7dda-4655-93a4-a28af79cf424 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] [instance: a00dd6f6-d48c-4938-84b1-71bec3877ad9] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:33.419183 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=3,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:47:33.427262 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fa5392d3-7dda-4655-93a4-a28af79cf424 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:33.428189 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fa5392d3-7dda-4655-93a4-a28af79cf424 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:33.428906 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fa5392d3-7dda-4655-93a4-a28af79cf424 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:33.429880 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fa5392d3-7dda-4655-93a4-a28af79cf424 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:33.431020 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fa5392d3-7dda-4655-93a4-a28af79cf424 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:33.431691 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fa5392d3-7dda-4655-93a4-a28af79cf424 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:33.560786 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-fa5392d3-7dda-4655-93a4-a28af79cf424 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfec6c2f34f94d66ab1cc982c5bb5bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256b67be18c246b186e09a313db08a7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:33.570578 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-fa5392d3-7dda-4655-93a4-a28af79cf424 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] 10.222.0.70 "GET /compute/v2.1/servers/a00dd6f6-d48c-4938-84b1-71bec3877ad9" status: 200 len: 1614 microversion: 2.1 time: 0.160632 Aug 27 02:47:33.571627 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 855/1702] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:33 2022] GET /compute/v2.1/servers/a00dd6f6-d48c-4938-84b1-71bec3877ad9 => generated 1614 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:47:34.049178 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-7f1c8fc4-e562-4370-86a6-97f090cfac85 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:34.050599 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-7f1c8fc4-e562-4370-86a6-97f090cfac85 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 70acfe32-deea-46fc-a214-8fdbb9f6cb7b] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:34.064697 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7f1c8fc4-e562-4370-86a6-97f090cfac85 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:34.066371 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7f1c8fc4-e562-4370-86a6-97f090cfac85 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:34.067885 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7f1c8fc4-e562-4370-86a6-97f090cfac85 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:34.068985 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7f1c8fc4-e562-4370-86a6-97f090cfac85 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:34.069697 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7f1c8fc4-e562-4370-86a6-97f090cfac85 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:34.070348 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7f1c8fc4-e562-4370-86a6-97f090cfac85 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:34.287639 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ce47c84d-78ce-40d2-9d09-859588f6ea56 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:34.288277 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-ce47c84d-78ce-40d2-9d09-859588f6ea56 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] [instance: 9d7f8c37-c4a6-400e-9a02-94f9040b780e] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:34.300964 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ce47c84d-78ce-40d2-9d09-859588f6ea56 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:34.302924 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ce47c84d-78ce-40d2-9d09-859588f6ea56 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:34.304067 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ce47c84d-78ce-40d2-9d09-859588f6ea56 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:34.308110 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ce47c84d-78ce-40d2-9d09-859588f6ea56 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:34.309362 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ce47c84d-78ce-40d2-9d09-859588f6ea56 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:34.312609 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ce47c84d-78ce-40d2-9d09-859588f6ea56 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:34.556691 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-ce47c84d-78ce-40d2-9d09-859588f6ea56 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d626281a9864fe7aed598d4be209137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ae1f9ee6b7e49849b68b3628b76766a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:34.567904 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ce47c84d-78ce-40d2-9d09-859588f6ea56 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] 10.222.0.70 "GET /compute/v2.1/servers/9d7f8c37-c4a6-400e-9a02-94f9040b780e" status: 200 len: 1275 microversion: 2.1 time: 0.284179 Aug 27 02:47:34.587246 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 856/1703] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:34 2022] GET /compute/v2.1/servers/9d7f8c37-c4a6-400e-9a02-94f9040b780e => generated 1275 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:34.595974 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d163ca11-d97c-4e86-ae5d-202f6679858c tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:34.597432 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d163ca11-d97c-4e86-ae5d-202f6679858c tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] [instance: d2020ea3-b05b-47ca-b9a1-950c028db483] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:34.604179 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d163ca11-d97c-4e86-ae5d-202f6679858c tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:34.604979 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d163ca11-d97c-4e86-ae5d-202f6679858c tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:34.605596 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d163ca11-d97c-4e86-ae5d-202f6679858c tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:34.608262 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d163ca11-d97c-4e86-ae5d-202f6679858c tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:34.609763 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d163ca11-d97c-4e86-ae5d-202f6679858c tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:34.610794 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d163ca11-d97c-4e86-ae5d-202f6679858c tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:34.804129 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-7f1c8fc4-e562-4370-86a6-97f090cfac85 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:34.817051 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-7f1c8fc4-e562-4370-86a6-97f090cfac85 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b" status: 200 len: 1386 microversion: 2.1 time: 0.781622 Aug 27 02:47:34.832437 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 848/1704] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:34 2022] GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b => generated 1386 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:34.839433 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-24c97ecf-67d3-4395-9915-278d8e1a5185 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:34.840515 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-24c97ecf-67d3-4395-9915-278d8e1a5185 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] [instance: a00dd6f6-d48c-4938-84b1-71bec3877ad9] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:34.850097 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-24c97ecf-67d3-4395-9915-278d8e1a5185 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:34.851050 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-24c97ecf-67d3-4395-9915-278d8e1a5185 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:34.852610 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-24c97ecf-67d3-4395-9915-278d8e1a5185 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:34.853717 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-24c97ecf-67d3-4395-9915-278d8e1a5185 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:34.854404 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-24c97ecf-67d3-4395-9915-278d8e1a5185 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:34.855083 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-24c97ecf-67d3-4395-9915-278d8e1a5185 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:35.065480 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-24c97ecf-67d3-4395-9915-278d8e1a5185 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfec6c2f34f94d66ab1cc982c5bb5bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256b67be18c246b186e09a313db08a7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:35.075029 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-24c97ecf-67d3-4395-9915-278d8e1a5185 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] 10.222.0.70 "GET /compute/v2.1/servers/a00dd6f6-d48c-4938-84b1-71bec3877ad9" status: 200 len: 1614 microversion: 2.1 time: 0.240238 Aug 27 02:47:35.075835 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 849/1705] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:34 2022] GET /compute/v2.1/servers/a00dd6f6-d48c-4938-84b1-71bec3877ad9 => generated 1614 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:35.202715 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d163ca11-d97c-4e86-ae5d-202f6679858c tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a724314a34d2477cac222eeba100840b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b7c879ef5f4e5e8204433a06bdd370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:35.214161 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d163ca11-d97c-4e86-ae5d-202f6679858c tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] 10.222.0.70 "GET /compute/v2.1/servers/d2020ea3-b05b-47ca-b9a1-950c028db483" status: 200 len: 1502 microversion: 2.1 time: 0.625323 Aug 27 02:47:35.223862 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 857/1706] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:34 2022] GET /compute/v2.1/servers/d2020ea3-b05b-47ca-b9a1-950c028db483 => generated 1502 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:35.239947 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-dd78c1fc-7d9c-48ec-bb84-4d45f41ee00c tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:35.241933 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-dd78c1fc-7d9c-48ec-bb84-4d45f41ee00c tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] [instance: d2020ea3-b05b-47ca-b9a1-950c028db483] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:35.252560 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dd78c1fc-7d9c-48ec-bb84-4d45f41ee00c tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:35.254118 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dd78c1fc-7d9c-48ec-bb84-4d45f41ee00c tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:35.254816 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dd78c1fc-7d9c-48ec-bb84-4d45f41ee00c tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:35.256331 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dd78c1fc-7d9c-48ec-bb84-4d45f41ee00c tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:35.257603 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dd78c1fc-7d9c-48ec-bb84-4d45f41ee00c tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:35.258242 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dd78c1fc-7d9c-48ec-bb84-4d45f41ee00c tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:35.293097 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-dd78c1fc-7d9c-48ec-bb84-4d45f41ee00c tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] [instance: d2020ea3-b05b-47ca-b9a1-950c028db483] Going to try to terminate instance {{(pid=134052) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:47:35.395766 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-29925a6e-6fa6-4445-9751-ada1b541d9ad req-aed93ded-da3c-428d-99c2-3ec490b837ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a00dd6f6-d48c-4938-84b1-71bec3877ad9", "name": "network-vif-deleted", "tag": "829c63ac-805f-401e-b2ab-43eae4e821bb"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:47:35.420108 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-29925a6e-6fa6-4445-9751-ada1b541d9ad req-aed93ded-da3c-428d-99c2-3ec490b837ee service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:35.420957 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-29925a6e-6fa6-4445-9751-ada1b541d9ad req-aed93ded-da3c-428d-99c2-3ec490b837ee service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:35.421595 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-29925a6e-6fa6-4445-9751-ada1b541d9ad req-aed93ded-da3c-428d-99c2-3ec490b837ee service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:35.451082 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-29925a6e-6fa6-4445-9751-ada1b541d9ad req-aed93ded-da3c-428d-99c2-3ec490b837ee service nova] Creating event network-vif-deleted:829c63ac-805f-401e-b2ab-43eae4e821bb for instance a00dd6f6-d48c-4938-84b1-71bec3877ad9 on n-h2-852278-4 Aug 27 02:47:35.464368 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-29925a6e-6fa6-4445-9751-ada1b541d9ad req-aed93ded-da3c-428d-99c2-3ec490b837ee service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080552 Aug 27 02:47:35.466139 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 858/1707] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:47:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:47:35.470244 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:47:35.520424 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-dd78c1fc-7d9c-48ec-bb84-4d45f41ee00c tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] 10.222.0.70 "DELETE /compute/v2.1/servers/d2020ea3-b05b-47ca-b9a1-950c028db483" status: 204 len: 0 microversion: 2.1 time: 0.286458 Aug 27 02:47:35.525836 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 850/1708] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:47:35 2022] DELETE /compute/v2.1/servers/d2020ea3-b05b-47ca-b9a1-950c028db483 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:47:35.531639 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-2bca42a0-816e-4578-a3d9-c53ac573f6cb tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:35.532368 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-2bca42a0-816e-4578-a3d9-c53ac573f6cb tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] [instance: d2020ea3-b05b-47ca-b9a1-950c028db483] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:35.540059 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2bca42a0-816e-4578-a3d9-c53ac573f6cb tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:35.540582 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2bca42a0-816e-4578-a3d9-c53ac573f6cb tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:35.541220 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2bca42a0-816e-4578-a3d9-c53ac573f6cb tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:35.542106 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2bca42a0-816e-4578-a3d9-c53ac573f6cb tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:35.542725 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2bca42a0-816e-4578-a3d9-c53ac573f6cb tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:35.543314 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2bca42a0-816e-4578-a3d9-c53ac573f6cb tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:35.602262 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-69767dcb-47e2-40db-9e6d-eac2f430b212 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:35.603535 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-69767dcb-47e2-40db-9e6d-eac2f430b212 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] [instance: 9d7f8c37-c4a6-400e-9a02-94f9040b780e] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:35.658884 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-69767dcb-47e2-40db-9e6d-eac2f430b212 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:35.661246 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-69767dcb-47e2-40db-9e6d-eac2f430b212 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:35.662549 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-69767dcb-47e2-40db-9e6d-eac2f430b212 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:35.663519 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-69767dcb-47e2-40db-9e6d-eac2f430b212 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:35.664190 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-69767dcb-47e2-40db-9e6d-eac2f430b212 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:35.665730 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-69767dcb-47e2-40db-9e6d-eac2f430b212 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:36.021997 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=4 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:47:36.067772 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=14 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:47:36.178420 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-69767dcb-47e2-40db-9e6d-eac2f430b212 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d626281a9864fe7aed598d4be209137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ae1f9ee6b7e49849b68b3628b76766a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:36.189770 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-69767dcb-47e2-40db-9e6d-eac2f430b212 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] 10.222.0.70 "GET /compute/v2.1/servers/9d7f8c37-c4a6-400e-9a02-94f9040b780e" status: 200 len: 1317 microversion: 2.1 time: 0.592878 Aug 27 02:47:36.192696 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 851/1709] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:35 2022] GET /compute/v2.1/servers/9d7f8c37-c4a6-400e-9a02-94f9040b780e => generated 1317 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:36.205103 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-d7206dd0-3dd5-49d9-a033-616503bfb34a req-a6f9c2a8-1795-4467-8fdf-f54652bf09fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70acfe32-deea-46fc-a214-8fdbb9f6cb7b", "name": "network-vif-deleted", "tag": "2644ae8b-0546-435d-ae4e-79c3fb9a12cc"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:47:36.232465 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-d7206dd0-3dd5-49d9-a033-616503bfb34a req-a6f9c2a8-1795-4467-8fdf-f54652bf09fe service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:36.233085 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-d7206dd0-3dd5-49d9-a033-616503bfb34a req-a6f9c2a8-1795-4467-8fdf-f54652bf09fe service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:36.233531 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-d7206dd0-3dd5-49d9-a033-616503bfb34a req-a6f9c2a8-1795-4467-8fdf-f54652bf09fe service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:36.234027 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-2bca42a0-816e-4578-a3d9-c53ac573f6cb tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a724314a34d2477cac222eeba100840b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b7c879ef5f4e5e8204433a06bdd370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:36.243275 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-2bca42a0-816e-4578-a3d9-c53ac573f6cb tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] 10.222.0.70 "GET /compute/v2.1/servers/d2020ea3-b05b-47ca-b9a1-950c028db483" status: 200 len: 1508 microversion: 2.1 time: 0.716001 Aug 27 02:47:36.249868 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-d7206dd0-3dd5-49d9-a033-616503bfb34a req-a6f9c2a8-1795-4467-8fdf-f54652bf09fe service nova] Creating event network-vif-deleted:2644ae8b-0546-435d-ae4e-79c3fb9a12cc for instance 70acfe32-deea-46fc-a214-8fdbb9f6cb7b on n-h1-852278-4 Aug 27 02:47:36.251026 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 859/1710] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:35 2022] GET /compute/v2.1/servers/d2020ea3-b05b-47ca-b9a1-950c028db483 => generated 1508 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:36.264578 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7c6d26f1-bdf1-43db-a08c-8c912355c148 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:36.265405 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-7c6d26f1-bdf1-43db-a08c-8c912355c148 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 70acfe32-deea-46fc-a214-8fdbb9f6cb7b] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:36.265830 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-d7206dd0-3dd5-49d9-a033-616503bfb34a req-a6f9c2a8-1795-4467-8fdf-f54652bf09fe service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069853 Aug 27 02:47:36.266958 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 852/1711] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:47:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:47:36.274716 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c3d5cc78-78c0-429a-9e3e-0f5ce06898c2 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:36.275922 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-c3d5cc78-78c0-429a-9e3e-0f5ce06898c2 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] [instance: a00dd6f6-d48c-4938-84b1-71bec3877ad9] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:36.278919 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7c6d26f1-bdf1-43db-a08c-8c912355c148 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:36.279531 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7c6d26f1-bdf1-43db-a08c-8c912355c148 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:36.280328 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7c6d26f1-bdf1-43db-a08c-8c912355c148 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:36.281416 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7c6d26f1-bdf1-43db-a08c-8c912355c148 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:36.282100 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7c6d26f1-bdf1-43db-a08c-8c912355c148 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:36.282835 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7c6d26f1-bdf1-43db-a08c-8c912355c148 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:36.283503 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c3d5cc78-78c0-429a-9e3e-0f5ce06898c2 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:36.284195 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c3d5cc78-78c0-429a-9e3e-0f5ce06898c2 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:36.284714 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c3d5cc78-78c0-429a-9e3e-0f5ce06898c2 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:36.285893 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c3d5cc78-78c0-429a-9e3e-0f5ce06898c2 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:36.286509 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c3d5cc78-78c0-429a-9e3e-0f5ce06898c2 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:36.287092 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c3d5cc78-78c0-429a-9e3e-0f5ce06898c2 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:36.365588 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c3d5cc78-78c0-429a-9e3e-0f5ce06898c2 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:36.366072 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c3d5cc78-78c0-429a-9e3e-0f5ce06898c2 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:36.366501 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c3d5cc78-78c0-429a-9e3e-0f5ce06898c2 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:36.373492 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.instance [None req-c3d5cc78-78c0-429a-9e3e-0f5ce06898c2 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lazy-loading 'fault' on Instance uuid a00dd6f6-d48c-4938-84b1-71bec3877ad9 {{(pid=134052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:47:36.477294 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-c3d5cc78-78c0-429a-9e3e-0f5ce06898c2 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfec6c2f34f94d66ab1cc982c5bb5bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256b67be18c246b186e09a313db08a7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:36.486097 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-7c6d26f1-bdf1-43db-a08c-8c912355c148 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:36.499607 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-7c6d26f1-bdf1-43db-a08c-8c912355c148 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b" status: 200 len: 1344 microversion: 2.1 time: 0.247322 Aug 27 02:47:36.500598 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 860/1712] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:36 2022] GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b => generated 1344 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:36.502682 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c3d5cc78-78c0-429a-9e3e-0f5ce06898c2 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] 10.222.0.70 "GET /compute/v2.1/servers/a00dd6f6-d48c-4938-84b1-71bec3877ad9" status: 200 len: 1332 microversion: 2.1 time: 0.233256 Aug 27 02:47:36.522090 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 853/1713] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:36 2022] GET /compute/v2.1/servers/a00dd6f6-d48c-4938-84b1-71bec3877ad9 => generated 1332 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:37.213306 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-503fb773-6304-4cec-91a1-fbd3c4a72bfa tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:37.214199 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-503fb773-6304-4cec-91a1-fbd3c4a72bfa tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] [instance: 9d7f8c37-c4a6-400e-9a02-94f9040b780e] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:37.216641 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:47:37.233450 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-503fb773-6304-4cec-91a1-fbd3c4a72bfa tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:37.234251 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-503fb773-6304-4cec-91a1-fbd3c4a72bfa tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:37.234844 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-503fb773-6304-4cec-91a1-fbd3c4a72bfa tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:37.235712 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-503fb773-6304-4cec-91a1-fbd3c4a72bfa tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:37.236447 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-503fb773-6304-4cec-91a1-fbd3c4a72bfa tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:37.237050 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-503fb773-6304-4cec-91a1-fbd3c4a72bfa tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:37.275733 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-72aa56ee-999d-4dc0-8021-51cd17e79a4b tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:37.281188 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-72aa56ee-999d-4dc0-8021-51cd17e79a4b tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] [instance: d2020ea3-b05b-47ca-b9a1-950c028db483] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:37.299660 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-72aa56ee-999d-4dc0-8021-51cd17e79a4b tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:37.310674 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-72aa56ee-999d-4dc0-8021-51cd17e79a4b tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:37.311613 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-72aa56ee-999d-4dc0-8021-51cd17e79a4b tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:37.314818 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-72aa56ee-999d-4dc0-8021-51cd17e79a4b tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:37.328378 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-72aa56ee-999d-4dc0-8021-51cd17e79a4b tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:37.330838 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-72aa56ee-999d-4dc0-8021-51cd17e79a4b tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:37.677201 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=8 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:47:38.026714 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-72aa56ee-999d-4dc0-8021-51cd17e79a4b tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a724314a34d2477cac222eeba100840b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b7c879ef5f4e5e8204433a06bdd370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:38.038349 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-72aa56ee-999d-4dc0-8021-51cd17e79a4b tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] 10.222.0.70 "GET /compute/v2.1/servers/d2020ea3-b05b-47ca-b9a1-950c028db483" status: 200 len: 1508 microversion: 2.1 time: 0.768622 Aug 27 02:47:38.056873 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 854/1714] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:37 2022] GET /compute/v2.1/servers/d2020ea3-b05b-47ca-b9a1-950c028db483 => generated 1508 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:38.065215 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-503fb773-6304-4cec-91a1-fbd3c4a72bfa tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d626281a9864fe7aed598d4be209137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ae1f9ee6b7e49849b68b3628b76766a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:38.078037 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-91fbe747-48ce-43e7-b233-7712b9374c9b tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:38.083179 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-91fbe747-48ce-43e7-b233-7712b9374c9b tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 70acfe32-deea-46fc-a214-8fdbb9f6cb7b] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:38.085252 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-503fb773-6304-4cec-91a1-fbd3c4a72bfa tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] 10.222.0.70 "GET /compute/v2.1/servers/9d7f8c37-c4a6-400e-9a02-94f9040b780e" status: 200 len: 1317 microversion: 2.1 time: 0.876398 Aug 27 02:47:38.089133 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 861/1715] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:37 2022] GET /compute/v2.1/servers/9d7f8c37-c4a6-400e-9a02-94f9040b780e => generated 1317 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:38.102050 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ac10e650-c51d-4912-a748-a9446fd79323 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:38.103153 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-ac10e650-c51d-4912-a748-a9446fd79323 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] [instance: a00dd6f6-d48c-4938-84b1-71bec3877ad9] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:38.109131 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-91fbe747-48ce-43e7-b233-7712b9374c9b tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:38.112593 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-91fbe747-48ce-43e7-b233-7712b9374c9b tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:38.113528 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-91fbe747-48ce-43e7-b233-7712b9374c9b tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:38.114938 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-91fbe747-48ce-43e7-b233-7712b9374c9b tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:38.117044 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-91fbe747-48ce-43e7-b233-7712b9374c9b tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:38.118056 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-91fbe747-48ce-43e7-b233-7712b9374c9b tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:38.140663 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ac10e650-c51d-4912-a748-a9446fd79323 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:38.141626 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ac10e650-c51d-4912-a748-a9446fd79323 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:38.150865 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ac10e650-c51d-4912-a748-a9446fd79323 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:38.151663 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ac10e650-c51d-4912-a748-a9446fd79323 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:38.156518 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ac10e650-c51d-4912-a748-a9446fd79323 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:38.157173 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ac10e650-c51d-4912-a748-a9446fd79323 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:38.238636 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-ac10e650-c51d-4912-a748-a9446fd79323 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] HTTP exception thrown: Instance a00dd6f6-d48c-4938-84b1-71bec3877ad9 could not be found. Aug 27 02:47:38.245932 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ac10e650-c51d-4912-a748-a9446fd79323 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Request method failure captured: Aug 27 02:47:38.245932 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/a00dd6f6-d48c-4938-84b1-71bec3877ad9 HTTP/1.1 Aug 27 02:47:38.245932 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:47:38.245932 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:47:38.245932 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:47:38.245932 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:47:38.245932 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:47:38.245932 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:47:38.245932 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:47:38.245932 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:47:38.245932 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYUGW-QtHaDyo8GEvWt2qOPgKN9lXPrnUts4oX-PBnorCZOvaTvczxcR_AQmyu4AI76ZdAb5EKuXDwaiHrCf0myU5jfDldRq3vUJdY4w1TYK43bzYSZ1pGkCs9KmqHwsl6vBDqbEnyf5AMfNJL_gvr1_ITR5TI59ASOZr4Pm-5dM7ac Aug 27 02:47:38.245932 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:47:38.245932 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:47:38.245932 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:47:38.245932 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:47:38.245932 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:47:38.245932 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:47:38.245932 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 256b67be18c246b186e09a313db08a7e Aug 27 02:47:38.245932 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-VolumesAdminNegativeTest-976590270 Aug 27 02:47:38.245932 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:47:38.245932 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:47:38.248235 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/256b67be18c246b186e09a313db08a7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_256b67be18c246b186e09a313db08a7e", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/256b67be18c246b186e09a313db08a7e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/256b67be18c246b186e09a313db08a7e"}]}] Aug 27 02:47:38.248235 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-VolumesAdminNegativeTest-976590270 Aug 27 02:47:38.248235 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 256b67be18c246b186e09a313db08a7e Aug 27 02:47:38.248235 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-976590270 Aug 27 02:47:38.248235 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-VolumesAdminNegativeTest-976590270-project Aug 27 02:47:38.248235 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:47:38.248235 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:47:38.248235 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: cfec6c2f34f94d66ab1cc982c5bb5bbd Aug 27 02:47:38.248235 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-VolumesAdminNegativeTest-976590270-project Aug 27 02:47:38.248235 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 02:47:38.248235 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance a00dd6f6-d48c-4938-84b1-71bec3877ad9 could not be found. Aug 27 02:47:38.248235 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': 'a00dd6f6-d48c-4938-84b1-71bec3877ad9'} Aug 27 02:47:38.249450 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:47:38.249450 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:47:38.249450 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:47:38.249450 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:47:38.249450 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:47:38.249450 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:47:38.249450 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:47:38.249450 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:47:38.249450 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:47:38.249450 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:47:38.249450 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a00dd6f6-d48c-4938-84b1-71bec3877ad9 could not be found. Aug 27 02:47:38.249450 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:47:38.249450 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:47:38.249450 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:47:38.249450 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:47:38.249450 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:47:38.249450 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:47:38.249450 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:47:38.249450 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:47:38.249450 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:47:38.251360 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:47:38.251360 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:47:38.251360 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:47:38.251360 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:47:38.251360 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:47:38.251360 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:47:38.251360 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:47:38.251360 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a00dd6f6-d48c-4938-84b1-71bec3877ad9 could not be found. Aug 27 02:47:38.251360 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:47:38.251360 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:47:38.251360 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:47:38.251360 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:47:38.251360 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:47:38.251360 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:47:38.251360 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:47:38.251360 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:47:38.251360 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a00dd6f6-d48c-4938-84b1-71bec3877ad9 could not be found. Aug 27 02:47:38.251360 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:47:38.257113 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ac10e650-c51d-4912-a748-a9446fd79323 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Returning 404 to user: Instance a00dd6f6-d48c-4938-84b1-71bec3877ad9 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:47:38.259016 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ac10e650-c51d-4912-a748-a9446fd79323 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] 10.222.0.70 "GET /compute/v2.1/servers/a00dd6f6-d48c-4938-84b1-71bec3877ad9" status: 404 len: 111 microversion: 2.1 time: 0.167532 Aug 27 02:47:38.263447 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 862/1716] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:38 2022] GET /compute/v2.1/servers/a00dd6f6-d48c-4938-84b1-71bec3877ad9 => generated 111 bytes in 172 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:47:38.291834 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-c9e03907-f72e-4c29-9593-f3a6def01f89 req-5ddb242f-37b3-4f74-9a3b-ede4d5e2ae32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "191df585-2175-47be-9bd8-29b914535f47", "tag": "178a305e-f6ec-4889-9602-1513853a515b"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:47:38.331781 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-c9e03907-f72e-4c29-9593-f3a6def01f89 req-5ddb242f-37b3-4f74-9a3b-ede4d5e2ae32 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:38.332266 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-c9e03907-f72e-4c29-9593-f3a6def01f89 req-5ddb242f-37b3-4f74-9a3b-ede4d5e2ae32 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:38.332725 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-c9e03907-f72e-4c29-9593-f3a6def01f89 req-5ddb242f-37b3-4f74-9a3b-ede4d5e2ae32 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:38.388110 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-c9e03907-f72e-4c29-9593-f3a6def01f89 req-5ddb242f-37b3-4f74-9a3b-ede4d5e2ae32 service nova] Creating event network-changed:178a305e-f6ec-4889-9602-1513853a515b for instance 191df585-2175-47be-9bd8-29b914535f47 on n-h2-852278-4 Aug 27 02:47:38.397989 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-c9e03907-f72e-4c29-9593-f3a6def01f89 req-5ddb242f-37b3-4f74-9a3b-ede4d5e2ae32 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131416 Aug 27 02:47:38.409046 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 863/1717] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:47:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:47:38.425264 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-288b8305-08a1-4afd-be75-ece72465e256 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] Calling method '.version_select at 0x7f5edfa2eb80>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:38.463050 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-91fbe747-48ce-43e7-b233-7712b9374c9b tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:38.489206 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-288b8305-08a1-4afd-be75-ece72465e256 tempest-VolumesAdminNegativeTest-976590270 tempest-VolumesAdminNegativeTest-976590270-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1418880326" status: 202 len: 0 microversion: 2.1 time: 0.078504 Aug 27 02:47:38.489925 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 864/1718] 10.222.0.70 () {58 vars in 1221 bytes} [Sat Aug 27 02:47:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1418880326 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:47:38.499119 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-91fbe747-48ce-43e7-b233-7712b9374c9b tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b" status: 200 len: 1182 microversion: 2.1 time: 0.434067 Aug 27 02:47:38.515540 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 855/1719] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:38 2022] GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b => generated 1182 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:39.069101 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-064233e5-269b-41c7-9356-981309a4bd6e tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:39.070512 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-064233e5-269b-41c7-9356-981309a4bd6e tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] [instance: d2020ea3-b05b-47ca-b9a1-950c028db483] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:39.078527 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-064233e5-269b-41c7-9356-981309a4bd6e tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:39.079289 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-064233e5-269b-41c7-9356-981309a4bd6e tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:39.079942 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-064233e5-269b-41c7-9356-981309a4bd6e tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:39.080956 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-064233e5-269b-41c7-9356-981309a4bd6e tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:39.081598 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-064233e5-269b-41c7-9356-981309a4bd6e tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:39.082203 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-064233e5-269b-41c7-9356-981309a4bd6e tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:39.110747 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-7647e962-00d3-4714-adc5-564163d7ca99 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:39.111368 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-7647e962-00d3-4714-adc5-564163d7ca99 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] [instance: 9d7f8c37-c4a6-400e-9a02-94f9040b780e] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:39.145256 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7647e962-00d3-4714-adc5-564163d7ca99 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:39.146984 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7647e962-00d3-4714-adc5-564163d7ca99 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:39.147606 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7647e962-00d3-4714-adc5-564163d7ca99 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:39.148687 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7647e962-00d3-4714-adc5-564163d7ca99 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:39.149322 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7647e962-00d3-4714-adc5-564163d7ca99 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:39.150019 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7647e962-00d3-4714-adc5-564163d7ca99 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:39.190212 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-064233e5-269b-41c7-9356-981309a4bd6e tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a724314a34d2477cac222eeba100840b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b7c879ef5f4e5e8204433a06bdd370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:39.202237 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-064233e5-269b-41c7-9356-981309a4bd6e tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] 10.222.0.70 "GET /compute/v2.1/servers/d2020ea3-b05b-47ca-b9a1-950c028db483" status: 200 len: 1466 microversion: 2.1 time: 0.137051 Aug 27 02:47:39.205462 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 865/1720] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:39 2022] GET /compute/v2.1/servers/d2020ea3-b05b-47ca-b9a1-950c028db483 => generated 1466 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:47:39.436275 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-e6167843-6188-4cd2-af7f-7a6e1a40260c req-94488488-3e02-4dc3-b031-921d05de34e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2020ea3-b05b-47ca-b9a1-950c028db483", "name": "network-vif-deleted", "tag": "276f206e-96b1-41f8-a246-bfeb80b199fe"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:47:39.456634 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-e6167843-6188-4cd2-af7f-7a6e1a40260c req-94488488-3e02-4dc3-b031-921d05de34e6 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:39.457431 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-e6167843-6188-4cd2-af7f-7a6e1a40260c req-94488488-3e02-4dc3-b031-921d05de34e6 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:39.458112 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-e6167843-6188-4cd2-af7f-7a6e1a40260c req-94488488-3e02-4dc3-b031-921d05de34e6 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:39.468054 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-7647e962-00d3-4714-adc5-564163d7ca99 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d626281a9864fe7aed598d4be209137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ae1f9ee6b7e49849b68b3628b76766a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:39.481125 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-7647e962-00d3-4714-adc5-564163d7ca99 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] 10.222.0.70 "GET /compute/v2.1/servers/9d7f8c37-c4a6-400e-9a02-94f9040b780e" status: 200 len: 1317 microversion: 2.1 time: 0.374125 Aug 27 02:47:39.491081 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-e6167843-6188-4cd2-af7f-7a6e1a40260c req-94488488-3e02-4dc3-b031-921d05de34e6 service nova] Creating event network-vif-deleted:276f206e-96b1-41f8-a246-bfeb80b199fe for instance d2020ea3-b05b-47ca-b9a1-950c028db483 on n-h1-852278-4 Aug 27 02:47:39.501150 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 856/1721] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:39 2022] GET /compute/v2.1/servers/9d7f8c37-c4a6-400e-9a02-94f9040b780e => generated 1317 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:39.504883 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-e6167843-6188-4cd2-af7f-7a6e1a40260c req-94488488-3e02-4dc3-b031-921d05de34e6 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072853 Aug 27 02:47:39.514186 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 866/1722] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:47:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:47:39.524594 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-1e4e1208-5885-4777-a213-59298adb1b10 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:39.525439 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-1e4e1208-5885-4777-a213-59298adb1b10 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 70acfe32-deea-46fc-a214-8fdbb9f6cb7b] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:39.532599 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1e4e1208-5885-4777-a213-59298adb1b10 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:39.542062 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1e4e1208-5885-4777-a213-59298adb1b10 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:39.542711 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1e4e1208-5885-4777-a213-59298adb1b10 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:39.543559 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1e4e1208-5885-4777-a213-59298adb1b10 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:39.544116 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1e4e1208-5885-4777-a213-59298adb1b10 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:39.545891 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1e4e1208-5885-4777-a213-59298adb1b10 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:39.646333 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-1e4e1208-5885-4777-a213-59298adb1b10 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:39.675395 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-1e4e1208-5885-4777-a213-59298adb1b10 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b" status: 200 len: 1182 microversion: 2.1 time: 0.142401 Aug 27 02:47:39.675395 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 857/1723] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:39 2022] GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b => generated 1182 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:40.252953 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4e155085-dc11-4c67-9022-ee16180eefa8 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:40.259822 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-4e155085-dc11-4c67-9022-ee16180eefa8 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] [instance: d2020ea3-b05b-47ca-b9a1-950c028db483] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:40.289405 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4e155085-dc11-4c67-9022-ee16180eefa8 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:40.290491 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4e155085-dc11-4c67-9022-ee16180eefa8 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:40.290944 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4e155085-dc11-4c67-9022-ee16180eefa8 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:40.291841 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4e155085-dc11-4c67-9022-ee16180eefa8 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:40.295642 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4e155085-dc11-4c67-9022-ee16180eefa8 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:40.296349 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4e155085-dc11-4c67-9022-ee16180eefa8 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:40.504494 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4e155085-dc11-4c67-9022-ee16180eefa8 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:40.504976 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4e155085-dc11-4c67-9022-ee16180eefa8 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:40.505862 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4e155085-dc11-4c67-9022-ee16180eefa8 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:40.506482 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-7509dee2-1888-491d-905b-03b1d829a93c tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:40.507312 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-7509dee2-1888-491d-905b-03b1d829a93c tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] [instance: 9d7f8c37-c4a6-400e-9a02-94f9040b780e] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:40.508606 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.objects.instance [None req-4e155085-dc11-4c67-9022-ee16180eefa8 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Lazy-loading 'fault' on Instance uuid d2020ea3-b05b-47ca-b9a1-950c028db483 {{(pid=134051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:47:40.543843 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7509dee2-1888-491d-905b-03b1d829a93c tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:40.546088 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7509dee2-1888-491d-905b-03b1d829a93c tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:40.546548 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7509dee2-1888-491d-905b-03b1d829a93c tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:40.551607 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7509dee2-1888-491d-905b-03b1d829a93c tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:40.554114 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7509dee2-1888-491d-905b-03b1d829a93c tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:40.554720 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7509dee2-1888-491d-905b-03b1d829a93c tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:40.571085 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:47:40.663216 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-4e155085-dc11-4c67-9022-ee16180eefa8 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a724314a34d2477cac222eeba100840b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b7c879ef5f4e5e8204433a06bdd370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:40.675232 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-4e155085-dc11-4c67-9022-ee16180eefa8 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] 10.222.0.70 "GET /compute/v2.1/servers/d2020ea3-b05b-47ca-b9a1-950c028db483" status: 200 len: 1304 microversion: 2.1 time: 0.438896 Aug 27 02:47:40.680162 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 867/1724] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:40 2022] GET /compute/v2.1/servers/d2020ea3-b05b-47ca-b9a1-950c028db483 => generated 1304 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:40.691609 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-466bd375-d775-4802-8c43-a07ccc290602 req-fed5603e-f325-453e-be14-65de3112a201 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d7f8c37-c4a6-400e-9a02-94f9040b780e", "tag": "545c57b0-4a40-4554-9d90-9ca7c0773d35"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:47:40.716446 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-466bd375-d775-4802-8c43-a07ccc290602 req-fed5603e-f325-453e-be14-65de3112a201 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:40.719460 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-466bd375-d775-4802-8c43-a07ccc290602 req-fed5603e-f325-453e-be14-65de3112a201 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:40.721150 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-466bd375-d775-4802-8c43-a07ccc290602 req-fed5603e-f325-453e-be14-65de3112a201 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:40.742630 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-466bd375-d775-4802-8c43-a07ccc290602 req-fed5603e-f325-453e-be14-65de3112a201 service nova] Creating event network-changed:545c57b0-4a40-4554-9d90-9ca7c0773d35 for instance 9d7f8c37-c4a6-400e-9a02-94f9040b780e on n-h2-852278-4 Aug 27 02:47:40.748293 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-466bd375-d775-4802-8c43-a07ccc290602 req-fed5603e-f325-453e-be14-65de3112a201 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066348 Aug 27 02:47:40.749529 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 868/1725] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:47:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:47:40.756357 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f3b8ec1a-57c9-4b36-9bc8-4ac6a4fd0fee tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:40.757412 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-f3b8ec1a-57c9-4b36-9bc8-4ac6a4fd0fee tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 70acfe32-deea-46fc-a214-8fdbb9f6cb7b] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:40.766064 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f3b8ec1a-57c9-4b36-9bc8-4ac6a4fd0fee tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:40.766832 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f3b8ec1a-57c9-4b36-9bc8-4ac6a4fd0fee tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:40.767507 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f3b8ec1a-57c9-4b36-9bc8-4ac6a4fd0fee tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:40.770561 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f3b8ec1a-57c9-4b36-9bc8-4ac6a4fd0fee tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:40.771303 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f3b8ec1a-57c9-4b36-9bc8-4ac6a4fd0fee tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:40.771999 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f3b8ec1a-57c9-4b36-9bc8-4ac6a4fd0fee tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:41.887827 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-f3b8ec1a-57c9-4b36-9bc8-4ac6a4fd0fee tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:41.899775 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-f3b8ec1a-57c9-4b36-9bc8-4ac6a4fd0fee tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b" status: 200 len: 1182 microversion: 2.1 time: 1.146824 Aug 27 02:47:41.903967 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 869/1726] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:40 2022] GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b => generated 1182 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:41.914775 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-2e82c059-f4f9-416c-923d-7bc6ce7f30d4 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:41.915393 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-2e82c059-f4f9-416c-923d-7bc6ce7f30d4 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] [instance: 484e03a9-aef3-4179-980c-0e7292a05b5a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:41.930653 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2e82c059-f4f9-416c-923d-7bc6ce7f30d4 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:41.931151 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2e82c059-f4f9-416c-923d-7bc6ce7f30d4 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:41.931596 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2e82c059-f4f9-416c-923d-7bc6ce7f30d4 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:41.932343 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2e82c059-f4f9-416c-923d-7bc6ce7f30d4 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:41.932792 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2e82c059-f4f9-416c-923d-7bc6ce7f30d4 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:41.933207 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2e82c059-f4f9-416c-923d-7bc6ce7f30d4 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:42.254626 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-7509dee2-1888-491d-905b-03b1d829a93c tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d626281a9864fe7aed598d4be209137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ae1f9ee6b7e49849b68b3628b76766a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:42.270051 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-7509dee2-1888-491d-905b-03b1d829a93c tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] 10.222.0.70 "GET /compute/v2.1/servers/9d7f8c37-c4a6-400e-9a02-94f9040b780e" status: 200 len: 1317 microversion: 2.1 time: 1.769939 Aug 27 02:47:42.296528 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 858/1727] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:40 2022] GET /compute/v2.1/servers/9d7f8c37-c4a6-400e-9a02-94f9040b780e => generated 1317 bytes in 1797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:47:42.309916 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d66bb7ec-a2af-4388-9ab0-136802f50b42 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:42.311443 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d66bb7ec-a2af-4388-9ab0-136802f50b42 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] [instance: d2020ea3-b05b-47ca-b9a1-950c028db483] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:42.328510 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d66bb7ec-a2af-4388-9ab0-136802f50b42 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:42.330365 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d66bb7ec-a2af-4388-9ab0-136802f50b42 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:42.331028 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d66bb7ec-a2af-4388-9ab0-136802f50b42 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:42.334067 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d66bb7ec-a2af-4388-9ab0-136802f50b42 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:42.334800 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d66bb7ec-a2af-4388-9ab0-136802f50b42 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:42.336266 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d66bb7ec-a2af-4388-9ab0-136802f50b42 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:42.381420 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-d66bb7ec-a2af-4388-9ab0-136802f50b42 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] HTTP exception thrown: Instance d2020ea3-b05b-47ca-b9a1-950c028db483 could not be found. Aug 27 02:47:42.388020 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d66bb7ec-a2af-4388-9ab0-136802f50b42 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Request method failure captured: Aug 27 02:47:42.388020 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/servers/d2020ea3-b05b-47ca-b9a1-950c028db483 HTTP/1.1 Aug 27 02:47:42.388020 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:47:42.388020 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:47:42.388020 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:47:42.388020 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:47:42.388020 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:47:42.388020 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:47:42.388020 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:47:42.388020 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:47:42.388020 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYWwbzAg0jdFU-TLMTCauW4UsKc6GTPHZ68EjHWr6fI61abEasCAwukOorAGc3NAaoB4tJFbzZj_7tyAplv-bvv6FqdvN1gbCGglfkABPxZ0Zz3pmKi6ibJW-yKhlG3wJpJp1fJo3XxNHeIdNheb_EPPAdc09wQsBHOili-F1kbLPDg Aug 27 02:47:42.388020 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:47:42.388020 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:47:42.388020 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:47:42.388020 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:47:42.388020 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:47:42.388020 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:47:42.388020 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 42b7c879ef5f4e5e8204433a06bdd370 Aug 27 02:47:42.388020 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ImagesNegativeTestJSON-1908428514 Aug 27 02:47:42.388020 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:47:42.388020 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:47:42.392198 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/42b7c879ef5f4e5e8204433a06bdd370"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_42b7c879ef5f4e5e8204433a06bdd370", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/42b7c879ef5f4e5e8204433a06bdd370"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/42b7c879ef5f4e5e8204433a06bdd370"}]}] Aug 27 02:47:42.392198 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ImagesNegativeTestJSON-1908428514 Aug 27 02:47:42.392198 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 42b7c879ef5f4e5e8204433a06bdd370 Aug 27 02:47:42.392198 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1908428514 Aug 27 02:47:42.392198 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ImagesNegativeTestJSON-1908428514-project Aug 27 02:47:42.392198 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:47:42.392198 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:47:42.392198 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: a724314a34d2477cac222eeba100840b Aug 27 02:47:42.392198 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ImagesNegativeTestJSON-1908428514-project Aug 27 02:47:42.392198 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 02:47:42.392198 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance d2020ea3-b05b-47ca-b9a1-950c028db483 could not be found. Aug 27 02:47:42.392198 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': 'd2020ea3-b05b-47ca-b9a1-950c028db483'} Aug 27 02:47:42.393507 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:47:42.393507 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:47:42.393507 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:47:42.393507 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:47:42.393507 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:47:42.393507 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:47:42.393507 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:47:42.393507 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:47:42.393507 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:47:42.393507 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:47:42.393507 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2020ea3-b05b-47ca-b9a1-950c028db483 could not be found. Aug 27 02:47:42.393507 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:47:42.393507 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:47:42.393507 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:47:42.393507 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:47:42.393507 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:47:42.393507 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:47:42.393507 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:47:42.393507 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:47:42.393507 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:47:42.396171 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:47:42.396171 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:47:42.396171 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:47:42.396171 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:47:42.396171 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:47:42.396171 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:47:42.396171 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:47:42.396171 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2020ea3-b05b-47ca-b9a1-950c028db483 could not be found. Aug 27 02:47:42.396171 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:47:42.396171 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:47:42.396171 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:47:42.396171 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:47:42.396171 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:47:42.396171 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:47:42.396171 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:47:42.396171 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:47:42.396171 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2020ea3-b05b-47ca-b9a1-950c028db483 could not be found. Aug 27 02:47:42.396171 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:47:42.403702 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d66bb7ec-a2af-4388-9ab0-136802f50b42 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Returning 404 to user: Instance d2020ea3-b05b-47ca-b9a1-950c028db483 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:47:42.408567 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d66bb7ec-a2af-4388-9ab0-136802f50b42 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] 10.222.0.70 "GET /compute/v2.1/servers/d2020ea3-b05b-47ca-b9a1-950c028db483" status: 404 len: 111 microversion: 2.1 time: 0.107774 Aug 27 02:47:42.410460 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 859/1728] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:42 2022] GET /compute/v2.1/servers/d2020ea3-b05b-47ca-b9a1-950c028db483 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:47:42.429641 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5dbe8310-9303-4ba4-b1ce-9410d4c3b651 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1267803279", "metadata": {"image_type": "test"}}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:47:42.438718 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-5dbe8310-9303-4ba4-b1ce-9410d4c3b651 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] [instance: d2020ea3-b05b-47ca-b9a1-950c028db483] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:42.457338 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5dbe8310-9303-4ba4-b1ce-9410d4c3b651 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:42.459244 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5dbe8310-9303-4ba4-b1ce-9410d4c3b651 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:42.460805 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5dbe8310-9303-4ba4-b1ce-9410d4c3b651 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:42.463865 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5dbe8310-9303-4ba4-b1ce-9410d4c3b651 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:42.465749 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5dbe8310-9303-4ba4-b1ce-9410d4c3b651 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:42.485026 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5dbe8310-9303-4ba4-b1ce-9410d4c3b651 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:42.539303 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-5dbe8310-9303-4ba4-b1ce-9410d4c3b651 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] HTTP exception thrown: Instance d2020ea3-b05b-47ca-b9a1-950c028db483 could not be found. Aug 27 02:47:42.547928 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5dbe8310-9303-4ba4-b1ce-9410d4c3b651 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Request method failure captured: Aug 27 02:47:42.547928 n-d-852278-4 devstack@n-api.service[134052]: request: POST /compute/v2.1/servers/d2020ea3-b05b-47ca-b9a1-950c028db483/action HTTP/1.1 Aug 27 02:47:42.547928 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:47:42.547928 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:47:42.547928 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:47:42.547928 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 112 Aug 27 02:47:42.547928 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:47:42.547928 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:47:42.547928 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:47:42.547928 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:47:42.547928 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYWwbzAg0jdFU-TLMTCauW4UsKc6GTPHZ68EjHWr6fI61abEasCAwukOorAGc3NAaoB4tJFbzZj_7tyAplv-bvv6FqdvN1gbCGglfkABPxZ0Zz3pmKi6ibJW-yKhlG3wJpJp1fJo3XxNHeIdNheb_EPPAdc09wQsBHOili-F1kbLPDg Aug 27 02:47:42.547928 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:47:42.547928 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:47:42.547928 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:47:42.547928 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:47:42.547928 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:47:42.547928 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:47:42.547928 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 42b7c879ef5f4e5e8204433a06bdd370 Aug 27 02:47:42.547928 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ImagesNegativeTestJSON-1908428514 Aug 27 02:47:42.547928 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:47:42.547928 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:47:42.549978 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/42b7c879ef5f4e5e8204433a06bdd370"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_42b7c879ef5f4e5e8204433a06bdd370", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/42b7c879ef5f4e5e8204433a06bdd370"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/42b7c879ef5f4e5e8204433a06bdd370"}]}] Aug 27 02:47:42.549978 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ImagesNegativeTestJSON-1908428514 Aug 27 02:47:42.549978 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 42b7c879ef5f4e5e8204433a06bdd370 Aug 27 02:47:42.549978 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1908428514 Aug 27 02:47:42.549978 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ImagesNegativeTestJSON-1908428514-project Aug 27 02:47:42.549978 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:47:42.549978 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:47:42.549978 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: a724314a34d2477cac222eeba100840b Aug 27 02:47:42.549978 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ImagesNegativeTestJSON-1908428514-project Aug 27 02:47:42.549978 n-d-852278-4 devstack@n-api.service[134052]: Aug 27 02:47:42.549978 n-d-852278-4 devstack@n-api.service[134052]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1267803279", "metadata": {"image_type": "test"}}} Aug 27 02:47:42.549978 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 02:47:42.550993 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance d2020ea3-b05b-47ca-b9a1-950c028db483 could not be found. Aug 27 02:47:42.550993 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': 'd2020ea3-b05b-47ca-b9a1-950c028db483', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1267803279', 'metadata': {'image_type': 'test'}}}} Aug 27 02:47:42.550993 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:47:42.550993 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:47:42.550993 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:47:42.550993 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:47:42.550993 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:47:42.550993 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:47:42.550993 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:47:42.550993 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:47:42.550993 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:47:42.550993 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:47:42.550993 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2020ea3-b05b-47ca-b9a1-950c028db483 could not be found. Aug 27 02:47:42.550993 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:47:42.550993 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:47:42.550993 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:47:42.550993 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:47:42.550993 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:47:42.550993 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:47:42.552694 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:47:42.552694 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:47:42.552694 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:47:42.552694 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:47:42.552694 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:47:42.552694 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:47:42.552694 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:47:42.552694 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:47:42.552694 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 27 02:47:42.552694 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 27 02:47:42.552694 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:47:42.552694 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:47:42.552694 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:47:42.552694 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:47:42.552694 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2020ea3-b05b-47ca-b9a1-950c028db483 could not be found. Aug 27 02:47:42.552694 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:47:42.552694 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:47:42.552694 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:47:42.552694 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:47:42.552694 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:47:42.554421 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:47:42.554421 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:47:42.554421 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:47:42.554421 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2020ea3-b05b-47ca-b9a1-950c028db483 could not be found. Aug 27 02:47:42.554421 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:47:42.554421 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5dbe8310-9303-4ba4-b1ce-9410d4c3b651 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Returning 404 to user: Instance d2020ea3-b05b-47ca-b9a1-950c028db483 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:47:42.555506 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-5dbe8310-9303-4ba4-b1ce-9410d4c3b651 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] 10.222.0.70 "POST /compute/v2.1/servers/d2020ea3-b05b-47ca-b9a1-950c028db483/action" status: 404 len: 111 microversion: 2.1 time: 0.138968 Aug 27 02:47:42.564567 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 860/1729] 10.222.0.70 () {60 vars in 1279 bytes} [Sat Aug 27 02:47:42 2022] POST /compute/v2.1/servers/d2020ea3-b05b-47ca-b9a1-950c028db483/action => generated 111 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:47:42.589342 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-34655c92-75cf-4ce8-9ff5-332895445024 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-673678585", "metadata": {"image_type": "test"}}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:47:42.597297 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-34655c92-75cf-4ce8-9ff5-332895445024 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Failed to fetch instance by id tempest-invalid-828264275 {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 27 02:47:42.597823 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-34655c92-75cf-4ce8-9ff5-332895445024 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] HTTP exception thrown: Instance tempest-invalid-828264275 could not be found. Aug 27 02:47:42.603360 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-34655c92-75cf-4ce8-9ff5-332895445024 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Request method failure captured: Aug 27 02:47:42.603360 n-d-852278-4 devstack@n-api.service[134052]: request: POST /compute/v2.1/servers/tempest-invalid-828264275/action HTTP/1.1 Aug 27 02:47:42.603360 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:47:42.603360 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:47:42.603360 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:47:42.603360 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 111 Aug 27 02:47:42.603360 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:47:42.603360 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:47:42.603360 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:47:42.603360 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:47:42.603360 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYWwbzAg0jdFU-TLMTCauW4UsKc6GTPHZ68EjHWr6fI61abEasCAwukOorAGc3NAaoB4tJFbzZj_7tyAplv-bvv6FqdvN1gbCGglfkABPxZ0Zz3pmKi6ibJW-yKhlG3wJpJp1fJo3XxNHeIdNheb_EPPAdc09wQsBHOili-F1kbLPDg Aug 27 02:47:42.603360 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:47:42.603360 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:47:42.603360 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:47:42.603360 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:47:42.603360 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:47:42.603360 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:47:42.603360 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 42b7c879ef5f4e5e8204433a06bdd370 Aug 27 02:47:42.603360 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ImagesNegativeTestJSON-1908428514 Aug 27 02:47:42.603360 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:47:42.603360 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:47:42.605849 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/42b7c879ef5f4e5e8204433a06bdd370"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_42b7c879ef5f4e5e8204433a06bdd370", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/42b7c879ef5f4e5e8204433a06bdd370"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/42b7c879ef5f4e5e8204433a06bdd370"}]}] Aug 27 02:47:42.605849 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ImagesNegativeTestJSON-1908428514 Aug 27 02:47:42.605849 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 42b7c879ef5f4e5e8204433a06bdd370 Aug 27 02:47:42.605849 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1908428514 Aug 27 02:47:42.605849 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ImagesNegativeTestJSON-1908428514-project Aug 27 02:47:42.605849 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:47:42.605849 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:47:42.605849 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: a724314a34d2477cac222eeba100840b Aug 27 02:47:42.605849 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ImagesNegativeTestJSON-1908428514-project Aug 27 02:47:42.605849 n-d-852278-4 devstack@n-api.service[134052]: Aug 27 02:47:42.605849 n-d-852278-4 devstack@n-api.service[134052]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-673678585", "metadata": {"image_type": "test"}}} Aug 27 02:47:42.605849 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 02:47:42.606890 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance tempest-invalid-828264275 could not be found. Aug 27 02:47:42.606890 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': 'tempest-invalid-828264275', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-673678585', 'metadata': {'image_type': 'test'}}}} Aug 27 02:47:42.606890 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:47:42.606890 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:47:42.606890 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:47:42.606890 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:47:42.606890 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 27 02:47:42.606890 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 27 02:47:42.606890 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-828264275 could not be found. Aug 27 02:47:42.606890 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:47:42.606890 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:47:42.606890 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:47:42.606890 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:47:42.606890 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:47:42.606890 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:47:42.606890 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:47:42.606890 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:47:42.606890 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:47:42.606890 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:47:42.606890 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:47:42.608349 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:47:42.608349 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:47:42.608349 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:47:42.608349 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 27 02:47:42.608349 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 27 02:47:42.608349 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:47:42.608349 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:47:42.608349 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:47:42.608349 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:47:42.608349 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-828264275 could not be found. Aug 27 02:47:42.608349 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:47:42.608349 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:47:42.608349 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:47:42.608349 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:47:42.608349 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:47:42.608349 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:47:42.608349 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:47:42.608349 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:47:42.608349 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-828264275 could not be found. Aug 27 02:47:42.608349 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:47:42.609801 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-34655c92-75cf-4ce8-9ff5-332895445024 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Returning 404 to user: Instance tempest-invalid-828264275 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:47:42.609801 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-34655c92-75cf-4ce8-9ff5-332895445024 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] 10.222.0.70 "POST /compute/v2.1/servers/tempest-invalid-828264275/action" status: 404 len: 100 microversion: 2.1 time: 0.025905 Aug 27 02:47:42.609801 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 861/1730] 10.222.0.70 () {60 vars in 1246 bytes} [Sat Aug 27 02:47:42 2022] POST /compute/v2.1/servers/tempest-invalid-828264275/action => generated 100 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:47:42.622135 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-69621ae7-5577-4e00-862e-0374f23d63f3 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1362331123"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:47:42.625926 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-69621ae7-5577-4e00-862e-0374f23d63f3 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 27 02:47:42.626446 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-69621ae7-5577-4e00-862e-0374f23d63f3 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 27 02:47:42.628063 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-69621ae7-5577-4e00-862e-0374f23d63f3 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Request method failure captured: Aug 27 02:47:42.628063 n-d-852278-4 devstack@n-api.service[134052]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Aug 27 02:47:42.628063 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:47:42.628063 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:47:42.628063 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:47:42.628063 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 57 Aug 27 02:47:42.628063 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:47:42.628063 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:47:42.628063 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:47:42.628063 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:47:42.628063 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYWwbzAg0jdFU-TLMTCauW4UsKc6GTPHZ68EjHWr6fI61abEasCAwukOorAGc3NAaoB4tJFbzZj_7tyAplv-bvv6FqdvN1gbCGglfkABPxZ0Zz3pmKi6ibJW-yKhlG3wJpJp1fJo3XxNHeIdNheb_EPPAdc09wQsBHOili-F1kbLPDg Aug 27 02:47:42.628063 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:47:42.628063 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:47:42.628063 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:47:42.628063 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:47:42.628063 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:47:42.628063 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:47:42.628063 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 42b7c879ef5f4e5e8204433a06bdd370 Aug 27 02:47:42.628063 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ImagesNegativeTestJSON-1908428514 Aug 27 02:47:42.628063 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:47:42.628063 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:47:42.630057 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/42b7c879ef5f4e5e8204433a06bdd370"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_42b7c879ef5f4e5e8204433a06bdd370", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/42b7c879ef5f4e5e8204433a06bdd370"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/42b7c879ef5f4e5e8204433a06bdd370"}]}] Aug 27 02:47:42.630057 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ImagesNegativeTestJSON-1908428514 Aug 27 02:47:42.630057 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 42b7c879ef5f4e5e8204433a06bdd370 Aug 27 02:47:42.630057 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1908428514 Aug 27 02:47:42.630057 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ImagesNegativeTestJSON-1908428514-project Aug 27 02:47:42.630057 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:47:42.630057 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:47:42.630057 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: a724314a34d2477cac222eeba100840b Aug 27 02:47:42.630057 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ImagesNegativeTestJSON-1908428514-project Aug 27 02:47:42.630057 n-d-852278-4 devstack@n-api.service[134052]: Aug 27 02:47:42.630057 n-d-852278-4 devstack@n-api.service[134052]: {"createImage": {"name": "tempest-test-snap-1362331123"}} Aug 27 02:47:42.630057 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 02:47:42.630057 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 27 02:47:42.631399 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1362331123'}}} Aug 27 02:47:42.631399 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:47:42.631399 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:47:42.631399 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:47:42.631399 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:47:42.631399 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 27 02:47:42.631399 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 27 02:47:42.631399 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 27 02:47:42.631399 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:47:42.631399 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:47:42.631399 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:47:42.631399 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:47:42.631399 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:47:42.631399 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:47:42.631399 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:47:42.631399 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:47:42.631399 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:47:42.631399 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:47:42.631399 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:47:42.631399 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:47:42.633219 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:47:42.633219 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:47:42.633219 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 27 02:47:42.633219 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 27 02:47:42.633219 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:47:42.633219 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:47:42.633219 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:47:42.633219 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:47:42.633219 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 27 02:47:42.633219 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:47:42.633219 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:47:42.633219 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:47:42.633219 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:47:42.633219 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:47:42.633219 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:47:42.633219 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:47:42.633219 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:47:42.633219 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 27 02:47:42.633219 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:47:42.635375 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-69621ae7-5577-4e00-862e-0374f23d63f3 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:47:42.635375 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-69621ae7-5577-4e00-862e-0374f23d63f3 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] 10.222.0.70 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.016966 Aug 27 02:47:42.648664 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 862/1731] 10.222.0.70 () {60 vars in 1275 bytes} [Sat Aug 27 02:47:42 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 02:47:42.661579 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5c9ae928-91fc-42c0-abda-9ed8e4dd90cf tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1032947261"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:47:42.670250 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-5c9ae928-91fc-42c0-abda-9ed8e4dd90cf tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 27 02:47:42.670834 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-5c9ae928-91fc-42c0-abda-9ed8e4dd90cf tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 27 02:47:42.678094 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5c9ae928-91fc-42c0-abda-9ed8e4dd90cf tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Request method failure captured: Aug 27 02:47:42.678094 n-d-852278-4 devstack@n-api.service[134052]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Aug 27 02:47:42.678094 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:47:42.678094 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:47:42.678094 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:47:42.678094 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 57 Aug 27 02:47:42.678094 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:47:42.678094 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:47:42.678094 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:47:42.678094 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:47:42.678094 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYWwbzAg0jdFU-TLMTCauW4UsKc6GTPHZ68EjHWr6fI61abEasCAwukOorAGc3NAaoB4tJFbzZj_7tyAplv-bvv6FqdvN1gbCGglfkABPxZ0Zz3pmKi6ibJW-yKhlG3wJpJp1fJo3XxNHeIdNheb_EPPAdc09wQsBHOili-F1kbLPDg Aug 27 02:47:42.678094 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:47:42.678094 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:47:42.678094 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:47:42.678094 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:47:42.678094 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:47:42.678094 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:47:42.678094 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 42b7c879ef5f4e5e8204433a06bdd370 Aug 27 02:47:42.678094 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ImagesNegativeTestJSON-1908428514 Aug 27 02:47:42.678094 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:47:42.678094 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:47:42.679845 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/42b7c879ef5f4e5e8204433a06bdd370"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_42b7c879ef5f4e5e8204433a06bdd370", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/42b7c879ef5f4e5e8204433a06bdd370"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/42b7c879ef5f4e5e8204433a06bdd370"}]}] Aug 27 02:47:42.679845 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ImagesNegativeTestJSON-1908428514 Aug 27 02:47:42.679845 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 42b7c879ef5f4e5e8204433a06bdd370 Aug 27 02:47:42.679845 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1908428514 Aug 27 02:47:42.679845 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ImagesNegativeTestJSON-1908428514-project Aug 27 02:47:42.679845 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:47:42.679845 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:47:42.679845 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: a724314a34d2477cac222eeba100840b Aug 27 02:47:42.679845 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ImagesNegativeTestJSON-1908428514-project Aug 27 02:47:42.679845 n-d-852278-4 devstack@n-api.service[134052]: Aug 27 02:47:42.679845 n-d-852278-4 devstack@n-api.service[134052]: {"createImage": {"name": "tempest-test-snap-1032947261"}} Aug 27 02:47:42.679845 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 02:47:42.679845 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 27 02:47:42.680843 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1032947261'}}} Aug 27 02:47:42.680843 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:47:42.680843 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:47:42.680843 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:47:42.680843 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:47:42.680843 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 27 02:47:42.680843 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 27 02:47:42.680843 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 27 02:47:42.680843 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:47:42.680843 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:47:42.680843 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:47:42.680843 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:47:42.680843 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:47:42.680843 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:47:42.680843 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:47:42.680843 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:47:42.680843 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:47:42.680843 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:47:42.680843 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:47:42.680843 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:47:42.682281 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:47:42.682281 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:47:42.682281 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 27 02:47:42.682281 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 27 02:47:42.682281 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:47:42.682281 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:47:42.682281 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:47:42.682281 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:47:42.682281 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 27 02:47:42.682281 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:47:42.682281 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:47:42.682281 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:47:42.682281 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:47:42.682281 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:47:42.682281 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:47:42.682281 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:47:42.682281 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:47:42.682281 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 27 02:47:42.682281 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:47:42.685492 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5c9ae928-91fc-42c0-abda-9ed8e4dd90cf tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:47:42.686826 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-5c9ae928-91fc-42c0-abda-9ed8e4dd90cf tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] 10.222.0.70 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.027609 Aug 27 02:47:42.687700 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 863/1732] 10.222.0.70 () {60 vars in 1281 bytes} [Sat Aug 27 02:47:42 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:47:42.697751 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6dd545ba-f9d6-4e80-927b-5542f37f3813 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:42.698318 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-6dd545ba-f9d6-4e80-927b-5542f37f3813 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] [instance: d2020ea3-b05b-47ca-b9a1-950c028db483] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:42.708131 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6dd545ba-f9d6-4e80-927b-5542f37f3813 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:42.708733 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6dd545ba-f9d6-4e80-927b-5542f37f3813 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:42.709237 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6dd545ba-f9d6-4e80-927b-5542f37f3813 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:42.709974 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6dd545ba-f9d6-4e80-927b-5542f37f3813 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:42.710505 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6dd545ba-f9d6-4e80-927b-5542f37f3813 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:42.710930 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6dd545ba-f9d6-4e80-927b-5542f37f3813 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:42.740079 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-6dd545ba-f9d6-4e80-927b-5542f37f3813 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] HTTP exception thrown: Instance d2020ea3-b05b-47ca-b9a1-950c028db483 could not be found. Aug 27 02:47:42.744914 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6dd545ba-f9d6-4e80-927b-5542f37f3813 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Request method failure captured: Aug 27 02:47:42.744914 n-d-852278-4 devstack@n-api.service[134052]: request: DELETE /compute/v2.1/servers/d2020ea3-b05b-47ca-b9a1-950c028db483 HTTP/1.1 Aug 27 02:47:42.744914 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:47:42.744914 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:47:42.744914 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:47:42.744914 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:47:42.744914 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:47:42.744914 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:47:42.744914 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:47:42.744914 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:47:42.744914 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYWwbzAg0jdFU-TLMTCauW4UsKc6GTPHZ68EjHWr6fI61abEasCAwukOorAGc3NAaoB4tJFbzZj_7tyAplv-bvv6FqdvN1gbCGglfkABPxZ0Zz3pmKi6ibJW-yKhlG3wJpJp1fJo3XxNHeIdNheb_EPPAdc09wQsBHOili-F1kbLPDg Aug 27 02:47:42.744914 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:47:42.744914 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:47:42.744914 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:47:42.744914 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:47:42.744914 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:47:42.744914 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:47:42.744914 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 42b7c879ef5f4e5e8204433a06bdd370 Aug 27 02:47:42.744914 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ImagesNegativeTestJSON-1908428514 Aug 27 02:47:42.744914 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:47:42.744914 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:47:42.746953 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/42b7c879ef5f4e5e8204433a06bdd370"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_42b7c879ef5f4e5e8204433a06bdd370", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/42b7c879ef5f4e5e8204433a06bdd370"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/42b7c879ef5f4e5e8204433a06bdd370"}]}] Aug 27 02:47:42.746953 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ImagesNegativeTestJSON-1908428514 Aug 27 02:47:42.746953 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 42b7c879ef5f4e5e8204433a06bdd370 Aug 27 02:47:42.746953 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1908428514 Aug 27 02:47:42.746953 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ImagesNegativeTestJSON-1908428514-project Aug 27 02:47:42.746953 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:47:42.746953 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:47:42.746953 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: a724314a34d2477cac222eeba100840b Aug 27 02:47:42.746953 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ImagesNegativeTestJSON-1908428514-project Aug 27 02:47:42.746953 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 02:47:42.746953 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance d2020ea3-b05b-47ca-b9a1-950c028db483 could not be found. Aug 27 02:47:42.746953 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': 'd2020ea3-b05b-47ca-b9a1-950c028db483'} Aug 27 02:47:42.749075 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:47:42.749075 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:47:42.749075 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:47:42.749075 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:47:42.749075 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:47:42.749075 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:47:42.749075 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:47:42.749075 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:47:42.749075 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:47:42.749075 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:47:42.749075 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2020ea3-b05b-47ca-b9a1-950c028db483 could not be found. Aug 27 02:47:42.749075 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:47:42.749075 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:47:42.749075 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:47:42.749075 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:47:42.749075 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:47:42.749075 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:47:42.749075 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:47:42.749075 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:47:42.749075 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:47:42.750756 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:47:42.750756 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 02:47:42.750756 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 02:47:42.750756 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 02:47:42.750756 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 02:47:42.750756 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:47:42.750756 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:47:42.750756 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:47:42.750756 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:47:42.750756 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2020ea3-b05b-47ca-b9a1-950c028db483 could not be found. Aug 27 02:47:42.750756 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:47:42.750756 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:47:42.750756 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:47:42.750756 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:47:42.750756 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:47:42.750756 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:47:42.750756 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:47:42.750756 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:47:42.750756 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2020ea3-b05b-47ca-b9a1-950c028db483 could not be found. Aug 27 02:47:42.750756 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:47:42.753963 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6dd545ba-f9d6-4e80-927b-5542f37f3813 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Returning 404 to user: Instance d2020ea3-b05b-47ca-b9a1-950c028db483 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:47:42.753963 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-6dd545ba-f9d6-4e80-927b-5542f37f3813 tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] 10.222.0.70 "DELETE /compute/v2.1/servers/d2020ea3-b05b-47ca-b9a1-950c028db483" status: 404 len: 111 microversion: 2.1 time: 0.053417 Aug 27 02:47:42.756558 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 864/1733] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:47:42 2022] DELETE /compute/v2.1/servers/d2020ea3-b05b-47ca-b9a1-950c028db483 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:47:42.762153 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-536978cf-c1f6-4a69-b871-da994f00dd3c tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:42.762862 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-536978cf-c1f6-4a69-b871-da994f00dd3c tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] [instance: d2020ea3-b05b-47ca-b9a1-950c028db483] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:42.781338 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-536978cf-c1f6-4a69-b871-da994f00dd3c tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:42.782562 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-536978cf-c1f6-4a69-b871-da994f00dd3c tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:42.783336 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-536978cf-c1f6-4a69-b871-da994f00dd3c tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:42.786652 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-536978cf-c1f6-4a69-b871-da994f00dd3c tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:42.787639 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-536978cf-c1f6-4a69-b871-da994f00dd3c tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:42.789489 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-536978cf-c1f6-4a69-b871-da994f00dd3c tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:42.825891 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-536978cf-c1f6-4a69-b871-da994f00dd3c tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] HTTP exception thrown: Instance d2020ea3-b05b-47ca-b9a1-950c028db483 could not be found. Aug 27 02:47:42.827517 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-536978cf-c1f6-4a69-b871-da994f00dd3c tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Request method failure captured: Aug 27 02:47:42.827517 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/servers/d2020ea3-b05b-47ca-b9a1-950c028db483 HTTP/1.1 Aug 27 02:47:42.827517 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:47:42.827517 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:47:42.827517 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:47:42.827517 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:47:42.827517 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:47:42.827517 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:47:42.827517 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:47:42.827517 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:47:42.827517 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYWwbzAg0jdFU-TLMTCauW4UsKc6GTPHZ68EjHWr6fI61abEasCAwukOorAGc3NAaoB4tJFbzZj_7tyAplv-bvv6FqdvN1gbCGglfkABPxZ0Zz3pmKi6ibJW-yKhlG3wJpJp1fJo3XxNHeIdNheb_EPPAdc09wQsBHOili-F1kbLPDg Aug 27 02:47:42.827517 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:47:42.827517 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:47:42.827517 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:47:42.827517 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:47:42.827517 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:47:42.827517 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:47:42.827517 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 42b7c879ef5f4e5e8204433a06bdd370 Aug 27 02:47:42.827517 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ImagesNegativeTestJSON-1908428514 Aug 27 02:47:42.827517 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:47:42.827517 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:47:42.829902 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/42b7c879ef5f4e5e8204433a06bdd370"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_42b7c879ef5f4e5e8204433a06bdd370", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/42b7c879ef5f4e5e8204433a06bdd370"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/42b7c879ef5f4e5e8204433a06bdd370"}]}] Aug 27 02:47:42.829902 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ImagesNegativeTestJSON-1908428514 Aug 27 02:47:42.829902 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 42b7c879ef5f4e5e8204433a06bdd370 Aug 27 02:47:42.829902 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1908428514 Aug 27 02:47:42.829902 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ImagesNegativeTestJSON-1908428514-project Aug 27 02:47:42.829902 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:47:42.829902 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:47:42.829902 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: a724314a34d2477cac222eeba100840b Aug 27 02:47:42.829902 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ImagesNegativeTestJSON-1908428514-project Aug 27 02:47:42.829902 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 02:47:42.829902 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance d2020ea3-b05b-47ca-b9a1-950c028db483 could not be found. Aug 27 02:47:42.829902 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': 'd2020ea3-b05b-47ca-b9a1-950c028db483'} Aug 27 02:47:42.831466 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:47:42.831466 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:47:42.831466 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:47:42.831466 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:47:42.831466 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:47:42.831466 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:47:42.831466 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:47:42.831466 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:47:42.831466 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:47:42.831466 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:47:42.831466 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2020ea3-b05b-47ca-b9a1-950c028db483 could not be found. Aug 27 02:47:42.831466 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:47:42.831466 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:47:42.831466 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:47:42.831466 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:47:42.831466 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:47:42.831466 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:47:42.831466 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:47:42.831466 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:47:42.831466 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:47:42.833787 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:47:42.833787 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:47:42.833787 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:47:42.833787 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:47:42.833787 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:47:42.833787 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:47:42.833787 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:47:42.833787 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2020ea3-b05b-47ca-b9a1-950c028db483 could not be found. Aug 27 02:47:42.833787 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:47:42.833787 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:47:42.833787 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:47:42.833787 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:47:42.833787 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:47:42.833787 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:47:42.833787 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:47:42.833787 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:47:42.833787 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2020ea3-b05b-47ca-b9a1-950c028db483 could not be found. Aug 27 02:47:42.833787 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:47:42.836797 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-536978cf-c1f6-4a69-b871-da994f00dd3c tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] Returning 404 to user: Instance d2020ea3-b05b-47ca-b9a1-950c028db483 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:47:42.836797 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-536978cf-c1f6-4a69-b871-da994f00dd3c tempest-ImagesNegativeTestJSON-1908428514 tempest-ImagesNegativeTestJSON-1908428514-project] 10.222.0.70 "GET /compute/v2.1/servers/d2020ea3-b05b-47ca-b9a1-950c028db483" status: 404 len: 111 microversion: 2.1 time: 0.071394 Aug 27 02:47:42.840898 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 865/1734] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:42 2022] GET /compute/v2.1/servers/d2020ea3-b05b-47ca-b9a1-950c028db483 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:47:42.923633 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-69213695-6851-41f0-a591-700ec69a714d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:42.924166 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-69213695-6851-41f0-a591-700ec69a714d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 70acfe32-deea-46fc-a214-8fdbb9f6cb7b] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:42.936895 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-69213695-6851-41f0-a591-700ec69a714d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:42.937520 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-69213695-6851-41f0-a591-700ec69a714d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:42.938165 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-69213695-6851-41f0-a591-700ec69a714d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:42.940949 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-69213695-6851-41f0-a591-700ec69a714d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:42.941646 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-69213695-6851-41f0-a591-700ec69a714d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:42.945028 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-69213695-6851-41f0-a591-700ec69a714d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:43.131753 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-2e82c059-f4f9-416c-923d-7bc6ce7f30d4 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:43.142868 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-2e82c059-f4f9-416c-923d-7bc6ce7f30d4 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:43.144327 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-2e82c059-f4f9-416c-923d-7bc6ce7f30d4 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:43.156097 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-2e82c059-f4f9-416c-923d-7bc6ce7f30d4 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] 10.222.0.70 "GET /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a" status: 200 len: 2951 microversion: 2.42 time: 1.250781 Aug 27 02:47:43.156746 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 870/1735] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:47:41 2022] GET /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a => generated 2951 bytes in 1252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:47:43.188409 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-bac59f46-50f4-4d8d-a2e6-746f59937f38 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:43.189161 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-bac59f46-50f4-4d8d-a2e6-746f59937f38 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] [instance: 484e03a9-aef3-4179-980c-0e7292a05b5a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:43.203078 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bac59f46-50f4-4d8d-a2e6-746f59937f38 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:43.203078 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bac59f46-50f4-4d8d-a2e6-746f59937f38 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:43.203078 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bac59f46-50f4-4d8d-a2e6-746f59937f38 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:43.203078 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bac59f46-50f4-4d8d-a2e6-746f59937f38 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:43.203413 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bac59f46-50f4-4d8d-a2e6-746f59937f38 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:43.203413 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bac59f46-50f4-4d8d-a2e6-746f59937f38 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:43.266258 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-69213695-6851-41f0-a591-700ec69a714d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:43.275931 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-69213695-6851-41f0-a591-700ec69a714d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b" status: 200 len: 1182 microversion: 2.1 time: 0.356642 Aug 27 02:47:43.281336 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 866/1736] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:42 2022] GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b => generated 1182 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:47:43.296857 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-43d1e14b-81b2-4af3-9aaf-e8dabdaed505 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:43.297489 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-43d1e14b-81b2-4af3-9aaf-e8dabdaed505 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] [instance: 9d7f8c37-c4a6-400e-9a02-94f9040b780e] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:43.304428 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-43d1e14b-81b2-4af3-9aaf-e8dabdaed505 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:43.305256 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-43d1e14b-81b2-4af3-9aaf-e8dabdaed505 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:43.305884 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-43d1e14b-81b2-4af3-9aaf-e8dabdaed505 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:43.306777 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-43d1e14b-81b2-4af3-9aaf-e8dabdaed505 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:43.307476 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-43d1e14b-81b2-4af3-9aaf-e8dabdaed505 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:43.309220 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-43d1e14b-81b2-4af3-9aaf-e8dabdaed505 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:43.634300 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-bac59f46-50f4-4d8d-a2e6-746f59937f38 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] 10.222.0.70 "GET /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a/os-interface" status: 200 len: 1830 microversion: 2.42 time: 0.449473 Aug 27 02:47:43.635716 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 871/1737] 10.222.0.70 () {60 vars in 1316 bytes} [Sat Aug 27 02:47:43 2022] GET /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a/os-interface => generated 1830 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:47:44.102038 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-efb194c1-b359-41c6-8530-13d6d4fbdc08 req-5aa3a5bf-386e-46e0-8fdf-0890bfb26092 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "191df585-2175-47be-9bd8-29b914535f47", "name": "network-vif-plugged", "status": "completed", "tag": "178a305e-f6ec-4889-9602-1513853a515b"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:47:44.140743 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-43d1e14b-81b2-4af3-9aaf-e8dabdaed505 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d626281a9864fe7aed598d4be209137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ae1f9ee6b7e49849b68b3628b76766a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:44.155319 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-43d1e14b-81b2-4af3-9aaf-e8dabdaed505 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] 10.222.0.70 "GET /compute/v2.1/servers/9d7f8c37-c4a6-400e-9a02-94f9040b780e" status: 200 len: 1317 microversion: 2.1 time: 0.859610 Aug 27 02:47:44.155957 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-efb194c1-b359-41c6-8530-13d6d4fbdc08 req-5aa3a5bf-386e-46e0-8fdf-0890bfb26092 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:44.158478 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-efb194c1-b359-41c6-8530-13d6d4fbdc08 req-5aa3a5bf-386e-46e0-8fdf-0890bfb26092 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:44.161867 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 867/1738] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:43 2022] GET /compute/v2.1/servers/9d7f8c37-c4a6-400e-9a02-94f9040b780e => generated 1317 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:44.162475 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-efb194c1-b359-41c6-8530-13d6d4fbdc08 req-5aa3a5bf-386e-46e0-8fdf-0890bfb26092 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:44.207089 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-efb194c1-b359-41c6-8530-13d6d4fbdc08 req-5aa3a5bf-386e-46e0-8fdf-0890bfb26092 service nova] Creating event network-vif-plugged:178a305e-f6ec-4889-9602-1513853a515b for instance 191df585-2175-47be-9bd8-29b914535f47 on n-h2-852278-4 Aug 27 02:47:44.218876 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-efb194c1-b359-41c6-8530-13d6d4fbdc08 req-5aa3a5bf-386e-46e0-8fdf-0890bfb26092 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119632 Aug 27 02:47:44.222565 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 872/1739] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:47:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:47:44.302327 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3a465471-d091-4cfe-93fe-677f87a61c63 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:44.303118 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-3a465471-d091-4cfe-93fe-677f87a61c63 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 70acfe32-deea-46fc-a214-8fdbb9f6cb7b] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:44.315495 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3a465471-d091-4cfe-93fe-677f87a61c63 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:44.317253 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3a465471-d091-4cfe-93fe-677f87a61c63 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:44.319928 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3a465471-d091-4cfe-93fe-677f87a61c63 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:44.321188 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3a465471-d091-4cfe-93fe-677f87a61c63 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:44.324679 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3a465471-d091-4cfe-93fe-677f87a61c63 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:44.325341 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3a465471-d091-4cfe-93fe-677f87a61c63 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:44.616197 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-3a465471-d091-4cfe-93fe-677f87a61c63 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:44.625805 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-3a465471-d091-4cfe-93fe-677f87a61c63 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b" status: 200 len: 1182 microversion: 2.1 time: 0.329681 Aug 27 02:47:44.626422 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 868/1740] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:44 2022] GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b => generated 1182 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:45.187588 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b6887e8e-c298-4fef-9617-dbbc99f41423 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:45.190064 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b6887e8e-c298-4fef-9617-dbbc99f41423 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] [instance: 9d7f8c37-c4a6-400e-9a02-94f9040b780e] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:45.213986 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b6887e8e-c298-4fef-9617-dbbc99f41423 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:45.216852 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b6887e8e-c298-4fef-9617-dbbc99f41423 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:45.217400 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b6887e8e-c298-4fef-9617-dbbc99f41423 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:45.218602 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b6887e8e-c298-4fef-9617-dbbc99f41423 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:45.219422 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b6887e8e-c298-4fef-9617-dbbc99f41423 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:45.221353 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b6887e8e-c298-4fef-9617-dbbc99f41423 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:45.649174 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-19c318a5-5943-4415-927d-f4ed29929aeb tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:45.649797 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-19c318a5-5943-4415-927d-f4ed29929aeb tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 70acfe32-deea-46fc-a214-8fdbb9f6cb7b] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:45.671681 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-19c318a5-5943-4415-927d-f4ed29929aeb tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:45.672219 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-19c318a5-5943-4415-927d-f4ed29929aeb tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:45.672680 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-19c318a5-5943-4415-927d-f4ed29929aeb tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:45.673401 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-19c318a5-5943-4415-927d-f4ed29929aeb tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:45.673848 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-19c318a5-5943-4415-927d-f4ed29929aeb tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:45.674265 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-19c318a5-5943-4415-927d-f4ed29929aeb tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:45.925630 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-19c318a5-5943-4415-927d-f4ed29929aeb tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:45.938671 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-19c318a5-5943-4415-927d-f4ed29929aeb tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b" status: 200 len: 1182 microversion: 2.1 time: 0.295244 Aug 27 02:47:45.942516 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 869/1741] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:45 2022] GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b => generated 1182 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:46.633133 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-b6887e8e-c298-4fef-9617-dbbc99f41423 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d626281a9864fe7aed598d4be209137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ae1f9ee6b7e49849b68b3628b76766a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:46.647478 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b6887e8e-c298-4fef-9617-dbbc99f41423 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] 10.222.0.70 "GET /compute/v2.1/servers/9d7f8c37-c4a6-400e-9a02-94f9040b780e" status: 200 len: 1317 microversion: 2.1 time: 1.465641 Aug 27 02:47:46.669812 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 873/1742] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:45 2022] GET /compute/v2.1/servers/9d7f8c37-c4a6-400e-9a02-94f9040b780e => generated 1317 bytes in 1489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:46.962797 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-164edafb-ff94-4827-afa7-f8e02c430550 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:46.964299 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-164edafb-ff94-4827-afa7-f8e02c430550 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 70acfe32-deea-46fc-a214-8fdbb9f6cb7b] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:46.990084 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-164edafb-ff94-4827-afa7-f8e02c430550 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:46.992890 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-164edafb-ff94-4827-afa7-f8e02c430550 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:46.993550 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-164edafb-ff94-4827-afa7-f8e02c430550 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:46.997341 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-164edafb-ff94-4827-afa7-f8e02c430550 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:46.998022 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-164edafb-ff94-4827-afa7-f8e02c430550 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:46.998611 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-164edafb-ff94-4827-afa7-f8e02c430550 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:47.036027 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-164edafb-ff94-4827-afa7-f8e02c430550 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] HTTP exception thrown: Instance 70acfe32-deea-46fc-a214-8fdbb9f6cb7b could not be found. Aug 27 02:47:47.037945 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-164edafb-ff94-4827-afa7-f8e02c430550 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Request method failure captured: Aug 27 02:47:47.037945 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b HTTP/1.1 Aug 27 02:47:47.037945 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:47:47.037945 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:47:47.037945 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:47:47.037945 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:47:47.037945 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:47:47.037945 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:47:47.037945 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:47:47.037945 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:47:47.037945 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYQ0RUq_2c9yZQ-tBPbmZSdvHy16w3uYqnC3ulfGKVhuo9V1qT0DhwpbZGrjZ7gKl36Bwe3ndp4oPtN8Yb1NhLVtR6ctzUSsGxj9x2fK83huw_99YjNve5IbacPLlJkw2C8b_A-bkfhkR5WCzDVEXkxJm7KG7Of9mLoKJwUixrEmvkI Aug 27 02:47:47.037945 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:47:47.037945 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:47:47.037945 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:47:47.037945 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:47:47.037945 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:47:47.037945 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:47:47.037945 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 42ec913a638c4c8c8749be73705d2c65 Aug 27 02:47:47.037945 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-LiveMigrationTest-966742224 Aug 27 02:47:47.037945 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:47:47.037945 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:47:47.039754 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/42ec913a638c4c8c8749be73705d2c65"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_42ec913a638c4c8c8749be73705d2c65", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/42ec913a638c4c8c8749be73705d2c65"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/42ec913a638c4c8c8749be73705d2c65"}]}] Aug 27 02:47:47.039754 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-LiveMigrationTest-966742224 Aug 27 02:47:47.039754 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 42ec913a638c4c8c8749be73705d2c65 Aug 27 02:47:47.039754 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-LiveMigrationTest-966742224 Aug 27 02:47:47.039754 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-LiveMigrationTest-966742224-project Aug 27 02:47:47.039754 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:47:47.039754 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:47:47.039754 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 6305debcc9294643bbed97f08de171bc Aug 27 02:47:47.039754 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-LiveMigrationTest-966742224-project Aug 27 02:47:47.039754 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 02:47:47.039754 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance 70acfe32-deea-46fc-a214-8fdbb9f6cb7b could not be found. Aug 27 02:47:47.039754 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '70acfe32-deea-46fc-a214-8fdbb9f6cb7b'} Aug 27 02:47:47.040675 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:47:47.040675 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:47:47.040675 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:47:47.040675 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:47:47.040675 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:47:47.040675 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:47:47.040675 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:47:47.040675 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:47:47.040675 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:47:47.040675 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:47:47.040675 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70acfe32-deea-46fc-a214-8fdbb9f6cb7b could not be found. Aug 27 02:47:47.040675 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:47:47.040675 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:47:47.040675 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:47:47.040675 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:47:47.040675 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:47:47.040675 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:47:47.040675 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:47:47.040675 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:47:47.040675 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:47:47.042284 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:47:47.042284 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:47:47.042284 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:47:47.042284 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:47:47.042284 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:47:47.042284 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:47:47.042284 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:47:47.042284 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70acfe32-deea-46fc-a214-8fdbb9f6cb7b could not be found. Aug 27 02:47:47.042284 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:47:47.042284 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:47:47.042284 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:47:47.042284 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:47:47.042284 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:47:47.042284 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:47:47.042284 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:47:47.042284 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:47:47.042284 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70acfe32-deea-46fc-a214-8fdbb9f6cb7b could not be found. Aug 27 02:47:47.042284 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:47:47.044986 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-164edafb-ff94-4827-afa7-f8e02c430550 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Returning 404 to user: Instance 70acfe32-deea-46fc-a214-8fdbb9f6cb7b could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:47:47.046056 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-164edafb-ff94-4827-afa7-f8e02c430550 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b" status: 404 len: 111 microversion: 2.1 time: 0.087423 Aug 27 02:47:47.047976 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 870/1743] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:46 2022] GET /compute/v2.1/servers/70acfe32-deea-46fc-a214-8fdbb9f6cb7b => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:47:47.672950 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7fb7c5b7-0664-475f-a86b-a8d42403a92d tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:47.674081 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-7fb7c5b7-0664-475f-a86b-a8d42403a92d tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] [instance: 9d7f8c37-c4a6-400e-9a02-94f9040b780e] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:47.690021 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7fb7c5b7-0664-475f-a86b-a8d42403a92d tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:47.690231 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7fb7c5b7-0664-475f-a86b-a8d42403a92d tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:47.690959 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7fb7c5b7-0664-475f-a86b-a8d42403a92d tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:47.691773 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7fb7c5b7-0664-475f-a86b-a8d42403a92d tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:47.692482 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7fb7c5b7-0664-475f-a86b-a8d42403a92d tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:47.693364 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7fb7c5b7-0664-475f-a86b-a8d42403a92d tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:47.987180 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-7fb7c5b7-0664-475f-a86b-a8d42403a92d tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d626281a9864fe7aed598d4be209137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ae1f9ee6b7e49849b68b3628b76766a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:47.999668 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-7fb7c5b7-0664-475f-a86b-a8d42403a92d tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] 10.222.0.70 "GET /compute/v2.1/servers/9d7f8c37-c4a6-400e-9a02-94f9040b780e" status: 200 len: 1317 microversion: 2.1 time: 0.330599 Aug 27 02:47:48.001309 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 874/1744] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:47 2022] GET /compute/v2.1/servers/9d7f8c37-c4a6-400e-9a02-94f9040b780e => generated 1317 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:48.277311 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-6bf6ade5-1930-4755-b18d-fc1c5eb5b7ff req-0a02d578-0b8f-442f-9163-7cfe3eeb3d2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d7f8c37-c4a6-400e-9a02-94f9040b780e", "name": "network-vif-plugged", "status": "completed", "tag": "545c57b0-4a40-4554-9d90-9ca7c0773d35"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:47:48.303757 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-6bf6ade5-1930-4755-b18d-fc1c5eb5b7ff req-0a02d578-0b8f-442f-9163-7cfe3eeb3d2e service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:48.309660 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-6bf6ade5-1930-4755-b18d-fc1c5eb5b7ff req-0a02d578-0b8f-442f-9163-7cfe3eeb3d2e service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:48.313642 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-6bf6ade5-1930-4755-b18d-fc1c5eb5b7ff req-0a02d578-0b8f-442f-9163-7cfe3eeb3d2e service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:48.363686 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-6bf6ade5-1930-4755-b18d-fc1c5eb5b7ff req-0a02d578-0b8f-442f-9163-7cfe3eeb3d2e service nova] Creating event network-vif-plugged:545c57b0-4a40-4554-9d90-9ca7c0773d35 for instance 9d7f8c37-c4a6-400e-9a02-94f9040b780e on n-h2-852278-4 Aug 27 02:47:48.383444 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-6bf6ade5-1930-4755-b18d-fc1c5eb5b7ff req-0a02d578-0b8f-442f-9163-7cfe3eeb3d2e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109927 Aug 27 02:47:48.386654 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 871/1745] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:47:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:47:49.021631 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-41168185-3dda-41fb-9c1f-3a913e921e37 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:49.023002 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-41168185-3dda-41fb-9c1f-3a913e921e37 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] [instance: 9d7f8c37-c4a6-400e-9a02-94f9040b780e] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:49.034794 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-41168185-3dda-41fb-9c1f-3a913e921e37 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:49.037954 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-41168185-3dda-41fb-9c1f-3a913e921e37 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:49.038582 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-41168185-3dda-41fb-9c1f-3a913e921e37 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:49.041595 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-41168185-3dda-41fb-9c1f-3a913e921e37 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:49.043433 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-41168185-3dda-41fb-9c1f-3a913e921e37 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:49.046363 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-41168185-3dda-41fb-9c1f-3a913e921e37 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:49.811013 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-41168185-3dda-41fb-9c1f-3a913e921e37 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d626281a9864fe7aed598d4be209137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ae1f9ee6b7e49849b68b3628b76766a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:49.820413 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-41168185-3dda-41fb-9c1f-3a913e921e37 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] 10.222.0.70 "GET /compute/v2.1/servers/9d7f8c37-c4a6-400e-9a02-94f9040b780e" status: 200 len: 1317 microversion: 2.1 time: 0.802738 Aug 27 02:47:49.820980 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 875/1746] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:49 2022] GET /compute/v2.1/servers/9d7f8c37-c4a6-400e-9a02-94f9040b780e => generated 1317 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:50.851155 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e818bd70-375f-4c47-970c-2e50b9e57f2f tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:50.854102 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-e818bd70-375f-4c47-970c-2e50b9e57f2f tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] [instance: 9d7f8c37-c4a6-400e-9a02-94f9040b780e] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:50.871972 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e818bd70-375f-4c47-970c-2e50b9e57f2f tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:50.873692 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e818bd70-375f-4c47-970c-2e50b9e57f2f tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:50.874522 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e818bd70-375f-4c47-970c-2e50b9e57f2f tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:50.876878 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e818bd70-375f-4c47-970c-2e50b9e57f2f tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:50.878366 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e818bd70-375f-4c47-970c-2e50b9e57f2f tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:50.881866 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e818bd70-375f-4c47-970c-2e50b9e57f2f tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:52.311859 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-e818bd70-375f-4c47-970c-2e50b9e57f2f tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d626281a9864fe7aed598d4be209137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ae1f9ee6b7e49849b68b3628b76766a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:52.327569 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e818bd70-375f-4c47-970c-2e50b9e57f2f tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] 10.222.0.70 "GET /compute/v2.1/servers/9d7f8c37-c4a6-400e-9a02-94f9040b780e" status: 200 len: 1467 microversion: 2.1 time: 1.482331 Aug 27 02:47:52.355446 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 872/1747] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:50 2022] GET /compute/v2.1/servers/9d7f8c37-c4a6-400e-9a02-94f9040b780e => generated 1467 bytes in 1505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:52.366067 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-334d71ef-da6c-4177-be34-7ad52f7dd707 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:52.366739 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-334d71ef-da6c-4177-be34-7ad52f7dd707 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] [instance: 191df585-2175-47be-9bd8-29b914535f47] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:52.383526 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-334d71ef-da6c-4177-be34-7ad52f7dd707 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:52.384290 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-334d71ef-da6c-4177-be34-7ad52f7dd707 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:52.384987 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-334d71ef-da6c-4177-be34-7ad52f7dd707 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:52.386403 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-334d71ef-da6c-4177-be34-7ad52f7dd707 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:52.387189 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-334d71ef-da6c-4177-be34-7ad52f7dd707 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:52.387877 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-334d71ef-da6c-4177-be34-7ad52f7dd707 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:52.812279 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ddabfe68-99eb-4b35-a5c2-9c203b34ce71 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-626971214", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:47:52.919489 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.network.neutron [None req-ddabfe68-99eb-4b35-a5c2-9c203b34ce71 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] validate_networks() for None {{(pid=134051) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:47:52.976009 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-334d71ef-da6c-4177-be34-7ad52f7dd707 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d626281a9864fe7aed598d4be209137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ae1f9ee6b7e49849b68b3628b76766a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:52.984571 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-334d71ef-da6c-4177-be34-7ad52f7dd707 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] 10.222.0.70 "GET /compute/v2.1/servers/191df585-2175-47be-9bd8-29b914535f47" status: 200 len: 1467 microversion: 2.1 time: 0.627851 Aug 27 02:47:52.985176 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 873/1748] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:52 2022] GET /compute/v2.1/servers/191df585-2175-47be-9bd8-29b914535f47 => generated 1467 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:53.010936 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-850aff27-a85e-462a-af75-fa45052cae70 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-298644985"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:47:53.021313 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-850aff27-a85e-462a-af75-fa45052cae70 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] [instance: 191df585-2175-47be-9bd8-29b914535f47] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:53.031228 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-850aff27-a85e-462a-af75-fa45052cae70 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:53.032211 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-850aff27-a85e-462a-af75-fa45052cae70 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:53.034021 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-850aff27-a85e-462a-af75-fa45052cae70 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:53.035091 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-850aff27-a85e-462a-af75-fa45052cae70 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:53.035778 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-850aff27-a85e-462a-af75-fa45052cae70 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:53.036461 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-850aff27-a85e-462a-af75-fa45052cae70 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:53.475778 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-ddabfe68-99eb-4b35-a5c2-9c203b34ce71 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Flavor limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:47:53.476557 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-ddabfe68-99eb-4b35-a5c2-9c203b34ce71 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Image limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:47:53.477223 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-ddabfe68-99eb-4b35-a5c2-9c203b34ce71 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Flavor pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:47:53.478053 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-ddabfe68-99eb-4b35-a5c2-9c203b34ce71 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Image pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:47:53.478752 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-ddabfe68-99eb-4b35-a5c2-9c203b34ce71 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:47:53.500704 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ddabfe68-99eb-4b35-a5c2-9c203b34ce71 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:53.505665 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ddabfe68-99eb-4b35-a5c2-9c203b34ce71 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:53.508812 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ddabfe68-99eb-4b35-a5c2-9c203b34ce71 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:53.511179 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ddabfe68-99eb-4b35-a5c2-9c203b34ce71 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:53.512585 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ddabfe68-99eb-4b35-a5c2-9c203b34ce71 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:53.518867 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ddabfe68-99eb-4b35-a5c2-9c203b34ce71 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:53.544943 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=100 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:47:53.591067 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-ddabfe68-99eb-4b35-a5c2-9c203b34ce71 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Getting quotas for project 937a5eeccaa7425ca72c8c74fb99f11a. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:47:53.613450 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-850aff27-a85e-462a-af75-fa45052cae70 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] 10.222.0.70 "POST /compute/v2.1/servers/191df585-2175-47be-9bd8-29b914535f47/action" status: 202 len: 0 microversion: 2.1 time: 0.604790 Aug 27 02:47:53.615945 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-ddabfe68-99eb-4b35-a5c2-9c203b34ce71 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Getting quotas for user 0b310e73ecd244d2938812d5be99558c and project 937a5eeccaa7425ca72c8c74fb99f11a. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:47:53.625409 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 874/1749] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 02:47:53 2022] POST /compute/v2.1/servers/191df585-2175-47be-9bd8-29b914535f47/action => generated 0 bytes in 621 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 27 02:47:53.651168 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-1504684e-e66e-42c9-a3d7-fd0149651ec4 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Calling method '.version_select at 0x7f5ee30f5b80>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:53.657868 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-ddabfe68-99eb-4b35-a5c2-9c203b34ce71 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Going to run 1 instances... {{(pid=134051) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:47:53.686211 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-ddabfe68-99eb-4b35-a5c2-9c203b34ce71 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: 60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134051) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:47:53.745109 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-1504684e-e66e-42c9-a3d7-fd0149651ec4 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] 10.222.0.70 "GET /compute/v2.1/images/ab2ca817-1bd6-41d1-b485-99378273bee8" status: 200 len: 1454 microversion: 2.1 time: 0.114447 Aug 27 02:47:53.756127 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 875/1750] 10.222.0.70 () {58 vars in 1233 bytes} [Sat Aug 27 02:47:53 2022] GET /compute/v2.1/images/ab2ca817-1bd6-41d1-b485-99378273bee8 => generated 1454 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:53.810563 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ddabfe68-99eb-4b35-a5c2-9c203b34ce71 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.523070 Aug 27 02:47:53.811271 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 876/1751] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 02:47:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1525 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 02:47:53.822710 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d92adea9-0181-43a6-9e5d-e048fa71123e tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:53.823465 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d92adea9-0181-43a6-9e5d-e048fa71123e tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: 60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:54.012931 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-d92adea9-0181-43a6-9e5d-e048fa71123e tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:54.021970 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d92adea9-0181-43a6-9e5d-e048fa71123e tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4" status: 200 len: 1212 microversion: 2.1 time: 0.203411 Aug 27 02:47:54.033335 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 876/1752] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:53 2022] GET /compute/v2.1/servers/60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4 => generated 1212 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:54.576301 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-26c729b4-5afd-4a77-bb23-f207660429c3 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-2108550991", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:47:54.697641 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.network.neutron [None req-26c729b4-5afd-4a77-bb23-f207660429c3 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] validate_networks() for None {{(pid=134051) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:47:54.763491 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f0c9e6bb-985b-4b9f-9ae7-0a74a0de106a tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Calling method '.version_select at 0x7f5ee30304c0>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:54.879792 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f0c9e6bb-985b-4b9f-9ae7-0a74a0de106a tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] 10.222.0.70 "GET /compute/v2.1/images/ab2ca817-1bd6-41d1-b485-99378273bee8" status: 200 len: 1454 microversion: 2.1 time: 0.120461 Aug 27 02:47:54.890072 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 877/1753] 10.222.0.70 () {58 vars in 1233 bytes} [Sat Aug 27 02:47:54 2022] GET /compute/v2.1/images/ab2ca817-1bd6-41d1-b485-99378273bee8 => generated 1454 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:55.049165 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-cc0888c4-d658-4eba-8874-d3e33c74881b tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:55.050532 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-cc0888c4-d658-4eba-8874-d3e33c74881b tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: 60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:55.072203 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cc0888c4-d658-4eba-8874-d3e33c74881b tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:55.072748 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cc0888c4-d658-4eba-8874-d3e33c74881b tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:55.076142 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cc0888c4-d658-4eba-8874-d3e33c74881b tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:55.080870 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cc0888c4-d658-4eba-8874-d3e33c74881b tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:55.081738 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cc0888c4-d658-4eba-8874-d3e33c74881b tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:55.082964 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cc0888c4-d658-4eba-8874-d3e33c74881b tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:55.137712 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-26c729b4-5afd-4a77-bb23-f207660429c3 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Flavor limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:47:55.138134 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-26c729b4-5afd-4a77-bb23-f207660429c3 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Image limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:47:55.138844 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-26c729b4-5afd-4a77-bb23-f207660429c3 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Flavor pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:47:55.139424 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-26c729b4-5afd-4a77-bb23-f207660429c3 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Image pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:47:55.140029 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-26c729b4-5afd-4a77-bb23-f207660429c3 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:47:55.153903 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-26c729b4-5afd-4a77-bb23-f207660429c3 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:55.154726 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-26c729b4-5afd-4a77-bb23-f207660429c3 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:55.155387 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-26c729b4-5afd-4a77-bb23-f207660429c3 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:55.156325 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-26c729b4-5afd-4a77-bb23-f207660429c3 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:55.157091 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-26c729b4-5afd-4a77-bb23-f207660429c3 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:55.157808 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-26c729b4-5afd-4a77-bb23-f207660429c3 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:55.247493 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-26c729b4-5afd-4a77-bb23-f207660429c3 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Getting quotas for project 96abd4aa8efa4761869dabdd1f143519. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:47:55.264663 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-26c729b4-5afd-4a77-bb23-f207660429c3 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Getting quotas for user 073966022576475b983af066d7edb099 and project 96abd4aa8efa4761869dabdd1f143519. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:47:55.276100 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-cc0888c4-d658-4eba-8874-d3e33c74881b tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:55.292038 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-cc0888c4-d658-4eba-8874-d3e33c74881b tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4" status: 200 len: 1208 microversion: 2.1 time: 0.248534 Aug 27 02:47:55.294277 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 878/1754] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:55 2022] GET /compute/v2.1/servers/60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4 => generated 1208 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:47:55.300036 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-770a26fd-b28d-49a3-82c7-cc9e37cde5e1 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:55.300580 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-770a26fd-b28d-49a3-82c7-cc9e37cde5e1 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 3095a9f9-6769-4107-94a5-beac6415694c] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:55.337201 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-770a26fd-b28d-49a3-82c7-cc9e37cde5e1 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:55.339267 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-770a26fd-b28d-49a3-82c7-cc9e37cde5e1 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:55.339751 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-770a26fd-b28d-49a3-82c7-cc9e37cde5e1 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:55.344254 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-770a26fd-b28d-49a3-82c7-cc9e37cde5e1 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:55.344781 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-770a26fd-b28d-49a3-82c7-cc9e37cde5e1 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:55.347422 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-26c729b4-5afd-4a77-bb23-f207660429c3 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Going to run 1 instances... {{(pid=134051) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:47:55.349688 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-770a26fd-b28d-49a3-82c7-cc9e37cde5e1 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:55.365982 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-26c729b4-5afd-4a77-bb23-f207660429c3 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] [instance: 4b88e24d-509c-49fe-b5e2-b2698620d6d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134051) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:47:55.468402 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-770a26fd-b28d-49a3-82c7-cc9e37cde5e1 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 3095a9f9-6769-4107-94a5-beac6415694c] Going to try to terminate instance {{(pid=134052) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:47:55.494944 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-26c729b4-5afd-4a77-bb23-f207660429c3 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.619779 Aug 27 02:47:55.505573 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 877/1755] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 02:47:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1631 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 02:47:55.518292 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7e8e812c-a2c3-4fda-bec9-ca00144c4a76 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:55.519366 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-7e8e812c-a2c3-4fda-bec9-ca00144c4a76 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] [instance: 4b88e24d-509c-49fe-b5e2-b2698620d6d6] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:55.716113 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-770a26fd-b28d-49a3-82c7-cc9e37cde5e1 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "DELETE /compute/v2.1/servers/3095a9f9-6769-4107-94a5-beac6415694c" status: 204 len: 0 microversion: 2.1 time: 0.420239 Aug 27 02:47:55.720961 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 879/1756] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:47:55 2022] DELETE /compute/v2.1/servers/3095a9f9-6769-4107-94a5-beac6415694c => generated 0 bytes in 423 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:47:55.722323 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-7e8e812c-a2c3-4fda-bec9-ca00144c4a76 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073966022576475b983af066d7edb099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96abd4aa8efa4761869dabdd1f143519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:55.733926 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-7e8e812c-a2c3-4fda-bec9-ca00144c4a76 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] 10.222.0.70 "GET /compute/v2.1/servers/4b88e24d-509c-49fe-b5e2-b2698620d6d6" status: 200 len: 1217 microversion: 2.1 time: 0.226760 Aug 27 02:47:55.737453 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 878/1757] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:55 2022] GET /compute/v2.1/servers/4b88e24d-509c-49fe-b5e2-b2698620d6d6 => generated 1217 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:55.750216 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e86d2c63-43a3-48fa-bd35-7dc8e040190c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:55.753236 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-e86d2c63-43a3-48fa-bd35-7dc8e040190c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 3095a9f9-6769-4107-94a5-beac6415694c] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:55.760289 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e86d2c63-43a3-48fa-bd35-7dc8e040190c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:55.760841 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e86d2c63-43a3-48fa-bd35-7dc8e040190c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:55.761288 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e86d2c63-43a3-48fa-bd35-7dc8e040190c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:55.763457 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e86d2c63-43a3-48fa-bd35-7dc8e040190c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:55.763935 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e86d2c63-43a3-48fa-bd35-7dc8e040190c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:55.764569 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e86d2c63-43a3-48fa-bd35-7dc8e040190c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:55.898284 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0e620836-65b6-4e42-a50c-21baf5534288 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Calling method '.version_select at 0x7f5ede923280>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:55.994904 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-0e620836-65b6-4e42-a50c-21baf5534288 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] 10.222.0.70 "GET /compute/v2.1/images/ab2ca817-1bd6-41d1-b485-99378273bee8" status: 200 len: 1454 microversion: 2.1 time: 0.103866 Aug 27 02:47:56.008691 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 879/1758] 10.222.0.70 () {58 vars in 1233 bytes} [Sat Aug 27 02:47:55 2022] GET /compute/v2.1/images/ab2ca817-1bd6-41d1-b485-99378273bee8 => generated 1454 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:47:56.079848 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-e86d2c63-43a3-48fa-bd35-7dc8e040190c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:56.093624 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e86d2c63-43a3-48fa-bd35-7dc8e040190c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/3095a9f9-6769-4107-94a5-beac6415694c" status: 200 len: 1667 microversion: 2.1 time: 0.360240 Aug 27 02:47:56.096892 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 880/1759] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:55 2022] GET /compute/v2.1/servers/3095a9f9-6769-4107-94a5-beac6415694c => generated 1667 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:56.323492 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-df5ae4e7-5828-4ddd-bdf6-af77a00c4572 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:56.324369 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-df5ae4e7-5828-4ddd-bdf6-af77a00c4572 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: 60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:56.346381 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-df5ae4e7-5828-4ddd-bdf6-af77a00c4572 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:56.347082 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-df5ae4e7-5828-4ddd-bdf6-af77a00c4572 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:56.347524 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-df5ae4e7-5828-4ddd-bdf6-af77a00c4572 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:56.353115 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-df5ae4e7-5828-4ddd-bdf6-af77a00c4572 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:56.354338 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-df5ae4e7-5828-4ddd-bdf6-af77a00c4572 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:56.354790 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-df5ae4e7-5828-4ddd-bdf6-af77a00c4572 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:56.514766 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-df5ae4e7-5828-4ddd-bdf6-af77a00c4572 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:56.526131 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-df5ae4e7-5828-4ddd-bdf6-af77a00c4572 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4" status: 200 len: 1282 microversion: 2.1 time: 0.209947 Aug 27 02:47:56.537793 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 880/1760] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:56 2022] GET /compute/v2.1/servers/60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4 => generated 1282 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:56.758099 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6c789f48-e226-4f1f-b42f-1df5891aec4f tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:56.758930 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-6c789f48-e226-4f1f-b42f-1df5891aec4f tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] [instance: 4b88e24d-509c-49fe-b5e2-b2698620d6d6] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:56.770630 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6c789f48-e226-4f1f-b42f-1df5891aec4f tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:56.771464 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6c789f48-e226-4f1f-b42f-1df5891aec4f tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:56.775175 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6c789f48-e226-4f1f-b42f-1df5891aec4f tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:56.776152 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6c789f48-e226-4f1f-b42f-1df5891aec4f tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:56.782360 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6c789f48-e226-4f1f-b42f-1df5891aec4f tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:56.782814 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6c789f48-e226-4f1f-b42f-1df5891aec4f tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:56.875155 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-6c789f48-e226-4f1f-b42f-1df5891aec4f tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073966022576475b983af066d7edb099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96abd4aa8efa4761869dabdd1f143519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:56.884531 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:47:56.893373 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-6c789f48-e226-4f1f-b42f-1df5891aec4f tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] 10.222.0.70 "GET /compute/v2.1/servers/4b88e24d-509c-49fe-b5e2-b2698620d6d6" status: 200 len: 1221 microversion: 2.1 time: 0.139568 Aug 27 02:47:56.896751 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 881/1761] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:56 2022] GET /compute/v2.1/servers/4b88e24d-509c-49fe-b5e2-b2698620d6d6 => generated 1221 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:57.013127 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4c0ba79b-fcf8-472d-9989-80b106db7ea8 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Calling method '.version_select at 0x7f5ede8e6040>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:57.083045 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-4c0ba79b-fcf8-472d-9989-80b106db7ea8 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] 10.222.0.70 "GET /compute/v2.1/images/ab2ca817-1bd6-41d1-b485-99378273bee8" status: 200 len: 1454 microversion: 2.1 time: 0.076098 Aug 27 02:47:57.091135 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 881/1762] 10.222.0.70 () {58 vars in 1233 bytes} [Sat Aug 27 02:47:57 2022] GET /compute/v2.1/images/ab2ca817-1bd6-41d1-b485-99378273bee8 => generated 1454 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:57.119534 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-38b72134-9355-465b-a6c4-65db8284e49c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:57.120705 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-38b72134-9355-465b-a6c4-65db8284e49c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 3095a9f9-6769-4107-94a5-beac6415694c] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:57.127959 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-38b72134-9355-465b-a6c4-65db8284e49c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:57.128471 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-38b72134-9355-465b-a6c4-65db8284e49c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:57.128902 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-38b72134-9355-465b-a6c4-65db8284e49c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:57.129609 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-38b72134-9355-465b-a6c4-65db8284e49c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:57.137962 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-38b72134-9355-465b-a6c4-65db8284e49c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:57.140578 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-38b72134-9355-465b-a6c4-65db8284e49c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:57.350731 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-38b72134-9355-465b-a6c4-65db8284e49c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:57.365961 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-38b72134-9355-465b-a6c4-65db8284e49c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/3095a9f9-6769-4107-94a5-beac6415694c" status: 200 len: 1667 microversion: 2.1 time: 0.250640 Aug 27 02:47:57.367008 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 882/1763] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:57 2022] GET /compute/v2.1/servers/3095a9f9-6769-4107-94a5-beac6415694c => generated 1667 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:57.548458 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-34182d89-dc0e-4476-8b6b-cbd5a46b2d1d tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:57.549967 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-34182d89-dc0e-4476-8b6b-cbd5a46b2d1d tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: 60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:57.579991 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-34182d89-dc0e-4476-8b6b-cbd5a46b2d1d tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:57.580492 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-34182d89-dc0e-4476-8b6b-cbd5a46b2d1d tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:57.580942 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-34182d89-dc0e-4476-8b6b-cbd5a46b2d1d tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:57.589697 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-34182d89-dc0e-4476-8b6b-cbd5a46b2d1d tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:57.591862 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-34182d89-dc0e-4476-8b6b-cbd5a46b2d1d tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:57.593199 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-34182d89-dc0e-4476-8b6b-cbd5a46b2d1d tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:57.784391 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-34182d89-dc0e-4476-8b6b-cbd5a46b2d1d tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:57.800370 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-34182d89-dc0e-4476-8b6b-cbd5a46b2d1d tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4" status: 200 len: 1270 microversion: 2.1 time: 0.255932 Aug 27 02:47:57.802575 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 883/1764] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:57 2022] GET /compute/v2.1/servers/60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4 => generated 1270 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:47:57.919019 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-2003c111-1787-49a8-ad9e-ddf522396fbf tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:57.919985 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-2003c111-1787-49a8-ad9e-ddf522396fbf tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] [instance: 4b88e24d-509c-49fe-b5e2-b2698620d6d6] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:57.935002 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2003c111-1787-49a8-ad9e-ddf522396fbf tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:57.937630 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2003c111-1787-49a8-ad9e-ddf522396fbf tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:57.945742 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2003c111-1787-49a8-ad9e-ddf522396fbf tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:57.948487 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2003c111-1787-49a8-ad9e-ddf522396fbf tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:57.949131 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2003c111-1787-49a8-ad9e-ddf522396fbf tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:57.950706 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2003c111-1787-49a8-ad9e-ddf522396fbf tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:57.997814 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-fd872e87-f0ed-4efc-98c7-0a02fb672cd7 tempest-ListImagesTestJSON-1386552364 tempest-ListImagesTestJSON-1386552364-project] Calling method '.version_select at 0x7f5ede8d9e50>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:58.087628 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-fd872e87-f0ed-4efc-98c7-0a02fb672cd7 tempest-ListImagesTestJSON-1386552364 tempest-ListImagesTestJSON-1386552364-project] 10.222.0.70 "GET /compute/v2.1/images/1552acd0-176a-4c81-b680-29d74105e9d6" status: 200 len: 784 microversion: 2.1 time: 0.606664 Aug 27 02:47:58.090408 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 882/1765] 10.222.0.70 () {58 vars in 1233 bytes} [Sat Aug 27 02:47:57 2022] GET /compute/v2.1/images/1552acd0-176a-4c81-b680-29d74105e9d6 => generated 784 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:47:58.110555 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-530ead75-f941-4064-925e-82691f19c980 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Calling method '.version_select at 0x7f5ede8e6af0>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:58.112929 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-2003c111-1787-49a8-ad9e-ddf522396fbf tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073966022576475b983af066d7edb099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96abd4aa8efa4761869dabdd1f143519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:58.121933 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-2003c111-1787-49a8-ad9e-ddf522396fbf tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] 10.222.0.70 "GET /compute/v2.1/servers/4b88e24d-509c-49fe-b5e2-b2698620d6d6" status: 200 len: 1287 microversion: 2.1 time: 0.208050 Aug 27 02:47:58.130291 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 884/1766] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:57 2022] GET /compute/v2.1/servers/4b88e24d-509c-49fe-b5e2-b2698620d6d6 => generated 1287 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:58.148233 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-71425d9f-838c-454a-896e-a96865b811ac tempest-ListImagesTestJSON-1386552364 tempest-ListImagesTestJSON-1386552364-project] Calling method '.version_select at 0x7f5ee321a040>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:58.289065 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-530ead75-f941-4064-925e-82691f19c980 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] 10.222.0.70 "GET /compute/v2.1/images/ab2ca817-1bd6-41d1-b485-99378273bee8" status: 200 len: 1454 microversion: 2.1 time: 0.185173 Aug 27 02:47:58.296176 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 883/1767] 10.222.0.70 () {58 vars in 1233 bytes} [Sat Aug 27 02:47:58 2022] GET /compute/v2.1/images/ab2ca817-1bd6-41d1-b485-99378273bee8 => generated 1454 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:58.297584 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-71425d9f-838c-454a-896e-a96865b811ac tempest-ListImagesTestJSON-1386552364 tempest-ListImagesTestJSON-1386552364-project] 10.222.0.70 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.166007 Aug 27 02:47:58.298353 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 885/1768] 10.222.0.70 () {58 vars in 1122 bytes} [Sat Aug 27 02:47:58 2022] GET /compute/v2.1/images => generated 445 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:47:58.317021 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f983f5f0-223a-45d2-90c4-2d129e87c9de tempest-ListImagesTestJSON-1386552364 tempest-ListImagesTestJSON-1386552364-project] Calling method '.version_select at 0x7f5ede8d9700>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:58.399209 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9f20339a-4d75-4c49-8c5f-36dad8e64a9d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:58.399880 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-9f20339a-4d75-4c49-8c5f-36dad8e64a9d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 3095a9f9-6769-4107-94a5-beac6415694c] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:58.402184 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-f983f5f0-223a-45d2-90c4-2d129e87c9de tempest-ListImagesTestJSON-1386552364 tempest-ListImagesTestJSON-1386552364-project] 10.222.0.70 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.088995 Aug 27 02:47:58.415252 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 884/1769] 10.222.0.70 () {58 vars in 1143 bytes} [Sat Aug 27 02:47:58 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:47:58.420096 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9f20339a-4d75-4c49-8c5f-36dad8e64a9d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:58.422133 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9f20339a-4d75-4c49-8c5f-36dad8e64a9d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:58.423223 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9f20339a-4d75-4c49-8c5f-36dad8e64a9d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:58.425650 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9f20339a-4d75-4c49-8c5f-36dad8e64a9d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:58.427075 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9f20339a-4d75-4c49-8c5f-36dad8e64a9d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:58.427743 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9f20339a-4d75-4c49-8c5f-36dad8e64a9d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:58.825603 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c23141e0-70f2-4910-ab95-533cc469fd3d tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:58.826215 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-c23141e0-70f2-4910-ab95-533cc469fd3d tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: 60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:58.846614 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c23141e0-70f2-4910-ab95-533cc469fd3d tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:58.847111 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c23141e0-70f2-4910-ab95-533cc469fd3d tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:58.847547 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c23141e0-70f2-4910-ab95-533cc469fd3d tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:58.848267 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c23141e0-70f2-4910-ab95-533cc469fd3d tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:58.851225 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c23141e0-70f2-4910-ab95-533cc469fd3d tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:58.851661 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c23141e0-70f2-4910-ab95-533cc469fd3d tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:58.873923 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-9f20339a-4d75-4c49-8c5f-36dad8e64a9d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:58.889400 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9f20339a-4d75-4c49-8c5f-36dad8e64a9d tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/3095a9f9-6769-4107-94a5-beac6415694c" status: 200 len: 1667 microversion: 2.1 time: 0.499197 Aug 27 02:47:58.891811 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 886/1770] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:58 2022] GET /compute/v2.1/servers/3095a9f9-6769-4107-94a5-beac6415694c => generated 1667 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:59.050081 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-c23141e0-70f2-4910-ab95-533cc469fd3d tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:59.067383 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c23141e0-70f2-4910-ab95-533cc469fd3d tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4" status: 200 len: 1270 microversion: 2.1 time: 0.247986 Aug 27 02:47:59.068650 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 885/1771] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:58 2022] GET /compute/v2.1/servers/60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4 => generated 1270 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:47:59.157041 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9b6b96b1-36bf-44d7-a010-80916785d7e3 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:59.160163 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-9b6b96b1-36bf-44d7-a010-80916785d7e3 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] [instance: 4b88e24d-509c-49fe-b5e2-b2698620d6d6] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:59.175947 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9b6b96b1-36bf-44d7-a010-80916785d7e3 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:59.178791 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9b6b96b1-36bf-44d7-a010-80916785d7e3 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:59.179600 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9b6b96b1-36bf-44d7-a010-80916785d7e3 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:59.182743 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9b6b96b1-36bf-44d7-a010-80916785d7e3 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:59.183571 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9b6b96b1-36bf-44d7-a010-80916785d7e3 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:59.186049 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9b6b96b1-36bf-44d7-a010-80916785d7e3 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:59.303793 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-57a6e13b-599a-4acd-a8a3-a5e0f623cd5b tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Calling method '.version_select at 0x7f5ede8e65e0>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:59.333881 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-9b6b96b1-36bf-44d7-a010-80916785d7e3 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073966022576475b983af066d7edb099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96abd4aa8efa4761869dabdd1f143519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:59.344721 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9b6b96b1-36bf-44d7-a010-80916785d7e3 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] 10.222.0.70 "GET /compute/v2.1/servers/4b88e24d-509c-49fe-b5e2-b2698620d6d6" status: 200 len: 1275 microversion: 2.1 time: 0.194496 Aug 27 02:47:59.346023 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 887/1772] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:59 2022] GET /compute/v2.1/servers/4b88e24d-509c-49fe-b5e2-b2698620d6d6 => generated 1275 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:59.391672 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-57a6e13b-599a-4acd-a8a3-a5e0f623cd5b tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] 10.222.0.70 "GET /compute/v2.1/images/ab2ca817-1bd6-41d1-b485-99378273bee8" status: 200 len: 1454 microversion: 2.1 time: 0.091667 Aug 27 02:47:59.392269 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 886/1773] 10.222.0.70 () {58 vars in 1233 bytes} [Sat Aug 27 02:47:59 2022] GET /compute/v2.1/images/ab2ca817-1bd6-41d1-b485-99378273bee8 => generated 1454 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:59.915252 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-cc945d6d-088a-4520-8d68-fa4030eff712 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:59.915701 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-cc945d6d-088a-4520-8d68-fa4030eff712 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 3095a9f9-6769-4107-94a5-beac6415694c] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:59.927756 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cc945d6d-088a-4520-8d68-fa4030eff712 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:59.929175 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cc945d6d-088a-4520-8d68-fa4030eff712 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:59.930664 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cc945d6d-088a-4520-8d68-fa4030eff712 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:59.935157 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cc945d6d-088a-4520-8d68-fa4030eff712 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:59.935814 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cc945d6d-088a-4520-8d68-fa4030eff712 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:59.936456 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cc945d6d-088a-4520-8d68-fa4030eff712 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:00.100808 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-77819192-f597-4b78-bd8b-8ca3f553a202 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:00.101489 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-77819192-f597-4b78-bd8b-8ca3f553a202 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: 60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:00.116907 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-77819192-f597-4b78-bd8b-8ca3f553a202 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:00.119165 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-77819192-f597-4b78-bd8b-8ca3f553a202 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:00.121719 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-77819192-f597-4b78-bd8b-8ca3f553a202 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:00.122733 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-77819192-f597-4b78-bd8b-8ca3f553a202 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:00.127599 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-77819192-f597-4b78-bd8b-8ca3f553a202 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:00.128558 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-77819192-f597-4b78-bd8b-8ca3f553a202 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:00.285387 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-cc945d6d-088a-4520-8d68-fa4030eff712 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:00.293978 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-cc945d6d-088a-4520-8d68-fa4030eff712 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/3095a9f9-6769-4107-94a5-beac6415694c" status: 200 len: 1599 microversion: 2.1 time: 0.382712 Aug 27 02:48:00.299002 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 888/1774] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:59 2022] GET /compute/v2.1/servers/3095a9f9-6769-4107-94a5-beac6415694c => generated 1599 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:00.368476 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-10cd6f5d-b691-4553-9a66-5ade213352b9 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:00.369457 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-10cd6f5d-b691-4553-9a66-5ade213352b9 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] [instance: 4b88e24d-509c-49fe-b5e2-b2698620d6d6] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:00.384625 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-10cd6f5d-b691-4553-9a66-5ade213352b9 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:00.385625 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-10cd6f5d-b691-4553-9a66-5ade213352b9 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:00.386408 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-10cd6f5d-b691-4553-9a66-5ade213352b9 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:00.387409 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-10cd6f5d-b691-4553-9a66-5ade213352b9 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:00.388098 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-10cd6f5d-b691-4553-9a66-5ade213352b9 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:00.388773 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-10cd6f5d-b691-4553-9a66-5ade213352b9 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:00.663560 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-10cd6f5d-b691-4553-9a66-5ade213352b9 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073966022576475b983af066d7edb099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96abd4aa8efa4761869dabdd1f143519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:00.676644 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-10cd6f5d-b691-4553-9a66-5ade213352b9 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] 10.222.0.70 "GET /compute/v2.1/servers/4b88e24d-509c-49fe-b5e2-b2698620d6d6" status: 200 len: 1275 microversion: 2.1 time: 0.312881 Aug 27 02:48:00.679285 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 889/1775] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:00 2022] GET /compute/v2.1/servers/4b88e24d-509c-49fe-b5e2-b2698620d6d6 => generated 1275 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:00.692667 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-20d85001-c180-4cfc-a4e5-0ed8cdc63891 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Calling method '.version_select at 0x7f5ee3091e50>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:00.810398 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-20d85001-c180-4cfc-a4e5-0ed8cdc63891 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] 10.222.0.70 "GET /compute/v2.1/images/ab2ca817-1bd6-41d1-b485-99378273bee8" status: 200 len: 1454 microversion: 2.1 time: 0.129795 Aug 27 02:48:00.810994 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 890/1776] 10.222.0.70 () {58 vars in 1233 bytes} [Sat Aug 27 02:48:00 2022] GET /compute/v2.1/images/ab2ca817-1bd6-41d1-b485-99378273bee8 => generated 1454 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:00.823802 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-16d197ad-a3c5-48d1-980b-60419b5fa102 req-dc37bc29-d70e-4eb0-83f5-8895d5b4afc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "191df585-2175-47be-9bd8-29b914535f47", "name": "network-vif-plugged", "status": "completed", "tag": "178a305e-f6ec-4889-9602-1513853a515b"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:48:00.854389 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-16d197ad-a3c5-48d1-980b-60419b5fa102 req-dc37bc29-d70e-4eb0-83f5-8895d5b4afc1 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:00.858931 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-16d197ad-a3c5-48d1-980b-60419b5fa102 req-dc37bc29-d70e-4eb0-83f5-8895d5b4afc1 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:00.861746 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-16d197ad-a3c5-48d1-980b-60419b5fa102 req-dc37bc29-d70e-4eb0-83f5-8895d5b4afc1 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:00.888197 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-16d197ad-a3c5-48d1-980b-60419b5fa102 req-dc37bc29-d70e-4eb0-83f5-8895d5b4afc1 service nova] Creating event network-vif-plugged:178a305e-f6ec-4889-9602-1513853a515b for instance 191df585-2175-47be-9bd8-29b914535f47 on n-h2-852278-4 Aug 27 02:48:00.899247 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-16d197ad-a3c5-48d1-980b-60419b5fa102 req-dc37bc29-d70e-4eb0-83f5-8895d5b4afc1 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086570 Aug 27 02:48:00.899887 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 891/1777] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:48:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:48:00.955146 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-6ed291cc-6b43-4766-941d-53d5dee41ea8 req-ac6df026-0406-4453-85b6-b3cac2e1249b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3095a9f9-6769-4107-94a5-beac6415694c", "name": "network-vif-deleted", "tag": "ccabb4f8-adfb-4fa5-a578-1d53c8d1dc89"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:48:01.001853 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-6ed291cc-6b43-4766-941d-53d5dee41ea8 req-ac6df026-0406-4453-85b6-b3cac2e1249b service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:01.003700 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-6ed291cc-6b43-4766-941d-53d5dee41ea8 req-ac6df026-0406-4453-85b6-b3cac2e1249b service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:01.003700 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-6ed291cc-6b43-4766-941d-53d5dee41ea8 req-ac6df026-0406-4453-85b6-b3cac2e1249b service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:01.039615 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-6ed291cc-6b43-4766-941d-53d5dee41ea8 req-ac6df026-0406-4453-85b6-b3cac2e1249b service nova] Creating event network-vif-deleted:ccabb4f8-adfb-4fa5-a578-1d53c8d1dc89 for instance 3095a9f9-6769-4107-94a5-beac6415694c on n-h2-852278-4 Aug 27 02:48:01.060537 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-6ed291cc-6b43-4766-941d-53d5dee41ea8 req-ac6df026-0406-4453-85b6-b3cac2e1249b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114546 Aug 27 02:48:01.061166 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 892/1778] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:48:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:48:01.082304 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-77819192-f597-4b78-bd8b-8ca3f553a202 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:01.091838 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-77819192-f597-4b78-bd8b-8ca3f553a202 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4" status: 200 len: 1312 microversion: 2.1 time: 1.006372 Aug 27 02:48:01.093357 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 887/1779] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:00 2022] GET /compute/v2.1/servers/60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4 => generated 1312 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:01.321278 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-27812716-e230-4ce6-a543-d5987dd8dbf7 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:01.321970 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-27812716-e230-4ce6-a543-d5987dd8dbf7 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 3095a9f9-6769-4107-94a5-beac6415694c] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:01.349761 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-27812716-e230-4ce6-a543-d5987dd8dbf7 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:01.353698 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-27812716-e230-4ce6-a543-d5987dd8dbf7 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:01.355947 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-27812716-e230-4ce6-a543-d5987dd8dbf7 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:01.356980 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-27812716-e230-4ce6-a543-d5987dd8dbf7 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:01.358772 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-27812716-e230-4ce6-a543-d5987dd8dbf7 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:01.362434 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-27812716-e230-4ce6-a543-d5987dd8dbf7 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:01.452943 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-27812716-e230-4ce6-a543-d5987dd8dbf7 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:01.455812 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-27812716-e230-4ce6-a543-d5987dd8dbf7 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:01.458741 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-27812716-e230-4ce6-a543-d5987dd8dbf7 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:01.459413 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.instance [None req-27812716-e230-4ce6-a543-d5987dd8dbf7 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lazy-loading 'fault' on Instance uuid 3095a9f9-6769-4107-94a5-beac6415694c {{(pid=134052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:48:01.560461 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-27812716-e230-4ce6-a543-d5987dd8dbf7 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:01.573840 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-27812716-e230-4ce6-a543-d5987dd8dbf7 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/3095a9f9-6769-4107-94a5-beac6415694c" status: 200 len: 1324 microversion: 2.1 time: 0.251931 Aug 27 02:48:01.576107 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 893/1780] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:01 2022] GET /compute/v2.1/servers/3095a9f9-6769-4107-94a5-beac6415694c => generated 1324 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:01.701032 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8c730884-0393-4ff0-a504-7ca9c5fdd549 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:01.702415 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-8c730884-0393-4ff0-a504-7ca9c5fdd549 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] [instance: 4b88e24d-509c-49fe-b5e2-b2698620d6d6] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:01.721233 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8c730884-0393-4ff0-a504-7ca9c5fdd549 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:01.721919 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8c730884-0393-4ff0-a504-7ca9c5fdd549 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:01.728165 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8c730884-0393-4ff0-a504-7ca9c5fdd549 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:01.730466 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8c730884-0393-4ff0-a504-7ca9c5fdd549 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:01.730946 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8c730884-0393-4ff0-a504-7ca9c5fdd549 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:01.731379 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8c730884-0393-4ff0-a504-7ca9c5fdd549 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:01.826450 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-7c4202c9-653e-4989-9696-3bf9fcf3b523 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Calling method '.version_select at 0x7f5ee321a040>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:01.908428 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-7c4202c9-653e-4989-9696-3bf9fcf3b523 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] 10.222.0.70 "GET /compute/v2.1/images/ab2ca817-1bd6-41d1-b485-99378273bee8" status: 200 len: 1454 microversion: 2.1 time: 0.086493 Aug 27 02:48:01.909023 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 894/1781] 10.222.0.70 () {58 vars in 1233 bytes} [Sat Aug 27 02:48:01 2022] GET /compute/v2.1/images/ab2ca817-1bd6-41d1-b485-99378273bee8 => generated 1454 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:48:02.113941 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-04e6f3ca-7c0f-4ed8-8ac9-def0ed179a89 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:02.115281 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-04e6f3ca-7c0f-4ed8-8ac9-def0ed179a89 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: 60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:02.133656 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-04e6f3ca-7c0f-4ed8-8ac9-def0ed179a89 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:02.137823 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-04e6f3ca-7c0f-4ed8-8ac9-def0ed179a89 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:02.148195 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-04e6f3ca-7c0f-4ed8-8ac9-def0ed179a89 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:02.149109 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-04e6f3ca-7c0f-4ed8-8ac9-def0ed179a89 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:02.149570 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-04e6f3ca-7c0f-4ed8-8ac9-def0ed179a89 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:02.150049 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-04e6f3ca-7c0f-4ed8-8ac9-def0ed179a89 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:02.370463 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-8c730884-0393-4ff0-a504-7ca9c5fdd549 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073966022576475b983af066d7edb099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96abd4aa8efa4761869dabdd1f143519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:02.382462 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-8c730884-0393-4ff0-a504-7ca9c5fdd549 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] 10.222.0.70 "GET /compute/v2.1/servers/4b88e24d-509c-49fe-b5e2-b2698620d6d6" status: 200 len: 1317 microversion: 2.1 time: 0.685448 Aug 27 02:48:02.387907 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 888/1782] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:01 2022] GET /compute/v2.1/servers/4b88e24d-509c-49fe-b5e2-b2698620d6d6 => generated 1317 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:02.548085 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-04e6f3ca-7c0f-4ed8-8ac9-def0ed179a89 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:02.560436 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-04e6f3ca-7c0f-4ed8-8ac9-def0ed179a89 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4" status: 200 len: 1312 microversion: 2.1 time: 0.449248 Aug 27 02:48:02.562180 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 895/1783] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:02 2022] GET /compute/v2.1/servers/60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4 => generated 1312 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:48:02.599151 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-bcbfa38c-7cc2-4075-b442-54843c97a37f tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:02.600157 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-bcbfa38c-7cc2-4075-b442-54843c97a37f tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 3095a9f9-6769-4107-94a5-beac6415694c] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:02.611538 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bcbfa38c-7cc2-4075-b442-54843c97a37f tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:02.612467 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bcbfa38c-7cc2-4075-b442-54843c97a37f tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:02.613062 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bcbfa38c-7cc2-4075-b442-54843c97a37f tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:02.613955 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bcbfa38c-7cc2-4075-b442-54843c97a37f tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:02.615348 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bcbfa38c-7cc2-4075-b442-54843c97a37f tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:02.617001 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bcbfa38c-7cc2-4075-b442-54843c97a37f tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:02.659652 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-bcbfa38c-7cc2-4075-b442-54843c97a37f tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] HTTP exception thrown: Instance 3095a9f9-6769-4107-94a5-beac6415694c could not be found. Aug 27 02:48:02.663301 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-bcbfa38c-7cc2-4075-b442-54843c97a37f tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Request method failure captured: Aug 27 02:48:02.663301 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/3095a9f9-6769-4107-94a5-beac6415694c HTTP/1.1 Aug 27 02:48:02.663301 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:48:02.663301 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:48:02.663301 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:48:02.663301 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:48:02.663301 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:48:02.663301 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:48:02.663301 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:48:02.663301 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:48:02.663301 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYQ0RUq_2c9yZQ-tBPbmZSdvHy16w3uYqnC3ulfGKVhuo9V1qT0DhwpbZGrjZ7gKl36Bwe3ndp4oPtN8Yb1NhLVtR6ctzUSsGxj9x2fK83huw_99YjNve5IbacPLlJkw2C8b_A-bkfhkR5WCzDVEXkxJm7KG7Of9mLoKJwUixrEmvkI Aug 27 02:48:02.663301 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:48:02.663301 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:48:02.663301 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:48:02.663301 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:48:02.663301 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:48:02.663301 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:48:02.663301 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 42ec913a638c4c8c8749be73705d2c65 Aug 27 02:48:02.663301 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-LiveMigrationTest-966742224 Aug 27 02:48:02.663301 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:48:02.663301 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:48:02.664472 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/42ec913a638c4c8c8749be73705d2c65"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_42ec913a638c4c8c8749be73705d2c65", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/42ec913a638c4c8c8749be73705d2c65"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/42ec913a638c4c8c8749be73705d2c65"}]}] Aug 27 02:48:02.664472 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-LiveMigrationTest-966742224 Aug 27 02:48:02.664472 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 42ec913a638c4c8c8749be73705d2c65 Aug 27 02:48:02.664472 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-LiveMigrationTest-966742224 Aug 27 02:48:02.664472 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-LiveMigrationTest-966742224-project Aug 27 02:48:02.664472 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:48:02.664472 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:48:02.664472 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 6305debcc9294643bbed97f08de171bc Aug 27 02:48:02.664472 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-LiveMigrationTest-966742224-project Aug 27 02:48:02.664472 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 02:48:02.664472 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance 3095a9f9-6769-4107-94a5-beac6415694c could not be found. Aug 27 02:48:02.664472 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '3095a9f9-6769-4107-94a5-beac6415694c'} Aug 27 02:48:02.665142 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:48:02.665142 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:48:02.665142 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:48:02.665142 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:48:02.665142 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:48:02.665142 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:48:02.665142 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:48:02.665142 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:48:02.665142 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:48:02.665142 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:48:02.665142 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3095a9f9-6769-4107-94a5-beac6415694c could not be found. Aug 27 02:48:02.665142 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:48:02.665142 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:48:02.665142 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:48:02.665142 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:48:02.665142 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:48:02.665142 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:48:02.665142 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:48:02.665142 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:48:02.665142 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:48:02.666116 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:48:02.666116 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:48:02.666116 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:48:02.666116 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:48:02.666116 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:48:02.666116 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:48:02.666116 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:48:02.666116 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3095a9f9-6769-4107-94a5-beac6415694c could not be found. Aug 27 02:48:02.666116 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:48:02.666116 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:48:02.666116 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:48:02.666116 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:48:02.666116 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:48:02.666116 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:48:02.666116 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:48:02.666116 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:48:02.666116 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3095a9f9-6769-4107-94a5-beac6415694c could not be found. Aug 27 02:48:02.666116 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:48:02.667767 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-bcbfa38c-7cc2-4075-b442-54843c97a37f tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Returning 404 to user: Instance 3095a9f9-6769-4107-94a5-beac6415694c could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:48:02.669421 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-bcbfa38c-7cc2-4075-b442-54843c97a37f tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/3095a9f9-6769-4107-94a5-beac6415694c" status: 404 len: 111 microversion: 2.1 time: 0.074522 Aug 27 02:48:02.672248 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 889/1784] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:02 2022] GET /compute/v2.1/servers/3095a9f9-6769-4107-94a5-beac6415694c => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:48:02.681187 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ae7a8e89-dc15-45c3-a49f-147c7357dc67 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '.version_select at 0x7f5ee30f5790>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:02.719500 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ae7a8e89-dc15-45c3-a49f-147c7357dc67 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-295401307" status: 202 len: 0 microversion: 2.1 time: 0.042191 Aug 27 02:48:02.720851 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 896/1785] 10.222.0.70 () {58 vars in 1218 bytes} [Sat Aug 27 02:48:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-295401307 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:48:02.923506 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e009baeb-3eb6-4732-a7ac-f79a7fed6e68 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Calling method '.version_select at 0x7f5ede994c10>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:03.018339 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e009baeb-3eb6-4732-a7ac-f79a7fed6e68 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] 10.222.0.70 "GET /compute/v2.1/images/ab2ca817-1bd6-41d1-b485-99378273bee8" status: 200 len: 1454 microversion: 2.1 time: 0.098237 Aug 27 02:48:03.019285 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 890/1786] 10.222.0.70 () {58 vars in 1233 bytes} [Sat Aug 27 02:48:02 2022] GET /compute/v2.1/images/ab2ca817-1bd6-41d1-b485-99378273bee8 => generated 1454 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:03.408907 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6c360442-3706-47b3-bacc-8b23613fb567 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:03.410300 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-6c360442-3706-47b3-bacc-8b23613fb567 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] [instance: 4b88e24d-509c-49fe-b5e2-b2698620d6d6] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:03.430408 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6c360442-3706-47b3-bacc-8b23613fb567 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:03.433910 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6c360442-3706-47b3-bacc-8b23613fb567 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:03.434476 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6c360442-3706-47b3-bacc-8b23613fb567 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:03.435979 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6c360442-3706-47b3-bacc-8b23613fb567 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:03.438841 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6c360442-3706-47b3-bacc-8b23613fb567 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:03.439442 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6c360442-3706-47b3-bacc-8b23613fb567 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:03.581906 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-bd2355d5-8d45-4c2f-99b1-54a2710fa17f tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:03.583228 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-bd2355d5-8d45-4c2f-99b1-54a2710fa17f tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: 60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:03.586175 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=84,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:48:03.598566 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bd2355d5-8d45-4c2f-99b1-54a2710fa17f tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:03.604240 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bd2355d5-8d45-4c2f-99b1-54a2710fa17f tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:03.605131 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bd2355d5-8d45-4c2f-99b1-54a2710fa17f tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:03.607018 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bd2355d5-8d45-4c2f-99b1-54a2710fa17f tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:03.608964 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bd2355d5-8d45-4c2f-99b1-54a2710fa17f tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:03.610186 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bd2355d5-8d45-4c2f-99b1-54a2710fa17f tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:04.017398 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:48:04.024965 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-6c360442-3706-47b3-bacc-8b23613fb567 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073966022576475b983af066d7edb099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96abd4aa8efa4761869dabdd1f143519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:04.045282 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-6c360442-3706-47b3-bacc-8b23613fb567 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] 10.222.0.70 "GET /compute/v2.1/servers/4b88e24d-509c-49fe-b5e2-b2698620d6d6" status: 200 len: 1317 microversion: 2.1 time: 0.641471 Aug 27 02:48:04.046536 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 897/1787] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:03 2022] GET /compute/v2.1/servers/4b88e24d-509c-49fe-b5e2-b2698620d6d6 => generated 1317 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:04.490788 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-bd2355d5-8d45-4c2f-99b1-54a2710fa17f tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:04.502952 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-2c3c26f4-049f-4e65-a2ba-1a74eb802baa tempest-AbsoluteLimitsNegativeTestJSON-1966805226 tempest-AbsoluteLimitsNegativeTestJSON-1966805226-project] Calling method '.version_select at 0x7f5ee2ef7280>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:04.521790 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-bd2355d5-8d45-4c2f-99b1-54a2710fa17f tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4" status: 200 len: 1312 microversion: 2.1 time: 0.942497 Aug 27 02:48:04.525234 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 891/1788] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:03 2022] GET /compute/v2.1/servers/60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4 => generated 1312 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:48:04.539128 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-db5c29c5-410c-46b3-b96c-f68baeed4932 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Calling method '.version_select at 0x7f5ede936820>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:04.544437 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2c3c26f4-049f-4e65-a2ba-1a74eb802baa tempest-AbsoluteLimitsNegativeTestJSON-1966805226 tempest-AbsoluteLimitsNegativeTestJSON-1966805226-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:04.547609 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2c3c26f4-049f-4e65-a2ba-1a74eb802baa tempest-AbsoluteLimitsNegativeTestJSON-1966805226 tempest-AbsoluteLimitsNegativeTestJSON-1966805226-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:04.548197 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2c3c26f4-049f-4e65-a2ba-1a74eb802baa tempest-AbsoluteLimitsNegativeTestJSON-1966805226 tempest-AbsoluteLimitsNegativeTestJSON-1966805226-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:04.549897 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2c3c26f4-049f-4e65-a2ba-1a74eb802baa tempest-AbsoluteLimitsNegativeTestJSON-1966805226 tempest-AbsoluteLimitsNegativeTestJSON-1966805226-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:04.551753 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2c3c26f4-049f-4e65-a2ba-1a74eb802baa tempest-AbsoluteLimitsNegativeTestJSON-1966805226 tempest-AbsoluteLimitsNegativeTestJSON-1966805226-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:04.552349 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2c3c26f4-049f-4e65-a2ba-1a74eb802baa tempest-AbsoluteLimitsNegativeTestJSON-1966805226 tempest-AbsoluteLimitsNegativeTestJSON-1966805226-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:04.582703 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:48:04.606075 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-2c3c26f4-049f-4e65-a2ba-1a74eb802baa tempest-AbsoluteLimitsNegativeTestJSON-1966805226 tempest-AbsoluteLimitsNegativeTestJSON-1966805226-project] 10.222.0.70 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.556348 Aug 27 02:48:04.634000 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 898/1789] 10.222.0.70 () {58 vars in 1122 bytes} [Sat Aug 27 02:48:04 2022] GET /compute/v2.1/limits => generated 511 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:48:04.642558 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-db5c29c5-410c-46b3-b96c-f68baeed4932 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] 10.222.0.70 "GET /compute/v2.1/images/ab2ca817-1bd6-41d1-b485-99378273bee8" status: 200 len: 1454 microversion: 2.1 time: 0.110162 Aug 27 02:48:04.652124 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 892/1790] 10.222.0.70 () {58 vars in 1233 bytes} [Sat Aug 27 02:48:04 2022] GET /compute/v2.1/images/ab2ca817-1bd6-41d1-b485-99378273bee8 => generated 1454 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:04.658742 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-504af1c7-4116-41db-aff0-eda59fca1d11 req-575a7e66-3a15-4130-92ac-bbd38f4cb6e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b88e24d-509c-49fe-b5e2-b2698620d6d6", "tag": "8e5488cf-e7f9-42ad-b395-21ba7264782d"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:48:04.691088 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-504af1c7-4116-41db-aff0-eda59fca1d11 req-575a7e66-3a15-4130-92ac-bbd38f4cb6e9 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:04.700076 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-504af1c7-4116-41db-aff0-eda59fca1d11 req-575a7e66-3a15-4130-92ac-bbd38f4cb6e9 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:04.702667 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-504af1c7-4116-41db-aff0-eda59fca1d11 req-575a7e66-3a15-4130-92ac-bbd38f4cb6e9 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:04.746100 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-504af1c7-4116-41db-aff0-eda59fca1d11 req-575a7e66-3a15-4130-92ac-bbd38f4cb6e9 service nova] Creating event network-changed:8e5488cf-e7f9-42ad-b395-21ba7264782d for instance 4b88e24d-509c-49fe-b5e2-b2698620d6d6 on n-h1-852278-4 Aug 27 02:48:04.764526 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-504af1c7-4116-41db-aff0-eda59fca1d11 req-575a7e66-3a15-4130-92ac-bbd38f4cb6e9 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126113 Aug 27 02:48:04.768184 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 899/1791] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:48:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:48:04.923984 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-759ffdf7-8685-4df3-bd5e-f54ffb69d362 tempest-AbsoluteLimitsNegativeTestJSON-1966805226 tempest-AbsoluteLimitsNegativeTestJSON-1966805226-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-701445254", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:48:05.036793 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.network.neutron [None req-759ffdf7-8685-4df3-bd5e-f54ffb69d362 tempest-AbsoluteLimitsNegativeTestJSON-1966805226 tempest-AbsoluteLimitsNegativeTestJSON-1966805226-project] validate_networks() for None {{(pid=134051) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:48:05.068472 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c096711c-0448-4e8b-bc32-295dcf91a2bd tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:05.069781 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-c096711c-0448-4e8b-bc32-295dcf91a2bd tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] [instance: 4b88e24d-509c-49fe-b5e2-b2698620d6d6] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:05.083398 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c096711c-0448-4e8b-bc32-295dcf91a2bd tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:05.093220 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c096711c-0448-4e8b-bc32-295dcf91a2bd tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:05.093804 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c096711c-0448-4e8b-bc32-295dcf91a2bd tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:05.094585 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c096711c-0448-4e8b-bc32-295dcf91a2bd tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:05.095061 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c096711c-0448-4e8b-bc32-295dcf91a2bd tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:05.095492 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c096711c-0448-4e8b-bc32-295dcf91a2bd tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:05.200884 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=4 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:48:05.629473 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-c096711c-0448-4e8b-bc32-295dcf91a2bd tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073966022576475b983af066d7edb099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96abd4aa8efa4761869dabdd1f143519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:05.644433 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c096711c-0448-4e8b-bc32-295dcf91a2bd tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] 10.222.0.70 "GET /compute/v2.1/servers/4b88e24d-509c-49fe-b5e2-b2698620d6d6" status: 200 len: 1317 microversion: 2.1 time: 0.580834 Aug 27 02:48:05.647774 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 900/1792] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:05 2022] GET /compute/v2.1/servers/4b88e24d-509c-49fe-b5e2-b2698620d6d6 => generated 1317 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:48:05.662288 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-356aa376-9b92-4139-afdb-5da0e577e16c req-778c34c2-c5b3-4e88-a33d-6d63a1630d63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4", "tag": "f88818f1-ef30-4d4a-9180-9bdfc399cfe1"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:48:05.692550 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-356aa376-9b92-4139-afdb-5da0e577e16c req-778c34c2-c5b3-4e88-a33d-6d63a1630d63 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:05.693224 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-356aa376-9b92-4139-afdb-5da0e577e16c req-778c34c2-c5b3-4e88-a33d-6d63a1630d63 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:05.694250 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-356aa376-9b92-4139-afdb-5da0e577e16c req-778c34c2-c5b3-4e88-a33d-6d63a1630d63 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:05.708764 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-356aa376-9b92-4139-afdb-5da0e577e16c req-778c34c2-c5b3-4e88-a33d-6d63a1630d63 service nova] Creating event network-changed:f88818f1-ef30-4d4a-9180-9bdfc399cfe1 for instance 60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4 on n-h1-852278-4 Aug 27 02:48:05.714738 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-356aa376-9b92-4139-afdb-5da0e577e16c req-778c34c2-c5b3-4e88-a33d-6d63a1630d63 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065470 Aug 27 02:48:05.715716 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 901/1793] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:48:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:48:05.722541 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-bfdc7376-a467-4dc3-9b37-a182647a17be tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:05.723683 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-bfdc7376-a467-4dc3-9b37-a182647a17be tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 14e68153-ad1e-4028-8580-dcb179346f31] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:05.739904 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=14 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:48:05.751864 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bfdc7376-a467-4dc3-9b37-a182647a17be tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:05.752859 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bfdc7376-a467-4dc3-9b37-a182647a17be tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:05.753509 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bfdc7376-a467-4dc3-9b37-a182647a17be tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:05.754575 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bfdc7376-a467-4dc3-9b37-a182647a17be tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:05.755227 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bfdc7376-a467-4dc3-9b37-a182647a17be tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:05.755817 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bfdc7376-a467-4dc3-9b37-a182647a17be tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:05.761968 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-759ffdf7-8685-4df3-bd5e-f54ffb69d362 tempest-AbsoluteLimitsNegativeTestJSON-1966805226 tempest-AbsoluteLimitsNegativeTestJSON-1966805226-project] Getting quotas for project 0ff0b66400764d2eb131ed7dda7407ae. Resources: dict_keys(['metadata_items']) {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:48:05.772023 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-759ffdf7-8685-4df3-bd5e-f54ffb69d362 tempest-AbsoluteLimitsNegativeTestJSON-1966805226 tempest-AbsoluteLimitsNegativeTestJSON-1966805226-project] Getting quotas for user 86695f8aadbe4d79bfa5c8ccc251908e and project 0ff0b66400764d2eb131ed7dda7407ae. Resources: dict_keys(['metadata_items']) {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:48:05.796835 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-759ffdf7-8685-4df3-bd5e-f54ffb69d362 tempest-AbsoluteLimitsNegativeTestJSON-1966805226 tempest-AbsoluteLimitsNegativeTestJSON-1966805226-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Aug 27 02:48:05.818700 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-759ffdf7-8685-4df3-bd5e-f54ffb69d362 tempest-AbsoluteLimitsNegativeTestJSON-1966805226 tempest-AbsoluteLimitsNegativeTestJSON-1966805226-project] Request method failure captured: Aug 27 02:48:05.818700 n-d-852278-4 devstack@n-api.service[134051]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 02:48:05.818700 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:48:05.818700 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:48:05.818700 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:48:05.818700 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 1751 Aug 27 02:48:05.818700 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:48:05.818700 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:48:05.818700 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:48:05.818700 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:48:05.818700 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYXjsp4kFspejeiqp_aedPnJq_2xK8RaVncAocEN8Fqkahs9sn6SK5L-S_nXNgphcADaSBJbmKkMYtzv8yVJEemwEUj73JR9nRQULG0aBXDPgJcG9NmZ7hjlINfvJVFWS5SdoXiZ5f7Acc5a7WLFo3Sy9RqL1N8R_XUGS1b4KUJRRtM Aug 27 02:48:05.818700 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:48:05.818700 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:48:05.818700 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:48:05.818700 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:48:05.818700 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:48:05.818700 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:48:05.818700 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 0ff0b66400764d2eb131ed7dda7407ae Aug 27 02:48:05.818700 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-1966805226 Aug 27 02:48:05.818700 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:48:05.818700 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:48:05.818700 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0ff0b66400764d2eb131ed7dda7407ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_0ff0b66400764d2eb131ed7dda7407ae", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0ff0b66400764d2eb131ed7dda7407ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/0ff0b66400764d2eb131ed7dda7407ae"}]}] Aug 27 02:48:05.818700 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-1966805226 Aug 27 02:48:05.818700 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 0ff0b66400764d2eb131ed7dda7407ae Aug 27 02:48:05.818700 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-1966805226 Aug 27 02:48:05.818700 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-1966805226-project Aug 27 02:48:05.818700 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:48:05.818700 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:48:05.818700 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 86695f8aadbe4d79bfa5c8ccc251908e Aug 27 02:48:05.818700 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-1966805226-project Aug 27 02:48:05.818700 n-d-852278-4 devstack@n-api.service[134051]: Aug 27 02:48:05.818700 n-d-852278-4 devstack@n-api.service[134051]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-701445254", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Aug 27 02:48:05.818700 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 02:48:05.818700 n-d-852278-4 devstack@n-api.service[134051]: exception: Maximum number of metadata items exceeds 128 Aug 27 02:48:05.820666 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-701445254', 'imageRef': '1552acd0-176a-4c81-b680-29d74105e9d6', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Aug 27 02:48:05.820666 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:48:05.820666 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:48:05.820666 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Aug 27 02:48:05.820666 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Aug 27 02:48:05.820666 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 02:48:05.820666 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 02:48:05.820666 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Aug 27 02:48:05.820666 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Aug 27 02:48:05.820666 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Aug 27 02:48:05.820666 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Aug 27 02:48:05.820666 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Aug 27 02:48:05.820666 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Aug 27 02:48:05.820666 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Aug 27 02:48:05.820666 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:48:05.820666 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:48:05.820666 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:48:05.820666 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:48:05.820666 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 27 02:48:05.820666 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 27 02:48:05.820666 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 27 02:48:05.820666 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 27 02:48:05.820666 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Aug 27 02:48:05.820666 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Aug 27 02:48:05.820666 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Aug 27 02:48:05.820666 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Aug 27 02:48:05.820666 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Aug 27 02:48:05.820666 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Aug 27 02:48:05.820666 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Aug 27 02:48:05.820666 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:48:05.820666 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:48:05.820666 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:48:05.820666 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:48:05.820666 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:48:05.820666 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:48:05.820666 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:48:05.820666 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:48:05.820666 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:48:05.820666 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:48:05.820666 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:48:05.820666 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:48:05.820666 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:48:05.820666 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:48:05.820666 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:48:05.822829 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:48:05.822829 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 27 02:48:05.822829 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 27 02:48:05.822829 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 27 02:48:05.822829 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Aug 27 02:48:05.822829 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:48:05.822829 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:48:05.822829 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:48:05.822829 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:48:05.822829 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:48:05.822829 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:48:05.822829 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:48:05.822829 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:48:05.822829 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Aug 27 02:48:05.822829 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:48:05.822829 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-759ffdf7-8685-4df3-bd5e-f54ffb69d362 tempest-AbsoluteLimitsNegativeTestJSON-1966805226 tempest-AbsoluteLimitsNegativeTestJSON-1966805226-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:48:05.822829 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-759ffdf7-8685-4df3-bd5e-f54ffb69d362 tempest-AbsoluteLimitsNegativeTestJSON-1966805226 tempest-AbsoluteLimitsNegativeTestJSON-1966805226-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.903140 Aug 27 02:48:05.826311 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 893/1794] 10.222.0.70 () {60 vars in 1148 bytes} [Sat Aug 27 02:48:04 2022] POST /compute/v2.1/servers => generated 87 bytes in 909 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Aug 27 02:48:05.834297 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-96dcface-2ed6-4981-8f7a-9f4f58c78b34 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:05.835288 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-96dcface-2ed6-4981-8f7a-9f4f58c78b34 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: 60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:05.847062 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-bfdc7376-a467-4dc3-9b37-a182647a17be tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 14e68153-ad1e-4028-8580-dcb179346f31] Going to try to terminate instance {{(pid=134052) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:48:05.847652 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-96dcface-2ed6-4981-8f7a-9f4f58c78b34 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:05.848349 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-96dcface-2ed6-4981-8f7a-9f4f58c78b34 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:05.849010 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-96dcface-2ed6-4981-8f7a-9f4f58c78b34 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:05.850044 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-96dcface-2ed6-4981-8f7a-9f4f58c78b34 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:05.850730 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-96dcface-2ed6-4981-8f7a-9f4f58c78b34 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:05.851629 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-96dcface-2ed6-4981-8f7a-9f4f58c78b34 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:06.003340 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-bfdc7376-a467-4dc3-9b37-a182647a17be tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "DELETE /compute/v2.1/servers/14e68153-ad1e-4028-8580-dcb179346f31" status: 204 len: 0 microversion: 2.1 time: 0.284966 Aug 27 02:48:06.004665 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 902/1795] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:48:05 2022] DELETE /compute/v2.1/servers/14e68153-ad1e-4028-8580-dcb179346f31 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:48:06.022082 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-eee92173-74b0-4f30-984d-6570698c3fe2 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Calling method '.version_select at 0x7f5ee2ef71f0>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:06.159278 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-eee92173-74b0-4f30-984d-6570698c3fe2 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] 10.222.0.70 "GET /compute/v2.1/images/ab2ca817-1bd6-41d1-b485-99378273bee8" status: 200 len: 1454 microversion: 2.1 time: 0.152959 Aug 27 02:48:06.171825 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 903/1796] 10.222.0.70 () {58 vars in 1233 bytes} [Sat Aug 27 02:48:06 2022] GET /compute/v2.1/images/ab2ca817-1bd6-41d1-b485-99378273bee8 => generated 1454 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:06.192148 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-234bc2f9-8ba2-4159-82dc-26cb526f98fc tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:06.209378 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-234bc2f9-8ba2-4159-82dc-26cb526f98fc tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 14e68153-ad1e-4028-8580-dcb179346f31] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:06.223645 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-234bc2f9-8ba2-4159-82dc-26cb526f98fc tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:06.227486 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-234bc2f9-8ba2-4159-82dc-26cb526f98fc tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:06.228144 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-234bc2f9-8ba2-4159-82dc-26cb526f98fc tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:06.232689 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-234bc2f9-8ba2-4159-82dc-26cb526f98fc tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:06.233360 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-234bc2f9-8ba2-4159-82dc-26cb526f98fc tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:06.235136 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-234bc2f9-8ba2-4159-82dc-26cb526f98fc tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:06.800734 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-234bc2f9-8ba2-4159-82dc-26cb526f98fc tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:06.805183 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:48:06.816180 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-234bc2f9-8ba2-4159-82dc-26cb526f98fc tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/14e68153-ad1e-4028-8580-dcb179346f31" status: 200 len: 1484 microversion: 2.1 time: 0.641465 Aug 27 02:48:06.817349 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 904/1797] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:06 2022] GET /compute/v2.1/servers/14e68153-ad1e-4028-8580-dcb179346f31 => generated 1484 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:06.828148 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-075fc58c-b7af-480f-9c4c-bcbfd6bc89cf tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:06.829500 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-075fc58c-b7af-480f-9c4c-bcbfd6bc89cf tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] [instance: 4b88e24d-509c-49fe-b5e2-b2698620d6d6] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:06.865606 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-96dcface-2ed6-4981-8f7a-9f4f58c78b34 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:06.877727 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-96dcface-2ed6-4981-8f7a-9f4f58c78b34 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4" status: 200 len: 1312 microversion: 2.1 time: 1.048908 Aug 27 02:48:06.878856 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 894/1798] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:05 2022] GET /compute/v2.1/servers/60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4 => generated 1312 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:06.880689 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-075fc58c-b7af-480f-9c4c-bcbfd6bc89cf tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:06.882131 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-075fc58c-b7af-480f-9c4c-bcbfd6bc89cf tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:06.882591 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-075fc58c-b7af-480f-9c4c-bcbfd6bc89cf tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:06.883338 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-075fc58c-b7af-480f-9c4c-bcbfd6bc89cf tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:06.883785 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-075fc58c-b7af-480f-9c4c-bcbfd6bc89cf tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:06.884201 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-075fc58c-b7af-480f-9c4c-bcbfd6bc89cf tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:07.088406 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-075fc58c-b7af-480f-9c4c-bcbfd6bc89cf tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073966022576475b983af066d7edb099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96abd4aa8efa4761869dabdd1f143519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:07.097005 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-075fc58c-b7af-480f-9c4c-bcbfd6bc89cf tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] 10.222.0.70 "GET /compute/v2.1/servers/4b88e24d-509c-49fe-b5e2-b2698620d6d6" status: 200 len: 1317 microversion: 2.1 time: 0.278179 Aug 27 02:48:07.098199 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 905/1799] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:06 2022] GET /compute/v2.1/servers/4b88e24d-509c-49fe-b5e2-b2698620d6d6 => generated 1317 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:07.176616 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-6037d7a2-b132-4e65-9d2d-24ea02606d2d tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Calling method '.version_select at 0x7f5ede936700>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:07.265612 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-6037d7a2-b132-4e65-9d2d-24ea02606d2d tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] 10.222.0.70 "GET /compute/v2.1/images/ab2ca817-1bd6-41d1-b485-99378273bee8" status: 200 len: 1454 microversion: 2.1 time: 0.092757 Aug 27 02:48:07.266427 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 895/1800] 10.222.0.70 () {58 vars in 1233 bytes} [Sat Aug 27 02:48:07 2022] GET /compute/v2.1/images/ab2ca817-1bd6-41d1-b485-99378273bee8 => generated 1454 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:07.847547 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3f83cdf2-dee0-4d46-b223-25c4b3a8b303 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:07.848296 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-3f83cdf2-dee0-4d46-b223-25c4b3a8b303 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 14e68153-ad1e-4028-8580-dcb179346f31] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:07.868304 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3f83cdf2-dee0-4d46-b223-25c4b3a8b303 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:07.870175 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3f83cdf2-dee0-4d46-b223-25c4b3a8b303 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:07.871270 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3f83cdf2-dee0-4d46-b223-25c4b3a8b303 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:07.873397 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3f83cdf2-dee0-4d46-b223-25c4b3a8b303 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:07.876577 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3f83cdf2-dee0-4d46-b223-25c4b3a8b303 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:07.877220 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3f83cdf2-dee0-4d46-b223-25c4b3a8b303 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:07.898748 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d2f82abc-ffdc-42e3-8fe0-32df771d9106 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:07.901137 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d2f82abc-ffdc-42e3-8fe0-32df771d9106 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: 60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:07.933622 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d2f82abc-ffdc-42e3-8fe0-32df771d9106 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:07.934656 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d2f82abc-ffdc-42e3-8fe0-32df771d9106 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:07.935315 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d2f82abc-ffdc-42e3-8fe0-32df771d9106 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:07.937103 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d2f82abc-ffdc-42e3-8fe0-32df771d9106 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:07.937811 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d2f82abc-ffdc-42e3-8fe0-32df771d9106 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:07.938613 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d2f82abc-ffdc-42e3-8fe0-32df771d9106 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:08.413160 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-3f83cdf2-dee0-4d46-b223-25c4b3a8b303 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:08.421104 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-3f83cdf2-dee0-4d46-b223-25c4b3a8b303 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/14e68153-ad1e-4028-8580-dcb179346f31" status: 200 len: 1484 microversion: 2.1 time: 0.583656 Aug 27 02:48:08.424750 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 906/1801] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:07 2022] GET /compute/v2.1/servers/14e68153-ad1e-4028-8580-dcb179346f31 => generated 1484 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:08.429253 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-dd7c7fce-e584-45ae-a38f-7743d61d4535 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:08.429856 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-dd7c7fce-e584-45ae-a38f-7743d61d4535 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] [instance: 4b88e24d-509c-49fe-b5e2-b2698620d6d6] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:08.447066 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dd7c7fce-e584-45ae-a38f-7743d61d4535 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:08.447554 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dd7c7fce-e584-45ae-a38f-7743d61d4535 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:08.453179 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dd7c7fce-e584-45ae-a38f-7743d61d4535 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:08.454088 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dd7c7fce-e584-45ae-a38f-7743d61d4535 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:08.454687 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dd7c7fce-e584-45ae-a38f-7743d61d4535 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:08.455274 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dd7c7fce-e584-45ae-a38f-7743d61d4535 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:08.455557 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d2f82abc-ffdc-42e3-8fe0-32df771d9106 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:08.471026 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d2f82abc-ffdc-42e3-8fe0-32df771d9106 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4" status: 200 len: 1312 microversion: 2.1 time: 0.574886 Aug 27 02:48:08.475092 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 896/1802] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:07 2022] GET /compute/v2.1/servers/60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4 => generated 1312 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:08.485666 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-85ef5644-12b2-480c-8d16-54678cc1cc0c tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Calling method '.version_select at 0x7f5ee7342dc0>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:08.563138 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-85ef5644-12b2-480c-8d16-54678cc1cc0c tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] 10.222.0.70 "GET /compute/v2.1/images/ab2ca817-1bd6-41d1-b485-99378273bee8" status: 200 len: 1454 microversion: 2.1 time: 0.086340 Aug 27 02:48:08.565839 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 897/1803] 10.222.0.70 () {58 vars in 1233 bytes} [Sat Aug 27 02:48:08 2022] GET /compute/v2.1/images/ab2ca817-1bd6-41d1-b485-99378273bee8 => generated 1454 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:08.907896 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-dd7c7fce-e584-45ae-a38f-7743d61d4535 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073966022576475b983af066d7edb099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96abd4aa8efa4761869dabdd1f143519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:08.916426 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-dd7c7fce-e584-45ae-a38f-7743d61d4535 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] 10.222.0.70 "GET /compute/v2.1/servers/4b88e24d-509c-49fe-b5e2-b2698620d6d6" status: 200 len: 1317 microversion: 2.1 time: 0.490704 Aug 27 02:48:08.919121 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 907/1804] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:08 2022] GET /compute/v2.1/servers/4b88e24d-509c-49fe-b5e2-b2698620d6d6 => generated 1317 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:09.447230 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-2112b9a9-991c-4da2-af65-5c5b6b76bef1 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:09.448250 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-2112b9a9-991c-4da2-af65-5c5b6b76bef1 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 14e68153-ad1e-4028-8580-dcb179346f31] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:09.472825 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2112b9a9-991c-4da2-af65-5c5b6b76bef1 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:09.473335 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2112b9a9-991c-4da2-af65-5c5b6b76bef1 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:09.473780 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2112b9a9-991c-4da2-af65-5c5b6b76bef1 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:09.474504 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2112b9a9-991c-4da2-af65-5c5b6b76bef1 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:09.475160 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2112b9a9-991c-4da2-af65-5c5b6b76bef1 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:09.476699 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2112b9a9-991c-4da2-af65-5c5b6b76bef1 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:09.494357 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0ac5fba9-6d64-4929-88ea-632f205bb14d tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:09.495204 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-0ac5fba9-6d64-4929-88ea-632f205bb14d tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: 60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:09.519810 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0ac5fba9-6d64-4929-88ea-632f205bb14d tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:09.522612 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0ac5fba9-6d64-4929-88ea-632f205bb14d tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:09.525425 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0ac5fba9-6d64-4929-88ea-632f205bb14d tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:09.534051 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0ac5fba9-6d64-4929-88ea-632f205bb14d tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:09.535868 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0ac5fba9-6d64-4929-88ea-632f205bb14d tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:09.538554 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0ac5fba9-6d64-4929-88ea-632f205bb14d tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:09.949297 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-2112b9a9-991c-4da2-af65-5c5b6b76bef1 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:09.964209 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-2112b9a9-991c-4da2-af65-5c5b6b76bef1 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/14e68153-ad1e-4028-8580-dcb179346f31" status: 200 len: 1442 microversion: 2.1 time: 0.517742 Aug 27 02:48:09.969601 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 898/1805] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:09 2022] GET /compute/v2.1/servers/14e68153-ad1e-4028-8580-dcb179346f31 => generated 1442 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:09.986400 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-81a40cfe-9dce-4780-bf20-4aa66d90be3b tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Calling method '.version_select at 0x7f5ede923820>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:10.090091 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-81a40cfe-9dce-4780-bf20-4aa66d90be3b tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] 10.222.0.70 "GET /compute/v2.1/images/ab2ca817-1bd6-41d1-b485-99378273bee8" status: 200 len: 1454 microversion: 2.1 time: 0.117271 Aug 27 02:48:10.090704 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 899/1806] 10.222.0.70 () {58 vars in 1233 bytes} [Sat Aug 27 02:48:09 2022] GET /compute/v2.1/images/ab2ca817-1bd6-41d1-b485-99378273bee8 => generated 1454 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:10.101475 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-cbc9021b-fb60-4523-90f4-4e04217dd502 req-ee07f793-5caa-42ed-b27d-000e430c0d19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14e68153-ad1e-4028-8580-dcb179346f31", "name": "network-vif-deleted", "tag": "a809e218-d2b7-4a52-83bd-7fc04b36e71e"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:48:10.121941 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-cbc9021b-fb60-4523-90f4-4e04217dd502 req-ee07f793-5caa-42ed-b27d-000e430c0d19 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:10.122421 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-cbc9021b-fb60-4523-90f4-4e04217dd502 req-ee07f793-5caa-42ed-b27d-000e430c0d19 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:10.127129 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-cbc9021b-fb60-4523-90f4-4e04217dd502 req-ee07f793-5caa-42ed-b27d-000e430c0d19 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:10.149432 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0ac5fba9-6d64-4929-88ea-632f205bb14d tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:10.161929 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-0ac5fba9-6d64-4929-88ea-632f205bb14d tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4" status: 200 len: 1312 microversion: 2.1 time: 0.671656 Aug 27 02:48:10.163209 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 908/1807] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:09 2022] GET /compute/v2.1/servers/60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4 => generated 1312 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:48:10.168334 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e8086974-0844-4b04-b0f7-f8ee614092c0 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:10.169159 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-e8086974-0844-4b04-b0f7-f8ee614092c0 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] [instance: 4b88e24d-509c-49fe-b5e2-b2698620d6d6] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:10.186396 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-cbc9021b-fb60-4523-90f4-4e04217dd502 req-ee07f793-5caa-42ed-b27d-000e430c0d19 service nova] Creating event network-vif-deleted:a809e218-d2b7-4a52-83bd-7fc04b36e71e for instance 14e68153-ad1e-4028-8580-dcb179346f31 on n-h1-852278-4 Aug 27 02:48:10.190830 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e8086974-0844-4b04-b0f7-f8ee614092c0 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:10.193403 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e8086974-0844-4b04-b0f7-f8ee614092c0 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:10.195910 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e8086974-0844-4b04-b0f7-f8ee614092c0 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:10.199076 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e8086974-0844-4b04-b0f7-f8ee614092c0 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:10.199799 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e8086974-0844-4b04-b0f7-f8ee614092c0 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:10.200916 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e8086974-0844-4b04-b0f7-f8ee614092c0 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:10.204545 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-cbc9021b-fb60-4523-90f4-4e04217dd502 req-ee07f793-5caa-42ed-b27d-000e430c0d19 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107439 Aug 27 02:48:10.214358 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 900/1808] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:48:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:48:10.441667 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-e8086974-0844-4b04-b0f7-f8ee614092c0 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073966022576475b983af066d7edb099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96abd4aa8efa4761869dabdd1f143519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:10.459402 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e8086974-0844-4b04-b0f7-f8ee614092c0 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] 10.222.0.70 "GET /compute/v2.1/servers/4b88e24d-509c-49fe-b5e2-b2698620d6d6" status: 200 len: 1317 microversion: 2.1 time: 0.294285 Aug 27 02:48:10.476982 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 909/1809] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:10 2022] GET /compute/v2.1/servers/4b88e24d-509c-49fe-b5e2-b2698620d6d6 => generated 1317 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:10.991280 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ea08c241-caf1-4120-adca-c8eed03858cd tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:10.992145 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-ea08c241-caf1-4120-adca-c8eed03858cd tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 14e68153-ad1e-4028-8580-dcb179346f31] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:11.014514 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ea08c241-caf1-4120-adca-c8eed03858cd tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:11.017778 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ea08c241-caf1-4120-adca-c8eed03858cd tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:11.018300 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ea08c241-caf1-4120-adca-c8eed03858cd tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:11.019170 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ea08c241-caf1-4120-adca-c8eed03858cd tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:11.021289 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ea08c241-caf1-4120-adca-c8eed03858cd tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:11.021776 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ea08c241-caf1-4120-adca-c8eed03858cd tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:11.107267 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-dfb3011c-ad85-442c-aae6-763d92d79ff3 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Calling method '.version_select at 0x7f5ee35b34c0>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:11.112416 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ea08c241-caf1-4120-adca-c8eed03858cd tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:11.113846 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ea08c241-caf1-4120-adca-c8eed03858cd tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:11.114353 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ea08c241-caf1-4120-adca-c8eed03858cd tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:11.116594 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.objects.instance [None req-ea08c241-caf1-4120-adca-c8eed03858cd tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lazy-loading 'fault' on Instance uuid 14e68153-ad1e-4028-8580-dcb179346f31 {{(pid=134051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:48:11.199609 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-dfb3011c-ad85-442c-aae6-763d92d79ff3 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] 10.222.0.70 "GET /compute/v2.1/images/ab2ca817-1bd6-41d1-b485-99378273bee8" status: 200 len: 1454 microversion: 2.1 time: 0.095269 Aug 27 02:48:11.205329 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 910/1810] 10.222.0.70 () {58 vars in 1233 bytes} [Sat Aug 27 02:48:11 2022] GET /compute/v2.1/images/ab2ca817-1bd6-41d1-b485-99378273bee8 => generated 1454 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:11.225072 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8468f426-d856-4742-808e-53503f3ba8a6 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:11.234508 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-8468f426-d856-4742-808e-53503f3ba8a6 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: 60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:11.267224 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8468f426-d856-4742-808e-53503f3ba8a6 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:11.269293 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-ea08c241-caf1-4120-adca-c8eed03858cd tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:11.270491 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8468f426-d856-4742-808e-53503f3ba8a6 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:11.273904 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8468f426-d856-4742-808e-53503f3ba8a6 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:11.275614 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8468f426-d856-4742-808e-53503f3ba8a6 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:11.279364 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8468f426-d856-4742-808e-53503f3ba8a6 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:11.282938 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8468f426-d856-4742-808e-53503f3ba8a6 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:11.290871 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ea08c241-caf1-4120-adca-c8eed03858cd tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/14e68153-ad1e-4028-8580-dcb179346f31" status: 200 len: 1301 microversion: 2.1 time: 0.301857 Aug 27 02:48:11.311747 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 901/1811] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:10 2022] GET /compute/v2.1/servers/14e68153-ad1e-4028-8580-dcb179346f31 => generated 1301 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:11.738253 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-6e487049-a39e-447d-b29d-0919c8f8fe0e tempest-FlavorsV2TestJSON-1989197500 tempest-FlavorsV2TestJSON-1989197500-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:11.749827 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-8468f426-d856-4742-808e-53503f3ba8a6 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:11.761104 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-6e487049-a39e-447d-b29d-0919c8f8fe0e tempest-FlavorsV2TestJSON-1989197500 tempest-FlavorsV2TestJSON-1989197500-project] 10.222.0.70 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.286282 Aug 27 02:48:11.761994 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 902/1812] 10.222.0.70 () {58 vars in 1137 bytes} [Sat Aug 27 02:48:11 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:48:11.787690 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-8468f426-d856-4742-808e-53503f3ba8a6 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4" status: 200 len: 1312 microversion: 2.1 time: 0.573909 Aug 27 02:48:11.788283 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ee8f6af2-80d1-435f-8382-c3d38a6d1956 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:11.788951 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 911/1813] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:11 2022] GET /compute/v2.1/servers/60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4 => generated 1312 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:11.789065 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-ee8f6af2-80d1-435f-8382-c3d38a6d1956 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] [instance: 4b88e24d-509c-49fe-b5e2-b2698620d6d6] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:11.800417 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ee8f6af2-80d1-435f-8382-c3d38a6d1956 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:11.801245 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ee8f6af2-80d1-435f-8382-c3d38a6d1956 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:11.801893 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ee8f6af2-80d1-435f-8382-c3d38a6d1956 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:11.805801 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c26c4d5f-6598-48f4-b863-dd60e1b9159f tempest-FlavorsV2TestJSON-1989197500 tempest-FlavorsV2TestJSON-1989197500-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:11.807621 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ee8f6af2-80d1-435f-8382-c3d38a6d1956 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:11.809408 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ee8f6af2-80d1-435f-8382-c3d38a6d1956 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:11.810206 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ee8f6af2-80d1-435f-8382-c3d38a6d1956 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:11.856960 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c26c4d5f-6598-48f4-b863-dd60e1b9159f tempest-FlavorsV2TestJSON-1989197500 tempest-FlavorsV2TestJSON-1989197500-project] 10.222.0.70 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.064279 Aug 27 02:48:11.857793 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 912/1814] 10.222.0.70 () {58 vars in 1125 bytes} [Sat Aug 27 02:48:11 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:11.871962 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c7e226fa-e9df-49ae-a85a-1aed2bcd9315 tempest-FlavorsV2TestJSON-1989197500 tempest-FlavorsV2TestJSON-1989197500-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:11.886193 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c7e226fa-e9df-49ae-a85a-1aed2bcd9315 tempest-FlavorsV2TestJSON-1989197500 tempest-FlavorsV2TestJSON-1989197500-project] 10.222.0.70 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.018250 Aug 27 02:48:11.887245 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 913/1815] 10.222.0.70 () {58 vars in 1137 bytes} [Sat Aug 27 02:48:11 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:48:11.907313 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-50920ab2-34e8-476d-bb4d-8a55be17c647 tempest-FlavorsV2TestJSON-1989197500 tempest-FlavorsV2TestJSON-1989197500-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:11.935423 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-50920ab2-34e8-476d-bb4d-8a55be17c647 tempest-FlavorsV2TestJSON-1989197500 tempest-FlavorsV2TestJSON-1989197500-project] 10.222.0.70 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.034610 Aug 27 02:48:11.936361 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 914/1816] 10.222.0.70 () {58 vars in 1137 bytes} [Sat Aug 27 02:48:11 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:48:11.954993 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d67a4e66-71ad-49f2-89f3-1b7c8554d16c tempest-FlavorsV2TestJSON-1989197500 tempest-FlavorsV2TestJSON-1989197500-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:11.998740 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d67a4e66-71ad-49f2-89f3-1b7c8554d16c tempest-FlavorsV2TestJSON-1989197500 tempest-FlavorsV2TestJSON-1989197500-project] 10.222.0.70 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.048808 Aug 27 02:48:12.000665 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 915/1817] 10.222.0.70 () {58 vars in 1165 bytes} [Sat Aug 27 02:48:11 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:12.025783 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e667be6b-78f4-4c85-94c2-b186db3cfcbf tempest-FlavorsV2TestJSON-1989197500 tempest-FlavorsV2TestJSON-1989197500-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:12.038687 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e667be6b-78f4-4c85-94c2-b186db3cfcbf tempest-FlavorsV2TestJSON-1989197500 tempest-FlavorsV2TestJSON-1989197500-project] 10.222.0.70 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.022702 Aug 27 02:48:12.047463 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 916/1818] 10.222.0.70 () {58 vars in 1137 bytes} [Sat Aug 27 02:48:12 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:48:12.053007 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-1f2e1590-2ea7-49c0-a360-adbc9aa1b005 tempest-FlavorsV2TestJSON-1989197500 tempest-FlavorsV2TestJSON-1989197500-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:12.085986 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-1f2e1590-2ea7-49c0-a360-adbc9aa1b005 tempest-FlavorsV2TestJSON-1989197500 tempest-FlavorsV2TestJSON-1989197500-project] 10.222.0.70 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.037147 Aug 27 02:48:12.098800 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 917/1819] 10.222.0.70 () {58 vars in 1169 bytes} [Sat Aug 27 02:48:12 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:12.112599 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9a96ea1b-3b87-436c-b8fe-bba1b8d58bbe tempest-FlavorsV2TestJSON-1989197500 tempest-FlavorsV2TestJSON-1989197500-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:12.146958 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9a96ea1b-3b87-436c-b8fe-bba1b8d58bbe tempest-FlavorsV2TestJSON-1989197500 tempest-FlavorsV2TestJSON-1989197500-project] 10.222.0.70 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.039790 Aug 27 02:48:12.156812 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 918/1820] 10.222.0.70 () {58 vars in 1161 bytes} [Sat Aug 27 02:48:12 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:48:12.166289 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-861f542a-c916-4175-bca5-78b5d63286c4 tempest-FlavorsV2TestJSON-1989197500 tempest-FlavorsV2TestJSON-1989197500-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:12.200688 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-861f542a-c916-4175-bca5-78b5d63286c4 tempest-FlavorsV2TestJSON-1989197500 tempest-FlavorsV2TestJSON-1989197500-project] 10.222.0.70 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.042029 Aug 27 02:48:12.203792 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 919/1821] 10.222.0.70 () {58 vars in 1137 bytes} [Sat Aug 27 02:48:12 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:48:12.221005 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-442d2f94-23aa-494a-a22c-98bf09f7438a tempest-FlavorsV2TestJSON-1989197500 tempest-FlavorsV2TestJSON-1989197500-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:12.292875 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-ee8f6af2-80d1-435f-8382-c3d38a6d1956 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073966022576475b983af066d7edb099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96abd4aa8efa4761869dabdd1f143519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:12.308689 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ee8f6af2-80d1-435f-8382-c3d38a6d1956 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] 10.222.0.70 "GET /compute/v2.1/servers/4b88e24d-509c-49fe-b5e2-b2698620d6d6" status: 200 len: 1317 microversion: 2.1 time: 0.541041 Aug 27 02:48:12.311092 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 903/1822] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:11 2022] GET /compute/v2.1/servers/4b88e24d-509c-49fe-b5e2-b2698620d6d6 => generated 1317 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:12.326719 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-442d2f94-23aa-494a-a22c-98bf09f7438a tempest-FlavorsV2TestJSON-1989197500 tempest-FlavorsV2TestJSON-1989197500-project] 10.222.0.70 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.105942 Aug 27 02:48:12.328537 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 920/1823] 10.222.0.70 () {58 vars in 1167 bytes} [Sat Aug 27 02:48:12 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:12.330068 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-6a619a13-1bf5-4182-afd9-fefdd045d890 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Calling method '.version_select at 0x7f5ede932ee0>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:12.344160 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-048a362c-966b-43c8-a882-c9e854c874f6 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:12.348959 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-048a362c-966b-43c8-a882-c9e854c874f6 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 14e68153-ad1e-4028-8580-dcb179346f31] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:12.359288 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-048a362c-966b-43c8-a882-c9e854c874f6 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:12.361558 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-048a362c-966b-43c8-a882-c9e854c874f6 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:12.363665 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-048a362c-966b-43c8-a882-c9e854c874f6 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:12.364901 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-048a362c-966b-43c8-a882-c9e854c874f6 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:12.365668 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-048a362c-966b-43c8-a882-c9e854c874f6 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:12.366302 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-048a362c-966b-43c8-a882-c9e854c874f6 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:12.392607 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-048a362c-966b-43c8-a882-c9e854c874f6 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] HTTP exception thrown: Instance 14e68153-ad1e-4028-8580-dcb179346f31 could not be found. Aug 27 02:48:12.395284 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-048a362c-966b-43c8-a882-c9e854c874f6 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Request method failure captured: Aug 27 02:48:12.395284 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/servers/14e68153-ad1e-4028-8580-dcb179346f31 HTTP/1.1 Aug 27 02:48:12.395284 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:48:12.395284 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:48:12.395284 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:48:12.395284 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:48:12.395284 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:48:12.395284 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:48:12.395284 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:48:12.395284 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:48:12.395284 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYQ0RUq_2c9yZQ-tBPbmZSdvHy16w3uYqnC3ulfGKVhuo9V1qT0DhwpbZGrjZ7gKl36Bwe3ndp4oPtN8Yb1NhLVtR6ctzUSsGxj9x2fK83huw_99YjNve5IbacPLlJkw2C8b_A-bkfhkR5WCzDVEXkxJm7KG7Of9mLoKJwUixrEmvkI Aug 27 02:48:12.395284 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:48:12.395284 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:48:12.395284 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:48:12.395284 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:48:12.395284 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:48:12.395284 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:48:12.395284 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 42ec913a638c4c8c8749be73705d2c65 Aug 27 02:48:12.395284 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-LiveMigrationTest-966742224 Aug 27 02:48:12.395284 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:48:12.395284 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:48:12.395284 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/42ec913a638c4c8c8749be73705d2c65"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_42ec913a638c4c8c8749be73705d2c65", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/42ec913a638c4c8c8749be73705d2c65"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/42ec913a638c4c8c8749be73705d2c65"}]}] Aug 27 02:48:12.395284 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-LiveMigrationTest-966742224 Aug 27 02:48:12.395284 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 42ec913a638c4c8c8749be73705d2c65 Aug 27 02:48:12.395284 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-LiveMigrationTest-966742224 Aug 27 02:48:12.395284 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-LiveMigrationTest-966742224-project Aug 27 02:48:12.395284 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:48:12.395284 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:48:12.395284 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 6305debcc9294643bbed97f08de171bc Aug 27 02:48:12.395284 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-LiveMigrationTest-966742224-project Aug 27 02:48:12.395284 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 02:48:12.395284 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance 14e68153-ad1e-4028-8580-dcb179346f31 could not be found. Aug 27 02:48:12.395284 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '14e68153-ad1e-4028-8580-dcb179346f31'} Aug 27 02:48:12.395284 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:48:12.395284 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:48:12.395284 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:48:12.395284 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:48:12.395284 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:48:12.395284 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:48:12.395284 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:48:12.395284 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:48:12.395284 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:48:12.395284 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:48:12.395284 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14e68153-ad1e-4028-8580-dcb179346f31 could not be found. Aug 27 02:48:12.395284 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:48:12.395284 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:48:12.395284 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:48:12.395284 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:48:12.395284 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:48:12.395284 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:48:12.395284 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:48:12.395284 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:48:12.395284 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:48:12.395284 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:48:12.395284 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:48:12.395284 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:48:12.395284 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:48:12.395284 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:48:12.395284 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:48:12.395284 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:48:12.395284 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14e68153-ad1e-4028-8580-dcb179346f31 could not be found. Aug 27 02:48:12.395284 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:48:12.395284 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:48:12.395284 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:48:12.398294 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:48:12.398294 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:48:12.398294 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:48:12.398294 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:48:12.398294 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:48:12.398294 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14e68153-ad1e-4028-8580-dcb179346f31 could not be found. Aug 27 02:48:12.398294 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:48:12.398294 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-048a362c-966b-43c8-a882-c9e854c874f6 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Returning 404 to user: Instance 14e68153-ad1e-4028-8580-dcb179346f31 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:48:12.398680 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-6a619a13-1bf5-4182-afd9-fefdd045d890 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] 10.222.0.70 "GET /compute/v2.1/images/ab2ca817-1bd6-41d1-b485-99378273bee8" status: 200 len: 1454 microversion: 2.1 time: 0.084308 Aug 27 02:48:12.398748 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-048a362c-966b-43c8-a882-c9e854c874f6 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/14e68153-ad1e-4028-8580-dcb179346f31" status: 404 len: 111 microversion: 2.1 time: 0.067208 Aug 27 02:48:12.398748 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 921/1824] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:12 2022] GET /compute/v2.1/servers/14e68153-ad1e-4028-8580-dcb179346f31 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:48:12.406235 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 904/1825] 10.222.0.70 () {58 vars in 1233 bytes} [Sat Aug 27 02:48:12 2022] GET /compute/v2.1/images/ab2ca817-1bd6-41d1-b485-99378273bee8 => generated 1454 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:12.406449 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-432d9a0e-1b88-4074-b157-6390ec65fb59 tempest-FlavorsV2TestJSON-1989197500 tempest-FlavorsV2TestJSON-1989197500-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:12.416799 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-432d9a0e-1b88-4074-b157-6390ec65fb59 tempest-FlavorsV2TestJSON-1989197500 tempest-FlavorsV2TestJSON-1989197500-project] 10.222.0.70 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017609 Aug 27 02:48:12.419435 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-58177a7b-9a4d-48c2-9015-e64b38b066a6 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:12.419950 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-58177a7b-9a4d-48c2-9015-e64b38b066a6 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 29b88730-7871-4923-832e-a02d67f0314b] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:12.426112 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 922/1826] 10.222.0.70 () {58 vars in 1137 bytes} [Sat Aug 27 02:48:12 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:48:12.431287 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-82b04701-e265-4625-9d1e-09107faaa8d2 tempest-FlavorsV2TestJSON-1989197500 tempest-FlavorsV2TestJSON-1989197500-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:12.437369 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-58177a7b-9a4d-48c2-9015-e64b38b066a6 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:12.443233 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-58177a7b-9a4d-48c2-9015-e64b38b066a6 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:12.444087 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-58177a7b-9a4d-48c2-9015-e64b38b066a6 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:12.445037 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-58177a7b-9a4d-48c2-9015-e64b38b066a6 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:12.445671 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-58177a7b-9a4d-48c2-9015-e64b38b066a6 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:12.446395 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-58177a7b-9a4d-48c2-9015-e64b38b066a6 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:12.452078 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-82b04701-e265-4625-9d1e-09107faaa8d2 tempest-FlavorsV2TestJSON-1989197500 tempest-FlavorsV2TestJSON-1989197500-project] 10.222.0.70 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.024591 Aug 27 02:48:12.464121 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 923/1827] 10.222.0.70 () {58 vars in 1144 bytes} [Sat Aug 27 02:48:12 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:12.471866 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-850adad3-8319-405f-ab30-2ae71b41fd86 tempest-FlavorsV2TestJSON-1989197500 tempest-FlavorsV2TestJSON-1989197500-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:12.485850 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-850adad3-8319-405f-ab30-2ae71b41fd86 tempest-FlavorsV2TestJSON-1989197500 tempest-FlavorsV2TestJSON-1989197500-project] 10.222.0.70 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.020047 Aug 27 02:48:12.493657 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 924/1828] 10.222.0.70 () {58 vars in 1137 bytes} [Sat Aug 27 02:48:12 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:48:12.499819 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-065b9f8f-8e37-4e5d-af3c-fe576aba318f tempest-FlavorsV2TestJSON-1989197500 tempest-FlavorsV2TestJSON-1989197500-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:12.518442 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-58177a7b-9a4d-48c2-9015-e64b38b066a6 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 29b88730-7871-4923-832e-a02d67f0314b] Going to try to terminate instance {{(pid=134051) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:48:12.523873 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-065b9f8f-8e37-4e5d-af3c-fe576aba318f tempest-FlavorsV2TestJSON-1989197500 tempest-FlavorsV2TestJSON-1989197500-project] 10.222.0.70 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.028337 Aug 27 02:48:12.533707 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 925/1829] 10.222.0.70 () {58 vars in 1148 bytes} [Sat Aug 27 02:48:12 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:12.549726 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a63bf31c-a4f3-49b4-9c7b-f21fced96664 tempest-FlavorsV2TestJSON-1989197500 tempest-FlavorsV2TestJSON-1989197500-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:12.571995 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a63bf31c-a4f3-49b4-9c7b-f21fced96664 tempest-FlavorsV2TestJSON-1989197500 tempest-FlavorsV2TestJSON-1989197500-project] 10.222.0.70 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.034901 Aug 27 02:48:12.574228 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 926/1830] 10.222.0.70 () {58 vars in 1140 bytes} [Sat Aug 27 02:48:12 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:48:12.587905 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9d6a7f82-1cd6-4b50-b185-afc68d7fa9d1 tempest-FlavorsV2TestJSON-1989197500 tempest-FlavorsV2TestJSON-1989197500-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:12.598072 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9d6a7f82-1cd6-4b50-b185-afc68d7fa9d1 tempest-FlavorsV2TestJSON-1989197500 tempest-FlavorsV2TestJSON-1989197500-project] 10.222.0.70 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014112 Aug 27 02:48:12.598931 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 927/1831] 10.222.0.70 () {58 vars in 1137 bytes} [Sat Aug 27 02:48:12 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:48:12.610531 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-aa728327-b432-4b7d-845f-281a85804d85 tempest-FlavorsV2TestJSON-1989197500 tempest-FlavorsV2TestJSON-1989197500-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:12.644714 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-aa728327-b432-4b7d-845f-281a85804d85 tempest-FlavorsV2TestJSON-1989197500 tempest-FlavorsV2TestJSON-1989197500-project] 10.222.0.70 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.037220 Aug 27 02:48:12.655720 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 928/1832] 10.222.0.70 () {58 vars in 1146 bytes} [Sat Aug 27 02:48:12 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:12.663196 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4cdacf9d-f8fa-4bdd-a696-d3c402e20e4b tempest-FlavorsV2TestJSON-1989197500 tempest-FlavorsV2TestJSON-1989197500-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:12.692187 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-4cdacf9d-f8fa-4bdd-a696-d3c402e20e4b tempest-FlavorsV2TestJSON-1989197500 tempest-FlavorsV2TestJSON-1989197500-project] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.034004 Aug 27 02:48:12.700980 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 929/1833] 10.222.0.70 () {58 vars in 1146 bytes} [Sat Aug 27 02:48:12 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:12.724848 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3e8c86f6-f8a9-4c29-9a16-bb0654aaedab tempest-FlavorsV2TestJSON-1989197500 tempest-FlavorsV2TestJSON-1989197500-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:12.746820 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-3e8c86f6-f8a9-4c29-9a16-bb0654aaedab tempest-FlavorsV2TestJSON-1989197500 tempest-FlavorsV2TestJSON-1989197500-project] 10.222.0.70 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.039977 Aug 27 02:48:12.749016 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 930/1834] 10.222.0.70 () {58 vars in 1137 bytes} [Sat Aug 27 02:48:12 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:48:12.792830 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-58177a7b-9a4d-48c2-9015-e64b38b066a6 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "DELETE /compute/v2.1/servers/29b88730-7871-4923-832e-a02d67f0314b" status: 204 len: 0 microversion: 2.1 time: 0.385626 Aug 27 02:48:12.794089 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 905/1835] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:48:12 2022] DELETE /compute/v2.1/servers/29b88730-7871-4923-832e-a02d67f0314b => generated 0 bytes in 388 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:48:12.805027 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f1b5d141-074b-4b67-b714-02f11de6e25c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:12.806087 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-f1b5d141-074b-4b67-b714-02f11de6e25c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 29b88730-7871-4923-832e-a02d67f0314b] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:12.811961 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7230fa59-bd99-43ae-aa00-8f694f323b62 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:12.812842 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-7230fa59-bd99-43ae-aa00-8f694f323b62 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: 60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:12.820272 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f1b5d141-074b-4b67-b714-02f11de6e25c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:12.820935 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f1b5d141-074b-4b67-b714-02f11de6e25c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:12.821917 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f1b5d141-074b-4b67-b714-02f11de6e25c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:12.822969 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f1b5d141-074b-4b67-b714-02f11de6e25c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:12.823610 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f1b5d141-074b-4b67-b714-02f11de6e25c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:12.824981 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7230fa59-bd99-43ae-aa00-8f694f323b62 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:12.828876 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7230fa59-bd99-43ae-aa00-8f694f323b62 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:12.829033 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f1b5d141-074b-4b67-b714-02f11de6e25c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:12.832982 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7230fa59-bd99-43ae-aa00-8f694f323b62 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:12.833761 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7230fa59-bd99-43ae-aa00-8f694f323b62 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:12.834234 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7230fa59-bd99-43ae-aa00-8f694f323b62 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:12.839039 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7230fa59-bd99-43ae-aa00-8f694f323b62 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:13.332678 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-7230fa59-bd99-43ae-aa00-8f694f323b62 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:13.351708 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-7230fa59-bd99-43ae-aa00-8f694f323b62 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4" status: 200 len: 1312 microversion: 2.1 time: 0.544375 Aug 27 02:48:13.359003 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 906/1836] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:12 2022] GET /compute/v2.1/servers/60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4 => generated 1312 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:13.365030 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-f1b5d141-074b-4b67-b714-02f11de6e25c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:13.376153 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-52b66f87-d74a-4446-ac46-7ea752aa76f1 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:13.376369 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f1b5d141-074b-4b67-b714-02f11de6e25c tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/29b88730-7871-4923-832e-a02d67f0314b" status: 200 len: 1499 microversion: 2.1 time: 0.576982 Aug 27 02:48:13.389709 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 931/1837] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:12 2022] GET /compute/v2.1/servers/29b88730-7871-4923-832e-a02d67f0314b => generated 1499 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:13.391050 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-52b66f87-d74a-4446-ac46-7ea752aa76f1 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] [instance: 4b88e24d-509c-49fe-b5e2-b2698620d6d6] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:13.408373 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-52b66f87-d74a-4446-ac46-7ea752aa76f1 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:13.409111 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-52b66f87-d74a-4446-ac46-7ea752aa76f1 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:13.411408 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c2f5cb44-5a49-49a1-8349-ec2cde0220e5 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Calling method '.version_select at 0x7f5ee35181f0>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:13.411807 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-52b66f87-d74a-4446-ac46-7ea752aa76f1 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:13.412937 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-52b66f87-d74a-4446-ac46-7ea752aa76f1 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:13.414293 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-52b66f87-d74a-4446-ac46-7ea752aa76f1 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:13.417022 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-52b66f87-d74a-4446-ac46-7ea752aa76f1 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:13.522572 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c2f5cb44-5a49-49a1-8349-ec2cde0220e5 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] 10.222.0.70 "GET /compute/v2.1/images/ab2ca817-1bd6-41d1-b485-99378273bee8" status: 200 len: 1454 microversion: 2.1 time: 0.113471 Aug 27 02:48:13.528280 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 932/1838] 10.222.0.70 () {58 vars in 1233 bytes} [Sat Aug 27 02:48:13 2022] GET /compute/v2.1/images/ab2ca817-1bd6-41d1-b485-99378273bee8 => generated 1454 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:48:13.875693 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-fb292d6c-2038-43ef-a13b-dc930974d6ad req-eb3f3c77-bd7e-40ad-a12a-151d4fab47e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4", "name": "network-vif-plugged", "status": "completed", "tag": "f88818f1-ef30-4d4a-9180-9bdfc399cfe1"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:48:13.918276 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-fb292d6c-2038-43ef-a13b-dc930974d6ad req-eb3f3c77-bd7e-40ad-a12a-151d4fab47e4 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:13.918878 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-fb292d6c-2038-43ef-a13b-dc930974d6ad req-eb3f3c77-bd7e-40ad-a12a-151d4fab47e4 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:13.919331 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-fb292d6c-2038-43ef-a13b-dc930974d6ad req-eb3f3c77-bd7e-40ad-a12a-151d4fab47e4 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:13.962568 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-fb292d6c-2038-43ef-a13b-dc930974d6ad req-eb3f3c77-bd7e-40ad-a12a-151d4fab47e4 service nova] Creating event network-vif-plugged:f88818f1-ef30-4d4a-9180-9bdfc399cfe1 for instance 60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4 on n-h1-852278-4 Aug 27 02:48:13.972910 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-fb292d6c-2038-43ef-a13b-dc930974d6ad req-eb3f3c77-bd7e-40ad-a12a-151d4fab47e4 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101093 Aug 27 02:48:13.980617 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 933/1839] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:48:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:48:14.379968 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-90ec8858-5cc9-452e-9669-f2aa702548ca tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:14.380811 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-90ec8858-5cc9-452e-9669-f2aa702548ca tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: 60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:14.389962 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-90ec8858-5cc9-452e-9669-f2aa702548ca tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:14.393614 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-90ec8858-5cc9-452e-9669-f2aa702548ca tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:14.397430 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-90ec8858-5cc9-452e-9669-f2aa702548ca tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:14.398485 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-90ec8858-5cc9-452e-9669-f2aa702548ca tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:14.399161 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-90ec8858-5cc9-452e-9669-f2aa702548ca tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:14.399802 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-90ec8858-5cc9-452e-9669-f2aa702548ca tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:14.427536 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-52b66f87-d74a-4446-ac46-7ea752aa76f1 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073966022576475b983af066d7edb099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96abd4aa8efa4761869dabdd1f143519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:14.446633 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-52b66f87-d74a-4446-ac46-7ea752aa76f1 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] 10.222.0.70 "GET /compute/v2.1/servers/4b88e24d-509c-49fe-b5e2-b2698620d6d6" status: 200 len: 1317 microversion: 2.1 time: 1.081332 Aug 27 02:48:14.450608 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 907/1840] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:13 2022] GET /compute/v2.1/servers/4b88e24d-509c-49fe-b5e2-b2698620d6d6 => generated 1317 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:14.468496 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-220090eb-a0c5-43a1-9992-353b7a856b1b tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:14.475514 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-220090eb-a0c5-43a1-9992-353b7a856b1b tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 29b88730-7871-4923-832e-a02d67f0314b] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:14.512897 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-220090eb-a0c5-43a1-9992-353b7a856b1b tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:14.518530 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-220090eb-a0c5-43a1-9992-353b7a856b1b tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:14.519505 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-220090eb-a0c5-43a1-9992-353b7a856b1b tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:14.527389 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-220090eb-a0c5-43a1-9992-353b7a856b1b tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:14.528122 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-220090eb-a0c5-43a1-9992-353b7a856b1b tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:14.530778 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:48:14.532702 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-220090eb-a0c5-43a1-9992-353b7a856b1b tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:14.574070 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:48:14.638157 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:48:14.780253 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-90ec8858-5cc9-452e-9669-f2aa702548ca tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:14.792810 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-90ec8858-5cc9-452e-9669-f2aa702548ca tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4" status: 200 len: 1312 microversion: 2.1 time: 0.417365 Aug 27 02:48:14.793439 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 934/1841] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:14 2022] GET /compute/v2.1/servers/60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4 => generated 1312 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:48:14.822625 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-1fdc606d-663b-4ee8-9c2b-52b0cdc58360 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Calling method '.version_select at 0x7f5ee34d21f0>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:14.971075 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-1fdc606d-663b-4ee8-9c2b-52b0cdc58360 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] 10.222.0.70 "GET /compute/v2.1/images/ab2ca817-1bd6-41d1-b485-99378273bee8" status: 200 len: 1454 microversion: 2.1 time: 0.161551 Aug 27 02:48:14.973043 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 935/1842] 10.222.0.70 () {58 vars in 1233 bytes} [Sat Aug 27 02:48:14 2022] GET /compute/v2.1/images/ab2ca817-1bd6-41d1-b485-99378273bee8 => generated 1454 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:15.082196 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-8e0d45b1-ae30-4143-adff-a74435eee86c req-e81f84c2-17d5-40ff-843b-72b4c0dc042e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29b88730-7871-4923-832e-a02d67f0314b", "name": "network-vif-deleted", "tag": "9106e9cc-88c9-45f9-89cd-bb38806e1943"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:48:15.109391 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-8e0d45b1-ae30-4143-adff-a74435eee86c req-e81f84c2-17d5-40ff-843b-72b4c0dc042e service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:15.110171 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-8e0d45b1-ae30-4143-adff-a74435eee86c req-e81f84c2-17d5-40ff-843b-72b4c0dc042e service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:15.110723 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-8e0d45b1-ae30-4143-adff-a74435eee86c req-e81f84c2-17d5-40ff-843b-72b4c0dc042e service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:15.144189 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-8e0d45b1-ae30-4143-adff-a74435eee86c req-e81f84c2-17d5-40ff-843b-72b4c0dc042e service nova] Creating event network-vif-deleted:9106e9cc-88c9-45f9-89cd-bb38806e1943 for instance 29b88730-7871-4923-832e-a02d67f0314b on n-h1-852278-4 Aug 27 02:48:15.157254 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-8e0d45b1-ae30-4143-adff-a74435eee86c req-e81f84c2-17d5-40ff-843b-72b4c0dc042e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082428 Aug 27 02:48:15.164437 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 936/1843] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:48:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:48:15.290563 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-220090eb-a0c5-43a1-9992-353b7a856b1b tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:15.304514 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-220090eb-a0c5-43a1-9992-353b7a856b1b tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/29b88730-7871-4923-832e-a02d67f0314b" status: 200 len: 1499 microversion: 2.1 time: 0.851467 Aug 27 02:48:15.305475 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 908/1844] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:14 2022] GET /compute/v2.1/servers/29b88730-7871-4923-832e-a02d67f0314b => generated 1499 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:15.474456 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-66441e94-74b8-4527-a1be-fb83bfe6fb02 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:15.477067 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-66441e94-74b8-4527-a1be-fb83bfe6fb02 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] [instance: 4b88e24d-509c-49fe-b5e2-b2698620d6d6] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:15.508133 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-66441e94-74b8-4527-a1be-fb83bfe6fb02 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:15.509492 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-66441e94-74b8-4527-a1be-fb83bfe6fb02 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:15.511077 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-66441e94-74b8-4527-a1be-fb83bfe6fb02 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:15.524719 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-66441e94-74b8-4527-a1be-fb83bfe6fb02 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:15.528963 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-66441e94-74b8-4527-a1be-fb83bfe6fb02 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:15.529582 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-66441e94-74b8-4527-a1be-fb83bfe6fb02 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:15.821872 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b568afe4-46b1-4075-a7a2-3299a243a590 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:15.823068 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b568afe4-46b1-4075-a7a2-3299a243a590 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: 60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:15.825313 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=4 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:48:15.835104 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b568afe4-46b1-4075-a7a2-3299a243a590 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:15.835836 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b568afe4-46b1-4075-a7a2-3299a243a590 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:15.836468 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b568afe4-46b1-4075-a7a2-3299a243a590 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:15.837615 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b568afe4-46b1-4075-a7a2-3299a243a590 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:15.838705 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b568afe4-46b1-4075-a7a2-3299a243a590 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:15.839154 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b568afe4-46b1-4075-a7a2-3299a243a590 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:16.254611 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-66441e94-74b8-4527-a1be-fb83bfe6fb02 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073966022576475b983af066d7edb099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96abd4aa8efa4761869dabdd1f143519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:16.263910 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-66441e94-74b8-4527-a1be-fb83bfe6fb02 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] 10.222.0.70 "GET /compute/v2.1/servers/4b88e24d-509c-49fe-b5e2-b2698620d6d6" status: 200 len: 1317 microversion: 2.1 time: 0.800172 Aug 27 02:48:16.268188 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 937/1845] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:15 2022] GET /compute/v2.1/servers/4b88e24d-509c-49fe-b5e2-b2698620d6d6 => generated 1317 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:16.275984 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8ba970f6-efa6-4fa3-acc7-177682f2bf25 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Calling method '.version_select at 0x7f5ee339b1f0>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:16.359807 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-8ba970f6-efa6-4fa3-acc7-177682f2bf25 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] 10.222.0.70 "GET /compute/v2.1/images/ab2ca817-1bd6-41d1-b485-99378273bee8" status: 200 len: 1454 microversion: 2.1 time: 0.090283 Aug 27 02:48:16.360404 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 938/1846] 10.222.0.70 () {58 vars in 1233 bytes} [Sat Aug 27 02:48:16 2022] GET /compute/v2.1/images/ab2ca817-1bd6-41d1-b485-99378273bee8 => generated 1454 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:16.374291 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-d830dd8c-d72f-4193-a77e-a6ed51f41857 req-4d97a1ca-598b-4465-8fbc-ba6001961bf3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b88e24d-509c-49fe-b5e2-b2698620d6d6", "name": "network-vif-plugged", "status": "completed", "tag": "8e5488cf-e7f9-42ad-b395-21ba7264782d"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:48:16.396859 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-d830dd8c-d72f-4193-a77e-a6ed51f41857 req-4d97a1ca-598b-4465-8fbc-ba6001961bf3 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:16.400595 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-d830dd8c-d72f-4193-a77e-a6ed51f41857 req-4d97a1ca-598b-4465-8fbc-ba6001961bf3 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:16.401201 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-d830dd8c-d72f-4193-a77e-a6ed51f41857 req-4d97a1ca-598b-4465-8fbc-ba6001961bf3 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:16.423535 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-b568afe4-46b1-4075-a7a2-3299a243a590 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:16.433549 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-d830dd8c-d72f-4193-a77e-a6ed51f41857 req-4d97a1ca-598b-4465-8fbc-ba6001961bf3 service nova] Creating event network-vif-plugged:8e5488cf-e7f9-42ad-b395-21ba7264782d for instance 4b88e24d-509c-49fe-b5e2-b2698620d6d6 on n-h1-852278-4 Aug 27 02:48:16.441758 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b568afe4-46b1-4075-a7a2-3299a243a590 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4" status: 200 len: 1462 microversion: 2.1 time: 0.626157 Aug 27 02:48:16.444645 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 909/1847] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:15 2022] GET /compute/v2.1/servers/60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4 => generated 1462 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:48:16.446405 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-d830dd8c-d72f-4193-a77e-a6ed51f41857 req-4d97a1ca-598b-4465-8fbc-ba6001961bf3 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081259 Aug 27 02:48:16.447499 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 939/1848] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:48:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:48:16.456574 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-fbf720fe-c5c3-4c7d-abe7-96af0884e2e7 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:16.468269 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-fbf720fe-c5c3-4c7d-abe7-96af0884e2e7 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 29b88730-7871-4923-832e-a02d67f0314b] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:16.478726 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fbf720fe-c5c3-4c7d-abe7-96af0884e2e7 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:16.479455 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fbf720fe-c5c3-4c7d-abe7-96af0884e2e7 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:16.480890 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fbf720fe-c5c3-4c7d-abe7-96af0884e2e7 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:16.507575 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fbf720fe-c5c3-4c7d-abe7-96af0884e2e7 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:16.509024 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fbf720fe-c5c3-4c7d-abe7-96af0884e2e7 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:16.513401 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fbf720fe-c5c3-4c7d-abe7-96af0884e2e7 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:16.622322 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fbf720fe-c5c3-4c7d-abe7-96af0884e2e7 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:16.622824 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fbf720fe-c5c3-4c7d-abe7-96af0884e2e7 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:16.623871 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fbf720fe-c5c3-4c7d-abe7-96af0884e2e7 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:16.624565 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.objects.instance [None req-fbf720fe-c5c3-4c7d-abe7-96af0884e2e7 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lazy-loading 'fault' on Instance uuid 29b88730-7871-4923-832e-a02d67f0314b {{(pid=134051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:48:17.004705 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a40fde2d-60af-40df-a44c-db30864f3055 tempest-MigrationsAdminTest-1330282624 tempest-MigrationsAdminTest-1330282624-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:17.006131 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a40fde2d-60af-40df-a44c-db30864f3055 tempest-MigrationsAdminTest-1330282624 tempest-MigrationsAdminTest-1330282624-project-admin] [instance: 60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:17.030193 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a40fde2d-60af-40df-a44c-db30864f3055 tempest-MigrationsAdminTest-1330282624 tempest-MigrationsAdminTest-1330282624-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:17.031146 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a40fde2d-60af-40df-a44c-db30864f3055 tempest-MigrationsAdminTest-1330282624 tempest-MigrationsAdminTest-1330282624-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:17.032377 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a40fde2d-60af-40df-a44c-db30864f3055 tempest-MigrationsAdminTest-1330282624 tempest-MigrationsAdminTest-1330282624-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:17.036923 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a40fde2d-60af-40df-a44c-db30864f3055 tempest-MigrationsAdminTest-1330282624 tempest-MigrationsAdminTest-1330282624-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:17.037643 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a40fde2d-60af-40df-a44c-db30864f3055 tempest-MigrationsAdminTest-1330282624 tempest-MigrationsAdminTest-1330282624-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:17.038245 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a40fde2d-60af-40df-a44c-db30864f3055 tempest-MigrationsAdminTest-1330282624 tempest-MigrationsAdminTest-1330282624-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:17.122782 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-fbf720fe-c5c3-4c7d-abe7-96af0884e2e7 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6305debcc9294643bbed97f08de171bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec913a638c4c8c8749be73705d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:17.130270 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-fbf720fe-c5c3-4c7d-abe7-96af0884e2e7 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/29b88730-7871-4923-832e-a02d67f0314b" status: 200 len: 1301 microversion: 2.1 time: 0.684446 Aug 27 02:48:17.133081 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 910/1849] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:16 2022] GET /compute/v2.1/servers/29b88730-7871-4923-832e-a02d67f0314b => generated 1301 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:17.288767 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-576593f1-6ed3-4d70-9d40-4eb7f1a80a27 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:17.289386 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-576593f1-6ed3-4d70-9d40-4eb7f1a80a27 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] [instance: 4b88e24d-509c-49fe-b5e2-b2698620d6d6] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:17.297038 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-576593f1-6ed3-4d70-9d40-4eb7f1a80a27 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:17.297536 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-576593f1-6ed3-4d70-9d40-4eb7f1a80a27 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:17.297975 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-576593f1-6ed3-4d70-9d40-4eb7f1a80a27 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:17.298698 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-576593f1-6ed3-4d70-9d40-4eb7f1a80a27 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:17.299186 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-576593f1-6ed3-4d70-9d40-4eb7f1a80a27 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:17.299602 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-576593f1-6ed3-4d70-9d40-4eb7f1a80a27 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:17.547021 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-576593f1-6ed3-4d70-9d40-4eb7f1a80a27 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073966022576475b983af066d7edb099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96abd4aa8efa4761869dabdd1f143519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:17.559842 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-576593f1-6ed3-4d70-9d40-4eb7f1a80a27 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] 10.222.0.70 "GET /compute/v2.1/servers/4b88e24d-509c-49fe-b5e2-b2698620d6d6" status: 200 len: 1317 microversion: 2.1 time: 0.271861 Aug 27 02:48:17.561028 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 911/1850] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:17 2022] GET /compute/v2.1/servers/4b88e24d-509c-49fe-b5e2-b2698620d6d6 => generated 1317 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:48:17.565919 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-99b37a47-68c4-4652-9ab7-2590015487e1 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Calling method '.version_select at 0x7f5ede8f78b0>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:17.717969 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-99b37a47-68c4-4652-9ab7-2590015487e1 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] 10.222.0.70 "GET /compute/v2.1/images/ab2ca817-1bd6-41d1-b485-99378273bee8" status: 200 len: 1454 microversion: 2.1 time: 0.155588 Aug 27 02:48:17.718561 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 912/1851] 10.222.0.70 () {58 vars in 1233 bytes} [Sat Aug 27 02:48:17 2022] GET /compute/v2.1/images/ab2ca817-1bd6-41d1-b485-99378273bee8 => generated 1454 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:17.731440 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a40fde2d-60af-40df-a44c-db30864f3055 tempest-MigrationsAdminTest-1330282624 tempest-MigrationsAdminTest-1330282624-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4" status: 200 len: 1613 microversion: 2.1 time: 1.266656 Aug 27 02:48:17.744789 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 940/1852] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:16 2022] GET /compute/v2.1/servers/60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4 => generated 1613 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:48:17.758912 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d2e328fa-83f9-4175-bc7c-3a8cba376d53 tempest-MigrationsAdminTest-1330282624 tempest-MigrationsAdminTest-1330282624-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:48:17.759489 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d2e328fa-83f9-4175-bc7c-3a8cba376d53 tempest-MigrationsAdminTest-1330282624 tempest-MigrationsAdminTest-1330282624-project-admin] [instance: 60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:17.769769 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d2e328fa-83f9-4175-bc7c-3a8cba376d53 tempest-MigrationsAdminTest-1330282624 tempest-MigrationsAdminTest-1330282624-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:17.770261 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d2e328fa-83f9-4175-bc7c-3a8cba376d53 tempest-MigrationsAdminTest-1330282624 tempest-MigrationsAdminTest-1330282624-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:17.773004 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d2e328fa-83f9-4175-bc7c-3a8cba376d53 tempest-MigrationsAdminTest-1330282624 tempest-MigrationsAdminTest-1330282624-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:17.774008 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d2e328fa-83f9-4175-bc7c-3a8cba376d53 tempest-MigrationsAdminTest-1330282624 tempest-MigrationsAdminTest-1330282624-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:17.774627 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d2e328fa-83f9-4175-bc7c-3a8cba376d53 tempest-MigrationsAdminTest-1330282624 tempest-MigrationsAdminTest-1330282624-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:17.785054 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d2e328fa-83f9-4175-bc7c-3a8cba376d53 tempest-MigrationsAdminTest-1330282624 tempest-MigrationsAdminTest-1330282624-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:17.971118 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d2e328fa-83f9-4175-bc7c-3a8cba376d53 tempest-MigrationsAdminTest-1330282624 tempest-MigrationsAdminTest-1330282624-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'aea269bcf7b8490088323b61dcfa2393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06bfee67ab6483d8b12ec11c3c51dde', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:17.974250 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d2e328fa-83f9-4175-bc7c-3a8cba376d53 tempest-MigrationsAdminTest-1330282624 tempest-MigrationsAdminTest-1330282624-project-admin] [instance: 60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4] flavor_id is None. Assuming migration. {{(pid=134051) resize /opt/stack/nova/nova/compute/api.py:4194}} Aug 27 02:48:17.974943 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d2e328fa-83f9-4175-bc7c-3a8cba376d53 tempest-MigrationsAdminTest-1330282624 tempest-MigrationsAdminTest-1330282624-project-admin] [instance: 60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=134051) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 27 02:48:18.156811 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-899237d8-ed03-4597-b57a-8580d9f2cfa3 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:18.157595 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-899237d8-ed03-4597-b57a-8580d9f2cfa3 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] [instance: 29b88730-7871-4923-832e-a02d67f0314b] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:18.173079 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-899237d8-ed03-4597-b57a-8580d9f2cfa3 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:18.176489 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-899237d8-ed03-4597-b57a-8580d9f2cfa3 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:18.179724 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-899237d8-ed03-4597-b57a-8580d9f2cfa3 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:18.186893 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-899237d8-ed03-4597-b57a-8580d9f2cfa3 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:18.194979 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-899237d8-ed03-4597-b57a-8580d9f2cfa3 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:18.196447 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-899237d8-ed03-4597-b57a-8580d9f2cfa3 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:18.251590 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-899237d8-ed03-4597-b57a-8580d9f2cfa3 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] HTTP exception thrown: Instance 29b88730-7871-4923-832e-a02d67f0314b could not be found. Aug 27 02:48:18.257495 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-899237d8-ed03-4597-b57a-8580d9f2cfa3 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Request method failure captured: Aug 27 02:48:18.257495 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/servers/29b88730-7871-4923-832e-a02d67f0314b HTTP/1.1 Aug 27 02:48:18.257495 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:48:18.257495 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:48:18.257495 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:48:18.257495 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:48:18.257495 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:48:18.257495 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:48:18.257495 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:48:18.257495 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:48:18.257495 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYQ0RUq_2c9yZQ-tBPbmZSdvHy16w3uYqnC3ulfGKVhuo9V1qT0DhwpbZGrjZ7gKl36Bwe3ndp4oPtN8Yb1NhLVtR6ctzUSsGxj9x2fK83huw_99YjNve5IbacPLlJkw2C8b_A-bkfhkR5WCzDVEXkxJm7KG7Of9mLoKJwUixrEmvkI Aug 27 02:48:18.257495 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:48:18.257495 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:48:18.257495 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:48:18.257495 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:48:18.257495 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:48:18.257495 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:48:18.257495 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 42ec913a638c4c8c8749be73705d2c65 Aug 27 02:48:18.257495 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-LiveMigrationTest-966742224 Aug 27 02:48:18.257495 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:48:18.257495 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:48:18.257495 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/42ec913a638c4c8c8749be73705d2c65"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_42ec913a638c4c8c8749be73705d2c65", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/42ec913a638c4c8c8749be73705d2c65"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/42ec913a638c4c8c8749be73705d2c65"}]}] Aug 27 02:48:18.257495 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-LiveMigrationTest-966742224 Aug 27 02:48:18.257495 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 42ec913a638c4c8c8749be73705d2c65 Aug 27 02:48:18.257495 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-LiveMigrationTest-966742224 Aug 27 02:48:18.257495 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-LiveMigrationTest-966742224-project Aug 27 02:48:18.257495 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:48:18.257495 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:48:18.257495 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 6305debcc9294643bbed97f08de171bc Aug 27 02:48:18.257495 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-LiveMigrationTest-966742224-project Aug 27 02:48:18.257495 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 02:48:18.257495 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance 29b88730-7871-4923-832e-a02d67f0314b could not be found. Aug 27 02:48:18.257495 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '29b88730-7871-4923-832e-a02d67f0314b'} Aug 27 02:48:18.257495 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:48:18.257495 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:48:18.257495 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:48:18.257495 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:48:18.257495 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:48:18.257495 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:48:18.257495 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:48:18.257495 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:48:18.257495 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:48:18.257495 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:48:18.257495 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29b88730-7871-4923-832e-a02d67f0314b could not be found. Aug 27 02:48:18.257495 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:48:18.257495 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:48:18.257495 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:48:18.257495 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:48:18.257495 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:48:18.257495 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:48:18.257495 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:48:18.257495 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:48:18.257495 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:48:18.257495 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:48:18.257495 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:48:18.257495 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:48:18.257495 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:48:18.257495 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:48:18.257495 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:48:18.257495 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:48:18.257495 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29b88730-7871-4923-832e-a02d67f0314b could not be found. Aug 27 02:48:18.257495 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:48:18.257495 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:48:18.257495 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:48:18.260857 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:48:18.260857 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:48:18.260857 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:48:18.260857 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:48:18.260857 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:48:18.260857 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29b88730-7871-4923-832e-a02d67f0314b could not be found. Aug 27 02:48:18.260857 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:48:18.267853 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-899237d8-ed03-4597-b57a-8580d9f2cfa3 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] Returning 404 to user: Instance 29b88730-7871-4923-832e-a02d67f0314b could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:48:18.270859 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-899237d8-ed03-4597-b57a-8580d9f2cfa3 tempest-LiveMigrationTest-966742224 tempest-LiveMigrationTest-966742224-project] 10.222.0.70 "GET /compute/v2.1/servers/29b88730-7871-4923-832e-a02d67f0314b" status: 404 len: 111 microversion: 2.1 time: 0.117878 Aug 27 02:48:18.273420 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 941/1853] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:18 2022] GET /compute/v2.1/servers/29b88730-7871-4923-832e-a02d67f0314b => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 02:48:18.581961 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-41119de6-424b-40b2-9549-19c796c7b362 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:18.583279 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-41119de6-424b-40b2-9549-19c796c7b362 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] [instance: 4b88e24d-509c-49fe-b5e2-b2698620d6d6] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:18.597709 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-41119de6-424b-40b2-9549-19c796c7b362 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:18.599654 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-41119de6-424b-40b2-9549-19c796c7b362 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:18.600755 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-41119de6-424b-40b2-9549-19c796c7b362 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:18.602928 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-41119de6-424b-40b2-9549-19c796c7b362 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:18.605770 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-41119de6-424b-40b2-9549-19c796c7b362 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:18.606930 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-41119de6-424b-40b2-9549-19c796c7b362 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:18.702011 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d2e328fa-83f9-4175-bc7c-3a8cba376d53 tempest-MigrationsAdminTest-1330282624 tempest-MigrationsAdminTest-1330282624-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4/action" status: 202 len: 0 microversion: 2.1 time: 0.946802 Aug 27 02:48:18.708124 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 913/1854] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 02:48:17 2022] POST /compute/v2.1/servers/60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4/action => generated 0 bytes in 954 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:48:18.728168 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-05c65820-5716-4616-95e3-765fb24d6259 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:18.728929 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-05c65820-5716-4616-95e3-765fb24d6259 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: 60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:18.742307 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-05c65820-5716-4616-95e3-765fb24d6259 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:18.742851 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-05c65820-5716-4616-95e3-765fb24d6259 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:18.743381 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-05c65820-5716-4616-95e3-765fb24d6259 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:18.744015 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-05c65820-5716-4616-95e3-765fb24d6259 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:18.744487 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-05c65820-5716-4616-95e3-765fb24d6259 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:18.744957 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-05c65820-5716-4616-95e3-765fb24d6259 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:19.113731 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-41119de6-424b-40b2-9549-19c796c7b362 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073966022576475b983af066d7edb099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96abd4aa8efa4761869dabdd1f143519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:19.125588 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-41119de6-424b-40b2-9549-19c796c7b362 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] 10.222.0.70 "GET /compute/v2.1/servers/4b88e24d-509c-49fe-b5e2-b2698620d6d6" status: 200 len: 1466 microversion: 2.1 time: 0.545742 Aug 27 02:48:19.126755 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 942/1855] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:18 2022] GET /compute/v2.1/servers/4b88e24d-509c-49fe-b5e2-b2698620d6d6 => generated 1466 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:48:19.143829 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-93355223-5b4e-4912-ac56-65ba00adde84 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Calling method '.version_select at 0x7f5ee724f0d0>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:19.165897 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-05c65820-5716-4616-95e3-765fb24d6259 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:19.174452 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-05c65820-5716-4616-95e3-765fb24d6259 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4" status: 200 len: 1471 microversion: 2.1 time: 0.462833 Aug 27 02:48:19.183968 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 914/1856] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:18 2022] GET /compute/v2.1/servers/60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4 => generated 1471 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:19.189164 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-27593f48-7017-472f-be09-0dd35b71f734 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-647220700", "metadata": {"image_type": "test"}}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:48:19.191921 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-27593f48-7017-472f-be09-0dd35b71f734 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] [instance: 4b88e24d-509c-49fe-b5e2-b2698620d6d6] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:19.216144 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-27593f48-7017-472f-be09-0dd35b71f734 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:19.216905 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-27593f48-7017-472f-be09-0dd35b71f734 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:19.217449 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-27593f48-7017-472f-be09-0dd35b71f734 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:19.221225 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-27593f48-7017-472f-be09-0dd35b71f734 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:19.221878 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-27593f48-7017-472f-be09-0dd35b71f734 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:19.222483 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-27593f48-7017-472f-be09-0dd35b71f734 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:19.242759 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-93355223-5b4e-4912-ac56-65ba00adde84 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] 10.222.0.70 "GET /compute/v2.1/images/ab2ca817-1bd6-41d1-b485-99378273bee8" status: 200 len: 1454 microversion: 2.1 time: 0.114532 Aug 27 02:48:19.244388 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 943/1857] 10.222.0.70 () {58 vars in 1233 bytes} [Sat Aug 27 02:48:19 2022] GET /compute/v2.1/images/ab2ca817-1bd6-41d1-b485-99378273bee8 => generated 1454 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:19.390112 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-27593f48-7017-472f-be09-0dd35b71f734 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Getting quotas for project 96abd4aa8efa4761869dabdd1f143519. Resources: dict_keys(['metadata_items']) {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:48:19.405476 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-27593f48-7017-472f-be09-0dd35b71f734 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Getting quotas for user 073966022576475b983af066d7edb099 and project 96abd4aa8efa4761869dabdd1f143519. Resources: dict_keys(['metadata_items']) {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:48:19.834914 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-27593f48-7017-472f-be09-0dd35b71f734 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] 10.222.0.70 "POST /compute/v2.1/servers/4b88e24d-509c-49fe-b5e2-b2698620d6d6/action" status: 202 len: 0 microversion: 2.1 time: 0.649210 Aug 27 02:48:19.838038 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 915/1858] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 02:48:19 2022] POST /compute/v2.1/servers/4b88e24d-509c-49fe-b5e2-b2698620d6d6/action => generated 0 bytes in 653 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 27 02:48:19.848241 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-34116a7c-6ecd-426f-b389-fcfb467a6609 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Calling method '.version_select at 0x7f5ee7271dc0>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:19.954104 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-34116a7c-6ecd-426f-b389-fcfb467a6609 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] 10.222.0.70 "GET /compute/v2.1/images/0ae12db3-6535-4c53-9cf0-6bb5faaa4513" status: 200 len: 1423 microversion: 2.1 time: 0.109779 Aug 27 02:48:19.956676 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 944/1859] 10.222.0.70 () {58 vars in 1233 bytes} [Sat Aug 27 02:48:19 2022] GET /compute/v2.1/images/0ae12db3-6535-4c53-9cf0-6bb5faaa4513 => generated 1423 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:48:20.206956 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-1403a2d8-4a6a-4c6d-ae95-2a46e0b25351 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:20.207673 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-1403a2d8-4a6a-4c6d-ae95-2a46e0b25351 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: 60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:20.221640 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1403a2d8-4a6a-4c6d-ae95-2a46e0b25351 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:20.222138 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1403a2d8-4a6a-4c6d-ae95-2a46e0b25351 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:20.224894 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1403a2d8-4a6a-4c6d-ae95-2a46e0b25351 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:20.225714 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1403a2d8-4a6a-4c6d-ae95-2a46e0b25351 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:20.226196 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1403a2d8-4a6a-4c6d-ae95-2a46e0b25351 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:20.229321 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1403a2d8-4a6a-4c6d-ae95-2a46e0b25351 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:20.260654 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6b4020ad-638d-459c-a83a-07d01c1329f8 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Calling method '.version_select at 0x7f5ee724f280>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:20.382942 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-6b4020ad-638d-459c-a83a-07d01c1329f8 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] 10.222.0.70 "GET /compute/v2.1/images/ab2ca817-1bd6-41d1-b485-99378273bee8" status: 200 len: 1454 microversion: 2.1 time: 0.126621 Aug 27 02:48:20.383801 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 945/1860] 10.222.0.70 () {58 vars in 1233 bytes} [Sat Aug 27 02:48:20 2022] GET /compute/v2.1/images/ab2ca817-1bd6-41d1-b485-99378273bee8 => generated 1454 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:20.976452 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6cf16db2-0e0c-4f22-bdb7-f36a47a978f7 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Calling method '.version_select at 0x7f5ee2e13b80>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:21.071096 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-6cf16db2-0e0c-4f22-bdb7-f36a47a978f7 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] 10.222.0.70 "GET /compute/v2.1/images/0ae12db3-6535-4c53-9cf0-6bb5faaa4513" status: 200 len: 1423 microversion: 2.1 time: 0.100801 Aug 27 02:48:21.073498 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 946/1861] 10.222.0.70 () {58 vars in 1233 bytes} [Sat Aug 27 02:48:20 2022] GET /compute/v2.1/images/0ae12db3-6535-4c53-9cf0-6bb5faaa4513 => generated 1423 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:21.305831 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-1403a2d8-4a6a-4c6d-ae95-2a46e0b25351 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:21.325866 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-1403a2d8-4a6a-4c6d-ae95-2a46e0b25351 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4" status: 200 len: 1471 microversion: 2.1 time: 1.115655 Aug 27 02:48:21.341446 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 916/1862] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:20 2022] GET /compute/v2.1/servers/60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4 => generated 1471 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:21.458322 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6fd5a70f-5e33-4df4-a20f-2f66165960e8 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Calling method '.version_select at 0x7f5ee724fd30>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:21.604668 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-6fd5a70f-5e33-4df4-a20f-2f66165960e8 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] 10.222.0.70 "GET /compute/v2.1/images/ab2ca817-1bd6-41d1-b485-99378273bee8" status: 200 len: 1454 microversion: 2.1 time: 0.206465 Aug 27 02:48:21.606847 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 947/1863] 10.222.0.70 () {58 vars in 1233 bytes} [Sat Aug 27 02:48:21 2022] GET /compute/v2.1/images/ab2ca817-1bd6-41d1-b485-99378273bee8 => generated 1454 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:22.090536 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a928b908-fa99-4500-adc3-893c43705208 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Calling method '.version_select at 0x7f5ede97d700>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:22.202034 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a928b908-fa99-4500-adc3-893c43705208 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] 10.222.0.70 "GET /compute/v2.1/images/0ae12db3-6535-4c53-9cf0-6bb5faaa4513" status: 200 len: 1423 microversion: 2.1 time: 0.118120 Aug 27 02:48:22.202632 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 917/1864] 10.222.0.70 () {58 vars in 1233 bytes} [Sat Aug 27 02:48:22 2022] GET /compute/v2.1/images/0ae12db3-6535-4c53-9cf0-6bb5faaa4513 => generated 1423 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:22.348769 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-37e47224-01f2-4d34-8cc9-ec0d8d9001ad tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:22.349892 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-37e47224-01f2-4d34-8cc9-ec0d8d9001ad tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: 60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:22.369765 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-37e47224-01f2-4d34-8cc9-ec0d8d9001ad tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:22.372957 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-37e47224-01f2-4d34-8cc9-ec0d8d9001ad tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:22.375637 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-37e47224-01f2-4d34-8cc9-ec0d8d9001ad tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:22.376712 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-37e47224-01f2-4d34-8cc9-ec0d8d9001ad tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:22.379234 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-37e47224-01f2-4d34-8cc9-ec0d8d9001ad tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:22.384833 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-37e47224-01f2-4d34-8cc9-ec0d8d9001ad tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:22.623537 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-06c38e59-f624-4485-864f-2d490fd27e13 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Calling method '.version_select at 0x7f5ede996c10>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:22.718615 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-06c38e59-f624-4485-864f-2d490fd27e13 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] 10.222.0.70 "GET /compute/v2.1/images/ab2ca817-1bd6-41d1-b485-99378273bee8" status: 200 len: 1454 microversion: 2.1 time: 0.102838 Aug 27 02:48:22.720735 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 918/1865] 10.222.0.70 () {58 vars in 1233 bytes} [Sat Aug 27 02:48:22 2022] GET /compute/v2.1/images/ab2ca817-1bd6-41d1-b485-99378273bee8 => generated 1454 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:48:22.822662 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-37e47224-01f2-4d34-8cc9-ec0d8d9001ad tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:22.838753 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-37e47224-01f2-4d34-8cc9-ec0d8d9001ad tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4" status: 200 len: 1471 microversion: 2.1 time: 0.495370 Aug 27 02:48:22.841717 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 948/1866] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:22 2022] GET /compute/v2.1/servers/60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4 => generated 1471 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:23.114604 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f103993b-1ca8-49ce-9eae-5196e39ab290 tempest-SecurityGroupRulesTestJSON-1478250502 tempest-SecurityGroupRulesTestJSON-1478250502-project] Action: 'create', calling method: .version_select at 0x7f5ede9368b0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1710256870", "description": "tempest-description-982610260"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:48:23.217126 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-acb12ebb-4b15-4052-807d-15153f799119 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Calling method '.version_select at 0x7f5ee7214d30>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:23.283108 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-acb12ebb-4b15-4052-807d-15153f799119 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] 10.222.0.70 "GET /compute/v2.1/images/0ae12db3-6535-4c53-9cf0-6bb5faaa4513" status: 200 len: 1423 microversion: 2.1 time: 0.069978 Aug 27 02:48:23.290496 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 949/1867] 10.222.0.70 () {58 vars in 1233 bytes} [Sat Aug 27 02:48:23 2022] GET /compute/v2.1/images/0ae12db3-6535-4c53-9cf0-6bb5faaa4513 => generated 1423 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:23.430572 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-f103993b-1ca8-49ce-9eae-5196e39ab290 tempest-SecurityGroupRulesTestJSON-1478250502 tempest-SecurityGroupRulesTestJSON-1478250502-project] 10.222.0.70 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.609792 Aug 27 02:48:23.431097 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 919/1868] 10.222.0.70 () {60 vars in 1180 bytes} [Sat Aug 27 02:48:22 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:48:23.451806 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-2d7fa385-b7bb-494e-bc82-8afab961d08c tempest-SecurityGroupRulesTestJSON-1478250502 tempest-SecurityGroupRulesTestJSON-1478250502-project] Action: 'create', calling method: .version_select at 0x7f5ee72198b0>, body: {"security_group_rule": {"parent_group_id": "c5b5dca1-fc8a-4141-9792-d6ab3623571f", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:48:23.736195 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0519ee63-a2da-42e2-a140-c1c78e424a26 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Calling method '.version_select at 0x7f5ede8d9820>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:23.814974 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-2d7fa385-b7bb-494e-bc82-8afab961d08c tempest-SecurityGroupRulesTestJSON-1478250502 tempest-SecurityGroupRulesTestJSON-1478250502-project] 10.222.0.70 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.373440 Aug 27 02:48:23.829026 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 950/1869] 10.222.0.70 () {60 vars in 1195 bytes} [Sat Aug 27 02:48:23 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:48:23.839186 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f18ae42d-9b45-4549-a2ea-eb70aed91935 tempest-SecurityGroupRulesTestJSON-1478250502 tempest-SecurityGroupRulesTestJSON-1478250502-project] Action: 'create', calling method: .version_select at 0x7f5ee2dfbc10>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1536670300", "description": "tempest-description-1541003588"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:48:23.888058 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-0519ee63-a2da-42e2-a140-c1c78e424a26 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] 10.222.0.70 "GET /compute/v2.1/images/ab2ca817-1bd6-41d1-b485-99378273bee8" status: 200 len: 1463 microversion: 2.1 time: 0.158902 Aug 27 02:48:23.901476 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 920/1870] 10.222.0.70 () {58 vars in 1233 bytes} [Sat Aug 27 02:48:23 2022] GET /compute/v2.1/images/ab2ca817-1bd6-41d1-b485-99378273bee8 => generated 1463 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:23.917533 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-229b30e3-13ca-4129-9b90-be5e6c5b2ff2 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:23.923317 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-229b30e3-13ca-4129-9b90-be5e6c5b2ff2 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: 60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:23.943961 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-229b30e3-13ca-4129-9b90-be5e6c5b2ff2 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:23.946575 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-229b30e3-13ca-4129-9b90-be5e6c5b2ff2 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:23.947693 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-229b30e3-13ca-4129-9b90-be5e6c5b2ff2 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:23.948973 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-229b30e3-13ca-4129-9b90-be5e6c5b2ff2 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:23.949625 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-229b30e3-13ca-4129-9b90-be5e6c5b2ff2 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:23.950219 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-229b30e3-13ca-4129-9b90-be5e6c5b2ff2 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:24.347817 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-229b30e3-13ca-4129-9b90-be5e6c5b2ff2 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:24.357399 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-229b30e3-13ca-4129-9b90-be5e6c5b2ff2 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4" status: 200 len: 1471 microversion: 2.1 time: 0.453960 Aug 27 02:48:24.365891 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 921/1871] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:23 2022] GET /compute/v2.1/servers/60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4 => generated 1471 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:24.392989 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e47e9661-c8b1-4f4b-8322-67a5fad9c324 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Calling method '.version_select at 0x7f5ede936c10>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:24.476454 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e47e9661-c8b1-4f4b-8322-67a5fad9c324 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] 10.222.0.70 "GET /compute/v2.1/images/ab2ca817-1bd6-41d1-b485-99378273bee8" status: 200 len: 1463 microversion: 2.1 time: 0.104675 Aug 27 02:48:24.477223 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 922/1872] 10.222.0.70 () {58 vars in 1233 bytes} [Sat Aug 27 02:48:24 2022] GET /compute/v2.1/images/ab2ca817-1bd6-41d1-b485-99378273bee8 => generated 1463 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:24.502218 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-48ec0aed-3959-4b23-9163-43354c23b82b tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Calling method '.version_select at 0x7f5ee732c1f0>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:24.577747 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-48ec0aed-3959-4b23-9163-43354c23b82b tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] 10.222.0.70 "GET /compute/v2.1/images/0ae12db3-6535-4c53-9cf0-6bb5faaa4513" status: 200 len: 1423 microversion: 2.1 time: 0.095550 Aug 27 02:48:24.578357 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 923/1873] 10.222.0.70 () {58 vars in 1233 bytes} [Sat Aug 27 02:48:24 2022] GET /compute/v2.1/images/0ae12db3-6535-4c53-9cf0-6bb5faaa4513 => generated 1423 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:24.583593 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3c390e14-b3d7-4def-a3ef-5f5dcf82559a tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:24.584429 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-3c390e14-b3d7-4def-a3ef-5f5dcf82559a tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] [instance: 191df585-2175-47be-9bd8-29b914535f47] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:24.596512 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3c390e14-b3d7-4def-a3ef-5f5dcf82559a tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:24.597244 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3c390e14-b3d7-4def-a3ef-5f5dcf82559a tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:24.597919 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3c390e14-b3d7-4def-a3ef-5f5dcf82559a tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:24.598937 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3c390e14-b3d7-4def-a3ef-5f5dcf82559a tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:24.600885 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3c390e14-b3d7-4def-a3ef-5f5dcf82559a tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:24.601546 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3c390e14-b3d7-4def-a3ef-5f5dcf82559a tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:24.669597 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f18ae42d-9b45-4549-a2ea-eb70aed91935 tempest-SecurityGroupRulesTestJSON-1478250502 tempest-SecurityGroupRulesTestJSON-1478250502-project] 10.222.0.70 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.838930 Aug 27 02:48:24.671652 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 951/1874] 10.222.0.70 () {60 vars in 1180 bytes} [Sat Aug 27 02:48:23 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:48:24.684407 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-bc8f3b80-953d-4915-be2d-5443f60850ff tempest-SecurityGroupRulesTestJSON-1478250502 tempest-SecurityGroupRulesTestJSON-1478250502-project] Action: 'create', calling method: .version_select at 0x7f5ee7271820>, body: {"security_group_rule": {"parent_group_id": "fca12f2a-cc5b-4597-b3ba-0992652af1e7", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:48:25.065513 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-3c390e14-b3d7-4def-a3ef-5f5dcf82559a tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d626281a9864fe7aed598d4be209137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ae1f9ee6b7e49849b68b3628b76766a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:25.075173 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-3c390e14-b3d7-4def-a3ef-5f5dcf82559a tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] 10.222.0.70 "GET /compute/v2.1/servers/191df585-2175-47be-9bd8-29b914535f47" status: 200 len: 1467 microversion: 2.1 time: 0.495523 Aug 27 02:48:25.078198 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 924/1875] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:24 2022] GET /compute/v2.1/servers/191df585-2175-47be-9bd8-29b914535f47 => generated 1467 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:25.102148 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8913923a-23ce-4340-ab1d-1ef3cde567d9 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-865260299"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:48:25.107605 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-8913923a-23ce-4340-ab1d-1ef3cde567d9 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] [instance: 9d7f8c37-c4a6-400e-9a02-94f9040b780e] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:25.125990 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8913923a-23ce-4340-ab1d-1ef3cde567d9 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:25.129971 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8913923a-23ce-4340-ab1d-1ef3cde567d9 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:25.132938 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8913923a-23ce-4340-ab1d-1ef3cde567d9 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:25.133977 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8913923a-23ce-4340-ab1d-1ef3cde567d9 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:25.134648 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8913923a-23ce-4340-ab1d-1ef3cde567d9 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:25.135446 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8913923a-23ce-4340-ab1d-1ef3cde567d9 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:25.410548 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-bc8f3b80-953d-4915-be2d-5443f60850ff tempest-SecurityGroupRulesTestJSON-1478250502 tempest-SecurityGroupRulesTestJSON-1478250502-project] 10.222.0.70 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.730879 Aug 27 02:48:25.411378 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 952/1876] 10.222.0.70 () {60 vars in 1195 bytes} [Sat Aug 27 02:48:24 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:48:25.419974 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b7ca5b76-8c7f-4d23-be67-441ca6ecd015 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:25.420872 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b7ca5b76-8c7f-4d23-be67-441ca6ecd015 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: 60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:25.434778 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b7ca5b76-8c7f-4d23-be67-441ca6ecd015 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:25.436427 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b7ca5b76-8c7f-4d23-be67-441ca6ecd015 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:25.437323 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b7ca5b76-8c7f-4d23-be67-441ca6ecd015 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:25.438225 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b7ca5b76-8c7f-4d23-be67-441ca6ecd015 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:25.438812 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b7ca5b76-8c7f-4d23-be67-441ca6ecd015 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:25.439522 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b7ca5b76-8c7f-4d23-be67-441ca6ecd015 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:25.623190 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-8913923a-23ce-4340-ab1d-1ef3cde567d9 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] 10.222.0.70 "POST /compute/v2.1/servers/9d7f8c37-c4a6-400e-9a02-94f9040b780e/action" status: 202 len: 0 microversion: 2.1 time: 0.526837 Aug 27 02:48:25.645404 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 925/1877] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 02:48:25 2022] POST /compute/v2.1/servers/9d7f8c37-c4a6-400e-9a02-94f9040b780e/action => generated 0 bytes in 550 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 27 02:48:25.654230 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-5951e7d0-a537-40d0-a2ab-4f215e4c6580 tempest-SecurityGroupRulesTestJSON-1478250502 tempest-SecurityGroupRulesTestJSON-1478250502-project] Action: 'create', calling method: .version_select at 0x7f5ede936ee0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-142776068", "description": "tempest-description-963958432"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:48:25.779097 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b7ca5b76-8c7f-4d23-be67-441ca6ecd015 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:25.789263 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b7ca5b76-8c7f-4d23-be67-441ca6ecd015 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4" status: 200 len: 1471 microversion: 2.1 time: 0.376487 Aug 27 02:48:25.793962 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 953/1878] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:25 2022] GET /compute/v2.1/servers/60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4 => generated 1471 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:25.813774 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-29a1afc1-7d78-49c3-9a64-d446205a334b tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Calling method '.version_select at 0x7f5ee7214b80>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:25.921587 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-29a1afc1-7d78-49c3-9a64-d446205a334b tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] 10.222.0.70 "GET /compute/v2.1/images/0ae12db3-6535-4c53-9cf0-6bb5faaa4513" status: 200 len: 1423 microversion: 2.1 time: 0.123930 Aug 27 02:48:25.930537 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 954/1879] 10.222.0.70 () {58 vars in 1233 bytes} [Sat Aug 27 02:48:25 2022] GET /compute/v2.1/images/0ae12db3-6535-4c53-9cf0-6bb5faaa4513 => generated 1423 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:25.970131 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6a9df04e-3880-48d9-880e-1ade87b75ed3 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Calling method '.version_select at 0x7f5ee7271550>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:26.074416 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-6a9df04e-3880-48d9-880e-1ade87b75ed3 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] 10.222.0.70 "GET /compute/v2.1/images/38bfc7f4-fb52-4d97-a6b8-cd768f249fb5" status: 200 len: 1454 microversion: 2.1 time: 0.142567 Aug 27 02:48:26.082051 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 955/1880] 10.222.0.70 () {58 vars in 1233 bytes} [Sat Aug 27 02:48:25 2022] GET /compute/v2.1/images/38bfc7f4-fb52-4d97-a6b8-cd768f249fb5 => generated 1454 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:26.195786 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-5951e7d0-a537-40d0-a2ab-4f215e4c6580 tempest-SecurityGroupRulesTestJSON-1478250502 tempest-SecurityGroupRulesTestJSON-1478250502-project] 10.222.0.70 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.548763 Aug 27 02:48:26.196541 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 926/1881] 10.222.0.70 () {60 vars in 1180 bytes} [Sat Aug 27 02:48:25 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:48:26.209939 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9a51b8c3-341d-4ab7-ad6c-da0c3d9a8345 tempest-SecurityGroupRulesTestJSON-1478250502 tempest-SecurityGroupRulesTestJSON-1478250502-project] Action: 'create', calling method: .version_select at 0x7f5ee7271940>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-237142598", "description": "tempest-description-1734285924"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:48:26.552246 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-aa8a2804-2cd1-47fd-aa72-f8c393a2ca32 req-fe725be0-4897-4426-b127-4e8ba19391c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b88e24d-509c-49fe-b5e2-b2698620d6d6", "name": "network-vif-plugged", "status": "completed", "tag": "8e5488cf-e7f9-42ad-b395-21ba7264782d"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:48:26.578809 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9a51b8c3-341d-4ab7-ad6c-da0c3d9a8345 tempest-SecurityGroupRulesTestJSON-1478250502 tempest-SecurityGroupRulesTestJSON-1478250502-project] 10.222.0.70 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.373006 Aug 27 02:48:26.580068 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 956/1882] 10.222.0.70 () {60 vars in 1180 bytes} [Sat Aug 27 02:48:26 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:48:26.598717 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-31876197-76d4-4515-a133-be4d7efdf118 tempest-SecurityGroupRulesTestJSON-1478250502 tempest-SecurityGroupRulesTestJSON-1478250502-project] Action: 'create', calling method: .version_select at 0x7f5ee724f430>, body: {"security_group_rule": {"parent_group_id": "54aec542-9bb9-4e32-8c17-e8d86b244493", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "0a03b922-b5cb-4d6a-be01-3e7b8d0c9dee"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:48:26.606715 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-aa8a2804-2cd1-47fd-aa72-f8c393a2ca32 req-fe725be0-4897-4426-b127-4e8ba19391c0 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:26.614648 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-aa8a2804-2cd1-47fd-aa72-f8c393a2ca32 req-fe725be0-4897-4426-b127-4e8ba19391c0 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:26.617154 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-aa8a2804-2cd1-47fd-aa72-f8c393a2ca32 req-fe725be0-4897-4426-b127-4e8ba19391c0 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:26.648026 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-aa8a2804-2cd1-47fd-aa72-f8c393a2ca32 req-fe725be0-4897-4426-b127-4e8ba19391c0 service nova] Creating event network-vif-plugged:8e5488cf-e7f9-42ad-b395-21ba7264782d for instance 4b88e24d-509c-49fe-b5e2-b2698620d6d6 on n-h1-852278-4 Aug 27 02:48:26.658699 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-aa8a2804-2cd1-47fd-aa72-f8c393a2ca32 req-fe725be0-4897-4426-b127-4e8ba19391c0 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110796 Aug 27 02:48:26.664410 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 927/1883] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:48:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:48:26.816446 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-edcbc7e0-5f28-4827-8f8c-67d81b822f1b tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:26.817685 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-edcbc7e0-5f28-4827-8f8c-67d81b822f1b tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: 60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:26.830496 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-edcbc7e0-5f28-4827-8f8c-67d81b822f1b tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:26.834287 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-edcbc7e0-5f28-4827-8f8c-67d81b822f1b tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:26.836595 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-edcbc7e0-5f28-4827-8f8c-67d81b822f1b tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:26.841734 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-edcbc7e0-5f28-4827-8f8c-67d81b822f1b tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:26.843410 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-edcbc7e0-5f28-4827-8f8c-67d81b822f1b tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:26.845424 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-edcbc7e0-5f28-4827-8f8c-67d81b822f1b tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:26.952736 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:48:27.274814 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-edcbc7e0-5f28-4827-8f8c-67d81b822f1b tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:27.286739 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-edcbc7e0-5f28-4827-8f8c-67d81b822f1b tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4" status: 200 len: 1471 microversion: 2.1 time: 0.475616 Aug 27 02:48:27.290059 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-31876197-76d4-4515-a133-be4d7efdf118 tempest-SecurityGroupRulesTestJSON-1478250502 tempest-SecurityGroupRulesTestJSON-1478250502-project] 10.222.0.70 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 0.700886 Aug 27 02:48:27.296329 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 957/1884] 10.222.0.70 () {60 vars in 1195 bytes} [Sat Aug 27 02:48:26 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:48:27.298524 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 928/1885] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:26 2022] GET /compute/v2.1/servers/60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4 => generated 1471 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:27.308076 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-38069d0c-d804-42ca-a9bf-418803b04c0e tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Calling method '.version_select at 0x7f5ede97d700>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:27.313377 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6309f2c3-78ca-4aa0-b35d-feba7f98a6a1 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Calling method '.version_select at 0x7f5ee2ef7dc0>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:27.644590 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-6309f2c3-78ca-4aa0-b35d-feba7f98a6a1 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] 10.222.0.70 "GET /compute/v2.1/images/0ae12db3-6535-4c53-9cf0-6bb5faaa4513" status: 200 len: 1423 microversion: 2.1 time: 0.345799 Aug 27 02:48:27.647156 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 958/1886] 10.222.0.70 () {58 vars in 1233 bytes} [Sat Aug 27 02:48:27 2022] GET /compute/v2.1/images/0ae12db3-6535-4c53-9cf0-6bb5faaa4513 => generated 1423 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:27.661117 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-bcc2bc45-fc4c-4e31-a268-b66f3b84d3fe tempest-SecurityGroupRulesTestJSON-1478250502 tempest-SecurityGroupRulesTestJSON-1478250502-project] Action: 'create', calling method: .version_select at 0x7f5ee724faf0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1232326930", "description": "tempest-description-1662969963"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:48:27.671201 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-38069d0c-d804-42ca-a9bf-418803b04c0e tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] 10.222.0.70 "GET /compute/v2.1/images/38bfc7f4-fb52-4d97-a6b8-cd768f249fb5" status: 200 len: 1454 microversion: 2.1 time: 0.371586 Aug 27 02:48:27.678612 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 929/1887] 10.222.0.70 () {58 vars in 1233 bytes} [Sat Aug 27 02:48:27 2022] GET /compute/v2.1/images/38bfc7f4-fb52-4d97-a6b8-cd768f249fb5 => generated 1454 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:28.316996 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-48d0b70f-3570-4bf9-94a5-6e737dac34cb tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:28.318505 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-48d0b70f-3570-4bf9-94a5-6e737dac34cb tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: 60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:28.331574 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-48d0b70f-3570-4bf9-94a5-6e737dac34cb tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:28.337097 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-48d0b70f-3570-4bf9-94a5-6e737dac34cb tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:28.337780 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-48d0b70f-3570-4bf9-94a5-6e737dac34cb tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:28.338738 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-48d0b70f-3570-4bf9-94a5-6e737dac34cb tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:28.339352 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-48d0b70f-3570-4bf9-94a5-6e737dac34cb tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:28.339998 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-48d0b70f-3570-4bf9-94a5-6e737dac34cb tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:28.551256 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-bcc2bc45-fc4c-4e31-a268-b66f3b84d3fe tempest-SecurityGroupRulesTestJSON-1478250502 tempest-SecurityGroupRulesTestJSON-1478250502-project] 10.222.0.70 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.902604 Aug 27 02:48:28.551916 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 959/1888] 10.222.0.70 () {60 vars in 1180 bytes} [Sat Aug 27 02:48:27 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:48:28.566296 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-51e88876-61ac-4a38-8352-e5bf2b6a43a4 tempest-SecurityGroupRulesTestJSON-1478250502 tempest-SecurityGroupRulesTestJSON-1478250502-project] Action: 'create', calling method: .version_select at 0x7f5ee3030a60>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1379739347", "description": "tempest-description-1032547015"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:48:29.405593 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-48d0b70f-3570-4bf9-94a5-6e737dac34cb tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:29.455198 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-48d0b70f-3570-4bf9-94a5-6e737dac34cb tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4" status: 200 len: 1476 microversion: 2.1 time: 1.142457 Aug 27 02:48:29.456197 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 930/1889] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:28 2022] GET /compute/v2.1/servers/60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4 => generated 1476 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:48:29.483748 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e9994652-f4c8-4e36-9575-b1ac7b6997ff tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Calling method '.version_select at 0x7f5ee7271d30>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:29.694843 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e9994652-f4c8-4e36-9575-b1ac7b6997ff tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] 10.222.0.70 "GET /compute/v2.1/images/0ae12db3-6535-4c53-9cf0-6bb5faaa4513" status: 200 len: 1423 microversion: 2.1 time: 0.227765 Aug 27 02:48:29.708006 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 931/1890] 10.222.0.70 () {58 vars in 1233 bytes} [Sat Aug 27 02:48:29 2022] GET /compute/v2.1/images/0ae12db3-6535-4c53-9cf0-6bb5faaa4513 => generated 1423 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:29.713533 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4d64a230-c3e3-4219-bbc4-52be29d3b851 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Calling method '.version_select at 0x7f5ede97d4c0>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:29.808648 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-51e88876-61ac-4a38-8352-e5bf2b6a43a4 tempest-SecurityGroupRulesTestJSON-1478250502 tempest-SecurityGroupRulesTestJSON-1478250502-project] 10.222.0.70 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 1.244311 Aug 27 02:48:29.825305 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 960/1891] 10.222.0.70 () {60 vars in 1180 bytes} [Sat Aug 27 02:48:28 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:48:29.857981 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-b9ac107f-6ce2-4c69-9203-f9590e6f727b req-a10f8792-9f7c-49c8-a275-be4718462393 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "191df585-2175-47be-9bd8-29b914535f47", "name": "network-vif-unplugged", "status": "completed", "tag": "178a305e-f6ec-4889-9602-1513853a515b"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:48:29.879744 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-4d64a230-c3e3-4219-bbc4-52be29d3b851 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] 10.222.0.70 "GET /compute/v2.1/images/38bfc7f4-fb52-4d97-a6b8-cd768f249fb5" status: 200 len: 1454 microversion: 2.1 time: 0.179638 Aug 27 02:48:29.901359 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 932/1892] 10.222.0.70 () {58 vars in 1233 bytes} [Sat Aug 27 02:48:29 2022] GET /compute/v2.1/images/38bfc7f4-fb52-4d97-a6b8-cd768f249fb5 => generated 1454 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:29.943137 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a06edf2e-2bcf-4faf-a884-2c86dfbe953c tempest-SecurityGroupRulesTestJSON-1478250502 tempest-SecurityGroupRulesTestJSON-1478250502-project] Action: 'create', calling method: .version_select at 0x7f5ee732c1f0>, body: {"security_group_rule": {"parent_group_id": "0cfa5ba9-a217-4200-b2e8-89426a3b1faf", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "c9de0ffa-aa9c-4952-b12b-f09123556fb9"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:48:29.943887 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-b9ac107f-6ce2-4c69-9203-f9590e6f727b req-a10f8792-9f7c-49c8-a275-be4718462393 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:29.944976 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-b9ac107f-6ce2-4c69-9203-f9590e6f727b req-a10f8792-9f7c-49c8-a275-be4718462393 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:29.945878 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-b9ac107f-6ce2-4c69-9203-f9590e6f727b req-a10f8792-9f7c-49c8-a275-be4718462393 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:30.044301 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-b9ac107f-6ce2-4c69-9203-f9590e6f727b req-a10f8792-9f7c-49c8-a275-be4718462393 service nova] Creating event network-vif-unplugged:178a305e-f6ec-4889-9602-1513853a515b for instance 191df585-2175-47be-9bd8-29b914535f47 on n-h2-852278-4 Aug 27 02:48:30.059679 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-b9ac107f-6ce2-4c69-9203-f9590e6f727b req-a10f8792-9f7c-49c8-a275-be4718462393 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.231564 Aug 27 02:48:30.062340 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 961/1893] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:48:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:48:30.485198 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-98d6269d-a8f1-40b8-90d5-5641c99bf2f3 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:30.496652 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-98d6269d-a8f1-40b8-90d5-5641c99bf2f3 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: 60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:30.547094 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-98d6269d-a8f1-40b8-90d5-5641c99bf2f3 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:30.550792 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-98d6269d-a8f1-40b8-90d5-5641c99bf2f3 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:30.554403 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-98d6269d-a8f1-40b8-90d5-5641c99bf2f3 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:30.559281 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-98d6269d-a8f1-40b8-90d5-5641c99bf2f3 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:30.562686 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-98d6269d-a8f1-40b8-90d5-5641c99bf2f3 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:30.563459 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-98d6269d-a8f1-40b8-90d5-5641c99bf2f3 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:32.486584 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-98d6269d-a8f1-40b8-90d5-5641c99bf2f3 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:32.518049 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-98d6269d-a8f1-40b8-90d5-5641c99bf2f3 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4" status: 200 len: 1476 microversion: 2.1 time: 2.043439 Aug 27 02:48:32.547640 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 962/1894] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:30 2022] GET /compute/v2.1/servers/60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4 => generated 1476 bytes in 2074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:32.575090 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b4f08335-e0b9-437d-b457-a42144cb59b2 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Calling method '.version_select at 0x7f5ee724fc10>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:33.689269 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a06edf2e-2bcf-4faf-a884-2c86dfbe953c tempest-SecurityGroupRulesTestJSON-1478250502 tempest-SecurityGroupRulesTestJSON-1478250502-project] 10.222.0.70 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 3.786224 Aug 27 02:48:33.690320 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 933/1895] 10.222.0.70 () {60 vars in 1195 bytes} [Sat Aug 27 02:48:29 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 3789 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:48:33.699961 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-679f3cf0-df71-45c9-85c3-c74a854ac853 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Calling method '.version_select at 0x7f5ede996820>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:38.331485 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:48:39.448764 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=8 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:48:40.539848 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:48:42.492991 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=96 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:48:45.487761 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b4f08335-e0b9-437d-b457-a42144cb59b2 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] 10.222.0.70 "GET /compute/v2.1/images/0ae12db3-6535-4c53-9cf0-6bb5faaa4513" status: 200 len: 1432 microversion: 2.1 time: 12.938430 Aug 27 02:48:45.488403 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 963/1896] 10.222.0.70 () {58 vars in 1233 bytes} [Sat Aug 27 02:48:32 2022] GET /compute/v2.1/images/0ae12db3-6535-4c53-9cf0-6bb5faaa4513 => generated 1432 bytes in 12940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:45.493122 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6ba236af-9471-4370-bb9c-0ef79fe6efc3 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:45.493805 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-6ba236af-9471-4370-bb9c-0ef79fe6efc3 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: 60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:45.494996 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-679f3cf0-df71-45c9-85c3-c74a854ac853 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] 10.222.0.70 "GET /compute/v2.1/images/38bfc7f4-fb52-4d97-a6b8-cd768f249fb5" status: 200 len: 1454 microversion: 2.1 time: 11.803028 Aug 27 02:48:45.495934 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 934/1897] 10.222.0.70 () {58 vars in 1233 bytes} [Sat Aug 27 02:48:33 2022] GET /compute/v2.1/images/38bfc7f4-fb52-4d97-a6b8-cd768f249fb5 => generated 1454 bytes in 11805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:45.504788 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d6d5e469-01aa-45dc-a0d5-4280383e63ad tempest-SecurityGroupRulesTestJSON-1478250502 tempest-SecurityGroupRulesTestJSON-1478250502-project] Calling method '.version_select at 0x7f5ee7271040>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:45.512888 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6ba236af-9471-4370-bb9c-0ef79fe6efc3 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:45.513388 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6ba236af-9471-4370-bb9c-0ef79fe6efc3 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:45.513830 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6ba236af-9471-4370-bb9c-0ef79fe6efc3 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:45.514590 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6ba236af-9471-4370-bb9c-0ef79fe6efc3 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:45.515038 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6ba236af-9471-4370-bb9c-0ef79fe6efc3 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:45.516109 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6ba236af-9471-4370-bb9c-0ef79fe6efc3 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:45.923760 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-6ba236af-9471-4370-bb9c-0ef79fe6efc3 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:45.933236 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-6ba236af-9471-4370-bb9c-0ef79fe6efc3 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4" status: 200 len: 1476 microversion: 2.1 time: 0.443591 Aug 27 02:48:45.943492 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 964/1898] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:45 2022] GET /compute/v2.1/servers/60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4 => generated 1476 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:45.971514 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d6d5e469-01aa-45dc-a0d5-4280383e63ad tempest-SecurityGroupRulesTestJSON-1478250502 tempest-SecurityGroupRulesTestJSON-1478250502-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/c9de0ffa-aa9c-4952-b12b-f09123556fb9" status: 202 len: 0 microversion: 2.1 time: 0.473273 Aug 27 02:48:45.972658 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 935/1899] 10.222.0.70 () {58 vars in 1272 bytes} [Sat Aug 27 02:48:45 2022] DELETE /compute/v2.1/os-security-groups/c9de0ffa-aa9c-4952-b12b-f09123556fb9 => generated 0 bytes in 476 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:48:45.990213 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-3cf2b3df-d954-40e3-933f-7fae37884c85 req-5d11eb4b-fa61-4cb5-91c3-ccf6d920221f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d7f8c37-c4a6-400e-9a02-94f9040b780e", "name": "network-vif-plugged", "status": "completed", "tag": "545c57b0-4a40-4554-9d90-9ca7c0773d35"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:48:46.032248 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-3cf2b3df-d954-40e3-933f-7fae37884c85 req-5d11eb4b-fa61-4cb5-91c3-ccf6d920221f service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:46.035059 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-3cf2b3df-d954-40e3-933f-7fae37884c85 req-5d11eb4b-fa61-4cb5-91c3-ccf6d920221f service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:46.035659 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-3cf2b3df-d954-40e3-933f-7fae37884c85 req-5d11eb4b-fa61-4cb5-91c3-ccf6d920221f service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:46.054284 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-3cf2b3df-d954-40e3-933f-7fae37884c85 req-5d11eb4b-fa61-4cb5-91c3-ccf6d920221f service nova] Creating event network-vif-plugged:545c57b0-4a40-4554-9d90-9ca7c0773d35 for instance 9d7f8c37-c4a6-400e-9a02-94f9040b780e on n-h2-852278-4 Aug 27 02:48:46.062953 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-3cf2b3df-d954-40e3-933f-7fae37884c85 req-5d11eb4b-fa61-4cb5-91c3-ccf6d920221f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081251 Aug 27 02:48:46.063838 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 936/1900] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:48:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:48:46.070207 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b7996965-390a-4757-bba8-025ae4b7a669 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Calling method '.version_select at 0x7f5ee732cd30>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:46.144210 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b7996965-390a-4757-bba8-025ae4b7a669 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] 10.222.0.70 "GET /compute/v2.1/images/0ae12db3-6535-4c53-9cf0-6bb5faaa4513" status: 200 len: 1432 microversion: 2.1 time: 0.077621 Aug 27 02:48:46.145295 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 937/1901] 10.222.0.70 () {58 vars in 1233 bytes} [Sat Aug 27 02:48:46 2022] GET /compute/v2.1/images/0ae12db3-6535-4c53-9cf0-6bb5faaa4513 => generated 1432 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:46.165186 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-17b282ac-57da-4737-b6a1-2c2902303e5d tempest-SecurityGroupRulesTestJSON-1478250502 tempest-SecurityGroupRulesTestJSON-1478250502-project] Calling method '.version_select at 0x7f5ee7271b80>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:46.238948 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-17b282ac-57da-4737-b6a1-2c2902303e5d tempest-SecurityGroupRulesTestJSON-1478250502 tempest-SecurityGroupRulesTestJSON-1478250502-project] 10.222.0.70 "GET /compute/v2.1/os-security-groups/0cfa5ba9-a217-4200-b2e8-89426a3b1faf" status: 200 len: 248 microversion: 2.1 time: 0.079733 Aug 27 02:48:46.239541 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 938/1902] 10.222.0.70 () {58 vars in 1269 bytes} [Sat Aug 27 02:48:46 2022] GET /compute/v2.1/os-security-groups/0cfa5ba9-a217-4200-b2e8-89426a3b1faf => generated 248 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:48:46.244850 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3e6acc01-3391-4a03-9cf8-cfe09bb718bc tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:46.245838 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-3e6acc01-3391-4a03-9cf8-cfe09bb718bc tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] [instance: 4b88e24d-509c-49fe-b5e2-b2698620d6d6] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:46.259839 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3e6acc01-3391-4a03-9cf8-cfe09bb718bc tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:46.260826 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3e6acc01-3391-4a03-9cf8-cfe09bb718bc tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:46.264067 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3e6acc01-3391-4a03-9cf8-cfe09bb718bc tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:46.265879 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3e6acc01-3391-4a03-9cf8-cfe09bb718bc tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:46.266670 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3e6acc01-3391-4a03-9cf8-cfe09bb718bc tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:46.268598 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3e6acc01-3391-4a03-9cf8-cfe09bb718bc tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:46.471146 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-3e6acc01-3391-4a03-9cf8-cfe09bb718bc tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073966022576475b983af066d7edb099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96abd4aa8efa4761869dabdd1f143519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:46.491287 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-3e6acc01-3391-4a03-9cf8-cfe09bb718bc tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] 10.222.0.70 "GET /compute/v2.1/servers/4b88e24d-509c-49fe-b5e2-b2698620d6d6" status: 200 len: 1466 microversion: 2.1 time: 0.249473 Aug 27 02:48:46.505551 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 939/1903] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:46 2022] GET /compute/v2.1/servers/4b88e24d-509c-49fe-b5e2-b2698620d6d6 => generated 1466 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:46.519416 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4cb05347-d7f4-46d1-8a5f-f8c074688efb tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-324482559", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "networks": [{"uuid": "56c1e6e5-f638-4015-aee9-61020b017eac"}]}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:48:46.524865 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3c2d3808-54c7-4589-9b2d-163e0fd5a4a5 tempest-SecurityGroupRulesTestJSON-1478250502 tempest-SecurityGroupRulesTestJSON-1478250502-project] Action: 'create', calling method: .version_select at 0x7f5ede8f7940>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1683628163", "description": "tempest-description-164081424"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:48:46.630025 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.network.neutron [None req-4cb05347-d7f4-46d1-8a5f-f8c074688efb tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] validate_networks() for [('56c1e6e5-f638-4015-aee9-61020b017eac', None, None, None, None, None)] {{(pid=134052) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:48:46.803627 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-3c2d3808-54c7-4589-9b2d-163e0fd5a4a5 tempest-SecurityGroupRulesTestJSON-1478250502 tempest-SecurityGroupRulesTestJSON-1478250502-project] 10.222.0.70 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.295860 Aug 27 02:48:46.805354 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 940/1904] 10.222.0.70 () {60 vars in 1180 bytes} [Sat Aug 27 02:48:46 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:48:46.811758 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0fa0a2f6-2f5b-476f-af16-0370536c6120 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Calling method '.version_select at 0x7f5ee732caf0>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:46.906249 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-0fa0a2f6-2f5b-476f-af16-0370536c6120 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] 10.222.0.70 "GET /compute/v2.1/images/38bfc7f4-fb52-4d97-a6b8-cd768f249fb5" status: 200 len: 1454 microversion: 2.1 time: 0.099494 Aug 27 02:48:46.912125 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 941/1905] 10.222.0.70 () {58 vars in 1233 bytes} [Sat Aug 27 02:48:46 2022] GET /compute/v2.1/images/38bfc7f4-fb52-4d97-a6b8-cd768f249fb5 => generated 1454 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:46.934795 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-eaa107ae-6c99-4462-983c-d2be7dbb3cdd tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Calling method '.version_select at 0x7f5ee7216790>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:47.038121 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-eaa107ae-6c99-4462-983c-d2be7dbb3cdd tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] 10.222.0.70 "GET /compute/v2.1/images/1552acd0-176a-4c81-b680-29d74105e9d6" status: 200 len: 784 microversion: 2.1 time: 0.123710 Aug 27 02:48:47.039421 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 942/1906] 10.222.0.70 () {58 vars in 1233 bytes} [Sat Aug 27 02:48:46 2022] GET /compute/v2.1/images/1552acd0-176a-4c81-b680-29d74105e9d6 => generated 784 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:48:47.056525 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-83278be2-5ea5-485a-a1c7-3bd10bf33ede tempest-SecurityGroupRulesTestJSON-1478250502 tempest-SecurityGroupRulesTestJSON-1478250502-project] Action: 'create', calling method: .version_select at 0x7f5ede9325e0>, body: {"security_group_rule": {"parent_group_id": "bd99327d-d9b2-45a5-aa99-692c3a4eb042", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:48:47.565445 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-4cb05347-d7f4-46d1-8a5f-f8c074688efb tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Flavor limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:48:47.566583 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-4cb05347-d7f4-46d1-8a5f-f8c074688efb tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Image limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:48:47.567248 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-4cb05347-d7f4-46d1-8a5f-f8c074688efb tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Flavor pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:48:47.567819 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-4cb05347-d7f4-46d1-8a5f-f8c074688efb tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Image pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:48:47.568417 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-4cb05347-d7f4-46d1-8a5f-f8c074688efb tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:48:47.584162 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4cb05347-d7f4-46d1-8a5f-f8c074688efb tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:47.586488 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4cb05347-d7f4-46d1-8a5f-f8c074688efb tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:47.587084 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4cb05347-d7f4-46d1-8a5f-f8c074688efb tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:47.588540 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4cb05347-d7f4-46d1-8a5f-f8c074688efb tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:47.589378 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4cb05347-d7f4-46d1-8a5f-f8c074688efb tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:47.590301 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4cb05347-d7f4-46d1-8a5f-f8c074688efb tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:47.600104 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-83278be2-5ea5-485a-a1c7-3bd10bf33ede tempest-SecurityGroupRulesTestJSON-1478250502 tempest-SecurityGroupRulesTestJSON-1478250502-project] 10.222.0.70 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.559211 Aug 27 02:48:47.600740 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 943/1907] 10.222.0.70 () {60 vars in 1195 bytes} [Sat Aug 27 02:48:47 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:48:47.613677 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0b64de14-d973-4ed1-9e6a-62f2d2a9566a tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:47.619427 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-0b64de14-d973-4ed1-9e6a-62f2d2a9566a tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: 60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:47.621412 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-4cb05347-d7f4-46d1-8a5f-f8c074688efb tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Getting quotas for project 4f9be56fbeb64cb08b9be4e3d7436782. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:48:47.629026 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-4cb05347-d7f4-46d1-8a5f-f8c074688efb tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Getting quotas for user 66c0fc8492654e6e85a90ce04736c055 and project 4f9be56fbeb64cb08b9be4e3d7436782. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:48:47.640931 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0b64de14-d973-4ed1-9e6a-62f2d2a9566a tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:47.641514 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0b64de14-d973-4ed1-9e6a-62f2d2a9566a tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:47.641973 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0b64de14-d973-4ed1-9e6a-62f2d2a9566a tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:47.645678 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0b64de14-d973-4ed1-9e6a-62f2d2a9566a tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:47.646208 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0b64de14-d973-4ed1-9e6a-62f2d2a9566a tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:47.648014 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-4cb05347-d7f4-46d1-8a5f-f8c074688efb tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Going to run 1 instances... {{(pid=134052) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:48:47.649201 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0b64de14-d973-4ed1-9e6a-62f2d2a9566a tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:47.651136 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-4cb05347-d7f4-46d1-8a5f-f8c074688efb tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] [instance: e445cdc5-5ecb-487c-adee-f5cb9862283c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134052) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:48:47.736913 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-4cb05347-d7f4-46d1-8a5f-f8c074688efb tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.792072 Aug 27 02:48:47.738312 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 965/1908] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 02:48:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1794 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:48:47.744864 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b96bccc8-d8fa-4cc2-bcc6-b6de1ad0d742 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:47.756628 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b96bccc8-d8fa-4cc2-bcc6-b6de1ad0d742 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] 10.222.0.70 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.016496 Aug 27 02:48:47.768489 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 966/1909] 10.222.0.70 () {58 vars in 1137 bytes} [Sat Aug 27 02:48:47 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:48:47.892082 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-0b64de14-d973-4ed1-9e6a-62f2d2a9566a tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:47.905221 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-0b64de14-d973-4ed1-9e6a-62f2d2a9566a tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4" status: 200 len: 1476 microversion: 2.1 time: 0.303029 Aug 27 02:48:47.905835 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 944/1910] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:47 2022] GET /compute/v2.1/servers/60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4 => generated 1476 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:47.911564 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-97c31e55-0c9e-484f-b6cf-df4c624b2770 tempest-SecurityGroupRulesTestJSON-1478250502 tempest-SecurityGroupRulesTestJSON-1478250502-project] Action: 'create', calling method: .version_select at 0x7f5ede932b80>, body: {"security_group_rule": {"parent_group_id": "bd99327d-d9b2-45a5-aa99-692c3a4eb042", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:48:48.112674 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8fdd0a55-ecad-4f6e-9573-cce6b477ab9a tempest-ServicesAdminNegativeV253TestJSON-1317500285 tempest-ServicesAdminNegativeV253TestJSON-1317500285-project-admin] Action: 'update', calling method: .version_select at 0x7f5ee725e700>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:48:48.121873 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8fdd0a55-ecad-4f6e-9573-cce6b477ab9a tempest-ServicesAdminNegativeV253TestJSON-1317500285 tempest-ServicesAdminNegativeV253TestJSON-1317500285-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:48.127745 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8fdd0a55-ecad-4f6e-9573-cce6b477ab9a tempest-ServicesAdminNegativeV253TestJSON-1317500285 tempest-ServicesAdminNegativeV253TestJSON-1317500285-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:48.128544 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8fdd0a55-ecad-4f6e-9573-cce6b477ab9a tempest-ServicesAdminNegativeV253TestJSON-1317500285 tempest-ServicesAdminNegativeV253TestJSON-1317500285-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:48.139072 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8fdd0a55-ecad-4f6e-9573-cce6b477ab9a tempest-ServicesAdminNegativeV253TestJSON-1317500285 tempest-ServicesAdminNegativeV253TestJSON-1317500285-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:48.140279 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8fdd0a55-ecad-4f6e-9573-cce6b477ab9a tempest-ServicesAdminNegativeV253TestJSON-1317500285 tempest-ServicesAdminNegativeV253TestJSON-1317500285-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:48.141087 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8fdd0a55-ecad-4f6e-9573-cce6b477ab9a tempest-ServicesAdminNegativeV253TestJSON-1317500285 tempest-ServicesAdminNegativeV253TestJSON-1317500285-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:48.162391 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-8fdd0a55-ecad-4f6e-9573-cce6b477ab9a tempest-ServicesAdminNegativeV253TestJSON-1317500285 tempest-ServicesAdminNegativeV253TestJSON-1317500285-project-admin] HTTP exception thrown: Service f239d831-665a-4697-8149-48894f106108 could not be found. Aug 27 02:48:48.168799 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8fdd0a55-ecad-4f6e-9573-cce6b477ab9a tempest-ServicesAdminNegativeV253TestJSON-1317500285 tempest-ServicesAdminNegativeV253TestJSON-1317500285-project-admin] Request method failure captured: Aug 27 02:48:48.168799 n-d-852278-4 devstack@n-api.service[134052]: request: PUT /compute/v2.1/os-services/f239d831-665a-4697-8149-48894f106108 HTTP/1.1 Aug 27 02:48:48.168799 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:48:48.168799 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:48:48.168799 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:48:48.168799 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 56 Aug 27 02:48:48.168799 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:48:48.168799 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:48:48.168799 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:48:48.168799 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:48:48.168799 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYYOF3KcOmPOAFgNblBLa0MOTc-weXJ5-CFPUk9gFv35oiwNhisAHpQQ-l_ZHqcawmeM3tdAWUEJC_OzhdAyFK6W6pHs2Ui64Q0i9T5_AptlhDp4ApZNzLdKcKNBCVR3yrbvVewzEBuQmlQ4dbEQP-HGWsz3TK7jylIZ76_NkvrNcDc Aug 27 02:48:48.168799 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:48:48.168799 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:48:48.168799 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:48:48.168799 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:48:48.168799 n-d-852278-4 devstack@n-api.service[134052]: X-Openstack-Nova-Api-Version: 2.53 Aug 27 02:48:48.168799 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:48:48.168799 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:48:48.168799 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: d9bd67f075a341008938124b8c5e8aa9 Aug 27 02:48:48.168799 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1317500285 Aug 27 02:48:48.168799 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,admin,member Aug 27 02:48:48.168799 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,admin,member Aug 27 02:48:48.168799 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d9bd67f075a341008938124b8c5e8aa9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d9bd67f075a341008938124b8c5e8aa9", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d9bd67f075a341008938124b8c5e8aa9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d9bd67f075a341008938124b8c5e8aa9"}]}] Aug 27 02:48:48.168799 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1317500285 Aug 27 02:48:48.168799 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: d9bd67f075a341008938124b8c5e8aa9 Aug 27 02:48:48.168799 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1317500285 Aug 27 02:48:48.168799 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1317500285-project-admin Aug 27 02:48:48.168799 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:48:48.168799 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:48:48.168799 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 343b105dff08491c9ac24a00b13946a4 Aug 27 02:48:48.168799 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1317500285-project-admin Aug 27 02:48:48.168799 n-d-852278-4 devstack@n-api.service[134052]: Aug 27 02:48:48.168799 n-d-852278-4 devstack@n-api.service[134052]: {"status": "disabled", "disabled_reason": "maintenance"} Aug 27 02:48:48.168799 n-d-852278-4 devstack@n-api.service[134052]: method: Aug 27 02:48:48.168799 n-d-852278-4 devstack@n-api.service[134052]: exception: Service f239d831-665a-4697-8149-48894f106108 could not be found. Aug 27 02:48:48.168799 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': 'f239d831-665a-4697-8149-48894f106108', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Aug 27 02:48:48.168799 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:48:48.168799 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:48:48.168799 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6205, in service_get_by_id Aug 27 02:48:48.168799 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 27 02:48:48.168799 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6065, in _find_service_in_cell Aug 27 02:48:48.168799 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 27 02:48:48.168799 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 27 02:48:48.168799 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:48:48.168799 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:48:48.168799 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:48:48.168799 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:48:48.168799 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Aug 27 02:48:48.168799 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 27 02:48:48.168799 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Aug 27 02:48:48.168799 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 27 02:48:48.168799 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service f239d831-665a-4697-8149-48894f106108 could not be found. Aug 27 02:48:48.168799 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:48:48.168799 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:48:48.168799 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:48:48.168799 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:48:48.168799 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:48:48.168799 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:48:48.168799 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:48:48.168799 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:48:48.168799 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:48:48.168799 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:48:48.168799 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:48:48.168799 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:48:48.168799 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:48:48.168799 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:48:48.178538 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Aug 27 02:48:48.178538 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:48:48.178538 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service f239d831-665a-4697-8149-48894f106108 could not be found. Aug 27 02:48:48.178538 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:48:48.178538 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:48:48.178538 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:48:48.178538 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:48:48.178538 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:48:48.178538 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:48:48.178538 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:48:48.178538 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:48:48.178538 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service f239d831-665a-4697-8149-48894f106108 could not be found. Aug 27 02:48:48.178538 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:48:48.182561 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8fdd0a55-ecad-4f6e-9573-cce6b477ab9a tempest-ServicesAdminNegativeV253TestJSON-1317500285 tempest-ServicesAdminNegativeV253TestJSON-1317500285-project-admin] Returning 404 to user: Service f239d831-665a-4697-8149-48894f106108 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:48:48.183805 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-8fdd0a55-ecad-4f6e-9573-cce6b477ab9a tempest-ServicesAdminNegativeV253TestJSON-1317500285 tempest-ServicesAdminNegativeV253TestJSON-1317500285-project-admin] 10.222.0.70 "PUT /compute/v2.1/os-services/f239d831-665a-4697-8149-48894f106108" status: 404 len: 110 microversion: 2.53 time: 0.414009 Aug 27 02:48:48.189216 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 967/1911] 10.222.0.70 () {62 vars in 1309 bytes} [Sat Aug 27 02:48:47 2022] PUT /compute/v2.1/os-services/f239d831-665a-4697-8149-48894f106108 => generated 110 bytes in 420 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 02:48:48.194996 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-2ed8fecd-afa4-4cfc-97f3-ece87d240853 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:48.195950 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-2ed8fecd-afa4-4cfc-97f3-ece87d240853 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] [instance: e445cdc5-5ecb-487c-adee-f5cb9862283c] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:48.292857 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-2ed8fecd-afa4-4cfc-97f3-ece87d240853 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66c0fc8492654e6e85a90ce04736c055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f9be56fbeb64cb08b9be4e3d7436782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:48.305793 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-2ed8fecd-afa4-4cfc-97f3-ece87d240853 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] 10.222.0.70 "GET /compute/v2.1/servers/e445cdc5-5ecb-487c-adee-f5cb9862283c" status: 200 len: 1223 microversion: 2.1 time: 0.114928 Aug 27 02:48:48.307684 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 968/1912] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:48 2022] GET /compute/v2.1/servers/e445cdc5-5ecb-487c-adee-f5cb9862283c => generated 1223 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:48.312582 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-fa39787c-0c58-428e-b8ed-1b25b90bc11e tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Calling method '.version_select at 0x7f5ee727b550>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:48.337134 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-97c31e55-0c9e-484f-b6cf-df4c624b2770 tempest-SecurityGroupRulesTestJSON-1478250502 tempest-SecurityGroupRulesTestJSON-1478250502-project] 10.222.0.70 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.429148 Aug 27 02:48:48.338702 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 945/1913] 10.222.0.70 () {60 vars in 1195 bytes} [Sat Aug 27 02:48:47 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:48:48.359907 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8f414cdc-202b-4530-a992-cbb0e59b310f tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Calling method '.version_select at 0x7f5ee732c0d0>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:49.446085 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-fa39787c-0c58-428e-b8ed-1b25b90bc11e tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] 10.222.0.70 "DELETE /compute/v2.1/images/0ae12db3-6535-4c53-9cf0-6bb5faaa4513" status: 204 len: 0 microversion: 2.1 time: 1.137035 Aug 27 02:48:49.454747 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 969/1914] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:48 2022] DELETE /compute/v2.1/images/0ae12db3-6535-4c53-9cf0-6bb5faaa4513 => generated 0 bytes in 1140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:48:49.461184 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e938496b-5ed9-4652-9c61-3826b62dea67 tempest-ServicesAdminNegativeV253TestJSON-1317500285 tempest-ServicesAdminNegativeV253TestJSON-1317500285-project-admin] Action: 'update', calling method: .version_select at 0x7f5ee727b040>, body: {"status": "disabled"} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:48:49.469623 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e938496b-5ed9-4652-9c61-3826b62dea67 tempest-ServicesAdminNegativeV253TestJSON-1317500285 tempest-ServicesAdminNegativeV253TestJSON-1317500285-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:49.470345 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e938496b-5ed9-4652-9c61-3826b62dea67 tempest-ServicesAdminNegativeV253TestJSON-1317500285 tempest-ServicesAdminNegativeV253TestJSON-1317500285-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:49.487458 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e938496b-5ed9-4652-9c61-3826b62dea67 tempest-ServicesAdminNegativeV253TestJSON-1317500285 tempest-ServicesAdminNegativeV253TestJSON-1317500285-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:49.499127 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e938496b-5ed9-4652-9c61-3826b62dea67 tempest-ServicesAdminNegativeV253TestJSON-1317500285 tempest-ServicesAdminNegativeV253TestJSON-1317500285-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:49.505309 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e938496b-5ed9-4652-9c61-3826b62dea67 tempest-ServicesAdminNegativeV253TestJSON-1317500285 tempest-ServicesAdminNegativeV253TestJSON-1317500285-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:49.505854 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e938496b-5ed9-4652-9c61-3826b62dea67 tempest-ServicesAdminNegativeV253TestJSON-1317500285 tempest-ServicesAdminNegativeV253TestJSON-1317500285-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:49.516761 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-8f414cdc-202b-4530-a992-cbb0e59b310f tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] 10.222.0.70 "GET /compute/v2.1/images/38bfc7f4-fb52-4d97-a6b8-cd768f249fb5" status: 200 len: 1454 microversion: 2.1 time: 1.167055 Aug 27 02:48:49.517360 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 946/1915] 10.222.0.70 () {58 vars in 1233 bytes} [Sat Aug 27 02:48:48 2022] GET /compute/v2.1/images/38bfc7f4-fb52-4d97-a6b8-cd768f249fb5 => generated 1454 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:49.528947 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-e938496b-5ed9-4652-9c61-3826b62dea67 tempest-ServicesAdminNegativeV253TestJSON-1317500285 tempest-ServicesAdminNegativeV253TestJSON-1317500285-project-admin] HTTP exception thrown: Service f239d831-665a-4697-8149-48894f106108 could not be found. Aug 27 02:48:49.530623 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e938496b-5ed9-4652-9c61-3826b62dea67 tempest-ServicesAdminNegativeV253TestJSON-1317500285 tempest-ServicesAdminNegativeV253TestJSON-1317500285-project-admin] Request method failure captured: Aug 27 02:48:49.530623 n-d-852278-4 devstack@n-api.service[134052]: request: PUT /compute/v2.1/os-services/f239d831-665a-4697-8149-48894f106108 HTTP/1.1 Aug 27 02:48:49.530623 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:48:49.530623 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:48:49.530623 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:48:49.530623 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 22 Aug 27 02:48:49.530623 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:48:49.530623 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:48:49.530623 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:48:49.530623 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:48:49.530623 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYYOF3KcOmPOAFgNblBLa0MOTc-weXJ5-CFPUk9gFv35oiwNhisAHpQQ-l_ZHqcawmeM3tdAWUEJC_OzhdAyFK6W6pHs2Ui64Q0i9T5_AptlhDp4ApZNzLdKcKNBCVR3yrbvVewzEBuQmlQ4dbEQP-HGWsz3TK7jylIZ76_NkvrNcDc Aug 27 02:48:49.530623 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:48:49.530623 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:48:49.530623 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:48:49.530623 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:48:49.530623 n-d-852278-4 devstack@n-api.service[134052]: X-Openstack-Nova-Api-Version: 2.53 Aug 27 02:48:49.530623 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:48:49.530623 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:48:49.530623 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: d9bd67f075a341008938124b8c5e8aa9 Aug 27 02:48:49.530623 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1317500285 Aug 27 02:48:49.530623 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,admin,member Aug 27 02:48:49.530623 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,admin,member Aug 27 02:48:49.530623 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d9bd67f075a341008938124b8c5e8aa9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d9bd67f075a341008938124b8c5e8aa9", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d9bd67f075a341008938124b8c5e8aa9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d9bd67f075a341008938124b8c5e8aa9"}]}] Aug 27 02:48:49.530623 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1317500285 Aug 27 02:48:49.530623 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: d9bd67f075a341008938124b8c5e8aa9 Aug 27 02:48:49.530623 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1317500285 Aug 27 02:48:49.530623 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1317500285-project-admin Aug 27 02:48:49.530623 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:48:49.530623 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:48:49.530623 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 343b105dff08491c9ac24a00b13946a4 Aug 27 02:48:49.530623 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1317500285-project-admin Aug 27 02:48:49.530623 n-d-852278-4 devstack@n-api.service[134052]: Aug 27 02:48:49.530623 n-d-852278-4 devstack@n-api.service[134052]: {"status": "disabled"} Aug 27 02:48:49.530623 n-d-852278-4 devstack@n-api.service[134052]: method: Aug 27 02:48:49.530623 n-d-852278-4 devstack@n-api.service[134052]: exception: Service f239d831-665a-4697-8149-48894f106108 could not be found. Aug 27 02:48:49.530623 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': 'f239d831-665a-4697-8149-48894f106108', 'body': {'status': 'disabled'}} Aug 27 02:48:49.530623 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:48:49.530623 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:48:49.530623 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6205, in service_get_by_id Aug 27 02:48:49.530623 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 27 02:48:49.530623 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6065, in _find_service_in_cell Aug 27 02:48:49.530623 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 27 02:48:49.530623 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 27 02:48:49.530623 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:48:49.530623 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:48:49.530623 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:48:49.530623 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:48:49.530623 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Aug 27 02:48:49.530623 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 27 02:48:49.530623 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Aug 27 02:48:49.530623 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 27 02:48:49.530623 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service f239d831-665a-4697-8149-48894f106108 could not be found. Aug 27 02:48:49.530623 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:48:49.530623 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:48:49.530623 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:48:49.530623 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:48:49.530623 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:48:49.530623 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:48:49.530623 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:48:49.530623 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:48:49.530623 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:48:49.530623 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:48:49.530623 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:48:49.530623 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:48:49.530623 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:48:49.530623 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:48:49.533910 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Aug 27 02:48:49.533910 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:48:49.533910 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service f239d831-665a-4697-8149-48894f106108 could not be found. Aug 27 02:48:49.533910 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:48:49.533910 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:48:49.533910 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:48:49.533910 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:48:49.533910 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:48:49.533910 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:48:49.533910 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:48:49.533910 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:48:49.533910 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service f239d831-665a-4697-8149-48894f106108 could not be found. Aug 27 02:48:49.533910 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:48:49.533910 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e938496b-5ed9-4652-9c61-3826b62dea67 tempest-ServicesAdminNegativeV253TestJSON-1317500285 tempest-ServicesAdminNegativeV253TestJSON-1317500285-project-admin] Returning 404 to user: Service f239d831-665a-4697-8149-48894f106108 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:48:49.534615 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7f113daa-5019-4f84-bf6b-0d32f6556576 tempest-SecurityGroupRulesTestJSON-1478250502 tempest-SecurityGroupRulesTestJSON-1478250502-project] Calling method '.version_select at 0x7f5ede97ddc0>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:49.534687 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e938496b-5ed9-4652-9c61-3826b62dea67 tempest-ServicesAdminNegativeV253TestJSON-1317500285 tempest-ServicesAdminNegativeV253TestJSON-1317500285-project-admin] 10.222.0.70 "PUT /compute/v2.1/os-services/f239d831-665a-4697-8149-48894f106108" status: 404 len: 110 microversion: 2.53 time: 0.076013 Aug 27 02:48:49.538338 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 970/1916] 10.222.0.70 () {62 vars in 1309 bytes} [Sat Aug 27 02:48:49 2022] PUT /compute/v2.1/os-services/f239d831-665a-4697-8149-48894f106108 => generated 110 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 02:48:49.552684 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-43acb93f-c4e3-4fb1-ab21-c240f94e952a tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:49.553299 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-43acb93f-c4e3-4fb1-ab21-c240f94e952a tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: 60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:49.579022 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-43acb93f-c4e3-4fb1-ab21-c240f94e952a tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:49.579519 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-43acb93f-c4e3-4fb1-ab21-c240f94e952a tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:49.579952 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-43acb93f-c4e3-4fb1-ab21-c240f94e952a tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:49.580690 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-43acb93f-c4e3-4fb1-ab21-c240f94e952a tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:49.581142 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-43acb93f-c4e3-4fb1-ab21-c240f94e952a tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:49.581557 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-43acb93f-c4e3-4fb1-ab21-c240f94e952a tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:49.603527 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-7f113daa-5019-4f84-bf6b-0d32f6556576 tempest-SecurityGroupRulesTestJSON-1478250502 tempest-SecurityGroupRulesTestJSON-1478250502-project] 10.222.0.70 "GET /compute/v2.1/os-security-groups/bd99327d-d9b2-45a5-aa99-692c3a4eb042" status: 200 len: 664 microversion: 2.1 time: 0.085004 Aug 27 02:48:49.604980 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 947/1917] 10.222.0.70 () {58 vars in 1269 bytes} [Sat Aug 27 02:48:49 2022] GET /compute/v2.1/os-security-groups/bd99327d-d9b2-45a5-aa99-692c3a4eb042 => generated 664 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:48:49.616439 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7f28281c-781d-4f23-8db9-bbeba2c378d2 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:49.617613 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-7f28281c-781d-4f23-8db9-bbeba2c378d2 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] [instance: e445cdc5-5ecb-487c-adee-f5cb9862283c] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:49.626803 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7f28281c-781d-4f23-8db9-bbeba2c378d2 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:49.627995 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7f28281c-781d-4f23-8db9-bbeba2c378d2 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:49.628894 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7f28281c-781d-4f23-8db9-bbeba2c378d2 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:49.629960 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7f28281c-781d-4f23-8db9-bbeba2c378d2 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:49.630658 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7f28281c-781d-4f23-8db9-bbeba2c378d2 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:49.631346 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7f28281c-781d-4f23-8db9-bbeba2c378d2 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:49.798638 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-7f28281c-781d-4f23-8db9-bbeba2c378d2 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66c0fc8492654e6e85a90ce04736c055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f9be56fbeb64cb08b9be4e3d7436782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:49.813924 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-7f28281c-781d-4f23-8db9-bbeba2c378d2 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] 10.222.0.70 "GET /compute/v2.1/servers/e445cdc5-5ecb-487c-adee-f5cb9862283c" status: 200 len: 1293 microversion: 2.1 time: 0.207510 Aug 27 02:48:49.814901 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 948/1918] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:49 2022] GET /compute/v2.1/servers/e445cdc5-5ecb-487c-adee-f5cb9862283c => generated 1293 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:49.821266 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8f7eabeb-2c48-48e9-b456-d5f1942a03be tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Calling method '.version_select at 0x7f5ede97ddc0>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:49.851222 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-8f7eabeb-2c48-48e9-b456-d5f1942a03be tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] HTTP exception thrown: Image not found. Aug 27 02:48:49.854077 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8f7eabeb-2c48-48e9-b456-d5f1942a03be tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Request method failure captured: Aug 27 02:48:49.854077 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/images/0ae12db3-6535-4c53-9cf0-6bb5faaa4513 HTTP/1.1 Aug 27 02:48:49.854077 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:48:49.854077 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:48:49.854077 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:48:49.854077 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:48:49.854077 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:48:49.854077 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:48:49.854077 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:48:49.854077 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:48:49.854077 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYXZs-aTjsu4dY2E35LFceONR468LXHet3JtaDk1jSLn7rlxv4ubACwdgzqFGJNx7r3z2yEOrBfDvKz6anHMyAL6AxveCSa11c6B73g-MhO_wzr9ufRmG_ezWmVTPygmsfGqmZp4-Uwb1Qw0Hv-s1as83SFwjue3xIbxxPf-vwgjzhI Aug 27 02:48:49.854077 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:48:49.854077 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:48:49.854077 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:48:49.854077 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:48:49.854077 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:48:49.854077 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:48:49.854077 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 96abd4aa8efa4761869dabdd1f143519 Aug 27 02:48:49.854077 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ImagesOneServerTestJSON-1611362133 Aug 27 02:48:49.854077 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:48:49.854077 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:48:49.854077 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/96abd4aa8efa4761869dabdd1f143519"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_96abd4aa8efa4761869dabdd1f143519", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/96abd4aa8efa4761869dabdd1f143519"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/96abd4aa8efa4761869dabdd1f143519"}]}] Aug 27 02:48:49.854077 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ImagesOneServerTestJSON-1611362133 Aug 27 02:48:49.854077 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 96abd4aa8efa4761869dabdd1f143519 Aug 27 02:48:49.854077 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1611362133 Aug 27 02:48:49.854077 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ImagesOneServerTestJSON-1611362133-project Aug 27 02:48:49.854077 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:48:49.854077 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:48:49.854077 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 073966022576475b983af066d7edb099 Aug 27 02:48:49.854077 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ImagesOneServerTestJSON-1611362133-project Aug 27 02:48:49.854077 n-d-852278-4 devstack@n-api.service[134051]: method: Aug 27 02:48:49.854077 n-d-852278-4 devstack@n-api.service[134051]: exception: Image not found. Aug 27 02:48:49.854077 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '0ae12db3-6535-4c53-9cf0-6bb5faaa4513'} Aug 27 02:48:49.854077 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:48:49.854077 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:48:49.854077 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 02:48:49.854077 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 02:48:49.854077 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 02:48:49.854077 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 02:48:49.854077 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 02:48:49.854077 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 02:48:49.854077 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 02:48:49.854077 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 02:48:49.854077 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 02:48:49.854077 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 02:48:49.854077 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 02:48:49.854077 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 02:48:49.854077 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 02:48:49.854077 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 02:48:49.854077 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 02:48:49.854077 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 02:48:49.854077 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 0ae12db3-6535-4c53-9cf0-6bb5faaa4513 Aug 27 02:48:49.854077 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:48:49.854077 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:48:49.854077 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:48:49.854077 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:48:49.854077 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 27 02:48:49.854077 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 27 02:48:49.854077 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 27 02:48:49.854077 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 27 02:48:49.854077 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 27 02:48:49.854077 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 27 02:48:49.854077 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 27 02:48:49.858059 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 27 02:48:49.858059 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 02:48:49.858059 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 02:48:49.858059 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 02:48:49.858059 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 02:48:49.858059 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 02:48:49.858059 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 02:48:49.858059 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 02:48:49.858059 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 02:48:49.858059 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 02:48:49.858059 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 02:48:49.858059 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 02:48:49.858059 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 02:48:49.858059 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 02:48:49.858059 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 02:48:49.858059 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 02:48:49.858059 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 02:48:49.858059 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 0ae12db3-6535-4c53-9cf0-6bb5faaa4513 could not be found. Aug 27 02:48:49.858059 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:48:49.858059 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:48:49.858059 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:48:49.858059 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:48:49.858059 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:48:49.858059 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:48:49.858059 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:48:49.858059 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:48:49.858059 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:48:49.858059 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:48:49.858059 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:48:49.858059 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:48:49.858059 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 27 02:48:49.858059 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 27 02:48:49.858059 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 02:48:49.858059 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:48:49.858059 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:48:49.858059 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:48:49.858059 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:48:49.858059 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:48:49.858059 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:48:49.858059 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:48:49.858059 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:48:49.858059 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 02:48:49.858059 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:48:49.858059 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8f7eabeb-2c48-48e9-b456-d5f1942a03be tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Returning 404 to user: Image not found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:48:49.858059 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-8f7eabeb-2c48-48e9-b456-d5f1942a03be tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] 10.222.0.70 "GET /compute/v2.1/images/0ae12db3-6535-4c53-9cf0-6bb5faaa4513" status: 404 len: 62 microversion: 2.1 time: 0.039588 Aug 27 02:48:49.858059 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 949/1919] 10.222.0.70 () {58 vars in 1233 bytes} [Sat Aug 27 02:48:49 2022] GET /compute/v2.1/images/0ae12db3-6535-4c53-9cf0-6bb5faaa4513 => generated 62 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 02:48:49.867366 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a5966a45-78ac-4719-a342-b9f760bf68b1 tempest-ServicesAdminNegativeV253TestJSON-1317500285 tempest-ServicesAdminNegativeV253TestJSON-1317500285-project-admin] Action: 'update', calling method: .version_select at 0x7f5ede97d1f0>, body: {"status": "enabled"} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:48:49.872015 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a5966a45-78ac-4719-a342-b9f760bf68b1 tempest-ServicesAdminNegativeV253TestJSON-1317500285 tempest-ServicesAdminNegativeV253TestJSON-1317500285-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:49.872583 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a5966a45-78ac-4719-a342-b9f760bf68b1 tempest-ServicesAdminNegativeV253TestJSON-1317500285 tempest-ServicesAdminNegativeV253TestJSON-1317500285-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:49.873601 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a5966a45-78ac-4719-a342-b9f760bf68b1 tempest-ServicesAdminNegativeV253TestJSON-1317500285 tempest-ServicesAdminNegativeV253TestJSON-1317500285-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:49.884569 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a5966a45-78ac-4719-a342-b9f760bf68b1 tempest-ServicesAdminNegativeV253TestJSON-1317500285 tempest-ServicesAdminNegativeV253TestJSON-1317500285-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:49.885097 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a5966a45-78ac-4719-a342-b9f760bf68b1 tempest-ServicesAdminNegativeV253TestJSON-1317500285 tempest-ServicesAdminNegativeV253TestJSON-1317500285-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:49.885721 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a5966a45-78ac-4719-a342-b9f760bf68b1 tempest-ServicesAdminNegativeV253TestJSON-1317500285 tempest-ServicesAdminNegativeV253TestJSON-1317500285-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:49.907045 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-a5966a45-78ac-4719-a342-b9f760bf68b1 tempest-ServicesAdminNegativeV253TestJSON-1317500285 tempest-ServicesAdminNegativeV253TestJSON-1317500285-project-admin] HTTP exception thrown: Service f239d831-665a-4697-8149-48894f106108 could not be found. Aug 27 02:48:49.912078 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a5966a45-78ac-4719-a342-b9f760bf68b1 tempest-ServicesAdminNegativeV253TestJSON-1317500285 tempest-ServicesAdminNegativeV253TestJSON-1317500285-project-admin] Request method failure captured: Aug 27 02:48:49.912078 n-d-852278-4 devstack@n-api.service[134051]: request: PUT /compute/v2.1/os-services/f239d831-665a-4697-8149-48894f106108 HTTP/1.1 Aug 27 02:48:49.912078 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:48:49.912078 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:48:49.912078 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:48:49.912078 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 21 Aug 27 02:48:49.912078 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:48:49.912078 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:48:49.912078 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:48:49.912078 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:48:49.912078 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYYOF3KcOmPOAFgNblBLa0MOTc-weXJ5-CFPUk9gFv35oiwNhisAHpQQ-l_ZHqcawmeM3tdAWUEJC_OzhdAyFK6W6pHs2Ui64Q0i9T5_AptlhDp4ApZNzLdKcKNBCVR3yrbvVewzEBuQmlQ4dbEQP-HGWsz3TK7jylIZ76_NkvrNcDc Aug 27 02:48:49.912078 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:48:49.912078 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:48:49.912078 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:48:49.912078 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:48:49.912078 n-d-852278-4 devstack@n-api.service[134051]: X-Openstack-Nova-Api-Version: 2.53 Aug 27 02:48:49.912078 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:48:49.912078 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:48:49.912078 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: d9bd67f075a341008938124b8c5e8aa9 Aug 27 02:48:49.912078 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1317500285 Aug 27 02:48:49.912078 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,admin,member Aug 27 02:48:49.912078 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,admin,member Aug 27 02:48:49.912078 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d9bd67f075a341008938124b8c5e8aa9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d9bd67f075a341008938124b8c5e8aa9", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d9bd67f075a341008938124b8c5e8aa9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d9bd67f075a341008938124b8c5e8aa9"}]}] Aug 27 02:48:49.912078 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1317500285 Aug 27 02:48:49.912078 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: d9bd67f075a341008938124b8c5e8aa9 Aug 27 02:48:49.912078 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1317500285 Aug 27 02:48:49.912078 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1317500285-project-admin Aug 27 02:48:49.912078 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:48:49.912078 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:48:49.912078 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 343b105dff08491c9ac24a00b13946a4 Aug 27 02:48:49.912078 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1317500285-project-admin Aug 27 02:48:49.912078 n-d-852278-4 devstack@n-api.service[134051]: Aug 27 02:48:49.912078 n-d-852278-4 devstack@n-api.service[134051]: {"status": "enabled"} Aug 27 02:48:49.912078 n-d-852278-4 devstack@n-api.service[134051]: method: Aug 27 02:48:49.912078 n-d-852278-4 devstack@n-api.service[134051]: exception: Service f239d831-665a-4697-8149-48894f106108 could not be found. Aug 27 02:48:49.912078 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': 'f239d831-665a-4697-8149-48894f106108', 'body': {'status': 'enabled'}} Aug 27 02:48:49.912078 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:48:49.912078 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:48:49.912078 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6205, in service_get_by_id Aug 27 02:48:49.912078 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 27 02:48:49.912078 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6065, in _find_service_in_cell Aug 27 02:48:49.912078 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 27 02:48:49.912078 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 27 02:48:49.912078 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:48:49.912078 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:48:49.912078 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:48:49.912078 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:48:49.912078 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Aug 27 02:48:49.912078 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 27 02:48:49.912078 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Aug 27 02:48:49.912078 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 27 02:48:49.912078 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service f239d831-665a-4697-8149-48894f106108 could not be found. Aug 27 02:48:49.912078 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:48:49.912078 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:48:49.912078 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:48:49.912078 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:48:49.912078 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:48:49.912078 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:48:49.912078 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:48:49.912078 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:48:49.912078 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:48:49.912078 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:48:49.912078 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:48:49.912078 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:48:49.912078 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:48:49.912078 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:48:49.916211 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Aug 27 02:48:49.916211 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:48:49.916211 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service f239d831-665a-4697-8149-48894f106108 could not be found. Aug 27 02:48:49.916211 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:48:49.916211 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:48:49.916211 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:48:49.916211 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:48:49.916211 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:48:49.916211 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:48:49.916211 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:48:49.916211 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:48:49.916211 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service f239d831-665a-4697-8149-48894f106108 could not be found. Aug 27 02:48:49.916211 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:48:49.916211 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a5966a45-78ac-4719-a342-b9f760bf68b1 tempest-ServicesAdminNegativeV253TestJSON-1317500285 tempest-ServicesAdminNegativeV253TestJSON-1317500285-project-admin] Returning 404 to user: Service f239d831-665a-4697-8149-48894f106108 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:48:49.926999 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a5966a45-78ac-4719-a342-b9f760bf68b1 tempest-ServicesAdminNegativeV253TestJSON-1317500285 tempest-ServicesAdminNegativeV253TestJSON-1317500285-project-admin] 10.222.0.70 "PUT /compute/v2.1/os-services/f239d831-665a-4697-8149-48894f106108" status: 404 len: 110 microversion: 2.53 time: 0.059761 Aug 27 02:48:49.928998 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 950/1920] 10.222.0.70 () {62 vars in 1309 bytes} [Sat Aug 27 02:48:49 2022] PUT /compute/v2.1/os-services/f239d831-665a-4697-8149-48894f106108 => generated 110 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 02:48:49.938321 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-989091fa-5838-41d4-98ee-49e31c778b71 tempest-SecurityGroupRulesTestJSON-1478250502 tempest-SecurityGroupRulesTestJSON-1478250502-project] Calling method '.version_select at 0x7f5ee72023a0>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:50.060262 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-43acb93f-c4e3-4fb1-ab21-c240f94e952a tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:50.072606 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-43acb93f-c4e3-4fb1-ab21-c240f94e952a tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4" status: 200 len: 1476 microversion: 2.1 time: 0.533024 Aug 27 02:48:50.073568 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 971/1921] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:49 2022] GET /compute/v2.1/servers/60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4 => generated 1476 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:50.078627 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-027e52fb-7214-4880-ba79-1498db57d8e6 req-3819f1b9-1231-48b1-b720-899aa05ab2a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b88e24d-509c-49fe-b5e2-b2698620d6d6", "name": "network-vif-unplugged", "status": "completed", "tag": "8e5488cf-e7f9-42ad-b395-21ba7264782d"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:48:50.093180 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-027e52fb-7214-4880-ba79-1498db57d8e6 req-3819f1b9-1231-48b1-b720-899aa05ab2a1 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:50.094094 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-027e52fb-7214-4880-ba79-1498db57d8e6 req-3819f1b9-1231-48b1-b720-899aa05ab2a1 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:50.094755 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-027e52fb-7214-4880-ba79-1498db57d8e6 req-3819f1b9-1231-48b1-b720-899aa05ab2a1 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:50.123319 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-027e52fb-7214-4880-ba79-1498db57d8e6 req-3819f1b9-1231-48b1-b720-899aa05ab2a1 service nova] Creating event network-vif-unplugged:8e5488cf-e7f9-42ad-b395-21ba7264782d for instance 4b88e24d-509c-49fe-b5e2-b2698620d6d6 on n-h1-852278-4 Aug 27 02:48:50.129652 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-027e52fb-7214-4880-ba79-1498db57d8e6 req-3819f1b9-1231-48b1-b720-899aa05ab2a1 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054626 Aug 27 02:48:50.130917 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 972/1922] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:48:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:48:50.137660 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c1267ce1-04f8-415a-8d5b-9cbdae501502 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-148714092"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:48:50.141536 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-c1267ce1-04f8-415a-8d5b-9cbdae501502 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] [instance: 4b88e24d-509c-49fe-b5e2-b2698620d6d6] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:50.151009 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c1267ce1-04f8-415a-8d5b-9cbdae501502 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:50.152052 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c1267ce1-04f8-415a-8d5b-9cbdae501502 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:50.152759 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c1267ce1-04f8-415a-8d5b-9cbdae501502 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:50.153769 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c1267ce1-04f8-415a-8d5b-9cbdae501502 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:50.154888 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c1267ce1-04f8-415a-8d5b-9cbdae501502 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:50.155522 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c1267ce1-04f8-415a-8d5b-9cbdae501502 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:50.333773 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-989091fa-5838-41d4-98ee-49e31c778b71 tempest-SecurityGroupRulesTestJSON-1478250502 tempest-SecurityGroupRulesTestJSON-1478250502-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-group-rules/7c47f0ea-a5f8-463c-a1bc-04a25434f3b4" status: 202 len: 0 microversion: 2.1 time: 0.403386 Aug 27 02:48:50.334359 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 951/1923] 10.222.0.70 () {58 vars in 1287 bytes} [Sat Aug 27 02:48:49 2022] DELETE /compute/v2.1/os-security-group-rules/7c47f0ea-a5f8-463c-a1bc-04a25434f3b4 => generated 0 bytes in 405 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:48:50.342112 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-59a28121-f206-4c44-8b21-f7079b350398 tempest-ServicesAdminNegativeV253TestJSON-1317500285 tempest-ServicesAdminNegativeV253TestJSON-1317500285-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:50.345834 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-59a28121-f206-4c44-8b21-f7079b350398 tempest-ServicesAdminNegativeV253TestJSON-1317500285 tempest-ServicesAdminNegativeV253TestJSON-1317500285-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:50.347074 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-59a28121-f206-4c44-8b21-f7079b350398 tempest-ServicesAdminNegativeV253TestJSON-1317500285 tempest-ServicesAdminNegativeV253TestJSON-1317500285-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:50.347515 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-59a28121-f206-4c44-8b21-f7079b350398 tempest-ServicesAdminNegativeV253TestJSON-1317500285 tempest-ServicesAdminNegativeV253TestJSON-1317500285-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:50.351541 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-59a28121-f206-4c44-8b21-f7079b350398 tempest-ServicesAdminNegativeV253TestJSON-1317500285 tempest-ServicesAdminNegativeV253TestJSON-1317500285-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:50.352008 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-59a28121-f206-4c44-8b21-f7079b350398 tempest-ServicesAdminNegativeV253TestJSON-1317500285 tempest-ServicesAdminNegativeV253TestJSON-1317500285-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:50.355400 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-59a28121-f206-4c44-8b21-f7079b350398 tempest-ServicesAdminNegativeV253TestJSON-1317500285 tempest-ServicesAdminNegativeV253TestJSON-1317500285-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:50.399110 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-59a28121-f206-4c44-8b21-f7079b350398 tempest-ServicesAdminNegativeV253TestJSON-1317500285 tempest-ServicesAdminNegativeV253TestJSON-1317500285-project-admin] 10.222.0.70 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.063372 Aug 27 02:48:50.413691 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 952/1924] 10.222.0.70 () {60 vars in 1178 bytes} [Sat Aug 27 02:48:50 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:48:50.423158 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c1267ce1-04f8-415a-8d5b-9cbdae501502 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] 10.222.0.70 "POST /compute/v2.1/servers/4b88e24d-509c-49fe-b5e2-b2698620d6d6/action" status: 202 len: 0 microversion: 2.1 time: 0.286326 Aug 27 02:48:50.429106 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 973/1925] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 02:48:50 2022] POST /compute/v2.1/servers/4b88e24d-509c-49fe-b5e2-b2698620d6d6/action => generated 0 bytes in 292 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 27 02:48:50.429258 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-6b45cc4b-182a-4d0b-962a-dbb4635dbd54 tempest-SecurityGroupRulesTestJSON-1478250502 tempest-SecurityGroupRulesTestJSON-1478250502-project] Calling method '.version_select at 0x7f5ee72163a0>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:50.438962 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3e9a0d2d-8a88-4137-a688-f045c6de6280 tempest-ServicesAdminNegativeV253TestJSON-1317500285 tempest-ServicesAdminNegativeV253TestJSON-1317500285-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:50.459751 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3e9a0d2d-8a88-4137-a688-f045c6de6280 tempest-ServicesAdminNegativeV253TestJSON-1317500285 tempest-ServicesAdminNegativeV253TestJSON-1317500285-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:50.460399 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3e9a0d2d-8a88-4137-a688-f045c6de6280 tempest-ServicesAdminNegativeV253TestJSON-1317500285 tempest-ServicesAdminNegativeV253TestJSON-1317500285-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:50.460634 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3e9a0d2d-8a88-4137-a688-f045c6de6280 tempest-ServicesAdminNegativeV253TestJSON-1317500285 tempest-ServicesAdminNegativeV253TestJSON-1317500285-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:50.461400 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3e9a0d2d-8a88-4137-a688-f045c6de6280 tempest-ServicesAdminNegativeV253TestJSON-1317500285 tempest-ServicesAdminNegativeV253TestJSON-1317500285-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:50.461847 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3e9a0d2d-8a88-4137-a688-f045c6de6280 tempest-ServicesAdminNegativeV253TestJSON-1317500285 tempest-ServicesAdminNegativeV253TestJSON-1317500285-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:50.462326 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3e9a0d2d-8a88-4137-a688-f045c6de6280 tempest-ServicesAdminNegativeV253TestJSON-1317500285 tempest-ServicesAdminNegativeV253TestJSON-1317500285-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:50.501694 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-3e9a0d2d-8a88-4137-a688-f045c6de6280 tempest-ServicesAdminNegativeV253TestJSON-1317500285 tempest-ServicesAdminNegativeV253TestJSON-1317500285-project-admin] 10.222.0.70 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.076376 Aug 27 02:48:50.502341 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 974/1926] 10.222.0.70 () {60 vars in 1211 bytes} [Sat Aug 27 02:48:50 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1239 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:48:50.514985 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e2e42b7b-7c9b-462a-86ec-09b40ef2474d tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Calling method '.version_select at 0x7f5ee724f4c0>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:50.585985 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e2e42b7b-7c9b-462a-86ec-09b40ef2474d tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] 10.222.0.70 "GET /compute/v2.1/images/90bf1cec-6c76-499b-b5d3-56e7eebb189a" status: 200 len: 1428 microversion: 2.1 time: 0.075393 Aug 27 02:48:50.586893 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 975/1927] 10.222.0.70 () {58 vars in 1233 bytes} [Sat Aug 27 02:48:50 2022] GET /compute/v2.1/images/90bf1cec-6c76-499b-b5d3-56e7eebb189a => generated 1428 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:50.593884 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-fd6e9495-860b-4fa9-948c-421660db0360 tempest-ServicesAdminNegativeV253TestJSON-1317500285 tempest-ServicesAdminNegativeV253TestJSON-1317500285-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:50.597694 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fd6e9495-860b-4fa9-948c-421660db0360 tempest-ServicesAdminNegativeV253TestJSON-1317500285 tempest-ServicesAdminNegativeV253TestJSON-1317500285-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:50.598397 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fd6e9495-860b-4fa9-948c-421660db0360 tempest-ServicesAdminNegativeV253TestJSON-1317500285 tempest-ServicesAdminNegativeV253TestJSON-1317500285-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:50.599003 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fd6e9495-860b-4fa9-948c-421660db0360 tempest-ServicesAdminNegativeV253TestJSON-1317500285 tempest-ServicesAdminNegativeV253TestJSON-1317500285-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:50.599891 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fd6e9495-860b-4fa9-948c-421660db0360 tempest-ServicesAdminNegativeV253TestJSON-1317500285 tempest-ServicesAdminNegativeV253TestJSON-1317500285-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:50.600553 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fd6e9495-860b-4fa9-948c-421660db0360 tempest-ServicesAdminNegativeV253TestJSON-1317500285 tempest-ServicesAdminNegativeV253TestJSON-1317500285-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:50.601133 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fd6e9495-860b-4fa9-948c-421660db0360 tempest-ServicesAdminNegativeV253TestJSON-1317500285 tempest-ServicesAdminNegativeV253TestJSON-1317500285-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:50.630317 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-fd6e9495-860b-4fa9-948c-421660db0360 tempest-ServicesAdminNegativeV253TestJSON-1317500285 tempest-ServicesAdminNegativeV253TestJSON-1317500285-project-admin] 10.222.0.70 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.042281 Aug 27 02:48:50.631216 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 976/1928] 10.222.0.70 () {60 vars in 1178 bytes} [Sat Aug 27 02:48:50 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:48:50.642492 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8521a49f-2d52-4a8c-ac33-16794a1a5ea5 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Calling method '.version_select at 0x7f5ee7214ca0>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:50.719550 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-8521a49f-2d52-4a8c-ac33-16794a1a5ea5 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] 10.222.0.70 "GET /compute/v2.1/images/38bfc7f4-fb52-4d97-a6b8-cd768f249fb5" status: 200 len: 1463 microversion: 2.1 time: 0.086893 Aug 27 02:48:50.729091 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 977/1929] 10.222.0.70 () {58 vars in 1233 bytes} [Sat Aug 27 02:48:50 2022] GET /compute/v2.1/images/38bfc7f4-fb52-4d97-a6b8-cd768f249fb5 => generated 1463 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:50.734048 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-41ae6c80-e49c-462c-84c4-6b5fe27bf7e5 tempest-ServicesAdminNegativeV253TestJSON-1317500285 tempest-ServicesAdminNegativeV253TestJSON-1317500285-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:50.739131 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-41ae6c80-e49c-462c-84c4-6b5fe27bf7e5 tempest-ServicesAdminNegativeV253TestJSON-1317500285 tempest-ServicesAdminNegativeV253TestJSON-1317500285-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:50.739817 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-41ae6c80-e49c-462c-84c4-6b5fe27bf7e5 tempest-ServicesAdminNegativeV253TestJSON-1317500285 tempest-ServicesAdminNegativeV253TestJSON-1317500285-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:50.740466 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-41ae6c80-e49c-462c-84c4-6b5fe27bf7e5 tempest-ServicesAdminNegativeV253TestJSON-1317500285 tempest-ServicesAdminNegativeV253TestJSON-1317500285-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:50.742159 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-41ae6c80-e49c-462c-84c4-6b5fe27bf7e5 tempest-ServicesAdminNegativeV253TestJSON-1317500285 tempest-ServicesAdminNegativeV253TestJSON-1317500285-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:50.742703 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-41ae6c80-e49c-462c-84c4-6b5fe27bf7e5 tempest-ServicesAdminNegativeV253TestJSON-1317500285 tempest-ServicesAdminNegativeV253TestJSON-1317500285-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:50.743148 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-41ae6c80-e49c-462c-84c4-6b5fe27bf7e5 tempest-ServicesAdminNegativeV253TestJSON-1317500285 tempest-ServicesAdminNegativeV253TestJSON-1317500285-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:50.768871 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-41ae6c80-e49c-462c-84c4-6b5fe27bf7e5 tempest-ServicesAdminNegativeV253TestJSON-1317500285 tempest-ServicesAdminNegativeV253TestJSON-1317500285-project-admin] 10.222.0.70 "GET /compute/v2.1/os-services?host=n-d-852278-4&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.038476 Aug 27 02:48:50.769775 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 978/1930] 10.222.0.70 () {60 vars in 1235 bytes} [Sat Aug 27 02:48:50 2022] GET /compute/v2.1/os-services?host=n-d-852278-4&binary=xxx => generated 16 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:50.781113 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-7a0d2cf1-ef0c-4abc-a4e6-3abb7c1154ad tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Calling method '.version_select at 0x7f5ee7219430>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:50.838841 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-7a0d2cf1-ef0c-4abc-a4e6-3abb7c1154ad tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] 10.222.0.70 "GET /compute/v2.1/images/38bfc7f4-fb52-4d97-a6b8-cd768f249fb5" status: 200 len: 1463 microversion: 2.1 time: 0.067738 Aug 27 02:48:50.839450 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 979/1931] 10.222.0.70 () {58 vars in 1233 bytes} [Sat Aug 27 02:48:50 2022] GET /compute/v2.1/images/38bfc7f4-fb52-4d97-a6b8-cd768f249fb5 => generated 1463 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:50.852743 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ad266320-504a-4ea4-9743-23b31b77764b tempest-ServicesAdminNegativeV253TestJSON-1317500285 tempest-ServicesAdminNegativeV253TestJSON-1317500285-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:50.856237 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ad266320-504a-4ea4-9743-23b31b77764b tempest-ServicesAdminNegativeV253TestJSON-1317500285 tempest-ServicesAdminNegativeV253TestJSON-1317500285-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:50.857496 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ad266320-504a-4ea4-9743-23b31b77764b tempest-ServicesAdminNegativeV253TestJSON-1317500285 tempest-ServicesAdminNegativeV253TestJSON-1317500285-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:50.858214 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ad266320-504a-4ea4-9743-23b31b77764b tempest-ServicesAdminNegativeV253TestJSON-1317500285 tempest-ServicesAdminNegativeV253TestJSON-1317500285-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:50.859448 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ad266320-504a-4ea4-9743-23b31b77764b tempest-ServicesAdminNegativeV253TestJSON-1317500285 tempest-ServicesAdminNegativeV253TestJSON-1317500285-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:50.859897 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ad266320-504a-4ea4-9743-23b31b77764b tempest-ServicesAdminNegativeV253TestJSON-1317500285 tempest-ServicesAdminNegativeV253TestJSON-1317500285-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:50.860794 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ad266320-504a-4ea4-9743-23b31b77764b tempest-ServicesAdminNegativeV253TestJSON-1317500285 tempest-ServicesAdminNegativeV253TestJSON-1317500285-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:50.887509 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ad266320-504a-4ea4-9743-23b31b77764b tempest-ServicesAdminNegativeV253TestJSON-1317500285 tempest-ServicesAdminNegativeV253TestJSON-1317500285-project-admin] 10.222.0.70 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.037901 Aug 27 02:48:50.894905 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 980/1932] 10.222.0.70 () {60 vars in 1178 bytes} [Sat Aug 27 02:48:50 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:48:50.899881 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f583c4b1-8c7b-454d-90a1-3ac67e53fbad tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:50.900695 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-f583c4b1-8c7b-454d-90a1-3ac67e53fbad tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] [instance: e445cdc5-5ecb-487c-adee-f5cb9862283c] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:50.907066 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f583c4b1-8c7b-454d-90a1-3ac67e53fbad tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:50.907551 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f583c4b1-8c7b-454d-90a1-3ac67e53fbad tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:50.908028 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f583c4b1-8c7b-454d-90a1-3ac67e53fbad tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:50.908827 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f583c4b1-8c7b-454d-90a1-3ac67e53fbad tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:50.909265 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f583c4b1-8c7b-454d-90a1-3ac67e53fbad tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:50.910249 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f583c4b1-8c7b-454d-90a1-3ac67e53fbad tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:51.242733 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-6b45cc4b-182a-4d0b-962a-dbb4635dbd54 tempest-SecurityGroupRulesTestJSON-1478250502 tempest-SecurityGroupRulesTestJSON-1478250502-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/bd99327d-d9b2-45a5-aa99-692c3a4eb042" status: 202 len: 0 microversion: 2.1 time: 0.826631 Aug 27 02:48:51.243795 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 953/1933] 10.222.0.70 () {58 vars in 1272 bytes} [Sat Aug 27 02:48:50 2022] DELETE /compute/v2.1/os-security-groups/bd99327d-d9b2-45a5-aa99-692c3a4eb042 => generated 0 bytes in 829 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:48:51.250998 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8653b2e4-a18a-4876-8bcf-32ff51167444 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:51.251713 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-8653b2e4-a18a-4876-8bcf-32ff51167444 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] [instance: 9d7f8c37-c4a6-400e-9a02-94f9040b780e] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:51.258890 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8653b2e4-a18a-4876-8bcf-32ff51167444 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:51.259468 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8653b2e4-a18a-4876-8bcf-32ff51167444 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:51.260131 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8653b2e4-a18a-4876-8bcf-32ff51167444 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:51.261063 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8653b2e4-a18a-4876-8bcf-32ff51167444 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:51.261600 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8653b2e4-a18a-4876-8bcf-32ff51167444 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:51.262246 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8653b2e4-a18a-4876-8bcf-32ff51167444 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:51.332420 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-f583c4b1-8c7b-454d-90a1-3ac67e53fbad tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66c0fc8492654e6e85a90ce04736c055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f9be56fbeb64cb08b9be4e3d7436782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:51.344203 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f583c4b1-8c7b-454d-90a1-3ac67e53fbad tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] 10.222.0.70 "GET /compute/v2.1/servers/e445cdc5-5ecb-487c-adee-f5cb9862283c" status: 200 len: 1323 microversion: 2.1 time: 0.448067 Aug 27 02:48:51.345421 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 981/1934] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:50 2022] GET /compute/v2.1/servers/e445cdc5-5ecb-487c-adee-f5cb9862283c => generated 1323 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:51.356697 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b0b0b31e-fac6-4abc-a981-f50f8e29df88 tempest-ServicesAdminNegativeV253TestJSON-1317500285 tempest-ServicesAdminNegativeV253TestJSON-1317500285-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:51.365262 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b0b0b31e-fac6-4abc-a981-f50f8e29df88 tempest-ServicesAdminNegativeV253TestJSON-1317500285 tempest-ServicesAdminNegativeV253TestJSON-1317500285-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:51.366166 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b0b0b31e-fac6-4abc-a981-f50f8e29df88 tempest-ServicesAdminNegativeV253TestJSON-1317500285 tempest-ServicesAdminNegativeV253TestJSON-1317500285-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:51.366802 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b0b0b31e-fac6-4abc-a981-f50f8e29df88 tempest-ServicesAdminNegativeV253TestJSON-1317500285 tempest-ServicesAdminNegativeV253TestJSON-1317500285-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:51.376085 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b0b0b31e-fac6-4abc-a981-f50f8e29df88 tempest-ServicesAdminNegativeV253TestJSON-1317500285 tempest-ServicesAdminNegativeV253TestJSON-1317500285-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:51.376633 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b0b0b31e-fac6-4abc-a981-f50f8e29df88 tempest-ServicesAdminNegativeV253TestJSON-1317500285 tempest-ServicesAdminNegativeV253TestJSON-1317500285-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:51.377069 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b0b0b31e-fac6-4abc-a981-f50f8e29df88 tempest-ServicesAdminNegativeV253TestJSON-1317500285 tempest-ServicesAdminNegativeV253TestJSON-1317500285-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:51.405687 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b0b0b31e-fac6-4abc-a981-f50f8e29df88 tempest-ServicesAdminNegativeV253TestJSON-1317500285 tempest-ServicesAdminNegativeV253TestJSON-1317500285-project-admin] 10.222.0.70 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.057665 Aug 27 02:48:51.406602 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 982/1935] 10.222.0.70 () {60 vars in 1239 bytes} [Sat Aug 27 02:48:51 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:51.419137 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-df056811-e179-424c-872c-029de4b24c5c tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:51.419759 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-df056811-e179-424c-872c-029de4b24c5c tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: 60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:51.426953 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-df056811-e179-424c-872c-029de4b24c5c tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:51.427433 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-df056811-e179-424c-872c-029de4b24c5c tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:51.427860 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-df056811-e179-424c-872c-029de4b24c5c tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:51.428613 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-df056811-e179-424c-872c-029de4b24c5c tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:51.429221 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-df056811-e179-424c-872c-029de4b24c5c tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:51.429781 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-df056811-e179-424c-872c-029de4b24c5c tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:51.664282 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-8653b2e4-a18a-4876-8bcf-32ff51167444 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d626281a9864fe7aed598d4be209137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ae1f9ee6b7e49849b68b3628b76766a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:51.672549 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-8653b2e4-a18a-4876-8bcf-32ff51167444 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] 10.222.0.70 "GET /compute/v2.1/servers/9d7f8c37-c4a6-400e-9a02-94f9040b780e" status: 200 len: 1467 microversion: 2.1 time: 0.427352 Aug 27 02:48:51.673123 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 954/1936] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:51 2022] GET /compute/v2.1/servers/9d7f8c37-c4a6-400e-9a02-94f9040b780e => generated 1467 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:51.692739 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-2a15c8ed-7879-451e-b2d2-b2d7039d6b7e tempest-SecurityGroupRulesTestJSON-1478250502 tempest-SecurityGroupRulesTestJSON-1478250502-project] Calling method '.version_select at 0x7f5ee7216af0>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:52.084343 n-d-852278-4 devstack@n-api.service[134051]: DEBUG neutronclient.v2_0.client [None req-2a15c8ed-7879-451e-b2d2-b2d7039d6b7e tempest-SecurityGroupRulesTestJSON-1478250502 tempest-SecurityGroupRulesTestJSON-1478250502-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c9de0ffa-aa9c-4952-b12b-f09123556fb9 does not exist", "detail": ""}} {{(pid=134051) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 02:48:52.084950 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.network.security_group_api [None req-2a15c8ed-7879-451e-b2d2-b2d7039d6b7e tempest-SecurityGroupRulesTestJSON-1478250502 tempest-SecurityGroupRulesTestJSON-1478250502-project] Neutron security group c9de0ffa-aa9c-4952-b12b-f09123556fb9 not found {{(pid=134051) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 27 02:48:52.085511 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-2a15c8ed-7879-451e-b2d2-b2d7039d6b7e tempest-SecurityGroupRulesTestJSON-1478250502 tempest-SecurityGroupRulesTestJSON-1478250502-project] HTTP exception thrown: Security group c9de0ffa-aa9c-4952-b12b-f09123556fb9 does not exist Aug 27 02:48:52.085511 n-d-852278-4 devstack@n-api.service[134051]: Neutron server returns request_ids: ['req-7752c2e8-8653-4d1e-a31f-9ac4fdf87e62'] Aug 27 02:48:52.087555 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-2a15c8ed-7879-451e-b2d2-b2d7039d6b7e tempest-SecurityGroupRulesTestJSON-1478250502 tempest-SecurityGroupRulesTestJSON-1478250502-project] Request method failure captured: Aug 27 02:48:52.087555 n-d-852278-4 devstack@n-api.service[134051]: request: DELETE /compute/v2.1/os-security-groups/c9de0ffa-aa9c-4952-b12b-f09123556fb9 HTTP/1.1 Aug 27 02:48:52.087555 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:48:52.087555 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:48:52.087555 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:48:52.087555 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:48:52.087555 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:48:52.087555 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:48:52.087555 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:48:52.087555 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:48:52.087555 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYX29cPK63MsJFxqJW5C96eJxkeHM_BcrulGzN7ysbMjvleDoQF1Xsd2iu9gqOYkS44CUnJ3PDEGBPUYkIgGqjeZGgtmY7AVmo3otmUPtxkqgYqNIy47gdOt6_-YlxDAntbwhio60IZWkyJ4iZq0O2pmNM1HJjTXeSYi5LpKuO0fMws Aug 27 02:48:52.087555 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:48:52.087555 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:48:52.087555 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:48:52.087555 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:48:52.087555 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:48:52.087555 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:48:52.087555 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: d114201f354e44e1bfebddfe345cf500 Aug 27 02:48:52.087555 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-1478250502 Aug 27 02:48:52.087555 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:48:52.087555 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:48:52.087555 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d114201f354e44e1bfebddfe345cf500"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d114201f354e44e1bfebddfe345cf500", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d114201f354e44e1bfebddfe345cf500"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d114201f354e44e1bfebddfe345cf500"}]}] Aug 27 02:48:52.087555 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-SecurityGroupRulesTestJSON-1478250502 Aug 27 02:48:52.087555 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: d114201f354e44e1bfebddfe345cf500 Aug 27 02:48:52.087555 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-1478250502 Aug 27 02:48:52.087555 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-SecurityGroupRulesTestJSON-1478250502-project Aug 27 02:48:52.087555 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:48:52.087555 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:48:52.087555 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 3dc3e3cfd1ff4d73a0e409854928bbda Aug 27 02:48:52.087555 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-SecurityGroupRulesTestJSON-1478250502-project Aug 27 02:48:52.087555 n-d-852278-4 devstack@n-api.service[134051]: method: Aug 27 02:48:52.087555 n-d-852278-4 devstack@n-api.service[134051]: exception: Security group c9de0ffa-aa9c-4952-b12b-f09123556fb9 does not exist Aug 27 02:48:52.087555 n-d-852278-4 devstack@n-api.service[134051]: Neutron server returns request_ids: ['req-7752c2e8-8653-4d1e-a31f-9ac4fdf87e62'] Aug 27 02:48:52.087555 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': 'c9de0ffa-aa9c-4952-b12b-f09123556fb9'} Aug 27 02:48:52.087555 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:48:52.087555 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:48:52.087555 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 27 02:48:52.087555 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 27 02:48:52.087555 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:48:52.087555 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:48:52.087555 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 27 02:48:52.087555 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 27 02:48:52.087555 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:48:52.087555 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:48:52.087555 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 02:48:52.087555 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 02:48:52.087555 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:48:52.087555 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:48:52.087555 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 02:48:52.087555 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 02:48:52.087555 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:48:52.087555 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:48:52.087555 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 02:48:52.087555 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 02:48:52.087555 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:48:52.087555 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:48:52.087555 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 02:48:52.087555 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 02:48:52.087555 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 02:48:52.087555 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 02:48:52.087555 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c9de0ffa-aa9c-4952-b12b-f09123556fb9 does not exist Aug 27 02:48:52.091364 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7752c2e8-8653-4d1e-a31f-9ac4fdf87e62'] Aug 27 02:48:52.091364 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:48:52.091364 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:48:52.091364 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:48:52.091364 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:48:52.091364 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 27 02:48:52.091364 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 27 02:48:52.091364 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 27 02:48:52.091364 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 27 02:48:52.091364 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c9de0ffa-aa9c-4952-b12b-f09123556fb9 does not exist Aug 27 02:48:52.091364 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7752c2e8-8653-4d1e-a31f-9ac4fdf87e62'] Aug 27 02:48:52.091364 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:48:52.091364 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:48:52.091364 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:48:52.091364 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:48:52.091364 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:48:52.091364 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:48:52.091364 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:48:52.091364 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:48:52.091364 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:48:52.091364 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:48:52.091364 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:48:52.091364 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:48:52.091364 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 27 02:48:52.091364 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 27 02:48:52.091364 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c9de0ffa-aa9c-4952-b12b-f09123556fb9 does not exist Aug 27 02:48:52.091364 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7752c2e8-8653-4d1e-a31f-9ac4fdf87e62'] Aug 27 02:48:52.091364 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:48:52.091364 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:48:52.091364 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:48:52.091364 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:48:52.091364 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:48:52.091364 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:48:52.091364 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:48:52.091364 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:48:52.091364 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c9de0ffa-aa9c-4952-b12b-f09123556fb9 does not exist Aug 27 02:48:52.091364 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7752c2e8-8653-4d1e-a31f-9ac4fdf87e62'] Aug 27 02:48:52.091364 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:48:52.091364 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-2a15c8ed-7879-451e-b2d2-b2d7039d6b7e tempest-SecurityGroupRulesTestJSON-1478250502 tempest-SecurityGroupRulesTestJSON-1478250502-project] Returning 404 to user: Security group c9de0ffa-aa9c-4952-b12b-f09123556fb9 does not exist Aug 27 02:48:52.091364 n-d-852278-4 devstack@n-api.service[134051]: Neutron server returns request_ids: ['req-7752c2e8-8653-4d1e-a31f-9ac4fdf87e62'] {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:48:52.091364 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-2a15c8ed-7879-451e-b2d2-b2d7039d6b7e tempest-SecurityGroupRulesTestJSON-1478250502 tempest-SecurityGroupRulesTestJSON-1478250502-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/c9de0ffa-aa9c-4952-b12b-f09123556fb9" status: 404 len: 194 microversion: 2.1 time: 0.403467 Aug 27 02:48:52.091364 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 955/1937] 10.222.0.70 () {58 vars in 1272 bytes} [Sat Aug 27 02:48:51 2022] DELETE /compute/v2.1/os-security-groups/c9de0ffa-aa9c-4952-b12b-f09123556fb9 => generated 194 bytes in 405 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:48:52.097396 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-cae64f84-18f7-4ecf-959b-44d154279190 req-0eba0b0a-5519-4a83-b823-9ff04799561a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4", "name": "network-vif-unplugged", "status": "completed", "tag": "f88818f1-ef30-4d4a-9180-9bdfc399cfe1"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:48:52.108667 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-cae64f84-18f7-4ecf-959b-44d154279190 req-0eba0b0a-5519-4a83-b823-9ff04799561a service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:52.108812 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-cae64f84-18f7-4ecf-959b-44d154279190 req-0eba0b0a-5519-4a83-b823-9ff04799561a service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:52.109368 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-df056811-e179-424c-872c-029de4b24c5c tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:52.110432 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-cae64f84-18f7-4ecf-959b-44d154279190 req-0eba0b0a-5519-4a83-b823-9ff04799561a service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:52.119439 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-df056811-e179-424c-872c-029de4b24c5c tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4" status: 200 len: 1475 microversion: 2.1 time: 0.711387 Aug 27 02:48:52.120065 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 983/1938] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:51 2022] GET /compute/v2.1/servers/60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4 => generated 1475 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:52.124926 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-50c7d981-103c-47e6-8126-178bf140dd08 req-285c50f5-0117-40b7-866d-598f81b6c270 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e445cdc5-5ecb-487c-adee-f5cb9862283c", "tag": "42ac4b18-965a-486a-8d1d-80c016c9888c"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:48:52.134678 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-50c7d981-103c-47e6-8126-178bf140dd08 req-285c50f5-0117-40b7-866d-598f81b6c270 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:52.135558 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-50c7d981-103c-47e6-8126-178bf140dd08 req-285c50f5-0117-40b7-866d-598f81b6c270 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:52.136284 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-50c7d981-103c-47e6-8126-178bf140dd08 req-285c50f5-0117-40b7-866d-598f81b6c270 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:52.138505 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-cae64f84-18f7-4ecf-959b-44d154279190 req-0eba0b0a-5519-4a83-b823-9ff04799561a service nova] Creating event network-vif-unplugged:f88818f1-ef30-4d4a-9180-9bdfc399cfe1 for instance 60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4 on n-h2-852278-4 Aug 27 02:48:52.150259 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-50c7d981-103c-47e6-8126-178bf140dd08 req-285c50f5-0117-40b7-866d-598f81b6c270 service nova] Creating event network-changed:42ac4b18-965a-486a-8d1d-80c016c9888c for instance e445cdc5-5ecb-487c-adee-f5cb9862283c on n-h2-852278-4 Aug 27 02:48:52.155486 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-50c7d981-103c-47e6-8126-178bf140dd08 req-285c50f5-0117-40b7-866d-598f81b6c270 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034048 Aug 27 02:48:52.156495 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 984/1939] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:48:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:48:52.160633 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [req-cae64f84-18f7-4ecf-959b-44d154279190 req-0eba0b0a-5519-4a83-b823-9ff04799561a service nova] Instance 60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-852278-4', 'n-h1-852278-4'} {{(pid=134051) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 02:48:52.182847 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-cae64f84-18f7-4ecf-959b-44d154279190 req-0eba0b0a-5519-4a83-b823-9ff04799561a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.088458 Aug 27 02:48:52.183477 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 956/1940] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:48:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:48:52.191993 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e0020110-af4f-4fab-9f3f-c61183001b7e tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Calling method '.version_select at 0x7f5ee7342a60>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:52.254855 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e0020110-af4f-4fab-9f3f-c61183001b7e tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] 10.222.0.70 "GET /compute/v2.1/images/90bf1cec-6c76-499b-b5d3-56e7eebb189a" status: 200 len: 1428 microversion: 2.1 time: 0.070150 Aug 27 02:48:52.255422 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 957/1941] 10.222.0.70 () {58 vars in 1233 bytes} [Sat Aug 27 02:48:52 2022] GET /compute/v2.1/images/90bf1cec-6c76-499b-b5d3-56e7eebb189a => generated 1428 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:52.265501 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3fe3bc44-131a-49f6-817c-d5a0676196bf tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1968430529"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:48:52.268006 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-3fe3bc44-131a-49f6-817c-d5a0676196bf tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] [instance: 191df585-2175-47be-9bd8-29b914535f47] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:52.275244 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3fe3bc44-131a-49f6-817c-d5a0676196bf tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:52.275730 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3fe3bc44-131a-49f6-817c-d5a0676196bf tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:52.276160 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3fe3bc44-131a-49f6-817c-d5a0676196bf tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:52.276915 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3fe3bc44-131a-49f6-817c-d5a0676196bf tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:52.278061 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3fe3bc44-131a-49f6-817c-d5a0676196bf tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:52.278493 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3fe3bc44-131a-49f6-817c-d5a0676196bf tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:52.407926 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d847d6cc-0d03-4a77-943d-6c06fc9d4c31 tempest-ServicesAdminNegativeV253TestJSON-1382973337 tempest-ServicesAdminNegativeV253TestJSON-1382973337-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:52.413368 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-d847d6cc-0d03-4a77-943d-6c06fc9d4c31 tempest-ServicesAdminNegativeV253TestJSON-1382973337 tempest-ServicesAdminNegativeV253TestJSON-1382973337-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'c1d458fe1a6f4724a63db28fa1be6d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6154359945141a0bc1bde0ce84f03cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:52.416379 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d847d6cc-0d03-4a77-943d-6c06fc9d4c31 tempest-ServicesAdminNegativeV253TestJSON-1382973337 tempest-ServicesAdminNegativeV253TestJSON-1382973337-project] Request method failure captured: Aug 27 02:48:52.416379 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/os-services HTTP/1.1 Aug 27 02:48:52.416379 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:48:52.416379 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:48:52.416379 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:48:52.416379 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:48:52.416379 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:48:52.416379 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:48:52.416379 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:48:52.416379 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:48:52.416379 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYYNqJjJOMlFkcKUT_xZbA-XP2K1BehPe6_VClXKVmjlfJuMKh7YOB8sok6Z4ct5GYzSDbHt-BBnU21T-2feypJG3B-2bdWK7xLthYy16xmDtgPYig3Zu4HH3zCtNtraPoVNeiE5FssJbhw-snaAP_27fbekRBYWEwn5J4wBPWCyJBI Aug 27 02:48:52.416379 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:48:52.416379 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:48:52.416379 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:48:52.416379 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:48:52.416379 n-d-852278-4 devstack@n-api.service[134052]: X-Openstack-Nova-Api-Version: 2.53 Aug 27 02:48:52.416379 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:48:52.416379 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:48:52.416379 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: b6154359945141a0bc1bde0ce84f03cd Aug 27 02:48:52.416379 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1382973337 Aug 27 02:48:52.416379 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:48:52.416379 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:48:52.416379 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b6154359945141a0bc1bde0ce84f03cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_b6154359945141a0bc1bde0ce84f03cd", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b6154359945141a0bc1bde0ce84f03cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/b6154359945141a0bc1bde0ce84f03cd"}]}] Aug 27 02:48:52.416379 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1382973337 Aug 27 02:48:52.416379 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: b6154359945141a0bc1bde0ce84f03cd Aug 27 02:48:52.416379 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1382973337 Aug 27 02:48:52.416379 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1382973337-project Aug 27 02:48:52.416379 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:48:52.416379 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:48:52.416379 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: c1d458fe1a6f4724a63db28fa1be6d3d Aug 27 02:48:52.416379 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1382973337-project Aug 27 02:48:52.416379 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 02:48:52.416379 n-d-852278-4 devstack@n-api.service[134052]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 27 02:48:52.416379 n-d-852278-4 devstack@n-api.service[134052]: action_args: {} Aug 27 02:48:52.416379 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:48:52.416379 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:48:52.416379 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:48:52.416379 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:48:52.416379 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:48:52.416379 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:48:52.416379 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 02:48:52.416379 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:48:52.416379 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 02:48:52.416379 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:48:52.416379 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:48:52.416379 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:48:52.416379 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Aug 27 02:48:52.416379 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Aug 27 02:48:52.416379 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 02:48:52.416379 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 02:48:52.416379 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 02:48:52.416379 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 02:48:52.416379 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 02:48:52.416379 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 02:48:52.416379 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 02:48:52.416379 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 02:48:52.416379 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 02:48:52.416379 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 02:48:52.416379 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 02:48:52.416379 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 02:48:52.416379 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 02:48:52.416379 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 02:48:52.416379 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 27 02:48:52.419721 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:48:52.419721 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:48:52.419721 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:48:52.419721 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:48:52.419721 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:48:52.419721 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:48:52.419721 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 02:48:52.419721 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 02:48:52.419721 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 27 02:48:52.419721 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:48:52.423282 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d847d6cc-0d03-4a77-943d-6c06fc9d4c31 tempest-ServicesAdminNegativeV253TestJSON-1382973337 tempest-ServicesAdminNegativeV253TestJSON-1382973337-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:48:52.424979 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d847d6cc-0d03-4a77-943d-6c06fc9d4c31 tempest-ServicesAdminNegativeV253TestJSON-1382973337 tempest-ServicesAdminNegativeV253TestJSON-1382973337-project] 10.222.0.70 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.267376 Aug 27 02:48:52.427472 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 985/1942] 10.222.0.70 () {60 vars in 1178 bytes} [Sat Aug 27 02:48:52 2022] GET /compute/v2.1/os-services => generated 112 bytes in 270 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Aug 27 02:48:52.442556 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-87aba2aa-e214-4175-b092-6b890641dd43 tempest-SecurityGroupRulesTestJSON-1478250502 tempest-SecurityGroupRulesTestJSON-1478250502-project] Calling method '.version_select at 0x7f5ee725ed30>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:52.489616 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-3fe3bc44-131a-49f6-817c-d5a0676196bf tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] 10.222.0.70 "POST /compute/v2.1/servers/191df585-2175-47be-9bd8-29b914535f47/action" status: 202 len: 0 microversion: 2.1 time: 0.232799 Aug 27 02:48:52.490640 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 958/1943] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 02:48:52 2022] POST /compute/v2.1/servers/191df585-2175-47be-9bd8-29b914535f47/action => generated 0 bytes in 234 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 27 02:48:52.501568 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b8c6d32e-dc6c-48a2-b0a6-6657c2e6180a tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:52.502507 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b8c6d32e-dc6c-48a2-b0a6-6657c2e6180a tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] [instance: e445cdc5-5ecb-487c-adee-f5cb9862283c] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:52.511015 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b8c6d32e-dc6c-48a2-b0a6-6657c2e6180a tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:52.511761 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b8c6d32e-dc6c-48a2-b0a6-6657c2e6180a tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:52.512378 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b8c6d32e-dc6c-48a2-b0a6-6657c2e6180a tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:52.513294 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b8c6d32e-dc6c-48a2-b0a6-6657c2e6180a tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:52.513891 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b8c6d32e-dc6c-48a2-b0a6-6657c2e6180a tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:52.514468 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b8c6d32e-dc6c-48a2-b0a6-6657c2e6180a tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:52.794129 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-b8c6d32e-dc6c-48a2-b0a6-6657c2e6180a tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66c0fc8492654e6e85a90ce04736c055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f9be56fbeb64cb08b9be4e3d7436782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:52.806553 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b8c6d32e-dc6c-48a2-b0a6-6657c2e6180a tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] 10.222.0.70 "GET /compute/v2.1/servers/e445cdc5-5ecb-487c-adee-f5cb9862283c" status: 200 len: 1323 microversion: 2.1 time: 0.314456 Aug 27 02:48:52.822156 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 959/1944] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:52 2022] GET /compute/v2.1/servers/e445cdc5-5ecb-487c-adee-f5cb9862283c => generated 1323 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:52.828079 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-6cf3f16a-4e38-4888-8085-e2da3527c309 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Calling method '.version_select at 0x7f5ede932550>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:52.840085 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-87aba2aa-e214-4175-b092-6b890641dd43 tempest-SecurityGroupRulesTestJSON-1478250502 tempest-SecurityGroupRulesTestJSON-1478250502-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/0cfa5ba9-a217-4200-b2e8-89426a3b1faf" status: 202 len: 0 microversion: 2.1 time: 0.411131 Aug 27 02:48:52.841676 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 986/1945] 10.222.0.70 () {58 vars in 1272 bytes} [Sat Aug 27 02:48:52 2022] DELETE /compute/v2.1/os-security-groups/0cfa5ba9-a217-4200-b2e8-89426a3b1faf => generated 0 bytes in 413 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:48:52.849482 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d5d2a7ac-17af-4b66-a322-db4a6d243489 tempest-SecurityGroupRulesTestJSON-1478250502 tempest-SecurityGroupRulesTestJSON-1478250502-project] Calling method '.version_select at 0x7f5ee725eca0>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:52.887898 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-6cf3f16a-4e38-4888-8085-e2da3527c309 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] 10.222.0.70 "GET /compute/v2.1/images/f6ba65b6-f90b-4da7-ad83-73a1ced207b6" status: 200 len: 1455 microversion: 2.1 time: 0.063969 Aug 27 02:48:52.889244 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 960/1946] 10.222.0.70 () {58 vars in 1233 bytes} [Sat Aug 27 02:48:52 2022] GET /compute/v2.1/images/f6ba65b6-f90b-4da7-ad83-73a1ced207b6 => generated 1455 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:53.143333 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ffdd641f-885a-4c8a-978a-1af9fe4179ef tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:53.143953 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-ffdd641f-885a-4c8a-978a-1af9fe4179ef tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: 60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:53.150751 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ffdd641f-885a-4c8a-978a-1af9fe4179ef tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:53.151388 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ffdd641f-885a-4c8a-978a-1af9fe4179ef tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:53.151925 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ffdd641f-885a-4c8a-978a-1af9fe4179ef tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:53.152744 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ffdd641f-885a-4c8a-978a-1af9fe4179ef tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:53.153250 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ffdd641f-885a-4c8a-978a-1af9fe4179ef tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:53.153755 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ffdd641f-885a-4c8a-978a-1af9fe4179ef tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:53.529148 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-ffdd641f-885a-4c8a-978a-1af9fe4179ef tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:53.547638 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ffdd641f-885a-4c8a-978a-1af9fe4179ef tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4" status: 200 len: 1475 microversion: 2.1 time: 0.408392 Aug 27 02:48:53.548594 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 961/1947] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:53 2022] GET /compute/v2.1/servers/60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4 => generated 1475 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:53.553415 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-91d61118-6601-45b1-982b-5959cef5f571 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Calling method '.version_select at 0x7f5ee7216430>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:53.587024 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d5d2a7ac-17af-4b66-a322-db4a6d243489 tempest-SecurityGroupRulesTestJSON-1478250502 tempest-SecurityGroupRulesTestJSON-1478250502-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/0a03b922-b5cb-4d6a-be01-3e7b8d0c9dee" status: 202 len: 0 microversion: 2.1 time: 0.741237 Aug 27 02:48:53.588483 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 987/1948] 10.222.0.70 () {58 vars in 1272 bytes} [Sat Aug 27 02:48:52 2022] DELETE /compute/v2.1/os-security-groups/0a03b922-b5cb-4d6a-be01-3e7b8d0c9dee => generated 0 bytes in 743 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:48:53.595908 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-754940a8-d166-47f7-9f92-ba4ad8c64f3d tempest-SecurityGroupRulesTestJSON-1478250502 tempest-SecurityGroupRulesTestJSON-1478250502-project] Calling method '.version_select at 0x7f5ee2cf2940>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:53.605291 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-91d61118-6601-45b1-982b-5959cef5f571 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] 10.222.0.70 "GET /compute/v2.1/images/90bf1cec-6c76-499b-b5d3-56e7eebb189a" status: 200 len: 1428 microversion: 2.1 time: 0.055588 Aug 27 02:48:53.606553 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 962/1949] 10.222.0.70 () {58 vars in 1233 bytes} [Sat Aug 27 02:48:53 2022] GET /compute/v2.1/images/90bf1cec-6c76-499b-b5d3-56e7eebb189a => generated 1428 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:53.837385 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8a557006-7063-44e5-b5b9-5cf3f76b135b tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:53.840530 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-8a557006-7063-44e5-b5b9-5cf3f76b135b tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] [instance: e445cdc5-5ecb-487c-adee-f5cb9862283c] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:53.849524 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8a557006-7063-44e5-b5b9-5cf3f76b135b tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:53.850435 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8a557006-7063-44e5-b5b9-5cf3f76b135b tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:53.851329 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8a557006-7063-44e5-b5b9-5cf3f76b135b tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:53.853097 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8a557006-7063-44e5-b5b9-5cf3f76b135b tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:53.853905 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8a557006-7063-44e5-b5b9-5cf3f76b135b tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:53.854509 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8a557006-7063-44e5-b5b9-5cf3f76b135b tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:54.017234 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-754940a8-d166-47f7-9f92-ba4ad8c64f3d tempest-SecurityGroupRulesTestJSON-1478250502 tempest-SecurityGroupRulesTestJSON-1478250502-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/54aec542-9bb9-4e32-8c17-e8d86b244493" status: 202 len: 0 microversion: 2.1 time: 0.424879 Aug 27 02:48:54.018476 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 988/1950] 10.222.0.70 () {58 vars in 1272 bytes} [Sat Aug 27 02:48:53 2022] DELETE /compute/v2.1/os-security-groups/54aec542-9bb9-4e32-8c17-e8d86b244493 => generated 0 bytes in 427 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 02:48:54.025596 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-75ad7f65-f381-4f80-904a-43655985668b tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Calling method '.version_select at 0x7f5ee7214940>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:54.095204 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-75ad7f65-f381-4f80-904a-43655985668b tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] 10.222.0.70 "GET /compute/v2.1/images/f6ba65b6-f90b-4da7-ad83-73a1ced207b6" status: 200 len: 1455 microversion: 2.1 time: 0.074709 Aug 27 02:48:54.098404 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-8a557006-7063-44e5-b5b9-5cf3f76b135b tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66c0fc8492654e6e85a90ce04736c055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f9be56fbeb64cb08b9be4e3d7436782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:54.098552 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 989/1951] 10.222.0.70 () {58 vars in 1233 bytes} [Sat Aug 27 02:48:54 2022] GET /compute/v2.1/images/f6ba65b6-f90b-4da7-ad83-73a1ced207b6 => generated 1455 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:54.109907 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-74922b62-8aa7-46b9-88b5-3959fbbd0261 tempest-SecurityGroupRulesTestJSON-1478250502 tempest-SecurityGroupRulesTestJSON-1478250502-project] Calling method '.version_select at 0x7f5ee2dfb280>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:54.110970 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-8a557006-7063-44e5-b5b9-5cf3f76b135b tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] 10.222.0.70 "GET /compute/v2.1/servers/e445cdc5-5ecb-487c-adee-f5cb9862283c" status: 200 len: 1323 microversion: 2.1 time: 0.286343 Aug 27 02:48:54.125017 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 963/1952] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:53 2022] GET /compute/v2.1/servers/e445cdc5-5ecb-487c-adee-f5cb9862283c => generated 1323 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:54.206524 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-282ece9f-f44a-45d2-a7e5-8a91fb06ae7b req-44ea1e87-9cfa-42d4-bcb6-f3215a6c8520 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4", "tag": "f88818f1-ef30-4d4a-9180-9bdfc399cfe1"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:48:54.234326 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-282ece9f-f44a-45d2-a7e5-8a91fb06ae7b req-44ea1e87-9cfa-42d4-bcb6-f3215a6c8520 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:54.235147 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-282ece9f-f44a-45d2-a7e5-8a91fb06ae7b req-44ea1e87-9cfa-42d4-bcb6-f3215a6c8520 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:54.238159 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-282ece9f-f44a-45d2-a7e5-8a91fb06ae7b req-44ea1e87-9cfa-42d4-bcb6-f3215a6c8520 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:54.271879 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-282ece9f-f44a-45d2-a7e5-8a91fb06ae7b req-44ea1e87-9cfa-42d4-bcb6-f3215a6c8520 service nova] Creating event network-changed:f88818f1-ef30-4d4a-9180-9bdfc399cfe1 for instance 60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4 on n-h2-852278-4 Aug 27 02:48:54.289044 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [req-282ece9f-f44a-45d2-a7e5-8a91fb06ae7b req-44ea1e87-9cfa-42d4-bcb6-f3215a6c8520 service nova] Instance 60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-852278-4', 'n-h1-852278-4'} {{(pid=134051) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 02:48:54.317036 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-282ece9f-f44a-45d2-a7e5-8a91fb06ae7b req-44ea1e87-9cfa-42d4-bcb6-f3215a6c8520 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114813 Aug 27 02:48:54.322408 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 964/1953] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:48:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:48:54.402457 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-74922b62-8aa7-46b9-88b5-3959fbbd0261 tempest-SecurityGroupRulesTestJSON-1478250502 tempest-SecurityGroupRulesTestJSON-1478250502-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/fca12f2a-cc5b-4597-b3ba-0992652af1e7" status: 202 len: 0 microversion: 2.1 time: 0.302873 Aug 27 02:48:54.406383 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 990/1954] 10.222.0.70 () {58 vars in 1272 bytes} [Sat Aug 27 02:48:54 2022] DELETE /compute/v2.1/os-security-groups/fca12f2a-cc5b-4597-b3ba-0992652af1e7 => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:48:54.418089 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f9d0b104-7a21-4b59-9aaa-fd8048d64b44 tempest-SecurityGroupRulesTestJSON-1478250502 tempest-SecurityGroupRulesTestJSON-1478250502-project] Calling method '.version_select at 0x7f5ede9963a0>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:54.461549 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-c57edceb-948a-4a85-befa-b3f5eb03dc70 req-880d20fd-4487-4c13-b37d-5b2629da5c4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d7f8c37-c4a6-400e-9a02-94f9040b780e", "name": "network-vif-unplugged", "status": "completed", "tag": "545c57b0-4a40-4554-9d90-9ca7c0773d35"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:48:54.478389 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-c57edceb-948a-4a85-befa-b3f5eb03dc70 req-880d20fd-4487-4c13-b37d-5b2629da5c4e service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:54.481590 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-c57edceb-948a-4a85-befa-b3f5eb03dc70 req-880d20fd-4487-4c13-b37d-5b2629da5c4e service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:54.482119 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-c57edceb-948a-4a85-befa-b3f5eb03dc70 req-880d20fd-4487-4c13-b37d-5b2629da5c4e service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:54.511147 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-c57edceb-948a-4a85-befa-b3f5eb03dc70 req-880d20fd-4487-4c13-b37d-5b2629da5c4e service nova] Creating event network-vif-unplugged:545c57b0-4a40-4554-9d90-9ca7c0773d35 for instance 9d7f8c37-c4a6-400e-9a02-94f9040b780e on n-h2-852278-4 Aug 27 02:48:54.518438 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-c57edceb-948a-4a85-befa-b3f5eb03dc70 req-880d20fd-4487-4c13-b37d-5b2629da5c4e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061839 Aug 27 02:48:54.519057 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 991/1955] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:48:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:48:54.579002 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-135e7752-d2b6-4653-a4ab-b5ea672c1da3 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:54.580494 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-135e7752-d2b6-4653-a4ab-b5ea672c1da3 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: 60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:54.598957 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-135e7752-d2b6-4653-a4ab-b5ea672c1da3 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:54.602220 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-135e7752-d2b6-4653-a4ab-b5ea672c1da3 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:54.602879 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-135e7752-d2b6-4653-a4ab-b5ea672c1da3 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:54.604467 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-135e7752-d2b6-4653-a4ab-b5ea672c1da3 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:54.606070 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-135e7752-d2b6-4653-a4ab-b5ea672c1da3 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:54.606522 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-135e7752-d2b6-4653-a4ab-b5ea672c1da3 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:54.852691 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-f9d0b104-7a21-4b59-9aaa-fd8048d64b44 tempest-SecurityGroupRulesTestJSON-1478250502 tempest-SecurityGroupRulesTestJSON-1478250502-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/c5b5dca1-fc8a-4141-9792-d6ab3623571f" status: 202 len: 0 microversion: 2.1 time: 0.440532 Aug 27 02:48:54.854204 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 965/1956] 10.222.0.70 () {58 vars in 1272 bytes} [Sat Aug 27 02:48:54 2022] DELETE /compute/v2.1/os-security-groups/c5b5dca1-fc8a-4141-9792-d6ab3623571f => generated 0 bytes in 444 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:48:54.859789 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b9e8baaa-fe7b-42e6-9b50-965f7f251796 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Calling method '.version_select at 0x7f5ee7269670>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:54.950075 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b9e8baaa-fe7b-42e6-9b50-965f7f251796 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] 10.222.0.70 "GET /compute/v2.1/images/90bf1cec-6c76-499b-b5d3-56e7eebb189a" status: 200 len: 1428 microversion: 2.1 time: 0.093704 Aug 27 02:48:54.951508 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 966/1957] 10.222.0.70 () {58 vars in 1233 bytes} [Sat Aug 27 02:48:54 2022] GET /compute/v2.1/images/90bf1cec-6c76-499b-b5d3-56e7eebb189a => generated 1428 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:54.988536 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-135e7752-d2b6-4653-a4ab-b5ea672c1da3 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:55.000916 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-135e7752-d2b6-4653-a4ab-b5ea672c1da3 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4" status: 200 len: 1473 microversion: 2.1 time: 0.429526 Aug 27 02:48:55.001893 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 992/1958] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:54 2022] GET /compute/v2.1/servers/60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4 => generated 1473 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:48:55.111625 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7cc7ebd1-0e32-4278-b319-3c4adeb89709 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Calling method '.version_select at 0x7f5ede9963a0>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:55.139882 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-cf14542c-2038-4ed3-8365-cbffab346369 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:55.142573 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-cf14542c-2038-4ed3-8365-cbffab346369 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] [instance: e445cdc5-5ecb-487c-adee-f5cb9862283c] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:55.149623 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cf14542c-2038-4ed3-8365-cbffab346369 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:55.150241 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cf14542c-2038-4ed3-8365-cbffab346369 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:55.150686 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cf14542c-2038-4ed3-8365-cbffab346369 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:55.151638 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cf14542c-2038-4ed3-8365-cbffab346369 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:55.152177 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cf14542c-2038-4ed3-8365-cbffab346369 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:55.152955 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cf14542c-2038-4ed3-8365-cbffab346369 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:55.232274 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-7cc7ebd1-0e32-4278-b319-3c4adeb89709 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] 10.222.0.70 "GET /compute/v2.1/images/f6ba65b6-f90b-4da7-ad83-73a1ced207b6" status: 200 len: 1455 microversion: 2.1 time: 0.124795 Aug 27 02:48:55.233165 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 967/1959] 10.222.0.70 () {58 vars in 1233 bytes} [Sat Aug 27 02:48:55 2022] GET /compute/v2.1/images/f6ba65b6-f90b-4da7-ad83-73a1ced207b6 => generated 1455 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:48:55.450223 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-cf14542c-2038-4ed3-8365-cbffab346369 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66c0fc8492654e6e85a90ce04736c055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f9be56fbeb64cb08b9be4e3d7436782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:55.458333 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-cf14542c-2038-4ed3-8365-cbffab346369 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] 10.222.0.70 "GET /compute/v2.1/servers/e445cdc5-5ecb-487c-adee-f5cb9862283c" status: 200 len: 1323 microversion: 2.1 time: 0.323972 Aug 27 02:48:55.475579 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 993/1960] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:55 2022] GET /compute/v2.1/servers/e445cdc5-5ecb-487c-adee-f5cb9862283c => generated 1323 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:48:55.967341 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c3e2a10c-eaae-4f13-adae-19aa79440f45 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Calling method '.version_select at 0x7f5ee72691f0>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:56.023383 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0fff96f1-a025-4195-b8c6-45a9822c9d78 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:56.024936 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-0fff96f1-a025-4195-b8c6-45a9822c9d78 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: 60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:56.035686 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0fff96f1-a025-4195-b8c6-45a9822c9d78 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:56.042170 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0fff96f1-a025-4195-b8c6-45a9822c9d78 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:56.047993 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0fff96f1-a025-4195-b8c6-45a9822c9d78 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:56.051667 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0fff96f1-a025-4195-b8c6-45a9822c9d78 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:56.053997 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0fff96f1-a025-4195-b8c6-45a9822c9d78 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:56.055641 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0fff96f1-a025-4195-b8c6-45a9822c9d78 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:56.059255 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c3e2a10c-eaae-4f13-adae-19aa79440f45 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] 10.222.0.70 "GET /compute/v2.1/images/90bf1cec-6c76-499b-b5d3-56e7eebb189a" status: 200 len: 1428 microversion: 2.1 time: 0.097735 Aug 27 02:48:56.059833 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 968/1961] 10.222.0.70 () {58 vars in 1233 bytes} [Sat Aug 27 02:48:55 2022] GET /compute/v2.1/images/90bf1cec-6c76-499b-b5d3-56e7eebb189a => generated 1428 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:56.248654 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c7ee707f-0149-4628-b0d0-45f4a5a8c262 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Calling method '.version_select at 0x7f5edf445d30>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:56.321118 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c7ee707f-0149-4628-b0d0-45f4a5a8c262 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] 10.222.0.70 "GET /compute/v2.1/images/f6ba65b6-f90b-4da7-ad83-73a1ced207b6" status: 200 len: 1455 microversion: 2.1 time: 0.077284 Aug 27 02:48:56.325551 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 969/1962] 10.222.0.70 () {58 vars in 1233 bytes} [Sat Aug 27 02:48:56 2022] GET /compute/v2.1/images/f6ba65b6-f90b-4da7-ad83-73a1ced207b6 => generated 1455 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:56.441838 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0fff96f1-a025-4195-b8c6-45a9822c9d78 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:56.462228 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-0fff96f1-a025-4195-b8c6-45a9822c9d78 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4" status: 200 len: 1473 microversion: 2.1 time: 0.441495 Aug 27 02:48:56.463052 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 994/1963] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:56 2022] GET /compute/v2.1/servers/60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4 => generated 1473 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:56.481013 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-91a8861e-b6da-403a-8929-26ef22baf249 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:56.481758 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-91a8861e-b6da-403a-8929-26ef22baf249 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] [instance: e445cdc5-5ecb-487c-adee-f5cb9862283c] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:56.494477 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-91a8861e-b6da-403a-8929-26ef22baf249 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:56.498304 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-91a8861e-b6da-403a-8929-26ef22baf249 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:56.499811 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-91a8861e-b6da-403a-8929-26ef22baf249 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:56.500601 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-91a8861e-b6da-403a-8929-26ef22baf249 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:56.504303 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-91a8861e-b6da-403a-8929-26ef22baf249 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:56.504806 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-91a8861e-b6da-403a-8929-26ef22baf249 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:56.574339 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-138a12ce-e4a5-4523-a6af-a31144b13068 req-4f953048-d678-4dc7-a111-c602d1de850f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b88e24d-509c-49fe-b5e2-b2698620d6d6", "name": "network-vif-plugged", "status": "completed", "tag": "8e5488cf-e7f9-42ad-b395-21ba7264782d"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:48:56.603558 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-138a12ce-e4a5-4523-a6af-a31144b13068 req-4f953048-d678-4dc7-a111-c602d1de850f service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:56.604053 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-138a12ce-e4a5-4523-a6af-a31144b13068 req-4f953048-d678-4dc7-a111-c602d1de850f service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:56.608356 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-138a12ce-e4a5-4523-a6af-a31144b13068 req-4f953048-d678-4dc7-a111-c602d1de850f service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:56.651924 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-138a12ce-e4a5-4523-a6af-a31144b13068 req-4f953048-d678-4dc7-a111-c602d1de850f service nova] Creating event network-vif-plugged:8e5488cf-e7f9-42ad-b395-21ba7264782d for instance 4b88e24d-509c-49fe-b5e2-b2698620d6d6 on n-h1-852278-4 Aug 27 02:48:56.667317 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-138a12ce-e4a5-4523-a6af-a31144b13068 req-4f953048-d678-4dc7-a111-c602d1de850f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096923 Aug 27 02:48:56.676342 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 995/1964] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:48:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:48:57.032000 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-91a8861e-b6da-403a-8929-26ef22baf249 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66c0fc8492654e6e85a90ce04736c055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f9be56fbeb64cb08b9be4e3d7436782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:57.049669 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-91a8861e-b6da-403a-8929-26ef22baf249 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] 10.222.0.70 "GET /compute/v2.1/servers/e445cdc5-5ecb-487c-adee-f5cb9862283c" status: 200 len: 1323 microversion: 2.1 time: 0.572601 Aug 27 02:48:57.051723 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 970/1965] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:56 2022] GET /compute/v2.1/servers/e445cdc5-5ecb-487c-adee-f5cb9862283c => generated 1323 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:57.076518 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f525bf8a-248e-4bb4-ad6c-1def8234031c tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Calling method '.version_select at 0x7f5ee7219700>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:57.162092 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f525bf8a-248e-4bb4-ad6c-1def8234031c tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] 10.222.0.70 "GET /compute/v2.1/images/90bf1cec-6c76-499b-b5d3-56e7eebb189a" status: 200 len: 1428 microversion: 2.1 time: 0.089836 Aug 27 02:48:57.164523 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 996/1966] 10.222.0.70 () {58 vars in 1233 bytes} [Sat Aug 27 02:48:57 2022] GET /compute/v2.1/images/90bf1cec-6c76-499b-b5d3-56e7eebb189a => generated 1428 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:57.340531 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8e937f5e-b975-4edc-8df1-8b20b6930ea8 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Calling method '.version_select at 0x7f5ee724fee0>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:57.406970 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-8e937f5e-b975-4edc-8df1-8b20b6930ea8 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] 10.222.0.70 "GET /compute/v2.1/images/f6ba65b6-f90b-4da7-ad83-73a1ced207b6" status: 200 len: 1455 microversion: 2.1 time: 0.070400 Aug 27 02:48:57.407789 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 997/1967] 10.222.0.70 () {58 vars in 1233 bytes} [Sat Aug 27 02:48:57 2022] GET /compute/v2.1/images/f6ba65b6-f90b-4da7-ad83-73a1ced207b6 => generated 1455 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:48:57.487344 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-08a2b3f8-b0c6-4b04-b742-c600a4805729 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:57.488486 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-08a2b3f8-b0c6-4b04-b742-c600a4805729 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: 60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:57.505807 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-08a2b3f8-b0c6-4b04-b742-c600a4805729 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:57.506756 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-08a2b3f8-b0c6-4b04-b742-c600a4805729 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:57.507201 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-08a2b3f8-b0c6-4b04-b742-c600a4805729 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:57.508024 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-08a2b3f8-b0c6-4b04-b742-c600a4805729 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:57.512137 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-08a2b3f8-b0c6-4b04-b742-c600a4805729 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:57.512792 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-08a2b3f8-b0c6-4b04-b742-c600a4805729 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:57.726535 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-18ecb20c-680b-477f-a10f-a1a0436a7850 tempest-FlavorsV2NegativeTest-1954293110 tempest-FlavorsV2NegativeTest-1954293110-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:57.759466 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-18ecb20c-680b-477f-a10f-a1a0436a7850 tempest-FlavorsV2NegativeTest-1954293110 tempest-FlavorsV2NegativeTest-1954293110-project] 10.222.0.70 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.613586 Aug 27 02:48:57.760290 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 971/1968] 10.222.0.70 () {58 vars in 1137 bytes} [Sat Aug 27 02:48:57 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:48:58.024794 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-08a2b3f8-b0c6-4b04-b742-c600a4805729 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:58.034817 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-08a2b3f8-b0c6-4b04-b742-c600a4805729 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4" status: 200 len: 1470 microversion: 2.1 time: 0.552022 Aug 27 02:48:58.041563 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 998/1969] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:57 2022] GET /compute/v2.1/servers/60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4 => generated 1470 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:48:58.063482 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-2963d7ac-27ba-4124-b42d-49150477dd01 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:48:58.067728 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-2963d7ac-27ba-4124-b42d-49150477dd01 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: 60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:58.079490 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-12527051-1972-4ccb-b3aa-cfa2ab870d87 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:58.083302 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-12527051-1972-4ccb-b3aa-cfa2ab870d87 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] [instance: e445cdc5-5ecb-487c-adee-f5cb9862283c] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:58.101400 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-12527051-1972-4ccb-b3aa-cfa2ab870d87 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:58.104165 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-12527051-1972-4ccb-b3aa-cfa2ab870d87 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:58.104586 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2963d7ac-27ba-4124-b42d-49150477dd01 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:58.105098 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2963d7ac-27ba-4124-b42d-49150477dd01 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:58.105539 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2963d7ac-27ba-4124-b42d-49150477dd01 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:58.107793 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-12527051-1972-4ccb-b3aa-cfa2ab870d87 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:58.108019 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2963d7ac-27ba-4124-b42d-49150477dd01 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:58.108696 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2963d7ac-27ba-4124-b42d-49150477dd01 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:58.109476 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-12527051-1972-4ccb-b3aa-cfa2ab870d87 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:58.110260 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2963d7ac-27ba-4124-b42d-49150477dd01 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:58.110840 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-12527051-1972-4ccb-b3aa-cfa2ab870d87 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:58.112342 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-12527051-1972-4ccb-b3aa-cfa2ab870d87 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:58.262549 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-2963d7ac-27ba-4124-b42d-49150477dd01 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "POST /compute/v2.1/servers/60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4/action" status: 204 len: 0 microversion: 2.1 time: 0.201840 Aug 27 02:48:58.269181 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 972/1970] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 02:48:58 2022] POST /compute/v2.1/servers/60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4/action => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:48:58.287979 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-9fc64df9-f2a4-4155-98ae-920d2ed4e7ce tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Calling method '.version_select at 0x7f5ede8f71f0>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:58.301288 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=8 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:48:58.468409 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-12527051-1972-4ccb-b3aa-cfa2ab870d87 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66c0fc8492654e6e85a90ce04736c055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f9be56fbeb64cb08b9be4e3d7436782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:58.479519 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-12527051-1972-4ccb-b3aa-cfa2ab870d87 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] 10.222.0.70 "GET /compute/v2.1/servers/e445cdc5-5ecb-487c-adee-f5cb9862283c" status: 200 len: 1323 microversion: 2.1 time: 0.411179 Aug 27 02:48:58.480114 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 999/1971] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:58 2022] GET /compute/v2.1/servers/e445cdc5-5ecb-487c-adee-f5cb9862283c => generated 1323 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:58.486829 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e0c35172-bb39-42fe-a032-1c6a58b7893c tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:58.487418 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-e0c35172-bb39-42fe-a032-1c6a58b7893c tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: 60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:58.506869 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e0c35172-bb39-42fe-a032-1c6a58b7893c tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:58.507613 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e0c35172-bb39-42fe-a032-1c6a58b7893c tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:58.508043 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e0c35172-bb39-42fe-a032-1c6a58b7893c tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:58.508863 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e0c35172-bb39-42fe-a032-1c6a58b7893c tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:58.509309 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e0c35172-bb39-42fe-a032-1c6a58b7893c tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:58.509728 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e0c35172-bb39-42fe-a032-1c6a58b7893c tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:59.488687 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-e0c35172-bb39-42fe-a032-1c6a58b7893c tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:59.502845 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e0c35172-bb39-42fe-a032-1c6a58b7893c tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4" status: 200 len: 1470 microversion: 2.1 time: 1.019327 Aug 27 02:48:59.504402 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1000/1972] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:58 2022] GET /compute/v2.1/servers/60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4 => generated 1470 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:59.510724 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-93080315-7bf9-4b7f-aa02-806d306e6d90 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Calling method '.version_select at 0x7f5ee72345e0>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:00.378137 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=4 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:49:01.387548 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=16 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:49:08.092977 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=32 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:49:08.237817 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:49:08.506494 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:49:09.501161 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:49:13.351862 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-9fc64df9-f2a4-4155-98ae-920d2ed4e7ce tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] 10.222.0.70 "GET /compute/v2.1/images/90bf1cec-6c76-499b-b5d3-56e7eebb189a" status: 200 len: 1437 microversion: 2.1 time: 15.080946 Aug 27 02:49:13.360749 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 973/1973] 10.222.0.70 () {58 vars in 1233 bytes} [Sat Aug 27 02:48:58 2022] GET /compute/v2.1/images/90bf1cec-6c76-499b-b5d3-56e7eebb189a => generated 1437 bytes in 15091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:13.373823 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-93080315-7bf9-4b7f-aa02-806d306e6d90 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] 10.222.0.70 "GET /compute/v2.1/images/f6ba65b6-f90b-4da7-ad83-73a1ced207b6" status: 200 len: 1455 microversion: 2.1 time: 13.867677 Aug 27 02:49:13.381635 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1001/1974] 10.222.0.70 () {58 vars in 1233 bytes} [Sat Aug 27 02:48:59 2022] GET /compute/v2.1/images/f6ba65b6-f90b-4da7-ad83-73a1ced207b6 => generated 1455 bytes in 13876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:13.392213 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7b1b1680-0113-4b3f-b6d4-390248ff1fe7 tempest-FlavorsV2NegativeTest-1954293110 tempest-FlavorsV2NegativeTest-1954293110-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-618741258", "imageRef": "ef95c138-e7f9-49f4-89f6-21ec61488e2e", "flavorRef": "452"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:49:13.396884 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ee54d455-6b15-45bd-bd6b-3501a2910f72 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:13.397507 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-ee54d455-6b15-45bd-bd6b-3501a2910f72 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] [instance: e445cdc5-5ecb-487c-adee-f5cb9862283c] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:13.441519 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ee54d455-6b15-45bd-bd6b-3501a2910f72 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:13.441988 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ee54d455-6b15-45bd-bd6b-3501a2910f72 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:13.442430 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ee54d455-6b15-45bd-bd6b-3501a2910f72 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:13.443154 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ee54d455-6b15-45bd-bd6b-3501a2910f72 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:13.443607 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ee54d455-6b15-45bd-bd6b-3501a2910f72 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:13.444744 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ee54d455-6b15-45bd-bd6b-3501a2910f72 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:13.611134 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.network.neutron [None req-7b1b1680-0113-4b3f-b6d4-390248ff1fe7 tempest-FlavorsV2NegativeTest-1954293110 tempest-FlavorsV2NegativeTest-1954293110-project] validate_networks() for None {{(pid=134051) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:49:14.226321 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-ee54d455-6b15-45bd-bd6b-3501a2910f72 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66c0fc8492654e6e85a90ce04736c055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f9be56fbeb64cb08b9be4e3d7436782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:14.247761 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ee54d455-6b15-45bd-bd6b-3501a2910f72 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] 10.222.0.70 "GET /compute/v2.1/servers/e445cdc5-5ecb-487c-adee-f5cb9862283c" status: 200 len: 1323 microversion: 2.1 time: 0.859524 Aug 27 02:49:14.262607 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1002/1975] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:13 2022] GET /compute/v2.1/servers/e445cdc5-5ecb-487c-adee-f5cb9862283c => generated 1323 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:14.269574 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-578d23e3-8a26-43b5-9e1e-2ff4074a8002 req-65a88f56-6571-4c6d-828b-4dd498473d89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e445cdc5-5ecb-487c-adee-f5cb9862283c", "name": "network-vif-plugged", "status": "completed", "tag": "42ac4b18-965a-486a-8d1d-80c016c9888c"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:49:14.283110 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-578d23e3-8a26-43b5-9e1e-2ff4074a8002 req-65a88f56-6571-4c6d-828b-4dd498473d89 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:14.283957 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-578d23e3-8a26-43b5-9e1e-2ff4074a8002 req-65a88f56-6571-4c6d-828b-4dd498473d89 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:14.284856 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-578d23e3-8a26-43b5-9e1e-2ff4074a8002 req-65a88f56-6571-4c6d-828b-4dd498473d89 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:14.299298 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-578d23e3-8a26-43b5-9e1e-2ff4074a8002 req-65a88f56-6571-4c6d-828b-4dd498473d89 service nova] Creating event network-vif-plugged:42ac4b18-965a-486a-8d1d-80c016c9888c for instance e445cdc5-5ecb-487c-adee-f5cb9862283c on n-h2-852278-4 Aug 27 02:49:14.305755 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-578d23e3-8a26-43b5-9e1e-2ff4074a8002 req-65a88f56-6571-4c6d-828b-4dd498473d89 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041116 Aug 27 02:49:14.315828 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-7b1b1680-0113-4b3f-b6d4-390248ff1fe7 tempest-FlavorsV2NegativeTest-1954293110 tempest-FlavorsV2NegativeTest-1954293110-project] HTTP exception thrown: Flavor's memory is too small for requested image. Aug 27 02:49:14.318843 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7b1b1680-0113-4b3f-b6d4-390248ff1fe7 tempest-FlavorsV2NegativeTest-1954293110 tempest-FlavorsV2NegativeTest-1954293110-project] Request method failure captured: Aug 27 02:49:14.318843 n-d-852278-4 devstack@n-api.service[134051]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 02:49:14.318843 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:49:14.318843 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:49:14.318843 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:49:14.318843 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 142 Aug 27 02:49:14.318843 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:49:14.318843 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:49:14.318843 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:49:14.318843 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:49:14.318843 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYYZ4OtmTOC_Mz_FSAVeXWCKV9KzlhnmHTDaOiOFpUKBtTga8NXlW5tc4-bP8nOmMr1RdFq0aILivxmEtfdl1ybHKZhHiAMH4I55pFCO8KA5KNZ1ybOwFEHSC1xNtIRZI46vKO6TqZ0lsQ688iVF5CoI5tA1OKqcubdWgXDHs21lu0I Aug 27 02:49:14.318843 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:49:14.318843 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:49:14.318843 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:49:14.318843 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:49:14.318843 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:49:14.318843 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:49:14.318843 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: ebd63261bf734c13a5291f63afcdd343 Aug 27 02:49:14.318843 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-FlavorsV2NegativeTest-1954293110 Aug 27 02:49:14.318843 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:49:14.318843 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:49:14.318843 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ebd63261bf734c13a5291f63afcdd343"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_ebd63261bf734c13a5291f63afcdd343", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ebd63261bf734c13a5291f63afcdd343"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/ebd63261bf734c13a5291f63afcdd343"}]}] Aug 27 02:49:14.318843 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-FlavorsV2NegativeTest-1954293110 Aug 27 02:49:14.318843 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: ebd63261bf734c13a5291f63afcdd343 Aug 27 02:49:14.318843 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-1954293110 Aug 27 02:49:14.318843 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-FlavorsV2NegativeTest-1954293110-project Aug 27 02:49:14.318843 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:49:14.318843 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:49:14.318843 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: dbf190b9ae8744afb0c7ebdb16646766 Aug 27 02:49:14.318843 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-FlavorsV2NegativeTest-1954293110-project Aug 27 02:49:14.318843 n-d-852278-4 devstack@n-api.service[134051]: Aug 27 02:49:14.318843 n-d-852278-4 devstack@n-api.service[134051]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-618741258", "imageRef": "ef95c138-e7f9-49f4-89f6-21ec61488e2e", "flavorRef": "452"}} Aug 27 02:49:14.318843 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 02:49:14.318843 n-d-852278-4 devstack@n-api.service[134051]: exception: Flavor's memory is too small for requested image. Aug 27 02:49:14.318843 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-618741258', 'imageRef': 'ef95c138-e7f9-49f4-89f6-21ec61488e2e', 'flavorRef': '452'}}} Aug 27 02:49:14.318843 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:49:14.318843 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:14.318843 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 27 02:49:14.318843 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 27 02:49:14.318843 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 27 02:49:14.318843 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 27 02:49:14.318843 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Aug 27 02:49:14.318843 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Aug 27 02:49:14.318843 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Aug 27 02:49:14.318843 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Aug 27 02:49:14.318843 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Aug 27 02:49:14.318843 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Aug 27 02:49:14.318843 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Aug 27 02:49:14.318843 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Aug 27 02:49:14.318843 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Aug 27 02:49:14.318843 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:49:14.318843 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:49:14.318843 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:49:14.318843 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:14.318843 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:49:14.318843 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:49:14.318843 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:49:14.318843 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:49:14.318843 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:49:14.318843 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:49:14.318843 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:49:14.318843 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:49:14.318843 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:49:14.318843 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:49:14.324338 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:49:14.324338 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:49:14.324338 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 27 02:49:14.324338 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Aug 27 02:49:14.324338 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 27 02:49:14.324338 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Aug 27 02:49:14.324338 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:49:14.324338 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:49:14.324338 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:49:14.324338 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:14.324338 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:49:14.324338 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:49:14.324338 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:49:14.324338 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:49:14.324338 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Aug 27 02:49:14.324338 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:49:14.343663 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7b1b1680-0113-4b3f-b6d4-390248ff1fe7 tempest-FlavorsV2NegativeTest-1954293110 tempest-FlavorsV2NegativeTest-1954293110-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:49:14.348521 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-7b1b1680-0113-4b3f-b6d4-390248ff1fe7 tempest-FlavorsV2NegativeTest-1954293110 tempest-FlavorsV2NegativeTest-1954293110-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.985897 Aug 27 02:49:14.352226 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 974/1976] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 02:49:13 2022] POST /compute/v2.1/servers => generated 93 bytes in 991 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 27 02:49:14.357437 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1003/1977] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:49:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:49:14.374613 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-19070338-8c24-4184-9655-30ff729ccd9d tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:14.374934 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-7828896f-5d07-4981-a4a4-ed48be7b6476 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Calling method '.version_select at 0x7f5ee72191f0>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:14.406095 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-19070338-8c24-4184-9655-30ff729ccd9d tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: 60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:14.441267 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-19070338-8c24-4184-9655-30ff729ccd9d tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:14.448801 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-19070338-8c24-4184-9655-30ff729ccd9d tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:14.454814 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-19070338-8c24-4184-9655-30ff729ccd9d tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:14.465664 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-19070338-8c24-4184-9655-30ff729ccd9d tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:14.467330 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-19070338-8c24-4184-9655-30ff729ccd9d tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:14.470487 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-19070338-8c24-4184-9655-30ff729ccd9d tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:15.171887 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-19070338-8c24-4184-9655-30ff729ccd9d tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:15.192374 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-19070338-8c24-4184-9655-30ff729ccd9d tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4" status: 200 len: 1462 microversion: 2.1 time: 0.834483 Aug 27 02:49:15.197569 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 975/1978] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:14 2022] GET /compute/v2.1/servers/60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4 => generated 1462 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:15.234744 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-7828896f-5d07-4981-a4a4-ed48be7b6476 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] 10.222.0.70 "GET /compute/v2.1/images/90bf1cec-6c76-499b-b5d3-56e7eebb189a" status: 200 len: 1437 microversion: 2.1 time: 0.873710 Aug 27 02:49:15.235438 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1004/1979] 10.222.0.70 () {58 vars in 1233 bytes} [Sat Aug 27 02:49:14 2022] GET /compute/v2.1/images/90bf1cec-6c76-499b-b5d3-56e7eebb189a => generated 1437 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:15.252167 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-dfa7dfc2-2fcb-4702-b822-330ad405ab50 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Calling method '.version_select at 0x7f5ede8e9c10>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:15.253451 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9adbe882-866c-4f74-9db1-3f976cb93d05 tempest-MigrationsAdminTest-1330282624 tempest-MigrationsAdminTest-1330282624-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:15.254271 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-9adbe882-866c-4f74-9db1-3f976cb93d05 tempest-MigrationsAdminTest-1330282624 tempest-MigrationsAdminTest-1330282624-project-admin] [instance: 60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:15.275249 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9adbe882-866c-4f74-9db1-3f976cb93d05 tempest-MigrationsAdminTest-1330282624 tempest-MigrationsAdminTest-1330282624-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:15.276900 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9adbe882-866c-4f74-9db1-3f976cb93d05 tempest-MigrationsAdminTest-1330282624 tempest-MigrationsAdminTest-1330282624-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:15.277798 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9adbe882-866c-4f74-9db1-3f976cb93d05 tempest-MigrationsAdminTest-1330282624 tempest-MigrationsAdminTest-1330282624-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:15.279234 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9adbe882-866c-4f74-9db1-3f976cb93d05 tempest-MigrationsAdminTest-1330282624 tempest-MigrationsAdminTest-1330282624-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:15.281154 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9adbe882-866c-4f74-9db1-3f976cb93d05 tempest-MigrationsAdminTest-1330282624 tempest-MigrationsAdminTest-1330282624-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:15.282206 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9adbe882-866c-4f74-9db1-3f976cb93d05 tempest-MigrationsAdminTest-1330282624 tempest-MigrationsAdminTest-1330282624-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:15.409672 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-dfa7dfc2-2fcb-4702-b822-330ad405ab50 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] 10.222.0.70 "GET /compute/v2.1/images/f6ba65b6-f90b-4da7-ad83-73a1ced207b6" status: 200 len: 1455 microversion: 2.1 time: 0.209492 Aug 27 02:49:15.410257 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 976/1980] 10.222.0.70 () {58 vars in 1233 bytes} [Sat Aug 27 02:49:15 2022] GET /compute/v2.1/images/f6ba65b6-f90b-4da7-ad83-73a1ced207b6 => generated 1455 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:15.433682 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b3604f39-b9ce-4345-b977-4a899b2a627d tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:15.434309 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b3604f39-b9ce-4345-b977-4a899b2a627d tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] [instance: 4b88e24d-509c-49fe-b5e2-b2698620d6d6] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:15.470923 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b3604f39-b9ce-4345-b977-4a899b2a627d tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:15.477939 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b3604f39-b9ce-4345-b977-4a899b2a627d tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:15.478399 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b3604f39-b9ce-4345-b977-4a899b2a627d tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:15.489735 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b3604f39-b9ce-4345-b977-4a899b2a627d tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:15.490248 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b3604f39-b9ce-4345-b977-4a899b2a627d tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:15.490687 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b3604f39-b9ce-4345-b977-4a899b2a627d tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:16.517161 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9adbe882-866c-4f74-9db1-3f976cb93d05 tempest-MigrationsAdminTest-1330282624 tempest-MigrationsAdminTest-1330282624-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4" status: 200 len: 1613 microversion: 2.1 time: 1.274173 Aug 27 02:49:16.522912 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1005/1981] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:15 2022] GET /compute/v2.1/servers/60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4 => generated 1613 bytes in 1287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:16.554001 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-57cbc1f5-6455-4675-bf59-688245a11747 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:16.555833 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-57cbc1f5-6455-4675-bf59-688245a11747 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] [instance: e445cdc5-5ecb-487c-adee-f5cb9862283c] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:16.567779 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-57cbc1f5-6455-4675-bf59-688245a11747 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:16.568900 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-57cbc1f5-6455-4675-bf59-688245a11747 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:16.569735 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-57cbc1f5-6455-4675-bf59-688245a11747 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:16.571120 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-57cbc1f5-6455-4675-bf59-688245a11747 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:16.573651 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-57cbc1f5-6455-4675-bf59-688245a11747 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:16.574340 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-57cbc1f5-6455-4675-bf59-688245a11747 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:16.620717 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-b3604f39-b9ce-4345-b977-4a899b2a627d tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073966022576475b983af066d7edb099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96abd4aa8efa4761869dabdd1f143519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:16.633591 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b3604f39-b9ce-4345-b977-4a899b2a627d tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] 10.222.0.70 "GET /compute/v2.1/servers/4b88e24d-509c-49fe-b5e2-b2698620d6d6" status: 200 len: 1466 microversion: 2.1 time: 1.222252 Aug 27 02:49:16.642400 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 977/1982] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:15 2022] GET /compute/v2.1/servers/4b88e24d-509c-49fe-b5e2-b2698620d6d6 => generated 1466 bytes in 1231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:16.895122 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ca89ff94-229c-409d-bcc1-46c11df32f11 tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Action: 'create', calling method: .version_select at 0x7f5edeb75280>, body: {"keypair": {"name": "tempest-keypair-43036546", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBfpcVhzySG2dfHcZD98A95MKFw4kQnrCoU2BeJKz41IiNu1wku9NmYmCvPhmwN8lcgvcne62qL4Mmhn/UzZ39heHASm61jvqnprsrvgMeFEFXEeBP9qQj9idr39OktKUg=="}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:49:16.940034 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-ca89ff94-229c-409d-bcc1-46c11df32f11 tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Getting quotas for project 76872eddea474d77850d528d56120b3d. Resources: {'key_pairs'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:49:16.947648 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-ca89ff94-229c-409d-bcc1-46c11df32f11 tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Getting quotas for user 70c5ce6f32ec4c979dda7ead8962a1fe and project 76872eddea474d77850d528d56120b3d. Resources: {'key_pairs'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:49:17.018022 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ca89ff94-229c-409d-bcc1-46c11df32f11 tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.374129 Aug 27 02:49:17.019432 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 978/1983] 10.222.0.70 () {60 vars in 1159 bytes} [Sat Aug 27 02:49:16 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:49:17.031163 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-57cbc1f5-6455-4675-bf59-688245a11747 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66c0fc8492654e6e85a90ce04736c055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f9be56fbeb64cb08b9be4e3d7436782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:17.040904 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-9a49eb73-c5e4-48d6-8841-449d4885b232 req-c1c1f55b-2cca-49e2-ac17-c1ef764bf4ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "191df585-2175-47be-9bd8-29b914535f47", "name": "network-vif-plugged", "status": "completed", "tag": "178a305e-f6ec-4889-9602-1513853a515b"}, {"server_uuid": "60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4", "name": "network-vif-plugged", "status": "completed", "tag": "f88818f1-ef30-4d4a-9180-9bdfc399cfe1"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:49:17.049068 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-57cbc1f5-6455-4675-bf59-688245a11747 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] 10.222.0.70 "GET /compute/v2.1/servers/e445cdc5-5ecb-487c-adee-f5cb9862283c" status: 200 len: 1519 microversion: 2.1 time: 0.510890 Aug 27 02:49:17.058999 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-9a49eb73-c5e4-48d6-8841-449d4885b232 req-c1c1f55b-2cca-49e2-ac17-c1ef764bf4ef service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:17.059749 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-9a49eb73-c5e4-48d6-8841-449d4885b232 req-c1c1f55b-2cca-49e2-ac17-c1ef764bf4ef service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:17.060618 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-9a49eb73-c5e4-48d6-8841-449d4885b232 req-c1c1f55b-2cca-49e2-ac17-c1ef764bf4ef service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:17.071717 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1006/1984] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:16 2022] GET /compute/v2.1/servers/e445cdc5-5ecb-487c-adee-f5cb9862283c => generated 1519 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:17.084967 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-33f7c43a-988d-4cce-ac80-a7fbee1642f1 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Calling method '.version_select at 0x7f5ee7219700>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:17.094098 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-9a49eb73-c5e4-48d6-8841-449d4885b232 req-c1c1f55b-2cca-49e2-ac17-c1ef764bf4ef service nova] Creating event network-vif-plugged:178a305e-f6ec-4889-9602-1513853a515b for instance 191df585-2175-47be-9bd8-29b914535f47 on n-h2-852278-4 Aug 27 02:49:17.094963 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-9a49eb73-c5e4-48d6-8841-449d4885b232 req-c1c1f55b-2cca-49e2-ac17-c1ef764bf4ef service nova] Creating event network-vif-plugged:f88818f1-ef30-4d4a-9180-9bdfc399cfe1 for instance 60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4 on n-h2-852278-4 Aug 27 02:49:17.107967 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-9a49eb73-c5e4-48d6-8841-449d4885b232 req-c1c1f55b-2cca-49e2-ac17-c1ef764bf4ef service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.086815 Aug 27 02:49:17.111206 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 979/1985] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:49:17 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:49:17.126616 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-626b7958-3377-4f27-91c9-0432afffaaf6 tempest-MigrationsAdminTest-1330282624 tempest-MigrationsAdminTest-1330282624-project-admin] Calling method '.version_select at 0x7f5ee71c7dc0>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:17.140650 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-626b7958-3377-4f27-91c9-0432afffaaf6 tempest-MigrationsAdminTest-1330282624 tempest-MigrationsAdminTest-1330282624-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:17.146674 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-626b7958-3377-4f27-91c9-0432afffaaf6 tempest-MigrationsAdminTest-1330282624 tempest-MigrationsAdminTest-1330282624-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:17.155288 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-33f7c43a-988d-4cce-ac80-a7fbee1642f1 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] 10.222.0.70 "GET /compute/v2.1/images/f6ba65b6-f90b-4da7-ad83-73a1ced207b6" status: 200 len: 1455 microversion: 2.1 time: 0.079613 Aug 27 02:49:17.157046 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-626b7958-3377-4f27-91c9-0432afffaaf6 tempest-MigrationsAdminTest-1330282624 tempest-MigrationsAdminTest-1330282624-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:17.157700 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1007/1986] 10.222.0.70 () {58 vars in 1233 bytes} [Sat Aug 27 02:49:17 2022] GET /compute/v2.1/images/f6ba65b6-f90b-4da7-ad83-73a1ced207b6 => generated 1455 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:17.168998 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-34ae3d2e-9ddf-43be-9d52-25fcc11e3263 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Calling method '.version_select at 0x7f5ee71cb040>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:17.177133 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-626b7958-3377-4f27-91c9-0432afffaaf6 tempest-MigrationsAdminTest-1330282624 tempest-MigrationsAdminTest-1330282624-project-admin] 10.222.0.70 "GET /compute/v2.1/os-migrations" status: 200 len: 409 microversion: 2.1 time: 0.063147 Aug 27 02:49:17.178303 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 980/1987] 10.222.0.70 () {58 vars in 1143 bytes} [Sat Aug 27 02:49:17 2022] GET /compute/v2.1/os-migrations => generated 409 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:49:17.184771 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-9e065da5-a655-4546-a823-f2170e3c4208 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Action: 'create', calling method: .version_select at 0x7f5ee720e5e0>, body: {"pool": null} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:49:18.744431 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-34ae3d2e-9ddf-43be-9d52-25fcc11e3263 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] 10.222.0.70 "DELETE /compute/v2.1/images/90bf1cec-6c76-499b-b5d3-56e7eebb189a" status: 204 len: 0 microversion: 2.1 time: 1.584347 Aug 27 02:49:18.745016 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1008/1988] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:17 2022] DELETE /compute/v2.1/images/90bf1cec-6c76-499b-b5d3-56e7eebb189a => generated 0 bytes in 1586 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:49:18.750427 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f47f9080-e116-4b5d-a30b-c4723d2ac9a9 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-59970692", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:49:18.866694 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.network.neutron [None req-f47f9080-e116-4b5d-a30b-c4723d2ac9a9 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] validate_networks() for None {{(pid=134052) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:49:19.182829 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-f47f9080-e116-4b5d-a30b-c4723d2ac9a9 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Flavor limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:49:19.183950 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-f47f9080-e116-4b5d-a30b-c4723d2ac9a9 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Image limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:49:19.184714 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-f47f9080-e116-4b5d-a30b-c4723d2ac9a9 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Flavor pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:49:19.185984 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-f47f9080-e116-4b5d-a30b-c4723d2ac9a9 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Image pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:49:19.186980 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-f47f9080-e116-4b5d-a30b-c4723d2ac9a9 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:49:19.214523 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f47f9080-e116-4b5d-a30b-c4723d2ac9a9 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:19.215117 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f47f9080-e116-4b5d-a30b-c4723d2ac9a9 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:19.215564 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f47f9080-e116-4b5d-a30b-c4723d2ac9a9 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:19.216430 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f47f9080-e116-4b5d-a30b-c4723d2ac9a9 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:19.216900 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f47f9080-e116-4b5d-a30b-c4723d2ac9a9 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:19.217332 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f47f9080-e116-4b5d-a30b-c4723d2ac9a9 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:19.266433 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-f47f9080-e116-4b5d-a30b-c4723d2ac9a9 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Getting quotas for project 937a5eeccaa7425ca72c8c74fb99f11a. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:49:19.275928 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-f47f9080-e116-4b5d-a30b-c4723d2ac9a9 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Getting quotas for user 0b310e73ecd244d2938812d5be99558c and project 937a5eeccaa7425ca72c8c74fb99f11a. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:49:19.311207 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-f47f9080-e116-4b5d-a30b-c4723d2ac9a9 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Going to run 1 instances... {{(pid=134052) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:49:19.313593 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-f47f9080-e116-4b5d-a30b-c4723d2ac9a9 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: cac17f47-6e08-4f15-a8cf-f5e44ad03d12] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134052) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:49:19.408990 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f47f9080-e116-4b5d-a30b-c4723d2ac9a9 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.662513 Aug 27 02:49:19.410321 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1009/1989] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 02:49:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 665 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:49:19.416124 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e9249a61-9139-4d55-8278-078b7968de6d tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Calling method '.version_select at 0x7f5ee7273c10>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:19.489042 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e9249a61-9139-4d55-8278-078b7968de6d tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] 10.222.0.70 "GET /compute/v2.1/images/f6ba65b6-f90b-4da7-ad83-73a1ced207b6" status: 200 len: 1464 microversion: 2.1 time: 0.077452 Aug 27 02:49:19.499280 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1010/1990] 10.222.0.70 () {58 vars in 1233 bytes} [Sat Aug 27 02:49:19 2022] GET /compute/v2.1/images/f6ba65b6-f90b-4da7-ad83-73a1ced207b6 => generated 1464 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:19.505396 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4de166a5-85dc-45fe-a8ed-7f3d7992e405 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Calling method '.version_select at 0x7f5ee7273f70>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:19.530363 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-4de166a5-85dc-45fe-a8ed-7f3d7992e405 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] HTTP exception thrown: Image not found. Aug 27 02:49:19.532270 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4de166a5-85dc-45fe-a8ed-7f3d7992e405 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Request method failure captured: Aug 27 02:49:19.532270 n-d-852278-4 devstack@n-api.service[134052]: request: DELETE /compute/v2.1/images/0ae12db3-6535-4c53-9cf0-6bb5faaa4513 HTTP/1.1 Aug 27 02:49:19.532270 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:49:19.532270 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:49:19.532270 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:49:19.532270 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:49:19.532270 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:49:19.532270 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:49:19.532270 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:49:19.532270 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:49:19.532270 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYXZs-aTjsu4dY2E35LFceONR468LXHet3JtaDk1jSLn7rlxv4ubACwdgzqFGJNx7r3z2yEOrBfDvKz6anHMyAL6AxveCSa11c6B73g-MhO_wzr9ufRmG_ezWmVTPygmsfGqmZp4-Uwb1Qw0Hv-s1as83SFwjue3xIbxxPf-vwgjzhI Aug 27 02:49:19.532270 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:49:19.532270 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:49:19.532270 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:49:19.532270 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:49:19.532270 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:49:19.532270 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:49:19.532270 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 96abd4aa8efa4761869dabdd1f143519 Aug 27 02:49:19.532270 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ImagesOneServerTestJSON-1611362133 Aug 27 02:49:19.532270 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:49:19.532270 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:49:19.532270 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/96abd4aa8efa4761869dabdd1f143519"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_96abd4aa8efa4761869dabdd1f143519", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/96abd4aa8efa4761869dabdd1f143519"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/96abd4aa8efa4761869dabdd1f143519"}]}] Aug 27 02:49:19.532270 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ImagesOneServerTestJSON-1611362133 Aug 27 02:49:19.532270 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 96abd4aa8efa4761869dabdd1f143519 Aug 27 02:49:19.532270 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1611362133 Aug 27 02:49:19.532270 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ImagesOneServerTestJSON-1611362133-project Aug 27 02:49:19.532270 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:49:19.532270 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:49:19.532270 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 073966022576475b983af066d7edb099 Aug 27 02:49:19.532270 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ImagesOneServerTestJSON-1611362133-project Aug 27 02:49:19.532270 n-d-852278-4 devstack@n-api.service[134052]: method: Aug 27 02:49:19.532270 n-d-852278-4 devstack@n-api.service[134052]: exception: Image not found. Aug 27 02:49:19.532270 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '0ae12db3-6535-4c53-9cf0-6bb5faaa4513'} Aug 27 02:49:19.532270 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:49:19.532270 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:19.532270 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 27 02:49:19.532270 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 27 02:49:19.532270 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 02:49:19.532270 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 02:49:19.532270 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 02:49:19.532270 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 02:49:19.532270 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 27 02:49:19.532270 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 27 02:49:19.532270 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 27 02:49:19.532270 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 27 02:49:19.532270 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 02:49:19.532270 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 02:49:19.532270 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 02:49:19.532270 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 02:49:19.532270 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 0ae12db3-6535-4c53-9cf0-6bb5faaa4513 to delete Aug 27 02:49:19.532270 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:49:19.532270 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:49:19.532270 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:49:19.532270 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:19.532270 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 27 02:49:19.532270 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 27 02:49:19.532270 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 27 02:49:19.532270 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 27 02:49:19.532270 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 27 02:49:19.532270 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 27 02:49:19.532270 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 0ae12db3-6535-4c53-9cf0-6bb5faaa4513 could not be found. Aug 27 02:49:19.532270 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:49:19.532270 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:49:19.532270 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:49:19.532270 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:19.536954 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:49:19.536954 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:49:19.536954 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:49:19.536954 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:49:19.536954 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:49:19.536954 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:49:19.536954 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:49:19.536954 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:49:19.536954 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 27 02:49:19.536954 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 27 02:49:19.536954 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 02:49:19.536954 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:49:19.536954 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:49:19.536954 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:49:19.536954 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:19.536954 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:49:19.536954 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:49:19.536954 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:49:19.536954 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:49:19.536954 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 02:49:19.536954 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:49:19.539297 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4de166a5-85dc-45fe-a8ed-7f3d7992e405 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Returning 404 to user: Image not found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:49:19.539297 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-4de166a5-85dc-45fe-a8ed-7f3d7992e405 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] 10.222.0.70 "DELETE /compute/v2.1/images/0ae12db3-6535-4c53-9cf0-6bb5faaa4513" status: 404 len: 62 microversion: 2.1 time: 0.037041 Aug 27 02:49:19.540744 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1011/1991] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:19 2022] DELETE /compute/v2.1/images/0ae12db3-6535-4c53-9cf0-6bb5faaa4513 => generated 62 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 02:49:19.545624 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-d271ebdf-109d-443d-933f-d1f75909b6d7 req-e4f1b8c1-64d0-4790-9f01-7627e4d4a243 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b88e24d-509c-49fe-b5e2-b2698620d6d6", "name": "network-vif-unplugged", "status": "completed", "tag": "8e5488cf-e7f9-42ad-b395-21ba7264782d"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:49:19.561702 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-d271ebdf-109d-443d-933f-d1f75909b6d7 req-e4f1b8c1-64d0-4790-9f01-7627e4d4a243 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:19.563663 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-d271ebdf-109d-443d-933f-d1f75909b6d7 req-e4f1b8c1-64d0-4790-9f01-7627e4d4a243 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:19.564827 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-d271ebdf-109d-443d-933f-d1f75909b6d7 req-e4f1b8c1-64d0-4790-9f01-7627e4d4a243 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:19.590089 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-d271ebdf-109d-443d-933f-d1f75909b6d7 req-e4f1b8c1-64d0-4790-9f01-7627e4d4a243 service nova] Creating event network-vif-unplugged:8e5488cf-e7f9-42ad-b395-21ba7264782d for instance 4b88e24d-509c-49fe-b5e2-b2698620d6d6 on n-h1-852278-4 Aug 27 02:49:19.601134 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-d271ebdf-109d-443d-933f-d1f75909b6d7 req-e4f1b8c1-64d0-4790-9f01-7627e4d4a243 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.058974 Aug 27 02:49:19.605883 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1012/1992] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:49:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:49:19.619410 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5c03a915-74d4-45ab-bef3-820de851b372 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:19.620192 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-5c03a915-74d4-45ab-bef3-820de851b372 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: cac17f47-6e08-4f15-a8cf-f5e44ad03d12] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:19.782679 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-5c03a915-74d4-45ab-bef3-820de851b372 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:19.792277 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-5c03a915-74d4-45ab-bef3-820de851b372 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/cac17f47-6e08-4f15-a8cf-f5e44ad03d12" status: 200 len: 1211 microversion: 2.1 time: 0.181285 Aug 27 02:49:19.799151 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1013/1993] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:19 2022] GET /compute/v2.1/servers/cac17f47-6e08-4f15-a8cf-f5e44ad03d12 => generated 1211 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:19.808476 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-dfd06986-f6df-4373-986e-f9f4da107afd tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Calling method '.version_select at 0x7f5ee34d2820>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:19.913850 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-dfd06986-f6df-4373-986e-f9f4da107afd tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] 10.222.0.70 "GET /compute/v2.1/images/f6ba65b6-f90b-4da7-ad83-73a1ced207b6" status: 200 len: 1464 microversion: 2.1 time: 0.109283 Aug 27 02:49:19.914764 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1014/1994] 10.222.0.70 () {58 vars in 1233 bytes} [Sat Aug 27 02:49:19 2022] GET /compute/v2.1/images/f6ba65b6-f90b-4da7-ad83-73a1ced207b6 => generated 1464 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:19.935680 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d549a73b-df97-47ef-9d02-a169153598fa tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:19.936515 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d549a73b-df97-47ef-9d02-a169153598fa tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] [instance: 4b88e24d-509c-49fe-b5e2-b2698620d6d6] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:19.944595 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d549a73b-df97-47ef-9d02-a169153598fa tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:19.945502 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d549a73b-df97-47ef-9d02-a169153598fa tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:19.946165 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d549a73b-df97-47ef-9d02-a169153598fa tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:19.947135 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d549a73b-df97-47ef-9d02-a169153598fa tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:19.947871 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d549a73b-df97-47ef-9d02-a169153598fa tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:19.949241 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d549a73b-df97-47ef-9d02-a169153598fa tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:19.995435 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d549a73b-df97-47ef-9d02-a169153598fa tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] [instance: 4b88e24d-509c-49fe-b5e2-b2698620d6d6] Going to try to terminate instance {{(pid=134052) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:49:20.131341 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d549a73b-df97-47ef-9d02-a169153598fa tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] 10.222.0.70 "DELETE /compute/v2.1/servers/4b88e24d-509c-49fe-b5e2-b2698620d6d6" status: 204 len: 0 microversion: 2.1 time: 0.214717 Aug 27 02:49:20.132453 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1015/1995] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:49:19 2022] DELETE /compute/v2.1/servers/4b88e24d-509c-49fe-b5e2-b2698620d6d6 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:49:20.142516 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e5c177b3-31ea-4ad0-b3a7-820324997b77 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:20.144873 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-e5c177b3-31ea-4ad0-b3a7-820324997b77 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] [instance: 191df585-2175-47be-9bd8-29b914535f47] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:20.161439 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e5c177b3-31ea-4ad0-b3a7-820324997b77 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:20.163141 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e5c177b3-31ea-4ad0-b3a7-820324997b77 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:20.164283 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e5c177b3-31ea-4ad0-b3a7-820324997b77 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:20.165725 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e5c177b3-31ea-4ad0-b3a7-820324997b77 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:20.171206 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e5c177b3-31ea-4ad0-b3a7-820324997b77 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:20.172231 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e5c177b3-31ea-4ad0-b3a7-820324997b77 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:20.289327 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-9e065da5-a655-4546-a823-f2170e3c4208 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] 10.222.0.70 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.109593 Aug 27 02:49:20.289937 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 981/1996] 10.222.0.70 () {60 vars in 1170 bytes} [Sat Aug 27 02:49:17 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:49:20.295225 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-cb245878-e2d7-42e7-9080-1bd54f0fbddd tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:20.297619 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-cb245878-e2d7-42e7-9080-1bd54f0fbddd tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] [instance: 4b88e24d-509c-49fe-b5e2-b2698620d6d6] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:20.318966 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cb245878-e2d7-42e7-9080-1bd54f0fbddd tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:20.319777 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cb245878-e2d7-42e7-9080-1bd54f0fbddd tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:20.320398 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cb245878-e2d7-42e7-9080-1bd54f0fbddd tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:20.324704 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cb245878-e2d7-42e7-9080-1bd54f0fbddd tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:20.327513 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cb245878-e2d7-42e7-9080-1bd54f0fbddd tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:20.335087 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cb245878-e2d7-42e7-9080-1bd54f0fbddd tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:20.503284 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-e5c177b3-31ea-4ad0-b3a7-820324997b77 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d626281a9864fe7aed598d4be209137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ae1f9ee6b7e49849b68b3628b76766a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:20.512555 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e5c177b3-31ea-4ad0-b3a7-820324997b77 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] 10.222.0.70 "GET /compute/v2.1/servers/191df585-2175-47be-9bd8-29b914535f47" status: 200 len: 1467 microversion: 2.1 time: 0.378445 Aug 27 02:49:20.516437 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1016/1997] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:20 2022] GET /compute/v2.1/servers/191df585-2175-47be-9bd8-29b914535f47 => generated 1467 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:20.533041 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4f8d5f07-4604-4c38-a69d-7ddd6da91779 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-2025129627", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "networks": [{"uuid": "56c1e6e5-f638-4015-aee9-61020b017eac"}]}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:49:20.608497 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-cb245878-e2d7-42e7-9080-1bd54f0fbddd tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073966022576475b983af066d7edb099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96abd4aa8efa4761869dabdd1f143519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:20.621935 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-cb245878-e2d7-42e7-9080-1bd54f0fbddd tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] 10.222.0.70 "GET /compute/v2.1/servers/4b88e24d-509c-49fe-b5e2-b2698620d6d6" status: 200 len: 1472 microversion: 2.1 time: 0.330878 Aug 27 02:49:20.625081 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 982/1998] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:20 2022] GET /compute/v2.1/servers/4b88e24d-509c-49fe-b5e2-b2698620d6d6 => generated 1472 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:20.632793 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-890e7f71-8c2d-4b98-a906-2858a49afa87 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Calling method '.version_select at 0x7f5ede8f74c0>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:20.662356 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.network.neutron [None req-4f8d5f07-4604-4c38-a69d-7ddd6da91779 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] validate_networks() for [('56c1e6e5-f638-4015-aee9-61020b017eac', None, None, None, None, None)] {{(pid=134052) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:49:20.770025 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-890e7f71-8c2d-4b98-a906-2858a49afa87 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] 10.222.0.70 "GET /compute/v2.1/images?changes-since=2022-08-27T02%3A47%3A24Z" status: 200 len: 1902 microversion: 2.1 time: 0.143435 Aug 27 02:49:20.771521 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 983/1999] 10.222.0.70 () {58 vars in 1199 bytes} [Sat Aug 27 02:49:20 2022] GET /compute/v2.1/images?changes-since=2022-08-27T02%3A47%3A24Z => generated 1902 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:20.787610 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-458fd471-b8cf-4b2d-b32b-c3d980a50a2d tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Calling method '.version_select at 0x7f5ee71c9a60>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:20.943223 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-458fd471-b8cf-4b2d-b32b-c3d980a50a2d tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] 10.222.0.70 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1818252507" status: 200 len: 485 microversion: 2.1 time: 0.160329 Aug 27 02:49:20.944359 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 984/2000] 10.222.0.70 () {58 vars in 1231 bytes} [Sat Aug 27 02:49:20 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1818252507 => generated 485 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:49:20.955774 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-96b42919-5f2f-4f32-a5a6-d7cb574febb1 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:20.956779 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-96b42919-5f2f-4f32-a5a6-d7cb574febb1 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: cac17f47-6e08-4f15-a8cf-f5e44ad03d12] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:20.963566 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-96b42919-5f2f-4f32-a5a6-d7cb574febb1 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:20.964363 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-96b42919-5f2f-4f32-a5a6-d7cb574febb1 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:20.965061 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-96b42919-5f2f-4f32-a5a6-d7cb574febb1 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:20.965965 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-96b42919-5f2f-4f32-a5a6-d7cb574febb1 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:20.966602 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-96b42919-5f2f-4f32-a5a6-d7cb574febb1 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:20.973113 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-96b42919-5f2f-4f32-a5a6-d7cb574febb1 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:21.072677 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-96b42919-5f2f-4f32-a5a6-d7cb574febb1 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:21.089655 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-96b42919-5f2f-4f32-a5a6-d7cb574febb1 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/cac17f47-6e08-4f15-a8cf-f5e44ad03d12" status: 200 len: 1215 microversion: 2.1 time: 0.143421 Aug 27 02:49:21.103967 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 985/2001] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:20 2022] GET /compute/v2.1/servers/cac17f47-6e08-4f15-a8cf-f5e44ad03d12 => generated 1215 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:21.111151 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-18a01f03-d55e-459f-bb72-0226dcd346ab tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Calling method '.version_select at 0x7f5ede936ee0>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:21.272405 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-18a01f03-d55e-459f-bb72-0226dcd346ab tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] 10.222.0.70 "GET /compute/v2.1/images?server=191df585-2175-47be-9bd8-29b914535f47" status: 200 len: 957 microversion: 2.1 time: 0.168060 Aug 27 02:49:21.274280 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 986/2002] 10.222.0.70 () {58 vars in 1209 bytes} [Sat Aug 27 02:49:21 2022] GET /compute/v2.1/images?server=191df585-2175-47be-9bd8-29b914535f47 => generated 957 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:49:21.288114 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ea98bf53-4c81-4a8b-83e1-0fa36dc33fc3 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Calling method '.version_select at 0x7f5ee71c6b80>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:21.412393 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ea98bf53-4c81-4a8b-83e1-0fa36dc33fc3 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] 10.222.0.70 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.70%2Fcompute%2Fv2.1%2Fservers%2F9d7f8c37-c4a6-400e-9a02-94f9040b780e" status: 200 len: 484 microversion: 2.1 time: 0.129331 Aug 27 02:49:21.414283 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 987/2003] 10.222.0.70 () {58 vars in 1317 bytes} [Sat Aug 27 02:49:21 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.70%2Fcompute%2Fv2.1%2Fservers%2F9d7f8c37-c4a6-400e-9a02-94f9040b780e => generated 484 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:49:21.428549 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c0084a2d-7af9-4cff-be95-1f3d282693ca tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Calling method '.version_select at 0x7f5ede8d99d0>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:21.502037 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c0084a2d-7af9-4cff-be95-1f3d282693ca tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] 10.222.0.70 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.70%2Fcompute%2Fservers%2F9d7f8c37-c4a6-400e-9a02-94f9040b780e" status: 200 len: 484 microversion: 2.1 time: 0.078431 Aug 27 02:49:21.503114 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 988/2004] 10.222.0.70 () {58 vars in 1303 bytes} [Sat Aug 27 02:49:21 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.70%2Fcompute%2Fservers%2F9d7f8c37-c4a6-400e-9a02-94f9040b780e => generated 484 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:49:21.517483 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f83b0044-9657-4f88-b59b-6f57183fb837 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Calling method '.version_select at 0x7f5ee71c6a60>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:21.582028 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-4f8d5f07-4604-4c38-a69d-7ddd6da91779 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Flavor limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:49:21.582613 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-4f8d5f07-4604-4c38-a69d-7ddd6da91779 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Image limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:49:21.582886 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-4f8d5f07-4604-4c38-a69d-7ddd6da91779 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Flavor pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:49:21.583467 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-4f8d5f07-4604-4c38-a69d-7ddd6da91779 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Image pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:49:21.583998 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-4f8d5f07-4604-4c38-a69d-7ddd6da91779 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:49:21.599112 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4f8d5f07-4604-4c38-a69d-7ddd6da91779 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:21.603326 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4f8d5f07-4604-4c38-a69d-7ddd6da91779 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:21.604044 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4f8d5f07-4604-4c38-a69d-7ddd6da91779 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:21.605008 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4f8d5f07-4604-4c38-a69d-7ddd6da91779 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:21.605628 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4f8d5f07-4604-4c38-a69d-7ddd6da91779 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:21.606201 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4f8d5f07-4604-4c38-a69d-7ddd6da91779 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:21.649185 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-4f8d5f07-4604-4c38-a69d-7ddd6da91779 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Getting quotas for project 4f9be56fbeb64cb08b9be4e3d7436782. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:49:21.659668 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-4f8d5f07-4604-4c38-a69d-7ddd6da91779 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Getting quotas for user 66c0fc8492654e6e85a90ce04736c055 and project 4f9be56fbeb64cb08b9be4e3d7436782. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:49:21.698378 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-4f8d5f07-4604-4c38-a69d-7ddd6da91779 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Going to run 1 instances... {{(pid=134052) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:49:21.700974 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-4f8d5f07-4604-4c38-a69d-7ddd6da91779 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] [instance: 26795af5-99b8-4a26-9843-3781a5016217] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134052) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:49:21.727943 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-f83b0044-9657-4f88-b59b-6f57183fb837 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] 10.222.0.70 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3281 microversion: 2.1 time: 0.212999 Aug 27 02:49:21.730034 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 989/2005] 10.222.0.70 () {58 vars in 1149 bytes} [Sat Aug 27 02:49:21 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3281 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:49:21.745622 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-cb49d10b-b406-4a3b-b9ce-1ed4625206ea tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:21.746916 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-cb49d10b-b406-4a3b-b9ce-1ed4625206ea tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] [instance: 4b88e24d-509c-49fe-b5e2-b2698620d6d6] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:21.758363 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cb49d10b-b406-4a3b-b9ce-1ed4625206ea tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:21.762591 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cb49d10b-b406-4a3b-b9ce-1ed4625206ea tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:21.763169 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cb49d10b-b406-4a3b-b9ce-1ed4625206ea tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:21.764180 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cb49d10b-b406-4a3b-b9ce-1ed4625206ea tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:21.765366 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cb49d10b-b406-4a3b-b9ce-1ed4625206ea tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:21.772950 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cb49d10b-b406-4a3b-b9ce-1ed4625206ea tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:21.781009 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-4f8d5f07-4604-4c38-a69d-7ddd6da91779 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.261269 Aug 27 02:49:21.790091 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1017/2006] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 02:49:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1271 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:49:21.796544 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ac58724c-6cdb-4343-bb22-c356884b6d30 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Calling method '.version_select at 0x7f5ee2ef7670>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:22.013808 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ac58724c-6cdb-4343-bb22-c356884b6d30 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] 10.222.0.70 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1429 microversion: 2.1 time: 0.221536 Aug 27 02:49:22.014416 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1018/2007] 10.222.0.70 () {58 vars in 1149 bytes} [Sat Aug 27 02:49:21 2022] GET /compute/v2.1/images?type=snapshot => generated 1429 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:22.044554 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c9d78964-64d3-4644-9133-d32d5e975b95 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:22.046335 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-c9d78964-64d3-4644-9133-d32d5e975b95 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] [instance: 26795af5-99b8-4a26-9843-3781a5016217] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:22.329663 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-c9d78964-64d3-4644-9133-d32d5e975b95 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66c0fc8492654e6e85a90ce04736c055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f9be56fbeb64cb08b9be4e3d7436782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:22.356953 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c9d78964-64d3-4644-9133-d32d5e975b95 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] 10.222.0.70 "GET /compute/v2.1/servers/26795af5-99b8-4a26-9843-3781a5016217" status: 200 len: 1224 microversion: 2.1 time: 0.327644 Aug 27 02:49:22.370354 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1019/2008] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:22 2022] GET /compute/v2.1/servers/26795af5-99b8-4a26-9843-3781a5016217 => generated 1224 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:22.375514 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-30c685fa-0a1e-433d-9124-08205ade758b tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Calling method '.version_select at 0x7f5ee724f040>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:22.519064 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-30c685fa-0a1e-433d-9124-08205ade758b tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] 10.222.0.70 "GET /compute/v2.1/images?limit=1" status: 200 len: 622 microversion: 2.1 time: 0.146233 Aug 27 02:49:22.524015 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1020/2009] 10.222.0.70 () {58 vars in 1137 bytes} [Sat Aug 27 02:49:22 2022] GET /compute/v2.1/images?limit=1 => generated 622 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:49:22.542918 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-53500dbd-a3d9-4da7-96f2-d01f6e64628d tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:22.544670 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-53500dbd-a3d9-4da7-96f2-d01f6e64628d tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: cac17f47-6e08-4f15-a8cf-f5e44ad03d12] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:22.554249 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-53500dbd-a3d9-4da7-96f2-d01f6e64628d tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:22.555448 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-53500dbd-a3d9-4da7-96f2-d01f6e64628d tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:22.556231 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-53500dbd-a3d9-4da7-96f2-d01f6e64628d tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:22.557538 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-53500dbd-a3d9-4da7-96f2-d01f6e64628d tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:22.558226 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-53500dbd-a3d9-4da7-96f2-d01f6e64628d tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:22.558852 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-53500dbd-a3d9-4da7-96f2-d01f6e64628d tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:22.627113 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-cb49d10b-b406-4a3b-b9ce-1ed4625206ea tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073966022576475b983af066d7edb099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96abd4aa8efa4761869dabdd1f143519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:22.641217 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-cb49d10b-b406-4a3b-b9ce-1ed4625206ea tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] 10.222.0.70 "GET /compute/v2.1/servers/4b88e24d-509c-49fe-b5e2-b2698620d6d6" status: 200 len: 1472 microversion: 2.1 time: 0.906217 Aug 27 02:49:22.642805 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 990/2010] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:21 2022] GET /compute/v2.1/servers/4b88e24d-509c-49fe-b5e2-b2698620d6d6 => generated 1472 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:22.654728 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-90b1b92c-1eea-4f6e-8cab-b2032a3f71c3 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Calling method '.version_select at 0x7f5ee732c430>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:22.790027 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-53500dbd-a3d9-4da7-96f2-d01f6e64628d tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:22.813385 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-53500dbd-a3d9-4da7-96f2-d01f6e64628d tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/cac17f47-6e08-4f15-a8cf-f5e44ad03d12" status: 200 len: 1263 microversion: 2.1 time: 0.275032 Aug 27 02:49:22.830733 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1021/2011] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:22 2022] GET /compute/v2.1/servers/cac17f47-6e08-4f15-a8cf-f5e44ad03d12 => generated 1263 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:22.857631 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-76dc2d6b-5d58-4389-bac1-f7f249d81eca tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "954e5996-f71a-4da3-b24c-01f281d2eb7e"}], "security_groups": [{"name": "tempest-securitygroup--2093128049"}], "key_name": "tempest-keypair-43036546", "user_data": "}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:49:22.965979 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-90b1b92c-1eea-4f6e-8cab-b2032a3f71c3 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] 10.222.0.70 "GET /compute/v2.1/images/detail?changes-since=2022-08-27T02%3A47%3A18Z" status: 200 len: 6334 microversion: 2.1 time: 0.322001 Aug 27 02:49:22.974622 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 991/2012] 10.222.0.70 () {58 vars in 1220 bytes} [Sat Aug 27 02:49:22 2022] GET /compute/v2.1/images/detail?changes-since=2022-08-27T02%3A47%3A18Z => generated 6334 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:22.994904 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-82d5282d-4f4a-4f65-89a2-445e333a5a9b tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Calling method '.version_select at 0x7f5ee71c4dc0>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:23.167373 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-82d5282d-4f4a-4f65-89a2-445e333a5a9b tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] 10.222.0.70 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1818252507" status: 200 len: 665 microversion: 2.1 time: 0.178094 Aug 27 02:49:23.168414 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 992/2013] 10.222.0.70 () {58 vars in 1252 bytes} [Sat Aug 27 02:49:22 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1818252507 => generated 665 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:49:23.193934 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-09083508-b11c-4de7-bf78-d2c6eadf0133 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Calling method '.version_select at 0x7f5ede97ac10>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:23.236220 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.network.neutron [None req-76dc2d6b-5d58-4389-bac1-f7f249d81eca tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] validate_networks() for [('954e5996-f71a-4da3-b24c-01f281d2eb7e', None, None, None, None, None)] {{(pid=134052) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:49:23.279658 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-09083508-b11c-4de7-bf78-d2c6eadf0133 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] 10.222.0.70 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.70%2Fcompute%2Fv2.1%2Fservers%2F9d7f8c37-c4a6-400e-9a02-94f9040b780e" status: 200 len: 1466 microversion: 2.1 time: 0.099496 Aug 27 02:49:23.280559 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 993/2014] 10.222.0.70 () {58 vars in 1338 bytes} [Sat Aug 27 02:49:23 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.70%2Fcompute%2Fv2.1%2Fservers%2F9d7f8c37-c4a6-400e-9a02-94f9040b780e => generated 1466 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:49:23.295922 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d42c330c-3f9a-4156-bdcf-f59b9e659310 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Calling method '.version_select at 0x7f5ee71c6790>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:23.382804 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d42c330c-3f9a-4156-bdcf-f59b9e659310 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] 10.222.0.70 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.70%2Fcompute%2Fservers%2F9d7f8c37-c4a6-400e-9a02-94f9040b780e" status: 200 len: 1466 microversion: 2.1 time: 0.091627 Aug 27 02:49:23.393651 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 994/2015] 10.222.0.70 () {58 vars in 1324 bytes} [Sat Aug 27 02:49:23 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.70%2Fcompute%2Fservers%2F9d7f8c37-c4a6-400e-9a02-94f9040b780e => generated 1466 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:23.407725 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-26ee3954-f5dd-4a5a-a8ee-57d95dcb21fb tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:23.407725 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-26ee3954-f5dd-4a5a-a8ee-57d95dcb21fb tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] [instance: 26795af5-99b8-4a26-9843-3781a5016217] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:23.429954 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-26ee3954-f5dd-4a5a-a8ee-57d95dcb21fb tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:23.435137 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-26ee3954-f5dd-4a5a-a8ee-57d95dcb21fb tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:23.435850 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-26ee3954-f5dd-4a5a-a8ee-57d95dcb21fb tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:23.437397 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-26ee3954-f5dd-4a5a-a8ee-57d95dcb21fb tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:23.440621 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-26ee3954-f5dd-4a5a-a8ee-57d95dcb21fb tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:23.441294 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-26ee3954-f5dd-4a5a-a8ee-57d95dcb21fb tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:24.063300 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-26ee3954-f5dd-4a5a-a8ee-57d95dcb21fb tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66c0fc8492654e6e85a90ce04736c055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f9be56fbeb64cb08b9be4e3d7436782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:24.081308 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-26ee3954-f5dd-4a5a-a8ee-57d95dcb21fb tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] 10.222.0.70 "GET /compute/v2.1/servers/26795af5-99b8-4a26-9843-3781a5016217" status: 200 len: 1276 microversion: 2.1 time: 0.693160 Aug 27 02:49:24.098888 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 995/2016] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:23 2022] GET /compute/v2.1/servers/26795af5-99b8-4a26-9843-3781a5016217 => generated 1276 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:24.107555 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-78dc6d3d-dd20-4200-955d-8c5ba91b7044 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Calling method '.version_select at 0x7f5ee732cca0>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:24.269824 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-78dc6d3d-dd20-4200-955d-8c5ba91b7044 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] 10.222.0.70 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7109 microversion: 2.1 time: 0.163005 Aug 27 02:49:24.271418 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 996/2017] 10.222.0.70 () {58 vars in 1170 bytes} [Sat Aug 27 02:49:24 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7109 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:24.283101 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-6a996727-eade-424c-ba46-70d6d2052da4 req-befef606-5cda-47be-8be2-4e8706f14212 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b88e24d-509c-49fe-b5e2-b2698620d6d6", "name": "network-vif-deleted", "tag": "8e5488cf-e7f9-42ad-b395-21ba7264782d"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:49:24.297513 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-6a996727-eade-424c-ba46-70d6d2052da4 req-befef606-5cda-47be-8be2-4e8706f14212 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:24.298071 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-6a996727-eade-424c-ba46-70d6d2052da4 req-befef606-5cda-47be-8be2-4e8706f14212 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:24.298762 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-6a996727-eade-424c-ba46-70d6d2052da4 req-befef606-5cda-47be-8be2-4e8706f14212 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:24.315612 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-6a996727-eade-424c-ba46-70d6d2052da4 req-befef606-5cda-47be-8be2-4e8706f14212 service nova] Creating event network-vif-deleted:8e5488cf-e7f9-42ad-b395-21ba7264782d for instance 4b88e24d-509c-49fe-b5e2-b2698620d6d6 on n-h1-852278-4 Aug 27 02:49:24.322932 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-6a996727-eade-424c-ba46-70d6d2052da4 req-befef606-5cda-47be-8be2-4e8706f14212 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046892 Aug 27 02:49:24.325034 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 997/2018] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:49:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:49:24.335159 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f80b127d-4d1a-42aa-98b3-64c714bc848a tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:24.336119 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-f80b127d-4d1a-42aa-98b3-64c714bc848a tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] [instance: 4b88e24d-509c-49fe-b5e2-b2698620d6d6] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:24.343381 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f80b127d-4d1a-42aa-98b3-64c714bc848a tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:24.344886 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f80b127d-4d1a-42aa-98b3-64c714bc848a tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:24.345750 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f80b127d-4d1a-42aa-98b3-64c714bc848a tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:24.346669 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f80b127d-4d1a-42aa-98b3-64c714bc848a tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:24.347394 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f80b127d-4d1a-42aa-98b3-64c714bc848a tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:24.347955 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f80b127d-4d1a-42aa-98b3-64c714bc848a tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:24.404519 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f80b127d-4d1a-42aa-98b3-64c714bc848a tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:24.405018 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f80b127d-4d1a-42aa-98b3-64c714bc848a tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:24.405465 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f80b127d-4d1a-42aa-98b3-64c714bc848a tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:24.406071 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.objects.instance [None req-f80b127d-4d1a-42aa-98b3-64c714bc848a tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Lazy-loading 'fault' on Instance uuid 4b88e24d-509c-49fe-b5e2-b2698620d6d6 {{(pid=134051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:49:24.648884 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-f80b127d-4d1a-42aa-98b3-64c714bc848a tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073966022576475b983af066d7edb099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96abd4aa8efa4761869dabdd1f143519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:24.659476 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-f80b127d-4d1a-42aa-98b3-64c714bc848a tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] 10.222.0.70 "GET /compute/v2.1/servers/4b88e24d-509c-49fe-b5e2-b2698620d6d6" status: 200 len: 1307 microversion: 2.1 time: 0.331125 Aug 27 02:49:24.690666 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 998/2019] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:24 2022] GET /compute/v2.1/servers/4b88e24d-509c-49fe-b5e2-b2698620d6d6 => generated 1307 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:24.705512 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-45b50a25-991d-4d24-898a-9c46a3838a82 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:24.706416 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-45b50a25-991d-4d24-898a-9c46a3838a82 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: cac17f47-6e08-4f15-a8cf-f5e44ad03d12] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:24.741130 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-45b50a25-991d-4d24-898a-9c46a3838a82 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:24.742937 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-45b50a25-991d-4d24-898a-9c46a3838a82 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:24.744830 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-45b50a25-991d-4d24-898a-9c46a3838a82 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:24.745797 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-45b50a25-991d-4d24-898a-9c46a3838a82 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:24.749778 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-45b50a25-991d-4d24-898a-9c46a3838a82 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:24.750579 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-45b50a25-991d-4d24-898a-9c46a3838a82 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:24.892371 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-45b50a25-991d-4d24-898a-9c46a3838a82 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:24.903923 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-45b50a25-991d-4d24-898a-9c46a3838a82 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/cac17f47-6e08-4f15-a8cf-f5e44ad03d12" status: 200 len: 1269 microversion: 2.1 time: 0.211368 Aug 27 02:49:24.905616 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 999/2020] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:24 2022] GET /compute/v2.1/servers/cac17f47-6e08-4f15-a8cf-f5e44ad03d12 => generated 1269 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:24.911686 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e4b00832-7bb3-4716-ab76-536135a7c5ef tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Calling method '.version_select at 0x7f5ee7225ca0>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:24.996497 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e4b00832-7bb3-4716-ab76-536135a7c5ef tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] 10.222.0.70 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4375 microversion: 2.1 time: 0.088775 Aug 27 02:49:24.997152 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1000/2021] 10.222.0.70 () {58 vars in 1170 bytes} [Sat Aug 27 02:49:24 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4375 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:25.006672 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-9ac563ff-8ee1-4d42-a631-6c592c812287 req-9de209ac-7fcd-4d00-88a7-b0dcd0540ec5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "191df585-2175-47be-9bd8-29b914535f47", "name": "network-vif-unplugged", "status": "completed", "tag": "178a305e-f6ec-4889-9602-1513853a515b"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:49:25.019075 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-9ac563ff-8ee1-4d42-a631-6c592c812287 req-9de209ac-7fcd-4d00-88a7-b0dcd0540ec5 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:25.019697 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-9ac563ff-8ee1-4d42-a631-6c592c812287 req-9de209ac-7fcd-4d00-88a7-b0dcd0540ec5 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:25.020210 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-9ac563ff-8ee1-4d42-a631-6c592c812287 req-9de209ac-7fcd-4d00-88a7-b0dcd0540ec5 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:25.031929 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-9ac563ff-8ee1-4d42-a631-6c592c812287 req-9de209ac-7fcd-4d00-88a7-b0dcd0540ec5 service nova] Creating event network-vif-unplugged:178a305e-f6ec-4889-9602-1513853a515b for instance 191df585-2175-47be-9bd8-29b914535f47 on n-h2-852278-4 Aug 27 02:49:25.037565 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-9ac563ff-8ee1-4d42-a631-6c592c812287 req-9de209ac-7fcd-4d00-88a7-b0dcd0540ec5 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039034 Aug 27 02:49:25.038179 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1001/2022] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:49:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:49:25.047726 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4efea243-6013-474a-93fa-57c111685bf2 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Calling method '.version_select at 0x7f5ee7225820>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:25.095011 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-4efea243-6013-474a-93fa-57c111685bf2 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] 10.222.0.70 "GET /compute/v2.1/images/1552acd0-176a-4c81-b680-29d74105e9d6" status: 200 len: 784 microversion: 2.1 time: 0.052039 Aug 27 02:49:25.095771 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1002/2023] 10.222.0.70 () {58 vars in 1233 bytes} [Sat Aug 27 02:49:25 2022] GET /compute/v2.1/images/1552acd0-176a-4c81-b680-29d74105e9d6 => generated 784 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:49:25.106834 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d7637419-045d-4d38-9d4b-d871771fdeb6 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:25.107819 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d7637419-045d-4d38-9d4b-d871771fdeb6 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] [instance: 26795af5-99b8-4a26-9843-3781a5016217] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:25.115014 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d7637419-045d-4d38-9d4b-d871771fdeb6 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:25.115744 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d7637419-045d-4d38-9d4b-d871771fdeb6 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:25.116405 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d7637419-045d-4d38-9d4b-d871771fdeb6 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:25.117433 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d7637419-045d-4d38-9d4b-d871771fdeb6 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:25.118110 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d7637419-045d-4d38-9d4b-d871771fdeb6 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:25.118732 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d7637419-045d-4d38-9d4b-d871771fdeb6 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:25.768753 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-76dc2d6b-5d58-4389-bac1-f7f249d81eca tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Flavor limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:49:25.769226 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-76dc2d6b-5d58-4389-bac1-f7f249d81eca tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Image limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:49:25.769626 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-76dc2d6b-5d58-4389-bac1-f7f249d81eca tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Flavor pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:49:25.770024 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-76dc2d6b-5d58-4389-bac1-f7f249d81eca tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Image pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:49:25.770604 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-76dc2d6b-5d58-4389-bac1-f7f249d81eca tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:49:25.781750 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d7637419-045d-4d38-9d4b-d871771fdeb6 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66c0fc8492654e6e85a90ce04736c055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f9be56fbeb64cb08b9be4e3d7436782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:25.792807 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-76dc2d6b-5d58-4389-bac1-f7f249d81eca tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:25.793176 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-76dc2d6b-5d58-4389-bac1-f7f249d81eca tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:25.793611 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-76dc2d6b-5d58-4389-bac1-f7f249d81eca tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:25.794929 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-76dc2d6b-5d58-4389-bac1-f7f249d81eca tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:25.795384 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-76dc2d6b-5d58-4389-bac1-f7f249d81eca tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:25.795803 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-76dc2d6b-5d58-4389-bac1-f7f249d81eca tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:25.822608 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d7637419-045d-4d38-9d4b-d871771fdeb6 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] 10.222.0.70 "GET /compute/v2.1/servers/26795af5-99b8-4a26-9843-3781a5016217" status: 200 len: 1324 microversion: 2.1 time: 0.710647 Aug 27 02:49:25.840029 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-76dc2d6b-5d58-4389-bac1-f7f249d81eca tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Getting quotas for project 76872eddea474d77850d528d56120b3d. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:49:25.844469 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1003/2024] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:25 2022] GET /compute/v2.1/servers/26795af5-99b8-4a26-9843-3781a5016217 => generated 1324 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:25.848936 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-76dc2d6b-5d58-4389-bac1-f7f249d81eca tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Getting quotas for user 70c5ce6f32ec4c979dda7ead8962a1fe and project 76872eddea474d77850d528d56120b3d. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:49:25.884290 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-76dc2d6b-5d58-4389-bac1-f7f249d81eca tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Going to run 1 instances... {{(pid=134052) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:49:25.886560 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-76dc2d6b-5d58-4389-bac1-f7f249d81eca tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] [instance: 14df3dce-7fb6-491c-9559-6fbca68580b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134052) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:49:25.888724 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-2444fb47-e286-4963-bd67-de4955dcd614 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Calling method '.version_select at 0x7f5ee7225dc0>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:25.961754 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-2444fb47-e286-4963-bd67-de4955dcd614 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] 10.222.0.70 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1611 microversion: 2.1 time: 0.111540 Aug 27 02:49:25.962542 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1004/2025] 10.222.0.70 () {58 vars in 1158 bytes} [Sat Aug 27 02:49:25 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1611 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:25.982478 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-fd416c76-8bd1-49d9-9c7d-01013ddd76a1 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:25.983044 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-fd416c76-8bd1-49d9-9c7d-01013ddd76a1 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] [instance: 4b88e24d-509c-49fe-b5e2-b2698620d6d6] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:25.998074 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-76dc2d6b-5d58-4389-bac1-f7f249d81eca tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 3.165992 Aug 27 02:49:25.999182 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1022/2026] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 02:49:22 2022] POST /compute/v2.1/servers => generated 409 bytes in 3168 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:49:26.004652 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-cc5f832d-a87a-4e6d-b674-51bf365afe5b tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:26.005539 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-cc5f832d-a87a-4e6d-b674-51bf365afe5b tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: cac17f47-6e08-4f15-a8cf-f5e44ad03d12] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:26.012809 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cc5f832d-a87a-4e6d-b674-51bf365afe5b tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:26.013755 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cc5f832d-a87a-4e6d-b674-51bf365afe5b tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:26.014364 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cc5f832d-a87a-4e6d-b674-51bf365afe5b tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:26.015147 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fd416c76-8bd1-49d9-9c7d-01013ddd76a1 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:26.015490 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cc5f832d-a87a-4e6d-b674-51bf365afe5b tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:26.016026 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fd416c76-8bd1-49d9-9c7d-01013ddd76a1 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:26.016527 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cc5f832d-a87a-4e6d-b674-51bf365afe5b tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:26.017152 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cc5f832d-a87a-4e6d-b674-51bf365afe5b tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:26.017474 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fd416c76-8bd1-49d9-9c7d-01013ddd76a1 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:26.018207 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fd416c76-8bd1-49d9-9c7d-01013ddd76a1 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:26.018719 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fd416c76-8bd1-49d9-9c7d-01013ddd76a1 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:26.019131 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fd416c76-8bd1-49d9-9c7d-01013ddd76a1 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:26.063069 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-fd416c76-8bd1-49d9-9c7d-01013ddd76a1 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] HTTP exception thrown: Instance 4b88e24d-509c-49fe-b5e2-b2698620d6d6 could not be found. Aug 27 02:49:26.076063 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-fd416c76-8bd1-49d9-9c7d-01013ddd76a1 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Request method failure captured: Aug 27 02:49:26.076063 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/4b88e24d-509c-49fe-b5e2-b2698620d6d6 HTTP/1.1 Aug 27 02:49:26.076063 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:49:26.076063 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:49:26.076063 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:49:26.076063 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:49:26.076063 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:49:26.076063 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:49:26.076063 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:49:26.076063 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:49:26.076063 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYXZs-aTjsu4dY2E35LFceONR468LXHet3JtaDk1jSLn7rlxv4ubACwdgzqFGJNx7r3z2yEOrBfDvKz6anHMyAL6AxveCSa11c6B73g-MhO_wzr9ufRmG_ezWmVTPygmsfGqmZp4-Uwb1Qw0Hv-s1as83SFwjue3xIbxxPf-vwgjzhI Aug 27 02:49:26.076063 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:49:26.076063 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:49:26.076063 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:49:26.076063 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:49:26.076063 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:49:26.076063 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:49:26.076063 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 96abd4aa8efa4761869dabdd1f143519 Aug 27 02:49:26.076063 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ImagesOneServerTestJSON-1611362133 Aug 27 02:49:26.076063 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:49:26.076063 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:49:26.076063 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/96abd4aa8efa4761869dabdd1f143519"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_96abd4aa8efa4761869dabdd1f143519", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/96abd4aa8efa4761869dabdd1f143519"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/96abd4aa8efa4761869dabdd1f143519"}]}] Aug 27 02:49:26.076063 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ImagesOneServerTestJSON-1611362133 Aug 27 02:49:26.076063 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 96abd4aa8efa4761869dabdd1f143519 Aug 27 02:49:26.076063 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1611362133 Aug 27 02:49:26.076063 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ImagesOneServerTestJSON-1611362133-project Aug 27 02:49:26.076063 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:49:26.076063 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:49:26.076063 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 073966022576475b983af066d7edb099 Aug 27 02:49:26.076063 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ImagesOneServerTestJSON-1611362133-project Aug 27 02:49:26.076063 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 02:49:26.076063 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance 4b88e24d-509c-49fe-b5e2-b2698620d6d6 could not be found. Aug 27 02:49:26.076063 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '4b88e24d-509c-49fe-b5e2-b2698620d6d6'} Aug 27 02:49:26.076063 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:49:26.076063 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:26.076063 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:49:26.076063 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:49:26.076063 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:49:26.076063 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:49:26.076063 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:49:26.076063 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:49:26.076063 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:49:26.076063 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:49:26.076063 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b88e24d-509c-49fe-b5e2-b2698620d6d6 could not be found. Aug 27 02:49:26.076063 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:49:26.076063 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:49:26.076063 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:49:26.076063 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:26.076063 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:49:26.076063 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:49:26.076063 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:49:26.076063 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:49:26.076063 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:49:26.076063 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:49:26.076063 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:49:26.076063 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:49:26.076063 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:49:26.076063 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:49:26.076063 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:49:26.076063 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:49:26.076063 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b88e24d-509c-49fe-b5e2-b2698620d6d6 could not be found. Aug 27 02:49:26.076063 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:49:26.076063 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:49:26.076063 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:49:26.080023 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:26.080023 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:49:26.080023 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:49:26.080023 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:49:26.080023 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:49:26.080023 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b88e24d-509c-49fe-b5e2-b2698620d6d6 could not be found. Aug 27 02:49:26.080023 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:49:26.082609 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-fd416c76-8bd1-49d9-9c7d-01013ddd76a1 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] Returning 404 to user: Instance 4b88e24d-509c-49fe-b5e2-b2698620d6d6 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:49:26.086118 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-fd416c76-8bd1-49d9-9c7d-01013ddd76a1 tempest-ImagesOneServerTestJSON-1611362133 tempest-ImagesOneServerTestJSON-1611362133-project] 10.222.0.70 "GET /compute/v2.1/servers/4b88e24d-509c-49fe-b5e2-b2698620d6d6" status: 404 len: 111 microversion: 2.1 time: 0.121135 Aug 27 02:49:26.089784 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1005/2027] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:25 2022] GET /compute/v2.1/servers/4b88e24d-509c-49fe-b5e2-b2698620d6d6 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:49:26.099433 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b10e18ba-adfc-4e2f-8d6f-4bde4bef9ddf tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Calling method '.version_select at 0x7f5ee720e280>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:26.232005 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-cc5f832d-a87a-4e6d-b674-51bf365afe5b tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:26.250160 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-cc5f832d-a87a-4e6d-b674-51bf365afe5b tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/cac17f47-6e08-4f15-a8cf-f5e44ad03d12" status: 200 len: 1269 microversion: 2.1 time: 0.247818 Aug 27 02:49:26.266101 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1023/2028] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:25 2022] GET /compute/v2.1/servers/cac17f47-6e08-4f15-a8cf-f5e44ad03d12 => generated 1269 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:26.275629 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-99a4370a-af3a-4118-a2fb-9fc5736e2a1b tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:26.276967 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-99a4370a-af3a-4118-a2fb-9fc5736e2a1b tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] [instance: 14df3dce-7fb6-491c-9559-6fbca68580b0] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:26.451550 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-99a4370a-af3a-4118-a2fb-9fc5736e2a1b tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c5ce6f32ec4c979dda7ead8962a1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76872eddea474d77850d528d56120b3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:26.459998 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-99a4370a-af3a-4118-a2fb-9fc5736e2a1b tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] 10.222.0.70 "GET /compute/v2.1/servers/14df3dce-7fb6-491c-9559-6fbca68580b0" status: 200 len: 1224 microversion: 2.1 time: 0.191526 Aug 27 02:49:26.462043 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1024/2029] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:26 2022] GET /compute/v2.1/servers/14df3dce-7fb6-491c-9559-6fbca68580b0 => generated 1224 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:26.472576 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-a86d7a55-d378-4d85-ae55-e325af2c3782 req-06a6e534-4238-457a-b894-74879cb5fab9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26795af5-99b8-4a26-9843-3781a5016217", "tag": "072e51fc-e3f0-46c0-b5a9-45f131439621"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:49:26.496371 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-a86d7a55-d378-4d85-ae55-e325af2c3782 req-06a6e534-4238-457a-b894-74879cb5fab9 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:26.498624 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-a86d7a55-d378-4d85-ae55-e325af2c3782 req-06a6e534-4238-457a-b894-74879cb5fab9 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:26.499134 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-a86d7a55-d378-4d85-ae55-e325af2c3782 req-06a6e534-4238-457a-b894-74879cb5fab9 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:26.525642 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-a86d7a55-d378-4d85-ae55-e325af2c3782 req-06a6e534-4238-457a-b894-74879cb5fab9 service nova] Creating event network-changed:072e51fc-e3f0-46c0-b5a9-45f131439621 for instance 26795af5-99b8-4a26-9843-3781a5016217 on n-h1-852278-4 Aug 27 02:49:26.537602 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-a86d7a55-d378-4d85-ae55-e325af2c3782 req-06a6e534-4238-457a-b894-74879cb5fab9 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071358 Aug 27 02:49:26.540931 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1025/2030] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:49:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:49:26.851470 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5a71720e-77af-43f1-8cf6-a5c573b722f6 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:26.853475 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-5a71720e-77af-43f1-8cf6-a5c573b722f6 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] [instance: 26795af5-99b8-4a26-9843-3781a5016217] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:26.881708 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5a71720e-77af-43f1-8cf6-a5c573b722f6 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:26.882911 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5a71720e-77af-43f1-8cf6-a5c573b722f6 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:26.883704 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5a71720e-77af-43f1-8cf6-a5c573b722f6 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:26.885490 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5a71720e-77af-43f1-8cf6-a5c573b722f6 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:26.893745 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5a71720e-77af-43f1-8cf6-a5c573b722f6 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:26.895131 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5a71720e-77af-43f1-8cf6-a5c573b722f6 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:26.956708 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=4 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:49:27.419453 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b10e18ba-adfc-4e2f-8d6f-4bde4bef9ddf tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] 10.222.0.70 "DELETE /compute/v2.1/images/f6ba65b6-f90b-4da7-ad83-73a1ced207b6" status: 204 len: 0 microversion: 2.1 time: 1.328063 Aug 27 02:49:27.420275 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1006/2031] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:26 2022] DELETE /compute/v2.1/images/f6ba65b6-f90b-4da7-ad83-73a1ced207b6 => generated 0 bytes in 1330 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:49:27.428124 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-aceb1661-8962-45e3-a57a-c4aa6270ae3d tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:27.428972 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-aceb1661-8962-45e3-a57a-c4aa6270ae3d tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: cac17f47-6e08-4f15-a8cf-f5e44ad03d12] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:27.438867 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-aceb1661-8962-45e3-a57a-c4aa6270ae3d tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:27.439622 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-aceb1661-8962-45e3-a57a-c4aa6270ae3d tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:27.440841 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-aceb1661-8962-45e3-a57a-c4aa6270ae3d tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:27.444417 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-aceb1661-8962-45e3-a57a-c4aa6270ae3d tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:27.450256 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-aceb1661-8962-45e3-a57a-c4aa6270ae3d tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:27.450836 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-aceb1661-8962-45e3-a57a-c4aa6270ae3d tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:27.594772 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-5a71720e-77af-43f1-8cf6-a5c573b722f6 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66c0fc8492654e6e85a90ce04736c055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f9be56fbeb64cb08b9be4e3d7436782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:27.611310 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-5a71720e-77af-43f1-8cf6-a5c573b722f6 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] 10.222.0.70 "GET /compute/v2.1/servers/26795af5-99b8-4a26-9843-3781a5016217" status: 200 len: 1324 microversion: 2.1 time: 0.764997 Aug 27 02:49:27.612949 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1026/2032] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:26 2022] GET /compute/v2.1/servers/26795af5-99b8-4a26-9843-3781a5016217 => generated 1324 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:27.620547 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-509cd618-326e-4ec2-bb16-bea66cc3d2f8 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Calling method '.version_select at 0x7f5ee35b35e0>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:27.860483 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-aceb1661-8962-45e3-a57a-c4aa6270ae3d tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:27.894735 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-aceb1661-8962-45e3-a57a-c4aa6270ae3d tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/cac17f47-6e08-4f15-a8cf-f5e44ad03d12" status: 200 len: 1311 microversion: 2.1 time: 0.472881 Aug 27 02:49:27.896804 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1007/2033] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:27 2022] GET /compute/v2.1/servers/cac17f47-6e08-4f15-a8cf-f5e44ad03d12 => generated 1311 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:27.913158 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8adf6a41-1e72-4b5a-b7ae-69eb4d3e1855 tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:27.914762 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-8adf6a41-1e72-4b5a-b7ae-69eb4d3e1855 tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] [instance: 14df3dce-7fb6-491c-9559-6fbca68580b0] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:27.927419 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8adf6a41-1e72-4b5a-b7ae-69eb4d3e1855 tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:27.929575 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8adf6a41-1e72-4b5a-b7ae-69eb4d3e1855 tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:27.932219 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8adf6a41-1e72-4b5a-b7ae-69eb4d3e1855 tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:27.934076 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8adf6a41-1e72-4b5a-b7ae-69eb4d3e1855 tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:27.935563 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8adf6a41-1e72-4b5a-b7ae-69eb4d3e1855 tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:27.938225 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8adf6a41-1e72-4b5a-b7ae-69eb4d3e1855 tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:28.558928 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-509cd618-326e-4ec2-bb16-bea66cc3d2f8 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] 10.222.0.70 "DELETE /compute/v2.1/images/38bfc7f4-fb52-4d97-a6b8-cd768f249fb5" status: 204 len: 0 microversion: 2.1 time: 0.943009 Aug 27 02:49:28.560581 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1027/2034] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:27 2022] DELETE /compute/v2.1/images/38bfc7f4-fb52-4d97-a6b8-cd768f249fb5 => generated 0 bytes in 947 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:49:28.571094 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-de4d5718-9358-4ee7-b217-954eaec48e06 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Calling method '.version_select at 0x7f5ee7219dc0>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:28.655537 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-8adf6a41-1e72-4b5a-b7ae-69eb4d3e1855 tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c5ce6f32ec4c979dda7ead8962a1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76872eddea474d77850d528d56120b3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:28.679764 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-8adf6a41-1e72-4b5a-b7ae-69eb4d3e1855 tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] 10.222.0.70 "GET /compute/v2.1/servers/14df3dce-7fb6-491c-9559-6fbca68580b0" status: 200 len: 1276 microversion: 2.1 time: 0.777694 Aug 27 02:49:28.683197 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1008/2035] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:27 2022] GET /compute/v2.1/servers/14df3dce-7fb6-491c-9559-6fbca68580b0 => generated 1276 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:28.692679 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a29a8ed1-4bac-4e34-b40e-6bbeac8494b7 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:28.694545 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-a29a8ed1-4bac-4e34-b40e-6bbeac8494b7 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] [instance: 26795af5-99b8-4a26-9843-3781a5016217] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:28.703175 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a29a8ed1-4bac-4e34-b40e-6bbeac8494b7 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:28.704205 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a29a8ed1-4bac-4e34-b40e-6bbeac8494b7 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:28.704996 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a29a8ed1-4bac-4e34-b40e-6bbeac8494b7 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:28.706228 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a29a8ed1-4bac-4e34-b40e-6bbeac8494b7 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:28.707100 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a29a8ed1-4bac-4e34-b40e-6bbeac8494b7 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:28.708436 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a29a8ed1-4bac-4e34-b40e-6bbeac8494b7 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:29.261383 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-a29a8ed1-4bac-4e34-b40e-6bbeac8494b7 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66c0fc8492654e6e85a90ce04736c055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f9be56fbeb64cb08b9be4e3d7436782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:29.274086 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a29a8ed1-4bac-4e34-b40e-6bbeac8494b7 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] 10.222.0.70 "GET /compute/v2.1/servers/26795af5-99b8-4a26-9843-3781a5016217" status: 200 len: 1324 microversion: 2.1 time: 0.587812 Aug 27 02:49:29.286157 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1009/2036] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:28 2022] GET /compute/v2.1/servers/26795af5-99b8-4a26-9843-3781a5016217 => generated 1324 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:29.303010 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-1c431ad4-af6f-43d8-abfe-682464b807a9 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:29.303812 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-1c431ad4-af6f-43d8-abfe-682464b807a9 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: cac17f47-6e08-4f15-a8cf-f5e44ad03d12] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:29.315197 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1c431ad4-af6f-43d8-abfe-682464b807a9 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:29.316048 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1c431ad4-af6f-43d8-abfe-682464b807a9 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:29.316523 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1c431ad4-af6f-43d8-abfe-682464b807a9 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:29.317729 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1c431ad4-af6f-43d8-abfe-682464b807a9 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:29.318254 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1c431ad4-af6f-43d8-abfe-682464b807a9 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:29.320795 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1c431ad4-af6f-43d8-abfe-682464b807a9 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:29.430589 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-de4d5718-9358-4ee7-b217-954eaec48e06 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] 10.222.0.70 "DELETE /compute/v2.1/images/ab2ca817-1bd6-41d1-b485-99378273bee8" status: 204 len: 0 microversion: 2.1 time: 0.864979 Aug 27 02:49:29.432527 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1028/2037] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:28 2022] DELETE /compute/v2.1/images/ab2ca817-1bd6-41d1-b485-99378273bee8 => generated 0 bytes in 868 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:49:29.440826 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-1637ef5b-b20f-410d-86bc-e7769c842506 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:29.441667 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-1637ef5b-b20f-410d-86bc-e7769c842506 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] [instance: 9d7f8c37-c4a6-400e-9a02-94f9040b780e] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:29.452011 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1637ef5b-b20f-410d-86bc-e7769c842506 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:29.452974 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1637ef5b-b20f-410d-86bc-e7769c842506 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:29.453811 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1637ef5b-b20f-410d-86bc-e7769c842506 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:29.455355 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1637ef5b-b20f-410d-86bc-e7769c842506 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:29.455893 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1637ef5b-b20f-410d-86bc-e7769c842506 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:29.456697 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1637ef5b-b20f-410d-86bc-e7769c842506 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:29.484783 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-1637ef5b-b20f-410d-86bc-e7769c842506 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] [instance: 9d7f8c37-c4a6-400e-9a02-94f9040b780e] Going to try to terminate instance {{(pid=134052) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:49:29.586425 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-1637ef5b-b20f-410d-86bc-e7769c842506 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] 10.222.0.70 "DELETE /compute/v2.1/servers/9d7f8c37-c4a6-400e-9a02-94f9040b780e" status: 204 len: 0 microversion: 2.1 time: 0.149027 Aug 27 02:49:29.587350 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1029/2038] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:49:29 2022] DELETE /compute/v2.1/servers/9d7f8c37-c4a6-400e-9a02-94f9040b780e => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:49:29.595919 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-345244dd-df62-44de-bfec-975e4c8cc590 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:29.596969 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-345244dd-df62-44de-bfec-975e4c8cc590 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] [instance: 9d7f8c37-c4a6-400e-9a02-94f9040b780e] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:29.601250 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=9,nova_api:UPDATE=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:49:29.605463 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-345244dd-df62-44de-bfec-975e4c8cc590 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:29.606304 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-345244dd-df62-44de-bfec-975e4c8cc590 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:29.606950 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-345244dd-df62-44de-bfec-975e4c8cc590 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:29.607897 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-345244dd-df62-44de-bfec-975e4c8cc590 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:29.608570 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-345244dd-df62-44de-bfec-975e4c8cc590 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:29.609486 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-345244dd-df62-44de-bfec-975e4c8cc590 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:29.779737 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-1c431ad4-af6f-43d8-abfe-682464b807a9 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:29.787905 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-1c431ad4-af6f-43d8-abfe-682464b807a9 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/cac17f47-6e08-4f15-a8cf-f5e44ad03d12" status: 200 len: 1311 microversion: 2.1 time: 0.499494 Aug 27 02:49:29.788985 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1010/2039] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:29 2022] GET /compute/v2.1/servers/cac17f47-6e08-4f15-a8cf-f5e44ad03d12 => generated 1311 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:29.809016 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b6914463-d6a7-4d11-84be-8a9362a43afe tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:29.810079 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b6914463-d6a7-4d11-84be-8a9362a43afe tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] [instance: 14df3dce-7fb6-491c-9559-6fbca68580b0] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:29.826278 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b6914463-d6a7-4d11-84be-8a9362a43afe tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:29.826965 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b6914463-d6a7-4d11-84be-8a9362a43afe tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:29.827596 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b6914463-d6a7-4d11-84be-8a9362a43afe tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:29.829711 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b6914463-d6a7-4d11-84be-8a9362a43afe tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:29.831076 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b6914463-d6a7-4d11-84be-8a9362a43afe tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:29.832756 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b6914463-d6a7-4d11-84be-8a9362a43afe tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:29.987541 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-b6914463-d6a7-4d11-84be-8a9362a43afe tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c5ce6f32ec4c979dda7ead8962a1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76872eddea474d77850d528d56120b3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:29.995073 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b6914463-d6a7-4d11-84be-8a9362a43afe tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] 10.222.0.70 "GET /compute/v2.1/servers/14df3dce-7fb6-491c-9559-6fbca68580b0" status: 200 len: 1282 microversion: 2.1 time: 0.191192 Aug 27 02:49:29.996005 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1011/2040] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:29 2022] GET /compute/v2.1/servers/14df3dce-7fb6-491c-9559-6fbca68580b0 => generated 1282 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:30.107793 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-345244dd-df62-44de-bfec-975e4c8cc590 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d626281a9864fe7aed598d4be209137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ae1f9ee6b7e49849b68b3628b76766a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:30.118205 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-345244dd-df62-44de-bfec-975e4c8cc590 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] 10.222.0.70 "GET /compute/v2.1/servers/9d7f8c37-c4a6-400e-9a02-94f9040b780e" status: 200 len: 1473 microversion: 2.1 time: 0.526591 Aug 27 02:49:30.120736 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1030/2041] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:29 2022] GET /compute/v2.1/servers/9d7f8c37-c4a6-400e-9a02-94f9040b780e => generated 1473 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:30.300102 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b07a120a-db99-4465-ade0-8de862470a78 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:30.301432 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b07a120a-db99-4465-ade0-8de862470a78 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] [instance: 26795af5-99b8-4a26-9843-3781a5016217] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:30.311550 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b07a120a-db99-4465-ade0-8de862470a78 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:30.311550 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b07a120a-db99-4465-ade0-8de862470a78 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:30.311807 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b07a120a-db99-4465-ade0-8de862470a78 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:30.312555 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b07a120a-db99-4465-ade0-8de862470a78 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:30.313090 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b07a120a-db99-4465-ade0-8de862470a78 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:30.313722 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b07a120a-db99-4465-ade0-8de862470a78 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:30.333360 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=100 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:49:30.763517 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-57a53322-6361-4609-986e-eaeabed8d953 req-b05843de-afbd-40fe-af88-5daf6d9e5f9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cac17f47-6e08-4f15-a8cf-f5e44ad03d12", "tag": "7d0fd053-123c-4222-8389-3499f91d9b8c"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:49:30.782492 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-57a53322-6361-4609-986e-eaeabed8d953 req-b05843de-afbd-40fe-af88-5daf6d9e5f9c service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:30.783929 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-57a53322-6361-4609-986e-eaeabed8d953 req-b05843de-afbd-40fe-af88-5daf6d9e5f9c service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:30.784653 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-57a53322-6361-4609-986e-eaeabed8d953 req-b05843de-afbd-40fe-af88-5daf6d9e5f9c service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:30.817624 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-57a53322-6361-4609-986e-eaeabed8d953 req-b05843de-afbd-40fe-af88-5daf6d9e5f9c service nova] Creating event network-changed:7d0fd053-123c-4222-8389-3499f91d9b8c for instance cac17f47-6e08-4f15-a8cf-f5e44ad03d12 on n-h1-852278-4 Aug 27 02:49:30.840098 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-57a53322-6361-4609-986e-eaeabed8d953 req-b05843de-afbd-40fe-af88-5daf6d9e5f9c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084302 Aug 27 02:49:30.841469 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1031/2042] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:49:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:49:30.852364 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e15467fe-cac4-425a-a56d-f8280adcc2e3 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:30.853821 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-e15467fe-cac4-425a-a56d-f8280adcc2e3 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: cac17f47-6e08-4f15-a8cf-f5e44ad03d12] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:30.866187 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e15467fe-cac4-425a-a56d-f8280adcc2e3 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:30.867724 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e15467fe-cac4-425a-a56d-f8280adcc2e3 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:30.868517 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e15467fe-cac4-425a-a56d-f8280adcc2e3 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:30.869506 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e15467fe-cac4-425a-a56d-f8280adcc2e3 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:30.871193 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e15467fe-cac4-425a-a56d-f8280adcc2e3 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:30.871824 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e15467fe-cac4-425a-a56d-f8280adcc2e3 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:31.138035 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-b07a120a-db99-4465-ade0-8de862470a78 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66c0fc8492654e6e85a90ce04736c055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f9be56fbeb64cb08b9be4e3d7436782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:31.157855 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b07a120a-db99-4465-ade0-8de862470a78 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] 10.222.0.70 "GET /compute/v2.1/servers/26795af5-99b8-4a26-9843-3781a5016217" status: 200 len: 1324 microversion: 2.1 time: 0.864435 Aug 27 02:49:31.158785 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1012/2043] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:30 2022] GET /compute/v2.1/servers/26795af5-99b8-4a26-9843-3781a5016217 => generated 1324 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:49:31.165438 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a0ecf38b-e1b4-42e7-b05e-886832a5853c tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:31.167568 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-a0ecf38b-e1b4-42e7-b05e-886832a5853c tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] [instance: 14df3dce-7fb6-491c-9559-6fbca68580b0] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:31.186797 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a0ecf38b-e1b4-42e7-b05e-886832a5853c tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:31.190900 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a0ecf38b-e1b4-42e7-b05e-886832a5853c tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:31.192165 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a0ecf38b-e1b4-42e7-b05e-886832a5853c tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:31.193197 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a0ecf38b-e1b4-42e7-b05e-886832a5853c tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:31.197142 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a0ecf38b-e1b4-42e7-b05e-886832a5853c tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:31.197921 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a0ecf38b-e1b4-42e7-b05e-886832a5853c tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:31.447316 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-e15467fe-cac4-425a-a56d-f8280adcc2e3 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:31.452046 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:49:31.472691 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e15467fe-cac4-425a-a56d-f8280adcc2e3 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/cac17f47-6e08-4f15-a8cf-f5e44ad03d12" status: 200 len: 1311 microversion: 2.1 time: 0.628438 Aug 27 02:49:31.473301 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1032/2044] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:30 2022] GET /compute/v2.1/servers/cac17f47-6e08-4f15-a8cf-f5e44ad03d12 => generated 1311 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:31.491028 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f677d3e6-7596-4e9b-8661-3c1e48214ffd tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:31.491689 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-f677d3e6-7596-4e9b-8661-3c1e48214ffd tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] [instance: 9d7f8c37-c4a6-400e-9a02-94f9040b780e] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:31.524124 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f677d3e6-7596-4e9b-8661-3c1e48214ffd tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:31.524643 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f677d3e6-7596-4e9b-8661-3c1e48214ffd tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:31.526960 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f677d3e6-7596-4e9b-8661-3c1e48214ffd tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:31.528121 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f677d3e6-7596-4e9b-8661-3c1e48214ffd tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:31.528781 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f677d3e6-7596-4e9b-8661-3c1e48214ffd tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:31.529356 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f677d3e6-7596-4e9b-8661-3c1e48214ffd tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:31.702387 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-a0ecf38b-e1b4-42e7-b05e-886832a5853c tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c5ce6f32ec4c979dda7ead8962a1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76872eddea474d77850d528d56120b3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:31.711387 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a0ecf38b-e1b4-42e7-b05e-886832a5853c tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] 10.222.0.70 "GET /compute/v2.1/servers/14df3dce-7fb6-491c-9559-6fbca68580b0" status: 200 len: 1350 microversion: 2.1 time: 0.549651 Aug 27 02:49:31.717354 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1013/2045] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:31 2022] GET /compute/v2.1/servers/14df3dce-7fb6-491c-9559-6fbca68580b0 => generated 1350 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:32.111525 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-f677d3e6-7596-4e9b-8661-3c1e48214ffd tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d626281a9864fe7aed598d4be209137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ae1f9ee6b7e49849b68b3628b76766a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:32.121203 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f677d3e6-7596-4e9b-8661-3c1e48214ffd tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] 10.222.0.70 "GET /compute/v2.1/servers/9d7f8c37-c4a6-400e-9a02-94f9040b780e" status: 200 len: 1473 microversion: 2.1 time: 0.646763 Aug 27 02:49:32.123300 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1033/2046] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:31 2022] GET /compute/v2.1/servers/9d7f8c37-c4a6-400e-9a02-94f9040b780e => generated 1473 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:32.179283 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-6be16750-3c4c-4902-b798-0c424ced44fc tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:32.179898 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-6be16750-3c4c-4902-b798-0c424ced44fc tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] [instance: 26795af5-99b8-4a26-9843-3781a5016217] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:32.197666 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6be16750-3c4c-4902-b798-0c424ced44fc tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:32.199889 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6be16750-3c4c-4902-b798-0c424ced44fc tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:32.201207 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6be16750-3c4c-4902-b798-0c424ced44fc tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:32.202641 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6be16750-3c4c-4902-b798-0c424ced44fc tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:32.204721 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6be16750-3c4c-4902-b798-0c424ced44fc tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:32.207171 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-0ce47c3e-62ca-4e13-ba30-e2173bb76b44 req-4e5e4757-e054-4218-ba29-d93c0801e641 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26795af5-99b8-4a26-9843-3781a5016217", "name": "network-vif-plugged", "status": "completed", "tag": "072e51fc-e3f0-46c0-b5a9-45f131439621"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:49:32.207932 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6be16750-3c4c-4902-b798-0c424ced44fc tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:32.262350 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-0ce47c3e-62ca-4e13-ba30-e2173bb76b44 req-4e5e4757-e054-4218-ba29-d93c0801e641 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:32.275487 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-0ce47c3e-62ca-4e13-ba30-e2173bb76b44 req-4e5e4757-e054-4218-ba29-d93c0801e641 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:32.276571 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-0ce47c3e-62ca-4e13-ba30-e2173bb76b44 req-4e5e4757-e054-4218-ba29-d93c0801e641 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:32.298223 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-0ce47c3e-62ca-4e13-ba30-e2173bb76b44 req-4e5e4757-e054-4218-ba29-d93c0801e641 service nova] Creating event network-vif-plugged:072e51fc-e3f0-46c0-b5a9-45f131439621 for instance 26795af5-99b8-4a26-9843-3781a5016217 on n-h1-852278-4 Aug 27 02:49:32.319494 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-0ce47c3e-62ca-4e13-ba30-e2173bb76b44 req-4e5e4757-e054-4218-ba29-d93c0801e641 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129082 Aug 27 02:49:32.320405 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1034/2047] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:49:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:49:32.497756 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-7c502beb-9e18-4ebd-b70c-cf2b48c71f94 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:32.498692 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-7c502beb-9e18-4ebd-b70c-cf2b48c71f94 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: cac17f47-6e08-4f15-a8cf-f5e44ad03d12] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:32.513429 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7c502beb-9e18-4ebd-b70c-cf2b48c71f94 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:32.514300 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7c502beb-9e18-4ebd-b70c-cf2b48c71f94 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:32.514969 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7c502beb-9e18-4ebd-b70c-cf2b48c71f94 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:32.516057 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7c502beb-9e18-4ebd-b70c-cf2b48c71f94 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:32.516762 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7c502beb-9e18-4ebd-b70c-cf2b48c71f94 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:32.517556 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7c502beb-9e18-4ebd-b70c-cf2b48c71f94 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:33.145666 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-6be16750-3c4c-4902-b798-0c424ced44fc tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66c0fc8492654e6e85a90ce04736c055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f9be56fbeb64cb08b9be4e3d7436782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:33.154015 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-6be16750-3c4c-4902-b798-0c424ced44fc tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] 10.222.0.70 "GET /compute/v2.1/servers/26795af5-99b8-4a26-9843-3781a5016217" status: 200 len: 1324 microversion: 2.1 time: 0.978769 Aug 27 02:49:33.155478 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1014/2048] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:32 2022] GET /compute/v2.1/servers/26795af5-99b8-4a26-9843-3781a5016217 => generated 1324 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:33.160348 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0e66c9a2-b25d-4892-82cb-743901f1ba3c tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:33.161204 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-0e66c9a2-b25d-4892-82cb-743901f1ba3c tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] [instance: 14df3dce-7fb6-491c-9559-6fbca68580b0] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:33.168262 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0e66c9a2-b25d-4892-82cb-743901f1ba3c tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:33.169100 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0e66c9a2-b25d-4892-82cb-743901f1ba3c tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:33.169764 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0e66c9a2-b25d-4892-82cb-743901f1ba3c tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:33.170704 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0e66c9a2-b25d-4892-82cb-743901f1ba3c tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:33.171353 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0e66c9a2-b25d-4892-82cb-743901f1ba3c tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:33.171968 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0e66c9a2-b25d-4892-82cb-743901f1ba3c tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:33.350773 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-7c502beb-9e18-4ebd-b70c-cf2b48c71f94 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:33.364920 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-7c502beb-9e18-4ebd-b70c-cf2b48c71f94 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/cac17f47-6e08-4f15-a8cf-f5e44ad03d12" status: 200 len: 1311 microversion: 2.1 time: 0.872834 Aug 27 02:49:33.367188 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1035/2049] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:32 2022] GET /compute/v2.1/servers/cac17f47-6e08-4f15-a8cf-f5e44ad03d12 => generated 1311 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:33.412111 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ba6e2388-d5ba-46d9-943a-e0174085b58a tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:33.414522 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-ba6e2388-d5ba-46d9-943a-e0174085b58a tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] [instance: 9d7f8c37-c4a6-400e-9a02-94f9040b780e] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:33.451426 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ba6e2388-d5ba-46d9-943a-e0174085b58a tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:33.454957 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ba6e2388-d5ba-46d9-943a-e0174085b58a tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:33.456196 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ba6e2388-d5ba-46d9-943a-e0174085b58a tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:33.457537 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ba6e2388-d5ba-46d9-943a-e0174085b58a tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:33.459257 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ba6e2388-d5ba-46d9-943a-e0174085b58a tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:33.460803 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ba6e2388-d5ba-46d9-943a-e0174085b58a tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:33.671979 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-ba6e2388-d5ba-46d9-943a-e0174085b58a tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d626281a9864fe7aed598d4be209137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ae1f9ee6b7e49849b68b3628b76766a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:33.683500 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ba6e2388-d5ba-46d9-943a-e0174085b58a tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] 10.222.0.70 "GET /compute/v2.1/servers/9d7f8c37-c4a6-400e-9a02-94f9040b780e" status: 200 len: 1431 microversion: 2.1 time: 0.314557 Aug 27 02:49:33.698850 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1036/2050] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:33 2022] GET /compute/v2.1/servers/9d7f8c37-c4a6-400e-9a02-94f9040b780e => generated 1431 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:33.705712 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-6e5a2a11-b0e3-4f3f-b948-82b82aff2ebe req-8e29dbc1-4344-46a7-9d36-81bc9d4e2b4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d7f8c37-c4a6-400e-9a02-94f9040b780e", "name": "network-vif-deleted", "tag": "545c57b0-4a40-4554-9d90-9ca7c0773d35"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:49:33.718289 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-6e5a2a11-b0e3-4f3f-b948-82b82aff2ebe req-8e29dbc1-4344-46a7-9d36-81bc9d4e2b4a service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:33.719068 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-6e5a2a11-b0e3-4f3f-b948-82b82aff2ebe req-8e29dbc1-4344-46a7-9d36-81bc9d4e2b4a service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:33.719678 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-6e5a2a11-b0e3-4f3f-b948-82b82aff2ebe req-8e29dbc1-4344-46a7-9d36-81bc9d4e2b4a service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:33.734201 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-6e5a2a11-b0e3-4f3f-b948-82b82aff2ebe req-8e29dbc1-4344-46a7-9d36-81bc9d4e2b4a service nova] Creating event network-vif-deleted:545c57b0-4a40-4554-9d90-9ca7c0773d35 for instance 9d7f8c37-c4a6-400e-9a02-94f9040b780e on n-h2-852278-4 Aug 27 02:49:33.743017 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-6e5a2a11-b0e3-4f3f-b948-82b82aff2ebe req-8e29dbc1-4344-46a7-9d36-81bc9d4e2b4a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042062 Aug 27 02:49:33.744184 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1037/2051] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:49:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:49:33.758209 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-0e66c9a2-b25d-4892-82cb-743901f1ba3c tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c5ce6f32ec4c979dda7ead8962a1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76872eddea474d77850d528d56120b3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:33.771666 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-0e66c9a2-b25d-4892-82cb-743901f1ba3c tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] 10.222.0.70 "GET /compute/v2.1/servers/14df3dce-7fb6-491c-9559-6fbca68580b0" status: 200 len: 1350 microversion: 2.1 time: 0.614812 Aug 27 02:49:33.776722 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1015/2052] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:33 2022] GET /compute/v2.1/servers/14df3dce-7fb6-491c-9559-6fbca68580b0 => generated 1350 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:34.176259 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-1e6e22a9-2e88-4875-a2bf-ea7734be33aa tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:34.177344 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-1e6e22a9-2e88-4875-a2bf-ea7734be33aa tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] [instance: 26795af5-99b8-4a26-9843-3781a5016217] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:34.193347 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1e6e22a9-2e88-4875-a2bf-ea7734be33aa tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:34.194821 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1e6e22a9-2e88-4875-a2bf-ea7734be33aa tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:34.197495 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1e6e22a9-2e88-4875-a2bf-ea7734be33aa tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:34.198498 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1e6e22a9-2e88-4875-a2bf-ea7734be33aa tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:34.215146 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1e6e22a9-2e88-4875-a2bf-ea7734be33aa tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:34.220877 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1e6e22a9-2e88-4875-a2bf-ea7734be33aa tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:34.387778 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-503f7925-3f17-46bc-8406-306366d613e2 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:34.388427 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-503f7925-3f17-46bc-8406-306366d613e2 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: cac17f47-6e08-4f15-a8cf-f5e44ad03d12] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:34.397460 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-503f7925-3f17-46bc-8406-306366d613e2 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:34.397927 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-503f7925-3f17-46bc-8406-306366d613e2 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:34.398372 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-503f7925-3f17-46bc-8406-306366d613e2 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:34.399127 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-503f7925-3f17-46bc-8406-306366d613e2 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:34.399597 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-503f7925-3f17-46bc-8406-306366d613e2 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:34.400027 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-503f7925-3f17-46bc-8406-306366d613e2 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:34.796447 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-1e6e22a9-2e88-4875-a2bf-ea7734be33aa tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66c0fc8492654e6e85a90ce04736c055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f9be56fbeb64cb08b9be4e3d7436782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:34.815785 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-1e6e22a9-2e88-4875-a2bf-ea7734be33aa tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] 10.222.0.70 "GET /compute/v2.1/servers/26795af5-99b8-4a26-9843-3781a5016217" status: 200 len: 1324 microversion: 2.1 time: 0.642999 Aug 27 02:49:34.817657 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1038/2053] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:34 2022] GET /compute/v2.1/servers/26795af5-99b8-4a26-9843-3781a5016217 => generated 1324 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:34.824410 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-7e96daaa-a947-495c-922b-6eb5459d92df tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:34.825142 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-7e96daaa-a947-495c-922b-6eb5459d92df tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] [instance: 9d7f8c37-c4a6-400e-9a02-94f9040b780e] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:34.834762 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7e96daaa-a947-495c-922b-6eb5459d92df tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:34.836073 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7e96daaa-a947-495c-922b-6eb5459d92df tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:34.836801 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7e96daaa-a947-495c-922b-6eb5459d92df tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:34.849268 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7e96daaa-a947-495c-922b-6eb5459d92df tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:34.850311 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7e96daaa-a947-495c-922b-6eb5459d92df tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:34.850311 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7e96daaa-a947-495c-922b-6eb5459d92df tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:34.867023 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-7e96daaa-a947-495c-922b-6eb5459d92df tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] HTTP exception thrown: Instance 9d7f8c37-c4a6-400e-9a02-94f9040b780e could not be found. Aug 27 02:49:34.884251 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-7e96daaa-a947-495c-922b-6eb5459d92df tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Request method failure captured: Aug 27 02:49:34.884251 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/servers/9d7f8c37-c4a6-400e-9a02-94f9040b780e HTTP/1.1 Aug 27 02:49:34.884251 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:49:34.884251 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:49:34.884251 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:49:34.884251 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:49:34.884251 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:49:34.884251 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:49:34.884251 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:49:34.884251 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:49:34.884251 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYW1kKk6CTqFXOURMHzia0PmXPGuXD7SW8X0q8r04-3F5dhqRD2r69XpSQOmaZP_C1lUMmww913w49a8nshk4e34UJMe5OxfB9S2G5OajSVJTZvIgdxvUhhBdGUB_PAgfktlu4E09zLiDMVOf808HMketHHgLeIgG28pstLBgYfVtvw Aug 27 02:49:34.884251 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:49:34.884251 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:49:34.884251 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:49:34.884251 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:49:34.884251 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:49:34.884251 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:49:34.884251 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 5ae1f9ee6b7e49849b68b3628b76766a Aug 27 02:49:34.884251 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ListImageFiltersTestJSON-1122911400 Aug 27 02:49:34.884251 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:49:34.884251 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:49:34.884251 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5ae1f9ee6b7e49849b68b3628b76766a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_5ae1f9ee6b7e49849b68b3628b76766a", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5ae1f9ee6b7e49849b68b3628b76766a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/5ae1f9ee6b7e49849b68b3628b76766a"}]}] Aug 27 02:49:34.884251 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ListImageFiltersTestJSON-1122911400 Aug 27 02:49:34.884251 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 5ae1f9ee6b7e49849b68b3628b76766a Aug 27 02:49:34.884251 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1122911400 Aug 27 02:49:34.884251 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ListImageFiltersTestJSON-1122911400-project Aug 27 02:49:34.884251 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:49:34.884251 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:49:34.884251 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 1d626281a9864fe7aed598d4be209137 Aug 27 02:49:34.884251 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ListImageFiltersTestJSON-1122911400-project Aug 27 02:49:34.884251 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 02:49:34.884251 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance 9d7f8c37-c4a6-400e-9a02-94f9040b780e could not be found. Aug 27 02:49:34.884251 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '9d7f8c37-c4a6-400e-9a02-94f9040b780e'} Aug 27 02:49:34.884251 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:49:34.884251 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:34.884251 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:49:34.884251 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:49:34.884251 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:49:34.884251 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:49:34.884251 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:49:34.884251 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:49:34.884251 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:49:34.884251 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:49:34.884251 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d7f8c37-c4a6-400e-9a02-94f9040b780e could not be found. Aug 27 02:49:34.884251 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:49:34.884251 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:49:34.884251 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:49:34.884251 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:34.884251 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:49:34.884251 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:49:34.884251 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:49:34.884251 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:49:34.884251 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:49:34.884251 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:49:34.884251 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:49:34.884251 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:49:34.884251 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:49:34.884251 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:49:34.884251 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:49:34.884251 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:49:34.884251 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d7f8c37-c4a6-400e-9a02-94f9040b780e could not be found. Aug 27 02:49:34.884251 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:49:34.884251 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:49:34.884251 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:49:34.887991 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:34.887991 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:49:34.887991 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:49:34.887991 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:49:34.887991 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:49:34.887991 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d7f8c37-c4a6-400e-9a02-94f9040b780e could not be found. Aug 27 02:49:34.887991 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:49:34.897124 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-7e96daaa-a947-495c-922b-6eb5459d92df tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Returning 404 to user: Instance 9d7f8c37-c4a6-400e-9a02-94f9040b780e could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:49:34.898168 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-7e96daaa-a947-495c-922b-6eb5459d92df tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] 10.222.0.70 "GET /compute/v2.1/servers/9d7f8c37-c4a6-400e-9a02-94f9040b780e" status: 404 len: 111 microversion: 2.1 time: 0.078765 Aug 27 02:49:34.898776 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1039/2054] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:34 2022] GET /compute/v2.1/servers/9d7f8c37-c4a6-400e-9a02-94f9040b780e => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:49:34.915164 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-5a5c42ca-01e7-494d-99e5-bde255978d58 req-3c581254-fdb4-495a-8675-da2d1f38a5a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14df3dce-7fb6-491c-9559-6fbca68580b0", "tag": "7484d94b-dbe7-4864-b57a-8baf10193a92"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:49:34.927447 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-5a5c42ca-01e7-494d-99e5-bde255978d58 req-3c581254-fdb4-495a-8675-da2d1f38a5a0 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:34.928121 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-5a5c42ca-01e7-494d-99e5-bde255978d58 req-3c581254-fdb4-495a-8675-da2d1f38a5a0 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:34.929208 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-5a5c42ca-01e7-494d-99e5-bde255978d58 req-3c581254-fdb4-495a-8675-da2d1f38a5a0 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:34.951613 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-5a5c42ca-01e7-494d-99e5-bde255978d58 req-3c581254-fdb4-495a-8675-da2d1f38a5a0 service nova] Creating event network-changed:7484d94b-dbe7-4864-b57a-8baf10193a92 for instance 14df3dce-7fb6-491c-9559-6fbca68580b0 on n-h2-852278-4 Aug 27 02:49:34.958587 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-5a5c42ca-01e7-494d-99e5-bde255978d58 req-3c581254-fdb4-495a-8675-da2d1f38a5a0 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055214 Aug 27 02:49:34.959450 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1040/2055] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:49:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:49:34.967330 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4db537a0-2d47-4d9e-8620-0f8d2238391b tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:34.968381 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-4db537a0-2d47-4d9e-8620-0f8d2238391b tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] [instance: 14df3dce-7fb6-491c-9559-6fbca68580b0] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:34.976302 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4db537a0-2d47-4d9e-8620-0f8d2238391b tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:34.977147 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4db537a0-2d47-4d9e-8620-0f8d2238391b tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:34.977808 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4db537a0-2d47-4d9e-8620-0f8d2238391b tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:34.978666 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4db537a0-2d47-4d9e-8620-0f8d2238391b tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:34.979179 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4db537a0-2d47-4d9e-8620-0f8d2238391b tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:34.979673 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4db537a0-2d47-4d9e-8620-0f8d2238391b tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:35.193432 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-503f7925-3f17-46bc-8406-306366d613e2 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:35.206149 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-503f7925-3f17-46bc-8406-306366d613e2 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/cac17f47-6e08-4f15-a8cf-f5e44ad03d12" status: 200 len: 1311 microversion: 2.1 time: 0.822790 Aug 27 02:49:35.207717 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1016/2056] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:34 2022] GET /compute/v2.1/servers/cac17f47-6e08-4f15-a8cf-f5e44ad03d12 => generated 1311 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:49:35.225122 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-34c6f64b-9bf7-4fbf-b75d-b35d5aea305d tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:35.225884 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-34c6f64b-9bf7-4fbf-b75d-b35d5aea305d tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] [instance: 191df585-2175-47be-9bd8-29b914535f47] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:35.232753 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-34c6f64b-9bf7-4fbf-b75d-b35d5aea305d tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:35.233652 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-34c6f64b-9bf7-4fbf-b75d-b35d5aea305d tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:35.234332 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-34c6f64b-9bf7-4fbf-b75d-b35d5aea305d tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:35.235678 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-34c6f64b-9bf7-4fbf-b75d-b35d5aea305d tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:35.236132 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-34c6f64b-9bf7-4fbf-b75d-b35d5aea305d tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:35.236648 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-34c6f64b-9bf7-4fbf-b75d-b35d5aea305d tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:35.269445 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-34c6f64b-9bf7-4fbf-b75d-b35d5aea305d tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] [instance: 191df585-2175-47be-9bd8-29b914535f47] Going to try to terminate instance {{(pid=134051) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:49:35.413612 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-34c6f64b-9bf7-4fbf-b75d-b35d5aea305d tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] 10.222.0.70 "DELETE /compute/v2.1/servers/191df585-2175-47be-9bd8-29b914535f47" status: 204 len: 0 microversion: 2.1 time: 0.203715 Aug 27 02:49:35.414271 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1017/2057] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:49:35 2022] DELETE /compute/v2.1/servers/191df585-2175-47be-9bd8-29b914535f47 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:49:35.432942 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-2baa1864-33e4-4ba4-8bac-a5e4e0bf6512 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:35.434761 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-2baa1864-33e4-4ba4-8bac-a5e4e0bf6512 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] [instance: 191df585-2175-47be-9bd8-29b914535f47] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:35.451111 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2baa1864-33e4-4ba4-8bac-a5e4e0bf6512 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:35.452095 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2baa1864-33e4-4ba4-8bac-a5e4e0bf6512 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:35.452567 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2baa1864-33e4-4ba4-8bac-a5e4e0bf6512 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:35.453318 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2baa1864-33e4-4ba4-8bac-a5e4e0bf6512 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:35.453763 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2baa1864-33e4-4ba4-8bac-a5e4e0bf6512 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:35.454178 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2baa1864-33e4-4ba4-8bac-a5e4e0bf6512 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:35.572335 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-4db537a0-2d47-4d9e-8620-0f8d2238391b tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c5ce6f32ec4c979dda7ead8962a1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76872eddea474d77850d528d56120b3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:35.583544 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-4db537a0-2d47-4d9e-8620-0f8d2238391b tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] 10.222.0.70 "GET /compute/v2.1/servers/14df3dce-7fb6-491c-9559-6fbca68580b0" status: 200 len: 1350 microversion: 2.1 time: 0.621932 Aug 27 02:49:35.584448 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1041/2058] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:34 2022] GET /compute/v2.1/servers/14df3dce-7fb6-491c-9559-6fbca68580b0 => generated 1350 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:35.687266 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-2baa1864-33e4-4ba4-8bac-a5e4e0bf6512 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d626281a9864fe7aed598d4be209137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ae1f9ee6b7e49849b68b3628b76766a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:35.697477 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-2baa1864-33e4-4ba4-8bac-a5e4e0bf6512 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] 10.222.0.70 "GET /compute/v2.1/servers/191df585-2175-47be-9bd8-29b914535f47" status: 200 len: 1473 microversion: 2.1 time: 0.273360 Aug 27 02:49:35.698497 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1018/2059] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:35 2022] GET /compute/v2.1/servers/191df585-2175-47be-9bd8-29b914535f47 => generated 1473 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:35.837524 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-73b03891-34eb-47a8-9cd8-e3c98df2d654 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:35.838919 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-73b03891-34eb-47a8-9cd8-e3c98df2d654 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] [instance: 26795af5-99b8-4a26-9843-3781a5016217] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:35.842142 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=6 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:49:35.846639 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-73b03891-34eb-47a8-9cd8-e3c98df2d654 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:35.847107 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-73b03891-34eb-47a8-9cd8-e3c98df2d654 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:35.847741 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-73b03891-34eb-47a8-9cd8-e3c98df2d654 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:35.848493 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-73b03891-34eb-47a8-9cd8-e3c98df2d654 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:35.848941 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-73b03891-34eb-47a8-9cd8-e3c98df2d654 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:35.849356 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-73b03891-34eb-47a8-9cd8-e3c98df2d654 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:36.006105 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-73b03891-34eb-47a8-9cd8-e3c98df2d654 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66c0fc8492654e6e85a90ce04736c055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f9be56fbeb64cb08b9be4e3d7436782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:36.015870 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-73b03891-34eb-47a8-9cd8-e3c98df2d654 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] 10.222.0.70 "GET /compute/v2.1/servers/26795af5-99b8-4a26-9843-3781a5016217" status: 200 len: 1519 microversion: 2.1 time: 0.182355 Aug 27 02:49:36.016504 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1042/2060] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:35 2022] GET /compute/v2.1/servers/26795af5-99b8-4a26-9843-3781a5016217 => generated 1519 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:36.037038 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-002dbcc3-5658-40cd-a0cf-e879bbe7975b tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Action: 'action', calling method: .version_select at 0x7f5ee556b280>, body: {"addFloatingIp": {"address": "172.25.0.59"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:49:36.040227 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-002dbcc3-5658-40cd-a0cf-e879bbe7975b tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] [instance: e445cdc5-5ecb-487c-adee-f5cb9862283c] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:36.056709 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-002dbcc3-5658-40cd-a0cf-e879bbe7975b tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:36.057495 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-002dbcc3-5658-40cd-a0cf-e879bbe7975b tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:36.058597 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-002dbcc3-5658-40cd-a0cf-e879bbe7975b tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:36.059761 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-002dbcc3-5658-40cd-a0cf-e879bbe7975b tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:36.061062 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-002dbcc3-5658-40cd-a0cf-e879bbe7975b tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:36.061510 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-002dbcc3-5658-40cd-a0cf-e879bbe7975b tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:36.147282 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-002dbcc3-5658-40cd-a0cf-e879bbe7975b tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Acquiring lock "refresh_cache-e445cdc5-5ecb-487c-adee-f5cb9862283c" {{(pid=134051) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 27 02:49:36.147743 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-002dbcc3-5658-40cd-a0cf-e879bbe7975b tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Acquired lock "refresh_cache-e445cdc5-5ecb-487c-adee-f5cb9862283c" {{(pid=134051) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 27 02:49:36.228368 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-72e98f0e-52d8-4f5b-80c0-5e9ccf49cebe tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:36.239148 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-72e98f0e-52d8-4f5b-80c0-5e9ccf49cebe tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: cac17f47-6e08-4f15-a8cf-f5e44ad03d12] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:36.275044 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-72e98f0e-52d8-4f5b-80c0-5e9ccf49cebe tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:36.279538 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-72e98f0e-52d8-4f5b-80c0-5e9ccf49cebe tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:36.280327 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-72e98f0e-52d8-4f5b-80c0-5e9ccf49cebe tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:36.281463 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-72e98f0e-52d8-4f5b-80c0-5e9ccf49cebe tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:36.283253 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-72e98f0e-52d8-4f5b-80c0-5e9ccf49cebe tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:36.283937 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-72e98f0e-52d8-4f5b-80c0-5e9ccf49cebe tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:36.456908 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=24 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:49:36.763060 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-72e98f0e-52d8-4f5b-80c0-5e9ccf49cebe tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:36.781587 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-72e98f0e-52d8-4f5b-80c0-5e9ccf49cebe tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/cac17f47-6e08-4f15-a8cf-f5e44ad03d12" status: 200 len: 1311 microversion: 2.1 time: 0.557391 Aug 27 02:49:36.783109 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1043/2061] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:36 2022] GET /compute/v2.1/servers/cac17f47-6e08-4f15-a8cf-f5e44ad03d12 => generated 1311 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:36.791820 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-1f07ef5c-a056-4684-af2c-2a196f073c27 tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:36.793210 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-1f07ef5c-a056-4684-af2c-2a196f073c27 tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] [instance: 14df3dce-7fb6-491c-9559-6fbca68580b0] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:36.804399 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1f07ef5c-a056-4684-af2c-2a196f073c27 tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:36.805840 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1f07ef5c-a056-4684-af2c-2a196f073c27 tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:36.807114 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1f07ef5c-a056-4684-af2c-2a196f073c27 tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:36.809076 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1f07ef5c-a056-4684-af2c-2a196f073c27 tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:36.810140 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1f07ef5c-a056-4684-af2c-2a196f073c27 tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:36.813468 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1f07ef5c-a056-4684-af2c-2a196f073c27 tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:37.261531 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-1f07ef5c-a056-4684-af2c-2a196f073c27 tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c5ce6f32ec4c979dda7ead8962a1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76872eddea474d77850d528d56120b3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:37.279254 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-1f07ef5c-a056-4684-af2c-2a196f073c27 tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] 10.222.0.70 "GET /compute/v2.1/servers/14df3dce-7fb6-491c-9559-6fbca68580b0" status: 200 len: 1350 microversion: 2.1 time: 0.488054 Aug 27 02:49:37.280173 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1044/2062] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:36 2022] GET /compute/v2.1/servers/14df3dce-7fb6-491c-9559-6fbca68580b0 => generated 1350 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:37.285122 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8070fb06-bf98-4e7a-899b-9d01ac9223fc tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:37.286099 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-8070fb06-bf98-4e7a-899b-9d01ac9223fc tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] [instance: 191df585-2175-47be-9bd8-29b914535f47] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:37.299856 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8070fb06-bf98-4e7a-899b-9d01ac9223fc tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:37.300654 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8070fb06-bf98-4e7a-899b-9d01ac9223fc tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:37.301232 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8070fb06-bf98-4e7a-899b-9d01ac9223fc tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:37.303475 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8070fb06-bf98-4e7a-899b-9d01ac9223fc tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:37.304130 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8070fb06-bf98-4e7a-899b-9d01ac9223fc tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:37.306526 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8070fb06-bf98-4e7a-899b-9d01ac9223fc tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:37.613004 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-8070fb06-bf98-4e7a-899b-9d01ac9223fc tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d626281a9864fe7aed598d4be209137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ae1f9ee6b7e49849b68b3628b76766a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:37.622697 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-8070fb06-bf98-4e7a-899b-9d01ac9223fc tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] 10.222.0.70 "GET /compute/v2.1/servers/191df585-2175-47be-9bd8-29b914535f47" status: 200 len: 1473 microversion: 2.1 time: 0.341252 Aug 27 02:49:37.623287 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1045/2063] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:37 2022] GET /compute/v2.1/servers/191df585-2175-47be-9bd8-29b914535f47 => generated 1473 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:37.862988 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-86d25223-bc49-4736-8a84-45cd28814901 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-1911553204", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "networks": [{"uuid": "cec1f1c8-ede6-4fbf-a6be-be33cc79bfe7"}]}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:49:37.961672 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.network.neutron [None req-86d25223-bc49-4736-8a84-45cd28814901 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] validate_networks() for [('cec1f1c8-ede6-4fbf-a6be-be33cc79bfe7', None, None, None, None, None)] {{(pid=134052) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:49:39.243807 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.network.neutron [None req-002dbcc3-5658-40cd-a0cf-e879bbe7975b tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] [instance: e445cdc5-5ecb-487c-adee-f5cb9862283c] Building network info cache for instance {{(pid=134051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 27 02:49:40.594269 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-86d25223-bc49-4736-8a84-45cd28814901 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Flavor limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:49:40.594909 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-86d25223-bc49-4736-8a84-45cd28814901 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Image limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:49:40.595141 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-86d25223-bc49-4736-8a84-45cd28814901 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Flavor pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:49:40.595776 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-86d25223-bc49-4736-8a84-45cd28814901 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Image pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:49:40.596286 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-86d25223-bc49-4736-8a84-45cd28814901 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:49:40.616997 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-86d25223-bc49-4736-8a84-45cd28814901 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:40.617592 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-86d25223-bc49-4736-8a84-45cd28814901 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:40.618042 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-86d25223-bc49-4736-8a84-45cd28814901 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:40.619091 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-86d25223-bc49-4736-8a84-45cd28814901 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:40.619609 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-86d25223-bc49-4736-8a84-45cd28814901 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:40.620094 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-86d25223-bc49-4736-8a84-45cd28814901 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:40.700160 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-86d25223-bc49-4736-8a84-45cd28814901 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Getting quotas for project 2c13c5aeb4da472da020639d5b6ad5aa. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:49:40.712978 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-86d25223-bc49-4736-8a84-45cd28814901 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Getting quotas for user ece67529f3704d9faf0ff443d7c016de and project 2c13c5aeb4da472da020639d5b6ad5aa. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:49:40.751393 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-86d25223-bc49-4736-8a84-45cd28814901 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Going to run 1 instances... {{(pid=134052) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:49:40.753496 n-d-852278-4 devstack@n-api.service[134052]: WARNING nova.utils [None req-86d25223-bc49-4736-8a84-45cd28814901 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Hostname tempest-FloatingIPsAssociationNegativeTestJSON-server-1911553204 is longer than 63, truncate it to tempest-FloatingIPsAssociationNegativeTestJSON-server-191155320 Aug 27 02:49:40.759172 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-86d25223-bc49-4736-8a84-45cd28814901 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] [instance: 57a1e617-8846-4da8-b84f-232ffc519f69] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134052) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:49:40.882966 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-86d25223-bc49-4736-8a84-45cd28814901 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.250013 Aug 27 02:49:40.909995 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1046/2064] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 02:49:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 3278 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:49:40.925177 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0994f910-2fbb-400e-a83d-18ae132bd9f9 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:40.926833 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-0994f910-2fbb-400e-a83d-18ae132bd9f9 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: cac17f47-6e08-4f15-a8cf-f5e44ad03d12] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:40.945236 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0994f910-2fbb-400e-a83d-18ae132bd9f9 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:40.946539 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0994f910-2fbb-400e-a83d-18ae132bd9f9 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:40.947212 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0994f910-2fbb-400e-a83d-18ae132bd9f9 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:40.952032 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0994f910-2fbb-400e-a83d-18ae132bd9f9 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:40.953531 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0994f910-2fbb-400e-a83d-18ae132bd9f9 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:40.954886 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0994f910-2fbb-400e-a83d-18ae132bd9f9 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:41.443190 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.network.neutron [None req-002dbcc3-5658-40cd-a0cf-e879bbe7975b tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] [instance: e445cdc5-5ecb-487c-adee-f5cb9862283c] Updating instance_info_cache with network_info: [{"id": "42ac4b18-965a-486a-8d1d-80c016c9888c", "address": "fa:16:3e:d3:42:65", "network": {"id": "56c1e6e5-f638-4015-aee9-61020b017eac", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-265073614-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.0.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "4f9be56fbeb64cb08b9be4e3d7436782", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap42ac4b18-96", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=134051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 27 02:49:41.472667 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-002dbcc3-5658-40cd-a0cf-e879bbe7975b tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Releasing lock "refresh_cache-e445cdc5-5ecb-487c-adee-f5cb9862283c" {{(pid=134051) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 27 02:49:41.479576 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-002dbcc3-5658-40cd-a0cf-e879bbe7975b tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] 10.222.0.70 "POST /compute/v2.1/servers/e445cdc5-5ecb-487c-adee-f5cb9862283c/action" status: 202 len: 0 microversion: 2.1 time: 5.442358 Aug 27 02:49:41.485274 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1019/2065] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 02:49:36 2022] POST /compute/v2.1/servers/e445cdc5-5ecb-487c-adee-f5cb9862283c/action => generated 0 bytes in 5453 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 27 02:49:41.503219 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-5cdd9612-311e-459f-b886-1c6a3b6d77db tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:41.503839 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-5cdd9612-311e-459f-b886-1c6a3b6d77db tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] [instance: 14df3dce-7fb6-491c-9559-6fbca68580b0] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:41.529150 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:49:41.534505 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5cdd9612-311e-459f-b886-1c6a3b6d77db tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:41.535227 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5cdd9612-311e-459f-b886-1c6a3b6d77db tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:41.536541 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5cdd9612-311e-459f-b886-1c6a3b6d77db tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:41.542432 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5cdd9612-311e-459f-b886-1c6a3b6d77db tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:41.545916 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5cdd9612-311e-459f-b886-1c6a3b6d77db tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:41.547031 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5cdd9612-311e-459f-b886-1c6a3b6d77db tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:41.609788 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0994f910-2fbb-400e-a83d-18ae132bd9f9 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:41.629422 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-0994f910-2fbb-400e-a83d-18ae132bd9f9 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/cac17f47-6e08-4f15-a8cf-f5e44ad03d12" status: 200 len: 1311 microversion: 2.1 time: 0.715498 Aug 27 02:49:41.639189 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1047/2066] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:40 2022] GET /compute/v2.1/servers/cac17f47-6e08-4f15-a8cf-f5e44ad03d12 => generated 1311 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:41.645189 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6b4f78fa-fca9-45f0-b108-0f883ad97614 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:41.655810 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-6b4f78fa-fca9-45f0-b108-0f883ad97614 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] [instance: 191df585-2175-47be-9bd8-29b914535f47] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:41.680584 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6b4f78fa-fca9-45f0-b108-0f883ad97614 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:41.688262 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6b4f78fa-fca9-45f0-b108-0f883ad97614 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:41.691138 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6b4f78fa-fca9-45f0-b108-0f883ad97614 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:41.692176 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6b4f78fa-fca9-45f0-b108-0f883ad97614 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:41.694080 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6b4f78fa-fca9-45f0-b108-0f883ad97614 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:41.695607 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6b4f78fa-fca9-45f0-b108-0f883ad97614 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:41.899647 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-6b4f78fa-fca9-45f0-b108-0f883ad97614 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d626281a9864fe7aed598d4be209137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ae1f9ee6b7e49849b68b3628b76766a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:41.908723 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-6b4f78fa-fca9-45f0-b108-0f883ad97614 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] 10.222.0.70 "GET /compute/v2.1/servers/191df585-2175-47be-9bd8-29b914535f47" status: 200 len: 1431 microversion: 2.1 time: 0.267884 Aug 27 02:49:41.921183 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1048/2067] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:41 2022] GET /compute/v2.1/servers/191df585-2175-47be-9bd8-29b914535f47 => generated 1431 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:41.938885 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-f5c032d0-7069-4b72-8bc1-652bd2e9b392 req-a0dc261f-0891-412d-94c4-e40dd4b74b3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e445cdc5-5ecb-487c-adee-f5cb9862283c", "tag": "42ac4b18-965a-486a-8d1d-80c016c9888c"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:49:41.958068 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-f5c032d0-7069-4b72-8bc1-652bd2e9b392 req-a0dc261f-0891-412d-94c4-e40dd4b74b3b service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:41.960618 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-f5c032d0-7069-4b72-8bc1-652bd2e9b392 req-a0dc261f-0891-412d-94c4-e40dd4b74b3b service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:41.962691 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-f5c032d0-7069-4b72-8bc1-652bd2e9b392 req-a0dc261f-0891-412d-94c4-e40dd4b74b3b service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:41.996521 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-f5c032d0-7069-4b72-8bc1-652bd2e9b392 req-a0dc261f-0891-412d-94c4-e40dd4b74b3b service nova] Creating event network-changed:42ac4b18-965a-486a-8d1d-80c016c9888c for instance e445cdc5-5ecb-487c-adee-f5cb9862283c on n-h2-852278-4 Aug 27 02:49:42.025388 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-f5c032d0-7069-4b72-8bc1-652bd2e9b392 req-a0dc261f-0891-412d-94c4-e40dd4b74b3b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102372 Aug 27 02:49:42.026926 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1049/2068] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:49:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:49:42.046555 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d49c6342-3ca1-4eec-92bf-174ef72941d9 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:42.053355 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d49c6342-3ca1-4eec-92bf-174ef72941d9 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] [instance: 57a1e617-8846-4da8-b84f-232ffc519f69] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:42.069619 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d49c6342-3ca1-4eec-92bf-174ef72941d9 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:42.070416 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d49c6342-3ca1-4eec-92bf-174ef72941d9 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:42.071385 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d49c6342-3ca1-4eec-92bf-174ef72941d9 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:42.078947 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d49c6342-3ca1-4eec-92bf-174ef72941d9 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:42.079768 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d49c6342-3ca1-4eec-92bf-174ef72941d9 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:42.086417 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d49c6342-3ca1-4eec-92bf-174ef72941d9 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:42.159906 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-5cdd9612-311e-459f-b886-1c6a3b6d77db tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c5ce6f32ec4c979dda7ead8962a1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76872eddea474d77850d528d56120b3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:42.168291 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-5cdd9612-311e-459f-b886-1c6a3b6d77db tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] 10.222.0.70 "GET /compute/v2.1/servers/14df3dce-7fb6-491c-9559-6fbca68580b0" status: 200 len: 1350 microversion: 2.1 time: 0.681866 Aug 27 02:49:42.172593 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1020/2069] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:41 2022] GET /compute/v2.1/servers/14df3dce-7fb6-491c-9559-6fbca68580b0 => generated 1350 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:42.182182 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-72aadda5-e018-4bb7-95b7-cb292254255a tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.0.59"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:49:42.198348 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-72aadda5-e018-4bb7-95b7-cb292254255a tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] [instance: 26795af5-99b8-4a26-9843-3781a5016217] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:42.221286 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-72aadda5-e018-4bb7-95b7-cb292254255a tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:42.222285 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-72aadda5-e018-4bb7-95b7-cb292254255a tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:42.222951 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-72aadda5-e018-4bb7-95b7-cb292254255a tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:42.223886 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-72aadda5-e018-4bb7-95b7-cb292254255a tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:42.224577 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-72aadda5-e018-4bb7-95b7-cb292254255a tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:42.227108 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-72aadda5-e018-4bb7-95b7-cb292254255a tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:42.329408 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-72aadda5-e018-4bb7-95b7-cb292254255a tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Acquiring lock "refresh_cache-26795af5-99b8-4a26-9843-3781a5016217" {{(pid=134051) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 27 02:49:42.339647 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-72aadda5-e018-4bb7-95b7-cb292254255a tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Acquired lock "refresh_cache-26795af5-99b8-4a26-9843-3781a5016217" {{(pid=134051) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 27 02:49:42.373577 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-d49c6342-3ca1-4eec-92bf-174ef72941d9 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece67529f3704d9faf0ff443d7c016de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c13c5aeb4da472da020639d5b6ad5aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:42.392511 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d49c6342-3ca1-4eec-92bf-174ef72941d9 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] 10.222.0.70 "GET /compute/v2.1/servers/57a1e617-8846-4da8-b84f-232ffc519f69" status: 200 len: 1236 microversion: 2.1 time: 0.363886 Aug 27 02:49:42.393179 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1050/2070] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:42 2022] GET /compute/v2.1/servers/57a1e617-8846-4da8-b84f-232ffc519f69 => generated 1236 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:42.413016 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-c1bd1fbd-117e-4a1f-b840-756f81257822 req-4a5a7edc-d109-41dd-a531-fb1783b96c1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cac17f47-6e08-4f15-a8cf-f5e44ad03d12", "name": "network-vif-plugged", "status": "completed", "tag": "7d0fd053-123c-4222-8389-3499f91d9b8c"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:49:42.440618 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-c1bd1fbd-117e-4a1f-b840-756f81257822 req-4a5a7edc-d109-41dd-a531-fb1783b96c1e service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:42.441097 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-c1bd1fbd-117e-4a1f-b840-756f81257822 req-4a5a7edc-d109-41dd-a531-fb1783b96c1e service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:42.441528 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-c1bd1fbd-117e-4a1f-b840-756f81257822 req-4a5a7edc-d109-41dd-a531-fb1783b96c1e service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:42.473545 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-c1bd1fbd-117e-4a1f-b840-756f81257822 req-4a5a7edc-d109-41dd-a531-fb1783b96c1e service nova] Creating event network-vif-plugged:7d0fd053-123c-4222-8389-3499f91d9b8c for instance cac17f47-6e08-4f15-a8cf-f5e44ad03d12 on n-h1-852278-4 Aug 27 02:49:42.486854 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-c1bd1fbd-117e-4a1f-b840-756f81257822 req-4a5a7edc-d109-41dd-a531-fb1783b96c1e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077498 Aug 27 02:49:42.488082 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1051/2071] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:49:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:49:42.661235 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-33edd120-d045-45ac-b180-b9b23bbb2db0 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:42.661948 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-33edd120-d045-45ac-b180-b9b23bbb2db0 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: cac17f47-6e08-4f15-a8cf-f5e44ad03d12] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:42.677615 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-33edd120-d045-45ac-b180-b9b23bbb2db0 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:42.678523 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-33edd120-d045-45ac-b180-b9b23bbb2db0 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:42.680295 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-33edd120-d045-45ac-b180-b9b23bbb2db0 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:42.688264 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-33edd120-d045-45ac-b180-b9b23bbb2db0 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:42.689919 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-33edd120-d045-45ac-b180-b9b23bbb2db0 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:42.691225 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-33edd120-d045-45ac-b180-b9b23bbb2db0 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:43.165554 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-33edd120-d045-45ac-b180-b9b23bbb2db0 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:43.177717 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-33edd120-d045-45ac-b180-b9b23bbb2db0 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/cac17f47-6e08-4f15-a8cf-f5e44ad03d12" status: 200 len: 1311 microversion: 2.1 time: 0.527515 Aug 27 02:49:43.178731 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1052/2072] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:42 2022] GET /compute/v2.1/servers/cac17f47-6e08-4f15-a8cf-f5e44ad03d12 => generated 1311 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:43.246282 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-72c645f0-2ee2-45c5-850f-8e352c44ede7 tempest-SecurityGroupsNegativeTestJSON-128170327 tempest-SecurityGroupsNegativeTestJSON-128170327-project] Calling method '.version_select at 0x7f5ee7234670>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:43.340030 n-d-852278-4 devstack@n-api.service[134052]: DEBUG neutronclient.v2_0.client [None req-72c645f0-2ee2-45c5-850f-8e352c44ede7 tempest-SecurityGroupsNegativeTestJSON-128170327 tempest-SecurityGroupsNegativeTestJSON-128170327-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9f7e5134-1440-41cf-af2b-afb5747a1c17 does not exist", "detail": ""}} {{(pid=134052) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 02:49:43.340689 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.network.security_group_api [None req-72c645f0-2ee2-45c5-850f-8e352c44ede7 tempest-SecurityGroupsNegativeTestJSON-128170327 tempest-SecurityGroupsNegativeTestJSON-128170327-project] Neutron security group 9f7e5134-1440-41cf-af2b-afb5747a1c17 not found {{(pid=134052) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 27 02:49:43.341416 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-72c645f0-2ee2-45c5-850f-8e352c44ede7 tempest-SecurityGroupsNegativeTestJSON-128170327 tempest-SecurityGroupsNegativeTestJSON-128170327-project] HTTP exception thrown: Security group 9f7e5134-1440-41cf-af2b-afb5747a1c17 does not exist Aug 27 02:49:43.341416 n-d-852278-4 devstack@n-api.service[134052]: Neutron server returns request_ids: ['req-bd660187-2afd-470e-a17e-7610d39335b8'] Aug 27 02:49:43.343974 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-72c645f0-2ee2-45c5-850f-8e352c44ede7 tempest-SecurityGroupsNegativeTestJSON-128170327 tempest-SecurityGroupsNegativeTestJSON-128170327-project] Request method failure captured: Aug 27 02:49:43.343974 n-d-852278-4 devstack@n-api.service[134052]: request: DELETE /compute/v2.1/os-security-groups/9f7e5134-1440-41cf-af2b-afb5747a1c17 HTTP/1.1 Aug 27 02:49:43.343974 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:49:43.343974 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:49:43.343974 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:49:43.343974 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:49:43.343974 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:49:43.343974 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:49:43.343974 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:49:43.343974 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:49:43.343974 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYZGInBS-AmacldjEgirChDyKxNny0i3veSrf2IKUre5cFQldNUQ9BkjlNPvElvHqkaaP9M7N6zns1wHy2P8R-KyoY-fNOMfpVFd5YWQt7VTnMwH3JCnN8hbP3xRuC_2e_WRUdHHt5rArbz-H9FrXPnLlrE5jyDys8mc67I9rVdBGZo Aug 27 02:49:43.343974 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:49:43.343974 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:49:43.343974 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:49:43.343974 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:49:43.343974 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:49:43.343974 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:49:43.343974 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 64fc12e5b7a34ca39d2a728a0e2291f8 Aug 27 02:49:43.343974 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-128170327 Aug 27 02:49:43.343974 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:49:43.343974 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:49:43.343974 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/64fc12e5b7a34ca39d2a728a0e2291f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_64fc12e5b7a34ca39d2a728a0e2291f8", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/64fc12e5b7a34ca39d2a728a0e2291f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/64fc12e5b7a34ca39d2a728a0e2291f8"}]}] Aug 27 02:49:43.343974 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-128170327 Aug 27 02:49:43.343974 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 64fc12e5b7a34ca39d2a728a0e2291f8 Aug 27 02:49:43.343974 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-128170327 Aug 27 02:49:43.343974 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-SecurityGroupsNegativeTestJSON-128170327-project Aug 27 02:49:43.343974 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:49:43.343974 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:49:43.343974 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: ffc6bff676f348dca981ae9808d78022 Aug 27 02:49:43.343974 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-128170327-project Aug 27 02:49:43.343974 n-d-852278-4 devstack@n-api.service[134052]: method: Aug 27 02:49:43.343974 n-d-852278-4 devstack@n-api.service[134052]: exception: Security group 9f7e5134-1440-41cf-af2b-afb5747a1c17 does not exist Aug 27 02:49:43.343974 n-d-852278-4 devstack@n-api.service[134052]: Neutron server returns request_ids: ['req-bd660187-2afd-470e-a17e-7610d39335b8'] Aug 27 02:49:43.343974 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '9f7e5134-1440-41cf-af2b-afb5747a1c17'} Aug 27 02:49:43.343974 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:49:43.343974 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:43.343974 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 27 02:49:43.343974 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 27 02:49:43.343974 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:49:43.343974 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:49:43.343974 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 27 02:49:43.343974 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 27 02:49:43.343974 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:49:43.343974 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:49:43.343974 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 02:49:43.343974 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 02:49:43.343974 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:49:43.343974 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:49:43.343974 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 02:49:43.343974 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 02:49:43.343974 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:49:43.343974 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:49:43.343974 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 02:49:43.343974 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 02:49:43.343974 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:49:43.343974 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:49:43.343974 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 02:49:43.343974 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 02:49:43.343974 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 02:49:43.343974 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 02:49:43.343974 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 9f7e5134-1440-41cf-af2b-afb5747a1c17 does not exist Aug 27 02:49:43.349941 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bd660187-2afd-470e-a17e-7610d39335b8'] Aug 27 02:49:43.349941 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:49:43.349941 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:49:43.349941 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:49:43.349941 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:43.349941 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 27 02:49:43.349941 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 27 02:49:43.349941 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 27 02:49:43.349941 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 27 02:49:43.349941 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 9f7e5134-1440-41cf-af2b-afb5747a1c17 does not exist Aug 27 02:49:43.349941 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bd660187-2afd-470e-a17e-7610d39335b8'] Aug 27 02:49:43.349941 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:49:43.349941 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:49:43.349941 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:49:43.349941 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:43.349941 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:49:43.349941 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:49:43.349941 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:49:43.349941 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:49:43.349941 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:49:43.349941 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:49:43.349941 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:49:43.349941 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:49:43.349941 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 27 02:49:43.349941 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 27 02:49:43.349941 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 9f7e5134-1440-41cf-af2b-afb5747a1c17 does not exist Aug 27 02:49:43.349941 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bd660187-2afd-470e-a17e-7610d39335b8'] Aug 27 02:49:43.349941 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:49:43.349941 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:49:43.349941 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:49:43.349941 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:43.349941 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:49:43.349941 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:49:43.349941 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:49:43.349941 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:49:43.349941 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 9f7e5134-1440-41cf-af2b-afb5747a1c17 does not exist Aug 27 02:49:43.349941 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bd660187-2afd-470e-a17e-7610d39335b8'] Aug 27 02:49:43.349941 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:49:43.349941 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-72c645f0-2ee2-45c5-850f-8e352c44ede7 tempest-SecurityGroupsNegativeTestJSON-128170327 tempest-SecurityGroupsNegativeTestJSON-128170327-project] Returning 404 to user: Security group 9f7e5134-1440-41cf-af2b-afb5747a1c17 does not exist Aug 27 02:49:43.349941 n-d-852278-4 devstack@n-api.service[134052]: Neutron server returns request_ids: ['req-bd660187-2afd-470e-a17e-7610d39335b8'] {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:49:43.349941 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-72c645f0-2ee2-45c5-850f-8e352c44ede7 tempest-SecurityGroupsNegativeTestJSON-128170327 tempest-SecurityGroupsNegativeTestJSON-128170327-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/9f7e5134-1440-41cf-af2b-afb5747a1c17" status: 404 len: 194 microversion: 2.1 time: 0.166162 Aug 27 02:49:43.349941 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1053/2073] 10.222.0.70 () {58 vars in 1272 bytes} [Sat Aug 27 02:49:43 2022] DELETE /compute/v2.1/os-security-groups/9f7e5134-1440-41cf-af2b-afb5747a1c17 => generated 194 bytes in 167 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:49:43.365949 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-bbd3b9d6-59ee-4e37-8dec-4a82de3c4759 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:43.366614 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-bbd3b9d6-59ee-4e37-8dec-4a82de3c4759 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] [instance: 191df585-2175-47be-9bd8-29b914535f47] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:43.393274 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bbd3b9d6-59ee-4e37-8dec-4a82de3c4759 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:43.393770 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bbd3b9d6-59ee-4e37-8dec-4a82de3c4759 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:43.400105 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bbd3b9d6-59ee-4e37-8dec-4a82de3c4759 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:43.400917 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bbd3b9d6-59ee-4e37-8dec-4a82de3c4759 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:43.401572 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bbd3b9d6-59ee-4e37-8dec-4a82de3c4759 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:43.404598 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bbd3b9d6-59ee-4e37-8dec-4a82de3c4759 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:43.438619 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-bbd3b9d6-59ee-4e37-8dec-4a82de3c4759 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] HTTP exception thrown: Instance 191df585-2175-47be-9bd8-29b914535f47 could not be found. Aug 27 02:49:43.440165 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-bbd3b9d6-59ee-4e37-8dec-4a82de3c4759 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Request method failure captured: Aug 27 02:49:43.440165 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/servers/191df585-2175-47be-9bd8-29b914535f47 HTTP/1.1 Aug 27 02:49:43.440165 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:49:43.440165 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:49:43.440165 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:49:43.440165 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:49:43.440165 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:49:43.440165 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:49:43.440165 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:49:43.440165 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:49:43.440165 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYW1kKk6CTqFXOURMHzia0PmXPGuXD7SW8X0q8r04-3F5dhqRD2r69XpSQOmaZP_C1lUMmww913w49a8nshk4e34UJMe5OxfB9S2G5OajSVJTZvIgdxvUhhBdGUB_PAgfktlu4E09zLiDMVOf808HMketHHgLeIgG28pstLBgYfVtvw Aug 27 02:49:43.440165 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:49:43.440165 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:49:43.440165 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:49:43.440165 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:49:43.440165 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:49:43.440165 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:49:43.440165 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 5ae1f9ee6b7e49849b68b3628b76766a Aug 27 02:49:43.440165 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ListImageFiltersTestJSON-1122911400 Aug 27 02:49:43.440165 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:49:43.440165 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:49:43.440165 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5ae1f9ee6b7e49849b68b3628b76766a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_5ae1f9ee6b7e49849b68b3628b76766a", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5ae1f9ee6b7e49849b68b3628b76766a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/5ae1f9ee6b7e49849b68b3628b76766a"}]}] Aug 27 02:49:43.440165 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ListImageFiltersTestJSON-1122911400 Aug 27 02:49:43.440165 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 5ae1f9ee6b7e49849b68b3628b76766a Aug 27 02:49:43.440165 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1122911400 Aug 27 02:49:43.440165 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ListImageFiltersTestJSON-1122911400-project Aug 27 02:49:43.440165 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:49:43.440165 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:49:43.440165 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 1d626281a9864fe7aed598d4be209137 Aug 27 02:49:43.440165 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ListImageFiltersTestJSON-1122911400-project Aug 27 02:49:43.440165 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 02:49:43.440165 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance 191df585-2175-47be-9bd8-29b914535f47 could not be found. Aug 27 02:49:43.440165 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '191df585-2175-47be-9bd8-29b914535f47'} Aug 27 02:49:43.440165 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:49:43.440165 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:43.440165 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:49:43.440165 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:49:43.440165 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:49:43.440165 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:49:43.440165 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:49:43.440165 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:49:43.440165 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:49:43.440165 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:49:43.440165 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 191df585-2175-47be-9bd8-29b914535f47 could not be found. Aug 27 02:49:43.440165 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:49:43.440165 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:49:43.440165 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:49:43.440165 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:43.440165 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:49:43.440165 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:49:43.440165 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:49:43.440165 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:49:43.440165 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:49:43.440165 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:49:43.440165 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:49:43.440165 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:49:43.440165 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:49:43.440165 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:49:43.440165 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:49:43.440165 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:49:43.440165 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 191df585-2175-47be-9bd8-29b914535f47 could not be found. Aug 27 02:49:43.440165 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:49:43.440165 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:49:43.440165 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:49:43.445668 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:43.445668 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:49:43.445668 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:49:43.445668 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:49:43.445668 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:49:43.445668 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 191df585-2175-47be-9bd8-29b914535f47 could not be found. Aug 27 02:49:43.445668 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:49:43.449311 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-bbd3b9d6-59ee-4e37-8dec-4a82de3c4759 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Returning 404 to user: Instance 191df585-2175-47be-9bd8-29b914535f47 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:49:43.450351 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-bbd3b9d6-59ee-4e37-8dec-4a82de3c4759 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] 10.222.0.70 "GET /compute/v2.1/servers/191df585-2175-47be-9bd8-29b914535f47" status: 404 len: 111 microversion: 2.1 time: 0.097915 Aug 27 02:49:43.451388 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1054/2074] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:43 2022] GET /compute/v2.1/servers/191df585-2175-47be-9bd8-29b914535f47 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:49:43.468634 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-67e07dd4-7e99-42cb-8996-280dada3936f tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:43.469445 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-67e07dd4-7e99-42cb-8996-280dada3936f tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] [instance: 14df3dce-7fb6-491c-9559-6fbca68580b0] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:43.499233 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-67e07dd4-7e99-42cb-8996-280dada3936f tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:43.500378 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-67e07dd4-7e99-42cb-8996-280dada3936f tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:43.501075 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-67e07dd4-7e99-42cb-8996-280dada3936f tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:43.503425 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-67e07dd4-7e99-42cb-8996-280dada3936f tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:43.504196 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-67e07dd4-7e99-42cb-8996-280dada3936f tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:43.505817 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-67e07dd4-7e99-42cb-8996-280dada3936f tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:44.691581 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-67e07dd4-7e99-42cb-8996-280dada3936f tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c5ce6f32ec4c979dda7ead8962a1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76872eddea474d77850d528d56120b3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:44.697167 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=100 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:49:44.704679 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-67e07dd4-7e99-42cb-8996-280dada3936f tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] 10.222.0.70 "GET /compute/v2.1/servers/14df3dce-7fb6-491c-9559-6fbca68580b0" status: 200 len: 1350 microversion: 2.1 time: 1.252044 Aug 27 02:49:44.707570 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1055/2075] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:43 2022] GET /compute/v2.1/servers/14df3dce-7fb6-491c-9559-6fbca68580b0 => generated 1350 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:44.718125 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-1de2ecc1-dcc3-4850-8166-fe4c51a8aa46 tempest-SecurityGroupsNegativeTestJSON-128170327 tempest-SecurityGroupsNegativeTestJSON-128170327-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.004055 Aug 27 02:49:44.718710 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1056/2076] 10.222.0.70 () {58 vars in 1164 bytes} [Sat Aug 27 02:49:44 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 27 02:49:44.729170 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-068d09b7-52c5-48df-88ff-24cfab37f631 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:44.733884 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-068d09b7-52c5-48df-88ff-24cfab37f631 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] [instance: 57a1e617-8846-4da8-b84f-232ffc519f69] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:44.746534 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-068d09b7-52c5-48df-88ff-24cfab37f631 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:44.751657 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-068d09b7-52c5-48df-88ff-24cfab37f631 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:44.752328 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-068d09b7-52c5-48df-88ff-24cfab37f631 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:44.753290 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-068d09b7-52c5-48df-88ff-24cfab37f631 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:44.754785 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-068d09b7-52c5-48df-88ff-24cfab37f631 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:44.755370 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-068d09b7-52c5-48df-88ff-24cfab37f631 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:44.999173 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-068d09b7-52c5-48df-88ff-24cfab37f631 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece67529f3704d9faf0ff443d7c016de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c13c5aeb4da472da020639d5b6ad5aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:45.008205 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-068d09b7-52c5-48df-88ff-24cfab37f631 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] 10.222.0.70 "GET /compute/v2.1/servers/57a1e617-8846-4da8-b84f-232ffc519f69" status: 200 len: 1290 microversion: 2.1 time: 0.288449 Aug 27 02:49:45.014933 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1057/2077] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:44 2022] GET /compute/v2.1/servers/57a1e617-8846-4da8-b84f-232ffc519f69 => generated 1290 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:45.020064 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5a3fced4-a896-407c-9cfd-ea6a786097b0 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Calling method '.version_select at 0x7f5ee7196a60>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:45.487450 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-5a3fced4-a896-407c-9cfd-ea6a786097b0 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] 10.222.0.70 "DELETE /compute/v2.1/images/8020a5cf-898b-4943-890d-dcd7b7876c94" status: 204 len: 0 microversion: 2.1 time: 0.470940 Aug 27 02:49:45.488164 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1058/2078] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:45 2022] DELETE /compute/v2.1/images/8020a5cf-898b-4943-890d-dcd7b7876c94 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:49:45.494047 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8fc6b4b5-c38c-4700-851a-d75894dc80a7 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:45.494961 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-8fc6b4b5-c38c-4700-851a-d75894dc80a7 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: cac17f47-6e08-4f15-a8cf-f5e44ad03d12] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:45.509598 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8fc6b4b5-c38c-4700-851a-d75894dc80a7 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:45.515595 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8fc6b4b5-c38c-4700-851a-d75894dc80a7 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:45.516621 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8fc6b4b5-c38c-4700-851a-d75894dc80a7 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:45.517612 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8fc6b4b5-c38c-4700-851a-d75894dc80a7 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:45.518298 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8fc6b4b5-c38c-4700-851a-d75894dc80a7 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:45.520536 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8fc6b4b5-c38c-4700-851a-d75894dc80a7 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:46.973507 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-8fc6b4b5-c38c-4700-851a-d75894dc80a7 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:47.004238 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-8fc6b4b5-c38c-4700-851a-d75894dc80a7 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/cac17f47-6e08-4f15-a8cf-f5e44ad03d12" status: 200 len: 1461 microversion: 2.1 time: 1.512766 Aug 27 02:49:47.007696 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1059/2079] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:45 2022] GET /compute/v2.1/servers/cac17f47-6e08-4f15-a8cf-f5e44ad03d12 => generated 1461 bytes in 1519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:47.017466 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-53892f9b-1a36-4de7-a344-e7367204c9f0 req-8728f53c-9125-4587-81c9-71f6d001fd20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "191df585-2175-47be-9bd8-29b914535f47", "name": "network-vif-deleted", "tag": "178a305e-f6ec-4889-9602-1513853a515b"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:49:47.037406 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-53892f9b-1a36-4de7-a344-e7367204c9f0 req-8728f53c-9125-4587-81c9-71f6d001fd20 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:47.038152 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-53892f9b-1a36-4de7-a344-e7367204c9f0 req-8728f53c-9125-4587-81c9-71f6d001fd20 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:47.038727 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-53892f9b-1a36-4de7-a344-e7367204c9f0 req-8728f53c-9125-4587-81c9-71f6d001fd20 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:47.051094 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-53892f9b-1a36-4de7-a344-e7367204c9f0 req-8728f53c-9125-4587-81c9-71f6d001fd20 service nova] Creating event network-vif-deleted:178a305e-f6ec-4889-9602-1513853a515b for instance 191df585-2175-47be-9bd8-29b914535f47 on n-h2-852278-4 Aug 27 02:49:47.091912 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-53892f9b-1a36-4de7-a344-e7367204c9f0 req-8728f53c-9125-4587-81c9-71f6d001fd20 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080504 Aug 27 02:49:47.092907 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1060/2080] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:49:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:49:47.104972 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4023284e-91c2-44b3-a700-d1d59d73a893 tempest-SecurityGroupsNegativeTestJSON-128170327 tempest-SecurityGroupsNegativeTestJSON-128170327-project] Calling method '.version_select at 0x7f5ee7234160>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:48.140849 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-4023284e-91c2-44b3-a700-d1d59d73a893 tempest-SecurityGroupsNegativeTestJSON-128170327 tempest-SecurityGroupsNegativeTestJSON-128170327-project] 10.222.0.70 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 1.046111 Aug 27 02:49:48.141529 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1061/2081] 10.222.0.70 () {58 vars in 1158 bytes} [Sat Aug 27 02:49:47 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:49:48.146824 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b9082a0a-02da-44db-956f-3d2c68015372 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Calling method '.version_select at 0x7f5ee724f790>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:48.541848 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b9082a0a-02da-44db-956f-3d2c68015372 tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] 10.222.0.70 "DELETE /compute/v2.1/images/ad164dff-00dc-46d7-a144-6b41f4ecabd8" status: 204 len: 0 microversion: 2.1 time: 0.398134 Aug 27 02:49:48.542985 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1062/2082] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:48 2022] DELETE /compute/v2.1/images/ad164dff-00dc-46d7-a144-6b41f4ecabd8 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:49:48.548899 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-8cafce77-4434-42a9-b83e-29a6c250bdcf req-e3031504-c6b7-4a0c-a1b9-783740305a1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14df3dce-7fb6-491c-9559-6fbca68580b0", "name": "network-vif-plugged", "status": "completed", "tag": "7484d94b-dbe7-4864-b57a-8baf10193a92"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:49:48.561633 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.network.neutron [None req-72aadda5-e018-4bb7-95b7-cb292254255a tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] [instance: 26795af5-99b8-4a26-9843-3781a5016217] re-assign floating IP 172.25.0.59 from instance e445cdc5-5ecb-487c-adee-f5cb9862283c Aug 27 02:49:48.575126 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-8cafce77-4434-42a9-b83e-29a6c250bdcf req-e3031504-c6b7-4a0c-a1b9-783740305a1f service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:48.576773 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-8cafce77-4434-42a9-b83e-29a6c250bdcf req-e3031504-c6b7-4a0c-a1b9-783740305a1f service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:48.577493 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-8cafce77-4434-42a9-b83e-29a6c250bdcf req-e3031504-c6b7-4a0c-a1b9-783740305a1f service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:48.608895 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-8cafce77-4434-42a9-b83e-29a6c250bdcf req-e3031504-c6b7-4a0c-a1b9-783740305a1f service nova] Creating event network-vif-plugged:7484d94b-dbe7-4864-b57a-8baf10193a92 for instance 14df3dce-7fb6-491c-9559-6fbca68580b0 on n-h2-852278-4 Aug 27 02:49:48.622185 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-8cafce77-4434-42a9-b83e-29a6c250bdcf req-e3031504-c6b7-4a0c-a1b9-783740305a1f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077422 Aug 27 02:49:48.623124 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1063/2083] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:49:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:49:48.628389 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a8c06df7-bb11-42f4-9f5c-fd47f083feef tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:48.629190 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a8c06df7-bb11-42f4-9f5c-fd47f083feef tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] [instance: 14df3dce-7fb6-491c-9559-6fbca68580b0] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:48.639605 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a8c06df7-bb11-42f4-9f5c-fd47f083feef tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:48.640111 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a8c06df7-bb11-42f4-9f5c-fd47f083feef tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:48.640565 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a8c06df7-bb11-42f4-9f5c-fd47f083feef tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:48.641280 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a8c06df7-bb11-42f4-9f5c-fd47f083feef tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:48.641724 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a8c06df7-bb11-42f4-9f5c-fd47f083feef tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:48.642143 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a8c06df7-bb11-42f4-9f5c-fd47f083feef tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:48.655514 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.network.neutron [None req-72aadda5-e018-4bb7-95b7-cb292254255a tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] [instance: e445cdc5-5ecb-487c-adee-f5cb9862283c] Building network info cache for instance {{(pid=134051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 27 02:49:49.436482 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-a8c06df7-bb11-42f4-9f5c-fd47f083feef tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c5ce6f32ec4c979dda7ead8962a1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76872eddea474d77850d528d56120b3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:49.454226 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a8c06df7-bb11-42f4-9f5c-fd47f083feef tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] 10.222.0.70 "GET /compute/v2.1/servers/14df3dce-7fb6-491c-9559-6fbca68580b0" status: 200 len: 1350 microversion: 2.1 time: 0.829294 Aug 27 02:49:49.468248 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1064/2084] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:48 2022] GET /compute/v2.1/servers/14df3dce-7fb6-491c-9559-6fbca68580b0 => generated 1350 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:49.472472 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-808c1931-6579-4d9b-8052-ddf926996097 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:49.473057 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-808c1931-6579-4d9b-8052-ddf926996097 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] [instance: 57a1e617-8846-4da8-b84f-232ffc519f69] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:49.482326 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-808c1931-6579-4d9b-8052-ddf926996097 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:49.482812 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-808c1931-6579-4d9b-8052-ddf926996097 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:49.483246 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-808c1931-6579-4d9b-8052-ddf926996097 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:49.483954 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-808c1931-6579-4d9b-8052-ddf926996097 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:49.484431 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-808c1931-6579-4d9b-8052-ddf926996097 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:49.484845 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-808c1931-6579-4d9b-8052-ddf926996097 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:49.898004 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-808c1931-6579-4d9b-8052-ddf926996097 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece67529f3704d9faf0ff443d7c016de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c13c5aeb4da472da020639d5b6ad5aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:49.909207 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-808c1931-6579-4d9b-8052-ddf926996097 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] 10.222.0.70 "GET /compute/v2.1/servers/57a1e617-8846-4da8-b84f-232ffc519f69" status: 200 len: 1332 microversion: 2.1 time: 0.444349 Aug 27 02:49:49.909863 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1065/2085] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:49 2022] GET /compute/v2.1/servers/57a1e617-8846-4da8-b84f-232ffc519f69 => generated 1332 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:49.929880 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e94ce069-6e7e-4984-9c22-d3d802ba019f tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:49:49.933127 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-e94ce069-6e7e-4984-9c22-d3d802ba019f tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: cac17f47-6e08-4f15-a8cf-f5e44ad03d12] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:49.942269 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e94ce069-6e7e-4984-9c22-d3d802ba019f tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:49.943484 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e94ce069-6e7e-4984-9c22-d3d802ba019f tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:49.943957 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e94ce069-6e7e-4984-9c22-d3d802ba019f tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:49.944925 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e94ce069-6e7e-4984-9c22-d3d802ba019f tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:49.945375 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e94ce069-6e7e-4984-9c22-d3d802ba019f tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:49.952612 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e94ce069-6e7e-4984-9c22-d3d802ba019f tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:50.126688 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.network.neutron [None req-72aadda5-e018-4bb7-95b7-cb292254255a tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] [instance: e445cdc5-5ecb-487c-adee-f5cb9862283c] Updating instance_info_cache with network_info: [{"id": "42ac4b18-965a-486a-8d1d-80c016c9888c", "address": "fa:16:3e:d3:42:65", "network": {"id": "56c1e6e5-f638-4015-aee9-61020b017eac", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-265073614-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "4f9be56fbeb64cb08b9be4e3d7436782", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap42ac4b18-96", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=134051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 27 02:49:50.154554 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.network.neutron [None req-72aadda5-e018-4bb7-95b7-cb292254255a tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] [instance: 26795af5-99b8-4a26-9843-3781a5016217] Building network info cache for instance {{(pid=134051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 27 02:49:50.178325 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-e94ce069-6e7e-4984-9c22-d3d802ba019f tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:50.188225 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-e94ce069-6e7e-4984-9c22-d3d802ba019f tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: cac17f47-6e08-4f15-a8cf-f5e44ad03d12] Old instance type m1.heat2, new instance type m1.heat {{(pid=134052) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 27 02:49:50.196658 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-e94ce069-6e7e-4984-9c22-d3d802ba019f tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Flavor limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:49:50.197786 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-e94ce069-6e7e-4984-9c22-d3d802ba019f tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Image limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:49:50.199132 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-e94ce069-6e7e-4984-9c22-d3d802ba019f tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Flavor pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:49:50.199705 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-e94ce069-6e7e-4984-9c22-d3d802ba019f tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Image pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:49:50.200618 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-e94ce069-6e7e-4984-9c22-d3d802ba019f tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:49:50.431809 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e94ce069-6e7e-4984-9c22-d3d802ba019f tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "POST /compute/v2.1/servers/cac17f47-6e08-4f15-a8cf-f5e44ad03d12/action" status: 202 len: 0 microversion: 2.1 time: 0.517055 Aug 27 02:49:50.434348 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1066/2086] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 02:49:49 2022] POST /compute/v2.1/servers/cac17f47-6e08-4f15-a8cf-f5e44ad03d12/action => generated 0 bytes in 524 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:49:50.446644 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f2f32502-d8e7-4efb-9704-dd953419ead8 tempest-SecurityGroupsNegativeTestJSON-128170327 tempest-SecurityGroupsNegativeTestJSON-128170327-project] Calling method '.version_select at 0x7f5ee71f48b0>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:50.629078 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:49:50.740527 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=6 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:49:50.839053 n-d-852278-4 devstack@n-api.service[134052]: DEBUG neutronclient.v2_0.client [None req-f2f32502-d8e7-4efb-9704-dd953419ead8 tempest-SecurityGroupsNegativeTestJSON-128170327 tempest-SecurityGroupsNegativeTestJSON-128170327-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=134052) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 02:49:50.840010 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-f2f32502-d8e7-4efb-9704-dd953419ead8 tempest-SecurityGroupsNegativeTestJSON-128170327 tempest-SecurityGroupsNegativeTestJSON-128170327-project] HTTP exception thrown: Insufficient rights for removing default security group. Aug 27 02:49:50.840010 n-d-852278-4 devstack@n-api.service[134052]: Neutron server returns request_ids: ['req-4f5b734c-4fc3-40d0-b7f5-017d3bba45f8'] Aug 27 02:49:50.842228 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f2f32502-d8e7-4efb-9704-dd953419ead8 tempest-SecurityGroupsNegativeTestJSON-128170327 tempest-SecurityGroupsNegativeTestJSON-128170327-project] Request method failure captured: Aug 27 02:49:50.842228 n-d-852278-4 devstack@n-api.service[134052]: request: DELETE /compute/v2.1/os-security-groups/afa9f506-6d8b-4531-bf8d-49910bd6858f HTTP/1.1 Aug 27 02:49:50.842228 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:49:50.842228 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:49:50.842228 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:49:50.842228 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:49:50.842228 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:49:50.842228 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:49:50.842228 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:49:50.842228 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:49:50.842228 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYZGInBS-AmacldjEgirChDyKxNny0i3veSrf2IKUre5cFQldNUQ9BkjlNPvElvHqkaaP9M7N6zns1wHy2P8R-KyoY-fNOMfpVFd5YWQt7VTnMwH3JCnN8hbP3xRuC_2e_WRUdHHt5rArbz-H9FrXPnLlrE5jyDys8mc67I9rVdBGZo Aug 27 02:49:50.842228 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:49:50.842228 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:49:50.842228 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:49:50.842228 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:49:50.842228 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:49:50.842228 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:49:50.842228 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 64fc12e5b7a34ca39d2a728a0e2291f8 Aug 27 02:49:50.842228 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-128170327 Aug 27 02:49:50.842228 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:49:50.842228 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:49:50.842228 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/64fc12e5b7a34ca39d2a728a0e2291f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_64fc12e5b7a34ca39d2a728a0e2291f8", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/64fc12e5b7a34ca39d2a728a0e2291f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/64fc12e5b7a34ca39d2a728a0e2291f8"}]}] Aug 27 02:49:50.842228 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-128170327 Aug 27 02:49:50.842228 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 64fc12e5b7a34ca39d2a728a0e2291f8 Aug 27 02:49:50.842228 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-128170327 Aug 27 02:49:50.842228 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-SecurityGroupsNegativeTestJSON-128170327-project Aug 27 02:49:50.842228 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:49:50.842228 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:49:50.842228 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: ffc6bff676f348dca981ae9808d78022 Aug 27 02:49:50.842228 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-128170327-project Aug 27 02:49:50.842228 n-d-852278-4 devstack@n-api.service[134052]: method: Aug 27 02:49:50.842228 n-d-852278-4 devstack@n-api.service[134052]: exception: Insufficient rights for removing default security group. Aug 27 02:49:50.842228 n-d-852278-4 devstack@n-api.service[134052]: Neutron server returns request_ids: ['req-4f5b734c-4fc3-40d0-b7f5-017d3bba45f8'] Aug 27 02:49:50.842228 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': 'afa9f506-6d8b-4531-bf8d-49910bd6858f'} Aug 27 02:49:50.842228 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:49:50.842228 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:50.842228 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 27 02:49:50.842228 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 27 02:49:50.842228 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:49:50.842228 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:49:50.842228 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 27 02:49:50.842228 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 27 02:49:50.842228 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:49:50.842228 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:49:50.842228 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 27 02:49:50.842228 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 27 02:49:50.842228 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:49:50.842228 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:49:50.842228 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 02:49:50.842228 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 02:49:50.842228 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:49:50.842228 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:49:50.842228 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 02:49:50.842228 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 02:49:50.842228 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:49:50.842228 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:49:50.842228 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 02:49:50.842228 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 02:49:50.842228 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 02:49:50.842228 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 02:49:50.842228 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Aug 27 02:49:50.846151 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4f5b734c-4fc3-40d0-b7f5-017d3bba45f8'] Aug 27 02:49:50.846151 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:49:50.846151 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:49:50.846151 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:49:50.846151 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:50.846151 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 27 02:49:50.846151 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 27 02:49:50.846151 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 27 02:49:50.846151 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 27 02:49:50.846151 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Aug 27 02:49:50.846151 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4f5b734c-4fc3-40d0-b7f5-017d3bba45f8'] Aug 27 02:49:50.846151 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:49:50.846151 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:49:50.846151 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:49:50.846151 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:50.846151 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:49:50.846151 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:49:50.846151 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:49:50.846151 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:49:50.846151 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:49:50.846151 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:49:50.846151 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:49:50.846151 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:49:50.846151 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 27 02:49:50.846151 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 27 02:49:50.846151 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Aug 27 02:49:50.846151 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4f5b734c-4fc3-40d0-b7f5-017d3bba45f8'] Aug 27 02:49:50.846151 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:49:50.846151 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:49:50.846151 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:49:50.846151 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:50.846151 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:49:50.846151 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:49:50.846151 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:49:50.846151 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:49:50.846151 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Aug 27 02:49:50.846151 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4f5b734c-4fc3-40d0-b7f5-017d3bba45f8'] Aug 27 02:49:50.846151 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:49:50.849641 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f2f32502-d8e7-4efb-9704-dd953419ead8 tempest-SecurityGroupsNegativeTestJSON-128170327 tempest-SecurityGroupsNegativeTestJSON-128170327-project] Returning 400 to user: Insufficient rights for removing default security group. Aug 27 02:49:50.849641 n-d-852278-4 devstack@n-api.service[134052]: Neutron server returns request_ids: ['req-4f5b734c-4fc3-40d0-b7f5-017d3bba45f8'] {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:49:50.851481 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f2f32502-d8e7-4efb-9704-dd953419ead8 tempest-SecurityGroupsNegativeTestJSON-128170327 tempest-SecurityGroupsNegativeTestJSON-128170327-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/afa9f506-6d8b-4531-bf8d-49910bd6858f" status: 400 len: 182 microversion: 2.1 time: 0.415851 Aug 27 02:49:50.853510 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1067/2087] 10.222.0.70 () {58 vars in 1272 bytes} [Sat Aug 27 02:49:50 2022] DELETE /compute/v2.1/os-security-groups/afa9f506-6d8b-4531-bf8d-49910bd6858f => generated 182 bytes in 418 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 02:49:50.865213 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-579735b7-ca85-45a8-9cb4-3560fcce332b tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] Calling method '.version_select at 0x7f5ee7196b80>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:51.299929 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-579735b7-ca85-45a8-9cb4-3560fcce332b tempest-ListImageFiltersTestJSON-1122911400 tempest-ListImageFiltersTestJSON-1122911400-project] 10.222.0.70 "DELETE /compute/v2.1/images/492b51ec-09ed-4626-9cdd-9d007fada80b" status: 204 len: 0 microversion: 2.1 time: 0.445140 Aug 27 02:49:51.300549 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1068/2088] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:50 2022] DELETE /compute/v2.1/images/492b51ec-09ed-4626-9cdd-9d007fada80b => generated 0 bytes in 446 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:49:51.340957 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.network.neutron [None req-72aadda5-e018-4bb7-95b7-cb292254255a tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] [instance: 26795af5-99b8-4a26-9843-3781a5016217] Updating instance_info_cache with network_info: [{"id": "072e51fc-e3f0-46c0-b5a9-45f131439621", "address": "fa:16:3e:3b:62:32", "network": {"id": "56c1e6e5-f638-4015-aee9-61020b017eac", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-265073614-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.0.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "4f9be56fbeb64cb08b9be4e3d7436782", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap072e51fc-e3", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=134051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 27 02:49:51.367726 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-72aadda5-e018-4bb7-95b7-cb292254255a tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Releasing lock "refresh_cache-26795af5-99b8-4a26-9843-3781a5016217" {{(pid=134051) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 27 02:49:51.368903 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-72aadda5-e018-4bb7-95b7-cb292254255a tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] 10.222.0.70 "POST /compute/v2.1/servers/26795af5-99b8-4a26-9843-3781a5016217/action" status: 202 len: 0 microversion: 2.1 time: 9.195036 Aug 27 02:49:51.369842 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1021/2089] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 02:49:42 2022] POST /compute/v2.1/servers/26795af5-99b8-4a26-9843-3781a5016217/action => generated 0 bytes in 9197 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 27 02:49:51.383374 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-6ad53ccc-4f85-42fe-acd5-ddc6cc8f4b71 req-4a772df7-3e0f-4da4-bd14-f0d355869360 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e445cdc5-5ecb-487c-adee-f5cb9862283c", "tag": "42ac4b18-965a-486a-8d1d-80c016c9888c"}, {"name": "network-changed", "server_uuid": "26795af5-99b8-4a26-9843-3781a5016217", "tag": "072e51fc-e3f0-46c0-b5a9-45f131439621"}, {"name": "network-changed", "server_uuid": "57a1e617-8846-4da8-b84f-232ffc519f69", "tag": "f1fc64b5-9211-456f-b514-94d86ae29282"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:49:51.402842 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-6ad53ccc-4f85-42fe-acd5-ddc6cc8f4b71 req-4a772df7-3e0f-4da4-bd14-f0d355869360 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:51.403276 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-6ad53ccc-4f85-42fe-acd5-ddc6cc8f4b71 req-4a772df7-3e0f-4da4-bd14-f0d355869360 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:51.403871 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-6ad53ccc-4f85-42fe-acd5-ddc6cc8f4b71 req-4a772df7-3e0f-4da4-bd14-f0d355869360 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:51.420787 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-6ad53ccc-4f85-42fe-acd5-ddc6cc8f4b71 req-4a772df7-3e0f-4da4-bd14-f0d355869360 service nova] Creating event network-changed:42ac4b18-965a-486a-8d1d-80c016c9888c for instance e445cdc5-5ecb-487c-adee-f5cb9862283c on n-h2-852278-4 Aug 27 02:49:51.424625 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-6ad53ccc-4f85-42fe-acd5-ddc6cc8f4b71 req-4a772df7-3e0f-4da4-bd14-f0d355869360 service nova] Creating event network-changed:072e51fc-e3f0-46c0-b5a9-45f131439621 for instance 26795af5-99b8-4a26-9843-3781a5016217 on n-h1-852278-4 Aug 27 02:49:51.425343 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-6ad53ccc-4f85-42fe-acd5-ddc6cc8f4b71 req-4a772df7-3e0f-4da4-bd14-f0d355869360 service nova] Creating event network-changed:f1fc64b5-9211-456f-b514-94d86ae29282 for instance 57a1e617-8846-4da8-b84f-232ffc519f69 on n-h2-852278-4 Aug 27 02:49:51.439119 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-6ad53ccc-4f85-42fe-acd5-ddc6cc8f4b71 req-4a772df7-3e0f-4da4-bd14-f0d355869360 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.065839 Aug 27 02:49:51.439782 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1022/2090] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:49:51 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:49:51.446390 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-83543df4-9b27-4f4e-8157-f98c635dae20 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:51.447196 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-83543df4-9b27-4f4e-8157-f98c635dae20 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: cac17f47-6e08-4f15-a8cf-f5e44ad03d12] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:51.455239 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-83543df4-9b27-4f4e-8157-f98c635dae20 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:51.467822 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4a5a6e39-080e-4e95-af26-0db27bcd78c2 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:51.468404 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-4a5a6e39-080e-4e95-af26-0db27bcd78c2 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] [instance: 484e03a9-aef3-4179-980c-0e7292a05b5a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:51.484246 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4a5a6e39-080e-4e95-af26-0db27bcd78c2 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:51.484724 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4a5a6e39-080e-4e95-af26-0db27bcd78c2 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:51.486648 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-83543df4-9b27-4f4e-8157-f98c635dae20 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:51.487045 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4a5a6e39-080e-4e95-af26-0db27bcd78c2 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:51.487194 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-83543df4-9b27-4f4e-8157-f98c635dae20 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:51.488031 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4a5a6e39-080e-4e95-af26-0db27bcd78c2 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:51.488518 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4a5a6e39-080e-4e95-af26-0db27bcd78c2 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:51.488946 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4a5a6e39-080e-4e95-af26-0db27bcd78c2 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:51.489220 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-83543df4-9b27-4f4e-8157-f98c635dae20 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:51.489698 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-83543df4-9b27-4f4e-8157-f98c635dae20 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:51.490127 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-83543df4-9b27-4f4e-8157-f98c635dae20 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:51.578225 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-4a5a6e39-080e-4e95-af26-0db27bcd78c2 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] [instance: 484e03a9-aef3-4179-980c-0e7292a05b5a] Going to try to terminate instance {{(pid=134052) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:49:51.780582 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-4a5a6e39-080e-4e95-af26-0db27bcd78c2 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] 10.222.0.70 "DELETE /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a" status: 204 len: 0 microversion: 2.42 time: 0.478284 Aug 27 02:49:51.781688 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1069/2091] 10.222.0.70 () {60 vars in 1280 bytes} [Sat Aug 27 02:49:51 2022] DELETE /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a => generated 0 bytes in 480 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 02:49:51.791523 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9b3ae596-ca87-4ffc-948f-e5655b7d9a74 tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:51.793069 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-9b3ae596-ca87-4ffc-948f-e5655b7d9a74 tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] [instance: 14df3dce-7fb6-491c-9559-6fbca68580b0] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:51.802108 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9b3ae596-ca87-4ffc-948f-e5655b7d9a74 tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:51.802611 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9b3ae596-ca87-4ffc-948f-e5655b7d9a74 tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:51.803321 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9b3ae596-ca87-4ffc-948f-e5655b7d9a74 tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:51.804052 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9b3ae596-ca87-4ffc-948f-e5655b7d9a74 tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:51.804531 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9b3ae596-ca87-4ffc-948f-e5655b7d9a74 tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:51.805402 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9b3ae596-ca87-4ffc-948f-e5655b7d9a74 tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:52.205560 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-9b3ae596-ca87-4ffc-948f-e5655b7d9a74 tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c5ce6f32ec4c979dda7ead8962a1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76872eddea474d77850d528d56120b3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:52.214631 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9b3ae596-ca87-4ffc-948f-e5655b7d9a74 tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] 10.222.0.70 "GET /compute/v2.1/servers/14df3dce-7fb6-491c-9559-6fbca68580b0" status: 200 len: 1539 microversion: 2.1 time: 0.428576 Aug 27 02:49:52.229390 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1070/2092] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:51 2022] GET /compute/v2.1/servers/14df3dce-7fb6-491c-9559-6fbca68580b0 => generated 1539 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:52.241439 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3465027b-6f82-4a39-b3f8-4f6a6b43b588 tempest-SecurityGroupsNegativeTestJSON-128170327 tempest-SecurityGroupsNegativeTestJSON-128170327-project] Calling method '.version_select at 0x7f5ee71a24c0>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:52.315253 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-83543df4-9b27-4f4e-8157-f98c635dae20 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:52.325224 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-83543df4-9b27-4f4e-8157-f98c635dae20 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/cac17f47-6e08-4f15-a8cf-f5e44ad03d12" status: 200 len: 1470 microversion: 2.1 time: 0.883969 Aug 27 02:49:52.325774 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1023/2093] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:51 2022] GET /compute/v2.1/servers/cac17f47-6e08-4f15-a8cf-f5e44ad03d12 => generated 1470 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:52.327738 n-d-852278-4 devstack@n-api.service[134052]: DEBUG neutronclient.v2_0.client [None req-3465027b-6f82-4a39-b3f8-4f6a6b43b588 tempest-SecurityGroupsNegativeTestJSON-128170327 tempest-SecurityGroupsNegativeTestJSON-128170327-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 731cd59a-fd60-4e28-b446-ff93bf5978d1 does not exist", "detail": ""}} {{(pid=134052) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 02:49:52.328368 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.network.security_group_api [None req-3465027b-6f82-4a39-b3f8-4f6a6b43b588 tempest-SecurityGroupsNegativeTestJSON-128170327 tempest-SecurityGroupsNegativeTestJSON-128170327-project] Neutron security group 731cd59a-fd60-4e28-b446-ff93bf5978d1 not found {{(pid=134052) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 27 02:49:52.328897 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-3465027b-6f82-4a39-b3f8-4f6a6b43b588 tempest-SecurityGroupsNegativeTestJSON-128170327 tempest-SecurityGroupsNegativeTestJSON-128170327-project] HTTP exception thrown: Security group 731cd59a-fd60-4e28-b446-ff93bf5978d1 does not exist Aug 27 02:49:52.328897 n-d-852278-4 devstack@n-api.service[134052]: Neutron server returns request_ids: ['req-f40b44ac-e1d7-4bc2-810a-a71b38fc9964'] Aug 27 02:49:52.330835 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3465027b-6f82-4a39-b3f8-4f6a6b43b588 tempest-SecurityGroupsNegativeTestJSON-128170327 tempest-SecurityGroupsNegativeTestJSON-128170327-project] Request method failure captured: Aug 27 02:49:52.330835 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/os-security-groups/731cd59a-fd60-4e28-b446-ff93bf5978d1 HTTP/1.1 Aug 27 02:49:52.330835 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:49:52.330835 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:49:52.330835 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:49:52.330835 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:49:52.330835 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:49:52.330835 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:49:52.330835 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:49:52.330835 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:49:52.330835 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYZGInBS-AmacldjEgirChDyKxNny0i3veSrf2IKUre5cFQldNUQ9BkjlNPvElvHqkaaP9M7N6zns1wHy2P8R-KyoY-fNOMfpVFd5YWQt7VTnMwH3JCnN8hbP3xRuC_2e_WRUdHHt5rArbz-H9FrXPnLlrE5jyDys8mc67I9rVdBGZo Aug 27 02:49:52.330835 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:49:52.330835 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:49:52.330835 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:49:52.330835 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:49:52.330835 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:49:52.330835 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:49:52.330835 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 64fc12e5b7a34ca39d2a728a0e2291f8 Aug 27 02:49:52.330835 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-128170327 Aug 27 02:49:52.330835 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:49:52.330835 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:49:52.330835 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/64fc12e5b7a34ca39d2a728a0e2291f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_64fc12e5b7a34ca39d2a728a0e2291f8", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/64fc12e5b7a34ca39d2a728a0e2291f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/64fc12e5b7a34ca39d2a728a0e2291f8"}]}] Aug 27 02:49:52.330835 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-128170327 Aug 27 02:49:52.330835 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 64fc12e5b7a34ca39d2a728a0e2291f8 Aug 27 02:49:52.330835 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-128170327 Aug 27 02:49:52.330835 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-SecurityGroupsNegativeTestJSON-128170327-project Aug 27 02:49:52.330835 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:49:52.330835 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:49:52.330835 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: ffc6bff676f348dca981ae9808d78022 Aug 27 02:49:52.330835 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-128170327-project Aug 27 02:49:52.330835 n-d-852278-4 devstack@n-api.service[134052]: method: Aug 27 02:49:52.330835 n-d-852278-4 devstack@n-api.service[134052]: exception: Security group 731cd59a-fd60-4e28-b446-ff93bf5978d1 does not exist Aug 27 02:49:52.330835 n-d-852278-4 devstack@n-api.service[134052]: Neutron server returns request_ids: ['req-f40b44ac-e1d7-4bc2-810a-a71b38fc9964'] Aug 27 02:49:52.330835 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '731cd59a-fd60-4e28-b446-ff93bf5978d1'} Aug 27 02:49:52.330835 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:49:52.330835 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:52.330835 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 27 02:49:52.330835 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 27 02:49:52.330835 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:49:52.330835 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:49:52.330835 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 27 02:49:52.330835 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 27 02:49:52.330835 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:49:52.330835 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:49:52.330835 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 02:49:52.330835 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 02:49:52.330835 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:49:52.330835 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:49:52.330835 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 02:49:52.330835 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 02:49:52.330835 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:49:52.330835 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:49:52.330835 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 02:49:52.330835 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 02:49:52.330835 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:49:52.330835 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:49:52.330835 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 02:49:52.330835 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 02:49:52.330835 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 02:49:52.330835 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 02:49:52.330835 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 731cd59a-fd60-4e28-b446-ff93bf5978d1 does not exist Aug 27 02:49:52.337386 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f40b44ac-e1d7-4bc2-810a-a71b38fc9964'] Aug 27 02:49:52.337386 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:49:52.337386 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:49:52.337386 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:49:52.337386 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:52.337386 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 27 02:49:52.337386 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 27 02:49:52.337386 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 27 02:49:52.337386 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 27 02:49:52.337386 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 731cd59a-fd60-4e28-b446-ff93bf5978d1 does not exist Aug 27 02:49:52.337386 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f40b44ac-e1d7-4bc2-810a-a71b38fc9964'] Aug 27 02:49:52.337386 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:49:52.337386 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:49:52.337386 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:49:52.337386 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:52.337386 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:49:52.337386 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:49:52.337386 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:49:52.337386 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:49:52.337386 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:49:52.337386 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:49:52.337386 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:49:52.337386 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:49:52.337386 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 27 02:49:52.337386 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 27 02:49:52.337386 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 731cd59a-fd60-4e28-b446-ff93bf5978d1 does not exist Aug 27 02:49:52.337386 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f40b44ac-e1d7-4bc2-810a-a71b38fc9964'] Aug 27 02:49:52.337386 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:49:52.337386 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:49:52.337386 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:49:52.337386 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:52.337386 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:49:52.337386 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:49:52.337386 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:49:52.337386 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:49:52.337386 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 731cd59a-fd60-4e28-b446-ff93bf5978d1 does not exist Aug 27 02:49:52.337386 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f40b44ac-e1d7-4bc2-810a-a71b38fc9964'] Aug 27 02:49:52.337386 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:49:52.337386 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3465027b-6f82-4a39-b3f8-4f6a6b43b588 tempest-SecurityGroupsNegativeTestJSON-128170327 tempest-SecurityGroupsNegativeTestJSON-128170327-project] Returning 404 to user: Security group 731cd59a-fd60-4e28-b446-ff93bf5978d1 does not exist Aug 27 02:49:52.337386 n-d-852278-4 devstack@n-api.service[134052]: Neutron server returns request_ids: ['req-f40b44ac-e1d7-4bc2-810a-a71b38fc9964'] {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:49:52.337386 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-3465027b-6f82-4a39-b3f8-4f6a6b43b588 tempest-SecurityGroupsNegativeTestJSON-128170327 tempest-SecurityGroupsNegativeTestJSON-128170327-project] 10.222.0.70 "GET /compute/v2.1/os-security-groups/731cd59a-fd60-4e28-b446-ff93bf5978d1" status: 404 len: 194 microversion: 2.1 time: 0.101625 Aug 27 02:49:52.337386 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1071/2094] 10.222.0.70 () {58 vars in 1269 bytes} [Sat Aug 27 02:49:52 2022] GET /compute/v2.1/os-security-groups/731cd59a-fd60-4e28-b446-ff93bf5978d1 => generated 194 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:49:52.343087 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-dc9551e8-012b-4ca2-8786-ae1bf009010d tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:52.343596 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-521ef638-7de6-4d44-8962-cc9d95441f84 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Action: 'action', calling method: .version_select at 0x7f5ee55693a0>, body: {"removeFloatingIp": {"address": "172.25.0.59"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:49:52.343765 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-dc9551e8-012b-4ca2-8786-ae1bf009010d tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] [instance: 57a1e617-8846-4da8-b84f-232ffc519f69] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:52.358169 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dc9551e8-012b-4ca2-8786-ae1bf009010d tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:52.358669 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dc9551e8-012b-4ca2-8786-ae1bf009010d tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:52.359104 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dc9551e8-012b-4ca2-8786-ae1bf009010d tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:52.359819 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dc9551e8-012b-4ca2-8786-ae1bf009010d tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:52.360268 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dc9551e8-012b-4ca2-8786-ae1bf009010d tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:52.361037 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dc9551e8-012b-4ca2-8786-ae1bf009010d tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:52.712790 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-521ef638-7de6-4d44-8962-cc9d95441f84 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] [instance: 26795af5-99b8-4a26-9843-3781a5016217] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:52.722154 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-521ef638-7de6-4d44-8962-cc9d95441f84 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:52.722655 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-521ef638-7de6-4d44-8962-cc9d95441f84 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:52.723807 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-521ef638-7de6-4d44-8962-cc9d95441f84 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:52.724571 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-521ef638-7de6-4d44-8962-cc9d95441f84 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:52.725242 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-521ef638-7de6-4d44-8962-cc9d95441f84 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:52.727385 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-521ef638-7de6-4d44-8962-cc9d95441f84 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:52.944102 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-dc9551e8-012b-4ca2-8786-ae1bf009010d tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece67529f3704d9faf0ff443d7c016de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c13c5aeb4da472da020639d5b6ad5aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:52.960130 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-dc9551e8-012b-4ca2-8786-ae1bf009010d tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] 10.222.0.70 "GET /compute/v2.1/servers/57a1e617-8846-4da8-b84f-232ffc519f69" status: 200 len: 1332 microversion: 2.1 time: 0.626099 Aug 27 02:49:52.963799 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1024/2095] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:52 2022] GET /compute/v2.1/servers/57a1e617-8846-4da8-b84f-232ffc519f69 => generated 1332 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:52.997841 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8ccacf9f-bc62-4b22-bb42-c7e1130b3b1c tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:53.004611 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-8ccacf9f-bc62-4b22-bb42-c7e1130b3b1c tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] [instance: 484e03a9-aef3-4179-980c-0e7292a05b5a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:53.016155 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8ccacf9f-bc62-4b22-bb42-c7e1130b3b1c tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:53.016933 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8ccacf9f-bc62-4b22-bb42-c7e1130b3b1c tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:53.017772 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8ccacf9f-bc62-4b22-bb42-c7e1130b3b1c tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:53.018672 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8ccacf9f-bc62-4b22-bb42-c7e1130b3b1c tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:53.019484 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8ccacf9f-bc62-4b22-bb42-c7e1130b3b1c tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:53.020611 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8ccacf9f-bc62-4b22-bb42-c7e1130b3b1c tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:53.031993 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=4,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=3,nova_cell1:RELEASE=3 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:49:53.549352 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-521ef638-7de6-4d44-8962-cc9d95441f84 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] HTTP exception thrown: Floating IP 172.25.0.59 is not associated with instance e445cdc5-5ecb-487c-adee-f5cb9862283c. Aug 27 02:49:53.553759 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-521ef638-7de6-4d44-8962-cc9d95441f84 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Request method failure captured: Aug 27 02:49:53.553759 n-d-852278-4 devstack@n-api.service[134052]: request: POST /compute/v2.1/servers/e445cdc5-5ecb-487c-adee-f5cb9862283c/action HTTP/1.1 Aug 27 02:49:53.553759 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:49:53.553759 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:49:53.553759 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:49:53.553759 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 48 Aug 27 02:49:53.553759 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:49:53.553759 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:49:53.553759 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:49:53.553759 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:49:53.553759 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYYC33a4sfcy0flVw5fElBdehyWAeg1tulUhA7AsP362Qhvm65PM70JFXBNalTPc4viU09Id9Z9Nwv26tmSWE9om-XPexmfdNMnm880cJaz8a6wZRrzmZsGh2ivxs7otD6rtMoYyDyYT9X6fA12qDhGtP0JhOLsdI78pvG7p67F1yr4 Aug 27 02:49:53.553759 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:49:53.553759 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:49:53.553759 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:49:53.553759 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:49:53.553759 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:49:53.553759 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:49:53.553759 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 4f9be56fbeb64cb08b9be4e3d7436782 Aug 27 02:49:53.553759 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-234532228 Aug 27 02:49:53.553759 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:49:53.553759 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:49:53.553759 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4f9be56fbeb64cb08b9be4e3d7436782"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_4f9be56fbeb64cb08b9be4e3d7436782", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4f9be56fbeb64cb08b9be4e3d7436782"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/4f9be56fbeb64cb08b9be4e3d7436782"}]}] Aug 27 02:49:53.553759 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-234532228 Aug 27 02:49:53.553759 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 4f9be56fbeb64cb08b9be4e3d7436782 Aug 27 02:49:53.553759 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-234532228 Aug 27 02:49:53.553759 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-FloatingIPsAssociationTestJSON-234532228-project Aug 27 02:49:53.553759 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:49:53.553759 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:49:53.553759 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 66c0fc8492654e6e85a90ce04736c055 Aug 27 02:49:53.553759 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-234532228-project Aug 27 02:49:53.553759 n-d-852278-4 devstack@n-api.service[134052]: Aug 27 02:49:53.553759 n-d-852278-4 devstack@n-api.service[134052]: {"removeFloatingIp": {"address": "172.25.0.59"}} Aug 27 02:49:53.553759 n-d-852278-4 devstack@n-api.service[134052]: method: Aug 27 02:49:53.553759 n-d-852278-4 devstack@n-api.service[134052]: exception: Floating IP 172.25.0.59 is not associated with instance e445cdc5-5ecb-487c-adee-f5cb9862283c. Aug 27 02:49:53.553759 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': 'e445cdc5-5ecb-487c-adee-f5cb9862283c', 'body': {'removeFloatingIp': {'address': '172.25.0.59'}}} Aug 27 02:49:53.553759 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:49:53.553759 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:53.553759 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:49:53.553759 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:49:53.553759 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:49:53.553759 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:49:53.553759 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:49:53.553759 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:49:53.553759 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:49:53.553759 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:49:53.553759 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:49:53.553759 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:49:53.553759 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Aug 27 02:49:53.553759 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 27 02:49:53.553759 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.0.59 is not associated with instance e445cdc5-5ecb-487c-adee-f5cb9862283c. Aug 27 02:49:53.553759 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:49:53.553759 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:49:53.553759 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:49:53.553759 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:53.553759 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:49:53.553759 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:49:53.553759 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:49:53.553759 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:49:53.553759 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.0.59 is not associated with instance e445cdc5-5ecb-487c-adee-f5cb9862283c. Aug 27 02:49:53.553759 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:49:53.558262 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-8ccacf9f-bc62-4b22-bb42-c7e1130b3b1c tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:53.560234 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-521ef638-7de6-4d44-8962-cc9d95441f84 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Returning 409 to user: Floating IP 172.25.0.59 is not associated with instance e445cdc5-5ecb-487c-adee-f5cb9862283c. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:49:53.566170 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-521ef638-7de6-4d44-8962-cc9d95441f84 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] 10.222.0.70 "POST /compute/v2.1/servers/e445cdc5-5ecb-487c-adee-f5cb9862283c/action" status: 409 len: 145 microversion: 2.1 time: 1.231601 Aug 27 02:49:53.570067 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1072/2096] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 02:49:52 2022] POST /compute/v2.1/servers/e445cdc5-5ecb-487c-adee-f5cb9862283c/action => generated 145 bytes in 1233 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 27 02:49:53.570252 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-8ccacf9f-bc62-4b22-bb42-c7e1130b3b1c tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:53.571719 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-8ccacf9f-bc62-4b22-bb42-c7e1130b3b1c tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:53.573162 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-8ccacf9f-bc62-4b22-bb42-c7e1130b3b1c tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] 10.222.0.70 "GET /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a" status: 200 len: 2957 microversion: 2.42 time: 0.592923 Aug 27 02:49:53.574710 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1025/2097] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:49:52 2022] GET /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a => generated 2957 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:49:53.591325 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-22e47cb2-d0ef-4ca9-ab71-9c3251eb2a27 tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:53.591842 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-22e47cb2-d0ef-4ca9-ab71-9c3251eb2a27 tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] [instance: 14df3dce-7fb6-491c-9559-6fbca68580b0] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:53.595797 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-95e57deb-0ced-49e1-9ac1-d6f631883dad tempest-SecurityGroupsNegativeTestJSON-128170327 tempest-SecurityGroupsNegativeTestJSON-128170327-project] Action: 'update', calling method: .version_select at 0x7f5ee7269dc0>, body: {"security_group": {"name": "tempest-sg-1436526034", "description": "tempest-description-2057291209"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:49:53.609511 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-22e47cb2-d0ef-4ca9-ab71-9c3251eb2a27 tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:53.610053 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-22e47cb2-d0ef-4ca9-ab71-9c3251eb2a27 tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:53.610507 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-22e47cb2-d0ef-4ca9-ab71-9c3251eb2a27 tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:53.611261 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-22e47cb2-d0ef-4ca9-ab71-9c3251eb2a27 tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:53.611711 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-22e47cb2-d0ef-4ca9-ab71-9c3251eb2a27 tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:53.612141 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-22e47cb2-d0ef-4ca9-ab71-9c3251eb2a27 tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:53.642652 n-d-852278-4 devstack@n-api.service[134051]: DEBUG neutronclient.v2_0.client [None req-95e57deb-0ced-49e1-9ac1-d6f631883dad tempest-SecurityGroupsNegativeTestJSON-128170327 tempest-SecurityGroupsNegativeTestJSON-128170327-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 346519a3-a9ba-4e81-b05a-bb9953fd4ce3 does not exist", "detail": ""}} {{(pid=134051) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 02:49:53.643398 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.network.security_group_api [None req-95e57deb-0ced-49e1-9ac1-d6f631883dad tempest-SecurityGroupsNegativeTestJSON-128170327 tempest-SecurityGroupsNegativeTestJSON-128170327-project] Neutron security group 346519a3-a9ba-4e81-b05a-bb9953fd4ce3 not found {{(pid=134051) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 27 02:49:53.644031 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-95e57deb-0ced-49e1-9ac1-d6f631883dad tempest-SecurityGroupsNegativeTestJSON-128170327 tempest-SecurityGroupsNegativeTestJSON-128170327-project] HTTP exception thrown: Security group 346519a3-a9ba-4e81-b05a-bb9953fd4ce3 does not exist Aug 27 02:49:53.644031 n-d-852278-4 devstack@n-api.service[134051]: Neutron server returns request_ids: ['req-dae22a69-ee23-42ba-8e03-5ea0d8ee32de'] Aug 27 02:49:53.646343 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-95e57deb-0ced-49e1-9ac1-d6f631883dad tempest-SecurityGroupsNegativeTestJSON-128170327 tempest-SecurityGroupsNegativeTestJSON-128170327-project] Request method failure captured: Aug 27 02:49:53.646343 n-d-852278-4 devstack@n-api.service[134051]: request: PUT /compute/v2.1/os-security-groups/346519a3-a9ba-4e81-b05a-bb9953fd4ce3 HTTP/1.1 Aug 27 02:49:53.646343 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:49:53.646343 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:49:53.646343 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:49:53.646343 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 102 Aug 27 02:49:53.646343 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:49:53.646343 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:49:53.646343 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:49:53.646343 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:49:53.646343 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYZGInBS-AmacldjEgirChDyKxNny0i3veSrf2IKUre5cFQldNUQ9BkjlNPvElvHqkaaP9M7N6zns1wHy2P8R-KyoY-fNOMfpVFd5YWQt7VTnMwH3JCnN8hbP3xRuC_2e_WRUdHHt5rArbz-H9FrXPnLlrE5jyDys8mc67I9rVdBGZo Aug 27 02:49:53.646343 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:49:53.646343 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:49:53.646343 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:49:53.646343 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:49:53.646343 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:49:53.646343 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:49:53.646343 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 64fc12e5b7a34ca39d2a728a0e2291f8 Aug 27 02:49:53.646343 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-128170327 Aug 27 02:49:53.646343 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:49:53.646343 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:49:53.646343 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/64fc12e5b7a34ca39d2a728a0e2291f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_64fc12e5b7a34ca39d2a728a0e2291f8", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/64fc12e5b7a34ca39d2a728a0e2291f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/64fc12e5b7a34ca39d2a728a0e2291f8"}]}] Aug 27 02:49:53.646343 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-128170327 Aug 27 02:49:53.646343 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 64fc12e5b7a34ca39d2a728a0e2291f8 Aug 27 02:49:53.646343 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-128170327 Aug 27 02:49:53.646343 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-SecurityGroupsNegativeTestJSON-128170327-project Aug 27 02:49:53.646343 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:49:53.646343 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:49:53.646343 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: ffc6bff676f348dca981ae9808d78022 Aug 27 02:49:53.646343 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-128170327-project Aug 27 02:49:53.646343 n-d-852278-4 devstack@n-api.service[134051]: Aug 27 02:49:53.646343 n-d-852278-4 devstack@n-api.service[134051]: {"security_group": {"name": "tempest-sg-1436526034", "description": "tempest-description-2057291209"}} Aug 27 02:49:53.646343 n-d-852278-4 devstack@n-api.service[134051]: method: Aug 27 02:49:53.646343 n-d-852278-4 devstack@n-api.service[134051]: exception: Security group 346519a3-a9ba-4e81-b05a-bb9953fd4ce3 does not exist Aug 27 02:49:53.646343 n-d-852278-4 devstack@n-api.service[134051]: Neutron server returns request_ids: ['req-dae22a69-ee23-42ba-8e03-5ea0d8ee32de'] Aug 27 02:49:53.646343 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '346519a3-a9ba-4e81-b05a-bb9953fd4ce3', 'body': {'security_group': {'name': 'tempest-sg-1436526034', 'description': 'tempest-description-2057291209'}}} Aug 27 02:49:53.646343 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:49:53.646343 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:53.646343 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 27 02:49:53.646343 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 27 02:49:53.646343 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:49:53.646343 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:49:53.646343 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 27 02:49:53.646343 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 27 02:49:53.646343 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:49:53.646343 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:49:53.646343 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 02:49:53.646343 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 02:49:53.646343 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:49:53.646343 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:49:53.646343 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 02:49:53.646343 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 02:49:53.646343 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:49:53.646343 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:49:53.646343 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 02:49:53.646343 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 02:49:53.646343 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:49:53.646343 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:49:53.646343 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 02:49:53.646343 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 02:49:53.646343 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 02:49:53.657354 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 02:49:53.657354 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 346519a3-a9ba-4e81-b05a-bb9953fd4ce3 does not exist Aug 27 02:49:53.657354 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dae22a69-ee23-42ba-8e03-5ea0d8ee32de'] Aug 27 02:49:53.657354 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:49:53.657354 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:49:53.657354 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:49:53.657354 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:53.657354 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Aug 27 02:49:53.657354 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 27 02:49:53.657354 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 27 02:49:53.657354 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 27 02:49:53.657354 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 346519a3-a9ba-4e81-b05a-bb9953fd4ce3 does not exist Aug 27 02:49:53.657354 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dae22a69-ee23-42ba-8e03-5ea0d8ee32de'] Aug 27 02:49:53.657354 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:49:53.657354 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:49:53.657354 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:49:53.657354 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:53.657354 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:49:53.657354 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:49:53.657354 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:49:53.657354 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:49:53.657354 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:49:53.657354 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:49:53.657354 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:49:53.657354 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:49:53.657354 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Aug 27 02:49:53.657354 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 27 02:49:53.657354 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 346519a3-a9ba-4e81-b05a-bb9953fd4ce3 does not exist Aug 27 02:49:53.657354 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dae22a69-ee23-42ba-8e03-5ea0d8ee32de'] Aug 27 02:49:53.657354 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:49:53.657354 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:49:53.657354 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:49:53.657354 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:53.657354 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:49:53.657354 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:49:53.657354 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:49:53.657354 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:49:53.657354 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 346519a3-a9ba-4e81-b05a-bb9953fd4ce3 does not exist Aug 27 02:49:53.657354 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dae22a69-ee23-42ba-8e03-5ea0d8ee32de'] Aug 27 02:49:53.657354 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:49:53.657354 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-95e57deb-0ced-49e1-9ac1-d6f631883dad tempest-SecurityGroupsNegativeTestJSON-128170327 tempest-SecurityGroupsNegativeTestJSON-128170327-project] Returning 404 to user: Security group 346519a3-a9ba-4e81-b05a-bb9953fd4ce3 does not exist Aug 27 02:49:53.657354 n-d-852278-4 devstack@n-api.service[134051]: Neutron server returns request_ids: ['req-dae22a69-ee23-42ba-8e03-5ea0d8ee32de'] {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:49:53.657354 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-95e57deb-0ced-49e1-9ac1-d6f631883dad tempest-SecurityGroupsNegativeTestJSON-128170327 tempest-SecurityGroupsNegativeTestJSON-128170327-project] 10.222.0.70 "PUT /compute/v2.1/os-security-groups/346519a3-a9ba-4e81-b05a-bb9953fd4ce3" status: 404 len: 194 microversion: 2.1 time: 0.071973 Aug 27 02:49:53.657354 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1026/2098] 10.222.0.70 () {60 vars in 1290 bytes} [Sat Aug 27 02:49:53 2022] PUT /compute/v2.1/os-security-groups/346519a3-a9ba-4e81-b05a-bb9953fd4ce3 => generated 194 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:49:53.662901 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-76642847-3c2e-4150-9141-54b123643735 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:53.663538 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-76642847-3c2e-4150-9141-54b123643735 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: cac17f47-6e08-4f15-a8cf-f5e44ad03d12] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:53.681799 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-76642847-3c2e-4150-9141-54b123643735 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:53.682651 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-76642847-3c2e-4150-9141-54b123643735 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:53.683298 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-76642847-3c2e-4150-9141-54b123643735 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:53.684230 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-76642847-3c2e-4150-9141-54b123643735 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:53.685008 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-76642847-3c2e-4150-9141-54b123643735 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:53.685873 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-76642847-3c2e-4150-9141-54b123643735 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:53.906931 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-22e47cb2-d0ef-4ca9-ab71-9c3251eb2a27 tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] 10.222.0.70 "GET /compute/v2.1/servers/14df3dce-7fb6-491c-9559-6fbca68580b0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.338539 Aug 27 02:49:53.907977 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1073/2099] 10.222.0.70 () {58 vars in 1275 bytes} [Sat Aug 27 02:49:53 2022] GET /compute/v2.1/servers/14df3dce-7fb6-491c-9559-6fbca68580b0/os-interface => generated 284 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:49:53.912932 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ebd7a9f2-f39d-4253-b410-32a79e9aa8a3 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.0.59"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:49:54.335066 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-76642847-3c2e-4150-9141-54b123643735 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:54.344008 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-76642847-3c2e-4150-9141-54b123643735 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/cac17f47-6e08-4f15-a8cf-f5e44ad03d12" status: 200 len: 1470 microversion: 2.1 time: 0.693641 Aug 27 02:49:54.344970 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1027/2100] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:53 2022] GET /compute/v2.1/servers/cac17f47-6e08-4f15-a8cf-f5e44ad03d12 => generated 1470 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:54.527242 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-aec6dac6-90d4-4fbf-acf8-b92cfca0abcb tempest-KeyPairsNegativeTestJSON-1936155010 tempest-KeyPairsNegativeTestJSON-1936155010-project] Action: 'create', calling method: .version_select at 0x7f5ee7271550>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCWrTkiNYRLfQNoAMhCHVG5JRPwLV9wz0flwaLDK9Jj626ywvMA7rdHKYF8W/CUZlTxdCW1cFtJeywzGYf9G02/YNasudZUhkkrfk+VPAp8E9UvD6F0rnO9TQSaEdGfQaw=="}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:49:54.534015 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-aec6dac6-90d4-4fbf-acf8-b92cfca0abcb tempest-KeyPairsNegativeTestJSON-1936155010 tempest-KeyPairsNegativeTestJSON-1936155010-project] Request method failure captured: Aug 27 02:49:54.534015 n-d-852278-4 devstack@n-api.service[134051]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 27 02:49:54.534015 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:49:54.534015 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:49:54.534015 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:49:54.534015 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 257 Aug 27 02:49:54.534015 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:49:54.534015 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:49:54.534015 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:49:54.534015 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:49:54.534015 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYZRidFy6t-pLV-mM86njli7w4Vl-0bnBXcz0_vb_UjKgVyfK8vmvik7N4wdj9PXlVI-w6r0uqDPhexJ-GRRlcNhKK13Li-Z2wC9f9cLVmHFZC-vZglOEYPx1mtvHQoJAKHpnnWrCQpFAzc1pfmiD7LNCdL9rxM-scVuQ-dVMbsC5xc Aug 27 02:49:54.534015 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:49:54.534015 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:49:54.534015 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:49:54.534015 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:49:54.534015 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:49:54.534015 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:49:54.534015 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 6b59a20bc0ee4f47b52b3c35fcfa189f Aug 27 02:49:54.534015 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1936155010 Aug 27 02:49:54.534015 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:49:54.534015 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:49:54.534015 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6b59a20bc0ee4f47b52b3c35fcfa189f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_6b59a20bc0ee4f47b52b3c35fcfa189f", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6b59a20bc0ee4f47b52b3c35fcfa189f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/6b59a20bc0ee4f47b52b3c35fcfa189f"}]}] Aug 27 02:49:54.534015 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1936155010 Aug 27 02:49:54.534015 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 6b59a20bc0ee4f47b52b3c35fcfa189f Aug 27 02:49:54.534015 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1936155010 Aug 27 02:49:54.534015 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-KeyPairsNegativeTestJSON-1936155010-project Aug 27 02:49:54.534015 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:49:54.534015 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:49:54.534015 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: fad44c508d064d9c84e8f0a58b808287 Aug 27 02:49:54.534015 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1936155010-project Aug 27 02:49:54.534015 n-d-852278-4 devstack@n-api.service[134051]: Aug 27 02:49:54.534015 n-d-852278-4 devstack@n-api.service[134051]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCWrTkiNYRLfQNoAMhCHVG5JRPwLV9wz0flwaLDK9Jj626ywvMA7rdHKYF8W/CUZlTxdCW1cFtJeywzGYf9G02/YNasudZUhkkrfk+VPAp8E9UvD6F0rnO9TQSaEdGfQaw=="}} Aug 27 02:49:54.534015 n-d-852278-4 devstack@n-api.service[134051]: method: Aug 27 02:49:54.534015 n-d-852278-4 devstack@n-api.service[134051]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 27 02:49:54.534015 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCWrTkiNYRLfQNoAMhCHVG5JRPwLV9wz0flwaLDK9Jj626ywvMA7rdHKYF8W/CUZlTxdCW1cFtJeywzGYf9G02/YNasudZUhkkrfk+VPAp8E9UvD6F0rnO9TQSaEdGfQaw=='}}} Aug 27 02:49:54.534015 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:49:54.534015 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:54.534015 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 27 02:49:54.534015 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 27 02:49:54.534015 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Aug 27 02:49:54.534015 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Aug 27 02:49:54.534015 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Aug 27 02:49:54.534015 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Aug 27 02:49:54.534015 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 27 02:49:54.534015 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:49:54.534015 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 27 02:49:54.534015 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:49:54.534015 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:54.534015 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 02:49:54.534015 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 02:49:54.534015 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 02:49:54.534015 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise error Aug 27 02:49:54.534015 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Aug 27 02:49:54.534015 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:49:54.534015 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Aug 27 02:49:54.534015 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Aug 27 02:49:54.534015 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Aug 27 02:49:54.534015 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi 'minLength': 1, Aug 27 02:49:54.534015 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 27 02:49:54.534015 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:49:54.534015 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Aug 27 02:49:54.534015 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Aug 27 02:49:54.534015 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:49:54.539828 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:49:54.539828 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:49:54.539828 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:54.539828 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:49:54.539828 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:49:54.539828 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:49:54.539828 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:49:54.539828 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:49:54.539828 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:49:54.539828 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:49:54.539828 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:49:54.539828 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:49:54.539828 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:49:54.539828 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 02:49:54.539828 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 02:49:54.539828 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 02:49:54.539828 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 02:49:54.539828 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 02:49:54.539828 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 02:49:54.539828 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 27 02:49:54.539828 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:49:54.539828 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:49:54.539828 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:49:54.539828 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:54.539828 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:49:54.539828 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:49:54.539828 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 02:49:54.539828 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 02:49:54.539828 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 27 02:49:54.539828 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:49:54.563343 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-aec6dac6-90d4-4fbf-acf8-b92cfca0abcb tempest-KeyPairsNegativeTestJSON-1936155010 tempest-KeyPairsNegativeTestJSON-1936155010-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:49:54.565078 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-aec6dac6-90d4-4fbf-acf8-b92cfca0abcb tempest-KeyPairsNegativeTestJSON-1936155010 tempest-KeyPairsNegativeTestJSON-1936155010-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.218164 Aug 27 02:49:54.565677 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1028/2101] 10.222.0.70 () {60 vars in 1159 bytes} [Sat Aug 27 02:49:54 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 220 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 02:49:54.575641 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-771e3659-1bea-4c0a-9735-41ac146f13c0 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:54.576328 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-771e3659-1bea-4c0a-9735-41ac146f13c0 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] [instance: 57a1e617-8846-4da8-b84f-232ffc519f69] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:54.596398 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-771e3659-1bea-4c0a-9735-41ac146f13c0 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:54.597018 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-771e3659-1bea-4c0a-9735-41ac146f13c0 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:54.597642 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-771e3659-1bea-4c0a-9735-41ac146f13c0 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:54.598537 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-771e3659-1bea-4c0a-9735-41ac146f13c0 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:54.599203 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-771e3659-1bea-4c0a-9735-41ac146f13c0 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:54.599871 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-771e3659-1bea-4c0a-9735-41ac146f13c0 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:54.901254 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-ebd7a9f2-f39d-4253-b410-32a79e9aa8a3 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] [instance: 26795af5-99b8-4a26-9843-3781a5016217] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:54.932188 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ebd7a9f2-f39d-4253-b410-32a79e9aa8a3 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:54.933570 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ebd7a9f2-f39d-4253-b410-32a79e9aa8a3 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:54.935513 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ebd7a9f2-f39d-4253-b410-32a79e9aa8a3 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:54.939302 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ebd7a9f2-f39d-4253-b410-32a79e9aa8a3 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:54.943529 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ebd7a9f2-f39d-4253-b410-32a79e9aa8a3 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:54.944858 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ebd7a9f2-f39d-4253-b410-32a79e9aa8a3 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:55.248693 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-771e3659-1bea-4c0a-9735-41ac146f13c0 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece67529f3704d9faf0ff443d7c016de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c13c5aeb4da472da020639d5b6ad5aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:55.260902 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-771e3659-1bea-4c0a-9735-41ac146f13c0 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] 10.222.0.70 "GET /compute/v2.1/servers/57a1e617-8846-4da8-b84f-232ffc519f69" status: 200 len: 1332 microversion: 2.1 time: 0.692943 Aug 27 02:49:55.270808 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1029/2102] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:54 2022] GET /compute/v2.1/servers/57a1e617-8846-4da8-b84f-232ffc519f69 => generated 1332 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:55.279155 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c1a5476d-961f-44b0-a810-4c3d4d3533c5 tempest-KeyPairsNegativeTestJSON-1936155010 tempest-KeyPairsNegativeTestJSON-1936155010-project] Action: 'create', calling method: .version_select at 0x7f5ee72698b0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1664377099", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:49:55.297870 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-c1a5476d-961f-44b0-a810-4c3d4d3533c5 tempest-KeyPairsNegativeTestJSON-1936155010 tempest-KeyPairsNegativeTestJSON-1936155010-project] Getting quotas for project 6b59a20bc0ee4f47b52b3c35fcfa189f. Resources: {'key_pairs'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:49:55.303666 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-c1a5476d-961f-44b0-a810-4c3d4d3533c5 tempest-KeyPairsNegativeTestJSON-1936155010 tempest-KeyPairsNegativeTestJSON-1936155010-project] Getting quotas for user fad44c508d064d9c84e8f0a58b808287 and project 6b59a20bc0ee4f47b52b3c35fcfa189f. Resources: {'key_pairs'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:49:55.324285 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-c1a5476d-961f-44b0-a810-4c3d4d3533c5 tempest-KeyPairsNegativeTestJSON-1936155010 tempest-KeyPairsNegativeTestJSON-1936155010-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 27 02:49:55.347221 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c1a5476d-961f-44b0-a810-4c3d4d3533c5 tempest-KeyPairsNegativeTestJSON-1936155010 tempest-KeyPairsNegativeTestJSON-1936155010-project] Request method failure captured: Aug 27 02:49:55.347221 n-d-852278-4 devstack@n-api.service[134051]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 27 02:49:55.347221 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:49:55.347221 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:49:55.347221 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:49:55.347221 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 2167 Aug 27 02:49:55.347221 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:49:55.347221 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:49:55.347221 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:49:55.347221 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:49:55.347221 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYZRidFy6t-pLV-mM86njli7w4Vl-0bnBXcz0_vb_UjKgVyfK8vmvik7N4wdj9PXlVI-w6r0uqDPhexJ-GRRlcNhKK13Li-Z2wC9f9cLVmHFZC-vZglOEYPx1mtvHQoJAKHpnnWrCQpFAzc1pfmiD7LNCdL9rxM-scVuQ-dVMbsC5xc Aug 27 02:49:55.347221 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:49:55.347221 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:49:55.347221 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:49:55.347221 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:49:55.347221 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:49:55.347221 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:49:55.347221 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 6b59a20bc0ee4f47b52b3c35fcfa189f Aug 27 02:49:55.347221 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1936155010 Aug 27 02:49:55.347221 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:49:55.347221 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:49:55.347221 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6b59a20bc0ee4f47b52b3c35fcfa189f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_6b59a20bc0ee4f47b52b3c35fcfa189f", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6b59a20bc0ee4f47b52b3c35fcfa189f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/6b59a20bc0ee4f47b52b3c35fcfa189f"}]}] Aug 27 02:49:55.347221 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1936155010 Aug 27 02:49:55.347221 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 6b59a20bc0ee4f47b52b3c35fcfa189f Aug 27 02:49:55.347221 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1936155010 Aug 27 02:49:55.347221 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-KeyPairsNegativeTestJSON-1936155010-project Aug 27 02:49:55.347221 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:49:55.347221 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:49:55.347221 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: fad44c508d064d9c84e8f0a58b808287 Aug 27 02:49:55.347221 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1936155010-project Aug 27 02:49:55.347221 n-d-852278-4 devstack@n-api.service[134051]: Aug 27 02:49:55.347221 n-d-852278-4 devstack@n-api.service[134051]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1664377099", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Aug 27 02:49:55.347221 n-d-852278-4 devstack@n-api.service[134051]: method: Aug 27 02:49:55.347221 n-d-852278-4 devstack@n-api.service[134051]: exception: Keypair data is invalid: failed to generate fingerprint Aug 27 02:49:55.349706 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1664377099', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Aug 27 02:49:55.349706 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:49:55.349706 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:55.349706 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 27 02:49:55.349706 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 27 02:49:55.349706 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Aug 27 02:49:55.349706 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Aug 27 02:49:55.349706 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Aug 27 02:49:55.349706 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:49:55.349706 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:49:55.349706 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:49:55.349706 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:55.349706 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 27 02:49:55.349706 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 27 02:49:55.349706 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 27 02:49:55.349706 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 27 02:49:55.349706 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 02:49:55.349706 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 02:49:55.349706 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 02:49:55.349706 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 02:49:55.349706 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 27 02:49:55.349706 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 27 02:49:55.349706 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6772, in import_key_pair Aug 27 02:49:55.349706 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 27 02:49:55.349706 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6845, in _generate_fingerprint Aug 27 02:49:55.349706 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 27 02:49:55.349706 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 27 02:49:55.349706 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 27 02:49:55.349706 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 27 02:49:55.349706 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:49:55.349706 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:49:55.349706 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:49:55.349706 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:55.349706 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:49:55.349706 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:49:55.349706 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:49:55.349706 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:49:55.349706 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:49:55.349706 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:49:55.349706 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:49:55.349706 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:49:55.352145 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:49:55.352145 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:49:55.352145 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:49:55.352145 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:49:55.352145 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 27 02:49:55.352145 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 27 02:49:55.352145 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 27 02:49:55.352145 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 27 02:49:55.352145 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 27 02:49:55.352145 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:49:55.352145 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:49:55.352145 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:49:55.352145 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:55.352145 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:49:55.352145 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:49:55.352145 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:49:55.352145 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:49:55.352145 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 27 02:49:55.352145 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:49:55.352145 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c1a5476d-961f-44b0-a810-4c3d4d3533c5 tempest-KeyPairsNegativeTestJSON-1936155010 tempest-KeyPairsNegativeTestJSON-1936155010-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:49:55.352145 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c1a5476d-961f-44b0-a810-4c3d4d3533c5 tempest-KeyPairsNegativeTestJSON-1936155010 tempest-KeyPairsNegativeTestJSON-1936155010-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.077109 Aug 27 02:49:55.352145 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1030/2103] 10.222.0.70 () {60 vars in 1160 bytes} [Sat Aug 27 02:49:55 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 78 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 27 02:49:55.358946 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e438ec3b-61ad-44ec-8e92-680ccb5416a6 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:55.359580 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-e438ec3b-61ad-44ec-8e92-680ccb5416a6 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] [instance: 484e03a9-aef3-4179-980c-0e7292a05b5a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:55.369694 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e438ec3b-61ad-44ec-8e92-680ccb5416a6 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:55.370191 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e438ec3b-61ad-44ec-8e92-680ccb5416a6 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:55.370631 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e438ec3b-61ad-44ec-8e92-680ccb5416a6 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:55.371504 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e438ec3b-61ad-44ec-8e92-680ccb5416a6 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:55.371965 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e438ec3b-61ad-44ec-8e92-680ccb5416a6 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:55.373158 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e438ec3b-61ad-44ec-8e92-680ccb5416a6 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:55.728921 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ebd7a9f2-f39d-4253-b410-32a79e9aa8a3 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Acquiring lock "refresh_cache-26795af5-99b8-4a26-9843-3781a5016217" {{(pid=134052) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 27 02:49:55.729427 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ebd7a9f2-f39d-4253-b410-32a79e9aa8a3 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Acquired lock "refresh_cache-26795af5-99b8-4a26-9843-3781a5016217" {{(pid=134052) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 27 02:49:55.988705 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e438ec3b-61ad-44ec-8e92-680ccb5416a6 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:55.999134 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e438ec3b-61ad-44ec-8e92-680ccb5416a6 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:56.000618 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e438ec3b-61ad-44ec-8e92-680ccb5416a6 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:56.001933 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e438ec3b-61ad-44ec-8e92-680ccb5416a6 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] 10.222.0.70 "GET /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a" status: 200 len: 2957 microversion: 2.42 time: 0.650878 Aug 27 02:49:56.014455 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1031/2104] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:49:55 2022] GET /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a => generated 2957 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:49:56.020666 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-aaa7d0d2-923b-4468-8193-7b5d9250cf30 tempest-KeyPairsNegativeTestJSON-1936155010 tempest-KeyPairsNegativeTestJSON-1936155010-project] Action: 'create', calling method: .version_select at 0x7f5ee71c9040>, body: {"keypair": {"name": "tempest-keypair-157902526", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBICs7Xy2r/3+c2EXGb+QP2clNz7WzY+5+CdKFmeUabxQ0fuPHyZnJ9XdMzfnNweHtsd4JKDL0Xw2R1MZC9MdZFqtnUX+oNSclVcEUTCvTN2AYo+kir2om0QP7hBZYS7OZg=="}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:49:56.042410 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-aaa7d0d2-923b-4468-8193-7b5d9250cf30 tempest-KeyPairsNegativeTestJSON-1936155010 tempest-KeyPairsNegativeTestJSON-1936155010-project] Getting quotas for project 6b59a20bc0ee4f47b52b3c35fcfa189f. Resources: {'key_pairs'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:49:56.048746 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-aaa7d0d2-923b-4468-8193-7b5d9250cf30 tempest-KeyPairsNegativeTestJSON-1936155010 tempest-KeyPairsNegativeTestJSON-1936155010-project] Getting quotas for user fad44c508d064d9c84e8f0a58b808287 and project 6b59a20bc0ee4f47b52b3c35fcfa189f. Resources: {'key_pairs'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:49:56.076225 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-aaa7d0d2-923b-4468-8193-7b5d9250cf30 tempest-KeyPairsNegativeTestJSON-1936155010 tempest-KeyPairsNegativeTestJSON-1936155010-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.072676 Aug 27 02:49:56.077028 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1032/2105] 10.222.0.70 () {60 vars in 1159 bytes} [Sat Aug 27 02:49:56 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:49:56.086501 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0ef444b0-e41c-46f7-b032-f7ee12b3cb50 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:56.087153 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-0ef444b0-e41c-46f7-b032-f7ee12b3cb50 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: cac17f47-6e08-4f15-a8cf-f5e44ad03d12] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:56.094733 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0ef444b0-e41c-46f7-b032-f7ee12b3cb50 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:56.095369 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0ef444b0-e41c-46f7-b032-f7ee12b3cb50 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:56.095812 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0ef444b0-e41c-46f7-b032-f7ee12b3cb50 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:56.096634 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0ef444b0-e41c-46f7-b032-f7ee12b3cb50 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:56.097474 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0ef444b0-e41c-46f7-b032-f7ee12b3cb50 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:56.097588 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0ef444b0-e41c-46f7-b032-f7ee12b3cb50 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:56.731665 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-0ef444b0-e41c-46f7-b032-f7ee12b3cb50 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:56.751893 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-0ef444b0-e41c-46f7-b032-f7ee12b3cb50 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/cac17f47-6e08-4f15-a8cf-f5e44ad03d12" status: 200 len: 1470 microversion: 2.1 time: 0.669366 Aug 27 02:49:56.753536 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1033/2106] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:56 2022] GET /compute/v2.1/servers/cac17f47-6e08-4f15-a8cf-f5e44ad03d12 => generated 1470 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:56.759271 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d6ad4eea-4386-4c85-866c-6ae3685cc929 tempest-KeyPairsNegativeTestJSON-1936155010 tempest-KeyPairsNegativeTestJSON-1936155010-project] Action: 'create', calling method: .version_select at 0x7f5ee7271b80>, body: {"keypair": {"name": "tempest-keypair-157902526", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBENHIcTcpxopxVNk+Fq/tjpSlvj14X06E2W+d4dRTr12uZwSDxJ+TZF4DQOUgwx8EB8WeH/TMeF3awTqhRHI/mZTZLvS5YhZ5Av15zHPrBlgwADd49p+J1h3Z8K9vwGlnw=="}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:49:56.791277 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-d6ad4eea-4386-4c85-866c-6ae3685cc929 tempest-KeyPairsNegativeTestJSON-1936155010 tempest-KeyPairsNegativeTestJSON-1936155010-project] Getting quotas for project 6b59a20bc0ee4f47b52b3c35fcfa189f. Resources: {'key_pairs'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:49:56.832908 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-d6ad4eea-4386-4c85-866c-6ae3685cc929 tempest-KeyPairsNegativeTestJSON-1936155010 tempest-KeyPairsNegativeTestJSON-1936155010-project] Getting quotas for user fad44c508d064d9c84e8f0a58b808287 and project 6b59a20bc0ee4f47b52b3c35fcfa189f. Resources: {'key_pairs'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:49:56.895143 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-d6ad4eea-4386-4c85-866c-6ae3685cc929 tempest-KeyPairsNegativeTestJSON-1936155010 tempest-KeyPairsNegativeTestJSON-1936155010-project] HTTP exception thrown: Key pair 'tempest-keypair-157902526' already exists. Aug 27 02:49:56.899500 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d6ad4eea-4386-4c85-866c-6ae3685cc929 tempest-KeyPairsNegativeTestJSON-1936155010 tempest-KeyPairsNegativeTestJSON-1936155010-project] Request method failure captured: Aug 27 02:49:56.899500 n-d-852278-4 devstack@n-api.service[134051]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 27 02:49:56.899500 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:49:56.899500 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:49:56.899500 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:49:56.899500 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 272 Aug 27 02:49:56.899500 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:49:56.899500 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:49:56.899500 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:49:56.899500 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:49:56.899500 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYZRidFy6t-pLV-mM86njli7w4Vl-0bnBXcz0_vb_UjKgVyfK8vmvik7N4wdj9PXlVI-w6r0uqDPhexJ-GRRlcNhKK13Li-Z2wC9f9cLVmHFZC-vZglOEYPx1mtvHQoJAKHpnnWrCQpFAzc1pfmiD7LNCdL9rxM-scVuQ-dVMbsC5xc Aug 27 02:49:56.899500 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:49:56.899500 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:49:56.899500 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:49:56.899500 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:49:56.899500 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:49:56.899500 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:49:56.899500 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 6b59a20bc0ee4f47b52b3c35fcfa189f Aug 27 02:49:56.899500 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1936155010 Aug 27 02:49:56.899500 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:49:56.899500 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:49:56.899500 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6b59a20bc0ee4f47b52b3c35fcfa189f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_6b59a20bc0ee4f47b52b3c35fcfa189f", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6b59a20bc0ee4f47b52b3c35fcfa189f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/6b59a20bc0ee4f47b52b3c35fcfa189f"}]}] Aug 27 02:49:56.899500 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1936155010 Aug 27 02:49:56.899500 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 6b59a20bc0ee4f47b52b3c35fcfa189f Aug 27 02:49:56.899500 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1936155010 Aug 27 02:49:56.899500 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-KeyPairsNegativeTestJSON-1936155010-project Aug 27 02:49:56.899500 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:49:56.899500 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:49:56.899500 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: fad44c508d064d9c84e8f0a58b808287 Aug 27 02:49:56.899500 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1936155010-project Aug 27 02:49:56.899500 n-d-852278-4 devstack@n-api.service[134051]: Aug 27 02:49:56.899500 n-d-852278-4 devstack@n-api.service[134051]: {"keypair": {"name": "tempest-keypair-157902526", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBENHIcTcpxopxVNk+Fq/tjpSlvj14X06E2W+d4dRTr12uZwSDxJ+TZF4DQOUgwx8EB8WeH/TMeF3awTqhRHI/mZTZLvS5YhZ5Av15zHPrBlgwADd49p+J1h3Z8K9vwGlnw=="}} Aug 27 02:49:56.899500 n-d-852278-4 devstack@n-api.service[134051]: method: Aug 27 02:49:56.899500 n-d-852278-4 devstack@n-api.service[134051]: exception: Key pair 'tempest-keypair-157902526' already exists. Aug 27 02:49:56.899500 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-157902526', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBENHIcTcpxopxVNk+Fq/tjpSlvj14X06E2W+d4dRTr12uZwSDxJ+TZF4DQOUgwx8EB8WeH/TMeF3awTqhRHI/mZTZLvS5YhZ5Av15zHPrBlgwADd49p+J1h3Z8K9vwGlnw=='}}} Aug 27 02:49:56.899500 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:49:56.899500 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:56.899500 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 27 02:49:56.899500 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 27 02:49:56.899500 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 27 02:49:56.899500 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 27 02:49:56.899500 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 27 02:49:56.899500 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 27 02:49:56.899500 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 27 02:49:56.899500 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 27 02:49:56.899500 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 27 02:49:56.899500 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 27 02:49:56.899500 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 27 02:49:56.899500 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi result.read() Aug 27 02:49:56.899500 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 27 02:49:56.899500 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 27 02:49:56.899500 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 27 02:49:56.899500 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 27 02:49:56.899500 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 27 02:49:56.899500 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 27 02:49:56.899500 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 27 02:49:56.899500 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 27 02:49:56.899500 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'fad44c508d064d9c84e8f0a58b808287-tempest-keypair-157902526' for key 'key_pairs.uniq_key_pairs0user_id0name'") Aug 27 02:49:56.899500 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:49:56.902754 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 27 02:49:56.902754 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:49:56.902754 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:56.902754 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Aug 27 02:49:56.902754 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi kp.save(context.session) Aug 27 02:49:56.902754 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 27 02:49:56.902754 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi session.flush() Aug 27 02:49:56.902754 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 27 02:49:56.902754 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 27 02:49:56.902754 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 27 02:49:56.902754 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 27 02:49:56.902754 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 27 02:49:56.902754 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 27 02:49:56.902754 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 27 02:49:56.902754 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception Aug 27 02:49:56.902754 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 27 02:49:56.902754 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 27 02:49:56.902754 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 27 02:49:56.902754 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 27 02:49:56.902754 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 27 02:49:56.902754 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 27 02:49:56.902754 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 27 02:49:56.902754 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 27 02:49:56.902754 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 27 02:49:56.902754 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 27 02:49:56.902754 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 27 02:49:56.902754 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 27 02:49:56.902754 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 27 02:49:56.902754 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 27 02:49:56.902754 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 27 02:49:56.902754 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 27 02:49:56.902754 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 27 02:49:56.902754 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 27 02:49:56.902754 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 27 02:49:56.902754 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 27 02:49:56.902754 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 27 02:49:56.902754 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception Aug 27 02:49:56.902754 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 27 02:49:56.902754 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 27 02:49:56.902754 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 27 02:49:56.902754 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 27 02:49:56.902754 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 27 02:49:56.902754 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 27 02:49:56.902754 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 27 02:49:56.902754 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 27 02:49:56.902754 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 27 02:49:56.902754 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 27 02:49:56.902754 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 27 02:49:56.902754 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi result.read() Aug 27 02:49:56.902754 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 27 02:49:56.902754 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 27 02:49:56.902754 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 27 02:49:56.902754 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 27 02:49:56.902754 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 27 02:49:56.902754 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 27 02:49:56.902754 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 27 02:49:56.905838 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 27 02:49:56.905838 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'fad44c508d064d9c84e8f0a58b808287-tempest-keypair-157902526' for key 'key_pairs.uniq_key_pairs0user_id0name'") Aug 27 02:49:56.905838 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Aug 27 02:49:56.905838 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 27, 2, 49, 56, 883439), 'updated_at': None, 'name': 'tempest-keypair-157902526', 'user_id': 'fad44c508d064d9c84e8f0a58b808287', 'fingerprint': 'e3:04:8f:01:0e:60:09:90:ef:f4:9d:79:49:03:ad:13', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBENHIcTcpxopxVNk+Fq/tjpSlvj14X06E2W+d4dRTr12uZwSDxJ+TZF4DQOUgwx8EB8WeH/TMeF3awTqhRHI/mZTZLvS5YhZ5Av15zHPrBlgwADd49p+J1h3Z8K9vwGlnw==', 'type': 'ssh'}] Aug 27 02:49:56.905838 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 27 02:49:56.905838 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:49:56.905838 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:49:56.905838 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:49:56.905838 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:56.905838 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 27 02:49:56.905838 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 27 02:49:56.905838 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 27 02:49:56.905838 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 27 02:49:56.905838 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 02:49:56.905838 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 02:49:56.905838 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 02:49:56.905838 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 02:49:56.905838 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 27 02:49:56.905838 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 27 02:49:56.905838 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6775, in import_key_pair Aug 27 02:49:56.905838 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi keypair.create() Aug 27 02:49:56.905838 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 27 02:49:56.905838 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 27 02:49:56.905838 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Aug 27 02:49:56.905838 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self._create() Aug 27 02:49:56.905838 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Aug 27 02:49:56.905838 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Aug 27 02:49:56.905838 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Aug 27 02:49:56.905838 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Aug 27 02:49:56.905838 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 02:49:56.905838 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 02:49:56.905838 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Aug 27 02:49:56.905838 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Aug 27 02:49:56.905838 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-157902526' already exists. Aug 27 02:49:56.905838 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:49:56.905838 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:49:56.905838 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:49:56.905838 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:56.905838 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:49:56.905838 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:49:56.905838 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:49:56.905838 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:49:56.905838 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:49:56.905838 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:49:56.905838 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:49:56.905838 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:49:56.905838 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:49:56.905838 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:49:56.905838 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:49:56.905838 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:49:56.905838 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 27 02:49:56.905838 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 27 02:49:56.905838 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Aug 27 02:49:56.905838 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Aug 27 02:49:56.905838 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-157902526' already exists. Aug 27 02:49:56.910820 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:49:56.910820 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:49:56.910820 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:49:56.910820 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:56.910820 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:49:56.910820 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:49:56.910820 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:49:56.910820 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:49:56.910820 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-157902526' already exists. Aug 27 02:49:56.910820 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:49:56.910820 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d6ad4eea-4386-4c85-866c-6ae3685cc929 tempest-KeyPairsNegativeTestJSON-1936155010 tempest-KeyPairsNegativeTestJSON-1936155010-project] Returning 409 to user: Key pair 'tempest-keypair-157902526' already exists. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:49:56.910820 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d6ad4eea-4386-4c85-866c-6ae3685cc929 tempest-KeyPairsNegativeTestJSON-1936155010 tempest-KeyPairsNegativeTestJSON-1936155010-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 409 len: 104 microversion: 2.1 time: 0.147911 Aug 27 02:49:56.910820 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1034/2107] 10.222.0.70 () {60 vars in 1159 bytes} [Sat Aug 27 02:49:56 2022] POST /compute/v2.1/os-keypairs => generated 104 bytes in 155 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 27 02:49:56.918884 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-34768eb2-0d5f-436d-a32a-05352b7a5be0 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:56.919497 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-34768eb2-0d5f-436d-a32a-05352b7a5be0 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] [instance: 57a1e617-8846-4da8-b84f-232ffc519f69] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:56.942533 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-34768eb2-0d5f-436d-a32a-05352b7a5be0 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:56.943041 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-34768eb2-0d5f-436d-a32a-05352b7a5be0 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:56.943481 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-34768eb2-0d5f-436d-a32a-05352b7a5be0 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:56.944269 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-34768eb2-0d5f-436d-a32a-05352b7a5be0 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:56.945239 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-34768eb2-0d5f-436d-a32a-05352b7a5be0 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:56.945664 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-34768eb2-0d5f-436d-a32a-05352b7a5be0 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:57.611508 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-34768eb2-0d5f-436d-a32a-05352b7a5be0 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece67529f3704d9faf0ff443d7c016de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c13c5aeb4da472da020639d5b6ad5aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:57.620928 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-34768eb2-0d5f-436d-a32a-05352b7a5be0 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] 10.222.0.70 "GET /compute/v2.1/servers/57a1e617-8846-4da8-b84f-232ffc519f69" status: 200 len: 1332 microversion: 2.1 time: 0.709413 Aug 27 02:49:57.629502 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1035/2108] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:56 2022] GET /compute/v2.1/servers/57a1e617-8846-4da8-b84f-232ffc519f69 => generated 1332 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:57.640609 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-23abd688-e0f6-4435-8300-82f9b5c5a9fb req-f1f7d7b0-4d5b-46ad-82d1-62b015a321ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14df3dce-7fb6-491c-9559-6fbca68580b0", "tag": "7484d94b-dbe7-4864-b57a-8baf10193a92"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:49:57.669093 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-23abd688-e0f6-4435-8300-82f9b5c5a9fb req-f1f7d7b0-4d5b-46ad-82d1-62b015a321ac service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:57.677519 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-23abd688-e0f6-4435-8300-82f9b5c5a9fb req-f1f7d7b0-4d5b-46ad-82d1-62b015a321ac service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:57.678012 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-23abd688-e0f6-4435-8300-82f9b5c5a9fb req-f1f7d7b0-4d5b-46ad-82d1-62b015a321ac service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:57.710038 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-23abd688-e0f6-4435-8300-82f9b5c5a9fb req-f1f7d7b0-4d5b-46ad-82d1-62b015a321ac service nova] Creating event network-changed:7484d94b-dbe7-4864-b57a-8baf10193a92 for instance 14df3dce-7fb6-491c-9559-6fbca68580b0 on n-h2-852278-4 Aug 27 02:49:57.722040 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-23abd688-e0f6-4435-8300-82f9b5c5a9fb req-f1f7d7b0-4d5b-46ad-82d1-62b015a321ac service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090938 Aug 27 02:49:57.722753 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1036/2109] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:49:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:49:57.731966 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a73ea9f3-82c1-4485-86c2-99258469e5f5 tempest-KeyPairsNegativeTestJSON-1936155010 tempest-KeyPairsNegativeTestJSON-1936155010-project] Calling method '.version_select at 0x7f5ee71c4f70>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:57.778332 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a73ea9f3-82c1-4485-86c2-99258469e5f5 tempest-KeyPairsNegativeTestJSON-1936155010 tempest-KeyPairsNegativeTestJSON-1936155010-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-157902526" status: 202 len: 0 microversion: 2.1 time: 0.054074 Aug 27 02:49:57.779406 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1037/2110] 10.222.0.70 () {58 vars in 1218 bytes} [Sat Aug 27 02:49:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-157902526 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:49:57.784060 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4bb0cd6e-33e6-4f03-8260-82316425489b tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:57.784838 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-4bb0cd6e-33e6-4f03-8260-82316425489b tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] [instance: 484e03a9-aef3-4179-980c-0e7292a05b5a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:57.800487 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4bb0cd6e-33e6-4f03-8260-82316425489b tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:57.800997 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4bb0cd6e-33e6-4f03-8260-82316425489b tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:57.801442 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4bb0cd6e-33e6-4f03-8260-82316425489b tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:57.802311 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4bb0cd6e-33e6-4f03-8260-82316425489b tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:57.802600 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4bb0cd6e-33e6-4f03-8260-82316425489b tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:57.803062 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4bb0cd6e-33e6-4f03-8260-82316425489b tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:58.351638 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.network.neutron [None req-ebd7a9f2-f39d-4253-b410-32a79e9aa8a3 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] [instance: 26795af5-99b8-4a26-9843-3781a5016217] Building network info cache for instance {{(pid=134052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 27 02:49:58.590111 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-4bb0cd6e-33e6-4f03-8260-82316425489b tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:58.608631 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-4bb0cd6e-33e6-4f03-8260-82316425489b tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:58.613026 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-4bb0cd6e-33e6-4f03-8260-82316425489b tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:58.615131 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-4bb0cd6e-33e6-4f03-8260-82316425489b tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] 10.222.0.70 "GET /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a" status: 200 len: 2915 microversion: 2.42 time: 0.834684 Aug 27 02:49:58.632880 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1038/2111] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:49:57 2022] GET /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a => generated 2915 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:49:58.645778 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-1539170c-49b2-4844-85ff-3b87d9a0611e req-1cb91a6f-be87-44f1-ad44-9f9bb01eff86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57a1e617-8846-4da8-b84f-232ffc519f69", "name": "network-vif-plugged", "status": "completed", "tag": "f1fc64b5-9211-456f-b514-94d86ae29282"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:49:58.666506 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-1539170c-49b2-4844-85ff-3b87d9a0611e req-1cb91a6f-be87-44f1-ad44-9f9bb01eff86 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:58.669150 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-1539170c-49b2-4844-85ff-3b87d9a0611e req-1cb91a6f-be87-44f1-ad44-9f9bb01eff86 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:58.669885 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-1539170c-49b2-4844-85ff-3b87d9a0611e req-1cb91a6f-be87-44f1-ad44-9f9bb01eff86 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:58.692101 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-1539170c-49b2-4844-85ff-3b87d9a0611e req-1cb91a6f-be87-44f1-ad44-9f9bb01eff86 service nova] Creating event network-vif-plugged:f1fc64b5-9211-456f-b514-94d86ae29282 for instance 57a1e617-8846-4da8-b84f-232ffc519f69 on n-h2-852278-4 Aug 27 02:49:58.708056 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-1539170c-49b2-4844-85ff-3b87d9a0611e req-1cb91a6f-be87-44f1-ad44-9f9bb01eff86 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073339 Aug 27 02:49:58.710155 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1039/2112] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:49:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:49:58.719068 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-07410a0d-0dc0-46b2-b214-5b3fdcb15a0d tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:58.721035 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-07410a0d-0dc0-46b2-b214-5b3fdcb15a0d tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: cac17f47-6e08-4f15-a8cf-f5e44ad03d12] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:58.764419 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-07410a0d-0dc0-46b2-b214-5b3fdcb15a0d tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:58.782967 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-07410a0d-0dc0-46b2-b214-5b3fdcb15a0d tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:58.786944 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-07410a0d-0dc0-46b2-b214-5b3fdcb15a0d tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:58.793518 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-07410a0d-0dc0-46b2-b214-5b3fdcb15a0d tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:58.794138 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-07410a0d-0dc0-46b2-b214-5b3fdcb15a0d tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:58.796396 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-07410a0d-0dc0-46b2-b214-5b3fdcb15a0d tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:59.288654 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-07410a0d-0dc0-46b2-b214-5b3fdcb15a0d tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:59.297519 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-07410a0d-0dc0-46b2-b214-5b3fdcb15a0d tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/cac17f47-6e08-4f15-a8cf-f5e44ad03d12" status: 200 len: 1475 microversion: 2.1 time: 0.585818 Aug 27 02:49:59.316473 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1040/2113] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:58 2022] GET /compute/v2.1/servers/cac17f47-6e08-4f15-a8cf-f5e44ad03d12 => generated 1475 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:59.321734 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-96507bc5-b00c-4112-a165-448dad3fd2f6 tempest-KeyPairsNegativeTestJSON-1936155010 tempest-KeyPairsNegativeTestJSON-1936155010-project] Action: 'create', calling method: .version_select at 0x7f5ee7202430>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK13MVa6bsbp0xjHtGmT8Hyl8+n9Q0VnOGRkdUQ7nZ6sBmvDtYTzxJ/Q9ja8uAsF7s/UHtFgyLPTkOmBZ+adRi/cK2wxj4k5LP6e/CCdMaIdeHFuzUnpUXcogBb4u+4XdQ=="}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:49:59.325915 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-96507bc5-b00c-4112-a165-448dad3fd2f6 tempest-KeyPairsNegativeTestJSON-1936155010 tempest-KeyPairsNegativeTestJSON-1936155010-project] Request method failure captured: Aug 27 02:49:59.325915 n-d-852278-4 devstack@n-api.service[134051]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 27 02:49:59.325915 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:49:59.325915 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:49:59.325915 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:49:59.325915 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 247 Aug 27 02:49:59.325915 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:49:59.325915 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:49:59.325915 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:49:59.325915 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:49:59.325915 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYZRidFy6t-pLV-mM86njli7w4Vl-0bnBXcz0_vb_UjKgVyfK8vmvik7N4wdj9PXlVI-w6r0uqDPhexJ-GRRlcNhKK13Li-Z2wC9f9cLVmHFZC-vZglOEYPx1mtvHQoJAKHpnnWrCQpFAzc1pfmiD7LNCdL9rxM-scVuQ-dVMbsC5xc Aug 27 02:49:59.325915 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:49:59.325915 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:49:59.325915 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:49:59.325915 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:49:59.325915 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:49:59.325915 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:49:59.325915 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 6b59a20bc0ee4f47b52b3c35fcfa189f Aug 27 02:49:59.325915 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1936155010 Aug 27 02:49:59.325915 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:49:59.325915 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:49:59.325915 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6b59a20bc0ee4f47b52b3c35fcfa189f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_6b59a20bc0ee4f47b52b3c35fcfa189f", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6b59a20bc0ee4f47b52b3c35fcfa189f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/6b59a20bc0ee4f47b52b3c35fcfa189f"}]}] Aug 27 02:49:59.325915 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1936155010 Aug 27 02:49:59.325915 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 6b59a20bc0ee4f47b52b3c35fcfa189f Aug 27 02:49:59.325915 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1936155010 Aug 27 02:49:59.325915 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-KeyPairsNegativeTestJSON-1936155010-project Aug 27 02:49:59.325915 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:49:59.325915 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:49:59.325915 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: fad44c508d064d9c84e8f0a58b808287 Aug 27 02:49:59.325915 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1936155010-project Aug 27 02:49:59.325915 n-d-852278-4 devstack@n-api.service[134051]: Aug 27 02:49:59.325915 n-d-852278-4 devstack@n-api.service[134051]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK13MVa6bsbp0xjHtGmT8Hyl8+n9Q0VnOGRkdUQ7nZ6sBmvDtYTzxJ/Q9ja8uAsF7s/UHtFgyLPTkOmBZ+adRi/cK2wxj4k5LP6e/CCdMaIdeHFuzUnpUXcogBb4u+4XdQ=="}} Aug 27 02:49:59.325915 n-d-852278-4 devstack@n-api.service[134051]: method: Aug 27 02:49:59.325915 n-d-852278-4 devstack@n-api.service[134051]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 27 02:49:59.325915 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK13MVa6bsbp0xjHtGmT8Hyl8+n9Q0VnOGRkdUQ7nZ6sBmvDtYTzxJ/Q9ja8uAsF7s/UHtFgyLPTkOmBZ+adRi/cK2wxj4k5LP6e/CCdMaIdeHFuzUnpUXcogBb4u+4XdQ=='}}} Aug 27 02:49:59.325915 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:49:59.325915 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:59.325915 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 02:49:59.325915 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 02:49:59.325915 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 02:49:59.325915 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise error Aug 27 02:49:59.325915 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 27 02:49:59.325915 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:49:59.325915 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Aug 27 02:49:59.325915 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 27 02:49:59.325915 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:49:59.325915 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi On instance['keypair']: Aug 27 02:49:59.325915 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi '' Aug 27 02:49:59.325915 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:49:59.325915 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:49:59.325915 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:49:59.325915 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:59.325915 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:49:59.325915 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:49:59.325915 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:49:59.325915 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:49:59.325915 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:49:59.325915 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:49:59.325915 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:49:59.325915 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:49:59.325915 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:49:59.325915 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:49:59.325915 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 02:49:59.325915 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 02:49:59.330831 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 02:49:59.330831 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 02:49:59.330831 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 02:49:59.330831 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 02:49:59.330831 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 27 02:49:59.330831 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:49:59.330831 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:49:59.330831 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:49:59.330831 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:59.330831 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:49:59.330831 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:49:59.330831 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 02:49:59.330831 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 02:49:59.330831 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 27 02:49:59.330831 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:49:59.332380 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-96507bc5-b00c-4112-a165-448dad3fd2f6 tempest-KeyPairsNegativeTestJSON-1936155010 tempest-KeyPairsNegativeTestJSON-1936155010-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:49:59.333406 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-96507bc5-b00c-4112-a165-448dad3fd2f6 tempest-KeyPairsNegativeTestJSON-1936155010 tempest-KeyPairsNegativeTestJSON-1936155010-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.015854 Aug 27 02:49:59.334131 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1041/2114] 10.222.0.70 () {60 vars in 1159 bytes} [Sat Aug 27 02:49:59 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 02:49:59.341327 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-1104d852-2a53-43f7-ab33-915c47e55929 req-3e398f49-6b95-4277-bde1-d66b96be9e30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26795af5-99b8-4a26-9843-3781a5016217", "tag": "072e51fc-e3f0-46c0-b5a9-45f131439621"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:49:59.352860 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-1104d852-2a53-43f7-ab33-915c47e55929 req-3e398f49-6b95-4277-bde1-d66b96be9e30 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:59.353506 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-1104d852-2a53-43f7-ab33-915c47e55929 req-3e398f49-6b95-4277-bde1-d66b96be9e30 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:59.354081 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-1104d852-2a53-43f7-ab33-915c47e55929 req-3e398f49-6b95-4277-bde1-d66b96be9e30 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:59.368908 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-1104d852-2a53-43f7-ab33-915c47e55929 req-3e398f49-6b95-4277-bde1-d66b96be9e30 service nova] Creating event network-changed:072e51fc-e3f0-46c0-b5a9-45f131439621 for instance 26795af5-99b8-4a26-9843-3781a5016217 on n-h1-852278-4 Aug 27 02:49:59.381375 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-1104d852-2a53-43f7-ab33-915c47e55929 req-3e398f49-6b95-4277-bde1-d66b96be9e30 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045750 Aug 27 02:49:59.382618 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1042/2115] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:49:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:49:59.388013 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c9d20dbe-21cf-490e-bdf7-c7ca5790653b tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:59.389087 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-c9d20dbe-21cf-490e-bdf7-c7ca5790653b tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] [instance: 57a1e617-8846-4da8-b84f-232ffc519f69] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:59.397765 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c9d20dbe-21cf-490e-bdf7-c7ca5790653b tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:59.398547 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c9d20dbe-21cf-490e-bdf7-c7ca5790653b tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:59.399377 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c9d20dbe-21cf-490e-bdf7-c7ca5790653b tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:59.400255 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c9d20dbe-21cf-490e-bdf7-c7ca5790653b tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:59.400947 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c9d20dbe-21cf-490e-bdf7-c7ca5790653b tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:59.401579 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c9d20dbe-21cf-490e-bdf7-c7ca5790653b tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:59.844736 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-c9d20dbe-21cf-490e-bdf7-c7ca5790653b tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece67529f3704d9faf0ff443d7c016de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c13c5aeb4da472da020639d5b6ad5aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:59.868657 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c9d20dbe-21cf-490e-bdf7-c7ca5790653b tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] 10.222.0.70 "GET /compute/v2.1/servers/57a1e617-8846-4da8-b84f-232ffc519f69" status: 200 len: 1332 microversion: 2.1 time: 0.481895 Aug 27 02:49:59.884468 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1043/2116] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:59 2022] GET /compute/v2.1/servers/57a1e617-8846-4da8-b84f-232ffc519f69 => generated 1332 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:59.896429 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ee687a15-52bc-4be9-915e-05fac8b5aad9 tempest-KeyPairsNegativeTestJSON-1936155010 tempest-KeyPairsNegativeTestJSON-1936155010-project] Action: 'create', calling method: .version_select at 0x7f5ee7342af0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1981580142", "public_key": " "}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:49:59.944400 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-ee687a15-52bc-4be9-915e-05fac8b5aad9 tempest-KeyPairsNegativeTestJSON-1936155010 tempest-KeyPairsNegativeTestJSON-1936155010-project] Getting quotas for project 6b59a20bc0ee4f47b52b3c35fcfa189f. Resources: {'key_pairs'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:49:59.958340 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-ee687a15-52bc-4be9-915e-05fac8b5aad9 tempest-KeyPairsNegativeTestJSON-1936155010 tempest-KeyPairsNegativeTestJSON-1936155010-project] Getting quotas for user fad44c508d064d9c84e8f0a58b808287 and project 6b59a20bc0ee4f47b52b3c35fcfa189f. Resources: {'key_pairs'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:50:00.016092 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-ee687a15-52bc-4be9-915e-05fac8b5aad9 tempest-KeyPairsNegativeTestJSON-1936155010 tempest-KeyPairsNegativeTestJSON-1936155010-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 27 02:50:00.018434 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ee687a15-52bc-4be9-915e-05fac8b5aad9 tempest-KeyPairsNegativeTestJSON-1936155010 tempest-KeyPairsNegativeTestJSON-1936155010-project] Request method failure captured: Aug 27 02:50:00.018434 n-d-852278-4 devstack@n-api.service[134051]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 27 02:50:00.018434 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:50:00.018434 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:50:00.018434 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:50:00.018434 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 95 Aug 27 02:50:00.018434 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:50:00.018434 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:50:00.018434 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:50:00.018434 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:50:00.018434 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYZRidFy6t-pLV-mM86njli7w4Vl-0bnBXcz0_vb_UjKgVyfK8vmvik7N4wdj9PXlVI-w6r0uqDPhexJ-GRRlcNhKK13Li-Z2wC9f9cLVmHFZC-vZglOEYPx1mtvHQoJAKHpnnWrCQpFAzc1pfmiD7LNCdL9rxM-scVuQ-dVMbsC5xc Aug 27 02:50:00.018434 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:50:00.018434 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:50:00.018434 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:50:00.018434 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:50:00.018434 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:50:00.018434 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:50:00.018434 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 6b59a20bc0ee4f47b52b3c35fcfa189f Aug 27 02:50:00.018434 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1936155010 Aug 27 02:50:00.018434 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:50:00.018434 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:50:00.018434 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6b59a20bc0ee4f47b52b3c35fcfa189f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_6b59a20bc0ee4f47b52b3c35fcfa189f", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6b59a20bc0ee4f47b52b3c35fcfa189f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/6b59a20bc0ee4f47b52b3c35fcfa189f"}]}] Aug 27 02:50:00.018434 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1936155010 Aug 27 02:50:00.018434 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 6b59a20bc0ee4f47b52b3c35fcfa189f Aug 27 02:50:00.018434 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1936155010 Aug 27 02:50:00.018434 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-KeyPairsNegativeTestJSON-1936155010-project Aug 27 02:50:00.018434 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:50:00.018434 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:50:00.018434 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: fad44c508d064d9c84e8f0a58b808287 Aug 27 02:50:00.018434 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1936155010-project Aug 27 02:50:00.018434 n-d-852278-4 devstack@n-api.service[134051]: Aug 27 02:50:00.018434 n-d-852278-4 devstack@n-api.service[134051]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1981580142", "public_key": " "}} Aug 27 02:50:00.018434 n-d-852278-4 devstack@n-api.service[134051]: method: Aug 27 02:50:00.018434 n-d-852278-4 devstack@n-api.service[134051]: exception: Keypair data is invalid: failed to generate fingerprint Aug 27 02:50:00.018434 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1981580142', 'public_key': ' '}}} Aug 27 02:50:00.018434 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:50:00.018434 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:00.018434 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 27 02:50:00.018434 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 27 02:50:00.018434 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Aug 27 02:50:00.018434 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Aug 27 02:50:00.018434 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Aug 27 02:50:00.018434 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:50:00.018434 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:50:00.018434 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:50:00.018434 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:00.018434 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 27 02:50:00.018434 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 27 02:50:00.018434 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 27 02:50:00.018434 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 27 02:50:00.018434 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 02:50:00.018434 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 02:50:00.018434 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 02:50:00.018434 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 02:50:00.018434 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 27 02:50:00.018434 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 27 02:50:00.018434 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6772, in import_key_pair Aug 27 02:50:00.018434 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 27 02:50:00.018434 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6845, in _generate_fingerprint Aug 27 02:50:00.018434 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 27 02:50:00.018434 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 27 02:50:00.018434 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 27 02:50:00.018434 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 27 02:50:00.018434 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:50:00.018434 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:50:00.018434 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:50:00.022514 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:00.022514 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:50:00.022514 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:50:00.022514 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:50:00.022514 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:50:00.022514 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:50:00.022514 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:50:00.022514 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:50:00.022514 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:50:00.022514 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:50:00.022514 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:50:00.022514 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:50:00.022514 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:50:00.022514 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 27 02:50:00.022514 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 27 02:50:00.022514 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 27 02:50:00.022514 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 27 02:50:00.022514 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 27 02:50:00.022514 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:50:00.022514 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:50:00.022514 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:50:00.022514 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:00.022514 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:50:00.022514 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:50:00.022514 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:50:00.022514 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:50:00.022514 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 27 02:50:00.022514 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:50:00.026042 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ee687a15-52bc-4be9-915e-05fac8b5aad9 tempest-KeyPairsNegativeTestJSON-1936155010 tempest-KeyPairsNegativeTestJSON-1936155010-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:50:00.027143 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ee687a15-52bc-4be9-915e-05fac8b5aad9 tempest-KeyPairsNegativeTestJSON-1936155010 tempest-KeyPairsNegativeTestJSON-1936155010-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.141219 Aug 27 02:50:00.027917 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1044/2117] 10.222.0.70 () {60 vars in 1158 bytes} [Sat Aug 27 02:49:59 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 143 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 27 02:50:00.032917 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-9cd88ead-71a8-4990-b0b2-359d79fc7037 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:00.036046 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-9cd88ead-71a8-4990-b0b2-359d79fc7037 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] [instance: 484e03a9-aef3-4179-980c-0e7292a05b5a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:00.057518 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9cd88ead-71a8-4990-b0b2-359d79fc7037 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:00.061673 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9cd88ead-71a8-4990-b0b2-359d79fc7037 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:00.062383 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9cd88ead-71a8-4990-b0b2-359d79fc7037 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:00.063300 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9cd88ead-71a8-4990-b0b2-359d79fc7037 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:00.063898 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9cd88ead-71a8-4990-b0b2-359d79fc7037 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:00.067923 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9cd88ead-71a8-4990-b0b2-359d79fc7037 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:00.850847 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-9cd88ead-71a8-4990-b0b2-359d79fc7037 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:00.864430 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-9cd88ead-71a8-4990-b0b2-359d79fc7037 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:00.870122 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-9cd88ead-71a8-4990-b0b2-359d79fc7037 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:00.871715 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-9cd88ead-71a8-4990-b0b2-359d79fc7037 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] 10.222.0.70 "GET /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a" status: 200 len: 2777 microversion: 2.42 time: 0.842623 Aug 27 02:50:00.878754 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1045/2118] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:50:00 2022] GET /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a => generated 2777 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:50:00.892442 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-2afad1f3-a1fd-4b62-9e4d-6095daf2160e req-c511dcb2-35f6-4eca-8081-f73270f7286c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "484e03a9-aef3-4179-980c-0e7292a05b5a", "name": "network-vif-deleted", "tag": "d8eb72ae-98e1-459d-a013-766f76a30e3d"}, {"server_uuid": "484e03a9-aef3-4179-980c-0e7292a05b5a", "name": "network-vif-deleted", "tag": "1689be35-623f-4a81-9df4-0846ddac5f37"}, {"server_uuid": "484e03a9-aef3-4179-980c-0e7292a05b5a", "name": "network-vif-deleted", "tag": "d59ac6c7-2440-450a-955f-48c4271b051e"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:50:00.939668 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-2afad1f3-a1fd-4b62-9e4d-6095daf2160e req-c511dcb2-35f6-4eca-8081-f73270f7286c service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:00.940172 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-2afad1f3-a1fd-4b62-9e4d-6095daf2160e req-c511dcb2-35f6-4eca-8081-f73270f7286c service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:00.940641 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-2afad1f3-a1fd-4b62-9e4d-6095daf2160e req-c511dcb2-35f6-4eca-8081-f73270f7286c service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:00.970690 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-2afad1f3-a1fd-4b62-9e4d-6095daf2160e req-c511dcb2-35f6-4eca-8081-f73270f7286c service nova] Creating event network-vif-deleted:d8eb72ae-98e1-459d-a013-766f76a30e3d for instance 484e03a9-aef3-4179-980c-0e7292a05b5a on n-h1-852278-4 Aug 27 02:50:00.971200 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-2afad1f3-a1fd-4b62-9e4d-6095daf2160e req-c511dcb2-35f6-4eca-8081-f73270f7286c service nova] Creating event network-vif-deleted:1689be35-623f-4a81-9df4-0846ddac5f37 for instance 484e03a9-aef3-4179-980c-0e7292a05b5a on n-h1-852278-4 Aug 27 02:50:00.971876 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-2afad1f3-a1fd-4b62-9e4d-6095daf2160e req-c511dcb2-35f6-4eca-8081-f73270f7286c service nova] Creating event network-vif-deleted:d59ac6c7-2440-450a-955f-48c4271b051e for instance 484e03a9-aef3-4179-980c-0e7292a05b5a on n-h1-852278-4 Aug 27 02:50:00.977958 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-2afad1f3-a1fd-4b62-9e4d-6095daf2160e req-c511dcb2-35f6-4eca-8081-f73270f7286c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.097638 Aug 27 02:50:00.979631 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1046/2119] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:50:00 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:50:00.986312 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ad2eb4ea-049c-4ef4-ac43-31ff5edb673e tempest-KeyPairsNegativeTestJSON-1936155010 tempest-KeyPairsNegativeTestJSON-1936155010-project] Action: 'create', calling method: .version_select at 0x7f5ede8e9c10>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHH/0aoq2XMi0pEbw9kJS++Fz2mBymm/l07cfKhrdWBlMOv+Yidiymy/u12Ky/GXRkG08FiJ0evVNNS8DBuvDqEqh0w6bpX5n0VhkpasIVAUQmJV8IgHXLDlF6/JtOxFcA=="}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:50:00.993085 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ad2eb4ea-049c-4ef4-ac43-31ff5edb673e tempest-KeyPairsNegativeTestJSON-1936155010 tempest-KeyPairsNegativeTestJSON-1936155010-project] Request method failure captured: Aug 27 02:50:00.993085 n-d-852278-4 devstack@n-api.service[134051]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 27 02:50:00.993085 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:50:00.993085 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:50:00.993085 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:50:00.993085 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 507 Aug 27 02:50:00.993085 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:50:00.993085 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:50:00.993085 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:50:00.993085 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:50:00.993085 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYZRidFy6t-pLV-mM86njli7w4Vl-0bnBXcz0_vb_UjKgVyfK8vmvik7N4wdj9PXlVI-w6r0uqDPhexJ-GRRlcNhKK13Li-Z2wC9f9cLVmHFZC-vZglOEYPx1mtvHQoJAKHpnnWrCQpFAzc1pfmiD7LNCdL9rxM-scVuQ-dVMbsC5xc Aug 27 02:50:00.993085 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:50:00.993085 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:50:00.993085 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:50:00.993085 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:50:00.993085 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:50:00.993085 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:50:00.993085 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 6b59a20bc0ee4f47b52b3c35fcfa189f Aug 27 02:50:00.993085 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1936155010 Aug 27 02:50:00.993085 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:50:00.993085 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:50:00.993085 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6b59a20bc0ee4f47b52b3c35fcfa189f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_6b59a20bc0ee4f47b52b3c35fcfa189f", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6b59a20bc0ee4f47b52b3c35fcfa189f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/6b59a20bc0ee4f47b52b3c35fcfa189f"}]}] Aug 27 02:50:00.993085 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1936155010 Aug 27 02:50:00.993085 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 6b59a20bc0ee4f47b52b3c35fcfa189f Aug 27 02:50:00.993085 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1936155010 Aug 27 02:50:00.993085 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-KeyPairsNegativeTestJSON-1936155010-project Aug 27 02:50:00.993085 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:50:00.993085 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:50:00.993085 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: fad44c508d064d9c84e8f0a58b808287 Aug 27 02:50:00.993085 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1936155010-project Aug 27 02:50:00.993085 n-d-852278-4 devstack@n-api.service[134051]: Aug 27 02:50:00.993085 n-d-852278-4 devstack@n-api.service[134051]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHH/0aoq2XMi0pEbw9kJS++Fz2mBymm/l07cfKhrdWBlMOv+Yidiymy/u12Ky/GXRkG08FiJ0evVNNS8DBuvDqEqh0w6bpX5n0VhkpasIVAUQmJV8IgHXLDlF6/JtOxFcA=="}} Aug 27 02:50:00.993085 n-d-852278-4 devstack@n-api.service[134051]: method: Aug 27 02:50:00.993085 n-d-852278-4 devstack@n-api.service[134051]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 27 02:50:00.993085 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHH/0aoq2XMi0pEbw9kJS++Fz2mBymm/l07cfKhrdWBlMOv+Yidiymy/u12Ky/GXRkG08FiJ0evVNNS8DBuvDqEqh0w6bpX5n0VhkpasIVAUQmJV8IgHXLDlF6/JtOxFcA=='}}} Aug 27 02:50:00.993085 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:50:00.993085 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:00.993085 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 02:50:00.993085 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 02:50:00.993085 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 02:50:00.993085 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise error Aug 27 02:50:00.993085 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 27 02:50:00.993085 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:50:00.993085 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Aug 27 02:50:00.993085 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 27 02:50:00.993085 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:50:00.993085 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi On instance['keypair']: Aug 27 02:50:00.993085 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Aug 27 02:50:00.997420 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:50:00.997420 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:50:00.997420 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:50:00.997420 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:00.997420 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:50:00.997420 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:50:00.997420 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:50:00.997420 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:50:00.997420 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:50:00.997420 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:50:00.997420 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:50:00.997420 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:50:00.997420 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:50:00.997420 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:50:00.997420 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 02:50:00.997420 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 02:50:00.997420 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 02:50:00.997420 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 02:50:00.997420 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 02:50:00.997420 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 02:50:00.997420 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 27 02:50:00.997420 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:50:00.997420 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:50:00.997420 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:50:00.997420 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:00.997420 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:50:00.997420 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:50:00.997420 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 02:50:00.997420 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 02:50:00.997420 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 27 02:50:00.997420 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:50:00.997420 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ad2eb4ea-049c-4ef4-ac43-31ff5edb673e tempest-KeyPairsNegativeTestJSON-1936155010 tempest-KeyPairsNegativeTestJSON-1936155010-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:50:00.997420 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ad2eb4ea-049c-4ef4-ac43-31ff5edb673e tempest-KeyPairsNegativeTestJSON-1936155010 tempest-KeyPairsNegativeTestJSON-1936155010-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.013232 Aug 27 02:50:00.997420 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1047/2120] 10.222.0.70 () {60 vars in 1159 bytes} [Sat Aug 27 02:50:00 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 02:50:01.001608 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-eda35967-ee2d-4b1d-a781-181c62212018 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:01.002518 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-eda35967-ee2d-4b1d-a781-181c62212018 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: cac17f47-6e08-4f15-a8cf-f5e44ad03d12] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:01.010554 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eda35967-ee2d-4b1d-a781-181c62212018 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:01.011432 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eda35967-ee2d-4b1d-a781-181c62212018 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:01.012027 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eda35967-ee2d-4b1d-a781-181c62212018 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:01.013394 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eda35967-ee2d-4b1d-a781-181c62212018 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:01.014142 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eda35967-ee2d-4b1d-a781-181c62212018 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:01.014781 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eda35967-ee2d-4b1d-a781-181c62212018 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:01.268939 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.network.neutron [None req-ebd7a9f2-f39d-4253-b410-32a79e9aa8a3 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] [instance: 26795af5-99b8-4a26-9843-3781a5016217] Updating instance_info_cache with network_info: [{"id": "072e51fc-e3f0-46c0-b5a9-45f131439621", "address": "fa:16:3e:3b:62:32", "network": {"id": "56c1e6e5-f638-4015-aee9-61020b017eac", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-265073614-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "4f9be56fbeb64cb08b9be4e3d7436782", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap072e51fc-e3", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=134052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 27 02:50:01.290025 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ebd7a9f2-f39d-4253-b410-32a79e9aa8a3 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Releasing lock "refresh_cache-26795af5-99b8-4a26-9843-3781a5016217" {{(pid=134052) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 27 02:50:01.291093 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ebd7a9f2-f39d-4253-b410-32a79e9aa8a3 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] 10.222.0.70 "POST /compute/v2.1/servers/26795af5-99b8-4a26-9843-3781a5016217/action" status: 202 len: 0 microversion: 2.1 time: 7.382047 Aug 27 02:50:01.293733 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1074/2121] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 02:49:53 2022] POST /compute/v2.1/servers/26795af5-99b8-4a26-9843-3781a5016217/action => generated 0 bytes in 7385 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 27 02:50:01.305380 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-082ccde1-6f8f-406b-aa7f-02fcd3f201d8 req-a56f8ca0-04d5-4744-aed7-72f35d9dd8c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "484e03a9-aef3-4179-980c-0e7292a05b5a", "name": "network-vif-unplugged", "status": "completed", "tag": "cd7a0d56-e84b-4f98-9baf-449824810d8d"}, {"server_uuid": "484e03a9-aef3-4179-980c-0e7292a05b5a", "name": "network-vif-unplugged", "status": "completed", "tag": "c90fb304-b679-479a-ba4f-cede7f0a36e7"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:50:01.329625 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:50:01.340714 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-082ccde1-6f8f-406b-aa7f-02fcd3f201d8 req-a56f8ca0-04d5-4744-aed7-72f35d9dd8c5 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:01.342157 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-082ccde1-6f8f-406b-aa7f-02fcd3f201d8 req-a56f8ca0-04d5-4744-aed7-72f35d9dd8c5 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:01.343010 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-082ccde1-6f8f-406b-aa7f-02fcd3f201d8 req-a56f8ca0-04d5-4744-aed7-72f35d9dd8c5 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:01.361907 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-082ccde1-6f8f-406b-aa7f-02fcd3f201d8 req-a56f8ca0-04d5-4744-aed7-72f35d9dd8c5 service nova] Creating event network-vif-unplugged:cd7a0d56-e84b-4f98-9baf-449824810d8d for instance 484e03a9-aef3-4179-980c-0e7292a05b5a on n-h1-852278-4 Aug 27 02:50:01.363451 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-082ccde1-6f8f-406b-aa7f-02fcd3f201d8 req-a56f8ca0-04d5-4744-aed7-72f35d9dd8c5 service nova] Creating event network-vif-unplugged:c90fb304-b679-479a-ba4f-cede7f0a36e7 for instance 484e03a9-aef3-4179-980c-0e7292a05b5a on n-h1-852278-4 Aug 27 02:50:01.370817 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-082ccde1-6f8f-406b-aa7f-02fcd3f201d8 req-a56f8ca0-04d5-4744-aed7-72f35d9dd8c5 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.075551 Aug 27 02:50:01.372222 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1075/2122] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:50:01 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:50:01.383357 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-680429c4-eaba-4514-a7e5-07d77b1fec12 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:01.384085 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-680429c4-eaba-4514-a7e5-07d77b1fec12 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] [instance: 57a1e617-8846-4da8-b84f-232ffc519f69] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:01.408639 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-680429c4-eaba-4514-a7e5-07d77b1fec12 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:01.409155 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-680429c4-eaba-4514-a7e5-07d77b1fec12 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:01.411457 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-680429c4-eaba-4514-a7e5-07d77b1fec12 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:01.412250 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-680429c4-eaba-4514-a7e5-07d77b1fec12 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:01.415148 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-680429c4-eaba-4514-a7e5-07d77b1fec12 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:01.415602 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-680429c4-eaba-4514-a7e5-07d77b1fec12 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:01.802453 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-eda35967-ee2d-4b1d-a781-181c62212018 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:01.817725 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-eda35967-ee2d-4b1d-a781-181c62212018 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/cac17f47-6e08-4f15-a8cf-f5e44ad03d12" status: 200 len: 1475 microversion: 2.1 time: 0.821357 Aug 27 02:50:01.834448 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1048/2123] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:00 2022] GET /compute/v2.1/servers/cac17f47-6e08-4f15-a8cf-f5e44ad03d12 => generated 1475 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:50:01.841160 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-40746c0a-b308-49a6-941d-d71a32b9ee82 tempest-KeyPairsNegativeTestJSON-1936155010 tempest-KeyPairsNegativeTestJSON-1936155010-project] Action: 'create', calling method: .version_select at 0x7f5ee72695e0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1444997694", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:50:01.864943 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-40746c0a-b308-49a6-941d-d71a32b9ee82 tempest-KeyPairsNegativeTestJSON-1936155010 tempest-KeyPairsNegativeTestJSON-1936155010-project] Getting quotas for project 6b59a20bc0ee4f47b52b3c35fcfa189f. Resources: {'key_pairs'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:50:01.873378 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-40746c0a-b308-49a6-941d-d71a32b9ee82 tempest-KeyPairsNegativeTestJSON-1936155010 tempest-KeyPairsNegativeTestJSON-1936155010-project] Getting quotas for user fad44c508d064d9c84e8f0a58b808287 and project 6b59a20bc0ee4f47b52b3c35fcfa189f. Resources: {'key_pairs'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:50:01.895376 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-680429c4-eaba-4514-a7e5-07d77b1fec12 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece67529f3704d9faf0ff443d7c016de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c13c5aeb4da472da020639d5b6ad5aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:01.905177 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-680429c4-eaba-4514-a7e5-07d77b1fec12 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] 10.222.0.70 "GET /compute/v2.1/servers/57a1e617-8846-4da8-b84f-232ffc519f69" status: 200 len: 1536 microversion: 2.1 time: 0.531215 Aug 27 02:50:01.905767 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1076/2124] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:01 2022] GET /compute/v2.1/servers/57a1e617-8846-4da8-b84f-232ffc519f69 => generated 1536 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:50:01.906722 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-40746c0a-b308-49a6-941d-d71a32b9ee82 tempest-KeyPairsNegativeTestJSON-1936155010 tempest-KeyPairsNegativeTestJSON-1936155010-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 27 02:50:01.908844 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-40746c0a-b308-49a6-941d-d71a32b9ee82 tempest-KeyPairsNegativeTestJSON-1936155010 tempest-KeyPairsNegativeTestJSON-1936155010-project] Request method failure captured: Aug 27 02:50:01.908844 n-d-852278-4 devstack@n-api.service[134051]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 27 02:50:01.908844 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:50:01.908844 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:50:01.908844 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:50:01.908844 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 118 Aug 27 02:50:01.908844 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:50:01.908844 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:50:01.908844 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:50:01.908844 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:50:01.908844 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYZRidFy6t-pLV-mM86njli7w4Vl-0bnBXcz0_vb_UjKgVyfK8vmvik7N4wdj9PXlVI-w6r0uqDPhexJ-GRRlcNhKK13Li-Z2wC9f9cLVmHFZC-vZglOEYPx1mtvHQoJAKHpnnWrCQpFAzc1pfmiD7LNCdL9rxM-scVuQ-dVMbsC5xc Aug 27 02:50:01.908844 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:50:01.908844 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:50:01.908844 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:50:01.908844 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:50:01.908844 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:50:01.908844 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:50:01.908844 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 6b59a20bc0ee4f47b52b3c35fcfa189f Aug 27 02:50:01.908844 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1936155010 Aug 27 02:50:01.908844 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:50:01.908844 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:50:01.908844 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6b59a20bc0ee4f47b52b3c35fcfa189f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_6b59a20bc0ee4f47b52b3c35fcfa189f", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6b59a20bc0ee4f47b52b3c35fcfa189f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/6b59a20bc0ee4f47b52b3c35fcfa189f"}]}] Aug 27 02:50:01.908844 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1936155010 Aug 27 02:50:01.908844 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 6b59a20bc0ee4f47b52b3c35fcfa189f Aug 27 02:50:01.908844 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1936155010 Aug 27 02:50:01.908844 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-KeyPairsNegativeTestJSON-1936155010-project Aug 27 02:50:01.908844 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:50:01.908844 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:50:01.908844 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: fad44c508d064d9c84e8f0a58b808287 Aug 27 02:50:01.908844 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1936155010-project Aug 27 02:50:01.908844 n-d-852278-4 devstack@n-api.service[134051]: Aug 27 02:50:01.908844 n-d-852278-4 devstack@n-api.service[134051]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1444997694", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Aug 27 02:50:01.908844 n-d-852278-4 devstack@n-api.service[134051]: method: Aug 27 02:50:01.908844 n-d-852278-4 devstack@n-api.service[134051]: exception: Keypair data is invalid: failed to generate fingerprint Aug 27 02:50:01.908844 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1444997694', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Aug 27 02:50:01.908844 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:50:01.908844 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:01.908844 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 27 02:50:01.908844 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 27 02:50:01.908844 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Aug 27 02:50:01.908844 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Aug 27 02:50:01.908844 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Aug 27 02:50:01.908844 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Aug 27 02:50:01.908844 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Aug 27 02:50:01.908844 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Aug 27 02:50:01.908844 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Aug 27 02:50:01.908844 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:50:01.908844 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:50:01.908844 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:50:01.908844 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:01.908844 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 27 02:50:01.908844 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 27 02:50:01.908844 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 27 02:50:01.908844 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 27 02:50:01.908844 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 02:50:01.908844 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 02:50:01.908844 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 02:50:01.908844 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 02:50:01.908844 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 27 02:50:01.908844 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 27 02:50:01.908844 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6772, in import_key_pair Aug 27 02:50:01.908844 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 27 02:50:01.908844 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6845, in _generate_fingerprint Aug 27 02:50:01.908844 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 27 02:50:01.912538 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 27 02:50:01.912538 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 27 02:50:01.912538 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 27 02:50:01.912538 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:50:01.912538 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:50:01.912538 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:50:01.912538 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:01.912538 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:50:01.912538 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:50:01.912538 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:50:01.912538 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:50:01.912538 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:50:01.912538 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:50:01.912538 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:50:01.912538 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:50:01.912538 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:50:01.912538 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:50:01.912538 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:50:01.912538 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:50:01.912538 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 27 02:50:01.912538 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 27 02:50:01.912538 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 27 02:50:01.912538 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 27 02:50:01.912538 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 27 02:50:01.912538 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:50:01.912538 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:50:01.912538 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:50:01.912538 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:01.912538 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:50:01.912538 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:50:01.912538 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:50:01.912538 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:50:01.912538 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 27 02:50:01.912538 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:50:01.915864 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-40746c0a-b308-49a6-941d-d71a32b9ee82 tempest-KeyPairsNegativeTestJSON-1936155010 tempest-KeyPairsNegativeTestJSON-1936155010-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:50:01.916726 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-40746c0a-b308-49a6-941d-d71a32b9ee82 tempest-KeyPairsNegativeTestJSON-1936155010 tempest-KeyPairsNegativeTestJSON-1936155010-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.080858 Aug 27 02:50:01.917453 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1049/2125] 10.222.0.70 () {60 vars in 1159 bytes} [Sat Aug 27 02:50:01 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 82 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 27 02:50:01.920198 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-99e3c204-f21a-43e9-8eb3-f2a7574eefca tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:01.920750 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-99e3c204-f21a-43e9-8eb3-f2a7574eefca tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] [instance: 26795af5-99b8-4a26-9843-3781a5016217] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:01.923193 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-5131a10e-ba6d-4194-972e-5c24d8916273 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:01.925671 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-5131a10e-ba6d-4194-972e-5c24d8916273 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] [instance: 484e03a9-aef3-4179-980c-0e7292a05b5a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:01.937798 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5131a10e-ba6d-4194-972e-5c24d8916273 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:01.938301 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5131a10e-ba6d-4194-972e-5c24d8916273 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:01.938734 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5131a10e-ba6d-4194-972e-5c24d8916273 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:01.939617 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5131a10e-ba6d-4194-972e-5c24d8916273 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:01.940218 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5131a10e-ba6d-4194-972e-5c24d8916273 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:01.940828 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5131a10e-ba6d-4194-972e-5c24d8916273 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:01.953770 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-99e3c204-f21a-43e9-8eb3-f2a7574eefca tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:01.954259 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-99e3c204-f21a-43e9-8eb3-f2a7574eefca tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:01.954724 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-99e3c204-f21a-43e9-8eb3-f2a7574eefca tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:01.955400 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-99e3c204-f21a-43e9-8eb3-f2a7574eefca tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:01.962046 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-99e3c204-f21a-43e9-8eb3-f2a7574eefca tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:01.962652 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-99e3c204-f21a-43e9-8eb3-f2a7574eefca tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:02.012273 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-99e3c204-f21a-43e9-8eb3-f2a7574eefca tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] [instance: 26795af5-99b8-4a26-9843-3781a5016217] Going to try to terminate instance {{(pid=134052) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:50:02.067896 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:50:02.126836 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-5131a10e-ba6d-4194-972e-5c24d8916273 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:02.151041 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-5131a10e-ba6d-4194-972e-5c24d8916273 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:02.151229 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-99e3c204-f21a-43e9-8eb3-f2a7574eefca tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] 10.222.0.70 "DELETE /compute/v2.1/servers/26795af5-99b8-4a26-9843-3781a5016217" status: 204 len: 0 microversion: 2.1 time: 0.238954 Aug 27 02:50:02.154474 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1077/2126] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:50:01 2022] DELETE /compute/v2.1/servers/26795af5-99b8-4a26-9843-3781a5016217 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:50:02.161638 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-5131a10e-ba6d-4194-972e-5c24d8916273 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:02.163357 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-5131a10e-ba6d-4194-972e-5c24d8916273 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] 10.222.0.70 "GET /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a" status: 200 len: 2279 microversion: 2.42 time: 0.244804 Aug 27 02:50:02.164557 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1050/2127] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:50:01 2022] GET /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a => generated 2279 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:50:02.170341 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8131978c-32ec-4775-b55d-652759eedd49 tempest-KeyPairsNegativeTestJSON-1936155010 tempest-KeyPairsNegativeTestJSON-1936155010-project] Calling method '.version_select at 0x7f5ee7271430>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:02.170469 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b68cdbb6-780b-47ee-b895-6afcf6030861 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Action: 'create', calling method: .version_select at 0x7f5ee718d5e0>, body: {"pool": "65cca408-d0e3-41ef-a7be-f6f3ea292ba5"} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:50:02.183564 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:50:02.200544 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-8131978c-32ec-4775-b55d-652759eedd49 tempest-KeyPairsNegativeTestJSON-1936155010 tempest-KeyPairsNegativeTestJSON-1936155010-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-762214072 not found for user fad44c508d064d9c84e8f0a58b808287 Aug 27 02:50:02.205136 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8131978c-32ec-4775-b55d-652759eedd49 tempest-KeyPairsNegativeTestJSON-1936155010 tempest-KeyPairsNegativeTestJSON-1936155010-project] Request method failure captured: Aug 27 02:50:02.205136 n-d-852278-4 devstack@n-api.service[134051]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-762214072 HTTP/1.1 Aug 27 02:50:02.205136 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:50:02.205136 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:50:02.205136 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:50:02.205136 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:50:02.205136 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:50:02.205136 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:50:02.205136 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:50:02.205136 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:50:02.205136 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYZRidFy6t-pLV-mM86njli7w4Vl-0bnBXcz0_vb_UjKgVyfK8vmvik7N4wdj9PXlVI-w6r0uqDPhexJ-GRRlcNhKK13Li-Z2wC9f9cLVmHFZC-vZglOEYPx1mtvHQoJAKHpnnWrCQpFAzc1pfmiD7LNCdL9rxM-scVuQ-dVMbsC5xc Aug 27 02:50:02.205136 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:50:02.205136 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:50:02.205136 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:50:02.205136 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:50:02.205136 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:50:02.205136 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:50:02.205136 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 6b59a20bc0ee4f47b52b3c35fcfa189f Aug 27 02:50:02.205136 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1936155010 Aug 27 02:50:02.205136 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:50:02.205136 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:50:02.205136 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6b59a20bc0ee4f47b52b3c35fcfa189f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_6b59a20bc0ee4f47b52b3c35fcfa189f", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6b59a20bc0ee4f47b52b3c35fcfa189f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/6b59a20bc0ee4f47b52b3c35fcfa189f"}]}] Aug 27 02:50:02.205136 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1936155010 Aug 27 02:50:02.205136 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 6b59a20bc0ee4f47b52b3c35fcfa189f Aug 27 02:50:02.205136 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1936155010 Aug 27 02:50:02.205136 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-KeyPairsNegativeTestJSON-1936155010-project Aug 27 02:50:02.205136 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:50:02.205136 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:50:02.205136 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: fad44c508d064d9c84e8f0a58b808287 Aug 27 02:50:02.205136 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1936155010-project Aug 27 02:50:02.205136 n-d-852278-4 devstack@n-api.service[134051]: method: Aug 27 02:50:02.205136 n-d-852278-4 devstack@n-api.service[134051]: exception: Keypair tempest-keypair-non-existent-762214072 not found for user fad44c508d064d9c84e8f0a58b808287 Aug 27 02:50:02.205136 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': 'tempest-keypair-non-existent-762214072'} Aug 27 02:50:02.205136 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:50:02.205136 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:02.205136 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Aug 27 02:50:02.205136 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Aug 27 02:50:02.205136 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 27 02:50:02.205136 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 27 02:50:02.205136 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 02:50:02.205136 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 02:50:02.205136 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 02:50:02.205136 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 02:50:02.205136 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 27 02:50:02.205136 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 27 02:50:02.205136 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6859, in delete_key_pair Aug 27 02:50:02.205136 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Aug 27 02:50:02.205136 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6880, in get_key_pair Aug 27 02:50:02.205136 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Aug 27 02:50:02.205136 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 02:50:02.205136 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 02:50:02.205136 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Aug 27 02:50:02.205136 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Aug 27 02:50:02.205136 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Aug 27 02:50:02.205136 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Aug 27 02:50:02.205136 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 02:50:02.205136 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 02:50:02.205136 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Aug 27 02:50:02.205136 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Aug 27 02:50:02.205136 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-762214072 not found for user fad44c508d064d9c84e8f0a58b808287 Aug 27 02:50:02.205136 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:50:02.205136 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:50:02.208659 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:50:02.208659 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:02.208659 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:50:02.208659 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:50:02.208659 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:50:02.208659 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:50:02.208659 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:50:02.208659 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:50:02.208659 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 02:50:02.208659 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:50:02.208659 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:50:02.208659 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:50:02.208659 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Aug 27 02:50:02.208659 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self._delete(req, id) Aug 27 02:50:02.208659 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Aug 27 02:50:02.208659 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Aug 27 02:50:02.208659 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-762214072 not found for user fad44c508d064d9c84e8f0a58b808287 Aug 27 02:50:02.208659 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:50:02.208659 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:50:02.208659 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:50:02.208659 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:02.208659 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:50:02.208659 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:50:02.208659 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:50:02.208659 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:50:02.208659 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-762214072 not found for user fad44c508d064d9c84e8f0a58b808287 Aug 27 02:50:02.208659 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:50:02.217989 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8131978c-32ec-4775-b55d-652759eedd49 tempest-KeyPairsNegativeTestJSON-1936155010 tempest-KeyPairsNegativeTestJSON-1936155010-project] Returning 404 to user: Keypair tempest-keypair-non-existent-762214072 not found for user fad44c508d064d9c84e8f0a58b808287 {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:50:02.219343 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-8131978c-32ec-4775-b55d-652759eedd49 tempest-KeyPairsNegativeTestJSON-1936155010 tempest-KeyPairsNegativeTestJSON-1936155010-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-762214072" status: 404 len: 144 microversion: 2.1 time: 0.053463 Aug 27 02:50:02.221260 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1051/2128] 10.222.0.70 () {58 vars in 1257 bytes} [Sat Aug 27 02:50:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-762214072 => generated 144 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:50:02.249797 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-556f77d0-dcb8-4ca7-a929-baf287b3b340 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.0.59"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:50:02.259048 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-556f77d0-dcb8-4ca7-a929-baf287b3b340 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] [instance: e445cdc5-5ecb-487c-adee-f5cb9862283c] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:02.273823 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-556f77d0-dcb8-4ca7-a929-baf287b3b340 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:02.274658 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-556f77d0-dcb8-4ca7-a929-baf287b3b340 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:02.275283 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-556f77d0-dcb8-4ca7-a929-baf287b3b340 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:02.276610 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-556f77d0-dcb8-4ca7-a929-baf287b3b340 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:02.279157 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-556f77d0-dcb8-4ca7-a929-baf287b3b340 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:02.280232 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-556f77d0-dcb8-4ca7-a929-baf287b3b340 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:02.314691 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-556f77d0-dcb8-4ca7-a929-baf287b3b340 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Acquiring lock "refresh_cache-e445cdc5-5ecb-487c-adee-f5cb9862283c" {{(pid=134051) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 27 02:50:02.315441 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-556f77d0-dcb8-4ca7-a929-baf287b3b340 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Acquired lock "refresh_cache-e445cdc5-5ecb-487c-adee-f5cb9862283c" {{(pid=134051) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 27 02:50:07.058451 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.network.neutron [None req-556f77d0-dcb8-4ca7-a929-baf287b3b340 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] [instance: e445cdc5-5ecb-487c-adee-f5cb9862283c] Building network info cache for instance {{(pid=134051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 27 02:50:08.112166 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b68cdbb6-780b-47ee-b895-6afcf6030861 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] 10.222.0.70 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 5.956161 Aug 27 02:50:08.114110 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1078/2129] 10.222.0.70 () {60 vars in 1170 bytes} [Sat Aug 27 02:50:02 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 5959 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:50:08.124737 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-1b89d89a-9cc6-4cbd-8b2e-ac0ffa828037 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:08.125835 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-1b89d89a-9cc6-4cbd-8b2e-ac0ffa828037 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: cac17f47-6e08-4f15-a8cf-f5e44ad03d12] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:08.142862 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1b89d89a-9cc6-4cbd-8b2e-ac0ffa828037 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:08.143844 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1b89d89a-9cc6-4cbd-8b2e-ac0ffa828037 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:08.144514 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1b89d89a-9cc6-4cbd-8b2e-ac0ffa828037 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:08.145782 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1b89d89a-9cc6-4cbd-8b2e-ac0ffa828037 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:08.146477 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1b89d89a-9cc6-4cbd-8b2e-ac0ffa828037 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:08.147156 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1b89d89a-9cc6-4cbd-8b2e-ac0ffa828037 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:08.548690 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-1b89d89a-9cc6-4cbd-8b2e-ac0ffa828037 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:08.564959 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-1b89d89a-9cc6-4cbd-8b2e-ac0ffa828037 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/cac17f47-6e08-4f15-a8cf-f5e44ad03d12" status: 200 len: 1475 microversion: 2.1 time: 0.448343 Aug 27 02:50:08.568094 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1079/2130] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:08 2022] GET /compute/v2.1/servers/cac17f47-6e08-4f15-a8cf-f5e44ad03d12 => generated 1475 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:50:08.580551 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-c1b08310-79ff-4823-bbbd-fe5d654522e4 req-26eec2be-aec4-4321-86c3-edb4189cd75c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "484e03a9-aef3-4179-980c-0e7292a05b5a", "name": "network-vif-deleted", "tag": "c90fb304-b679-479a-ba4f-cede7f0a36e7"}, {"server_uuid": "484e03a9-aef3-4179-980c-0e7292a05b5a", "name": "network-vif-deleted", "tag": "cd7a0d56-e84b-4f98-9baf-449824810d8d"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:50:08.612877 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-c1b08310-79ff-4823-bbbd-fe5d654522e4 req-26eec2be-aec4-4321-86c3-edb4189cd75c service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:08.615286 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-c1b08310-79ff-4823-bbbd-fe5d654522e4 req-26eec2be-aec4-4321-86c3-edb4189cd75c service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:08.618104 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-c1b08310-79ff-4823-bbbd-fe5d654522e4 req-26eec2be-aec4-4321-86c3-edb4189cd75c service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:08.654191 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-c1b08310-79ff-4823-bbbd-fe5d654522e4 req-26eec2be-aec4-4321-86c3-edb4189cd75c service nova] Creating event network-vif-deleted:c90fb304-b679-479a-ba4f-cede7f0a36e7 for instance 484e03a9-aef3-4179-980c-0e7292a05b5a on n-h1-852278-4 Aug 27 02:50:08.655931 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-c1b08310-79ff-4823-bbbd-fe5d654522e4 req-26eec2be-aec4-4321-86c3-edb4189cd75c service nova] Creating event network-vif-deleted:cd7a0d56-e84b-4f98-9baf-449824810d8d for instance 484e03a9-aef3-4179-980c-0e7292a05b5a on n-h1-852278-4 Aug 27 02:50:08.674255 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-c1b08310-79ff-4823-bbbd-fe5d654522e4 req-26eec2be-aec4-4321-86c3-edb4189cd75c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.099265 Aug 27 02:50:08.674917 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1080/2131] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:50:08 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:50:08.703065 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8e75ea81-3056-4bd0-b407-52dd9a676c21 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:08.703797 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-8e75ea81-3056-4bd0-b407-52dd9a676c21 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] [instance: 484e03a9-aef3-4179-980c-0e7292a05b5a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:08.738625 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8e75ea81-3056-4bd0-b407-52dd9a676c21 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:08.741063 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8e75ea81-3056-4bd0-b407-52dd9a676c21 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:08.741530 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8e75ea81-3056-4bd0-b407-52dd9a676c21 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:08.746440 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8e75ea81-3056-4bd0-b407-52dd9a676c21 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:08.755010 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8e75ea81-3056-4bd0-b407-52dd9a676c21 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:08.757338 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8e75ea81-3056-4bd0-b407-52dd9a676c21 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:08.799552 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.network.neutron [None req-556f77d0-dcb8-4ca7-a929-baf287b3b340 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] [instance: e445cdc5-5ecb-487c-adee-f5cb9862283c] Updating instance_info_cache with network_info: [{"id": "42ac4b18-965a-486a-8d1d-80c016c9888c", "address": "fa:16:3e:d3:42:65", "network": {"id": "56c1e6e5-f638-4015-aee9-61020b017eac", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-265073614-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.0.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "4f9be56fbeb64cb08b9be4e3d7436782", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap42ac4b18-96", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=134051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 27 02:50:08.821620 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-556f77d0-dcb8-4ca7-a929-baf287b3b340 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Releasing lock "refresh_cache-e445cdc5-5ecb-487c-adee-f5cb9862283c" {{(pid=134051) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 27 02:50:08.823315 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-556f77d0-dcb8-4ca7-a929-baf287b3b340 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] 10.222.0.70 "POST /compute/v2.1/servers/e445cdc5-5ecb-487c-adee-f5cb9862283c/action" status: 202 len: 0 microversion: 2.1 time: 6.600741 Aug 27 02:50:08.827623 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1052/2132] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 02:50:02 2022] POST /compute/v2.1/servers/e445cdc5-5ecb-487c-adee-f5cb9862283c/action => generated 0 bytes in 6603 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 27 02:50:08.836720 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-4f67c551-98f5-4e8e-b667-7a496e2d8360 req-840bc73d-010b-4637-8c1a-da3883b4430c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e445cdc5-5ecb-487c-adee-f5cb9862283c", "tag": "42ac4b18-965a-486a-8d1d-80c016c9888c"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:50:08.868561 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-4f67c551-98f5-4e8e-b667-7a496e2d8360 req-840bc73d-010b-4637-8c1a-da3883b4430c service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:08.874003 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-4f67c551-98f5-4e8e-b667-7a496e2d8360 req-840bc73d-010b-4637-8c1a-da3883b4430c service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:08.875949 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-4f67c551-98f5-4e8e-b667-7a496e2d8360 req-840bc73d-010b-4637-8c1a-da3883b4430c service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:08.921333 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-4f67c551-98f5-4e8e-b667-7a496e2d8360 req-840bc73d-010b-4637-8c1a-da3883b4430c service nova] Creating event network-changed:42ac4b18-965a-486a-8d1d-80c016c9888c for instance e445cdc5-5ecb-487c-adee-f5cb9862283c on n-h2-852278-4 Aug 27 02:50:08.942934 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-4f67c551-98f5-4e8e-b667-7a496e2d8360 req-840bc73d-010b-4637-8c1a-da3883b4430c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113556 Aug 27 02:50:08.948295 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1053/2133] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:50:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:50:08.959377 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3e0bc405-7917-44c6-a03a-931613255d51 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.0.85"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:50:08.963629 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-3e0bc405-7917-44c6-a03a-931613255d51 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] [instance: 57a1e617-8846-4da8-b84f-232ffc519f69] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:08.982354 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3e0bc405-7917-44c6-a03a-931613255d51 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:08.982861 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3e0bc405-7917-44c6-a03a-931613255d51 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:08.983294 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3e0bc405-7917-44c6-a03a-931613255d51 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:08.984031 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3e0bc405-7917-44c6-a03a-931613255d51 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:08.987070 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3e0bc405-7917-44c6-a03a-931613255d51 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:08.989404 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3e0bc405-7917-44c6-a03a-931613255d51 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:09.050473 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3e0bc405-7917-44c6-a03a-931613255d51 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Acquiring lock "refresh_cache-57a1e617-8846-4da8-b84f-232ffc519f69" {{(pid=134051) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 27 02:50:09.051136 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3e0bc405-7917-44c6-a03a-931613255d51 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Acquired lock "refresh_cache-57a1e617-8846-4da8-b84f-232ffc519f69" {{(pid=134051) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 27 02:50:09.307108 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-8e75ea81-3056-4bd0-b407-52dd9a676c21 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:09.322315 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-8e75ea81-3056-4bd0-b407-52dd9a676c21 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:09.326151 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-8e75ea81-3056-4bd0-b407-52dd9a676c21 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:09.329296 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-8e75ea81-3056-4bd0-b407-52dd9a676c21 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] 10.222.0.70 "GET /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a" status: 200 len: 1605 microversion: 2.42 time: 0.649890 Aug 27 02:50:09.332253 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1081/2134] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:50:08 2022] GET /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a => generated 1605 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:50:09.341422 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-deac3d56-43d4-4270-9b20-bf9feb9cf511 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Calling method '.version_select at 0x7f5ee71f40d0>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:10.487814 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-deac3d56-43d4-4270-9b20-bf9feb9cf511 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] 10.222.0.70 "GET /compute/v2.1/os-floating-ips/f7577190-6a6e-44d0-8e10-5dde933396ae" status: 200 len: 184 microversion: 2.1 time: 1.154224 Aug 27 02:50:10.489186 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1082/2135] 10.222.0.70 () {58 vars in 1260 bytes} [Sat Aug 27 02:50:09 2022] GET /compute/v2.1/os-floating-ips/f7577190-6a6e-44d0-8e10-5dde933396ae => generated 184 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:50:10.494399 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-03d8db68-7147-42af-89a7-0bd892a5fc19 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:10.495194 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-03d8db68-7147-42af-89a7-0bd892a5fc19 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: cac17f47-6e08-4f15-a8cf-f5e44ad03d12] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:10.547282 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-03d8db68-7147-42af-89a7-0bd892a5fc19 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:10.549153 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-03d8db68-7147-42af-89a7-0bd892a5fc19 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:10.549800 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-03d8db68-7147-42af-89a7-0bd892a5fc19 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:10.551958 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-03d8db68-7147-42af-89a7-0bd892a5fc19 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:10.552679 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-03d8db68-7147-42af-89a7-0bd892a5fc19 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:10.553367 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-03d8db68-7147-42af-89a7-0bd892a5fc19 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:11.708069 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-03d8db68-7147-42af-89a7-0bd892a5fc19 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:11.722971 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-03d8db68-7147-42af-89a7-0bd892a5fc19 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/cac17f47-6e08-4f15-a8cf-f5e44ad03d12" status: 200 len: 1475 microversion: 2.1 time: 1.232118 Aug 27 02:50:11.738774 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1083/2136] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:10 2022] GET /compute/v2.1/servers/cac17f47-6e08-4f15-a8cf-f5e44ad03d12 => generated 1475 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:50:11.747269 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e57e6fd7-0766-4ec3-88cb-c1671a67dd36 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:11.747964 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-e57e6fd7-0766-4ec3-88cb-c1671a67dd36 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] [instance: 484e03a9-aef3-4179-980c-0e7292a05b5a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:11.755513 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e57e6fd7-0766-4ec3-88cb-c1671a67dd36 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:11.756218 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e57e6fd7-0766-4ec3-88cb-c1671a67dd36 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:11.756768 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e57e6fd7-0766-4ec3-88cb-c1671a67dd36 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:11.757572 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e57e6fd7-0766-4ec3-88cb-c1671a67dd36 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:11.758328 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e57e6fd7-0766-4ec3-88cb-c1671a67dd36 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:11.758851 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e57e6fd7-0766-4ec3-88cb-c1671a67dd36 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:11.885981 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=20 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:50:12.004839 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-e57e6fd7-0766-4ec3-88cb-c1671a67dd36 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:12.023623 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-e57e6fd7-0766-4ec3-88cb-c1671a67dd36 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:12.025483 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-e57e6fd7-0766-4ec3-88cb-c1671a67dd36 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:12.026877 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e57e6fd7-0766-4ec3-88cb-c1671a67dd36 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] 10.222.0.70 "GET /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a" status: 200 len: 1605 microversion: 2.42 time: 0.286060 Aug 27 02:50:12.032102 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1084/2137] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:50:11 2022] GET /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a => generated 1605 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:50:12.048441 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-357a20c4-12ca-473c-8ae7-2cac6bf92031 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.0.59"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:50:12.638736 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-357a20c4-12ca-473c-8ae7-2cac6bf92031 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] [instance: e445cdc5-5ecb-487c-adee-f5cb9862283c] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:12.647251 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-357a20c4-12ca-473c-8ae7-2cac6bf92031 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:12.648048 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-357a20c4-12ca-473c-8ae7-2cac6bf92031 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:12.648974 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-357a20c4-12ca-473c-8ae7-2cac6bf92031 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:12.649925 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-357a20c4-12ca-473c-8ae7-2cac6bf92031 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:12.652080 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-357a20c4-12ca-473c-8ae7-2cac6bf92031 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:12.656978 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-357a20c4-12ca-473c-8ae7-2cac6bf92031 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:13.993574 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-357a20c4-12ca-473c-8ae7-2cac6bf92031 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Acquiring lock "refresh_cache-e445cdc5-5ecb-487c-adee-f5cb9862283c" {{(pid=134052) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 27 02:50:13.994280 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-357a20c4-12ca-473c-8ae7-2cac6bf92031 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Acquired lock "refresh_cache-e445cdc5-5ecb-487c-adee-f5cb9862283c" {{(pid=134052) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 27 02:50:15.602337 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.network.neutron [None req-3e0bc405-7917-44c6-a03a-931613255d51 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] [instance: 57a1e617-8846-4da8-b84f-232ffc519f69] Building network info cache for instance {{(pid=134051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 27 02:50:17.711974 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.network.neutron [None req-357a20c4-12ca-473c-8ae7-2cac6bf92031 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] [instance: e445cdc5-5ecb-487c-adee-f5cb9862283c] Building network info cache for instance {{(pid=134052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 27 02:50:18.810840 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.network.neutron [None req-3e0bc405-7917-44c6-a03a-931613255d51 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] [instance: 57a1e617-8846-4da8-b84f-232ffc519f69] Updating instance_info_cache with network_info: [{"id": "f1fc64b5-9211-456f-b514-94d86ae29282", "address": "fa:16:3e:3e:64:6b", "network": {"id": "cec1f1c8-ede6-4fbf-a6be-be33cc79bfe7", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-178782255-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.0.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "2c13c5aeb4da472da020639d5b6ad5aa", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapf1fc64b5-92", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=134051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 27 02:50:18.827807 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:50:18.838132 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3e0bc405-7917-44c6-a03a-931613255d51 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Releasing lock "refresh_cache-57a1e617-8846-4da8-b84f-232ffc519f69" {{(pid=134051) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 27 02:50:18.842837 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-3e0bc405-7917-44c6-a03a-931613255d51 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] 10.222.0.70 "POST /compute/v2.1/servers/57a1e617-8846-4da8-b84f-232ffc519f69/action" status: 202 len: 0 microversion: 2.1 time: 9.890213 Aug 27 02:50:18.844144 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1054/2138] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 02:50:08 2022] POST /compute/v2.1/servers/57a1e617-8846-4da8-b84f-232ffc519f69/action => generated 0 bytes in 9895 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 27 02:50:18.982441 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=7 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:50:19.073268 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-b3e3054f-a124-439f-981b-a25a7210be42 req-c26a0127-3321-4359-bd09-f0146a783202 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26795af5-99b8-4a26-9843-3781a5016217", "name": "network-vif-deleted", "tag": "072e51fc-e3f0-46c0-b5a9-45f131439621"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:50:19.087468 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-b3e3054f-a124-439f-981b-a25a7210be42 req-c26a0127-3321-4359-bd09-f0146a783202 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:19.089714 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-b3e3054f-a124-439f-981b-a25a7210be42 req-c26a0127-3321-4359-bd09-f0146a783202 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:19.090387 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-b3e3054f-a124-439f-981b-a25a7210be42 req-c26a0127-3321-4359-bd09-f0146a783202 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:19.105128 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-b3e3054f-a124-439f-981b-a25a7210be42 req-c26a0127-3321-4359-bd09-f0146a783202 service nova] Creating event network-vif-deleted:072e51fc-e3f0-46c0-b5a9-45f131439621 for instance 26795af5-99b8-4a26-9843-3781a5016217 on n-h1-852278-4 Aug 27 02:50:19.113013 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-b3e3054f-a124-439f-981b-a25a7210be42 req-c26a0127-3321-4359-bd09-f0146a783202 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.267176 Aug 27 02:50:19.117979 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1055/2139] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:50:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:50:19.124013 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d1cc22d5-24cf-412b-b978-4546226e78cb tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:19.127835 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d1cc22d5-24cf-412b-b978-4546226e78cb tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: cac17f47-6e08-4f15-a8cf-f5e44ad03d12] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:19.147120 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d1cc22d5-24cf-412b-b978-4546226e78cb tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:19.150043 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d1cc22d5-24cf-412b-b978-4546226e78cb tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:19.152330 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d1cc22d5-24cf-412b-b978-4546226e78cb tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:19.154655 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d1cc22d5-24cf-412b-b978-4546226e78cb tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:19.155828 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d1cc22d5-24cf-412b-b978-4546226e78cb tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:19.156856 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d1cc22d5-24cf-412b-b978-4546226e78cb tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:19.919462 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d1cc22d5-24cf-412b-b978-4546226e78cb tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:19.940290 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d1cc22d5-24cf-412b-b978-4546226e78cb tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/cac17f47-6e08-4f15-a8cf-f5e44ad03d12" status: 200 len: 1469 microversion: 2.1 time: 0.818881 Aug 27 02:50:19.942874 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1056/2140] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:19 2022] GET /compute/v2.1/servers/cac17f47-6e08-4f15-a8cf-f5e44ad03d12 => generated 1469 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:50:19.951936 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-bb5e9fd8-86e4-4a40-ab5d-0a8a70e64ee0 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:19.954532 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-bb5e9fd8-86e4-4a40-ab5d-0a8a70e64ee0 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] [instance: 484e03a9-aef3-4179-980c-0e7292a05b5a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:19.967906 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bb5e9fd8-86e4-4a40-ab5d-0a8a70e64ee0 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:19.970855 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bb5e9fd8-86e4-4a40-ab5d-0a8a70e64ee0 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:19.971693 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bb5e9fd8-86e4-4a40-ab5d-0a8a70e64ee0 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:19.977145 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bb5e9fd8-86e4-4a40-ab5d-0a8a70e64ee0 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:19.978064 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bb5e9fd8-86e4-4a40-ab5d-0a8a70e64ee0 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:19.978725 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bb5e9fd8-86e4-4a40-ab5d-0a8a70e64ee0 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:20.166046 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-bb5e9fd8-86e4-4a40-ab5d-0a8a70e64ee0 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:20.175691 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-bb5e9fd8-86e4-4a40-ab5d-0a8a70e64ee0 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:20.177225 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-bb5e9fd8-86e4-4a40-ab5d-0a8a70e64ee0 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:20.178444 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-bb5e9fd8-86e4-4a40-ab5d-0a8a70e64ee0 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] 10.222.0.70 "GET /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a" status: 200 len: 1605 microversion: 2.42 time: 0.233132 Aug 27 02:50:20.210323 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1057/2141] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:50:19 2022] GET /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a => generated 1605 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:50:20.227035 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-b8bcf900-2cf3-4892-8997-3da85dec7938 req-6fb9867a-1769-47ec-afbb-87d666583da8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57a1e617-8846-4da8-b84f-232ffc519f69", "tag": "f1fc64b5-9211-456f-b514-94d86ae29282"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:50:20.242316 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-b8bcf900-2cf3-4892-8997-3da85dec7938 req-6fb9867a-1769-47ec-afbb-87d666583da8 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:20.243467 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-b8bcf900-2cf3-4892-8997-3da85dec7938 req-6fb9867a-1769-47ec-afbb-87d666583da8 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:20.244230 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-b8bcf900-2cf3-4892-8997-3da85dec7938 req-6fb9867a-1769-47ec-afbb-87d666583da8 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:20.257177 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-b8bcf900-2cf3-4892-8997-3da85dec7938 req-6fb9867a-1769-47ec-afbb-87d666583da8 service nova] Creating event network-changed:f1fc64b5-9211-456f-b514-94d86ae29282 for instance 57a1e617-8846-4da8-b84f-232ffc519f69 on n-h2-852278-4 Aug 27 02:50:20.264477 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-b8bcf900-2cf3-4892-8997-3da85dec7938 req-6fb9867a-1769-47ec-afbb-87d666583da8 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050080 Aug 27 02:50:20.265655 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1058/2142] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:50:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:50:20.273770 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-eb674360-2bc8-466b-bb1c-a3c3464c6841 req-6196eb12-f793-42ce-8598-36510dd9daf4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cac17f47-6e08-4f15-a8cf-f5e44ad03d12", "name": "network-vif-unplugged", "status": "completed", "tag": "7d0fd053-123c-4222-8389-3499f91d9b8c"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:50:20.291503 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-eb674360-2bc8-466b-bb1c-a3c3464c6841 req-6196eb12-f793-42ce-8598-36510dd9daf4 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:20.292288 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-eb674360-2bc8-466b-bb1c-a3c3464c6841 req-6196eb12-f793-42ce-8598-36510dd9daf4 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:20.292993 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-eb674360-2bc8-466b-bb1c-a3c3464c6841 req-6196eb12-f793-42ce-8598-36510dd9daf4 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:20.307513 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-eb674360-2bc8-466b-bb1c-a3c3464c6841 req-6196eb12-f793-42ce-8598-36510dd9daf4 service nova] Creating event network-vif-unplugged:7d0fd053-123c-4222-8389-3499f91d9b8c for instance cac17f47-6e08-4f15-a8cf-f5e44ad03d12 on n-h1-852278-4 Aug 27 02:50:20.319942 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [req-eb674360-2bc8-466b-bb1c-a3c3464c6841 req-6196eb12-f793-42ce-8598-36510dd9daf4 service nova] Instance cac17f47-6e08-4f15-a8cf-f5e44ad03d12 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852278-4'} {{(pid=134051) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 02:50:20.328562 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-eb674360-2bc8-466b-bb1c-a3c3464c6841 req-6196eb12-f793-42ce-8598-36510dd9daf4 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060135 Aug 27 02:50:20.329454 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1059/2143] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:50:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:50:20.337515 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-de5ec96c-6af8-40ba-b36d-93d9da0d9677 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Action: 'create', calling method: .version_select at 0x7f5ee72021f0>, body: {"pool": "65cca408-d0e3-41ef-a7be-f6f3ea292ba5"} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:50:21.121268 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.network.neutron [None req-357a20c4-12ca-473c-8ae7-2cac6bf92031 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] [instance: e445cdc5-5ecb-487c-adee-f5cb9862283c] Updating instance_info_cache with network_info: [{"id": "42ac4b18-965a-486a-8d1d-80c016c9888c", "address": "fa:16:3e:d3:42:65", "network": {"id": "56c1e6e5-f638-4015-aee9-61020b017eac", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-265073614-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "4f9be56fbeb64cb08b9be4e3d7436782", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap42ac4b18-96", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=134052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 27 02:50:21.146236 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-357a20c4-12ca-473c-8ae7-2cac6bf92031 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Releasing lock "refresh_cache-e445cdc5-5ecb-487c-adee-f5cb9862283c" {{(pid=134052) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 27 02:50:21.147747 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-357a20c4-12ca-473c-8ae7-2cac6bf92031 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] 10.222.0.70 "POST /compute/v2.1/servers/e445cdc5-5ecb-487c-adee-f5cb9862283c/action" status: 202 len: 0 microversion: 2.1 time: 9.114228 Aug 27 02:50:21.148747 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1085/2144] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 02:50:12 2022] POST /compute/v2.1/servers/e445cdc5-5ecb-487c-adee-f5cb9862283c/action => generated 0 bytes in 9116 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 27 02:50:21.154116 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-1cd172b6-3dd1-4aec-80b2-3fe69afcb6ea tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:50:21.155007 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-1cd172b6-3dd1-4aec-80b2-3fe69afcb6ea tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: cac17f47-6e08-4f15-a8cf-f5e44ad03d12] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:21.164644 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1cd172b6-3dd1-4aec-80b2-3fe69afcb6ea tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:21.172743 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1cd172b6-3dd1-4aec-80b2-3fe69afcb6ea tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:21.173604 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1cd172b6-3dd1-4aec-80b2-3fe69afcb6ea tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:21.174664 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1cd172b6-3dd1-4aec-80b2-3fe69afcb6ea tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:21.184697 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1cd172b6-3dd1-4aec-80b2-3fe69afcb6ea tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:21.185970 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1cd172b6-3dd1-4aec-80b2-3fe69afcb6ea tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:21.313083 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-1cd172b6-3dd1-4aec-80b2-3fe69afcb6ea tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "POST /compute/v2.1/servers/cac17f47-6e08-4f15-a8cf-f5e44ad03d12/action" status: 204 len: 0 microversion: 2.1 time: 0.162175 Aug 27 02:50:21.326642 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1086/2145] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 02:50:21 2022] POST /compute/v2.1/servers/cac17f47-6e08-4f15-a8cf-f5e44ad03d12/action => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:50:21.334799 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-506bd249-e461-4679-8235-cd402034aab8 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:21.336618 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-506bd249-e461-4679-8235-cd402034aab8 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] [instance: 26795af5-99b8-4a26-9843-3781a5016217] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:21.394031 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-506bd249-e461-4679-8235-cd402034aab8 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:21.400640 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-506bd249-e461-4679-8235-cd402034aab8 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:21.403821 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-506bd249-e461-4679-8235-cd402034aab8 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:21.408745 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-506bd249-e461-4679-8235-cd402034aab8 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:21.410692 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-506bd249-e461-4679-8235-cd402034aab8 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:21.412561 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-506bd249-e461-4679-8235-cd402034aab8 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:21.441926 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-506bd249-e461-4679-8235-cd402034aab8 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] HTTP exception thrown: Instance 26795af5-99b8-4a26-9843-3781a5016217 could not be found. Aug 27 02:50:21.444393 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-506bd249-e461-4679-8235-cd402034aab8 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Request method failure captured: Aug 27 02:50:21.444393 n-d-852278-4 devstack@n-api.service[134052]: request: DELETE /compute/v2.1/servers/26795af5-99b8-4a26-9843-3781a5016217 HTTP/1.1 Aug 27 02:50:21.444393 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:50:21.444393 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:50:21.444393 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:50:21.444393 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:50:21.444393 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:50:21.444393 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:50:21.444393 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:50:21.444393 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:50:21.444393 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYYC33a4sfcy0flVw5fElBdehyWAeg1tulUhA7AsP362Qhvm65PM70JFXBNalTPc4viU09Id9Z9Nwv26tmSWE9om-XPexmfdNMnm880cJaz8a6wZRrzmZsGh2ivxs7otD6rtMoYyDyYT9X6fA12qDhGtP0JhOLsdI78pvG7p67F1yr4 Aug 27 02:50:21.444393 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:50:21.444393 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:50:21.444393 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:50:21.444393 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:50:21.444393 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:50:21.444393 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:50:21.444393 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 4f9be56fbeb64cb08b9be4e3d7436782 Aug 27 02:50:21.444393 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-234532228 Aug 27 02:50:21.444393 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:50:21.444393 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:50:21.444393 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4f9be56fbeb64cb08b9be4e3d7436782"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_4f9be56fbeb64cb08b9be4e3d7436782", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4f9be56fbeb64cb08b9be4e3d7436782"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/4f9be56fbeb64cb08b9be4e3d7436782"}]}] Aug 27 02:50:21.444393 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-234532228 Aug 27 02:50:21.444393 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 4f9be56fbeb64cb08b9be4e3d7436782 Aug 27 02:50:21.444393 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-234532228 Aug 27 02:50:21.444393 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-FloatingIPsAssociationTestJSON-234532228-project Aug 27 02:50:21.444393 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:50:21.444393 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:50:21.444393 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 66c0fc8492654e6e85a90ce04736c055 Aug 27 02:50:21.444393 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-234532228-project Aug 27 02:50:21.444393 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 02:50:21.444393 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance 26795af5-99b8-4a26-9843-3781a5016217 could not be found. Aug 27 02:50:21.444393 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '26795af5-99b8-4a26-9843-3781a5016217'} Aug 27 02:50:21.444393 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:50:21.444393 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:21.444393 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:50:21.444393 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:50:21.444393 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:50:21.444393 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:50:21.444393 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:50:21.444393 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:50:21.444393 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:50:21.444393 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:50:21.444393 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26795af5-99b8-4a26-9843-3781a5016217 could not be found. Aug 27 02:50:21.444393 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:50:21.444393 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:50:21.444393 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:50:21.444393 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:21.444393 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:50:21.444393 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:50:21.444393 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:50:21.444393 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:50:21.444393 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:50:21.444393 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:50:21.444393 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 02:50:21.444393 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 02:50:21.444393 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 02:50:21.444393 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 02:50:21.444393 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:50:21.444393 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:50:21.444393 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:50:21.444393 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:50:21.447963 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26795af5-99b8-4a26-9843-3781a5016217 could not be found. Aug 27 02:50:21.447963 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:50:21.447963 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:50:21.447963 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:50:21.447963 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:21.447963 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:50:21.447963 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:50:21.447963 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:50:21.447963 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:50:21.447963 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26795af5-99b8-4a26-9843-3781a5016217 could not be found. Aug 27 02:50:21.447963 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:50:21.450385 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-506bd249-e461-4679-8235-cd402034aab8 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Returning 404 to user: Instance 26795af5-99b8-4a26-9843-3781a5016217 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:50:21.453725 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-506bd249-e461-4679-8235-cd402034aab8 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] 10.222.0.70 "DELETE /compute/v2.1/servers/26795af5-99b8-4a26-9843-3781a5016217" status: 404 len: 111 microversion: 2.1 time: 0.125432 Aug 27 02:50:21.454556 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1087/2146] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:50:21 2022] DELETE /compute/v2.1/servers/26795af5-99b8-4a26-9843-3781a5016217 => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:50:21.470392 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a44a8c46-4aff-4ef2-9d0f-577736e1ad2a tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:21.472131 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a44a8c46-4aff-4ef2-9d0f-577736e1ad2a tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] [instance: 484e03a9-aef3-4179-980c-0e7292a05b5a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:21.487428 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a44a8c46-4aff-4ef2-9d0f-577736e1ad2a tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:21.487929 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a44a8c46-4aff-4ef2-9d0f-577736e1ad2a tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:21.488388 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a44a8c46-4aff-4ef2-9d0f-577736e1ad2a tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:21.489104 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a44a8c46-4aff-4ef2-9d0f-577736e1ad2a tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:21.489878 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a44a8c46-4aff-4ef2-9d0f-577736e1ad2a tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:21.490459 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a44a8c46-4aff-4ef2-9d0f-577736e1ad2a tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:22.022499 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-a44a8c46-4aff-4ef2-9d0f-577736e1ad2a tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:22.054410 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-a44a8c46-4aff-4ef2-9d0f-577736e1ad2a tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:22.056586 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-a44a8c46-4aff-4ef2-9d0f-577736e1ad2a tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '585803c75b454475993d2189c88cc6d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35c895f49f4d31a4137dd3392f65bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:22.058620 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a44a8c46-4aff-4ef2-9d0f-577736e1ad2a tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] 10.222.0.70 "GET /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a" status: 200 len: 1605 microversion: 2.42 time: 0.599329 Aug 27 02:50:22.085363 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1088/2147] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:50:21 2022] GET /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a => generated 1605 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:50:22.122796 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d6d425ef-319f-4aa8-b369-7ccd91ff8715 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:22.123597 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d6d425ef-319f-4aa8-b369-7ccd91ff8715 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: cac17f47-6e08-4f15-a8cf-f5e44ad03d12] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:22.144697 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d6d425ef-319f-4aa8-b369-7ccd91ff8715 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:22.145202 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d6d425ef-319f-4aa8-b369-7ccd91ff8715 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:22.145641 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d6d425ef-319f-4aa8-b369-7ccd91ff8715 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:22.151415 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d6d425ef-319f-4aa8-b369-7ccd91ff8715 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:22.151961 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d6d425ef-319f-4aa8-b369-7ccd91ff8715 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:22.152818 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d6d425ef-319f-4aa8-b369-7ccd91ff8715 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:22.821513 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-d6d425ef-319f-4aa8-b369-7ccd91ff8715 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:22.832758 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d6d425ef-319f-4aa8-b369-7ccd91ff8715 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/cac17f47-6e08-4f15-a8cf-f5e44ad03d12" status: 200 len: 1469 microversion: 2.1 time: 0.726785 Aug 27 02:50:22.833883 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1089/2148] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:22 2022] GET /compute/v2.1/servers/cac17f47-6e08-4f15-a8cf-f5e44ad03d12 => generated 1469 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:50:22.846917 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d71ccf2b-a19f-4b6a-9724-8812e6809275 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:22.847854 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d71ccf2b-a19f-4b6a-9724-8812e6809275 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] [instance: 26795af5-99b8-4a26-9843-3781a5016217] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:22.861521 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d71ccf2b-a19f-4b6a-9724-8812e6809275 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:22.863932 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d71ccf2b-a19f-4b6a-9724-8812e6809275 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:22.865477 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d71ccf2b-a19f-4b6a-9724-8812e6809275 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:22.867860 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d71ccf2b-a19f-4b6a-9724-8812e6809275 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:22.868575 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d71ccf2b-a19f-4b6a-9724-8812e6809275 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:22.870237 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d71ccf2b-a19f-4b6a-9724-8812e6809275 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:22.907006 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-d71ccf2b-a19f-4b6a-9724-8812e6809275 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] HTTP exception thrown: Instance 26795af5-99b8-4a26-9843-3781a5016217 could not be found. Aug 27 02:50:22.909028 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d71ccf2b-a19f-4b6a-9724-8812e6809275 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Request method failure captured: Aug 27 02:50:22.909028 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/servers/26795af5-99b8-4a26-9843-3781a5016217 HTTP/1.1 Aug 27 02:50:22.909028 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:50:22.909028 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:50:22.909028 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:50:22.909028 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:50:22.909028 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:50:22.909028 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:50:22.909028 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:50:22.909028 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:50:22.909028 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYYC33a4sfcy0flVw5fElBdehyWAeg1tulUhA7AsP362Qhvm65PM70JFXBNalTPc4viU09Id9Z9Nwv26tmSWE9om-XPexmfdNMnm880cJaz8a6wZRrzmZsGh2ivxs7otD6rtMoYyDyYT9X6fA12qDhGtP0JhOLsdI78pvG7p67F1yr4 Aug 27 02:50:22.909028 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:50:22.909028 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:50:22.909028 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:50:22.909028 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:50:22.909028 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:50:22.909028 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:50:22.909028 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 4f9be56fbeb64cb08b9be4e3d7436782 Aug 27 02:50:22.909028 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-234532228 Aug 27 02:50:22.909028 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:50:22.909028 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:50:22.909028 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4f9be56fbeb64cb08b9be4e3d7436782"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_4f9be56fbeb64cb08b9be4e3d7436782", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4f9be56fbeb64cb08b9be4e3d7436782"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/4f9be56fbeb64cb08b9be4e3d7436782"}]}] Aug 27 02:50:22.909028 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-234532228 Aug 27 02:50:22.909028 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 4f9be56fbeb64cb08b9be4e3d7436782 Aug 27 02:50:22.909028 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-234532228 Aug 27 02:50:22.909028 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-FloatingIPsAssociationTestJSON-234532228-project Aug 27 02:50:22.909028 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:50:22.909028 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:50:22.909028 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 66c0fc8492654e6e85a90ce04736c055 Aug 27 02:50:22.909028 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-234532228-project Aug 27 02:50:22.909028 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 02:50:22.909028 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance 26795af5-99b8-4a26-9843-3781a5016217 could not be found. Aug 27 02:50:22.909028 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '26795af5-99b8-4a26-9843-3781a5016217'} Aug 27 02:50:22.909028 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:50:22.909028 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:22.909028 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:50:22.909028 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:50:22.909028 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:50:22.909028 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:50:22.909028 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:50:22.909028 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:50:22.909028 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:50:22.909028 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:50:22.909028 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26795af5-99b8-4a26-9843-3781a5016217 could not be found. Aug 27 02:50:22.909028 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:50:22.909028 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:50:22.909028 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:50:22.909028 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:22.909028 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:50:22.909028 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:50:22.909028 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:50:22.909028 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:50:22.909028 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:50:22.909028 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:50:22.909028 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:50:22.909028 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:50:22.909028 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:50:22.909028 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:50:22.909028 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:50:22.909028 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:50:22.909028 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26795af5-99b8-4a26-9843-3781a5016217 could not be found. Aug 27 02:50:22.909028 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:50:22.909028 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:50:22.912750 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:50:22.912750 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:22.912750 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:50:22.912750 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:50:22.912750 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:50:22.912750 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:50:22.912750 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26795af5-99b8-4a26-9843-3781a5016217 could not be found. Aug 27 02:50:22.912750 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:50:22.914501 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d71ccf2b-a19f-4b6a-9724-8812e6809275 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Returning 404 to user: Instance 26795af5-99b8-4a26-9843-3781a5016217 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:50:22.915809 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d71ccf2b-a19f-4b6a-9724-8812e6809275 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] 10.222.0.70 "GET /compute/v2.1/servers/26795af5-99b8-4a26-9843-3781a5016217" status: 404 len: 111 microversion: 2.1 time: 0.079487 Aug 27 02:50:22.918957 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1090/2149] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:22 2022] GET /compute/v2.1/servers/26795af5-99b8-4a26-9843-3781a5016217 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:50:22.939181 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-d29d95b0-f4d7-4c7a-a537-e9e59cfadf8c req-76c584ae-17ea-4b02-b81c-d80dd01064b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e445cdc5-5ecb-487c-adee-f5cb9862283c", "tag": "42ac4b18-965a-486a-8d1d-80c016c9888c"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:50:22.966138 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-d29d95b0-f4d7-4c7a-a537-e9e59cfadf8c req-76c584ae-17ea-4b02-b81c-d80dd01064b8 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:22.966665 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-d29d95b0-f4d7-4c7a-a537-e9e59cfadf8c req-76c584ae-17ea-4b02-b81c-d80dd01064b8 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:22.971944 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-d29d95b0-f4d7-4c7a-a537-e9e59cfadf8c req-76c584ae-17ea-4b02-b81c-d80dd01064b8 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:22.993456 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-d29d95b0-f4d7-4c7a-a537-e9e59cfadf8c req-76c584ae-17ea-4b02-b81c-d80dd01064b8 service nova] Creating event network-changed:42ac4b18-965a-486a-8d1d-80c016c9888c for instance e445cdc5-5ecb-487c-adee-f5cb9862283c on n-h2-852278-4 Aug 27 02:50:23.019400 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-d29d95b0-f4d7-4c7a-a537-e9e59cfadf8c req-76c584ae-17ea-4b02-b81c-d80dd01064b8 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094085 Aug 27 02:50:23.020610 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1091/2150] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:50:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:50:23.031591 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-c1123226-118c-4c0d-91bd-c1a39ac9a19f req-25cba90b-6191-4eee-8416-f9c622388754 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cac17f47-6e08-4f15-a8cf-f5e44ad03d12", "name": "network-vif-plugged", "status": "completed", "tag": "7d0fd053-123c-4222-8389-3499f91d9b8c"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:50:23.053186 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-c1123226-118c-4c0d-91bd-c1a39ac9a19f req-25cba90b-6191-4eee-8416-f9c622388754 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:23.053752 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-c1123226-118c-4c0d-91bd-c1a39ac9a19f req-25cba90b-6191-4eee-8416-f9c622388754 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:23.055268 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-c1123226-118c-4c0d-91bd-c1a39ac9a19f req-25cba90b-6191-4eee-8416-f9c622388754 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:23.069484 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-c1123226-118c-4c0d-91bd-c1a39ac9a19f req-25cba90b-6191-4eee-8416-f9c622388754 service nova] Creating event network-vif-plugged:7d0fd053-123c-4222-8389-3499f91d9b8c for instance cac17f47-6e08-4f15-a8cf-f5e44ad03d12 on n-h1-852278-4 Aug 27 02:50:23.080988 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [req-c1123226-118c-4c0d-91bd-c1a39ac9a19f req-25cba90b-6191-4eee-8416-f9c622388754 service nova] Instance cac17f47-6e08-4f15-a8cf-f5e44ad03d12 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852278-4'} {{(pid=134052) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 02:50:23.094007 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-c1123226-118c-4c0d-91bd-c1a39ac9a19f req-25cba90b-6191-4eee-8416-f9c622388754 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069663 Aug 27 02:50:23.095567 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1092/2151] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:50:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:50:23.102657 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9aacc312-773d-4b59-9826-40b380088cc1 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Calling method '.version_select at 0x7f5ee718d550>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:24.097261 n-d-852278-4 devstack@n-api.service[134052]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 02:50:24.097976 n-d-852278-4 devstack@n-api.service[134052]: Sat Aug 27 02:50:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-floating-ips/f7577190-6a6e-44d0-8e10-5dde933396ae (ip 10.222.0.70) !!! Aug 27 02:50:26.894467 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9aacc312-773d-4b59-9826-40b380088cc1 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] 10.222.0.70 "DELETE /compute/v2.1/os-floating-ips/f7577190-6a6e-44d0-8e10-5dde933396ae" status: 202 len: 0 microversion: 2.1 time: 3.797178 Aug 27 02:50:26.896029 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1093/2152] 10.222.0.70 () {58 vars in 1263 bytes} [Sat Aug 27 02:50:23 2022] DELETE /compute/v2.1/os-floating-ips/f7577190-6a6e-44d0-8e10-5dde933396ae => generated 0 bytes in 3800 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:50:26.901830 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6d4b3511-ed09-440f-86b9-75f10798769f tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:26.902780 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-6d4b3511-ed09-440f-86b9-75f10798769f tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] [instance: 484e03a9-aef3-4179-980c-0e7292a05b5a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:26.919765 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6d4b3511-ed09-440f-86b9-75f10798769f tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:26.923138 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6d4b3511-ed09-440f-86b9-75f10798769f tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:26.923813 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6d4b3511-ed09-440f-86b9-75f10798769f tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:26.924758 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6d4b3511-ed09-440f-86b9-75f10798769f tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:26.932838 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6d4b3511-ed09-440f-86b9-75f10798769f tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:26.933638 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6d4b3511-ed09-440f-86b9-75f10798769f tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:26.964834 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-6d4b3511-ed09-440f-86b9-75f10798769f tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] HTTP exception thrown: Instance 484e03a9-aef3-4179-980c-0e7292a05b5a could not be found. Aug 27 02:50:26.966505 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6d4b3511-ed09-440f-86b9-75f10798769f tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Request method failure captured: Aug 27 02:50:26.966505 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a HTTP/1.1 Aug 27 02:50:26.966505 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:50:26.966505 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:50:26.966505 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:50:26.966505 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:50:26.966505 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:50:26.966505 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:50:26.966505 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:50:26.966505 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:50:26.966505 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYTp7V16ERwgojK6BvG52F-UUjor2emaXL5UiNwbTQOqgCbKUJn7U76g9bMykoF12gGYGWYbCCg6veGyQurkmZvYrJAF_yvWKgSs7Xn2Vb47ewIHMeFSAL6YoXL8IQvXirNN5Eq9yxZspt44Z-13_9Saj7KddNvbqEGAdU45TpdhvPU Aug 27 02:50:26.966505 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:50:26.966505 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:50:26.966505 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:50:26.966505 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:50:26.966505 n-d-852278-4 devstack@n-api.service[134052]: X-Openstack-Nova-Api-Version: 2.42 Aug 27 02:50:26.966505 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:50:26.966505 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:50:26.966505 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: ae35c895f49f4d31a4137dd3392f65bf Aug 27 02:50:26.966505 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-204109502 Aug 27 02:50:26.966505 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:50:26.966505 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:50:26.966505 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ae35c895f49f4d31a4137dd3392f65bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_ae35c895f49f4d31a4137dd3392f65bf", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ae35c895f49f4d31a4137dd3392f65bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/ae35c895f49f4d31a4137dd3392f65bf"}]}] Aug 27 02:50:26.966505 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-TaggedBootDevicesTest_v242-204109502 Aug 27 02:50:26.966505 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: ae35c895f49f4d31a4137dd3392f65bf Aug 27 02:50:26.966505 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-204109502 Aug 27 02:50:26.966505 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-TaggedBootDevicesTest_v242-204109502-project Aug 27 02:50:26.966505 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:50:26.966505 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:50:26.966505 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 585803c75b454475993d2189c88cc6d7 Aug 27 02:50:26.966505 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-TaggedBootDevicesTest_v242-204109502-project Aug 27 02:50:26.966505 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 02:50:26.966505 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance 484e03a9-aef3-4179-980c-0e7292a05b5a could not be found. Aug 27 02:50:26.966505 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '484e03a9-aef3-4179-980c-0e7292a05b5a'} Aug 27 02:50:26.966505 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:50:26.966505 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:26.966505 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:50:26.966505 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:50:26.966505 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:50:26.966505 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:50:26.966505 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:50:26.966505 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:50:26.966505 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:50:26.966505 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:50:26.966505 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 484e03a9-aef3-4179-980c-0e7292a05b5a could not be found. Aug 27 02:50:26.966505 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:50:26.966505 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:50:26.966505 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:50:26.966505 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:26.966505 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:50:26.966505 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:50:26.966505 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:50:26.966505 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:50:26.966505 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:50:26.966505 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:50:26.966505 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:50:26.966505 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:50:26.966505 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:50:26.966505 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:50:26.966505 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:50:26.966505 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:50:26.966505 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 484e03a9-aef3-4179-980c-0e7292a05b5a could not be found. Aug 27 02:50:26.966505 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:50:26.966505 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:50:26.970892 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:50:26.970892 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:26.970892 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:50:26.970892 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:50:26.970892 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:50:26.970892 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:50:26.970892 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 484e03a9-aef3-4179-980c-0e7292a05b5a could not be found. Aug 27 02:50:26.970892 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:50:26.970892 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6d4b3511-ed09-440f-86b9-75f10798769f tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Returning 404 to user: Instance 484e03a9-aef3-4179-980c-0e7292a05b5a could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:50:26.970892 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-6d4b3511-ed09-440f-86b9-75f10798769f tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] 10.222.0.70 "GET /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a" status: 404 len: 111 microversion: 2.42 time: 0.071149 Aug 27 02:50:26.970892 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1094/2153] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:50:26 2022] GET /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 02:50:26.978755 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-fbbb1b3e-05af-491a-9b41-908687fcc4b6 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:26.980041 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-fbbb1b3e-05af-491a-9b41-908687fcc4b6 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: cac17f47-6e08-4f15-a8cf-f5e44ad03d12] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:27.035952 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fbbb1b3e-05af-491a-9b41-908687fcc4b6 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:27.037238 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fbbb1b3e-05af-491a-9b41-908687fcc4b6 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:27.049575 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fbbb1b3e-05af-491a-9b41-908687fcc4b6 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:27.050894 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fbbb1b3e-05af-491a-9b41-908687fcc4b6 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:27.051434 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fbbb1b3e-05af-491a-9b41-908687fcc4b6 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:27.051931 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fbbb1b3e-05af-491a-9b41-908687fcc4b6 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:27.614962 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-fbbb1b3e-05af-491a-9b41-908687fcc4b6 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:27.629842 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-fbbb1b3e-05af-491a-9b41-908687fcc4b6 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/cac17f47-6e08-4f15-a8cf-f5e44ad03d12" status: 200 len: 1461 microversion: 2.1 time: 0.657887 Aug 27 02:50:27.630902 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1095/2154] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:26 2022] GET /compute/v2.1/servers/cac17f47-6e08-4f15-a8cf-f5e44ad03d12 => generated 1461 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:50:27.635890 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b2afe1af-5240-465d-939b-8389d3e77167 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:27.643226 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b2afe1af-5240-465d-939b-8389d3e77167 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] [instance: e445cdc5-5ecb-487c-adee-f5cb9862283c] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:27.656568 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b2afe1af-5240-465d-939b-8389d3e77167 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:27.657397 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b2afe1af-5240-465d-939b-8389d3e77167 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:27.657840 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b2afe1af-5240-465d-939b-8389d3e77167 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:27.658561 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b2afe1af-5240-465d-939b-8389d3e77167 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:27.659174 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b2afe1af-5240-465d-939b-8389d3e77167 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:27.659607 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b2afe1af-5240-465d-939b-8389d3e77167 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:27.704455 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b2afe1af-5240-465d-939b-8389d3e77167 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] [instance: e445cdc5-5ecb-487c-adee-f5cb9862283c] Going to try to terminate instance {{(pid=134052) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:50:27.774684 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:UPDATE=4,nova_cell1:SELECT=92,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:50:27.841419 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b2afe1af-5240-465d-939b-8389d3e77167 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] 10.222.0.70 "DELETE /compute/v2.1/servers/e445cdc5-5ecb-487c-adee-f5cb9862283c" status: 204 len: 0 microversion: 2.1 time: 0.208965 Aug 27 02:50:27.842573 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1096/2155] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:50:27 2022] DELETE /compute/v2.1/servers/e445cdc5-5ecb-487c-adee-f5cb9862283c => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:50:27.850010 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c0542964-2ab0-4c6f-9885-242c014e207f tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Calling method '.version_select at 0x7f5ee7226790>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:27.881647 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c0542964-2ab0-4c6f-9885-242c014e207f tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1303823778" status: 204 len: 0 microversion: 2.42 time: 0.037284 Aug 27 02:50:27.882315 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1097/2156] 10.222.0.70 () {60 vars in 1262 bytes} [Sat Aug 27 02:50:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1303823778 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 02:50:27.891134 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-70630119-b2bd-41ea-8f7a-1d52d001b561 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:27.892011 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-70630119-b2bd-41ea-8f7a-1d52d001b561 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: cac17f47-6e08-4f15-a8cf-f5e44ad03d12] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:27.904847 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-70630119-b2bd-41ea-8f7a-1d52d001b561 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:27.905885 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-70630119-b2bd-41ea-8f7a-1d52d001b561 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:27.906508 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-70630119-b2bd-41ea-8f7a-1d52d001b561 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:27.907281 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-70630119-b2bd-41ea-8f7a-1d52d001b561 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:27.908880 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-70630119-b2bd-41ea-8f7a-1d52d001b561 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:27.909458 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-70630119-b2bd-41ea-8f7a-1d52d001b561 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:27.991939 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-de5ec96c-6af8-40ba-b36d-93d9da0d9677 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] 10.222.0.70 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 7.661030 Aug 27 02:50:27.993282 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1060/2157] 10.222.0.70 () {60 vars in 1170 bytes} [Sat Aug 27 02:50:20 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 7663 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:50:28.003779 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d00ec48b-ae93-4118-b2d9-d4c4bc4ca3cd tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:28.005453 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d00ec48b-ae93-4118-b2d9-d4c4bc4ca3cd tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] [instance: e445cdc5-5ecb-487c-adee-f5cb9862283c] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:28.014007 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d00ec48b-ae93-4118-b2d9-d4c4bc4ca3cd tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:28.015441 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d00ec48b-ae93-4118-b2d9-d4c4bc4ca3cd tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:28.016168 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d00ec48b-ae93-4118-b2d9-d4c4bc4ca3cd tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:28.017190 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d00ec48b-ae93-4118-b2d9-d4c4bc4ca3cd tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:28.017874 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d00ec48b-ae93-4118-b2d9-d4c4bc4ca3cd tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:28.018526 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d00ec48b-ae93-4118-b2d9-d4c4bc4ca3cd tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:28.822144 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-70630119-b2bd-41ea-8f7a-1d52d001b561 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:28.839241 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-70630119-b2bd-41ea-8f7a-1d52d001b561 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/cac17f47-6e08-4f15-a8cf-f5e44ad03d12" status: 200 len: 1461 microversion: 2.1 time: 0.951867 Aug 27 02:50:28.842094 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1098/2158] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:27 2022] GET /compute/v2.1/servers/cac17f47-6e08-4f15-a8cf-f5e44ad03d12 => generated 1461 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:50:28.855506 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-187d229b-ac05-4bdc-a6a0-76953d97ace7 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Action: 'action', calling method: .version_select at 0x7f5ee5569280>, body: {"addFloatingIp": {"address": "172.25.0.236"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:50:28.863032 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-187d229b-ac05-4bdc-a6a0-76953d97ace7 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] [instance: 57a1e617-8846-4da8-b84f-232ffc519f69] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:28.886648 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-187d229b-ac05-4bdc-a6a0-76953d97ace7 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:28.887806 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-187d229b-ac05-4bdc-a6a0-76953d97ace7 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:28.889251 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-187d229b-ac05-4bdc-a6a0-76953d97ace7 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:28.893520 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-187d229b-ac05-4bdc-a6a0-76953d97ace7 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:28.895598 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-187d229b-ac05-4bdc-a6a0-76953d97ace7 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:28.896915 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-187d229b-ac05-4bdc-a6a0-76953d97ace7 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:28.943567 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d00ec48b-ae93-4118-b2d9-d4c4bc4ca3cd tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66c0fc8492654e6e85a90ce04736c055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f9be56fbeb64cb08b9be4e3d7436782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:28.948486 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-187d229b-ac05-4bdc-a6a0-76953d97ace7 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Acquiring lock "refresh_cache-57a1e617-8846-4da8-b84f-232ffc519f69" {{(pid=134052) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 27 02:50:28.949769 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-187d229b-ac05-4bdc-a6a0-76953d97ace7 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Acquired lock "refresh_cache-57a1e617-8846-4da8-b84f-232ffc519f69" {{(pid=134052) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 27 02:50:28.952874 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d00ec48b-ae93-4118-b2d9-d4c4bc4ca3cd tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] 10.222.0.70 "GET /compute/v2.1/servers/e445cdc5-5ecb-487c-adee-f5cb9862283c" status: 200 len: 1525 microversion: 2.1 time: 0.954421 Aug 27 02:50:28.956562 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1061/2159] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:27 2022] GET /compute/v2.1/servers/e445cdc5-5ecb-487c-adee-f5cb9862283c => generated 1525 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:50:29.102631 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-21be2cd6-9e71-4764-9ad7-0f70ea2c7336 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1597085541", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "networks": [{"uuid": "9f81fa4d-d0d4-411f-b6ce-c99b22cb14d3"}]}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:50:29.211896 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.network.neutron [None req-21be2cd6-9e71-4764-9ad7-0f70ea2c7336 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] validate_networks() for [('9f81fa4d-d0d4-411f-b6ce-c99b22cb14d3', None, None, None, None, None)] {{(pid=134051) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:50:30.242063 n-d-852278-4 devstack@n-api.service[134052]: DEBUG neutronclient.v2_0.client [None req-187d229b-ac05-4bdc-a6a0-76953d97ace7 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.0.236 (20bca687-6bcf-4135-ab11-84d2fb78a9ca) with port f1fc64b5-9211-456f-b514-94d86ae29282 using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network 65cca408-d0e3-41ef-a7be-f6f3ea292ba5.", "detail": ""}} {{(pid=134052) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 02:50:30.243381 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-187d229b-ac05-4bdc-a6a0-76953d97ace7 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Releasing lock "refresh_cache-57a1e617-8846-4da8-b84f-232ffc519f69" {{(pid=134052) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 27 02:50:30.243614 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-187d229b-ac05-4bdc-a6a0-76953d97ace7 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] HTTP exception thrown: Cannot associate floating IP 172.25.0.236 (20bca687-6bcf-4135-ab11-84d2fb78a9ca) with port f1fc64b5-9211-456f-b514-94d86ae29282 using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network 65cca408-d0e3-41ef-a7be-f6f3ea292ba5. Aug 27 02:50:30.243614 n-d-852278-4 devstack@n-api.service[134052]: Neutron server returns request_ids: ['req-fadae7dd-ba0d-465c-86ba-9be7d6c114e0'] Aug 27 02:50:30.246655 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-187d229b-ac05-4bdc-a6a0-76953d97ace7 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Request method failure captured: Aug 27 02:50:30.246655 n-d-852278-4 devstack@n-api.service[134052]: request: POST /compute/v2.1/servers/57a1e617-8846-4da8-b84f-232ffc519f69/action HTTP/1.1 Aug 27 02:50:30.246655 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:50:30.246655 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:50:30.246655 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:50:30.246655 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 46 Aug 27 02:50:30.246655 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:50:30.246655 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:50:30.246655 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:50:30.246655 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:50:30.246655 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYZBHK5lJQrdMj_AIzVz1BIf6TAv82YyeU0Mi4KNWaGZlnNvrahx2fCXt0F5D_IBmtIoOZ71FZ2QPJSr07MZuRSWSVJ8dVK-neCA_QCKq50hu1JadvwPdTgut4AoG_fqbxyQgshY-tQLo6U2vxcoxz_6g4r9JWKwF61goCkuWVmk8Rs Aug 27 02:50:30.246655 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:50:30.246655 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:50:30.246655 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:50:30.246655 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:50:30.246655 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:50:30.246655 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:50:30.246655 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 2c13c5aeb4da472da020639d5b6ad5aa Aug 27 02:50:30.246655 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-714154922 Aug 27 02:50:30.246655 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:50:30.246655 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:50:30.246655 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2c13c5aeb4da472da020639d5b6ad5aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_2c13c5aeb4da472da020639d5b6ad5aa", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2c13c5aeb4da472da020639d5b6ad5aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/2c13c5aeb4da472da020639d5b6ad5aa"}]}] Aug 27 02:50:30.246655 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-714154922 Aug 27 02:50:30.246655 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 2c13c5aeb4da472da020639d5b6ad5aa Aug 27 02:50:30.246655 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-714154922 Aug 27 02:50:30.246655 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project Aug 27 02:50:30.246655 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:50:30.246655 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:50:30.246655 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: ece67529f3704d9faf0ff443d7c016de Aug 27 02:50:30.246655 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project Aug 27 02:50:30.246655 n-d-852278-4 devstack@n-api.service[134052]: Aug 27 02:50:30.246655 n-d-852278-4 devstack@n-api.service[134052]: {"addFloatingIp": {"address": "172.25.0.236"}} Aug 27 02:50:30.246655 n-d-852278-4 devstack@n-api.service[134052]: method: Aug 27 02:50:30.246655 n-d-852278-4 devstack@n-api.service[134052]: exception: Cannot associate floating IP 172.25.0.236 (20bca687-6bcf-4135-ab11-84d2fb78a9ca) with port f1fc64b5-9211-456f-b514-94d86ae29282 using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network 65cca408-d0e3-41ef-a7be-f6f3ea292ba5. Aug 27 02:50:30.246655 n-d-852278-4 devstack@n-api.service[134052]: Neutron server returns request_ids: ['req-fadae7dd-ba0d-465c-86ba-9be7d6c114e0'] Aug 27 02:50:30.246655 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '57a1e617-8846-4da8-b84f-232ffc519f69', 'body': {'addFloatingIp': {'address': '172.25.0.236'}}} Aug 27 02:50:30.246655 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:50:30.246655 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:30.246655 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2706, in associate_floating_ip Aug 27 02:50:30.246655 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Aug 27 02:50:30.246655 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:50:30.246655 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:50:30.246655 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1014, in update_floatingip Aug 27 02:50:30.246655 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Aug 27 02:50:30.246655 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:50:30.246655 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:50:30.246655 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2520, in _update_resource Aug 27 02:50:30.246655 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Aug 27 02:50:30.246655 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:50:30.246655 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:50:30.246655 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Aug 27 02:50:30.246655 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Aug 27 02:50:30.246655 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:50:30.246655 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:50:30.246655 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 02:50:30.246655 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 02:50:30.246655 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:50:30.246655 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:50:30.246655 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 02:50:30.246655 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 02:50:30.258415 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:50:30.258415 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:50:30.258415 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 02:50:30.258415 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 02:50:30.258415 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 02:50:30.258415 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 02:50:30.258415 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.0.236 (20bca687-6bcf-4135-ab11-84d2fb78a9ca) with port f1fc64b5-9211-456f-b514-94d86ae29282 using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network 65cca408-d0e3-41ef-a7be-f6f3ea292ba5. Aug 27 02:50:30.258415 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fadae7dd-ba0d-465c-86ba-9be7d6c114e0'] Aug 27 02:50:30.258415 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:50:30.258415 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:50:30.258415 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:50:30.258415 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:30.258415 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Aug 27 02:50:30.258415 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Aug 27 02:50:30.258415 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Aug 27 02:50:30.258415 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Aug 27 02:50:30.258415 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2708, in associate_floating_ip Aug 27 02:50:30.258415 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Aug 27 02:50:30.258415 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.0.236 (20bca687-6bcf-4135-ab11-84d2fb78a9ca) with port f1fc64b5-9211-456f-b514-94d86ae29282 using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network 65cca408-d0e3-41ef-a7be-f6f3ea292ba5. Aug 27 02:50:30.258415 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fadae7dd-ba0d-465c-86ba-9be7d6c114e0'] Aug 27 02:50:30.258415 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:50:30.258415 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:50:30.258415 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:50:30.258415 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:30.258415 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:50:30.258415 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:50:30.258415 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:50:30.258415 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:50:30.258415 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:50:30.258415 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:50:30.258415 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:50:30.258415 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:50:30.258415 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:50:30.258415 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:50:30.258415 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Aug 27 02:50:30.258415 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Aug 27 02:50:30.258415 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.0.236 (20bca687-6bcf-4135-ab11-84d2fb78a9ca) with port f1fc64b5-9211-456f-b514-94d86ae29282 using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network 65cca408-d0e3-41ef-a7be-f6f3ea292ba5. Aug 27 02:50:30.258415 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fadae7dd-ba0d-465c-86ba-9be7d6c114e0'] Aug 27 02:50:30.258415 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:50:30.258415 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:50:30.258415 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:50:30.258415 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:30.258415 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:50:30.258415 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:50:30.258415 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:50:30.258415 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:50:30.258415 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.0.236 (20bca687-6bcf-4135-ab11-84d2fb78a9ca) with port f1fc64b5-9211-456f-b514-94d86ae29282 using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network 65cca408-d0e3-41ef-a7be-f6f3ea292ba5. Aug 27 02:50:30.258415 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fadae7dd-ba0d-465c-86ba-9be7d6c114e0'] Aug 27 02:50:30.258415 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:50:30.273503 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-187d229b-ac05-4bdc-a6a0-76953d97ace7 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Returning 400 to user: Cannot associate floating IP 172.25.0.236 (20bca687-6bcf-4135-ab11-84d2fb78a9ca) with port f1fc64b5-9211-456f-b514-94d86ae29282 using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network 65cca408-d0e3-41ef-a7be-f6f3ea292ba5. Aug 27 02:50:30.273503 n-d-852278-4 devstack@n-api.service[134052]: Neutron server returns request_ids: ['req-fadae7dd-ba0d-465c-86ba-9be7d6c114e0'] {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:50:30.273503 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-187d229b-ac05-4bdc-a6a0-76953d97ace7 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] 10.222.0.70 "POST /compute/v2.1/servers/57a1e617-8846-4da8-b84f-232ffc519f69/action" status: 400 len: 382 microversion: 2.1 time: 1.404134 Aug 27 02:50:30.273503 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1099/2160] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 02:50:28 2022] POST /compute/v2.1/servers/57a1e617-8846-4da8-b84f-232ffc519f69/action => generated 382 bytes in 1405 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 02:50:30.273503 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8b06a9a2-9077-4030-ad2a-dc5a3b4a6913 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Action: 'create', calling method: .version_select at 0x7f5ee71d7b80>, body: {"keypair": {"name": "tempest-keypair-509792707", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBABF5iK/uFwwtAUCysC2KKTfu3pGQmalhHP9Z4A7S0il/46W1odutL4g5fw/WPbwB7aZfpUyj/cRJbtHPt9M/r0xJIPaJkLfQLmzyZWaWCE/ldXuhmIty/u19oYXa0z8AQ=="}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:50:30.327847 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-8b06a9a2-9077-4030-ad2a-dc5a3b4a6913 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Getting quotas for project 937a5eeccaa7425ca72c8c74fb99f11a. Resources: {'key_pairs'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:50:30.386511 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-8b06a9a2-9077-4030-ad2a-dc5a3b4a6913 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Getting quotas for user 0b310e73ecd244d2938812d5be99558c and project 937a5eeccaa7425ca72c8c74fb99f11a. Resources: {'key_pairs'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:50:30.429730 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-8b06a9a2-9077-4030-ad2a-dc5a3b4a6913 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.179158 Aug 27 02:50:30.438491 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1100/2161] 10.222.0.70 () {60 vars in 1159 bytes} [Sat Aug 27 02:50:30 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:50:30.445054 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-2270ec03-bfba-4f37-b8fe-5cda8acc2f40 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:30.446979 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-2270ec03-bfba-4f37-b8fe-5cda8acc2f40 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] [instance: e445cdc5-5ecb-487c-adee-f5cb9862283c] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:30.453031 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2270ec03-bfba-4f37-b8fe-5cda8acc2f40 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:30.453773 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2270ec03-bfba-4f37-b8fe-5cda8acc2f40 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:30.454391 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2270ec03-bfba-4f37-b8fe-5cda8acc2f40 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:30.455840 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2270ec03-bfba-4f37-b8fe-5cda8acc2f40 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:30.456494 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2270ec03-bfba-4f37-b8fe-5cda8acc2f40 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:30.457076 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2270ec03-bfba-4f37-b8fe-5cda8acc2f40 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:31.131523 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-2270ec03-bfba-4f37-b8fe-5cda8acc2f40 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66c0fc8492654e6e85a90ce04736c055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f9be56fbeb64cb08b9be4e3d7436782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:31.146501 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-2270ec03-bfba-4f37-b8fe-5cda8acc2f40 tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] 10.222.0.70 "GET /compute/v2.1/servers/e445cdc5-5ecb-487c-adee-f5cb9862283c" status: 200 len: 1525 microversion: 2.1 time: 0.706468 Aug 27 02:50:31.147494 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1101/2162] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:30 2022] GET /compute/v2.1/servers/e445cdc5-5ecb-487c-adee-f5cb9862283c => generated 1525 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:50:31.152621 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5d3f621e-f403-41ad-bd64-4b3cd84c621e tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Calling method '.version_select at 0x7f5ee7214040>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:31.195161 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-21be2cd6-9e71-4764-9ad7-0f70ea2c7336 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Flavor limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:50:31.196682 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-21be2cd6-9e71-4764-9ad7-0f70ea2c7336 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Image limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:50:31.197349 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-21be2cd6-9e71-4764-9ad7-0f70ea2c7336 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Flavor pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:50:31.197926 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-21be2cd6-9e71-4764-9ad7-0f70ea2c7336 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Image pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:50:31.198483 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-21be2cd6-9e71-4764-9ad7-0f70ea2c7336 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:50:31.219437 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-21be2cd6-9e71-4764-9ad7-0f70ea2c7336 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:31.220053 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-21be2cd6-9e71-4764-9ad7-0f70ea2c7336 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:31.220536 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-21be2cd6-9e71-4764-9ad7-0f70ea2c7336 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:31.221283 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-21be2cd6-9e71-4764-9ad7-0f70ea2c7336 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:31.221735 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-21be2cd6-9e71-4764-9ad7-0f70ea2c7336 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:31.222163 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-21be2cd6-9e71-4764-9ad7-0f70ea2c7336 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:31.270714 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-21be2cd6-9e71-4764-9ad7-0f70ea2c7336 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Getting quotas for project 840077c9375b4b2a9214cb8dda094cc8. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:50:31.277634 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-21be2cd6-9e71-4764-9ad7-0f70ea2c7336 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Getting quotas for user dc53b0977c2b4e06b2f290442483913b and project 840077c9375b4b2a9214cb8dda094cc8. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:50:31.299773 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-21be2cd6-9e71-4764-9ad7-0f70ea2c7336 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Going to run 1 instances... {{(pid=134051) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:50:31.302731 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-21be2cd6-9e71-4764-9ad7-0f70ea2c7336 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: 24cefd05-8d3a-4813-af22-160658183e1b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134051) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:50:31.386428 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-21be2cd6-9e71-4764-9ad7-0f70ea2c7336 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.428325 Aug 27 02:50:31.392980 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1062/2163] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 02:50:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 2430 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:50:31.395804 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f94c672c-c8bc-4bd0-bc3c-cf354a86a29a tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:31.396367 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-f94c672c-c8bc-4bd0-bc3c-cf354a86a29a tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] [instance: 14df3dce-7fb6-491c-9559-6fbca68580b0] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:31.405728 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f94c672c-c8bc-4bd0-bc3c-cf354a86a29a tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:31.406847 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f94c672c-c8bc-4bd0-bc3c-cf354a86a29a tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:31.407577 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f94c672c-c8bc-4bd0-bc3c-cf354a86a29a tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:31.408609 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f94c672c-c8bc-4bd0-bc3c-cf354a86a29a tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:31.409489 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f94c672c-c8bc-4bd0-bc3c-cf354a86a29a tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:31.410154 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f94c672c-c8bc-4bd0-bc3c-cf354a86a29a tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:31.469829 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-f94c672c-c8bc-4bd0-bc3c-cf354a86a29a tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] [instance: 14df3dce-7fb6-491c-9559-6fbca68580b0] Going to try to terminate instance {{(pid=134051) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:50:31.701080 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-f94c672c-c8bc-4bd0-bc3c-cf354a86a29a tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] 10.222.0.70 "DELETE /compute/v2.1/servers/14df3dce-7fb6-491c-9559-6fbca68580b0" status: 204 len: 0 microversion: 2.1 time: 0.312527 Aug 27 02:50:31.703610 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1063/2164] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:50:31 2022] DELETE /compute/v2.1/servers/14df3dce-7fb6-491c-9559-6fbca68580b0 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:50:31.721932 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-05ca5ca3-7300-4488-b22d-814d0389c0b1 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:31.723440 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-05ca5ca3-7300-4488-b22d-814d0389c0b1 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: 24cefd05-8d3a-4813-af22-160658183e1b] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:32.122912 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-05ca5ca3-7300-4488-b22d-814d0389c0b1 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:32.137982 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-05ca5ca3-7300-4488-b22d-814d0389c0b1 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/24cefd05-8d3a-4813-af22-160658183e1b" status: 200 len: 1215 microversion: 2.1 time: 0.431498 Aug 27 02:50:32.138810 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1064/2165] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:31 2022] GET /compute/v2.1/servers/24cefd05-8d3a-4813-af22-160658183e1b => generated 1215 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:50:32.144119 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b301dcfc-d361-4554-b4de-22788f225b96 tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:32.153290 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b301dcfc-d361-4554-b4de-22788f225b96 tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] [instance: 14df3dce-7fb6-491c-9559-6fbca68580b0] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:32.188830 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b301dcfc-d361-4554-b4de-22788f225b96 tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:32.196713 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b301dcfc-d361-4554-b4de-22788f225b96 tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:32.198039 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b301dcfc-d361-4554-b4de-22788f225b96 tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:32.198891 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b301dcfc-d361-4554-b4de-22788f225b96 tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:32.199298 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b301dcfc-d361-4554-b4de-22788f225b96 tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:32.199916 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b301dcfc-d361-4554-b4de-22788f225b96 tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:32.918478 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-b301dcfc-d361-4554-b4de-22788f225b96 tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c5ce6f32ec4c979dda7ead8962a1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76872eddea474d77850d528d56120b3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:32.936157 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b301dcfc-d361-4554-b4de-22788f225b96 tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] 10.222.0.70 "GET /compute/v2.1/servers/14df3dce-7fb6-491c-9559-6fbca68580b0" status: 200 len: 1664 microversion: 2.1 time: 0.794093 Aug 27 02:50:32.937193 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1065/2166] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:32 2022] GET /compute/v2.1/servers/14df3dce-7fb6-491c-9559-6fbca68580b0 => generated 1664 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:50:32.951588 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ba826091-2204-442f-bb0a-45389ad0b5ad tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:32.953627 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-ba826091-2204-442f-bb0a-45389ad0b5ad tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] [instance: e445cdc5-5ecb-487c-adee-f5cb9862283c] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:32.968537 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ba826091-2204-442f-bb0a-45389ad0b5ad tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:32.969472 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ba826091-2204-442f-bb0a-45389ad0b5ad tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:32.972297 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ba826091-2204-442f-bb0a-45389ad0b5ad tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:32.973431 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ba826091-2204-442f-bb0a-45389ad0b5ad tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:32.974812 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ba826091-2204-442f-bb0a-45389ad0b5ad tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:32.976802 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ba826091-2204-442f-bb0a-45389ad0b5ad tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:33.330013 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-ba826091-2204-442f-bb0a-45389ad0b5ad tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66c0fc8492654e6e85a90ce04736c055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f9be56fbeb64cb08b9be4e3d7436782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:33.342072 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ba826091-2204-442f-bb0a-45389ad0b5ad tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] 10.222.0.70 "GET /compute/v2.1/servers/e445cdc5-5ecb-487c-adee-f5cb9862283c" status: 200 len: 1308 microversion: 2.1 time: 0.401216 Aug 27 02:50:33.344496 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1066/2167] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:32 2022] GET /compute/v2.1/servers/e445cdc5-5ecb-487c-adee-f5cb9862283c => generated 1308 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:50:33.358613 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-6952bca9-0f95-4054-9ddb-f35613e93160 req-81bdc430-634b-497a-ad72-d5a5f4bfecc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e445cdc5-5ecb-487c-adee-f5cb9862283c", "name": "network-vif-deleted", "tag": "42ac4b18-965a-486a-8d1d-80c016c9888c"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:50:33.388390 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-6952bca9-0f95-4054-9ddb-f35613e93160 req-81bdc430-634b-497a-ad72-d5a5f4bfecc8 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:33.389144 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-6952bca9-0f95-4054-9ddb-f35613e93160 req-81bdc430-634b-497a-ad72-d5a5f4bfecc8 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:33.390269 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-6952bca9-0f95-4054-9ddb-f35613e93160 req-81bdc430-634b-497a-ad72-d5a5f4bfecc8 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:33.415962 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-6952bca9-0f95-4054-9ddb-f35613e93160 req-81bdc430-634b-497a-ad72-d5a5f4bfecc8 service nova] Creating event network-vif-deleted:42ac4b18-965a-486a-8d1d-80c016c9888c for instance e445cdc5-5ecb-487c-adee-f5cb9862283c on n-h2-852278-4 Aug 27 02:50:33.424777 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-6952bca9-0f95-4054-9ddb-f35613e93160 req-81bdc430-634b-497a-ad72-d5a5f4bfecc8 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075433 Aug 27 02:50:33.426347 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1067/2168] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:50:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:50:33.516145 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0a8440eb-eed5-4d2c-91c4-b69aaf95b8bf tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Action: 'create', calling method: .version_select at 0x7f5ee72713a0>, body: {"keypair": {"name": "tempest-keypair-370147892", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGOAhUYt5w8hexfYrrZ98jqvnNwIF9/2A8wNl3PB35d1pB3LzZjw5IcRJxZEfwRZDLWwuMU3lRr/TqJ92fTWz66x+kvZvVVBidwU1YMGWYPR8pTeRMJaExbtbanYIBU5Kw=="}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:50:33.547307 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-0a8440eb-eed5-4d2c-91c4-b69aaf95b8bf tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Getting quotas for project 952767db5f394fc4bf01c0efd65f2fb9. Resources: {'key_pairs'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:50:33.554811 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-0a8440eb-eed5-4d2c-91c4-b69aaf95b8bf tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Getting quotas for user c850bda78e664117b671910c0e68bfb9 and project 952767db5f394fc4bf01c0efd65f2fb9. Resources: {'key_pairs'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:50:33.592783 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-0a8440eb-eed5-4d2c-91c4-b69aaf95b8bf tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.163628 Aug 27 02:50:33.603837 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1068/2169] 10.222.0.70 () {60 vars in 1159 bytes} [Sat Aug 27 02:50:33 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:50:33.611773 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-60e9df07-1ebd-444f-989e-9e8f6e14e40c tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:33.614215 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-60e9df07-1ebd-444f-989e-9e8f6e14e40c tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: 24cefd05-8d3a-4813-af22-160658183e1b] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:33.624503 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-60e9df07-1ebd-444f-989e-9e8f6e14e40c tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:33.626727 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-60e9df07-1ebd-444f-989e-9e8f6e14e40c tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:33.627496 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-60e9df07-1ebd-444f-989e-9e8f6e14e40c tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:33.629239 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-60e9df07-1ebd-444f-989e-9e8f6e14e40c tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:33.630727 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-60e9df07-1ebd-444f-989e-9e8f6e14e40c tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:33.631295 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-60e9df07-1ebd-444f-989e-9e8f6e14e40c tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:33.938929 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-60e9df07-1ebd-444f-989e-9e8f6e14e40c tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:33.961671 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-60e9df07-1ebd-444f-989e-9e8f6e14e40c tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/24cefd05-8d3a-4813-af22-160658183e1b" status: 200 len: 1267 microversion: 2.1 time: 0.355643 Aug 27 02:50:33.966411 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1069/2170] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:33 2022] GET /compute/v2.1/servers/24cefd05-8d3a-4813-af22-160658183e1b => generated 1267 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:50:33.983032 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d3cbd805-4786-441a-891b-5f6c20210b8f tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:33.983666 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d3cbd805-4786-441a-891b-5f6c20210b8f tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] [instance: 14df3dce-7fb6-491c-9559-6fbca68580b0] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:33.994813 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d3cbd805-4786-441a-891b-5f6c20210b8f tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:33.995726 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d3cbd805-4786-441a-891b-5f6c20210b8f tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:34.005142 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d3cbd805-4786-441a-891b-5f6c20210b8f tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:34.009719 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d3cbd805-4786-441a-891b-5f6c20210b8f tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:34.010758 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d3cbd805-4786-441a-891b-5f6c20210b8f tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:34.011213 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d3cbd805-4786-441a-891b-5f6c20210b8f tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:34.660994 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d3cbd805-4786-441a-891b-5f6c20210b8f tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c5ce6f32ec4c979dda7ead8962a1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76872eddea474d77850d528d56120b3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:34.672093 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d3cbd805-4786-441a-891b-5f6c20210b8f tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] 10.222.0.70 "GET /compute/v2.1/servers/14df3dce-7fb6-491c-9559-6fbca68580b0" status: 200 len: 1664 microversion: 2.1 time: 0.702677 Aug 27 02:50:34.682463 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1070/2171] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:33 2022] GET /compute/v2.1/servers/14df3dce-7fb6-491c-9559-6fbca68580b0 => generated 1664 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:50:34.697146 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a413593a-71b7-441e-a0d0-338957b7494c tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:34.698049 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-a413593a-71b7-441e-a0d0-338957b7494c tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] [instance: e445cdc5-5ecb-487c-adee-f5cb9862283c] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:34.705083 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a413593a-71b7-441e-a0d0-338957b7494c tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:34.705592 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a413593a-71b7-441e-a0d0-338957b7494c tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:34.706005 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a413593a-71b7-441e-a0d0-338957b7494c tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:34.706879 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a413593a-71b7-441e-a0d0-338957b7494c tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:34.707189 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a413593a-71b7-441e-a0d0-338957b7494c tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:34.715896 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a413593a-71b7-441e-a0d0-338957b7494c tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:34.745044 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-a413593a-71b7-441e-a0d0-338957b7494c tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] HTTP exception thrown: Instance e445cdc5-5ecb-487c-adee-f5cb9862283c could not be found. Aug 27 02:50:34.746706 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a413593a-71b7-441e-a0d0-338957b7494c tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Request method failure captured: Aug 27 02:50:34.746706 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/e445cdc5-5ecb-487c-adee-f5cb9862283c HTTP/1.1 Aug 27 02:50:34.746706 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:50:34.746706 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:50:34.746706 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:50:34.746706 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:50:34.746706 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:50:34.746706 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:50:34.746706 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:50:34.746706 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:50:34.746706 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYYC33a4sfcy0flVw5fElBdehyWAeg1tulUhA7AsP362Qhvm65PM70JFXBNalTPc4viU09Id9Z9Nwv26tmSWE9om-XPexmfdNMnm880cJaz8a6wZRrzmZsGh2ivxs7otD6rtMoYyDyYT9X6fA12qDhGtP0JhOLsdI78pvG7p67F1yr4 Aug 27 02:50:34.746706 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:50:34.746706 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:50:34.746706 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:50:34.746706 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:50:34.746706 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:50:34.746706 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:50:34.746706 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 4f9be56fbeb64cb08b9be4e3d7436782 Aug 27 02:50:34.746706 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-234532228 Aug 27 02:50:34.746706 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:50:34.746706 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:50:34.746706 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4f9be56fbeb64cb08b9be4e3d7436782"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_4f9be56fbeb64cb08b9be4e3d7436782", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4f9be56fbeb64cb08b9be4e3d7436782"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/4f9be56fbeb64cb08b9be4e3d7436782"}]}] Aug 27 02:50:34.746706 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-234532228 Aug 27 02:50:34.746706 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 4f9be56fbeb64cb08b9be4e3d7436782 Aug 27 02:50:34.746706 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-234532228 Aug 27 02:50:34.746706 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-FloatingIPsAssociationTestJSON-234532228-project Aug 27 02:50:34.746706 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:50:34.746706 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:50:34.746706 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 66c0fc8492654e6e85a90ce04736c055 Aug 27 02:50:34.746706 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-234532228-project Aug 27 02:50:34.746706 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 02:50:34.746706 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance e445cdc5-5ecb-487c-adee-f5cb9862283c could not be found. Aug 27 02:50:34.746706 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': 'e445cdc5-5ecb-487c-adee-f5cb9862283c'} Aug 27 02:50:34.746706 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:50:34.746706 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:34.746706 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:50:34.746706 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:50:34.746706 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:50:34.746706 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:50:34.746706 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:50:34.746706 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:50:34.746706 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:50:34.746706 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:50:34.746706 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e445cdc5-5ecb-487c-adee-f5cb9862283c could not be found. Aug 27 02:50:34.746706 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:50:34.746706 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:50:34.746706 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:50:34.746706 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:34.746706 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:50:34.746706 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:50:34.746706 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:50:34.746706 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:50:34.746706 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:50:34.746706 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:50:34.746706 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:50:34.746706 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:50:34.746706 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:50:34.746706 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:50:34.746706 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:50:34.746706 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:50:34.746706 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e445cdc5-5ecb-487c-adee-f5cb9862283c could not be found. Aug 27 02:50:34.746706 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:50:34.746706 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:50:34.753257 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:50:34.753257 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:34.753257 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:50:34.753257 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:50:34.753257 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:50:34.753257 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:50:34.753257 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e445cdc5-5ecb-487c-adee-f5cb9862283c could not be found. Aug 27 02:50:34.753257 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:50:34.753257 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a413593a-71b7-441e-a0d0-338957b7494c tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] Returning 404 to user: Instance e445cdc5-5ecb-487c-adee-f5cb9862283c could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:50:34.753257 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a413593a-71b7-441e-a0d0-338957b7494c tempest-FloatingIPsAssociationTestJSON-234532228 tempest-FloatingIPsAssociationTestJSON-234532228-project] 10.222.0.70 "GET /compute/v2.1/servers/e445cdc5-5ecb-487c-adee-f5cb9862283c" status: 404 len: 111 microversion: 2.1 time: 0.064126 Aug 27 02:50:34.753257 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1071/2172] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:34 2022] GET /compute/v2.1/servers/e445cdc5-5ecb-487c-adee-f5cb9862283c => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:50:34.990382 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-79e239dd-e10b-4ed6-9908-b1812a3bb514 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:34.991603 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-79e239dd-e10b-4ed6-9908-b1812a3bb514 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: 24cefd05-8d3a-4813-af22-160658183e1b] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:35.011978 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-79e239dd-e10b-4ed6-9908-b1812a3bb514 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:35.014920 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-79e239dd-e10b-4ed6-9908-b1812a3bb514 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:35.015589 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-79e239dd-e10b-4ed6-9908-b1812a3bb514 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:35.016572 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-79e239dd-e10b-4ed6-9908-b1812a3bb514 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:35.017030 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-79e239dd-e10b-4ed6-9908-b1812a3bb514 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:35.017454 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-79e239dd-e10b-4ed6-9908-b1812a3bb514 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:35.315106 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-79e239dd-e10b-4ed6-9908-b1812a3bb514 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:35.331051 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-79e239dd-e10b-4ed6-9908-b1812a3bb514 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/24cefd05-8d3a-4813-af22-160658183e1b" status: 200 len: 1273 microversion: 2.1 time: 0.341187 Aug 27 02:50:35.333576 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1072/2173] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:34 2022] GET /compute/v2.1/servers/24cefd05-8d3a-4813-af22-160658183e1b => generated 1273 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:50:35.389791 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a29ff629-39fc-42b9-be22-0375f480b4ce tempest-MigrationsAdminTest-1330282624 tempest-MigrationsAdminTest-1330282624-project-admin] Calling method '.version_select at 0x7f5ee7202dc0>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:35.394890 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a29ff629-39fc-42b9-be22-0375f480b4ce tempest-MigrationsAdminTest-1330282624 tempest-MigrationsAdminTest-1330282624-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:35.395334 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a29ff629-39fc-42b9-be22-0375f480b4ce tempest-MigrationsAdminTest-1330282624 tempest-MigrationsAdminTest-1330282624-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:35.396536 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a29ff629-39fc-42b9-be22-0375f480b4ce tempest-MigrationsAdminTest-1330282624 tempest-MigrationsAdminTest-1330282624-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:35.418234 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a29ff629-39fc-42b9-be22-0375f480b4ce tempest-MigrationsAdminTest-1330282624 tempest-MigrationsAdminTest-1330282624-project-admin] 10.222.0.70 "GET /compute/v2.1/os-migrations" status: 200 len: 803 microversion: 2.1 time: 0.032316 Aug 27 02:50:35.418878 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1073/2174] 10.222.0.70 () {58 vars in 1143 bytes} [Sat Aug 27 02:50:35 2022] GET /compute/v2.1/os-migrations => generated 803 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:50:35.453243 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3ad00f66-170f-45ec-89a4-595a94267203 tempest-MigrationsAdminTest-1330282624 tempest-MigrationsAdminTest-1330282624-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:35.481616 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-3ad00f66-170f-45ec-89a4-595a94267203 tempest-MigrationsAdminTest-1330282624 tempest-MigrationsAdminTest-1330282624-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.043567 Aug 27 02:50:35.482238 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1074/2175] 10.222.0.70 () {58 vars in 1137 bytes} [Sat Aug 27 02:50:35 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:50:35.508244 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-80540f0c-408a-423f-b38a-856e0a4d283a tempest-MigrationsAdminTest-1330282624 tempest-MigrationsAdminTest-1330282624-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-1404262036", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:50:35.539643 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-80540f0c-408a-423f-b38a-856e0a4d283a tempest-MigrationsAdminTest-1330282624 tempest-MigrationsAdminTest-1330282624-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 499 microversion: 2.1 time: 0.036817 Aug 27 02:50:35.549166 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1075/2176] 10.222.0.70 () {60 vars in 1146 bytes} [Sat Aug 27 02:50:35 2022] POST /compute/v2.1/flavors => generated 499 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:50:35.556052 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d9391925-f901-4a1d-907f-89bbb19ebfdd tempest-MigrationsAdminTest-1330282624 tempest-MigrationsAdminTest-1330282624-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:35.571466 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d9391925-f901-4a1d-907f-89bbb19ebfdd tempest-MigrationsAdminTest-1330282624 tempest-MigrationsAdminTest-1330282624-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.020842 Aug 27 02:50:35.578734 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1076/2177] 10.222.0.70 () {58 vars in 1182 bytes} [Sat Aug 27 02:50:35 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:50:35.712906 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-188374c9-7fb1-4f78-bc12-457a3f98b642 tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:35.713586 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-188374c9-7fb1-4f78-bc12-457a3f98b642 tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] [instance: 14df3dce-7fb6-491c-9559-6fbca68580b0] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:35.721882 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-188374c9-7fb1-4f78-bc12-457a3f98b642 tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:35.722375 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-188374c9-7fb1-4f78-bc12-457a3f98b642 tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:35.722816 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-188374c9-7fb1-4f78-bc12-457a3f98b642 tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:35.723569 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-188374c9-7fb1-4f78-bc12-457a3f98b642 tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:35.724019 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-188374c9-7fb1-4f78-bc12-457a3f98b642 tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:35.748001 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-188374c9-7fb1-4f78-bc12-457a3f98b642 tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:36.469863 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-5d3f621e-f403-41ad-bd64-4b3cd84c621e tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] 10.222.0.70 "DELETE /compute/v2.1/os-floating-ips/20bca687-6bcf-4135-ab11-84d2fb78a9ca" status: 202 len: 0 microversion: 2.1 time: 5.320877 Aug 27 02:50:36.470475 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1102/2178] 10.222.0.70 () {58 vars in 1263 bytes} [Sat Aug 27 02:50:31 2022] DELETE /compute/v2.1/os-floating-ips/20bca687-6bcf-4135-ab11-84d2fb78a9ca => generated 0 bytes in 5322 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:50:36.476127 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-de01d30a-7343-4b1b-b2a1-e1c73ec3fc93 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1136271517", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "73af9b1d-3c67-43df-9c7c-648e48a6eacb"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:50:36.498427 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:50:36.603554 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.network.neutron [None req-de01d30a-7343-4b1b-b2a1-e1c73ec3fc93 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] validate_networks() for None {{(pid=134052) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:50:36.730994 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-188374c9-7fb1-4f78-bc12-457a3f98b642 tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c5ce6f32ec4c979dda7ead8962a1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76872eddea474d77850d528d56120b3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:36.747610 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-188374c9-7fb1-4f78-bc12-457a3f98b642 tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] 10.222.0.70 "GET /compute/v2.1/servers/14df3dce-7fb6-491c-9559-6fbca68580b0" status: 200 len: 1664 microversion: 2.1 time: 1.043956 Aug 27 02:50:36.748838 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1077/2179] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:35 2022] GET /compute/v2.1/servers/14df3dce-7fb6-491c-9559-6fbca68580b0 => generated 1664 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:50:36.769096 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a589f13f-4c77-4423-bab7-6aa1ce2520c3 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:36.769736 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-a589f13f-4c77-4423-bab7-6aa1ce2520c3 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: 24cefd05-8d3a-4813-af22-160658183e1b] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:36.789468 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a589f13f-4c77-4423-bab7-6aa1ce2520c3 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:36.790000 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a589f13f-4c77-4423-bab7-6aa1ce2520c3 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:36.791045 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a589f13f-4c77-4423-bab7-6aa1ce2520c3 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:36.793394 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a589f13f-4c77-4423-bab7-6aa1ce2520c3 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:36.794911 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a589f13f-4c77-4423-bab7-6aa1ce2520c3 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:36.795903 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a589f13f-4c77-4423-bab7-6aa1ce2520c3 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:37.172823 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-a589f13f-4c77-4423-bab7-6aa1ce2520c3 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:37.188780 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a589f13f-4c77-4423-bab7-6aa1ce2520c3 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/24cefd05-8d3a-4813-af22-160658183e1b" status: 200 len: 1273 microversion: 2.1 time: 0.436441 Aug 27 02:50:37.208563 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1078/2180] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:36 2022] GET /compute/v2.1/servers/24cefd05-8d3a-4813-af22-160658183e1b => generated 1273 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:50:37.220564 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-fc789af5-ec15-4eee-8901-20b25c2d90f3 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Action: 'action', calling method: .version_select at 0x7f5ee556b3a0>, body: {"removeFloatingIp": {"address": "172.25.0.85"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:50:38.045109 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-fc789af5-ec15-4eee-8901-20b25c2d90f3 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] [instance: 57a1e617-8846-4da8-b84f-232ffc519f69] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:38.058054 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fc789af5-ec15-4eee-8901-20b25c2d90f3 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:38.059388 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fc789af5-ec15-4eee-8901-20b25c2d90f3 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:38.060006 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fc789af5-ec15-4eee-8901-20b25c2d90f3 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:38.062103 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fc789af5-ec15-4eee-8901-20b25c2d90f3 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:38.063593 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fc789af5-ec15-4eee-8901-20b25c2d90f3 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:38.064366 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fc789af5-ec15-4eee-8901-20b25c2d90f3 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:38.085182 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-de01d30a-7343-4b1b-b2a1-e1c73ec3fc93 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Flavor limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:50:38.087461 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-de01d30a-7343-4b1b-b2a1-e1c73ec3fc93 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Image limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:50:38.091315 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-de01d30a-7343-4b1b-b2a1-e1c73ec3fc93 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Flavor pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:50:38.091979 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-de01d30a-7343-4b1b-b2a1-e1c73ec3fc93 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Image pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:50:38.095960 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-de01d30a-7343-4b1b-b2a1-e1c73ec3fc93 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:50:38.125916 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-de01d30a-7343-4b1b-b2a1-e1c73ec3fc93 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:38.126656 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-de01d30a-7343-4b1b-b2a1-e1c73ec3fc93 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:38.127903 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-de01d30a-7343-4b1b-b2a1-e1c73ec3fc93 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:38.128889 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-de01d30a-7343-4b1b-b2a1-e1c73ec3fc93 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:38.129348 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-de01d30a-7343-4b1b-b2a1-e1c73ec3fc93 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:38.130192 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-de01d30a-7343-4b1b-b2a1-e1c73ec3fc93 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:38.157944 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-de01d30a-7343-4b1b-b2a1-e1c73ec3fc93 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Getting quotas for project 937a5eeccaa7425ca72c8c74fb99f11a. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:50:38.188481 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-de01d30a-7343-4b1b-b2a1-e1c73ec3fc93 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Getting quotas for user 0b310e73ecd244d2938812d5be99558c and project 937a5eeccaa7425ca72c8c74fb99f11a. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:50:38.237197 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-de01d30a-7343-4b1b-b2a1-e1c73ec3fc93 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Going to run 1 instances... {{(pid=134052) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:50:38.246168 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-de01d30a-7343-4b1b-b2a1-e1c73ec3fc93 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: a4aca2ed-a835-4f8f-96ae-c3502645425a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134052) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:50:38.395713 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-de01d30a-7343-4b1b-b2a1-e1c73ec3fc93 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.923558 Aug 27 02:50:38.397489 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1103/2181] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 02:50:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1926 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:50:38.410589 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ecb93a53-869c-4b53-8177-1acfc81927f9 tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:38.412045 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-ecb93a53-869c-4b53-8177-1acfc81927f9 tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] [instance: 14df3dce-7fb6-491c-9559-6fbca68580b0] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:38.420985 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ecb93a53-869c-4b53-8177-1acfc81927f9 tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:38.422056 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ecb93a53-869c-4b53-8177-1acfc81927f9 tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:38.426060 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ecb93a53-869c-4b53-8177-1acfc81927f9 tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:38.450914 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ecb93a53-869c-4b53-8177-1acfc81927f9 tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:38.451834 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ecb93a53-869c-4b53-8177-1acfc81927f9 tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:38.452636 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ecb93a53-869c-4b53-8177-1acfc81927f9 tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:38.898136 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-ecb93a53-869c-4b53-8177-1acfc81927f9 tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c5ce6f32ec4c979dda7ead8962a1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76872eddea474d77850d528d56120b3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:38.920293 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ecb93a53-869c-4b53-8177-1acfc81927f9 tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] 10.222.0.70 "GET /compute/v2.1/servers/14df3dce-7fb6-491c-9559-6fbca68580b0" status: 200 len: 1596 microversion: 2.1 time: 0.521525 Aug 27 02:50:38.938430 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1104/2182] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:38 2022] GET /compute/v2.1/servers/14df3dce-7fb6-491c-9559-6fbca68580b0 => generated 1596 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:50:38.944862 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-96887d90-b186-44eb-9e39-61f46f350707 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:38.945838 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-96887d90-b186-44eb-9e39-61f46f350707 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: 24cefd05-8d3a-4813-af22-160658183e1b] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:38.956441 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-96887d90-b186-44eb-9e39-61f46f350707 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:38.958664 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-96887d90-b186-44eb-9e39-61f46f350707 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:38.959602 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-96887d90-b186-44eb-9e39-61f46f350707 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:38.960618 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-96887d90-b186-44eb-9e39-61f46f350707 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:38.961307 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-96887d90-b186-44eb-9e39-61f46f350707 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:38.961949 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-96887d90-b186-44eb-9e39-61f46f350707 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:39.383933 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fc789af5-ec15-4eee-8901-20b25c2d90f3 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Acquiring lock "refresh_cache-57a1e617-8846-4da8-b84f-232ffc519f69" {{(pid=134051) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 27 02:50:39.384900 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fc789af5-ec15-4eee-8901-20b25c2d90f3 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Acquired lock "refresh_cache-57a1e617-8846-4da8-b84f-232ffc519f69" {{(pid=134051) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 27 02:50:39.645809 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-96887d90-b186-44eb-9e39-61f46f350707 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:39.659500 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-96887d90-b186-44eb-9e39-61f46f350707 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/24cefd05-8d3a-4813-af22-160658183e1b" status: 200 len: 1315 microversion: 2.1 time: 0.719378 Aug 27 02:50:39.660960 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1105/2183] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:38 2022] GET /compute/v2.1/servers/24cefd05-8d3a-4813-af22-160658183e1b => generated 1315 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:50:39.667584 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0c3bda6a-72d6-483b-9c50-2a4c002715bc tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:39.669057 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-0c3bda6a-72d6-483b-9c50-2a4c002715bc tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: a4aca2ed-a835-4f8f-96ae-c3502645425a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:39.682289 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0c3bda6a-72d6-483b-9c50-2a4c002715bc tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:39.683255 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0c3bda6a-72d6-483b-9c50-2a4c002715bc tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:39.685230 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0c3bda6a-72d6-483b-9c50-2a4c002715bc tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:39.686331 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0c3bda6a-72d6-483b-9c50-2a4c002715bc tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:39.687049 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0c3bda6a-72d6-483b-9c50-2a4c002715bc tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:39.698687 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0c3bda6a-72d6-483b-9c50-2a4c002715bc tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:39.974296 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0c3bda6a-72d6-483b-9c50-2a4c002715bc tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:40.005463 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-0c3bda6a-72d6-483b-9c50-2a4c002715bc tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/a4aca2ed-a835-4f8f-96ae-c3502645425a" status: 200 len: 1331 microversion: 2.1 time: 0.342857 Aug 27 02:50:40.010175 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1106/2184] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:39 2022] GET /compute/v2.1/servers/a4aca2ed-a835-4f8f-96ae-c3502645425a => generated 1331 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:50:40.021937 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-95b0604b-d06b-4255-ad6f-a90064c673c4 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:40.030595 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-95b0604b-d06b-4255-ad6f-a90064c673c4 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] [instance: 484e03a9-aef3-4179-980c-0e7292a05b5a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:40.063444 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-95b0604b-d06b-4255-ad6f-a90064c673c4 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:40.066045 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-95b0604b-d06b-4255-ad6f-a90064c673c4 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:40.066746 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-95b0604b-d06b-4255-ad6f-a90064c673c4 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:40.069560 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-95b0604b-d06b-4255-ad6f-a90064c673c4 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:40.070882 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-95b0604b-d06b-4255-ad6f-a90064c673c4 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:40.076478 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-95b0604b-d06b-4255-ad6f-a90064c673c4 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:40.114612 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-95b0604b-d06b-4255-ad6f-a90064c673c4 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] HTTP exception thrown: Instance 484e03a9-aef3-4179-980c-0e7292a05b5a could not be found. Aug 27 02:50:40.117025 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-95b0604b-d06b-4255-ad6f-a90064c673c4 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Request method failure captured: Aug 27 02:50:40.117025 n-d-852278-4 devstack@n-api.service[134052]: request: DELETE /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a HTTP/1.1 Aug 27 02:50:40.117025 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:50:40.117025 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:50:40.117025 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:50:40.117025 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:50:40.117025 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:50:40.117025 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:50:40.117025 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:50:40.117025 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:50:40.117025 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYTp7V16ERwgojK6BvG52F-UUjor2emaXL5UiNwbTQOqgCbKUJn7U76g9bMykoF12gGYGWYbCCg6veGyQurkmZvYrJAF_yvWKgSs7Xn2Vb47ewIHMeFSAL6YoXL8IQvXirNN5Eq9yxZspt44Z-13_9Saj7KddNvbqEGAdU45TpdhvPU Aug 27 02:50:40.117025 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:50:40.117025 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:50:40.117025 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:50:40.117025 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:50:40.117025 n-d-852278-4 devstack@n-api.service[134052]: X-Openstack-Nova-Api-Version: 2.42 Aug 27 02:50:40.117025 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:50:40.117025 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:50:40.117025 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: ae35c895f49f4d31a4137dd3392f65bf Aug 27 02:50:40.117025 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-204109502 Aug 27 02:50:40.117025 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:50:40.117025 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:50:40.117025 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ae35c895f49f4d31a4137dd3392f65bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_ae35c895f49f4d31a4137dd3392f65bf", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ae35c895f49f4d31a4137dd3392f65bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/ae35c895f49f4d31a4137dd3392f65bf"}]}] Aug 27 02:50:40.117025 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-TaggedBootDevicesTest_v242-204109502 Aug 27 02:50:40.117025 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: ae35c895f49f4d31a4137dd3392f65bf Aug 27 02:50:40.117025 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-204109502 Aug 27 02:50:40.117025 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-TaggedBootDevicesTest_v242-204109502-project Aug 27 02:50:40.117025 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:50:40.117025 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:50:40.117025 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 585803c75b454475993d2189c88cc6d7 Aug 27 02:50:40.117025 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-TaggedBootDevicesTest_v242-204109502-project Aug 27 02:50:40.117025 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 02:50:40.117025 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance 484e03a9-aef3-4179-980c-0e7292a05b5a could not be found. Aug 27 02:50:40.117025 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '484e03a9-aef3-4179-980c-0e7292a05b5a'} Aug 27 02:50:40.117025 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:50:40.117025 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:40.117025 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:50:40.117025 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:50:40.117025 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:50:40.117025 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:50:40.117025 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:50:40.117025 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:50:40.117025 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:50:40.117025 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:50:40.117025 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 484e03a9-aef3-4179-980c-0e7292a05b5a could not be found. Aug 27 02:50:40.117025 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:50:40.117025 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:50:40.117025 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:50:40.117025 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:40.117025 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:50:40.117025 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:50:40.117025 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:50:40.117025 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:50:40.117025 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:50:40.117025 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:50:40.117025 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 02:50:40.117025 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 02:50:40.117025 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 02:50:40.117025 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 02:50:40.117025 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:50:40.117025 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:50:40.117025 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:50:40.117025 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:50:40.120951 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 484e03a9-aef3-4179-980c-0e7292a05b5a could not be found. Aug 27 02:50:40.120951 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:50:40.120951 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:50:40.120951 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:50:40.120951 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:40.120951 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:50:40.120951 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:50:40.120951 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:50:40.120951 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:50:40.120951 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 484e03a9-aef3-4179-980c-0e7292a05b5a could not be found. Aug 27 02:50:40.120951 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:50:40.125235 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-95b0604b-d06b-4255-ad6f-a90064c673c4 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Returning 404 to user: Instance 484e03a9-aef3-4179-980c-0e7292a05b5a could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:50:40.126496 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-95b0604b-d06b-4255-ad6f-a90064c673c4 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] 10.222.0.70 "DELETE /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a" status: 404 len: 111 microversion: 2.42 time: 0.114748 Aug 27 02:50:40.133442 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1107/2185] 10.222.0.70 () {60 vars in 1280 bytes} [Sat Aug 27 02:50:40 2022] DELETE /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 02:50:40.142061 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-584dfaad-a603-4805-918a-7b758066ba36 req-62e769dc-ed57-4ab0-934a-f778ab33753b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24cefd05-8d3a-4813-af22-160658183e1b", "tag": "2c230c5a-70ca-4e66-9b32-f703ed94751e"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:50:40.162177 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-584dfaad-a603-4805-918a-7b758066ba36 req-62e769dc-ed57-4ab0-934a-f778ab33753b service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:40.163080 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-584dfaad-a603-4805-918a-7b758066ba36 req-62e769dc-ed57-4ab0-934a-f778ab33753b service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:40.163868 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-584dfaad-a603-4805-918a-7b758066ba36 req-62e769dc-ed57-4ab0-934a-f778ab33753b service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:40.199800 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-584dfaad-a603-4805-918a-7b758066ba36 req-62e769dc-ed57-4ab0-934a-f778ab33753b service nova] Creating event network-changed:2c230c5a-70ca-4e66-9b32-f703ed94751e for instance 24cefd05-8d3a-4813-af22-160658183e1b on n-h1-852278-4 Aug 27 02:50:40.218116 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-584dfaad-a603-4805-918a-7b758066ba36 req-62e769dc-ed57-4ab0-934a-f778ab33753b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081608 Aug 27 02:50:40.221503 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1108/2186] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:50:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:50:40.401273 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-f7c4b37c-8d6e-43e7-a882-94d2290a1e1c req-25fa9701-3724-47b4-88db-e10451f8a353 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14df3dce-7fb6-491c-9559-6fbca68580b0", "name": "network-vif-deleted", "tag": "7484d94b-dbe7-4864-b57a-8baf10193a92"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:50:40.426217 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-f7c4b37c-8d6e-43e7-a882-94d2290a1e1c req-25fa9701-3724-47b4-88db-e10451f8a353 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:40.426768 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-f7c4b37c-8d6e-43e7-a882-94d2290a1e1c req-25fa9701-3724-47b4-88db-e10451f8a353 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:40.427198 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-f7c4b37c-8d6e-43e7-a882-94d2290a1e1c req-25fa9701-3724-47b4-88db-e10451f8a353 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:40.457939 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-f7c4b37c-8d6e-43e7-a882-94d2290a1e1c req-25fa9701-3724-47b4-88db-e10451f8a353 service nova] Creating event network-vif-deleted:7484d94b-dbe7-4864-b57a-8baf10193a92 for instance 14df3dce-7fb6-491c-9559-6fbca68580b0 on n-h2-852278-4 Aug 27 02:50:40.470558 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-f7c4b37c-8d6e-43e7-a882-94d2290a1e1c req-25fa9701-3724-47b4-88db-e10451f8a353 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.247357 Aug 27 02:50:40.471180 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1109/2187] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:50:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:50:40.486363 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-7e5e0898-50d1-4b25-8e0b-6197602c2b5d tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:40.487192 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-7e5e0898-50d1-4b25-8e0b-6197602c2b5d tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] [instance: 14df3dce-7fb6-491c-9559-6fbca68580b0] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:40.507760 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7e5e0898-50d1-4b25-8e0b-6197602c2b5d tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:40.508259 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7e5e0898-50d1-4b25-8e0b-6197602c2b5d tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:40.508715 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7e5e0898-50d1-4b25-8e0b-6197602c2b5d tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:40.511047 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7e5e0898-50d1-4b25-8e0b-6197602c2b5d tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:40.511518 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7e5e0898-50d1-4b25-8e0b-6197602c2b5d tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:40.511941 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7e5e0898-50d1-4b25-8e0b-6197602c2b5d tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:40.593170 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7e5e0898-50d1-4b25-8e0b-6197602c2b5d tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:40.593647 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7e5e0898-50d1-4b25-8e0b-6197602c2b5d tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:40.594073 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7e5e0898-50d1-4b25-8e0b-6197602c2b5d tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:40.594525 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.instance [None req-7e5e0898-50d1-4b25-8e0b-6197602c2b5d tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Lazy-loading 'fault' on Instance uuid 14df3dce-7fb6-491c-9559-6fbca68580b0 {{(pid=134052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:50:40.792290 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-7e5e0898-50d1-4b25-8e0b-6197602c2b5d tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c5ce6f32ec4c979dda7ead8962a1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76872eddea474d77850d528d56120b3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:40.802901 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-7e5e0898-50d1-4b25-8e0b-6197602c2b5d tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] 10.222.0.70 "GET /compute/v2.1/servers/14df3dce-7fb6-491c-9559-6fbca68580b0" status: 200 len: 1314 microversion: 2.1 time: 0.330490 Aug 27 02:50:40.806766 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1110/2188] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:40 2022] GET /compute/v2.1/servers/14df3dce-7fb6-491c-9559-6fbca68580b0 => generated 1314 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:50:40.813831 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-1726a4cc-cf93-4c5d-9058-80caeed31a85 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:40.822074 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-1726a4cc-cf93-4c5d-9058-80caeed31a85 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] [instance: 484e03a9-aef3-4179-980c-0e7292a05b5a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:40.835182 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1726a4cc-cf93-4c5d-9058-80caeed31a85 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:40.838569 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1726a4cc-cf93-4c5d-9058-80caeed31a85 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:40.839214 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1726a4cc-cf93-4c5d-9058-80caeed31a85 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:40.840033 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1726a4cc-cf93-4c5d-9058-80caeed31a85 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:40.840521 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1726a4cc-cf93-4c5d-9058-80caeed31a85 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:40.847165 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1726a4cc-cf93-4c5d-9058-80caeed31a85 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:40.872994 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-1726a4cc-cf93-4c5d-9058-80caeed31a85 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] HTTP exception thrown: Instance 484e03a9-aef3-4179-980c-0e7292a05b5a could not be found. Aug 27 02:50:40.875027 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-1726a4cc-cf93-4c5d-9058-80caeed31a85 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Request method failure captured: Aug 27 02:50:40.875027 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a HTTP/1.1 Aug 27 02:50:40.875027 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:50:40.875027 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:50:40.875027 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:50:40.875027 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:50:40.875027 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:50:40.875027 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:50:40.875027 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:50:40.875027 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:50:40.875027 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYTp7V16ERwgojK6BvG52F-UUjor2emaXL5UiNwbTQOqgCbKUJn7U76g9bMykoF12gGYGWYbCCg6veGyQurkmZvYrJAF_yvWKgSs7Xn2Vb47ewIHMeFSAL6YoXL8IQvXirNN5Eq9yxZspt44Z-13_9Saj7KddNvbqEGAdU45TpdhvPU Aug 27 02:50:40.875027 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:50:40.875027 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:50:40.875027 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:50:40.875027 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:50:40.875027 n-d-852278-4 devstack@n-api.service[134052]: X-Openstack-Nova-Api-Version: 2.42 Aug 27 02:50:40.875027 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:50:40.875027 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:50:40.875027 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: ae35c895f49f4d31a4137dd3392f65bf Aug 27 02:50:40.875027 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-204109502 Aug 27 02:50:40.875027 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:50:40.875027 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:50:40.875027 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ae35c895f49f4d31a4137dd3392f65bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_ae35c895f49f4d31a4137dd3392f65bf", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ae35c895f49f4d31a4137dd3392f65bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/ae35c895f49f4d31a4137dd3392f65bf"}]}] Aug 27 02:50:40.875027 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-TaggedBootDevicesTest_v242-204109502 Aug 27 02:50:40.875027 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: ae35c895f49f4d31a4137dd3392f65bf Aug 27 02:50:40.875027 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-204109502 Aug 27 02:50:40.875027 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-TaggedBootDevicesTest_v242-204109502-project Aug 27 02:50:40.875027 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:50:40.875027 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:50:40.875027 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 585803c75b454475993d2189c88cc6d7 Aug 27 02:50:40.875027 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-TaggedBootDevicesTest_v242-204109502-project Aug 27 02:50:40.875027 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 02:50:40.875027 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance 484e03a9-aef3-4179-980c-0e7292a05b5a could not be found. Aug 27 02:50:40.875027 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '484e03a9-aef3-4179-980c-0e7292a05b5a'} Aug 27 02:50:40.875027 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:50:40.875027 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:40.875027 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:50:40.875027 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:50:40.875027 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:50:40.875027 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:50:40.875027 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:50:40.875027 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:50:40.875027 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:50:40.875027 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:50:40.875027 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 484e03a9-aef3-4179-980c-0e7292a05b5a could not be found. Aug 27 02:50:40.875027 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:50:40.875027 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:50:40.875027 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:50:40.875027 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:40.875027 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:50:40.875027 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:50:40.875027 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:50:40.875027 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:50:40.875027 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:50:40.875027 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:50:40.875027 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:50:40.875027 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:50:40.875027 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:50:40.875027 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:50:40.875027 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:50:40.875027 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:50:40.875027 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 484e03a9-aef3-4179-980c-0e7292a05b5a could not be found. Aug 27 02:50:40.875027 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:50:40.875027 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:50:40.880504 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:50:40.880504 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:40.880504 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:50:40.880504 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:50:40.880504 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:50:40.880504 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:50:40.880504 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 484e03a9-aef3-4179-980c-0e7292a05b5a could not be found. Aug 27 02:50:40.880504 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:50:40.880504 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-1726a4cc-cf93-4c5d-9058-80caeed31a85 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] Returning 404 to user: Instance 484e03a9-aef3-4179-980c-0e7292a05b5a could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:50:40.880504 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-1726a4cc-cf93-4c5d-9058-80caeed31a85 tempest-TaggedBootDevicesTest_v242-204109502 tempest-TaggedBootDevicesTest_v242-204109502-project] 10.222.0.70 "GET /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a" status: 404 len: 111 microversion: 2.42 time: 0.068138 Aug 27 02:50:40.885229 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1111/2189] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:50:40 2022] GET /compute/v2.1/servers/484e03a9-aef3-4179-980c-0e7292a05b5a => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 02:50:40.893562 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-118f8b50-2f40-4b0d-be8a-2269916bf574 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:40.896018 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-118f8b50-2f40-4b0d-be8a-2269916bf574 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: 24cefd05-8d3a-4813-af22-160658183e1b] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:40.908733 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-118f8b50-2f40-4b0d-be8a-2269916bf574 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:40.911576 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-118f8b50-2f40-4b0d-be8a-2269916bf574 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:40.912204 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-118f8b50-2f40-4b0d-be8a-2269916bf574 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:40.913119 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-118f8b50-2f40-4b0d-be8a-2269916bf574 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:40.915770 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-118f8b50-2f40-4b0d-be8a-2269916bf574 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:40.916407 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-118f8b50-2f40-4b0d-be8a-2269916bf574 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:41.248214 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:50:42.149868 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-118f8b50-2f40-4b0d-be8a-2269916bf574 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:42.167369 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-118f8b50-2f40-4b0d-be8a-2269916bf574 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/24cefd05-8d3a-4813-af22-160658183e1b" status: 200 len: 1315 microversion: 2.1 time: 1.280868 Aug 27 02:50:42.181108 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1112/2190] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:40 2022] GET /compute/v2.1/servers/24cefd05-8d3a-4813-af22-160658183e1b => generated 1315 bytes in 1295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:50:42.191262 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-18743791-999c-4672-a3dd-28b7f7341c6c tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:42.199828 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-18743791-999c-4672-a3dd-28b7f7341c6c tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: a4aca2ed-a835-4f8f-96ae-c3502645425a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:42.216721 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-18743791-999c-4672-a3dd-28b7f7341c6c tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:42.221182 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-18743791-999c-4672-a3dd-28b7f7341c6c tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:42.221955 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-18743791-999c-4672-a3dd-28b7f7341c6c tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:42.222950 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-18743791-999c-4672-a3dd-28b7f7341c6c tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:42.223536 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-18743791-999c-4672-a3dd-28b7f7341c6c tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:42.225810 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-18743791-999c-4672-a3dd-28b7f7341c6c tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:42.357445 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-18743791-999c-4672-a3dd-28b7f7341c6c tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:42.366308 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-18743791-999c-4672-a3dd-28b7f7341c6c tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/a4aca2ed-a835-4f8f-96ae-c3502645425a" status: 200 len: 1337 microversion: 2.1 time: 0.183890 Aug 27 02:50:42.388795 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1113/2191] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:42 2022] GET /compute/v2.1/servers/a4aca2ed-a835-4f8f-96ae-c3502645425a => generated 1337 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:50:42.394548 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-15eb00b3-8c9e-4fbd-bb36-d52d58c8ac5b tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:42.395318 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-15eb00b3-8c9e-4fbd-bb36-d52d58c8ac5b tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] [instance: 14df3dce-7fb6-491c-9559-6fbca68580b0] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:42.402132 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-15eb00b3-8c9e-4fbd-bb36-d52d58c8ac5b tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:42.402741 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-15eb00b3-8c9e-4fbd-bb36-d52d58c8ac5b tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:42.403296 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-15eb00b3-8c9e-4fbd-bb36-d52d58c8ac5b tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:42.404216 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-15eb00b3-8c9e-4fbd-bb36-d52d58c8ac5b tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:42.404900 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-15eb00b3-8c9e-4fbd-bb36-d52d58c8ac5b tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:42.405325 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-15eb00b3-8c9e-4fbd-bb36-d52d58c8ac5b tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:42.419910 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-15eb00b3-8c9e-4fbd-bb36-d52d58c8ac5b tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] HTTP exception thrown: Instance 14df3dce-7fb6-491c-9559-6fbca68580b0 could not be found. Aug 27 02:50:42.421511 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-15eb00b3-8c9e-4fbd-bb36-d52d58c8ac5b tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Request method failure captured: Aug 27 02:50:42.421511 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/servers/14df3dce-7fb6-491c-9559-6fbca68580b0 HTTP/1.1 Aug 27 02:50:42.421511 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:50:42.421511 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:50:42.421511 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:50:42.421511 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:50:42.421511 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:50:42.421511 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:50:42.421511 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:50:42.421511 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:50:42.421511 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYYrcNpy6PyblI5WHEOQiGR96upUtcocpPTX1Vbvudu5gUROCgo2KvIwBBj9N4YiZ30ev6ZKmkh2oLUiQhFoy44vFxl5UNe77hL6Rafadmq0z_FIjRwUrkbrK1sjIjFPKuQvYcdJsG98uC4e2enimYs5TwuVmbBSmGzYKO8n876-1xU Aug 27 02:50:42.421511 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:50:42.421511 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:50:42.421511 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:50:42.421511 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:50:42.421511 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:50:42.421511 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:50:42.421511 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 76872eddea474d77850d528d56120b3d Aug 27 02:50:42.421511 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ServersTestFqdnHostnames-499239213 Aug 27 02:50:42.421511 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:50:42.421511 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:50:42.421511 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/76872eddea474d77850d528d56120b3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_76872eddea474d77850d528d56120b3d", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/76872eddea474d77850d528d56120b3d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/76872eddea474d77850d528d56120b3d"}]}] Aug 27 02:50:42.421511 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ServersTestFqdnHostnames-499239213 Aug 27 02:50:42.421511 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 76872eddea474d77850d528d56120b3d Aug 27 02:50:42.421511 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-499239213 Aug 27 02:50:42.421511 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ServersTestFqdnHostnames-499239213-project Aug 27 02:50:42.421511 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:50:42.421511 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:50:42.421511 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 70c5ce6f32ec4c979dda7ead8962a1fe Aug 27 02:50:42.421511 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ServersTestFqdnHostnames-499239213-project Aug 27 02:50:42.421511 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 02:50:42.421511 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance 14df3dce-7fb6-491c-9559-6fbca68580b0 could not be found. Aug 27 02:50:42.421511 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '14df3dce-7fb6-491c-9559-6fbca68580b0'} Aug 27 02:50:42.421511 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:50:42.421511 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:42.421511 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:50:42.421511 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:50:42.421511 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:50:42.421511 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:50:42.421511 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:50:42.421511 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:50:42.421511 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:50:42.421511 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:50:42.421511 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14df3dce-7fb6-491c-9559-6fbca68580b0 could not be found. Aug 27 02:50:42.421511 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:50:42.421511 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:50:42.421511 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:50:42.421511 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:42.421511 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:50:42.421511 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:50:42.421511 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:50:42.421511 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:50:42.421511 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:50:42.421511 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:50:42.421511 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:50:42.421511 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:50:42.421511 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:50:42.421511 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:50:42.421511 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:50:42.421511 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:50:42.421511 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14df3dce-7fb6-491c-9559-6fbca68580b0 could not be found. Aug 27 02:50:42.421511 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:50:42.421511 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:50:42.421511 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:50:42.426228 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:42.426228 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:50:42.426228 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:50:42.426228 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:50:42.426228 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:50:42.426228 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14df3dce-7fb6-491c-9559-6fbca68580b0 could not be found. Aug 27 02:50:42.426228 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:50:42.426228 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-15eb00b3-8c9e-4fbd-bb36-d52d58c8ac5b tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Returning 404 to user: Instance 14df3dce-7fb6-491c-9559-6fbca68580b0 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:50:42.426228 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-15eb00b3-8c9e-4fbd-bb36-d52d58c8ac5b tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] 10.222.0.70 "GET /compute/v2.1/servers/14df3dce-7fb6-491c-9559-6fbca68580b0" status: 404 len: 111 microversion: 2.1 time: 0.032558 Aug 27 02:50:42.427171 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1114/2192] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:42 2022] GET /compute/v2.1/servers/14df3dce-7fb6-491c-9559-6fbca68580b0 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:50:42.432211 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-098f3752-7781-4563-83d2-add833eb88dd tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] Calling method '.version_select at 0x7f5ee38099d0>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:42.462558 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-098f3752-7781-4563-83d2-add833eb88dd tempest-ServersTestFqdnHostnames-499239213 tempest-ServersTestFqdnHostnames-499239213-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-43036546" status: 202 len: 0 microversion: 2.1 time: 0.033001 Aug 27 02:50:42.467287 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1115/2193] 10.222.0.70 () {58 vars in 1215 bytes} [Sat Aug 27 02:50:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-43036546 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:50:43.020292 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.network.neutron [None req-fc789af5-ec15-4eee-8901-20b25c2d90f3 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] [instance: 57a1e617-8846-4da8-b84f-232ffc519f69] Building network info cache for instance {{(pid=134051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 27 02:50:43.023235 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:SELECT=95,nova_cell1:INSERT=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:50:43.043583 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-4be01a12-85f3-4d71-874e-702cffb5758e req-46a5c89c-58aa-404b-86e4-c674e1c8127d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57a1e617-8846-4da8-b84f-232ffc519f69", "tag": "f1fc64b5-9211-456f-b514-94d86ae29282"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:50:43.074150 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-4be01a12-85f3-4d71-874e-702cffb5758e req-46a5c89c-58aa-404b-86e4-c674e1c8127d service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:43.074661 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-4be01a12-85f3-4d71-874e-702cffb5758e req-46a5c89c-58aa-404b-86e4-c674e1c8127d service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:43.075107 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-4be01a12-85f3-4d71-874e-702cffb5758e req-46a5c89c-58aa-404b-86e4-c674e1c8127d service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:43.118118 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-4be01a12-85f3-4d71-874e-702cffb5758e req-46a5c89c-58aa-404b-86e4-c674e1c8127d service nova] Creating event network-changed:f1fc64b5-9211-456f-b514-94d86ae29282 for instance 57a1e617-8846-4da8-b84f-232ffc519f69 on n-h2-852278-4 Aug 27 02:50:43.138408 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-4be01a12-85f3-4d71-874e-702cffb5758e req-46a5c89c-58aa-404b-86e4-c674e1c8127d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097873 Aug 27 02:50:43.145235 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1116/2194] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:50:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:50:43.196646 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0c155fdb-cdd7-48fe-b6ab-75cfd3f24d35 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:43.199898 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-0c155fdb-cdd7-48fe-b6ab-75cfd3f24d35 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: 24cefd05-8d3a-4813-af22-160658183e1b] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:43.212492 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0c155fdb-cdd7-48fe-b6ab-75cfd3f24d35 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:43.213261 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0c155fdb-cdd7-48fe-b6ab-75cfd3f24d35 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:43.213863 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0c155fdb-cdd7-48fe-b6ab-75cfd3f24d35 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:43.214758 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0c155fdb-cdd7-48fe-b6ab-75cfd3f24d35 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:43.215354 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0c155fdb-cdd7-48fe-b6ab-75cfd3f24d35 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:43.215921 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0c155fdb-cdd7-48fe-b6ab-75cfd3f24d35 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:43.567345 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=12 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:50:44.801984 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0c155fdb-cdd7-48fe-b6ab-75cfd3f24d35 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:44.819272 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-0c155fdb-cdd7-48fe-b6ab-75cfd3f24d35 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/24cefd05-8d3a-4813-af22-160658183e1b" status: 200 len: 1315 microversion: 2.1 time: 1.629862 Aug 27 02:50:44.819830 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1117/2195] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:43 2022] GET /compute/v2.1/servers/24cefd05-8d3a-4813-af22-160658183e1b => generated 1315 bytes in 1632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:50:44.846428 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c27e54e8-eb70-425f-a75b-7250219a600e tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:44.847296 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-c27e54e8-eb70-425f-a75b-7250219a600e tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: a4aca2ed-a835-4f8f-96ae-c3502645425a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:44.866284 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c27e54e8-eb70-425f-a75b-7250219a600e tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:44.867111 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c27e54e8-eb70-425f-a75b-7250219a600e tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:44.868529 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c27e54e8-eb70-425f-a75b-7250219a600e tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:44.869993 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c27e54e8-eb70-425f-a75b-7250219a600e tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:44.870768 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c27e54e8-eb70-425f-a75b-7250219a600e tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:44.871373 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c27e54e8-eb70-425f-a75b-7250219a600e tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:46.092836 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-c27e54e8-eb70-425f-a75b-7250219a600e tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:46.106744 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c27e54e8-eb70-425f-a75b-7250219a600e tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/a4aca2ed-a835-4f8f-96ae-c3502645425a" status: 200 len: 1379 microversion: 2.1 time: 1.264823 Aug 27 02:50:46.107823 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1118/2196] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:44 2022] GET /compute/v2.1/servers/a4aca2ed-a835-4f8f-96ae-c3502645425a => generated 1379 bytes in 1287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:50:46.128382 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-996929e2-e862-4b53-b9ec-7f417aa786f1 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1723845031", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7532a923-41df-4761-8077-055e309eff44"}], "security_groups": [{"name": "tempest-securitygroup--84457800"}], "key_name": "tempest-keypair-370147892", "user_data": "}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:50:46.591278 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.network.neutron [None req-996929e2-e862-4b53-b9ec-7f417aa786f1 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] validate_networks() for [('7532a923-41df-4761-8077-055e309eff44', None, None, None, None, None)] {{(pid=134052) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:50:47.272144 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.network.neutron [None req-fc789af5-ec15-4eee-8901-20b25c2d90f3 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] [instance: 57a1e617-8846-4da8-b84f-232ffc519f69] Updating instance_info_cache with network_info: [{"id": "f1fc64b5-9211-456f-b514-94d86ae29282", "address": "fa:16:3e:3e:64:6b", "network": {"id": "cec1f1c8-ede6-4fbf-a6be-be33cc79bfe7", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-178782255-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "2c13c5aeb4da472da020639d5b6ad5aa", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapf1fc64b5-92", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=134051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 27 02:50:47.291121 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fc789af5-ec15-4eee-8901-20b25c2d90f3 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Releasing lock "refresh_cache-57a1e617-8846-4da8-b84f-232ffc519f69" {{(pid=134051) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 27 02:50:47.292625 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-fc789af5-ec15-4eee-8901-20b25c2d90f3 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] 10.222.0.70 "POST /compute/v2.1/servers/57a1e617-8846-4da8-b84f-232ffc519f69/action" status: 202 len: 0 microversion: 2.1 time: 10.082352 Aug 27 02:50:47.294370 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1079/2197] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 02:50:37 2022] POST /compute/v2.1/servers/57a1e617-8846-4da8-b84f-232ffc519f69/action => generated 0 bytes in 10085 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 27 02:50:47.310697 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4676e035-f3d2-4b9c-82cd-1c825e02e075 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:47.311510 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-4676e035-f3d2-4b9c-82cd-1c825e02e075 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: 24cefd05-8d3a-4813-af22-160658183e1b] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:47.324910 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4676e035-f3d2-4b9c-82cd-1c825e02e075 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:47.326752 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4676e035-f3d2-4b9c-82cd-1c825e02e075 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:47.327419 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4676e035-f3d2-4b9c-82cd-1c825e02e075 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:47.337520 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4676e035-f3d2-4b9c-82cd-1c825e02e075 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:47.338382 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4676e035-f3d2-4b9c-82cd-1c825e02e075 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:47.339202 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4676e035-f3d2-4b9c-82cd-1c825e02e075 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:48.143692 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:50:48.212692 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=10 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:50:48.325425 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-4676e035-f3d2-4b9c-82cd-1c825e02e075 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:48.340184 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-4676e035-f3d2-4b9c-82cd-1c825e02e075 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/24cefd05-8d3a-4813-af22-160658183e1b" status: 200 len: 1315 microversion: 2.1 time: 1.043891 Aug 27 02:50:48.340827 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1080/2198] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:47 2022] GET /compute/v2.1/servers/24cefd05-8d3a-4813-af22-160658183e1b => generated 1315 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:50:48.424024 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-996929e2-e862-4b53-b9ec-7f417aa786f1 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Flavor limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:50:48.424531 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-996929e2-e862-4b53-b9ec-7f417aa786f1 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Image limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:50:48.425143 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-996929e2-e862-4b53-b9ec-7f417aa786f1 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Flavor pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:50:48.425611 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-996929e2-e862-4b53-b9ec-7f417aa786f1 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Image pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:50:48.426331 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-996929e2-e862-4b53-b9ec-7f417aa786f1 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:50:48.457761 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-996929e2-e862-4b53-b9ec-7f417aa786f1 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:48.460322 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-996929e2-e862-4b53-b9ec-7f417aa786f1 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:48.461820 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-996929e2-e862-4b53-b9ec-7f417aa786f1 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:48.462640 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-996929e2-e862-4b53-b9ec-7f417aa786f1 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:48.463103 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-996929e2-e862-4b53-b9ec-7f417aa786f1 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:48.471136 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-996929e2-e862-4b53-b9ec-7f417aa786f1 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:48.514946 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-996929e2-e862-4b53-b9ec-7f417aa786f1 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Getting quotas for project 952767db5f394fc4bf01c0efd65f2fb9. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:50:48.515300 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-c0ed1ffa-746a-4a49-8079-53092b9c0540 req-6c6a071f-16c6-480c-9f86-7e1d89347d76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24cefd05-8d3a-4813-af22-160658183e1b", "name": "network-vif-plugged", "status": "completed", "tag": "2c230c5a-70ca-4e66-9b32-f703ed94751e"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:50:48.521067 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-996929e2-e862-4b53-b9ec-7f417aa786f1 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Getting quotas for user c850bda78e664117b671910c0e68bfb9 and project 952767db5f394fc4bf01c0efd65f2fb9. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:50:48.537466 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-c0ed1ffa-746a-4a49-8079-53092b9c0540 req-6c6a071f-16c6-480c-9f86-7e1d89347d76 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:48.538343 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-c0ed1ffa-746a-4a49-8079-53092b9c0540 req-6c6a071f-16c6-480c-9f86-7e1d89347d76 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:48.538804 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-c0ed1ffa-746a-4a49-8079-53092b9c0540 req-6c6a071f-16c6-480c-9f86-7e1d89347d76 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:48.542138 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-996929e2-e862-4b53-b9ec-7f417aa786f1 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Going to run 1 instances... {{(pid=134052) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:50:48.544693 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-996929e2-e862-4b53-b9ec-7f417aa786f1 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134052) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:50:48.569694 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-c0ed1ffa-746a-4a49-8079-53092b9c0540 req-6c6a071f-16c6-480c-9f86-7e1d89347d76 service nova] Creating event network-vif-plugged:2c230c5a-70ca-4e66-9b32-f703ed94751e for instance 24cefd05-8d3a-4813-af22-160658183e1b on n-h1-852278-4 Aug 27 02:50:48.589365 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-c0ed1ffa-746a-4a49-8079-53092b9c0540 req-6c6a071f-16c6-480c-9f86-7e1d89347d76 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.235402 Aug 27 02:50:48.593316 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1081/2199] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:50:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:50:48.608615 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d766d4e3-8e3a-4ee0-8e53-afeb88e664dd tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:48.611158 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d766d4e3-8e3a-4ee0-8e53-afeb88e664dd tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: a4aca2ed-a835-4f8f-96ae-c3502645425a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:48.627541 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d766d4e3-8e3a-4ee0-8e53-afeb88e664dd tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:48.641647 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-996929e2-e862-4b53-b9ec-7f417aa786f1 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 2.526391 Aug 27 02:50:48.642275 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d766d4e3-8e3a-4ee0-8e53-afeb88e664dd tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:48.642740 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d766d4e3-8e3a-4ee0-8e53-afeb88e664dd tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:48.643524 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d766d4e3-8e3a-4ee0-8e53-afeb88e664dd tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:48.643984 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d766d4e3-8e3a-4ee0-8e53-afeb88e664dd tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:48.644445 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d766d4e3-8e3a-4ee0-8e53-afeb88e664dd tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:48.651390 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1119/2200] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 02:50:46 2022] POST /compute/v2.1/servers => generated 407 bytes in 2543 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:50:48.662370 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-eb626d5c-9385-4512-88b1-8a35afacac2a tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Calling method '.version_select at 0x7f5ee719b280>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:50.042114 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d766d4e3-8e3a-4ee0-8e53-afeb88e664dd tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:50.050741 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d766d4e3-8e3a-4ee0-8e53-afeb88e664dd tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/a4aca2ed-a835-4f8f-96ae-c3502645425a" status: 200 len: 1379 microversion: 2.1 time: 1.455819 Aug 27 02:50:50.064451 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1082/2201] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:48 2022] GET /compute/v2.1/servers/a4aca2ed-a835-4f8f-96ae-c3502645425a => generated 1379 bytes in 1460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:50:50.069158 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-fef60809-3c8e-4317-b3e4-75a3ab7ed77e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:50.069791 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-fef60809-3c8e-4317-b3e4-75a3ab7ed77e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:50.079390 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:50:50.085935 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fef60809-3c8e-4317-b3e4-75a3ab7ed77e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:50.086443 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fef60809-3c8e-4317-b3e4-75a3ab7ed77e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:50.086913 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fef60809-3c8e-4317-b3e4-75a3ab7ed77e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:50.087884 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fef60809-3c8e-4317-b3e4-75a3ab7ed77e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:50.088388 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fef60809-3c8e-4317-b3e4-75a3ab7ed77e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:50.088827 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fef60809-3c8e-4317-b3e4-75a3ab7ed77e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:50.575394 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-fef60809-3c8e-4317-b3e4-75a3ab7ed77e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:50.619886 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-fef60809-3c8e-4317-b3e4-75a3ab7ed77e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1234 microversion: 2.1 time: 0.542259 Aug 27 02:50:50.622141 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1083/2202] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:50 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1234 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:50:50.634287 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-f619ea04-c2e7-411c-beb4-e420fcbfeb6a req-d01e7514-7d40-42f0-ad8d-505e4168f25c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4aca2ed-a835-4f8f-96ae-c3502645425a", "tag": "4f9042c6-628d-483c-88dc-649ec8de9f53"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:50:50.665920 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-f619ea04-c2e7-411c-beb4-e420fcbfeb6a req-d01e7514-7d40-42f0-ad8d-505e4168f25c service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:50.675060 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-f619ea04-c2e7-411c-beb4-e420fcbfeb6a req-d01e7514-7d40-42f0-ad8d-505e4168f25c service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:50.677470 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-f619ea04-c2e7-411c-beb4-e420fcbfeb6a req-d01e7514-7d40-42f0-ad8d-505e4168f25c service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:50.743381 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-f619ea04-c2e7-411c-beb4-e420fcbfeb6a req-d01e7514-7d40-42f0-ad8d-505e4168f25c service nova] Creating event network-changed:4f9042c6-628d-483c-88dc-649ec8de9f53 for instance a4aca2ed-a835-4f8f-96ae-c3502645425a on n-h2-852278-4 Aug 27 02:50:50.773376 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-f619ea04-c2e7-411c-beb4-e420fcbfeb6a req-d01e7514-7d40-42f0-ad8d-505e4168f25c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133233 Aug 27 02:50:50.782018 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1084/2203] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:50:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:50:50.816856 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3bc8ffdb-1766-48d1-a67d-6b590a585033 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:50.820443 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-3bc8ffdb-1766-48d1-a67d-6b590a585033 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: 24cefd05-8d3a-4813-af22-160658183e1b] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:50.846467 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3bc8ffdb-1766-48d1-a67d-6b590a585033 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:50.850121 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3bc8ffdb-1766-48d1-a67d-6b590a585033 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:50.850905 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3bc8ffdb-1766-48d1-a67d-6b590a585033 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:50.853061 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3bc8ffdb-1766-48d1-a67d-6b590a585033 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:50.854024 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3bc8ffdb-1766-48d1-a67d-6b590a585033 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:50.855038 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3bc8ffdb-1766-48d1-a67d-6b590a585033 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:51.183264 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-eb626d5c-9385-4512-88b1-8a35afacac2a tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] 10.222.0.70 "DELETE /compute/v2.1/os-floating-ips/a37c5f94-b1f7-4334-b077-ffa1ef5cd368" status: 202 len: 0 microversion: 2.1 time: 2.527567 Aug 27 02:50:51.184864 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1120/2204] 10.222.0.70 () {58 vars in 1263 bytes} [Sat Aug 27 02:50:48 2022] DELETE /compute/v2.1/os-floating-ips/a37c5f94-b1f7-4334-b077-ffa1ef5cd368 => generated 0 bytes in 2533 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:50:51.196766 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-1097d7a7-487c-476c-a9a4-a0957b028c50 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:51.197917 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-1097d7a7-487c-476c-a9a4-a0957b028c50 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: a4aca2ed-a835-4f8f-96ae-c3502645425a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:51.229867 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1097d7a7-487c-476c-a9a4-a0957b028c50 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:51.231653 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1097d7a7-487c-476c-a9a4-a0957b028c50 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:51.232918 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1097d7a7-487c-476c-a9a4-a0957b028c50 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:51.237590 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1097d7a7-487c-476c-a9a4-a0957b028c50 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:51.238854 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1097d7a7-487c-476c-a9a4-a0957b028c50 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:51.239794 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1097d7a7-487c-476c-a9a4-a0957b028c50 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:51.506897 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-3bc8ffdb-1766-48d1-a67d-6b590a585033 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:51.516004 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-3bc8ffdb-1766-48d1-a67d-6b590a585033 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/24cefd05-8d3a-4813-af22-160658183e1b" status: 200 len: 1501 microversion: 2.1 time: 0.732049 Aug 27 02:50:51.535103 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1085/2205] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:50 2022] GET /compute/v2.1/servers/24cefd05-8d3a-4813-af22-160658183e1b => generated 1501 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:50:51.547899 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a041bc42-e208-4246-a5e3-32a6f83379a9 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:50:51.555726 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a041bc42-e208-4246-a5e3-32a6f83379a9 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Request method failure captured: Aug 27 02:50:51.555726 n-d-852278-4 devstack@n-api.service[134051]: request: POST /compute/v2.1/servers/57a1e617-8846-4da8-b84f-232ffc519f69/action HTTP/1.1 Aug 27 02:50:51.555726 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:50:51.555726 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:50:51.555726 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:50:51.555726 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 34 Aug 27 02:50:51.555726 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:50:51.555726 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:50:51.555726 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:50:51.555726 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:50:51.555726 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYZBHK5lJQrdMj_AIzVz1BIf6TAv82YyeU0Mi4KNWaGZlnNvrahx2fCXt0F5D_IBmtIoOZ71FZ2QPJSr07MZuRSWSVJ8dVK-neCA_QCKq50hu1JadvwPdTgut4AoG_fqbxyQgshY-tQLo6U2vxcoxz_6g4r9JWKwF61goCkuWVmk8Rs Aug 27 02:50:51.555726 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:50:51.555726 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:50:51.555726 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:50:51.555726 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:50:51.555726 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:50:51.555726 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:50:51.555726 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 2c13c5aeb4da472da020639d5b6ad5aa Aug 27 02:50:51.555726 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-714154922 Aug 27 02:50:51.555726 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:50:51.555726 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:50:51.555726 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2c13c5aeb4da472da020639d5b6ad5aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_2c13c5aeb4da472da020639d5b6ad5aa", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2c13c5aeb4da472da020639d5b6ad5aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/2c13c5aeb4da472da020639d5b6ad5aa"}]}] Aug 27 02:50:51.555726 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-714154922 Aug 27 02:50:51.555726 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 2c13c5aeb4da472da020639d5b6ad5aa Aug 27 02:50:51.555726 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-714154922 Aug 27 02:50:51.555726 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project Aug 27 02:50:51.555726 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:50:51.555726 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:50:51.555726 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: ece67529f3704d9faf0ff443d7c016de Aug 27 02:50:51.555726 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project Aug 27 02:50:51.555726 n-d-852278-4 devstack@n-api.service[134051]: Aug 27 02:50:51.555726 n-d-852278-4 devstack@n-api.service[134051]: {"addFloatingIp": {"address": ""}} Aug 27 02:50:51.555726 n-d-852278-4 devstack@n-api.service[134051]: method: Aug 27 02:50:51.555726 n-d-852278-4 devstack@n-api.service[134051]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Aug 27 02:50:51.555726 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '57a1e617-8846-4da8-b84f-232ffc519f69', 'body': {'addFloatingIp': {'address': ''}}} Aug 27 02:50:51.555726 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:50:51.555726 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:51.555726 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 02:50:51.555726 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 02:50:51.555726 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 02:50:51.555726 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise error Aug 27 02:50:51.555726 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Aug 27 02:50:51.555726 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:50:51.555726 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Aug 27 02:50:51.555726 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Aug 27 02:50:51.555726 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:50:51.555726 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Aug 27 02:50:51.555726 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi '' Aug 27 02:50:51.555726 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:50:51.555726 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:50:51.555726 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:50:51.555726 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:51.555726 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:50:51.555726 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:50:51.555726 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:50:51.555726 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:50:51.555726 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:50:51.555726 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:50:51.555726 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:50:51.555726 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:50:51.555726 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 02:50:51.555726 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 02:50:51.555726 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 02:50:51.555726 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 02:50:51.555726 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 02:50:51.559668 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 02:50:51.559668 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Aug 27 02:50:51.559668 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:50:51.559668 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:50:51.559668 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:50:51.559668 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:51.559668 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:50:51.559668 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:50:51.559668 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 02:50:51.559668 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 02:50:51.559668 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Aug 27 02:50:51.559668 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:50:51.562164 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a041bc42-e208-4246-a5e3-32a6f83379a9 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:50:51.563456 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a041bc42-e208-4246-a5e3-32a6f83379a9 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] 10.222.0.70 "POST /compute/v2.1/servers/57a1e617-8846-4da8-b84f-232ffc519f69/action" status: 400 len: 142 microversion: 2.1 time: 0.025865 Aug 27 02:50:51.569875 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1086/2206] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 02:50:51 2022] POST /compute/v2.1/servers/57a1e617-8846-4da8-b84f-232ffc519f69/action => generated 142 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 02:50:51.588735 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-5917a156-3c85-456a-9dbb-93b8a5c78af0 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:51.589640 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-5917a156-3c85-456a-9dbb-93b8a5c78af0 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: 24cefd05-8d3a-4813-af22-160658183e1b] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:51.598753 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5917a156-3c85-456a-9dbb-93b8a5c78af0 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:51.599552 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5917a156-3c85-456a-9dbb-93b8a5c78af0 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:51.600240 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5917a156-3c85-456a-9dbb-93b8a5c78af0 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:51.601197 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5917a156-3c85-456a-9dbb-93b8a5c78af0 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:51.601847 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5917a156-3c85-456a-9dbb-93b8a5c78af0 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:51.602456 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5917a156-3c85-456a-9dbb-93b8a5c78af0 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:51.645090 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-5917a156-3c85-456a-9dbb-93b8a5c78af0 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: 24cefd05-8d3a-4813-af22-160658183e1b] Going to try to terminate instance {{(pid=134051) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:50:51.781068 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-1097d7a7-487c-476c-a9a4-a0957b028c50 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:51.785565 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-5917a156-3c85-456a-9dbb-93b8a5c78af0 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "DELETE /compute/v2.1/servers/24cefd05-8d3a-4813-af22-160658183e1b" status: 204 len: 0 microversion: 2.1 time: 0.209228 Aug 27 02:50:51.791685 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1087/2207] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:50:51 2022] DELETE /compute/v2.1/servers/24cefd05-8d3a-4813-af22-160658183e1b => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:50:51.792801 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-1097d7a7-487c-476c-a9a4-a0957b028c50 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/a4aca2ed-a835-4f8f-96ae-c3502645425a" status: 200 len: 1379 microversion: 2.1 time: 0.606571 Aug 27 02:50:51.794830 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1121/2208] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:51 2022] GET /compute/v2.1/servers/a4aca2ed-a835-4f8f-96ae-c3502645425a => generated 1379 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:50:51.823972 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5fc72dfc-c8be-47e7-856a-ea8ac4890a13 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:51.825788 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-5fc72dfc-c8be-47e7-856a-ea8ac4890a13 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:51.830622 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8c5f79db-2cae-4870-8dab-8b29e20b8dec tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:50:51.835685 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-8c5f79db-2cae-4870-8dab-8b29e20b8dec tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] [instance: 57a1e617-8846-4da8-b84f-232ffc519f69] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:51.843435 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5fc72dfc-c8be-47e7-856a-ea8ac4890a13 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:51.844202 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5fc72dfc-c8be-47e7-856a-ea8ac4890a13 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:51.845304 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5fc72dfc-c8be-47e7-856a-ea8ac4890a13 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:51.848823 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5fc72dfc-c8be-47e7-856a-ea8ac4890a13 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:51.849653 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5fc72dfc-c8be-47e7-856a-ea8ac4890a13 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:51.850264 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5fc72dfc-c8be-47e7-856a-ea8ac4890a13 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:51.850953 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8c5f79db-2cae-4870-8dab-8b29e20b8dec tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:51.852069 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8c5f79db-2cae-4870-8dab-8b29e20b8dec tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:51.853527 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8c5f79db-2cae-4870-8dab-8b29e20b8dec tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:51.855814 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8c5f79db-2cae-4870-8dab-8b29e20b8dec tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:51.857389 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8c5f79db-2cae-4870-8dab-8b29e20b8dec tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:51.859696 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8c5f79db-2cae-4870-8dab-8b29e20b8dec tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:51.917424 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8c5f79db-2cae-4870-8dab-8b29e20b8dec tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Acquiring lock "refresh_cache-57a1e617-8846-4da8-b84f-232ffc519f69" {{(pid=134051) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 27 02:50:51.917834 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8c5f79db-2cae-4870-8dab-8b29e20b8dec tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Acquired lock "refresh_cache-57a1e617-8846-4da8-b84f-232ffc519f69" {{(pid=134051) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 27 02:50:51.955835 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-5fc72dfc-c8be-47e7-856a-ea8ac4890a13 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:51.963277 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-5fc72dfc-c8be-47e7-856a-ea8ac4890a13 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1296 microversion: 2.1 time: 0.166184 Aug 27 02:50:51.972542 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1122/2209] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:51 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1296 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:50:51.976985 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-1361cdc5-e502-46be-aae4-949a2aa6dbc9 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:51.977980 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-1361cdc5-e502-46be-aae4-949a2aa6dbc9 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: 24cefd05-8d3a-4813-af22-160658183e1b] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:51.985987 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1361cdc5-e502-46be-aae4-949a2aa6dbc9 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:51.989247 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1361cdc5-e502-46be-aae4-949a2aa6dbc9 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:51.989909 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1361cdc5-e502-46be-aae4-949a2aa6dbc9 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:51.991002 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1361cdc5-e502-46be-aae4-949a2aa6dbc9 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:51.991478 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1361cdc5-e502-46be-aae4-949a2aa6dbc9 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:51.991912 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1361cdc5-e502-46be-aae4-949a2aa6dbc9 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:52.026147 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:50:52.060958 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8c5f79db-2cae-4870-8dab-8b29e20b8dec tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Releasing lock "refresh_cache-57a1e617-8846-4da8-b84f-232ffc519f69" {{(pid=134051) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 27 02:50:52.061991 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-8c5f79db-2cae-4870-8dab-8b29e20b8dec tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] HTTP exception thrown: floating IP not found Aug 27 02:50:52.065196 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8c5f79db-2cae-4870-8dab-8b29e20b8dec tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Request method failure captured: Aug 27 02:50:52.065196 n-d-852278-4 devstack@n-api.service[134051]: request: POST /compute/v2.1/servers/57a1e617-8846-4da8-b84f-232ffc519f69/action HTTP/1.1 Aug 27 02:50:52.065196 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:50:52.065196 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:50:52.065196 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:50:52.065196 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 41 Aug 27 02:50:52.065196 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:50:52.065196 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:50:52.065196 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:50:52.065196 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:50:52.065196 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYZBHK5lJQrdMj_AIzVz1BIf6TAv82YyeU0Mi4KNWaGZlnNvrahx2fCXt0F5D_IBmtIoOZ71FZ2QPJSr07MZuRSWSVJ8dVK-neCA_QCKq50hu1JadvwPdTgut4AoG_fqbxyQgshY-tQLo6U2vxcoxz_6g4r9JWKwF61goCkuWVmk8Rs Aug 27 02:50:52.065196 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:50:52.065196 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:50:52.065196 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:50:52.065196 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:50:52.065196 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:50:52.065196 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:50:52.065196 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 2c13c5aeb4da472da020639d5b6ad5aa Aug 27 02:50:52.065196 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-714154922 Aug 27 02:50:52.065196 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:50:52.065196 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:50:52.065196 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2c13c5aeb4da472da020639d5b6ad5aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_2c13c5aeb4da472da020639d5b6ad5aa", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2c13c5aeb4da472da020639d5b6ad5aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/2c13c5aeb4da472da020639d5b6ad5aa"}]}] Aug 27 02:50:52.065196 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-714154922 Aug 27 02:50:52.065196 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 2c13c5aeb4da472da020639d5b6ad5aa Aug 27 02:50:52.065196 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-714154922 Aug 27 02:50:52.065196 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project Aug 27 02:50:52.065196 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:50:52.065196 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:50:52.065196 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: ece67529f3704d9faf0ff443d7c016de Aug 27 02:50:52.065196 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project Aug 27 02:50:52.065196 n-d-852278-4 devstack@n-api.service[134051]: Aug 27 02:50:52.065196 n-d-852278-4 devstack@n-api.service[134051]: {"addFloatingIp": {"address": "0.0.0.0"}} Aug 27 02:50:52.065196 n-d-852278-4 devstack@n-api.service[134051]: method: Aug 27 02:50:52.065196 n-d-852278-4 devstack@n-api.service[134051]: exception: floating IP not found Aug 27 02:50:52.065196 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '57a1e617-8846-4da8-b84f-232ffc519f69', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Aug 27 02:50:52.065196 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:50:52.065196 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:52.065196 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Aug 27 02:50:52.065196 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Aug 27 02:50:52.065196 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Aug 27 02:50:52.065196 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Aug 27 02:50:52.065196 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2702, in associate_floating_ip Aug 27 02:50:52.065196 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Aug 27 02:50:52.065196 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Aug 27 02:50:52.065196 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Aug 27 02:50:52.065196 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Aug 27 02:50:52.065196 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:50:52.065196 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:50:52.065196 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:50:52.065196 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:52.065196 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:50:52.065196 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:50:52.065196 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:50:52.065196 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:50:52.065196 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:50:52.065196 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:50:52.065196 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:50:52.065196 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:50:52.065196 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:50:52.065196 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:50:52.065196 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Aug 27 02:50:52.065196 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 27 02:50:52.065196 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Aug 27 02:50:52.065196 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:50:52.069905 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:50:52.069905 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:50:52.069905 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:52.069905 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:50:52.069905 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:50:52.069905 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:50:52.069905 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:50:52.069905 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Aug 27 02:50:52.069905 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:50:52.072731 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8c5f79db-2cae-4870-8dab-8b29e20b8dec tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Returning 404 to user: floating IP not found {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:50:52.074358 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-8c5f79db-2cae-4870-8dab-8b29e20b8dec tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] 10.222.0.70 "POST /compute/v2.1/servers/57a1e617-8846-4da8-b84f-232ffc519f69/action" status: 404 len: 67 microversion: 2.1 time: 0.263222 Aug 27 02:50:52.075316 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1088/2210] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 02:50:51 2022] POST /compute/v2.1/servers/57a1e617-8846-4da8-b84f-232ffc519f69/action => generated 67 bytes in 283 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 02:50:52.087384 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-5a695eef-3fec-4440-96dc-6e30f8e88529 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:50:52.140968 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-5a695eef-3fec-4440-96dc-6e30f8e88529 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Aug 27 02:50:52.142745 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-5a695eef-3fec-4440-96dc-6e30f8e88529 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Request method failure captured: Aug 27 02:50:52.142745 n-d-852278-4 devstack@n-api.service[134051]: request: POST /compute/v2.1/servers/57a1e617-8846-4da8-b84f-232ffc519f69/action HTTP/1.1 Aug 27 02:50:52.142745 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:50:52.142745 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:50:52.142745 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:50:52.142745 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 44 Aug 27 02:50:52.142745 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:50:52.142745 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:50:52.142745 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:50:52.142745 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:50:52.142745 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYZBHK5lJQrdMj_AIzVz1BIf6TAv82YyeU0Mi4KNWaGZlnNvrahx2fCXt0F5D_IBmtIoOZ71FZ2QPJSr07MZuRSWSVJ8dVK-neCA_QCKq50hu1JadvwPdTgut4AoG_fqbxyQgshY-tQLo6U2vxcoxz_6g4r9JWKwF61goCkuWVmk8Rs Aug 27 02:50:52.142745 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:50:52.142745 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:50:52.142745 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:50:52.142745 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:50:52.142745 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:50:52.142745 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:50:52.142745 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 2c13c5aeb4da472da020639d5b6ad5aa Aug 27 02:50:52.142745 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-714154922 Aug 27 02:50:52.142745 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:50:52.142745 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:50:52.142745 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2c13c5aeb4da472da020639d5b6ad5aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_2c13c5aeb4da472da020639d5b6ad5aa", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2c13c5aeb4da472da020639d5b6ad5aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/2c13c5aeb4da472da020639d5b6ad5aa"}]}] Aug 27 02:50:52.142745 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-714154922 Aug 27 02:50:52.142745 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 2c13c5aeb4da472da020639d5b6ad5aa Aug 27 02:50:52.142745 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-714154922 Aug 27 02:50:52.142745 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project Aug 27 02:50:52.142745 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:50:52.142745 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:50:52.142745 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: ece67529f3704d9faf0ff443d7c016de Aug 27 02:50:52.142745 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project Aug 27 02:50:52.142745 n-d-852278-4 devstack@n-api.service[134051]: Aug 27 02:50:52.142745 n-d-852278-4 devstack@n-api.service[134051]: {"removeFloatingIp": {"address": "0.0.0.0"}} Aug 27 02:50:52.142745 n-d-852278-4 devstack@n-api.service[134051]: method: Aug 27 02:50:52.142745 n-d-852278-4 devstack@n-api.service[134051]: exception: Floating IP not found for address 0.0.0.0. Aug 27 02:50:52.142745 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '57a1e617-8846-4da8-b84f-232ffc519f69', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Aug 27 02:50:52.142745 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:50:52.142745 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:52.142745 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Aug 27 02:50:52.142745 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Aug 27 02:50:52.142745 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2930, in get_instance_id_by_floating_address Aug 27 02:50:52.142745 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Aug 27 02:50:52.142745 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Aug 27 02:50:52.142745 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Aug 27 02:50:52.142745 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Aug 27 02:50:52.142745 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:50:52.142745 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:50:52.142745 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:50:52.142745 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:52.142745 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:50:52.142745 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:50:52.142745 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:50:52.142745 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:50:52.142745 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:50:52.142745 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:50:52.142745 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:50:52.142745 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:50:52.142745 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:50:52.142745 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:50:52.142745 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Aug 27 02:50:52.142745 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Aug 27 02:50:52.142745 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Aug 27 02:50:52.142745 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Aug 27 02:50:52.147165 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Aug 27 02:50:52.147165 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:50:52.147165 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:50:52.147165 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:50:52.147165 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:52.147165 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:50:52.147165 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:50:52.147165 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:50:52.147165 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:50:52.147165 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Aug 27 02:50:52.147165 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:50:52.147165 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-5a695eef-3fec-4440-96dc-6e30f8e88529 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:50:52.147165 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-5a695eef-3fec-4440-96dc-6e30f8e88529 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] 10.222.0.70 "POST /compute/v2.1/servers/57a1e617-8846-4da8-b84f-232ffc519f69/action" status: 404 len: 88 microversion: 2.1 time: 0.063366 Aug 27 02:50:52.147970 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1089/2211] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 02:50:52 2022] POST /compute/v2.1/servers/57a1e617-8846-4da8-b84f-232ffc519f69/action => generated 88 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 02:50:52.160205 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d64b3406-d87e-4a64-900f-ca36717c071b tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:52.160815 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d64b3406-d87e-4a64-900f-ca36717c071b tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] [instance: 57a1e617-8846-4da8-b84f-232ffc519f69] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:52.178216 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d64b3406-d87e-4a64-900f-ca36717c071b tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:52.185710 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d64b3406-d87e-4a64-900f-ca36717c071b tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:52.186170 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d64b3406-d87e-4a64-900f-ca36717c071b tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:52.186937 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d64b3406-d87e-4a64-900f-ca36717c071b tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:52.187396 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d64b3406-d87e-4a64-900f-ca36717c071b tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:52.187826 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d64b3406-d87e-4a64-900f-ca36717c071b tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:52.237679 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d64b3406-d87e-4a64-900f-ca36717c071b tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] [instance: 57a1e617-8846-4da8-b84f-232ffc519f69] Going to try to terminate instance {{(pid=134051) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:50:52.345394 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-1361cdc5-e502-46be-aae4-949a2aa6dbc9 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:52.360741 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-1361cdc5-e502-46be-aae4-949a2aa6dbc9 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/24cefd05-8d3a-4813-af22-160658183e1b" status: 200 len: 1507 microversion: 2.1 time: 0.393168 Aug 27 02:50:52.380808 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1123/2212] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:51 2022] GET /compute/v2.1/servers/24cefd05-8d3a-4813-af22-160658183e1b => generated 1507 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:50:52.436016 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d64b3406-d87e-4a64-900f-ca36717c071b tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] 10.222.0.70 "DELETE /compute/v2.1/servers/57a1e617-8846-4da8-b84f-232ffc519f69" status: 204 len: 0 microversion: 2.1 time: 0.282155 Aug 27 02:50:52.437121 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1090/2213] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:50:52 2022] DELETE /compute/v2.1/servers/57a1e617-8846-4da8-b84f-232ffc519f69 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:50:52.447973 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b0550aa1-73b4-452c-bfba-bd919249d77a tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:52.448837 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b0550aa1-73b4-452c-bfba-bd919249d77a tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] [instance: 57a1e617-8846-4da8-b84f-232ffc519f69] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:52.455129 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b0550aa1-73b4-452c-bfba-bd919249d77a tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:52.455611 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b0550aa1-73b4-452c-bfba-bd919249d77a tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:52.456040 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b0550aa1-73b4-452c-bfba-bd919249d77a tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:52.464811 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b0550aa1-73b4-452c-bfba-bd919249d77a tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:52.466682 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b0550aa1-73b4-452c-bfba-bd919249d77a tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:52.467321 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b0550aa1-73b4-452c-bfba-bd919249d77a tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:52.768121 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b0550aa1-73b4-452c-bfba-bd919249d77a tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece67529f3704d9faf0ff443d7c016de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c13c5aeb4da472da020639d5b6ad5aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:52.779280 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b0550aa1-73b4-452c-bfba-bd919249d77a tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] 10.222.0.70 "GET /compute/v2.1/servers/57a1e617-8846-4da8-b84f-232ffc519f69" status: 200 len: 1542 microversion: 2.1 time: 0.335261 Aug 27 02:50:52.789514 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1124/2214] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:52 2022] GET /compute/v2.1/servers/57a1e617-8846-4da8-b84f-232ffc519f69 => generated 1542 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:50:52.816074 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b334f7e3-6917-4940-96ed-b2b527771c8b tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:52.816940 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b334f7e3-6917-4940-96ed-b2b527771c8b tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: a4aca2ed-a835-4f8f-96ae-c3502645425a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:52.829111 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b334f7e3-6917-4940-96ed-b2b527771c8b tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:52.835548 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b334f7e3-6917-4940-96ed-b2b527771c8b tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:52.836252 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b334f7e3-6917-4940-96ed-b2b527771c8b tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:52.837545 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b334f7e3-6917-4940-96ed-b2b527771c8b tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:52.838330 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b334f7e3-6917-4940-96ed-b2b527771c8b tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:52.839010 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b334f7e3-6917-4940-96ed-b2b527771c8b tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:52.985630 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ab804a29-8028-4bd8-aaf3-a0282edadfba tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:52.987047 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-ab804a29-8028-4bd8-aaf3-a0282edadfba tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:53.001747 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ab804a29-8028-4bd8-aaf3-a0282edadfba tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:53.004220 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ab804a29-8028-4bd8-aaf3-a0282edadfba tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:53.004639 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ab804a29-8028-4bd8-aaf3-a0282edadfba tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:53.007604 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ab804a29-8028-4bd8-aaf3-a0282edadfba tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:53.011498 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ab804a29-8028-4bd8-aaf3-a0282edadfba tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:53.013656 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ab804a29-8028-4bd8-aaf3-a0282edadfba tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:53.301545 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-ab804a29-8028-4bd8-aaf3-a0282edadfba tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:53.307080 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-b334f7e3-6917-4940-96ed-b2b527771c8b tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:53.315712 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b334f7e3-6917-4940-96ed-b2b527771c8b tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/a4aca2ed-a835-4f8f-96ae-c3502645425a" status: 200 len: 1379 microversion: 2.1 time: 0.504091 Aug 27 02:50:53.318200 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1091/2215] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:52 2022] GET /compute/v2.1/servers/a4aca2ed-a835-4f8f-96ae-c3502645425a => generated 1379 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:50:53.320478 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ab804a29-8028-4bd8-aaf3-a0282edadfba tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1296 microversion: 2.1 time: 0.339032 Aug 27 02:50:53.328478 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1125/2216] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:52 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1296 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:50:53.386534 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-618d29de-bde8-48e2-8645-30fe2a117092 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:53.387561 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-618d29de-bde8-48e2-8645-30fe2a117092 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: 24cefd05-8d3a-4813-af22-160658183e1b] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:53.397623 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-618d29de-bde8-48e2-8645-30fe2a117092 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:53.400975 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-618d29de-bde8-48e2-8645-30fe2a117092 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:53.401595 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-618d29de-bde8-48e2-8645-30fe2a117092 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:53.402516 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-618d29de-bde8-48e2-8645-30fe2a117092 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:53.404820 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-618d29de-bde8-48e2-8645-30fe2a117092 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:53.405264 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-618d29de-bde8-48e2-8645-30fe2a117092 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:53.811342 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4f424adc-1ea1-4326-9376-d0f97a6a99e3 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:53.811909 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-4f424adc-1ea1-4326-9376-d0f97a6a99e3 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] [instance: 57a1e617-8846-4da8-b84f-232ffc519f69] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:53.833575 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4f424adc-1ea1-4326-9376-d0f97a6a99e3 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:53.836504 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4f424adc-1ea1-4326-9376-d0f97a6a99e3 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:53.837007 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4f424adc-1ea1-4326-9376-d0f97a6a99e3 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:53.842089 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4f424adc-1ea1-4326-9376-d0f97a6a99e3 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:53.843706 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4f424adc-1ea1-4326-9376-d0f97a6a99e3 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:53.850635 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4f424adc-1ea1-4326-9376-d0f97a6a99e3 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:53.901478 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-618d29de-bde8-48e2-8645-30fe2a117092 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:53.914011 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-618d29de-bde8-48e2-8645-30fe2a117092 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/24cefd05-8d3a-4813-af22-160658183e1b" status: 200 len: 1507 microversion: 2.1 time: 0.532239 Aug 27 02:50:53.915292 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1092/2217] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:53 2022] GET /compute/v2.1/servers/24cefd05-8d3a-4813-af22-160658183e1b => generated 1507 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:50:54.339744 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-960dc7c1-04d1-41ae-83fc-0f9d18b9778f tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:54.340636 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-960dc7c1-04d1-41ae-83fc-0f9d18b9778f tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: a4aca2ed-a835-4f8f-96ae-c3502645425a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:54.355985 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-960dc7c1-04d1-41ae-83fc-0f9d18b9778f tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:54.357004 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-960dc7c1-04d1-41ae-83fc-0f9d18b9778f tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:54.360385 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-960dc7c1-04d1-41ae-83fc-0f9d18b9778f tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:54.362129 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-960dc7c1-04d1-41ae-83fc-0f9d18b9778f tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:54.364421 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-960dc7c1-04d1-41ae-83fc-0f9d18b9778f tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:54.366954 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-960dc7c1-04d1-41ae-83fc-0f9d18b9778f tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:55.116521 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-4f424adc-1ea1-4326-9376-d0f97a6a99e3 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece67529f3704d9faf0ff443d7c016de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c13c5aeb4da472da020639d5b6ad5aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:55.131750 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-4f424adc-1ea1-4326-9376-d0f97a6a99e3 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] 10.222.0.70 "GET /compute/v2.1/servers/57a1e617-8846-4da8-b84f-232ffc519f69" status: 200 len: 1542 microversion: 2.1 time: 1.323482 Aug 27 02:50:55.134708 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1126/2218] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:53 2022] GET /compute/v2.1/servers/57a1e617-8846-4da8-b84f-232ffc519f69 => generated 1542 bytes in 1329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:50:55.152869 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-791790df-48a7-420f-aa2a-9ab05e7e24f6 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:55.154770 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-791790df-48a7-420f-aa2a-9ab05e7e24f6 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:55.175318 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-791790df-48a7-420f-aa2a-9ab05e7e24f6 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:55.177227 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-791790df-48a7-420f-aa2a-9ab05e7e24f6 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:55.179067 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-791790df-48a7-420f-aa2a-9ab05e7e24f6 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:55.181283 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-791790df-48a7-420f-aa2a-9ab05e7e24f6 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:55.182852 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-791790df-48a7-420f-aa2a-9ab05e7e24f6 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:55.183924 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-791790df-48a7-420f-aa2a-9ab05e7e24f6 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:55.674622 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-960dc7c1-04d1-41ae-83fc-0f9d18b9778f tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:55.689528 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-960dc7c1-04d1-41ae-83fc-0f9d18b9778f tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/a4aca2ed-a835-4f8f-96ae-c3502645425a" status: 200 len: 1379 microversion: 2.1 time: 1.353862 Aug 27 02:50:55.690574 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1093/2219] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:54 2022] GET /compute/v2.1/servers/a4aca2ed-a835-4f8f-96ae-c3502645425a => generated 1379 bytes in 1357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:50:55.709958 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7caf9b38-5b2d-43ac-895c-49a8a73ba98b tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:55.716362 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-7caf9b38-5b2d-43ac-895c-49a8a73ba98b tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: 24cefd05-8d3a-4813-af22-160658183e1b] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:55.726763 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7caf9b38-5b2d-43ac-895c-49a8a73ba98b tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:55.728172 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7caf9b38-5b2d-43ac-895c-49a8a73ba98b tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:55.729086 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7caf9b38-5b2d-43ac-895c-49a8a73ba98b tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:55.730942 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7caf9b38-5b2d-43ac-895c-49a8a73ba98b tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:55.731787 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7caf9b38-5b2d-43ac-895c-49a8a73ba98b tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:55.732499 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7caf9b38-5b2d-43ac-895c-49a8a73ba98b tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:55.806524 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7caf9b38-5b2d-43ac-895c-49a8a73ba98b tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:55.807207 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7caf9b38-5b2d-43ac-895c-49a8a73ba98b tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:55.810079 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7caf9b38-5b2d-43ac-895c-49a8a73ba98b tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:55.811025 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.objects.instance [None req-7caf9b38-5b2d-43ac-895c-49a8a73ba98b tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lazy-loading 'fault' on Instance uuid 24cefd05-8d3a-4813-af22-160658183e1b {{(pid=134051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:50:56.075648 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-791790df-48a7-420f-aa2a-9ab05e7e24f6 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:56.104186 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-791790df-48a7-420f-aa2a-9ab05e7e24f6 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1362 microversion: 2.1 time: 0.966892 Aug 27 02:50:56.104908 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1127/2220] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:55 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1362 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:50:56.124261 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-a807aeb5-de2c-4b2b-8479-2810fc28ec0b req-44e3b861-bb2e-4f40-8a5d-965569b7e465 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24cefd05-8d3a-4813-af22-160658183e1b", "name": "network-vif-deleted", "tag": "2c230c5a-70ca-4e66-9b32-f703ed94751e"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:50:56.155233 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-a807aeb5-de2c-4b2b-8479-2810fc28ec0b req-44e3b861-bb2e-4f40-8a5d-965569b7e465 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:56.166496 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-a807aeb5-de2c-4b2b-8479-2810fc28ec0b req-44e3b861-bb2e-4f40-8a5d-965569b7e465 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:56.173468 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-a807aeb5-de2c-4b2b-8479-2810fc28ec0b req-44e3b861-bb2e-4f40-8a5d-965569b7e465 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:56.225682 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-a807aeb5-de2c-4b2b-8479-2810fc28ec0b req-44e3b861-bb2e-4f40-8a5d-965569b7e465 service nova] Creating event network-vif-deleted:2c230c5a-70ca-4e66-9b32-f703ed94751e for instance 24cefd05-8d3a-4813-af22-160658183e1b on n-h1-852278-4 Aug 27 02:50:56.233233 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-a807aeb5-de2c-4b2b-8479-2810fc28ec0b req-44e3b861-bb2e-4f40-8a5d-965569b7e465 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125599 Aug 27 02:50:56.235091 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1128/2221] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:50:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:50:56.242088 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-aa630dae-f751-433d-bf98-f0ef01687ca5 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:56.243021 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-aa630dae-f751-433d-bf98-f0ef01687ca5 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] [instance: 57a1e617-8846-4da8-b84f-232ffc519f69] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:56.253937 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-aa630dae-f751-433d-bf98-f0ef01687ca5 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:56.255165 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-aa630dae-f751-433d-bf98-f0ef01687ca5 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:56.255954 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-aa630dae-f751-433d-bf98-f0ef01687ca5 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:56.257311 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-aa630dae-f751-433d-bf98-f0ef01687ca5 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:56.258208 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-aa630dae-f751-433d-bf98-f0ef01687ca5 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:56.259585 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-aa630dae-f751-433d-bf98-f0ef01687ca5 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:56.330228 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-7caf9b38-5b2d-43ac-895c-49a8a73ba98b tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:56.341195 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-7caf9b38-5b2d-43ac-895c-49a8a73ba98b tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/24cefd05-8d3a-4813-af22-160658183e1b" status: 200 len: 1305 microversion: 2.1 time: 0.647627 Aug 27 02:50:56.345944 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1094/2222] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:55 2022] GET /compute/v2.1/servers/24cefd05-8d3a-4813-af22-160658183e1b => generated 1305 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:50:56.658318 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-aa630dae-f751-433d-bf98-f0ef01687ca5 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece67529f3704d9faf0ff443d7c016de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c13c5aeb4da472da020639d5b6ad5aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:56.675038 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-aa630dae-f751-433d-bf98-f0ef01687ca5 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] 10.222.0.70 "GET /compute/v2.1/servers/57a1e617-8846-4da8-b84f-232ffc519f69" status: 200 len: 1542 microversion: 2.1 time: 0.438473 Aug 27 02:50:56.675626 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1129/2223] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:56 2022] GET /compute/v2.1/servers/57a1e617-8846-4da8-b84f-232ffc519f69 => generated 1542 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:50:56.713230 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-621143b1-c9da-4321-8438-5869b0d15714 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:56.713846 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-621143b1-c9da-4321-8438-5869b0d15714 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: a4aca2ed-a835-4f8f-96ae-c3502645425a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:56.726171 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-621143b1-c9da-4321-8438-5869b0d15714 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:56.726684 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-621143b1-c9da-4321-8438-5869b0d15714 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:56.728159 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-621143b1-c9da-4321-8438-5869b0d15714 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:56.728938 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-621143b1-c9da-4321-8438-5869b0d15714 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:56.731377 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-621143b1-c9da-4321-8438-5869b0d15714 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:56.731855 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-621143b1-c9da-4321-8438-5869b0d15714 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:57.026379 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-0ac13bc7-2d62-4bc2-9076-524c33dcfe2c req-e5625e1d-8f14-4b70-9fd0-d67882cbed60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57a1e617-8846-4da8-b84f-232ffc519f69", "name": "network-vif-deleted", "tag": "f1fc64b5-9211-456f-b514-94d86ae29282"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:50:57.056154 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-0ac13bc7-2d62-4bc2-9076-524c33dcfe2c req-e5625e1d-8f14-4b70-9fd0-d67882cbed60 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:57.080940 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-0ac13bc7-2d62-4bc2-9076-524c33dcfe2c req-e5625e1d-8f14-4b70-9fd0-d67882cbed60 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:57.081475 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-0ac13bc7-2d62-4bc2-9076-524c33dcfe2c req-e5625e1d-8f14-4b70-9fd0-d67882cbed60 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:57.133149 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-0ac13bc7-2d62-4bc2-9076-524c33dcfe2c req-e5625e1d-8f14-4b70-9fd0-d67882cbed60 service nova] Creating event network-vif-deleted:f1fc64b5-9211-456f-b514-94d86ae29282 for instance 57a1e617-8846-4da8-b84f-232ffc519f69 on n-h2-852278-4 Aug 27 02:50:57.140120 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-621143b1-c9da-4321-8438-5869b0d15714 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:57.148730 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-0ac13bc7-2d62-4bc2-9076-524c33dcfe2c req-e5625e1d-8f14-4b70-9fd0-d67882cbed60 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133286 Aug 27 02:50:57.153219 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=94,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:50:57.156595 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1130/2224] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:50:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:50:57.164227 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-621143b1-c9da-4321-8438-5869b0d15714 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/a4aca2ed-a835-4f8f-96ae-c3502645425a" status: 200 len: 1379 microversion: 2.1 time: 0.454495 Aug 27 02:50:57.166777 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1095/2225] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:56 2022] GET /compute/v2.1/servers/a4aca2ed-a835-4f8f-96ae-c3502645425a => generated 1379 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:50:57.172775 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8bcfbbfb-020e-470b-a410-30f7226e0127 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:57.173487 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-8bcfbbfb-020e-470b-a410-30f7226e0127 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:57.186003 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8bcfbbfb-020e-470b-a410-30f7226e0127 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:57.189677 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8bcfbbfb-020e-470b-a410-30f7226e0127 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:57.191615 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8bcfbbfb-020e-470b-a410-30f7226e0127 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:57.197740 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8bcfbbfb-020e-470b-a410-30f7226e0127 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:57.201316 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8bcfbbfb-020e-470b-a410-30f7226e0127 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:57.203635 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8bcfbbfb-020e-470b-a410-30f7226e0127 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:57.315628 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-ece90784-57c9-48ab-8ec8-ff17a8431e24 req-eeb87968-0aa1-4113-9d69-181c72a899e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4aca2ed-a835-4f8f-96ae-c3502645425a", "name": "network-vif-plugged", "status": "completed", "tag": "4f9042c6-628d-483c-88dc-649ec8de9f53"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:50:57.380575 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-ece90784-57c9-48ab-8ec8-ff17a8431e24 req-eeb87968-0aa1-4113-9d69-181c72a899e7 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:57.384684 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-ece90784-57c9-48ab-8ec8-ff17a8431e24 req-eeb87968-0aa1-4113-9d69-181c72a899e7 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:57.385522 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-ece90784-57c9-48ab-8ec8-ff17a8431e24 req-eeb87968-0aa1-4113-9d69-181c72a899e7 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:57.440465 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-ece90784-57c9-48ab-8ec8-ff17a8431e24 req-eeb87968-0aa1-4113-9d69-181c72a899e7 service nova] Creating event network-vif-plugged:4f9042c6-628d-483c-88dc-649ec8de9f53 for instance a4aca2ed-a835-4f8f-96ae-c3502645425a on n-h2-852278-4 Aug 27 02:50:57.447262 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-ece90784-57c9-48ab-8ec8-ff17a8431e24 req-eeb87968-0aa1-4113-9d69-181c72a899e7 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136343 Aug 27 02:50:57.448122 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1096/2226] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:50:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:50:57.454625 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-86171d6e-d38e-48de-b0ec-a7c956212c84 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:57.456068 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-86171d6e-d38e-48de-b0ec-a7c956212c84 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: 24cefd05-8d3a-4813-af22-160658183e1b] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:57.487527 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-86171d6e-d38e-48de-b0ec-a7c956212c84 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:57.489317 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-86171d6e-d38e-48de-b0ec-a7c956212c84 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:57.490698 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-86171d6e-d38e-48de-b0ec-a7c956212c84 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:57.494515 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-86171d6e-d38e-48de-b0ec-a7c956212c84 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:57.495194 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-86171d6e-d38e-48de-b0ec-a7c956212c84 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:57.495866 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-86171d6e-d38e-48de-b0ec-a7c956212c84 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:57.520818 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-86171d6e-d38e-48de-b0ec-a7c956212c84 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] HTTP exception thrown: Instance 24cefd05-8d3a-4813-af22-160658183e1b could not be found. Aug 27 02:50:57.523159 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-86171d6e-d38e-48de-b0ec-a7c956212c84 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Request method failure captured: Aug 27 02:50:57.523159 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/24cefd05-8d3a-4813-af22-160658183e1b HTTP/1.1 Aug 27 02:50:57.523159 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:50:57.523159 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:50:57.523159 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:50:57.523159 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:50:57.523159 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:50:57.523159 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:50:57.523159 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:50:57.523159 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:50:57.523159 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYZ0St41cKkzS8_oefTYdmhcUQuTjHJMchuX75Wes8eVywW22WD3_nUDa_aMbIFBVV51GGjDa8GDt8SbwEVTMvQnSuXk6MkeKEfB2NWHjFnNKSNKnT9A2S4P8aN7qYWhUsGxW2ugzvIrMVMPtkn5w90KE7af4tlEcxQ5ERFDVU7f32Y Aug 27 02:50:57.523159 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:50:57.523159 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:50:57.523159 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:50:57.523159 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:50:57.523159 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:50:57.523159 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:50:57.523159 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 840077c9375b4b2a9214cb8dda094cc8 Aug 27 02:50:57.523159 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-DeleteServersTestJSON-725615510 Aug 27 02:50:57.523159 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:50:57.523159 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:50:57.523159 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/840077c9375b4b2a9214cb8dda094cc8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_840077c9375b4b2a9214cb8dda094cc8", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/840077c9375b4b2a9214cb8dda094cc8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/840077c9375b4b2a9214cb8dda094cc8"}]}] Aug 27 02:50:57.523159 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-DeleteServersTestJSON-725615510 Aug 27 02:50:57.523159 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 840077c9375b4b2a9214cb8dda094cc8 Aug 27 02:50:57.523159 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-DeleteServersTestJSON-725615510 Aug 27 02:50:57.523159 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-DeleteServersTestJSON-725615510-project Aug 27 02:50:57.523159 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:50:57.523159 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:50:57.523159 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: dc53b0977c2b4e06b2f290442483913b Aug 27 02:50:57.523159 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-DeleteServersTestJSON-725615510-project Aug 27 02:50:57.523159 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 02:50:57.523159 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance 24cefd05-8d3a-4813-af22-160658183e1b could not be found. Aug 27 02:50:57.523159 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '24cefd05-8d3a-4813-af22-160658183e1b'} Aug 27 02:50:57.523159 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:50:57.523159 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:57.523159 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:50:57.523159 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:50:57.523159 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:50:57.523159 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:50:57.523159 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:50:57.523159 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:50:57.523159 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:50:57.523159 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:50:57.523159 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24cefd05-8d3a-4813-af22-160658183e1b could not be found. Aug 27 02:50:57.523159 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:50:57.523159 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:50:57.523159 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:50:57.523159 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:57.523159 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:50:57.523159 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:50:57.523159 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:50:57.523159 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:50:57.523159 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:50:57.523159 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:50:57.523159 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:50:57.523159 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:50:57.523159 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:50:57.523159 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:50:57.523159 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:50:57.523159 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:50:57.523159 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24cefd05-8d3a-4813-af22-160658183e1b could not be found. Aug 27 02:50:57.523159 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:50:57.523159 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:50:57.523159 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:50:57.527752 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:57.527752 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:50:57.527752 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:50:57.527752 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:50:57.527752 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:50:57.527752 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24cefd05-8d3a-4813-af22-160658183e1b could not be found. Aug 27 02:50:57.527752 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:50:57.529422 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-86171d6e-d38e-48de-b0ec-a7c956212c84 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Returning 404 to user: Instance 24cefd05-8d3a-4813-af22-160658183e1b could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:50:57.530426 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-86171d6e-d38e-48de-b0ec-a7c956212c84 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/24cefd05-8d3a-4813-af22-160658183e1b" status: 404 len: 111 microversion: 2.1 time: 0.080994 Aug 27 02:50:57.531708 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1097/2227] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:57 2022] GET /compute/v2.1/servers/24cefd05-8d3a-4813-af22-160658183e1b => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:50:57.646165 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-8bcfbbfb-020e-470b-a410-30f7226e0127 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:57.654460 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-8bcfbbfb-020e-470b-a410-30f7226e0127 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1362 microversion: 2.1 time: 0.496339 Aug 27 02:50:57.655317 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1131/2228] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:57 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1362 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:50:57.697561 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-72278c92-1b89-4cf4-85e1-f8ea89555193 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:57.699342 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-72278c92-1b89-4cf4-85e1-f8ea89555193 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] [instance: 57a1e617-8846-4da8-b84f-232ffc519f69] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:57.710351 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-72278c92-1b89-4cf4-85e1-f8ea89555193 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:57.710857 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-72278c92-1b89-4cf4-85e1-f8ea89555193 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:57.712459 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-72278c92-1b89-4cf4-85e1-f8ea89555193 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:57.714132 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-72278c92-1b89-4cf4-85e1-f8ea89555193 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:57.714712 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-72278c92-1b89-4cf4-85e1-f8ea89555193 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:57.715396 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-72278c92-1b89-4cf4-85e1-f8ea89555193 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:57.782493 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-303d58de-5d46-4af4-b869-8a2eb9d26fb9 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1763333001", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "networks": [{"uuid": "9f81fa4d-d0d4-411f-b6ce-c99b22cb14d3"}]}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:50:57.833495 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-72278c92-1b89-4cf4-85e1-f8ea89555193 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:57.853007 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-72278c92-1b89-4cf4-85e1-f8ea89555193 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:57.855734 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-72278c92-1b89-4cf4-85e1-f8ea89555193 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:57.858595 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.objects.instance [None req-72278c92-1b89-4cf4-85e1-f8ea89555193 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Lazy-loading 'fault' on Instance uuid 57a1e617-8846-4da8-b84f-232ffc519f69 {{(pid=134051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:50:57.913589 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.network.neutron [None req-303d58de-5d46-4af4-b869-8a2eb9d26fb9 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] validate_networks() for [('9f81fa4d-d0d4-411f-b6ce-c99b22cb14d3', None, None, None, None, None)] {{(pid=134052) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:50:58.102162 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-72278c92-1b89-4cf4-85e1-f8ea89555193 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece67529f3704d9faf0ff443d7c016de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c13c5aeb4da472da020639d5b6ad5aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:58.112335 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-72278c92-1b89-4cf4-85e1-f8ea89555193 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] 10.222.0.70 "GET /compute/v2.1/servers/57a1e617-8846-4da8-b84f-232ffc519f69" status: 200 len: 1322 microversion: 2.1 time: 0.418909 Aug 27 02:50:58.116795 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1098/2229] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:57 2022] GET /compute/v2.1/servers/57a1e617-8846-4da8-b84f-232ffc519f69 => generated 1322 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:50:58.187537 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-1d6ad076-7456-4b53-b6ca-94f7880af673 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:58.188148 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-1d6ad076-7456-4b53-b6ca-94f7880af673 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: a4aca2ed-a835-4f8f-96ae-c3502645425a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:58.203631 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1d6ad076-7456-4b53-b6ca-94f7880af673 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:58.204132 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1d6ad076-7456-4b53-b6ca-94f7880af673 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:58.204597 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1d6ad076-7456-4b53-b6ca-94f7880af673 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:58.205312 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1d6ad076-7456-4b53-b6ca-94f7880af673 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:58.212963 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1d6ad076-7456-4b53-b6ca-94f7880af673 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:58.213416 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1d6ad076-7456-4b53-b6ca-94f7880af673 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:58.503622 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:50:58.531454 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=6 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:50:58.678211 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-1d6ad076-7456-4b53-b6ca-94f7880af673 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:58.693358 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-1d6ad076-7456-4b53-b6ca-94f7880af673 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/a4aca2ed-a835-4f8f-96ae-c3502645425a" status: 200 len: 1379 microversion: 2.1 time: 0.510231 Aug 27 02:50:58.695112 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1099/2230] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:58 2022] GET /compute/v2.1/servers/a4aca2ed-a835-4f8f-96ae-c3502645425a => generated 1379 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:50:58.705280 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-e13880e5-2dac-4a30-be95-4326c58db53a req-91d682e6-1afc-4121-911c-3fb97d55c614 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb0d71f2-158d-4acc-8774-6874e7da29cd", "tag": "fe5d48cf-956a-4e15-9a8e-fdd605d313b1"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:50:58.729082 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-e13880e5-2dac-4a30-be95-4326c58db53a req-91d682e6-1afc-4121-911c-3fb97d55c614 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:58.729777 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-e13880e5-2dac-4a30-be95-4326c58db53a req-91d682e6-1afc-4121-911c-3fb97d55c614 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:58.729969 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-e13880e5-2dac-4a30-be95-4326c58db53a req-91d682e6-1afc-4121-911c-3fb97d55c614 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:58.745810 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-e13880e5-2dac-4a30-be95-4326c58db53a req-91d682e6-1afc-4121-911c-3fb97d55c614 service nova] Creating event network-changed:fe5d48cf-956a-4e15-9a8e-fdd605d313b1 for instance bb0d71f2-158d-4acc-8774-6874e7da29cd on n-h1-852278-4 Aug 27 02:50:58.779138 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-e13880e5-2dac-4a30-be95-4326c58db53a req-91d682e6-1afc-4121-911c-3fb97d55c614 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082593 Aug 27 02:50:58.780071 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1100/2231] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:50:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:50:58.786168 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b4d155a6-0ddd-4f06-b865-dadb530c7b38 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:58.786873 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b4d155a6-0ddd-4f06-b865-dadb530c7b38 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:58.799693 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b4d155a6-0ddd-4f06-b865-dadb530c7b38 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:58.803375 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b4d155a6-0ddd-4f06-b865-dadb530c7b38 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:58.804039 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b4d155a6-0ddd-4f06-b865-dadb530c7b38 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:58.805297 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b4d155a6-0ddd-4f06-b865-dadb530c7b38 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:58.808127 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b4d155a6-0ddd-4f06-b865-dadb530c7b38 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:58.808777 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b4d155a6-0ddd-4f06-b865-dadb530c7b38 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:59.099097 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-303d58de-5d46-4af4-b869-8a2eb9d26fb9 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Flavor limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:50:59.099524 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-303d58de-5d46-4af4-b869-8a2eb9d26fb9 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Image limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:50:59.100002 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-303d58de-5d46-4af4-b869-8a2eb9d26fb9 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Flavor pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:50:59.100447 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-303d58de-5d46-4af4-b869-8a2eb9d26fb9 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Image pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:50:59.100879 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-303d58de-5d46-4af4-b869-8a2eb9d26fb9 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:50:59.138789 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-303d58de-5d46-4af4-b869-8a2eb9d26fb9 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:59.140434 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-303d58de-5d46-4af4-b869-8a2eb9d26fb9 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:59.142880 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-303d58de-5d46-4af4-b869-8a2eb9d26fb9 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:59.143718 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-303d58de-5d46-4af4-b869-8a2eb9d26fb9 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:59.144192 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-303d58de-5d46-4af4-b869-8a2eb9d26fb9 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:59.144678 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-303d58de-5d46-4af4-b869-8a2eb9d26fb9 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:59.192225 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-b4d155a6-0ddd-4f06-b865-dadb530c7b38 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:59.199902 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-303d58de-5d46-4af4-b869-8a2eb9d26fb9 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Getting quotas for project 840077c9375b4b2a9214cb8dda094cc8. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:50:59.203472 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b4d155a6-0ddd-4f06-b865-dadb530c7b38 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1362 microversion: 2.1 time: 0.422122 Aug 27 02:50:59.204731 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1101/2232] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:58 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1362 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:50:59.209897 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3a06a551-aff6-4060-85bc-1cbc8c7e0885 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:59.210866 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-3a06a551-aff6-4060-85bc-1cbc8c7e0885 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] [instance: 57a1e617-8846-4da8-b84f-232ffc519f69] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:59.215604 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-303d58de-5d46-4af4-b869-8a2eb9d26fb9 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Getting quotas for user dc53b0977c2b4e06b2f290442483913b and project 840077c9375b4b2a9214cb8dda094cc8. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:50:59.220750 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3a06a551-aff6-4060-85bc-1cbc8c7e0885 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:59.221630 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3a06a551-aff6-4060-85bc-1cbc8c7e0885 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:59.222351 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3a06a551-aff6-4060-85bc-1cbc8c7e0885 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:59.223945 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3a06a551-aff6-4060-85bc-1cbc8c7e0885 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:59.224659 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3a06a551-aff6-4060-85bc-1cbc8c7e0885 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:59.225420 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3a06a551-aff6-4060-85bc-1cbc8c7e0885 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:59.257711 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-3a06a551-aff6-4060-85bc-1cbc8c7e0885 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] HTTP exception thrown: Instance 57a1e617-8846-4da8-b84f-232ffc519f69 could not be found. Aug 27 02:50:59.259754 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3a06a551-aff6-4060-85bc-1cbc8c7e0885 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Request method failure captured: Aug 27 02:50:59.259754 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/57a1e617-8846-4da8-b84f-232ffc519f69 HTTP/1.1 Aug 27 02:50:59.259754 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:50:59.259754 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:50:59.259754 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:50:59.259754 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:50:59.259754 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:50:59.259754 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:50:59.259754 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:50:59.259754 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:50:59.259754 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYZBHK5lJQrdMj_AIzVz1BIf6TAv82YyeU0Mi4KNWaGZlnNvrahx2fCXt0F5D_IBmtIoOZ71FZ2QPJSr07MZuRSWSVJ8dVK-neCA_QCKq50hu1JadvwPdTgut4AoG_fqbxyQgshY-tQLo6U2vxcoxz_6g4r9JWKwF61goCkuWVmk8Rs Aug 27 02:50:59.259754 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:50:59.259754 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:50:59.259754 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:50:59.259754 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:50:59.259754 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:50:59.259754 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:50:59.259754 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 2c13c5aeb4da472da020639d5b6ad5aa Aug 27 02:50:59.259754 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-714154922 Aug 27 02:50:59.259754 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:50:59.259754 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:50:59.259754 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2c13c5aeb4da472da020639d5b6ad5aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_2c13c5aeb4da472da020639d5b6ad5aa", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2c13c5aeb4da472da020639d5b6ad5aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/2c13c5aeb4da472da020639d5b6ad5aa"}]}] Aug 27 02:50:59.259754 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-714154922 Aug 27 02:50:59.259754 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 2c13c5aeb4da472da020639d5b6ad5aa Aug 27 02:50:59.259754 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-714154922 Aug 27 02:50:59.259754 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project Aug 27 02:50:59.259754 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:50:59.259754 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:50:59.259754 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: ece67529f3704d9faf0ff443d7c016de Aug 27 02:50:59.259754 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project Aug 27 02:50:59.259754 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 02:50:59.259754 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance 57a1e617-8846-4da8-b84f-232ffc519f69 could not be found. Aug 27 02:50:59.259754 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '57a1e617-8846-4da8-b84f-232ffc519f69'} Aug 27 02:50:59.259754 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:50:59.259754 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:59.259754 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:50:59.259754 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:50:59.259754 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:50:59.259754 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:50:59.259754 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:50:59.259754 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:50:59.259754 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:50:59.259754 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:50:59.259754 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57a1e617-8846-4da8-b84f-232ffc519f69 could not be found. Aug 27 02:50:59.259754 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:50:59.259754 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:50:59.259754 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:50:59.259754 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:59.259754 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:50:59.259754 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:50:59.259754 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:50:59.259754 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:50:59.259754 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:50:59.259754 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:50:59.259754 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:50:59.259754 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:50:59.259754 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:50:59.259754 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:50:59.259754 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:50:59.259754 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:50:59.259754 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57a1e617-8846-4da8-b84f-232ffc519f69 could not be found. Aug 27 02:50:59.259754 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:50:59.264452 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:50:59.264452 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:50:59.264452 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:59.264452 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:50:59.264452 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:50:59.264452 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:50:59.264452 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:50:59.264452 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57a1e617-8846-4da8-b84f-232ffc519f69 could not be found. Aug 27 02:50:59.264452 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:50:59.265619 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:50:59.265619 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-303d58de-5d46-4af4-b869-8a2eb9d26fb9 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Going to run 1 instances... {{(pid=134052) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:50:59.269601 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3a06a551-aff6-4060-85bc-1cbc8c7e0885 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] Returning 404 to user: Instance 57a1e617-8846-4da8-b84f-232ffc519f69 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:50:59.270634 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-3a06a551-aff6-4060-85bc-1cbc8c7e0885 tempest-FloatingIPsAssociationNegativeTestJSON-714154922 tempest-FloatingIPsAssociationNegativeTestJSON-714154922-project] 10.222.0.70 "GET /compute/v2.1/servers/57a1e617-8846-4da8-b84f-232ffc519f69" status: 404 len: 111 microversion: 2.1 time: 0.064737 Aug 27 02:50:59.271372 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1102/2233] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:59 2022] GET /compute/v2.1/servers/57a1e617-8846-4da8-b84f-232ffc519f69 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:50:59.274621 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-303d58de-5d46-4af4-b869-8a2eb9d26fb9 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: c2c6b214-da6b-48dd-b84c-b111611fc89a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134052) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:50:59.430855 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-303d58de-5d46-4af4-b869-8a2eb9d26fb9 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.652910 Aug 27 02:50:59.435283 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1132/2234] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 02:50:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1658 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:50:59.442973 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-562b8304-2b8d-427f-ad5d-535ed1ec4d21 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:59.443709 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-562b8304-2b8d-427f-ad5d-535ed1ec4d21 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: c2c6b214-da6b-48dd-b84c-b111611fc89a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:59.621815 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-562b8304-2b8d-427f-ad5d-535ed1ec4d21 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:59.630080 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-562b8304-2b8d-427f-ad5d-535ed1ec4d21 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/c2c6b214-da6b-48dd-b84c-b111611fc89a" status: 200 len: 1215 microversion: 2.1 time: 0.191535 Aug 27 02:50:59.637265 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1103/2235] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:59 2022] GET /compute/v2.1/servers/c2c6b214-da6b-48dd-b84c-b111611fc89a => generated 1215 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:50:59.717125 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-83e32556-5f0a-4474-97cf-fff62ba6e69c tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:59.718344 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-83e32556-5f0a-4474-97cf-fff62ba6e69c tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: a4aca2ed-a835-4f8f-96ae-c3502645425a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:59.730513 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-83e32556-5f0a-4474-97cf-fff62ba6e69c tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:59.731409 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-83e32556-5f0a-4474-97cf-fff62ba6e69c tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:59.732025 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-83e32556-5f0a-4474-97cf-fff62ba6e69c tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:59.732933 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-83e32556-5f0a-4474-97cf-fff62ba6e69c tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:59.733537 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-83e32556-5f0a-4474-97cf-fff62ba6e69c tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:59.734101 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-83e32556-5f0a-4474-97cf-fff62ba6e69c tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:00.032987 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-83e32556-5f0a-4474-97cf-fff62ba6e69c tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:00.042055 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-83e32556-5f0a-4474-97cf-fff62ba6e69c tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/a4aca2ed-a835-4f8f-96ae-c3502645425a" status: 200 len: 1529 microversion: 2.1 time: 0.329240 Aug 27 02:51:00.046610 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1133/2236] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:59 2022] GET /compute/v2.1/servers/a4aca2ed-a835-4f8f-96ae-c3502645425a => generated 1529 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:00.063522 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0542c091-3c63-452b-9939-c61d4674bf0b tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:00.064779 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-0542c091-3c63-452b-9939-c61d4674bf0b tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: a4aca2ed-a835-4f8f-96ae-c3502645425a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:00.076383 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0542c091-3c63-452b-9939-c61d4674bf0b tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:00.080719 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0542c091-3c63-452b-9939-c61d4674bf0b tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:00.081180 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0542c091-3c63-452b-9939-c61d4674bf0b tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:00.082000 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0542c091-3c63-452b-9939-c61d4674bf0b tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:00.085761 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0542c091-3c63-452b-9939-c61d4674bf0b tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:00.086224 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0542c091-3c63-452b-9939-c61d4674bf0b tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:00.225145 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-04f1f2ee-7463-47d4-8b1a-f0e0c0d2838a tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:00.225971 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-04f1f2ee-7463-47d4-8b1a-f0e0c0d2838a tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:00.234895 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-04f1f2ee-7463-47d4-8b1a-f0e0c0d2838a tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:00.235793 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-04f1f2ee-7463-47d4-8b1a-f0e0c0d2838a tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:00.236477 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-04f1f2ee-7463-47d4-8b1a-f0e0c0d2838a tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:00.237392 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-04f1f2ee-7463-47d4-8b1a-f0e0c0d2838a tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:00.238340 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-04f1f2ee-7463-47d4-8b1a-f0e0c0d2838a tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:00.238967 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-04f1f2ee-7463-47d4-8b1a-f0e0c0d2838a tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:00.421430 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-0542c091-3c63-452b-9939-c61d4674bf0b tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:00.435100 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-0542c091-3c63-452b-9939-c61d4674bf0b tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/a4aca2ed-a835-4f8f-96ae-c3502645425a" status: 200 len: 1529 microversion: 2.1 time: 0.375577 Aug 27 02:51:00.449661 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1104/2237] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:00 2022] GET /compute/v2.1/servers/a4aca2ed-a835-4f8f-96ae-c3502645425a => generated 1529 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:00.457975 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-240fd755-25f6-4a26-99cc-555c9f815282 tempest-MigrationsAdminTest-1330282624 tempest-MigrationsAdminTest-1330282624-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:00.515690 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-240fd755-25f6-4a26-99cc-555c9f815282 tempest-MigrationsAdminTest-1330282624 tempest-MigrationsAdminTest-1330282624-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/73af9b1d-3c67-43df-9c7c-648e48a6eacb" status: 202 len: 0 microversion: 2.1 time: 0.062095 Aug 27 02:51:00.518654 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1105/2238] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:51:00 2022] DELETE /compute/v2.1/flavors/73af9b1d-3c67-43df-9c7c-648e48a6eacb => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:51:00.528438 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-10f72bf3-6abd-4b93-97ba-0ce21690d368 tempest-MigrationsAdminTest-1330282624 tempest-MigrationsAdminTest-1330282624-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:00.545848 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-04f1f2ee-7463-47d4-8b1a-f0e0c0d2838a tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:00.565367 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-04f1f2ee-7463-47d4-8b1a-f0e0c0d2838a tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1362 microversion: 2.1 time: 0.344584 Aug 27 02:51:00.580337 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1134/2239] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:00 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1362 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:00.601769 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-10f72bf3-6abd-4b93-97ba-0ce21690d368 tempest-MigrationsAdminTest-1330282624 tempest-MigrationsAdminTest-1330282624-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.077654 Aug 27 02:51:00.615656 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1106/2240] 10.222.0.70 () {58 vars in 1146 bytes} [Sat Aug 27 02:51:00 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:00.627629 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-019ddf59-4c1e-45fa-8175-e404cdedceab tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:51:00.630332 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-019ddf59-4c1e-45fa-8175-e404cdedceab tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: a4aca2ed-a835-4f8f-96ae-c3502645425a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:00.650443 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-41579de8-c934-497e-976d-31295ca463c4 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:00.651430 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-41579de8-c934-497e-976d-31295ca463c4 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: c2c6b214-da6b-48dd-b84c-b111611fc89a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:00.658494 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-019ddf59-4c1e-45fa-8175-e404cdedceab tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:00.659237 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-019ddf59-4c1e-45fa-8175-e404cdedceab tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:00.660579 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-019ddf59-4c1e-45fa-8175-e404cdedceab tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:00.666014 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-019ddf59-4c1e-45fa-8175-e404cdedceab tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:00.666412 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-019ddf59-4c1e-45fa-8175-e404cdedceab tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:00.666862 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-019ddf59-4c1e-45fa-8175-e404cdedceab tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:00.671516 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-41579de8-c934-497e-976d-31295ca463c4 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:00.672096 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-41579de8-c934-497e-976d-31295ca463c4 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:00.672577 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-41579de8-c934-497e-976d-31295ca463c4 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:00.673444 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-41579de8-c934-497e-976d-31295ca463c4 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:00.673782 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-41579de8-c934-497e-976d-31295ca463c4 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:00.674210 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-41579de8-c934-497e-976d-31295ca463c4 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:00.758414 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-019ddf59-4c1e-45fa-8175-e404cdedceab tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:00.793002 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-019ddf59-4c1e-45fa-8175-e404cdedceab tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: a4aca2ed-a835-4f8f-96ae-c3502645425a] Old instance type tempest-test_resize_flavor_-1404262036, new instance type m1.heat {{(pid=134052) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 27 02:51:00.801758 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-019ddf59-4c1e-45fa-8175-e404cdedceab tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Flavor limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:51:00.802187 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-019ddf59-4c1e-45fa-8175-e404cdedceab tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Image limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:51:00.802660 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-019ddf59-4c1e-45fa-8175-e404cdedceab tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Flavor pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:51:00.808037 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-019ddf59-4c1e-45fa-8175-e404cdedceab tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Image pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:51:00.815094 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-019ddf59-4c1e-45fa-8175-e404cdedceab tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:51:00.821259 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-41579de8-c934-497e-976d-31295ca463c4 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:00.838289 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-41579de8-c934-497e-976d-31295ca463c4 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/c2c6b214-da6b-48dd-b84c-b111611fc89a" status: 200 len: 1219 microversion: 2.1 time: 0.191829 Aug 27 02:51:00.844655 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1107/2241] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:00 2022] GET /compute/v2.1/servers/c2c6b214-da6b-48dd-b84c-b111611fc89a => generated 1219 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:51:01.040842 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-019ddf59-4c1e-45fa-8175-e404cdedceab tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "POST /compute/v2.1/servers/a4aca2ed-a835-4f8f-96ae-c3502645425a/action" status: 202 len: 0 microversion: 2.1 time: 0.419760 Aug 27 02:51:01.041475 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1135/2242] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 02:51:00 2022] POST /compute/v2.1/servers/a4aca2ed-a835-4f8f-96ae-c3502645425a/action => generated 0 bytes in 422 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:51:01.050125 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-5d6c24c9-79c4-4831-8211-7b0ebbf1df96 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:01.051621 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-5d6c24c9-79c4-4831-8211-7b0ebbf1df96 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: a4aca2ed-a835-4f8f-96ae-c3502645425a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:01.064397 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5d6c24c9-79c4-4831-8211-7b0ebbf1df96 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:01.065102 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5d6c24c9-79c4-4831-8211-7b0ebbf1df96 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:01.071228 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5d6c24c9-79c4-4831-8211-7b0ebbf1df96 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:01.073168 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5d6c24c9-79c4-4831-8211-7b0ebbf1df96 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:01.073666 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5d6c24c9-79c4-4831-8211-7b0ebbf1df96 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:01.082189 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5d6c24c9-79c4-4831-8211-7b0ebbf1df96 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:01.591358 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ded125bc-1654-4268-a45c-64b923cf9bf4 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:01.592133 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-ded125bc-1654-4268-a45c-64b923cf9bf4 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:01.598180 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-5d6c24c9-79c4-4831-8211-7b0ebbf1df96 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:01.604698 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ded125bc-1654-4268-a45c-64b923cf9bf4 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:01.605610 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ded125bc-1654-4268-a45c-64b923cf9bf4 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:01.606636 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ded125bc-1654-4268-a45c-64b923cf9bf4 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:01.609301 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ded125bc-1654-4268-a45c-64b923cf9bf4 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:01.609942 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ded125bc-1654-4268-a45c-64b923cf9bf4 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:01.610720 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-5d6c24c9-79c4-4831-8211-7b0ebbf1df96 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/a4aca2ed-a835-4f8f-96ae-c3502645425a" status: 200 len: 1538 microversion: 2.1 time: 0.564591 Aug 27 02:51:01.611331 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ded125bc-1654-4268-a45c-64b923cf9bf4 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:01.638207 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1108/2243] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:01 2022] GET /compute/v2.1/servers/a4aca2ed-a835-4f8f-96ae-c3502645425a => generated 1538 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:01.868864 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7711414b-5ec6-41fc-8af1-e7590dfead84 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:01.870074 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-7711414b-5ec6-41fc-8af1-e7590dfead84 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: c2c6b214-da6b-48dd-b84c-b111611fc89a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:01.880442 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7711414b-5ec6-41fc-8af1-e7590dfead84 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:01.883793 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7711414b-5ec6-41fc-8af1-e7590dfead84 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:01.885812 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7711414b-5ec6-41fc-8af1-e7590dfead84 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:01.888951 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7711414b-5ec6-41fc-8af1-e7590dfead84 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:01.892523 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7711414b-5ec6-41fc-8af1-e7590dfead84 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:01.893351 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7711414b-5ec6-41fc-8af1-e7590dfead84 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:02.006064 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-ded125bc-1654-4268-a45c-64b923cf9bf4 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:02.020556 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ded125bc-1654-4268-a45c-64b923cf9bf4 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1362 microversion: 2.1 time: 0.432546 Aug 27 02:51:02.022860 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1136/2244] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:01 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1362 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:51:02.133007 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-7711414b-5ec6-41fc-8af1-e7590dfead84 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:02.142464 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-7711414b-5ec6-41fc-8af1-e7590dfead84 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/c2c6b214-da6b-48dd-b84c-b111611fc89a" status: 200 len: 1273 microversion: 2.1 time: 0.278277 Aug 27 02:51:02.143068 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1109/2245] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:01 2022] GET /compute/v2.1/servers/c2c6b214-da6b-48dd-b84c-b111611fc89a => generated 1273 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:51:02.634048 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8bc163ea-bef5-428f-ae9b-ca70f1958878 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:02.636502 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-8bc163ea-bef5-428f-ae9b-ca70f1958878 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: a4aca2ed-a835-4f8f-96ae-c3502645425a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:02.686614 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8bc163ea-bef5-428f-ae9b-ca70f1958878 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:02.691868 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8bc163ea-bef5-428f-ae9b-ca70f1958878 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:02.692712 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8bc163ea-bef5-428f-ae9b-ca70f1958878 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:02.697429 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8bc163ea-bef5-428f-ae9b-ca70f1958878 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:02.701320 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8bc163ea-bef5-428f-ae9b-ca70f1958878 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:02.705869 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8bc163ea-bef5-428f-ae9b-ca70f1958878 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:03.044039 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-1d45cfee-3397-49ac-96ae-eec2b0603aa5 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:03.044694 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-1d45cfee-3397-49ac-96ae-eec2b0603aa5 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:03.052653 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1d45cfee-3397-49ac-96ae-eec2b0603aa5 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:03.053142 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1d45cfee-3397-49ac-96ae-eec2b0603aa5 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:03.060100 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1d45cfee-3397-49ac-96ae-eec2b0603aa5 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:03.061361 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1d45cfee-3397-49ac-96ae-eec2b0603aa5 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:03.061898 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1d45cfee-3397-49ac-96ae-eec2b0603aa5 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:03.062763 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1d45cfee-3397-49ac-96ae-eec2b0603aa5 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:03.595890 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-8bc163ea-bef5-428f-ae9b-ca70f1958878 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:03.610273 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-8bc163ea-bef5-428f-ae9b-ca70f1958878 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/a4aca2ed-a835-4f8f-96ae-c3502645425a" status: 200 len: 1538 microversion: 2.1 time: 0.982676 Aug 27 02:51:03.621905 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1137/2246] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:02 2022] GET /compute/v2.1/servers/a4aca2ed-a835-4f8f-96ae-c3502645425a => generated 1538 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:51:03.622711 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6451a6d7-95d5-4777-97fd-c198faba8a9a tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:03.624665 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-6451a6d7-95d5-4777-97fd-c198faba8a9a tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: c2c6b214-da6b-48dd-b84c-b111611fc89a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:03.649670 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6451a6d7-95d5-4777-97fd-c198faba8a9a tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:03.651744 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6451a6d7-95d5-4777-97fd-c198faba8a9a tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:03.652472 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6451a6d7-95d5-4777-97fd-c198faba8a9a tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:03.655080 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6451a6d7-95d5-4777-97fd-c198faba8a9a tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:03.657863 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6451a6d7-95d5-4777-97fd-c198faba8a9a tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:03.658548 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6451a6d7-95d5-4777-97fd-c198faba8a9a tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:03.909945 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-6451a6d7-95d5-4777-97fd-c198faba8a9a tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:03.940088 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-1d45cfee-3397-49ac-96ae-eec2b0603aa5 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:03.955909 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-1d45cfee-3397-49ac-96ae-eec2b0603aa5 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1362 microversion: 2.1 time: 0.913383 Aug 27 02:51:03.958017 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-6451a6d7-95d5-4777-97fd-c198faba8a9a tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/c2c6b214-da6b-48dd-b84c-b111611fc89a" status: 200 len: 1273 microversion: 2.1 time: 0.345507 Aug 27 02:51:03.958614 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1138/2247] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:03 2022] GET /compute/v2.1/servers/c2c6b214-da6b-48dd-b84c-b111611fc89a => generated 1273 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:03.960615 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1110/2248] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:03 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1362 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:51:04.639778 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e62e096c-dd27-4289-873f-5aa48290337b tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:04.641468 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-e62e096c-dd27-4289-873f-5aa48290337b tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: a4aca2ed-a835-4f8f-96ae-c3502645425a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:04.660263 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e62e096c-dd27-4289-873f-5aa48290337b tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:04.661862 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e62e096c-dd27-4289-873f-5aa48290337b tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:04.663152 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e62e096c-dd27-4289-873f-5aa48290337b tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:04.665067 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e62e096c-dd27-4289-873f-5aa48290337b tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:04.665885 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e62e096c-dd27-4289-873f-5aa48290337b tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:04.667369 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e62e096c-dd27-4289-873f-5aa48290337b tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:04.855177 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-fa6e0444-8248-41ba-b25b-bb7cb36d9018 req-a1545b1f-db23-4a16-9611-145dd8fd015b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb0d71f2-158d-4acc-8774-6874e7da29cd", "name": "network-vif-plugged", "status": "completed", "tag": "fe5d48cf-956a-4e15-9a8e-fdd605d313b1"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:51:04.890943 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-fa6e0444-8248-41ba-b25b-bb7cb36d9018 req-a1545b1f-db23-4a16-9611-145dd8fd015b service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:04.896439 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-fa6e0444-8248-41ba-b25b-bb7cb36d9018 req-a1545b1f-db23-4a16-9611-145dd8fd015b service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:04.896895 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-fa6e0444-8248-41ba-b25b-bb7cb36d9018 req-a1545b1f-db23-4a16-9611-145dd8fd015b service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:04.946246 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-fa6e0444-8248-41ba-b25b-bb7cb36d9018 req-a1545b1f-db23-4a16-9611-145dd8fd015b service nova] Creating event network-vif-plugged:fe5d48cf-956a-4e15-9a8e-fdd605d313b1 for instance bb0d71f2-158d-4acc-8774-6874e7da29cd on n-h1-852278-4 Aug 27 02:51:04.962321 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-fa6e0444-8248-41ba-b25b-bb7cb36d9018 req-a1545b1f-db23-4a16-9611-145dd8fd015b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113907 Aug 27 02:51:04.963198 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1139/2249] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:51:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:51:04.987835 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8fe5348b-b9c2-4cfc-ba0a-ec41a866f9ad tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:04.989138 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-8fe5348b-b9c2-4cfc-ba0a-ec41a866f9ad tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: c2c6b214-da6b-48dd-b84c-b111611fc89a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:05.002072 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8fe5348b-b9c2-4cfc-ba0a-ec41a866f9ad tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:05.005040 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8fe5348b-b9c2-4cfc-ba0a-ec41a866f9ad tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:05.005686 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8fe5348b-b9c2-4cfc-ba0a-ec41a866f9ad tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:05.006567 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8fe5348b-b9c2-4cfc-ba0a-ec41a866f9ad tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:05.009016 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8fe5348b-b9c2-4cfc-ba0a-ec41a866f9ad tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:05.009635 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8fe5348b-b9c2-4cfc-ba0a-ec41a866f9ad tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:05.331417 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-8fe5348b-b9c2-4cfc-ba0a-ec41a866f9ad tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:05.353337 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-8fe5348b-b9c2-4cfc-ba0a-ec41a866f9ad tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/c2c6b214-da6b-48dd-b84c-b111611fc89a" status: 200 len: 1273 microversion: 2.1 time: 0.365791 Aug 27 02:51:05.368771 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1140/2250] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:04 2022] GET /compute/v2.1/servers/c2c6b214-da6b-48dd-b84c-b111611fc89a => generated 1273 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:05.403907 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-37c2594e-1aab-49c0-aa0f-b7645a6c2afe tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:05.408515 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-37c2594e-1aab-49c0-aa0f-b7645a6c2afe tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:05.424575 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-37c2594e-1aab-49c0-aa0f-b7645a6c2afe tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:05.428445 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-37c2594e-1aab-49c0-aa0f-b7645a6c2afe tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:05.428988 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-37c2594e-1aab-49c0-aa0f-b7645a6c2afe tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:05.430868 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-37c2594e-1aab-49c0-aa0f-b7645a6c2afe tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:05.431339 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-37c2594e-1aab-49c0-aa0f-b7645a6c2afe tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:05.431766 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-37c2594e-1aab-49c0-aa0f-b7645a6c2afe tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:05.512566 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:51:06.040285 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e62e096c-dd27-4289-873f-5aa48290337b tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:06.049254 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e62e096c-dd27-4289-873f-5aa48290337b tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/a4aca2ed-a835-4f8f-96ae-c3502645425a" status: 200 len: 1538 microversion: 2.1 time: 1.417989 Aug 27 02:51:06.060707 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1111/2251] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:04 2022] GET /compute/v2.1/servers/a4aca2ed-a835-4f8f-96ae-c3502645425a => generated 1538 bytes in 1431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:06.185197 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-37c2594e-1aab-49c0-aa0f-b7645a6c2afe tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:06.195097 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-37c2594e-1aab-49c0-aa0f-b7645a6c2afe tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1362 microversion: 2.1 time: 0.805182 Aug 27 02:51:06.197280 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1141/2252] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:05 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1362 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:06.388994 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-847cf785-b331-466c-a6c5-5756950fbc41 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:06.389803 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-847cf785-b331-466c-a6c5-5756950fbc41 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: c2c6b214-da6b-48dd-b84c-b111611fc89a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:06.408461 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-847cf785-b331-466c-a6c5-5756950fbc41 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:06.409227 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-847cf785-b331-466c-a6c5-5756950fbc41 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:06.409982 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-847cf785-b331-466c-a6c5-5756950fbc41 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:06.410954 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-847cf785-b331-466c-a6c5-5756950fbc41 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:06.411624 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-847cf785-b331-466c-a6c5-5756950fbc41 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:06.412913 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-847cf785-b331-466c-a6c5-5756950fbc41 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:07.077197 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ca7e68e1-4054-4a68-9e32-49b2447d4e75 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:07.078285 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-ca7e68e1-4054-4a68-9e32-49b2447d4e75 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: a4aca2ed-a835-4f8f-96ae-c3502645425a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:07.095268 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ca7e68e1-4054-4a68-9e32-49b2447d4e75 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:07.095870 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ca7e68e1-4054-4a68-9e32-49b2447d4e75 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:07.096417 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ca7e68e1-4054-4a68-9e32-49b2447d4e75 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:07.097207 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ca7e68e1-4054-4a68-9e32-49b2447d4e75 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:07.097890 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ca7e68e1-4054-4a68-9e32-49b2447d4e75 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:07.098495 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ca7e68e1-4054-4a68-9e32-49b2447d4e75 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:08.284226 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-847cf785-b331-466c-a6c5-5756950fbc41 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:08.301101 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-847cf785-b331-466c-a6c5-5756950fbc41 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/c2c6b214-da6b-48dd-b84c-b111611fc89a" status: 200 len: 1315 microversion: 2.1 time: 1.915151 Aug 27 02:51:08.302725 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1112/2253] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:06 2022] GET /compute/v2.1/servers/c2c6b214-da6b-48dd-b84c-b111611fc89a => generated 1315 bytes in 1918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:08.308900 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-5bc64837-0ba9-4d21-8244-a53048974fe0 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:08.309697 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-5bc64837-0ba9-4d21-8244-a53048974fe0 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:08.320582 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5bc64837-0ba9-4d21-8244-a53048974fe0 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:08.321429 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5bc64837-0ba9-4d21-8244-a53048974fe0 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:08.322072 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5bc64837-0ba9-4d21-8244-a53048974fe0 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:08.335218 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5bc64837-0ba9-4d21-8244-a53048974fe0 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:08.336125 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5bc64837-0ba9-4d21-8244-a53048974fe0 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:08.336825 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5bc64837-0ba9-4d21-8244-a53048974fe0 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:08.540669 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-ca7e68e1-4054-4a68-9e32-49b2447d4e75 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:08.552824 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ca7e68e1-4054-4a68-9e32-49b2447d4e75 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/a4aca2ed-a835-4f8f-96ae-c3502645425a" status: 200 len: 1538 microversion: 2.1 time: 1.479463 Aug 27 02:51:08.553426 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1142/2254] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:07 2022] GET /compute/v2.1/servers/a4aca2ed-a835-4f8f-96ae-c3502645425a => generated 1538 bytes in 1481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:08.571822 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-105329a5-8ff1-4135-b698-9a100ff4bc4a req-7b3bff37-579c-4d67-b470-e0ec840201c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2c6b214-da6b-48dd-b84c-b111611fc89a", "tag": "b44293e2-5ab8-471e-a1bb-e41d51c8e40a"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:51:08.586793 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-105329a5-8ff1-4135-b698-9a100ff4bc4a req-7b3bff37-579c-4d67-b470-e0ec840201c0 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:08.587375 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-105329a5-8ff1-4135-b698-9a100ff4bc4a req-7b3bff37-579c-4d67-b470-e0ec840201c0 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:08.587820 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-105329a5-8ff1-4135-b698-9a100ff4bc4a req-7b3bff37-579c-4d67-b470-e0ec840201c0 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:08.611749 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-105329a5-8ff1-4135-b698-9a100ff4bc4a req-7b3bff37-579c-4d67-b470-e0ec840201c0 service nova] Creating event network-changed:b44293e2-5ab8-471e-a1bb-e41d51c8e40a for instance c2c6b214-da6b-48dd-b84c-b111611fc89a on n-h1-852278-4 Aug 27 02:51:08.625567 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-105329a5-8ff1-4135-b698-9a100ff4bc4a req-7b3bff37-579c-4d67-b470-e0ec840201c0 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057715 Aug 27 02:51:08.626476 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1143/2255] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:51:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:51:08.902213 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-5bc64837-0ba9-4d21-8244-a53048974fe0 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:08.919819 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-5bc64837-0ba9-4d21-8244-a53048974fe0 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1549 microversion: 2.1 time: 0.615917 Aug 27 02:51:08.926769 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1113/2256] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:08 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1549 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:08.948696 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b85bd4ff-06b4-4176-b1b5-c3aeed130b7b tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:08.949603 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b85bd4ff-06b4-4176-b1b5-c3aeed130b7b tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:08.961949 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b85bd4ff-06b4-4176-b1b5-c3aeed130b7b tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:08.965894 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b85bd4ff-06b4-4176-b1b5-c3aeed130b7b tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:08.966604 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b85bd4ff-06b4-4176-b1b5-c3aeed130b7b tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:08.967373 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b85bd4ff-06b4-4176-b1b5-c3aeed130b7b tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:08.967814 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b85bd4ff-06b4-4176-b1b5-c3aeed130b7b tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:08.968241 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b85bd4ff-06b4-4176-b1b5-c3aeed130b7b tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:09.159927 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b85bd4ff-06b4-4176-b1b5-c3aeed130b7b tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.215737 Aug 27 02:51:09.161023 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1144/2257] 10.222.0.70 () {58 vars in 1275 bytes} [Sat Aug 27 02:51:08 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd/os-interface => generated 284 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:51:09.324872 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-df70dfca-cd89-44c3-a547-9fa347f8c0bf tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:09.325523 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-df70dfca-cd89-44c3-a547-9fa347f8c0bf tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: c2c6b214-da6b-48dd-b84c-b111611fc89a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:09.346849 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-df70dfca-cd89-44c3-a547-9fa347f8c0bf tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:09.347406 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-df70dfca-cd89-44c3-a547-9fa347f8c0bf tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:09.347854 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-df70dfca-cd89-44c3-a547-9fa347f8c0bf tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:09.348617 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-df70dfca-cd89-44c3-a547-9fa347f8c0bf tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:09.349251 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-df70dfca-cd89-44c3-a547-9fa347f8c0bf tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:09.350685 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-df70dfca-cd89-44c3-a547-9fa347f8c0bf tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:09.572018 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:51:09.573802 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=6 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:51:09.580040 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-934f5610-aa6e-4177-89a5-f0eec9f60316 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:09.580956 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-934f5610-aa6e-4177-89a5-f0eec9f60316 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: a4aca2ed-a835-4f8f-96ae-c3502645425a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:09.599290 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-934f5610-aa6e-4177-89a5-f0eec9f60316 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:09.600049 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-934f5610-aa6e-4177-89a5-f0eec9f60316 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:09.600716 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-934f5610-aa6e-4177-89a5-f0eec9f60316 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:09.602002 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-934f5610-aa6e-4177-89a5-f0eec9f60316 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:09.613846 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-934f5610-aa6e-4177-89a5-f0eec9f60316 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:09.614597 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-934f5610-aa6e-4177-89a5-f0eec9f60316 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:09.629857 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:51:10.321377 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-df70dfca-cd89-44c3-a547-9fa347f8c0bf tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:10.331057 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-df70dfca-cd89-44c3-a547-9fa347f8c0bf tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/c2c6b214-da6b-48dd-b84c-b111611fc89a" status: 200 len: 1315 microversion: 2.1 time: 1.011584 Aug 27 02:51:10.333119 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1114/2258] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:09 2022] GET /compute/v2.1/servers/c2c6b214-da6b-48dd-b84c-b111611fc89a => generated 1315 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:10.754806 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-934f5610-aa6e-4177-89a5-f0eec9f60316 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:10.801666 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-934f5610-aa6e-4177-89a5-f0eec9f60316 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/a4aca2ed-a835-4f8f-96ae-c3502645425a" status: 200 len: 1543 microversion: 2.1 time: 1.227502 Aug 27 02:51:10.808268 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1145/2259] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:09 2022] GET /compute/v2.1/servers/a4aca2ed-a835-4f8f-96ae-c3502645425a => generated 1543 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:11.353563 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7c6b4be2-8ec7-4b10-ab66-68d32cdc1746 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:11.354195 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-7c6b4be2-8ec7-4b10-ab66-68d32cdc1746 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: c2c6b214-da6b-48dd-b84c-b111611fc89a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:11.366941 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7c6b4be2-8ec7-4b10-ab66-68d32cdc1746 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:11.367436 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7c6b4be2-8ec7-4b10-ab66-68d32cdc1746 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:11.367876 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7c6b4be2-8ec7-4b10-ab66-68d32cdc1746 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:11.368634 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7c6b4be2-8ec7-4b10-ab66-68d32cdc1746 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:11.369086 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7c6b4be2-8ec7-4b10-ab66-68d32cdc1746 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:11.369509 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7c6b4be2-8ec7-4b10-ab66-68d32cdc1746 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:11.773412 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-7c6b4be2-8ec7-4b10-ab66-68d32cdc1746 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:11.789196 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-7c6b4be2-8ec7-4b10-ab66-68d32cdc1746 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/c2c6b214-da6b-48dd-b84c-b111611fc89a" status: 200 len: 1315 microversion: 2.1 time: 0.439663 Aug 27 02:51:11.802404 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1115/2260] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:11 2022] GET /compute/v2.1/servers/c2c6b214-da6b-48dd-b84c-b111611fc89a => generated 1315 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:11.840954 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5f8a6654-b65c-45a3-8158-6d8873a71311 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:11.841608 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-5f8a6654-b65c-45a3-8158-6d8873a71311 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: a4aca2ed-a835-4f8f-96ae-c3502645425a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:11.863369 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5f8a6654-b65c-45a3-8158-6d8873a71311 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:11.863886 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5f8a6654-b65c-45a3-8158-6d8873a71311 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:11.864392 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5f8a6654-b65c-45a3-8158-6d8873a71311 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:11.865164 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5f8a6654-b65c-45a3-8158-6d8873a71311 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:11.865623 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5f8a6654-b65c-45a3-8158-6d8873a71311 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:11.867079 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5f8a6654-b65c-45a3-8158-6d8873a71311 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:12.643032 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-e20dd2e1-a4ae-4aee-b684-90b8c2a200f9 req-20050525-9ca3-4710-8030-406a166aee59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb0d71f2-158d-4acc-8774-6874e7da29cd", "tag": "fe5d48cf-956a-4e15-9a8e-fdd605d313b1"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:51:12.692195 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-e20dd2e1-a4ae-4aee-b684-90b8c2a200f9 req-20050525-9ca3-4710-8030-406a166aee59 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:12.692735 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-e20dd2e1-a4ae-4aee-b684-90b8c2a200f9 req-20050525-9ca3-4710-8030-406a166aee59 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:12.694938 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-e20dd2e1-a4ae-4aee-b684-90b8c2a200f9 req-20050525-9ca3-4710-8030-406a166aee59 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:12.732758 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-e20dd2e1-a4ae-4aee-b684-90b8c2a200f9 req-20050525-9ca3-4710-8030-406a166aee59 service nova] Creating event network-changed:fe5d48cf-956a-4e15-9a8e-fdd605d313b1 for instance bb0d71f2-158d-4acc-8774-6874e7da29cd on n-h1-852278-4 Aug 27 02:51:12.752341 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-e20dd2e1-a4ae-4aee-b684-90b8c2a200f9 req-20050525-9ca3-4710-8030-406a166aee59 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118856 Aug 27 02:51:12.758539 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1116/2261] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:51:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:51:12.810893 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-25db4109-1450-4b22-ba65-11dd1756c3a4 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:12.811601 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-25db4109-1450-4b22-ba65-11dd1756c3a4 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: c2c6b214-da6b-48dd-b84c-b111611fc89a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:12.825186 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-25db4109-1450-4b22-ba65-11dd1756c3a4 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:12.825690 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-25db4109-1450-4b22-ba65-11dd1756c3a4 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:12.826130 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-25db4109-1450-4b22-ba65-11dd1756c3a4 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:12.826908 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-25db4109-1450-4b22-ba65-11dd1756c3a4 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:12.827366 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-25db4109-1450-4b22-ba65-11dd1756c3a4 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:12.827812 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-25db4109-1450-4b22-ba65-11dd1756c3a4 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:13.141880 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-5f8a6654-b65c-45a3-8158-6d8873a71311 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:13.153105 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-5f8a6654-b65c-45a3-8158-6d8873a71311 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/a4aca2ed-a835-4f8f-96ae-c3502645425a" status: 200 len: 1543 microversion: 2.1 time: 1.316696 Aug 27 02:51:13.157749 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1146/2262] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:11 2022] GET /compute/v2.1/servers/a4aca2ed-a835-4f8f-96ae-c3502645425a => generated 1543 bytes in 1323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:13.496843 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-99a87c19-14d4-4c71-9a6f-c3e8664e9bd1 tempest-FloatingIPsNegativeTestJSON-1885694057 tempest-FloatingIPsNegativeTestJSON-1885694057-project] Calling method '.version_select at 0x7f5ee718d040>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:14.258661 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-99a87c19-14d4-4c71-9a6f-c3e8664e9bd1 tempest-FloatingIPsNegativeTestJSON-1885694057 tempest-FloatingIPsNegativeTestJSON-1885694057-project] 10.222.0.70 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.833946 Aug 27 02:51:14.259240 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1147/2263] 10.222.0.70 () {58 vars in 1149 bytes} [Sat Aug 27 02:51:13 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:51:14.277695 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-29957db7-4361-4652-9b06-29f2cc2d51b4 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:14.278337 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-29957db7-4361-4652-9b06-29f2cc2d51b4 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: a4aca2ed-a835-4f8f-96ae-c3502645425a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:14.330396 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-29957db7-4361-4652-9b06-29f2cc2d51b4 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:14.336348 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-25db4109-1450-4b22-ba65-11dd1756c3a4 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:14.337882 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-29957db7-4361-4652-9b06-29f2cc2d51b4 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:14.339046 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-29957db7-4361-4652-9b06-29f2cc2d51b4 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:14.345006 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-25db4109-1450-4b22-ba65-11dd1756c3a4 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/c2c6b214-da6b-48dd-b84c-b111611fc89a" status: 200 len: 1315 microversion: 2.1 time: 1.538235 Aug 27 02:51:14.345601 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1117/2264] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:12 2022] GET /compute/v2.1/servers/c2c6b214-da6b-48dd-b84c-b111611fc89a => generated 1315 bytes in 1540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:14.350666 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-29957db7-4361-4652-9b06-29f2cc2d51b4 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:14.352462 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-29957db7-4361-4652-9b06-29f2cc2d51b4 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:14.353601 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-29957db7-4361-4652-9b06-29f2cc2d51b4 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:14.370143 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-23162761-0bbb-4089-83c0-4ee262129649 tempest-FloatingIPsNegativeTestJSON-1885694057 tempest-FloatingIPsNegativeTestJSON-1885694057-project] Action: 'create', calling method: .version_select at 0x7f5ede90d8b0>, body: {"pool": "non_exist_pool"} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:51:14.576144 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-23162761-0bbb-4089-83c0-4ee262129649 tempest-FloatingIPsNegativeTestJSON-1885694057 tempest-FloatingIPsNegativeTestJSON-1885694057-project] HTTP exception thrown: Floating IP pool not found. Aug 27 02:51:14.576144 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-23162761-0bbb-4089-83c0-4ee262129649 tempest-FloatingIPsNegativeTestJSON-1885694057 tempest-FloatingIPsNegativeTestJSON-1885694057-project] Request method failure captured: Aug 27 02:51:14.576144 n-d-852278-4 devstack@n-api.service[134051]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Aug 27 02:51:14.576144 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:51:14.576144 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:51:14.576144 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:51:14.576144 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 26 Aug 27 02:51:14.576144 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:51:14.576144 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:51:14.576144 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:51:14.576144 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:51:14.576144 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYahicU4Jm3J7TyUIfb74rQbe9SzMxV8gcUQrQ0pbcpyFtItUgUWOcK4HVR3aSpdoIDJN8VVr6-vTilglW0qrpt_jtqL5kJ01E3tt46FtRJ9zVyEotK43kLSxCOTaHh9y74Oy7MQWmsy4-_ENwOZ496n_6XM1o_owDX098MzGMsd4Yw Aug 27 02:51:14.576144 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:51:14.576144 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:51:14.576144 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:51:14.576144 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:51:14.576144 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:51:14.576144 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:51:14.576144 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: f5c8674829514550897b39f9916229c9 Aug 27 02:51:14.576144 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1885694057 Aug 27 02:51:14.576144 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:51:14.576144 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:51:14.576144 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f5c8674829514550897b39f9916229c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f5c8674829514550897b39f9916229c9", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f5c8674829514550897b39f9916229c9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f5c8674829514550897b39f9916229c9"}]}] Aug 27 02:51:14.576144 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1885694057 Aug 27 02:51:14.576144 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: f5c8674829514550897b39f9916229c9 Aug 27 02:51:14.576144 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1885694057 Aug 27 02:51:14.576144 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-FloatingIPsNegativeTestJSON-1885694057-project Aug 27 02:51:14.576144 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:51:14.576144 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:51:14.576144 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 742e6cd9be47456b9735a3e7dde31caa Aug 27 02:51:14.576144 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1885694057-project Aug 27 02:51:14.576144 n-d-852278-4 devstack@n-api.service[134051]: Aug 27 02:51:14.576144 n-d-852278-4 devstack@n-api.service[134051]: {"pool": "non_exist_pool"} Aug 27 02:51:14.576144 n-d-852278-4 devstack@n-api.service[134051]: method: Aug 27 02:51:14.576144 n-d-852278-4 devstack@n-api.service[134051]: exception: Floating IP pool not found. Aug 27 02:51:14.576144 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'body': {'pool': 'non_exist_pool'}} Aug 27 02:51:14.576144 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:51:14.576144 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:51:14.576144 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Aug 27 02:51:14.576144 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Aug 27 02:51:14.576144 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2975, in allocate_floating_ip Aug 27 02:51:14.576144 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Aug 27 02:51:14.576144 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2965, in _get_floating_ip_pool_id_by_name_or_id Aug 27 02:51:14.576144 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Aug 27 02:51:14.576144 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Aug 27 02:51:14.576144 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:51:14.576144 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:51:14.576144 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:51:14.576144 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:51:14.576144 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:51:14.576144 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:51:14.576144 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:51:14.576144 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:51:14.576144 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:51:14.576144 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:51:14.576144 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:51:14.576144 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:51:14.576144 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Aug 27 02:51:14.576144 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:51:14.576144 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Aug 27 02:51:14.576144 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:51:14.576144 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:51:14.576144 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:51:14.576144 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:51:14.576144 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:51:14.580670 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:51:14.580670 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:51:14.580670 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:51:14.580670 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Aug 27 02:51:14.580670 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:51:14.580670 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-23162761-0bbb-4089-83c0-4ee262129649 tempest-FloatingIPsNegativeTestJSON-1885694057 tempest-FloatingIPsNegativeTestJSON-1885694057-project] Returning 404 to user: Floating IP pool not found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:51:14.580670 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-23162761-0bbb-4089-83c0-4ee262129649 tempest-FloatingIPsNegativeTestJSON-1885694057 tempest-FloatingIPsNegativeTestJSON-1885694057-project] 10.222.0.70 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.208925 Aug 27 02:51:14.580670 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1118/2265] 10.222.0.70 () {60 vars in 1170 bytes} [Sat Aug 27 02:51:14 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 210 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 02:51:14.582233 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-078e06e8-03fe-4771-9ee3-31e029b558e0 tempest-FloatingIPsNegativeTestJSON-1885694057 tempest-FloatingIPsNegativeTestJSON-1885694057-project] Calling method '.version_select at 0x7f5ede981a60>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:14.831147 n-d-852278-4 devstack@n-api.service[134051]: DEBUG neutronclient.v2_0.client [None req-078e06e8-03fe-4771-9ee3-31e029b558e0 tempest-FloatingIPsNegativeTestJSON-1885694057 tempest-FloatingIPsNegativeTestJSON-1885694057-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 57ee6a9c-e9d2-4d6a-bbfd-092bf19a1c60 could not be found", "detail": ""}} {{(pid=134051) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 02:51:14.833495 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-078e06e8-03fe-4771-9ee3-31e029b558e0 tempest-FloatingIPsNegativeTestJSON-1885694057 tempest-FloatingIPsNegativeTestJSON-1885694057-project] HTTP exception thrown: Floating IP not found for ID 57ee6a9c-e9d2-4d6a-bbfd-092bf19a1c60 Aug 27 02:51:14.835585 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-078e06e8-03fe-4771-9ee3-31e029b558e0 tempest-FloatingIPsNegativeTestJSON-1885694057 tempest-FloatingIPsNegativeTestJSON-1885694057-project] Request method failure captured: Aug 27 02:51:14.835585 n-d-852278-4 devstack@n-api.service[134051]: request: DELETE /compute/v2.1/os-floating-ips/57ee6a9c-e9d2-4d6a-bbfd-092bf19a1c60 HTTP/1.1 Aug 27 02:51:14.835585 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:51:14.835585 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:51:14.835585 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:51:14.835585 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:51:14.835585 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:51:14.835585 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:51:14.835585 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:51:14.835585 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:51:14.835585 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYahicU4Jm3J7TyUIfb74rQbe9SzMxV8gcUQrQ0pbcpyFtItUgUWOcK4HVR3aSpdoIDJN8VVr6-vTilglW0qrpt_jtqL5kJ01E3tt46FtRJ9zVyEotK43kLSxCOTaHh9y74Oy7MQWmsy4-_ENwOZ496n_6XM1o_owDX098MzGMsd4Yw Aug 27 02:51:14.835585 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:51:14.835585 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:51:14.835585 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:51:14.835585 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:51:14.835585 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:51:14.835585 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:51:14.835585 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: f5c8674829514550897b39f9916229c9 Aug 27 02:51:14.835585 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1885694057 Aug 27 02:51:14.835585 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:51:14.835585 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:51:14.835585 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f5c8674829514550897b39f9916229c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f5c8674829514550897b39f9916229c9", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f5c8674829514550897b39f9916229c9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f5c8674829514550897b39f9916229c9"}]}] Aug 27 02:51:14.835585 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1885694057 Aug 27 02:51:14.835585 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: f5c8674829514550897b39f9916229c9 Aug 27 02:51:14.835585 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1885694057 Aug 27 02:51:14.835585 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-FloatingIPsNegativeTestJSON-1885694057-project Aug 27 02:51:14.835585 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:51:14.835585 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:51:14.835585 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 742e6cd9be47456b9735a3e7dde31caa Aug 27 02:51:14.835585 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1885694057-project Aug 27 02:51:14.835585 n-d-852278-4 devstack@n-api.service[134051]: method: Aug 27 02:51:14.835585 n-d-852278-4 devstack@n-api.service[134051]: exception: Floating IP not found for ID 57ee6a9c-e9d2-4d6a-bbfd-092bf19a1c60 Aug 27 02:51:14.835585 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '57ee6a9c-e9d2-4d6a-bbfd-092bf19a1c60'} Aug 27 02:51:14.835585 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:51:14.835585 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:51:14.835585 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 27 02:51:14.835585 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 27 02:51:14.835585 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:51:14.835585 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:51:14.835585 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 27 02:51:14.835585 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 27 02:51:14.835585 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:51:14.835585 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:51:14.835585 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 02:51:14.835585 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 02:51:14.835585 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:51:14.835585 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:51:14.835585 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 02:51:14.835585 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 02:51:14.835585 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:51:14.835585 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:51:14.835585 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 02:51:14.835585 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 02:51:14.835585 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:51:14.835585 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:51:14.835585 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 02:51:14.835585 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 02:51:14.835585 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 02:51:14.835585 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 02:51:14.835585 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 57ee6a9c-e9d2-4d6a-bbfd-092bf19a1c60 could not be found Aug 27 02:51:14.835585 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7967f407-6775-4232-8ab2-c77b4c4a75e9'] Aug 27 02:51:14.839659 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:51:14.839659 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:51:14.839659 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:51:14.839659 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:51:14.839659 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Aug 27 02:51:14.839659 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 27 02:51:14.839659 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 27 02:51:14.839659 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 27 02:51:14.839659 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 57ee6a9c-e9d2-4d6a-bbfd-092bf19a1c60. Aug 27 02:51:14.839659 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:51:14.839659 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:51:14.839659 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:51:14.839659 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:51:14.839659 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:51:14.839659 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:51:14.839659 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:51:14.839659 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:51:14.839659 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:51:14.839659 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:51:14.839659 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:51:14.839659 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:51:14.839659 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Aug 27 02:51:14.839659 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 27 02:51:14.839659 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 57ee6a9c-e9d2-4d6a-bbfd-092bf19a1c60 Aug 27 02:51:14.839659 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:51:14.839659 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:51:14.839659 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:51:14.839659 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:51:14.839659 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:51:14.839659 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:51:14.839659 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:51:14.839659 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:51:14.839659 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 57ee6a9c-e9d2-4d6a-bbfd-092bf19a1c60 Aug 27 02:51:14.839659 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:51:14.848195 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-078e06e8-03fe-4771-9ee3-31e029b558e0 tempest-FloatingIPsNegativeTestJSON-1885694057 tempest-FloatingIPsNegativeTestJSON-1885694057-project] Returning 404 to user: Floating IP not found for ID 57ee6a9c-e9d2-4d6a-bbfd-092bf19a1c60 {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:51:14.850752 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-078e06e8-03fe-4771-9ee3-31e029b558e0 tempest-FloatingIPsNegativeTestJSON-1885694057 tempest-FloatingIPsNegativeTestJSON-1885694057-project] 10.222.0.70 "DELETE /compute/v2.1/os-floating-ips/57ee6a9c-e9d2-4d6a-bbfd-092bf19a1c60" status: 404 len: 111 microversion: 2.1 time: 0.272970 Aug 27 02:51:14.854324 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1119/2266] 10.222.0.70 () {58 vars in 1263 bytes} [Sat Aug 27 02:51:14 2022] DELETE /compute/v2.1/os-floating-ips/57ee6a9c-e9d2-4d6a-bbfd-092bf19a1c60 => generated 111 bytes in 277 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:51:15.062697 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-29957db7-4361-4652-9b06-29f2cc2d51b4 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:15.074867 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-29957db7-4361-4652-9b06-29f2cc2d51b4 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/a4aca2ed-a835-4f8f-96ae-c3502645425a" status: 200 len: 1543 microversion: 2.1 time: 0.814410 Aug 27 02:51:15.076054 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1148/2267] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:14 2022] GET /compute/v2.1/servers/a4aca2ed-a835-4f8f-96ae-c3502645425a => generated 1543 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:15.387238 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-bf204889-3769-4b1b-975b-fab2819c5f08 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:15.388569 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-bf204889-3769-4b1b-975b-fab2819c5f08 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: c2c6b214-da6b-48dd-b84c-b111611fc89a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:15.401958 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bf204889-3769-4b1b-975b-fab2819c5f08 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:15.404364 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bf204889-3769-4b1b-975b-fab2819c5f08 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:15.406924 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bf204889-3769-4b1b-975b-fab2819c5f08 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:15.407833 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bf204889-3769-4b1b-975b-fab2819c5f08 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:15.408597 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bf204889-3769-4b1b-975b-fab2819c5f08 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:15.409242 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bf204889-3769-4b1b-975b-fab2819c5f08 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:15.467592 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=100 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:51:16.112210 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6371fc10-0155-422b-97b0-62449fb13594 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:16.113362 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-6371fc10-0155-422b-97b0-62449fb13594 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: a4aca2ed-a835-4f8f-96ae-c3502645425a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:16.124953 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6371fc10-0155-422b-97b0-62449fb13594 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:16.132648 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6371fc10-0155-422b-97b0-62449fb13594 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:16.133191 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6371fc10-0155-422b-97b0-62449fb13594 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:16.134118 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6371fc10-0155-422b-97b0-62449fb13594 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:16.134586 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6371fc10-0155-422b-97b0-62449fb13594 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:16.135707 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6371fc10-0155-422b-97b0-62449fb13594 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:16.391380 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-bf204889-3769-4b1b-975b-fab2819c5f08 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:16.402850 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-bf204889-3769-4b1b-975b-fab2819c5f08 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/c2c6b214-da6b-48dd-b84c-b111611fc89a" status: 200 len: 1315 microversion: 2.1 time: 1.020841 Aug 27 02:51:16.404352 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1120/2268] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:15 2022] GET /compute/v2.1/servers/c2c6b214-da6b-48dd-b84c-b111611fc89a => generated 1315 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:16.539794 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-6371fc10-0155-422b-97b0-62449fb13594 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:16.547902 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-6371fc10-0155-422b-97b0-62449fb13594 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/a4aca2ed-a835-4f8f-96ae-c3502645425a" status: 200 len: 1543 microversion: 2.1 time: 0.439595 Aug 27 02:51:16.567847 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1149/2269] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:16 2022] GET /compute/v2.1/servers/a4aca2ed-a835-4f8f-96ae-c3502645425a => generated 1543 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:17.271677 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-0b44d737-f227-4b8a-bdaa-ddde21314bc1 req-e53db5b6-14ef-4cee-af94-0d7f5ab8d4c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2c6b214-da6b-48dd-b84c-b111611fc89a", "name": "network-vif-plugged", "status": "completed", "tag": "b44293e2-5ab8-471e-a1bb-e41d51c8e40a"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:51:17.293419 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-0b44d737-f227-4b8a-bdaa-ddde21314bc1 req-e53db5b6-14ef-4cee-af94-0d7f5ab8d4c4 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:17.294123 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-0b44d737-f227-4b8a-bdaa-ddde21314bc1 req-e53db5b6-14ef-4cee-af94-0d7f5ab8d4c4 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:17.294756 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-0b44d737-f227-4b8a-bdaa-ddde21314bc1 req-e53db5b6-14ef-4cee-af94-0d7f5ab8d4c4 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:17.340824 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-0b44d737-f227-4b8a-bdaa-ddde21314bc1 req-e53db5b6-14ef-4cee-af94-0d7f5ab8d4c4 service nova] Creating event network-vif-plugged:b44293e2-5ab8-471e-a1bb-e41d51c8e40a for instance c2c6b214-da6b-48dd-b84c-b111611fc89a on n-h1-852278-4 Aug 27 02:51:17.358477 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-0b44d737-f227-4b8a-bdaa-ddde21314bc1 req-e53db5b6-14ef-4cee-af94-0d7f5ab8d4c4 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084687 Aug 27 02:51:17.360958 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1121/2270] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:51:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:51:17.430099 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6a587c58-b79f-46e0-9bf0-f8620983e10c tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:17.431298 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-6a587c58-b79f-46e0-9bf0-f8620983e10c tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: c2c6b214-da6b-48dd-b84c-b111611fc89a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:17.446263 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6a587c58-b79f-46e0-9bf0-f8620983e10c tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:17.447023 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6a587c58-b79f-46e0-9bf0-f8620983e10c tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:17.447613 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6a587c58-b79f-46e0-9bf0-f8620983e10c tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:17.448562 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6a587c58-b79f-46e0-9bf0-f8620983e10c tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:17.449029 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6a587c58-b79f-46e0-9bf0-f8620983e10c tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:17.449465 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6a587c58-b79f-46e0-9bf0-f8620983e10c tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:17.576298 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-90a5911a-a08e-4c85-901b-a5bc693e2dc1 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:17.578624 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-90a5911a-a08e-4c85-901b-a5bc693e2dc1 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: a4aca2ed-a835-4f8f-96ae-c3502645425a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:17.592080 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-90a5911a-a08e-4c85-901b-a5bc693e2dc1 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:17.601038 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-90a5911a-a08e-4c85-901b-a5bc693e2dc1 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:17.601857 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-90a5911a-a08e-4c85-901b-a5bc693e2dc1 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:17.606124 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-90a5911a-a08e-4c85-901b-a5bc693e2dc1 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:17.606897 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-90a5911a-a08e-4c85-901b-a5bc693e2dc1 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:17.612950 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-90a5911a-a08e-4c85-901b-a5bc693e2dc1 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:18.089078 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-6a587c58-b79f-46e0-9bf0-f8620983e10c tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:18.097373 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-6a587c58-b79f-46e0-9bf0-f8620983e10c tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/c2c6b214-da6b-48dd-b84c-b111611fc89a" status: 200 len: 1315 microversion: 2.1 time: 0.672479 Aug 27 02:51:18.100659 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1150/2271] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:17 2022] GET /compute/v2.1/servers/c2c6b214-da6b-48dd-b84c-b111611fc89a => generated 1315 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:18.396169 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-90a5911a-a08e-4c85-901b-a5bc693e2dc1 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:18.422457 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-90a5911a-a08e-4c85-901b-a5bc693e2dc1 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/a4aca2ed-a835-4f8f-96ae-c3502645425a" status: 200 len: 1543 microversion: 2.1 time: 0.844597 Aug 27 02:51:18.423122 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1122/2272] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:17 2022] GET /compute/v2.1/servers/a4aca2ed-a835-4f8f-96ae-c3502645425a => generated 1543 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:51:19.122578 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f1e0e339-6c79-4d22-b20a-0a8a6126ce8a tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:19.124305 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-f1e0e339-6c79-4d22-b20a-0a8a6126ce8a tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: c2c6b214-da6b-48dd-b84c-b111611fc89a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:19.135224 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f1e0e339-6c79-4d22-b20a-0a8a6126ce8a tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:19.136737 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f1e0e339-6c79-4d22-b20a-0a8a6126ce8a tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:19.137594 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f1e0e339-6c79-4d22-b20a-0a8a6126ce8a tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:19.140209 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f1e0e339-6c79-4d22-b20a-0a8a6126ce8a tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:19.141922 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f1e0e339-6c79-4d22-b20a-0a8a6126ce8a tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:19.144581 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f1e0e339-6c79-4d22-b20a-0a8a6126ce8a tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:19.356185 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0028b65e-5672-4225-bd7a-50693860f43d tempest-ImagesMetadataNegativeTestJSON-352148844 tempest-ImagesMetadataNegativeTestJSON-352148844-project] Calling method '.version_select at 0x7f5ee359ac10>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:19.412839 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-0028b65e-5672-4225-bd7a-50693860f43d tempest-ImagesMetadataNegativeTestJSON-352148844 tempest-ImagesMetadataNegativeTestJSON-352148844-project] HTTP exception thrown: Image not found. Aug 27 02:51:19.431028 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0028b65e-5672-4225-bd7a-50693860f43d tempest-ImagesMetadataNegativeTestJSON-352148844 tempest-ImagesMetadataNegativeTestJSON-352148844-project] Request method failure captured: Aug 27 02:51:19.431028 n-d-852278-4 devstack@n-api.service[134052]: request: DELETE /compute/v2.1/images/e3fc3a2e-3f04-4516-bdac-0ef9a4349d8c/metadata/os_distro HTTP/1.1 Aug 27 02:51:19.431028 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:51:19.431028 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:51:19.431028 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:51:19.431028 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:51:19.431028 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:51:19.431028 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:51:19.431028 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:51:19.431028 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:51:19.431028 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYamNKvuon3g634lNlmN9wMQyGPPfEA0olhuYRHo-qTunQT4NI8pEWpLS_DqRtGeFuCX-p7es8Sqd0vC7rvygbcZ6KYp43NuYbZqRXFa31zs0Xx8YfpckvyXJkPK1XS15_LFccUUKmeaZDwLBN6dCxg75_8ZYjXIFs2KZ5I-YeBJUvc Aug 27 02:51:19.431028 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:51:19.431028 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:51:19.431028 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:51:19.431028 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:51:19.431028 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:51:19.431028 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:51:19.431028 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 1f494d880c9b4e1b882a8d580e6b7598 Aug 27 02:51:19.431028 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-352148844 Aug 27 02:51:19.431028 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:51:19.431028 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:51:19.431028 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/1f494d880c9b4e1b882a8d580e6b7598"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_1f494d880c9b4e1b882a8d580e6b7598", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/1f494d880c9b4e1b882a8d580e6b7598"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/1f494d880c9b4e1b882a8d580e6b7598"}]}] Aug 27 02:51:19.431028 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-352148844 Aug 27 02:51:19.431028 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 1f494d880c9b4e1b882a8d580e6b7598 Aug 27 02:51:19.431028 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-352148844 Aug 27 02:51:19.431028 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ImagesMetadataNegativeTestJSON-352148844-project Aug 27 02:51:19.431028 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:51:19.431028 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:51:19.431028 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 602905718d6f447680b57c6afb25e40a Aug 27 02:51:19.431028 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-352148844-project Aug 27 02:51:19.431028 n-d-852278-4 devstack@n-api.service[134052]: method: Aug 27 02:51:19.431028 n-d-852278-4 devstack@n-api.service[134052]: exception: Image not found. Aug 27 02:51:19.431028 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'image_id': 'e3fc3a2e-3f04-4516-bdac-0ef9a4349d8c', 'id': 'os_distro'} Aug 27 02:51:19.431028 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:51:19.431028 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:51:19.431028 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 02:51:19.431028 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 02:51:19.431028 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 02:51:19.431028 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 02:51:19.431028 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 02:51:19.431028 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 02:51:19.431028 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 02:51:19.431028 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 02:51:19.431028 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 02:51:19.431028 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 02:51:19.431028 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 02:51:19.431028 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 02:51:19.431028 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 02:51:19.431028 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 02:51:19.431028 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 02:51:19.431028 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 02:51:19.431028 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID e3fc3a2e-3f04-4516-bdac-0ef9a4349d8c Aug 27 02:51:19.431028 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:51:19.431028 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:51:19.431028 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:51:19.431028 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:51:19.431028 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 27 02:51:19.431028 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 27 02:51:19.431028 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 27 02:51:19.431028 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 27 02:51:19.431028 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 27 02:51:19.431028 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 27 02:51:19.436767 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 27 02:51:19.436767 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 27 02:51:19.436767 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 02:51:19.436767 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 02:51:19.436767 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 02:51:19.436767 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 02:51:19.436767 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 02:51:19.436767 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 02:51:19.436767 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 02:51:19.436767 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 02:51:19.436767 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 02:51:19.436767 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 02:51:19.436767 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 02:51:19.436767 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 02:51:19.436767 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 02:51:19.436767 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 02:51:19.436767 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 02:51:19.436767 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 02:51:19.436767 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e3fc3a2e-3f04-4516-bdac-0ef9a4349d8c could not be found. Aug 27 02:51:19.436767 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:51:19.436767 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:51:19.436767 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:51:19.436767 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:51:19.436767 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:51:19.436767 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:51:19.436767 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:51:19.436767 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:51:19.436767 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:51:19.436767 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:51:19.436767 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:51:19.436767 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:51:19.436767 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Aug 27 02:51:19.436767 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 27 02:51:19.436767 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 27 02:51:19.436767 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 27 02:51:19.436767 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 02:51:19.436767 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:51:19.436767 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:51:19.436767 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:51:19.436767 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:51:19.436767 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:51:19.436767 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:51:19.436767 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:51:19.436767 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:51:19.436767 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 02:51:19.436767 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:51:19.436767 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0028b65e-5672-4225-bd7a-50693860f43d tempest-ImagesMetadataNegativeTestJSON-352148844 tempest-ImagesMetadataNegativeTestJSON-352148844-project] Returning 404 to user: Image not found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:51:19.436767 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-0028b65e-5672-4225-bd7a-50693860f43d tempest-ImagesMetadataNegativeTestJSON-352148844 tempest-ImagesMetadataNegativeTestJSON-352148844-project] 10.222.0.70 "DELETE /compute/v2.1/images/e3fc3a2e-3f04-4516-bdac-0ef9a4349d8c/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.415873 Aug 27 02:51:19.447792 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1151/2273] 10.222.0.70 () {58 vars in 1293 bytes} [Sat Aug 27 02:51:19 2022] DELETE /compute/v2.1/images/e3fc3a2e-3f04-4516-bdac-0ef9a4349d8c/metadata/os_distro => generated 62 bytes in 426 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 02:51:19.588442 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-904a4758-ce86-4801-9d42-e480eaf49f8e tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Action: 'create', calling method: .version_select at 0x7f5ee7219a60>, body: {"keypair": {"name": "tempest-keypair-1325620928", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHLFUij43buGwA9YcEkpNX/Nk2RS9PEPnwSa0zHueURvftgYBjEi5PO32hV9BhAYHv8Z+GI7WWB+MJvI2CvVwGMTr1Gg9+XjiCsOPH1MTebKp9VYcaqmIh8ae6k0R4HVhQ=="}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:51:19.621264 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-904a4758-ce86-4801-9d42-e480eaf49f8e tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Getting quotas for project 6c13c50438234109913876bf5a11d271. Resources: {'key_pairs'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:51:19.633927 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-904a4758-ce86-4801-9d42-e480eaf49f8e tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Getting quotas for user 8ece2eb399074418ac5f890d223c1be0 and project 6c13c50438234109913876bf5a11d271. Resources: {'key_pairs'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:51:19.686996 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-904a4758-ce86-4801-9d42-e480eaf49f8e tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.243862 Aug 27 02:51:19.688251 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1152/2274] 10.222.0.70 () {60 vars in 1159 bytes} [Sat Aug 27 02:51:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:51:19.695684 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-669dc6f1-956c-436a-984c-78eceb85c904 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:19.696578 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-669dc6f1-956c-436a-984c-78eceb85c904 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: a4aca2ed-a835-4f8f-96ae-c3502645425a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:19.703511 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-669dc6f1-956c-436a-984c-78eceb85c904 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:19.704260 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-669dc6f1-956c-436a-984c-78eceb85c904 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:19.704948 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-669dc6f1-956c-436a-984c-78eceb85c904 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:19.705902 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-669dc6f1-956c-436a-984c-78eceb85c904 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:19.706616 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-669dc6f1-956c-436a-984c-78eceb85c904 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:19.707261 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-669dc6f1-956c-436a-984c-78eceb85c904 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:19.788828 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-f1e0e339-6c79-4d22-b20a-0a8a6126ce8a tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:19.824205 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-f1e0e339-6c79-4d22-b20a-0a8a6126ce8a tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/c2c6b214-da6b-48dd-b84c-b111611fc89a" status: 200 len: 1315 microversion: 2.1 time: 0.703552 Aug 27 02:51:19.828724 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1123/2275] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:19 2022] GET /compute/v2.1/servers/c2c6b214-da6b-48dd-b84c-b111611fc89a => generated 1315 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:51:19.845098 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-879806dd-c9a4-4f18-8d04-1fdd035b3aab tempest-ImagesMetadataNegativeTestJSON-352148844 tempest-ImagesMetadataNegativeTestJSON-352148844-project] Calling method '.version_select at 0x7f5ede97d280>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:19.881219 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-879806dd-c9a4-4f18-8d04-1fdd035b3aab tempest-ImagesMetadataNegativeTestJSON-352148844 tempest-ImagesMetadataNegativeTestJSON-352148844-project] HTTP exception thrown: Image not found. Aug 27 02:51:19.884779 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-879806dd-c9a4-4f18-8d04-1fdd035b3aab tempest-ImagesMetadataNegativeTestJSON-352148844 tempest-ImagesMetadataNegativeTestJSON-352148844-project] Request method failure captured: Aug 27 02:51:19.884779 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/images/bbe756d8-c72c-433e-b2c3-31521e93d49c/metadata/os_version HTTP/1.1 Aug 27 02:51:19.884779 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:51:19.884779 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:51:19.884779 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:51:19.884779 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:51:19.884779 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:51:19.884779 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:51:19.884779 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:51:19.884779 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:51:19.884779 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYamNKvuon3g634lNlmN9wMQyGPPfEA0olhuYRHo-qTunQT4NI8pEWpLS_DqRtGeFuCX-p7es8Sqd0vC7rvygbcZ6KYp43NuYbZqRXFa31zs0Xx8YfpckvyXJkPK1XS15_LFccUUKmeaZDwLBN6dCxg75_8ZYjXIFs2KZ5I-YeBJUvc Aug 27 02:51:19.884779 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:51:19.884779 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:51:19.884779 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:51:19.884779 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:51:19.884779 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:51:19.884779 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:51:19.884779 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 1f494d880c9b4e1b882a8d580e6b7598 Aug 27 02:51:19.884779 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-352148844 Aug 27 02:51:19.884779 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:51:19.884779 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:51:19.884779 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/1f494d880c9b4e1b882a8d580e6b7598"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_1f494d880c9b4e1b882a8d580e6b7598", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/1f494d880c9b4e1b882a8d580e6b7598"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/1f494d880c9b4e1b882a8d580e6b7598"}]}] Aug 27 02:51:19.884779 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-352148844 Aug 27 02:51:19.884779 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 1f494d880c9b4e1b882a8d580e6b7598 Aug 27 02:51:19.884779 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-352148844 Aug 27 02:51:19.884779 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ImagesMetadataNegativeTestJSON-352148844-project Aug 27 02:51:19.884779 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:51:19.884779 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:51:19.884779 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 602905718d6f447680b57c6afb25e40a Aug 27 02:51:19.884779 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-352148844-project Aug 27 02:51:19.884779 n-d-852278-4 devstack@n-api.service[134051]: method: Aug 27 02:51:19.884779 n-d-852278-4 devstack@n-api.service[134051]: exception: Image not found. Aug 27 02:51:19.884779 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'image_id': 'bbe756d8-c72c-433e-b2c3-31521e93d49c', 'id': 'os_version'} Aug 27 02:51:19.884779 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:51:19.884779 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:51:19.884779 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 02:51:19.884779 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 02:51:19.884779 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 02:51:19.884779 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 02:51:19.884779 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 02:51:19.884779 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 02:51:19.884779 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 02:51:19.884779 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 02:51:19.884779 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 02:51:19.884779 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 02:51:19.884779 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 02:51:19.884779 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 02:51:19.884779 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 02:51:19.884779 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 02:51:19.884779 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 02:51:19.884779 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 02:51:19.884779 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID bbe756d8-c72c-433e-b2c3-31521e93d49c Aug 27 02:51:19.884779 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:51:19.884779 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:51:19.884779 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:51:19.884779 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:51:19.884779 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 27 02:51:19.884779 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 27 02:51:19.884779 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 27 02:51:19.884779 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 27 02:51:19.884779 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 27 02:51:19.884779 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 27 02:51:19.889169 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 27 02:51:19.889169 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 27 02:51:19.889169 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 02:51:19.889169 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 02:51:19.889169 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 02:51:19.889169 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 02:51:19.889169 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 02:51:19.889169 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 02:51:19.889169 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 02:51:19.889169 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 02:51:19.889169 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 02:51:19.889169 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 02:51:19.889169 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 02:51:19.889169 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 02:51:19.889169 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 02:51:19.889169 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 02:51:19.889169 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 02:51:19.889169 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 02:51:19.889169 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image bbe756d8-c72c-433e-b2c3-31521e93d49c could not be found. Aug 27 02:51:19.889169 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:51:19.889169 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:51:19.889169 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:51:19.889169 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:51:19.889169 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:51:19.889169 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:51:19.889169 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:51:19.889169 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:51:19.889169 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:51:19.889169 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:51:19.889169 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:51:19.889169 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:51:19.889169 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Aug 27 02:51:19.889169 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Aug 27 02:51:19.889169 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 27 02:51:19.889169 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 27 02:51:19.889169 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 02:51:19.889169 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:51:19.889169 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:51:19.889169 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:51:19.889169 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:51:19.889169 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:51:19.889169 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:51:19.889169 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:51:19.889169 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:51:19.889169 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 02:51:19.889169 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:51:19.893705 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-879806dd-c9a4-4f18-8d04-1fdd035b3aab tempest-ImagesMetadataNegativeTestJSON-352148844 tempest-ImagesMetadataNegativeTestJSON-352148844-project] Returning 404 to user: Image not found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:51:19.895976 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-879806dd-c9a4-4f18-8d04-1fdd035b3aab tempest-ImagesMetadataNegativeTestJSON-352148844 tempest-ImagesMetadataNegativeTestJSON-352148844-project] 10.222.0.70 "GET /compute/v2.1/images/bbe756d8-c72c-433e-b2c3-31521e93d49c/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.065911 Aug 27 02:51:19.898920 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1124/2276] 10.222.0.70 () {58 vars in 1293 bytes} [Sat Aug 27 02:51:19 2022] GET /compute/v2.1/images/bbe756d8-c72c-433e-b2c3-31521e93d49c/metadata/os_version => generated 62 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 02:51:19.910100 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-226840c2-81db-4703-8d98-37c231e8aae1 tempest-ImagesMetadataNegativeTestJSON-352148844 tempest-ImagesMetadataNegativeTestJSON-352148844-project] Calling method '.version_select at 0x7f5ee7202940>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:19.943579 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-226840c2-81db-4703-8d98-37c231e8aae1 tempest-ImagesMetadataNegativeTestJSON-352148844 tempest-ImagesMetadataNegativeTestJSON-352148844-project] HTTP exception thrown: Image not found. Aug 27 02:51:19.946550 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-226840c2-81db-4703-8d98-37c231e8aae1 tempest-ImagesMetadataNegativeTestJSON-352148844 tempest-ImagesMetadataNegativeTestJSON-352148844-project] Request method failure captured: Aug 27 02:51:19.946550 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/images/3e0a9ab6-f1bf-43e1-83be-b8f25b762a8e/metadata HTTP/1.1 Aug 27 02:51:19.946550 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:51:19.946550 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:51:19.946550 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:51:19.946550 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:51:19.946550 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:51:19.946550 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:51:19.946550 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:51:19.946550 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:51:19.946550 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYamNKvuon3g634lNlmN9wMQyGPPfEA0olhuYRHo-qTunQT4NI8pEWpLS_DqRtGeFuCX-p7es8Sqd0vC7rvygbcZ6KYp43NuYbZqRXFa31zs0Xx8YfpckvyXJkPK1XS15_LFccUUKmeaZDwLBN6dCxg75_8ZYjXIFs2KZ5I-YeBJUvc Aug 27 02:51:19.946550 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:51:19.946550 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:51:19.946550 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:51:19.946550 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:51:19.946550 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:51:19.946550 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:51:19.946550 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 1f494d880c9b4e1b882a8d580e6b7598 Aug 27 02:51:19.946550 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-352148844 Aug 27 02:51:19.946550 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:51:19.946550 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:51:19.946550 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/1f494d880c9b4e1b882a8d580e6b7598"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_1f494d880c9b4e1b882a8d580e6b7598", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/1f494d880c9b4e1b882a8d580e6b7598"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/1f494d880c9b4e1b882a8d580e6b7598"}]}] Aug 27 02:51:19.946550 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-352148844 Aug 27 02:51:19.946550 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 1f494d880c9b4e1b882a8d580e6b7598 Aug 27 02:51:19.946550 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-352148844 Aug 27 02:51:19.946550 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ImagesMetadataNegativeTestJSON-352148844-project Aug 27 02:51:19.946550 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:51:19.946550 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:51:19.946550 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 602905718d6f447680b57c6afb25e40a Aug 27 02:51:19.946550 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-352148844-project Aug 27 02:51:19.946550 n-d-852278-4 devstack@n-api.service[134051]: method: Aug 27 02:51:19.946550 n-d-852278-4 devstack@n-api.service[134051]: exception: Image not found. Aug 27 02:51:19.946550 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'image_id': '3e0a9ab6-f1bf-43e1-83be-b8f25b762a8e'} Aug 27 02:51:19.946550 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:51:19.946550 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:51:19.946550 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 02:51:19.946550 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 02:51:19.946550 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 02:51:19.946550 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 02:51:19.946550 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 02:51:19.946550 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 02:51:19.946550 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 02:51:19.946550 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 02:51:19.946550 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 02:51:19.946550 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 02:51:19.946550 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 02:51:19.946550 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 02:51:19.946550 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 02:51:19.946550 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 02:51:19.946550 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 02:51:19.946550 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 02:51:19.946550 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 3e0a9ab6-f1bf-43e1-83be-b8f25b762a8e Aug 27 02:51:19.946550 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:51:19.946550 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:51:19.946550 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:51:19.946550 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:51:19.946550 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 27 02:51:19.946550 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 27 02:51:19.946550 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 27 02:51:19.946550 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 27 02:51:19.946550 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 27 02:51:19.946550 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 27 02:51:19.950288 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 27 02:51:19.950288 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 27 02:51:19.950288 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 02:51:19.950288 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 02:51:19.950288 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 02:51:19.950288 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 02:51:19.950288 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 02:51:19.950288 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 02:51:19.950288 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 02:51:19.950288 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 02:51:19.950288 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 02:51:19.950288 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 02:51:19.950288 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 02:51:19.950288 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 02:51:19.950288 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 02:51:19.950288 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 02:51:19.950288 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 02:51:19.950288 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 02:51:19.950288 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 3e0a9ab6-f1bf-43e1-83be-b8f25b762a8e could not be found. Aug 27 02:51:19.950288 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:51:19.950288 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:51:19.950288 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:51:19.950288 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:51:19.950288 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:51:19.950288 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:51:19.950288 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:51:19.950288 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:51:19.950288 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:51:19.950288 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:51:19.950288 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:51:19.950288 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:51:19.950288 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Aug 27 02:51:19.950288 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Aug 27 02:51:19.950288 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 27 02:51:19.950288 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 27 02:51:19.950288 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 02:51:19.950288 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:51:19.950288 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:51:19.950288 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:51:19.950288 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:51:19.950288 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:51:19.950288 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:51:19.950288 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:51:19.950288 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:51:19.950288 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 02:51:19.950288 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:51:19.956719 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-226840c2-81db-4703-8d98-37c231e8aae1 tempest-ImagesMetadataNegativeTestJSON-352148844 tempest-ImagesMetadataNegativeTestJSON-352148844-project] Returning 404 to user: Image not found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:51:19.957914 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-226840c2-81db-4703-8d98-37c231e8aae1 tempest-ImagesMetadataNegativeTestJSON-352148844 tempest-ImagesMetadataNegativeTestJSON-352148844-project] 10.222.0.70 "GET /compute/v2.1/images/3e0a9ab6-f1bf-43e1-83be-b8f25b762a8e/metadata" status: 404 len: 62 microversion: 2.1 time: 0.051879 Aug 27 02:51:19.959138 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1125/2277] 10.222.0.70 () {58 vars in 1260 bytes} [Sat Aug 27 02:51:19 2022] GET /compute/v2.1/images/3e0a9ab6-f1bf-43e1-83be-b8f25b762a8e/metadata => generated 62 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 27 02:51:19.991081 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b997bbc3-90a9-43b0-8945-9f3fc1b35fb4 tempest-ImagesMetadataNegativeTestJSON-352148844 tempest-ImagesMetadataNegativeTestJSON-352148844-project] Action: 'update_all', calling method: .version_select at 0x7f5ede8f8670>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:51:20.073986 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-b997bbc3-90a9-43b0-8945-9f3fc1b35fb4 tempest-ImagesMetadataNegativeTestJSON-352148844 tempest-ImagesMetadataNegativeTestJSON-352148844-project] HTTP exception thrown: Image not found. Aug 27 02:51:20.076539 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b997bbc3-90a9-43b0-8945-9f3fc1b35fb4 tempest-ImagesMetadataNegativeTestJSON-352148844 tempest-ImagesMetadataNegativeTestJSON-352148844-project] Request method failure captured: Aug 27 02:51:20.076539 n-d-852278-4 devstack@n-api.service[134051]: request: PUT /compute/v2.1/images/ffc2a92d-a0bc-47bc-89e5-eacaa879ca1f/metadata HTTP/1.1 Aug 27 02:51:20.076539 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:51:20.076539 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:51:20.076539 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:51:20.076539 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 57 Aug 27 02:51:20.076539 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:51:20.076539 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:51:20.076539 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:51:20.076539 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:51:20.076539 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYamNKvuon3g634lNlmN9wMQyGPPfEA0olhuYRHo-qTunQT4NI8pEWpLS_DqRtGeFuCX-p7es8Sqd0vC7rvygbcZ6KYp43NuYbZqRXFa31zs0Xx8YfpckvyXJkPK1XS15_LFccUUKmeaZDwLBN6dCxg75_8ZYjXIFs2KZ5I-YeBJUvc Aug 27 02:51:20.076539 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:51:20.076539 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:51:20.076539 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:51:20.076539 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:51:20.076539 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:51:20.076539 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:51:20.076539 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 1f494d880c9b4e1b882a8d580e6b7598 Aug 27 02:51:20.076539 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-352148844 Aug 27 02:51:20.076539 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:51:20.076539 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:51:20.076539 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/1f494d880c9b4e1b882a8d580e6b7598"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_1f494d880c9b4e1b882a8d580e6b7598", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/1f494d880c9b4e1b882a8d580e6b7598"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/1f494d880c9b4e1b882a8d580e6b7598"}]}] Aug 27 02:51:20.076539 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-352148844 Aug 27 02:51:20.076539 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 1f494d880c9b4e1b882a8d580e6b7598 Aug 27 02:51:20.076539 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-352148844 Aug 27 02:51:20.076539 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ImagesMetadataNegativeTestJSON-352148844-project Aug 27 02:51:20.076539 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:51:20.076539 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:51:20.076539 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 602905718d6f447680b57c6afb25e40a Aug 27 02:51:20.076539 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-352148844-project Aug 27 02:51:20.076539 n-d-852278-4 devstack@n-api.service[134051]: Aug 27 02:51:20.076539 n-d-852278-4 devstack@n-api.service[134051]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Aug 27 02:51:20.076539 n-d-852278-4 devstack@n-api.service[134051]: method: Aug 27 02:51:20.076539 n-d-852278-4 devstack@n-api.service[134051]: exception: Image not found. Aug 27 02:51:20.076539 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'image_id': 'ffc2a92d-a0bc-47bc-89e5-eacaa879ca1f', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Aug 27 02:51:20.076539 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:51:20.076539 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:51:20.076539 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 02:51:20.076539 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 02:51:20.076539 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 02:51:20.076539 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 02:51:20.076539 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 02:51:20.076539 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 02:51:20.076539 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 02:51:20.076539 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 02:51:20.076539 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 02:51:20.076539 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 02:51:20.076539 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 02:51:20.076539 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 02:51:20.076539 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 02:51:20.076539 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 02:51:20.076539 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 02:51:20.076539 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 02:51:20.076539 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID ffc2a92d-a0bc-47bc-89e5-eacaa879ca1f Aug 27 02:51:20.076539 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:51:20.076539 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:51:20.076539 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:51:20.076539 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:51:20.076539 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 27 02:51:20.076539 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 27 02:51:20.076539 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 27 02:51:20.076539 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 27 02:51:20.076539 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 27 02:51:20.076539 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 27 02:51:20.086040 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 27 02:51:20.086040 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 27 02:51:20.086040 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 02:51:20.086040 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 02:51:20.086040 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 02:51:20.086040 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 02:51:20.086040 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 02:51:20.086040 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 02:51:20.086040 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 02:51:20.086040 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 02:51:20.086040 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 02:51:20.086040 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 02:51:20.086040 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 02:51:20.086040 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 02:51:20.086040 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 02:51:20.086040 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 02:51:20.086040 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 02:51:20.086040 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 02:51:20.086040 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ffc2a92d-a0bc-47bc-89e5-eacaa879ca1f could not be found. Aug 27 02:51:20.086040 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:51:20.086040 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:51:20.086040 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:51:20.086040 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:51:20.086040 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:51:20.086040 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:51:20.086040 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:51:20.086040 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:51:20.086040 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:51:20.086040 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:51:20.086040 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:51:20.086040 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:51:20.086040 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:51:20.086040 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:51:20.086040 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Aug 27 02:51:20.086040 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 27 02:51:20.086040 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 27 02:51:20.086040 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 27 02:51:20.086040 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 02:51:20.086040 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:51:20.086040 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:51:20.086040 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:51:20.086040 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:51:20.086040 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:51:20.086040 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:51:20.086040 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:51:20.086040 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:51:20.086040 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 02:51:20.086040 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:51:20.086040 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b997bbc3-90a9-43b0-8945-9f3fc1b35fb4 tempest-ImagesMetadataNegativeTestJSON-352148844 tempest-ImagesMetadataNegativeTestJSON-352148844-project] Returning 404 to user: Image not found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:51:20.086040 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b997bbc3-90a9-43b0-8945-9f3fc1b35fb4 tempest-ImagesMetadataNegativeTestJSON-352148844 tempest-ImagesMetadataNegativeTestJSON-352148844-project] 10.222.0.70 "PUT /compute/v2.1/images/ffc2a92d-a0bc-47bc-89e5-eacaa879ca1f/metadata" status: 404 len: 62 microversion: 2.1 time: 0.103606 Aug 27 02:51:20.086040 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1126/2278] 10.222.0.70 () {60 vars in 1280 bytes} [Sat Aug 27 02:51:19 2022] PUT /compute/v2.1/images/ffc2a92d-a0bc-47bc-89e5-eacaa879ca1f/metadata => generated 62 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 02:51:20.133395 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d657a774-bcc2-4b9d-82dc-e7d02b10b93b tempest-ImagesMetadataNegativeTestJSON-352148844 tempest-ImagesMetadataNegativeTestJSON-352148844-project] Action: 'update', calling method: .version_select at 0x7f5ede97d790>, body: {"meta": {"os_distro": "alt"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:51:20.178472 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-d657a774-bcc2-4b9d-82dc-e7d02b10b93b tempest-ImagesMetadataNegativeTestJSON-352148844 tempest-ImagesMetadataNegativeTestJSON-352148844-project] HTTP exception thrown: Image not found. Aug 27 02:51:20.182177 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d657a774-bcc2-4b9d-82dc-e7d02b10b93b tempest-ImagesMetadataNegativeTestJSON-352148844 tempest-ImagesMetadataNegativeTestJSON-352148844-project] Request method failure captured: Aug 27 02:51:20.182177 n-d-852278-4 devstack@n-api.service[134051]: request: PUT /compute/v2.1/images/872bc652-56ad-4599-97e3-bcde45e6ff04/metadata/os_distro HTTP/1.1 Aug 27 02:51:20.182177 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:51:20.182177 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:51:20.182177 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:51:20.182177 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 30 Aug 27 02:51:20.182177 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:51:20.182177 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:51:20.182177 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:51:20.182177 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:51:20.182177 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYamNKvuon3g634lNlmN9wMQyGPPfEA0olhuYRHo-qTunQT4NI8pEWpLS_DqRtGeFuCX-p7es8Sqd0vC7rvygbcZ6KYp43NuYbZqRXFa31zs0Xx8YfpckvyXJkPK1XS15_LFccUUKmeaZDwLBN6dCxg75_8ZYjXIFs2KZ5I-YeBJUvc Aug 27 02:51:20.182177 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:51:20.182177 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:51:20.182177 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:51:20.182177 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:51:20.182177 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:51:20.182177 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:51:20.182177 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 1f494d880c9b4e1b882a8d580e6b7598 Aug 27 02:51:20.182177 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-352148844 Aug 27 02:51:20.182177 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:51:20.182177 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:51:20.182177 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/1f494d880c9b4e1b882a8d580e6b7598"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_1f494d880c9b4e1b882a8d580e6b7598", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/1f494d880c9b4e1b882a8d580e6b7598"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/1f494d880c9b4e1b882a8d580e6b7598"}]}] Aug 27 02:51:20.182177 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-352148844 Aug 27 02:51:20.182177 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 1f494d880c9b4e1b882a8d580e6b7598 Aug 27 02:51:20.182177 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-352148844 Aug 27 02:51:20.182177 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ImagesMetadataNegativeTestJSON-352148844-project Aug 27 02:51:20.182177 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:51:20.182177 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:51:20.182177 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 602905718d6f447680b57c6afb25e40a Aug 27 02:51:20.182177 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-352148844-project Aug 27 02:51:20.182177 n-d-852278-4 devstack@n-api.service[134051]: Aug 27 02:51:20.182177 n-d-852278-4 devstack@n-api.service[134051]: {"meta": {"os_distro": "alt"}} Aug 27 02:51:20.182177 n-d-852278-4 devstack@n-api.service[134051]: method: Aug 27 02:51:20.182177 n-d-852278-4 devstack@n-api.service[134051]: exception: Image not found. Aug 27 02:51:20.182177 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'image_id': '872bc652-56ad-4599-97e3-bcde45e6ff04', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Aug 27 02:51:20.182177 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:51:20.182177 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:51:20.182177 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 02:51:20.182177 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 02:51:20.182177 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 02:51:20.182177 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 02:51:20.182177 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 02:51:20.182177 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 02:51:20.182177 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 02:51:20.182177 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 02:51:20.182177 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 02:51:20.182177 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 02:51:20.182177 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 02:51:20.182177 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 02:51:20.182177 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 02:51:20.182177 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 02:51:20.182177 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 02:51:20.182177 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 02:51:20.182177 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 872bc652-56ad-4599-97e3-bcde45e6ff04 Aug 27 02:51:20.182177 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:51:20.182177 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:51:20.182177 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:51:20.182177 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:51:20.182177 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 27 02:51:20.182177 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 27 02:51:20.182177 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 27 02:51:20.182177 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 27 02:51:20.182177 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 27 02:51:20.182177 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 27 02:51:20.193187 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 27 02:51:20.193187 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 27 02:51:20.193187 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 02:51:20.193187 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 02:51:20.193187 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 02:51:20.193187 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 02:51:20.193187 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 02:51:20.193187 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 02:51:20.193187 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 02:51:20.193187 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 02:51:20.193187 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 02:51:20.193187 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 02:51:20.193187 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 02:51:20.193187 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 02:51:20.193187 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 02:51:20.193187 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 02:51:20.193187 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 02:51:20.193187 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 02:51:20.193187 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 872bc652-56ad-4599-97e3-bcde45e6ff04 could not be found. Aug 27 02:51:20.193187 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:51:20.193187 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:51:20.193187 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:51:20.193187 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:51:20.193187 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:51:20.193187 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:51:20.193187 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:51:20.193187 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:51:20.193187 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:51:20.193187 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:51:20.193187 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:51:20.193187 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:51:20.193187 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:51:20.193187 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:51:20.193187 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Aug 27 02:51:20.193187 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 27 02:51:20.193187 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 27 02:51:20.193187 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 27 02:51:20.193187 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 02:51:20.193187 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:51:20.193187 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:51:20.193187 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:51:20.193187 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:51:20.193187 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:51:20.193187 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:51:20.193187 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:51:20.193187 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:51:20.193187 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 02:51:20.193187 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:51:20.193187 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d657a774-bcc2-4b9d-82dc-e7d02b10b93b tempest-ImagesMetadataNegativeTestJSON-352148844 tempest-ImagesMetadataNegativeTestJSON-352148844-project] Returning 404 to user: Image not found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:51:20.193187 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d657a774-bcc2-4b9d-82dc-e7d02b10b93b tempest-ImagesMetadataNegativeTestJSON-352148844 tempest-ImagesMetadataNegativeTestJSON-352148844-project] 10.222.0.70 "PUT /compute/v2.1/images/872bc652-56ad-4599-97e3-bcde45e6ff04/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.084715 Aug 27 02:51:20.193187 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1127/2279] 10.222.0.70 () {60 vars in 1310 bytes} [Sat Aug 27 02:51:20 2022] PUT /compute/v2.1/images/872bc652-56ad-4599-97e3-bcde45e6ff04/metadata/os_distro => generated 62 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 02:51:20.202809 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-660e496f-b0de-49c9-8e62-a8113d62b68f tempest-ImagesMetadataNegativeTestJSON-352148844 tempest-ImagesMetadataNegativeTestJSON-352148844-project] Action: 'create', calling method: .version_select at 0x7f5ede90d790>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:51:20.247989 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-660e496f-b0de-49c9-8e62-a8113d62b68f tempest-ImagesMetadataNegativeTestJSON-352148844 tempest-ImagesMetadataNegativeTestJSON-352148844-project] HTTP exception thrown: Image not found. Aug 27 02:51:20.251449 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-660e496f-b0de-49c9-8e62-a8113d62b68f tempest-ImagesMetadataNegativeTestJSON-352148844 tempest-ImagesMetadataNegativeTestJSON-352148844-project] Request method failure captured: Aug 27 02:51:20.251449 n-d-852278-4 devstack@n-api.service[134051]: request: POST /compute/v2.1/images/5bb7fa52-94ce-4084-9537-dcf92b2db91e/metadata HTTP/1.1 Aug 27 02:51:20.251449 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:51:20.251449 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:51:20.251449 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:51:20.251449 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 57 Aug 27 02:51:20.251449 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:51:20.251449 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:51:20.251449 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:51:20.251449 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:51:20.251449 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYamNKvuon3g634lNlmN9wMQyGPPfEA0olhuYRHo-qTunQT4NI8pEWpLS_DqRtGeFuCX-p7es8Sqd0vC7rvygbcZ6KYp43NuYbZqRXFa31zs0Xx8YfpckvyXJkPK1XS15_LFccUUKmeaZDwLBN6dCxg75_8ZYjXIFs2KZ5I-YeBJUvc Aug 27 02:51:20.251449 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:51:20.251449 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:51:20.251449 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:51:20.251449 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:51:20.251449 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:51:20.251449 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:51:20.251449 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 1f494d880c9b4e1b882a8d580e6b7598 Aug 27 02:51:20.251449 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-352148844 Aug 27 02:51:20.251449 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:51:20.251449 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:51:20.251449 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/1f494d880c9b4e1b882a8d580e6b7598"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_1f494d880c9b4e1b882a8d580e6b7598", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/1f494d880c9b4e1b882a8d580e6b7598"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/1f494d880c9b4e1b882a8d580e6b7598"}]}] Aug 27 02:51:20.251449 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-352148844 Aug 27 02:51:20.251449 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 1f494d880c9b4e1b882a8d580e6b7598 Aug 27 02:51:20.251449 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-352148844 Aug 27 02:51:20.251449 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ImagesMetadataNegativeTestJSON-352148844-project Aug 27 02:51:20.251449 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:51:20.251449 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:51:20.251449 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 602905718d6f447680b57c6afb25e40a Aug 27 02:51:20.251449 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-352148844-project Aug 27 02:51:20.251449 n-d-852278-4 devstack@n-api.service[134051]: Aug 27 02:51:20.251449 n-d-852278-4 devstack@n-api.service[134051]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Aug 27 02:51:20.251449 n-d-852278-4 devstack@n-api.service[134051]: method: Aug 27 02:51:20.251449 n-d-852278-4 devstack@n-api.service[134051]: exception: Image not found. Aug 27 02:51:20.251449 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'image_id': '5bb7fa52-94ce-4084-9537-dcf92b2db91e', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Aug 27 02:51:20.251449 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:51:20.251449 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:51:20.251449 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 02:51:20.251449 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 02:51:20.251449 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 02:51:20.251449 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 02:51:20.251449 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 02:51:20.251449 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 02:51:20.251449 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 02:51:20.251449 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 02:51:20.251449 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 02:51:20.251449 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 02:51:20.251449 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 02:51:20.251449 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 02:51:20.251449 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 02:51:20.251449 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 02:51:20.251449 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 02:51:20.251449 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 02:51:20.251449 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 5bb7fa52-94ce-4084-9537-dcf92b2db91e Aug 27 02:51:20.251449 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:51:20.251449 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:51:20.251449 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:51:20.251449 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:51:20.251449 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 27 02:51:20.251449 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 27 02:51:20.251449 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 27 02:51:20.251449 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 27 02:51:20.251449 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 27 02:51:20.251449 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 27 02:51:20.262282 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 27 02:51:20.262282 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 27 02:51:20.262282 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 02:51:20.262282 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 02:51:20.262282 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 02:51:20.262282 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 02:51:20.262282 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 02:51:20.262282 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 02:51:20.262282 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 02:51:20.262282 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 02:51:20.262282 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 02:51:20.262282 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 02:51:20.262282 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 02:51:20.262282 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 02:51:20.262282 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 02:51:20.262282 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 02:51:20.262282 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 02:51:20.262282 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 02:51:20.262282 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5bb7fa52-94ce-4084-9537-dcf92b2db91e could not be found. Aug 27 02:51:20.262282 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:51:20.262282 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:51:20.262282 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:51:20.262282 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:51:20.262282 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:51:20.262282 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:51:20.262282 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:51:20.262282 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:51:20.262282 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:51:20.262282 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:51:20.262282 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:51:20.262282 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:51:20.262282 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:51:20.262282 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:51:20.262282 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Aug 27 02:51:20.262282 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 27 02:51:20.262282 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 27 02:51:20.262282 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 27 02:51:20.262282 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 02:51:20.262282 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:51:20.262282 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:51:20.262282 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:51:20.262282 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:51:20.262282 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:51:20.262282 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:51:20.262282 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:51:20.262282 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:51:20.262282 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 02:51:20.262282 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:51:20.262282 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-660e496f-b0de-49c9-8e62-a8113d62b68f tempest-ImagesMetadataNegativeTestJSON-352148844 tempest-ImagesMetadataNegativeTestJSON-352148844-project] Returning 404 to user: Image not found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:51:20.262282 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-660e496f-b0de-49c9-8e62-a8113d62b68f tempest-ImagesMetadataNegativeTestJSON-352148844 tempest-ImagesMetadataNegativeTestJSON-352148844-project] 10.222.0.70 "POST /compute/v2.1/images/5bb7fa52-94ce-4084-9537-dcf92b2db91e/metadata" status: 404 len: 62 microversion: 2.1 time: 0.063631 Aug 27 02:51:20.268113 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1128/2280] 10.222.0.70 () {60 vars in 1281 bytes} [Sat Aug 27 02:51:20 2022] POST /compute/v2.1/images/5bb7fa52-94ce-4084-9537-dcf92b2db91e/metadata => generated 62 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 02:51:20.609531 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-669dc6f1-956c-436a-984c-78eceb85c904 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:20.628863 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-669dc6f1-956c-436a-984c-78eceb85c904 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/a4aca2ed-a835-4f8f-96ae-c3502645425a" status: 200 len: 1543 microversion: 2.1 time: 0.931500 Aug 27 02:51:20.629523 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1153/2281] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:19 2022] GET /compute/v2.1/servers/a4aca2ed-a835-4f8f-96ae-c3502645425a => generated 1543 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:20.853158 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-cf2e047b-01de-4532-ba0e-071ed7c607cd tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:20.854634 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-cf2e047b-01de-4532-ba0e-071ed7c607cd tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: c2c6b214-da6b-48dd-b84c-b111611fc89a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:20.866402 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:DELETE=3 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:51:20.886892 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cf2e047b-01de-4532-ba0e-071ed7c607cd tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:20.887693 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cf2e047b-01de-4532-ba0e-071ed7c607cd tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:20.888762 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cf2e047b-01de-4532-ba0e-071ed7c607cd tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:20.894801 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cf2e047b-01de-4532-ba0e-071ed7c607cd tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:20.894913 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cf2e047b-01de-4532-ba0e-071ed7c607cd tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:20.896091 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cf2e047b-01de-4532-ba0e-071ed7c607cd tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:21.332440 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-cf2e047b-01de-4532-ba0e-071ed7c607cd tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:21.349330 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-cf2e047b-01de-4532-ba0e-071ed7c607cd tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/c2c6b214-da6b-48dd-b84c-b111611fc89a" status: 200 len: 1502 microversion: 2.1 time: 0.501844 Aug 27 02:51:21.354532 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1129/2282] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:20 2022] GET /compute/v2.1/servers/c2c6b214-da6b-48dd-b84c-b111611fc89a => generated 1502 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:21.653550 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e6eb44ba-e704-42f8-9a0f-e4b3a5e38fdd tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:21.654799 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-e6eb44ba-e704-42f8-9a0f-e4b3a5e38fdd tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: a4aca2ed-a835-4f8f-96ae-c3502645425a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:21.671121 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e6eb44ba-e704-42f8-9a0f-e4b3a5e38fdd tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:21.671902 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e6eb44ba-e704-42f8-9a0f-e4b3a5e38fdd tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:21.672535 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e6eb44ba-e704-42f8-9a0f-e4b3a5e38fdd tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:21.675819 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e6eb44ba-e704-42f8-9a0f-e4b3a5e38fdd tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:21.677982 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e6eb44ba-e704-42f8-9a0f-e4b3a5e38fdd tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:21.679410 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e6eb44ba-e704-42f8-9a0f-e4b3a5e38fdd tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:22.292053 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-e6eb44ba-e704-42f8-9a0f-e4b3a5e38fdd tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:22.310230 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e6eb44ba-e704-42f8-9a0f-e4b3a5e38fdd tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/a4aca2ed-a835-4f8f-96ae-c3502645425a" status: 200 len: 1543 microversion: 2.1 time: 0.661690 Aug 27 02:51:22.311328 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1154/2283] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:21 2022] GET /compute/v2.1/servers/a4aca2ed-a835-4f8f-96ae-c3502645425a => generated 1543 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:23.337203 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-097b0e8f-a4e1-4887-88ef-704cec9ed581 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:23.337873 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-097b0e8f-a4e1-4887-88ef-704cec9ed581 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: a4aca2ed-a835-4f8f-96ae-c3502645425a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:23.351856 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-097b0e8f-a4e1-4887-88ef-704cec9ed581 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:23.352376 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-097b0e8f-a4e1-4887-88ef-704cec9ed581 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:23.352816 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-097b0e8f-a4e1-4887-88ef-704cec9ed581 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:23.353555 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-097b0e8f-a4e1-4887-88ef-704cec9ed581 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:23.354034 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-097b0e8f-a4e1-4887-88ef-704cec9ed581 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:23.354456 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-097b0e8f-a4e1-4887-88ef-704cec9ed581 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:23.677976 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-097b0e8f-a4e1-4887-88ef-704cec9ed581 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:23.715819 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-097b0e8f-a4e1-4887-88ef-704cec9ed581 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/a4aca2ed-a835-4f8f-96ae-c3502645425a" status: 200 len: 1543 microversion: 2.1 time: 0.381455 Aug 27 02:51:23.717554 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1130/2284] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:23 2022] GET /compute/v2.1/servers/a4aca2ed-a835-4f8f-96ae-c3502645425a => generated 1543 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:24.275445 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-7d0095ff-842b-42cd-a329-4e5e557dc2df tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3862320a-fe6a-441f-ad33-0341797fd0bb"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:51:24.282020 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-7d0095ff-842b-42cd-a329-4e5e557dc2df tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: c2c6b214-da6b-48dd-b84c-b111611fc89a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:24.308154 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7d0095ff-842b-42cd-a329-4e5e557dc2df tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:24.308661 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7d0095ff-842b-42cd-a329-4e5e557dc2df tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:24.311703 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7d0095ff-842b-42cd-a329-4e5e557dc2df tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:24.315018 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7d0095ff-842b-42cd-a329-4e5e557dc2df tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:24.315763 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7d0095ff-842b-42cd-a329-4e5e557dc2df tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:24.316237 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7d0095ff-842b-42cd-a329-4e5e557dc2df tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:24.745402 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f4805c3a-1a48-4e09-8dee-789a9737f808 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:24.747809 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-f4805c3a-1a48-4e09-8dee-789a9737f808 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: a4aca2ed-a835-4f8f-96ae-c3502645425a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:24.775595 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f4805c3a-1a48-4e09-8dee-789a9737f808 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:24.780023 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f4805c3a-1a48-4e09-8dee-789a9737f808 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:24.780549 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f4805c3a-1a48-4e09-8dee-789a9737f808 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:24.783746 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f4805c3a-1a48-4e09-8dee-789a9737f808 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:24.787874 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f4805c3a-1a48-4e09-8dee-789a9737f808 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:24.788724 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f4805c3a-1a48-4e09-8dee-789a9737f808 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:24.834466 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-7d0095ff-842b-42cd-a329-4e5e557dc2df tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "POST /compute/v2.1/servers/c2c6b214-da6b-48dd-b84c-b111611fc89a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.562716 Aug 27 02:51:24.835125 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1155/2285] 10.222.0.70 () {60 vars in 1323 bytes} [Sat Aug 27 02:51:24 2022] POST /compute/v2.1/servers/c2c6b214-da6b-48dd-b84c-b111611fc89a/os-volume_attachments => generated 194 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:51:25.223781 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-f4805c3a-1a48-4e09-8dee-789a9737f808 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:25.238268 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-f4805c3a-1a48-4e09-8dee-789a9737f808 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/a4aca2ed-a835-4f8f-96ae-c3502645425a" status: 200 len: 1543 microversion: 2.1 time: 0.504051 Aug 27 02:51:25.238870 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1131/2286] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:24 2022] GET /compute/v2.1/servers/a4aca2ed-a835-4f8f-96ae-c3502645425a => generated 1543 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:51:25.646391 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a55624fb-6f81-47f9-8ab9-a07639f0af2c tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1207967048", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "98a157c1-b59e-4376-9dd5-1d9da72e6e77"}], "security_groups": [{"name": "tempest-securitygroup--1271203504"}], "key_name": "tempest-keypair-1325620928", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:51:25.867266 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.network.neutron [None req-a55624fb-6f81-47f9-8ab9-a07639f0af2c tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] validate_networks() for [('98a157c1-b59e-4376-9dd5-1d9da72e6e77', None, None, None, None, None)] {{(pid=134052) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:51:26.261468 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-69ecbf50-b454-4b52-ba3c-066833d30734 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:26.262068 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-69ecbf50-b454-4b52-ba3c-066833d30734 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: a4aca2ed-a835-4f8f-96ae-c3502645425a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:26.282396 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-69ecbf50-b454-4b52-ba3c-066833d30734 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:26.286228 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-69ecbf50-b454-4b52-ba3c-066833d30734 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:26.286784 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-69ecbf50-b454-4b52-ba3c-066833d30734 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:26.290856 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-69ecbf50-b454-4b52-ba3c-066833d30734 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:26.294672 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-69ecbf50-b454-4b52-ba3c-066833d30734 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:26.295210 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-69ecbf50-b454-4b52-ba3c-066833d30734 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:26.996640 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-69ecbf50-b454-4b52-ba3c-066833d30734 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:27.009029 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-69ecbf50-b454-4b52-ba3c-066833d30734 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/a4aca2ed-a835-4f8f-96ae-c3502645425a" status: 200 len: 1542 microversion: 2.1 time: 0.753288 Aug 27 02:51:27.030240 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1132/2287] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:26 2022] GET /compute/v2.1/servers/a4aca2ed-a835-4f8f-96ae-c3502645425a => generated 1542 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:27.594524 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-a55624fb-6f81-47f9-8ab9-a07639f0af2c tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Getting quotas for project 6c13c50438234109913876bf5a11d271. Resources: dict_keys(['metadata_items']) {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:51:27.638910 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-a55624fb-6f81-47f9-8ab9-a07639f0af2c tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Getting quotas for user 8ece2eb399074418ac5f890d223c1be0 and project 6c13c50438234109913876bf5a11d271. Resources: dict_keys(['metadata_items']) {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:51:27.673752 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-a55624fb-6f81-47f9-8ab9-a07639f0af2c tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Flavor limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:51:27.674558 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-a55624fb-6f81-47f9-8ab9-a07639f0af2c tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Image limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:51:27.676084 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-a55624fb-6f81-47f9-8ab9-a07639f0af2c tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Flavor pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:51:27.678134 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-a55624fb-6f81-47f9-8ab9-a07639f0af2c tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Image pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:51:27.678726 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-a55624fb-6f81-47f9-8ab9-a07639f0af2c tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:51:27.702804 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a55624fb-6f81-47f9-8ab9-a07639f0af2c tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:27.704836 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a55624fb-6f81-47f9-8ab9-a07639f0af2c tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:27.707650 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a55624fb-6f81-47f9-8ab9-a07639f0af2c tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:27.715918 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a55624fb-6f81-47f9-8ab9-a07639f0af2c tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:27.718109 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a55624fb-6f81-47f9-8ab9-a07639f0af2c tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:27.719123 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a55624fb-6f81-47f9-8ab9-a07639f0af2c tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:27.791339 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-a55624fb-6f81-47f9-8ab9-a07639f0af2c tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Getting quotas for project 6c13c50438234109913876bf5a11d271. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:51:27.817711 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-a55624fb-6f81-47f9-8ab9-a07639f0af2c tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Getting quotas for user 8ece2eb399074418ac5f890d223c1be0 and project 6c13c50438234109913876bf5a11d271. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:51:27.867072 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a55624fb-6f81-47f9-8ab9-a07639f0af2c tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Going to run 1 instances... {{(pid=134052) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:51:27.871763 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a55624fb-6f81-47f9-8ab9-a07639f0af2c tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] [instance: 503900da-e41b-4787-bb1e-9d3df7df05b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134052) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:51:28.014699 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a55624fb-6f81-47f9-8ab9-a07639f0af2c tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 2.373652 Aug 27 02:51:28.031474 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a69e545a-239e-4c03-b547-7221fb4739e8 tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:28.032053 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-a69e545a-239e-4c03-b547-7221fb4739e8 tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] [instance: 503900da-e41b-4787-bb1e-9d3df7df05b6] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:28.038058 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1156/2288] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 02:51:25 2022] POST /compute/v2.1/servers => generated 407 bytes in 2398 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:51:28.058974 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-674e4dc7-4a67-49d8-acda-a0ad9e135d4f tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:28.064199 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-674e4dc7-4a67-49d8-acda-a0ad9e135d4f tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: a4aca2ed-a835-4f8f-96ae-c3502645425a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:28.105296 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-674e4dc7-4a67-49d8-acda-a0ad9e135d4f tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:28.110983 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-674e4dc7-4a67-49d8-acda-a0ad9e135d4f tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:28.112768 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-674e4dc7-4a67-49d8-acda-a0ad9e135d4f tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:28.115766 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-674e4dc7-4a67-49d8-acda-a0ad9e135d4f tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:28.120912 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-674e4dc7-4a67-49d8-acda-a0ad9e135d4f tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:28.121520 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-674e4dc7-4a67-49d8-acda-a0ad9e135d4f tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:28.457013 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-a69e545a-239e-4c03-b547-7221fb4739e8 tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ece2eb399074418ac5f890d223c1be0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c13c50438234109913876bf5a11d271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:28.466521 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a69e545a-239e-4c03-b547-7221fb4739e8 tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] 10.222.0.70 "GET /compute/v2.1/servers/503900da-e41b-4787-bb1e-9d3df7df05b6" status: 200 len: 1270 microversion: 2.1 time: 0.441124 Aug 27 02:51:28.469348 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1133/2289] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:28 2022] GET /compute/v2.1/servers/503900da-e41b-4787-bb1e-9d3df7df05b6 => generated 1270 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:28.661957 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b7e00e10-6b0c-4ec7-8a01-e224ac5f1735 tempest-ImagesMetadataTestJSON-1595503781 tempest-ImagesMetadataTestJSON-1595503781-project] Calling method '.version_select at 0x7f5ede996ca0>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:28.731050 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b7e00e10-6b0c-4ec7-8a01-e224ac5f1735 tempest-ImagesMetadataTestJSON-1595503781 tempest-ImagesMetadataTestJSON-1595503781-project] 10.222.0.70 "GET /compute/v2.1/images/9c0c6a0b-b061-44af-bef5-83f0a9f0b81c" status: 200 len: 636 microversion: 2.1 time: 0.071077 Aug 27 02:51:28.734342 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1134/2290] 10.222.0.70 () {58 vars in 1233 bytes} [Sat Aug 27 02:51:28 2022] GET /compute/v2.1/images/9c0c6a0b-b061-44af-bef5-83f0a9f0b81c => generated 636 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:51:28.757055 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a5cb5740-c94c-4cac-b26b-f4f461927fcd tempest-ImagesMetadataTestJSON-1595503781 tempest-ImagesMetadataTestJSON-1595503781-project] Action: 'update_all', calling method: .version_select at 0x7f5ede993820>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:51:28.869763 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-a5cb5740-c94c-4cac-b26b-f4f461927fcd tempest-ImagesMetadataTestJSON-1595503781 tempest-ImagesMetadataTestJSON-1595503781-project] Getting quotas for project 3f208f744c404039b9997fbefddc5a14. Resources: dict_keys(['metadata_items']) {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:51:28.893082 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-a5cb5740-c94c-4cac-b26b-f4f461927fcd tempest-ImagesMetadataTestJSON-1595503781 tempest-ImagesMetadataTestJSON-1595503781-project] Getting quotas for user 01b036d0953049ffbfcfc93623b04a47 and project 3f208f744c404039b9997fbefddc5a14. Resources: dict_keys(['metadata_items']) {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:51:28.895050 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-674e4dc7-4a67-49d8-acda-a0ad9e135d4f tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:28.906385 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-674e4dc7-4a67-49d8-acda-a0ad9e135d4f tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/a4aca2ed-a835-4f8f-96ae-c3502645425a" status: 200 len: 1542 microversion: 2.1 time: 0.867133 Aug 27 02:51:28.923757 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1157/2291] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:28 2022] GET /compute/v2.1/servers/a4aca2ed-a835-4f8f-96ae-c3502645425a => generated 1542 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:29.491392 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-23b72fcd-2f07-4e41-9fc8-e098e2fcd719 tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:29.492035 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-23b72fcd-2f07-4e41-9fc8-e098e2fcd719 tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] [instance: 503900da-e41b-4787-bb1e-9d3df7df05b6] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:29.508827 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-23b72fcd-2f07-4e41-9fc8-e098e2fcd719 tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:29.509393 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-23b72fcd-2f07-4e41-9fc8-e098e2fcd719 tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:29.509764 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-23b72fcd-2f07-4e41-9fc8-e098e2fcd719 tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:29.510496 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-23b72fcd-2f07-4e41-9fc8-e098e2fcd719 tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:29.511058 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-23b72fcd-2f07-4e41-9fc8-e098e2fcd719 tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:29.511566 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-23b72fcd-2f07-4e41-9fc8-e098e2fcd719 tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:29.520873 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a5cb5740-c94c-4cac-b26b-f4f461927fcd tempest-ImagesMetadataTestJSON-1595503781 tempest-ImagesMetadataTestJSON-1595503781-project] 10.222.0.70 "PUT /compute/v2.1/images/9c0c6a0b-b061-44af-bef5-83f0a9f0b81c/metadata" status: 200 len: 61 microversion: 2.1 time: 0.773321 Aug 27 02:51:29.522832 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1135/2292] 10.222.0.70 () {60 vars in 1280 bytes} [Sat Aug 27 02:51:28 2022] PUT /compute/v2.1/images/9c0c6a0b-b061-44af-bef5-83f0a9f0b81c/metadata => generated 61 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:51:29.528825 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-792f45f8-6a35-4460-a041-361d008dd3ec req-aea54af0-ab83-4a37-b75e-14f25c9bfea6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4aca2ed-a835-4f8f-96ae-c3502645425a", "name": "network-vif-unplugged", "status": "completed", "tag": "4f9042c6-628d-483c-88dc-649ec8de9f53"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:51:29.556952 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-792f45f8-6a35-4460-a041-361d008dd3ec req-aea54af0-ab83-4a37-b75e-14f25c9bfea6 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:29.558565 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-792f45f8-6a35-4460-a041-361d008dd3ec req-aea54af0-ab83-4a37-b75e-14f25c9bfea6 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:29.559828 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-792f45f8-6a35-4460-a041-361d008dd3ec req-aea54af0-ab83-4a37-b75e-14f25c9bfea6 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:29.613694 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-792f45f8-6a35-4460-a041-361d008dd3ec req-aea54af0-ab83-4a37-b75e-14f25c9bfea6 service nova] Creating event network-vif-unplugged:4f9042c6-628d-483c-88dc-649ec8de9f53 for instance a4aca2ed-a835-4f8f-96ae-c3502645425a on n-h2-852278-4 Aug 27 02:51:29.637351 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [req-792f45f8-6a35-4460-a041-361d008dd3ec req-aea54af0-ab83-4a37-b75e-14f25c9bfea6 service nova] Instance a4aca2ed-a835-4f8f-96ae-c3502645425a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-852278-4'} {{(pid=134051) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 02:51:29.662181 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-792f45f8-6a35-4460-a041-361d008dd3ec req-aea54af0-ab83-4a37-b75e-14f25c9bfea6 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.137612 Aug 27 02:51:29.669759 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1136/2293] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:51:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:51:29.689866 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f1adecfc-1d5b-4de5-a1c9-446e3900396d tempest-ImagesMetadataTestJSON-1595503781 tempest-ImagesMetadataTestJSON-1595503781-project] Calling method '.version_select at 0x7f5ede9935e0>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:29.763506 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-23b72fcd-2f07-4e41-9fc8-e098e2fcd719 tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ece2eb399074418ac5f890d223c1be0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c13c50438234109913876bf5a11d271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:29.773731 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-23b72fcd-2f07-4e41-9fc8-e098e2fcd719 tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] 10.222.0.70 "GET /compute/v2.1/servers/503900da-e41b-4787-bb1e-9d3df7df05b6" status: 200 len: 1274 microversion: 2.1 time: 0.287931 Aug 27 02:51:29.792239 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1158/2294] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:29 2022] GET /compute/v2.1/servers/503900da-e41b-4787-bb1e-9d3df7df05b6 => generated 1274 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:29.932194 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8b2cb78a-887c-4256-9c82-640b331005be tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:29.933486 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-8b2cb78a-887c-4256-9c82-640b331005be tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: a4aca2ed-a835-4f8f-96ae-c3502645425a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:29.945087 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=7 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:51:29.946884 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8b2cb78a-887c-4256-9c82-640b331005be tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:29.947618 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8b2cb78a-887c-4256-9c82-640b331005be tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:29.948924 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8b2cb78a-887c-4256-9c82-640b331005be tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:29.955045 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8b2cb78a-887c-4256-9c82-640b331005be tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:29.955334 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8b2cb78a-887c-4256-9c82-640b331005be tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:29.955846 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8b2cb78a-887c-4256-9c82-640b331005be tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:30.132662 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-f1adecfc-1d5b-4de5-a1c9-446e3900396d tempest-ImagesMetadataTestJSON-1595503781 tempest-ImagesMetadataTestJSON-1595503781-project] 10.222.0.70 "DELETE /compute/v2.1/images/9c0c6a0b-b061-44af-bef5-83f0a9f0b81c/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.458603 Aug 27 02:51:30.133602 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1137/2295] 10.222.0.70 () {58 vars in 1296 bytes} [Sat Aug 27 02:51:29 2022] DELETE /compute/v2.1/images/9c0c6a0b-b061-44af-bef5-83f0a9f0b81c/metadata/os_version => generated 0 bytes in 463 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:51:30.141661 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b57a6b30-dd13-4d66-9d94-d40f6fda479b tempest-ImagesMetadataTestJSON-1595503781 tempest-ImagesMetadataTestJSON-1595503781-project] Calling method '.version_select at 0x7f5ede996f70>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:30.218290 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b57a6b30-dd13-4d66-9d94-d40f6fda479b tempest-ImagesMetadataTestJSON-1595503781 tempest-ImagesMetadataTestJSON-1595503781-project] 10.222.0.70 "GET /compute/v2.1/images/9c0c6a0b-b061-44af-bef5-83f0a9f0b81c/metadata" status: 200 len: 37 microversion: 2.1 time: 0.079348 Aug 27 02:51:30.221108 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1138/2296] 10.222.0.70 () {58 vars in 1260 bytes} [Sat Aug 27 02:51:30 2022] GET /compute/v2.1/images/9c0c6a0b-b061-44af-bef5-83f0a9f0b81c/metadata => generated 37 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:51:30.236880 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-673389e6-9b72-42fa-b534-8e6bd59e45bf tempest-ImagesMetadataTestJSON-1595503781 tempest-ImagesMetadataTestJSON-1595503781-project] Action: 'update_all', calling method: .version_select at 0x7f5ede9eb550>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:51:30.324228 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-673389e6-9b72-42fa-b534-8e6bd59e45bf tempest-ImagesMetadataTestJSON-1595503781 tempest-ImagesMetadataTestJSON-1595503781-project] Getting quotas for project 3f208f744c404039b9997fbefddc5a14. Resources: dict_keys(['metadata_items']) {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:51:30.344497 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-673389e6-9b72-42fa-b534-8e6bd59e45bf tempest-ImagesMetadataTestJSON-1595503781 tempest-ImagesMetadataTestJSON-1595503781-project] Getting quotas for user 01b036d0953049ffbfcfc93623b04a47 and project 3f208f744c404039b9997fbefddc5a14. Resources: dict_keys(['metadata_items']) {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:51:30.403824 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-8b2cb78a-887c-4256-9c82-640b331005be tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:30.412484 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-8b2cb78a-887c-4256-9c82-640b331005be tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/a4aca2ed-a835-4f8f-96ae-c3502645425a" status: 200 len: 1474 microversion: 2.1 time: 0.487230 Aug 27 02:51:30.436260 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1159/2297] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:29 2022] GET /compute/v2.1/servers/a4aca2ed-a835-4f8f-96ae-c3502645425a => generated 1474 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:30.798874 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4e162f4b-be92-4e32-aa15-8c8416bab781 tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:30.799496 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-4e162f4b-be92-4e32-aa15-8c8416bab781 tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] [instance: 503900da-e41b-4787-bb1e-9d3df7df05b6] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:30.816800 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4e162f4b-be92-4e32-aa15-8c8416bab781 tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:30.819159 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4e162f4b-be92-4e32-aa15-8c8416bab781 tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:30.826392 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4e162f4b-be92-4e32-aa15-8c8416bab781 tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:30.830547 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4e162f4b-be92-4e32-aa15-8c8416bab781 tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:30.831385 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4e162f4b-be92-4e32-aa15-8c8416bab781 tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:30.834013 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4e162f4b-be92-4e32-aa15-8c8416bab781 tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:30.845226 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-673389e6-9b72-42fa-b534-8e6bd59e45bf tempest-ImagesMetadataTestJSON-1595503781 tempest-ImagesMetadataTestJSON-1595503781-project] 10.222.0.70 "PUT /compute/v2.1/images/9c0c6a0b-b061-44af-bef5-83f0a9f0b81c/metadata" status: 200 len: 61 microversion: 2.1 time: 0.616703 Aug 27 02:51:30.846278 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1139/2298] 10.222.0.70 () {60 vars in 1280 bytes} [Sat Aug 27 02:51:30 2022] PUT /compute/v2.1/images/9c0c6a0b-b061-44af-bef5-83f0a9f0b81c/metadata => generated 61 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:51:30.856458 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3b25731b-efd1-408b-a505-3cf55df070fe tempest-ImagesMetadataTestJSON-1595503781 tempest-ImagesMetadataTestJSON-1595503781-project] Calling method '.version_select at 0x7f5ede917ee0>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:30.927808 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-3b25731b-efd1-408b-a505-3cf55df070fe tempest-ImagesMetadataTestJSON-1595503781 tempest-ImagesMetadataTestJSON-1595503781-project] 10.222.0.70 "GET /compute/v2.1/images/9c0c6a0b-b061-44af-bef5-83f0a9f0b81c/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.075920 Aug 27 02:51:30.929878 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1140/2299] 10.222.0.70 () {58 vars in 1290 bytes} [Sat Aug 27 02:51:30 2022] GET /compute/v2.1/images/9c0c6a0b-b061-44af-bef5-83f0a9f0b81c/metadata/os_distro => generated 33 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 27 02:51:30.940097 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-52e47eae-39c9-40d4-88ea-cb0b00c1e6c2 tempest-ImagesMetadataTestJSON-1595503781 tempest-ImagesMetadataTestJSON-1595503781-project] Action: 'update_all', calling method: .version_select at 0x7f5ededf55e0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:51:31.040333 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-52e47eae-39c9-40d4-88ea-cb0b00c1e6c2 tempest-ImagesMetadataTestJSON-1595503781 tempest-ImagesMetadataTestJSON-1595503781-project] Getting quotas for project 3f208f744c404039b9997fbefddc5a14. Resources: dict_keys(['metadata_items']) {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:51:31.048798 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-52e47eae-39c9-40d4-88ea-cb0b00c1e6c2 tempest-ImagesMetadataTestJSON-1595503781 tempest-ImagesMetadataTestJSON-1595503781-project] Getting quotas for user 01b036d0953049ffbfcfc93623b04a47 and project 3f208f744c404039b9997fbefddc5a14. Resources: dict_keys(['metadata_items']) {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:51:31.336401 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-52e47eae-39c9-40d4-88ea-cb0b00c1e6c2 tempest-ImagesMetadataTestJSON-1595503781 tempest-ImagesMetadataTestJSON-1595503781-project] 10.222.0.70 "PUT /compute/v2.1/images/9c0c6a0b-b061-44af-bef5-83f0a9f0b81c/metadata" status: 200 len: 61 microversion: 2.1 time: 0.400163 Aug 27 02:51:31.341131 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1141/2300] 10.222.0.70 () {60 vars in 1280 bytes} [Sat Aug 27 02:51:30 2022] PUT /compute/v2.1/images/9c0c6a0b-b061-44af-bef5-83f0a9f0b81c/metadata => generated 61 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 27 02:51:31.348150 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f9ef02cd-1caa-4ab0-9f09-6702d088ab93 tempest-ImagesMetadataTestJSON-1595503781 tempest-ImagesMetadataTestJSON-1595503781-project] Calling method '.version_select at 0x7f5ededf5940>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:31.379316 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-4e162f4b-be92-4e32-aa15-8c8416bab781 tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ece2eb399074418ac5f890d223c1be0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c13c50438234109913876bf5a11d271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:31.391406 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-4e162f4b-be92-4e32-aa15-8c8416bab781 tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] 10.222.0.70 "GET /compute/v2.1/servers/503900da-e41b-4787-bb1e-9d3df7df05b6" status: 200 len: 1322 microversion: 2.1 time: 0.596796 Aug 27 02:51:31.394700 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1160/2301] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:30 2022] GET /compute/v2.1/servers/503900da-e41b-4787-bb1e-9d3df7df05b6 => generated 1322 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:51:31.441035 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-f9ef02cd-1caa-4ab0-9f09-6702d088ab93 tempest-ImagesMetadataTestJSON-1595503781 tempest-ImagesMetadataTestJSON-1595503781-project] 10.222.0.70 "GET /compute/v2.1/images/9c0c6a0b-b061-44af-bef5-83f0a9f0b81c/metadata" status: 200 len: 61 microversion: 2.1 time: 0.097238 Aug 27 02:51:31.441635 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1142/2302] 10.222.0.70 () {58 vars in 1260 bytes} [Sat Aug 27 02:51:31 2022] GET /compute/v2.1/images/9c0c6a0b-b061-44af-bef5-83f0a9f0b81c/metadata => generated 61 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 27 02:51:31.448375 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ca918f32-a108-4ee0-91c3-2d38ce6e015c tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:31.450240 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-ca918f32-a108-4ee0-91c3-2d38ce6e015c tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: a4aca2ed-a835-4f8f-96ae-c3502645425a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:31.463633 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ca918f32-a108-4ee0-91c3-2d38ce6e015c tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:31.464349 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ca918f32-a108-4ee0-91c3-2d38ce6e015c tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:31.465021 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ca918f32-a108-4ee0-91c3-2d38ce6e015c tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:31.465881 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ca918f32-a108-4ee0-91c3-2d38ce6e015c tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:31.466486 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ca918f32-a108-4ee0-91c3-2d38ce6e015c tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:31.467126 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ca918f32-a108-4ee0-91c3-2d38ce6e015c tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:31.476850 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0e696571-68bd-466e-98ee-ac509d15d301 tempest-ImagesMetadataTestJSON-1595503781 tempest-ImagesMetadataTestJSON-1595503781-project] Action: 'update_all', calling method: .version_select at 0x7f5edf4a1ee0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:51:31.494237 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:51:31.578392 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-0e696571-68bd-466e-98ee-ac509d15d301 tempest-ImagesMetadataTestJSON-1595503781 tempest-ImagesMetadataTestJSON-1595503781-project] Getting quotas for project 3f208f744c404039b9997fbefddc5a14. Resources: dict_keys(['metadata_items']) {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:51:31.589580 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-0e696571-68bd-466e-98ee-ac509d15d301 tempest-ImagesMetadataTestJSON-1595503781 tempest-ImagesMetadataTestJSON-1595503781-project] Getting quotas for user 01b036d0953049ffbfcfc93623b04a47 and project 3f208f744c404039b9997fbefddc5a14. Resources: dict_keys(['metadata_items']) {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:51:31.929400 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-0e696571-68bd-466e-98ee-ac509d15d301 tempest-ImagesMetadataTestJSON-1595503781 tempest-ImagesMetadataTestJSON-1595503781-project] 10.222.0.70 "PUT /compute/v2.1/images/9c0c6a0b-b061-44af-bef5-83f0a9f0b81c/metadata" status: 200 len: 61 microversion: 2.1 time: 0.468132 Aug 27 02:51:31.932908 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1143/2303] 10.222.0.70 () {60 vars in 1280 bytes} [Sat Aug 27 02:51:31 2022] PUT /compute/v2.1/images/9c0c6a0b-b061-44af-bef5-83f0a9f0b81c/metadata => generated 61 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:51:31.943865 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0c969162-2088-4656-89d9-7a40130948cd tempest-ImagesMetadataTestJSON-1595503781 tempest-ImagesMetadataTestJSON-1595503781-project] Action: 'update_all', calling method: .version_select at 0x7f5ededf5160>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:51:32.037196 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-0c969162-2088-4656-89d9-7a40130948cd tempest-ImagesMetadataTestJSON-1595503781 tempest-ImagesMetadataTestJSON-1595503781-project] Getting quotas for project 3f208f744c404039b9997fbefddc5a14. Resources: dict_keys(['metadata_items']) {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:51:32.056839 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-0c969162-2088-4656-89d9-7a40130948cd tempest-ImagesMetadataTestJSON-1595503781 tempest-ImagesMetadataTestJSON-1595503781-project] Getting quotas for user 01b036d0953049ffbfcfc93623b04a47 and project 3f208f744c404039b9997fbefddc5a14. Resources: dict_keys(['metadata_items']) {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:51:32.676809 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-0c969162-2088-4656-89d9-7a40130948cd tempest-ImagesMetadataTestJSON-1595503781 tempest-ImagesMetadataTestJSON-1595503781-project] 10.222.0.70 "PUT /compute/v2.1/images/9c0c6a0b-b061-44af-bef5-83f0a9f0b81c/metadata" status: 200 len: 64 microversion: 2.1 time: 0.740593 Aug 27 02:51:32.677607 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1144/2304] 10.222.0.70 () {60 vars in 1280 bytes} [Sat Aug 27 02:51:31 2022] PUT /compute/v2.1/images/9c0c6a0b-b061-44af-bef5-83f0a9f0b81c/metadata => generated 64 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:51:32.690528 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7ead5e9e-5544-41aa-955d-6924f8781b2c tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:32.691390 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-7ead5e9e-5544-41aa-955d-6924f8781b2c tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] [instance: 503900da-e41b-4787-bb1e-9d3df7df05b6] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:32.720991 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7ead5e9e-5544-41aa-955d-6924f8781b2c tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:32.729552 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7ead5e9e-5544-41aa-955d-6924f8781b2c tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:32.730089 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7ead5e9e-5544-41aa-955d-6924f8781b2c tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:32.730863 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7ead5e9e-5544-41aa-955d-6924f8781b2c tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:32.731392 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7ead5e9e-5544-41aa-955d-6924f8781b2c tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:32.733719 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7ead5e9e-5544-41aa-955d-6924f8781b2c tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:33.014070 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-ca918f32-a108-4ee0-91c3-2d38ce6e015c tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:33.014578 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-7ead5e9e-5544-41aa-955d-6924f8781b2c tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ece2eb399074418ac5f890d223c1be0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c13c50438234109913876bf5a11d271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:33.035554 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-7ead5e9e-5544-41aa-955d-6924f8781b2c tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] 10.222.0.70 "GET /compute/v2.1/servers/503900da-e41b-4787-bb1e-9d3df7df05b6" status: 200 len: 1328 microversion: 2.1 time: 0.351715 Aug 27 02:51:33.036405 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1145/2305] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:32 2022] GET /compute/v2.1/servers/503900da-e41b-4787-bb1e-9d3df7df05b6 => generated 1328 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:33.045726 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ca918f32-a108-4ee0-91c3-2d38ce6e015c tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/a4aca2ed-a835-4f8f-96ae-c3502645425a" status: 200 len: 1471 microversion: 2.1 time: 1.608268 Aug 27 02:51:33.047779 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1161/2306] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:31 2022] GET /compute/v2.1/servers/a4aca2ed-a835-4f8f-96ae-c3502645425a => generated 1471 bytes in 1611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:33.062232 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-07b05603-f55b-4073-8548-6d05d3f16bfa tempest-ImagesMetadataTestJSON-1595503781 tempest-ImagesMetadataTestJSON-1595503781-project] Calling method '.version_select at 0x7f5ede8e63a0>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:33.075310 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-92da6b98-6bc5-4d09-8e93-f66da5c62421 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:51:33.076404 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-92da6b98-6bc5-4d09-8e93-f66da5c62421 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: a4aca2ed-a835-4f8f-96ae-c3502645425a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:33.088552 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-92da6b98-6bc5-4d09-8e93-f66da5c62421 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:33.089313 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-92da6b98-6bc5-4d09-8e93-f66da5c62421 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:33.089952 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-92da6b98-6bc5-4d09-8e93-f66da5c62421 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:33.090840 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-92da6b98-6bc5-4d09-8e93-f66da5c62421 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:33.092182 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-92da6b98-6bc5-4d09-8e93-f66da5c62421 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:33.094594 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-92da6b98-6bc5-4d09-8e93-f66da5c62421 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:33.162815 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-07b05603-f55b-4073-8548-6d05d3f16bfa tempest-ImagesMetadataTestJSON-1595503781 tempest-ImagesMetadataTestJSON-1595503781-project] 10.222.0.70 "GET /compute/v2.1/images/9c0c6a0b-b061-44af-bef5-83f0a9f0b81c/metadata" status: 200 len: 64 microversion: 2.1 time: 0.114753 Aug 27 02:51:33.177262 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1146/2307] 10.222.0.70 () {58 vars in 1260 bytes} [Sat Aug 27 02:51:33 2022] GET /compute/v2.1/images/9c0c6a0b-b061-44af-bef5-83f0a9f0b81c/metadata => generated 64 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:51:33.188764 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-80d612c1-edcd-4621-a55a-78c90b0e724a tempest-ImagesMetadataTestJSON-1595503781 tempest-ImagesMetadataTestJSON-1595503781-project] Action: 'update_all', calling method: .version_select at 0x7f5ede981af0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:51:33.190833 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-92da6b98-6bc5-4d09-8e93-f66da5c62421 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:33.196131 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-92da6b98-6bc5-4d09-8e93-f66da5c62421 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:33.196894 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-92da6b98-6bc5-4d09-8e93-f66da5c62421 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:33.199835 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-92da6b98-6bc5-4d09-8e93-f66da5c62421 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:33.201552 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-92da6b98-6bc5-4d09-8e93-f66da5c62421 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:33.202196 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-92da6b98-6bc5-4d09-8e93-f66da5c62421 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:33.275901 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-80d612c1-edcd-4621-a55a-78c90b0e724a tempest-ImagesMetadataTestJSON-1595503781 tempest-ImagesMetadataTestJSON-1595503781-project] Getting quotas for project 3f208f744c404039b9997fbefddc5a14. Resources: dict_keys(['metadata_items']) {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:51:33.288451 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-80d612c1-edcd-4621-a55a-78c90b0e724a tempest-ImagesMetadataTestJSON-1595503781 tempest-ImagesMetadataTestJSON-1595503781-project] Getting quotas for user 01b036d0953049ffbfcfc93623b04a47 and project 3f208f744c404039b9997fbefddc5a14. Resources: dict_keys(['metadata_items']) {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:51:33.291373 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-92da6b98-6bc5-4d09-8e93-f66da5c62421 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Getting quotas for project 937a5eeccaa7425ca72c8c74fb99f11a. Resources: {'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:51:33.311171 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-92da6b98-6bc5-4d09-8e93-f66da5c62421 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Getting quotas for user 0b310e73ecd244d2938812d5be99558c and project 937a5eeccaa7425ca72c8c74fb99f11a. Resources: {'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:51:33.596929 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-92da6b98-6bc5-4d09-8e93-f66da5c62421 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "POST /compute/v2.1/servers/a4aca2ed-a835-4f8f-96ae-c3502645425a/action" status: 202 len: 0 microversion: 2.1 time: 0.526272 Aug 27 02:51:33.605898 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1162/2308] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 02:51:33 2022] POST /compute/v2.1/servers/a4aca2ed-a835-4f8f-96ae-c3502645425a/action => generated 0 bytes in 536 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:51:33.616481 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-7e343956-f0f6-4db8-b230-e6b8adb4dfa1 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:33.621814 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-7e343956-f0f6-4db8-b230-e6b8adb4dfa1 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: a4aca2ed-a835-4f8f-96ae-c3502645425a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:33.638443 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7e343956-f0f6-4db8-b230-e6b8adb4dfa1 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:33.641236 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7e343956-f0f6-4db8-b230-e6b8adb4dfa1 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:33.644001 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7e343956-f0f6-4db8-b230-e6b8adb4dfa1 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:33.645130 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7e343956-f0f6-4db8-b230-e6b8adb4dfa1 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:33.645766 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7e343956-f0f6-4db8-b230-e6b8adb4dfa1 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:33.646408 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7e343956-f0f6-4db8-b230-e6b8adb4dfa1 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:33.933605 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-80d612c1-edcd-4621-a55a-78c90b0e724a tempest-ImagesMetadataTestJSON-1595503781 tempest-ImagesMetadataTestJSON-1595503781-project] 10.222.0.70 "PUT /compute/v2.1/images/9c0c6a0b-b061-44af-bef5-83f0a9f0b81c/metadata" status: 200 len: 61 microversion: 2.1 time: 0.748992 Aug 27 02:51:33.934388 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1147/2309] 10.222.0.70 () {60 vars in 1280 bytes} [Sat Aug 27 02:51:33 2022] PUT /compute/v2.1/images/9c0c6a0b-b061-44af-bef5-83f0a9f0b81c/metadata => generated 61 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 27 02:51:33.943935 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-1974901b-0025-4990-ad63-5d88b22497dd tempest-ImagesMetadataTestJSON-1595503781 tempest-ImagesMetadataTestJSON-1595503781-project] Action: 'update', calling method: .version_select at 0x7f5ede8f70d0>, body: {"meta": {"os_version": "alt"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:51:34.037642 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-1974901b-0025-4990-ad63-5d88b22497dd tempest-ImagesMetadataTestJSON-1595503781 tempest-ImagesMetadataTestJSON-1595503781-project] Getting quotas for project 3f208f744c404039b9997fbefddc5a14. Resources: dict_keys(['metadata_items']) {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:51:34.055273 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-1974901b-0025-4990-ad63-5d88b22497dd tempest-ImagesMetadataTestJSON-1595503781 tempest-ImagesMetadataTestJSON-1595503781-project] Getting quotas for user 01b036d0953049ffbfcfc93623b04a47 and project 3f208f744c404039b9997fbefddc5a14. Resources: dict_keys(['metadata_items']) {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:51:34.534242 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-7e343956-f0f6-4db8-b230-e6b8adb4dfa1 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:34.547719 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-7e343956-f0f6-4db8-b230-e6b8adb4dfa1 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/a4aca2ed-a835-4f8f-96ae-c3502645425a" status: 200 len: 1470 microversion: 2.1 time: 0.935313 Aug 27 02:51:34.550450 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-1974901b-0025-4990-ad63-5d88b22497dd tempest-ImagesMetadataTestJSON-1595503781 tempest-ImagesMetadataTestJSON-1595503781-project] 10.222.0.70 "PUT /compute/v2.1/images/9c0c6a0b-b061-44af-bef5-83f0a9f0b81c/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.610495 Aug 27 02:51:34.551479 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1148/2310] 10.222.0.70 () {60 vars in 1313 bytes} [Sat Aug 27 02:51:33 2022] PUT /compute/v2.1/images/9c0c6a0b-b061-44af-bef5-83f0a9f0b81c/metadata/os_version => generated 31 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 27 02:51:34.568106 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1163/2311] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:33 2022] GET /compute/v2.1/servers/a4aca2ed-a835-4f8f-96ae-c3502645425a => generated 1470 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:34.568243 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a35d0e5b-2b04-434c-82ae-2837da871e1e tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:34.568243 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-a35d0e5b-2b04-434c-82ae-2837da871e1e tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] [instance: 503900da-e41b-4787-bb1e-9d3df7df05b6] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:34.574364 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a35d0e5b-2b04-434c-82ae-2837da871e1e tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:34.574862 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a35d0e5b-2b04-434c-82ae-2837da871e1e tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:34.575317 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a35d0e5b-2b04-434c-82ae-2837da871e1e tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:34.576033 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a35d0e5b-2b04-434c-82ae-2837da871e1e tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:34.576445 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-77159d1c-6612-4b68-8f30-65d20f596d64 tempest-ImagesMetadataTestJSON-1595503781 tempest-ImagesMetadataTestJSON-1595503781-project] Calling method '.version_select at 0x7f5ee3030280>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:34.591091 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a35d0e5b-2b04-434c-82ae-2837da871e1e tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:34.591914 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a35d0e5b-2b04-434c-82ae-2837da871e1e tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:34.641244 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-77159d1c-6612-4b68-8f30-65d20f596d64 tempest-ImagesMetadataTestJSON-1595503781 tempest-ImagesMetadataTestJSON-1595503781-project] 10.222.0.70 "GET /compute/v2.1/images/9c0c6a0b-b061-44af-bef5-83f0a9f0b81c/metadata" status: 200 len: 58 microversion: 2.1 time: 0.077563 Aug 27 02:51:34.643045 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1164/2312] 10.222.0.70 () {58 vars in 1260 bytes} [Sat Aug 27 02:51:34 2022] GET /compute/v2.1/images/9c0c6a0b-b061-44af-bef5-83f0a9f0b81c/metadata => generated 58 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:51:34.657375 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9ddf4496-849e-4d2e-bb1f-446de03905d9 tempest-ImagesMetadataTestJSON-1595503781 tempest-ImagesMetadataTestJSON-1595503781-project] Action: 'update_all', calling method: .version_select at 0x7f5ee2ce8670>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:51:34.823563 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-9ddf4496-849e-4d2e-bb1f-446de03905d9 tempest-ImagesMetadataTestJSON-1595503781 tempest-ImagesMetadataTestJSON-1595503781-project] Getting quotas for project 3f208f744c404039b9997fbefddc5a14. Resources: dict_keys(['metadata_items']) {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:51:34.851184 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-9ddf4496-849e-4d2e-bb1f-446de03905d9 tempest-ImagesMetadataTestJSON-1595503781 tempest-ImagesMetadataTestJSON-1595503781-project] Getting quotas for user 01b036d0953049ffbfcfc93623b04a47 and project 3f208f744c404039b9997fbefddc5a14. Resources: dict_keys(['metadata_items']) {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:51:35.192522 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-a35d0e5b-2b04-434c-82ae-2837da871e1e tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ece2eb399074418ac5f890d223c1be0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c13c50438234109913876bf5a11d271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:35.202709 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a35d0e5b-2b04-434c-82ae-2837da871e1e tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] 10.222.0.70 "GET /compute/v2.1/servers/503900da-e41b-4787-bb1e-9d3df7df05b6" status: 200 len: 1396 microversion: 2.1 time: 0.647956 Aug 27 02:51:35.203348 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1149/2313] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:34 2022] GET /compute/v2.1/servers/503900da-e41b-4787-bb1e-9d3df7df05b6 => generated 1396 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:35.399969 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9ddf4496-849e-4d2e-bb1f-446de03905d9 tempest-ImagesMetadataTestJSON-1595503781 tempest-ImagesMetadataTestJSON-1595503781-project] 10.222.0.70 "PUT /compute/v2.1/images/9c0c6a0b-b061-44af-bef5-83f0a9f0b81c/metadata" status: 200 len: 61 microversion: 2.1 time: 0.749747 Aug 27 02:51:35.400799 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1165/2314] 10.222.0.70 () {60 vars in 1280 bytes} [Sat Aug 27 02:51:34 2022] PUT /compute/v2.1/images/9c0c6a0b-b061-44af-bef5-83f0a9f0b81c/metadata => generated 61 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 27 02:51:35.410747 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-9c82f13c-05a7-43c3-bf90-245ab2bc43d0 tempest-ImagesMetadataTestJSON-1595503781 tempest-ImagesMetadataTestJSON-1595503781-project] Action: 'create', calling method: .version_select at 0x7f5ede8d9310>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:51:35.495890 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-9c82f13c-05a7-43c3-bf90-245ab2bc43d0 tempest-ImagesMetadataTestJSON-1595503781 tempest-ImagesMetadataTestJSON-1595503781-project] Getting quotas for project 3f208f744c404039b9997fbefddc5a14. Resources: dict_keys(['metadata_items']) {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:51:35.514773 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-9c82f13c-05a7-43c3-bf90-245ab2bc43d0 tempest-ImagesMetadataTestJSON-1595503781 tempest-ImagesMetadataTestJSON-1595503781-project] Getting quotas for user 01b036d0953049ffbfcfc93623b04a47 and project 3f208f744c404039b9997fbefddc5a14. Resources: dict_keys(['metadata_items']) {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:51:35.569591 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6bbb4114-9644-43c9-a2d7-e26192ba225d tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:35.570213 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-6bbb4114-9644-43c9-a2d7-e26192ba225d tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: a4aca2ed-a835-4f8f-96ae-c3502645425a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:35.583243 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6bbb4114-9644-43c9-a2d7-e26192ba225d tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:35.583733 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6bbb4114-9644-43c9-a2d7-e26192ba225d tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:35.587926 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6bbb4114-9644-43c9-a2d7-e26192ba225d tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:35.591671 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6bbb4114-9644-43c9-a2d7-e26192ba225d tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:35.600152 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6bbb4114-9644-43c9-a2d7-e26192ba225d tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:35.600533 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6bbb4114-9644-43c9-a2d7-e26192ba225d tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:36.148265 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-9c82f13c-05a7-43c3-bf90-245ab2bc43d0 tempest-ImagesMetadataTestJSON-1595503781 tempest-ImagesMetadataTestJSON-1595503781-project] 10.222.0.70 "POST /compute/v2.1/images/9c0c6a0b-b061-44af-bef5-83f0a9f0b81c/metadata" status: 200 len: 85 microversion: 2.1 time: 0.741550 Aug 27 02:51:36.148913 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1150/2315] 10.222.0.70 () {60 vars in 1281 bytes} [Sat Aug 27 02:51:35 2022] POST /compute/v2.1/images/9c0c6a0b-b061-44af-bef5-83f0a9f0b81c/metadata => generated 85 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:51:36.159844 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-9d535151-0792-4557-8731-d892f7e5975f tempest-ImagesMetadataTestJSON-1595503781 tempest-ImagesMetadataTestJSON-1595503781-project] Calling method '.version_select at 0x7f5ede90d8b0>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:36.269466 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-9d535151-0792-4557-8731-d892f7e5975f tempest-ImagesMetadataTestJSON-1595503781 tempest-ImagesMetadataTestJSON-1595503781-project] 10.222.0.70 "GET /compute/v2.1/images/9c0c6a0b-b061-44af-bef5-83f0a9f0b81c/metadata" status: 200 len: 85 microversion: 2.1 time: 0.113530 Aug 27 02:51:36.275684 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1151/2316] 10.222.0.70 () {58 vars in 1260 bytes} [Sat Aug 27 02:51:36 2022] GET /compute/v2.1/images/9c0c6a0b-b061-44af-bef5-83f0a9f0b81c/metadata => generated 85 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:51:36.286479 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ba361634-52b1-4dc9-b0b5-88dac8c47110 tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:36.287107 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-ba361634-52b1-4dc9-b0b5-88dac8c47110 tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] [instance: 503900da-e41b-4787-bb1e-9d3df7df05b6] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:36.346794 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ba361634-52b1-4dc9-b0b5-88dac8c47110 tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:36.348607 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ba361634-52b1-4dc9-b0b5-88dac8c47110 tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:36.353766 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ba361634-52b1-4dc9-b0b5-88dac8c47110 tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:36.358012 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ba361634-52b1-4dc9-b0b5-88dac8c47110 tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:36.365930 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ba361634-52b1-4dc9-b0b5-88dac8c47110 tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:36.368000 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ba361634-52b1-4dc9-b0b5-88dac8c47110 tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:36.527053 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-6bbb4114-9644-43c9-a2d7-e26192ba225d tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:36.542763 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-6bbb4114-9644-43c9-a2d7-e26192ba225d tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/a4aca2ed-a835-4f8f-96ae-c3502645425a" status: 200 len: 1470 microversion: 2.1 time: 0.975749 Aug 27 02:51:36.554722 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1166/2317] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:35 2022] GET /compute/v2.1/servers/a4aca2ed-a835-4f8f-96ae-c3502645425a => generated 1470 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:51:37.569766 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d6a117a6-7f92-46ab-a642-43e808705484 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:37.574710 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d6a117a6-7f92-46ab-a642-43e808705484 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: a4aca2ed-a835-4f8f-96ae-c3502645425a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:37.586750 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d6a117a6-7f92-46ab-a642-43e808705484 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:37.598250 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d6a117a6-7f92-46ab-a642-43e808705484 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:37.598933 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d6a117a6-7f92-46ab-a642-43e808705484 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:37.599726 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d6a117a6-7f92-46ab-a642-43e808705484 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:37.600187 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d6a117a6-7f92-46ab-a642-43e808705484 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:37.600656 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d6a117a6-7f92-46ab-a642-43e808705484 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:37.761759 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-ba361634-52b1-4dc9-b0b5-88dac8c47110 tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ece2eb399074418ac5f890d223c1be0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c13c50438234109913876bf5a11d271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:37.769871 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ba361634-52b1-4dc9-b0b5-88dac8c47110 tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] 10.222.0.70 "GET /compute/v2.1/servers/503900da-e41b-4787-bb1e-9d3df7df05b6" status: 200 len: 1396 microversion: 2.1 time: 1.492929 Aug 27 02:51:37.770712 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1152/2318] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:36 2022] GET /compute/v2.1/servers/503900da-e41b-4787-bb1e-9d3df7df05b6 => generated 1396 bytes in 1494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:38.294036 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-d6a117a6-7f92-46ab-a642-43e808705484 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:38.317562 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d6a117a6-7f92-46ab-a642-43e808705484 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/a4aca2ed-a835-4f8f-96ae-c3502645425a" status: 200 len: 1470 microversion: 2.1 time: 0.750713 Aug 27 02:51:38.320458 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1167/2319] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:37 2022] GET /compute/v2.1/servers/a4aca2ed-a835-4f8f-96ae-c3502645425a => generated 1470 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:38.769045 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7e1f17ec-25c1-4f12-b63c-d15df69e2742 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-517229992", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "networks": [{"uuid": "677b7ba1-2913-4272-8be4-7a8908d3b556"}]}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:51:38.791180 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-447aee17-cfcd-461f-95cc-8edc8b71bdde tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:38.793133 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-447aee17-cfcd-461f-95cc-8edc8b71bdde tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] [instance: 503900da-e41b-4787-bb1e-9d3df7df05b6] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:38.810721 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-447aee17-cfcd-461f-95cc-8edc8b71bdde tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:38.811627 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-447aee17-cfcd-461f-95cc-8edc8b71bdde tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:38.812269 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-447aee17-cfcd-461f-95cc-8edc8b71bdde tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:38.814851 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-447aee17-cfcd-461f-95cc-8edc8b71bdde tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:38.816258 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-447aee17-cfcd-461f-95cc-8edc8b71bdde tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:38.818968 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-447aee17-cfcd-461f-95cc-8edc8b71bdde tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:38.883427 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.network.neutron [None req-7e1f17ec-25c1-4f12-b63c-d15df69e2742 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] validate_networks() for [('677b7ba1-2913-4272-8be4-7a8908d3b556', None, None, None, None, None)] {{(pid=134051) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:51:40.344642 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-447aee17-cfcd-461f-95cc-8edc8b71bdde tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ece2eb399074418ac5f890d223c1be0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c13c50438234109913876bf5a11d271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:40.353884 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-447aee17-cfcd-461f-95cc-8edc8b71bdde tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] 10.222.0.70 "GET /compute/v2.1/servers/503900da-e41b-4787-bb1e-9d3df7df05b6" status: 200 len: 1396 microversion: 2.1 time: 1.567201 Aug 27 02:51:40.364950 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1168/2320] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:38 2022] GET /compute/v2.1/servers/503900da-e41b-4787-bb1e-9d3df7df05b6 => generated 1396 bytes in 1579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:40.381976 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-c7d16a6d-64db-4cb0-89bd-6ca81eefc345 req-f3350cb5-6671-4261-89b2-164be979b73c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4aca2ed-a835-4f8f-96ae-c3502645425a", "name": "network-vif-plugged", "status": "completed", "tag": "4f9042c6-628d-483c-88dc-649ec8de9f53"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:51:40.413553 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-c7d16a6d-64db-4cb0-89bd-6ca81eefc345 req-f3350cb5-6671-4261-89b2-164be979b73c service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:40.423471 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-c7d16a6d-64db-4cb0-89bd-6ca81eefc345 req-f3350cb5-6671-4261-89b2-164be979b73c service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:40.429643 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-c7d16a6d-64db-4cb0-89bd-6ca81eefc345 req-f3350cb5-6671-4261-89b2-164be979b73c service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:40.472004 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-c7d16a6d-64db-4cb0-89bd-6ca81eefc345 req-f3350cb5-6671-4261-89b2-164be979b73c service nova] Creating event network-vif-plugged:4f9042c6-628d-483c-88dc-649ec8de9f53 for instance a4aca2ed-a835-4f8f-96ae-c3502645425a on n-h2-852278-4 Aug 27 02:51:40.485006 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [req-c7d16a6d-64db-4cb0-89bd-6ca81eefc345 req-f3350cb5-6671-4261-89b2-164be979b73c service nova] Instance a4aca2ed-a835-4f8f-96ae-c3502645425a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-852278-4'} {{(pid=134052) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 02:51:40.507248 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-c7d16a6d-64db-4cb0-89bd-6ca81eefc345 req-f3350cb5-6671-4261-89b2-164be979b73c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140139 Aug 27 02:51:40.508404 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1169/2321] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:51:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:51:40.521050 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-3aa754e0-3ad0-474b-8bae-1e9b327452d8 req-7fa93346-0824-4172-909c-d1176a415909 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "503900da-e41b-4787-bb1e-9d3df7df05b6", "tag": "d5dfa226-5023-4e6d-a3ae-5b36139b84bc"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:51:40.551993 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-3aa754e0-3ad0-474b-8bae-1e9b327452d8 req-7fa93346-0824-4172-909c-d1176a415909 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:40.556775 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-3aa754e0-3ad0-474b-8bae-1e9b327452d8 req-7fa93346-0824-4172-909c-d1176a415909 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:40.558423 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-3aa754e0-3ad0-474b-8bae-1e9b327452d8 req-7fa93346-0824-4172-909c-d1176a415909 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:40.596356 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-3aa754e0-3ad0-474b-8bae-1e9b327452d8 req-7fa93346-0824-4172-909c-d1176a415909 service nova] Creating event network-changed:d5dfa226-5023-4e6d-a3ae-5b36139b84bc for instance 503900da-e41b-4787-bb1e-9d3df7df05b6 on n-h2-852278-4 Aug 27 02:51:40.616970 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-3aa754e0-3ad0-474b-8bae-1e9b327452d8 req-7fa93346-0824-4172-909c-d1176a415909 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105334 Aug 27 02:51:40.619204 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1170/2322] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:51:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:51:40.636276 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-710c22b2-6d27-4cbc-b7cf-0150e8a521ba tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:40.637761 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-710c22b2-6d27-4cbc-b7cf-0150e8a521ba tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: a4aca2ed-a835-4f8f-96ae-c3502645425a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:40.654707 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-710c22b2-6d27-4cbc-b7cf-0150e8a521ba tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:40.657851 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-710c22b2-6d27-4cbc-b7cf-0150e8a521ba tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:40.660742 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-710c22b2-6d27-4cbc-b7cf-0150e8a521ba tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:40.662778 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-710c22b2-6d27-4cbc-b7cf-0150e8a521ba tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:40.663545 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-710c22b2-6d27-4cbc-b7cf-0150e8a521ba tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:40.664675 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-710c22b2-6d27-4cbc-b7cf-0150e8a521ba tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:41.009656 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-7e1f17ec-25c1-4f12-b63c-d15df69e2742 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Flavor limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:51:41.011201 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-7e1f17ec-25c1-4f12-b63c-d15df69e2742 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Image limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:51:41.011884 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-7e1f17ec-25c1-4f12-b63c-d15df69e2742 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Flavor pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:51:41.012525 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-7e1f17ec-25c1-4f12-b63c-d15df69e2742 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Image pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:51:41.013140 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-7e1f17ec-25c1-4f12-b63c-d15df69e2742 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:51:41.046734 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7e1f17ec-25c1-4f12-b63c-d15df69e2742 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:41.047590 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7e1f17ec-25c1-4f12-b63c-d15df69e2742 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:41.048429 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7e1f17ec-25c1-4f12-b63c-d15df69e2742 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:41.049995 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7e1f17ec-25c1-4f12-b63c-d15df69e2742 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:41.052077 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7e1f17ec-25c1-4f12-b63c-d15df69e2742 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:41.054934 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7e1f17ec-25c1-4f12-b63c-d15df69e2742 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:41.109324 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-7e1f17ec-25c1-4f12-b63c-d15df69e2742 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Getting quotas for project 40794f05e8b94a0f8f087a87a58e0ba1. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:51:41.131262 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-7e1f17ec-25c1-4f12-b63c-d15df69e2742 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Getting quotas for user f496f24dccea47bd9a5ab532fe45e370 and project 40794f05e8b94a0f8f087a87a58e0ba1. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:51:41.166206 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-7e1f17ec-25c1-4f12-b63c-d15df69e2742 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Going to run 1 instances... {{(pid=134051) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:51:41.169944 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-7e1f17ec-25c1-4f12-b63c-d15df69e2742 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] [instance: 457da794-89e7-4b30-95ba-802c95550c7e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134051) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:51:41.271229 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-7e1f17ec-25c1-4f12-b63c-d15df69e2742 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.777230 Aug 27 02:51:41.272702 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1153/2323] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 02:51:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 2779 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:51:41.712770 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-710c22b2-6d27-4cbc-b7cf-0150e8a521ba tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:41.736288 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-710c22b2-6d27-4cbc-b7cf-0150e8a521ba tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/a4aca2ed-a835-4f8f-96ae-c3502645425a" status: 200 len: 1536 microversion: 2.1 time: 1.114118 Aug 27 02:51:41.747516 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1171/2324] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:40 2022] GET /compute/v2.1/servers/a4aca2ed-a835-4f8f-96ae-c3502645425a => generated 1536 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:41.771952 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-da867447-3bea-4f94-8d3f-a5c4c39fba67 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:41.775640 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-da867447-3bea-4f94-8d3f-a5c4c39fba67 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] [instance: 457da794-89e7-4b30-95ba-802c95550c7e] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:41.982462 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7bf1f2b8-1880-4c02-b6e2-9477af06ebee tempest-KeyPairsV2TestJSON-131669743 tempest-KeyPairsV2TestJSON-131669743-project] Action: 'create', calling method: .version_select at 0x7f5edf4b9820>, body: {"keypair": {"name": "tempest-keypair-338957080", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC/JcAfqGXYfURcg38vkyuUY2G+VlJfan8FlqEvYIdvfVh7INwn7uu4Ooq4q0COhc/mifcoU5hsUVc3XeuURL8p8NwCrYWVTplV6gmdK9x1VYVIGIbgrhQ6zX20FysR/Cw=="}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:51:42.006167 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:51:42.027427 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-da867447-3bea-4f94-8d3f-a5c4c39fba67 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f496f24dccea47bd9a5ab532fe45e370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40794f05e8b94a0f8f087a87a58e0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:42.036045 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-7bf1f2b8-1880-4c02-b6e2-9477af06ebee tempest-KeyPairsV2TestJSON-131669743 tempest-KeyPairsV2TestJSON-131669743-project] Getting quotas for project bab5d59e9ede47999dcdf2cbbd6e2427. Resources: {'key_pairs'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:51:42.039177 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=19 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:51:42.045180 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-da867447-3bea-4f94-8d3f-a5c4c39fba67 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "GET /compute/v2.1/servers/457da794-89e7-4b30-95ba-802c95550c7e" status: 200 len: 1207 microversion: 2.1 time: 0.296078 Aug 27 02:51:42.045423 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-7bf1f2b8-1880-4c02-b6e2-9477af06ebee tempest-KeyPairsV2TestJSON-131669743 tempest-KeyPairsV2TestJSON-131669743-project] Getting quotas for user f8b142126da04af2bf8b32bc289e5954 and project bab5d59e9ede47999dcdf2cbbd6e2427. Resources: {'key_pairs'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:51:42.045796 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1172/2325] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:41 2022] GET /compute/v2.1/servers/457da794-89e7-4b30-95ba-802c95550c7e => generated 1207 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:42.065468 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-854a9f2a-7224-43cc-a65f-1517c23452fb tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:42.066084 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-854a9f2a-7224-43cc-a65f-1517c23452fb tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] [instance: 503900da-e41b-4787-bb1e-9d3df7df05b6] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:42.075679 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-7bf1f2b8-1880-4c02-b6e2-9477af06ebee tempest-KeyPairsV2TestJSON-131669743 tempest-KeyPairsV2TestJSON-131669743-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.801089 Aug 27 02:51:42.076000 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-854a9f2a-7224-43cc-a65f-1517c23452fb tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:42.080453 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-854a9f2a-7224-43cc-a65f-1517c23452fb tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:42.080637 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1154/2326] 10.222.0.70 () {60 vars in 1159 bytes} [Sat Aug 27 02:51:41 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:51:42.082110 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-854a9f2a-7224-43cc-a65f-1517c23452fb tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:42.089599 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-854a9f2a-7224-43cc-a65f-1517c23452fb tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:42.090104 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-854a9f2a-7224-43cc-a65f-1517c23452fb tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:42.093929 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-854a9f2a-7224-43cc-a65f-1517c23452fb tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:42.100044 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8b6403f2-bd07-4c76-83f0-7fee22f1f97c tempest-KeyPairsV2TestJSON-131669743 tempest-KeyPairsV2TestJSON-131669743-project] Calling method '.version_select at 0x7f5ede996b80>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:42.123101 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-8b6403f2-bd07-4c76-83f0-7fee22f1f97c tempest-KeyPairsV2TestJSON-131669743 tempest-KeyPairsV2TestJSON-131669743-project] 10.222.0.70 "GET /compute/v2.1/os-keypairs/tempest-keypair-338957080" status: 200 len: 497 microversion: 2.1 time: 0.038633 Aug 27 02:51:42.124716 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1155/2327] 10.222.0.70 () {58 vars in 1215 bytes} [Sat Aug 27 02:51:42 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-338957080 => generated 497 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:51:42.138383 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-07bb553f-279a-41f4-bcd7-4fd5f51993ff tempest-KeyPairsV2TestJSON-131669743 tempest-KeyPairsV2TestJSON-131669743-project] Calling method '.version_select at 0x7f5ede993c10>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:42.187809 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-07bb553f-279a-41f4-bcd7-4fd5f51993ff tempest-KeyPairsV2TestJSON-131669743 tempest-KeyPairsV2TestJSON-131669743-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-338957080" status: 202 len: 0 microversion: 2.1 time: 0.052010 Aug 27 02:51:42.189257 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1156/2328] 10.222.0.70 () {58 vars in 1218 bytes} [Sat Aug 27 02:51:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-338957080 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:51:42.222846 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-66d9bf6b-b7f2-4650-940a-4056ed92278e tempest-KeyPairsV2TestJSON-131669743 tempest-KeyPairsV2TestJSON-131669743-project] Action: 'create', calling method: .version_select at 0x7f5ede981310>, body: {"keypair": {"name": "tempest-keypair-221038911", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPu7P7m14/gNgnpHGnkbxqHrio+Ym5a5jSUwSBQxJAcJx4jozXIETFR/igTmcizw801yvFkIyW2JtEff/Mn0quiDIEyUBbZ6pRVEf3ufXMbRna0DyQzm09TVlQVhGrMRmw=="}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:51:42.247416 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-66d9bf6b-b7f2-4650-940a-4056ed92278e tempest-KeyPairsV2TestJSON-131669743 tempest-KeyPairsV2TestJSON-131669743-project] Getting quotas for project bab5d59e9ede47999dcdf2cbbd6e2427. Resources: {'key_pairs'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:51:42.253895 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-66d9bf6b-b7f2-4650-940a-4056ed92278e tempest-KeyPairsV2TestJSON-131669743 tempest-KeyPairsV2TestJSON-131669743-project] Getting quotas for user f8b142126da04af2bf8b32bc289e5954 and project bab5d59e9ede47999dcdf2cbbd6e2427. Resources: {'key_pairs'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:51:42.285108 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-66d9bf6b-b7f2-4650-940a-4056ed92278e tempest-KeyPairsV2TestJSON-131669743 tempest-KeyPairsV2TestJSON-131669743-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.087395 Aug 27 02:51:42.285884 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1157/2329] 10.222.0.70 () {60 vars in 1159 bytes} [Sat Aug 27 02:51:42 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:51:42.297204 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0c36c9fe-1ffc-47bd-852a-89e802ccdc5b tempest-KeyPairsV2TestJSON-131669743 tempest-KeyPairsV2TestJSON-131669743-project] Calling method '.version_select at 0x7f5ede8d9c10>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:42.333631 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-0c36c9fe-1ffc-47bd-852a-89e802ccdc5b tempest-KeyPairsV2TestJSON-131669743 tempest-KeyPairsV2TestJSON-131669743-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-221038911" status: 202 len: 0 microversion: 2.1 time: 0.039492 Aug 27 02:51:42.335220 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1158/2330] 10.222.0.70 () {58 vars in 1218 bytes} [Sat Aug 27 02:51:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-221038911 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:51:42.359487 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d5f9856e-5105-46c0-9e21-8645d74eb27e tempest-KeyPairsV2TestJSON-131669743 tempest-KeyPairsV2TestJSON-131669743-project] Action: 'create', calling method: .version_select at 0x7f5edf92f0d0>, body: {"keypair": {"name": "tempest-keypair-1120361276", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:51:42.386928 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-d5f9856e-5105-46c0-9e21-8645d74eb27e tempest-KeyPairsV2TestJSON-131669743 tempest-KeyPairsV2TestJSON-131669743-project] Getting quotas for project bab5d59e9ede47999dcdf2cbbd6e2427. Resources: {'key_pairs'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:51:42.393999 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-d5f9856e-5105-46c0-9e21-8645d74eb27e tempest-KeyPairsV2TestJSON-131669743 tempest-KeyPairsV2TestJSON-131669743-project] Getting quotas for user f8b142126da04af2bf8b32bc289e5954 and project bab5d59e9ede47999dcdf2cbbd6e2427. Resources: {'key_pairs'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:51:42.523102 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d5f9856e-5105-46c0-9e21-8645d74eb27e tempest-KeyPairsV2TestJSON-131669743 tempest-KeyPairsV2TestJSON-131669743-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 574 microversion: 2.1 time: 0.176961 Aug 27 02:51:42.535212 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1159/2331] 10.222.0.70 () {60 vars in 1159 bytes} [Sat Aug 27 02:51:42 2022] POST /compute/v2.1/os-keypairs => generated 574 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:51:42.549463 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-72d3d3bb-27c3-46f7-9e7d-d7365b0bf570 tempest-KeyPairsV2TestJSON-131669743 tempest-KeyPairsV2TestJSON-131669743-project] Calling method '.version_select at 0x7f5ede993d30>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:42.596759 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-72d3d3bb-27c3-46f7-9e7d-d7365b0bf570 tempest-KeyPairsV2TestJSON-131669743 tempest-KeyPairsV2TestJSON-131669743-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1120361276" status: 202 len: 0 microversion: 2.1 time: 0.058329 Aug 27 02:51:42.601731 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1160/2332] 10.222.0.70 () {58 vars in 1221 bytes} [Sat Aug 27 02:51:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1120361276 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:51:42.624632 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-6a629a3d-2a22-4d62-9bc4-e5ffa463b1f5 tempest-KeyPairsV2TestJSON-131669743 tempest-KeyPairsV2TestJSON-131669743-project] Action: 'create', calling method: .version_select at 0x7f5ede8e6820>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-976204332", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBENyilvae/SrHIdJ3OEUWGt8rgA2K+zZyxCG3CExq/RL/K0dDykud85xynBVGQ2sJym3xp092qqcccs/1YGLq0uQm0OiMUDG4med9WSV/SEcDA7ZgrZQHvX9E1fkg713MA=="}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:51:42.661339 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-854a9f2a-7224-43cc-a65f-1517c23452fb tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ece2eb399074418ac5f890d223c1be0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c13c50438234109913876bf5a11d271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:42.670277 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-854a9f2a-7224-43cc-a65f-1517c23452fb tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] 10.222.0.70 "GET /compute/v2.1/servers/503900da-e41b-4787-bb1e-9d3df7df05b6" status: 200 len: 1396 microversion: 2.1 time: 0.608680 Aug 27 02:51:42.689530 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-6a629a3d-2a22-4d62-9bc4-e5ffa463b1f5 tempest-KeyPairsV2TestJSON-131669743 tempest-KeyPairsV2TestJSON-131669743-project] Getting quotas for project bab5d59e9ede47999dcdf2cbbd6e2427. Resources: {'key_pairs'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:51:42.690304 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1173/2333] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:42 2022] GET /compute/v2.1/servers/503900da-e41b-4787-bb1e-9d3df7df05b6 => generated 1396 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:42.700546 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-6a629a3d-2a22-4d62-9bc4-e5ffa463b1f5 tempest-KeyPairsV2TestJSON-131669743 tempest-KeyPairsV2TestJSON-131669743-project] Getting quotas for user f8b142126da04af2bf8b32bc289e5954 and project bab5d59e9ede47999dcdf2cbbd6e2427. Resources: {'key_pairs'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:51:42.745233 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-6a629a3d-2a22-4d62-9bc4-e5ffa463b1f5 tempest-KeyPairsV2TestJSON-131669743 tempest-KeyPairsV2TestJSON-131669743-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.133073 Aug 27 02:51:42.754500 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1161/2334] 10.222.0.70 () {60 vars in 1159 bytes} [Sat Aug 27 02:51:42 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:51:42.761229 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b460095a-8470-483a-9ea5-457f3fe6e6f1 tempest-KeyPairsV2TestJSON-131669743 tempest-KeyPairsV2TestJSON-131669743-project] Action: 'create', calling method: .version_select at 0x7f5ee71b38b0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-320513151", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ1WpJAbbP/V1MfRekxroxKwabqQre7zE9ul7aVipg3Q2sMBjOXwyhGvTkWSNEjUbfsKXp1gH+t/oyoq/x8mhtAFcE1fJGUqycxZ95xte3X9NPOrVqo05ltw/SArjRF79w=="}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:51:42.775079 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-af528cab-6a13-4831-b4e5-cefba940ea0a tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:42.776067 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-af528cab-6a13-4831-b4e5-cefba940ea0a tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: a4aca2ed-a835-4f8f-96ae-c3502645425a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:42.787108 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-af528cab-6a13-4831-b4e5-cefba940ea0a tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:42.787735 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-af528cab-6a13-4831-b4e5-cefba940ea0a tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:42.788777 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-af528cab-6a13-4831-b4e5-cefba940ea0a tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:42.789741 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-af528cab-6a13-4831-b4e5-cefba940ea0a tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:42.790307 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-af528cab-6a13-4831-b4e5-cefba940ea0a tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:42.791036 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-af528cab-6a13-4831-b4e5-cefba940ea0a tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:42.792377 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-b460095a-8470-483a-9ea5-457f3fe6e6f1 tempest-KeyPairsV2TestJSON-131669743 tempest-KeyPairsV2TestJSON-131669743-project] Getting quotas for project bab5d59e9ede47999dcdf2cbbd6e2427. Resources: {'key_pairs'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:51:42.811175 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-b460095a-8470-483a-9ea5-457f3fe6e6f1 tempest-KeyPairsV2TestJSON-131669743 tempest-KeyPairsV2TestJSON-131669743-project] Getting quotas for user f8b142126da04af2bf8b32bc289e5954 and project bab5d59e9ede47999dcdf2cbbd6e2427. Resources: {'key_pairs'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:51:42.851227 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b460095a-8470-483a-9ea5-457f3fe6e6f1 tempest-KeyPairsV2TestJSON-131669743 tempest-KeyPairsV2TestJSON-131669743-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.094777 Aug 27 02:51:42.859879 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1174/2335] 10.222.0.70 () {60 vars in 1159 bytes} [Sat Aug 27 02:51:42 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:51:42.866010 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9d0ce3c8-d7b9-4e2e-98a0-32ce81a77bf9 tempest-KeyPairsV2TestJSON-131669743 tempest-KeyPairsV2TestJSON-131669743-project] Action: 'create', calling method: .version_select at 0x7f5ee321a280>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-355824428", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJIfwXh86+YPypvW1kz7/5jQ6Dr4gDw2Fn+0deV1Y3hpExYyswQDL0c3h1UkX4mnEaI4ie1m3tHrOJ8mb5C7tjONuSlonNNKXMGUGUkYyRtnWLEv3j7DJnH8HAKYuoAOLA=="}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:51:42.891046 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-9d0ce3c8-d7b9-4e2e-98a0-32ce81a77bf9 tempest-KeyPairsV2TestJSON-131669743 tempest-KeyPairsV2TestJSON-131669743-project] Getting quotas for project bab5d59e9ede47999dcdf2cbbd6e2427. Resources: {'key_pairs'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:51:42.899549 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-9d0ce3c8-d7b9-4e2e-98a0-32ce81a77bf9 tempest-KeyPairsV2TestJSON-131669743 tempest-KeyPairsV2TestJSON-131669743-project] Getting quotas for user f8b142126da04af2bf8b32bc289e5954 and project bab5d59e9ede47999dcdf2cbbd6e2427. Resources: {'key_pairs'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:51:42.938001 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9d0ce3c8-d7b9-4e2e-98a0-32ce81a77bf9 tempest-KeyPairsV2TestJSON-131669743 tempest-KeyPairsV2TestJSON-131669743-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.076126 Aug 27 02:51:42.938627 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1175/2336] 10.222.0.70 () {60 vars in 1159 bytes} [Sat Aug 27 02:51:42 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:51:42.948802 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-83ab1a40-37ce-4da7-9a1a-5d779c24b507 tempest-KeyPairsV2TestJSON-131669743 tempest-KeyPairsV2TestJSON-131669743-project] Calling method '.version_select at 0x7f5ee30f5af0>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:42.953096 n-d-852278-4 devstack@n-api.service[134052]: WARNING oslo_db.sqlalchemy.utils [None req-83ab1a40-37ce-4da7-9a1a-5d779c24b507 tempest-KeyPairsV2TestJSON-131669743 tempest-KeyPairsV2TestJSON-131669743-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 27 02:51:42.958942 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-83ab1a40-37ce-4da7-9a1a-5d779c24b507 tempest-KeyPairsV2TestJSON-131669743 tempest-KeyPairsV2TestJSON-131669743-project] 10.222.0.70 "GET /compute/v2.1/os-keypairs" status: 200 len: 1091 microversion: 2.1 time: 0.014007 Aug 27 02:51:42.959827 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1176/2337] 10.222.0.70 () {58 vars in 1137 bytes} [Sat Aug 27 02:51:42 2022] GET /compute/v2.1/os-keypairs => generated 1091 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:42.970061 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3383ff47-a2a9-404c-9da2-376f15211173 tempest-KeyPairsV2TestJSON-131669743 tempest-KeyPairsV2TestJSON-131669743-project] Calling method '.version_select at 0x7f5ee2d53940>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:43.008176 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-3383ff47-a2a9-404c-9da2-376f15211173 tempest-KeyPairsV2TestJSON-131669743 tempest-KeyPairsV2TestJSON-131669743-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-355824428" status: 202 len: 0 microversion: 2.1 time: 0.041893 Aug 27 02:51:43.011095 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1177/2338] 10.222.0.70 () {58 vars in 1275 bytes} [Sat Aug 27 02:51:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-355824428 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:51:43.017354 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-95f04d96-d9d1-47a9-894a-3c42d2d8cc06 tempest-KeyPairsV2TestJSON-131669743 tempest-KeyPairsV2TestJSON-131669743-project] Calling method '.version_select at 0x7f5ee2ce8430>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:43.041071 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-af528cab-6a13-4831-b4e5-cefba940ea0a tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:43.054676 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-af528cab-6a13-4831-b4e5-cefba940ea0a tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/a4aca2ed-a835-4f8f-96ae-c3502645425a" status: 200 len: 1536 microversion: 2.1 time: 0.286156 Aug 27 02:51:43.056352 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1162/2339] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:42 2022] GET /compute/v2.1/servers/a4aca2ed-a835-4f8f-96ae-c3502645425a => generated 1536 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:43.065834 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-95f04d96-d9d1-47a9-894a-3c42d2d8cc06 tempest-KeyPairsV2TestJSON-131669743 tempest-KeyPairsV2TestJSON-131669743-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-320513151" status: 202 len: 0 microversion: 2.1 time: 0.052229 Aug 27 02:51:43.066753 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1178/2340] 10.222.0.70 () {58 vars in 1275 bytes} [Sat Aug 27 02:51:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-320513151 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:51:43.069156 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-9521446d-be4b-4457-aecf-6ce230f90b10 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:43.070853 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-9521446d-be4b-4457-aecf-6ce230f90b10 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] [instance: 457da794-89e7-4b30-95ba-802c95550c7e] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:43.075745 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a38505f0-d1da-41e6-a177-44faaa39b7f1 tempest-KeyPairsV2TestJSON-131669743 tempest-KeyPairsV2TestJSON-131669743-project] Calling method '.version_select at 0x7f5ee2ddf4c0>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:43.086427 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9521446d-be4b-4457-aecf-6ce230f90b10 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:43.087520 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9521446d-be4b-4457-aecf-6ce230f90b10 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:43.088616 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9521446d-be4b-4457-aecf-6ce230f90b10 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:43.091501 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9521446d-be4b-4457-aecf-6ce230f90b10 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:43.103134 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9521446d-be4b-4457-aecf-6ce230f90b10 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:43.109105 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9521446d-be4b-4457-aecf-6ce230f90b10 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:43.130605 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a38505f0-d1da-41e6-a177-44faaa39b7f1 tempest-KeyPairsV2TestJSON-131669743 tempest-KeyPairsV2TestJSON-131669743-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-976204332" status: 202 len: 0 microversion: 2.1 time: 0.059750 Aug 27 02:51:43.131796 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1179/2341] 10.222.0.70 () {58 vars in 1275 bytes} [Sat Aug 27 02:51:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-976204332 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 02:51:43.240061 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-9521446d-be4b-4457-aecf-6ce230f90b10 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f496f24dccea47bd9a5ab532fe45e370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40794f05e8b94a0f8f087a87a58e0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:43.273892 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-9521446d-be4b-4457-aecf-6ce230f90b10 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "GET /compute/v2.1/servers/457da794-89e7-4b30-95ba-802c95550c7e" status: 200 len: 1211 microversion: 2.1 time: 0.189789 Aug 27 02:51:43.275907 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1163/2342] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:43 2022] GET /compute/v2.1/servers/457da794-89e7-4b30-95ba-802c95550c7e => generated 1211 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:43.567311 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=5 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:51:43.572252 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-b82dc6f4-300b-41c4-8931-64df63d034a1 req-6907e44a-6c77-4c1c-affc-099adb84d926 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4aca2ed-a835-4f8f-96ae-c3502645425a", "name": "network-vif-unplugged", "status": "completed", "tag": "4f9042c6-628d-483c-88dc-649ec8de9f53"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:51:43.625786 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-b82dc6f4-300b-41c4-8931-64df63d034a1 req-6907e44a-6c77-4c1c-affc-099adb84d926 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:43.630702 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-b82dc6f4-300b-41c4-8931-64df63d034a1 req-6907e44a-6c77-4c1c-affc-099adb84d926 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:43.631496 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-b82dc6f4-300b-41c4-8931-64df63d034a1 req-6907e44a-6c77-4c1c-affc-099adb84d926 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:43.685160 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-b82dc6f4-300b-41c4-8931-64df63d034a1 req-6907e44a-6c77-4c1c-affc-099adb84d926 service nova] Creating event network-vif-unplugged:4f9042c6-628d-483c-88dc-649ec8de9f53 for instance a4aca2ed-a835-4f8f-96ae-c3502645425a on n-h2-852278-4 Aug 27 02:51:43.698890 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-6f53643e-4dbd-4fb7-bdb9-2923a946ce6e tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:43.699653 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-6f53643e-4dbd-4fb7-bdb9-2923a946ce6e tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] [instance: 503900da-e41b-4787-bb1e-9d3df7df05b6] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:43.733084 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6f53643e-4dbd-4fb7-bdb9-2923a946ce6e tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:43.733819 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6f53643e-4dbd-4fb7-bdb9-2923a946ce6e tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:43.735678 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6f53643e-4dbd-4fb7-bdb9-2923a946ce6e tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:43.739534 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [req-b82dc6f4-300b-41c4-8931-64df63d034a1 req-6907e44a-6c77-4c1c-affc-099adb84d926 service nova] Instance a4aca2ed-a835-4f8f-96ae-c3502645425a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-852278-4'} {{(pid=134052) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 02:51:43.741034 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6f53643e-4dbd-4fb7-bdb9-2923a946ce6e tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:43.744692 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6f53643e-4dbd-4fb7-bdb9-2923a946ce6e tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:43.752190 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6f53643e-4dbd-4fb7-bdb9-2923a946ce6e tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:43.775032 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-b82dc6f4-300b-41c4-8931-64df63d034a1 req-6907e44a-6c77-4c1c-affc-099adb84d926 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.208109 Aug 27 02:51:43.780967 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1180/2343] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:51:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:51:44.081009 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-23c40b2d-4194-423e-807e-c78ade0207ab tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:44.081809 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-23c40b2d-4194-423e-807e-c78ade0207ab tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: a4aca2ed-a835-4f8f-96ae-c3502645425a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:44.122298 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-23c40b2d-4194-423e-807e-c78ade0207ab tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:44.126387 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-23c40b2d-4194-423e-807e-c78ade0207ab tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:44.128982 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-23c40b2d-4194-423e-807e-c78ade0207ab tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:44.129878 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-23c40b2d-4194-423e-807e-c78ade0207ab tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:44.130419 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-23c40b2d-4194-423e-807e-c78ade0207ab tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:44.132567 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-23c40b2d-4194-423e-807e-c78ade0207ab tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:44.199580 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-6f53643e-4dbd-4fb7-bdb9-2923a946ce6e tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ece2eb399074418ac5f890d223c1be0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c13c50438234109913876bf5a11d271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:44.210074 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-6f53643e-4dbd-4fb7-bdb9-2923a946ce6e tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] 10.222.0.70 "GET /compute/v2.1/servers/503900da-e41b-4787-bb1e-9d3df7df05b6" status: 200 len: 1396 microversion: 2.1 time: 0.516685 Aug 27 02:51:44.217680 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1164/2344] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:43 2022] GET /compute/v2.1/servers/503900da-e41b-4787-bb1e-9d3df7df05b6 => generated 1396 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:51:44.298621 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e9f18a29-7c52-4184-adf0-37299ddfe558 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:44.299348 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-e9f18a29-7c52-4184-adf0-37299ddfe558 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] [instance: 457da794-89e7-4b30-95ba-802c95550c7e] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:44.309229 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e9f18a29-7c52-4184-adf0-37299ddfe558 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:44.309450 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e9f18a29-7c52-4184-adf0-37299ddfe558 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:44.316174 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e9f18a29-7c52-4184-adf0-37299ddfe558 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:44.319930 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e9f18a29-7c52-4184-adf0-37299ddfe558 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:44.328878 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e9f18a29-7c52-4184-adf0-37299ddfe558 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:44.329798 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e9f18a29-7c52-4184-adf0-37299ddfe558 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:44.540414 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e9f18a29-7c52-4184-adf0-37299ddfe558 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f496f24dccea47bd9a5ab532fe45e370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40794f05e8b94a0f8f087a87a58e0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:44.554720 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e9f18a29-7c52-4184-adf0-37299ddfe558 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "GET /compute/v2.1/servers/457da794-89e7-4b30-95ba-802c95550c7e" status: 200 len: 1259 microversion: 2.1 time: 0.254382 Aug 27 02:51:44.556959 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1165/2345] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:44 2022] GET /compute/v2.1/servers/457da794-89e7-4b30-95ba-802c95550c7e => generated 1259 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:51:44.656365 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-23c40b2d-4194-423e-807e-c78ade0207ab tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:44.680561 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-23c40b2d-4194-423e-807e-c78ade0207ab tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/a4aca2ed-a835-4f8f-96ae-c3502645425a" status: 200 len: 1536 microversion: 2.1 time: 0.603023 Aug 27 02:51:44.688355 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1181/2346] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:44 2022] GET /compute/v2.1/servers/a4aca2ed-a835-4f8f-96ae-c3502645425a => generated 1536 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:44.729897 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e94a8a8d-38d7-4565-8caf-bb0831e6804a tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:44.730635 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-e94a8a8d-38d7-4565-8caf-bb0831e6804a tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:44.754851 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e94a8a8d-38d7-4565-8caf-bb0831e6804a tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:44.756454 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e94a8a8d-38d7-4565-8caf-bb0831e6804a tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:44.759562 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e94a8a8d-38d7-4565-8caf-bb0831e6804a tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:44.761554 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e94a8a8d-38d7-4565-8caf-bb0831e6804a tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:44.764592 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e94a8a8d-38d7-4565-8caf-bb0831e6804a tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:44.765806 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e94a8a8d-38d7-4565-8caf-bb0831e6804a tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:45.120762 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e94a8a8d-38d7-4565-8caf-bb0831e6804a tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:45.132611 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e94a8a8d-38d7-4565-8caf-bb0831e6804a tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1668 microversion: 2.1 time: 0.407238 Aug 27 02:51:45.140708 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1166/2347] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:44 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1668 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:45.150816 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-2a5b7d7a-f756-4a98-ae1e-aa4713372d0b tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:45.152486 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-2a5b7d7a-f756-4a98-ae1e-aa4713372d0b tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: c2c6b214-da6b-48dd-b84c-b111611fc89a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:45.190969 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2a5b7d7a-f756-4a98-ae1e-aa4713372d0b tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:45.191791 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2a5b7d7a-f756-4a98-ae1e-aa4713372d0b tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:45.193899 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2a5b7d7a-f756-4a98-ae1e-aa4713372d0b tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:45.196029 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2a5b7d7a-f756-4a98-ae1e-aa4713372d0b tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:45.198991 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2a5b7d7a-f756-4a98-ae1e-aa4713372d0b tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:45.199866 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2a5b7d7a-f756-4a98-ae1e-aa4713372d0b tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:45.266701 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-2a5b7d7a-f756-4a98-ae1e-aa4713372d0b tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: c2c6b214-da6b-48dd-b84c-b111611fc89a] Going to try to terminate instance {{(pid=134051) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:51:45.271189 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=100 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:51:45.347066 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e8c54d98-2d26-4736-812e-d65e3dcce9e4 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-504985715", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "networks": [{"uuid": "ebe7b2b2-924f-4033-b3f1-0cce3bc68ae5"}]}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:51:45.452711 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-2a5b7d7a-f756-4a98-ae1e-aa4713372d0b tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "DELETE /compute/v2.1/servers/c2c6b214-da6b-48dd-b84c-b111611fc89a" status: 204 len: 0 microversion: 2.1 time: 0.310338 Aug 27 02:51:45.453311 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1167/2348] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:51:45 2022] DELETE /compute/v2.1/servers/c2c6b214-da6b-48dd-b84c-b111611fc89a => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:51:45.469570 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4fcfa31a-4541-49a6-9157-21697751c9df tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:45.470160 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.network.neutron [None req-e8c54d98-2d26-4736-812e-d65e3dcce9e4 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] validate_networks() for [('ebe7b2b2-924f-4033-b3f1-0cce3bc68ae5', None, None, None, None, None)] {{(pid=134052) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:51:45.472640 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-4fcfa31a-4541-49a6-9157-21697751c9df tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:45.489556 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4fcfa31a-4541-49a6-9157-21697751c9df tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:45.490061 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4fcfa31a-4541-49a6-9157-21697751c9df tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:45.490494 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4fcfa31a-4541-49a6-9157-21697751c9df tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:45.492717 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4fcfa31a-4541-49a6-9157-21697751c9df tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:45.495206 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4fcfa31a-4541-49a6-9157-21697751c9df tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:45.495984 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4fcfa31a-4541-49a6-9157-21697751c9df tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:46.464776 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-4fcfa31a-4541-49a6-9157-21697751c9df tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:46.480541 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-4fcfa31a-4541-49a6-9157-21697751c9df tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1668 microversion: 2.1 time: 1.025824 Aug 27 02:51:46.483096 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1168/2349] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:45 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1668 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:46.490346 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c858e66e-60ac-466e-be55-cfa221a33b90 tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:46.491416 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-c858e66e-60ac-466e-be55-cfa221a33b90 tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] [instance: 503900da-e41b-4787-bb1e-9d3df7df05b6] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:46.501825 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c858e66e-60ac-466e-be55-cfa221a33b90 tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:46.503067 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c858e66e-60ac-466e-be55-cfa221a33b90 tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:46.503954 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c858e66e-60ac-466e-be55-cfa221a33b90 tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:46.505148 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c858e66e-60ac-466e-be55-cfa221a33b90 tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:46.505838 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c858e66e-60ac-466e-be55-cfa221a33b90 tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:46.506816 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c858e66e-60ac-466e-be55-cfa221a33b90 tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:46.838915 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-c858e66e-60ac-466e-be55-cfa221a33b90 tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ece2eb399074418ac5f890d223c1be0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c13c50438234109913876bf5a11d271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:46.846788 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c858e66e-60ac-466e-be55-cfa221a33b90 tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] 10.222.0.70 "GET /compute/v2.1/servers/503900da-e41b-4787-bb1e-9d3df7df05b6" status: 200 len: 1396 microversion: 2.1 time: 0.362370 Aug 27 02:51:46.860208 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1169/2350] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:46 2022] GET /compute/v2.1/servers/503900da-e41b-4787-bb1e-9d3df7df05b6 => generated 1396 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:46.866540 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-62648f80-a0d9-4490-824f-31cfae8dec78 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:46.867382 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-62648f80-a0d9-4490-824f-31cfae8dec78 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: c2c6b214-da6b-48dd-b84c-b111611fc89a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:46.874305 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-62648f80-a0d9-4490-824f-31cfae8dec78 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:46.875614 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-62648f80-a0d9-4490-824f-31cfae8dec78 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:46.876234 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-62648f80-a0d9-4490-824f-31cfae8dec78 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:46.877201 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-62648f80-a0d9-4490-824f-31cfae8dec78 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:46.880995 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-62648f80-a0d9-4490-824f-31cfae8dec78 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:46.881645 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-62648f80-a0d9-4490-824f-31cfae8dec78 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:47.202379 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-e8c54d98-2d26-4736-812e-d65e3dcce9e4 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Flavor limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:51:47.202893 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-e8c54d98-2d26-4736-812e-d65e3dcce9e4 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Image limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:51:47.203273 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-e8c54d98-2d26-4736-812e-d65e3dcce9e4 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Flavor pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:51:47.203681 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-e8c54d98-2d26-4736-812e-d65e3dcce9e4 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Image pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:51:47.204091 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-e8c54d98-2d26-4736-812e-d65e3dcce9e4 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:51:47.207327 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-62648f80-a0d9-4490-824f-31cfae8dec78 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:47.215899 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e8c54d98-2d26-4736-812e-d65e3dcce9e4 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:47.216516 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e8c54d98-2d26-4736-812e-d65e3dcce9e4 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:47.217011 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-62648f80-a0d9-4490-824f-31cfae8dec78 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/c2c6b214-da6b-48dd-b84c-b111611fc89a" status: 200 len: 1554 microversion: 2.1 time: 0.355361 Aug 27 02:51:47.217206 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e8c54d98-2d26-4736-812e-d65e3dcce9e4 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:47.218057 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e8c54d98-2d26-4736-812e-d65e3dcce9e4 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:47.219458 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e8c54d98-2d26-4736-812e-d65e3dcce9e4 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:47.220110 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e8c54d98-2d26-4736-812e-d65e3dcce9e4 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:47.223197 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1170/2351] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:46 2022] GET /compute/v2.1/servers/c2c6b214-da6b-48dd-b84c-b111611fc89a => generated 1554 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:47.234143 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ba19f47b-9725-4c2b-aa9e-f34015c94fd4 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:47.234760 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-ba19f47b-9725-4c2b-aa9e-f34015c94fd4 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] [instance: 457da794-89e7-4b30-95ba-802c95550c7e] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:47.242457 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-e8c54d98-2d26-4736-812e-d65e3dcce9e4 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Getting quotas for project c5a8810c21784788b4c0ee64dedbaf15. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:51:47.245151 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=2,nova_api:DELETE=3 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:51:47.250156 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-e8c54d98-2d26-4736-812e-d65e3dcce9e4 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Getting quotas for user d317e74b4bbc4da298a0dcbd78068352 and project c5a8810c21784788b4c0ee64dedbaf15. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:51:47.250927 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ba19f47b-9725-4c2b-aa9e-f34015c94fd4 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:47.251422 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ba19f47b-9725-4c2b-aa9e-f34015c94fd4 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:47.251862 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ba19f47b-9725-4c2b-aa9e-f34015c94fd4 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:47.252649 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ba19f47b-9725-4c2b-aa9e-f34015c94fd4 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:47.253100 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ba19f47b-9725-4c2b-aa9e-f34015c94fd4 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:47.253524 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ba19f47b-9725-4c2b-aa9e-f34015c94fd4 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:47.267696 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-e8c54d98-2d26-4736-812e-d65e3dcce9e4 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Going to run 1 instances... {{(pid=134052) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:51:47.270523 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-e8c54d98-2d26-4736-812e-d65e3dcce9e4 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] [instance: 6ef152e6-ba27-46bd-871a-04d8539b493e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134052) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:51:47.341001 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e8c54d98-2d26-4736-812e-d65e3dcce9e4 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.531904 Aug 27 02:51:47.342441 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1182/2352] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 02:51:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 2534 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:51:47.349003 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e773e17b-dd4e-41da-be97-4ce40829de41 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:47.350062 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-e773e17b-dd4e-41da-be97-4ce40829de41 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: a4aca2ed-a835-4f8f-96ae-c3502645425a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:47.357404 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e773e17b-dd4e-41da-be97-4ce40829de41 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:47.358652 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e773e17b-dd4e-41da-be97-4ce40829de41 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:47.359356 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e773e17b-dd4e-41da-be97-4ce40829de41 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:47.360545 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e773e17b-dd4e-41da-be97-4ce40829de41 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:47.361173 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e773e17b-dd4e-41da-be97-4ce40829de41 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:47.361815 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e773e17b-dd4e-41da-be97-4ce40829de41 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:47.380497 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-ba19f47b-9725-4c2b-aa9e-f34015c94fd4 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f496f24dccea47bd9a5ab532fe45e370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40794f05e8b94a0f8f087a87a58e0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:47.391196 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ba19f47b-9725-4c2b-aa9e-f34015c94fd4 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "GET /compute/v2.1/servers/457da794-89e7-4b30-95ba-802c95550c7e" status: 200 len: 1265 microversion: 2.1 time: 0.166828 Aug 27 02:51:47.393469 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1171/2353] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:47 2022] GET /compute/v2.1/servers/457da794-89e7-4b30-95ba-802c95550c7e => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:47.405349 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e2ec266e-9834-490b-a001-234eaf34e41b tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:47.410274 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-e2ec266e-9834-490b-a001-234eaf34e41b tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:47.420891 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e2ec266e-9834-490b-a001-234eaf34e41b tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:47.423958 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e2ec266e-9834-490b-a001-234eaf34e41b tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:47.424713 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e2ec266e-9834-490b-a001-234eaf34e41b tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:47.425660 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e2ec266e-9834-490b-a001-234eaf34e41b tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:47.428304 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e2ec266e-9834-490b-a001-234eaf34e41b tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:47.428942 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e2ec266e-9834-490b-a001-234eaf34e41b tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:47.752182 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-e773e17b-dd4e-41da-be97-4ce40829de41 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:47.761278 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e773e17b-dd4e-41da-be97-4ce40829de41 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/a4aca2ed-a835-4f8f-96ae-c3502645425a" status: 200 len: 1529 microversion: 2.1 time: 0.417485 Aug 27 02:51:47.776859 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1183/2354] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:47 2022] GET /compute/v2.1/servers/a4aca2ed-a835-4f8f-96ae-c3502645425a => generated 1529 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:47.794700 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e2ec266e-9834-490b-a001-234eaf34e41b tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:47.810093 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e2ec266e-9834-490b-a001-234eaf34e41b tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1668 microversion: 2.1 time: 0.414292 Aug 27 02:51:47.812216 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1172/2355] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:47 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1668 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:47.820725 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-bb09000c-bc15-4c1d-8e76-3739ef4fd6e0 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:47.822500 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-bb09000c-bc15-4c1d-8e76-3739ef4fd6e0 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] [instance: 6ef152e6-ba27-46bd-871a-04d8539b493e] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:47.998956 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-76c7227e-8dc2-4763-9642-b1386ac9828c tempest-KeyPairsV22TestJSON-109444167 tempest-KeyPairsV22TestJSON-109444167-project] Action: 'create', calling method: .version_select at 0x7f5ee30300d0>, body: {"keypair": {"name": "tempest-keypair-579454324", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCfbWM+DChuqR5sFsiQuxbGlZiopdSKnijA3p9ZpyFw9aUYnwSrI04agi3TQczx5yKy5TG0FF4MxJA56tryPM2ZagdLx1W+g9naTKll0cNeTUMnb8Y6THAeYRje1lz32pw=="}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:51:48.025776 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-76c7227e-8dc2-4763-9642-b1386ac9828c tempest-KeyPairsV22TestJSON-109444167 tempest-KeyPairsV22TestJSON-109444167-project] Getting quotas for project 93c01aa673db4139823053661328f1a7. Resources: {'key_pairs'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:51:48.050395 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-76c7227e-8dc2-4763-9642-b1386ac9828c tempest-KeyPairsV22TestJSON-109444167 tempest-KeyPairsV22TestJSON-109444167-project] Getting quotas for user 5f827446808f45af9bbb388ed127346a and project 93c01aa673db4139823053661328f1a7. Resources: {'key_pairs'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:51:48.091540 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-bb09000c-bc15-4c1d-8e76-3739ef4fd6e0 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317e74b4bbc4da298a0dcbd78068352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a8810c21784788b4c0ee64dedbaf15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:48.105842 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-76c7227e-8dc2-4763-9642-b1386ac9828c tempest-KeyPairsV22TestJSON-109444167 tempest-KeyPairsV22TestJSON-109444167-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.327520 Aug 27 02:51:48.106746 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1184/2356] 10.222.0.70 () {62 vars in 1199 bytes} [Sat Aug 27 02:51:47 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 329 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 27 02:51:48.118728 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-7992f81e-a59e-40d2-8b50-a1d7776efcbb req-73cb7ffc-ae88-40aa-b599-454787ad9d23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "503900da-e41b-4787-bb1e-9d3df7df05b6", "name": "network-vif-plugged", "status": "completed", "tag": "d5dfa226-5023-4e6d-a3ae-5b36139b84bc"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:51:48.144613 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-bb09000c-bc15-4c1d-8e76-3739ef4fd6e0 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] 10.222.0.70 "GET /compute/v2.1/servers/6ef152e6-ba27-46bd-871a-04d8539b493e" status: 200 len: 1217 microversion: 2.1 time: 0.326577 Aug 27 02:51:48.146011 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1173/2357] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:47 2022] GET /compute/v2.1/servers/6ef152e6-ba27-46bd-871a-04d8539b493e => generated 1217 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:48.147864 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-7992f81e-a59e-40d2-8b50-a1d7776efcbb req-73cb7ffc-ae88-40aa-b599-454787ad9d23 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:48.148561 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-7992f81e-a59e-40d2-8b50-a1d7776efcbb req-73cb7ffc-ae88-40aa-b599-454787ad9d23 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:48.149153 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-7992f81e-a59e-40d2-8b50-a1d7776efcbb req-73cb7ffc-ae88-40aa-b599-454787ad9d23 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:48.166909 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f1397f94-3de1-46c7-b7d3-9f92e941bf3f tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:48.169121 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-f1397f94-3de1-46c7-b7d3-9f92e941bf3f tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: a4aca2ed-a835-4f8f-96ae-c3502645425a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:48.171666 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-7992f81e-a59e-40d2-8b50-a1d7776efcbb req-73cb7ffc-ae88-40aa-b599-454787ad9d23 service nova] Creating event network-vif-plugged:d5dfa226-5023-4e6d-a3ae-5b36139b84bc for instance 503900da-e41b-4787-bb1e-9d3df7df05b6 on n-h2-852278-4 Aug 27 02:51:48.177654 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-7992f81e-a59e-40d2-8b50-a1d7776efcbb req-73cb7ffc-ae88-40aa-b599-454787ad9d23 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069640 Aug 27 02:51:48.178917 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1185/2358] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:51:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:51:48.185368 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f1397f94-3de1-46c7-b7d3-9f92e941bf3f tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:48.186083 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-dab7cfd8-b263-4bbe-8017-d164334b1671 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-845243707"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:51:48.191187 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f1397f94-3de1-46c7-b7d3-9f92e941bf3f tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:48.194137 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f1397f94-3de1-46c7-b7d3-9f92e941bf3f tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:48.194841 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f1397f94-3de1-46c7-b7d3-9f92e941bf3f tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:48.197789 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f1397f94-3de1-46c7-b7d3-9f92e941bf3f tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:48.199874 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f1397f94-3de1-46c7-b7d3-9f92e941bf3f tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:48.208990 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-dab7cfd8-b263-4bbe-8017-d164334b1671 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:48.229549 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dab7cfd8-b263-4bbe-8017-d164334b1671 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:48.230080 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dab7cfd8-b263-4bbe-8017-d164334b1671 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:48.230528 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dab7cfd8-b263-4bbe-8017-d164334b1671 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:48.231262 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dab7cfd8-b263-4bbe-8017-d164334b1671 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:48.244907 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dab7cfd8-b263-4bbe-8017-d164334b1671 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:48.245394 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dab7cfd8-b263-4bbe-8017-d164334b1671 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:48.706189 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:51:48.739745 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-dab7cfd8-b263-4bbe-8017-d164334b1671 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "POST /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd/action" status: 202 len: 0 microversion: 2.1 time: 0.557992 Aug 27 02:51:48.741465 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1186/2359] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 02:51:48 2022] POST /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd/action => generated 0 bytes in 561 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Aug 27 02:51:48.754917 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3b3245fa-5a92-49c9-b224-08cb3914139f tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:48.758184 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-3b3245fa-5a92-49c9-b224-08cb3914139f tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] [instance: 503900da-e41b-4787-bb1e-9d3df7df05b6] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:48.773600 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3b3245fa-5a92-49c9-b224-08cb3914139f tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:48.774073 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3b3245fa-5a92-49c9-b224-08cb3914139f tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:48.775711 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3b3245fa-5a92-49c9-b224-08cb3914139f tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:48.778142 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3b3245fa-5a92-49c9-b224-08cb3914139f tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:48.779959 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3b3245fa-5a92-49c9-b224-08cb3914139f tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:48.782109 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3b3245fa-5a92-49c9-b224-08cb3914139f tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:49.154371 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-f1397f94-3de1-46c7-b7d3-9f92e941bf3f tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:49.172262 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-f1397f94-3de1-46c7-b7d3-9f92e941bf3f tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/a4aca2ed-a835-4f8f-96ae-c3502645425a" status: 200 len: 1529 microversion: 2.1 time: 1.022781 Aug 27 02:51:49.173151 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1174/2360] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:48 2022] GET /compute/v2.1/servers/a4aca2ed-a835-4f8f-96ae-c3502645425a => generated 1529 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:49.185376 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-3b3245fa-5a92-49c9-b224-08cb3914139f tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ece2eb399074418ac5f890d223c1be0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c13c50438234109913876bf5a11d271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:49.195698 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-67336789-a971-4ee4-8e0d-8caf3d30e43c req-697438b9-96e5-47c1-bd64-73e9b86d6d4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2c6b214-da6b-48dd-b84c-b111611fc89a", "name": "network-vif-deleted", "tag": "b44293e2-5ab8-471e-a1bb-e41d51c8e40a"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:51:49.196647 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-3b3245fa-5a92-49c9-b224-08cb3914139f tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] 10.222.0.70 "GET /compute/v2.1/servers/503900da-e41b-4787-bb1e-9d3df7df05b6" status: 200 len: 1396 microversion: 2.1 time: 0.452449 Aug 27 02:51:49.200651 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1187/2361] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:48 2022] GET /compute/v2.1/servers/503900da-e41b-4787-bb1e-9d3df7df05b6 => generated 1396 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:49.205654 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-cb781a9a-3c5c-4a41-bd4a-36a9724d3dc7 tempest-KeyPairsV22TestJSON-109444167 tempest-KeyPairsV22TestJSON-109444167-project] Calling method '.version_select at 0x7f5ee3401790>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:49.220541 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-67336789-a971-4ee4-8e0d-8caf3d30e43c req-697438b9-96e5-47c1-bd64-73e9b86d6d4b service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:49.222436 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-67336789-a971-4ee4-8e0d-8caf3d30e43c req-697438b9-96e5-47c1-bd64-73e9b86d6d4b service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:49.223962 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-67336789-a971-4ee4-8e0d-8caf3d30e43c req-697438b9-96e5-47c1-bd64-73e9b86d6d4b service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:49.226526 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-cb781a9a-3c5c-4a41-bd4a-36a9724d3dc7 tempest-KeyPairsV22TestJSON-109444167 tempest-KeyPairsV22TestJSON-109444167-project] 10.222.0.70 "GET /compute/v2.1/os-keypairs/tempest-keypair-579454324" status: 200 len: 512 microversion: 2.2 time: 0.024737 Aug 27 02:51:49.239021 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1188/2362] 10.222.0.70 () {60 vars in 1255 bytes} [Sat Aug 27 02:51:49 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-579454324 => generated 512 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:51:49.244256 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-553a3e26-2df6-4ac6-a4c9-c5a05bc05d68 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:49.244911 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-553a3e26-2df6-4ac6-a4c9-c5a05bc05d68 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: c2c6b214-da6b-48dd-b84c-b111611fc89a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:49.249504 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-67336789-a971-4ee4-8e0d-8caf3d30e43c req-697438b9-96e5-47c1-bd64-73e9b86d6d4b service nova] Creating event network-vif-deleted:b44293e2-5ab8-471e-a1bb-e41d51c8e40a for instance c2c6b214-da6b-48dd-b84c-b111611fc89a on n-h1-852278-4 Aug 27 02:51:49.262217 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-67336789-a971-4ee4-8e0d-8caf3d30e43c req-697438b9-96e5-47c1-bd64-73e9b86d6d4b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075652 Aug 27 02:51:49.269099 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1175/2363] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:51:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:51:49.269402 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-553a3e26-2df6-4ac6-a4c9-c5a05bc05d68 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:49.269797 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-553a3e26-2df6-4ac6-a4c9-c5a05bc05d68 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:49.270241 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-553a3e26-2df6-4ac6-a4c9-c5a05bc05d68 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:49.270960 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-553a3e26-2df6-4ac6-a4c9-c5a05bc05d68 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:49.271409 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-553a3e26-2df6-4ac6-a4c9-c5a05bc05d68 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:49.272295 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-553a3e26-2df6-4ac6-a4c9-c5a05bc05d68 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:49.277038 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-60e9e0b4-36c4-43c0-88c5-15e06b7805b4 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:49.278004 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-60e9e0b4-36c4-43c0-88c5-15e06b7805b4 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] [instance: 457da794-89e7-4b30-95ba-802c95550c7e] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:49.284876 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-60e9e0b4-36c4-43c0-88c5-15e06b7805b4 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:49.285619 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-60e9e0b4-36c4-43c0-88c5-15e06b7805b4 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:49.286242 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-60e9e0b4-36c4-43c0-88c5-15e06b7805b4 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:49.287169 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-60e9e0b4-36c4-43c0-88c5-15e06b7805b4 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:49.287807 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-60e9e0b4-36c4-43c0-88c5-15e06b7805b4 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:49.288461 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-60e9e0b4-36c4-43c0-88c5-15e06b7805b4 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:49.406723 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-553a3e26-2df6-4ac6-a4c9-c5a05bc05d68 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:49.417389 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-553a3e26-2df6-4ac6-a4c9-c5a05bc05d68 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/c2c6b214-da6b-48dd-b84c-b111611fc89a" status: 200 len: 1346 microversion: 2.1 time: 0.177043 Aug 27 02:51:49.420245 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1189/2364] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:49 2022] GET /compute/v2.1/servers/c2c6b214-da6b-48dd-b84c-b111611fc89a => generated 1346 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:49.439950 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-283dc360-fcde-4daf-830c-61bd15451953 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:49.442179 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-283dc360-fcde-4daf-830c-61bd15451953 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] [instance: 6ef152e6-ba27-46bd-871a-04d8539b493e] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:49.461400 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-283dc360-fcde-4daf-830c-61bd15451953 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:49.462145 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-283dc360-fcde-4daf-830c-61bd15451953 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:49.463426 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-283dc360-fcde-4daf-830c-61bd15451953 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:49.464674 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-283dc360-fcde-4daf-830c-61bd15451953 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:49.465285 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-283dc360-fcde-4daf-830c-61bd15451953 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:49.466936 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-283dc360-fcde-4daf-830c-61bd15451953 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:49.676169 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-283dc360-fcde-4daf-830c-61bd15451953 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317e74b4bbc4da298a0dcbd78068352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a8810c21784788b4c0ee64dedbaf15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:49.688718 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-283dc360-fcde-4daf-830c-61bd15451953 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] 10.222.0.70 "GET /compute/v2.1/servers/6ef152e6-ba27-46bd-871a-04d8539b493e" status: 200 len: 1269 microversion: 2.1 time: 0.264338 Aug 27 02:51:49.705405 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1190/2365] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:49 2022] GET /compute/v2.1/servers/6ef152e6-ba27-46bd-871a-04d8539b493e => generated 1269 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:49.711406 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e63a562c-8272-4340-a61b-acfea28a5ac1 tempest-MigrationsAdminTest-1330282624 tempest-MigrationsAdminTest-1330282624-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:49.717850 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-60e9e0b4-36c4-43c0-88c5-15e06b7805b4 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f496f24dccea47bd9a5ab532fe45e370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40794f05e8b94a0f8f087a87a58e0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:49.728994 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-60e9e0b4-36c4-43c0-88c5-15e06b7805b4 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "GET /compute/v2.1/servers/457da794-89e7-4b30-95ba-802c95550c7e" status: 200 len: 1307 microversion: 2.1 time: 0.457030 Aug 27 02:51:49.729641 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1176/2366] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:49 2022] GET /compute/v2.1/servers/457da794-89e7-4b30-95ba-802c95550c7e => generated 1307 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:49.741849 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-68c8b93a-7a73-4cbb-834a-bcc186fbb50d tempest-KeyPairsV22TestJSON-109444167 tempest-KeyPairsV22TestJSON-109444167-project] Calling method '.version_select at 0x7f5ede9815e0>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:49.745427 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-e63a562c-8272-4340-a61b-acfea28a5ac1 tempest-MigrationsAdminTest-1330282624 tempest-MigrationsAdminTest-1330282624-project-admin] HTTP exception thrown: Flavor 73af9b1d-3c67-43df-9c7c-648e48a6eacb could not be found. Aug 27 02:51:49.753183 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e63a562c-8272-4340-a61b-acfea28a5ac1 tempest-MigrationsAdminTest-1330282624 tempest-MigrationsAdminTest-1330282624-project-admin] Request method failure captured: Aug 27 02:51:49.753183 n-d-852278-4 devstack@n-api.service[134052]: request: DELETE /compute/v2.1/flavors/73af9b1d-3c67-43df-9c7c-648e48a6eacb HTTP/1.1 Aug 27 02:51:49.753183 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:51:49.753183 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:51:49.753183 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:51:49.753183 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:51:49.753183 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:51:49.753183 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:51:49.753183 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:51:49.753183 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:51:49.753183 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYXXCPik60o_FpNLh1MaypnRNdYsGYMeKohJ9iidN_JVF5M2cQVkhskJp40ItIvNNDWcAIJRM9bNafWqtF6uVOqiPcJDSHcSQ7TuhU4WUJC_QINvlHItKxCxpGBipCrGe7E1gHe4aJz9ODa3lS9yi7Ds1R_ZuiXgAmdGuzz6RsIdvLg Aug 27 02:51:49.753183 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:51:49.753183 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:51:49.753183 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:51:49.753183 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:51:49.753183 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:51:49.753183 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:51:49.753183 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: a06bfee67ab6483d8b12ec11c3c51dde Aug 27 02:51:49.753183 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-MigrationsAdminTest-1330282624 Aug 27 02:51:49.753183 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,admin,member Aug 27 02:51:49.753183 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,admin,member Aug 27 02:51:49.753183 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a06bfee67ab6483d8b12ec11c3c51dde"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_a06bfee67ab6483d8b12ec11c3c51dde", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a06bfee67ab6483d8b12ec11c3c51dde"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/a06bfee67ab6483d8b12ec11c3c51dde"}]}] Aug 27 02:51:49.753183 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-MigrationsAdminTest-1330282624 Aug 27 02:51:49.753183 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: a06bfee67ab6483d8b12ec11c3c51dde Aug 27 02:51:49.753183 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-MigrationsAdminTest-1330282624 Aug 27 02:51:49.753183 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-MigrationsAdminTest-1330282624-project-admin Aug 27 02:51:49.753183 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:51:49.753183 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:51:49.753183 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: aea269bcf7b8490088323b61dcfa2393 Aug 27 02:51:49.753183 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-MigrationsAdminTest-1330282624-project-admin Aug 27 02:51:49.753183 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 02:51:49.753183 n-d-852278-4 devstack@n-api.service[134052]: exception: Flavor 73af9b1d-3c67-43df-9c7c-648e48a6eacb could not be found. Aug 27 02:51:49.753183 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '73af9b1d-3c67-43df-9c7c-648e48a6eacb'} Aug 27 02:51:49.753183 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:51:49.753183 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:51:49.753183 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Aug 27 02:51:49.753183 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi flavor.destroy() Aug 27 02:51:49.753183 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 27 02:51:49.753183 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 27 02:51:49.753183 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Aug 27 02:51:49.753183 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Aug 27 02:51:49.753183 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Aug 27 02:51:49.753183 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Aug 27 02:51:49.753183 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 02:51:49.753183 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 02:51:49.753183 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Aug 27 02:51:49.753183 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Aug 27 02:51:49.753183 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 73af9b1d-3c67-43df-9c7c-648e48a6eacb could not be found. Aug 27 02:51:49.753183 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:51:49.753183 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:51:49.753183 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:51:49.753183 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:51:49.753183 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:51:49.753183 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:51:49.753183 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:51:49.753183 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:51:49.753183 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:51:49.753183 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:51:49.753183 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Aug 27 02:51:49.753183 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:51:49.753183 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 73af9b1d-3c67-43df-9c7c-648e48a6eacb could not be found. Aug 27 02:51:49.753183 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:51:49.753183 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:51:49.757869 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:51:49.757869 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:51:49.757869 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:51:49.757869 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:51:49.757869 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:51:49.757869 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:51:49.757869 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 73af9b1d-3c67-43df-9c7c-648e48a6eacb could not be found. Aug 27 02:51:49.757869 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:51:49.757869 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e63a562c-8272-4340-a61b-acfea28a5ac1 tempest-MigrationsAdminTest-1330282624 tempest-MigrationsAdminTest-1330282624-project-admin] Returning 404 to user: Flavor 73af9b1d-3c67-43df-9c7c-648e48a6eacb could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:51:49.757869 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e63a562c-8272-4340-a61b-acfea28a5ac1 tempest-MigrationsAdminTest-1330282624 tempest-MigrationsAdminTest-1330282624-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/73af9b1d-3c67-43df-9c7c-648e48a6eacb" status: 404 len: 109 microversion: 2.1 time: 0.047893 Aug 27 02:51:49.757869 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1191/2367] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:51:49 2022] DELETE /compute/v2.1/flavors/73af9b1d-3c67-43df-9c7c-648e48a6eacb => generated 109 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:51:49.785716 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:51:49.818441 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-68c8b93a-7a73-4cbb-834a-bcc186fbb50d tempest-KeyPairsV22TestJSON-109444167 tempest-KeyPairsV22TestJSON-109444167-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-579454324" status: 204 len: 0 microversion: 2.2 time: 0.085516 Aug 27 02:51:49.820539 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1177/2368] 10.222.0.70 () {60 vars in 1258 bytes} [Sat Aug 27 02:51:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-579454324 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:51:49.833748 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-08601a62-6c4d-4964-93d9-ef3a681b0734 tempest-KeyPairsV22TestJSON-109444167 tempest-KeyPairsV22TestJSON-109444167-project] Action: 'create', calling method: .version_select at 0x7f5ee3809430>, body: {"keypair": {"name": "tempest-keypair-702029779", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNBAcwDPZ8dc3iXRqK7BxVtKwAMlDV0cFq6EEBTOF+44IXufhR2UF7qApWjF9Ml55EmL9vmZWgguSyZXHz6wBR1HCpFX7LNcMCIe3wEsQW8N48945oApjPgHziUcn+Qlqg=="}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:51:49.865140 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-08601a62-6c4d-4964-93d9-ef3a681b0734 tempest-KeyPairsV22TestJSON-109444167 tempest-KeyPairsV22TestJSON-109444167-project] Getting quotas for project 93c01aa673db4139823053661328f1a7. Resources: {'key_pairs'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:51:49.876101 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-08601a62-6c4d-4964-93d9-ef3a681b0734 tempest-KeyPairsV22TestJSON-109444167 tempest-KeyPairsV22TestJSON-109444167-project] Getting quotas for user 5f827446808f45af9bbb388ed127346a and project 93c01aa673db4139823053661328f1a7. Resources: {'key_pairs'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:51:49.933230 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-08601a62-6c4d-4964-93d9-ef3a681b0734 tempest-KeyPairsV22TestJSON-109444167 tempest-KeyPairsV22TestJSON-109444167-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.103902 Aug 27 02:51:49.935354 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1192/2369] 10.222.0.70 () {62 vars in 1199 bytes} [Sat Aug 27 02:51:49 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 108 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 27 02:51:49.946685 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e25f2a90-1e1a-466e-b503-ff6b1b84b473 tempest-KeyPairsV22TestJSON-109444167 tempest-KeyPairsV22TestJSON-109444167-project] Calling method '.version_select at 0x7f5edf445c10>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:49.984821 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e25f2a90-1e1a-466e-b503-ff6b1b84b473 tempest-KeyPairsV22TestJSON-109444167 tempest-KeyPairsV22TestJSON-109444167-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-702029779" status: 204 len: 0 microversion: 2.2 time: 0.042917 Aug 27 02:51:49.986161 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1178/2370] 10.222.0.70 () {60 vars in 1258 bytes} [Sat Aug 27 02:51:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-702029779 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:51:50.001112 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-fa9763a4-6f42-4cb6-9af3-d51ba2bc2d59 tempest-KeyPairsV22TestJSON-109444167 tempest-KeyPairsV22TestJSON-109444167-project] Action: 'create', calling method: .version_select at 0x7f5ee719b280>, body: {"keypair": {"name": "tempest-keypair-648075344", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:51:50.004789 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f478f03c-4b0c-4431-829f-0a8b2397a3d3 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-593058965", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:51:50.037401 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-fa9763a4-6f42-4cb6-9af3-d51ba2bc2d59 tempest-KeyPairsV22TestJSON-109444167 tempest-KeyPairsV22TestJSON-109444167-project] Getting quotas for project 93c01aa673db4139823053661328f1a7. Resources: {'key_pairs'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:51:50.062360 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-fa9763a4-6f42-4cb6-9af3-d51ba2bc2d59 tempest-KeyPairsV22TestJSON-109444167 tempest-KeyPairsV22TestJSON-109444167-project] Getting quotas for user 5f827446808f45af9bbb388ed127346a and project 93c01aa673db4139823053661328f1a7. Resources: {'key_pairs'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:51:50.120973 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.network.neutron [None req-f478f03c-4b0c-4431-829f-0a8b2397a3d3 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] validate_networks() for None {{(pid=134051) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:51:50.153119 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-fa9763a4-6f42-4cb6-9af3-d51ba2bc2d59 tempest-KeyPairsV22TestJSON-109444167 tempest-KeyPairsV22TestJSON-109444167-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 201 len: 588 microversion: 2.2 time: 0.161500 Aug 27 02:51:50.157010 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1193/2371] 10.222.0.70 () {62 vars in 1199 bytes} [Sat Aug 27 02:51:49 2022] POST /compute/v2.1/os-keypairs => generated 588 bytes in 166 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 27 02:51:50.189494 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-20297574-b84d-4165-9ae4-b72624a2b8b8 req-e0fccd57-4a8a-43d1-ba4c-6084b21f1e34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "457da794-89e7-4b30-95ba-802c95550c7e", "tag": "27be2c6c-8615-4a7c-96a7-71c5111896a7"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:51:50.249206 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-20297574-b84d-4165-9ae4-b72624a2b8b8 req-e0fccd57-4a8a-43d1-ba4c-6084b21f1e34 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:50.249794 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-20297574-b84d-4165-9ae4-b72624a2b8b8 req-e0fccd57-4a8a-43d1-ba4c-6084b21f1e34 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:50.256856 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-20297574-b84d-4165-9ae4-b72624a2b8b8 req-e0fccd57-4a8a-43d1-ba4c-6084b21f1e34 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:50.298062 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-20297574-b84d-4165-9ae4-b72624a2b8b8 req-e0fccd57-4a8a-43d1-ba4c-6084b21f1e34 service nova] Creating event network-changed:27be2c6c-8615-4a7c-96a7-71c5111896a7 for instance 457da794-89e7-4b30-95ba-802c95550c7e on n-h2-852278-4 Aug 27 02:51:50.332682 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-20297574-b84d-4165-9ae4-b72624a2b8b8 req-e0fccd57-4a8a-43d1-ba4c-6084b21f1e34 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.162139 Aug 27 02:51:50.342921 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1194/2372] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:51:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:51:50.378544 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-12210fe6-87e5-423d-a001-6aabdf402adc tempest-KeyPairsV22TestJSON-109444167 tempest-KeyPairsV22TestJSON-109444167-project] Calling method '.version_select at 0x7f5ee2d530d0>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:50.439410 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-12210fe6-87e5-423d-a001-6aabdf402adc tempest-KeyPairsV22TestJSON-109444167 tempest-KeyPairsV22TestJSON-109444167-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-648075344" status: 204 len: 0 microversion: 2.2 time: 0.081969 Aug 27 02:51:50.440271 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1195/2373] 10.222.0.70 () {60 vars in 1258 bytes} [Sat Aug 27 02:51:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-648075344 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:51:50.459497 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-fe69660e-85ea-4989-ba76-b6d2194b1d1a tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:50.460652 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-fe69660e-85ea-4989-ba76-b6d2194b1d1a tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] [instance: 503900da-e41b-4787-bb1e-9d3df7df05b6] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:50.470780 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fe69660e-85ea-4989-ba76-b6d2194b1d1a tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:50.471671 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fe69660e-85ea-4989-ba76-b6d2194b1d1a tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:50.474118 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fe69660e-85ea-4989-ba76-b6d2194b1d1a tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:50.475109 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fe69660e-85ea-4989-ba76-b6d2194b1d1a tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:50.477632 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fe69660e-85ea-4989-ba76-b6d2194b1d1a tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:50.479114 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fe69660e-85ea-4989-ba76-b6d2194b1d1a tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:51.005143 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-fe69660e-85ea-4989-ba76-b6d2194b1d1a tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ece2eb399074418ac5f890d223c1be0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c13c50438234109913876bf5a11d271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:51.015711 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-fe69660e-85ea-4989-ba76-b6d2194b1d1a tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] 10.222.0.70 "GET /compute/v2.1/servers/503900da-e41b-4787-bb1e-9d3df7df05b6" status: 200 len: 1577 microversion: 2.1 time: 0.570536 Aug 27 02:51:51.016303 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1196/2374] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:50 2022] GET /compute/v2.1/servers/503900da-e41b-4787-bb1e-9d3df7df05b6 => generated 1577 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:51.049665 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-390a9b2f-e65e-4656-ba46-f8b6d512ab6b tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:51.050307 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-390a9b2f-e65e-4656-ba46-f8b6d512ab6b tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: c2c6b214-da6b-48dd-b84c-b111611fc89a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:51.074431 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-390a9b2f-e65e-4656-ba46-f8b6d512ab6b tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:51.074961 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-390a9b2f-e65e-4656-ba46-f8b6d512ab6b tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:51.075453 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-390a9b2f-e65e-4656-ba46-f8b6d512ab6b tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:51.076198 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-390a9b2f-e65e-4656-ba46-f8b6d512ab6b tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:51.076675 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-390a9b2f-e65e-4656-ba46-f8b6d512ab6b tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:51.077097 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-390a9b2f-e65e-4656-ba46-f8b6d512ab6b tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:51.085355 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:51:51.209452 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-390a9b2f-e65e-4656-ba46-f8b6d512ab6b tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:51.221922 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-390a9b2f-e65e-4656-ba46-f8b6d512ab6b tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/c2c6b214-da6b-48dd-b84c-b111611fc89a" status: 200 len: 1346 microversion: 2.1 time: 0.186388 Aug 27 02:51:51.229242 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1197/2375] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:51 2022] GET /compute/v2.1/servers/c2c6b214-da6b-48dd-b84c-b111611fc89a => generated 1346 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:51.248299 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-358efb10-b399-45bc-bfc6-025c4f08228f tempest-KeyPairsV22TestJSON-109444167 tempest-KeyPairsV22TestJSON-109444167-project] Action: 'create', calling method: .version_select at 0x7f5ee719b280>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1338548532", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLqmOmWBSmdn1BjlGWl0VyZpht+6LJlG5YqVi/mQxV2WID/UM3Xcdh1VW7UWUkGS8vBGTuCXvokNjGITrBKGEquad0XiXRkCvDIF6Jf9eCLNye/eNUXHcD6/Y6mO7Rz6Ag=="}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:51:51.289599 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-358efb10-b399-45bc-bfc6-025c4f08228f tempest-KeyPairsV22TestJSON-109444167 tempest-KeyPairsV22TestJSON-109444167-project] Getting quotas for project 93c01aa673db4139823053661328f1a7. Resources: {'key_pairs'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:51:51.297627 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-358efb10-b399-45bc-bfc6-025c4f08228f tempest-KeyPairsV22TestJSON-109444167 tempest-KeyPairsV22TestJSON-109444167-project] Getting quotas for user 5f827446808f45af9bbb388ed127346a and project 93c01aa673db4139823053661328f1a7. Resources: {'key_pairs'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:51:51.349630 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-358efb10-b399-45bc-bfc6-025c4f08228f tempest-KeyPairsV22TestJSON-109444167 tempest-KeyPairsV22TestJSON-109444167-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.119053 Aug 27 02:51:51.350421 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1198/2376] 10.222.0.70 () {62 vars in 1199 bytes} [Sat Aug 27 02:51:51 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 120 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 27 02:51:51.363116 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-d39431d5-b97b-4fcd-8b45-39344aec5e7f req-69bfed55-107d-4a2a-b06e-5fc2be4712b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4aca2ed-a835-4f8f-96ae-c3502645425a", "name": "network-vif-plugged", "status": "completed", "tag": "4f9042c6-628d-483c-88dc-649ec8de9f53"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:51:51.390999 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-d39431d5-b97b-4fcd-8b45-39344aec5e7f req-69bfed55-107d-4a2a-b06e-5fc2be4712b7 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:51.392907 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-d39431d5-b97b-4fcd-8b45-39344aec5e7f req-69bfed55-107d-4a2a-b06e-5fc2be4712b7 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:51.393747 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-d39431d5-b97b-4fcd-8b45-39344aec5e7f req-69bfed55-107d-4a2a-b06e-5fc2be4712b7 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:51.419207 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-d39431d5-b97b-4fcd-8b45-39344aec5e7f req-69bfed55-107d-4a2a-b06e-5fc2be4712b7 service nova] Creating event network-vif-plugged:4f9042c6-628d-483c-88dc-649ec8de9f53 for instance a4aca2ed-a835-4f8f-96ae-c3502645425a on n-h2-852278-4 Aug 27 02:51:51.425467 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-d39431d5-b97b-4fcd-8b45-39344aec5e7f req-69bfed55-107d-4a2a-b06e-5fc2be4712b7 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073313 Aug 27 02:51:51.426679 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1199/2377] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:51:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:51:51.434028 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-2c1d8c82-2287-48fd-bdfe-8bc73548ddba tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:51.434952 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-2c1d8c82-2287-48fd-bdfe-8bc73548ddba tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] [instance: 6ef152e6-ba27-46bd-871a-04d8539b493e] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:51.442818 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2c1d8c82-2287-48fd-bdfe-8bc73548ddba tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:51.443524 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2c1d8c82-2287-48fd-bdfe-8bc73548ddba tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:51.444138 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2c1d8c82-2287-48fd-bdfe-8bc73548ddba tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:51.445329 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2c1d8c82-2287-48fd-bdfe-8bc73548ddba tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:51.445936 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2c1d8c82-2287-48fd-bdfe-8bc73548ddba tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:51.446501 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2c1d8c82-2287-48fd-bdfe-8bc73548ddba tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:51.490543 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-f478f03c-4b0c-4431-829f-0a8b2397a3d3 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Flavor limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:51:51.491121 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-f478f03c-4b0c-4431-829f-0a8b2397a3d3 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Image limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:51:51.491735 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-f478f03c-4b0c-4431-829f-0a8b2397a3d3 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Flavor pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:51:51.492238 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-f478f03c-4b0c-4431-829f-0a8b2397a3d3 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Image pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:51:51.492982 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-f478f03c-4b0c-4431-829f-0a8b2397a3d3 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:51:51.524665 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=59 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:51:51.536892 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-2c1d8c82-2287-48fd-bdfe-8bc73548ddba tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317e74b4bbc4da298a0dcbd78068352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a8810c21784788b4c0ee64dedbaf15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:51.538086 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f478f03c-4b0c-4431-829f-0a8b2397a3d3 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:51.539620 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f478f03c-4b0c-4431-829f-0a8b2397a3d3 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:51.541430 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f478f03c-4b0c-4431-829f-0a8b2397a3d3 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:51.543441 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f478f03c-4b0c-4431-829f-0a8b2397a3d3 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:51.544136 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f478f03c-4b0c-4431-829f-0a8b2397a3d3 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:51.547296 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f478f03c-4b0c-4431-829f-0a8b2397a3d3 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:51.555561 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-2c1d8c82-2287-48fd-bdfe-8bc73548ddba tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] 10.222.0.70 "GET /compute/v2.1/servers/6ef152e6-ba27-46bd-871a-04d8539b493e" status: 200 len: 1275 microversion: 2.1 time: 0.126461 Aug 27 02:51:51.556863 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1200/2378] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:51 2022] GET /compute/v2.1/servers/6ef152e6-ba27-46bd-871a-04d8539b493e => generated 1275 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:51.578551 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b821abc3-e352-4c99-90a0-38b6bae06ab0 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:51.579474 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b821abc3-e352-4c99-90a0-38b6bae06ab0 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] [instance: 457da794-89e7-4b30-95ba-802c95550c7e] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:51.589498 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b821abc3-e352-4c99-90a0-38b6bae06ab0 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:51.589988 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b821abc3-e352-4c99-90a0-38b6bae06ab0 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:51.590604 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b821abc3-e352-4c99-90a0-38b6bae06ab0 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:51.591587 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b821abc3-e352-4c99-90a0-38b6bae06ab0 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:51.592489 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b821abc3-e352-4c99-90a0-38b6bae06ab0 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:51.593083 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b821abc3-e352-4c99-90a0-38b6bae06ab0 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:51.605005 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-f478f03c-4b0c-4431-829f-0a8b2397a3d3 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Getting quotas for project 937a5eeccaa7425ca72c8c74fb99f11a. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:51:51.630403 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-f478f03c-4b0c-4431-829f-0a8b2397a3d3 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Getting quotas for user 0b310e73ecd244d2938812d5be99558c and project 937a5eeccaa7425ca72c8c74fb99f11a. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:51:51.674326 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-f478f03c-4b0c-4431-829f-0a8b2397a3d3 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Going to run 1 instances... {{(pid=134051) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:51:51.679040 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-f478f03c-4b0c-4431-829f-0a8b2397a3d3 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: ba987aee-2707-4d47-aba9-d2803aa70745] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134051) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:51:51.797291 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-f478f03c-4b0c-4431-829f-0a8b2397a3d3 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.796898 Aug 27 02:51:51.800862 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1179/2379] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 02:51:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1802 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:51:51.812388 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b398f716-3486-4503-a252-7219eda058dd tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:51.820328 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b398f716-3486-4503-a252-7219eda058dd tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] [instance: 503900da-e41b-4787-bb1e-9d3df7df05b6] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:51.841314 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b398f716-3486-4503-a252-7219eda058dd tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:51.850575 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b398f716-3486-4503-a252-7219eda058dd tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:51.851355 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b398f716-3486-4503-a252-7219eda058dd tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:51.852940 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b398f716-3486-4503-a252-7219eda058dd tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:51.853815 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b398f716-3486-4503-a252-7219eda058dd tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:51.854463 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b398f716-3486-4503-a252-7219eda058dd tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:52.290283 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b398f716-3486-4503-a252-7219eda058dd tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] 10.222.0.70 "GET /compute/v2.1/servers/503900da-e41b-4787-bb1e-9d3df7df05b6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.483136 Aug 27 02:51:52.291581 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1180/2380] 10.222.0.70 () {58 vars in 1275 bytes} [Sat Aug 27 02:51:51 2022] GET /compute/v2.1/servers/503900da-e41b-4787-bb1e-9d3df7df05b6/os-interface => generated 284 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:51:52.302453 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-37f5df46-2ab3-4b08-bc3a-913bee4402d6 tempest-KeyPairsV22TestJSON-109444167 tempest-KeyPairsV22TestJSON-109444167-project] Action: 'create', calling method: .version_select at 0x7f5ede8d93a0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1563711095", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAhSGaocsAKQOvN6d+mvfXys7et4CjNdvpAEOJcU9E5n8HPVFdZfi1UxHJcFXZUs7AYVcEjVbrnrq8cIXZ7ipihAerFvlfpJ5kA3FsIOdbmCfiPLGUqt+Uf/R3oRiZxHNw=="}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:51:52.338418 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-37f5df46-2ab3-4b08-bc3a-913bee4402d6 tempest-KeyPairsV22TestJSON-109444167 tempest-KeyPairsV22TestJSON-109444167-project] Getting quotas for project 93c01aa673db4139823053661328f1a7. Resources: {'key_pairs'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:51:52.356969 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b821abc3-e352-4c99-90a0-38b6bae06ab0 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f496f24dccea47bd9a5ab532fe45e370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40794f05e8b94a0f8f087a87a58e0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:52.360532 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-37f5df46-2ab3-4b08-bc3a-913bee4402d6 tempest-KeyPairsV22TestJSON-109444167 tempest-KeyPairsV22TestJSON-109444167-project] Getting quotas for user 5f827446808f45af9bbb388ed127346a and project 93c01aa673db4139823053661328f1a7. Resources: {'key_pairs'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:51:52.372745 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b821abc3-e352-4c99-90a0-38b6bae06ab0 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "GET /compute/v2.1/servers/457da794-89e7-4b30-95ba-802c95550c7e" status: 200 len: 1307 microversion: 2.1 time: 0.805518 Aug 27 02:51:52.374751 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1201/2381] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:51 2022] GET /compute/v2.1/servers/457da794-89e7-4b30-95ba-802c95550c7e => generated 1307 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:52.432681 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-37f5df46-2ab3-4b08-bc3a-913bee4402d6 tempest-KeyPairsV22TestJSON-109444167 tempest-KeyPairsV22TestJSON-109444167-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.139090 Aug 27 02:51:52.433729 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1181/2382] 10.222.0.70 () {62 vars in 1199 bytes} [Sat Aug 27 02:51:52 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 141 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 27 02:51:52.442668 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4d78c6b1-9027-4707-89cf-89faa35e9d6e tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:52.442668 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-4d78c6b1-9027-4707-89cf-89faa35e9d6e tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: ba987aee-2707-4d47-aba9-d2803aa70745] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:52.483242 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ef0482a0-6866-49df-9dff-01559ce9efba tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:52.486514 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-ef0482a0-6866-49df-9dff-01559ce9efba tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: c2c6b214-da6b-48dd-b84c-b111611fc89a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:52.496669 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ef0482a0-6866-49df-9dff-01559ce9efba tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:52.497991 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ef0482a0-6866-49df-9dff-01559ce9efba tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:52.499385 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ef0482a0-6866-49df-9dff-01559ce9efba tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:52.500436 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ef0482a0-6866-49df-9dff-01559ce9efba tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:52.501252 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ef0482a0-6866-49df-9dff-01559ce9efba tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:52.502048 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ef0482a0-6866-49df-9dff-01559ce9efba tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:52.666536 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-ef0482a0-6866-49df-9dff-01559ce9efba tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:52.684031 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ef0482a0-6866-49df-9dff-01559ce9efba tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/c2c6b214-da6b-48dd-b84c-b111611fc89a" status: 200 len: 1346 microversion: 2.1 time: 0.208239 Aug 27 02:51:52.685112 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1182/2383] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:52 2022] GET /compute/v2.1/servers/c2c6b214-da6b-48dd-b84c-b111611fc89a => generated 1346 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:52.696053 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a0cfd6d9-fc12-4ca3-b9af-07a58fa711a4 tempest-KeyPairsV22TestJSON-109444167 tempest-KeyPairsV22TestJSON-109444167-project] Action: 'create', calling method: .version_select at 0x7f5ede996ee0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1162299760", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKH+w8RyxabwgrrzkOGnzbD8qZ+ZpGBXZXWWQrsNYyJV57GWzj+jriPtuZL/BbqB0e8M7cymk6R+WWgIqeVl7myLJLgpTidx79G9wWskGMdkDYVnAFWqTh8U1VFDXEBp9g=="}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:51:52.725501 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-4d78c6b1-9027-4707-89cf-89faa35e9d6e tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:52.734550 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-4d78c6b1-9027-4707-89cf-89faa35e9d6e tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/ba987aee-2707-4d47-aba9-d2803aa70745" status: 200 len: 1212 microversion: 2.1 time: 0.346781 Aug 27 02:51:52.736901 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1202/2384] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:52 2022] GET /compute/v2.1/servers/ba987aee-2707-4d47-aba9-d2803aa70745 => generated 1212 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:52.746512 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-a0cfd6d9-fc12-4ca3-b9af-07a58fa711a4 tempest-KeyPairsV22TestJSON-109444167 tempest-KeyPairsV22TestJSON-109444167-project] Getting quotas for project 93c01aa673db4139823053661328f1a7. Resources: {'key_pairs'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:51:52.749901 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-58bd5978-d6e5-44c5-8f58-d7102dafd96b tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:52.753268 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-58bd5978-d6e5-44c5-8f58-d7102dafd96b tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] [instance: 6ef152e6-ba27-46bd-871a-04d8539b493e] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:52.772205 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-a0cfd6d9-fc12-4ca3-b9af-07a58fa711a4 tempest-KeyPairsV22TestJSON-109444167 tempest-KeyPairsV22TestJSON-109444167-project] Getting quotas for user 5f827446808f45af9bbb388ed127346a and project 93c01aa673db4139823053661328f1a7. Resources: {'key_pairs'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:51:52.772715 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-58bd5978-d6e5-44c5-8f58-d7102dafd96b tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:52.773554 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-58bd5978-d6e5-44c5-8f58-d7102dafd96b tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:52.774268 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-58bd5978-d6e5-44c5-8f58-d7102dafd96b tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:52.775405 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-58bd5978-d6e5-44c5-8f58-d7102dafd96b tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:52.776070 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-58bd5978-d6e5-44c5-8f58-d7102dafd96b tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:52.777050 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-58bd5978-d6e5-44c5-8f58-d7102dafd96b tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:52.853744 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a0cfd6d9-fc12-4ca3-b9af-07a58fa711a4 tempest-KeyPairsV22TestJSON-109444167 tempest-KeyPairsV22TestJSON-109444167-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.167524 Aug 27 02:51:52.854364 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1183/2385] 10.222.0.70 () {62 vars in 1199 bytes} [Sat Aug 27 02:51:52 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 169 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 27 02:51:52.873167 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-01cf46c1-7cd7-474a-a1f5-fc20302a401a tempest-KeyPairsV22TestJSON-109444167 tempest-KeyPairsV22TestJSON-109444167-project] Calling method '.version_select at 0x7f5edf237a60>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:52.888997 n-d-852278-4 devstack@n-api.service[134051]: WARNING oslo_db.sqlalchemy.utils [None req-01cf46c1-7cd7-474a-a1f5-fc20302a401a tempest-KeyPairsV22TestJSON-109444167 tempest-KeyPairsV22TestJSON-109444167-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 27 02:51:52.942718 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-01cf46c1-7cd7-474a-a1f5-fc20302a401a tempest-KeyPairsV22TestJSON-109444167 tempest-KeyPairsV22TestJSON-109444167-project] 10.222.0.70 "GET /compute/v2.1/os-keypairs" status: 200 len: 1142 microversion: 2.2 time: 0.081591 Aug 27 02:51:52.947502 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1184/2386] 10.222.0.70 () {60 vars in 1177 bytes} [Sat Aug 27 02:51:52 2022] GET /compute/v2.1/os-keypairs => generated 1142 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:52.960754 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-04291167-8b17-4cd3-b0ee-db520551b0d1 tempest-KeyPairsV22TestJSON-109444167 tempest-KeyPairsV22TestJSON-109444167-project] Calling method '.version_select at 0x7f5edef51670>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:53.038732 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-04291167-8b17-4cd3-b0ee-db520551b0d1 tempest-KeyPairsV22TestJSON-109444167 tempest-KeyPairsV22TestJSON-109444167-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1162299760" status: 204 len: 0 microversion: 2.2 time: 0.083971 Aug 27 02:51:53.042663 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1185/2387] 10.222.0.70 () {60 vars in 1321 bytes} [Sat Aug 27 02:51:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1162299760 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:51:53.051149 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-2937e73e-80e2-4595-94de-7833076d9ef8 tempest-KeyPairsV22TestJSON-109444167 tempest-KeyPairsV22TestJSON-109444167-project] Calling method '.version_select at 0x7f5edf237940>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:53.131372 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-2937e73e-80e2-4595-94de-7833076d9ef8 tempest-KeyPairsV22TestJSON-109444167 tempest-KeyPairsV22TestJSON-109444167-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1563711095" status: 204 len: 0 microversion: 2.2 time: 0.083990 Aug 27 02:51:53.134655 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1186/2388] 10.222.0.70 () {60 vars in 1321 bytes} [Sat Aug 27 02:51:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1563711095 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:51:53.168530 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-805a66d3-32c4-43ae-9794-9bbeb99ad6ca tempest-KeyPairsV22TestJSON-109444167 tempest-KeyPairsV22TestJSON-109444167-project] Calling method '.version_select at 0x7f5edf458430>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:53.175265 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-58bd5978-d6e5-44c5-8f58-d7102dafd96b tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317e74b4bbc4da298a0dcbd78068352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a8810c21784788b4c0ee64dedbaf15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:53.187539 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-58bd5978-d6e5-44c5-8f58-d7102dafd96b tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] 10.222.0.70 "GET /compute/v2.1/servers/6ef152e6-ba27-46bd-871a-04d8539b493e" status: 200 len: 1317 microversion: 2.1 time: 0.447309 Aug 27 02:51:53.188770 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1203/2389] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:52 2022] GET /compute/v2.1/servers/6ef152e6-ba27-46bd-871a-04d8539b493e => generated 1317 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:53.212874 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-805a66d3-32c4-43ae-9794-9bbeb99ad6ca tempest-KeyPairsV22TestJSON-109444167 tempest-KeyPairsV22TestJSON-109444167-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1338548532" status: 204 len: 0 microversion: 2.2 time: 0.071964 Aug 27 02:51:53.213676 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1187/2390] 10.222.0.70 () {60 vars in 1321 bytes} [Sat Aug 27 02:51:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1338548532 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:51:53.230677 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-72abda1e-d893-4cdf-8650-a5bb5e9946b3 tempest-KeyPairsV22TestJSON-109444167 tempest-KeyPairsV22TestJSON-109444167-project] Action: 'create', calling method: .version_select at 0x7f5ee3518160>, body: {"keypair": {"name": "tempest-keypair-2080371358", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHATe0IA5ce0m4cSBmOXGdmzPMNRLbhmto2Sti+XVp5e/4dICYS4rFso1Eh42PGUZyIVgilYyeSwEMycDtzyp2Zm+xLi7LPKpkTecrTDxni/JD9jc7xl0pjpGh1Od8/3ZQ=="}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:51:53.274021 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-72abda1e-d893-4cdf-8650-a5bb5e9946b3 tempest-KeyPairsV22TestJSON-109444167 tempest-KeyPairsV22TestJSON-109444167-project] Getting quotas for project 93c01aa673db4139823053661328f1a7. Resources: {'key_pairs'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:51:53.281545 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:DELETE=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:51:53.304783 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-72abda1e-d893-4cdf-8650-a5bb5e9946b3 tempest-KeyPairsV22TestJSON-109444167 tempest-KeyPairsV22TestJSON-109444167-project] Getting quotas for user 5f827446808f45af9bbb388ed127346a and project 93c01aa673db4139823053661328f1a7. Resources: {'key_pairs'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:51:53.384298 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-72abda1e-d893-4cdf-8650-a5bb5e9946b3 tempest-KeyPairsV22TestJSON-109444167 tempest-KeyPairsV22TestJSON-109444167-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.157848 Aug 27 02:51:53.390710 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1204/2391] 10.222.0.70 () {62 vars in 1199 bytes} [Sat Aug 27 02:51:53 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 161 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 27 02:51:53.396342 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-dc0ffdd6-ed21-4fe1-a4a5-81ff2af39bfe tempest-KeyPairsV22TestJSON-109444167 tempest-KeyPairsV22TestJSON-109444167-project] Calling method '.version_select at 0x7f5edf319700>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:53.422057 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b5a928fd-ff6d-4d37-aa61-f19df8b02bdd tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:53.428090 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b5a928fd-ff6d-4d37-aa61-f19df8b02bdd tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] [instance: 457da794-89e7-4b30-95ba-802c95550c7e] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:53.436406 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-dc0ffdd6-ed21-4fe1-a4a5-81ff2af39bfe tempest-KeyPairsV22TestJSON-109444167 tempest-KeyPairsV22TestJSON-109444167-project] 10.222.0.70 "GET /compute/v2.1/os-keypairs/tempest-keypair-2080371358" status: 200 len: 513 microversion: 2.2 time: 0.044461 Aug 27 02:51:53.447010 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1188/2392] 10.222.0.70 () {60 vars in 1258 bytes} [Sat Aug 27 02:51:53 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-2080371358 => generated 513 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:51:53.455427 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b5a928fd-ff6d-4d37-aa61-f19df8b02bdd tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:53.457351 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b5a928fd-ff6d-4d37-aa61-f19df8b02bdd tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:53.459656 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b5a928fd-ff6d-4d37-aa61-f19df8b02bdd tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:53.460506 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b5a928fd-ff6d-4d37-aa61-f19df8b02bdd tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:53.465324 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b5a928fd-ff6d-4d37-aa61-f19df8b02bdd tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:53.466884 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-5275e6b9-7d71-40dc-9903-4633d0b7ef71 tempest-KeyPairsV22TestJSON-109444167 tempest-KeyPairsV22TestJSON-109444167-project] Calling method '.version_select at 0x7f5edf316430>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:53.468081 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b5a928fd-ff6d-4d37-aa61-f19df8b02bdd tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:53.482543 n-d-852278-4 devstack@n-api.service[134051]: WARNING oslo_db.sqlalchemy.utils [None req-5275e6b9-7d71-40dc-9903-4633d0b7ef71 tempest-KeyPairsV22TestJSON-109444167 tempest-KeyPairsV22TestJSON-109444167-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 27 02:51:53.503192 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-5275e6b9-7d71-40dc-9903-4633d0b7ef71 tempest-KeyPairsV22TestJSON-109444167 tempest-KeyPairsV22TestJSON-109444167-project] 10.222.0.70 "GET /compute/v2.1/os-keypairs" status: 200 len: 370 microversion: 2.2 time: 0.053862 Aug 27 02:51:53.510580 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1189/2393] 10.222.0.70 () {60 vars in 1177 bytes} [Sat Aug 27 02:51:53 2022] GET /compute/v2.1/os-keypairs => generated 370 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:51:53.522327 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-6e44ca65-416a-41a7-902e-de154b1dff23 tempest-KeyPairsV22TestJSON-109444167 tempest-KeyPairsV22TestJSON-109444167-project] Calling method '.version_select at 0x7f5edf421af0>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:53.573486 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-6e44ca65-416a-41a7-902e-de154b1dff23 tempest-KeyPairsV22TestJSON-109444167 tempest-KeyPairsV22TestJSON-109444167-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2080371358" status: 204 len: 0 microversion: 2.2 time: 0.060695 Aug 27 02:51:53.574858 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1190/2394] 10.222.0.70 () {60 vars in 1261 bytes} [Sat Aug 27 02:51:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2080371358 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 02:51:53.592772 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-eca25a04-f481-4ba9-a90b-afbf51bcdccd tempest-KeyPairsV22TestJSON-109444167 tempest-KeyPairsV22TestJSON-109444167-project] Action: 'create', calling method: .version_select at 0x7f5edf046e50>, body: {"keypair": {"name": "tempest-keypair-1586368920", "type": "x509"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:51:53.648609 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-eca25a04-f481-4ba9-a90b-afbf51bcdccd tempest-KeyPairsV22TestJSON-109444167 tempest-KeyPairsV22TestJSON-109444167-project] Getting quotas for project 93c01aa673db4139823053661328f1a7. Resources: {'key_pairs'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:51:53.664703 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-eca25a04-f481-4ba9-a90b-afbf51bcdccd tempest-KeyPairsV22TestJSON-109444167 tempest-KeyPairsV22TestJSON-109444167-project] Getting quotas for user 5f827446808f45af9bbb388ed127346a and project 93c01aa673db4139823053661328f1a7. Resources: {'key_pairs'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:51:53.697560 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.processutils [None req-eca25a04-f481-4ba9-a90b-afbf51bcdccd tempest-KeyPairsV22TestJSON-109444167 tempest-KeyPairsV22TestJSON-109444167-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpmrsldnp4/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpmrsldnp4/temp.key -subj /CN=5f827446808f45af9bbb388ed127346a -extensions v3_req_client {{(pid=134051) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Aug 27 02:51:54.654840 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.processutils [None req-eca25a04-f481-4ba9-a90b-afbf51bcdccd tempest-KeyPairsV22TestJSON-109444167 tempest-KeyPairsV22TestJSON-109444167-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpmrsldnp4/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpmrsldnp4/temp.key -subj /CN=5f827446808f45af9bbb388ed127346a -extensions v3_req_client" returned: 0 in 0.954s {{(pid=134051) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Aug 27 02:51:54.657965 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.processutils [None req-eca25a04-f481-4ba9-a90b-afbf51bcdccd tempest-KeyPairsV22TestJSON-109444167 tempest-KeyPairsV22TestJSON-109444167-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpmrsldnp4/temp.key -password pass: {{(pid=134051) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Aug 27 02:51:54.718369 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b5a928fd-ff6d-4d37-aa61-f19df8b02bdd tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f496f24dccea47bd9a5ab532fe45e370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40794f05e8b94a0f8f087a87a58e0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:54.731678 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.processutils [None req-eca25a04-f481-4ba9-a90b-afbf51bcdccd tempest-KeyPairsV22TestJSON-109444167 tempest-KeyPairsV22TestJSON-109444167-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpmrsldnp4/temp.key -password pass:" returned: 0 in 0.074s {{(pid=134051) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Aug 27 02:51:54.734908 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b5a928fd-ff6d-4d37-aa61-f19df8b02bdd tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "GET /compute/v2.1/servers/457da794-89e7-4b30-95ba-802c95550c7e" status: 200 len: 1307 microversion: 2.1 time: 1.333311 Aug 27 02:51:54.735579 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1205/2395] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:53 2022] GET /compute/v2.1/servers/457da794-89e7-4b30-95ba-802c95550c7e => generated 1307 bytes in 1338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:54.745569 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d1b2c2e1-d854-4d97-91f6-644d7e776386 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:54.746193 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d1b2c2e1-d854-4d97-91f6-644d7e776386 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: c2c6b214-da6b-48dd-b84c-b111611fc89a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:54.761209 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d1b2c2e1-d854-4d97-91f6-644d7e776386 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:54.762795 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d1b2c2e1-d854-4d97-91f6-644d7e776386 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:54.765218 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d1b2c2e1-d854-4d97-91f6-644d7e776386 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:54.766012 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d1b2c2e1-d854-4d97-91f6-644d7e776386 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:54.767843 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d1b2c2e1-d854-4d97-91f6-644d7e776386 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:54.769378 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d1b2c2e1-d854-4d97-91f6-644d7e776386 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:54.807150 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-eca25a04-f481-4ba9-a90b-afbf51bcdccd tempest-KeyPairsV22TestJSON-109444167 tempest-KeyPairsV22TestJSON-109444167-project] Getting quotas for project 93c01aa673db4139823053661328f1a7. Resources: {'key_pairs'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:51:54.835262 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-eca25a04-f481-4ba9-a90b-afbf51bcdccd tempest-KeyPairsV22TestJSON-109444167 tempest-KeyPairsV22TestJSON-109444167-project] Getting quotas for user 5f827446808f45af9bbb388ed127346a and project 93c01aa673db4139823053661328f1a7. Resources: {'key_pairs'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:51:54.896151 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-eca25a04-f481-4ba9-a90b-afbf51bcdccd tempest-KeyPairsV22TestJSON-109444167 tempest-KeyPairsV22TestJSON-109444167-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 201 len: 4693 microversion: 2.2 time: 1.315596 Aug 27 02:51:54.904608 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1191/2396] 10.222.0.70 () {62 vars in 1198 bytes} [Sat Aug 27 02:51:53 2022] POST /compute/v2.1/os-keypairs => generated 4693 bytes in 1325 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:51:54.933774 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b902fa39-8333-42e7-bcce-56ac6a89737c tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:54.933908 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-d1b2c2e1-d854-4d97-91f6-644d7e776386 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:54.940953 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b902fa39-8333-42e7-bcce-56ac6a89737c tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: ba987aee-2707-4d47-aba9-d2803aa70745] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:54.946766 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d1b2c2e1-d854-4d97-91f6-644d7e776386 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/c2c6b214-da6b-48dd-b84c-b111611fc89a" status: 200 len: 1346 microversion: 2.1 time: 0.210007 Aug 27 02:51:54.949924 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1206/2397] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:54 2022] GET /compute/v2.1/servers/c2c6b214-da6b-48dd-b84c-b111611fc89a => generated 1346 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:54.957792 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ec0f3aaa-c0a7-4f31-82e2-df38b89819af tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:54.960681 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-ec0f3aaa-c0a7-4f31-82e2-df38b89819af tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] [instance: 6ef152e6-ba27-46bd-871a-04d8539b493e] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:54.972909 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ec0f3aaa-c0a7-4f31-82e2-df38b89819af tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:54.975490 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ec0f3aaa-c0a7-4f31-82e2-df38b89819af tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:54.977738 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ec0f3aaa-c0a7-4f31-82e2-df38b89819af tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:54.987659 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b902fa39-8333-42e7-bcce-56ac6a89737c tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:54.988077 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ec0f3aaa-c0a7-4f31-82e2-df38b89819af tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:54.988720 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b902fa39-8333-42e7-bcce-56ac6a89737c tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:54.989310 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b902fa39-8333-42e7-bcce-56ac6a89737c tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:54.989691 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ec0f3aaa-c0a7-4f31-82e2-df38b89819af tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:54.990133 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b902fa39-8333-42e7-bcce-56ac6a89737c tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:54.990811 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b902fa39-8333-42e7-bcce-56ac6a89737c tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:54.991440 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b902fa39-8333-42e7-bcce-56ac6a89737c tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:54.991563 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ec0f3aaa-c0a7-4f31-82e2-df38b89819af tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:55.241511 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-b902fa39-8333-42e7-bcce-56ac6a89737c tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:55.257526 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b902fa39-8333-42e7-bcce-56ac6a89737c tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/ba987aee-2707-4d47-aba9-d2803aa70745" status: 200 len: 1270 microversion: 2.1 time: 0.351561 Aug 27 02:51:55.258148 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1192/2398] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:54 2022] GET /compute/v2.1/servers/ba987aee-2707-4d47-aba9-d2803aa70745 => generated 1270 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:55.262736 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-931e0ab1-4a8d-43a6-9cad-0a56b667db4f tempest-KeyPairsV22TestJSON-109444167 tempest-KeyPairsV22TestJSON-109444167-project] Calling method '.version_select at 0x7f5edf0418b0>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:55.291222 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-931e0ab1-4a8d-43a6-9cad-0a56b667db4f tempest-KeyPairsV22TestJSON-109444167 tempest-KeyPairsV22TestJSON-109444167-project] 10.222.0.70 "GET /compute/v2.1/os-keypairs/tempest-keypair-1586368920" status: 200 len: 1534 microversion: 2.2 time: 0.031959 Aug 27 02:51:55.296823 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1193/2399] 10.222.0.70 () {60 vars in 1258 bytes} [Sat Aug 27 02:51:55 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1586368920 => generated 1534 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:55.306008 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-6134db0f-e6ce-40e2-9f84-8abd60b24092 req-9050bcc6-9a3a-4c4d-b2bb-e7c379571be7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb0d71f2-158d-4acc-8774-6874e7da29cd", "name": "network-vif-plugged", "status": "completed", "tag": "fe5d48cf-956a-4e15-9a8e-fdd605d313b1"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:51:55.333055 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=6,nova_api:INSERT=6 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:51:55.336381 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-6134db0f-e6ce-40e2-9f84-8abd60b24092 req-9050bcc6-9a3a-4c4d-b2bb-e7c379571be7 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:55.338152 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-6134db0f-e6ce-40e2-9f84-8abd60b24092 req-9050bcc6-9a3a-4c4d-b2bb-e7c379571be7 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:55.340786 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-6134db0f-e6ce-40e2-9f84-8abd60b24092 req-9050bcc6-9a3a-4c4d-b2bb-e7c379571be7 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:55.367944 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-6134db0f-e6ce-40e2-9f84-8abd60b24092 req-9050bcc6-9a3a-4c4d-b2bb-e7c379571be7 service nova] Creating event network-vif-plugged:fe5d48cf-956a-4e15-9a8e-fdd605d313b1 for instance bb0d71f2-158d-4acc-8774-6874e7da29cd on n-h1-852278-4 Aug 27 02:51:55.375322 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-6134db0f-e6ce-40e2-9f84-8abd60b24092 req-9050bcc6-9a3a-4c4d-b2bb-e7c379571be7 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076204 Aug 27 02:51:55.375739 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1194/2400] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:51:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:51:55.377460 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-ec0f3aaa-c0a7-4f31-82e2-df38b89819af tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317e74b4bbc4da298a0dcbd78068352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a8810c21784788b4c0ee64dedbaf15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:55.381997 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-72d5a417-607f-4991-9d32-02624bd6d0db tempest-KeyPairsV22TestJSON-109444167 tempest-KeyPairsV22TestJSON-109444167-project] Calling method '.version_select at 0x7f5edf046670>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:55.387374 n-d-852278-4 devstack@n-api.service[134051]: WARNING oslo_db.sqlalchemy.utils [None req-72d5a417-607f-4991-9d32-02624bd6d0db tempest-KeyPairsV22TestJSON-109444167 tempest-KeyPairsV22TestJSON-109444167-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 27 02:51:55.393272 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-72d5a417-607f-4991-9d32-02624bd6d0db tempest-KeyPairsV22TestJSON-109444167 tempest-KeyPairsV22TestJSON-109444167-project] 10.222.0.70 "GET /compute/v2.1/os-keypairs" status: 200 len: 1391 microversion: 2.2 time: 0.016174 Aug 27 02:51:55.393524 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ec0f3aaa-c0a7-4f31-82e2-df38b89819af tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] 10.222.0.70 "GET /compute/v2.1/servers/6ef152e6-ba27-46bd-871a-04d8539b493e" status: 200 len: 1317 microversion: 2.1 time: 0.442010 Aug 27 02:51:55.393895 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1207/2401] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:54 2022] GET /compute/v2.1/servers/6ef152e6-ba27-46bd-871a-04d8539b493e => generated 1317 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:55.407392 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1195/2402] 10.222.0.70 () {60 vars in 1177 bytes} [Sat Aug 27 02:51:55 2022] GET /compute/v2.1/os-keypairs => generated 1391 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:55.418022 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-882fb2dc-94a7-4863-adbd-d37d9f74809f tempest-KeyPairsV22TestJSON-109444167 tempest-KeyPairsV22TestJSON-109444167-project] Calling method '.version_select at 0x7f5ee2ce8550>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:55.454203 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-882fb2dc-94a7-4863-adbd-d37d9f74809f tempest-KeyPairsV22TestJSON-109444167 tempest-KeyPairsV22TestJSON-109444167-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1586368920" status: 204 len: 0 microversion: 2.2 time: 0.040041 Aug 27 02:51:55.455451 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1208/2403] 10.222.0.70 () {60 vars in 1261 bytes} [Sat Aug 27 02:51:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1586368920 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:51:55.757913 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a88e1378-df05-48f7-845a-570e16f6bd6d tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:55.759386 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-a88e1378-df05-48f7-845a-570e16f6bd6d tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] [instance: 457da794-89e7-4b30-95ba-802c95550c7e] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:55.782421 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a88e1378-df05-48f7-845a-570e16f6bd6d tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:55.783061 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a88e1378-df05-48f7-845a-570e16f6bd6d tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:55.783519 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a88e1378-df05-48f7-845a-570e16f6bd6d tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:55.784273 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a88e1378-df05-48f7-845a-570e16f6bd6d tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:55.791463 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a88e1378-df05-48f7-845a-570e16f6bd6d tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:55.794871 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a88e1378-df05-48f7-845a-570e16f6bd6d tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:55.967483 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-32a01877-1fb1-4a98-8c55-6333fe156913 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:55.968104 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-32a01877-1fb1-4a98-8c55-6333fe156913 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: c2c6b214-da6b-48dd-b84c-b111611fc89a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:55.996087 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-32a01877-1fb1-4a98-8c55-6333fe156913 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:55.997165 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-32a01877-1fb1-4a98-8c55-6333fe156913 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:56.000398 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-32a01877-1fb1-4a98-8c55-6333fe156913 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:56.001343 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-32a01877-1fb1-4a98-8c55-6333fe156913 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:56.005018 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-32a01877-1fb1-4a98-8c55-6333fe156913 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:56.007623 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-32a01877-1fb1-4a98-8c55-6333fe156913 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:56.317575 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-32a01877-1fb1-4a98-8c55-6333fe156913 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:56.331758 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-32a01877-1fb1-4a98-8c55-6333fe156913 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/c2c6b214-da6b-48dd-b84c-b111611fc89a" status: 200 len: 1346 microversion: 2.1 time: 0.368511 Aug 27 02:51:56.335644 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1209/2404] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:55 2022] GET /compute/v2.1/servers/c2c6b214-da6b-48dd-b84c-b111611fc89a => generated 1346 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:56.349262 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-2e410c70-d0e1-4231-8d7f-49fc0b474150 req-400c9a6a-f963-4aed-a862-eb3b661df8f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ef152e6-ba27-46bd-871a-04d8539b493e", "tag": "2080aa25-53d4-46f2-a694-162ef2ea0ac4"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:51:56.374454 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-2e410c70-d0e1-4231-8d7f-49fc0b474150 req-400c9a6a-f963-4aed-a862-eb3b661df8f5 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:56.375555 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-2e410c70-d0e1-4231-8d7f-49fc0b474150 req-400c9a6a-f963-4aed-a862-eb3b661df8f5 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:56.377532 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-2e410c70-d0e1-4231-8d7f-49fc0b474150 req-400c9a6a-f963-4aed-a862-eb3b661df8f5 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:56.405591 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-a88e1378-df05-48f7-845a-570e16f6bd6d tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f496f24dccea47bd9a5ab532fe45e370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40794f05e8b94a0f8f087a87a58e0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:56.422751 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a88e1378-df05-48f7-845a-570e16f6bd6d tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "GET /compute/v2.1/servers/457da794-89e7-4b30-95ba-802c95550c7e" status: 200 len: 1307 microversion: 2.1 time: 0.666665 Aug 27 02:51:56.425824 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1196/2405] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:55 2022] GET /compute/v2.1/servers/457da794-89e7-4b30-95ba-802c95550c7e => generated 1307 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:56.435564 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4dabeb20-0b8a-4439-a5a2-8362a6aa2061 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:56.440172 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-2e410c70-d0e1-4231-8d7f-49fc0b474150 req-400c9a6a-f963-4aed-a862-eb3b661df8f5 service nova] Creating event network-changed:2080aa25-53d4-46f2-a694-162ef2ea0ac4 for instance 6ef152e6-ba27-46bd-871a-04d8539b493e on n-h1-852278-4 Aug 27 02:51:56.445275 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-4dabeb20-0b8a-4439-a5a2-8362a6aa2061 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: ba987aee-2707-4d47-aba9-d2803aa70745] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:56.454087 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-2e410c70-d0e1-4231-8d7f-49fc0b474150 req-400c9a6a-f963-4aed-a862-eb3b661df8f5 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115832 Aug 27 02:51:56.461415 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1210/2406] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:51:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:51:56.468639 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4dabeb20-0b8a-4439-a5a2-8362a6aa2061 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:56.469868 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4dabeb20-0b8a-4439-a5a2-8362a6aa2061 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:56.470549 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4dabeb20-0b8a-4439-a5a2-8362a6aa2061 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:56.473858 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b684cf88-77c6-4afc-98a1-20380ab39857 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:56.474895 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4dabeb20-0b8a-4439-a5a2-8362a6aa2061 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:56.476807 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4dabeb20-0b8a-4439-a5a2-8362a6aa2061 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:56.478973 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4dabeb20-0b8a-4439-a5a2-8362a6aa2061 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:56.483629 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b684cf88-77c6-4afc-98a1-20380ab39857 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] [instance: 6ef152e6-ba27-46bd-871a-04d8539b493e] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:56.507664 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b684cf88-77c6-4afc-98a1-20380ab39857 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:56.508921 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b684cf88-77c6-4afc-98a1-20380ab39857 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:56.509599 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b684cf88-77c6-4afc-98a1-20380ab39857 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:56.510828 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b684cf88-77c6-4afc-98a1-20380ab39857 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:56.511476 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b684cf88-77c6-4afc-98a1-20380ab39857 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:56.512113 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b684cf88-77c6-4afc-98a1-20380ab39857 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:56.981259 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b684cf88-77c6-4afc-98a1-20380ab39857 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317e74b4bbc4da298a0dcbd78068352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a8810c21784788b4c0ee64dedbaf15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:56.991772 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b684cf88-77c6-4afc-98a1-20380ab39857 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] 10.222.0.70 "GET /compute/v2.1/servers/6ef152e6-ba27-46bd-871a-04d8539b493e" status: 200 len: 1317 microversion: 2.1 time: 0.528960 Aug 27 02:51:56.995937 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1211/2407] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:56 2022] GET /compute/v2.1/servers/6ef152e6-ba27-46bd-871a-04d8539b493e => generated 1317 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:57.004607 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-4dabeb20-0b8a-4439-a5a2-8362a6aa2061 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:57.014233 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-4dabeb20-0b8a-4439-a5a2-8362a6aa2061 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/ba987aee-2707-4d47-aba9-d2803aa70745" status: 200 len: 1312 microversion: 2.1 time: 0.586775 Aug 27 02:51:57.021045 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1197/2408] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:56 2022] GET /compute/v2.1/servers/ba987aee-2707-4d47-aba9-d2803aa70745 => generated 1312 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:57.355799 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c915d775-1f38-4708-b97d-39c94794426c tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:57.356829 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-c915d775-1f38-4708-b97d-39c94794426c tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: c2c6b214-da6b-48dd-b84c-b111611fc89a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:57.360241 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:51:57.386400 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c915d775-1f38-4708-b97d-39c94794426c tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:57.400603 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c915d775-1f38-4708-b97d-39c94794426c tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:57.401287 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c915d775-1f38-4708-b97d-39c94794426c tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:57.406662 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c915d775-1f38-4708-b97d-39c94794426c tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:57.406870 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c915d775-1f38-4708-b97d-39c94794426c tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:57.407503 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c915d775-1f38-4708-b97d-39c94794426c tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:57.451008 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-13510ff5-7017-447c-97e0-654287074bc5 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:57.453074 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-13510ff5-7017-447c-97e0-654287074bc5 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] [instance: 457da794-89e7-4b30-95ba-802c95550c7e] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:57.484976 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-13510ff5-7017-447c-97e0-654287074bc5 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:57.489410 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-13510ff5-7017-447c-97e0-654287074bc5 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:57.490923 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-13510ff5-7017-447c-97e0-654287074bc5 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:57.494437 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-13510ff5-7017-447c-97e0-654287074bc5 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:57.498763 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-13510ff5-7017-447c-97e0-654287074bc5 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:57.499779 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-13510ff5-7017-447c-97e0-654287074bc5 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:57.757997 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-c915d775-1f38-4708-b97d-39c94794426c tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:57.784187 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c915d775-1f38-4708-b97d-39c94794426c tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/c2c6b214-da6b-48dd-b84c-b111611fc89a" status: 200 len: 1346 microversion: 2.1 time: 0.432943 Aug 27 02:51:57.810572 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1212/2409] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:57 2022] GET /compute/v2.1/servers/c2c6b214-da6b-48dd-b84c-b111611fc89a => generated 1346 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:57.829416 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-37f5adc9-f525-4ead-b424-c829f9ffbc46 tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:57.835623 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-37f5adc9-f525-4ead-b424-c829f9ffbc46 tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] [instance: 503900da-e41b-4787-bb1e-9d3df7df05b6] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:57.860640 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-37f5adc9-f525-4ead-b424-c829f9ffbc46 tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:57.875328 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-37f5adc9-f525-4ead-b424-c829f9ffbc46 tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:57.875328 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-37f5adc9-f525-4ead-b424-c829f9ffbc46 tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:57.890957 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-37f5adc9-f525-4ead-b424-c829f9ffbc46 tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:57.892742 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-37f5adc9-f525-4ead-b424-c829f9ffbc46 tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:57.895280 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-37f5adc9-f525-4ead-b424-c829f9ffbc46 tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:58.498483 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-13510ff5-7017-447c-97e0-654287074bc5 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f496f24dccea47bd9a5ab532fe45e370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40794f05e8b94a0f8f087a87a58e0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:58.514434 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-13510ff5-7017-447c-97e0-654287074bc5 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "GET /compute/v2.1/servers/457da794-89e7-4b30-95ba-802c95550c7e" status: 200 len: 1307 microversion: 2.1 time: 1.073174 Aug 27 02:51:58.515179 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-37f5adc9-f525-4ead-b424-c829f9ffbc46 tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ece2eb399074418ac5f890d223c1be0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c13c50438234109913876bf5a11d271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:58.519553 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1198/2410] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:57 2022] GET /compute/v2.1/servers/457da794-89e7-4b30-95ba-802c95550c7e => generated 1307 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:58.526486 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-1c3928b8-ba63-4262-92e9-227fee33e075 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:58.528350 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-1c3928b8-ba63-4262-92e9-227fee33e075 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] [instance: 6ef152e6-ba27-46bd-871a-04d8539b493e] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:58.538197 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-37f5adc9-f525-4ead-b424-c829f9ffbc46 tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] 10.222.0.70 "GET /compute/v2.1/servers/503900da-e41b-4787-bb1e-9d3df7df05b6" status: 200 len: 1577 microversion: 2.1 time: 0.726021 Aug 27 02:51:58.538755 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1213/2411] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:57 2022] GET /compute/v2.1/servers/503900da-e41b-4787-bb1e-9d3df7df05b6 => generated 1577 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:58.554922 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1c3928b8-ba63-4262-92e9-227fee33e075 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:58.555948 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1c3928b8-ba63-4262-92e9-227fee33e075 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:58.556961 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1c3928b8-ba63-4262-92e9-227fee33e075 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:58.559729 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1c3928b8-ba63-4262-92e9-227fee33e075 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:58.561198 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1c3928b8-ba63-4262-92e9-227fee33e075 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:58.562079 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1c3928b8-ba63-4262-92e9-227fee33e075 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:58.564064 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c25f4532-d82e-4a9c-a699-d6dcdb322be2 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:58.567059 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-c25f4532-d82e-4a9c-a699-d6dcdb322be2 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: ba987aee-2707-4d47-aba9-d2803aa70745] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:58.582256 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c25f4532-d82e-4a9c-a699-d6dcdb322be2 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:58.582752 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c25f4532-d82e-4a9c-a699-d6dcdb322be2 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:58.585365 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c25f4532-d82e-4a9c-a699-d6dcdb322be2 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:58.586137 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c25f4532-d82e-4a9c-a699-d6dcdb322be2 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:58.586600 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c25f4532-d82e-4a9c-a699-d6dcdb322be2 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:58.587023 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c25f4532-d82e-4a9c-a699-d6dcdb322be2 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:58.601858 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:51:59.229107 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-1c3928b8-ba63-4262-92e9-227fee33e075 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317e74b4bbc4da298a0dcbd78068352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a8810c21784788b4c0ee64dedbaf15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:59.240179 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-1c3928b8-ba63-4262-92e9-227fee33e075 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] 10.222.0.70 "GET /compute/v2.1/servers/6ef152e6-ba27-46bd-871a-04d8539b493e" status: 200 len: 1317 microversion: 2.1 time: 0.718328 Aug 27 02:51:59.242125 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1199/2412] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:58 2022] GET /compute/v2.1/servers/6ef152e6-ba27-46bd-871a-04d8539b493e => generated 1317 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:59.257413 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-2974c5f5-0eb6-424f-b983-12148993054e req-520865ed-2f56-4761-b3ab-ebb79a9a0b08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "503900da-e41b-4787-bb1e-9d3df7df05b6", "tag": "d5dfa226-5023-4e6d-a3ae-5b36139b84bc"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:51:59.281230 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-2974c5f5-0eb6-424f-b983-12148993054e req-520865ed-2f56-4761-b3ab-ebb79a9a0b08 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:59.281718 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-2974c5f5-0eb6-424f-b983-12148993054e req-520865ed-2f56-4761-b3ab-ebb79a9a0b08 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:59.282151 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-2974c5f5-0eb6-424f-b983-12148993054e req-520865ed-2f56-4761-b3ab-ebb79a9a0b08 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:59.292271 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:51:59.324410 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-2974c5f5-0eb6-424f-b983-12148993054e req-520865ed-2f56-4761-b3ab-ebb79a9a0b08 service nova] Creating event network-changed:d5dfa226-5023-4e6d-a3ae-5b36139b84bc for instance 503900da-e41b-4787-bb1e-9d3df7df05b6 on n-h2-852278-4 Aug 27 02:51:59.348164 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-2974c5f5-0eb6-424f-b983-12148993054e req-520865ed-2f56-4761-b3ab-ebb79a9a0b08 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104561 Aug 27 02:51:59.357338 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1200/2413] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:51:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:51:59.378552 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-24c2ce90-0172-4c88-bc5a-404d94a4e9d1 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:59.383012 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-24c2ce90-0172-4c88-bc5a-404d94a4e9d1 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: c2c6b214-da6b-48dd-b84c-b111611fc89a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:59.411780 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-24c2ce90-0172-4c88-bc5a-404d94a4e9d1 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:59.415126 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-24c2ce90-0172-4c88-bc5a-404d94a4e9d1 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:59.417856 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-24c2ce90-0172-4c88-bc5a-404d94a4e9d1 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:59.420351 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-24c2ce90-0172-4c88-bc5a-404d94a4e9d1 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:59.425923 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-24c2ce90-0172-4c88-bc5a-404d94a4e9d1 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:59.427056 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-24c2ce90-0172-4c88-bc5a-404d94a4e9d1 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:59.514770 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-24c2ce90-0172-4c88-bc5a-404d94a4e9d1 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:59.516304 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-24c2ce90-0172-4c88-bc5a-404d94a4e9d1 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:59.518677 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-24c2ce90-0172-4c88-bc5a-404d94a4e9d1 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:59.520242 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.objects.instance [None req-24c2ce90-0172-4c88-bc5a-404d94a4e9d1 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lazy-loading 'fault' on Instance uuid c2c6b214-da6b-48dd-b84c-b111611fc89a {{(pid=134051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:51:59.544191 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-c25f4532-d82e-4a9c-a699-d6dcdb322be2 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:59.560592 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c25f4532-d82e-4a9c-a699-d6dcdb322be2 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/ba987aee-2707-4d47-aba9-d2803aa70745" status: 200 len: 1312 microversion: 2.1 time: 1.004516 Aug 27 02:51:59.562597 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1214/2414] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:58 2022] GET /compute/v2.1/servers/ba987aee-2707-4d47-aba9-d2803aa70745 => generated 1312 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:59.572936 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f766f8e1-e50b-46f7-97ca-8f02a4836bda tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:59.576202 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-f766f8e1-e50b-46f7-97ca-8f02a4836bda tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] [instance: 457da794-89e7-4b30-95ba-802c95550c7e] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:59.593499 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f766f8e1-e50b-46f7-97ca-8f02a4836bda tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:59.595082 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f766f8e1-e50b-46f7-97ca-8f02a4836bda tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:59.596875 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f766f8e1-e50b-46f7-97ca-8f02a4836bda tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:59.599653 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f766f8e1-e50b-46f7-97ca-8f02a4836bda tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:59.600377 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f766f8e1-e50b-46f7-97ca-8f02a4836bda tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:59.600983 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f766f8e1-e50b-46f7-97ca-8f02a4836bda tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:59.645175 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-24c2ce90-0172-4c88-bc5a-404d94a4e9d1 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:59.664567 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-24c2ce90-0172-4c88-bc5a-404d94a4e9d1 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/c2c6b214-da6b-48dd-b84c-b111611fc89a" status: 200 len: 1305 microversion: 2.1 time: 0.296215 Aug 27 02:51:59.684047 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1201/2415] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:59 2022] GET /compute/v2.1/servers/c2c6b214-da6b-48dd-b84c-b111611fc89a => generated 1305 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:59.931824 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-f766f8e1-e50b-46f7-97ca-8f02a4836bda tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f496f24dccea47bd9a5ab532fe45e370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40794f05e8b94a0f8f087a87a58e0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:59.952205 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f766f8e1-e50b-46f7-97ca-8f02a4836bda tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "GET /compute/v2.1/servers/457da794-89e7-4b30-95ba-802c95550c7e" status: 200 len: 1307 microversion: 2.1 time: 0.385063 Aug 27 02:51:59.954460 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1215/2416] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:59 2022] GET /compute/v2.1/servers/457da794-89e7-4b30-95ba-802c95550c7e => generated 1307 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:00.090913 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-c87236a6-4c9e-4b77-8330-a2f99abbd0c8 req-3da902e0-2a5b-4029-9e1e-d625aab8e593 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "457da794-89e7-4b30-95ba-802c95550c7e", "name": "network-vif-plugged", "status": "completed", "tag": "27be2c6c-8615-4a7c-96a7-71c5111896a7"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:52:00.128396 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-c87236a6-4c9e-4b77-8330-a2f99abbd0c8 req-3da902e0-2a5b-4029-9e1e-d625aab8e593 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:00.131215 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-c87236a6-4c9e-4b77-8330-a2f99abbd0c8 req-3da902e0-2a5b-4029-9e1e-d625aab8e593 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:00.135379 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-c87236a6-4c9e-4b77-8330-a2f99abbd0c8 req-3da902e0-2a5b-4029-9e1e-d625aab8e593 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:00.207612 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-c87236a6-4c9e-4b77-8330-a2f99abbd0c8 req-3da902e0-2a5b-4029-9e1e-d625aab8e593 service nova] Creating event network-vif-plugged:27be2c6c-8615-4a7c-96a7-71c5111896a7 for instance 457da794-89e7-4b30-95ba-802c95550c7e on n-h2-852278-4 Aug 27 02:52:00.234907 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-c87236a6-4c9e-4b77-8330-a2f99abbd0c8 req-3da902e0-2a5b-4029-9e1e-d625aab8e593 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148996 Aug 27 02:52:00.236918 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1202/2417] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:52:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:52:00.284040 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9d857d0f-d358-46e4-b5e8-e5fd09e8fa34 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:00.285040 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-9d857d0f-d358-46e4-b5e8-e5fd09e8fa34 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] [instance: 6ef152e6-ba27-46bd-871a-04d8539b493e] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:00.298310 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9d857d0f-d358-46e4-b5e8-e5fd09e8fa34 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:00.300854 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9d857d0f-d358-46e4-b5e8-e5fd09e8fa34 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:00.302923 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9d857d0f-d358-46e4-b5e8-e5fd09e8fa34 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:00.305809 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9d857d0f-d358-46e4-b5e8-e5fd09e8fa34 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:00.306471 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9d857d0f-d358-46e4-b5e8-e5fd09e8fa34 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:00.307419 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9d857d0f-d358-46e4-b5e8-e5fd09e8fa34 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:00.584083 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a345d4ab-b690-4b5f-adef-aeed99c3afe5 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:00.585928 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-a345d4ab-b690-4b5f-adef-aeed99c3afe5 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: ba987aee-2707-4d47-aba9-d2803aa70745] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:00.594714 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a345d4ab-b690-4b5f-adef-aeed99c3afe5 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:00.603750 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a345d4ab-b690-4b5f-adef-aeed99c3afe5 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:00.609059 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a345d4ab-b690-4b5f-adef-aeed99c3afe5 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:00.610206 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a345d4ab-b690-4b5f-adef-aeed99c3afe5 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:00.613163 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a345d4ab-b690-4b5f-adef-aeed99c3afe5 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:00.615284 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a345d4ab-b690-4b5f-adef-aeed99c3afe5 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:00.993094 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-9d857d0f-d358-46e4-b5e8-e5fd09e8fa34 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317e74b4bbc4da298a0dcbd78068352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a8810c21784788b4c0ee64dedbaf15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:01.009163 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9d857d0f-d358-46e4-b5e8-e5fd09e8fa34 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] 10.222.0.70 "GET /compute/v2.1/servers/6ef152e6-ba27-46bd-871a-04d8539b493e" status: 200 len: 1317 microversion: 2.1 time: 0.747354 Aug 27 02:52:01.009778 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1216/2418] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:00 2022] GET /compute/v2.1/servers/6ef152e6-ba27-46bd-871a-04d8539b493e => generated 1317 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:01.037335 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b878ae13-02c5-4824-ae35-edae3e140d98 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:01.038003 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b878ae13-02c5-4824-ae35-edae3e140d98 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: c2c6b214-da6b-48dd-b84c-b111611fc89a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:01.048139 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b878ae13-02c5-4824-ae35-edae3e140d98 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:01.048767 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b878ae13-02c5-4824-ae35-edae3e140d98 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:01.049394 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b878ae13-02c5-4824-ae35-edae3e140d98 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:01.050298 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b878ae13-02c5-4824-ae35-edae3e140d98 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:01.050908 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b878ae13-02c5-4824-ae35-edae3e140d98 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:01.051490 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b878ae13-02c5-4824-ae35-edae3e140d98 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:01.079615 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-b878ae13-02c5-4824-ae35-edae3e140d98 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] HTTP exception thrown: Instance c2c6b214-da6b-48dd-b84c-b111611fc89a could not be found. Aug 27 02:52:01.091246 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b878ae13-02c5-4824-ae35-edae3e140d98 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Request method failure captured: Aug 27 02:52:01.091246 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/servers/c2c6b214-da6b-48dd-b84c-b111611fc89a HTTP/1.1 Aug 27 02:52:01.091246 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:52:01.091246 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:52:01.091246 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:52:01.091246 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:52:01.091246 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:52:01.091246 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:52:01.091246 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:52:01.091246 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:52:01.091246 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYZ0St41cKkzS8_oefTYdmhcUQuTjHJMchuX75Wes8eVywW22WD3_nUDa_aMbIFBVV51GGjDa8GDt8SbwEVTMvQnSuXk6MkeKEfB2NWHjFnNKSNKnT9A2S4P8aN7qYWhUsGxW2ugzvIrMVMPtkn5w90KE7af4tlEcxQ5ERFDVU7f32Y Aug 27 02:52:01.091246 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:52:01.091246 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:52:01.091246 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:52:01.091246 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:52:01.091246 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:52:01.091246 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:52:01.091246 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 840077c9375b4b2a9214cb8dda094cc8 Aug 27 02:52:01.091246 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-DeleteServersTestJSON-725615510 Aug 27 02:52:01.091246 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:52:01.091246 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:52:01.091246 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/840077c9375b4b2a9214cb8dda094cc8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_840077c9375b4b2a9214cb8dda094cc8", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/840077c9375b4b2a9214cb8dda094cc8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/840077c9375b4b2a9214cb8dda094cc8"}]}] Aug 27 02:52:01.091246 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-DeleteServersTestJSON-725615510 Aug 27 02:52:01.091246 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 840077c9375b4b2a9214cb8dda094cc8 Aug 27 02:52:01.091246 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-DeleteServersTestJSON-725615510 Aug 27 02:52:01.091246 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-DeleteServersTestJSON-725615510-project Aug 27 02:52:01.091246 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:52:01.091246 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:52:01.091246 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: dc53b0977c2b4e06b2f290442483913b Aug 27 02:52:01.091246 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-DeleteServersTestJSON-725615510-project Aug 27 02:52:01.091246 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 02:52:01.091246 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance c2c6b214-da6b-48dd-b84c-b111611fc89a could not be found. Aug 27 02:52:01.091246 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': 'c2c6b214-da6b-48dd-b84c-b111611fc89a'} Aug 27 02:52:01.091246 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:52:01.091246 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:52:01.091246 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:52:01.091246 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:52:01.091246 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:52:01.091246 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:52:01.091246 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:52:01.091246 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:52:01.091246 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:52:01.091246 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:52:01.091246 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2c6b214-da6b-48dd-b84c-b111611fc89a could not be found. Aug 27 02:52:01.091246 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:52:01.091246 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:52:01.091246 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:52:01.091246 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:52:01.091246 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:52:01.091246 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:52:01.091246 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:52:01.091246 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:52:01.091246 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:52:01.091246 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:52:01.091246 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:52:01.091246 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:52:01.091246 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:52:01.091246 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:52:01.091246 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:52:01.091246 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:52:01.091246 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2c6b214-da6b-48dd-b84c-b111611fc89a could not be found. Aug 27 02:52:01.091246 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:52:01.091246 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:52:01.091246 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:52:01.095526 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:52:01.095526 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:52:01.095526 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:52:01.095526 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:52:01.095526 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:52:01.095526 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2c6b214-da6b-48dd-b84c-b111611fc89a could not be found. Aug 27 02:52:01.095526 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:52:01.097716 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b878ae13-02c5-4824-ae35-edae3e140d98 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Returning 404 to user: Instance c2c6b214-da6b-48dd-b84c-b111611fc89a could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:52:01.101222 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b878ae13-02c5-4824-ae35-edae3e140d98 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/c2c6b214-da6b-48dd-b84c-b111611fc89a" status: 404 len: 111 microversion: 2.1 time: 0.088147 Aug 27 02:52:01.102071 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1217/2419] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:01 2022] GET /compute/v2.1/servers/c2c6b214-da6b-48dd-b84c-b111611fc89a => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:52:01.253464 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-a345d4ab-b690-4b5f-adef-aeed99c3afe5 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:01.267653 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a345d4ab-b690-4b5f-adef-aeed99c3afe5 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/ba987aee-2707-4d47-aba9-d2803aa70745" status: 200 len: 1312 microversion: 2.1 time: 0.688226 Aug 27 02:52:01.268305 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1203/2420] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:00 2022] GET /compute/v2.1/servers/ba987aee-2707-4d47-aba9-d2803aa70745 => generated 1312 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:52:01.292268 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-926e51c7-d781-458b-8233-3553c9fb2e4d tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:01.300673 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-926e51c7-d781-458b-8233-3553c9fb2e4d tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] [instance: 457da794-89e7-4b30-95ba-802c95550c7e] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:01.325843 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-926e51c7-d781-458b-8233-3553c9fb2e4d tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:01.326449 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-926e51c7-d781-458b-8233-3553c9fb2e4d tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:01.326899 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-926e51c7-d781-458b-8233-3553c9fb2e4d tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:01.328217 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-926e51c7-d781-458b-8233-3553c9fb2e4d tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:01.332452 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-926e51c7-d781-458b-8233-3553c9fb2e4d tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:01.335270 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-926e51c7-d781-458b-8233-3553c9fb2e4d tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:01.525712 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-33cc1076-1bc3-47b0-8ccc-3981794b9c0f tempest-AbsoluteLimitsTestJSON-1570102854 tempest-AbsoluteLimitsTestJSON-1570102854-project] Calling method '.version_select at 0x7f5ee72144c0>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:01.551523 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-33cc1076-1bc3-47b0-8ccc-3981794b9c0f tempest-AbsoluteLimitsTestJSON-1570102854 tempest-AbsoluteLimitsTestJSON-1570102854-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:01.552146 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-33cc1076-1bc3-47b0-8ccc-3981794b9c0f tempest-AbsoluteLimitsTestJSON-1570102854 tempest-AbsoluteLimitsTestJSON-1570102854-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:01.552694 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-33cc1076-1bc3-47b0-8ccc-3981794b9c0f tempest-AbsoluteLimitsTestJSON-1570102854 tempest-AbsoluteLimitsTestJSON-1570102854-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:01.556055 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-33cc1076-1bc3-47b0-8ccc-3981794b9c0f tempest-AbsoluteLimitsTestJSON-1570102854 tempest-AbsoluteLimitsTestJSON-1570102854-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:01.556656 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-33cc1076-1bc3-47b0-8ccc-3981794b9c0f tempest-AbsoluteLimitsTestJSON-1570102854 tempest-AbsoluteLimitsTestJSON-1570102854-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:01.557167 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-33cc1076-1bc3-47b0-8ccc-3981794b9c0f tempest-AbsoluteLimitsTestJSON-1570102854 tempest-AbsoluteLimitsTestJSON-1570102854-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:01.581730 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:52:01.607201 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-926e51c7-d781-458b-8233-3553c9fb2e4d tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f496f24dccea47bd9a5ab532fe45e370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40794f05e8b94a0f8f087a87a58e0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:01.616773 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-33cc1076-1bc3-47b0-8ccc-3981794b9c0f tempest-AbsoluteLimitsTestJSON-1570102854 tempest-AbsoluteLimitsTestJSON-1570102854-project] 10.222.0.70 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.508874 Aug 27 02:52:01.618099 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1218/2421] 10.222.0.70 () {58 vars in 1122 bytes} [Sat Aug 27 02:52:01 2022] GET /compute/v2.1/limits => generated 511 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:52:01.630691 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5184a735-8249-4b06-aca0-98b9dd3ee2f5 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:01.633340 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-926e51c7-d781-458b-8233-3553c9fb2e4d tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "GET /compute/v2.1/servers/457da794-89e7-4b30-95ba-802c95550c7e" status: 200 len: 1307 microversion: 2.1 time: 0.339281 Aug 27 02:52:01.634769 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-5184a735-8249-4b06-aca0-98b9dd3ee2f5 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: c2c6b214-da6b-48dd-b84c-b111611fc89a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:01.648587 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5184a735-8249-4b06-aca0-98b9dd3ee2f5 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:01.649350 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5184a735-8249-4b06-aca0-98b9dd3ee2f5 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:01.651188 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5184a735-8249-4b06-aca0-98b9dd3ee2f5 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:01.651940 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1204/2422] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:01 2022] GET /compute/v2.1/servers/457da794-89e7-4b30-95ba-802c95550c7e => generated 1307 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:01.657201 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5184a735-8249-4b06-aca0-98b9dd3ee2f5 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:01.657974 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5184a735-8249-4b06-aca0-98b9dd3ee2f5 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:01.658570 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5184a735-8249-4b06-aca0-98b9dd3ee2f5 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:01.673022 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-e480da35-07ab-436a-92be-5c9e54a056bb req-bfef8b6a-8513-4b12-8349-431167aa3b47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba987aee-2707-4d47-aba9-d2803aa70745", "tag": "0871e4ff-ef2c-4a64-a799-ecfb74bf8dfa"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:52:01.689195 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-5184a735-8249-4b06-aca0-98b9dd3ee2f5 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] HTTP exception thrown: Instance c2c6b214-da6b-48dd-b84c-b111611fc89a could not be found. Aug 27 02:52:01.691839 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5184a735-8249-4b06-aca0-98b9dd3ee2f5 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Request method failure captured: Aug 27 02:52:01.691839 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/servers/c2c6b214-da6b-48dd-b84c-b111611fc89a/os-volume_attachments HTTP/1.1 Aug 27 02:52:01.691839 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:52:01.691839 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:52:01.691839 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:52:01.691839 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:52:01.691839 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:52:01.691839 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:52:01.691839 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:52:01.691839 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:52:01.691839 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYZ0St41cKkzS8_oefTYdmhcUQuTjHJMchuX75Wes8eVywW22WD3_nUDa_aMbIFBVV51GGjDa8GDt8SbwEVTMvQnSuXk6MkeKEfB2NWHjFnNKSNKnT9A2S4P8aN7qYWhUsGxW2ugzvIrMVMPtkn5w90KE7af4tlEcxQ5ERFDVU7f32Y Aug 27 02:52:01.691839 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:52:01.691839 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:52:01.691839 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:52:01.691839 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:52:01.691839 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:52:01.691839 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:52:01.691839 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 840077c9375b4b2a9214cb8dda094cc8 Aug 27 02:52:01.691839 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-DeleteServersTestJSON-725615510 Aug 27 02:52:01.691839 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:52:01.691839 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:52:01.691839 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/840077c9375b4b2a9214cb8dda094cc8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_840077c9375b4b2a9214cb8dda094cc8", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/840077c9375b4b2a9214cb8dda094cc8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/840077c9375b4b2a9214cb8dda094cc8"}]}] Aug 27 02:52:01.691839 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-DeleteServersTestJSON-725615510 Aug 27 02:52:01.691839 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 840077c9375b4b2a9214cb8dda094cc8 Aug 27 02:52:01.691839 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-DeleteServersTestJSON-725615510 Aug 27 02:52:01.691839 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-DeleteServersTestJSON-725615510-project Aug 27 02:52:01.691839 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:52:01.691839 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:52:01.691839 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: dc53b0977c2b4e06b2f290442483913b Aug 27 02:52:01.691839 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-DeleteServersTestJSON-725615510-project Aug 27 02:52:01.691839 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 02:52:01.691839 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance c2c6b214-da6b-48dd-b84c-b111611fc89a could not be found. Aug 27 02:52:01.691839 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'server_id': 'c2c6b214-da6b-48dd-b84c-b111611fc89a'} Aug 27 02:52:01.691839 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:52:01.691839 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:52:01.691839 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:52:01.691839 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:52:01.691839 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:52:01.691839 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:52:01.691839 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:52:01.691839 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:52:01.691839 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:52:01.691839 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:52:01.691839 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2c6b214-da6b-48dd-b84c-b111611fc89a could not be found. Aug 27 02:52:01.691839 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:52:01.691839 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:52:01.691839 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:52:01.691839 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:52:01.691839 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:52:01.691839 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:52:01.691839 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:52:01.691839 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:52:01.691839 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:52:01.691839 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:52:01.691839 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 02:52:01.691839 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:52:01.691839 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 02:52:01.691839 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:52:01.691839 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 27 02:52:01.691839 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 27 02:52:01.691839 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:52:01.691839 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:52:01.696383 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2c6b214-da6b-48dd-b84c-b111611fc89a could not be found. Aug 27 02:52:01.696383 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:52:01.696383 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:52:01.696383 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:52:01.696383 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:52:01.696383 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:52:01.696383 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:52:01.696383 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:52:01.696383 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:52:01.696383 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2c6b214-da6b-48dd-b84c-b111611fc89a could not be found. Aug 27 02:52:01.696383 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:52:01.698228 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5184a735-8249-4b06-aca0-98b9dd3ee2f5 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Returning 404 to user: Instance c2c6b214-da6b-48dd-b84c-b111611fc89a could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:52:01.699279 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-5184a735-8249-4b06-aca0-98b9dd3ee2f5 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/c2c6b214-da6b-48dd-b84c-b111611fc89a/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.080010 Aug 27 02:52:01.701924 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1219/2423] 10.222.0.70 () {58 vars in 1302 bytes} [Sat Aug 27 02:52:01 2022] GET /compute/v2.1/servers/c2c6b214-da6b-48dd-b84c-b111611fc89a/os-volume_attachments => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:52:01.710181 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-e480da35-07ab-436a-92be-5c9e54a056bb req-bfef8b6a-8513-4b12-8349-431167aa3b47 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:01.718605 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-e480da35-07ab-436a-92be-5c9e54a056bb req-bfef8b6a-8513-4b12-8349-431167aa3b47 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:01.719062 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-e480da35-07ab-436a-92be-5c9e54a056bb req-bfef8b6a-8513-4b12-8349-431167aa3b47 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:01.773145 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-e480da35-07ab-436a-92be-5c9e54a056bb req-bfef8b6a-8513-4b12-8349-431167aa3b47 service nova] Creating event network-changed:0871e4ff-ef2c-4a64-a799-ecfb74bf8dfa for instance ba987aee-2707-4d47-aba9-d2803aa70745 on n-h1-852278-4 Aug 27 02:52:01.802130 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-e480da35-07ab-436a-92be-5c9e54a056bb req-bfef8b6a-8513-4b12-8349-431167aa3b47 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136344 Aug 27 02:52:01.802130 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1205/2424] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:52:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:52:02.043182 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d813db50-2e51-4423-85fb-9dd411610523 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:02.044552 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d813db50-2e51-4423-85fb-9dd411610523 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] [instance: 6ef152e6-ba27-46bd-871a-04d8539b493e] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:02.059802 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d813db50-2e51-4423-85fb-9dd411610523 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:02.060325 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d813db50-2e51-4423-85fb-9dd411610523 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:02.069114 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d813db50-2e51-4423-85fb-9dd411610523 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:02.070038 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d813db50-2e51-4423-85fb-9dd411610523 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:02.070774 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d813db50-2e51-4423-85fb-9dd411610523 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:02.071223 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d813db50-2e51-4423-85fb-9dd411610523 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:02.085670 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-5bbb1a5c-bd8c-4693-a807-63a7b68f6b68 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2126220986", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "networks": [{"uuid": "9f81fa4d-d0d4-411f-b6ce-c99b22cb14d3"}]}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:52:02.245385 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.network.neutron [None req-5bbb1a5c-bd8c-4693-a807-63a7b68f6b68 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] validate_networks() for [('9f81fa4d-d0d4-411f-b6ce-c99b22cb14d3', None, None, None, None, None)] {{(pid=134051) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:52:02.641135 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-d813db50-2e51-4423-85fb-9dd411610523 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317e74b4bbc4da298a0dcbd78068352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a8810c21784788b4c0ee64dedbaf15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:02.657578 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d813db50-2e51-4423-85fb-9dd411610523 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] 10.222.0.70 "GET /compute/v2.1/servers/6ef152e6-ba27-46bd-871a-04d8539b493e" status: 200 len: 1317 microversion: 2.1 time: 0.631085 Aug 27 02:52:02.658531 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1220/2425] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:02 2022] GET /compute/v2.1/servers/6ef152e6-ba27-46bd-871a-04d8539b493e => generated 1317 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:02.667134 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-cb6f9b80-34b2-4a83-b6cd-f74cadeeb84d tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:02.671609 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-cb6f9b80-34b2-4a83-b6cd-f74cadeeb84d tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: ba987aee-2707-4d47-aba9-d2803aa70745] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:02.699176 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cb6f9b80-34b2-4a83-b6cd-f74cadeeb84d tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:02.703192 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cb6f9b80-34b2-4a83-b6cd-f74cadeeb84d tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:02.703911 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cb6f9b80-34b2-4a83-b6cd-f74cadeeb84d tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:02.706428 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cb6f9b80-34b2-4a83-b6cd-f74cadeeb84d tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:02.708029 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cb6f9b80-34b2-4a83-b6cd-f74cadeeb84d tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:02.711730 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cb6f9b80-34b2-4a83-b6cd-f74cadeeb84d tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:03.056264 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-cb6f9b80-34b2-4a83-b6cd-f74cadeeb84d tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:03.066850 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-cb6f9b80-34b2-4a83-b6cd-f74cadeeb84d tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/ba987aee-2707-4d47-aba9-d2803aa70745" status: 200 len: 1312 microversion: 2.1 time: 0.407192 Aug 27 02:52:03.073962 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1221/2426] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:02 2022] GET /compute/v2.1/servers/ba987aee-2707-4d47-aba9-d2803aa70745 => generated 1312 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:03.101578 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-01119aed-26ae-4f08-9ae3-52cb4ea03839 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:03.102191 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-01119aed-26ae-4f08-9ae3-52cb4ea03839 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] [instance: 457da794-89e7-4b30-95ba-802c95550c7e] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:03.111058 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-01119aed-26ae-4f08-9ae3-52cb4ea03839 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:03.111820 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-01119aed-26ae-4f08-9ae3-52cb4ea03839 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:03.112442 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-01119aed-26ae-4f08-9ae3-52cb4ea03839 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:03.113378 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-01119aed-26ae-4f08-9ae3-52cb4ea03839 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:03.113971 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-01119aed-26ae-4f08-9ae3-52cb4ea03839 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:03.114536 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-01119aed-26ae-4f08-9ae3-52cb4ea03839 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:03.206104 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-5bbb1a5c-bd8c-4693-a807-63a7b68f6b68 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Flavor limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:52:03.206104 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-5bbb1a5c-bd8c-4693-a807-63a7b68f6b68 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Image limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:52:03.206709 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-5bbb1a5c-bd8c-4693-a807-63a7b68f6b68 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Flavor pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:52:03.206880 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-5bbb1a5c-bd8c-4693-a807-63a7b68f6b68 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Image pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:52:03.207399 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-5bbb1a5c-bd8c-4693-a807-63a7b68f6b68 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:52:03.228098 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5bbb1a5c-bd8c-4693-a807-63a7b68f6b68 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:03.235272 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5bbb1a5c-bd8c-4693-a807-63a7b68f6b68 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:03.235996 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5bbb1a5c-bd8c-4693-a807-63a7b68f6b68 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:03.238896 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5bbb1a5c-bd8c-4693-a807-63a7b68f6b68 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:03.239602 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5bbb1a5c-bd8c-4693-a807-63a7b68f6b68 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:03.241695 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5bbb1a5c-bd8c-4693-a807-63a7b68f6b68 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:03.299014 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-5bbb1a5c-bd8c-4693-a807-63a7b68f6b68 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Getting quotas for project 840077c9375b4b2a9214cb8dda094cc8. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:52:03.309417 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-5bbb1a5c-bd8c-4693-a807-63a7b68f6b68 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Getting quotas for user dc53b0977c2b4e06b2f290442483913b and project 840077c9375b4b2a9214cb8dda094cc8. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:52:03.347403 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-5bbb1a5c-bd8c-4693-a807-63a7b68f6b68 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Going to run 1 instances... {{(pid=134051) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:52:03.350323 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-5bbb1a5c-bd8c-4693-a807-63a7b68f6b68 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: a5ea93e6-d2ab-4be4-89b6-7b2fd77e8474] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134051) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:52:03.377313 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-01119aed-26ae-4f08-9ae3-52cb4ea03839 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f496f24dccea47bd9a5ab532fe45e370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40794f05e8b94a0f8f087a87a58e0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:03.387704 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-01119aed-26ae-4f08-9ae3-52cb4ea03839 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "GET /compute/v2.1/servers/457da794-89e7-4b30-95ba-802c95550c7e" status: 200 len: 1487 microversion: 2.1 time: 0.297204 Aug 27 02:52:03.388429 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1222/2427] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:03 2022] GET /compute/v2.1/servers/457da794-89e7-4b30-95ba-802c95550c7e => generated 1487 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:03.393472 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-8f9b02a1-4bbc-4324-b424-14b2d16b7ec7 req-ac5471b8-1410-49da-84aa-f2924b88a623 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ef152e6-ba27-46bd-871a-04d8539b493e", "name": "network-vif-plugged", "status": "completed", "tag": "2080aa25-53d4-46f2-a694-162ef2ea0ac4"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:52:03.404262 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-8f9b02a1-4bbc-4324-b424-14b2d16b7ec7 req-ac5471b8-1410-49da-84aa-f2924b88a623 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:03.404529 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-8f9b02a1-4bbc-4324-b424-14b2d16b7ec7 req-ac5471b8-1410-49da-84aa-f2924b88a623 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:03.405050 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-8f9b02a1-4bbc-4324-b424-14b2d16b7ec7 req-ac5471b8-1410-49da-84aa-f2924b88a623 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:03.428123 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-5bbb1a5c-bd8c-4693-a807-63a7b68f6b68 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.347054 Aug 27 02:52:03.429066 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1206/2428] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 02:52:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1349 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 02:52:03.434399 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-2c303186-ecde-4e1a-b13c-e3cea3ef8e7c tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:52:03.435207 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-2c303186-ecde-4e1a-b13c-e3cea3ef8e7c tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] [instance: 457da794-89e7-4b30-95ba-802c95550c7e] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:03.444126 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2c303186-ecde-4e1a-b13c-e3cea3ef8e7c tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:03.445191 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2c303186-ecde-4e1a-b13c-e3cea3ef8e7c tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:03.445698 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2c303186-ecde-4e1a-b13c-e3cea3ef8e7c tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:03.446980 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2c303186-ecde-4e1a-b13c-e3cea3ef8e7c tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:03.447505 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2c303186-ecde-4e1a-b13c-e3cea3ef8e7c tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:03.447998 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2c303186-ecde-4e1a-b13c-e3cea3ef8e7c tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:03.451930 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-8f9b02a1-4bbc-4324-b424-14b2d16b7ec7 req-ac5471b8-1410-49da-84aa-f2924b88a623 service nova] Creating event network-vif-plugged:2080aa25-53d4-46f2-a694-162ef2ea0ac4 for instance 6ef152e6-ba27-46bd-871a-04d8539b493e on n-h1-852278-4 Aug 27 02:52:03.492836 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-8f9b02a1-4bbc-4324-b424-14b2d16b7ec7 req-ac5471b8-1410-49da-84aa-f2924b88a623 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102956 Aug 27 02:52:03.494667 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1223/2429] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:52:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:52:03.504399 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-00010bef-b0ba-46e5-98b9-91644c1b84b9 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:03.506209 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-00010bef-b0ba-46e5-98b9-91644c1b84b9 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: a5ea93e6-d2ab-4be4-89b6-7b2fd77e8474] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:03.605295 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-2c303186-ecde-4e1a-b13c-e3cea3ef8e7c tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "POST /compute/v2.1/servers/457da794-89e7-4b30-95ba-802c95550c7e/action" status: 202 len: 0 microversion: 2.1 time: 0.173615 Aug 27 02:52:03.607118 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1207/2430] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 02:52:03 2022] POST /compute/v2.1/servers/457da794-89e7-4b30-95ba-802c95550c7e/action => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:52:03.618116 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f381146d-0300-497e-9c9f-428a98ec33c9 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:03.623774 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-f381146d-0300-497e-9c9f-428a98ec33c9 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] [instance: 457da794-89e7-4b30-95ba-802c95550c7e] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:03.624416 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-00010bef-b0ba-46e5-98b9-91644c1b84b9 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:03.640563 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f381146d-0300-497e-9c9f-428a98ec33c9 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:03.640821 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-00010bef-b0ba-46e5-98b9-91644c1b84b9 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/a5ea93e6-d2ab-4be4-89b6-7b2fd77e8474" status: 200 len: 1215 microversion: 2.1 time: 0.143488 Aug 27 02:52:03.641926 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f381146d-0300-497e-9c9f-428a98ec33c9 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:03.642979 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f381146d-0300-497e-9c9f-428a98ec33c9 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:03.643345 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1224/2431] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:03 2022] GET /compute/v2.1/servers/a5ea93e6-d2ab-4be4-89b6-7b2fd77e8474 => generated 1215 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:03.644968 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f381146d-0300-497e-9c9f-428a98ec33c9 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:03.646670 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f381146d-0300-497e-9c9f-428a98ec33c9 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:03.647222 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f381146d-0300-497e-9c9f-428a98ec33c9 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:03.673353 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8dd1950f-698d-4865-a7ea-c56e7a9be540 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:03.675642 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-8dd1950f-698d-4865-a7ea-c56e7a9be540 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: a5ea93e6-d2ab-4be4-89b6-7b2fd77e8474] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:03.818983 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-8dd1950f-698d-4865-a7ea-c56e7a9be540 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: a5ea93e6-d2ab-4be4-89b6-7b2fd77e8474] Going to try to terminate instance {{(pid=134052) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:52:04.048334 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-f381146d-0300-497e-9c9f-428a98ec33c9 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f496f24dccea47bd9a5ab532fe45e370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40794f05e8b94a0f8f087a87a58e0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:04.058273 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-f381146d-0300-497e-9c9f-428a98ec33c9 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "GET /compute/v2.1/servers/457da794-89e7-4b30-95ba-802c95550c7e" status: 200 len: 1492 microversion: 2.1 time: 0.446682 Aug 27 02:52:04.063023 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1208/2432] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:03 2022] GET /compute/v2.1/servers/457da794-89e7-4b30-95ba-802c95550c7e => generated 1492 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:04.075372 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-785cb06c-557e-431c-9b1d-36ee8b2771a7 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:04.077130 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-785cb06c-557e-431c-9b1d-36ee8b2771a7 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] [instance: 6ef152e6-ba27-46bd-871a-04d8539b493e] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:04.085815 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-785cb06c-557e-431c-9b1d-36ee8b2771a7 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:04.086571 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-785cb06c-557e-431c-9b1d-36ee8b2771a7 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:04.087197 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-785cb06c-557e-431c-9b1d-36ee8b2771a7 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:04.088159 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-785cb06c-557e-431c-9b1d-36ee8b2771a7 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:04.088949 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-785cb06c-557e-431c-9b1d-36ee8b2771a7 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:04.089594 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-785cb06c-557e-431c-9b1d-36ee8b2771a7 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:04.249978 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.scheduler.client.report [None req-8dd1950f-698d-4865-a7ea-c56e7a9be540 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Deleted allocations for instance a5ea93e6-d2ab-4be4-89b6-7b2fd77e8474 Aug 27 02:52:04.257377 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.compute.api [None req-8dd1950f-698d-4865-a7ea-c56e7a9be540 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: a5ea93e6-d2ab-4be4-89b6-7b2fd77e8474] Instance Mapping does not exist while attempting local delete cleanup. Aug 27 02:52:04.260581 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-8dd1950f-698d-4865-a7ea-c56e7a9be540 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "DELETE /compute/v2.1/servers/a5ea93e6-d2ab-4be4-89b6-7b2fd77e8474" status: 204 len: 0 microversion: 2.1 time: 0.600069 Aug 27 02:52:04.262142 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1225/2433] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:52:03 2022] DELETE /compute/v2.1/servers/a5ea93e6-d2ab-4be4-89b6-7b2fd77e8474 => generated 0 bytes in 603 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 02:52:04.281742 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-51fdc13e-9017-4556-aa77-6d607a3e22eb tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:04.285133 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-51fdc13e-9017-4556-aa77-6d607a3e22eb tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: ba987aee-2707-4d47-aba9-d2803aa70745] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:04.314276 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-51fdc13e-9017-4556-aa77-6d607a3e22eb tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:04.317520 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-51fdc13e-9017-4556-aa77-6d607a3e22eb tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:04.318214 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-51fdc13e-9017-4556-aa77-6d607a3e22eb tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:04.319166 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-51fdc13e-9017-4556-aa77-6d607a3e22eb tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:04.321274 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-51fdc13e-9017-4556-aa77-6d607a3e22eb tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:04.324152 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-51fdc13e-9017-4556-aa77-6d607a3e22eb tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:04.494660 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-785cb06c-557e-431c-9b1d-36ee8b2771a7 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317e74b4bbc4da298a0dcbd78068352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a8810c21784788b4c0ee64dedbaf15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:04.514492 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-785cb06c-557e-431c-9b1d-36ee8b2771a7 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] 10.222.0.70 "GET /compute/v2.1/servers/6ef152e6-ba27-46bd-871a-04d8539b493e" status: 200 len: 1317 microversion: 2.1 time: 0.449764 Aug 27 02:52:04.515434 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1209/2434] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:04 2022] GET /compute/v2.1/servers/6ef152e6-ba27-46bd-871a-04d8539b493e => generated 1317 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:04.526411 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-028852fd-1224-48d6-bf3d-515c940e41d2 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:04.527534 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-028852fd-1224-48d6-bf3d-515c940e41d2 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: a5ea93e6-d2ab-4be4-89b6-7b2fd77e8474] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:04.541581 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-028852fd-1224-48d6-bf3d-515c940e41d2 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] HTTP exception thrown: Instance a5ea93e6-d2ab-4be4-89b6-7b2fd77e8474 could not be found. Aug 27 02:52:04.543849 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-028852fd-1224-48d6-bf3d-515c940e41d2 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Request method failure captured: Aug 27 02:52:04.543849 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/a5ea93e6-d2ab-4be4-89b6-7b2fd77e8474 HTTP/1.1 Aug 27 02:52:04.543849 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:52:04.543849 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:52:04.543849 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:52:04.543849 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:52:04.543849 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:52:04.543849 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:52:04.543849 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:52:04.543849 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:52:04.543849 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYZ0St41cKkzS8_oefTYdmhcUQuTjHJMchuX75Wes8eVywW22WD3_nUDa_aMbIFBVV51GGjDa8GDt8SbwEVTMvQnSuXk6MkeKEfB2NWHjFnNKSNKnT9A2S4P8aN7qYWhUsGxW2ugzvIrMVMPtkn5w90KE7af4tlEcxQ5ERFDVU7f32Y Aug 27 02:52:04.543849 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:52:04.543849 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:52:04.543849 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:52:04.543849 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:52:04.543849 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:52:04.543849 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:52:04.543849 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 840077c9375b4b2a9214cb8dda094cc8 Aug 27 02:52:04.543849 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-DeleteServersTestJSON-725615510 Aug 27 02:52:04.543849 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:52:04.543849 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:52:04.543849 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/840077c9375b4b2a9214cb8dda094cc8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_840077c9375b4b2a9214cb8dda094cc8", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/840077c9375b4b2a9214cb8dda094cc8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/840077c9375b4b2a9214cb8dda094cc8"}]}] Aug 27 02:52:04.543849 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-DeleteServersTestJSON-725615510 Aug 27 02:52:04.543849 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 840077c9375b4b2a9214cb8dda094cc8 Aug 27 02:52:04.543849 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-DeleteServersTestJSON-725615510 Aug 27 02:52:04.543849 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-DeleteServersTestJSON-725615510-project Aug 27 02:52:04.543849 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:52:04.543849 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:52:04.543849 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: dc53b0977c2b4e06b2f290442483913b Aug 27 02:52:04.543849 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-DeleteServersTestJSON-725615510-project Aug 27 02:52:04.543849 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 02:52:04.543849 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance a5ea93e6-d2ab-4be4-89b6-7b2fd77e8474 could not be found. Aug 27 02:52:04.543849 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': 'a5ea93e6-d2ab-4be4-89b6-7b2fd77e8474'} Aug 27 02:52:04.543849 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:52:04.543849 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:52:04.543849 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:52:04.543849 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:52:04.543849 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:52:04.543849 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:52:04.543849 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 02:52:04.543849 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 02:52:04.543849 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5ea93e6-d2ab-4be4-89b6-7b2fd77e8474 could not be found. Aug 27 02:52:04.543849 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:52:04.543849 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:52:04.543849 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:52:04.543849 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:52:04.543849 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:52:04.543849 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:52:04.543849 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:52:04.543849 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:52:04.543849 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:52:04.543849 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:52:04.543849 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:52:04.543849 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:52:04.543849 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:52:04.543849 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:52:04.543849 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:52:04.543849 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:52:04.543849 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5ea93e6-d2ab-4be4-89b6-7b2fd77e8474 could not be found. Aug 27 02:52:04.543849 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:52:04.543849 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:52:04.543849 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:52:04.543849 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:52:04.543849 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:52:04.547720 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:52:04.547720 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:52:04.547720 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:52:04.547720 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5ea93e6-d2ab-4be4-89b6-7b2fd77e8474 could not be found. Aug 27 02:52:04.547720 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:52:04.554880 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-028852fd-1224-48d6-bf3d-515c940e41d2 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Returning 404 to user: Instance a5ea93e6-d2ab-4be4-89b6-7b2fd77e8474 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:52:04.557417 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-028852fd-1224-48d6-bf3d-515c940e41d2 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/a5ea93e6-d2ab-4be4-89b6-7b2fd77e8474" status: 404 len: 111 microversion: 2.1 time: 0.040953 Aug 27 02:52:04.560666 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1210/2435] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:04 2022] GET /compute/v2.1/servers/a5ea93e6-d2ab-4be4-89b6-7b2fd77e8474 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:52:04.568673 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-51fdc13e-9017-4556-aa77-6d607a3e22eb tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:04.578260 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-51fdc13e-9017-4556-aa77-6d607a3e22eb tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/ba987aee-2707-4d47-aba9-d2803aa70745" status: 200 len: 1312 microversion: 2.1 time: 0.311236 Aug 27 02:52:04.585898 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1226/2436] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:04 2022] GET /compute/v2.1/servers/ba987aee-2707-4d47-aba9-d2803aa70745 => generated 1312 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:04.710936 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a70b4071-4711-4c6c-a126-0c80db185b76 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1136694675", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "networks": [{"uuid": "9f81fa4d-d0d4-411f-b6ce-c99b22cb14d3"}]}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:52:04.786773 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.network.neutron [None req-a70b4071-4711-4c6c-a126-0c80db185b76 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] validate_networks() for [('9f81fa4d-d0d4-411f-b6ce-c99b22cb14d3', None, None, None, None, None)] {{(pid=134051) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:52:05.088224 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-880d6b59-106e-4c85-86ca-3d7e09d48f4d tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:05.089844 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-880d6b59-106e-4c85-86ca-3d7e09d48f4d tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] [instance: 457da794-89e7-4b30-95ba-802c95550c7e] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:05.105182 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-880d6b59-106e-4c85-86ca-3d7e09d48f4d tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:05.109503 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-880d6b59-106e-4c85-86ca-3d7e09d48f4d tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:05.110347 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-880d6b59-106e-4c85-86ca-3d7e09d48f4d tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:05.112767 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-880d6b59-106e-4c85-86ca-3d7e09d48f4d tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:05.115772 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-880d6b59-106e-4c85-86ca-3d7e09d48f4d tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:05.116918 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-880d6b59-106e-4c85-86ca-3d7e09d48f4d tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:05.377676 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-880d6b59-106e-4c85-86ca-3d7e09d48f4d tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f496f24dccea47bd9a5ab532fe45e370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40794f05e8b94a0f8f087a87a58e0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:05.388000 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-880d6b59-106e-4c85-86ca-3d7e09d48f4d tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "GET /compute/v2.1/servers/457da794-89e7-4b30-95ba-802c95550c7e" status: 200 len: 1472 microversion: 2.1 time: 0.304984 Aug 27 02:52:05.397899 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1227/2437] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:05 2022] GET /compute/v2.1/servers/457da794-89e7-4b30-95ba-802c95550c7e => generated 1472 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:05.421746 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-30ffab7b-f397-4757-a41b-c1c39745fc09 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-411828744"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:52:05.425008 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-30ffab7b-f397-4757-a41b-c1c39745fc09 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] [instance: 457da794-89e7-4b30-95ba-802c95550c7e] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:05.445970 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-30ffab7b-f397-4757-a41b-c1c39745fc09 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:05.445970 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-30ffab7b-f397-4757-a41b-c1c39745fc09 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:05.446299 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-30ffab7b-f397-4757-a41b-c1c39745fc09 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:05.451446 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-30ffab7b-f397-4757-a41b-c1c39745fc09 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:05.454026 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-30ffab7b-f397-4757-a41b-c1c39745fc09 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:05.459006 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-30ffab7b-f397-4757-a41b-c1c39745fc09 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:05.668421 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-a70b4071-4711-4c6c-a126-0c80db185b76 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Flavor limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:52:05.669320 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-a70b4071-4711-4c6c-a126-0c80db185b76 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Image limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:52:05.669955 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-a70b4071-4711-4c6c-a126-0c80db185b76 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Flavor pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:52:05.670513 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-a70b4071-4711-4c6c-a126-0c80db185b76 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Image pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:52:05.671204 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-a70b4071-4711-4c6c-a126-0c80db185b76 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:52:05.690919 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a70b4071-4711-4c6c-a126-0c80db185b76 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:05.691669 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a70b4071-4711-4c6c-a126-0c80db185b76 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:05.693755 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a70b4071-4711-4c6c-a126-0c80db185b76 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:05.694700 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a70b4071-4711-4c6c-a126-0c80db185b76 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:05.697113 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a70b4071-4711-4c6c-a126-0c80db185b76 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:05.697758 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a70b4071-4711-4c6c-a126-0c80db185b76 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:05.740965 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-a70b4071-4711-4c6c-a126-0c80db185b76 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Getting quotas for project 840077c9375b4b2a9214cb8dda094cc8. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:52:05.763031 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-a70b4071-4711-4c6c-a126-0c80db185b76 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Getting quotas for user dc53b0977c2b4e06b2f290442483913b and project 840077c9375b4b2a9214cb8dda094cc8. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:52:05.801607 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-a70b4071-4711-4c6c-a126-0c80db185b76 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Going to run 1 instances... {{(pid=134051) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:52:05.805061 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-a70b4071-4711-4c6c-a126-0c80db185b76 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: a59ed991-1ea2-45a0-8c0a-6e241c337a4b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134051) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:52:05.828002 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-30ffab7b-f397-4757-a41b-c1c39745fc09 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "POST /compute/v2.1/servers/457da794-89e7-4b30-95ba-802c95550c7e/action" status: 202 len: 0 microversion: 2.1 time: 0.410189 Aug 27 02:52:05.829345 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1228/2438] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 02:52:05 2022] POST /compute/v2.1/servers/457da794-89e7-4b30-95ba-802c95550c7e/action => generated 0 bytes in 413 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Aug 27 02:52:05.853433 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a4b74f59-49c0-4a51-b3df-dcc2d0b903a8 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:05.855379 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a4b74f59-49c0-4a51-b3df-dcc2d0b903a8 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] [instance: 6ef152e6-ba27-46bd-871a-04d8539b493e] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:05.873245 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a4b74f59-49c0-4a51-b3df-dcc2d0b903a8 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:05.875215 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a4b74f59-49c0-4a51-b3df-dcc2d0b903a8 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:05.875882 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a4b74f59-49c0-4a51-b3df-dcc2d0b903a8 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:05.877981 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a4b74f59-49c0-4a51-b3df-dcc2d0b903a8 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:05.880117 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a4b74f59-49c0-4a51-b3df-dcc2d0b903a8 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:05.881444 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a4b74f59-49c0-4a51-b3df-dcc2d0b903a8 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:05.937554 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a70b4071-4711-4c6c-a126-0c80db185b76 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.230591 Aug 27 02:52:05.938209 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1211/2439] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 02:52:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1232 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:52:05.953018 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-90e477be-d175-4ca7-bfe2-e6214e4f4cc1 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:05.954860 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-90e477be-d175-4ca7-bfe2-e6214e4f4cc1 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: ba987aee-2707-4d47-aba9-d2803aa70745] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:05.973634 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-90e477be-d175-4ca7-bfe2-e6214e4f4cc1 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:05.974679 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-90e477be-d175-4ca7-bfe2-e6214e4f4cc1 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:05.976548 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-90e477be-d175-4ca7-bfe2-e6214e4f4cc1 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:05.978171 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-90e477be-d175-4ca7-bfe2-e6214e4f4cc1 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:05.991243 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-90e477be-d175-4ca7-bfe2-e6214e4f4cc1 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:05.992123 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-90e477be-d175-4ca7-bfe2-e6214e4f4cc1 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:06.606512 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-a4b74f59-49c0-4a51-b3df-dcc2d0b903a8 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317e74b4bbc4da298a0dcbd78068352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a8810c21784788b4c0ee64dedbaf15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:06.622263 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a4b74f59-49c0-4a51-b3df-dcc2d0b903a8 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] 10.222.0.70 "GET /compute/v2.1/servers/6ef152e6-ba27-46bd-871a-04d8539b493e" status: 200 len: 1506 microversion: 2.1 time: 0.784485 Aug 27 02:52:06.622977 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1229/2440] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:05 2022] GET /compute/v2.1/servers/6ef152e6-ba27-46bd-871a-04d8539b493e => generated 1506 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:06.654968 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-776f5d81-4b95-486c-8879-4626e28b5012 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '.version_select at 0x7f5ee2e44dc0>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:06.737058 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-90e477be-d175-4ca7-bfe2-e6214e4f4cc1 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:06.753769 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-776f5d81-4b95-486c-8879-4626e28b5012 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "GET /compute/v2.1/images/fc902f34-89f1-4a0a-af61-22568052f001" status: 200 len: 1411 microversion: 2.1 time: 0.109219 Aug 27 02:52:06.761001 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1230/2441] 10.222.0.70 () {58 vars in 1233 bytes} [Sat Aug 27 02:52:06 2022] GET /compute/v2.1/images/fc902f34-89f1-4a0a-af61-22568052f001 => generated 1411 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:06.761001 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4fc79c93-e316-4236-856e-32fbdd7c85ef tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:06.761001 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-4fc79c93-e316-4236-856e-32fbdd7c85ef tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: a59ed991-1ea2-45a0-8c0a-6e241c337a4b] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:06.763724 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-90e477be-d175-4ca7-bfe2-e6214e4f4cc1 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/ba987aee-2707-4d47-aba9-d2803aa70745" status: 200 len: 1312 microversion: 2.1 time: 0.818953 Aug 27 02:52:06.777002 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1212/2442] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:05 2022] GET /compute/v2.1/servers/ba987aee-2707-4d47-aba9-d2803aa70745 => generated 1312 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:06.786928 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a03a2889-f2b5-4abf-9f1f-6987d48556ef tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:06.787553 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-a03a2889-f2b5-4abf-9f1f-6987d48556ef tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] [instance: 6ef152e6-ba27-46bd-871a-04d8539b493e] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:06.804850 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a03a2889-f2b5-4abf-9f1f-6987d48556ef tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:06.806924 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a03a2889-f2b5-4abf-9f1f-6987d48556ef tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:06.809293 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a03a2889-f2b5-4abf-9f1f-6987d48556ef tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:06.810465 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a03a2889-f2b5-4abf-9f1f-6987d48556ef tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:06.814087 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a03a2889-f2b5-4abf-9f1f-6987d48556ef tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:06.814532 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a03a2889-f2b5-4abf-9f1f-6987d48556ef tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:06.969283 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-4fc79c93-e316-4236-856e-32fbdd7c85ef tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:06.996694 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-4fc79c93-e316-4236-856e-32fbdd7c85ef tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/a59ed991-1ea2-45a0-8c0a-6e241c337a4b" status: 200 len: 1215 microversion: 2.1 time: 0.239071 Aug 27 02:52:06.999490 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1231/2443] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:06 2022] GET /compute/v2.1/servers/a59ed991-1ea2-45a0-8c0a-6e241c337a4b => generated 1215 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:07.250588 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-a03a2889-f2b5-4abf-9f1f-6987d48556ef tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317e74b4bbc4da298a0dcbd78068352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a8810c21784788b4c0ee64dedbaf15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:07.261325 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a03a2889-f2b5-4abf-9f1f-6987d48556ef tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] 10.222.0.70 "GET /compute/v2.1/servers/6ef152e6-ba27-46bd-871a-04d8539b493e" status: 200 len: 1506 microversion: 2.1 time: 0.483012 Aug 27 02:52:07.262428 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1213/2444] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:06 2022] GET /compute/v2.1/servers/6ef152e6-ba27-46bd-871a-04d8539b493e => generated 1506 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:07.288709 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0f38efc8-ba11-455f-a98e-1154da4233a0 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "OS-DCF:diskConfig": "AUTO"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:52:07.292004 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-0f38efc8-ba11-455f-a98e-1154da4233a0 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] [instance: 6ef152e6-ba27-46bd-871a-04d8539b493e] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:07.310794 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0f38efc8-ba11-455f-a98e-1154da4233a0 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:07.311367 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0f38efc8-ba11-455f-a98e-1154da4233a0 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:07.312240 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0f38efc8-ba11-455f-a98e-1154da4233a0 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:07.315065 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0f38efc8-ba11-455f-a98e-1154da4233a0 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:07.315562 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0f38efc8-ba11-455f-a98e-1154da4233a0 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:07.317135 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0f38efc8-ba11-455f-a98e-1154da4233a0 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:07.490677 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-0f38efc8-ba11-455f-a98e-1154da4233a0 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Flavor limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:52:07.491191 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-0f38efc8-ba11-455f-a98e-1154da4233a0 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Image limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:52:07.496027 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-0f38efc8-ba11-455f-a98e-1154da4233a0 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Flavor pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:52:07.497969 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-0f38efc8-ba11-455f-a98e-1154da4233a0 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Image pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:52:07.499342 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-0f38efc8-ba11-455f-a98e-1154da4233a0 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:52:07.526725 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-7257d63a-bdd1-4488-90fa-0ec4d9995e2c req-7aa323b5-8738-4e5f-899f-0e7671157223 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba987aee-2707-4d47-aba9-d2803aa70745", "name": "network-vif-plugged", "status": "completed", "tag": "0871e4ff-ef2c-4a64-a799-ecfb74bf8dfa"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:52:07.540044 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-7257d63a-bdd1-4488-90fa-0ec4d9995e2c req-7aa323b5-8738-4e5f-899f-0e7671157223 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:07.546383 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-7257d63a-bdd1-4488-90fa-0ec4d9995e2c req-7aa323b5-8738-4e5f-899f-0e7671157223 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:07.547746 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-7257d63a-bdd1-4488-90fa-0ec4d9995e2c req-7aa323b5-8738-4e5f-899f-0e7671157223 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:07.570166 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-7257d63a-bdd1-4488-90fa-0ec4d9995e2c req-7aa323b5-8738-4e5f-899f-0e7671157223 service nova] Creating event network-vif-plugged:0871e4ff-ef2c-4a64-a799-ecfb74bf8dfa for instance ba987aee-2707-4d47-aba9-d2803aa70745 on n-h1-852278-4 Aug 27 02:52:07.584379 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-7257d63a-bdd1-4488-90fa-0ec4d9995e2c req-7aa323b5-8738-4e5f-899f-0e7671157223 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061074 Aug 27 02:52:07.588764 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1214/2445] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:52:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:52:07.654631 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-0f38efc8-ba11-455f-a98e-1154da4233a0 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] [instance: 6ef152e6-ba27-46bd-871a-04d8539b493e] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:07.677999 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0f38efc8-ba11-455f-a98e-1154da4233a0 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:07.679375 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0f38efc8-ba11-455f-a98e-1154da4233a0 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:07.681679 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0f38efc8-ba11-455f-a98e-1154da4233a0 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:07.682901 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0f38efc8-ba11-455f-a98e-1154da4233a0 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:07.685374 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0f38efc8-ba11-455f-a98e-1154da4233a0 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:07.686702 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0f38efc8-ba11-455f-a98e-1154da4233a0 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:07.732430 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-0f38efc8-ba11-455f-a98e-1154da4233a0 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] 10.222.0.70 "POST /compute/v2.1/servers/6ef152e6-ba27-46bd-871a-04d8539b493e/action" status: 202 len: 1108 microversion: 2.1 time: 0.449708 Aug 27 02:52:07.735629 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1232/2446] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 02:52:07 2022] POST /compute/v2.1/servers/6ef152e6-ba27-46bd-871a-04d8539b493e/action => generated 1108 bytes in 454 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 27 02:52:07.765780 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-23ede944-e5f5-454f-8a0d-dbb4b55be562 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:07.768957 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-23ede944-e5f5-454f-8a0d-dbb4b55be562 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] [instance: 6ef152e6-ba27-46bd-871a-04d8539b493e] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:07.769182 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-7a87cf5d-f092-4934-b6e0-61271d92e818 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '.version_select at 0x7f5ee3371280>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:07.787813 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-23ede944-e5f5-454f-8a0d-dbb4b55be562 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:07.792250 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-23ede944-e5f5-454f-8a0d-dbb4b55be562 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:07.793075 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-23ede944-e5f5-454f-8a0d-dbb4b55be562 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:07.794180 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-23ede944-e5f5-454f-8a0d-dbb4b55be562 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:07.797241 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-23ede944-e5f5-454f-8a0d-dbb4b55be562 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:07.800493 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-23ede944-e5f5-454f-8a0d-dbb4b55be562 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:07.931357 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-7a87cf5d-f092-4934-b6e0-61271d92e818 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "GET /compute/v2.1/images/fc902f34-89f1-4a0a-af61-22568052f001" status: 200 len: 1411 microversion: 2.1 time: 0.167127 Aug 27 02:52:07.952249 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1233/2447] 10.222.0.70 () {58 vars in 1233 bytes} [Sat Aug 27 02:52:07 2022] GET /compute/v2.1/images/fc902f34-89f1-4a0a-af61-22568052f001 => generated 1411 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:52:07.965767 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b3e81c96-7cd0-4b40-9e23-fa09c5c8c4cb tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:07.968002 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b3e81c96-7cd0-4b40-9e23-fa09c5c8c4cb tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: ba987aee-2707-4d47-aba9-d2803aa70745] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:07.988086 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b3e81c96-7cd0-4b40-9e23-fa09c5c8c4cb tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:07.996975 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b3e81c96-7cd0-4b40-9e23-fa09c5c8c4cb tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:07.997535 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b3e81c96-7cd0-4b40-9e23-fa09c5c8c4cb tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:07.998298 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b3e81c96-7cd0-4b40-9e23-fa09c5c8c4cb tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:07.998785 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b3e81c96-7cd0-4b40-9e23-fa09c5c8c4cb tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:08.002633 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b3e81c96-7cd0-4b40-9e23-fa09c5c8c4cb tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:08.123099 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-23ede944-e5f5-454f-8a0d-dbb4b55be562 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317e74b4bbc4da298a0dcbd78068352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a8810c21784788b4c0ee64dedbaf15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:08.132056 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-23ede944-e5f5-454f-8a0d-dbb4b55be562 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] 10.222.0.70 "GET /compute/v2.1/servers/6ef152e6-ba27-46bd-871a-04d8539b493e" status: 200 len: 1513 microversion: 2.1 time: 0.378206 Aug 27 02:52:08.142204 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1215/2448] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:07 2022] GET /compute/v2.1/servers/6ef152e6-ba27-46bd-871a-04d8539b493e => generated 1513 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:08.151248 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-dbe367ef-a240-4617-b7c0-211b5d7edc66 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:08.154162 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-dbe367ef-a240-4617-b7c0-211b5d7edc66 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: a59ed991-1ea2-45a0-8c0a-6e241c337a4b] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:08.175427 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dbe367ef-a240-4617-b7c0-211b5d7edc66 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:08.184148 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dbe367ef-a240-4617-b7c0-211b5d7edc66 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:08.185074 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dbe367ef-a240-4617-b7c0-211b5d7edc66 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:08.186025 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dbe367ef-a240-4617-b7c0-211b5d7edc66 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:08.188863 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dbe367ef-a240-4617-b7c0-211b5d7edc66 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:08.191462 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dbe367ef-a240-4617-b7c0-211b5d7edc66 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:08.522665 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-dbe367ef-a240-4617-b7c0-211b5d7edc66 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:08.538725 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-dbe367ef-a240-4617-b7c0-211b5d7edc66 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/a59ed991-1ea2-45a0-8c0a-6e241c337a4b" status: 200 len: 1275 microversion: 2.1 time: 0.395291 Aug 27 02:52:08.556456 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1216/2449] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:08 2022] GET /compute/v2.1/servers/a59ed991-1ea2-45a0-8c0a-6e241c337a4b => generated 1275 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:08.713875 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b3e81c96-7cd0-4b40-9e23-fa09c5c8c4cb tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:08.725526 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b3e81c96-7cd0-4b40-9e23-fa09c5c8c4cb tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/ba987aee-2707-4d47-aba9-d2803aa70745" status: 200 len: 1312 microversion: 2.1 time: 0.770301 Aug 27 02:52:08.731744 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1234/2450] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:07 2022] GET /compute/v2.1/servers/ba987aee-2707-4d47-aba9-d2803aa70745 => generated 1312 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:08.946568 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-03971217-fe91-49e0-938e-ef98152d735b tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '.version_select at 0x7f5ede8f8f70>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:09.091019 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-03971217-fe91-49e0-938e-ef98152d735b tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "GET /compute/v2.1/images/fc902f34-89f1-4a0a-af61-22568052f001" status: 200 len: 1411 microversion: 2.1 time: 0.141401 Aug 27 02:52:09.107952 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1217/2451] 10.222.0.70 () {58 vars in 1233 bytes} [Sat Aug 27 02:52:08 2022] GET /compute/v2.1/images/fc902f34-89f1-4a0a-af61-22568052f001 => generated 1411 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:09.162358 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f0eceb27-1f00-4c3a-ba58-96c51e0e05ae tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:09.163191 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-f0eceb27-1f00-4c3a-ba58-96c51e0e05ae tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] [instance: 6ef152e6-ba27-46bd-871a-04d8539b493e] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:09.171826 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f0eceb27-1f00-4c3a-ba58-96c51e0e05ae tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:09.174372 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f0eceb27-1f00-4c3a-ba58-96c51e0e05ae tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:09.174920 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f0eceb27-1f00-4c3a-ba58-96c51e0e05ae tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:09.176392 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f0eceb27-1f00-4c3a-ba58-96c51e0e05ae tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:09.178359 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f0eceb27-1f00-4c3a-ba58-96c51e0e05ae tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:09.180378 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f0eceb27-1f00-4c3a-ba58-96c51e0e05ae tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:09.197410 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:52:09.565484 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-525aad0e-9952-4002-8272-b6977ed71222 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:09.566649 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-525aad0e-9952-4002-8272-b6977ed71222 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: a59ed991-1ea2-45a0-8c0a-6e241c337a4b] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:09.598729 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-525aad0e-9952-4002-8272-b6977ed71222 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:09.601630 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-525aad0e-9952-4002-8272-b6977ed71222 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:09.602116 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-525aad0e-9952-4002-8272-b6977ed71222 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:09.604280 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-525aad0e-9952-4002-8272-b6977ed71222 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:09.606716 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-525aad0e-9952-4002-8272-b6977ed71222 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:09.607256 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-525aad0e-9952-4002-8272-b6977ed71222 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:09.885348 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-f0eceb27-1f00-4c3a-ba58-96c51e0e05ae tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317e74b4bbc4da298a0dcbd78068352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a8810c21784788b4c0ee64dedbaf15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:09.896067 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f0eceb27-1f00-4c3a-ba58-96c51e0e05ae tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] 10.222.0.70 "GET /compute/v2.1/servers/6ef152e6-ba27-46bd-871a-04d8539b493e" status: 200 len: 1513 microversion: 2.1 time: 0.738617 Aug 27 02:52:09.907157 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1235/2452] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:09 2022] GET /compute/v2.1/servers/6ef152e6-ba27-46bd-871a-04d8539b493e => generated 1513 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:09.921099 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-26830ddb-9f60-4770-a1c3-7dd4ca422bb7 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:09.921726 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-26830ddb-9f60-4770-a1c3-7dd4ca422bb7 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: ba987aee-2707-4d47-aba9-d2803aa70745] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:09.926265 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-525aad0e-9952-4002-8272-b6977ed71222 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:09.945570 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-26830ddb-9f60-4770-a1c3-7dd4ca422bb7 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:09.946503 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-26830ddb-9f60-4770-a1c3-7dd4ca422bb7 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:09.947598 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-26830ddb-9f60-4770-a1c3-7dd4ca422bb7 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:09.948667 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-26830ddb-9f60-4770-a1c3-7dd4ca422bb7 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:09.950766 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-26830ddb-9f60-4770-a1c3-7dd4ca422bb7 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:09.951241 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-26830ddb-9f60-4770-a1c3-7dd4ca422bb7 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:09.954491 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-525aad0e-9952-4002-8272-b6977ed71222 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/a59ed991-1ea2-45a0-8c0a-6e241c337a4b" status: 200 len: 1273 microversion: 2.1 time: 0.387586 Aug 27 02:52:09.955776 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1218/2453] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:09 2022] GET /compute/v2.1/servers/a59ed991-1ea2-45a0-8c0a-6e241c337a4b => generated 1273 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:52:10.110448 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c9530f89-7549-4dbd-862d-db06847ba888 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '.version_select at 0x7f5ee71c49d0>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:10.494184 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c9530f89-7549-4dbd-862d-db06847ba888 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "GET /compute/v2.1/images/fc902f34-89f1-4a0a-af61-22568052f001" status: 200 len: 1411 microversion: 2.1 time: 0.390250 Aug 27 02:52:10.509558 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1219/2454] 10.222.0.70 () {58 vars in 1233 bytes} [Sat Aug 27 02:52:10 2022] GET /compute/v2.1/images/fc902f34-89f1-4a0a-af61-22568052f001 => generated 1411 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:10.668132 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-26830ddb-9f60-4770-a1c3-7dd4ca422bb7 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:10.689285 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-26830ddb-9f60-4770-a1c3-7dd4ca422bb7 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/ba987aee-2707-4d47-aba9-d2803aa70745" status: 200 len: 1462 microversion: 2.1 time: 0.778435 Aug 27 02:52:10.710682 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1236/2455] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:09 2022] GET /compute/v2.1/servers/ba987aee-2707-4d47-aba9-d2803aa70745 => generated 1462 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:10.715078 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-1a15e020-61dd-40c0-bd8c-5c1aa8d07dc9 tempest-MigrationsAdminTest-1330282624 tempest-MigrationsAdminTest-1330282624-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:10.715681 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-1a15e020-61dd-40c0-bd8c-5c1aa8d07dc9 tempest-MigrationsAdminTest-1330282624 tempest-MigrationsAdminTest-1330282624-project-admin] [instance: ba987aee-2707-4d47-aba9-d2803aa70745] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:10.730797 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1a15e020-61dd-40c0-bd8c-5c1aa8d07dc9 tempest-MigrationsAdminTest-1330282624 tempest-MigrationsAdminTest-1330282624-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:10.731894 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1a15e020-61dd-40c0-bd8c-5c1aa8d07dc9 tempest-MigrationsAdminTest-1330282624 tempest-MigrationsAdminTest-1330282624-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:10.733201 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1a15e020-61dd-40c0-bd8c-5c1aa8d07dc9 tempest-MigrationsAdminTest-1330282624 tempest-MigrationsAdminTest-1330282624-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:10.738180 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1a15e020-61dd-40c0-bd8c-5c1aa8d07dc9 tempest-MigrationsAdminTest-1330282624 tempest-MigrationsAdminTest-1330282624-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:10.740854 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1a15e020-61dd-40c0-bd8c-5c1aa8d07dc9 tempest-MigrationsAdminTest-1330282624 tempest-MigrationsAdminTest-1330282624-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:10.744097 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1a15e020-61dd-40c0-bd8c-5c1aa8d07dc9 tempest-MigrationsAdminTest-1330282624 tempest-MigrationsAdminTest-1330282624-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:10.937908 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0c58756f-ac3d-4bc0-95ed-f7214224bbc6 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:10.941885 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-0c58756f-ac3d-4bc0-95ed-f7214224bbc6 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] [instance: 6ef152e6-ba27-46bd-871a-04d8539b493e] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:10.971692 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0c58756f-ac3d-4bc0-95ed-f7214224bbc6 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:10.982233 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0c58756f-ac3d-4bc0-95ed-f7214224bbc6 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:10.984599 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0c58756f-ac3d-4bc0-95ed-f7214224bbc6 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:11.004742 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0c58756f-ac3d-4bc0-95ed-f7214224bbc6 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:11.007047 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0c58756f-ac3d-4bc0-95ed-f7214224bbc6 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:11.010263 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0c58756f-ac3d-4bc0-95ed-f7214224bbc6 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:11.146946 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-1a15e020-61dd-40c0-bd8c-5c1aa8d07dc9 tempest-MigrationsAdminTest-1330282624 tempest-MigrationsAdminTest-1330282624-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/ba987aee-2707-4d47-aba9-d2803aa70745" status: 200 len: 1613 microversion: 2.1 time: 0.432575 Aug 27 02:52:11.161506 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1220/2456] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:10 2022] GET /compute/v2.1/servers/ba987aee-2707-4d47-aba9-d2803aa70745 => generated 1613 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:52:11.161506 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-5578486c-09dd-4196-8aba-77fcff3d3ac8 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:11.161506 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-5578486c-09dd-4196-8aba-77fcff3d3ac8 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: a59ed991-1ea2-45a0-8c0a-6e241c337a4b] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:11.175635 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5578486c-09dd-4196-8aba-77fcff3d3ac8 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:11.176330 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5578486c-09dd-4196-8aba-77fcff3d3ac8 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:11.176878 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5578486c-09dd-4196-8aba-77fcff3d3ac8 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:11.177938 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5578486c-09dd-4196-8aba-77fcff3d3ac8 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:11.180783 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5578486c-09dd-4196-8aba-77fcff3d3ac8 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:11.181455 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5578486c-09dd-4196-8aba-77fcff3d3ac8 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:11.582193 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:52:12.065882 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0c58756f-ac3d-4bc0-95ed-f7214224bbc6 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317e74b4bbc4da298a0dcbd78068352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a8810c21784788b4c0ee64dedbaf15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:12.081103 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-0c58756f-ac3d-4bc0-95ed-f7214224bbc6 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] 10.222.0.70 "GET /compute/v2.1/servers/6ef152e6-ba27-46bd-871a-04d8539b493e" status: 200 len: 1513 microversion: 2.1 time: 1.149376 Aug 27 02:52:12.085405 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1237/2457] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:10 2022] GET /compute/v2.1/servers/6ef152e6-ba27-46bd-871a-04d8539b493e => generated 1513 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:52:12.099408 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d8a6024a-e597-4602-979d-375106bdb4c8 tempest-MigrationsAdminTest-1330282624 tempest-MigrationsAdminTest-1330282624-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:52:12.110316 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d8a6024a-e597-4602-979d-375106bdb4c8 tempest-MigrationsAdminTest-1330282624 tempest-MigrationsAdminTest-1330282624-project-admin] [instance: ba987aee-2707-4d47-aba9-d2803aa70745] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:12.125130 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d8a6024a-e597-4602-979d-375106bdb4c8 tempest-MigrationsAdminTest-1330282624 tempest-MigrationsAdminTest-1330282624-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:12.127976 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d8a6024a-e597-4602-979d-375106bdb4c8 tempest-MigrationsAdminTest-1330282624 tempest-MigrationsAdminTest-1330282624-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:12.129044 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d8a6024a-e597-4602-979d-375106bdb4c8 tempest-MigrationsAdminTest-1330282624 tempest-MigrationsAdminTest-1330282624-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:12.130578 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d8a6024a-e597-4602-979d-375106bdb4c8 tempest-MigrationsAdminTest-1330282624 tempest-MigrationsAdminTest-1330282624-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:12.133955 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d8a6024a-e597-4602-979d-375106bdb4c8 tempest-MigrationsAdminTest-1330282624 tempest-MigrationsAdminTest-1330282624-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:12.134561 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d8a6024a-e597-4602-979d-375106bdb4c8 tempest-MigrationsAdminTest-1330282624 tempest-MigrationsAdminTest-1330282624-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:12.324822 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-d8a6024a-e597-4602-979d-375106bdb4c8 tempest-MigrationsAdminTest-1330282624 tempest-MigrationsAdminTest-1330282624-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'aea269bcf7b8490088323b61dcfa2393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06bfee67ab6483d8b12ec11c3c51dde', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:12.325755 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d8a6024a-e597-4602-979d-375106bdb4c8 tempest-MigrationsAdminTest-1330282624 tempest-MigrationsAdminTest-1330282624-project-admin] [instance: ba987aee-2707-4d47-aba9-d2803aa70745] flavor_id is None. Assuming migration. {{(pid=134052) resize /opt/stack/nova/nova/compute/api.py:4194}} Aug 27 02:52:12.326351 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d8a6024a-e597-4602-979d-375106bdb4c8 tempest-MigrationsAdminTest-1330282624 tempest-MigrationsAdminTest-1330282624-project-admin] [instance: ba987aee-2707-4d47-aba9-d2803aa70745] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=134052) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 27 02:52:12.379711 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-5578486c-09dd-4196-8aba-77fcff3d3ac8 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:12.388727 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-5578486c-09dd-4196-8aba-77fcff3d3ac8 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/a59ed991-1ea2-45a0-8c0a-6e241c337a4b" status: 200 len: 1315 microversion: 2.1 time: 1.236867 Aug 27 02:52:12.392034 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1221/2458] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:11 2022] GET /compute/v2.1/servers/a59ed991-1ea2-45a0-8c0a-6e241c337a4b => generated 1315 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:12.397185 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-dadf7b71-e53b-4681-a674-4777efe5c113 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '.version_select at 0x7f5ede8f70d0>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:12.858230 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d8a6024a-e597-4602-979d-375106bdb4c8 tempest-MigrationsAdminTest-1330282624 tempest-MigrationsAdminTest-1330282624-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/ba987aee-2707-4d47-aba9-d2803aa70745/action" status: 202 len: 0 microversion: 2.1 time: 0.771355 Aug 27 02:52:12.862011 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1238/2459] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 02:52:12 2022] POST /compute/v2.1/servers/ba987aee-2707-4d47-aba9-d2803aa70745/action => generated 0 bytes in 773 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:52:12.870800 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-9d698327-8b7e-499e-bb73-5cbacd4a35f3 req-0173231b-d0a2-41f0-9b48-ae24723d23c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "457da794-89e7-4b30-95ba-802c95550c7e", "name": "network-vif-plugged", "status": "completed", "tag": "27be2c6c-8615-4a7c-96a7-71c5111896a7"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:52:12.898211 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-9d698327-8b7e-499e-bb73-5cbacd4a35f3 req-0173231b-d0a2-41f0-9b48-ae24723d23c7 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:12.909950 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-9d698327-8b7e-499e-bb73-5cbacd4a35f3 req-0173231b-d0a2-41f0-9b48-ae24723d23c7 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:12.910513 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-9d698327-8b7e-499e-bb73-5cbacd4a35f3 req-0173231b-d0a2-41f0-9b48-ae24723d23c7 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:12.960170 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-9d698327-8b7e-499e-bb73-5cbacd4a35f3 req-0173231b-d0a2-41f0-9b48-ae24723d23c7 service nova] Creating event network-vif-plugged:27be2c6c-8615-4a7c-96a7-71c5111896a7 for instance 457da794-89e7-4b30-95ba-802c95550c7e on n-h2-852278-4 Aug 27 02:52:12.977380 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-9d698327-8b7e-499e-bb73-5cbacd4a35f3 req-0173231b-d0a2-41f0-9b48-ae24723d23c7 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116786 Aug 27 02:52:12.978683 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1239/2460] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:52:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:52:13.008517 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-bfe2ae17-bc18-4b38-b345-3d3a42dd6c64 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:13.009595 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-bfe2ae17-bc18-4b38-b345-3d3a42dd6c64 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: ba987aee-2707-4d47-aba9-d2803aa70745] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:13.019099 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=1,nova_api:DELETE=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:52:13.021217 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bfe2ae17-bc18-4b38-b345-3d3a42dd6c64 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:13.029256 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bfe2ae17-bc18-4b38-b345-3d3a42dd6c64 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:13.030090 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bfe2ae17-bc18-4b38-b345-3d3a42dd6c64 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:13.031088 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bfe2ae17-bc18-4b38-b345-3d3a42dd6c64 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:13.032149 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bfe2ae17-bc18-4b38-b345-3d3a42dd6c64 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:13.032862 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bfe2ae17-bc18-4b38-b345-3d3a42dd6c64 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:13.636653 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-bfe2ae17-bc18-4b38-b345-3d3a42dd6c64 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:13.655857 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-bfe2ae17-bc18-4b38-b345-3d3a42dd6c64 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/ba987aee-2707-4d47-aba9-d2803aa70745" status: 200 len: 1471 microversion: 2.1 time: 0.653953 Aug 27 02:52:13.659221 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1240/2461] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:12 2022] GET /compute/v2.1/servers/ba987aee-2707-4d47-aba9-d2803aa70745 => generated 1471 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:13.675092 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-03107fa7-515c-4a73-b7de-4867dee66df4 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:13.676015 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-03107fa7-515c-4a73-b7de-4867dee66df4 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] [instance: 6ef152e6-ba27-46bd-871a-04d8539b493e] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:13.694732 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-03107fa7-515c-4a73-b7de-4867dee66df4 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:13.700972 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-03107fa7-515c-4a73-b7de-4867dee66df4 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:13.701754 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-03107fa7-515c-4a73-b7de-4867dee66df4 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:13.702661 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-03107fa7-515c-4a73-b7de-4867dee66df4 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:13.703413 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-03107fa7-515c-4a73-b7de-4867dee66df4 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:13.705193 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-03107fa7-515c-4a73-b7de-4867dee66df4 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:14.361963 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-03107fa7-515c-4a73-b7de-4867dee66df4 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317e74b4bbc4da298a0dcbd78068352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a8810c21784788b4c0ee64dedbaf15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:14.383409 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-03107fa7-515c-4a73-b7de-4867dee66df4 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] 10.222.0.70 "GET /compute/v2.1/servers/6ef152e6-ba27-46bd-871a-04d8539b493e" status: 200 len: 1513 microversion: 2.1 time: 0.716359 Aug 27 02:52:14.386001 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1241/2462] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:13 2022] GET /compute/v2.1/servers/6ef152e6-ba27-46bd-871a-04d8539b493e => generated 1513 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:14.400958 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-996dcce5-dfcf-4255-99ef-9cf46238953e tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:14.402610 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-996dcce5-dfcf-4255-99ef-9cf46238953e tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: a59ed991-1ea2-45a0-8c0a-6e241c337a4b] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:14.440682 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-996dcce5-dfcf-4255-99ef-9cf46238953e tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:14.449485 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-996dcce5-dfcf-4255-99ef-9cf46238953e tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:14.450790 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-996dcce5-dfcf-4255-99ef-9cf46238953e tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:14.452849 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-996dcce5-dfcf-4255-99ef-9cf46238953e tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:14.454496 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-996dcce5-dfcf-4255-99ef-9cf46238953e tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:14.458056 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-996dcce5-dfcf-4255-99ef-9cf46238953e tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:15.725189 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=4 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:52:15.784106 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=33 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:52:15.879040 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-996dcce5-dfcf-4255-99ef-9cf46238953e tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:15.890074 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-996dcce5-dfcf-4255-99ef-9cf46238953e tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/a59ed991-1ea2-45a0-8c0a-6e241c337a4b" status: 200 len: 1315 microversion: 2.1 time: 1.501220 Aug 27 02:52:15.890986 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1242/2463] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:14 2022] GET /compute/v2.1/servers/a59ed991-1ea2-45a0-8c0a-6e241c337a4b => generated 1315 bytes in 1504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:15.897961 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-3cff6680-324d-4dea-b49c-d9ad33d2b106 req-3d8f8230-f286-4691-b64c-082cdeff3c02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a59ed991-1ea2-45a0-8c0a-6e241c337a4b", "tag": "69e25bdc-655b-4fba-befe-c9cbeb891a75"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:52:15.911071 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-3cff6680-324d-4dea-b49c-d9ad33d2b106 req-3d8f8230-f286-4691-b64c-082cdeff3c02 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:15.911549 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-3cff6680-324d-4dea-b49c-d9ad33d2b106 req-3d8f8230-f286-4691-b64c-082cdeff3c02 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:15.912409 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-3cff6680-324d-4dea-b49c-d9ad33d2b106 req-3d8f8230-f286-4691-b64c-082cdeff3c02 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:15.943769 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-3cff6680-324d-4dea-b49c-d9ad33d2b106 req-3d8f8230-f286-4691-b64c-082cdeff3c02 service nova] Creating event network-changed:69e25bdc-655b-4fba-befe-c9cbeb891a75 for instance a59ed991-1ea2-45a0-8c0a-6e241c337a4b on n-h2-852278-4 Aug 27 02:52:15.949757 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-3cff6680-324d-4dea-b49c-d9ad33d2b106 req-3d8f8230-f286-4691-b64c-082cdeff3c02 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056276 Aug 27 02:52:15.950695 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1243/2464] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:52:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:52:15.965029 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-19b0063c-28d9-4c6e-943b-e49ed591698f tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:15.965907 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-19b0063c-28d9-4c6e-943b-e49ed591698f tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: ba987aee-2707-4d47-aba9-d2803aa70745] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:15.974014 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-19b0063c-28d9-4c6e-943b-e49ed591698f tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:15.974928 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-19b0063c-28d9-4c6e-943b-e49ed591698f tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:15.975333 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-19b0063c-28d9-4c6e-943b-e49ed591698f tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:15.975672 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-19b0063c-28d9-4c6e-943b-e49ed591698f tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:15.976430 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-19b0063c-28d9-4c6e-943b-e49ed591698f tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:16.000560 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-19b0063c-28d9-4c6e-943b-e49ed591698f tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:16.346910 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-19b0063c-28d9-4c6e-943b-e49ed591698f tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:16.357090 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-19b0063c-28d9-4c6e-943b-e49ed591698f tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/ba987aee-2707-4d47-aba9-d2803aa70745" status: 200 len: 1471 microversion: 2.1 time: 0.405165 Aug 27 02:52:16.362645 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1244/2465] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:15 2022] GET /compute/v2.1/servers/ba987aee-2707-4d47-aba9-d2803aa70745 => generated 1471 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:16.374471 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-cdc16234-4993-47da-bfc7-5b70fb6508d2 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:16.375383 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-cdc16234-4993-47da-bfc7-5b70fb6508d2 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] [instance: 6ef152e6-ba27-46bd-871a-04d8539b493e] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:16.390952 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cdc16234-4993-47da-bfc7-5b70fb6508d2 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:16.391895 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cdc16234-4993-47da-bfc7-5b70fb6508d2 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:16.392919 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cdc16234-4993-47da-bfc7-5b70fb6508d2 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:16.395681 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cdc16234-4993-47da-bfc7-5b70fb6508d2 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:16.397722 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cdc16234-4993-47da-bfc7-5b70fb6508d2 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:16.400386 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cdc16234-4993-47da-bfc7-5b70fb6508d2 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:16.857287 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-cdc16234-4993-47da-bfc7-5b70fb6508d2 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317e74b4bbc4da298a0dcbd78068352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a8810c21784788b4c0ee64dedbaf15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:16.870117 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-cdc16234-4993-47da-bfc7-5b70fb6508d2 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] 10.222.0.70 "GET /compute/v2.1/servers/6ef152e6-ba27-46bd-871a-04d8539b493e" status: 200 len: 1513 microversion: 2.1 time: 0.506247 Aug 27 02:52:16.874143 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1245/2466] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:16 2022] GET /compute/v2.1/servers/6ef152e6-ba27-46bd-871a-04d8539b493e => generated 1513 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:16.915307 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3d9705d0-3e51-404c-ba0c-aecf8f260e53 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:16.918554 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-3d9705d0-3e51-404c-ba0c-aecf8f260e53 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: a59ed991-1ea2-45a0-8c0a-6e241c337a4b] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:16.948232 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3d9705d0-3e51-404c-ba0c-aecf8f260e53 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:16.952697 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3d9705d0-3e51-404c-ba0c-aecf8f260e53 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:16.953223 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3d9705d0-3e51-404c-ba0c-aecf8f260e53 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:16.961305 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3d9705d0-3e51-404c-ba0c-aecf8f260e53 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:16.961818 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3d9705d0-3e51-404c-ba0c-aecf8f260e53 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:16.964559 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3d9705d0-3e51-404c-ba0c-aecf8f260e53 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:17.079194 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=45 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:52:18.189068 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-3d9705d0-3e51-404c-ba0c-aecf8f260e53 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:18.198326 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-3d9705d0-3e51-404c-ba0c-aecf8f260e53 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/a59ed991-1ea2-45a0-8c0a-6e241c337a4b" status: 200 len: 1315 microversion: 2.1 time: 1.287313 Aug 27 02:52:18.200923 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1246/2467] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:16 2022] GET /compute/v2.1/servers/a59ed991-1ea2-45a0-8c0a-6e241c337a4b => generated 1315 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:18.210172 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-01fa2d5d-b6b2-40be-9fb1-edd08e1bf28e tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:18.217408 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-01fa2d5d-b6b2-40be-9fb1-edd08e1bf28e tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: ba987aee-2707-4d47-aba9-d2803aa70745] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:18.248649 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-01fa2d5d-b6b2-40be-9fb1-edd08e1bf28e tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:18.250305 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-01fa2d5d-b6b2-40be-9fb1-edd08e1bf28e tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:18.252444 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-01fa2d5d-b6b2-40be-9fb1-edd08e1bf28e tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:18.255398 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-01fa2d5d-b6b2-40be-9fb1-edd08e1bf28e tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:18.257054 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-01fa2d5d-b6b2-40be-9fb1-edd08e1bf28e tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:18.260287 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-01fa2d5d-b6b2-40be-9fb1-edd08e1bf28e tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:18.579494 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-01fa2d5d-b6b2-40be-9fb1-edd08e1bf28e tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:18.589931 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-01fa2d5d-b6b2-40be-9fb1-edd08e1bf28e tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/ba987aee-2707-4d47-aba9-d2803aa70745" status: 200 len: 1471 microversion: 2.1 time: 0.386372 Aug 27 02:52:18.594008 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1247/2468] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:18 2022] GET /compute/v2.1/servers/ba987aee-2707-4d47-aba9-d2803aa70745 => generated 1471 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:19.163019 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-16b80613-8a6a-4a0b-8e57-95325ab033c2 tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-400227743", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "networks": [{"uuid": "4030f945-18a1-4ee5-bbb0-85a4f35d6c4d"}]}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:52:19.911198 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.network.neutron [None req-16b80613-8a6a-4a0b-8e57-95325ab033c2 tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] validate_networks() for [('4030f945-18a1-4ee5-bbb0-85a4f35d6c4d', None, None, None, None, None)] {{(pid=134052) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:52:19.915960 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-dadf7b71-e53b-4681-a674-4777efe5c113 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "GET /compute/v2.1/images/fc902f34-89f1-4a0a-af61-22568052f001" status: 200 len: 1411 microversion: 2.1 time: 7.521472 Aug 27 02:52:19.927299 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1222/2469] 10.222.0.70 () {58 vars in 1233 bytes} [Sat Aug 27 02:52:12 2022] GET /compute/v2.1/images/fc902f34-89f1-4a0a-af61-22568052f001 => generated 1411 bytes in 7534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:19.946492 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-54c895bd-fbfa-4913-9900-8244ca7d567a tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:19.948075 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-54c895bd-fbfa-4913-9900-8244ca7d567a tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] [instance: 6ef152e6-ba27-46bd-871a-04d8539b493e] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:19.965848 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-54c895bd-fbfa-4913-9900-8244ca7d567a tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:19.966644 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-54c895bd-fbfa-4913-9900-8244ca7d567a tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:19.968299 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-54c895bd-fbfa-4913-9900-8244ca7d567a tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:19.969625 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-54c895bd-fbfa-4913-9900-8244ca7d567a tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:19.970351 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-54c895bd-fbfa-4913-9900-8244ca7d567a tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:19.971808 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-54c895bd-fbfa-4913-9900-8244ca7d567a tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:20.018183 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:52:20.211232 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-54c895bd-fbfa-4913-9900-8244ca7d567a tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317e74b4bbc4da298a0dcbd78068352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a8810c21784788b4c0ee64dedbaf15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:20.221874 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-54c895bd-fbfa-4913-9900-8244ca7d567a tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] 10.222.0.70 "GET /compute/v2.1/servers/6ef152e6-ba27-46bd-871a-04d8539b493e" status: 200 len: 1513 microversion: 2.1 time: 0.293179 Aug 27 02:52:20.222762 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1223/2470] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:19 2022] GET /compute/v2.1/servers/6ef152e6-ba27-46bd-871a-04d8539b493e => generated 1513 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:20.228354 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8bc1b5ec-62a3-47f7-b47d-acdecb47d647 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:20.229359 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-8bc1b5ec-62a3-47f7-b47d-acdecb47d647 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: a59ed991-1ea2-45a0-8c0a-6e241c337a4b] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:20.268029 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8bc1b5ec-62a3-47f7-b47d-acdecb47d647 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:20.280416 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8bc1b5ec-62a3-47f7-b47d-acdecb47d647 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:20.280980 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8bc1b5ec-62a3-47f7-b47d-acdecb47d647 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:20.281748 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8bc1b5ec-62a3-47f7-b47d-acdecb47d647 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:20.288278 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8bc1b5ec-62a3-47f7-b47d-acdecb47d647 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:20.288898 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8bc1b5ec-62a3-47f7-b47d-acdecb47d647 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:21.155720 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-16b80613-8a6a-4a0b-8e57-95325ab033c2 tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Flavor limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:52:21.156779 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-16b80613-8a6a-4a0b-8e57-95325ab033c2 tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Image limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:52:21.157479 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-16b80613-8a6a-4a0b-8e57-95325ab033c2 tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Flavor pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:52:21.158096 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-16b80613-8a6a-4a0b-8e57-95325ab033c2 tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Image pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:52:21.158666 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-16b80613-8a6a-4a0b-8e57-95325ab033c2 tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:52:21.179517 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-16b80613-8a6a-4a0b-8e57-95325ab033c2 tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:21.180012 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-16b80613-8a6a-4a0b-8e57-95325ab033c2 tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:21.180487 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-16b80613-8a6a-4a0b-8e57-95325ab033c2 tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:21.181225 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-16b80613-8a6a-4a0b-8e57-95325ab033c2 tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:21.181674 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-16b80613-8a6a-4a0b-8e57-95325ab033c2 tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:21.182097 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-16b80613-8a6a-4a0b-8e57-95325ab033c2 tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:21.200809 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-8bc1b5ec-62a3-47f7-b47d-acdecb47d647 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:21.212690 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-8bc1b5ec-62a3-47f7-b47d-acdecb47d647 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/a59ed991-1ea2-45a0-8c0a-6e241c337a4b" status: 200 len: 1315 microversion: 2.1 time: 0.988533 Aug 27 02:52:21.217372 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1224/2471] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:20 2022] GET /compute/v2.1/servers/a59ed991-1ea2-45a0-8c0a-6e241c337a4b => generated 1315 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:21.222944 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-88f62a73-ed2e-4044-98da-1ef6171baa39 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:21.223798 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-88f62a73-ed2e-4044-98da-1ef6171baa39 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: ba987aee-2707-4d47-aba9-d2803aa70745] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:21.235665 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-16b80613-8a6a-4a0b-8e57-95325ab033c2 tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Getting quotas for project 7efbb3a8866e47d7981008b08e89f416. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:52:21.242733 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-88f62a73-ed2e-4044-98da-1ef6171baa39 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:21.243586 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-88f62a73-ed2e-4044-98da-1ef6171baa39 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:21.244252 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-88f62a73-ed2e-4044-98da-1ef6171baa39 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:21.245746 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-88f62a73-ed2e-4044-98da-1ef6171baa39 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:21.246424 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-88f62a73-ed2e-4044-98da-1ef6171baa39 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:21.247055 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-88f62a73-ed2e-4044-98da-1ef6171baa39 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:21.253742 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-16b80613-8a6a-4a0b-8e57-95325ab033c2 tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Getting quotas for user 03191d0be5ae427286971e228534be75 and project 7efbb3a8866e47d7981008b08e89f416. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:52:21.279918 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-16b80613-8a6a-4a0b-8e57-95325ab033c2 tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Going to run 1 instances... {{(pid=134052) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:52:21.282887 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-16b80613-8a6a-4a0b-8e57-95325ab033c2 tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] [instance: 9da9d8a1-ec78-43ed-b29d-8560df6e3937] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134052) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:52:21.367867 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-16b80613-8a6a-4a0b-8e57-95325ab033c2 tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 2.770087 Aug 27 02:52:21.370351 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1248/2472] 10.222.0.70 () {62 vars in 1188 bytes} [Sat Aug 27 02:52:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 2773 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 27 02:52:21.376116 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-156b75e1-97c6-4a50-af2f-1a7002f5c13b tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:21.377215 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-156b75e1-97c6-4a50-af2f-1a7002f5c13b tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:21.384827 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-156b75e1-97c6-4a50-af2f-1a7002f5c13b tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:21.385892 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-156b75e1-97c6-4a50-af2f-1a7002f5c13b tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:21.386572 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-156b75e1-97c6-4a50-af2f-1a7002f5c13b tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:21.387374 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-156b75e1-97c6-4a50-af2f-1a7002f5c13b tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:21.387955 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-156b75e1-97c6-4a50-af2f-1a7002f5c13b tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:21.388498 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-156b75e1-97c6-4a50-af2f-1a7002f5c13b tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:21.700157 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-88f62a73-ed2e-4044-98da-1ef6171baa39 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:21.730428 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-88f62a73-ed2e-4044-98da-1ef6171baa39 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/ba987aee-2707-4d47-aba9-d2803aa70745" status: 200 len: 1476 microversion: 2.1 time: 0.510991 Aug 27 02:52:21.731503 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1225/2473] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:21 2022] GET /compute/v2.1/servers/ba987aee-2707-4d47-aba9-d2803aa70745 => generated 1476 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:21.773160 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-078abb37-40fd-4697-9af7-fbdcacade7fe tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '.version_select at 0x7f5edf214670>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:21.796929 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-156b75e1-97c6-4a50-af2f-1a7002f5c13b tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:21.826358 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-156b75e1-97c6-4a50-af2f-1a7002f5c13b tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1668 microversion: 2.1 time: 0.454340 Aug 27 02:52:21.828940 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1249/2474] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:21 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1668 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:21.847055 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a3352d7b-7d52-4796-9d73-aea873188f09 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:21.848154 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a3352d7b-7d52-4796-9d73-aea873188f09 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] [instance: 6ef152e6-ba27-46bd-871a-04d8539b493e] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:21.866214 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a3352d7b-7d52-4796-9d73-aea873188f09 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:21.866717 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a3352d7b-7d52-4796-9d73-aea873188f09 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:21.867152 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a3352d7b-7d52-4796-9d73-aea873188f09 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:21.867882 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a3352d7b-7d52-4796-9d73-aea873188f09 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:21.907856 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-078abb37-40fd-4697-9af7-fbdcacade7fe tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "GET /compute/v2.1/images/fc902f34-89f1-4a0a-af61-22568052f001" status: 200 len: 1411 microversion: 2.1 time: 0.141936 Aug 27 02:52:21.915473 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1226/2475] 10.222.0.70 () {58 vars in 1233 bytes} [Sat Aug 27 02:52:21 2022] GET /compute/v2.1/images/fc902f34-89f1-4a0a-af61-22568052f001 => generated 1411 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:21.918147 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a3352d7b-7d52-4796-9d73-aea873188f09 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.050s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:21.919252 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a3352d7b-7d52-4796-9d73-aea873188f09 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:21.934580 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f8f170ed-e784-434f-b45f-5253263cecf1 tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:21.944424 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-f8f170ed-e784-434f-b45f-5253263cecf1 tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] [instance: 9da9d8a1-ec78-43ed-b29d-8560df6e3937] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:22.532842 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-f8f170ed-e784-434f-b45f-5253263cecf1 tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03191d0be5ae427286971e228534be75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efbb3a8866e47d7981008b08e89f416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:22.553316 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-a3352d7b-7d52-4796-9d73-aea873188f09 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317e74b4bbc4da298a0dcbd78068352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a8810c21784788b4c0ee64dedbaf15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:22.563039 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a3352d7b-7d52-4796-9d73-aea873188f09 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] 10.222.0.70 "GET /compute/v2.1/servers/6ef152e6-ba27-46bd-871a-04d8539b493e" status: 200 len: 1513 microversion: 2.1 time: 0.732414 Aug 27 02:52:22.564532 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1250/2476] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:21 2022] GET /compute/v2.1/servers/6ef152e6-ba27-46bd-871a-04d8539b493e => generated 1513 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:22.569727 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5b51798e-f865-4df6-b2c0-d253d35c38a8 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-181963690"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:52:22.572417 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-5b51798e-f865-4df6-b2c0-d253d35c38a8 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:22.584936 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5b51798e-f865-4df6-b2c0-d253d35c38a8 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:22.585782 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5b51798e-f865-4df6-b2c0-d253d35c38a8 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:22.586388 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5b51798e-f865-4df6-b2c0-d253d35c38a8 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:22.587857 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5b51798e-f865-4df6-b2c0-d253d35c38a8 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:22.588502 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5b51798e-f865-4df6-b2c0-d253d35c38a8 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:22.589088 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5b51798e-f865-4df6-b2c0-d253d35c38a8 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:22.594571 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-f8f170ed-e784-434f-b45f-5253263cecf1 tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03191d0be5ae427286971e228534be75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efbb3a8866e47d7981008b08e89f416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:22.607539 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-f8f170ed-e784-434f-b45f-5253263cecf1 tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03191d0be5ae427286971e228534be75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efbb3a8866e47d7981008b08e89f416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:22.614152 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-f8f170ed-e784-434f-b45f-5253263cecf1 tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] 10.222.0.70 "GET /compute/v2.1/servers/9da9d8a1-ec78-43ed-b29d-8560df6e3937" status: 200 len: 1258 microversion: 2.21 time: 0.696663 Aug 27 02:52:22.619037 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1227/2477] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:52:21 2022] GET /compute/v2.1/servers/9da9d8a1-ec78-43ed-b29d-8560df6e3937 => generated 1258 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:52:22.644666 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-e9bd8fa5-0d3d-460b-944b-4200264b156c req-d2e314e2-03b0-4803-aa43-5d5c2b6618b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a59ed991-1ea2-45a0-8c0a-6e241c337a4b", "name": "network-vif-plugged", "status": "completed", "tag": "69e25bdc-655b-4fba-befe-c9cbeb891a75"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:52:22.658322 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-e9bd8fa5-0d3d-460b-944b-4200264b156c req-d2e314e2-03b0-4803-aa43-5d5c2b6618b1 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:22.659241 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-e9bd8fa5-0d3d-460b-944b-4200264b156c req-d2e314e2-03b0-4803-aa43-5d5c2b6618b1 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:22.660120 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-e9bd8fa5-0d3d-460b-944b-4200264b156c req-d2e314e2-03b0-4803-aa43-5d5c2b6618b1 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:22.717597 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-e9bd8fa5-0d3d-460b-944b-4200264b156c req-d2e314e2-03b0-4803-aa43-5d5c2b6618b1 service nova] Creating event network-vif-plugged:69e25bdc-655b-4fba-befe-c9cbeb891a75 for instance a59ed991-1ea2-45a0-8c0a-6e241c337a4b on n-h2-852278-4 Aug 27 02:52:22.732496 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-e9bd8fa5-0d3d-460b-944b-4200264b156c req-d2e314e2-03b0-4803-aa43-5d5c2b6618b1 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111209 Aug 27 02:52:22.734809 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1228/2478] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:52:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:52:22.748976 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-06eb4079-d461-4249-8b51-95a452f12626 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:22.753042 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-06eb4079-d461-4249-8b51-95a452f12626 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: a59ed991-1ea2-45a0-8c0a-6e241c337a4b] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:22.769661 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-06eb4079-d461-4249-8b51-95a452f12626 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:22.770417 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-06eb4079-d461-4249-8b51-95a452f12626 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:22.771961 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-06eb4079-d461-4249-8b51-95a452f12626 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:22.773630 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-06eb4079-d461-4249-8b51-95a452f12626 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:22.776917 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-06eb4079-d461-4249-8b51-95a452f12626 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:22.778263 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-06eb4079-d461-4249-8b51-95a452f12626 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:22.907568 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:52:23.019406 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-5b51798e-f865-4df6-b2c0-d253d35c38a8 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "POST /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd/action" status: 202 len: 0 microversion: 2.1 time: 0.453190 Aug 27 02:52:23.020710 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1251/2479] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 02:52:22 2022] POST /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd/action => generated 0 bytes in 455 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Aug 27 02:52:23.045995 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-93867f5a-3a7c-4834-a4e8-6e4849a9f0af tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:23.046867 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-93867f5a-3a7c-4834-a4e8-6e4849a9f0af tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: ba987aee-2707-4d47-aba9-d2803aa70745] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:23.082109 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-93867f5a-3a7c-4834-a4e8-6e4849a9f0af tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:23.083162 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-93867f5a-3a7c-4834-a4e8-6e4849a9f0af tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:23.086392 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-93867f5a-3a7c-4834-a4e8-6e4849a9f0af tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:23.087523 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-93867f5a-3a7c-4834-a4e8-6e4849a9f0af tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:23.090258 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-93867f5a-3a7c-4834-a4e8-6e4849a9f0af tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:23.094331 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-93867f5a-3a7c-4834-a4e8-6e4849a9f0af tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:23.248340 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-06eb4079-d461-4249-8b51-95a452f12626 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:23.256609 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-06eb4079-d461-4249-8b51-95a452f12626 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/a59ed991-1ea2-45a0-8c0a-6e241c337a4b" status: 200 len: 1315 microversion: 2.1 time: 0.520286 Aug 27 02:52:23.260986 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1229/2480] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:22 2022] GET /compute/v2.1/servers/a59ed991-1ea2-45a0-8c0a-6e241c337a4b => generated 1315 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:23.267040 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-1d9fb5df-7177-464b-89eb-6cb2c54d808b tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '.version_select at 0x7f5ede981040>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:23.353362 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-1d9fb5df-7177-464b-89eb-6cb2c54d808b tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "GET /compute/v2.1/images/fc902f34-89f1-4a0a-af61-22568052f001" status: 200 len: 1411 microversion: 2.1 time: 0.090928 Aug 27 02:52:23.354012 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1230/2481] 10.222.0.70 () {58 vars in 1233 bytes} [Sat Aug 27 02:52:23 2022] GET /compute/v2.1/images/fc902f34-89f1-4a0a-af61-22568052f001 => generated 1411 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:23.404022 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-93867f5a-3a7c-4834-a4e8-6e4849a9f0af tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:23.418003 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-93867f5a-3a7c-4834-a4e8-6e4849a9f0af tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/ba987aee-2707-4d47-aba9-d2803aa70745" status: 200 len: 1476 microversion: 2.1 time: 0.395748 Aug 27 02:52:23.419871 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1252/2482] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:23 2022] GET /compute/v2.1/servers/ba987aee-2707-4d47-aba9-d2803aa70745 => generated 1476 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:23.597840 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-70150b15-87f5-4c23-b3dc-ce4f038c6dc2 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:23.598579 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-70150b15-87f5-4c23-b3dc-ce4f038c6dc2 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] [instance: 6ef152e6-ba27-46bd-871a-04d8539b493e] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:23.606447 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-70150b15-87f5-4c23-b3dc-ce4f038c6dc2 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:23.609103 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-70150b15-87f5-4c23-b3dc-ce4f038c6dc2 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:23.609807 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-70150b15-87f5-4c23-b3dc-ce4f038c6dc2 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:23.610717 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-70150b15-87f5-4c23-b3dc-ce4f038c6dc2 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:23.611245 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-70150b15-87f5-4c23-b3dc-ce4f038c6dc2 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:23.611770 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-70150b15-87f5-4c23-b3dc-ce4f038c6dc2 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:23.642755 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ccf7b667-dce2-43b3-b005-056510f8dd96 tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:23.643474 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-ccf7b667-dce2-43b3-b005-056510f8dd96 tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] [instance: 9da9d8a1-ec78-43ed-b29d-8560df6e3937] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:23.655524 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ccf7b667-dce2-43b3-b005-056510f8dd96 tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:23.658415 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ccf7b667-dce2-43b3-b005-056510f8dd96 tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:23.659001 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ccf7b667-dce2-43b3-b005-056510f8dd96 tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:23.660047 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ccf7b667-dce2-43b3-b005-056510f8dd96 tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:23.660629 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ccf7b667-dce2-43b3-b005-056510f8dd96 tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:23.664861 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ccf7b667-dce2-43b3-b005-056510f8dd96 tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:23.831076 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-ccf7b667-dce2-43b3-b005-056510f8dd96 tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03191d0be5ae427286971e228534be75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efbb3a8866e47d7981008b08e89f416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:23.848838 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-ccf7b667-dce2-43b3-b005-056510f8dd96 tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03191d0be5ae427286971e228534be75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efbb3a8866e47d7981008b08e89f416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:23.851558 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-ccf7b667-dce2-43b3-b005-056510f8dd96 tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03191d0be5ae427286971e228534be75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efbb3a8866e47d7981008b08e89f416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:23.853291 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ccf7b667-dce2-43b3-b005-056510f8dd96 tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] 10.222.0.70 "GET /compute/v2.1/servers/9da9d8a1-ec78-43ed-b29d-8560df6e3937" status: 200 len: 1310 microversion: 2.21 time: 0.214792 Aug 27 02:52:23.877821 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-70150b15-87f5-4c23-b3dc-ce4f038c6dc2 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317e74b4bbc4da298a0dcbd78068352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a8810c21784788b4c0ee64dedbaf15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:23.881938 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1253/2483] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:52:23 2022] GET /compute/v2.1/servers/9da9d8a1-ec78-43ed-b29d-8560df6e3937 => generated 1310 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:52:23.889553 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-70150b15-87f5-4c23-b3dc-ce4f038c6dc2 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] 10.222.0.70 "GET /compute/v2.1/servers/6ef152e6-ba27-46bd-871a-04d8539b493e" status: 200 len: 1513 microversion: 2.1 time: 0.298769 Aug 27 02:52:23.905175 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1231/2484] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:23 2022] GET /compute/v2.1/servers/6ef152e6-ba27-46bd-871a-04d8539b493e => generated 1513 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:24.283641 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e21a881b-913a-47f4-9e0f-bd2b12531804 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:24.284271 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-e21a881b-913a-47f4-9e0f-bd2b12531804 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: a59ed991-1ea2-45a0-8c0a-6e241c337a4b] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:24.294974 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e21a881b-913a-47f4-9e0f-bd2b12531804 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:24.295465 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e21a881b-913a-47f4-9e0f-bd2b12531804 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:24.295898 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e21a881b-913a-47f4-9e0f-bd2b12531804 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:24.296704 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e21a881b-913a-47f4-9e0f-bd2b12531804 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:24.297102 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e21a881b-913a-47f4-9e0f-bd2b12531804 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:24.297505 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e21a881b-913a-47f4-9e0f-bd2b12531804 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:24.371191 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8e4debf0-b553-475a-8bc6-77c7b8ab36d4 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '.version_select at 0x7f5ede981040>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:24.473152 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-8e4debf0-b553-475a-8bc6-77c7b8ab36d4 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "GET /compute/v2.1/images/fc902f34-89f1-4a0a-af61-22568052f001" status: 200 len: 1411 microversion: 2.1 time: 0.107220 Aug 27 02:52:24.474264 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1232/2485] 10.222.0.70 () {58 vars in 1233 bytes} [Sat Aug 27 02:52:24 2022] GET /compute/v2.1/images/fc902f34-89f1-4a0a-af61-22568052f001 => generated 1411 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:52:24.493903 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-1c6ef770-bfab-48f0-8e1c-73b5c4803d9b tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:24.496104 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-1c6ef770-bfab-48f0-8e1c-73b5c4803d9b tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: ba987aee-2707-4d47-aba9-d2803aa70745] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:24.522127 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1c6ef770-bfab-48f0-8e1c-73b5c4803d9b tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:24.525140 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1c6ef770-bfab-48f0-8e1c-73b5c4803d9b tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:24.526703 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1c6ef770-bfab-48f0-8e1c-73b5c4803d9b tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:24.529825 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1c6ef770-bfab-48f0-8e1c-73b5c4803d9b tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:24.531247 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1c6ef770-bfab-48f0-8e1c-73b5c4803d9b tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:24.531861 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1c6ef770-bfab-48f0-8e1c-73b5c4803d9b tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:24.662205 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-e21a881b-913a-47f4-9e0f-bd2b12531804 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:24.671155 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e21a881b-913a-47f4-9e0f-bd2b12531804 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/a59ed991-1ea2-45a0-8c0a-6e241c337a4b" status: 200 len: 1315 microversion: 2.1 time: 0.391593 Aug 27 02:52:24.675162 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1254/2486] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:24 2022] GET /compute/v2.1/servers/a59ed991-1ea2-45a0-8c0a-6e241c337a4b => generated 1315 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:24.836686 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-1c6ef770-bfab-48f0-8e1c-73b5c4803d9b tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:24.847868 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-1c6ef770-bfab-48f0-8e1c-73b5c4803d9b tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/ba987aee-2707-4d47-aba9-d2803aa70745" status: 200 len: 1476 microversion: 2.1 time: 0.369315 Aug 27 02:52:24.849102 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1233/2487] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:24 2022] GET /compute/v2.1/servers/ba987aee-2707-4d47-aba9-d2803aa70745 => generated 1476 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:24.880018 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0d37cf34-7531-44db-97da-e2acfd111285 tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:24.881322 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-0d37cf34-7531-44db-97da-e2acfd111285 tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] [instance: 9da9d8a1-ec78-43ed-b29d-8560df6e3937] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:24.892272 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0d37cf34-7531-44db-97da-e2acfd111285 tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:24.896597 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0d37cf34-7531-44db-97da-e2acfd111285 tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:24.897268 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0d37cf34-7531-44db-97da-e2acfd111285 tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:24.898430 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0d37cf34-7531-44db-97da-e2acfd111285 tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:24.899056 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0d37cf34-7531-44db-97da-e2acfd111285 tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:24.899638 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0d37cf34-7531-44db-97da-e2acfd111285 tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:24.914187 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-77d60964-d510-4d69-84db-f81961995fb3 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:24.914703 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-77d60964-d510-4d69-84db-f81961995fb3 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] [instance: 6ef152e6-ba27-46bd-871a-04d8539b493e] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:24.916919 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:52:24.932204 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-77d60964-d510-4d69-84db-f81961995fb3 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:24.932740 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-77d60964-d510-4d69-84db-f81961995fb3 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:24.933394 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-77d60964-d510-4d69-84db-f81961995fb3 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:24.934280 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-77d60964-d510-4d69-84db-f81961995fb3 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:24.934830 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-77d60964-d510-4d69-84db-f81961995fb3 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:24.935313 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-77d60964-d510-4d69-84db-f81961995fb3 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:25.026367 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0d37cf34-7531-44db-97da-e2acfd111285 tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03191d0be5ae427286971e228534be75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efbb3a8866e47d7981008b08e89f416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:25.048304 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0d37cf34-7531-44db-97da-e2acfd111285 tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03191d0be5ae427286971e228534be75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efbb3a8866e47d7981008b08e89f416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:25.052064 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0d37cf34-7531-44db-97da-e2acfd111285 tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03191d0be5ae427286971e228534be75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efbb3a8866e47d7981008b08e89f416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:25.057209 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-0d37cf34-7531-44db-97da-e2acfd111285 tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] 10.222.0.70 "GET /compute/v2.1/servers/9da9d8a1-ec78-43ed-b29d-8560df6e3937" status: 200 len: 1316 microversion: 2.21 time: 0.182828 Aug 27 02:52:25.075678 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1255/2488] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:52:24 2022] GET /compute/v2.1/servers/9da9d8a1-ec78-43ed-b29d-8560df6e3937 => generated 1316 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:52:25.288228 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-77d60964-d510-4d69-84db-f81961995fb3 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317e74b4bbc4da298a0dcbd78068352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a8810c21784788b4c0ee64dedbaf15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:25.297191 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-77d60964-d510-4d69-84db-f81961995fb3 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] 10.222.0.70 "GET /compute/v2.1/servers/6ef152e6-ba27-46bd-871a-04d8539b493e" status: 200 len: 1513 microversion: 2.1 time: 0.387050 Aug 27 02:52:25.312522 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1234/2489] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:24 2022] GET /compute/v2.1/servers/6ef152e6-ba27-46bd-871a-04d8539b493e => generated 1513 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:52:25.340872 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-12fe8484-cff3-400a-905b-e0551f1c38df req-b006c716-5fa8-4c39-8951-93bf8222cdfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb0d71f2-158d-4acc-8774-6874e7da29cd", "name": "network-vif-unplugged", "status": "completed", "tag": "fe5d48cf-956a-4e15-9a8e-fdd605d313b1"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:52:25.357262 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-12fe8484-cff3-400a-905b-e0551f1c38df req-b006c716-5fa8-4c39-8951-93bf8222cdfe service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:25.357758 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-12fe8484-cff3-400a-905b-e0551f1c38df req-b006c716-5fa8-4c39-8951-93bf8222cdfe service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:25.358408 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-12fe8484-cff3-400a-905b-e0551f1c38df req-b006c716-5fa8-4c39-8951-93bf8222cdfe service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:25.375758 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-12fe8484-cff3-400a-905b-e0551f1c38df req-b006c716-5fa8-4c39-8951-93bf8222cdfe service nova] Creating event network-vif-unplugged:fe5d48cf-956a-4e15-9a8e-fdd605d313b1 for instance bb0d71f2-158d-4acc-8774-6874e7da29cd on n-h1-852278-4 Aug 27 02:52:25.381540 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-12fe8484-cff3-400a-905b-e0551f1c38df req-b006c716-5fa8-4c39-8951-93bf8222cdfe service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044288 Aug 27 02:52:25.382852 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1256/2490] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:52:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:52:25.500267 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0b6949be-213f-4c3e-beb3-55bb9dc0eaf7 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '.version_select at 0x7f5edf4210d0>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:25.607093 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-0b6949be-213f-4c3e-beb3-55bb9dc0eaf7 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "GET /compute/v2.1/images/fc902f34-89f1-4a0a-af61-22568052f001" status: 200 len: 1411 microversion: 2.1 time: 0.122066 Aug 27 02:52:25.608101 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1235/2491] 10.222.0.70 () {58 vars in 1233 bytes} [Sat Aug 27 02:52:25 2022] GET /compute/v2.1/images/fc902f34-89f1-4a0a-af61-22568052f001 => generated 1411 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:25.696172 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-99bd36ea-c19f-46da-a510-f8d24c9e7cd7 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:25.696899 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-99bd36ea-c19f-46da-a510-f8d24c9e7cd7 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: a59ed991-1ea2-45a0-8c0a-6e241c337a4b] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:25.711016 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-99bd36ea-c19f-46da-a510-f8d24c9e7cd7 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:25.713226 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-99bd36ea-c19f-46da-a510-f8d24c9e7cd7 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:25.716145 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-99bd36ea-c19f-46da-a510-f8d24c9e7cd7 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:25.717163 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-99bd36ea-c19f-46da-a510-f8d24c9e7cd7 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:25.717788 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-99bd36ea-c19f-46da-a510-f8d24c9e7cd7 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:25.718500 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-99bd36ea-c19f-46da-a510-f8d24c9e7cd7 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:25.869930 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f29099da-02bb-4814-ae63-347104ed7edd tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:25.870691 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-f29099da-02bb-4814-ae63-347104ed7edd tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: ba987aee-2707-4d47-aba9-d2803aa70745] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:25.886306 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f29099da-02bb-4814-ae63-347104ed7edd tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:25.886821 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f29099da-02bb-4814-ae63-347104ed7edd tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:25.887265 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f29099da-02bb-4814-ae63-347104ed7edd tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:25.887997 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f29099da-02bb-4814-ae63-347104ed7edd tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:25.888487 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f29099da-02bb-4814-ae63-347104ed7edd tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:25.892943 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f29099da-02bb-4814-ae63-347104ed7edd tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:26.046985 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-99bd36ea-c19f-46da-a510-f8d24c9e7cd7 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:26.061865 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-99bd36ea-c19f-46da-a510-f8d24c9e7cd7 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/a59ed991-1ea2-45a0-8c0a-6e241c337a4b" status: 200 len: 1501 microversion: 2.1 time: 0.368474 Aug 27 02:52:26.064403 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1257/2492] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:25 2022] GET /compute/v2.1/servers/a59ed991-1ea2-45a0-8c0a-6e241c337a4b => generated 1501 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:26.082287 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b45e0a3a-a251-462b-8920-3657afffbcaa tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:26.082924 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b45e0a3a-a251-462b-8920-3657afffbcaa tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] [instance: 9da9d8a1-ec78-43ed-b29d-8560df6e3937] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:26.100254 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b45e0a3a-a251-462b-8920-3657afffbcaa tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:26.100817 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b45e0a3a-a251-462b-8920-3657afffbcaa tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:26.101807 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b45e0a3a-a251-462b-8920-3657afffbcaa tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:26.103931 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b45e0a3a-a251-462b-8920-3657afffbcaa tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:26.104579 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b45e0a3a-a251-462b-8920-3657afffbcaa tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:26.106319 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b45e0a3a-a251-462b-8920-3657afffbcaa tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:26.309843 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-f29099da-02bb-4814-ae63-347104ed7edd tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:26.318446 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-f29099da-02bb-4814-ae63-347104ed7edd tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/ba987aee-2707-4d47-aba9-d2803aa70745" status: 200 len: 1476 microversion: 2.1 time: 0.452746 Aug 27 02:52:26.340559 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1236/2493] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:25 2022] GET /compute/v2.1/servers/ba987aee-2707-4d47-aba9-d2803aa70745 => generated 1476 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:26.346732 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b45e0a3a-a251-462b-8920-3657afffbcaa tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03191d0be5ae427286971e228534be75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efbb3a8866e47d7981008b08e89f416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:26.351814 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7d100a9c-5407-4ea8-a577-82f76bfd0f71 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:52:26.352709 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-7d100a9c-5407-4ea8-a577-82f76bfd0f71 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: a59ed991-1ea2-45a0-8c0a-6e241c337a4b] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:26.359601 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7d100a9c-5407-4ea8-a577-82f76bfd0f71 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:26.360505 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7d100a9c-5407-4ea8-a577-82f76bfd0f71 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:26.361213 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7d100a9c-5407-4ea8-a577-82f76bfd0f71 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:26.361926 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b45e0a3a-a251-462b-8920-3657afffbcaa tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03191d0be5ae427286971e228534be75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efbb3a8866e47d7981008b08e89f416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:26.362436 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7d100a9c-5407-4ea8-a577-82f76bfd0f71 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:26.363113 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7d100a9c-5407-4ea8-a577-82f76bfd0f71 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:26.363748 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7d100a9c-5407-4ea8-a577-82f76bfd0f71 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:26.367317 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b45e0a3a-a251-462b-8920-3657afffbcaa tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03191d0be5ae427286971e228534be75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efbb3a8866e47d7981008b08e89f416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:26.375677 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b45e0a3a-a251-462b-8920-3657afffbcaa tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] 10.222.0.70 "GET /compute/v2.1/servers/9da9d8a1-ec78-43ed-b29d-8560df6e3937" status: 200 len: 1358 microversion: 2.21 time: 0.296407 Aug 27 02:52:26.377907 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1258/2494] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:52:26 2022] GET /compute/v2.1/servers/9da9d8a1-ec78-43ed-b29d-8560df6e3937 => generated 1358 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:52:26.386133 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-11ff03db-ef3e-40ee-8f00-96ea28431669 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:26.387503 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-11ff03db-ef3e-40ee-8f00-96ea28431669 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] [instance: 6ef152e6-ba27-46bd-871a-04d8539b493e] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:26.399872 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-11ff03db-ef3e-40ee-8f00-96ea28431669 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:26.400941 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-11ff03db-ef3e-40ee-8f00-96ea28431669 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:26.401607 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-11ff03db-ef3e-40ee-8f00-96ea28431669 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:26.402567 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-11ff03db-ef3e-40ee-8f00-96ea28431669 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:26.403609 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-11ff03db-ef3e-40ee-8f00-96ea28431669 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:26.404245 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-11ff03db-ef3e-40ee-8f00-96ea28431669 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:26.517691 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-7d100a9c-5407-4ea8-a577-82f76bfd0f71 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "POST /compute/v2.1/servers/a59ed991-1ea2-45a0-8c0a-6e241c337a4b/action" status: 202 len: 0 microversion: 2.1 time: 0.175052 Aug 27 02:52:26.519240 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1237/2495] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 02:52:26 2022] POST /compute/v2.1/servers/a59ed991-1ea2-45a0-8c0a-6e241c337a4b/action => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:52:26.528122 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-dc8cfb47-97c9-47f8-87ba-400705b23c22 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:26.529209 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-dc8cfb47-97c9-47f8-87ba-400705b23c22 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: a59ed991-1ea2-45a0-8c0a-6e241c337a4b] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:26.543759 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dc8cfb47-97c9-47f8-87ba-400705b23c22 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:26.544344 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dc8cfb47-97c9-47f8-87ba-400705b23c22 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:26.554620 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dc8cfb47-97c9-47f8-87ba-400705b23c22 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:26.555663 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dc8cfb47-97c9-47f8-87ba-400705b23c22 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:26.556165 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dc8cfb47-97c9-47f8-87ba-400705b23c22 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:26.557118 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dc8cfb47-97c9-47f8-87ba-400705b23c22 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:26.876016 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-11ff03db-ef3e-40ee-8f00-96ea28431669 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317e74b4bbc4da298a0dcbd78068352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a8810c21784788b4c0ee64dedbaf15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:26.886829 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-11ff03db-ef3e-40ee-8f00-96ea28431669 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] 10.222.0.70 "GET /compute/v2.1/servers/6ef152e6-ba27-46bd-871a-04d8539b493e" status: 200 len: 1513 microversion: 2.1 time: 0.507644 Aug 27 02:52:26.888427 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1259/2496] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:26 2022] GET /compute/v2.1/servers/6ef152e6-ba27-46bd-871a-04d8539b493e => generated 1513 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:26.895062 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6ffbbed2-6ac8-4f8c-a073-83a0d41a54db tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '.version_select at 0x7f5ee72143a0>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:26.948388 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-dc8cfb47-97c9-47f8-87ba-400705b23c22 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:26.981702 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-6ffbbed2-6ac8-4f8c-a073-83a0d41a54db tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "GET /compute/v2.1/images/fc902f34-89f1-4a0a-af61-22568052f001" status: 200 len: 1411 microversion: 2.1 time: 0.091603 Aug 27 02:52:26.990634 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1260/2497] 10.222.0.70 () {58 vars in 1233 bytes} [Sat Aug 27 02:52:26 2022] GET /compute/v2.1/images/fc902f34-89f1-4a0a-af61-22568052f001 => generated 1411 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:26.996788 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-8673fec4-1fc7-4e68-87a5-e27518e2d744 req-d9e1aef8-6a94-4033-b2ed-800127db3753 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9da9d8a1-ec78-43ed-b29d-8560df6e3937", "tag": "748de1f1-74e0-437d-aa71-384f6db35553"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:52:26.999111 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-dc8cfb47-97c9-47f8-87ba-400705b23c22 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/a59ed991-1ea2-45a0-8c0a-6e241c337a4b" status: 200 len: 1506 microversion: 2.1 time: 0.472701 Aug 27 02:52:27.002378 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1238/2498] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:26 2022] GET /compute/v2.1/servers/a59ed991-1ea2-45a0-8c0a-6e241c337a4b => generated 1506 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:52:27.017358 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-8673fec4-1fc7-4e68-87a5-e27518e2d744 req-d9e1aef8-6a94-4033-b2ed-800127db3753 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:27.025117 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-8673fec4-1fc7-4e68-87a5-e27518e2d744 req-d9e1aef8-6a94-4033-b2ed-800127db3753 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:27.027369 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-8673fec4-1fc7-4e68-87a5-e27518e2d744 req-d9e1aef8-6a94-4033-b2ed-800127db3753 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:27.053467 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-8673fec4-1fc7-4e68-87a5-e27518e2d744 req-d9e1aef8-6a94-4033-b2ed-800127db3753 service nova] Creating event network-changed:748de1f1-74e0-437d-aa71-384f6db35553 for instance 9da9d8a1-ec78-43ed-b29d-8560df6e3937 on n-h1-852278-4 Aug 27 02:52:27.059845 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-8673fec4-1fc7-4e68-87a5-e27518e2d744 req-d9e1aef8-6a94-4033-b2ed-800127db3753 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067495 Aug 27 02:52:27.062002 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1261/2499] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:52:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:52:27.355210 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ce64326e-2efe-42ce-b9ac-12fa83d1a854 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:27.355876 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-ce64326e-2efe-42ce-b9ac-12fa83d1a854 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: ba987aee-2707-4d47-aba9-d2803aa70745] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:27.384973 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ce64326e-2efe-42ce-b9ac-12fa83d1a854 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:27.386515 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ce64326e-2efe-42ce-b9ac-12fa83d1a854 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:27.387905 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ce64326e-2efe-42ce-b9ac-12fa83d1a854 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:27.395229 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ce64326e-2efe-42ce-b9ac-12fa83d1a854 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:27.397829 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ce64326e-2efe-42ce-b9ac-12fa83d1a854 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:27.399127 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ce64326e-2efe-42ce-b9ac-12fa83d1a854 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:27.401167 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a6f96810-be35-4040-86b2-ee129e3c71aa tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:27.401881 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a6f96810-be35-4040-86b2-ee129e3c71aa tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] [instance: 9da9d8a1-ec78-43ed-b29d-8560df6e3937] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:27.419618 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a6f96810-be35-4040-86b2-ee129e3c71aa tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:27.420149 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a6f96810-be35-4040-86b2-ee129e3c71aa tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:27.420630 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a6f96810-be35-4040-86b2-ee129e3c71aa tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:27.421375 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a6f96810-be35-4040-86b2-ee129e3c71aa tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:27.422874 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a6f96810-be35-4040-86b2-ee129e3c71aa tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:27.423355 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a6f96810-be35-4040-86b2-ee129e3c71aa tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:27.747451 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-ce64326e-2efe-42ce-b9ac-12fa83d1a854 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:27.760292 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ce64326e-2efe-42ce-b9ac-12fa83d1a854 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/ba987aee-2707-4d47-aba9-d2803aa70745" status: 200 len: 1476 microversion: 2.1 time: 0.409823 Aug 27 02:52:27.760918 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1239/2500] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:27 2022] GET /compute/v2.1/servers/ba987aee-2707-4d47-aba9-d2803aa70745 => generated 1476 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:27.786163 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-a6f96810-be35-4040-86b2-ee129e3c71aa tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03191d0be5ae427286971e228534be75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efbb3a8866e47d7981008b08e89f416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:27.798405 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-a6f96810-be35-4040-86b2-ee129e3c71aa tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03191d0be5ae427286971e228534be75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efbb3a8866e47d7981008b08e89f416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:27.806443 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-a6f96810-be35-4040-86b2-ee129e3c71aa tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03191d0be5ae427286971e228534be75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efbb3a8866e47d7981008b08e89f416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:27.808136 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a6f96810-be35-4040-86b2-ee129e3c71aa tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] 10.222.0.70 "GET /compute/v2.1/servers/9da9d8a1-ec78-43ed-b29d-8560df6e3937" status: 200 len: 1358 microversion: 2.21 time: 0.412357 Aug 27 02:52:27.811491 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1262/2501] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:52:27 2022] GET /compute/v2.1/servers/9da9d8a1-ec78-43ed-b29d-8560df6e3937 => generated 1358 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:52:27.909890 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-2c2022a1-3b7e-40cc-8212-fae94ae85935 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:27.910531 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-2c2022a1-3b7e-40cc-8212-fae94ae85935 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] [instance: 6ef152e6-ba27-46bd-871a-04d8539b493e] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:27.927968 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2c2022a1-3b7e-40cc-8212-fae94ae85935 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:27.928485 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2c2022a1-3b7e-40cc-8212-fae94ae85935 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:27.929241 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2c2022a1-3b7e-40cc-8212-fae94ae85935 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:27.930057 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2c2022a1-3b7e-40cc-8212-fae94ae85935 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:27.932886 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2c2022a1-3b7e-40cc-8212-fae94ae85935 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:27.932886 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2c2022a1-3b7e-40cc-8212-fae94ae85935 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:27.988215 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d0947911-dcc9-4e72-93a2-1adac1f8b68c tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1157306957", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "networks": [{"uuid": "6d9835cd-4c5d-46e1-af0f-b70cccb5be2e"}]}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:52:28.057908 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.network.neutron [None req-d0947911-dcc9-4e72-93a2-1adac1f8b68c tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] validate_networks() for [('6d9835cd-4c5d-46e1-af0f-b70cccb5be2e', None, None, None, None, None)] {{(pid=134051) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:52:28.176743 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-2c2022a1-3b7e-40cc-8212-fae94ae85935 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317e74b4bbc4da298a0dcbd78068352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a8810c21784788b4c0ee64dedbaf15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:28.185493 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-2c2022a1-3b7e-40cc-8212-fae94ae85935 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] 10.222.0.70 "GET /compute/v2.1/servers/6ef152e6-ba27-46bd-871a-04d8539b493e" status: 200 len: 1513 microversion: 2.1 time: 0.280022 Aug 27 02:52:28.199147 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1263/2502] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:27 2022] GET /compute/v2.1/servers/6ef152e6-ba27-46bd-871a-04d8539b493e => generated 1513 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:28.204181 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d5d9d011-3ac1-4718-92df-5c6002e2dd3f tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '.version_select at 0x7f5ee34b9f70>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:28.286597 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d5d9d011-3ac1-4718-92df-5c6002e2dd3f tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "GET /compute/v2.1/images/fc902f34-89f1-4a0a-af61-22568052f001" status: 200 len: 1411 microversion: 2.1 time: 0.086251 Aug 27 02:52:28.287371 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1264/2503] 10.222.0.70 () {58 vars in 1233 bytes} [Sat Aug 27 02:52:28 2022] GET /compute/v2.1/images/fc902f34-89f1-4a0a-af61-22568052f001 => generated 1411 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:28.291697 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4b8bd8c1-870e-4176-8398-1063f921dd44 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:28.292330 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-4b8bd8c1-870e-4176-8398-1063f921dd44 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: a59ed991-1ea2-45a0-8c0a-6e241c337a4b] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:28.299886 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4b8bd8c1-870e-4176-8398-1063f921dd44 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:28.300602 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4b8bd8c1-870e-4176-8398-1063f921dd44 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:28.301237 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4b8bd8c1-870e-4176-8398-1063f921dd44 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:28.302286 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4b8bd8c1-870e-4176-8398-1063f921dd44 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:28.302709 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4b8bd8c1-870e-4176-8398-1063f921dd44 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:28.303100 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4b8bd8c1-870e-4176-8398-1063f921dd44 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:28.528130 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-4b8bd8c1-870e-4176-8398-1063f921dd44 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:28.538046 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-4b8bd8c1-870e-4176-8398-1063f921dd44 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/a59ed991-1ea2-45a0-8c0a-6e241c337a4b" status: 200 len: 1486 microversion: 2.1 time: 0.249814 Aug 27 02:52:28.540126 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1265/2504] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:28 2022] GET /compute/v2.1/servers/a59ed991-1ea2-45a0-8c0a-6e241c337a4b => generated 1486 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:28.565541 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-2cf48d55-aa4d-4e44-9de6-bad6e14850d4 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:28.566316 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-2cf48d55-aa4d-4e44-9de6-bad6e14850d4 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: a59ed991-1ea2-45a0-8c0a-6e241c337a4b] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:28.576527 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2cf48d55-aa4d-4e44-9de6-bad6e14850d4 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:28.577284 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2cf48d55-aa4d-4e44-9de6-bad6e14850d4 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:28.577869 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2cf48d55-aa4d-4e44-9de6-bad6e14850d4 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:28.579106 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2cf48d55-aa4d-4e44-9de6-bad6e14850d4 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:28.579756 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2cf48d55-aa4d-4e44-9de6-bad6e14850d4 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:28.580385 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2cf48d55-aa4d-4e44-9de6-bad6e14850d4 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:28.618401 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-2cf48d55-aa4d-4e44-9de6-bad6e14850d4 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: a59ed991-1ea2-45a0-8c0a-6e241c337a4b] Going to try to terminate instance {{(pid=134052) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:52:28.640406 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-d0947911-dcc9-4e72-93a2-1adac1f8b68c tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Flavor limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:52:28.641477 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-d0947911-dcc9-4e72-93a2-1adac1f8b68c tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Image limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:52:28.642136 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-d0947911-dcc9-4e72-93a2-1adac1f8b68c tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Flavor pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:52:28.642692 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-d0947911-dcc9-4e72-93a2-1adac1f8b68c tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Image pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:52:28.644257 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-d0947911-dcc9-4e72-93a2-1adac1f8b68c tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:52:28.657072 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d0947911-dcc9-4e72-93a2-1adac1f8b68c tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:28.657934 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d0947911-dcc9-4e72-93a2-1adac1f8b68c tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:28.658548 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d0947911-dcc9-4e72-93a2-1adac1f8b68c tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:28.659539 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d0947911-dcc9-4e72-93a2-1adac1f8b68c tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:28.660130 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d0947911-dcc9-4e72-93a2-1adac1f8b68c tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:28.660731 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d0947911-dcc9-4e72-93a2-1adac1f8b68c tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:28.684790 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-d0947911-dcc9-4e72-93a2-1adac1f8b68c tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Getting quotas for project 079fe2e8a6184fba858e3d8e60730fe2. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:52:28.693956 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-d0947911-dcc9-4e72-93a2-1adac1f8b68c tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Getting quotas for user 745fd53ea2694f919ff28af2c17e60a8 and project 079fe2e8a6184fba858e3d8e60730fe2. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:52:28.709752 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d0947911-dcc9-4e72-93a2-1adac1f8b68c tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Going to run 1 instances... {{(pid=134051) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:52:28.714688 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d0947911-dcc9-4e72-93a2-1adac1f8b68c tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] [instance: b4b1bc77-1487-47d4-ae3b-14e693c1c4c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134051) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:52:28.725194 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-2cf48d55-aa4d-4e44-9de6-bad6e14850d4 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "DELETE /compute/v2.1/servers/a59ed991-1ea2-45a0-8c0a-6e241c337a4b" status: 204 len: 0 microversion: 2.1 time: 0.164735 Aug 27 02:52:28.726627 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1266/2505] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:52:28 2022] DELETE /compute/v2.1/servers/a59ed991-1ea2-45a0-8c0a-6e241c337a4b => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 02:52:28.737470 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-305ea03b-5da5-484c-b687-85c326c118b0 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:28.740720 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-305ea03b-5da5-484c-b687-85c326c118b0 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: a59ed991-1ea2-45a0-8c0a-6e241c337a4b] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:28.748270 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-305ea03b-5da5-484c-b687-85c326c118b0 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:28.749044 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-305ea03b-5da5-484c-b687-85c326c118b0 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:28.749511 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-305ea03b-5da5-484c-b687-85c326c118b0 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:28.750221 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-305ea03b-5da5-484c-b687-85c326c118b0 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:28.750672 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-305ea03b-5da5-484c-b687-85c326c118b0 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:28.751120 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-305ea03b-5da5-484c-b687-85c326c118b0 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:28.777652 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d0947911-dcc9-4e72-93a2-1adac1f8b68c tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.015336 Aug 27 02:52:28.778913 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1240/2506] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 02:52:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1017 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:52:28.797648 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0f86046f-618d-422c-a0d5-b2820d033961 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:28.799282 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-0f86046f-618d-422c-a0d5-b2820d033961 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: ba987aee-2707-4d47-aba9-d2803aa70745] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:28.809957 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0f86046f-618d-422c-a0d5-b2820d033961 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:28.810728 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0f86046f-618d-422c-a0d5-b2820d033961 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:28.811310 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0f86046f-618d-422c-a0d5-b2820d033961 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:28.812185 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0f86046f-618d-422c-a0d5-b2820d033961 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:28.812859 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0f86046f-618d-422c-a0d5-b2820d033961 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:28.813324 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0f86046f-618d-422c-a0d5-b2820d033961 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:29.003261 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-305ea03b-5da5-484c-b687-85c326c118b0 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:29.017375 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-305ea03b-5da5-484c-b687-85c326c118b0 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/a59ed991-1ea2-45a0-8c0a-6e241c337a4b" status: 200 len: 1492 microversion: 2.1 time: 0.284025 Aug 27 02:52:29.018716 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1267/2507] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:28 2022] GET /compute/v2.1/servers/a59ed991-1ea2-45a0-8c0a-6e241c337a4b => generated 1492 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:29.031039 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-082503eb-32ea-41c3-b896-880057e5c627 tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:29.032774 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-082503eb-32ea-41c3-b896-880057e5c627 tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] [instance: b4b1bc77-1487-47d4-ae3b-14e693c1c4c5] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:29.125632 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-082503eb-32ea-41c3-b896-880057e5c627 tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745fd53ea2694f919ff28af2c17e60a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079fe2e8a6184fba858e3d8e60730fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:29.134033 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-082503eb-32ea-41c3-b896-880057e5c627 tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] 10.222.0.70 "GET /compute/v2.1/servers/b4b1bc77-1487-47d4-ae3b-14e693c1c4c5" status: 200 len: 1214 microversion: 2.1 time: 0.114039 Aug 27 02:52:29.147198 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1268/2508] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:29 2022] GET /compute/v2.1/servers/b4b1bc77-1487-47d4-ae3b-14e693c1c4c5 => generated 1214 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:29.147942 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ae86bc03-cda8-4586-9182-88bb60d90523 tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:29.148862 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-ae86bc03-cda8-4586-9182-88bb60d90523 tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] [instance: 9da9d8a1-ec78-43ed-b29d-8560df6e3937] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:29.174766 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-0f86046f-618d-422c-a0d5-b2820d033961 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:29.182035 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ae86bc03-cda8-4586-9182-88bb60d90523 tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:29.182577 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ae86bc03-cda8-4586-9182-88bb60d90523 tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:29.183037 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ae86bc03-cda8-4586-9182-88bb60d90523 tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:29.183775 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ae86bc03-cda8-4586-9182-88bb60d90523 tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:29.184805 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ae86bc03-cda8-4586-9182-88bb60d90523 tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:29.188706 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-0f86046f-618d-422c-a0d5-b2820d033961 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/ba987aee-2707-4d47-aba9-d2803aa70745" status: 200 len: 1476 microversion: 2.1 time: 0.408254 Aug 27 02:52:29.189801 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1241/2509] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:28 2022] GET /compute/v2.1/servers/ba987aee-2707-4d47-aba9-d2803aa70745 => generated 1476 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:29.197036 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ae86bc03-cda8-4586-9182-88bb60d90523 tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:29.208138 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e4e53d89-c955-4f74-89e7-ffdff5f4379e tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:29.208986 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-e4e53d89-c955-4f74-89e7-ffdff5f4379e tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] [instance: 6ef152e6-ba27-46bd-871a-04d8539b493e] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:29.221287 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e4e53d89-c955-4f74-89e7-ffdff5f4379e tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:29.222152 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e4e53d89-c955-4f74-89e7-ffdff5f4379e tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:29.227787 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e4e53d89-c955-4f74-89e7-ffdff5f4379e tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:29.229087 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e4e53d89-c955-4f74-89e7-ffdff5f4379e tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:29.229815 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e4e53d89-c955-4f74-89e7-ffdff5f4379e tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:29.230527 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e4e53d89-c955-4f74-89e7-ffdff5f4379e tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:29.518382 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-ae86bc03-cda8-4586-9182-88bb60d90523 tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03191d0be5ae427286971e228534be75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efbb3a8866e47d7981008b08e89f416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:29.532397 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-ae86bc03-cda8-4586-9182-88bb60d90523 tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03191d0be5ae427286971e228534be75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efbb3a8866e47d7981008b08e89f416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:29.541454 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-ae86bc03-cda8-4586-9182-88bb60d90523 tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03191d0be5ae427286971e228534be75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efbb3a8866e47d7981008b08e89f416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:29.542768 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ae86bc03-cda8-4586-9182-88bb60d90523 tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] 10.222.0.70 "GET /compute/v2.1/servers/9da9d8a1-ec78-43ed-b29d-8560df6e3937" status: 200 len: 1358 microversion: 2.21 time: 0.404095 Aug 27 02:52:29.546032 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1269/2510] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:52:29 2022] GET /compute/v2.1/servers/9da9d8a1-ec78-43ed-b29d-8560df6e3937 => generated 1358 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:52:29.552698 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-493fa82a-5521-45c0-afc6-739677608ddd tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '.version_select at 0x7f5ee3811c10>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:29.568771 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e4e53d89-c955-4f74-89e7-ffdff5f4379e tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317e74b4bbc4da298a0dcbd78068352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a8810c21784788b4c0ee64dedbaf15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:29.577651 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e4e53d89-c955-4f74-89e7-ffdff5f4379e tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] 10.222.0.70 "GET /compute/v2.1/servers/6ef152e6-ba27-46bd-871a-04d8539b493e" status: 200 len: 1513 microversion: 2.1 time: 0.374732 Aug 27 02:52:29.578568 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1242/2511] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:29 2022] GET /compute/v2.1/servers/6ef152e6-ba27-46bd-871a-04d8539b493e => generated 1513 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:29.597681 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-e0fe8a5c-6d96-4e73-b76f-43a84eec323c req-0094e41a-d395-4527-80c1-b603b525ebd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb0d71f2-158d-4acc-8774-6874e7da29cd", "name": "network-vif-plugged", "status": "completed", "tag": "fe5d48cf-956a-4e15-9a8e-fdd605d313b1"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:52:29.623709 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-e0fe8a5c-6d96-4e73-b76f-43a84eec323c req-0094e41a-d395-4527-80c1-b603b525ebd7 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:29.633520 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-493fa82a-5521-45c0-afc6-739677608ddd tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "GET /compute/v2.1/images/fc902f34-89f1-4a0a-af61-22568052f001" status: 200 len: 1411 microversion: 2.1 time: 0.086122 Aug 27 02:52:29.637277 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-e0fe8a5c-6d96-4e73-b76f-43a84eec323c req-0094e41a-d395-4527-80c1-b603b525ebd7 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:29.637734 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-e0fe8a5c-6d96-4e73-b76f-43a84eec323c req-0094e41a-d395-4527-80c1-b603b525ebd7 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:29.639370 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1270/2512] 10.222.0.70 () {58 vars in 1233 bytes} [Sat Aug 27 02:52:29 2022] GET /compute/v2.1/images/fc902f34-89f1-4a0a-af61-22568052f001 => generated 1411 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:29.708043 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-e0fe8a5c-6d96-4e73-b76f-43a84eec323c req-0094e41a-d395-4527-80c1-b603b525ebd7 service nova] Creating event network-vif-plugged:fe5d48cf-956a-4e15-9a8e-fdd605d313b1 for instance bb0d71f2-158d-4acc-8774-6874e7da29cd on n-h1-852278-4 Aug 27 02:52:29.717467 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-e0fe8a5c-6d96-4e73-b76f-43a84eec323c req-0094e41a-d395-4527-80c1-b603b525ebd7 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136749 Aug 27 02:52:29.722845 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1243/2513] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:52:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:52:30.048827 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-42e6ccc3-dc94-4c96-b006-70225d2ea131 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:30.049443 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-42e6ccc3-dc94-4c96-b006-70225d2ea131 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: a59ed991-1ea2-45a0-8c0a-6e241c337a4b] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:30.056284 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-42e6ccc3-dc94-4c96-b006-70225d2ea131 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:30.056823 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-42e6ccc3-dc94-4c96-b006-70225d2ea131 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:30.059051 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-42e6ccc3-dc94-4c96-b006-70225d2ea131 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:30.059952 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-42e6ccc3-dc94-4c96-b006-70225d2ea131 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:30.060554 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-42e6ccc3-dc94-4c96-b006-70225d2ea131 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:30.060991 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-42e6ccc3-dc94-4c96-b006-70225d2ea131 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:30.069927 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:52:30.157002 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-841107ae-d281-4105-903c-0631ac8b4940 tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:30.157779 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-841107ae-d281-4105-903c-0631ac8b4940 tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] [instance: b4b1bc77-1487-47d4-ae3b-14e693c1c4c5] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:30.175605 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-841107ae-d281-4105-903c-0631ac8b4940 tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:30.179322 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-841107ae-d281-4105-903c-0631ac8b4940 tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:30.181008 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-841107ae-d281-4105-903c-0631ac8b4940 tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:30.182699 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-841107ae-d281-4105-903c-0631ac8b4940 tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:30.184642 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-841107ae-d281-4105-903c-0631ac8b4940 tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:30.185771 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-841107ae-d281-4105-903c-0631ac8b4940 tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:30.233347 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-42e6ccc3-dc94-4c96-b006-70225d2ea131 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:30.246850 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-42e6ccc3-dc94-4c96-b006-70225d2ea131 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/a59ed991-1ea2-45a0-8c0a-6e241c337a4b" status: 200 len: 1492 microversion: 2.1 time: 0.199845 Aug 27 02:52:30.250075 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1271/2514] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:30 2022] GET /compute/v2.1/servers/a59ed991-1ea2-45a0-8c0a-6e241c337a4b => generated 1492 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:30.260738 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ace8f4e8-a7ad-499b-a55f-e671a72505f8 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:30.261645 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-ace8f4e8-a7ad-499b-a55f-e671a72505f8 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: ba987aee-2707-4d47-aba9-d2803aa70745] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:30.271110 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ace8f4e8-a7ad-499b-a55f-e671a72505f8 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:30.271878 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ace8f4e8-a7ad-499b-a55f-e671a72505f8 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:30.272564 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ace8f4e8-a7ad-499b-a55f-e671a72505f8 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:30.273718 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ace8f4e8-a7ad-499b-a55f-e671a72505f8 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:30.274327 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ace8f4e8-a7ad-499b-a55f-e671a72505f8 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:30.275209 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ace8f4e8-a7ad-499b-a55f-e671a72505f8 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:30.294853 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-841107ae-d281-4105-903c-0631ac8b4940 tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745fd53ea2694f919ff28af2c17e60a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079fe2e8a6184fba858e3d8e60730fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:30.306659 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-841107ae-d281-4105-903c-0631ac8b4940 tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] 10.222.0.70 "GET /compute/v2.1/servers/b4b1bc77-1487-47d4-ae3b-14e693c1c4c5" status: 200 len: 1210 microversion: 2.1 time: 0.155503 Aug 27 02:52:30.309053 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1244/2515] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:30 2022] GET /compute/v2.1/servers/b4b1bc77-1487-47d4-ae3b-14e693c1c4c5 => generated 1210 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:30.520265 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-ace8f4e8-a7ad-499b-a55f-e671a72505f8 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:30.540058 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ace8f4e8-a7ad-499b-a55f-e671a72505f8 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/ba987aee-2707-4d47-aba9-d2803aa70745" status: 200 len: 1476 microversion: 2.1 time: 0.288041 Aug 27 02:52:30.540900 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1272/2516] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:30 2022] GET /compute/v2.1/servers/ba987aee-2707-4d47-aba9-d2803aa70745 => generated 1476 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:30.575555 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-58c60b1d-a2d1-43de-bac0-dfe20815782c tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:30.576448 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-58c60b1d-a2d1-43de-bac0-dfe20815782c tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] [instance: 9da9d8a1-ec78-43ed-b29d-8560df6e3937] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:30.607493 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-58c60b1d-a2d1-43de-bac0-dfe20815782c tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:30.608261 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-58c60b1d-a2d1-43de-bac0-dfe20815782c tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:30.611002 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-58c60b1d-a2d1-43de-bac0-dfe20815782c tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:30.613675 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-58c60b1d-a2d1-43de-bac0-dfe20815782c tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:30.615413 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4e308892-884d-49e8-931b-d5056f6d1612 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:30.616060 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-58c60b1d-a2d1-43de-bac0-dfe20815782c tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:30.616843 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-58c60b1d-a2d1-43de-bac0-dfe20815782c tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:30.620997 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-4e308892-884d-49e8-931b-d5056f6d1612 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] [instance: 6ef152e6-ba27-46bd-871a-04d8539b493e] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:30.635295 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4e308892-884d-49e8-931b-d5056f6d1612 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:30.642559 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4e308892-884d-49e8-931b-d5056f6d1612 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:30.643503 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4e308892-884d-49e8-931b-d5056f6d1612 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:30.644568 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4e308892-884d-49e8-931b-d5056f6d1612 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:30.645287 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4e308892-884d-49e8-931b-d5056f6d1612 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:30.646006 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4e308892-884d-49e8-931b-d5056f6d1612 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:30.972737 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-58c60b1d-a2d1-43de-bac0-dfe20815782c tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03191d0be5ae427286971e228534be75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efbb3a8866e47d7981008b08e89f416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:30.976394 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-4e308892-884d-49e8-931b-d5056f6d1612 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317e74b4bbc4da298a0dcbd78068352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a8810c21784788b4c0ee64dedbaf15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:30.984240 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-4e308892-884d-49e8-931b-d5056f6d1612 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] 10.222.0.70 "GET /compute/v2.1/servers/6ef152e6-ba27-46bd-871a-04d8539b493e" status: 200 len: 1513 microversion: 2.1 time: 0.387465 Aug 27 02:52:30.984853 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1273/2517] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:30 2022] GET /compute/v2.1/servers/6ef152e6-ba27-46bd-871a-04d8539b493e => generated 1513 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:52:30.990754 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-58c60b1d-a2d1-43de-bac0-dfe20815782c tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03191d0be5ae427286971e228534be75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efbb3a8866e47d7981008b08e89f416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:30.994524 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e7da1a48-edae-41d5-b5bb-e3b35773d37c tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '.version_select at 0x7f5ee72143a0>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:30.999171 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-58c60b1d-a2d1-43de-bac0-dfe20815782c tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03191d0be5ae427286971e228534be75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efbb3a8866e47d7981008b08e89f416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:31.001313 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-58c60b1d-a2d1-43de-bac0-dfe20815782c tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] 10.222.0.70 "GET /compute/v2.1/servers/9da9d8a1-ec78-43ed-b29d-8560df6e3937" status: 200 len: 1358 microversion: 2.21 time: 0.436286 Aug 27 02:52:31.002047 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1245/2518] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:52:30 2022] GET /compute/v2.1/servers/9da9d8a1-ec78-43ed-b29d-8560df6e3937 => generated 1358 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:52:31.065637 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e7da1a48-edae-41d5-b5bb-e3b35773d37c tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "GET /compute/v2.1/images/fc902f34-89f1-4a0a-af61-22568052f001" status: 200 len: 1420 microversion: 2.1 time: 0.077311 Aug 27 02:52:31.069066 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1274/2519] 10.222.0.70 () {58 vars in 1233 bytes} [Sat Aug 27 02:52:30 2022] GET /compute/v2.1/images/fc902f34-89f1-4a0a-af61-22568052f001 => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:31.082728 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-06e31b0c-db20-4348-8d60-bbd0ee69157c tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '.version_select at 0x7f5edef7fb80>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:31.148622 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-06e31b0c-db20-4348-8d60-bbd0ee69157c tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "GET /compute/v2.1/images/fc902f34-89f1-4a0a-af61-22568052f001" status: 200 len: 1420 microversion: 2.1 time: 0.070244 Aug 27 02:52:31.150289 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1246/2520] 10.222.0.70 () {58 vars in 1233 bytes} [Sat Aug 27 02:52:31 2022] GET /compute/v2.1/images/fc902f34-89f1-4a0a-af61-22568052f001 => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:31.165709 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-47d518bf-f150-43a6-b2da-21fef32e96a8 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '.version_select at 0x7f5ee34b9310>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:31.202203 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:52:31.213315 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-cd24aeea-f569-4323-9192-e8fe063674be req-dc0f8bab-437a-4200-a07e-af163591d639 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a59ed991-1ea2-45a0-8c0a-6e241c337a4b", "name": "network-vif-deleted", "tag": "69e25bdc-655b-4fba-befe-c9cbeb891a75"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:52:31.230606 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-cd24aeea-f569-4323-9192-e8fe063674be req-dc0f8bab-437a-4200-a07e-af163591d639 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:31.234201 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-cd24aeea-f569-4323-9192-e8fe063674be req-dc0f8bab-437a-4200-a07e-af163591d639 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:31.235109 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-cd24aeea-f569-4323-9192-e8fe063674be req-dc0f8bab-437a-4200-a07e-af163591d639 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:31.266613 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:52:31.271796 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-cd24aeea-f569-4323-9192-e8fe063674be req-dc0f8bab-437a-4200-a07e-af163591d639 service nova] Creating event network-vif-deleted:69e25bdc-655b-4fba-befe-c9cbeb891a75 for instance a59ed991-1ea2-45a0-8c0a-6e241c337a4b on n-h2-852278-4 Aug 27 02:52:31.284799 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-cd24aeea-f569-4323-9192-e8fe063674be req-dc0f8bab-437a-4200-a07e-af163591d639 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075751 Aug 27 02:52:31.286262 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1247/2521] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:52:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:52:31.296935 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-de5e9e77-2c40-4990-8017-971920a8b1bb tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:31.298002 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-de5e9e77-2c40-4990-8017-971920a8b1bb tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: a59ed991-1ea2-45a0-8c0a-6e241c337a4b] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:31.305909 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-de5e9e77-2c40-4990-8017-971920a8b1bb tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:31.308861 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-de5e9e77-2c40-4990-8017-971920a8b1bb tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:31.309501 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-de5e9e77-2c40-4990-8017-971920a8b1bb tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:31.310455 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-de5e9e77-2c40-4990-8017-971920a8b1bb tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:31.312449 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-de5e9e77-2c40-4990-8017-971920a8b1bb tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:31.313057 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-de5e9e77-2c40-4990-8017-971920a8b1bb tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:31.521915 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-de5e9e77-2c40-4990-8017-971920a8b1bb tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:31.538971 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-de5e9e77-2c40-4990-8017-971920a8b1bb tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/a59ed991-1ea2-45a0-8c0a-6e241c337a4b" status: 200 len: 1285 microversion: 2.1 time: 0.248657 Aug 27 02:52:31.542148 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1248/2522] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:31 2022] GET /compute/v2.1/servers/a59ed991-1ea2-45a0-8c0a-6e241c337a4b => generated 1285 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:31.554682 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e9d3a663-733f-4782-b610-b56a47eb2411 tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:31.555383 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-e9d3a663-733f-4782-b610-b56a47eb2411 tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] [instance: b4b1bc77-1487-47d4-ae3b-14e693c1c4c5] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:31.564778 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e9d3a663-733f-4782-b610-b56a47eb2411 tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:31.565281 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e9d3a663-733f-4782-b610-b56a47eb2411 tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:31.565724 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e9d3a663-733f-4782-b610-b56a47eb2411 tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:31.566603 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e9d3a663-733f-4782-b610-b56a47eb2411 tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:31.567060 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e9d3a663-733f-4782-b610-b56a47eb2411 tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:31.567488 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e9d3a663-733f-4782-b610-b56a47eb2411 tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:31.662555 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e9d3a663-733f-4782-b610-b56a47eb2411 tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745fd53ea2694f919ff28af2c17e60a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079fe2e8a6184fba858e3d8e60730fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:31.673615 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e9d3a663-733f-4782-b610-b56a47eb2411 tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] 10.222.0.70 "GET /compute/v2.1/servers/b4b1bc77-1487-47d4-ae3b-14e693c1c4c5" status: 200 len: 1284 microversion: 2.1 time: 0.130315 Aug 27 02:52:31.676678 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1249/2523] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:31 2022] GET /compute/v2.1/servers/b4b1bc77-1487-47d4-ae3b-14e693c1c4c5 => generated 1284 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:31.681604 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a375b198-4d26-4f6d-b568-79b61cc1fa43 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:31.682211 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-a375b198-4d26-4f6d-b568-79b61cc1fa43 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: ba987aee-2707-4d47-aba9-d2803aa70745] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:31.702274 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a375b198-4d26-4f6d-b568-79b61cc1fa43 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:31.705749 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a375b198-4d26-4f6d-b568-79b61cc1fa43 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:31.706478 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a375b198-4d26-4f6d-b568-79b61cc1fa43 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:31.707719 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a375b198-4d26-4f6d-b568-79b61cc1fa43 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:31.707825 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a375b198-4d26-4f6d-b568-79b61cc1fa43 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:31.708247 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a375b198-4d26-4f6d-b568-79b61cc1fa43 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:31.982874 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-a375b198-4d26-4f6d-b568-79b61cc1fa43 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:31.993300 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a375b198-4d26-4f6d-b568-79b61cc1fa43 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/ba987aee-2707-4d47-aba9-d2803aa70745" status: 200 len: 1476 microversion: 2.1 time: 0.315542 Aug 27 02:52:31.995949 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1250/2524] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:31 2022] GET /compute/v2.1/servers/ba987aee-2707-4d47-aba9-d2803aa70745 => generated 1476 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:32.013497 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7de95769-8d9b-4bf0-819a-1642bff00eeb tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:32.014068 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-7de95769-8d9b-4bf0-819a-1642bff00eeb tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] [instance: 6ef152e6-ba27-46bd-871a-04d8539b493e] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:32.028288 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7de95769-8d9b-4bf0-819a-1642bff00eeb tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:32.030838 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7de95769-8d9b-4bf0-819a-1642bff00eeb tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:32.031567 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7de95769-8d9b-4bf0-819a-1642bff00eeb tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:32.033702 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7de95769-8d9b-4bf0-819a-1642bff00eeb tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:32.035002 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7de95769-8d9b-4bf0-819a-1642bff00eeb tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:32.037130 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7de95769-8d9b-4bf0-819a-1642bff00eeb tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:32.123071 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-47d518bf-f150-43a6-b2da-21fef32e96a8 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "DELETE /compute/v2.1/images/fc902f34-89f1-4a0a-af61-22568052f001" status: 204 len: 0 microversion: 2.1 time: 0.963051 Aug 27 02:52:32.124419 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1275/2525] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:31 2022] DELETE /compute/v2.1/images/fc902f34-89f1-4a0a-af61-22568052f001 => generated 0 bytes in 965 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 02:52:32.130312 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d8e098da-df0c-4a02-9b02-02250dc2c256 tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:32.131013 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d8e098da-df0c-4a02-9b02-02250dc2c256 tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] [instance: 9da9d8a1-ec78-43ed-b29d-8560df6e3937] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:32.149479 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d8e098da-df0c-4a02-9b02-02250dc2c256 tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:32.152656 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d8e098da-df0c-4a02-9b02-02250dc2c256 tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:32.154464 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d8e098da-df0c-4a02-9b02-02250dc2c256 tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:32.156582 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d8e098da-df0c-4a02-9b02-02250dc2c256 tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:32.157344 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d8e098da-df0c-4a02-9b02-02250dc2c256 tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:32.158413 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d8e098da-df0c-4a02-9b02-02250dc2c256 tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:32.558589 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-7de95769-8d9b-4bf0-819a-1642bff00eeb tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317e74b4bbc4da298a0dcbd78068352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a8810c21784788b4c0ee64dedbaf15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:32.568250 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-7de95769-8d9b-4bf0-819a-1642bff00eeb tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] 10.222.0.70 "GET /compute/v2.1/servers/6ef152e6-ba27-46bd-871a-04d8539b493e" status: 200 len: 1513 microversion: 2.1 time: 0.561391 Aug 27 02:52:32.568884 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1251/2526] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:32 2022] GET /compute/v2.1/servers/6ef152e6-ba27-46bd-871a-04d8539b493e => generated 1513 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:52:32.574010 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-89cddef3-34d5-4a80-9d25-db4bd85c879b tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:32.574658 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-89cddef3-34d5-4a80-9d25-db4bd85c879b tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] [instance: 457da794-89e7-4b30-95ba-802c95550c7e] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:32.580778 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-89cddef3-34d5-4a80-9d25-db4bd85c879b tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:32.581476 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-89cddef3-34d5-4a80-9d25-db4bd85c879b tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:32.582077 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-89cddef3-34d5-4a80-9d25-db4bd85c879b tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:32.582924 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-89cddef3-34d5-4a80-9d25-db4bd85c879b tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:32.583519 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-89cddef3-34d5-4a80-9d25-db4bd85c879b tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:32.584069 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-89cddef3-34d5-4a80-9d25-db4bd85c879b tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:32.606345 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-d8e098da-df0c-4a02-9b02-02250dc2c256 tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03191d0be5ae427286971e228534be75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efbb3a8866e47d7981008b08e89f416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:32.614743 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-89cddef3-34d5-4a80-9d25-db4bd85c879b tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] [instance: 457da794-89e7-4b30-95ba-802c95550c7e] Going to try to terminate instance {{(pid=134051) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:52:32.620211 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-d8e098da-df0c-4a02-9b02-02250dc2c256 tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03191d0be5ae427286971e228534be75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efbb3a8866e47d7981008b08e89f416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:32.621859 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-d8e098da-df0c-4a02-9b02-02250dc2c256 tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03191d0be5ae427286971e228534be75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efbb3a8866e47d7981008b08e89f416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:32.623032 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d8e098da-df0c-4a02-9b02-02250dc2c256 tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] 10.222.0.70 "GET /compute/v2.1/servers/9da9d8a1-ec78-43ed-b29d-8560df6e3937" status: 200 len: 1358 microversion: 2.21 time: 0.497274 Aug 27 02:52:32.655213 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1276/2527] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:52:32 2022] GET /compute/v2.1/servers/9da9d8a1-ec78-43ed-b29d-8560df6e3937 => generated 1358 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:52:32.665364 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-99c41512-16d6-41ad-aecd-20c22f45302f tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:32.673588 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-99c41512-16d6-41ad-aecd-20c22f45302f tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8ece2eb399074418ac5f890d223c1be0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c13c50438234109913876bf5a11d271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:32.675082 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-99c41512-16d6-41ad-aecd-20c22f45302f tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Searching by: {'deleted': False, 'project_id': '6c13c50438234109913876bf5a11d271'} {{(pid=134052) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 02:52:32.694424 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-99c41512-16d6-41ad-aecd-20c22f45302f tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:32.695304 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-99c41512-16d6-41ad-aecd-20c22f45302f tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:32.696010 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-99c41512-16d6-41ad-aecd-20c22f45302f tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:32.704903 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-99c41512-16d6-41ad-aecd-20c22f45302f tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:32.705869 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-99c41512-16d6-41ad-aecd-20c22f45302f tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:32.706326 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-99c41512-16d6-41ad-aecd-20c22f45302f tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:32.729503 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-89cddef3-34d5-4a80-9d25-db4bd85c879b tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "DELETE /compute/v2.1/servers/457da794-89e7-4b30-95ba-802c95550c7e" status: 204 len: 0 microversion: 2.1 time: 0.159040 Aug 27 02:52:32.730600 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1252/2528] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:52:32 2022] DELETE /compute/v2.1/servers/457da794-89e7-4b30-95ba-802c95550c7e => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:52:32.738417 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8e36bdd5-e372-4700-afdc-b86ef7b692df tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:32.739480 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-8e36bdd5-e372-4700-afdc-b86ef7b692df tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: a59ed991-1ea2-45a0-8c0a-6e241c337a4b] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:32.746047 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.multi_cell_list [None req-99c41512-16d6-41ad-aecd-20c22f45302f tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=134052) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 02:52:32.765628 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8e36bdd5-e372-4700-afdc-b86ef7b692df tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:32.767311 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8e36bdd5-e372-4700-afdc-b86ef7b692df tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:32.767947 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8e36bdd5-e372-4700-afdc-b86ef7b692df tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:32.772058 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8e36bdd5-e372-4700-afdc-b86ef7b692df tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:32.773382 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8e36bdd5-e372-4700-afdc-b86ef7b692df tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:32.774013 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8e36bdd5-e372-4700-afdc-b86ef7b692df tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:32.790346 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-99c41512-16d6-41ad-aecd-20c22f45302f tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] 10.222.0.70 "GET /compute/v2.1/servers" status: 200 len: 334 microversion: 2.1 time: 0.133738 Aug 27 02:52:32.791706 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1277/2529] 10.222.0.70 () {58 vars in 1125 bytes} [Sat Aug 27 02:52:32 2022] GET /compute/v2.1/servers => generated 334 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:52:32.795839 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-8e36bdd5-e372-4700-afdc-b86ef7b692df tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] HTTP exception thrown: Instance a59ed991-1ea2-45a0-8c0a-6e241c337a4b could not be found. Aug 27 02:52:32.798203 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8e36bdd5-e372-4700-afdc-b86ef7b692df tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Request method failure captured: Aug 27 02:52:32.798203 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/a59ed991-1ea2-45a0-8c0a-6e241c337a4b HTTP/1.1 Aug 27 02:52:32.798203 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:52:32.798203 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:52:32.798203 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:52:32.798203 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:52:32.798203 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:52:32.798203 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:52:32.798203 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:52:32.798203 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:52:32.798203 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYZ0St41cKkzS8_oefTYdmhcUQuTjHJMchuX75Wes8eVywW22WD3_nUDa_aMbIFBVV51GGjDa8GDt8SbwEVTMvQnSuXk6MkeKEfB2NWHjFnNKSNKnT9A2S4P8aN7qYWhUsGxW2ugzvIrMVMPtkn5w90KE7af4tlEcxQ5ERFDVU7f32Y Aug 27 02:52:32.798203 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:52:32.798203 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:52:32.798203 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:52:32.798203 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:52:32.798203 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:52:32.798203 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:52:32.798203 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 840077c9375b4b2a9214cb8dda094cc8 Aug 27 02:52:32.798203 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-DeleteServersTestJSON-725615510 Aug 27 02:52:32.798203 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:52:32.798203 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:52:32.798203 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/840077c9375b4b2a9214cb8dda094cc8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_840077c9375b4b2a9214cb8dda094cc8", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/840077c9375b4b2a9214cb8dda094cc8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/840077c9375b4b2a9214cb8dda094cc8"}]}] Aug 27 02:52:32.798203 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-DeleteServersTestJSON-725615510 Aug 27 02:52:32.798203 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 840077c9375b4b2a9214cb8dda094cc8 Aug 27 02:52:32.798203 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-DeleteServersTestJSON-725615510 Aug 27 02:52:32.798203 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-DeleteServersTestJSON-725615510-project Aug 27 02:52:32.798203 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:52:32.798203 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:52:32.798203 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: dc53b0977c2b4e06b2f290442483913b Aug 27 02:52:32.798203 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-DeleteServersTestJSON-725615510-project Aug 27 02:52:32.798203 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 02:52:32.798203 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance a59ed991-1ea2-45a0-8c0a-6e241c337a4b could not be found. Aug 27 02:52:32.798203 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': 'a59ed991-1ea2-45a0-8c0a-6e241c337a4b'} Aug 27 02:52:32.798203 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:52:32.798203 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:52:32.798203 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:52:32.798203 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:52:32.798203 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:52:32.798203 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:52:32.798203 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:52:32.798203 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:52:32.798203 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:52:32.798203 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:52:32.798203 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a59ed991-1ea2-45a0-8c0a-6e241c337a4b could not be found. Aug 27 02:52:32.798203 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:52:32.798203 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:52:32.798203 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:52:32.798203 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:52:32.798203 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:52:32.798203 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:52:32.798203 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:52:32.798203 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:52:32.798203 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:52:32.798203 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:52:32.798203 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:52:32.798203 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:52:32.798203 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:52:32.798203 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:52:32.798203 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:52:32.798203 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:52:32.798203 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a59ed991-1ea2-45a0-8c0a-6e241c337a4b could not be found. Aug 27 02:52:32.798203 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:52:32.798203 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:52:32.798203 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:52:32.803335 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:52:32.803335 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:52:32.803335 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:52:32.803335 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:52:32.803335 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:52:32.803335 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a59ed991-1ea2-45a0-8c0a-6e241c337a4b could not be found. Aug 27 02:52:32.803335 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:52:32.803335 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8e36bdd5-e372-4700-afdc-b86ef7b692df tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Returning 404 to user: Instance a59ed991-1ea2-45a0-8c0a-6e241c337a4b could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:52:32.803335 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-8e36bdd5-e372-4700-afdc-b86ef7b692df tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/a59ed991-1ea2-45a0-8c0a-6e241c337a4b" status: 404 len: 111 microversion: 2.1 time: 0.068119 Aug 27 02:52:32.803335 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1253/2530] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:32 2022] GET /compute/v2.1/servers/a59ed991-1ea2-45a0-8c0a-6e241c337a4b => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:52:32.805543 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9285285c-422b-4a01-868e-dab68bbf30b1 tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:32.805920 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-6886024c-c7f6-4252-af0f-3c360ced61d8 tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:32.806690 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-9285285c-422b-4a01-868e-dab68bbf30b1 tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] [instance: b4b1bc77-1487-47d4-ae3b-14e693c1c4c5] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:32.811481 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-6886024c-c7f6-4252-af0f-3c360ced61d8 tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8ece2eb399074418ac5f890d223c1be0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c13c50438234109913876bf5a11d271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:32.812482 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-6886024c-c7f6-4252-af0f-3c360ced61d8 tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Searching by: {'deleted': False, 'project_id': '6c13c50438234109913876bf5a11d271'} {{(pid=134051) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 02:52:32.814100 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9285285c-422b-4a01-868e-dab68bbf30b1 tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:32.814847 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9285285c-422b-4a01-868e-dab68bbf30b1 tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:32.816066 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9285285c-422b-4a01-868e-dab68bbf30b1 tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:32.817111 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9285285c-422b-4a01-868e-dab68bbf30b1 tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:32.818150 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9285285c-422b-4a01-868e-dab68bbf30b1 tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:32.818795 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9285285c-422b-4a01-868e-dab68bbf30b1 tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:32.819357 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6886024c-c7f6-4252-af0f-3c360ced61d8 tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:32.820265 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6886024c-c7f6-4252-af0f-3c360ced61d8 tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:32.820265 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6886024c-c7f6-4252-af0f-3c360ced61d8 tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:32.820983 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6886024c-c7f6-4252-af0f-3c360ced61d8 tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:32.821426 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6886024c-c7f6-4252-af0f-3c360ced61d8 tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:32.822013 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6886024c-c7f6-4252-af0f-3c360ced61d8 tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:32.891038 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.multi_cell_list [None req-6886024c-c7f6-4252-af0f-3c360ced61d8 tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=134051) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 02:52:32.952382 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-6886024c-c7f6-4252-af0f-3c360ced61d8 tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ece2eb399074418ac5f890d223c1be0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c13c50438234109913876bf5a11d271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:32.963471 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6886024c-c7f6-4252-af0f-3c360ced61d8 tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:32.964304 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6886024c-c7f6-4252-af0f-3c360ced61d8 tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:32.964458 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6886024c-c7f6-4252-af0f-3c360ced61d8 tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:33.178705 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-9285285c-422b-4a01-868e-dab68bbf30b1 tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745fd53ea2694f919ff28af2c17e60a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079fe2e8a6184fba858e3d8e60730fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:33.192139 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-6886024c-c7f6-4252-af0f-3c360ced61d8 tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] 10.222.0.70 "GET /compute/v2.1/servers/detail" status: 200 len: 1698 microversion: 2.1 time: 0.390073 Aug 27 02:52:33.208499 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9285285c-422b-4a01-868e-dab68bbf30b1 tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] 10.222.0.70 "GET /compute/v2.1/servers/b4b1bc77-1487-47d4-ae3b-14e693c1c4c5" status: 200 len: 1314 microversion: 2.1 time: 0.414860 Aug 27 02:52:33.208896 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1254/2531] 10.222.0.70 () {58 vars in 1146 bytes} [Sat Aug 27 02:52:32 2022] GET /compute/v2.1/servers/detail => generated 1698 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:33.216700 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-73adda46-2b0a-4bc7-8269-9474249cee5c tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-427788067", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "networks": [{"uuid": "677b7ba1-2913-4272-8be4-7a8908d3b556"}]}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:52:33.233340 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1278/2532] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:32 2022] GET /compute/v2.1/servers/b4b1bc77-1487-47d4-ae3b-14e693c1c4c5 => generated 1314 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:33.252674 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9ca27b6d-c595-495e-9fd1-48b1cf510fed tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:33.253738 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-9ca27b6d-c595-495e-9fd1-48b1cf510fed tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: ba987aee-2707-4d47-aba9-d2803aa70745] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:33.268507 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9ca27b6d-c595-495e-9fd1-48b1cf510fed tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:33.269281 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9ca27b6d-c595-495e-9fd1-48b1cf510fed tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:33.269878 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9ca27b6d-c595-495e-9fd1-48b1cf510fed tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:33.270752 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9ca27b6d-c595-495e-9fd1-48b1cf510fed tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:33.273183 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9ca27b6d-c595-495e-9fd1-48b1cf510fed tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:33.277323 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9ca27b6d-c595-495e-9fd1-48b1cf510fed tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:33.324838 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.network.neutron [None req-73adda46-2b0a-4bc7-8269-9474249cee5c tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] validate_networks() for [('677b7ba1-2913-4272-8be4-7a8908d3b556', None, None, None, None, None)] {{(pid=134051) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:52:34.006499 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-9ca27b6d-c595-495e-9fd1-48b1cf510fed tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:34.014929 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9ca27b6d-c595-495e-9fd1-48b1cf510fed tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/ba987aee-2707-4d47-aba9-d2803aa70745" status: 200 len: 1476 microversion: 2.1 time: 0.778272 Aug 27 02:52:34.028539 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1279/2533] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:33 2022] GET /compute/v2.1/servers/ba987aee-2707-4d47-aba9-d2803aa70745 => generated 1476 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:34.028539 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3b171bb2-ba20-4e9e-b038-b6868e988e23 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-475882480", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "networks": [{"uuid": "9f81fa4d-d0d4-411f-b6ce-c99b22cb14d3"}]}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:52:34.082170 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.network.neutron [None req-3b171bb2-ba20-4e9e-b038-b6868e988e23 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] validate_networks() for [('9f81fa4d-d0d4-411f-b6ce-c99b22cb14d3', None, None, None, None, None)] {{(pid=134052) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:52:34.554768 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-73adda46-2b0a-4bc7-8269-9474249cee5c tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Flavor limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:52:34.555291 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-73adda46-2b0a-4bc7-8269-9474249cee5c tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Image limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:52:34.556167 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-73adda46-2b0a-4bc7-8269-9474249cee5c tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Flavor pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:52:34.556167 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-73adda46-2b0a-4bc7-8269-9474249cee5c tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Image pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:52:34.556880 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-73adda46-2b0a-4bc7-8269-9474249cee5c tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:52:34.569461 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-73adda46-2b0a-4bc7-8269-9474249cee5c tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:34.569948 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-73adda46-2b0a-4bc7-8269-9474249cee5c tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:34.570399 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-73adda46-2b0a-4bc7-8269-9474249cee5c tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:34.571155 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-73adda46-2b0a-4bc7-8269-9474249cee5c tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:34.571751 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-73adda46-2b0a-4bc7-8269-9474249cee5c tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:34.572281 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-73adda46-2b0a-4bc7-8269-9474249cee5c tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:34.597866 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-73adda46-2b0a-4bc7-8269-9474249cee5c tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Getting quotas for project 40794f05e8b94a0f8f087a87a58e0ba1. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:52:34.608021 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-73adda46-2b0a-4bc7-8269-9474249cee5c tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Getting quotas for user f496f24dccea47bd9a5ab532fe45e370 and project 40794f05e8b94a0f8f087a87a58e0ba1. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:52:34.620848 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-73adda46-2b0a-4bc7-8269-9474249cee5c tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Going to run 1 instances... {{(pid=134051) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:52:34.623451 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-73adda46-2b0a-4bc7-8269-9474249cee5c tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] [instance: 546a5816-c2d9-494b-8c23-b0983cd11eb9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134051) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:52:34.709589 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-73adda46-2b0a-4bc7-8269-9474249cee5c tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.499638 Aug 27 02:52:34.710797 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1255/2534] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 02:52:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1501 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:52:34.715808 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f67bdc71-6373-4bc9-8bb6-cba1b15601cc tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:34.727202 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-f67bdc71-6373-4bc9-8bb6-cba1b15601cc tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] 10.222.0.70 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015183 Aug 27 02:52:34.728283 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1256/2535] 10.222.0.70 () {58 vars in 1137 bytes} [Sat Aug 27 02:52:34 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:52:34.733136 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-780d535e-fa2c-4048-bc01-67e2ff837c19 req-b70db135-0b44-491c-8f04-03e01fe4a764 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9da9d8a1-ec78-43ed-b29d-8560df6e3937", "name": "network-vif-plugged", "status": "completed", "tag": "748de1f1-74e0-437d-aa71-384f6db35553"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:52:34.744187 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-780d535e-fa2c-4048-bc01-67e2ff837c19 req-b70db135-0b44-491c-8f04-03e01fe4a764 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:34.745468 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-780d535e-fa2c-4048-bc01-67e2ff837c19 req-b70db135-0b44-491c-8f04-03e01fe4a764 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:34.745468 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-780d535e-fa2c-4048-bc01-67e2ff837c19 req-b70db135-0b44-491c-8f04-03e01fe4a764 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:34.771358 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-780d535e-fa2c-4048-bc01-67e2ff837c19 req-b70db135-0b44-491c-8f04-03e01fe4a764 service nova] Creating event network-vif-plugged:748de1f1-74e0-437d-aa71-384f6db35553 for instance 9da9d8a1-ec78-43ed-b29d-8560df6e3937 on n-h1-852278-4 Aug 27 02:52:34.779930 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-780d535e-fa2c-4048-bc01-67e2ff837c19 req-b70db135-0b44-491c-8f04-03e01fe4a764 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049778 Aug 27 02:52:34.780919 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1257/2536] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:52:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:52:34.789367 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-83a7e95b-6b4e-4f54-8d06-7650815f47fa tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:34.790595 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-83a7e95b-6b4e-4f54-8d06-7650815f47fa tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] [instance: 6ef152e6-ba27-46bd-871a-04d8539b493e] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:34.805521 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-83a7e95b-6b4e-4f54-8d06-7650815f47fa tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:34.806721 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-83a7e95b-6b4e-4f54-8d06-7650815f47fa tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:34.807412 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-83a7e95b-6b4e-4f54-8d06-7650815f47fa tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:34.808551 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-83a7e95b-6b4e-4f54-8d06-7650815f47fa tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:34.809229 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-83a7e95b-6b4e-4f54-8d06-7650815f47fa tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:34.809881 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-83a7e95b-6b4e-4f54-8d06-7650815f47fa tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:35.325962 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-3b171bb2-ba20-4e9e-b038-b6868e988e23 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Flavor limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:52:35.329951 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-3b171bb2-ba20-4e9e-b038-b6868e988e23 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Image limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:52:35.330798 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-3b171bb2-ba20-4e9e-b038-b6868e988e23 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Flavor pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:52:35.333462 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-3b171bb2-ba20-4e9e-b038-b6868e988e23 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Image pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:52:35.334213 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-3b171bb2-ba20-4e9e-b038-b6868e988e23 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:52:35.364387 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3b171bb2-ba20-4e9e-b038-b6868e988e23 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:35.365584 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3b171bb2-ba20-4e9e-b038-b6868e988e23 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:35.366453 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3b171bb2-ba20-4e9e-b038-b6868e988e23 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:35.368387 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3b171bb2-ba20-4e9e-b038-b6868e988e23 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:35.369504 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3b171bb2-ba20-4e9e-b038-b6868e988e23 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:35.370934 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3b171bb2-ba20-4e9e-b038-b6868e988e23 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:35.401656 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-3b171bb2-ba20-4e9e-b038-b6868e988e23 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Getting quotas for project 840077c9375b4b2a9214cb8dda094cc8. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:52:35.414083 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-83a7e95b-6b4e-4f54-8d06-7650815f47fa tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317e74b4bbc4da298a0dcbd78068352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a8810c21784788b4c0ee64dedbaf15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:35.417119 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-3b171bb2-ba20-4e9e-b038-b6868e988e23 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Getting quotas for user dc53b0977c2b4e06b2f290442483913b and project 840077c9375b4b2a9214cb8dda094cc8. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:52:35.423729 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:52:35.424513 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-83a7e95b-6b4e-4f54-8d06-7650815f47fa tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] 10.222.0.70 "GET /compute/v2.1/servers/6ef152e6-ba27-46bd-871a-04d8539b493e" status: 200 len: 1513 microversion: 2.1 time: 0.641609 Aug 27 02:52:35.426612 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1258/2537] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:34 2022] GET /compute/v2.1/servers/6ef152e6-ba27-46bd-871a-04d8539b493e => generated 1513 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:35.442147 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-1645341d-6f4b-4d98-8d34-83da130b42cb tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:35.446732 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-1645341d-6f4b-4d98-8d34-83da130b42cb tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] [instance: 9da9d8a1-ec78-43ed-b29d-8560df6e3937] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:35.455629 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1645341d-6f4b-4d98-8d34-83da130b42cb tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:35.461105 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1645341d-6f4b-4d98-8d34-83da130b42cb tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:35.461812 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1645341d-6f4b-4d98-8d34-83da130b42cb tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:35.462797 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1645341d-6f4b-4d98-8d34-83da130b42cb tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:35.464867 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-3b171bb2-ba20-4e9e-b038-b6868e988e23 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Going to run 1 instances... {{(pid=134052) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:52:35.465043 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1645341d-6f4b-4d98-8d34-83da130b42cb tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:35.467012 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1645341d-6f4b-4d98-8d34-83da130b42cb tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:35.468428 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-3b171bb2-ba20-4e9e-b038-b6868e988e23 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: 97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134052) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:52:35.563583 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-3b171bb2-ba20-4e9e-b038-b6868e988e23 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.542404 Aug 27 02:52:35.567552 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1280/2538] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 02:52:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1551 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:52:35.600446 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-90aed920-d8c2-4bf2-8030-c3ad0b58e420 tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:35.601463 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-90aed920-d8c2-4bf2-8030-c3ad0b58e420 tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] [instance: b4b1bc77-1487-47d4-ae3b-14e693c1c4c5] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:35.610255 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-90aed920-d8c2-4bf2-8030-c3ad0b58e420 tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:35.611310 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-90aed920-d8c2-4bf2-8030-c3ad0b58e420 tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:35.611982 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-90aed920-d8c2-4bf2-8030-c3ad0b58e420 tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:35.613618 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-90aed920-d8c2-4bf2-8030-c3ad0b58e420 tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:35.614322 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-90aed920-d8c2-4bf2-8030-c3ad0b58e420 tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:35.614975 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-90aed920-d8c2-4bf2-8030-c3ad0b58e420 tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:36.148355 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-1645341d-6f4b-4d98-8d34-83da130b42cb tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03191d0be5ae427286971e228534be75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efbb3a8866e47d7981008b08e89f416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:36.159826 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-1645341d-6f4b-4d98-8d34-83da130b42cb tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03191d0be5ae427286971e228534be75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efbb3a8866e47d7981008b08e89f416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:36.164260 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-1645341d-6f4b-4d98-8d34-83da130b42cb tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03191d0be5ae427286971e228534be75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efbb3a8866e47d7981008b08e89f416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:36.165792 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-1645341d-6f4b-4d98-8d34-83da130b42cb tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] 10.222.0.70 "GET /compute/v2.1/servers/9da9d8a1-ec78-43ed-b29d-8560df6e3937" status: 200 len: 1358 microversion: 2.21 time: 0.733328 Aug 27 02:52:36.170513 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1259/2539] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:52:35 2022] GET /compute/v2.1/servers/9da9d8a1-ec78-43ed-b29d-8560df6e3937 => generated 1358 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:52:36.184123 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-fc74dd75-7431-4b8e-b944-7dfe1393c5a9 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:36.185053 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-fc74dd75-7431-4b8e-b944-7dfe1393c5a9 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] [instance: 546a5816-c2d9-494b-8c23-b0983cd11eb9] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:36.201400 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fc74dd75-7431-4b8e-b944-7dfe1393c5a9 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:36.202528 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fc74dd75-7431-4b8e-b944-7dfe1393c5a9 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:36.204263 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fc74dd75-7431-4b8e-b944-7dfe1393c5a9 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:36.207296 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fc74dd75-7431-4b8e-b944-7dfe1393c5a9 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:36.208433 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fc74dd75-7431-4b8e-b944-7dfe1393c5a9 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:36.209732 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fc74dd75-7431-4b8e-b944-7dfe1393c5a9 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:36.271223 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-90aed920-d8c2-4bf2-8030-c3ad0b58e420 tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745fd53ea2694f919ff28af2c17e60a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079fe2e8a6184fba858e3d8e60730fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:36.279500 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-90aed920-d8c2-4bf2-8030-c3ad0b58e420 tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] 10.222.0.70 "GET /compute/v2.1/servers/b4b1bc77-1487-47d4-ae3b-14e693c1c4c5" status: 200 len: 1314 microversion: 2.1 time: 0.709919 Aug 27 02:52:36.280256 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1281/2540] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:35 2022] GET /compute/v2.1/servers/b4b1bc77-1487-47d4-ae3b-14e693c1c4c5 => generated 1314 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:36.295682 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f5887b7a-7d54-4f56-b94f-b3ec1d7ab2e7 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:36.296333 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-f5887b7a-7d54-4f56-b94f-b3ec1d7ab2e7 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: ba987aee-2707-4d47-aba9-d2803aa70745] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:36.308732 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f5887b7a-7d54-4f56-b94f-b3ec1d7ab2e7 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:36.309754 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f5887b7a-7d54-4f56-b94f-b3ec1d7ab2e7 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:36.310194 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f5887b7a-7d54-4f56-b94f-b3ec1d7ab2e7 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:36.311181 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f5887b7a-7d54-4f56-b94f-b3ec1d7ab2e7 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:36.311640 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f5887b7a-7d54-4f56-b94f-b3ec1d7ab2e7 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:36.312060 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f5887b7a-7d54-4f56-b94f-b3ec1d7ab2e7 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:36.377058 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-fc74dd75-7431-4b8e-b944-7dfe1393c5a9 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f496f24dccea47bd9a5ab532fe45e370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40794f05e8b94a0f8f087a87a58e0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:36.393198 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-fc74dd75-7431-4b8e-b944-7dfe1393c5a9 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "GET /compute/v2.1/servers/546a5816-c2d9-494b-8c23-b0983cd11eb9" status: 200 len: 1259 microversion: 2.1 time: 0.221262 Aug 27 02:52:36.394113 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1260/2541] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:36 2022] GET /compute/v2.1/servers/546a5816-c2d9-494b-8c23-b0983cd11eb9 => generated 1259 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:36.411944 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ebf2fe45-f8c0-4fb2-8d9a-c76f76d93ce4 tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:36.425154 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-ebf2fe45-f8c0-4fb2-8d9a-c76f76d93ce4 tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] [instance: 503900da-e41b-4787-bb1e-9d3df7df05b6] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:36.432508 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ebf2fe45-f8c0-4fb2-8d9a-c76f76d93ce4 tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:36.433918 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ebf2fe45-f8c0-4fb2-8d9a-c76f76d93ce4 tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:36.434525 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ebf2fe45-f8c0-4fb2-8d9a-c76f76d93ce4 tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:36.435418 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ebf2fe45-f8c0-4fb2-8d9a-c76f76d93ce4 tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:36.436452 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ebf2fe45-f8c0-4fb2-8d9a-c76f76d93ce4 tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:36.436879 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ebf2fe45-f8c0-4fb2-8d9a-c76f76d93ce4 tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:36.468571 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-ebf2fe45-f8c0-4fb2-8d9a-c76f76d93ce4 tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] [instance: 503900da-e41b-4787-bb1e-9d3df7df05b6] Going to try to terminate instance {{(pid=134051) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:52:36.564864 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ebf2fe45-f8c0-4fb2-8d9a-c76f76d93ce4 tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] 10.222.0.70 "DELETE /compute/v2.1/servers/503900da-e41b-4787-bb1e-9d3df7df05b6" status: 204 len: 0 microversion: 2.1 time: 0.156388 Aug 27 02:52:36.569024 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1261/2542] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:52:36 2022] DELETE /compute/v2.1/servers/503900da-e41b-4787-bb1e-9d3df7df05b6 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:52:36.586466 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a26836ba-96d9-49ec-972c-a1c2987b97c3 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:36.586713 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-a26836ba-96d9-49ec-972c-a1c2987b97c3 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: 97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:36.604884 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a26836ba-96d9-49ec-972c-a1c2987b97c3 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:36.608987 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a26836ba-96d9-49ec-972c-a1c2987b97c3 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:36.609608 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a26836ba-96d9-49ec-972c-a1c2987b97c3 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:36.610654 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a26836ba-96d9-49ec-972c-a1c2987b97c3 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:36.611265 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a26836ba-96d9-49ec-972c-a1c2987b97c3 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:36.611694 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a26836ba-96d9-49ec-972c-a1c2987b97c3 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:36.859696 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-a26836ba-96d9-49ec-972c-a1c2987b97c3 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:36.884963 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a26836ba-96d9-49ec-972c-a1c2987b97c3 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4" status: 200 len: 1218 microversion: 2.1 time: 0.314390 Aug 27 02:52:36.891863 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1262/2543] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:36 2022] GET /compute/v2.1/servers/97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4 => generated 1218 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:36.907553 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-2f089296-e02d-47ee-9c82-44f52b5c3fe9 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:36.912861 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-2f089296-e02d-47ee-9c82-44f52b5c3fe9 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] [instance: 6ef152e6-ba27-46bd-871a-04d8539b493e] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:36.919689 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2f089296-e02d-47ee-9c82-44f52b5c3fe9 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:36.926099 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2f089296-e02d-47ee-9c82-44f52b5c3fe9 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:36.926734 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2f089296-e02d-47ee-9c82-44f52b5c3fe9 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:36.927642 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2f089296-e02d-47ee-9c82-44f52b5c3fe9 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:36.928249 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2f089296-e02d-47ee-9c82-44f52b5c3fe9 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:36.929205 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2f089296-e02d-47ee-9c82-44f52b5c3fe9 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:36.933284 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-f5887b7a-7d54-4f56-b94f-b3ec1d7ab2e7 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:36.945529 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f5887b7a-7d54-4f56-b94f-b3ec1d7ab2e7 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/ba987aee-2707-4d47-aba9-d2803aa70745" status: 200 len: 1476 microversion: 2.1 time: 0.659625 Aug 27 02:52:36.949955 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1282/2544] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:36 2022] GET /compute/v2.1/servers/ba987aee-2707-4d47-aba9-d2803aa70745 => generated 1476 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:36.966155 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-df66e304-fb7b-4d44-801d-c68f589dad83 tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:36.966947 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-df66e304-fb7b-4d44-801d-c68f589dad83 tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] [instance: 503900da-e41b-4787-bb1e-9d3df7df05b6] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:36.982131 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:52:36.992388 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-df66e304-fb7b-4d44-801d-c68f589dad83 tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:36.992885 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-df66e304-fb7b-4d44-801d-c68f589dad83 tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:36.993308 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-df66e304-fb7b-4d44-801d-c68f589dad83 tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:36.994024 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-df66e304-fb7b-4d44-801d-c68f589dad83 tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:36.994470 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-df66e304-fb7b-4d44-801d-c68f589dad83 tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:36.994897 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-df66e304-fb7b-4d44-801d-c68f589dad83 tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:37.294684 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-df66e304-fb7b-4d44-801d-c68f589dad83 tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ece2eb399074418ac5f890d223c1be0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c13c50438234109913876bf5a11d271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:37.309505 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-2f089296-e02d-47ee-9c82-44f52b5c3fe9 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317e74b4bbc4da298a0dcbd78068352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a8810c21784788b4c0ee64dedbaf15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:37.311442 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-df66e304-fb7b-4d44-801d-c68f589dad83 tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] 10.222.0.70 "GET /compute/v2.1/servers/503900da-e41b-4787-bb1e-9d3df7df05b6" status: 200 len: 1701 microversion: 2.1 time: 0.360031 Aug 27 02:52:37.312159 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1283/2545] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:36 2022] GET /compute/v2.1/servers/503900da-e41b-4787-bb1e-9d3df7df05b6 => generated 1701 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:37.318036 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-9b3ed673-ad6f-42a9-aca1-dfc4d450edf7 req-80e1f374-d4ba-4c41-b4be-f0e78fa47fd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4b1bc77-1487-47d4-ae3b-14e693c1c4c5", "tag": "f2b43a68-d758-4ea0-96e7-6f29bafdfb2b"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:52:37.331251 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-2f089296-e02d-47ee-9c82-44f52b5c3fe9 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] 10.222.0.70 "GET /compute/v2.1/servers/6ef152e6-ba27-46bd-871a-04d8539b493e" status: 200 len: 1519 microversion: 2.1 time: 0.437843 Aug 27 02:52:37.332172 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1263/2546] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:36 2022] GET /compute/v2.1/servers/6ef152e6-ba27-46bd-871a-04d8539b493e => generated 1519 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:37.336743 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-b95f2202-8717-4432-a790-419955fc18d2 req-618f8217-c937-4800-9793-35faaaf65e1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "457da794-89e7-4b30-95ba-802c95550c7e", "name": "network-vif-unplugged", "status": "completed", "tag": "27be2c6c-8615-4a7c-96a7-71c5111896a7"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:52:37.346816 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-b95f2202-8717-4432-a790-419955fc18d2 req-618f8217-c937-4800-9793-35faaaf65e1c service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:37.347301 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-b95f2202-8717-4432-a790-419955fc18d2 req-618f8217-c937-4800-9793-35faaaf65e1c service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:37.347733 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-b95f2202-8717-4432-a790-419955fc18d2 req-618f8217-c937-4800-9793-35faaaf65e1c service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:37.349991 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-9b3ed673-ad6f-42a9-aca1-dfc4d450edf7 req-80e1f374-d4ba-4c41-b4be-f0e78fa47fd2 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:37.350855 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-9b3ed673-ad6f-42a9-aca1-dfc4d450edf7 req-80e1f374-d4ba-4c41-b4be-f0e78fa47fd2 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:37.351303 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-9b3ed673-ad6f-42a9-aca1-dfc4d450edf7 req-80e1f374-d4ba-4c41-b4be-f0e78fa47fd2 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:37.359546 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-b95f2202-8717-4432-a790-419955fc18d2 req-618f8217-c937-4800-9793-35faaaf65e1c service nova] Creating event network-vif-unplugged:27be2c6c-8615-4a7c-96a7-71c5111896a7 for instance 457da794-89e7-4b30-95ba-802c95550c7e on n-h2-852278-4 Aug 27 02:52:37.368653 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-b95f2202-8717-4432-a790-419955fc18d2 req-618f8217-c937-4800-9793-35faaaf65e1c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035008 Aug 27 02:52:37.369608 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1264/2547] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:52:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:52:37.371853 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-9b3ed673-ad6f-42a9-aca1-dfc4d450edf7 req-80e1f374-d4ba-4c41-b4be-f0e78fa47fd2 service nova] Creating event network-changed:f2b43a68-d758-4ea0-96e7-6f29bafdfb2b for instance b4b1bc77-1487-47d4-ae3b-14e693c1c4c5 on n-h2-852278-4 Aug 27 02:52:37.375817 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-605d09c4-a042-4206-aec9-aa6e405b62de tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:37.376212 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-605d09c4-a042-4206-aec9-aa6e405b62de tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] [instance: 9da9d8a1-ec78-43ed-b29d-8560df6e3937] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:37.378234 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:52:37.381331 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-9b3ed673-ad6f-42a9-aca1-dfc4d450edf7 req-80e1f374-d4ba-4c41-b4be-f0e78fa47fd2 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067362 Aug 27 02:52:37.381442 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1284/2548] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:52:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:52:37.388895 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-605d09c4-a042-4206-aec9-aa6e405b62de tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:37.389401 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-605d09c4-a042-4206-aec9-aa6e405b62de tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:37.389856 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-605d09c4-a042-4206-aec9-aa6e405b62de tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:37.390662 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0060e080-493b-4158-adbc-3ff73d35bd5d tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:37.390817 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-605d09c4-a042-4206-aec9-aa6e405b62de tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:37.391203 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-605d09c4-a042-4206-aec9-aa6e405b62de tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:37.391771 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-605d09c4-a042-4206-aec9-aa6e405b62de tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:37.392022 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-0060e080-493b-4158-adbc-3ff73d35bd5d tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] [instance: b4b1bc77-1487-47d4-ae3b-14e693c1c4c5] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:37.403182 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0060e080-493b-4158-adbc-3ff73d35bd5d tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:37.404206 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0060e080-493b-4158-adbc-3ff73d35bd5d tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:37.404831 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0060e080-493b-4158-adbc-3ff73d35bd5d tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:37.405705 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0060e080-493b-4158-adbc-3ff73d35bd5d tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:37.406338 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0060e080-493b-4158-adbc-3ff73d35bd5d tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:37.407066 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0060e080-493b-4158-adbc-3ff73d35bd5d tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:37.614967 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0060e080-493b-4158-adbc-3ff73d35bd5d tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745fd53ea2694f919ff28af2c17e60a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079fe2e8a6184fba858e3d8e60730fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:37.622944 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-0060e080-493b-4158-adbc-3ff73d35bd5d tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] 10.222.0.70 "GET /compute/v2.1/servers/b4b1bc77-1487-47d4-ae3b-14e693c1c4c5" status: 200 len: 1314 microversion: 2.1 time: 0.240351 Aug 27 02:52:37.636627 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1285/2549] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:37 2022] GET /compute/v2.1/servers/b4b1bc77-1487-47d4-ae3b-14e693c1c4c5 => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:37.636627 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-dcce2c2b-87a5-4f93-9eea-f92d6011909e tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:37.636627 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-dcce2c2b-87a5-4f93-9eea-f92d6011909e tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] [instance: 546a5816-c2d9-494b-8c23-b0983cd11eb9] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:37.648273 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dcce2c2b-87a5-4f93-9eea-f92d6011909e tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:37.648797 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dcce2c2b-87a5-4f93-9eea-f92d6011909e tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:37.649242 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dcce2c2b-87a5-4f93-9eea-f92d6011909e tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:37.649958 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dcce2c2b-87a5-4f93-9eea-f92d6011909e tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:37.650412 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dcce2c2b-87a5-4f93-9eea-f92d6011909e tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:37.650857 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dcce2c2b-87a5-4f93-9eea-f92d6011909e tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:37.657724 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-605d09c4-a042-4206-aec9-aa6e405b62de tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03191d0be5ae427286971e228534be75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efbb3a8866e47d7981008b08e89f416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:37.680154 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-605d09c4-a042-4206-aec9-aa6e405b62de tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03191d0be5ae427286971e228534be75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efbb3a8866e47d7981008b08e89f416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:37.682723 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-605d09c4-a042-4206-aec9-aa6e405b62de tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03191d0be5ae427286971e228534be75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efbb3a8866e47d7981008b08e89f416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:37.684228 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-605d09c4-a042-4206-aec9-aa6e405b62de tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] 10.222.0.70 "GET /compute/v2.1/servers/9da9d8a1-ec78-43ed-b29d-8560df6e3937" status: 200 len: 1358 microversion: 2.21 time: 0.313480 Aug 27 02:52:37.697462 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1265/2550] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:52:37 2022] GET /compute/v2.1/servers/9da9d8a1-ec78-43ed-b29d-8560df6e3937 => generated 1358 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:52:37.724731 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-dcce2c2b-87a5-4f93-9eea-f92d6011909e tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f496f24dccea47bd9a5ab532fe45e370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40794f05e8b94a0f8f087a87a58e0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:37.733560 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-dcce2c2b-87a5-4f93-9eea-f92d6011909e tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "GET /compute/v2.1/servers/546a5816-c2d9-494b-8c23-b0983cd11eb9" status: 200 len: 1267 microversion: 2.1 time: 0.108990 Aug 27 02:52:37.734539 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1286/2551] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:37 2022] GET /compute/v2.1/servers/546a5816-c2d9-494b-8c23-b0983cd11eb9 => generated 1267 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:37.918201 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-492cc612-70cb-41cc-a1d9-3c89cc9b7b6c tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:37.921979 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-492cc612-70cb-41cc-a1d9-3c89cc9b7b6c tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: 97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:37.942135 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-492cc612-70cb-41cc-a1d9-3c89cc9b7b6c tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:37.945023 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-492cc612-70cb-41cc-a1d9-3c89cc9b7b6c tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:37.945552 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-492cc612-70cb-41cc-a1d9-3c89cc9b7b6c tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:37.946328 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-492cc612-70cb-41cc-a1d9-3c89cc9b7b6c tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:37.946801 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-492cc612-70cb-41cc-a1d9-3c89cc9b7b6c tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:37.947241 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-492cc612-70cb-41cc-a1d9-3c89cc9b7b6c tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:37.976376 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c4d39947-7215-47b7-8f2f-0b7b9caf3905 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:37.978850 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-c4d39947-7215-47b7-8f2f-0b7b9caf3905 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: ba987aee-2707-4d47-aba9-d2803aa70745] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:37.997037 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c4d39947-7215-47b7-8f2f-0b7b9caf3905 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:37.998304 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c4d39947-7215-47b7-8f2f-0b7b9caf3905 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:37.999662 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c4d39947-7215-47b7-8f2f-0b7b9caf3905 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:38.001353 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c4d39947-7215-47b7-8f2f-0b7b9caf3905 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:38.002708 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c4d39947-7215-47b7-8f2f-0b7b9caf3905 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:38.003452 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c4d39947-7215-47b7-8f2f-0b7b9caf3905 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:38.148275 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-492cc612-70cb-41cc-a1d9-3c89cc9b7b6c tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:38.164653 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-492cc612-70cb-41cc-a1d9-3c89cc9b7b6c tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4" status: 200 len: 1210 microversion: 2.1 time: 0.255592 Aug 27 02:52:38.167012 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1266/2552] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:37 2022] GET /compute/v2.1/servers/97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4 => generated 1210 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:38.336165 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4f3b9491-1fa8-4076-9c07-7795f74bc280 tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:38.339490 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-4f3b9491-1fa8-4076-9c07-7795f74bc280 tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] [instance: 503900da-e41b-4787-bb1e-9d3df7df05b6] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:38.364793 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4f3b9491-1fa8-4076-9c07-7795f74bc280 tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:38.366559 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4f3b9491-1fa8-4076-9c07-7795f74bc280 tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:38.368543 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4f3b9491-1fa8-4076-9c07-7795f74bc280 tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:38.370655 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4f3b9491-1fa8-4076-9c07-7795f74bc280 tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:38.372625 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4f3b9491-1fa8-4076-9c07-7795f74bc280 tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:38.374652 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4f3b9491-1fa8-4076-9c07-7795f74bc280 tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:38.945381 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-c4d39947-7215-47b7-8f2f-0b7b9caf3905 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:38.954537 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c4d39947-7215-47b7-8f2f-0b7b9caf3905 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/ba987aee-2707-4d47-aba9-d2803aa70745" status: 200 len: 1476 microversion: 2.1 time: 0.985828 Aug 27 02:52:38.965089 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1287/2553] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:37 2022] GET /compute/v2.1/servers/ba987aee-2707-4d47-aba9-d2803aa70745 => generated 1476 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:52:38.970433 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-246f62ec-2b95-4053-9508-2c6986638a75 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:38.971349 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-246f62ec-2b95-4053-9508-2c6986638a75 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] [instance: 6ef152e6-ba27-46bd-871a-04d8539b493e] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:38.985082 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-246f62ec-2b95-4053-9508-2c6986638a75 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:38.986420 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-246f62ec-2b95-4053-9508-2c6986638a75 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:38.987723 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-246f62ec-2b95-4053-9508-2c6986638a75 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:38.990179 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-246f62ec-2b95-4053-9508-2c6986638a75 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:38.991145 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-246f62ec-2b95-4053-9508-2c6986638a75 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:38.993984 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-246f62ec-2b95-4053-9508-2c6986638a75 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:39.478252 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-4f3b9491-1fa8-4076-9c07-7795f74bc280 tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ece2eb399074418ac5f890d223c1be0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c13c50438234109913876bf5a11d271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:39.490150 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-4f3b9491-1fa8-4076-9c07-7795f74bc280 tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] 10.222.0.70 "GET /compute/v2.1/servers/503900da-e41b-4787-bb1e-9d3df7df05b6" status: 200 len: 1701 microversion: 2.1 time: 1.160290 Aug 27 02:52:39.512340 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1267/2554] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:38 2022] GET /compute/v2.1/servers/503900da-e41b-4787-bb1e-9d3df7df05b6 => generated 1701 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:52:39.512340 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-fd804335-83bb-4c0b-a78d-906e27126f0c tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:39.512340 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-fd804335-83bb-4c0b-a78d-906e27126f0c tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] [instance: b4b1bc77-1487-47d4-ae3b-14e693c1c4c5] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:39.525099 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fd804335-83bb-4c0b-a78d-906e27126f0c tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:39.531519 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fd804335-83bb-4c0b-a78d-906e27126f0c tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:39.532337 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fd804335-83bb-4c0b-a78d-906e27126f0c tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:39.533209 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fd804335-83bb-4c0b-a78d-906e27126f0c tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:39.533735 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fd804335-83bb-4c0b-a78d-906e27126f0c tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:39.534223 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fd804335-83bb-4c0b-a78d-906e27126f0c tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:39.705217 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-246f62ec-2b95-4053-9508-2c6986638a75 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317e74b4bbc4da298a0dcbd78068352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a8810c21784788b4c0ee64dedbaf15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:39.718617 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-246f62ec-2b95-4053-9508-2c6986638a75 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] 10.222.0.70 "GET /compute/v2.1/servers/6ef152e6-ba27-46bd-871a-04d8539b493e" status: 200 len: 1519 microversion: 2.1 time: 0.750017 Aug 27 02:52:39.719579 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1288/2555] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:38 2022] GET /compute/v2.1/servers/6ef152e6-ba27-46bd-871a-04d8539b493e => generated 1519 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:39.729779 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b4a6ee9a-0090-434c-b9c0-6cfb7d1de97d tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:39.736973 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b4a6ee9a-0090-434c-b9c0-6cfb7d1de97d tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] [instance: 9da9d8a1-ec78-43ed-b29d-8560df6e3937] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:39.752761 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b4a6ee9a-0090-434c-b9c0-6cfb7d1de97d tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:39.754198 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b4a6ee9a-0090-434c-b9c0-6cfb7d1de97d tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:39.754844 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b4a6ee9a-0090-434c-b9c0-6cfb7d1de97d tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:39.755776 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b4a6ee9a-0090-434c-b9c0-6cfb7d1de97d tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:39.756973 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b4a6ee9a-0090-434c-b9c0-6cfb7d1de97d tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:39.758021 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b4a6ee9a-0090-434c-b9c0-6cfb7d1de97d tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:40.102699 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-fd804335-83bb-4c0b-a78d-906e27126f0c tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745fd53ea2694f919ff28af2c17e60a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079fe2e8a6184fba858e3d8e60730fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:40.114447 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-fd804335-83bb-4c0b-a78d-906e27126f0c tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] 10.222.0.70 "GET /compute/v2.1/servers/b4b1bc77-1487-47d4-ae3b-14e693c1c4c5" status: 200 len: 1314 microversion: 2.1 time: 0.612481 Aug 27 02:52:40.129270 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1268/2556] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:39 2022] GET /compute/v2.1/servers/b4b1bc77-1487-47d4-ae3b-14e693c1c4c5 => generated 1314 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:40.138824 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-5f2be04b-b58d-4939-970a-c9faa2225e49 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:40.145421 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-5f2be04b-b58d-4939-970a-c9faa2225e49 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] [instance: 546a5816-c2d9-494b-8c23-b0983cd11eb9] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:40.163707 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5f2be04b-b58d-4939-970a-c9faa2225e49 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:40.164792 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5f2be04b-b58d-4939-970a-c9faa2225e49 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:40.165450 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5f2be04b-b58d-4939-970a-c9faa2225e49 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:40.166382 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5f2be04b-b58d-4939-970a-c9faa2225e49 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:40.167034 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5f2be04b-b58d-4939-970a-c9faa2225e49 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:40.167680 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5f2be04b-b58d-4939-970a-c9faa2225e49 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:40.213466 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b4a6ee9a-0090-434c-b9c0-6cfb7d1de97d tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03191d0be5ae427286971e228534be75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efbb3a8866e47d7981008b08e89f416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:40.237675 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b4a6ee9a-0090-434c-b9c0-6cfb7d1de97d tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03191d0be5ae427286971e228534be75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efbb3a8866e47d7981008b08e89f416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:40.239177 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b4a6ee9a-0090-434c-b9c0-6cfb7d1de97d tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03191d0be5ae427286971e228534be75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efbb3a8866e47d7981008b08e89f416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:40.253739 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b4a6ee9a-0090-434c-b9c0-6cfb7d1de97d tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] 10.222.0.70 "GET /compute/v2.1/servers/9da9d8a1-ec78-43ed-b29d-8560df6e3937" status: 200 len: 1550 microversion: 2.21 time: 0.517416 Aug 27 02:52:40.264411 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1289/2557] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:52:39 2022] GET /compute/v2.1/servers/9da9d8a1-ec78-43ed-b29d-8560df6e3937 => generated 1550 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:52:40.272174 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-394154ed-ac88-4711-ae98-6d5ca855478a tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:40.272174 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-394154ed-ac88-4711-ae98-6d5ca855478a tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: 97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:40.288772 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-394154ed-ac88-4711-ae98-6d5ca855478a tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:40.289263 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-394154ed-ac88-4711-ae98-6d5ca855478a tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:40.289700 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-394154ed-ac88-4711-ae98-6d5ca855478a tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:40.290576 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-394154ed-ac88-4711-ae98-6d5ca855478a tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:40.290846 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-394154ed-ac88-4711-ae98-6d5ca855478a tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:40.291265 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-394154ed-ac88-4711-ae98-6d5ca855478a tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:40.722979 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-5f2be04b-b58d-4939-970a-c9faa2225e49 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f496f24dccea47bd9a5ab532fe45e370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40794f05e8b94a0f8f087a87a58e0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:40.736298 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-5f2be04b-b58d-4939-970a-c9faa2225e49 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "GET /compute/v2.1/servers/546a5816-c2d9-494b-8c23-b0983cd11eb9" status: 200 len: 1265 microversion: 2.1 time: 0.601414 Aug 27 02:52:40.749430 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1269/2558] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:40 2022] GET /compute/v2.1/servers/546a5816-c2d9-494b-8c23-b0983cd11eb9 => generated 1265 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:40.763311 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-c34807a8-989a-41d6-8a00-0e443b4a58c7 req-ce35d24a-d154-4e41-afd7-917dcc386bb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "457da794-89e7-4b30-95ba-802c95550c7e", "name": "network-vif-deleted", "tag": "27be2c6c-8615-4a7c-96a7-71c5111896a7"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:52:40.770459 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-394154ed-ac88-4711-ae98-6d5ca855478a tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:40.775270 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=100 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:52:40.792556 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-394154ed-ac88-4711-ae98-6d5ca855478a tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4" status: 200 len: 1284 microversion: 2.1 time: 0.536237 Aug 27 02:52:40.795707 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1290/2559] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:40 2022] GET /compute/v2.1/servers/97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4 => generated 1284 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:40.797670 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-c34807a8-989a-41d6-8a00-0e443b4a58c7 req-ce35d24a-d154-4e41-afd7-917dcc386bb7 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:40.798154 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-c34807a8-989a-41d6-8a00-0e443b4a58c7 req-ce35d24a-d154-4e41-afd7-917dcc386bb7 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:40.798584 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-c34807a8-989a-41d6-8a00-0e443b4a58c7 req-ce35d24a-d154-4e41-afd7-917dcc386bb7 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:40.805553 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-5c51175b-0a52-497d-88e2-3a0779bc39a5 req-874ba254-5bab-4d9e-b68b-11862c069610 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "503900da-e41b-4787-bb1e-9d3df7df05b6", "name": "network-vif-deleted", "tag": "d5dfa226-5023-4e6d-a3ae-5b36139b84bc"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:52:40.828045 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-5c51175b-0a52-497d-88e2-3a0779bc39a5 req-874ba254-5bab-4d9e-b68b-11862c069610 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:40.834006 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-5c51175b-0a52-497d-88e2-3a0779bc39a5 req-874ba254-5bab-4d9e-b68b-11862c069610 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:40.834758 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-5c51175b-0a52-497d-88e2-3a0779bc39a5 req-874ba254-5bab-4d9e-b68b-11862c069610 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:40.861758 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-c34807a8-989a-41d6-8a00-0e443b4a58c7 req-ce35d24a-d154-4e41-afd7-917dcc386bb7 service nova] Creating event network-vif-deleted:27be2c6c-8615-4a7c-96a7-71c5111896a7 for instance 457da794-89e7-4b30-95ba-802c95550c7e on n-h2-852278-4 Aug 27 02:52:40.867603 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-5c51175b-0a52-497d-88e2-3a0779bc39a5 req-874ba254-5bab-4d9e-b68b-11862c069610 service nova] Creating event network-vif-deleted:d5dfa226-5023-4e6d-a3ae-5b36139b84bc for instance 503900da-e41b-4787-bb1e-9d3df7df05b6 on n-h2-852278-4 Aug 27 02:52:40.879742 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-5c51175b-0a52-497d-88e2-3a0779bc39a5 req-874ba254-5bab-4d9e-b68b-11862c069610 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082045 Aug 27 02:52:40.882664 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1291/2560] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:52:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:52:40.886359 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-c34807a8-989a-41d6-8a00-0e443b4a58c7 req-ce35d24a-d154-4e41-afd7-917dcc386bb7 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135170 Aug 27 02:52:40.894866 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1270/2561] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:52:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:52:40.902895 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e67bf8de-bb11-43d1-9227-bef489a689c9 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:40.903704 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-e67bf8de-bb11-43d1-9227-bef489a689c9 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: ba987aee-2707-4d47-aba9-d2803aa70745] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:40.904455 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-379f45f4-30b5-40d5-96bc-a09ed74e1deb tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:40.905360 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-379f45f4-30b5-40d5-96bc-a09ed74e1deb tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] [instance: 9da9d8a1-ec78-43ed-b29d-8560df6e3937] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:40.919282 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e67bf8de-bb11-43d1-9227-bef489a689c9 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:40.931901 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e67bf8de-bb11-43d1-9227-bef489a689c9 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:40.932615 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e67bf8de-bb11-43d1-9227-bef489a689c9 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:40.934260 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e67bf8de-bb11-43d1-9227-bef489a689c9 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:40.935979 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e67bf8de-bb11-43d1-9227-bef489a689c9 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:40.936817 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-379f45f4-30b5-40d5-96bc-a09ed74e1deb tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:40.939407 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-379f45f4-30b5-40d5-96bc-a09ed74e1deb tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:40.940505 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-379f45f4-30b5-40d5-96bc-a09ed74e1deb tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:40.941986 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e67bf8de-bb11-43d1-9227-bef489a689c9 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:40.943549 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-379f45f4-30b5-40d5-96bc-a09ed74e1deb tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:40.944908 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-379f45f4-30b5-40d5-96bc-a09ed74e1deb tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:40.945838 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-379f45f4-30b5-40d5-96bc-a09ed74e1deb tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:41.000152 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-379f45f4-30b5-40d5-96bc-a09ed74e1deb tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] [instance: 9da9d8a1-ec78-43ed-b29d-8560df6e3937] Going to try to terminate instance {{(pid=134051) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:52:41.172969 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-379f45f4-30b5-40d5-96bc-a09ed74e1deb tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] 10.222.0.70 "DELETE /compute/v2.1/servers/9da9d8a1-ec78-43ed-b29d-8560df6e3937" status: 204 len: 0 microversion: 2.21 time: 0.275574 Aug 27 02:52:41.173926 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1271/2562] 10.222.0.70 () {60 vars in 1280 bytes} [Sat Aug 27 02:52:40 2022] DELETE /compute/v2.1/servers/9da9d8a1-ec78-43ed-b29d-8560df6e3937 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 02:52:41.182018 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f837c1fb-4143-4c00-8a34-d3417952632f tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:41.183992 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-f837c1fb-4143-4c00-8a34-d3417952632f tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] [instance: 503900da-e41b-4787-bb1e-9d3df7df05b6] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:41.200407 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f837c1fb-4143-4c00-8a34-d3417952632f tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:41.201031 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f837c1fb-4143-4c00-8a34-d3417952632f tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:41.201543 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f837c1fb-4143-4c00-8a34-d3417952632f tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:41.203638 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f837c1fb-4143-4c00-8a34-d3417952632f tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:41.204222 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f837c1fb-4143-4c00-8a34-d3417952632f tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:41.206866 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f837c1fb-4143-4c00-8a34-d3417952632f tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:41.279874 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f837c1fb-4143-4c00-8a34-d3417952632f tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:41.279874 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f837c1fb-4143-4c00-8a34-d3417952632f tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:41.279874 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f837c1fb-4143-4c00-8a34-d3417952632f tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:41.279874 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.objects.instance [None req-f837c1fb-4143-4c00-8a34-d3417952632f tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Lazy-loading 'fault' on Instance uuid 503900da-e41b-4787-bb1e-9d3df7df05b6 {{(pid=134051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:52:41.474441 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-f837c1fb-4143-4c00-8a34-d3417952632f tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ece2eb399074418ac5f890d223c1be0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c13c50438234109913876bf5a11d271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:41.489857 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-f837c1fb-4143-4c00-8a34-d3417952632f tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] 10.222.0.70 "GET /compute/v2.1/servers/503900da-e41b-4787-bb1e-9d3df7df05b6" status: 200 len: 1360 microversion: 2.1 time: 0.313842 Aug 27 02:52:41.506760 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1272/2563] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:41 2022] GET /compute/v2.1/servers/503900da-e41b-4787-bb1e-9d3df7df05b6 => generated 1360 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:41.520059 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-5fc63318-f7a9-42ee-b21d-e122e6274af8 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:41.526746 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-5fc63318-f7a9-42ee-b21d-e122e6274af8 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] [instance: 6ef152e6-ba27-46bd-871a-04d8539b493e] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:41.542156 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5fc63318-f7a9-42ee-b21d-e122e6274af8 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:41.543179 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5fc63318-f7a9-42ee-b21d-e122e6274af8 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:41.543869 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5fc63318-f7a9-42ee-b21d-e122e6274af8 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:41.544865 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5fc63318-f7a9-42ee-b21d-e122e6274af8 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:41.550289 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5fc63318-f7a9-42ee-b21d-e122e6274af8 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:41.551150 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5fc63318-f7a9-42ee-b21d-e122e6274af8 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:42.045745 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-5fc63318-f7a9-42ee-b21d-e122e6274af8 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317e74b4bbc4da298a0dcbd78068352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a8810c21784788b4c0ee64dedbaf15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:42.055544 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-5fc63318-f7a9-42ee-b21d-e122e6274af8 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] 10.222.0.70 "GET /compute/v2.1/servers/6ef152e6-ba27-46bd-871a-04d8539b493e" status: 200 len: 1519 microversion: 2.1 time: 0.544683 Aug 27 02:52:42.060070 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1273/2564] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:41 2022] GET /compute/v2.1/servers/6ef152e6-ba27-46bd-871a-04d8539b493e => generated 1519 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:42.069826 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-cfdba6cf-6af1-4b98-843c-2afa5682c98e tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:42.070717 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-cfdba6cf-6af1-4b98-843c-2afa5682c98e tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] [instance: b4b1bc77-1487-47d4-ae3b-14e693c1c4c5] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:42.077156 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-e67bf8de-bb11-43d1-9227-bef489a689c9 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:42.101148 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e67bf8de-bb11-43d1-9227-bef489a689c9 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/ba987aee-2707-4d47-aba9-d2803aa70745" status: 200 len: 1476 microversion: 2.1 time: 1.212778 Aug 27 02:52:42.103001 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1292/2565] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:40 2022] GET /compute/v2.1/servers/ba987aee-2707-4d47-aba9-d2803aa70745 => generated 1476 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:42.111338 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-438d1add-5c65-4555-a6a2-08da38ee493b tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:42.114094 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-438d1add-5c65-4555-a6a2-08da38ee493b tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] [instance: 9da9d8a1-ec78-43ed-b29d-8560df6e3937] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:42.114936 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cfdba6cf-6af1-4b98-843c-2afa5682c98e tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:42.115858 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cfdba6cf-6af1-4b98-843c-2afa5682c98e tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:42.115858 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cfdba6cf-6af1-4b98-843c-2afa5682c98e tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:42.116633 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cfdba6cf-6af1-4b98-843c-2afa5682c98e tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:42.117089 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cfdba6cf-6af1-4b98-843c-2afa5682c98e tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:42.117522 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cfdba6cf-6af1-4b98-843c-2afa5682c98e tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:42.125886 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-438d1add-5c65-4555-a6a2-08da38ee493b tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:42.127559 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-438d1add-5c65-4555-a6a2-08da38ee493b tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:42.128487 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-438d1add-5c65-4555-a6a2-08da38ee493b tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:42.129442 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-438d1add-5c65-4555-a6a2-08da38ee493b tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:42.130134 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-438d1add-5c65-4555-a6a2-08da38ee493b tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:42.130848 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-438d1add-5c65-4555-a6a2-08da38ee493b tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:42.801658 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-cfdba6cf-6af1-4b98-843c-2afa5682c98e tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745fd53ea2694f919ff28af2c17e60a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079fe2e8a6184fba858e3d8e60730fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:42.816475 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-cfdba6cf-6af1-4b98-843c-2afa5682c98e tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] 10.222.0.70 "GET /compute/v2.1/servers/b4b1bc77-1487-47d4-ae3b-14e693c1c4c5" status: 200 len: 1314 microversion: 2.1 time: 0.753824 Aug 27 02:52:42.820055 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1274/2566] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:42 2022] GET /compute/v2.1/servers/b4b1bc77-1487-47d4-ae3b-14e693c1c4c5 => generated 1314 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:42.825123 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-438d1add-5c65-4555-a6a2-08da38ee493b tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03191d0be5ae427286971e228534be75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efbb3a8866e47d7981008b08e89f416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:42.833560 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-1c2abc3a-b506-4bb7-a2f1-d1afc767e499 req-be6927aa-f276-4810-86b8-3c9727eb0076 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ef152e6-ba27-46bd-871a-04d8539b493e", "name": "network-vif-plugged", "status": "completed", "tag": "2080aa25-53d4-46f2-a694-162ef2ea0ac4"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:52:42.837338 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-438d1add-5c65-4555-a6a2-08da38ee493b tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03191d0be5ae427286971e228534be75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efbb3a8866e47d7981008b08e89f416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:42.838732 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-438d1add-5c65-4555-a6a2-08da38ee493b tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03191d0be5ae427286971e228534be75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efbb3a8866e47d7981008b08e89f416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:42.855033 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-438d1add-5c65-4555-a6a2-08da38ee493b tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] 10.222.0.70 "GET /compute/v2.1/servers/9da9d8a1-ec78-43ed-b29d-8560df6e3937" status: 200 len: 1556 microversion: 2.21 time: 0.748851 Aug 27 02:52:42.857754 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1293/2567] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:52:42 2022] GET /compute/v2.1/servers/9da9d8a1-ec78-43ed-b29d-8560df6e3937 => generated 1556 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:52:42.864867 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-1c2abc3a-b506-4bb7-a2f1-d1afc767e499 req-be6927aa-f276-4810-86b8-3c9727eb0076 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:42.866133 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-1c2abc3a-b506-4bb7-a2f1-d1afc767e499 req-be6927aa-f276-4810-86b8-3c9727eb0076 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:42.866681 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-1c2abc3a-b506-4bb7-a2f1-d1afc767e499 req-be6927aa-f276-4810-86b8-3c9727eb0076 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:42.871746 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6fab5acd-9e0a-41f0-973f-26ed62a85954 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:42.872386 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-6fab5acd-9e0a-41f0-973f-26ed62a85954 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] [instance: 546a5816-c2d9-494b-8c23-b0983cd11eb9] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:42.900102 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6fab5acd-9e0a-41f0-973f-26ed62a85954 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:42.900630 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6fab5acd-9e0a-41f0-973f-26ed62a85954 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:42.901090 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6fab5acd-9e0a-41f0-973f-26ed62a85954 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:42.901808 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6fab5acd-9e0a-41f0-973f-26ed62a85954 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:42.902259 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6fab5acd-9e0a-41f0-973f-26ed62a85954 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:42.902681 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6fab5acd-9e0a-41f0-973f-26ed62a85954 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:42.914309 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-1c2abc3a-b506-4bb7-a2f1-d1afc767e499 req-be6927aa-f276-4810-86b8-3c9727eb0076 service nova] Creating event network-vif-plugged:2080aa25-53d4-46f2-a694-162ef2ea0ac4 for instance 6ef152e6-ba27-46bd-871a-04d8539b493e on n-h1-852278-4 Aug 27 02:52:42.936492 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-1c2abc3a-b506-4bb7-a2f1-d1afc767e499 req-be6927aa-f276-4810-86b8-3c9727eb0076 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113565 Aug 27 02:52:42.940694 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1275/2568] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:52:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:52:42.954758 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d8856fe3-a88d-4b9a-9920-1973376e3daa tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:42.968062 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d8856fe3-a88d-4b9a-9920-1973376e3daa tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: 97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:42.978656 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d8856fe3-a88d-4b9a-9920-1973376e3daa tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:42.980022 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d8856fe3-a88d-4b9a-9920-1973376e3daa tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:42.992055 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d8856fe3-a88d-4b9a-9920-1973376e3daa tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:42.993266 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d8856fe3-a88d-4b9a-9920-1973376e3daa tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:42.993971 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d8856fe3-a88d-4b9a-9920-1973376e3daa tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:42.994771 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d8856fe3-a88d-4b9a-9920-1973376e3daa tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:44.121135 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-6fab5acd-9e0a-41f0-973f-26ed62a85954 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f496f24dccea47bd9a5ab532fe45e370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40794f05e8b94a0f8f087a87a58e0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:44.143836 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-6fab5acd-9e0a-41f0-973f-26ed62a85954 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "GET /compute/v2.1/servers/546a5816-c2d9-494b-8c23-b0983cd11eb9" status: 200 len: 1307 microversion: 2.1 time: 1.281172 Aug 27 02:52:44.146825 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1294/2569] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:42 2022] GET /compute/v2.1/servers/546a5816-c2d9-494b-8c23-b0983cd11eb9 => generated 1307 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:44.162295 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-46d921f6-6711-4caa-aa16-d6b74b7c793e tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:44.167077 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-46d921f6-6711-4caa-aa16-d6b74b7c793e tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] [instance: 503900da-e41b-4787-bb1e-9d3df7df05b6] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:44.175892 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d8856fe3-a88d-4b9a-9920-1973376e3daa tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:44.183113 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-46d921f6-6711-4caa-aa16-d6b74b7c793e tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:44.186530 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-46d921f6-6711-4caa-aa16-d6b74b7c793e tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:44.187487 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-46d921f6-6711-4caa-aa16-d6b74b7c793e tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:44.189114 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-46d921f6-6711-4caa-aa16-d6b74b7c793e tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:44.190571 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-46d921f6-6711-4caa-aa16-d6b74b7c793e tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:44.193824 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-46d921f6-6711-4caa-aa16-d6b74b7c793e tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:44.196721 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d8856fe3-a88d-4b9a-9920-1973376e3daa tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4" status: 200 len: 1314 microversion: 2.1 time: 1.253500 Aug 27 02:52:44.199805 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1276/2570] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:42 2022] GET /compute/v2.1/servers/97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4 => generated 1314 bytes in 1258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:44.212858 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c73f6538-9a2d-42c0-b246-39e0800185ac tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:44.215400 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-c73f6538-9a2d-42c0-b246-39e0800185ac tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] [instance: 6ef152e6-ba27-46bd-871a-04d8539b493e] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:44.231854 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c73f6538-9a2d-42c0-b246-39e0800185ac tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:44.234324 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c73f6538-9a2d-42c0-b246-39e0800185ac tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:44.236598 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c73f6538-9a2d-42c0-b246-39e0800185ac tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:44.242111 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c73f6538-9a2d-42c0-b246-39e0800185ac tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:44.243893 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-46d921f6-6711-4caa-aa16-d6b74b7c793e tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] HTTP exception thrown: Instance 503900da-e41b-4787-bb1e-9d3df7df05b6 could not be found. Aug 27 02:52:44.245995 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c73f6538-9a2d-42c0-b246-39e0800185ac tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:44.246785 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c73f6538-9a2d-42c0-b246-39e0800185ac tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:44.247719 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-46d921f6-6711-4caa-aa16-d6b74b7c793e tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Request method failure captured: Aug 27 02:52:44.247719 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/servers/503900da-e41b-4787-bb1e-9d3df7df05b6 HTTP/1.1 Aug 27 02:52:44.247719 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:52:44.247719 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:52:44.247719 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:52:44.247719 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:52:44.247719 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:52:44.247719 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:52:44.247719 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:52:44.247719 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:52:44.247719 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYamNq8XGBPOUj43BTQ9B2-EHkPb6bgICr_gXMn99eYDKxZuRskNMo_TgHnQ6IiDFLXbZETyOYSi9VwKQZBUbdFWYqCkvTKZSdaVZjVGawWRClLYS503_TaiHzxkcUu2nRJfdmObxlpvTe4RGvVbMulkr_NZcPsQgOedbnx1OqjvSC4 Aug 27 02:52:44.247719 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:52:44.247719 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:52:44.247719 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:52:44.247719 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:52:44.247719 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:52:44.247719 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:52:44.247719 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 6c13c50438234109913876bf5a11d271 Aug 27 02:52:44.247719 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ServersTestJSON-1465008321 Aug 27 02:52:44.247719 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:52:44.247719 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:52:44.247719 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6c13c50438234109913876bf5a11d271"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_6c13c50438234109913876bf5a11d271", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6c13c50438234109913876bf5a11d271"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/6c13c50438234109913876bf5a11d271"}]}] Aug 27 02:52:44.247719 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ServersTestJSON-1465008321 Aug 27 02:52:44.247719 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 6c13c50438234109913876bf5a11d271 Aug 27 02:52:44.247719 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ServersTestJSON-1465008321 Aug 27 02:52:44.247719 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ServersTestJSON-1465008321-project Aug 27 02:52:44.247719 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:52:44.247719 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:52:44.247719 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 8ece2eb399074418ac5f890d223c1be0 Aug 27 02:52:44.247719 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ServersTestJSON-1465008321-project Aug 27 02:52:44.247719 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 02:52:44.247719 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance 503900da-e41b-4787-bb1e-9d3df7df05b6 could not be found. Aug 27 02:52:44.247719 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '503900da-e41b-4787-bb1e-9d3df7df05b6'} Aug 27 02:52:44.247719 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:52:44.247719 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:52:44.247719 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:52:44.247719 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:52:44.247719 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:52:44.247719 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:52:44.247719 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:52:44.247719 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:52:44.247719 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:52:44.247719 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:52:44.247719 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 503900da-e41b-4787-bb1e-9d3df7df05b6 could not be found. Aug 27 02:52:44.247719 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:52:44.247719 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:52:44.247719 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:52:44.247719 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:52:44.247719 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:52:44.247719 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:52:44.247719 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:52:44.247719 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:52:44.247719 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:52:44.247719 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:52:44.247719 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:52:44.247719 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:52:44.247719 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:52:44.247719 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:52:44.247719 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:52:44.247719 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:52:44.247719 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 503900da-e41b-4787-bb1e-9d3df7df05b6 could not be found. Aug 27 02:52:44.247719 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:52:44.247719 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:52:44.247719 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:52:44.251982 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:52:44.251982 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:52:44.251982 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:52:44.251982 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:52:44.251982 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:52:44.251982 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 503900da-e41b-4787-bb1e-9d3df7df05b6 could not be found. Aug 27 02:52:44.251982 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:52:44.255168 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-46d921f6-6711-4caa-aa16-d6b74b7c793e tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Returning 404 to user: Instance 503900da-e41b-4787-bb1e-9d3df7df05b6 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:52:44.257359 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-46d921f6-6711-4caa-aa16-d6b74b7c793e tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] 10.222.0.70 "GET /compute/v2.1/servers/503900da-e41b-4787-bb1e-9d3df7df05b6" status: 404 len: 111 microversion: 2.1 time: 0.106967 Aug 27 02:52:44.258494 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1295/2571] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:44 2022] GET /compute/v2.1/servers/503900da-e41b-4787-bb1e-9d3df7df05b6 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:52:44.273154 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-157d7861-75ad-4640-823c-cf1200df831e tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:44.275177 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-157d7861-75ad-4640-823c-cf1200df831e tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: ba987aee-2707-4d47-aba9-d2803aa70745] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:44.282062 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-157d7861-75ad-4640-823c-cf1200df831e tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:44.284072 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-157d7861-75ad-4640-823c-cf1200df831e tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:44.285432 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-157d7861-75ad-4640-823c-cf1200df831e tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:44.286400 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-157d7861-75ad-4640-823c-cf1200df831e tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:44.287059 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-157d7861-75ad-4640-823c-cf1200df831e tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:44.287733 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-157d7861-75ad-4640-823c-cf1200df831e tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:44.583234 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=6 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:52:44.614206 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=16 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:52:44.781028 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-c73f6538-9a2d-42c0-b246-39e0800185ac tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317e74b4bbc4da298a0dcbd78068352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a8810c21784788b4c0ee64dedbaf15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:44.789197 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c73f6538-9a2d-42c0-b246-39e0800185ac tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] 10.222.0.70 "GET /compute/v2.1/servers/6ef152e6-ba27-46bd-871a-04d8539b493e" status: 200 len: 1519 microversion: 2.1 time: 0.587564 Aug 27 02:52:44.794437 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1277/2572] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:44 2022] GET /compute/v2.1/servers/6ef152e6-ba27-46bd-871a-04d8539b493e => generated 1519 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:44.800518 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-21c20e5a-4bfc-4f08-ab02-a59ac0e90646 req-9c865604-8005-4a57-88e8-25633fcc2a88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9da9d8a1-ec78-43ed-b29d-8560df6e3937", "name": "network-vif-deleted", "tag": "748de1f1-74e0-437d-aa71-384f6db35553"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:52:44.825749 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-21c20e5a-4bfc-4f08-ab02-a59ac0e90646 req-9c865604-8005-4a57-88e8-25633fcc2a88 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:44.826243 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-21c20e5a-4bfc-4f08-ab02-a59ac0e90646 req-9c865604-8005-4a57-88e8-25633fcc2a88 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:44.826673 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-21c20e5a-4bfc-4f08-ab02-a59ac0e90646 req-9c865604-8005-4a57-88e8-25633fcc2a88 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:44.850454 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-21c20e5a-4bfc-4f08-ab02-a59ac0e90646 req-9c865604-8005-4a57-88e8-25633fcc2a88 service nova] Creating event network-vif-deleted:748de1f1-74e0-437d-aa71-384f6db35553 for instance 9da9d8a1-ec78-43ed-b29d-8560df6e3937 on n-h1-852278-4 Aug 27 02:52:44.858975 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-21c20e5a-4bfc-4f08-ab02-a59ac0e90646 req-9c865604-8005-4a57-88e8-25633fcc2a88 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063009 Aug 27 02:52:44.861428 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1278/2573] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:52:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:52:44.884884 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7c0cda5b-7d3f-49d7-b7c0-10b3d2798661 tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:44.885875 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-7c0cda5b-7d3f-49d7-b7c0-10b3d2798661 tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] [instance: b4b1bc77-1487-47d4-ae3b-14e693c1c4c5] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:44.893200 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7c0cda5b-7d3f-49d7-b7c0-10b3d2798661 tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:44.894087 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7c0cda5b-7d3f-49d7-b7c0-10b3d2798661 tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:44.894695 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7c0cda5b-7d3f-49d7-b7c0-10b3d2798661 tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:44.896176 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7c0cda5b-7d3f-49d7-b7c0-10b3d2798661 tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:44.896815 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7c0cda5b-7d3f-49d7-b7c0-10b3d2798661 tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:44.897393 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7c0cda5b-7d3f-49d7-b7c0-10b3d2798661 tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:44.906372 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-157d7861-75ad-4640-823c-cf1200df831e tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:44.914636 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-157d7861-75ad-4640-823c-cf1200df831e tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/ba987aee-2707-4d47-aba9-d2803aa70745" status: 200 len: 1475 microversion: 2.1 time: 0.654835 Aug 27 02:52:44.924781 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1296/2574] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:44 2022] GET /compute/v2.1/servers/ba987aee-2707-4d47-aba9-d2803aa70745 => generated 1475 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:44.944129 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-2d833af5-6866-4f91-b823-d28b255ce27c tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:44.945037 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-2d833af5-6866-4f91-b823-d28b255ce27c tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] [instance: 9da9d8a1-ec78-43ed-b29d-8560df6e3937] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:44.951563 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2d833af5-6866-4f91-b823-d28b255ce27c tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:44.952326 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2d833af5-6866-4f91-b823-d28b255ce27c tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:44.952955 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2d833af5-6866-4f91-b823-d28b255ce27c tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:44.964975 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2d833af5-6866-4f91-b823-d28b255ce27c tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:44.965468 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2d833af5-6866-4f91-b823-d28b255ce27c tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:44.965916 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2d833af5-6866-4f91-b823-d28b255ce27c tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:45.006398 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2d833af5-6866-4f91-b823-d28b255ce27c tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:45.007143 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2d833af5-6866-4f91-b823-d28b255ce27c tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:45.007731 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2d833af5-6866-4f91-b823-d28b255ce27c tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:45.008472 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.instance [None req-2d833af5-6866-4f91-b823-d28b255ce27c tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Lazy-loading 'fault' on Instance uuid 9da9d8a1-ec78-43ed-b29d-8560df6e3937 {{(pid=134052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:52:45.212759 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-2d833af5-6866-4f91-b823-d28b255ce27c tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03191d0be5ae427286971e228534be75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efbb3a8866e47d7981008b08e89f416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:45.227973 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-2d833af5-6866-4f91-b823-d28b255ce27c tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03191d0be5ae427286971e228534be75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efbb3a8866e47d7981008b08e89f416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:45.233083 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-2d833af5-6866-4f91-b823-d28b255ce27c tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03191d0be5ae427286971e228534be75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efbb3a8866e47d7981008b08e89f416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:45.236461 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-2d833af5-6866-4f91-b823-d28b255ce27c tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] 10.222.0.70 "GET /compute/v2.1/servers/9da9d8a1-ec78-43ed-b29d-8560df6e3937" status: 200 len: 1348 microversion: 2.21 time: 0.308319 Aug 27 02:52:45.237249 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1297/2575] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:52:44 2022] GET /compute/v2.1/servers/9da9d8a1-ec78-43ed-b29d-8560df6e3937 => generated 1348 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:52:45.249661 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-00592b4c-7860-4fa6-ae55-9c2bc817b73a tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] Calling method '.version_select at 0x7f5ee2f59160>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:45.296106 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-00592b4c-7860-4fa6-ae55-9c2bc817b73a tempest-ServersTestJSON-1465008321 tempest-ServersTestJSON-1465008321-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1325620928" status: 202 len: 0 microversion: 2.1 time: 0.056332 Aug 27 02:52:45.298248 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1298/2576] 10.222.0.70 () {58 vars in 1221 bytes} [Sat Aug 27 02:52:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1325620928 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:52:45.306327 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-4ffc4ff8-fda2-4471-a8c5-0be58c165296 req-eea92aa6-9d84-4011-84af-1c49fa4feaa1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4b1bc77-1487-47d4-ae3b-14e693c1c4c5", "name": "network-vif-plugged", "status": "completed", "tag": "f2b43a68-d758-4ea0-96e7-6f29bafdfb2b"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:52:45.319564 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-4ffc4ff8-fda2-4471-a8c5-0be58c165296 req-eea92aa6-9d84-4011-84af-1c49fa4feaa1 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:45.320286 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-4ffc4ff8-fda2-4471-a8c5-0be58c165296 req-eea92aa6-9d84-4011-84af-1c49fa4feaa1 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:45.321049 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-4ffc4ff8-fda2-4471-a8c5-0be58c165296 req-eea92aa6-9d84-4011-84af-1c49fa4feaa1 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:45.335572 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-4ffc4ff8-fda2-4471-a8c5-0be58c165296 req-eea92aa6-9d84-4011-84af-1c49fa4feaa1 service nova] Creating event network-vif-plugged:f2b43a68-d758-4ea0-96e7-6f29bafdfb2b for instance b4b1bc77-1487-47d4-ae3b-14e693c1c4c5 on n-h2-852278-4 Aug 27 02:52:45.342199 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-4ffc4ff8-fda2-4471-a8c5-0be58c165296 req-eea92aa6-9d84-4011-84af-1c49fa4feaa1 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042219 Aug 27 02:52:45.343111 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1299/2577] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:52:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:52:45.367681 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-db093d4f-cb76-4d75-ad1d-19c4c80b02b0 req-b6eaad41-18bb-40a7-90e6-82fb24622125 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba987aee-2707-4d47-aba9-d2803aa70745", "name": "network-vif-unplugged", "status": "completed", "tag": "0871e4ff-ef2c-4a64-a799-ecfb74bf8dfa"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:52:45.382095 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-db093d4f-cb76-4d75-ad1d-19c4c80b02b0 req-b6eaad41-18bb-40a7-90e6-82fb24622125 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:45.382883 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-db093d4f-cb76-4d75-ad1d-19c4c80b02b0 req-b6eaad41-18bb-40a7-90e6-82fb24622125 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:45.384243 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-db093d4f-cb76-4d75-ad1d-19c4c80b02b0 req-b6eaad41-18bb-40a7-90e6-82fb24622125 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:45.402232 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=4 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:52:45.415529 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-db093d4f-cb76-4d75-ad1d-19c4c80b02b0 req-b6eaad41-18bb-40a7-90e6-82fb24622125 service nova] Creating event network-vif-unplugged:0871e4ff-ef2c-4a64-a799-ecfb74bf8dfa for instance ba987aee-2707-4d47-aba9-d2803aa70745 on n-h2-852278-4 Aug 27 02:52:45.423075 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [req-db093d4f-cb76-4d75-ad1d-19c4c80b02b0 req-b6eaad41-18bb-40a7-90e6-82fb24622125 service nova] Instance ba987aee-2707-4d47-aba9-d2803aa70745 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-852278-4', 'n-h1-852278-4'} {{(pid=134052) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 02:52:45.438614 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-db093d4f-cb76-4d75-ad1d-19c4c80b02b0 req-b6eaad41-18bb-40a7-90e6-82fb24622125 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.093750 Aug 27 02:52:45.440287 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1300/2578] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:52:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:52:45.446274 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-2996ed96-7cdf-4a9b-ab85-30b8dfa6bd6c tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:45.447326 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-2996ed96-7cdf-4a9b-ab85-30b8dfa6bd6c tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] [instance: 546a5816-c2d9-494b-8c23-b0983cd11eb9] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:45.454977 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=14 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:52:45.458349 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2996ed96-7cdf-4a9b-ab85-30b8dfa6bd6c tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:45.459242 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2996ed96-7cdf-4a9b-ab85-30b8dfa6bd6c tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:45.459867 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2996ed96-7cdf-4a9b-ab85-30b8dfa6bd6c tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:45.460751 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2996ed96-7cdf-4a9b-ab85-30b8dfa6bd6c tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:45.462166 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2996ed96-7cdf-4a9b-ab85-30b8dfa6bd6c tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:45.462747 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2996ed96-7cdf-4a9b-ab85-30b8dfa6bd6c tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:45.521641 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-7c0cda5b-7d3f-49d7-b7c0-10b3d2798661 tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745fd53ea2694f919ff28af2c17e60a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079fe2e8a6184fba858e3d8e60730fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:45.540401 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-7c0cda5b-7d3f-49d7-b7c0-10b3d2798661 tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] 10.222.0.70 "GET /compute/v2.1/servers/b4b1bc77-1487-47d4-ae3b-14e693c1c4c5" status: 200 len: 1314 microversion: 2.1 time: 0.668574 Aug 27 02:52:45.541091 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1279/2579] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:44 2022] GET /compute/v2.1/servers/b4b1bc77-1487-47d4-ae3b-14e693c1c4c5 => generated 1314 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:45.546627 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b9a7d0c9-d285-4a39-9598-e49078672411 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:45.547483 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b9a7d0c9-d285-4a39-9598-e49078672411 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: 97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:45.560431 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b9a7d0c9-d285-4a39-9598-e49078672411 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:45.560970 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b9a7d0c9-d285-4a39-9598-e49078672411 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:45.561374 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b9a7d0c9-d285-4a39-9598-e49078672411 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:45.562090 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b9a7d0c9-d285-4a39-9598-e49078672411 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:45.562545 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b9a7d0c9-d285-4a39-9598-e49078672411 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:45.563031 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b9a7d0c9-d285-4a39-9598-e49078672411 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:46.103493 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-2996ed96-7cdf-4a9b-ab85-30b8dfa6bd6c tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f496f24dccea47bd9a5ab532fe45e370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40794f05e8b94a0f8f087a87a58e0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:46.112110 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-2996ed96-7cdf-4a9b-ab85-30b8dfa6bd6c tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "GET /compute/v2.1/servers/546a5816-c2d9-494b-8c23-b0983cd11eb9" status: 200 len: 1307 microversion: 2.1 time: 0.670382 Aug 27 02:52:46.126360 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1301/2580] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:45 2022] GET /compute/v2.1/servers/546a5816-c2d9-494b-8c23-b0983cd11eb9 => generated 1307 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:46.132048 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6104ab06-ee98-4d92-bca3-6f6570dacdd8 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:46.132713 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-6104ab06-ee98-4d92-bca3-6f6570dacdd8 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] [instance: 6ef152e6-ba27-46bd-871a-04d8539b493e] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:46.139287 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6104ab06-ee98-4d92-bca3-6f6570dacdd8 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:46.139812 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6104ab06-ee98-4d92-bca3-6f6570dacdd8 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:46.140192 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6104ab06-ee98-4d92-bca3-6f6570dacdd8 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:46.141150 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6104ab06-ee98-4d92-bca3-6f6570dacdd8 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:46.141754 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6104ab06-ee98-4d92-bca3-6f6570dacdd8 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:46.142362 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6104ab06-ee98-4d92-bca3-6f6570dacdd8 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:46.150171 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-b9a7d0c9-d285-4a39-9598-e49078672411 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:46.156662 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:52:46.159595 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b9a7d0c9-d285-4a39-9598-e49078672411 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4" status: 200 len: 1314 microversion: 2.1 time: 0.617273 Aug 27 02:52:46.167823 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1280/2581] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:45 2022] GET /compute/v2.1/servers/97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4 => generated 1314 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:46.172990 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a4f44bf6-8685-4aac-84d0-e46b785ac8f7 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:46.174850 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-a4f44bf6-8685-4aac-84d0-e46b785ac8f7 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: ba987aee-2707-4d47-aba9-d2803aa70745] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:46.189167 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a4f44bf6-8685-4aac-84d0-e46b785ac8f7 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:46.190031 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a4f44bf6-8685-4aac-84d0-e46b785ac8f7 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:46.190919 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a4f44bf6-8685-4aac-84d0-e46b785ac8f7 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:46.192274 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a4f44bf6-8685-4aac-84d0-e46b785ac8f7 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:46.193198 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a4f44bf6-8685-4aac-84d0-e46b785ac8f7 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:46.193864 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a4f44bf6-8685-4aac-84d0-e46b785ac8f7 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:46.994840 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-6104ab06-ee98-4d92-bca3-6f6570dacdd8 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317e74b4bbc4da298a0dcbd78068352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a8810c21784788b4c0ee64dedbaf15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:47.006782 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-6104ab06-ee98-4d92-bca3-6f6570dacdd8 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] 10.222.0.70 "GET /compute/v2.1/servers/6ef152e6-ba27-46bd-871a-04d8539b493e" status: 200 len: 1504 microversion: 2.1 time: 0.878585 Aug 27 02:52:47.020355 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-a4f44bf6-8685-4aac-84d0-e46b785ac8f7 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:47.020355 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a4f44bf6-8685-4aac-84d0-e46b785ac8f7 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/ba987aee-2707-4d47-aba9-d2803aa70745" status: 200 len: 1475 microversion: 2.1 time: 0.849249 Aug 27 02:52:47.022442 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1302/2582] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:46 2022] GET /compute/v2.1/servers/6ef152e6-ba27-46bd-871a-04d8539b493e => generated 1504 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:47.030371 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5888e60f-d1e3-4abf-89da-4926e99586d8 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:47.031381 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-5888e60f-d1e3-4abf-89da-4926e99586d8 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:47.033615 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1281/2583] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:46 2022] GET /compute/v2.1/servers/ba987aee-2707-4d47-aba9-d2803aa70745 => generated 1475 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:47.038541 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5888e60f-d1e3-4abf-89da-4926e99586d8 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:47.039039 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5888e60f-d1e3-4abf-89da-4926e99586d8 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:47.039467 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5888e60f-d1e3-4abf-89da-4926e99586d8 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:47.040353 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5888e60f-d1e3-4abf-89da-4926e99586d8 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:47.040955 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5888e60f-d1e3-4abf-89da-4926e99586d8 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:47.041100 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-72649cc7-de9f-4825-9cd2-3e6a9e1312ba tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:47.041672 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-72649cc7-de9f-4825-9cd2-3e6a9e1312ba tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] [instance: 9da9d8a1-ec78-43ed-b29d-8560df6e3937] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:47.041794 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5888e60f-d1e3-4abf-89da-4926e99586d8 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:47.052854 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-72649cc7-de9f-4825-9cd2-3e6a9e1312ba tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:47.054485 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-72649cc7-de9f-4825-9cd2-3e6a9e1312ba tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:47.054935 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-72649cc7-de9f-4825-9cd2-3e6a9e1312ba tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:47.055676 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-72649cc7-de9f-4825-9cd2-3e6a9e1312ba tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:47.056605 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-72649cc7-de9f-4825-9cd2-3e6a9e1312ba tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:47.057041 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-72649cc7-de9f-4825-9cd2-3e6a9e1312ba tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:47.083085 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-72649cc7-de9f-4825-9cd2-3e6a9e1312ba tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] HTTP exception thrown: Instance 9da9d8a1-ec78-43ed-b29d-8560df6e3937 could not be found. Aug 27 02:52:47.086291 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-72649cc7-de9f-4825-9cd2-3e6a9e1312ba tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Request method failure captured: Aug 27 02:52:47.086291 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/9da9d8a1-ec78-43ed-b29d-8560df6e3937 HTTP/1.1 Aug 27 02:52:47.086291 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:52:47.086291 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:52:47.086291 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:52:47.086291 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:52:47.086291 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:52:47.086291 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:52:47.086291 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:52:47.086291 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:52:47.086291 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYbhlw58gG_4u485kIxbKSRkAddzbMY4e08nuWxOrS1SiNcNRHURuYtjLQLVk1b8b_4MXDtamTO7M9E5QdmCebzob_RDSOM56G0wU3ZKEGvsbpE-0O6AVgxWa5tdgiH0kKzMsqEU08uf6vXvV6Pp8FDdjT_bIw9a_PZEOfoluGXwldI Aug 27 02:52:47.086291 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:52:47.086291 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:52:47.086291 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:52:47.086291 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:52:47.086291 n-d-852278-4 devstack@n-api.service[134051]: X-Openstack-Nova-Api-Version: 2.21 Aug 27 02:52:47.086291 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:52:47.086291 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:52:47.086291 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 7efbb3a8866e47d7981008b08e89f416 Aug 27 02:52:47.086291 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1587321060 Aug 27 02:52:47.086291 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:52:47.086291 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:52:47.086291 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7efbb3a8866e47d7981008b08e89f416"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_7efbb3a8866e47d7981008b08e89f416", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7efbb3a8866e47d7981008b08e89f416"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/7efbb3a8866e47d7981008b08e89f416"}]}] Aug 27 02:52:47.086291 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-InstanceActionsV221TestJSON-1587321060 Aug 27 02:52:47.086291 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 7efbb3a8866e47d7981008b08e89f416 Aug 27 02:52:47.086291 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1587321060 Aug 27 02:52:47.086291 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-InstanceActionsV221TestJSON-1587321060-project Aug 27 02:52:47.086291 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:52:47.086291 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:52:47.086291 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 03191d0be5ae427286971e228534be75 Aug 27 02:52:47.086291 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-InstanceActionsV221TestJSON-1587321060-project Aug 27 02:52:47.086291 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 02:52:47.086291 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance 9da9d8a1-ec78-43ed-b29d-8560df6e3937 could not be found. Aug 27 02:52:47.086291 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '9da9d8a1-ec78-43ed-b29d-8560df6e3937'} Aug 27 02:52:47.086291 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:52:47.086291 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:52:47.086291 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:52:47.086291 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:52:47.086291 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:52:47.086291 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:52:47.086291 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:52:47.086291 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:52:47.086291 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:52:47.086291 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:52:47.086291 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9da9d8a1-ec78-43ed-b29d-8560df6e3937 could not be found. Aug 27 02:52:47.086291 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:52:47.086291 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:52:47.086291 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:52:47.086291 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:52:47.086291 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:52:47.086291 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:52:47.086291 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:52:47.086291 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:52:47.086291 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:52:47.086291 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:52:47.086291 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:52:47.086291 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:52:47.086291 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:52:47.086291 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:52:47.086291 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:52:47.086291 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:52:47.086291 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9da9d8a1-ec78-43ed-b29d-8560df6e3937 could not be found. Aug 27 02:52:47.086291 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:52:47.086291 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:52:47.090788 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:52:47.090788 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:52:47.090788 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:52:47.090788 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:52:47.090788 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:52:47.090788 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:52:47.090788 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9da9d8a1-ec78-43ed-b29d-8560df6e3937 could not be found. Aug 27 02:52:47.090788 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:52:47.092063 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-72649cc7-de9f-4825-9cd2-3e6a9e1312ba tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Returning 404 to user: Instance 9da9d8a1-ec78-43ed-b29d-8560df6e3937 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:52:47.092958 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-72649cc7-de9f-4825-9cd2-3e6a9e1312ba tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] 10.222.0.70 "GET /compute/v2.1/servers/9da9d8a1-ec78-43ed-b29d-8560df6e3937" status: 404 len: 111 microversion: 2.21 time: 0.057752 Aug 27 02:52:47.093655 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1282/2584] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:52:47 2022] GET /compute/v2.1/servers/9da9d8a1-ec78-43ed-b29d-8560df6e3937 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 02:52:47.098934 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3a0bf5a7-b897-4ed4-b748-9d0aec0498f8 tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:47.099537 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-3a0bf5a7-b897-4ed4-b748-9d0aec0498f8 tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] [instance: b4b1bc77-1487-47d4-ae3b-14e693c1c4c5] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:47.106284 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3a0bf5a7-b897-4ed4-b748-9d0aec0498f8 tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:47.106775 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3a0bf5a7-b897-4ed4-b748-9d0aec0498f8 tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:47.107199 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3a0bf5a7-b897-4ed4-b748-9d0aec0498f8 tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:47.108143 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3a0bf5a7-b897-4ed4-b748-9d0aec0498f8 tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:47.108724 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3a0bf5a7-b897-4ed4-b748-9d0aec0498f8 tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:47.109337 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3a0bf5a7-b897-4ed4-b748-9d0aec0498f8 tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:47.604876 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-5888e60f-d1e3-4abf-89da-4926e99586d8 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:47.613893 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-5888e60f-d1e3-4abf-89da-4926e99586d8 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1668 microversion: 2.1 time: 0.590069 Aug 27 02:52:47.614459 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1303/2585] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:47 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1668 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:47.632579 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-195668d6-c5fc-4576-a3af-65586006a91a tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:47.633421 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-195668d6-c5fc-4576-a3af-65586006a91a tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] [instance: 6ef152e6-ba27-46bd-871a-04d8539b493e] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:47.640749 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-195668d6-c5fc-4576-a3af-65586006a91a tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:47.641708 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-195668d6-c5fc-4576-a3af-65586006a91a tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:47.642268 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-195668d6-c5fc-4576-a3af-65586006a91a tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:47.643211 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-195668d6-c5fc-4576-a3af-65586006a91a tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:47.644704 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-195668d6-c5fc-4576-a3af-65586006a91a tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:47.645515 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-195668d6-c5fc-4576-a3af-65586006a91a tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:47.682551 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-3a0bf5a7-b897-4ed4-b748-9d0aec0498f8 tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745fd53ea2694f919ff28af2c17e60a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079fe2e8a6184fba858e3d8e60730fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:47.691209 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-3a0bf5a7-b897-4ed4-b748-9d0aec0498f8 tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] 10.222.0.70 "GET /compute/v2.1/servers/b4b1bc77-1487-47d4-ae3b-14e693c1c4c5" status: 200 len: 1499 microversion: 2.1 time: 0.595913 Aug 27 02:52:47.692141 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1283/2586] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:47 2022] GET /compute/v2.1/servers/b4b1bc77-1487-47d4-ae3b-14e693c1c4c5 => generated 1499 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:47.697390 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-52b6a9c8-b4e6-4106-be34-58724f4af173 tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Calling method '.version_select at 0x7f5edf214280>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:47.698224 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-52b6a9c8-b4e6-4106-be34-58724f4af173 tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] [instance: 9da9d8a1-ec78-43ed-b29d-8560df6e3937] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:47.705424 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-52b6a9c8-b4e6-4106-be34-58724f4af173 tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:47.706397 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-52b6a9c8-b4e6-4106-be34-58724f4af173 tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:47.707232 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-52b6a9c8-b4e6-4106-be34-58724f4af173 tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:47.708375 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-52b6a9c8-b4e6-4106-be34-58724f4af173 tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:47.709109 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-52b6a9c8-b4e6-4106-be34-58724f4af173 tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:47.709757 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-52b6a9c8-b4e6-4106-be34-58724f4af173 tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:47.795930 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-52b6a9c8-b4e6-4106-be34-58724f4af173 tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] 10.222.0.70 "GET /compute/v2.1/servers/9da9d8a1-ec78-43ed-b29d-8560df6e3937/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.102454 Aug 27 02:52:47.808498 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1284/2587] 10.222.0.70 () {60 vars in 1337 bytes} [Sat Aug 27 02:52:47 2022] GET /compute/v2.1/servers/9da9d8a1-ec78-43ed-b29d-8560df6e3937/os-instance-actions => generated 611 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:52:47.814726 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-acd81008-31bb-4846-9349-9bef61c469ce tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:47.815764 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-acd81008-31bb-4846-9349-9bef61c469ce tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] [instance: 546a5816-c2d9-494b-8c23-b0983cd11eb9] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:47.822327 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-acd81008-31bb-4846-9349-9bef61c469ce tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:47.823238 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-acd81008-31bb-4846-9349-9bef61c469ce tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:47.823838 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-acd81008-31bb-4846-9349-9bef61c469ce tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:47.824707 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-acd81008-31bb-4846-9349-9bef61c469ce tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:47.825299 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-acd81008-31bb-4846-9349-9bef61c469ce tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:47.825864 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-acd81008-31bb-4846-9349-9bef61c469ce tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:48.136379 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-195668d6-c5fc-4576-a3af-65586006a91a tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317e74b4bbc4da298a0dcbd78068352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a8810c21784788b4c0ee64dedbaf15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:48.149664 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-195668d6-c5fc-4576-a3af-65586006a91a tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] 10.222.0.70 "GET /compute/v2.1/servers/6ef152e6-ba27-46bd-871a-04d8539b493e" status: 200 len: 1504 microversion: 2.1 time: 0.533954 Aug 27 02:52:48.150332 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1304/2588] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:47 2022] GET /compute/v2.1/servers/6ef152e6-ba27-46bd-871a-04d8539b493e => generated 1504 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:48.156431 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-810067d2-520d-4cbd-ba1e-5caf35e1219a tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:48.160399 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-810067d2-520d-4cbd-ba1e-5caf35e1219a tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: 97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:48.178196 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-810067d2-520d-4cbd-ba1e-5caf35e1219a tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:48.179011 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-810067d2-520d-4cbd-ba1e-5caf35e1219a tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:48.179441 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-810067d2-520d-4cbd-ba1e-5caf35e1219a tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:48.180349 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-810067d2-520d-4cbd-ba1e-5caf35e1219a tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:48.180988 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-810067d2-520d-4cbd-ba1e-5caf35e1219a tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:48.181372 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-810067d2-520d-4cbd-ba1e-5caf35e1219a tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:48.376231 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-acd81008-31bb-4846-9349-9bef61c469ce tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f496f24dccea47bd9a5ab532fe45e370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40794f05e8b94a0f8f087a87a58e0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:48.393333 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-acd81008-31bb-4846-9349-9bef61c469ce tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "GET /compute/v2.1/servers/546a5816-c2d9-494b-8c23-b0983cd11eb9" status: 200 len: 1307 microversion: 2.1 time: 0.583279 Aug 27 02:52:48.404333 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1285/2589] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:47 2022] GET /compute/v2.1/servers/546a5816-c2d9-494b-8c23-b0983cd11eb9 => generated 1307 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:48.404333 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-2dc87495-5026-41f4-815f-0d7d81f9aec4 req-a466a8ba-4a1e-49c9-be48-b4b1ae051d99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba987aee-2707-4d47-aba9-d2803aa70745", "tag": "0871e4ff-ef2c-4a64-a799-ecfb74bf8dfa"}, {"name": "network-changed", "server_uuid": "546a5816-c2d9-494b-8c23-b0983cd11eb9", "tag": "2efb5816-4d86-45f2-a90e-53904afe8489"}, {"name": "network-changed", "server_uuid": "97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4", "tag": "b6ccabb4-3a86-495e-9764-020c27981067"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:52:48.420509 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-2dc87495-5026-41f4-815f-0d7d81f9aec4 req-a466a8ba-4a1e-49c9-be48-b4b1ae051d99 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:48.421113 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-2dc87495-5026-41f4-815f-0d7d81f9aec4 req-a466a8ba-4a1e-49c9-be48-b4b1ae051d99 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:48.424585 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-2dc87495-5026-41f4-815f-0d7d81f9aec4 req-a466a8ba-4a1e-49c9-be48-b4b1ae051d99 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:48.480759 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-2dc87495-5026-41f4-815f-0d7d81f9aec4 req-a466a8ba-4a1e-49c9-be48-b4b1ae051d99 service nova] Creating event network-changed:0871e4ff-ef2c-4a64-a799-ecfb74bf8dfa for instance ba987aee-2707-4d47-aba9-d2803aa70745 on n-h2-852278-4 Aug 27 02:52:48.482230 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-2dc87495-5026-41f4-815f-0d7d81f9aec4 req-a466a8ba-4a1e-49c9-be48-b4b1ae051d99 service nova] Creating event network-changed:2efb5816-4d86-45f2-a90e-53904afe8489 for instance 546a5816-c2d9-494b-8c23-b0983cd11eb9 on n-h2-852278-4 Aug 27 02:52:48.482899 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-2dc87495-5026-41f4-815f-0d7d81f9aec4 req-a466a8ba-4a1e-49c9-be48-b4b1ae051d99 service nova] Creating event network-changed:b6ccabb4-3a86-495e-9764-020c27981067 for instance 97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4 on n-h2-852278-4 Aug 27 02:52:48.510398 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [req-2dc87495-5026-41f4-815f-0d7d81f9aec4 req-a466a8ba-4a1e-49c9-be48-b4b1ae051d99 service nova] Instance ba987aee-2707-4d47-aba9-d2803aa70745 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-852278-4', 'n-h1-852278-4'} {{(pid=134051) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 02:52:48.554818 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-2dc87495-5026-41f4-815f-0d7d81f9aec4 req-a466a8ba-4a1e-49c9-be48-b4b1ae051d99 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.158672 Aug 27 02:52:48.555737 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1286/2590] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:52:48 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:52:48.566520 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-810067d2-520d-4cbd-ba1e-5caf35e1219a tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:48.570614 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-32126be8-5fee-4eba-8277-1c4633bcb3e3 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-527574935"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:52:48.576626 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-810067d2-520d-4cbd-ba1e-5caf35e1219a tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4" status: 200 len: 1314 microversion: 2.1 time: 0.424913 Aug 27 02:52:48.577429 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1305/2591] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:48 2022] GET /compute/v2.1/servers/97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4 => generated 1314 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:48.583329 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-cfd1b451-1a49-42f0-92ea-d63083174679 tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:48.584015 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-cfd1b451-1a49-42f0-92ea-d63083174679 tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] [instance: 9da9d8a1-ec78-43ed-b29d-8560df6e3937] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:48.591581 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-32126be8-5fee-4eba-8277-1c4633bcb3e3 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:48.595845 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cfd1b451-1a49-42f0-92ea-d63083174679 tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:48.596358 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cfd1b451-1a49-42f0-92ea-d63083174679 tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:48.596847 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cfd1b451-1a49-42f0-92ea-d63083174679 tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:48.607947 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cfd1b451-1a49-42f0-92ea-d63083174679 tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:48.609131 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cfd1b451-1a49-42f0-92ea-d63083174679 tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:48.611224 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cfd1b451-1a49-42f0-92ea-d63083174679 tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:48.617033 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-32126be8-5fee-4eba-8277-1c4633bcb3e3 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:48.617762 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-32126be8-5fee-4eba-8277-1c4633bcb3e3 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:48.618899 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-32126be8-5fee-4eba-8277-1c4633bcb3e3 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:48.621420 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-32126be8-5fee-4eba-8277-1c4633bcb3e3 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:48.623968 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-32126be8-5fee-4eba-8277-1c4633bcb3e3 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:48.625781 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-32126be8-5fee-4eba-8277-1c4633bcb3e3 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:48.663003 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-cfd1b451-1a49-42f0-92ea-d63083174679 tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] HTTP exception thrown: Instance 9da9d8a1-ec78-43ed-b29d-8560df6e3937 could not be found. Aug 27 02:52:48.667683 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-cfd1b451-1a49-42f0-92ea-d63083174679 tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Request method failure captured: Aug 27 02:52:48.667683 n-d-852278-4 devstack@n-api.service[134052]: request: DELETE /compute/v2.1/servers/9da9d8a1-ec78-43ed-b29d-8560df6e3937 HTTP/1.1 Aug 27 02:52:48.667683 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:52:48.667683 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:52:48.667683 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:52:48.667683 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:52:48.667683 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:52:48.667683 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:52:48.667683 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:52:48.667683 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:52:48.667683 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYbhlw58gG_4u485kIxbKSRkAddzbMY4e08nuWxOrS1SiNcNRHURuYtjLQLVk1b8b_4MXDtamTO7M9E5QdmCebzob_RDSOM56G0wU3ZKEGvsbpE-0O6AVgxWa5tdgiH0kKzMsqEU08uf6vXvV6Pp8FDdjT_bIw9a_PZEOfoluGXwldI Aug 27 02:52:48.667683 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:52:48.667683 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:52:48.667683 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:52:48.667683 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:52:48.667683 n-d-852278-4 devstack@n-api.service[134052]: X-Openstack-Nova-Api-Version: 2.21 Aug 27 02:52:48.667683 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:52:48.667683 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:52:48.667683 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 7efbb3a8866e47d7981008b08e89f416 Aug 27 02:52:48.667683 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1587321060 Aug 27 02:52:48.667683 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:52:48.667683 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:52:48.667683 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7efbb3a8866e47d7981008b08e89f416"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_7efbb3a8866e47d7981008b08e89f416", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7efbb3a8866e47d7981008b08e89f416"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/7efbb3a8866e47d7981008b08e89f416"}]}] Aug 27 02:52:48.667683 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-InstanceActionsV221TestJSON-1587321060 Aug 27 02:52:48.667683 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 7efbb3a8866e47d7981008b08e89f416 Aug 27 02:52:48.667683 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1587321060 Aug 27 02:52:48.667683 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-InstanceActionsV221TestJSON-1587321060-project Aug 27 02:52:48.667683 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:52:48.667683 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:52:48.667683 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 03191d0be5ae427286971e228534be75 Aug 27 02:52:48.667683 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-InstanceActionsV221TestJSON-1587321060-project Aug 27 02:52:48.667683 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 02:52:48.667683 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance 9da9d8a1-ec78-43ed-b29d-8560df6e3937 could not be found. Aug 27 02:52:48.667683 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '9da9d8a1-ec78-43ed-b29d-8560df6e3937'} Aug 27 02:52:48.667683 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:52:48.667683 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:52:48.667683 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:52:48.667683 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:52:48.667683 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:52:48.667683 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:52:48.667683 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:52:48.667683 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:52:48.667683 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:52:48.667683 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:52:48.667683 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9da9d8a1-ec78-43ed-b29d-8560df6e3937 could not be found. Aug 27 02:52:48.667683 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:52:48.667683 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:52:48.667683 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:52:48.667683 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:52:48.667683 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:52:48.667683 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:52:48.667683 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:52:48.667683 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:52:48.667683 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:52:48.667683 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:52:48.667683 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 02:52:48.667683 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 02:52:48.667683 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 02:52:48.667683 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 02:52:48.667683 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:52:48.667683 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:52:48.667683 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:52:48.667683 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:52:48.672515 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9da9d8a1-ec78-43ed-b29d-8560df6e3937 could not be found. Aug 27 02:52:48.672515 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:52:48.672515 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:52:48.672515 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:52:48.672515 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:52:48.672515 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:52:48.672515 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:52:48.672515 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:52:48.672515 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:52:48.672515 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9da9d8a1-ec78-43ed-b29d-8560df6e3937 could not be found. Aug 27 02:52:48.672515 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:52:48.674592 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-cfd1b451-1a49-42f0-92ea-d63083174679 tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Returning 404 to user: Instance 9da9d8a1-ec78-43ed-b29d-8560df6e3937 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:52:48.675646 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-cfd1b451-1a49-42f0-92ea-d63083174679 tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] 10.222.0.70 "DELETE /compute/v2.1/servers/9da9d8a1-ec78-43ed-b29d-8560df6e3937" status: 404 len: 111 microversion: 2.21 time: 0.096983 Aug 27 02:52:48.678554 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1306/2592] 10.222.0.70 () {60 vars in 1280 bytes} [Sat Aug 27 02:52:48 2022] DELETE /compute/v2.1/servers/9da9d8a1-ec78-43ed-b29d-8560df6e3937 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 02:52:48.687850 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3a7d9f00-36c6-410a-8797-cac451e55f0e tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:48.693102 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-3a7d9f00-36c6-410a-8797-cac451e55f0e tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: ba987aee-2707-4d47-aba9-d2803aa70745] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:48.706234 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3a7d9f00-36c6-410a-8797-cac451e55f0e tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:48.706848 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3a7d9f00-36c6-410a-8797-cac451e55f0e tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:48.707516 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3a7d9f00-36c6-410a-8797-cac451e55f0e tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:48.709529 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3a7d9f00-36c6-410a-8797-cac451e55f0e tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:48.710007 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3a7d9f00-36c6-410a-8797-cac451e55f0e tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:48.710440 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3a7d9f00-36c6-410a-8797-cac451e55f0e tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:48.995334 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-32126be8-5fee-4eba-8277-1c4633bcb3e3 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "POST /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd/action" status: 202 len: 0 microversion: 2.1 time: 0.435076 Aug 27 02:52:49.005745 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1287/2593] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 02:52:48 2022] POST /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd/action => generated 0 bytes in 449 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Aug 27 02:52:49.022603 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b1366056-3699-4f41-a9a6-29df80c5a098 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:49.027954 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b1366056-3699-4f41-a9a6-29df80c5a098 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] [instance: 6ef152e6-ba27-46bd-871a-04d8539b493e] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:49.038245 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-3a7d9f00-36c6-410a-8797-cac451e55f0e tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:49.042836 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b1366056-3699-4f41-a9a6-29df80c5a098 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:49.043522 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b1366056-3699-4f41-a9a6-29df80c5a098 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:49.043984 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b1366056-3699-4f41-a9a6-29df80c5a098 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:49.044790 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b1366056-3699-4f41-a9a6-29df80c5a098 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:49.046156 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b1366056-3699-4f41-a9a6-29df80c5a098 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:49.046913 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b1366056-3699-4f41-a9a6-29df80c5a098 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:49.049319 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-3a7d9f00-36c6-410a-8797-cac451e55f0e tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/ba987aee-2707-4d47-aba9-d2803aa70745" status: 200 len: 1475 microversion: 2.1 time: 0.369233 Aug 27 02:52:49.050181 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1307/2594] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:48 2022] GET /compute/v2.1/servers/ba987aee-2707-4d47-aba9-d2803aa70745 => generated 1475 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:49.055425 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-eea3c245-6d0f-40d9-a713-f6a36558fc3c tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:49.056377 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-eea3c245-6d0f-40d9-a713-f6a36558fc3c tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] [instance: 9da9d8a1-ec78-43ed-b29d-8560df6e3937] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:49.062967 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-eea3c245-6d0f-40d9-a713-f6a36558fc3c tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:49.063780 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-eea3c245-6d0f-40d9-a713-f6a36558fc3c tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:49.064521 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-eea3c245-6d0f-40d9-a713-f6a36558fc3c tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:49.065463 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-eea3c245-6d0f-40d9-a713-f6a36558fc3c tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:49.066127 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-eea3c245-6d0f-40d9-a713-f6a36558fc3c tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:49.066789 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-eea3c245-6d0f-40d9-a713-f6a36558fc3c tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:49.085043 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-eea3c245-6d0f-40d9-a713-f6a36558fc3c tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] HTTP exception thrown: Instance 9da9d8a1-ec78-43ed-b29d-8560df6e3937 could not be found. Aug 27 02:52:49.087663 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-eea3c245-6d0f-40d9-a713-f6a36558fc3c tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Request method failure captured: Aug 27 02:52:49.087663 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/servers/9da9d8a1-ec78-43ed-b29d-8560df6e3937 HTTP/1.1 Aug 27 02:52:49.087663 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:52:49.087663 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:52:49.087663 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:52:49.087663 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:52:49.087663 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:52:49.087663 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:52:49.087663 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:52:49.087663 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:52:49.087663 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYbhlw58gG_4u485kIxbKSRkAddzbMY4e08nuWxOrS1SiNcNRHURuYtjLQLVk1b8b_4MXDtamTO7M9E5QdmCebzob_RDSOM56G0wU3ZKEGvsbpE-0O6AVgxWa5tdgiH0kKzMsqEU08uf6vXvV6Pp8FDdjT_bIw9a_PZEOfoluGXwldI Aug 27 02:52:49.087663 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:52:49.087663 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:52:49.087663 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:52:49.087663 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:52:49.087663 n-d-852278-4 devstack@n-api.service[134052]: X-Openstack-Nova-Api-Version: 2.21 Aug 27 02:52:49.087663 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:52:49.087663 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:52:49.087663 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 7efbb3a8866e47d7981008b08e89f416 Aug 27 02:52:49.087663 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1587321060 Aug 27 02:52:49.087663 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:52:49.087663 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:52:49.087663 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7efbb3a8866e47d7981008b08e89f416"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_7efbb3a8866e47d7981008b08e89f416", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7efbb3a8866e47d7981008b08e89f416"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/7efbb3a8866e47d7981008b08e89f416"}]}] Aug 27 02:52:49.087663 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-InstanceActionsV221TestJSON-1587321060 Aug 27 02:52:49.087663 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 7efbb3a8866e47d7981008b08e89f416 Aug 27 02:52:49.087663 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1587321060 Aug 27 02:52:49.087663 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-InstanceActionsV221TestJSON-1587321060-project Aug 27 02:52:49.087663 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:52:49.087663 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:52:49.087663 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 03191d0be5ae427286971e228534be75 Aug 27 02:52:49.087663 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-InstanceActionsV221TestJSON-1587321060-project Aug 27 02:52:49.087663 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 02:52:49.087663 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance 9da9d8a1-ec78-43ed-b29d-8560df6e3937 could not be found. Aug 27 02:52:49.087663 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '9da9d8a1-ec78-43ed-b29d-8560df6e3937'} Aug 27 02:52:49.087663 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:52:49.087663 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:52:49.087663 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:52:49.087663 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:52:49.087663 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:52:49.087663 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:52:49.087663 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:52:49.087663 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:52:49.087663 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:52:49.087663 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:52:49.087663 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9da9d8a1-ec78-43ed-b29d-8560df6e3937 could not be found. Aug 27 02:52:49.087663 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:52:49.087663 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:52:49.087663 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:52:49.087663 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:52:49.087663 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:52:49.087663 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:52:49.087663 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:52:49.087663 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:52:49.087663 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:52:49.087663 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:52:49.087663 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:52:49.087663 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:52:49.087663 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:52:49.087663 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:52:49.087663 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:52:49.087663 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:52:49.087663 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9da9d8a1-ec78-43ed-b29d-8560df6e3937 could not be found. Aug 27 02:52:49.087663 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:52:49.087663 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:52:49.091538 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:52:49.091538 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:52:49.091538 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:52:49.091538 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:52:49.091538 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:52:49.091538 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:52:49.091538 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9da9d8a1-ec78-43ed-b29d-8560df6e3937 could not be found. Aug 27 02:52:49.091538 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:52:49.096730 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b1366056-3699-4f41-a9a6-29df80c5a098 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] [instance: 6ef152e6-ba27-46bd-871a-04d8539b493e] Going to try to terminate instance {{(pid=134051) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:52:49.108534 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-eea3c245-6d0f-40d9-a713-f6a36558fc3c tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] Returning 404 to user: Instance 9da9d8a1-ec78-43ed-b29d-8560df6e3937 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:52:49.109804 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-eea3c245-6d0f-40d9-a713-f6a36558fc3c tempest-InstanceActionsV221TestJSON-1587321060 tempest-InstanceActionsV221TestJSON-1587321060-project] 10.222.0.70 "GET /compute/v2.1/servers/9da9d8a1-ec78-43ed-b29d-8560df6e3937" status: 404 len: 111 microversion: 2.21 time: 0.058304 Aug 27 02:52:49.110956 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1308/2595] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:52:49 2022] GET /compute/v2.1/servers/9da9d8a1-ec78-43ed-b29d-8560df6e3937 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 02:52:49.132001 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-16f0931b-66cf-4a5a-a465-5f253083006d tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:49.145980 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-16f0931b-66cf-4a5a-a465-5f253083006d tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:49.164377 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-16f0931b-66cf-4a5a-a465-5f253083006d tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:49.165505 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-16f0931b-66cf-4a5a-a465-5f253083006d tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:49.166232 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-16f0931b-66cf-4a5a-a465-5f253083006d tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:49.167968 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-16f0931b-66cf-4a5a-a465-5f253083006d tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:49.168775 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-16f0931b-66cf-4a5a-a465-5f253083006d tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:49.170133 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-16f0931b-66cf-4a5a-a465-5f253083006d tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:49.290651 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b1366056-3699-4f41-a9a6-29df80c5a098 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] 10.222.0.70 "DELETE /compute/v2.1/servers/6ef152e6-ba27-46bd-871a-04d8539b493e" status: 204 len: 0 microversion: 2.1 time: 0.282121 Aug 27 02:52:49.292030 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1288/2596] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:52:49 2022] DELETE /compute/v2.1/servers/6ef152e6-ba27-46bd-871a-04d8539b493e => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:52:49.453356 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-fd2f8472-87a9-4df7-b7a3-d68663ddb2bb tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:49.454106 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-fd2f8472-87a9-4df7-b7a3-d68663ddb2bb tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] [instance: 546a5816-c2d9-494b-8c23-b0983cd11eb9] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:49.461643 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fd2f8472-87a9-4df7-b7a3-d68663ddb2bb tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:49.462455 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fd2f8472-87a9-4df7-b7a3-d68663ddb2bb tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:49.463186 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fd2f8472-87a9-4df7-b7a3-d68663ddb2bb tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:49.464748 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fd2f8472-87a9-4df7-b7a3-d68663ddb2bb tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:49.465458 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fd2f8472-87a9-4df7-b7a3-d68663ddb2bb tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:49.466110 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fd2f8472-87a9-4df7-b7a3-d68663ddb2bb tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:50.154973 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-16f0931b-66cf-4a5a-a465-5f253083006d tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:50.168172 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-16f0931b-66cf-4a5a-a465-5f253083006d tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1678 microversion: 2.1 time: 1.055758 Aug 27 02:52:50.172806 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1309/2597] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:49 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1678 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:50.178980 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9452a7e6-2949-4894-9f5c-0e8cdf37e998 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-739001246", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "networks": [{"uuid": "ebe7b2b2-924f-4033-b3f1-0cce3bc68ae5"}]}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:52:50.234829 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-fd2f8472-87a9-4df7-b7a3-d68663ddb2bb tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f496f24dccea47bd9a5ab532fe45e370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40794f05e8b94a0f8f087a87a58e0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:50.253073 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-fd2f8472-87a9-4df7-b7a3-d68663ddb2bb tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "GET /compute/v2.1/servers/546a5816-c2d9-494b-8c23-b0983cd11eb9" status: 200 len: 1307 microversion: 2.1 time: 0.837089 Aug 27 02:52:50.255269 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1289/2598] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:49 2022] GET /compute/v2.1/servers/546a5816-c2d9-494b-8c23-b0983cd11eb9 => generated 1307 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:50.269451 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.network.neutron [None req-9452a7e6-2949-4894-9f5c-0e8cdf37e998 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] validate_networks() for [('ebe7b2b2-924f-4033-b3f1-0cce3bc68ae5', None, None, None, None, None)] {{(pid=134052) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:52:50.274944 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c13106a1-2693-44e0-aeef-ffb5908bbbbe tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:50.275576 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-c13106a1-2693-44e0-aeef-ffb5908bbbbe tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: 97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:50.289944 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c13106a1-2693-44e0-aeef-ffb5908bbbbe tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:50.290849 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c13106a1-2693-44e0-aeef-ffb5908bbbbe tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:50.291781 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c13106a1-2693-44e0-aeef-ffb5908bbbbe tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:50.292801 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c13106a1-2693-44e0-aeef-ffb5908bbbbe tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:50.295407 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c13106a1-2693-44e0-aeef-ffb5908bbbbe tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:50.296874 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c13106a1-2693-44e0-aeef-ffb5908bbbbe tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:51.121464 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-c13106a1-2693-44e0-aeef-ffb5908bbbbe tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:51.131707 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c13106a1-2693-44e0-aeef-ffb5908bbbbe tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4" status: 200 len: 1314 microversion: 2.1 time: 0.874381 Aug 27 02:52:51.144348 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1290/2599] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:50 2022] GET /compute/v2.1/servers/97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4 => generated 1314 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:51.144348 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ce6d6247-bd18-4965-b440-06f0801c1132 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:51.144348 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-ce6d6247-bd18-4965-b440-06f0801c1132 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: ba987aee-2707-4d47-aba9-d2803aa70745] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:51.145568 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ce6d6247-bd18-4965-b440-06f0801c1132 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:51.146177 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ce6d6247-bd18-4965-b440-06f0801c1132 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:51.146608 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ce6d6247-bd18-4965-b440-06f0801c1132 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:51.147468 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ce6d6247-bd18-4965-b440-06f0801c1132 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:51.149152 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ce6d6247-bd18-4965-b440-06f0801c1132 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:51.149152 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ce6d6247-bd18-4965-b440-06f0801c1132 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:51.511435 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-ce6d6247-bd18-4965-b440-06f0801c1132 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:51.521917 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ce6d6247-bd18-4965-b440-06f0801c1132 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/ba987aee-2707-4d47-aba9-d2803aa70745" status: 200 len: 1473 microversion: 2.1 time: 0.386504 Aug 27 02:52:51.522825 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1291/2600] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:51 2022] GET /compute/v2.1/servers/ba987aee-2707-4d47-aba9-d2803aa70745 => generated 1473 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:51.529691 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-00575560-2faf-4532-9677-f49b59eab369 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:51.530609 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-00575560-2faf-4532-9677-f49b59eab369 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:51.537609 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-00575560-2faf-4532-9677-f49b59eab369 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:51.538129 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-00575560-2faf-4532-9677-f49b59eab369 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:51.538508 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-00575560-2faf-4532-9677-f49b59eab369 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:51.540303 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-00575560-2faf-4532-9677-f49b59eab369 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:51.541336 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-00575560-2faf-4532-9677-f49b59eab369 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:51.542353 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-00575560-2faf-4532-9677-f49b59eab369 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:51.590347 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-9452a7e6-2949-4894-9f5c-0e8cdf37e998 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Flavor limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:52:51.590838 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-9452a7e6-2949-4894-9f5c-0e8cdf37e998 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Image limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:52:51.591560 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-9452a7e6-2949-4894-9f5c-0e8cdf37e998 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Flavor pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:52:51.591682 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-9452a7e6-2949-4894-9f5c-0e8cdf37e998 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Image pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:52:51.592004 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-9452a7e6-2949-4894-9f5c-0e8cdf37e998 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:52:51.622742 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9452a7e6-2949-4894-9f5c-0e8cdf37e998 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:51.623224 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9452a7e6-2949-4894-9f5c-0e8cdf37e998 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:51.623681 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9452a7e6-2949-4894-9f5c-0e8cdf37e998 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:51.624626 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9452a7e6-2949-4894-9f5c-0e8cdf37e998 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:51.625565 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9452a7e6-2949-4894-9f5c-0e8cdf37e998 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:51.626282 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9452a7e6-2949-4894-9f5c-0e8cdf37e998 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:51.654021 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-9452a7e6-2949-4894-9f5c-0e8cdf37e998 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Getting quotas for project c5a8810c21784788b4c0ee64dedbaf15. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:52:51.661965 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-9452a7e6-2949-4894-9f5c-0e8cdf37e998 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Getting quotas for user d317e74b4bbc4da298a0dcbd78068352 and project c5a8810c21784788b4c0ee64dedbaf15. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:52:51.676493 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-9452a7e6-2949-4894-9f5c-0e8cdf37e998 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Going to run 1 instances... {{(pid=134052) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:52:51.679755 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-9452a7e6-2949-4894-9f5c-0e8cdf37e998 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] [instance: 7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134052) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:52:51.752670 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9452a7e6-2949-4894-9f5c-0e8cdf37e998 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.578584 Aug 27 02:52:51.753492 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1310/2601] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 02:52:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1580 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:52:51.759031 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0bfa3d98-e40d-4654-8013-46669cd5fda8 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:51.759993 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-0bfa3d98-e40d-4654-8013-46669cd5fda8 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] [instance: 546a5816-c2d9-494b-8c23-b0983cd11eb9] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:51.767509 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0bfa3d98-e40d-4654-8013-46669cd5fda8 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:51.768350 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0bfa3d98-e40d-4654-8013-46669cd5fda8 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:51.769098 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0bfa3d98-e40d-4654-8013-46669cd5fda8 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:51.785168 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0bfa3d98-e40d-4654-8013-46669cd5fda8 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:51.786368 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0bfa3d98-e40d-4654-8013-46669cd5fda8 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:51.787020 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0bfa3d98-e40d-4654-8013-46669cd5fda8 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:51.847639 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-00575560-2faf-4532-9677-f49b59eab369 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:51.856443 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-00575560-2faf-4532-9677-f49b59eab369 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1686 microversion: 2.1 time: 0.332277 Aug 27 02:52:51.860226 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1292/2602] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:51 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1686 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:51.870480 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-deac5ce4-8db0-4e63-9236-feed6002e0f5 req-55cf3df4-a5f7-4853-914a-9ae17941d835 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb0d71f2-158d-4acc-8774-6874e7da29cd", "name": "network-vif-unplugged", "status": "completed", "tag": "fe5d48cf-956a-4e15-9a8e-fdd605d313b1"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:52:51.902780 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-deac5ce4-8db0-4e63-9236-feed6002e0f5 req-55cf3df4-a5f7-4853-914a-9ae17941d835 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:51.903267 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-deac5ce4-8db0-4e63-9236-feed6002e0f5 req-55cf3df4-a5f7-4853-914a-9ae17941d835 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:51.903696 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-deac5ce4-8db0-4e63-9236-feed6002e0f5 req-55cf3df4-a5f7-4853-914a-9ae17941d835 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:51.919538 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-deac5ce4-8db0-4e63-9236-feed6002e0f5 req-55cf3df4-a5f7-4853-914a-9ae17941d835 service nova] Creating event network-vif-unplugged:fe5d48cf-956a-4e15-9a8e-fdd605d313b1 for instance bb0d71f2-158d-4acc-8774-6874e7da29cd on n-h1-852278-4 Aug 27 02:52:51.933719 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-deac5ce4-8db0-4e63-9236-feed6002e0f5 req-55cf3df4-a5f7-4853-914a-9ae17941d835 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.071029 Aug 27 02:52:51.934630 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1293/2603] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:52:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:52:51.939880 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-fbee9388-ea39-431f-8799-13eafca58b99 tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:51.940528 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-fbee9388-ea39-431f-8799-13eafca58b99 tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] [instance: b4b1bc77-1487-47d4-ae3b-14e693c1c4c5] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:51.956517 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fbee9388-ea39-431f-8799-13eafca58b99 tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:51.957014 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fbee9388-ea39-431f-8799-13eafca58b99 tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:51.962752 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fbee9388-ea39-431f-8799-13eafca58b99 tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:51.963511 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fbee9388-ea39-431f-8799-13eafca58b99 tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:51.964328 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fbee9388-ea39-431f-8799-13eafca58b99 tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:51.973249 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fbee9388-ea39-431f-8799-13eafca58b99 tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:52.039402 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-fbee9388-ea39-431f-8799-13eafca58b99 tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] [instance: b4b1bc77-1487-47d4-ae3b-14e693c1c4c5] Going to try to terminate instance {{(pid=134051) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:52:52.129334 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:52:52.258871 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-fbee9388-ea39-431f-8799-13eafca58b99 tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] 10.222.0.70 "DELETE /compute/v2.1/servers/b4b1bc77-1487-47d4-ae3b-14e693c1c4c5" status: 204 len: 0 microversion: 2.1 time: 0.320391 Aug 27 02:52:52.261158 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1294/2604] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:52:51 2022] DELETE /compute/v2.1/servers/b4b1bc77-1487-47d4-ae3b-14e693c1c4c5 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:52:52.279137 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-988f5008-62cd-41ac-aaae-2e8139305c83 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:52.314450 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-988f5008-62cd-41ac-aaae-2e8139305c83 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] [instance: 7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:52.519801 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-988f5008-62cd-41ac-aaae-2e8139305c83 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317e74b4bbc4da298a0dcbd78068352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a8810c21784788b4c0ee64dedbaf15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:52.531451 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-988f5008-62cd-41ac-aaae-2e8139305c83 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] 10.222.0.70 "GET /compute/v2.1/servers/7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8" status: 200 len: 1217 microversion: 2.1 time: 0.266962 Aug 27 02:52:52.532299 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1295/2605] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:52 2022] GET /compute/v2.1/servers/7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8 => generated 1217 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:52.539114 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-fbc8494f-8f56-4bd4-85d6-71a8f3c93614 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:52.540560 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-fbc8494f-8f56-4bd4-85d6-71a8f3c93614 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: 97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:52.563392 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0bfa3d98-e40d-4654-8013-46669cd5fda8 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f496f24dccea47bd9a5ab532fe45e370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40794f05e8b94a0f8f087a87a58e0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:52.575176 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fbc8494f-8f56-4bd4-85d6-71a8f3c93614 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:52.575671 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fbc8494f-8f56-4bd4-85d6-71a8f3c93614 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:52.576108 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fbc8494f-8f56-4bd4-85d6-71a8f3c93614 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:52.576862 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fbc8494f-8f56-4bd4-85d6-71a8f3c93614 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:52.577303 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fbc8494f-8f56-4bd4-85d6-71a8f3c93614 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:52.578060 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fbc8494f-8f56-4bd4-85d6-71a8f3c93614 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:52.586834 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-0bfa3d98-e40d-4654-8013-46669cd5fda8 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "GET /compute/v2.1/servers/546a5816-c2d9-494b-8c23-b0983cd11eb9" status: 200 len: 1307 microversion: 2.1 time: 0.827511 Aug 27 02:52:52.587470 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1311/2606] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:51 2022] GET /compute/v2.1/servers/546a5816-c2d9-494b-8c23-b0983cd11eb9 => generated 1307 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:52.592339 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-d06df750-fc24-4505-a69f-b634b2659b73 req-3b67e727-d46a-413a-9ae3-2670d0285bd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ef152e6-ba27-46bd-871a-04d8539b493e", "name": "network-vif-deleted", "tag": "2080aa25-53d4-46f2-a694-162ef2ea0ac4"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:52:52.621272 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-d06df750-fc24-4505-a69f-b634b2659b73 req-3b67e727-d46a-413a-9ae3-2670d0285bd7 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:52.621919 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-d06df750-fc24-4505-a69f-b634b2659b73 req-3b67e727-d46a-413a-9ae3-2670d0285bd7 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:52.622520 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-d06df750-fc24-4505-a69f-b634b2659b73 req-3b67e727-d46a-413a-9ae3-2670d0285bd7 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:52.641183 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-d06df750-fc24-4505-a69f-b634b2659b73 req-3b67e727-d46a-413a-9ae3-2670d0285bd7 service nova] Creating event network-vif-deleted:2080aa25-53d4-46f2-a694-162ef2ea0ac4 for instance 6ef152e6-ba27-46bd-871a-04d8539b493e on n-h1-852278-4 Aug 27 02:52:52.658181 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-d06df750-fc24-4505-a69f-b634b2659b73 req-3b67e727-d46a-413a-9ae3-2670d0285bd7 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068800 Aug 27 02:52:52.663043 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1312/2607] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:52:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:52:52.669081 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a9eafcc5-8f0d-4d4e-9039-d5b329726c02 tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:52.671240 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a9eafcc5-8f0d-4d4e-9039-d5b329726c02 tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] [instance: b4b1bc77-1487-47d4-ae3b-14e693c1c4c5] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:52.678590 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a9eafcc5-8f0d-4d4e-9039-d5b329726c02 tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:52.679673 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a9eafcc5-8f0d-4d4e-9039-d5b329726c02 tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:52.680415 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a9eafcc5-8f0d-4d4e-9039-d5b329726c02 tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:52.681539 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a9eafcc5-8f0d-4d4e-9039-d5b329726c02 tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:52.682184 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a9eafcc5-8f0d-4d4e-9039-d5b329726c02 tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:52.682875 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a9eafcc5-8f0d-4d4e-9039-d5b329726c02 tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:52.688952 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=100 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:52:53.042386 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-fbc8494f-8f56-4bd4-85d6-71a8f3c93614 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:53.051795 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-fbc8494f-8f56-4bd4-85d6-71a8f3c93614 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4" status: 200 len: 1314 microversion: 2.1 time: 0.517071 Aug 27 02:52:53.052516 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1296/2608] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:52 2022] GET /compute/v2.1/servers/97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4 => generated 1314 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:53.082433 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-a9eafcc5-8f0d-4d4e-9039-d5b329726c02 tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745fd53ea2694f919ff28af2c17e60a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079fe2e8a6184fba858e3d8e60730fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:53.092395 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a9eafcc5-8f0d-4d4e-9039-d5b329726c02 tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] 10.222.0.70 "GET /compute/v2.1/servers/b4b1bc77-1487-47d4-ae3b-14e693c1c4c5" status: 200 len: 1505 microversion: 2.1 time: 0.427856 Aug 27 02:52:53.105187 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1313/2609] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:52 2022] GET /compute/v2.1/servers/b4b1bc77-1487-47d4-ae3b-14e693c1c4c5 => generated 1505 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:53.112651 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-be152088-7bd7-4fc1-8360-1b94d133fe12 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:53.113621 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-be152088-7bd7-4fc1-8360-1b94d133fe12 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:53.121494 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-be152088-7bd7-4fc1-8360-1b94d133fe12 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:53.122193 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-be152088-7bd7-4fc1-8360-1b94d133fe12 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:53.122773 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-be152088-7bd7-4fc1-8360-1b94d133fe12 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:53.123738 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-be152088-7bd7-4fc1-8360-1b94d133fe12 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:53.124536 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-be152088-7bd7-4fc1-8360-1b94d133fe12 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:53.126669 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-be152088-7bd7-4fc1-8360-1b94d133fe12 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:53.255479 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-56e0c26f-773e-464a-8322-902a16e3f659 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:53.257553 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-56e0c26f-773e-464a-8322-902a16e3f659 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: ba987aee-2707-4d47-aba9-d2803aa70745] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:53.265825 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-56e0c26f-773e-464a-8322-902a16e3f659 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:53.266341 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-56e0c26f-773e-464a-8322-902a16e3f659 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:53.266889 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-56e0c26f-773e-464a-8322-902a16e3f659 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:53.267778 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-56e0c26f-773e-464a-8322-902a16e3f659 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:53.268206 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-56e0c26f-773e-464a-8322-902a16e3f659 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:53.268817 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-56e0c26f-773e-464a-8322-902a16e3f659 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:53.463788 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-be152088-7bd7-4fc1-8360-1b94d133fe12 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:53.475891 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-be152088-7bd7-4fc1-8360-1b94d133fe12 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1686 microversion: 2.1 time: 0.369546 Aug 27 02:52:53.480067 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1314/2610] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:53 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1686 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:53.560744 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5192cc65-68c0-43a3-8152-0e829845809c tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:53.561473 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-5192cc65-68c0-43a3-8152-0e829845809c tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] [instance: 7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:53.570536 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5192cc65-68c0-43a3-8152-0e829845809c tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:53.571471 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5192cc65-68c0-43a3-8152-0e829845809c tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:53.572256 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5192cc65-68c0-43a3-8152-0e829845809c tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:53.573249 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5192cc65-68c0-43a3-8152-0e829845809c tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:53.573909 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5192cc65-68c0-43a3-8152-0e829845809c tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:53.574557 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5192cc65-68c0-43a3-8152-0e829845809c tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:54.127804 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-5192cc65-68c0-43a3-8152-0e829845809c tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317e74b4bbc4da298a0dcbd78068352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a8810c21784788b4c0ee64dedbaf15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:54.139694 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-5192cc65-68c0-43a3-8152-0e829845809c tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] 10.222.0.70 "GET /compute/v2.1/servers/7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8" status: 200 len: 1269 microversion: 2.1 time: 0.583656 Aug 27 02:52:54.152738 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1315/2611] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:53 2022] GET /compute/v2.1/servers/7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8 => generated 1269 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:52:54.171610 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-56e0c26f-773e-464a-8322-902a16e3f659 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:54.180083 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-56e0c26f-773e-464a-8322-902a16e3f659 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/ba987aee-2707-4d47-aba9-d2803aa70745" status: 200 len: 1470 microversion: 2.1 time: 1.126084 Aug 27 02:52:54.180802 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1297/2612] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:53 2022] GET /compute/v2.1/servers/ba987aee-2707-4d47-aba9-d2803aa70745 => generated 1470 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:54.181187 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5baf28f3-6cd4-4a0f-aff6-45af11ef17fa tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:54.182203 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-5baf28f3-6cd4-4a0f-aff6-45af11ef17fa tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] [instance: 546a5816-c2d9-494b-8c23-b0983cd11eb9] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:54.194505 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5baf28f3-6cd4-4a0f-aff6-45af11ef17fa tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:54.195010 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5baf28f3-6cd4-4a0f-aff6-45af11ef17fa tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:54.195437 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5baf28f3-6cd4-4a0f-aff6-45af11ef17fa tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:54.199015 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f67b30dc-141a-4068-9846-b4e7ba9f585e tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:54.201286 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-f67b30dc-141a-4068-9846-b4e7ba9f585e tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: 97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:54.201419 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5baf28f3-6cd4-4a0f-aff6-45af11ef17fa tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:54.201814 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5baf28f3-6cd4-4a0f-aff6-45af11ef17fa tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:54.202257 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5baf28f3-6cd4-4a0f-aff6-45af11ef17fa tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:54.218172 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f67b30dc-141a-4068-9846-b4e7ba9f585e tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:54.219284 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f67b30dc-141a-4068-9846-b4e7ba9f585e tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:54.227679 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f67b30dc-141a-4068-9846-b4e7ba9f585e tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:54.228672 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f67b30dc-141a-4068-9846-b4e7ba9f585e tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:54.229321 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f67b30dc-141a-4068-9846-b4e7ba9f585e tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:54.229932 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f67b30dc-141a-4068-9846-b4e7ba9f585e tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:54.722830 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-5baf28f3-6cd4-4a0f-aff6-45af11ef17fa tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f496f24dccea47bd9a5ab532fe45e370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40794f05e8b94a0f8f087a87a58e0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:54.730734 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-5baf28f3-6cd4-4a0f-aff6-45af11ef17fa tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "GET /compute/v2.1/servers/546a5816-c2d9-494b-8c23-b0983cd11eb9" status: 200 len: 1307 microversion: 2.1 time: 0.576579 Aug 27 02:52:54.742233 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-f67b30dc-141a-4068-9846-b4e7ba9f585e tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:54.750329 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-f67b30dc-141a-4068-9846-b4e7ba9f585e tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4" status: 200 len: 1314 microversion: 2.1 time: 0.564339 Aug 27 02:52:54.750940 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1298/2613] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:54 2022] GET /compute/v2.1/servers/97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4 => generated 1314 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:54.752466 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1316/2614] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:54 2022] GET /compute/v2.1/servers/546a5816-c2d9-494b-8c23-b0983cd11eb9 => generated 1307 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:54.757422 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-bf1b080a-f9c8-430e-8255-66aee986077f tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:52:54.757961 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-bf1b080a-f9c8-430e-8255-66aee986077f tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: ba987aee-2707-4d47-aba9-d2803aa70745] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:54.767164 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-024062f5-c3c4-4d6c-94e3-95870cf51d79 tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:54.767788 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-024062f5-c3c4-4d6c-94e3-95870cf51d79 tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] [instance: b4b1bc77-1487-47d4-ae3b-14e693c1c4c5] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:54.788235 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bf1b080a-f9c8-430e-8255-66aee986077f tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:54.788762 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bf1b080a-f9c8-430e-8255-66aee986077f tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:54.792540 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-024062f5-c3c4-4d6c-94e3-95870cf51d79 tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:54.793066 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-024062f5-c3c4-4d6c-94e3-95870cf51d79 tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:54.793516 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-024062f5-c3c4-4d6c-94e3-95870cf51d79 tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:54.794255 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-024062f5-c3c4-4d6c-94e3-95870cf51d79 tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:54.794714 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-024062f5-c3c4-4d6c-94e3-95870cf51d79 tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:54.795159 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-024062f5-c3c4-4d6c-94e3-95870cf51d79 tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:54.800156 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bf1b080a-f9c8-430e-8255-66aee986077f tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:54.802626 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bf1b080a-f9c8-430e-8255-66aee986077f tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:54.804908 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bf1b080a-f9c8-430e-8255-66aee986077f tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:54.805531 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bf1b080a-f9c8-430e-8255-66aee986077f tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:54.902285 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:52:55.064909 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-bf1b080a-f9c8-430e-8255-66aee986077f tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "POST /compute/v2.1/servers/ba987aee-2707-4d47-aba9-d2803aa70745/action" status: 202 len: 0 microversion: 2.1 time: 0.311017 Aug 27 02:52:55.072896 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1317/2615] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 02:52:54 2022] POST /compute/v2.1/servers/ba987aee-2707-4d47-aba9-d2803aa70745/action => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:52:55.081549 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0758df96-6f93-49c4-aed3-bf505a0b1ad5 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:55.099697 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-0758df96-6f93-49c4-aed3-bf505a0b1ad5 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:55.115111 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0758df96-6f93-49c4-aed3-bf505a0b1ad5 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:55.115662 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0758df96-6f93-49c4-aed3-bf505a0b1ad5 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:55.116197 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0758df96-6f93-49c4-aed3-bf505a0b1ad5 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:55.117265 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0758df96-6f93-49c4-aed3-bf505a0b1ad5 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:55.117767 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0758df96-6f93-49c4-aed3-bf505a0b1ad5 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:55.119035 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0758df96-6f93-49c4-aed3-bf505a0b1ad5 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:55.562135 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-024062f5-c3c4-4d6c-94e3-95870cf51d79 tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745fd53ea2694f919ff28af2c17e60a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079fe2e8a6184fba858e3d8e60730fe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:55.574672 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-024062f5-c3c4-4d6c-94e3-95870cf51d79 tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] 10.222.0.70 "GET /compute/v2.1/servers/b4b1bc77-1487-47d4-ae3b-14e693c1c4c5" status: 200 len: 1505 microversion: 2.1 time: 0.822652 Aug 27 02:52:55.587999 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1299/2616] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:54 2022] GET /compute/v2.1/servers/b4b1bc77-1487-47d4-ae3b-14e693c1c4c5 => generated 1505 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:55.589098 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-dd318d69-3bb1-459d-8ee6-d0e658394c91 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:55.589800 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-dd318d69-3bb1-459d-8ee6-d0e658394c91 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: ba987aee-2707-4d47-aba9-d2803aa70745] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:55.608055 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dd318d69-3bb1-459d-8ee6-d0e658394c91 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:55.608572 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dd318d69-3bb1-459d-8ee6-d0e658394c91 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:55.609004 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dd318d69-3bb1-459d-8ee6-d0e658394c91 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:55.609740 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dd318d69-3bb1-459d-8ee6-d0e658394c91 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:55.610362 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dd318d69-3bb1-459d-8ee6-d0e658394c91 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:55.610933 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dd318d69-3bb1-459d-8ee6-d0e658394c91 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:56.006889 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0758df96-6f93-49c4-aed3-bf505a0b1ad5 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:56.026185 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-0758df96-6f93-49c4-aed3-bf505a0b1ad5 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1681 microversion: 2.1 time: 0.948496 Aug 27 02:52:56.030530 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1318/2617] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:55 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1681 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:56.054352 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c213dda0-c834-46eb-9d8e-b6150860c0fe tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:56.056297 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-c213dda0-c834-46eb-9d8e-b6150860c0fe tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] [instance: 7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:56.079721 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c213dda0-c834-46eb-9d8e-b6150860c0fe tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:56.080223 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c213dda0-c834-46eb-9d8e-b6150860c0fe tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:56.080689 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c213dda0-c834-46eb-9d8e-b6150860c0fe tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:56.081415 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c213dda0-c834-46eb-9d8e-b6150860c0fe tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:56.085067 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c213dda0-c834-46eb-9d8e-b6150860c0fe tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:56.085848 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c213dda0-c834-46eb-9d8e-b6150860c0fe tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:56.172622 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-dd318d69-3bb1-459d-8ee6-d0e658394c91 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:56.186356 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-dd318d69-3bb1-459d-8ee6-d0e658394c91 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/ba987aee-2707-4d47-aba9-d2803aa70745" status: 200 len: 1469 microversion: 2.1 time: 0.609470 Aug 27 02:52:56.197453 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1300/2618] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:55 2022] GET /compute/v2.1/servers/ba987aee-2707-4d47-aba9-d2803aa70745 => generated 1469 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:56.204351 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-6920cf90-7aee-446f-a507-34094b8055df req-f6ab452e-922a-40b3-a9de-44e2591c6752 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "546a5816-c2d9-494b-8c23-b0983cd11eb9", "name": "network-vif-plugged", "status": "completed", "tag": "2efb5816-4d86-45f2-a90e-53904afe8489"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:52:56.232450 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-6920cf90-7aee-446f-a507-34094b8055df req-f6ab452e-922a-40b3-a9de-44e2591c6752 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:56.233515 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-6920cf90-7aee-446f-a507-34094b8055df req-f6ab452e-922a-40b3-a9de-44e2591c6752 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:56.234171 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-6920cf90-7aee-446f-a507-34094b8055df req-f6ab452e-922a-40b3-a9de-44e2591c6752 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:56.248395 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-6920cf90-7aee-446f-a507-34094b8055df req-f6ab452e-922a-40b3-a9de-44e2591c6752 service nova] Creating event network-vif-plugged:2efb5816-4d86-45f2-a90e-53904afe8489 for instance 546a5816-c2d9-494b-8c23-b0983cd11eb9 on n-h2-852278-4 Aug 27 02:52:56.257761 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-6920cf90-7aee-446f-a507-34094b8055df req-f6ab452e-922a-40b3-a9de-44e2591c6752 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058656 Aug 27 02:52:56.260104 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1301/2619] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:52:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:52:56.266346 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3a657f5e-38e3-49b6-8067-73ed32ee936a tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:56.267400 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-3a657f5e-38e3-49b6-8067-73ed32ee936a tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] [instance: 546a5816-c2d9-494b-8c23-b0983cd11eb9] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:56.276758 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3a657f5e-38e3-49b6-8067-73ed32ee936a tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:56.277705 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3a657f5e-38e3-49b6-8067-73ed32ee936a tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:56.278373 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3a657f5e-38e3-49b6-8067-73ed32ee936a tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:56.279330 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3a657f5e-38e3-49b6-8067-73ed32ee936a tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:56.280246 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3a657f5e-38e3-49b6-8067-73ed32ee936a tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:56.281391 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3a657f5e-38e3-49b6-8067-73ed32ee936a tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:56.468753 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-c213dda0-c834-46eb-9d8e-b6150860c0fe tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317e74b4bbc4da298a0dcbd78068352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a8810c21784788b4c0ee64dedbaf15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:56.489164 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c213dda0-c834-46eb-9d8e-b6150860c0fe tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] 10.222.0.70 "GET /compute/v2.1/servers/7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8" status: 200 len: 1275 microversion: 2.1 time: 0.455965 Aug 27 02:52:56.496120 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1319/2620] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:56 2022] GET /compute/v2.1/servers/7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8 => generated 1275 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:56.510429 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-795b85f4-897d-4438-9de3-9a02fcea30cc tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:56.511051 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-795b85f4-897d-4438-9de3-9a02fcea30cc tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: 97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:56.524025 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-795b85f4-897d-4438-9de3-9a02fcea30cc tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:56.524595 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-795b85f4-897d-4438-9de3-9a02fcea30cc tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:56.524986 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-795b85f4-897d-4438-9de3-9a02fcea30cc tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:56.525700 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-795b85f4-897d-4438-9de3-9a02fcea30cc tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:56.526145 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-795b85f4-897d-4438-9de3-9a02fcea30cc tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:56.526563 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-795b85f4-897d-4438-9de3-9a02fcea30cc tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:56.821071 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-3a657f5e-38e3-49b6-8067-73ed32ee936a tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f496f24dccea47bd9a5ab532fe45e370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40794f05e8b94a0f8f087a87a58e0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:56.834111 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-3a657f5e-38e3-49b6-8067-73ed32ee936a tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "GET /compute/v2.1/servers/546a5816-c2d9-494b-8c23-b0983cd11eb9" status: 200 len: 1307 microversion: 2.1 time: 0.572245 Aug 27 02:52:56.836924 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1302/2621] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:56 2022] GET /compute/v2.1/servers/546a5816-c2d9-494b-8c23-b0983cd11eb9 => generated 1307 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:56.857311 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-7b138628-8859-4428-a808-5b29b6039a27 req-447430dd-1998-4fa1-b3d3-711999b317d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4b1bc77-1487-47d4-ae3b-14e693c1c4c5", "name": "network-vif-deleted", "tag": "f2b43a68-d758-4ea0-96e7-6f29bafdfb2b"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:52:56.881962 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-7b138628-8859-4428-a808-5b29b6039a27 req-447430dd-1998-4fa1-b3d3-711999b317d7 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:56.882439 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-7b138628-8859-4428-a808-5b29b6039a27 req-447430dd-1998-4fa1-b3d3-711999b317d7 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:56.882864 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-7b138628-8859-4428-a808-5b29b6039a27 req-447430dd-1998-4fa1-b3d3-711999b317d7 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:56.902628 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-7b138628-8859-4428-a808-5b29b6039a27 req-447430dd-1998-4fa1-b3d3-711999b317d7 service nova] Creating event network-vif-deleted:f2b43a68-d758-4ea0-96e7-6f29bafdfb2b for instance b4b1bc77-1487-47d4-ae3b-14e693c1c4c5 on n-h2-852278-4 Aug 27 02:52:56.925413 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-7b138628-8859-4428-a808-5b29b6039a27 req-447430dd-1998-4fa1-b3d3-711999b317d7 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084891 Aug 27 02:52:56.926433 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1303/2622] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:52:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:52:56.931952 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-185e4885-e647-48c7-a2fc-16eb4322f2ca tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:56.932683 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-185e4885-e647-48c7-a2fc-16eb4322f2ca tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] [instance: b4b1bc77-1487-47d4-ae3b-14e693c1c4c5] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:56.949135 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:52:56.955618 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-185e4885-e647-48c7-a2fc-16eb4322f2ca tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:56.956262 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-185e4885-e647-48c7-a2fc-16eb4322f2ca tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:56.956909 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-185e4885-e647-48c7-a2fc-16eb4322f2ca tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:56.957762 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-185e4885-e647-48c7-a2fc-16eb4322f2ca tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:56.958952 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-185e4885-e647-48c7-a2fc-16eb4322f2ca tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:56.960607 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-185e4885-e647-48c7-a2fc-16eb4322f2ca tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:57.016178 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-185e4885-e647-48c7-a2fc-16eb4322f2ca tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] HTTP exception thrown: Instance b4b1bc77-1487-47d4-ae3b-14e693c1c4c5 could not be found. Aug 27 02:52:57.024640 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-185e4885-e647-48c7-a2fc-16eb4322f2ca tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Request method failure captured: Aug 27 02:52:57.024640 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/b4b1bc77-1487-47d4-ae3b-14e693c1c4c5 HTTP/1.1 Aug 27 02:52:57.024640 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:52:57.024640 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:52:57.024640 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:52:57.024640 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:52:57.024640 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:52:57.024640 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:52:57.024640 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:52:57.024640 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:52:57.024640 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYbo8eTYIimSiENeJOD_ek17ZDfNm6MB6JgyiT9K9nCiBuqdgoNaenqRsWB1b9I_8jY_7Zctna85cAXNjZZpyabVFFnaZAVwJlsaBlJNMcDhhtL99yQqGYSbw9KbSPdJaGVbtLeG7tfih52d0k1OBgRKzkDca-LEbHZZrx1yrRuNZto Aug 27 02:52:57.024640 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:52:57.024640 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:52:57.024640 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:52:57.024640 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:52:57.024640 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:52:57.024640 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:52:57.024640 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 079fe2e8a6184fba858e3d8e60730fe2 Aug 27 02:52:57.024640 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-VolumesActionsTest-868170916 Aug 27 02:52:57.024640 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:52:57.024640 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:52:57.024640 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/079fe2e8a6184fba858e3d8e60730fe2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_079fe2e8a6184fba858e3d8e60730fe2", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/079fe2e8a6184fba858e3d8e60730fe2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/079fe2e8a6184fba858e3d8e60730fe2"}]}] Aug 27 02:52:57.024640 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-VolumesActionsTest-868170916 Aug 27 02:52:57.024640 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 079fe2e8a6184fba858e3d8e60730fe2 Aug 27 02:52:57.024640 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-VolumesActionsTest-868170916 Aug 27 02:52:57.024640 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-VolumesActionsTest-868170916-project Aug 27 02:52:57.024640 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:52:57.024640 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:52:57.024640 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 745fd53ea2694f919ff28af2c17e60a8 Aug 27 02:52:57.024640 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-VolumesActionsTest-868170916-project Aug 27 02:52:57.024640 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 02:52:57.024640 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance b4b1bc77-1487-47d4-ae3b-14e693c1c4c5 could not be found. Aug 27 02:52:57.024640 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': 'b4b1bc77-1487-47d4-ae3b-14e693c1c4c5'} Aug 27 02:52:57.024640 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:52:57.024640 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:52:57.024640 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:52:57.024640 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:52:57.024640 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:52:57.024640 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:52:57.024640 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:52:57.024640 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:52:57.024640 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:52:57.024640 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:52:57.024640 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4b1bc77-1487-47d4-ae3b-14e693c1c4c5 could not be found. Aug 27 02:52:57.024640 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:52:57.024640 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:52:57.024640 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:52:57.024640 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:52:57.024640 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:52:57.024640 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:52:57.024640 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:52:57.024640 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:52:57.024640 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:52:57.024640 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:52:57.024640 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:52:57.024640 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:52:57.024640 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:52:57.024640 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:52:57.024640 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:52:57.024640 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:52:57.024640 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4b1bc77-1487-47d4-ae3b-14e693c1c4c5 could not be found. Aug 27 02:52:57.024640 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:52:57.024640 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:52:57.024640 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:52:57.029033 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:52:57.029033 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:52:57.029033 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:52:57.029033 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:52:57.029033 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:52:57.029033 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4b1bc77-1487-47d4-ae3b-14e693c1c4c5 could not be found. Aug 27 02:52:57.029033 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:52:57.038802 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-185e4885-e647-48c7-a2fc-16eb4322f2ca tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] Returning 404 to user: Instance b4b1bc77-1487-47d4-ae3b-14e693c1c4c5 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:52:57.042241 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-185e4885-e647-48c7-a2fc-16eb4322f2ca tempest-VolumesActionsTest-868170916 tempest-VolumesActionsTest-868170916-project] 10.222.0.70 "GET /compute/v2.1/servers/b4b1bc77-1487-47d4-ae3b-14e693c1c4c5" status: 404 len: 111 microversion: 2.1 time: 0.114637 Aug 27 02:52:57.046123 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1304/2623] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:56 2022] GET /compute/v2.1/servers/b4b1bc77-1487-47d4-ae3b-14e693c1c4c5 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:52:57.072733 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-560fc0a1-3005-4694-b490-8a19f588c923 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:57.078583 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-560fc0a1-3005-4694-b490-8a19f588c923 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:57.102516 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-560fc0a1-3005-4694-b490-8a19f588c923 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:57.103039 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-560fc0a1-3005-4694-b490-8a19f588c923 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:57.109460 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-560fc0a1-3005-4694-b490-8a19f588c923 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:57.111388 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-560fc0a1-3005-4694-b490-8a19f588c923 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:57.123080 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-560fc0a1-3005-4694-b490-8a19f588c923 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:57.124555 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-560fc0a1-3005-4694-b490-8a19f588c923 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:57.635446 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-795b85f4-897d-4438-9de3-9a02fcea30cc tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:57.666215 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-795b85f4-897d-4438-9de3-9a02fcea30cc tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4" status: 200 len: 1314 microversion: 2.1 time: 1.168663 Aug 27 02:52:57.666831 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1320/2624] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:56 2022] GET /compute/v2.1/servers/97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4 => generated 1314 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:57.698959 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ae953e33-81ce-42b6-846d-472f30ada5c9 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:57.699724 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-ae953e33-81ce-42b6-846d-472f30ada5c9 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: ba987aee-2707-4d47-aba9-d2803aa70745] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:57.719705 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ae953e33-81ce-42b6-846d-472f30ada5c9 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:57.720226 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ae953e33-81ce-42b6-846d-472f30ada5c9 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:57.721182 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ae953e33-81ce-42b6-846d-472f30ada5c9 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:57.722119 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ae953e33-81ce-42b6-846d-472f30ada5c9 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:57.727458 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ae953e33-81ce-42b6-846d-472f30ada5c9 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:57.727914 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ae953e33-81ce-42b6-846d-472f30ada5c9 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:57.893059 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-560fc0a1-3005-4694-b490-8a19f588c923 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:57.911083 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-560fc0a1-3005-4694-b490-8a19f588c923 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1681 microversion: 2.1 time: 0.859085 Aug 27 02:52:57.911923 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1305/2625] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:57 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1681 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:57.950553 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b6732d13-05aa-44d9-84ac-0ebcd22db19d tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:57.958747 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b6732d13-05aa-44d9-84ac-0ebcd22db19d tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] [instance: 7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:57.975490 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b6732d13-05aa-44d9-84ac-0ebcd22db19d tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:57.979256 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b6732d13-05aa-44d9-84ac-0ebcd22db19d tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:57.980462 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b6732d13-05aa-44d9-84ac-0ebcd22db19d tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:57.991745 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b6732d13-05aa-44d9-84ac-0ebcd22db19d tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:57.994334 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b6732d13-05aa-44d9-84ac-0ebcd22db19d tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:57.995171 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b6732d13-05aa-44d9-84ac-0ebcd22db19d tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:59.851474 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-b6732d13-05aa-44d9-84ac-0ebcd22db19d tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317e74b4bbc4da298a0dcbd78068352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a8810c21784788b4c0ee64dedbaf15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:59.869274 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b6732d13-05aa-44d9-84ac-0ebcd22db19d tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] 10.222.0.70 "GET /compute/v2.1/servers/7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8" status: 200 len: 1317 microversion: 2.1 time: 1.929987 Aug 27 02:52:59.870152 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1306/2626] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:57 2022] GET /compute/v2.1/servers/7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8 => generated 1317 bytes in 1932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:59.883636 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-70240690-fe11-4b7d-a533-ed22928a15b6 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:59.884747 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-70240690-fe11-4b7d-a533-ed22928a15b6 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] [instance: 546a5816-c2d9-494b-8c23-b0983cd11eb9] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:59.892540 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-70240690-fe11-4b7d-a533-ed22928a15b6 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:59.893404 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-70240690-fe11-4b7d-a533-ed22928a15b6 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:59.894031 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-70240690-fe11-4b7d-a533-ed22928a15b6 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:59.895352 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-70240690-fe11-4b7d-a533-ed22928a15b6 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:59.896589 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-70240690-fe11-4b7d-a533-ed22928a15b6 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:59.898017 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-70240690-fe11-4b7d-a533-ed22928a15b6 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:00.343908 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-ae953e33-81ce-42b6-846d-472f30ada5c9 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:00.353565 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ae953e33-81ce-42b6-846d-472f30ada5c9 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/ba987aee-2707-4d47-aba9-d2803aa70745" status: 200 len: 1469 microversion: 2.1 time: 2.685670 Aug 27 02:53:00.374025 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1321/2627] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:57 2022] GET /compute/v2.1/servers/ba987aee-2707-4d47-aba9-d2803aa70745 => generated 1469 bytes in 2706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:00.387133 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-7b9938db-305d-4069-92cf-31b222af1dbc tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:00.387942 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-7b9938db-305d-4069-92cf-31b222af1dbc tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: 97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:00.397687 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7b9938db-305d-4069-92cf-31b222af1dbc tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:00.405246 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7b9938db-305d-4069-92cf-31b222af1dbc tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:00.405973 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7b9938db-305d-4069-92cf-31b222af1dbc tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:00.406922 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7b9938db-305d-4069-92cf-31b222af1dbc tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:00.407537 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7b9938db-305d-4069-92cf-31b222af1dbc tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:00.408115 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7b9938db-305d-4069-92cf-31b222af1dbc tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:00.493551 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-70240690-fe11-4b7d-a533-ed22928a15b6 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f496f24dccea47bd9a5ab532fe45e370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40794f05e8b94a0f8f087a87a58e0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:00.502720 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-70240690-fe11-4b7d-a533-ed22928a15b6 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "GET /compute/v2.1/servers/546a5816-c2d9-494b-8c23-b0983cd11eb9" status: 200 len: 1487 microversion: 2.1 time: 0.629932 Aug 27 02:53:00.508058 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1307/2628] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:59 2022] GET /compute/v2.1/servers/546a5816-c2d9-494b-8c23-b0983cd11eb9 => generated 1487 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:00.520998 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-f9ecc9f0-8e34-48f7-b415-29d7567701fc req-56be22ad-b61c-4d4e-a0e6-f6811601370a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb0d71f2-158d-4acc-8774-6874e7da29cd", "name": "network-vif-plugged", "status": "completed", "tag": "fe5d48cf-956a-4e15-9a8e-fdd605d313b1"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:53:00.542332 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-f9ecc9f0-8e34-48f7-b415-29d7567701fc req-56be22ad-b61c-4d4e-a0e6-f6811601370a service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:00.542814 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-f9ecc9f0-8e34-48f7-b415-29d7567701fc req-56be22ad-b61c-4d4e-a0e6-f6811601370a service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:00.543245 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-f9ecc9f0-8e34-48f7-b415-29d7567701fc req-56be22ad-b61c-4d4e-a0e6-f6811601370a service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:00.571507 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-f9ecc9f0-8e34-48f7-b415-29d7567701fc req-56be22ad-b61c-4d4e-a0e6-f6811601370a service nova] Creating event network-vif-plugged:fe5d48cf-956a-4e15-9a8e-fdd605d313b1 for instance bb0d71f2-158d-4acc-8774-6874e7da29cd on n-h1-852278-4 Aug 27 02:53:00.580837 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-f9ecc9f0-8e34-48f7-b415-29d7567701fc req-56be22ad-b61c-4d4e-a0e6-f6811601370a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070953 Aug 27 02:53:00.582084 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1308/2629] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:53:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:53:00.587840 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-1aadd7dd-7284-4edc-8104-3aacc8c5ba66 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:00.600179 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-1aadd7dd-7284-4edc-8104-3aacc8c5ba66 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:00.609595 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1aadd7dd-7284-4edc-8104-3aacc8c5ba66 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:00.610298 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1aadd7dd-7284-4edc-8104-3aacc8c5ba66 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:00.615267 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1aadd7dd-7284-4edc-8104-3aacc8c5ba66 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:00.616805 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1aadd7dd-7284-4edc-8104-3aacc8c5ba66 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:00.617437 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1aadd7dd-7284-4edc-8104-3aacc8c5ba66 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:00.618745 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1aadd7dd-7284-4edc-8104-3aacc8c5ba66 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:00.940215 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-1aadd7dd-7284-4edc-8104-3aacc8c5ba66 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:00.955999 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-1aadd7dd-7284-4edc-8104-3aacc8c5ba66 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1681 microversion: 2.1 time: 0.368796 Aug 27 02:53:00.960636 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1309/2630] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:00 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1681 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:00.972331 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7b8a6c83-ee77-4cb0-a445-66a1053157ab tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:53:00.985736 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7b8a6c83-ee77-4cb0-a445-66a1053157ab tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:00.994875 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7b8a6c83-ee77-4cb0-a445-66a1053157ab tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:00.995561 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7b8a6c83-ee77-4cb0-a445-66a1053157ab tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:01.158354 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-7b9938db-305d-4069-92cf-31b222af1dbc tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:01.169617 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-7b9938db-305d-4069-92cf-31b222af1dbc tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4" status: 200 len: 1314 microversion: 2.1 time: 0.794107 Aug 27 02:53:01.181067 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1322/2631] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:00 2022] GET /compute/v2.1/servers/97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4 => generated 1314 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:01.194644 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c21e45d1-82aa-4319-a11b-c615e6c44534 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:01.197106 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-c21e45d1-82aa-4319-a11b-c615e6c44534 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] [instance: 7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:01.206036 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-7b8a6c83-ee77-4cb0-a445-66a1053157ab tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] [instance: 546a5816-c2d9-494b-8c23-b0983cd11eb9] Going to try to stop instance {{(pid=134051) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 27 02:53:01.238350 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c21e45d1-82aa-4319-a11b-c615e6c44534 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:01.238845 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c21e45d1-82aa-4319-a11b-c615e6c44534 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:01.239280 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c21e45d1-82aa-4319-a11b-c615e6c44534 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:01.240021 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c21e45d1-82aa-4319-a11b-c615e6c44534 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:01.240525 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c21e45d1-82aa-4319-a11b-c615e6c44534 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:01.240941 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c21e45d1-82aa-4319-a11b-c615e6c44534 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:01.294735 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-7b8a6c83-ee77-4cb0-a445-66a1053157ab tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "POST /compute/v2.1/servers/546a5816-c2d9-494b-8c23-b0983cd11eb9/action" status: 202 len: 0 microversion: 2.1 time: 0.332052 Aug 27 02:53:01.296803 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1310/2632] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 02:53:00 2022] POST /compute/v2.1/servers/546a5816-c2d9-494b-8c23-b0983cd11eb9/action => generated 0 bytes in 335 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:53:01.315894 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-5d29c552-de03-4485-a0c0-536ac877a6a4 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:01.316735 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-5d29c552-de03-4485-a0c0-536ac877a6a4 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] [instance: 546a5816-c2d9-494b-8c23-b0983cd11eb9] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:01.328507 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5d29c552-de03-4485-a0c0-536ac877a6a4 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:01.329114 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5d29c552-de03-4485-a0c0-536ac877a6a4 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:01.329724 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5d29c552-de03-4485-a0c0-536ac877a6a4 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:01.330633 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5d29c552-de03-4485-a0c0-536ac877a6a4 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:01.331240 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5d29c552-de03-4485-a0c0-536ac877a6a4 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:01.342269 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5d29c552-de03-4485-a0c0-536ac877a6a4 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:01.538932 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-c21e45d1-82aa-4319-a11b-c615e6c44534 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317e74b4bbc4da298a0dcbd78068352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a8810c21784788b4c0ee64dedbaf15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:01.552611 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c21e45d1-82aa-4319-a11b-c615e6c44534 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] 10.222.0.70 "GET /compute/v2.1/servers/7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8" status: 200 len: 1317 microversion: 2.1 time: 0.370007 Aug 27 02:53:01.555807 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1323/2633] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:01 2022] GET /compute/v2.1/servers/7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8 => generated 1317 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:01.568954 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-64f20049-ab89-4b7f-a95c-eeda6327874b tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:01.569761 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-64f20049-ab89-4b7f-a95c-eeda6327874b tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: ba987aee-2707-4d47-aba9-d2803aa70745] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:01.587252 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-64f20049-ab89-4b7f-a95c-eeda6327874b tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:01.588044 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-64f20049-ab89-4b7f-a95c-eeda6327874b tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:01.588717 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-64f20049-ab89-4b7f-a95c-eeda6327874b tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:01.589620 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-64f20049-ab89-4b7f-a95c-eeda6327874b tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:01.590244 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-64f20049-ab89-4b7f-a95c-eeda6327874b tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:01.593255 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-64f20049-ab89-4b7f-a95c-eeda6327874b tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:01.644774 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:53:01.667419 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-5d29c552-de03-4485-a0c0-536ac877a6a4 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f496f24dccea47bd9a5ab532fe45e370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40794f05e8b94a0f8f087a87a58e0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:01.678234 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-5d29c552-de03-4485-a0c0-536ac877a6a4 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "GET /compute/v2.1/servers/546a5816-c2d9-494b-8c23-b0983cd11eb9" status: 200 len: 1497 microversion: 2.1 time: 0.366570 Aug 27 02:53:01.679375 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1311/2634] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:01 2022] GET /compute/v2.1/servers/546a5816-c2d9-494b-8c23-b0983cd11eb9 => generated 1497 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:01.685900 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=6 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:53:01.980685 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-81cbab17-8721-487e-b0a1-7fb2af341895 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:01.981309 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-81cbab17-8721-487e-b0a1-7fb2af341895 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:01.997174 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-81cbab17-8721-487e-b0a1-7fb2af341895 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:01.998678 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-81cbab17-8721-487e-b0a1-7fb2af341895 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:01.999132 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-81cbab17-8721-487e-b0a1-7fb2af341895 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:01.999906 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-81cbab17-8721-487e-b0a1-7fb2af341895 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:02.006393 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-81cbab17-8721-487e-b0a1-7fb2af341895 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:02.006846 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-81cbab17-8721-487e-b0a1-7fb2af341895 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:02.065520 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-64f20049-ab89-4b7f-a95c-eeda6327874b tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:02.077253 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-64f20049-ab89-4b7f-a95c-eeda6327874b tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/ba987aee-2707-4d47-aba9-d2803aa70745" status: 200 len: 1469 microversion: 2.1 time: 0.518864 Aug 27 02:53:02.093588 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1324/2635] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:01 2022] GET /compute/v2.1/servers/ba987aee-2707-4d47-aba9-d2803aa70745 => generated 1469 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:02.198182 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-198399df-69ce-407a-bd14-dec5e410f57f tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:02.201475 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-198399df-69ce-407a-bd14-dec5e410f57f tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: 97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:02.212653 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-198399df-69ce-407a-bd14-dec5e410f57f tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:02.217679 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-198399df-69ce-407a-bd14-dec5e410f57f tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:02.218226 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-198399df-69ce-407a-bd14-dec5e410f57f tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:02.219068 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-198399df-69ce-407a-bd14-dec5e410f57f tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:02.222453 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-198399df-69ce-407a-bd14-dec5e410f57f tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:02.222900 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-198399df-69ce-407a-bd14-dec5e410f57f tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:02.339484 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-81cbab17-8721-487e-b0a1-7fb2af341895 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:02.352077 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-81cbab17-8721-487e-b0a1-7fb2af341895 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1681 microversion: 2.1 time: 0.372782 Aug 27 02:53:02.352793 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1312/2636] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:01 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1681 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:02.498157 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-198399df-69ce-407a-bd14-dec5e410f57f tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:02.539166 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-198399df-69ce-407a-bd14-dec5e410f57f tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4" status: 200 len: 1314 microversion: 2.1 time: 0.341473 Aug 27 02:53:02.541063 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1325/2637] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:02 2022] GET /compute/v2.1/servers/97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4 => generated 1314 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:53:02.578428 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-bd091cab-f841-4134-98bc-b50ad8a9267f tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:02.579195 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-bd091cab-f841-4134-98bc-b50ad8a9267f tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] [instance: 7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:02.582427 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:53:02.595311 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bd091cab-f841-4134-98bc-b50ad8a9267f tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:02.597830 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bd091cab-f841-4134-98bc-b50ad8a9267f tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:02.600458 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bd091cab-f841-4134-98bc-b50ad8a9267f tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:02.601663 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bd091cab-f841-4134-98bc-b50ad8a9267f tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:02.604795 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bd091cab-f841-4134-98bc-b50ad8a9267f tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:02.606278 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bd091cab-f841-4134-98bc-b50ad8a9267f tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:02.637459 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-15d6c56f-5414-4142-baed-274ea5334d4d req-d13152a4-beb9-4a58-ba70-959aacac9f9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4", "name": "network-vif-plugged", "status": "completed", "tag": "b6ccabb4-3a86-495e-9764-020c27981067"}, {"server_uuid": "ba987aee-2707-4d47-aba9-d2803aa70745", "name": "network-vif-plugged", "status": "completed", "tag": "0871e4ff-ef2c-4a64-a799-ecfb74bf8dfa"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:53:02.671210 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-15d6c56f-5414-4142-baed-274ea5334d4d req-d13152a4-beb9-4a58-ba70-959aacac9f9f service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:02.674398 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-15d6c56f-5414-4142-baed-274ea5334d4d req-d13152a4-beb9-4a58-ba70-959aacac9f9f service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:02.675465 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-15d6c56f-5414-4142-baed-274ea5334d4d req-d13152a4-beb9-4a58-ba70-959aacac9f9f service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:02.729650 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-15d6c56f-5414-4142-baed-274ea5334d4d req-d13152a4-beb9-4a58-ba70-959aacac9f9f service nova] Creating event network-vif-plugged:b6ccabb4-3a86-495e-9764-020c27981067 for instance 97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4 on n-h2-852278-4 Aug 27 02:53:02.730472 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-15d6c56f-5414-4142-baed-274ea5334d4d req-d13152a4-beb9-4a58-ba70-959aacac9f9f service nova] Creating event network-vif-plugged:0871e4ff-ef2c-4a64-a799-ecfb74bf8dfa for instance ba987aee-2707-4d47-aba9-d2803aa70745 on n-h2-852278-4 Aug 27 02:53:02.750445 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [req-15d6c56f-5414-4142-baed-274ea5334d4d req-d13152a4-beb9-4a58-ba70-959aacac9f9f service nova] Instance ba987aee-2707-4d47-aba9-d2803aa70745 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-852278-4', 'n-h1-852278-4'} {{(pid=134052) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 02:53:02.795235 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-15d6c56f-5414-4142-baed-274ea5334d4d req-d13152a4-beb9-4a58-ba70-959aacac9f9f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.160189 Aug 27 02:53:02.798855 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1326/2638] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:53:02 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:53:02.814104 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8ae0355d-f444-493c-a034-d13b58d9d6fe tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:02.814735 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-bd091cab-f841-4134-98bc-b50ad8a9267f tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317e74b4bbc4da298a0dcbd78068352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a8810c21784788b4c0ee64dedbaf15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:02.815806 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-8ae0355d-f444-493c-a034-d13b58d9d6fe tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] [instance: 546a5816-c2d9-494b-8c23-b0983cd11eb9] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:02.817112 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:53:02.825092 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-bd091cab-f841-4134-98bc-b50ad8a9267f tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] 10.222.0.70 "GET /compute/v2.1/servers/7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8" status: 200 len: 1317 microversion: 2.1 time: 0.252214 Aug 27 02:53:02.840244 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1313/2639] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:02 2022] GET /compute/v2.1/servers/7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8 => generated 1317 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:02.847249 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8ae0355d-f444-493c-a034-d13b58d9d6fe tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:02.847938 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8ae0355d-f444-493c-a034-d13b58d9d6fe tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:02.848588 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8ae0355d-f444-493c-a034-d13b58d9d6fe tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:02.849487 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8ae0355d-f444-493c-a034-d13b58d9d6fe tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:02.850123 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8ae0355d-f444-493c-a034-d13b58d9d6fe tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:02.851075 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8ae0355d-f444-493c-a034-d13b58d9d6fe tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:03.099499 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e08a48dd-a7c6-48f5-8d65-200b9545996a tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:03.100108 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-e08a48dd-a7c6-48f5-8d65-200b9545996a tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: ba987aee-2707-4d47-aba9-d2803aa70745] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:03.112458 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e08a48dd-a7c6-48f5-8d65-200b9545996a tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:03.112985 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e08a48dd-a7c6-48f5-8d65-200b9545996a tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:03.113422 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e08a48dd-a7c6-48f5-8d65-200b9545996a tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:03.114141 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e08a48dd-a7c6-48f5-8d65-200b9545996a tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:03.114587 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e08a48dd-a7c6-48f5-8d65-200b9545996a tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:03.115005 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e08a48dd-a7c6-48f5-8d65-200b9545996a tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:03.133933 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-8ae0355d-f444-493c-a034-d13b58d9d6fe tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f496f24dccea47bd9a5ab532fe45e370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40794f05e8b94a0f8f087a87a58e0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:03.150179 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-8ae0355d-f444-493c-a034-d13b58d9d6fe tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "GET /compute/v2.1/servers/546a5816-c2d9-494b-8c23-b0983cd11eb9" status: 200 len: 1497 microversion: 2.1 time: 0.349792 Aug 27 02:53:03.153716 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1327/2640] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:02 2022] GET /compute/v2.1/servers/546a5816-c2d9-494b-8c23-b0983cd11eb9 => generated 1497 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:03.331788 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e08a48dd-a7c6-48f5-8d65-200b9545996a tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:03.340016 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e08a48dd-a7c6-48f5-8d65-200b9545996a tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/ba987aee-2707-4d47-aba9-d2803aa70745" status: 200 len: 1469 microversion: 2.1 time: 0.245215 Aug 27 02:53:03.341861 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1314/2641] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:03 2022] GET /compute/v2.1/servers/ba987aee-2707-4d47-aba9-d2803aa70745 => generated 1469 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:53:03.373488 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4d38c8f4-1a83-43a1-aab3-b8a16b2cf5ea tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:03.374431 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-4d38c8f4-1a83-43a1-aab3-b8a16b2cf5ea tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:03.391126 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4d38c8f4-1a83-43a1-aab3-b8a16b2cf5ea tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:03.391916 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4d38c8f4-1a83-43a1-aab3-b8a16b2cf5ea tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:03.392573 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4d38c8f4-1a83-43a1-aab3-b8a16b2cf5ea tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:03.393538 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4d38c8f4-1a83-43a1-aab3-b8a16b2cf5ea tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:03.394146 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4d38c8f4-1a83-43a1-aab3-b8a16b2cf5ea tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:03.394770 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4d38c8f4-1a83-43a1-aab3-b8a16b2cf5ea tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:03.417128 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:53:03.563861 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-69c4fb38-e4a3-405e-b7f8-d6ad7654a58e tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:03.565113 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-69c4fb38-e4a3-405e-b7f8-d6ad7654a58e tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: 97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:03.586244 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-69c4fb38-e4a3-405e-b7f8-d6ad7654a58e tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:03.592278 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-69c4fb38-e4a3-405e-b7f8-d6ad7654a58e tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:03.593089 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-69c4fb38-e4a3-405e-b7f8-d6ad7654a58e tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:03.598543 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-69c4fb38-e4a3-405e-b7f8-d6ad7654a58e tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:03.599390 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-69c4fb38-e4a3-405e-b7f8-d6ad7654a58e tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:03.601494 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-69c4fb38-e4a3-405e-b7f8-d6ad7654a58e tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:03.698597 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-4d38c8f4-1a83-43a1-aab3-b8a16b2cf5ea tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:03.709578 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-4d38c8f4-1a83-43a1-aab3-b8a16b2cf5ea tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1681 microversion: 2.1 time: 0.339898 Aug 27 02:53:03.710190 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1328/2642] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:03 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1681 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:03.757402 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-ff79fab1-8b86-48f8-8b0f-c5e154eb9649 req-6d8f15ad-973d-483d-acde-1aec04155d51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8", "tag": "dee4c86c-595f-441d-ba5f-4bf6d022ab1a"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:53:03.778637 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-ff79fab1-8b86-48f8-8b0f-c5e154eb9649 req-6d8f15ad-973d-483d-acde-1aec04155d51 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:03.788460 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-ff79fab1-8b86-48f8-8b0f-c5e154eb9649 req-6d8f15ad-973d-483d-acde-1aec04155d51 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:03.790996 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-ff79fab1-8b86-48f8-8b0f-c5e154eb9649 req-6d8f15ad-973d-483d-acde-1aec04155d51 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:03.828555 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-ff79fab1-8b86-48f8-8b0f-c5e154eb9649 req-6d8f15ad-973d-483d-acde-1aec04155d51 service nova] Creating event network-changed:dee4c86c-595f-441d-ba5f-4bf6d022ab1a for instance 7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8 on n-h1-852278-4 Aug 27 02:53:03.846786 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-ff79fab1-8b86-48f8-8b0f-c5e154eb9649 req-6d8f15ad-973d-483d-acde-1aec04155d51 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093620 Aug 27 02:53:03.850093 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1329/2643] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:53:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:53:03.865497 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c407b406-cb6c-41f3-a823-f2f9ad2b1c6a tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:03.866492 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-c407b406-cb6c-41f3-a823-f2f9ad2b1c6a tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] [instance: 7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:03.881433 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c407b406-cb6c-41f3-a823-f2f9ad2b1c6a tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:03.883397 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c407b406-cb6c-41f3-a823-f2f9ad2b1c6a tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:03.884038 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c407b406-cb6c-41f3-a823-f2f9ad2b1c6a tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:03.886203 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c407b406-cb6c-41f3-a823-f2f9ad2b1c6a tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:03.888126 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c407b406-cb6c-41f3-a823-f2f9ad2b1c6a tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:03.888763 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c407b406-cb6c-41f3-a823-f2f9ad2b1c6a tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:03.981038 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-69c4fb38-e4a3-405e-b7f8-d6ad7654a58e tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:03.998362 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-69c4fb38-e4a3-405e-b7f8-d6ad7654a58e tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4" status: 200 len: 1314 microversion: 2.1 time: 0.438670 Aug 27 02:53:03.998962 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1315/2644] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:03 2022] GET /compute/v2.1/servers/97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4 => generated 1314 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:04.174869 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-084df3c9-eb5f-4b36-ac73-158d4837e8fa tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:04.175521 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-084df3c9-eb5f-4b36-ac73-158d4837e8fa tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] [instance: 546a5816-c2d9-494b-8c23-b0983cd11eb9] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:04.190312 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-084df3c9-eb5f-4b36-ac73-158d4837e8fa tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:04.197243 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-084df3c9-eb5f-4b36-ac73-158d4837e8fa tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:04.197916 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-084df3c9-eb5f-4b36-ac73-158d4837e8fa tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:04.199176 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-084df3c9-eb5f-4b36-ac73-158d4837e8fa tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:04.199799 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-084df3c9-eb5f-4b36-ac73-158d4837e8fa tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:04.200415 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-084df3c9-eb5f-4b36-ac73-158d4837e8fa tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:04.242175 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-c407b406-cb6c-41f3-a823-f2f9ad2b1c6a tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317e74b4bbc4da298a0dcbd78068352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a8810c21784788b4c0ee64dedbaf15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:04.264659 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c407b406-cb6c-41f3-a823-f2f9ad2b1c6a tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] 10.222.0.70 "GET /compute/v2.1/servers/7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8" status: 200 len: 1317 microversion: 2.1 time: 0.405457 Aug 27 02:53:04.265363 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1330/2645] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:03 2022] GET /compute/v2.1/servers/7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8 => generated 1317 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:04.366355 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-15033433-7931-4e70-9c80-6f0708f1142a tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:04.369631 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-15033433-7931-4e70-9c80-6f0708f1142a tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: ba987aee-2707-4d47-aba9-d2803aa70745] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:04.390959 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-15033433-7931-4e70-9c80-6f0708f1142a tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:04.393709 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-15033433-7931-4e70-9c80-6f0708f1142a tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:04.395051 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-15033433-7931-4e70-9c80-6f0708f1142a tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:04.397660 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-15033433-7931-4e70-9c80-6f0708f1142a tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:04.401444 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-15033433-7931-4e70-9c80-6f0708f1142a tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:04.404784 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-15033433-7931-4e70-9c80-6f0708f1142a tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:04.582982 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-084df3c9-eb5f-4b36-ac73-158d4837e8fa tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f496f24dccea47bd9a5ab532fe45e370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40794f05e8b94a0f8f087a87a58e0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:04.596199 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-084df3c9-eb5f-4b36-ac73-158d4837e8fa tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "GET /compute/v2.1/servers/546a5816-c2d9-494b-8c23-b0983cd11eb9" status: 200 len: 1497 microversion: 2.1 time: 0.425135 Aug 27 02:53:04.602045 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1316/2646] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:04 2022] GET /compute/v2.1/servers/546a5816-c2d9-494b-8c23-b0983cd11eb9 => generated 1497 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:53:04.675188 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-15033433-7931-4e70-9c80-6f0708f1142a tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:04.691045 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-15033433-7931-4e70-9c80-6f0708f1142a tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/ba987aee-2707-4d47-aba9-d2803aa70745" status: 200 len: 1469 microversion: 2.1 time: 0.330934 Aug 27 02:53:04.705693 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1331/2647] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:04 2022] GET /compute/v2.1/servers/ba987aee-2707-4d47-aba9-d2803aa70745 => generated 1469 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:04.732805 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-29d136a4-e92c-4275-8975-437cb74c8de9 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:04.733817 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-29d136a4-e92c-4275-8975-437cb74c8de9 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:04.750309 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-29d136a4-e92c-4275-8975-437cb74c8de9 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:04.752952 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-29d136a4-e92c-4275-8975-437cb74c8de9 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:04.753397 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-29d136a4-e92c-4275-8975-437cb74c8de9 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:04.754126 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-29d136a4-e92c-4275-8975-437cb74c8de9 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:04.754576 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-29d136a4-e92c-4275-8975-437cb74c8de9 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:04.757322 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-29d136a4-e92c-4275-8975-437cb74c8de9 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:05.020819 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3c57a005-8e62-4163-a1a2-f8f784a2b6e3 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:05.022083 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-3c57a005-8e62-4163-a1a2-f8f784a2b6e3 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: 97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:05.039350 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3c57a005-8e62-4163-a1a2-f8f784a2b6e3 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:05.046122 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3c57a005-8e62-4163-a1a2-f8f784a2b6e3 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:05.047471 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3c57a005-8e62-4163-a1a2-f8f784a2b6e3 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:05.049438 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3c57a005-8e62-4163-a1a2-f8f784a2b6e3 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:05.052623 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3c57a005-8e62-4163-a1a2-f8f784a2b6e3 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:05.054047 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3c57a005-8e62-4163-a1a2-f8f784a2b6e3 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:05.068667 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-29d136a4-e92c-4275-8975-437cb74c8de9 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:05.078669 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-29d136a4-e92c-4275-8975-437cb74c8de9 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1681 microversion: 2.1 time: 0.351209 Aug 27 02:53:05.080453 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1317/2648] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:04 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1681 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:05.081930 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-29d136a4-e92c-4275-8975-437cb74c8de9 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:05.083125 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-29d136a4-e92c-4275-8975-437cb74c8de9 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001478 Aug 27 02:53:05.083935 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1318/2649] 10.222.0.70 () {56 vars in 886 bytes} [Sat Aug 27 02:53:05 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 27 02:53:05.290311 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ddac0448-23f4-445d-82d6-c90644c16778 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:05.291570 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-ddac0448-23f4-445d-82d6-c90644c16778 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] [instance: 7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:05.307279 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ddac0448-23f4-445d-82d6-c90644c16778 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:05.309404 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ddac0448-23f4-445d-82d6-c90644c16778 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:05.309870 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ddac0448-23f4-445d-82d6-c90644c16778 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:05.310609 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ddac0448-23f4-445d-82d6-c90644c16778 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:05.320897 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ddac0448-23f4-445d-82d6-c90644c16778 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:05.323901 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ddac0448-23f4-445d-82d6-c90644c16778 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:05.551516 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-3c57a005-8e62-4163-a1a2-f8f784a2b6e3 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:05.565352 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-3c57a005-8e62-4163-a1a2-f8f784a2b6e3 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4" status: 200 len: 1500 microversion: 2.1 time: 0.546391 Aug 27 02:53:05.568726 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1332/2650] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:05 2022] GET /compute/v2.1/servers/97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4 => generated 1500 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:05.594126 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-563c18fe-e46d-4ac4-8391-bfe243de650b tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:53:05.595020 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-563c18fe-e46d-4ac4-8391-bfe243de650b tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: 97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:05.609192 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-563c18fe-e46d-4ac4-8391-bfe243de650b tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:05.610313 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-563c18fe-e46d-4ac4-8391-bfe243de650b tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:05.610963 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-563c18fe-e46d-4ac4-8391-bfe243de650b tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:05.612660 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-563c18fe-e46d-4ac4-8391-bfe243de650b tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:05.613461 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-563c18fe-e46d-4ac4-8391-bfe243de650b tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:05.614120 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-563c18fe-e46d-4ac4-8391-bfe243de650b tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:05.670005 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.instance [None req-563c18fe-e46d-4ac4-8391-bfe243de650b tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lazy-loading 'flavor' on Instance uuid 97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4 {{(pid=134052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:53:05.761431 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-ddac0448-23f4-445d-82d6-c90644c16778 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317e74b4bbc4da298a0dcbd78068352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a8810c21784788b4c0ee64dedbaf15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:05.776302 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ddac0448-23f4-445d-82d6-c90644c16778 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] 10.222.0.70 "GET /compute/v2.1/servers/7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8" status: 200 len: 1317 microversion: 2.1 time: 0.489183 Aug 27 02:53:05.778796 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1319/2651] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:05 2022] GET /compute/v2.1/servers/7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8 => generated 1317 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:53:05.796697 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-69f26446-5ea1-46b2-be87-1f5b03f19656 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:05.798607 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-69f26446-5ea1-46b2-be87-1f5b03f19656 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] [instance: 546a5816-c2d9-494b-8c23-b0983cd11eb9] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:05.811586 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-69f26446-5ea1-46b2-be87-1f5b03f19656 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:05.814669 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-69f26446-5ea1-46b2-be87-1f5b03f19656 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:05.815201 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-69f26446-5ea1-46b2-be87-1f5b03f19656 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:05.815810 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-69f26446-5ea1-46b2-be87-1f5b03f19656 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:05.816260 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-69f26446-5ea1-46b2-be87-1f5b03f19656 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:05.818601 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-69f26446-5ea1-46b2-be87-1f5b03f19656 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:06.131738 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-69f26446-5ea1-46b2-be87-1f5b03f19656 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f496f24dccea47bd9a5ab532fe45e370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40794f05e8b94a0f8f087a87a58e0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:06.150267 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-69f26446-5ea1-46b2-be87-1f5b03f19656 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "GET /compute/v2.1/servers/546a5816-c2d9-494b-8c23-b0983cd11eb9" status: 200 len: 1497 microversion: 2.1 time: 0.365461 Aug 27 02:53:06.151578 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1320/2652] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:05 2022] GET /compute/v2.1/servers/546a5816-c2d9-494b-8c23-b0983cd11eb9 => generated 1497 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:06.170810 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b84c95d7-7821-4de2-96b2-70e5bf718689 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:06.174474 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b84c95d7-7821-4de2-96b2-70e5bf718689 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: ba987aee-2707-4d47-aba9-d2803aa70745] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:06.184879 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-563c18fe-e46d-4ac4-8391-bfe243de650b tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "POST /compute/v2.1/servers/97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4/action" status: 202 len: 0 microversion: 2.1 time: 0.594933 Aug 27 02:53:06.190286 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1333/2653] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 02:53:05 2022] POST /compute/v2.1/servers/97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4/action => generated 0 bytes in 601 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 02:53:06.199690 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-57dce4db-4461-402a-ac48-01d06d3be34b req-7e11d323-97e1-45cb-8346-79c36054c5fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba987aee-2707-4d47-aba9-d2803aa70745", "name": "network-vif-unplugged", "status": "completed", "tag": "0871e4ff-ef2c-4a64-a799-ecfb74bf8dfa"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:53:06.203214 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b84c95d7-7821-4de2-96b2-70e5bf718689 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:06.204974 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b84c95d7-7821-4de2-96b2-70e5bf718689 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:06.208804 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b84c95d7-7821-4de2-96b2-70e5bf718689 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:06.209788 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b84c95d7-7821-4de2-96b2-70e5bf718689 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:06.212730 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b84c95d7-7821-4de2-96b2-70e5bf718689 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:06.217673 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b84c95d7-7821-4de2-96b2-70e5bf718689 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:06.243018 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-57dce4db-4461-402a-ac48-01d06d3be34b req-7e11d323-97e1-45cb-8346-79c36054c5fc service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:06.248103 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-57dce4db-4461-402a-ac48-01d06d3be34b req-7e11d323-97e1-45cb-8346-79c36054c5fc service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:06.249099 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-57dce4db-4461-402a-ac48-01d06d3be34b req-7e11d323-97e1-45cb-8346-79c36054c5fc service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:06.280550 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-57dce4db-4461-402a-ac48-01d06d3be34b req-7e11d323-97e1-45cb-8346-79c36054c5fc service nova] Creating event network-vif-unplugged:0871e4ff-ef2c-4a64-a799-ecfb74bf8dfa for instance ba987aee-2707-4d47-aba9-d2803aa70745 on n-h1-852278-4 Aug 27 02:53:06.297857 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [req-57dce4db-4461-402a-ac48-01d06d3be34b req-7e11d323-97e1-45cb-8346-79c36054c5fc service nova] Instance ba987aee-2707-4d47-aba9-d2803aa70745 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-852278-4', 'n-h1-852278-4'} {{(pid=134052) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 02:53:06.327450 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-57dce4db-4461-402a-ac48-01d06d3be34b req-7e11d323-97e1-45cb-8346-79c36054c5fc service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.135303 Aug 27 02:53:06.331726 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1334/2654] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:53:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:53:06.345130 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e68e95de-cc36-41a1-bedb-836853076b0e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:06.346033 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-e68e95de-cc36-41a1-bedb-836853076b0e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:06.358503 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e68e95de-cc36-41a1-bedb-836853076b0e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:06.362955 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e68e95de-cc36-41a1-bedb-836853076b0e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:06.363636 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e68e95de-cc36-41a1-bedb-836853076b0e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:06.365757 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e68e95de-cc36-41a1-bedb-836853076b0e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:06.367499 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e68e95de-cc36-41a1-bedb-836853076b0e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:06.369250 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e68e95de-cc36-41a1-bedb-836853076b0e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:06.464721 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-b84c95d7-7821-4de2-96b2-70e5bf718689 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:06.474652 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b84c95d7-7821-4de2-96b2-70e5bf718689 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/ba987aee-2707-4d47-aba9-d2803aa70745" status: 200 len: 1469 microversion: 2.1 time: 0.317984 Aug 27 02:53:06.475861 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1321/2655] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:06 2022] GET /compute/v2.1/servers/ba987aee-2707-4d47-aba9-d2803aa70745 => generated 1469 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:06.501388 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-9a7b5d22-017d-4f81-a4b4-9a25fbad526b tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:06.504509 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-9a7b5d22-017d-4f81-a4b4-9a25fbad526b tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: 97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:06.517923 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9a7b5d22-017d-4f81-a4b4-9a25fbad526b tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:06.518682 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9a7b5d22-017d-4f81-a4b4-9a25fbad526b tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:06.519315 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9a7b5d22-017d-4f81-a4b4-9a25fbad526b tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:06.520371 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9a7b5d22-017d-4f81-a4b4-9a25fbad526b tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:06.524228 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9a7b5d22-017d-4f81-a4b4-9a25fbad526b tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:06.524883 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9a7b5d22-017d-4f81-a4b4-9a25fbad526b tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:06.707740 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-e68e95de-cc36-41a1-bedb-836853076b0e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:06.718669 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e68e95de-cc36-41a1-bedb-836853076b0e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1681 microversion: 2.1 time: 0.385258 Aug 27 02:53:06.737064 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1335/2656] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:06 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1681 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:06.802995 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a476f579-519f-4cf5-91a6-d2b7f2735dca tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:06.804303 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a476f579-519f-4cf5-91a6-d2b7f2735dca tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] [instance: 7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:06.819282 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a476f579-519f-4cf5-91a6-d2b7f2735dca tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:06.820408 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a476f579-519f-4cf5-91a6-d2b7f2735dca tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:06.820861 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a476f579-519f-4cf5-91a6-d2b7f2735dca tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:06.823705 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a476f579-519f-4cf5-91a6-d2b7f2735dca tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:06.824262 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a476f579-519f-4cf5-91a6-d2b7f2735dca tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:06.825786 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a476f579-519f-4cf5-91a6-d2b7f2735dca tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:06.841772 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-9a7b5d22-017d-4f81-a4b4-9a25fbad526b tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:06.852881 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-9a7b5d22-017d-4f81-a4b4-9a25fbad526b tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4" status: 200 len: 1506 microversion: 2.1 time: 0.373350 Aug 27 02:53:06.854781 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1322/2657] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:06 2022] GET /compute/v2.1/servers/97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4 => generated 1506 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:07.097721 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-a476f579-519f-4cf5-91a6-d2b7f2735dca tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317e74b4bbc4da298a0dcbd78068352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a8810c21784788b4c0ee64dedbaf15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:07.118106 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a476f579-519f-4cf5-91a6-d2b7f2735dca tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] 10.222.0.70 "GET /compute/v2.1/servers/7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8" status: 200 len: 1317 microversion: 2.1 time: 0.314481 Aug 27 02:53:07.118918 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1336/2658] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:06 2022] GET /compute/v2.1/servers/7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8 => generated 1317 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:53:07.176759 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-19e5d094-ea6d-40d5-94a3-742b74df8af9 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:07.177673 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-19e5d094-ea6d-40d5-94a3-742b74df8af9 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] [instance: 546a5816-c2d9-494b-8c23-b0983cd11eb9] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:07.190601 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-19e5d094-ea6d-40d5-94a3-742b74df8af9 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:07.192096 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-19e5d094-ea6d-40d5-94a3-742b74df8af9 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:07.192761 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-19e5d094-ea6d-40d5-94a3-742b74df8af9 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:07.193635 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-19e5d094-ea6d-40d5-94a3-742b74df8af9 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:07.194811 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-19e5d094-ea6d-40d5-94a3-742b74df8af9 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:07.195681 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-19e5d094-ea6d-40d5-94a3-742b74df8af9 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:07.408155 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-19e5d094-ea6d-40d5-94a3-742b74df8af9 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f496f24dccea47bd9a5ab532fe45e370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40794f05e8b94a0f8f087a87a58e0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:07.418620 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-19e5d094-ea6d-40d5-94a3-742b74df8af9 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "GET /compute/v2.1/servers/546a5816-c2d9-494b-8c23-b0983cd11eb9" status: 200 len: 1497 microversion: 2.1 time: 0.248594 Aug 27 02:53:07.420339 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1323/2659] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:07 2022] GET /compute/v2.1/servers/546a5816-c2d9-494b-8c23-b0983cd11eb9 => generated 1497 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:07.497994 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-afcfb539-2c33-4a1e-9abc-cb68127acd85 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:07.501813 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-afcfb539-2c33-4a1e-9abc-cb68127acd85 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: ba987aee-2707-4d47-aba9-d2803aa70745] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:07.528675 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-afcfb539-2c33-4a1e-9abc-cb68127acd85 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:07.529588 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-afcfb539-2c33-4a1e-9abc-cb68127acd85 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:07.530684 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-afcfb539-2c33-4a1e-9abc-cb68127acd85 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:07.531945 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-afcfb539-2c33-4a1e-9abc-cb68127acd85 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:07.533347 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-afcfb539-2c33-4a1e-9abc-cb68127acd85 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:07.534013 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-afcfb539-2c33-4a1e-9abc-cb68127acd85 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:07.739461 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-afcfb539-2c33-4a1e-9abc-cb68127acd85 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:07.749661 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-251e5d29-9a48-46d7-a222-99daab47ffbb tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:07.750142 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-afcfb539-2c33-4a1e-9abc-cb68127acd85 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/ba987aee-2707-4d47-aba9-d2803aa70745" status: 200 len: 1469 microversion: 2.1 time: 0.258837 Aug 27 02:53:07.750379 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-251e5d29-9a48-46d7-a222-99daab47ffbb tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:07.756706 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1337/2660] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:07 2022] GET /compute/v2.1/servers/ba987aee-2707-4d47-aba9-d2803aa70745 => generated 1469 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:07.764102 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-251e5d29-9a48-46d7-a222-99daab47ffbb tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:07.764808 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-251e5d29-9a48-46d7-a222-99daab47ffbb tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:07.765163 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-251e5d29-9a48-46d7-a222-99daab47ffbb tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:07.765945 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-251e5d29-9a48-46d7-a222-99daab47ffbb tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:07.766390 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-251e5d29-9a48-46d7-a222-99daab47ffbb tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:07.767949 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-251e5d29-9a48-46d7-a222-99daab47ffbb tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:07.877664 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a33c1b84-263a-4795-96a4-cd8bdd31cba0 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:07.878329 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a33c1b84-263a-4795-96a4-cd8bdd31cba0 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: 97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:07.941373 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a33c1b84-263a-4795-96a4-cd8bdd31cba0 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:07.941898 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a33c1b84-263a-4795-96a4-cd8bdd31cba0 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:07.949348 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a33c1b84-263a-4795-96a4-cd8bdd31cba0 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:07.957250 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a33c1b84-263a-4795-96a4-cd8bdd31cba0 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:07.961320 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a33c1b84-263a-4795-96a4-cd8bdd31cba0 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:07.961976 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a33c1b84-263a-4795-96a4-cd8bdd31cba0 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:08.097347 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-251e5d29-9a48-46d7-a222-99daab47ffbb tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:08.107286 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-251e5d29-9a48-46d7-a222-99daab47ffbb tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1681 microversion: 2.1 time: 0.361928 Aug 27 02:53:08.120486 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1324/2661] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:07 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1681 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:53:08.139226 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-79a69334-5f67-4c1b-839b-7b3979eec0a6 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:08.139843 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-79a69334-5f67-4c1b-839b-7b3979eec0a6 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] [instance: 7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:08.161164 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-79a69334-5f67-4c1b-839b-7b3979eec0a6 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:08.161894 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-79a69334-5f67-4c1b-839b-7b3979eec0a6 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:08.169073 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-79a69334-5f67-4c1b-839b-7b3979eec0a6 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:08.170041 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-79a69334-5f67-4c1b-839b-7b3979eec0a6 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:08.170352 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-79a69334-5f67-4c1b-839b-7b3979eec0a6 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:08.173959 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-79a69334-5f67-4c1b-839b-7b3979eec0a6 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:08.516337 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-a33c1b84-263a-4795-96a4-cd8bdd31cba0 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:08.527263 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a33c1b84-263a-4795-96a4-cd8bdd31cba0 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4" status: 200 len: 1506 microversion: 2.1 time: 0.656269 Aug 27 02:53:08.527865 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1338/2662] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:07 2022] GET /compute/v2.1/servers/97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4 => generated 1506 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:08.545732 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a8088b8b-2ea6-4607-92b7-4488ba3c14d2 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:08.548432 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a8088b8b-2ea6-4607-92b7-4488ba3c14d2 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] [instance: 546a5816-c2d9-494b-8c23-b0983cd11eb9] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:08.566212 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a8088b8b-2ea6-4607-92b7-4488ba3c14d2 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:08.569056 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a8088b8b-2ea6-4607-92b7-4488ba3c14d2 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:08.569671 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a8088b8b-2ea6-4607-92b7-4488ba3c14d2 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:08.571102 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a8088b8b-2ea6-4607-92b7-4488ba3c14d2 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:08.576138 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a8088b8b-2ea6-4607-92b7-4488ba3c14d2 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:08.576968 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a8088b8b-2ea6-4607-92b7-4488ba3c14d2 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:08.617847 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-79a69334-5f67-4c1b-839b-7b3979eec0a6 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317e74b4bbc4da298a0dcbd78068352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a8810c21784788b4c0ee64dedbaf15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:08.631886 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-79a69334-5f67-4c1b-839b-7b3979eec0a6 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] 10.222.0.70 "GET /compute/v2.1/servers/7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8" status: 200 len: 1317 microversion: 2.1 time: 0.492333 Aug 27 02:53:08.644143 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1325/2663] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:08 2022] GET /compute/v2.1/servers/7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8 => generated 1317 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:53:08.645800 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-57fd8c9f-7545-435b-97d3-a091eda0e7ce req-e9ee811a-1252-4bb1-aa39-04bbe0aa42bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba987aee-2707-4d47-aba9-d2803aa70745", "tag": "0871e4ff-ef2c-4a64-a799-ecfb74bf8dfa"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:53:08.673546 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-57fd8c9f-7545-435b-97d3-a091eda0e7ce req-e9ee811a-1252-4bb1-aa39-04bbe0aa42bb service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:08.678060 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-57fd8c9f-7545-435b-97d3-a091eda0e7ce req-e9ee811a-1252-4bb1-aa39-04bbe0aa42bb service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:08.679047 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-57fd8c9f-7545-435b-97d3-a091eda0e7ce req-e9ee811a-1252-4bb1-aa39-04bbe0aa42bb service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:08.714354 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-57fd8c9f-7545-435b-97d3-a091eda0e7ce req-e9ee811a-1252-4bb1-aa39-04bbe0aa42bb service nova] Creating event network-changed:0871e4ff-ef2c-4a64-a799-ecfb74bf8dfa for instance ba987aee-2707-4d47-aba9-d2803aa70745 on n-h1-852278-4 Aug 27 02:53:08.729907 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [req-57fd8c9f-7545-435b-97d3-a091eda0e7ce req-e9ee811a-1252-4bb1-aa39-04bbe0aa42bb service nova] Instance ba987aee-2707-4d47-aba9-d2803aa70745 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-852278-4', 'n-h1-852278-4'} {{(pid=134051) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 02:53:08.762411 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-57fd8c9f-7545-435b-97d3-a091eda0e7ce req-e9ee811a-1252-4bb1-aa39-04bbe0aa42bb service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126774 Aug 27 02:53:08.765732 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1326/2664] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:53:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:53:08.781110 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d6bae0b3-19e3-4697-8481-7307e9071647 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:08.784464 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d6bae0b3-19e3-4697-8481-7307e9071647 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: ba987aee-2707-4d47-aba9-d2803aa70745] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:08.805409 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d6bae0b3-19e3-4697-8481-7307e9071647 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:08.806233 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d6bae0b3-19e3-4697-8481-7307e9071647 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:08.809123 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d6bae0b3-19e3-4697-8481-7307e9071647 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:08.810245 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d6bae0b3-19e3-4697-8481-7307e9071647 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:08.811803 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d6bae0b3-19e3-4697-8481-7307e9071647 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:08.812855 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d6bae0b3-19e3-4697-8481-7307e9071647 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:09.364288 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-a8088b8b-2ea6-4607-92b7-4488ba3c14d2 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f496f24dccea47bd9a5ab532fe45e370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40794f05e8b94a0f8f087a87a58e0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:09.377968 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a8088b8b-2ea6-4607-92b7-4488ba3c14d2 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "GET /compute/v2.1/servers/546a5816-c2d9-494b-8c23-b0983cd11eb9" status: 200 len: 1497 microversion: 2.1 time: 0.835953 Aug 27 02:53:09.383446 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1339/2665] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:08 2022] GET /compute/v2.1/servers/546a5816-c2d9-494b-8c23-b0983cd11eb9 => generated 1497 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:09.403358 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-753960ba-dcc9-4002-9373-cae98c3231db tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:09.404462 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-753960ba-dcc9-4002-9373-cae98c3231db tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:09.434750 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-753960ba-dcc9-4002-9373-cae98c3231db tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:09.435593 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-753960ba-dcc9-4002-9373-cae98c3231db tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:09.436201 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-753960ba-dcc9-4002-9373-cae98c3231db tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:09.437179 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-753960ba-dcc9-4002-9373-cae98c3231db tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:09.437803 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-753960ba-dcc9-4002-9373-cae98c3231db tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:09.438378 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-753960ba-dcc9-4002-9373-cae98c3231db tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:09.921176 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-753960ba-dcc9-4002-9373-cae98c3231db tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:09.937752 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-753960ba-dcc9-4002-9373-cae98c3231db tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1681 microversion: 2.1 time: 0.549937 Aug 27 02:53:09.942479 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1340/2666] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:09 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1681 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:09.961274 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-be748e3e-d3c3-4d7d-bace-4af5d2367e2f tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:09.964780 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-be748e3e-d3c3-4d7d-bace-4af5d2367e2f tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: 97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:09.965245 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d6bae0b3-19e3-4697-8481-7307e9071647 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:09.975187 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d6bae0b3-19e3-4697-8481-7307e9071647 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/ba987aee-2707-4d47-aba9-d2803aa70745" status: 200 len: 1469 microversion: 2.1 time: 1.206998 Aug 27 02:53:09.983611 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1327/2667] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:08 2022] GET /compute/v2.1/servers/ba987aee-2707-4d47-aba9-d2803aa70745 => generated 1469 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:09.985029 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-be748e3e-d3c3-4d7d-bace-4af5d2367e2f tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:09.985583 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-be748e3e-d3c3-4d7d-bace-4af5d2367e2f tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:09.986030 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-be748e3e-d3c3-4d7d-bace-4af5d2367e2f tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:09.986774 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-be748e3e-d3c3-4d7d-bace-4af5d2367e2f tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:09.987222 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-be748e3e-d3c3-4d7d-bace-4af5d2367e2f tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:09.987644 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-be748e3e-d3c3-4d7d-bace-4af5d2367e2f tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:09.999766 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e67dad9f-b29d-4803-a842-30ffee81f8ac tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:10.000751 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-e67dad9f-b29d-4803-a842-30ffee81f8ac tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] [instance: 7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:10.015223 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e67dad9f-b29d-4803-a842-30ffee81f8ac tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:10.017338 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e67dad9f-b29d-4803-a842-30ffee81f8ac tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:10.018049 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e67dad9f-b29d-4803-a842-30ffee81f8ac tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:10.019004 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e67dad9f-b29d-4803-a842-30ffee81f8ac tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:10.021337 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e67dad9f-b29d-4803-a842-30ffee81f8ac tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:10.023930 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e67dad9f-b29d-4803-a842-30ffee81f8ac tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:10.814555 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e67dad9f-b29d-4803-a842-30ffee81f8ac tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317e74b4bbc4da298a0dcbd78068352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a8810c21784788b4c0ee64dedbaf15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:10.830571 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e67dad9f-b29d-4803-a842-30ffee81f8ac tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] 10.222.0.70 "GET /compute/v2.1/servers/7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8" status: 200 len: 1317 microversion: 2.1 time: 0.841297 Aug 27 02:53:10.831581 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1328/2668] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:09 2022] GET /compute/v2.1/servers/7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8 => generated 1317 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:10.847892 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f325da3f-a718-4f40-831d-eaf44a03319f tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:10.848612 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-f325da3f-a718-4f40-831d-eaf44a03319f tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] [instance: 546a5816-c2d9-494b-8c23-b0983cd11eb9] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:10.860455 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f325da3f-a718-4f40-831d-eaf44a03319f tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:10.862391 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f325da3f-a718-4f40-831d-eaf44a03319f tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:10.863015 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f325da3f-a718-4f40-831d-eaf44a03319f tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:10.865317 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f325da3f-a718-4f40-831d-eaf44a03319f tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:10.865957 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f325da3f-a718-4f40-831d-eaf44a03319f tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:10.868896 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f325da3f-a718-4f40-831d-eaf44a03319f tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:11.024222 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-be748e3e-d3c3-4d7d-bace-4af5d2367e2f tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:11.041469 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-be748e3e-d3c3-4d7d-bace-4af5d2367e2f tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4" status: 200 len: 1506 microversion: 2.1 time: 1.097567 Aug 27 02:53:11.042095 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1341/2669] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:09 2022] GET /compute/v2.1/servers/97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4 => generated 1506 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:11.063467 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c012f457-84f6-4a92-8953-c98b95a4a817 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:11.067995 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-c012f457-84f6-4a92-8953-c98b95a4a817 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:11.084118 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c012f457-84f6-4a92-8953-c98b95a4a817 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:11.084633 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c012f457-84f6-4a92-8953-c98b95a4a817 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:11.085068 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c012f457-84f6-4a92-8953-c98b95a4a817 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:11.085768 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c012f457-84f6-4a92-8953-c98b95a4a817 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:11.105105 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c012f457-84f6-4a92-8953-c98b95a4a817 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:11.105558 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c012f457-84f6-4a92-8953-c98b95a4a817 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:11.634297 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-f325da3f-a718-4f40-831d-eaf44a03319f tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f496f24dccea47bd9a5ab532fe45e370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40794f05e8b94a0f8f087a87a58e0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:11.647156 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-f325da3f-a718-4f40-831d-eaf44a03319f tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "GET /compute/v2.1/servers/546a5816-c2d9-494b-8c23-b0983cd11eb9" status: 200 len: 1497 microversion: 2.1 time: 0.814384 Aug 27 02:53:11.651701 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1329/2670] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:10 2022] GET /compute/v2.1/servers/546a5816-c2d9-494b-8c23-b0983cd11eb9 => generated 1497 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:11.662747 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-c012f457-84f6-4a92-8953-c98b95a4a817 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:11.673092 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c012f457-84f6-4a92-8953-c98b95a4a817 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1681 microversion: 2.1 time: 0.629902 Aug 27 02:53:11.678125 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-2875c5ee-74e0-43c0-b081-27cc95145771 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:11.683479 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1342/2671] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:11 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1681 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:11.687006 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-2875c5ee-74e0-43c0-b081-27cc95145771 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: ba987aee-2707-4d47-aba9-d2803aa70745] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:11.718649 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2875c5ee-74e0-43c0-b081-27cc95145771 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:11.719551 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2875c5ee-74e0-43c0-b081-27cc95145771 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:11.722008 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2875c5ee-74e0-43c0-b081-27cc95145771 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:11.723014 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2875c5ee-74e0-43c0-b081-27cc95145771 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:11.723698 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2875c5ee-74e0-43c0-b081-27cc95145771 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:11.724848 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2875c5ee-74e0-43c0-b081-27cc95145771 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:11.851766 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ff5821f0-0457-4b5c-9d3f-2ba0cc69c6e6 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:11.852580 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-ff5821f0-0457-4b5c-9d3f-2ba0cc69c6e6 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] [instance: 7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:11.871340 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ff5821f0-0457-4b5c-9d3f-2ba0cc69c6e6 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:11.872643 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ff5821f0-0457-4b5c-9d3f-2ba0cc69c6e6 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:11.873408 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ff5821f0-0457-4b5c-9d3f-2ba0cc69c6e6 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:11.874696 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ff5821f0-0457-4b5c-9d3f-2ba0cc69c6e6 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:11.875523 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ff5821f0-0457-4b5c-9d3f-2ba0cc69c6e6 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:11.877146 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ff5821f0-0457-4b5c-9d3f-2ba0cc69c6e6 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:12.191350 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-2875c5ee-74e0-43c0-b081-27cc95145771 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:12.200646 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-2875c5ee-74e0-43c0-b081-27cc95145771 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/ba987aee-2707-4d47-aba9-d2803aa70745" status: 200 len: 1469 microversion: 2.1 time: 0.546903 Aug 27 02:53:12.205220 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1330/2672] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:11 2022] GET /compute/v2.1/servers/ba987aee-2707-4d47-aba9-d2803aa70745 => generated 1469 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:12.230323 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c31244f5-4d4c-43a1-a105-fb0e65bf2f8b tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:12.231109 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-c31244f5-4d4c-43a1-a105-fb0e65bf2f8b tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: 97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:12.239636 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c31244f5-4d4c-43a1-a105-fb0e65bf2f8b tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:12.241639 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c31244f5-4d4c-43a1-a105-fb0e65bf2f8b tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:12.249281 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c31244f5-4d4c-43a1-a105-fb0e65bf2f8b tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:12.252230 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c31244f5-4d4c-43a1-a105-fb0e65bf2f8b tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:12.252953 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c31244f5-4d4c-43a1-a105-fb0e65bf2f8b tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:12.254518 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c31244f5-4d4c-43a1-a105-fb0e65bf2f8b tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:12.416522 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-ff5821f0-0457-4b5c-9d3f-2ba0cc69c6e6 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317e74b4bbc4da298a0dcbd78068352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a8810c21784788b4c0ee64dedbaf15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:12.425640 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ff5821f0-0457-4b5c-9d3f-2ba0cc69c6e6 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] 10.222.0.70 "GET /compute/v2.1/servers/7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8" status: 200 len: 1317 microversion: 2.1 time: 0.577932 Aug 27 02:53:12.430599 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1343/2673] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:11 2022] GET /compute/v2.1/servers/7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8 => generated 1317 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:12.505204 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-f06d7bc5-0763-4978-bd35-f77dcb8e8644 req-515c90bd-3216-46ed-805e-d2c40ab41e97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8", "name": "network-vif-plugged", "status": "completed", "tag": "dee4c86c-595f-441d-ba5f-4bf6d022ab1a"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:53:12.533870 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-f06d7bc5-0763-4978-bd35-f77dcb8e8644 req-515c90bd-3216-46ed-805e-d2c40ab41e97 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:12.535038 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-f06d7bc5-0763-4978-bd35-f77dcb8e8644 req-515c90bd-3216-46ed-805e-d2c40ab41e97 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:12.538286 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-f06d7bc5-0763-4978-bd35-f77dcb8e8644 req-515c90bd-3216-46ed-805e-d2c40ab41e97 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:12.583815 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:53:12.595406 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-f06d7bc5-0763-4978-bd35-f77dcb8e8644 req-515c90bd-3216-46ed-805e-d2c40ab41e97 service nova] Creating event network-vif-plugged:dee4c86c-595f-441d-ba5f-4bf6d022ab1a for instance 7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8 on n-h1-852278-4 Aug 27 02:53:12.619052 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-f06d7bc5-0763-4978-bd35-f77dcb8e8644 req-515c90bd-3216-46ed-805e-d2c40ab41e97 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118270 Aug 27 02:53:12.634009 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1344/2674] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:53:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:53:12.649988 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-c31244f5-4d4c-43a1-a105-fb0e65bf2f8b tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:12.653345 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=100 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:53:12.673199 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0f9b6b92-ab84-49c4-9f7d-32a281a38e53 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:12.678753 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-0f9b6b92-ab84-49c4-9f7d-32a281a38e53 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] [instance: 546a5816-c2d9-494b-8c23-b0983cd11eb9] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:12.703902 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c31244f5-4d4c-43a1-a105-fb0e65bf2f8b tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4" status: 200 len: 1506 microversion: 2.1 time: 0.493899 Aug 27 02:53:12.706662 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1331/2675] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:12 2022] GET /compute/v2.1/servers/97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4 => generated 1506 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:12.719561 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0f9b6b92-ab84-49c4-9f7d-32a281a38e53 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:12.721051 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0f9b6b92-ab84-49c4-9f7d-32a281a38e53 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:12.721623 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0f9b6b92-ab84-49c4-9f7d-32a281a38e53 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:12.727241 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-38281419-b404-4339-9983-453ddd12af9b tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:12.728674 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0f9b6b92-ab84-49c4-9f7d-32a281a38e53 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:12.731319 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0f9b6b92-ab84-49c4-9f7d-32a281a38e53 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:12.732082 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0f9b6b92-ab84-49c4-9f7d-32a281a38e53 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:12.736660 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-38281419-b404-4339-9983-453ddd12af9b tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:12.790530 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-38281419-b404-4339-9983-453ddd12af9b tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:12.791061 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-38281419-b404-4339-9983-453ddd12af9b tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:12.791501 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-38281419-b404-4339-9983-453ddd12af9b tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:12.792224 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-38281419-b404-4339-9983-453ddd12af9b tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:12.801717 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-38281419-b404-4339-9983-453ddd12af9b tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:12.802170 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-38281419-b404-4339-9983-453ddd12af9b tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:13.342591 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0f9b6b92-ab84-49c4-9f7d-32a281a38e53 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f496f24dccea47bd9a5ab532fe45e370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40794f05e8b94a0f8f087a87a58e0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:13.351820 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-0f9b6b92-ab84-49c4-9f7d-32a281a38e53 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "GET /compute/v2.1/servers/546a5816-c2d9-494b-8c23-b0983cd11eb9" status: 200 len: 1497 microversion: 2.1 time: 0.682981 Aug 27 02:53:13.358887 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1345/2676] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:12 2022] GET /compute/v2.1/servers/546a5816-c2d9-494b-8c23-b0983cd11eb9 => generated 1497 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:13.387106 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-38281419-b404-4339-9983-453ddd12af9b tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:13.401647 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-38281419-b404-4339-9983-453ddd12af9b tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1681 microversion: 2.1 time: 0.689276 Aug 27 02:53:13.403737 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1332/2677] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:12 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1681 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:13.410849 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f9b9fdba-cacd-4a2f-80c8-bab4af7feeeb tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:13.411539 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-f9b9fdba-cacd-4a2f-80c8-bab4af7feeeb tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: ba987aee-2707-4d47-aba9-d2803aa70745] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:13.418304 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f9b9fdba-cacd-4a2f-80c8-bab4af7feeeb tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:13.419280 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f9b9fdba-cacd-4a2f-80c8-bab4af7feeeb tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:13.420021 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f9b9fdba-cacd-4a2f-80c8-bab4af7feeeb tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:13.420993 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f9b9fdba-cacd-4a2f-80c8-bab4af7feeeb tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:13.421729 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f9b9fdba-cacd-4a2f-80c8-bab4af7feeeb tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:13.422415 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f9b9fdba-cacd-4a2f-80c8-bab4af7feeeb tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:13.626294 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-f9b9fdba-cacd-4a2f-80c8-bab4af7feeeb tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:13.640952 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-f9b9fdba-cacd-4a2f-80c8-bab4af7feeeb tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/ba987aee-2707-4d47-aba9-d2803aa70745" status: 200 len: 1462 microversion: 2.1 time: 0.234411 Aug 27 02:53:13.663723 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1333/2678] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:13 2022] GET /compute/v2.1/servers/ba987aee-2707-4d47-aba9-d2803aa70745 => generated 1462 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:13.671166 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f1ef5c76-b395-4751-8c36-14b8ebac8699 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:13.672057 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-f1ef5c76-b395-4751-8c36-14b8ebac8699 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] [instance: 7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:13.682330 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f1ef5c76-b395-4751-8c36-14b8ebac8699 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:13.682828 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f1ef5c76-b395-4751-8c36-14b8ebac8699 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:13.683264 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f1ef5c76-b395-4751-8c36-14b8ebac8699 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:13.683975 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f1ef5c76-b395-4751-8c36-14b8ebac8699 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:13.684449 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f1ef5c76-b395-4751-8c36-14b8ebac8699 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:13.684866 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f1ef5c76-b395-4751-8c36-14b8ebac8699 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:13.910115 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d917b83a-0f6b-435f-8d39-e3f1262f4c57 tempest-ComputeTenantNetworksTest-3859853 tempest-ComputeTenantNetworksTest-3859853-project] Calling method '.version_select at 0x7f5ee2dee790>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:14.749133 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-f1ef5c76-b395-4751-8c36-14b8ebac8699 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317e74b4bbc4da298a0dcbd78068352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a8810c21784788b4c0ee64dedbaf15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:14.760967 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-f1ef5c76-b395-4751-8c36-14b8ebac8699 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] 10.222.0.70 "GET /compute/v2.1/servers/7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8" status: 200 len: 1317 microversion: 2.1 time: 1.095832 Aug 27 02:53:14.765459 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1334/2679] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:13 2022] GET /compute/v2.1/servers/7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8 => generated 1317 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:14.776388 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b14b6266-1407-4ba5-99cd-1816bd3b0288 tempest-MigrationsAdminTest-1330282624 tempest-MigrationsAdminTest-1330282624-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:14.777309 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b14b6266-1407-4ba5-99cd-1816bd3b0288 tempest-MigrationsAdminTest-1330282624 tempest-MigrationsAdminTest-1330282624-project-admin] [instance: ba987aee-2707-4d47-aba9-d2803aa70745] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:14.800241 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b14b6266-1407-4ba5-99cd-1816bd3b0288 tempest-MigrationsAdminTest-1330282624 tempest-MigrationsAdminTest-1330282624-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:14.800683 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b14b6266-1407-4ba5-99cd-1816bd3b0288 tempest-MigrationsAdminTest-1330282624 tempest-MigrationsAdminTest-1330282624-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:14.801120 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b14b6266-1407-4ba5-99cd-1816bd3b0288 tempest-MigrationsAdminTest-1330282624 tempest-MigrationsAdminTest-1330282624-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:14.802145 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b14b6266-1407-4ba5-99cd-1816bd3b0288 tempest-MigrationsAdminTest-1330282624 tempest-MigrationsAdminTest-1330282624-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:14.802272 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b14b6266-1407-4ba5-99cd-1816bd3b0288 tempest-MigrationsAdminTest-1330282624 tempest-MigrationsAdminTest-1330282624-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:14.802687 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b14b6266-1407-4ba5-99cd-1816bd3b0288 tempest-MigrationsAdminTest-1330282624 tempest-MigrationsAdminTest-1330282624-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:14.960678 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d917b83a-0f6b-435f-8d39-e3f1262f4c57 tempest-ComputeTenantNetworksTest-3859853 tempest-ComputeTenantNetworksTest-3859853-project] 10.222.0.70 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 308 microversion: 2.1 time: 1.600224 Aug 27 02:53:14.966600 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1346/2680] 10.222.0.70 () {58 vars in 1158 bytes} [Sat Aug 27 02:53:13 2022] GET /compute/v2.1/os-tenant-networks => generated 308 bytes in 1602 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:53:14.969261 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-95816d28-e095-43f8-9157-c104c017574c tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:14.971033 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-95816d28-e095-43f8-9157-c104c017574c tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: 97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:14.994423 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-95816d28-e095-43f8-9157-c104c017574c tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:14.994926 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-95816d28-e095-43f8-9157-c104c017574c tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:14.999700 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-95816d28-e095-43f8-9157-c104c017574c tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:15.000494 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-95816d28-e095-43f8-9157-c104c017574c tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:15.000963 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-95816d28-e095-43f8-9157-c104c017574c tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:15.001391 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-95816d28-e095-43f8-9157-c104c017574c tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:15.304587 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b14b6266-1407-4ba5-99cd-1816bd3b0288 tempest-MigrationsAdminTest-1330282624 tempest-MigrationsAdminTest-1330282624-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/ba987aee-2707-4d47-aba9-d2803aa70745" status: 200 len: 1613 microversion: 2.1 time: 0.537257 Aug 27 02:53:15.307494 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1335/2681] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:14 2022] GET /compute/v2.1/servers/ba987aee-2707-4d47-aba9-d2803aa70745 => generated 1613 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:15.323406 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-1d46e7de-58c3-4bb7-90b4-a2e1b7bfbf6b tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:15.324428 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-1d46e7de-58c3-4bb7-90b4-a2e1b7bfbf6b tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] [instance: 546a5816-c2d9-494b-8c23-b0983cd11eb9] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:15.351611 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1d46e7de-58c3-4bb7-90b4-a2e1b7bfbf6b tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:15.352148 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1d46e7de-58c3-4bb7-90b4-a2e1b7bfbf6b tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:15.355474 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1d46e7de-58c3-4bb7-90b4-a2e1b7bfbf6b tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:15.356245 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1d46e7de-58c3-4bb7-90b4-a2e1b7bfbf6b tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:15.360535 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1d46e7de-58c3-4bb7-90b4-a2e1b7bfbf6b tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:15.363385 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1d46e7de-58c3-4bb7-90b4-a2e1b7bfbf6b tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:15.375727 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-95816d28-e095-43f8-9157-c104c017574c tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:15.393606 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-95816d28-e095-43f8-9157-c104c017574c tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4" status: 200 len: 1506 microversion: 2.1 time: 0.430136 Aug 27 02:53:15.394457 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1347/2682] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:14 2022] GET /compute/v2.1/servers/97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4 => generated 1506 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:15.405282 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e50feb3f-bc2f-47a2-b359-e7e3bf779577 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:15.406311 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-e50feb3f-bc2f-47a2-b359-e7e3bf779577 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:15.422936 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e50feb3f-bc2f-47a2-b359-e7e3bf779577 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:15.425478 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e50feb3f-bc2f-47a2-b359-e7e3bf779577 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:15.426122 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e50feb3f-bc2f-47a2-b359-e7e3bf779577 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:15.427012 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e50feb3f-bc2f-47a2-b359-e7e3bf779577 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:15.429621 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e50feb3f-bc2f-47a2-b359-e7e3bf779577 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:15.430310 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e50feb3f-bc2f-47a2-b359-e7e3bf779577 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:15.766392 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-1d46e7de-58c3-4bb7-90b4-a2e1b7bfbf6b tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f496f24dccea47bd9a5ab532fe45e370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40794f05e8b94a0f8f087a87a58e0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:15.775539 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-1d46e7de-58c3-4bb7-90b4-a2e1b7bfbf6b tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "GET /compute/v2.1/servers/546a5816-c2d9-494b-8c23-b0983cd11eb9" status: 200 len: 1497 microversion: 2.1 time: 0.466719 Aug 27 02:53:15.779168 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1336/2683] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:15 2022] GET /compute/v2.1/servers/546a5816-c2d9-494b-8c23-b0983cd11eb9 => generated 1497 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:15.791958 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c7b7aeb8-61d4-4026-8c35-691c09e7d199 tempest-ComputeTenantNetworksTest-3859853 tempest-ComputeTenantNetworksTest-3859853-project] Calling method '.version_select at 0x7f5eded10040>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:15.969736 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c7b7aeb8-61d4-4026-8c35-691c09e7d199 tempest-ComputeTenantNetworksTest-3859853 tempest-ComputeTenantNetworksTest-3859853-project] 10.222.0.70 "GET /compute/v2.1/os-tenant-networks/5256e6be-2489-419e-ba60-43dd71b3d565" status: 200 len: 139 microversion: 2.1 time: 0.187459 Aug 27 02:53:15.970896 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1337/2684] 10.222.0.70 () {58 vars in 1269 bytes} [Sat Aug 27 02:53:15 2022] GET /compute/v2.1/os-tenant-networks/5256e6be-2489-419e-ba60-43dd71b3d565 => generated 139 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:53:15.976443 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-663148a7-91bf-4f6f-8145-1d90aba2f37d tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:15.977470 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-663148a7-91bf-4f6f-8145-1d90aba2f37d tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: ba987aee-2707-4d47-aba9-d2803aa70745] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:15.997593 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-663148a7-91bf-4f6f-8145-1d90aba2f37d tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:15.998669 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-663148a7-91bf-4f6f-8145-1d90aba2f37d tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:15.999400 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-663148a7-91bf-4f6f-8145-1d90aba2f37d tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:16.000935 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-663148a7-91bf-4f6f-8145-1d90aba2f37d tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:16.003070 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-663148a7-91bf-4f6f-8145-1d90aba2f37d tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:16.003528 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-663148a7-91bf-4f6f-8145-1d90aba2f37d tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:16.097053 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-663148a7-91bf-4f6f-8145-1d90aba2f37d tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: ba987aee-2707-4d47-aba9-d2803aa70745] Going to try to terminate instance {{(pid=134051) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:53:16.240408 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-e50feb3f-bc2f-47a2-b359-e7e3bf779577 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:16.265174 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e50feb3f-bc2f-47a2-b359-e7e3bf779577 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1681 microversion: 2.1 time: 0.855485 Aug 27 02:53:16.281699 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1348/2685] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:15 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1681 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:16.293509 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-663148a7-91bf-4f6f-8145-1d90aba2f37d tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "DELETE /compute/v2.1/servers/ba987aee-2707-4d47-aba9-d2803aa70745" status: 204 len: 0 microversion: 2.1 time: 0.320932 Aug 27 02:53:16.294847 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ea0d0063-2cf2-4642-8c65-898aee3be93d tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:16.296009 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1338/2686] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:53:15 2022] DELETE /compute/v2.1/servers/ba987aee-2707-4d47-aba9-d2803aa70745 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:53:16.302318 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-ea0d0063-2cf2-4642-8c65-898aee3be93d tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] [instance: 7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:16.310409 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-356ac217-fb4d-4505-8168-5c7cc8fb5258 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:16.312162 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-356ac217-fb4d-4505-8168-5c7cc8fb5258 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: ba987aee-2707-4d47-aba9-d2803aa70745] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:16.317615 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ea0d0063-2cf2-4642-8c65-898aee3be93d tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:16.319937 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ea0d0063-2cf2-4642-8c65-898aee3be93d tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:16.320631 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ea0d0063-2cf2-4642-8c65-898aee3be93d tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:16.322209 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ea0d0063-2cf2-4642-8c65-898aee3be93d tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:16.324746 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ea0d0063-2cf2-4642-8c65-898aee3be93d tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:16.328411 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ea0d0063-2cf2-4642-8c65-898aee3be93d tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:16.333552 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-356ac217-fb4d-4505-8168-5c7cc8fb5258 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:16.334215 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-356ac217-fb4d-4505-8168-5c7cc8fb5258 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:16.334611 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-356ac217-fb4d-4505-8168-5c7cc8fb5258 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:16.335256 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-356ac217-fb4d-4505-8168-5c7cc8fb5258 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:16.335714 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-356ac217-fb4d-4505-8168-5c7cc8fb5258 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:16.336131 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-356ac217-fb4d-4505-8168-5c7cc8fb5258 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:16.672598 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-ea0d0063-2cf2-4642-8c65-898aee3be93d tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317e74b4bbc4da298a0dcbd78068352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a8810c21784788b4c0ee64dedbaf15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:16.686903 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ea0d0063-2cf2-4642-8c65-898aee3be93d tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] 10.222.0.70 "GET /compute/v2.1/servers/7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8" status: 200 len: 1506 microversion: 2.1 time: 0.402818 Aug 27 02:53:16.689515 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1349/2687] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:16 2022] GET /compute/v2.1/servers/7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8 => generated 1506 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:16.700471 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ba5f117e-3fe1-43a5-99fd-08b036d30ce3 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:16.701099 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-ba5f117e-3fe1-43a5-99fd-08b036d30ce3 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: 97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:16.719429 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ba5f117e-3fe1-43a5-99fd-08b036d30ce3 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:16.729156 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ba5f117e-3fe1-43a5-99fd-08b036d30ce3 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:16.731785 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ba5f117e-3fe1-43a5-99fd-08b036d30ce3 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:16.732794 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ba5f117e-3fe1-43a5-99fd-08b036d30ce3 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:16.734880 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ba5f117e-3fe1-43a5-99fd-08b036d30ce3 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:16.735521 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ba5f117e-3fe1-43a5-99fd-08b036d30ce3 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:17.331455 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-ba5f117e-3fe1-43a5-99fd-08b036d30ce3 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:17.343966 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ba5f117e-3fe1-43a5-99fd-08b036d30ce3 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4" status: 200 len: 1506 microversion: 2.1 time: 0.653270 Aug 27 02:53:17.350169 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-356ac217-fb4d-4505-8168-5c7cc8fb5258 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:17.359192 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-356ac217-fb4d-4505-8168-5c7cc8fb5258 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/ba987aee-2707-4d47-aba9-d2803aa70745" status: 200 len: 1468 microversion: 2.1 time: 1.058811 Aug 27 02:53:17.374386 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1350/2688] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:16 2022] GET /compute/v2.1/servers/97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4 => generated 1506 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:17.378288 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1339/2689] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:16 2022] GET /compute/v2.1/servers/ba987aee-2707-4d47-aba9-d2803aa70745 => generated 1468 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:17.389516 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6c33f4b5-1338-4198-875c-6b8445b00910 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:17.389916 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-6c33f4b5-1338-4198-875c-6b8445b00910 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] [instance: 7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:17.393678 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ca7316f5-47b7-4fbe-b120-6319747abaab tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:17.396987 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-ca7316f5-47b7-4fbe-b120-6319747abaab tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] [instance: 546a5816-c2d9-494b-8c23-b0983cd11eb9] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:17.418132 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6c33f4b5-1338-4198-875c-6b8445b00910 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:17.418634 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6c33f4b5-1338-4198-875c-6b8445b00910 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:17.419068 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6c33f4b5-1338-4198-875c-6b8445b00910 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:17.420955 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ca7316f5-47b7-4fbe-b120-6319747abaab tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:17.422799 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6c33f4b5-1338-4198-875c-6b8445b00910 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:17.424960 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ca7316f5-47b7-4fbe-b120-6319747abaab tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:17.425648 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6c33f4b5-1338-4198-875c-6b8445b00910 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:17.426280 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ca7316f5-47b7-4fbe-b120-6319747abaab tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:17.426882 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6c33f4b5-1338-4198-875c-6b8445b00910 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:17.434652 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ca7316f5-47b7-4fbe-b120-6319747abaab tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:17.435292 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ca7316f5-47b7-4fbe-b120-6319747abaab tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:17.435744 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ca7316f5-47b7-4fbe-b120-6319747abaab tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:18.193352 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-6c33f4b5-1338-4198-875c-6b8445b00910 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317e74b4bbc4da298a0dcbd78068352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a8810c21784788b4c0ee64dedbaf15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:18.202093 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-6c33f4b5-1338-4198-875c-6b8445b00910 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] 10.222.0.70 "GET /compute/v2.1/servers/7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8" status: 200 len: 1506 microversion: 2.1 time: 0.826492 Aug 27 02:53:18.213548 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1351/2690] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:17 2022] GET /compute/v2.1/servers/7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8 => generated 1506 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:18.225539 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-7cbb7fcc-cc9e-4b91-a3d1-372ce96ac256 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:18.226175 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-7cbb7fcc-cc9e-4b91-a3d1-372ce96ac256 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:18.234688 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-ca7316f5-47b7-4fbe-b120-6319747abaab tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f496f24dccea47bd9a5ab532fe45e370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40794f05e8b94a0f8f087a87a58e0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:18.246791 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7cbb7fcc-cc9e-4b91-a3d1-372ce96ac256 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:18.247592 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7cbb7fcc-cc9e-4b91-a3d1-372ce96ac256 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:18.248783 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7cbb7fcc-cc9e-4b91-a3d1-372ce96ac256 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:18.254386 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7cbb7fcc-cc9e-4b91-a3d1-372ce96ac256 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:18.255031 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7cbb7fcc-cc9e-4b91-a3d1-372ce96ac256 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:18.255731 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7cbb7fcc-cc9e-4b91-a3d1-372ce96ac256 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:18.258632 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ca7316f5-47b7-4fbe-b120-6319747abaab tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "GET /compute/v2.1/servers/546a5816-c2d9-494b-8c23-b0983cd11eb9" status: 200 len: 1497 microversion: 2.1 time: 0.878124 Aug 27 02:53:18.282165 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1340/2691] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:17 2022] GET /compute/v2.1/servers/546a5816-c2d9-494b-8c23-b0983cd11eb9 => generated 1497 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:18.289889 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d69eb677-365f-477e-a31d-85724b49f69d tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:53:18.295746 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d69eb677-365f-477e-a31d-85724b49f69d tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] [instance: 7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:18.305403 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d69eb677-365f-477e-a31d-85724b49f69d tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:18.306247 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d69eb677-365f-477e-a31d-85724b49f69d tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:18.306914 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d69eb677-365f-477e-a31d-85724b49f69d tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:18.307914 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d69eb677-365f-477e-a31d-85724b49f69d tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:18.308631 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d69eb677-365f-477e-a31d-85724b49f69d tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:18.309291 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d69eb677-365f-477e-a31d-85724b49f69d tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:18.459417 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d69eb677-365f-477e-a31d-85724b49f69d tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] 10.222.0.70 "PUT /compute/v2.1/servers/7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8" status: 200 len: 1078 microversion: 2.1 time: 0.175623 Aug 27 02:53:18.473944 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1341/2692] 10.222.0.70 () {60 vars in 1256 bytes} [Sat Aug 27 02:53:18 2022] PUT /compute/v2.1/servers/7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8 => generated 1078 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:18.484875 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8462a232-5fb1-4933-8574-0dc275c9a9f3 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:18.485915 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-8462a232-5fb1-4933-8574-0dc275c9a9f3 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: 97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:18.503717 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8462a232-5fb1-4933-8574-0dc275c9a9f3 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:18.505914 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8462a232-5fb1-4933-8574-0dc275c9a9f3 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:18.506659 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8462a232-5fb1-4933-8574-0dc275c9a9f3 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:18.510326 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8462a232-5fb1-4933-8574-0dc275c9a9f3 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:18.511124 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8462a232-5fb1-4933-8574-0dc275c9a9f3 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:18.511803 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8462a232-5fb1-4933-8574-0dc275c9a9f3 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:19.010947 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-7cbb7fcc-cc9e-4b91-a3d1-372ce96ac256 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:19.032323 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-7cbb7fcc-cc9e-4b91-a3d1-372ce96ac256 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1681 microversion: 2.1 time: 0.817558 Aug 27 02:53:19.042856 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1352/2693] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:18 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1681 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:19.052394 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-8462a232-5fb1-4933-8574-0dc275c9a9f3 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:19.070261 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-21de53f7-340c-4ad3-9245-2cd3a270c7e4 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:19.071901 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-8462a232-5fb1-4933-8574-0dc275c9a9f3 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4" status: 200 len: 1506 microversion: 2.1 time: 0.596441 Aug 27 02:53:19.085441 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-21de53f7-340c-4ad3-9245-2cd3a270c7e4 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: ba987aee-2707-4d47-aba9-d2803aa70745] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:19.089787 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1342/2694] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:18 2022] GET /compute/v2.1/servers/97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4 => generated 1506 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:19.116748 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-53bbdfe5-0e04-47ae-8202-55dc6ed04fc5 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:19.121619 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-21de53f7-340c-4ad3-9245-2cd3a270c7e4 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:19.122177 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-53bbdfe5-0e04-47ae-8202-55dc6ed04fc5 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] [instance: 7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:19.127709 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-21de53f7-340c-4ad3-9245-2cd3a270c7e4 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:19.128722 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-21de53f7-340c-4ad3-9245-2cd3a270c7e4 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:19.131555 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-21de53f7-340c-4ad3-9245-2cd3a270c7e4 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:19.132283 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-21de53f7-340c-4ad3-9245-2cd3a270c7e4 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:19.133333 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-21de53f7-340c-4ad3-9245-2cd3a270c7e4 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:19.147180 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-53bbdfe5-0e04-47ae-8202-55dc6ed04fc5 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:19.148207 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-53bbdfe5-0e04-47ae-8202-55dc6ed04fc5 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:19.148964 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-53bbdfe5-0e04-47ae-8202-55dc6ed04fc5 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:19.151544 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-53bbdfe5-0e04-47ae-8202-55dc6ed04fc5 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:19.152236 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-53bbdfe5-0e04-47ae-8202-55dc6ed04fc5 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:19.154036 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-53bbdfe5-0e04-47ae-8202-55dc6ed04fc5 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:19.510932 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-53bbdfe5-0e04-47ae-8202-55dc6ed04fc5 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317e74b4bbc4da298a0dcbd78068352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a8810c21784788b4c0ee64dedbaf15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:19.525961 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-53bbdfe5-0e04-47ae-8202-55dc6ed04fc5 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] 10.222.0.70 "GET /compute/v2.1/servers/7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8" status: 200 len: 1504 microversion: 2.1 time: 0.433964 Aug 27 02:53:19.528859 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1343/2695] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:19 2022] GET /compute/v2.1/servers/7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8 => generated 1504 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:19.534055 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-bd625c00-e947-4783-856d-ef923e1c53c8 req-2e3be08d-b257-4100-b735-3acf88e74c81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba987aee-2707-4d47-aba9-d2803aa70745", "name": "network-vif-plugged", "status": "completed", "tag": "0871e4ff-ef2c-4a64-a799-ecfb74bf8dfa"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:53:19.562497 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-bd625c00-e947-4783-856d-ef923e1c53c8 req-2e3be08d-b257-4100-b735-3acf88e74c81 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:19.569067 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-bd625c00-e947-4783-856d-ef923e1c53c8 req-2e3be08d-b257-4100-b735-3acf88e74c81 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:19.570009 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-bd625c00-e947-4783-856d-ef923e1c53c8 req-2e3be08d-b257-4100-b735-3acf88e74c81 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:19.596281 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-bd625c00-e947-4783-856d-ef923e1c53c8 req-2e3be08d-b257-4100-b735-3acf88e74c81 service nova] Creating event network-vif-plugged:0871e4ff-ef2c-4a64-a799-ecfb74bf8dfa for instance ba987aee-2707-4d47-aba9-d2803aa70745 on n-h1-852278-4 Aug 27 02:53:19.611127 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-bd625c00-e947-4783-856d-ef923e1c53c8 req-2e3be08d-b257-4100-b735-3acf88e74c81 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080493 Aug 27 02:53:19.612269 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1344/2696] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:53:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:53:19.622109 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-bd83099e-3ea3-4fde-a6b5-836da1dbbf54 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:19.625188 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-bd83099e-3ea3-4fde-a6b5-836da1dbbf54 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] [instance: 546a5816-c2d9-494b-8c23-b0983cd11eb9] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:19.641038 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bd83099e-3ea3-4fde-a6b5-836da1dbbf54 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:19.641726 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bd83099e-3ea3-4fde-a6b5-836da1dbbf54 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:19.644984 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bd83099e-3ea3-4fde-a6b5-836da1dbbf54 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:19.646754 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bd83099e-3ea3-4fde-a6b5-836da1dbbf54 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:19.647419 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bd83099e-3ea3-4fde-a6b5-836da1dbbf54 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:19.648043 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bd83099e-3ea3-4fde-a6b5-836da1dbbf54 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:19.686413 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-21de53f7-340c-4ad3-9245-2cd3a270c7e4 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:19.699300 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-21de53f7-340c-4ad3-9245-2cd3a270c7e4 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/ba987aee-2707-4d47-aba9-d2803aa70745" status: 200 len: 1468 microversion: 2.1 time: 0.654646 Aug 27 02:53:19.702001 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1353/2697] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:19 2022] GET /compute/v2.1/servers/ba987aee-2707-4d47-aba9-d2803aa70745 => generated 1468 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:19.734872 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-03a42f8c-5dd3-452e-9499-142333c489c2 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:19.736265 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-03a42f8c-5dd3-452e-9499-142333c489c2 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] [instance: 7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:19.750469 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-03a42f8c-5dd3-452e-9499-142333c489c2 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:19.752921 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-03a42f8c-5dd3-452e-9499-142333c489c2 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:19.758211 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-03a42f8c-5dd3-452e-9499-142333c489c2 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:19.760754 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-03a42f8c-5dd3-452e-9499-142333c489c2 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:19.770246 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-03a42f8c-5dd3-452e-9499-142333c489c2 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:19.773833 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-03a42f8c-5dd3-452e-9499-142333c489c2 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:20.585168 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-bd83099e-3ea3-4fde-a6b5-836da1dbbf54 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f496f24dccea47bd9a5ab532fe45e370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40794f05e8b94a0f8f087a87a58e0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:20.595524 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-bd83099e-3ea3-4fde-a6b5-836da1dbbf54 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "GET /compute/v2.1/servers/546a5816-c2d9-494b-8c23-b0983cd11eb9" status: 200 len: 1497 microversion: 2.1 time: 0.981689 Aug 27 02:53:20.613090 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1345/2698] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:19 2022] GET /compute/v2.1/servers/546a5816-c2d9-494b-8c23-b0983cd11eb9 => generated 1497 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:20.633773 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-cb5d762e-2eac-4b44-a2a3-23336ddbf63e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:20.637150 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-cb5d762e-2eac-4b44-a2a3-23336ddbf63e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:20.658358 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cb5d762e-2eac-4b44-a2a3-23336ddbf63e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:20.661548 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cb5d762e-2eac-4b44-a2a3-23336ddbf63e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:20.662384 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cb5d762e-2eac-4b44-a2a3-23336ddbf63e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:20.666354 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cb5d762e-2eac-4b44-a2a3-23336ddbf63e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:20.667075 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cb5d762e-2eac-4b44-a2a3-23336ddbf63e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:20.667686 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cb5d762e-2eac-4b44-a2a3-23336ddbf63e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:20.927580 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-03a42f8c-5dd3-452e-9499-142333c489c2 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317e74b4bbc4da298a0dcbd78068352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a8810c21784788b4c0ee64dedbaf15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:20.939828 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-03a42f8c-5dd3-452e-9499-142333c489c2 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] 10.222.0.70 "GET /compute/v2.1/servers/7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8" status: 200 len: 1504 microversion: 2.1 time: 1.233688 Aug 27 02:53:20.940504 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1354/2699] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:19 2022] GET /compute/v2.1/servers/7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8 => generated 1504 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:20.953518 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4f6099a0-fa50-4725-b966-9e059873f14e tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:20.954142 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-4f6099a0-fa50-4725-b966-9e059873f14e tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: 97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:20.973143 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4f6099a0-fa50-4725-b966-9e059873f14e tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:20.973669 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4f6099a0-fa50-4725-b966-9e059873f14e tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:20.974124 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4f6099a0-fa50-4725-b966-9e059873f14e tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:20.974889 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4f6099a0-fa50-4725-b966-9e059873f14e tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:20.988832 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4f6099a0-fa50-4725-b966-9e059873f14e tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:20.989361 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4f6099a0-fa50-4725-b966-9e059873f14e tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:21.536657 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-cb5d762e-2eac-4b44-a2a3-23336ddbf63e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:21.546828 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-cb5d762e-2eac-4b44-a2a3-23336ddbf63e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1681 microversion: 2.1 time: 0.925521 Aug 27 02:53:21.549755 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1346/2700] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:20 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1681 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:21.570124 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-807b7b0b-fd2b-43db-a3ca-86714903f1e1 req-c7f29396-d0cd-4b3e-8ff9-000d2ae2161b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba987aee-2707-4d47-aba9-d2803aa70745", "name": "network-vif-deleted", "tag": "0871e4ff-ef2c-4a64-a799-ecfb74bf8dfa"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:53:21.581915 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-4f6099a0-fa50-4725-b966-9e059873f14e tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:21.591342 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-4f6099a0-fa50-4725-b966-9e059873f14e tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4" status: 200 len: 1506 microversion: 2.1 time: 0.649772 Aug 27 02:53:21.591957 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1355/2701] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:20 2022] GET /compute/v2.1/servers/97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4 => generated 1506 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:21.604329 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-807b7b0b-fd2b-43db-a3ca-86714903f1e1 req-c7f29396-d0cd-4b3e-8ff9-000d2ae2161b service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:21.604902 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-807b7b0b-fd2b-43db-a3ca-86714903f1e1 req-c7f29396-d0cd-4b3e-8ff9-000d2ae2161b service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:21.605215 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-807b7b0b-fd2b-43db-a3ca-86714903f1e1 req-c7f29396-d0cd-4b3e-8ff9-000d2ae2161b service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:21.615510 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e29e605e-32ff-4f6e-a7ef-e22937227ed1 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:21.616100 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-e29e605e-32ff-4f6e-a7ef-e22937227ed1 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: ba987aee-2707-4d47-aba9-d2803aa70745] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:21.644679 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e29e605e-32ff-4f6e-a7ef-e22937227ed1 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:21.645465 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e29e605e-32ff-4f6e-a7ef-e22937227ed1 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:21.646067 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e29e605e-32ff-4f6e-a7ef-e22937227ed1 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:21.646965 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e29e605e-32ff-4f6e-a7ef-e22937227ed1 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:21.647585 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-807b7b0b-fd2b-43db-a3ca-86714903f1e1 req-c7f29396-d0cd-4b3e-8ff9-000d2ae2161b service nova] Creating event network-vif-deleted:0871e4ff-ef2c-4a64-a799-ecfb74bf8dfa for instance ba987aee-2707-4d47-aba9-d2803aa70745 on n-h1-852278-4 Aug 27 02:53:21.647730 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e29e605e-32ff-4f6e-a7ef-e22937227ed1 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:21.648289 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e29e605e-32ff-4f6e-a7ef-e22937227ed1 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:21.662711 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-807b7b0b-fd2b-43db-a3ca-86714903f1e1 req-c7f29396-d0cd-4b3e-8ff9-000d2ae2161b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098290 Aug 27 02:53:21.681514 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1347/2702] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:53:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:53:21.687642 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-eb2dcd2d-cabe-4827-8d63-3bd1f0f9fa47 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:53:21.697614 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-eb2dcd2d-cabe-4827-8d63-3bd1f0f9fa47 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] [instance: 7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:21.716259 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eb2dcd2d-cabe-4827-8d63-3bd1f0f9fa47 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:21.718835 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eb2dcd2d-cabe-4827-8d63-3bd1f0f9fa47 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:21.721213 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e29e605e-32ff-4f6e-a7ef-e22937227ed1 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:21.721827 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eb2dcd2d-cabe-4827-8d63-3bd1f0f9fa47 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:21.722740 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eb2dcd2d-cabe-4827-8d63-3bd1f0f9fa47 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:21.723317 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eb2dcd2d-cabe-4827-8d63-3bd1f0f9fa47 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:21.723455 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e29e605e-32ff-4f6e-a7ef-e22937227ed1 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:21.725857 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e29e605e-32ff-4f6e-a7ef-e22937227ed1 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:21.726483 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eb2dcd2d-cabe-4827-8d63-3bd1f0f9fa47 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:21.726723 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.instance [None req-e29e605e-32ff-4f6e-a7ef-e22937227ed1 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lazy-loading 'fault' on Instance uuid ba987aee-2707-4d47-aba9-d2803aa70745 {{(pid=134052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:53:21.809053 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:53:21.822771 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-e29e605e-32ff-4f6e-a7ef-e22937227ed1 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:21.832275 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e29e605e-32ff-4f6e-a7ef-e22937227ed1 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/ba987aee-2707-4d47-aba9-d2803aa70745" status: 200 len: 1302 microversion: 2.1 time: 0.223365 Aug 27 02:53:21.837145 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1356/2703] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:21 2022] GET /compute/v2.1/servers/ba987aee-2707-4d47-aba9-d2803aa70745 => generated 1302 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:21.845421 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-47cf9663-574e-4657-a0be-d3d3a83b28e6 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:21.848059 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-47cf9663-574e-4657-a0be-d3d3a83b28e6 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] [instance: 546a5816-c2d9-494b-8c23-b0983cd11eb9] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:21.865559 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-47cf9663-574e-4657-a0be-d3d3a83b28e6 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:21.866350 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-47cf9663-574e-4657-a0be-d3d3a83b28e6 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:21.868421 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-47cf9663-574e-4657-a0be-d3d3a83b28e6 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:21.869605 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-47cf9663-574e-4657-a0be-d3d3a83b28e6 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:21.871596 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-47cf9663-574e-4657-a0be-d3d3a83b28e6 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:21.872283 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-47cf9663-574e-4657-a0be-d3d3a83b28e6 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:22.052864 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-eb2dcd2d-cabe-4827-8d63-3bd1f0f9fa47 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Flavor limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:53:22.053300 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-eb2dcd2d-cabe-4827-8d63-3bd1f0f9fa47 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Image limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:53:22.057075 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-eb2dcd2d-cabe-4827-8d63-3bd1f0f9fa47 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Flavor pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:53:22.059942 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-eb2dcd2d-cabe-4827-8d63-3bd1f0f9fa47 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Image pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:53:22.060385 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-eb2dcd2d-cabe-4827-8d63-3bd1f0f9fa47 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:53:22.253836 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-eb2dcd2d-cabe-4827-8d63-3bd1f0f9fa47 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] [instance: 7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:22.270631 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eb2dcd2d-cabe-4827-8d63-3bd1f0f9fa47 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:22.271387 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eb2dcd2d-cabe-4827-8d63-3bd1f0f9fa47 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:22.272608 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eb2dcd2d-cabe-4827-8d63-3bd1f0f9fa47 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:22.274591 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eb2dcd2d-cabe-4827-8d63-3bd1f0f9fa47 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:22.276747 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eb2dcd2d-cabe-4827-8d63-3bd1f0f9fa47 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:22.278582 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eb2dcd2d-cabe-4827-8d63-3bd1f0f9fa47 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:22.346480 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-eb2dcd2d-cabe-4827-8d63-3bd1f0f9fa47 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] 10.222.0.70 "POST /compute/v2.1/servers/7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8/action" status: 202 len: 1110 microversion: 2.1 time: 0.663580 Aug 27 02:53:22.351387 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1348/2704] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 02:53:21 2022] POST /compute/v2.1/servers/7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8/action => generated 1110 bytes in 669 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 27 02:53:22.360066 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-47cf9663-574e-4657-a0be-d3d3a83b28e6 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f496f24dccea47bd9a5ab532fe45e370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40794f05e8b94a0f8f087a87a58e0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:22.372303 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-842db147-3166-4a55-8567-0622fae23113 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:22.377818 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-842db147-3166-4a55-8567-0622fae23113 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] [instance: 7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:22.379908 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-47cf9663-574e-4657-a0be-d3d3a83b28e6 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "GET /compute/v2.1/servers/546a5816-c2d9-494b-8c23-b0983cd11eb9" status: 200 len: 1497 microversion: 2.1 time: 0.541356 Aug 27 02:53:22.398803 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1357/2705] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:21 2022] GET /compute/v2.1/servers/546a5816-c2d9-494b-8c23-b0983cd11eb9 => generated 1497 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:22.410581 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-842db147-3166-4a55-8567-0622fae23113 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:22.413748 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-842db147-3166-4a55-8567-0622fae23113 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:22.414380 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-842db147-3166-4a55-8567-0622fae23113 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:22.415312 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-842db147-3166-4a55-8567-0622fae23113 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:22.418240 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-842db147-3166-4a55-8567-0622fae23113 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:22.418881 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-842db147-3166-4a55-8567-0622fae23113 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:22.573679 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-1768e5cb-25bb-4e94-9011-03b184a02f9f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:22.574519 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-1768e5cb-25bb-4e94-9011-03b184a02f9f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:22.596153 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1768e5cb-25bb-4e94-9011-03b184a02f9f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:22.596676 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1768e5cb-25bb-4e94-9011-03b184a02f9f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:22.597110 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1768e5cb-25bb-4e94-9011-03b184a02f9f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:22.597869 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1768e5cb-25bb-4e94-9011-03b184a02f9f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:22.598296 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1768e5cb-25bb-4e94-9011-03b184a02f9f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:22.598717 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1768e5cb-25bb-4e94-9011-03b184a02f9f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:22.876457 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-842db147-3166-4a55-8567-0622fae23113 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317e74b4bbc4da298a0dcbd78068352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a8810c21784788b4c0ee64dedbaf15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:22.884595 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-842db147-3166-4a55-8567-0622fae23113 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] 10.222.0.70 "GET /compute/v2.1/servers/7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8" status: 200 len: 1515 microversion: 2.1 time: 0.516762 Aug 27 02:53:22.885191 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1349/2706] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:22 2022] GET /compute/v2.1/servers/7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8 => generated 1515 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:22.912693 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4fc9585d-1424-4808-a44d-5776f3708612 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:22.913874 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-4fc9585d-1424-4808-a44d-5776f3708612 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: 97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:22.928037 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4fc9585d-1424-4808-a44d-5776f3708612 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:22.928919 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4fc9585d-1424-4808-a44d-5776f3708612 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:22.929363 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4fc9585d-1424-4808-a44d-5776f3708612 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:22.930083 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4fc9585d-1424-4808-a44d-5776f3708612 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:22.930537 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4fc9585d-1424-4808-a44d-5776f3708612 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:22.930963 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4fc9585d-1424-4808-a44d-5776f3708612 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:23.356086 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-1768e5cb-25bb-4e94-9011-03b184a02f9f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:23.364945 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-1768e5cb-25bb-4e94-9011-03b184a02f9f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1668 microversion: 2.1 time: 0.797691 Aug 27 02:53:23.365616 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1358/2707] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:22 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1668 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:53:23.405560 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-7dccb4c1-c40d-43eb-9ad8-002080a93f24 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:23.406348 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-7dccb4c1-c40d-43eb-9ad8-002080a93f24 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: ba987aee-2707-4d47-aba9-d2803aa70745] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:23.435786 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7dccb4c1-c40d-43eb-9ad8-002080a93f24 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:23.436446 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7dccb4c1-c40d-43eb-9ad8-002080a93f24 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:23.441312 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7dccb4c1-c40d-43eb-9ad8-002080a93f24 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:23.445154 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7dccb4c1-c40d-43eb-9ad8-002080a93f24 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:23.445907 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7dccb4c1-c40d-43eb-9ad8-002080a93f24 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:23.447676 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7dccb4c1-c40d-43eb-9ad8-002080a93f24 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:23.493951 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-7dccb4c1-c40d-43eb-9ad8-002080a93f24 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] HTTP exception thrown: Instance ba987aee-2707-4d47-aba9-d2803aa70745 could not be found. Aug 27 02:53:23.500944 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-7dccb4c1-c40d-43eb-9ad8-002080a93f24 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Request method failure captured: Aug 27 02:53:23.500944 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/servers/ba987aee-2707-4d47-aba9-d2803aa70745 HTTP/1.1 Aug 27 02:53:23.500944 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:53:23.500944 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:53:23.500944 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:53:23.500944 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:53:23.500944 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:53:23.500944 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:53:23.500944 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:53:23.500944 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:53:23.500944 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYXV0r3jGUq47WLGtKQpD2GT6ZaucKLj1FHCRVWh7FmbJ46ArZdeI2i4KuIQK6o7gnteOdnBxpMeNOLKzoZIrvG7jVXHSKepr0w2IF9adZg6La101vR9uA7o3L_hdEWDLnTX4lG6KD99R14eN8P3ngENHLfo1gbuvR2cMcQDOiaqQnU Aug 27 02:53:23.500944 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:53:23.500944 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:53:23.500944 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:53:23.500944 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:53:23.500944 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:53:23.500944 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:53:23.500944 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 937a5eeccaa7425ca72c8c74fb99f11a Aug 27 02:53:23.500944 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-MigrationsAdminTest-893175282 Aug 27 02:53:23.500944 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:53:23.500944 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:53:23.500944 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/937a5eeccaa7425ca72c8c74fb99f11a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_937a5eeccaa7425ca72c8c74fb99f11a", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/937a5eeccaa7425ca72c8c74fb99f11a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/937a5eeccaa7425ca72c8c74fb99f11a"}]}] Aug 27 02:53:23.500944 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-MigrationsAdminTest-893175282 Aug 27 02:53:23.500944 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 937a5eeccaa7425ca72c8c74fb99f11a Aug 27 02:53:23.500944 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-MigrationsAdminTest-893175282 Aug 27 02:53:23.500944 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-MigrationsAdminTest-893175282-project Aug 27 02:53:23.500944 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:53:23.500944 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:53:23.500944 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 0b310e73ecd244d2938812d5be99558c Aug 27 02:53:23.500944 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-MigrationsAdminTest-893175282-project Aug 27 02:53:23.500944 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 02:53:23.500944 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance ba987aee-2707-4d47-aba9-d2803aa70745 could not be found. Aug 27 02:53:23.500944 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': 'ba987aee-2707-4d47-aba9-d2803aa70745'} Aug 27 02:53:23.500944 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:53:23.500944 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:53:23.500944 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:53:23.500944 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:53:23.500944 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:53:23.500944 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:53:23.500944 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:53:23.500944 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:53:23.500944 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:53:23.500944 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:53:23.500944 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba987aee-2707-4d47-aba9-d2803aa70745 could not be found. Aug 27 02:53:23.500944 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:53:23.500944 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:53:23.500944 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:53:23.500944 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:53:23.500944 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:53:23.500944 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:53:23.500944 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:53:23.500944 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:53:23.500944 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:53:23.500944 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:53:23.500944 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:53:23.500944 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:53:23.500944 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:53:23.500944 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:53:23.500944 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:53:23.500944 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:53:23.500944 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba987aee-2707-4d47-aba9-d2803aa70745 could not be found. Aug 27 02:53:23.500944 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:53:23.500944 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:53:23.500944 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:53:23.505387 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:53:23.505387 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:53:23.505387 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:53:23.505387 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:53:23.505387 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:53:23.505387 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba987aee-2707-4d47-aba9-d2803aa70745 could not be found. Aug 27 02:53:23.505387 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:53:23.509308 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-7dccb4c1-c40d-43eb-9ad8-002080a93f24 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Returning 404 to user: Instance ba987aee-2707-4d47-aba9-d2803aa70745 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:53:23.512833 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-7dccb4c1-c40d-43eb-9ad8-002080a93f24 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/ba987aee-2707-4d47-aba9-d2803aa70745" status: 404 len: 111 microversion: 2.1 time: 0.146174 Aug 27 02:53:23.514950 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1359/2708] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:23 2022] GET /compute/v2.1/servers/ba987aee-2707-4d47-aba9-d2803aa70745 => generated 111 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:53:23.522239 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b8d02b50-95ec-4dac-a401-f9e991c031df tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:23.526186 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b8d02b50-95ec-4dac-a401-f9e991c031df tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] [instance: 546a5816-c2d9-494b-8c23-b0983cd11eb9] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:23.535321 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b8d02b50-95ec-4dac-a401-f9e991c031df tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:23.536187 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b8d02b50-95ec-4dac-a401-f9e991c031df tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:23.536893 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b8d02b50-95ec-4dac-a401-f9e991c031df tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:23.538821 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b8d02b50-95ec-4dac-a401-f9e991c031df tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:23.539998 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b8d02b50-95ec-4dac-a401-f9e991c031df tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:23.543372 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b8d02b50-95ec-4dac-a401-f9e991c031df tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:23.609346 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-4fc9585d-1424-4808-a44d-5776f3708612 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:23.646127 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-4fc9585d-1424-4808-a44d-5776f3708612 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4" status: 200 len: 1506 microversion: 2.1 time: 0.755604 Aug 27 02:53:23.661513 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1350/2709] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:22 2022] GET /compute/v2.1/servers/97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4 => generated 1506 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:23.676434 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-cad7758c-7585-482e-aa98-c235068a4bb5 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:23.676993 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-cad7758c-7585-482e-aa98-c235068a4bb5 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: a4aca2ed-a835-4f8f-96ae-c3502645425a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:23.692177 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:53:23.701920 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cad7758c-7585-482e-aa98-c235068a4bb5 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:23.704211 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cad7758c-7585-482e-aa98-c235068a4bb5 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:23.704725 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cad7758c-7585-482e-aa98-c235068a4bb5 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:23.708789 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cad7758c-7585-482e-aa98-c235068a4bb5 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:23.709279 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cad7758c-7585-482e-aa98-c235068a4bb5 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:23.709708 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cad7758c-7585-482e-aa98-c235068a4bb5 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:23.819072 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-cad7758c-7585-482e-aa98-c235068a4bb5 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: a4aca2ed-a835-4f8f-96ae-c3502645425a] Going to try to terminate instance {{(pid=134051) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:53:23.997739 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-cad7758c-7585-482e-aa98-c235068a4bb5 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "DELETE /compute/v2.1/servers/a4aca2ed-a835-4f8f-96ae-c3502645425a" status: 204 len: 0 microversion: 2.1 time: 0.344438 Aug 27 02:53:24.000094 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1351/2710] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:53:23 2022] DELETE /compute/v2.1/servers/a4aca2ed-a835-4f8f-96ae-c3502645425a => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:53:24.010877 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-df7450aa-9c09-47f2-8c3b-b653251a6d5f tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:24.011929 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-df7450aa-9c09-47f2-8c3b-b653251a6d5f tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] [instance: 7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:24.027781 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-df7450aa-9c09-47f2-8c3b-b653251a6d5f tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:24.028289 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-df7450aa-9c09-47f2-8c3b-b653251a6d5f tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:24.028749 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-df7450aa-9c09-47f2-8c3b-b653251a6d5f tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:24.032119 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-df7450aa-9c09-47f2-8c3b-b653251a6d5f tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:24.032560 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-df7450aa-9c09-47f2-8c3b-b653251a6d5f tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:24.032993 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-df7450aa-9c09-47f2-8c3b-b653251a6d5f tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:24.132597 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b8d02b50-95ec-4dac-a401-f9e991c031df tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f496f24dccea47bd9a5ab532fe45e370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40794f05e8b94a0f8f087a87a58e0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:24.155489 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b8d02b50-95ec-4dac-a401-f9e991c031df tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "GET /compute/v2.1/servers/546a5816-c2d9-494b-8c23-b0983cd11eb9" status: 200 len: 1497 microversion: 2.1 time: 0.639057 Aug 27 02:53:24.156239 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1360/2711] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:23 2022] GET /compute/v2.1/servers/546a5816-c2d9-494b-8c23-b0983cd11eb9 => generated 1497 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:24.179740 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8fc1fad2-e541-498e-af1a-bf55ce4062a7 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:24.180503 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-8fc1fad2-e541-498e-af1a-bf55ce4062a7 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: a4aca2ed-a835-4f8f-96ae-c3502645425a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:24.202320 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8fc1fad2-e541-498e-af1a-bf55ce4062a7 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:24.202836 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8fc1fad2-e541-498e-af1a-bf55ce4062a7 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:24.207905 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8fc1fad2-e541-498e-af1a-bf55ce4062a7 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:24.213377 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8fc1fad2-e541-498e-af1a-bf55ce4062a7 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:24.214198 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8fc1fad2-e541-498e-af1a-bf55ce4062a7 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:24.216195 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8fc1fad2-e541-498e-af1a-bf55ce4062a7 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:24.685230 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-df7450aa-9c09-47f2-8c3b-b653251a6d5f tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317e74b4bbc4da298a0dcbd78068352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a8810c21784788b4c0ee64dedbaf15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:24.699102 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-df7450aa-9c09-47f2-8c3b-b653251a6d5f tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] 10.222.0.70 "GET /compute/v2.1/servers/7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8" status: 200 len: 1515 microversion: 2.1 time: 0.696913 Aug 27 02:53:24.699804 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1352/2712] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:24 2022] GET /compute/v2.1/servers/7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8 => generated 1515 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:24.708465 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-2f401b0c-0eeb-49b2-8d2f-eff2c506892e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:24.712878 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-2f401b0c-0eeb-49b2-8d2f-eff2c506892e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:24.723867 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2f401b0c-0eeb-49b2-8d2f-eff2c506892e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:24.731444 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2f401b0c-0eeb-49b2-8d2f-eff2c506892e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:24.732141 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2f401b0c-0eeb-49b2-8d2f-eff2c506892e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:24.733177 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2f401b0c-0eeb-49b2-8d2f-eff2c506892e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:24.733912 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2f401b0c-0eeb-49b2-8d2f-eff2c506892e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:24.734554 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2f401b0c-0eeb-49b2-8d2f-eff2c506892e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:24.914886 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-8fc1fad2-e541-498e-af1a-bf55ce4062a7 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:24.934276 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-8fc1fad2-e541-498e-af1a-bf55ce4062a7 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/a4aca2ed-a835-4f8f-96ae-c3502645425a" status: 200 len: 1535 microversion: 2.1 time: 0.774874 Aug 27 02:53:24.935376 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1361/2713] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:24 2022] GET /compute/v2.1/servers/a4aca2ed-a835-4f8f-96ae-c3502645425a => generated 1535 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:24.941997 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3da6c813-39ca-49c5-bbed-a0e92ad4ec7f tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:24.943320 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-3da6c813-39ca-49c5-bbed-a0e92ad4ec7f tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: 97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:24.953035 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3da6c813-39ca-49c5-bbed-a0e92ad4ec7f tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:24.954880 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3da6c813-39ca-49c5-bbed-a0e92ad4ec7f tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:24.955547 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3da6c813-39ca-49c5-bbed-a0e92ad4ec7f tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:24.957321 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3da6c813-39ca-49c5-bbed-a0e92ad4ec7f tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:24.958572 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3da6c813-39ca-49c5-bbed-a0e92ad4ec7f tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:24.959419 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3da6c813-39ca-49c5-bbed-a0e92ad4ec7f tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:25.240582 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-2f401b0c-0eeb-49b2-8d2f-eff2c506892e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:25.251745 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-2f401b0c-0eeb-49b2-8d2f-eff2c506892e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1668 microversion: 2.1 time: 0.550226 Aug 27 02:53:25.265251 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-3da6c813-39ca-49c5-bbed-a0e92ad4ec7f tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:25.266044 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1353/2714] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:24 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1668 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:25.269517 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=100 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:53:25.292842 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-3da6c813-39ca-49c5-bbed-a0e92ad4ec7f tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4" status: 200 len: 1506 microversion: 2.1 time: 0.354155 Aug 27 02:53:25.294220 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1362/2715] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:24 2022] GET /compute/v2.1/servers/97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4 => generated 1506 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:25.296759 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-753ecb79-748f-4394-bf2b-58c6d084caa9 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:25.297389 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-753ecb79-748f-4394-bf2b-58c6d084caa9 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] [instance: 546a5816-c2d9-494b-8c23-b0983cd11eb9] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:25.316245 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-753ecb79-748f-4394-bf2b-58c6d084caa9 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:25.316928 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-753ecb79-748f-4394-bf2b-58c6d084caa9 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:25.317366 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-753ecb79-748f-4394-bf2b-58c6d084caa9 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:25.318078 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-753ecb79-748f-4394-bf2b-58c6d084caa9 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:25.318525 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-753ecb79-748f-4394-bf2b-58c6d084caa9 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:25.318944 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-753ecb79-748f-4394-bf2b-58c6d084caa9 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:25.721979 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-999de839-9938-4916-9de8-7a12e8a29e1a tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:25.722779 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-999de839-9938-4916-9de8-7a12e8a29e1a tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] [instance: 7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:25.727140 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=93 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:53:25.737435 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-999de839-9938-4916-9de8-7a12e8a29e1a tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:25.738278 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-999de839-9938-4916-9de8-7a12e8a29e1a tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:25.747546 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-999de839-9938-4916-9de8-7a12e8a29e1a tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:25.751789 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-999de839-9938-4916-9de8-7a12e8a29e1a tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:25.752823 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-999de839-9938-4916-9de8-7a12e8a29e1a tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:25.753542 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-999de839-9938-4916-9de8-7a12e8a29e1a tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:26.073764 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-753ecb79-748f-4394-bf2b-58c6d084caa9 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f496f24dccea47bd9a5ab532fe45e370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40794f05e8b94a0f8f087a87a58e0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:26.082003 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-753ecb79-748f-4394-bf2b-58c6d084caa9 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "GET /compute/v2.1/servers/546a5816-c2d9-494b-8c23-b0983cd11eb9" status: 200 len: 1497 microversion: 2.1 time: 0.810780 Aug 27 02:53:26.082602 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1354/2716] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:25 2022] GET /compute/v2.1/servers/546a5816-c2d9-494b-8c23-b0983cd11eb9 => generated 1497 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:26.096127 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-013bba66-66d7-4e81-b22e-e373b0d3d1e9 req-ceea48b4-0802-4a4b-98c9-a06e16ef8eff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb0d71f2-158d-4acc-8774-6874e7da29cd", "name": "network-vif-unplugged", "status": "completed", "tag": "fe5d48cf-956a-4e15-9a8e-fdd605d313b1"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:53:26.120169 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-013bba66-66d7-4e81-b22e-e373b0d3d1e9 req-ceea48b4-0802-4a4b-98c9-a06e16ef8eff service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:26.120703 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-013bba66-66d7-4e81-b22e-e373b0d3d1e9 req-ceea48b4-0802-4a4b-98c9-a06e16ef8eff service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:26.121385 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-013bba66-66d7-4e81-b22e-e373b0d3d1e9 req-ceea48b4-0802-4a4b-98c9-a06e16ef8eff service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:26.136684 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-013bba66-66d7-4e81-b22e-e373b0d3d1e9 req-ceea48b4-0802-4a4b-98c9-a06e16ef8eff service nova] Creating event network-vif-unplugged:fe5d48cf-956a-4e15-9a8e-fdd605d313b1 for instance bb0d71f2-158d-4acc-8774-6874e7da29cd on n-h1-852278-4 Aug 27 02:53:26.144641 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-013bba66-66d7-4e81-b22e-e373b0d3d1e9 req-ceea48b4-0802-4a4b-98c9-a06e16ef8eff service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060544 Aug 27 02:53:26.152248 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1355/2717] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:53:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:53:26.160130 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-97fce1c4-edb0-454c-b0c6-818f8db5b9af tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:26.160874 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-97fce1c4-edb0-454c-b0c6-818f8db5b9af tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: a4aca2ed-a835-4f8f-96ae-c3502645425a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:26.170411 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-97fce1c4-edb0-454c-b0c6-818f8db5b9af tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:26.171258 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-97fce1c4-edb0-454c-b0c6-818f8db5b9af tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:26.172017 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-97fce1c4-edb0-454c-b0c6-818f8db5b9af tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:26.173559 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-97fce1c4-edb0-454c-b0c6-818f8db5b9af tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:26.174178 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-97fce1c4-edb0-454c-b0c6-818f8db5b9af tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:26.174993 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-97fce1c4-edb0-454c-b0c6-818f8db5b9af tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:26.334243 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-999de839-9938-4916-9de8-7a12e8a29e1a tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317e74b4bbc4da298a0dcbd78068352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a8810c21784788b4c0ee64dedbaf15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:26.344831 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-999de839-9938-4916-9de8-7a12e8a29e1a tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] 10.222.0.70 "GET /compute/v2.1/servers/7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8" status: 200 len: 1515 microversion: 2.1 time: 0.628202 Aug 27 02:53:26.345445 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1363/2718] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:25 2022] GET /compute/v2.1/servers/7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8 => generated 1515 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:26.353169 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-bf5bc07f-4162-4434-a50a-52d50951579f tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:26.353169 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-bf5bc07f-4162-4434-a50a-52d50951579f tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: 97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:26.368015 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bf5bc07f-4162-4434-a50a-52d50951579f tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:26.368540 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bf5bc07f-4162-4434-a50a-52d50951579f tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:26.368971 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bf5bc07f-4162-4434-a50a-52d50951579f tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:26.369689 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bf5bc07f-4162-4434-a50a-52d50951579f tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:26.370126 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bf5bc07f-4162-4434-a50a-52d50951579f tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:26.370537 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bf5bc07f-4162-4434-a50a-52d50951579f tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:26.663474 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-97fce1c4-edb0-454c-b0c6-818f8db5b9af tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:26.674644 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-97fce1c4-edb0-454c-b0c6-818f8db5b9af tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/a4aca2ed-a835-4f8f-96ae-c3502645425a" status: 200 len: 1535 microversion: 2.1 time: 0.520479 Aug 27 02:53:26.675421 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1356/2719] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:26 2022] GET /compute/v2.1/servers/a4aca2ed-a835-4f8f-96ae-c3502645425a => generated 1535 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:26.820444 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-bf5bc07f-4162-4434-a50a-52d50951579f tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:26.834756 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-bf5bc07f-4162-4434-a50a-52d50951579f tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4" status: 200 len: 1506 microversion: 2.1 time: 0.487930 Aug 27 02:53:26.835787 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1364/2720] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:26 2022] GET /compute/v2.1/servers/97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4 => generated 1506 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:27.070413 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-506860e1-5db2-4260-b4a2-9379dca3283f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:27.071338 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-506860e1-5db2-4260-b4a2-9379dca3283f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:27.080863 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-506860e1-5db2-4260-b4a2-9379dca3283f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:27.081672 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-506860e1-5db2-4260-b4a2-9379dca3283f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:27.082373 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-506860e1-5db2-4260-b4a2-9379dca3283f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:27.083235 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-506860e1-5db2-4260-b4a2-9379dca3283f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:27.084037 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-506860e1-5db2-4260-b4a2-9379dca3283f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:27.084537 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-506860e1-5db2-4260-b4a2-9379dca3283f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:27.106824 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0cb09a96-ab6e-41a6-a37f-0b8510844b10 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:27.108807 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-0cb09a96-ab6e-41a6-a37f-0b8510844b10 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] [instance: 546a5816-c2d9-494b-8c23-b0983cd11eb9] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:27.121887 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0cb09a96-ab6e-41a6-a37f-0b8510844b10 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:27.123704 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0cb09a96-ab6e-41a6-a37f-0b8510844b10 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:27.125853 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0cb09a96-ab6e-41a6-a37f-0b8510844b10 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:27.127042 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0cb09a96-ab6e-41a6-a37f-0b8510844b10 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:27.128866 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0cb09a96-ab6e-41a6-a37f-0b8510844b10 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:27.130930 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0cb09a96-ab6e-41a6-a37f-0b8510844b10 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:27.618652 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0cb09a96-ab6e-41a6-a37f-0b8510844b10 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f496f24dccea47bd9a5ab532fe45e370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40794f05e8b94a0f8f087a87a58e0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:27.635147 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-0cb09a96-ab6e-41a6-a37f-0b8510844b10 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "GET /compute/v2.1/servers/546a5816-c2d9-494b-8c23-b0983cd11eb9" status: 200 len: 1474 microversion: 2.1 time: 0.533350 Aug 27 02:53:27.636001 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1365/2721] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:27 2022] GET /compute/v2.1/servers/546a5816-c2d9-494b-8c23-b0983cd11eb9 => generated 1474 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:27.658280 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ba1e6aa7-6445-4c1e-8458-5b2b4c6ecd69 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:27.664592 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-ba1e6aa7-6445-4c1e-8458-5b2b4c6ecd69 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] [instance: 7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:27.697203 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ba1e6aa7-6445-4c1e-8458-5b2b4c6ecd69 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:27.697777 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ba1e6aa7-6445-4c1e-8458-5b2b4c6ecd69 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:27.706120 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ba1e6aa7-6445-4c1e-8458-5b2b4c6ecd69 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:27.707806 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ba1e6aa7-6445-4c1e-8458-5b2b4c6ecd69 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:27.708414 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ba1e6aa7-6445-4c1e-8458-5b2b4c6ecd69 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:27.708792 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ba1e6aa7-6445-4c1e-8458-5b2b4c6ecd69 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:27.751156 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-506860e1-5db2-4260-b4a2-9379dca3283f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:27.762544 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-506860e1-5db2-4260-b4a2-9379dca3283f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1668 microversion: 2.1 time: 0.696563 Aug 27 02:53:27.763275 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1357/2722] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:27 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1668 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:27.795387 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-e3a75919-c17a-4ecd-bf5c-3d38ed71abd6 req-a8d396ba-fd46-4284-b871-d183464c57fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4aca2ed-a835-4f8f-96ae-c3502645425a", "name": "network-vif-deleted", "tag": "4f9042c6-628d-483c-88dc-649ec8de9f53"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:53:27.844052 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-e3a75919-c17a-4ecd-bf5c-3d38ed71abd6 req-a8d396ba-fd46-4284-b871-d183464c57fe service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:27.849852 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-e3a75919-c17a-4ecd-bf5c-3d38ed71abd6 req-a8d396ba-fd46-4284-b871-d183464c57fe service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:27.855537 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-e3a75919-c17a-4ecd-bf5c-3d38ed71abd6 req-a8d396ba-fd46-4284-b871-d183464c57fe service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:27.915343 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-e3a75919-c17a-4ecd-bf5c-3d38ed71abd6 req-a8d396ba-fd46-4284-b871-d183464c57fe service nova] Creating event network-vif-deleted:4f9042c6-628d-483c-88dc-649ec8de9f53 for instance a4aca2ed-a835-4f8f-96ae-c3502645425a on n-h2-852278-4 Aug 27 02:53:27.931719 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-e3a75919-c17a-4ecd-bf5c-3d38ed71abd6 req-a8d396ba-fd46-4284-b871-d183464c57fe service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145807 Aug 27 02:53:27.934023 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1358/2723] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:53:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:53:27.944793 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d55fbca8-bb8a-4bd5-ab5e-73f0cfaa3069 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1018645054"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:53:27.950865 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d55fbca8-bb8a-4bd5-ab5e-73f0cfaa3069 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] [instance: 546a5816-c2d9-494b-8c23-b0983cd11eb9] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:27.970442 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d55fbca8-bb8a-4bd5-ab5e-73f0cfaa3069 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:27.971352 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d55fbca8-bb8a-4bd5-ab5e-73f0cfaa3069 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:27.972030 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d55fbca8-bb8a-4bd5-ab5e-73f0cfaa3069 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:27.973034 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d55fbca8-bb8a-4bd5-ab5e-73f0cfaa3069 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:27.976733 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d55fbca8-bb8a-4bd5-ab5e-73f0cfaa3069 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:27.977433 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d55fbca8-bb8a-4bd5-ab5e-73f0cfaa3069 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:28.137537 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-ba1e6aa7-6445-4c1e-8458-5b2b4c6ecd69 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317e74b4bbc4da298a0dcbd78068352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a8810c21784788b4c0ee64dedbaf15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:28.164981 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ba1e6aa7-6445-4c1e-8458-5b2b4c6ecd69 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] 10.222.0.70 "GET /compute/v2.1/servers/7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8" status: 200 len: 1515 microversion: 2.1 time: 0.527222 Aug 27 02:53:28.171012 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1366/2724] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:27 2022] GET /compute/v2.1/servers/7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8 => generated 1515 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:28.187028 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9b56ae53-a5d4-45ab-8ac5-4918b74206d5 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:28.187748 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-9b56ae53-a5d4-45ab-8ac5-4918b74206d5 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: a4aca2ed-a835-4f8f-96ae-c3502645425a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:28.214659 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9b56ae53-a5d4-45ab-8ac5-4918b74206d5 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:28.215361 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9b56ae53-a5d4-45ab-8ac5-4918b74206d5 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:28.216224 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9b56ae53-a5d4-45ab-8ac5-4918b74206d5 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:28.217280 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9b56ae53-a5d4-45ab-8ac5-4918b74206d5 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:28.218004 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9b56ae53-a5d4-45ab-8ac5-4918b74206d5 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:28.220256 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9b56ae53-a5d4-45ab-8ac5-4918b74206d5 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:28.290675 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9b56ae53-a5d4-45ab-8ac5-4918b74206d5 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:28.314096 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9b56ae53-a5d4-45ab-8ac5-4918b74206d5 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:28.315953 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9b56ae53-a5d4-45ab-8ac5-4918b74206d5 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:28.317374 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.instance [None req-9b56ae53-a5d4-45ab-8ac5-4918b74206d5 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lazy-loading 'fault' on Instance uuid a4aca2ed-a835-4f8f-96ae-c3502645425a {{(pid=134052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:53:28.466960 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-9b56ae53-a5d4-45ab-8ac5-4918b74206d5 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:28.485468 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9b56ae53-a5d4-45ab-8ac5-4918b74206d5 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/a4aca2ed-a835-4f8f-96ae-c3502645425a" status: 200 len: 1369 microversion: 2.1 time: 0.312023 Aug 27 02:53:28.487832 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d55fbca8-bb8a-4bd5-ab5e-73f0cfaa3069 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "POST /compute/v2.1/servers/546a5816-c2d9-494b-8c23-b0983cd11eb9/action" status: 202 len: 0 microversion: 2.1 time: 0.551399 Aug 27 02:53:28.493912 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1359/2725] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 02:53:27 2022] POST /compute/v2.1/servers/546a5816-c2d9-494b-8c23-b0983cd11eb9/action => generated 0 bytes in 554 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 27 02:53:28.501344 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1367/2726] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:28 2022] GET /compute/v2.1/servers/a4aca2ed-a835-4f8f-96ae-c3502645425a => generated 1369 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:28.508285 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-53a51e86-1dd6-4231-9bf7-8380c4191006 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:28.508974 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-53a51e86-1dd6-4231-9bf7-8380c4191006 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: 97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:28.512974 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-5cd13d6d-c830-4895-939a-4d88a8fe2dd3 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:28.513973 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-5cd13d6d-c830-4895-939a-4d88a8fe2dd3 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:28.525916 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-53a51e86-1dd6-4231-9bf7-8380c4191006 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:28.526418 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-53a51e86-1dd6-4231-9bf7-8380c4191006 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:28.530948 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-53a51e86-1dd6-4231-9bf7-8380c4191006 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:28.533016 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-53a51e86-1dd6-4231-9bf7-8380c4191006 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:28.535715 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-53a51e86-1dd6-4231-9bf7-8380c4191006 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:28.536407 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-53a51e86-1dd6-4231-9bf7-8380c4191006 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:28.540965 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5cd13d6d-c830-4895-939a-4d88a8fe2dd3 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:28.541523 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5cd13d6d-c830-4895-939a-4d88a8fe2dd3 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:28.541977 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5cd13d6d-c830-4895-939a-4d88a8fe2dd3 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:28.542731 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5cd13d6d-c830-4895-939a-4d88a8fe2dd3 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:28.543190 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5cd13d6d-c830-4895-939a-4d88a8fe2dd3 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:28.543619 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5cd13d6d-c830-4895-939a-4d88a8fe2dd3 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:28.909711 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-53a51e86-1dd6-4231-9bf7-8380c4191006 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:28.922505 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-53a51e86-1dd6-4231-9bf7-8380c4191006 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4" status: 200 len: 1506 microversion: 2.1 time: 0.418653 Aug 27 02:53:28.925021 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1368/2727] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:28 2022] GET /compute/v2.1/servers/97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4 => generated 1506 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:28.939534 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-66746561-1d4c-4b45-b674-f2e0f7698540 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '.version_select at 0x7f5ee2f811f0>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:29.049297 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-5cd13d6d-c830-4895-939a-4d88a8fe2dd3 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:29.057928 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-66746561-1d4c-4b45-b674-f2e0f7698540 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "GET /compute/v2.1/images/50103730-0d32-4451-b672-ca0cdb239f81" status: 200 len: 1412 microversion: 2.1 time: 0.127161 Aug 27 02:53:29.059492 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-5cd13d6d-c830-4895-939a-4d88a8fe2dd3 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1668 microversion: 2.1 time: 0.560801 Aug 27 02:53:29.060076 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1360/2728] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:28 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1668 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:29.063432 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1369/2729] 10.222.0.70 () {58 vars in 1233 bytes} [Sat Aug 27 02:53:28 2022] GET /compute/v2.1/images/50103730-0d32-4451-b672-ca0cdb239f81 => generated 1412 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:29.080583 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-957338b3-c2f0-4867-88e9-f891406ea2d8 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:29.081526 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-957338b3-c2f0-4867-88e9-f891406ea2d8 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:29.088699 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-957338b3-c2f0-4867-88e9-f891406ea2d8 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:29.089487 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-957338b3-c2f0-4867-88e9-f891406ea2d8 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:29.090121 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-957338b3-c2f0-4867-88e9-f891406ea2d8 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:29.091050 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-957338b3-c2f0-4867-88e9-f891406ea2d8 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:29.091697 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-957338b3-c2f0-4867-88e9-f891406ea2d8 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:29.093658 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-957338b3-c2f0-4867-88e9-f891406ea2d8 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:29.193053 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-2a7d9af0-487c-4831-9330-62fd8a4f0ab7 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:29.194015 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-2a7d9af0-487c-4831-9330-62fd8a4f0ab7 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] [instance: 7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:29.208350 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2a7d9af0-487c-4831-9330-62fd8a4f0ab7 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:29.214372 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2a7d9af0-487c-4831-9330-62fd8a4f0ab7 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:29.216448 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2a7d9af0-487c-4831-9330-62fd8a4f0ab7 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:29.218864 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2a7d9af0-487c-4831-9330-62fd8a4f0ab7 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:29.219370 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2a7d9af0-487c-4831-9330-62fd8a4f0ab7 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:29.219811 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2a7d9af0-487c-4831-9330-62fd8a4f0ab7 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:29.279295 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:53:29.472161 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-957338b3-c2f0-4867-88e9-f891406ea2d8 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:29.487076 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-957338b3-c2f0-4867-88e9-f891406ea2d8 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1668 microversion: 2.1 time: 0.406381 Aug 27 02:53:29.488524 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1370/2730] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:29 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1668 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:29.509013 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8affb74f-d6c3-46d2-bb4b-f8d7d4b83729 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:29.510000 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-8affb74f-d6c3-46d2-bb4b-f8d7d4b83729 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: a4aca2ed-a835-4f8f-96ae-c3502645425a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:29.521450 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8affb74f-d6c3-46d2-bb4b-f8d7d4b83729 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:29.522271 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8affb74f-d6c3-46d2-bb4b-f8d7d4b83729 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:29.522955 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8affb74f-d6c3-46d2-bb4b-f8d7d4b83729 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:29.525511 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8affb74f-d6c3-46d2-bb4b-f8d7d4b83729 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:29.527044 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8affb74f-d6c3-46d2-bb4b-f8d7d4b83729 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:29.530104 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8affb74f-d6c3-46d2-bb4b-f8d7d4b83729 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:29.542795 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-2a7d9af0-487c-4831-9330-62fd8a4f0ab7 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317e74b4bbc4da298a0dcbd78068352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a8810c21784788b4c0ee64dedbaf15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:29.576543 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-2a7d9af0-487c-4831-9330-62fd8a4f0ab7 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] 10.222.0.70 "GET /compute/v2.1/servers/7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8" status: 200 len: 1515 microversion: 2.1 time: 0.387417 Aug 27 02:53:29.577516 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1361/2731] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:29 2022] GET /compute/v2.1/servers/7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8 => generated 1515 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:53:29.596565 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-8affb74f-d6c3-46d2-bb4b-f8d7d4b83729 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] HTTP exception thrown: Instance a4aca2ed-a835-4f8f-96ae-c3502645425a could not be found. Aug 27 02:53:29.598443 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8affb74f-d6c3-46d2-bb4b-f8d7d4b83729 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Request method failure captured: Aug 27 02:53:29.598443 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/servers/a4aca2ed-a835-4f8f-96ae-c3502645425a HTTP/1.1 Aug 27 02:53:29.598443 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:53:29.598443 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:53:29.598443 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:53:29.598443 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:53:29.598443 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:53:29.598443 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:53:29.598443 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:53:29.598443 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:53:29.598443 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYXV0r3jGUq47WLGtKQpD2GT6ZaucKLj1FHCRVWh7FmbJ46ArZdeI2i4KuIQK6o7gnteOdnBxpMeNOLKzoZIrvG7jVXHSKepr0w2IF9adZg6La101vR9uA7o3L_hdEWDLnTX4lG6KD99R14eN8P3ngENHLfo1gbuvR2cMcQDOiaqQnU Aug 27 02:53:29.598443 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:53:29.598443 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:53:29.598443 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:53:29.598443 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:53:29.598443 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:53:29.598443 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:53:29.598443 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 937a5eeccaa7425ca72c8c74fb99f11a Aug 27 02:53:29.598443 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-MigrationsAdminTest-893175282 Aug 27 02:53:29.598443 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:53:29.598443 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:53:29.598443 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/937a5eeccaa7425ca72c8c74fb99f11a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_937a5eeccaa7425ca72c8c74fb99f11a", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/937a5eeccaa7425ca72c8c74fb99f11a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/937a5eeccaa7425ca72c8c74fb99f11a"}]}] Aug 27 02:53:29.598443 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-MigrationsAdminTest-893175282 Aug 27 02:53:29.598443 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 937a5eeccaa7425ca72c8c74fb99f11a Aug 27 02:53:29.598443 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-MigrationsAdminTest-893175282 Aug 27 02:53:29.598443 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-MigrationsAdminTest-893175282-project Aug 27 02:53:29.598443 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:53:29.598443 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:53:29.598443 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 0b310e73ecd244d2938812d5be99558c Aug 27 02:53:29.598443 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-MigrationsAdminTest-893175282-project Aug 27 02:53:29.598443 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 02:53:29.598443 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance a4aca2ed-a835-4f8f-96ae-c3502645425a could not be found. Aug 27 02:53:29.598443 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': 'a4aca2ed-a835-4f8f-96ae-c3502645425a'} Aug 27 02:53:29.598443 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:53:29.598443 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:53:29.598443 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:53:29.598443 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:53:29.598443 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:53:29.598443 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:53:29.598443 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:53:29.598443 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:53:29.598443 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:53:29.598443 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:53:29.598443 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4aca2ed-a835-4f8f-96ae-c3502645425a could not be found. Aug 27 02:53:29.598443 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:53:29.598443 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:53:29.598443 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:53:29.598443 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:53:29.598443 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:53:29.598443 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:53:29.598443 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:53:29.598443 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:53:29.598443 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:53:29.598443 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:53:29.598443 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:53:29.598443 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:53:29.598443 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:53:29.598443 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:53:29.598443 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:53:29.598443 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:53:29.598443 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4aca2ed-a835-4f8f-96ae-c3502645425a could not be found. Aug 27 02:53:29.598443 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:53:29.598443 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:53:29.598443 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:53:29.602796 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:53:29.602796 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:53:29.602796 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:53:29.602796 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:53:29.602796 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:53:29.602796 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4aca2ed-a835-4f8f-96ae-c3502645425a could not be found. Aug 27 02:53:29.602796 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:53:29.603482 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-fd194c87-f864-48e2-a30b-bed1ed66e8a6 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:53:29.605300 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8affb74f-d6c3-46d2-bb4b-f8d7d4b83729 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Returning 404 to user: Instance a4aca2ed-a835-4f8f-96ae-c3502645425a could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:53:29.606088 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-fd194c87-f864-48e2-a30b-bed1ed66e8a6 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:29.606719 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-8affb74f-d6c3-46d2-bb4b-f8d7d4b83729 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/a4aca2ed-a835-4f8f-96ae-c3502645425a" status: 404 len: 111 microversion: 2.1 time: 0.102087 Aug 27 02:53:29.607669 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1371/2732] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:29 2022] GET /compute/v2.1/servers/a4aca2ed-a835-4f8f-96ae-c3502645425a => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:53:29.620601 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e0cb33c5-07f3-4400-9d04-1da4abf7877b tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '.version_select at 0x7f5ee2f94e50>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:29.633125 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fd194c87-f864-48e2-a30b-bed1ed66e8a6 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:29.636039 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fd194c87-f864-48e2-a30b-bed1ed66e8a6 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:29.636760 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fd194c87-f864-48e2-a30b-bed1ed66e8a6 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:29.638847 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fd194c87-f864-48e2-a30b-bed1ed66e8a6 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:29.655796 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fd194c87-f864-48e2-a30b-bed1ed66e8a6 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:29.657478 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fd194c87-f864-48e2-a30b-bed1ed66e8a6 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:29.685641 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e0cb33c5-07f3-4400-9d04-1da4abf7877b tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-509792707" status: 202 len: 0 microversion: 2.1 time: 0.072194 Aug 27 02:53:29.687771 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1372/2733] 10.222.0.70 () {58 vars in 1218 bytes} [Sat Aug 27 02:53:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-509792707 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:53:29.826136 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-fd194c87-f864-48e2-a30b-bed1ed66e8a6 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "POST /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd/action" status: 202 len: 0 microversion: 2.1 time: 0.247146 Aug 27 02:53:29.829134 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1362/2734] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 02:53:29 2022] POST /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd/action => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:53:29.837162 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-07cbd279-36f9-48d4-9899-70ad5db20807 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:29.837770 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-07cbd279-36f9-48d4-9899-70ad5db20807 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:29.851734 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-07cbd279-36f9-48d4-9899-70ad5db20807 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:29.855825 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-07cbd279-36f9-48d4-9899-70ad5db20807 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:29.857432 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-07cbd279-36f9-48d4-9899-70ad5db20807 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:29.858552 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-07cbd279-36f9-48d4-9899-70ad5db20807 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:29.859976 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-07cbd279-36f9-48d4-9899-70ad5db20807 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:29.861870 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-07cbd279-36f9-48d4-9899-70ad5db20807 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:29.951498 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-6b239032-0e68-469d-b569-209fe9172977 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:29.952722 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-6b239032-0e68-469d-b569-209fe9172977 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: 97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:29.967185 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6b239032-0e68-469d-b569-209fe9172977 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:29.973823 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6b239032-0e68-469d-b569-209fe9172977 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:29.975416 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6b239032-0e68-469d-b569-209fe9172977 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:29.976760 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6b239032-0e68-469d-b569-209fe9172977 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:29.977447 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6b239032-0e68-469d-b569-209fe9172977 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:29.978086 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6b239032-0e68-469d-b569-209fe9172977 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:30.481658 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-07cbd279-36f9-48d4-9899-70ad5db20807 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:30.496373 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-07cbd279-36f9-48d4-9899-70ad5db20807 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1670 microversion: 2.1 time: 0.660096 Aug 27 02:53:30.497043 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1373/2735] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:29 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1670 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:30.508768 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-75121058-d824-44e2-92a1-9b297237c883 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '.version_select at 0x7f5ee2e130d0>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:30.606606 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-75121058-d824-44e2-92a1-9b297237c883 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "GET /compute/v2.1/images/50103730-0d32-4451-b672-ca0cdb239f81" status: 200 len: 1412 microversion: 2.1 time: 0.105318 Aug 27 02:53:30.607267 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1374/2736] 10.222.0.70 () {58 vars in 1233 bytes} [Sat Aug 27 02:53:30 2022] GET /compute/v2.1/images/50103730-0d32-4451-b672-ca0cdb239f81 => generated 1412 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:30.620558 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-981fcaca-11dc-4cf2-b6a4-89388554dc50 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:30.621253 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-981fcaca-11dc-4cf2-b6a4-89388554dc50 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] [instance: 7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:30.633469 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-981fcaca-11dc-4cf2-b6a4-89388554dc50 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:30.633945 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-981fcaca-11dc-4cf2-b6a4-89388554dc50 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:30.634395 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-981fcaca-11dc-4cf2-b6a4-89388554dc50 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:30.635109 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-981fcaca-11dc-4cf2-b6a4-89388554dc50 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:30.635557 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-981fcaca-11dc-4cf2-b6a4-89388554dc50 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:30.635982 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-981fcaca-11dc-4cf2-b6a4-89388554dc50 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:30.654313 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-6b239032-0e68-469d-b569-209fe9172977 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:30.665106 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-6b239032-0e68-469d-b569-209fe9172977 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4" status: 200 len: 1506 microversion: 2.1 time: 0.719929 Aug 27 02:53:30.669243 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1363/2737] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:29 2022] GET /compute/v2.1/servers/97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4 => generated 1506 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:31.033080 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-981fcaca-11dc-4cf2-b6a4-89388554dc50 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317e74b4bbc4da298a0dcbd78068352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a8810c21784788b4c0ee64dedbaf15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:31.054389 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-981fcaca-11dc-4cf2-b6a4-89388554dc50 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] 10.222.0.70 "GET /compute/v2.1/servers/7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8" status: 200 len: 1515 microversion: 2.1 time: 0.444550 Aug 27 02:53:31.054994 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1375/2738] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:30 2022] GET /compute/v2.1/servers/7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8 => generated 1515 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:31.522124 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-66072b82-8e5b-4377-b910-a1f5cb41aaa1 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:31.522814 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-66072b82-8e5b-4377-b910-a1f5cb41aaa1 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:31.541200 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-66072b82-8e5b-4377-b910-a1f5cb41aaa1 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:31.542026 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-66072b82-8e5b-4377-b910-a1f5cb41aaa1 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:31.542636 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-66072b82-8e5b-4377-b910-a1f5cb41aaa1 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:31.543562 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-66072b82-8e5b-4377-b910-a1f5cb41aaa1 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:31.544458 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-66072b82-8e5b-4377-b910-a1f5cb41aaa1 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:31.545033 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-66072b82-8e5b-4377-b910-a1f5cb41aaa1 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:31.623855 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-34a620b4-286a-4ad3-90a4-bfc1d11e1ad0 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '.version_select at 0x7f5ee2e13790>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:32.072172 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-66072b82-8e5b-4377-b910-a1f5cb41aaa1 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:32.086895 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-66072b82-8e5b-4377-b910-a1f5cb41aaa1 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1670 microversion: 2.1 time: 0.569084 Aug 27 02:53:32.102664 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1364/2739] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:31 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1670 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:32.118289 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3424ec53-a36d-401b-8f19-d578028efde2 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:32.118967 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-3424ec53-a36d-401b-8f19-d578028efde2 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: 97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:32.127686 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3424ec53-a36d-401b-8f19-d578028efde2 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:32.128840 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3424ec53-a36d-401b-8f19-d578028efde2 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:32.129549 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3424ec53-a36d-401b-8f19-d578028efde2 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:32.130557 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3424ec53-a36d-401b-8f19-d578028efde2 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:32.131173 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3424ec53-a36d-401b-8f19-d578028efde2 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:32.132865 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3424ec53-a36d-401b-8f19-d578028efde2 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:32.331483 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-34a620b4-286a-4ad3-90a4-bfc1d11e1ad0 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "GET /compute/v2.1/images/50103730-0d32-4451-b672-ca0cdb239f81" status: 200 len: 1412 microversion: 2.1 time: 0.712685 Aug 27 02:53:32.335305 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1376/2740] 10.222.0.70 () {58 vars in 1233 bytes} [Sat Aug 27 02:53:31 2022] GET /compute/v2.1/images/50103730-0d32-4451-b672-ca0cdb239f81 => generated 1412 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:32.366432 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-175d5d39-b766-4f4f-943f-d6cfb8e71f35 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:32.367084 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-175d5d39-b766-4f4f-943f-d6cfb8e71f35 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] [instance: 7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:32.414598 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-175d5d39-b766-4f4f-943f-d6cfb8e71f35 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:32.422820 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-175d5d39-b766-4f4f-943f-d6cfb8e71f35 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:32.431250 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-175d5d39-b766-4f4f-943f-d6cfb8e71f35 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:32.434955 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-175d5d39-b766-4f4f-943f-d6cfb8e71f35 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:32.435649 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-175d5d39-b766-4f4f-943f-d6cfb8e71f35 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:32.437303 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-175d5d39-b766-4f4f-943f-d6cfb8e71f35 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:32.654900 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-3424ec53-a36d-401b-8f19-d578028efde2 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:32.669490 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-3424ec53-a36d-401b-8f19-d578028efde2 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4" status: 200 len: 1506 microversion: 2.1 time: 0.562052 Aug 27 02:53:32.674430 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1365/2741] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:32 2022] GET /compute/v2.1/servers/97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4 => generated 1506 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:32.685137 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3bbb6e32-b05b-4639-a867-47b81a083c9d tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:32.689940 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-3bbb6e32-b05b-4639-a867-47b81a083c9d tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: cac17f47-6e08-4f15-a8cf-f5e44ad03d12] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:32.710149 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3bbb6e32-b05b-4639-a867-47b81a083c9d tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:32.710957 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3bbb6e32-b05b-4639-a867-47b81a083c9d tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:32.713129 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3bbb6e32-b05b-4639-a867-47b81a083c9d tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:32.714174 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3bbb6e32-b05b-4639-a867-47b81a083c9d tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:32.715036 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3bbb6e32-b05b-4639-a867-47b81a083c9d tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:32.717104 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3bbb6e32-b05b-4639-a867-47b81a083c9d tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:32.796898 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-3bbb6e32-b05b-4639-a867-47b81a083c9d tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: cac17f47-6e08-4f15-a8cf-f5e44ad03d12] Going to try to terminate instance {{(pid=134051) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:53:32.887889 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-175d5d39-b766-4f4f-943f-d6cfb8e71f35 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317e74b4bbc4da298a0dcbd78068352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a8810c21784788b4c0ee64dedbaf15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:32.900804 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-175d5d39-b766-4f4f-943f-d6cfb8e71f35 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] 10.222.0.70 "GET /compute/v2.1/servers/7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8" status: 200 len: 1515 microversion: 2.1 time: 0.563839 Aug 27 02:53:32.901532 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1377/2742] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:32 2022] GET /compute/v2.1/servers/7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8 => generated 1515 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:33.023780 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-3bbb6e32-b05b-4639-a867-47b81a083c9d tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "DELETE /compute/v2.1/servers/cac17f47-6e08-4f15-a8cf-f5e44ad03d12" status: 204 len: 0 microversion: 2.1 time: 0.347630 Aug 27 02:53:33.027784 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1366/2743] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:53:32 2022] DELETE /compute/v2.1/servers/cac17f47-6e08-4f15-a8cf-f5e44ad03d12 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:53:33.035563 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-44bf13ce-d204-4840-9771-17a419449627 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:33.035563 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-44bf13ce-d204-4840-9771-17a419449627 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: cac17f47-6e08-4f15-a8cf-f5e44ad03d12] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:33.047076 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-44bf13ce-d204-4840-9771-17a419449627 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:33.053797 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-44bf13ce-d204-4840-9771-17a419449627 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:33.054390 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-44bf13ce-d204-4840-9771-17a419449627 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:33.055350 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-44bf13ce-d204-4840-9771-17a419449627 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:33.055829 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-44bf13ce-d204-4840-9771-17a419449627 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:33.056399 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-44bf13ce-d204-4840-9771-17a419449627 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:33.116333 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d5e1161a-be9f-4a39-8878-5ba1937a198c tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:33.117659 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d5e1161a-be9f-4a39-8878-5ba1937a198c tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:33.133279 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d5e1161a-be9f-4a39-8878-5ba1937a198c tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:33.134197 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d5e1161a-be9f-4a39-8878-5ba1937a198c tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:33.134971 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d5e1161a-be9f-4a39-8878-5ba1937a198c tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:33.137952 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d5e1161a-be9f-4a39-8878-5ba1937a198c tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:33.140560 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d5e1161a-be9f-4a39-8878-5ba1937a198c tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:33.141013 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d5e1161a-be9f-4a39-8878-5ba1937a198c tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:33.409312 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-44bf13ce-d204-4840-9771-17a419449627 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:33.427542 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-44bf13ce-d204-4840-9771-17a419449627 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/cac17f47-6e08-4f15-a8cf-f5e44ad03d12" status: 200 len: 1467 microversion: 2.1 time: 0.398268 Aug 27 02:53:33.428152 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1378/2744] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:33 2022] GET /compute/v2.1/servers/cac17f47-6e08-4f15-a8cf-f5e44ad03d12 => generated 1467 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:33.440970 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c2d1060a-a648-466e-bf94-b7091fcb6cb9 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '.version_select at 0x7f5ee2f7e310>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:33.469952 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d5e1161a-be9f-4a39-8878-5ba1937a198c tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:33.494697 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d5e1161a-be9f-4a39-8878-5ba1937a198c tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1668 microversion: 2.1 time: 0.384080 Aug 27 02:53:33.496838 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1367/2745] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:33 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1668 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:53:33.521220 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-9bb579aa-776d-4f56-911b-cd5f1e8d5b6e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:53:33.524893 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-9bb579aa-776d-4f56-911b-cd5f1e8d5b6e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:33.543375 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9bb579aa-776d-4f56-911b-cd5f1e8d5b6e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:33.543876 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9bb579aa-776d-4f56-911b-cd5f1e8d5b6e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:33.545065 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9bb579aa-776d-4f56-911b-cd5f1e8d5b6e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:33.564753 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9bb579aa-776d-4f56-911b-cd5f1e8d5b6e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:33.565277 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9bb579aa-776d-4f56-911b-cd5f1e8d5b6e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:33.565691 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9bb579aa-776d-4f56-911b-cd5f1e8d5b6e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:34.206220 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-9bb579aa-776d-4f56-911b-cd5f1e8d5b6e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "POST /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd/action" status: 200 len: 322 microversion: 2.1 time: 0.693655 Aug 27 02:53:34.208168 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1368/2746] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 02:53:33 2022] POST /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd/action => generated 322 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:53:34.218067 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3f828586-c448-4cd7-bfae-dc00dcc3adbc tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:34.220595 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-3f828586-c448-4cd7-bfae-dc00dcc3adbc tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: 97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:34.245570 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3f828586-c448-4cd7-bfae-dc00dcc3adbc tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:34.247326 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3f828586-c448-4cd7-bfae-dc00dcc3adbc tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:34.248256 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3f828586-c448-4cd7-bfae-dc00dcc3adbc tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:34.249724 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3f828586-c448-4cd7-bfae-dc00dcc3adbc tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:34.250821 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3f828586-c448-4cd7-bfae-dc00dcc3adbc tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:34.251874 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3f828586-c448-4cd7-bfae-dc00dcc3adbc tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:34.533441 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-3f828586-c448-4cd7-bfae-dc00dcc3adbc tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:34.560879 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-3f828586-c448-4cd7-bfae-dc00dcc3adbc tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4" status: 200 len: 1506 microversion: 2.1 time: 0.350784 Aug 27 02:53:34.562690 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1369/2747] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:34 2022] GET /compute/v2.1/servers/97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4 => generated 1506 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:34.580988 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a7923bb4-36f9-416d-8b80-b3c418e2c25d tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:34.582503 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-a7923bb4-36f9-416d-8b80-b3c418e2c25d tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] [instance: 7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:34.591519 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a7923bb4-36f9-416d-8b80-b3c418e2c25d tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:34.592726 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a7923bb4-36f9-416d-8b80-b3c418e2c25d tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:34.593934 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a7923bb4-36f9-416d-8b80-b3c418e2c25d tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:34.596090 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a7923bb4-36f9-416d-8b80-b3c418e2c25d tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:34.596813 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a7923bb4-36f9-416d-8b80-b3c418e2c25d tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:34.597431 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a7923bb4-36f9-416d-8b80-b3c418e2c25d tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:34.885187 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-a7923bb4-36f9-416d-8b80-b3c418e2c25d tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317e74b4bbc4da298a0dcbd78068352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a8810c21784788b4c0ee64dedbaf15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:34.897744 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a7923bb4-36f9-416d-8b80-b3c418e2c25d tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] 10.222.0.70 "GET /compute/v2.1/servers/7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8" status: 200 len: 1515 microversion: 2.1 time: 0.331160 Aug 27 02:53:34.900549 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1370/2748] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:34 2022] GET /compute/v2.1/servers/7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8 => generated 1515 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:34.912513 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-da7f3083-431b-4efe-8cac-f0fe21441436 req-f0e3d08e-30df-49c0-a3e8-699873b0937b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "546a5816-c2d9-494b-8c23-b0983cd11eb9", "name": "network-vif-plugged", "status": "completed", "tag": "2efb5816-4d86-45f2-a90e-53904afe8489"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:53:34.950008 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-da7f3083-431b-4efe-8cac-f0fe21441436 req-f0e3d08e-30df-49c0-a3e8-699873b0937b service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:34.953890 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-da7f3083-431b-4efe-8cac-f0fe21441436 req-f0e3d08e-30df-49c0-a3e8-699873b0937b service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:34.954334 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-da7f3083-431b-4efe-8cac-f0fe21441436 req-f0e3d08e-30df-49c0-a3e8-699873b0937b service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:34.971174 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-da7f3083-431b-4efe-8cac-f0fe21441436 req-f0e3d08e-30df-49c0-a3e8-699873b0937b service nova] Creating event network-vif-plugged:2efb5816-4d86-45f2-a90e-53904afe8489 for instance 546a5816-c2d9-494b-8c23-b0983cd11eb9 on n-h2-852278-4 Aug 27 02:53:34.977200 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-da7f3083-431b-4efe-8cac-f0fe21441436 req-f0e3d08e-30df-49c0-a3e8-699873b0937b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074607 Aug 27 02:53:34.978551 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1371/2749] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:53:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:53:34.986053 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3587d28c-dbc2-4a4c-bc0e-f15a3c37e8d0 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:34.986986 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-3587d28c-dbc2-4a4c-bc0e-f15a3c37e8d0 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:34.997344 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3587d28c-dbc2-4a4c-bc0e-f15a3c37e8d0 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:34.998971 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3587d28c-dbc2-4a4c-bc0e-f15a3c37e8d0 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:34.999605 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3587d28c-dbc2-4a4c-bc0e-f15a3c37e8d0 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:35.000713 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3587d28c-dbc2-4a4c-bc0e-f15a3c37e8d0 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:35.001320 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3587d28c-dbc2-4a4c-bc0e-f15a3c37e8d0 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:35.002227 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3587d28c-dbc2-4a4c-bc0e-f15a3c37e8d0 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:35.401139 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-3587d28c-dbc2-4a4c-bc0e-f15a3c37e8d0 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:35.414179 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-3587d28c-dbc2-4a4c-bc0e-f15a3c37e8d0 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1668 microversion: 2.1 time: 0.434179 Aug 27 02:53:35.417937 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1372/2750] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:34 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1668 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:35.423423 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-5f173ab8-efd6-41e6-86ff-7eef1317fea6 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:35.424253 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-5f173ab8-efd6-41e6-86ff-7eef1317fea6 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: cac17f47-6e08-4f15-a8cf-f5e44ad03d12] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:35.437561 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5f173ab8-efd6-41e6-86ff-7eef1317fea6 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:35.440931 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5f173ab8-efd6-41e6-86ff-7eef1317fea6 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:35.443901 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5f173ab8-efd6-41e6-86ff-7eef1317fea6 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:35.445784 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5f173ab8-efd6-41e6-86ff-7eef1317fea6 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:35.447460 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5f173ab8-efd6-41e6-86ff-7eef1317fea6 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:35.451366 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5f173ab8-efd6-41e6-86ff-7eef1317fea6 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:35.654655 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-5f173ab8-efd6-41e6-86ff-7eef1317fea6 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b310e73ecd244d2938812d5be99558c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937a5eeccaa7425ca72c8c74fb99f11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:35.665376 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-5f173ab8-efd6-41e6-86ff-7eef1317fea6 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/cac17f47-6e08-4f15-a8cf-f5e44ad03d12" status: 200 len: 1425 microversion: 2.1 time: 0.245779 Aug 27 02:53:35.665753 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1373/2751] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:35 2022] GET /compute/v2.1/servers/cac17f47-6e08-4f15-a8cf-f5e44ad03d12 => generated 1425 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:35.683634 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-cb9d19c5-39e6-41fc-a507-031e5bac0d86 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:35.688886 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-cb9d19c5-39e6-41fc-a507-031e5bac0d86 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:35.713631 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cb9d19c5-39e6-41fc-a507-031e5bac0d86 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:35.716631 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cb9d19c5-39e6-41fc-a507-031e5bac0d86 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:35.717303 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cb9d19c5-39e6-41fc-a507-031e5bac0d86 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:35.720220 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cb9d19c5-39e6-41fc-a507-031e5bac0d86 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:35.722176 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cb9d19c5-39e6-41fc-a507-031e5bac0d86 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:35.724075 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cb9d19c5-39e6-41fc-a507-031e5bac0d86 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:36.095102 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-cb9d19c5-39e6-41fc-a507-031e5bac0d86 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:36.106718 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-cb9d19c5-39e6-41fc-a507-031e5bac0d86 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1668 microversion: 2.1 time: 0.435652 Aug 27 02:53:36.108266 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1374/2752] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:35 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1668 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:36.126928 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-55813023-3049-4924-a2f4-e7bbe2d4a20f tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:36.128423 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-55813023-3049-4924-a2f4-e7bbe2d4a20f tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: 97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:36.146536 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-55813023-3049-4924-a2f4-e7bbe2d4a20f tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:36.147342 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-55813023-3049-4924-a2f4-e7bbe2d4a20f tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:36.148897 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-55813023-3049-4924-a2f4-e7bbe2d4a20f tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:36.149886 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-55813023-3049-4924-a2f4-e7bbe2d4a20f tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:36.150544 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-55813023-3049-4924-a2f4-e7bbe2d4a20f tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:36.151120 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-55813023-3049-4924-a2f4-e7bbe2d4a20f tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:36.474561 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-55813023-3049-4924-a2f4-e7bbe2d4a20f tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:36.498135 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-55813023-3049-4924-a2f4-e7bbe2d4a20f tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4" status: 200 len: 1506 microversion: 2.1 time: 0.386460 Aug 27 02:53:36.500794 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1375/2753] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:36 2022] GET /compute/v2.1/servers/97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4 => generated 1506 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:36.515147 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-d4f59800-eed8-4563-b10a-7542466a46e6 req-82d8984e-59f4-4101-85a9-82fbe795d2ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cac17f47-6e08-4f15-a8cf-f5e44ad03d12", "name": "network-vif-deleted", "tag": "7d0fd053-123c-4222-8389-3499f91d9b8c"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:53:36.527719 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-d4f59800-eed8-4563-b10a-7542466a46e6 req-82d8984e-59f4-4101-85a9-82fbe795d2ef service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:36.528518 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-d4f59800-eed8-4563-b10a-7542466a46e6 req-82d8984e-59f4-4101-85a9-82fbe795d2ef service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:36.529191 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-d4f59800-eed8-4563-b10a-7542466a46e6 req-82d8984e-59f4-4101-85a9-82fbe795d2ef service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:36.569135 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-d4f59800-eed8-4563-b10a-7542466a46e6 req-82d8984e-59f4-4101-85a9-82fbe795d2ef service nova] Creating event network-vif-deleted:7d0fd053-123c-4222-8389-3499f91d9b8c for instance cac17f47-6e08-4f15-a8cf-f5e44ad03d12 on n-h1-852278-4 Aug 27 02:53:36.578040 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-d4f59800-eed8-4563-b10a-7542466a46e6 req-82d8984e-59f4-4101-85a9-82fbe795d2ef service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075240 Aug 27 02:53:36.579335 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1376/2754] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:53:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:53:36.590463 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f112b57e-2bf4-40a8-9992-da38853a55e0 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:36.594954 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-f112b57e-2bf4-40a8-9992-da38853a55e0 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] [instance: 7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:36.607818 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f112b57e-2bf4-40a8-9992-da38853a55e0 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:36.613404 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f112b57e-2bf4-40a8-9992-da38853a55e0 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:36.614261 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f112b57e-2bf4-40a8-9992-da38853a55e0 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:36.618276 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f112b57e-2bf4-40a8-9992-da38853a55e0 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:36.621198 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f112b57e-2bf4-40a8-9992-da38853a55e0 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:36.622784 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f112b57e-2bf4-40a8-9992-da38853a55e0 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:36.628165 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:53:36.804915 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-f112b57e-2bf4-40a8-9992-da38853a55e0 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317e74b4bbc4da298a0dcbd78068352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a8810c21784788b4c0ee64dedbaf15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:36.817078 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-f112b57e-2bf4-40a8-9992-da38853a55e0 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] 10.222.0.70 "GET /compute/v2.1/servers/7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8" status: 200 len: 1515 microversion: 2.1 time: 0.235893 Aug 27 02:53:36.818058 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1377/2755] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:36 2022] GET /compute/v2.1/servers/7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8 => generated 1515 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:36.828682 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-bc779c63-35db-407a-b8c5-0c54d1123c28 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:36.833138 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-bc779c63-35db-407a-b8c5-0c54d1123c28 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:36.843868 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bc779c63-35db-407a-b8c5-0c54d1123c28 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:36.846273 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bc779c63-35db-407a-b8c5-0c54d1123c28 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:36.850562 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bc779c63-35db-407a-b8c5-0c54d1123c28 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:36.851412 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bc779c63-35db-407a-b8c5-0c54d1123c28 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:36.851892 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bc779c63-35db-407a-b8c5-0c54d1123c28 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:36.869736 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bc779c63-35db-407a-b8c5-0c54d1123c28 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:37.246122 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-bc779c63-35db-407a-b8c5-0c54d1123c28 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:37.302458 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-bc779c63-35db-407a-b8c5-0c54d1123c28 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1668 microversion: 2.1 time: 0.483063 Aug 27 02:53:37.304238 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1378/2756] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:36 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1668 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:37.330515 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-24790f3a-9c83-4180-a942-fb34c4ed9d3b tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:37.331543 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-24790f3a-9c83-4180-a942-fb34c4ed9d3b tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: cac17f47-6e08-4f15-a8cf-f5e44ad03d12] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:37.342754 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-24790f3a-9c83-4180-a942-fb34c4ed9d3b tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:37.343538 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-24790f3a-9c83-4180-a942-fb34c4ed9d3b tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:37.344158 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-24790f3a-9c83-4180-a942-fb34c4ed9d3b tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:37.352194 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-24790f3a-9c83-4180-a942-fb34c4ed9d3b tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:37.354571 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-24790f3a-9c83-4180-a942-fb34c4ed9d3b tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:37.355234 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-24790f3a-9c83-4180-a942-fb34c4ed9d3b tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:37.384711 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-24790f3a-9c83-4180-a942-fb34c4ed9d3b tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] HTTP exception thrown: Instance cac17f47-6e08-4f15-a8cf-f5e44ad03d12 could not be found. Aug 27 02:53:37.388089 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-24790f3a-9c83-4180-a942-fb34c4ed9d3b tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Request method failure captured: Aug 27 02:53:37.388089 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/cac17f47-6e08-4f15-a8cf-f5e44ad03d12 HTTP/1.1 Aug 27 02:53:37.388089 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:53:37.388089 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:53:37.388089 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:53:37.388089 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:53:37.388089 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:53:37.388089 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:53:37.388089 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:53:37.388089 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:53:37.388089 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYXV0r3jGUq47WLGtKQpD2GT6ZaucKLj1FHCRVWh7FmbJ46ArZdeI2i4KuIQK6o7gnteOdnBxpMeNOLKzoZIrvG7jVXHSKepr0w2IF9adZg6La101vR9uA7o3L_hdEWDLnTX4lG6KD99R14eN8P3ngENHLfo1gbuvR2cMcQDOiaqQnU Aug 27 02:53:37.388089 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:53:37.388089 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:53:37.388089 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:53:37.388089 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:53:37.388089 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:53:37.388089 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:53:37.388089 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 937a5eeccaa7425ca72c8c74fb99f11a Aug 27 02:53:37.388089 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-MigrationsAdminTest-893175282 Aug 27 02:53:37.388089 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:53:37.388089 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:53:37.388089 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/937a5eeccaa7425ca72c8c74fb99f11a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_937a5eeccaa7425ca72c8c74fb99f11a", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/937a5eeccaa7425ca72c8c74fb99f11a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/937a5eeccaa7425ca72c8c74fb99f11a"}]}] Aug 27 02:53:37.388089 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-MigrationsAdminTest-893175282 Aug 27 02:53:37.388089 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 937a5eeccaa7425ca72c8c74fb99f11a Aug 27 02:53:37.388089 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-MigrationsAdminTest-893175282 Aug 27 02:53:37.388089 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-MigrationsAdminTest-893175282-project Aug 27 02:53:37.388089 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:53:37.388089 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:53:37.388089 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 0b310e73ecd244d2938812d5be99558c Aug 27 02:53:37.388089 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-MigrationsAdminTest-893175282-project Aug 27 02:53:37.388089 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 02:53:37.388089 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance cac17f47-6e08-4f15-a8cf-f5e44ad03d12 could not be found. Aug 27 02:53:37.388089 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': 'cac17f47-6e08-4f15-a8cf-f5e44ad03d12'} Aug 27 02:53:37.388089 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:53:37.388089 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:53:37.388089 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:53:37.388089 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:53:37.388089 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:53:37.388089 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:53:37.388089 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:53:37.388089 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:53:37.388089 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:53:37.388089 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:53:37.388089 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cac17f47-6e08-4f15-a8cf-f5e44ad03d12 could not be found. Aug 27 02:53:37.388089 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:53:37.388089 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:53:37.388089 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:53:37.388089 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:53:37.388089 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:53:37.388089 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:53:37.388089 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:53:37.388089 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:53:37.388089 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:53:37.388089 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:53:37.388089 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:53:37.388089 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:53:37.388089 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:53:37.388089 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:53:37.388089 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:53:37.388089 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:53:37.388089 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cac17f47-6e08-4f15-a8cf-f5e44ad03d12 could not be found. Aug 27 02:53:37.388089 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:53:37.388089 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:53:37.388089 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:53:37.392832 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:53:37.392832 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:53:37.392832 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:53:37.392832 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:53:37.392832 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:53:37.392832 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cac17f47-6e08-4f15-a8cf-f5e44ad03d12 could not be found. Aug 27 02:53:37.392832 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:53:37.394993 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-24790f3a-9c83-4180-a942-fb34c4ed9d3b tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Returning 404 to user: Instance cac17f47-6e08-4f15-a8cf-f5e44ad03d12 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:53:37.401776 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-24790f3a-9c83-4180-a942-fb34c4ed9d3b tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/cac17f47-6e08-4f15-a8cf-f5e44ad03d12" status: 404 len: 111 microversion: 2.1 time: 0.073942 Aug 27 02:53:37.409391 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1379/2757] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:37 2022] GET /compute/v2.1/servers/cac17f47-6e08-4f15-a8cf-f5e44ad03d12 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:53:37.419582 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f0f89d37-f828-477e-8248-13d77ad98519 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:37.420636 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-f0f89d37-f828-477e-8248-13d77ad98519 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:37.440686 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f0f89d37-f828-477e-8248-13d77ad98519 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:37.443127 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f0f89d37-f828-477e-8248-13d77ad98519 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:37.444489 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f0f89d37-f828-477e-8248-13d77ad98519 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:37.446237 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f0f89d37-f828-477e-8248-13d77ad98519 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:37.449243 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f0f89d37-f828-477e-8248-13d77ad98519 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:37.450676 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f0f89d37-f828-477e-8248-13d77ad98519 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:37.754414 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-f0f89d37-f828-477e-8248-13d77ad98519 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:37.770545 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-f0f89d37-f828-477e-8248-13d77ad98519 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1668 microversion: 2.1 time: 0.358052 Aug 27 02:53:37.771723 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1380/2758] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:37 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1668 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:37.776482 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-392e284a-aa3c-4184-8506-84ac1c27529c tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:37.776973 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-392e284a-aa3c-4184-8506-84ac1c27529c tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: 60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:37.785548 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-392e284a-aa3c-4184-8506-84ac1c27529c tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:37.786036 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-392e284a-aa3c-4184-8506-84ac1c27529c tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:37.786465 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-392e284a-aa3c-4184-8506-84ac1c27529c tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:37.787167 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-392e284a-aa3c-4184-8506-84ac1c27529c tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:37.787611 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-392e284a-aa3c-4184-8506-84ac1c27529c tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:37.788027 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-392e284a-aa3c-4184-8506-84ac1c27529c tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:37.840236 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-392e284a-aa3c-4184-8506-84ac1c27529c tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: 60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4] Going to try to terminate instance {{(pid=134051) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:53:37.990238 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-392e284a-aa3c-4184-8506-84ac1c27529c tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "DELETE /compute/v2.1/servers/60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4" status: 204 len: 0 microversion: 2.1 time: 0.217148 Aug 27 02:53:37.991159 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1381/2759] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:53:37 2022] DELETE /compute/v2.1/servers/60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:53:37.998258 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-5e50a6c6-3d6b-43b2-b8d3-1f6c0779d570 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:38.000893 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-5e50a6c6-3d6b-43b2-b8d3-1f6c0779d570 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: 97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:38.009337 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5e50a6c6-3d6b-43b2-b8d3-1f6c0779d570 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:38.010165 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5e50a6c6-3d6b-43b2-b8d3-1f6c0779d570 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:38.010753 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5e50a6c6-3d6b-43b2-b8d3-1f6c0779d570 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:38.011676 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5e50a6c6-3d6b-43b2-b8d3-1f6c0779d570 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:38.012299 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5e50a6c6-3d6b-43b2-b8d3-1f6c0779d570 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:38.012904 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5e50a6c6-3d6b-43b2-b8d3-1f6c0779d570 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:38.243547 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-5e50a6c6-3d6b-43b2-b8d3-1f6c0779d570 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:38.261210 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-5e50a6c6-3d6b-43b2-b8d3-1f6c0779d570 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4" status: 200 len: 1527 microversion: 2.1 time: 0.268286 Aug 27 02:53:38.263881 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1382/2760] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:37 2022] GET /compute/v2.1/servers/97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4 => generated 1527 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:38.272671 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-6ada3d98-181a-4c26-bb7d-0a240a710d9e tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:38.273467 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-6ada3d98-181a-4c26-bb7d-0a240a710d9e tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] [instance: 7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:38.287187 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6ada3d98-181a-4c26-bb7d-0a240a710d9e tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:38.289548 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6ada3d98-181a-4c26-bb7d-0a240a710d9e tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:38.290812 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6ada3d98-181a-4c26-bb7d-0a240a710d9e tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:38.292026 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6ada3d98-181a-4c26-bb7d-0a240a710d9e tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:38.292752 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6ada3d98-181a-4c26-bb7d-0a240a710d9e tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:38.293322 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6ada3d98-181a-4c26-bb7d-0a240a710d9e tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:38.576624 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-6ada3d98-181a-4c26-bb7d-0a240a710d9e tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317e74b4bbc4da298a0dcbd78068352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a8810c21784788b4c0ee64dedbaf15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:38.586499 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-6ada3d98-181a-4c26-bb7d-0a240a710d9e tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] 10.222.0.70 "GET /compute/v2.1/servers/7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8" status: 200 len: 1515 microversion: 2.1 time: 0.321311 Aug 27 02:53:38.588271 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1383/2761] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:38 2022] GET /compute/v2.1/servers/7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8 => generated 1515 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:38.593832 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ec3304ca-2e2f-404b-ad24-aaddb15d11b5 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1696646082", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "networks": [{"uuid": "7532a923-41df-4761-8077-055e309eff44"}]}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:53:43.045787 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=28,nova_api:DELETE=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:53:43.417849 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=71 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:53:48.582114 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:53:48.612298 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=3 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:53:51.103540 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c2d1060a-a648-466e-bf94-b7091fcb6cb9 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "GET /compute/v2.1/images/50103730-0d32-4451-b672-ca0cdb239f81" status: 200 len: 1412 microversion: 2.1 time: 17.672998 Aug 27 02:53:51.104435 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1379/2762] 10.222.0.70 () {58 vars in 1233 bytes} [Sat Aug 27 02:53:33 2022] GET /compute/v2.1/images/50103730-0d32-4451-b672-ca0cdb239f81 => generated 1412 bytes in 17675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:51.113119 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-996fff21-397f-468a-886f-5af4423cfcf7 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:51.113903 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-996fff21-397f-468a-886f-5af4423cfcf7 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] [instance: 60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:51.121299 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-996fff21-397f-468a-886f-5af4423cfcf7 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:51.122351 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-996fff21-397f-468a-886f-5af4423cfcf7 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:51.122941 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-996fff21-397f-468a-886f-5af4423cfcf7 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:51.124423 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-996fff21-397f-468a-886f-5af4423cfcf7 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:51.125062 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-996fff21-397f-468a-886f-5af4423cfcf7 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:51.125646 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-996fff21-397f-468a-886f-5af4423cfcf7 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:51.131928 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.network.neutron [None req-ec3304ca-2e2f-404b-ad24-aaddb15d11b5 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] validate_networks() for [('7532a923-41df-4761-8077-055e309eff44', None, None, None, None, None)] {{(pid=134051) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:53:51.148895 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-996fff21-397f-468a-886f-5af4423cfcf7 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] HTTP exception thrown: Instance 60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4 could not be found. Aug 27 02:53:51.151199 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-996fff21-397f-468a-886f-5af4423cfcf7 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Request method failure captured: Aug 27 02:53:51.151199 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/servers/60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4 HTTP/1.1 Aug 27 02:53:51.151199 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:53:51.151199 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:53:51.151199 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:53:51.151199 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:53:51.151199 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:53:51.151199 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:53:51.151199 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:53:51.151199 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:53:51.151199 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYXV0r3jGUq47WLGtKQpD2GT6ZaucKLj1FHCRVWh7FmbJ46ArZdeI2i4KuIQK6o7gnteOdnBxpMeNOLKzoZIrvG7jVXHSKepr0w2IF9adZg6La101vR9uA7o3L_hdEWDLnTX4lG6KD99R14eN8P3ngENHLfo1gbuvR2cMcQDOiaqQnU Aug 27 02:53:51.151199 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:53:51.151199 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:53:51.151199 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:53:51.151199 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:53:51.151199 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:53:51.151199 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:53:51.151199 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 937a5eeccaa7425ca72c8c74fb99f11a Aug 27 02:53:51.151199 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-MigrationsAdminTest-893175282 Aug 27 02:53:51.151199 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:53:51.151199 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:53:51.151199 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/937a5eeccaa7425ca72c8c74fb99f11a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_937a5eeccaa7425ca72c8c74fb99f11a", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/937a5eeccaa7425ca72c8c74fb99f11a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/937a5eeccaa7425ca72c8c74fb99f11a"}]}] Aug 27 02:53:51.151199 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-MigrationsAdminTest-893175282 Aug 27 02:53:51.151199 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 937a5eeccaa7425ca72c8c74fb99f11a Aug 27 02:53:51.151199 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-MigrationsAdminTest-893175282 Aug 27 02:53:51.151199 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-MigrationsAdminTest-893175282-project Aug 27 02:53:51.151199 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:53:51.151199 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:53:51.151199 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 0b310e73ecd244d2938812d5be99558c Aug 27 02:53:51.151199 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-MigrationsAdminTest-893175282-project Aug 27 02:53:51.151199 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 02:53:51.151199 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance 60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4 could not be found. Aug 27 02:53:51.151199 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4'} Aug 27 02:53:51.151199 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:53:51.151199 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:53:51.151199 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:53:51.151199 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:53:51.151199 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:53:51.151199 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:53:51.151199 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:53:51.151199 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:53:51.151199 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:53:51.151199 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:53:51.151199 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4 could not be found. Aug 27 02:53:51.151199 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:53:51.151199 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:53:51.151199 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:53:51.151199 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:53:51.151199 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:53:51.151199 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:53:51.151199 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:53:51.151199 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:53:51.151199 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:53:51.151199 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:53:51.151199 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:53:51.151199 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:53:51.151199 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:53:51.151199 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:53:51.151199 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:53:51.151199 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:53:51.151199 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4 could not be found. Aug 27 02:53:51.151199 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:53:51.151199 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:53:51.151199 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:53:51.157251 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:53:51.157251 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:53:51.157251 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:53:51.157251 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:53:51.157251 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:53:51.157251 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4 could not be found. Aug 27 02:53:51.157251 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:53:51.159941 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-996fff21-397f-468a-886f-5af4423cfcf7 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] Returning 404 to user: Instance 60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:53:51.161024 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-996fff21-397f-468a-886f-5af4423cfcf7 tempest-MigrationsAdminTest-893175282 tempest-MigrationsAdminTest-893175282-project] 10.222.0.70 "GET /compute/v2.1/servers/60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4" status: 404 len: 111 microversion: 2.1 time: 0.054921 Aug 27 02:53:51.165168 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1380/2763] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:51 2022] GET /compute/v2.1/servers/60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:53:51.171115 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e05b9a3c-03be-43aa-9321-d378bdd19060 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:51.171732 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-e05b9a3c-03be-43aa-9321-d378bdd19060 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: 97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:51.179847 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e05b9a3c-03be-43aa-9321-d378bdd19060 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:51.180739 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e05b9a3c-03be-43aa-9321-d378bdd19060 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:51.181180 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e05b9a3c-03be-43aa-9321-d378bdd19060 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:51.181905 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e05b9a3c-03be-43aa-9321-d378bdd19060 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:51.182351 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e05b9a3c-03be-43aa-9321-d378bdd19060 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:51.182806 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e05b9a3c-03be-43aa-9321-d378bdd19060 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:51.552763 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-e05b9a3c-03be-43aa-9321-d378bdd19060 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:51.566338 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e05b9a3c-03be-43aa-9321-d378bdd19060 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4" status: 200 len: 1522 microversion: 2.1 time: 0.399698 Aug 27 02:53:51.568468 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1381/2764] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:51 2022] GET /compute/v2.1/servers/97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4 => generated 1522 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:51.586442 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-7a7becc9-d021-42f8-ba70-3f93d3393810 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:51.587353 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-7a7becc9-d021-42f8-ba70-3f93d3393810 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] [instance: 7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:51.608218 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7a7becc9-d021-42f8-ba70-3f93d3393810 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:51.609207 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7a7becc9-d021-42f8-ba70-3f93d3393810 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:51.609594 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7a7becc9-d021-42f8-ba70-3f93d3393810 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:51.610473 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7a7becc9-d021-42f8-ba70-3f93d3393810 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:51.611084 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7a7becc9-d021-42f8-ba70-3f93d3393810 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:51.611652 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7a7becc9-d021-42f8-ba70-3f93d3393810 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:52.730898 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-7a7becc9-d021-42f8-ba70-3f93d3393810 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317e74b4bbc4da298a0dcbd78068352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a8810c21784788b4c0ee64dedbaf15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:52.740083 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-7a7becc9-d021-42f8-ba70-3f93d3393810 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] 10.222.0.70 "GET /compute/v2.1/servers/7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8" status: 200 len: 1521 microversion: 2.1 time: 1.169507 Aug 27 02:53:52.743689 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1382/2765] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:51 2022] GET /compute/v2.1/servers/7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8 => generated 1521 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:52.750370 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-2cd249f9-03f6-4d9e-9479-10b75081b192 req-46189f61-1160-42c5-87b8-17c03e8039fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4", "name": "network-vif-deleted", "tag": "f88818f1-ef30-4d4a-9180-9bdfc399cfe1"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:53:52.774452 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-2cd249f9-03f6-4d9e-9479-10b75081b192 req-46189f61-1160-42c5-87b8-17c03e8039fa service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:52.778059 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-2cd249f9-03f6-4d9e-9479-10b75081b192 req-46189f61-1160-42c5-87b8-17c03e8039fa service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:52.780953 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-2cd249f9-03f6-4d9e-9479-10b75081b192 req-46189f61-1160-42c5-87b8-17c03e8039fa service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:52.810313 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-2cd249f9-03f6-4d9e-9479-10b75081b192 req-46189f61-1160-42c5-87b8-17c03e8039fa service nova] Creating event network-vif-deleted:f88818f1-ef30-4d4a-9180-9bdfc399cfe1 for instance 60f9c4bf-2cdb-4aa1-9ba6-7fa97772aea4 on n-h2-852278-4 Aug 27 02:53:52.828446 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-2cd249f9-03f6-4d9e-9479-10b75081b192 req-46189f61-1160-42c5-87b8-17c03e8039fa service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083004 Aug 27 02:53:52.830919 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1383/2766] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:53:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:53:52.842461 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-88c99303-c4b1-45ff-9d45-48ff3722e63f req-74f66323-1a7c-4e85-b1f6-8917e72e62fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4", "name": "network-vif-plugged", "status": "completed", "tag": "b6ccabb4-3a86-495e-9764-020c27981067"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:53:52.883047 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-88c99303-c4b1-45ff-9d45-48ff3722e63f req-74f66323-1a7c-4e85-b1f6-8917e72e62fb service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:52.888511 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-88c99303-c4b1-45ff-9d45-48ff3722e63f req-74f66323-1a7c-4e85-b1f6-8917e72e62fb service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:52.889398 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-88c99303-c4b1-45ff-9d45-48ff3722e63f req-74f66323-1a7c-4e85-b1f6-8917e72e62fb service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:52.926531 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-88c99303-c4b1-45ff-9d45-48ff3722e63f req-74f66323-1a7c-4e85-b1f6-8917e72e62fb service nova] Creating event network-vif-plugged:b6ccabb4-3a86-495e-9764-020c27981067 for instance 97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4 on n-h2-852278-4 Aug 27 02:53:52.940080 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-88c99303-c4b1-45ff-9d45-48ff3722e63f req-74f66323-1a7c-4e85-b1f6-8917e72e62fb service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107418 Aug 27 02:53:52.940847 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1384/2767] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:53:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:53:52.948626 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6f370cb6-5daf-437f-b9ed-7e1028ec97d0 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '.version_select at 0x7f5ee2e13b80>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:53.009268 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-6f370cb6-5daf-437f-b9ed-7e1028ec97d0 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "GET /compute/v2.1/images/50103730-0d32-4451-b672-ca0cdb239f81" status: 200 len: 1421 microversion: 2.1 time: 0.066672 Aug 27 02:53:53.010071 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1385/2768] 10.222.0.70 () {58 vars in 1233 bytes} [Sat Aug 27 02:53:52 2022] GET /compute/v2.1/images/50103730-0d32-4451-b672-ca0cdb239f81 => generated 1421 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:53.027394 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-7e3cc92d-3d2a-4af7-a22b-e480625de74e tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:53.028137 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-7e3cc92d-3d2a-4af7-a22b-e480625de74e tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: 97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:53.036456 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7e3cc92d-3d2a-4af7-a22b-e480625de74e tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:53.037623 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7e3cc92d-3d2a-4af7-a22b-e480625de74e tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:53.038285 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7e3cc92d-3d2a-4af7-a22b-e480625de74e tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:53.039626 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7e3cc92d-3d2a-4af7-a22b-e480625de74e tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:53.040949 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7e3cc92d-3d2a-4af7-a22b-e480625de74e tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:53.041936 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7e3cc92d-3d2a-4af7-a22b-e480625de74e tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:53.083753 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-ec3304ca-2e2f-404b-ad24-aaddb15d11b5 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Flavor limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:53:53.084251 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-ec3304ca-2e2f-404b-ad24-aaddb15d11b5 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Image limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:53:53.084659 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-ec3304ca-2e2f-404b-ad24-aaddb15d11b5 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Flavor pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:53:53.085071 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-ec3304ca-2e2f-404b-ad24-aaddb15d11b5 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Image pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:53:53.085806 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-ec3304ca-2e2f-404b-ad24-aaddb15d11b5 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:53:53.111102 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ec3304ca-2e2f-404b-ad24-aaddb15d11b5 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:53.111604 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ec3304ca-2e2f-404b-ad24-aaddb15d11b5 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:53.118587 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ec3304ca-2e2f-404b-ad24-aaddb15d11b5 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:53.123105 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ec3304ca-2e2f-404b-ad24-aaddb15d11b5 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:53.127989 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ec3304ca-2e2f-404b-ad24-aaddb15d11b5 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:53.130604 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ec3304ca-2e2f-404b-ad24-aaddb15d11b5 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:53.248770 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-ec3304ca-2e2f-404b-ad24-aaddb15d11b5 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Getting quotas for project 952767db5f394fc4bf01c0efd65f2fb9. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:53:53.274245 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-ec3304ca-2e2f-404b-ad24-aaddb15d11b5 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Getting quotas for user c850bda78e664117b671910c0e68bfb9 and project 952767db5f394fc4bf01c0efd65f2fb9. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:53:53.284776 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-7e3cc92d-3d2a-4af7-a22b-e480625de74e tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:53.299268 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-7e3cc92d-3d2a-4af7-a22b-e480625de74e tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4" status: 200 len: 1522 microversion: 2.1 time: 0.280479 Aug 27 02:53:53.300474 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1386/2769] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:53 2022] GET /compute/v2.1/servers/97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4 => generated 1522 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:53.310340 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-79d62f44-fe40-4def-9837-03d85ddfe4b0 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '.version_select at 0x7f5ee2deeee0>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:53.337849 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-ec3304ca-2e2f-404b-ad24-aaddb15d11b5 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Going to run 1 instances... {{(pid=134051) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:53:53.342576 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-ec3304ca-2e2f-404b-ad24-aaddb15d11b5 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 228b8015-1061-46f1-a6a3-c5d0ba039660] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134051) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:53:53.380425 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-79d62f44-fe40-4def-9837-03d85ddfe4b0 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "GET /compute/v2.1/images/50103730-0d32-4451-b672-ca0cdb239f81" status: 200 len: 1421 microversion: 2.1 time: 0.077806 Aug 27 02:53:53.381762 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1387/2770] 10.222.0.70 () {58 vars in 1233 bytes} [Sat Aug 27 02:53:53 2022] GET /compute/v2.1/images/50103730-0d32-4451-b672-ca0cdb239f81 => generated 1421 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:53.399692 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b0d7fb30-8eaf-421e-8e20-73b541e0fa80 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '.version_select at 0x7f5ee3030670>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:53.459180 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ec3304ca-2e2f-404b-ad24-aaddb15d11b5 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 14.869635 Aug 27 02:53:53.465938 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1384/2771] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 02:53:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 14877 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:53:53.480345 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-29cb66e0-60aa-494d-83f5-10bba0dfa288 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:53.483903 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-29cb66e0-60aa-494d-83f5-10bba0dfa288 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 228b8015-1061-46f1-a6a3-c5d0ba039660] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:53.633039 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-29cb66e0-60aa-494d-83f5-10bba0dfa288 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:53.643752 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-29cb66e0-60aa-494d-83f5-10bba0dfa288 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/228b8015-1061-46f1-a6a3-c5d0ba039660" status: 200 len: 1215 microversion: 2.1 time: 0.170336 Aug 27 02:53:53.653687 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1385/2772] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:53 2022] GET /compute/v2.1/servers/228b8015-1061-46f1-a6a3-c5d0ba039660 => generated 1215 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:53:53.766636 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b9487c19-ca5a-4ec1-baae-d229c26d2a0f tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:53.769061 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b9487c19-ca5a-4ec1-baae-d229c26d2a0f tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] [instance: 7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:53.793814 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b9487c19-ca5a-4ec1-baae-d229c26d2a0f tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:53.795917 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b9487c19-ca5a-4ec1-baae-d229c26d2a0f tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:53.796723 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b9487c19-ca5a-4ec1-baae-d229c26d2a0f tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:53.797542 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b9487c19-ca5a-4ec1-baae-d229c26d2a0f tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:53.797869 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b9487c19-ca5a-4ec1-baae-d229c26d2a0f tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:53.798291 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b9487c19-ca5a-4ec1-baae-d229c26d2a0f tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:54.249969 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-b9487c19-ca5a-4ec1-baae-d229c26d2a0f tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317e74b4bbc4da298a0dcbd78068352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a8810c21784788b4c0ee64dedbaf15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:54.265762 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b9487c19-ca5a-4ec1-baae-d229c26d2a0f tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] 10.222.0.70 "GET /compute/v2.1/servers/7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8" status: 200 len: 1521 microversion: 2.1 time: 0.502695 Aug 27 02:53:54.271125 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1386/2773] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:53 2022] GET /compute/v2.1/servers/7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8 => generated 1521 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:53:54.322791 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d6e9352c-5749-4399-850a-bb0056bdd191 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:54.323541 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d6e9352c-5749-4399-850a-bb0056bdd191 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: 97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:54.338765 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d6e9352c-5749-4399-850a-bb0056bdd191 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:54.342480 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d6e9352c-5749-4399-850a-bb0056bdd191 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:54.344266 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d6e9352c-5749-4399-850a-bb0056bdd191 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:54.347638 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d6e9352c-5749-4399-850a-bb0056bdd191 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:54.348932 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d6e9352c-5749-4399-850a-bb0056bdd191 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:54.350638 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d6e9352c-5749-4399-850a-bb0056bdd191 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:54.599080 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d6e9352c-5749-4399-850a-bb0056bdd191 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:54.616361 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d6e9352c-5749-4399-850a-bb0056bdd191 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4" status: 200 len: 1522 microversion: 2.1 time: 0.297616 Aug 27 02:53:54.632739 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1387/2774] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:54 2022] GET /compute/v2.1/servers/97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4 => generated 1522 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:53:54.668728 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-728982aa-fda9-4136-a0b9-9e8c86deea48 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:54.670105 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-728982aa-fda9-4136-a0b9-9e8c86deea48 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 228b8015-1061-46f1-a6a3-c5d0ba039660] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:54.686312 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-728982aa-fda9-4136-a0b9-9e8c86deea48 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:54.689641 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-728982aa-fda9-4136-a0b9-9e8c86deea48 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:54.691223 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-728982aa-fda9-4136-a0b9-9e8c86deea48 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:54.694442 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-728982aa-fda9-4136-a0b9-9e8c86deea48 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:54.696365 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-728982aa-fda9-4136-a0b9-9e8c86deea48 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:54.698418 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-728982aa-fda9-4136-a0b9-9e8c86deea48 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:54.875620 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-728982aa-fda9-4136-a0b9-9e8c86deea48 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:54.887861 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-728982aa-fda9-4136-a0b9-9e8c86deea48 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/228b8015-1061-46f1-a6a3-c5d0ba039660" status: 200 len: 1219 microversion: 2.1 time: 0.225295 Aug 27 02:53:54.892585 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1388/2775] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:54 2022] GET /compute/v2.1/servers/228b8015-1061-46f1-a6a3-c5d0ba039660 => generated 1219 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:53:54.908706 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b0d7fb30-8eaf-421e-8e20-73b541e0fa80 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "DELETE /compute/v2.1/images/50103730-0d32-4451-b672-ca0cdb239f81" status: 204 len: 0 microversion: 2.1 time: 1.513854 Aug 27 02:53:54.910253 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1388/2776] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:53 2022] DELETE /compute/v2.1/images/50103730-0d32-4451-b672-ca0cdb239f81 => generated 0 bytes in 1517 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:53:54.941135 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b2b6e99c-0cbd-44c4-9fca-b6748dae3f91 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:54.955702 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b2b6e99c-0cbd-44c4-9fca-b6748dae3f91 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] [instance: 546a5816-c2d9-494b-8c23-b0983cd11eb9] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:54.959773 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-ece11d31-849c-4f9f-9d32-26d9d1555ae3 req-75500deb-e023-4e25-a9ff-322eb639a6c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8", "name": "network-vif-unplugged", "status": "completed", "tag": "dee4c86c-595f-441d-ba5f-4bf6d022ab1a"}, {"server_uuid": "7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8", "name": "network-vif-plugged", "status": "completed", "tag": "dee4c86c-595f-441d-ba5f-4bf6d022ab1a"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:53:54.987568 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b2b6e99c-0cbd-44c4-9fca-b6748dae3f91 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:54.992630 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b2b6e99c-0cbd-44c4-9fca-b6748dae3f91 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:54.993836 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-ece11d31-849c-4f9f-9d32-26d9d1555ae3 req-75500deb-e023-4e25-a9ff-322eb639a6c0 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:54.995618 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b2b6e99c-0cbd-44c4-9fca-b6748dae3f91 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:54.997396 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b2b6e99c-0cbd-44c4-9fca-b6748dae3f91 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:54.998783 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-ece11d31-849c-4f9f-9d32-26d9d1555ae3 req-75500deb-e023-4e25-a9ff-322eb639a6c0 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:55.004504 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b2b6e99c-0cbd-44c4-9fca-b6748dae3f91 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:55.005414 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-ece11d31-849c-4f9f-9d32-26d9d1555ae3 req-75500deb-e023-4e25-a9ff-322eb639a6c0 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:55.007146 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b2b6e99c-0cbd-44c4-9fca-b6748dae3f91 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:55.056368 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-ece11d31-849c-4f9f-9d32-26d9d1555ae3 req-75500deb-e023-4e25-a9ff-322eb639a6c0 service nova] Creating event network-vif-unplugged:dee4c86c-595f-441d-ba5f-4bf6d022ab1a for instance 7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8 on n-h1-852278-4 Aug 27 02:53:55.061084 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-ece11d31-849c-4f9f-9d32-26d9d1555ae3 req-75500deb-e023-4e25-a9ff-322eb639a6c0 service nova] Creating event network-vif-plugged:dee4c86c-595f-441d-ba5f-4bf6d022ab1a for instance 7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8 on n-h1-852278-4 Aug 27 02:53:55.063872 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b2b6e99c-0cbd-44c4-9fca-b6748dae3f91 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] [instance: 546a5816-c2d9-494b-8c23-b0983cd11eb9] Going to try to terminate instance {{(pid=134051) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:53:55.091358 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-ece11d31-849c-4f9f-9d32-26d9d1555ae3 req-75500deb-e023-4e25-a9ff-322eb639a6c0 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.136711 Aug 27 02:53:55.097814 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1389/2777] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:53:54 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:53:55.263583 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b2b6e99c-0cbd-44c4-9fca-b6748dae3f91 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "DELETE /compute/v2.1/servers/546a5816-c2d9-494b-8c23-b0983cd11eb9" status: 204 len: 0 microversion: 2.1 time: 0.348251 Aug 27 02:53:55.269917 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1389/2778] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:53:54 2022] DELETE /compute/v2.1/servers/546a5816-c2d9-494b-8c23-b0983cd11eb9 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:53:55.302306 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3a76ba81-337a-48f2-820c-a549a792f3e5 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:55.303122 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-3a76ba81-337a-48f2-820c-a549a792f3e5 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] [instance: 7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:55.325999 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3a76ba81-337a-48f2-820c-a549a792f3e5 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:55.327890 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3a76ba81-337a-48f2-820c-a549a792f3e5 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:55.329347 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3a76ba81-337a-48f2-820c-a549a792f3e5 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:55.334909 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3a76ba81-337a-48f2-820c-a549a792f3e5 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:55.335666 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3a76ba81-337a-48f2-820c-a549a792f3e5 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:55.340596 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3a76ba81-337a-48f2-820c-a549a792f3e5 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:55.571245 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a0914512-f250-4235-985f-672d26f02128 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-76553095", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "networks": [{"uuid": "677b7ba1-2913-4272-8be4-7a8908d3b556"}]}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:53:55.689406 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.network.neutron [None req-a0914512-f250-4235-985f-672d26f02128 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] validate_networks() for [('677b7ba1-2913-4272-8be4-7a8908d3b556', None, None, None, None, None)] {{(pid=134051) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:53:55.923047 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-3a76ba81-337a-48f2-820c-a549a792f3e5 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317e74b4bbc4da298a0dcbd78068352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a8810c21784788b4c0ee64dedbaf15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:55.936058 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-3a76ba81-337a-48f2-820c-a549a792f3e5 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] 10.222.0.70 "GET /compute/v2.1/servers/7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8" status: 200 len: 1521 microversion: 2.1 time: 0.646423 Aug 27 02:53:55.953138 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1390/2779] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:55 2022] GET /compute/v2.1/servers/7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8 => generated 1521 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:55.983839 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-23cf4020-3d05-43cb-b803-ed100845730f tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:55.985094 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-23cf4020-3d05-43cb-b803-ed100845730f tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: 97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:56.004831 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-23cf4020-3d05-43cb-b803-ed100845730f tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:56.007150 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-23cf4020-3d05-43cb-b803-ed100845730f tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:56.009060 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-23cf4020-3d05-43cb-b803-ed100845730f tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:56.011808 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-23cf4020-3d05-43cb-b803-ed100845730f tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:56.012592 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-23cf4020-3d05-43cb-b803-ed100845730f tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:56.014337 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-23cf4020-3d05-43cb-b803-ed100845730f tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:56.470076 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-23cf4020-3d05-43cb-b803-ed100845730f tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:56.484969 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-23cf4020-3d05-43cb-b803-ed100845730f tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4" status: 200 len: 1522 microversion: 2.1 time: 0.530092 Aug 27 02:53:56.486131 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1391/2780] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:55 2022] GET /compute/v2.1/servers/97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4 => generated 1522 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:56.502416 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-abef1ee0-fce0-4c09-981e-ad378ed11eff tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:56.508712 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-abef1ee0-fce0-4c09-981e-ad378ed11eff tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 228b8015-1061-46f1-a6a3-c5d0ba039660] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:56.530631 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-abef1ee0-fce0-4c09-981e-ad378ed11eff tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:56.532882 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-abef1ee0-fce0-4c09-981e-ad378ed11eff tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:56.536233 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-abef1ee0-fce0-4c09-981e-ad378ed11eff tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:56.537053 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-abef1ee0-fce0-4c09-981e-ad378ed11eff tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:56.538425 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-abef1ee0-fce0-4c09-981e-ad378ed11eff tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:56.541180 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-abef1ee0-fce0-4c09-981e-ad378ed11eff tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:56.768954 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-a0914512-f250-4235-985f-672d26f02128 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Flavor limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:53:56.769439 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-a0914512-f250-4235-985f-672d26f02128 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Image limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:53:56.769851 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-a0914512-f250-4235-985f-672d26f02128 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Flavor pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:53:56.770259 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-a0914512-f250-4235-985f-672d26f02128 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Image pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:53:56.770743 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-a0914512-f250-4235-985f-672d26f02128 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:53:56.783439 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a0914512-f250-4235-985f-672d26f02128 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:56.783924 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a0914512-f250-4235-985f-672d26f02128 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:56.784384 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a0914512-f250-4235-985f-672d26f02128 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:56.785117 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a0914512-f250-4235-985f-672d26f02128 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:56.785558 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a0914512-f250-4235-985f-672d26f02128 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:56.801155 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a0914512-f250-4235-985f-672d26f02128 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:56.899904 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-a0914512-f250-4235-985f-672d26f02128 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Getting quotas for project 40794f05e8b94a0f8f087a87a58e0ba1. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:53:56.925358 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-abef1ee0-fce0-4c09-981e-ad378ed11eff tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:56.944403 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-a0914512-f250-4235-985f-672d26f02128 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Getting quotas for user f496f24dccea47bd9a5ab532fe45e370 and project 40794f05e8b94a0f8f087a87a58e0ba1. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:53:56.951898 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-abef1ee0-fce0-4c09-981e-ad378ed11eff tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/228b8015-1061-46f1-a6a3-c5d0ba039660" status: 200 len: 1273 microversion: 2.1 time: 0.453986 Aug 27 02:53:56.952532 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1392/2781] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:56 2022] GET /compute/v2.1/servers/228b8015-1061-46f1-a6a3-c5d0ba039660 => generated 1273 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:56.978772 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-54c5b123-e6b4-4b9f-8b3d-4619e8146d6d tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:56.979399 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-54c5b123-e6b4-4b9f-8b3d-4619e8146d6d tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] [instance: 7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:57.003786 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-54c5b123-e6b4-4b9f-8b3d-4619e8146d6d tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:57.004283 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-54c5b123-e6b4-4b9f-8b3d-4619e8146d6d tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:57.004750 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-54c5b123-e6b4-4b9f-8b3d-4619e8146d6d tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:57.005464 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-54c5b123-e6b4-4b9f-8b3d-4619e8146d6d tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:57.005910 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-54c5b123-e6b4-4b9f-8b3d-4619e8146d6d tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:57.013296 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-a0914512-f250-4235-985f-672d26f02128 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Going to run 1 instances... {{(pid=134051) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:53:57.020826 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-a0914512-f250-4235-985f-672d26f02128 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] [instance: cb02560c-ca90-41f2-8e4a-1fe0f0494068] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134051) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:53:57.030293 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-54c5b123-e6b4-4b9f-8b3d-4619e8146d6d tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:57.139674 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a0914512-f250-4235-985f-672d26f02128 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.569846 Aug 27 02:53:57.147470 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1390/2782] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 02:53:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1581 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 02:53:57.161515 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-8f926864-32b3-4ab6-8b7e-91994b9f91ca req-078ae613-6473-4038-81a4-c1a4faae4789 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "546a5816-c2d9-494b-8c23-b0983cd11eb9", "name": "network-vif-unplugged", "status": "completed", "tag": "2efb5816-4d86-45f2-a90e-53904afe8489"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:53:57.193692 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-8f926864-32b3-4ab6-8b7e-91994b9f91ca req-078ae613-6473-4038-81a4-c1a4faae4789 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:57.194487 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-8f926864-32b3-4ab6-8b7e-91994b9f91ca req-078ae613-6473-4038-81a4-c1a4faae4789 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:57.195304 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-8f926864-32b3-4ab6-8b7e-91994b9f91ca req-078ae613-6473-4038-81a4-c1a4faae4789 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:57.225887 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-8f926864-32b3-4ab6-8b7e-91994b9f91ca req-078ae613-6473-4038-81a4-c1a4faae4789 service nova] Creating event network-vif-unplugged:2efb5816-4d86-45f2-a90e-53904afe8489 for instance 546a5816-c2d9-494b-8c23-b0983cd11eb9 on n-h2-852278-4 Aug 27 02:53:57.238330 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-8f926864-32b3-4ab6-8b7e-91994b9f91ca req-078ae613-6473-4038-81a4-c1a4faae4789 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.089219 Aug 27 02:53:57.239692 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1391/2783] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:53:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:53:57.257505 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-fd5355d9-16d7-4f4a-88d9-744a3fecda0d tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:57.260844 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-fd5355d9-16d7-4f4a-88d9-744a3fecda0d tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] [instance: cb02560c-ca90-41f2-8e4a-1fe0f0494068] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:57.614576 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-fd5355d9-16d7-4f4a-88d9-744a3fecda0d tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f496f24dccea47bd9a5ab532fe45e370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40794f05e8b94a0f8f087a87a58e0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:57.637191 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-fd5355d9-16d7-4f4a-88d9-744a3fecda0d tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "GET /compute/v2.1/servers/cb02560c-ca90-41f2-8e4a-1fe0f0494068" status: 200 len: 1206 microversion: 2.1 time: 0.395885 Aug 27 02:53:57.637804 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1392/2784] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:57 2022] GET /compute/v2.1/servers/cb02560c-ca90-41f2-8e4a-1fe0f0494068 => generated 1206 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:57.693243 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-68eff4ab-b156-4b22-8add-93e7f1b6f41b tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:57.693895 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-68eff4ab-b156-4b22-8add-93e7f1b6f41b tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: 97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:57.727375 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-68eff4ab-b156-4b22-8add-93e7f1b6f41b tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:57.727883 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-68eff4ab-b156-4b22-8add-93e7f1b6f41b tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:57.728333 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-68eff4ab-b156-4b22-8add-93e7f1b6f41b tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:57.739959 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-68eff4ab-b156-4b22-8add-93e7f1b6f41b tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:57.742181 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-68eff4ab-b156-4b22-8add-93e7f1b6f41b tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:57.757128 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-68eff4ab-b156-4b22-8add-93e7f1b6f41b tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:57.838596 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-54c5b123-e6b4-4b9f-8b3d-4619e8146d6d tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317e74b4bbc4da298a0dcbd78068352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a8810c21784788b4c0ee64dedbaf15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:57.851871 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-54c5b123-e6b4-4b9f-8b3d-4619e8146d6d tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] 10.222.0.70 "GET /compute/v2.1/servers/7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8" status: 200 len: 1521 microversion: 2.1 time: 0.892590 Aug 27 02:53:57.852993 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1393/2785] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:56 2022] GET /compute/v2.1/servers/7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8 => generated 1521 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:57.979777 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-7ac6ba2e-f4de-42da-9573-f0f3c2d0d818 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:57.981190 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-7ac6ba2e-f4de-42da-9573-f0f3c2d0d818 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 228b8015-1061-46f1-a6a3-c5d0ba039660] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:58.001788 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7ac6ba2e-f4de-42da-9573-f0f3c2d0d818 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:58.005514 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7ac6ba2e-f4de-42da-9573-f0f3c2d0d818 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:58.007201 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7ac6ba2e-f4de-42da-9573-f0f3c2d0d818 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:58.010281 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7ac6ba2e-f4de-42da-9573-f0f3c2d0d818 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:58.012916 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7ac6ba2e-f4de-42da-9573-f0f3c2d0d818 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:58.017233 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7ac6ba2e-f4de-42da-9573-f0f3c2d0d818 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:58.496244 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-68eff4ab-b156-4b22-8add-93e7f1b6f41b tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:58.504945 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-68eff4ab-b156-4b22-8add-93e7f1b6f41b tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4" status: 200 len: 1522 microversion: 2.1 time: 0.845953 Aug 27 02:53:58.505544 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1393/2786] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:57 2022] GET /compute/v2.1/servers/97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4 => generated 1522 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:58.785641 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-7ac6ba2e-f4de-42da-9573-f0f3c2d0d818 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:58.797055 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-7ac6ba2e-f4de-42da-9573-f0f3c2d0d818 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/228b8015-1061-46f1-a6a3-c5d0ba039660" status: 200 len: 1315 microversion: 2.1 time: 0.819531 Aug 27 02:53:58.797952 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1394/2787] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:57 2022] GET /compute/v2.1/servers/228b8015-1061-46f1-a6a3-c5d0ba039660 => generated 1315 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:53:58.832260 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4173c140-6895-4a45-8112-c83f24624b25 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:58.836102 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-4173c140-6895-4a45-8112-c83f24624b25 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] [instance: cb02560c-ca90-41f2-8e4a-1fe0f0494068] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:58.852728 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4173c140-6895-4a45-8112-c83f24624b25 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:58.854917 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4173c140-6895-4a45-8112-c83f24624b25 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:58.856858 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4173c140-6895-4a45-8112-c83f24624b25 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:58.857928 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4173c140-6895-4a45-8112-c83f24624b25 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:58.859404 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4173c140-6895-4a45-8112-c83f24624b25 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:58.865176 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4173c140-6895-4a45-8112-c83f24624b25 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:59.097373 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-4173c140-6895-4a45-8112-c83f24624b25 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f496f24dccea47bd9a5ab532fe45e370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40794f05e8b94a0f8f087a87a58e0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:59.111771 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-4173c140-6895-4a45-8112-c83f24624b25 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "GET /compute/v2.1/servers/cb02560c-ca90-41f2-8e4a-1fe0f0494068" status: 200 len: 1202 microversion: 2.1 time: 0.309809 Aug 27 02:53:59.113445 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1395/2788] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:58 2022] GET /compute/v2.1/servers/cb02560c-ca90-41f2-8e4a-1fe0f0494068 => generated 1202 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:59.116953 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8d9eeafb-97e0-4656-919a-44a9c38ae2e6 tempest-QuotasAdminTestJSON-956326715 tempest-QuotasAdminTestJSON-956326715-project-admin] Calling method '.version_select at 0x7f5ede25ca60>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:59.125544 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-78efca04-b92c-410e-817f-95b33f316346 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:59.130633 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-78efca04-b92c-410e-817f-95b33f316346 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] [instance: 7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:59.142714 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-78efca04-b92c-410e-817f-95b33f316346 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:59.143306 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-78efca04-b92c-410e-817f-95b33f316346 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:59.159407 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-78efca04-b92c-410e-817f-95b33f316346 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:59.177447 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-78efca04-b92c-410e-817f-95b33f316346 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:59.185986 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-78efca04-b92c-410e-817f-95b33f316346 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:59.187914 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-78efca04-b92c-410e-817f-95b33f316346 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:59.367115 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-8d9eeafb-97e0-4656-919a-44a9c38ae2e6 tempest-QuotasAdminTestJSON-956326715 tempest-QuotasAdminTestJSON-956326715-project-admin] 10.222.0.70 "GET /compute/v2.1/os-quota-sets/036bcce7964340598a341c015a054ca8" status: 200 len: 371 microversion: 2.1 time: 0.831632 Aug 27 02:53:59.376444 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1394/2789] 10.222.0.70 () {58 vars in 1242 bytes} [Sat Aug 27 02:53:58 2022] GET /compute/v2.1/os-quota-sets/036bcce7964340598a341c015a054ca8 => generated 371 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:53:59.388268 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-2b171971-9146-47fd-819b-ab92e1537ad5 tempest-QuotasAdminTestJSON-956326715 tempest-QuotasAdminTestJSON-956326715-project-admin] Action: 'update', calling method: .version_select at 0x7f5edeb46040>, body: {"quota_set": {"ram": "5120"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:53:59.581310 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2b171971-9146-47fd-819b-ab92e1537ad5 tempest-QuotasAdminTestJSON-956326715 tempest-QuotasAdminTestJSON-956326715-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:59.583451 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2b171971-9146-47fd-819b-ab92e1537ad5 tempest-QuotasAdminTestJSON-956326715 tempest-QuotasAdminTestJSON-956326715-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:59.591638 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2b171971-9146-47fd-819b-ab92e1537ad5 tempest-QuotasAdminTestJSON-956326715 tempest-QuotasAdminTestJSON-956326715-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:59.592710 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2b171971-9146-47fd-819b-ab92e1537ad5 tempest-QuotasAdminTestJSON-956326715 tempest-QuotasAdminTestJSON-956326715-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:59.593511 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2b171971-9146-47fd-819b-ab92e1537ad5 tempest-QuotasAdminTestJSON-956326715 tempest-QuotasAdminTestJSON-956326715-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:59.594386 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2b171971-9146-47fd-819b-ab92e1537ad5 tempest-QuotasAdminTestJSON-956326715 tempest-QuotasAdminTestJSON-956326715-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:59.811048 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-2b171971-9146-47fd-819b-ab92e1537ad5 tempest-QuotasAdminTestJSON-956326715 tempest-QuotasAdminTestJSON-956326715-project-admin] 10.222.0.70 "PUT /compute/v2.1/os-quota-sets/036bcce7964340598a341c015a054ca8" status: 200 len: 328 microversion: 2.1 time: 0.425018 Aug 27 02:53:59.833081 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1395/2790] 10.222.0.70 () {60 vars in 1262 bytes} [Sat Aug 27 02:53:59 2022] PUT /compute/v2.1/os-quota-sets/036bcce7964340598a341c015a054ca8 => generated 328 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:53:59.865784 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-d03a1547-b79d-48a0-9045-e12458e21474 req-a6578e94-b58c-474a-b251-a72321ddc810 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "546a5816-c2d9-494b-8c23-b0983cd11eb9", "name": "network-vif-deleted", "tag": "2efb5816-4d86-45f2-a90e-53904afe8489"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:53:59.884936 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-78efca04-b92c-410e-817f-95b33f316346 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317e74b4bbc4da298a0dcbd78068352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a8810c21784788b4c0ee64dedbaf15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:59.904351 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-d03a1547-b79d-48a0-9045-e12458e21474 req-a6578e94-b58c-474a-b251-a72321ddc810 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:59.913345 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-d03a1547-b79d-48a0-9045-e12458e21474 req-a6578e94-b58c-474a-b251-a72321ddc810 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:59.915336 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-d03a1547-b79d-48a0-9045-e12458e21474 req-a6578e94-b58c-474a-b251-a72321ddc810 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:59.918553 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-78efca04-b92c-410e-817f-95b33f316346 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] 10.222.0.70 "GET /compute/v2.1/servers/7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8" status: 200 len: 1506 microversion: 2.1 time: 0.802674 Aug 27 02:53:59.931924 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1396/2791] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:59 2022] GET /compute/v2.1/servers/7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8 => generated 1506 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:59.978396 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-d03a1547-b79d-48a0-9045-e12458e21474 req-a6578e94-b58c-474a-b251-a72321ddc810 service nova] Creating event network-vif-deleted:2efb5816-4d86-45f2-a90e-53904afe8489 for instance 546a5816-c2d9-494b-8c23-b0983cd11eb9 on n-h2-852278-4 Aug 27 02:53:59.978636 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-be15928d-0f0e-47ed-ad48-d81d22f0fe5c tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:59.981799 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-be15928d-0f0e-47ed-ad48-d81d22f0fe5c tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: 97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:00.000461 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-d03a1547-b79d-48a0-9045-e12458e21474 req-a6578e94-b58c-474a-b251-a72321ddc810 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.157840 Aug 27 02:54:00.004653 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1396/2792] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:53:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:54:00.006856 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-be15928d-0f0e-47ed-ad48-d81d22f0fe5c tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:00.010833 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-be15928d-0f0e-47ed-ad48-d81d22f0fe5c tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:00.011972 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-be15928d-0f0e-47ed-ad48-d81d22f0fe5c tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:00.015945 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-be15928d-0f0e-47ed-ad48-d81d22f0fe5c tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:00.017221 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-be15928d-0f0e-47ed-ad48-d81d22f0fe5c tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:00.018195 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-be15928d-0f0e-47ed-ad48-d81d22f0fe5c tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:00.038766 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-dea6a2dd-2652-4c7b-bcd3-a5621c7f71f6 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:00.042697 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-dea6a2dd-2652-4c7b-bcd3-a5621c7f71f6 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 228b8015-1061-46f1-a6a3-c5d0ba039660] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:00.076479 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dea6a2dd-2652-4c7b-bcd3-a5621c7f71f6 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:00.078443 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dea6a2dd-2652-4c7b-bcd3-a5621c7f71f6 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:00.079340 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dea6a2dd-2652-4c7b-bcd3-a5621c7f71f6 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:00.085993 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dea6a2dd-2652-4c7b-bcd3-a5621c7f71f6 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:00.086748 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dea6a2dd-2652-4c7b-bcd3-a5621c7f71f6 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:00.089266 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dea6a2dd-2652-4c7b-bcd3-a5621c7f71f6 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:00.602096 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-be15928d-0f0e-47ed-ad48-d81d22f0fe5c tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:00.619714 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-be15928d-0f0e-47ed-ad48-d81d22f0fe5c tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4" status: 200 len: 1522 microversion: 2.1 time: 0.658414 Aug 27 02:54:00.633231 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1397/2793] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:59 2022] GET /compute/v2.1/servers/97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4 => generated 1522 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:00.645247 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ef187ac2-292c-4cac-9e3d-14448d8f724c tempest-QuotasAdminTestJSON-956326715 tempest-QuotasAdminTestJSON-956326715-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:00.673749 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ef187ac2-292c-4cac-9e3d-14448d8f724c tempest-QuotasAdminTestJSON-956326715 tempest-QuotasAdminTestJSON-956326715-project-admin] 10.222.0.70 "DELETE /compute/v2.1/os-quota-sets/036bcce7964340598a341c015a054ca8" status: 202 len: 0 microversion: 2.1 time: 0.035495 Aug 27 02:54:00.674761 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1398/2794] 10.222.0.70 () {58 vars in 1245 bytes} [Sat Aug 27 02:54:00 2022] DELETE /compute/v2.1/os-quota-sets/036bcce7964340598a341c015a054ca8 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:54:00.684078 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-bd6fe9c8-c9f4-4f52-805f-9f8686f56ebe tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:00.685130 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-bd6fe9c8-c9f4-4f52-805f-9f8686f56ebe tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] [instance: 7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:00.695145 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bd6fe9c8-c9f4-4f52-805f-9f8686f56ebe tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:00.696933 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bd6fe9c8-c9f4-4f52-805f-9f8686f56ebe tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:00.697919 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bd6fe9c8-c9f4-4f52-805f-9f8686f56ebe tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:00.700447 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bd6fe9c8-c9f4-4f52-805f-9f8686f56ebe tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:00.701491 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bd6fe9c8-c9f4-4f52-805f-9f8686f56ebe tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:00.702398 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bd6fe9c8-c9f4-4f52-805f-9f8686f56ebe tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:01.024253 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-bd6fe9c8-c9f4-4f52-805f-9f8686f56ebe tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317e74b4bbc4da298a0dcbd78068352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a8810c21784788b4c0ee64dedbaf15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:01.038380 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-bd6fe9c8-c9f4-4f52-805f-9f8686f56ebe tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] 10.222.0.70 "GET /compute/v2.1/servers/7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8" status: 200 len: 1506 microversion: 2.1 time: 0.361554 Aug 27 02:54:01.039458 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1399/2795] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:00 2022] GET /compute/v2.1/servers/7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8 => generated 1506 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:01.064800 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-72974dd9-5e77-4828-8c04-e6880003b828 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:01.066255 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-72974dd9-5e77-4828-8c04-e6880003b828 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] [instance: cb02560c-ca90-41f2-8e4a-1fe0f0494068] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:01.074578 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-72974dd9-5e77-4828-8c04-e6880003b828 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:01.075239 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-72974dd9-5e77-4828-8c04-e6880003b828 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:01.075844 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-72974dd9-5e77-4828-8c04-e6880003b828 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:01.077315 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-72974dd9-5e77-4828-8c04-e6880003b828 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:01.077914 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-72974dd9-5e77-4828-8c04-e6880003b828 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:01.078505 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-72974dd9-5e77-4828-8c04-e6880003b828 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:01.190691 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-dea6a2dd-2652-4c7b-bcd3-a5621c7f71f6 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:01.202349 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-dea6a2dd-2652-4c7b-bcd3-a5621c7f71f6 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/228b8015-1061-46f1-a6a3-c5d0ba039660" status: 200 len: 1315 microversion: 2.1 time: 1.192800 Aug 27 02:54:01.206146 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1397/2796] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:00 2022] GET /compute/v2.1/servers/228b8015-1061-46f1-a6a3-c5d0ba039660 => generated 1315 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:01.222477 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-553338fa-ec8a-41af-9c2f-e70c178c316e tempest-QuotasAdminTestJSON-956326715 tempest-QuotasAdminTestJSON-956326715-project-admin] Calling method '.version_select at 0x7f5edeb46a60>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:01.288392 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-72974dd9-5e77-4828-8c04-e6880003b828 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f496f24dccea47bd9a5ab532fe45e370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40794f05e8b94a0f8f087a87a58e0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:01.298549 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-72974dd9-5e77-4828-8c04-e6880003b828 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "GET /compute/v2.1/servers/cb02560c-ca90-41f2-8e4a-1fe0f0494068" status: 200 len: 1264 microversion: 2.1 time: 0.241269 Aug 27 02:54:01.304063 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1400/2797] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:01 2022] GET /compute/v2.1/servers/cb02560c-ca90-41f2-8e4a-1fe0f0494068 => generated 1264 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:01.317470 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f5563815-a6c4-445a-a6ec-b2ea4d89b379 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:01.318751 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-f5563815-a6c4-445a-a6ec-b2ea4d89b379 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] [instance: 7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:01.338850 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f5563815-a6c4-445a-a6ec-b2ea4d89b379 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:01.339708 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f5563815-a6c4-445a-a6ec-b2ea4d89b379 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:01.341874 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f5563815-a6c4-445a-a6ec-b2ea4d89b379 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:01.343072 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f5563815-a6c4-445a-a6ec-b2ea4d89b379 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:01.346344 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f5563815-a6c4-445a-a6ec-b2ea4d89b379 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:01.348640 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f5563815-a6c4-445a-a6ec-b2ea4d89b379 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:01.436384 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-f5563815-a6c4-445a-a6ec-b2ea4d89b379 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] [instance: 7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8] Going to try to terminate instance {{(pid=134052) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:54:01.588126 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:54:01.718459 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f5563815-a6c4-445a-a6ec-b2ea4d89b379 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] 10.222.0.70 "DELETE /compute/v2.1/servers/7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8" status: 204 len: 0 microversion: 2.1 time: 0.412463 Aug 27 02:54:01.727310 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1401/2798] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:54:01 2022] DELETE /compute/v2.1/servers/7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:54:01.735438 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d386009f-d6c9-4c72-9d62-9456c78a8a20 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:01.757695 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d386009f-d6c9-4c72-9d62-9456c78a8a20 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: 97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:01.777685 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d386009f-d6c9-4c72-9d62-9456c78a8a20 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:01.778201 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d386009f-d6c9-4c72-9d62-9456c78a8a20 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:01.778631 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d386009f-d6c9-4c72-9d62-9456c78a8a20 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:01.779416 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d386009f-d6c9-4c72-9d62-9456c78a8a20 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:01.779876 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d386009f-d6c9-4c72-9d62-9456c78a8a20 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:01.780300 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d386009f-d6c9-4c72-9d62-9456c78a8a20 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:01.891604 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-553338fa-ec8a-41af-9c2f-e70c178c316e tempest-QuotasAdminTestJSON-956326715 tempest-QuotasAdminTestJSON-956326715-project-admin] 10.222.0.70 "GET /compute/v2.1/os-quota-sets/036bcce7964340598a341c015a054ca8" status: 200 len: 371 microversion: 2.1 time: 0.683840 Aug 27 02:54:01.907132 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1398/2799] 10.222.0.70 () {58 vars in 1242 bytes} [Sat Aug 27 02:54:01 2022] GET /compute/v2.1/os-quota-sets/036bcce7964340598a341c015a054ca8 => generated 371 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:54:02.001078 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-f918c437-e762-4894-98f8-d38c7edea646 req-84efd3f7-40ea-449b-b82f-1971003eb64e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "228b8015-1061-46f1-a6a3-c5d0ba039660", "tag": "f4187e0f-f8d2-4cd3-996d-70d701cfa1f0"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:54:02.022347 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-f918c437-e762-4894-98f8-d38c7edea646 req-84efd3f7-40ea-449b-b82f-1971003eb64e service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:02.028195 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-f918c437-e762-4894-98f8-d38c7edea646 req-84efd3f7-40ea-449b-b82f-1971003eb64e service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:02.028800 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-f918c437-e762-4894-98f8-d38c7edea646 req-84efd3f7-40ea-449b-b82f-1971003eb64e service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:02.052363 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-f918c437-e762-4894-98f8-d38c7edea646 req-84efd3f7-40ea-449b-b82f-1971003eb64e service nova] Creating event network-changed:f4187e0f-f8d2-4cd3-996d-70d701cfa1f0 for instance 228b8015-1061-46f1-a6a3-c5d0ba039660 on n-h1-852278-4 Aug 27 02:54:02.071817 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-f918c437-e762-4894-98f8-d38c7edea646 req-84efd3f7-40ea-449b-b82f-1971003eb64e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074929 Aug 27 02:54:02.073686 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1399/2800] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:54:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:54:02.156284 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8ca5764a-adb9-4489-9328-0584235d4023 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-2092721979", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "networks": [{"uuid": "ebe7b2b2-924f-4033-b3f1-0cce3bc68ae5"}]}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:54:02.303654 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.network.neutron [None req-8ca5764a-adb9-4489-9328-0584235d4023 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] validate_networks() for [('ebe7b2b2-924f-4033-b3f1-0cce3bc68ae5', None, None, None, None, None)] {{(pid=134051) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:54:02.515218 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-d386009f-d6c9-4c72-9d62-9456c78a8a20 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:02.530891 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d386009f-d6c9-4c72-9d62-9456c78a8a20 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4" status: 200 len: 1522 microversion: 2.1 time: 0.799668 Aug 27 02:54:02.535733 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1402/2801] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:01 2022] GET /compute/v2.1/servers/97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4 => generated 1522 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:02.561271 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8d4d9936-0c2a-4b97-a45f-5c0d1a9a9ac5 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:02.563461 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-8d4d9936-0c2a-4b97-a45f-5c0d1a9a9ac5 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 228b8015-1061-46f1-a6a3-c5d0ba039660] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:02.588526 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8d4d9936-0c2a-4b97-a45f-5c0d1a9a9ac5 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:02.589342 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8d4d9936-0c2a-4b97-a45f-5c0d1a9a9ac5 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:02.597823 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8d4d9936-0c2a-4b97-a45f-5c0d1a9a9ac5 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:02.599758 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8d4d9936-0c2a-4b97-a45f-5c0d1a9a9ac5 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:02.602007 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8d4d9936-0c2a-4b97-a45f-5c0d1a9a9ac5 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:02.602815 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8d4d9936-0c2a-4b97-a45f-5c0d1a9a9ac5 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:03.206681 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-8d4d9936-0c2a-4b97-a45f-5c0d1a9a9ac5 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:03.223381 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-8d4d9936-0c2a-4b97-a45f-5c0d1a9a9ac5 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/228b8015-1061-46f1-a6a3-c5d0ba039660" status: 200 len: 1315 microversion: 2.1 time: 0.684367 Aug 27 02:54:03.224098 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1403/2802] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:02 2022] GET /compute/v2.1/servers/228b8015-1061-46f1-a6a3-c5d0ba039660 => generated 1315 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:03.244650 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-7bfbca41-9910-4ee8-9620-fb6b7ec195ce tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:03.245428 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-7bfbca41-9910-4ee8-9620-fb6b7ec195ce tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] [instance: cb02560c-ca90-41f2-8e4a-1fe0f0494068] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:03.270505 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7bfbca41-9910-4ee8-9620-fb6b7ec195ce tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:03.291573 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7bfbca41-9910-4ee8-9620-fb6b7ec195ce tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:03.292240 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7bfbca41-9910-4ee8-9620-fb6b7ec195ce tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:03.294476 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7bfbca41-9910-4ee8-9620-fb6b7ec195ce tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:03.299519 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7bfbca41-9910-4ee8-9620-fb6b7ec195ce tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:03.300579 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7bfbca41-9910-4ee8-9620-fb6b7ec195ce tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:03.943422 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-7bfbca41-9910-4ee8-9620-fb6b7ec195ce tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f496f24dccea47bd9a5ab532fe45e370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40794f05e8b94a0f8f087a87a58e0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:03.954400 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-7bfbca41-9910-4ee8-9620-fb6b7ec195ce tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "GET /compute/v2.1/servers/cb02560c-ca90-41f2-8e4a-1fe0f0494068" status: 200 len: 1306 microversion: 2.1 time: 0.728853 Aug 27 02:54:03.954930 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1404/2803] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:03 2022] GET /compute/v2.1/servers/cb02560c-ca90-41f2-8e4a-1fe0f0494068 => generated 1306 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:03.973992 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-883057da-5253-4e87-be8c-a148299cbc4d tempest-QuotasAdminTestJSON-956326715 tempest-QuotasAdminTestJSON-956326715-project-admin] Calling method '.version_select at 0x7f5ee3811670>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:04.447111 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-883057da-5253-4e87-be8c-a148299cbc4d tempest-QuotasAdminTestJSON-956326715 tempest-QuotasAdminTestJSON-956326715-project-admin] 10.222.0.70 "GET /compute/v2.1/os-quota-sets/7edb2bdfecf443ba85215816329a1fc0/defaults" status: 200 len: 371 microversion: 2.1 time: 0.489585 Aug 27 02:54:04.456959 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1405/2804] 10.222.0.70 () {58 vars in 1269 bytes} [Sat Aug 27 02:54:03 2022] GET /compute/v2.1/os-quota-sets/7edb2bdfecf443ba85215816329a1fc0/defaults => generated 371 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:54:04.472264 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8c8de767-9f48-40ad-aa5d-90d5450f9148 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:04.473051 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-8c8de767-9f48-40ad-aa5d-90d5450f9148 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: 97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:04.486879 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8c8de767-9f48-40ad-aa5d-90d5450f9148 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:04.490074 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8c8de767-9f48-40ad-aa5d-90d5450f9148 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:04.490074 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8c8de767-9f48-40ad-aa5d-90d5450f9148 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:04.493206 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8c8de767-9f48-40ad-aa5d-90d5450f9148 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:04.493775 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8c8de767-9f48-40ad-aa5d-90d5450f9148 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:04.494174 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8c8de767-9f48-40ad-aa5d-90d5450f9148 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:04.883100 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-8ca5764a-adb9-4489-9328-0584235d4023 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Flavor limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:54:04.883774 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-8ca5764a-adb9-4489-9328-0584235d4023 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Image limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:54:04.884008 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-8ca5764a-adb9-4489-9328-0584235d4023 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Flavor pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:54:04.884450 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-8ca5764a-adb9-4489-9328-0584235d4023 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Image pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:54:04.884948 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-8ca5764a-adb9-4489-9328-0584235d4023 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:54:04.926711 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8ca5764a-adb9-4489-9328-0584235d4023 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:04.927227 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8ca5764a-adb9-4489-9328-0584235d4023 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:04.927715 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8ca5764a-adb9-4489-9328-0584235d4023 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:04.928922 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8ca5764a-adb9-4489-9328-0584235d4023 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:04.929380 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8ca5764a-adb9-4489-9328-0584235d4023 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:04.929804 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8ca5764a-adb9-4489-9328-0584235d4023 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:05.043580 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-8ca5764a-adb9-4489-9328-0584235d4023 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Getting quotas for project c5a8810c21784788b4c0ee64dedbaf15. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:54:05.073717 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-8ca5764a-adb9-4489-9328-0584235d4023 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Getting quotas for user d317e74b4bbc4da298a0dcbd78068352 and project c5a8810c21784788b4c0ee64dedbaf15. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:54:05.124371 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-8ca5764a-adb9-4489-9328-0584235d4023 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Going to run 1 instances... {{(pid=134051) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:54:05.128297 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-8ca5764a-adb9-4489-9328-0584235d4023 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] [instance: dc54b06e-43a5-4450-bf3c-d9949dcf04b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134051) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:54:05.197839 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-8c8de767-9f48-40ad-aa5d-90d5450f9148 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:05.220838 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-8c8de767-9f48-40ad-aa5d-90d5450f9148 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4" status: 200 len: 1522 microversion: 2.1 time: 0.762975 Aug 27 02:54:05.221461 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1406/2805] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:04 2022] GET /compute/v2.1/servers/97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4 => generated 1522 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:05.241839 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-52b75fd5-1f98-4918-924c-7cccca31c1d4 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:05.242472 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-52b75fd5-1f98-4918-924c-7cccca31c1d4 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 228b8015-1061-46f1-a6a3-c5d0ba039660] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:05.265939 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=10,nova_api:UPDATE=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:54:05.275165 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-52b75fd5-1f98-4918-924c-7cccca31c1d4 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:05.275662 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-52b75fd5-1f98-4918-924c-7cccca31c1d4 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:05.276142 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-52b75fd5-1f98-4918-924c-7cccca31c1d4 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:05.277028 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-52b75fd5-1f98-4918-924c-7cccca31c1d4 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:05.277501 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-52b75fd5-1f98-4918-924c-7cccca31c1d4 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:05.277938 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-52b75fd5-1f98-4918-924c-7cccca31c1d4 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:05.336460 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-8ca5764a-adb9-4489-9328-0584235d4023 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.185018 Aug 27 02:54:05.342501 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1400/2806] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 02:54:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 3192 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:54:05.363349 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-5bb3e5e0-6902-4769-ac9a-26c5a49d488b tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:05.371573 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-5bb3e5e0-6902-4769-ac9a-26c5a49d488b tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] [instance: cb02560c-ca90-41f2-8e4a-1fe0f0494068] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:05.400433 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5bb3e5e0-6902-4769-ac9a-26c5a49d488b tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:05.403054 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5bb3e5e0-6902-4769-ac9a-26c5a49d488b tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:05.403721 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5bb3e5e0-6902-4769-ac9a-26c5a49d488b tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:05.408875 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5bb3e5e0-6902-4769-ac9a-26c5a49d488b tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:05.412353 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5bb3e5e0-6902-4769-ac9a-26c5a49d488b tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:05.413023 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5bb3e5e0-6902-4769-ac9a-26c5a49d488b tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:07.094229 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-5bb3e5e0-6902-4769-ac9a-26c5a49d488b tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f496f24dccea47bd9a5ab532fe45e370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40794f05e8b94a0f8f087a87a58e0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:07.111607 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-5bb3e5e0-6902-4769-ac9a-26c5a49d488b tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "GET /compute/v2.1/servers/cb02560c-ca90-41f2-8e4a-1fe0f0494068" status: 200 len: 1306 microversion: 2.1 time: 1.766642 Aug 27 02:54:07.113026 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1401/2807] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:05 2022] GET /compute/v2.1/servers/cb02560c-ca90-41f2-8e4a-1fe0f0494068 => generated 1306 bytes in 1770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:07.128522 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ca94add2-8814-41e9-9c1d-ec821bd542de tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:07.129384 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-ca94add2-8814-41e9-9c1d-ec821bd542de tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] [instance: dc54b06e-43a5-4450-bf3c-d9949dcf04b1] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:07.146877 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ca94add2-8814-41e9-9c1d-ec821bd542de tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:07.149201 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ca94add2-8814-41e9-9c1d-ec821bd542de tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:07.151861 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ca94add2-8814-41e9-9c1d-ec821bd542de tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:07.152904 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ca94add2-8814-41e9-9c1d-ec821bd542de tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:07.154132 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ca94add2-8814-41e9-9c1d-ec821bd542de tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:07.156206 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ca94add2-8814-41e9-9c1d-ec821bd542de tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:07.226217 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-52b75fd5-1f98-4918-924c-7cccca31c1d4 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:07.247297 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-52b75fd5-1f98-4918-924c-7cccca31c1d4 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/228b8015-1061-46f1-a6a3-c5d0ba039660" status: 200 len: 1315 microversion: 2.1 time: 2.021371 Aug 27 02:54:07.249655 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1407/2808] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:05 2022] GET /compute/v2.1/servers/228b8015-1061-46f1-a6a3-c5d0ba039660 => generated 1315 bytes in 2028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:07.296804 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-690e6257-d288-4597-b931-fbff65cb43b7 tempest-QuotasAdminTestJSON-956326715 tempest-QuotasAdminTestJSON-956326715-project-admin] Action: 'update', calling method: .version_select at 0x7f5ee2dffe50>, body: {"quota_set": {"ram": "5120"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:54:07.373053 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-ca94add2-8814-41e9-9c1d-ec821bd542de tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317e74b4bbc4da298a0dcbd78068352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a8810c21784788b4c0ee64dedbaf15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:07.384689 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ca94add2-8814-41e9-9c1d-ec821bd542de tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] 10.222.0.70 "GET /compute/v2.1/servers/dc54b06e-43a5-4450-bf3c-d9949dcf04b1" status: 200 len: 1270 microversion: 2.1 time: 0.268232 Aug 27 02:54:07.385733 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1402/2809] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:07 2022] GET /compute/v2.1/servers/dc54b06e-43a5-4450-bf3c-d9949dcf04b1 => generated 1270 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:07.398868 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-d7d1372d-a192-408c-8cff-0764bbf686e8 req-26b802ec-c0f7-4a4a-b194-1cc8e5151f07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8", "name": "network-vif-deleted", "tag": "dee4c86c-595f-441d-ba5f-4bf6d022ab1a"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:54:07.449863 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-d7d1372d-a192-408c-8cff-0764bbf686e8 req-26b802ec-c0f7-4a4a-b194-1cc8e5151f07 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:07.451851 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-d7d1372d-a192-408c-8cff-0764bbf686e8 req-26b802ec-c0f7-4a4a-b194-1cc8e5151f07 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:07.453968 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-d7d1372d-a192-408c-8cff-0764bbf686e8 req-26b802ec-c0f7-4a4a-b194-1cc8e5151f07 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:07.481031 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-d7d1372d-a192-408c-8cff-0764bbf686e8 req-26b802ec-c0f7-4a4a-b194-1cc8e5151f07 service nova] Creating event network-vif-deleted:dee4c86c-595f-441d-ba5f-4bf6d022ab1a for instance 7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8 on n-h1-852278-4 Aug 27 02:54:07.487314 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-d7d1372d-a192-408c-8cff-0764bbf686e8 req-26b802ec-c0f7-4a4a-b194-1cc8e5151f07 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099530 Aug 27 02:54:07.488467 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1403/2810] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:54:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:54:07.495086 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-1442311b-333f-4e81-a559-e142fdd2e9f1 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:07.497166 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-1442311b-333f-4e81-a559-e142fdd2e9f1 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: 97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:07.509149 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1442311b-333f-4e81-a559-e142fdd2e9f1 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:07.510259 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1442311b-333f-4e81-a559-e142fdd2e9f1 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:07.510930 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1442311b-333f-4e81-a559-e142fdd2e9f1 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:07.512156 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1442311b-333f-4e81-a559-e142fdd2e9f1 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:07.512936 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1442311b-333f-4e81-a559-e142fdd2e9f1 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:07.514109 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1442311b-333f-4e81-a559-e142fdd2e9f1 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:08.008172 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-1442311b-333f-4e81-a559-e142fdd2e9f1 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:08.032088 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-1442311b-333f-4e81-a559-e142fdd2e9f1 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4" status: 200 len: 1522 microversion: 2.1 time: 0.534505 Aug 27 02:54:08.034546 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1404/2811] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:07 2022] GET /compute/v2.1/servers/97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4 => generated 1522 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:08.134512 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-690e6257-d288-4597-b931-fbff65cb43b7 tempest-QuotasAdminTestJSON-956326715 tempest-QuotasAdminTestJSON-956326715-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:08.134988 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-690e6257-d288-4597-b931-fbff65cb43b7 tempest-QuotasAdminTestJSON-956326715 tempest-QuotasAdminTestJSON-956326715-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:08.136655 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4035f409-d117-45ce-aecc-0eee75657fb6 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:08.138603 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-4035f409-d117-45ce-aecc-0eee75657fb6 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] [instance: cb02560c-ca90-41f2-8e4a-1fe0f0494068] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:08.141466 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-690e6257-d288-4597-b931-fbff65cb43b7 tempest-QuotasAdminTestJSON-956326715 tempest-QuotasAdminTestJSON-956326715-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:08.146888 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4035f409-d117-45ce-aecc-0eee75657fb6 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:08.147073 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-690e6257-d288-4597-b931-fbff65cb43b7 tempest-QuotasAdminTestJSON-956326715 tempest-QuotasAdminTestJSON-956326715-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:08.147540 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-690e6257-d288-4597-b931-fbff65cb43b7 tempest-QuotasAdminTestJSON-956326715 tempest-QuotasAdminTestJSON-956326715-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:08.147969 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-690e6257-d288-4597-b931-fbff65cb43b7 tempest-QuotasAdminTestJSON-956326715 tempest-QuotasAdminTestJSON-956326715-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:08.148257 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4035f409-d117-45ce-aecc-0eee75657fb6 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:08.148923 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4035f409-d117-45ce-aecc-0eee75657fb6 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:08.149840 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4035f409-d117-45ce-aecc-0eee75657fb6 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:08.150529 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4035f409-d117-45ce-aecc-0eee75657fb6 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:08.151440 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4035f409-d117-45ce-aecc-0eee75657fb6 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:08.332685 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-690e6257-d288-4597-b931-fbff65cb43b7 tempest-QuotasAdminTestJSON-956326715 tempest-QuotasAdminTestJSON-956326715-project-admin] 10.222.0.70 "PUT /compute/v2.1/os-quota-sets/0d81512ee3f54c60859876b6fe284e69" status: 200 len: 328 microversion: 2.1 time: 1.081806 Aug 27 02:54:08.337728 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1408/2812] 10.222.0.70 () {60 vars in 1262 bytes} [Sat Aug 27 02:54:07 2022] PUT /compute/v2.1/os-quota-sets/0d81512ee3f54c60859876b6fe284e69 => generated 328 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:54:08.354302 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-16b9795b-a9ec-486e-9601-f9346530c273 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:08.355735 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-16b9795b-a9ec-486e-9601-f9346530c273 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 228b8015-1061-46f1-a6a3-c5d0ba039660] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:08.376056 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-16b9795b-a9ec-486e-9601-f9346530c273 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:08.378095 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-16b9795b-a9ec-486e-9601-f9346530c273 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:08.380645 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-16b9795b-a9ec-486e-9601-f9346530c273 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:08.381557 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-16b9795b-a9ec-486e-9601-f9346530c273 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:08.382839 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-16b9795b-a9ec-486e-9601-f9346530c273 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:08.383465 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-16b9795b-a9ec-486e-9601-f9346530c273 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:08.604640 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-4035f409-d117-45ce-aecc-0eee75657fb6 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f496f24dccea47bd9a5ab532fe45e370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40794f05e8b94a0f8f087a87a58e0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:08.617692 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-4035f409-d117-45ce-aecc-0eee75657fb6 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "GET /compute/v2.1/servers/cb02560c-ca90-41f2-8e4a-1fe0f0494068" status: 200 len: 1306 microversion: 2.1 time: 0.484775 Aug 27 02:54:08.620963 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1405/2813] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:08 2022] GET /compute/v2.1/servers/cb02560c-ca90-41f2-8e4a-1fe0f0494068 => generated 1306 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:54:08.632273 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-de33b455-c591-4c7d-a947-36e5bbdc0f5b tempest-QuotasAdminTestJSON-956326715 tempest-QuotasAdminTestJSON-956326715-project-admin] Calling method '.version_select at 0x7f5ede2b0b80>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:08.867177 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-16b9795b-a9ec-486e-9601-f9346530c273 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:08.883393 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-16b9795b-a9ec-486e-9601-f9346530c273 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/228b8015-1061-46f1-a6a3-c5d0ba039660" status: 200 len: 1315 microversion: 2.1 time: 0.544289 Aug 27 02:54:08.896425 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1409/2814] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:08 2022] GET /compute/v2.1/servers/228b8015-1061-46f1-a6a3-c5d0ba039660 => generated 1315 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:08.914528 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-660ca511-b781-4d33-b62c-e96cd33466e7 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:08.926377 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-660ca511-b781-4d33-b62c-e96cd33466e7 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] [instance: dc54b06e-43a5-4450-bf3c-d9949dcf04b1] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:08.943540 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-660ca511-b781-4d33-b62c-e96cd33466e7 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:08.945450 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-660ca511-b781-4d33-b62c-e96cd33466e7 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:08.946206 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-660ca511-b781-4d33-b62c-e96cd33466e7 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:08.950512 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-660ca511-b781-4d33-b62c-e96cd33466e7 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:08.951512 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-660ca511-b781-4d33-b62c-e96cd33466e7 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:08.953000 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-660ca511-b781-4d33-b62c-e96cd33466e7 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:09.095099 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-660ca511-b781-4d33-b62c-e96cd33466e7 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317e74b4bbc4da298a0dcbd78068352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a8810c21784788b4c0ee64dedbaf15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:09.112775 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-660ca511-b781-4d33-b62c-e96cd33466e7 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] 10.222.0.70 "GET /compute/v2.1/servers/dc54b06e-43a5-4450-bf3c-d9949dcf04b1" status: 200 len: 1276 microversion: 2.1 time: 0.206897 Aug 27 02:54:09.113571 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1410/2815] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:08 2022] GET /compute/v2.1/servers/dc54b06e-43a5-4450-bf3c-d9949dcf04b1 => generated 1276 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:09.120270 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c5e5f1a1-e83b-4b4c-9ac8-d743b88ca5a3 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:09.121118 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-c5e5f1a1-e83b-4b4c-9ac8-d743b88ca5a3 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: 97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:09.141306 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c5e5f1a1-e83b-4b4c-9ac8-d743b88ca5a3 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:09.142464 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c5e5f1a1-e83b-4b4c-9ac8-d743b88ca5a3 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:09.147568 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c5e5f1a1-e83b-4b4c-9ac8-d743b88ca5a3 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:09.150173 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c5e5f1a1-e83b-4b4c-9ac8-d743b88ca5a3 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:09.152575 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c5e5f1a1-e83b-4b4c-9ac8-d743b88ca5a3 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:09.154413 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c5e5f1a1-e83b-4b4c-9ac8-d743b88ca5a3 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:09.263743 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-de33b455-c591-4c7d-a947-36e5bbdc0f5b tempest-QuotasAdminTestJSON-956326715 tempest-QuotasAdminTestJSON-956326715-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:09.265907 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-de33b455-c591-4c7d-a947-36e5bbdc0f5b tempest-QuotasAdminTestJSON-956326715 tempest-QuotasAdminTestJSON-956326715-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:09.266473 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-de33b455-c591-4c7d-a947-36e5bbdc0f5b tempest-QuotasAdminTestJSON-956326715 tempest-QuotasAdminTestJSON-956326715-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:09.268180 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-de33b455-c591-4c7d-a947-36e5bbdc0f5b tempest-QuotasAdminTestJSON-956326715 tempest-QuotasAdminTestJSON-956326715-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:09.270290 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-de33b455-c591-4c7d-a947-36e5bbdc0f5b tempest-QuotasAdminTestJSON-956326715 tempest-QuotasAdminTestJSON-956326715-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:09.271043 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-de33b455-c591-4c7d-a947-36e5bbdc0f5b tempest-QuotasAdminTestJSON-956326715 tempest-QuotasAdminTestJSON-956326715-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:09.339593 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-de33b455-c591-4c7d-a947-36e5bbdc0f5b tempest-QuotasAdminTestJSON-956326715 tempest-QuotasAdminTestJSON-956326715-project-admin] 10.222.0.70 "GET /compute/v2.1/os-quota-sets/0d81512ee3f54c60859876b6fe284e69/detail" status: 200 len: 916 microversion: 2.1 time: 0.716645 Aug 27 02:54:09.342968 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1406/2816] 10.222.0.70 () {58 vars in 1263 bytes} [Sat Aug 27 02:54:08 2022] GET /compute/v2.1/os-quota-sets/0d81512ee3f54c60859876b6fe284e69/detail => generated 916 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:54:09.533329 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-6175c189-df6c-46ef-8449-107c3358f78b req-b05359ca-d9ec-4b9a-b125-5062c62386f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb02560c-ca90-41f2-8e4a-1fe0f0494068", "tag": "6bd7f222-246e-43d7-af80-a8892ef8ad8b"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:54:09.560430 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-6175c189-df6c-46ef-8449-107c3358f78b req-b05359ca-d9ec-4b9a-b125-5062c62386f3 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:09.566750 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-6175c189-df6c-46ef-8449-107c3358f78b req-b05359ca-d9ec-4b9a-b125-5062c62386f3 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:09.568959 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-6175c189-df6c-46ef-8449-107c3358f78b req-b05359ca-d9ec-4b9a-b125-5062c62386f3 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:09.599867 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-6175c189-df6c-46ef-8449-107c3358f78b req-b05359ca-d9ec-4b9a-b125-5062c62386f3 service nova] Creating event network-changed:6bd7f222-246e-43d7-af80-a8892ef8ad8b for instance cb02560c-ca90-41f2-8e4a-1fe0f0494068 on n-h2-852278-4 Aug 27 02:54:09.614037 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-6175c189-df6c-46ef-8449-107c3358f78b req-b05359ca-d9ec-4b9a-b125-5062c62386f3 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087435 Aug 27 02:54:09.619843 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1407/2817] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:54:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:54:09.657618 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b6168bee-ccfb-4ff3-af82-f5d75d705362 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:09.659287 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b6168bee-ccfb-4ff3-af82-f5d75d705362 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] [instance: cb02560c-ca90-41f2-8e4a-1fe0f0494068] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:09.673659 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b6168bee-ccfb-4ff3-af82-f5d75d705362 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:09.674535 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b6168bee-ccfb-4ff3-af82-f5d75d705362 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:09.675673 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b6168bee-ccfb-4ff3-af82-f5d75d705362 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:09.696830 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b6168bee-ccfb-4ff3-af82-f5d75d705362 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:09.700221 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b6168bee-ccfb-4ff3-af82-f5d75d705362 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:09.701251 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b6168bee-ccfb-4ff3-af82-f5d75d705362 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:09.913293 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-c5e5f1a1-e83b-4b4c-9ac8-d743b88ca5a3 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:09.925314 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c5e5f1a1-e83b-4b4c-9ac8-d743b88ca5a3 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4" status: 200 len: 1522 microversion: 2.1 time: 0.808962 Aug 27 02:54:09.927930 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1411/2818] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:09 2022] GET /compute/v2.1/servers/97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4 => generated 1522 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:09.933781 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-18ef45cb-fc44-4d71-bff6-1c2cd8b836e2 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:09.934591 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-18ef45cb-fc44-4d71-bff6-1c2cd8b836e2 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 228b8015-1061-46f1-a6a3-c5d0ba039660] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:09.951034 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-18ef45cb-fc44-4d71-bff6-1c2cd8b836e2 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:09.955223 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-18ef45cb-fc44-4d71-bff6-1c2cd8b836e2 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:09.964834 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-18ef45cb-fc44-4d71-bff6-1c2cd8b836e2 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:09.968742 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-18ef45cb-fc44-4d71-bff6-1c2cd8b836e2 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:09.974723 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-18ef45cb-fc44-4d71-bff6-1c2cd8b836e2 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:09.975451 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-18ef45cb-fc44-4d71-bff6-1c2cd8b836e2 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:10.702081 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-b6168bee-ccfb-4ff3-af82-f5d75d705362 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f496f24dccea47bd9a5ab532fe45e370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40794f05e8b94a0f8f087a87a58e0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:10.714739 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b6168bee-ccfb-4ff3-af82-f5d75d705362 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "GET /compute/v2.1/servers/cb02560c-ca90-41f2-8e4a-1fe0f0494068" status: 200 len: 1306 microversion: 2.1 time: 1.069090 Aug 27 02:54:10.732404 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1408/2819] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:09 2022] GET /compute/v2.1/servers/cb02560c-ca90-41f2-8e4a-1fe0f0494068 => generated 1306 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:10.744011 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a0422483-3a3a-467a-aa0c-70c224efcd3f tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:10.745293 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-a0422483-3a3a-467a-aa0c-70c224efcd3f tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] [instance: dc54b06e-43a5-4450-bf3c-d9949dcf04b1] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:10.756574 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a0422483-3a3a-467a-aa0c-70c224efcd3f tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:10.757425 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a0422483-3a3a-467a-aa0c-70c224efcd3f tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:10.758126 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a0422483-3a3a-467a-aa0c-70c224efcd3f tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:10.759059 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a0422483-3a3a-467a-aa0c-70c224efcd3f tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:10.759704 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a0422483-3a3a-467a-aa0c-70c224efcd3f tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:10.760348 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a0422483-3a3a-467a-aa0c-70c224efcd3f tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:10.788648 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:54:11.012735 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-18ef45cb-fc44-4d71-bff6-1c2cd8b836e2 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:11.022518 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-18ef45cb-fc44-4d71-bff6-1c2cd8b836e2 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/228b8015-1061-46f1-a6a3-c5d0ba039660" status: 200 len: 1315 microversion: 2.1 time: 1.092092 Aug 27 02:54:11.023127 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1412/2820] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:09 2022] GET /compute/v2.1/servers/228b8015-1061-46f1-a6a3-c5d0ba039660 => generated 1315 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:11.028119 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-70caf399-279d-496b-9d90-6008c3efde55 tempest-QuotasAdminTestJSON-956326715 tempest-QuotasAdminTestJSON-956326715-project-admin] Action: 'update', calling method: .version_select at 0x7f5ee26b1ee0>, body: {"quota_set": {"ram": "2048"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:54:11.582262 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-70caf399-279d-496b-9d90-6008c3efde55 tempest-QuotasAdminTestJSON-956326715 tempest-QuotasAdminTestJSON-956326715-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:11.582996 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-70caf399-279d-496b-9d90-6008c3efde55 tempest-QuotasAdminTestJSON-956326715 tempest-QuotasAdminTestJSON-956326715-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:11.585306 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-70caf399-279d-496b-9d90-6008c3efde55 tempest-QuotasAdminTestJSON-956326715 tempest-QuotasAdminTestJSON-956326715-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:11.594346 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-70caf399-279d-496b-9d90-6008c3efde55 tempest-QuotasAdminTestJSON-956326715 tempest-QuotasAdminTestJSON-956326715-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:11.594905 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-70caf399-279d-496b-9d90-6008c3efde55 tempest-QuotasAdminTestJSON-956326715 tempest-QuotasAdminTestJSON-956326715-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:11.595348 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-70caf399-279d-496b-9d90-6008c3efde55 tempest-QuotasAdminTestJSON-956326715 tempest-QuotasAdminTestJSON-956326715-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:11.697795 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-a0422483-3a3a-467a-aa0c-70c224efcd3f tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317e74b4bbc4da298a0dcbd78068352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a8810c21784788b4c0ee64dedbaf15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:11.698735 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-70caf399-279d-496b-9d90-6008c3efde55 tempest-QuotasAdminTestJSON-956326715 tempest-QuotasAdminTestJSON-956326715-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:11.699837 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-70caf399-279d-496b-9d90-6008c3efde55 tempest-QuotasAdminTestJSON-956326715 tempest-QuotasAdminTestJSON-956326715-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:11.700966 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-70caf399-279d-496b-9d90-6008c3efde55 tempest-QuotasAdminTestJSON-956326715 tempest-QuotasAdminTestJSON-956326715-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:11.702234 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-70caf399-279d-496b-9d90-6008c3efde55 tempest-QuotasAdminTestJSON-956326715 tempest-QuotasAdminTestJSON-956326715-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:11.703537 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-70caf399-279d-496b-9d90-6008c3efde55 tempest-QuotasAdminTestJSON-956326715 tempest-QuotasAdminTestJSON-956326715-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:11.704385 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-70caf399-279d-496b-9d90-6008c3efde55 tempest-QuotasAdminTestJSON-956326715 tempest-QuotasAdminTestJSON-956326715-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:11.707778 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a0422483-3a3a-467a-aa0c-70c224efcd3f tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] 10.222.0.70 "GET /compute/v2.1/servers/dc54b06e-43a5-4450-bf3c-d9949dcf04b1" status: 200 len: 1318 microversion: 2.1 time: 0.973887 Aug 27 02:54:11.712213 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1409/2821] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:10 2022] GET /compute/v2.1/servers/dc54b06e-43a5-4450-bf3c-d9949dcf04b1 => generated 1318 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:11.723835 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e533bbd0-a6f6-49d0-a074-fb4663d03ae4 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:11.739743 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-e533bbd0-a6f6-49d0-a074-fb4663d03ae4 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: 97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:11.760883 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e533bbd0-a6f6-49d0-a074-fb4663d03ae4 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:11.763505 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e533bbd0-a6f6-49d0-a074-fb4663d03ae4 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:11.764173 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e533bbd0-a6f6-49d0-a074-fb4663d03ae4 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:11.767870 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e533bbd0-a6f6-49d0-a074-fb4663d03ae4 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:11.768868 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e533bbd0-a6f6-49d0-a074-fb4663d03ae4 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:11.771013 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e533bbd0-a6f6-49d0-a074-fb4663d03ae4 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:11.820607 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:54:11.866139 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-70caf399-279d-496b-9d90-6008c3efde55 tempest-QuotasAdminTestJSON-956326715 tempest-QuotasAdminTestJSON-956326715-project-admin] 10.222.0.70 "PUT /compute/v2.1/os-quota-sets/0d81512ee3f54c60859876b6fe284e69?user_id=a8e2f84e76594ca89cff34f4e0d23287" status: 200 len: 328 microversion: 2.1 time: 0.839191 Aug 27 02:54:11.868617 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1413/2822] 10.222.0.70 () {60 vars in 1343 bytes} [Sat Aug 27 02:54:11 2022] PUT /compute/v2.1/os-quota-sets/0d81512ee3f54c60859876b6fe284e69?user_id=a8e2f84e76594ca89cff34f4e0d23287 => generated 328 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:54:11.886317 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d71e610a-6eff-4b20-a42c-2e07cd7cfad8 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:11.887234 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d71e610a-6eff-4b20-a42c-2e07cd7cfad8 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] [instance: cb02560c-ca90-41f2-8e4a-1fe0f0494068] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:11.906426 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d71e610a-6eff-4b20-a42c-2e07cd7cfad8 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:11.907266 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d71e610a-6eff-4b20-a42c-2e07cd7cfad8 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:11.907504 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d71e610a-6eff-4b20-a42c-2e07cd7cfad8 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:11.926826 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d71e610a-6eff-4b20-a42c-2e07cd7cfad8 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:11.927312 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d71e610a-6eff-4b20-a42c-2e07cd7cfad8 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:11.933294 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d71e610a-6eff-4b20-a42c-2e07cd7cfad8 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:12.491610 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-d71e610a-6eff-4b20-a42c-2e07cd7cfad8 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f496f24dccea47bd9a5ab532fe45e370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40794f05e8b94a0f8f087a87a58e0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:12.503792 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d71e610a-6eff-4b20-a42c-2e07cd7cfad8 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "GET /compute/v2.1/servers/cb02560c-ca90-41f2-8e4a-1fe0f0494068" status: 200 len: 1306 microversion: 2.1 time: 0.633628 Aug 27 02:54:12.504363 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1414/2823] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:11 2022] GET /compute/v2.1/servers/cb02560c-ca90-41f2-8e4a-1fe0f0494068 => generated 1306 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:12.524997 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d4ae0034-eee5-457b-aac7-7568a5b983a7 tempest-QuotasAdminTestJSON-956326715 tempest-QuotasAdminTestJSON-956326715-project-admin] Calling method '.version_select at 0x7f5ee71f40d0>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:12.579448 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e533bbd0-a6f6-49d0-a074-fb4663d03ae4 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:12.593744 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e533bbd0-a6f6-49d0-a074-fb4663d03ae4 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4" status: 200 len: 1522 microversion: 2.1 time: 0.873600 Aug 27 02:54:12.599503 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1410/2824] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:11 2022] GET /compute/v2.1/servers/97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4 => generated 1522 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:12.612787 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4dd8db84-411d-4a22-819c-94eb13c3e300 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:12.613420 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-4dd8db84-411d-4a22-819c-94eb13c3e300 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 228b8015-1061-46f1-a6a3-c5d0ba039660] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:12.638522 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4dd8db84-411d-4a22-819c-94eb13c3e300 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:12.639026 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4dd8db84-411d-4a22-819c-94eb13c3e300 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:12.642276 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4dd8db84-411d-4a22-819c-94eb13c3e300 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:12.643038 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4dd8db84-411d-4a22-819c-94eb13c3e300 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:12.643503 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4dd8db84-411d-4a22-819c-94eb13c3e300 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:12.643931 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4dd8db84-411d-4a22-819c-94eb13c3e300 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:13.119790 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-4dd8db84-411d-4a22-819c-94eb13c3e300 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:13.136925 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-4dd8db84-411d-4a22-819c-94eb13c3e300 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/228b8015-1061-46f1-a6a3-c5d0ba039660" status: 200 len: 1315 microversion: 2.1 time: 0.532855 Aug 27 02:54:13.143034 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1411/2825] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:12 2022] GET /compute/v2.1/servers/228b8015-1061-46f1-a6a3-c5d0ba039660 => generated 1315 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:13.161356 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-bb7ac324-6113-4239-a304-9a2818c4da6e req-98380bf4-d456-4e89-be99-f2615205b052 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "228b8015-1061-46f1-a6a3-c5d0ba039660", "name": "network-vif-plugged", "status": "completed", "tag": "f4187e0f-f8d2-4cd3-996d-70d701cfa1f0"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:54:13.197256 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d4ae0034-eee5-457b-aac7-7568a5b983a7 tempest-QuotasAdminTestJSON-956326715 tempest-QuotasAdminTestJSON-956326715-project-admin] 10.222.0.70 "GET /compute/v2.1/os-quota-sets/0d81512ee3f54c60859876b6fe284e69?user_id=a8e2f84e76594ca89cff34f4e0d23287" status: 200 len: 370 microversion: 2.1 time: 0.678829 Aug 27 02:54:13.210785 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-bb7ac324-6113-4239-a304-9a2818c4da6e req-98380bf4-d456-4e89-be99-f2615205b052 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:13.212696 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1415/2826] 10.222.0.70 () {58 vars in 1323 bytes} [Sat Aug 27 02:54:12 2022] GET /compute/v2.1/os-quota-sets/0d81512ee3f54c60859876b6fe284e69?user_id=a8e2f84e76594ca89cff34f4e0d23287 => generated 370 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:54:13.218730 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-bb7ac324-6113-4239-a304-9a2818c4da6e req-98380bf4-d456-4e89-be99-f2615205b052 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:13.219554 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-bb7ac324-6113-4239-a304-9a2818c4da6e req-98380bf4-d456-4e89-be99-f2615205b052 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:13.223820 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0f2da5ec-d9f8-4590-8cba-18552f58f27a tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:13.227284 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-0f2da5ec-d9f8-4590-8cba-18552f58f27a tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] [instance: dc54b06e-43a5-4450-bf3c-d9949dcf04b1] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:13.241059 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0f2da5ec-d9f8-4590-8cba-18552f58f27a tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:13.243093 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0f2da5ec-d9f8-4590-8cba-18552f58f27a tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:13.244955 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0f2da5ec-d9f8-4590-8cba-18552f58f27a tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:13.248212 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0f2da5ec-d9f8-4590-8cba-18552f58f27a tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:13.249124 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0f2da5ec-d9f8-4590-8cba-18552f58f27a tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:13.249719 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0f2da5ec-d9f8-4590-8cba-18552f58f27a tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:13.265171 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-bb7ac324-6113-4239-a304-9a2818c4da6e req-98380bf4-d456-4e89-be99-f2615205b052 service nova] Creating event network-vif-plugged:f4187e0f-f8d2-4cd3-996d-70d701cfa1f0 for instance 228b8015-1061-46f1-a6a3-c5d0ba039660 on n-h1-852278-4 Aug 27 02:54:13.272688 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-bb7ac324-6113-4239-a304-9a2818c4da6e req-98380bf4-d456-4e89-be99-f2615205b052 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127718 Aug 27 02:54:13.282292 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1412/2827] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:54:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:54:13.494044 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-1eba965b-6d6f-4e42-8aa6-afd2bf1f79a6 req-354d49e1-835a-4051-b3f6-3a7ed87e23d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc54b06e-43a5-4450-bf3c-d9949dcf04b1", "tag": "e6026f69-48ad-496a-a661-91dce3b2f0ba"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:54:13.523544 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-1eba965b-6d6f-4e42-8aa6-afd2bf1f79a6 req-354d49e1-835a-4051-b3f6-3a7ed87e23d2 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:13.533779 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-1eba965b-6d6f-4e42-8aa6-afd2bf1f79a6 req-354d49e1-835a-4051-b3f6-3a7ed87e23d2 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:13.534406 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-1eba965b-6d6f-4e42-8aa6-afd2bf1f79a6 req-354d49e1-835a-4051-b3f6-3a7ed87e23d2 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:13.573393 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-1eba965b-6d6f-4e42-8aa6-afd2bf1f79a6 req-354d49e1-835a-4051-b3f6-3a7ed87e23d2 service nova] Creating event network-changed:e6026f69-48ad-496a-a661-91dce3b2f0ba for instance dc54b06e-43a5-4450-bf3c-d9949dcf04b1 on n-h2-852278-4 Aug 27 02:54:13.593604 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-1eba965b-6d6f-4e42-8aa6-afd2bf1f79a6 req-354d49e1-835a-4051-b3f6-3a7ed87e23d2 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100990 Aug 27 02:54:13.598088 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1413/2828] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:54:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:54:13.616365 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-48c4f565-0418-4696-ab86-e055a43da079 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:13.623441 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-48c4f565-0418-4696-ab86-e055a43da079 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] [instance: cb02560c-ca90-41f2-8e4a-1fe0f0494068] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:13.652115 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-48c4f565-0418-4696-ab86-e055a43da079 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:13.654262 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-48c4f565-0418-4696-ab86-e055a43da079 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:13.655282 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-48c4f565-0418-4696-ab86-e055a43da079 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:13.657744 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-48c4f565-0418-4696-ab86-e055a43da079 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:13.660622 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-48c4f565-0418-4696-ab86-e055a43da079 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:13.662617 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-48c4f565-0418-4696-ab86-e055a43da079 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:14.238983 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0f2da5ec-d9f8-4590-8cba-18552f58f27a tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317e74b4bbc4da298a0dcbd78068352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a8810c21784788b4c0ee64dedbaf15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:14.258700 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-0f2da5ec-d9f8-4590-8cba-18552f58f27a tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] 10.222.0.70 "GET /compute/v2.1/servers/dc54b06e-43a5-4450-bf3c-d9949dcf04b1" status: 200 len: 1318 microversion: 2.1 time: 1.040757 Aug 27 02:54:14.263450 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1416/2829] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:13 2022] GET /compute/v2.1/servers/dc54b06e-43a5-4450-bf3c-d9949dcf04b1 => generated 1318 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:14.309156 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-914d368a-7595-4775-8467-fd69b4b49d03 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:14.322107 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-914d368a-7595-4775-8467-fd69b4b49d03 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: 97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:14.349446 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-914d368a-7595-4775-8467-fd69b4b49d03 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:14.350775 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-914d368a-7595-4775-8467-fd69b4b49d03 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:14.350775 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-914d368a-7595-4775-8467-fd69b4b49d03 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:14.354567 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-914d368a-7595-4775-8467-fd69b4b49d03 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:14.356320 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-914d368a-7595-4775-8467-fd69b4b49d03 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:14.360183 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-914d368a-7595-4775-8467-fd69b4b49d03 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:14.429308 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-48c4f565-0418-4696-ab86-e055a43da079 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f496f24dccea47bd9a5ab532fe45e370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40794f05e8b94a0f8f087a87a58e0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:14.442244 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-48c4f565-0418-4696-ab86-e055a43da079 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "GET /compute/v2.1/servers/cb02560c-ca90-41f2-8e4a-1fe0f0494068" status: 200 len: 1306 microversion: 2.1 time: 0.841096 Aug 27 02:54:14.443801 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1414/2830] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:13 2022] GET /compute/v2.1/servers/cb02560c-ca90-41f2-8e4a-1fe0f0494068 => generated 1306 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:14.449861 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e606834e-3035-4edb-8de0-f2f5aa776413 tempest-QuotasAdminTestJSON-956326715 tempest-QuotasAdminTestJSON-956326715-project-admin] Calling method '.version_select at 0x7f5ede2445e0>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:14.694250 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-914d368a-7595-4775-8467-fd69b4b49d03 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:14.704055 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-914d368a-7595-4775-8467-fd69b4b49d03 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4" status: 200 len: 1522 microversion: 2.1 time: 0.434364 Aug 27 02:54:14.709150 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1417/2831] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:14 2022] GET /compute/v2.1/servers/97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4 => generated 1522 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:14.714083 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-1f34de4f-8df6-4070-90aa-897245aa94e1 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:14.714947 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-1f34de4f-8df6-4070-90aa-897245aa94e1 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 228b8015-1061-46f1-a6a3-c5d0ba039660] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:14.741466 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1f34de4f-8df6-4070-90aa-897245aa94e1 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:14.744416 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1f34de4f-8df6-4070-90aa-897245aa94e1 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:14.745182 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1f34de4f-8df6-4070-90aa-897245aa94e1 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:14.746046 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1f34de4f-8df6-4070-90aa-897245aa94e1 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:14.749169 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1f34de4f-8df6-4070-90aa-897245aa94e1 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:14.749717 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1f34de4f-8df6-4070-90aa-897245aa94e1 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:14.984935 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e606834e-3035-4edb-8de0-f2f5aa776413 tempest-QuotasAdminTestJSON-956326715 tempest-QuotasAdminTestJSON-956326715-project-admin] 10.222.0.70 "GET /compute/v2.1/os-quota-sets/7edb2bdfecf443ba85215816329a1fc0/defaults" status: 200 len: 371 microversion: 2.1 time: 0.538361 Aug 27 02:54:14.994060 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1415/2832] 10.222.0.70 () {58 vars in 1269 bytes} [Sat Aug 27 02:54:14 2022] GET /compute/v2.1/os-quota-sets/7edb2bdfecf443ba85215816329a1fc0/defaults => generated 371 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:54:14.999970 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a870c3ec-47ca-41de-9ee5-4aa51d071ca8 tempest-QuotasAdminTestJSON-956326715 tempest-QuotasAdminTestJSON-956326715-project-admin] Action: 'update', calling method: .version_select at 0x7f5ede2754c0>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:54:15.413423 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-1f34de4f-8df6-4070-90aa-897245aa94e1 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:15.424244 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-1f34de4f-8df6-4070-90aa-897245aa94e1 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/228b8015-1061-46f1-a6a3-c5d0ba039660" status: 200 len: 1502 microversion: 2.1 time: 0.713297 Aug 27 02:54:15.426669 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1418/2833] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:14 2022] GET /compute/v2.1/servers/228b8015-1061-46f1-a6a3-c5d0ba039660 => generated 1502 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:15.433987 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5bf65f86-8729-402d-b9a7-b44b41eaef27 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:15.434919 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-5bf65f86-8729-402d-b9a7-b44b41eaef27 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] [instance: dc54b06e-43a5-4450-bf3c-d9949dcf04b1] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:15.444415 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5bf65f86-8729-402d-b9a7-b44b41eaef27 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:15.445515 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5bf65f86-8729-402d-b9a7-b44b41eaef27 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:15.447853 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5bf65f86-8729-402d-b9a7-b44b41eaef27 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:15.449408 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5bf65f86-8729-402d-b9a7-b44b41eaef27 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:15.450060 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5bf65f86-8729-402d-b9a7-b44b41eaef27 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:15.451254 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5bf65f86-8729-402d-b9a7-b44b41eaef27 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:15.514288 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a870c3ec-47ca-41de-9ee5-4aa51d071ca8 tempest-QuotasAdminTestJSON-956326715 tempest-QuotasAdminTestJSON-956326715-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:15.515437 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a870c3ec-47ca-41de-9ee5-4aa51d071ca8 tempest-QuotasAdminTestJSON-956326715 tempest-QuotasAdminTestJSON-956326715-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:15.515437 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a870c3ec-47ca-41de-9ee5-4aa51d071ca8 tempest-QuotasAdminTestJSON-956326715 tempest-QuotasAdminTestJSON-956326715-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:15.515886 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a870c3ec-47ca-41de-9ee5-4aa51d071ca8 tempest-QuotasAdminTestJSON-956326715 tempest-QuotasAdminTestJSON-956326715-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:15.516376 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a870c3ec-47ca-41de-9ee5-4aa51d071ca8 tempest-QuotasAdminTestJSON-956326715 tempest-QuotasAdminTestJSON-956326715-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:15.530440 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a870c3ec-47ca-41de-9ee5-4aa51d071ca8 tempest-QuotasAdminTestJSON-956326715 tempest-QuotasAdminTestJSON-956326715-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:15.551156 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=11 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:54:15.753158 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-5bf65f86-8729-402d-b9a7-b44b41eaef27 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317e74b4bbc4da298a0dcbd78068352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a8810c21784788b4c0ee64dedbaf15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:15.774991 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-5bf65f86-8729-402d-b9a7-b44b41eaef27 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] 10.222.0.70 "GET /compute/v2.1/servers/dc54b06e-43a5-4450-bf3c-d9949dcf04b1" status: 200 len: 1318 microversion: 2.1 time: 0.346915 Aug 27 02:54:15.775822 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1419/2834] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:15 2022] GET /compute/v2.1/servers/dc54b06e-43a5-4450-bf3c-d9949dcf04b1 => generated 1318 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:15.785959 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-0ce4e505-b7df-4700-a742-1bf228897500 req-ef17c1f4-de47-4e58-952a-3491ce91b730 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb02560c-ca90-41f2-8e4a-1fe0f0494068", "name": "network-vif-plugged", "status": "completed", "tag": "6bd7f222-246e-43d7-af80-a8892ef8ad8b"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:54:15.800842 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-0ce4e505-b7df-4700-a742-1bf228897500 req-ef17c1f4-de47-4e58-952a-3491ce91b730 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:15.801326 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-0ce4e505-b7df-4700-a742-1bf228897500 req-ef17c1f4-de47-4e58-952a-3491ce91b730 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:15.801755 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-0ce4e505-b7df-4700-a742-1bf228897500 req-ef17c1f4-de47-4e58-952a-3491ce91b730 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:15.826940 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-0ce4e505-b7df-4700-a742-1bf228897500 req-ef17c1f4-de47-4e58-952a-3491ce91b730 service nova] Creating event network-vif-plugged:6bd7f222-246e-43d7-af80-a8892ef8ad8b for instance cb02560c-ca90-41f2-8e4a-1fe0f0494068 on n-h2-852278-4 Aug 27 02:54:15.836458 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-0ce4e505-b7df-4700-a742-1bf228897500 req-ef17c1f4-de47-4e58-952a-3491ce91b730 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059207 Aug 27 02:54:15.844635 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1420/2835] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:54:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:54:15.860526 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3145af23-9847-49c0-b419-6314be7f18b3 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:54:15.874360 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3145af23-9847-49c0-b419-6314be7f18b3 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:15.875368 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3145af23-9847-49c0-b419-6314be7f18b3 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:15.876236 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3145af23-9847-49c0-b419-6314be7f18b3 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:16.016092 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a870c3ec-47ca-41de-9ee5-4aa51d071ca8 tempest-QuotasAdminTestJSON-956326715 tempest-QuotasAdminTestJSON-956326715-project-admin] 10.222.0.70 "PUT /compute/v2.1/os-quota-sets/7edb2bdfecf443ba85215816329a1fc0" status: 200 len: 329 microversion: 2.1 time: 1.020400 Aug 27 02:54:16.017190 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1416/2836] 10.222.0.70 () {60 vars in 1263 bytes} [Sat Aug 27 02:54:14 2022] PUT /compute/v2.1/os-quota-sets/7edb2bdfecf443ba85215816329a1fc0 => generated 329 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:54:16.036101 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-1bf2edeb-96e1-478a-aea8-2b8630bf63a0 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:16.037454 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-1bf2edeb-96e1-478a-aea8-2b8630bf63a0 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] [instance: cb02560c-ca90-41f2-8e4a-1fe0f0494068] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:16.047953 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1bf2edeb-96e1-478a-aea8-2b8630bf63a0 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:16.049070 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1bf2edeb-96e1-478a-aea8-2b8630bf63a0 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:16.049761 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1bf2edeb-96e1-478a-aea8-2b8630bf63a0 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:16.052733 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1bf2edeb-96e1-478a-aea8-2b8630bf63a0 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:16.052733 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1bf2edeb-96e1-478a-aea8-2b8630bf63a0 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:16.052733 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1bf2edeb-96e1-478a-aea8-2b8630bf63a0 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:16.098213 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-3145af23-9847-49c0-b419-6314be7f18b3 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 228b8015-1061-46f1-a6a3-c5d0ba039660] Going to try to stop instance {{(pid=134052) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 27 02:54:16.105348 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:54:16.199745 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-3145af23-9847-49c0-b419-6314be7f18b3 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "POST /compute/v2.1/servers/228b8015-1061-46f1-a6a3-c5d0ba039660/action" status: 202 len: 0 microversion: 2.1 time: 0.349683 Aug 27 02:54:16.201381 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1421/2837] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 02:54:15 2022] POST /compute/v2.1/servers/228b8015-1061-46f1-a6a3-c5d0ba039660/action => generated 0 bytes in 352 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:54:16.207983 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-453a549e-369c-4643-9569-aad734ff8e4b tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:16.208858 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-453a549e-369c-4643-9569-aad734ff8e4b tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: 97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:16.216073 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-453a549e-369c-4643-9569-aad734ff8e4b tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:16.216985 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-453a549e-369c-4643-9569-aad734ff8e4b tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:16.217581 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-453a549e-369c-4643-9569-aad734ff8e4b tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:16.218369 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-453a549e-369c-4643-9569-aad734ff8e4b tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:16.218830 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-453a549e-369c-4643-9569-aad734ff8e4b tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:16.219253 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-453a549e-369c-4643-9569-aad734ff8e4b tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:16.370680 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-1bf2edeb-96e1-478a-aea8-2b8630bf63a0 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f496f24dccea47bd9a5ab532fe45e370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40794f05e8b94a0f8f087a87a58e0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:16.380060 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-1bf2edeb-96e1-478a-aea8-2b8630bf63a0 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "GET /compute/v2.1/servers/cb02560c-ca90-41f2-8e4a-1fe0f0494068" status: 200 len: 1306 microversion: 2.1 time: 0.361414 Aug 27 02:54:16.387384 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1417/2838] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:16 2022] GET /compute/v2.1/servers/cb02560c-ca90-41f2-8e4a-1fe0f0494068 => generated 1306 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:16.407389 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-9baadf79-0694-4ccd-8005-08dd7cc48772 tempest-QuotasAdminTestJSON-956326715 tempest-QuotasAdminTestJSON-956326715-project-admin] Action: 'update', calling method: .version_select at 0x7f5ede275af0>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:54:16.582276 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-453a549e-369c-4643-9569-aad734ff8e4b tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:16.595993 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-453a549e-369c-4643-9569-aad734ff8e4b tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4" status: 200 len: 1522 microversion: 2.1 time: 0.392877 Aug 27 02:54:16.609153 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1422/2839] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:16 2022] GET /compute/v2.1/servers/97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4 => generated 1522 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:16.632142 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-2bfef5d0-27af-4533-9002-fa03f3080004 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:16.633862 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-2bfef5d0-27af-4533-9002-fa03f3080004 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 228b8015-1061-46f1-a6a3-c5d0ba039660] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:16.650660 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2bfef5d0-27af-4533-9002-fa03f3080004 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:16.652801 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2bfef5d0-27af-4533-9002-fa03f3080004 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:16.653441 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2bfef5d0-27af-4533-9002-fa03f3080004 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:16.654498 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2bfef5d0-27af-4533-9002-fa03f3080004 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:16.655168 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2bfef5d0-27af-4533-9002-fa03f3080004 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:16.655829 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2bfef5d0-27af-4533-9002-fa03f3080004 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:16.909463 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9baadf79-0694-4ccd-8005-08dd7cc48772 tempest-QuotasAdminTestJSON-956326715 tempest-QuotasAdminTestJSON-956326715-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:16.910507 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9baadf79-0694-4ccd-8005-08dd7cc48772 tempest-QuotasAdminTestJSON-956326715 tempest-QuotasAdminTestJSON-956326715-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:16.911333 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9baadf79-0694-4ccd-8005-08dd7cc48772 tempest-QuotasAdminTestJSON-956326715 tempest-QuotasAdminTestJSON-956326715-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:16.912274 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9baadf79-0694-4ccd-8005-08dd7cc48772 tempest-QuotasAdminTestJSON-956326715 tempest-QuotasAdminTestJSON-956326715-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:16.912941 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9baadf79-0694-4ccd-8005-08dd7cc48772 tempest-QuotasAdminTestJSON-956326715 tempest-QuotasAdminTestJSON-956326715-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:16.913615 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9baadf79-0694-4ccd-8005-08dd7cc48772 tempest-QuotasAdminTestJSON-956326715 tempest-QuotasAdminTestJSON-956326715-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:17.154924 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=18,nova_api:UPDATE=4 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:54:17.289396 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-2bfef5d0-27af-4533-9002-fa03f3080004 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:17.299999 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-2bfef5d0-27af-4533-9002-fa03f3080004 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/228b8015-1061-46f1-a6a3-c5d0ba039660" status: 200 len: 1512 microversion: 2.1 time: 0.689669 Aug 27 02:54:17.312584 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1423/2840] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:16 2022] GET /compute/v2.1/servers/228b8015-1061-46f1-a6a3-c5d0ba039660 => generated 1512 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:17.313821 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-68f5f865-bb2f-46eb-b29e-326e7926daef tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:17.314439 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-68f5f865-bb2f-46eb-b29e-326e7926daef tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] [instance: dc54b06e-43a5-4450-bf3c-d9949dcf04b1] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:17.339300 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-68f5f865-bb2f-46eb-b29e-326e7926daef tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:17.341530 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-68f5f865-bb2f-46eb-b29e-326e7926daef tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:17.342226 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-68f5f865-bb2f-46eb-b29e-326e7926daef tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:17.345045 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-68f5f865-bb2f-46eb-b29e-326e7926daef tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:17.345810 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-68f5f865-bb2f-46eb-b29e-326e7926daef tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:17.348514 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-68f5f865-bb2f-46eb-b29e-326e7926daef tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:17.600382 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=100 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:54:17.726625 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-9baadf79-0694-4ccd-8005-08dd7cc48772 tempest-QuotasAdminTestJSON-956326715 tempest-QuotasAdminTestJSON-956326715-project-admin] 10.222.0.70 "PUT /compute/v2.1/os-quota-sets/7edb2bdfecf443ba85215816329a1fc0" status: 200 len: 329 microversion: 2.1 time: 1.337991 Aug 27 02:54:17.742555 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1418/2841] 10.222.0.70 () {60 vars in 1263 bytes} [Sat Aug 27 02:54:16 2022] PUT /compute/v2.1/os-quota-sets/7edb2bdfecf443ba85215816329a1fc0 => generated 329 bytes in 1355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:54:17.747502 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-68f5f865-bb2f-46eb-b29e-326e7926daef tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317e74b4bbc4da298a0dcbd78068352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a8810c21784788b4c0ee64dedbaf15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:17.748041 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-bcefd020-9626-4ab4-a034-d4ffea067876 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:17.753639 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-bcefd020-9626-4ab4-a034-d4ffea067876 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] [instance: cb02560c-ca90-41f2-8e4a-1fe0f0494068] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:17.759654 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-68f5f865-bb2f-46eb-b29e-326e7926daef tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] 10.222.0.70 "GET /compute/v2.1/servers/dc54b06e-43a5-4450-bf3c-d9949dcf04b1" status: 200 len: 1318 microversion: 2.1 time: 0.449597 Aug 27 02:54:17.760639 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1424/2842] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:17 2022] GET /compute/v2.1/servers/dc54b06e-43a5-4450-bf3c-d9949dcf04b1 => generated 1318 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:17.766463 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-45414e9b-192d-4bdd-ae69-274ff03d3d01 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:17.767361 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-45414e9b-192d-4bdd-ae69-274ff03d3d01 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: 97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:17.774803 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-45414e9b-192d-4bdd-ae69-274ff03d3d01 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:17.775642 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-45414e9b-192d-4bdd-ae69-274ff03d3d01 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:17.777043 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-45414e9b-192d-4bdd-ae69-274ff03d3d01 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:17.778059 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-45414e9b-192d-4bdd-ae69-274ff03d3d01 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:17.778933 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-45414e9b-192d-4bdd-ae69-274ff03d3d01 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:17.779740 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-45414e9b-192d-4bdd-ae69-274ff03d3d01 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:17.785572 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bcefd020-9626-4ab4-a034-d4ffea067876 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:17.786077 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bcefd020-9626-4ab4-a034-d4ffea067876 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:17.786511 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bcefd020-9626-4ab4-a034-d4ffea067876 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:17.787217 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bcefd020-9626-4ab4-a034-d4ffea067876 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:17.787678 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bcefd020-9626-4ab4-a034-d4ffea067876 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:17.788100 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bcefd020-9626-4ab4-a034-d4ffea067876 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:18.482619 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-45414e9b-192d-4bdd-ae69-274ff03d3d01 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:18.496016 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-45414e9b-192d-4bdd-ae69-274ff03d3d01 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4" status: 200 len: 1522 microversion: 2.1 time: 0.734070 Aug 27 02:54:18.506529 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1425/2843] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:17 2022] GET /compute/v2.1/servers/97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4 => generated 1522 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:18.513741 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0792bcc6-2d71-4d4a-8dcf-64dde90adca4 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:18.516790 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-0792bcc6-2d71-4d4a-8dcf-64dde90adca4 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 228b8015-1061-46f1-a6a3-c5d0ba039660] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:18.530113 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0792bcc6-2d71-4d4a-8dcf-64dde90adca4 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:18.531735 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0792bcc6-2d71-4d4a-8dcf-64dde90adca4 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:18.533053 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0792bcc6-2d71-4d4a-8dcf-64dde90adca4 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:18.534212 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0792bcc6-2d71-4d4a-8dcf-64dde90adca4 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:18.538651 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0792bcc6-2d71-4d4a-8dcf-64dde90adca4 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:18.539727 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0792bcc6-2d71-4d4a-8dcf-64dde90adca4 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:18.607658 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-bcefd020-9626-4ab4-a034-d4ffea067876 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f496f24dccea47bd9a5ab532fe45e370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40794f05e8b94a0f8f087a87a58e0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:18.623332 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-bcefd020-9626-4ab4-a034-d4ffea067876 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "GET /compute/v2.1/servers/cb02560c-ca90-41f2-8e4a-1fe0f0494068" status: 200 len: 1306 microversion: 2.1 time: 0.878368 Aug 27 02:54:18.641671 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1419/2844] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:17 2022] GET /compute/v2.1/servers/cb02560c-ca90-41f2-8e4a-1fe0f0494068 => generated 1306 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:18.786166 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a60352d3-15e1-4d22-8ddd-23b9b8bd8429 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:18.787015 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-a60352d3-15e1-4d22-8ddd-23b9b8bd8429 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] [instance: dc54b06e-43a5-4450-bf3c-d9949dcf04b1] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:18.810286 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a60352d3-15e1-4d22-8ddd-23b9b8bd8429 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:18.810947 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a60352d3-15e1-4d22-8ddd-23b9b8bd8429 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:18.815934 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a60352d3-15e1-4d22-8ddd-23b9b8bd8429 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:18.818438 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a60352d3-15e1-4d22-8ddd-23b9b8bd8429 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:18.819196 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a60352d3-15e1-4d22-8ddd-23b9b8bd8429 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:18.820962 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a60352d3-15e1-4d22-8ddd-23b9b8bd8429 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:19.048041 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0792bcc6-2d71-4d4a-8dcf-64dde90adca4 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:19.061386 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-0792bcc6-2d71-4d4a-8dcf-64dde90adca4 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/228b8015-1061-46f1-a6a3-c5d0ba039660" status: 200 len: 1512 microversion: 2.1 time: 0.552422 Aug 27 02:54:19.062792 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1426/2845] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:18 2022] GET /compute/v2.1/servers/228b8015-1061-46f1-a6a3-c5d0ba039660 => generated 1512 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:19.297934 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-a60352d3-15e1-4d22-8ddd-23b9b8bd8429 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317e74b4bbc4da298a0dcbd78068352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a8810c21784788b4c0ee64dedbaf15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:19.309631 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a60352d3-15e1-4d22-8ddd-23b9b8bd8429 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] 10.222.0.70 "GET /compute/v2.1/servers/dc54b06e-43a5-4450-bf3c-d9949dcf04b1" status: 200 len: 1318 microversion: 2.1 time: 0.526485 Aug 27 02:54:19.310328 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1420/2846] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:18 2022] GET /compute/v2.1/servers/dc54b06e-43a5-4450-bf3c-d9949dcf04b1 => generated 1318 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:19.522683 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c68338f2-5aeb-4ce5-9624-338707cf1d15 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:19.524418 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-c68338f2-5aeb-4ce5-9624-338707cf1d15 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: 97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:19.538797 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c68338f2-5aeb-4ce5-9624-338707cf1d15 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:19.544027 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c68338f2-5aeb-4ce5-9624-338707cf1d15 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:19.545462 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c68338f2-5aeb-4ce5-9624-338707cf1d15 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:19.548512 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c68338f2-5aeb-4ce5-9624-338707cf1d15 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:19.549234 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c68338f2-5aeb-4ce5-9624-338707cf1d15 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:19.551225 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c68338f2-5aeb-4ce5-9624-338707cf1d15 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:19.651002 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-56cfc791-cd0a-4d7d-824b-d9d8c67ec5e6 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:19.652125 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-56cfc791-cd0a-4d7d-824b-d9d8c67ec5e6 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] [instance: cb02560c-ca90-41f2-8e4a-1fe0f0494068] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:19.664073 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-56cfc791-cd0a-4d7d-824b-d9d8c67ec5e6 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:19.664961 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-56cfc791-cd0a-4d7d-824b-d9d8c67ec5e6 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:19.668493 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-56cfc791-cd0a-4d7d-824b-d9d8c67ec5e6 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:19.669916 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-56cfc791-cd0a-4d7d-824b-d9d8c67ec5e6 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:19.673611 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-56cfc791-cd0a-4d7d-824b-d9d8c67ec5e6 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:19.674470 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-56cfc791-cd0a-4d7d-824b-d9d8c67ec5e6 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:20.315058 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-c68338f2-5aeb-4ce5-9624-338707cf1d15 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:20.331673 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c68338f2-5aeb-4ce5-9624-338707cf1d15 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4" status: 200 len: 1504 microversion: 2.1 time: 0.812597 Aug 27 02:54:20.333974 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1427/2847] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:19 2022] GET /compute/v2.1/servers/97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4 => generated 1504 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:20.352065 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0582edd8-f5ba-4612-9d19-1ebdc3b466b7 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:20.357849 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-0582edd8-f5ba-4612-9d19-1ebdc3b466b7 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 228b8015-1061-46f1-a6a3-c5d0ba039660] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:20.382042 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0582edd8-f5ba-4612-9d19-1ebdc3b466b7 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:20.385056 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0582edd8-f5ba-4612-9d19-1ebdc3b466b7 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:20.388485 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0582edd8-f5ba-4612-9d19-1ebdc3b466b7 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:20.390914 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0582edd8-f5ba-4612-9d19-1ebdc3b466b7 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:20.392513 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0582edd8-f5ba-4612-9d19-1ebdc3b466b7 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:20.394433 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0582edd8-f5ba-4612-9d19-1ebdc3b466b7 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:20.410211 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-56cfc791-cd0a-4d7d-824b-d9d8c67ec5e6 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f496f24dccea47bd9a5ab532fe45e370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40794f05e8b94a0f8f087a87a58e0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:20.423016 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-56cfc791-cd0a-4d7d-824b-d9d8c67ec5e6 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "GET /compute/v2.1/servers/cb02560c-ca90-41f2-8e4a-1fe0f0494068" status: 200 len: 1485 microversion: 2.1 time: 0.777118 Aug 27 02:54:20.425073 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1421/2848] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:19 2022] GET /compute/v2.1/servers/cb02560c-ca90-41f2-8e4a-1fe0f0494068 => generated 1485 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:20.430655 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e9311bb2-7699-4a6b-a077-b37f7a4c8dcf tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:20.431657 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-e9311bb2-7699-4a6b-a077-b37f7a4c8dcf tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] [instance: dc54b06e-43a5-4450-bf3c-d9949dcf04b1] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:20.438064 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e9311bb2-7699-4a6b-a077-b37f7a4c8dcf tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:20.438947 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e9311bb2-7699-4a6b-a077-b37f7a4c8dcf tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:20.439703 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e9311bb2-7699-4a6b-a077-b37f7a4c8dcf tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:20.440768 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e9311bb2-7699-4a6b-a077-b37f7a4c8dcf tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:20.443764 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e9311bb2-7699-4a6b-a077-b37f7a4c8dcf tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:20.447045 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e9311bb2-7699-4a6b-a077-b37f7a4c8dcf tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:20.714679 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0582edd8-f5ba-4612-9d19-1ebdc3b466b7 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:20.724425 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-0582edd8-f5ba-4612-9d19-1ebdc3b466b7 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/228b8015-1061-46f1-a6a3-c5d0ba039660" status: 200 len: 1512 microversion: 2.1 time: 0.386396 Aug 27 02:54:20.730959 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1428/2849] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:20 2022] GET /compute/v2.1/servers/228b8015-1061-46f1-a6a3-c5d0ba039660 => generated 1512 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:20.736334 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-355bb35c-91a8-46f5-b78e-a587c6db5b70 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:54:20.748128 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-355bb35c-91a8-46f5-b78e-a587c6db5b70 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] [instance: cb02560c-ca90-41f2-8e4a-1fe0f0494068] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:20.762620 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-355bb35c-91a8-46f5-b78e-a587c6db5b70 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:20.763405 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-355bb35c-91a8-46f5-b78e-a587c6db5b70 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:20.764026 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-355bb35c-91a8-46f5-b78e-a587c6db5b70 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:20.765008 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-355bb35c-91a8-46f5-b78e-a587c6db5b70 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:20.765629 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-355bb35c-91a8-46f5-b78e-a587c6db5b70 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:20.766203 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-355bb35c-91a8-46f5-b78e-a587c6db5b70 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:20.800710 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e9311bb2-7699-4a6b-a077-b37f7a4c8dcf tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317e74b4bbc4da298a0dcbd78068352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a8810c21784788b4c0ee64dedbaf15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:20.816205 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e9311bb2-7699-4a6b-a077-b37f7a4c8dcf tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] 10.222.0.70 "GET /compute/v2.1/servers/dc54b06e-43a5-4450-bf3c-d9949dcf04b1" status: 200 len: 1318 microversion: 2.1 time: 0.389212 Aug 27 02:54:20.820547 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.instance [None req-355bb35c-91a8-46f5-b78e-a587c6db5b70 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lazy-loading 'flavor' on Instance uuid cb02560c-ca90-41f2-8e4a-1fe0f0494068 {{(pid=134052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:54:20.822168 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1422/2850] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:20 2022] GET /compute/v2.1/servers/dc54b06e-43a5-4450-bf3c-d9949dcf04b1 => generated 1318 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:20.834823 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-50316952-ebe4-4ff6-a617-468e3d2b4a69 req-b918b923-d4e3-4db4-9ff1-50b020a6779d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4", "name": "network-vif-unplugged", "status": "completed", "tag": "b6ccabb4-3a86-495e-9764-020c27981067"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:54:20.885891 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-50316952-ebe4-4ff6-a617-468e3d2b4a69 req-b918b923-d4e3-4db4-9ff1-50b020a6779d service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:20.886751 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-50316952-ebe4-4ff6-a617-468e3d2b4a69 req-b918b923-d4e3-4db4-9ff1-50b020a6779d service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:20.887697 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-50316952-ebe4-4ff6-a617-468e3d2b4a69 req-b918b923-d4e3-4db4-9ff1-50b020a6779d service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:20.923584 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-50316952-ebe4-4ff6-a617-468e3d2b4a69 req-b918b923-d4e3-4db4-9ff1-50b020a6779d service nova] Creating event network-vif-unplugged:b6ccabb4-3a86-495e-9764-020c27981067 for instance 97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4 on n-h2-852278-4 Aug 27 02:54:20.943018 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-50316952-ebe4-4ff6-a617-468e3d2b4a69 req-b918b923-d4e3-4db4-9ff1-50b020a6779d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.116786 Aug 27 02:54:20.944886 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1423/2851] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:54:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:54:20.987828 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-355bb35c-91a8-46f5-b78e-a587c6db5b70 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "POST /compute/v2.1/servers/cb02560c-ca90-41f2-8e4a-1fe0f0494068/action" status: 202 len: 0 microversion: 2.1 time: 0.255103 Aug 27 02:54:20.991730 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1429/2852] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 02:54:20 2022] POST /compute/v2.1/servers/cb02560c-ca90-41f2-8e4a-1fe0f0494068/action => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:54:21.000061 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-fac41735-0d41-4a6a-87b5-22d1066fda91 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:21.001299 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-fac41735-0d41-4a6a-87b5-22d1066fda91 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] [instance: cb02560c-ca90-41f2-8e4a-1fe0f0494068] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:21.019580 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fac41735-0d41-4a6a-87b5-22d1066fda91 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:21.023192 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fac41735-0d41-4a6a-87b5-22d1066fda91 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:21.023924 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fac41735-0d41-4a6a-87b5-22d1066fda91 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:21.026868 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fac41735-0d41-4a6a-87b5-22d1066fda91 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:21.027652 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fac41735-0d41-4a6a-87b5-22d1066fda91 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:21.030720 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fac41735-0d41-4a6a-87b5-22d1066fda91 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:21.368673 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3c2fdc95-6025-4214-a383-ff2787ec2a70 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:21.369381 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-3c2fdc95-6025-4214-a383-ff2787ec2a70 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: 97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:21.378615 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3c2fdc95-6025-4214-a383-ff2787ec2a70 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:21.381930 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3c2fdc95-6025-4214-a383-ff2787ec2a70 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:21.382408 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3c2fdc95-6025-4214-a383-ff2787ec2a70 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:21.389172 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3c2fdc95-6025-4214-a383-ff2787ec2a70 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:21.389663 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3c2fdc95-6025-4214-a383-ff2787ec2a70 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:21.390099 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3c2fdc95-6025-4214-a383-ff2787ec2a70 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:21.473104 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-fac41735-0d41-4a6a-87b5-22d1066fda91 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f496f24dccea47bd9a5ab532fe45e370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40794f05e8b94a0f8f087a87a58e0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:21.484168 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-fac41735-0d41-4a6a-87b5-22d1066fda91 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "GET /compute/v2.1/servers/cb02560c-ca90-41f2-8e4a-1fe0f0494068" status: 200 len: 1493 microversion: 2.1 time: 0.490636 Aug 27 02:54:21.499532 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1424/2853] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:20 2022] GET /compute/v2.1/servers/cb02560c-ca90-41f2-8e4a-1fe0f0494068 => generated 1493 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:54:21.725593 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=7 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:54:21.755148 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-afd67da9-545c-4951-9847-00534a8edd1b tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:21.755821 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-afd67da9-545c-4951-9847-00534a8edd1b tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 228b8015-1061-46f1-a6a3-c5d0ba039660] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:21.773413 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-afd67da9-545c-4951-9847-00534a8edd1b tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:21.777264 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-afd67da9-545c-4951-9847-00534a8edd1b tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:21.799304 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-afd67da9-545c-4951-9847-00534a8edd1b tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:21.810891 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-afd67da9-545c-4951-9847-00534a8edd1b tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:21.815352 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-afd67da9-545c-4951-9847-00534a8edd1b tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:21.817207 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-afd67da9-545c-4951-9847-00534a8edd1b tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:21.905935 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-3c2fdc95-6025-4214-a383-ff2787ec2a70 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:21.917390 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-3c2fdc95-6025-4214-a383-ff2787ec2a70 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4" status: 200 len: 1504 microversion: 2.1 time: 0.563982 Aug 27 02:54:21.948812 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1430/2854] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:21 2022] GET /compute/v2.1/servers/97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4 => generated 1504 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:54:21.961239 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5c05b33b-287d-4c6a-b36f-1c0e6df3303e tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:21.980260 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-5c05b33b-287d-4c6a-b36f-1c0e6df3303e tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] [instance: dc54b06e-43a5-4450-bf3c-d9949dcf04b1] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:22.001709 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5c05b33b-287d-4c6a-b36f-1c0e6df3303e tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:22.008763 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5c05b33b-287d-4c6a-b36f-1c0e6df3303e tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:22.012296 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5c05b33b-287d-4c6a-b36f-1c0e6df3303e tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:22.020124 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5c05b33b-287d-4c6a-b36f-1c0e6df3303e tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:22.020893 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5c05b33b-287d-4c6a-b36f-1c0e6df3303e tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:22.029147 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5c05b33b-287d-4c6a-b36f-1c0e6df3303e tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:22.506659 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-5c05b33b-287d-4c6a-b36f-1c0e6df3303e tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317e74b4bbc4da298a0dcbd78068352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a8810c21784788b4c0ee64dedbaf15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:22.516839 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-5c05b33b-287d-4c6a-b36f-1c0e6df3303e tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] 10.222.0.70 "GET /compute/v2.1/servers/dc54b06e-43a5-4450-bf3c-d9949dcf04b1" status: 200 len: 1318 microversion: 2.1 time: 0.566318 Aug 27 02:54:22.523584 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1431/2855] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:21 2022] GET /compute/v2.1/servers/dc54b06e-43a5-4450-bf3c-d9949dcf04b1 => generated 1318 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:22.536136 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8a496fa8-9c7c-47ef-9541-d80361705252 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:22.537106 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-8a496fa8-9c7c-47ef-9541-d80361705252 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] [instance: cb02560c-ca90-41f2-8e4a-1fe0f0494068] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:22.574012 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8a496fa8-9c7c-47ef-9541-d80361705252 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:22.577325 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8a496fa8-9c7c-47ef-9541-d80361705252 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:22.579363 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8a496fa8-9c7c-47ef-9541-d80361705252 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:22.580856 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8a496fa8-9c7c-47ef-9541-d80361705252 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:22.584401 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8a496fa8-9c7c-47ef-9541-d80361705252 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:22.586666 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8a496fa8-9c7c-47ef-9541-d80361705252 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:22.605961 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-afd67da9-545c-4951-9847-00534a8edd1b tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:22.617690 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-afd67da9-545c-4951-9847-00534a8edd1b tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/228b8015-1061-46f1-a6a3-c5d0ba039660" status: 200 len: 1512 microversion: 2.1 time: 0.867862 Aug 27 02:54:22.618328 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1425/2856] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:21 2022] GET /compute/v2.1/servers/228b8015-1061-46f1-a6a3-c5d0ba039660 => generated 1512 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:54:22.906996 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-8a496fa8-9c7c-47ef-9541-d80361705252 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f496f24dccea47bd9a5ab532fe45e370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40794f05e8b94a0f8f087a87a58e0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:22.927556 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-8a496fa8-9c7c-47ef-9541-d80361705252 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "GET /compute/v2.1/servers/cb02560c-ca90-41f2-8e4a-1fe0f0494068" status: 200 len: 1476 microversion: 2.1 time: 0.399019 Aug 27 02:54:22.933430 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1432/2857] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:22 2022] GET /compute/v2.1/servers/cb02560c-ca90-41f2-8e4a-1fe0f0494068 => generated 1476 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:22.955742 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-261883d3-7265-4676-ac42-0235d948ca22 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:22.956451 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-261883d3-7265-4676-ac42-0235d948ca22 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: 97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:22.961920 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-74c8bfb2-3385-4af0-aff5-950b31fd7794 req-df343d90-915d-4ed7-9bab-3ba8fa74a8a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc54b06e-43a5-4450-bf3c-d9949dcf04b1", "name": "network-vif-plugged", "status": "completed", "tag": "e6026f69-48ad-496a-a661-91dce3b2f0ba"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:54:22.973443 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-261883d3-7265-4676-ac42-0235d948ca22 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:22.973930 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-261883d3-7265-4676-ac42-0235d948ca22 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:22.974366 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-261883d3-7265-4676-ac42-0235d948ca22 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:22.975094 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-261883d3-7265-4676-ac42-0235d948ca22 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:22.975543 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-261883d3-7265-4676-ac42-0235d948ca22 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:22.975975 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-261883d3-7265-4676-ac42-0235d948ca22 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:22.992165 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-74c8bfb2-3385-4af0-aff5-950b31fd7794 req-df343d90-915d-4ed7-9bab-3ba8fa74a8a8 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:23.008773 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-74c8bfb2-3385-4af0-aff5-950b31fd7794 req-df343d90-915d-4ed7-9bab-3ba8fa74a8a8 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:23.009582 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-74c8bfb2-3385-4af0-aff5-950b31fd7794 req-df343d90-915d-4ed7-9bab-3ba8fa74a8a8 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:23.039447 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-74c8bfb2-3385-4af0-aff5-950b31fd7794 req-df343d90-915d-4ed7-9bab-3ba8fa74a8a8 service nova] Creating event network-vif-plugged:e6026f69-48ad-496a-a661-91dce3b2f0ba for instance dc54b06e-43a5-4450-bf3c-d9949dcf04b1 on n-h2-852278-4 Aug 27 02:54:23.047659 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-74c8bfb2-3385-4af0-aff5-950b31fd7794 req-df343d90-915d-4ed7-9bab-3ba8fa74a8a8 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090763 Aug 27 02:54:23.048930 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1433/2858] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:54:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:54:23.060350 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c09093f5-8026-47c0-b210-b4ea80c058c7 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-638800016"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:54:23.064200 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-c09093f5-8026-47c0-b210-b4ea80c058c7 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] [instance: cb02560c-ca90-41f2-8e4a-1fe0f0494068] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:23.093734 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c09093f5-8026-47c0-b210-b4ea80c058c7 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:23.094743 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c09093f5-8026-47c0-b210-b4ea80c058c7 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:23.095978 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c09093f5-8026-47c0-b210-b4ea80c058c7 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:23.098537 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c09093f5-8026-47c0-b210-b4ea80c058c7 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:23.099431 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c09093f5-8026-47c0-b210-b4ea80c058c7 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:23.100161 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c09093f5-8026-47c0-b210-b4ea80c058c7 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:23.195094 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=24 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:54:23.672906 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c09093f5-8026-47c0-b210-b4ea80c058c7 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "POST /compute/v2.1/servers/cb02560c-ca90-41f2-8e4a-1fe0f0494068/action" status: 202 len: 0 microversion: 2.1 time: 0.616283 Aug 27 02:54:23.676647 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1434/2859] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 02:54:23 2022] POST /compute/v2.1/servers/cb02560c-ca90-41f2-8e4a-1fe0f0494068/action => generated 0 bytes in 627 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 27 02:54:23.690454 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4fe35c35-f349-4979-934b-0b0f958c242a tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:23.696707 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-4fe35c35-f349-4979-934b-0b0f958c242a tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] [instance: dc54b06e-43a5-4450-bf3c-d9949dcf04b1] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:23.710839 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4fe35c35-f349-4979-934b-0b0f958c242a tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:23.716713 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4fe35c35-f349-4979-934b-0b0f958c242a tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:23.720454 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4fe35c35-f349-4979-934b-0b0f958c242a tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:23.725218 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4fe35c35-f349-4979-934b-0b0f958c242a tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:23.726434 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4fe35c35-f349-4979-934b-0b0f958c242a tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:23.728072 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4fe35c35-f349-4979-934b-0b0f958c242a tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:23.749705 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-261883d3-7265-4676-ac42-0235d948ca22 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:23.758894 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-261883d3-7265-4676-ac42-0235d948ca22 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4" status: 200 len: 1447 microversion: 2.1 time: 0.807443 Aug 27 02:54:23.762291 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1426/2860] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:22 2022] GET /compute/v2.1/servers/97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4 => generated 1447 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:23.775478 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a3b39657-39c0-44e5-9805-e3caeb5db4c2 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Action: 'create', calling method: .version_select at 0x7f5ede255a60>, body: {"keypair": {"name": "tempest-keypair-1854057571", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHNARSx+fzv60k+jcsxPAhd4Z3JmBxA0Y7Y2nnP1Lr9DhOPJTGN8StdJNsTfcJKW6LFJ0RpCm1RElmzhub+jDwcfnFIzzVlJF5dSnOUKOxMtSBq95GyWtWfpzYeM3yfURw=="}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:54:23.792595 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:54:23.842666 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-a3b39657-39c0-44e5-9805-e3caeb5db4c2 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Getting quotas for project 10e26cc78b814d498d6a931ecf300dff. Resources: {'key_pairs'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:54:23.860190 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-a3b39657-39c0-44e5-9805-e3caeb5db4c2 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Getting quotas for user 57aed857618644f7adc472fc5c5e0c36 and project 10e26cc78b814d498d6a931ecf300dff. Resources: {'key_pairs'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:54:23.929308 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a3b39657-39c0-44e5-9805-e3caeb5db4c2 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.147005 Aug 27 02:54:23.937901 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1427/2861] 10.222.0.70 () {62 vars in 1200 bytes} [Sat Aug 27 02:54:23 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 173 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 27 02:54:23.948566 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c79e8217-0a2e-4dc7-8986-da9fd838144f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:23.960540 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-c79e8217-0a2e-4dc7-8986-da9fd838144f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 228b8015-1061-46f1-a6a3-c5d0ba039660] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:23.990097 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c79e8217-0a2e-4dc7-8986-da9fd838144f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:23.999421 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c79e8217-0a2e-4dc7-8986-da9fd838144f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:24.000361 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c79e8217-0a2e-4dc7-8986-da9fd838144f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:24.003621 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c79e8217-0a2e-4dc7-8986-da9fd838144f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:24.004367 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c79e8217-0a2e-4dc7-8986-da9fd838144f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:24.005036 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c79e8217-0a2e-4dc7-8986-da9fd838144f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:24.109946 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-4fe35c35-f349-4979-934b-0b0f958c242a tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317e74b4bbc4da298a0dcbd78068352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a8810c21784788b4c0ee64dedbaf15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:24.123680 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-4fe35c35-f349-4979-934b-0b0f958c242a tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] 10.222.0.70 "GET /compute/v2.1/servers/dc54b06e-43a5-4450-bf3c-d9949dcf04b1" status: 200 len: 1318 microversion: 2.1 time: 0.442224 Aug 27 02:54:24.129224 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1435/2862] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:23 2022] GET /compute/v2.1/servers/dc54b06e-43a5-4450-bf3c-d9949dcf04b1 => generated 1318 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:24.143516 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d993989f-d06f-4f05-b186-ebdeebe97183 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '.version_select at 0x7f5ee7196f70>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:24.282562 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d993989f-d06f-4f05-b186-ebdeebe97183 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "GET /compute/v2.1/images/57627f6b-d2bf-4292-a3b4-db93ad1b2e3f" status: 200 len: 1437 microversion: 2.1 time: 0.149240 Aug 27 02:54:24.284983 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1436/2863] 10.222.0.70 () {58 vars in 1233 bytes} [Sat Aug 27 02:54:24 2022] GET /compute/v2.1/images/57627f6b-d2bf-4292-a3b4-db93ad1b2e3f => generated 1437 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:24.299871 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-aa800c25-c79e-4ec8-b686-3b01d071eb40 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:24.300391 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-aa800c25-c79e-4ec8-b686-3b01d071eb40 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: 97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:24.333234 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-aa800c25-c79e-4ec8-b686-3b01d071eb40 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:24.336611 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-aa800c25-c79e-4ec8-b686-3b01d071eb40 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:24.337310 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-aa800c25-c79e-4ec8-b686-3b01d071eb40 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:24.338540 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-aa800c25-c79e-4ec8-b686-3b01d071eb40 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:24.343258 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-aa800c25-c79e-4ec8-b686-3b01d071eb40 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:24.343708 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-aa800c25-c79e-4ec8-b686-3b01d071eb40 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:24.435444 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-c79e8217-0a2e-4dc7-8986-da9fd838144f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:24.452078 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c79e8217-0a2e-4dc7-8986-da9fd838144f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/228b8015-1061-46f1-a6a3-c5d0ba039660" status: 200 len: 1512 microversion: 2.1 time: 0.507612 Aug 27 02:54:24.452706 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-aa800c25-c79e-4ec8-b686-3b01d071eb40 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: 97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4] Going to try to terminate instance {{(pid=134052) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:54:24.471111 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1428/2864] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:23 2022] GET /compute/v2.1/servers/228b8015-1061-46f1-a6a3-c5d0ba039660 => generated 1512 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:24.483243 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.compute.api [None req-aa800c25-c79e-4ec8-b686-3b01d071eb40 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: 97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4] Working on deleting snapshot 647966b2-9e0f-43e5-b810-88e47ef374f1 from shelved instance... Aug 27 02:54:25.163927 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b57d0cf3-f5c1-442a-9db0-4a5926f0166d tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:25.164558 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b57d0cf3-f5c1-442a-9db0-4a5926f0166d tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] [instance: dc54b06e-43a5-4450-bf3c-d9949dcf04b1] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:25.178797 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b57d0cf3-f5c1-442a-9db0-4a5926f0166d tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:25.179293 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b57d0cf3-f5c1-442a-9db0-4a5926f0166d tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:25.179722 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b57d0cf3-f5c1-442a-9db0-4a5926f0166d tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:25.180480 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b57d0cf3-f5c1-442a-9db0-4a5926f0166d tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:25.195721 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b57d0cf3-f5c1-442a-9db0-4a5926f0166d tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:25.196291 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b57d0cf3-f5c1-442a-9db0-4a5926f0166d tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:25.958232 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-b57d0cf3-f5c1-442a-9db0-4a5926f0166d tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317e74b4bbc4da298a0dcbd78068352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a8810c21784788b4c0ee64dedbaf15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:25.973496 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b57d0cf3-f5c1-442a-9db0-4a5926f0166d tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] 10.222.0.70 "GET /compute/v2.1/servers/dc54b06e-43a5-4450-bf3c-d9949dcf04b1" status: 200 len: 1507 microversion: 2.1 time: 0.814181 Aug 27 02:54:25.977733 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1429/2865] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:25 2022] GET /compute/v2.1/servers/dc54b06e-43a5-4450-bf3c-d9949dcf04b1 => generated 1507 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:25.985198 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-103ea2aa-e0a9-48dc-8c1f-9a8616241ee5 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '.version_select at 0x7f5edeb46550>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:26.062088 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-103ea2aa-e0a9-48dc-8c1f-9a8616241ee5 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "GET /compute/v2.1/images/57627f6b-d2bf-4292-a3b4-db93ad1b2e3f" status: 200 len: 1437 microversion: 2.1 time: 0.079472 Aug 27 02:54:26.063043 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1430/2866] 10.222.0.70 () {58 vars in 1233 bytes} [Sat Aug 27 02:54:25 2022] GET /compute/v2.1/images/57627f6b-d2bf-4292-a3b4-db93ad1b2e3f => generated 1437 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:26.219268 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-aa800c25-c79e-4ec8-b686-3b01d071eb40 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: 97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4] Doing local delete in cell 9e3f7cc8-d9cf-4064-9831-4fdba8cfa839(cell1) {{(pid=134052) _delete /opt/stack/nova/nova/compute/api.py:2546}} Aug 27 02:54:26.220042 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-aa800c25-c79e-4ec8-b686-3b01d071eb40 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:26.220920 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-aa800c25-c79e-4ec8-b686-3b01d071eb40 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:26.221368 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-aa800c25-c79e-4ec8-b686-3b01d071eb40 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:26.222581 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.compute.api [None req-aa800c25-c79e-4ec8-b686-3b01d071eb40 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: 97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Aug 27 02:54:26.230631 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.network.neutron [None req-aa800c25-c79e-4ec8-b686-3b01d071eb40 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: 97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4] deallocate_for_instance() {{(pid=134052) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Aug 27 02:54:26.574722 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-cca6460f-a5a4-4a6a-a4f0-280dadc794a6 tempest-QuotasAdminNegativeTest-1038096192 tempest-QuotasAdminNegativeTest-1038096192-project-admin] Calling method '.version_select at 0x7f5ede244b80>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:26.823223 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-cca6460f-a5a4-4a6a-a4f0-280dadc794a6 tempest-QuotasAdminNegativeTest-1038096192 tempest-QuotasAdminNegativeTest-1038096192-project-admin] 10.222.0.70 "GET /compute/v2.1/os-quota-sets/0323005115224960923bf4c1023754d8" status: 200 len: 371 microversion: 2.1 time: 0.750955 Aug 27 02:54:26.824012 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1431/2867] 10.222.0.70 () {58 vars in 1242 bytes} [Sat Aug 27 02:54:26 2022] GET /compute/v2.1/os-quota-sets/0323005115224960923bf4c1023754d8 => generated 371 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:54:26.830849 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-01b8741d-1687-415a-918a-5237b9a9bab7 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:26.831725 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-01b8741d-1687-415a-918a-5237b9a9bab7 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 228b8015-1061-46f1-a6a3-c5d0ba039660] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:26.841518 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-01b8741d-1687-415a-918a-5237b9a9bab7 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:26.842289 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-01b8741d-1687-415a-918a-5237b9a9bab7 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:26.843197 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-01b8741d-1687-415a-918a-5237b9a9bab7 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:26.844151 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-01b8741d-1687-415a-918a-5237b9a9bab7 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:26.844858 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-01b8741d-1687-415a-918a-5237b9a9bab7 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:26.845464 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-01b8741d-1687-415a-918a-5237b9a9bab7 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:26.937428 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=3 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:54:27.276475 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-01b8741d-1687-415a-918a-5237b9a9bab7 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:27.289377 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-01b8741d-1687-415a-918a-5237b9a9bab7 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/228b8015-1061-46f1-a6a3-c5d0ba039660" status: 200 len: 1512 microversion: 2.1 time: 0.464090 Aug 27 02:54:27.319106 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1432/2868] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:26 2022] GET /compute/v2.1/servers/228b8015-1061-46f1-a6a3-c5d0ba039660 => generated 1512 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:27.325948 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-1284d7c5-be6c-46c5-aebb-6325cfa8080f tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:27.326861 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-1284d7c5-be6c-46c5-aebb-6325cfa8080f tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] [instance: dc54b06e-43a5-4450-bf3c-d9949dcf04b1] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:27.334072 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1284d7c5-be6c-46c5-aebb-6325cfa8080f tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:27.335732 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1284d7c5-be6c-46c5-aebb-6325cfa8080f tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:27.336452 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1284d7c5-be6c-46c5-aebb-6325cfa8080f tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:27.337634 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1284d7c5-be6c-46c5-aebb-6325cfa8080f tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:27.338775 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1284d7c5-be6c-46c5-aebb-6325cfa8080f tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:27.339406 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1284d7c5-be6c-46c5-aebb-6325cfa8080f tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:27.360743 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=100 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:54:27.708870 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.network.neutron [None req-aa800c25-c79e-4ec8-b686-3b01d071eb40 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: 97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4] Updating instance_info_cache with network_info: [] {{(pid=134052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 27 02:54:27.740059 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-1284d7c5-be6c-46c5-aebb-6325cfa8080f tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317e74b4bbc4da298a0dcbd78068352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a8810c21784788b4c0ee64dedbaf15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:27.757744 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-1284d7c5-be6c-46c5-aebb-6325cfa8080f tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] 10.222.0.70 "GET /compute/v2.1/servers/dc54b06e-43a5-4450-bf3c-d9949dcf04b1" status: 200 len: 1507 microversion: 2.1 time: 0.437329 Aug 27 02:54:27.761100 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1433/2869] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:27 2022] GET /compute/v2.1/servers/dc54b06e-43a5-4450-bf3c-d9949dcf04b1 => generated 1507 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:27.778256 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-593119c0-1786-4e76-ad24-fbc36590521d tempest-QuotasAdminNegativeTest-1038096192 tempest-QuotasAdminNegativeTest-1038096192-project-admin] Action: 'update', calling method: .version_select at 0x7f5ede259700>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:54:28.256749 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-aa800c25-c79e-4ec8-b686-3b01d071eb40 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "DELETE /compute/v2.1/servers/97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4" status: 204 len: 0 microversion: 2.1 time: 3.968358 Aug 27 02:54:28.258132 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1437/2870] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:54:24 2022] DELETE /compute/v2.1/servers/97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4 => generated 0 bytes in 3972 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:54:28.268352 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ad195faf-2fa4-4737-b8a0-a4e220f51a27 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '.version_select at 0x7f5ee2c98310>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:28.375968 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ad195faf-2fa4-4737-b8a0-a4e220f51a27 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "GET /compute/v2.1/images/57627f6b-d2bf-4292-a3b4-db93ad1b2e3f" status: 200 len: 1437 microversion: 2.1 time: 0.116492 Aug 27 02:54:28.376961 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1438/2871] 10.222.0.70 () {58 vars in 1233 bytes} [Sat Aug 27 02:54:28 2022] GET /compute/v2.1/images/57627f6b-d2bf-4292-a3b4-db93ad1b2e3f => generated 1437 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:28.390670 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-dc7fcd81-bf0e-409a-b50c-caa08272cb3d req-f074752d-26cb-4a20-975d-7cddc64cd23d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4", "name": "network-vif-deleted", "tag": "b6ccabb4-3a86-495e-9764-020c27981067"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:54:28.421035 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-593119c0-1786-4e76-ad24-fbc36590521d tempest-QuotasAdminNegativeTest-1038096192 tempest-QuotasAdminNegativeTest-1038096192-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:28.421546 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-dc7fcd81-bf0e-409a-b50c-caa08272cb3d req-f074752d-26cb-4a20-975d-7cddc64cd23d service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:28.421711 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-593119c0-1786-4e76-ad24-fbc36590521d tempest-QuotasAdminNegativeTest-1038096192 tempest-QuotasAdminNegativeTest-1038096192-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:28.421996 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-593119c0-1786-4e76-ad24-fbc36590521d tempest-QuotasAdminNegativeTest-1038096192 tempest-QuotasAdminNegativeTest-1038096192-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:28.422139 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-dc7fcd81-bf0e-409a-b50c-caa08272cb3d req-f074752d-26cb-4a20-975d-7cddc64cd23d service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:28.422467 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-dc7fcd81-bf0e-409a-b50c-caa08272cb3d req-f074752d-26cb-4a20-975d-7cddc64cd23d service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:28.422740 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-593119c0-1786-4e76-ad24-fbc36590521d tempest-QuotasAdminNegativeTest-1038096192 tempest-QuotasAdminNegativeTest-1038096192-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:28.423197 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-593119c0-1786-4e76-ad24-fbc36590521d tempest-QuotasAdminNegativeTest-1038096192 tempest-QuotasAdminNegativeTest-1038096192-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:28.423629 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-593119c0-1786-4e76-ad24-fbc36590521d tempest-QuotasAdminNegativeTest-1038096192 tempest-QuotasAdminNegativeTest-1038096192-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:28.457772 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.compute.server_external_events [req-dc7fcd81-bf0e-409a-b50c-caa08272cb3d req-f074752d-26cb-4a20-975d-7cddc64cd23d service nova] Unable to find a host for instance 97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4. Dropping event network-vif-deleted {{(pid=134052) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 27 02:54:28.458820 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-dc7fcd81-bf0e-409a-b50c-caa08272cb3d req-f074752d-26cb-4a20-975d-7cddc64cd23d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.072756 Aug 27 02:54:28.461295 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1439/2872] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:54:28 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 84 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 27 02:54:28.471170 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9dfbe1e3-7cd6-4127-88d3-12300ad27fd3 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:54:28.479662 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-9dfbe1e3-7cd6-4127-88d3-12300ad27fd3 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] [instance: dc54b06e-43a5-4450-bf3c-d9949dcf04b1] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:28.492127 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9dfbe1e3-7cd6-4127-88d3-12300ad27fd3 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:28.496431 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9dfbe1e3-7cd6-4127-88d3-12300ad27fd3 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:28.497093 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9dfbe1e3-7cd6-4127-88d3-12300ad27fd3 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:28.498060 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9dfbe1e3-7cd6-4127-88d3-12300ad27fd3 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:28.498668 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9dfbe1e3-7cd6-4127-88d3-12300ad27fd3 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:28.500351 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9dfbe1e3-7cd6-4127-88d3-12300ad27fd3 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:28.611427 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-593119c0-1786-4e76-ad24-fbc36590521d tempest-QuotasAdminNegativeTest-1038096192 tempest-QuotasAdminNegativeTest-1038096192-project-admin] 10.222.0.70 "PUT /compute/v2.1/os-quota-sets/0323005115224960923bf4c1023754d8" status: 200 len: 328 microversion: 2.1 time: 0.847940 Aug 27 02:54:28.612216 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1434/2873] 10.222.0.70 () {60 vars in 1262 bytes} [Sat Aug 27 02:54:27 2022] PUT /compute/v2.1/os-quota-sets/0323005115224960923bf4c1023754d8 => generated 328 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:54:28.625423 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-2a9abd8b-015e-49b5-8d52-49d47c552055 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:28.627990 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-2a9abd8b-015e-49b5-8d52-49d47c552055 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: 97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:28.665014 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=12,nova_api:UPDATE=10 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:54:28.674303 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2a9abd8b-015e-49b5-8d52-49d47c552055 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:28.675145 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2a9abd8b-015e-49b5-8d52-49d47c552055 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:28.675792 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2a9abd8b-015e-49b5-8d52-49d47c552055 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:28.678549 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2a9abd8b-015e-49b5-8d52-49d47c552055 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:28.680645 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2a9abd8b-015e-49b5-8d52-49d47c552055 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:28.683206 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2a9abd8b-015e-49b5-8d52-49d47c552055 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:28.715522 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-2a9abd8b-015e-49b5-8d52-49d47c552055 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] HTTP exception thrown: Instance 97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4 could not be found. Aug 27 02:54:28.717390 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-2a9abd8b-015e-49b5-8d52-49d47c552055 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Request method failure captured: Aug 27 02:54:28.717390 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4 HTTP/1.1 Aug 27 02:54:28.717390 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:54:28.717390 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:54:28.717390 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:54:28.717390 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:54:28.717390 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:54:28.717390 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:54:28.717390 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:54:28.717390 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:54:28.717390 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYZ0St41cKkzS8_oefTYdmhcUQuTjHJMchuX75Wes8eVywW22WD3_nUDa_aMbIFBVV51GGjDa8GDt8SbwEVTMvQnSuXk6MkeKEfB2NWHjFnNKSNKnT9A2S4P8aN7qYWhUsGxW2ugzvIrMVMPtkn5w90KE7af4tlEcxQ5ERFDVU7f32Y Aug 27 02:54:28.717390 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:54:28.717390 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:54:28.717390 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:54:28.717390 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:54:28.717390 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:54:28.717390 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:54:28.717390 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 840077c9375b4b2a9214cb8dda094cc8 Aug 27 02:54:28.717390 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-DeleteServersTestJSON-725615510 Aug 27 02:54:28.717390 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:54:28.717390 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:54:28.717390 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/840077c9375b4b2a9214cb8dda094cc8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_840077c9375b4b2a9214cb8dda094cc8", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/840077c9375b4b2a9214cb8dda094cc8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/840077c9375b4b2a9214cb8dda094cc8"}]}] Aug 27 02:54:28.717390 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-DeleteServersTestJSON-725615510 Aug 27 02:54:28.717390 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 840077c9375b4b2a9214cb8dda094cc8 Aug 27 02:54:28.717390 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-DeleteServersTestJSON-725615510 Aug 27 02:54:28.717390 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-DeleteServersTestJSON-725615510-project Aug 27 02:54:28.717390 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:54:28.717390 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:54:28.717390 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: dc53b0977c2b4e06b2f290442483913b Aug 27 02:54:28.717390 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-DeleteServersTestJSON-725615510-project Aug 27 02:54:28.717390 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 02:54:28.717390 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance 97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4 could not be found. Aug 27 02:54:28.717390 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4'} Aug 27 02:54:28.717390 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:54:28.717390 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:54:28.717390 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:54:28.717390 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:54:28.717390 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:54:28.717390 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:54:28.717390 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:54:28.717390 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:54:28.717390 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:54:28.717390 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:54:28.717390 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4 could not be found. Aug 27 02:54:28.717390 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:54:28.717390 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:54:28.717390 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:54:28.717390 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:54:28.717390 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:54:28.717390 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:54:28.717390 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:54:28.717390 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:54:28.717390 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:54:28.717390 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:54:28.717390 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:54:28.717390 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:54:28.717390 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:54:28.717390 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:54:28.717390 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:54:28.717390 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:54:28.717390 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4 could not be found. Aug 27 02:54:28.717390 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:54:28.717390 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:54:28.717390 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:54:28.722787 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:54:28.722787 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:54:28.722787 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:54:28.722787 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:54:28.722787 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:54:28.722787 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4 could not be found. Aug 27 02:54:28.722787 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:54:28.723559 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9dfbe1e3-7cd6-4127-88d3-12300ad27fd3 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] 10.222.0.70 "PUT /compute/v2.1/servers/dc54b06e-43a5-4450-bf3c-d9949dcf04b1" status: 200 len: 1079 microversion: 2.1 time: 0.257572 Aug 27 02:54:28.724395 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1440/2874] 10.222.0.70 () {60 vars in 1256 bytes} [Sat Aug 27 02:54:28 2022] PUT /compute/v2.1/servers/dc54b06e-43a5-4450-bf3c-d9949dcf04b1 => generated 1079 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:28.725229 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-2a9abd8b-015e-49b5-8d52-49d47c552055 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Returning 404 to user: Instance 97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:54:28.726393 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-2a9abd8b-015e-49b5-8d52-49d47c552055 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4" status: 404 len: 111 microversion: 2.1 time: 0.111210 Aug 27 02:54:28.730426 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9eb5ccd4-ffac-41a1-b88d-08053ff05406 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:28.730426 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-9eb5ccd4-ffac-41a1-b88d-08053ff05406 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 228b8015-1061-46f1-a6a3-c5d0ba039660] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:28.731032 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1435/2875] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:28 2022] GET /compute/v2.1/servers/97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:54:28.737828 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-2d7d17e4-69c0-450b-b952-4d19abdf0918 req-64ba123f-efa7-4cc0-b953-943ddcfc4148 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb02560c-ca90-41f2-8e4a-1fe0f0494068", "name": "network-vif-plugged", "status": "completed", "tag": "6bd7f222-246e-43d7-af80-a8892ef8ad8b"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:54:28.744148 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9eb5ccd4-ffac-41a1-b88d-08053ff05406 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:28.744657 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9eb5ccd4-ffac-41a1-b88d-08053ff05406 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:28.745099 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9eb5ccd4-ffac-41a1-b88d-08053ff05406 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:28.745783 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9eb5ccd4-ffac-41a1-b88d-08053ff05406 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:28.746224 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9eb5ccd4-ffac-41a1-b88d-08053ff05406 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:28.746637 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9eb5ccd4-ffac-41a1-b88d-08053ff05406 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:28.750426 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-2d7d17e4-69c0-450b-b952-4d19abdf0918 req-64ba123f-efa7-4cc0-b953-943ddcfc4148 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:28.751541 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-2d7d17e4-69c0-450b-b952-4d19abdf0918 req-64ba123f-efa7-4cc0-b953-943ddcfc4148 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:28.752197 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-2d7d17e4-69c0-450b-b952-4d19abdf0918 req-64ba123f-efa7-4cc0-b953-943ddcfc4148 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:28.765746 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-2d7d17e4-69c0-450b-b952-4d19abdf0918 req-64ba123f-efa7-4cc0-b953-943ddcfc4148 service nova] Creating event network-vif-plugged:6bd7f222-246e-43d7-af80-a8892ef8ad8b for instance cb02560c-ca90-41f2-8e4a-1fe0f0494068 on n-h2-852278-4 Aug 27 02:54:28.771831 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-2d7d17e4-69c0-450b-b952-4d19abdf0918 req-64ba123f-efa7-4cc0-b953-943ddcfc4148 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038893 Aug 27 02:54:28.773358 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1436/2876] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:54:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:54:28.781355 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-9df81b2d-5ef4-45de-8027-a21bb66190b9 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-442536279", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "0eb95330-1246-40a4-bfca-d3f2e6ab9ae4"}, {"port": "55ef695b-3e5a-443f-aaa4-c5aca34edc53", "tag": "port-1"}, {"port": "57c0448a-207e-435f-9a6b-4477adaf5128", "tag": "port-2"}, {"uuid": "77c20b8e-be28-4bea-b97c-e9c37383b329", "tag": "net-1"}, {"uuid": "77c20b8e-be28-4bea-b97c-e9c37383b329"}, {"uuid": "cf7c1826-7f11-4c59-905b-ccb907a8e770", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "cf7c1826-7f11-4c59-905b-ccb907a8e770", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "d31d43c6-d3d0-4582-a93e-00d4df328b25", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "678dfac7-2ba6-44dc-baa1-6117daedcd35", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "acd88a8a-e459-4415-85a7-e5330cbb58fd", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1124830522"}], "key_name": "tempest-keypair-1854057571", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:54:29.432986 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.network.neutron [None req-9df81b2d-5ef4-45de-8027-a21bb66190b9 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] validate_networks() for [('0eb95330-1246-40a4-bfca-d3f2e6ab9ae4', None, None, None, None, None), (None, None, '55ef695b-3e5a-443f-aaa4-c5aca34edc53', None, None, None), (None, None, '57c0448a-207e-435f-9a6b-4477adaf5128', None, None, None), ('77c20b8e-be28-4bea-b97c-e9c37383b329', None, None, None, None, None), ('77c20b8e-be28-4bea-b97c-e9c37383b329', None, None, None, None, None), ('cf7c1826-7f11-4c59-905b-ccb907a8e770', '10.2.2.100', None, None, None, None), ('cf7c1826-7f11-4c59-905b-ccb907a8e770', '10.2.2.200', None, None, None, None)] {{(pid=134051) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:54:29.504124 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-9eb5ccd4-ffac-41a1-b88d-08053ff05406 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:29.512563 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9eb5ccd4-ffac-41a1-b88d-08053ff05406 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/228b8015-1061-46f1-a6a3-c5d0ba039660" status: 200 len: 1512 microversion: 2.1 time: 0.787099 Aug 27 02:54:29.518427 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1441/2877] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:28 2022] GET /compute/v2.1/servers/228b8015-1061-46f1-a6a3-c5d0ba039660 => generated 1512 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:29.527539 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ee8b8c2c-585f-4920-ada9-7390bfdfc633 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:29.530481 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-ee8b8c2c-585f-4920-ada9-7390bfdfc633 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] [instance: dc54b06e-43a5-4450-bf3c-d9949dcf04b1] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:29.544349 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ee8b8c2c-585f-4920-ada9-7390bfdfc633 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:29.547990 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ee8b8c2c-585f-4920-ada9-7390bfdfc633 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:29.548769 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ee8b8c2c-585f-4920-ada9-7390bfdfc633 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:29.549753 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ee8b8c2c-585f-4920-ada9-7390bfdfc633 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:29.550608 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ee8b8c2c-585f-4920-ada9-7390bfdfc633 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:29.551248 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ee8b8c2c-585f-4920-ada9-7390bfdfc633 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:29.948555 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-ee8b8c2c-585f-4920-ada9-7390bfdfc633 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317e74b4bbc4da298a0dcbd78068352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a8810c21784788b4c0ee64dedbaf15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:29.958270 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ee8b8c2c-585f-4920-ada9-7390bfdfc633 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] 10.222.0.70 "GET /compute/v2.1/servers/dc54b06e-43a5-4450-bf3c-d9949dcf04b1" status: 200 len: 1505 microversion: 2.1 time: 0.437855 Aug 27 02:54:29.964697 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1442/2878] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:29 2022] GET /compute/v2.1/servers/dc54b06e-43a5-4450-bf3c-d9949dcf04b1 => generated 1505 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:30.449557 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f2033c33-b2e5-4359-a7f5-c36e04d2ab4e tempest-QuotasAdminNegativeTest-671004927 tempest-QuotasAdminNegativeTest-671004927-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1714835150", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:54:30.555779 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.network.neutron [None req-f2033c33-b2e5-4359-a7f5-c36e04d2ab4e tempest-QuotasAdminNegativeTest-671004927 tempest-QuotasAdminNegativeTest-671004927-project] validate_networks() for None {{(pid=134052) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:54:31.348482 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-f2033c33-b2e5-4359-a7f5-c36e04d2ab4e tempest-QuotasAdminNegativeTest-671004927 tempest-QuotasAdminNegativeTest-671004927-project] Flavor limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:54:31.349657 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-f2033c33-b2e5-4359-a7f5-c36e04d2ab4e tempest-QuotasAdminNegativeTest-671004927 tempest-QuotasAdminNegativeTest-671004927-project] Image limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:54:31.351125 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-f2033c33-b2e5-4359-a7f5-c36e04d2ab4e tempest-QuotasAdminNegativeTest-671004927 tempest-QuotasAdminNegativeTest-671004927-project] Flavor pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:54:31.351734 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-f2033c33-b2e5-4359-a7f5-c36e04d2ab4e tempest-QuotasAdminNegativeTest-671004927 tempest-QuotasAdminNegativeTest-671004927-project] Image pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:54:31.352422 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-f2033c33-b2e5-4359-a7f5-c36e04d2ab4e tempest-QuotasAdminNegativeTest-671004927 tempest-QuotasAdminNegativeTest-671004927-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:54:31.378630 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f2033c33-b2e5-4359-a7f5-c36e04d2ab4e tempest-QuotasAdminNegativeTest-671004927 tempest-QuotasAdminNegativeTest-671004927-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:31.380013 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f2033c33-b2e5-4359-a7f5-c36e04d2ab4e tempest-QuotasAdminNegativeTest-671004927 tempest-QuotasAdminNegativeTest-671004927-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:31.384498 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f2033c33-b2e5-4359-a7f5-c36e04d2ab4e tempest-QuotasAdminNegativeTest-671004927 tempest-QuotasAdminNegativeTest-671004927-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:31.387269 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f2033c33-b2e5-4359-a7f5-c36e04d2ab4e tempest-QuotasAdminNegativeTest-671004927 tempest-QuotasAdminNegativeTest-671004927-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:31.388910 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f2033c33-b2e5-4359-a7f5-c36e04d2ab4e tempest-QuotasAdminNegativeTest-671004927 tempest-QuotasAdminNegativeTest-671004927-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:31.389535 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f2033c33-b2e5-4359-a7f5-c36e04d2ab4e tempest-QuotasAdminNegativeTest-671004927 tempest-QuotasAdminNegativeTest-671004927-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:31.443905 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-f2033c33-b2e5-4359-a7f5-c36e04d2ab4e tempest-QuotasAdminNegativeTest-671004927 tempest-QuotasAdminNegativeTest-671004927-project] Getting quotas for project 0323005115224960923bf4c1023754d8. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:54:31.465236 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-f2033c33-b2e5-4359-a7f5-c36e04d2ab4e tempest-QuotasAdminNegativeTest-671004927 tempest-QuotasAdminNegativeTest-671004927-project] Getting quotas for user c139fc18ea5648ee954a96089b084455 and project 0323005115224960923bf4c1023754d8. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:54:31.487730 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.utils [None req-f2033c33-b2e5-4359-a7f5-c36e04d2ab4e tempest-QuotasAdminNegativeTest-671004927 tempest-QuotasAdminNegativeTest-671004927-project] cores quota exceeded for 0323005115224960923bf4c1023754d8, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=134052) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 27 02:54:31.489665 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-f2033c33-b2e5-4359-a7f5-c36e04d2ab4e tempest-QuotasAdminNegativeTest-671004927 tempest-QuotasAdminNegativeTest-671004927-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 27 02:54:31.502960 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f2033c33-b2e5-4359-a7f5-c36e04d2ab4e tempest-QuotasAdminNegativeTest-671004927 tempest-QuotasAdminNegativeTest-671004927-project] Request method failure captured: Aug 27 02:54:31.502960 n-d-852278-4 devstack@n-api.service[134052]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 02:54:31.502960 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:54:31.502960 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:54:31.502960 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:54:31.502960 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 145 Aug 27 02:54:31.502960 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:54:31.502960 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:54:31.502960 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:54:31.502960 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:54:31.502960 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYdfW-FPB_OkwJB_zlvBvQshB_BgvvH6GZ7I0eR8qwpt1aI3-MO6HqlWVtF25R_e5XokFRq8En7r-FRKHYqEmW2eYul34hgTowUfykLacARxnNQXzNhAqiCewhrCgedqXyiXAc7Fq6-f3e1dGrBnDYorTcRa5s-Dmm-Nvex32MQKCbo Aug 27 02:54:31.502960 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:54:31.502960 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:54:31.502960 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:54:31.502960 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:54:31.502960 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:54:31.502960 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:54:31.502960 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 0323005115224960923bf4c1023754d8 Aug 27 02:54:31.502960 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-QuotasAdminNegativeTest-671004927 Aug 27 02:54:31.502960 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:54:31.502960 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:54:31.502960 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0323005115224960923bf4c1023754d8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_0323005115224960923bf4c1023754d8", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0323005115224960923bf4c1023754d8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/0323005115224960923bf4c1023754d8"}]}] Aug 27 02:54:31.502960 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-QuotasAdminNegativeTest-671004927 Aug 27 02:54:31.502960 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 0323005115224960923bf4c1023754d8 Aug 27 02:54:31.502960 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-671004927 Aug 27 02:54:31.502960 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-QuotasAdminNegativeTest-671004927-project Aug 27 02:54:31.502960 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:54:31.502960 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:54:31.502960 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: c139fc18ea5648ee954a96089b084455 Aug 27 02:54:31.502960 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-QuotasAdminNegativeTest-671004927-project Aug 27 02:54:31.502960 n-d-852278-4 devstack@n-api.service[134052]: Aug 27 02:54:31.502960 n-d-852278-4 devstack@n-api.service[134052]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1714835150", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452"}} Aug 27 02:54:31.502960 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 02:54:31.502960 n-d-852278-4 devstack@n-api.service[134052]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 27 02:54:31.502960 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1714835150', 'imageRef': '1552acd0-176a-4c81-b680-29d74105e9d6', 'flavorRef': '452'}}} Aug 27 02:54:31.502960 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:54:31.502960 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:54:31.502960 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 27 02:54:31.502960 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 27 02:54:31.502960 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 02:54:31.502960 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 02:54:31.502960 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 27 02:54:31.502960 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc Aug 27 02:54:31.502960 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 27 02:54:31.502960 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 27 02:54:31.502960 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 02:54:31.502960 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 02:54:31.502960 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 27 02:54:31.502960 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 27 02:54:31.502960 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 27 02:54:31.502960 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 27 02:54:31.502960 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 27 02:54:31.502960 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 27 02:54:31.502960 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Aug 27 02:54:31.502960 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:54:31.502960 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:54:31.502960 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:54:31.502960 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:54:31.502960 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 27 02:54:31.502960 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 27 02:54:31.502960 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 27 02:54:31.502960 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 27 02:54:31.502960 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Aug 27 02:54:31.508597 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 27 02:54:31.508597 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Aug 27 02:54:31.508597 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 27 02:54:31.508597 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 27 02:54:31.508597 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 27 02:54:31.508597 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 27 02:54:31.508597 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:54:31.508597 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:54:31.508597 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:54:31.508597 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:54:31.508597 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:54:31.508597 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:54:31.508597 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:54:31.508597 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:54:31.508597 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:54:31.508597 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:54:31.508597 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:54:31.508597 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:54:31.508597 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:54:31.508597 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:54:31.508597 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:54:31.508597 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:54:31.508597 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 27 02:54:31.508597 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 27 02:54:31.508597 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 27 02:54:31.508597 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 27 02:54:31.508597 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:54:31.508597 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:54:31.508597 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:54:31.508597 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:54:31.508597 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:54:31.508597 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:54:31.508597 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:54:31.508597 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:54:31.508597 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 27 02:54:31.508597 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:54:31.512962 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f2033c33-b2e5-4359-a7f5-c36e04d2ab4e tempest-QuotasAdminNegativeTest-671004927 tempest-QuotasAdminNegativeTest-671004927-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:54:31.514059 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f2033c33-b2e5-4359-a7f5-c36e04d2ab4e tempest-QuotasAdminNegativeTest-671004927 tempest-QuotasAdminNegativeTest-671004927-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 1.541216 Aug 27 02:54:31.518525 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1443/2879] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 02:54:29 2022] POST /compute/v2.1/servers => generated 111 bytes in 1551 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:54:31.524830 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-03067316-9ec8-476a-a183-9b3e7c764ef9 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1663432492", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "networks": [{"uuid": "9f81fa4d-d0d4-411f-b6ce-c99b22cb14d3"}]}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:54:31.606479 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.network.neutron [None req-03067316-9ec8-476a-a183-9b3e7c764ef9 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] validate_networks() for [('9f81fa4d-d0d4-411f-b6ce-c99b22cb14d3', None, None, None, None, None)] {{(pid=134052) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:54:32.594066 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-03067316-9ec8-476a-a183-9b3e7c764ef9 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Flavor limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:54:32.595575 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-03067316-9ec8-476a-a183-9b3e7c764ef9 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Image limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:54:32.596185 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-03067316-9ec8-476a-a183-9b3e7c764ef9 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Flavor pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:54:32.596705 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-03067316-9ec8-476a-a183-9b3e7c764ef9 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Image pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:54:32.597202 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-03067316-9ec8-476a-a183-9b3e7c764ef9 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:54:32.612139 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-03067316-9ec8-476a-a183-9b3e7c764ef9 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:32.615709 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-03067316-9ec8-476a-a183-9b3e7c764ef9 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:32.616857 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-03067316-9ec8-476a-a183-9b3e7c764ef9 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:32.618929 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-03067316-9ec8-476a-a183-9b3e7c764ef9 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:32.619522 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-03067316-9ec8-476a-a183-9b3e7c764ef9 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:32.620043 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-03067316-9ec8-476a-a183-9b3e7c764ef9 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:32.664302 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-03067316-9ec8-476a-a183-9b3e7c764ef9 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Getting quotas for project 840077c9375b4b2a9214cb8dda094cc8. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:54:32.697598 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-03067316-9ec8-476a-a183-9b3e7c764ef9 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Getting quotas for user dc53b0977c2b4e06b2f290442483913b and project 840077c9375b4b2a9214cb8dda094cc8. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:54:32.728138 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-03067316-9ec8-476a-a183-9b3e7c764ef9 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Going to run 1 instances... {{(pid=134052) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:54:32.731903 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-03067316-9ec8-476a-a183-9b3e7c764ef9 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: 1854f7da-898a-4c09-8da9-a69fab19bb71] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134052) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:54:32.815187 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-03067316-9ec8-476a-a183-9b3e7c764ef9 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.295267 Aug 27 02:54:32.816148 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1444/2880] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 02:54:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1297 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:54:32.822048 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-50f35ee0-8875-4bad-833d-cc24cb7e6a95 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '.version_select at 0x7f5ee2f7e1f0>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:32.924569 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-50f35ee0-8875-4bad-833d-cc24cb7e6a95 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "GET /compute/v2.1/images/57627f6b-d2bf-4292-a3b4-db93ad1b2e3f" status: 200 len: 1437 microversion: 2.1 time: 0.107072 Aug 27 02:54:32.931969 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1445/2881] 10.222.0.70 () {58 vars in 1233 bytes} [Sat Aug 27 02:54:32 2022] GET /compute/v2.1/images/57627f6b-d2bf-4292-a3b4-db93ad1b2e3f => generated 1437 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:32.942696 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9f11e741-691a-4eed-b8ce-8cede66421de tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:32.950269 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-9f11e741-691a-4eed-b8ce-8cede66421de tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] [instance: dc54b06e-43a5-4450-bf3c-d9949dcf04b1] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:32.966108 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9f11e741-691a-4eed-b8ce-8cede66421de tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:32.966754 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9f11e741-691a-4eed-b8ce-8cede66421de tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:32.967510 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9f11e741-691a-4eed-b8ce-8cede66421de tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:32.968685 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9f11e741-691a-4eed-b8ce-8cede66421de tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:32.969297 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9f11e741-691a-4eed-b8ce-8cede66421de tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:32.971865 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9f11e741-691a-4eed-b8ce-8cede66421de tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:33.427780 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-9f11e741-691a-4eed-b8ce-8cede66421de tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317e74b4bbc4da298a0dcbd78068352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a8810c21784788b4c0ee64dedbaf15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:33.459966 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9f11e741-691a-4eed-b8ce-8cede66421de tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] 10.222.0.70 "GET /compute/v2.1/servers/dc54b06e-43a5-4450-bf3c-d9949dcf04b1" status: 200 len: 1505 microversion: 2.1 time: 0.525862 Aug 27 02:54:33.475970 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1446/2882] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:32 2022] GET /compute/v2.1/servers/dc54b06e-43a5-4450-bf3c-d9949dcf04b1 => generated 1505 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:33.491731 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-31439c15-6b45-4caf-b957-858169bc89fb tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:33.503672 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-31439c15-6b45-4caf-b957-858169bc89fb tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 228b8015-1061-46f1-a6a3-c5d0ba039660] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:33.524287 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:54:33.545480 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-31439c15-6b45-4caf-b957-858169bc89fb tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:33.546081 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-31439c15-6b45-4caf-b957-858169bc89fb tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:33.547352 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-31439c15-6b45-4caf-b957-858169bc89fb tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:33.549163 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-31439c15-6b45-4caf-b957-858169bc89fb tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:33.550250 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-31439c15-6b45-4caf-b957-858169bc89fb tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:33.550838 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-31439c15-6b45-4caf-b957-858169bc89fb tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:33.944165 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-31439c15-6b45-4caf-b957-858169bc89fb tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:33.959720 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-31439c15-6b45-4caf-b957-858169bc89fb tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/228b8015-1061-46f1-a6a3-c5d0ba039660" status: 200 len: 1512 microversion: 2.1 time: 0.487839 Aug 27 02:54:33.962247 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1447/2883] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:33 2022] GET /compute/v2.1/servers/228b8015-1061-46f1-a6a3-c5d0ba039660 => generated 1512 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:33.974705 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f43586dc-27ed-47a6-916f-f09d18d270e5 tempest-QuotasAdminNegativeTest-1038096192 tempest-QuotasAdminNegativeTest-1038096192-project-admin] Action: 'update', calling method: .version_select at 0x7f5ee2f59670>, body: {"quota_set": {"cores": 20}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:54:34.412203 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f43586dc-27ed-47a6-916f-f09d18d270e5 tempest-QuotasAdminNegativeTest-1038096192 tempest-QuotasAdminNegativeTest-1038096192-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:34.418898 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f43586dc-27ed-47a6-916f-f09d18d270e5 tempest-QuotasAdminNegativeTest-1038096192 tempest-QuotasAdminNegativeTest-1038096192-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:34.419580 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f43586dc-27ed-47a6-916f-f09d18d270e5 tempest-QuotasAdminNegativeTest-1038096192 tempest-QuotasAdminNegativeTest-1038096192-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:34.422280 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f43586dc-27ed-47a6-916f-f09d18d270e5 tempest-QuotasAdminNegativeTest-1038096192 tempest-QuotasAdminNegativeTest-1038096192-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:34.423477 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f43586dc-27ed-47a6-916f-f09d18d270e5 tempest-QuotasAdminNegativeTest-1038096192 tempest-QuotasAdminNegativeTest-1038096192-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:34.424999 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f43586dc-27ed-47a6-916f-f09d18d270e5 tempest-QuotasAdminNegativeTest-1038096192 tempest-QuotasAdminNegativeTest-1038096192-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:34.433489 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-9df81b2d-5ef4-45de-8027-a21bb66190b9 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Flavor limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:54:34.434033 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-9df81b2d-5ef4-45de-8027-a21bb66190b9 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Image limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:54:34.435266 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-9df81b2d-5ef4-45de-8027-a21bb66190b9 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Flavor pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:54:34.435944 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-9df81b2d-5ef4-45de-8027-a21bb66190b9 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Image pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:54:34.436596 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-9df81b2d-5ef4-45de-8027-a21bb66190b9 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:54:34.476345 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9df81b2d-5ef4-45de-8027-a21bb66190b9 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:34.476916 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9df81b2d-5ef4-45de-8027-a21bb66190b9 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:34.477996 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9df81b2d-5ef4-45de-8027-a21bb66190b9 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:34.481170 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9df81b2d-5ef4-45de-8027-a21bb66190b9 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:34.482478 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9df81b2d-5ef4-45de-8027-a21bb66190b9 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:34.483803 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9df81b2d-5ef4-45de-8027-a21bb66190b9 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:34.513222 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-9df81b2d-5ef4-45de-8027-a21bb66190b9 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Getting quotas for project 10e26cc78b814d498d6a931ecf300dff. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:54:34.525079 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-9df81b2d-5ef4-45de-8027-a21bb66190b9 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Getting quotas for user 57aed857618644f7adc472fc5c5e0c36 and project 10e26cc78b814d498d6a931ecf300dff. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:54:34.558957 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f43586dc-27ed-47a6-916f-f09d18d270e5 tempest-QuotasAdminNegativeTest-1038096192 tempest-QuotasAdminNegativeTest-1038096192-project-admin] 10.222.0.70 "PUT /compute/v2.1/os-quota-sets/0323005115224960923bf4c1023754d8" status: 200 len: 329 microversion: 2.1 time: 0.595540 Aug 27 02:54:34.560126 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1448/2884] 10.222.0.70 () {60 vars in 1262 bytes} [Sat Aug 27 02:54:33 2022] PUT /compute/v2.1/os-quota-sets/0323005115224960923bf4c1023754d8 => generated 329 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:54:34.579457 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3f61b237-dc72-428f-8e07-f45a7558e844 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:34.582277 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-3f61b237-dc72-428f-8e07-f45a7558e844 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: 1854f7da-898a-4c09-8da9-a69fab19bb71] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:34.600910 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3f61b237-dc72-428f-8e07-f45a7558e844 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:34.602610 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3f61b237-dc72-428f-8e07-f45a7558e844 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:34.603351 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3f61b237-dc72-428f-8e07-f45a7558e844 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:34.605696 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3f61b237-dc72-428f-8e07-f45a7558e844 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:34.607729 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3f61b237-dc72-428f-8e07-f45a7558e844 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:34.609086 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3f61b237-dc72-428f-8e07-f45a7558e844 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:34.730199 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-3f61b237-dc72-428f-8e07-f45a7558e844 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:34.745177 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-3f61b237-dc72-428f-8e07-f45a7558e844 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/1854f7da-898a-4c09-8da9-a69fab19bb71" status: 200 len: 1267 microversion: 2.1 time: 0.183695 Aug 27 02:54:34.746079 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1449/2885] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:34 2022] GET /compute/v2.1/servers/1854f7da-898a-4c09-8da9-a69fab19bb71 => generated 1267 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:34.760878 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-cf8c7f22-e78a-4199-a6e4-ffac63257238 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:54:34.763639 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-cf8c7f22-e78a-4199-a6e4-ffac63257238 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] [instance: dc54b06e-43a5-4450-bf3c-d9949dcf04b1] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:34.774329 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cf8c7f22-e78a-4199-a6e4-ffac63257238 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:34.778035 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cf8c7f22-e78a-4199-a6e4-ffac63257238 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:34.778665 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cf8c7f22-e78a-4199-a6e4-ffac63257238 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:34.779393 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cf8c7f22-e78a-4199-a6e4-ffac63257238 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:34.779836 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cf8c7f22-e78a-4199-a6e4-ffac63257238 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:34.780254 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cf8c7f22-e78a-4199-a6e4-ffac63257238 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:34.849066 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=17,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:54:34.935791 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-9df81b2d-5ef4-45de-8027-a21bb66190b9 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Going to run 1 instances... {{(pid=134051) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:54:34.939052 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-9df81b2d-5ef4-45de-8027-a21bb66190b9 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] [instance: b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='d31d43c6-d3d0-4582-a93e-00d4df328b25',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='678dfac7-2ba6-44dc-baa1-6117daedcd35',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='acd88a8a-e459-4415-85a7-e5330cbb58fd',volume_size=None,volume_type=None)] {{(pid=134051) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:54:35.090212 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-cf8c7f22-e78a-4199-a6e4-ffac63257238 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] 10.222.0.70 "PUT /compute/v2.1/servers/dc54b06e-43a5-4450-bf3c-d9949dcf04b1" status: 200 len: 1081 microversion: 2.1 time: 0.342680 Aug 27 02:54:35.104342 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1450/2886] 10.222.0.70 () {60 vars in 1256 bytes} [Sat Aug 27 02:54:34 2022] PUT /compute/v2.1/servers/dc54b06e-43a5-4450-bf3c-d9949dcf04b1 => generated 1081 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:35.125058 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-26b13d9b-bfe4-4749-922f-a5b72ad69ad6 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '.version_select at 0x7f5ee251ee50>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:35.223558 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-26b13d9b-bfe4-4749-922f-a5b72ad69ad6 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "GET /compute/v2.1/images/57627f6b-d2bf-4292-a3b4-db93ad1b2e3f" status: 200 len: 1437 microversion: 2.1 time: 0.107859 Aug 27 02:54:35.224163 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1451/2887] 10.222.0.70 () {58 vars in 1233 bytes} [Sat Aug 27 02:54:35 2022] GET /compute/v2.1/images/57627f6b-d2bf-4292-a3b4-db93ad1b2e3f => generated 1437 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:35.234820 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9187bf49-33b0-4002-afd6-88cef276a5b3 tempest-QuotasAdminNegativeTest-1038096192 tempest-QuotasAdminNegativeTest-1038096192-project-admin] Calling method '.version_select at 0x7f5ee2504820>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:35.656154 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9187bf49-33b0-4002-afd6-88cef276a5b3 tempest-QuotasAdminNegativeTest-1038096192 tempest-QuotasAdminNegativeTest-1038096192-project-admin] 10.222.0.70 "GET /compute/v2.1/os-quota-sets/0323005115224960923bf4c1023754d8" status: 200 len: 371 microversion: 2.1 time: 0.430477 Aug 27 02:54:35.657086 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1452/2888] 10.222.0.70 () {58 vars in 1242 bytes} [Sat Aug 27 02:54:35 2022] GET /compute/v2.1/os-quota-sets/0323005115224960923bf4c1023754d8 => generated 371 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:54:35.682050 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-97e6e1ac-b93e-40f5-a1ab-f1a5dd57d444 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:35.684929 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-97e6e1ac-b93e-40f5-a1ab-f1a5dd57d444 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 228b8015-1061-46f1-a6a3-c5d0ba039660] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:35.701750 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-97e6e1ac-b93e-40f5-a1ab-f1a5dd57d444 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:35.702450 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-97e6e1ac-b93e-40f5-a1ab-f1a5dd57d444 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:35.703066 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-97e6e1ac-b93e-40f5-a1ab-f1a5dd57d444 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:35.703871 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-97e6e1ac-b93e-40f5-a1ab-f1a5dd57d444 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:35.704441 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-97e6e1ac-b93e-40f5-a1ab-f1a5dd57d444 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:35.705103 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-97e6e1ac-b93e-40f5-a1ab-f1a5dd57d444 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:35.786325 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-9df81b2d-5ef4-45de-8027-a21bb66190b9 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.32 time: 7.011166 Aug 27 02:54:35.788661 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1437/2889] 10.222.0.70 () {62 vars in 1189 bytes} [Sat Aug 27 02:54:28 2022] POST /compute/v2.1/servers => generated 406 bytes in 7015 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 27 02:54:35.797400 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-345ea121-17db-4594-b304-d430d8e0844a tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:35.798620 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-345ea121-17db-4594-b304-d430d8e0844a tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] [instance: dc54b06e-43a5-4450-bf3c-d9949dcf04b1] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:35.817519 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-345ea121-17db-4594-b304-d430d8e0844a tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:35.818583 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-345ea121-17db-4594-b304-d430d8e0844a tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:35.819280 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-345ea121-17db-4594-b304-d430d8e0844a tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:35.820459 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-345ea121-17db-4594-b304-d430d8e0844a tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:35.821734 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-345ea121-17db-4594-b304-d430d8e0844a tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:35.822426 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-345ea121-17db-4594-b304-d430d8e0844a tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:36.054156 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-97e6e1ac-b93e-40f5-a1ab-f1a5dd57d444 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:36.066354 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-97e6e1ac-b93e-40f5-a1ab-f1a5dd57d444 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/228b8015-1061-46f1-a6a3-c5d0ba039660" status: 200 len: 1512 microversion: 2.1 time: 0.406031 Aug 27 02:54:36.066968 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1453/2890] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:35 2022] GET /compute/v2.1/servers/228b8015-1061-46f1-a6a3-c5d0ba039660 => generated 1512 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:36.086009 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-dd00b71a-7e1f-412f-b7f2-152864438981 tempest-QuotasAdminNegativeTest-1038096192 tempest-QuotasAdminNegativeTest-1038096192-project-admin] Action: 'update', calling method: .version_select at 0x7f5ee345f940>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:54:36.138196 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-345ea121-17db-4594-b304-d430d8e0844a tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317e74b4bbc4da298a0dcbd78068352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a8810c21784788b4c0ee64dedbaf15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:36.153652 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-345ea121-17db-4594-b304-d430d8e0844a tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] 10.222.0.70 "GET /compute/v2.1/servers/dc54b06e-43a5-4450-bf3c-d9949dcf04b1" status: 200 len: 1507 microversion: 2.1 time: 0.362848 Aug 27 02:54:36.154645 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1438/2891] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:35 2022] GET /compute/v2.1/servers/dc54b06e-43a5-4450-bf3c-d9949dcf04b1 => generated 1507 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:36.159636 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e542c372-af88-4dcf-9b67-86f8efa8eb5d tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:36.160508 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-e542c372-af88-4dcf-9b67-86f8efa8eb5d tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: 1854f7da-898a-4c09-8da9-a69fab19bb71] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:36.177860 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e542c372-af88-4dcf-9b67-86f8efa8eb5d tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:36.178878 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e542c372-af88-4dcf-9b67-86f8efa8eb5d tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:36.179518 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e542c372-af88-4dcf-9b67-86f8efa8eb5d tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:36.180430 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e542c372-af88-4dcf-9b67-86f8efa8eb5d tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:36.181045 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e542c372-af88-4dcf-9b67-86f8efa8eb5d tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:36.181627 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e542c372-af88-4dcf-9b67-86f8efa8eb5d tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:36.573000 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e542c372-af88-4dcf-9b67-86f8efa8eb5d tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:36.597151 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dd00b71a-7e1f-412f-b7f2-152864438981 tempest-QuotasAdminNegativeTest-1038096192 tempest-QuotasAdminNegativeTest-1038096192-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:36.600748 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dd00b71a-7e1f-412f-b7f2-152864438981 tempest-QuotasAdminNegativeTest-1038096192 tempest-QuotasAdminNegativeTest-1038096192-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:36.602413 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dd00b71a-7e1f-412f-b7f2-152864438981 tempest-QuotasAdminNegativeTest-1038096192 tempest-QuotasAdminNegativeTest-1038096192-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:36.603006 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e542c372-af88-4dcf-9b67-86f8efa8eb5d tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/1854f7da-898a-4c09-8da9-a69fab19bb71" status: 200 len: 1315 microversion: 2.1 time: 0.445664 Aug 27 02:54:36.604956 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1439/2892] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:36 2022] GET /compute/v2.1/servers/1854f7da-898a-4c09-8da9-a69fab19bb71 => generated 1315 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:36.605139 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dd00b71a-7e1f-412f-b7f2-152864438981 tempest-QuotasAdminNegativeTest-1038096192 tempest-QuotasAdminNegativeTest-1038096192-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:36.605606 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dd00b71a-7e1f-412f-b7f2-152864438981 tempest-QuotasAdminNegativeTest-1038096192 tempest-QuotasAdminNegativeTest-1038096192-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:36.606022 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dd00b71a-7e1f-412f-b7f2-152864438981 tempest-QuotasAdminNegativeTest-1038096192 tempest-QuotasAdminNegativeTest-1038096192-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:36.611493 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8e646ad2-afe1-4455-9bd4-0c5d739ade44 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:36.613632 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-8e646ad2-afe1-4455-9bd4-0c5d739ade44 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] [instance: b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:36.734935 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-8e646ad2-afe1-4455-9bd4-0c5d739ade44 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:36.745335 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-8e646ad2-afe1-4455-9bd4-0c5d739ade44 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:36.747132 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-8e646ad2-afe1-4455-9bd4-0c5d739ade44 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:36.748487 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-8e646ad2-afe1-4455-9bd4-0c5d739ade44 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] 10.222.0.70 "GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7" status: 200 len: 1285 microversion: 2.32 time: 0.141505 Aug 27 02:54:36.749806 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1440/2893] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:54:36 2022] GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 => generated 1285 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:54:36.755696 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e1ea0a6e-d2e1-4418-a022-e595008c3590 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:36.756529 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-e1ea0a6e-d2e1-4418-a022-e595008c3590 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] [instance: dc54b06e-43a5-4450-bf3c-d9949dcf04b1] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:36.762525 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-dd00b71a-7e1f-412f-b7f2-152864438981 tempest-QuotasAdminNegativeTest-1038096192 tempest-QuotasAdminNegativeTest-1038096192-project-admin] 10.222.0.70 "PUT /compute/v2.1/os-quota-sets/0323005115224960923bf4c1023754d8" status: 200 len: 328 microversion: 2.1 time: 0.694477 Aug 27 02:54:36.765064 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e1ea0a6e-d2e1-4418-a022-e595008c3590 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:36.765782 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e1ea0a6e-d2e1-4418-a022-e595008c3590 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:36.767207 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e1ea0a6e-d2e1-4418-a022-e595008c3590 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:36.768162 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e1ea0a6e-d2e1-4418-a022-e595008c3590 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:36.769065 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e1ea0a6e-d2e1-4418-a022-e595008c3590 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:36.769934 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e1ea0a6e-d2e1-4418-a022-e595008c3590 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:36.782723 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1454/2894] 10.222.0.70 () {60 vars in 1262 bytes} [Sat Aug 27 02:54:36 2022] PUT /compute/v2.1/os-quota-sets/0323005115224960923bf4c1023754d8 => generated 328 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:54:36.796476 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6ff6c686-c0a7-472b-a22c-c77890a64688 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '.version_select at 0x7f5ee2438b80>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:36.910813 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-6ff6c686-c0a7-472b-a22c-c77890a64688 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "GET /compute/v2.1/images/57627f6b-d2bf-4292-a3b4-db93ad1b2e3f" status: 200 len: 1437 microversion: 2.1 time: 0.125841 Aug 27 02:54:36.918953 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1455/2895] 10.222.0.70 () {58 vars in 1233 bytes} [Sat Aug 27 02:54:36 2022] GET /compute/v2.1/images/57627f6b-d2bf-4292-a3b4-db93ad1b2e3f => generated 1437 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:37.090470 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-13816035-ceed-4ccb-aa6f-495691314443 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:37.091319 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-13816035-ceed-4ccb-aa6f-495691314443 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 228b8015-1061-46f1-a6a3-c5d0ba039660] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:37.101102 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-13816035-ceed-4ccb-aa6f-495691314443 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:37.104572 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-13816035-ceed-4ccb-aa6f-495691314443 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:37.106480 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-13816035-ceed-4ccb-aa6f-495691314443 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:37.109176 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-13816035-ceed-4ccb-aa6f-495691314443 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:37.110087 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-13816035-ceed-4ccb-aa6f-495691314443 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:37.111320 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-13816035-ceed-4ccb-aa6f-495691314443 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:37.245046 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e1ea0a6e-d2e1-4418-a022-e595008c3590 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317e74b4bbc4da298a0dcbd78068352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a8810c21784788b4c0ee64dedbaf15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:37.261128 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e1ea0a6e-d2e1-4418-a022-e595008c3590 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] 10.222.0.70 "GET /compute/v2.1/servers/dc54b06e-43a5-4450-bf3c-d9949dcf04b1" status: 200 len: 1507 microversion: 2.1 time: 0.509532 Aug 27 02:54:37.263250 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1441/2896] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:36 2022] GET /compute/v2.1/servers/dc54b06e-43a5-4450-bf3c-d9949dcf04b1 => generated 1507 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:37.271000 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a3611d36-ffef-4ba2-9bb0-ba1c5ae2dcff tempest-QuotasAdminNegativeTest-671004927 tempest-QuotasAdminNegativeTest-671004927-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1345765892", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:54:37.407032 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.network.neutron [None req-a3611d36-ffef-4ba2-9bb0-ba1c5ae2dcff tempest-QuotasAdminNegativeTest-671004927 tempest-QuotasAdminNegativeTest-671004927-project] validate_networks() for None {{(pid=134051) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:54:37.594587 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-13816035-ceed-4ccb-aa6f-495691314443 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:37.603782 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-13816035-ceed-4ccb-aa6f-495691314443 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/228b8015-1061-46f1-a6a3-c5d0ba039660" status: 200 len: 1512 microversion: 2.1 time: 0.519807 Aug 27 02:54:37.622959 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1456/2897] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:37 2022] GET /compute/v2.1/servers/228b8015-1061-46f1-a6a3-c5d0ba039660 => generated 1512 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:37.645052 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ae067d38-3655-4865-b530-a098a4038606 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:37.647134 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-ae067d38-3655-4865-b530-a098a4038606 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] [instance: dc54b06e-43a5-4450-bf3c-d9949dcf04b1] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:37.676495 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ae067d38-3655-4865-b530-a098a4038606 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:37.696060 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ae067d38-3655-4865-b530-a098a4038606 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:37.696733 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ae067d38-3655-4865-b530-a098a4038606 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:37.697503 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ae067d38-3655-4865-b530-a098a4038606 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:37.725466 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ae067d38-3655-4865-b530-a098a4038606 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:37.726315 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ae067d38-3655-4865-b530-a098a4038606 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:37.825781 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-ae067d38-3655-4865-b530-a098a4038606 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] [instance: dc54b06e-43a5-4450-bf3c-d9949dcf04b1] Going to try to terminate instance {{(pid=134052) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:54:38.057260 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-a3611d36-ffef-4ba2-9bb0-ba1c5ae2dcff tempest-QuotasAdminNegativeTest-671004927 tempest-QuotasAdminNegativeTest-671004927-project] Flavor limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:54:38.058896 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-a3611d36-ffef-4ba2-9bb0-ba1c5ae2dcff tempest-QuotasAdminNegativeTest-671004927 tempest-QuotasAdminNegativeTest-671004927-project] Image limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:54:38.059668 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-a3611d36-ffef-4ba2-9bb0-ba1c5ae2dcff tempest-QuotasAdminNegativeTest-671004927 tempest-QuotasAdminNegativeTest-671004927-project] Flavor pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:54:38.060248 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-a3611d36-ffef-4ba2-9bb0-ba1c5ae2dcff tempest-QuotasAdminNegativeTest-671004927 tempest-QuotasAdminNegativeTest-671004927-project] Image pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:54:38.060838 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-a3611d36-ffef-4ba2-9bb0-ba1c5ae2dcff tempest-QuotasAdminNegativeTest-671004927 tempest-QuotasAdminNegativeTest-671004927-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:54:38.072278 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a3611d36-ffef-4ba2-9bb0-ba1c5ae2dcff tempest-QuotasAdminNegativeTest-671004927 tempest-QuotasAdminNegativeTest-671004927-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:38.073068 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a3611d36-ffef-4ba2-9bb0-ba1c5ae2dcff tempest-QuotasAdminNegativeTest-671004927 tempest-QuotasAdminNegativeTest-671004927-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:38.073666 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a3611d36-ffef-4ba2-9bb0-ba1c5ae2dcff tempest-QuotasAdminNegativeTest-671004927 tempest-QuotasAdminNegativeTest-671004927-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:38.074579 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a3611d36-ffef-4ba2-9bb0-ba1c5ae2dcff tempest-QuotasAdminNegativeTest-671004927 tempest-QuotasAdminNegativeTest-671004927-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:38.077522 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a3611d36-ffef-4ba2-9bb0-ba1c5ae2dcff tempest-QuotasAdminNegativeTest-671004927 tempest-QuotasAdminNegativeTest-671004927-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:38.079118 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a3611d36-ffef-4ba2-9bb0-ba1c5ae2dcff tempest-QuotasAdminNegativeTest-671004927 tempest-QuotasAdminNegativeTest-671004927-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:38.102206 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-a3611d36-ffef-4ba2-9bb0-ba1c5ae2dcff tempest-QuotasAdminNegativeTest-671004927 tempest-QuotasAdminNegativeTest-671004927-project] Getting quotas for project 0323005115224960923bf4c1023754d8. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:54:38.108156 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-a3611d36-ffef-4ba2-9bb0-ba1c5ae2dcff tempest-QuotasAdminNegativeTest-671004927 tempest-QuotasAdminNegativeTest-671004927-project] Getting quotas for user c139fc18ea5648ee954a96089b084455 and project 0323005115224960923bf4c1023754d8. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:54:38.124252 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.utils [None req-a3611d36-ffef-4ba2-9bb0-ba1c5ae2dcff tempest-QuotasAdminNegativeTest-671004927 tempest-QuotasAdminNegativeTest-671004927-project] instances quota exceeded for 0323005115224960923bf4c1023754d8, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=134051) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 27 02:54:38.125366 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-a3611d36-ffef-4ba2-9bb0-ba1c5ae2dcff tempest-QuotasAdminNegativeTest-671004927 tempest-QuotasAdminNegativeTest-671004927-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 27 02:54:38.129219 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a3611d36-ffef-4ba2-9bb0-ba1c5ae2dcff tempest-QuotasAdminNegativeTest-671004927 tempest-QuotasAdminNegativeTest-671004927-project] Request method failure captured: Aug 27 02:54:38.129219 n-d-852278-4 devstack@n-api.service[134051]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 02:54:38.129219 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:54:38.129219 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:54:38.129219 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:54:38.129219 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 145 Aug 27 02:54:38.129219 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:54:38.129219 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:54:38.129219 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:54:38.129219 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:54:38.129219 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYdfW-FPB_OkwJB_zlvBvQshB_BgvvH6GZ7I0eR8qwpt1aI3-MO6HqlWVtF25R_e5XokFRq8En7r-FRKHYqEmW2eYul34hgTowUfykLacARxnNQXzNhAqiCewhrCgedqXyiXAc7Fq6-f3e1dGrBnDYorTcRa5s-Dmm-Nvex32MQKCbo Aug 27 02:54:38.129219 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:54:38.129219 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:54:38.129219 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:54:38.129219 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:54:38.129219 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:54:38.129219 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:54:38.129219 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 0323005115224960923bf4c1023754d8 Aug 27 02:54:38.129219 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-QuotasAdminNegativeTest-671004927 Aug 27 02:54:38.129219 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:54:38.129219 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:54:38.129219 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0323005115224960923bf4c1023754d8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_0323005115224960923bf4c1023754d8", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0323005115224960923bf4c1023754d8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/0323005115224960923bf4c1023754d8"}]}] Aug 27 02:54:38.129219 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-QuotasAdminNegativeTest-671004927 Aug 27 02:54:38.129219 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 0323005115224960923bf4c1023754d8 Aug 27 02:54:38.129219 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-671004927 Aug 27 02:54:38.129219 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-QuotasAdminNegativeTest-671004927-project Aug 27 02:54:38.129219 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:54:38.129219 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:54:38.129219 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: c139fc18ea5648ee954a96089b084455 Aug 27 02:54:38.129219 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-QuotasAdminNegativeTest-671004927-project Aug 27 02:54:38.129219 n-d-852278-4 devstack@n-api.service[134051]: Aug 27 02:54:38.129219 n-d-852278-4 devstack@n-api.service[134051]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1345765892", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452"}} Aug 27 02:54:38.129219 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 02:54:38.129219 n-d-852278-4 devstack@n-api.service[134051]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 27 02:54:38.129219 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1345765892', 'imageRef': '1552acd0-176a-4c81-b680-29d74105e9d6', 'flavorRef': '452'}}} Aug 27 02:54:38.129219 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:54:38.129219 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:54:38.129219 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 27 02:54:38.129219 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 27 02:54:38.129219 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 02:54:38.129219 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 02:54:38.129219 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 27 02:54:38.129219 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc Aug 27 02:54:38.129219 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 27 02:54:38.129219 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 27 02:54:38.129219 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 02:54:38.129219 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 02:54:38.129219 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 27 02:54:38.129219 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 27 02:54:38.129219 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 27 02:54:38.129219 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 27 02:54:38.129219 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 27 02:54:38.129219 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 27 02:54:38.129219 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Aug 27 02:54:38.129219 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:54:38.129219 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:54:38.129219 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:54:38.129219 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:54:38.129219 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 27 02:54:38.129219 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 27 02:54:38.129219 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 27 02:54:38.129219 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 27 02:54:38.129219 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Aug 27 02:54:38.134805 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 27 02:54:38.134805 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Aug 27 02:54:38.134805 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 27 02:54:38.134805 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 27 02:54:38.134805 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 27 02:54:38.134805 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 27 02:54:38.134805 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:54:38.134805 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:54:38.134805 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:54:38.134805 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:54:38.134805 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:54:38.134805 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:54:38.134805 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:54:38.134805 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:54:38.134805 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:54:38.134805 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:54:38.134805 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:54:38.134805 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:54:38.134805 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:54:38.134805 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:54:38.134805 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:54:38.134805 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:54:38.134805 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 27 02:54:38.134805 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 27 02:54:38.134805 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 27 02:54:38.134805 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 27 02:54:38.134805 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:54:38.134805 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:54:38.134805 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:54:38.134805 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:54:38.134805 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:54:38.134805 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:54:38.134805 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:54:38.134805 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:54:38.134805 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 27 02:54:38.134805 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:54:38.140410 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a3611d36-ffef-4ba2-9bb0-ba1c5ae2dcff tempest-QuotasAdminNegativeTest-671004927 tempest-QuotasAdminNegativeTest-671004927-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:54:38.141579 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a3611d36-ffef-4ba2-9bb0-ba1c5ae2dcff tempest-QuotasAdminNegativeTest-671004927 tempest-QuotasAdminNegativeTest-671004927-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.877132 Aug 27 02:54:38.146296 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1442/2898] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 02:54:37 2022] POST /compute/v2.1/servers => generated 119 bytes in 882 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:54:38.152531 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b9742f91-ad3d-4abc-bdb5-bb1ff1fbd39e tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:38.153575 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b9742f91-ad3d-4abc-bdb5-bb1ff1fbd39e tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: 1854f7da-898a-4c09-8da9-a69fab19bb71] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:38.160260 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ae067d38-3655-4865-b530-a098a4038606 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] 10.222.0.70 "DELETE /compute/v2.1/servers/dc54b06e-43a5-4450-bf3c-d9949dcf04b1" status: 204 len: 0 microversion: 2.1 time: 0.535729 Aug 27 02:54:38.161943 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b9742f91-ad3d-4abc-bdb5-bb1ff1fbd39e tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:38.162632 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b9742f91-ad3d-4abc-bdb5-bb1ff1fbd39e tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:38.163231 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b9742f91-ad3d-4abc-bdb5-bb1ff1fbd39e tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:38.164443 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b9742f91-ad3d-4abc-bdb5-bb1ff1fbd39e tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:38.165062 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b9742f91-ad3d-4abc-bdb5-bb1ff1fbd39e tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:38.165692 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b9742f91-ad3d-4abc-bdb5-bb1ff1fbd39e tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:38.167089 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1457/2899] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:54:37 2022] DELETE /compute/v2.1/servers/dc54b06e-43a5-4450-bf3c-d9949dcf04b1 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:54:38.208407 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e8d7d735-4a65-46bc-a57a-02110a8a2c8d tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:38.213728 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-e8d7d735-4a65-46bc-a57a-02110a8a2c8d tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] [instance: b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:38.229062 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e8d7d735-4a65-46bc-a57a-02110a8a2c8d tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:38.230306 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e8d7d735-4a65-46bc-a57a-02110a8a2c8d tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:38.231385 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e8d7d735-4a65-46bc-a57a-02110a8a2c8d tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:38.233704 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e8d7d735-4a65-46bc-a57a-02110a8a2c8d tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:38.234541 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e8d7d735-4a65-46bc-a57a-02110a8a2c8d tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:38.235461 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e8d7d735-4a65-46bc-a57a-02110a8a2c8d tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:38.395440 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-e8d7d735-4a65-46bc-a57a-02110a8a2c8d tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:38.407061 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-e8d7d735-4a65-46bc-a57a-02110a8a2c8d tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:38.409188 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-e8d7d735-4a65-46bc-a57a-02110a8a2c8d tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:38.411057 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e8d7d735-4a65-46bc-a57a-02110a8a2c8d tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] 10.222.0.70 "GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7" status: 200 len: 1519 microversion: 2.32 time: 0.228081 Aug 27 02:54:38.412366 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1458/2900] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:54:38 2022] GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 => generated 1519 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:54:38.419167 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-786d7943-e7e1-471b-9dce-0ac7c6982cf3 req-f1f7f4b7-1659-4950-aac7-5a18ae205a96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1854f7da-898a-4c09-8da9-a69fab19bb71", "tag": "10ed780f-6187-49a9-a5a1-880bcba4e477"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:54:38.430949 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-786d7943-e7e1-471b-9dce-0ac7c6982cf3 req-f1f7f4b7-1659-4950-aac7-5a18ae205a96 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:38.431722 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-786d7943-e7e1-471b-9dce-0ac7c6982cf3 req-f1f7f4b7-1659-4950-aac7-5a18ae205a96 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:38.432782 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-786d7943-e7e1-471b-9dce-0ac7c6982cf3 req-f1f7f4b7-1659-4950-aac7-5a18ae205a96 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:38.446445 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-786d7943-e7e1-471b-9dce-0ac7c6982cf3 req-f1f7f4b7-1659-4950-aac7-5a18ae205a96 service nova] Creating event network-changed:10ed780f-6187-49a9-a5a1-880bcba4e477 for instance 1854f7da-898a-4c09-8da9-a69fab19bb71 on n-h1-852278-4 Aug 27 02:54:38.453352 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-786d7943-e7e1-471b-9dce-0ac7c6982cf3 req-f1f7f4b7-1659-4950-aac7-5a18ae205a96 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039231 Aug 27 02:54:38.454586 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1459/2901] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:54:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:54:38.464271 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d0ffac8b-c93e-408a-941e-ef8ebc5bb5e5 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '.version_select at 0x7f5ee245a700>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:38.471829 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-b9742f91-ad3d-4abc-bdb5-bb1ff1fbd39e tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:38.489450 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b9742f91-ad3d-4abc-bdb5-bb1ff1fbd39e tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/1854f7da-898a-4c09-8da9-a69fab19bb71" status: 200 len: 1315 microversion: 2.1 time: 0.339331 Aug 27 02:54:38.490989 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1443/2902] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:38 2022] GET /compute/v2.1/servers/1854f7da-898a-4c09-8da9-a69fab19bb71 => generated 1315 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:38.499393 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-194724da-9207-4294-afa2-662f0b317fad tempest-QuotasAdminNegativeTest-1038096192 tempest-QuotasAdminNegativeTest-1038096192-project-admin] Action: 'update', calling method: .version_select at 0x7f5ee72168b0>, body: {"quota_set": {"instances": 10}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:54:38.560006 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d0ffac8b-c93e-408a-941e-ef8ebc5bb5e5 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "GET /compute/v2.1/images/57627f6b-d2bf-4292-a3b4-db93ad1b2e3f" status: 200 len: 1437 microversion: 2.1 time: 0.100789 Aug 27 02:54:38.569309 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1460/2903] 10.222.0.70 () {58 vars in 1233 bytes} [Sat Aug 27 02:54:38 2022] GET /compute/v2.1/images/57627f6b-d2bf-4292-a3b4-db93ad1b2e3f => generated 1437 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:38.578053 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9df62f54-211e-472f-8d47-fbfbeb1a8ad7 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:38.582253 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-9df62f54-211e-472f-8d47-fbfbeb1a8ad7 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] [instance: dc54b06e-43a5-4450-bf3c-d9949dcf04b1] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:38.603347 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9df62f54-211e-472f-8d47-fbfbeb1a8ad7 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:38.604482 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9df62f54-211e-472f-8d47-fbfbeb1a8ad7 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:38.605080 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9df62f54-211e-472f-8d47-fbfbeb1a8ad7 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:38.605773 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9df62f54-211e-472f-8d47-fbfbeb1a8ad7 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:38.607282 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9df62f54-211e-472f-8d47-fbfbeb1a8ad7 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:38.608408 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9df62f54-211e-472f-8d47-fbfbeb1a8ad7 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:38.664111 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-9df62f54-211e-472f-8d47-fbfbeb1a8ad7 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] [instance: dc54b06e-43a5-4450-bf3c-d9949dcf04b1] Going to try to terminate instance {{(pid=134052) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:54:38.731572 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.compute.api [None req-9df62f54-211e-472f-8d47-fbfbeb1a8ad7 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] [instance: dc54b06e-43a5-4450-bf3c-d9949dcf04b1] Instance is already in deleting state, ignoring this request Aug 27 02:54:38.732625 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9df62f54-211e-472f-8d47-fbfbeb1a8ad7 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] 10.222.0.70 "DELETE /compute/v2.1/servers/dc54b06e-43a5-4450-bf3c-d9949dcf04b1" status: 204 len: 0 microversion: 2.1 time: 0.162148 Aug 27 02:54:38.736879 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1461/2904] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:54:38 2022] DELETE /compute/v2.1/servers/dc54b06e-43a5-4450-bf3c-d9949dcf04b1 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:54:38.742041 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-00881966-c056-4dc9-9393-fa30d47f3315 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:38.742940 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-00881966-c056-4dc9-9393-fa30d47f3315 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 228b8015-1061-46f1-a6a3-c5d0ba039660] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:38.749569 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-00881966-c056-4dc9-9393-fa30d47f3315 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:38.750478 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-00881966-c056-4dc9-9393-fa30d47f3315 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:38.751001 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-00881966-c056-4dc9-9393-fa30d47f3315 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:38.752100 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-00881966-c056-4dc9-9393-fa30d47f3315 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:38.752792 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-00881966-c056-4dc9-9393-fa30d47f3315 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:38.753422 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-00881966-c056-4dc9-9393-fa30d47f3315 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:38.850872 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-194724da-9207-4294-afa2-662f0b317fad tempest-QuotasAdminNegativeTest-1038096192 tempest-QuotasAdminNegativeTest-1038096192-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:38.851816 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-194724da-9207-4294-afa2-662f0b317fad tempest-QuotasAdminNegativeTest-1038096192 tempest-QuotasAdminNegativeTest-1038096192-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:38.852533 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-194724da-9207-4294-afa2-662f0b317fad tempest-QuotasAdminNegativeTest-1038096192 tempest-QuotasAdminNegativeTest-1038096192-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:38.853818 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-194724da-9207-4294-afa2-662f0b317fad tempest-QuotasAdminNegativeTest-1038096192 tempest-QuotasAdminNegativeTest-1038096192-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:38.854469 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-194724da-9207-4294-afa2-662f0b317fad tempest-QuotasAdminNegativeTest-1038096192 tempest-QuotasAdminNegativeTest-1038096192-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:38.855104 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-194724da-9207-4294-afa2-662f0b317fad tempest-QuotasAdminNegativeTest-1038096192 tempest-QuotasAdminNegativeTest-1038096192-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:38.948527 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-00881966-c056-4dc9-9393-fa30d47f3315 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:38.958669 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-00881966-c056-4dc9-9393-fa30d47f3315 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/228b8015-1061-46f1-a6a3-c5d0ba039660" status: 200 len: 1512 microversion: 2.1 time: 0.220408 Aug 27 02:54:38.961591 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1462/2905] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:38 2022] GET /compute/v2.1/servers/228b8015-1061-46f1-a6a3-c5d0ba039660 => generated 1512 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:38.970004 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-81a75c0b-3b15-4aa2-b865-89ec5375af69 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:38.972138 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-81a75c0b-3b15-4aa2-b865-89ec5375af69 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] [instance: dc54b06e-43a5-4450-bf3c-d9949dcf04b1] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:38.986398 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-81a75c0b-3b15-4aa2-b865-89ec5375af69 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:38.989287 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-81a75c0b-3b15-4aa2-b865-89ec5375af69 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:38.990395 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-81a75c0b-3b15-4aa2-b865-89ec5375af69 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:38.991332 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-81a75c0b-3b15-4aa2-b865-89ec5375af69 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:38.991784 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-81a75c0b-3b15-4aa2-b865-89ec5375af69 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:38.992227 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-81a75c0b-3b15-4aa2-b865-89ec5375af69 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:39.012365 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-194724da-9207-4294-afa2-662f0b317fad tempest-QuotasAdminNegativeTest-1038096192 tempest-QuotasAdminNegativeTest-1038096192-project-admin] 10.222.0.70 "PUT /compute/v2.1/os-quota-sets/0323005115224960923bf4c1023754d8" status: 200 len: 329 microversion: 2.1 time: 0.513888 Aug 27 02:54:39.012365 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1444/2906] 10.222.0.70 () {60 vars in 1262 bytes} [Sat Aug 27 02:54:38 2022] PUT /compute/v2.1/os-quota-sets/0323005115224960923bf4c1023754d8 => generated 329 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:54:39.023081 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b8826dc2-63e7-4bee-ba9b-b156cde12f21 tempest-QuotasAdminNegativeTest-1038096192 tempest-QuotasAdminNegativeTest-1038096192-project-admin] Calling method '.version_select at 0x7f5ede27fe50>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:39.212515 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-81a75c0b-3b15-4aa2-b865-89ec5375af69 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317e74b4bbc4da298a0dcbd78068352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a8810c21784788b4c0ee64dedbaf15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:39.222144 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-81a75c0b-3b15-4aa2-b865-89ec5375af69 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] 10.222.0.70 "GET /compute/v2.1/servers/dc54b06e-43a5-4450-bf3c-d9949dcf04b1" status: 200 len: 1513 microversion: 2.1 time: 0.259365 Aug 27 02:54:39.239937 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1463/2907] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:38 2022] GET /compute/v2.1/servers/dc54b06e-43a5-4450-bf3c-d9949dcf04b1 => generated 1513 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:39.354461 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b8826dc2-63e7-4bee-ba9b-b156cde12f21 tempest-QuotasAdminNegativeTest-1038096192 tempest-QuotasAdminNegativeTest-1038096192-project-admin] 10.222.0.70 "GET /compute/v2.1/os-quota-sets/0323005115224960923bf4c1023754d8" status: 200 len: 371 microversion: 2.1 time: 0.335747 Aug 27 02:54:39.355377 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1445/2908] 10.222.0.70 () {58 vars in 1242 bytes} [Sat Aug 27 02:54:39 2022] GET /compute/v2.1/os-quota-sets/0323005115224960923bf4c1023754d8 => generated 371 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:54:39.369399 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-67c906c7-2b44-4219-8ef2-a83b705719bf tempest-QuotasAdminNegativeTest-1038096192 tempest-QuotasAdminNegativeTest-1038096192-project-admin] Action: 'update', calling method: .version_select at 0x7f5ee24a2ee0>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:54:39.438479 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4e3f9578-a087-45ab-9033-2f9cfc105902 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:39.439711 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-4e3f9578-a087-45ab-9033-2f9cfc105902 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] [instance: b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:39.447149 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4e3f9578-a087-45ab-9033-2f9cfc105902 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:39.447972 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4e3f9578-a087-45ab-9033-2f9cfc105902 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:39.451632 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4e3f9578-a087-45ab-9033-2f9cfc105902 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:39.454449 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4e3f9578-a087-45ab-9033-2f9cfc105902 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:39.456879 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4e3f9578-a087-45ab-9033-2f9cfc105902 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:39.457716 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4e3f9578-a087-45ab-9033-2f9cfc105902 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:39.469773 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-67c906c7-2b44-4219-8ef2-a83b705719bf tempest-QuotasAdminNegativeTest-1038096192 tempest-QuotasAdminNegativeTest-1038096192-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:39.472850 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-67c906c7-2b44-4219-8ef2-a83b705719bf tempest-QuotasAdminNegativeTest-1038096192 tempest-QuotasAdminNegativeTest-1038096192-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:39.473374 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-67c906c7-2b44-4219-8ef2-a83b705719bf tempest-QuotasAdminNegativeTest-1038096192 tempest-QuotasAdminNegativeTest-1038096192-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:39.474599 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-67c906c7-2b44-4219-8ef2-a83b705719bf tempest-QuotasAdminNegativeTest-1038096192 tempest-QuotasAdminNegativeTest-1038096192-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:39.476524 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-67c906c7-2b44-4219-8ef2-a83b705719bf tempest-QuotasAdminNegativeTest-1038096192 tempest-QuotasAdminNegativeTest-1038096192-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:39.477605 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-67c906c7-2b44-4219-8ef2-a83b705719bf tempest-QuotasAdminNegativeTest-1038096192 tempest-QuotasAdminNegativeTest-1038096192-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:39.584920 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-4e3f9578-a087-45ab-9033-2f9cfc105902 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:39.602724 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-4e3f9578-a087-45ab-9033-2f9cfc105902 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:39.602724 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-4e3f9578-a087-45ab-9033-2f9cfc105902 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:39.603973 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-4e3f9578-a087-45ab-9033-2f9cfc105902 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] 10.222.0.70 "GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7" status: 200 len: 1575 microversion: 2.32 time: 0.170310 Aug 27 02:54:39.604808 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1446/2909] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:54:39 2022] GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 => generated 1575 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:54:39.613053 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-67c906c7-2b44-4219-8ef2-a83b705719bf tempest-QuotasAdminNegativeTest-1038096192 tempest-QuotasAdminNegativeTest-1038096192-project-admin] 10.222.0.70 "PUT /compute/v2.1/os-quota-sets/0323005115224960923bf4c1023754d8" status: 200 len: 325 microversion: 2.1 time: 0.248928 Aug 27 02:54:39.627015 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1464/2910] 10.222.0.70 () {60 vars in 1262 bytes} [Sat Aug 27 02:54:39 2022] PUT /compute/v2.1/os-quota-sets/0323005115224960923bf4c1023754d8 => generated 325 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:54:39.633300 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-fd693ef1-131b-4c3e-8441-f336248ff03d tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:39.633927 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-fd693ef1-131b-4c3e-8441-f336248ff03d tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: 1854f7da-898a-4c09-8da9-a69fab19bb71] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:39.649583 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-df00d1a1-9b40-46d2-9ce5-3f9d359e3535 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '.version_select at 0x7f5ee24a2ca0>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:39.666152 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fd693ef1-131b-4c3e-8441-f336248ff03d tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:39.669345 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fd693ef1-131b-4c3e-8441-f336248ff03d tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:39.670048 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fd693ef1-131b-4c3e-8441-f336248ff03d tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:39.671011 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fd693ef1-131b-4c3e-8441-f336248ff03d tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:39.671865 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fd693ef1-131b-4c3e-8441-f336248ff03d tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:39.672728 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fd693ef1-131b-4c3e-8441-f336248ff03d tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:39.726316 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-df00d1a1-9b40-46d2-9ce5-3f9d359e3535 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "GET /compute/v2.1/images/57627f6b-d2bf-4292-a3b4-db93ad1b2e3f" status: 200 len: 1437 microversion: 2.1 time: 0.096987 Aug 27 02:54:39.727468 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1465/2911] 10.222.0.70 () {58 vars in 1233 bytes} [Sat Aug 27 02:54:39 2022] GET /compute/v2.1/images/57627f6b-d2bf-4292-a3b4-db93ad1b2e3f => generated 1437 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:39.930745 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-53c670d3-5f12-4b25-a3f3-133aab1cf314 tempest-QuotasAdminNegativeTest-671004927 tempest-QuotasAdminNegativeTest-671004927-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-369125259", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:54:40.043211 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.network.neutron [None req-53c670d3-5f12-4b25-a3f3-133aab1cf314 tempest-QuotasAdminNegativeTest-671004927 tempest-QuotasAdminNegativeTest-671004927-project] validate_networks() for None {{(pid=134052) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:54:41.416092 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-fd693ef1-131b-4c3e-8441-f336248ff03d tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:41.432198 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-fd693ef1-131b-4c3e-8441-f336248ff03d tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/1854f7da-898a-4c09-8da9-a69fab19bb71" status: 200 len: 1315 microversion: 2.1 time: 1.814440 Aug 27 02:54:41.446636 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1447/2912] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:39 2022] GET /compute/v2.1/servers/1854f7da-898a-4c09-8da9-a69fab19bb71 => generated 1315 bytes in 1829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:41.448340 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-2bd6b97a-0e70-43b4-b5d9-ba4165679257 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:41.448340 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-2bd6b97a-0e70-43b4-b5d9-ba4165679257 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 228b8015-1061-46f1-a6a3-c5d0ba039660] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:41.464654 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2bd6b97a-0e70-43b4-b5d9-ba4165679257 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:41.468122 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2bd6b97a-0e70-43b4-b5d9-ba4165679257 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:41.468746 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2bd6b97a-0e70-43b4-b5d9-ba4165679257 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:41.470073 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2bd6b97a-0e70-43b4-b5d9-ba4165679257 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:41.471686 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2bd6b97a-0e70-43b4-b5d9-ba4165679257 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:41.474670 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2bd6b97a-0e70-43b4-b5d9-ba4165679257 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:42.070432 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-53c670d3-5f12-4b25-a3f3-133aab1cf314 tempest-QuotasAdminNegativeTest-671004927 tempest-QuotasAdminNegativeTest-671004927-project] Flavor limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:54:42.071516 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-53c670d3-5f12-4b25-a3f3-133aab1cf314 tempest-QuotasAdminNegativeTest-671004927 tempest-QuotasAdminNegativeTest-671004927-project] Image limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:54:42.072182 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-53c670d3-5f12-4b25-a3f3-133aab1cf314 tempest-QuotasAdminNegativeTest-671004927 tempest-QuotasAdminNegativeTest-671004927-project] Flavor pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:54:42.072819 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-53c670d3-5f12-4b25-a3f3-133aab1cf314 tempest-QuotasAdminNegativeTest-671004927 tempest-QuotasAdminNegativeTest-671004927-project] Image pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:54:42.073415 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-53c670d3-5f12-4b25-a3f3-133aab1cf314 tempest-QuotasAdminNegativeTest-671004927 tempest-QuotasAdminNegativeTest-671004927-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:54:42.095062 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-53c670d3-5f12-4b25-a3f3-133aab1cf314 tempest-QuotasAdminNegativeTest-671004927 tempest-QuotasAdminNegativeTest-671004927-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:42.095931 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-53c670d3-5f12-4b25-a3f3-133aab1cf314 tempest-QuotasAdminNegativeTest-671004927 tempest-QuotasAdminNegativeTest-671004927-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:42.096631 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-53c670d3-5f12-4b25-a3f3-133aab1cf314 tempest-QuotasAdminNegativeTest-671004927 tempest-QuotasAdminNegativeTest-671004927-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:42.097627 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-53c670d3-5f12-4b25-a3f3-133aab1cf314 tempest-QuotasAdminNegativeTest-671004927 tempest-QuotasAdminNegativeTest-671004927-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:42.098345 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-53c670d3-5f12-4b25-a3f3-133aab1cf314 tempest-QuotasAdminNegativeTest-671004927 tempest-QuotasAdminNegativeTest-671004927-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:42.099036 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-53c670d3-5f12-4b25-a3f3-133aab1cf314 tempest-QuotasAdminNegativeTest-671004927 tempest-QuotasAdminNegativeTest-671004927-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:42.140825 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-53c670d3-5f12-4b25-a3f3-133aab1cf314 tempest-QuotasAdminNegativeTest-671004927 tempest-QuotasAdminNegativeTest-671004927-project] Getting quotas for project 0323005115224960923bf4c1023754d8. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:54:42.154332 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-53c670d3-5f12-4b25-a3f3-133aab1cf314 tempest-QuotasAdminNegativeTest-671004927 tempest-QuotasAdminNegativeTest-671004927-project] Getting quotas for user c139fc18ea5648ee954a96089b084455 and project 0323005115224960923bf4c1023754d8. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:54:42.182958 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.utils [None req-53c670d3-5f12-4b25-a3f3-133aab1cf314 tempest-QuotasAdminNegativeTest-671004927 tempest-QuotasAdminNegativeTest-671004927-project] ram quota exceeded for 0323005115224960923bf4c1023754d8, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=134052) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 27 02:54:42.185679 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-53c670d3-5f12-4b25-a3f3-133aab1cf314 tempest-QuotasAdminNegativeTest-671004927 tempest-QuotasAdminNegativeTest-671004927-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 27 02:54:42.188061 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-53c670d3-5f12-4b25-a3f3-133aab1cf314 tempest-QuotasAdminNegativeTest-671004927 tempest-QuotasAdminNegativeTest-671004927-project] Request method failure captured: Aug 27 02:54:42.188061 n-d-852278-4 devstack@n-api.service[134052]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 02:54:42.188061 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:54:42.188061 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:54:42.188061 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:54:42.188061 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 144 Aug 27 02:54:42.188061 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:54:42.188061 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:54:42.188061 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:54:42.188061 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:54:42.188061 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYdfW-FPB_OkwJB_zlvBvQshB_BgvvH6GZ7I0eR8qwpt1aI3-MO6HqlWVtF25R_e5XokFRq8En7r-FRKHYqEmW2eYul34hgTowUfykLacARxnNQXzNhAqiCewhrCgedqXyiXAc7Fq6-f3e1dGrBnDYorTcRa5s-Dmm-Nvex32MQKCbo Aug 27 02:54:42.188061 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:54:42.188061 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:54:42.188061 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:54:42.188061 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:54:42.188061 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:54:42.188061 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:54:42.188061 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 0323005115224960923bf4c1023754d8 Aug 27 02:54:42.188061 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-QuotasAdminNegativeTest-671004927 Aug 27 02:54:42.188061 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:54:42.188061 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:54:42.188061 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0323005115224960923bf4c1023754d8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_0323005115224960923bf4c1023754d8", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0323005115224960923bf4c1023754d8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/0323005115224960923bf4c1023754d8"}]}] Aug 27 02:54:42.188061 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-QuotasAdminNegativeTest-671004927 Aug 27 02:54:42.188061 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 0323005115224960923bf4c1023754d8 Aug 27 02:54:42.188061 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-671004927 Aug 27 02:54:42.188061 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-QuotasAdminNegativeTest-671004927-project Aug 27 02:54:42.188061 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:54:42.188061 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:54:42.188061 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: c139fc18ea5648ee954a96089b084455 Aug 27 02:54:42.188061 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-QuotasAdminNegativeTest-671004927-project Aug 27 02:54:42.188061 n-d-852278-4 devstack@n-api.service[134052]: Aug 27 02:54:42.188061 n-d-852278-4 devstack@n-api.service[134052]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-369125259", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452"}} Aug 27 02:54:42.188061 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 02:54:42.188061 n-d-852278-4 devstack@n-api.service[134052]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 27 02:54:42.188061 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-369125259', 'imageRef': '1552acd0-176a-4c81-b680-29d74105e9d6', 'flavorRef': '452'}}} Aug 27 02:54:42.188061 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:54:42.188061 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:54:42.188061 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 27 02:54:42.188061 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 27 02:54:42.188061 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 02:54:42.188061 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 02:54:42.188061 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 27 02:54:42.188061 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc Aug 27 02:54:42.188061 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 27 02:54:42.188061 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 27 02:54:42.188061 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 02:54:42.188061 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 02:54:42.188061 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 27 02:54:42.188061 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 27 02:54:42.188061 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 27 02:54:42.188061 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 27 02:54:42.188061 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 27 02:54:42.188061 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 27 02:54:42.188061 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Aug 27 02:54:42.188061 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:54:42.188061 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:54:42.188061 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:54:42.188061 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:54:42.188061 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 27 02:54:42.188061 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 27 02:54:42.188061 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 27 02:54:42.188061 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 27 02:54:42.188061 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Aug 27 02:54:42.193379 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 27 02:54:42.193379 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Aug 27 02:54:42.193379 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 27 02:54:42.193379 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 27 02:54:42.193379 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 27 02:54:42.193379 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 27 02:54:42.193379 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:54:42.193379 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:54:42.193379 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:54:42.193379 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:54:42.193379 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:54:42.193379 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:54:42.193379 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:54:42.193379 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:54:42.193379 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:54:42.193379 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:54:42.193379 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:54:42.193379 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:54:42.193379 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:54:42.193379 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:54:42.193379 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:54:42.193379 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:54:42.193379 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 27 02:54:42.193379 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 27 02:54:42.193379 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 27 02:54:42.193379 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 27 02:54:42.193379 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:54:42.193379 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:54:42.193379 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:54:42.193379 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:54:42.193379 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:54:42.193379 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:54:42.193379 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:54:42.193379 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:54:42.193379 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 27 02:54:42.193379 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:54:42.212089 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-53c670d3-5f12-4b25-a3f3-133aab1cf314 tempest-QuotasAdminNegativeTest-671004927 tempest-QuotasAdminNegativeTest-671004927-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:54:42.214288 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-53c670d3-5f12-4b25-a3f3-133aab1cf314 tempest-QuotasAdminNegativeTest-671004927 tempest-QuotasAdminNegativeTest-671004927-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 2.289825 Aug 27 02:54:42.218455 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1466/2913] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 02:54:39 2022] POST /compute/v2.1/servers => generated 110 bytes in 2295 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:54:42.225141 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-414b193c-1fd2-4414-8635-2a657d6f91a8 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:42.231712 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-414b193c-1fd2-4414-8635-2a657d6f91a8 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] [instance: dc54b06e-43a5-4450-bf3c-d9949dcf04b1] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:42.243271 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-414b193c-1fd2-4414-8635-2a657d6f91a8 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:42.246739 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-414b193c-1fd2-4414-8635-2a657d6f91a8 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:42.247485 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-414b193c-1fd2-4414-8635-2a657d6f91a8 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:42.251000 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-414b193c-1fd2-4414-8635-2a657d6f91a8 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:42.251967 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-414b193c-1fd2-4414-8635-2a657d6f91a8 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:42.252682 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-414b193c-1fd2-4414-8635-2a657d6f91a8 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:42.486333 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-414b193c-1fd2-4414-8635-2a657d6f91a8 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317e74b4bbc4da298a0dcbd78068352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a8810c21784788b4c0ee64dedbaf15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:42.501529 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-414b193c-1fd2-4414-8635-2a657d6f91a8 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] 10.222.0.70 "GET /compute/v2.1/servers/dc54b06e-43a5-4450-bf3c-d9949dcf04b1" status: 200 len: 1471 microversion: 2.1 time: 0.277305 Aug 27 02:54:42.505249 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1467/2914] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:42 2022] GET /compute/v2.1/servers/dc54b06e-43a5-4450-bf3c-d9949dcf04b1 => generated 1471 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:42.524236 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-2bd6b97a-0e70-43b4-b5d9-ba4165679257 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:42.524796 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-581e11b7-b5ba-47e3-9848-69934aef2f38 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:42.531105 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-581e11b7-b5ba-47e3-9848-69934aef2f38 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] [instance: b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:42.534061 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-2bd6b97a-0e70-43b4-b5d9-ba4165679257 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/228b8015-1061-46f1-a6a3-c5d0ba039660" status: 200 len: 1512 microversion: 2.1 time: 1.097785 Aug 27 02:54:42.537911 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1448/2915] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:41 2022] GET /compute/v2.1/servers/228b8015-1061-46f1-a6a3-c5d0ba039660 => generated 1512 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:42.557353 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-581e11b7-b5ba-47e3-9848-69934aef2f38 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:42.558114 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-581e11b7-b5ba-47e3-9848-69934aef2f38 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:42.558363 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-fefd882f-1cf1-4b3d-9cbf-183dda04d44b tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '.version_select at 0x7f5ede1caee0>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:42.558917 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-581e11b7-b5ba-47e3-9848-69934aef2f38 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:42.560717 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-581e11b7-b5ba-47e3-9848-69934aef2f38 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:42.561366 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-581e11b7-b5ba-47e3-9848-69934aef2f38 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:42.562316 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-581e11b7-b5ba-47e3-9848-69934aef2f38 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:42.654952 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-fefd882f-1cf1-4b3d-9cbf-183dda04d44b tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "GET /compute/v2.1/images/57627f6b-d2bf-4292-a3b4-db93ad1b2e3f" status: 200 len: 1437 microversion: 2.1 time: 0.115502 Aug 27 02:54:42.665784 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1449/2916] 10.222.0.70 () {58 vars in 1233 bytes} [Sat Aug 27 02:54:42 2022] GET /compute/v2.1/images/57627f6b-d2bf-4292-a3b4-db93ad1b2e3f => generated 1437 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:42.670930 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-44c543cd-f9aa-4270-b2a9-7713175ee590 tempest-QuotasAdminNegativeTest-1038096192 tempest-QuotasAdminNegativeTest-1038096192-project-admin] Action: 'update', calling method: .version_select at 0x7f5ede1c38b0>, body: {"quota_set": {"ram": 51200}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:54:43.016401 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-581e11b7-b5ba-47e3-9848-69934aef2f38 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:43.035585 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-581e11b7-b5ba-47e3-9848-69934aef2f38 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:43.040594 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-581e11b7-b5ba-47e3-9848-69934aef2f38 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:43.042591 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-581e11b7-b5ba-47e3-9848-69934aef2f38 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] 10.222.0.70 "GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7" status: 200 len: 1593 microversion: 2.32 time: 0.536225 Aug 27 02:54:43.075304 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1468/2917] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:54:42 2022] GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 => generated 1593 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:54:43.086999 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-37b3d777-e4d0-4167-8396-66f9ec7fa5e3 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:43.093953 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-37b3d777-e4d0-4167-8396-66f9ec7fa5e3 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: 1854f7da-898a-4c09-8da9-a69fab19bb71] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:43.108760 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-37b3d777-e4d0-4167-8396-66f9ec7fa5e3 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:43.111753 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-37b3d777-e4d0-4167-8396-66f9ec7fa5e3 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:43.115442 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-37b3d777-e4d0-4167-8396-66f9ec7fa5e3 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:43.116757 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-37b3d777-e4d0-4167-8396-66f9ec7fa5e3 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:43.118030 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-37b3d777-e4d0-4167-8396-66f9ec7fa5e3 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:43.119926 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-37b3d777-e4d0-4167-8396-66f9ec7fa5e3 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:43.327132 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-44c543cd-f9aa-4270-b2a9-7713175ee590 tempest-QuotasAdminNegativeTest-1038096192 tempest-QuotasAdminNegativeTest-1038096192-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:43.331186 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-44c543cd-f9aa-4270-b2a9-7713175ee590 tempest-QuotasAdminNegativeTest-1038096192 tempest-QuotasAdminNegativeTest-1038096192-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:43.331916 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-44c543cd-f9aa-4270-b2a9-7713175ee590 tempest-QuotasAdminNegativeTest-1038096192 tempest-QuotasAdminNegativeTest-1038096192-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:43.332930 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-44c543cd-f9aa-4270-b2a9-7713175ee590 tempest-QuotasAdminNegativeTest-1038096192 tempest-QuotasAdminNegativeTest-1038096192-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:43.340260 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-44c543cd-f9aa-4270-b2a9-7713175ee590 tempest-QuotasAdminNegativeTest-1038096192 tempest-QuotasAdminNegativeTest-1038096192-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:43.341142 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-44c543cd-f9aa-4270-b2a9-7713175ee590 tempest-QuotasAdminNegativeTest-1038096192 tempest-QuotasAdminNegativeTest-1038096192-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:43.485930 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-44c543cd-f9aa-4270-b2a9-7713175ee590 tempest-QuotasAdminNegativeTest-1038096192 tempest-QuotasAdminNegativeTest-1038096192-project-admin] 10.222.0.70 "PUT /compute/v2.1/os-quota-sets/0323005115224960923bf4c1023754d8" status: 200 len: 329 microversion: 2.1 time: 0.817529 Aug 27 02:54:43.490842 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1450/2918] 10.222.0.70 () {60 vars in 1262 bytes} [Sat Aug 27 02:54:42 2022] PUT /compute/v2.1/os-quota-sets/0323005115224960923bf4c1023754d8 => generated 329 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:54:43.513424 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-6a0f5be9-0235-42e8-a88e-db58a4a2b4a6 req-dfc5937d-57bd-4fc9-8a47-8bc8e6ffe2cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc54b06e-43a5-4450-bf3c-d9949dcf04b1", "name": "network-vif-deleted", "tag": "e6026f69-48ad-496a-a661-91dce3b2f0ba"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:54:43.555957 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-6a0f5be9-0235-42e8-a88e-db58a4a2b4a6 req-dfc5937d-57bd-4fc9-8a47-8bc8e6ffe2cf service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:43.558517 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-6a0f5be9-0235-42e8-a88e-db58a4a2b4a6 req-dfc5937d-57bd-4fc9-8a47-8bc8e6ffe2cf service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:43.559603 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-6a0f5be9-0235-42e8-a88e-db58a4a2b4a6 req-dfc5937d-57bd-4fc9-8a47-8bc8e6ffe2cf service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:43.576443 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-37b3d777-e4d0-4167-8396-66f9ec7fa5e3 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:43.587559 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-6a0f5be9-0235-42e8-a88e-db58a4a2b4a6 req-dfc5937d-57bd-4fc9-8a47-8bc8e6ffe2cf service nova] Creating event network-vif-deleted:e6026f69-48ad-496a-a661-91dce3b2f0ba for instance dc54b06e-43a5-4450-bf3c-d9949dcf04b1 on n-h2-852278-4 Aug 27 02:54:43.587835 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-37b3d777-e4d0-4167-8396-66f9ec7fa5e3 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/1854f7da-898a-4c09-8da9-a69fab19bb71" status: 200 len: 1315 microversion: 2.1 time: 0.510519 Aug 27 02:54:43.588682 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1469/2919] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:43 2022] GET /compute/v2.1/servers/1854f7da-898a-4c09-8da9-a69fab19bb71 => generated 1315 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:43.595122 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-6a0f5be9-0235-42e8-a88e-db58a4a2b4a6 req-dfc5937d-57bd-4fc9-8a47-8bc8e6ffe2cf service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092716 Aug 27 02:54:43.596364 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1451/2920] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:54:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:54:43.625483 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-fb285358-4909-4bb0-9317-76961f2a4086 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:43.631723 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-fb285358-4909-4bb0-9317-76961f2a4086 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] [instance: dc54b06e-43a5-4450-bf3c-d9949dcf04b1] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:43.637515 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-064aa498-a7ba-45b1-8aa3-22759013dfad tempest-QuotasAdminNegativeTest-671004927 tempest-QuotasAdminNegativeTest-671004927-project] Action: 'update', calling method: .version_select at 0x7f5ee23f88b0>, body: {"quota_set": {"ram": 0}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:54:43.644160 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-064aa498-a7ba-45b1-8aa3-22759013dfad tempest-QuotasAdminNegativeTest-671004927 tempest-QuotasAdminNegativeTest-671004927-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': 'c139fc18ea5648ee954a96089b084455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0323005115224960923bf4c1023754d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:43.649806 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fb285358-4909-4bb0-9317-76961f2a4086 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:43.652700 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fb285358-4909-4bb0-9317-76961f2a4086 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:43.653552 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fb285358-4909-4bb0-9317-76961f2a4086 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:43.655538 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fb285358-4909-4bb0-9317-76961f2a4086 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:43.656846 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fb285358-4909-4bb0-9317-76961f2a4086 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:43.658152 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fb285358-4909-4bb0-9317-76961f2a4086 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:43.674607 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-064aa498-a7ba-45b1-8aa3-22759013dfad tempest-QuotasAdminNegativeTest-671004927 tempest-QuotasAdminNegativeTest-671004927-project] Request method failure captured: Aug 27 02:54:43.674607 n-d-852278-4 devstack@n-api.service[134052]: request: PUT /compute/v2.1/os-quota-sets/0323005115224960923bf4c1023754d8 HTTP/1.1 Aug 27 02:54:43.674607 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:54:43.674607 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:54:43.674607 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:54:43.674607 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 25 Aug 27 02:54:43.674607 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:54:43.674607 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:54:43.674607 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:54:43.674607 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:54:43.674607 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYdfW-FPB_OkwJB_zlvBvQshB_BgvvH6GZ7I0eR8qwpt1aI3-MO6HqlWVtF25R_e5XokFRq8En7r-FRKHYqEmW2eYul34hgTowUfykLacARxnNQXzNhAqiCewhrCgedqXyiXAc7Fq6-f3e1dGrBnDYorTcRa5s-Dmm-Nvex32MQKCbo Aug 27 02:54:43.674607 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:54:43.674607 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:54:43.674607 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:54:43.674607 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:54:43.674607 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:54:43.674607 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:54:43.674607 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 0323005115224960923bf4c1023754d8 Aug 27 02:54:43.674607 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-QuotasAdminNegativeTest-671004927 Aug 27 02:54:43.674607 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:54:43.674607 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:54:43.674607 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0323005115224960923bf4c1023754d8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_0323005115224960923bf4c1023754d8", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0323005115224960923bf4c1023754d8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/0323005115224960923bf4c1023754d8"}]}] Aug 27 02:54:43.674607 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-QuotasAdminNegativeTest-671004927 Aug 27 02:54:43.674607 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 0323005115224960923bf4c1023754d8 Aug 27 02:54:43.674607 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-671004927 Aug 27 02:54:43.674607 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-QuotasAdminNegativeTest-671004927-project Aug 27 02:54:43.674607 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:54:43.674607 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:54:43.674607 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: c139fc18ea5648ee954a96089b084455 Aug 27 02:54:43.674607 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-QuotasAdminNegativeTest-671004927-project Aug 27 02:54:43.674607 n-d-852278-4 devstack@n-api.service[134052]: Aug 27 02:54:43.674607 n-d-852278-4 devstack@n-api.service[134052]: {"quota_set": {"ram": 0}} Aug 27 02:54:43.674607 n-d-852278-4 devstack@n-api.service[134052]: method: Aug 27 02:54:43.674607 n-d-852278-4 devstack@n-api.service[134052]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 27 02:54:43.674607 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '0323005115224960923bf4c1023754d8', 'body': {'quota_set': {'ram': 0}}} Aug 27 02:54:43.674607 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:54:43.674607 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:54:43.674607 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:54:43.674607 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:54:43.674607 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:54:43.674607 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:54:43.674607 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:54:43.674607 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:54:43.674607 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:54:43.674607 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:54:43.674607 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:54:43.674607 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:54:43.674607 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Aug 27 02:54:43.674607 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Aug 27 02:54:43.674607 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 02:54:43.674607 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:54:43.674607 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 02:54:43.674607 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:54:43.674607 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Aug 27 02:54:43.674607 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Aug 27 02:54:43.674607 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 02:54:43.674607 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 02:54:43.674607 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 02:54:43.674607 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 02:54:43.674607 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 02:54:43.674607 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 02:54:43.674607 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 02:54:43.674607 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 02:54:43.674607 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 02:54:43.674607 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 02:54:43.682275 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 02:54:43.682275 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 02:54:43.682275 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 02:54:43.682275 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 02:54:43.682275 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 27 02:54:43.682275 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:54:43.682275 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:54:43.682275 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:54:43.682275 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:54:43.682275 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:54:43.682275 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:54:43.682275 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 02:54:43.682275 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 02:54:43.682275 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 27 02:54:43.682275 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:54:43.682275 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-064aa498-a7ba-45b1-8aa3-22759013dfad tempest-QuotasAdminNegativeTest-671004927 tempest-QuotasAdminNegativeTest-671004927-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:54:43.682275 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-064aa498-a7ba-45b1-8aa3-22759013dfad tempest-QuotasAdminNegativeTest-671004927 tempest-QuotasAdminNegativeTest-671004927-project] 10.222.0.70 "PUT /compute/v2.1/os-quota-sets/0323005115224960923bf4c1023754d8" status: 403 len: 116 microversion: 2.1 time: 0.072847 Aug 27 02:54:43.685212 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1470/2921] 10.222.0.70 () {60 vars in 1262 bytes} [Sat Aug 27 02:54:43 2022] PUT /compute/v2.1/os-quota-sets/0323005115224960923bf4c1023754d8 => generated 116 bytes in 94 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:54:43.687993 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-998278c2-9ce8-482d-902d-cd4ba7e5e7c8 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:43.694287 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-998278c2-9ce8-482d-902d-cd4ba7e5e7c8 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 228b8015-1061-46f1-a6a3-c5d0ba039660] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:43.720067 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-998278c2-9ce8-482d-902d-cd4ba7e5e7c8 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:43.720624 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-998278c2-9ce8-482d-902d-cd4ba7e5e7c8 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:43.721076 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-998278c2-9ce8-482d-902d-cd4ba7e5e7c8 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:43.721807 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-998278c2-9ce8-482d-902d-cd4ba7e5e7c8 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:43.722313 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-998278c2-9ce8-482d-902d-cd4ba7e5e7c8 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:43.722671 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-998278c2-9ce8-482d-902d-cd4ba7e5e7c8 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:43.741080 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fb285358-4909-4bb0-9317-76961f2a4086 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:43.742827 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fb285358-4909-4bb0-9317-76961f2a4086 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:43.745228 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fb285358-4909-4bb0-9317-76961f2a4086 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:43.745853 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.objects.instance [None req-fb285358-4909-4bb0-9317-76961f2a4086 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lazy-loading 'fault' on Instance uuid dc54b06e-43a5-4450-bf3c-d9949dcf04b1 {{(pid=134051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:54:43.832848 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-fb285358-4909-4bb0-9317-76961f2a4086 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd317e74b4bbc4da298a0dcbd78068352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a8810c21784788b4c0ee64dedbaf15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:43.845391 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-fb285358-4909-4bb0-9317-76961f2a4086 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] 10.222.0.70 "GET /compute/v2.1/servers/dc54b06e-43a5-4450-bf3c-d9949dcf04b1" status: 200 len: 1308 microversion: 2.1 time: 0.247544 Aug 27 02:54:43.846003 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1452/2922] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:43 2022] GET /compute/v2.1/servers/dc54b06e-43a5-4450-bf3c-d9949dcf04b1 => generated 1308 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:43.858209 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a0f64ff4-af5f-465f-8fb6-c775aed1df5f tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '.version_select at 0x7f5ede27d430>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:43.944198 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a0f64ff4-af5f-465f-8fb6-c775aed1df5f tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "GET /compute/v2.1/images/57627f6b-d2bf-4292-a3b4-db93ad1b2e3f" status: 200 len: 1437 microversion: 2.1 time: 0.097104 Aug 27 02:54:43.944835 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1453/2923] 10.222.0.70 () {58 vars in 1233 bytes} [Sat Aug 27 02:54:43 2022] GET /compute/v2.1/images/57627f6b-d2bf-4292-a3b4-db93ad1b2e3f => generated 1437 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:44.069313 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f2b3735b-791e-443d-a7e5-522710642d47 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:44.070343 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-f2b3735b-791e-443d-a7e5-522710642d47 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] [instance: b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:44.086535 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f2b3735b-791e-443d-a7e5-522710642d47 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:44.093031 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f2b3735b-791e-443d-a7e5-522710642d47 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:44.093489 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f2b3735b-791e-443d-a7e5-522710642d47 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:44.100751 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f2b3735b-791e-443d-a7e5-522710642d47 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:44.101625 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f2b3735b-791e-443d-a7e5-522710642d47 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:44.102222 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f2b3735b-791e-443d-a7e5-522710642d47 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:44.409181 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-f2b3735b-791e-443d-a7e5-522710642d47 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:44.432353 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-f2b3735b-791e-443d-a7e5-522710642d47 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:44.441705 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-f2b3735b-791e-443d-a7e5-522710642d47 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:44.447375 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-f2b3735b-791e-443d-a7e5-522710642d47 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] 10.222.0.70 "GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7" status: 200 len: 1593 microversion: 2.32 time: 0.380192 Aug 27 02:54:44.449409 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1454/2924] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:54:44 2022] GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 => generated 1593 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:54:44.542547 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-998278c2-9ce8-482d-902d-cd4ba7e5e7c8 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:44.558497 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-998278c2-9ce8-482d-902d-cd4ba7e5e7c8 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/228b8015-1061-46f1-a6a3-c5d0ba039660" status: 200 len: 1489 microversion: 2.1 time: 0.868922 Aug 27 02:54:44.561874 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1471/2925] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:43 2022] GET /compute/v2.1/servers/228b8015-1061-46f1-a6a3-c5d0ba039660 => generated 1489 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:44.592634 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-12eaabbd-d105-40e7-ba68-6b10df8cc841 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:54:44.604142 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-12eaabbd-d105-40e7-ba68-6b10df8cc841 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:44.623297 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5ba97274-3eda-43fb-91d7-72c0b39b26a4 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:44.625631 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-12eaabbd-d105-40e7-ba68-6b10df8cc841 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:44.626396 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-5ba97274-3eda-43fb-91d7-72c0b39b26a4 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: 1854f7da-898a-4c09-8da9-a69fab19bb71] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:44.631459 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-12eaabbd-d105-40e7-ba68-6b10df8cc841 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:44.632279 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-12eaabbd-d105-40e7-ba68-6b10df8cc841 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:44.636296 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-12eaabbd-d105-40e7-ba68-6b10df8cc841 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:44.639285 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-12eaabbd-d105-40e7-ba68-6b10df8cc841 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:44.641643 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-12eaabbd-d105-40e7-ba68-6b10df8cc841 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:44.652351 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5ba97274-3eda-43fb-91d7-72c0b39b26a4 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:44.654703 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5ba97274-3eda-43fb-91d7-72c0b39b26a4 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:44.655735 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5ba97274-3eda-43fb-91d7-72c0b39b26a4 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:44.658215 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5ba97274-3eda-43fb-91d7-72c0b39b26a4 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:44.661602 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5ba97274-3eda-43fb-91d7-72c0b39b26a4 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:44.664196 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5ba97274-3eda-43fb-91d7-72c0b39b26a4 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:44.682764 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:54:44.768460 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-12eaabbd-d105-40e7-ba68-6b10df8cc841 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "POST /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd/action" status: 200 len: 172 microversion: 2.1 time: 0.190519 Aug 27 02:54:44.774257 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1455/2926] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 02:54:44 2022] POST /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd/action => generated 172 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:54:44.782602 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-d7f4d116-a70e-4a7c-aa40-f47088e9e506 req-547a9e53-b6be-4655-bd86-a49f21492f0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1854f7da-898a-4c09-8da9-a69fab19bb71", "name": "network-vif-plugged", "status": "completed", "tag": "10ed780f-6187-49a9-a5a1-880bcba4e477"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:54:44.829186 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-d7f4d116-a70e-4a7c-aa40-f47088e9e506 req-547a9e53-b6be-4655-bd86-a49f21492f0a service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:44.829981 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-d7f4d116-a70e-4a7c-aa40-f47088e9e506 req-547a9e53-b6be-4655-bd86-a49f21492f0a service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:44.837465 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-d7f4d116-a70e-4a7c-aa40-f47088e9e506 req-547a9e53-b6be-4655-bd86-a49f21492f0a service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:44.874556 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-d7f4d116-a70e-4a7c-aa40-f47088e9e506 req-547a9e53-b6be-4655-bd86-a49f21492f0a service nova] Creating event network-vif-plugged:10ed780f-6187-49a9-a5a1-880bcba4e477 for instance 1854f7da-898a-4c09-8da9-a69fab19bb71 on n-h1-852278-4 Aug 27 02:54:44.882645 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-d7f4d116-a70e-4a7c-aa40-f47088e9e506 req-547a9e53-b6be-4655-bd86-a49f21492f0a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105134 Aug 27 02:54:44.889475 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1456/2927] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:54:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:54:44.901517 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0bbc7abb-f35f-4049-bedc-c0b0be2cdd11 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:44.903687 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-0bbc7abb-f35f-4049-bedc-c0b0be2cdd11 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:44.921182 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=5,nova_api:UPDATE=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:54:44.930874 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0bbc7abb-f35f-4049-bedc-c0b0be2cdd11 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:44.939366 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0bbc7abb-f35f-4049-bedc-c0b0be2cdd11 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:44.940923 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0bbc7abb-f35f-4049-bedc-c0b0be2cdd11 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:44.943683 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0bbc7abb-f35f-4049-bedc-c0b0be2cdd11 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:44.954885 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0bbc7abb-f35f-4049-bedc-c0b0be2cdd11 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:44.955592 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0bbc7abb-f35f-4049-bedc-c0b0be2cdd11 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:45.394349 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-5ba97274-3eda-43fb-91d7-72c0b39b26a4 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:45.420385 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-5ba97274-3eda-43fb-91d7-72c0b39b26a4 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/1854f7da-898a-4c09-8da9-a69fab19bb71" status: 200 len: 1315 microversion: 2.1 time: 0.814588 Aug 27 02:54:45.421021 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1472/2928] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:44 2022] GET /compute/v2.1/servers/1854f7da-898a-4c09-8da9-a69fab19bb71 => generated 1315 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:45.439274 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6d741c08-5483-4f0f-b83b-e03e7fcb54ed tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:45.441705 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-6d741c08-5483-4f0f-b83b-e03e7fcb54ed tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] [instance: dc54b06e-43a5-4450-bf3c-d9949dcf04b1] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:45.457782 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6d741c08-5483-4f0f-b83b-e03e7fcb54ed tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:45.460986 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6d741c08-5483-4f0f-b83b-e03e7fcb54ed tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:45.462027 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6d741c08-5483-4f0f-b83b-e03e7fcb54ed tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:45.464321 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6d741c08-5483-4f0f-b83b-e03e7fcb54ed tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:45.466152 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6d741c08-5483-4f0f-b83b-e03e7fcb54ed tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:45.466822 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6d741c08-5483-4f0f-b83b-e03e7fcb54ed tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:45.492195 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-0bbc7abb-f35f-4049-bedc-c0b0be2cdd11 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:45.508974 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-0bbc7abb-f35f-4049-bedc-c0b0be2cdd11 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1668 microversion: 2.1 time: 0.617893 Aug 27 02:54:45.509963 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-6d741c08-5483-4f0f-b83b-e03e7fcb54ed tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] HTTP exception thrown: Instance dc54b06e-43a5-4450-bf3c-d9949dcf04b1 could not be found. Aug 27 02:54:45.511657 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6d741c08-5483-4f0f-b83b-e03e7fcb54ed tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Request method failure captured: Aug 27 02:54:45.511657 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/servers/dc54b06e-43a5-4450-bf3c-d9949dcf04b1 HTTP/1.1 Aug 27 02:54:45.511657 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:54:45.511657 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:54:45.511657 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:54:45.511657 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:54:45.511657 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:54:45.511657 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:54:45.511657 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:54:45.511657 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:54:45.511657 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYbA9qEsQ7AuJA4V6RYxG7OHaZuLgFpRbzGQ6AlDd_YkHRkXZJD6_hECDI_QZ1zOi4020OHNxwNI09wKKKMOB81DbDu8dfolUdwegk-e8EYDInik67VVD7m4lzYtUM_6g_lL5rtyhiFzrCoC2juCZjoSt7IgxvRTxYthQfx1D1w603w Aug 27 02:54:45.511657 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:54:45.511657 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:54:45.511657 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:54:45.511657 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:54:45.511657 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:54:45.511657 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:54:45.511657 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: c5a8810c21784788b4c0ee64dedbaf15 Aug 27 02:54:45.511657 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1732061864 Aug 27 02:54:45.511657 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:54:45.511657 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:54:45.511657 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c5a8810c21784788b4c0ee64dedbaf15"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c5a8810c21784788b4c0ee64dedbaf15", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c5a8810c21784788b4c0ee64dedbaf15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c5a8810c21784788b4c0ee64dedbaf15"}]}] Aug 27 02:54:45.511657 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ServerDiskConfigTestJSON-1732061864 Aug 27 02:54:45.511657 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: c5a8810c21784788b4c0ee64dedbaf15 Aug 27 02:54:45.511657 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1732061864 Aug 27 02:54:45.511657 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ServerDiskConfigTestJSON-1732061864-project Aug 27 02:54:45.511657 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:54:45.511657 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:54:45.511657 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: d317e74b4bbc4da298a0dcbd78068352 Aug 27 02:54:45.511657 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ServerDiskConfigTestJSON-1732061864-project Aug 27 02:54:45.511657 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 02:54:45.511657 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance dc54b06e-43a5-4450-bf3c-d9949dcf04b1 could not be found. Aug 27 02:54:45.511657 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': 'dc54b06e-43a5-4450-bf3c-d9949dcf04b1'} Aug 27 02:54:45.511657 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:54:45.511657 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:54:45.511657 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:54:45.511657 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:54:45.511657 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:54:45.511657 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:54:45.511657 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:54:45.511657 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:54:45.511657 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:54:45.511657 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:54:45.511657 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc54b06e-43a5-4450-bf3c-d9949dcf04b1 could not be found. Aug 27 02:54:45.511657 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:54:45.511657 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:54:45.511657 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:54:45.511657 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:54:45.511657 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:54:45.511657 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:54:45.511657 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:54:45.511657 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:54:45.511657 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:54:45.511657 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:54:45.511657 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:54:45.511657 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:54:45.511657 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:54:45.511657 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:54:45.511657 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:54:45.511657 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:54:45.511657 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc54b06e-43a5-4450-bf3c-d9949dcf04b1 could not be found. Aug 27 02:54:45.511657 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:54:45.511657 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:54:45.511657 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:54:45.517921 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:54:45.517921 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:54:45.517921 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:54:45.517921 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:54:45.517921 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:54:45.517921 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc54b06e-43a5-4450-bf3c-d9949dcf04b1 could not be found. Aug 27 02:54:45.517921 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:54:45.520203 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6d741c08-5483-4f0f-b83b-e03e7fcb54ed tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Returning 404 to user: Instance dc54b06e-43a5-4450-bf3c-d9949dcf04b1 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:54:45.523935 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-6d741c08-5483-4f0f-b83b-e03e7fcb54ed tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] 10.222.0.70 "GET /compute/v2.1/servers/dc54b06e-43a5-4450-bf3c-d9949dcf04b1" status: 404 len: 111 microversion: 2.1 time: 0.098565 Aug 27 02:54:45.524861 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1457/2930] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:44 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1668 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:45.525012 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1473/2930] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:45 2022] GET /compute/v2.1/servers/dc54b06e-43a5-4450-bf3c-d9949dcf04b1 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:54:45.545482 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8ebb3029-692d-4d3a-bcf4-b2b8bd45041c tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '.version_select at 0x7f5ee251eaf0>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:45.563072 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3386ab0d-d37f-43bb-acc7-0af636b994b0 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:45.563883 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-3386ab0d-d37f-43bb-acc7-0af636b994b0 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] [instance: b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:45.578776 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3386ab0d-d37f-43bb-acc7-0af636b994b0 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:45.579280 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3386ab0d-d37f-43bb-acc7-0af636b994b0 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:45.579715 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3386ab0d-d37f-43bb-acc7-0af636b994b0 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:45.580464 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3386ab0d-d37f-43bb-acc7-0af636b994b0 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:45.580916 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3386ab0d-d37f-43bb-acc7-0af636b994b0 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:45.581331 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3386ab0d-d37f-43bb-acc7-0af636b994b0 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:45.616069 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-8ebb3029-692d-4d3a-bcf4-b2b8bd45041c tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "GET /compute/v2.1/images/57627f6b-d2bf-4292-a3b4-db93ad1b2e3f" status: 200 len: 1437 microversion: 2.1 time: 0.089621 Aug 27 02:54:45.617372 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1474/2931] 10.222.0.70 () {58 vars in 1233 bytes} [Sat Aug 27 02:54:45 2022] GET /compute/v2.1/images/57627f6b-d2bf-4292-a3b4-db93ad1b2e3f => generated 1437 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:45.626293 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9a14c4a0-6f68-4738-90a2-cc3adbd516b7 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:45.632805 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-9a14c4a0-6f68-4738-90a2-cc3adbd516b7 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] [instance: 7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:45.644770 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:54:45.650587 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9a14c4a0-6f68-4738-90a2-cc3adbd516b7 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:45.652481 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9a14c4a0-6f68-4738-90a2-cc3adbd516b7 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:45.653312 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9a14c4a0-6f68-4738-90a2-cc3adbd516b7 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:45.654283 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9a14c4a0-6f68-4738-90a2-cc3adbd516b7 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:45.656865 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9a14c4a0-6f68-4738-90a2-cc3adbd516b7 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:45.657518 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9a14c4a0-6f68-4738-90a2-cc3adbd516b7 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:45.693537 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-9a14c4a0-6f68-4738-90a2-cc3adbd516b7 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] HTTP exception thrown: Instance 7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8 could not be found. Aug 27 02:54:45.697938 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9a14c4a0-6f68-4738-90a2-cc3adbd516b7 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Request method failure captured: Aug 27 02:54:45.697938 n-d-852278-4 devstack@n-api.service[134052]: request: DELETE /compute/v2.1/servers/7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8 HTTP/1.1 Aug 27 02:54:45.697938 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:54:45.697938 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:54:45.697938 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:54:45.697938 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:54:45.697938 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:54:45.697938 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:54:45.697938 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:54:45.697938 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:54:45.697938 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYbA9qEsQ7AuJA4V6RYxG7OHaZuLgFpRbzGQ6AlDd_YkHRkXZJD6_hECDI_QZ1zOi4020OHNxwNI09wKKKMOB81DbDu8dfolUdwegk-e8EYDInik67VVD7m4lzYtUM_6g_lL5rtyhiFzrCoC2juCZjoSt7IgxvRTxYthQfx1D1w603w Aug 27 02:54:45.697938 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:54:45.697938 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:54:45.697938 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:54:45.697938 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:54:45.697938 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:54:45.697938 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:54:45.697938 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: c5a8810c21784788b4c0ee64dedbaf15 Aug 27 02:54:45.697938 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1732061864 Aug 27 02:54:45.697938 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:54:45.697938 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:54:45.697938 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c5a8810c21784788b4c0ee64dedbaf15"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c5a8810c21784788b4c0ee64dedbaf15", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c5a8810c21784788b4c0ee64dedbaf15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c5a8810c21784788b4c0ee64dedbaf15"}]}] Aug 27 02:54:45.697938 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ServerDiskConfigTestJSON-1732061864 Aug 27 02:54:45.697938 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: c5a8810c21784788b4c0ee64dedbaf15 Aug 27 02:54:45.697938 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1732061864 Aug 27 02:54:45.697938 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ServerDiskConfigTestJSON-1732061864-project Aug 27 02:54:45.697938 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:54:45.697938 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:54:45.697938 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: d317e74b4bbc4da298a0dcbd78068352 Aug 27 02:54:45.697938 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ServerDiskConfigTestJSON-1732061864-project Aug 27 02:54:45.697938 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 02:54:45.697938 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance 7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8 could not be found. Aug 27 02:54:45.697938 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8'} Aug 27 02:54:45.697938 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:54:45.697938 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:54:45.697938 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:54:45.697938 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:54:45.697938 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:54:45.697938 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:54:45.697938 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:54:45.697938 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:54:45.697938 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:54:45.697938 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:54:45.697938 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8 could not be found. Aug 27 02:54:45.697938 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:54:45.697938 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:54:45.697938 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:54:45.697938 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:54:45.697938 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:54:45.697938 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:54:45.697938 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:54:45.697938 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:54:45.697938 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:54:45.697938 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:54:45.697938 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 02:54:45.697938 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 02:54:45.697938 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 02:54:45.697938 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 02:54:45.697938 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:54:45.697938 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:54:45.697938 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:54:45.697938 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:54:45.702298 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8 could not be found. Aug 27 02:54:45.702298 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:54:45.702298 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:54:45.702298 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:54:45.702298 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:54:45.702298 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:54:45.702298 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:54:45.702298 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:54:45.702298 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:54:45.702298 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8 could not be found. Aug 27 02:54:45.702298 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:54:45.708137 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9a14c4a0-6f68-4738-90a2-cc3adbd516b7 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Returning 404 to user: Instance 7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:54:45.709360 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9a14c4a0-6f68-4738-90a2-cc3adbd516b7 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] 10.222.0.70 "DELETE /compute/v2.1/servers/7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8" status: 404 len: 111 microversion: 2.1 time: 0.089825 Aug 27 02:54:45.712532 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1475/2932] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:54:45 2022] DELETE /compute/v2.1/servers/7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:54:45.723957 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0f5314b5-8d23-471f-a5d9-7729d7a7546a tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:45.724783 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-0f5314b5-8d23-471f-a5d9-7729d7a7546a tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:45.743550 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0f5314b5-8d23-471f-a5d9-7729d7a7546a tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:45.744335 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0f5314b5-8d23-471f-a5d9-7729d7a7546a tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:45.745065 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0f5314b5-8d23-471f-a5d9-7729d7a7546a tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:45.746087 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0f5314b5-8d23-471f-a5d9-7729d7a7546a tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:45.750193 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0f5314b5-8d23-471f-a5d9-7729d7a7546a tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:45.751040 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0f5314b5-8d23-471f-a5d9-7729d7a7546a tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:45.993834 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-3386ab0d-d37f-43bb-acc7-0af636b994b0 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:46.025647 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-3386ab0d-d37f-43bb-acc7-0af636b994b0 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:46.027586 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-3386ab0d-d37f-43bb-acc7-0af636b994b0 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:46.031028 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-3386ab0d-d37f-43bb-acc7-0af636b994b0 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] 10.222.0.70 "GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7" status: 200 len: 1661 microversion: 2.32 time: 0.503516 Aug 27 02:54:46.032352 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1458/2933] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:54:45 2022] GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 => generated 1661 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:54:46.107636 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7e033c12-cf44-4389-83c3-c49675af455b tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:46.107636 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-7e033c12-cf44-4389-83c3-c49675af455b tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] [instance: 7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:46.126057 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7e033c12-cf44-4389-83c3-c49675af455b tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:46.127043 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7e033c12-cf44-4389-83c3-c49675af455b tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:46.128329 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7e033c12-cf44-4389-83c3-c49675af455b tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:46.131109 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7e033c12-cf44-4389-83c3-c49675af455b tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:46.132708 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7e033c12-cf44-4389-83c3-c49675af455b tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:46.134211 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7e033c12-cf44-4389-83c3-c49675af455b tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:46.155349 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-7e033c12-cf44-4389-83c3-c49675af455b tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] HTTP exception thrown: Instance 7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8 could not be found. Aug 27 02:54:46.157414 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7e033c12-cf44-4389-83c3-c49675af455b tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Request method failure captured: Aug 27 02:54:46.157414 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8 HTTP/1.1 Aug 27 02:54:46.157414 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:54:46.157414 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:54:46.157414 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:54:46.157414 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:54:46.157414 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:54:46.157414 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:54:46.157414 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:54:46.157414 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:54:46.157414 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYbA9qEsQ7AuJA4V6RYxG7OHaZuLgFpRbzGQ6AlDd_YkHRkXZJD6_hECDI_QZ1zOi4020OHNxwNI09wKKKMOB81DbDu8dfolUdwegk-e8EYDInik67VVD7m4lzYtUM_6g_lL5rtyhiFzrCoC2juCZjoSt7IgxvRTxYthQfx1D1w603w Aug 27 02:54:46.157414 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:54:46.157414 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:54:46.157414 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:54:46.157414 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:54:46.157414 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:54:46.157414 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:54:46.157414 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: c5a8810c21784788b4c0ee64dedbaf15 Aug 27 02:54:46.157414 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1732061864 Aug 27 02:54:46.157414 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:54:46.157414 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:54:46.157414 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c5a8810c21784788b4c0ee64dedbaf15"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c5a8810c21784788b4c0ee64dedbaf15", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c5a8810c21784788b4c0ee64dedbaf15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c5a8810c21784788b4c0ee64dedbaf15"}]}] Aug 27 02:54:46.157414 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ServerDiskConfigTestJSON-1732061864 Aug 27 02:54:46.157414 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: c5a8810c21784788b4c0ee64dedbaf15 Aug 27 02:54:46.157414 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1732061864 Aug 27 02:54:46.157414 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ServerDiskConfigTestJSON-1732061864-project Aug 27 02:54:46.157414 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:54:46.157414 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:54:46.157414 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: d317e74b4bbc4da298a0dcbd78068352 Aug 27 02:54:46.157414 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ServerDiskConfigTestJSON-1732061864-project Aug 27 02:54:46.157414 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 02:54:46.157414 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance 7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8 could not be found. Aug 27 02:54:46.157414 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8'} Aug 27 02:54:46.157414 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:54:46.157414 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:54:46.157414 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:54:46.157414 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:54:46.157414 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:54:46.157414 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:54:46.157414 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:54:46.157414 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:54:46.157414 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:54:46.157414 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:54:46.157414 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8 could not be found. Aug 27 02:54:46.157414 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:54:46.157414 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:54:46.157414 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:54:46.157414 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:54:46.157414 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:54:46.157414 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:54:46.157414 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:54:46.157414 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:54:46.157414 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:54:46.157414 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:54:46.157414 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:54:46.157414 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:54:46.157414 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:54:46.157414 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:54:46.157414 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:54:46.157414 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:54:46.157414 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8 could not be found. Aug 27 02:54:46.157414 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:54:46.157414 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:54:46.157414 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:54:46.161603 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:54:46.161603 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:54:46.161603 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:54:46.161603 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:54:46.161603 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:54:46.161603 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8 could not be found. Aug 27 02:54:46.161603 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:54:46.163145 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7e033c12-cf44-4389-83c3-c49675af455b tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Returning 404 to user: Instance 7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:54:46.164793 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-7e033c12-cf44-4389-83c3-c49675af455b tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] 10.222.0.70 "GET /compute/v2.1/servers/7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8" status: 404 len: 111 microversion: 2.1 time: 0.130136 Aug 27 02:54:46.165889 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1459/2934] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:46 2022] GET /compute/v2.1/servers/7160c9e1-2dec-402c-ad4d-2c0fa4c5b5d8 => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:54:46.175149 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4be2e47f-6ec0-45a5-a676-06ee19ae9646 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:46.176121 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-4be2e47f-6ec0-45a5-a676-06ee19ae9646 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] [instance: 6ef152e6-ba27-46bd-871a-04d8539b493e] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:46.193025 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4be2e47f-6ec0-45a5-a676-06ee19ae9646 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:46.232022 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4be2e47f-6ec0-45a5-a676-06ee19ae9646 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:46.232478 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4be2e47f-6ec0-45a5-a676-06ee19ae9646 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.039s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:46.239928 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4be2e47f-6ec0-45a5-a676-06ee19ae9646 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:46.240541 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4be2e47f-6ec0-45a5-a676-06ee19ae9646 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:46.240993 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4be2e47f-6ec0-45a5-a676-06ee19ae9646 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:46.296583 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-4be2e47f-6ec0-45a5-a676-06ee19ae9646 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] HTTP exception thrown: Instance 6ef152e6-ba27-46bd-871a-04d8539b493e could not be found. Aug 27 02:54:46.303948 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4be2e47f-6ec0-45a5-a676-06ee19ae9646 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Request method failure captured: Aug 27 02:54:46.303948 n-d-852278-4 devstack@n-api.service[134051]: request: DELETE /compute/v2.1/servers/6ef152e6-ba27-46bd-871a-04d8539b493e HTTP/1.1 Aug 27 02:54:46.303948 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:54:46.303948 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:54:46.303948 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:54:46.303948 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:54:46.303948 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:54:46.303948 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:54:46.303948 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:54:46.303948 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:54:46.303948 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYbA9qEsQ7AuJA4V6RYxG7OHaZuLgFpRbzGQ6AlDd_YkHRkXZJD6_hECDI_QZ1zOi4020OHNxwNI09wKKKMOB81DbDu8dfolUdwegk-e8EYDInik67VVD7m4lzYtUM_6g_lL5rtyhiFzrCoC2juCZjoSt7IgxvRTxYthQfx1D1w603w Aug 27 02:54:46.303948 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:54:46.303948 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:54:46.303948 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:54:46.303948 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:54:46.303948 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:54:46.303948 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:54:46.303948 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: c5a8810c21784788b4c0ee64dedbaf15 Aug 27 02:54:46.303948 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1732061864 Aug 27 02:54:46.303948 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:54:46.303948 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:54:46.303948 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c5a8810c21784788b4c0ee64dedbaf15"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c5a8810c21784788b4c0ee64dedbaf15", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c5a8810c21784788b4c0ee64dedbaf15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c5a8810c21784788b4c0ee64dedbaf15"}]}] Aug 27 02:54:46.303948 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ServerDiskConfigTestJSON-1732061864 Aug 27 02:54:46.303948 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: c5a8810c21784788b4c0ee64dedbaf15 Aug 27 02:54:46.303948 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1732061864 Aug 27 02:54:46.303948 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ServerDiskConfigTestJSON-1732061864-project Aug 27 02:54:46.303948 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:54:46.303948 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:54:46.303948 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: d317e74b4bbc4da298a0dcbd78068352 Aug 27 02:54:46.303948 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ServerDiskConfigTestJSON-1732061864-project Aug 27 02:54:46.303948 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 02:54:46.303948 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance 6ef152e6-ba27-46bd-871a-04d8539b493e could not be found. Aug 27 02:54:46.303948 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '6ef152e6-ba27-46bd-871a-04d8539b493e'} Aug 27 02:54:46.303948 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:54:46.303948 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:54:46.303948 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:54:46.303948 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:54:46.303948 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:54:46.303948 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:54:46.303948 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:54:46.303948 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:54:46.303948 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:54:46.303948 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:54:46.303948 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ef152e6-ba27-46bd-871a-04d8539b493e could not be found. Aug 27 02:54:46.303948 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:54:46.303948 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:54:46.303948 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:54:46.303948 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:54:46.303948 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:54:46.303948 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:54:46.303948 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:54:46.303948 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:54:46.303948 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:54:46.303948 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:54:46.303948 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 02:54:46.303948 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 02:54:46.303948 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 02:54:46.303948 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 02:54:46.303948 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:54:46.303948 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:54:46.303948 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:54:46.303948 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:54:46.308556 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ef152e6-ba27-46bd-871a-04d8539b493e could not be found. Aug 27 02:54:46.308556 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:54:46.308556 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:54:46.308556 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:54:46.308556 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:54:46.308556 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:54:46.308556 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:54:46.308556 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:54:46.308556 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:54:46.308556 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ef152e6-ba27-46bd-871a-04d8539b493e could not be found. Aug 27 02:54:46.308556 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:54:46.313351 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4be2e47f-6ec0-45a5-a676-06ee19ae9646 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Returning 404 to user: Instance 6ef152e6-ba27-46bd-871a-04d8539b493e could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:54:46.318996 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-4be2e47f-6ec0-45a5-a676-06ee19ae9646 tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] 10.222.0.70 "DELETE /compute/v2.1/servers/6ef152e6-ba27-46bd-871a-04d8539b493e" status: 404 len: 111 microversion: 2.1 time: 0.148907 Aug 27 02:54:46.320620 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1460/2935] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:54:46 2022] DELETE /compute/v2.1/servers/6ef152e6-ba27-46bd-871a-04d8539b493e => generated 111 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:54:46.347494 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d5864a21-7d42-4bea-b806-df626d1397fb tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:46.351381 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d5864a21-7d42-4bea-b806-df626d1397fb tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] [instance: 6ef152e6-ba27-46bd-871a-04d8539b493e] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:46.377505 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d5864a21-7d42-4bea-b806-df626d1397fb tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:46.381029 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d5864a21-7d42-4bea-b806-df626d1397fb tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:46.384913 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d5864a21-7d42-4bea-b806-df626d1397fb tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:46.388917 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d5864a21-7d42-4bea-b806-df626d1397fb tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:46.390782 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d5864a21-7d42-4bea-b806-df626d1397fb tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:46.392663 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d5864a21-7d42-4bea-b806-df626d1397fb tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:46.433878 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-d5864a21-7d42-4bea-b806-df626d1397fb tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] HTTP exception thrown: Instance 6ef152e6-ba27-46bd-871a-04d8539b493e could not be found. Aug 27 02:54:46.436963 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d5864a21-7d42-4bea-b806-df626d1397fb tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Request method failure captured: Aug 27 02:54:46.436963 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/6ef152e6-ba27-46bd-871a-04d8539b493e HTTP/1.1 Aug 27 02:54:46.436963 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:54:46.436963 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:54:46.436963 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:54:46.436963 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:54:46.436963 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:54:46.436963 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:54:46.436963 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:54:46.436963 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:54:46.436963 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYbA9qEsQ7AuJA4V6RYxG7OHaZuLgFpRbzGQ6AlDd_YkHRkXZJD6_hECDI_QZ1zOi4020OHNxwNI09wKKKMOB81DbDu8dfolUdwegk-e8EYDInik67VVD7m4lzYtUM_6g_lL5rtyhiFzrCoC2juCZjoSt7IgxvRTxYthQfx1D1w603w Aug 27 02:54:46.436963 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:54:46.436963 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:54:46.436963 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:54:46.436963 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:54:46.436963 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:54:46.436963 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:54:46.436963 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: c5a8810c21784788b4c0ee64dedbaf15 Aug 27 02:54:46.436963 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1732061864 Aug 27 02:54:46.436963 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:54:46.436963 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:54:46.436963 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c5a8810c21784788b4c0ee64dedbaf15"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c5a8810c21784788b4c0ee64dedbaf15", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c5a8810c21784788b4c0ee64dedbaf15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c5a8810c21784788b4c0ee64dedbaf15"}]}] Aug 27 02:54:46.436963 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ServerDiskConfigTestJSON-1732061864 Aug 27 02:54:46.436963 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: c5a8810c21784788b4c0ee64dedbaf15 Aug 27 02:54:46.436963 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1732061864 Aug 27 02:54:46.436963 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ServerDiskConfigTestJSON-1732061864-project Aug 27 02:54:46.436963 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:54:46.436963 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:54:46.436963 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: d317e74b4bbc4da298a0dcbd78068352 Aug 27 02:54:46.436963 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ServerDiskConfigTestJSON-1732061864-project Aug 27 02:54:46.436963 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 02:54:46.436963 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance 6ef152e6-ba27-46bd-871a-04d8539b493e could not be found. Aug 27 02:54:46.436963 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '6ef152e6-ba27-46bd-871a-04d8539b493e'} Aug 27 02:54:46.436963 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:54:46.436963 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:54:46.436963 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:54:46.436963 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:54:46.436963 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:54:46.436963 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:54:46.436963 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:54:46.436963 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:54:46.436963 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:54:46.436963 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:54:46.436963 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ef152e6-ba27-46bd-871a-04d8539b493e could not be found. Aug 27 02:54:46.436963 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:54:46.436963 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:54:46.436963 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:54:46.436963 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:54:46.436963 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:54:46.436963 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:54:46.436963 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:54:46.436963 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:54:46.436963 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:54:46.436963 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:54:46.436963 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:54:46.436963 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:54:46.436963 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:54:46.436963 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:54:46.436963 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:54:46.436963 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:54:46.436963 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ef152e6-ba27-46bd-871a-04d8539b493e could not be found. Aug 27 02:54:46.436963 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:54:46.436963 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:54:46.436963 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:54:46.441038 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:54:46.441038 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:54:46.441038 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:54:46.441038 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:54:46.441038 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:54:46.441038 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ef152e6-ba27-46bd-871a-04d8539b493e could not be found. Aug 27 02:54:46.441038 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:54:46.444293 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d5864a21-7d42-4bea-b806-df626d1397fb tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] Returning 404 to user: Instance 6ef152e6-ba27-46bd-871a-04d8539b493e could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:54:46.445589 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d5864a21-7d42-4bea-b806-df626d1397fb tempest-ServerDiskConfigTestJSON-1732061864 tempest-ServerDiskConfigTestJSON-1732061864-project] 10.222.0.70 "GET /compute/v2.1/servers/6ef152e6-ba27-46bd-871a-04d8539b493e" status: 404 len: 111 microversion: 2.1 time: 0.120401 Aug 27 02:54:46.446916 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1461/2936] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:46 2022] GET /compute/v2.1/servers/6ef152e6-ba27-46bd-871a-04d8539b493e => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:54:46.452182 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b50bd746-6ac2-4d5f-b70f-7a39e48ebea7 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:46.453167 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b50bd746-6ac2-4d5f-b70f-7a39e48ebea7 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: 1854f7da-898a-4c09-8da9-a69fab19bb71] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:46.461124 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b50bd746-6ac2-4d5f-b70f-7a39e48ebea7 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:46.461994 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b50bd746-6ac2-4d5f-b70f-7a39e48ebea7 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:46.462733 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b50bd746-6ac2-4d5f-b70f-7a39e48ebea7 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:46.463676 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b50bd746-6ac2-4d5f-b70f-7a39e48ebea7 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:46.464386 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b50bd746-6ac2-4d5f-b70f-7a39e48ebea7 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:46.465078 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b50bd746-6ac2-4d5f-b70f-7a39e48ebea7 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:46.470888 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=100 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:54:46.811948 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-b50bd746-6ac2-4d5f-b70f-7a39e48ebea7 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:46.821980 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b50bd746-6ac2-4d5f-b70f-7a39e48ebea7 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/1854f7da-898a-4c09-8da9-a69fab19bb71" status: 200 len: 1315 microversion: 2.1 time: 0.373776 Aug 27 02:54:46.826914 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1462/2937] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:46 2022] GET /compute/v2.1/servers/1854f7da-898a-4c09-8da9-a69fab19bb71 => generated 1315 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:46.831733 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e33aad4d-7424-4d61-9019-28e6f21c1bfe tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '.version_select at 0x7f5ede277e50>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:46.920737 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e33aad4d-7424-4d61-9019-28e6f21c1bfe tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "GET /compute/v2.1/images/57627f6b-d2bf-4292-a3b4-db93ad1b2e3f" status: 200 len: 1437 microversion: 2.1 time: 0.092561 Aug 27 02:54:46.921684 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1463/2938] 10.222.0.70 () {58 vars in 1233 bytes} [Sat Aug 27 02:54:46 2022] GET /compute/v2.1/images/57627f6b-d2bf-4292-a3b4-db93ad1b2e3f => generated 1437 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:46.934475 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0f5314b5-8d23-471f-a5d9-7729d7a7546a tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:46.948686 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-0f5314b5-8d23-471f-a5d9-7729d7a7546a tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1668 microversion: 2.1 time: 1.232078 Aug 27 02:54:46.953150 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1476/2939] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:45 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1668 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:46.973059 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-06ecd723-1900-4c17-a059-154a5ef9f317 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:46.974056 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-06ecd723-1900-4c17-a059-154a5ef9f317 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:46.984064 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-06ecd723-1900-4c17-a059-154a5ef9f317 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:46.985227 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-06ecd723-1900-4c17-a059-154a5ef9f317 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:46.985935 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-06ecd723-1900-4c17-a059-154a5ef9f317 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:46.986909 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-06ecd723-1900-4c17-a059-154a5ef9f317 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:46.987624 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-06ecd723-1900-4c17-a059-154a5ef9f317 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:46.988343 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-06ecd723-1900-4c17-a059-154a5ef9f317 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:47.123066 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b4c49cfc-7498-4e3c-892a-2dfe95d08632 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:47.123927 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b4c49cfc-7498-4e3c-892a-2dfe95d08632 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] [instance: b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:47.148041 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b4c49cfc-7498-4e3c-892a-2dfe95d08632 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:47.148569 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b4c49cfc-7498-4e3c-892a-2dfe95d08632 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:47.149361 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b4c49cfc-7498-4e3c-892a-2dfe95d08632 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:47.149696 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b4c49cfc-7498-4e3c-892a-2dfe95d08632 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:47.155328 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b4c49cfc-7498-4e3c-892a-2dfe95d08632 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:47.156002 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b4c49cfc-7498-4e3c-892a-2dfe95d08632 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:47.278820 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-06ecd723-1900-4c17-a059-154a5ef9f317 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:47.291408 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-06ecd723-1900-4c17-a059-154a5ef9f317 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1668 microversion: 2.1 time: 0.322837 Aug 27 02:54:47.304347 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1464/2940] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:46 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1668 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:47.319746 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c610f24a-a891-4f40-83c8-708056670d3f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:47.320397 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-c610f24a-a891-4f40-83c8-708056670d3f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:47.333197 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c610f24a-a891-4f40-83c8-708056670d3f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:47.333709 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c610f24a-a891-4f40-83c8-708056670d3f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:47.334255 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c610f24a-a891-4f40-83c8-708056670d3f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:47.334999 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c610f24a-a891-4f40-83c8-708056670d3f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:47.335458 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c610f24a-a891-4f40-83c8-708056670d3f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:47.335889 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c610f24a-a891-4f40-83c8-708056670d3f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:47.698595 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b4c49cfc-7498-4e3c-892a-2dfe95d08632 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:47.724660 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b4c49cfc-7498-4e3c-892a-2dfe95d08632 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:47.729538 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b4c49cfc-7498-4e3c-892a-2dfe95d08632 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:47.731311 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b4c49cfc-7498-4e3c-892a-2dfe95d08632 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] 10.222.0.70 "GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7" status: 200 len: 1708 microversion: 2.32 time: 0.613663 Aug 27 02:54:47.732460 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1477/2941] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:54:47 2022] GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 => generated 1708 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:54:47.785536 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-c610f24a-a891-4f40-83c8-708056670d3f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:47.806182 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c610f24a-a891-4f40-83c8-708056670d3f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1668 microversion: 2.1 time: 0.489652 Aug 27 02:54:47.813274 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1465/2942] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:47 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1668 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:54:47.843692 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-df3e200c-d6dc-4610-8410-f1495530b485 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:47.845093 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-df3e200c-d6dc-4610-8410-f1495530b485 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: 1854f7da-898a-4c09-8da9-a69fab19bb71] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:47.864218 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-df3e200c-d6dc-4610-8410-f1495530b485 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:47.866539 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-df3e200c-d6dc-4610-8410-f1495530b485 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:47.868799 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-df3e200c-d6dc-4610-8410-f1495530b485 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:47.871235 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-df3e200c-d6dc-4610-8410-f1495530b485 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:47.873026 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-df3e200c-d6dc-4610-8410-f1495530b485 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:47.876195 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-df3e200c-d6dc-4610-8410-f1495530b485 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:47.937016 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-508d8a03-dec5-4c82-aa0a-d2a6844b7dd7 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '.version_select at 0x7f5ede1c38b0>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:48.039292 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-508d8a03-dec5-4c82-aa0a-d2a6844b7dd7 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "GET /compute/v2.1/images/57627f6b-d2bf-4292-a3b4-db93ad1b2e3f" status: 200 len: 1446 microversion: 2.1 time: 0.106627 Aug 27 02:54:48.039982 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1466/2943] 10.222.0.70 () {58 vars in 1233 bytes} [Sat Aug 27 02:54:47 2022] GET /compute/v2.1/images/57627f6b-d2bf-4292-a3b4-db93ad1b2e3f => generated 1446 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:54:48.061778 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f39768e6-f125-455e-a336-fbd8ba91959a tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '.version_select at 0x7f5ede277280>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:48.149155 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-f39768e6-f125-455e-a336-fbd8ba91959a tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "GET /compute/v2.1/images/57627f6b-d2bf-4292-a3b4-db93ad1b2e3f" status: 200 len: 1446 microversion: 2.1 time: 0.099283 Aug 27 02:54:48.150052 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1467/2944] 10.222.0.70 () {58 vars in 1233 bytes} [Sat Aug 27 02:54:48 2022] GET /compute/v2.1/images/57627f6b-d2bf-4292-a3b4-db93ad1b2e3f => generated 1446 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:54:48.189293 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b2a95614-e95e-4fac-bec0-1be7c30459f7 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '.version_select at 0x7f5ede2774c0>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:48.781630 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-df3e200c-d6dc-4610-8410-f1495530b485 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:48.792197 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-df3e200c-d6dc-4610-8410-f1495530b485 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/1854f7da-898a-4c09-8da9-a69fab19bb71" status: 200 len: 1502 microversion: 2.1 time: 0.952770 Aug 27 02:54:48.792824 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1478/2945] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:47 2022] GET /compute/v2.1/servers/1854f7da-898a-4c09-8da9-a69fab19bb71 => generated 1502 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:54:48.809071 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-11afe77a-6e2c-431d-ab91-b1f1a0f56dae tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-700033039", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "networks": [{"uuid": "7532a923-41df-4761-8077-055e309eff44"}]}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:54:48.959484 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.network.neutron [None req-11afe77a-6e2c-431d-ab91-b1f1a0f56dae tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] validate_networks() for [('7532a923-41df-4761-8077-055e309eff44', None, None, None, None, None)] {{(pid=134052) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:54:49.708735 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b2a95614-e95e-4fac-bec0-1be7c30459f7 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "DELETE /compute/v2.1/images/57627f6b-d2bf-4292-a3b4-db93ad1b2e3f" status: 204 len: 0 microversion: 2.1 time: 1.547340 Aug 27 02:54:49.711944 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1468/2946] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:48 2022] DELETE /compute/v2.1/images/57627f6b-d2bf-4292-a3b4-db93ad1b2e3f => generated 0 bytes in 1553 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:54:49.727068 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8d458132-f7e8-4077-8eef-caaac450129f tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:49.731287 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-8d458132-f7e8-4077-8eef-caaac450129f tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] [instance: b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:49.742087 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8d458132-f7e8-4077-8eef-caaac450129f tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:49.743138 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8d458132-f7e8-4077-8eef-caaac450129f tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:49.744626 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8d458132-f7e8-4077-8eef-caaac450129f tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:49.748202 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8d458132-f7e8-4077-8eef-caaac450129f tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:49.749662 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8d458132-f7e8-4077-8eef-caaac450129f tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:49.751778 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8d458132-f7e8-4077-8eef-caaac450129f tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:50.688443 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-8d458132-f7e8-4077-8eef-caaac450129f tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:50.706186 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-8d458132-f7e8-4077-8eef-caaac450129f tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:50.708169 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-8d458132-f7e8-4077-8eef-caaac450129f tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:50.709395 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-8d458132-f7e8-4077-8eef-caaac450129f tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] 10.222.0.70 "GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7" status: 200 len: 1755 microversion: 2.32 time: 0.995746 Aug 27 02:54:50.712886 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1469/2947] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:54:49 2022] GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 => generated 1755 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:54:50.720470 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-aca5edd1-b88c-4183-aea8-05cd9dc21ae8 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:54:50.748184 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-aca5edd1-b88c-4183-aea8-05cd9dc21ae8 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:50.749462 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-aca5edd1-b88c-4183-aea8-05cd9dc21ae8 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:50.752136 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-aca5edd1-b88c-4183-aea8-05cd9dc21ae8 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:50.809210 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-aca5edd1-b88c-4183-aea8-05cd9dc21ae8 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: 1854f7da-898a-4c09-8da9-a69fab19bb71] Going to try to stop instance {{(pid=134051) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 27 02:54:50.916061 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-aca5edd1-b88c-4183-aea8-05cd9dc21ae8 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "POST /compute/v2.1/servers/1854f7da-898a-4c09-8da9-a69fab19bb71/action" status: 202 len: 0 microversion: 2.1 time: 0.201650 Aug 27 02:54:50.920455 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1470/2948] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 02:54:50 2022] POST /compute/v2.1/servers/1854f7da-898a-4c09-8da9-a69fab19bb71/action => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:54:50.942403 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-1af6d193-5149-469a-9133-3f9073780337 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:50.944622 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-1af6d193-5149-469a-9133-3f9073780337 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] [instance: cb02560c-ca90-41f2-8e4a-1fe0f0494068] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:50.958927 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1af6d193-5149-469a-9133-3f9073780337 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:50.960444 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1af6d193-5149-469a-9133-3f9073780337 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:50.961351 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1af6d193-5149-469a-9133-3f9073780337 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:50.963295 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1af6d193-5149-469a-9133-3f9073780337 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:50.963960 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1af6d193-5149-469a-9133-3f9073780337 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:50.964818 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1af6d193-5149-469a-9133-3f9073780337 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:51.005665 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-1af6d193-5149-469a-9133-3f9073780337 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] [instance: cb02560c-ca90-41f2-8e4a-1fe0f0494068] Going to try to terminate instance {{(pid=134051) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:54:51.144484 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-1af6d193-5149-469a-9133-3f9073780337 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "DELETE /compute/v2.1/servers/cb02560c-ca90-41f2-8e4a-1fe0f0494068" status: 204 len: 0 microversion: 2.1 time: 0.224485 Aug 27 02:54:51.145289 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1471/2949] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:54:50 2022] DELETE /compute/v2.1/servers/cb02560c-ca90-41f2-8e4a-1fe0f0494068 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:54:51.159995 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-11afe77a-6e2c-431d-ab91-b1f1a0f56dae tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Flavor limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:54:51.160755 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-11afe77a-6e2c-431d-ab91-b1f1a0f56dae tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Image limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:54:51.161230 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-11afe77a-6e2c-431d-ab91-b1f1a0f56dae tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Flavor pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:54:51.161640 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-11afe77a-6e2c-431d-ab91-b1f1a0f56dae tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Image pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:54:51.162051 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-11afe77a-6e2c-431d-ab91-b1f1a0f56dae tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:54:51.177432 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-11afe77a-6e2c-431d-ab91-b1f1a0f56dae tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:51.178291 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-11afe77a-6e2c-431d-ab91-b1f1a0f56dae tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:51.178927 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-11afe77a-6e2c-431d-ab91-b1f1a0f56dae tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:51.189497 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-11afe77a-6e2c-431d-ab91-b1f1a0f56dae tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:51.190247 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-11afe77a-6e2c-431d-ab91-b1f1a0f56dae tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:51.190843 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-11afe77a-6e2c-431d-ab91-b1f1a0f56dae tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:51.227425 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-11afe77a-6e2c-431d-ab91-b1f1a0f56dae tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Getting quotas for project 952767db5f394fc4bf01c0efd65f2fb9. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:54:51.233742 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-11afe77a-6e2c-431d-ab91-b1f1a0f56dae tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Getting quotas for user c850bda78e664117b671910c0e68bfb9 and project 952767db5f394fc4bf01c0efd65f2fb9. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:54:51.272244 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-11afe77a-6e2c-431d-ab91-b1f1a0f56dae tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Going to run 1 instances... {{(pid=134052) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:54:51.280586 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-11afe77a-6e2c-431d-ab91-b1f1a0f56dae tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 2d6bf535-89e0-4c21-b2cf-fafcf18c4f18] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134052) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:54:51.401041 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-11afe77a-6e2c-431d-ab91-b1f1a0f56dae tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.604345 Aug 27 02:54:51.401645 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1479/2950] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 02:54:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 2608 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:54:51.413158 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f6a55109-b086-4b6d-bee6-f1adfd626ef8 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:51.414078 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-f6a55109-b086-4b6d-bee6-f1adfd626ef8 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: 1854f7da-898a-4c09-8da9-a69fab19bb71] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:51.428354 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f6a55109-b086-4b6d-bee6-f1adfd626ef8 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:51.429052 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f6a55109-b086-4b6d-bee6-f1adfd626ef8 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:51.429666 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f6a55109-b086-4b6d-bee6-f1adfd626ef8 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:51.430549 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f6a55109-b086-4b6d-bee6-f1adfd626ef8 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:51.431166 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f6a55109-b086-4b6d-bee6-f1adfd626ef8 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:51.431747 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f6a55109-b086-4b6d-bee6-f1adfd626ef8 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:51.466704 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8cbabc31-5032-4806-9808-d22276396fd3 tempest-SecurityGroupsTestAdminJSON-305479160 tempest-SecurityGroupsTestAdminJSON-305479160-project] Action: 'create', calling method: .version_select at 0x7f5ede27d820>, body: {"security_group": {"name": "tempest-securitygroup-2133342683", "description": "tempest-description-1472086331"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:54:51.648366 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-f6a55109-b086-4b6d-bee6-f1adfd626ef8 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:51.663983 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f6a55109-b086-4b6d-bee6-f1adfd626ef8 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/1854f7da-898a-4c09-8da9-a69fab19bb71" status: 200 len: 1512 microversion: 2.1 time: 0.260016 Aug 27 02:54:51.664775 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1480/2951] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:51 2022] GET /compute/v2.1/servers/1854f7da-898a-4c09-8da9-a69fab19bb71 => generated 1512 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:51.670837 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e1f5c015-3d27-4b7b-9a90-eaa5c92952b2 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1272544548", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "networks": [{"uuid": "677b7ba1-2913-4272-8be4-7a8908d3b556"}]}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:54:51.771305 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.network.neutron [None req-e1f5c015-3d27-4b7b-9a90-eaa5c92952b2 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] validate_networks() for [('677b7ba1-2913-4272-8be4-7a8908d3b556', None, None, None, None, None)] {{(pid=134052) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:54:52.374289 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-8cbabc31-5032-4806-9808-d22276396fd3 tempest-SecurityGroupsTestAdminJSON-305479160 tempest-SecurityGroupsTestAdminJSON-305479160-project] 10.222.0.70 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 1.227464 Aug 27 02:54:52.374958 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1472/2952] 10.222.0.70 () {60 vars in 1180 bytes} [Sat Aug 27 02:54:51 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:54:52.380246 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-093c3621-41ab-4457-9ccb-892511580eb1 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:52.381341 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-093c3621-41ab-4457-9ccb-892511580eb1 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 2d6bf535-89e0-4c21-b2cf-fafcf18c4f18] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:52.406838 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-093c3621-41ab-4457-9ccb-892511580eb1 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:52.407653 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-093c3621-41ab-4457-9ccb-892511580eb1 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:52.408267 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-093c3621-41ab-4457-9ccb-892511580eb1 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:52.409271 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-093c3621-41ab-4457-9ccb-892511580eb1 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:52.412098 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-093c3621-41ab-4457-9ccb-892511580eb1 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:52.412996 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-093c3621-41ab-4457-9ccb-892511580eb1 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:52.661346 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-093c3621-41ab-4457-9ccb-892511580eb1 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:52.676980 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-093c3621-41ab-4457-9ccb-892511580eb1 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/2d6bf535-89e0-4c21-b2cf-fafcf18c4f18" status: 200 len: 1218 microversion: 2.1 time: 0.293976 Aug 27 02:54:52.679359 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1473/2953] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:52 2022] GET /compute/v2.1/servers/2d6bf535-89e0-4c21-b2cf-fafcf18c4f18 => generated 1218 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:52.689222 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ff85963f-03c9-47a0-8933-795960358839 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:52.690157 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-ff85963f-03c9-47a0-8933-795960358839 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] [instance: b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:52.698248 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ff85963f-03c9-47a0-8933-795960358839 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:52.699079 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ff85963f-03c9-47a0-8933-795960358839 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:52.700767 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ff85963f-03c9-47a0-8933-795960358839 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:52.701860 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ff85963f-03c9-47a0-8933-795960358839 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:52.702525 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ff85963f-03c9-47a0-8933-795960358839 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:52.703274 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ff85963f-03c9-47a0-8933-795960358839 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:53.279351 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-ff85963f-03c9-47a0-8933-795960358839 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:53.290060 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-ff85963f-03c9-47a0-8933-795960358839 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:53.307054 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-ff85963f-03c9-47a0-8933-795960358839 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:53.308702 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ff85963f-03c9-47a0-8933-795960358839 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] 10.222.0.70 "GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7" status: 200 len: 1802 microversion: 2.32 time: 0.623416 Aug 27 02:54:53.310191 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1474/2954] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:54:52 2022] GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 => generated 1802 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:54:53.338190 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-e1f5c015-3d27-4b7b-9a90-eaa5c92952b2 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Flavor limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:54:53.339699 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-e1f5c015-3d27-4b7b-9a90-eaa5c92952b2 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Image limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:54:53.340565 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-e1f5c015-3d27-4b7b-9a90-eaa5c92952b2 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Flavor pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:54:53.341179 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-e1f5c015-3d27-4b7b-9a90-eaa5c92952b2 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Image pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:54:53.341790 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-e1f5c015-3d27-4b7b-9a90-eaa5c92952b2 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:54:53.369696 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=51 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:54:53.374683 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-2c78c942-d16f-489c-9303-650ff1f9d942 req-1a62af25-16a9-4865-b774-0ad63b632025 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb02560c-ca90-41f2-8e4a-1fe0f0494068", "name": "network-vif-unplugged", "status": "completed", "tag": "6bd7f222-246e-43d7-af80-a8892ef8ad8b"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:54:53.386858 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e1f5c015-3d27-4b7b-9a90-eaa5c92952b2 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:53.387529 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e1f5c015-3d27-4b7b-9a90-eaa5c92952b2 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:53.391956 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e1f5c015-3d27-4b7b-9a90-eaa5c92952b2 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:53.394464 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e1f5c015-3d27-4b7b-9a90-eaa5c92952b2 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:53.394936 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e1f5c015-3d27-4b7b-9a90-eaa5c92952b2 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:53.399340 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e1f5c015-3d27-4b7b-9a90-eaa5c92952b2 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:53.401514 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=10 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:54:53.411327 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-2c78c942-d16f-489c-9303-650ff1f9d942 req-1a62af25-16a9-4865-b774-0ad63b632025 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:53.411807 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-2c78c942-d16f-489c-9303-650ff1f9d942 req-1a62af25-16a9-4865-b774-0ad63b632025 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:53.412242 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-2c78c942-d16f-489c-9303-650ff1f9d942 req-1a62af25-16a9-4865-b774-0ad63b632025 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:53.424230 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=15 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:54:53.449662 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-2c78c942-d16f-489c-9303-650ff1f9d942 req-1a62af25-16a9-4865-b774-0ad63b632025 service nova] Creating event network-vif-unplugged:6bd7f222-246e-43d7-af80-a8892ef8ad8b for instance cb02560c-ca90-41f2-8e4a-1fe0f0494068 on n-h2-852278-4 Aug 27 02:54:53.456289 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-e1f5c015-3d27-4b7b-9a90-eaa5c92952b2 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Getting quotas for project 40794f05e8b94a0f8f087a87a58e0ba1. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:54:53.463101 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-2c78c942-d16f-489c-9303-650ff1f9d942 req-1a62af25-16a9-4865-b774-0ad63b632025 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.104017 Aug 27 02:54:53.465287 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1475/2955] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:54:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:54:53.470806 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-e1f5c015-3d27-4b7b-9a90-eaa5c92952b2 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Getting quotas for user f496f24dccea47bd9a5ab532fe45e370 and project 40794f05e8b94a0f8f087a87a58e0ba1. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:54:53.484988 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d30dcbcd-d6b6-4026-9475-85fc12c86b84 tempest-SecurityGroupsTestAdminJSON-305479160 tempest-SecurityGroupsTestAdminJSON-305479160-project] Action: 'create', calling method: .version_select at 0x7f5ede27d5e0>, body: {"security_group": {"name": "tempest-securitygroup-1282571536", "description": "tempest-description-1708949618"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:54:53.486728 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-e1f5c015-3d27-4b7b-9a90-eaa5c92952b2 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Going to run 1 instances... {{(pid=134052) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:54:53.489518 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-e1f5c015-3d27-4b7b-9a90-eaa5c92952b2 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] [instance: e010b43a-87fc-43cf-9ab8-6db75becb702] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134052) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:54:53.519526 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=50 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:54:53.565683 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e1f5c015-3d27-4b7b-9a90-eaa5c92952b2 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.899492 Aug 27 02:54:53.568893 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1481/2956] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 02:54:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1903 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:54:53.579391 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-fad6c44d-f0e5-4086-a79d-7133bf5c9669 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:53.581558 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-fad6c44d-f0e5-4086-a79d-7133bf5c9669 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: 1854f7da-898a-4c09-8da9-a69fab19bb71] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:53.591366 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fad6c44d-f0e5-4086-a79d-7133bf5c9669 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:53.591917 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fad6c44d-f0e5-4086-a79d-7133bf5c9669 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:53.592715 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fad6c44d-f0e5-4086-a79d-7133bf5c9669 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:53.593446 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fad6c44d-f0e5-4086-a79d-7133bf5c9669 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:53.593898 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fad6c44d-f0e5-4086-a79d-7133bf5c9669 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:53.594322 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fad6c44d-f0e5-4086-a79d-7133bf5c9669 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:54.707023 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d30dcbcd-d6b6-4026-9475-85fc12c86b84 tempest-SecurityGroupsTestAdminJSON-305479160 tempest-SecurityGroupsTestAdminJSON-305479160-project] 10.222.0.70 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 1.233294 Aug 27 02:54:54.708798 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1476/2957] 10.222.0.70 () {60 vars in 1180 bytes} [Sat Aug 27 02:54:53 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:54:54.715823 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7b475989-ad76-4aba-a7cb-4abe3eea585b tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:54.718282 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-7b475989-ad76-4aba-a7cb-4abe3eea585b tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] [instance: e010b43a-87fc-43cf-9ab8-6db75becb702] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:54.750091 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7b475989-ad76-4aba-a7cb-4abe3eea585b tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:54.751528 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7b475989-ad76-4aba-a7cb-4abe3eea585b tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:54.752231 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7b475989-ad76-4aba-a7cb-4abe3eea585b tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:54.756390 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7b475989-ad76-4aba-a7cb-4abe3eea585b tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:54.757420 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7b475989-ad76-4aba-a7cb-4abe3eea585b tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:54.758124 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7b475989-ad76-4aba-a7cb-4abe3eea585b tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:54.804047 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-fad6c44d-f0e5-4086-a79d-7133bf5c9669 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:54.816672 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-fad6c44d-f0e5-4086-a79d-7133bf5c9669 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/1854f7da-898a-4c09-8da9-a69fab19bb71" status: 200 len: 1512 microversion: 2.1 time: 1.246593 Aug 27 02:54:54.830248 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1482/2958] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:53 2022] GET /compute/v2.1/servers/1854f7da-898a-4c09-8da9-a69fab19bb71 => generated 1512 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:54.842656 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ea2b7e17-e56a-4615-a1fe-fee4be3434ae tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:54.844462 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-ea2b7e17-e56a-4615-a1fe-fee4be3434ae tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 2d6bf535-89e0-4c21-b2cf-fafcf18c4f18] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:54.861752 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ea2b7e17-e56a-4615-a1fe-fee4be3434ae tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:54.862238 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ea2b7e17-e56a-4615-a1fe-fee4be3434ae tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:54.862841 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ea2b7e17-e56a-4615-a1fe-fee4be3434ae tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:54.863797 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ea2b7e17-e56a-4615-a1fe-fee4be3434ae tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:54.864454 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ea2b7e17-e56a-4615-a1fe-fee4be3434ae tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:54.865086 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ea2b7e17-e56a-4615-a1fe-fee4be3434ae tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:54.972373 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-7b475989-ad76-4aba-a7cb-4abe3eea585b tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f496f24dccea47bd9a5ab532fe45e370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40794f05e8b94a0f8f087a87a58e0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:54.987062 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-7b475989-ad76-4aba-a7cb-4abe3eea585b tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "GET /compute/v2.1/servers/e010b43a-87fc-43cf-9ab8-6db75becb702" status: 200 len: 1260 microversion: 2.1 time: 0.276713 Aug 27 02:54:54.990322 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1477/2959] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:54 2022] GET /compute/v2.1/servers/e010b43a-87fc-43cf-9ab8-6db75becb702 => generated 1260 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:55.012549 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ae82fe60-2e11-4be6-a9a9-fd904771d4e6 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:55.013175 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-ae82fe60-2e11-4be6-a9a9-fd904771d4e6 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] [instance: b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:55.027580 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ae82fe60-2e11-4be6-a9a9-fd904771d4e6 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:55.028120 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ae82fe60-2e11-4be6-a9a9-fd904771d4e6 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:55.028587 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ae82fe60-2e11-4be6-a9a9-fd904771d4e6 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:55.029294 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ae82fe60-2e11-4be6-a9a9-fd904771d4e6 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:55.032960 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ae82fe60-2e11-4be6-a9a9-fd904771d4e6 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:55.034942 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ae82fe60-2e11-4be6-a9a9-fd904771d4e6 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:55.105925 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-ea2b7e17-e56a-4615-a1fe-fee4be3434ae tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:55.128200 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ea2b7e17-e56a-4615-a1fe-fee4be3434ae tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/2d6bf535-89e0-4c21-b2cf-fafcf18c4f18" status: 200 len: 1272 microversion: 2.1 time: 0.296607 Aug 27 02:54:55.129061 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1483/2960] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:54 2022] GET /compute/v2.1/servers/2d6bf535-89e0-4c21-b2cf-fafcf18c4f18 => generated 1272 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:55.290122 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d85ac5d3-cc8f-4074-8b79-810945a4b531 tempest-SecurityGroupsTestAdminJSON-427923122 tempest-SecurityGroupsTestAdminJSON-427923122-project-admin] Action: 'create', calling method: .version_select at 0x7f5ee240adc0>, body: {"security_group": {"name": "tempest-securitygroup-1267498449", "description": "tempest-description-1424022615"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:54:55.692867 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-ae82fe60-2e11-4be6-a9a9-fd904771d4e6 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:55.726380 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-ae82fe60-2e11-4be6-a9a9-fd904771d4e6 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:55.728298 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-ae82fe60-2e11-4be6-a9a9-fd904771d4e6 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:55.735182 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ae82fe60-2e11-4be6-a9a9-fd904771d4e6 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] 10.222.0.70 "GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7" status: 200 len: 1849 microversion: 2.32 time: 0.738622 Aug 27 02:54:55.736117 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1478/2961] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:54:54 2022] GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 => generated 1849 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:54:55.749915 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-44957de0-05f1-4be0-a323-860b3f4fec3a req-cfe507df-d5aa-49a0-9698-2f7b1ab75f28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb02560c-ca90-41f2-8e4a-1fe0f0494068", "name": "network-vif-deleted", "tag": "6bd7f222-246e-43d7-af80-a8892ef8ad8b"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:54:55.769252 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-44957de0-05f1-4be0-a323-860b3f4fec3a req-cfe507df-d5aa-49a0-9698-2f7b1ab75f28 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:55.779903 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-44957de0-05f1-4be0-a323-860b3f4fec3a req-cfe507df-d5aa-49a0-9698-2f7b1ab75f28 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:55.780548 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-44957de0-05f1-4be0-a323-860b3f4fec3a req-cfe507df-d5aa-49a0-9698-2f7b1ab75f28 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:55.801098 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-44957de0-05f1-4be0-a323-860b3f4fec3a req-cfe507df-d5aa-49a0-9698-2f7b1ab75f28 service nova] Creating event network-vif-deleted:6bd7f222-246e-43d7-af80-a8892ef8ad8b for instance cb02560c-ca90-41f2-8e4a-1fe0f0494068 on n-h2-852278-4 Aug 27 02:54:55.807110 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-44957de0-05f1-4be0-a323-860b3f4fec3a req-cfe507df-d5aa-49a0-9698-2f7b1ab75f28 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069526 Aug 27 02:54:55.808864 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1479/2962] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:54:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:54:55.843524 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-5fabb84b-d70c-43fa-8085-77e2cae05c85 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:55.845127 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-5fabb84b-d70c-43fa-8085-77e2cae05c85 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: 1854f7da-898a-4c09-8da9-a69fab19bb71] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:55.860502 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5fabb84b-d70c-43fa-8085-77e2cae05c85 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:55.861395 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5fabb84b-d70c-43fa-8085-77e2cae05c85 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:55.862736 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5fabb84b-d70c-43fa-8085-77e2cae05c85 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:55.864690 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5fabb84b-d70c-43fa-8085-77e2cae05c85 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:55.866321 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5fabb84b-d70c-43fa-8085-77e2cae05c85 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:55.867639 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5fabb84b-d70c-43fa-8085-77e2cae05c85 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:56.768621 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-5fabb84b-d70c-43fa-8085-77e2cae05c85 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:56.779167 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-5fabb84b-d70c-43fa-8085-77e2cae05c85 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/1854f7da-898a-4c09-8da9-a69fab19bb71" status: 200 len: 1512 microversion: 2.1 time: 0.940979 Aug 27 02:54:56.780951 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1480/2963] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:55 2022] GET /compute/v2.1/servers/1854f7da-898a-4c09-8da9-a69fab19bb71 => generated 1512 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:54:56.788008 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-644f1ad0-0033-4fe5-ac4f-7f08bb03777f tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:56.788871 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-644f1ad0-0033-4fe5-ac4f-7f08bb03777f tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] [instance: e010b43a-87fc-43cf-9ab8-6db75becb702] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:56.811352 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-644f1ad0-0033-4fe5-ac4f-7f08bb03777f tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:56.812437 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-644f1ad0-0033-4fe5-ac4f-7f08bb03777f tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:56.813159 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-644f1ad0-0033-4fe5-ac4f-7f08bb03777f tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:56.814134 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-644f1ad0-0033-4fe5-ac4f-7f08bb03777f tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:56.814862 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-644f1ad0-0033-4fe5-ac4f-7f08bb03777f tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:56.815865 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-644f1ad0-0033-4fe5-ac4f-7f08bb03777f tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:56.909508 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d85ac5d3-cc8f-4074-8b79-810945a4b531 tempest-SecurityGroupsTestAdminJSON-427923122 tempest-SecurityGroupsTestAdminJSON-427923122-project-admin] 10.222.0.70 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 1.764401 Aug 27 02:54:56.917291 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1484/2964] 10.222.0.70 () {60 vars in 1180 bytes} [Sat Aug 27 02:54:55 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 1775 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:54:56.928942 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-360f9e5d-3b67-4b7e-b65c-3b535bc51367 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:56.930571 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-360f9e5d-3b67-4b7e-b65c-3b535bc51367 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 2d6bf535-89e0-4c21-b2cf-fafcf18c4f18] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:56.937966 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-360f9e5d-3b67-4b7e-b65c-3b535bc51367 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:56.938745 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-360f9e5d-3b67-4b7e-b65c-3b535bc51367 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:56.939366 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-360f9e5d-3b67-4b7e-b65c-3b535bc51367 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:56.940269 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-360f9e5d-3b67-4b7e-b65c-3b535bc51367 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:56.941073 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-360f9e5d-3b67-4b7e-b65c-3b535bc51367 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:56.941683 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-360f9e5d-3b67-4b7e-b65c-3b535bc51367 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:57.015064 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-644f1ad0-0033-4fe5-ac4f-7f08bb03777f tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f496f24dccea47bd9a5ab532fe45e370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40794f05e8b94a0f8f087a87a58e0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:57.026391 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-644f1ad0-0033-4fe5-ac4f-7f08bb03777f tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "GET /compute/v2.1/servers/e010b43a-87fc-43cf-9ab8-6db75becb702" status: 200 len: 1266 microversion: 2.1 time: 0.244040 Aug 27 02:54:57.028077 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1481/2965] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:56 2022] GET /compute/v2.1/servers/e010b43a-87fc-43cf-9ab8-6db75becb702 => generated 1266 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:57.033757 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b97796a5-3237-4f28-bd10-f66c731ff79f tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:57.034710 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b97796a5-3237-4f28-bd10-f66c731ff79f tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] [instance: b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:57.042693 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b97796a5-3237-4f28-bd10-f66c731ff79f tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:57.043941 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b97796a5-3237-4f28-bd10-f66c731ff79f tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:57.045120 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b97796a5-3237-4f28-bd10-f66c731ff79f tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:57.050198 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-360f9e5d-3b67-4b7e-b65c-3b535bc51367 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:57.071794 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b97796a5-3237-4f28-bd10-f66c731ff79f tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:57.072291 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b97796a5-3237-4f28-bd10-f66c731ff79f tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:57.072768 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b97796a5-3237-4f28-bd10-f66c731ff79f tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:57.078712 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-360f9e5d-3b67-4b7e-b65c-3b535bc51367 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/2d6bf535-89e0-4c21-b2cf-fafcf18c4f18" status: 200 len: 1272 microversion: 2.1 time: 0.159833 Aug 27 02:54:57.079697 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1485/2966] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:56 2022] GET /compute/v2.1/servers/2d6bf535-89e0-4c21-b2cf-fafcf18c4f18 => generated 1272 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:57.084734 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ebd6a7e9-a2b7-41ac-9d8c-9799485e99fa tempest-SecurityGroupsTestAdminJSON-427923122 tempest-SecurityGroupsTestAdminJSON-427923122-project-admin] Action: 'create', calling method: .version_select at 0x7f5ee241f550>, body: {"security_group": {"name": "tempest-securitygroup-827440301", "description": "tempest-description-1591218779"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:54:57.670024 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-b97796a5-3237-4f28-bd10-f66c731ff79f tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:57.687269 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-b97796a5-3237-4f28-bd10-f66c731ff79f tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:57.688843 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-b97796a5-3237-4f28-bd10-f66c731ff79f tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:57.689941 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b97796a5-3237-4f28-bd10-f66c731ff79f tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] 10.222.0.70 "GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7" status: 200 len: 1849 microversion: 2.32 time: 0.660635 Aug 27 02:54:57.691090 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1482/2967] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:54:57 2022] GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 => generated 1849 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:54:57.807880 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-6aa8eeab-c8bf-4fd5-9ad5-8e8fad55b020 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:57.810272 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-6aa8eeab-c8bf-4fd5-9ad5-8e8fad55b020 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: 1854f7da-898a-4c09-8da9-a69fab19bb71] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:57.843921 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6aa8eeab-c8bf-4fd5-9ad5-8e8fad55b020 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:57.846812 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6aa8eeab-c8bf-4fd5-9ad5-8e8fad55b020 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:57.848981 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6aa8eeab-c8bf-4fd5-9ad5-8e8fad55b020 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:57.850577 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6aa8eeab-c8bf-4fd5-9ad5-8e8fad55b020 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:57.851428 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6aa8eeab-c8bf-4fd5-9ad5-8e8fad55b020 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:57.852141 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6aa8eeab-c8bf-4fd5-9ad5-8e8fad55b020 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:57.895763 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:54:57.913382 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ebd6a7e9-a2b7-41ac-9d8c-9799485e99fa tempest-SecurityGroupsTestAdminJSON-427923122 tempest-SecurityGroupsTestAdminJSON-427923122-project-admin] 10.222.0.70 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.832290 Aug 27 02:54:57.918532 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1486/2968] 10.222.0.70 () {60 vars in 1180 bytes} [Sat Aug 27 02:54:57 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:54:57.931184 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ac33dca2-38c9-469e-9d2b-3fbe4cf48092 tempest-SecurityGroupsTestAdminJSON-427923122 tempest-SecurityGroupsTestAdminJSON-427923122-project-admin] Calling method '.version_select at 0x7f5ee71de040>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:58.673712 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-6aa8eeab-c8bf-4fd5-9ad5-8e8fad55b020 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:58.687905 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-6aa8eeab-c8bf-4fd5-9ad5-8e8fad55b020 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/1854f7da-898a-4c09-8da9-a69fab19bb71" status: 200 len: 1512 microversion: 2.1 time: 0.886501 Aug 27 02:54:58.689453 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1483/2969] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:57 2022] GET /compute/v2.1/servers/1854f7da-898a-4c09-8da9-a69fab19bb71 => generated 1512 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:54:58.695076 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-6ab366d5-657a-41b8-a83b-cb1485d410b5 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:58.696418 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-6ab366d5-657a-41b8-a83b-cb1485d410b5 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] [instance: e010b43a-87fc-43cf-9ab8-6db75becb702] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:58.703490 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6ab366d5-657a-41b8-a83b-cb1485d410b5 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:58.704265 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6ab366d5-657a-41b8-a83b-cb1485d410b5 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:58.706378 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6ab366d5-657a-41b8-a83b-cb1485d410b5 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:58.707311 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6ab366d5-657a-41b8-a83b-cb1485d410b5 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:58.707961 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6ab366d5-657a-41b8-a83b-cb1485d410b5 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:58.708688 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6ab366d5-657a-41b8-a83b-cb1485d410b5 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:59.286892 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-6ab366d5-657a-41b8-a83b-cb1485d410b5 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f496f24dccea47bd9a5ab532fe45e370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40794f05e8b94a0f8f087a87a58e0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:59.295456 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-6ab366d5-657a-41b8-a83b-cb1485d410b5 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "GET /compute/v2.1/servers/e010b43a-87fc-43cf-9ab8-6db75becb702" status: 200 len: 1308 microversion: 2.1 time: 0.604725 Aug 27 02:54:59.296050 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1484/2970] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:58 2022] GET /compute/v2.1/servers/e010b43a-87fc-43cf-9ab8-6db75becb702 => generated 1308 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:59.311262 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-56734933-7aca-4d2e-9a8b-12f1524f5b63 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:59.311883 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-56734933-7aca-4d2e-9a8b-12f1524f5b63 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 2d6bf535-89e0-4c21-b2cf-fafcf18c4f18] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:59.319615 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-56734933-7aca-4d2e-9a8b-12f1524f5b63 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:59.325624 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-56734933-7aca-4d2e-9a8b-12f1524f5b63 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:59.326484 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-56734933-7aca-4d2e-9a8b-12f1524f5b63 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:59.327400 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-56734933-7aca-4d2e-9a8b-12f1524f5b63 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:59.333658 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-56734933-7aca-4d2e-9a8b-12f1524f5b63 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:59.334330 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-56734933-7aca-4d2e-9a8b-12f1524f5b63 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:59.875565 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-56734933-7aca-4d2e-9a8b-12f1524f5b63 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:59.887094 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-56734933-7aca-4d2e-9a8b-12f1524f5b63 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/2d6bf535-89e0-4c21-b2cf-fafcf18c4f18" status: 200 len: 1314 microversion: 2.1 time: 0.589896 Aug 27 02:54:59.888140 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1485/2971] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:59 2022] GET /compute/v2.1/servers/2d6bf535-89e0-4c21-b2cf-fafcf18c4f18 => generated 1314 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:59.893077 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-b17f985c-1794-4a0a-957d-a7e0cb8b396a req-7af1ea15-57de-46dc-be23-54b515c58af1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7", "tag": "8524810a-aaa6-4efe-ac59-2515339a1681"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:54:59.923751 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-b17f985c-1794-4a0a-957d-a7e0cb8b396a req-7af1ea15-57de-46dc-be23-54b515c58af1 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:59.924225 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-b17f985c-1794-4a0a-957d-a7e0cb8b396a req-7af1ea15-57de-46dc-be23-54b515c58af1 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:59.924675 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-b17f985c-1794-4a0a-957d-a7e0cb8b396a req-7af1ea15-57de-46dc-be23-54b515c58af1 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:59.947623 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-b17f985c-1794-4a0a-957d-a7e0cb8b396a req-7af1ea15-57de-46dc-be23-54b515c58af1 service nova] Creating event network-changed:8524810a-aaa6-4efe-ac59-2515339a1681 for instance b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 on n-h2-852278-4 Aug 27 02:54:59.959724 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-b17f985c-1794-4a0a-957d-a7e0cb8b396a req-7af1ea15-57de-46dc-be23-54b515c58af1 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069981 Aug 27 02:54:59.960734 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1486/2972] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:54:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:54:59.966097 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4506eb88-b2a9-4013-9514-faa8753f3a02 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:59.966796 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-4506eb88-b2a9-4013-9514-faa8753f3a02 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] [instance: b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:59.985688 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4506eb88-b2a9-4013-9514-faa8753f3a02 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:59.986175 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4506eb88-b2a9-4013-9514-faa8753f3a02 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:59.986606 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4506eb88-b2a9-4013-9514-faa8753f3a02 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:59.987311 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4506eb88-b2a9-4013-9514-faa8753f3a02 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:59.987757 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4506eb88-b2a9-4013-9514-faa8753f3a02 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:59.988174 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4506eb88-b2a9-4013-9514-faa8753f3a02 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:01.336912 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-4506eb88-b2a9-4013-9514-faa8753f3a02 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:01.357829 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-4506eb88-b2a9-4013-9514-faa8753f3a02 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:01.366995 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-4506eb88-b2a9-4013-9514-faa8753f3a02 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:01.373998 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-4506eb88-b2a9-4013-9514-faa8753f3a02 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] 10.222.0.70 "GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7" status: 200 len: 1870 microversion: 2.32 time: 1.410177 Aug 27 02:55:01.375640 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1487/2973] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:54:59 2022] GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 => generated 1870 bytes in 1414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:55:01.402571 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-22201ed6-3485-46b6-a1b9-2b25cb3577d3 req-70c15e6d-f66c-466c-9901-80bb2bfc9882 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e010b43a-87fc-43cf-9ab8-6db75becb702", "tag": "cf6f3d69-229f-4ec6-a305-1e8331df92e7"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:55:01.416301 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-22201ed6-3485-46b6-a1b9-2b25cb3577d3 req-70c15e6d-f66c-466c-9901-80bb2bfc9882 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:01.416822 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-22201ed6-3485-46b6-a1b9-2b25cb3577d3 req-70c15e6d-f66c-466c-9901-80bb2bfc9882 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:01.417457 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-22201ed6-3485-46b6-a1b9-2b25cb3577d3 req-70c15e6d-f66c-466c-9901-80bb2bfc9882 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:01.467290 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-22201ed6-3485-46b6-a1b9-2b25cb3577d3 req-70c15e6d-f66c-466c-9901-80bb2bfc9882 service nova] Creating event network-changed:cf6f3d69-229f-4ec6-a305-1e8331df92e7 for instance e010b43a-87fc-43cf-9ab8-6db75becb702 on n-h1-852278-4 Aug 27 02:55:01.481892 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-22201ed6-3485-46b6-a1b9-2b25cb3577d3 req-70c15e6d-f66c-466c-9901-80bb2bfc9882 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086282 Aug 27 02:55:01.484945 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1488/2974] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:55:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:55:01.501234 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-58e9313e-d0d4-4f00-b753-57ea21053550 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:01.512981 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-58e9313e-d0d4-4f00-b753-57ea21053550 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: 1854f7da-898a-4c09-8da9-a69fab19bb71] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:01.531811 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-58e9313e-d0d4-4f00-b753-57ea21053550 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:01.532349 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-58e9313e-d0d4-4f00-b753-57ea21053550 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:01.532816 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-58e9313e-d0d4-4f00-b753-57ea21053550 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:01.537408 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-58e9313e-d0d4-4f00-b753-57ea21053550 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:01.537911 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-58e9313e-d0d4-4f00-b753-57ea21053550 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:01.540848 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-58e9313e-d0d4-4f00-b753-57ea21053550 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:02.113555 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-58e9313e-d0d4-4f00-b753-57ea21053550 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:02.126407 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-58e9313e-d0d4-4f00-b753-57ea21053550 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/1854f7da-898a-4c09-8da9-a69fab19bb71" status: 200 len: 1512 microversion: 2.1 time: 0.637425 Aug 27 02:55:02.129020 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1489/2975] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:01 2022] GET /compute/v2.1/servers/1854f7da-898a-4c09-8da9-a69fab19bb71 => generated 1512 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:55:02.139776 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-649c9aae-2b77-4ac0-95d2-4096f02cd96f tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:02.141456 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-649c9aae-2b77-4ac0-95d2-4096f02cd96f tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] [instance: e010b43a-87fc-43cf-9ab8-6db75becb702] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:02.149303 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-649c9aae-2b77-4ac0-95d2-4096f02cd96f tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:02.149809 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-649c9aae-2b77-4ac0-95d2-4096f02cd96f tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:02.150288 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-649c9aae-2b77-4ac0-95d2-4096f02cd96f tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:02.151086 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-649c9aae-2b77-4ac0-95d2-4096f02cd96f tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:02.151538 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-649c9aae-2b77-4ac0-95d2-4096f02cd96f tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:02.151962 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-649c9aae-2b77-4ac0-95d2-4096f02cd96f tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:02.722684 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-649c9aae-2b77-4ac0-95d2-4096f02cd96f tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f496f24dccea47bd9a5ab532fe45e370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40794f05e8b94a0f8f087a87a58e0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:02.731456 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-649c9aae-2b77-4ac0-95d2-4096f02cd96f tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "GET /compute/v2.1/servers/e010b43a-87fc-43cf-9ab8-6db75becb702" status: 200 len: 1308 microversion: 2.1 time: 0.600809 Aug 27 02:55:02.745005 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1490/2976] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:02 2022] GET /compute/v2.1/servers/e010b43a-87fc-43cf-9ab8-6db75becb702 => generated 1308 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:55:02.745978 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-994bab6d-a7e5-47be-8302-acbbc9885bef tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:02.746684 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-994bab6d-a7e5-47be-8302-acbbc9885bef tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 2d6bf535-89e0-4c21-b2cf-fafcf18c4f18] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:02.760415 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-994bab6d-a7e5-47be-8302-acbbc9885bef tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:02.760917 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-994bab6d-a7e5-47be-8302-acbbc9885bef tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:02.763838 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-994bab6d-a7e5-47be-8302-acbbc9885bef tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:02.764650 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-994bab6d-a7e5-47be-8302-acbbc9885bef tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:02.765120 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-994bab6d-a7e5-47be-8302-acbbc9885bef tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:02.769495 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-994bab6d-a7e5-47be-8302-acbbc9885bef tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:03.149632 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-994bab6d-a7e5-47be-8302-acbbc9885bef tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:03.161989 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-994bab6d-a7e5-47be-8302-acbbc9885bef tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/2d6bf535-89e0-4c21-b2cf-fafcf18c4f18" status: 200 len: 1314 microversion: 2.1 time: 0.424440 Aug 27 02:55:03.162810 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1491/2977] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:02 2022] GET /compute/v2.1/servers/2d6bf535-89e0-4c21-b2cf-fafcf18c4f18 => generated 1314 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:55:03.181860 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-42759875-de8d-432c-916f-83353a99314f req-2a7dd16c-00bf-45df-8e28-bed64ba3436f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d6bf535-89e0-4c21-b2cf-fafcf18c4f18", "tag": "8a321f34-88af-436b-ac87-1009ae5c3dcd"}, {"name": "network-changed", "server_uuid": "b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7", "tag": "55ef695b-3e5a-443f-aaa4-c5aca34edc53"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:55:03.203418 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-42759875-de8d-432c-916f-83353a99314f req-2a7dd16c-00bf-45df-8e28-bed64ba3436f service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:03.205031 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-42759875-de8d-432c-916f-83353a99314f req-2a7dd16c-00bf-45df-8e28-bed64ba3436f service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:03.206149 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-42759875-de8d-432c-916f-83353a99314f req-2a7dd16c-00bf-45df-8e28-bed64ba3436f service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:03.243206 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-42759875-de8d-432c-916f-83353a99314f req-2a7dd16c-00bf-45df-8e28-bed64ba3436f service nova] Creating event network-changed:8a321f34-88af-436b-ac87-1009ae5c3dcd for instance 2d6bf535-89e0-4c21-b2cf-fafcf18c4f18 on n-h2-852278-4 Aug 27 02:55:03.243714 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-42759875-de8d-432c-916f-83353a99314f req-2a7dd16c-00bf-45df-8e28-bed64ba3436f service nova] Creating event network-changed:55ef695b-3e5a-443f-aaa4-c5aca34edc53 for instance b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 on n-h2-852278-4 Aug 27 02:55:03.281444 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-42759875-de8d-432c-916f-83353a99314f req-2a7dd16c-00bf-45df-8e28-bed64ba3436f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.103811 Aug 27 02:55:03.290580 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1492/2978] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:55:03 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:55:03.296976 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-57569832-544c-42f5-a7f5-37a219e95089 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:03.299754 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-57569832-544c-42f5-a7f5-37a219e95089 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] [instance: b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:03.317282 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-57569832-544c-42f5-a7f5-37a219e95089 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:03.317840 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-57569832-544c-42f5-a7f5-37a219e95089 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:03.318284 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-57569832-544c-42f5-a7f5-37a219e95089 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:03.319022 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-57569832-544c-42f5-a7f5-37a219e95089 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:03.319481 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-57569832-544c-42f5-a7f5-37a219e95089 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:03.319910 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-57569832-544c-42f5-a7f5-37a219e95089 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:03.441788 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:55:03.481537 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=5 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:55:03.731298 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-57569832-544c-42f5-a7f5-37a219e95089 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:03.758952 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-57569832-544c-42f5-a7f5-37a219e95089 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:03.770635 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-57569832-544c-42f5-a7f5-37a219e95089 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:03.776858 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-57569832-544c-42f5-a7f5-37a219e95089 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] 10.222.0.70 "GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7" status: 200 len: 1891 microversion: 2.32 time: 0.480236 Aug 27 02:55:03.779116 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1493/2979] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:55:03 2022] GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 => generated 1891 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:55:03.791219 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f1c905eb-a14e-4d53-88f8-044dd7c5f0b1 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:03.793468 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-f1c905eb-a14e-4d53-88f8-044dd7c5f0b1 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: 1854f7da-898a-4c09-8da9-a69fab19bb71] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:03.837851 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f1c905eb-a14e-4d53-88f8-044dd7c5f0b1 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:03.838825 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f1c905eb-a14e-4d53-88f8-044dd7c5f0b1 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:03.839596 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f1c905eb-a14e-4d53-88f8-044dd7c5f0b1 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:03.845246 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f1c905eb-a14e-4d53-88f8-044dd7c5f0b1 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:03.846143 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f1c905eb-a14e-4d53-88f8-044dd7c5f0b1 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:03.846775 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f1c905eb-a14e-4d53-88f8-044dd7c5f0b1 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:04.513768 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-f1c905eb-a14e-4d53-88f8-044dd7c5f0b1 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:04.523019 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-f1c905eb-a14e-4d53-88f8-044dd7c5f0b1 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/1854f7da-898a-4c09-8da9-a69fab19bb71" status: 200 len: 1512 microversion: 2.1 time: 0.741460 Aug 27 02:55:04.523636 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1494/2980] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:03 2022] GET /compute/v2.1/servers/1854f7da-898a-4c09-8da9-a69fab19bb71 => generated 1512 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:55:04.545927 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-6876c5f9-7287-42b8-84f6-1de4a06a6135 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:04.546913 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-6876c5f9-7287-42b8-84f6-1de4a06a6135 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] [instance: e010b43a-87fc-43cf-9ab8-6db75becb702] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:04.558516 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6876c5f9-7287-42b8-84f6-1de4a06a6135 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:04.563861 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6876c5f9-7287-42b8-84f6-1de4a06a6135 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:04.564805 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6876c5f9-7287-42b8-84f6-1de4a06a6135 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:04.565836 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6876c5f9-7287-42b8-84f6-1de4a06a6135 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:04.568060 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6876c5f9-7287-42b8-84f6-1de4a06a6135 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:04.577358 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6876c5f9-7287-42b8-84f6-1de4a06a6135 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:05.146084 n-d-852278-4 devstack@n-api.service[134052]: DEBUG neutronclient.v2_0.client [None req-ac33dca2-38c9-469e-9d2b-3fbe4cf48092 tempest-SecurityGroupsTestAdminJSON-427923122 tempest-SecurityGroupsTestAdminJSON-427923122-project-admin] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a79d1fad-38e0-40eb-a8ca-71af97b6a5d3 does not exist", "detail": ""}} {{(pid=134052) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 02:55:05.146770 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.network.security_group_api [None req-ac33dca2-38c9-469e-9d2b-3fbe4cf48092 tempest-SecurityGroupsTestAdminJSON-427923122 tempest-SecurityGroupsTestAdminJSON-427923122-project-admin] Neutron security group a79d1fad-38e0-40eb-a8ca-71af97b6a5d3 not found {{(pid=134052) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 27 02:55:05.147559 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.compute.security_groups [None req-ac33dca2-38c9-469e-9d2b-3fbe4cf48092 tempest-SecurityGroupsTestAdminJSON-427923122 tempest-SecurityGroupsTestAdminJSON-427923122-project-admin] Security Group ID a79d1fad-38e0-40eb-a8ca-71af97b6a5d3 does not exist {{(pid=134052) _format_security_group_rule /opt/stack/nova/nova/api/openstack/compute/security_groups.py:75}} Aug 27 02:55:05.227943 n-d-852278-4 devstack@n-api.service[134052]: DEBUG neutronclient.v2_0.client [None req-ac33dca2-38c9-469e-9d2b-3fbe4cf48092 tempest-SecurityGroupsTestAdminJSON-427923122 tempest-SecurityGroupsTestAdminJSON-427923122-project-admin] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a79d1fad-38e0-40eb-a8ca-71af97b6a5d3 does not exist", "detail": ""}} {{(pid=134052) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 02:55:05.229068 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.network.security_group_api [None req-ac33dca2-38c9-469e-9d2b-3fbe4cf48092 tempest-SecurityGroupsTestAdminJSON-427923122 tempest-SecurityGroupsTestAdminJSON-427923122-project-admin] Neutron security group a79d1fad-38e0-40eb-a8ca-71af97b6a5d3 not found {{(pid=134052) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 27 02:55:05.232939 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.compute.security_groups [None req-ac33dca2-38c9-469e-9d2b-3fbe4cf48092 tempest-SecurityGroupsTestAdminJSON-427923122 tempest-SecurityGroupsTestAdminJSON-427923122-project-admin] Security Group ID a79d1fad-38e0-40eb-a8ca-71af97b6a5d3 does not exist {{(pid=134052) _format_security_group_rule /opt/stack/nova/nova/api/openstack/compute/security_groups.py:75}} Aug 27 02:55:05.284448 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-6876c5f9-7287-42b8-84f6-1de4a06a6135 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f496f24dccea47bd9a5ab532fe45e370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40794f05e8b94a0f8f087a87a58e0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:05.309884 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-6876c5f9-7287-42b8-84f6-1de4a06a6135 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "GET /compute/v2.1/servers/e010b43a-87fc-43cf-9ab8-6db75becb702" status: 200 len: 1308 microversion: 2.1 time: 0.783031 Aug 27 02:55:05.317283 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1495/2981] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:04 2022] GET /compute/v2.1/servers/e010b43a-87fc-43cf-9ab8-6db75becb702 => generated 1308 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:55:05.347948 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e228ab78-38ae-492e-8820-64faa99ebf2b tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:05.350028 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-e228ab78-38ae-492e-8820-64faa99ebf2b tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 2d6bf535-89e0-4c21-b2cf-fafcf18c4f18] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:05.384063 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e228ab78-38ae-492e-8820-64faa99ebf2b tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:05.385706 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e228ab78-38ae-492e-8820-64faa99ebf2b tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:05.390461 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e228ab78-38ae-492e-8820-64faa99ebf2b tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:05.392070 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e228ab78-38ae-492e-8820-64faa99ebf2b tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:05.393090 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e228ab78-38ae-492e-8820-64faa99ebf2b tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:05.394089 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e228ab78-38ae-492e-8820-64faa99ebf2b tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:06.362541 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e228ab78-38ae-492e-8820-64faa99ebf2b tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:06.395487 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e228ab78-38ae-492e-8820-64faa99ebf2b tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/2d6bf535-89e0-4c21-b2cf-fafcf18c4f18" status: 200 len: 1314 microversion: 2.1 time: 1.074130 Aug 27 02:55:06.396712 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1496/2982] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:05 2022] GET /compute/v2.1/servers/2d6bf535-89e0-4c21-b2cf-fafcf18c4f18 => generated 1314 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:55:06.401759 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-75f63a5d-961f-4324-be34-3e406ee579fa tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:06.402570 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-75f63a5d-961f-4324-be34-3e406ee579fa tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] [instance: b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:06.408780 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-75f63a5d-961f-4324-be34-3e406ee579fa tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:06.409478 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-75f63a5d-961f-4324-be34-3e406ee579fa tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:06.410099 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-75f63a5d-961f-4324-be34-3e406ee579fa tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:06.410954 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-75f63a5d-961f-4324-be34-3e406ee579fa tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:06.411546 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-75f63a5d-961f-4324-be34-3e406ee579fa tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:06.412118 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-75f63a5d-961f-4324-be34-3e406ee579fa tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:06.768051 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ac33dca2-38c9-469e-9d2b-3fbe4cf48092 tempest-SecurityGroupsTestAdminJSON-427923122 tempest-SecurityGroupsTestAdminJSON-427923122-project-admin] 10.222.0.70 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 9790 microversion: 2.1 time: 8.841673 Aug 27 02:55:06.771215 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1487/2983] 10.222.0.70 () {58 vars in 1191 bytes} [Sat Aug 27 02:54:57 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 9790 bytes in 8846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:55:06.781576 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-c1768a12-8d4e-4331-a321-246d7bdf98be req-d5f8830b-7f8e-4852-81b6-d6f6babaef2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7", "tag": "57c0448a-207e-435f-9a6b-4477adaf5128"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:55:06.800148 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-c1768a12-8d4e-4331-a321-246d7bdf98be req-d5f8830b-7f8e-4852-81b6-d6f6babaef2a service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:06.801127 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-c1768a12-8d4e-4331-a321-246d7bdf98be req-d5f8830b-7f8e-4852-81b6-d6f6babaef2a service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:06.802123 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-c1768a12-8d4e-4331-a321-246d7bdf98be req-d5f8830b-7f8e-4852-81b6-d6f6babaef2a service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:06.820742 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-c1768a12-8d4e-4331-a321-246d7bdf98be req-d5f8830b-7f8e-4852-81b6-d6f6babaef2a service nova] Creating event network-changed:57c0448a-207e-435f-9a6b-4477adaf5128 for instance b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 on n-h2-852278-4 Aug 27 02:55:06.829693 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-c1768a12-8d4e-4331-a321-246d7bdf98be req-d5f8830b-7f8e-4852-81b6-d6f6babaef2a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056198 Aug 27 02:55:06.831031 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1488/2984] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:55:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:55:06.840411 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-763cdad2-bbe6-40ac-ad75-0d9766a0f42b tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:06.841396 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-763cdad2-bbe6-40ac-ad75-0d9766a0f42b tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: 1854f7da-898a-4c09-8da9-a69fab19bb71] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:06.849194 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-763cdad2-bbe6-40ac-ad75-0d9766a0f42b tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:06.849687 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-763cdad2-bbe6-40ac-ad75-0d9766a0f42b tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:06.850123 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-763cdad2-bbe6-40ac-ad75-0d9766a0f42b tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:06.850833 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-763cdad2-bbe6-40ac-ad75-0d9766a0f42b tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:06.851726 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-763cdad2-bbe6-40ac-ad75-0d9766a0f42b tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:06.852354 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-763cdad2-bbe6-40ac-ad75-0d9766a0f42b tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:06.944906 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-75f63a5d-961f-4324-be34-3e406ee579fa tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:06.956679 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-75f63a5d-961f-4324-be34-3e406ee579fa tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:06.958509 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-75f63a5d-961f-4324-be34-3e406ee579fa tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:06.959797 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-75f63a5d-961f-4324-be34-3e406ee579fa tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] 10.222.0.70 "GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7" status: 200 len: 1879 microversion: 2.32 time: 0.561757 Aug 27 02:55:06.960618 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1497/2985] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:55:06 2022] GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 => generated 1879 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:55:06.965796 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-30767b9f-4eda-4db7-8fb6-77afee042cc5 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:06.967273 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-30767b9f-4eda-4db7-8fb6-77afee042cc5 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] [instance: e010b43a-87fc-43cf-9ab8-6db75becb702] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:06.974792 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-30767b9f-4eda-4db7-8fb6-77afee042cc5 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:06.975715 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-30767b9f-4eda-4db7-8fb6-77afee042cc5 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:06.976330 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-30767b9f-4eda-4db7-8fb6-77afee042cc5 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:06.977334 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-30767b9f-4eda-4db7-8fb6-77afee042cc5 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:06.978156 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-30767b9f-4eda-4db7-8fb6-77afee042cc5 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:06.979566 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-30767b9f-4eda-4db7-8fb6-77afee042cc5 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:07.234973 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-763cdad2-bbe6-40ac-ad75-0d9766a0f42b tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:07.253292 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-763cdad2-bbe6-40ac-ad75-0d9766a0f42b tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/1854f7da-898a-4c09-8da9-a69fab19bb71" status: 200 len: 1512 microversion: 2.1 time: 0.420543 Aug 27 02:55:07.266993 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1489/2986] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:06 2022] GET /compute/v2.1/servers/1854f7da-898a-4c09-8da9-a69fab19bb71 => generated 1512 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:55:07.266993 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-a70ffa77-fae6-4069-ba41-1e5e209c3e1a req-c7712498-6b0b-4bfd-b32e-48a3bcd6fd0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e010b43a-87fc-43cf-9ab8-6db75becb702", "name": "network-vif-plugged", "status": "completed", "tag": "cf6f3d69-229f-4ec6-a305-1e8331df92e7"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:55:07.282345 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-a70ffa77-fae6-4069-ba41-1e5e209c3e1a req-c7712498-6b0b-4bfd-b32e-48a3bcd6fd0d service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:07.282824 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-a70ffa77-fae6-4069-ba41-1e5e209c3e1a req-c7712498-6b0b-4bfd-b32e-48a3bcd6fd0d service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:07.283258 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-a70ffa77-fae6-4069-ba41-1e5e209c3e1a req-c7712498-6b0b-4bfd-b32e-48a3bcd6fd0d service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:07.314636 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-a70ffa77-fae6-4069-ba41-1e5e209c3e1a req-c7712498-6b0b-4bfd-b32e-48a3bcd6fd0d service nova] Creating event network-vif-plugged:cf6f3d69-229f-4ec6-a305-1e8331df92e7 for instance e010b43a-87fc-43cf-9ab8-6db75becb702 on n-h1-852278-4 Aug 27 02:55:07.321132 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-a70ffa77-fae6-4069-ba41-1e5e209c3e1a req-c7712498-6b0b-4bfd-b32e-48a3bcd6fd0d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065588 Aug 27 02:55:07.322084 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1490/2987] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:55:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:55:07.328503 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-1f97d23a-a4d2-4268-998b-67539c9d9308 tempest-SecurityGroupsTestAdminJSON-305479160 tempest-SecurityGroupsTestAdminJSON-305479160-project] Calling method '.version_select at 0x7f5ee240a700>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:07.443305 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-30767b9f-4eda-4db7-8fb6-77afee042cc5 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f496f24dccea47bd9a5ab532fe45e370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40794f05e8b94a0f8f087a87a58e0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:07.461153 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-30767b9f-4eda-4db7-8fb6-77afee042cc5 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "GET /compute/v2.1/servers/e010b43a-87fc-43cf-9ab8-6db75becb702" status: 200 len: 1308 microversion: 2.1 time: 0.499241 Aug 27 02:55:07.463065 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1498/2988] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:06 2022] GET /compute/v2.1/servers/e010b43a-87fc-43cf-9ab8-6db75becb702 => generated 1308 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:55:07.482116 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-bb1e48e2-c21c-4bc8-9f06-b69d5571e43d tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:07.483637 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-bb1e48e2-c21c-4bc8-9f06-b69d5571e43d tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 2d6bf535-89e0-4c21-b2cf-fafcf18c4f18] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:07.496234 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bb1e48e2-c21c-4bc8-9f06-b69d5571e43d tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:07.497021 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bb1e48e2-c21c-4bc8-9f06-b69d5571e43d tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:07.497632 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bb1e48e2-c21c-4bc8-9f06-b69d5571e43d tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:07.499185 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bb1e48e2-c21c-4bc8-9f06-b69d5571e43d tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:07.500547 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bb1e48e2-c21c-4bc8-9f06-b69d5571e43d tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:07.501154 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bb1e48e2-c21c-4bc8-9f06-b69d5571e43d tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:07.942396 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-bb1e48e2-c21c-4bc8-9f06-b69d5571e43d tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:07.951578 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-bb1e48e2-c21c-4bc8-9f06-b69d5571e43d tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/2d6bf535-89e0-4c21-b2cf-fafcf18c4f18" status: 200 len: 1314 microversion: 2.1 time: 0.487212 Aug 27 02:55:07.953123 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1499/2989] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:07 2022] GET /compute/v2.1/servers/2d6bf535-89e0-4c21-b2cf-fafcf18c4f18 => generated 1314 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:55:07.989218 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-9639a03e-9235-401f-baa5-0df32fb86b4b tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:07.989848 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-9639a03e-9235-401f-baa5-0df32fb86b4b tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] [instance: b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:07.996025 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9639a03e-9235-401f-baa5-0df32fb86b4b tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:07.996950 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9639a03e-9235-401f-baa5-0df32fb86b4b tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:07.997575 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9639a03e-9235-401f-baa5-0df32fb86b4b tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:07.998485 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9639a03e-9235-401f-baa5-0df32fb86b4b tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:07.999100 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9639a03e-9235-401f-baa5-0df32fb86b4b tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:07.999693 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9639a03e-9235-401f-baa5-0df32fb86b4b tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:08.093989 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-1f97d23a-a4d2-4268-998b-67539c9d9308 tempest-SecurityGroupsTestAdminJSON-305479160 tempest-SecurityGroupsTestAdminJSON-305479160-project] 10.222.0.70 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1113 microversion: 2.1 time: 0.770404 Aug 27 02:55:08.096492 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1491/2990] 10.222.0.70 () {58 vars in 1191 bytes} [Sat Aug 27 02:55:07 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1113 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:55:08.109275 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-971de96a-09f9-4358-9b2f-8d3a8e8a7978 tempest-SecurityGroupsTestAdminJSON-427923122 tempest-SecurityGroupsTestAdminJSON-427923122-project-admin] Calling method '.version_select at 0x7f5ee23f8670>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:08.426731 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-9639a03e-9235-401f-baa5-0df32fb86b4b tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:08.446879 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-9639a03e-9235-401f-baa5-0df32fb86b4b tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:08.454426 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-9639a03e-9235-401f-baa5-0df32fb86b4b tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:08.456499 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-9639a03e-9235-401f-baa5-0df32fb86b4b tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] 10.222.0.70 "GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7" status: 200 len: 1879 microversion: 2.32 time: 0.472914 Aug 27 02:55:08.475097 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1500/2991] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:55:07 2022] GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 => generated 1879 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:55:08.481023 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-561e75a7-93b8-4c4c-b34b-889fab0a30da tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:08.481879 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-561e75a7-93b8-4c4c-b34b-889fab0a30da tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: 1854f7da-898a-4c09-8da9-a69fab19bb71] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:08.488347 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-561e75a7-93b8-4c4c-b34b-889fab0a30da tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:08.489112 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-561e75a7-93b8-4c4c-b34b-889fab0a30da tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:08.489709 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-561e75a7-93b8-4c4c-b34b-889fab0a30da tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:08.490578 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-561e75a7-93b8-4c4c-b34b-889fab0a30da tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:08.491188 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-561e75a7-93b8-4c4c-b34b-889fab0a30da tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:08.492015 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-561e75a7-93b8-4c4c-b34b-889fab0a30da tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:08.671818 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-971de96a-09f9-4358-9b2f-8d3a8e8a7978 tempest-SecurityGroupsTestAdminJSON-427923122 tempest-SecurityGroupsTestAdminJSON-427923122-project-admin] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/633efc09-7ba2-4b16-9a77-023429a7a4fe" status: 202 len: 0 microversion: 2.1 time: 0.566283 Aug 27 02:55:08.677119 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1492/2992] 10.222.0.70 () {58 vars in 1272 bytes} [Sat Aug 27 02:55:08 2022] DELETE /compute/v2.1/os-security-groups/633efc09-7ba2-4b16-9a77-023429a7a4fe => generated 0 bytes in 572 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:55:08.684049 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-7bf298b6-5ae2-4482-ab4f-99f4f2b61c14 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:08.686912 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-7bf298b6-5ae2-4482-ab4f-99f4f2b61c14 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] [instance: e010b43a-87fc-43cf-9ab8-6db75becb702] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:08.711728 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7bf298b6-5ae2-4482-ab4f-99f4f2b61c14 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:08.715108 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7bf298b6-5ae2-4482-ab4f-99f4f2b61c14 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:08.715807 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7bf298b6-5ae2-4482-ab4f-99f4f2b61c14 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:08.718578 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7bf298b6-5ae2-4482-ab4f-99f4f2b61c14 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:08.720176 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7bf298b6-5ae2-4482-ab4f-99f4f2b61c14 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:08.720999 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7bf298b6-5ae2-4482-ab4f-99f4f2b61c14 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:08.885008 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-561e75a7-93b8-4c4c-b34b-889fab0a30da tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:08.897726 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-561e75a7-93b8-4c4c-b34b-889fab0a30da tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/1854f7da-898a-4c09-8da9-a69fab19bb71" status: 200 len: 1489 microversion: 2.1 time: 0.421107 Aug 27 02:55:08.899353 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1501/2993] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:08 2022] GET /compute/v2.1/servers/1854f7da-898a-4c09-8da9-a69fab19bb71 => generated 1489 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:55:08.905284 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7573635f-df54-4797-bc48-647162731012 tempest-SecurityGroupsTestAdminJSON-427923122 tempest-SecurityGroupsTestAdminJSON-427923122-project-admin] Calling method '.version_select at 0x7f5ede2ee790>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:09.080714 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-7bf298b6-5ae2-4482-ab4f-99f4f2b61c14 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f496f24dccea47bd9a5ab532fe45e370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40794f05e8b94a0f8f087a87a58e0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:09.106349 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-7bf298b6-5ae2-4482-ab4f-99f4f2b61c14 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "GET /compute/v2.1/servers/e010b43a-87fc-43cf-9ab8-6db75becb702" status: 200 len: 1308 microversion: 2.1 time: 0.427184 Aug 27 02:55:09.109707 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1493/2994] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:08 2022] GET /compute/v2.1/servers/e010b43a-87fc-43cf-9ab8-6db75becb702 => generated 1308 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:55:09.117537 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-f3a70ed4-8e67-4305-a0cb-1f4e52350262 req-59792e34-ef20-4155-98f0-c87d793880db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7", "tag": "a013082b-68fd-42aa-a18e-2179253e7de6"}, {"name": "network-changed", "server_uuid": "b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7", "tag": "014fb24b-31f0-4751-9df3-1439a144e5d6"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:55:09.130312 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-f3a70ed4-8e67-4305-a0cb-1f4e52350262 req-59792e34-ef20-4155-98f0-c87d793880db service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:09.131572 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-f3a70ed4-8e67-4305-a0cb-1f4e52350262 req-59792e34-ef20-4155-98f0-c87d793880db service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:09.132183 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-f3a70ed4-8e67-4305-a0cb-1f4e52350262 req-59792e34-ef20-4155-98f0-c87d793880db service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:09.153261 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-f3a70ed4-8e67-4305-a0cb-1f4e52350262 req-59792e34-ef20-4155-98f0-c87d793880db service nova] Creating event network-changed:a013082b-68fd-42aa-a18e-2179253e7de6 for instance b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 on n-h2-852278-4 Aug 27 02:55:09.153982 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-f3a70ed4-8e67-4305-a0cb-1f4e52350262 req-59792e34-ef20-4155-98f0-c87d793880db service nova] Creating event network-changed:014fb24b-31f0-4751-9df3-1439a144e5d6 for instance b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 on n-h2-852278-4 Aug 27 02:55:09.161019 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-f3a70ed4-8e67-4305-a0cb-1f4e52350262 req-59792e34-ef20-4155-98f0-c87d793880db service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.049838 Aug 27 02:55:09.161985 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1494/2995] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:55:09 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:55:09.169792 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-2675f51c-2b8c-4af3-bcb9-4fa21fdf4caf tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:09.172816 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-2675f51c-2b8c-4af3-bcb9-4fa21fdf4caf tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: 1854f7da-898a-4c09-8da9-a69fab19bb71] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:09.182832 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2675f51c-2b8c-4af3-bcb9-4fa21fdf4caf tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:09.183540 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2675f51c-2b8c-4af3-bcb9-4fa21fdf4caf tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:09.184334 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2675f51c-2b8c-4af3-bcb9-4fa21fdf4caf tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:09.185223 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2675f51c-2b8c-4af3-bcb9-4fa21fdf4caf tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:09.185834 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2675f51c-2b8c-4af3-bcb9-4fa21fdf4caf tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:09.186418 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2675f51c-2b8c-4af3-bcb9-4fa21fdf4caf tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:09.229191 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-2675f51c-2b8c-4af3-bcb9-4fa21fdf4caf tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: 1854f7da-898a-4c09-8da9-a69fab19bb71] Going to try to terminate instance {{(pid=134052) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:55:09.422947 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-2675f51c-2b8c-4af3-bcb9-4fa21fdf4caf tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "DELETE /compute/v2.1/servers/1854f7da-898a-4c09-8da9-a69fab19bb71" status: 204 len: 0 microversion: 2.1 time: 0.259347 Aug 27 02:55:09.423869 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1495/2996] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:55:09 2022] DELETE /compute/v2.1/servers/1854f7da-898a-4c09-8da9-a69fab19bb71 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:55:09.432064 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0e9fbba1-55b7-4f15-a154-9c6bbf4d9598 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:09.433379 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-0e9fbba1-55b7-4f15-a154-9c6bbf4d9598 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 2d6bf535-89e0-4c21-b2cf-fafcf18c4f18] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:09.450246 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0e9fbba1-55b7-4f15-a154-9c6bbf4d9598 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:09.468719 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0e9fbba1-55b7-4f15-a154-9c6bbf4d9598 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:09.469363 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0e9fbba1-55b7-4f15-a154-9c6bbf4d9598 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:09.470286 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0e9fbba1-55b7-4f15-a154-9c6bbf4d9598 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:09.470870 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0e9fbba1-55b7-4f15-a154-9c6bbf4d9598 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:09.471413 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0e9fbba1-55b7-4f15-a154-9c6bbf4d9598 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:09.694845 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-7573635f-df54-4797-bc48-647162731012 tempest-SecurityGroupsTestAdminJSON-427923122 tempest-SecurityGroupsTestAdminJSON-427923122-project-admin] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/58fb0f93-de4c-4dc3-baf2-da87f898c9da" status: 202 len: 0 microversion: 2.1 time: 0.794206 Aug 27 02:55:09.696104 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1502/2997] 10.222.0.70 () {58 vars in 1272 bytes} [Sat Aug 27 02:55:08 2022] DELETE /compute/v2.1/os-security-groups/58fb0f93-de4c-4dc3-baf2-da87f898c9da => generated 0 bytes in 796 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:55:09.701145 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-338250d2-a72b-48ca-a543-30e4ffd1a9fa req-796657ed-2583-4a99-9fc6-e550eeeb64a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d6bf535-89e0-4c21-b2cf-fafcf18c4f18", "name": "network-vif-plugged", "status": "completed", "tag": "8a321f34-88af-436b-ac87-1009ae5c3dcd"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:55:09.733627 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-338250d2-a72b-48ca-a543-30e4ffd1a9fa req-796657ed-2583-4a99-9fc6-e550eeeb64a1 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:09.734300 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-338250d2-a72b-48ca-a543-30e4ffd1a9fa req-796657ed-2583-4a99-9fc6-e550eeeb64a1 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:09.734913 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-338250d2-a72b-48ca-a543-30e4ffd1a9fa req-796657ed-2583-4a99-9fc6-e550eeeb64a1 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:09.739876 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=100 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:55:09.749467 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-338250d2-a72b-48ca-a543-30e4ffd1a9fa req-796657ed-2583-4a99-9fc6-e550eeeb64a1 service nova] Creating event network-vif-plugged:8a321f34-88af-436b-ac87-1009ae5c3dcd for instance 2d6bf535-89e0-4c21-b2cf-fafcf18c4f18 on n-h2-852278-4 Aug 27 02:55:09.755417 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-338250d2-a72b-48ca-a543-30e4ffd1a9fa req-796657ed-2583-4a99-9fc6-e550eeeb64a1 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057893 Aug 27 02:55:09.756646 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1503/2998] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:55:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:55:09.762473 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-2e88821c-dc11-4eee-938f-684b091e615c tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:09.763476 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-2e88821c-dc11-4eee-938f-684b091e615c tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: 1854f7da-898a-4c09-8da9-a69fab19bb71] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:09.783640 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2e88821c-dc11-4eee-938f-684b091e615c tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:09.784427 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2e88821c-dc11-4eee-938f-684b091e615c tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:09.785047 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2e88821c-dc11-4eee-938f-684b091e615c tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:09.785964 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2e88821c-dc11-4eee-938f-684b091e615c tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:09.786599 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2e88821c-dc11-4eee-938f-684b091e615c tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:09.787192 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2e88821c-dc11-4eee-938f-684b091e615c tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:10.522286 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0e9fbba1-55b7-4f15-a154-9c6bbf4d9598 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:10.531751 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-0e9fbba1-55b7-4f15-a154-9c6bbf4d9598 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/2d6bf535-89e0-4c21-b2cf-fafcf18c4f18" status: 200 len: 1314 microversion: 2.1 time: 1.106359 Aug 27 02:55:10.532582 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1496/2999] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:09 2022] GET /compute/v2.1/servers/2d6bf535-89e0-4c21-b2cf-fafcf18c4f18 => generated 1314 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:55:10.550043 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-829c8d1e-ecb6-4906-a15c-820b7d0aef14 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:10.550987 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-829c8d1e-ecb6-4906-a15c-820b7d0aef14 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] [instance: b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:10.557979 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-829c8d1e-ecb6-4906-a15c-820b7d0aef14 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:10.558866 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-829c8d1e-ecb6-4906-a15c-820b7d0aef14 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:10.559474 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-829c8d1e-ecb6-4906-a15c-820b7d0aef14 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:10.560425 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-829c8d1e-ecb6-4906-a15c-820b7d0aef14 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:10.561053 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-829c8d1e-ecb6-4906-a15c-820b7d0aef14 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:10.561646 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-829c8d1e-ecb6-4906-a15c-820b7d0aef14 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:10.627483 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-2e88821c-dc11-4eee-938f-684b091e615c tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:10.645622 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-2e88821c-dc11-4eee-938f-684b091e615c tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/1854f7da-898a-4c09-8da9-a69fab19bb71" status: 200 len: 1495 microversion: 2.1 time: 0.887366 Aug 27 02:55:10.646817 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1504/3000] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:09 2022] GET /compute/v2.1/servers/1854f7da-898a-4c09-8da9-a69fab19bb71 => generated 1495 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:55:10.653194 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f54df400-677a-43bd-b510-2b417649ed71 tempest-SecurityGroupsTestAdminJSON-305479160 tempest-SecurityGroupsTestAdminJSON-305479160-project] Calling method '.version_select at 0x7f5ede27f430>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:11.026873 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-829c8d1e-ecb6-4906-a15c-820b7d0aef14 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:11.030668 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:55:11.039455 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-829c8d1e-ecb6-4906-a15c-820b7d0aef14 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:11.041399 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-829c8d1e-ecb6-4906-a15c-820b7d0aef14 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:11.042869 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-829c8d1e-ecb6-4906-a15c-820b7d0aef14 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] 10.222.0.70 "GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7" status: 200 len: 1879 microversion: 2.32 time: 0.497001 Aug 27 02:55:11.043728 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1497/3001] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:55:10 2022] GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 => generated 1879 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:55:11.049068 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d9148da4-8bd4-48be-8755-87537e305bb8 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:11.049942 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d9148da4-8bd4-48be-8755-87537e305bb8 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] [instance: e010b43a-87fc-43cf-9ab8-6db75becb702] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:11.057511 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d9148da4-8bd4-48be-8755-87537e305bb8 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:11.058835 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d9148da4-8bd4-48be-8755-87537e305bb8 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:11.061780 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d9148da4-8bd4-48be-8755-87537e305bb8 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:11.061780 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d9148da4-8bd4-48be-8755-87537e305bb8 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:11.062289 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d9148da4-8bd4-48be-8755-87537e305bb8 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:11.062773 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d9148da4-8bd4-48be-8755-87537e305bb8 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:11.403297 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-d9148da4-8bd4-48be-8755-87537e305bb8 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f496f24dccea47bd9a5ab532fe45e370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40794f05e8b94a0f8f087a87a58e0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:11.411365 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d9148da4-8bd4-48be-8755-87537e305bb8 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "GET /compute/v2.1/servers/e010b43a-87fc-43cf-9ab8-6db75becb702" status: 200 len: 1487 microversion: 2.1 time: 0.366246 Aug 27 02:55:11.416038 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1498/3002] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:11 2022] GET /compute/v2.1/servers/e010b43a-87fc-43cf-9ab8-6db75becb702 => generated 1487 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:55:11.421197 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-8bbd8042-1055-493c-a804-d5d665e8b607 req-bc2e4e1b-a87f-49fe-aece-fcb4dae202b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7", "tag": "08d8ee97-a66d-4a1f-8b10-8785838e3d14"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:55:11.471496 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-f54df400-677a-43bd-b510-2b417649ed71 tempest-SecurityGroupsTestAdminJSON-305479160 tempest-SecurityGroupsTestAdminJSON-305479160-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/780f6bd8-03e1-43f6-b624-f271f3c3cd43" status: 202 len: 0 microversion: 2.1 time: 0.822202 Aug 27 02:55:11.472437 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-8bbd8042-1055-493c-a804-d5d665e8b607 req-bc2e4e1b-a87f-49fe-aece-fcb4dae202b8 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:11.473127 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-8bbd8042-1055-493c-a804-d5d665e8b607 req-bc2e4e1b-a87f-49fe-aece-fcb4dae202b8 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:11.474528 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-8bbd8042-1055-493c-a804-d5d665e8b607 req-bc2e4e1b-a87f-49fe-aece-fcb4dae202b8 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:11.475334 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1505/3003] 10.222.0.70 () {58 vars in 1272 bytes} [Sat Aug 27 02:55:10 2022] DELETE /compute/v2.1/os-security-groups/780f6bd8-03e1-43f6-b624-f271f3c3cd43 => generated 0 bytes in 828 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:55:11.485757 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3398005a-5fee-4118-abbc-b9803fd4c57c tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-894468154"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:55:11.491806 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-3398005a-5fee-4118-abbc-b9803fd4c57c tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] [instance: e010b43a-87fc-43cf-9ab8-6db75becb702] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:11.493855 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-8bbd8042-1055-493c-a804-d5d665e8b607 req-bc2e4e1b-a87f-49fe-aece-fcb4dae202b8 service nova] Creating event network-changed:08d8ee97-a66d-4a1f-8b10-8785838e3d14 for instance b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 on n-h2-852278-4 Aug 27 02:55:11.503532 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-8bbd8042-1055-493c-a804-d5d665e8b607 req-bc2e4e1b-a87f-49fe-aece-fcb4dae202b8 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085949 Aug 27 02:55:11.504165 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1499/3004] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:55:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:55:11.557547 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3398005a-5fee-4118-abbc-b9803fd4c57c tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:11.565671 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3398005a-5fee-4118-abbc-b9803fd4c57c tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:11.569816 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3398005a-5fee-4118-abbc-b9803fd4c57c tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:11.583679 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3398005a-5fee-4118-abbc-b9803fd4c57c tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:11.584292 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3398005a-5fee-4118-abbc-b9803fd4c57c tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:11.586609 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3398005a-5fee-4118-abbc-b9803fd4c57c tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:11.950462 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-01e7d636-2385-4413-a60a-ad17526373bc tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-1519278202", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "networks": [{"uuid": "4c2cee58-a572-4c90-95b1-7fcf0787ef51"}]}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:55:12.023923 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.network.neutron [None req-01e7d636-2385-4413-a60a-ad17526373bc tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] validate_networks() for [('4c2cee58-a572-4c90-95b1-7fcf0787ef51', None, None, None, None, None)] {{(pid=134052) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:55:12.115063 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-3398005a-5fee-4118-abbc-b9803fd4c57c tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "POST /compute/v2.1/servers/e010b43a-87fc-43cf-9ab8-6db75becb702/action" status: 202 len: 0 microversion: 2.1 time: 0.636757 Aug 27 02:55:12.116442 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1506/3005] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 02:55:11 2022] POST /compute/v2.1/servers/e010b43a-87fc-43cf-9ab8-6db75becb702/action => generated 0 bytes in 640 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 27 02:55:12.129660 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-cd7fca83-215e-44db-bf3d-57186453bc9f tempest-SecurityGroupsTestAdminJSON-305479160 tempest-SecurityGroupsTestAdminJSON-305479160-project] Calling method '.version_select at 0x7f5ede259550>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:13.003859 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-cd7fca83-215e-44db-bf3d-57186453bc9f tempest-SecurityGroupsTestAdminJSON-305479160 tempest-SecurityGroupsTestAdminJSON-305479160-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/c682f781-d674-49eb-81a7-421dbd7114e7" status: 202 len: 0 microversion: 2.1 time: 0.885962 Aug 27 02:55:13.005732 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1507/3006] 10.222.0.70 () {58 vars in 1272 bytes} [Sat Aug 27 02:55:12 2022] DELETE /compute/v2.1/os-security-groups/c682f781-d674-49eb-81a7-421dbd7114e7 => generated 0 bytes in 888 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:55:13.017730 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4fe8e7a2-3d13-4699-9933-8a78ea477b08 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:13.018706 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-4fe8e7a2-3d13-4699-9933-8a78ea477b08 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 2d6bf535-89e0-4c21-b2cf-fafcf18c4f18] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:13.028990 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4fe8e7a2-3d13-4699-9933-8a78ea477b08 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:13.030109 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4fe8e7a2-3d13-4699-9933-8a78ea477b08 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:13.030741 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4fe8e7a2-3d13-4699-9933-8a78ea477b08 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:13.032158 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4fe8e7a2-3d13-4699-9933-8a78ea477b08 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:13.032803 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4fe8e7a2-3d13-4699-9933-8a78ea477b08 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:13.033556 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4fe8e7a2-3d13-4699-9933-8a78ea477b08 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:13.368663 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-01e7d636-2385-4413-a60a-ad17526373bc tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Flavor limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:55:13.371319 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-01e7d636-2385-4413-a60a-ad17526373bc tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Image limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:55:13.372214 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-01e7d636-2385-4413-a60a-ad17526373bc tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Flavor pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:55:13.372899 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-01e7d636-2385-4413-a60a-ad17526373bc tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Image pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:55:13.373544 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-01e7d636-2385-4413-a60a-ad17526373bc tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:55:13.387441 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-01e7d636-2385-4413-a60a-ad17526373bc tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:13.391419 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-01e7d636-2385-4413-a60a-ad17526373bc tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:13.392115 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-01e7d636-2385-4413-a60a-ad17526373bc tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:13.393274 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-01e7d636-2385-4413-a60a-ad17526373bc tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:13.396008 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-01e7d636-2385-4413-a60a-ad17526373bc tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:13.397553 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-01e7d636-2385-4413-a60a-ad17526373bc tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:13.397826 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-4fe8e7a2-3d13-4699-9933-8a78ea477b08 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:13.407256 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-4fe8e7a2-3d13-4699-9933-8a78ea477b08 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/2d6bf535-89e0-4c21-b2cf-fafcf18c4f18" status: 200 len: 1502 microversion: 2.1 time: 0.398459 Aug 27 02:55:13.420812 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1508/3007] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:13 2022] GET /compute/v2.1/servers/2d6bf535-89e0-4c21-b2cf-fafcf18c4f18 => generated 1502 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:55:13.427216 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-01e7d636-2385-4413-a60a-ad17526373bc tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Getting quotas for project 97f84ee02bd14800bc5a4212a3746e9c. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:55:13.438941 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-01e7d636-2385-4413-a60a-ad17526373bc tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Getting quotas for user 7b8ecf90321841438b77fdceed1e6ca4 and project 97f84ee02bd14800bc5a4212a3746e9c. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:55:13.440055 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-cd7c9dd7-0658-4cf6-b5c2-3fe22c3d42da tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:13.443733 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-cd7c9dd7-0658-4cf6-b5c2-3fe22c3d42da tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: 1854f7da-898a-4c09-8da9-a69fab19bb71] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:13.461410 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cd7c9dd7-0658-4cf6-b5c2-3fe22c3d42da tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:13.469741 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cd7c9dd7-0658-4cf6-b5c2-3fe22c3d42da tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:13.470837 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cd7c9dd7-0658-4cf6-b5c2-3fe22c3d42da tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:13.471905 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cd7c9dd7-0658-4cf6-b5c2-3fe22c3d42da tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:13.472619 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cd7c9dd7-0658-4cf6-b5c2-3fe22c3d42da tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:13.473523 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cd7c9dd7-0658-4cf6-b5c2-3fe22c3d42da tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:13.475814 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-01e7d636-2385-4413-a60a-ad17526373bc tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Going to run 1 instances... {{(pid=134052) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:55:13.478325 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-01e7d636-2385-4413-a60a-ad17526373bc tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] [instance: d93fa48e-eff8-43b7-a1d9-a8199c8c0db9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134052) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:55:13.488954 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-cd7c9dd7-0658-4cf6-b5c2-3fe22c3d42da tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] HTTP exception thrown: Instance 1854f7da-898a-4c09-8da9-a69fab19bb71 could not be found. Aug 27 02:55:13.497203 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-cd7c9dd7-0658-4cf6-b5c2-3fe22c3d42da tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Request method failure captured: Aug 27 02:55:13.497203 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/1854f7da-898a-4c09-8da9-a69fab19bb71 HTTP/1.1 Aug 27 02:55:13.497203 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:55:13.497203 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:55:13.497203 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:55:13.497203 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:55:13.497203 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:55:13.497203 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:55:13.497203 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:55:13.497203 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:55:13.497203 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYZ0St41cKkzS8_oefTYdmhcUQuTjHJMchuX75Wes8eVywW22WD3_nUDa_aMbIFBVV51GGjDa8GDt8SbwEVTMvQnSuXk6MkeKEfB2NWHjFnNKSNKnT9A2S4P8aN7qYWhUsGxW2ugzvIrMVMPtkn5w90KE7af4tlEcxQ5ERFDVU7f32Y Aug 27 02:55:13.497203 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:55:13.497203 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:55:13.497203 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:55:13.497203 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:55:13.497203 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:55:13.497203 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:55:13.497203 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 840077c9375b4b2a9214cb8dda094cc8 Aug 27 02:55:13.497203 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-DeleteServersTestJSON-725615510 Aug 27 02:55:13.497203 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:55:13.497203 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:55:13.497203 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/840077c9375b4b2a9214cb8dda094cc8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_840077c9375b4b2a9214cb8dda094cc8", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/840077c9375b4b2a9214cb8dda094cc8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/840077c9375b4b2a9214cb8dda094cc8"}]}] Aug 27 02:55:13.497203 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-DeleteServersTestJSON-725615510 Aug 27 02:55:13.497203 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 840077c9375b4b2a9214cb8dda094cc8 Aug 27 02:55:13.497203 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-DeleteServersTestJSON-725615510 Aug 27 02:55:13.497203 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-DeleteServersTestJSON-725615510-project Aug 27 02:55:13.497203 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:55:13.497203 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:55:13.497203 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: dc53b0977c2b4e06b2f290442483913b Aug 27 02:55:13.497203 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-DeleteServersTestJSON-725615510-project Aug 27 02:55:13.497203 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 02:55:13.497203 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance 1854f7da-898a-4c09-8da9-a69fab19bb71 could not be found. Aug 27 02:55:13.497203 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '1854f7da-898a-4c09-8da9-a69fab19bb71'} Aug 27 02:55:13.497203 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:55:13.497203 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:13.497203 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:55:13.497203 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:55:13.497203 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:55:13.497203 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:55:13.497203 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:55:13.497203 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:55:13.497203 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:55:13.497203 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:55:13.497203 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1854f7da-898a-4c09-8da9-a69fab19bb71 could not be found. Aug 27 02:55:13.497203 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:55:13.497203 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:55:13.497203 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:55:13.497203 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:13.497203 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:55:13.497203 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:55:13.497203 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:55:13.497203 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:55:13.497203 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:55:13.497203 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:55:13.497203 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:55:13.497203 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:55:13.497203 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:55:13.497203 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:55:13.497203 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:55:13.497203 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:55:13.497203 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1854f7da-898a-4c09-8da9-a69fab19bb71 could not be found. Aug 27 02:55:13.497203 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:55:13.497203 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:55:13.497203 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:55:13.503613 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:13.503613 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:55:13.503613 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:55:13.503613 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:55:13.503613 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:55:13.503613 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1854f7da-898a-4c09-8da9-a69fab19bb71 could not be found. Aug 27 02:55:13.503613 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:55:13.506533 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-cd7c9dd7-0658-4cf6-b5c2-3fe22c3d42da tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Returning 404 to user: Instance 1854f7da-898a-4c09-8da9-a69fab19bb71 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:55:13.507683 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-cd7c9dd7-0658-4cf6-b5c2-3fe22c3d42da tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/1854f7da-898a-4c09-8da9-a69fab19bb71" status: 404 len: 111 microversion: 2.1 time: 0.079605 Aug 27 02:55:13.508353 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1509/3008] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:13 2022] GET /compute/v2.1/servers/1854f7da-898a-4c09-8da9-a69fab19bb71 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:55:13.523910 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-21ac8133-41dd-4940-a4b4-f6191c32a375 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:13.524666 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-21ac8133-41dd-4940-a4b4-f6191c32a375 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] [instance: b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:13.535521 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-21ac8133-41dd-4940-a4b4-f6191c32a375 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:13.536333 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-21ac8133-41dd-4940-a4b4-f6191c32a375 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:13.536969 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-21ac8133-41dd-4940-a4b4-f6191c32a375 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:13.540648 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-21ac8133-41dd-4940-a4b4-f6191c32a375 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:13.541438 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-21ac8133-41dd-4940-a4b4-f6191c32a375 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:13.542325 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-21ac8133-41dd-4940-a4b4-f6191c32a375 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:13.635046 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-01e7d636-2385-4413-a60a-ad17526373bc tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.124900 Aug 27 02:55:13.636519 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1500/3009] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 02:55:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 2132 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:55:13.641639 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5fa374ca-d65d-4681-b264-5e81126b71b1 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '.version_select at 0x7f5ee23f20d0>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:13.742281 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-5fa374ca-d65d-4681-b264-5e81126b71b1 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "GET /compute/v2.1/images/8baba1db-6138-47bf-92d9-193ba402a494" status: 200 len: 1411 microversion: 2.1 time: 0.104423 Aug 27 02:55:13.751316 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1501/3010] 10.222.0.70 () {58 vars in 1233 bytes} [Sat Aug 27 02:55:13 2022] GET /compute/v2.1/images/8baba1db-6138-47bf-92d9-193ba402a494 => generated 1411 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:55:13.753935 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-5eda91ff-3102-4acc-b676-9f0120ab3fda req-c0b0cca7-9df0-48ee-b4af-950317a35060 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1854f7da-898a-4c09-8da9-a69fab19bb71", "name": "network-vif-deleted", "tag": "10ed780f-6187-49a9-a5a1-880bcba4e477"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:55:13.783441 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-5eda91ff-3102-4acc-b676-9f0120ab3fda req-c0b0cca7-9df0-48ee-b4af-950317a35060 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:13.783931 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-5eda91ff-3102-4acc-b676-9f0120ab3fda req-c0b0cca7-9df0-48ee-b4af-950317a35060 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:13.788867 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-5eda91ff-3102-4acc-b676-9f0120ab3fda req-c0b0cca7-9df0-48ee-b4af-950317a35060 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:13.813612 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-5eda91ff-3102-4acc-b676-9f0120ab3fda req-c0b0cca7-9df0-48ee-b4af-950317a35060 service nova] Creating event network-vif-deleted:10ed780f-6187-49a9-a5a1-880bcba4e477 for instance 1854f7da-898a-4c09-8da9-a69fab19bb71 on n-h1-852278-4 Aug 27 02:55:13.831799 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-5eda91ff-3102-4acc-b676-9f0120ab3fda req-c0b0cca7-9df0-48ee-b4af-950317a35060 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087210 Aug 27 02:55:13.834008 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1502/3011] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:55:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:55:13.842685 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-06397ce3-5e1b-4d7f-b63b-f1c8e0ce9af1 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:55:13.846803 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-06397ce3-5e1b-4d7f-b63b-f1c8e0ce9af1 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 2d6bf535-89e0-4c21-b2cf-fafcf18c4f18] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:13.878596 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-06397ce3-5e1b-4d7f-b63b-f1c8e0ce9af1 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:13.879155 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-06397ce3-5e1b-4d7f-b63b-f1c8e0ce9af1 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:13.879664 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-06397ce3-5e1b-4d7f-b63b-f1c8e0ce9af1 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:13.881015 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-06397ce3-5e1b-4d7f-b63b-f1c8e0ce9af1 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:13.881479 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-06397ce3-5e1b-4d7f-b63b-f1c8e0ce9af1 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:13.882167 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-06397ce3-5e1b-4d7f-b63b-f1c8e0ce9af1 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:13.975068 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-06397ce3-5e1b-4d7f-b63b-f1c8e0ce9af1 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "POST /compute/v2.1/servers/2d6bf535-89e0-4c21-b2cf-fafcf18c4f18/action" status: 200 len: 14 microversion: 2.1 time: 0.138790 Aug 27 02:55:13.976267 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1503/3012] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 02:55:13 2022] POST /compute/v2.1/servers/2d6bf535-89e0-4c21-b2cf-fafcf18c4f18/action => generated 14 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:55:13.984435 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-bc03b203-075c-40dd-a15b-de1ef2a5c8c9 req-59d41a9e-f537-4cf2-9985-af7b0ebc8214 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7", "tag": "07494d6f-38b9-4b8b-930b-4c4d1abbc8b1"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:55:14.016930 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-bc03b203-075c-40dd-a15b-de1ef2a5c8c9 req-59d41a9e-f537-4cf2-9985-af7b0ebc8214 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:14.017431 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-bc03b203-075c-40dd-a15b-de1ef2a5c8c9 req-59d41a9e-f537-4cf2-9985-af7b0ebc8214 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:14.017932 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-bc03b203-075c-40dd-a15b-de1ef2a5c8c9 req-59d41a9e-f537-4cf2-9985-af7b0ebc8214 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:14.051697 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-bc03b203-075c-40dd-a15b-de1ef2a5c8c9 req-59d41a9e-f537-4cf2-9985-af7b0ebc8214 service nova] Creating event network-changed:07494d6f-38b9-4b8b-930b-4c4d1abbc8b1 for instance b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 on n-h2-852278-4 Aug 27 02:55:14.057595 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-bc03b203-075c-40dd-a15b-de1ef2a5c8c9 req-59d41a9e-f537-4cf2-9985-af7b0ebc8214 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079770 Aug 27 02:55:14.058211 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1504/3013] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:55:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:55:14.065776 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-78f85687-3346-4336-852f-f2b8f7437913 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:14.066765 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-78f85687-3346-4336-852f-f2b8f7437913 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] [instance: d93fa48e-eff8-43b7-a1d9-a8199c8c0db9] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:14.158041 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-21ac8133-41dd-4940-a4b4-f6191c32a375 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:14.173434 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-21ac8133-41dd-4940-a4b4-f6191c32a375 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:14.175193 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-21ac8133-41dd-4940-a4b4-f6191c32a375 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:14.176779 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-21ac8133-41dd-4940-a4b4-f6191c32a375 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] 10.222.0.70 "GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7" status: 200 len: 1879 microversion: 2.32 time: 0.666935 Aug 27 02:55:14.178929 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1510/3014] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:55:13 2022] GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 => generated 1879 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:55:14.183677 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d756917e-9b54-4f6b-8d57-b414a3ed1c43 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-910897428", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "networks": [{"uuid": "9f81fa4d-d0d4-411f-b6ce-c99b22cb14d3"}]}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:55:14.266749 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-78f85687-3346-4336-852f-f2b8f7437913 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8ecf90321841438b77fdceed1e6ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f84ee02bd14800bc5a4212a3746e9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:14.285518 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.network.neutron [None req-d756917e-9b54-4f6b-8d57-b414a3ed1c43 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] validate_networks() for [('9f81fa4d-d0d4-411f-b6ce-c99b22cb14d3', None, None, None, None, None)] {{(pid=134051) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:55:14.301515 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-78f85687-3346-4336-852f-f2b8f7437913 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] 10.222.0.70 "GET /compute/v2.1/servers/d93fa48e-eff8-43b7-a1d9-a8199c8c0db9" status: 200 len: 1217 microversion: 2.1 time: 0.237925 Aug 27 02:55:14.315515 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1505/3015] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:14 2022] GET /compute/v2.1/servers/d93fa48e-eff8-43b7-a1d9-a8199c8c0db9 => generated 1217 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:55:14.325823 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-eb78c8e1-1fc8-4407-9bf9-99ce62506d41 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '.version_select at 0x7f5ee24dd3a0>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:14.412372 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-eb78c8e1-1fc8-4407-9bf9-99ce62506d41 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "GET /compute/v2.1/images/8baba1db-6138-47bf-92d9-193ba402a494" status: 200 len: 1411 microversion: 2.1 time: 0.092787 Aug 27 02:55:14.413055 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1506/3016] 10.222.0.70 () {58 vars in 1233 bytes} [Sat Aug 27 02:55:14 2022] GET /compute/v2.1/images/8baba1db-6138-47bf-92d9-193ba402a494 => generated 1411 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:55:14.435306 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-28237ade-1aa0-44d8-8952-92e3d22322e9 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '.version_select at 0x7f5ee23d4790>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:14.661315 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-28237ade-1aa0-44d8-8952-92e3d22322e9 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "DELETE /compute/v2.1/images/8baba1db-6138-47bf-92d9-193ba402a494" status: 204 len: 0 microversion: 2.1 time: 0.235979 Aug 27 02:55:14.661903 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1507/3017] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:14 2022] DELETE /compute/v2.1/images/8baba1db-6138-47bf-92d9-193ba402a494 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:55:14.670440 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4d741cad-7e18-46a7-b815-df5960a31589 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '.version_select at 0x7f5ee251e670>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:14.703830 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-4d741cad-7e18-46a7-b815-df5960a31589 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] HTTP exception thrown: Image not found. Aug 27 02:55:14.706001 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4d741cad-7e18-46a7-b815-df5960a31589 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Request method failure captured: Aug 27 02:55:14.706001 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/images/8baba1db-6138-47bf-92d9-193ba402a494 HTTP/1.1 Aug 27 02:55:14.706001 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:55:14.706001 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:55:14.706001 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:55:14.706001 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:55:14.706001 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:55:14.706001 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:55:14.706001 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:55:14.706001 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:55:14.706001 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYa6jxAiv7Ivf74NMfGucxC3HYIS_vYIE1pGlCTUoC-crVbgzy-AQHAL3xArrXAQuFmegXJQKx-G4la5NLXFH_vNd7fLPXuTxEw83W4WlqVhcgrHmCBlkbsMADCHeHlOC-QOBAgwbAsOYbs6cq6dqQxwMDcgtdeGEOfB2nhchgJ7ZEU Aug 27 02:55:14.706001 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:55:14.706001 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:55:14.706001 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:55:14.706001 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:55:14.706001 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:55:14.706001 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:55:14.706001 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 40794f05e8b94a0f8f087a87a58e0ba1 Aug 27 02:55:14.706001 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ImagesTestJSON-345203415 Aug 27 02:55:14.706001 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:55:14.706001 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:55:14.706001 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/40794f05e8b94a0f8f087a87a58e0ba1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_40794f05e8b94a0f8f087a87a58e0ba1", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/40794f05e8b94a0f8f087a87a58e0ba1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/40794f05e8b94a0f8f087a87a58e0ba1"}]}] Aug 27 02:55:14.706001 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ImagesTestJSON-345203415 Aug 27 02:55:14.706001 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 40794f05e8b94a0f8f087a87a58e0ba1 Aug 27 02:55:14.706001 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ImagesTestJSON-345203415 Aug 27 02:55:14.706001 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ImagesTestJSON-345203415-project Aug 27 02:55:14.706001 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:55:14.706001 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:55:14.706001 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: f496f24dccea47bd9a5ab532fe45e370 Aug 27 02:55:14.706001 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ImagesTestJSON-345203415-project Aug 27 02:55:14.706001 n-d-852278-4 devstack@n-api.service[134052]: method: Aug 27 02:55:14.706001 n-d-852278-4 devstack@n-api.service[134052]: exception: Image not found. Aug 27 02:55:14.706001 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '8baba1db-6138-47bf-92d9-193ba402a494'} Aug 27 02:55:14.706001 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:55:14.706001 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:14.706001 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 02:55:14.706001 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 02:55:14.706001 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 02:55:14.706001 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 02:55:14.706001 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 02:55:14.706001 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 02:55:14.706001 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 02:55:14.706001 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 02:55:14.706001 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 02:55:14.706001 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 02:55:14.706001 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 02:55:14.706001 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 02:55:14.706001 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 02:55:14.706001 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 02:55:14.706001 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 02:55:14.706001 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 02:55:14.706001 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 8baba1db-6138-47bf-92d9-193ba402a494 Aug 27 02:55:14.706001 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:14.706001 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:55:14.706001 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:14.706001 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:14.706001 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 27 02:55:14.706001 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 27 02:55:14.706001 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 27 02:55:14.706001 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 27 02:55:14.706001 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 27 02:55:14.706001 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 27 02:55:14.706001 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 27 02:55:14.706001 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 27 02:55:14.711286 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 02:55:14.711286 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 02:55:14.711286 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 02:55:14.711286 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 02:55:14.711286 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 02:55:14.711286 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 02:55:14.711286 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 02:55:14.711286 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 02:55:14.711286 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 02:55:14.711286 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 02:55:14.711286 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 02:55:14.711286 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 02:55:14.711286 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 02:55:14.711286 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 02:55:14.711286 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 02:55:14.711286 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 02:55:14.711286 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8baba1db-6138-47bf-92d9-193ba402a494 could not be found. Aug 27 02:55:14.711286 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:14.711286 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:55:14.711286 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:14.711286 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:14.711286 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:55:14.711286 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:55:14.711286 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:55:14.711286 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:55:14.711286 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:55:14.711286 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:55:14.711286 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:55:14.711286 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:55:14.711286 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 27 02:55:14.711286 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 27 02:55:14.711286 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 02:55:14.711286 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:14.711286 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:55:14.711286 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:14.711286 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:14.711286 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:55:14.711286 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:55:14.711286 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:55:14.711286 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:55:14.711286 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 02:55:14.711286 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:14.711286 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4d741cad-7e18-46a7-b815-df5960a31589 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Returning 404 to user: Image not found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:55:14.717590 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-4d741cad-7e18-46a7-b815-df5960a31589 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "GET /compute/v2.1/images/8baba1db-6138-47bf-92d9-193ba402a494" status: 404 len: 62 microversion: 2.1 time: 0.045201 Aug 27 02:55:14.717590 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1508/3018] 10.222.0.70 () {58 vars in 1233 bytes} [Sat Aug 27 02:55:14 2022] GET /compute/v2.1/images/8baba1db-6138-47bf-92d9-193ba402a494 => generated 62 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 27 02:55:14.721922 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-aeda76a3-a0c9-4665-bd37-2302632aa0ff tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:14.722540 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-aeda76a3-a0c9-4665-bd37-2302632aa0ff tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] [instance: e010b43a-87fc-43cf-9ab8-6db75becb702] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:14.737146 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:55:14.739749 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-aeda76a3-a0c9-4665-bd37-2302632aa0ff tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:14.740247 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-aeda76a3-a0c9-4665-bd37-2302632aa0ff tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:14.742893 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-aeda76a3-a0c9-4665-bd37-2302632aa0ff tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:14.745471 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-aeda76a3-a0c9-4665-bd37-2302632aa0ff tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:14.746011 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-aeda76a3-a0c9-4665-bd37-2302632aa0ff tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:14.748865 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-aeda76a3-a0c9-4665-bd37-2302632aa0ff tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:15.627816 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-aeda76a3-a0c9-4665-bd37-2302632aa0ff tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f496f24dccea47bd9a5ab532fe45e370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40794f05e8b94a0f8f087a87a58e0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:15.640612 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-aeda76a3-a0c9-4665-bd37-2302632aa0ff tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "GET /compute/v2.1/servers/e010b43a-87fc-43cf-9ab8-6db75becb702" status: 200 len: 1505 microversion: 2.1 time: 0.920635 Aug 27 02:55:15.641245 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1509/3019] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:14 2022] GET /compute/v2.1/servers/e010b43a-87fc-43cf-9ab8-6db75becb702 => generated 1505 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:55:15.658378 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c1d2e3ca-cb07-4369-9485-90d398862b09 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:55:15.661039 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-c1d2e3ca-cb07-4369-9485-90d398862b09 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 2d6bf535-89e0-4c21-b2cf-fafcf18c4f18] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:15.670593 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c1d2e3ca-cb07-4369-9485-90d398862b09 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:15.671080 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c1d2e3ca-cb07-4369-9485-90d398862b09 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:15.671568 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c1d2e3ca-cb07-4369-9485-90d398862b09 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:15.672281 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c1d2e3ca-cb07-4369-9485-90d398862b09 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:15.672754 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c1d2e3ca-cb07-4369-9485-90d398862b09 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:15.673170 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c1d2e3ca-cb07-4369-9485-90d398862b09 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:15.696602 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-d756917e-9b54-4f6b-8d57-b414a3ed1c43 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Flavor limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:55:15.697048 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-d756917e-9b54-4f6b-8d57-b414a3ed1c43 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Image limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:55:15.697474 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-d756917e-9b54-4f6b-8d57-b414a3ed1c43 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Flavor pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:55:15.697925 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-d756917e-9b54-4f6b-8d57-b414a3ed1c43 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Image pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:55:15.698262 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-d756917e-9b54-4f6b-8d57-b414a3ed1c43 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:55:15.703027 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:55:15.709791 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d756917e-9b54-4f6b-8d57-b414a3ed1c43 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:15.711377 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d756917e-9b54-4f6b-8d57-b414a3ed1c43 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:15.712204 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d756917e-9b54-4f6b-8d57-b414a3ed1c43 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:15.714018 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d756917e-9b54-4f6b-8d57-b414a3ed1c43 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:15.714779 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d756917e-9b54-4f6b-8d57-b414a3ed1c43 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:15.715528 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d756917e-9b54-4f6b-8d57-b414a3ed1c43 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:15.745003 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c1d2e3ca-cb07-4369-9485-90d398862b09 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "POST /compute/v2.1/servers/2d6bf535-89e0-4c21-b2cf-fafcf18c4f18/action" status: 200 len: 14 microversion: 2.1 time: 0.102288 Aug 27 02:55:15.748874 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1510/3020] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 02:55:15 2022] POST /compute/v2.1/servers/2d6bf535-89e0-4c21-b2cf-fafcf18c4f18/action => generated 14 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:55:15.761591 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-12dae327-d874-4569-91b8-f2ad2530e224 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:15.762315 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-12dae327-d874-4569-91b8-f2ad2530e224 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] [instance: b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:15.762816 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-d756917e-9b54-4f6b-8d57-b414a3ed1c43 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Getting quotas for project 840077c9375b4b2a9214cb8dda094cc8. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:55:15.776696 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-d756917e-9b54-4f6b-8d57-b414a3ed1c43 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Getting quotas for user dc53b0977c2b4e06b2f290442483913b and project 840077c9375b4b2a9214cb8dda094cc8. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:55:15.780135 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-12dae327-d874-4569-91b8-f2ad2530e224 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:15.780702 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-12dae327-d874-4569-91b8-f2ad2530e224 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:15.781335 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-12dae327-d874-4569-91b8-f2ad2530e224 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:15.782226 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-12dae327-d874-4569-91b8-f2ad2530e224 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:15.782901 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-12dae327-d874-4569-91b8-f2ad2530e224 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:15.783676 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-12dae327-d874-4569-91b8-f2ad2530e224 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:15.809380 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d756917e-9b54-4f6b-8d57-b414a3ed1c43 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Going to run 1 instances... {{(pid=134051) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:55:15.816296 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d756917e-9b54-4f6b-8d57-b414a3ed1c43 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: cafa2fd0-80bd-413c-a7ae-4cb7b3c2a573] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134051) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:55:15.925801 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d756917e-9b54-4f6b-8d57-b414a3ed1c43 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.745938 Aug 27 02:55:15.932002 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1511/3021] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 02:55:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1753 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:55:15.945410 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e5bc2c7f-db2a-4a91-b94c-69850a70dcc5 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:15.946036 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-e5bc2c7f-db2a-4a91-b94c-69850a70dcc5 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] [instance: d93fa48e-eff8-43b7-a1d9-a8199c8c0db9] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:15.967073 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e5bc2c7f-db2a-4a91-b94c-69850a70dcc5 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:15.967580 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e5bc2c7f-db2a-4a91-b94c-69850a70dcc5 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:15.969956 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e5bc2c7f-db2a-4a91-b94c-69850a70dcc5 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:15.970707 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e5bc2c7f-db2a-4a91-b94c-69850a70dcc5 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:15.972356 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e5bc2c7f-db2a-4a91-b94c-69850a70dcc5 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:15.972784 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e5bc2c7f-db2a-4a91-b94c-69850a70dcc5 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:16.157882 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-12dae327-d874-4569-91b8-f2ad2530e224 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:16.174615 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e5bc2c7f-db2a-4a91-b94c-69850a70dcc5 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8ecf90321841438b77fdceed1e6ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f84ee02bd14800bc5a4212a3746e9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:16.185141 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-12dae327-d874-4569-91b8-f2ad2530e224 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:16.187139 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-12dae327-d874-4569-91b8-f2ad2530e224 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:16.188683 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e5bc2c7f-db2a-4a91-b94c-69850a70dcc5 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] 10.222.0.70 "GET /compute/v2.1/servers/d93fa48e-eff8-43b7-a1d9-a8199c8c0db9" status: 200 len: 1275 microversion: 2.1 time: 0.254940 Aug 27 02:55:16.190531 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1512/3022] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:15 2022] GET /compute/v2.1/servers/d93fa48e-eff8-43b7-a1d9-a8199c8c0db9 => generated 1275 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:55:16.192139 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-12dae327-d874-4569-91b8-f2ad2530e224 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] 10.222.0.70 "GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7" status: 200 len: 1879 microversion: 2.32 time: 0.443154 Aug 27 02:55:16.207334 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1511/3023] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:55:15 2022] GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 => generated 1879 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:55:16.209316 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-33448e8c-80bf-4a5f-9707-143ef4b1479c tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:16.210685 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-33448e8c-80bf-4a5f-9707-143ef4b1479c tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: cafa2fd0-80bd-413c-a7ae-4cb7b3c2a573] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:16.307306 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-33448e8c-80bf-4a5f-9707-143ef4b1479c tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:16.319850 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-33448e8c-80bf-4a5f-9707-143ef4b1479c tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/cafa2fd0-80bd-413c-a7ae-4cb7b3c2a573" status: 200 len: 1214 microversion: 2.1 time: 0.126274 Aug 27 02:55:16.322588 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1513/3024] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:16 2022] GET /compute/v2.1/servers/cafa2fd0-80bd-413c-a7ae-4cb7b3c2a573 => generated 1214 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:55:16.661685 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5fa2b933-88a1-4554-9a47-5969da50cf82 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:16.662948 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-5fa2b933-88a1-4554-9a47-5969da50cf82 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] [instance: e010b43a-87fc-43cf-9ab8-6db75becb702] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:16.673001 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5fa2b933-88a1-4554-9a47-5969da50cf82 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:16.678500 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5fa2b933-88a1-4554-9a47-5969da50cf82 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:16.678941 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5fa2b933-88a1-4554-9a47-5969da50cf82 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:16.679683 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5fa2b933-88a1-4554-9a47-5969da50cf82 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:16.681390 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5fa2b933-88a1-4554-9a47-5969da50cf82 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:16.681826 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5fa2b933-88a1-4554-9a47-5969da50cf82 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:16.760211 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-5d634f2f-c14d-4d26-ace3-936262f39841 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:55:16.763131 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-5d634f2f-c14d-4d26-ace3-936262f39841 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 2d6bf535-89e0-4c21-b2cf-fafcf18c4f18] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:16.783177 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5d634f2f-c14d-4d26-ace3-936262f39841 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:16.784945 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5d634f2f-c14d-4d26-ace3-936262f39841 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:16.786158 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5d634f2f-c14d-4d26-ace3-936262f39841 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:16.788252 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5d634f2f-c14d-4d26-ace3-936262f39841 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:16.792171 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5d634f2f-c14d-4d26-ace3-936262f39841 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:16.792979 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5d634f2f-c14d-4d26-ace3-936262f39841 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:16.863110 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-5d634f2f-c14d-4d26-ace3-936262f39841 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "POST /compute/v2.1/servers/2d6bf535-89e0-4c21-b2cf-fafcf18c4f18/action" status: 200 len: 14 microversion: 2.1 time: 0.107059 Aug 27 02:55:16.864398 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1514/3025] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 02:55:16 2022] POST /compute/v2.1/servers/2d6bf535-89e0-4c21-b2cf-fafcf18c4f18/action => generated 14 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:55:17.068734 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-5fa2b933-88a1-4554-9a47-5969da50cf82 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f496f24dccea47bd9a5ab532fe45e370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40794f05e8b94a0f8f087a87a58e0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:17.086501 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-5fa2b933-88a1-4554-9a47-5969da50cf82 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "GET /compute/v2.1/servers/e010b43a-87fc-43cf-9ab8-6db75becb702" status: 200 len: 1487 microversion: 2.1 time: 0.428646 Aug 27 02:55:17.088224 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1512/3026] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:16 2022] GET /compute/v2.1/servers/e010b43a-87fc-43cf-9ab8-6db75becb702 => generated 1487 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:55:17.110447 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e3c9e707-1b33-44be-bd47-bf5b45fe5388 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:17.111355 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-e3c9e707-1b33-44be-bd47-bf5b45fe5388 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] [instance: e010b43a-87fc-43cf-9ab8-6db75becb702] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:17.125634 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e3c9e707-1b33-44be-bd47-bf5b45fe5388 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:17.126561 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e3c9e707-1b33-44be-bd47-bf5b45fe5388 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:17.127163 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e3c9e707-1b33-44be-bd47-bf5b45fe5388 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:17.128866 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e3c9e707-1b33-44be-bd47-bf5b45fe5388 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:17.129495 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e3c9e707-1b33-44be-bd47-bf5b45fe5388 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:17.130081 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e3c9e707-1b33-44be-bd47-bf5b45fe5388 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:17.202437 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-e3c9e707-1b33-44be-bd47-bf5b45fe5388 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] [instance: e010b43a-87fc-43cf-9ab8-6db75becb702] Going to try to terminate instance {{(pid=134051) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:55:17.214177 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8126e317-28fe-4cf7-8d06-44136aa9d9f9 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:17.215555 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-8126e317-28fe-4cf7-8d06-44136aa9d9f9 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] [instance: d93fa48e-eff8-43b7-a1d9-a8199c8c0db9] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:17.227460 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8126e317-28fe-4cf7-8d06-44136aa9d9f9 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:17.228668 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8126e317-28fe-4cf7-8d06-44136aa9d9f9 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:17.231326 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8126e317-28fe-4cf7-8d06-44136aa9d9f9 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:17.237645 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8126e317-28fe-4cf7-8d06-44136aa9d9f9 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:17.239659 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8126e317-28fe-4cf7-8d06-44136aa9d9f9 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:17.240147 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8126e317-28fe-4cf7-8d06-44136aa9d9f9 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:17.311961 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e3c9e707-1b33-44be-bd47-bf5b45fe5388 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "DELETE /compute/v2.1/servers/e010b43a-87fc-43cf-9ab8-6db75becb702" status: 204 len: 0 microversion: 2.1 time: 0.204372 Aug 27 02:55:17.313244 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1515/3027] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:55:17 2022] DELETE /compute/v2.1/servers/e010b43a-87fc-43cf-9ab8-6db75becb702 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:55:17.323412 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7af62c63-7f0b-4e39-a2c3-b337aef7f7c5 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:17.324627 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-7af62c63-7f0b-4e39-a2c3-b337aef7f7c5 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] [instance: b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:17.331281 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7af62c63-7f0b-4e39-a2c3-b337aef7f7c5 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:17.332211 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7af62c63-7f0b-4e39-a2c3-b337aef7f7c5 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:17.332898 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7af62c63-7f0b-4e39-a2c3-b337aef7f7c5 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:17.333899 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7af62c63-7f0b-4e39-a2c3-b337aef7f7c5 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:17.334566 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7af62c63-7f0b-4e39-a2c3-b337aef7f7c5 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:17.335343 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7af62c63-7f0b-4e39-a2c3-b337aef7f7c5 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:17.373328 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-8126e317-28fe-4cf7-8d06-44136aa9d9f9 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8ecf90321841438b77fdceed1e6ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f84ee02bd14800bc5a4212a3746e9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:17.386502 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-8126e317-28fe-4cf7-8d06-44136aa9d9f9 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] 10.222.0.70 "GET /compute/v2.1/servers/d93fa48e-eff8-43b7-a1d9-a8199c8c0db9" status: 200 len: 1275 microversion: 2.1 time: 0.178023 Aug 27 02:55:17.399268 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1513/3028] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:17 2022] GET /compute/v2.1/servers/d93fa48e-eff8-43b7-a1d9-a8199c8c0db9 => generated 1275 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:55:17.420082 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a9adc4d3-ee65-4ad5-bade-2ccf84fcf82b tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '.version_select at 0x7f5ee2419790>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:17.474386 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-a9adc4d3-ee65-4ad5-bade-2ccf84fcf82b tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] HTTP exception thrown: Image not found. Aug 27 02:55:17.476876 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a9adc4d3-ee65-4ad5-bade-2ccf84fcf82b tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Request method failure captured: Aug 27 02:55:17.476876 n-d-852278-4 devstack@n-api.service[134052]: request: DELETE /compute/v2.1/images/8baba1db-6138-47bf-92d9-193ba402a494 HTTP/1.1 Aug 27 02:55:17.476876 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:55:17.476876 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:55:17.476876 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:55:17.476876 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:55:17.476876 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:55:17.476876 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:55:17.476876 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:55:17.476876 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:55:17.476876 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYa6jxAiv7Ivf74NMfGucxC3HYIS_vYIE1pGlCTUoC-crVbgzy-AQHAL3xArrXAQuFmegXJQKx-G4la5NLXFH_vNd7fLPXuTxEw83W4WlqVhcgrHmCBlkbsMADCHeHlOC-QOBAgwbAsOYbs6cq6dqQxwMDcgtdeGEOfB2nhchgJ7ZEU Aug 27 02:55:17.476876 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:55:17.476876 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:55:17.476876 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:55:17.476876 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:55:17.476876 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:55:17.476876 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:55:17.476876 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 40794f05e8b94a0f8f087a87a58e0ba1 Aug 27 02:55:17.476876 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ImagesTestJSON-345203415 Aug 27 02:55:17.476876 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:55:17.476876 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:55:17.476876 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/40794f05e8b94a0f8f087a87a58e0ba1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_40794f05e8b94a0f8f087a87a58e0ba1", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/40794f05e8b94a0f8f087a87a58e0ba1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/40794f05e8b94a0f8f087a87a58e0ba1"}]}] Aug 27 02:55:17.476876 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ImagesTestJSON-345203415 Aug 27 02:55:17.476876 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 40794f05e8b94a0f8f087a87a58e0ba1 Aug 27 02:55:17.476876 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ImagesTestJSON-345203415 Aug 27 02:55:17.476876 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ImagesTestJSON-345203415-project Aug 27 02:55:17.476876 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:55:17.476876 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:55:17.476876 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: f496f24dccea47bd9a5ab532fe45e370 Aug 27 02:55:17.476876 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ImagesTestJSON-345203415-project Aug 27 02:55:17.476876 n-d-852278-4 devstack@n-api.service[134052]: method: Aug 27 02:55:17.476876 n-d-852278-4 devstack@n-api.service[134052]: exception: Image not found. Aug 27 02:55:17.476876 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '8baba1db-6138-47bf-92d9-193ba402a494'} Aug 27 02:55:17.476876 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:55:17.476876 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:17.476876 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 27 02:55:17.476876 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 27 02:55:17.476876 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 02:55:17.476876 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 02:55:17.476876 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 02:55:17.476876 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 02:55:17.476876 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 27 02:55:17.476876 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 27 02:55:17.476876 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 27 02:55:17.476876 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 27 02:55:17.476876 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 02:55:17.476876 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 02:55:17.476876 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 02:55:17.476876 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 02:55:17.476876 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 8baba1db-6138-47bf-92d9-193ba402a494 to delete Aug 27 02:55:17.476876 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:17.476876 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:55:17.476876 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:17.476876 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:17.476876 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 27 02:55:17.476876 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 27 02:55:17.476876 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 27 02:55:17.476876 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 27 02:55:17.476876 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 27 02:55:17.476876 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 27 02:55:17.476876 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8baba1db-6138-47bf-92d9-193ba402a494 could not be found. Aug 27 02:55:17.476876 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:17.476876 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:55:17.476876 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:17.476876 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:17.486094 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:55:17.486094 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:55:17.486094 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:55:17.486094 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:55:17.486094 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:55:17.486094 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:55:17.486094 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:55:17.486094 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:55:17.486094 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 27 02:55:17.486094 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 27 02:55:17.486094 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 02:55:17.486094 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:17.486094 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:55:17.486094 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:17.486094 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:17.486094 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:55:17.486094 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:55:17.486094 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:55:17.486094 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:55:17.486094 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 02:55:17.486094 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:17.486094 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a9adc4d3-ee65-4ad5-bade-2ccf84fcf82b tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Returning 404 to user: Image not found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:55:17.486094 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a9adc4d3-ee65-4ad5-bade-2ccf84fcf82b tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "DELETE /compute/v2.1/images/8baba1db-6138-47bf-92d9-193ba402a494" status: 404 len: 62 microversion: 2.1 time: 0.078409 Aug 27 02:55:17.486094 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1514/3029] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:17 2022] DELETE /compute/v2.1/images/8baba1db-6138-47bf-92d9-193ba402a494 => generated 62 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 02:55:17.490717 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-04a6f24b-9d79-4655-a6fe-f56786469e97 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:17.492041 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-04a6f24b-9d79-4655-a6fe-f56786469e97 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: cafa2fd0-80bd-413c-a7ae-4cb7b3c2a573] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:17.509864 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-04a6f24b-9d79-4655-a6fe-f56786469e97 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:17.510385 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-04a6f24b-9d79-4655-a6fe-f56786469e97 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:17.510839 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-04a6f24b-9d79-4655-a6fe-f56786469e97 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:17.515835 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-04a6f24b-9d79-4655-a6fe-f56786469e97 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:17.517061 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-04a6f24b-9d79-4655-a6fe-f56786469e97 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:17.518948 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-04a6f24b-9d79-4655-a6fe-f56786469e97 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:17.768802 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-04a6f24b-9d79-4655-a6fe-f56786469e97 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:17.778319 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-04a6f24b-9d79-4655-a6fe-f56786469e97 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/cafa2fd0-80bd-413c-a7ae-4cb7b3c2a573" status: 200 len: 1274 microversion: 2.1 time: 0.296414 Aug 27 02:55:17.779600 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1515/3030] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:17 2022] GET /compute/v2.1/servers/cafa2fd0-80bd-413c-a7ae-4cb7b3c2a573 => generated 1274 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:55:17.784631 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b719687f-a729-4512-b78b-4ab1e33a6375 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:17.785385 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b719687f-a729-4512-b78b-4ab1e33a6375 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] [instance: e010b43a-87fc-43cf-9ab8-6db75becb702] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:17.792409 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b719687f-a729-4512-b78b-4ab1e33a6375 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:17.793338 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b719687f-a729-4512-b78b-4ab1e33a6375 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:17.794278 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b719687f-a729-4512-b78b-4ab1e33a6375 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:17.795326 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b719687f-a729-4512-b78b-4ab1e33a6375 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:17.795985 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b719687f-a729-4512-b78b-4ab1e33a6375 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:17.796619 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b719687f-a729-4512-b78b-4ab1e33a6375 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:17.834067 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b719687f-a729-4512-b78b-4ab1e33a6375 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] [instance: e010b43a-87fc-43cf-9ab8-6db75becb702] Going to try to terminate instance {{(pid=134052) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:55:17.936688 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-7af62c63-7f0b-4e39-a2c3-b337aef7f7c5 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:17.946314 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.compute.api [None req-b719687f-a729-4512-b78b-4ab1e33a6375 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] [instance: e010b43a-87fc-43cf-9ab8-6db75becb702] Instance is already in deleting state, ignoring this request Aug 27 02:55:17.947270 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b719687f-a729-4512-b78b-4ab1e33a6375 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "DELETE /compute/v2.1/servers/e010b43a-87fc-43cf-9ab8-6db75becb702" status: 204 len: 0 microversion: 2.1 time: 0.166679 Aug 27 02:55:17.947925 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1516/3031] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:55:17 2022] DELETE /compute/v2.1/servers/e010b43a-87fc-43cf-9ab8-6db75becb702 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:55:17.954171 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-7af62c63-7f0b-4e39-a2c3-b337aef7f7c5 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:17.954697 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-000c6b7b-b696-4032-b5f1-8600a0959c39 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:55:17.958903 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-000c6b7b-b696-4032-b5f1-8600a0959c39 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 2d6bf535-89e0-4c21-b2cf-fafcf18c4f18] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:17.961229 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-7af62c63-7f0b-4e39-a2c3-b337aef7f7c5 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:17.962675 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-7af62c63-7f0b-4e39-a2c3-b337aef7f7c5 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] 10.222.0.70 "GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7" status: 200 len: 1879 microversion: 2.32 time: 0.647889 Aug 27 02:55:17.963447 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1516/3032] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:55:17 2022] GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 => generated 1879 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:55:17.967801 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-000c6b7b-b696-4032-b5f1-8600a0959c39 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:17.968298 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-000c6b7b-b696-4032-b5f1-8600a0959c39 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:17.968757 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-000c6b7b-b696-4032-b5f1-8600a0959c39 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:17.969849 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-000c6b7b-b696-4032-b5f1-8600a0959c39 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:17.970308 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-000c6b7b-b696-4032-b5f1-8600a0959c39 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:17.970729 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-000c6b7b-b696-4032-b5f1-8600a0959c39 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:17.987644 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3faa3fe4-c003-48ef-a6f7-21b12c92732f tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:17.988631 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-3faa3fe4-c003-48ef-a6f7-21b12c92732f tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] [instance: e010b43a-87fc-43cf-9ab8-6db75becb702] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:18.002870 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3faa3fe4-c003-48ef-a6f7-21b12c92732f tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:18.003368 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3faa3fe4-c003-48ef-a6f7-21b12c92732f tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:18.003814 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3faa3fe4-c003-48ef-a6f7-21b12c92732f tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:18.004573 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3faa3fe4-c003-48ef-a6f7-21b12c92732f tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:18.010002 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3faa3fe4-c003-48ef-a6f7-21b12c92732f tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:18.010452 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3faa3fe4-c003-48ef-a6f7-21b12c92732f tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:18.044551 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-000c6b7b-b696-4032-b5f1-8600a0959c39 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "POST /compute/v2.1/servers/2d6bf535-89e0-4c21-b2cf-fafcf18c4f18/action" status: 200 len: 14 microversion: 2.1 time: 0.095056 Aug 27 02:55:18.056539 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1517/3033] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 02:55:17 2022] POST /compute/v2.1/servers/2d6bf535-89e0-4c21-b2cf-fafcf18c4f18/action => generated 14 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:55:18.498677 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-3faa3fe4-c003-48ef-a6f7-21b12c92732f tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f496f24dccea47bd9a5ab532fe45e370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40794f05e8b94a0f8f087a87a58e0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:18.509742 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8f87cdf7-8dd6-448b-9c4f-88b4e68457e5 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-1321387002", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "networks": "none"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:55:18.513048 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-3faa3fe4-c003-48ef-a6f7-21b12c92732f tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "GET /compute/v2.1/servers/e010b43a-87fc-43cf-9ab8-6db75becb702" status: 200 len: 1493 microversion: 2.1 time: 0.548123 Aug 27 02:55:18.513653 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1517/3034] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:17 2022] GET /compute/v2.1/servers/e010b43a-87fc-43cf-9ab8-6db75becb702 => generated 1493 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:55:18.518471 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f1244190-b087-4634-bf02-d58518ce7527 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:18.519085 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-f1244190-b087-4634-bf02-d58518ce7527 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] [instance: d93fa48e-eff8-43b7-a1d9-a8199c8c0db9] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:18.540076 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f1244190-b087-4634-bf02-d58518ce7527 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:18.540605 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f1244190-b087-4634-bf02-d58518ce7527 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:18.541050 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f1244190-b087-4634-bf02-d58518ce7527 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:18.541746 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f1244190-b087-4634-bf02-d58518ce7527 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:18.542374 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f1244190-b087-4634-bf02-d58518ce7527 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:18.543001 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f1244190-b087-4634-bf02-d58518ce7527 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:18.594624 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-8f87cdf7-8dd6-448b-9c4f-88b4e68457e5 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Flavor limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:55:18.596947 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-8f87cdf7-8dd6-448b-9c4f-88b4e68457e5 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Image limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:55:18.598102 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-8f87cdf7-8dd6-448b-9c4f-88b4e68457e5 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Flavor pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:55:18.598903 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-8f87cdf7-8dd6-448b-9c4f-88b4e68457e5 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Image pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:55:18.599641 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-8f87cdf7-8dd6-448b-9c4f-88b4e68457e5 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:55:18.613799 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8f87cdf7-8dd6-448b-9c4f-88b4e68457e5 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:18.614656 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8f87cdf7-8dd6-448b-9c4f-88b4e68457e5 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:18.615364 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8f87cdf7-8dd6-448b-9c4f-88b4e68457e5 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:18.616356 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8f87cdf7-8dd6-448b-9c4f-88b4e68457e5 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:18.617174 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8f87cdf7-8dd6-448b-9c4f-88b4e68457e5 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:18.617875 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8f87cdf7-8dd6-448b-9c4f-88b4e68457e5 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:18.646565 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-8f87cdf7-8dd6-448b-9c4f-88b4e68457e5 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Getting quotas for project 77abdb9b52614d1fbd6d70774a2df31f. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:55:18.657192 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-8f87cdf7-8dd6-448b-9c4f-88b4e68457e5 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Getting quotas for user 5097adbf553e4e319d2cb0cf383f587a and project 77abdb9b52614d1fbd6d70774a2df31f. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:55:18.672275 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-8f87cdf7-8dd6-448b-9c4f-88b4e68457e5 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Going to run 1 instances... {{(pid=134052) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:55:18.674866 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-8f87cdf7-8dd6-448b-9c4f-88b4e68457e5 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] [instance: 3f31178a-8993-4aa6-8d41-496bfec13bec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134052) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:55:18.729599 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-8f87cdf7-8dd6-448b-9c4f-88b4e68457e5 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.396442 Aug 27 02:55:18.736437 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1518/3035] 10.222.0.70 () {62 vars in 1188 bytes} [Sat Aug 27 02:55:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 404 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 27 02:55:18.741542 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-e4699457-000c-428f-8fd1-fa93c4d46ff6 req-1c530798-6d6d-49f1-91da-abfa88feb181 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e010b43a-87fc-43cf-9ab8-6db75becb702", "name": "network-vif-plugged", "status": "completed", "tag": "cf6f3d69-229f-4ec6-a305-1e8331df92e7"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:55:18.758800 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-e4699457-000c-428f-8fd1-fa93c4d46ff6 req-1c530798-6d6d-49f1-91da-abfa88feb181 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:18.759485 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-e4699457-000c-428f-8fd1-fa93c4d46ff6 req-1c530798-6d6d-49f1-91da-abfa88feb181 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:18.760372 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-e4699457-000c-428f-8fd1-fa93c4d46ff6 req-1c530798-6d6d-49f1-91da-abfa88feb181 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:18.786824 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-e4699457-000c-428f-8fd1-fa93c4d46ff6 req-1c530798-6d6d-49f1-91da-abfa88feb181 service nova] Creating event network-vif-plugged:cf6f3d69-229f-4ec6-a305-1e8331df92e7 for instance e010b43a-87fc-43cf-9ab8-6db75becb702 on n-h1-852278-4 Aug 27 02:55:18.797247 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-e4699457-000c-428f-8fd1-fa93c4d46ff6 req-1c530798-6d6d-49f1-91da-abfa88feb181 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057366 Aug 27 02:55:18.803701 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1519/3036] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:55:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:55:18.814315 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-bac9ac65-1c5b-476b-815d-6d90319e2072 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:55:18.817771 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-bac9ac65-1c5b-476b-815d-6d90319e2072 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] [instance: 3f31178a-8993-4aa6-8d41-496bfec13bec] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:18.926850 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-f1244190-b087-4634-bf02-d58518ce7527 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8ecf90321841438b77fdceed1e6ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f84ee02bd14800bc5a4212a3746e9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:18.935076 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-f1244190-b087-4634-bf02-d58518ce7527 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] 10.222.0.70 "GET /compute/v2.1/servers/d93fa48e-eff8-43b7-a1d9-a8199c8c0db9" status: 200 len: 1317 microversion: 2.1 time: 0.420385 Aug 27 02:55:18.935664 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1518/3037] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:18 2022] GET /compute/v2.1/servers/d93fa48e-eff8-43b7-a1d9-a8199c8c0db9 => generated 1317 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:55:18.950191 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d38cf275-b10d-4c76-b3ef-0a5eefcfc662 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:18.959514 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d38cf275-b10d-4c76-b3ef-0a5eefcfc662 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: cafa2fd0-80bd-413c-a7ae-4cb7b3c2a573] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:18.966611 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d38cf275-b10d-4c76-b3ef-0a5eefcfc662 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:18.969333 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d38cf275-b10d-4c76-b3ef-0a5eefcfc662 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:18.969957 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d38cf275-b10d-4c76-b3ef-0a5eefcfc662 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:18.972909 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d38cf275-b10d-4c76-b3ef-0a5eefcfc662 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:18.973549 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d38cf275-b10d-4c76-b3ef-0a5eefcfc662 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:18.975223 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d38cf275-b10d-4c76-b3ef-0a5eefcfc662 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:19.003845 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-bac9ac65-1c5b-476b-815d-6d90319e2072 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5097adbf553e4e319d2cb0cf383f587a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77abdb9b52614d1fbd6d70774a2df31f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:19.015773 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-bac9ac65-1c5b-476b-815d-6d90319e2072 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5097adbf553e4e319d2cb0cf383f587a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77abdb9b52614d1fbd6d70774a2df31f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:19.019429 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-bac9ac65-1c5b-476b-815d-6d90319e2072 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5097adbf553e4e319d2cb0cf383f587a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77abdb9b52614d1fbd6d70774a2df31f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:19.033278 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-bac9ac65-1c5b-476b-815d-6d90319e2072 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] 10.222.0.70 "PUT /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec" status: 200 len: 1359 microversion: 2.75 time: 0.225407 Aug 27 02:55:19.052666 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1520/3038] 10.222.0.70 () {62 vars in 1297 bytes} [Sat Aug 27 02:55:18 2022] PUT /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec => generated 1359 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:55:19.061531 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6f591ee5-645d-4e55-96d4-1aeded902ba1 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:19.062663 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-6f591ee5-645d-4e55-96d4-1aeded902ba1 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] [instance: b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:19.073101 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6f591ee5-645d-4e55-96d4-1aeded902ba1 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:19.073589 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6f591ee5-645d-4e55-96d4-1aeded902ba1 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:19.074078 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6f591ee5-645d-4e55-96d4-1aeded902ba1 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:19.074777 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6f591ee5-645d-4e55-96d4-1aeded902ba1 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:19.075216 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6f591ee5-645d-4e55-96d4-1aeded902ba1 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:19.075629 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6f591ee5-645d-4e55-96d4-1aeded902ba1 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:19.098703 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d38cf275-b10d-4c76-b3ef-0a5eefcfc662 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:19.112981 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d38cf275-b10d-4c76-b3ef-0a5eefcfc662 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/cafa2fd0-80bd-413c-a7ae-4cb7b3c2a573" status: 200 len: 1272 microversion: 2.1 time: 0.170861 Aug 27 02:55:19.115241 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1519/3039] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:18 2022] GET /compute/v2.1/servers/cafa2fd0-80bd-413c-a7ae-4cb7b3c2a573 => generated 1272 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:55:19.124343 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c9937fdf-d034-4f75-abd3-13f3d75a113c tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:55:19.131014 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-c9937fdf-d034-4f75-abd3-13f3d75a113c tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 2d6bf535-89e0-4c21-b2cf-fafcf18c4f18] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:19.143677 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c9937fdf-d034-4f75-abd3-13f3d75a113c tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:19.144194 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c9937fdf-d034-4f75-abd3-13f3d75a113c tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:19.144680 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c9937fdf-d034-4f75-abd3-13f3d75a113c tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:19.145508 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c9937fdf-d034-4f75-abd3-13f3d75a113c tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:19.146668 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c9937fdf-d034-4f75-abd3-13f3d75a113c tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:19.148977 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c9937fdf-d034-4f75-abd3-13f3d75a113c tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:19.204511 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c9937fdf-d034-4f75-abd3-13f3d75a113c tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "POST /compute/v2.1/servers/2d6bf535-89e0-4c21-b2cf-fafcf18c4f18/action" status: 200 len: 14 microversion: 2.1 time: 0.087191 Aug 27 02:55:19.208596 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1520/3040] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 02:55:19 2022] POST /compute/v2.1/servers/2d6bf535-89e0-4c21-b2cf-fafcf18c4f18/action => generated 14 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:55:19.215765 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-554f9e42-50d7-44a9-98b3-decf958ed424 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:19.216943 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-554f9e42-50d7-44a9-98b3-decf958ed424 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] [instance: 3f31178a-8993-4aa6-8d41-496bfec13bec] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:19.383119 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-554f9e42-50d7-44a9-98b3-decf958ed424 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5097adbf553e4e319d2cb0cf383f587a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77abdb9b52614d1fbd6d70774a2df31f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:19.396736 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-554f9e42-50d7-44a9-98b3-decf958ed424 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5097adbf553e4e319d2cb0cf383f587a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77abdb9b52614d1fbd6d70774a2df31f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:19.398948 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-554f9e42-50d7-44a9-98b3-decf958ed424 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5097adbf553e4e319d2cb0cf383f587a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77abdb9b52614d1fbd6d70774a2df31f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:19.408147 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-554f9e42-50d7-44a9-98b3-decf958ed424 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] 10.222.0.70 "GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec" status: 200 len: 1359 microversion: 2.75 time: 0.196698 Aug 27 02:55:19.408972 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1521/3041] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:55:19 2022] GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec => generated 1359 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:55:19.534026 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-de0883e4-b36c-46ad-942c-e993b9661768 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:19.534642 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-de0883e4-b36c-46ad-942c-e993b9661768 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] [instance: e010b43a-87fc-43cf-9ab8-6db75becb702] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:19.536235 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-6f591ee5-645d-4e55-96d4-1aeded902ba1 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:19.543861 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-de0883e4-b36c-46ad-942c-e993b9661768 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:19.549235 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-de0883e4-b36c-46ad-942c-e993b9661768 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:19.549963 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-de0883e4-b36c-46ad-942c-e993b9661768 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:19.550943 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-de0883e4-b36c-46ad-942c-e993b9661768 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:19.551069 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-6f591ee5-645d-4e55-96d4-1aeded902ba1 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:19.554953 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-de0883e4-b36c-46ad-942c-e993b9661768 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:19.555849 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-de0883e4-b36c-46ad-942c-e993b9661768 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:19.558612 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-6f591ee5-645d-4e55-96d4-1aeded902ba1 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:19.560012 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-6f591ee5-645d-4e55-96d4-1aeded902ba1 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] 10.222.0.70 "GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7" status: 200 len: 1879 microversion: 2.32 time: 0.505952 Aug 27 02:55:19.577464 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1521/3042] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:55:19 2022] GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 => generated 1879 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:55:19.858420 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-de0883e4-b36c-46ad-942c-e993b9661768 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f496f24dccea47bd9a5ab532fe45e370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40794f05e8b94a0f8f087a87a58e0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:19.872925 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-de0883e4-b36c-46ad-942c-e993b9661768 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "GET /compute/v2.1/servers/e010b43a-87fc-43cf-9ab8-6db75becb702" status: 200 len: 1493 microversion: 2.1 time: 0.341158 Aug 27 02:55:19.873820 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1522/3043] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:19 2022] GET /compute/v2.1/servers/e010b43a-87fc-43cf-9ab8-6db75becb702 => generated 1493 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:55:19.955144 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-89c16ff1-5c77-4b50-8785-27f59dc1fcc7 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:19.956827 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-89c16ff1-5c77-4b50-8785-27f59dc1fcc7 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] [instance: d93fa48e-eff8-43b7-a1d9-a8199c8c0db9] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:19.963473 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-89c16ff1-5c77-4b50-8785-27f59dc1fcc7 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:19.964349 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-89c16ff1-5c77-4b50-8785-27f59dc1fcc7 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:19.965032 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-89c16ff1-5c77-4b50-8785-27f59dc1fcc7 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:19.965992 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-89c16ff1-5c77-4b50-8785-27f59dc1fcc7 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:19.966655 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-89c16ff1-5c77-4b50-8785-27f59dc1fcc7 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:19.967305 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-89c16ff1-5c77-4b50-8785-27f59dc1fcc7 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:20.135757 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0a891568-0064-45fa-83b8-3a1de9d3e2d8 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:20.136597 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-0a891568-0064-45fa-83b8-3a1de9d3e2d8 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: cafa2fd0-80bd-413c-a7ae-4cb7b3c2a573] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:20.143619 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0a891568-0064-45fa-83b8-3a1de9d3e2d8 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:20.144173 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0a891568-0064-45fa-83b8-3a1de9d3e2d8 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:20.144707 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0a891568-0064-45fa-83b8-3a1de9d3e2d8 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:20.145498 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0a891568-0064-45fa-83b8-3a1de9d3e2d8 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:20.146017 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0a891568-0064-45fa-83b8-3a1de9d3e2d8 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:20.146508 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0a891568-0064-45fa-83b8-3a1de9d3e2d8 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:20.168721 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:55:20.733070 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-89c16ff1-5c77-4b50-8785-27f59dc1fcc7 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8ecf90321841438b77fdceed1e6ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f84ee02bd14800bc5a4212a3746e9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:20.742360 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-89c16ff1-5c77-4b50-8785-27f59dc1fcc7 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] 10.222.0.70 "GET /compute/v2.1/servers/d93fa48e-eff8-43b7-a1d9-a8199c8c0db9" status: 200 len: 1317 microversion: 2.1 time: 0.791035 Aug 27 02:55:20.743415 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1522/3044] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:19 2022] GET /compute/v2.1/servers/d93fa48e-eff8-43b7-a1d9-a8199c8c0db9 => generated 1317 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:55:20.817829 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-0665c66e-1045-4996-9e97-4c6b3ba5721c req-5ebd8cbd-a4cf-4b2f-a546-36db74e4ea4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d93fa48e-eff8-43b7-a1d9-a8199c8c0db9", "tag": "ffdfccc5-74d7-49e6-9a30-6dd06e5e4a03"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:55:20.829311 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-0665c66e-1045-4996-9e97-4c6b3ba5721c req-5ebd8cbd-a4cf-4b2f-a546-36db74e4ea4f service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:20.829941 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-0665c66e-1045-4996-9e97-4c6b3ba5721c req-5ebd8cbd-a4cf-4b2f-a546-36db74e4ea4f service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:20.830464 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-0665c66e-1045-4996-9e97-4c6b3ba5721c req-5ebd8cbd-a4cf-4b2f-a546-36db74e4ea4f service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:20.844273 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-0665c66e-1045-4996-9e97-4c6b3ba5721c req-5ebd8cbd-a4cf-4b2f-a546-36db74e4ea4f service nova] Creating event network-changed:ffdfccc5-74d7-49e6-9a30-6dd06e5e4a03 for instance d93fa48e-eff8-43b7-a1d9-a8199c8c0db9 on n-h1-852278-4 Aug 27 02:55:20.849843 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-0665c66e-1045-4996-9e97-4c6b3ba5721c req-5ebd8cbd-a4cf-4b2f-a546-36db74e4ea4f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105102 Aug 27 02:55:20.850613 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1523/3045] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:55:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:55:20.856801 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-cbc9e6c3-22dd-4be0-b7de-c79611f56b20 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:55:20.859239 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-cbc9e6c3-22dd-4be0-b7de-c79611f56b20 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 2d6bf535-89e0-4c21-b2cf-fafcf18c4f18] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:20.866221 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cbc9e6c3-22dd-4be0-b7de-c79611f56b20 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:20.866794 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cbc9e6c3-22dd-4be0-b7de-c79611f56b20 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:20.867469 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cbc9e6c3-22dd-4be0-b7de-c79611f56b20 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:20.868256 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cbc9e6c3-22dd-4be0-b7de-c79611f56b20 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:20.868823 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cbc9e6c3-22dd-4be0-b7de-c79611f56b20 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:20.869446 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cbc9e6c3-22dd-4be0-b7de-c79611f56b20 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:20.914381 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-cbc9e6c3-22dd-4be0-b7de-c79611f56b20 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "POST /compute/v2.1/servers/2d6bf535-89e0-4c21-b2cf-fafcf18c4f18/action" status: 200 len: 14 microversion: 2.1 time: 0.061995 Aug 27 02:55:20.916296 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1524/3046] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 02:55:20 2022] POST /compute/v2.1/servers/2d6bf535-89e0-4c21-b2cf-fafcf18c4f18/action => generated 14 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:55:20.922832 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ae642cc4-f4d0-4b7c-a6f9-6e047e3c65e8 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:20.925477 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-ae642cc4-f4d0-4b7c-a6f9-6e047e3c65e8 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] [instance: 3f31178a-8993-4aa6-8d41-496bfec13bec] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:20.933023 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ae642cc4-f4d0-4b7c-a6f9-6e047e3c65e8 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:20.933573 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ae642cc4-f4d0-4b7c-a6f9-6e047e3c65e8 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:20.934008 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ae642cc4-f4d0-4b7c-a6f9-6e047e3c65e8 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:20.934733 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ae642cc4-f4d0-4b7c-a6f9-6e047e3c65e8 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:20.935180 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ae642cc4-f4d0-4b7c-a6f9-6e047e3c65e8 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:20.935604 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ae642cc4-f4d0-4b7c-a6f9-6e047e3c65e8 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:20.953599 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-0a891568-0064-45fa-83b8-3a1de9d3e2d8 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:20.968354 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-0a891568-0064-45fa-83b8-3a1de9d3e2d8 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/cafa2fd0-80bd-413c-a7ae-4cb7b3c2a573" status: 200 len: 1314 microversion: 2.1 time: 0.836782 Aug 27 02:55:20.970473 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1523/3047] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:20 2022] GET /compute/v2.1/servers/cafa2fd0-80bd-413c-a7ae-4cb7b3c2a573 => generated 1314 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:55:20.979626 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-36f6695b-2661-4723-86dc-ce9578cab3b1 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:20.980595 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-36f6695b-2661-4723-86dc-ce9578cab3b1 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] [instance: b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:20.996174 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-36f6695b-2661-4723-86dc-ce9578cab3b1 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:20.997036 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-36f6695b-2661-4723-86dc-ce9578cab3b1 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:20.998676 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-36f6695b-2661-4723-86dc-ce9578cab3b1 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:20.999736 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-36f6695b-2661-4723-86dc-ce9578cab3b1 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:21.000460 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-36f6695b-2661-4723-86dc-ce9578cab3b1 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:21.001171 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-36f6695b-2661-4723-86dc-ce9578cab3b1 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:21.127806 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-ae642cc4-f4d0-4b7c-a6f9-6e047e3c65e8 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5097adbf553e4e319d2cb0cf383f587a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77abdb9b52614d1fbd6d70774a2df31f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:21.138359 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-ae642cc4-f4d0-4b7c-a6f9-6e047e3c65e8 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5097adbf553e4e319d2cb0cf383f587a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77abdb9b52614d1fbd6d70774a2df31f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:21.139858 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-ae642cc4-f4d0-4b7c-a6f9-6e047e3c65e8 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5097adbf553e4e319d2cb0cf383f587a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77abdb9b52614d1fbd6d70774a2df31f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:21.145857 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ae642cc4-f4d0-4b7c-a6f9-6e047e3c65e8 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] 10.222.0.70 "GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec" status: 200 len: 1417 microversion: 2.75 time: 0.227981 Aug 27 02:55:21.146684 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1525/3048] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:55:20 2022] GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec => generated 1417 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:55:21.164886 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9777b4d6-46a6-4b22-9973-00f046c48c9c tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:21.165577 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-9777b4d6-46a6-4b22-9973-00f046c48c9c tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] [instance: e010b43a-87fc-43cf-9ab8-6db75becb702] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:21.172635 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9777b4d6-46a6-4b22-9973-00f046c48c9c tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:21.173259 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9777b4d6-46a6-4b22-9973-00f046c48c9c tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:21.173783 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9777b4d6-46a6-4b22-9973-00f046c48c9c tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:21.174658 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9777b4d6-46a6-4b22-9973-00f046c48c9c tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:21.175349 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9777b4d6-46a6-4b22-9973-00f046c48c9c tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:21.175856 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9777b4d6-46a6-4b22-9973-00f046c48c9c tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:21.182373 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:55:21.308305 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-9777b4d6-46a6-4b22-9973-00f046c48c9c tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f496f24dccea47bd9a5ab532fe45e370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40794f05e8b94a0f8f087a87a58e0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:21.320922 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9777b4d6-46a6-4b22-9973-00f046c48c9c tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "GET /compute/v2.1/servers/e010b43a-87fc-43cf-9ab8-6db75becb702" status: 200 len: 1451 microversion: 2.1 time: 0.162075 Aug 27 02:55:21.322967 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1526/3049] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:21 2022] GET /compute/v2.1/servers/e010b43a-87fc-43cf-9ab8-6db75becb702 => generated 1451 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:55:21.401707 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-36f6695b-2661-4723-86dc-ce9578cab3b1 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:21.414796 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-36f6695b-2661-4723-86dc-ce9578cab3b1 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:21.417148 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-36f6695b-2661-4723-86dc-ce9578cab3b1 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:21.418811 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-36f6695b-2661-4723-86dc-ce9578cab3b1 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] 10.222.0.70 "GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7" status: 200 len: 1879 microversion: 2.32 time: 0.445702 Aug 27 02:55:21.419439 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1524/3050] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:55:20 2022] GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 => generated 1879 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:55:21.512359 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-a4cd0560-cefd-4eeb-97f8-18c6ef329da5 req-46dbe8f4-4e69-44b7-99bd-ba8319a1192c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cafa2fd0-80bd-413c-a7ae-4cb7b3c2a573", "tag": "d161a02d-1ba1-4a2e-a278-1c8407983018"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:55:21.523120 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-a4cd0560-cefd-4eeb-97f8-18c6ef329da5 req-46dbe8f4-4e69-44b7-99bd-ba8319a1192c service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:21.523908 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-a4cd0560-cefd-4eeb-97f8-18c6ef329da5 req-46dbe8f4-4e69-44b7-99bd-ba8319a1192c service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:21.524580 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-a4cd0560-cefd-4eeb-97f8-18c6ef329da5 req-46dbe8f4-4e69-44b7-99bd-ba8319a1192c service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:21.536986 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-a4cd0560-cefd-4eeb-97f8-18c6ef329da5 req-46dbe8f4-4e69-44b7-99bd-ba8319a1192c service nova] Creating event network-changed:d161a02d-1ba1-4a2e-a278-1c8407983018 for instance cafa2fd0-80bd-413c-a7ae-4cb7b3c2a573 on n-h2-852278-4 Aug 27 02:55:21.542412 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-a4cd0560-cefd-4eeb-97f8-18c6ef329da5 req-46dbe8f4-4e69-44b7-99bd-ba8319a1192c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033877 Aug 27 02:55:21.543653 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1527/3051] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:55:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:55:21.763356 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d37668c6-77ad-421e-9341-b3448db7ad1e tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:21.763979 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d37668c6-77ad-421e-9341-b3448db7ad1e tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] [instance: d93fa48e-eff8-43b7-a1d9-a8199c8c0db9] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:21.782068 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d37668c6-77ad-421e-9341-b3448db7ad1e tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:21.782579 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d37668c6-77ad-421e-9341-b3448db7ad1e tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:21.783015 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d37668c6-77ad-421e-9341-b3448db7ad1e tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:21.783741 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d37668c6-77ad-421e-9341-b3448db7ad1e tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:21.784198 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d37668c6-77ad-421e-9341-b3448db7ad1e tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:21.788833 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d37668c6-77ad-421e-9341-b3448db7ad1e tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:21.927719 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a66d712f-7713-47a6-ac1c-ca8ceb5cd215 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:55:21.930765 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a66d712f-7713-47a6-ac1c-ca8ceb5cd215 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 2d6bf535-89e0-4c21-b2cf-fafcf18c4f18] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:21.952348 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a66d712f-7713-47a6-ac1c-ca8ceb5cd215 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:21.953763 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a66d712f-7713-47a6-ac1c-ca8ceb5cd215 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:21.955017 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a66d712f-7713-47a6-ac1c-ca8ceb5cd215 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:21.955968 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a66d712f-7713-47a6-ac1c-ca8ceb5cd215 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:21.956534 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a66d712f-7713-47a6-ac1c-ca8ceb5cd215 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:21.957073 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a66d712f-7713-47a6-ac1c-ca8ceb5cd215 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:22.010572 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a66d712f-7713-47a6-ac1c-ca8ceb5cd215 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "POST /compute/v2.1/servers/2d6bf535-89e0-4c21-b2cf-fafcf18c4f18/action" status: 200 len: 14 microversion: 2.1 time: 0.088459 Aug 27 02:55:22.015188 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1528/3052] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 02:55:21 2022] POST /compute/v2.1/servers/2d6bf535-89e0-4c21-b2cf-fafcf18c4f18/action => generated 14 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:55:22.021518 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-87f1b3bb-2a5b-4ad9-90b6-8e7859f681b7 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:22.022215 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-87f1b3bb-2a5b-4ad9-90b6-8e7859f681b7 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: cafa2fd0-80bd-413c-a7ae-4cb7b3c2a573] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:22.030469 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-87f1b3bb-2a5b-4ad9-90b6-8e7859f681b7 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:22.030845 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-87f1b3bb-2a5b-4ad9-90b6-8e7859f681b7 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:22.031279 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-87f1b3bb-2a5b-4ad9-90b6-8e7859f681b7 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:22.031991 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-87f1b3bb-2a5b-4ad9-90b6-8e7859f681b7 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:22.032469 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-87f1b3bb-2a5b-4ad9-90b6-8e7859f681b7 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:22.034923 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-87f1b3bb-2a5b-4ad9-90b6-8e7859f681b7 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:22.255215 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d37668c6-77ad-421e-9341-b3448db7ad1e tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8ecf90321841438b77fdceed1e6ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f84ee02bd14800bc5a4212a3746e9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:22.265013 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d37668c6-77ad-421e-9341-b3448db7ad1e tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] 10.222.0.70 "GET /compute/v2.1/servers/d93fa48e-eff8-43b7-a1d9-a8199c8c0db9" status: 200 len: 1317 microversion: 2.1 time: 0.505555 Aug 27 02:55:22.266231 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1525/3053] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:21 2022] GET /compute/v2.1/servers/d93fa48e-eff8-43b7-a1d9-a8199c8c0db9 => generated 1317 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:55:22.271400 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4961214f-c1e4-49a5-beea-378afdea884e tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:22.273200 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-4961214f-c1e4-49a5-beea-378afdea884e tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] [instance: 3f31178a-8993-4aa6-8d41-496bfec13bec] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:22.279451 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4961214f-c1e4-49a5-beea-378afdea884e tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:22.280057 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4961214f-c1e4-49a5-beea-378afdea884e tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:22.280740 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4961214f-c1e4-49a5-beea-378afdea884e tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:22.281502 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4961214f-c1e4-49a5-beea-378afdea884e tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:22.282137 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4961214f-c1e4-49a5-beea-378afdea884e tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:22.282716 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4961214f-c1e4-49a5-beea-378afdea884e tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:22.478339 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-87f1b3bb-2a5b-4ad9-90b6-8e7859f681b7 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:22.487173 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-87f1b3bb-2a5b-4ad9-90b6-8e7859f681b7 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/cafa2fd0-80bd-413c-a7ae-4cb7b3c2a573" status: 200 len: 1314 microversion: 2.1 time: 0.470431 Aug 27 02:55:22.488470 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1529/3054] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:22 2022] GET /compute/v2.1/servers/cafa2fd0-80bd-413c-a7ae-4cb7b3c2a573 => generated 1314 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:55:22.493742 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5699d285-4619-4e3a-b79b-10a762e713d9 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:22.494587 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-5699d285-4619-4e3a-b79b-10a762e713d9 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] [instance: e010b43a-87fc-43cf-9ab8-6db75becb702] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:22.501086 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5699d285-4619-4e3a-b79b-10a762e713d9 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:22.501698 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5699d285-4619-4e3a-b79b-10a762e713d9 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:22.502236 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5699d285-4619-4e3a-b79b-10a762e713d9 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:22.503048 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5699d285-4619-4e3a-b79b-10a762e713d9 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:22.503591 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5699d285-4619-4e3a-b79b-10a762e713d9 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:22.504106 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5699d285-4619-4e3a-b79b-10a762e713d9 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:22.542674 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5699d285-4619-4e3a-b79b-10a762e713d9 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:22.543584 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5699d285-4619-4e3a-b79b-10a762e713d9 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:22.544323 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5699d285-4619-4e3a-b79b-10a762e713d9 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:22.544990 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.instance [None req-5699d285-4619-4e3a-b79b-10a762e713d9 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lazy-loading 'fault' on Instance uuid e010b43a-87fc-43cf-9ab8-6db75becb702 {{(pid=134052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:55:22.566189 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-4961214f-c1e4-49a5-beea-378afdea884e tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5097adbf553e4e319d2cb0cf383f587a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77abdb9b52614d1fbd6d70774a2df31f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:22.577741 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-4961214f-c1e4-49a5-beea-378afdea884e tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5097adbf553e4e319d2cb0cf383f587a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77abdb9b52614d1fbd6d70774a2df31f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:22.579656 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-4961214f-c1e4-49a5-beea-378afdea884e tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5097adbf553e4e319d2cb0cf383f587a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77abdb9b52614d1fbd6d70774a2df31f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:22.586491 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-4961214f-c1e4-49a5-beea-378afdea884e tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] 10.222.0.70 "GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec" status: 200 len: 1417 microversion: 2.75 time: 0.318599 Aug 27 02:55:22.587565 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1526/3055] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:55:22 2022] GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec => generated 1417 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:55:22.593684 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-02a51054-b46f-4008-acfb-eb062f5a3ede tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:22.594539 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-02a51054-b46f-4008-acfb-eb062f5a3ede tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] [instance: b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:22.601642 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-02a51054-b46f-4008-acfb-eb062f5a3ede tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:22.602422 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-02a51054-b46f-4008-acfb-eb062f5a3ede tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:22.603054 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-02a51054-b46f-4008-acfb-eb062f5a3ede tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:22.603960 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-02a51054-b46f-4008-acfb-eb062f5a3ede tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:22.604612 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-02a51054-b46f-4008-acfb-eb062f5a3ede tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:22.606345 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-02a51054-b46f-4008-acfb-eb062f5a3ede tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:22.615176 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-5699d285-4619-4e3a-b79b-10a762e713d9 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f496f24dccea47bd9a5ab532fe45e370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40794f05e8b94a0f8f087a87a58e0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:22.634559 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-5699d285-4619-4e3a-b79b-10a762e713d9 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "GET /compute/v2.1/servers/e010b43a-87fc-43cf-9ab8-6db75becb702" status: 200 len: 1298 microversion: 2.1 time: 0.138809 Aug 27 02:55:22.636045 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1530/3056] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:22 2022] GET /compute/v2.1/servers/e010b43a-87fc-43cf-9ab8-6db75becb702 => generated 1298 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:55:23.022770 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-02a51054-b46f-4008-acfb-eb062f5a3ede tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:23.023642 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6676945c-1859-4604-a900-a15c39c571fb tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:55:23.027343 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-6676945c-1859-4604-a900-a15c39c571fb tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 2d6bf535-89e0-4c21-b2cf-fafcf18c4f18] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:23.035978 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6676945c-1859-4604-a900-a15c39c571fb tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:23.036858 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6676945c-1859-4604-a900-a15c39c571fb tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:23.037856 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6676945c-1859-4604-a900-a15c39c571fb tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:23.038798 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6676945c-1859-4604-a900-a15c39c571fb tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:23.040139 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6676945c-1859-4604-a900-a15c39c571fb tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:23.040281 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-02a51054-b46f-4008-acfb-eb062f5a3ede tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:23.041000 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6676945c-1859-4604-a900-a15c39c571fb tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:23.042311 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-02a51054-b46f-4008-acfb-eb062f5a3ede tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:23.043779 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-02a51054-b46f-4008-acfb-eb062f5a3ede tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] 10.222.0.70 "GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7" status: 200 len: 1879 microversion: 2.32 time: 0.454262 Aug 27 02:55:23.059347 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1527/3057] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:55:22 2022] GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 => generated 1879 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:55:23.123820 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-6d637888-3394-4915-a7d4-02c23e32488a req-ae5a5f01-4738-427c-b442-367bb5429f59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e010b43a-87fc-43cf-9ab8-6db75becb702", "name": "network-vif-deleted", "tag": "cf6f3d69-229f-4ec6-a305-1e8331df92e7"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:55:23.138679 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-6d637888-3394-4915-a7d4-02c23e32488a req-ae5a5f01-4738-427c-b442-367bb5429f59 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:23.139492 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-6d637888-3394-4915-a7d4-02c23e32488a req-ae5a5f01-4738-427c-b442-367bb5429f59 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:23.140122 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-6d637888-3394-4915-a7d4-02c23e32488a req-ae5a5f01-4738-427c-b442-367bb5429f59 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:23.153894 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-6d637888-3394-4915-a7d4-02c23e32488a req-ae5a5f01-4738-427c-b442-367bb5429f59 service nova] Creating event network-vif-deleted:cf6f3d69-229f-4ec6-a305-1e8331df92e7 for instance e010b43a-87fc-43cf-9ab8-6db75becb702 on n-h1-852278-4 Aug 27 02:55:23.160809 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-6d637888-3394-4915-a7d4-02c23e32488a req-ae5a5f01-4738-427c-b442-367bb5429f59 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041603 Aug 27 02:55:23.165610 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1528/3058] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:55:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:55:23.290117 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-47f77ec1-dd2c-48fa-8d9f-2bc042b13ef7 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:23.291160 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-47f77ec1-dd2c-48fa-8d9f-2bc042b13ef7 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] [instance: d93fa48e-eff8-43b7-a1d9-a8199c8c0db9] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:23.301686 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-47f77ec1-dd2c-48fa-8d9f-2bc042b13ef7 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:23.302402 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-47f77ec1-dd2c-48fa-8d9f-2bc042b13ef7 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:23.303704 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-47f77ec1-dd2c-48fa-8d9f-2bc042b13ef7 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:23.304698 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-47f77ec1-dd2c-48fa-8d9f-2bc042b13ef7 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:23.305385 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-47f77ec1-dd2c-48fa-8d9f-2bc042b13ef7 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:23.306155 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-47f77ec1-dd2c-48fa-8d9f-2bc042b13ef7 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:23.327007 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-6676945c-1859-4604-a900-a15c39c571fb tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "POST /compute/v2.1/servers/2d6bf535-89e0-4c21-b2cf-fafcf18c4f18/action" status: 200 len: 14 microversion: 2.1 time: 0.308402 Aug 27 02:55:23.331085 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1531/3059] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 02:55:23 2022] POST /compute/v2.1/servers/2d6bf535-89e0-4c21-b2cf-fafcf18c4f18/action => generated 14 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:55:23.461792 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-47f77ec1-dd2c-48fa-8d9f-2bc042b13ef7 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8ecf90321841438b77fdceed1e6ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f84ee02bd14800bc5a4212a3746e9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:23.469718 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-47f77ec1-dd2c-48fa-8d9f-2bc042b13ef7 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] 10.222.0.70 "GET /compute/v2.1/servers/d93fa48e-eff8-43b7-a1d9-a8199c8c0db9" status: 200 len: 1317 microversion: 2.1 time: 0.185667 Aug 27 02:55:23.470291 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1529/3060] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:23 2022] GET /compute/v2.1/servers/d93fa48e-eff8-43b7-a1d9-a8199c8c0db9 => generated 1317 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:55:23.508148 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-fa261314-6524-43e0-8411-a2a6c4ca837f tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:23.508936 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-fa261314-6524-43e0-8411-a2a6c4ca837f tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: cafa2fd0-80bd-413c-a7ae-4cb7b3c2a573] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:23.515880 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fa261314-6524-43e0-8411-a2a6c4ca837f tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:23.516386 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fa261314-6524-43e0-8411-a2a6c4ca837f tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:23.516821 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fa261314-6524-43e0-8411-a2a6c4ca837f tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:23.517522 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fa261314-6524-43e0-8411-a2a6c4ca837f tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:23.517966 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fa261314-6524-43e0-8411-a2a6c4ca837f tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:23.518406 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fa261314-6524-43e0-8411-a2a6c4ca837f tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:23.611501 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a8d809ab-822a-4932-97d9-8b6d64829d25 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:23.612094 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-a8d809ab-822a-4932-97d9-8b6d64829d25 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] [instance: 3f31178a-8993-4aa6-8d41-496bfec13bec] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:23.618403 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a8d809ab-822a-4932-97d9-8b6d64829d25 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:23.618941 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a8d809ab-822a-4932-97d9-8b6d64829d25 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:23.619357 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a8d809ab-822a-4932-97d9-8b6d64829d25 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:23.620070 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a8d809ab-822a-4932-97d9-8b6d64829d25 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:23.620553 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a8d809ab-822a-4932-97d9-8b6d64829d25 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:23.621020 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a8d809ab-822a-4932-97d9-8b6d64829d25 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:23.660499 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-fa261314-6524-43e0-8411-a2a6c4ca837f tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:23.677000 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-fa261314-6524-43e0-8411-a2a6c4ca837f tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/cafa2fd0-80bd-413c-a7ae-4cb7b3c2a573" status: 200 len: 1314 microversion: 2.1 time: 0.172698 Aug 27 02:55:23.695632 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1532/3061] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:23 2022] GET /compute/v2.1/servers/cafa2fd0-80bd-413c-a7ae-4cb7b3c2a573 => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:55:23.699160 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-a8d809ab-822a-4932-97d9-8b6d64829d25 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5097adbf553e4e319d2cb0cf383f587a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77abdb9b52614d1fbd6d70774a2df31f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:23.702486 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6df33ad9-e124-4d52-b229-806eccad0e7a tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:23.703101 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-6df33ad9-e124-4d52-b229-806eccad0e7a tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] [instance: e010b43a-87fc-43cf-9ab8-6db75becb702] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:23.707812 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-a8d809ab-822a-4932-97d9-8b6d64829d25 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5097adbf553e4e319d2cb0cf383f587a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77abdb9b52614d1fbd6d70774a2df31f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:23.709595 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-a8d809ab-822a-4932-97d9-8b6d64829d25 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5097adbf553e4e319d2cb0cf383f587a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77abdb9b52614d1fbd6d70774a2df31f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:23.709742 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6df33ad9-e124-4d52-b229-806eccad0e7a tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:23.710133 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6df33ad9-e124-4d52-b229-806eccad0e7a tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:23.710561 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6df33ad9-e124-4d52-b229-806eccad0e7a tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:23.711255 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6df33ad9-e124-4d52-b229-806eccad0e7a tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:23.711953 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6df33ad9-e124-4d52-b229-806eccad0e7a tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:23.712610 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6df33ad9-e124-4d52-b229-806eccad0e7a tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:23.714831 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a8d809ab-822a-4932-97d9-8b6d64829d25 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] 10.222.0.70 "GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec" status: 200 len: 1438 microversion: 2.75 time: 0.107238 Aug 27 02:55:23.715657 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1530/3062] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:55:23 2022] GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec => generated 1438 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:55:23.740217 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-789a19bc-cadd-4169-9e32-9370402070fc tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:55:23.744725 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-789a19bc-cadd-4169-9e32-9370402070fc tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] [instance: 3f31178a-8993-4aa6-8d41-496bfec13bec] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:23.746669 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6df33ad9-e124-4d52-b229-806eccad0e7a tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:23.747171 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6df33ad9-e124-4d52-b229-806eccad0e7a tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:23.747604 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6df33ad9-e124-4d52-b229-806eccad0e7a tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:23.748058 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.instance [None req-6df33ad9-e124-4d52-b229-806eccad0e7a tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lazy-loading 'fault' on Instance uuid e010b43a-87fc-43cf-9ab8-6db75becb702 {{(pid=134052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:55:23.763023 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-789a19bc-cadd-4169-9e32-9370402070fc tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:23.764515 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-789a19bc-cadd-4169-9e32-9370402070fc tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:23.765053 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-789a19bc-cadd-4169-9e32-9370402070fc tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:23.765823 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-789a19bc-cadd-4169-9e32-9370402070fc tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:23.766539 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-789a19bc-cadd-4169-9e32-9370402070fc tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:23.767169 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-789a19bc-cadd-4169-9e32-9370402070fc tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:23.804156 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-6df33ad9-e124-4d52-b229-806eccad0e7a tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f496f24dccea47bd9a5ab532fe45e370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40794f05e8b94a0f8f087a87a58e0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:23.814133 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-6df33ad9-e124-4d52-b229-806eccad0e7a tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "GET /compute/v2.1/servers/e010b43a-87fc-43cf-9ab8-6db75becb702" status: 200 len: 1298 microversion: 2.1 time: 0.117324 Aug 27 02:55:23.821372 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1533/3063] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:23 2022] GET /compute/v2.1/servers/e010b43a-87fc-43cf-9ab8-6db75becb702 => generated 1298 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:55:23.866388 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-789a19bc-cadd-4169-9e32-9370402070fc tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Flavor limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:55:23.867119 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-789a19bc-cadd-4169-9e32-9370402070fc tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Image limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:55:23.867743 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-789a19bc-cadd-4169-9e32-9370402070fc tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Flavor pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:55:23.868216 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-789a19bc-cadd-4169-9e32-9370402070fc tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Image pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:55:23.868901 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-789a19bc-cadd-4169-9e32-9370402070fc tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:55:23.965851 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-789a19bc-cadd-4169-9e32-9370402070fc tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] [instance: 3f31178a-8993-4aa6-8d41-496bfec13bec] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:23.984193 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-789a19bc-cadd-4169-9e32-9370402070fc tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:23.986236 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-789a19bc-cadd-4169-9e32-9370402070fc tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:23.987051 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-789a19bc-cadd-4169-9e32-9370402070fc tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:23.992405 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-789a19bc-cadd-4169-9e32-9370402070fc tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:23.993096 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-789a19bc-cadd-4169-9e32-9370402070fc tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:23.993581 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-789a19bc-cadd-4169-9e32-9370402070fc tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:24.072701 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0c239a26-535e-43ae-96b3-ef53d0a27071 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:24.077216 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-0c239a26-535e-43ae-96b3-ef53d0a27071 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] [instance: b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:24.086689 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0c239a26-535e-43ae-96b3-ef53d0a27071 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:24.087431 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0c239a26-535e-43ae-96b3-ef53d0a27071 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:24.088023 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0c239a26-535e-43ae-96b3-ef53d0a27071 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:24.088941 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0c239a26-535e-43ae-96b3-ef53d0a27071 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:24.089635 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0c239a26-535e-43ae-96b3-ef53d0a27071 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:24.092553 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0c239a26-535e-43ae-96b3-ef53d0a27071 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:24.118518 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-789a19bc-cadd-4169-9e32-9370402070fc tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5097adbf553e4e319d2cb0cf383f587a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77abdb9b52614d1fbd6d70774a2df31f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:24.133015 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-789a19bc-cadd-4169-9e32-9370402070fc tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5097adbf553e4e319d2cb0cf383f587a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77abdb9b52614d1fbd6d70774a2df31f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:24.136500 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-789a19bc-cadd-4169-9e32-9370402070fc tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5097adbf553e4e319d2cb0cf383f587a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77abdb9b52614d1fbd6d70774a2df31f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:24.146784 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-789a19bc-cadd-4169-9e32-9370402070fc tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] 10.222.0.70 "POST /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec/action" status: 202 len: 1495 microversion: 2.75 time: 0.410637 Aug 27 02:55:24.147716 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1531/3064] 10.222.0.70 () {62 vars in 1319 bytes} [Sat Aug 27 02:55:23 2022] POST /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec/action => generated 1495 bytes in 412 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Aug 27 02:55:24.171318 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-39c36a55-28c6-4004-bba7-b4a6e19611c0 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:24.172157 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-39c36a55-28c6-4004-bba7-b4a6e19611c0 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] [instance: 3f31178a-8993-4aa6-8d41-496bfec13bec] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:24.180707 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-39c36a55-28c6-4004-bba7-b4a6e19611c0 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:24.181221 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-39c36a55-28c6-4004-bba7-b4a6e19611c0 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:24.182803 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-39c36a55-28c6-4004-bba7-b4a6e19611c0 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:24.183571 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-39c36a55-28c6-4004-bba7-b4a6e19611c0 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:24.184031 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-39c36a55-28c6-4004-bba7-b4a6e19611c0 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:24.184483 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-39c36a55-28c6-4004-bba7-b4a6e19611c0 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:24.299685 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-39c36a55-28c6-4004-bba7-b4a6e19611c0 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5097adbf553e4e319d2cb0cf383f587a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77abdb9b52614d1fbd6d70774a2df31f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:24.312017 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-39c36a55-28c6-4004-bba7-b4a6e19611c0 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5097adbf553e4e319d2cb0cf383f587a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77abdb9b52614d1fbd6d70774a2df31f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:24.314034 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-39c36a55-28c6-4004-bba7-b4a6e19611c0 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5097adbf553e4e319d2cb0cf383f587a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77abdb9b52614d1fbd6d70774a2df31f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:24.323221 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-39c36a55-28c6-4004-bba7-b4a6e19611c0 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] 10.222.0.70 "GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec" status: 200 len: 1447 microversion: 2.75 time: 0.155979 Aug 27 02:55:24.324558 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1532/3065] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:55:24 2022] GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec => generated 1447 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:55:24.350804 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-40a6a537-baa9-4fa3-b970-74eff6393be6 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:55:24.354683 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-40a6a537-baa9-4fa3-b970-74eff6393be6 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 2d6bf535-89e0-4c21-b2cf-fafcf18c4f18] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:24.362374 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-40a6a537-baa9-4fa3-b970-74eff6393be6 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:24.363120 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-40a6a537-baa9-4fa3-b970-74eff6393be6 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:24.363701 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-40a6a537-baa9-4fa3-b970-74eff6393be6 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:24.364525 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-40a6a537-baa9-4fa3-b970-74eff6393be6 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:24.365355 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-40a6a537-baa9-4fa3-b970-74eff6393be6 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:24.366233 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-40a6a537-baa9-4fa3-b970-74eff6393be6 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:24.368883 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0c239a26-535e-43ae-96b3-ef53d0a27071 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:24.386557 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0c239a26-535e-43ae-96b3-ef53d0a27071 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:24.388465 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0c239a26-535e-43ae-96b3-ef53d0a27071 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:24.390163 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-0c239a26-535e-43ae-96b3-ef53d0a27071 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] 10.222.0.70 "GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7" status: 200 len: 1879 microversion: 2.32 time: 0.321403 Aug 27 02:55:24.394049 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1534/3066] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:55:24 2022] GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 => generated 1879 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:55:24.439633 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-40a6a537-baa9-4fa3-b970-74eff6393be6 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "POST /compute/v2.1/servers/2d6bf535-89e0-4c21-b2cf-fafcf18c4f18/action" status: 200 len: 8204 microversion: 2.1 time: 0.104722 Aug 27 02:55:24.441956 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1533/3067] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 02:55:24 2022] POST /compute/v2.1/servers/2d6bf535-89e0-4c21-b2cf-fafcf18c4f18/action => generated 8204 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:55:24.453551 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b99d261e-718c-4ce8-b383-f1eca2db6135 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:24.454441 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b99d261e-718c-4ce8-b383-f1eca2db6135 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:24.462843 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b99d261e-718c-4ce8-b383-f1eca2db6135 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:24.463337 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b99d261e-718c-4ce8-b383-f1eca2db6135 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:24.463773 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b99d261e-718c-4ce8-b383-f1eca2db6135 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:24.464549 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b99d261e-718c-4ce8-b383-f1eca2db6135 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:24.465012 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b99d261e-718c-4ce8-b383-f1eca2db6135 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:24.465434 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b99d261e-718c-4ce8-b383-f1eca2db6135 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:24.495031 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a5b5e7e5-3f8c-4e4f-955e-b54822520b9e tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:24.496161 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-a5b5e7e5-3f8c-4e4f-955e-b54822520b9e tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] [instance: d93fa48e-eff8-43b7-a1d9-a8199c8c0db9] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:24.504051 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a5b5e7e5-3f8c-4e4f-955e-b54822520b9e tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:24.504587 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a5b5e7e5-3f8c-4e4f-955e-b54822520b9e tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:24.505213 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a5b5e7e5-3f8c-4e4f-955e-b54822520b9e tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:24.506129 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a5b5e7e5-3f8c-4e4f-955e-b54822520b9e tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:24.506754 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a5b5e7e5-3f8c-4e4f-955e-b54822520b9e tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:24.507360 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a5b5e7e5-3f8c-4e4f-955e-b54822520b9e tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:24.671518 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b99d261e-718c-4ce8-b383-f1eca2db6135 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:24.681479 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b99d261e-718c-4ce8-b383-f1eca2db6135 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1668 microversion: 2.1 time: 0.232354 Aug 27 02:55:24.682549 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1535/3068] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:24 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1668 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:55:24.703657 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-a5b5e7e5-3f8c-4e4f-955e-b54822520b9e tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8ecf90321841438b77fdceed1e6ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f84ee02bd14800bc5a4212a3746e9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:24.709709 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-44ba1d20-87f9-4ffd-a95b-87754b5e138f tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:24.710651 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-44ba1d20-87f9-4ffd-a95b-87754b5e138f tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: cafa2fd0-80bd-413c-a7ae-4cb7b3c2a573] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:24.717311 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a5b5e7e5-3f8c-4e4f-955e-b54822520b9e tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] 10.222.0.70 "GET /compute/v2.1/servers/d93fa48e-eff8-43b7-a1d9-a8199c8c0db9" status: 200 len: 1317 microversion: 2.1 time: 0.227482 Aug 27 02:55:24.718681 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-44ba1d20-87f9-4ffd-a95b-87754b5e138f tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:24.719421 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-44ba1d20-87f9-4ffd-a95b-87754b5e138f tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:24.719916 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-44ba1d20-87f9-4ffd-a95b-87754b5e138f tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:24.720695 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-44ba1d20-87f9-4ffd-a95b-87754b5e138f tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:24.721337 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-44ba1d20-87f9-4ffd-a95b-87754b5e138f tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:24.721914 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-44ba1d20-87f9-4ffd-a95b-87754b5e138f tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:24.722261 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1534/3069] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:24 2022] GET /compute/v2.1/servers/d93fa48e-eff8-43b7-a1d9-a8199c8c0db9 => generated 1317 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:55:24.729997 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-9fbf5161-8e9c-4ddb-8e15-4ef1e7f77478 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:24.730619 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-9fbf5161-8e9c-4ddb-8e15-4ef1e7f77478 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:24.737089 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9fbf5161-8e9c-4ddb-8e15-4ef1e7f77478 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:24.737565 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9fbf5161-8e9c-4ddb-8e15-4ef1e7f77478 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:24.738059 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9fbf5161-8e9c-4ddb-8e15-4ef1e7f77478 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:24.739002 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9fbf5161-8e9c-4ddb-8e15-4ef1e7f77478 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:24.739461 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9fbf5161-8e9c-4ddb-8e15-4ef1e7f77478 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:24.739880 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9fbf5161-8e9c-4ddb-8e15-4ef1e7f77478 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:24.962161 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-44ba1d20-87f9-4ffd-a95b-87754b5e138f tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:24.966046 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-9fbf5161-8e9c-4ddb-8e15-4ef1e7f77478 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:24.972003 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-44ba1d20-87f9-4ffd-a95b-87754b5e138f tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/cafa2fd0-80bd-413c-a7ae-4cb7b3c2a573" status: 200 len: 1314 microversion: 2.1 time: 0.272918 Aug 27 02:55:24.973274 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1536/3070] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:24 2022] GET /compute/v2.1/servers/cafa2fd0-80bd-413c-a7ae-4cb7b3c2a573 => generated 1314 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:55:24.978122 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b9c6acda-dfe2-4ae5-b6d1-ecc4b81d33f6 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:24.978765 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b9c6acda-dfe2-4ae5-b6d1-ecc4b81d33f6 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] [instance: e010b43a-87fc-43cf-9ab8-6db75becb702] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:24.985175 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b9c6acda-dfe2-4ae5-b6d1-ecc4b81d33f6 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:24.985582 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b9c6acda-dfe2-4ae5-b6d1-ecc4b81d33f6 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:24.986013 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b9c6acda-dfe2-4ae5-b6d1-ecc4b81d33f6 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:24.986828 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b9c6acda-dfe2-4ae5-b6d1-ecc4b81d33f6 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:24.987261 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b9c6acda-dfe2-4ae5-b6d1-ecc4b81d33f6 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:24.987679 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b9c6acda-dfe2-4ae5-b6d1-ecc4b81d33f6 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:24.994452 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-9fbf5161-8e9c-4ddb-8e15-4ef1e7f77478 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1668 microversion: 2.1 time: 0.271041 Aug 27 02:55:24.995185 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1535/3071] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:24 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1668 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:55:25.004249 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-b9c6acda-dfe2-4ae5-b6d1-ecc4b81d33f6 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] HTTP exception thrown: Instance e010b43a-87fc-43cf-9ab8-6db75becb702 could not be found. Aug 27 02:55:25.006019 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b9c6acda-dfe2-4ae5-b6d1-ecc4b81d33f6 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Request method failure captured: Aug 27 02:55:25.006019 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/servers/e010b43a-87fc-43cf-9ab8-6db75becb702 HTTP/1.1 Aug 27 02:55:25.006019 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:55:25.006019 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:55:25.006019 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:55:25.006019 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:55:25.006019 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:55:25.006019 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:55:25.006019 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:55:25.006019 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:55:25.006019 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYa6jxAiv7Ivf74NMfGucxC3HYIS_vYIE1pGlCTUoC-crVbgzy-AQHAL3xArrXAQuFmegXJQKx-G4la5NLXFH_vNd7fLPXuTxEw83W4WlqVhcgrHmCBlkbsMADCHeHlOC-QOBAgwbAsOYbs6cq6dqQxwMDcgtdeGEOfB2nhchgJ7ZEU Aug 27 02:55:25.006019 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:55:25.006019 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:55:25.006019 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:55:25.006019 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:55:25.006019 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:55:25.006019 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:55:25.006019 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 40794f05e8b94a0f8f087a87a58e0ba1 Aug 27 02:55:25.006019 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ImagesTestJSON-345203415 Aug 27 02:55:25.006019 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:55:25.006019 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:55:25.006019 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/40794f05e8b94a0f8f087a87a58e0ba1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_40794f05e8b94a0f8f087a87a58e0ba1", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/40794f05e8b94a0f8f087a87a58e0ba1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/40794f05e8b94a0f8f087a87a58e0ba1"}]}] Aug 27 02:55:25.006019 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ImagesTestJSON-345203415 Aug 27 02:55:25.006019 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 40794f05e8b94a0f8f087a87a58e0ba1 Aug 27 02:55:25.006019 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ImagesTestJSON-345203415 Aug 27 02:55:25.006019 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ImagesTestJSON-345203415-project Aug 27 02:55:25.006019 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:55:25.006019 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:55:25.006019 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: f496f24dccea47bd9a5ab532fe45e370 Aug 27 02:55:25.006019 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ImagesTestJSON-345203415-project Aug 27 02:55:25.006019 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 02:55:25.006019 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance e010b43a-87fc-43cf-9ab8-6db75becb702 could not be found. Aug 27 02:55:25.006019 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': 'e010b43a-87fc-43cf-9ab8-6db75becb702'} Aug 27 02:55:25.006019 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:55:25.006019 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:25.006019 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:55:25.006019 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:55:25.006019 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:55:25.006019 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:55:25.006019 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:55:25.006019 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:55:25.006019 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:55:25.006019 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:55:25.006019 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e010b43a-87fc-43cf-9ab8-6db75becb702 could not be found. Aug 27 02:55:25.006019 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:25.006019 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:55:25.006019 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:25.006019 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:25.006019 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:55:25.006019 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:55:25.006019 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:55:25.006019 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:55:25.006019 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:55:25.006019 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:55:25.006019 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:55:25.006019 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:55:25.006019 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:55:25.006019 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:55:25.006019 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:55:25.006019 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:55:25.006019 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e010b43a-87fc-43cf-9ab8-6db75becb702 could not be found. Aug 27 02:55:25.006019 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:25.006019 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:55:25.006019 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:25.006019 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:25.010684 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:55:25.010684 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:55:25.010684 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:55:25.010684 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:55:25.010684 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e010b43a-87fc-43cf-9ab8-6db75becb702 could not be found. Aug 27 02:55:25.010684 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:25.010684 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b9c6acda-dfe2-4ae5-b6d1-ecc4b81d33f6 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Returning 404 to user: Instance e010b43a-87fc-43cf-9ab8-6db75becb702 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:55:25.010684 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b9c6acda-dfe2-4ae5-b6d1-ecc4b81d33f6 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "GET /compute/v2.1/servers/e010b43a-87fc-43cf-9ab8-6db75becb702" status: 404 len: 111 microversion: 2.1 time: 0.032973 Aug 27 02:55:25.010684 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1537/3072] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:24 2022] GET /compute/v2.1/servers/e010b43a-87fc-43cf-9ab8-6db75becb702 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:55:25.016120 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d00050ed-40ee-4832-91df-d3ce18eb36d7 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:25.016305 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f9201291-0954-41a9-8b11-8dc552f79a19 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '.version_select at 0x7f5ee251f280>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:25.016897 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d00050ed-40ee-4832-91df-d3ce18eb36d7 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:25.022993 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d00050ed-40ee-4832-91df-d3ce18eb36d7 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:25.023555 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d00050ed-40ee-4832-91df-d3ce18eb36d7 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:25.024064 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d00050ed-40ee-4832-91df-d3ce18eb36d7 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:25.024855 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d00050ed-40ee-4832-91df-d3ce18eb36d7 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:25.032728 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d00050ed-40ee-4832-91df-d3ce18eb36d7 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:25.034224 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d00050ed-40ee-4832-91df-d3ce18eb36d7 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:25.046581 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-f9201291-0954-41a9-8b11-8dc552f79a19 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] HTTP exception thrown: Image not found. Aug 27 02:55:25.048489 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f9201291-0954-41a9-8b11-8dc552f79a19 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Request method failure captured: Aug 27 02:55:25.048489 n-d-852278-4 devstack@n-api.service[134052]: request: DELETE /compute/v2.1/images/57627f6b-d2bf-4292-a3b4-db93ad1b2e3f HTTP/1.1 Aug 27 02:55:25.048489 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:55:25.048489 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:55:25.048489 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:55:25.048489 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:55:25.048489 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:55:25.048489 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:55:25.048489 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:55:25.048489 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:55:25.048489 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYa6jxAiv7Ivf74NMfGucxC3HYIS_vYIE1pGlCTUoC-crVbgzy-AQHAL3xArrXAQuFmegXJQKx-G4la5NLXFH_vNd7fLPXuTxEw83W4WlqVhcgrHmCBlkbsMADCHeHlOC-QOBAgwbAsOYbs6cq6dqQxwMDcgtdeGEOfB2nhchgJ7ZEU Aug 27 02:55:25.048489 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:55:25.048489 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:55:25.048489 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:55:25.048489 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:55:25.048489 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:55:25.048489 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:55:25.048489 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 40794f05e8b94a0f8f087a87a58e0ba1 Aug 27 02:55:25.048489 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ImagesTestJSON-345203415 Aug 27 02:55:25.048489 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:55:25.048489 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:55:25.048489 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/40794f05e8b94a0f8f087a87a58e0ba1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_40794f05e8b94a0f8f087a87a58e0ba1", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/40794f05e8b94a0f8f087a87a58e0ba1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/40794f05e8b94a0f8f087a87a58e0ba1"}]}] Aug 27 02:55:25.048489 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ImagesTestJSON-345203415 Aug 27 02:55:25.048489 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 40794f05e8b94a0f8f087a87a58e0ba1 Aug 27 02:55:25.048489 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ImagesTestJSON-345203415 Aug 27 02:55:25.048489 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ImagesTestJSON-345203415-project Aug 27 02:55:25.048489 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:55:25.048489 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:55:25.048489 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: f496f24dccea47bd9a5ab532fe45e370 Aug 27 02:55:25.048489 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ImagesTestJSON-345203415-project Aug 27 02:55:25.048489 n-d-852278-4 devstack@n-api.service[134052]: method: Aug 27 02:55:25.048489 n-d-852278-4 devstack@n-api.service[134052]: exception: Image not found. Aug 27 02:55:25.048489 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '57627f6b-d2bf-4292-a3b4-db93ad1b2e3f'} Aug 27 02:55:25.048489 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:55:25.048489 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:25.048489 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 27 02:55:25.048489 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 27 02:55:25.048489 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 02:55:25.048489 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 02:55:25.048489 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 02:55:25.048489 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 02:55:25.048489 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 27 02:55:25.048489 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 27 02:55:25.048489 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 27 02:55:25.048489 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 27 02:55:25.048489 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 02:55:25.048489 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 02:55:25.048489 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 02:55:25.048489 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 02:55:25.048489 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 57627f6b-d2bf-4292-a3b4-db93ad1b2e3f to delete Aug 27 02:55:25.048489 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:25.048489 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:55:25.048489 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:25.048489 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:25.048489 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 27 02:55:25.048489 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 27 02:55:25.048489 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 27 02:55:25.048489 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 27 02:55:25.048489 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 27 02:55:25.048489 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 27 02:55:25.048489 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 57627f6b-d2bf-4292-a3b4-db93ad1b2e3f could not be found. Aug 27 02:55:25.048489 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:25.048489 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:55:25.048489 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:25.048489 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:25.054502 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:55:25.054502 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:55:25.054502 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:55:25.054502 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:55:25.054502 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:55:25.054502 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:55:25.054502 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:55:25.054502 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:55:25.054502 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 27 02:55:25.054502 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 27 02:55:25.054502 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 02:55:25.054502 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:25.054502 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:55:25.054502 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:25.054502 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:25.054502 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:55:25.054502 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:55:25.054502 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:55:25.054502 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:55:25.054502 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 02:55:25.054502 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:25.054502 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f9201291-0954-41a9-8b11-8dc552f79a19 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Returning 404 to user: Image not found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:55:25.054502 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f9201291-0954-41a9-8b11-8dc552f79a19 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "DELETE /compute/v2.1/images/57627f6b-d2bf-4292-a3b4-db93ad1b2e3f" status: 404 len: 62 microversion: 2.1 time: 0.038060 Aug 27 02:55:25.054502 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1538/3073] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:25 2022] DELETE /compute/v2.1/images/57627f6b-d2bf-4292-a3b4-db93ad1b2e3f => generated 62 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 27 02:55:25.059951 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-1a59528d-58ee-4686-887b-e9eab310930b tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:25.060628 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-1a59528d-58ee-4686-887b-e9eab310930b tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] [instance: cb02560c-ca90-41f2-8e4a-1fe0f0494068] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:25.067931 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1a59528d-58ee-4686-887b-e9eab310930b tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:25.068455 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1a59528d-58ee-4686-887b-e9eab310930b tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:25.068887 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1a59528d-58ee-4686-887b-e9eab310930b tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:25.069599 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1a59528d-58ee-4686-887b-e9eab310930b tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:25.070056 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1a59528d-58ee-4686-887b-e9eab310930b tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:25.070504 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1a59528d-58ee-4686-887b-e9eab310930b tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:25.085298 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-1a59528d-58ee-4686-887b-e9eab310930b tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] HTTP exception thrown: Instance cb02560c-ca90-41f2-8e4a-1fe0f0494068 could not be found. Aug 27 02:55:25.086911 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-1a59528d-58ee-4686-887b-e9eab310930b tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Request method failure captured: Aug 27 02:55:25.086911 n-d-852278-4 devstack@n-api.service[134052]: request: DELETE /compute/v2.1/servers/cb02560c-ca90-41f2-8e4a-1fe0f0494068 HTTP/1.1 Aug 27 02:55:25.086911 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:55:25.086911 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:55:25.086911 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:55:25.086911 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:55:25.086911 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:55:25.086911 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:55:25.086911 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:55:25.086911 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:55:25.086911 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYa6jxAiv7Ivf74NMfGucxC3HYIS_vYIE1pGlCTUoC-crVbgzy-AQHAL3xArrXAQuFmegXJQKx-G4la5NLXFH_vNd7fLPXuTxEw83W4WlqVhcgrHmCBlkbsMADCHeHlOC-QOBAgwbAsOYbs6cq6dqQxwMDcgtdeGEOfB2nhchgJ7ZEU Aug 27 02:55:25.086911 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:55:25.086911 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:55:25.086911 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:55:25.086911 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:55:25.086911 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:55:25.086911 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:55:25.086911 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 40794f05e8b94a0f8f087a87a58e0ba1 Aug 27 02:55:25.086911 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ImagesTestJSON-345203415 Aug 27 02:55:25.086911 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:55:25.086911 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:55:25.086911 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/40794f05e8b94a0f8f087a87a58e0ba1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_40794f05e8b94a0f8f087a87a58e0ba1", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/40794f05e8b94a0f8f087a87a58e0ba1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/40794f05e8b94a0f8f087a87a58e0ba1"}]}] Aug 27 02:55:25.086911 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ImagesTestJSON-345203415 Aug 27 02:55:25.086911 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 40794f05e8b94a0f8f087a87a58e0ba1 Aug 27 02:55:25.086911 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ImagesTestJSON-345203415 Aug 27 02:55:25.086911 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ImagesTestJSON-345203415-project Aug 27 02:55:25.086911 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:55:25.086911 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:55:25.086911 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: f496f24dccea47bd9a5ab532fe45e370 Aug 27 02:55:25.086911 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ImagesTestJSON-345203415-project Aug 27 02:55:25.086911 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 02:55:25.086911 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance cb02560c-ca90-41f2-8e4a-1fe0f0494068 could not be found. Aug 27 02:55:25.086911 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': 'cb02560c-ca90-41f2-8e4a-1fe0f0494068'} Aug 27 02:55:25.086911 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:55:25.086911 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:25.086911 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:55:25.086911 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:55:25.086911 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:55:25.086911 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:55:25.086911 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:55:25.086911 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:55:25.086911 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:55:25.086911 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:55:25.086911 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb02560c-ca90-41f2-8e4a-1fe0f0494068 could not be found. Aug 27 02:55:25.086911 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:25.086911 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:55:25.086911 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:25.086911 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:25.086911 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:55:25.086911 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:55:25.086911 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:55:25.086911 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:55:25.086911 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:55:25.086911 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:55:25.086911 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 02:55:25.086911 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 02:55:25.086911 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 02:55:25.086911 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 02:55:25.086911 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:55:25.086911 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:55:25.086911 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:55:25.086911 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:55:25.086911 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb02560c-ca90-41f2-8e4a-1fe0f0494068 could not be found. Aug 27 02:55:25.092209 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:25.092209 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:55:25.092209 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:25.092209 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:25.092209 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:55:25.092209 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:55:25.092209 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:55:25.092209 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:55:25.092209 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb02560c-ca90-41f2-8e4a-1fe0f0494068 could not be found. Aug 27 02:55:25.092209 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:25.092209 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-1a59528d-58ee-4686-887b-e9eab310930b tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Returning 404 to user: Instance cb02560c-ca90-41f2-8e4a-1fe0f0494068 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:55:25.092209 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-1a59528d-58ee-4686-887b-e9eab310930b tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "DELETE /compute/v2.1/servers/cb02560c-ca90-41f2-8e4a-1fe0f0494068" status: 404 len: 111 microversion: 2.1 time: 0.032459 Aug 27 02:55:25.093240 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1539/3074] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:55:25 2022] DELETE /compute/v2.1/servers/cb02560c-ca90-41f2-8e4a-1fe0f0494068 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 02:55:25.097342 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-7ca20d07-7477-4909-96c2-37ca73ddaba2 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:25.097952 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-7ca20d07-7477-4909-96c2-37ca73ddaba2 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] [instance: cb02560c-ca90-41f2-8e4a-1fe0f0494068] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:25.104649 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7ca20d07-7477-4909-96c2-37ca73ddaba2 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:25.105232 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7ca20d07-7477-4909-96c2-37ca73ddaba2 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:25.105814 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7ca20d07-7477-4909-96c2-37ca73ddaba2 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:25.106768 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7ca20d07-7477-4909-96c2-37ca73ddaba2 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:25.107221 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7ca20d07-7477-4909-96c2-37ca73ddaba2 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:25.107646 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7ca20d07-7477-4909-96c2-37ca73ddaba2 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:25.121794 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-7ca20d07-7477-4909-96c2-37ca73ddaba2 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] HTTP exception thrown: Instance cb02560c-ca90-41f2-8e4a-1fe0f0494068 could not be found. Aug 27 02:55:25.123357 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-7ca20d07-7477-4909-96c2-37ca73ddaba2 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Request method failure captured: Aug 27 02:55:25.123357 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/servers/cb02560c-ca90-41f2-8e4a-1fe0f0494068 HTTP/1.1 Aug 27 02:55:25.123357 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:55:25.123357 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:55:25.123357 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:55:25.123357 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:55:25.123357 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:55:25.123357 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:55:25.123357 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:55:25.123357 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:55:25.123357 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYa6jxAiv7Ivf74NMfGucxC3HYIS_vYIE1pGlCTUoC-crVbgzy-AQHAL3xArrXAQuFmegXJQKx-G4la5NLXFH_vNd7fLPXuTxEw83W4WlqVhcgrHmCBlkbsMADCHeHlOC-QOBAgwbAsOYbs6cq6dqQxwMDcgtdeGEOfB2nhchgJ7ZEU Aug 27 02:55:25.123357 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:55:25.123357 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:55:25.123357 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:55:25.123357 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:55:25.123357 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:55:25.123357 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:55:25.123357 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 40794f05e8b94a0f8f087a87a58e0ba1 Aug 27 02:55:25.123357 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ImagesTestJSON-345203415 Aug 27 02:55:25.123357 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:55:25.123357 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:55:25.123357 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/40794f05e8b94a0f8f087a87a58e0ba1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_40794f05e8b94a0f8f087a87a58e0ba1", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/40794f05e8b94a0f8f087a87a58e0ba1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/40794f05e8b94a0f8f087a87a58e0ba1"}]}] Aug 27 02:55:25.123357 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ImagesTestJSON-345203415 Aug 27 02:55:25.123357 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 40794f05e8b94a0f8f087a87a58e0ba1 Aug 27 02:55:25.123357 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ImagesTestJSON-345203415 Aug 27 02:55:25.123357 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ImagesTestJSON-345203415-project Aug 27 02:55:25.123357 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:55:25.123357 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:55:25.123357 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: f496f24dccea47bd9a5ab532fe45e370 Aug 27 02:55:25.123357 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ImagesTestJSON-345203415-project Aug 27 02:55:25.123357 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 02:55:25.123357 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance cb02560c-ca90-41f2-8e4a-1fe0f0494068 could not be found. Aug 27 02:55:25.123357 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': 'cb02560c-ca90-41f2-8e4a-1fe0f0494068'} Aug 27 02:55:25.123357 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:55:25.123357 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:25.123357 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:55:25.123357 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:55:25.123357 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:55:25.123357 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:55:25.123357 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:55:25.123357 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:55:25.123357 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:55:25.123357 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:55:25.123357 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb02560c-ca90-41f2-8e4a-1fe0f0494068 could not be found. Aug 27 02:55:25.123357 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:25.123357 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:55:25.123357 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:25.123357 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:25.123357 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:55:25.123357 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:55:25.123357 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:55:25.123357 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:55:25.123357 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:55:25.123357 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:55:25.123357 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:55:25.123357 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:55:25.123357 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:55:25.123357 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:55:25.123357 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:55:25.123357 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:55:25.123357 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb02560c-ca90-41f2-8e4a-1fe0f0494068 could not be found. Aug 27 02:55:25.123357 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:25.123357 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:55:25.123357 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:25.123357 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:25.128802 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:55:25.128802 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:55:25.128802 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:55:25.128802 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:55:25.128802 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb02560c-ca90-41f2-8e4a-1fe0f0494068 could not be found. Aug 27 02:55:25.128802 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:25.128802 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-7ca20d07-7477-4909-96c2-37ca73ddaba2 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Returning 404 to user: Instance cb02560c-ca90-41f2-8e4a-1fe0f0494068 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:55:25.128802 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-7ca20d07-7477-4909-96c2-37ca73ddaba2 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "GET /compute/v2.1/servers/cb02560c-ca90-41f2-8e4a-1fe0f0494068" status: 404 len: 111 microversion: 2.1 time: 0.031313 Aug 27 02:55:25.128802 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1540/3075] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:25 2022] GET /compute/v2.1/servers/cb02560c-ca90-41f2-8e4a-1fe0f0494068 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:55:25.133444 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0139a591-582f-4cb7-9152-56beee5bb9be tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '.version_select at 0x7f5ee2438c10>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:25.156084 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-0139a591-582f-4cb7-9152-56beee5bb9be tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] HTTP exception thrown: Image not found. Aug 27 02:55:25.158011 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0139a591-582f-4cb7-9152-56beee5bb9be tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Request method failure captured: Aug 27 02:55:25.158011 n-d-852278-4 devstack@n-api.service[134052]: request: DELETE /compute/v2.1/images/50103730-0d32-4451-b672-ca0cdb239f81 HTTP/1.1 Aug 27 02:55:25.158011 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:55:25.158011 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:55:25.158011 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:55:25.158011 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:55:25.158011 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:55:25.158011 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:55:25.158011 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:55:25.158011 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:55:25.158011 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYa6jxAiv7Ivf74NMfGucxC3HYIS_vYIE1pGlCTUoC-crVbgzy-AQHAL3xArrXAQuFmegXJQKx-G4la5NLXFH_vNd7fLPXuTxEw83W4WlqVhcgrHmCBlkbsMADCHeHlOC-QOBAgwbAsOYbs6cq6dqQxwMDcgtdeGEOfB2nhchgJ7ZEU Aug 27 02:55:25.158011 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:55:25.158011 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:55:25.158011 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:55:25.158011 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:55:25.158011 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:55:25.158011 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:55:25.158011 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 40794f05e8b94a0f8f087a87a58e0ba1 Aug 27 02:55:25.158011 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ImagesTestJSON-345203415 Aug 27 02:55:25.158011 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:55:25.158011 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:55:25.158011 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/40794f05e8b94a0f8f087a87a58e0ba1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_40794f05e8b94a0f8f087a87a58e0ba1", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/40794f05e8b94a0f8f087a87a58e0ba1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/40794f05e8b94a0f8f087a87a58e0ba1"}]}] Aug 27 02:55:25.158011 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ImagesTestJSON-345203415 Aug 27 02:55:25.158011 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 40794f05e8b94a0f8f087a87a58e0ba1 Aug 27 02:55:25.158011 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ImagesTestJSON-345203415 Aug 27 02:55:25.158011 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ImagesTestJSON-345203415-project Aug 27 02:55:25.158011 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:55:25.158011 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:55:25.158011 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: f496f24dccea47bd9a5ab532fe45e370 Aug 27 02:55:25.158011 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ImagesTestJSON-345203415-project Aug 27 02:55:25.158011 n-d-852278-4 devstack@n-api.service[134052]: method: Aug 27 02:55:25.158011 n-d-852278-4 devstack@n-api.service[134052]: exception: Image not found. Aug 27 02:55:25.158011 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '50103730-0d32-4451-b672-ca0cdb239f81'} Aug 27 02:55:25.158011 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:55:25.158011 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:25.158011 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 27 02:55:25.158011 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 27 02:55:25.158011 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 02:55:25.158011 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 02:55:25.158011 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 02:55:25.158011 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 02:55:25.158011 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 27 02:55:25.158011 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 27 02:55:25.158011 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 27 02:55:25.158011 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 27 02:55:25.158011 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 02:55:25.158011 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 02:55:25.158011 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 02:55:25.158011 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 02:55:25.158011 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 50103730-0d32-4451-b672-ca0cdb239f81 to delete Aug 27 02:55:25.158011 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:25.158011 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:55:25.158011 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:25.158011 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:25.158011 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 27 02:55:25.158011 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 27 02:55:25.158011 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 27 02:55:25.158011 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 27 02:55:25.158011 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 27 02:55:25.158011 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 27 02:55:25.158011 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 50103730-0d32-4451-b672-ca0cdb239f81 could not be found. Aug 27 02:55:25.158011 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:25.158011 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:55:25.158011 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:25.158011 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:25.163702 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:55:25.163702 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:55:25.163702 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:55:25.163702 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:55:25.163702 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:55:25.163702 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:55:25.163702 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:55:25.163702 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:55:25.163702 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 27 02:55:25.163702 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 27 02:55:25.163702 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 02:55:25.163702 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:25.163702 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:55:25.163702 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:25.163702 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:25.163702 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:55:25.163702 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:55:25.163702 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:55:25.163702 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:55:25.163702 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 02:55:25.163702 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:25.163702 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0139a591-582f-4cb7-9152-56beee5bb9be tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Returning 404 to user: Image not found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:55:25.163702 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-0139a591-582f-4cb7-9152-56beee5bb9be tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "DELETE /compute/v2.1/images/50103730-0d32-4451-b672-ca0cdb239f81" status: 404 len: 62 microversion: 2.1 time: 0.029649 Aug 27 02:55:25.163702 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1541/3076] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:25 2022] DELETE /compute/v2.1/images/50103730-0d32-4451-b672-ca0cdb239f81 => generated 62 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 02:55:25.169402 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4f575e40-c84e-4c4d-a7a5-66d9efdfca36 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:25.169664 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-4f575e40-c84e-4c4d-a7a5-66d9efdfca36 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] [instance: 546a5816-c2d9-494b-8c23-b0983cd11eb9] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:25.178846 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4f575e40-c84e-4c4d-a7a5-66d9efdfca36 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:25.179344 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4f575e40-c84e-4c4d-a7a5-66d9efdfca36 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:25.179783 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4f575e40-c84e-4c4d-a7a5-66d9efdfca36 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:25.181061 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4f575e40-c84e-4c4d-a7a5-66d9efdfca36 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:25.181359 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4f575e40-c84e-4c4d-a7a5-66d9efdfca36 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:25.182118 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4f575e40-c84e-4c4d-a7a5-66d9efdfca36 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:25.196908 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d00050ed-40ee-4832-91df-d3ce18eb36d7 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:25.198645 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-4f575e40-c84e-4c4d-a7a5-66d9efdfca36 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] HTTP exception thrown: Instance 546a5816-c2d9-494b-8c23-b0983cd11eb9 could not be found. Aug 27 02:55:25.200499 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4f575e40-c84e-4c4d-a7a5-66d9efdfca36 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Request method failure captured: Aug 27 02:55:25.200499 n-d-852278-4 devstack@n-api.service[134052]: request: DELETE /compute/v2.1/servers/546a5816-c2d9-494b-8c23-b0983cd11eb9 HTTP/1.1 Aug 27 02:55:25.200499 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:55:25.200499 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:55:25.200499 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:55:25.200499 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:55:25.200499 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:55:25.200499 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:55:25.200499 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:55:25.200499 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:55:25.200499 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYa6jxAiv7Ivf74NMfGucxC3HYIS_vYIE1pGlCTUoC-crVbgzy-AQHAL3xArrXAQuFmegXJQKx-G4la5NLXFH_vNd7fLPXuTxEw83W4WlqVhcgrHmCBlkbsMADCHeHlOC-QOBAgwbAsOYbs6cq6dqQxwMDcgtdeGEOfB2nhchgJ7ZEU Aug 27 02:55:25.200499 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:55:25.200499 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:55:25.200499 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:55:25.200499 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:55:25.200499 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:55:25.200499 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:55:25.200499 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 40794f05e8b94a0f8f087a87a58e0ba1 Aug 27 02:55:25.200499 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ImagesTestJSON-345203415 Aug 27 02:55:25.200499 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:55:25.200499 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:55:25.200499 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/40794f05e8b94a0f8f087a87a58e0ba1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_40794f05e8b94a0f8f087a87a58e0ba1", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/40794f05e8b94a0f8f087a87a58e0ba1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/40794f05e8b94a0f8f087a87a58e0ba1"}]}] Aug 27 02:55:25.200499 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ImagesTestJSON-345203415 Aug 27 02:55:25.200499 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 40794f05e8b94a0f8f087a87a58e0ba1 Aug 27 02:55:25.200499 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ImagesTestJSON-345203415 Aug 27 02:55:25.200499 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ImagesTestJSON-345203415-project Aug 27 02:55:25.200499 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:55:25.200499 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:55:25.200499 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: f496f24dccea47bd9a5ab532fe45e370 Aug 27 02:55:25.200499 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ImagesTestJSON-345203415-project Aug 27 02:55:25.200499 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 02:55:25.200499 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance 546a5816-c2d9-494b-8c23-b0983cd11eb9 could not be found. Aug 27 02:55:25.200499 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '546a5816-c2d9-494b-8c23-b0983cd11eb9'} Aug 27 02:55:25.200499 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:55:25.200499 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:25.200499 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:55:25.200499 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:55:25.200499 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:55:25.200499 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:55:25.200499 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:55:25.200499 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:55:25.200499 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:55:25.200499 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:55:25.200499 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 546a5816-c2d9-494b-8c23-b0983cd11eb9 could not be found. Aug 27 02:55:25.200499 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:25.200499 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:55:25.200499 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:25.200499 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:25.200499 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:55:25.200499 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:55:25.200499 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:55:25.200499 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:55:25.200499 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:55:25.200499 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:55:25.200499 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 02:55:25.200499 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 02:55:25.200499 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 02:55:25.200499 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 02:55:25.200499 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:55:25.200499 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:55:25.200499 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:55:25.200499 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:55:25.200499 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 546a5816-c2d9-494b-8c23-b0983cd11eb9 could not be found. Aug 27 02:55:25.205339 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:25.205339 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:55:25.205339 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:25.205339 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:25.205339 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:55:25.205339 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:55:25.205339 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:55:25.205339 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:55:25.205339 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 546a5816-c2d9-494b-8c23-b0983cd11eb9 could not be found. Aug 27 02:55:25.205339 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:25.205339 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4f575e40-c84e-4c4d-a7a5-66d9efdfca36 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Returning 404 to user: Instance 546a5816-c2d9-494b-8c23-b0983cd11eb9 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:55:25.205339 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-4f575e40-c84e-4c4d-a7a5-66d9efdfca36 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "DELETE /compute/v2.1/servers/546a5816-c2d9-494b-8c23-b0983cd11eb9" status: 404 len: 111 microversion: 2.1 time: 0.037434 Aug 27 02:55:25.205339 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1542/3077] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:55:25 2022] DELETE /compute/v2.1/servers/546a5816-c2d9-494b-8c23-b0983cd11eb9 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:55:25.210811 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8d9bb9a9-e18e-4e61-8b15-4731d6311616 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:25.211422 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-8d9bb9a9-e18e-4e61-8b15-4731d6311616 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] [instance: 546a5816-c2d9-494b-8c23-b0983cd11eb9] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:25.212274 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d00050ed-40ee-4832-91df-d3ce18eb36d7 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1668 microversion: 2.1 time: 0.201619 Aug 27 02:55:25.213029 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1536/3078] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:25 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1668 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:55:25.217622 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8d9bb9a9-e18e-4e61-8b15-4731d6311616 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:25.218101 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8d9bb9a9-e18e-4e61-8b15-4731d6311616 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:25.218532 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8d9bb9a9-e18e-4e61-8b15-4731d6311616 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:25.219260 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8d9bb9a9-e18e-4e61-8b15-4731d6311616 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:25.219703 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8d9bb9a9-e18e-4e61-8b15-4731d6311616 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:25.220122 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8d9bb9a9-e18e-4e61-8b15-4731d6311616 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:25.234113 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-983dcf32-ed63-484b-bbc4-fea02880f982 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:25.235018 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-983dcf32-ed63-484b-bbc4-fea02880f982 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:25.236588 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-8d9bb9a9-e18e-4e61-8b15-4731d6311616 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] HTTP exception thrown: Instance 546a5816-c2d9-494b-8c23-b0983cd11eb9 could not be found. Aug 27 02:55:25.238518 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8d9bb9a9-e18e-4e61-8b15-4731d6311616 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Request method failure captured: Aug 27 02:55:25.238518 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/servers/546a5816-c2d9-494b-8c23-b0983cd11eb9 HTTP/1.1 Aug 27 02:55:25.238518 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:55:25.238518 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:55:25.238518 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:55:25.238518 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:55:25.238518 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:55:25.238518 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:55:25.238518 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:55:25.238518 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:55:25.238518 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYa6jxAiv7Ivf74NMfGucxC3HYIS_vYIE1pGlCTUoC-crVbgzy-AQHAL3xArrXAQuFmegXJQKx-G4la5NLXFH_vNd7fLPXuTxEw83W4WlqVhcgrHmCBlkbsMADCHeHlOC-QOBAgwbAsOYbs6cq6dqQxwMDcgtdeGEOfB2nhchgJ7ZEU Aug 27 02:55:25.238518 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:55:25.238518 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:55:25.238518 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:55:25.238518 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:55:25.238518 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:55:25.238518 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:55:25.238518 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 40794f05e8b94a0f8f087a87a58e0ba1 Aug 27 02:55:25.238518 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ImagesTestJSON-345203415 Aug 27 02:55:25.238518 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:55:25.238518 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:55:25.238518 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/40794f05e8b94a0f8f087a87a58e0ba1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_40794f05e8b94a0f8f087a87a58e0ba1", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/40794f05e8b94a0f8f087a87a58e0ba1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/40794f05e8b94a0f8f087a87a58e0ba1"}]}] Aug 27 02:55:25.238518 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ImagesTestJSON-345203415 Aug 27 02:55:25.238518 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 40794f05e8b94a0f8f087a87a58e0ba1 Aug 27 02:55:25.238518 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ImagesTestJSON-345203415 Aug 27 02:55:25.238518 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ImagesTestJSON-345203415-project Aug 27 02:55:25.238518 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:55:25.238518 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:55:25.238518 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: f496f24dccea47bd9a5ab532fe45e370 Aug 27 02:55:25.238518 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ImagesTestJSON-345203415-project Aug 27 02:55:25.238518 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 02:55:25.238518 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance 546a5816-c2d9-494b-8c23-b0983cd11eb9 could not be found. Aug 27 02:55:25.238518 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '546a5816-c2d9-494b-8c23-b0983cd11eb9'} Aug 27 02:55:25.238518 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:55:25.238518 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:25.238518 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:55:25.238518 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:55:25.238518 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:55:25.238518 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:55:25.238518 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:55:25.238518 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:55:25.238518 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:55:25.238518 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:55:25.238518 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 546a5816-c2d9-494b-8c23-b0983cd11eb9 could not be found. Aug 27 02:55:25.238518 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:25.238518 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:55:25.238518 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:25.238518 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:25.238518 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:55:25.238518 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:55:25.238518 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:55:25.238518 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:55:25.238518 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:55:25.238518 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:55:25.238518 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:55:25.238518 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:55:25.238518 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:55:25.238518 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:55:25.238518 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:55:25.238518 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:55:25.238518 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 546a5816-c2d9-494b-8c23-b0983cd11eb9 could not be found. Aug 27 02:55:25.238518 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:25.238518 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:55:25.238518 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:25.238518 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:25.244124 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:55:25.244124 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:55:25.244124 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:55:25.244124 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:55:25.244124 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 546a5816-c2d9-494b-8c23-b0983cd11eb9 could not be found. Aug 27 02:55:25.244124 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:25.244605 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-983dcf32-ed63-484b-bbc4-fea02880f982 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:25.244696 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8d9bb9a9-e18e-4e61-8b15-4731d6311616 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Returning 404 to user: Instance 546a5816-c2d9-494b-8c23-b0983cd11eb9 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:55:25.244780 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-983dcf32-ed63-484b-bbc4-fea02880f982 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:25.244780 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-983dcf32-ed63-484b-bbc4-fea02880f982 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:25.244780 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-983dcf32-ed63-484b-bbc4-fea02880f982 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:25.244780 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-983dcf32-ed63-484b-bbc4-fea02880f982 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:25.245088 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-8d9bb9a9-e18e-4e61-8b15-4731d6311616 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "GET /compute/v2.1/servers/546a5816-c2d9-494b-8c23-b0983cd11eb9" status: 404 len: 111 microversion: 2.1 time: 0.036185 Aug 27 02:55:25.245171 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-983dcf32-ed63-484b-bbc4-fea02880f982 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:25.245254 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1543/3079] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:25 2022] GET /compute/v2.1/servers/546a5816-c2d9-494b-8c23-b0983cd11eb9 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 02:55:25.254061 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-27191588-0bc9-45f4-bb6b-607badafa269 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '.version_select at 0x7f5ee241f310>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:25.277493 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-27191588-0bc9-45f4-bb6b-607badafa269 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] HTTP exception thrown: Image not found. Aug 27 02:55:25.279444 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-27191588-0bc9-45f4-bb6b-607badafa269 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Request method failure captured: Aug 27 02:55:25.279444 n-d-852278-4 devstack@n-api.service[134052]: request: DELETE /compute/v2.1/images/fc902f34-89f1-4a0a-af61-22568052f001 HTTP/1.1 Aug 27 02:55:25.279444 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:55:25.279444 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:55:25.279444 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:55:25.279444 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:55:25.279444 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:55:25.279444 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:55:25.279444 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:55:25.279444 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:55:25.279444 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYa6jxAiv7Ivf74NMfGucxC3HYIS_vYIE1pGlCTUoC-crVbgzy-AQHAL3xArrXAQuFmegXJQKx-G4la5NLXFH_vNd7fLPXuTxEw83W4WlqVhcgrHmCBlkbsMADCHeHlOC-QOBAgwbAsOYbs6cq6dqQxwMDcgtdeGEOfB2nhchgJ7ZEU Aug 27 02:55:25.279444 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:55:25.279444 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:55:25.279444 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:55:25.279444 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:55:25.279444 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:55:25.279444 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:55:25.279444 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 40794f05e8b94a0f8f087a87a58e0ba1 Aug 27 02:55:25.279444 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ImagesTestJSON-345203415 Aug 27 02:55:25.279444 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:55:25.279444 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:55:25.279444 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/40794f05e8b94a0f8f087a87a58e0ba1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_40794f05e8b94a0f8f087a87a58e0ba1", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/40794f05e8b94a0f8f087a87a58e0ba1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/40794f05e8b94a0f8f087a87a58e0ba1"}]}] Aug 27 02:55:25.279444 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ImagesTestJSON-345203415 Aug 27 02:55:25.279444 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 40794f05e8b94a0f8f087a87a58e0ba1 Aug 27 02:55:25.279444 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ImagesTestJSON-345203415 Aug 27 02:55:25.279444 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ImagesTestJSON-345203415-project Aug 27 02:55:25.279444 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:55:25.279444 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:55:25.279444 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: f496f24dccea47bd9a5ab532fe45e370 Aug 27 02:55:25.279444 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ImagesTestJSON-345203415-project Aug 27 02:55:25.279444 n-d-852278-4 devstack@n-api.service[134052]: method: Aug 27 02:55:25.279444 n-d-852278-4 devstack@n-api.service[134052]: exception: Image not found. Aug 27 02:55:25.279444 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': 'fc902f34-89f1-4a0a-af61-22568052f001'} Aug 27 02:55:25.279444 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:55:25.279444 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:25.279444 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 27 02:55:25.279444 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 27 02:55:25.279444 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 02:55:25.279444 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 02:55:25.279444 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 02:55:25.279444 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 02:55:25.279444 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 27 02:55:25.279444 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 27 02:55:25.279444 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 27 02:55:25.279444 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 27 02:55:25.279444 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 02:55:25.279444 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 02:55:25.279444 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 02:55:25.279444 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 02:55:25.279444 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image fc902f34-89f1-4a0a-af61-22568052f001 to delete Aug 27 02:55:25.279444 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:25.279444 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:55:25.279444 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:25.279444 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:25.279444 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 27 02:55:25.279444 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 27 02:55:25.279444 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 27 02:55:25.279444 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 27 02:55:25.279444 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 27 02:55:25.279444 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 27 02:55:25.279444 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image fc902f34-89f1-4a0a-af61-22568052f001 could not be found. Aug 27 02:55:25.279444 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:25.279444 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:55:25.279444 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:25.279444 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:25.284023 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:55:25.284023 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:55:25.284023 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:55:25.284023 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:55:25.284023 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:55:25.284023 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:55:25.284023 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:55:25.284023 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:55:25.284023 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 27 02:55:25.284023 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 27 02:55:25.284023 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 02:55:25.284023 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:25.284023 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:55:25.284023 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:25.284023 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:25.284023 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:55:25.284023 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:55:25.284023 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:55:25.284023 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:55:25.284023 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 02:55:25.284023 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:25.284023 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-27191588-0bc9-45f4-bb6b-607badafa269 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Returning 404 to user: Image not found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:55:25.284023 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-27191588-0bc9-45f4-bb6b-607badafa269 tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "DELETE /compute/v2.1/images/fc902f34-89f1-4a0a-af61-22568052f001" status: 404 len: 62 microversion: 2.1 time: 0.030743 Aug 27 02:55:25.284023 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1544/3080] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:25 2022] DELETE /compute/v2.1/images/fc902f34-89f1-4a0a-af61-22568052f001 => generated 62 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 02:55:25.292714 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5ee92678-a144-43cc-aff4-19dd4d535b4c tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:25.293454 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-5ee92678-a144-43cc-aff4-19dd4d535b4c tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] [instance: 457da794-89e7-4b30-95ba-802c95550c7e] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:25.300659 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5ee92678-a144-43cc-aff4-19dd4d535b4c tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:25.301151 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5ee92678-a144-43cc-aff4-19dd4d535b4c tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:25.301588 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5ee92678-a144-43cc-aff4-19dd4d535b4c tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:25.302503 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5ee92678-a144-43cc-aff4-19dd4d535b4c tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:25.303251 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5ee92678-a144-43cc-aff4-19dd4d535b4c tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:25.303673 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5ee92678-a144-43cc-aff4-19dd4d535b4c tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:25.318088 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-5ee92678-a144-43cc-aff4-19dd4d535b4c tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] HTTP exception thrown: Instance 457da794-89e7-4b30-95ba-802c95550c7e could not be found. Aug 27 02:55:25.321254 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5ee92678-a144-43cc-aff4-19dd4d535b4c tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Request method failure captured: Aug 27 02:55:25.321254 n-d-852278-4 devstack@n-api.service[134052]: request: DELETE /compute/v2.1/servers/457da794-89e7-4b30-95ba-802c95550c7e HTTP/1.1 Aug 27 02:55:25.321254 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:55:25.321254 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:55:25.321254 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:55:25.321254 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:55:25.321254 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:55:25.321254 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:55:25.321254 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:55:25.321254 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:55:25.321254 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYa6jxAiv7Ivf74NMfGucxC3HYIS_vYIE1pGlCTUoC-crVbgzy-AQHAL3xArrXAQuFmegXJQKx-G4la5NLXFH_vNd7fLPXuTxEw83W4WlqVhcgrHmCBlkbsMADCHeHlOC-QOBAgwbAsOYbs6cq6dqQxwMDcgtdeGEOfB2nhchgJ7ZEU Aug 27 02:55:25.321254 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:55:25.321254 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:55:25.321254 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:55:25.321254 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:55:25.321254 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:55:25.321254 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:55:25.321254 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 40794f05e8b94a0f8f087a87a58e0ba1 Aug 27 02:55:25.321254 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ImagesTestJSON-345203415 Aug 27 02:55:25.321254 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:55:25.321254 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:55:25.321254 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/40794f05e8b94a0f8f087a87a58e0ba1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_40794f05e8b94a0f8f087a87a58e0ba1", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/40794f05e8b94a0f8f087a87a58e0ba1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/40794f05e8b94a0f8f087a87a58e0ba1"}]}] Aug 27 02:55:25.321254 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ImagesTestJSON-345203415 Aug 27 02:55:25.321254 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 40794f05e8b94a0f8f087a87a58e0ba1 Aug 27 02:55:25.321254 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ImagesTestJSON-345203415 Aug 27 02:55:25.321254 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ImagesTestJSON-345203415-project Aug 27 02:55:25.321254 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:55:25.321254 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:55:25.321254 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: f496f24dccea47bd9a5ab532fe45e370 Aug 27 02:55:25.321254 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ImagesTestJSON-345203415-project Aug 27 02:55:25.321254 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 02:55:25.321254 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance 457da794-89e7-4b30-95ba-802c95550c7e could not be found. Aug 27 02:55:25.321254 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '457da794-89e7-4b30-95ba-802c95550c7e'} Aug 27 02:55:25.321254 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:55:25.321254 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:25.321254 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:55:25.321254 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:55:25.321254 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:55:25.321254 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:55:25.321254 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:55:25.321254 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:55:25.321254 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:55:25.321254 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:55:25.321254 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 457da794-89e7-4b30-95ba-802c95550c7e could not be found. Aug 27 02:55:25.321254 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:25.321254 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:55:25.321254 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:25.321254 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:25.321254 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:55:25.321254 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:55:25.321254 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:55:25.321254 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:55:25.321254 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:55:25.321254 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:55:25.321254 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 02:55:25.321254 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 02:55:25.321254 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 02:55:25.321254 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 02:55:25.321254 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:55:25.321254 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:55:25.321254 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:55:25.321254 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:55:25.321254 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 457da794-89e7-4b30-95ba-802c95550c7e could not be found. Aug 27 02:55:25.326002 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:25.326002 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:55:25.326002 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:25.326002 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:25.326002 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:55:25.326002 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:55:25.326002 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:55:25.326002 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:55:25.326002 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 457da794-89e7-4b30-95ba-802c95550c7e could not be found. Aug 27 02:55:25.326002 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:25.326002 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5ee92678-a144-43cc-aff4-19dd4d535b4c tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Returning 404 to user: Instance 457da794-89e7-4b30-95ba-802c95550c7e could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:55:25.326002 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-5ee92678-a144-43cc-aff4-19dd4d535b4c tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "DELETE /compute/v2.1/servers/457da794-89e7-4b30-95ba-802c95550c7e" status: 404 len: 111 microversion: 2.1 time: 0.034310 Aug 27 02:55:25.326002 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1545/3081] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:55:25 2022] DELETE /compute/v2.1/servers/457da794-89e7-4b30-95ba-802c95550c7e => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:55:25.330958 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-bfe77c98-b1bc-42ca-a838-dc2cb68cda5d tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:25.331449 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-bfe77c98-b1bc-42ca-a838-dc2cb68cda5d tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] [instance: 457da794-89e7-4b30-95ba-802c95550c7e] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:25.337698 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bfe77c98-b1bc-42ca-a838-dc2cb68cda5d tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:25.338234 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bfe77c98-b1bc-42ca-a838-dc2cb68cda5d tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:25.338668 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bfe77c98-b1bc-42ca-a838-dc2cb68cda5d tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:25.339382 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bfe77c98-b1bc-42ca-a838-dc2cb68cda5d tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:25.339894 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bfe77c98-b1bc-42ca-a838-dc2cb68cda5d tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:25.340332 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bfe77c98-b1bc-42ca-a838-dc2cb68cda5d tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:25.355310 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-bfe77c98-b1bc-42ca-a838-dc2cb68cda5d tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] HTTP exception thrown: Instance 457da794-89e7-4b30-95ba-802c95550c7e could not be found. Aug 27 02:55:25.356888 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-bfe77c98-b1bc-42ca-a838-dc2cb68cda5d tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Request method failure captured: Aug 27 02:55:25.356888 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/servers/457da794-89e7-4b30-95ba-802c95550c7e HTTP/1.1 Aug 27 02:55:25.356888 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:55:25.356888 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:55:25.356888 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:55:25.356888 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:55:25.356888 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:55:25.356888 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:55:25.356888 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:55:25.356888 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:55:25.356888 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYa6jxAiv7Ivf74NMfGucxC3HYIS_vYIE1pGlCTUoC-crVbgzy-AQHAL3xArrXAQuFmegXJQKx-G4la5NLXFH_vNd7fLPXuTxEw83W4WlqVhcgrHmCBlkbsMADCHeHlOC-QOBAgwbAsOYbs6cq6dqQxwMDcgtdeGEOfB2nhchgJ7ZEU Aug 27 02:55:25.356888 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:55:25.356888 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:55:25.356888 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:55:25.356888 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:55:25.356888 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:55:25.356888 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:55:25.356888 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 40794f05e8b94a0f8f087a87a58e0ba1 Aug 27 02:55:25.356888 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ImagesTestJSON-345203415 Aug 27 02:55:25.356888 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:55:25.356888 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:55:25.356888 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/40794f05e8b94a0f8f087a87a58e0ba1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_40794f05e8b94a0f8f087a87a58e0ba1", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/40794f05e8b94a0f8f087a87a58e0ba1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/40794f05e8b94a0f8f087a87a58e0ba1"}]}] Aug 27 02:55:25.356888 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ImagesTestJSON-345203415 Aug 27 02:55:25.356888 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 40794f05e8b94a0f8f087a87a58e0ba1 Aug 27 02:55:25.356888 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ImagesTestJSON-345203415 Aug 27 02:55:25.356888 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ImagesTestJSON-345203415-project Aug 27 02:55:25.356888 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:55:25.356888 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:55:25.356888 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: f496f24dccea47bd9a5ab532fe45e370 Aug 27 02:55:25.356888 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ImagesTestJSON-345203415-project Aug 27 02:55:25.356888 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 02:55:25.356888 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance 457da794-89e7-4b30-95ba-802c95550c7e could not be found. Aug 27 02:55:25.356888 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '457da794-89e7-4b30-95ba-802c95550c7e'} Aug 27 02:55:25.356888 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:55:25.356888 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:25.356888 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:55:25.356888 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:55:25.356888 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:55:25.356888 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:55:25.356888 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:55:25.356888 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:55:25.356888 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:55:25.356888 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:55:25.356888 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 457da794-89e7-4b30-95ba-802c95550c7e could not be found. Aug 27 02:55:25.356888 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:25.356888 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:55:25.356888 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:25.356888 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:25.356888 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:55:25.356888 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:55:25.356888 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:55:25.356888 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:55:25.356888 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:55:25.356888 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:55:25.356888 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:55:25.356888 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:55:25.356888 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:55:25.356888 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:55:25.356888 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:55:25.356888 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:55:25.356888 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 457da794-89e7-4b30-95ba-802c95550c7e could not be found. Aug 27 02:55:25.356888 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:25.356888 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:55:25.356888 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:25.356888 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:25.361938 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:55:25.361938 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:55:25.361938 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:55:25.361938 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:55:25.361938 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 457da794-89e7-4b30-95ba-802c95550c7e could not be found. Aug 27 02:55:25.361938 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:25.361938 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-bfe77c98-b1bc-42ca-a838-dc2cb68cda5d tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] Returning 404 to user: Instance 457da794-89e7-4b30-95ba-802c95550c7e could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:55:25.361938 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-bfe77c98-b1bc-42ca-a838-dc2cb68cda5d tempest-ImagesTestJSON-345203415 tempest-ImagesTestJSON-345203415-project] 10.222.0.70 "GET /compute/v2.1/servers/457da794-89e7-4b30-95ba-802c95550c7e" status: 404 len: 111 microversion: 2.1 time: 0.031891 Aug 27 02:55:25.361938 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1546/3082] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:25 2022] GET /compute/v2.1/servers/457da794-89e7-4b30-95ba-802c95550c7e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 02:55:25.363703 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-aa819185-c519-4368-83c6-b57fd8ad56a1 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:25.364327 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-aa819185-c519-4368-83c6-b57fd8ad56a1 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] [instance: 3f31178a-8993-4aa6-8d41-496bfec13bec] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:25.371728 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-aa819185-c519-4368-83c6-b57fd8ad56a1 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:25.372225 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-aa819185-c519-4368-83c6-b57fd8ad56a1 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:25.372759 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-aa819185-c519-4368-83c6-b57fd8ad56a1 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:25.373471 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-aa819185-c519-4368-83c6-b57fd8ad56a1 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:25.373919 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-aa819185-c519-4368-83c6-b57fd8ad56a1 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:25.374337 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-aa819185-c519-4368-83c6-b57fd8ad56a1 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:25.470941 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-aa819185-c519-4368-83c6-b57fd8ad56a1 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5097adbf553e4e319d2cb0cf383f587a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77abdb9b52614d1fbd6d70774a2df31f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:25.480061 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-aa819185-c519-4368-83c6-b57fd8ad56a1 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5097adbf553e4e319d2cb0cf383f587a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77abdb9b52614d1fbd6d70774a2df31f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:25.482122 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-aa819185-c519-4368-83c6-b57fd8ad56a1 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5097adbf553e4e319d2cb0cf383f587a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77abdb9b52614d1fbd6d70774a2df31f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:25.487502 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-aa819185-c519-4368-83c6-b57fd8ad56a1 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] 10.222.0.70 "GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec" status: 200 len: 1447 microversion: 2.75 time: 0.127340 Aug 27 02:55:25.488406 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1547/3083] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:55:25 2022] GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec => generated 1447 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:55:25.493319 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-2c4dc92b-8cae-4535-ae51-b307de97547a tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:25.494123 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-2c4dc92b-8cae-4535-ae51-b307de97547a tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] [instance: b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:25.497553 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:55:25.501865 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2c4dc92b-8cae-4535-ae51-b307de97547a tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:25.502373 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-983dcf32-ed63-484b-bbc4-fea02880f982 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:25.502833 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2c4dc92b-8cae-4535-ae51-b307de97547a tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:25.503435 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2c4dc92b-8cae-4535-ae51-b307de97547a tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:25.504352 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2c4dc92b-8cae-4535-ae51-b307de97547a tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:25.505177 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2c4dc92b-8cae-4535-ae51-b307de97547a tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:25.505765 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2c4dc92b-8cae-4535-ae51-b307de97547a tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:25.510937 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-983dcf32-ed63-484b-bbc4-fea02880f982 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1668 microversion: 2.1 time: 0.281895 Aug 27 02:55:25.512380 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1537/3084] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:25 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1668 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:55:25.532886 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-47f516bb-dde8-4bf3-b7dd-c4d3b289c8dd tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:55:25.533931 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-47f516bb-dde8-4bf3-b7dd-c4d3b289c8dd tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:25.541452 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-47f516bb-dde8-4bf3-b7dd-c4d3b289c8dd tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:25.542087 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-47f516bb-dde8-4bf3-b7dd-c4d3b289c8dd tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:25.543044 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-47f516bb-dde8-4bf3-b7dd-c4d3b289c8dd tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:25.543997 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-47f516bb-dde8-4bf3-b7dd-c4d3b289c8dd tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:25.544797 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-47f516bb-dde8-4bf3-b7dd-c4d3b289c8dd tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:25.545429 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-47f516bb-dde8-4bf3-b7dd-c4d3b289c8dd tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:25.576747 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:55:25.603761 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-47f516bb-dde8-4bf3-b7dd-c4d3b289c8dd tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Locking {{(pid=134051) lock /opt/stack/nova/nova/compute/api.py:4843}} Aug 27 02:55:25.670547 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-47f516bb-dde8-4bf3-b7dd-c4d3b289c8dd tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "POST /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd/action" status: 202 len: 0 microversion: 2.1 time: 0.141819 Aug 27 02:55:25.671599 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1538/3085] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 02:55:25 2022] POST /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd/action => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:55:25.680498 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-78da66fa-302e-4a4f-9db8-450d18f93e8f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:25.681321 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-78da66fa-302e-4a4f-9db8-450d18f93e8f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:25.690728 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-78da66fa-302e-4a4f-9db8-450d18f93e8f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:25.691444 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-78da66fa-302e-4a4f-9db8-450d18f93e8f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:25.691915 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-78da66fa-302e-4a4f-9db8-450d18f93e8f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:25.693131 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-78da66fa-302e-4a4f-9db8-450d18f93e8f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:25.693371 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-78da66fa-302e-4a4f-9db8-450d18f93e8f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:25.694012 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-78da66fa-302e-4a4f-9db8-450d18f93e8f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:25.729513 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:55:25.795578 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-2c4dc92b-8cae-4535-ae51-b307de97547a tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:25.810711 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-2c4dc92b-8cae-4535-ae51-b307de97547a tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:25.813487 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-2c4dc92b-8cae-4535-ae51-b307de97547a tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:25.815539 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-2c4dc92b-8cae-4535-ae51-b307de97547a tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] 10.222.0.70 "GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7" status: 200 len: 1879 microversion: 2.32 time: 0.326049 Aug 27 02:55:25.829232 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1548/3086] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:55:25 2022] GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 => generated 1879 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:55:25.839651 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c92e0ff1-a02a-4e6e-849f-648ec375b9a2 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:25.840598 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-c92e0ff1-a02a-4e6e-849f-648ec375b9a2 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] [instance: d93fa48e-eff8-43b7-a1d9-a8199c8c0db9] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:25.847129 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c92e0ff1-a02a-4e6e-849f-648ec375b9a2 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:25.847855 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c92e0ff1-a02a-4e6e-849f-648ec375b9a2 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:25.848520 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c92e0ff1-a02a-4e6e-849f-648ec375b9a2 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:25.849848 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c92e0ff1-a02a-4e6e-849f-648ec375b9a2 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:25.850552 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c92e0ff1-a02a-4e6e-849f-648ec375b9a2 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:25.851721 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c92e0ff1-a02a-4e6e-849f-648ec375b9a2 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:25.875335 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-78da66fa-302e-4a4f-9db8-450d18f93e8f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:25.888818 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-78da66fa-302e-4a4f-9db8-450d18f93e8f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1668 microversion: 2.1 time: 0.212867 Aug 27 02:55:25.891590 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1539/3087] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:25 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1668 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:55:25.909570 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4f48c551-7ad4-4b06-9cf5-787eb1f453a4 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:55:25.916933 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4f48c551-7ad4-4b06-9cf5-787eb1f453a4 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:25.918327 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4f48c551-7ad4-4b06-9cf5-787eb1f453a4 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:25.918966 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4f48c551-7ad4-4b06-9cf5-787eb1f453a4 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:25.950108 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-4f48c551-7ad4-4b06-9cf5-787eb1f453a4 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] HTTP exception thrown: Instance bb0d71f2-158d-4acc-8774-6874e7da29cd is locked Aug 27 02:55:25.979920 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4f48c551-7ad4-4b06-9cf5-787eb1f453a4 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Request method failure captured: Aug 27 02:55:25.979920 n-d-852278-4 devstack@n-api.service[134051]: request: POST /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd/action HTTP/1.1 Aug 27 02:55:25.979920 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:55:25.979920 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:55:25.979920 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:55:25.979920 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 15 Aug 27 02:55:25.979920 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:55:25.979920 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:55:25.979920 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:55:25.979920 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:55:25.979920 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYZ4Z8i7XrQCoJ8R1xQrljLXT0Y1KKkpWSlhl8nQzR0Gffp8SuHSAmEqH2wTow_HYUPfKDsH80AYAaprEdUsqUlgb1Dqa2tgrmc5xbHE8YE53Hq_xfoTBUsq6qNfDu_s_oKqI9wgNRhJDAuY_9xSuITf0Dzo8xZBUzkyCrp-xMPec0c Aug 27 02:55:25.979920 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:55:25.979920 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:55:25.979920 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:55:25.979920 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:55:25.979920 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:55:25.979920 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:55:25.979920 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 952767db5f394fc4bf01c0efd65f2fb9 Aug 27 02:55:25.979920 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ServerActionsTestJSON-1132885212 Aug 27 02:55:25.979920 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:55:25.979920 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:55:25.979920 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/952767db5f394fc4bf01c0efd65f2fb9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_952767db5f394fc4bf01c0efd65f2fb9", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/952767db5f394fc4bf01c0efd65f2fb9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/952767db5f394fc4bf01c0efd65f2fb9"}]}] Aug 27 02:55:25.979920 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ServerActionsTestJSON-1132885212 Aug 27 02:55:25.979920 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 952767db5f394fc4bf01c0efd65f2fb9 Aug 27 02:55:25.979920 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ServerActionsTestJSON-1132885212 Aug 27 02:55:25.979920 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ServerActionsTestJSON-1132885212-project Aug 27 02:55:25.979920 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:55:25.979920 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:55:25.979920 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: c850bda78e664117b671910c0e68bfb9 Aug 27 02:55:25.979920 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ServerActionsTestJSON-1132885212-project Aug 27 02:55:25.979920 n-d-852278-4 devstack@n-api.service[134051]: Aug 27 02:55:25.979920 n-d-852278-4 devstack@n-api.service[134051]: {"os-stop": {}} Aug 27 02:55:25.979920 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 02:55:25.979920 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance bb0d71f2-158d-4acc-8774-6874e7da29cd is locked Aug 27 02:55:25.979920 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': 'bb0d71f2-158d-4acc-8774-6874e7da29cd', 'body': {'os-stop': {}}} Aug 27 02:55:25.979920 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:55:25.979920 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:25.979920 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1446, in _stop_server Aug 27 02:55:25.979920 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Aug 27 02:55:25.979920 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 240, in inner Aug 27 02:55:25.979920 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Aug 27 02:55:25.979920 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance bb0d71f2-158d-4acc-8774-6874e7da29cd is locked Aug 27 02:55:25.979920 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:55:25.979920 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:55:25.979920 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:55:25.979920 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:25.979920 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:55:25.979920 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:55:25.979920 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:55:25.979920 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:55:25.979920 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:55:25.979920 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:55:25.979920 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1448, in _stop_server Aug 27 02:55:25.979920 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Aug 27 02:55:25.979920 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance bb0d71f2-158d-4acc-8774-6874e7da29cd is locked Aug 27 02:55:25.979920 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:55:25.979920 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:55:25.979920 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:55:25.979920 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:25.979920 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:55:25.979920 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:55:25.979920 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:55:25.979920 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:55:25.979920 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb0d71f2-158d-4acc-8774-6874e7da29cd is locked Aug 27 02:55:25.979920 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:55:25.989370 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4f48c551-7ad4-4b06-9cf5-787eb1f453a4 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Returning 409 to user: Instance bb0d71f2-158d-4acc-8774-6874e7da29cd is locked {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:55:25.989370 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-4f48c551-7ad4-4b06-9cf5-787eb1f453a4 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "POST /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd/action" status: 409 len: 107 microversion: 2.1 time: 0.048160 Aug 27 02:55:25.989370 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1540/3088] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 02:55:25 2022] POST /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd/action => generated 107 bytes in 56 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 27 02:55:25.989370 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-6a23ddb6-316b-44a6-b6f0-6b8a611e1deb tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:55:25.989370 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-6a23ddb6-316b-44a6-b6f0-6b8a611e1deb tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:25.989370 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6a23ddb6-316b-44a6-b6f0-6b8a611e1deb tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:25.989370 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6a23ddb6-316b-44a6-b6f0-6b8a611e1deb tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:25.989370 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6a23ddb6-316b-44a6-b6f0-6b8a611e1deb tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:25.991200 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6a23ddb6-316b-44a6-b6f0-6b8a611e1deb tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:25.991853 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6a23ddb6-316b-44a6-b6f0-6b8a611e1deb tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:25.992500 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6a23ddb6-316b-44a6-b6f0-6b8a611e1deb tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:26.037821 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-c92e0ff1-a02a-4e6e-849f-648ec375b9a2 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8ecf90321841438b77fdceed1e6ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f84ee02bd14800bc5a4212a3746e9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:26.043916 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-6a23ddb6-316b-44a6-b6f0-6b8a611e1deb tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Unlocking {{(pid=134051) unlock /opt/stack/nova/nova/compute/api.py:4872}} Aug 27 02:55:26.046441 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c92e0ff1-a02a-4e6e-849f-648ec375b9a2 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] 10.222.0.70 "GET /compute/v2.1/servers/d93fa48e-eff8-43b7-a1d9-a8199c8c0db9" status: 200 len: 1317 microversion: 2.1 time: 0.215747 Aug 27 02:55:26.061058 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1549/3089] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:25 2022] GET /compute/v2.1/servers/d93fa48e-eff8-43b7-a1d9-a8199c8c0db9 => generated 1317 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:55:26.076825 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f311dd66-38f7-451a-a5a9-34f064ad4441 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:26.077745 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-f311dd66-38f7-451a-a5a9-34f064ad4441 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: cafa2fd0-80bd-413c-a7ae-4cb7b3c2a573] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:26.089007 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f311dd66-38f7-451a-a5a9-34f064ad4441 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:26.092481 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f311dd66-38f7-451a-a5a9-34f064ad4441 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:26.093144 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f311dd66-38f7-451a-a5a9-34f064ad4441 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:26.094043 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f311dd66-38f7-451a-a5a9-34f064ad4441 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:26.094777 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f311dd66-38f7-451a-a5a9-34f064ad4441 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:26.095384 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f311dd66-38f7-451a-a5a9-34f064ad4441 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:26.103231 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-6a23ddb6-316b-44a6-b6f0-6b8a611e1deb tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "POST /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd/action" status: 202 len: 0 microversion: 2.1 time: 0.139354 Aug 27 02:55:26.107523 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1541/3090] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 02:55:25 2022] POST /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd/action => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:55:26.113222 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7415f443-ac72-44c3-a2a2-b7d2a0f5f81f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:55:26.119824 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7415f443-ac72-44c3-a2a2-b7d2a0f5f81f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:26.120345 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7415f443-ac72-44c3-a2a2-b7d2a0f5f81f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:26.121429 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7415f443-ac72-44c3-a2a2-b7d2a0f5f81f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:26.147914 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-7415f443-ac72-44c3-a2a2-b7d2a0f5f81f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Going to try to stop instance {{(pid=134051) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 27 02:55:26.217007 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-7415f443-ac72-44c3-a2a2-b7d2a0f5f81f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "POST /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd/action" status: 202 len: 0 microversion: 2.1 time: 0.107499 Aug 27 02:55:26.219660 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1542/3091] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 02:55:26 2022] POST /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:55:26.242284 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-2e278d35-c462-44e7-9e42-3fd4986a2b15 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:26.243077 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-2e278d35-c462-44e7-9e42-3fd4986a2b15 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:26.253331 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:55:26.254996 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2e278d35-c462-44e7-9e42-3fd4986a2b15 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:26.255492 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2e278d35-c462-44e7-9e42-3fd4986a2b15 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:26.255926 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2e278d35-c462-44e7-9e42-3fd4986a2b15 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:26.256852 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2e278d35-c462-44e7-9e42-3fd4986a2b15 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:26.264006 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2e278d35-c462-44e7-9e42-3fd4986a2b15 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:26.266441 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2e278d35-c462-44e7-9e42-3fd4986a2b15 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:26.294581 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-f311dd66-38f7-451a-a5a9-34f064ad4441 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:26.307527 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f311dd66-38f7-451a-a5a9-34f064ad4441 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/cafa2fd0-80bd-413c-a7ae-4cb7b3c2a573" status: 200 len: 1314 microversion: 2.1 time: 0.244286 Aug 27 02:55:26.308750 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1550/3092] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:26 2022] GET /compute/v2.1/servers/cafa2fd0-80bd-413c-a7ae-4cb7b3c2a573 => generated 1314 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:55:26.486275 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-2e278d35-c462-44e7-9e42-3fd4986a2b15 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:26.498881 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-2e278d35-c462-44e7-9e42-3fd4986a2b15 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1678 microversion: 2.1 time: 0.261697 Aug 27 02:55:26.517244 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1543/3093] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:26 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1678 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:55:26.521112 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-62ed10f9-c2ac-4ed1-9b34-0fae8a24d942 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:26.522111 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-62ed10f9-c2ac-4ed1-9b34-0fae8a24d942 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] [instance: 3f31178a-8993-4aa6-8d41-496bfec13bec] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:26.532256 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-62ed10f9-c2ac-4ed1-9b34-0fae8a24d942 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:26.533316 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-62ed10f9-c2ac-4ed1-9b34-0fae8a24d942 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:26.533922 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-62ed10f9-c2ac-4ed1-9b34-0fae8a24d942 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:26.535277 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-62ed10f9-c2ac-4ed1-9b34-0fae8a24d942 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:26.535915 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-62ed10f9-c2ac-4ed1-9b34-0fae8a24d942 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:26.537269 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-62ed10f9-c2ac-4ed1-9b34-0fae8a24d942 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:26.543409 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=100 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:55:26.630167 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-62ed10f9-c2ac-4ed1-9b34-0fae8a24d942 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5097adbf553e4e319d2cb0cf383f587a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77abdb9b52614d1fbd6d70774a2df31f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:26.643821 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-62ed10f9-c2ac-4ed1-9b34-0fae8a24d942 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5097adbf553e4e319d2cb0cf383f587a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77abdb9b52614d1fbd6d70774a2df31f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:26.650093 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-62ed10f9-c2ac-4ed1-9b34-0fae8a24d942 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5097adbf553e4e319d2cb0cf383f587a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77abdb9b52614d1fbd6d70774a2df31f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:26.661116 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-62ed10f9-c2ac-4ed1-9b34-0fae8a24d942 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] 10.222.0.70 "GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec" status: 200 len: 1447 microversion: 2.75 time: 0.151879 Aug 27 02:55:26.665112 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1551/3094] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:55:26 2022] GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec => generated 1447 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:55:26.851815 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ea16aeba-6558-4ad9-b31d-a9aba070f25c tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:26.852610 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-ea16aeba-6558-4ad9-b31d-a9aba070f25c tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] [instance: b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:26.860627 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ea16aeba-6558-4ad9-b31d-a9aba070f25c tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:26.861308 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ea16aeba-6558-4ad9-b31d-a9aba070f25c tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:26.862299 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ea16aeba-6558-4ad9-b31d-a9aba070f25c tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:26.863188 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ea16aeba-6558-4ad9-b31d-a9aba070f25c tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:26.863763 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ea16aeba-6558-4ad9-b31d-a9aba070f25c tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:26.864429 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ea16aeba-6558-4ad9-b31d-a9aba070f25c tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:27.082524 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-836ff160-b941-40d7-a98a-61acb719b5c2 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:27.084016 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-836ff160-b941-40d7-a98a-61acb719b5c2 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] [instance: d93fa48e-eff8-43b7-a1d9-a8199c8c0db9] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:27.090734 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-836ff160-b941-40d7-a98a-61acb719b5c2 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:27.091667 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-836ff160-b941-40d7-a98a-61acb719b5c2 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:27.092101 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-836ff160-b941-40d7-a98a-61acb719b5c2 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:27.092837 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-836ff160-b941-40d7-a98a-61acb719b5c2 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:27.093277 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-836ff160-b941-40d7-a98a-61acb719b5c2 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:27.093861 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-836ff160-b941-40d7-a98a-61acb719b5c2 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:27.159035 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-ea16aeba-6558-4ad9-b31d-a9aba070f25c tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:27.179872 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-ea16aeba-6558-4ad9-b31d-a9aba070f25c tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:27.181377 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-ea16aeba-6558-4ad9-b31d-a9aba070f25c tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:27.182615 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ea16aeba-6558-4ad9-b31d-a9aba070f25c tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] 10.222.0.70 "GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7" status: 200 len: 1879 microversion: 2.32 time: 0.343083 Aug 27 02:55:27.196337 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1544/3095] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:55:26 2022] GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 => generated 1879 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:55:27.324498 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-836ff160-b941-40d7-a98a-61acb719b5c2 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8ecf90321841438b77fdceed1e6ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f84ee02bd14800bc5a4212a3746e9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:27.329308 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-16859ac0-f418-4863-babe-3af231322432 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:27.329634 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-16859ac0-f418-4863-babe-3af231322432 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: cafa2fd0-80bd-413c-a7ae-4cb7b3c2a573] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:27.345177 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-16859ac0-f418-4863-babe-3af231322432 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:27.345697 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-16859ac0-f418-4863-babe-3af231322432 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:27.346143 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-16859ac0-f418-4863-babe-3af231322432 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:27.347369 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-836ff160-b941-40d7-a98a-61acb719b5c2 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] 10.222.0.70 "GET /compute/v2.1/servers/d93fa48e-eff8-43b7-a1d9-a8199c8c0db9" status: 200 len: 1317 microversion: 2.1 time: 0.269192 Aug 27 02:55:27.348119 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1552/3096] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:27 2022] GET /compute/v2.1/servers/d93fa48e-eff8-43b7-a1d9-a8199c8c0db9 => generated 1317 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:55:27.349340 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-16859ac0-f418-4863-babe-3af231322432 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:27.349866 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-16859ac0-f418-4863-babe-3af231322432 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:27.350316 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-16859ac0-f418-4863-babe-3af231322432 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:27.519463 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-675174da-de79-4548-aca4-1b875a66cf65 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:27.520265 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-675174da-de79-4548-aca4-1b875a66cf65 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:27.530366 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-675174da-de79-4548-aca4-1b875a66cf65 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:27.531219 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-675174da-de79-4548-aca4-1b875a66cf65 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:27.531863 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-675174da-de79-4548-aca4-1b875a66cf65 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:27.533384 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-675174da-de79-4548-aca4-1b875a66cf65 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:27.534286 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-675174da-de79-4548-aca4-1b875a66cf65 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:27.535057 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-675174da-de79-4548-aca4-1b875a66cf65 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:27.638370 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-16859ac0-f418-4863-babe-3af231322432 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:27.649061 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-16859ac0-f418-4863-babe-3af231322432 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/cafa2fd0-80bd-413c-a7ae-4cb7b3c2a573" status: 200 len: 1314 microversion: 2.1 time: 0.323693 Aug 27 02:55:27.650654 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1545/3097] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:27 2022] GET /compute/v2.1/servers/cafa2fd0-80bd-413c-a7ae-4cb7b3c2a573 => generated 1314 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:55:27.693658 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d7720022-a5e4-4653-9e84-e91c56170dab tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:27.696749 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d7720022-a5e4-4653-9e84-e91c56170dab tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] [instance: 3f31178a-8993-4aa6-8d41-496bfec13bec] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:27.704781 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d7720022-a5e4-4653-9e84-e91c56170dab tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:27.705713 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d7720022-a5e4-4653-9e84-e91c56170dab tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:27.706425 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d7720022-a5e4-4653-9e84-e91c56170dab tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:27.707435 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d7720022-a5e4-4653-9e84-e91c56170dab tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:27.708280 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d7720022-a5e4-4653-9e84-e91c56170dab tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:27.709040 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d7720022-a5e4-4653-9e84-e91c56170dab tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:28.235276 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d7720022-a5e4-4653-9e84-e91c56170dab tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5097adbf553e4e319d2cb0cf383f587a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77abdb9b52614d1fbd6d70774a2df31f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:28.249048 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-675174da-de79-4548-aca4-1b875a66cf65 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:28.252890 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d7720022-a5e4-4653-9e84-e91c56170dab tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5097adbf553e4e319d2cb0cf383f587a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77abdb9b52614d1fbd6d70774a2df31f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:28.254633 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d7720022-a5e4-4653-9e84-e91c56170dab tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5097adbf553e4e319d2cb0cf383f587a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77abdb9b52614d1fbd6d70774a2df31f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:28.263566 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-675174da-de79-4548-aca4-1b875a66cf65 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1678 microversion: 2.1 time: 0.744891 Aug 27 02:55:28.276345 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d7720022-a5e4-4653-9e84-e91c56170dab tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] 10.222.0.70 "GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec" status: 200 len: 1447 microversion: 2.75 time: 0.583043 Aug 27 02:55:28.277349 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1553/3098] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:27 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1678 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:55:28.277841 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1546/3099] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:55:27 2022] GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec => generated 1447 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:55:28.285014 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-84cb9122-db23-4e28-bbbc-f7d0f4fa3c4f tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:28.286023 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-84cb9122-db23-4e28-bbbc-f7d0f4fa3c4f tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] [instance: b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:28.292982 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-84cb9122-db23-4e28-bbbc-f7d0f4fa3c4f tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:28.294045 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-84cb9122-db23-4e28-bbbc-f7d0f4fa3c4f tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:28.295033 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-84cb9122-db23-4e28-bbbc-f7d0f4fa3c4f tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:28.296485 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-84cb9122-db23-4e28-bbbc-f7d0f4fa3c4f tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:28.297195 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-84cb9122-db23-4e28-bbbc-f7d0f4fa3c4f tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:28.297904 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-84cb9122-db23-4e28-bbbc-f7d0f4fa3c4f tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:28.372007 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-5478b168-7a65-42ef-9480-e931a9140527 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:28.372531 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-5478b168-7a65-42ef-9480-e931a9140527 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] [instance: d93fa48e-eff8-43b7-a1d9-a8199c8c0db9] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:28.381249 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5478b168-7a65-42ef-9480-e931a9140527 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:28.381794 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5478b168-7a65-42ef-9480-e931a9140527 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:28.382241 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5478b168-7a65-42ef-9480-e931a9140527 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:28.383478 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5478b168-7a65-42ef-9480-e931a9140527 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:28.383995 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5478b168-7a65-42ef-9480-e931a9140527 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:28.384443 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5478b168-7a65-42ef-9480-e931a9140527 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:28.631201 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=4 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:55:28.735689 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-5478b168-7a65-42ef-9480-e931a9140527 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8ecf90321841438b77fdceed1e6ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f84ee02bd14800bc5a4212a3746e9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:28.747319 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-5478b168-7a65-42ef-9480-e931a9140527 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] 10.222.0.70 "GET /compute/v2.1/servers/d93fa48e-eff8-43b7-a1d9-a8199c8c0db9" status: 200 len: 1317 microversion: 2.1 time: 0.380504 Aug 27 02:55:28.759916 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1547/3100] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:28 2022] GET /compute/v2.1/servers/d93fa48e-eff8-43b7-a1d9-a8199c8c0db9 => generated 1317 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:55:28.767748 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-d24786bf-afe7-4468-9b34-f87f09dfae0e req-d1b02774-7910-4989-bb78-cf6f77dc0f89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cafa2fd0-80bd-413c-a7ae-4cb7b3c2a573", "name": "network-vif-plugged", "status": "completed", "tag": "d161a02d-1ba1-4a2e-a278-1c8407983018"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:55:28.783343 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-d24786bf-afe7-4468-9b34-f87f09dfae0e req-d1b02774-7910-4989-bb78-cf6f77dc0f89 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:28.783829 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-d24786bf-afe7-4468-9b34-f87f09dfae0e req-d1b02774-7910-4989-bb78-cf6f77dc0f89 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:28.784615 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-d24786bf-afe7-4468-9b34-f87f09dfae0e req-d1b02774-7910-4989-bb78-cf6f77dc0f89 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:28.789669 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-84cb9122-db23-4e28-bbbc-f7d0f4fa3c4f tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:28.801991 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-d24786bf-afe7-4468-9b34-f87f09dfae0e req-d1b02774-7910-4989-bb78-cf6f77dc0f89 service nova] Creating event network-vif-plugged:d161a02d-1ba1-4a2e-a278-1c8407983018 for instance cafa2fd0-80bd-413c-a7ae-4cb7b3c2a573 on n-h2-852278-4 Aug 27 02:55:28.805717 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-84cb9122-db23-4e28-bbbc-f7d0f4fa3c4f tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:28.807443 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-84cb9122-db23-4e28-bbbc-f7d0f4fa3c4f tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:28.808530 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-d24786bf-afe7-4468-9b34-f87f09dfae0e req-d1b02774-7910-4989-bb78-cf6f77dc0f89 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046138 Aug 27 02:55:28.809193 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-84cb9122-db23-4e28-bbbc-f7d0f4fa3c4f tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] 10.222.0.70 "GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7" status: 200 len: 1879 microversion: 2.32 time: 0.530224 Aug 27 02:55:28.809463 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1548/3101] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:55:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:55:28.810399 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1554/3102] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:55:28 2022] GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 => generated 1879 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:55:29.049599 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-bf9a3e76-d32b-4d68-a5b0-ea99396c53b4 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:29.051031 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-bf9a3e76-d32b-4d68-a5b0-ea99396c53b4 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: cafa2fd0-80bd-413c-a7ae-4cb7b3c2a573] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:29.057934 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bf9a3e76-d32b-4d68-a5b0-ea99396c53b4 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:29.058929 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bf9a3e76-d32b-4d68-a5b0-ea99396c53b4 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:29.059436 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bf9a3e76-d32b-4d68-a5b0-ea99396c53b4 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:29.060154 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bf9a3e76-d32b-4d68-a5b0-ea99396c53b4 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:29.060630 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bf9a3e76-d32b-4d68-a5b0-ea99396c53b4 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:29.061057 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bf9a3e76-d32b-4d68-a5b0-ea99396c53b4 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:29.287940 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ad3a48ed-704e-476e-a519-625ac2a39d9a tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:29.288583 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-ad3a48ed-704e-476e-a519-625ac2a39d9a tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:29.290791 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=16 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:55:29.293982 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-bf9a3e76-d32b-4d68-a5b0-ea99396c53b4 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:29.303404 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ad3a48ed-704e-476e-a519-625ac2a39d9a tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:29.311799 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-bf9a3e76-d32b-4d68-a5b0-ea99396c53b4 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/cafa2fd0-80bd-413c-a7ae-4cb7b3c2a573" status: 200 len: 1314 microversion: 2.1 time: 0.501048 Aug 27 02:55:29.312719 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ad3a48ed-704e-476e-a519-625ac2a39d9a tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:29.313345 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ad3a48ed-704e-476e-a519-625ac2a39d9a tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:29.314280 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ad3a48ed-704e-476e-a519-625ac2a39d9a tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:29.315110 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1549/3103] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:28 2022] GET /compute/v2.1/servers/cafa2fd0-80bd-413c-a7ae-4cb7b3c2a573 => generated 1314 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:55:29.315784 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ad3a48ed-704e-476e-a519-625ac2a39d9a tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:29.317723 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ad3a48ed-704e-476e-a519-625ac2a39d9a tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:29.331594 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ce72f12d-53e6-4e09-8ea3-acfacc7ee516 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:29.332214 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-ce72f12d-53e6-4e09-8ea3-acfacc7ee516 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] [instance: 3f31178a-8993-4aa6-8d41-496bfec13bec] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:29.345602 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ce72f12d-53e6-4e09-8ea3-acfacc7ee516 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:29.346107 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ce72f12d-53e6-4e09-8ea3-acfacc7ee516 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:29.346549 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ce72f12d-53e6-4e09-8ea3-acfacc7ee516 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:29.347275 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ce72f12d-53e6-4e09-8ea3-acfacc7ee516 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:29.347732 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ce72f12d-53e6-4e09-8ea3-acfacc7ee516 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:29.348162 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ce72f12d-53e6-4e09-8ea3-acfacc7ee516 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:29.398590 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=10 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:55:29.399372 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=9,nova_cell1:INSERT=4 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:55:29.518792 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-ce72f12d-53e6-4e09-8ea3-acfacc7ee516 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5097adbf553e4e319d2cb0cf383f587a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77abdb9b52614d1fbd6d70774a2df31f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:29.541101 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-ce72f12d-53e6-4e09-8ea3-acfacc7ee516 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5097adbf553e4e319d2cb0cf383f587a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77abdb9b52614d1fbd6d70774a2df31f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:29.547430 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-ce72f12d-53e6-4e09-8ea3-acfacc7ee516 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5097adbf553e4e319d2cb0cf383f587a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77abdb9b52614d1fbd6d70774a2df31f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:29.559336 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ce72f12d-53e6-4e09-8ea3-acfacc7ee516 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] 10.222.0.70 "GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec" status: 200 len: 1447 microversion: 2.75 time: 0.242249 Aug 27 02:55:29.561064 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1550/3104] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:55:29 2022] GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec => generated 1447 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:55:29.696801 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-ad3a48ed-704e-476e-a519-625ac2a39d9a tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:29.710508 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ad3a48ed-704e-476e-a519-625ac2a39d9a tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1678 microversion: 2.1 time: 0.426364 Aug 27 02:55:29.711745 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1555/3105] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:29 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1678 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:55:29.779423 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-1139e1b7-8fda-45e9-a156-4a770061f8af tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:29.780526 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-1139e1b7-8fda-45e9-a156-4a770061f8af tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] [instance: d93fa48e-eff8-43b7-a1d9-a8199c8c0db9] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:29.794278 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1139e1b7-8fda-45e9-a156-4a770061f8af tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:29.795089 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1139e1b7-8fda-45e9-a156-4a770061f8af tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:29.795707 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1139e1b7-8fda-45e9-a156-4a770061f8af tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:29.796649 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1139e1b7-8fda-45e9-a156-4a770061f8af tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:29.797426 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1139e1b7-8fda-45e9-a156-4a770061f8af tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:29.798025 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1139e1b7-8fda-45e9-a156-4a770061f8af tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:29.835324 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c1054130-0180-47bc-a033-b954cf9da6a3 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:29.836128 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-c1054130-0180-47bc-a033-b954cf9da6a3 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] [instance: b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:29.845706 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c1054130-0180-47bc-a033-b954cf9da6a3 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:29.846441 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c1054130-0180-47bc-a033-b954cf9da6a3 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:29.847100 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c1054130-0180-47bc-a033-b954cf9da6a3 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:29.848005 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c1054130-0180-47bc-a033-b954cf9da6a3 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:29.848858 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c1054130-0180-47bc-a033-b954cf9da6a3 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:29.849447 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c1054130-0180-47bc-a033-b954cf9da6a3 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:30.070720 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-1139e1b7-8fda-45e9-a156-4a770061f8af tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8ecf90321841438b77fdceed1e6ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f84ee02bd14800bc5a4212a3746e9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:30.079161 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-1139e1b7-8fda-45e9-a156-4a770061f8af tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] 10.222.0.70 "GET /compute/v2.1/servers/d93fa48e-eff8-43b7-a1d9-a8199c8c0db9" status: 200 len: 1317 microversion: 2.1 time: 0.307378 Aug 27 02:55:30.097161 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1551/3106] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:29 2022] GET /compute/v2.1/servers/d93fa48e-eff8-43b7-a1d9-a8199c8c0db9 => generated 1317 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:55:30.136291 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-c1054130-0180-47bc-a033-b954cf9da6a3 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:30.149985 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-c1054130-0180-47bc-a033-b954cf9da6a3 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:30.155360 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-c1054130-0180-47bc-a033-b954cf9da6a3 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:30.159303 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c1054130-0180-47bc-a033-b954cf9da6a3 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] 10.222.0.70 "GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7" status: 200 len: 1879 microversion: 2.32 time: 0.328534 Aug 27 02:55:30.160447 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1556/3107] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:55:29 2022] GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 => generated 1879 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:55:30.335222 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-773dc373-5258-4438-8262-7d01ed678256 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:30.335911 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-773dc373-5258-4438-8262-7d01ed678256 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: cafa2fd0-80bd-413c-a7ae-4cb7b3c2a573] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:30.348969 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-773dc373-5258-4438-8262-7d01ed678256 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:30.349724 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-773dc373-5258-4438-8262-7d01ed678256 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:30.350357 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-773dc373-5258-4438-8262-7d01ed678256 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:30.351291 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-773dc373-5258-4438-8262-7d01ed678256 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:30.351748 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-773dc373-5258-4438-8262-7d01ed678256 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:30.352379 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-773dc373-5258-4438-8262-7d01ed678256 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:30.586136 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3f8f176d-565f-44ac-94ee-d5615c953df8 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:30.586911 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-3f8f176d-565f-44ac-94ee-d5615c953df8 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] [instance: 3f31178a-8993-4aa6-8d41-496bfec13bec] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:30.603086 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3f8f176d-565f-44ac-94ee-d5615c953df8 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:30.604172 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3f8f176d-565f-44ac-94ee-d5615c953df8 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:30.606373 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3f8f176d-565f-44ac-94ee-d5615c953df8 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:30.608806 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3f8f176d-565f-44ac-94ee-d5615c953df8 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:30.609333 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3f8f176d-565f-44ac-94ee-d5615c953df8 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:30.610399 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3f8f176d-565f-44ac-94ee-d5615c953df8 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:30.654308 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-773dc373-5258-4438-8262-7d01ed678256 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:30.670174 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-773dc373-5258-4438-8262-7d01ed678256 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/cafa2fd0-80bd-413c-a7ae-4cb7b3c2a573" status: 200 len: 1501 microversion: 2.1 time: 0.338806 Aug 27 02:55:30.672382 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1552/3108] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:30 2022] GET /compute/v2.1/servers/cafa2fd0-80bd-413c-a7ae-4cb7b3c2a573 => generated 1501 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:55:30.694343 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4e97067c-61b7-49d2-ad07-5a03bc2b518f tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:55:30.694939 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-4e97067c-61b7-49d2-ad07-5a03bc2b518f tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: cafa2fd0-80bd-413c-a7ae-4cb7b3c2a573] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:30.701475 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4e97067c-61b7-49d2-ad07-5a03bc2b518f tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:30.702127 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4e97067c-61b7-49d2-ad07-5a03bc2b518f tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:30.702738 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4e97067c-61b7-49d2-ad07-5a03bc2b518f tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:30.703568 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4e97067c-61b7-49d2-ad07-5a03bc2b518f tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:30.704161 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4e97067c-61b7-49d2-ad07-5a03bc2b518f tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:30.704718 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4e97067c-61b7-49d2-ad07-5a03bc2b518f tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:30.741699 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.objects.instance [None req-4e97067c-61b7-49d2-ad07-5a03bc2b518f tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lazy-loading 'flavor' on Instance uuid cafa2fd0-80bd-413c-a7ae-4cb7b3c2a573 {{(pid=134051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:55:30.743792 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-3f8f176d-565f-44ac-94ee-d5615c953df8 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5097adbf553e4e319d2cb0cf383f587a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77abdb9b52614d1fbd6d70774a2df31f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:30.753755 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-3f8f176d-565f-44ac-94ee-d5615c953df8 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5097adbf553e4e319d2cb0cf383f587a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77abdb9b52614d1fbd6d70774a2df31f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:30.755803 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-3f8f176d-565f-44ac-94ee-d5615c953df8 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5097adbf553e4e319d2cb0cf383f587a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77abdb9b52614d1fbd6d70774a2df31f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:30.762265 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-3f8f176d-565f-44ac-94ee-d5615c953df8 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] 10.222.0.70 "GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec" status: 200 len: 1447 microversion: 2.75 time: 0.181032 Aug 27 02:55:30.763127 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1557/3109] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:55:30 2022] GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec => generated 1447 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:55:30.767898 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ae2fdd85-f9d1-4c51-8ec9-30069c2fa1d8 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:30.768775 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-ae2fdd85-f9d1-4c51-8ec9-30069c2fa1d8 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:30.775132 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ae2fdd85-f9d1-4c51-8ec9-30069c2fa1d8 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:30.775835 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ae2fdd85-f9d1-4c51-8ec9-30069c2fa1d8 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:30.776622 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ae2fdd85-f9d1-4c51-8ec9-30069c2fa1d8 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:30.777614 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ae2fdd85-f9d1-4c51-8ec9-30069c2fa1d8 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:30.778234 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ae2fdd85-f9d1-4c51-8ec9-30069c2fa1d8 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:30.778824 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ae2fdd85-f9d1-4c51-8ec9-30069c2fa1d8 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:30.929166 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-4e97067c-61b7-49d2-ad07-5a03bc2b518f tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "POST /compute/v2.1/servers/cafa2fd0-80bd-413c-a7ae-4cb7b3c2a573/action" status: 202 len: 0 microversion: 2.1 time: 0.239067 Aug 27 02:55:30.930636 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1553/3110] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 02:55:30 2022] POST /compute/v2.1/servers/cafa2fd0-80bd-413c-a7ae-4cb7b3c2a573/action => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 02:55:30.949944 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-eb131524-2373-4f4e-85f4-54c53e73cf92 req-23da1d65-d974-4056-9fa2-b46b3b594365 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d93fa48e-eff8-43b7-a1d9-a8199c8c0db9", "name": "network-vif-plugged", "status": "completed", "tag": "ffdfccc5-74d7-49e6-9a30-6dd06e5e4a03"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:55:30.961100 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-eb131524-2373-4f4e-85f4-54c53e73cf92 req-23da1d65-d974-4056-9fa2-b46b3b594365 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:30.961882 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-eb131524-2373-4f4e-85f4-54c53e73cf92 req-23da1d65-d974-4056-9fa2-b46b3b594365 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:30.962479 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-eb131524-2373-4f4e-85f4-54c53e73cf92 req-23da1d65-d974-4056-9fa2-b46b3b594365 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:30.987300 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-eb131524-2373-4f4e-85f4-54c53e73cf92 req-23da1d65-d974-4056-9fa2-b46b3b594365 service nova] Creating event network-vif-plugged:ffdfccc5-74d7-49e6-9a30-6dd06e5e4a03 for instance d93fa48e-eff8-43b7-a1d9-a8199c8c0db9 on n-h1-852278-4 Aug 27 02:55:30.994037 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-eb131524-2373-4f4e-85f4-54c53e73cf92 req-23da1d65-d974-4056-9fa2-b46b3b594365 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061658 Aug 27 02:55:30.995128 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1554/3111] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:55:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:55:31.001065 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c723efe9-4055-435d-9f8b-034985a38dbb tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:31.001847 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-c723efe9-4055-435d-9f8b-034985a38dbb tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: cafa2fd0-80bd-413c-a7ae-4cb7b3c2a573] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:31.002018 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-ae2fdd85-f9d1-4c51-8ec9-30069c2fa1d8 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:31.009229 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c723efe9-4055-435d-9f8b-034985a38dbb tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:31.010364 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c723efe9-4055-435d-9f8b-034985a38dbb tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:31.011015 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c723efe9-4055-435d-9f8b-034985a38dbb tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:31.011453 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ae2fdd85-f9d1-4c51-8ec9-30069c2fa1d8 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1678 microversion: 2.1 time: 0.246716 Aug 27 02:55:31.012329 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c723efe9-4055-435d-9f8b-034985a38dbb tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:31.012650 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1558/3112] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:30 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1678 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:55:31.013165 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c723efe9-4055-435d-9f8b-034985a38dbb tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:31.013632 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c723efe9-4055-435d-9f8b-034985a38dbb tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:31.110557 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8b7a91fc-c31f-4adf-acff-aae48bf31b42 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:31.111193 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-8b7a91fc-c31f-4adf-acff-aae48bf31b42 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] [instance: d93fa48e-eff8-43b7-a1d9-a8199c8c0db9] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:31.117666 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8b7a91fc-c31f-4adf-acff-aae48bf31b42 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:31.118352 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8b7a91fc-c31f-4adf-acff-aae48bf31b42 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:31.119517 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8b7a91fc-c31f-4adf-acff-aae48bf31b42 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:31.120241 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8b7a91fc-c31f-4adf-acff-aae48bf31b42 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:31.120954 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8b7a91fc-c31f-4adf-acff-aae48bf31b42 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:31.121789 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8b7a91fc-c31f-4adf-acff-aae48bf31b42 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:31.205246 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-c723efe9-4055-435d-9f8b-034985a38dbb tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:31.216218 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c723efe9-4055-435d-9f8b-034985a38dbb tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/cafa2fd0-80bd-413c-a7ae-4cb7b3c2a573" status: 200 len: 1509 microversion: 2.1 time: 0.219810 Aug 27 02:55:31.217064 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1555/3113] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:30 2022] GET /compute/v2.1/servers/cafa2fd0-80bd-413c-a7ae-4cb7b3c2a573 => generated 1509 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:55:31.222645 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-789bf19c-ba4c-4eb7-a0f2-d435cdc415ea tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:31.223518 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-789bf19c-ba4c-4eb7-a0f2-d435cdc415ea tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] [instance: b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:31.229540 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-789bf19c-ba4c-4eb7-a0f2-d435cdc415ea tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:31.230344 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-789bf19c-ba4c-4eb7-a0f2-d435cdc415ea tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:31.230959 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-789bf19c-ba4c-4eb7-a0f2-d435cdc415ea tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:31.231861 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-789bf19c-ba4c-4eb7-a0f2-d435cdc415ea tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:31.232795 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-789bf19c-ba4c-4eb7-a0f2-d435cdc415ea tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:31.233399 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-789bf19c-ba4c-4eb7-a0f2-d435cdc415ea tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:31.417164 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-8b7a91fc-c31f-4adf-acff-aae48bf31b42 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8ecf90321841438b77fdceed1e6ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f84ee02bd14800bc5a4212a3746e9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:31.429072 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-8b7a91fc-c31f-4adf-acff-aae48bf31b42 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] 10.222.0.70 "GET /compute/v2.1/servers/d93fa48e-eff8-43b7-a1d9-a8199c8c0db9" status: 200 len: 1317 microversion: 2.1 time: 0.324460 Aug 27 02:55:31.430777 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1559/3114] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:31 2022] GET /compute/v2.1/servers/d93fa48e-eff8-43b7-a1d9-a8199c8c0db9 => generated 1317 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:55:31.521700 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-789bf19c-ba4c-4eb7-a0f2-d435cdc415ea tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:31.533453 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-789bf19c-ba4c-4eb7-a0f2-d435cdc415ea tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:31.535279 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-789bf19c-ba4c-4eb7-a0f2-d435cdc415ea tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:31.536747 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-789bf19c-ba4c-4eb7-a0f2-d435cdc415ea tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] 10.222.0.70 "GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7" status: 200 len: 1879 microversion: 2.32 time: 0.318562 Aug 27 02:55:31.551124 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1556/3115] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:55:31 2022] GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 => generated 1879 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:55:31.791409 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-9d1beeda-2753-4e6a-9602-c2d02632985d tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:31.793538 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-9d1beeda-2753-4e6a-9602-c2d02632985d tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] [instance: 3f31178a-8993-4aa6-8d41-496bfec13bec] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:31.817970 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9d1beeda-2753-4e6a-9602-c2d02632985d tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:31.820281 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9d1beeda-2753-4e6a-9602-c2d02632985d tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:31.820783 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9d1beeda-2753-4e6a-9602-c2d02632985d tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:31.821531 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9d1beeda-2753-4e6a-9602-c2d02632985d tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:31.824832 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9d1beeda-2753-4e6a-9602-c2d02632985d tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:31.825382 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9d1beeda-2753-4e6a-9602-c2d02632985d tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:31.900358 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-72a25d15-ca83-415f-9d82-f8fdcfc68581 tempest-ImagesDeleteNegativeTestJSON-1167242026 tempest-ImagesDeleteNegativeTestJSON-1167242026-project] 10.222.0.70 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.219566 Aug 27 02:55:31.901745 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1560/3116] 10.222.0.70 () {58 vars in 1128 bytes} [Sat Aug 27 02:55:31 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 27 02:55:31.910859 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-9d1beeda-2753-4e6a-9602-c2d02632985d tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5097adbf553e4e319d2cb0cf383f587a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77abdb9b52614d1fbd6d70774a2df31f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:31.911064 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ace19328-315e-4dbc-be8b-ca6c0ab5a668 tempest-ImagesDeleteNegativeTestJSON-1167242026 tempest-ImagesDeleteNegativeTestJSON-1167242026-project] Calling method '.version_select at 0x7f5ee240d0d0>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:31.922945 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-9d1beeda-2753-4e6a-9602-c2d02632985d tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5097adbf553e4e319d2cb0cf383f587a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77abdb9b52614d1fbd6d70774a2df31f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:31.924673 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-9d1beeda-2753-4e6a-9602-c2d02632985d tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5097adbf553e4e319d2cb0cf383f587a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77abdb9b52614d1fbd6d70774a2df31f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:31.934239 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-9d1beeda-2753-4e6a-9602-c2d02632985d tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] 10.222.0.70 "GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec" status: 200 len: 1447 microversion: 2.75 time: 0.147050 Aug 27 02:55:31.935702 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1557/3117] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:55:31 2022] GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec => generated 1447 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:55:31.936785 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-ace19328-315e-4dbc-be8b-ca6c0ab5a668 tempest-ImagesDeleteNegativeTestJSON-1167242026 tempest-ImagesDeleteNegativeTestJSON-1167242026-project] HTTP exception thrown: Image not found. Aug 27 02:55:31.938599 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ace19328-315e-4dbc-be8b-ca6c0ab5a668 tempest-ImagesDeleteNegativeTestJSON-1167242026 tempest-ImagesDeleteNegativeTestJSON-1167242026-project] Request method failure captured: Aug 27 02:55:31.938599 n-d-852278-4 devstack@n-api.service[134052]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Aug 27 02:55:31.938599 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:55:31.938599 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:55:31.938599 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:55:31.938599 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:55:31.938599 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:55:31.938599 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:55:31.938599 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:55:31.938599 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:55:31.938599 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYej0xh2lFLjC2-FhmCVLfZ2rosAgb6fRdsq9aMxIXPlA_M2AHEst-gRyh2EI9fcRIGR7HGyhYMalBTxVUFsIIndq6jG4Yun-MJ3pCmWcORJfq0smKo72MW5rI-frkQlw27x4Te-H1deNV3N6Ukt2nUXOR81BLh8XnY2Mi2z5PmOkW8 Aug 27 02:55:31.938599 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:55:31.938599 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:55:31.938599 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:55:31.938599 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:55:31.938599 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:55:31.938599 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:55:31.938599 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 0ed9de5701374593996656b24c2e564b Aug 27 02:55:31.938599 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1167242026 Aug 27 02:55:31.938599 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:55:31.938599 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:55:31.938599 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0ed9de5701374593996656b24c2e564b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_0ed9de5701374593996656b24c2e564b", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0ed9de5701374593996656b24c2e564b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/0ed9de5701374593996656b24c2e564b"}]}] Aug 27 02:55:31.938599 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1167242026 Aug 27 02:55:31.938599 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 0ed9de5701374593996656b24c2e564b Aug 27 02:55:31.938599 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1167242026 Aug 27 02:55:31.938599 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ImagesDeleteNegativeTestJSON-1167242026-project Aug 27 02:55:31.938599 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:55:31.938599 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:55:31.938599 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: aec3702fab1445e082aded57a9697a94 Aug 27 02:55:31.938599 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1167242026-project Aug 27 02:55:31.938599 n-d-852278-4 devstack@n-api.service[134052]: method: Aug 27 02:55:31.938599 n-d-852278-4 devstack@n-api.service[134052]: exception: Image not found. Aug 27 02:55:31.938599 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '-1'} Aug 27 02:55:31.938599 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:55:31.938599 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:31.938599 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 27 02:55:31.938599 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 27 02:55:31.938599 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 02:55:31.938599 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 02:55:31.938599 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 02:55:31.938599 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 02:55:31.938599 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 27 02:55:31.938599 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 27 02:55:31.938599 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 27 02:55:31.938599 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 27 02:55:31.938599 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 02:55:31.938599 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 02:55:31.938599 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 02:55:31.938599 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 02:55:31.938599 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Aug 27 02:55:31.938599 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:31.938599 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:55:31.938599 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:31.938599 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:31.938599 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 27 02:55:31.938599 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 27 02:55:31.938599 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 27 02:55:31.938599 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 27 02:55:31.938599 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 27 02:55:31.938599 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 27 02:55:31.938599 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Aug 27 02:55:31.938599 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:31.938599 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:55:31.938599 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:31.938599 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:31.944389 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:55:31.944389 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:55:31.944389 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:55:31.944389 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:55:31.944389 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:55:31.944389 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:55:31.944389 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:55:31.944389 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:55:31.944389 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 27 02:55:31.944389 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 27 02:55:31.944389 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 02:55:31.944389 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:31.944389 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:55:31.944389 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:31.944389 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:31.944389 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:55:31.944389 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:55:31.944389 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:55:31.944389 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:55:31.944389 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 02:55:31.944389 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:31.947201 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ace19328-315e-4dbc-be8b-ca6c0ab5a668 tempest-ImagesDeleteNegativeTestJSON-1167242026 tempest-ImagesDeleteNegativeTestJSON-1167242026-project] Returning 404 to user: Image not found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:55:31.948067 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ace19328-315e-4dbc-be8b-ca6c0ab5a668 tempest-ImagesDeleteNegativeTestJSON-1167242026 tempest-ImagesDeleteNegativeTestJSON-1167242026-project] 10.222.0.70 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.041047 Aug 27 02:55:31.948756 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1561/3118] 10.222.0.70 () {58 vars in 1134 bytes} [Sat Aug 27 02:55:31 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 02:55:31.958910 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-61f5fe11-bb24-473b-9419-7637e66d122d tempest-ImagesDeleteNegativeTestJSON-1167242026 tempest-ImagesDeleteNegativeTestJSON-1167242026-project] Calling method '.version_select at 0x7f5edeb20e50>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:31.983970 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-61f5fe11-bb24-473b-9419-7637e66d122d tempest-ImagesDeleteNegativeTestJSON-1167242026 tempest-ImagesDeleteNegativeTestJSON-1167242026-project] HTTP exception thrown: Image not found. Aug 27 02:55:31.986182 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-61f5fe11-bb24-473b-9419-7637e66d122d tempest-ImagesDeleteNegativeTestJSON-1167242026 tempest-ImagesDeleteNegativeTestJSON-1167242026-project] Request method failure captured: Aug 27 02:55:31.986182 n-d-852278-4 devstack@n-api.service[134051]: request: DELETE /compute/v2.1/images/f960d713-da1a-4427-a1f9-19f3808a97cj HTTP/1.1 Aug 27 02:55:31.986182 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:55:31.986182 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:55:31.986182 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:55:31.986182 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:55:31.986182 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:55:31.986182 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:55:31.986182 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:55:31.986182 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:55:31.986182 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYej0xh2lFLjC2-FhmCVLfZ2rosAgb6fRdsq9aMxIXPlA_M2AHEst-gRyh2EI9fcRIGR7HGyhYMalBTxVUFsIIndq6jG4Yun-MJ3pCmWcORJfq0smKo72MW5rI-frkQlw27x4Te-H1deNV3N6Ukt2nUXOR81BLh8XnY2Mi2z5PmOkW8 Aug 27 02:55:31.986182 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:55:31.986182 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:55:31.986182 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:55:31.986182 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:55:31.986182 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:55:31.986182 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:55:31.986182 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 0ed9de5701374593996656b24c2e564b Aug 27 02:55:31.986182 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1167242026 Aug 27 02:55:31.986182 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:55:31.986182 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:55:31.986182 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0ed9de5701374593996656b24c2e564b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_0ed9de5701374593996656b24c2e564b", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0ed9de5701374593996656b24c2e564b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/0ed9de5701374593996656b24c2e564b"}]}] Aug 27 02:55:31.986182 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1167242026 Aug 27 02:55:31.986182 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 0ed9de5701374593996656b24c2e564b Aug 27 02:55:31.986182 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1167242026 Aug 27 02:55:31.986182 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ImagesDeleteNegativeTestJSON-1167242026-project Aug 27 02:55:31.986182 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:55:31.986182 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:55:31.986182 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: aec3702fab1445e082aded57a9697a94 Aug 27 02:55:31.986182 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1167242026-project Aug 27 02:55:31.986182 n-d-852278-4 devstack@n-api.service[134051]: method: Aug 27 02:55:31.986182 n-d-852278-4 devstack@n-api.service[134051]: exception: Image not found. Aug 27 02:55:31.986182 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': 'f960d713-da1a-4427-a1f9-19f3808a97cj'} Aug 27 02:55:31.986182 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:55:31.986182 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:31.986182 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 27 02:55:31.986182 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 27 02:55:31.986182 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 02:55:31.986182 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 02:55:31.986182 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 02:55:31.986182 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 02:55:31.986182 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 27 02:55:31.986182 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 27 02:55:31.986182 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 27 02:55:31.986182 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 27 02:55:31.986182 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 02:55:31.986182 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 02:55:31.986182 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 02:55:31.986182 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 02:55:31.986182 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image f960d713-da1a-4427-a1f9-19f3808a97cj to delete Aug 27 02:55:31.986182 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:55:31.986182 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:55:31.986182 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:55:31.986182 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:31.986182 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 27 02:55:31.986182 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 27 02:55:31.986182 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 27 02:55:31.986182 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 27 02:55:31.986182 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 27 02:55:31.986182 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 27 02:55:31.986182 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f960d713-da1a-4427-a1f9-19f3808a97cj could not be found. Aug 27 02:55:31.986182 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:55:31.986182 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:55:31.986182 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:55:31.991076 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:31.991076 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:55:31.991076 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:55:31.991076 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:55:31.991076 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:55:31.991076 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:55:31.991076 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:55:31.991076 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:55:31.991076 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:55:31.991076 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 27 02:55:31.991076 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 27 02:55:31.991076 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 02:55:31.991076 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:55:31.991076 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:55:31.991076 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:55:31.991076 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:31.991076 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:55:31.991076 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:55:31.991076 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:55:31.991076 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:55:31.991076 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 02:55:31.991076 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:55:31.996402 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-61f5fe11-bb24-473b-9419-7637e66d122d tempest-ImagesDeleteNegativeTestJSON-1167242026 tempest-ImagesDeleteNegativeTestJSON-1167242026-project] Returning 404 to user: Image not found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:55:31.996402 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-61f5fe11-bb24-473b-9419-7637e66d122d tempest-ImagesDeleteNegativeTestJSON-1167242026 tempest-ImagesDeleteNegativeTestJSON-1167242026-project] 10.222.0.70 "DELETE /compute/v2.1/images/f960d713-da1a-4427-a1f9-19f3808a97cj" status: 404 len: 62 microversion: 2.1 time: 0.040300 Aug 27 02:55:31.996402 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1558/3119] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:31 2022] DELETE /compute/v2.1/images/f960d713-da1a-4427-a1f9-19f3808a97cj => generated 62 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 02:55:32.006442 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c475baaf-5b05-481a-add8-f90a4abf760f tempest-ImagesDeleteNegativeTestJSON-1167242026 tempest-ImagesDeleteNegativeTestJSON-1167242026-project] Calling method '.version_select at 0x7f5ee2e93790>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:32.022718 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-c475baaf-5b05-481a-add8-f90a4abf760f tempest-ImagesDeleteNegativeTestJSON-1167242026 tempest-ImagesDeleteNegativeTestJSON-1167242026-project] HTTP exception thrown: Image not found. Aug 27 02:55:32.025191 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c475baaf-5b05-481a-add8-f90a4abf760f tempest-ImagesDeleteNegativeTestJSON-1167242026 tempest-ImagesDeleteNegativeTestJSON-1167242026-project] Request method failure captured: Aug 27 02:55:32.025191 n-d-852278-4 devstack@n-api.service[134052]: request: DELETE /compute/v2.1/images/60018434-5bd3-4933-92a4-103c1bd2e6b41 HTTP/1.1 Aug 27 02:55:32.025191 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:55:32.025191 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:55:32.025191 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:55:32.025191 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:55:32.025191 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:55:32.025191 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:55:32.025191 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:55:32.025191 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:55:32.025191 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYej0xh2lFLjC2-FhmCVLfZ2rosAgb6fRdsq9aMxIXPlA_M2AHEst-gRyh2EI9fcRIGR7HGyhYMalBTxVUFsIIndq6jG4Yun-MJ3pCmWcORJfq0smKo72MW5rI-frkQlw27x4Te-H1deNV3N6Ukt2nUXOR81BLh8XnY2Mi2z5PmOkW8 Aug 27 02:55:32.025191 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:55:32.025191 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:55:32.025191 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:55:32.025191 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:55:32.025191 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:55:32.025191 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:55:32.025191 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 0ed9de5701374593996656b24c2e564b Aug 27 02:55:32.025191 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1167242026 Aug 27 02:55:32.025191 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:55:32.025191 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:55:32.025191 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0ed9de5701374593996656b24c2e564b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_0ed9de5701374593996656b24c2e564b", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0ed9de5701374593996656b24c2e564b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/0ed9de5701374593996656b24c2e564b"}]}] Aug 27 02:55:32.025191 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1167242026 Aug 27 02:55:32.025191 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 0ed9de5701374593996656b24c2e564b Aug 27 02:55:32.025191 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1167242026 Aug 27 02:55:32.025191 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ImagesDeleteNegativeTestJSON-1167242026-project Aug 27 02:55:32.025191 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:55:32.025191 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:55:32.025191 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: aec3702fab1445e082aded57a9697a94 Aug 27 02:55:32.025191 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1167242026-project Aug 27 02:55:32.025191 n-d-852278-4 devstack@n-api.service[134052]: method: Aug 27 02:55:32.025191 n-d-852278-4 devstack@n-api.service[134052]: exception: Image not found. Aug 27 02:55:32.025191 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '60018434-5bd3-4933-92a4-103c1bd2e6b41'} Aug 27 02:55:32.025191 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:55:32.025191 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:32.025191 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 27 02:55:32.025191 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 27 02:55:32.025191 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 02:55:32.025191 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 02:55:32.025191 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 02:55:32.025191 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 02:55:32.025191 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 27 02:55:32.025191 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 27 02:55:32.025191 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 27 02:55:32.025191 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 27 02:55:32.025191 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 02:55:32.025191 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 02:55:32.025191 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 02:55:32.025191 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 02:55:32.025191 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 60018434-5bd3-4933-92a4-103c1bd2e6b41 to delete Aug 27 02:55:32.025191 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:32.025191 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:55:32.025191 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:32.025191 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:32.025191 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 27 02:55:32.025191 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 27 02:55:32.025191 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 27 02:55:32.025191 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 27 02:55:32.025191 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 27 02:55:32.025191 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 27 02:55:32.025191 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 60018434-5bd3-4933-92a4-103c1bd2e6b41 could not be found. Aug 27 02:55:32.025191 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:32.025191 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:55:32.025191 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:32.031504 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:32.031504 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:55:32.031504 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:55:32.031504 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:55:32.031504 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:55:32.031504 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:55:32.031504 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:55:32.031504 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:55:32.031504 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:55:32.031504 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 27 02:55:32.031504 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 27 02:55:32.031504 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 02:55:32.031504 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:32.031504 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:55:32.031504 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:32.031504 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:32.031504 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:55:32.031504 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:55:32.031504 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:55:32.031504 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:55:32.031504 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 02:55:32.031504 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:32.037742 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c475baaf-5b05-481a-add8-f90a4abf760f tempest-ImagesDeleteNegativeTestJSON-1167242026 tempest-ImagesDeleteNegativeTestJSON-1167242026-project] Returning 404 to user: Image not found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:55:32.037742 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c475baaf-5b05-481a-add8-f90a4abf760f tempest-ImagesDeleteNegativeTestJSON-1167242026 tempest-ImagesDeleteNegativeTestJSON-1167242026-project] 10.222.0.70 "DELETE /compute/v2.1/images/60018434-5bd3-4933-92a4-103c1bd2e6b41" status: 404 len: 62 microversion: 2.1 time: 0.035782 Aug 27 02:55:32.037742 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1562/3120] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:55:31 2022] DELETE /compute/v2.1/images/60018434-5bd3-4933-92a4-103c1bd2e6b41 => generated 62 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 02:55:32.047569 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e5a1c6a1-8ba3-4eb2-8a63-7054867d9c1c tempest-ImagesDeleteNegativeTestJSON-1167242026 tempest-ImagesDeleteNegativeTestJSON-1167242026-project] Calling method '.version_select at 0x7f5ee23d44c0>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:32.087772 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-e5a1c6a1-8ba3-4eb2-8a63-7054867d9c1c tempest-ImagesDeleteNegativeTestJSON-1167242026 tempest-ImagesDeleteNegativeTestJSON-1167242026-project] HTTP exception thrown: Image not found. Aug 27 02:55:32.089786 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e5a1c6a1-8ba3-4eb2-8a63-7054867d9c1c tempest-ImagesDeleteNegativeTestJSON-1167242026 tempest-ImagesDeleteNegativeTestJSON-1167242026-project] Request method failure captured: Aug 27 02:55:32.089786 n-d-852278-4 devstack@n-api.service[134052]: request: DELETE /compute/v2.1/images/tempest-invalid-813085176 HTTP/1.1 Aug 27 02:55:32.089786 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:55:32.089786 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:55:32.089786 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:55:32.089786 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:55:32.089786 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:55:32.089786 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:55:32.089786 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:55:32.089786 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:55:32.089786 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYej0xh2lFLjC2-FhmCVLfZ2rosAgb6fRdsq9aMxIXPlA_M2AHEst-gRyh2EI9fcRIGR7HGyhYMalBTxVUFsIIndq6jG4Yun-MJ3pCmWcORJfq0smKo72MW5rI-frkQlw27x4Te-H1deNV3N6Ukt2nUXOR81BLh8XnY2Mi2z5PmOkW8 Aug 27 02:55:32.089786 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:55:32.089786 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:55:32.089786 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:55:32.089786 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:55:32.089786 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:55:32.089786 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:55:32.089786 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 0ed9de5701374593996656b24c2e564b Aug 27 02:55:32.089786 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1167242026 Aug 27 02:55:32.089786 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:55:32.089786 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:55:32.089786 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0ed9de5701374593996656b24c2e564b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_0ed9de5701374593996656b24c2e564b", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0ed9de5701374593996656b24c2e564b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/0ed9de5701374593996656b24c2e564b"}]}] Aug 27 02:55:32.089786 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1167242026 Aug 27 02:55:32.089786 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 0ed9de5701374593996656b24c2e564b Aug 27 02:55:32.089786 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1167242026 Aug 27 02:55:32.089786 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ImagesDeleteNegativeTestJSON-1167242026-project Aug 27 02:55:32.089786 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:55:32.089786 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:55:32.089786 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: aec3702fab1445e082aded57a9697a94 Aug 27 02:55:32.089786 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1167242026-project Aug 27 02:55:32.089786 n-d-852278-4 devstack@n-api.service[134052]: method: Aug 27 02:55:32.089786 n-d-852278-4 devstack@n-api.service[134052]: exception: Image not found. Aug 27 02:55:32.089786 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': 'tempest-invalid-813085176'} Aug 27 02:55:32.089786 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:55:32.089786 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:32.089786 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 27 02:55:32.089786 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 27 02:55:32.089786 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 02:55:32.089786 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 02:55:32.089786 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 02:55:32.089786 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 02:55:32.089786 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 27 02:55:32.089786 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 27 02:55:32.089786 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 27 02:55:32.089786 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 27 02:55:32.089786 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 02:55:32.089786 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 02:55:32.089786 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 02:55:32.089786 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 02:55:32.089786 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-813085176 to delete Aug 27 02:55:32.089786 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:32.089786 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:55:32.089786 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:32.089786 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:32.089786 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 27 02:55:32.089786 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 27 02:55:32.089786 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 27 02:55:32.089786 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 27 02:55:32.089786 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 27 02:55:32.089786 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 27 02:55:32.089786 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-813085176 could not be found. Aug 27 02:55:32.089786 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:32.089786 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:55:32.089786 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:32.089786 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:32.095377 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:55:32.095377 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:55:32.095377 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:55:32.095377 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:55:32.095377 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:55:32.095377 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:55:32.095377 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:55:32.095377 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:55:32.095377 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 27 02:55:32.095377 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 27 02:55:32.095377 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 02:55:32.095377 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:32.095377 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:55:32.095377 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:32.095377 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:32.095377 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:55:32.095377 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:55:32.095377 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:55:32.095377 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:55:32.095377 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 02:55:32.095377 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:32.095377 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e5a1c6a1-8ba3-4eb2-8a63-7054867d9c1c tempest-ImagesDeleteNegativeTestJSON-1167242026 tempest-ImagesDeleteNegativeTestJSON-1167242026-project] Returning 404 to user: Image not found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:55:32.097470 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e5a1c6a1-8ba3-4eb2-8a63-7054867d9c1c tempest-ImagesDeleteNegativeTestJSON-1167242026 tempest-ImagesDeleteNegativeTestJSON-1167242026-project] 10.222.0.70 "DELETE /compute/v2.1/images/tempest-invalid-813085176" status: 404 len: 62 microversion: 2.1 time: 0.051850 Aug 27 02:55:32.104655 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1563/3121] 10.222.0.70 () {58 vars in 1203 bytes} [Sat Aug 27 02:55:32 2022] DELETE /compute/v2.1/images/tempest-invalid-813085176 => generated 62 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 27 02:55:32.111961 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-010d4986-569c-4ef6-b1c6-9ff64131a588 tempest-ImagesDeleteNegativeTestJSON-1167242026 tempest-ImagesDeleteNegativeTestJSON-1167242026-project] Calling method '.version_select at 0x7f5ee3e9dca0>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:32.136534 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-010d4986-569c-4ef6-b1c6-9ff64131a588 tempest-ImagesDeleteNegativeTestJSON-1167242026 tempest-ImagesDeleteNegativeTestJSON-1167242026-project] HTTP exception thrown: Image not found. Aug 27 02:55:32.139085 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-010d4986-569c-4ef6-b1c6-9ff64131a588 tempest-ImagesDeleteNegativeTestJSON-1167242026 tempest-ImagesDeleteNegativeTestJSON-1167242026-project] Request method failure captured: Aug 27 02:55:32.139085 n-d-852278-4 devstack@n-api.service[134052]: request: DELETE /compute/v2.1/images/a7d4de21-fc41-403f-971f-21a88af0783a HTTP/1.1 Aug 27 02:55:32.139085 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:55:32.139085 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:55:32.139085 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:55:32.139085 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:55:32.139085 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:55:32.139085 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:55:32.139085 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:55:32.139085 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:55:32.139085 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYej0xh2lFLjC2-FhmCVLfZ2rosAgb6fRdsq9aMxIXPlA_M2AHEst-gRyh2EI9fcRIGR7HGyhYMalBTxVUFsIIndq6jG4Yun-MJ3pCmWcORJfq0smKo72MW5rI-frkQlw27x4Te-H1deNV3N6Ukt2nUXOR81BLh8XnY2Mi2z5PmOkW8 Aug 27 02:55:32.139085 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:55:32.139085 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:55:32.139085 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:55:32.139085 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:55:32.139085 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:55:32.139085 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:55:32.139085 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 0ed9de5701374593996656b24c2e564b Aug 27 02:55:32.139085 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1167242026 Aug 27 02:55:32.139085 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:55:32.139085 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:55:32.139085 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0ed9de5701374593996656b24c2e564b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_0ed9de5701374593996656b24c2e564b", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0ed9de5701374593996656b24c2e564b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/0ed9de5701374593996656b24c2e564b"}]}] Aug 27 02:55:32.139085 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1167242026 Aug 27 02:55:32.139085 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 0ed9de5701374593996656b24c2e564b Aug 27 02:55:32.139085 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1167242026 Aug 27 02:55:32.139085 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ImagesDeleteNegativeTestJSON-1167242026-project Aug 27 02:55:32.139085 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:55:32.139085 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:55:32.139085 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: aec3702fab1445e082aded57a9697a94 Aug 27 02:55:32.139085 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1167242026-project Aug 27 02:55:32.139085 n-d-852278-4 devstack@n-api.service[134052]: method: Aug 27 02:55:32.139085 n-d-852278-4 devstack@n-api.service[134052]: exception: Image not found. Aug 27 02:55:32.139085 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': 'a7d4de21-fc41-403f-971f-21a88af0783a'} Aug 27 02:55:32.139085 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:55:32.139085 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:32.139085 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 27 02:55:32.139085 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 27 02:55:32.139085 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 02:55:32.139085 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 02:55:32.139085 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 02:55:32.139085 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 02:55:32.139085 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 27 02:55:32.139085 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 27 02:55:32.139085 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 27 02:55:32.139085 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 27 02:55:32.139085 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 02:55:32.139085 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 02:55:32.139085 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 02:55:32.139085 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 02:55:32.139085 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image a7d4de21-fc41-403f-971f-21a88af0783a to delete Aug 27 02:55:32.139085 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:32.139085 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:55:32.139085 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:32.139085 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:32.139085 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 27 02:55:32.139085 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 27 02:55:32.139085 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 27 02:55:32.139085 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 27 02:55:32.139085 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 27 02:55:32.139085 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 27 02:55:32.139085 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a7d4de21-fc41-403f-971f-21a88af0783a could not be found. Aug 27 02:55:32.139085 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:32.139085 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:55:32.139085 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:32.143448 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:32.143448 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:55:32.143448 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:55:32.143448 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:55:32.143448 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:55:32.143448 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:55:32.143448 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:55:32.143448 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:55:32.143448 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:55:32.143448 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 27 02:55:32.143448 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 27 02:55:32.143448 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 02:55:32.143448 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:32.143448 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:55:32.143448 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:32.143448 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:32.143448 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:55:32.143448 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:55:32.143448 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:55:32.143448 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:55:32.143448 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 02:55:32.143448 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:32.147819 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-010d4986-569c-4ef6-b1c6-9ff64131a588 tempest-ImagesDeleteNegativeTestJSON-1167242026 tempest-ImagesDeleteNegativeTestJSON-1167242026-project] Returning 404 to user: Image not found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:55:32.149051 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-010d4986-569c-4ef6-b1c6-9ff64131a588 tempest-ImagesDeleteNegativeTestJSON-1167242026 tempest-ImagesDeleteNegativeTestJSON-1167242026-project] 10.222.0.70 "DELETE /compute/v2.1/images/a7d4de21-fc41-403f-971f-21a88af0783a" status: 404 len: 62 microversion: 2.1 time: 0.042890 Aug 27 02:55:32.154921 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1564/3122] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:32 2022] DELETE /compute/v2.1/images/a7d4de21-fc41-403f-971f-21a88af0783a => generated 62 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 02:55:32.235750 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-eb4efa14-2aec-4fbf-be46-f790c730a392 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:32.236490 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-eb4efa14-2aec-4fbf-be46-f790c730a392 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:32.244143 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e867a71c-5735-4552-a292-d7ba52f38819 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:32.244729 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eb4efa14-2aec-4fbf-be46-f790c730a392 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:32.245291 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-e867a71c-5735-4552-a292-d7ba52f38819 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: cafa2fd0-80bd-413c-a7ae-4cb7b3c2a573] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:32.245478 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eb4efa14-2aec-4fbf-be46-f790c730a392 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:32.245898 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eb4efa14-2aec-4fbf-be46-f790c730a392 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:32.246789 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eb4efa14-2aec-4fbf-be46-f790c730a392 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:32.247310 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eb4efa14-2aec-4fbf-be46-f790c730a392 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:32.248750 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eb4efa14-2aec-4fbf-be46-f790c730a392 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:32.257997 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e867a71c-5735-4552-a292-d7ba52f38819 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:32.258741 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e867a71c-5735-4552-a292-d7ba52f38819 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:32.259345 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e867a71c-5735-4552-a292-d7ba52f38819 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:32.262563 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e867a71c-5735-4552-a292-d7ba52f38819 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:32.263954 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e867a71c-5735-4552-a292-d7ba52f38819 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:32.273554 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e867a71c-5735-4552-a292-d7ba52f38819 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:32.691217 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-eb4efa14-2aec-4fbf-be46-f790c730a392 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:32.705039 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-e867a71c-5735-4552-a292-d7ba52f38819 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:32.715101 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e867a71c-5735-4552-a292-d7ba52f38819 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/cafa2fd0-80bd-413c-a7ae-4cb7b3c2a573" status: 200 len: 1492 microversion: 2.1 time: 0.479836 Aug 27 02:55:32.719594 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-eb4efa14-2aec-4fbf-be46-f790c730a392 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1678 microversion: 2.1 time: 0.677123 Aug 27 02:55:32.720947 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1559/3123] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:32 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1678 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:55:32.727612 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-891df4d1-2438-4f38-ac5b-23aad0643dfa tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:32.734022 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-891df4d1-2438-4f38-ac5b-23aad0643dfa tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] [instance: d93fa48e-eff8-43b7-a1d9-a8199c8c0db9] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:32.736150 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1565/3124] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:32 2022] GET /compute/v2.1/servers/cafa2fd0-80bd-413c-a7ae-4cb7b3c2a573 => generated 1492 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:55:32.741557 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-324dfc06-5119-4348-ad79-cc65aa8c5b0f tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:32.742182 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-324dfc06-5119-4348-ad79-cc65aa8c5b0f tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] [instance: b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:32.760166 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-324dfc06-5119-4348-ad79-cc65aa8c5b0f tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:32.760637 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-891df4d1-2438-4f38-ac5b-23aad0643dfa tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:32.761931 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-324dfc06-5119-4348-ad79-cc65aa8c5b0f tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:32.763619 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-891df4d1-2438-4f38-ac5b-23aad0643dfa tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:32.764598 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-891df4d1-2438-4f38-ac5b-23aad0643dfa tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:32.766314 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-324dfc06-5119-4348-ad79-cc65aa8c5b0f tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:32.768340 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-324dfc06-5119-4348-ad79-cc65aa8c5b0f tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:32.768921 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-891df4d1-2438-4f38-ac5b-23aad0643dfa tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:32.769750 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-891df4d1-2438-4f38-ac5b-23aad0643dfa tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:32.770326 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-891df4d1-2438-4f38-ac5b-23aad0643dfa tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:32.773054 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-324dfc06-5119-4348-ad79-cc65aa8c5b0f tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:32.774386 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-324dfc06-5119-4348-ad79-cc65aa8c5b0f tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:33.132679 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-891df4d1-2438-4f38-ac5b-23aad0643dfa tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8ecf90321841438b77fdceed1e6ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f84ee02bd14800bc5a4212a3746e9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:33.141270 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-891df4d1-2438-4f38-ac5b-23aad0643dfa tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] 10.222.0.70 "GET /compute/v2.1/servers/d93fa48e-eff8-43b7-a1d9-a8199c8c0db9" status: 200 len: 1505 microversion: 2.1 time: 0.418499 Aug 27 02:55:33.142277 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1560/3125] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:32 2022] GET /compute/v2.1/servers/d93fa48e-eff8-43b7-a1d9-a8199c8c0db9 => generated 1505 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:55:33.147801 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-20ecda85-f7a6-4aef-a4bb-453d0e8b449c tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:33.148502 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-20ecda85-f7a6-4aef-a4bb-453d0e8b449c tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: cafa2fd0-80bd-413c-a7ae-4cb7b3c2a573] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:33.156822 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-20ecda85-f7a6-4aef-a4bb-453d0e8b449c tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:33.157820 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-20ecda85-f7a6-4aef-a4bb-453d0e8b449c tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:33.158762 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-20ecda85-f7a6-4aef-a4bb-453d0e8b449c tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:33.160103 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-20ecda85-f7a6-4aef-a4bb-453d0e8b449c tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:33.161156 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-20ecda85-f7a6-4aef-a4bb-453d0e8b449c tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:33.161962 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-20ecda85-f7a6-4aef-a4bb-453d0e8b449c tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:33.200884 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-20ecda85-f7a6-4aef-a4bb-453d0e8b449c tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: cafa2fd0-80bd-413c-a7ae-4cb7b3c2a573] Going to try to terminate instance {{(pid=134051) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:55:33.207972 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-324dfc06-5119-4348-ad79-cc65aa8c5b0f tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:33.230745 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-324dfc06-5119-4348-ad79-cc65aa8c5b0f tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:33.232684 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-324dfc06-5119-4348-ad79-cc65aa8c5b0f tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:33.237164 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-324dfc06-5119-4348-ad79-cc65aa8c5b0f tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] 10.222.0.70 "GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7" status: 200 len: 1879 microversion: 2.32 time: 0.499514 Aug 27 02:55:33.237927 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1566/3126] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:55:32 2022] GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 => generated 1879 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:55:33.243244 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-22d1b54e-bcd9-4b62-bff9-0a551d2af3c4 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:33.243852 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-22d1b54e-bcd9-4b62-bff9-0a551d2af3c4 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] [instance: 3f31178a-8993-4aa6-8d41-496bfec13bec] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:33.252028 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-22d1b54e-bcd9-4b62-bff9-0a551d2af3c4 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:33.252793 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-22d1b54e-bcd9-4b62-bff9-0a551d2af3c4 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:33.253415 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-22d1b54e-bcd9-4b62-bff9-0a551d2af3c4 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:33.254455 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-22d1b54e-bcd9-4b62-bff9-0a551d2af3c4 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:33.261400 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-22d1b54e-bcd9-4b62-bff9-0a551d2af3c4 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:33.261607 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-22d1b54e-bcd9-4b62-bff9-0a551d2af3c4 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:33.354328 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-20ecda85-f7a6-4aef-a4bb-453d0e8b449c tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "DELETE /compute/v2.1/servers/cafa2fd0-80bd-413c-a7ae-4cb7b3c2a573" status: 204 len: 0 microversion: 2.1 time: 0.210222 Aug 27 02:55:33.355374 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1561/3127] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:55:33 2022] DELETE /compute/v2.1/servers/cafa2fd0-80bd-413c-a7ae-4cb7b3c2a573 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:55:33.363659 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d5a6962f-8a4d-4fda-8bf9-ecfe59eedf73 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:33.364683 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d5a6962f-8a4d-4fda-8bf9-ecfe59eedf73 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] [instance: d93fa48e-eff8-43b7-a1d9-a8199c8c0db9] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:33.372767 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d5a6962f-8a4d-4fda-8bf9-ecfe59eedf73 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:33.373765 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d5a6962f-8a4d-4fda-8bf9-ecfe59eedf73 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:33.374428 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d5a6962f-8a4d-4fda-8bf9-ecfe59eedf73 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:33.375389 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d5a6962f-8a4d-4fda-8bf9-ecfe59eedf73 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:33.376050 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d5a6962f-8a4d-4fda-8bf9-ecfe59eedf73 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:33.377408 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d5a6962f-8a4d-4fda-8bf9-ecfe59eedf73 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:33.386411 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-22d1b54e-bcd9-4b62-bff9-0a551d2af3c4 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5097adbf553e4e319d2cb0cf383f587a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77abdb9b52614d1fbd6d70774a2df31f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:33.413398 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-22d1b54e-bcd9-4b62-bff9-0a551d2af3c4 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5097adbf553e4e319d2cb0cf383f587a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77abdb9b52614d1fbd6d70774a2df31f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:33.417544 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-22d1b54e-bcd9-4b62-bff9-0a551d2af3c4 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5097adbf553e4e319d2cb0cf383f587a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77abdb9b52614d1fbd6d70774a2df31f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:33.432441 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-22d1b54e-bcd9-4b62-bff9-0a551d2af3c4 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] 10.222.0.70 "GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec" status: 200 len: 1447 microversion: 2.75 time: 0.193337 Aug 27 02:55:33.434325 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1567/3128] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:55:33 2022] GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec => generated 1447 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:55:33.445698 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d5a6962f-8a4d-4fda-8bf9-ecfe59eedf73 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '7b8ecf90321841438b77fdceed1e6ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f84ee02bd14800bc5a4212a3746e9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:33.452002 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d5a6962f-8a4d-4fda-8bf9-ecfe59eedf73 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] 10.222.0.70 "GET /compute/v2.1/servers/d93fa48e-eff8-43b7-a1d9-a8199c8c0db9/os-instance-actions/req-01e7d636-2385-4413-a60a-ad17526373bc" status: 200 len: 313 microversion: 2.1 time: 0.094757 Aug 27 02:55:33.452480 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-bc1a544b-e3b9-4b93-8287-e214f301ae03 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:33.453815 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1562/3129] 10.222.0.70 () {58 vars in 1419 bytes} [Sat Aug 27 02:55:33 2022] GET /compute/v2.1/servers/d93fa48e-eff8-43b7-a1d9-a8199c8c0db9/os-instance-actions/req-01e7d636-2385-4413-a60a-ad17526373bc => generated 313 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:55:33.457179 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-bc1a544b-e3b9-4b93-8287-e214f301ae03 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: cafa2fd0-80bd-413c-a7ae-4cb7b3c2a573] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:33.464773 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bc1a544b-e3b9-4b93-8287-e214f301ae03 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:33.465587 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bc1a544b-e3b9-4b93-8287-e214f301ae03 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:33.466010 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bc1a544b-e3b9-4b93-8287-e214f301ae03 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:33.466933 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bc1a544b-e3b9-4b93-8287-e214f301ae03 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:33.467533 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bc1a544b-e3b9-4b93-8287-e214f301ae03 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:33.468116 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bc1a544b-e3b9-4b93-8287-e214f301ae03 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:33.468493 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a4985131-db63-4911-a57c-0f73c059dce3 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:55:33.470943 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-a4985131-db63-4911-a57c-0f73c059dce3 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] [instance: d93fa48e-eff8-43b7-a1d9-a8199c8c0db9] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:33.481942 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a4985131-db63-4911-a57c-0f73c059dce3 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:33.482727 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a4985131-db63-4911-a57c-0f73c059dce3 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:33.483234 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a4985131-db63-4911-a57c-0f73c059dce3 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:33.484728 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a4985131-db63-4911-a57c-0f73c059dce3 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:33.485297 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a4985131-db63-4911-a57c-0f73c059dce3 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:33.485862 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a4985131-db63-4911-a57c-0f73c059dce3 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:33.642561 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a4985131-db63-4911-a57c-0f73c059dce3 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] 10.222.0.70 "POST /compute/v2.1/servers/d93fa48e-eff8-43b7-a1d9-a8199c8c0db9/action" status: 202 len: 0 microversion: 2.1 time: 0.178557 Aug 27 02:55:33.643862 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1563/3130] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 02:55:33 2022] POST /compute/v2.1/servers/d93fa48e-eff8-43b7-a1d9-a8199c8c0db9/action => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 02:55:33.655671 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f356b9f0-1980-40b9-a914-dbfbd65d3500 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:33.656778 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-f356b9f0-1980-40b9-a914-dbfbd65d3500 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] [instance: d93fa48e-eff8-43b7-a1d9-a8199c8c0db9] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:33.666734 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f356b9f0-1980-40b9-a914-dbfbd65d3500 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:33.668228 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f356b9f0-1980-40b9-a914-dbfbd65d3500 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:33.669218 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f356b9f0-1980-40b9-a914-dbfbd65d3500 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:33.670190 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f356b9f0-1980-40b9-a914-dbfbd65d3500 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:33.670865 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f356b9f0-1980-40b9-a914-dbfbd65d3500 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:33.671455 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f356b9f0-1980-40b9-a914-dbfbd65d3500 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:33.696939 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:55:33.859482 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-bc1a544b-e3b9-4b93-8287-e214f301ae03 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:33.887863 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-bc1a544b-e3b9-4b93-8287-e214f301ae03 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/cafa2fd0-80bd-413c-a7ae-4cb7b3c2a573" status: 200 len: 1498 microversion: 2.1 time: 0.450540 Aug 27 02:55:33.888478 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1568/3131] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:33 2022] GET /compute/v2.1/servers/cafa2fd0-80bd-413c-a7ae-4cb7b3c2a573 => generated 1498 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:55:33.895867 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e658b835-f6a4-4765-90b4-8b73316427df tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:33.896769 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-e658b835-f6a4-4765-90b4-8b73316427df tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:33.902049 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-f356b9f0-1980-40b9-a914-dbfbd65d3500 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8ecf90321841438b77fdceed1e6ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f84ee02bd14800bc5a4212a3746e9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:33.909970 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e658b835-f6a4-4765-90b4-8b73316427df tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:33.910920 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e658b835-f6a4-4765-90b4-8b73316427df tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:33.911510 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e658b835-f6a4-4765-90b4-8b73316427df tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:33.912421 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e658b835-f6a4-4765-90b4-8b73316427df tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:33.913249 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e658b835-f6a4-4765-90b4-8b73316427df tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:33.913821 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e658b835-f6a4-4765-90b4-8b73316427df tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:33.914144 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-f356b9f0-1980-40b9-a914-dbfbd65d3500 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] 10.222.0.70 "GET /compute/v2.1/servers/d93fa48e-eff8-43b7-a1d9-a8199c8c0db9" status: 200 len: 1507 microversion: 2.1 time: 0.263134 Aug 27 02:55:33.929306 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1564/3132] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:33 2022] GET /compute/v2.1/servers/d93fa48e-eff8-43b7-a1d9-a8199c8c0db9 => generated 1507 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:55:34.095277 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-e658b835-f6a4-4765-90b4-8b73316427df tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:34.104907 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e658b835-f6a4-4765-90b4-8b73316427df tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1678 microversion: 2.1 time: 0.212759 Aug 27 02:55:34.106092 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1569/3133] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:33 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1678 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:55:34.264527 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f400cbff-e8a7-4815-9d80-96afbcb617b5 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:34.265143 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-f400cbff-e8a7-4815-9d80-96afbcb617b5 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] [instance: b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:34.274069 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f400cbff-e8a7-4815-9d80-96afbcb617b5 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:34.274589 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f400cbff-e8a7-4815-9d80-96afbcb617b5 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:34.275035 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f400cbff-e8a7-4815-9d80-96afbcb617b5 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:34.275871 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f400cbff-e8a7-4815-9d80-96afbcb617b5 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:34.276420 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f400cbff-e8a7-4815-9d80-96afbcb617b5 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:34.276933 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f400cbff-e8a7-4815-9d80-96afbcb617b5 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:34.459257 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b60c0882-3281-4fbb-a5ce-adf073c45815 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:34.460405 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b60c0882-3281-4fbb-a5ce-adf073c45815 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] [instance: 3f31178a-8993-4aa6-8d41-496bfec13bec] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:34.467028 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b60c0882-3281-4fbb-a5ce-adf073c45815 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:34.467646 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b60c0882-3281-4fbb-a5ce-adf073c45815 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:34.468174 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b60c0882-3281-4fbb-a5ce-adf073c45815 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:34.469022 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b60c0882-3281-4fbb-a5ce-adf073c45815 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:34.469713 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b60c0882-3281-4fbb-a5ce-adf073c45815 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:34.475025 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b60c0882-3281-4fbb-a5ce-adf073c45815 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:34.483829 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-f400cbff-e8a7-4815-9d80-96afbcb617b5 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:34.495951 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-f400cbff-e8a7-4815-9d80-96afbcb617b5 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:34.497836 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-f400cbff-e8a7-4815-9d80-96afbcb617b5 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:34.499248 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-f400cbff-e8a7-4815-9d80-96afbcb617b5 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] 10.222.0.70 "GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7" status: 200 len: 1879 microversion: 2.32 time: 0.238742 Aug 27 02:55:34.500960 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1565/3134] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:55:34 2022] GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 => generated 1879 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:55:34.565215 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b60c0882-3281-4fbb-a5ce-adf073c45815 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5097adbf553e4e319d2cb0cf383f587a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77abdb9b52614d1fbd6d70774a2df31f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:34.573966 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b60c0882-3281-4fbb-a5ce-adf073c45815 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5097adbf553e4e319d2cb0cf383f587a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77abdb9b52614d1fbd6d70774a2df31f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:34.575573 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b60c0882-3281-4fbb-a5ce-adf073c45815 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5097adbf553e4e319d2cb0cf383f587a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77abdb9b52614d1fbd6d70774a2df31f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:34.581391 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b60c0882-3281-4fbb-a5ce-adf073c45815 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] 10.222.0.70 "GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec" status: 200 len: 1447 microversion: 2.75 time: 0.126920 Aug 27 02:55:34.592392 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1570/3135] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:55:34 2022] GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec => generated 1447 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:55:34.913825 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b2eb36e5-503c-4243-a768-58d0520ae648 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:34.915668 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b2eb36e5-503c-4243-a768-58d0520ae648 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: cafa2fd0-80bd-413c-a7ae-4cb7b3c2a573] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:34.933029 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b2eb36e5-503c-4243-a768-58d0520ae648 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:34.933865 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b2eb36e5-503c-4243-a768-58d0520ae648 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:34.934603 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b2eb36e5-503c-4243-a768-58d0520ae648 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:34.935889 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b2eb36e5-503c-4243-a768-58d0520ae648 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:34.936641 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b2eb36e5-503c-4243-a768-58d0520ae648 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:34.937492 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a7a82e67-fbd7-4144-9556-8ec7ed8429ca tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:34.937677 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b2eb36e5-503c-4243-a768-58d0520ae648 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:34.939430 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a7a82e67-fbd7-4144-9556-8ec7ed8429ca tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] [instance: d93fa48e-eff8-43b7-a1d9-a8199c8c0db9] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:34.949693 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a7a82e67-fbd7-4144-9556-8ec7ed8429ca tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:34.950465 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a7a82e67-fbd7-4144-9556-8ec7ed8429ca tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:34.951479 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a7a82e67-fbd7-4144-9556-8ec7ed8429ca tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:34.953079 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a7a82e67-fbd7-4144-9556-8ec7ed8429ca tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:34.953715 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a7a82e67-fbd7-4144-9556-8ec7ed8429ca tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:34.954893 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a7a82e67-fbd7-4144-9556-8ec7ed8429ca tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:35.462186 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-a7a82e67-fbd7-4144-9556-8ec7ed8429ca tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8ecf90321841438b77fdceed1e6ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f84ee02bd14800bc5a4212a3746e9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:35.471398 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-b2eb36e5-503c-4243-a768-58d0520ae648 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:35.478690 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a7a82e67-fbd7-4144-9556-8ec7ed8429ca tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] 10.222.0.70 "GET /compute/v2.1/servers/d93fa48e-eff8-43b7-a1d9-a8199c8c0db9" status: 200 len: 1507 microversion: 2.1 time: 0.547018 Aug 27 02:55:35.498295 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1571/3136] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:34 2022] GET /compute/v2.1/servers/d93fa48e-eff8-43b7-a1d9-a8199c8c0db9 => generated 1507 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:55:35.503129 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b2eb36e5-503c-4243-a768-58d0520ae648 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/cafa2fd0-80bd-413c-a7ae-4cb7b3c2a573" status: 200 len: 1498 microversion: 2.1 time: 0.593882 Aug 27 02:55:35.507032 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a4b1df7e-328b-4158-9f0e-1866cc9f34e4 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:35.507255 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1566/3137] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:34 2022] GET /compute/v2.1/servers/cafa2fd0-80bd-413c-a7ae-4cb7b3c2a573 => generated 1498 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:55:35.512542 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a4b1df7e-328b-4158-9f0e-1866cc9f34e4 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:35.523698 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a4b1df7e-328b-4158-9f0e-1866cc9f34e4 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:35.524916 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a4b1df7e-328b-4158-9f0e-1866cc9f34e4 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:35.525091 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-72838986-05ed-4dec-9862-57c245cc0dd0 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:35.525695 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a4b1df7e-328b-4158-9f0e-1866cc9f34e4 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:35.526087 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-72838986-05ed-4dec-9862-57c245cc0dd0 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] [instance: b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:35.527025 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a4b1df7e-328b-4158-9f0e-1866cc9f34e4 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:35.527782 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a4b1df7e-328b-4158-9f0e-1866cc9f34e4 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:35.528428 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a4b1df7e-328b-4158-9f0e-1866cc9f34e4 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:35.555044 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-72838986-05ed-4dec-9862-57c245cc0dd0 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:35.555472 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-72838986-05ed-4dec-9862-57c245cc0dd0 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:35.555913 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-72838986-05ed-4dec-9862-57c245cc0dd0 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:35.560969 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-72838986-05ed-4dec-9862-57c245cc0dd0 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:35.561510 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-72838986-05ed-4dec-9862-57c245cc0dd0 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:35.561956 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-72838986-05ed-4dec-9862-57c245cc0dd0 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:35.992877 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-a4b1df7e-328b-4158-9f0e-1866cc9f34e4 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:35.996539 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=100 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:55:36.004432 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a4b1df7e-328b-4158-9f0e-1866cc9f34e4 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1678 microversion: 2.1 time: 0.504625 Aug 27 02:55:36.005750 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1572/3138] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:35 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1678 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:55:36.011064 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4b387465-c6f9-438c-993a-221d91a48c4e tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:36.011918 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-4b387465-c6f9-438c-993a-221d91a48c4e tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] [instance: 3f31178a-8993-4aa6-8d41-496bfec13bec] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:36.023312 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4b387465-c6f9-438c-993a-221d91a48c4e tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:36.025054 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4b387465-c6f9-438c-993a-221d91a48c4e tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:36.025997 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4b387465-c6f9-438c-993a-221d91a48c4e tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:36.027565 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4b387465-c6f9-438c-993a-221d91a48c4e tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:36.028260 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4b387465-c6f9-438c-993a-221d91a48c4e tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:36.029813 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4b387465-c6f9-438c-993a-221d91a48c4e tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:36.067879 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-72838986-05ed-4dec-9862-57c245cc0dd0 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:36.081333 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-72838986-05ed-4dec-9862-57c245cc0dd0 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:36.083298 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-72838986-05ed-4dec-9862-57c245cc0dd0 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:36.084818 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-72838986-05ed-4dec-9862-57c245cc0dd0 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] 10.222.0.70 "GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7" status: 200 len: 1879 microversion: 2.32 time: 0.565159 Aug 27 02:55:36.095015 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1567/3139] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:55:35 2022] GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 => generated 1879 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:55:36.151546 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-4b387465-c6f9-438c-993a-221d91a48c4e tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5097adbf553e4e319d2cb0cf383f587a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77abdb9b52614d1fbd6d70774a2df31f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:36.164170 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-4b387465-c6f9-438c-993a-221d91a48c4e tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5097adbf553e4e319d2cb0cf383f587a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77abdb9b52614d1fbd6d70774a2df31f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:36.166165 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-4b387465-c6f9-438c-993a-221d91a48c4e tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5097adbf553e4e319d2cb0cf383f587a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77abdb9b52614d1fbd6d70774a2df31f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:36.174191 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-4b387465-c6f9-438c-993a-221d91a48c4e tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] 10.222.0.70 "GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec" status: 200 len: 1447 microversion: 2.75 time: 0.166676 Aug 27 02:55:36.192415 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1573/3140] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:55:36 2022] GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec => generated 1447 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:55:36.278774 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-229d8e43-a641-40f2-bf7b-c3b78109270e req-51d70706-1588-42a4-b452-430ac28c1743 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cafa2fd0-80bd-413c-a7ae-4cb7b3c2a573", "name": "network-vif-deleted", "tag": "d161a02d-1ba1-4a2e-a278-1c8407983018"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:55:36.297232 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-229d8e43-a641-40f2-bf7b-c3b78109270e req-51d70706-1588-42a4-b452-430ac28c1743 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:36.297982 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-229d8e43-a641-40f2-bf7b-c3b78109270e req-51d70706-1588-42a4-b452-430ac28c1743 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:36.298763 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-229d8e43-a641-40f2-bf7b-c3b78109270e req-51d70706-1588-42a4-b452-430ac28c1743 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:36.345117 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-229d8e43-a641-40f2-bf7b-c3b78109270e req-51d70706-1588-42a4-b452-430ac28c1743 service nova] Creating event network-vif-deleted:d161a02d-1ba1-4a2e-a278-1c8407983018 for instance cafa2fd0-80bd-413c-a7ae-4cb7b3c2a573 on n-h2-852278-4 Aug 27 02:55:36.354280 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-229d8e43-a641-40f2-bf7b-c3b78109270e req-51d70706-1588-42a4-b452-430ac28c1743 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079575 Aug 27 02:55:36.360065 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1568/3141] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:55:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:55:36.507104 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a21567c5-125e-4c08-a8e1-62f8d81de083 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:36.508542 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a21567c5-125e-4c08-a8e1-62f8d81de083 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] [instance: d93fa48e-eff8-43b7-a1d9-a8199c8c0db9] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:36.525325 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a21567c5-125e-4c08-a8e1-62f8d81de083 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:36.529828 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a21567c5-125e-4c08-a8e1-62f8d81de083 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:36.531472 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a21567c5-125e-4c08-a8e1-62f8d81de083 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:36.533053 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a21567c5-125e-4c08-a8e1-62f8d81de083 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:36.534387 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a21567c5-125e-4c08-a8e1-62f8d81de083 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:36.536478 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a21567c5-125e-4c08-a8e1-62f8d81de083 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:36.537376 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-cea44daf-3b66-49e9-88ce-4bc2e035524f tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:36.538103 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-cea44daf-3b66-49e9-88ce-4bc2e035524f tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: cafa2fd0-80bd-413c-a7ae-4cb7b3c2a573] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:36.555576 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cea44daf-3b66-49e9-88ce-4bc2e035524f tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:36.556445 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cea44daf-3b66-49e9-88ce-4bc2e035524f tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:36.556904 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cea44daf-3b66-49e9-88ce-4bc2e035524f tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:36.558003 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cea44daf-3b66-49e9-88ce-4bc2e035524f tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:36.558555 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cea44daf-3b66-49e9-88ce-4bc2e035524f tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:36.559044 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cea44daf-3b66-49e9-88ce-4bc2e035524f tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:36.663428 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cea44daf-3b66-49e9-88ce-4bc2e035524f tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:36.663924 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cea44daf-3b66-49e9-88ce-4bc2e035524f tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:36.664388 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cea44daf-3b66-49e9-88ce-4bc2e035524f tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:36.664853 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.objects.instance [None req-cea44daf-3b66-49e9-88ce-4bc2e035524f tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lazy-loading 'fault' on Instance uuid cafa2fd0-80bd-413c-a7ae-4cb7b3c2a573 {{(pid=134051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:55:36.781094 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-cea44daf-3b66-49e9-88ce-4bc2e035524f tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc53b0977c2b4e06b2f290442483913b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840077c9375b4b2a9214cb8dda094cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:36.793320 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-cea44daf-3b66-49e9-88ce-4bc2e035524f tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/cafa2fd0-80bd-413c-a7ae-4cb7b3c2a573" status: 200 len: 1304 microversion: 2.1 time: 0.270262 Aug 27 02:55:36.795657 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1569/3142] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:36 2022] GET /compute/v2.1/servers/cafa2fd0-80bd-413c-a7ae-4cb7b3c2a573 => generated 1304 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:55:36.834835 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-a21567c5-125e-4c08-a8e1-62f8d81de083 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8ecf90321841438b77fdceed1e6ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f84ee02bd14800bc5a4212a3746e9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:36.844103 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a21567c5-125e-4c08-a8e1-62f8d81de083 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] 10.222.0.70 "GET /compute/v2.1/servers/d93fa48e-eff8-43b7-a1d9-a8199c8c0db9" status: 200 len: 1505 microversion: 2.1 time: 0.342333 Aug 27 02:55:36.844818 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1574/3143] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:36 2022] GET /compute/v2.1/servers/d93fa48e-eff8-43b7-a1d9-a8199c8c0db9 => generated 1505 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:55:36.869999 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-41c4b023-763b-452e-84a4-d8348eaf82fc tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Calling method '.version_select at 0x7f5eded9fdc0>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:36.870642 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-41c4b023-763b-452e-84a4-d8348eaf82fc tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] [instance: d93fa48e-eff8-43b7-a1d9-a8199c8c0db9] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:36.887506 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-41c4b023-763b-452e-84a4-d8348eaf82fc tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:36.888002 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-41c4b023-763b-452e-84a4-d8348eaf82fc tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:36.890273 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-41c4b023-763b-452e-84a4-d8348eaf82fc tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:36.894044 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-41c4b023-763b-452e-84a4-d8348eaf82fc tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:36.894044 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-41c4b023-763b-452e-84a4-d8348eaf82fc tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:36.894362 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-41c4b023-763b-452e-84a4-d8348eaf82fc tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:36.968137 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-41c4b023-763b-452e-84a4-d8348eaf82fc tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] 10.222.0.70 "GET /compute/v2.1/servers/d93fa48e-eff8-43b7-a1d9-a8199c8c0db9/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.102136 Aug 27 02:55:36.969215 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1570/3144] 10.222.0.70 () {58 vars in 1296 bytes} [Sat Aug 27 02:55:36 2022] GET /compute/v2.1/servers/d93fa48e-eff8-43b7-a1d9-a8199c8c0db9/os-instance-actions => generated 611 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:55:36.981930 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a531104c-9c90-4607-aca6-37ffa0255876 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:36.983230 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a531104c-9c90-4607-aca6-37ffa0255876 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] [instance: d93fa48e-eff8-43b7-a1d9-a8199c8c0db9] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:37.002310 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a531104c-9c90-4607-aca6-37ffa0255876 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:37.002800 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a531104c-9c90-4607-aca6-37ffa0255876 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:37.003239 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a531104c-9c90-4607-aca6-37ffa0255876 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:37.003994 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a531104c-9c90-4607-aca6-37ffa0255876 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:37.006650 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a531104c-9c90-4607-aca6-37ffa0255876 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:37.007347 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a531104c-9c90-4607-aca6-37ffa0255876 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:37.026894 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e5a062c2-d8d4-4418-9784-58c1ab0d1eab tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:37.027888 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-e5a062c2-d8d4-4418-9784-58c1ab0d1eab tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:37.039254 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e5a062c2-d8d4-4418-9784-58c1ab0d1eab tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:37.040935 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e5a062c2-d8d4-4418-9784-58c1ab0d1eab tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:37.041586 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e5a062c2-d8d4-4418-9784-58c1ab0d1eab tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:37.045255 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e5a062c2-d8d4-4418-9784-58c1ab0d1eab tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:37.045954 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e5a062c2-d8d4-4418-9784-58c1ab0d1eab tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:37.046680 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e5a062c2-d8d4-4418-9784-58c1ab0d1eab tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:37.075688 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a531104c-9c90-4607-aca6-37ffa0255876 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] [instance: d93fa48e-eff8-43b7-a1d9-a8199c8c0db9] Going to try to terminate instance {{(pid=134052) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:55:37.196257 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a531104c-9c90-4607-aca6-37ffa0255876 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] 10.222.0.70 "DELETE /compute/v2.1/servers/d93fa48e-eff8-43b7-a1d9-a8199c8c0db9" status: 204 len: 0 microversion: 2.1 time: 0.218471 Aug 27 02:55:37.200586 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1575/3145] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:55:36 2022] DELETE /compute/v2.1/servers/d93fa48e-eff8-43b7-a1d9-a8199c8c0db9 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:55:37.208049 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-44a86d34-0910-4a6e-bfb5-bb4271aff3ab tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:37.209062 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-44a86d34-0910-4a6e-bfb5-bb4271aff3ab tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] [instance: b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:37.217118 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-44a86d34-0910-4a6e-bfb5-bb4271aff3ab tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:37.217837 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-44a86d34-0910-4a6e-bfb5-bb4271aff3ab tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:37.218278 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-44a86d34-0910-4a6e-bfb5-bb4271aff3ab tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:37.219001 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-44a86d34-0910-4a6e-bfb5-bb4271aff3ab tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:37.219455 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-44a86d34-0910-4a6e-bfb5-bb4271aff3ab tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:37.219881 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-44a86d34-0910-4a6e-bfb5-bb4271aff3ab tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:37.246534 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e5a062c2-d8d4-4418-9784-58c1ab0d1eab tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:37.255647 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e5a062c2-d8d4-4418-9784-58c1ab0d1eab tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1655 microversion: 2.1 time: 0.233883 Aug 27 02:55:37.256606 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1571/3146] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:37 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1655 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:55:37.261842 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-22f007fb-47bb-4e79-83a0-0e0424443461 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:37.262742 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-22f007fb-47bb-4e79-83a0-0e0424443461 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] [instance: 3f31178a-8993-4aa6-8d41-496bfec13bec] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:37.270114 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-22f007fb-47bb-4e79-83a0-0e0424443461 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:37.270913 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-22f007fb-47bb-4e79-83a0-0e0424443461 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:37.272051 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-22f007fb-47bb-4e79-83a0-0e0424443461 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:37.272980 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-22f007fb-47bb-4e79-83a0-0e0424443461 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:37.273624 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-22f007fb-47bb-4e79-83a0-0e0424443461 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:37.274305 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-22f007fb-47bb-4e79-83a0-0e0424443461 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:37.397207 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-22f007fb-47bb-4e79-83a0-0e0424443461 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5097adbf553e4e319d2cb0cf383f587a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77abdb9b52614d1fbd6d70774a2df31f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:37.408222 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-22f007fb-47bb-4e79-83a0-0e0424443461 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5097adbf553e4e319d2cb0cf383f587a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77abdb9b52614d1fbd6d70774a2df31f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:37.410013 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-22f007fb-47bb-4e79-83a0-0e0424443461 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5097adbf553e4e319d2cb0cf383f587a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77abdb9b52614d1fbd6d70774a2df31f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:37.415628 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-22f007fb-47bb-4e79-83a0-0e0424443461 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] 10.222.0.70 "GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec" status: 200 len: 1447 microversion: 2.75 time: 0.157767 Aug 27 02:55:37.416222 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1572/3147] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:55:37 2022] GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec => generated 1447 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:55:37.421062 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ccc24196-1088-4a6d-ae76-fe1ffcd4be0b tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:37.421929 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-ccc24196-1088-4a6d-ae76-fe1ffcd4be0b tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] [instance: d93fa48e-eff8-43b7-a1d9-a8199c8c0db9] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:37.428793 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ccc24196-1088-4a6d-ae76-fe1ffcd4be0b tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:37.429521 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ccc24196-1088-4a6d-ae76-fe1ffcd4be0b tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:37.430132 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ccc24196-1088-4a6d-ae76-fe1ffcd4be0b tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:37.431001 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ccc24196-1088-4a6d-ae76-fe1ffcd4be0b tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:37.431687 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ccc24196-1088-4a6d-ae76-fe1ffcd4be0b tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:37.432419 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ccc24196-1088-4a6d-ae76-fe1ffcd4be0b tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:37.477819 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-44a86d34-0910-4a6e-bfb5-bb4271aff3ab tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:37.491066 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-44a86d34-0910-4a6e-bfb5-bb4271aff3ab tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:37.493442 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-44a86d34-0910-4a6e-bfb5-bb4271aff3ab tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:37.494826 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-44a86d34-0910-4a6e-bfb5-bb4271aff3ab tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] 10.222.0.70 "GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7" status: 200 len: 1879 microversion: 2.32 time: 0.292704 Aug 27 02:55:37.495579 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1576/3148] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:55:37 2022] GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 => generated 1879 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:55:37.502131 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-38dafdb4-0e5a-4f9d-a6bc-2b117c4f7872 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:55:37.511766 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-38dafdb4-0e5a-4f9d-a6bc-2b117c4f7872 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:37.513343 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-38dafdb4-0e5a-4f9d-a6bc-2b117c4f7872 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:37.514011 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-38dafdb4-0e5a-4f9d-a6bc-2b117c4f7872 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:37.550297 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-38dafdb4-0e5a-4f9d-a6bc-2b117c4f7872 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Going to try to start instance {{(pid=134052) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 27 02:55:37.610761 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-38dafdb4-0e5a-4f9d-a6bc-2b117c4f7872 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "POST /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd/action" status: 202 len: 0 microversion: 2.1 time: 0.113426 Aug 27 02:55:37.614399 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1577/3149] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 02:55:37 2022] POST /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:55:37.614590 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-ccc24196-1088-4a6d-ae76-fe1ffcd4be0b tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8ecf90321841438b77fdceed1e6ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f84ee02bd14800bc5a4212a3746e9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:37.621447 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0a00632f-82ae-4ad4-8991-8d7ed7b4cd2a tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:37.622152 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-0a00632f-82ae-4ad4-8991-8d7ed7b4cd2a tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:37.623654 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ccc24196-1088-4a6d-ae76-fe1ffcd4be0b tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] 10.222.0.70 "GET /compute/v2.1/servers/d93fa48e-eff8-43b7-a1d9-a8199c8c0db9" status: 200 len: 1511 microversion: 2.1 time: 0.206287 Aug 27 02:55:37.624583 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1573/3150] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:37 2022] GET /compute/v2.1/servers/d93fa48e-eff8-43b7-a1d9-a8199c8c0db9 => generated 1511 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:55:37.628927 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0a00632f-82ae-4ad4-8991-8d7ed7b4cd2a tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:37.629315 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0a00632f-82ae-4ad4-8991-8d7ed7b4cd2a tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:37.629929 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0a00632f-82ae-4ad4-8991-8d7ed7b4cd2a tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:37.630956 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0a00632f-82ae-4ad4-8991-8d7ed7b4cd2a tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:37.631408 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0a00632f-82ae-4ad4-8991-8d7ed7b4cd2a tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:37.631822 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0a00632f-82ae-4ad4-8991-8d7ed7b4cd2a tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:37.810874 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0a00632f-82ae-4ad4-8991-8d7ed7b4cd2a tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:37.824041 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-85dff0ca-e33b-46cf-b914-65a2c43f8e19 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:37.825168 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-85dff0ca-e33b-46cf-b914-65a2c43f8e19 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: cafa2fd0-80bd-413c-a7ae-4cb7b3c2a573] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:37.830603 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-0a00632f-82ae-4ad4-8991-8d7ed7b4cd2a tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1664 microversion: 2.1 time: 0.213619 Aug 27 02:55:37.833809 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1578/3151] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:37 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1664 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:55:37.834398 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-85dff0ca-e33b-46cf-b914-65a2c43f8e19 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:37.835128 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-85dff0ca-e33b-46cf-b914-65a2c43f8e19 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:37.835575 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-85dff0ca-e33b-46cf-b914-65a2c43f8e19 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:37.836300 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-85dff0ca-e33b-46cf-b914-65a2c43f8e19 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:37.836792 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-85dff0ca-e33b-46cf-b914-65a2c43f8e19 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:37.837581 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-85dff0ca-e33b-46cf-b914-65a2c43f8e19 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:37.856642 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-85dff0ca-e33b-46cf-b914-65a2c43f8e19 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] HTTP exception thrown: Instance cafa2fd0-80bd-413c-a7ae-4cb7b3c2a573 could not be found. Aug 27 02:55:37.859544 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-85dff0ca-e33b-46cf-b914-65a2c43f8e19 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Request method failure captured: Aug 27 02:55:37.859544 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/cafa2fd0-80bd-413c-a7ae-4cb7b3c2a573 HTTP/1.1 Aug 27 02:55:37.859544 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:55:37.859544 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:55:37.859544 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:55:37.859544 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:55:37.859544 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:55:37.859544 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:55:37.859544 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:55:37.859544 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:55:37.859544 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYZ0St41cKkzS8_oefTYdmhcUQuTjHJMchuX75Wes8eVywW22WD3_nUDa_aMbIFBVV51GGjDa8GDt8SbwEVTMvQnSuXk6MkeKEfB2NWHjFnNKSNKnT9A2S4P8aN7qYWhUsGxW2ugzvIrMVMPtkn5w90KE7af4tlEcxQ5ERFDVU7f32Y Aug 27 02:55:37.859544 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:55:37.859544 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:55:37.859544 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:55:37.859544 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:55:37.859544 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:55:37.859544 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:55:37.859544 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 840077c9375b4b2a9214cb8dda094cc8 Aug 27 02:55:37.859544 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-DeleteServersTestJSON-725615510 Aug 27 02:55:37.859544 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:55:37.859544 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:55:37.859544 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/840077c9375b4b2a9214cb8dda094cc8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_840077c9375b4b2a9214cb8dda094cc8", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/840077c9375b4b2a9214cb8dda094cc8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/840077c9375b4b2a9214cb8dda094cc8"}]}] Aug 27 02:55:37.859544 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-DeleteServersTestJSON-725615510 Aug 27 02:55:37.859544 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 840077c9375b4b2a9214cb8dda094cc8 Aug 27 02:55:37.859544 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-DeleteServersTestJSON-725615510 Aug 27 02:55:37.859544 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-DeleteServersTestJSON-725615510-project Aug 27 02:55:37.859544 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:55:37.859544 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:55:37.859544 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: dc53b0977c2b4e06b2f290442483913b Aug 27 02:55:37.859544 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-DeleteServersTestJSON-725615510-project Aug 27 02:55:37.859544 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 02:55:37.859544 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance cafa2fd0-80bd-413c-a7ae-4cb7b3c2a573 could not be found. Aug 27 02:55:37.859544 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': 'cafa2fd0-80bd-413c-a7ae-4cb7b3c2a573'} Aug 27 02:55:37.859544 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:55:37.859544 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:37.859544 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:55:37.859544 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:55:37.859544 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:55:37.859544 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:55:37.859544 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:55:37.859544 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:55:37.859544 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:55:37.859544 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:55:37.859544 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cafa2fd0-80bd-413c-a7ae-4cb7b3c2a573 could not be found. Aug 27 02:55:37.859544 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:55:37.859544 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:55:37.859544 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:55:37.859544 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:37.859544 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:55:37.859544 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:55:37.859544 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:55:37.859544 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:55:37.859544 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:55:37.859544 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:55:37.859544 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:55:37.859544 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:55:37.859544 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:55:37.859544 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:55:37.859544 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:55:37.859544 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:55:37.859544 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cafa2fd0-80bd-413c-a7ae-4cb7b3c2a573 could not be found. Aug 27 02:55:37.859544 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:55:37.859544 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:55:37.859544 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:55:37.864725 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:37.864725 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:55:37.864725 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:55:37.864725 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:55:37.864725 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:55:37.864725 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cafa2fd0-80bd-413c-a7ae-4cb7b3c2a573 could not be found. Aug 27 02:55:37.864725 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:55:37.864725 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-85dff0ca-e33b-46cf-b914-65a2c43f8e19 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Returning 404 to user: Instance cafa2fd0-80bd-413c-a7ae-4cb7b3c2a573 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:55:37.865311 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-85dff0ca-e33b-46cf-b914-65a2c43f8e19 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/cafa2fd0-80bd-413c-a7ae-4cb7b3c2a573" status: 404 len: 111 microversion: 2.1 time: 0.051427 Aug 27 02:55:37.865900 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1574/3152] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:37 2022] GET /compute/v2.1/servers/cafa2fd0-80bd-413c-a7ae-4cb7b3c2a573 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 02:55:37.882024 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-cbb5680f-1a0e-4d72-b151-81055bdbc54b tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:37.882926 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-cbb5680f-1a0e-4d72-b151-81055bdbc54b tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: cafa2fd0-80bd-413c-a7ae-4cb7b3c2a573] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:37.889806 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cbb5680f-1a0e-4d72-b151-81055bdbc54b tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:37.890563 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cbb5680f-1a0e-4d72-b151-81055bdbc54b tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:37.891375 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cbb5680f-1a0e-4d72-b151-81055bdbc54b tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:37.893051 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cbb5680f-1a0e-4d72-b151-81055bdbc54b tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:37.893936 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cbb5680f-1a0e-4d72-b151-81055bdbc54b tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:37.894591 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cbb5680f-1a0e-4d72-b151-81055bdbc54b tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:37.911297 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-cbb5680f-1a0e-4d72-b151-81055bdbc54b tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] HTTP exception thrown: Instance cafa2fd0-80bd-413c-a7ae-4cb7b3c2a573 could not be found. Aug 27 02:55:37.913139 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-cbb5680f-1a0e-4d72-b151-81055bdbc54b tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Request method failure captured: Aug 27 02:55:37.913139 n-d-852278-4 devstack@n-api.service[134052]: request: DELETE /compute/v2.1/servers/cafa2fd0-80bd-413c-a7ae-4cb7b3c2a573 HTTP/1.1 Aug 27 02:55:37.913139 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:55:37.913139 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:55:37.913139 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:55:37.913139 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:55:37.913139 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:55:37.913139 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:55:37.913139 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:55:37.913139 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:55:37.913139 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYZ0St41cKkzS8_oefTYdmhcUQuTjHJMchuX75Wes8eVywW22WD3_nUDa_aMbIFBVV51GGjDa8GDt8SbwEVTMvQnSuXk6MkeKEfB2NWHjFnNKSNKnT9A2S4P8aN7qYWhUsGxW2ugzvIrMVMPtkn5w90KE7af4tlEcxQ5ERFDVU7f32Y Aug 27 02:55:37.913139 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:55:37.913139 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:55:37.913139 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:55:37.913139 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:55:37.913139 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:55:37.913139 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:55:37.913139 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 840077c9375b4b2a9214cb8dda094cc8 Aug 27 02:55:37.913139 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-DeleteServersTestJSON-725615510 Aug 27 02:55:37.913139 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:55:37.913139 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:55:37.913139 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/840077c9375b4b2a9214cb8dda094cc8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_840077c9375b4b2a9214cb8dda094cc8", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/840077c9375b4b2a9214cb8dda094cc8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/840077c9375b4b2a9214cb8dda094cc8"}]}] Aug 27 02:55:37.913139 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-DeleteServersTestJSON-725615510 Aug 27 02:55:37.913139 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 840077c9375b4b2a9214cb8dda094cc8 Aug 27 02:55:37.913139 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-DeleteServersTestJSON-725615510 Aug 27 02:55:37.913139 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-DeleteServersTestJSON-725615510-project Aug 27 02:55:37.913139 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:55:37.913139 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:55:37.913139 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: dc53b0977c2b4e06b2f290442483913b Aug 27 02:55:37.913139 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-DeleteServersTestJSON-725615510-project Aug 27 02:55:37.913139 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 02:55:37.913139 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance cafa2fd0-80bd-413c-a7ae-4cb7b3c2a573 could not be found. Aug 27 02:55:37.913139 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': 'cafa2fd0-80bd-413c-a7ae-4cb7b3c2a573'} Aug 27 02:55:37.913139 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:55:37.913139 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:37.913139 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:55:37.913139 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:55:37.913139 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:55:37.913139 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:55:37.913139 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:55:37.913139 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:55:37.913139 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:55:37.913139 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:55:37.913139 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cafa2fd0-80bd-413c-a7ae-4cb7b3c2a573 could not be found. Aug 27 02:55:37.913139 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:37.913139 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:55:37.913139 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:37.913139 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:37.913139 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:55:37.913139 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:55:37.913139 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:55:37.913139 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:55:37.913139 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:55:37.913139 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:55:37.913139 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 02:55:37.913139 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 02:55:37.913139 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 02:55:37.913139 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 02:55:37.913139 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:55:37.913139 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:55:37.913139 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:55:37.913139 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:55:37.918174 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cafa2fd0-80bd-413c-a7ae-4cb7b3c2a573 could not be found. Aug 27 02:55:37.918174 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:37.918174 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:55:37.918174 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:37.918174 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:37.918174 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:55:37.918174 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:55:37.918174 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:55:37.918174 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:55:37.918174 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cafa2fd0-80bd-413c-a7ae-4cb7b3c2a573 could not be found. Aug 27 02:55:37.918174 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:37.923548 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-cbb5680f-1a0e-4d72-b151-81055bdbc54b tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Returning 404 to user: Instance cafa2fd0-80bd-413c-a7ae-4cb7b3c2a573 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:55:37.924182 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-cbb5680f-1a0e-4d72-b151-81055bdbc54b tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "DELETE /compute/v2.1/servers/cafa2fd0-80bd-413c-a7ae-4cb7b3c2a573" status: 404 len: 111 microversion: 2.1 time: 0.046443 Aug 27 02:55:37.924890 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1579/3153] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:55:37 2022] DELETE /compute/v2.1/servers/cafa2fd0-80bd-413c-a7ae-4cb7b3c2a573 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:55:37.937282 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ce5488d2-c237-48e9-b493-8a52ab407a81 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:37.938340 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-ce5488d2-c237-48e9-b493-8a52ab407a81 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: cafa2fd0-80bd-413c-a7ae-4cb7b3c2a573] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:37.945288 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ce5488d2-c237-48e9-b493-8a52ab407a81 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:37.945776 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ce5488d2-c237-48e9-b493-8a52ab407a81 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:37.946441 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ce5488d2-c237-48e9-b493-8a52ab407a81 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:37.947432 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ce5488d2-c237-48e9-b493-8a52ab407a81 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:37.948126 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ce5488d2-c237-48e9-b493-8a52ab407a81 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:37.948654 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ce5488d2-c237-48e9-b493-8a52ab407a81 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:37.964142 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-ce5488d2-c237-48e9-b493-8a52ab407a81 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] HTTP exception thrown: Instance cafa2fd0-80bd-413c-a7ae-4cb7b3c2a573 could not be found. Aug 27 02:55:37.966099 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ce5488d2-c237-48e9-b493-8a52ab407a81 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Request method failure captured: Aug 27 02:55:37.966099 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/cafa2fd0-80bd-413c-a7ae-4cb7b3c2a573 HTTP/1.1 Aug 27 02:55:37.966099 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:55:37.966099 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:55:37.966099 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:55:37.966099 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:55:37.966099 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:55:37.966099 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:55:37.966099 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:55:37.966099 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:55:37.966099 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYZ0St41cKkzS8_oefTYdmhcUQuTjHJMchuX75Wes8eVywW22WD3_nUDa_aMbIFBVV51GGjDa8GDt8SbwEVTMvQnSuXk6MkeKEfB2NWHjFnNKSNKnT9A2S4P8aN7qYWhUsGxW2ugzvIrMVMPtkn5w90KE7af4tlEcxQ5ERFDVU7f32Y Aug 27 02:55:37.966099 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:55:37.966099 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:55:37.966099 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:55:37.966099 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:55:37.966099 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:55:37.966099 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:55:37.966099 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 840077c9375b4b2a9214cb8dda094cc8 Aug 27 02:55:37.966099 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-DeleteServersTestJSON-725615510 Aug 27 02:55:37.966099 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:55:37.966099 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:55:37.966099 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/840077c9375b4b2a9214cb8dda094cc8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_840077c9375b4b2a9214cb8dda094cc8", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/840077c9375b4b2a9214cb8dda094cc8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/840077c9375b4b2a9214cb8dda094cc8"}]}] Aug 27 02:55:37.966099 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-DeleteServersTestJSON-725615510 Aug 27 02:55:37.966099 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 840077c9375b4b2a9214cb8dda094cc8 Aug 27 02:55:37.966099 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-DeleteServersTestJSON-725615510 Aug 27 02:55:37.966099 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-DeleteServersTestJSON-725615510-project Aug 27 02:55:37.966099 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:55:37.966099 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:55:37.966099 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: dc53b0977c2b4e06b2f290442483913b Aug 27 02:55:37.966099 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-DeleteServersTestJSON-725615510-project Aug 27 02:55:37.966099 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 02:55:37.966099 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance cafa2fd0-80bd-413c-a7ae-4cb7b3c2a573 could not be found. Aug 27 02:55:37.966099 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': 'cafa2fd0-80bd-413c-a7ae-4cb7b3c2a573'} Aug 27 02:55:37.966099 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:55:37.966099 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:37.966099 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:55:37.966099 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:55:37.966099 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:55:37.966099 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:55:37.966099 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:55:37.966099 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:55:37.966099 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:55:37.966099 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:55:37.966099 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cafa2fd0-80bd-413c-a7ae-4cb7b3c2a573 could not be found. Aug 27 02:55:37.966099 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:55:37.966099 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:55:37.966099 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:55:37.966099 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:37.966099 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:55:37.966099 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:55:37.966099 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:55:37.966099 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:55:37.966099 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:55:37.966099 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:55:37.966099 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:55:37.966099 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:55:37.966099 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:55:37.966099 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:55:37.966099 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:55:37.966099 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:55:37.966099 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cafa2fd0-80bd-413c-a7ae-4cb7b3c2a573 could not be found. Aug 27 02:55:37.966099 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:55:37.966099 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:55:37.966099 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:55:37.976595 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:37.976595 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:55:37.976595 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:55:37.976595 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:55:37.976595 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:55:37.976595 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cafa2fd0-80bd-413c-a7ae-4cb7b3c2a573 could not be found. Aug 27 02:55:37.976595 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:55:37.976595 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ce5488d2-c237-48e9-b493-8a52ab407a81 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Returning 404 to user: Instance cafa2fd0-80bd-413c-a7ae-4cb7b3c2a573 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:55:37.976595 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ce5488d2-c237-48e9-b493-8a52ab407a81 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/cafa2fd0-80bd-413c-a7ae-4cb7b3c2a573" status: 404 len: 111 microversion: 2.1 time: 0.038104 Aug 27 02:55:37.976595 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1575/3154] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:37 2022] GET /compute/v2.1/servers/cafa2fd0-80bd-413c-a7ae-4cb7b3c2a573 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 02:55:37.979057 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9bfedd38-a31e-4565-a236-ef605e7b9352 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:37.980146 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-9bfedd38-a31e-4565-a236-ef605e7b9352 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: 1854f7da-898a-4c09-8da9-a69fab19bb71] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:37.986714 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9bfedd38-a31e-4565-a236-ef605e7b9352 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:37.989469 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9bfedd38-a31e-4565-a236-ef605e7b9352 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:37.990040 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9bfedd38-a31e-4565-a236-ef605e7b9352 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:37.990854 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9bfedd38-a31e-4565-a236-ef605e7b9352 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:37.991370 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9bfedd38-a31e-4565-a236-ef605e7b9352 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:37.992028 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9bfedd38-a31e-4565-a236-ef605e7b9352 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:38.009313 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-9bfedd38-a31e-4565-a236-ef605e7b9352 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] HTTP exception thrown: Instance 1854f7da-898a-4c09-8da9-a69fab19bb71 could not be found. Aug 27 02:55:38.011317 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9bfedd38-a31e-4565-a236-ef605e7b9352 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Request method failure captured: Aug 27 02:55:38.011317 n-d-852278-4 devstack@n-api.service[134052]: request: DELETE /compute/v2.1/servers/1854f7da-898a-4c09-8da9-a69fab19bb71 HTTP/1.1 Aug 27 02:55:38.011317 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:55:38.011317 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:55:38.011317 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:55:38.011317 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:55:38.011317 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:55:38.011317 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:55:38.011317 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:55:38.011317 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:55:38.011317 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYZ0St41cKkzS8_oefTYdmhcUQuTjHJMchuX75Wes8eVywW22WD3_nUDa_aMbIFBVV51GGjDa8GDt8SbwEVTMvQnSuXk6MkeKEfB2NWHjFnNKSNKnT9A2S4P8aN7qYWhUsGxW2ugzvIrMVMPtkn5w90KE7af4tlEcxQ5ERFDVU7f32Y Aug 27 02:55:38.011317 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:55:38.011317 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:55:38.011317 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:55:38.011317 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:55:38.011317 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:55:38.011317 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:55:38.011317 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 840077c9375b4b2a9214cb8dda094cc8 Aug 27 02:55:38.011317 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-DeleteServersTestJSON-725615510 Aug 27 02:55:38.011317 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:55:38.011317 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:55:38.011317 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/840077c9375b4b2a9214cb8dda094cc8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_840077c9375b4b2a9214cb8dda094cc8", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/840077c9375b4b2a9214cb8dda094cc8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/840077c9375b4b2a9214cb8dda094cc8"}]}] Aug 27 02:55:38.011317 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-DeleteServersTestJSON-725615510 Aug 27 02:55:38.011317 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 840077c9375b4b2a9214cb8dda094cc8 Aug 27 02:55:38.011317 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-DeleteServersTestJSON-725615510 Aug 27 02:55:38.011317 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-DeleteServersTestJSON-725615510-project Aug 27 02:55:38.011317 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:55:38.011317 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:55:38.011317 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: dc53b0977c2b4e06b2f290442483913b Aug 27 02:55:38.011317 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-DeleteServersTestJSON-725615510-project Aug 27 02:55:38.011317 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 02:55:38.011317 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance 1854f7da-898a-4c09-8da9-a69fab19bb71 could not be found. Aug 27 02:55:38.011317 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '1854f7da-898a-4c09-8da9-a69fab19bb71'} Aug 27 02:55:38.011317 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:55:38.011317 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:38.011317 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:55:38.011317 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:55:38.011317 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:55:38.011317 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:55:38.011317 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:55:38.011317 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:55:38.011317 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:55:38.011317 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:55:38.011317 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1854f7da-898a-4c09-8da9-a69fab19bb71 could not be found. Aug 27 02:55:38.011317 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:38.011317 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:55:38.011317 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:38.011317 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:38.011317 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:55:38.011317 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:55:38.011317 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:55:38.011317 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:55:38.011317 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:55:38.011317 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:55:38.011317 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 02:55:38.011317 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 02:55:38.011317 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 02:55:38.011317 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 02:55:38.011317 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:55:38.011317 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:55:38.011317 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:55:38.011317 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:55:38.017133 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1854f7da-898a-4c09-8da9-a69fab19bb71 could not be found. Aug 27 02:55:38.017133 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:38.017133 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:55:38.017133 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:38.017133 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:38.017133 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:55:38.017133 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:55:38.017133 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:55:38.017133 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:55:38.017133 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1854f7da-898a-4c09-8da9-a69fab19bb71 could not be found. Aug 27 02:55:38.017133 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:38.017133 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9bfedd38-a31e-4565-a236-ef605e7b9352 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Returning 404 to user: Instance 1854f7da-898a-4c09-8da9-a69fab19bb71 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:55:38.017133 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9bfedd38-a31e-4565-a236-ef605e7b9352 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "DELETE /compute/v2.1/servers/1854f7da-898a-4c09-8da9-a69fab19bb71" status: 404 len: 111 microversion: 2.1 time: 0.040429 Aug 27 02:55:38.017133 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1580/3155] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:55:37 2022] DELETE /compute/v2.1/servers/1854f7da-898a-4c09-8da9-a69fab19bb71 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:55:38.024569 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3813e0d2-3bb9-439f-9cbe-e02a8bd6e845 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:38.025511 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-3813e0d2-3bb9-439f-9cbe-e02a8bd6e845 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: 1854f7da-898a-4c09-8da9-a69fab19bb71] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:38.032905 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3813e0d2-3bb9-439f-9cbe-e02a8bd6e845 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:38.033751 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3813e0d2-3bb9-439f-9cbe-e02a8bd6e845 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:38.034462 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3813e0d2-3bb9-439f-9cbe-e02a8bd6e845 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:38.035956 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3813e0d2-3bb9-439f-9cbe-e02a8bd6e845 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:38.036713 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3813e0d2-3bb9-439f-9cbe-e02a8bd6e845 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:38.037383 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3813e0d2-3bb9-439f-9cbe-e02a8bd6e845 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:38.053091 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-3813e0d2-3bb9-439f-9cbe-e02a8bd6e845 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] HTTP exception thrown: Instance 1854f7da-898a-4c09-8da9-a69fab19bb71 could not be found. Aug 27 02:55:38.055234 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3813e0d2-3bb9-439f-9cbe-e02a8bd6e845 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Request method failure captured: Aug 27 02:55:38.055234 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/1854f7da-898a-4c09-8da9-a69fab19bb71 HTTP/1.1 Aug 27 02:55:38.055234 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:55:38.055234 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:55:38.055234 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:55:38.055234 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:55:38.055234 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:55:38.055234 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:55:38.055234 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:55:38.055234 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:55:38.055234 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYZ0St41cKkzS8_oefTYdmhcUQuTjHJMchuX75Wes8eVywW22WD3_nUDa_aMbIFBVV51GGjDa8GDt8SbwEVTMvQnSuXk6MkeKEfB2NWHjFnNKSNKnT9A2S4P8aN7qYWhUsGxW2ugzvIrMVMPtkn5w90KE7af4tlEcxQ5ERFDVU7f32Y Aug 27 02:55:38.055234 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:55:38.055234 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:55:38.055234 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:55:38.055234 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:55:38.055234 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:55:38.055234 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:55:38.055234 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 840077c9375b4b2a9214cb8dda094cc8 Aug 27 02:55:38.055234 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-DeleteServersTestJSON-725615510 Aug 27 02:55:38.055234 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:55:38.055234 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:55:38.055234 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/840077c9375b4b2a9214cb8dda094cc8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_840077c9375b4b2a9214cb8dda094cc8", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/840077c9375b4b2a9214cb8dda094cc8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/840077c9375b4b2a9214cb8dda094cc8"}]}] Aug 27 02:55:38.055234 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-DeleteServersTestJSON-725615510 Aug 27 02:55:38.055234 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 840077c9375b4b2a9214cb8dda094cc8 Aug 27 02:55:38.055234 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-DeleteServersTestJSON-725615510 Aug 27 02:55:38.055234 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-DeleteServersTestJSON-725615510-project Aug 27 02:55:38.055234 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:55:38.055234 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:55:38.055234 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: dc53b0977c2b4e06b2f290442483913b Aug 27 02:55:38.055234 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-DeleteServersTestJSON-725615510-project Aug 27 02:55:38.055234 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 02:55:38.055234 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance 1854f7da-898a-4c09-8da9-a69fab19bb71 could not be found. Aug 27 02:55:38.055234 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '1854f7da-898a-4c09-8da9-a69fab19bb71'} Aug 27 02:55:38.055234 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:55:38.055234 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:38.055234 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:55:38.055234 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:55:38.055234 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:55:38.055234 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:55:38.055234 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:55:38.055234 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:55:38.055234 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:55:38.055234 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:55:38.055234 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1854f7da-898a-4c09-8da9-a69fab19bb71 could not be found. Aug 27 02:55:38.055234 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:55:38.055234 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:55:38.055234 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:55:38.055234 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:38.055234 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:55:38.055234 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:55:38.055234 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:55:38.055234 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:55:38.055234 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:55:38.055234 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:55:38.055234 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:55:38.055234 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:55:38.055234 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:55:38.055234 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:55:38.055234 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:55:38.055234 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:55:38.055234 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1854f7da-898a-4c09-8da9-a69fab19bb71 could not be found. Aug 27 02:55:38.055234 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:55:38.055234 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:55:38.055234 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:55:38.059725 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:38.059725 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:55:38.059725 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:55:38.059725 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:55:38.059725 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:55:38.059725 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1854f7da-898a-4c09-8da9-a69fab19bb71 could not be found. Aug 27 02:55:38.059725 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:55:38.061587 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3813e0d2-3bb9-439f-9cbe-e02a8bd6e845 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Returning 404 to user: Instance 1854f7da-898a-4c09-8da9-a69fab19bb71 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:55:38.062710 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-3813e0d2-3bb9-439f-9cbe-e02a8bd6e845 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/1854f7da-898a-4c09-8da9-a69fab19bb71" status: 404 len: 111 microversion: 2.1 time: 0.042404 Aug 27 02:55:38.064147 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1576/3156] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:38 2022] GET /compute/v2.1/servers/1854f7da-898a-4c09-8da9-a69fab19bb71 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:55:38.073207 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-77f53cbb-2b6e-424d-98c7-744e6e9ebecd tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:38.073738 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-77f53cbb-2b6e-424d-98c7-744e6e9ebecd tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: 97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:38.080371 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-77f53cbb-2b6e-424d-98c7-744e6e9ebecd tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:38.081067 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-77f53cbb-2b6e-424d-98c7-744e6e9ebecd tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:38.081745 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-77f53cbb-2b6e-424d-98c7-744e6e9ebecd tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:38.082809 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-77f53cbb-2b6e-424d-98c7-744e6e9ebecd tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:38.083571 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-77f53cbb-2b6e-424d-98c7-744e6e9ebecd tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:38.083701 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-77f53cbb-2b6e-424d-98c7-744e6e9ebecd tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:38.100295 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-77f53cbb-2b6e-424d-98c7-744e6e9ebecd tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] HTTP exception thrown: Instance 97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4 could not be found. Aug 27 02:55:38.102298 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-77f53cbb-2b6e-424d-98c7-744e6e9ebecd tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Request method failure captured: Aug 27 02:55:38.102298 n-d-852278-4 devstack@n-api.service[134052]: request: DELETE /compute/v2.1/servers/97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4 HTTP/1.1 Aug 27 02:55:38.102298 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:55:38.102298 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:55:38.102298 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:55:38.102298 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:55:38.102298 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:55:38.102298 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:55:38.102298 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:55:38.102298 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:55:38.102298 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYZ0St41cKkzS8_oefTYdmhcUQuTjHJMchuX75Wes8eVywW22WD3_nUDa_aMbIFBVV51GGjDa8GDt8SbwEVTMvQnSuXk6MkeKEfB2NWHjFnNKSNKnT9A2S4P8aN7qYWhUsGxW2ugzvIrMVMPtkn5w90KE7af4tlEcxQ5ERFDVU7f32Y Aug 27 02:55:38.102298 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:55:38.102298 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:55:38.102298 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:55:38.102298 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:55:38.102298 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:55:38.102298 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:55:38.102298 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 840077c9375b4b2a9214cb8dda094cc8 Aug 27 02:55:38.102298 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-DeleteServersTestJSON-725615510 Aug 27 02:55:38.102298 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:55:38.102298 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:55:38.102298 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/840077c9375b4b2a9214cb8dda094cc8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_840077c9375b4b2a9214cb8dda094cc8", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/840077c9375b4b2a9214cb8dda094cc8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/840077c9375b4b2a9214cb8dda094cc8"}]}] Aug 27 02:55:38.102298 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-DeleteServersTestJSON-725615510 Aug 27 02:55:38.102298 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 840077c9375b4b2a9214cb8dda094cc8 Aug 27 02:55:38.102298 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-DeleteServersTestJSON-725615510 Aug 27 02:55:38.102298 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-DeleteServersTestJSON-725615510-project Aug 27 02:55:38.102298 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:55:38.102298 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:55:38.102298 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: dc53b0977c2b4e06b2f290442483913b Aug 27 02:55:38.102298 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-DeleteServersTestJSON-725615510-project Aug 27 02:55:38.102298 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 02:55:38.102298 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance 97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4 could not be found. Aug 27 02:55:38.102298 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4'} Aug 27 02:55:38.102298 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:55:38.102298 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:38.102298 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:55:38.102298 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:55:38.102298 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:55:38.102298 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:55:38.102298 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:55:38.102298 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:55:38.102298 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:55:38.102298 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:55:38.102298 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4 could not be found. Aug 27 02:55:38.102298 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:38.102298 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:55:38.102298 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:38.102298 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:38.102298 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:55:38.102298 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:55:38.102298 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:55:38.102298 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:55:38.102298 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:55:38.102298 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:55:38.102298 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 02:55:38.102298 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 02:55:38.102298 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 02:55:38.102298 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 02:55:38.102298 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:55:38.102298 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:55:38.102298 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:55:38.102298 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:55:38.110042 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4 could not be found. Aug 27 02:55:38.110042 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:38.110042 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:55:38.110042 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:38.110042 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:38.110042 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:55:38.110042 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:55:38.110042 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:55:38.110042 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:55:38.110042 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4 could not be found. Aug 27 02:55:38.110042 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:38.110042 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-77f53cbb-2b6e-424d-98c7-744e6e9ebecd tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Returning 404 to user: Instance 97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:55:38.110042 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-77f53cbb-2b6e-424d-98c7-744e6e9ebecd tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "DELETE /compute/v2.1/servers/97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4" status: 404 len: 111 microversion: 2.1 time: 0.035457 Aug 27 02:55:38.110042 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1581/3157] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:55:38 2022] DELETE /compute/v2.1/servers/97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:55:38.113785 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-9f82a375-f5cd-4480-87f7-811d5e3e15da tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:38.114447 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-9f82a375-f5cd-4480-87f7-811d5e3e15da tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: 97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:38.120979 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9f82a375-f5cd-4480-87f7-811d5e3e15da tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:38.121655 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9f82a375-f5cd-4480-87f7-811d5e3e15da tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:38.122270 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9f82a375-f5cd-4480-87f7-811d5e3e15da tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:38.123147 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9f82a375-f5cd-4480-87f7-811d5e3e15da tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:38.123759 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9f82a375-f5cd-4480-87f7-811d5e3e15da tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:38.124371 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9f82a375-f5cd-4480-87f7-811d5e3e15da tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:38.141981 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-9f82a375-f5cd-4480-87f7-811d5e3e15da tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] HTTP exception thrown: Instance 97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4 could not be found. Aug 27 02:55:38.143768 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-9f82a375-f5cd-4480-87f7-811d5e3e15da tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Request method failure captured: Aug 27 02:55:38.143768 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4 HTTP/1.1 Aug 27 02:55:38.143768 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:55:38.143768 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:55:38.143768 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:55:38.143768 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:55:38.143768 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:55:38.143768 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:55:38.143768 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:55:38.143768 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:55:38.143768 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYZ0St41cKkzS8_oefTYdmhcUQuTjHJMchuX75Wes8eVywW22WD3_nUDa_aMbIFBVV51GGjDa8GDt8SbwEVTMvQnSuXk6MkeKEfB2NWHjFnNKSNKnT9A2S4P8aN7qYWhUsGxW2ugzvIrMVMPtkn5w90KE7af4tlEcxQ5ERFDVU7f32Y Aug 27 02:55:38.143768 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:55:38.143768 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:55:38.143768 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:55:38.143768 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:55:38.143768 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:55:38.143768 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:55:38.143768 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 840077c9375b4b2a9214cb8dda094cc8 Aug 27 02:55:38.143768 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-DeleteServersTestJSON-725615510 Aug 27 02:55:38.143768 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:55:38.143768 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:55:38.143768 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/840077c9375b4b2a9214cb8dda094cc8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_840077c9375b4b2a9214cb8dda094cc8", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/840077c9375b4b2a9214cb8dda094cc8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/840077c9375b4b2a9214cb8dda094cc8"}]}] Aug 27 02:55:38.143768 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-DeleteServersTestJSON-725615510 Aug 27 02:55:38.143768 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 840077c9375b4b2a9214cb8dda094cc8 Aug 27 02:55:38.143768 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-DeleteServersTestJSON-725615510 Aug 27 02:55:38.143768 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-DeleteServersTestJSON-725615510-project Aug 27 02:55:38.143768 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:55:38.143768 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:55:38.143768 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: dc53b0977c2b4e06b2f290442483913b Aug 27 02:55:38.143768 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-DeleteServersTestJSON-725615510-project Aug 27 02:55:38.143768 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 02:55:38.143768 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance 97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4 could not be found. Aug 27 02:55:38.143768 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4'} Aug 27 02:55:38.143768 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:55:38.143768 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:38.143768 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:55:38.143768 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:55:38.143768 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:55:38.143768 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:55:38.143768 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:55:38.143768 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:55:38.143768 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:55:38.143768 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:55:38.143768 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4 could not be found. Aug 27 02:55:38.143768 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:55:38.143768 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:55:38.143768 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:55:38.143768 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:38.143768 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:55:38.143768 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:55:38.143768 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:55:38.143768 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:55:38.143768 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:55:38.143768 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:55:38.143768 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:55:38.143768 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:55:38.143768 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:55:38.143768 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:55:38.143768 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:55:38.143768 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:55:38.143768 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4 could not be found. Aug 27 02:55:38.143768 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:55:38.143768 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:55:38.143768 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:55:38.149330 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:38.149330 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:55:38.149330 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:55:38.149330 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:55:38.149330 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:55:38.149330 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4 could not be found. Aug 27 02:55:38.149330 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:55:38.149330 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-9f82a375-f5cd-4480-87f7-811d5e3e15da tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Returning 404 to user: Instance 97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:55:38.149330 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-9f82a375-f5cd-4480-87f7-811d5e3e15da tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4" status: 404 len: 111 microversion: 2.1 time: 0.037497 Aug 27 02:55:38.149330 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1577/3158] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:38 2022] GET /compute/v2.1/servers/97655dcd-43e8-470f-9ccc-ce4ba8dbf4f4 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:55:38.157322 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-606264bf-6c2c-4f9a-8041-e0845fe07a4c tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:38.157884 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-606264bf-6c2c-4f9a-8041-e0845fe07a4c tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: a59ed991-1ea2-45a0-8c0a-6e241c337a4b] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:38.165641 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-606264bf-6c2c-4f9a-8041-e0845fe07a4c tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:38.166146 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-606264bf-6c2c-4f9a-8041-e0845fe07a4c tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:38.166584 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-606264bf-6c2c-4f9a-8041-e0845fe07a4c tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:38.167338 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-606264bf-6c2c-4f9a-8041-e0845fe07a4c tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:38.167791 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-606264bf-6c2c-4f9a-8041-e0845fe07a4c tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:38.168286 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-606264bf-6c2c-4f9a-8041-e0845fe07a4c tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:38.184167 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-606264bf-6c2c-4f9a-8041-e0845fe07a4c tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] HTTP exception thrown: Instance a59ed991-1ea2-45a0-8c0a-6e241c337a4b could not be found. Aug 27 02:55:38.185816 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-606264bf-6c2c-4f9a-8041-e0845fe07a4c tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Request method failure captured: Aug 27 02:55:38.185816 n-d-852278-4 devstack@n-api.service[134052]: request: DELETE /compute/v2.1/servers/a59ed991-1ea2-45a0-8c0a-6e241c337a4b HTTP/1.1 Aug 27 02:55:38.185816 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:55:38.185816 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:55:38.185816 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:55:38.185816 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:55:38.185816 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:55:38.185816 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:55:38.185816 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:55:38.185816 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:55:38.185816 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYZ0St41cKkzS8_oefTYdmhcUQuTjHJMchuX75Wes8eVywW22WD3_nUDa_aMbIFBVV51GGjDa8GDt8SbwEVTMvQnSuXk6MkeKEfB2NWHjFnNKSNKnT9A2S4P8aN7qYWhUsGxW2ugzvIrMVMPtkn5w90KE7af4tlEcxQ5ERFDVU7f32Y Aug 27 02:55:38.185816 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:55:38.185816 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:55:38.185816 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:55:38.185816 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:55:38.185816 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:55:38.185816 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:55:38.185816 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 840077c9375b4b2a9214cb8dda094cc8 Aug 27 02:55:38.185816 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-DeleteServersTestJSON-725615510 Aug 27 02:55:38.185816 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:55:38.185816 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:55:38.185816 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/840077c9375b4b2a9214cb8dda094cc8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_840077c9375b4b2a9214cb8dda094cc8", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/840077c9375b4b2a9214cb8dda094cc8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/840077c9375b4b2a9214cb8dda094cc8"}]}] Aug 27 02:55:38.185816 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-DeleteServersTestJSON-725615510 Aug 27 02:55:38.185816 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 840077c9375b4b2a9214cb8dda094cc8 Aug 27 02:55:38.185816 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-DeleteServersTestJSON-725615510 Aug 27 02:55:38.185816 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-DeleteServersTestJSON-725615510-project Aug 27 02:55:38.185816 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:55:38.185816 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:55:38.185816 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: dc53b0977c2b4e06b2f290442483913b Aug 27 02:55:38.185816 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-DeleteServersTestJSON-725615510-project Aug 27 02:55:38.185816 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 02:55:38.185816 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance a59ed991-1ea2-45a0-8c0a-6e241c337a4b could not be found. Aug 27 02:55:38.185816 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': 'a59ed991-1ea2-45a0-8c0a-6e241c337a4b'} Aug 27 02:55:38.185816 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:55:38.185816 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:38.185816 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:55:38.185816 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:55:38.185816 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:55:38.185816 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:55:38.185816 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:55:38.185816 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:55:38.185816 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:55:38.185816 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:55:38.185816 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a59ed991-1ea2-45a0-8c0a-6e241c337a4b could not be found. Aug 27 02:55:38.185816 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:38.185816 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:55:38.185816 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:38.185816 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:38.185816 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:55:38.185816 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:55:38.185816 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:55:38.185816 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:55:38.185816 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:55:38.185816 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:55:38.185816 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 02:55:38.185816 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 02:55:38.185816 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 02:55:38.185816 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 02:55:38.185816 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:55:38.185816 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:55:38.185816 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:55:38.185816 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:55:38.191443 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a59ed991-1ea2-45a0-8c0a-6e241c337a4b could not be found. Aug 27 02:55:38.191443 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:38.191443 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:55:38.191443 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:38.191443 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:38.191443 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:55:38.191443 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:55:38.191443 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:55:38.191443 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:55:38.191443 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a59ed991-1ea2-45a0-8c0a-6e241c337a4b could not be found. Aug 27 02:55:38.191443 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:38.191443 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-606264bf-6c2c-4f9a-8041-e0845fe07a4c tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Returning 404 to user: Instance a59ed991-1ea2-45a0-8c0a-6e241c337a4b could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:55:38.191443 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-606264bf-6c2c-4f9a-8041-e0845fe07a4c tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "DELETE /compute/v2.1/servers/a59ed991-1ea2-45a0-8c0a-6e241c337a4b" status: 404 len: 111 microversion: 2.1 time: 0.034064 Aug 27 02:55:38.193675 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1582/3159] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:55:38 2022] DELETE /compute/v2.1/servers/a59ed991-1ea2-45a0-8c0a-6e241c337a4b => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:55:38.197552 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-90b66df3-e1d6-475e-8a48-5f3af85b4c24 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:38.198173 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-90b66df3-e1d6-475e-8a48-5f3af85b4c24 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: a59ed991-1ea2-45a0-8c0a-6e241c337a4b] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:38.211834 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-90b66df3-e1d6-475e-8a48-5f3af85b4c24 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:38.212409 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-90b66df3-e1d6-475e-8a48-5f3af85b4c24 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:38.212823 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-90b66df3-e1d6-475e-8a48-5f3af85b4c24 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:38.213691 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-90b66df3-e1d6-475e-8a48-5f3af85b4c24 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:38.214227 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-90b66df3-e1d6-475e-8a48-5f3af85b4c24 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:38.214671 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-90b66df3-e1d6-475e-8a48-5f3af85b4c24 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:38.240523 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-90b66df3-e1d6-475e-8a48-5f3af85b4c24 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] HTTP exception thrown: Instance a59ed991-1ea2-45a0-8c0a-6e241c337a4b could not be found. Aug 27 02:55:38.242689 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-90b66df3-e1d6-475e-8a48-5f3af85b4c24 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Request method failure captured: Aug 27 02:55:38.242689 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/a59ed991-1ea2-45a0-8c0a-6e241c337a4b HTTP/1.1 Aug 27 02:55:38.242689 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:55:38.242689 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:55:38.242689 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:55:38.242689 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:55:38.242689 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:55:38.242689 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:55:38.242689 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:55:38.242689 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:55:38.242689 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYZ0St41cKkzS8_oefTYdmhcUQuTjHJMchuX75Wes8eVywW22WD3_nUDa_aMbIFBVV51GGjDa8GDt8SbwEVTMvQnSuXk6MkeKEfB2NWHjFnNKSNKnT9A2S4P8aN7qYWhUsGxW2ugzvIrMVMPtkn5w90KE7af4tlEcxQ5ERFDVU7f32Y Aug 27 02:55:38.242689 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:55:38.242689 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:55:38.242689 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:55:38.242689 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:55:38.242689 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:55:38.242689 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:55:38.242689 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 840077c9375b4b2a9214cb8dda094cc8 Aug 27 02:55:38.242689 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-DeleteServersTestJSON-725615510 Aug 27 02:55:38.242689 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:55:38.242689 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:55:38.242689 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/840077c9375b4b2a9214cb8dda094cc8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_840077c9375b4b2a9214cb8dda094cc8", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/840077c9375b4b2a9214cb8dda094cc8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/840077c9375b4b2a9214cb8dda094cc8"}]}] Aug 27 02:55:38.242689 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-DeleteServersTestJSON-725615510 Aug 27 02:55:38.242689 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 840077c9375b4b2a9214cb8dda094cc8 Aug 27 02:55:38.242689 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-DeleteServersTestJSON-725615510 Aug 27 02:55:38.242689 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-DeleteServersTestJSON-725615510-project Aug 27 02:55:38.242689 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:55:38.242689 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:55:38.242689 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: dc53b0977c2b4e06b2f290442483913b Aug 27 02:55:38.242689 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-DeleteServersTestJSON-725615510-project Aug 27 02:55:38.242689 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 02:55:38.242689 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance a59ed991-1ea2-45a0-8c0a-6e241c337a4b could not be found. Aug 27 02:55:38.242689 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': 'a59ed991-1ea2-45a0-8c0a-6e241c337a4b'} Aug 27 02:55:38.242689 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:55:38.242689 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:38.242689 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:55:38.242689 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:55:38.242689 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:55:38.242689 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:55:38.242689 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:55:38.242689 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:55:38.242689 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:55:38.242689 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:55:38.242689 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a59ed991-1ea2-45a0-8c0a-6e241c337a4b could not be found. Aug 27 02:55:38.242689 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:55:38.242689 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:55:38.242689 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:55:38.242689 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:38.242689 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:55:38.242689 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:55:38.242689 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:55:38.242689 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:55:38.242689 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:55:38.242689 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:55:38.242689 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:55:38.242689 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:55:38.242689 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:55:38.242689 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:55:38.242689 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:55:38.242689 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:55:38.242689 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a59ed991-1ea2-45a0-8c0a-6e241c337a4b could not be found. Aug 27 02:55:38.242689 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:55:38.242689 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:55:38.242689 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:55:38.253886 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:38.253886 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:55:38.253886 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:55:38.253886 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:55:38.253886 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:55:38.253886 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a59ed991-1ea2-45a0-8c0a-6e241c337a4b could not be found. Aug 27 02:55:38.253886 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:55:38.253886 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-90b66df3-e1d6-475e-8a48-5f3af85b4c24 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Returning 404 to user: Instance a59ed991-1ea2-45a0-8c0a-6e241c337a4b could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:55:38.253886 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-90b66df3-e1d6-475e-8a48-5f3af85b4c24 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/a59ed991-1ea2-45a0-8c0a-6e241c337a4b" status: 404 len: 111 microversion: 2.1 time: 0.052171 Aug 27 02:55:38.256520 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ffc2e6d0-6b85-46ab-8b5f-561e6ba65511 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:38.256520 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-ffc2e6d0-6b85-46ab-8b5f-561e6ba65511 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: a5ea93e6-d2ab-4be4-89b6-7b2fd77e8474] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:38.257888 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1578/3160] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:38 2022] GET /compute/v2.1/servers/a59ed991-1ea2-45a0-8c0a-6e241c337a4b => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:55:38.264762 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-ffc2e6d0-6b85-46ab-8b5f-561e6ba65511 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] HTTP exception thrown: Instance a5ea93e6-d2ab-4be4-89b6-7b2fd77e8474 could not be found. Aug 27 02:55:38.271988 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ffc2e6d0-6b85-46ab-8b5f-561e6ba65511 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Request method failure captured: Aug 27 02:55:38.271988 n-d-852278-4 devstack@n-api.service[134052]: request: DELETE /compute/v2.1/servers/a5ea93e6-d2ab-4be4-89b6-7b2fd77e8474 HTTP/1.1 Aug 27 02:55:38.271988 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:55:38.271988 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:55:38.271988 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:55:38.271988 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:55:38.271988 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:55:38.271988 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:55:38.271988 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:55:38.271988 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:55:38.271988 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYZ0St41cKkzS8_oefTYdmhcUQuTjHJMchuX75Wes8eVywW22WD3_nUDa_aMbIFBVV51GGjDa8GDt8SbwEVTMvQnSuXk6MkeKEfB2NWHjFnNKSNKnT9A2S4P8aN7qYWhUsGxW2ugzvIrMVMPtkn5w90KE7af4tlEcxQ5ERFDVU7f32Y Aug 27 02:55:38.271988 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:55:38.271988 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:55:38.271988 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:55:38.271988 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:55:38.271988 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:55:38.271988 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:55:38.271988 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 840077c9375b4b2a9214cb8dda094cc8 Aug 27 02:55:38.271988 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-DeleteServersTestJSON-725615510 Aug 27 02:55:38.271988 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:55:38.271988 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:55:38.271988 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/840077c9375b4b2a9214cb8dda094cc8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_840077c9375b4b2a9214cb8dda094cc8", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/840077c9375b4b2a9214cb8dda094cc8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/840077c9375b4b2a9214cb8dda094cc8"}]}] Aug 27 02:55:38.271988 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-DeleteServersTestJSON-725615510 Aug 27 02:55:38.271988 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 840077c9375b4b2a9214cb8dda094cc8 Aug 27 02:55:38.271988 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-DeleteServersTestJSON-725615510 Aug 27 02:55:38.271988 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-DeleteServersTestJSON-725615510-project Aug 27 02:55:38.271988 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:55:38.271988 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:55:38.271988 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: dc53b0977c2b4e06b2f290442483913b Aug 27 02:55:38.271988 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-DeleteServersTestJSON-725615510-project Aug 27 02:55:38.271988 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 02:55:38.271988 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance a5ea93e6-d2ab-4be4-89b6-7b2fd77e8474 could not be found. Aug 27 02:55:38.271988 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': 'a5ea93e6-d2ab-4be4-89b6-7b2fd77e8474'} Aug 27 02:55:38.271988 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:55:38.271988 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:38.271988 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:55:38.271988 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:55:38.271988 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:55:38.271988 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:55:38.271988 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 02:55:38.271988 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 02:55:38.271988 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5ea93e6-d2ab-4be4-89b6-7b2fd77e8474 could not be found. Aug 27 02:55:38.271988 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:38.271988 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:55:38.271988 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:38.271988 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:38.271988 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:55:38.271988 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:55:38.271988 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:55:38.271988 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:55:38.271988 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:55:38.271988 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:55:38.271988 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 02:55:38.271988 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 02:55:38.271988 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 02:55:38.271988 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 02:55:38.271988 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:55:38.271988 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:55:38.271988 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:55:38.271988 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:55:38.271988 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5ea93e6-d2ab-4be4-89b6-7b2fd77e8474 could not be found. Aug 27 02:55:38.271988 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:38.271988 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:55:38.271988 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:38.277423 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:38.277423 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:55:38.277423 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:55:38.277423 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:55:38.277423 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:55:38.277423 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5ea93e6-d2ab-4be4-89b6-7b2fd77e8474 could not be found. Aug 27 02:55:38.277423 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:38.284286 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ffc2e6d0-6b85-46ab-8b5f-561e6ba65511 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Returning 404 to user: Instance a5ea93e6-d2ab-4be4-89b6-7b2fd77e8474 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:55:38.284286 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ffc2e6d0-6b85-46ab-8b5f-561e6ba65511 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "DELETE /compute/v2.1/servers/a5ea93e6-d2ab-4be4-89b6-7b2fd77e8474" status: 404 len: 111 microversion: 2.1 time: 0.029918 Aug 27 02:55:38.292025 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1583/3161] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:55:38 2022] DELETE /compute/v2.1/servers/a5ea93e6-d2ab-4be4-89b6-7b2fd77e8474 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:55:38.301252 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-176774cf-bdde-425d-a04f-d5a6b9ab7c6e tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:38.303863 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-176774cf-bdde-425d-a04f-d5a6b9ab7c6e tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: a5ea93e6-d2ab-4be4-89b6-7b2fd77e8474] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:38.328223 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-176774cf-bdde-425d-a04f-d5a6b9ab7c6e tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] HTTP exception thrown: Instance a5ea93e6-d2ab-4be4-89b6-7b2fd77e8474 could not be found. Aug 27 02:55:38.332251 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-176774cf-bdde-425d-a04f-d5a6b9ab7c6e tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Request method failure captured: Aug 27 02:55:38.332251 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/a5ea93e6-d2ab-4be4-89b6-7b2fd77e8474 HTTP/1.1 Aug 27 02:55:38.332251 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:55:38.332251 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:55:38.332251 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:55:38.332251 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:55:38.332251 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:55:38.332251 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:55:38.332251 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:55:38.332251 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:55:38.332251 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYZ0St41cKkzS8_oefTYdmhcUQuTjHJMchuX75Wes8eVywW22WD3_nUDa_aMbIFBVV51GGjDa8GDt8SbwEVTMvQnSuXk6MkeKEfB2NWHjFnNKSNKnT9A2S4P8aN7qYWhUsGxW2ugzvIrMVMPtkn5w90KE7af4tlEcxQ5ERFDVU7f32Y Aug 27 02:55:38.332251 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:55:38.332251 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:55:38.332251 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:55:38.332251 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:55:38.332251 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:55:38.332251 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:55:38.332251 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 840077c9375b4b2a9214cb8dda094cc8 Aug 27 02:55:38.332251 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-DeleteServersTestJSON-725615510 Aug 27 02:55:38.332251 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:55:38.332251 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:55:38.332251 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/840077c9375b4b2a9214cb8dda094cc8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_840077c9375b4b2a9214cb8dda094cc8", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/840077c9375b4b2a9214cb8dda094cc8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/840077c9375b4b2a9214cb8dda094cc8"}]}] Aug 27 02:55:38.332251 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-DeleteServersTestJSON-725615510 Aug 27 02:55:38.332251 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 840077c9375b4b2a9214cb8dda094cc8 Aug 27 02:55:38.332251 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-DeleteServersTestJSON-725615510 Aug 27 02:55:38.332251 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-DeleteServersTestJSON-725615510-project Aug 27 02:55:38.332251 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:55:38.332251 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:55:38.332251 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: dc53b0977c2b4e06b2f290442483913b Aug 27 02:55:38.332251 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-DeleteServersTestJSON-725615510-project Aug 27 02:55:38.332251 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 02:55:38.332251 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance a5ea93e6-d2ab-4be4-89b6-7b2fd77e8474 could not be found. Aug 27 02:55:38.332251 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': 'a5ea93e6-d2ab-4be4-89b6-7b2fd77e8474'} Aug 27 02:55:38.332251 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:55:38.332251 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:38.332251 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:55:38.332251 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:55:38.332251 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:55:38.332251 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:55:38.332251 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 02:55:38.332251 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 02:55:38.332251 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5ea93e6-d2ab-4be4-89b6-7b2fd77e8474 could not be found. Aug 27 02:55:38.332251 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:55:38.332251 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:55:38.332251 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:55:38.332251 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:38.332251 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:55:38.332251 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:55:38.332251 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:55:38.332251 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:55:38.332251 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:55:38.332251 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:55:38.332251 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:55:38.332251 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:55:38.332251 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:55:38.332251 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:55:38.332251 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:55:38.332251 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:55:38.332251 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5ea93e6-d2ab-4be4-89b6-7b2fd77e8474 could not be found. Aug 27 02:55:38.332251 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:55:38.332251 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:55:38.332251 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:55:38.332251 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:38.332251 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:55:38.337497 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:55:38.337497 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:55:38.337497 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:55:38.337497 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5ea93e6-d2ab-4be4-89b6-7b2fd77e8474 could not be found. Aug 27 02:55:38.337497 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:55:38.337497 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-176774cf-bdde-425d-a04f-d5a6b9ab7c6e tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Returning 404 to user: Instance a5ea93e6-d2ab-4be4-89b6-7b2fd77e8474 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:55:38.338708 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-176774cf-bdde-425d-a04f-d5a6b9ab7c6e tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/a5ea93e6-d2ab-4be4-89b6-7b2fd77e8474" status: 404 len: 111 microversion: 2.1 time: 0.047576 Aug 27 02:55:38.343110 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1579/3162] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:38 2022] GET /compute/v2.1/servers/a5ea93e6-d2ab-4be4-89b6-7b2fd77e8474 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:55:38.447451 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b14d89fd-8805-454a-8249-826d7b7616fe tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:38.449411 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b14d89fd-8805-454a-8249-826d7b7616fe tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] [instance: 3f31178a-8993-4aa6-8d41-496bfec13bec] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:38.506701 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b14d89fd-8805-454a-8249-826d7b7616fe tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:38.509005 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b14d89fd-8805-454a-8249-826d7b7616fe tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:38.520504 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-2224dac6-a6db-4c2d-8a87-940cd20bdcfb tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:38.521533 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-2224dac6-a6db-4c2d-8a87-940cd20bdcfb tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] [instance: b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:38.533810 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b14d89fd-8805-454a-8249-826d7b7616fe tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:38.536081 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b14d89fd-8805-454a-8249-826d7b7616fe tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:38.539319 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b14d89fd-8805-454a-8249-826d7b7616fe tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:38.544548 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b14d89fd-8805-454a-8249-826d7b7616fe tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:38.546637 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2224dac6-a6db-4c2d-8a87-940cd20bdcfb tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:38.554840 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2224dac6-a6db-4c2d-8a87-940cd20bdcfb tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:38.558926 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2224dac6-a6db-4c2d-8a87-940cd20bdcfb tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:38.563764 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2224dac6-a6db-4c2d-8a87-940cd20bdcfb tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:38.573334 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2224dac6-a6db-4c2d-8a87-940cd20bdcfb tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:38.579164 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2224dac6-a6db-4c2d-8a87-940cd20bdcfb tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:39.454758 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b14d89fd-8805-454a-8249-826d7b7616fe tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5097adbf553e4e319d2cb0cf383f587a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77abdb9b52614d1fbd6d70774a2df31f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:39.470895 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b14d89fd-8805-454a-8249-826d7b7616fe tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5097adbf553e4e319d2cb0cf383f587a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77abdb9b52614d1fbd6d70774a2df31f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:39.472694 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b14d89fd-8805-454a-8249-826d7b7616fe tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5097adbf553e4e319d2cb0cf383f587a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77abdb9b52614d1fbd6d70774a2df31f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:39.484068 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b14d89fd-8805-454a-8249-826d7b7616fe tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] 10.222.0.70 "GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec" status: 200 len: 1447 microversion: 2.75 time: 1.043913 Aug 27 02:55:39.485256 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1584/3163] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:55:38 2022] GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec => generated 1447 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:55:39.505214 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-cb5586a2-3a85-4b39-90c4-c22f637b2dbd tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:39.506234 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-cb5586a2-3a85-4b39-90c4-c22f637b2dbd tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] [instance: d93fa48e-eff8-43b7-a1d9-a8199c8c0db9] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:39.512793 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cb5586a2-3a85-4b39-90c4-c22f637b2dbd tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:39.513687 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cb5586a2-3a85-4b39-90c4-c22f637b2dbd tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:39.514340 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cb5586a2-3a85-4b39-90c4-c22f637b2dbd tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:39.515284 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cb5586a2-3a85-4b39-90c4-c22f637b2dbd tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:39.515953 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cb5586a2-3a85-4b39-90c4-c22f637b2dbd tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:39.516615 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cb5586a2-3a85-4b39-90c4-c22f637b2dbd tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:40.039290 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-2224dac6-a6db-4c2d-8a87-940cd20bdcfb tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:40.061730 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-2224dac6-a6db-4c2d-8a87-940cd20bdcfb tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:40.063495 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-2224dac6-a6db-4c2d-8a87-940cd20bdcfb tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:40.065022 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-2224dac6-a6db-4c2d-8a87-940cd20bdcfb tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] 10.222.0.70 "GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7" status: 200 len: 1879 microversion: 2.32 time: 1.549571 Aug 27 02:55:40.066216 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1580/3164] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:55:38 2022] GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 => generated 1879 bytes in 1552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:55:40.071179 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-fd2dfff6-3b27-4af6-b56c-a4507e81d76b tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:40.081309 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-fd2dfff6-3b27-4af6-b56c-a4507e81d76b tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:40.088045 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fd2dfff6-3b27-4af6-b56c-a4507e81d76b tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:40.088795 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fd2dfff6-3b27-4af6-b56c-a4507e81d76b tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:40.093076 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fd2dfff6-3b27-4af6-b56c-a4507e81d76b tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:40.094136 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fd2dfff6-3b27-4af6-b56c-a4507e81d76b tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:40.094782 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fd2dfff6-3b27-4af6-b56c-a4507e81d76b tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:40.095382 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fd2dfff6-3b27-4af6-b56c-a4507e81d76b tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:40.250229 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-cb5586a2-3a85-4b39-90c4-c22f637b2dbd tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8ecf90321841438b77fdceed1e6ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f84ee02bd14800bc5a4212a3746e9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:40.258105 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-cb5586a2-3a85-4b39-90c4-c22f637b2dbd tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] 10.222.0.70 "GET /compute/v2.1/servers/d93fa48e-eff8-43b7-a1d9-a8199c8c0db9" status: 200 len: 1511 microversion: 2.1 time: 0.771531 Aug 27 02:55:40.258684 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1585/3165] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:39 2022] GET /compute/v2.1/servers/d93fa48e-eff8-43b7-a1d9-a8199c8c0db9 => generated 1511 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:55:40.511610 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-806d6806-1354-4e5c-a587-5b798dde2171 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:40.512754 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-806d6806-1354-4e5c-a587-5b798dde2171 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] [instance: 3f31178a-8993-4aa6-8d41-496bfec13bec] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:40.530015 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-806d6806-1354-4e5c-a587-5b798dde2171 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:40.530523 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-806d6806-1354-4e5c-a587-5b798dde2171 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:40.535381 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-806d6806-1354-4e5c-a587-5b798dde2171 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:40.536137 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-806d6806-1354-4e5c-a587-5b798dde2171 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:40.536632 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-806d6806-1354-4e5c-a587-5b798dde2171 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:40.537059 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-806d6806-1354-4e5c-a587-5b798dde2171 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:40.715275 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-806d6806-1354-4e5c-a587-5b798dde2171 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5097adbf553e4e319d2cb0cf383f587a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77abdb9b52614d1fbd6d70774a2df31f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:40.723754 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-806d6806-1354-4e5c-a587-5b798dde2171 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5097adbf553e4e319d2cb0cf383f587a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77abdb9b52614d1fbd6d70774a2df31f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:40.731118 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-806d6806-1354-4e5c-a587-5b798dde2171 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5097adbf553e4e319d2cb0cf383f587a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77abdb9b52614d1fbd6d70774a2df31f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:40.745035 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-fd2dfff6-3b27-4af6-b56c-a4507e81d76b tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:40.753297 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-fd2dfff6-3b27-4af6-b56c-a4507e81d76b tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1664 microversion: 2.1 time: 0.685685 Aug 27 02:55:40.755604 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1581/3166] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:40 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1664 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:55:40.769251 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-806d6806-1354-4e5c-a587-5b798dde2171 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] 10.222.0.70 "GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec" status: 200 len: 1447 microversion: 2.75 time: 0.262479 Aug 27 02:55:40.785206 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1586/3167] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:55:40 2022] GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec => generated 1447 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:55:41.093005 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-fb0c1043-1d6b-4e53-80fc-2f346331201a tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:41.094294 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-fb0c1043-1d6b-4e53-80fc-2f346331201a tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] [instance: b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:41.106116 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fb0c1043-1d6b-4e53-80fc-2f346331201a tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:41.114556 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fb0c1043-1d6b-4e53-80fc-2f346331201a tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:41.120868 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fb0c1043-1d6b-4e53-80fc-2f346331201a tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:41.121906 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fb0c1043-1d6b-4e53-80fc-2f346331201a tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:41.122544 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fb0c1043-1d6b-4e53-80fc-2f346331201a tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:41.123169 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fb0c1043-1d6b-4e53-80fc-2f346331201a tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:41.281163 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5595796c-a9ea-43a0-afcf-388545d69fab tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:41.283675 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-5595796c-a9ea-43a0-afcf-388545d69fab tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] [instance: d93fa48e-eff8-43b7-a1d9-a8199c8c0db9] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:41.308426 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5595796c-a9ea-43a0-afcf-388545d69fab tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:41.309071 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5595796c-a9ea-43a0-afcf-388545d69fab tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:41.309528 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5595796c-a9ea-43a0-afcf-388545d69fab tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:41.310274 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5595796c-a9ea-43a0-afcf-388545d69fab tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:41.310734 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5595796c-a9ea-43a0-afcf-388545d69fab tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:41.311161 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5595796c-a9ea-43a0-afcf-388545d69fab tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:41.621478 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-5595796c-a9ea-43a0-afcf-388545d69fab tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8ecf90321841438b77fdceed1e6ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f84ee02bd14800bc5a4212a3746e9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:41.654050 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-5595796c-a9ea-43a0-afcf-388545d69fab tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] 10.222.0.70 "GET /compute/v2.1/servers/d93fa48e-eff8-43b7-a1d9-a8199c8c0db9" status: 200 len: 1469 microversion: 2.1 time: 0.371783 Aug 27 02:55:41.667122 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1587/3168] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:41 2022] GET /compute/v2.1/servers/d93fa48e-eff8-43b7-a1d9-a8199c8c0db9 => generated 1469 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:55:41.717468 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-54f7295f-741d-46ac-92e1-143e7b4883c0 req-80ed57f3-bb3f-4615-a035-70ba5a8adc2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d93fa48e-eff8-43b7-a1d9-a8199c8c0db9", "name": "network-vif-deleted", "tag": "ffdfccc5-74d7-49e6-9a30-6dd06e5e4a03"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:55:41.785789 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-54f7295f-741d-46ac-92e1-143e7b4883c0 req-80ed57f3-bb3f-4615-a035-70ba5a8adc2c service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:41.786596 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-54f7295f-741d-46ac-92e1-143e7b4883c0 req-80ed57f3-bb3f-4615-a035-70ba5a8adc2c service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:41.788002 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-54f7295f-741d-46ac-92e1-143e7b4883c0 req-80ed57f3-bb3f-4615-a035-70ba5a8adc2c service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:41.861306 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-54f7295f-741d-46ac-92e1-143e7b4883c0 req-80ed57f3-bb3f-4615-a035-70ba5a8adc2c service nova] Creating event network-vif-deleted:ffdfccc5-74d7-49e6-9a30-6dd06e5e4a03 for instance d93fa48e-eff8-43b7-a1d9-a8199c8c0db9 on n-h1-852278-4 Aug 27 02:55:41.886848 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-54f7295f-741d-46ac-92e1-143e7b4883c0 req-80ed57f3-bb3f-4615-a035-70ba5a8adc2c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.173574 Aug 27 02:55:41.890274 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1588/3169] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:55:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Aug 27 02:55:41.909826 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-860d7ead-a048-48a7-a9e0-a76956bc80a8 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:41.911048 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-860d7ead-a048-48a7-a9e0-a76956bc80a8 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:41.920164 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-860d7ead-a048-48a7-a9e0-a76956bc80a8 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:41.920870 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-860d7ead-a048-48a7-a9e0-a76956bc80a8 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:41.921502 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-860d7ead-a048-48a7-a9e0-a76956bc80a8 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:41.922380 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-860d7ead-a048-48a7-a9e0-a76956bc80a8 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:41.923079 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-860d7ead-a048-48a7-a9e0-a76956bc80a8 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:41.923774 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-860d7ead-a048-48a7-a9e0-a76956bc80a8 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:41.978391 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-fb0c1043-1d6b-4e53-80fc-2f346331201a tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:42.002963 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-fb0c1043-1d6b-4e53-80fc-2f346331201a tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:42.005144 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-fb0c1043-1d6b-4e53-80fc-2f346331201a tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:42.006827 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-fb0c1043-1d6b-4e53-80fc-2f346331201a tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] 10.222.0.70 "GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7" status: 200 len: 1879 microversion: 2.32 time: 0.918215 Aug 27 02:55:42.008153 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1582/3170] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:55:41 2022] GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 => generated 1879 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:55:42.013551 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e3934e2b-6205-42e6-95d9-fc51f71f71b6 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:42.014458 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-e3934e2b-6205-42e6-95d9-fc51f71f71b6 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] [instance: 3f31178a-8993-4aa6-8d41-496bfec13bec] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:42.021527 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e3934e2b-6205-42e6-95d9-fc51f71f71b6 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:42.022296 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e3934e2b-6205-42e6-95d9-fc51f71f71b6 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:42.023049 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e3934e2b-6205-42e6-95d9-fc51f71f71b6 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:42.023962 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e3934e2b-6205-42e6-95d9-fc51f71f71b6 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:42.026701 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e3934e2b-6205-42e6-95d9-fc51f71f71b6 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:42.028708 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e3934e2b-6205-42e6-95d9-fc51f71f71b6 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:42.514658 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e3934e2b-6205-42e6-95d9-fc51f71f71b6 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5097adbf553e4e319d2cb0cf383f587a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77abdb9b52614d1fbd6d70774a2df31f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:42.526576 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e3934e2b-6205-42e6-95d9-fc51f71f71b6 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5097adbf553e4e319d2cb0cf383f587a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77abdb9b52614d1fbd6d70774a2df31f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:42.531612 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e3934e2b-6205-42e6-95d9-fc51f71f71b6 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5097adbf553e4e319d2cb0cf383f587a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77abdb9b52614d1fbd6d70774a2df31f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:42.552099 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e3934e2b-6205-42e6-95d9-fc51f71f71b6 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] 10.222.0.70 "GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec" status: 200 len: 1447 microversion: 2.75 time: 0.542487 Aug 27 02:55:42.561835 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1583/3171] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:55:42 2022] GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec => generated 1447 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:55:42.688050 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-415299f9-a5a4-4660-81cc-b130b97d1c6b tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:42.689344 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-415299f9-a5a4-4660-81cc-b130b97d1c6b tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] [instance: d93fa48e-eff8-43b7-a1d9-a8199c8c0db9] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:42.726158 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-415299f9-a5a4-4660-81cc-b130b97d1c6b tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:42.727625 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-860d7ead-a048-48a7-a9e0-a76956bc80a8 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:42.733654 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-415299f9-a5a4-4660-81cc-b130b97d1c6b tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:42.740974 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-415299f9-a5a4-4660-81cc-b130b97d1c6b tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:42.743115 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-415299f9-a5a4-4660-81cc-b130b97d1c6b tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:42.744076 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-415299f9-a5a4-4660-81cc-b130b97d1c6b tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:42.747100 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-415299f9-a5a4-4660-81cc-b130b97d1c6b tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:42.754947 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-860d7ead-a048-48a7-a9e0-a76956bc80a8 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1664 microversion: 2.1 time: 0.851724 Aug 27 02:55:42.756137 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1589/3172] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:41 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1664 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:55:42.841077 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:55:42.858098 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-415299f9-a5a4-4660-81cc-b130b97d1c6b tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:42.860094 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-415299f9-a5a4-4660-81cc-b130b97d1c6b tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:42.860754 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-415299f9-a5a4-4660-81cc-b130b97d1c6b tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:42.862798 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.objects.instance [None req-415299f9-a5a4-4660-81cc-b130b97d1c6b tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Lazy-loading 'fault' on Instance uuid d93fa48e-eff8-43b7-a1d9-a8199c8c0db9 {{(pid=134051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:55:43.014537 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-415299f9-a5a4-4660-81cc-b130b97d1c6b tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8ecf90321841438b77fdceed1e6ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f84ee02bd14800bc5a4212a3746e9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:43.038608 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b717adcd-58cf-4f7b-a104-f1d38dae15a1 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:43.040173 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b717adcd-58cf-4f7b-a104-f1d38dae15a1 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] [instance: b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:43.040912 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-415299f9-a5a4-4660-81cc-b130b97d1c6b tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] 10.222.0.70 "GET /compute/v2.1/servers/d93fa48e-eff8-43b7-a1d9-a8199c8c0db9" status: 200 len: 1307 microversion: 2.1 time: 0.356227 Aug 27 02:55:43.042137 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1584/3173] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:42 2022] GET /compute/v2.1/servers/d93fa48e-eff8-43b7-a1d9-a8199c8c0db9 => generated 1307 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:55:43.057796 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b717adcd-58cf-4f7b-a104-f1d38dae15a1 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:43.059505 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b717adcd-58cf-4f7b-a104-f1d38dae15a1 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:43.060783 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b717adcd-58cf-4f7b-a104-f1d38dae15a1 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:43.062242 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b717adcd-58cf-4f7b-a104-f1d38dae15a1 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:43.064276 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b717adcd-58cf-4f7b-a104-f1d38dae15a1 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:43.064913 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b717adcd-58cf-4f7b-a104-f1d38dae15a1 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:43.593150 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0ed9a0be-1068-44c5-a628-a956d9f6a09f tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:43.595192 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-0ed9a0be-1068-44c5-a628-a956d9f6a09f tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] [instance: 3f31178a-8993-4aa6-8d41-496bfec13bec] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:43.607876 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0ed9a0be-1068-44c5-a628-a956d9f6a09f tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:43.612833 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0ed9a0be-1068-44c5-a628-a956d9f6a09f tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:43.613591 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0ed9a0be-1068-44c5-a628-a956d9f6a09f tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:43.614590 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0ed9a0be-1068-44c5-a628-a956d9f6a09f tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:43.618126 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0ed9a0be-1068-44c5-a628-a956d9f6a09f tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:43.618903 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0ed9a0be-1068-44c5-a628-a956d9f6a09f tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:43.667180 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b717adcd-58cf-4f7b-a104-f1d38dae15a1 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:43.678798 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=100 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:55:43.682207 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b717adcd-58cf-4f7b-a104-f1d38dae15a1 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:43.687162 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b717adcd-58cf-4f7b-a104-f1d38dae15a1 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:43.692666 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b717adcd-58cf-4f7b-a104-f1d38dae15a1 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] 10.222.0.70 "GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7" status: 200 len: 1879 microversion: 2.32 time: 0.661484 Aug 27 02:55:43.709101 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1590/3174] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:55:43 2022] GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 => generated 1879 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:55:43.779685 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-843926f9-f0cb-4244-b9c4-53d6b94f403e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:43.784007 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-843926f9-f0cb-4244-b9c4-53d6b94f403e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:43.797462 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-843926f9-f0cb-4244-b9c4-53d6b94f403e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:43.798351 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-843926f9-f0cb-4244-b9c4-53d6b94f403e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:43.798791 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-843926f9-f0cb-4244-b9c4-53d6b94f403e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:43.799523 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-843926f9-f0cb-4244-b9c4-53d6b94f403e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:43.800915 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-0ed9a0be-1068-44c5-a628-a956d9f6a09f tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5097adbf553e4e319d2cb0cf383f587a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77abdb9b52614d1fbd6d70774a2df31f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:43.802226 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-843926f9-f0cb-4244-b9c4-53d6b94f403e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:43.804003 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-843926f9-f0cb-4244-b9c4-53d6b94f403e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:43.813229 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:55:43.820303 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-0ed9a0be-1068-44c5-a628-a956d9f6a09f tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5097adbf553e4e319d2cb0cf383f587a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77abdb9b52614d1fbd6d70774a2df31f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:43.828799 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-0ed9a0be-1068-44c5-a628-a956d9f6a09f tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5097adbf553e4e319d2cb0cf383f587a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77abdb9b52614d1fbd6d70774a2df31f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:43.843712 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-0ed9a0be-1068-44c5-a628-a956d9f6a09f tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] 10.222.0.70 "GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec" status: 200 len: 1447 microversion: 2.75 time: 0.257113 Aug 27 02:55:43.860337 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1585/3175] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:55:43 2022] GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec => generated 1447 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:55:44.067561 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a68ab935-13b9-48be-a219-df8818d0cb89 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:44.068239 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-a68ab935-13b9-48be-a219-df8818d0cb89 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] [instance: d93fa48e-eff8-43b7-a1d9-a8199c8c0db9] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:44.100226 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a68ab935-13b9-48be-a219-df8818d0cb89 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:44.104704 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a68ab935-13b9-48be-a219-df8818d0cb89 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:44.105863 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a68ab935-13b9-48be-a219-df8818d0cb89 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:44.112613 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a68ab935-13b9-48be-a219-df8818d0cb89 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:44.114419 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a68ab935-13b9-48be-a219-df8818d0cb89 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:44.115402 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-843926f9-f0cb-4244-b9c4-53d6b94f403e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:44.118193 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a68ab935-13b9-48be-a219-df8818d0cb89 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:44.127471 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-843926f9-f0cb-4244-b9c4-53d6b94f403e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1668 microversion: 2.1 time: 0.351755 Aug 27 02:55:44.129529 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1591/3176] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:43 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1668 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:55:44.153291 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-89f4acbd-d726-4c96-964a-647d12ed5e40 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:44.153495 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-a68ab935-13b9-48be-a219-df8818d0cb89 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] HTTP exception thrown: Instance d93fa48e-eff8-43b7-a1d9-a8199c8c0db9 could not be found. Aug 27 02:55:44.154298 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-89f4acbd-d726-4c96-964a-647d12ed5e40 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:44.155035 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a68ab935-13b9-48be-a219-df8818d0cb89 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Request method failure captured: Aug 27 02:55:44.155035 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/d93fa48e-eff8-43b7-a1d9-a8199c8c0db9 HTTP/1.1 Aug 27 02:55:44.155035 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:55:44.155035 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:55:44.155035 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:55:44.155035 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:55:44.155035 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:55:44.155035 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:55:44.155035 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:55:44.155035 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:55:44.155035 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYePYcyRBaecCfyyU8EnhfUKGwYzopqFOkP002VArDXOo4xrHtW4GdOo7D-pzsRd9blP9gA02_BaXuRY4nAjr84WUpcmpUL6LcXNtk1XncExyFL9yyQ6TYM05m4WFxFlwzQospRkTHh63X984sk2ujPxVSJL21ANlvl8aqQjkuf1OTs Aug 27 02:55:44.155035 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:55:44.155035 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:55:44.155035 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:55:44.155035 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:55:44.155035 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:55:44.155035 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:55:44.155035 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 97f84ee02bd14800bc5a4212a3746e9c Aug 27 02:55:44.155035 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-InstanceActionsTestJSON-597900964 Aug 27 02:55:44.155035 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:55:44.155035 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:55:44.155035 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/97f84ee02bd14800bc5a4212a3746e9c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_97f84ee02bd14800bc5a4212a3746e9c", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/97f84ee02bd14800bc5a4212a3746e9c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/97f84ee02bd14800bc5a4212a3746e9c"}]}] Aug 27 02:55:44.155035 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-InstanceActionsTestJSON-597900964 Aug 27 02:55:44.155035 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 97f84ee02bd14800bc5a4212a3746e9c Aug 27 02:55:44.155035 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-InstanceActionsTestJSON-597900964 Aug 27 02:55:44.155035 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-InstanceActionsTestJSON-597900964-project Aug 27 02:55:44.155035 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:55:44.155035 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:55:44.155035 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 7b8ecf90321841438b77fdceed1e6ca4 Aug 27 02:55:44.155035 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-InstanceActionsTestJSON-597900964-project Aug 27 02:55:44.155035 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 02:55:44.155035 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance d93fa48e-eff8-43b7-a1d9-a8199c8c0db9 could not be found. Aug 27 02:55:44.155035 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': 'd93fa48e-eff8-43b7-a1d9-a8199c8c0db9'} Aug 27 02:55:44.155035 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:55:44.155035 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:44.155035 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:55:44.155035 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:55:44.155035 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:55:44.155035 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:55:44.155035 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:55:44.155035 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:55:44.155035 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:55:44.155035 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:55:44.155035 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d93fa48e-eff8-43b7-a1d9-a8199c8c0db9 could not be found. Aug 27 02:55:44.155035 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:55:44.155035 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:55:44.155035 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:55:44.155035 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:44.155035 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:55:44.155035 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:55:44.155035 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:55:44.155035 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:55:44.155035 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:55:44.155035 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:55:44.155035 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:55:44.155035 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:55:44.155035 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:55:44.155035 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:55:44.155035 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:55:44.155035 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:55:44.155035 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d93fa48e-eff8-43b7-a1d9-a8199c8c0db9 could not be found. Aug 27 02:55:44.155035 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:55:44.155035 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:55:44.155035 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:55:44.161545 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:44.161545 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:55:44.161545 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:55:44.161545 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:55:44.161545 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:55:44.161545 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d93fa48e-eff8-43b7-a1d9-a8199c8c0db9 could not be found. Aug 27 02:55:44.161545 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:55:44.163739 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a68ab935-13b9-48be-a219-df8818d0cb89 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] Returning 404 to user: Instance d93fa48e-eff8-43b7-a1d9-a8199c8c0db9 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:55:44.165194 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a68ab935-13b9-48be-a219-df8818d0cb89 tempest-InstanceActionsTestJSON-597900964 tempest-InstanceActionsTestJSON-597900964-project] 10.222.0.70 "GET /compute/v2.1/servers/d93fa48e-eff8-43b7-a1d9-a8199c8c0db9" status: 404 len: 111 microversion: 2.1 time: 0.104420 Aug 27 02:55:44.166288 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1586/3177] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:44 2022] GET /compute/v2.1/servers/d93fa48e-eff8-43b7-a1d9-a8199c8c0db9 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:55:44.169501 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-89f4acbd-d726-4c96-964a-647d12ed5e40 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:44.170009 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-89f4acbd-d726-4c96-964a-647d12ed5e40 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:44.170454 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-89f4acbd-d726-4c96-964a-647d12ed5e40 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:44.174713 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-89f4acbd-d726-4c96-964a-647d12ed5e40 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:44.175194 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-89f4acbd-d726-4c96-964a-647d12ed5e40 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:44.176918 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-89f4acbd-d726-4c96-964a-647d12ed5e40 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:44.358127 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-253ec844-2f2f-4195-a1b7-df6187a88685 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Action: 'create', calling method: .version_select at 0x7f5eded07dc0>, body: {"keypair": {"name": "tempest-keypair-1644598461", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFhkJ4ZAj/ln+aEHy89MTq/3DTC0bv/9X78disbnNg8n7ejjucMqz17WanGhAsPqaEK1fmOCVOMhoFlk2GTRLEHvinAx1pzX3ai8r1yP0LpwKlJkuEXndIMf+L+oqvZr8w=="}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:55:44.404170 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-253ec844-2f2f-4195-a1b7-df6187a88685 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Getting quotas for project c997efbeda2c4a2db15e9fe38ab96959. Resources: {'key_pairs'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:55:44.445911 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-253ec844-2f2f-4195-a1b7-df6187a88685 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Getting quotas for user c501b75773884dd7bf574035b88fc5d2 and project c997efbeda2c4a2db15e9fe38ab96959. Resources: {'key_pairs'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:55:44.474506 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-89f4acbd-d726-4c96-964a-647d12ed5e40 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:44.483360 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-89f4acbd-d726-4c96-964a-647d12ed5e40 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1668 microversion: 2.1 time: 0.335421 Aug 27 02:55:44.490038 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1592/3178] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:44 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1668 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:55:44.501618 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0772d82a-39e1-42d3-b029-6a0371b51632 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:44.502403 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-0772d82a-39e1-42d3-b029-6a0371b51632 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: c2c6b214-da6b-48dd-b84c-b111611fc89a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:44.517277 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-253ec844-2f2f-4195-a1b7-df6187a88685 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.310951 Aug 27 02:55:44.520273 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1587/3179] 10.222.0.70 () {60 vars in 1159 bytes} [Sat Aug 27 02:55:44 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:55:44.521518 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:55:44.537275 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0772d82a-39e1-42d3-b029-6a0371b51632 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:44.537782 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0772d82a-39e1-42d3-b029-6a0371b51632 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:44.538231 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0772d82a-39e1-42d3-b029-6a0371b51632 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:44.545732 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-beba08f8-6c98-49d4-b044-2b239d0edeec tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:55:44.546364 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0772d82a-39e1-42d3-b029-6a0371b51632 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:44.549666 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0772d82a-39e1-42d3-b029-6a0371b51632 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:44.551671 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0772d82a-39e1-42d3-b029-6a0371b51632 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:44.556955 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-beba08f8-6c98-49d4-b044-2b239d0edeec tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:44.583764 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-beba08f8-6c98-49d4-b044-2b239d0edeec tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:44.586186 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-beba08f8-6c98-49d4-b044-2b239d0edeec tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:44.587013 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-beba08f8-6c98-49d4-b044-2b239d0edeec tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:44.589915 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-beba08f8-6c98-49d4-b044-2b239d0edeec tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:44.590533 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-beba08f8-6c98-49d4-b044-2b239d0edeec tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:44.592448 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-beba08f8-6c98-49d4-b044-2b239d0edeec tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:44.609509 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-0772d82a-39e1-42d3-b029-6a0371b51632 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] HTTP exception thrown: Instance c2c6b214-da6b-48dd-b84c-b111611fc89a could not be found. Aug 27 02:55:44.619638 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0772d82a-39e1-42d3-b029-6a0371b51632 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Request method failure captured: Aug 27 02:55:44.619638 n-d-852278-4 devstack@n-api.service[134052]: request: DELETE /compute/v2.1/servers/c2c6b214-da6b-48dd-b84c-b111611fc89a HTTP/1.1 Aug 27 02:55:44.619638 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:55:44.619638 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:55:44.619638 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:55:44.619638 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:55:44.619638 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:55:44.619638 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:55:44.619638 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:55:44.619638 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:55:44.619638 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYZ0St41cKkzS8_oefTYdmhcUQuTjHJMchuX75Wes8eVywW22WD3_nUDa_aMbIFBVV51GGjDa8GDt8SbwEVTMvQnSuXk6MkeKEfB2NWHjFnNKSNKnT9A2S4P8aN7qYWhUsGxW2ugzvIrMVMPtkn5w90KE7af4tlEcxQ5ERFDVU7f32Y Aug 27 02:55:44.619638 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:55:44.619638 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:55:44.619638 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:55:44.619638 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:55:44.619638 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:55:44.619638 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:55:44.619638 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 840077c9375b4b2a9214cb8dda094cc8 Aug 27 02:55:44.619638 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-DeleteServersTestJSON-725615510 Aug 27 02:55:44.619638 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:55:44.619638 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:55:44.619638 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/840077c9375b4b2a9214cb8dda094cc8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_840077c9375b4b2a9214cb8dda094cc8", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/840077c9375b4b2a9214cb8dda094cc8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/840077c9375b4b2a9214cb8dda094cc8"}]}] Aug 27 02:55:44.619638 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-DeleteServersTestJSON-725615510 Aug 27 02:55:44.619638 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 840077c9375b4b2a9214cb8dda094cc8 Aug 27 02:55:44.619638 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-DeleteServersTestJSON-725615510 Aug 27 02:55:44.619638 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-DeleteServersTestJSON-725615510-project Aug 27 02:55:44.619638 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:55:44.619638 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:55:44.619638 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: dc53b0977c2b4e06b2f290442483913b Aug 27 02:55:44.619638 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-DeleteServersTestJSON-725615510-project Aug 27 02:55:44.619638 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 02:55:44.619638 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance c2c6b214-da6b-48dd-b84c-b111611fc89a could not be found. Aug 27 02:55:44.619638 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': 'c2c6b214-da6b-48dd-b84c-b111611fc89a'} Aug 27 02:55:44.619638 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:55:44.619638 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:44.619638 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:55:44.619638 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:55:44.619638 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:55:44.619638 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:55:44.619638 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:55:44.619638 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:55:44.619638 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:55:44.619638 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:55:44.619638 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2c6b214-da6b-48dd-b84c-b111611fc89a could not be found. Aug 27 02:55:44.619638 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:44.619638 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:55:44.619638 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:44.619638 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:44.619638 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:55:44.619638 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:55:44.619638 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:55:44.619638 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:55:44.619638 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:55:44.619638 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:55:44.619638 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 02:55:44.619638 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 02:55:44.619638 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 02:55:44.619638 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 02:55:44.619638 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:55:44.619638 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:55:44.619638 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:55:44.619638 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:55:44.626447 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2c6b214-da6b-48dd-b84c-b111611fc89a could not be found. Aug 27 02:55:44.626447 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:44.626447 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:55:44.626447 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:44.626447 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:44.626447 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:55:44.626447 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:55:44.626447 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:55:44.626447 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:55:44.626447 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2c6b214-da6b-48dd-b84c-b111611fc89a could not be found. Aug 27 02:55:44.626447 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:44.626447 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0772d82a-39e1-42d3-b029-6a0371b51632 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Returning 404 to user: Instance c2c6b214-da6b-48dd-b84c-b111611fc89a could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:55:44.626447 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-0772d82a-39e1-42d3-b029-6a0371b51632 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "DELETE /compute/v2.1/servers/c2c6b214-da6b-48dd-b84c-b111611fc89a" status: 404 len: 111 microversion: 2.1 time: 0.128916 Aug 27 02:55:44.626447 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1593/3180] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:55:44 2022] DELETE /compute/v2.1/servers/c2c6b214-da6b-48dd-b84c-b111611fc89a => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:55:44.635623 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c4e7e7a5-a514-44a9-9d6a-8d11f1a75acd tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:44.639217 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-c4e7e7a5-a514-44a9-9d6a-8d11f1a75acd tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: c2c6b214-da6b-48dd-b84c-b111611fc89a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:44.656019 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c4e7e7a5-a514-44a9-9d6a-8d11f1a75acd tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:44.656687 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c4e7e7a5-a514-44a9-9d6a-8d11f1a75acd tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:44.657237 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c4e7e7a5-a514-44a9-9d6a-8d11f1a75acd tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:44.660161 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c4e7e7a5-a514-44a9-9d6a-8d11f1a75acd tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:44.662609 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c4e7e7a5-a514-44a9-9d6a-8d11f1a75acd tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:44.663081 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c4e7e7a5-a514-44a9-9d6a-8d11f1a75acd tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:44.677433 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-beba08f8-6c98-49d4-b044-2b239d0edeec tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Unlocking {{(pid=134051) unlock /opt/stack/nova/nova/compute/api.py:4872}} Aug 27 02:55:44.703924 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-c4e7e7a5-a514-44a9-9d6a-8d11f1a75acd tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] HTTP exception thrown: Instance c2c6b214-da6b-48dd-b84c-b111611fc89a could not be found. Aug 27 02:55:44.709341 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c4e7e7a5-a514-44a9-9d6a-8d11f1a75acd tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Request method failure captured: Aug 27 02:55:44.709341 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/servers/c2c6b214-da6b-48dd-b84c-b111611fc89a HTTP/1.1 Aug 27 02:55:44.709341 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:55:44.709341 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:55:44.709341 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:55:44.709341 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:55:44.709341 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:55:44.709341 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:55:44.709341 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:55:44.709341 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:55:44.709341 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYZ0St41cKkzS8_oefTYdmhcUQuTjHJMchuX75Wes8eVywW22WD3_nUDa_aMbIFBVV51GGjDa8GDt8SbwEVTMvQnSuXk6MkeKEfB2NWHjFnNKSNKnT9A2S4P8aN7qYWhUsGxW2ugzvIrMVMPtkn5w90KE7af4tlEcxQ5ERFDVU7f32Y Aug 27 02:55:44.709341 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:55:44.709341 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:55:44.709341 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:55:44.709341 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:55:44.709341 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:55:44.709341 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:55:44.709341 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 840077c9375b4b2a9214cb8dda094cc8 Aug 27 02:55:44.709341 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-DeleteServersTestJSON-725615510 Aug 27 02:55:44.709341 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:55:44.709341 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:55:44.709341 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/840077c9375b4b2a9214cb8dda094cc8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_840077c9375b4b2a9214cb8dda094cc8", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/840077c9375b4b2a9214cb8dda094cc8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/840077c9375b4b2a9214cb8dda094cc8"}]}] Aug 27 02:55:44.709341 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-DeleteServersTestJSON-725615510 Aug 27 02:55:44.709341 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 840077c9375b4b2a9214cb8dda094cc8 Aug 27 02:55:44.709341 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-DeleteServersTestJSON-725615510 Aug 27 02:55:44.709341 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-DeleteServersTestJSON-725615510-project Aug 27 02:55:44.709341 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:55:44.709341 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:55:44.709341 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: dc53b0977c2b4e06b2f290442483913b Aug 27 02:55:44.709341 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-DeleteServersTestJSON-725615510-project Aug 27 02:55:44.709341 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 02:55:44.709341 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance c2c6b214-da6b-48dd-b84c-b111611fc89a could not be found. Aug 27 02:55:44.709341 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': 'c2c6b214-da6b-48dd-b84c-b111611fc89a'} Aug 27 02:55:44.709341 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:55:44.709341 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:44.709341 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:55:44.709341 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:55:44.709341 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:55:44.709341 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:55:44.709341 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:55:44.709341 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:55:44.709341 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:55:44.709341 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:55:44.709341 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2c6b214-da6b-48dd-b84c-b111611fc89a could not be found. Aug 27 02:55:44.709341 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:44.709341 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:55:44.709341 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:44.709341 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:44.709341 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:55:44.709341 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:55:44.709341 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:55:44.709341 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:55:44.709341 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:55:44.709341 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:55:44.709341 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:55:44.709341 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:55:44.709341 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:55:44.709341 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:55:44.709341 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:55:44.709341 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:55:44.709341 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2c6b214-da6b-48dd-b84c-b111611fc89a could not be found. Aug 27 02:55:44.709341 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:44.709341 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:55:44.709341 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:44.714348 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:44.714348 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:55:44.714348 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:55:44.714348 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:55:44.714348 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:55:44.714348 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2c6b214-da6b-48dd-b84c-b111611fc89a could not be found. Aug 27 02:55:44.714348 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:55:44.716126 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c4e7e7a5-a514-44a9-9d6a-8d11f1a75acd tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Returning 404 to user: Instance c2c6b214-da6b-48dd-b84c-b111611fc89a could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:55:44.717508 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c4e7e7a5-a514-44a9-9d6a-8d11f1a75acd tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/c2c6b214-da6b-48dd-b84c-b111611fc89a" status: 404 len: 111 microversion: 2.1 time: 0.091195 Aug 27 02:55:44.718554 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1594/3181] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:44 2022] GET /compute/v2.1/servers/c2c6b214-da6b-48dd-b84c-b111611fc89a => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:55:44.724129 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-91beb72d-fbb5-4fff-adf2-9d85a4c30946 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:44.725181 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-91beb72d-fbb5-4fff-adf2-9d85a4c30946 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] [instance: b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:44.732598 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-91beb72d-fbb5-4fff-adf2-9d85a4c30946 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:44.733485 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-91beb72d-fbb5-4fff-adf2-9d85a4c30946 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:44.734269 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-91beb72d-fbb5-4fff-adf2-9d85a4c30946 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:44.735284 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-91beb72d-fbb5-4fff-adf2-9d85a4c30946 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:44.735967 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-91beb72d-fbb5-4fff-adf2-9d85a4c30946 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:44.736678 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-91beb72d-fbb5-4fff-adf2-9d85a4c30946 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:44.747242 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-beba08f8-6c98-49d4-b044-2b239d0edeec tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "POST /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd/action" status: 202 len: 0 microversion: 2.1 time: 0.225675 Aug 27 02:55:44.747942 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1588/3182] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 02:55:44 2022] POST /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd/action => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:55:44.768699 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b3600a87-dfa0-49aa-9328-c9ccd46f6144 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:44.769215 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b3600a87-dfa0-49aa-9328-c9ccd46f6144 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: 24cefd05-8d3a-4813-af22-160658183e1b] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:44.785629 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b3600a87-dfa0-49aa-9328-c9ccd46f6144 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:44.787189 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b3600a87-dfa0-49aa-9328-c9ccd46f6144 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:44.787832 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b3600a87-dfa0-49aa-9328-c9ccd46f6144 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:44.788786 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b3600a87-dfa0-49aa-9328-c9ccd46f6144 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:44.789247 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b3600a87-dfa0-49aa-9328-c9ccd46f6144 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:44.789680 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b3600a87-dfa0-49aa-9328-c9ccd46f6144 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:44.809751 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-b3600a87-dfa0-49aa-9328-c9ccd46f6144 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] HTTP exception thrown: Instance 24cefd05-8d3a-4813-af22-160658183e1b could not be found. Aug 27 02:55:44.811518 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b3600a87-dfa0-49aa-9328-c9ccd46f6144 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Request method failure captured: Aug 27 02:55:44.811518 n-d-852278-4 devstack@n-api.service[134051]: request: DELETE /compute/v2.1/servers/24cefd05-8d3a-4813-af22-160658183e1b HTTP/1.1 Aug 27 02:55:44.811518 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:55:44.811518 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:55:44.811518 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:55:44.811518 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:55:44.811518 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:55:44.811518 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:55:44.811518 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:55:44.811518 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:55:44.811518 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYZ0St41cKkzS8_oefTYdmhcUQuTjHJMchuX75Wes8eVywW22WD3_nUDa_aMbIFBVV51GGjDa8GDt8SbwEVTMvQnSuXk6MkeKEfB2NWHjFnNKSNKnT9A2S4P8aN7qYWhUsGxW2ugzvIrMVMPtkn5w90KE7af4tlEcxQ5ERFDVU7f32Y Aug 27 02:55:44.811518 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:55:44.811518 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:55:44.811518 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:55:44.811518 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:55:44.811518 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:55:44.811518 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:55:44.811518 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 840077c9375b4b2a9214cb8dda094cc8 Aug 27 02:55:44.811518 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-DeleteServersTestJSON-725615510 Aug 27 02:55:44.811518 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:55:44.811518 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:55:44.811518 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/840077c9375b4b2a9214cb8dda094cc8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_840077c9375b4b2a9214cb8dda094cc8", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/840077c9375b4b2a9214cb8dda094cc8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/840077c9375b4b2a9214cb8dda094cc8"}]}] Aug 27 02:55:44.811518 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-DeleteServersTestJSON-725615510 Aug 27 02:55:44.811518 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 840077c9375b4b2a9214cb8dda094cc8 Aug 27 02:55:44.811518 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-DeleteServersTestJSON-725615510 Aug 27 02:55:44.811518 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-DeleteServersTestJSON-725615510-project Aug 27 02:55:44.811518 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:55:44.811518 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:55:44.811518 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: dc53b0977c2b4e06b2f290442483913b Aug 27 02:55:44.811518 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-DeleteServersTestJSON-725615510-project Aug 27 02:55:44.811518 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 02:55:44.811518 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance 24cefd05-8d3a-4813-af22-160658183e1b could not be found. Aug 27 02:55:44.811518 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '24cefd05-8d3a-4813-af22-160658183e1b'} Aug 27 02:55:44.811518 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:55:44.811518 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:44.811518 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:55:44.811518 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:55:44.811518 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:55:44.811518 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:55:44.811518 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:55:44.811518 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:55:44.811518 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:55:44.811518 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:55:44.811518 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24cefd05-8d3a-4813-af22-160658183e1b could not be found. Aug 27 02:55:44.811518 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:55:44.811518 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:55:44.811518 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:55:44.811518 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:44.811518 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:55:44.811518 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:55:44.811518 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:55:44.811518 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:55:44.811518 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:55:44.811518 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:55:44.811518 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 02:55:44.811518 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 02:55:44.811518 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 02:55:44.811518 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 02:55:44.811518 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:55:44.811518 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:55:44.811518 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:55:44.811518 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:55:44.816142 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24cefd05-8d3a-4813-af22-160658183e1b could not be found. Aug 27 02:55:44.816142 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:55:44.816142 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:55:44.816142 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:55:44.816142 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:44.816142 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:55:44.816142 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:55:44.816142 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:55:44.816142 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:55:44.816142 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24cefd05-8d3a-4813-af22-160658183e1b could not be found. Aug 27 02:55:44.816142 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:55:44.819958 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b3600a87-dfa0-49aa-9328-c9ccd46f6144 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Returning 404 to user: Instance 24cefd05-8d3a-4813-af22-160658183e1b could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:55:44.821168 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b3600a87-dfa0-49aa-9328-c9ccd46f6144 tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "DELETE /compute/v2.1/servers/24cefd05-8d3a-4813-af22-160658183e1b" status: 404 len: 111 microversion: 2.1 time: 0.069796 Aug 27 02:55:44.822249 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1589/3183] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:55:44 2022] DELETE /compute/v2.1/servers/24cefd05-8d3a-4813-af22-160658183e1b => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:55:44.827551 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-9b41e07a-ab01-46ff-9b93-f55ede349e74 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:44.828634 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-9b41e07a-ab01-46ff-9b93-f55ede349e74 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:44.836707 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9b41e07a-ab01-46ff-9b93-f55ede349e74 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:44.837585 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9b41e07a-ab01-46ff-9b93-f55ede349e74 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:44.838276 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9b41e07a-ab01-46ff-9b93-f55ede349e74 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:44.839802 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9b41e07a-ab01-46ff-9b93-f55ede349e74 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:44.840602 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9b41e07a-ab01-46ff-9b93-f55ede349e74 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:44.841252 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9b41e07a-ab01-46ff-9b93-f55ede349e74 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:45.121792 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-9b41e07a-ab01-46ff-9b93-f55ede349e74 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:45.132788 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-9b41e07a-ab01-46ff-9b93-f55ede349e74 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1668 microversion: 2.1 time: 0.309189 Aug 27 02:55:45.134119 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1590/3184] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:44 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1668 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:55:45.139899 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-cf1b4d44-0379-4304-ad53-c46fe4f1decc tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:45.140855 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-cf1b4d44-0379-4304-ad53-c46fe4f1decc tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] [instance: 24cefd05-8d3a-4813-af22-160658183e1b] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:45.147786 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cf1b4d44-0379-4304-ad53-c46fe4f1decc tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:45.149076 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cf1b4d44-0379-4304-ad53-c46fe4f1decc tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:45.149795 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cf1b4d44-0379-4304-ad53-c46fe4f1decc tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:45.151325 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cf1b4d44-0379-4304-ad53-c46fe4f1decc tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:45.152203 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cf1b4d44-0379-4304-ad53-c46fe4f1decc tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:45.152949 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cf1b4d44-0379-4304-ad53-c46fe4f1decc tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:45.172069 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-cf1b4d44-0379-4304-ad53-c46fe4f1decc tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] HTTP exception thrown: Instance 24cefd05-8d3a-4813-af22-160658183e1b could not be found. Aug 27 02:55:45.174164 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-cf1b4d44-0379-4304-ad53-c46fe4f1decc tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Request method failure captured: Aug 27 02:55:45.174164 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/24cefd05-8d3a-4813-af22-160658183e1b HTTP/1.1 Aug 27 02:55:45.174164 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:55:45.174164 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:55:45.174164 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:55:45.174164 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:55:45.174164 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:55:45.174164 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:55:45.174164 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:55:45.174164 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:55:45.174164 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYZ0St41cKkzS8_oefTYdmhcUQuTjHJMchuX75Wes8eVywW22WD3_nUDa_aMbIFBVV51GGjDa8GDt8SbwEVTMvQnSuXk6MkeKEfB2NWHjFnNKSNKnT9A2S4P8aN7qYWhUsGxW2ugzvIrMVMPtkn5w90KE7af4tlEcxQ5ERFDVU7f32Y Aug 27 02:55:45.174164 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:55:45.174164 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:55:45.174164 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:55:45.174164 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:55:45.174164 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:55:45.174164 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:55:45.174164 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 840077c9375b4b2a9214cb8dda094cc8 Aug 27 02:55:45.174164 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-DeleteServersTestJSON-725615510 Aug 27 02:55:45.174164 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:55:45.174164 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:55:45.174164 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/840077c9375b4b2a9214cb8dda094cc8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_840077c9375b4b2a9214cb8dda094cc8", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/840077c9375b4b2a9214cb8dda094cc8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/840077c9375b4b2a9214cb8dda094cc8"}]}] Aug 27 02:55:45.174164 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-DeleteServersTestJSON-725615510 Aug 27 02:55:45.174164 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 840077c9375b4b2a9214cb8dda094cc8 Aug 27 02:55:45.174164 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-DeleteServersTestJSON-725615510 Aug 27 02:55:45.174164 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-DeleteServersTestJSON-725615510-project Aug 27 02:55:45.174164 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:55:45.174164 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:55:45.174164 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: dc53b0977c2b4e06b2f290442483913b Aug 27 02:55:45.174164 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-DeleteServersTestJSON-725615510-project Aug 27 02:55:45.174164 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 02:55:45.174164 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance 24cefd05-8d3a-4813-af22-160658183e1b could not be found. Aug 27 02:55:45.174164 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '24cefd05-8d3a-4813-af22-160658183e1b'} Aug 27 02:55:45.174164 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:55:45.174164 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:45.174164 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:55:45.174164 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:55:45.174164 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:55:45.174164 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:55:45.174164 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:55:45.174164 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:55:45.174164 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:55:45.174164 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:55:45.174164 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24cefd05-8d3a-4813-af22-160658183e1b could not be found. Aug 27 02:55:45.174164 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:55:45.174164 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:55:45.174164 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:55:45.174164 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:45.174164 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:55:45.174164 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:55:45.174164 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:55:45.174164 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:55:45.174164 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:55:45.174164 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:55:45.174164 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:55:45.174164 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:55:45.174164 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:55:45.174164 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:55:45.174164 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:55:45.174164 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:55:45.174164 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24cefd05-8d3a-4813-af22-160658183e1b could not be found. Aug 27 02:55:45.174164 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:55:45.174164 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:55:45.174164 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:55:45.178937 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:45.178937 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:55:45.178937 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:55:45.178937 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:55:45.178937 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:55:45.178937 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24cefd05-8d3a-4813-af22-160658183e1b could not be found. Aug 27 02:55:45.178937 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:55:45.183110 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-cf1b4d44-0379-4304-ad53-c46fe4f1decc tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] Returning 404 to user: Instance 24cefd05-8d3a-4813-af22-160658183e1b could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:55:45.184506 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-cf1b4d44-0379-4304-ad53-c46fe4f1decc tempest-DeleteServersTestJSON-725615510 tempest-DeleteServersTestJSON-725615510-project] 10.222.0.70 "GET /compute/v2.1/servers/24cefd05-8d3a-4813-af22-160658183e1b" status: 404 len: 111 microversion: 2.1 time: 0.049013 Aug 27 02:55:45.185700 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1591/3185] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:45 2022] GET /compute/v2.1/servers/24cefd05-8d3a-4813-af22-160658183e1b => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:55:45.191468 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-be0f5bc6-697d-4fa9-a05f-4f9c694180f4 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:45.192412 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-be0f5bc6-697d-4fa9-a05f-4f9c694180f4 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] [instance: 3f31178a-8993-4aa6-8d41-496bfec13bec] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:45.201880 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-be0f5bc6-697d-4fa9-a05f-4f9c694180f4 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:45.202772 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-be0f5bc6-697d-4fa9-a05f-4f9c694180f4 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:45.203730 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-be0f5bc6-697d-4fa9-a05f-4f9c694180f4 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:45.204791 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-be0f5bc6-697d-4fa9-a05f-4f9c694180f4 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:45.205488 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-be0f5bc6-697d-4fa9-a05f-4f9c694180f4 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:45.206151 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-be0f5bc6-697d-4fa9-a05f-4f9c694180f4 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:45.228475 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-91beb72d-fbb5-4fff-adf2-9d85a4c30946 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:45.246344 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-91beb72d-fbb5-4fff-adf2-9d85a4c30946 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:45.251639 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-91beb72d-fbb5-4fff-adf2-9d85a4c30946 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:45.254656 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-91beb72d-fbb5-4fff-adf2-9d85a4c30946 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] 10.222.0.70 "GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7" status: 200 len: 1879 microversion: 2.32 time: 0.534662 Aug 27 02:55:45.256390 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1595/3186] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:55:44 2022] GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 => generated 1879 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:55:45.263339 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-20241c97-c645-48e0-809c-59d2979304c2 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:45.263959 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-20241c97-c645-48e0-809c-59d2979304c2 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:45.284516 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-20241c97-c645-48e0-809c-59d2979304c2 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:45.285057 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-20241c97-c645-48e0-809c-59d2979304c2 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:45.286651 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-20241c97-c645-48e0-809c-59d2979304c2 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:45.289033 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-20241c97-c645-48e0-809c-59d2979304c2 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:45.290124 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-20241c97-c645-48e0-809c-59d2979304c2 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:45.291361 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-20241c97-c645-48e0-809c-59d2979304c2 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:45.400288 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-be0f5bc6-697d-4fa9-a05f-4f9c694180f4 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5097adbf553e4e319d2cb0cf383f587a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77abdb9b52614d1fbd6d70774a2df31f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:45.415677 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-be0f5bc6-697d-4fa9-a05f-4f9c694180f4 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5097adbf553e4e319d2cb0cf383f587a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77abdb9b52614d1fbd6d70774a2df31f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:45.418567 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-be0f5bc6-697d-4fa9-a05f-4f9c694180f4 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5097adbf553e4e319d2cb0cf383f587a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77abdb9b52614d1fbd6d70774a2df31f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:45.437091 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-be0f5bc6-697d-4fa9-a05f-4f9c694180f4 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] 10.222.0.70 "GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec" status: 200 len: 1447 microversion: 2.75 time: 0.248537 Aug 27 02:55:45.439417 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1592/3187] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:55:45 2022] GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec => generated 1447 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:55:45.649718 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-20241c97-c645-48e0-809c-59d2979304c2 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:45.668992 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-20241c97-c645-48e0-809c-59d2979304c2 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1668 microversion: 2.1 time: 0.411255 Aug 27 02:55:45.672759 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1596/3188] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:45 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1668 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:55:45.696469 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-02e416dd-b412-44f1-8a0b-b78a2acf2cf4 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:45.697484 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-02e416dd-b412-44f1-8a0b-b78a2acf2cf4 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:45.718745 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-02e416dd-b412-44f1-8a0b-b78a2acf2cf4 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:45.721541 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-02e416dd-b412-44f1-8a0b-b78a2acf2cf4 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:45.724544 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-02e416dd-b412-44f1-8a0b-b78a2acf2cf4 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:45.726519 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-02e416dd-b412-44f1-8a0b-b78a2acf2cf4 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:45.726995 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-02e416dd-b412-44f1-8a0b-b78a2acf2cf4 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:45.727609 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-02e416dd-b412-44f1-8a0b-b78a2acf2cf4 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:46.284600 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-1441707a-589d-4a95-9cca-ab8c0e076e54 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:46.285211 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-1441707a-589d-4a95-9cca-ab8c0e076e54 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] [instance: b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:46.298507 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1441707a-589d-4a95-9cca-ab8c0e076e54 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:46.299124 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1441707a-589d-4a95-9cca-ab8c0e076e54 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:46.299661 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1441707a-589d-4a95-9cca-ab8c0e076e54 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:46.308048 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1441707a-589d-4a95-9cca-ab8c0e076e54 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:46.308839 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1441707a-589d-4a95-9cca-ab8c0e076e54 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:46.309358 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1441707a-589d-4a95-9cca-ab8c0e076e54 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:46.409971 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-02e416dd-b412-44f1-8a0b-b78a2acf2cf4 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:46.439124 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-02e416dd-b412-44f1-8a0b-b78a2acf2cf4 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1668 microversion: 2.1 time: 0.749026 Aug 27 02:55:46.453018 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1593/3189] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:45 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1668 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:55:46.462377 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-eb993925-184a-4865-af96-c5af42a86a39 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:55:46.463577 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-eb993925-184a-4865-af96-c5af42a86a39 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:46.472930 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eb993925-184a-4865-af96-c5af42a86a39 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:46.482215 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eb993925-184a-4865-af96-c5af42a86a39 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:46.486490 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eb993925-184a-4865-af96-c5af42a86a39 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:46.487447 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eb993925-184a-4865-af96-c5af42a86a39 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:46.487940 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eb993925-184a-4865-af96-c5af42a86a39 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:46.488407 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eb993925-184a-4865-af96-c5af42a86a39 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:46.587591 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-eb993925-184a-4865-af96-c5af42a86a39 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "POST /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd/action" status: 202 len: 0 microversion: 2.1 time: 0.130524 Aug 27 02:55:46.593938 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1594/3190] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 02:55:46 2022] POST /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:55:46.607083 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d76fdfc3-4c54-4712-8df7-929770637172 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:46.608263 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d76fdfc3-4c54-4712-8df7-929770637172 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] [instance: 3f31178a-8993-4aa6-8d41-496bfec13bec] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:46.619548 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d76fdfc3-4c54-4712-8df7-929770637172 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:46.620838 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d76fdfc3-4c54-4712-8df7-929770637172 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:46.621285 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d76fdfc3-4c54-4712-8df7-929770637172 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:46.625028 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d76fdfc3-4c54-4712-8df7-929770637172 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:46.625513 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d76fdfc3-4c54-4712-8df7-929770637172 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:46.625959 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d76fdfc3-4c54-4712-8df7-929770637172 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:46.776198 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-1441707a-589d-4a95-9cca-ab8c0e076e54 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:46.790074 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-1441707a-589d-4a95-9cca-ab8c0e076e54 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:46.794645 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-1441707a-589d-4a95-9cca-ab8c0e076e54 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:46.797844 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-1441707a-589d-4a95-9cca-ab8c0e076e54 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] 10.222.0.70 "GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7" status: 200 len: 1879 microversion: 2.32 time: 0.519287 Aug 27 02:55:46.800810 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1597/3191] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:55:46 2022] GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 => generated 1879 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:55:46.811296 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d76fdfc3-4c54-4712-8df7-929770637172 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5097adbf553e4e319d2cb0cf383f587a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77abdb9b52614d1fbd6d70774a2df31f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:46.857406 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-da9b087a-558b-4021-9f18-bda826f2b5be tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:46.860291 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-da9b087a-558b-4021-9f18-bda826f2b5be tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:46.860788 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d76fdfc3-4c54-4712-8df7-929770637172 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5097adbf553e4e319d2cb0cf383f587a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77abdb9b52614d1fbd6d70774a2df31f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:46.866925 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d76fdfc3-4c54-4712-8df7-929770637172 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5097adbf553e4e319d2cb0cf383f587a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77abdb9b52614d1fbd6d70774a2df31f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:46.895171 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-da9b087a-558b-4021-9f18-bda826f2b5be tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:46.897217 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-da9b087a-558b-4021-9f18-bda826f2b5be tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:46.899254 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-da9b087a-558b-4021-9f18-bda826f2b5be tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:46.899498 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d76fdfc3-4c54-4712-8df7-929770637172 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] 10.222.0.70 "GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec" status: 200 len: 1447 microversion: 2.75 time: 0.300699 Aug 27 02:55:46.903827 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1595/3192] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:55:46 2022] GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec => generated 1447 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:55:46.904753 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-da9b087a-558b-4021-9f18-bda826f2b5be tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:46.905588 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-da9b087a-558b-4021-9f18-bda826f2b5be tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:46.906231 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-da9b087a-558b-4021-9f18-bda826f2b5be tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:47.223376 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-da9b087a-558b-4021-9f18-bda826f2b5be tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:47.235655 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-da9b087a-558b-4021-9f18-bda826f2b5be tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1653 microversion: 2.1 time: 0.432398 Aug 27 02:55:47.236651 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1598/3193] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:46 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1653 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:55:47.257827 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f2572e57-d4a0-4c1f-bb24-4d4d94444889 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:55:47.258885 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-f2572e57-d4a0-4c1f-bb24-4d4d94444889 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:47.268183 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f2572e57-d4a0-4c1f-bb24-4d4d94444889 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:47.269041 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f2572e57-d4a0-4c1f-bb24-4d4d94444889 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:47.269675 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f2572e57-d4a0-4c1f-bb24-4d4d94444889 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:47.270553 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f2572e57-d4a0-4c1f-bb24-4d4d94444889 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:47.271170 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f2572e57-d4a0-4c1f-bb24-4d4d94444889 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:47.271764 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f2572e57-d4a0-4c1f-bb24-4d4d94444889 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:47.386727 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-f2572e57-d4a0-4c1f-bb24-4d4d94444889 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "POST /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd/action" status: 202 len: 0 microversion: 2.1 time: 0.132131 Aug 27 02:55:47.391193 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1596/3194] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 02:55:47 2022] POST /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:55:47.396059 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3887383b-547a-4efa-bf1c-626e67742eaf tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:47.396706 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-3887383b-547a-4efa-bf1c-626e67742eaf tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:47.404118 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3887383b-547a-4efa-bf1c-626e67742eaf tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:47.404647 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3887383b-547a-4efa-bf1c-626e67742eaf tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:47.405086 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3887383b-547a-4efa-bf1c-626e67742eaf tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:47.405796 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3887383b-547a-4efa-bf1c-626e67742eaf tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:47.406242 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3887383b-547a-4efa-bf1c-626e67742eaf tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:47.406658 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3887383b-547a-4efa-bf1c-626e67742eaf tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:47.827156 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-1fa81384-683f-4172-8db7-6473c63de9bd tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:47.828446 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-1fa81384-683f-4172-8db7-6473c63de9bd tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] [instance: b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:47.837673 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1fa81384-683f-4172-8db7-6473c63de9bd tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:47.838432 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1fa81384-683f-4172-8db7-6473c63de9bd tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:47.840772 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1fa81384-683f-4172-8db7-6473c63de9bd tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:47.842371 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1fa81384-683f-4172-8db7-6473c63de9bd tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:47.847204 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1fa81384-683f-4172-8db7-6473c63de9bd tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:47.849400 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1fa81384-683f-4172-8db7-6473c63de9bd tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:48.255754 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-3887383b-547a-4efa-bf1c-626e67742eaf tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:48.265016 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-3887383b-547a-4efa-bf1c-626e67742eaf tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1660 microversion: 2.1 time: 0.873185 Aug 27 02:55:48.265626 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1599/3195] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:47 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1660 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:55:48.281276 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-dd7e6ec3-75db-4850-8be8-0c640436add1 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:48.285701 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-dd7e6ec3-75db-4850-8be8-0c640436add1 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] [instance: 3f31178a-8993-4aa6-8d41-496bfec13bec] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:48.301502 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dd7e6ec3-75db-4850-8be8-0c640436add1 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:48.302485 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dd7e6ec3-75db-4850-8be8-0c640436add1 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:48.304088 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dd7e6ec3-75db-4850-8be8-0c640436add1 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:48.304965 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dd7e6ec3-75db-4850-8be8-0c640436add1 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:48.309270 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dd7e6ec3-75db-4850-8be8-0c640436add1 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:48.309943 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dd7e6ec3-75db-4850-8be8-0c640436add1 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:48.407616 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-1fa81384-683f-4172-8db7-6473c63de9bd tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:48.420940 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-dd7e6ec3-75db-4850-8be8-0c640436add1 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5097adbf553e4e319d2cb0cf383f587a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77abdb9b52614d1fbd6d70774a2df31f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:48.431686 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-dd7e6ec3-75db-4850-8be8-0c640436add1 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5097adbf553e4e319d2cb0cf383f587a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77abdb9b52614d1fbd6d70774a2df31f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:48.435245 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-1fa81384-683f-4172-8db7-6473c63de9bd tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:48.437579 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-1fa81384-683f-4172-8db7-6473c63de9bd tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:48.439178 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-dd7e6ec3-75db-4850-8be8-0c640436add1 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5097adbf553e4e319d2cb0cf383f587a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77abdb9b52614d1fbd6d70774a2df31f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:48.440648 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-1fa81384-683f-4172-8db7-6473c63de9bd tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] 10.222.0.70 "GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7" status: 200 len: 1879 microversion: 2.32 time: 0.617661 Aug 27 02:55:48.457058 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-dd7e6ec3-75db-4850-8be8-0c640436add1 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] 10.222.0.70 "GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec" status: 200 len: 1447 microversion: 2.75 time: 0.181787 Aug 27 02:55:48.457058 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1600/3196] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:55:48 2022] GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec => generated 1447 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:55:48.459216 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1597/3197] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:55:47 2022] GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 => generated 1879 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:55:48.564045 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-7c0a6f47-4079-41ee-bd3f-bbb98a80f682 req-ef111ec5-a6ea-431c-b2ac-8ada3be8de28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7", "name": "network-vif-plugged", "status": "completed", "tag": "55ef695b-3e5a-443f-aaa4-c5aca34edc53"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:55:48.574392 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-7c0a6f47-4079-41ee-bd3f-bbb98a80f682 req-ef111ec5-a6ea-431c-b2ac-8ada3be8de28 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:48.575170 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-7c0a6f47-4079-41ee-bd3f-bbb98a80f682 req-ef111ec5-a6ea-431c-b2ac-8ada3be8de28 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:48.575897 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-7c0a6f47-4079-41ee-bd3f-bbb98a80f682 req-ef111ec5-a6ea-431c-b2ac-8ada3be8de28 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:48.592527 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-7c0a6f47-4079-41ee-bd3f-bbb98a80f682 req-ef111ec5-a6ea-431c-b2ac-8ada3be8de28 service nova] Creating event network-vif-plugged:55ef695b-3e5a-443f-aaa4-c5aca34edc53 for instance b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 on n-h2-852278-4 Aug 27 02:55:48.607757 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-7c0a6f47-4079-41ee-bd3f-bbb98a80f682 req-ef111ec5-a6ea-431c-b2ac-8ada3be8de28 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145393 Aug 27 02:55:48.608684 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1601/3198] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:55:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:55:49.286047 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-2534ad8f-b6bb-4c7f-bd72-5449769000be tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:49.286643 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-2534ad8f-b6bb-4c7f-bd72-5449769000be tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:49.293719 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2534ad8f-b6bb-4c7f-bd72-5449769000be tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:49.294460 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2534ad8f-b6bb-4c7f-bd72-5449769000be tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:49.295073 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2534ad8f-b6bb-4c7f-bd72-5449769000be tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:49.295941 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2534ad8f-b6bb-4c7f-bd72-5449769000be tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:49.296600 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2534ad8f-b6bb-4c7f-bd72-5449769000be tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:49.297190 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2534ad8f-b6bb-4c7f-bd72-5449769000be tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:49.465772 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9eeaea23-0025-4075-bfb2-0e63aa482641 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:49.467103 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-9eeaea23-0025-4075-bfb2-0e63aa482641 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] [instance: b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:49.474789 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9eeaea23-0025-4075-bfb2-0e63aa482641 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:49.475509 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9eeaea23-0025-4075-bfb2-0e63aa482641 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:49.476101 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9eeaea23-0025-4075-bfb2-0e63aa482641 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:49.477014 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9eeaea23-0025-4075-bfb2-0e63aa482641 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:49.477614 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9eeaea23-0025-4075-bfb2-0e63aa482641 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:49.478181 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9eeaea23-0025-4075-bfb2-0e63aa482641 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:49.500301 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-2534ad8f-b6bb-4c7f-bd72-5449769000be tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:49.513040 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-2534ad8f-b6bb-4c7f-bd72-5449769000be tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1668 microversion: 2.1 time: 0.230548 Aug 27 02:55:49.530595 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1598/3199] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:49 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1668 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:55:49.537031 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-88b07777-6131-4ce5-929e-f01d4b09c273 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:49.538045 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-88b07777-6131-4ce5-929e-f01d4b09c273 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] [instance: 3f31178a-8993-4aa6-8d41-496bfec13bec] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:49.546372 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-88b07777-6131-4ce5-929e-f01d4b09c273 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:49.547257 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-88b07777-6131-4ce5-929e-f01d4b09c273 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:49.547955 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-88b07777-6131-4ce5-929e-f01d4b09c273 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:49.549512 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-88b07777-6131-4ce5-929e-f01d4b09c273 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:49.551111 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-88b07777-6131-4ce5-929e-f01d4b09c273 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:49.551823 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-88b07777-6131-4ce5-929e-f01d4b09c273 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:49.726107 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-88b07777-6131-4ce5-929e-f01d4b09c273 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5097adbf553e4e319d2cb0cf383f587a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77abdb9b52614d1fbd6d70774a2df31f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:49.736947 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-88b07777-6131-4ce5-929e-f01d4b09c273 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5097adbf553e4e319d2cb0cf383f587a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77abdb9b52614d1fbd6d70774a2df31f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:49.738693 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-88b07777-6131-4ce5-929e-f01d4b09c273 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5097adbf553e4e319d2cb0cf383f587a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77abdb9b52614d1fbd6d70774a2df31f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:49.744959 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-88b07777-6131-4ce5-929e-f01d4b09c273 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] 10.222.0.70 "GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec" status: 200 len: 1447 microversion: 2.75 time: 0.212902 Aug 27 02:55:49.745724 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1599/3200] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:55:49 2022] GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec => generated 1447 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:55:49.751150 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-618b248c-9f89-4147-9d32-88d52287165d tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:49.752050 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-618b248c-9f89-4147-9d32-88d52287165d tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:49.759549 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-618b248c-9f89-4147-9d32-88d52287165d tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:49.760392 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-618b248c-9f89-4147-9d32-88d52287165d tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:49.761125 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-618b248c-9f89-4147-9d32-88d52287165d tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:49.762118 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-618b248c-9f89-4147-9d32-88d52287165d tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:49.762804 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-618b248c-9f89-4147-9d32-88d52287165d tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:49.763775 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-618b248c-9f89-4147-9d32-88d52287165d tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:49.938379 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-9eeaea23-0025-4075-bfb2-0e63aa482641 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:49.949516 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-9eeaea23-0025-4075-bfb2-0e63aa482641 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:49.951288 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-9eeaea23-0025-4075-bfb2-0e63aa482641 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:49.952762 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9eeaea23-0025-4075-bfb2-0e63aa482641 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] 10.222.0.70 "GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7" status: 200 len: 1879 microversion: 2.32 time: 0.491599 Aug 27 02:55:49.970784 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1602/3201] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:55:49 2022] GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 => generated 1879 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:55:50.065327 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-618b248c-9f89-4147-9d32-88d52287165d tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:50.068358 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=4,nova_cell1:UPDATE=6 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:55:50.079604 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-618b248c-9f89-4147-9d32-88d52287165d tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1668 microversion: 2.1 time: 0.332525 Aug 27 02:55:50.080211 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1600/3202] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:49 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1668 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:55:50.110936 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6310b54b-241f-43ee-93a4-3ddc97353071 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:50.111574 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-6310b54b-241f-43ee-93a4-3ddc97353071 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:50.118197 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6310b54b-241f-43ee-93a4-3ddc97353071 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:50.118681 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6310b54b-241f-43ee-93a4-3ddc97353071 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:50.119303 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6310b54b-241f-43ee-93a4-3ddc97353071 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:50.120427 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6310b54b-241f-43ee-93a4-3ddc97353071 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:50.121095 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6310b54b-241f-43ee-93a4-3ddc97353071 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:50.121855 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6310b54b-241f-43ee-93a4-3ddc97353071 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:50.290945 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d7308fb7-2e0e-4f86-bc24-dd9e50db5d8b tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-1529167730", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "12e8fe17-360c-4144-8743-41f479b27364"}], "security_groups": [{"name": "tempest-securitygroup--90761899"}], "key_name": "tempest-keypair-1644598461", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:55:50.368432 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-6310b54b-241f-43ee-93a4-3ddc97353071 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:50.379523 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-6310b54b-241f-43ee-93a4-3ddc97353071 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1668 microversion: 2.1 time: 0.277646 Aug 27 02:55:50.399648 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1603/3203] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:50 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1668 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:55:50.408345 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f099dedd-3ae3-4385-b537-ec6f3474f5dd tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:50.408991 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-f099dedd-3ae3-4385-b537-ec6f3474f5dd tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:50.416127 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f099dedd-3ae3-4385-b537-ec6f3474f5dd tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:50.416685 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f099dedd-3ae3-4385-b537-ec6f3474f5dd tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:50.417228 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f099dedd-3ae3-4385-b537-ec6f3474f5dd tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:50.418921 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f099dedd-3ae3-4385-b537-ec6f3474f5dd tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:50.419364 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f099dedd-3ae3-4385-b537-ec6f3474f5dd tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:50.419893 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f099dedd-3ae3-4385-b537-ec6f3474f5dd tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:50.517805 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.network.neutron [None req-d7308fb7-2e0e-4f86-bc24-dd9e50db5d8b tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] validate_networks() for [('12e8fe17-360c-4144-8743-41f479b27364', None, None, None, None, None)] {{(pid=134051) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:55:50.719416 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-f099dedd-3ae3-4385-b537-ec6f3474f5dd tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:50.728003 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f099dedd-3ae3-4385-b537-ec6f3474f5dd tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1668 microversion: 2.1 time: 0.327205 Aug 27 02:55:50.732785 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1604/3204] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:50 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1668 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:55:50.744835 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-9d9314fd-c170-40f3-a6fe-b9478e70c24c req-7d444d68-633c-4454-92c2-bf4e7d57512d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7", "name": "network-vif-plugged", "status": "completed", "tag": "08d8ee97-a66d-4a1f-8b10-8785838e3d14"}, {"server_uuid": "b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7", "name": "network-vif-plugged", "status": "completed", "tag": "a013082b-68fd-42aa-a18e-2179253e7de6"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:55:50.767856 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-9d9314fd-c170-40f3-a6fe-b9478e70c24c req-7d444d68-633c-4454-92c2-bf4e7d57512d service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:50.781078 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-9d9314fd-c170-40f3-a6fe-b9478e70c24c req-7d444d68-633c-4454-92c2-bf4e7d57512d service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:50.781531 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-9d9314fd-c170-40f3-a6fe-b9478e70c24c req-7d444d68-633c-4454-92c2-bf4e7d57512d service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:50.795099 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-9d9314fd-c170-40f3-a6fe-b9478e70c24c req-7d444d68-633c-4454-92c2-bf4e7d57512d service nova] Creating event network-vif-plugged:08d8ee97-a66d-4a1f-8b10-8785838e3d14 for instance b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 on n-h2-852278-4 Aug 27 02:55:50.801205 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-9d9314fd-c170-40f3-a6fe-b9478e70c24c req-7d444d68-633c-4454-92c2-bf4e7d57512d service nova] Creating event network-vif-plugged:a013082b-68fd-42aa-a18e-2179253e7de6 for instance b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 on n-h2-852278-4 Aug 27 02:55:50.821114 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-9d9314fd-c170-40f3-a6fe-b9478e70c24c req-7d444d68-633c-4454-92c2-bf4e7d57512d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.086854 Aug 27 02:55:50.822409 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1605/3205] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:55:50 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:55:50.827727 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d7e83150-ecbd-409f-96d0-c2c5d7ff1c20 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:50.828452 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d7e83150-ecbd-409f-96d0-c2c5d7ff1c20 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:50.847951 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d7e83150-ecbd-409f-96d0-c2c5d7ff1c20 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:50.849173 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d7e83150-ecbd-409f-96d0-c2c5d7ff1c20 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:50.849796 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d7e83150-ecbd-409f-96d0-c2c5d7ff1c20 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:50.850681 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d7e83150-ecbd-409f-96d0-c2c5d7ff1c20 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:50.851450 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d7e83150-ecbd-409f-96d0-c2c5d7ff1c20 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:50.852958 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d7e83150-ecbd-409f-96d0-c2c5d7ff1c20 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:51.169406 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-d7e83150-ecbd-409f-96d0-c2c5d7ff1c20 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:51.179818 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d7e83150-ecbd-409f-96d0-c2c5d7ff1c20 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1668 microversion: 2.1 time: 0.356051 Aug 27 02:55:51.181064 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1606/3206] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:50 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1668 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:55:51.196799 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e1215e9e-6640-4b6e-ac03-f20cd01a079f tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:51.198598 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-e1215e9e-6640-4b6e-ac03-f20cd01a079f tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] [instance: 3f31178a-8993-4aa6-8d41-496bfec13bec] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:51.206322 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e1215e9e-6640-4b6e-ac03-f20cd01a079f tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:51.207186 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e1215e9e-6640-4b6e-ac03-f20cd01a079f tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:51.208770 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e1215e9e-6640-4b6e-ac03-f20cd01a079f tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:51.209725 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e1215e9e-6640-4b6e-ac03-f20cd01a079f tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:51.210573 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e1215e9e-6640-4b6e-ac03-f20cd01a079f tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:51.211210 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e1215e9e-6640-4b6e-ac03-f20cd01a079f tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:51.347112 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-d7308fb7-2e0e-4f86-bc24-dd9e50db5d8b tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Getting quotas for project c997efbeda2c4a2db15e9fe38ab96959. Resources: dict_keys(['metadata_items']) {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:55:51.359972 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-d7308fb7-2e0e-4f86-bc24-dd9e50db5d8b tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Getting quotas for user c501b75773884dd7bf574035b88fc5d2 and project c997efbeda2c4a2db15e9fe38ab96959. Resources: dict_keys(['metadata_items']) {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:55:51.380495 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-d7308fb7-2e0e-4f86-bc24-dd9e50db5d8b tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Flavor limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:55:51.381242 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-d7308fb7-2e0e-4f86-bc24-dd9e50db5d8b tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Image limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:55:51.381907 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-d7308fb7-2e0e-4f86-bc24-dd9e50db5d8b tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Flavor pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:55:51.382523 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-d7308fb7-2e0e-4f86-bc24-dd9e50db5d8b tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Image pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:55:51.383096 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-d7308fb7-2e0e-4f86-bc24-dd9e50db5d8b tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:55:51.393189 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d7308fb7-2e0e-4f86-bc24-dd9e50db5d8b tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:51.393954 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d7308fb7-2e0e-4f86-bc24-dd9e50db5d8b tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:51.394602 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d7308fb7-2e0e-4f86-bc24-dd9e50db5d8b tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:51.395564 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d7308fb7-2e0e-4f86-bc24-dd9e50db5d8b tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:51.396361 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d7308fb7-2e0e-4f86-bc24-dd9e50db5d8b tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:51.397556 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d7308fb7-2e0e-4f86-bc24-dd9e50db5d8b tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:51.412991 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-e1215e9e-6640-4b6e-ac03-f20cd01a079f tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5097adbf553e4e319d2cb0cf383f587a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77abdb9b52614d1fbd6d70774a2df31f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:51.421901 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-d7308fb7-2e0e-4f86-bc24-dd9e50db5d8b tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Getting quotas for project c997efbeda2c4a2db15e9fe38ab96959. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:55:51.428459 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-e1215e9e-6640-4b6e-ac03-f20cd01a079f tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5097adbf553e4e319d2cb0cf383f587a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77abdb9b52614d1fbd6d70774a2df31f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:51.430160 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-e1215e9e-6640-4b6e-ac03-f20cd01a079f tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5097adbf553e4e319d2cb0cf383f587a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77abdb9b52614d1fbd6d70774a2df31f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:51.430556 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-d7308fb7-2e0e-4f86-bc24-dd9e50db5d8b tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Getting quotas for user c501b75773884dd7bf574035b88fc5d2 and project c997efbeda2c4a2db15e9fe38ab96959. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:55:51.441460 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e1215e9e-6640-4b6e-ac03-f20cd01a079f tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] 10.222.0.70 "GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec" status: 200 len: 1453 microversion: 2.75 time: 0.259027 Aug 27 02:55:51.452497 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1607/3207] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:55:51 2022] GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec => generated 1453 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:55:51.453242 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-cd603c2b-d0a5-414d-9b1b-cacca3ccd25d tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:51.453870 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-cd603c2b-d0a5-414d-9b1b-cacca3ccd25d tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] [instance: b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:51.467282 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d7308fb7-2e0e-4f86-bc24-dd9e50db5d8b tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Going to run 1 instances... {{(pid=134051) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:55:51.470648 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d7308fb7-2e0e-4f86-bc24-dd9e50db5d8b tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] [instance: eaad739b-53d7-4128-8392-92ee0a953afa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134051) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:55:51.470988 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cd603c2b-d0a5-414d-9b1b-cacca3ccd25d tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:51.471493 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cd603c2b-d0a5-414d-9b1b-cacca3ccd25d tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:51.471922 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cd603c2b-d0a5-414d-9b1b-cacca3ccd25d tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:51.472707 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cd603c2b-d0a5-414d-9b1b-cacca3ccd25d tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:51.473153 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cd603c2b-d0a5-414d-9b1b-cacca3ccd25d tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:51.473574 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cd603c2b-d0a5-414d-9b1b-cacca3ccd25d tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:51.545658 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d7308fb7-2e0e-4f86-bc24-dd9e50db5d8b tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.259633 Aug 27 02:55:51.553800 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1601/3208] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 02:55:50 2022] POST /compute/v2.1/servers => generated 407 bytes in 1268 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 02:55:51.565278 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-55b4f35e-14e1-453a-a68c-248f56898f13 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:51.566240 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-55b4f35e-14e1-453a-a68c-248f56898f13 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:51.574325 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-55b4f35e-14e1-453a-a68c-248f56898f13 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:51.575090 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-55b4f35e-14e1-453a-a68c-248f56898f13 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:51.575452 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-55b4f35e-14e1-453a-a68c-248f56898f13 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:51.576386 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-55b4f35e-14e1-453a-a68c-248f56898f13 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:51.577003 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-55b4f35e-14e1-453a-a68c-248f56898f13 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:51.577609 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-55b4f35e-14e1-453a-a68c-248f56898f13 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:51.875131 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-cd603c2b-d0a5-414d-9b1b-cacca3ccd25d tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:51.888035 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-cd603c2b-d0a5-414d-9b1b-cacca3ccd25d tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:51.890840 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-cd603c2b-d0a5-414d-9b1b-cacca3ccd25d tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:51.892092 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-cd603c2b-d0a5-414d-9b1b-cacca3ccd25d tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] 10.222.0.70 "GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7" status: 200 len: 1879 microversion: 2.32 time: 0.442942 Aug 27 02:55:51.913249 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1608/3209] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:55:51 2022] GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 => generated 1879 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:55:51.936493 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c6dc8e38-55de-4590-866c-cd6050157efb tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:51.937445 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-c6dc8e38-55de-4590-866c-cd6050157efb tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] [instance: eaad739b-53d7-4128-8392-92ee0a953afa] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:51.938095 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-55b4f35e-14e1-453a-a68c-248f56898f13 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:51.977618 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-55b4f35e-14e1-453a-a68c-248f56898f13 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1668 microversion: 2.1 time: 0.397058 Aug 27 02:55:51.981541 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1602/3210] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:51 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1668 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:55:52.114487 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-c6dc8e38-55de-4590-866c-cd6050157efb tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c501b75773884dd7bf574035b88fc5d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c997efbeda2c4a2db15e9fe38ab96959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:52.154501 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c6dc8e38-55de-4590-866c-cd6050157efb tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] 10.222.0.70 "GET /compute/v2.1/servers/eaad739b-53d7-4128-8392-92ee0a953afa" status: 200 len: 1278 microversion: 2.1 time: 0.212011 Aug 27 02:55:52.171023 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1609/3211] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:51 2022] GET /compute/v2.1/servers/eaad739b-53d7-4128-8392-92ee0a953afa => generated 1278 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:55:52.470153 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-fe2d25c5-eb6e-4bd7-98ea-6fb58061ba26 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:52.470677 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-fe2d25c5-eb6e-4bd7-98ea-6fb58061ba26 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] [instance: 3f31178a-8993-4aa6-8d41-496bfec13bec] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:52.488938 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fe2d25c5-eb6e-4bd7-98ea-6fb58061ba26 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:52.489834 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fe2d25c5-eb6e-4bd7-98ea-6fb58061ba26 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:52.490521 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fe2d25c5-eb6e-4bd7-98ea-6fb58061ba26 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:52.491479 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fe2d25c5-eb6e-4bd7-98ea-6fb58061ba26 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:52.492142 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fe2d25c5-eb6e-4bd7-98ea-6fb58061ba26 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:52.492772 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fe2d25c5-eb6e-4bd7-98ea-6fb58061ba26 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:52.624847 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-fe2d25c5-eb6e-4bd7-98ea-6fb58061ba26 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5097adbf553e4e319d2cb0cf383f587a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77abdb9b52614d1fbd6d70774a2df31f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:52.645869 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-fe2d25c5-eb6e-4bd7-98ea-6fb58061ba26 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5097adbf553e4e319d2cb0cf383f587a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77abdb9b52614d1fbd6d70774a2df31f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:52.647738 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-fe2d25c5-eb6e-4bd7-98ea-6fb58061ba26 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5097adbf553e4e319d2cb0cf383f587a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77abdb9b52614d1fbd6d70774a2df31f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:52.660703 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-fe2d25c5-eb6e-4bd7-98ea-6fb58061ba26 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] 10.222.0.70 "GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec" status: 200 len: 1453 microversion: 2.75 time: 0.194610 Aug 27 02:55:52.661907 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1603/3212] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:55:52 2022] GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec => generated 1453 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:55:52.879832 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-cd1b32f8-8f46-4f59-bd58-c40bef0da185 req-3b70e461-2b5d-4d1f-8584-8e9d6f1de9c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7", "name": "network-vif-plugged", "status": "completed", "tag": "014fb24b-31f0-4751-9df3-1439a144e5d6"}, {"server_uuid": "b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7", "name": "network-vif-plugged", "status": "completed", "tag": "07494d6f-38b9-4b8b-930b-4c4d1abbc8b1"}, {"server_uuid": "b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7", "name": "network-vif-plugged", "status": "completed", "tag": "8524810a-aaa6-4efe-ac59-2515339a1681"}, {"server_uuid": "b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7", "name": "network-vif-plugged", "status": "completed", "tag": "57c0448a-207e-435f-9a6b-4477adaf5128"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:55:52.892512 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-cd1b32f8-8f46-4f59-bd58-c40bef0da185 req-3b70e461-2b5d-4d1f-8584-8e9d6f1de9c2 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:52.893092 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-cd1b32f8-8f46-4f59-bd58-c40bef0da185 req-3b70e461-2b5d-4d1f-8584-8e9d6f1de9c2 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:52.893926 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-cd1b32f8-8f46-4f59-bd58-c40bef0da185 req-3b70e461-2b5d-4d1f-8584-8e9d6f1de9c2 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:52.918251 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-cd1b32f8-8f46-4f59-bd58-c40bef0da185 req-3b70e461-2b5d-4d1f-8584-8e9d6f1de9c2 service nova] Creating event network-vif-plugged:014fb24b-31f0-4751-9df3-1439a144e5d6 for instance b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 on n-h2-852278-4 Aug 27 02:55:52.918861 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7ff61a72-a1fa-485d-9046-5ccd14c6e3ad tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:52.921202 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-7ff61a72-a1fa-485d-9046-5ccd14c6e3ad tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] [instance: b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:52.927172 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-cd1b32f8-8f46-4f59-bd58-c40bef0da185 req-3b70e461-2b5d-4d1f-8584-8e9d6f1de9c2 service nova] Creating event network-vif-plugged:07494d6f-38b9-4b8b-930b-4c4d1abbc8b1 for instance b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 on n-h2-852278-4 Aug 27 02:55:52.928150 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-cd1b32f8-8f46-4f59-bd58-c40bef0da185 req-3b70e461-2b5d-4d1f-8584-8e9d6f1de9c2 service nova] Creating event network-vif-plugged:8524810a-aaa6-4efe-ac59-2515339a1681 for instance b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 on n-h2-852278-4 Aug 27 02:55:52.928895 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-cd1b32f8-8f46-4f59-bd58-c40bef0da185 req-3b70e461-2b5d-4d1f-8584-8e9d6f1de9c2 service nova] Creating event network-vif-plugged:57c0448a-207e-435f-9a6b-4477adaf5128 for instance b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 on n-h2-852278-4 Aug 27 02:55:52.934456 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7ff61a72-a1fa-485d-9046-5ccd14c6e3ad tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:52.934964 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7ff61a72-a1fa-485d-9046-5ccd14c6e3ad tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:52.936676 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7ff61a72-a1fa-485d-9046-5ccd14c6e3ad tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:52.937420 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7ff61a72-a1fa-485d-9046-5ccd14c6e3ad tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:52.939028 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7ff61a72-a1fa-485d-9046-5ccd14c6e3ad tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:52.941842 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7ff61a72-a1fa-485d-9046-5ccd14c6e3ad tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:52.942604 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-cd1b32f8-8f46-4f59-bd58-c40bef0da185 req-3b70e461-2b5d-4d1f-8584-8e9d6f1de9c2 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.069937 Aug 27 02:55:52.945142 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1610/3213] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:55:52 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:55:53.181901 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f325b0ac-e335-44db-b7e1-05c59f90e098 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:53.182679 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-f325b0ac-e335-44db-b7e1-05c59f90e098 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] [instance: eaad739b-53d7-4128-8392-92ee0a953afa] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:53.193303 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f325b0ac-e335-44db-b7e1-05c59f90e098 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:53.194035 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f325b0ac-e335-44db-b7e1-05c59f90e098 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:53.194470 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f325b0ac-e335-44db-b7e1-05c59f90e098 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:53.195188 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f325b0ac-e335-44db-b7e1-05c59f90e098 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:53.195632 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f325b0ac-e335-44db-b7e1-05c59f90e098 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:53.196144 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f325b0ac-e335-44db-b7e1-05c59f90e098 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:53.429479 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-f325b0ac-e335-44db-b7e1-05c59f90e098 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c501b75773884dd7bf574035b88fc5d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c997efbeda2c4a2db15e9fe38ab96959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:53.456539 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f325b0ac-e335-44db-b7e1-05c59f90e098 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] 10.222.0.70 "GET /compute/v2.1/servers/eaad739b-53d7-4128-8392-92ee0a953afa" status: 200 len: 1330 microversion: 2.1 time: 0.271101 Aug 27 02:55:53.457282 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1611/3214] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:53 2022] GET /compute/v2.1/servers/eaad739b-53d7-4128-8392-92ee0a953afa => generated 1330 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:55:53.523994 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-7ff61a72-a1fa-485d-9046-5ccd14c6e3ad tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:53.541912 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-7ff61a72-a1fa-485d-9046-5ccd14c6e3ad tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:53.543404 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-7ff61a72-a1fa-485d-9046-5ccd14c6e3ad tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:53.544807 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-7ff61a72-a1fa-485d-9046-5ccd14c6e3ad tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] 10.222.0.70 "GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7" status: 200 len: 1879 microversion: 2.32 time: 0.633385 Aug 27 02:55:53.560800 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1604/3215] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:55:52 2022] GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 => generated 1879 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:55:53.688009 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-210ebf2f-05c2-4fd8-90fb-e4dad010ef83 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:53.688870 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-210ebf2f-05c2-4fd8-90fb-e4dad010ef83 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] [instance: 3f31178a-8993-4aa6-8d41-496bfec13bec] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:53.708907 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-210ebf2f-05c2-4fd8-90fb-e4dad010ef83 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:53.709318 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-210ebf2f-05c2-4fd8-90fb-e4dad010ef83 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:53.709843 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-210ebf2f-05c2-4fd8-90fb-e4dad010ef83 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:53.710580 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-210ebf2f-05c2-4fd8-90fb-e4dad010ef83 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:53.711122 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-210ebf2f-05c2-4fd8-90fb-e4dad010ef83 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:53.711546 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-210ebf2f-05c2-4fd8-90fb-e4dad010ef83 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:53.740116 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=100 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:55:53.912066 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-210ebf2f-05c2-4fd8-90fb-e4dad010ef83 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5097adbf553e4e319d2cb0cf383f587a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77abdb9b52614d1fbd6d70774a2df31f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:53.953993 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-210ebf2f-05c2-4fd8-90fb-e4dad010ef83 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5097adbf553e4e319d2cb0cf383f587a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77abdb9b52614d1fbd6d70774a2df31f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:53.955939 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-210ebf2f-05c2-4fd8-90fb-e4dad010ef83 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5097adbf553e4e319d2cb0cf383f587a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77abdb9b52614d1fbd6d70774a2df31f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:53.981820 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-210ebf2f-05c2-4fd8-90fb-e4dad010ef83 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] 10.222.0.70 "GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec" status: 200 len: 1438 microversion: 2.75 time: 0.298673 Aug 27 02:55:53.985167 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1612/3216] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:55:53 2022] GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec => generated 1438 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:55:54.343749 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e8280ef7-ecf8-464d-b81d-0745f322ff73 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:55:54.347211 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-e8280ef7-ecf8-464d-b81d-0745f322ff73 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] [instance: 3f31178a-8993-4aa6-8d41-496bfec13bec] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:54.364774 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e8280ef7-ecf8-464d-b81d-0745f322ff73 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:54.365561 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e8280ef7-ecf8-464d-b81d-0745f322ff73 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:54.367683 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e8280ef7-ecf8-464d-b81d-0745f322ff73 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:54.375762 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e8280ef7-ecf8-464d-b81d-0745f322ff73 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:54.376740 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e8280ef7-ecf8-464d-b81d-0745f322ff73 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:54.377210 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e8280ef7-ecf8-464d-b81d-0745f322ff73 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:54.478849 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e3bb2124-00e7-472f-890d-c37602ac3b70 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:54.479415 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-e3bb2124-00e7-472f-890d-c37602ac3b70 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] [instance: eaad739b-53d7-4128-8392-92ee0a953afa] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:54.491935 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e3bb2124-00e7-472f-890d-c37602ac3b70 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:54.492732 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e3bb2124-00e7-472f-890d-c37602ac3b70 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:54.492938 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e3bb2124-00e7-472f-890d-c37602ac3b70 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:54.493659 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e3bb2124-00e7-472f-890d-c37602ac3b70 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:54.494068 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e3bb2124-00e7-472f-890d-c37602ac3b70 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:54.494493 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e3bb2124-00e7-472f-890d-c37602ac3b70 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:54.533161 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-e8280ef7-ecf8-464d-b81d-0745f322ff73 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Flavor limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:55:54.534327 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-e8280ef7-ecf8-464d-b81d-0745f322ff73 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Image limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:55:54.535119 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-e8280ef7-ecf8-464d-b81d-0745f322ff73 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Flavor pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:55:54.535729 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-e8280ef7-ecf8-464d-b81d-0745f322ff73 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Image pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:55:54.536209 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-e8280ef7-ecf8-464d-b81d-0745f322ff73 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:55:54.605032 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-e8280ef7-ecf8-464d-b81d-0745f322ff73 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] [instance: 3f31178a-8993-4aa6-8d41-496bfec13bec] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:54.612248 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e8280ef7-ecf8-464d-b81d-0745f322ff73 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:54.613090 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e8280ef7-ecf8-464d-b81d-0745f322ff73 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:54.613733 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e8280ef7-ecf8-464d-b81d-0745f322ff73 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:54.614757 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e8280ef7-ecf8-464d-b81d-0745f322ff73 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:54.615602 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e8280ef7-ecf8-464d-b81d-0745f322ff73 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:54.616247 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e8280ef7-ecf8-464d-b81d-0745f322ff73 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:54.653423 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-e3bb2124-00e7-472f-890d-c37602ac3b70 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c501b75773884dd7bf574035b88fc5d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c997efbeda2c4a2db15e9fe38ab96959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:54.689853 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e3bb2124-00e7-472f-890d-c37602ac3b70 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] 10.222.0.70 "GET /compute/v2.1/servers/eaad739b-53d7-4128-8392-92ee0a953afa" status: 200 len: 1336 microversion: 2.1 time: 0.215299 Aug 27 02:55:54.691901 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1613/3217] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:54 2022] GET /compute/v2.1/servers/eaad739b-53d7-4128-8392-92ee0a953afa => generated 1336 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:55:54.698515 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a7ab7cf9-d02e-49ed-a022-bd0e80caf635 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:54.699497 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a7ab7cf9-d02e-49ed-a022-bd0e80caf635 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] [instance: b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:54.717681 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a7ab7cf9-d02e-49ed-a022-bd0e80caf635 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:54.718728 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a7ab7cf9-d02e-49ed-a022-bd0e80caf635 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:54.719737 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a7ab7cf9-d02e-49ed-a022-bd0e80caf635 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:54.720994 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a7ab7cf9-d02e-49ed-a022-bd0e80caf635 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:54.721671 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a7ab7cf9-d02e-49ed-a022-bd0e80caf635 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:54.722341 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a7ab7cf9-d02e-49ed-a022-bd0e80caf635 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:54.810618 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.objects.instance [None req-e8280ef7-ecf8-464d-b81d-0745f322ff73 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lazy-loading 'services' on Instance uuid 3f31178a-8993-4aa6-8d41-496bfec13bec {{(pid=134051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:55:54.828114 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e8280ef7-ecf8-464d-b81d-0745f322ff73 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec/action" status: 202 len: 1942 microversion: 2.75 time: 0.822554 Aug 27 02:55:54.840340 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1605/3218] 10.222.0.70 () {62 vars in 1319 bytes} [Sat Aug 27 02:55:54 2022] POST /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec/action => generated 1942 bytes in 824 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 27 02:55:54.853885 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ab7589aa-8991-45a1-a489-356cc526e0f5 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:54.854640 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-ab7589aa-8991-45a1-a489-356cc526e0f5 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] [instance: 3f31178a-8993-4aa6-8d41-496bfec13bec] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:54.862795 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ab7589aa-8991-45a1-a489-356cc526e0f5 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:54.863411 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ab7589aa-8991-45a1-a489-356cc526e0f5 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:54.863997 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ab7589aa-8991-45a1-a489-356cc526e0f5 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:54.865002 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ab7589aa-8991-45a1-a489-356cc526e0f5 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:54.865700 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ab7589aa-8991-45a1-a489-356cc526e0f5 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:54.866578 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ab7589aa-8991-45a1-a489-356cc526e0f5 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:55.142826 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.objects.instance [None req-ab7589aa-8991-45a1-a489-356cc526e0f5 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lazy-loading 'services' on Instance uuid 3f31178a-8993-4aa6-8d41-496bfec13bec {{(pid=134051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:55:55.164746 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ab7589aa-8991-45a1-a489-356cc526e0f5 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec" status: 200 len: 1929 microversion: 2.75 time: 0.315183 Aug 27 02:55:55.165668 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1606/3219] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:55:54 2022] GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec => generated 1929 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:55:55.269469 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-a7ab7cf9-d02e-49ed-a022-bd0e80caf635 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:55.282571 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-a7ab7cf9-d02e-49ed-a022-bd0e80caf635 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:55.284204 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-a7ab7cf9-d02e-49ed-a022-bd0e80caf635 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:55.285847 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a7ab7cf9-d02e-49ed-a022-bd0e80caf635 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] 10.222.0.70 "GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7" status: 200 len: 1879 microversion: 2.32 time: 0.592579 Aug 27 02:55:55.286434 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1614/3220] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:55:54 2022] GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 => generated 1879 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:55:55.715042 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-da67529a-cc61-467b-9cf9-3a8cbf550781 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:55.715875 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-da67529a-cc61-467b-9cf9-3a8cbf550781 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] [instance: eaad739b-53d7-4128-8392-92ee0a953afa] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:55.725758 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-da67529a-cc61-467b-9cf9-3a8cbf550781 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:55.727184 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-da67529a-cc61-467b-9cf9-3a8cbf550781 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:55.728848 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-da67529a-cc61-467b-9cf9-3a8cbf550781 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:55.733184 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-da67529a-cc61-467b-9cf9-3a8cbf550781 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:55.733703 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-da67529a-cc61-467b-9cf9-3a8cbf550781 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:55.735744 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-da67529a-cc61-467b-9cf9-3a8cbf550781 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:55.842284 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-da67529a-cc61-467b-9cf9-3a8cbf550781 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c501b75773884dd7bf574035b88fc5d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c997efbeda2c4a2db15e9fe38ab96959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:55.852535 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-da67529a-cc61-467b-9cf9-3a8cbf550781 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] 10.222.0.70 "GET /compute/v2.1/servers/eaad739b-53d7-4128-8392-92ee0a953afa" status: 200 len: 1336 microversion: 2.1 time: 0.142152 Aug 27 02:55:55.866416 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1607/3221] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:55 2022] GET /compute/v2.1/servers/eaad739b-53d7-4128-8392-92ee0a953afa => generated 1336 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:55:56.191972 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-51569e2b-8bbe-4cd1-903a-9b104f51ed04 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:56.192671 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-51569e2b-8bbe-4cd1-903a-9b104f51ed04 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] [instance: 3f31178a-8993-4aa6-8d41-496bfec13bec] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:56.206363 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-51569e2b-8bbe-4cd1-903a-9b104f51ed04 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:56.207117 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-51569e2b-8bbe-4cd1-903a-9b104f51ed04 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:56.209241 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-51569e2b-8bbe-4cd1-903a-9b104f51ed04 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:56.211824 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-51569e2b-8bbe-4cd1-903a-9b104f51ed04 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:56.214239 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-51569e2b-8bbe-4cd1-903a-9b104f51ed04 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:56.216077 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-51569e2b-8bbe-4cd1-903a-9b104f51ed04 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:56.316196 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-9561d96f-d29e-4d9d-8bad-36273349821e tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:56.317256 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-9561d96f-d29e-4d9d-8bad-36273349821e tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] [instance: b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:56.319902 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:55:56.327147 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9561d96f-d29e-4d9d-8bad-36273349821e tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:56.327899 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9561d96f-d29e-4d9d-8bad-36273349821e tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:56.328551 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9561d96f-d29e-4d9d-8bad-36273349821e tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:56.329544 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9561d96f-d29e-4d9d-8bad-36273349821e tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:56.330167 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9561d96f-d29e-4d9d-8bad-36273349821e tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:56.333091 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9561d96f-d29e-4d9d-8bad-36273349821e tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:56.895970 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.instance [None req-51569e2b-8bbe-4cd1-903a-9b104f51ed04 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lazy-loading 'services' on Instance uuid 3f31178a-8993-4aa6-8d41-496bfec13bec {{(pid=134052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:55:56.937090 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-51569e2b-8bbe-4cd1-903a-9b104f51ed04 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec" status: 200 len: 1929 microversion: 2.75 time: 0.749763 Aug 27 02:55:56.940116 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1615/3222] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:55:56 2022] GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec => generated 1929 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:55:56.957285 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b2bc98df-0167-4df3-bdd0-49c5406427db tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:56.958118 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b2bc98df-0167-4df3-bdd0-49c5406427db tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] [instance: eaad739b-53d7-4128-8392-92ee0a953afa] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:56.971815 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b2bc98df-0167-4df3-bdd0-49c5406427db tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:56.972335 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b2bc98df-0167-4df3-bdd0-49c5406427db tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:56.979381 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b2bc98df-0167-4df3-bdd0-49c5406427db tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:56.981103 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b2bc98df-0167-4df3-bdd0-49c5406427db tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:56.981756 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b2bc98df-0167-4df3-bdd0-49c5406427db tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:56.982440 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b2bc98df-0167-4df3-bdd0-49c5406427db tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:57.371391 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-9561d96f-d29e-4d9d-8bad-36273349821e tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:57.382122 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-9561d96f-d29e-4d9d-8bad-36273349821e tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:57.385247 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-9561d96f-d29e-4d9d-8bad-36273349821e tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:57.387211 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-9561d96f-d29e-4d9d-8bad-36273349821e tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] 10.222.0.70 "GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7" status: 200 len: 2829 microversion: 2.32 time: 1.080603 Aug 27 02:55:57.388064 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1608/3223] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:55:56 2022] GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 => generated 2829 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:55:57.412843 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d9a353b1-0690-4704-af54-f97ed245f87a tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:57.413716 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d9a353b1-0690-4704-af54-f97ed245f87a tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] [instance: b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:57.422294 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d9a353b1-0690-4704-af54-f97ed245f87a tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:57.423232 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d9a353b1-0690-4704-af54-f97ed245f87a tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:57.423897 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d9a353b1-0690-4704-af54-f97ed245f87a tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:57.424892 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d9a353b1-0690-4704-af54-f97ed245f87a tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:57.425566 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d9a353b1-0690-4704-af54-f97ed245f87a tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:57.426481 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d9a353b1-0690-4704-af54-f97ed245f87a tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:57.464282 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b2bc98df-0167-4df3-bdd0-49c5406427db tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c501b75773884dd7bf574035b88fc5d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c997efbeda2c4a2db15e9fe38ab96959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:57.474816 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b2bc98df-0167-4df3-bdd0-49c5406427db tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] 10.222.0.70 "GET /compute/v2.1/servers/eaad739b-53d7-4128-8392-92ee0a953afa" status: 200 len: 1402 microversion: 2.1 time: 0.533250 Aug 27 02:55:57.476354 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1616/3224] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:56 2022] GET /compute/v2.1/servers/eaad739b-53d7-4128-8392-92ee0a953afa => generated 1402 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:55:57.605527 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d9a353b1-0690-4704-af54-f97ed245f87a tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] 10.222.0.70 "GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7/os-interface" status: 200 len: 1830 microversion: 2.32 time: 0.197067 Aug 27 02:55:57.606571 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1609/3225] 10.222.0.70 () {60 vars in 1316 bytes} [Sat Aug 27 02:55:57 2022] GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7/os-interface => generated 1830 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:55:57.966955 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c5dbd5cf-c593-425e-91e9-4b09a3c4f398 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:57.968161 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-c5dbd5cf-c593-425e-91e9-4b09a3c4f398 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] [instance: 3f31178a-8993-4aa6-8d41-496bfec13bec] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:57.980906 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c5dbd5cf-c593-425e-91e9-4b09a3c4f398 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:57.981900 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c5dbd5cf-c593-425e-91e9-4b09a3c4f398 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:57.982582 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c5dbd5cf-c593-425e-91e9-4b09a3c4f398 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:57.983557 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c5dbd5cf-c593-425e-91e9-4b09a3c4f398 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:57.984233 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c5dbd5cf-c593-425e-91e9-4b09a3c4f398 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:57.984929 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c5dbd5cf-c593-425e-91e9-4b09a3c4f398 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:58.123056 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.instance [None req-c5dbd5cf-c593-425e-91e9-4b09a3c4f398 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lazy-loading 'services' on Instance uuid 3f31178a-8993-4aa6-8d41-496bfec13bec {{(pid=134052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:55:58.181396 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c5dbd5cf-c593-425e-91e9-4b09a3c4f398 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec" status: 200 len: 1929 microversion: 2.75 time: 0.218179 Aug 27 02:55:58.182321 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1617/3226] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:55:57 2022] GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec => generated 1929 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:55:58.501342 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-811b60d2-d9cb-47b1-a06e-36028fc8b911 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:58.501992 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-811b60d2-d9cb-47b1-a06e-36028fc8b911 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] [instance: eaad739b-53d7-4128-8392-92ee0a953afa] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:58.509076 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-811b60d2-d9cb-47b1-a06e-36028fc8b911 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:58.509825 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-811b60d2-d9cb-47b1-a06e-36028fc8b911 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:58.510532 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-811b60d2-d9cb-47b1-a06e-36028fc8b911 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:58.511552 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-811b60d2-d9cb-47b1-a06e-36028fc8b911 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:58.512244 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-811b60d2-d9cb-47b1-a06e-36028fc8b911 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:58.513045 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-811b60d2-d9cb-47b1-a06e-36028fc8b911 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:58.860079 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-811b60d2-d9cb-47b1-a06e-36028fc8b911 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c501b75773884dd7bf574035b88fc5d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c997efbeda2c4a2db15e9fe38ab96959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:58.874662 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-811b60d2-d9cb-47b1-a06e-36028fc8b911 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] 10.222.0.70 "GET /compute/v2.1/servers/eaad739b-53d7-4128-8392-92ee0a953afa" status: 200 len: 1402 microversion: 2.1 time: 0.377141 Aug 27 02:55:58.876840 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1610/3227] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:58 2022] GET /compute/v2.1/servers/eaad739b-53d7-4128-8392-92ee0a953afa => generated 1402 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:55:59.151427 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-a9c35e2e-c179-41a2-988c-bb6298614430 req-3abbe79a-6bf3-4ef3-8665-3d79977afbe9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eaad739b-53d7-4128-8392-92ee0a953afa", "tag": "f5277d96-257e-4ea0-9978-d01e2d410339"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:55:59.172516 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-a9c35e2e-c179-41a2-988c-bb6298614430 req-3abbe79a-6bf3-4ef3-8665-3d79977afbe9 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:59.173266 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-a9c35e2e-c179-41a2-988c-bb6298614430 req-3abbe79a-6bf3-4ef3-8665-3d79977afbe9 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:59.175551 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-a9c35e2e-c179-41a2-988c-bb6298614430 req-3abbe79a-6bf3-4ef3-8665-3d79977afbe9 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:59.203095 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-a9c35e2e-c179-41a2-988c-bb6298614430 req-3abbe79a-6bf3-4ef3-8665-3d79977afbe9 service nova] Creating event network-changed:f5277d96-257e-4ea0-9978-d01e2d410339 for instance eaad739b-53d7-4128-8392-92ee0a953afa on n-h2-852278-4 Aug 27 02:55:59.215709 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-425de509-e1a6-4f3e-9807-78e3d2924b39 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:59.218585 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-425de509-e1a6-4f3e-9807-78e3d2924b39 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] [instance: 3f31178a-8993-4aa6-8d41-496bfec13bec] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:59.219904 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-a9c35e2e-c179-41a2-988c-bb6298614430 req-3abbe79a-6bf3-4ef3-8665-3d79977afbe9 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.288445 Aug 27 02:55:59.220728 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1618/3228] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:55:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:55:59.228585 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-425de509-e1a6-4f3e-9807-78e3d2924b39 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:59.230158 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-425de509-e1a6-4f3e-9807-78e3d2924b39 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:59.230982 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-425de509-e1a6-4f3e-9807-78e3d2924b39 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:59.234783 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-425de509-e1a6-4f3e-9807-78e3d2924b39 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:59.235580 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-425de509-e1a6-4f3e-9807-78e3d2924b39 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:59.236406 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-425de509-e1a6-4f3e-9807-78e3d2924b39 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:59.503174 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.objects.instance [None req-425de509-e1a6-4f3e-9807-78e3d2924b39 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lazy-loading 'services' on Instance uuid 3f31178a-8993-4aa6-8d41-496bfec13bec {{(pid=134051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:55:59.527944 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-425de509-e1a6-4f3e-9807-78e3d2924b39 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec" status: 200 len: 1929 microversion: 2.75 time: 0.322448 Aug 27 02:55:59.528636 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1611/3229] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:55:59 2022] GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec => generated 1929 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:55:59.900541 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b56a9bef-9d7c-4fcf-a232-b093e2c7692e tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:59.902014 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b56a9bef-9d7c-4fcf-a232-b093e2c7692e tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] [instance: eaad739b-53d7-4128-8392-92ee0a953afa] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:59.909820 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b56a9bef-9d7c-4fcf-a232-b093e2c7692e tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:59.911271 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b56a9bef-9d7c-4fcf-a232-b093e2c7692e tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:59.911928 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b56a9bef-9d7c-4fcf-a232-b093e2c7692e tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:59.912964 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b56a9bef-9d7c-4fcf-a232-b093e2c7692e tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:59.913615 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b56a9bef-9d7c-4fcf-a232-b093e2c7692e tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:59.914276 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b56a9bef-9d7c-4fcf-a232-b093e2c7692e tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:00.553384 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-16fcac02-45b6-4d8d-9f24-320d62eda15c tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:00.554022 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-16fcac02-45b6-4d8d-9f24-320d62eda15c tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] [instance: 3f31178a-8993-4aa6-8d41-496bfec13bec] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:00.572181 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-16fcac02-45b6-4d8d-9f24-320d62eda15c tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:00.572719 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-16fcac02-45b6-4d8d-9f24-320d62eda15c tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:00.573248 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-16fcac02-45b6-4d8d-9f24-320d62eda15c tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:00.573948 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-16fcac02-45b6-4d8d-9f24-320d62eda15c tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:00.574402 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-16fcac02-45b6-4d8d-9f24-320d62eda15c tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:00.574944 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-16fcac02-45b6-4d8d-9f24-320d62eda15c tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:00.597194 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b56a9bef-9d7c-4fcf-a232-b093e2c7692e tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c501b75773884dd7bf574035b88fc5d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c997efbeda2c4a2db15e9fe38ab96959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:00.608625 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b56a9bef-9d7c-4fcf-a232-b093e2c7692e tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] 10.222.0.70 "GET /compute/v2.1/servers/eaad739b-53d7-4128-8392-92ee0a953afa" status: 200 len: 1402 microversion: 2.1 time: 0.714937 Aug 27 02:56:00.610394 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1619/3230] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:59 2022] GET /compute/v2.1/servers/eaad739b-53d7-4128-8392-92ee0a953afa => generated 1402 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:56:00.777522 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.objects.instance [None req-16fcac02-45b6-4d8d-9f24-320d62eda15c tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lazy-loading 'services' on Instance uuid 3f31178a-8993-4aa6-8d41-496bfec13bec {{(pid=134051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:56:00.823328 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-16fcac02-45b6-4d8d-9f24-320d62eda15c tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec" status: 200 len: 1929 microversion: 2.75 time: 0.273426 Aug 27 02:56:00.827625 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1612/3231] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:56:00 2022] GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec => generated 1929 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:56:01.269129 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-c1a86d05-5042-4aab-93fa-834a672fe38a req-36d5c26b-1126-4343-95fe-f108a6b10c9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7", "tag": "8524810a-aaa6-4efe-ac59-2515339a1681"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:56:01.295002 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-c1a86d05-5042-4aab-93fa-834a672fe38a req-36d5c26b-1126-4343-95fe-f108a6b10c9e service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:01.295796 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-c1a86d05-5042-4aab-93fa-834a672fe38a req-36d5c26b-1126-4343-95fe-f108a6b10c9e service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:01.296435 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-c1a86d05-5042-4aab-93fa-834a672fe38a req-36d5c26b-1126-4343-95fe-f108a6b10c9e service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:01.322759 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-c1a86d05-5042-4aab-93fa-834a672fe38a req-36d5c26b-1126-4343-95fe-f108a6b10c9e service nova] Creating event network-changed:8524810a-aaa6-4efe-ac59-2515339a1681 for instance b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 on n-h2-852278-4 Aug 27 02:56:01.330558 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-c1a86d05-5042-4aab-93fa-834a672fe38a req-36d5c26b-1126-4343-95fe-f108a6b10c9e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065147 Aug 27 02:56:01.331384 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1620/3232] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:56:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:56:01.630458 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d3ccc980-c0ae-4231-8ce3-69277c22acbd tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:01.631246 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d3ccc980-c0ae-4231-8ce3-69277c22acbd tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] [instance: eaad739b-53d7-4128-8392-92ee0a953afa] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:01.633493 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:56:01.634825 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=14 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:56:01.641264 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d3ccc980-c0ae-4231-8ce3-69277c22acbd tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:01.642139 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d3ccc980-c0ae-4231-8ce3-69277c22acbd tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:01.642817 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d3ccc980-c0ae-4231-8ce3-69277c22acbd tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:01.643787 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d3ccc980-c0ae-4231-8ce3-69277c22acbd tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:01.644492 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d3ccc980-c0ae-4231-8ce3-69277c22acbd tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:01.645146 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d3ccc980-c0ae-4231-8ce3-69277c22acbd tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:01.852191 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ea561e95-7ea9-4ca2-b297-d4b9a30a9304 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:01.854973 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-ea561e95-7ea9-4ca2-b297-d4b9a30a9304 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] [instance: 3f31178a-8993-4aa6-8d41-496bfec13bec] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:01.878002 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ea561e95-7ea9-4ca2-b297-d4b9a30a9304 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:01.878604 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ea561e95-7ea9-4ca2-b297-d4b9a30a9304 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:01.879081 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ea561e95-7ea9-4ca2-b297-d4b9a30a9304 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:01.887196 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ea561e95-7ea9-4ca2-b297-d4b9a30a9304 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:01.889589 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ea561e95-7ea9-4ca2-b297-d4b9a30a9304 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:01.889977 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ea561e95-7ea9-4ca2-b297-d4b9a30a9304 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:01.961563 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d3ccc980-c0ae-4231-8ce3-69277c22acbd tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c501b75773884dd7bf574035b88fc5d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c997efbeda2c4a2db15e9fe38ab96959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:01.974189 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d3ccc980-c0ae-4231-8ce3-69277c22acbd tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] 10.222.0.70 "GET /compute/v2.1/servers/eaad739b-53d7-4128-8392-92ee0a953afa" status: 200 len: 1402 microversion: 2.1 time: 0.347663 Aug 27 02:56:01.978912 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1613/3233] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:01 2022] GET /compute/v2.1/servers/eaad739b-53d7-4128-8392-92ee0a953afa => generated 1402 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:56:02.073601 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.instance [None req-ea561e95-7ea9-4ca2-b297-d4b9a30a9304 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lazy-loading 'services' on Instance uuid 3f31178a-8993-4aa6-8d41-496bfec13bec {{(pid=134052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:56:02.120866 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ea561e95-7ea9-4ca2-b297-d4b9a30a9304 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec" status: 200 len: 1929 microversion: 2.75 time: 0.270630 Aug 27 02:56:02.121892 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1621/3234] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:56:01 2022] GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec => generated 1929 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:56:02.998092 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b564879a-e793-4711-9cbd-5e8794adaf81 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:03.001249 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b564879a-e793-4711-9cbd-5e8794adaf81 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] [instance: eaad739b-53d7-4128-8392-92ee0a953afa] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:03.024087 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b564879a-e793-4711-9cbd-5e8794adaf81 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:03.024806 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b564879a-e793-4711-9cbd-5e8794adaf81 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:03.026866 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b564879a-e793-4711-9cbd-5e8794adaf81 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:03.027694 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b564879a-e793-4711-9cbd-5e8794adaf81 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:03.028839 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b564879a-e793-4711-9cbd-5e8794adaf81 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:03.031794 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b564879a-e793-4711-9cbd-5e8794adaf81 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:03.162261 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-fb4bfaae-ae66-43b9-935e-075d4561eec5 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:03.165770 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-fb4bfaae-ae66-43b9-935e-075d4561eec5 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] [instance: 3f31178a-8993-4aa6-8d41-496bfec13bec] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:03.177608 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:56:03.181493 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fb4bfaae-ae66-43b9-935e-075d4561eec5 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:03.184866 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fb4bfaae-ae66-43b9-935e-075d4561eec5 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:03.187555 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fb4bfaae-ae66-43b9-935e-075d4561eec5 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:03.191292 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fb4bfaae-ae66-43b9-935e-075d4561eec5 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:03.192073 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fb4bfaae-ae66-43b9-935e-075d4561eec5 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:03.192785 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fb4bfaae-ae66-43b9-935e-075d4561eec5 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:03.591145 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.instance [None req-fb4bfaae-ae66-43b9-935e-075d4561eec5 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lazy-loading 'services' on Instance uuid 3f31178a-8993-4aa6-8d41-496bfec13bec {{(pid=134052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:56:03.644393 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-fb4bfaae-ae66-43b9-935e-075d4561eec5 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec" status: 200 len: 1929 microversion: 2.75 time: 0.500698 Aug 27 02:56:03.645285 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1622/3235] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:56:03 2022] GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec => generated 1929 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:56:04.298847 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-b564879a-e793-4711-9cbd-5e8794adaf81 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c501b75773884dd7bf574035b88fc5d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c997efbeda2c4a2db15e9fe38ab96959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:04.302257 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:56:04.311815 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b564879a-e793-4711-9cbd-5e8794adaf81 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] 10.222.0.70 "GET /compute/v2.1/servers/eaad739b-53d7-4128-8392-92ee0a953afa" status: 200 len: 1402 microversion: 2.1 time: 1.319381 Aug 27 02:56:04.316833 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1614/3236] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:02 2022] GET /compute/v2.1/servers/eaad739b-53d7-4128-8392-92ee0a953afa => generated 1402 bytes in 1326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:56:04.674651 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f727fe72-576c-4a59-a774-8906700ad8b0 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:04.678391 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-f727fe72-576c-4a59-a774-8906700ad8b0 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] [instance: 3f31178a-8993-4aa6-8d41-496bfec13bec] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:04.690952 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f727fe72-576c-4a59-a774-8906700ad8b0 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:04.696888 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f727fe72-576c-4a59-a774-8906700ad8b0 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:04.697684 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f727fe72-576c-4a59-a774-8906700ad8b0 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:04.698810 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f727fe72-576c-4a59-a774-8906700ad8b0 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:04.701101 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f727fe72-576c-4a59-a774-8906700ad8b0 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:04.701772 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f727fe72-576c-4a59-a774-8906700ad8b0 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:04.876156 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.instance [None req-f727fe72-576c-4a59-a774-8906700ad8b0 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lazy-loading 'services' on Instance uuid 3f31178a-8993-4aa6-8d41-496bfec13bec {{(pid=134052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:56:04.915829 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f727fe72-576c-4a59-a774-8906700ad8b0 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec" status: 200 len: 1929 microversion: 2.75 time: 0.245679 Aug 27 02:56:04.936905 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1623/3237] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:56:04 2022] GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec => generated 1929 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:56:05.336687 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-23599cd2-e840-4287-8359-3f2dd1164209 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:05.338291 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-23599cd2-e840-4287-8359-3f2dd1164209 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] [instance: eaad739b-53d7-4128-8392-92ee0a953afa] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:05.357830 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-23599cd2-e840-4287-8359-3f2dd1164209 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:05.358837 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-23599cd2-e840-4287-8359-3f2dd1164209 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:05.359488 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-23599cd2-e840-4287-8359-3f2dd1164209 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:05.365326 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-23599cd2-e840-4287-8359-3f2dd1164209 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:05.366113 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-23599cd2-e840-4287-8359-3f2dd1164209 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:05.366760 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-23599cd2-e840-4287-8359-3f2dd1164209 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:05.818179 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-23599cd2-e840-4287-8359-3f2dd1164209 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c501b75773884dd7bf574035b88fc5d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c997efbeda2c4a2db15e9fe38ab96959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:05.837462 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-23599cd2-e840-4287-8359-3f2dd1164209 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] 10.222.0.70 "GET /compute/v2.1/servers/eaad739b-53d7-4128-8392-92ee0a953afa" status: 200 len: 1402 microversion: 2.1 time: 0.508225 Aug 27 02:56:05.841727 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1615/3238] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:05 2022] GET /compute/v2.1/servers/eaad739b-53d7-4128-8392-92ee0a953afa => generated 1402 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:56:05.949990 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8ed939bb-7899-4eac-b1a5-dbd3aced44c1 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:05.950749 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-8ed939bb-7899-4eac-b1a5-dbd3aced44c1 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] [instance: 3f31178a-8993-4aa6-8d41-496bfec13bec] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:05.967216 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8ed939bb-7899-4eac-b1a5-dbd3aced44c1 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:05.967717 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8ed939bb-7899-4eac-b1a5-dbd3aced44c1 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:05.968150 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8ed939bb-7899-4eac-b1a5-dbd3aced44c1 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:05.968929 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8ed939bb-7899-4eac-b1a5-dbd3aced44c1 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:05.969381 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8ed939bb-7899-4eac-b1a5-dbd3aced44c1 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:05.978299 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8ed939bb-7899-4eac-b1a5-dbd3aced44c1 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:06.431282 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.instance [None req-8ed939bb-7899-4eac-b1a5-dbd3aced44c1 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lazy-loading 'services' on Instance uuid 3f31178a-8993-4aa6-8d41-496bfec13bec {{(pid=134052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:56:06.496710 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-8ed939bb-7899-4eac-b1a5-dbd3aced44c1 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec" status: 200 len: 1929 microversion: 2.75 time: 0.550306 Aug 27 02:56:06.500921 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1624/3239] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:56:05 2022] GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec => generated 1929 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:56:06.755672 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-afed6c77-208a-44a6-8663-fa8bf248a8dc req-d72eae4f-2b67-47d6-b4bc-d69773979040 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eaad739b-53d7-4128-8392-92ee0a953afa", "name": "network-vif-plugged", "status": "completed", "tag": "f5277d96-257e-4ea0-9978-d01e2d410339"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:56:06.787157 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-afed6c77-208a-44a6-8663-fa8bf248a8dc req-d72eae4f-2b67-47d6-b4bc-d69773979040 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:06.788777 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-afed6c77-208a-44a6-8663-fa8bf248a8dc req-d72eae4f-2b67-47d6-b4bc-d69773979040 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:06.789255 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-afed6c77-208a-44a6-8663-fa8bf248a8dc req-d72eae4f-2b67-47d6-b4bc-d69773979040 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:06.821635 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-afed6c77-208a-44a6-8663-fa8bf248a8dc req-d72eae4f-2b67-47d6-b4bc-d69773979040 service nova] Creating event network-vif-plugged:f5277d96-257e-4ea0-9978-d01e2d410339 for instance eaad739b-53d7-4128-8392-92ee0a953afa on n-h2-852278-4 Aug 27 02:56:06.833569 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-afed6c77-208a-44a6-8663-fa8bf248a8dc req-d72eae4f-2b67-47d6-b4bc-d69773979040 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083309 Aug 27 02:56:06.837336 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1616/3240] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:56:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:56:06.862590 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-076288ba-f25b-4077-82f5-9c4cf60ccde7 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:06.863822 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-076288ba-f25b-4077-82f5-9c4cf60ccde7 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] [instance: eaad739b-53d7-4128-8392-92ee0a953afa] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:06.892084 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-076288ba-f25b-4077-82f5-9c4cf60ccde7 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:06.898549 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-076288ba-f25b-4077-82f5-9c4cf60ccde7 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:06.899492 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-076288ba-f25b-4077-82f5-9c4cf60ccde7 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:06.907054 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-076288ba-f25b-4077-82f5-9c4cf60ccde7 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:06.914168 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-076288ba-f25b-4077-82f5-9c4cf60ccde7 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:06.915171 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-076288ba-f25b-4077-82f5-9c4cf60ccde7 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:07.349908 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-076288ba-f25b-4077-82f5-9c4cf60ccde7 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c501b75773884dd7bf574035b88fc5d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c997efbeda2c4a2db15e9fe38ab96959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:07.363283 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-076288ba-f25b-4077-82f5-9c4cf60ccde7 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] 10.222.0.70 "GET /compute/v2.1/servers/eaad739b-53d7-4128-8392-92ee0a953afa" status: 200 len: 1402 microversion: 2.1 time: 0.504411 Aug 27 02:56:07.378089 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1625/3241] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:06 2022] GET /compute/v2.1/servers/eaad739b-53d7-4128-8392-92ee0a953afa => generated 1402 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:56:07.533787 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-1bae0014-1b6c-4c7f-91f8-fa7929dc0d63 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:07.534631 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-1bae0014-1b6c-4c7f-91f8-fa7929dc0d63 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] [instance: 3f31178a-8993-4aa6-8d41-496bfec13bec] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:07.544072 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1bae0014-1b6c-4c7f-91f8-fa7929dc0d63 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:07.545559 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1bae0014-1b6c-4c7f-91f8-fa7929dc0d63 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:07.546242 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1bae0014-1b6c-4c7f-91f8-fa7929dc0d63 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:07.547321 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1bae0014-1b6c-4c7f-91f8-fa7929dc0d63 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:07.548837 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1bae0014-1b6c-4c7f-91f8-fa7929dc0d63 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:07.549565 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1bae0014-1b6c-4c7f-91f8-fa7929dc0d63 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:07.700505 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.objects.instance [None req-1bae0014-1b6c-4c7f-91f8-fa7929dc0d63 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lazy-loading 'services' on Instance uuid 3f31178a-8993-4aa6-8d41-496bfec13bec {{(pid=134051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:56:07.732017 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-1bae0014-1b6c-4c7f-91f8-fa7929dc0d63 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec" status: 200 len: 1929 microversion: 2.75 time: 0.205653 Aug 27 02:56:07.740817 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1617/3242] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:56:07 2022] GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec => generated 1929 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:56:07.759076 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a1cb3929-29ef-4c5c-a55c-097cb5e2788f tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-146894883", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "networks": [{"uuid": "d53cb795-d736-4850-b2ac-5dc6348156cb"}]}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:56:07.832673 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.network.neutron [None req-a1cb3929-29ef-4c5c-a55c-097cb5e2788f tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] validate_networks() for [('d53cb795-d736-4850-b2ac-5dc6348156cb', None, None, None, None, None)] {{(pid=134052) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:56:08.389168 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0d555b95-1532-4ad5-a2bb-6590d579e0d7 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:08.389868 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-0d555b95-1532-4ad5-a2bb-6590d579e0d7 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] [instance: eaad739b-53d7-4128-8392-92ee0a953afa] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:08.399452 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0d555b95-1532-4ad5-a2bb-6590d579e0d7 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:08.399948 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0d555b95-1532-4ad5-a2bb-6590d579e0d7 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:08.400430 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0d555b95-1532-4ad5-a2bb-6590d579e0d7 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:08.405819 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0d555b95-1532-4ad5-a2bb-6590d579e0d7 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:08.406306 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0d555b95-1532-4ad5-a2bb-6590d579e0d7 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:08.406753 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0d555b95-1532-4ad5-a2bb-6590d579e0d7 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:08.769015 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-0d555b95-1532-4ad5-a2bb-6590d579e0d7 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c501b75773884dd7bf574035b88fc5d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c997efbeda2c4a2db15e9fe38ab96959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:08.781005 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-0d555b95-1532-4ad5-a2bb-6590d579e0d7 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] 10.222.0.70 "GET /compute/v2.1/servers/eaad739b-53d7-4128-8392-92ee0a953afa" status: 200 len: 1402 microversion: 2.1 time: 0.395777 Aug 27 02:56:08.781615 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1618/3243] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:08 2022] GET /compute/v2.1/servers/eaad739b-53d7-4128-8392-92ee0a953afa => generated 1402 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:56:08.794943 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-6c74a030-4eb5-445e-8b61-88dada559744 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:08.795835 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-6c74a030-4eb5-445e-8b61-88dada559744 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] [instance: 3f31178a-8993-4aa6-8d41-496bfec13bec] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:08.808406 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6c74a030-4eb5-445e-8b61-88dada559744 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:08.808886 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6c74a030-4eb5-445e-8b61-88dada559744 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:08.809932 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6c74a030-4eb5-445e-8b61-88dada559744 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:08.810688 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6c74a030-4eb5-445e-8b61-88dada559744 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:08.813281 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6c74a030-4eb5-445e-8b61-88dada559744 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:08.813656 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6c74a030-4eb5-445e-8b61-88dada559744 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:08.942238 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.objects.instance [None req-6c74a030-4eb5-445e-8b61-88dada559744 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lazy-loading 'services' on Instance uuid 3f31178a-8993-4aa6-8d41-496bfec13bec {{(pid=134051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:56:08.964682 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-6c74a030-4eb5-445e-8b61-88dada559744 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec" status: 200 len: 1929 microversion: 2.75 time: 0.181939 Aug 27 02:56:08.965703 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1619/3244] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:56:08 2022] GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec => generated 1929 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:56:09.207256 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-a1cb3929-29ef-4c5c-a55c-097cb5e2788f tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Flavor limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:56:09.207804 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-a1cb3929-29ef-4c5c-a55c-097cb5e2788f tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Image limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:56:09.208476 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-a1cb3929-29ef-4c5c-a55c-097cb5e2788f tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Flavor pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:56:09.208884 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-a1cb3929-29ef-4c5c-a55c-097cb5e2788f tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Image pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:56:09.209308 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-a1cb3929-29ef-4c5c-a55c-097cb5e2788f tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:56:09.227575 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a1cb3929-29ef-4c5c-a55c-097cb5e2788f tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:09.228066 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a1cb3929-29ef-4c5c-a55c-097cb5e2788f tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:09.228529 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a1cb3929-29ef-4c5c-a55c-097cb5e2788f tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:09.232484 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a1cb3929-29ef-4c5c-a55c-097cb5e2788f tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:09.233023 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a1cb3929-29ef-4c5c-a55c-097cb5e2788f tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:09.233462 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a1cb3929-29ef-4c5c-a55c-097cb5e2788f tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:09.258961 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-a1cb3929-29ef-4c5c-a55c-097cb5e2788f tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Getting quotas for project e33011ef842941b3a35988d66565e958. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:56:09.264859 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-a1cb3929-29ef-4c5c-a55c-097cb5e2788f tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Getting quotas for user 6b59cfb13dfa4dcbb96fa040cd11f4c4 and project e33011ef842941b3a35988d66565e958. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:56:09.285728 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a1cb3929-29ef-4c5c-a55c-097cb5e2788f tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Going to run 1 instances... {{(pid=134052) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:56:09.288063 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a1cb3929-29ef-4c5c-a55c-097cb5e2788f tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] [instance: bdbaaee4-171e-4fcc-82c9-8b52850aed4f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134052) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:56:09.340101 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:56:09.391879 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a1cb3929-29ef-4c5c-a55c-097cb5e2788f tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.719763 Aug 27 02:56:09.397428 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1626/3245] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 02:56:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1726 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 02:56:09.409725 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c582c15b-a0c5-4818-b271-da942d2e40bd tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:09.410492 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-c582c15b-a0c5-4818-b271-da942d2e40bd tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] [instance: bdbaaee4-171e-4fcc-82c9-8b52850aed4f] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:09.529239 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-c582c15b-a0c5-4818-b271-da942d2e40bd tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b59cfb13dfa4dcbb96fa040cd11f4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33011ef842941b3a35988d66565e958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:09.540065 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c582c15b-a0c5-4818-b271-da942d2e40bd tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] 10.222.0.70 "GET /compute/v2.1/servers/bdbaaee4-171e-4fcc-82c9-8b52850aed4f" status: 200 len: 1224 microversion: 2.1 time: 0.135592 Aug 27 02:56:09.541026 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1620/3246] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:09 2022] GET /compute/v2.1/servers/bdbaaee4-171e-4fcc-82c9-8b52850aed4f => generated 1224 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:56:09.548945 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-97553d2f-68a8-4fd8-887d-3044cab505c3 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-1251322628", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "e7e2016f-72fa-4c5b-947d-9a8b6b4e27d2"}]}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:56:09.618710 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.network.neutron [None req-97553d2f-68a8-4fd8-887d-3044cab505c3 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] validate_networks() for [('e7e2016f-72fa-4c5b-947d-9a8b6b4e27d2', None, None, None, None, None)] {{(pid=134052) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:56:09.804083 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-9302e2bd-e7f7-499b-9c18-86487c80be3c tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:09.805059 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-9302e2bd-e7f7-499b-9c18-86487c80be3c tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] [instance: eaad739b-53d7-4128-8392-92ee0a953afa] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:09.822362 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9302e2bd-e7f7-499b-9c18-86487c80be3c tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:09.828886 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9302e2bd-e7f7-499b-9c18-86487c80be3c tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:09.831439 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9302e2bd-e7f7-499b-9c18-86487c80be3c tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:09.833669 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9302e2bd-e7f7-499b-9c18-86487c80be3c tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:09.838686 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9302e2bd-e7f7-499b-9c18-86487c80be3c tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:09.840291 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9302e2bd-e7f7-499b-9c18-86487c80be3c tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:10.359098 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-9302e2bd-e7f7-499b-9c18-86487c80be3c tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c501b75773884dd7bf574035b88fc5d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c997efbeda2c4a2db15e9fe38ab96959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:10.373256 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-9302e2bd-e7f7-499b-9c18-86487c80be3c tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] 10.222.0.70 "GET /compute/v2.1/servers/eaad739b-53d7-4128-8392-92ee0a953afa" status: 200 len: 1588 microversion: 2.1 time: 0.573872 Aug 27 02:56:10.373884 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1621/3247] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:09 2022] GET /compute/v2.1/servers/eaad739b-53d7-4128-8392-92ee0a953afa => generated 1588 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:56:10.382289 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a2bbf1b9-871f-435a-8c5a-cb26d78f1a78 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:10.382909 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-a2bbf1b9-871f-435a-8c5a-cb26d78f1a78 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] [instance: 3f31178a-8993-4aa6-8d41-496bfec13bec] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:10.400832 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a2bbf1b9-871f-435a-8c5a-cb26d78f1a78 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:10.402948 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a2bbf1b9-871f-435a-8c5a-cb26d78f1a78 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:10.406126 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a2bbf1b9-871f-435a-8c5a-cb26d78f1a78 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:10.407908 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a2bbf1b9-871f-435a-8c5a-cb26d78f1a78 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:10.410779 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a2bbf1b9-871f-435a-8c5a-cb26d78f1a78 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:10.412302 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a2bbf1b9-871f-435a-8c5a-cb26d78f1a78 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:10.468090 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-97553d2f-68a8-4fd8-887d-3044cab505c3 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Flavor limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:56:10.468823 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-97553d2f-68a8-4fd8-887d-3044cab505c3 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Image limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:56:10.469007 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-97553d2f-68a8-4fd8-887d-3044cab505c3 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Flavor pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:56:10.469417 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-97553d2f-68a8-4fd8-887d-3044cab505c3 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Image pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:56:10.469822 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-97553d2f-68a8-4fd8-887d-3044cab505c3 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:56:10.482671 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-97553d2f-68a8-4fd8-887d-3044cab505c3 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:10.483541 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-97553d2f-68a8-4fd8-887d-3044cab505c3 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:10.484358 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-97553d2f-68a8-4fd8-887d-3044cab505c3 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:10.485790 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-97553d2f-68a8-4fd8-887d-3044cab505c3 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:10.486562 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-97553d2f-68a8-4fd8-887d-3044cab505c3 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:10.487404 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-97553d2f-68a8-4fd8-887d-3044cab505c3 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:10.568887 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-97553d2f-68a8-4fd8-887d-3044cab505c3 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Getting quotas for project 244b19609b60427c80601c033539a55a. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:56:10.587976 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-97553d2f-68a8-4fd8-887d-3044cab505c3 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Getting quotas for user 52807fd89d4048f3a0034cb270ba2e9c and project 244b19609b60427c80601c033539a55a. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:56:10.591364 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.objects.instance [None req-a2bbf1b9-871f-435a-8c5a-cb26d78f1a78 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lazy-loading 'services' on Instance uuid 3f31178a-8993-4aa6-8d41-496bfec13bec {{(pid=134051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:56:10.654131 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a2bbf1b9-871f-435a-8c5a-cb26d78f1a78 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec" status: 200 len: 1929 microversion: 2.75 time: 0.278477 Aug 27 02:56:10.654738 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1622/3248] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:56:10 2022] GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec => generated 1929 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:56:10.662153 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-97553d2f-68a8-4fd8-887d-3044cab505c3 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Going to run 2 instances... {{(pid=134052) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:56:10.664495 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-97553d2f-68a8-4fd8-887d-3044cab505c3 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] [instance: c5baad75-87d5-4a3f-b3f8-73ca40b9781a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134052) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:56:10.673905 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b00d5ae7-16e2-4429-9d69-cf03ae67169b tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:10.674398 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b00d5ae7-16e2-4429-9d69-cf03ae67169b tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] [instance: eaad739b-53d7-4128-8392-92ee0a953afa] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:10.707660 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b00d5ae7-16e2-4429-9d69-cf03ae67169b tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:10.708240 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b00d5ae7-16e2-4429-9d69-cf03ae67169b tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:10.710795 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b00d5ae7-16e2-4429-9d69-cf03ae67169b tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:10.715293 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b00d5ae7-16e2-4429-9d69-cf03ae67169b tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:10.717189 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b00d5ae7-16e2-4429-9d69-cf03ae67169b tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:10.718035 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b00d5ae7-16e2-4429-9d69-cf03ae67169b tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:10.807686 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-97553d2f-68a8-4fd8-887d-3044cab505c3 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] [instance: 3af57aa3-9dfb-436f-8b35-0ba727f4ceee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=c5baad75-87d5-4a3f-b3f8-73ca40b9781a,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134052) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:56:11.021311 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-97553d2f-68a8-4fd8-887d-3044cab505c3 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.586205 Aug 27 02:56:11.022738 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1627/3249] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 02:56:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1592 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:56:11.037849 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4566b91d-67d0-46e9-8205-db2d9157e93a tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:11.042350 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-4566b91d-67d0-46e9-8205-db2d9157e93a tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] [instance: bdbaaee4-171e-4fcc-82c9-8b52850aed4f] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:11.060097 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4566b91d-67d0-46e9-8205-db2d9157e93a tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:11.060921 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4566b91d-67d0-46e9-8205-db2d9157e93a tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:11.062233 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4566b91d-67d0-46e9-8205-db2d9157e93a tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:11.063128 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4566b91d-67d0-46e9-8205-db2d9157e93a tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:11.063871 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4566b91d-67d0-46e9-8205-db2d9157e93a tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:11.064480 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4566b91d-67d0-46e9-8205-db2d9157e93a tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:11.081748 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b00d5ae7-16e2-4429-9d69-cf03ae67169b tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] 10.222.0.70 "GET /compute/v2.1/servers/eaad739b-53d7-4128-8392-92ee0a953afa/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.411893 Aug 27 02:56:11.094624 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1623/3250] 10.222.0.70 () {58 vars in 1275 bytes} [Sat Aug 27 02:56:10 2022] GET /compute/v2.1/servers/eaad739b-53d7-4128-8392-92ee0a953afa/os-interface => generated 284 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:56:11.118540 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c557071a-aa27-4660-b0a5-ce79ea3c70bf tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:11.143635 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-c557071a-aa27-4660-b0a5-ce79ea3c70bf tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '52807fd89d4048f3a0034cb270ba2e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '244b19609b60427c80601c033539a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:11.148218 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-c557071a-aa27-4660-b0a5-ce79ea3c70bf tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Searching by: {'deleted': False, 'project_id': '244b19609b60427c80601c033539a55a'} {{(pid=134051) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 02:56:11.213457 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c557071a-aa27-4660-b0a5-ce79ea3c70bf tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:11.218766 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c557071a-aa27-4660-b0a5-ce79ea3c70bf tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:11.219447 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c557071a-aa27-4660-b0a5-ce79ea3c70bf tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:11.220682 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c557071a-aa27-4660-b0a5-ce79ea3c70bf tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:11.221472 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c557071a-aa27-4660-b0a5-ce79ea3c70bf tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:11.222195 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c557071a-aa27-4660-b0a5-ce79ea3c70bf tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:11.314309 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c557071a-aa27-4660-b0a5-ce79ea3c70bf tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] 10.222.0.70 "GET /compute/v2.1/servers" status: 200 len: 677 microversion: 2.1 time: 0.217731 Aug 27 02:56:11.315379 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1624/3251] 10.222.0.70 () {58 vars in 1125 bytes} [Sat Aug 27 02:56:11 2022] GET /compute/v2.1/servers => generated 677 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:56:11.346201 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-9641a8a7-4802-4289-9891-30a43b0c8671 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:11.350041 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-4566b91d-67d0-46e9-8205-db2d9157e93a tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b59cfb13dfa4dcbb96fa040cd11f4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33011ef842941b3a35988d66565e958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:11.351291 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-9641a8a7-4802-4289-9891-30a43b0c8671 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] [instance: 3af57aa3-9dfb-436f-8b35-0ba727f4ceee] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:11.364106 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-4566b91d-67d0-46e9-8205-db2d9157e93a tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] 10.222.0.70 "GET /compute/v2.1/servers/bdbaaee4-171e-4fcc-82c9-8b52850aed4f" status: 200 len: 1276 microversion: 2.1 time: 0.337814 Aug 27 02:56:11.365673 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1628/3252] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:11 2022] GET /compute/v2.1/servers/bdbaaee4-171e-4fcc-82c9-8b52850aed4f => generated 1276 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:56:11.496271 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-9641a8a7-4802-4289-9891-30a43b0c8671 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52807fd89d4048f3a0034cb270ba2e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '244b19609b60427c80601c033539a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:11.505593 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-9641a8a7-4802-4289-9891-30a43b0c8671 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] 10.222.0.70 "GET /compute/v2.1/servers/3af57aa3-9dfb-436f-8b35-0ba727f4ceee" status: 200 len: 1220 microversion: 2.1 time: 0.173280 Aug 27 02:56:11.507926 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1625/3253] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:11 2022] GET /compute/v2.1/servers/3af57aa3-9dfb-436f-8b35-0ba727f4ceee => generated 1220 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:56:11.679757 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b51b0e06-b6f7-45e4-8a19-8fbf205a232b tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:11.680610 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b51b0e06-b6f7-45e4-8a19-8fbf205a232b tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] [instance: 3f31178a-8993-4aa6-8d41-496bfec13bec] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:11.689623 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b51b0e06-b6f7-45e4-8a19-8fbf205a232b tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:11.690996 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b51b0e06-b6f7-45e4-8a19-8fbf205a232b tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:11.691849 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b51b0e06-b6f7-45e4-8a19-8fbf205a232b tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:11.693199 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b51b0e06-b6f7-45e4-8a19-8fbf205a232b tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:11.693984 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b51b0e06-b6f7-45e4-8a19-8fbf205a232b tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:11.694704 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b51b0e06-b6f7-45e4-8a19-8fbf205a232b tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:11.724715 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=100 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:56:11.871008 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.instance [None req-b51b0e06-b6f7-45e4-8a19-8fbf205a232b tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lazy-loading 'services' on Instance uuid 3f31178a-8993-4aa6-8d41-496bfec13bec {{(pid=134052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:56:11.928069 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b51b0e06-b6f7-45e4-8a19-8fbf205a232b tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec" status: 200 len: 1929 microversion: 2.75 time: 0.250923 Aug 27 02:56:11.948880 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1629/3254] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:56:11 2022] GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec => generated 1929 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:56:12.402206 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4d9931ce-d155-4acb-adf2-02d3dae7ed06 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:12.402827 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-4d9931ce-d155-4acb-adf2-02d3dae7ed06 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] [instance: bdbaaee4-171e-4fcc-82c9-8b52850aed4f] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:12.415759 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4d9931ce-d155-4acb-adf2-02d3dae7ed06 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:12.416281 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4d9931ce-d155-4acb-adf2-02d3dae7ed06 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:12.429200 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4d9931ce-d155-4acb-adf2-02d3dae7ed06 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:12.430058 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4d9931ce-d155-4acb-adf2-02d3dae7ed06 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:12.430605 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4d9931ce-d155-4acb-adf2-02d3dae7ed06 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:12.431038 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4d9931ce-d155-4acb-adf2-02d3dae7ed06 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:12.541762 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ffbf4666-6a9c-486d-b7ac-956434655021 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:12.544401 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-ffbf4666-6a9c-486d-b7ac-956434655021 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] [instance: 3af57aa3-9dfb-436f-8b35-0ba727f4ceee] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:12.619349 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-4d9931ce-d155-4acb-adf2-02d3dae7ed06 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b59cfb13dfa4dcbb96fa040cd11f4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33011ef842941b3a35988d66565e958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:12.631951 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-4d9931ce-d155-4acb-adf2-02d3dae7ed06 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] 10.222.0.70 "GET /compute/v2.1/servers/bdbaaee4-171e-4fcc-82c9-8b52850aed4f" status: 200 len: 1282 microversion: 2.1 time: 0.233816 Aug 27 02:56:12.634068 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1626/3255] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:12 2022] GET /compute/v2.1/servers/bdbaaee4-171e-4fcc-82c9-8b52850aed4f => generated 1282 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:56:12.692198 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-ffbf4666-6a9c-486d-b7ac-956434655021 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52807fd89d4048f3a0034cb270ba2e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '244b19609b60427c80601c033539a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:12.700645 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ffbf4666-6a9c-486d-b7ac-956434655021 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] 10.222.0.70 "GET /compute/v2.1/servers/3af57aa3-9dfb-436f-8b35-0ba727f4ceee" status: 200 len: 1220 microversion: 2.1 time: 0.173194 Aug 27 02:56:12.701372 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1630/3256] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:12 2022] GET /compute/v2.1/servers/3af57aa3-9dfb-436f-8b35-0ba727f4ceee => generated 1220 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:56:12.961693 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-509d71aa-ffb7-4699-abe9-06cd87c46f62 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:12.962634 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-509d71aa-ffb7-4699-abe9-06cd87c46f62 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] [instance: 3f31178a-8993-4aa6-8d41-496bfec13bec] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:12.980387 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-509d71aa-ffb7-4699-abe9-06cd87c46f62 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:12.989195 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-509d71aa-ffb7-4699-abe9-06cd87c46f62 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:12.989652 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-509d71aa-ffb7-4699-abe9-06cd87c46f62 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:12.990414 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-509d71aa-ffb7-4699-abe9-06cd87c46f62 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:12.990877 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-509d71aa-ffb7-4699-abe9-06cd87c46f62 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:12.991492 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-509d71aa-ffb7-4699-abe9-06cd87c46f62 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:13.075507 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.objects.instance [None req-509d71aa-ffb7-4699-abe9-06cd87c46f62 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lazy-loading 'services' on Instance uuid 3f31178a-8993-4aa6-8d41-496bfec13bec {{(pid=134051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:56:13.095180 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-509d71aa-ffb7-4699-abe9-06cd87c46f62 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec" status: 200 len: 1929 microversion: 2.75 time: 0.139727 Aug 27 02:56:13.109172 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1627/3257] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:56:12 2022] GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec => generated 1929 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:56:13.393565 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-46cf63a0-3288-4381-8e33-8be9a7c0d43d tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:13.397116 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-f96bfcc4-b799-426c-8e75-dfaa7dcb1e57 req-9b734c23-6780-4f1a-ae47-55eee3dcb70f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eaad739b-53d7-4128-8392-92ee0a953afa", "tag": "f5277d96-257e-4ea0-9978-d01e2d410339"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:56:13.398711 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-46cf63a0-3288-4381-8e33-8be9a7c0d43d tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] [instance: eaad739b-53d7-4128-8392-92ee0a953afa] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:13.422295 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-46cf63a0-3288-4381-8e33-8be9a7c0d43d tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:13.425346 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-46cf63a0-3288-4381-8e33-8be9a7c0d43d tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:13.429142 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-f96bfcc4-b799-426c-8e75-dfaa7dcb1e57 req-9b734c23-6780-4f1a-ae47-55eee3dcb70f service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:13.429744 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-f96bfcc4-b799-426c-8e75-dfaa7dcb1e57 req-9b734c23-6780-4f1a-ae47-55eee3dcb70f service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:13.430388 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-f96bfcc4-b799-426c-8e75-dfaa7dcb1e57 req-9b734c23-6780-4f1a-ae47-55eee3dcb70f service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:13.433179 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-46cf63a0-3288-4381-8e33-8be9a7c0d43d tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:13.434548 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-46cf63a0-3288-4381-8e33-8be9a7c0d43d tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:13.435319 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-46cf63a0-3288-4381-8e33-8be9a7c0d43d tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:13.436285 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-46cf63a0-3288-4381-8e33-8be9a7c0d43d tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:13.449057 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-f96bfcc4-b799-426c-8e75-dfaa7dcb1e57 req-9b734c23-6780-4f1a-ae47-55eee3dcb70f service nova] Creating event network-changed:f5277d96-257e-4ea0-9978-d01e2d410339 for instance eaad739b-53d7-4128-8392-92ee0a953afa on n-h2-852278-4 Aug 27 02:56:13.459791 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-f96bfcc4-b799-426c-8e75-dfaa7dcb1e57 req-9b734c23-6780-4f1a-ae47-55eee3dcb70f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066380 Aug 27 02:56:13.461156 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1628/3258] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:56:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:56:13.664099 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4eabd991-c15d-455f-a062-d45c34f4e63a tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:13.664936 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-4eabd991-c15d-455f-a062-d45c34f4e63a tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] [instance: bdbaaee4-171e-4fcc-82c9-8b52850aed4f] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:13.672711 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4eabd991-c15d-455f-a062-d45c34f4e63a tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:13.673225 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4eabd991-c15d-455f-a062-d45c34f4e63a tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:13.675618 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4eabd991-c15d-455f-a062-d45c34f4e63a tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:13.681690 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4eabd991-c15d-455f-a062-d45c34f4e63a tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:13.682367 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4eabd991-c15d-455f-a062-d45c34f4e63a tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:13.688212 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4eabd991-c15d-455f-a062-d45c34f4e63a tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:14.641559 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-4eabd991-c15d-455f-a062-d45c34f4e63a tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b59cfb13dfa4dcbb96fa040cd11f4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33011ef842941b3a35988d66565e958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:14.650739 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-46cf63a0-3288-4381-8e33-8be9a7c0d43d tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c501b75773884dd7bf574035b88fc5d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c997efbeda2c4a2db15e9fe38ab96959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:14.655009 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-4eabd991-c15d-455f-a062-d45c34f4e63a tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] 10.222.0.70 "GET /compute/v2.1/servers/bdbaaee4-171e-4fcc-82c9-8b52850aed4f" status: 200 len: 1324 microversion: 2.1 time: 1.002047 Aug 27 02:56:14.655750 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1629/3259] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:13 2022] GET /compute/v2.1/servers/bdbaaee4-171e-4fcc-82c9-8b52850aed4f => generated 1324 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:56:14.662476 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-9ed0b880-9820-44c9-8329-41713ed13a5f tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:14.663083 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-9ed0b880-9820-44c9-8329-41713ed13a5f tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] [instance: 3af57aa3-9dfb-436f-8b35-0ba727f4ceee] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:14.667293 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-46cf63a0-3288-4381-8e33-8be9a7c0d43d tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] 10.222.0.70 "GET /compute/v2.1/servers/eaad739b-53d7-4128-8392-92ee0a953afa" status: 200 len: 1588 microversion: 2.1 time: 1.280425 Aug 27 02:56:14.667889 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1631/3260] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:13 2022] GET /compute/v2.1/servers/eaad739b-53d7-4128-8392-92ee0a953afa => generated 1588 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:56:14.673267 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-26df8672-5a53-47c7-8d6b-5173cfb7a5e0 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:14.680657 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-26df8672-5a53-47c7-8d6b-5173cfb7a5e0 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] [instance: 3f31178a-8993-4aa6-8d41-496bfec13bec] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:14.683067 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9ed0b880-9820-44c9-8329-41713ed13a5f tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:14.683965 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9ed0b880-9820-44c9-8329-41713ed13a5f tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:14.686717 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9ed0b880-9820-44c9-8329-41713ed13a5f tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:14.687710 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9ed0b880-9820-44c9-8329-41713ed13a5f tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:14.688362 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9ed0b880-9820-44c9-8329-41713ed13a5f tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:14.688957 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9ed0b880-9820-44c9-8329-41713ed13a5f tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:14.696364 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-26df8672-5a53-47c7-8d6b-5173cfb7a5e0 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:14.696865 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-26df8672-5a53-47c7-8d6b-5173cfb7a5e0 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:14.697295 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-26df8672-5a53-47c7-8d6b-5173cfb7a5e0 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:14.698059 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-26df8672-5a53-47c7-8d6b-5173cfb7a5e0 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:14.698502 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-26df8672-5a53-47c7-8d6b-5173cfb7a5e0 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:14.698913 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-26df8672-5a53-47c7-8d6b-5173cfb7a5e0 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:14.906091 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.instance [None req-26df8672-5a53-47c7-8d6b-5173cfb7a5e0 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lazy-loading 'services' on Instance uuid 3f31178a-8993-4aa6-8d41-496bfec13bec {{(pid=134052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:56:14.939636 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-26df8672-5a53-47c7-8d6b-5173cfb7a5e0 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec" status: 200 len: 1929 microversion: 2.75 time: 0.270460 Aug 27 02:56:14.940930 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1632/3261] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:56:14 2022] GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec => generated 1929 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:56:15.051978 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-9ed0b880-9820-44c9-8329-41713ed13a5f tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52807fd89d4048f3a0034cb270ba2e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '244b19609b60427c80601c033539a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:15.060923 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-9ed0b880-9820-44c9-8329-41713ed13a5f tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] 10.222.0.70 "GET /compute/v2.1/servers/3af57aa3-9dfb-436f-8b35-0ba727f4ceee" status: 200 len: 1278 microversion: 2.1 time: 0.402613 Aug 27 02:56:15.061489 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1630/3262] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:14 2022] GET /compute/v2.1/servers/3af57aa3-9dfb-436f-8b35-0ba727f4ceee => generated 1278 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:56:15.693325 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-bd501686-2b5b-4ef1-be68-d91fde64f539 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:15.694075 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-bd501686-2b5b-4ef1-be68-d91fde64f539 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] [instance: bdbaaee4-171e-4fcc-82c9-8b52850aed4f] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:15.701866 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bd501686-2b5b-4ef1-be68-d91fde64f539 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:15.702972 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bd501686-2b5b-4ef1-be68-d91fde64f539 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:15.703413 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bd501686-2b5b-4ef1-be68-d91fde64f539 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:15.704131 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bd501686-2b5b-4ef1-be68-d91fde64f539 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:15.704677 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bd501686-2b5b-4ef1-be68-d91fde64f539 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:15.705745 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bd501686-2b5b-4ef1-be68-d91fde64f539 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:15.943394 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-bd501686-2b5b-4ef1-be68-d91fde64f539 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b59cfb13dfa4dcbb96fa040cd11f4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33011ef842941b3a35988d66565e958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:15.952605 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-bd501686-2b5b-4ef1-be68-d91fde64f539 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] 10.222.0.70 "GET /compute/v2.1/servers/bdbaaee4-171e-4fcc-82c9-8b52850aed4f" status: 200 len: 1324 microversion: 2.1 time: 0.263698 Aug 27 02:56:15.970817 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1633/3263] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:15 2022] GET /compute/v2.1/servers/bdbaaee4-171e-4fcc-82c9-8b52850aed4f => generated 1324 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:56:15.982688 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-510bbc76-c70f-4d86-8bf6-809f8f811ef7 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:15.988280 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-7c97c4b3-f4c4-4ff8-a64c-397475326e77 req-2cab752f-2dd3-4d38-bc96-e84df90d6d87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdbaaee4-171e-4fcc-82c9-8b52850aed4f", "tag": "7cfc9dfb-21e4-4db9-9e2c-8e6645c1bc57"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:56:15.993080 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-510bbc76-c70f-4d86-8bf6-809f8f811ef7 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] [instance: 3f31178a-8993-4aa6-8d41-496bfec13bec] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:16.010851 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-7c97c4b3-f4c4-4ff8-a64c-397475326e77 req-2cab752f-2dd3-4d38-bc96-e84df90d6d87 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:16.011428 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-7c97c4b3-f4c4-4ff8-a64c-397475326e77 req-2cab752f-2dd3-4d38-bc96-e84df90d6d87 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:16.011865 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-7c97c4b3-f4c4-4ff8-a64c-397475326e77 req-2cab752f-2dd3-4d38-bc96-e84df90d6d87 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:16.013427 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-510bbc76-c70f-4d86-8bf6-809f8f811ef7 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:16.014757 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-510bbc76-c70f-4d86-8bf6-809f8f811ef7 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:16.017004 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-510bbc76-c70f-4d86-8bf6-809f8f811ef7 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:16.018483 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-510bbc76-c70f-4d86-8bf6-809f8f811ef7 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:16.019165 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-510bbc76-c70f-4d86-8bf6-809f8f811ef7 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:16.020862 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-510bbc76-c70f-4d86-8bf6-809f8f811ef7 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:16.042956 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-7c97c4b3-f4c4-4ff8-a64c-397475326e77 req-2cab752f-2dd3-4d38-bc96-e84df90d6d87 service nova] Creating event network-changed:7cfc9dfb-21e4-4db9-9e2c-8e6645c1bc57 for instance bdbaaee4-171e-4fcc-82c9-8b52850aed4f on n-h1-852278-4 Aug 27 02:56:16.054578 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-7c97c4b3-f4c4-4ff8-a64c-397475326e77 req-2cab752f-2dd3-4d38-bc96-e84df90d6d87 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069949 Aug 27 02:56:16.055955 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1634/3264] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:56:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:56:16.085074 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-292743c5-3edc-44b0-a3f9-bc0528f85582 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:16.086223 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-292743c5-3edc-44b0-a3f9-bc0528f85582 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] [instance: 3af57aa3-9dfb-436f-8b35-0ba727f4ceee] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:16.107052 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-292743c5-3edc-44b0-a3f9-bc0528f85582 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:16.109730 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-292743c5-3edc-44b0-a3f9-bc0528f85582 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:16.110214 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-292743c5-3edc-44b0-a3f9-bc0528f85582 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:16.110971 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-292743c5-3edc-44b0-a3f9-bc0528f85582 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:16.111337 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-292743c5-3edc-44b0-a3f9-bc0528f85582 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:16.114369 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-292743c5-3edc-44b0-a3f9-bc0528f85582 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:16.219650 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.objects.instance [None req-510bbc76-c70f-4d86-8bf6-809f8f811ef7 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lazy-loading 'services' on Instance uuid 3f31178a-8993-4aa6-8d41-496bfec13bec {{(pid=134051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:56:16.242593 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-510bbc76-c70f-4d86-8bf6-809f8f811ef7 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec" status: 200 len: 1929 microversion: 2.75 time: 0.264763 Aug 27 02:56:16.255743 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1631/3265] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:56:15 2022] GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec => generated 1929 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:56:16.290087 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-292743c5-3edc-44b0-a3f9-bc0528f85582 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52807fd89d4048f3a0034cb270ba2e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '244b19609b60427c80601c033539a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:16.304743 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-292743c5-3edc-44b0-a3f9-bc0528f85582 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] 10.222.0.70 "GET /compute/v2.1/servers/3af57aa3-9dfb-436f-8b35-0ba727f4ceee" status: 200 len: 1278 microversion: 2.1 time: 0.225552 Aug 27 02:56:16.306923 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1635/3266] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:16 2022] GET /compute/v2.1/servers/3af57aa3-9dfb-436f-8b35-0ba727f4ceee => generated 1278 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:56:16.984504 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-88daa707-0b33-44be-8c62-deff03c338e2 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:16.985782 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-88daa707-0b33-44be-8c62-deff03c338e2 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] [instance: bdbaaee4-171e-4fcc-82c9-8b52850aed4f] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:17.002170 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-88daa707-0b33-44be-8c62-deff03c338e2 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:17.002768 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-88daa707-0b33-44be-8c62-deff03c338e2 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:17.003224 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-88daa707-0b33-44be-8c62-deff03c338e2 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:17.004187 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-88daa707-0b33-44be-8c62-deff03c338e2 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:17.004817 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-88daa707-0b33-44be-8c62-deff03c338e2 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:17.005898 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-88daa707-0b33-44be-8c62-deff03c338e2 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:17.270507 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0327e129-d75e-4a74-8d00-9e51062fdca9 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:17.271612 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-0327e129-d75e-4a74-8d00-9e51062fdca9 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] [instance: 3f31178a-8993-4aa6-8d41-496bfec13bec] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:17.286872 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0327e129-d75e-4a74-8d00-9e51062fdca9 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:17.287553 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0327e129-d75e-4a74-8d00-9e51062fdca9 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:17.288432 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0327e129-d75e-4a74-8d00-9e51062fdca9 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:17.289316 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0327e129-d75e-4a74-8d00-9e51062fdca9 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:17.289858 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0327e129-d75e-4a74-8d00-9e51062fdca9 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:17.290371 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0327e129-d75e-4a74-8d00-9e51062fdca9 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:17.405068 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-88daa707-0b33-44be-8c62-deff03c338e2 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b59cfb13dfa4dcbb96fa040cd11f4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33011ef842941b3a35988d66565e958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:17.414668 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-88daa707-0b33-44be-8c62-deff03c338e2 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] 10.222.0.70 "GET /compute/v2.1/servers/bdbaaee4-171e-4fcc-82c9-8b52850aed4f" status: 200 len: 1324 microversion: 2.1 time: 0.433868 Aug 27 02:56:17.430738 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1632/3267] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:16 2022] GET /compute/v2.1/servers/bdbaaee4-171e-4fcc-82c9-8b52850aed4f => generated 1324 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:56:17.430738 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c80e5264-2242-4805-9925-ef7fd67ca2cf tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:17.431057 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.instance [None req-0327e129-d75e-4a74-8d00-9e51062fdca9 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lazy-loading 'services' on Instance uuid 3f31178a-8993-4aa6-8d41-496bfec13bec {{(pid=134052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:56:17.431163 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-c80e5264-2242-4805-9925-ef7fd67ca2cf tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] [instance: 3af57aa3-9dfb-436f-8b35-0ba727f4ceee] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:17.447067 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c80e5264-2242-4805-9925-ef7fd67ca2cf tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:17.449132 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c80e5264-2242-4805-9925-ef7fd67ca2cf tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:17.449753 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c80e5264-2242-4805-9925-ef7fd67ca2cf tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:17.450663 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c80e5264-2242-4805-9925-ef7fd67ca2cf tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:17.451429 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c80e5264-2242-4805-9925-ef7fd67ca2cf tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:17.452166 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c80e5264-2242-4805-9925-ef7fd67ca2cf tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:17.452954 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-0327e129-d75e-4a74-8d00-9e51062fdca9 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec" status: 200 len: 1929 microversion: 2.75 time: 0.189248 Aug 27 02:56:17.456353 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1636/3268] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:56:17 2022] GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec => generated 1929 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:56:17.744475 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-c80e5264-2242-4805-9925-ef7fd67ca2cf tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52807fd89d4048f3a0034cb270ba2e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '244b19609b60427c80601c033539a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:17.753329 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c80e5264-2242-4805-9925-ef7fd67ca2cf tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] 10.222.0.70 "GET /compute/v2.1/servers/3af57aa3-9dfb-436f-8b35-0ba727f4ceee" status: 200 len: 1320 microversion: 2.1 time: 0.327355 Aug 27 02:56:17.756813 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1633/3269] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:17 2022] GET /compute/v2.1/servers/3af57aa3-9dfb-436f-8b35-0ba727f4ceee => generated 1320 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:56:18.071988 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-7277fed0-c9ee-4a7a-be17-22eb4b71323e req-60d75542-1547-4eb3-8325-d0052b7310fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3af57aa3-9dfb-436f-8b35-0ba727f4ceee", "tag": "029899f4-d7d1-4dce-bea8-98ad91749f24"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:56:18.086760 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-034ffde1-716c-4eea-94c5-20b665794978 req-5b5ffaa3-59c1-40ae-82c9-1b420e1664a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5baad75-87d5-4a3f-b3f8-73ca40b9781a", "tag": "998bb2bb-d0ab-40ee-b888-9cc7df69e539"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:56:18.123151 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-7277fed0-c9ee-4a7a-be17-22eb4b71323e req-60d75542-1547-4eb3-8325-d0052b7310fc service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:18.124154 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-7277fed0-c9ee-4a7a-be17-22eb4b71323e req-60d75542-1547-4eb3-8325-d0052b7310fc service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:18.124853 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-034ffde1-716c-4eea-94c5-20b665794978 req-5b5ffaa3-59c1-40ae-82c9-1b420e1664a8 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:18.125946 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-7277fed0-c9ee-4a7a-be17-22eb4b71323e req-60d75542-1547-4eb3-8325-d0052b7310fc service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:18.128515 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-034ffde1-716c-4eea-94c5-20b665794978 req-5b5ffaa3-59c1-40ae-82c9-1b420e1664a8 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:18.129265 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-034ffde1-716c-4eea-94c5-20b665794978 req-5b5ffaa3-59c1-40ae-82c9-1b420e1664a8 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:18.154817 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=100 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:56:18.157772 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-7277fed0-c9ee-4a7a-be17-22eb4b71323e req-60d75542-1547-4eb3-8325-d0052b7310fc service nova] Creating event network-changed:029899f4-d7d1-4dce-bea8-98ad91749f24 for instance 3af57aa3-9dfb-436f-8b35-0ba727f4ceee on n-h2-852278-4 Aug 27 02:56:18.159966 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-034ffde1-716c-4eea-94c5-20b665794978 req-5b5ffaa3-59c1-40ae-82c9-1b420e1664a8 service nova] Creating event network-changed:998bb2bb-d0ab-40ee-b888-9cc7df69e539 for instance c5baad75-87d5-4a3f-b3f8-73ca40b9781a on n-h1-852278-4 Aug 27 02:56:18.167218 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-7277fed0-c9ee-4a7a-be17-22eb4b71323e req-60d75542-1547-4eb3-8325-d0052b7310fc service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099318 Aug 27 02:56:18.168379 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1637/3270] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:56:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:56:18.169041 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-034ffde1-716c-4eea-94c5-20b665794978 req-5b5ffaa3-59c1-40ae-82c9-1b420e1664a8 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090279 Aug 27 02:56:18.169823 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1634/3271] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:56:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:56:18.440964 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4205f8e1-9fc0-4f2a-b8b9-fa634e88d993 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:18.445121 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-4205f8e1-9fc0-4f2a-b8b9-fa634e88d993 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] [instance: bdbaaee4-171e-4fcc-82c9-8b52850aed4f] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:18.455497 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4205f8e1-9fc0-4f2a-b8b9-fa634e88d993 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:18.456340 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4205f8e1-9fc0-4f2a-b8b9-fa634e88d993 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:18.457123 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4205f8e1-9fc0-4f2a-b8b9-fa634e88d993 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:18.458014 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4205f8e1-9fc0-4f2a-b8b9-fa634e88d993 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:18.458648 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4205f8e1-9fc0-4f2a-b8b9-fa634e88d993 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:18.459181 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4205f8e1-9fc0-4f2a-b8b9-fa634e88d993 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:18.490252 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4809c532-dbed-4a4d-bc3c-b401ecff1cbf tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:18.491325 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-4809c532-dbed-4a4d-bc3c-b401ecff1cbf tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] [instance: 3f31178a-8993-4aa6-8d41-496bfec13bec] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:18.505390 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4809c532-dbed-4a4d-bc3c-b401ecff1cbf tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:18.507780 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4809c532-dbed-4a4d-bc3c-b401ecff1cbf tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:18.508587 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4809c532-dbed-4a4d-bc3c-b401ecff1cbf tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:18.509616 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4809c532-dbed-4a4d-bc3c-b401ecff1cbf tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:18.511721 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4809c532-dbed-4a4d-bc3c-b401ecff1cbf tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:18.512509 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4809c532-dbed-4a4d-bc3c-b401ecff1cbf tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:18.643185 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.objects.instance [None req-4809c532-dbed-4a4d-bc3c-b401ecff1cbf tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lazy-loading 'services' on Instance uuid 3f31178a-8993-4aa6-8d41-496bfec13bec {{(pid=134051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:56:18.686353 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-4809c532-dbed-4a4d-bc3c-b401ecff1cbf tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec" status: 200 len: 1929 microversion: 2.75 time: 0.201302 Aug 27 02:56:18.688796 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1635/3272] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:56:18 2022] GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec => generated 1929 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:56:18.754276 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-4205f8e1-9fc0-4f2a-b8b9-fa634e88d993 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b59cfb13dfa4dcbb96fa040cd11f4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33011ef842941b3a35988d66565e958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:18.763502 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-4205f8e1-9fc0-4f2a-b8b9-fa634e88d993 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] 10.222.0.70 "GET /compute/v2.1/servers/bdbaaee4-171e-4fcc-82c9-8b52850aed4f" status: 200 len: 1324 microversion: 2.1 time: 0.328333 Aug 27 02:56:18.764104 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1638/3273] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:18 2022] GET /compute/v2.1/servers/bdbaaee4-171e-4fcc-82c9-8b52850aed4f => generated 1324 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:56:18.776599 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-570480ae-e4f1-4b7d-ae3f-1167d77ad661 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:18.777655 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-570480ae-e4f1-4b7d-ae3f-1167d77ad661 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] [instance: 3af57aa3-9dfb-436f-8b35-0ba727f4ceee] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:18.787092 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-570480ae-e4f1-4b7d-ae3f-1167d77ad661 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:18.788221 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-570480ae-e4f1-4b7d-ae3f-1167d77ad661 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:18.788977 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-570480ae-e4f1-4b7d-ae3f-1167d77ad661 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:18.789914 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-570480ae-e4f1-4b7d-ae3f-1167d77ad661 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:18.790507 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-570480ae-e4f1-4b7d-ae3f-1167d77ad661 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:18.790925 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-570480ae-e4f1-4b7d-ae3f-1167d77ad661 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:18.954975 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-570480ae-e4f1-4b7d-ae3f-1167d77ad661 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52807fd89d4048f3a0034cb270ba2e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '244b19609b60427c80601c033539a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:18.967479 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-570480ae-e4f1-4b7d-ae3f-1167d77ad661 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] 10.222.0.70 "GET /compute/v2.1/servers/3af57aa3-9dfb-436f-8b35-0ba727f4ceee" status: 200 len: 1320 microversion: 2.1 time: 0.193435 Aug 27 02:56:18.969188 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1636/3274] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:18 2022] GET /compute/v2.1/servers/3af57aa3-9dfb-436f-8b35-0ba727f4ceee => generated 1320 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:56:19.714447 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9e90e801-ecc4-477a-922c-48dc43301b16 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:19.715820 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-9e90e801-ecc4-477a-922c-48dc43301b16 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] [instance: 3f31178a-8993-4aa6-8d41-496bfec13bec] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:19.730139 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9e90e801-ecc4-477a-922c-48dc43301b16 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:19.731125 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9e90e801-ecc4-477a-922c-48dc43301b16 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:19.731852 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9e90e801-ecc4-477a-922c-48dc43301b16 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:19.732712 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9e90e801-ecc4-477a-922c-48dc43301b16 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:19.733262 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9e90e801-ecc4-477a-922c-48dc43301b16 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:19.734001 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9e90e801-ecc4-477a-922c-48dc43301b16 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:19.783962 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-defd6521-d92c-4d43-9cac-7f959d6291a5 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:19.784761 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-defd6521-d92c-4d43-9cac-7f959d6291a5 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] [instance: bdbaaee4-171e-4fcc-82c9-8b52850aed4f] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:19.792639 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-defd6521-d92c-4d43-9cac-7f959d6291a5 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:19.793553 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-defd6521-d92c-4d43-9cac-7f959d6291a5 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:19.794172 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-defd6521-d92c-4d43-9cac-7f959d6291a5 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:19.795540 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-defd6521-d92c-4d43-9cac-7f959d6291a5 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:19.796275 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-defd6521-d92c-4d43-9cac-7f959d6291a5 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:19.796890 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-defd6521-d92c-4d43-9cac-7f959d6291a5 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:19.842927 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.instance [None req-9e90e801-ecc4-477a-922c-48dc43301b16 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lazy-loading 'services' on Instance uuid 3f31178a-8993-4aa6-8d41-496bfec13bec {{(pid=134052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:56:19.881565 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9e90e801-ecc4-477a-922c-48dc43301b16 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec" status: 200 len: 1929 microversion: 2.75 time: 0.172017 Aug 27 02:56:19.882189 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1639/3275] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:56:19 2022] GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec => generated 1929 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:56:19.990225 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-21f79391-dcc0-4c14-b2ed-f04159e05e45 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:19.990873 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-21f79391-dcc0-4c14-b2ed-f04159e05e45 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] [instance: 3af57aa3-9dfb-436f-8b35-0ba727f4ceee] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:19.998971 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-21f79391-dcc0-4c14-b2ed-f04159e05e45 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:19.999468 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-21f79391-dcc0-4c14-b2ed-f04159e05e45 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:19.999894 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-21f79391-dcc0-4c14-b2ed-f04159e05e45 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:20.005309 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-21f79391-dcc0-4c14-b2ed-f04159e05e45 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:20.005823 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-21f79391-dcc0-4c14-b2ed-f04159e05e45 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:20.006488 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-21f79391-dcc0-4c14-b2ed-f04159e05e45 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:20.163299 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-defd6521-d92c-4d43-9cac-7f959d6291a5 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b59cfb13dfa4dcbb96fa040cd11f4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33011ef842941b3a35988d66565e958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:20.173320 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-defd6521-d92c-4d43-9cac-7f959d6291a5 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] 10.222.0.70 "GET /compute/v2.1/servers/bdbaaee4-171e-4fcc-82c9-8b52850aed4f" status: 200 len: 1324 microversion: 2.1 time: 0.393225 Aug 27 02:56:20.174045 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1637/3276] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:19 2022] GET /compute/v2.1/servers/bdbaaee4-171e-4fcc-82c9-8b52850aed4f => generated 1324 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:56:20.278464 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-21f79391-dcc0-4c14-b2ed-f04159e05e45 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52807fd89d4048f3a0034cb270ba2e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '244b19609b60427c80601c033539a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:20.286872 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-21f79391-dcc0-4c14-b2ed-f04159e05e45 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] 10.222.0.70 "GET /compute/v2.1/servers/3af57aa3-9dfb-436f-8b35-0ba727f4ceee" status: 200 len: 1320 microversion: 2.1 time: 0.300779 Aug 27 02:56:20.287525 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1640/3277] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:19 2022] GET /compute/v2.1/servers/3af57aa3-9dfb-436f-8b35-0ba727f4ceee => generated 1320 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:56:20.912055 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3273fcda-7915-4487-bae0-d89638b7112c tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:20.912734 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-3273fcda-7915-4487-bae0-d89638b7112c tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] [instance: 3f31178a-8993-4aa6-8d41-496bfec13bec] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:20.943665 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3273fcda-7915-4487-bae0-d89638b7112c tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:20.944166 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3273fcda-7915-4487-bae0-d89638b7112c tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:20.944662 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3273fcda-7915-4487-bae0-d89638b7112c tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:20.945413 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3273fcda-7915-4487-bae0-d89638b7112c tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:20.945883 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3273fcda-7915-4487-bae0-d89638b7112c tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:20.946311 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3273fcda-7915-4487-bae0-d89638b7112c tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:21.033358 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.objects.instance [None req-3273fcda-7915-4487-bae0-d89638b7112c tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lazy-loading 'services' on Instance uuid 3f31178a-8993-4aa6-8d41-496bfec13bec {{(pid=134051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:56:21.049846 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-3273fcda-7915-4487-bae0-d89638b7112c tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec" status: 200 len: 1929 microversion: 2.75 time: 0.143354 Aug 27 02:56:21.050635 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1638/3278] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:56:20 2022] GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec => generated 1929 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:56:21.195573 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d9dd810d-a43f-4f82-8e5b-a2792ddab05b tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:21.196515 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d9dd810d-a43f-4f82-8e5b-a2792ddab05b tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] [instance: bdbaaee4-171e-4fcc-82c9-8b52850aed4f] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:21.198795 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=4 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:56:21.205131 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d9dd810d-a43f-4f82-8e5b-a2792ddab05b tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:21.205851 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d9dd810d-a43f-4f82-8e5b-a2792ddab05b tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:21.206779 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d9dd810d-a43f-4f82-8e5b-a2792ddab05b tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:21.207286 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d9dd810d-a43f-4f82-8e5b-a2792ddab05b tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:21.207626 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d9dd810d-a43f-4f82-8e5b-a2792ddab05b tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:21.208081 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d9dd810d-a43f-4f82-8e5b-a2792ddab05b tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:21.315892 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0f52c9b2-1286-4aea-ac5d-e690a85ff2cc tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:21.316934 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-0f52c9b2-1286-4aea-ac5d-e690a85ff2cc tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] [instance: 3af57aa3-9dfb-436f-8b35-0ba727f4ceee] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:21.326922 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:56:21.330780 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0f52c9b2-1286-4aea-ac5d-e690a85ff2cc tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:21.332299 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0f52c9b2-1286-4aea-ac5d-e690a85ff2cc tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:21.333227 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0f52c9b2-1286-4aea-ac5d-e690a85ff2cc tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:21.335605 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0f52c9b2-1286-4aea-ac5d-e690a85ff2cc tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:21.336505 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0f52c9b2-1286-4aea-ac5d-e690a85ff2cc tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:21.337096 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0f52c9b2-1286-4aea-ac5d-e690a85ff2cc tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:21.378650 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-d9dd810d-a43f-4f82-8e5b-a2792ddab05b tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b59cfb13dfa4dcbb96fa040cd11f4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33011ef842941b3a35988d66565e958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:21.389802 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d9dd810d-a43f-4f82-8e5b-a2792ddab05b tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] 10.222.0.70 "GET /compute/v2.1/servers/bdbaaee4-171e-4fcc-82c9-8b52850aed4f" status: 200 len: 1324 microversion: 2.1 time: 0.198447 Aug 27 02:56:21.397164 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1641/3279] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:21 2022] GET /compute/v2.1/servers/bdbaaee4-171e-4fcc-82c9-8b52850aed4f => generated 1324 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:56:21.500874 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=4 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:56:21.519185 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-0f52c9b2-1286-4aea-ac5d-e690a85ff2cc tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52807fd89d4048f3a0034cb270ba2e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '244b19609b60427c80601c033539a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:21.528226 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-0f52c9b2-1286-4aea-ac5d-e690a85ff2cc tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] 10.222.0.70 "GET /compute/v2.1/servers/3af57aa3-9dfb-436f-8b35-0ba727f4ceee" status: 200 len: 1320 microversion: 2.1 time: 0.221268 Aug 27 02:56:21.528954 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1639/3280] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:21 2022] GET /compute/v2.1/servers/3af57aa3-9dfb-436f-8b35-0ba727f4ceee => generated 1320 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:56:22.076573 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-fb4fda8e-8e9e-4098-b0ac-adfb1754f804 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:22.077342 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-fb4fda8e-8e9e-4098-b0ac-adfb1754f804 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] [instance: 3f31178a-8993-4aa6-8d41-496bfec13bec] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:22.084493 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fb4fda8e-8e9e-4098-b0ac-adfb1754f804 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:22.085092 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fb4fda8e-8e9e-4098-b0ac-adfb1754f804 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:22.085593 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fb4fda8e-8e9e-4098-b0ac-adfb1754f804 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:22.086387 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fb4fda8e-8e9e-4098-b0ac-adfb1754f804 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:22.086940 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fb4fda8e-8e9e-4098-b0ac-adfb1754f804 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:22.087553 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fb4fda8e-8e9e-4098-b0ac-adfb1754f804 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:22.345595 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.instance [None req-fb4fda8e-8e9e-4098-b0ac-adfb1754f804 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lazy-loading 'services' on Instance uuid 3f31178a-8993-4aa6-8d41-496bfec13bec {{(pid=134052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:56:22.368868 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-fb4fda8e-8e9e-4098-b0ac-adfb1754f804 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec" status: 200 len: 1929 microversion: 2.75 time: 0.296761 Aug 27 02:56:22.387394 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1642/3281] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:56:22 2022] GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec => generated 1929 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:56:22.415824 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-220b005e-30cf-48c1-b8a1-29860ab80305 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:22.416899 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-220b005e-30cf-48c1-b8a1-29860ab80305 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] [instance: bdbaaee4-171e-4fcc-82c9-8b52850aed4f] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:22.424629 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-220b005e-30cf-48c1-b8a1-29860ab80305 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:22.425409 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-220b005e-30cf-48c1-b8a1-29860ab80305 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:22.425824 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-220b005e-30cf-48c1-b8a1-29860ab80305 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:22.426566 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-220b005e-30cf-48c1-b8a1-29860ab80305 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:22.427140 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-220b005e-30cf-48c1-b8a1-29860ab80305 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:22.428337 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-220b005e-30cf-48c1-b8a1-29860ab80305 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:22.512175 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-b3cec110-534e-456d-8798-df040e0c5c3b req-578846e2-06b1-4321-9c5e-2fce8bd6e863 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3af57aa3-9dfb-436f-8b35-0ba727f4ceee", "name": "network-vif-plugged", "status": "completed", "tag": "029899f4-d7d1-4dce-bea8-98ad91749f24"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:56:22.528564 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-b3cec110-534e-456d-8798-df040e0c5c3b req-578846e2-06b1-4321-9c5e-2fce8bd6e863 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:22.529548 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-b3cec110-534e-456d-8798-df040e0c5c3b req-578846e2-06b1-4321-9c5e-2fce8bd6e863 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:22.530705 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-b3cec110-534e-456d-8798-df040e0c5c3b req-578846e2-06b1-4321-9c5e-2fce8bd6e863 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:22.546668 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-b3cec110-534e-456d-8798-df040e0c5c3b req-578846e2-06b1-4321-9c5e-2fce8bd6e863 service nova] Creating event network-vif-plugged:029899f4-d7d1-4dce-bea8-98ad91749f24 for instance 3af57aa3-9dfb-436f-8b35-0ba727f4ceee on n-h2-852278-4 Aug 27 02:56:22.553557 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-b3cec110-534e-456d-8798-df040e0c5c3b req-578846e2-06b1-4321-9c5e-2fce8bd6e863 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046151 Aug 27 02:56:22.554950 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1643/3282] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:56:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:56:22.561807 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-1f90ccb9-99ac-4e2c-a740-af8ea80cbc55 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:22.562670 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-1f90ccb9-99ac-4e2c-a740-af8ea80cbc55 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] [instance: 3af57aa3-9dfb-436f-8b35-0ba727f4ceee] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:22.572031 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1f90ccb9-99ac-4e2c-a740-af8ea80cbc55 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:22.573902 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1f90ccb9-99ac-4e2c-a740-af8ea80cbc55 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:22.575032 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1f90ccb9-99ac-4e2c-a740-af8ea80cbc55 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:22.594530 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1f90ccb9-99ac-4e2c-a740-af8ea80cbc55 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:22.595044 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1f90ccb9-99ac-4e2c-a740-af8ea80cbc55 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:22.595500 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1f90ccb9-99ac-4e2c-a740-af8ea80cbc55 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:22.696893 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=14 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:56:22.743578 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-220b005e-30cf-48c1-b8a1-29860ab80305 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b59cfb13dfa4dcbb96fa040cd11f4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33011ef842941b3a35988d66565e958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:22.759634 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-220b005e-30cf-48c1-b8a1-29860ab80305 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] 10.222.0.70 "GET /compute/v2.1/servers/bdbaaee4-171e-4fcc-82c9-8b52850aed4f" status: 200 len: 1324 microversion: 2.1 time: 0.347775 Aug 27 02:56:22.760615 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1640/3283] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:22 2022] GET /compute/v2.1/servers/bdbaaee4-171e-4fcc-82c9-8b52850aed4f => generated 1324 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:56:22.930492 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-1f90ccb9-99ac-4e2c-a740-af8ea80cbc55 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52807fd89d4048f3a0034cb270ba2e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '244b19609b60427c80601c033539a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:22.943417 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-1f90ccb9-99ac-4e2c-a740-af8ea80cbc55 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] 10.222.0.70 "GET /compute/v2.1/servers/3af57aa3-9dfb-436f-8b35-0ba727f4ceee" status: 200 len: 1320 microversion: 2.1 time: 0.386914 Aug 27 02:56:22.944144 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1644/3284] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:22 2022] GET /compute/v2.1/servers/3af57aa3-9dfb-436f-8b35-0ba727f4ceee => generated 1320 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:56:23.396965 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-34e478fa-0e76-4daf-bf54-b5000ad591f3 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:23.397685 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-34e478fa-0e76-4daf-bf54-b5000ad591f3 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] [instance: 3f31178a-8993-4aa6-8d41-496bfec13bec] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:23.405763 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-34e478fa-0e76-4daf-bf54-b5000ad591f3 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:23.407445 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-34e478fa-0e76-4daf-bf54-b5000ad591f3 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:23.408239 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-34e478fa-0e76-4daf-bf54-b5000ad591f3 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:23.409539 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-34e478fa-0e76-4daf-bf54-b5000ad591f3 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:23.410195 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-34e478fa-0e76-4daf-bf54-b5000ad591f3 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:23.410656 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-34e478fa-0e76-4daf-bf54-b5000ad591f3 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:23.558657 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.objects.instance [None req-34e478fa-0e76-4daf-bf54-b5000ad591f3 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lazy-loading 'services' on Instance uuid 3f31178a-8993-4aa6-8d41-496bfec13bec {{(pid=134051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:56:23.578462 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-34e478fa-0e76-4daf-bf54-b5000ad591f3 tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec" status: 200 len: 1935 microversion: 2.75 time: 0.186563 Aug 27 02:56:23.579388 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1641/3285] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:56:23 2022] GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec => generated 1935 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:56:23.783214 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e9835b4a-6f0d-4a0f-a921-041bbd3a45f4 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:23.783844 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-e9835b4a-6f0d-4a0f-a921-041bbd3a45f4 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] [instance: bdbaaee4-171e-4fcc-82c9-8b52850aed4f] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:23.792363 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e9835b4a-6f0d-4a0f-a921-041bbd3a45f4 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:23.792868 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e9835b4a-6f0d-4a0f-a921-041bbd3a45f4 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:23.793314 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e9835b4a-6f0d-4a0f-a921-041bbd3a45f4 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:23.794017 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e9835b4a-6f0d-4a0f-a921-041bbd3a45f4 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:23.794461 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e9835b4a-6f0d-4a0f-a921-041bbd3a45f4 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:23.798283 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e9835b4a-6f0d-4a0f-a921-041bbd3a45f4 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:23.964619 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-01f85b79-5a11-4e75-b731-65afedcf92b5 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:23.966175 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-01f85b79-5a11-4e75-b731-65afedcf92b5 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] [instance: 3af57aa3-9dfb-436f-8b35-0ba727f4ceee] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:23.972648 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-01f85b79-5a11-4e75-b731-65afedcf92b5 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:23.973450 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-01f85b79-5a11-4e75-b731-65afedcf92b5 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:23.974062 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-01f85b79-5a11-4e75-b731-65afedcf92b5 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:23.974772 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-01f85b79-5a11-4e75-b731-65afedcf92b5 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:23.975228 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-01f85b79-5a11-4e75-b731-65afedcf92b5 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:23.975653 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-01f85b79-5a11-4e75-b731-65afedcf92b5 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:24.062329 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-e9835b4a-6f0d-4a0f-a921-041bbd3a45f4 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b59cfb13dfa4dcbb96fa040cd11f4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33011ef842941b3a35988d66565e958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:24.072285 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e9835b4a-6f0d-4a0f-a921-041bbd3a45f4 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] 10.222.0.70 "GET /compute/v2.1/servers/bdbaaee4-171e-4fcc-82c9-8b52850aed4f" status: 200 len: 1324 microversion: 2.1 time: 0.292864 Aug 27 02:56:24.072984 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1645/3286] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:23 2022] GET /compute/v2.1/servers/bdbaaee4-171e-4fcc-82c9-8b52850aed4f => generated 1324 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:56:24.199991 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-01f85b79-5a11-4e75-b731-65afedcf92b5 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52807fd89d4048f3a0034cb270ba2e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '244b19609b60427c80601c033539a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:24.209628 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-01f85b79-5a11-4e75-b731-65afedcf92b5 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] 10.222.0.70 "GET /compute/v2.1/servers/3af57aa3-9dfb-436f-8b35-0ba727f4ceee" status: 200 len: 1320 microversion: 2.1 time: 0.248960 Aug 27 02:56:24.211264 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1642/3287] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:23 2022] GET /compute/v2.1/servers/3af57aa3-9dfb-436f-8b35-0ba727f4ceee => generated 1320 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:56:24.492695 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e3161f2c-8d31-4b1d-bff7-76c1f8713317 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:56:24.495146 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-e3161f2c-8d31-4b1d-bff7-76c1f8713317 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:24.501721 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e3161f2c-8d31-4b1d-bff7-76c1f8713317 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:24.502466 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e3161f2c-8d31-4b1d-bff7-76c1f8713317 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:24.502886 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e3161f2c-8d31-4b1d-bff7-76c1f8713317 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:24.503751 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e3161f2c-8d31-4b1d-bff7-76c1f8713317 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:24.504386 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e3161f2c-8d31-4b1d-bff7-76c1f8713317 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:24.504805 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e3161f2c-8d31-4b1d-bff7-76c1f8713317 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:24.563945 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:56:24.573984 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-8fbdcd14-3865-41a2-a7d4-537182567347 req-748eb9fb-7e8e-4533-bf53-3c71d2467327 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdbaaee4-171e-4fcc-82c9-8b52850aed4f", "name": "network-vif-plugged", "status": "completed", "tag": "7cfc9dfb-21e4-4db9-9e2c-8e6645c1bc57"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:56:24.600577 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-8fbdcd14-3865-41a2-a7d4-537182567347 req-748eb9fb-7e8e-4533-bf53-3c71d2467327 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:24.602908 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e3161f2c-8d31-4b1d-bff7-76c1f8713317 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "POST /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd/action" status: 202 len: 0 microversion: 2.1 time: 0.113348 Aug 27 02:56:24.603648 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-8fbdcd14-3865-41a2-a7d4-537182567347 req-748eb9fb-7e8e-4533-bf53-3c71d2467327 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:24.604833 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1646/3288] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 02:56:24 2022] POST /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:56:24.607476 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-8fbdcd14-3865-41a2-a7d4-537182567347 req-748eb9fb-7e8e-4533-bf53-3c71d2467327 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:24.612157 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-aad8e560-f8c4-4f91-a3ef-bd9da438623a tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:24.613166 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-aad8e560-f8c4-4f91-a3ef-bd9da438623a tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] [instance: 3f31178a-8993-4aa6-8d41-496bfec13bec] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:24.621516 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-aad8e560-f8c4-4f91-a3ef-bd9da438623a tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:24.622470 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-aad8e560-f8c4-4f91-a3ef-bd9da438623a tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:24.623238 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-aad8e560-f8c4-4f91-a3ef-bd9da438623a tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:24.624193 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-aad8e560-f8c4-4f91-a3ef-bd9da438623a tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:24.624735 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-aad8e560-f8c4-4f91-a3ef-bd9da438623a tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:24.625266 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-aad8e560-f8c4-4f91-a3ef-bd9da438623a tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:24.629003 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-8fbdcd14-3865-41a2-a7d4-537182567347 req-748eb9fb-7e8e-4533-bf53-3c71d2467327 service nova] Creating event network-vif-plugged:7cfc9dfb-21e4-4db9-9e2c-8e6645c1bc57 for instance bdbaaee4-171e-4fcc-82c9-8b52850aed4f on n-h1-852278-4 Aug 27 02:56:24.645459 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-8fbdcd14-3865-41a2-a7d4-537182567347 req-748eb9fb-7e8e-4533-bf53-3c71d2467327 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075098 Aug 27 02:56:24.650571 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1643/3289] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:56:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:56:24.665678 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-25eb9499-afc4-49e4-a84f-923f2847c2d7 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:24.667331 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-25eb9499-afc4-49e4-a84f-923f2847c2d7 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:24.676725 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-25eb9499-afc4-49e4-a84f-923f2847c2d7 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:24.677295 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-25eb9499-afc4-49e4-a84f-923f2847c2d7 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:24.678072 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-25eb9499-afc4-49e4-a84f-923f2847c2d7 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:24.678803 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-25eb9499-afc4-49e4-a84f-923f2847c2d7 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:24.679270 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-25eb9499-afc4-49e4-a84f-923f2847c2d7 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:24.679690 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-25eb9499-afc4-49e4-a84f-923f2847c2d7 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:24.755747 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.instance [None req-aad8e560-f8c4-4f91-a3ef-bd9da438623a tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] Lazy-loading 'services' on Instance uuid 3f31178a-8993-4aa6-8d41-496bfec13bec {{(pid=134052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:56:24.809083 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-aad8e560-f8c4-4f91-a3ef-bd9da438623a tempest-ServersAdmin275Test-1213673643 tempest-ServersAdmin275Test-1213673643-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec" status: 200 len: 1920 microversion: 2.75 time: 0.202451 Aug 27 02:56:24.810330 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1647/3290] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:56:24 2022] GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec => generated 1920 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:56:24.857517 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c9febf7e-a0f3-47e8-a03a-d84265233ff6 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:24.858029 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-c9febf7e-a0f3-47e8-a03a-d84265233ff6 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] [instance: 3f31178a-8993-4aa6-8d41-496bfec13bec] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:24.871238 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c9febf7e-a0f3-47e8-a03a-d84265233ff6 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:24.873262 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c9febf7e-a0f3-47e8-a03a-d84265233ff6 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:24.874855 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c9febf7e-a0f3-47e8-a03a-d84265233ff6 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:24.876028 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c9febf7e-a0f3-47e8-a03a-d84265233ff6 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:24.878173 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c9febf7e-a0f3-47e8-a03a-d84265233ff6 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:24.879331 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c9febf7e-a0f3-47e8-a03a-d84265233ff6 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:24.920951 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-c9febf7e-a0f3-47e8-a03a-d84265233ff6 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] [instance: 3f31178a-8993-4aa6-8d41-496bfec13bec] Going to try to terminate instance {{(pid=134052) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:56:25.004532 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-25eb9499-afc4-49e4-a84f-923f2847c2d7 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:25.021838 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-25eb9499-afc4-49e4-a84f-923f2847c2d7 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1670 microversion: 2.1 time: 0.367979 Aug 27 02:56:25.022782 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1644/3291] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:24 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1670 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:56:25.031569 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c9febf7e-a0f3-47e8-a03a-d84265233ff6 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] 10.222.0.70 "DELETE /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec" status: 204 len: 0 microversion: 2.75 time: 0.177944 Aug 27 02:56:25.036786 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1648/3292] 10.222.0.70 () {60 vars in 1280 bytes} [Sat Aug 27 02:56:24 2022] DELETE /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 27 02:56:25.043529 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-53adab4e-6bc8-4743-849a-f62348dfe35a tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:25.044927 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-53adab4e-6bc8-4743-849a-f62348dfe35a tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] [instance: 3f31178a-8993-4aa6-8d41-496bfec13bec] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:25.053464 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-53adab4e-6bc8-4743-849a-f62348dfe35a tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:25.053969 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-53adab4e-6bc8-4743-849a-f62348dfe35a tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:25.054412 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-53adab4e-6bc8-4743-849a-f62348dfe35a tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:25.055135 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-53adab4e-6bc8-4743-849a-f62348dfe35a tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:25.055585 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-53adab4e-6bc8-4743-849a-f62348dfe35a tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:25.056015 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-53adab4e-6bc8-4743-849a-f62348dfe35a tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:25.100461 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5fca0781-37b5-41a5-a085-99ac48594fad tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:25.112080 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-5fca0781-37b5-41a5-a085-99ac48594fad tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] [instance: bdbaaee4-171e-4fcc-82c9-8b52850aed4f] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:25.131946 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5fca0781-37b5-41a5-a085-99ac48594fad tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:25.132585 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5fca0781-37b5-41a5-a085-99ac48594fad tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:25.133099 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5fca0781-37b5-41a5-a085-99ac48594fad tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:25.134190 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5fca0781-37b5-41a5-a085-99ac48594fad tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:25.134723 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5fca0781-37b5-41a5-a085-99ac48594fad tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:25.135318 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5fca0781-37b5-41a5-a085-99ac48594fad tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:25.160828 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-53adab4e-6bc8-4743-849a-f62348dfe35a tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5097adbf553e4e319d2cb0cf383f587a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77abdb9b52614d1fbd6d70774a2df31f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:25.180877 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-53adab4e-6bc8-4743-849a-f62348dfe35a tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5097adbf553e4e319d2cb0cf383f587a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77abdb9b52614d1fbd6d70774a2df31f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:25.188256 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-53adab4e-6bc8-4743-849a-f62348dfe35a tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5097adbf553e4e319d2cb0cf383f587a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77abdb9b52614d1fbd6d70774a2df31f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:25.205683 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=100 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:56:25.212117 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-53adab4e-6bc8-4743-849a-f62348dfe35a tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] 10.222.0.70 "GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec" status: 200 len: 1444 microversion: 2.75 time: 0.174838 Aug 27 02:56:25.214306 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1645/3293] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:56:25 2022] GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec => generated 1444 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:56:25.235660 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b83d8f20-1849-4fe8-9cf8-f82f085cb6bd tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:25.246063 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b83d8f20-1849-4fe8-9cf8-f82f085cb6bd tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] [instance: 3af57aa3-9dfb-436f-8b35-0ba727f4ceee] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:25.256758 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b83d8f20-1849-4fe8-9cf8-f82f085cb6bd tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:25.257248 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b83d8f20-1849-4fe8-9cf8-f82f085cb6bd tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:25.257934 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b83d8f20-1849-4fe8-9cf8-f82f085cb6bd tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:25.258668 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b83d8f20-1849-4fe8-9cf8-f82f085cb6bd tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:25.259131 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b83d8f20-1849-4fe8-9cf8-f82f085cb6bd tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:25.260254 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b83d8f20-1849-4fe8-9cf8-f82f085cb6bd tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:25.448089 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-5fca0781-37b5-41a5-a085-99ac48594fad tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b59cfb13dfa4dcbb96fa040cd11f4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33011ef842941b3a35988d66565e958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:25.457737 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-5fca0781-37b5-41a5-a085-99ac48594fad tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] 10.222.0.70 "GET /compute/v2.1/servers/bdbaaee4-171e-4fcc-82c9-8b52850aed4f" status: 200 len: 1324 microversion: 2.1 time: 0.362275 Aug 27 02:56:25.458333 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1649/3294] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:25 2022] GET /compute/v2.1/servers/bdbaaee4-171e-4fcc-82c9-8b52850aed4f => generated 1324 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:56:25.479749 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-b83d8f20-1849-4fe8-9cf8-f82f085cb6bd tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52807fd89d4048f3a0034cb270ba2e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '244b19609b60427c80601c033539a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:25.487758 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b83d8f20-1849-4fe8-9cf8-f82f085cb6bd tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] 10.222.0.70 "GET /compute/v2.1/servers/3af57aa3-9dfb-436f-8b35-0ba727f4ceee" status: 200 len: 1508 microversion: 2.1 time: 0.256495 Aug 27 02:56:25.488339 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1646/3295] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:25 2022] GET /compute/v2.1/servers/3af57aa3-9dfb-436f-8b35-0ba727f4ceee => generated 1508 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:56:25.508978 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a38ac03b-98af-4375-b8e7-c665aaa0c34b tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:25.509650 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a38ac03b-98af-4375-b8e7-c665aaa0c34b tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] [instance: c5baad75-87d5-4a3f-b3f8-73ca40b9781a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:25.516106 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a38ac03b-98af-4375-b8e7-c665aaa0c34b tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:25.516626 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a38ac03b-98af-4375-b8e7-c665aaa0c34b tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:25.517253 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a38ac03b-98af-4375-b8e7-c665aaa0c34b tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:25.517965 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a38ac03b-98af-4375-b8e7-c665aaa0c34b tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:25.518415 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a38ac03b-98af-4375-b8e7-c665aaa0c34b tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:25.518869 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a38ac03b-98af-4375-b8e7-c665aaa0c34b tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:25.719172 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-a38ac03b-98af-4375-b8e7-c665aaa0c34b tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52807fd89d4048f3a0034cb270ba2e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '244b19609b60427c80601c033539a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:25.727158 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a38ac03b-98af-4375-b8e7-c665aaa0c34b tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] 10.222.0.70 "GET /compute/v2.1/servers/c5baad75-87d5-4a3f-b3f8-73ca40b9781a" status: 200 len: 1320 microversion: 2.1 time: 0.222169 Aug 27 02:56:25.727818 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1650/3296] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:25 2022] GET /compute/v2.1/servers/c5baad75-87d5-4a3f-b3f8-73ca40b9781a => generated 1320 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:56:26.045839 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f07a6b20-5e91-4295-aaad-477cd8f2a6cd tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:26.046714 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-f07a6b20-5e91-4295-aaad-477cd8f2a6cd tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:26.055554 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f07a6b20-5e91-4295-aaad-477cd8f2a6cd tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:26.056028 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f07a6b20-5e91-4295-aaad-477cd8f2a6cd tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:26.057028 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f07a6b20-5e91-4295-aaad-477cd8f2a6cd tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:26.057747 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f07a6b20-5e91-4295-aaad-477cd8f2a6cd tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:26.058195 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f07a6b20-5e91-4295-aaad-477cd8f2a6cd tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:26.058613 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f07a6b20-5e91-4295-aaad-477cd8f2a6cd tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:26.209978 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-f07a6b20-5e91-4295-aaad-477cd8f2a6cd tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:26.219021 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-f07a6b20-5e91-4295-aaad-477cd8f2a6cd tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1670 microversion: 2.1 time: 0.177031 Aug 27 02:56:26.219670 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1647/3297] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:26 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1670 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:56:26.245469 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f606ddee-21a5-41d1-8953-d4e296869971 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:26.246055 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-f606ddee-21a5-41d1-8953-d4e296869971 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] [instance: 3f31178a-8993-4aa6-8d41-496bfec13bec] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:26.253895 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f606ddee-21a5-41d1-8953-d4e296869971 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:26.254387 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f606ddee-21a5-41d1-8953-d4e296869971 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:26.254833 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f606ddee-21a5-41d1-8953-d4e296869971 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:26.255525 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f606ddee-21a5-41d1-8953-d4e296869971 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:26.255973 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f606ddee-21a5-41d1-8953-d4e296869971 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:26.256547 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f606ddee-21a5-41d1-8953-d4e296869971 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:26.325425 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-f606ddee-21a5-41d1-8953-d4e296869971 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5097adbf553e4e319d2cb0cf383f587a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77abdb9b52614d1fbd6d70774a2df31f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:26.334350 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-f606ddee-21a5-41d1-8953-d4e296869971 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5097adbf553e4e319d2cb0cf383f587a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77abdb9b52614d1fbd6d70774a2df31f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:26.335918 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-f606ddee-21a5-41d1-8953-d4e296869971 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5097adbf553e4e319d2cb0cf383f587a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77abdb9b52614d1fbd6d70774a2df31f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:26.342340 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f606ddee-21a5-41d1-8953-d4e296869971 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] 10.222.0.70 "GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec" status: 200 len: 1444 microversion: 2.75 time: 0.101122 Aug 27 02:56:26.343041 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1651/3298] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:56:26 2022] GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec => generated 1444 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:56:26.482539 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-2e01fcc5-9424-4008-b520-fe98e6b6107c tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:26.483804 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-2e01fcc5-9424-4008-b520-fe98e6b6107c tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] [instance: bdbaaee4-171e-4fcc-82c9-8b52850aed4f] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:26.490229 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2e01fcc5-9424-4008-b520-fe98e6b6107c tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:26.490720 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2e01fcc5-9424-4008-b520-fe98e6b6107c tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:26.491156 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2e01fcc5-9424-4008-b520-fe98e6b6107c tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:26.491850 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2e01fcc5-9424-4008-b520-fe98e6b6107c tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:26.492410 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2e01fcc5-9424-4008-b520-fe98e6b6107c tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:26.492769 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2e01fcc5-9424-4008-b520-fe98e6b6107c tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:26.637841 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-2e01fcc5-9424-4008-b520-fe98e6b6107c tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b59cfb13dfa4dcbb96fa040cd11f4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33011ef842941b3a35988d66565e958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:26.646930 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-2e01fcc5-9424-4008-b520-fe98e6b6107c tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] 10.222.0.70 "GET /compute/v2.1/servers/bdbaaee4-171e-4fcc-82c9-8b52850aed4f" status: 200 len: 1324 microversion: 2.1 time: 0.169838 Aug 27 02:56:26.648264 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1648/3299] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:26 2022] GET /compute/v2.1/servers/bdbaaee4-171e-4fcc-82c9-8b52850aed4f => generated 1324 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:56:26.673733 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-0383b700-2a2e-41d5-acb1-a4ec6b24321b req-0e4e9d70-1b59-4bf5-9e44-27b5cb485f74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5baad75-87d5-4a3f-b3f8-73ca40b9781a", "name": "network-vif-plugged", "status": "completed", "tag": "998bb2bb-d0ab-40ee-b888-9cc7df69e539"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:56:26.688013 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-0383b700-2a2e-41d5-acb1-a4ec6b24321b req-0e4e9d70-1b59-4bf5-9e44-27b5cb485f74 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:26.688593 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-0383b700-2a2e-41d5-acb1-a4ec6b24321b req-0e4e9d70-1b59-4bf5-9e44-27b5cb485f74 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:26.689088 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-0383b700-2a2e-41d5-acb1-a4ec6b24321b req-0e4e9d70-1b59-4bf5-9e44-27b5cb485f74 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:26.704390 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-0383b700-2a2e-41d5-acb1-a4ec6b24321b req-0e4e9d70-1b59-4bf5-9e44-27b5cb485f74 service nova] Creating event network-vif-plugged:998bb2bb-d0ab-40ee-b888-9cc7df69e539 for instance c5baad75-87d5-4a3f-b3f8-73ca40b9781a on n-h1-852278-4 Aug 27 02:56:26.711234 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-0383b700-2a2e-41d5-acb1-a4ec6b24321b req-0e4e9d70-1b59-4bf5-9e44-27b5cb485f74 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042312 Aug 27 02:56:26.712229 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1652/3300] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:56:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:56:26.749897 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4af5b5d9-b9da-48ae-a819-dff76f2651b6 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:26.750560 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-4af5b5d9-b9da-48ae-a819-dff76f2651b6 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] [instance: c5baad75-87d5-4a3f-b3f8-73ca40b9781a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:26.757356 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4af5b5d9-b9da-48ae-a819-dff76f2651b6 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:26.757868 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4af5b5d9-b9da-48ae-a819-dff76f2651b6 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:26.758320 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4af5b5d9-b9da-48ae-a819-dff76f2651b6 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:26.759029 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4af5b5d9-b9da-48ae-a819-dff76f2651b6 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:26.759587 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4af5b5d9-b9da-48ae-a819-dff76f2651b6 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:26.760066 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4af5b5d9-b9da-48ae-a819-dff76f2651b6 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:26.913885 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-4af5b5d9-b9da-48ae-a819-dff76f2651b6 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52807fd89d4048f3a0034cb270ba2e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '244b19609b60427c80601c033539a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:26.927078 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-4af5b5d9-b9da-48ae-a819-dff76f2651b6 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] 10.222.0.70 "GET /compute/v2.1/servers/c5baad75-87d5-4a3f-b3f8-73ca40b9781a" status: 200 len: 1320 microversion: 2.1 time: 0.182491 Aug 27 02:56:26.928398 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1649/3301] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:26 2022] GET /compute/v2.1/servers/c5baad75-87d5-4a3f-b3f8-73ca40b9781a => generated 1320 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:56:27.242027 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a708527c-3ab3-451d-afd6-24a6bcd37690 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:27.242753 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a708527c-3ab3-451d-afd6-24a6bcd37690 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:27.249894 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a708527c-3ab3-451d-afd6-24a6bcd37690 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:27.250508 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a708527c-3ab3-451d-afd6-24a6bcd37690 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:27.250792 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a708527c-3ab3-451d-afd6-24a6bcd37690 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:27.251486 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a708527c-3ab3-451d-afd6-24a6bcd37690 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:27.251928 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a708527c-3ab3-451d-afd6-24a6bcd37690 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:27.252446 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a708527c-3ab3-451d-afd6-24a6bcd37690 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:27.368822 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-5d717a96-b93f-4f48-806e-fce40801ee64 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:27.369582 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-5d717a96-b93f-4f48-806e-fce40801ee64 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] [instance: 3f31178a-8993-4aa6-8d41-496bfec13bec] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:27.378143 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5d717a96-b93f-4f48-806e-fce40801ee64 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:27.378767 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5d717a96-b93f-4f48-806e-fce40801ee64 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:27.379306 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5d717a96-b93f-4f48-806e-fce40801ee64 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:27.380083 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5d717a96-b93f-4f48-806e-fce40801ee64 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:27.380635 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5d717a96-b93f-4f48-806e-fce40801ee64 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:27.381124 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5d717a96-b93f-4f48-806e-fce40801ee64 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:27.401116 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-a708527c-3ab3-451d-afd6-24a6bcd37690 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:27.409992 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a708527c-3ab3-451d-afd6-24a6bcd37690 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1670 microversion: 2.1 time: 0.172281 Aug 27 02:56:27.420163 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1653/3302] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:27 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1670 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:56:27.474540 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-5d717a96-b93f-4f48-806e-fce40801ee64 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5097adbf553e4e319d2cb0cf383f587a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77abdb9b52614d1fbd6d70774a2df31f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:27.486143 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-5d717a96-b93f-4f48-806e-fce40801ee64 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5097adbf553e4e319d2cb0cf383f587a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77abdb9b52614d1fbd6d70774a2df31f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:27.487696 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-5d717a96-b93f-4f48-806e-fce40801ee64 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5097adbf553e4e319d2cb0cf383f587a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77abdb9b52614d1fbd6d70774a2df31f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:27.500466 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-5d717a96-b93f-4f48-806e-fce40801ee64 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] 10.222.0.70 "GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec" status: 200 len: 1444 microversion: 2.75 time: 0.129388 Aug 27 02:56:27.511657 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1650/3303] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:56:27 2022] GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec => generated 1444 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:56:27.669446 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5fe43868-4214-4e6b-942d-95709a6632a1 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:27.669979 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-5fe43868-4214-4e6b-942d-95709a6632a1 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] [instance: bdbaaee4-171e-4fcc-82c9-8b52850aed4f] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:27.678529 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5fe43868-4214-4e6b-942d-95709a6632a1 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:27.679010 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5fe43868-4214-4e6b-942d-95709a6632a1 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:27.679443 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5fe43868-4214-4e6b-942d-95709a6632a1 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:27.680136 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5fe43868-4214-4e6b-942d-95709a6632a1 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:27.680620 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5fe43868-4214-4e6b-942d-95709a6632a1 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:27.681037 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5fe43868-4214-4e6b-942d-95709a6632a1 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:27.813872 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-5fe43868-4214-4e6b-942d-95709a6632a1 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b59cfb13dfa4dcbb96fa040cd11f4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33011ef842941b3a35988d66565e958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:27.822514 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-5fe43868-4214-4e6b-942d-95709a6632a1 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] 10.222.0.70 "GET /compute/v2.1/servers/bdbaaee4-171e-4fcc-82c9-8b52850aed4f" status: 200 len: 1521 microversion: 2.1 time: 0.157168 Aug 27 02:56:27.823087 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1654/3304] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:27 2022] GET /compute/v2.1/servers/bdbaaee4-171e-4fcc-82c9-8b52850aed4f => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:56:27.843615 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4d2948d7-f052-4376-9148-16af70dcf99a tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:27.844222 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-4d2948d7-f052-4376-9148-16af70dcf99a tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] [instance: bdbaaee4-171e-4fcc-82c9-8b52850aed4f] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:27.850400 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4d2948d7-f052-4376-9148-16af70dcf99a tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:27.850958 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4d2948d7-f052-4376-9148-16af70dcf99a tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:27.851363 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4d2948d7-f052-4376-9148-16af70dcf99a tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:27.852046 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4d2948d7-f052-4376-9148-16af70dcf99a tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:27.852518 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4d2948d7-f052-4376-9148-16af70dcf99a tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:27.852936 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4d2948d7-f052-4376-9148-16af70dcf99a tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:27.856676 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=100 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:56:27.880729 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-4d2948d7-f052-4376-9148-16af70dcf99a tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] HTTP exception thrown: Action 999 not found Aug 27 02:56:27.889864 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4d2948d7-f052-4376-9148-16af70dcf99a tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Request method failure captured: Aug 27 02:56:27.889864 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/bdbaaee4-171e-4fcc-82c9-8b52850aed4f/os-instance-actions/999 HTTP/1.1 Aug 27 02:56:27.889864 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:56:27.889864 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:56:27.889864 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:56:27.889864 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:56:27.889864 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:56:27.889864 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:56:27.889864 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:56:27.889864 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:56:27.889864 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYfHggg92h80i2AOtBCMbaPj_8trT0g_CvtvQdScRZK20TKwPPG_pZcperciOaX8jvzTDUvZq1FAXCyOkvKsIRHJWS1ttKESOD8yEN8A7tm8bLiZnynoVXDo3nlDxiDNIUaPQPILWQoCKUEtbPFJXI0Up7a_tBescGriHPa9jfGTuH8 Aug 27 02:56:27.889864 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:56:27.889864 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:56:27.889864 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:56:27.889864 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:56:27.889864 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:56:27.889864 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:56:27.889864 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: e33011ef842941b3a35988d66565e958 Aug 27 02:56:27.889864 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-827574272 Aug 27 02:56:27.889864 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:56:27.889864 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:56:27.889864 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e33011ef842941b3a35988d66565e958"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_e33011ef842941b3a35988d66565e958", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e33011ef842941b3a35988d66565e958"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/e33011ef842941b3a35988d66565e958"}]}] Aug 27 02:56:27.889864 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-827574272 Aug 27 02:56:27.889864 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: e33011ef842941b3a35988d66565e958 Aug 27 02:56:27.889864 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-827574272 Aug 27 02:56:27.889864 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-InstanceActionsNegativeTestJSON-827574272-project Aug 27 02:56:27.889864 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:56:27.889864 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:56:27.889864 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 6b59cfb13dfa4dcbb96fa040cd11f4c4 Aug 27 02:56:27.889864 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-827574272-project Aug 27 02:56:27.889864 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 02:56:27.889864 n-d-852278-4 devstack@n-api.service[134051]: exception: Action 999 not found Aug 27 02:56:27.889864 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'server_id': 'bdbaaee4-171e-4fcc-82c9-8b52850aed4f', 'id': '999'} Aug 27 02:56:27.889864 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:56:27.889864 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:56:27.889864 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:56:27.889864 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:56:27.889864 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:56:27.889864 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:56:27.889864 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:56:27.889864 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:56:27.889864 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Aug 27 02:56:27.889864 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 27 02:56:27.889864 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Aug 27 02:56:27.889864 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:56:27.889864 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:56:27.889864 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:56:27.889864 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:56:27.889864 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:56:27.889864 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:56:27.889864 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:56:27.889864 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:56:27.889864 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Aug 27 02:56:27.889864 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:56:27.894088 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4d2948d7-f052-4376-9148-16af70dcf99a tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Returning 404 to user: Action 999 not found {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:56:27.894088 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-4d2948d7-f052-4376-9148-16af70dcf99a tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] 10.222.0.70 "GET /compute/v2.1/servers/bdbaaee4-171e-4fcc-82c9-8b52850aed4f/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.051659 Aug 27 02:56:27.894088 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1651/3305] 10.222.0.70 () {58 vars in 1308 bytes} [Sat Aug 27 02:56:27 2022] GET /compute/v2.1/servers/bdbaaee4-171e-4fcc-82c9-8b52850aed4f/os-instance-actions/999 => generated 66 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 02:56:27.901414 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3c5b6588-6e47-40f0-bb64-a1490b4cd2d3 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Calling method '.version_select at 0x7f5ee2f59550>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:27.902060 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-3c5b6588-6e47-40f0-bb64-a1490b4cd2d3 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] [instance: 065a943f-f31a-417d-8632-59824fabc60d] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:27.907855 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-3c5b6588-6e47-40f0-bb64-a1490b4cd2d3 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] HTTP exception thrown: Instance 065a943f-f31a-417d-8632-59824fabc60d could not be found. Aug 27 02:56:27.909894 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3c5b6588-6e47-40f0-bb64-a1490b4cd2d3 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Request method failure captured: Aug 27 02:56:27.909894 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/servers/065a943f-f31a-417d-8632-59824fabc60d/os-instance-actions HTTP/1.1 Aug 27 02:56:27.909894 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:56:27.909894 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:56:27.909894 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:56:27.909894 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:56:27.909894 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:56:27.909894 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:56:27.909894 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:56:27.909894 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:56:27.909894 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYfHggg92h80i2AOtBCMbaPj_8trT0g_CvtvQdScRZK20TKwPPG_pZcperciOaX8jvzTDUvZq1FAXCyOkvKsIRHJWS1ttKESOD8yEN8A7tm8bLiZnynoVXDo3nlDxiDNIUaPQPILWQoCKUEtbPFJXI0Up7a_tBescGriHPa9jfGTuH8 Aug 27 02:56:27.909894 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:56:27.909894 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:56:27.909894 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:56:27.909894 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:56:27.909894 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:56:27.909894 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:56:27.909894 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: e33011ef842941b3a35988d66565e958 Aug 27 02:56:27.909894 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-827574272 Aug 27 02:56:27.909894 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:56:27.909894 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:56:27.909894 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e33011ef842941b3a35988d66565e958"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_e33011ef842941b3a35988d66565e958", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e33011ef842941b3a35988d66565e958"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/e33011ef842941b3a35988d66565e958"}]}] Aug 27 02:56:27.909894 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-827574272 Aug 27 02:56:27.909894 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: e33011ef842941b3a35988d66565e958 Aug 27 02:56:27.909894 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-827574272 Aug 27 02:56:27.909894 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-InstanceActionsNegativeTestJSON-827574272-project Aug 27 02:56:27.909894 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:56:27.909894 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:56:27.909894 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 6b59cfb13dfa4dcbb96fa040cd11f4c4 Aug 27 02:56:27.909894 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-827574272-project Aug 27 02:56:27.909894 n-d-852278-4 devstack@n-api.service[134052]: method: Aug 27 02:56:27.909894 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance 065a943f-f31a-417d-8632-59824fabc60d could not be found. Aug 27 02:56:27.909894 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'server_id': '065a943f-f31a-417d-8632-59824fabc60d'} Aug 27 02:56:27.909894 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:56:27.909894 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:56:27.909894 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:56:27.909894 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:56:27.909894 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:56:27.909894 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:56:27.909894 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 02:56:27.909894 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 02:56:27.909894 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 065a943f-f31a-417d-8632-59824fabc60d could not be found. Aug 27 02:56:27.909894 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:56:27.909894 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:56:27.909894 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:56:27.909894 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:56:27.909894 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:56:27.909894 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:56:27.909894 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:56:27.909894 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:56:27.909894 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:56:27.909894 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:56:27.909894 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:56:27.909894 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:56:27.909894 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Aug 27 02:56:27.909894 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Aug 27 02:56:27.909894 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:56:27.909894 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:56:27.909894 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Aug 27 02:56:27.909894 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Aug 27 02:56:27.909894 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:56:27.909894 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:56:27.915169 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 065a943f-f31a-417d-8632-59824fabc60d could not be found. Aug 27 02:56:27.915169 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:56:27.915169 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:56:27.915169 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:56:27.915169 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:56:27.915169 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:56:27.915169 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:56:27.915169 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:56:27.915169 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:56:27.915169 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 065a943f-f31a-417d-8632-59824fabc60d could not be found. Aug 27 02:56:27.915169 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:56:27.915169 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3c5b6588-6e47-40f0-bb64-a1490b4cd2d3 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Returning 404 to user: Instance 065a943f-f31a-417d-8632-59824fabc60d could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:56:27.915169 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-3c5b6588-6e47-40f0-bb64-a1490b4cd2d3 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] 10.222.0.70 "GET /compute/v2.1/servers/065a943f-f31a-417d-8632-59824fabc60d/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.014768 Aug 27 02:56:27.915169 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1655/3306] 10.222.0.70 () {58 vars in 1296 bytes} [Sat Aug 27 02:56:27 2022] GET /compute/v2.1/servers/065a943f-f31a-417d-8632-59824fabc60d/os-instance-actions => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:56:27.923055 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-32533c86-a113-4185-bfd4-d24468f7f14e tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:27.923641 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-32533c86-a113-4185-bfd4-d24468f7f14e tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] [instance: bdbaaee4-171e-4fcc-82c9-8b52850aed4f] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:27.930411 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-32533c86-a113-4185-bfd4-d24468f7f14e tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:27.930900 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-32533c86-a113-4185-bfd4-d24468f7f14e tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:27.931337 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-32533c86-a113-4185-bfd4-d24468f7f14e tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:27.932041 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-32533c86-a113-4185-bfd4-d24468f7f14e tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:27.932534 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-32533c86-a113-4185-bfd4-d24468f7f14e tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:27.932974 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-32533c86-a113-4185-bfd4-d24468f7f14e tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:27.949233 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a01e33ee-db99-4bb9-9660-93a5a00ddb53 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:27.950008 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a01e33ee-db99-4bb9-9660-93a5a00ddb53 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] [instance: c5baad75-87d5-4a3f-b3f8-73ca40b9781a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:27.953047 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:56:27.958259 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a01e33ee-db99-4bb9-9660-93a5a00ddb53 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:27.958919 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a01e33ee-db99-4bb9-9660-93a5a00ddb53 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:27.959358 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a01e33ee-db99-4bb9-9660-93a5a00ddb53 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:27.960019 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-32533c86-a113-4185-bfd4-d24468f7f14e tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] [instance: bdbaaee4-171e-4fcc-82c9-8b52850aed4f] Going to try to terminate instance {{(pid=134051) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:56:27.960886 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a01e33ee-db99-4bb9-9660-93a5a00ddb53 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:27.961345 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a01e33ee-db99-4bb9-9660-93a5a00ddb53 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:27.961761 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a01e33ee-db99-4bb9-9660-93a5a00ddb53 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:28.052487 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-32533c86-a113-4185-bfd4-d24468f7f14e tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] 10.222.0.70 "DELETE /compute/v2.1/servers/bdbaaee4-171e-4fcc-82c9-8b52850aed4f" status: 204 len: 0 microversion: 2.1 time: 0.132789 Aug 27 02:56:28.054633 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1652/3307] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:56:27 2022] DELETE /compute/v2.1/servers/bdbaaee4-171e-4fcc-82c9-8b52850aed4f => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:56:28.063430 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8804efbe-9907-43f8-a445-25fa8286ab48 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:28.064482 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-8804efbe-9907-43f8-a445-25fa8286ab48 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] [instance: bdbaaee4-171e-4fcc-82c9-8b52850aed4f] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:28.071650 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8804efbe-9907-43f8-a445-25fa8286ab48 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:28.072300 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8804efbe-9907-43f8-a445-25fa8286ab48 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:28.072894 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8804efbe-9907-43f8-a445-25fa8286ab48 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:28.073693 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8804efbe-9907-43f8-a445-25fa8286ab48 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:28.074914 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8804efbe-9907-43f8-a445-25fa8286ab48 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:28.075224 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8804efbe-9907-43f8-a445-25fa8286ab48 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:28.117828 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-a01e33ee-db99-4bb9-9660-93a5a00ddb53 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52807fd89d4048f3a0034cb270ba2e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '244b19609b60427c80601c033539a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:28.127278 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a01e33ee-db99-4bb9-9660-93a5a00ddb53 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] 10.222.0.70 "GET /compute/v2.1/servers/c5baad75-87d5-4a3f-b3f8-73ca40b9781a" status: 200 len: 1320 microversion: 2.1 time: 0.182275 Aug 27 02:56:28.135594 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1656/3308] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:27 2022] GET /compute/v2.1/servers/c5baad75-87d5-4a3f-b3f8-73ca40b9781a => generated 1320 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:56:28.217190 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-8804efbe-9907-43f8-a445-25fa8286ab48 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b59cfb13dfa4dcbb96fa040cd11f4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33011ef842941b3a35988d66565e958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:28.225345 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-8804efbe-9907-43f8-a445-25fa8286ab48 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] 10.222.0.70 "GET /compute/v2.1/servers/bdbaaee4-171e-4fcc-82c9-8b52850aed4f" status: 200 len: 1527 microversion: 2.1 time: 0.166560 Aug 27 02:56:28.225909 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1653/3309] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:28 2022] GET /compute/v2.1/servers/bdbaaee4-171e-4fcc-82c9-8b52850aed4f => generated 1527 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:56:28.433443 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-33c58d33-3293-4392-90e4-d0f8e58b9584 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:28.434175 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-33c58d33-3293-4392-90e4-d0f8e58b9584 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:28.441403 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-33c58d33-3293-4392-90e4-d0f8e58b9584 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:28.441889 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-33c58d33-3293-4392-90e4-d0f8e58b9584 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:28.442317 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-33c58d33-3293-4392-90e4-d0f8e58b9584 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:28.443010 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-33c58d33-3293-4392-90e4-d0f8e58b9584 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:28.443449 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-33c58d33-3293-4392-90e4-d0f8e58b9584 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:28.443866 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-33c58d33-3293-4392-90e4-d0f8e58b9584 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:28.530397 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8d9b31df-50b0-4347-bf10-826c67b42f0f tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:28.531709 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-8d9b31df-50b0-4347-bf10-826c67b42f0f tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] [instance: 3f31178a-8993-4aa6-8d41-496bfec13bec] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:28.538835 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8d9b31df-50b0-4347-bf10-826c67b42f0f tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:28.539312 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8d9b31df-50b0-4347-bf10-826c67b42f0f tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:28.539751 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8d9b31df-50b0-4347-bf10-826c67b42f0f tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:28.540700 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8d9b31df-50b0-4347-bf10-826c67b42f0f tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:28.541163 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8d9b31df-50b0-4347-bf10-826c67b42f0f tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:28.541798 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8d9b31df-50b0-4347-bf10-826c67b42f0f tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:28.578845 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-33c58d33-3293-4392-90e4-d0f8e58b9584 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:28.587104 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-33c58d33-3293-4392-90e4-d0f8e58b9584 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1675 microversion: 2.1 time: 0.157684 Aug 27 02:56:28.596663 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1657/3310] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:28 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1675 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:56:28.608213 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-8d9b31df-50b0-4347-bf10-826c67b42f0f tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5097adbf553e4e319d2cb0cf383f587a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77abdb9b52614d1fbd6d70774a2df31f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:28.621113 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-8d9b31df-50b0-4347-bf10-826c67b42f0f tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5097adbf553e4e319d2cb0cf383f587a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77abdb9b52614d1fbd6d70774a2df31f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:28.623441 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-8d9b31df-50b0-4347-bf10-826c67b42f0f tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5097adbf553e4e319d2cb0cf383f587a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77abdb9b52614d1fbd6d70774a2df31f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:28.630543 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-8d9b31df-50b0-4347-bf10-826c67b42f0f tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] 10.222.0.70 "GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec" status: 200 len: 1444 microversion: 2.75 time: 0.104272 Aug 27 02:56:28.631388 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1654/3311] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:56:28 2022] GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec => generated 1444 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:56:29.148145 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-69ba7a9b-eaa1-4a31-95c3-30e6c82578f9 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:29.148791 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-69ba7a9b-eaa1-4a31-95c3-30e6c82578f9 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] [instance: c5baad75-87d5-4a3f-b3f8-73ca40b9781a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:29.155760 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-69ba7a9b-eaa1-4a31-95c3-30e6c82578f9 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:29.156337 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-69ba7a9b-eaa1-4a31-95c3-30e6c82578f9 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:29.156826 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-69ba7a9b-eaa1-4a31-95c3-30e6c82578f9 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:29.157525 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-69ba7a9b-eaa1-4a31-95c3-30e6c82578f9 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:29.157981 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-69ba7a9b-eaa1-4a31-95c3-30e6c82578f9 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:29.158673 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-69ba7a9b-eaa1-4a31-95c3-30e6c82578f9 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:29.246503 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-787e733d-a63c-48d5-a0ab-61cd0c7868d9 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:29.247109 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-787e733d-a63c-48d5-a0ab-61cd0c7868d9 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] [instance: bdbaaee4-171e-4fcc-82c9-8b52850aed4f] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:29.253805 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-787e733d-a63c-48d5-a0ab-61cd0c7868d9 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:29.254282 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-787e733d-a63c-48d5-a0ab-61cd0c7868d9 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:29.254708 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-787e733d-a63c-48d5-a0ab-61cd0c7868d9 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:29.255426 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-787e733d-a63c-48d5-a0ab-61cd0c7868d9 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:29.255871 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-787e733d-a63c-48d5-a0ab-61cd0c7868d9 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:29.256359 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-787e733d-a63c-48d5-a0ab-61cd0c7868d9 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:29.349966 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-69ba7a9b-eaa1-4a31-95c3-30e6c82578f9 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52807fd89d4048f3a0034cb270ba2e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '244b19609b60427c80601c033539a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:29.358375 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-69ba7a9b-eaa1-4a31-95c3-30e6c82578f9 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] 10.222.0.70 "GET /compute/v2.1/servers/c5baad75-87d5-4a3f-b3f8-73ca40b9781a" status: 200 len: 1320 microversion: 2.1 time: 0.214243 Aug 27 02:56:29.359235 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1658/3312] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:29 2022] GET /compute/v2.1/servers/c5baad75-87d5-4a3f-b3f8-73ca40b9781a => generated 1320 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:56:29.411967 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-787e733d-a63c-48d5-a0ab-61cd0c7868d9 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b59cfb13dfa4dcbb96fa040cd11f4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33011ef842941b3a35988d66565e958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:29.420364 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-787e733d-a63c-48d5-a0ab-61cd0c7868d9 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] 10.222.0.70 "GET /compute/v2.1/servers/bdbaaee4-171e-4fcc-82c9-8b52850aed4f" status: 200 len: 1527 microversion: 2.1 time: 0.178014 Aug 27 02:56:29.420940 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1655/3313] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:29 2022] GET /compute/v2.1/servers/bdbaaee4-171e-4fcc-82c9-8b52850aed4f => generated 1527 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:56:29.609689 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f5a6d0d9-74d5-419f-8f1f-161e24fc3ee7 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:29.610283 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-f5a6d0d9-74d5-419f-8f1f-161e24fc3ee7 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:29.624954 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f5a6d0d9-74d5-419f-8f1f-161e24fc3ee7 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:29.625441 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f5a6d0d9-74d5-419f-8f1f-161e24fc3ee7 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:29.625875 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f5a6d0d9-74d5-419f-8f1f-161e24fc3ee7 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:29.626611 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f5a6d0d9-74d5-419f-8f1f-161e24fc3ee7 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:29.627050 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f5a6d0d9-74d5-419f-8f1f-161e24fc3ee7 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:29.627469 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f5a6d0d9-74d5-419f-8f1f-161e24fc3ee7 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:29.662575 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7ef39baa-fbbe-4264-b0ce-b1930e292263 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:29.663328 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-7ef39baa-fbbe-4264-b0ce-b1930e292263 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] [instance: 3f31178a-8993-4aa6-8d41-496bfec13bec] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:29.672422 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7ef39baa-fbbe-4264-b0ce-b1930e292263 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:29.672777 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7ef39baa-fbbe-4264-b0ce-b1930e292263 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:29.673439 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7ef39baa-fbbe-4264-b0ce-b1930e292263 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:29.674418 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7ef39baa-fbbe-4264-b0ce-b1930e292263 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:29.674875 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7ef39baa-fbbe-4264-b0ce-b1930e292263 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:29.675314 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7ef39baa-fbbe-4264-b0ce-b1930e292263 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:29.761305 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-7ef39baa-fbbe-4264-b0ce-b1930e292263 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5097adbf553e4e319d2cb0cf383f587a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77abdb9b52614d1fbd6d70774a2df31f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:29.770801 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-7ef39baa-fbbe-4264-b0ce-b1930e292263 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5097adbf553e4e319d2cb0cf383f587a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77abdb9b52614d1fbd6d70774a2df31f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:29.772288 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-7ef39baa-fbbe-4264-b0ce-b1930e292263 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5097adbf553e4e319d2cb0cf383f587a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77abdb9b52614d1fbd6d70774a2df31f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:29.778167 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-7ef39baa-fbbe-4264-b0ce-b1930e292263 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] 10.222.0.70 "GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec" status: 200 len: 1444 microversion: 2.75 time: 0.119637 Aug 27 02:56:29.779115 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1656/3314] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:56:29 2022] GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec => generated 1444 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:56:29.802442 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-f5a6d0d9-74d5-419f-8f1f-161e24fc3ee7 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:29.811369 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f5a6d0d9-74d5-419f-8f1f-161e24fc3ee7 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1675 microversion: 2.1 time: 0.205639 Aug 27 02:56:29.811941 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1659/3315] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:29 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1675 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:56:30.379006 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f42ac116-6745-484c-858d-1610131ec86d tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:30.379686 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-f42ac116-6745-484c-858d-1610131ec86d tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] [instance: c5baad75-87d5-4a3f-b3f8-73ca40b9781a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:30.387263 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f42ac116-6745-484c-858d-1610131ec86d tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:30.388093 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f42ac116-6745-484c-858d-1610131ec86d tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:30.388698 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f42ac116-6745-484c-858d-1610131ec86d tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:30.389896 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f42ac116-6745-484c-858d-1610131ec86d tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:30.390491 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f42ac116-6745-484c-858d-1610131ec86d tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:30.391019 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f42ac116-6745-484c-858d-1610131ec86d tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:30.442423 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-29e36639-dbad-4ddb-b764-b2b9184c3f20 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:30.443023 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-29e36639-dbad-4ddb-b764-b2b9184c3f20 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] [instance: bdbaaee4-171e-4fcc-82c9-8b52850aed4f] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:30.449799 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-29e36639-dbad-4ddb-b764-b2b9184c3f20 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:30.450354 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-29e36639-dbad-4ddb-b764-b2b9184c3f20 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:30.450784 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-29e36639-dbad-4ddb-b764-b2b9184c3f20 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:30.451576 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-29e36639-dbad-4ddb-b764-b2b9184c3f20 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:30.452020 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-29e36639-dbad-4ddb-b764-b2b9184c3f20 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:30.452487 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-29e36639-dbad-4ddb-b764-b2b9184c3f20 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:30.589779 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-f42ac116-6745-484c-858d-1610131ec86d tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52807fd89d4048f3a0034cb270ba2e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '244b19609b60427c80601c033539a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:30.599974 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-f42ac116-6745-484c-858d-1610131ec86d tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] 10.222.0.70 "GET /compute/v2.1/servers/c5baad75-87d5-4a3f-b3f8-73ca40b9781a" status: 200 len: 1320 microversion: 2.1 time: 0.224754 Aug 27 02:56:30.600931 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1657/3316] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:30 2022] GET /compute/v2.1/servers/c5baad75-87d5-4a3f-b3f8-73ca40b9781a => generated 1320 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:56:30.623642 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-29e36639-dbad-4ddb-b764-b2b9184c3f20 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b59cfb13dfa4dcbb96fa040cd11f4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33011ef842941b3a35988d66565e958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:30.634531 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-29e36639-dbad-4ddb-b764-b2b9184c3f20 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] 10.222.0.70 "GET /compute/v2.1/servers/bdbaaee4-171e-4fcc-82c9-8b52850aed4f" status: 200 len: 1527 microversion: 2.1 time: 0.196404 Aug 27 02:56:30.635167 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1660/3317] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:30 2022] GET /compute/v2.1/servers/bdbaaee4-171e-4fcc-82c9-8b52850aed4f => generated 1527 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:56:30.805102 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-cf05e1fa-6b79-4e42-bc84-b3154a01e955 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:30.805985 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-cf05e1fa-6b79-4e42-bc84-b3154a01e955 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] [instance: 3f31178a-8993-4aa6-8d41-496bfec13bec] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:30.814152 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cf05e1fa-6b79-4e42-bc84-b3154a01e955 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:30.814944 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cf05e1fa-6b79-4e42-bc84-b3154a01e955 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:30.815392 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cf05e1fa-6b79-4e42-bc84-b3154a01e955 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:30.816134 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cf05e1fa-6b79-4e42-bc84-b3154a01e955 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:30.816712 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cf05e1fa-6b79-4e42-bc84-b3154a01e955 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:30.817114 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cf05e1fa-6b79-4e42-bc84-b3154a01e955 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:30.835120 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-373a58e6-8e7a-4d85-a52b-7a88a944bacc tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:30.836169 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-373a58e6-8e7a-4d85-a52b-7a88a944bacc tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:30.843963 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-373a58e6-8e7a-4d85-a52b-7a88a944bacc tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:30.845303 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-373a58e6-8e7a-4d85-a52b-7a88a944bacc tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:30.845945 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-373a58e6-8e7a-4d85-a52b-7a88a944bacc tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:30.846901 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-373a58e6-8e7a-4d85-a52b-7a88a944bacc tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:30.848551 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-373a58e6-8e7a-4d85-a52b-7a88a944bacc tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:30.849806 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-373a58e6-8e7a-4d85-a52b-7a88a944bacc tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:30.924599 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-cf05e1fa-6b79-4e42-bc84-b3154a01e955 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5097adbf553e4e319d2cb0cf383f587a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77abdb9b52614d1fbd6d70774a2df31f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:30.936044 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-cf05e1fa-6b79-4e42-bc84-b3154a01e955 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5097adbf553e4e319d2cb0cf383f587a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77abdb9b52614d1fbd6d70774a2df31f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:30.937808 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-cf05e1fa-6b79-4e42-bc84-b3154a01e955 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5097adbf553e4e319d2cb0cf383f587a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77abdb9b52614d1fbd6d70774a2df31f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:30.944474 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-cf05e1fa-6b79-4e42-bc84-b3154a01e955 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] 10.222.0.70 "GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec" status: 200 len: 1444 microversion: 2.75 time: 0.143789 Aug 27 02:56:30.950893 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1658/3318] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:56:30 2022] GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec => generated 1444 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:56:31.116743 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-373a58e6-8e7a-4d85-a52b-7a88a944bacc tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:31.125692 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-373a58e6-8e7a-4d85-a52b-7a88a944bacc tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1675 microversion: 2.1 time: 0.294790 Aug 27 02:56:31.131030 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1661/3319] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:30 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1675 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:56:31.623289 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-5cc95012-25bc-4f0f-ac41-06594689e633 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:31.624354 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-5cc95012-25bc-4f0f-ac41-06594689e633 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] [instance: c5baad75-87d5-4a3f-b3f8-73ca40b9781a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:31.631378 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5cc95012-25bc-4f0f-ac41-06594689e633 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:31.631861 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5cc95012-25bc-4f0f-ac41-06594689e633 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:31.632422 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5cc95012-25bc-4f0f-ac41-06594689e633 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:31.633214 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5cc95012-25bc-4f0f-ac41-06594689e633 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:31.633678 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5cc95012-25bc-4f0f-ac41-06594689e633 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:31.634894 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5cc95012-25bc-4f0f-ac41-06594689e633 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:31.656584 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-768999b0-78b9-41f4-86d5-13bc276a70ff tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:31.658103 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-768999b0-78b9-41f4-86d5-13bc276a70ff tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] [instance: bdbaaee4-171e-4fcc-82c9-8b52850aed4f] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:31.667169 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-768999b0-78b9-41f4-86d5-13bc276a70ff tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:31.667770 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-768999b0-78b9-41f4-86d5-13bc276a70ff tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:31.668680 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-768999b0-78b9-41f4-86d5-13bc276a70ff tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:31.669735 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-768999b0-78b9-41f4-86d5-13bc276a70ff tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:31.670478 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-768999b0-78b9-41f4-86d5-13bc276a70ff tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:31.671182 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-768999b0-78b9-41f4-86d5-13bc276a70ff tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:31.914871 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-5cc95012-25bc-4f0f-ac41-06594689e633 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52807fd89d4048f3a0034cb270ba2e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '244b19609b60427c80601c033539a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:31.926470 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-768999b0-78b9-41f4-86d5-13bc276a70ff tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b59cfb13dfa4dcbb96fa040cd11f4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33011ef842941b3a35988d66565e958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:31.929455 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:56:31.930563 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-5cc95012-25bc-4f0f-ac41-06594689e633 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] 10.222.0.70 "GET /compute/v2.1/servers/c5baad75-87d5-4a3f-b3f8-73ca40b9781a" status: 200 len: 1320 microversion: 2.1 time: 0.312721 Aug 27 02:56:31.935600 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1659/3320] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:31 2022] GET /compute/v2.1/servers/c5baad75-87d5-4a3f-b3f8-73ca40b9781a => generated 1320 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:56:31.937171 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-768999b0-78b9-41f4-86d5-13bc276a70ff tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] 10.222.0.70 "GET /compute/v2.1/servers/bdbaaee4-171e-4fcc-82c9-8b52850aed4f" status: 200 len: 1527 microversion: 2.1 time: 0.285823 Aug 27 02:56:31.938813 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1662/3321] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:31 2022] GET /compute/v2.1/servers/bdbaaee4-171e-4fcc-82c9-8b52850aed4f => generated 1527 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:56:31.975172 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-480a94be-a0a8-4181-987e-4bbf418e7956 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:31.976329 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-480a94be-a0a8-4181-987e-4bbf418e7956 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] [instance: 3f31178a-8993-4aa6-8d41-496bfec13bec] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:31.983579 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-480a94be-a0a8-4181-987e-4bbf418e7956 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:31.984563 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-480a94be-a0a8-4181-987e-4bbf418e7956 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:31.985039 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-480a94be-a0a8-4181-987e-4bbf418e7956 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:31.985804 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-480a94be-a0a8-4181-987e-4bbf418e7956 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:31.986424 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-480a94be-a0a8-4181-987e-4bbf418e7956 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:31.987081 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-480a94be-a0a8-4181-987e-4bbf418e7956 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:32.081827 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-480a94be-a0a8-4181-987e-4bbf418e7956 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5097adbf553e4e319d2cb0cf383f587a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77abdb9b52614d1fbd6d70774a2df31f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:32.091766 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-480a94be-a0a8-4181-987e-4bbf418e7956 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5097adbf553e4e319d2cb0cf383f587a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77abdb9b52614d1fbd6d70774a2df31f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:32.093970 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-480a94be-a0a8-4181-987e-4bbf418e7956 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5097adbf553e4e319d2cb0cf383f587a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77abdb9b52614d1fbd6d70774a2df31f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:32.100400 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-480a94be-a0a8-4181-987e-4bbf418e7956 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] 10.222.0.70 "GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec" status: 200 len: 1444 microversion: 2.75 time: 0.129964 Aug 27 02:56:32.116805 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1660/3322] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:56:31 2022] GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec => generated 1444 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:56:32.149703 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4aa797fa-1010-44cf-9d5e-64b2f8b149e0 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:32.150788 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-4aa797fa-1010-44cf-9d5e-64b2f8b149e0 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:32.160532 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4aa797fa-1010-44cf-9d5e-64b2f8b149e0 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:32.161381 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4aa797fa-1010-44cf-9d5e-64b2f8b149e0 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:32.162245 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4aa797fa-1010-44cf-9d5e-64b2f8b149e0 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:32.163100 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4aa797fa-1010-44cf-9d5e-64b2f8b149e0 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:32.163916 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4aa797fa-1010-44cf-9d5e-64b2f8b149e0 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:32.164893 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4aa797fa-1010-44cf-9d5e-64b2f8b149e0 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:32.423423 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-4aa797fa-1010-44cf-9d5e-64b2f8b149e0 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:32.432578 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-4aa797fa-1010-44cf-9d5e-64b2f8b149e0 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1675 microversion: 2.1 time: 0.288832 Aug 27 02:56:32.433287 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1663/3323] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:32 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1675 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:56:32.954316 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-83aa5d61-3670-4f69-80ad-3f4e241aa963 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:32.954988 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-83aa5d61-3670-4f69-80ad-3f4e241aa963 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] [instance: c5baad75-87d5-4a3f-b3f8-73ca40b9781a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:32.961274 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-21a874fe-6f03-4710-bbaf-db8aec60c943 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:32.961970 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-21a874fe-6f03-4710-bbaf-db8aec60c943 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] [instance: bdbaaee4-171e-4fcc-82c9-8b52850aed4f] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:32.964018 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-83aa5d61-3670-4f69-80ad-3f4e241aa963 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:32.964728 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-83aa5d61-3670-4f69-80ad-3f4e241aa963 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:32.965351 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-83aa5d61-3670-4f69-80ad-3f4e241aa963 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:32.966145 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-83aa5d61-3670-4f69-80ad-3f4e241aa963 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:32.966661 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-83aa5d61-3670-4f69-80ad-3f4e241aa963 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:32.967088 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-83aa5d61-3670-4f69-80ad-3f4e241aa963 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:32.971907 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-21a874fe-6f03-4710-bbaf-db8aec60c943 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:32.972757 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-21a874fe-6f03-4710-bbaf-db8aec60c943 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:32.973502 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-21a874fe-6f03-4710-bbaf-db8aec60c943 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:32.974429 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-21a874fe-6f03-4710-bbaf-db8aec60c943 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:32.975045 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-21a874fe-6f03-4710-bbaf-db8aec60c943 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:32.975529 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-21a874fe-6f03-4710-bbaf-db8aec60c943 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:33.204269 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-83aa5d61-3670-4f69-80ad-3f4e241aa963 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52807fd89d4048f3a0034cb270ba2e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '244b19609b60427c80601c033539a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:33.209030 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-21a874fe-6f03-4710-bbaf-db8aec60c943 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b59cfb13dfa4dcbb96fa040cd11f4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33011ef842941b3a35988d66565e958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:33.213361 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-83aa5d61-3670-4f69-80ad-3f4e241aa963 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] 10.222.0.70 "GET /compute/v2.1/servers/c5baad75-87d5-4a3f-b3f8-73ca40b9781a" status: 200 len: 1320 microversion: 2.1 time: 0.264306 Aug 27 02:56:33.224603 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1661/3324] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:32 2022] GET /compute/v2.1/servers/c5baad75-87d5-4a3f-b3f8-73ca40b9781a => generated 1320 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:56:33.224811 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-21a874fe-6f03-4710-bbaf-db8aec60c943 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] 10.222.0.70 "GET /compute/v2.1/servers/bdbaaee4-171e-4fcc-82c9-8b52850aed4f" status: 200 len: 1527 microversion: 2.1 time: 0.263771 Aug 27 02:56:33.224811 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1664/3325] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:32 2022] GET /compute/v2.1/servers/bdbaaee4-171e-4fcc-82c9-8b52850aed4f => generated 1527 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:56:33.228825 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-65675880-5001-48a3-b515-53834afdce7e tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:33.229580 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-65675880-5001-48a3-b515-53834afdce7e tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] [instance: 3f31178a-8993-4aa6-8d41-496bfec13bec] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:33.235903 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-65675880-5001-48a3-b515-53834afdce7e tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:33.236536 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-65675880-5001-48a3-b515-53834afdce7e tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:33.237075 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-65675880-5001-48a3-b515-53834afdce7e tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:33.237873 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-65675880-5001-48a3-b515-53834afdce7e tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:33.238393 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-65675880-5001-48a3-b515-53834afdce7e tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:33.238889 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-65675880-5001-48a3-b515-53834afdce7e tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:33.272328 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-65675880-5001-48a3-b515-53834afdce7e tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:33.272824 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-65675880-5001-48a3-b515-53834afdce7e tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:33.273257 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-65675880-5001-48a3-b515-53834afdce7e tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:33.273705 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.objects.instance [None req-65675880-5001-48a3-b515-53834afdce7e tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lazy-loading 'fault' on Instance uuid 3f31178a-8993-4aa6-8d41-496bfec13bec {{(pid=134051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:56:33.317983 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-65675880-5001-48a3-b515-53834afdce7e tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5097adbf553e4e319d2cb0cf383f587a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77abdb9b52614d1fbd6d70774a2df31f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:33.326233 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-65675880-5001-48a3-b515-53834afdce7e tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5097adbf553e4e319d2cb0cf383f587a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77abdb9b52614d1fbd6d70774a2df31f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:33.327860 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-65675880-5001-48a3-b515-53834afdce7e tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5097adbf553e4e319d2cb0cf383f587a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77abdb9b52614d1fbd6d70774a2df31f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:33.333519 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-65675880-5001-48a3-b515-53834afdce7e tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] 10.222.0.70 "GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec" status: 200 len: 1449 microversion: 2.75 time: 0.118571 Aug 27 02:56:33.334067 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1662/3326] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:56:33 2022] GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec => generated 1449 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:56:33.454561 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5a335ae8-c0cb-403c-9979-30f1a3e69773 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:33.455495 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-5a335ae8-c0cb-403c-9979-30f1a3e69773 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:33.465186 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5a335ae8-c0cb-403c-9979-30f1a3e69773 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:33.465676 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5a335ae8-c0cb-403c-9979-30f1a3e69773 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:33.468407 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5a335ae8-c0cb-403c-9979-30f1a3e69773 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:33.469403 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5a335ae8-c0cb-403c-9979-30f1a3e69773 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:33.469863 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5a335ae8-c0cb-403c-9979-30f1a3e69773 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:33.470459 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5a335ae8-c0cb-403c-9979-30f1a3e69773 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:33.617008 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-5a335ae8-c0cb-403c-9979-30f1a3e69773 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:33.626253 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-5a335ae8-c0cb-403c-9979-30f1a3e69773 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1668 microversion: 2.1 time: 0.175834 Aug 27 02:56:33.642333 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1665/3327] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:33 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1668 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:56:34.235408 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-9d4c708f-4238-42a8-8860-4d172cafaf15 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:34.236127 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-9d4c708f-4238-42a8-8860-4d172cafaf15 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] [instance: c5baad75-87d5-4a3f-b3f8-73ca40b9781a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:34.238959 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f377093c-1aeb-473b-b574-1b661d6b8d52 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:34.239572 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-f377093c-1aeb-473b-b574-1b661d6b8d52 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] [instance: bdbaaee4-171e-4fcc-82c9-8b52850aed4f] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:34.244924 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9d4c708f-4238-42a8-8860-4d172cafaf15 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:34.245420 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9d4c708f-4238-42a8-8860-4d172cafaf15 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:34.246351 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9d4c708f-4238-42a8-8860-4d172cafaf15 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:34.246917 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f377093c-1aeb-473b-b574-1b661d6b8d52 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:34.247354 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9d4c708f-4238-42a8-8860-4d172cafaf15 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:34.247471 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f377093c-1aeb-473b-b574-1b661d6b8d52 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:34.247814 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f377093c-1aeb-473b-b574-1b661d6b8d52 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:34.247936 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9d4c708f-4238-42a8-8860-4d172cafaf15 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:34.248557 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f377093c-1aeb-473b-b574-1b661d6b8d52 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:34.249000 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f377093c-1aeb-473b-b574-1b661d6b8d52 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:34.249135 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9d4c708f-4238-42a8-8860-4d172cafaf15 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:34.249412 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f377093c-1aeb-473b-b574-1b661d6b8d52 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:34.450443 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-9d4c708f-4238-42a8-8860-4d172cafaf15 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52807fd89d4048f3a0034cb270ba2e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '244b19609b60427c80601c033539a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:34.457746 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-f377093c-1aeb-473b-b574-1b661d6b8d52 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b59cfb13dfa4dcbb96fa040cd11f4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33011ef842941b3a35988d66565e958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:34.459913 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-9d4c708f-4238-42a8-8860-4d172cafaf15 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] 10.222.0.70 "GET /compute/v2.1/servers/c5baad75-87d5-4a3f-b3f8-73ca40b9781a" status: 200 len: 1320 microversion: 2.1 time: 0.228708 Aug 27 02:56:34.461100 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1663/3328] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:34 2022] GET /compute/v2.1/servers/c5baad75-87d5-4a3f-b3f8-73ca40b9781a => generated 1320 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:56:34.469168 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-1a805590-7ec9-49d6-93a9-5270cebee382 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:34.469887 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-1a805590-7ec9-49d6-93a9-5270cebee382 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] [instance: 3f31178a-8993-4aa6-8d41-496bfec13bec] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:34.474557 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f377093c-1aeb-473b-b574-1b661d6b8d52 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] 10.222.0.70 "GET /compute/v2.1/servers/bdbaaee4-171e-4fcc-82c9-8b52850aed4f" status: 200 len: 1527 microversion: 2.1 time: 0.239498 Aug 27 02:56:34.475188 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1666/3329] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:34 2022] GET /compute/v2.1/servers/bdbaaee4-171e-4fcc-82c9-8b52850aed4f => generated 1527 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:56:34.477646 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1a805590-7ec9-49d6-93a9-5270cebee382 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:34.478226 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1a805590-7ec9-49d6-93a9-5270cebee382 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:34.478902 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1a805590-7ec9-49d6-93a9-5270cebee382 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:34.479793 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1a805590-7ec9-49d6-93a9-5270cebee382 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:34.480178 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1a805590-7ec9-49d6-93a9-5270cebee382 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:34.480604 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1a805590-7ec9-49d6-93a9-5270cebee382 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:34.516437 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1a805590-7ec9-49d6-93a9-5270cebee382 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:34.516934 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1a805590-7ec9-49d6-93a9-5270cebee382 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:34.517370 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1a805590-7ec9-49d6-93a9-5270cebee382 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:34.517814 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.objects.instance [None req-1a805590-7ec9-49d6-93a9-5270cebee382 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lazy-loading 'fault' on Instance uuid 3f31178a-8993-4aa6-8d41-496bfec13bec {{(pid=134051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:56:34.560944 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-1a805590-7ec9-49d6-93a9-5270cebee382 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5097adbf553e4e319d2cb0cf383f587a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77abdb9b52614d1fbd6d70774a2df31f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:34.569844 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-1a805590-7ec9-49d6-93a9-5270cebee382 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5097adbf553e4e319d2cb0cf383f587a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77abdb9b52614d1fbd6d70774a2df31f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:34.571324 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-1a805590-7ec9-49d6-93a9-5270cebee382 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5097adbf553e4e319d2cb0cf383f587a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77abdb9b52614d1fbd6d70774a2df31f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:34.577314 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-1a805590-7ec9-49d6-93a9-5270cebee382 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] 10.222.0.70 "GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec" status: 200 len: 1449 microversion: 2.75 time: 0.111954 Aug 27 02:56:34.577900 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1664/3330] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:56:34 2022] GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec => generated 1449 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:56:35.480826 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-efe6a124-c4d2-4daf-a05d-d2dae030d744 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:35.481606 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-efe6a124-c4d2-4daf-a05d-d2dae030d744 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] [instance: c5baad75-87d5-4a3f-b3f8-73ca40b9781a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:35.488652 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-efe6a124-c4d2-4daf-a05d-d2dae030d744 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:35.489127 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-efe6a124-c4d2-4daf-a05d-d2dae030d744 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:35.489736 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-efe6a124-c4d2-4daf-a05d-d2dae030d744 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:35.490609 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-efe6a124-c4d2-4daf-a05d-d2dae030d744 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:35.491203 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-efe6a124-c4d2-4daf-a05d-d2dae030d744 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:35.491974 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-efe6a124-c4d2-4daf-a05d-d2dae030d744 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:35.498687 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0b0e3a43-d9ee-4651-9140-2180beec9d77 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:35.499728 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-0b0e3a43-d9ee-4651-9140-2180beec9d77 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] [instance: bdbaaee4-171e-4fcc-82c9-8b52850aed4f] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:35.512392 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0b0e3a43-d9ee-4651-9140-2180beec9d77 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:35.512874 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0b0e3a43-d9ee-4651-9140-2180beec9d77 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:35.513313 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0b0e3a43-d9ee-4651-9140-2180beec9d77 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:35.514023 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0b0e3a43-d9ee-4651-9140-2180beec9d77 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:35.514472 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0b0e3a43-d9ee-4651-9140-2180beec9d77 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:35.514896 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0b0e3a43-d9ee-4651-9140-2180beec9d77 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:35.538610 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:56:35.844952 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-0b0e3a43-d9ee-4651-9140-2180beec9d77 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b59cfb13dfa4dcbb96fa040cd11f4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33011ef842941b3a35988d66565e958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:35.845464 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-efe6a124-c4d2-4daf-a05d-d2dae030d744 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52807fd89d4048f3a0034cb270ba2e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '244b19609b60427c80601c033539a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:35.856434 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-0b0e3a43-d9ee-4651-9140-2180beec9d77 tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] 10.222.0.70 "GET /compute/v2.1/servers/bdbaaee4-171e-4fcc-82c9-8b52850aed4f" status: 200 len: 1527 microversion: 2.1 time: 0.363045 Aug 27 02:56:35.857429 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-efe6a124-c4d2-4daf-a05d-d2dae030d744 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] 10.222.0.70 "GET /compute/v2.1/servers/c5baad75-87d5-4a3f-b3f8-73ca40b9781a" status: 200 len: 1508 microversion: 2.1 time: 0.380589 Aug 27 02:56:35.857697 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1665/3331] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:35 2022] GET /compute/v2.1/servers/bdbaaee4-171e-4fcc-82c9-8b52850aed4f => generated 1527 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:56:35.858456 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1667/3332] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:35 2022] GET /compute/v2.1/servers/c5baad75-87d5-4a3f-b3f8-73ca40b9781a => generated 1508 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:56:35.865005 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-202ac61b-f29c-41a7-83ca-c874b17e2617 req-9facc005-bf75-4783-8058-9eb54b63fd6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdbaaee4-171e-4fcc-82c9-8b52850aed4f", "name": "network-vif-deleted", "tag": "7cfc9dfb-21e4-4db9-9e2c-8e6645c1bc57"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:56:35.877402 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f0ca320f-16d8-4a45-bc5d-5e81d6a23646 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:35.878067 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-f0ca320f-16d8-4a45-bc5d-5e81d6a23646 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] [instance: 3f31178a-8993-4aa6-8d41-496bfec13bec] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:35.878969 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-202ac61b-f29c-41a7-83ca-c874b17e2617 req-9facc005-bf75-4783-8058-9eb54b63fd6a service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:35.880023 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-202ac61b-f29c-41a7-83ca-c874b17e2617 req-9facc005-bf75-4783-8058-9eb54b63fd6a service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:35.881273 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-202ac61b-f29c-41a7-83ca-c874b17e2617 req-9facc005-bf75-4783-8058-9eb54b63fd6a service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:35.889928 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f0ca320f-16d8-4a45-bc5d-5e81d6a23646 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:35.890429 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f0ca320f-16d8-4a45-bc5d-5e81d6a23646 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:35.891605 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f0ca320f-16d8-4a45-bc5d-5e81d6a23646 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:35.892376 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f0ca320f-16d8-4a45-bc5d-5e81d6a23646 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:35.892843 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f0ca320f-16d8-4a45-bc5d-5e81d6a23646 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:35.893560 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f0ca320f-16d8-4a45-bc5d-5e81d6a23646 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:35.903745 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-202ac61b-f29c-41a7-83ca-c874b17e2617 req-9facc005-bf75-4783-8058-9eb54b63fd6a service nova] Creating event network-vif-deleted:7cfc9dfb-21e4-4db9-9e2c-8e6645c1bc57 for instance bdbaaee4-171e-4fcc-82c9-8b52850aed4f on n-h1-852278-4 Aug 27 02:56:35.910057 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-f0ca320f-16d8-4a45-bc5d-5e81d6a23646 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] HTTP exception thrown: Instance 3f31178a-8993-4aa6-8d41-496bfec13bec could not be found. Aug 27 02:56:35.910334 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-202ac61b-f29c-41a7-83ca-c874b17e2617 req-9facc005-bf75-4783-8058-9eb54b63fd6a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049389 Aug 27 02:56:35.911430 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1668/3333] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:56:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:56:35.911746 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f0ca320f-16d8-4a45-bc5d-5e81d6a23646 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Request method failure captured: Aug 27 02:56:35.911746 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec HTTP/1.1 Aug 27 02:56:35.911746 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:56:35.911746 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:56:35.911746 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:56:35.911746 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:56:35.911746 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:56:35.911746 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:56:35.911746 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:56:35.911746 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:56:35.911746 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYeV7wmjm8VVFHQddFOv0GZf5h30-Z67HtRqItH6rbQrWYWQdnzNDn7GSe7QXXdDZurIXINih7A5_euMROLDG4Vj4z1zx9i09y4Ee9Y0BzLIwGDasGTA3IDBlgcvtAevU7j5N5ngDHi_WJoKTQwz0fQvPQnri_1jGnkrBdfysL9NTLY Aug 27 02:56:35.911746 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:56:35.911746 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:56:35.911746 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:56:35.911746 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:56:35.911746 n-d-852278-4 devstack@n-api.service[134051]: X-Openstack-Nova-Api-Version: 2.75 Aug 27 02:56:35.911746 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:56:35.911746 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:56:35.911746 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 77abdb9b52614d1fbd6d70774a2df31f Aug 27 02:56:35.911746 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ServersAdmin275Test-24843198 Aug 27 02:56:35.911746 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:56:35.911746 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:56:35.911746 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/77abdb9b52614d1fbd6d70774a2df31f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_77abdb9b52614d1fbd6d70774a2df31f", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/77abdb9b52614d1fbd6d70774a2df31f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/77abdb9b52614d1fbd6d70774a2df31f"}]}] Aug 27 02:56:35.911746 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ServersAdmin275Test-24843198 Aug 27 02:56:35.911746 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 77abdb9b52614d1fbd6d70774a2df31f Aug 27 02:56:35.911746 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ServersAdmin275Test-24843198 Aug 27 02:56:35.911746 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ServersAdmin275Test-24843198-project Aug 27 02:56:35.911746 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:56:35.911746 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:56:35.911746 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 5097adbf553e4e319d2cb0cf383f587a Aug 27 02:56:35.911746 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ServersAdmin275Test-24843198-project Aug 27 02:56:35.911746 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 02:56:35.911746 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance 3f31178a-8993-4aa6-8d41-496bfec13bec could not be found. Aug 27 02:56:35.911746 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '3f31178a-8993-4aa6-8d41-496bfec13bec'} Aug 27 02:56:35.911746 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:56:35.911746 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:56:35.911746 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:56:35.911746 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:56:35.911746 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:56:35.911746 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:56:35.911746 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:56:35.911746 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:56:35.911746 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:56:35.911746 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:56:35.911746 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f31178a-8993-4aa6-8d41-496bfec13bec could not be found. Aug 27 02:56:35.911746 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:56:35.911746 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:56:35.911746 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:56:35.911746 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:56:35.911746 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:56:35.911746 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:56:35.911746 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:56:35.911746 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:56:35.911746 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:56:35.911746 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:56:35.911746 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:56:35.911746 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:56:35.911746 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:56:35.911746 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:56:35.911746 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:56:35.911746 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:56:35.911746 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f31178a-8993-4aa6-8d41-496bfec13bec could not be found. Aug 27 02:56:35.911746 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:56:35.911746 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:56:35.911746 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:56:35.918368 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:56:35.918368 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:56:35.918368 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:56:35.918368 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:56:35.918368 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:56:35.918368 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f31178a-8993-4aa6-8d41-496bfec13bec could not be found. Aug 27 02:56:35.918368 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:56:35.918368 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f0ca320f-16d8-4a45-bc5d-5e81d6a23646 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] Returning 404 to user: Instance 3f31178a-8993-4aa6-8d41-496bfec13bec could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:56:35.918368 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-f0ca320f-16d8-4a45-bc5d-5e81d6a23646 tempest-ServersAdmin275Test-24843198 tempest-ServersAdmin275Test-24843198-project] 10.222.0.70 "GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec" status: 404 len: 111 microversion: 2.75 time: 0.054469 Aug 27 02:56:35.918368 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1666/3334] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:56:35 2022] GET /compute/v2.1/servers/3f31178a-8993-4aa6-8d41-496bfec13bec => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 02:56:35.927391 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ea3915a1-9c6b-40a0-8dbe-d4a4e2663d02 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:35.928444 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-ea3915a1-9c6b-40a0-8dbe-d4a4e2663d02 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] [instance: c5baad75-87d5-4a3f-b3f8-73ca40b9781a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:35.937519 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ea3915a1-9c6b-40a0-8dbe-d4a4e2663d02 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:35.938098 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ea3915a1-9c6b-40a0-8dbe-d4a4e2663d02 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:35.938603 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ea3915a1-9c6b-40a0-8dbe-d4a4e2663d02 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:35.939419 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ea3915a1-9c6b-40a0-8dbe-d4a4e2663d02 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:35.939952 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ea3915a1-9c6b-40a0-8dbe-d4a4e2663d02 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:35.940656 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ea3915a1-9c6b-40a0-8dbe-d4a4e2663d02 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:35.973706 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-ea3915a1-9c6b-40a0-8dbe-d4a4e2663d02 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] [instance: c5baad75-87d5-4a3f-b3f8-73ca40b9781a] Going to try to terminate instance {{(pid=134052) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:56:36.087450 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ea3915a1-9c6b-40a0-8dbe-d4a4e2663d02 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] 10.222.0.70 "DELETE /compute/v2.1/servers/c5baad75-87d5-4a3f-b3f8-73ca40b9781a" status: 204 len: 0 microversion: 2.1 time: 0.165024 Aug 27 02:56:36.088571 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1669/3335] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:56:35 2022] DELETE /compute/v2.1/servers/c5baad75-87d5-4a3f-b3f8-73ca40b9781a => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:56:36.097206 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-96a2a580-d09b-4795-872f-cdaf369398bc tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:36.098338 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-96a2a580-d09b-4795-872f-cdaf369398bc tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] [instance: 3af57aa3-9dfb-436f-8b35-0ba727f4ceee] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:36.107513 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-96a2a580-d09b-4795-872f-cdaf369398bc tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:36.108007 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-96a2a580-d09b-4795-872f-cdaf369398bc tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:36.108505 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-96a2a580-d09b-4795-872f-cdaf369398bc tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:36.109248 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-96a2a580-d09b-4795-872f-cdaf369398bc tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:36.109680 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-96a2a580-d09b-4795-872f-cdaf369398bc tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:36.110108 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-96a2a580-d09b-4795-872f-cdaf369398bc tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:36.140618 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-96a2a580-d09b-4795-872f-cdaf369398bc tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] [instance: 3af57aa3-9dfb-436f-8b35-0ba727f4ceee] Going to try to terminate instance {{(pid=134051) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:56:36.236383 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-96a2a580-d09b-4795-872f-cdaf369398bc tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] 10.222.0.70 "DELETE /compute/v2.1/servers/3af57aa3-9dfb-436f-8b35-0ba727f4ceee" status: 204 len: 0 microversion: 2.1 time: 0.142222 Aug 27 02:56:36.240239 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1667/3336] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:56:36 2022] DELETE /compute/v2.1/servers/3af57aa3-9dfb-436f-8b35-0ba727f4ceee => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:56:36.363929 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0f556f84-3ac7-4fa9-8ad9-f4656afbc573 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-1214788379", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "e7e2016f-72fa-4c5b-947d-9a8b6b4e27d2"}]}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:56:36.418660 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.network.neutron [None req-0f556f84-3ac7-4fa9-8ad9-f4656afbc573 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] validate_networks() for [('e7e2016f-72fa-4c5b-947d-9a8b6b4e27d2', None, None, None, None, None)] {{(pid=134052) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:56:36.824742 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-0f556f84-3ac7-4fa9-8ad9-f4656afbc573 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Flavor limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:56:36.825404 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-0f556f84-3ac7-4fa9-8ad9-f4656afbc573 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Image limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:56:36.825827 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-0f556f84-3ac7-4fa9-8ad9-f4656afbc573 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Flavor pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:56:36.826329 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-0f556f84-3ac7-4fa9-8ad9-f4656afbc573 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Image pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:56:36.826735 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-0f556f84-3ac7-4fa9-8ad9-f4656afbc573 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:56:36.836459 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0f556f84-3ac7-4fa9-8ad9-f4656afbc573 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:36.836953 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0f556f84-3ac7-4fa9-8ad9-f4656afbc573 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:36.837388 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0f556f84-3ac7-4fa9-8ad9-f4656afbc573 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:36.838180 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0f556f84-3ac7-4fa9-8ad9-f4656afbc573 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:36.838740 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0f556f84-3ac7-4fa9-8ad9-f4656afbc573 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:36.839190 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0f556f84-3ac7-4fa9-8ad9-f4656afbc573 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:36.858364 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-0f556f84-3ac7-4fa9-8ad9-f4656afbc573 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Getting quotas for project 244b19609b60427c80601c033539a55a. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:56:36.864141 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-0f556f84-3ac7-4fa9-8ad9-f4656afbc573 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Getting quotas for user 52807fd89d4048f3a0034cb270ba2e9c and project 244b19609b60427c80601c033539a55a. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:56:36.880869 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-0f556f84-3ac7-4fa9-8ad9-f4656afbc573 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Going to run 2 instances... {{(pid=134052) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:56:36.884135 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-0f556f84-3ac7-4fa9-8ad9-f4656afbc573 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] [instance: 497196bf-70cb-417d-a396-ebf6e5418547] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134052) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:56:36.894022 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-1caf6ad8-5d48-4dfd-9bbd-7ef1ea0efd3f tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:36.897482 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-1caf6ad8-5d48-4dfd-9bbd-7ef1ea0efd3f tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] [instance: bdbaaee4-171e-4fcc-82c9-8b52850aed4f] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:36.911425 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1caf6ad8-5d48-4dfd-9bbd-7ef1ea0efd3f tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:36.912791 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1caf6ad8-5d48-4dfd-9bbd-7ef1ea0efd3f tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:36.913414 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1caf6ad8-5d48-4dfd-9bbd-7ef1ea0efd3f tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:36.915110 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1caf6ad8-5d48-4dfd-9bbd-7ef1ea0efd3f tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:36.926725 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1caf6ad8-5d48-4dfd-9bbd-7ef1ea0efd3f tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:36.930249 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1caf6ad8-5d48-4dfd-9bbd-7ef1ea0efd3f tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:36.939006 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-0f556f84-3ac7-4fa9-8ad9-f4656afbc573 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] [instance: 31375ef8-ce19-46e1-b574-6252175884b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=497196bf-70cb-417d-a396-ebf6e5418547,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134052) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:56:36.989680 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1caf6ad8-5d48-4dfd-9bbd-7ef1ea0efd3f tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:36.990736 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1caf6ad8-5d48-4dfd-9bbd-7ef1ea0efd3f tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:36.991349 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1caf6ad8-5d48-4dfd-9bbd-7ef1ea0efd3f tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:36.991975 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.objects.instance [None req-1caf6ad8-5d48-4dfd-9bbd-7ef1ea0efd3f tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Lazy-loading 'fault' on Instance uuid bdbaaee4-171e-4fcc-82c9-8b52850aed4f {{(pid=134051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:56:37.056978 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-0f556f84-3ac7-4fa9-8ad9-f4656afbc573 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 0.702321 Aug 27 02:56:37.058044 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1670/3337] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 02:56:36 2022] POST /compute/v2.1/servers => generated 32 bytes in 704 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Aug 27 02:56:37.066750 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-20d54c12-0764-4af2-a1b0-6e0307fc12c9 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:37.071771 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-20d54c12-0764-4af2-a1b0-6e0307fc12c9 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '52807fd89d4048f3a0034cb270ba2e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '244b19609b60427c80601c033539a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:37.072681 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-20d54c12-0764-4af2-a1b0-6e0307fc12c9 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Searching by: {'deleted': False, 'project_id': '244b19609b60427c80601c033539a55a'} {{(pid=134052) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 02:56:37.078919 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-1caf6ad8-5d48-4dfd-9bbd-7ef1ea0efd3f tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b59cfb13dfa4dcbb96fa040cd11f4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33011ef842941b3a35988d66565e958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:37.088879 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-20d54c12-0764-4af2-a1b0-6e0307fc12c9 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:37.089370 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-20d54c12-0764-4af2-a1b0-6e0307fc12c9 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:37.089809 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-20d54c12-0764-4af2-a1b0-6e0307fc12c9 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:37.091169 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-20d54c12-0764-4af2-a1b0-6e0307fc12c9 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:37.091169 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-20d54c12-0764-4af2-a1b0-6e0307fc12c9 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:37.091377 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-20d54c12-0764-4af2-a1b0-6e0307fc12c9 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:37.092652 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-1caf6ad8-5d48-4dfd-9bbd-7ef1ea0efd3f tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] 10.222.0.70 "GET /compute/v2.1/servers/bdbaaee4-171e-4fcc-82c9-8b52850aed4f" status: 200 len: 1314 microversion: 2.1 time: 0.213039 Aug 27 02:56:37.104866 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1668/3338] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:36 2022] GET /compute/v2.1/servers/bdbaaee4-171e-4fcc-82c9-8b52850aed4f => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:56:37.142117 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.multi_cell_list [None req-20d54c12-0764-4af2-a1b0-6e0307fc12c9 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=134052) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 02:56:37.185932 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-20d54c12-0764-4af2-a1b0-6e0307fc12c9 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] 10.222.0.70 "GET /compute/v2.1/servers" status: 200 len: 1337 microversion: 2.1 time: 0.123985 Aug 27 02:56:37.187266 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1671/3339] 10.222.0.70 () {58 vars in 1125 bytes} [Sat Aug 27 02:56:37 2022] GET /compute/v2.1/servers => generated 1337 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:56:37.200094 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4626c1a4-f93a-4542-b4bd-fac79b235531 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:37.200745 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-4626c1a4-f93a-4542-b4bd-fac79b235531 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] [instance: 31375ef8-ce19-46e1-b574-6252175884b7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:37.294597 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-4626c1a4-f93a-4542-b4bd-fac79b235531 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52807fd89d4048f3a0034cb270ba2e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '244b19609b60427c80601c033539a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:37.302582 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-4626c1a4-f93a-4542-b4bd-fac79b235531 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] 10.222.0.70 "GET /compute/v2.1/servers/31375ef8-ce19-46e1-b574-6252175884b7" status: 200 len: 1218 microversion: 2.1 time: 0.107538 Aug 27 02:56:37.303481 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1669/3340] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:37 2022] GET /compute/v2.1/servers/31375ef8-ce19-46e1-b574-6252175884b7 => generated 1218 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:56:38.117786 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6f8c6b20-0452-463c-be93-1a2693bfc42e tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:38.118508 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-6f8c6b20-0452-463c-be93-1a2693bfc42e tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] [instance: bdbaaee4-171e-4fcc-82c9-8b52850aed4f] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:38.130019 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6f8c6b20-0452-463c-be93-1a2693bfc42e tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:38.131140 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6f8c6b20-0452-463c-be93-1a2693bfc42e tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:38.132572 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6f8c6b20-0452-463c-be93-1a2693bfc42e tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:38.135357 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6f8c6b20-0452-463c-be93-1a2693bfc42e tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:38.136159 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6f8c6b20-0452-463c-be93-1a2693bfc42e tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:38.136949 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6f8c6b20-0452-463c-be93-1a2693bfc42e tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:38.155327 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-6f8c6b20-0452-463c-be93-1a2693bfc42e tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] HTTP exception thrown: Instance bdbaaee4-171e-4fcc-82c9-8b52850aed4f could not be found. Aug 27 02:56:38.157922 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6f8c6b20-0452-463c-be93-1a2693bfc42e tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Request method failure captured: Aug 27 02:56:38.157922 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/servers/bdbaaee4-171e-4fcc-82c9-8b52850aed4f HTTP/1.1 Aug 27 02:56:38.157922 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:56:38.157922 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:56:38.157922 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:56:38.157922 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:56:38.157922 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:56:38.157922 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:56:38.157922 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:56:38.157922 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:56:38.157922 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYfHggg92h80i2AOtBCMbaPj_8trT0g_CvtvQdScRZK20TKwPPG_pZcperciOaX8jvzTDUvZq1FAXCyOkvKsIRHJWS1ttKESOD8yEN8A7tm8bLiZnynoVXDo3nlDxiDNIUaPQPILWQoCKUEtbPFJXI0Up7a_tBescGriHPa9jfGTuH8 Aug 27 02:56:38.157922 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:56:38.157922 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:56:38.157922 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:56:38.157922 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:56:38.157922 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:56:38.157922 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:56:38.157922 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: e33011ef842941b3a35988d66565e958 Aug 27 02:56:38.157922 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-827574272 Aug 27 02:56:38.157922 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:56:38.157922 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:56:38.157922 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e33011ef842941b3a35988d66565e958"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_e33011ef842941b3a35988d66565e958", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e33011ef842941b3a35988d66565e958"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/e33011ef842941b3a35988d66565e958"}]}] Aug 27 02:56:38.157922 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-827574272 Aug 27 02:56:38.157922 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: e33011ef842941b3a35988d66565e958 Aug 27 02:56:38.157922 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-827574272 Aug 27 02:56:38.157922 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-InstanceActionsNegativeTestJSON-827574272-project Aug 27 02:56:38.157922 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:56:38.157922 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:56:38.157922 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 6b59cfb13dfa4dcbb96fa040cd11f4c4 Aug 27 02:56:38.157922 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-827574272-project Aug 27 02:56:38.157922 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 02:56:38.157922 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance bdbaaee4-171e-4fcc-82c9-8b52850aed4f could not be found. Aug 27 02:56:38.157922 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': 'bdbaaee4-171e-4fcc-82c9-8b52850aed4f'} Aug 27 02:56:38.157922 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:56:38.157922 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:56:38.157922 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:56:38.157922 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:56:38.157922 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:56:38.157922 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:56:38.157922 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:56:38.157922 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:56:38.157922 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:56:38.157922 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:56:38.157922 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdbaaee4-171e-4fcc-82c9-8b52850aed4f could not be found. Aug 27 02:56:38.157922 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:56:38.157922 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:56:38.157922 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:56:38.157922 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:56:38.157922 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:56:38.157922 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:56:38.157922 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:56:38.157922 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:56:38.157922 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:56:38.157922 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:56:38.157922 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:56:38.157922 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:56:38.157922 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:56:38.157922 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:56:38.157922 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:56:38.157922 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:56:38.157922 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdbaaee4-171e-4fcc-82c9-8b52850aed4f could not be found. Aug 27 02:56:38.157922 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:56:38.157922 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:56:38.163315 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:56:38.163315 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:56:38.163315 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:56:38.163315 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:56:38.163315 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:56:38.163315 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:56:38.163315 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdbaaee4-171e-4fcc-82c9-8b52850aed4f could not be found. Aug 27 02:56:38.163315 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:56:38.163315 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6f8c6b20-0452-463c-be93-1a2693bfc42e tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] Returning 404 to user: Instance bdbaaee4-171e-4fcc-82c9-8b52850aed4f could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:56:38.163315 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-6f8c6b20-0452-463c-be93-1a2693bfc42e tempest-InstanceActionsNegativeTestJSON-827574272 tempest-InstanceActionsNegativeTestJSON-827574272-project] 10.222.0.70 "GET /compute/v2.1/servers/bdbaaee4-171e-4fcc-82c9-8b52850aed4f" status: 404 len: 111 microversion: 2.1 time: 0.045845 Aug 27 02:56:38.164165 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1672/3341] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:38 2022] GET /compute/v2.1/servers/bdbaaee4-171e-4fcc-82c9-8b52850aed4f => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:56:38.325121 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-25ca8c21-901d-465f-8935-a3362c348d2a tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:38.325822 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-25ca8c21-901d-465f-8935-a3362c348d2a tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] [instance: 31375ef8-ce19-46e1-b574-6252175884b7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:38.356540 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-25ca8c21-901d-465f-8935-a3362c348d2a tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:38.362674 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-25ca8c21-901d-465f-8935-a3362c348d2a tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:38.365538 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-25ca8c21-901d-465f-8935-a3362c348d2a tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:38.370626 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-25ca8c21-901d-465f-8935-a3362c348d2a tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:38.374556 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-25ca8c21-901d-465f-8935-a3362c348d2a tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:38.378988 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-25ca8c21-901d-465f-8935-a3362c348d2a tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:38.552570 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-25ca8c21-901d-465f-8935-a3362c348d2a tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52807fd89d4048f3a0034cb270ba2e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '244b19609b60427c80601c033539a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:38.561398 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-25ca8c21-901d-465f-8935-a3362c348d2a tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] 10.222.0.70 "GET /compute/v2.1/servers/31375ef8-ce19-46e1-b574-6252175884b7" status: 200 len: 1270 microversion: 2.1 time: 0.242183 Aug 27 02:56:38.566236 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1670/3342] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:38 2022] GET /compute/v2.1/servers/31375ef8-ce19-46e1-b574-6252175884b7 => generated 1270 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:56:39.202585 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-a000b3e0-b96c-428e-99e7-1d1b8f5ec455 req-9b11a25f-fd59-45c6-b2f7-318bb6c5bb50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3af57aa3-9dfb-436f-8b35-0ba727f4ceee", "name": "network-vif-deleted", "tag": "029899f4-d7d1-4dce-bea8-98ad91749f24"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:56:39.242277 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-a000b3e0-b96c-428e-99e7-1d1b8f5ec455 req-9b11a25f-fd59-45c6-b2f7-318bb6c5bb50 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:39.243088 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-a000b3e0-b96c-428e-99e7-1d1b8f5ec455 req-9b11a25f-fd59-45c6-b2f7-318bb6c5bb50 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:39.243784 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-a000b3e0-b96c-428e-99e7-1d1b8f5ec455 req-9b11a25f-fd59-45c6-b2f7-318bb6c5bb50 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:39.283871 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-a000b3e0-b96c-428e-99e7-1d1b8f5ec455 req-9b11a25f-fd59-45c6-b2f7-318bb6c5bb50 service nova] Creating event network-vif-deleted:029899f4-d7d1-4dce-bea8-98ad91749f24 for instance 3af57aa3-9dfb-436f-8b35-0ba727f4ceee on n-h2-852278-4 Aug 27 02:56:39.298172 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-a000b3e0-b96c-428e-99e7-1d1b8f5ec455 req-9b11a25f-fd59-45c6-b2f7-318bb6c5bb50 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099506 Aug 27 02:56:39.298816 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1673/3343] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:56:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:56:39.588782 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-17528280-b672-4cd1-97a0-86b987a26c1e tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:39.589625 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-17528280-b672-4cd1-97a0-86b987a26c1e tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] [instance: 31375ef8-ce19-46e1-b574-6252175884b7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:39.608239 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-17528280-b672-4cd1-97a0-86b987a26c1e tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:39.609954 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-17528280-b672-4cd1-97a0-86b987a26c1e tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:39.617908 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-17528280-b672-4cd1-97a0-86b987a26c1e tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:39.620925 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-17528280-b672-4cd1-97a0-86b987a26c1e tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:39.624670 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-17528280-b672-4cd1-97a0-86b987a26c1e tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:39.625861 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-17528280-b672-4cd1-97a0-86b987a26c1e tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:39.944378 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-17528280-b672-4cd1-97a0-86b987a26c1e tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52807fd89d4048f3a0034cb270ba2e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '244b19609b60427c80601c033539a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:39.997326 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3c1022bd-a09b-4b94-aeae-18968af8a16b tempest-ListImageFiltersNegativeTestJSON-94127187 tempest-ListImageFiltersNegativeTestJSON-94127187-project] Calling method '.version_select at 0x7f5ee30ac790>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:40.008884 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-17528280-b672-4cd1-97a0-86b987a26c1e tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] 10.222.0.70 "GET /compute/v2.1/servers/31375ef8-ce19-46e1-b574-6252175884b7" status: 200 len: 1288 microversion: 2.1 time: 0.413354 Aug 27 02:56:40.015747 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1671/3344] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:39 2022] GET /compute/v2.1/servers/31375ef8-ce19-46e1-b574-6252175884b7 => generated 1288 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:56:40.025894 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-3c1022bd-a09b-4b94-aeae-18968af8a16b tempest-ListImageFiltersNegativeTestJSON-94127187 tempest-ListImageFiltersNegativeTestJSON-94127187-project] HTTP exception thrown: Image not found. Aug 27 02:56:40.031514 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3c1022bd-a09b-4b94-aeae-18968af8a16b tempest-ListImageFiltersNegativeTestJSON-94127187 tempest-ListImageFiltersNegativeTestJSON-94127187-project] Request method failure captured: Aug 27 02:56:40.031514 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/images/7dd2aced-613c-4e53-9842-f61d2377c84b HTTP/1.1 Aug 27 02:56:40.031514 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:56:40.031514 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:56:40.031514 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:56:40.031514 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:56:40.031514 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:56:40.031514 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:56:40.031514 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:56:40.031514 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:56:40.031514 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYfnQPoBfX2dIGPNJ6LeVauhIiT_jAlUDUh-hz1f3Zdr1lbZ0tvPgE-XMEFdbd8INmCU0xIkbCxW9THnvNaEhxxyBqd4KKfa8iidqEAPrMSI-5jzqk4uIAx5FHCUSIHRbonazyKfsyelP4s_35mczzjTMDop1kuEqQ9KZO7u5PRdThQ Aug 27 02:56:40.031514 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:56:40.031514 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:56:40.031514 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:56:40.031514 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:56:40.031514 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:56:40.031514 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:56:40.031514 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: d888a880ac5c4d95b2b7a6e9f63aa9f3 Aug 27 02:56:40.031514 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-94127187 Aug 27 02:56:40.031514 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:56:40.031514 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:56:40.031514 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d888a880ac5c4d95b2b7a6e9f63aa9f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d888a880ac5c4d95b2b7a6e9f63aa9f3", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d888a880ac5c4d95b2b7a6e9f63aa9f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d888a880ac5c4d95b2b7a6e9f63aa9f3"}]}] Aug 27 02:56:40.031514 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-94127187 Aug 27 02:56:40.031514 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: d888a880ac5c4d95b2b7a6e9f63aa9f3 Aug 27 02:56:40.031514 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-94127187 Aug 27 02:56:40.031514 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ListImageFiltersNegativeTestJSON-94127187-project Aug 27 02:56:40.031514 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:56:40.031514 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:56:40.031514 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 22dd92cfea264d139a3568c6a82a6118 Aug 27 02:56:40.031514 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-94127187-project Aug 27 02:56:40.031514 n-d-852278-4 devstack@n-api.service[134052]: method: Aug 27 02:56:40.031514 n-d-852278-4 devstack@n-api.service[134052]: exception: Image not found. Aug 27 02:56:40.031514 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '7dd2aced-613c-4e53-9842-f61d2377c84b'} Aug 27 02:56:40.031514 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:56:40.031514 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:56:40.031514 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 02:56:40.031514 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 02:56:40.031514 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 02:56:40.031514 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 02:56:40.031514 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 02:56:40.031514 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 02:56:40.031514 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 02:56:40.031514 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 02:56:40.031514 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 02:56:40.031514 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 02:56:40.031514 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 02:56:40.031514 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 02:56:40.031514 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 02:56:40.031514 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 02:56:40.031514 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 02:56:40.031514 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 02:56:40.031514 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 7dd2aced-613c-4e53-9842-f61d2377c84b Aug 27 02:56:40.031514 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:56:40.031514 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:56:40.031514 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:56:40.031514 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:56:40.031514 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 27 02:56:40.031514 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 27 02:56:40.031514 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 27 02:56:40.031514 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 27 02:56:40.031514 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 27 02:56:40.031514 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 27 02:56:40.031514 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 27 02:56:40.036507 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 27 02:56:40.036507 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 02:56:40.036507 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 02:56:40.036507 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 02:56:40.036507 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 02:56:40.036507 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 02:56:40.036507 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 02:56:40.036507 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 02:56:40.036507 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 02:56:40.036507 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 02:56:40.036507 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 02:56:40.036507 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 02:56:40.036507 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 02:56:40.036507 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 02:56:40.036507 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 02:56:40.036507 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 02:56:40.036507 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 02:56:40.036507 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 7dd2aced-613c-4e53-9842-f61d2377c84b could not be found. Aug 27 02:56:40.036507 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:56:40.036507 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:56:40.036507 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:56:40.036507 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:56:40.036507 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:56:40.036507 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:56:40.036507 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:56:40.036507 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:56:40.036507 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:56:40.036507 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:56:40.036507 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:56:40.036507 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:56:40.036507 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 27 02:56:40.036507 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 27 02:56:40.036507 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 02:56:40.036507 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:56:40.036507 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:56:40.036507 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:56:40.036507 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:56:40.036507 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:56:40.036507 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:56:40.036507 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:56:40.036507 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:56:40.036507 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 02:56:40.036507 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:56:40.036507 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3c1022bd-a09b-4b94-aeae-18968af8a16b tempest-ListImageFiltersNegativeTestJSON-94127187 tempest-ListImageFiltersNegativeTestJSON-94127187-project] Returning 404 to user: Image not found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:56:40.036507 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-3c1022bd-a09b-4b94-aeae-18968af8a16b tempest-ListImageFiltersNegativeTestJSON-94127187 tempest-ListImageFiltersNegativeTestJSON-94127187-project] 10.222.0.70 "GET /compute/v2.1/images/7dd2aced-613c-4e53-9842-f61d2377c84b" status: 404 len: 62 microversion: 2.1 time: 0.272078 Aug 27 02:56:40.046372 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1674/3345] 10.222.0.70 () {58 vars in 1233 bytes} [Sat Aug 27 02:56:39 2022] GET /compute/v2.1/images/7dd2aced-613c-4e53-9842-f61d2377c84b => generated 62 bytes in 277 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 27 02:56:41.035596 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c8681cd3-605c-4fcb-97d8-b5c6ee64d425 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:41.036188 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-c8681cd3-605c-4fcb-97d8-b5c6ee64d425 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] [instance: 31375ef8-ce19-46e1-b574-6252175884b7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:41.043300 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c8681cd3-605c-4fcb-97d8-b5c6ee64d425 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:41.043798 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c8681cd3-605c-4fcb-97d8-b5c6ee64d425 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:41.044349 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c8681cd3-605c-4fcb-97d8-b5c6ee64d425 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:41.058048 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c8681cd3-605c-4fcb-97d8-b5c6ee64d425 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:41.058679 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c8681cd3-605c-4fcb-97d8-b5c6ee64d425 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:41.059449 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c8681cd3-605c-4fcb-97d8-b5c6ee64d425 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:41.204193 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-c8681cd3-605c-4fcb-97d8-b5c6ee64d425 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52807fd89d4048f3a0034cb270ba2e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '244b19609b60427c80601c033539a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:41.215727 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c8681cd3-605c-4fcb-97d8-b5c6ee64d425 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] 10.222.0.70 "GET /compute/v2.1/servers/31375ef8-ce19-46e1-b574-6252175884b7" status: 200 len: 1276 microversion: 2.1 time: 0.184236 Aug 27 02:56:41.218058 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1672/3346] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:41 2022] GET /compute/v2.1/servers/31375ef8-ce19-46e1-b574-6252175884b7 => generated 1276 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:56:41.337566 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-9f4c46f2-fa62-4199-b004-1210ad0f0fa9 req-ae3bf2fb-cd03-41e4-a40a-4e3332a210eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5baad75-87d5-4a3f-b3f8-73ca40b9781a", "name": "network-vif-deleted", "tag": "998bb2bb-d0ab-40ee-b888-9cc7df69e539"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:56:41.349739 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-9f4c46f2-fa62-4199-b004-1210ad0f0fa9 req-ae3bf2fb-cd03-41e4-a40a-4e3332a210eb service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:41.350808 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-9f4c46f2-fa62-4199-b004-1210ad0f0fa9 req-ae3bf2fb-cd03-41e4-a40a-4e3332a210eb service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:41.351506 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-9f4c46f2-fa62-4199-b004-1210ad0f0fa9 req-ae3bf2fb-cd03-41e4-a40a-4e3332a210eb service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:41.363422 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-9f4c46f2-fa62-4199-b004-1210ad0f0fa9 req-ae3bf2fb-cd03-41e4-a40a-4e3332a210eb service nova] Creating event network-vif-deleted:998bb2bb-d0ab-40ee-b888-9cc7df69e539 for instance c5baad75-87d5-4a3f-b3f8-73ca40b9781a on n-h1-852278-4 Aug 27 02:56:41.369603 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-9f4c46f2-fa62-4199-b004-1210ad0f0fa9 req-ae3bf2fb-cd03-41e4-a40a-4e3332a210eb service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036979 Aug 27 02:56:41.371097 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1675/3347] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:56:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:56:42.238355 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-87990f5f-447d-4061-917e-e0c542633f06 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:42.239094 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-87990f5f-447d-4061-917e-e0c542633f06 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] [instance: 31375ef8-ce19-46e1-b574-6252175884b7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:42.246350 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-87990f5f-447d-4061-917e-e0c542633f06 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:42.246870 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-87990f5f-447d-4061-917e-e0c542633f06 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:42.247314 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-87990f5f-447d-4061-917e-e0c542633f06 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:42.248130 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-87990f5f-447d-4061-917e-e0c542633f06 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:42.248821 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-87990f5f-447d-4061-917e-e0c542633f06 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:42.249412 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-87990f5f-447d-4061-917e-e0c542633f06 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:42.663689 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-87990f5f-447d-4061-917e-e0c542633f06 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52807fd89d4048f3a0034cb270ba2e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '244b19609b60427c80601c033539a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:42.674493 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-87990f5f-447d-4061-917e-e0c542633f06 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] 10.222.0.70 "GET /compute/v2.1/servers/31375ef8-ce19-46e1-b574-6252175884b7" status: 200 len: 1318 microversion: 2.1 time: 0.439987 Aug 27 02:56:42.677186 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1673/3348] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:42 2022] GET /compute/v2.1/servers/31375ef8-ce19-46e1-b574-6252175884b7 => generated 1318 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:56:43.438280 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-71fe9bbf-0b79-4eab-82d6-b2f8195ac98b req-2921a72f-0eeb-425d-9fbe-cd08991b0f7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31375ef8-ce19-46e1-b574-6252175884b7", "tag": "bafe066e-264c-48c2-921c-abcab1d80216"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:56:43.470809 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-71fe9bbf-0b79-4eab-82d6-b2f8195ac98b req-2921a72f-0eeb-425d-9fbe-cd08991b0f7d service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:43.471647 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-71fe9bbf-0b79-4eab-82d6-b2f8195ac98b req-2921a72f-0eeb-425d-9fbe-cd08991b0f7d service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:43.472582 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-71fe9bbf-0b79-4eab-82d6-b2f8195ac98b req-2921a72f-0eeb-425d-9fbe-cd08991b0f7d service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:43.536755 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-71fe9bbf-0b79-4eab-82d6-b2f8195ac98b req-2921a72f-0eeb-425d-9fbe-cd08991b0f7d service nova] Creating event network-changed:bafe066e-264c-48c2-921c-abcab1d80216 for instance 31375ef8-ce19-46e1-b574-6252175884b7 on n-h1-852278-4 Aug 27 02:56:43.542328 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-63ad3e6d-33b1-43b0-be57-fda7aaf65d0e tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:43.543545 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-63ad3e6d-33b1-43b0-be57-fda7aaf65d0e tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] [instance: b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:43.550333 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-71fe9bbf-0b79-4eab-82d6-b2f8195ac98b req-2921a72f-0eeb-425d-9fbe-cd08991b0f7d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128739 Aug 27 02:56:43.551289 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1676/3349] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:56:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:56:43.579160 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-63ad3e6d-33b1-43b0-be57-fda7aaf65d0e tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:43.584640 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-63ad3e6d-33b1-43b0-be57-fda7aaf65d0e tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:43.588521 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-63ad3e6d-33b1-43b0-be57-fda7aaf65d0e tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:43.592420 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-63ad3e6d-33b1-43b0-be57-fda7aaf65d0e tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:43.598467 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-63ad3e6d-33b1-43b0-be57-fda7aaf65d0e tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:43.599988 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-63ad3e6d-33b1-43b0-be57-fda7aaf65d0e tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:43.699219 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3c343462-4f1b-4b09-a022-bdad38f6ee6d tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:43.700262 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-3c343462-4f1b-4b09-a022-bdad38f6ee6d tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] [instance: 31375ef8-ce19-46e1-b574-6252175884b7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:43.708066 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3c343462-4f1b-4b09-a022-bdad38f6ee6d tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:43.708878 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3c343462-4f1b-4b09-a022-bdad38f6ee6d tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:43.709518 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3c343462-4f1b-4b09-a022-bdad38f6ee6d tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:43.710411 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3c343462-4f1b-4b09-a022-bdad38f6ee6d tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:43.711034 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3c343462-4f1b-4b09-a022-bdad38f6ee6d tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:43.711654 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3c343462-4f1b-4b09-a022-bdad38f6ee6d tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:44.460517 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-3c343462-4f1b-4b09-a022-bdad38f6ee6d tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52807fd89d4048f3a0034cb270ba2e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '244b19609b60427c80601c033539a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:44.474451 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-3c343462-4f1b-4b09-a022-bdad38f6ee6d tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] 10.222.0.70 "GET /compute/v2.1/servers/31375ef8-ce19-46e1-b574-6252175884b7" status: 200 len: 1318 microversion: 2.1 time: 0.779485 Aug 27 02:56:44.476994 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1677/3350] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:43 2022] GET /compute/v2.1/servers/31375ef8-ce19-46e1-b574-6252175884b7 => generated 1318 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:56:44.561794 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-63ad3e6d-33b1-43b0-be57-fda7aaf65d0e tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:44.574293 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-63ad3e6d-33b1-43b0-be57-fda7aaf65d0e tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:44.576673 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-63ad3e6d-33b1-43b0-be57-fda7aaf65d0e tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:44.578188 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-63ad3e6d-33b1-43b0-be57-fda7aaf65d0e tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] 10.222.0.70 "GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7" status: 200 len: 2948 microversion: 2.32 time: 1.044555 Aug 27 02:56:44.579006 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1674/3351] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:56:43 2022] GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 => generated 2948 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:56:44.605157 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-fa9f006e-43ff-4591-9de4-bd6fde3976d1 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:44.605949 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-fa9f006e-43ff-4591-9de4-bd6fde3976d1 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] [instance: b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:44.612806 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fa9f006e-43ff-4591-9de4-bd6fde3976d1 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:44.613536 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fa9f006e-43ff-4591-9de4-bd6fde3976d1 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:44.614137 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fa9f006e-43ff-4591-9de4-bd6fde3976d1 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:44.615153 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fa9f006e-43ff-4591-9de4-bd6fde3976d1 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:44.615825 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fa9f006e-43ff-4591-9de4-bd6fde3976d1 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:44.616465 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fa9f006e-43ff-4591-9de4-bd6fde3976d1 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:44.664714 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-e83837f5-3ae2-4f27-96ac-8a167334b8a9 req-84b9bf98-648d-431b-a90c-1fdfc3c563fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "497196bf-70cb-417d-a396-ebf6e5418547", "tag": "9a79aa81-4cce-4ae9-8d6a-a09de5e0b186"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:56:44.676945 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-e83837f5-3ae2-4f27-96ac-8a167334b8a9 req-84b9bf98-648d-431b-a90c-1fdfc3c563fd service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:44.678346 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-e83837f5-3ae2-4f27-96ac-8a167334b8a9 req-84b9bf98-648d-431b-a90c-1fdfc3c563fd service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:44.679028 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-e83837f5-3ae2-4f27-96ac-8a167334b8a9 req-84b9bf98-648d-431b-a90c-1fdfc3c563fd service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:44.693319 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-e83837f5-3ae2-4f27-96ac-8a167334b8a9 req-84b9bf98-648d-431b-a90c-1fdfc3c563fd service nova] Creating event network-changed:9a79aa81-4cce-4ae9-8d6a-a09de5e0b186 for instance 497196bf-70cb-417d-a396-ebf6e5418547 on n-h1-852278-4 Aug 27 02:56:44.699421 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-e83837f5-3ae2-4f27-96ac-8a167334b8a9 req-84b9bf98-648d-431b-a90c-1fdfc3c563fd service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039192 Aug 27 02:56:44.701025 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1675/3352] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:56:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:56:44.940126 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-fa9f006e-43ff-4591-9de4-bd6fde3976d1 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] 10.222.0.70 "GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7/os-interface" status: 200 len: 1830 microversion: 2.32 time: 0.338977 Aug 27 02:56:44.941743 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1678/3353] 10.222.0.70 () {60 vars in 1316 bytes} [Sat Aug 27 02:56:44 2022] GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7/os-interface => generated 1830 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:56:45.500819 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-dff7b1a1-38a9-4491-9479-4acb29b0d2e9 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:45.501790 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-dff7b1a1-38a9-4491-9479-4acb29b0d2e9 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] [instance: 31375ef8-ce19-46e1-b574-6252175884b7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:45.516550 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dff7b1a1-38a9-4491-9479-4acb29b0d2e9 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:45.517295 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dff7b1a1-38a9-4491-9479-4acb29b0d2e9 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:45.518071 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dff7b1a1-38a9-4491-9479-4acb29b0d2e9 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:45.519476 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dff7b1a1-38a9-4491-9479-4acb29b0d2e9 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:45.521424 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dff7b1a1-38a9-4491-9479-4acb29b0d2e9 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:45.522159 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dff7b1a1-38a9-4491-9479-4acb29b0d2e9 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:45.841929 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-dff7b1a1-38a9-4491-9479-4acb29b0d2e9 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52807fd89d4048f3a0034cb270ba2e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '244b19609b60427c80601c033539a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:45.855365 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-dff7b1a1-38a9-4491-9479-4acb29b0d2e9 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] 10.222.0.70 "GET /compute/v2.1/servers/31375ef8-ce19-46e1-b574-6252175884b7" status: 200 len: 1318 microversion: 2.1 time: 0.359483 Aug 27 02:56:45.856892 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1676/3354] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:45 2022] GET /compute/v2.1/servers/31375ef8-ce19-46e1-b574-6252175884b7 => generated 1318 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:56:46.875045 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=6 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:56:46.880149 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c7dc2ce3-d49f-437b-9edd-ca4f4b6394c1 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:46.881079 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-c7dc2ce3-d49f-437b-9edd-ca4f4b6394c1 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] [instance: 31375ef8-ce19-46e1-b574-6252175884b7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:46.906248 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c7dc2ce3-d49f-437b-9edd-ca4f4b6394c1 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:46.908029 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c7dc2ce3-d49f-437b-9edd-ca4f4b6394c1 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:46.908702 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c7dc2ce3-d49f-437b-9edd-ca4f4b6394c1 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:46.909734 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c7dc2ce3-d49f-437b-9edd-ca4f4b6394c1 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:46.910374 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c7dc2ce3-d49f-437b-9edd-ca4f4b6394c1 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:46.910974 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c7dc2ce3-d49f-437b-9edd-ca4f4b6394c1 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:47.119151 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=4 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:56:47.194659 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-c7dc2ce3-d49f-437b-9edd-ca4f4b6394c1 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52807fd89d4048f3a0034cb270ba2e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '244b19609b60427c80601c033539a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:47.206693 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c7dc2ce3-d49f-437b-9edd-ca4f4b6394c1 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] 10.222.0.70 "GET /compute/v2.1/servers/31375ef8-ce19-46e1-b574-6252175884b7" status: 200 len: 1318 microversion: 2.1 time: 0.333344 Aug 27 02:56:47.208522 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1679/3355] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:46 2022] GET /compute/v2.1/servers/31375ef8-ce19-46e1-b574-6252175884b7 => generated 1318 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:56:48.103666 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-61a321d5-4126-4b4e-8027-b48e907d879c tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:48.110336 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-61a321d5-4126-4b4e-8027-b48e907d879c tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c501b75773884dd7bf574035b88fc5d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c997efbeda2c4a2db15e9fe38ab96959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:48.111373 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-61a321d5-4126-4b4e-8027-b48e907d879c tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Searching by: {'deleted': False, 'project_id': 'c997efbeda2c4a2db15e9fe38ab96959'} {{(pid=134051) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 02:56:48.124879 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:56:48.127103 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-61a321d5-4126-4b4e-8027-b48e907d879c tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:48.127587 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-61a321d5-4126-4b4e-8027-b48e907d879c tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:48.128017 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-61a321d5-4126-4b4e-8027-b48e907d879c tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:48.128985 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-61a321d5-4126-4b4e-8027-b48e907d879c tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:48.129644 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-61a321d5-4126-4b4e-8027-b48e907d879c tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:48.130060 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-61a321d5-4126-4b4e-8027-b48e907d879c tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:48.178296 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.multi_cell_list [None req-61a321d5-4126-4b4e-8027-b48e907d879c tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=134051) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 02:56:48.220481 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-61a321d5-4126-4b4e-8027-b48e907d879c tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] 10.222.0.70 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.125858 Aug 27 02:56:48.227638 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-39275886-fc46-4903-8e17-2e716c6c28bc tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:48.236598 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-39275886-fc46-4903-8e17-2e716c6c28bc tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] [instance: 31375ef8-ce19-46e1-b574-6252175884b7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:48.245924 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1677/3356] 10.222.0.70 () {58 vars in 1125 bytes} [Sat Aug 27 02:56:48 2022] GET /compute/v2.1/servers => generated 340 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:56:48.258910 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a69e9ac3-f9bc-4538-9082-8b30c22f4608 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:48.262921 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-39275886-fc46-4903-8e17-2e716c6c28bc tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:48.263430 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-39275886-fc46-4903-8e17-2e716c6c28bc tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:48.263861 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-39275886-fc46-4903-8e17-2e716c6c28bc tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:48.276668 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-39275886-fc46-4903-8e17-2e716c6c28bc tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:48.280787 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-39275886-fc46-4903-8e17-2e716c6c28bc tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:48.281228 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-39275886-fc46-4903-8e17-2e716c6c28bc tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:48.288120 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-a69e9ac3-f9bc-4538-9082-8b30c22f4608 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c501b75773884dd7bf574035b88fc5d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c997efbeda2c4a2db15e9fe38ab96959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:48.289017 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-a69e9ac3-f9bc-4538-9082-8b30c22f4608 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Searching by: {'deleted': False, 'project_id': 'c997efbeda2c4a2db15e9fe38ab96959'} {{(pid=134051) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 02:56:48.298633 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:56:48.304828 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a69e9ac3-f9bc-4538-9082-8b30c22f4608 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:48.305623 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a69e9ac3-f9bc-4538-9082-8b30c22f4608 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:48.306261 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a69e9ac3-f9bc-4538-9082-8b30c22f4608 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:48.307420 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a69e9ac3-f9bc-4538-9082-8b30c22f4608 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:48.308663 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a69e9ac3-f9bc-4538-9082-8b30c22f4608 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:48.310467 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a69e9ac3-f9bc-4538-9082-8b30c22f4608 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:48.356269 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.multi_cell_list [None req-a69e9ac3-f9bc-4538-9082-8b30c22f4608 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=134051) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 02:56:48.420619 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-a69e9ac3-f9bc-4538-9082-8b30c22f4608 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c501b75773884dd7bf574035b88fc5d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c997efbeda2c4a2db15e9fe38ab96959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:48.429729 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a69e9ac3-f9bc-4538-9082-8b30c22f4608 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:48.430215 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a69e9ac3-f9bc-4538-9082-8b30c22f4608 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:48.430645 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a69e9ac3-f9bc-4538-9082-8b30c22f4608 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:49.255969 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a69e9ac3-f9bc-4538-9082-8b30c22f4608 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] 10.222.0.70 "GET /compute/v2.1/servers/detail" status: 200 len: 1710 microversion: 2.1 time: 1.000854 Aug 27 02:56:49.256645 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1678/3357] 10.222.0.70 () {58 vars in 1146 bytes} [Sat Aug 27 02:56:48 2022] GET /compute/v2.1/servers/detail => generated 1710 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:56:49.279175 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-1bb60c2f-e300-4ece-a35c-db356b990b32 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:49.289281 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-1bb60c2f-e300-4ece-a35c-db356b990b32 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] 10.222.0.70 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013765 Aug 27 02:56:49.290468 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1679/3358] 10.222.0.70 () {58 vars in 1137 bytes} [Sat Aug 27 02:56:49 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:56:49.304642 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-39275886-fc46-4903-8e17-2e716c6c28bc tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52807fd89d4048f3a0034cb270ba2e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '244b19609b60427c80601c033539a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:49.316635 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-39275886-fc46-4903-8e17-2e716c6c28bc tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] 10.222.0.70 "GET /compute/v2.1/servers/31375ef8-ce19-46e1-b574-6252175884b7" status: 200 len: 1318 microversion: 2.1 time: 1.092627 Aug 27 02:56:49.324370 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1680/3359] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:48 2022] GET /compute/v2.1/servers/31375ef8-ce19-46e1-b574-6252175884b7 => generated 1318 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:56:49.608177 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-41bf6d21-09f8-4f64-807f-2741d13e7237 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:49.609375 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-41bf6d21-09f8-4f64-807f-2741d13e7237 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] [instance: eaad739b-53d7-4128-8392-92ee0a953afa] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:49.618275 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-41bf6d21-09f8-4f64-807f-2741d13e7237 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:49.618840 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-41bf6d21-09f8-4f64-807f-2741d13e7237 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:49.619283 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-41bf6d21-09f8-4f64-807f-2741d13e7237 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:49.620007 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-41bf6d21-09f8-4f64-807f-2741d13e7237 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:49.620491 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-41bf6d21-09f8-4f64-807f-2741d13e7237 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:49.620920 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-41bf6d21-09f8-4f64-807f-2741d13e7237 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:49.687439 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-41bf6d21-09f8-4f64-807f-2741d13e7237 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] [instance: eaad739b-53d7-4128-8392-92ee0a953afa] Going to try to terminate instance {{(pid=134051) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:56:49.796516 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:56:49.911594 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-41bf6d21-09f8-4f64-807f-2741d13e7237 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] 10.222.0.70 "DELETE /compute/v2.1/servers/eaad739b-53d7-4128-8392-92ee0a953afa" status: 204 len: 0 microversion: 2.1 time: 0.305678 Aug 27 02:56:49.913695 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1680/3360] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:56:49 2022] DELETE /compute/v2.1/servers/eaad739b-53d7-4128-8392-92ee0a953afa => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:56:49.923750 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-bf5a2594-0226-491f-87fe-ebabc1327ea9 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:49.924610 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-bf5a2594-0226-491f-87fe-ebabc1327ea9 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] [instance: eaad739b-53d7-4128-8392-92ee0a953afa] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:49.943695 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bf5a2594-0226-491f-87fe-ebabc1327ea9 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:49.949527 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bf5a2594-0226-491f-87fe-ebabc1327ea9 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:49.949994 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bf5a2594-0226-491f-87fe-ebabc1327ea9 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:49.952958 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bf5a2594-0226-491f-87fe-ebabc1327ea9 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:49.958470 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bf5a2594-0226-491f-87fe-ebabc1327ea9 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:49.959081 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bf5a2594-0226-491f-87fe-ebabc1327ea9 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:50.341260 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-cab7b575-dbae-4c52-a0f1-f64633579475 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:50.341973 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-cab7b575-dbae-4c52-a0f1-f64633579475 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] [instance: 31375ef8-ce19-46e1-b574-6252175884b7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:50.370255 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cab7b575-dbae-4c52-a0f1-f64633579475 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:50.372735 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cab7b575-dbae-4c52-a0f1-f64633579475 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:50.373195 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cab7b575-dbae-4c52-a0f1-f64633579475 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:50.374015 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cab7b575-dbae-4c52-a0f1-f64633579475 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:50.374380 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cab7b575-dbae-4c52-a0f1-f64633579475 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:50.374805 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cab7b575-dbae-4c52-a0f1-f64633579475 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:50.726055 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-bf5a2594-0226-491f-87fe-ebabc1327ea9 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c501b75773884dd7bf574035b88fc5d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c997efbeda2c4a2db15e9fe38ab96959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:50.737438 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-bf5a2594-0226-491f-87fe-ebabc1327ea9 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] 10.222.0.70 "GET /compute/v2.1/servers/eaad739b-53d7-4128-8392-92ee0a953afa" status: 200 len: 1713 microversion: 2.1 time: 0.819145 Aug 27 02:56:50.749931 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1681/3361] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:49 2022] GET /compute/v2.1/servers/eaad739b-53d7-4128-8392-92ee0a953afa => generated 1713 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:56:50.906872 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-cab7b575-dbae-4c52-a0f1-f64633579475 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52807fd89d4048f3a0034cb270ba2e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '244b19609b60427c80601c033539a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:50.921888 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-cab7b575-dbae-4c52-a0f1-f64633579475 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] 10.222.0.70 "GET /compute/v2.1/servers/31375ef8-ce19-46e1-b574-6252175884b7" status: 200 len: 1318 microversion: 2.1 time: 0.586219 Aug 27 02:56:50.936291 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1681/3362] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:50 2022] GET /compute/v2.1/servers/31375ef8-ce19-46e1-b574-6252175884b7 => generated 1318 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:56:51.725906 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-041eb696-698b-4846-b816-d29a0627b4ad req-f24b5adf-9181-4cf8-8d95-dbfa8876b0b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31375ef8-ce19-46e1-b574-6252175884b7", "name": "network-vif-plugged", "status": "completed", "tag": "bafe066e-264c-48c2-921c-abcab1d80216"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:56:51.756267 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-041eb696-698b-4846-b816-d29a0627b4ad req-f24b5adf-9181-4cf8-8d95-dbfa8876b0b1 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:51.761224 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-041eb696-698b-4846-b816-d29a0627b4ad req-f24b5adf-9181-4cf8-8d95-dbfa8876b0b1 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:51.762298 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-041eb696-698b-4846-b816-d29a0627b4ad req-f24b5adf-9181-4cf8-8d95-dbfa8876b0b1 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:51.767976 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-1e10c03b-a401-46e2-b086-2662ffbbcbc1 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:51.769774 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-1e10c03b-a401-46e2-b086-2662ffbbcbc1 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] [instance: eaad739b-53d7-4128-8392-92ee0a953afa] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:51.782438 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1e10c03b-a401-46e2-b086-2662ffbbcbc1 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:51.784275 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1e10c03b-a401-46e2-b086-2662ffbbcbc1 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:51.787523 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1e10c03b-a401-46e2-b086-2662ffbbcbc1 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:51.788615 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1e10c03b-a401-46e2-b086-2662ffbbcbc1 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:51.789732 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1e10c03b-a401-46e2-b086-2662ffbbcbc1 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:51.790166 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1e10c03b-a401-46e2-b086-2662ffbbcbc1 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:51.806033 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-041eb696-698b-4846-b816-d29a0627b4ad req-f24b5adf-9181-4cf8-8d95-dbfa8876b0b1 service nova] Creating event network-vif-plugged:bafe066e-264c-48c2-921c-abcab1d80216 for instance 31375ef8-ce19-46e1-b574-6252175884b7 on n-h1-852278-4 Aug 27 02:56:51.814602 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-041eb696-698b-4846-b816-d29a0627b4ad req-f24b5adf-9181-4cf8-8d95-dbfa8876b0b1 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096858 Aug 27 02:56:51.817283 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1682/3363] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:56:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:56:51.944059 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-1b01a474-9280-4439-988a-3c12c10d6ccc tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:51.945937 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-1b01a474-9280-4439-988a-3c12c10d6ccc tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] [instance: 31375ef8-ce19-46e1-b574-6252175884b7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:51.954645 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1b01a474-9280-4439-988a-3c12c10d6ccc tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:51.955465 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1b01a474-9280-4439-988a-3c12c10d6ccc tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:51.956822 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1b01a474-9280-4439-988a-3c12c10d6ccc tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:51.957973 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1b01a474-9280-4439-988a-3c12c10d6ccc tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:51.958660 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1b01a474-9280-4439-988a-3c12c10d6ccc tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:51.959312 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1b01a474-9280-4439-988a-3c12c10d6ccc tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:52.008688 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:56:52.668089 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-1e10c03b-a401-46e2-b086-2662ffbbcbc1 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c501b75773884dd7bf574035b88fc5d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c997efbeda2c4a2db15e9fe38ab96959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:52.674097 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-1b01a474-9280-4439-988a-3c12c10d6ccc tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52807fd89d4048f3a0034cb270ba2e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '244b19609b60427c80601c033539a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:52.676429 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-1e10c03b-a401-46e2-b086-2662ffbbcbc1 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] 10.222.0.70 "GET /compute/v2.1/servers/eaad739b-53d7-4128-8392-92ee0a953afa" status: 200 len: 1713 microversion: 2.1 time: 0.913084 Aug 27 02:56:52.683059 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1682/3364] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:51 2022] GET /compute/v2.1/servers/eaad739b-53d7-4128-8392-92ee0a953afa => generated 1713 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:56:52.701559 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-1b01a474-9280-4439-988a-3c12c10d6ccc tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] 10.222.0.70 "GET /compute/v2.1/servers/31375ef8-ce19-46e1-b574-6252175884b7" status: 200 len: 1318 microversion: 2.1 time: 0.763131 Aug 27 02:56:52.715941 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1683/3365] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:51 2022] GET /compute/v2.1/servers/31375ef8-ce19-46e1-b574-6252175884b7 => generated 1318 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:56:53.463145 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-b431b084-e881-473a-a790-e9615a1698f3 req-8d419f4a-ff29-4806-a48e-48160e4dbe50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eaad739b-53d7-4128-8392-92ee0a953afa", "name": "network-vif-deleted", "tag": "f5277d96-257e-4ea0-9978-d01e2d410339"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:56:53.479306 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-b431b084-e881-473a-a790-e9615a1698f3 req-8d419f4a-ff29-4806-a48e-48160e4dbe50 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:53.493372 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-b431b084-e881-473a-a790-e9615a1698f3 req-8d419f4a-ff29-4806-a48e-48160e4dbe50 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:53.494747 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-b431b084-e881-473a-a790-e9615a1698f3 req-8d419f4a-ff29-4806-a48e-48160e4dbe50 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:53.528952 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-b431b084-e881-473a-a790-e9615a1698f3 req-8d419f4a-ff29-4806-a48e-48160e4dbe50 service nova] Creating event network-vif-deleted:f5277d96-257e-4ea0-9978-d01e2d410339 for instance eaad739b-53d7-4128-8392-92ee0a953afa on n-h2-852278-4 Aug 27 02:56:53.557332 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-b431b084-e881-473a-a790-e9615a1698f3 req-8d419f4a-ff29-4806-a48e-48160e4dbe50 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098276 Aug 27 02:56:53.562258 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1683/3366] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:56:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:56:53.700973 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6a30685a-b717-4830-8557-ae487c106db5 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:53.702655 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-6a30685a-b717-4830-8557-ae487c106db5 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] [instance: eaad739b-53d7-4128-8392-92ee0a953afa] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:53.717257 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6a30685a-b717-4830-8557-ae487c106db5 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:53.718072 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6a30685a-b717-4830-8557-ae487c106db5 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:53.718891 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6a30685a-b717-4830-8557-ae487c106db5 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:53.719833 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6a30685a-b717-4830-8557-ae487c106db5 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:53.721207 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6a30685a-b717-4830-8557-ae487c106db5 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:53.721810 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6a30685a-b717-4830-8557-ae487c106db5 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:53.723216 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-730e42fb-d301-4ea9-8ac3-e08a2b65c144 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:53.723938 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-730e42fb-d301-4ea9-8ac3-e08a2b65c144 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] [instance: 31375ef8-ce19-46e1-b574-6252175884b7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:53.739997 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-730e42fb-d301-4ea9-8ac3-e08a2b65c144 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:53.740541 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-730e42fb-d301-4ea9-8ac3-e08a2b65c144 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:53.740996 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-730e42fb-d301-4ea9-8ac3-e08a2b65c144 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:53.741727 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-730e42fb-d301-4ea9-8ac3-e08a2b65c144 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:53.742180 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-730e42fb-d301-4ea9-8ac3-e08a2b65c144 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:53.754969 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-730e42fb-d301-4ea9-8ac3-e08a2b65c144 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:53.861094 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6a30685a-b717-4830-8557-ae487c106db5 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:53.865379 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6a30685a-b717-4830-8557-ae487c106db5 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:53.866122 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6a30685a-b717-4830-8557-ae487c106db5 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:53.866750 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.instance [None req-6a30685a-b717-4830-8557-ae487c106db5 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Lazy-loading 'fault' on Instance uuid eaad739b-53d7-4128-8392-92ee0a953afa {{(pid=134052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:56:54.284020 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-6a30685a-b717-4830-8557-ae487c106db5 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c501b75773884dd7bf574035b88fc5d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c997efbeda2c4a2db15e9fe38ab96959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:54.320522 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-6a30685a-b717-4830-8557-ae487c106db5 tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] 10.222.0.70 "GET /compute/v2.1/servers/eaad739b-53d7-4128-8392-92ee0a953afa" status: 200 len: 1368 microversion: 2.1 time: 0.625275 Aug 27 02:56:54.324221 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1684/3367] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:53 2022] GET /compute/v2.1/servers/eaad739b-53d7-4128-8392-92ee0a953afa => generated 1368 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:56:54.338776 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-882df8ad-2898-4139-9bc2-571d4dd44a8a req-f60d69bf-40b1-406e-9333-d3de564e5c84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "497196bf-70cb-417d-a396-ebf6e5418547", "name": "network-vif-plugged", "status": "completed", "tag": "9a79aa81-4cce-4ae9-8d6a-a09de5e0b186"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:56:54.391264 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-882df8ad-2898-4139-9bc2-571d4dd44a8a req-f60d69bf-40b1-406e-9333-d3de564e5c84 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:54.392353 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-882df8ad-2898-4139-9bc2-571d4dd44a8a req-f60d69bf-40b1-406e-9333-d3de564e5c84 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:54.394469 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-882df8ad-2898-4139-9bc2-571d4dd44a8a req-f60d69bf-40b1-406e-9333-d3de564e5c84 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:54.445156 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-882df8ad-2898-4139-9bc2-571d4dd44a8a req-f60d69bf-40b1-406e-9333-d3de564e5c84 service nova] Creating event network-vif-plugged:9a79aa81-4cce-4ae9-8d6a-a09de5e0b186 for instance 497196bf-70cb-417d-a396-ebf6e5418547 on n-h1-852278-4 Aug 27 02:56:54.458323 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-882df8ad-2898-4139-9bc2-571d4dd44a8a req-f60d69bf-40b1-406e-9333-d3de564e5c84 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131145 Aug 27 02:56:54.470864 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1685/3368] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:56:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:56:54.618084 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-730e42fb-d301-4ea9-8ac3-e08a2b65c144 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52807fd89d4048f3a0034cb270ba2e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '244b19609b60427c80601c033539a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:54.632274 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-730e42fb-d301-4ea9-8ac3-e08a2b65c144 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] 10.222.0.70 "GET /compute/v2.1/servers/31375ef8-ce19-46e1-b574-6252175884b7" status: 200 len: 1318 microversion: 2.1 time: 0.912012 Aug 27 02:56:54.633429 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1684/3369] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:53 2022] GET /compute/v2.1/servers/31375ef8-ce19-46e1-b574-6252175884b7 => generated 1318 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:56:54.888444 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-2c8bd7c4-6dad-45d9-b869-20b5f2301dc5 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Action: 'create', calling method: .version_select at 0x7f5ee3490940>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-674481318", "description": "tempest-description-190633747"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:56:55.351933 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-35d33bdc-7d66-4fd8-aff4-28f432bb4dab tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:55.353105 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-35d33bdc-7d66-4fd8-aff4-28f432bb4dab tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] [instance: eaad739b-53d7-4128-8392-92ee0a953afa] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:55.362041 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-35d33bdc-7d66-4fd8-aff4-28f432bb4dab tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:55.362985 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-35d33bdc-7d66-4fd8-aff4-28f432bb4dab tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:55.363702 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-35d33bdc-7d66-4fd8-aff4-28f432bb4dab tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:55.365013 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-35d33bdc-7d66-4fd8-aff4-28f432bb4dab tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:55.365896 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-35d33bdc-7d66-4fd8-aff4-28f432bb4dab tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:55.367349 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-35d33bdc-7d66-4fd8-aff4-28f432bb4dab tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:55.390100 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-35d33bdc-7d66-4fd8-aff4-28f432bb4dab tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] HTTP exception thrown: Instance eaad739b-53d7-4128-8392-92ee0a953afa could not be found. Aug 27 02:56:55.393975 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-35d33bdc-7d66-4fd8-aff4-28f432bb4dab tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Request method failure captured: Aug 27 02:56:55.393975 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/eaad739b-53d7-4128-8392-92ee0a953afa HTTP/1.1 Aug 27 02:56:55.393975 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:56:55.393975 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:56:55.393975 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:56:55.393975 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:56:55.393975 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:56:55.393975 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:56:55.393975 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:56:55.393975 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:56:55.393975 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYewQJB5-y37X9LMT8CNHKYTvGz3CJ-sYdOuDvQshN-HK9Vo61xcTKBcy94F3nbUfPEkxQKz59QaUsGVkyLCsqJdDdTRY2pqPv5mHkKTt54wUqYbxlDYh9Xqb5zEbfFfW0OiFZXJml0xooEv0e1ijoPJnmj3vxThAk2JL2QJv5VJX6Y Aug 27 02:56:55.393975 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:56:55.393975 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:56:55.393975 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:56:55.393975 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:56:55.393975 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:56:55.393975 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:56:55.393975 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: c997efbeda2c4a2db15e9fe38ab96959 Aug 27 02:56:55.393975 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ServersTestManualDisk-166289187 Aug 27 02:56:55.393975 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:56:55.393975 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:56:55.393975 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c997efbeda2c4a2db15e9fe38ab96959"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c997efbeda2c4a2db15e9fe38ab96959", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c997efbeda2c4a2db15e9fe38ab96959"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c997efbeda2c4a2db15e9fe38ab96959"}]}] Aug 27 02:56:55.393975 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ServersTestManualDisk-166289187 Aug 27 02:56:55.393975 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: c997efbeda2c4a2db15e9fe38ab96959 Aug 27 02:56:55.393975 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ServersTestManualDisk-166289187 Aug 27 02:56:55.393975 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ServersTestManualDisk-166289187-project Aug 27 02:56:55.393975 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:56:55.393975 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:56:55.393975 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: c501b75773884dd7bf574035b88fc5d2 Aug 27 02:56:55.393975 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ServersTestManualDisk-166289187-project Aug 27 02:56:55.393975 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 02:56:55.393975 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance eaad739b-53d7-4128-8392-92ee0a953afa could not be found. Aug 27 02:56:55.393975 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': 'eaad739b-53d7-4128-8392-92ee0a953afa'} Aug 27 02:56:55.393975 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:56:55.393975 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:56:55.393975 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:56:55.393975 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:56:55.393975 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:56:55.393975 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:56:55.393975 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:56:55.393975 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:56:55.393975 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:56:55.393975 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:56:55.393975 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eaad739b-53d7-4128-8392-92ee0a953afa could not be found. Aug 27 02:56:55.393975 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:56:55.393975 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:56:55.393975 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:56:55.393975 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:56:55.393975 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:56:55.393975 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:56:55.393975 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:56:55.393975 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:56:55.393975 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:56:55.393975 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:56:55.393975 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:56:55.393975 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:56:55.393975 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:56:55.393975 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:56:55.393975 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:56:55.393975 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:56:55.393975 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eaad739b-53d7-4128-8392-92ee0a953afa could not be found. Aug 27 02:56:55.393975 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:56:55.393975 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:56:55.393975 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:56:55.402169 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:56:55.402169 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:56:55.402169 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:56:55.402169 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:56:55.402169 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:56:55.402169 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eaad739b-53d7-4128-8392-92ee0a953afa could not be found. Aug 27 02:56:55.402169 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:56:55.403419 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-2c8bd7c4-6dad-45d9-b869-20b5f2301dc5 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] 10.222.0.70 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.725866 Aug 27 02:56:55.403419 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1686/3370] 10.222.0.70 () {60 vars in 1180 bytes} [Sat Aug 27 02:56:54 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:56:55.407005 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-35d33bdc-7d66-4fd8-aff4-28f432bb4dab tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Returning 404 to user: Instance eaad739b-53d7-4128-8392-92ee0a953afa could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:56:55.408773 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-35d33bdc-7d66-4fd8-aff4-28f432bb4dab tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] 10.222.0.70 "GET /compute/v2.1/servers/eaad739b-53d7-4128-8392-92ee0a953afa" status: 404 len: 111 microversion: 2.1 time: 0.063040 Aug 27 02:56:55.409790 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6248d2ee-45de-4b7b-8d1c-8714e966aab8 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Action: 'create', calling method: .version_select at 0x7f5ee30eeb80>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-757177487", "description": "tempest-description-1279039483"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:56:55.412736 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1685/3371] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:55 2022] GET /compute/v2.1/servers/eaad739b-53d7-4128-8392-92ee0a953afa => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 02:56:55.433980 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e9898b93-2638-44d6-8ad0-c92775a0693d tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] Calling method '.version_select at 0x7f5ede8f70d0>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:55.471313 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e9898b93-2638-44d6-8ad0-c92775a0693d tempest-ServersTestManualDisk-166289187 tempest-ServersTestManualDisk-166289187-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1644598461" status: 202 len: 0 microversion: 2.1 time: 0.054849 Aug 27 02:56:55.472390 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1686/3372] 10.222.0.70 () {58 vars in 1221 bytes} [Sat Aug 27 02:56:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1644598461 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:56:55.656598 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ae73dd7e-7e20-4fee-938d-673d2db6718c tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:55.657305 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-ae73dd7e-7e20-4fee-938d-673d2db6718c tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] [instance: 31375ef8-ce19-46e1-b574-6252175884b7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:55.668371 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ae73dd7e-7e20-4fee-938d-673d2db6718c tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:55.675537 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ae73dd7e-7e20-4fee-938d-673d2db6718c tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:55.675995 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ae73dd7e-7e20-4fee-938d-673d2db6718c tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:55.677076 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ae73dd7e-7e20-4fee-938d-673d2db6718c tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:55.678039 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ae73dd7e-7e20-4fee-938d-673d2db6718c tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:55.678679 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ae73dd7e-7e20-4fee-938d-673d2db6718c tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:56.568011 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-6248d2ee-45de-4b7b-8d1c-8714e966aab8 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] 10.222.0.70 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.164071 Aug 27 02:56:56.569769 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1687/3373] 10.222.0.70 () {60 vars in 1180 bytes} [Sat Aug 27 02:56:55 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:56:56.663866 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-ae73dd7e-7e20-4fee-938d-673d2db6718c tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52807fd89d4048f3a0034cb270ba2e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '244b19609b60427c80601c033539a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:56.675328 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ae73dd7e-7e20-4fee-938d-673d2db6718c tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] 10.222.0.70 "GET /compute/v2.1/servers/31375ef8-ce19-46e1-b574-6252175884b7" status: 200 len: 1507 microversion: 2.1 time: 1.022908 Aug 27 02:56:56.678063 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1687/3374] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:55 2022] GET /compute/v2.1/servers/31375ef8-ce19-46e1-b574-6252175884b7 => generated 1507 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:56:56.700157 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-303b7478-6bc3-4f91-9202-e7b9ced3333f tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:56.703213 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-303b7478-6bc3-4f91-9202-e7b9ced3333f tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] [instance: 497196bf-70cb-417d-a396-ebf6e5418547] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:56.713525 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-303b7478-6bc3-4f91-9202-e7b9ced3333f tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:56.715153 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-303b7478-6bc3-4f91-9202-e7b9ced3333f tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:56.715828 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-303b7478-6bc3-4f91-9202-e7b9ced3333f tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:56.716768 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-303b7478-6bc3-4f91-9202-e7b9ced3333f tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:56.717455 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-303b7478-6bc3-4f91-9202-e7b9ced3333f tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:56.718174 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-303b7478-6bc3-4f91-9202-e7b9ced3333f tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:56.843265 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-15735be8-41fe-47b2-bb2a-657220ef07c7 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1689953673", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "networks": [{"uuid": "53b4444b-c159-4662-80fb-650a74ad037c"}]}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:56:56.904799 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.network.neutron [None req-15735be8-41fe-47b2-bb2a-657220ef07c7 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] validate_networks() for [('53b4444b-c159-4662-80fb-650a74ad037c', None, None, None, None, None)] {{(pid=134051) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:56:57.081849 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-303b7478-6bc3-4f91-9202-e7b9ced3333f tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52807fd89d4048f3a0034cb270ba2e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '244b19609b60427c80601c033539a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:57.091097 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-303b7478-6bc3-4f91-9202-e7b9ced3333f tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] 10.222.0.70 "GET /compute/v2.1/servers/497196bf-70cb-417d-a396-ebf6e5418547" status: 200 len: 1506 microversion: 2.1 time: 0.395822 Aug 27 02:56:57.112004 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1688/3375] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:56 2022] GET /compute/v2.1/servers/497196bf-70cb-417d-a396-ebf6e5418547 => generated 1506 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:56:57.117909 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-71d8f5f3-60b9-46a7-9073-86e7a1cad7c1 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:57.118715 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-71d8f5f3-60b9-46a7-9073-86e7a1cad7c1 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] [instance: 497196bf-70cb-417d-a396-ebf6e5418547] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:57.126410 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-71d8f5f3-60b9-46a7-9073-86e7a1cad7c1 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:57.127206 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-71d8f5f3-60b9-46a7-9073-86e7a1cad7c1 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:57.128007 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-71d8f5f3-60b9-46a7-9073-86e7a1cad7c1 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:57.129013 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-71d8f5f3-60b9-46a7-9073-86e7a1cad7c1 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:57.129780 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-71d8f5f3-60b9-46a7-9073-86e7a1cad7c1 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:57.130361 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-71d8f5f3-60b9-46a7-9073-86e7a1cad7c1 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:57.170300 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-71d8f5f3-60b9-46a7-9073-86e7a1cad7c1 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] [instance: 497196bf-70cb-417d-a396-ebf6e5418547] Going to try to terminate instance {{(pid=134052) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:56:57.327034 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-71d8f5f3-60b9-46a7-9073-86e7a1cad7c1 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] 10.222.0.70 "DELETE /compute/v2.1/servers/497196bf-70cb-417d-a396-ebf6e5418547" status: 204 len: 0 microversion: 2.1 time: 0.211474 Aug 27 02:56:57.327762 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1689/3376] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:56:57 2022] DELETE /compute/v2.1/servers/497196bf-70cb-417d-a396-ebf6e5418547 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 02:56:57.341960 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5be5d063-9ee8-4f50-92d7-64965d8f0f36 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:57.343275 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-5be5d063-9ee8-4f50-92d7-64965d8f0f36 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] [instance: 31375ef8-ce19-46e1-b574-6252175884b7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:57.355536 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5be5d063-9ee8-4f50-92d7-64965d8f0f36 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:57.356505 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5be5d063-9ee8-4f50-92d7-64965d8f0f36 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:57.357098 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5be5d063-9ee8-4f50-92d7-64965d8f0f36 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:57.358010 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5be5d063-9ee8-4f50-92d7-64965d8f0f36 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:57.358653 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5be5d063-9ee8-4f50-92d7-64965d8f0f36 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:57.359233 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5be5d063-9ee8-4f50-92d7-64965d8f0f36 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:57.390695 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-5be5d063-9ee8-4f50-92d7-64965d8f0f36 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] [instance: 31375ef8-ce19-46e1-b574-6252175884b7] Going to try to terminate instance {{(pid=134052) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:56:57.525755 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=3,nova_api:INSERT=6 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:56:57.559082 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-5be5d063-9ee8-4f50-92d7-64965d8f0f36 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] 10.222.0.70 "DELETE /compute/v2.1/servers/31375ef8-ce19-46e1-b574-6252175884b7" status: 204 len: 0 microversion: 2.1 time: 0.213049 Aug 27 02:56:57.560544 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1690/3377] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:56:57 2022] DELETE /compute/v2.1/servers/31375ef8-ce19-46e1-b574-6252175884b7 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 02:56:57.571224 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-953d488d-19d6-4117-addb-d4b7ce012a42 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:57.574688 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-953d488d-19d6-4117-addb-d4b7ce012a42 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] [instance: 497196bf-70cb-417d-a396-ebf6e5418547] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:57.590225 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-953d488d-19d6-4117-addb-d4b7ce012a42 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:57.590730 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-953d488d-19d6-4117-addb-d4b7ce012a42 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:57.591165 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-953d488d-19d6-4117-addb-d4b7ce012a42 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:57.591905 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-953d488d-19d6-4117-addb-d4b7ce012a42 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:57.592382 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-953d488d-19d6-4117-addb-d4b7ce012a42 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:57.593339 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-953d488d-19d6-4117-addb-d4b7ce012a42 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:57.832799 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-15735be8-41fe-47b2-bb2a-657220ef07c7 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Flavor limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:56:57.832799 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-15735be8-41fe-47b2-bb2a-657220ef07c7 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Image limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:56:57.832799 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-15735be8-41fe-47b2-bb2a-657220ef07c7 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Flavor pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:56:57.832799 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-15735be8-41fe-47b2-bb2a-657220ef07c7 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Image pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:56:57.833799 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-15735be8-41fe-47b2-bb2a-657220ef07c7 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:56:57.851311 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-15735be8-41fe-47b2-bb2a-657220ef07c7 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:57.852117 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-15735be8-41fe-47b2-bb2a-657220ef07c7 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:57.854438 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-15735be8-41fe-47b2-bb2a-657220ef07c7 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:57.856812 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-15735be8-41fe-47b2-bb2a-657220ef07c7 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:57.857692 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-15735be8-41fe-47b2-bb2a-657220ef07c7 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:57.860660 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-15735be8-41fe-47b2-bb2a-657220ef07c7 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:57.930669 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-15735be8-41fe-47b2-bb2a-657220ef07c7 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Getting quotas for project 2a6a888c878245cb9e5909e071c9b9c2. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:56:57.945521 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-15735be8-41fe-47b2-bb2a-657220ef07c7 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Getting quotas for user ef6381ae230a45de8b105374c2d25383 and project 2a6a888c878245cb9e5909e071c9b9c2. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:56:57.982099 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-15735be8-41fe-47b2-bb2a-657220ef07c7 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Going to run 1 instances... {{(pid=134051) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:56:57.984848 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-15735be8-41fe-47b2-bb2a-657220ef07c7 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] [instance: 543bc953-d047-4594-a5d1-2d3a33fbfa35] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134051) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:56:58.106402 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-15735be8-41fe-47b2-bb2a-657220ef07c7 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.266994 Aug 27 02:56:58.110505 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1688/3378] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 02:56:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1272 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 02:56:58.121116 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ba641605-b7c7-4eb0-86ca-4c5cdb504314 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:58.121748 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-ba641605-b7c7-4eb0-86ca-4c5cdb504314 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] [instance: 543bc953-d047-4594-a5d1-2d3a33fbfa35] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:58.279283 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-953d488d-19d6-4117-addb-d4b7ce012a42 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52807fd89d4048f3a0034cb270ba2e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '244b19609b60427c80601c033539a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:58.289939 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-953d488d-19d6-4117-addb-d4b7ce012a42 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] 10.222.0.70 "GET /compute/v2.1/servers/497196bf-70cb-417d-a396-ebf6e5418547" status: 200 len: 1512 microversion: 2.1 time: 0.724317 Aug 27 02:56:58.296241 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1691/3379] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:57 2022] GET /compute/v2.1/servers/497196bf-70cb-417d-a396-ebf6e5418547 => generated 1512 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:56:58.392211 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-ba641605-b7c7-4eb0-86ca-4c5cdb504314 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6381ae230a45de8b105374c2d25383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a6a888c878245cb9e5909e071c9b9c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:58.399673 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ba641605-b7c7-4eb0-86ca-4c5cdb504314 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] 10.222.0.70 "GET /compute/v2.1/servers/543bc953-d047-4594-a5d1-2d3a33fbfa35" status: 200 len: 1216 microversion: 2.1 time: 0.285050 Aug 27 02:56:58.408484 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1689/3380] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:58 2022] GET /compute/v2.1/servers/543bc953-d047-4594-a5d1-2d3a33fbfa35 => generated 1216 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:56:59.318268 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-194fa59c-600d-4239-af00-d32df0775851 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:59.319674 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-194fa59c-600d-4239-af00-d32df0775851 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] [instance: 497196bf-70cb-417d-a396-ebf6e5418547] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:59.336743 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-194fa59c-600d-4239-af00-d32df0775851 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:59.339875 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-194fa59c-600d-4239-af00-d32df0775851 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:59.341844 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-194fa59c-600d-4239-af00-d32df0775851 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:59.343670 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-194fa59c-600d-4239-af00-d32df0775851 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:59.344895 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-194fa59c-600d-4239-af00-d32df0775851 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:59.347716 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-194fa59c-600d-4239-af00-d32df0775851 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:59.425979 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-9f262bef-5c80-4066-ae5e-f45d3b4b968a tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:59.427204 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-9f262bef-5c80-4066-ae5e-f45d3b4b968a tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] [instance: 543bc953-d047-4594-a5d1-2d3a33fbfa35] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:59.454080 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9f262bef-5c80-4066-ae5e-f45d3b4b968a tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:59.454841 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9f262bef-5c80-4066-ae5e-f45d3b4b968a tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:59.455465 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9f262bef-5c80-4066-ae5e-f45d3b4b968a tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:59.460330 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9f262bef-5c80-4066-ae5e-f45d3b4b968a tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:59.462874 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9f262bef-5c80-4066-ae5e-f45d3b4b968a tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:59.463645 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9f262bef-5c80-4066-ae5e-f45d3b4b968a tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:59.877351 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-9f262bef-5c80-4066-ae5e-f45d3b4b968a tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6381ae230a45de8b105374c2d25383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a6a888c878245cb9e5909e071c9b9c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:59.890484 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-9f262bef-5c80-4066-ae5e-f45d3b4b968a tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] 10.222.0.70 "GET /compute/v2.1/servers/543bc953-d047-4594-a5d1-2d3a33fbfa35" status: 200 len: 1220 microversion: 2.1 time: 0.468708 Aug 27 02:56:59.893714 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1690/3381] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:59 2022] GET /compute/v2.1/servers/543bc953-d047-4594-a5d1-2d3a33fbfa35 => generated 1220 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:56:59.971809 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-194fa59c-600d-4239-af00-d32df0775851 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52807fd89d4048f3a0034cb270ba2e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '244b19609b60427c80601c033539a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:59.983636 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-194fa59c-600d-4239-af00-d32df0775851 tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] 10.222.0.70 "GET /compute/v2.1/servers/497196bf-70cb-417d-a396-ebf6e5418547" status: 200 len: 1512 microversion: 2.1 time: 0.667826 Aug 27 02:56:59.984636 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1692/3382] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:59 2022] GET /compute/v2.1/servers/497196bf-70cb-417d-a396-ebf6e5418547 => generated 1512 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:57:00.927579 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-88dc1984-6872-45a7-a094-f10c356c4348 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:00.931944 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-88dc1984-6872-45a7-a094-f10c356c4348 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] [instance: 543bc953-d047-4594-a5d1-2d3a33fbfa35] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:00.983097 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-88dc1984-6872-45a7-a094-f10c356c4348 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:00.983861 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-88dc1984-6872-45a7-a094-f10c356c4348 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:00.985058 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-88dc1984-6872-45a7-a094-f10c356c4348 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:00.986901 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-88dc1984-6872-45a7-a094-f10c356c4348 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:00.988915 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-88dc1984-6872-45a7-a094-f10c356c4348 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:00.991154 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-88dc1984-6872-45a7-a094-f10c356c4348 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:01.016910 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f6ff8eb3-c00e-475a-8739-6f75392e9baa tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:01.017539 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-f6ff8eb3-c00e-475a-8739-6f75392e9baa tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] [instance: 497196bf-70cb-417d-a396-ebf6e5418547] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:01.041167 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f6ff8eb3-c00e-475a-8739-6f75392e9baa tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:01.041727 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f6ff8eb3-c00e-475a-8739-6f75392e9baa tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:01.044780 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f6ff8eb3-c00e-475a-8739-6f75392e9baa tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:01.053997 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f6ff8eb3-c00e-475a-8739-6f75392e9baa tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:01.057220 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f6ff8eb3-c00e-475a-8739-6f75392e9baa tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:01.058168 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f6ff8eb3-c00e-475a-8739-6f75392e9baa tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:02.038645 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-f6ff8eb3-c00e-475a-8739-6f75392e9baa tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52807fd89d4048f3a0034cb270ba2e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '244b19609b60427c80601c033539a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:02.057898 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f6ff8eb3-c00e-475a-8739-6f75392e9baa tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] 10.222.0.70 "GET /compute/v2.1/servers/497196bf-70cb-417d-a396-ebf6e5418547" status: 200 len: 1470 microversion: 2.1 time: 1.047707 Aug 27 02:57:02.059223 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1693/3383] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:57:01 2022] GET /compute/v2.1/servers/497196bf-70cb-417d-a396-ebf6e5418547 => generated 1470 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:57:02.064410 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-8ac07eba-6f74-495d-a148-6d3f78ceffae req-efc1ec33-985e-4a21-80cd-68198186791d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "497196bf-70cb-417d-a396-ebf6e5418547", "name": "network-vif-deleted", "tag": "9a79aa81-4cce-4ae9-8d6a-a09de5e0b186"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:57:02.089045 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-88dc1984-6872-45a7-a094-f10c356c4348 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6381ae230a45de8b105374c2d25383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a6a888c878245cb9e5909e071c9b9c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:02.098521 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-8ac07eba-6f74-495d-a148-6d3f78ceffae req-efc1ec33-985e-4a21-80cd-68198186791d service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:02.101617 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-8ac07eba-6f74-495d-a148-6d3f78ceffae req-efc1ec33-985e-4a21-80cd-68198186791d service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:02.104814 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-8ac07eba-6f74-495d-a148-6d3f78ceffae req-efc1ec33-985e-4a21-80cd-68198186791d service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:02.115580 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-88dc1984-6872-45a7-a094-f10c356c4348 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] 10.222.0.70 "GET /compute/v2.1/servers/543bc953-d047-4594-a5d1-2d3a33fbfa35" status: 200 len: 1274 microversion: 2.1 time: 1.194847 Aug 27 02:57:02.116255 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1691/3384] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:57:00 2022] GET /compute/v2.1/servers/543bc953-d047-4594-a5d1-2d3a33fbfa35 => generated 1274 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:57:02.168182 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-8ac07eba-6f74-495d-a148-6d3f78ceffae req-efc1ec33-985e-4a21-80cd-68198186791d service nova] Creating event network-vif-deleted:9a79aa81-4cce-4ae9-8d6a-a09de5e0b186 for instance 497196bf-70cb-417d-a396-ebf6e5418547 on n-h1-852278-4 Aug 27 02:57:02.186790 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-8ac07eba-6f74-495d-a148-6d3f78ceffae req-efc1ec33-985e-4a21-80cd-68198186791d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123654 Aug 27 02:57:02.190190 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1694/3385] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:57:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:57:02.992924 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-f1ae6a71-c237-4376-87d0-519f458e2048 req-0eb17648-713e-443f-80f3-746518bc6a1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31375ef8-ce19-46e1-b574-6252175884b7", "name": "network-vif-deleted", "tag": "bafe066e-264c-48c2-921c-abcab1d80216"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:57:03.024061 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-f1ae6a71-c237-4376-87d0-519f458e2048 req-0eb17648-713e-443f-80f3-746518bc6a1a service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:03.024802 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-f1ae6a71-c237-4376-87d0-519f458e2048 req-0eb17648-713e-443f-80f3-746518bc6a1a service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:03.027069 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-f1ae6a71-c237-4376-87d0-519f458e2048 req-0eb17648-713e-443f-80f3-746518bc6a1a service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:03.068113 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-f1ae6a71-c237-4376-87d0-519f458e2048 req-0eb17648-713e-443f-80f3-746518bc6a1a service nova] Creating event network-vif-deleted:bafe066e-264c-48c2-921c-abcab1d80216 for instance 31375ef8-ce19-46e1-b574-6252175884b7 on n-h1-852278-4 Aug 27 02:57:03.077583 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-f1ae6a71-c237-4376-87d0-519f458e2048 req-0eb17648-713e-443f-80f3-746518bc6a1a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090025 Aug 27 02:57:03.078948 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1692/3386] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:57:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:57:03.082503 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6a89a205-8fbb-4a2e-a13c-033ff68ed0de tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:03.083232 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-6a89a205-8fbb-4a2e-a13c-033ff68ed0de tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] [instance: 497196bf-70cb-417d-a396-ebf6e5418547] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:03.125059 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6a89a205-8fbb-4a2e-a13c-033ff68ed0de tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:03.127485 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6a89a205-8fbb-4a2e-a13c-033ff68ed0de tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:03.131649 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6a89a205-8fbb-4a2e-a13c-033ff68ed0de tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:03.133469 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6a89a205-8fbb-4a2e-a13c-033ff68ed0de tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:03.134023 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6a89a205-8fbb-4a2e-a13c-033ff68ed0de tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:03.134458 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6a89a205-8fbb-4a2e-a13c-033ff68ed0de tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:03.142579 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-01e94320-4908-4424-ba17-c9d93162f1c2 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:03.144379 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-01e94320-4908-4424-ba17-c9d93162f1c2 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] [instance: 543bc953-d047-4594-a5d1-2d3a33fbfa35] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:03.162063 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-01e94320-4908-4424-ba17-c9d93162f1c2 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:03.163058 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-01e94320-4908-4424-ba17-c9d93162f1c2 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:03.164230 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-01e94320-4908-4424-ba17-c9d93162f1c2 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:03.167515 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-01e94320-4908-4424-ba17-c9d93162f1c2 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:03.169957 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-01e94320-4908-4424-ba17-c9d93162f1c2 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:03.172006 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-01e94320-4908-4424-ba17-c9d93162f1c2 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:03.201499 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-6a89a205-8fbb-4a2e-a13c-033ff68ed0de tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] HTTP exception thrown: Instance 497196bf-70cb-417d-a396-ebf6e5418547 could not be found. Aug 27 02:57:03.206920 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6a89a205-8fbb-4a2e-a13c-033ff68ed0de tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Request method failure captured: Aug 27 02:57:03.206920 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/servers/497196bf-70cb-417d-a396-ebf6e5418547 HTTP/1.1 Aug 27 02:57:03.206920 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:57:03.206920 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:57:03.206920 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:57:03.206920 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:57:03.206920 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:57:03.206920 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:57:03.206920 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:57:03.206920 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:57:03.206920 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYfJKKv3Ym58n1sa_Vi3Jmm3kJswssAdts83U2NSIkTyfcn7MvA7y2xcHC_kXc-Us1ll8Rve7_umpHFsXtJAM5T2u_NneNUETa2vtqnl05zRFM-gF1-n5Kwjh0JT3b0ZHEtkdu_tqipcliIY81G3BYoGK0EMbFF0jpq2WoUfMHzQErw Aug 27 02:57:03.206920 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:57:03.206920 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:57:03.206920 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:57:03.206920 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:57:03.206920 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:57:03.206920 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:57:03.206920 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 244b19609b60427c80601c033539a55a Aug 27 02:57:03.206920 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-MultipleCreateTestJSON-1318254133 Aug 27 02:57:03.206920 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:57:03.206920 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:57:03.206920 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/244b19609b60427c80601c033539a55a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_244b19609b60427c80601c033539a55a", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/244b19609b60427c80601c033539a55a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/244b19609b60427c80601c033539a55a"}]}] Aug 27 02:57:03.206920 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-MultipleCreateTestJSON-1318254133 Aug 27 02:57:03.206920 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 244b19609b60427c80601c033539a55a Aug 27 02:57:03.206920 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1318254133 Aug 27 02:57:03.206920 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-MultipleCreateTestJSON-1318254133-project Aug 27 02:57:03.206920 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:57:03.206920 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:57:03.206920 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 52807fd89d4048f3a0034cb270ba2e9c Aug 27 02:57:03.206920 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-MultipleCreateTestJSON-1318254133-project Aug 27 02:57:03.206920 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 02:57:03.206920 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance 497196bf-70cb-417d-a396-ebf6e5418547 could not be found. Aug 27 02:57:03.206920 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '497196bf-70cb-417d-a396-ebf6e5418547'} Aug 27 02:57:03.206920 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:57:03.206920 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:57:03.206920 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:57:03.206920 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:57:03.206920 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:57:03.206920 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:57:03.206920 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:57:03.206920 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:57:03.206920 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:57:03.206920 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:57:03.206920 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 497196bf-70cb-417d-a396-ebf6e5418547 could not be found. Aug 27 02:57:03.206920 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:57:03.206920 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:57:03.206920 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:57:03.206920 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:57:03.206920 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:57:03.206920 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:57:03.206920 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:57:03.206920 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:57:03.206920 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:57:03.206920 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:57:03.206920 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:57:03.206920 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:57:03.206920 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:57:03.206920 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:57:03.206920 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:57:03.206920 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:57:03.206920 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 497196bf-70cb-417d-a396-ebf6e5418547 could not be found. Aug 27 02:57:03.206920 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:57:03.206920 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:57:03.206920 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:57:03.212711 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:57:03.212711 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:57:03.212711 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:57:03.212711 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:57:03.212711 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:57:03.212711 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 497196bf-70cb-417d-a396-ebf6e5418547 could not be found. Aug 27 02:57:03.212711 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:57:03.213971 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6a89a205-8fbb-4a2e-a13c-033ff68ed0de tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Returning 404 to user: Instance 497196bf-70cb-417d-a396-ebf6e5418547 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:57:03.221110 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-6a89a205-8fbb-4a2e-a13c-033ff68ed0de tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] 10.222.0.70 "GET /compute/v2.1/servers/497196bf-70cb-417d-a396-ebf6e5418547" status: 404 len: 111 microversion: 2.1 time: 0.138983 Aug 27 02:57:03.225857 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1695/3387] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:57:03 2022] GET /compute/v2.1/servers/497196bf-70cb-417d-a396-ebf6e5418547 => generated 111 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:57:03.241988 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c4248e2b-3200-4507-8a8c-1880cebbe15c tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:03.243896 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-c4248e2b-3200-4507-8a8c-1880cebbe15c tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] [instance: 31375ef8-ce19-46e1-b574-6252175884b7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:03.272076 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c4248e2b-3200-4507-8a8c-1880cebbe15c tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:03.274354 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c4248e2b-3200-4507-8a8c-1880cebbe15c tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:03.274951 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c4248e2b-3200-4507-8a8c-1880cebbe15c tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:03.276493 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c4248e2b-3200-4507-8a8c-1880cebbe15c tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:03.280583 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c4248e2b-3200-4507-8a8c-1880cebbe15c tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:03.281164 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c4248e2b-3200-4507-8a8c-1880cebbe15c tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:03.344061 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c4248e2b-3200-4507-8a8c-1880cebbe15c tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:03.345445 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c4248e2b-3200-4507-8a8c-1880cebbe15c tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:03.346171 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c4248e2b-3200-4507-8a8c-1880cebbe15c tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:03.347716 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.instance [None req-c4248e2b-3200-4507-8a8c-1880cebbe15c tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lazy-loading 'fault' on Instance uuid 31375ef8-ce19-46e1-b574-6252175884b7 {{(pid=134052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:57:03.361849 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-01e94320-4908-4424-ba17-c9d93162f1c2 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6381ae230a45de8b105374c2d25383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a6a888c878245cb9e5909e071c9b9c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:03.381276 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-01e94320-4908-4424-ba17-c9d93162f1c2 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] 10.222.0.70 "GET /compute/v2.1/servers/543bc953-d047-4594-a5d1-2d3a33fbfa35" status: 200 len: 1274 microversion: 2.1 time: 0.242960 Aug 27 02:57:03.382609 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1693/3388] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:57:03 2022] GET /compute/v2.1/servers/543bc953-d047-4594-a5d1-2d3a33fbfa35 => generated 1274 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:57:03.404893 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-09f9f7f6-213b-410d-a94b-37dd62e9aea8 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:03.405644 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-09f9f7f6-213b-410d-a94b-37dd62e9aea8 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:03.412820 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-09f9f7f6-213b-410d-a94b-37dd62e9aea8 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:03.413946 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-09f9f7f6-213b-410d-a94b-37dd62e9aea8 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:03.414947 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-09f9f7f6-213b-410d-a94b-37dd62e9aea8 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:03.416068 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-09f9f7f6-213b-410d-a94b-37dd62e9aea8 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:03.416619 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-09f9f7f6-213b-410d-a94b-37dd62e9aea8 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:03.417133 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-09f9f7f6-213b-410d-a94b-37dd62e9aea8 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:03.489965 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-c4248e2b-3200-4507-8a8c-1880cebbe15c tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52807fd89d4048f3a0034cb270ba2e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '244b19609b60427c80601c033539a55a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:03.498703 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c4248e2b-3200-4507-8a8c-1880cebbe15c tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] 10.222.0.70 "GET /compute/v2.1/servers/31375ef8-ce19-46e1-b574-6252175884b7" status: 200 len: 1308 microversion: 2.1 time: 0.269643 Aug 27 02:57:03.500889 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1696/3389] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:57:03 2022] GET /compute/v2.1/servers/31375ef8-ce19-46e1-b574-6252175884b7 => generated 1308 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:57:03.876104 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-09f9f7f6-213b-410d-a94b-37dd62e9aea8 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:03.889180 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-09f9f7f6-213b-410d-a94b-37dd62e9aea8 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1668 microversion: 2.1 time: 0.488806 Aug 27 02:57:03.890694 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1694/3390] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:57:03 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1668 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:57:03.922248 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9412b890-ad02-41f9-8363-b241af4c3259 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:03.923152 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-9412b890-ad02-41f9-8363-b241af4c3259 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:03.932130 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9412b890-ad02-41f9-8363-b241af4c3259 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:03.933133 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9412b890-ad02-41f9-8363-b241af4c3259 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:03.933744 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9412b890-ad02-41f9-8363-b241af4c3259 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:03.934674 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9412b890-ad02-41f9-8363-b241af4c3259 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:03.935376 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9412b890-ad02-41f9-8363-b241af4c3259 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:03.936009 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9412b890-ad02-41f9-8363-b241af4c3259 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:04.404386 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f80b1a69-099d-411b-a011-be9680fad77c tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:04.404974 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-f80b1a69-099d-411b-a011-be9680fad77c tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] [instance: 543bc953-d047-4594-a5d1-2d3a33fbfa35] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:04.418055 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f80b1a69-099d-411b-a011-be9680fad77c tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:04.418455 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f80b1a69-099d-411b-a011-be9680fad77c tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:04.418955 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f80b1a69-099d-411b-a011-be9680fad77c tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:04.419736 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f80b1a69-099d-411b-a011-be9680fad77c tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:04.420211 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f80b1a69-099d-411b-a011-be9680fad77c tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:04.420659 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f80b1a69-099d-411b-a011-be9680fad77c tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:04.452651 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-9412b890-ad02-41f9-8363-b241af4c3259 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:04.467790 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9412b890-ad02-41f9-8363-b241af4c3259 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1668 microversion: 2.1 time: 0.544401 Aug 27 02:57:04.470388 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1697/3391] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:57:03 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1668 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:57:04.491329 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0f592a79-3a83-489f-942b-fc965c4b80dd tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:04.492108 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-0f592a79-3a83-489f-942b-fc965c4b80dd tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:04.514756 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0f592a79-3a83-489f-942b-fc965c4b80dd tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:04.514756 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0f592a79-3a83-489f-942b-fc965c4b80dd tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:04.514756 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0f592a79-3a83-489f-942b-fc965c4b80dd tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:04.515201 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0f592a79-3a83-489f-942b-fc965c4b80dd tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:04.516469 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0f592a79-3a83-489f-942b-fc965c4b80dd tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:04.517265 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0f592a79-3a83-489f-942b-fc965c4b80dd tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:04.960429 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0f592a79-3a83-489f-942b-fc965c4b80dd tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:04.969734 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-0f592a79-3a83-489f-942b-fc965c4b80dd tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1668 microversion: 2.1 time: 0.482168 Aug 27 02:57:04.978619 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1698/3392] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:57:04 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1668 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:57:04.983943 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-002b9995-5a52-434e-b416-f132513d826e tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:04.999225 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-002b9995-5a52-434e-b416-f132513d826e tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] [instance: 31375ef8-ce19-46e1-b574-6252175884b7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:05.013356 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-002b9995-5a52-434e-b416-f132513d826e tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:05.021395 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-002b9995-5a52-434e-b416-f132513d826e tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:05.022508 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-002b9995-5a52-434e-b416-f132513d826e tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:05.030060 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-002b9995-5a52-434e-b416-f132513d826e tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:05.031071 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-002b9995-5a52-434e-b416-f132513d826e tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:05.032037 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-002b9995-5a52-434e-b416-f132513d826e tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:05.038725 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-f80b1a69-099d-411b-a011-be9680fad77c tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6381ae230a45de8b105374c2d25383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a6a888c878245cb9e5909e071c9b9c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:05.047610 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-f80b1a69-099d-411b-a011-be9680fad77c tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] 10.222.0.70 "GET /compute/v2.1/servers/543bc953-d047-4594-a5d1-2d3a33fbfa35" status: 200 len: 1316 microversion: 2.1 time: 0.647367 Aug 27 02:57:05.054281 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1695/3393] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:57:04 2022] GET /compute/v2.1/servers/543bc953-d047-4594-a5d1-2d3a33fbfa35 => generated 1316 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:57:05.061952 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d6bcd8ad-761f-4cea-a960-30832388f9dc tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:05.067430 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-002b9995-5a52-434e-b416-f132513d826e tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] HTTP exception thrown: Instance 31375ef8-ce19-46e1-b574-6252175884b7 could not be found. Aug 27 02:57:05.069962 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-002b9995-5a52-434e-b416-f132513d826e tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Request method failure captured: Aug 27 02:57:05.069962 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/servers/31375ef8-ce19-46e1-b574-6252175884b7 HTTP/1.1 Aug 27 02:57:05.069962 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:57:05.069962 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:57:05.069962 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:57:05.069962 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:57:05.069962 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:57:05.069962 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:57:05.069962 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:57:05.069962 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:57:05.069962 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYfJKKv3Ym58n1sa_Vi3Jmm3kJswssAdts83U2NSIkTyfcn7MvA7y2xcHC_kXc-Us1ll8Rve7_umpHFsXtJAM5T2u_NneNUETa2vtqnl05zRFM-gF1-n5Kwjh0JT3b0ZHEtkdu_tqipcliIY81G3BYoGK0EMbFF0jpq2WoUfMHzQErw Aug 27 02:57:05.069962 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:57:05.069962 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:57:05.069962 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:57:05.069962 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:57:05.069962 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:57:05.069962 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:57:05.069962 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 244b19609b60427c80601c033539a55a Aug 27 02:57:05.069962 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-MultipleCreateTestJSON-1318254133 Aug 27 02:57:05.069962 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:57:05.069962 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:57:05.069962 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/244b19609b60427c80601c033539a55a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_244b19609b60427c80601c033539a55a", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/244b19609b60427c80601c033539a55a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/244b19609b60427c80601c033539a55a"}]}] Aug 27 02:57:05.069962 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-MultipleCreateTestJSON-1318254133 Aug 27 02:57:05.069962 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 244b19609b60427c80601c033539a55a Aug 27 02:57:05.069962 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1318254133 Aug 27 02:57:05.069962 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-MultipleCreateTestJSON-1318254133-project Aug 27 02:57:05.069962 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:57:05.069962 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:57:05.069962 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 52807fd89d4048f3a0034cb270ba2e9c Aug 27 02:57:05.069962 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-MultipleCreateTestJSON-1318254133-project Aug 27 02:57:05.069962 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 02:57:05.069962 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance 31375ef8-ce19-46e1-b574-6252175884b7 could not be found. Aug 27 02:57:05.069962 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '31375ef8-ce19-46e1-b574-6252175884b7'} Aug 27 02:57:05.069962 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:57:05.069962 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:57:05.069962 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:57:05.069962 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:57:05.069962 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:57:05.069962 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:57:05.069962 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:57:05.069962 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:57:05.069962 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:57:05.069962 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:57:05.069962 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31375ef8-ce19-46e1-b574-6252175884b7 could not be found. Aug 27 02:57:05.069962 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:57:05.069962 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:57:05.069962 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:57:05.069962 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:57:05.069962 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:57:05.069962 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:57:05.069962 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:57:05.069962 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:57:05.069962 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:57:05.069962 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:57:05.069962 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:57:05.069962 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:57:05.069962 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:57:05.069962 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:57:05.069962 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:57:05.069962 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:57:05.069962 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31375ef8-ce19-46e1-b574-6252175884b7 could not be found. Aug 27 02:57:05.069962 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:57:05.069962 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:57:05.069962 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:57:05.074564 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:57:05.074564 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:57:05.074564 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:57:05.074564 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:57:05.074564 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:57:05.074564 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31375ef8-ce19-46e1-b574-6252175884b7 could not be found. Aug 27 02:57:05.074564 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:57:05.078934 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d6bcd8ad-761f-4cea-a960-30832388f9dc tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:05.080577 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-002b9995-5a52-434e-b416-f132513d826e tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] Returning 404 to user: Instance 31375ef8-ce19-46e1-b574-6252175884b7 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:57:05.082020 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-002b9995-5a52-434e-b416-f132513d826e tempest-MultipleCreateTestJSON-1318254133 tempest-MultipleCreateTestJSON-1318254133-project] 10.222.0.70 "GET /compute/v2.1/servers/31375ef8-ce19-46e1-b574-6252175884b7" status: 404 len: 111 microversion: 2.1 time: 0.102042 Aug 27 02:57:05.085609 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1699/3394] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:57:04 2022] GET /compute/v2.1/servers/31375ef8-ce19-46e1-b574-6252175884b7 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:57:05.089024 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d6bcd8ad-761f-4cea-a960-30832388f9dc tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:05.091073 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d6bcd8ad-761f-4cea-a960-30832388f9dc tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:05.093117 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d6bcd8ad-761f-4cea-a960-30832388f9dc tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:05.095102 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d6bcd8ad-761f-4cea-a960-30832388f9dc tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:05.095851 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d6bcd8ad-761f-4cea-a960-30832388f9dc tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:05.097369 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d6bcd8ad-761f-4cea-a960-30832388f9dc tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:05.486393 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8a868c5e-f389-443e-8726-55a038943725 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-1041358281", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "networks": [{"uuid": "17d132a1-5573-44f1-b337-7d5db666010c"}]}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:57:05.602082 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.network.neutron [None req-8a868c5e-f389-443e-8726-55a038943725 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] validate_networks() for [('17d132a1-5573-44f1-b337-7d5db666010c', None, None, None, None, None)] {{(pid=134052) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:57:06.084911 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d6bcd8ad-761f-4cea-a960-30832388f9dc tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:06.104122 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d6bcd8ad-761f-4cea-a960-30832388f9dc tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1668 microversion: 2.1 time: 1.048211 Aug 27 02:57:06.109955 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1696/3395] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:57:05 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1668 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:57:06.121838 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3454eb45-bb38-4d2f-9abd-faf414b91d90 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:06.123200 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-3454eb45-bb38-4d2f-9abd-faf414b91d90 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] [instance: 543bc953-d047-4594-a5d1-2d3a33fbfa35] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:06.165010 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3454eb45-bb38-4d2f-9abd-faf414b91d90 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:06.170162 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3454eb45-bb38-4d2f-9abd-faf414b91d90 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:06.171802 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3454eb45-bb38-4d2f-9abd-faf414b91d90 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:06.173264 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3454eb45-bb38-4d2f-9abd-faf414b91d90 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:06.176470 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3454eb45-bb38-4d2f-9abd-faf414b91d90 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:06.178190 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3454eb45-bb38-4d2f-9abd-faf414b91d90 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:07.415358 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-8a868c5e-f389-443e-8726-55a038943725 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Flavor limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:57:07.416711 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-8a868c5e-f389-443e-8726-55a038943725 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Image limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:57:07.417409 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-8a868c5e-f389-443e-8726-55a038943725 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Flavor pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:57:07.418018 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-8a868c5e-f389-443e-8726-55a038943725 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Image pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:57:07.418857 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-8a868c5e-f389-443e-8726-55a038943725 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:57:07.444908 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8a868c5e-f389-443e-8726-55a038943725 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:07.445411 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8a868c5e-f389-443e-8726-55a038943725 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:07.446723 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8a868c5e-f389-443e-8726-55a038943725 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:07.448919 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8a868c5e-f389-443e-8726-55a038943725 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:07.449411 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8a868c5e-f389-443e-8726-55a038943725 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:07.451918 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8a868c5e-f389-443e-8726-55a038943725 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:07.500192 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-8a868c5e-f389-443e-8726-55a038943725 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Getting quotas for project 10678bb6b93c4dc59f76e689f5b20ff9. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:57:07.514377 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-3454eb45-bb38-4d2f-9abd-faf414b91d90 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6381ae230a45de8b105374c2d25383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a6a888c878245cb9e5909e071c9b9c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:07.517538 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-8a868c5e-f389-443e-8726-55a038943725 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Getting quotas for user c07e9c0615234db297022024208e8e2b and project 10678bb6b93c4dc59f76e689f5b20ff9. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:57:07.522484 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-3454eb45-bb38-4d2f-9abd-faf414b91d90 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] 10.222.0.70 "GET /compute/v2.1/servers/543bc953-d047-4594-a5d1-2d3a33fbfa35" status: 200 len: 1316 microversion: 2.1 time: 1.411129 Aug 27 02:57:07.528703 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1697/3396] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:57:06 2022] GET /compute/v2.1/servers/543bc953-d047-4594-a5d1-2d3a33fbfa35 => generated 1316 bytes in 1418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:57:07.542768 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4c1c7a86-17c2-4a94-ae72-6f2f9a4d21dd tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-976979739", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "networks": [{"uuid": "7532a923-41df-4761-8077-055e309eff44"}]}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:57:07.575895 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-8a868c5e-f389-443e-8726-55a038943725 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Going to run 1 instances... {{(pid=134052) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:57:07.579061 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-8a868c5e-f389-443e-8726-55a038943725 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] [instance: f8532783-21d1-4910-91ef-223c2379fd43] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134052) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:57:07.660145 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.network.neutron [None req-4c1c7a86-17c2-4a94-ae72-6f2f9a4d21dd tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] validate_networks() for [('7532a923-41df-4761-8077-055e309eff44', None, None, None, None, None)] {{(pid=134051) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:57:07.665621 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-8a868c5e-f389-443e-8726-55a038943725 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 2.427547 Aug 27 02:57:07.667000 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1700/3397] 10.222.0.70 () {62 vars in 1188 bytes} [Sat Aug 27 02:57:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 2430 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 27 02:57:07.680245 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b592977c-34de-4255-8e2f-2884d788e811 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:07.689776 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b592977c-34de-4255-8e2f-2884d788e811 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] [instance: f8532783-21d1-4910-91ef-223c2379fd43] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:07.893824 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=6 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:57:08.119607 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b592977c-34de-4255-8e2f-2884d788e811 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07e9c0615234db297022024208e8e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10678bb6b93c4dc59f76e689f5b20ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:08.152927 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b592977c-34de-4255-8e2f-2884d788e811 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c07e9c0615234db297022024208e8e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10678bb6b93c4dc59f76e689f5b20ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:08.158753 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b592977c-34de-4255-8e2f-2884d788e811 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c07e9c0615234db297022024208e8e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10678bb6b93c4dc59f76e689f5b20ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:08.166710 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b592977c-34de-4255-8e2f-2884d788e811 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] 10.222.0.70 "GET /compute/v2.1/servers/f8532783-21d1-4910-91ef-223c2379fd43" status: 200 len: 1262 microversion: 2.26 time: 0.491659 Aug 27 02:57:08.169765 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1701/3398] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:57:07 2022] GET /compute/v2.1/servers/f8532783-21d1-4910-91ef-223c2379fd43 => generated 1262 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:57:08.185584 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-51ad4e35-206c-4a15-848a-f54b9e97edbe req-25a5a34d-b0a0-4cc0-8914-e19f3b5a1ee3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "543bc953-d047-4594-a5d1-2d3a33fbfa35", "tag": "d252ad9d-633f-41f3-917d-80b5159c1f85"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:57:08.215542 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-51ad4e35-206c-4a15-848a-f54b9e97edbe req-25a5a34d-b0a0-4cc0-8914-e19f3b5a1ee3 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:08.217629 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-51ad4e35-206c-4a15-848a-f54b9e97edbe req-25a5a34d-b0a0-4cc0-8914-e19f3b5a1ee3 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:08.219255 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-51ad4e35-206c-4a15-848a-f54b9e97edbe req-25a5a34d-b0a0-4cc0-8914-e19f3b5a1ee3 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:08.250444 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-51ad4e35-206c-4a15-848a-f54b9e97edbe req-25a5a34d-b0a0-4cc0-8914-e19f3b5a1ee3 service nova] Creating event network-changed:d252ad9d-633f-41f3-917d-80b5159c1f85 for instance 543bc953-d047-4594-a5d1-2d3a33fbfa35 on n-h2-852278-4 Aug 27 02:57:08.258627 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-51ad4e35-206c-4a15-848a-f54b9e97edbe req-25a5a34d-b0a0-4cc0-8914-e19f3b5a1ee3 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087291 Aug 27 02:57:08.259619 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1702/3399] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:57:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:57:08.399145 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=10 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:57:08.544278 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-bcc30690-8a83-4221-a372-b731a663a412 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:08.544997 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-bcc30690-8a83-4221-a372-b731a663a412 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] [instance: 543bc953-d047-4594-a5d1-2d3a33fbfa35] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:08.555181 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bcc30690-8a83-4221-a372-b731a663a412 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:08.556043 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bcc30690-8a83-4221-a372-b731a663a412 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:08.556894 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bcc30690-8a83-4221-a372-b731a663a412 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:08.558213 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bcc30690-8a83-4221-a372-b731a663a412 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:08.558826 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bcc30690-8a83-4221-a372-b731a663a412 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:08.559522 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bcc30690-8a83-4221-a372-b731a663a412 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:08.610718 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:57:09.352634 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-bcc30690-8a83-4221-a372-b731a663a412 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6381ae230a45de8b105374c2d25383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a6a888c878245cb9e5909e071c9b9c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:09.362400 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-bcc30690-8a83-4221-a372-b731a663a412 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] 10.222.0.70 "GET /compute/v2.1/servers/543bc953-d047-4594-a5d1-2d3a33fbfa35" status: 200 len: 1316 microversion: 2.1 time: 0.822678 Aug 27 02:57:09.379747 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1703/3400] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:57:08 2022] GET /compute/v2.1/servers/543bc953-d047-4594-a5d1-2d3a33fbfa35 => generated 1316 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:57:09.390794 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b585f4ab-fabc-4f4d-8dfa-e8a4410b230f tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:09.392795 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b585f4ab-fabc-4f4d-8dfa-e8a4410b230f tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] [instance: f8532783-21d1-4910-91ef-223c2379fd43] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:09.414853 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b585f4ab-fabc-4f4d-8dfa-e8a4410b230f tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:09.416024 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b585f4ab-fabc-4f4d-8dfa-e8a4410b230f tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:09.418443 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b585f4ab-fabc-4f4d-8dfa-e8a4410b230f tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:09.420454 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b585f4ab-fabc-4f4d-8dfa-e8a4410b230f tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:09.421468 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b585f4ab-fabc-4f4d-8dfa-e8a4410b230f tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:09.422817 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b585f4ab-fabc-4f4d-8dfa-e8a4410b230f tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:09.656456 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b585f4ab-fabc-4f4d-8dfa-e8a4410b230f tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07e9c0615234db297022024208e8e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10678bb6b93c4dc59f76e689f5b20ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:09.672444 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b585f4ab-fabc-4f4d-8dfa-e8a4410b230f tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c07e9c0615234db297022024208e8e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10678bb6b93c4dc59f76e689f5b20ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:09.682712 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b585f4ab-fabc-4f4d-8dfa-e8a4410b230f tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c07e9c0615234db297022024208e8e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10678bb6b93c4dc59f76e689f5b20ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:09.685178 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b585f4ab-fabc-4f4d-8dfa-e8a4410b230f tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] 10.222.0.70 "GET /compute/v2.1/servers/f8532783-21d1-4910-91ef-223c2379fd43" status: 200 len: 1314 microversion: 2.26 time: 0.304225 Aug 27 02:57:09.691508 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1704/3401] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:57:09 2022] GET /compute/v2.1/servers/f8532783-21d1-4910-91ef-223c2379fd43 => generated 1314 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:57:10.125558 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-4c1c7a86-17c2-4a94-ae72-6f2f9a4d21dd tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Flavor limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:57:10.128347 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-4c1c7a86-17c2-4a94-ae72-6f2f9a4d21dd tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Image limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:57:10.129222 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-4c1c7a86-17c2-4a94-ae72-6f2f9a4d21dd tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Flavor pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:57:10.129956 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-4c1c7a86-17c2-4a94-ae72-6f2f9a4d21dd tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Image pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:57:10.130594 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-4c1c7a86-17c2-4a94-ae72-6f2f9a4d21dd tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:57:10.156679 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4c1c7a86-17c2-4a94-ae72-6f2f9a4d21dd tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:10.158491 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4c1c7a86-17c2-4a94-ae72-6f2f9a4d21dd tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:10.159618 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4c1c7a86-17c2-4a94-ae72-6f2f9a4d21dd tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:10.161167 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4c1c7a86-17c2-4a94-ae72-6f2f9a4d21dd tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:10.162122 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4c1c7a86-17c2-4a94-ae72-6f2f9a4d21dd tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:10.163916 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4c1c7a86-17c2-4a94-ae72-6f2f9a4d21dd tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:10.197546 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-4c1c7a86-17c2-4a94-ae72-6f2f9a4d21dd tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Getting quotas for project 952767db5f394fc4bf01c0efd65f2fb9. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:57:10.206993 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-4c1c7a86-17c2-4a94-ae72-6f2f9a4d21dd tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Getting quotas for user c850bda78e664117b671910c0e68bfb9 and project 952767db5f394fc4bf01c0efd65f2fb9. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:57:10.230592 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-4c1c7a86-17c2-4a94-ae72-6f2f9a4d21dd tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Going to run 1 instances... {{(pid=134051) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:57:10.233688 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-4c1c7a86-17c2-4a94-ae72-6f2f9a4d21dd tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 123a4464-d077-4253-9d13-38f63f70fc43] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134051) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:57:10.348962 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-4c1c7a86-17c2-4a94-ae72-6f2f9a4d21dd tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.818218 Aug 27 02:57:10.356820 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1698/3402] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 02:57:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 2827 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:57:10.362712 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0319f53f-9cdc-4b22-9151-f980f4989939 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:10.363335 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-0319f53f-9cdc-4b22-9151-f980f4989939 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 123a4464-d077-4253-9d13-38f63f70fc43] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:10.390769 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c1005694-3154-4a87-8faf-abbf0f1071f1 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:10.393372 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-c1005694-3154-4a87-8faf-abbf0f1071f1 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] [instance: 543bc953-d047-4594-a5d1-2d3a33fbfa35] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:10.443127 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c1005694-3154-4a87-8faf-abbf0f1071f1 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:10.450284 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c1005694-3154-4a87-8faf-abbf0f1071f1 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:10.453116 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c1005694-3154-4a87-8faf-abbf0f1071f1 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:10.455277 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c1005694-3154-4a87-8faf-abbf0f1071f1 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:10.455953 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c1005694-3154-4a87-8faf-abbf0f1071f1 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:10.458205 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c1005694-3154-4a87-8faf-abbf0f1071f1 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:10.701411 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0319f53f-9cdc-4b22-9151-f980f4989939 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:10.710162 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-0319f53f-9cdc-4b22-9151-f980f4989939 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/123a4464-d077-4253-9d13-38f63f70fc43" status: 200 len: 1214 microversion: 2.1 time: 0.352689 Aug 27 02:57:10.712819 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1705/3403] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:57:10 2022] GET /compute/v2.1/servers/123a4464-d077-4253-9d13-38f63f70fc43 => generated 1214 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:57:10.717746 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-41e88b6b-fb96-43b0-aef2-031799314453 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:10.724816 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-41e88b6b-fb96-43b0-aef2-031799314453 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] [instance: f8532783-21d1-4910-91ef-223c2379fd43] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:10.742614 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-41e88b6b-fb96-43b0-aef2-031799314453 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:10.744964 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-41e88b6b-fb96-43b0-aef2-031799314453 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:10.746662 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-41e88b6b-fb96-43b0-aef2-031799314453 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:10.748628 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-41e88b6b-fb96-43b0-aef2-031799314453 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:10.753240 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-41e88b6b-fb96-43b0-aef2-031799314453 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:10.753897 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-41e88b6b-fb96-43b0-aef2-031799314453 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:10.954467 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-41e88b6b-fb96-43b0-aef2-031799314453 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07e9c0615234db297022024208e8e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10678bb6b93c4dc59f76e689f5b20ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:10.965937 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-41e88b6b-fb96-43b0-aef2-031799314453 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c07e9c0615234db297022024208e8e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10678bb6b93c4dc59f76e689f5b20ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:10.970116 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-41e88b6b-fb96-43b0-aef2-031799314453 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c07e9c0615234db297022024208e8e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10678bb6b93c4dc59f76e689f5b20ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:10.977775 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-41e88b6b-fb96-43b0-aef2-031799314453 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] 10.222.0.70 "GET /compute/v2.1/servers/f8532783-21d1-4910-91ef-223c2379fd43" status: 200 len: 1320 microversion: 2.26 time: 0.263587 Aug 27 02:57:10.978927 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1706/3404] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:57:10 2022] GET /compute/v2.1/servers/f8532783-21d1-4910-91ef-223c2379fd43 => generated 1320 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:57:11.113112 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-c1005694-3154-4a87-8faf-abbf0f1071f1 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6381ae230a45de8b105374c2d25383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a6a888c878245cb9e5909e071c9b9c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:11.122322 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c1005694-3154-4a87-8faf-abbf0f1071f1 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] 10.222.0.70 "GET /compute/v2.1/servers/543bc953-d047-4594-a5d1-2d3a33fbfa35" status: 200 len: 1316 microversion: 2.1 time: 0.737599 Aug 27 02:57:11.124987 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1699/3405] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:57:10 2022] GET /compute/v2.1/servers/543bc953-d047-4594-a5d1-2d3a33fbfa35 => generated 1316 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:57:11.733667 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-db06fc21-837e-453d-ba58-d3975e6cf949 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:11.734958 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-db06fc21-837e-453d-ba58-d3975e6cf949 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 123a4464-d077-4253-9d13-38f63f70fc43] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:11.743971 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-db06fc21-837e-453d-ba58-d3975e6cf949 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:11.744717 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-db06fc21-837e-453d-ba58-d3975e6cf949 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:11.745334 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-db06fc21-837e-453d-ba58-d3975e6cf949 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:11.746281 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-db06fc21-837e-453d-ba58-d3975e6cf949 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:11.747146 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-db06fc21-837e-453d-ba58-d3975e6cf949 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:11.747809 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-db06fc21-837e-453d-ba58-d3975e6cf949 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:11.899485 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-db06fc21-837e-453d-ba58-d3975e6cf949 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:11.909118 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-db06fc21-837e-453d-ba58-d3975e6cf949 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/123a4464-d077-4253-9d13-38f63f70fc43" status: 200 len: 1266 microversion: 2.1 time: 0.180764 Aug 27 02:57:11.913110 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1707/3406] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:57:11 2022] GET /compute/v2.1/servers/123a4464-d077-4253-9d13-38f63f70fc43 => generated 1266 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:57:12.005196 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-5d8913af-5092-4819-ac6f-84f3f0be4712 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:12.007115 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-5d8913af-5092-4819-ac6f-84f3f0be4712 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] [instance: f8532783-21d1-4910-91ef-223c2379fd43] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:12.018866 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5d8913af-5092-4819-ac6f-84f3f0be4712 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:12.020918 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5d8913af-5092-4819-ac6f-84f3f0be4712 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:12.021532 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5d8913af-5092-4819-ac6f-84f3f0be4712 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:12.024122 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5d8913af-5092-4819-ac6f-84f3f0be4712 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:12.028886 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5d8913af-5092-4819-ac6f-84f3f0be4712 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:12.029654 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5d8913af-5092-4819-ac6f-84f3f0be4712 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:12.145236 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a2fa8620-c0f5-4fd4-a85e-0023fa92e89e tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:12.145852 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a2fa8620-c0f5-4fd4-a85e-0023fa92e89e tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] [instance: 543bc953-d047-4594-a5d1-2d3a33fbfa35] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:12.160646 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a2fa8620-c0f5-4fd4-a85e-0023fa92e89e tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:12.161145 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a2fa8620-c0f5-4fd4-a85e-0023fa92e89e tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:12.161583 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a2fa8620-c0f5-4fd4-a85e-0023fa92e89e tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:12.162293 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a2fa8620-c0f5-4fd4-a85e-0023fa92e89e tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:12.162854 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a2fa8620-c0f5-4fd4-a85e-0023fa92e89e tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:12.163284 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a2fa8620-c0f5-4fd4-a85e-0023fa92e89e tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:12.842948 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-5d8913af-5092-4819-ac6f-84f3f0be4712 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07e9c0615234db297022024208e8e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10678bb6b93c4dc59f76e689f5b20ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:12.851660 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-5d8913af-5092-4819-ac6f-84f3f0be4712 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c07e9c0615234db297022024208e8e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10678bb6b93c4dc59f76e689f5b20ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:12.853483 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-5d8913af-5092-4819-ac6f-84f3f0be4712 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c07e9c0615234db297022024208e8e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10678bb6b93c4dc59f76e689f5b20ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:12.854868 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-5d8913af-5092-4819-ac6f-84f3f0be4712 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] 10.222.0.70 "GET /compute/v2.1/servers/f8532783-21d1-4910-91ef-223c2379fd43" status: 200 len: 1362 microversion: 2.26 time: 0.853752 Aug 27 02:57:12.869191 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1700/3407] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:57:12 2022] GET /compute/v2.1/servers/f8532783-21d1-4910-91ef-223c2379fd43 => generated 1362 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:57:12.920280 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-a2fa8620-c0f5-4fd4-a85e-0023fa92e89e tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6381ae230a45de8b105374c2d25383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a6a888c878245cb9e5909e071c9b9c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:12.945043 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a2fa8620-c0f5-4fd4-a85e-0023fa92e89e tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] 10.222.0.70 "GET /compute/v2.1/servers/543bc953-d047-4594-a5d1-2d3a33fbfa35" status: 200 len: 1316 microversion: 2.1 time: 0.803581 Aug 27 02:57:12.949422 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1708/3408] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:57:12 2022] GET /compute/v2.1/servers/543bc953-d047-4594-a5d1-2d3a33fbfa35 => generated 1316 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:57:12.964763 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-7844b21f-8659-4f47-911e-c39f1a2d19df tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:12.965712 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-7844b21f-8659-4f47-911e-c39f1a2d19df tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 123a4464-d077-4253-9d13-38f63f70fc43] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:12.975595 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7844b21f-8659-4f47-911e-c39f1a2d19df tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:12.976483 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7844b21f-8659-4f47-911e-c39f1a2d19df tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:12.977119 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7844b21f-8659-4f47-911e-c39f1a2d19df tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:12.978147 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7844b21f-8659-4f47-911e-c39f1a2d19df tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:12.981265 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7844b21f-8659-4f47-911e-c39f1a2d19df tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:12.981927 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7844b21f-8659-4f47-911e-c39f1a2d19df tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:13.126160 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ee1cef59-6e1a-4c27-8de3-8c5b7010d7ad tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1118990088", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "networks": [{"uuid": "82c9ecbe-90a9-4c18-ac3f-1e6ffd03957c"}]}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:57:13.205572 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.network.neutron [None req-ee1cef59-6e1a-4c27-8de3-8c5b7010d7ad tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] validate_networks() for [('82c9ecbe-90a9-4c18-ac3f-1e6ffd03957c', None, None, None, None, None)] {{(pid=134051) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:57:13.265292 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-7844b21f-8659-4f47-911e-c39f1a2d19df tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:13.276959 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-7844b21f-8659-4f47-911e-c39f1a2d19df tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/123a4464-d077-4253-9d13-38f63f70fc43" status: 200 len: 1272 microversion: 2.1 time: 0.325000 Aug 27 02:57:13.277613 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1709/3409] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:57:12 2022] GET /compute/v2.1/servers/123a4464-d077-4253-9d13-38f63f70fc43 => generated 1272 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:57:13.297005 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-0f0e182e-1788-4603-a594-925e6f3dbf83 req-ab92c47a-a4ba-44b3-a68d-d129af6b673d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8532783-21d1-4910-91ef-223c2379fd43", "tag": "e085573e-6d8b-4579-a677-c77683bcdb66"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:57:13.318845 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-0f0e182e-1788-4603-a594-925e6f3dbf83 req-ab92c47a-a4ba-44b3-a68d-d129af6b673d service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:13.319573 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-0f0e182e-1788-4603-a594-925e6f3dbf83 req-ab92c47a-a4ba-44b3-a68d-d129af6b673d service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:13.320487 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-0f0e182e-1788-4603-a594-925e6f3dbf83 req-ab92c47a-a4ba-44b3-a68d-d129af6b673d service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:13.352609 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-0f0e182e-1788-4603-a594-925e6f3dbf83 req-ab92c47a-a4ba-44b3-a68d-d129af6b673d service nova] Creating event network-changed:e085573e-6d8b-4579-a677-c77683bcdb66 for instance f8532783-21d1-4910-91ef-223c2379fd43 on n-h1-852278-4 Aug 27 02:57:13.382758 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-0f0e182e-1788-4603-a594-925e6f3dbf83 req-ab92c47a-a4ba-44b3-a68d-d129af6b673d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085709 Aug 27 02:57:13.386138 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1710/3410] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:57:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:57:13.892185 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d50f8b1f-4225-4e48-a4d3-e02365693a01 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:13.893381 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d50f8b1f-4225-4e48-a4d3-e02365693a01 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] [instance: f8532783-21d1-4910-91ef-223c2379fd43] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:13.909631 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d50f8b1f-4225-4e48-a4d3-e02365693a01 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:13.910933 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d50f8b1f-4225-4e48-a4d3-e02365693a01 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:13.911542 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d50f8b1f-4225-4e48-a4d3-e02365693a01 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:13.912721 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d50f8b1f-4225-4e48-a4d3-e02365693a01 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:13.913586 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d50f8b1f-4225-4e48-a4d3-e02365693a01 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:13.914549 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d50f8b1f-4225-4e48-a4d3-e02365693a01 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:14.247588 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-d50f8b1f-4225-4e48-a4d3-e02365693a01 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07e9c0615234db297022024208e8e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10678bb6b93c4dc59f76e689f5b20ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:14.256877 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-d50f8b1f-4225-4e48-a4d3-e02365693a01 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c07e9c0615234db297022024208e8e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10678bb6b93c4dc59f76e689f5b20ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:14.263460 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-d50f8b1f-4225-4e48-a4d3-e02365693a01 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c07e9c0615234db297022024208e8e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10678bb6b93c4dc59f76e689f5b20ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:14.264629 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d50f8b1f-4225-4e48-a4d3-e02365693a01 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] 10.222.0.70 "GET /compute/v2.1/servers/f8532783-21d1-4910-91ef-223c2379fd43" status: 200 len: 1362 microversion: 2.26 time: 0.385508 Aug 27 02:57:14.280536 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1711/3411] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:57:13 2022] GET /compute/v2.1/servers/f8532783-21d1-4910-91ef-223c2379fd43 => generated 1362 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:57:14.290219 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-96e25c73-2ef2-46f3-8b12-ba4021091ae8 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:14.290846 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-96e25c73-2ef2-46f3-8b12-ba4021091ae8 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] [instance: 543bc953-d047-4594-a5d1-2d3a33fbfa35] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:14.299965 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-96e25c73-2ef2-46f3-8b12-ba4021091ae8 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:14.300970 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-96e25c73-2ef2-46f3-8b12-ba4021091ae8 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:14.301592 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-96e25c73-2ef2-46f3-8b12-ba4021091ae8 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:14.304151 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-96e25c73-2ef2-46f3-8b12-ba4021091ae8 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:14.304698 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-96e25c73-2ef2-46f3-8b12-ba4021091ae8 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:14.305132 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-96e25c73-2ef2-46f3-8b12-ba4021091ae8 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:14.347678 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-ee1cef59-6e1a-4c27-8de3-8c5b7010d7ad tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Flavor limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:57:14.348227 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-ee1cef59-6e1a-4c27-8de3-8c5b7010d7ad tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Image limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:57:14.348583 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-ee1cef59-6e1a-4c27-8de3-8c5b7010d7ad tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Flavor pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:57:14.348992 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-ee1cef59-6e1a-4c27-8de3-8c5b7010d7ad tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Image pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:57:14.349396 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-ee1cef59-6e1a-4c27-8de3-8c5b7010d7ad tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:57:14.367954 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ee1cef59-6e1a-4c27-8de3-8c5b7010d7ad tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:14.369201 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ee1cef59-6e1a-4c27-8de3-8c5b7010d7ad tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:14.370439 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ee1cef59-6e1a-4c27-8de3-8c5b7010d7ad tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:14.371493 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ee1cef59-6e1a-4c27-8de3-8c5b7010d7ad tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:14.372262 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ee1cef59-6e1a-4c27-8de3-8c5b7010d7ad tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:14.372984 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ee1cef59-6e1a-4c27-8de3-8c5b7010d7ad tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:14.400080 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-ee1cef59-6e1a-4c27-8de3-8c5b7010d7ad tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Getting quotas for project 2448b78114c54dd39bc85538fb973dd2. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:57:14.406100 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-ee1cef59-6e1a-4c27-8de3-8c5b7010d7ad tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Getting quotas for user 2b217f9cbc204919ba77d885315907c2 and project 2448b78114c54dd39bc85538fb973dd2. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:57:14.431846 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-ee1cef59-6e1a-4c27-8de3-8c5b7010d7ad tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Going to run 1 instances... {{(pid=134051) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:57:14.436526 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-ee1cef59-6e1a-4c27-8de3-8c5b7010d7ad tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] [instance: 02eba429-ecb3-4a5c-87ea-c049ad7aca1a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134051) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:57:14.473403 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=8 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:57:14.494474 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ee1cef59-6e1a-4c27-8de3-8c5b7010d7ad tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.623870 Aug 27 02:57:14.511580 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1701/3412] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 02:57:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1641 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:57:14.517726 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0a984d3c-e7ff-43dd-9046-3ecf638ffc69 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:14.518811 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-0a984d3c-e7ff-43dd-9046-3ecf638ffc69 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 123a4464-d077-4253-9d13-38f63f70fc43] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:14.533529 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0a984d3c-e7ff-43dd-9046-3ecf638ffc69 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:14.534273 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0a984d3c-e7ff-43dd-9046-3ecf638ffc69 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:14.535250 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0a984d3c-e7ff-43dd-9046-3ecf638ffc69 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:14.536210 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0a984d3c-e7ff-43dd-9046-3ecf638ffc69 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:14.536938 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0a984d3c-e7ff-43dd-9046-3ecf638ffc69 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:14.538325 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0a984d3c-e7ff-43dd-9046-3ecf638ffc69 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:14.689905 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-0a984d3c-e7ff-43dd-9046-3ecf638ffc69 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:14.726156 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-0a984d3c-e7ff-43dd-9046-3ecf638ffc69 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/123a4464-d077-4253-9d13-38f63f70fc43" status: 200 len: 1272 microversion: 2.1 time: 0.212806 Aug 27 02:57:14.727981 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1702/3413] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:57:14 2022] GET /compute/v2.1/servers/123a4464-d077-4253-9d13-38f63f70fc43 => generated 1272 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:57:14.753787 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-755dd644-6763-423f-a92c-e6b398bd9b97 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-2141765342", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "networks": [{"uuid": "82c9ecbe-90a9-4c18-ac3f-1e6ffd03957c"}]}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:57:14.846431 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.network.neutron [None req-755dd644-6763-423f-a92c-e6b398bd9b97 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] validate_networks() for [('82c9ecbe-90a9-4c18-ac3f-1e6ffd03957c', None, None, None, None, None)] {{(pid=134051) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:57:15.335127 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-96e25c73-2ef2-46f3-8b12-ba4021091ae8 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6381ae230a45de8b105374c2d25383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a6a888c878245cb9e5909e071c9b9c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:15.353839 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-96e25c73-2ef2-46f3-8b12-ba4021091ae8 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] 10.222.0.70 "GET /compute/v2.1/servers/543bc953-d047-4594-a5d1-2d3a33fbfa35" status: 200 len: 1316 microversion: 2.1 time: 1.071008 Aug 27 02:57:15.368970 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1712/3414] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:57:14 2022] GET /compute/v2.1/servers/543bc953-d047-4594-a5d1-2d3a33fbfa35 => generated 1316 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:57:15.377390 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-79e0af96-4702-40c5-842e-2a76c93b7262 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:15.379229 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-79e0af96-4702-40c5-842e-2a76c93b7262 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] [instance: f8532783-21d1-4910-91ef-223c2379fd43] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:15.439136 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-79e0af96-4702-40c5-842e-2a76c93b7262 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:15.440049 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-79e0af96-4702-40c5-842e-2a76c93b7262 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:15.441072 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-79e0af96-4702-40c5-842e-2a76c93b7262 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:15.441817 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-79e0af96-4702-40c5-842e-2a76c93b7262 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:15.442274 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-79e0af96-4702-40c5-842e-2a76c93b7262 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:15.442698 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-79e0af96-4702-40c5-842e-2a76c93b7262 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:16.430724 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-79e0af96-4702-40c5-842e-2a76c93b7262 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07e9c0615234db297022024208e8e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10678bb6b93c4dc59f76e689f5b20ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:16.443692 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-79e0af96-4702-40c5-842e-2a76c93b7262 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c07e9c0615234db297022024208e8e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10678bb6b93c4dc59f76e689f5b20ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:16.445879 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-79e0af96-4702-40c5-842e-2a76c93b7262 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c07e9c0615234db297022024208e8e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10678bb6b93c4dc59f76e689f5b20ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:16.447613 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-79e0af96-4702-40c5-842e-2a76c93b7262 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] 10.222.0.70 "GET /compute/v2.1/servers/f8532783-21d1-4910-91ef-223c2379fd43" status: 200 len: 1362 microversion: 2.26 time: 1.077129 Aug 27 02:57:16.450425 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1713/3415] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:57:15 2022] GET /compute/v2.1/servers/f8532783-21d1-4910-91ef-223c2379fd43 => generated 1362 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:57:16.510765 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-41866030-d486-4fa3-b12f-3781f9b39eb2 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:16.510765 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-41866030-d486-4fa3-b12f-3781f9b39eb2 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 123a4464-d077-4253-9d13-38f63f70fc43] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:16.529035 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-41866030-d486-4fa3-b12f-3781f9b39eb2 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:16.536999 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-41866030-d486-4fa3-b12f-3781f9b39eb2 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:16.538307 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-41866030-d486-4fa3-b12f-3781f9b39eb2 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:16.539328 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-41866030-d486-4fa3-b12f-3781f9b39eb2 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:16.540068 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-41866030-d486-4fa3-b12f-3781f9b39eb2 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:16.540725 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-41866030-d486-4fa3-b12f-3781f9b39eb2 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:16.861140 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-755dd644-6763-423f-a92c-e6b398bd9b97 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Flavor limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:57:16.862281 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-755dd644-6763-423f-a92c-e6b398bd9b97 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Image limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:57:16.862764 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-755dd644-6763-423f-a92c-e6b398bd9b97 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Flavor pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:57:16.868619 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-755dd644-6763-423f-a92c-e6b398bd9b97 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Image pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:57:16.869218 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-755dd644-6763-423f-a92c-e6b398bd9b97 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:57:16.889424 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-755dd644-6763-423f-a92c-e6b398bd9b97 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:16.891931 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-755dd644-6763-423f-a92c-e6b398bd9b97 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:16.893095 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-755dd644-6763-423f-a92c-e6b398bd9b97 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:16.894119 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-755dd644-6763-423f-a92c-e6b398bd9b97 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:16.895054 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-755dd644-6763-423f-a92c-e6b398bd9b97 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:16.895950 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-755dd644-6763-423f-a92c-e6b398bd9b97 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:16.941971 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-755dd644-6763-423f-a92c-e6b398bd9b97 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Getting quotas for project 2448b78114c54dd39bc85538fb973dd2. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:57:16.955588 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-755dd644-6763-423f-a92c-e6b398bd9b97 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Getting quotas for user 2b217f9cbc204919ba77d885315907c2 and project 2448b78114c54dd39bc85538fb973dd2. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:57:16.975027 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-755dd644-6763-423f-a92c-e6b398bd9b97 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Going to run 1 instances... {{(pid=134051) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:57:16.977756 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-755dd644-6763-423f-a92c-e6b398bd9b97 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] [instance: fce0841b-76a8-496d-8fc0-69ad3fa9f7a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134051) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:57:17.115942 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-755dd644-6763-423f-a92c-e6b398bd9b97 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.372057 Aug 27 02:57:17.116662 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1703/3416] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 02:57:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 2388 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:57:17.117553 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-41866030-d486-4fa3-b12f-3781f9b39eb2 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:17.135292 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-879427cb-ac57-4311-b112-32528a27d952 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:17.136116 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-879427cb-ac57-4311-b112-32528a27d952 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] [instance: 543bc953-d047-4594-a5d1-2d3a33fbfa35] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:17.143332 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-879427cb-ac57-4311-b112-32528a27d952 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:17.144545 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-879427cb-ac57-4311-b112-32528a27d952 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:17.145156 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-879427cb-ac57-4311-b112-32528a27d952 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:17.146189 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-879427cb-ac57-4311-b112-32528a27d952 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:17.146513 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-41866030-d486-4fa3-b12f-3781f9b39eb2 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/123a4464-d077-4253-9d13-38f63f70fc43" status: 200 len: 1314 microversion: 2.1 time: 0.694737 Aug 27 02:57:17.147070 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-879427cb-ac57-4311-b112-32528a27d952 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:17.148725 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-879427cb-ac57-4311-b112-32528a27d952 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:17.154503 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1714/3417] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:57:16 2022] GET /compute/v2.1/servers/123a4464-d077-4253-9d13-38f63f70fc43 => generated 1314 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:57:17.217796 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:57:17.219647 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-35266c4b-7960-4a0d-b2b6-d040897a31ff tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1065771266", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "451", "networks": [{"uuid": "82c9ecbe-90a9-4c18-ac3f-1e6ffd03957c"}]}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:57:17.321094 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.network.neutron [None req-35266c4b-7960-4a0d-b2b6-d040897a31ff tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] validate_networks() for [('82c9ecbe-90a9-4c18-ac3f-1e6ffd03957c', None, None, None, None, None)] {{(pid=134052) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:57:17.475972 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:57:17.838617 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-879427cb-ac57-4311-b112-32528a27d952 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6381ae230a45de8b105374c2d25383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a6a888c878245cb9e5909e071c9b9c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:17.853189 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-879427cb-ac57-4311-b112-32528a27d952 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] 10.222.0.70 "GET /compute/v2.1/servers/543bc953-d047-4594-a5d1-2d3a33fbfa35" status: 200 len: 1316 microversion: 2.1 time: 0.735472 Aug 27 02:57:17.853789 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1704/3418] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:57:17 2022] GET /compute/v2.1/servers/543bc953-d047-4594-a5d1-2d3a33fbfa35 => generated 1316 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:57:17.873506 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-6fde3693-5b10-4f83-abf8-88de44d067c7 req-44a8d518-5bcc-44ef-b2e5-b92ea9039c98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "543bc953-d047-4594-a5d1-2d3a33fbfa35", "name": "network-vif-plugged", "status": "completed", "tag": "d252ad9d-633f-41f3-917d-80b5159c1f85"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:57:17.890096 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-6fde3693-5b10-4f83-abf8-88de44d067c7 req-44a8d518-5bcc-44ef-b2e5-b92ea9039c98 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:17.890771 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-6fde3693-5b10-4f83-abf8-88de44d067c7 req-44a8d518-5bcc-44ef-b2e5-b92ea9039c98 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:17.893176 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-6fde3693-5b10-4f83-abf8-88de44d067c7 req-44a8d518-5bcc-44ef-b2e5-b92ea9039c98 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:17.910438 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-6fde3693-5b10-4f83-abf8-88de44d067c7 req-44a8d518-5bcc-44ef-b2e5-b92ea9039c98 service nova] Creating event network-vif-plugged:d252ad9d-633f-41f3-917d-80b5159c1f85 for instance 543bc953-d047-4594-a5d1-2d3a33fbfa35 on n-h2-852278-4 Aug 27 02:57:17.931804 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-6fde3693-5b10-4f83-abf8-88de44d067c7 req-44a8d518-5bcc-44ef-b2e5-b92ea9039c98 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062602 Aug 27 02:57:17.932716 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1705/3419] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:57:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:57:17.940749 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-362135b2-8c68-4ea2-a42f-a286bad04714 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:17.941876 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-362135b2-8c68-4ea2-a42f-a286bad04714 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] [instance: f8532783-21d1-4910-91ef-223c2379fd43] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:17.956793 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-362135b2-8c68-4ea2-a42f-a286bad04714 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:17.958159 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-362135b2-8c68-4ea2-a42f-a286bad04714 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:17.958667 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-362135b2-8c68-4ea2-a42f-a286bad04714 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:17.961033 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-362135b2-8c68-4ea2-a42f-a286bad04714 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:17.961493 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-362135b2-8c68-4ea2-a42f-a286bad04714 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:17.964409 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-362135b2-8c68-4ea2-a42f-a286bad04714 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:18.503553 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-362135b2-8c68-4ea2-a42f-a286bad04714 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07e9c0615234db297022024208e8e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10678bb6b93c4dc59f76e689f5b20ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:18.525453 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-362135b2-8c68-4ea2-a42f-a286bad04714 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c07e9c0615234db297022024208e8e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10678bb6b93c4dc59f76e689f5b20ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:18.543963 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-362135b2-8c68-4ea2-a42f-a286bad04714 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c07e9c0615234db297022024208e8e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10678bb6b93c4dc59f76e689f5b20ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:18.551873 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-362135b2-8c68-4ea2-a42f-a286bad04714 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] 10.222.0.70 "GET /compute/v2.1/servers/f8532783-21d1-4910-91ef-223c2379fd43" status: 200 len: 1362 microversion: 2.26 time: 0.617819 Aug 27 02:57:18.569065 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1706/3420] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:57:17 2022] GET /compute/v2.1/servers/f8532783-21d1-4910-91ef-223c2379fd43 => generated 1362 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:57:18.575468 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-afdc4950-c7f5-498c-9fe9-90115d6e5abb tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:18.576173 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-afdc4950-c7f5-498c-9fe9-90115d6e5abb tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 123a4464-d077-4253-9d13-38f63f70fc43] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:18.582631 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-afdc4950-c7f5-498c-9fe9-90115d6e5abb tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:18.583124 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-afdc4950-c7f5-498c-9fe9-90115d6e5abb tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:18.584146 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-afdc4950-c7f5-498c-9fe9-90115d6e5abb tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:18.584945 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-afdc4950-c7f5-498c-9fe9-90115d6e5abb tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:18.585400 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-afdc4950-c7f5-498c-9fe9-90115d6e5abb tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:18.585825 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-afdc4950-c7f5-498c-9fe9-90115d6e5abb tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:19.370263 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-35266c4b-7960-4a0d-b2b6-d040897a31ff tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Flavor limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:57:19.371420 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-35266c4b-7960-4a0d-b2b6-d040897a31ff tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Image limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:57:19.372078 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-35266c4b-7960-4a0d-b2b6-d040897a31ff tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Flavor pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:57:19.372706 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-35266c4b-7960-4a0d-b2b6-d040897a31ff tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Image pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:57:19.373418 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-35266c4b-7960-4a0d-b2b6-d040897a31ff tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:57:19.387790 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-35266c4b-7960-4a0d-b2b6-d040897a31ff tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:19.388741 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-35266c4b-7960-4a0d-b2b6-d040897a31ff tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:19.389334 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-35266c4b-7960-4a0d-b2b6-d040897a31ff tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:19.391225 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-35266c4b-7960-4a0d-b2b6-d040897a31ff tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:19.392024 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-35266c4b-7960-4a0d-b2b6-d040897a31ff tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:19.392694 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-35266c4b-7960-4a0d-b2b6-d040897a31ff tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:19.441979 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-afdc4950-c7f5-498c-9fe9-90115d6e5abb tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:19.461137 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-35266c4b-7960-4a0d-b2b6-d040897a31ff tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Getting quotas for project 2448b78114c54dd39bc85538fb973dd2. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:57:19.461550 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-afdc4950-c7f5-498c-9fe9-90115d6e5abb tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/123a4464-d077-4253-9d13-38f63f70fc43" status: 200 len: 1314 microversion: 2.1 time: 0.881361 Aug 27 02:57:19.465454 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1707/3421] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:57:18 2022] GET /compute/v2.1/servers/123a4464-d077-4253-9d13-38f63f70fc43 => generated 1314 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:57:19.492203 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-35266c4b-7960-4a0d-b2b6-d040897a31ff tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Getting quotas for user 2b217f9cbc204919ba77d885315907c2 and project 2448b78114c54dd39bc85538fb973dd2. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:57:19.506735 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f77793c8-1e7e-4f6a-9d0e-0178415e125a tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:19.509453 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-35266c4b-7960-4a0d-b2b6-d040897a31ff tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Going to run 1 instances... {{(pid=134052) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:57:19.509644 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-f77793c8-1e7e-4f6a-9d0e-0178415e125a tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] [instance: 543bc953-d047-4594-a5d1-2d3a33fbfa35] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:19.512703 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-35266c4b-7960-4a0d-b2b6-d040897a31ff tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] [instance: edb9e3a3-f71d-4a90-b617-167316a61e44] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134052) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:57:19.542530 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f77793c8-1e7e-4f6a-9d0e-0178415e125a tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:19.544337 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f77793c8-1e7e-4f6a-9d0e-0178415e125a tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:19.544933 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f77793c8-1e7e-4f6a-9d0e-0178415e125a tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:19.548247 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f77793c8-1e7e-4f6a-9d0e-0178415e125a tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:19.551290 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f77793c8-1e7e-4f6a-9d0e-0178415e125a tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:19.553213 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f77793c8-1e7e-4f6a-9d0e-0178415e125a tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:19.593833 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-35266c4b-7960-4a0d-b2b6-d040897a31ff tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.378772 Aug 27 02:57:19.607526 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1715/3422] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 02:57:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 2393 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:57:19.620256 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-19f48c12-8eaa-48f6-a785-26e580738bfc req-5d641d48-7eed-4050-b708-2a246075b6aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "123a4464-d077-4253-9d13-38f63f70fc43", "tag": "611d60d4-10eb-4ef5-a705-cd3852a652a8"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:57:19.635346 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-19f48c12-8eaa-48f6-a785-26e580738bfc req-5d641d48-7eed-4050-b708-2a246075b6aa service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:19.636066 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-19f48c12-8eaa-48f6-a785-26e580738bfc req-5d641d48-7eed-4050-b708-2a246075b6aa service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:19.636663 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-19f48c12-8eaa-48f6-a785-26e580738bfc req-5d641d48-7eed-4050-b708-2a246075b6aa service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:19.654492 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-19f48c12-8eaa-48f6-a785-26e580738bfc req-5d641d48-7eed-4050-b708-2a246075b6aa service nova] Creating event network-changed:611d60d4-10eb-4ef5-a705-cd3852a652a8 for instance 123a4464-d077-4253-9d13-38f63f70fc43 on n-h1-852278-4 Aug 27 02:57:19.684842 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-19f48c12-8eaa-48f6-a785-26e580738bfc req-5d641d48-7eed-4050-b708-2a246075b6aa service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074775 Aug 27 02:57:19.685641 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1716/3423] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:57:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:57:19.695831 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d7aa2e3b-e2a4-4be6-8e0d-b5a9cf7091f5 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:19.699270 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d7aa2e3b-e2a4-4be6-8e0d-b5a9cf7091f5 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] [instance: f8532783-21d1-4910-91ef-223c2379fd43] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:19.715350 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d7aa2e3b-e2a4-4be6-8e0d-b5a9cf7091f5 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:19.716149 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d7aa2e3b-e2a4-4be6-8e0d-b5a9cf7091f5 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:19.717305 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d7aa2e3b-e2a4-4be6-8e0d-b5a9cf7091f5 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:19.719544 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d7aa2e3b-e2a4-4be6-8e0d-b5a9cf7091f5 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:19.720131 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d7aa2e3b-e2a4-4be6-8e0d-b5a9cf7091f5 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:19.723090 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d7aa2e3b-e2a4-4be6-8e0d-b5a9cf7091f5 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:20.218916 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-f77793c8-1e7e-4f6a-9d0e-0178415e125a tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6381ae230a45de8b105374c2d25383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a6a888c878245cb9e5909e071c9b9c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:20.229079 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-f77793c8-1e7e-4f6a-9d0e-0178415e125a tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] 10.222.0.70 "GET /compute/v2.1/servers/543bc953-d047-4594-a5d1-2d3a33fbfa35" status: 200 len: 1505 microversion: 2.1 time: 0.762544 Aug 27 02:57:20.241856 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1708/3424] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:57:19 2022] GET /compute/v2.1/servers/543bc953-d047-4594-a5d1-2d3a33fbfa35 => generated 1505 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:57:20.253491 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3cca91df-044f-4785-8976-82459ee75176 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:20.254445 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-3cca91df-044f-4785-8976-82459ee75176 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] [instance: edb9e3a3-f71d-4a90-b617-167316a61e44] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:20.434131 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-3cca91df-044f-4785-8976-82459ee75176 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b217f9cbc204919ba77d885315907c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2448b78114c54dd39bc85538fb973dd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:20.444535 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-3cca91df-044f-4785-8976-82459ee75176 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] 10.222.0.70 "GET /compute/v2.1/servers/edb9e3a3-f71d-4a90-b617-167316a61e44" status: 200 len: 1221 microversion: 2.1 time: 0.201450 Aug 27 02:57:20.448903 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1709/3425] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:57:20 2022] GET /compute/v2.1/servers/edb9e3a3-f71d-4a90-b617-167316a61e44 => generated 1221 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:57:20.456035 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-5c065d09-bc21-4ab7-b300-d9dc9c5d7efc tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-674481318"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:57:20.462279 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-5c065d09-bc21-4ab7-b300-d9dc9c5d7efc tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] [instance: 543bc953-d047-4594-a5d1-2d3a33fbfa35] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:20.474721 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5c065d09-bc21-4ab7-b300-d9dc9c5d7efc tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:20.475368 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5c065d09-bc21-4ab7-b300-d9dc9c5d7efc tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:20.476042 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5c065d09-bc21-4ab7-b300-d9dc9c5d7efc tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:20.488972 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5c065d09-bc21-4ab7-b300-d9dc9c5d7efc tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:20.489499 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5c065d09-bc21-4ab7-b300-d9dc9c5d7efc tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:20.489846 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-d7aa2e3b-e2a4-4be6-8e0d-b5a9cf7091f5 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07e9c0615234db297022024208e8e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10678bb6b93c4dc59f76e689f5b20ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:20.490851 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5c065d09-bc21-4ab7-b300-d9dc9c5d7efc tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:20.508740 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-d7aa2e3b-e2a4-4be6-8e0d-b5a9cf7091f5 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c07e9c0615234db297022024208e8e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10678bb6b93c4dc59f76e689f5b20ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:20.510479 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-d7aa2e3b-e2a4-4be6-8e0d-b5a9cf7091f5 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c07e9c0615234db297022024208e8e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10678bb6b93c4dc59f76e689f5b20ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:20.518465 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d7aa2e3b-e2a4-4be6-8e0d-b5a9cf7091f5 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] 10.222.0.70 "GET /compute/v2.1/servers/f8532783-21d1-4910-91ef-223c2379fd43" status: 200 len: 1362 microversion: 2.26 time: 0.830645 Aug 27 02:57:20.519734 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1717/3426] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:57:19 2022] GET /compute/v2.1/servers/f8532783-21d1-4910-91ef-223c2379fd43 => generated 1362 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:57:20.527797 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6f79a440-24b2-410d-a360-a5bdc695d688 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:20.530501 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-6f79a440-24b2-410d-a360-a5bdc695d688 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 123a4464-d077-4253-9d13-38f63f70fc43] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:20.541070 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6f79a440-24b2-410d-a360-a5bdc695d688 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:20.541783 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6f79a440-24b2-410d-a360-a5bdc695d688 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:20.542361 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6f79a440-24b2-410d-a360-a5bdc695d688 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:20.543797 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6f79a440-24b2-410d-a360-a5bdc695d688 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:20.544414 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6f79a440-24b2-410d-a360-a5bdc695d688 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:20.544975 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6f79a440-24b2-410d-a360-a5bdc695d688 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:21.027213 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.network.security_group_api [None req-5c065d09-bc21-4ab7-b300-d9dc9c5d7efc tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Adding security group d1886d11-6bfb-413b-acdc-007193effed7 to port d252ad9d-633f-41f3-917d-80b5159c1f85 Aug 27 02:57:21.067899 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-6f79a440-24b2-410d-a360-a5bdc695d688 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:21.086666 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-6f79a440-24b2-410d-a360-a5bdc695d688 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/123a4464-d077-4253-9d13-38f63f70fc43" status: 200 len: 1314 microversion: 2.1 time: 0.565445 Aug 27 02:57:21.087514 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1718/3427] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:57:20 2022] GET /compute/v2.1/servers/123a4464-d077-4253-9d13-38f63f70fc43 => generated 1314 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:57:21.645837 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a07fa0eb-0bf7-4978-9b5d-4294edfd6502 tempest-VolumesSnapshotsTestJSON-1454701903 tempest-VolumesSnapshotsTestJSON-1454701903-project] Action: 'create', calling method: .version_select at 0x7f5ee2504dc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-673356440"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:57:21.907321 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-5c065d09-bc21-4ab7-b300-d9dc9c5d7efc tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] 10.222.0.70 "POST /compute/v2.1/servers/543bc953-d047-4594-a5d1-2d3a33fbfa35/action" status: 202 len: 0 microversion: 2.1 time: 1.457010 Aug 27 02:57:21.911994 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1710/3428] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 02:57:20 2022] POST /compute/v2.1/servers/543bc953-d047-4594-a5d1-2d3a33fbfa35/action => generated 0 bytes in 1462 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:57:21.924050 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-011646ec-4928-42b1-ad43-e8fba8712016 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:21.924780 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-011646ec-4928-42b1-ad43-e8fba8712016 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] [instance: edb9e3a3-f71d-4a90-b617-167316a61e44] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:21.942262 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-011646ec-4928-42b1-ad43-e8fba8712016 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:21.943725 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-011646ec-4928-42b1-ad43-e8fba8712016 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:21.947798 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-011646ec-4928-42b1-ad43-e8fba8712016 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:21.952898 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-011646ec-4928-42b1-ad43-e8fba8712016 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:21.953361 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-011646ec-4928-42b1-ad43-e8fba8712016 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:21.953803 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-011646ec-4928-42b1-ad43-e8fba8712016 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:22.167429 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-011646ec-4928-42b1-ad43-e8fba8712016 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b217f9cbc204919ba77d885315907c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2448b78114c54dd39bc85538fb973dd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:22.177344 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-011646ec-4928-42b1-ad43-e8fba8712016 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] 10.222.0.70 "GET /compute/v2.1/servers/edb9e3a3-f71d-4a90-b617-167316a61e44" status: 200 len: 1279 microversion: 2.1 time: 0.264220 Aug 27 02:57:22.180135 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1711/3429] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:57:21 2022] GET /compute/v2.1/servers/edb9e3a3-f71d-4a90-b617-167316a61e44 => generated 1279 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:57:22.192079 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-9cbedfb9-6c77-483e-95f8-652dcf4e2807 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:22.198730 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-9cbedfb9-6c77-483e-95f8-652dcf4e2807 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] [instance: f8532783-21d1-4910-91ef-223c2379fd43] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:22.205293 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9cbedfb9-6c77-483e-95f8-652dcf4e2807 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:22.210217 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9cbedfb9-6c77-483e-95f8-652dcf4e2807 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:22.210881 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9cbedfb9-6c77-483e-95f8-652dcf4e2807 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:22.212077 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9cbedfb9-6c77-483e-95f8-652dcf4e2807 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:22.212961 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9cbedfb9-6c77-483e-95f8-652dcf4e2807 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:22.213745 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9cbedfb9-6c77-483e-95f8-652dcf4e2807 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:22.220805 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a07fa0eb-0bf7-4978-9b5d-4294edfd6502 tempest-VolumesSnapshotsTestJSON-1454701903 tempest-VolumesSnapshotsTestJSON-1454701903-project] 10.222.0.70 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.784870 Aug 27 02:57:22.222037 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1719/3430] 10.222.0.70 () {60 vars in 1155 bytes} [Sat Aug 27 02:57:21 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 787 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Aug 27 02:57:22.227155 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-a8fe34af-e9d2-475f-b72a-ecfcae92a2b1 req-8495ba8c-1885-423f-9dee-46b629c8ae7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8532783-21d1-4910-91ef-223c2379fd43", "name": "network-vif-plugged", "status": "completed", "tag": "e085573e-6d8b-4579-a677-c77683bcdb66"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:57:22.259118 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-a8fe34af-e9d2-475f-b72a-ecfcae92a2b1 req-8495ba8c-1885-423f-9dee-46b629c8ae7e service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:22.261859 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-a8fe34af-e9d2-475f-b72a-ecfcae92a2b1 req-8495ba8c-1885-423f-9dee-46b629c8ae7e service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:22.262534 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-a8fe34af-e9d2-475f-b72a-ecfcae92a2b1 req-8495ba8c-1885-423f-9dee-46b629c8ae7e service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:22.285234 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-a8fe34af-e9d2-475f-b72a-ecfcae92a2b1 req-8495ba8c-1885-423f-9dee-46b629c8ae7e service nova] Creating event network-vif-plugged:e085573e-6d8b-4579-a677-c77683bcdb66 for instance f8532783-21d1-4910-91ef-223c2379fd43 on n-h1-852278-4 Aug 27 02:57:22.292123 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-a8fe34af-e9d2-475f-b72a-ecfcae92a2b1 req-8495ba8c-1885-423f-9dee-46b629c8ae7e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068470 Aug 27 02:57:22.293888 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1720/3431] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:57:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:57:22.303609 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-29c6eaeb-21c0-445d-b169-794d79ad5bd6 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-757177487"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:57:22.304640 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-29c6eaeb-21c0-445d-b169-794d79ad5bd6 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] [instance: 543bc953-d047-4594-a5d1-2d3a33fbfa35] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:22.313660 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-29c6eaeb-21c0-445d-b169-794d79ad5bd6 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:22.316408 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-29c6eaeb-21c0-445d-b169-794d79ad5bd6 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:22.317507 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-29c6eaeb-21c0-445d-b169-794d79ad5bd6 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:22.318517 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-29c6eaeb-21c0-445d-b169-794d79ad5bd6 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:22.319178 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-29c6eaeb-21c0-445d-b169-794d79ad5bd6 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:22.320157 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-29c6eaeb-21c0-445d-b169-794d79ad5bd6 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:22.848680 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-9cbedfb9-6c77-483e-95f8-652dcf4e2807 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07e9c0615234db297022024208e8e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10678bb6b93c4dc59f76e689f5b20ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:22.857949 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-9cbedfb9-6c77-483e-95f8-652dcf4e2807 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c07e9c0615234db297022024208e8e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10678bb6b93c4dc59f76e689f5b20ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:22.859651 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-9cbedfb9-6c77-483e-95f8-652dcf4e2807 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c07e9c0615234db297022024208e8e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10678bb6b93c4dc59f76e689f5b20ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:22.861061 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-9cbedfb9-6c77-483e-95f8-652dcf4e2807 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] 10.222.0.70 "GET /compute/v2.1/servers/f8532783-21d1-4910-91ef-223c2379fd43" status: 200 len: 1362 microversion: 2.26 time: 0.675635 Aug 27 02:57:22.876832 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1712/3432] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:57:22 2022] GET /compute/v2.1/servers/f8532783-21d1-4910-91ef-223c2379fd43 => generated 1362 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:57:22.883147 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-6f51f303-4fa2-4bdb-853f-7455b7d5fd80 req-ae7ab0af-9464-4979-9063-c6477244621e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "543bc953-d047-4594-a5d1-2d3a33fbfa35", "tag": "d252ad9d-633f-41f3-917d-80b5159c1f85"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:57:22.893636 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-6f51f303-4fa2-4bdb-853f-7455b7d5fd80 req-ae7ab0af-9464-4979-9063-c6477244621e service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:22.894356 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-6f51f303-4fa2-4bdb-853f-7455b7d5fd80 req-ae7ab0af-9464-4979-9063-c6477244621e service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:22.894961 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-6f51f303-4fa2-4bdb-853f-7455b7d5fd80 req-ae7ab0af-9464-4979-9063-c6477244621e service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:22.907395 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-6f51f303-4fa2-4bdb-853f-7455b7d5fd80 req-ae7ab0af-9464-4979-9063-c6477244621e service nova] Creating event network-changed:d252ad9d-633f-41f3-917d-80b5159c1f85 for instance 543bc953-d047-4594-a5d1-2d3a33fbfa35 on n-h2-852278-4 Aug 27 02:57:22.913652 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-6f51f303-4fa2-4bdb-853f-7455b7d5fd80 req-ae7ab0af-9464-4979-9063-c6477244621e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035076 Aug 27 02:57:22.914852 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1713/3433] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:57:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:57:22.921095 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-451ea23c-cf63-43f4-a778-e51d3bf76709 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:22.922002 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-451ea23c-cf63-43f4-a778-e51d3bf76709 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 123a4464-d077-4253-9d13-38f63f70fc43] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:22.932928 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-451ea23c-cf63-43f4-a778-e51d3bf76709 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:22.933625 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-451ea23c-cf63-43f4-a778-e51d3bf76709 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:22.935981 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-451ea23c-cf63-43f4-a778-e51d3bf76709 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:22.936886 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-451ea23c-cf63-43f4-a778-e51d3bf76709 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:22.937474 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-451ea23c-cf63-43f4-a778-e51d3bf76709 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:22.938182 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-451ea23c-cf63-43f4-a778-e51d3bf76709 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:23.214230 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.network.security_group_api [None req-29c6eaeb-21c0-445d-b169-794d79ad5bd6 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Adding security group f4af0402-e097-4969-a14c-e6a8677ed4d3 to port d252ad9d-633f-41f3-917d-80b5159c1f85 Aug 27 02:57:24.065630 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-451ea23c-cf63-43f4-a778-e51d3bf76709 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:24.075206 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-451ea23c-cf63-43f4-a778-e51d3bf76709 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/123a4464-d077-4253-9d13-38f63f70fc43" status: 200 len: 1314 microversion: 2.1 time: 1.158343 Aug 27 02:57:24.076469 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1714/3434] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:57:22 2022] GET /compute/v2.1/servers/123a4464-d077-4253-9d13-38f63f70fc43 => generated 1314 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:57:24.083438 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-5aaab053-e6b2-4046-9adb-84327e88ab3c tempest-VolumesSnapshotsTestJSON-1454701903 tempest-VolumesSnapshotsTestJSON-1454701903-project] Calling method '.version_select at 0x7f5ede9948b0>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:24.182652 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-5aaab053-e6b2-4046-9adb-84327e88ab3c tempest-VolumesSnapshotsTestJSON-1454701903 tempest-VolumesSnapshotsTestJSON-1454701903-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/d10772fc-f691-4890-ace8-8ba362b7851b" status: 200 len: 345 microversion: 2.1 time: 0.104303 Aug 27 02:57:24.183490 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1715/3435] 10.222.0.70 () {58 vars in 1245 bytes} [Sat Aug 27 02:57:24 2022] GET /compute/v2.1/os-volumes/d10772fc-f691-4890-ace8-8ba362b7851b => generated 345 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:57:24.202689 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c73999ab-aa6b-497e-99dd-57a9307b5e29 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:24.203621 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-c73999ab-aa6b-497e-99dd-57a9307b5e29 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] [instance: edb9e3a3-f71d-4a90-b617-167316a61e44] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:24.215495 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c73999ab-aa6b-497e-99dd-57a9307b5e29 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:24.216230 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c73999ab-aa6b-497e-99dd-57a9307b5e29 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:24.217377 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c73999ab-aa6b-497e-99dd-57a9307b5e29 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:24.218866 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c73999ab-aa6b-497e-99dd-57a9307b5e29 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:24.219463 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c73999ab-aa6b-497e-99dd-57a9307b5e29 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:24.220519 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c73999ab-aa6b-497e-99dd-57a9307b5e29 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:24.371680 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-c73999ab-aa6b-497e-99dd-57a9307b5e29 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b217f9cbc204919ba77d885315907c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2448b78114c54dd39bc85538fb973dd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:24.382317 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c73999ab-aa6b-497e-99dd-57a9307b5e29 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] 10.222.0.70 "GET /compute/v2.1/servers/edb9e3a3-f71d-4a90-b617-167316a61e44" status: 200 len: 1279 microversion: 2.1 time: 0.189266 Aug 27 02:57:24.389483 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1716/3436] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:57:24 2022] GET /compute/v2.1/servers/edb9e3a3-f71d-4a90-b617-167316a61e44 => generated 1279 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:57:24.399430 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b76fd89a-e19c-4841-aed5-b64343365c84 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:24.404070 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b76fd89a-e19c-4841-aed5-b64343365c84 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] [instance: f8532783-21d1-4910-91ef-223c2379fd43] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:24.412073 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b76fd89a-e19c-4841-aed5-b64343365c84 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:24.412605 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b76fd89a-e19c-4841-aed5-b64343365c84 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:24.413040 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b76fd89a-e19c-4841-aed5-b64343365c84 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:24.413916 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b76fd89a-e19c-4841-aed5-b64343365c84 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:24.414371 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b76fd89a-e19c-4841-aed5-b64343365c84 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:24.415039 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b76fd89a-e19c-4841-aed5-b64343365c84 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:25.133209 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-b76fd89a-e19c-4841-aed5-b64343365c84 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07e9c0615234db297022024208e8e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10678bb6b93c4dc59f76e689f5b20ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:25.144574 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-b76fd89a-e19c-4841-aed5-b64343365c84 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c07e9c0615234db297022024208e8e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10678bb6b93c4dc59f76e689f5b20ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:25.146787 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-b76fd89a-e19c-4841-aed5-b64343365c84 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c07e9c0615234db297022024208e8e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10678bb6b93c4dc59f76e689f5b20ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:25.148410 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b76fd89a-e19c-4841-aed5-b64343365c84 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] 10.222.0.70 "GET /compute/v2.1/servers/f8532783-21d1-4910-91ef-223c2379fd43" status: 200 len: 1547 microversion: 2.26 time: 0.755328 Aug 27 02:57:25.149576 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1717/3437] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:57:24 2022] GET /compute/v2.1/servers/f8532783-21d1-4910-91ef-223c2379fd43 => generated 1547 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:57:25.156880 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0bd040e0-c8b8-45fe-859b-a02de9ebbdda tempest-VolumesSnapshotsTestJSON-1454701903 tempest-VolumesSnapshotsTestJSON-1454701903-project] Action: 'create', calling method: .version_select at 0x7f5ede8d9ee0>, body: {"snapshot": {"volume_id": "d10772fc-f691-4890-ace8-8ba362b7851b", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-2009588713"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:57:25.403666 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-29c6eaeb-21c0-445d-b169-794d79ad5bd6 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] 10.222.0.70 "POST /compute/v2.1/servers/543bc953-d047-4594-a5d1-2d3a33fbfa35/action" status: 202 len: 0 microversion: 2.1 time: 3.108181 Aug 27 02:57:25.405097 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1721/3438] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 02:57:22 2022] POST /compute/v2.1/servers/543bc953-d047-4594-a5d1-2d3a33fbfa35/action => generated 0 bytes in 3110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:57:25.413806 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-37a05b6c-5f29-46e1-a744-5e32661c71b6 req-e1104eca-e7db-4554-b688-08ba642f3d89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02eba429-ecb3-4a5c-87ea-c049ad7aca1a", "tag": "ef643ab7-d23e-493f-ac79-153b06eccfce"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:57:25.473436 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-37a05b6c-5f29-46e1-a744-5e32661c71b6 req-e1104eca-e7db-4554-b688-08ba642f3d89 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:25.474823 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-37a05b6c-5f29-46e1-a744-5e32661c71b6 req-e1104eca-e7db-4554-b688-08ba642f3d89 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:25.475782 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-37a05b6c-5f29-46e1-a744-5e32661c71b6 req-e1104eca-e7db-4554-b688-08ba642f3d89 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:25.502214 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-0bd040e0-c8b8-45fe-859b-a02de9ebbdda tempest-VolumesSnapshotsTestJSON-1454701903 tempest-VolumesSnapshotsTestJSON-1454701903-project] 10.222.0.70 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.350361 Aug 27 02:57:25.502822 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1718/3439] 10.222.0.70 () {60 vars in 1162 bytes} [Sat Aug 27 02:57:25 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:57:25.509415 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0da2c7b2-38d1-4c47-968e-6d39c2a20a3f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:25.509415 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-0da2c7b2-38d1-4c47-968e-6d39c2a20a3f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 123a4464-d077-4253-9d13-38f63f70fc43] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:25.533735 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-37a05b6c-5f29-46e1-a744-5e32661c71b6 req-e1104eca-e7db-4554-b688-08ba642f3d89 service nova] Creating event network-changed:ef643ab7-d23e-493f-ac79-153b06eccfce for instance 02eba429-ecb3-4a5c-87ea-c049ad7aca1a on n-h2-852278-4 Aug 27 02:57:25.545110 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0da2c7b2-38d1-4c47-968e-6d39c2a20a3f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:25.545832 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0da2c7b2-38d1-4c47-968e-6d39c2a20a3f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:25.546048 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-37a05b6c-5f29-46e1-a744-5e32661c71b6 req-e1104eca-e7db-4554-b688-08ba642f3d89 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139424 Aug 27 02:57:25.546619 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0da2c7b2-38d1-4c47-968e-6d39c2a20a3f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:25.551081 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0da2c7b2-38d1-4c47-968e-6d39c2a20a3f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:25.551997 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0da2c7b2-38d1-4c47-968e-6d39c2a20a3f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:25.552901 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0da2c7b2-38d1-4c47-968e-6d39c2a20a3f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:25.561465 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1722/3440] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:57:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:57:25.573645 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-7f1bda2a-2729-49c0-b022-1a357b93b248 req-f5e924ea-c5fe-4c3d-8208-b6af85269df5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fce0841b-76a8-496d-8fc0-69ad3fa9f7a6", "tag": "d0f2db9d-c256-452d-8d30-d74c91aaec32"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:57:25.617591 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-7f1bda2a-2729-49c0-b022-1a357b93b248 req-f5e924ea-c5fe-4c3d-8208-b6af85269df5 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:25.623549 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-7f1bda2a-2729-49c0-b022-1a357b93b248 req-f5e924ea-c5fe-4c3d-8208-b6af85269df5 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:25.625183 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-7f1bda2a-2729-49c0-b022-1a357b93b248 req-f5e924ea-c5fe-4c3d-8208-b6af85269df5 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:25.647082 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-7f1bda2a-2729-49c0-b022-1a357b93b248 req-f5e924ea-c5fe-4c3d-8208-b6af85269df5 service nova] Creating event network-changed:d0f2db9d-c256-452d-8d30-d74c91aaec32 for instance fce0841b-76a8-496d-8fc0-69ad3fa9f7a6 on n-h1-852278-4 Aug 27 02:57:25.653490 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-7f1bda2a-2729-49c0-b022-1a357b93b248 req-f5e924ea-c5fe-4c3d-8208-b6af85269df5 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090336 Aug 27 02:57:25.655657 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1723/3441] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:57:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:57:25.662395 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-16d93b87-b9a4-4c70-8536-2d34fa405fca tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Calling method '.version_select at 0x7f5ee3518280>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:25.668172 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:57:25.682648 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-16d93b87-b9a4-4c70-8536-2d34fa405fca tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:25.683375 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-16d93b87-b9a4-4c70-8536-2d34fa405fca tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:25.684063 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-16d93b87-b9a4-4c70-8536-2d34fa405fca tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:25.685366 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-16d93b87-b9a4-4c70-8536-2d34fa405fca tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] [instance: f8532783-21d1-4910-91ef-223c2379fd43] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:25.693398 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-16d93b87-b9a4-4c70-8536-2d34fa405fca tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:25.694095 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-16d93b87-b9a4-4c70-8536-2d34fa405fca tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:25.694679 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-16d93b87-b9a4-4c70-8536-2d34fa405fca tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:25.696434 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-16d93b87-b9a4-4c70-8536-2d34fa405fca tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:25.697302 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-16d93b87-b9a4-4c70-8536-2d34fa405fca tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:25.698019 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-16d93b87-b9a4-4c70-8536-2d34fa405fca tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:25.747457 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-16d93b87-b9a4-4c70-8536-2d34fa405fca tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:25.749311 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-16d93b87-b9a4-4c70-8536-2d34fa405fca tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:25.750095 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-16d93b87-b9a4-4c70-8536-2d34fa405fca tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:25.786846 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-16d93b87-b9a4-4c70-8536-2d34fa405fca tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:25.788085 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-16d93b87-b9a4-4c70-8536-2d34fa405fca tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:25.788768 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-16d93b87-b9a4-4c70-8536-2d34fa405fca tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:25.822708 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=1,nova_cell1:RELEASE=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:57:25.828496 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.instance [None req-16d93b87-b9a4-4c70-8536-2d34fa405fca tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lazy-loading 'flavor' on Instance uuid f8532783-21d1-4910-91ef-223c2379fd43 {{(pid=134052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:57:25.848271 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-16d93b87-b9a4-4c70-8536-2d34fa405fca tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] 10.222.0.70 "PUT /compute/v2.1/servers/f8532783-21d1-4910-91ef-223c2379fd43/tags/tempest-tag-1992064466" status: 201 len: 0 microversion: 2.26 time: 0.190905 Aug 27 02:57:25.855562 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1724/3442] 10.222.0.70 () {62 vars in 1380 bytes} [Sat Aug 27 02:57:25 2022] PUT /compute/v2.1/servers/f8532783-21d1-4910-91ef-223c2379fd43/tags/tempest-tag-1992064466 => generated 0 bytes in 199 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Aug 27 02:57:25.861825 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-061fa0e4-9b36-4556-ae0d-54ad6e841644 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:25.862711 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-061fa0e4-9b36-4556-ae0d-54ad6e841644 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] [instance: edb9e3a3-f71d-4a90-b617-167316a61e44] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:25.872629 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-061fa0e4-9b36-4556-ae0d-54ad6e841644 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:25.873315 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-061fa0e4-9b36-4556-ae0d-54ad6e841644 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:25.873895 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-061fa0e4-9b36-4556-ae0d-54ad6e841644 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:25.874992 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-061fa0e4-9b36-4556-ae0d-54ad6e841644 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:25.875732 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-061fa0e4-9b36-4556-ae0d-54ad6e841644 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:25.876441 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-061fa0e4-9b36-4556-ae0d-54ad6e841644 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:26.373757 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-0da2c7b2-38d1-4c47-968e-6d39c2a20a3f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:26.384240 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-0da2c7b2-38d1-4c47-968e-6d39c2a20a3f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/123a4464-d077-4253-9d13-38f63f70fc43" status: 200 len: 1314 microversion: 2.1 time: 0.880288 Aug 27 02:57:26.384864 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1719/3443] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:57:25 2022] GET /compute/v2.1/servers/123a4464-d077-4253-9d13-38f63f70fc43 => generated 1314 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:57:26.408724 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-061fa0e4-9b36-4556-ae0d-54ad6e841644 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b217f9cbc204919ba77d885315907c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2448b78114c54dd39bc85538fb973dd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:26.411926 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-36339f08-7965-4e2b-a1e0-590154cb6391 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:26.412448 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-36339f08-7965-4e2b-a1e0-590154cb6391 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] [instance: 543bc953-d047-4594-a5d1-2d3a33fbfa35] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:26.421576 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-061fa0e4-9b36-4556-ae0d-54ad6e841644 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] 10.222.0.70 "GET /compute/v2.1/servers/edb9e3a3-f71d-4a90-b617-167316a61e44" status: 200 len: 1321 microversion: 2.1 time: 0.564261 Aug 27 02:57:26.422779 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1725/3444] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:57:25 2022] GET /compute/v2.1/servers/edb9e3a3-f71d-4a90-b617-167316a61e44 => generated 1321 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:57:26.432614 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-36339f08-7965-4e2b-a1e0-590154cb6391 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:26.433174 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-36339f08-7965-4e2b-a1e0-590154cb6391 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:26.433617 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-36339f08-7965-4e2b-a1e0-590154cb6391 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:26.436594 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-36339f08-7965-4e2b-a1e0-590154cb6391 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:26.437915 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-36339f08-7965-4e2b-a1e0-590154cb6391 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:26.440204 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8bf1a205-6cf8-4f99-941f-2999b88cdfc0 tempest-VolumesSnapshotsTestJSON-1454701903 tempest-VolumesSnapshotsTestJSON-1454701903-project] Calling method '.version_select at 0x7f5ee321ad30>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:26.447498 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-36339f08-7965-4e2b-a1e0-590154cb6391 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:26.543704 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-8bf1a205-6cf8-4f99-941f-2999b88cdfc0 tempest-VolumesSnapshotsTestJSON-1454701903 tempest-VolumesSnapshotsTestJSON-1454701903-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/54f98102-d393-48e7-b01b-77ae8261cb6b" status: 200 len: 287 microversion: 2.1 time: 0.118996 Aug 27 02:57:26.545043 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1726/3445] 10.222.0.70 () {58 vars in 1251 bytes} [Sat Aug 27 02:57:26 2022] GET /compute/v2.1/os-snapshots/54f98102-d393-48e7-b01b-77ae8261cb6b => generated 287 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:57:26.551645 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-93ef0748-cb2f-4d6b-b66d-f0d31acb36df tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Calling method '.version_select at 0x7f5ee3828700>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:26.563600 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-93ef0748-cb2f-4d6b-b66d-f0d31acb36df tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:26.565789 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-93ef0748-cb2f-4d6b-b66d-f0d31acb36df tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:26.566581 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-93ef0748-cb2f-4d6b-b66d-f0d31acb36df tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:26.584078 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-93ef0748-cb2f-4d6b-b66d-f0d31acb36df tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] 10.222.0.70 "GET /compute/v2.1/servers/f8532783-21d1-4910-91ef-223c2379fd43/tags/tempest-tag-1992064466" status: 204 len: 0 microversion: 2.26 time: 0.037216 Aug 27 02:57:26.585741 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1727/3446] 10.222.0.70 () {60 vars in 1361 bytes} [Sat Aug 27 02:57:26 2022] GET /compute/v2.1/servers/f8532783-21d1-4910-91ef-223c2379fd43/tags/tempest-tag-1992064466 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 02:57:26.594662 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-bfa23258-636a-43a6-935f-9f6ac33c74ba req-8c06e91f-e796-4994-a464-d7250f29ecda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "123a4464-d077-4253-9d13-38f63f70fc43", "name": "network-vif-plugged", "status": "completed", "tag": "611d60d4-10eb-4ef5-a705-cd3852a652a8"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:57:26.610165 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-bfa23258-636a-43a6-935f-9f6ac33c74ba req-8c06e91f-e796-4994-a464-d7250f29ecda service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:26.610923 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-bfa23258-636a-43a6-935f-9f6ac33c74ba req-8c06e91f-e796-4994-a464-d7250f29ecda service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:26.611540 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-bfa23258-636a-43a6-935f-9f6ac33c74ba req-8c06e91f-e796-4994-a464-d7250f29ecda service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:26.631196 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-bfa23258-636a-43a6-935f-9f6ac33c74ba req-8c06e91f-e796-4994-a464-d7250f29ecda service nova] Creating event network-vif-plugged:611d60d4-10eb-4ef5-a705-cd3852a652a8 for instance 123a4464-d077-4253-9d13-38f63f70fc43 on n-h1-852278-4 Aug 27 02:57:26.637916 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-bfa23258-636a-43a6-935f-9f6ac33c74ba req-8c06e91f-e796-4994-a464-d7250f29ecda service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048905 Aug 27 02:57:26.639967 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1728/3447] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:57:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:57:26.647009 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-bd7336dc-fffb-417c-abd5-9c2cc78f9d9d tempest-VolumesSnapshotsTestJSON-1454701903 tempest-VolumesSnapshotsTestJSON-1454701903-project] Calling method '.version_select at 0x7f5ee35e2d30>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:26.738153 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-bd7336dc-fffb-417c-abd5-9c2cc78f9d9d tempest-VolumesSnapshotsTestJSON-1454701903 tempest-VolumesSnapshotsTestJSON-1454701903-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.096858 Aug 27 02:57:26.745287 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1729/3448] 10.222.0.70 () {58 vars in 1140 bytes} [Sat Aug 27 02:57:26 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:57:26.766409 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-1745f776-a406-48e2-9af6-0c714e8aba8e tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Calling method '.version_select at 0x7f5ee31a65e0>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:26.779709 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1745f776-a406-48e2-9af6-0c714e8aba8e tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:26.780564 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1745f776-a406-48e2-9af6-0c714e8aba8e tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:26.781224 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1745f776-a406-48e2-9af6-0c714e8aba8e tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:26.782597 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-1745f776-a406-48e2-9af6-0c714e8aba8e tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] [instance: f8532783-21d1-4910-91ef-223c2379fd43] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:26.791033 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1745f776-a406-48e2-9af6-0c714e8aba8e tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:26.792545 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1745f776-a406-48e2-9af6-0c714e8aba8e tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:26.793198 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1745f776-a406-48e2-9af6-0c714e8aba8e tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:26.794118 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1745f776-a406-48e2-9af6-0c714e8aba8e tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:26.794768 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1745f776-a406-48e2-9af6-0c714e8aba8e tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:26.795431 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1745f776-a406-48e2-9af6-0c714e8aba8e tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:26.849402 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1745f776-a406-48e2-9af6-0c714e8aba8e tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:26.849878 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1745f776-a406-48e2-9af6-0c714e8aba8e tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:26.850312 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1745f776-a406-48e2-9af6-0c714e8aba8e tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:26.871478 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.instance [None req-1745f776-a406-48e2-9af6-0c714e8aba8e tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lazy-loading 'flavor' on Instance uuid f8532783-21d1-4910-91ef-223c2379fd43 {{(pid=134052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:57:26.893701 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-1745f776-a406-48e2-9af6-0c714e8aba8e tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] 10.222.0.70 "DELETE /compute/v2.1/servers/f8532783-21d1-4910-91ef-223c2379fd43/tags" status: 204 len: 0 microversion: 2.26 time: 0.143559 Aug 27 02:57:26.895703 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1730/3449] 10.222.0.70 () {60 vars in 1295 bytes} [Sat Aug 27 02:57:26 2022] DELETE /compute/v2.1/servers/f8532783-21d1-4910-91ef-223c2379fd43/tags => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 02:57:26.903863 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5cea963e-db90-4758-9ce1-f046f1710918 tempest-VolumesSnapshotsTestJSON-1454701903 tempest-VolumesSnapshotsTestJSON-1454701903-project] Calling method '.version_select at 0x7f5ee31a6a60>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:26.912224 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=6 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:57:26.949478 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-5cea963e-db90-4758-9ce1-f046f1710918 tempest-VolumesSnapshotsTestJSON-1454701903 tempest-VolumesSnapshotsTestJSON-1454701903-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/54f98102-d393-48e7-b01b-77ae8261cb6b" status: 200 len: 287 microversion: 2.1 time: 0.052318 Aug 27 02:57:26.954303 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1731/3450] 10.222.0.70 () {58 vars in 1251 bytes} [Sat Aug 27 02:57:26 2022] GET /compute/v2.1/os-snapshots/54f98102-d393-48e7-b01b-77ae8261cb6b => generated 287 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:57:26.955984 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9e53af51-f00d-4826-a780-e50546a7ee54 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Calling method '.version_select at 0x7f5ee3518820>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:26.965789 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9e53af51-f00d-4826-a780-e50546a7ee54 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:26.966285 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9e53af51-f00d-4826-a780-e50546a7ee54 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:26.966717 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9e53af51-f00d-4826-a780-e50546a7ee54 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:26.978153 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9e53af51-f00d-4826-a780-e50546a7ee54 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] 10.222.0.70 "GET /compute/v2.1/servers/f8532783-21d1-4910-91ef-223c2379fd43/tags" status: 200 len: 12 microversion: 2.26 time: 0.026525 Aug 27 02:57:26.978958 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1732/3451] 10.222.0.70 () {60 vars in 1292 bytes} [Sat Aug 27 02:57:26 2022] GET /compute/v2.1/servers/f8532783-21d1-4910-91ef-223c2379fd43/tags => generated 12 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:57:26.989343 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-19520423-e85f-4e7d-93c5-14f9f91be5f8 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Calling method '.version_select at 0x7f5ee339b5e0>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:27.028291 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-19520423-e85f-4e7d-93c5-14f9f91be5f8 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:27.029110 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-19520423-e85f-4e7d-93c5-14f9f91be5f8 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:27.029897 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-19520423-e85f-4e7d-93c5-14f9f91be5f8 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:27.040035 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-19520423-e85f-4e7d-93c5-14f9f91be5f8 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] [instance: f8532783-21d1-4910-91ef-223c2379fd43] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:27.052394 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-19520423-e85f-4e7d-93c5-14f9f91be5f8 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:27.053387 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-19520423-e85f-4e7d-93c5-14f9f91be5f8 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:27.053963 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-19520423-e85f-4e7d-93c5-14f9f91be5f8 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:27.054673 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-19520423-e85f-4e7d-93c5-14f9f91be5f8 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:27.055152 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-19520423-e85f-4e7d-93c5-14f9f91be5f8 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:27.055914 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-19520423-e85f-4e7d-93c5-14f9f91be5f8 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:27.094234 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-19520423-e85f-4e7d-93c5-14f9f91be5f8 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:27.095072 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-19520423-e85f-4e7d-93c5-14f9f91be5f8 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:27.095637 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-19520423-e85f-4e7d-93c5-14f9f91be5f8 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:27.108499 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-19520423-e85f-4e7d-93c5-14f9f91be5f8 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:27.109830 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-19520423-e85f-4e7d-93c5-14f9f91be5f8 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:27.123114 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-19520423-e85f-4e7d-93c5-14f9f91be5f8 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:27.170153 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.instance [None req-19520423-e85f-4e7d-93c5-14f9f91be5f8 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lazy-loading 'flavor' on Instance uuid f8532783-21d1-4910-91ef-223c2379fd43 {{(pid=134052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:57:27.201395 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-19520423-e85f-4e7d-93c5-14f9f91be5f8 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] 10.222.0.70 "PUT /compute/v2.1/servers/f8532783-21d1-4910-91ef-223c2379fd43/tags/tempest-tag-241228050" status: 201 len: 0 microversion: 2.26 time: 0.215787 Aug 27 02:57:27.202991 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1733/3452] 10.222.0.70 () {62 vars in 1377 bytes} [Sat Aug 27 02:57:26 2022] PUT /compute/v2.1/servers/f8532783-21d1-4910-91ef-223c2379fd43/tags/tempest-tag-241228050 => generated 0 bytes in 219 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Aug 27 02:57:27.215424 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6d58e238-8779-4a90-8c43-40c911bf6f05 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Calling method '.version_select at 0x7f5ee314f790>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:27.226713 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6d58e238-8779-4a90-8c43-40c911bf6f05 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:27.227556 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6d58e238-8779-4a90-8c43-40c911bf6f05 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:27.228213 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6d58e238-8779-4a90-8c43-40c911bf6f05 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:27.240677 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-6d58e238-8779-4a90-8c43-40c911bf6f05 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] 10.222.0.70 "GET /compute/v2.1/servers/f8532783-21d1-4910-91ef-223c2379fd43/tags" status: 200 len: 35 microversion: 2.26 time: 0.030635 Aug 27 02:57:27.242190 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1734/3453] 10.222.0.70 () {60 vars in 1292 bytes} [Sat Aug 27 02:57:27 2022] GET /compute/v2.1/servers/f8532783-21d1-4910-91ef-223c2379fd43/tags => generated 35 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:57:27.252915 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-fcac247f-ce7e-400e-9098-4279dad3b7cd tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Calling method '.version_select at 0x7f5ee31a6670>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:27.261660 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fcac247f-ce7e-400e-9098-4279dad3b7cd tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:27.262333 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fcac247f-ce7e-400e-9098-4279dad3b7cd tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:27.263122 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fcac247f-ce7e-400e-9098-4279dad3b7cd tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:27.264035 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-fcac247f-ce7e-400e-9098-4279dad3b7cd tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] [instance: f8532783-21d1-4910-91ef-223c2379fd43] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:27.274333 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fcac247f-ce7e-400e-9098-4279dad3b7cd tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:27.275079 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fcac247f-ce7e-400e-9098-4279dad3b7cd tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:27.275829 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fcac247f-ce7e-400e-9098-4279dad3b7cd tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:27.276703 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fcac247f-ce7e-400e-9098-4279dad3b7cd tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:27.277276 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fcac247f-ce7e-400e-9098-4279dad3b7cd tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:27.277824 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fcac247f-ce7e-400e-9098-4279dad3b7cd tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:27.305365 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fcac247f-ce7e-400e-9098-4279dad3b7cd tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:27.306485 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fcac247f-ce7e-400e-9098-4279dad3b7cd tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:27.307068 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fcac247f-ce7e-400e-9098-4279dad3b7cd tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:27.334980 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.instance [None req-fcac247f-ce7e-400e-9098-4279dad3b7cd tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lazy-loading 'flavor' on Instance uuid f8532783-21d1-4910-91ef-223c2379fd43 {{(pid=134052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:57:27.351464 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-fcac247f-ce7e-400e-9098-4279dad3b7cd tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] 10.222.0.70 "DELETE /compute/v2.1/servers/f8532783-21d1-4910-91ef-223c2379fd43/tags/tempest-tag-241228050" status: 204 len: 0 microversion: 2.26 time: 0.102425 Aug 27 02:57:27.355048 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1735/3454] 10.222.0.70 () {60 vars in 1361 bytes} [Sat Aug 27 02:57:27 2022] DELETE /compute/v2.1/servers/f8532783-21d1-4910-91ef-223c2379fd43/tags/tempest-tag-241228050 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 02:57:27.360501 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f44cab91-f05b-4dd8-ad9f-84d35dfcd8e1 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Calling method '.version_select at 0x7f5ee3828d30>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:27.369013 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f44cab91-f05b-4dd8-ad9f-84d35dfcd8e1 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:27.369647 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f44cab91-f05b-4dd8-ad9f-84d35dfcd8e1 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:27.370146 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f44cab91-f05b-4dd8-ad9f-84d35dfcd8e1 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:27.386271 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f44cab91-f05b-4dd8-ad9f-84d35dfcd8e1 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] 10.222.0.70 "GET /compute/v2.1/servers/f8532783-21d1-4910-91ef-223c2379fd43/tags" status: 200 len: 12 microversion: 2.26 time: 0.029851 Aug 27 02:57:27.396232 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1736/3455] 10.222.0.70 () {60 vars in 1292 bytes} [Sat Aug 27 02:57:27 2022] GET /compute/v2.1/servers/f8532783-21d1-4910-91ef-223c2379fd43/tags => generated 12 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:57:27.409240 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f93ddc55-4cbb-4b0f-9f1b-2f41254cb695 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Calling method '.version_select at 0x7f5ee2471310>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:27.419097 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f93ddc55-4cbb-4b0f-9f1b-2f41254cb695 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:27.419722 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f93ddc55-4cbb-4b0f-9f1b-2f41254cb695 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:27.423805 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f93ddc55-4cbb-4b0f-9f1b-2f41254cb695 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:27.423805 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-f93ddc55-4cbb-4b0f-9f1b-2f41254cb695 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] [instance: f8532783-21d1-4910-91ef-223c2379fd43] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:27.450421 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f93ddc55-4cbb-4b0f-9f1b-2f41254cb695 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:27.452907 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f93ddc55-4cbb-4b0f-9f1b-2f41254cb695 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:27.453358 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f93ddc55-4cbb-4b0f-9f1b-2f41254cb695 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:27.454102 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f93ddc55-4cbb-4b0f-9f1b-2f41254cb695 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:27.454555 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f93ddc55-4cbb-4b0f-9f1b-2f41254cb695 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:27.458723 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f93ddc55-4cbb-4b0f-9f1b-2f41254cb695 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:27.556147 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f93ddc55-4cbb-4b0f-9f1b-2f41254cb695 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:27.571351 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f93ddc55-4cbb-4b0f-9f1b-2f41254cb695 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:27.576429 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f93ddc55-4cbb-4b0f-9f1b-2f41254cb695 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:27.612663 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.instance [None req-f93ddc55-4cbb-4b0f-9f1b-2f41254cb695 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lazy-loading 'flavor' on Instance uuid f8532783-21d1-4910-91ef-223c2379fd43 {{(pid=134052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:57:27.631424 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-36339f08-7965-4e2b-a1e0-590154cb6391 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] 10.222.0.70 "GET /compute/v2.1/servers/543bc953-d047-4594-a5d1-2d3a33fbfa35/os-security-groups" status: 200 len: 1156 microversion: 2.1 time: 1.229146 Aug 27 02:57:27.642801 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1720/3456] 10.222.0.70 () {58 vars in 1293 bytes} [Sat Aug 27 02:57:26 2022] GET /compute/v2.1/servers/543bc953-d047-4594-a5d1-2d3a33fbfa35/os-security-groups => generated 1156 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:57:27.648076 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-5ca04a8f-02c0-4898-96fb-5beb8dc9ba82 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:27.648463 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-5ca04a8f-02c0-4898-96fb-5beb8dc9ba82 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 123a4464-d077-4253-9d13-38f63f70fc43] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:27.664948 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f93ddc55-4cbb-4b0f-9f1b-2f41254cb695 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] 10.222.0.70 "DELETE /compute/v2.1/servers/f8532783-21d1-4910-91ef-223c2379fd43/tags" status: 204 len: 0 microversion: 2.26 time: 0.260472 Aug 27 02:57:27.666888 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1737/3457] 10.222.0.70 () {60 vars in 1295 bytes} [Sat Aug 27 02:57:27 2022] DELETE /compute/v2.1/servers/f8532783-21d1-4910-91ef-223c2379fd43/tags => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 02:57:27.675548 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-26f8c52d-8e1a-4571-9509-70aa8312c24f tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:27.676658 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-26f8c52d-8e1a-4571-9509-70aa8312c24f tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] [instance: edb9e3a3-f71d-4a90-b617-167316a61e44] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:27.685107 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-26f8c52d-8e1a-4571-9509-70aa8312c24f tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:27.685750 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-26f8c52d-8e1a-4571-9509-70aa8312c24f tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:27.688055 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-26f8c52d-8e1a-4571-9509-70aa8312c24f tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:27.690247 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-26f8c52d-8e1a-4571-9509-70aa8312c24f tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:27.690733 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-26f8c52d-8e1a-4571-9509-70aa8312c24f tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:27.691750 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-26f8c52d-8e1a-4571-9509-70aa8312c24f tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:27.695815 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5ca04a8f-02c0-4898-96fb-5beb8dc9ba82 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:27.696364 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5ca04a8f-02c0-4898-96fb-5beb8dc9ba82 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:27.696797 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5ca04a8f-02c0-4898-96fb-5beb8dc9ba82 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:27.701286 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5ca04a8f-02c0-4898-96fb-5beb8dc9ba82 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:27.703126 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5ca04a8f-02c0-4898-96fb-5beb8dc9ba82 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:27.703714 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5ca04a8f-02c0-4898-96fb-5beb8dc9ba82 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:28.326226 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-5ca04a8f-02c0-4898-96fb-5beb8dc9ba82 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:28.334646 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-5ca04a8f-02c0-4898-96fb-5beb8dc9ba82 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/123a4464-d077-4253-9d13-38f63f70fc43" status: 200 len: 1314 microversion: 2.1 time: 0.690658 Aug 27 02:57:28.335473 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1721/3458] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:57:27 2022] GET /compute/v2.1/servers/123a4464-d077-4253-9d13-38f63f70fc43 => generated 1314 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:57:28.349867 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ac7a037e-2eb9-4d4c-8742-959cd06e410a tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Action: 'create', calling method: .version_select at 0x7f5ede9364c0>, body: {"security_group": {"name": " tempest-securitygroup -1893603613 ", "description": "tempest-description-1233924757"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:57:28.359142 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-26f8c52d-8e1a-4571-9509-70aa8312c24f tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b217f9cbc204919ba77d885315907c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2448b78114c54dd39bc85538fb973dd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:28.370322 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-26f8c52d-8e1a-4571-9509-70aa8312c24f tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] 10.222.0.70 "GET /compute/v2.1/servers/edb9e3a3-f71d-4a90-b617-167316a61e44" status: 200 len: 1321 microversion: 2.1 time: 0.702065 Aug 27 02:57:28.370963 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1738/3459] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:57:27 2022] GET /compute/v2.1/servers/edb9e3a3-f71d-4a90-b617-167316a61e44 => generated 1321 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:57:28.378258 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-251c7325-61ab-4e46-9b28-b3c70f2e2424 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Calling method '.version_select at 0x7f5ee240d310>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:28.388247 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-251c7325-61ab-4e46-9b28-b3c70f2e2424 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:28.388940 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-251c7325-61ab-4e46-9b28-b3c70f2e2424 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:28.389383 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-251c7325-61ab-4e46-9b28-b3c70f2e2424 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:28.389866 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-251c7325-61ab-4e46-9b28-b3c70f2e2424 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] [instance: f8532783-21d1-4910-91ef-223c2379fd43] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:28.395577 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-251c7325-61ab-4e46-9b28-b3c70f2e2424 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:28.396048 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-251c7325-61ab-4e46-9b28-b3c70f2e2424 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:28.396533 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-251c7325-61ab-4e46-9b28-b3c70f2e2424 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:28.397355 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-251c7325-61ab-4e46-9b28-b3c70f2e2424 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:28.397765 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-251c7325-61ab-4e46-9b28-b3c70f2e2424 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:28.398629 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-251c7325-61ab-4e46-9b28-b3c70f2e2424 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:28.434889 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-251c7325-61ab-4e46-9b28-b3c70f2e2424 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:28.435539 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-251c7325-61ab-4e46-9b28-b3c70f2e2424 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:28.435866 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-251c7325-61ab-4e46-9b28-b3c70f2e2424 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:28.445269 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-251c7325-61ab-4e46-9b28-b3c70f2e2424 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:28.445943 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-251c7325-61ab-4e46-9b28-b3c70f2e2424 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:28.446463 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-251c7325-61ab-4e46-9b28-b3c70f2e2424 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:28.471528 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.instance [None req-251c7325-61ab-4e46-9b28-b3c70f2e2424 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lazy-loading 'flavor' on Instance uuid f8532783-21d1-4910-91ef-223c2379fd43 {{(pid=134052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:57:28.486904 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-251c7325-61ab-4e46-9b28-b3c70f2e2424 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] 10.222.0.70 "PUT /compute/v2.1/servers/f8532783-21d1-4910-91ef-223c2379fd43/tags/tempest-tag-1562191602" status: 201 len: 0 microversion: 2.26 time: 0.114240 Aug 27 02:57:28.487908 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1739/3460] 10.222.0.70 () {62 vars in 1380 bytes} [Sat Aug 27 02:57:28 2022] PUT /compute/v2.1/servers/f8532783-21d1-4910-91ef-223c2379fd43/tags/tempest-tag-1562191602 => generated 0 bytes in 116 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Aug 27 02:57:28.492601 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-cb98e6c4-f529-4834-bf2f-976d9474c8f9 req-6a29b9cc-7ef6-4bf2-b06a-4a6c6b2be1a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "543bc953-d047-4594-a5d1-2d3a33fbfa35", "tag": "d252ad9d-633f-41f3-917d-80b5159c1f85"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:57:28.502919 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-cb98e6c4-f529-4834-bf2f-976d9474c8f9 req-6a29b9cc-7ef6-4bf2-b06a-4a6c6b2be1a4 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:28.503654 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-cb98e6c4-f529-4834-bf2f-976d9474c8f9 req-6a29b9cc-7ef6-4bf2-b06a-4a6c6b2be1a4 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:28.504331 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-cb98e6c4-f529-4834-bf2f-976d9474c8f9 req-6a29b9cc-7ef6-4bf2-b06a-4a6c6b2be1a4 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:28.519743 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-cb98e6c4-f529-4834-bf2f-976d9474c8f9 req-6a29b9cc-7ef6-4bf2-b06a-4a6c6b2be1a4 service nova] Creating event network-changed:d252ad9d-633f-41f3-917d-80b5159c1f85 for instance 543bc953-d047-4594-a5d1-2d3a33fbfa35 on n-h2-852278-4 Aug 27 02:57:28.526417 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-cb98e6c4-f529-4834-bf2f-976d9474c8f9 req-6a29b9cc-7ef6-4bf2-b06a-4a6c6b2be1a4 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036881 Aug 27 02:57:28.527305 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1740/3461] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:57:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:57:28.533937 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3e76595a-4b13-45c1-9ee4-867014e8a7c1 tempest-VolumesSnapshotsTestJSON-1454701903 tempest-VolumesSnapshotsTestJSON-1454701903-project] Calling method '.version_select at 0x7f5ee309f700>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:28.590156 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-3e76595a-4b13-45c1-9ee4-867014e8a7c1 tempest-VolumesSnapshotsTestJSON-1454701903 tempest-VolumesSnapshotsTestJSON-1454701903-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/54f98102-d393-48e7-b01b-77ae8261cb6b" status: 200 len: 288 microversion: 2.1 time: 0.061378 Aug 27 02:57:28.590926 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1741/3462] 10.222.0.70 () {58 vars in 1251 bytes} [Sat Aug 27 02:57:28 2022] GET /compute/v2.1/os-snapshots/54f98102-d393-48e7-b01b-77ae8261cb6b => generated 288 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:57:28.596777 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4338a8b7-91e8-4922-989c-bbce50d69ec4 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Calling method '.version_select at 0x7f5ee3482160>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:28.608389 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4338a8b7-91e8-4922-989c-bbce50d69ec4 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:28.608870 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4338a8b7-91e8-4922-989c-bbce50d69ec4 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:28.609485 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4338a8b7-91e8-4922-989c-bbce50d69ec4 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:28.610055 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-4338a8b7-91e8-4922-989c-bbce50d69ec4 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] [instance: f8532783-21d1-4910-91ef-223c2379fd43] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:28.616293 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4338a8b7-91e8-4922-989c-bbce50d69ec4 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:28.616800 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4338a8b7-91e8-4922-989c-bbce50d69ec4 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:28.618081 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4338a8b7-91e8-4922-989c-bbce50d69ec4 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:28.618793 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4338a8b7-91e8-4922-989c-bbce50d69ec4 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:28.619252 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4338a8b7-91e8-4922-989c-bbce50d69ec4 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:28.619821 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4338a8b7-91e8-4922-989c-bbce50d69ec4 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:28.638130 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=91,nova_cell1:DELETE=3,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:57:28.650323 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4338a8b7-91e8-4922-989c-bbce50d69ec4 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:28.650807 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4338a8b7-91e8-4922-989c-bbce50d69ec4 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:28.651417 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4338a8b7-91e8-4922-989c-bbce50d69ec4 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:28.669554 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4338a8b7-91e8-4922-989c-bbce50d69ec4 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:28.670110 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4338a8b7-91e8-4922-989c-bbce50d69ec4 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:28.670873 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4338a8b7-91e8-4922-989c-bbce50d69ec4 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:28.703672 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.instance [None req-4338a8b7-91e8-4922-989c-bbce50d69ec4 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lazy-loading 'flavor' on Instance uuid f8532783-21d1-4910-91ef-223c2379fd43 {{(pid=134052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:57:28.722877 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-4338a8b7-91e8-4922-989c-bbce50d69ec4 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] 10.222.0.70 "PUT /compute/v2.1/servers/f8532783-21d1-4910-91ef-223c2379fd43/tags/tempest-tag-521942064" status: 201 len: 0 microversion: 2.26 time: 0.130740 Aug 27 02:57:28.723791 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1742/3463] 10.222.0.70 () {62 vars in 1377 bytes} [Sat Aug 27 02:57:28 2022] PUT /compute/v2.1/servers/f8532783-21d1-4910-91ef-223c2379fd43/tags/tempest-tag-521942064 => generated 0 bytes in 132 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Aug 27 02:57:28.729306 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-39ebfcb9-1e8c-43ec-9979-683b58642a37 tempest-VolumesSnapshotsTestJSON-1454701903 tempest-VolumesSnapshotsTestJSON-1454701903-project] Calling method '.version_select at 0x7f5ee31a6a60>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:28.800650 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-39ebfcb9-1e8c-43ec-9979-683b58642a37 tempest-VolumesSnapshotsTestJSON-1454701903 tempest-VolumesSnapshotsTestJSON-1454701903-project] 10.222.0.70 "DELETE /compute/v2.1/os-snapshots/54f98102-d393-48e7-b01b-77ae8261cb6b" status: 202 len: 0 microversion: 2.1 time: 0.075268 Aug 27 02:57:28.801454 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1743/3464] 10.222.0.70 () {58 vars in 1254 bytes} [Sat Aug 27 02:57:28 2022] DELETE /compute/v2.1/os-snapshots/54f98102-d393-48e7-b01b-77ae8261cb6b => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:57:28.811328 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4dd0a56c-7085-4cb1-99ae-ef4f8793443d tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Calling method '.version_select at 0x7f5ee3811670>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:28.832764 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4dd0a56c-7085-4cb1-99ae-ef4f8793443d tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:28.833253 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4dd0a56c-7085-4cb1-99ae-ef4f8793443d tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:28.833685 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4dd0a56c-7085-4cb1-99ae-ef4f8793443d tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:28.834570 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-4dd0a56c-7085-4cb1-99ae-ef4f8793443d tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] [instance: f8532783-21d1-4910-91ef-223c2379fd43] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:28.840477 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4dd0a56c-7085-4cb1-99ae-ef4f8793443d tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:28.840957 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4dd0a56c-7085-4cb1-99ae-ef4f8793443d tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:28.841389 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4dd0a56c-7085-4cb1-99ae-ef4f8793443d tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:28.842372 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4dd0a56c-7085-4cb1-99ae-ef4f8793443d tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:28.842868 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4dd0a56c-7085-4cb1-99ae-ef4f8793443d tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:28.846135 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4dd0a56c-7085-4cb1-99ae-ef4f8793443d tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:28.876861 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4dd0a56c-7085-4cb1-99ae-ef4f8793443d tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:28.877042 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4dd0a56c-7085-4cb1-99ae-ef4f8793443d tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:28.877478 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4dd0a56c-7085-4cb1-99ae-ef4f8793443d tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:28.906163 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.instance [None req-4dd0a56c-7085-4cb1-99ae-ef4f8793443d tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lazy-loading 'flavor' on Instance uuid f8532783-21d1-4910-91ef-223c2379fd43 {{(pid=134052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:57:28.926732 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-4dd0a56c-7085-4cb1-99ae-ef4f8793443d tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] 10.222.0.70 "DELETE /compute/v2.1/servers/f8532783-21d1-4910-91ef-223c2379fd43/tags" status: 204 len: 0 microversion: 2.26 time: 0.119350 Aug 27 02:57:28.928562 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1744/3465] 10.222.0.70 () {60 vars in 1295 bytes} [Sat Aug 27 02:57:28 2022] DELETE /compute/v2.1/servers/f8532783-21d1-4910-91ef-223c2379fd43/tags => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 02:57:28.938452 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0354e9e6-582b-4f27-ac22-6d3bb2090953 tempest-VolumesSnapshotsTestJSON-1454701903 tempest-VolumesSnapshotsTestJSON-1454701903-project] Calling method '.version_select at 0x7f5ee3159940>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:29.017804 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-0354e9e6-582b-4f27-ac22-6d3bb2090953 tempest-VolumesSnapshotsTestJSON-1454701903 tempest-VolumesSnapshotsTestJSON-1454701903-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/54f98102-d393-48e7-b01b-77ae8261cb6b" status: 200 len: 287 microversion: 2.1 time: 0.088012 Aug 27 02:57:29.029631 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ac7a037e-2eb9-4d4c-8742-959cd06e410a tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] 10.222.0.70 "POST /compute/v2.1/os-security-groups" status: 200 len: 224 microversion: 2.1 time: 0.678030 Aug 27 02:57:29.030186 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1745/3467] 10.222.0.70 () {58 vars in 1251 bytes} [Sat Aug 27 02:57:28 2022] GET /compute/v2.1/os-snapshots/54f98102-d393-48e7-b01b-77ae8261cb6b => generated 287 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:57:29.030276 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1722/3467] 10.222.0.70 () {60 vars in 1180 bytes} [Sat Aug 27 02:57:28 2022] POST /compute/v2.1/os-security-groups => generated 224 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:57:29.030353 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-28a04c1e-7883-449e-810e-9014d41fe6d9 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Calling method '.version_select at 0x7f5ee30ee040>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:29.036503 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-98cf8f20-3eb3-4b6f-b83f-a437807bd287 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Calling method '.version_select at 0x7f5ede8e6af0>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:29.066367 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-28a04c1e-7883-449e-810e-9014d41fe6d9 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:29.066874 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-28a04c1e-7883-449e-810e-9014d41fe6d9 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:29.067310 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-28a04c1e-7883-449e-810e-9014d41fe6d9 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:29.086225 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-28a04c1e-7883-449e-810e-9014d41fe6d9 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] 10.222.0.70 "GET /compute/v2.1/servers/f8532783-21d1-4910-91ef-223c2379fd43/tags" status: 200 len: 12 microversion: 2.26 time: 0.064469 Aug 27 02:57:29.088679 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1746/3468] 10.222.0.70 () {60 vars in 1292 bytes} [Sat Aug 27 02:57:29 2022] GET /compute/v2.1/servers/f8532783-21d1-4910-91ef-223c2379fd43/tags => generated 12 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:57:29.104143 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6d043c7d-bc96-4dd2-b30f-9c7f9188c91c tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Calling method '.version_select at 0x7f5ee3811af0>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:29.123516 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6d043c7d-bc96-4dd2-b30f-9c7f9188c91c tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:29.123981 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6d043c7d-bc96-4dd2-b30f-9c7f9188c91c tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:29.124603 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6d043c7d-bc96-4dd2-b30f-9c7f9188c91c tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:29.125349 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-6d043c7d-bc96-4dd2-b30f-9c7f9188c91c tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] [instance: f8532783-21d1-4910-91ef-223c2379fd43] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:29.133873 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6d043c7d-bc96-4dd2-b30f-9c7f9188c91c tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:29.134499 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6d043c7d-bc96-4dd2-b30f-9c7f9188c91c tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:29.134997 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6d043c7d-bc96-4dd2-b30f-9c7f9188c91c tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:29.136340 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6d043c7d-bc96-4dd2-b30f-9c7f9188c91c tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:29.136340 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6d043c7d-bc96-4dd2-b30f-9c7f9188c91c tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:29.136600 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6d043c7d-bc96-4dd2-b30f-9c7f9188c91c tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:29.200090 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6d043c7d-bc96-4dd2-b30f-9c7f9188c91c tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:29.200986 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6d043c7d-bc96-4dd2-b30f-9c7f9188c91c tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:29.201424 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6d043c7d-bc96-4dd2-b30f-9c7f9188c91c tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:29.225954 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.instance [None req-6d043c7d-bc96-4dd2-b30f-9c7f9188c91c tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lazy-loading 'flavor' on Instance uuid f8532783-21d1-4910-91ef-223c2379fd43 {{(pid=134052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:57:29.257899 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-6d043c7d-bc96-4dd2-b30f-9c7f9188c91c tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] 10.222.0.70 "DELETE /compute/v2.1/servers/f8532783-21d1-4910-91ef-223c2379fd43/tags" status: 204 len: 0 microversion: 2.26 time: 0.165210 Aug 27 02:57:29.265002 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1747/3469] 10.222.0.70 () {60 vars in 1295 bytes} [Sat Aug 27 02:57:29 2022] DELETE /compute/v2.1/servers/f8532783-21d1-4910-91ef-223c2379fd43/tags => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 27 02:57:29.275506 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4cea3f72-9c4a-4448-a53e-b54a95bb94e2 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Calling method '.version_select at 0x7f5ee3371f70>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:29.294121 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4cea3f72-9c4a-4448-a53e-b54a95bb94e2 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:29.294121 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4cea3f72-9c4a-4448-a53e-b54a95bb94e2 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:29.294670 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4cea3f72-9c4a-4448-a53e-b54a95bb94e2 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:29.295106 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-4cea3f72-9c4a-4448-a53e-b54a95bb94e2 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] [instance: f8532783-21d1-4910-91ef-223c2379fd43] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:29.319419 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4cea3f72-9c4a-4448-a53e-b54a95bb94e2 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:29.319942 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4cea3f72-9c4a-4448-a53e-b54a95bb94e2 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:29.320396 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4cea3f72-9c4a-4448-a53e-b54a95bb94e2 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:29.321153 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4cea3f72-9c4a-4448-a53e-b54a95bb94e2 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:29.321637 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4cea3f72-9c4a-4448-a53e-b54a95bb94e2 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:29.322072 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4cea3f72-9c4a-4448-a53e-b54a95bb94e2 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:29.390481 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4cea3f72-9c4a-4448-a53e-b54a95bb94e2 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:29.391820 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4cea3f72-9c4a-4448-a53e-b54a95bb94e2 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:29.391820 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4cea3f72-9c4a-4448-a53e-b54a95bb94e2 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:29.403419 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-98cf8f20-3eb3-4b6f-b83f-a437807bd287 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] 10.222.0.70 "GET /compute/v2.1/os-security-groups/7e00f5ae-c548-4406-97df-73cdf5c87dae" status: 200 len: 224 microversion: 2.1 time: 0.371284 Aug 27 02:57:29.404083 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1723/3470] 10.222.0.70 () {58 vars in 1269 bytes} [Sat Aug 27 02:57:29 2022] GET /compute/v2.1/os-security-groups/7e00f5ae-c548-4406-97df-73cdf5c87dae => generated 224 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:57:29.408981 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-161b5f0f-fe7a-4995-a716-d9d07acf220b tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:29.409676 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-161b5f0f-fe7a-4995-a716-d9d07acf220b tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 123a4464-d077-4253-9d13-38f63f70fc43] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:29.425768 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4cea3f72-9c4a-4448-a53e-b54a95bb94e2 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:29.426174 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4cea3f72-9c4a-4448-a53e-b54a95bb94e2 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:29.426739 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4cea3f72-9c4a-4448-a53e-b54a95bb94e2 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:29.433324 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-161b5f0f-fe7a-4995-a716-d9d07acf220b tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:29.433824 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-161b5f0f-fe7a-4995-a716-d9d07acf220b tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:29.443714 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:57:29.457293 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-161b5f0f-fe7a-4995-a716-d9d07acf220b tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:29.458295 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-161b5f0f-fe7a-4995-a716-d9d07acf220b tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:29.458788 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-161b5f0f-fe7a-4995-a716-d9d07acf220b tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:29.459238 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-161b5f0f-fe7a-4995-a716-d9d07acf220b tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:29.467922 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.instance [None req-4cea3f72-9c4a-4448-a53e-b54a95bb94e2 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lazy-loading 'flavor' on Instance uuid f8532783-21d1-4910-91ef-223c2379fd43 {{(pid=134052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:57:29.504866 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=16 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:57:29.507185 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-4cea3f72-9c4a-4448-a53e-b54a95bb94e2 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] 10.222.0.70 "PUT /compute/v2.1/servers/f8532783-21d1-4910-91ef-223c2379fd43/tags/tempest-tag-1893334864" status: 201 len: 0 microversion: 2.26 time: 0.236709 Aug 27 02:57:29.512005 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1748/3471] 10.222.0.70 () {62 vars in 1380 bytes} [Sat Aug 27 02:57:29 2022] PUT /compute/v2.1/servers/f8532783-21d1-4910-91ef-223c2379fd43/tags/tempest-tag-1893334864 => generated 0 bytes in 242 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Aug 27 02:57:29.524978 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-082440b1-3d2d-4e62-aef6-9ac4a569518b tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:29.525998 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-082440b1-3d2d-4e62-aef6-9ac4a569518b tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] [instance: edb9e3a3-f71d-4a90-b617-167316a61e44] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:29.533448 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-082440b1-3d2d-4e62-aef6-9ac4a569518b tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:29.533880 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-082440b1-3d2d-4e62-aef6-9ac4a569518b tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:29.534318 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-082440b1-3d2d-4e62-aef6-9ac4a569518b tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:29.543029 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-082440b1-3d2d-4e62-aef6-9ac4a569518b tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:29.543521 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-082440b1-3d2d-4e62-aef6-9ac4a569518b tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:29.543962 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-082440b1-3d2d-4e62-aef6-9ac4a569518b tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:30.016259 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-161b5f0f-fe7a-4995-a716-d9d07acf220b tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:30.028091 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-161b5f0f-fe7a-4995-a716-d9d07acf220b tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/123a4464-d077-4253-9d13-38f63f70fc43" status: 200 len: 1502 microversion: 2.1 time: 0.622900 Aug 27 02:57:30.028737 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1724/3472] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:57:29 2022] GET /compute/v2.1/servers/123a4464-d077-4253-9d13-38f63f70fc43 => generated 1502 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:57:30.053302 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-29a81a53-501d-4ceb-b4b0-4fb19cdd1794 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Calling method '.version_select at 0x7f5ede936c10>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:30.159669 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-082440b1-3d2d-4e62-aef6-9ac4a569518b tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b217f9cbc204919ba77d885315907c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2448b78114c54dd39bc85538fb973dd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:30.176366 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-082440b1-3d2d-4e62-aef6-9ac4a569518b tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] 10.222.0.70 "GET /compute/v2.1/servers/edb9e3a3-f71d-4a90-b617-167316a61e44" status: 200 len: 1321 microversion: 2.1 time: 0.661350 Aug 27 02:57:30.188335 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1749/3473] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:57:29 2022] GET /compute/v2.1/servers/edb9e3a3-f71d-4a90-b617-167316a61e44 => generated 1321 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:57:30.188335 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a33af7fa-0b80-4a64-8ed0-1085c7ad088f tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Calling method '.version_select at 0x7f5ee309f670>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:30.199002 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a33af7fa-0b80-4a64-8ed0-1085c7ad088f tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:30.200053 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a33af7fa-0b80-4a64-8ed0-1085c7ad088f tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:30.200632 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a33af7fa-0b80-4a64-8ed0-1085c7ad088f tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:30.201250 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a33af7fa-0b80-4a64-8ed0-1085c7ad088f tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] [instance: f8532783-21d1-4910-91ef-223c2379fd43] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:30.219578 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a33af7fa-0b80-4a64-8ed0-1085c7ad088f tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:30.220216 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a33af7fa-0b80-4a64-8ed0-1085c7ad088f tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:30.220743 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a33af7fa-0b80-4a64-8ed0-1085c7ad088f tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:30.221586 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a33af7fa-0b80-4a64-8ed0-1085c7ad088f tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:30.222825 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a33af7fa-0b80-4a64-8ed0-1085c7ad088f tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:30.223335 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a33af7fa-0b80-4a64-8ed0-1085c7ad088f tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:30.286247 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a33af7fa-0b80-4a64-8ed0-1085c7ad088f tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:30.287989 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a33af7fa-0b80-4a64-8ed0-1085c7ad088f tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:30.290778 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a33af7fa-0b80-4a64-8ed0-1085c7ad088f tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:30.315550 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a33af7fa-0b80-4a64-8ed0-1085c7ad088f tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:30.317337 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a33af7fa-0b80-4a64-8ed0-1085c7ad088f tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:30.318342 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a33af7fa-0b80-4a64-8ed0-1085c7ad088f tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:30.368244 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.instance [None req-a33af7fa-0b80-4a64-8ed0-1085c7ad088f tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lazy-loading 'flavor' on Instance uuid f8532783-21d1-4910-91ef-223c2379fd43 {{(pid=134052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:57:30.391413 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a33af7fa-0b80-4a64-8ed0-1085c7ad088f tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] 10.222.0.70 "PUT /compute/v2.1/servers/f8532783-21d1-4910-91ef-223c2379fd43/tags/tempest-tag-959383776" status: 201 len: 0 microversion: 2.26 time: 0.212332 Aug 27 02:57:30.392106 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1750/3474] 10.222.0.70 () {62 vars in 1377 bytes} [Sat Aug 27 02:57:30 2022] PUT /compute/v2.1/servers/f8532783-21d1-4910-91ef-223c2379fd43/tags/tempest-tag-959383776 => generated 0 bytes in 214 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Aug 27 02:57:30.402094 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e2018282-6040-411a-9561-c5e632406bd1 tempest-VolumesSnapshotsTestJSON-1454701903 tempest-VolumesSnapshotsTestJSON-1454701903-project] Calling method '.version_select at 0x7f5ee2ce89d0>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:30.440302 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=20 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:57:30.442240 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e2018282-6040-411a-9561-c5e632406bd1 tempest-VolumesSnapshotsTestJSON-1454701903 tempest-VolumesSnapshotsTestJSON-1454701903-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/54f98102-d393-48e7-b01b-77ae8261cb6b" status: 200 len: 287 microversion: 2.1 time: 0.044317 Aug 27 02:57:30.443830 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1751/3475] 10.222.0.70 () {58 vars in 1251 bytes} [Sat Aug 27 02:57:30 2022] GET /compute/v2.1/os-snapshots/54f98102-d393-48e7-b01b-77ae8261cb6b => generated 287 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:57:30.448950 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-056ca7c8-b05f-4631-ad31-d5a6a82d1eac tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:57:30.450327 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-056ca7c8-b05f-4631-ad31-d5a6a82d1eac tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 123a4464-d077-4253-9d13-38f63f70fc43] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:30.458750 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-056ca7c8-b05f-4631-ad31-d5a6a82d1eac tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:30.459356 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-056ca7c8-b05f-4631-ad31-d5a6a82d1eac tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:30.459926 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-056ca7c8-b05f-4631-ad31-d5a6a82d1eac tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:30.461669 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-056ca7c8-b05f-4631-ad31-d5a6a82d1eac tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:30.462589 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-056ca7c8-b05f-4631-ad31-d5a6a82d1eac tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:30.464134 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-056ca7c8-b05f-4631-ad31-d5a6a82d1eac tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:30.502824 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-29a81a53-501d-4ceb-b4b0-4fb19cdd1794 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/7e00f5ae-c548-4406-97df-73cdf5c87dae" status: 202 len: 0 microversion: 2.1 time: 0.453610 Aug 27 02:57:30.504655 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1725/3476] 10.222.0.70 () {58 vars in 1272 bytes} [Sat Aug 27 02:57:30 2022] DELETE /compute/v2.1/os-security-groups/7e00f5ae-c548-4406-97df-73cdf5c87dae => generated 0 bytes in 475 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:57:30.515061 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-645a7955-95bc-45ef-a54d-df8ec980a6e0 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Action: 'update_all', calling method: .version_select at 0x7f5ede9948b0>, body: {"tags": ["tempest-tag-246674532", "tempest-tag-376734552"]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:57:30.531570 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-645a7955-95bc-45ef-a54d-df8ec980a6e0 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:30.532334 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-645a7955-95bc-45ef-a54d-df8ec980a6e0 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:30.533065 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-645a7955-95bc-45ef-a54d-df8ec980a6e0 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:30.533683 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-645a7955-95bc-45ef-a54d-df8ec980a6e0 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] [instance: f8532783-21d1-4910-91ef-223c2379fd43] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:30.566046 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-645a7955-95bc-45ef-a54d-df8ec980a6e0 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:30.567103 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-645a7955-95bc-45ef-a54d-df8ec980a6e0 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:30.568042 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-645a7955-95bc-45ef-a54d-df8ec980a6e0 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:30.569136 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-645a7955-95bc-45ef-a54d-df8ec980a6e0 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:30.569811 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-645a7955-95bc-45ef-a54d-df8ec980a6e0 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:30.570442 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-645a7955-95bc-45ef-a54d-df8ec980a6e0 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:30.609304 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-645a7955-95bc-45ef-a54d-df8ec980a6e0 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:30.610127 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-645a7955-95bc-45ef-a54d-df8ec980a6e0 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:30.610860 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-645a7955-95bc-45ef-a54d-df8ec980a6e0 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:30.646080 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.objects.instance [None req-645a7955-95bc-45ef-a54d-df8ec980a6e0 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lazy-loading 'flavor' on Instance uuid f8532783-21d1-4910-91ef-223c2379fd43 {{(pid=134051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:57:30.671939 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.network.security_group_api [None req-056ca7c8-b05f-4631-ad31-d5a6a82d1eac tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Removing security group 7307da70-775b-4454-8cd5-b19db3834327 from port 611d60d4-10eb-4ef5-a705-cd3852a652a8 Aug 27 02:57:30.677104 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-645a7955-95bc-45ef-a54d-df8ec980a6e0 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] 10.222.0.70 "PUT /compute/v2.1/servers/f8532783-21d1-4910-91ef-223c2379fd43/tags" status: 200 len: 60 microversion: 2.26 time: 0.171177 Aug 27 02:57:30.678065 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1726/3477] 10.222.0.70 () {62 vars in 1312 bytes} [Sat Aug 27 02:57:30 2022] PUT /compute/v2.1/servers/f8532783-21d1-4910-91ef-223c2379fd43/tags => generated 60 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:57:30.693953 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-17ba71e2-d29c-41db-974f-aaa35eb77881 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Calling method '.version_select at 0x7f5ede97d820>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:30.744257 n-d-852278-4 devstack@n-api.service[134051]: DEBUG neutronclient.v2_0.client [None req-17ba71e2-d29c-41db-974f-aaa35eb77881 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 7e00f5ae-c548-4406-97df-73cdf5c87dae does not exist", "detail": ""}} {{(pid=134051) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 02:57:30.748902 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.network.security_group_api [None req-17ba71e2-d29c-41db-974f-aaa35eb77881 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Neutron security group 7e00f5ae-c548-4406-97df-73cdf5c87dae not found {{(pid=134051) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 27 02:57:30.749985 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-17ba71e2-d29c-41db-974f-aaa35eb77881 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] HTTP exception thrown: Security group 7e00f5ae-c548-4406-97df-73cdf5c87dae does not exist Aug 27 02:57:30.749985 n-d-852278-4 devstack@n-api.service[134051]: Neutron server returns request_ids: ['req-2844bd67-c3f3-4e78-9c5d-b62af2d3588a'] Aug 27 02:57:30.754444 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-17ba71e2-d29c-41db-974f-aaa35eb77881 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Request method failure captured: Aug 27 02:57:30.754444 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/os-security-groups/7e00f5ae-c548-4406-97df-73cdf5c87dae HTTP/1.1 Aug 27 02:57:30.754444 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:57:30.754444 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:57:30.754444 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:57:30.754444 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:57:30.754444 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:57:30.754444 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:57:30.754444 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:57:30.754444 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:57:30.754444 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYf2b88jccGp908k3vQwdmk8aWVpZgx4XAwdI__tT5JQ00leavue9yGRA0Ra6tx0k8LuwOwvFz5QHaUm9YwpVl7ey0u_0fYkHaP7j9Kliw_5Q5Xf4F9k_115SseZDZeFd_ncRBfnV98omKQ5oUaf4zu042RXCwV00aKzeJyDrzb4sII Aug 27 02:57:30.754444 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:57:30.754444 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:57:30.754444 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:57:30.754444 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:57:30.754444 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:57:30.754444 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:57:30.754444 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 2a6a888c878245cb9e5909e071c9b9c2 Aug 27 02:57:30.754444 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-SecurityGroupsTestJSON-23859158 Aug 27 02:57:30.754444 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:57:30.754444 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:57:30.754444 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2a6a888c878245cb9e5909e071c9b9c2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_2a6a888c878245cb9e5909e071c9b9c2", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2a6a888c878245cb9e5909e071c9b9c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/2a6a888c878245cb9e5909e071c9b9c2"}]}] Aug 27 02:57:30.754444 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-SecurityGroupsTestJSON-23859158 Aug 27 02:57:30.754444 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 2a6a888c878245cb9e5909e071c9b9c2 Aug 27 02:57:30.754444 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-23859158 Aug 27 02:57:30.754444 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-SecurityGroupsTestJSON-23859158-project Aug 27 02:57:30.754444 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:57:30.754444 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:57:30.754444 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: ef6381ae230a45de8b105374c2d25383 Aug 27 02:57:30.754444 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-SecurityGroupsTestJSON-23859158-project Aug 27 02:57:30.754444 n-d-852278-4 devstack@n-api.service[134051]: method: Aug 27 02:57:30.754444 n-d-852278-4 devstack@n-api.service[134051]: exception: Security group 7e00f5ae-c548-4406-97df-73cdf5c87dae does not exist Aug 27 02:57:30.754444 n-d-852278-4 devstack@n-api.service[134051]: Neutron server returns request_ids: ['req-2844bd67-c3f3-4e78-9c5d-b62af2d3588a'] Aug 27 02:57:30.754444 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '7e00f5ae-c548-4406-97df-73cdf5c87dae'} Aug 27 02:57:30.754444 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:57:30.754444 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:57:30.754444 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 27 02:57:30.754444 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 27 02:57:30.754444 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:57:30.754444 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:57:30.754444 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 27 02:57:30.754444 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 27 02:57:30.754444 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:57:30.754444 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:57:30.754444 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 02:57:30.754444 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 02:57:30.754444 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:57:30.754444 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:57:30.754444 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 02:57:30.754444 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 02:57:30.754444 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:57:30.754444 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:57:30.754444 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 02:57:30.754444 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 02:57:30.754444 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:57:30.754444 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:57:30.754444 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 02:57:30.754444 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 02:57:30.754444 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 02:57:30.754444 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 02:57:30.754444 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 7e00f5ae-c548-4406-97df-73cdf5c87dae does not exist Aug 27 02:57:30.757939 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2844bd67-c3f3-4e78-9c5d-b62af2d3588a'] Aug 27 02:57:30.757939 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:57:30.757939 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:57:30.757939 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:57:30.757939 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:57:30.757939 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 27 02:57:30.757939 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 27 02:57:30.757939 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 27 02:57:30.757939 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 27 02:57:30.757939 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 7e00f5ae-c548-4406-97df-73cdf5c87dae does not exist Aug 27 02:57:30.757939 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2844bd67-c3f3-4e78-9c5d-b62af2d3588a'] Aug 27 02:57:30.757939 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:57:30.757939 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:57:30.757939 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:57:30.757939 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:57:30.757939 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:57:30.757939 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:57:30.757939 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:57:30.757939 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:57:30.757939 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:57:30.757939 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:57:30.757939 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:57:30.757939 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:57:30.757939 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 27 02:57:30.757939 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 27 02:57:30.757939 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 7e00f5ae-c548-4406-97df-73cdf5c87dae does not exist Aug 27 02:57:30.757939 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2844bd67-c3f3-4e78-9c5d-b62af2d3588a'] Aug 27 02:57:30.757939 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:57:30.757939 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:57:30.757939 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:57:30.757939 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:57:30.757939 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:57:30.757939 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:57:30.757939 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:57:30.757939 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:57:30.757939 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 7e00f5ae-c548-4406-97df-73cdf5c87dae does not exist Aug 27 02:57:30.757939 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2844bd67-c3f3-4e78-9c5d-b62af2d3588a'] Aug 27 02:57:30.757939 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:57:30.763376 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-17ba71e2-d29c-41db-974f-aaa35eb77881 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Returning 404 to user: Security group 7e00f5ae-c548-4406-97df-73cdf5c87dae does not exist Aug 27 02:57:30.763376 n-d-852278-4 devstack@n-api.service[134051]: Neutron server returns request_ids: ['req-2844bd67-c3f3-4e78-9c5d-b62af2d3588a'] {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:57:30.765881 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-17ba71e2-d29c-41db-974f-aaa35eb77881 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] 10.222.0.70 "GET /compute/v2.1/os-security-groups/7e00f5ae-c548-4406-97df-73cdf5c87dae" status: 404 len: 194 microversion: 2.1 time: 0.086006 Aug 27 02:57:30.777188 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1727/3478] 10.222.0.70 () {58 vars in 1269 bytes} [Sat Aug 27 02:57:30 2022] GET /compute/v2.1/os-security-groups/7e00f5ae-c548-4406-97df-73cdf5c87dae => generated 194 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:57:30.790545 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-9176d5be-b6aa-427e-b5ca-5d3ecc7d5323 req-2348cf03-4b50-431e-91ca-f2f9129495d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "edb9e3a3-f71d-4a90-b617-167316a61e44", "tag": "ea2d074a-0c88-4878-943e-a739cc0ecf65"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:57:30.802366 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-9176d5be-b6aa-427e-b5ca-5d3ecc7d5323 req-2348cf03-4b50-431e-91ca-f2f9129495d2 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:30.803337 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-9176d5be-b6aa-427e-b5ca-5d3ecc7d5323 req-2348cf03-4b50-431e-91ca-f2f9129495d2 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:30.803932 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-9176d5be-b6aa-427e-b5ca-5d3ecc7d5323 req-2348cf03-4b50-431e-91ca-f2f9129495d2 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:30.819129 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-9176d5be-b6aa-427e-b5ca-5d3ecc7d5323 req-2348cf03-4b50-431e-91ca-f2f9129495d2 service nova] Creating event network-changed:ea2d074a-0c88-4878-943e-a739cc0ecf65 for instance edb9e3a3-f71d-4a90-b617-167316a61e44 on n-h2-852278-4 Aug 27 02:57:30.825461 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-9176d5be-b6aa-427e-b5ca-5d3ecc7d5323 req-2348cf03-4b50-431e-91ca-f2f9129495d2 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043696 Aug 27 02:57:30.826396 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1728/3479] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:57:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:57:30.833632 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-090aa35f-a5bb-44e6-b99c-f628b11ed023 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Calling method '.version_select at 0x7f5edf384310>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:30.843590 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-090aa35f-a5bb-44e6-b99c-f628b11ed023 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:30.844531 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-090aa35f-a5bb-44e6-b99c-f628b11ed023 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:30.845424 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-090aa35f-a5bb-44e6-b99c-f628b11ed023 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:30.853763 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=98,nova_cell1:DELETE=1,nova_cell1:INSERT=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:57:30.857854 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-090aa35f-a5bb-44e6-b99c-f628b11ed023 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] 10.222.0.70 "GET /compute/v2.1/servers/f8532783-21d1-4910-91ef-223c2379fd43/tags" status: 200 len: 60 microversion: 2.26 time: 0.029951 Aug 27 02:57:30.858896 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1729/3480] 10.222.0.70 () {60 vars in 1292 bytes} [Sat Aug 27 02:57:30 2022] GET /compute/v2.1/servers/f8532783-21d1-4910-91ef-223c2379fd43/tags => generated 60 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:57:30.864135 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-adfdf86f-27ee-4c80-9dda-4aa15c16b662 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Action: 'create', calling method: .version_select at 0x7f5ede97d8b0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1025104723", "description": "tempest-description-450317048"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:57:31.659999 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-adfdf86f-27ee-4c80-9dda-4aa15c16b662 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] 10.222.0.70 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.799741 Aug 27 02:57:31.661617 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1730/3481] 10.222.0.70 () {60 vars in 1180 bytes} [Sat Aug 27 02:57:30 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:57:31.667959 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c695a623-c985-427c-a8cd-e95b9f692b58 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Calling method '.version_select at 0x7f5ee7202040>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:31.678940 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c695a623-c985-427c-a8cd-e95b9f692b58 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:31.679395 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-056ca7c8-b05f-4631-ad31-d5a6a82d1eac tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "POST /compute/v2.1/servers/123a4464-d077-4253-9d13-38f63f70fc43/action" status: 202 len: 0 microversion: 2.1 time: 1.234241 Aug 27 02:57:31.679838 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c695a623-c985-427c-a8cd-e95b9f692b58 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:31.679943 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c695a623-c985-427c-a8cd-e95b9f692b58 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:31.680486 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1752/3482] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 02:57:30 2022] POST /compute/v2.1/servers/123a4464-d077-4253-9d13-38f63f70fc43/action => generated 0 bytes in 1236 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:57:31.684160 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-c695a623-c985-427c-a8cd-e95b9f692b58 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] [instance: f8532783-21d1-4910-91ef-223c2379fd43] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:31.686703 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ee011d56-2164-426f-9ea8-e683158314ec tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:31.687351 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-ee011d56-2164-426f-9ea8-e683158314ec tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] [instance: edb9e3a3-f71d-4a90-b617-167316a61e44] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:31.692154 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c695a623-c985-427c-a8cd-e95b9f692b58 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:31.692884 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c695a623-c985-427c-a8cd-e95b9f692b58 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:31.694113 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c695a623-c985-427c-a8cd-e95b9f692b58 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:31.694778 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ee011d56-2164-426f-9ea8-e683158314ec tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:31.695260 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ee011d56-2164-426f-9ea8-e683158314ec tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:31.695495 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c695a623-c985-427c-a8cd-e95b9f692b58 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:31.695690 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ee011d56-2164-426f-9ea8-e683158314ec tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:31.696390 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c695a623-c985-427c-a8cd-e95b9f692b58 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:31.696507 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ee011d56-2164-426f-9ea8-e683158314ec tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:31.696896 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ee011d56-2164-426f-9ea8-e683158314ec tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:31.697324 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c695a623-c985-427c-a8cd-e95b9f692b58 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:31.697709 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ee011d56-2164-426f-9ea8-e683158314ec tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:31.724513 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c695a623-c985-427c-a8cd-e95b9f692b58 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:31.725102 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c695a623-c985-427c-a8cd-e95b9f692b58 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:31.725732 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c695a623-c985-427c-a8cd-e95b9f692b58 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:31.742235 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.objects.instance [None req-c695a623-c985-427c-a8cd-e95b9f692b58 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lazy-loading 'flavor' on Instance uuid f8532783-21d1-4910-91ef-223c2379fd43 {{(pid=134051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:57:31.757776 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c695a623-c985-427c-a8cd-e95b9f692b58 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] 10.222.0.70 "DELETE /compute/v2.1/servers/f8532783-21d1-4910-91ef-223c2379fd43/tags" status: 204 len: 0 microversion: 2.26 time: 0.094743 Aug 27 02:57:31.758574 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1731/3483] 10.222.0.70 () {60 vars in 1295 bytes} [Sat Aug 27 02:57:31 2022] DELETE /compute/v2.1/servers/f8532783-21d1-4910-91ef-223c2379fd43/tags => generated 0 bytes in 96 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 02:57:31.764252 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-28c23f8c-9d33-40f1-87ac-f418abee1e1a tempest-VolumesSnapshotsTestJSON-1454701903 tempest-VolumesSnapshotsTestJSON-1454701903-project] Calling method '.version_select at 0x7f5ede9949d0>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:31.795756 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-28c23f8c-9d33-40f1-87ac-f418abee1e1a tempest-VolumesSnapshotsTestJSON-1454701903 tempest-VolumesSnapshotsTestJSON-1454701903-project] HTTP exception thrown: Snapshot 54f98102-d393-48e7-b01b-77ae8261cb6b could not be found. Aug 27 02:57:31.801959 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-28c23f8c-9d33-40f1-87ac-f418abee1e1a tempest-VolumesSnapshotsTestJSON-1454701903 tempest-VolumesSnapshotsTestJSON-1454701903-project] Request method failure captured: Aug 27 02:57:31.801959 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/os-snapshots/54f98102-d393-48e7-b01b-77ae8261cb6b HTTP/1.1 Aug 27 02:57:31.801959 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:57:31.801959 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:57:31.801959 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:57:31.801959 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:57:31.801959 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:57:31.801959 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:57:31.801959 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:57:31.801959 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:57:31.801959 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYgR_7W79kzstWeEBb0_3-KtxzIuBeq6YpAK5Ef6ZmBVWXyUrzb00i1-rNRLZ1vqwBIiB6a0y4c85fNJoY9dcdA2l4GEidrf4QtOk5EqF_8drcvJy0BLZ3K4mq7qHLGoHAJGBpAWabcAmtMzRd9FL4G1RE52Ti9-mvyv-GHdGcXWQ-k Aug 27 02:57:31.801959 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:57:31.801959 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:57:31.801959 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:57:31.801959 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:57:31.801959 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:57:31.801959 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:57:31.801959 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 6a50fe5379b348cfab491fafb32842e2 Aug 27 02:57:31.801959 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1454701903 Aug 27 02:57:31.801959 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:57:31.801959 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:57:31.801959 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6a50fe5379b348cfab491fafb32842e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_6a50fe5379b348cfab491fafb32842e2", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6a50fe5379b348cfab491fafb32842e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/6a50fe5379b348cfab491fafb32842e2"}]}] Aug 27 02:57:31.801959 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1454701903 Aug 27 02:57:31.801959 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 6a50fe5379b348cfab491fafb32842e2 Aug 27 02:57:31.801959 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1454701903 Aug 27 02:57:31.801959 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-VolumesSnapshotsTestJSON-1454701903-project Aug 27 02:57:31.801959 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:57:31.801959 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:57:31.801959 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: bf4b0543e5924af8876124daebad0de7 Aug 27 02:57:31.801959 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1454701903-project Aug 27 02:57:31.801959 n-d-852278-4 devstack@n-api.service[134051]: method: Aug 27 02:57:31.801959 n-d-852278-4 devstack@n-api.service[134051]: exception: Snapshot 54f98102-d393-48e7-b01b-77ae8261cb6b could not be found. Aug 27 02:57:31.801959 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '54f98102-d393-48e7-b01b-77ae8261cb6b'} Aug 27 02:57:31.801959 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:57:31.801959 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:57:31.801959 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 27 02:57:31.801959 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 27 02:57:31.801959 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 27 02:57:31.801959 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 27 02:57:31.801959 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 27 02:57:31.801959 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 27 02:57:31.801959 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 27 02:57:31.801959 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 27 02:57:31.801959 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 27 02:57:31.801959 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 27 02:57:31.801959 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 02:57:31.801959 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 02:57:31.801959 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 02:57:31.801959 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 02:57:31.801959 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 54f98102-d393-48e7-b01b-77ae8261cb6b could not be found. (HTTP 404) (Request-ID: req-675b2857-04b3-4bc5-aa6a-bed2a8310b7e) Aug 27 02:57:31.801959 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:57:31.801959 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:57:31.801959 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:57:31.801959 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:57:31.801959 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 27 02:57:31.801959 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 27 02:57:31.801959 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 27 02:57:31.801959 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 27 02:57:31.801959 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 27 02:57:31.801959 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 27 02:57:31.801959 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 27 02:57:31.801959 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 27 02:57:31.805509 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 27 02:57:31.805509 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 27 02:57:31.805509 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 27 02:57:31.805509 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 27 02:57:31.805509 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 27 02:57:31.805509 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 27 02:57:31.805509 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 27 02:57:31.805509 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 27 02:57:31.805509 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 27 02:57:31.805509 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 27 02:57:31.805509 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 02:57:31.805509 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 02:57:31.805509 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 02:57:31.805509 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 02:57:31.805509 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 54f98102-d393-48e7-b01b-77ae8261cb6b could not be found. Aug 27 02:57:31.805509 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:57:31.805509 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:57:31.805509 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:57:31.805509 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:57:31.805509 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:57:31.805509 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:57:31.805509 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:57:31.805509 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:57:31.805509 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:57:31.805509 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:57:31.805509 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:57:31.805509 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:57:31.805509 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 27 02:57:31.805509 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:57:31.805509 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 54f98102-d393-48e7-b01b-77ae8261cb6b could not be found. Aug 27 02:57:31.805509 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:57:31.805509 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:57:31.805509 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:57:31.805509 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:57:31.805509 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:57:31.805509 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:57:31.805509 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:57:31.805509 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:57:31.805509 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 54f98102-d393-48e7-b01b-77ae8261cb6b could not be found. Aug 27 02:57:31.805509 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:57:31.805509 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-28c23f8c-9d33-40f1-87ac-f418abee1e1a tempest-VolumesSnapshotsTestJSON-1454701903 tempest-VolumesSnapshotsTestJSON-1454701903-project] Returning 404 to user: Snapshot 54f98102-d393-48e7-b01b-77ae8261cb6b could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:57:31.805509 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-28c23f8c-9d33-40f1-87ac-f418abee1e1a tempest-VolumesSnapshotsTestJSON-1454701903 tempest-VolumesSnapshotsTestJSON-1454701903-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/54f98102-d393-48e7-b01b-77ae8261cb6b" status: 404 len: 111 microversion: 2.1 time: 0.043495 Aug 27 02:57:31.812467 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1732/3484] 10.222.0.70 () {58 vars in 1251 bytes} [Sat Aug 27 02:57:31 2022] GET /compute/v2.1/os-snapshots/54f98102-d393-48e7-b01b-77ae8261cb6b => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:57:31.829978 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4bf3de3f-bd22-4da3-ae4c-6e282af298a3 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Action: 'create', calling method: .version_select at 0x7f5ede8e6c10>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-739687762", "description": "tempest-description-1554230632"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:57:32.009616 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-ee011d56-2164-426f-9ea8-e683158314ec tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b217f9cbc204919ba77d885315907c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2448b78114c54dd39bc85538fb973dd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:32.018126 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ee011d56-2164-426f-9ea8-e683158314ec tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] 10.222.0.70 "GET /compute/v2.1/servers/edb9e3a3-f71d-4a90-b617-167316a61e44" status: 200 len: 1321 microversion: 2.1 time: 0.336293 Aug 27 02:57:32.018905 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1753/3485] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:57:31 2022] GET /compute/v2.1/servers/edb9e3a3-f71d-4a90-b617-167316a61e44 => generated 1321 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:57:32.037858 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8601e2c5-8d99-46e8-930e-71030c45ae3f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:32.038711 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-8601e2c5-8d99-46e8-930e-71030c45ae3f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 123a4464-d077-4253-9d13-38f63f70fc43] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:32.045454 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8601e2c5-8d99-46e8-930e-71030c45ae3f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:32.046135 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8601e2c5-8d99-46e8-930e-71030c45ae3f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:32.046738 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8601e2c5-8d99-46e8-930e-71030c45ae3f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:32.047590 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8601e2c5-8d99-46e8-930e-71030c45ae3f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:32.048188 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8601e2c5-8d99-46e8-930e-71030c45ae3f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:32.048802 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8601e2c5-8d99-46e8-930e-71030c45ae3f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:32.160491 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-8601e2c5-8d99-46e8-930e-71030c45ae3f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:32.171062 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-8601e2c5-8d99-46e8-930e-71030c45ae3f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/123a4464-d077-4253-9d13-38f63f70fc43" status: 200 len: 1460 microversion: 2.1 time: 0.137273 Aug 27 02:57:32.172426 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1754/3486] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:57:32 2022] GET /compute/v2.1/servers/123a4464-d077-4253-9d13-38f63f70fc43 => generated 1460 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:57:32.179922 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ca521e40-4d4a-4c5f-a236-691ca52369c3 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:32.180759 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-ca521e40-4d4a-4c5f-a236-691ca52369c3 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] [instance: f8532783-21d1-4910-91ef-223c2379fd43] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:32.195001 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ca521e40-4d4a-4c5f-a236-691ca52369c3 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:32.196077 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ca521e40-4d4a-4c5f-a236-691ca52369c3 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:32.197983 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ca521e40-4d4a-4c5f-a236-691ca52369c3 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:32.199324 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ca521e40-4d4a-4c5f-a236-691ca52369c3 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:32.199959 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ca521e40-4d4a-4c5f-a236-691ca52369c3 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:32.200558 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ca521e40-4d4a-4c5f-a236-691ca52369c3 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:32.250747 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-ca521e40-4d4a-4c5f-a236-691ca52369c3 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] [instance: f8532783-21d1-4910-91ef-223c2379fd43] Going to try to terminate instance {{(pid=134052) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:57:32.302492 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=89,nova_cell1:SAVEPOINT=3,nova_cell1:INSERT=3,nova_cell1:RELEASE=3,nova_cell1:DELETE=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:57:32.305767 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-4bf3de3f-bd22-4da3-ae4c-6e282af298a3 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] 10.222.0.70 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.491705 Aug 27 02:57:32.306807 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1733/3487] 10.222.0.70 () {60 vars in 1180 bytes} [Sat Aug 27 02:57:31 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:57:32.311740 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-9298a82d-8d48-43cf-b66d-6777c1b9b2ee tempest-VolumesSnapshotsTestJSON-1454701903 tempest-VolumesSnapshotsTestJSON-1454701903-project] Calling method '.version_select at 0x7f5edf4a1b80>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:32.402426 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ca521e40-4d4a-4c5f-a236-691ca52369c3 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] 10.222.0.70 "DELETE /compute/v2.1/servers/f8532783-21d1-4910-91ef-223c2379fd43" status: 204 len: 0 microversion: 2.26 time: 0.228137 Aug 27 02:57:32.406333 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1755/3488] 10.222.0.70 () {60 vars in 1280 bytes} [Sat Aug 27 02:57:32 2022] DELETE /compute/v2.1/servers/f8532783-21d1-4910-91ef-223c2379fd43 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 02:57:32.409848 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-dc9dea27-aecd-45ee-a5df-342b943a3f6f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:32.410559 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-dc9dea27-aecd-45ee-a5df-342b943a3f6f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:32.418016 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dc9dea27-aecd-45ee-a5df-342b943a3f6f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:32.418507 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dc9dea27-aecd-45ee-a5df-342b943a3f6f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:32.419026 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dc9dea27-aecd-45ee-a5df-342b943a3f6f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:32.421502 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dc9dea27-aecd-45ee-a5df-342b943a3f6f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:32.422559 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dc9dea27-aecd-45ee-a5df-342b943a3f6f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:32.422993 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dc9dea27-aecd-45ee-a5df-342b943a3f6f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:32.437397 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-9298a82d-8d48-43cf-b66d-6777c1b9b2ee tempest-VolumesSnapshotsTestJSON-1454701903 tempest-VolumesSnapshotsTestJSON-1454701903-project] 10.222.0.70 "DELETE /compute/v2.1/os-volumes/d10772fc-f691-4890-ace8-8ba362b7851b" status: 202 len: 0 microversion: 2.1 time: 0.129143 Aug 27 02:57:32.438039 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1734/3489] 10.222.0.70 () {58 vars in 1248 bytes} [Sat Aug 27 02:57:32 2022] DELETE /compute/v2.1/os-volumes/d10772fc-f691-4890-ace8-8ba362b7851b => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:57:32.447405 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-6a6f2422-e117-4efd-97ed-233bf2baebb9 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Action: 'create', calling method: .version_select at 0x7f5ede8f8700>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1281649492", "description": "tempest-description-2030451921"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:57:32.750787 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-6a6f2422-e117-4efd-97ed-233bf2baebb9 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] 10.222.0.70 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.307704 Aug 27 02:57:32.751785 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1735/3490] 10.222.0.70 () {60 vars in 1180 bytes} [Sat Aug 27 02:57:32 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:57:32.758492 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-057b13ac-6e6d-41a3-b9d6-0849850b7e12 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:32.759846 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-057b13ac-6e6d-41a3-b9d6-0849850b7e12 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] [instance: f8532783-21d1-4910-91ef-223c2379fd43] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:32.778433 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-057b13ac-6e6d-41a3-b9d6-0849850b7e12 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:32.780820 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-057b13ac-6e6d-41a3-b9d6-0849850b7e12 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:32.781612 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-057b13ac-6e6d-41a3-b9d6-0849850b7e12 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:32.783573 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-057b13ac-6e6d-41a3-b9d6-0849850b7e12 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:32.786330 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-057b13ac-6e6d-41a3-b9d6-0849850b7e12 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:32.787008 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-057b13ac-6e6d-41a3-b9d6-0849850b7e12 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:32.849029 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-dc9dea27-aecd-45ee-a5df-342b943a3f6f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:32.863518 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-dc9dea27-aecd-45ee-a5df-342b943a3f6f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1668 microversion: 2.1 time: 0.458244 Aug 27 02:57:32.864295 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1756/3491] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:57:32 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1668 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:57:32.874044 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-54d09752-6fbe-4d97-a672-dc25ce3a547f tempest-VolumesSnapshotsTestJSON-1454701903 tempest-VolumesSnapshotsTestJSON-1454701903-project] Calling method '.version_select at 0x7f5ee3811700>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:32.957030 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-54d09752-6fbe-4d97-a672-dc25ce3a547f tempest-VolumesSnapshotsTestJSON-1454701903 tempest-VolumesSnapshotsTestJSON-1454701903-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/d10772fc-f691-4890-ace8-8ba362b7851b" status: 200 len: 344 microversion: 2.1 time: 0.089662 Aug 27 02:57:32.964711 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1757/3492] 10.222.0.70 () {58 vars in 1245 bytes} [Sat Aug 27 02:57:32 2022] GET /compute/v2.1/os-volumes/d10772fc-f691-4890-ace8-8ba362b7851b => generated 344 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:57:32.972119 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-656e78c2-6c50-4df4-a5c5-ec0cdffd24ed tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Calling method '.version_select at 0x7f5ee31a6280>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:33.224400 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-057b13ac-6e6d-41a3-b9d6-0849850b7e12 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07e9c0615234db297022024208e8e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10678bb6b93c4dc59f76e689f5b20ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:33.235164 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-057b13ac-6e6d-41a3-b9d6-0849850b7e12 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c07e9c0615234db297022024208e8e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10678bb6b93c4dc59f76e689f5b20ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:33.237428 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-057b13ac-6e6d-41a3-b9d6-0849850b7e12 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c07e9c0615234db297022024208e8e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10678bb6b93c4dc59f76e689f5b20ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:33.239026 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-057b13ac-6e6d-41a3-b9d6-0849850b7e12 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] 10.222.0.70 "GET /compute/v2.1/servers/f8532783-21d1-4910-91ef-223c2379fd43" status: 200 len: 1553 microversion: 2.26 time: 0.486016 Aug 27 02:57:33.240157 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1736/3493] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:57:32 2022] GET /compute/v2.1/servers/f8532783-21d1-4910-91ef-223c2379fd43 => generated 1553 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:57:33.246144 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-41d6972a-7c07-4908-b790-60f647aa0c16 req-de58053e-7a6c-4f71-8a88-cd6cc6a4e0e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "123a4464-d077-4253-9d13-38f63f70fc43", "tag": "611d60d4-10eb-4ef5-a705-cd3852a652a8"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:57:33.257099 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-41d6972a-7c07-4908-b790-60f647aa0c16 req-de58053e-7a6c-4f71-8a88-cd6cc6a4e0e4 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:33.257870 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-41d6972a-7c07-4908-b790-60f647aa0c16 req-de58053e-7a6c-4f71-8a88-cd6cc6a4e0e4 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:33.258556 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-41d6972a-7c07-4908-b790-60f647aa0c16 req-de58053e-7a6c-4f71-8a88-cd6cc6a4e0e4 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:33.271612 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-41d6972a-7c07-4908-b790-60f647aa0c16 req-de58053e-7a6c-4f71-8a88-cd6cc6a4e0e4 service nova] Creating event network-changed:611d60d4-10eb-4ef5-a705-cd3852a652a8 for instance 123a4464-d077-4253-9d13-38f63f70fc43 on n-h1-852278-4 Aug 27 02:57:33.278238 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-41d6972a-7c07-4908-b790-60f647aa0c16 req-de58053e-7a6c-4f71-8a88-cd6cc6a4e0e4 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036583 Aug 27 02:57:33.279072 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1737/3494] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:57:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:57:33.285441 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c570dbe4-1cb4-4fd4-872b-b3d8d74de697 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:33.286205 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-c570dbe4-1cb4-4fd4-872b-b3d8d74de697 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:33.298914 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c570dbe4-1cb4-4fd4-872b-b3d8d74de697 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:33.299663 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c570dbe4-1cb4-4fd4-872b-b3d8d74de697 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:33.300242 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c570dbe4-1cb4-4fd4-872b-b3d8d74de697 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:33.301586 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c570dbe4-1cb4-4fd4-872b-b3d8d74de697 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:33.302184 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c570dbe4-1cb4-4fd4-872b-b3d8d74de697 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:33.303063 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c570dbe4-1cb4-4fd4-872b-b3d8d74de697 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:33.359527 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-656e78c2-6c50-4df4-a5c5-ec0cdffd24ed tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] 10.222.0.70 "GET /compute/v2.1/os-security-groups" status: 200 len: 1832 microversion: 2.1 time: 0.393579 Aug 27 02:57:33.368185 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1758/3495] 10.222.0.70 () {58 vars in 1158 bytes} [Sat Aug 27 02:57:32 2022] GET /compute/v2.1/os-security-groups => generated 1832 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:57:33.368185 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d039c7ab-5f95-4049-9dcf-c8b1859f50fa tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:33.368185 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d039c7ab-5f95-4049-9dcf-c8b1859f50fa tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] [instance: edb9e3a3-f71d-4a90-b617-167316a61e44] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:33.378065 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d039c7ab-5f95-4049-9dcf-c8b1859f50fa tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:33.378562 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d039c7ab-5f95-4049-9dcf-c8b1859f50fa tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:33.378995 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d039c7ab-5f95-4049-9dcf-c8b1859f50fa tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:33.379710 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d039c7ab-5f95-4049-9dcf-c8b1859f50fa tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:33.380159 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d039c7ab-5f95-4049-9dcf-c8b1859f50fa tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:33.380612 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d039c7ab-5f95-4049-9dcf-c8b1859f50fa tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:33.582530 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-c570dbe4-1cb4-4fd4-872b-b3d8d74de697 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:33.593328 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c570dbe4-1cb4-4fd4-872b-b3d8d74de697 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1668 microversion: 2.1 time: 0.312715 Aug 27 02:57:33.594666 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1738/3496] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:57:33 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1668 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:57:33.599934 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-1b2a37d9-9014-477c-9f83-eccf4ff0d2ee req-15693859-f5d9-44a9-b750-c4efd661aa90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02eba429-ecb3-4a5c-87ea-c049ad7aca1a", "name": "network-vif-plugged", "status": "completed", "tag": "ef643ab7-d23e-493f-ac79-153b06eccfce"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:57:33.647841 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-1b2a37d9-9014-477c-9f83-eccf4ff0d2ee req-15693859-f5d9-44a9-b750-c4efd661aa90 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:33.649068 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-1b2a37d9-9014-477c-9f83-eccf4ff0d2ee req-15693859-f5d9-44a9-b750-c4efd661aa90 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:33.649799 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-1b2a37d9-9014-477c-9f83-eccf4ff0d2ee req-15693859-f5d9-44a9-b750-c4efd661aa90 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:33.673689 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-d039c7ab-5f95-4049-9dcf-c8b1859f50fa tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b217f9cbc204919ba77d885315907c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2448b78114c54dd39bc85538fb973dd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:33.701276 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d039c7ab-5f95-4049-9dcf-c8b1859f50fa tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] 10.222.0.70 "GET /compute/v2.1/servers/edb9e3a3-f71d-4a90-b617-167316a61e44" status: 200 len: 1321 microversion: 2.1 time: 0.337175 Aug 27 02:57:33.703415 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-1b2a37d9-9014-477c-9f83-eccf4ff0d2ee req-15693859-f5d9-44a9-b750-c4efd661aa90 service nova] Creating event network-vif-plugged:ef643ab7-d23e-493f-ac79-153b06eccfce for instance 02eba429-ecb3-4a5c-87ea-c049ad7aca1a on n-h2-852278-4 Aug 27 02:57:33.715249 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-1b2a37d9-9014-477c-9f83-eccf4ff0d2ee req-15693859-f5d9-44a9-b750-c4efd661aa90 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118129 Aug 27 02:57:33.715430 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1759/3497] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:57:33 2022] GET /compute/v2.1/servers/edb9e3a3-f71d-4a90-b617-167316a61e44 => generated 1321 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:57:33.716730 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1739/3498] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:57:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:57:33.720324 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6fbaa4ce-86a6-44ba-9ed9-571719ac287b tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Calling method '.version_select at 0x7f5ee3159550>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:33.751175 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-1e3e62c5-e130-4704-b0bc-4924aa7ce4f9 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:33.757660 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-1e3e62c5-e130-4704-b0bc-4924aa7ce4f9 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:33.780709 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1e3e62c5-e130-4704-b0bc-4924aa7ce4f9 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:33.781579 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1e3e62c5-e130-4704-b0bc-4924aa7ce4f9 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:33.782217 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1e3e62c5-e130-4704-b0bc-4924aa7ce4f9 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:33.783132 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1e3e62c5-e130-4704-b0bc-4924aa7ce4f9 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:33.783779 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1e3e62c5-e130-4704-b0bc-4924aa7ce4f9 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:33.784429 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1e3e62c5-e130-4704-b0bc-4924aa7ce4f9 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:34.274964 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-1e3e62c5-e130-4704-b0bc-4924aa7ce4f9 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:34.288836 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-1e3e62c5-e130-4704-b0bc-4924aa7ce4f9 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1668 microversion: 2.1 time: 0.568892 Aug 27 02:57:34.290264 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1740/3499] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:57:33 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1668 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:57:34.296537 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-51f6243d-47f4-4a32-b6a7-e9b68e17c12e tempest-VolumesSnapshotsTestJSON-1454701903 tempest-VolumesSnapshotsTestJSON-1454701903-project] Calling method '.version_select at 0x7f5ede8e9940>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:34.357490 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-51f6243d-47f4-4a32-b6a7-e9b68e17c12e tempest-VolumesSnapshotsTestJSON-1454701903 tempest-VolumesSnapshotsTestJSON-1454701903-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/d10772fc-f691-4890-ace8-8ba362b7851b" status: 200 len: 344 microversion: 2.1 time: 0.065889 Aug 27 02:57:34.365316 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1741/3500] 10.222.0.70 () {58 vars in 1245 bytes} [Sat Aug 27 02:57:34 2022] GET /compute/v2.1/os-volumes/d10772fc-f691-4890-ace8-8ba362b7851b => generated 344 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:57:34.373009 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-296d95c0-5694-41ab-a7c8-8ca9925f44e9 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:34.373869 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-296d95c0-5694-41ab-a7c8-8ca9925f44e9 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] [instance: f8532783-21d1-4910-91ef-223c2379fd43] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:34.383844 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-296d95c0-5694-41ab-a7c8-8ca9925f44e9 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:34.385012 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-296d95c0-5694-41ab-a7c8-8ca9925f44e9 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:34.385601 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-296d95c0-5694-41ab-a7c8-8ca9925f44e9 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:34.386602 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-296d95c0-5694-41ab-a7c8-8ca9925f44e9 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:34.388808 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-296d95c0-5694-41ab-a7c8-8ca9925f44e9 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:34.389555 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-296d95c0-5694-41ab-a7c8-8ca9925f44e9 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:34.441530 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-6fbaa4ce-86a6-44ba-9ed9-571719ac287b tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/2e7b5a26-678c-48f7-ba68-f602f10b5adb" status: 202 len: 0 microversion: 2.1 time: 0.723090 Aug 27 02:57:34.443630 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1760/3501] 10.222.0.70 () {58 vars in 1272 bytes} [Sat Aug 27 02:57:33 2022] DELETE /compute/v2.1/os-security-groups/2e7b5a26-678c-48f7-ba68-f602f10b5adb => generated 0 bytes in 728 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:57:34.452201 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-545bdfc7-2fc9-45ba-a93e-84917320e788 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:34.454393 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-545bdfc7-2fc9-45ba-a93e-84917320e788 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:34.463145 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-545bdfc7-2fc9-45ba-a93e-84917320e788 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:34.463827 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-545bdfc7-2fc9-45ba-a93e-84917320e788 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:34.464676 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-545bdfc7-2fc9-45ba-a93e-84917320e788 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:34.465710 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-545bdfc7-2fc9-45ba-a93e-84917320e788 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:34.466302 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-545bdfc7-2fc9-45ba-a93e-84917320e788 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:34.466865 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-545bdfc7-2fc9-45ba-a93e-84917320e788 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:34.741376 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-296d95c0-5694-41ab-a7c8-8ca9925f44e9 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07e9c0615234db297022024208e8e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10678bb6b93c4dc59f76e689f5b20ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:34.755478 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-296d95c0-5694-41ab-a7c8-8ca9925f44e9 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c07e9c0615234db297022024208e8e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10678bb6b93c4dc59f76e689f5b20ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:34.758042 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-296d95c0-5694-41ab-a7c8-8ca9925f44e9 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c07e9c0615234db297022024208e8e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10678bb6b93c4dc59f76e689f5b20ff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:34.762177 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-545bdfc7-2fc9-45ba-a93e-84917320e788 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:34.769332 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-296d95c0-5694-41ab-a7c8-8ca9925f44e9 tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] 10.222.0.70 "GET /compute/v2.1/servers/f8532783-21d1-4910-91ef-223c2379fd43" status: 200 len: 1553 microversion: 2.26 time: 0.400718 Aug 27 02:57:34.788871 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-545bdfc7-2fc9-45ba-a93e-84917320e788 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1668 microversion: 2.1 time: 0.330838 Aug 27 02:57:34.788871 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1761/3502] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:57:34 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1668 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:57:34.793144 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1742/3503] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:57:34 2022] GET /compute/v2.1/servers/f8532783-21d1-4910-91ef-223c2379fd43 => generated 1553 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:57:34.793287 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c1595f64-9917-4fe7-afbf-06812a2f364c tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Calling method '.version_select at 0x7f5ee3030040>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:34.803212 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-913a4aef-654e-429b-86d7-7450896988a8 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:34.803833 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-913a4aef-654e-429b-86d7-7450896988a8 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] [instance: edb9e3a3-f71d-4a90-b617-167316a61e44] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:34.826112 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-913a4aef-654e-429b-86d7-7450896988a8 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:34.826620 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-913a4aef-654e-429b-86d7-7450896988a8 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:34.827052 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-913a4aef-654e-429b-86d7-7450896988a8 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:34.827770 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-913a4aef-654e-429b-86d7-7450896988a8 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:34.828215 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-913a4aef-654e-429b-86d7-7450896988a8 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:34.832860 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-913a4aef-654e-429b-86d7-7450896988a8 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:34.878923 n-d-852278-4 devstack@n-api.service[134052]: DEBUG neutronclient.v2_0.client [None req-c1595f64-9917-4fe7-afbf-06812a2f364c tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 2e7b5a26-678c-48f7-ba68-f602f10b5adb does not exist", "detail": ""}} {{(pid=134052) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 02:57:34.879839 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.network.security_group_api [None req-c1595f64-9917-4fe7-afbf-06812a2f364c tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Neutron security group 2e7b5a26-678c-48f7-ba68-f602f10b5adb not found {{(pid=134052) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 27 02:57:34.881220 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-c1595f64-9917-4fe7-afbf-06812a2f364c tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] HTTP exception thrown: Security group 2e7b5a26-678c-48f7-ba68-f602f10b5adb does not exist Aug 27 02:57:34.881220 n-d-852278-4 devstack@n-api.service[134052]: Neutron server returns request_ids: ['req-9eea0897-6650-458d-9341-7650b7357f29'] Aug 27 02:57:34.883838 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c1595f64-9917-4fe7-afbf-06812a2f364c tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Request method failure captured: Aug 27 02:57:34.883838 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/os-security-groups/2e7b5a26-678c-48f7-ba68-f602f10b5adb HTTP/1.1 Aug 27 02:57:34.883838 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:57:34.883838 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:57:34.883838 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:57:34.883838 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:57:34.883838 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:57:34.883838 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:57:34.883838 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:57:34.883838 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:57:34.883838 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYf2b88jccGp908k3vQwdmk8aWVpZgx4XAwdI__tT5JQ00leavue9yGRA0Ra6tx0k8LuwOwvFz5QHaUm9YwpVl7ey0u_0fYkHaP7j9Kliw_5Q5Xf4F9k_115SseZDZeFd_ncRBfnV98omKQ5oUaf4zu042RXCwV00aKzeJyDrzb4sII Aug 27 02:57:34.883838 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:57:34.883838 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:57:34.883838 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:57:34.883838 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:57:34.883838 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:57:34.883838 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:57:34.883838 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 2a6a888c878245cb9e5909e071c9b9c2 Aug 27 02:57:34.883838 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-SecurityGroupsTestJSON-23859158 Aug 27 02:57:34.883838 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:57:34.883838 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:57:34.883838 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2a6a888c878245cb9e5909e071c9b9c2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_2a6a888c878245cb9e5909e071c9b9c2", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2a6a888c878245cb9e5909e071c9b9c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/2a6a888c878245cb9e5909e071c9b9c2"}]}] Aug 27 02:57:34.883838 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-SecurityGroupsTestJSON-23859158 Aug 27 02:57:34.883838 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 2a6a888c878245cb9e5909e071c9b9c2 Aug 27 02:57:34.883838 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-23859158 Aug 27 02:57:34.883838 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-SecurityGroupsTestJSON-23859158-project Aug 27 02:57:34.883838 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:57:34.883838 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:57:34.883838 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: ef6381ae230a45de8b105374c2d25383 Aug 27 02:57:34.883838 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-SecurityGroupsTestJSON-23859158-project Aug 27 02:57:34.883838 n-d-852278-4 devstack@n-api.service[134052]: method: Aug 27 02:57:34.883838 n-d-852278-4 devstack@n-api.service[134052]: exception: Security group 2e7b5a26-678c-48f7-ba68-f602f10b5adb does not exist Aug 27 02:57:34.883838 n-d-852278-4 devstack@n-api.service[134052]: Neutron server returns request_ids: ['req-9eea0897-6650-458d-9341-7650b7357f29'] Aug 27 02:57:34.883838 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '2e7b5a26-678c-48f7-ba68-f602f10b5adb'} Aug 27 02:57:34.883838 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:57:34.883838 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:57:34.883838 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 27 02:57:34.883838 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 27 02:57:34.883838 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:57:34.883838 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:57:34.883838 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 27 02:57:34.883838 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 27 02:57:34.883838 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:57:34.883838 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:57:34.883838 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 02:57:34.883838 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 02:57:34.883838 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:57:34.883838 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:57:34.883838 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 02:57:34.883838 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 02:57:34.883838 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:57:34.883838 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:57:34.883838 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 02:57:34.883838 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 02:57:34.883838 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:57:34.883838 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:57:34.883838 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 02:57:34.883838 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 02:57:34.883838 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 02:57:34.883838 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 02:57:34.883838 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 2e7b5a26-678c-48f7-ba68-f602f10b5adb does not exist Aug 27 02:57:34.887534 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9eea0897-6650-458d-9341-7650b7357f29'] Aug 27 02:57:34.887534 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:57:34.887534 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:57:34.887534 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:57:34.887534 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:57:34.887534 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 27 02:57:34.887534 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 27 02:57:34.887534 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 27 02:57:34.887534 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 27 02:57:34.887534 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 2e7b5a26-678c-48f7-ba68-f602f10b5adb does not exist Aug 27 02:57:34.887534 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9eea0897-6650-458d-9341-7650b7357f29'] Aug 27 02:57:34.887534 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:57:34.887534 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:57:34.887534 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:57:34.887534 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:57:34.887534 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:57:34.887534 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:57:34.887534 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:57:34.887534 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:57:34.887534 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:57:34.887534 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:57:34.887534 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:57:34.887534 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:57:34.887534 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 27 02:57:34.887534 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 27 02:57:34.887534 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 2e7b5a26-678c-48f7-ba68-f602f10b5adb does not exist Aug 27 02:57:34.887534 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9eea0897-6650-458d-9341-7650b7357f29'] Aug 27 02:57:34.887534 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:57:34.887534 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:57:34.887534 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:57:34.887534 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:57:34.887534 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:57:34.887534 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:57:34.887534 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:57:34.887534 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:57:34.887534 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 2e7b5a26-678c-48f7-ba68-f602f10b5adb does not exist Aug 27 02:57:34.887534 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9eea0897-6650-458d-9341-7650b7357f29'] Aug 27 02:57:34.887534 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:57:34.887534 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c1595f64-9917-4fe7-afbf-06812a2f364c tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Returning 404 to user: Security group 2e7b5a26-678c-48f7-ba68-f602f10b5adb does not exist Aug 27 02:57:34.887534 n-d-852278-4 devstack@n-api.service[134052]: Neutron server returns request_ids: ['req-9eea0897-6650-458d-9341-7650b7357f29'] {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:57:34.889560 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c1595f64-9917-4fe7-afbf-06812a2f364c tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] 10.222.0.70 "GET /compute/v2.1/os-security-groups/2e7b5a26-678c-48f7-ba68-f602f10b5adb" status: 404 len: 194 microversion: 2.1 time: 0.110960 Aug 27 02:57:34.893653 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1762/3504] 10.222.0.70 () {58 vars in 1269 bytes} [Sat Aug 27 02:57:34 2022] GET /compute/v2.1/os-security-groups/2e7b5a26-678c-48f7-ba68-f602f10b5adb => generated 194 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:57:34.909992 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-faea6ffd-8827-4fd0-97ed-6f6d9a79e1e0 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Calling method '.version_select at 0x7f5ee3401c10>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:35.372883 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-faea6ffd-8827-4fd0-97ed-6f6d9a79e1e0 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/020822de-f56c-4739-8056-1159b2a26c5e" status: 202 len: 0 microversion: 2.1 time: 0.477539 Aug 27 02:57:35.376744 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1763/3505] 10.222.0.70 () {58 vars in 1272 bytes} [Sat Aug 27 02:57:34 2022] DELETE /compute/v2.1/os-security-groups/020822de-f56c-4739-8056-1159b2a26c5e => generated 0 bytes in 482 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:57:35.382241 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3256c192-5f04-46e6-ae65-519344f81389 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1317806376", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "networks": [{"uuid": "7532a923-41df-4761-8077-055e309eff44"}]}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:57:35.390649 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-913a4aef-654e-429b-86d7-7450896988a8 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b217f9cbc204919ba77d885315907c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2448b78114c54dd39bc85538fb973dd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:35.414583 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-913a4aef-654e-429b-86d7-7450896988a8 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] 10.222.0.70 "GET /compute/v2.1/servers/edb9e3a3-f71d-4a90-b617-167316a61e44" status: 200 len: 1321 microversion: 2.1 time: 0.617424 Aug 27 02:57:35.415811 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1743/3506] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:57:34 2022] GET /compute/v2.1/servers/edb9e3a3-f71d-4a90-b617-167316a61e44 => generated 1321 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:57:35.433360 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-c945bc76-337b-4359-8e27-cb4da01546c2 req-73c82267-4b98-4a49-81fb-ff2b7128b3c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8532783-21d1-4910-91ef-223c2379fd43", "name": "network-vif-deleted", "tag": "e085573e-6d8b-4579-a677-c77683bcdb66"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:57:35.475729 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.network.neutron [None req-3256c192-5f04-46e6-ae65-519344f81389 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] validate_networks() for [('7532a923-41df-4761-8077-055e309eff44', None, None, None, None, None)] {{(pid=134052) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:57:35.486692 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-c945bc76-337b-4359-8e27-cb4da01546c2 req-73c82267-4b98-4a49-81fb-ff2b7128b3c5 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:35.488162 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-c945bc76-337b-4359-8e27-cb4da01546c2 req-73c82267-4b98-4a49-81fb-ff2b7128b3c5 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:35.490514 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-c945bc76-337b-4359-8e27-cb4da01546c2 req-73c82267-4b98-4a49-81fb-ff2b7128b3c5 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:35.511466 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-c945bc76-337b-4359-8e27-cb4da01546c2 req-73c82267-4b98-4a49-81fb-ff2b7128b3c5 service nova] Creating event network-vif-deleted:e085573e-6d8b-4579-a677-c77683bcdb66 for instance f8532783-21d1-4910-91ef-223c2379fd43 on n-h1-852278-4 Aug 27 02:57:35.527872 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-c945bc76-337b-4359-8e27-cb4da01546c2 req-73c82267-4b98-4a49-81fb-ff2b7128b3c5 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109632 Aug 27 02:57:35.529891 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1744/3507] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:57:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:57:35.536217 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-71f688d3-1433-4b3f-b9f9-718065a6a5c9 tempest-VolumesSnapshotsTestJSON-1454701903 tempest-VolumesSnapshotsTestJSON-1454701903-project] Calling method '.version_select at 0x7f5ede97d280>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:35.574867 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-71f688d3-1433-4b3f-b9f9-718065a6a5c9 tempest-VolumesSnapshotsTestJSON-1454701903 tempest-VolumesSnapshotsTestJSON-1454701903-project] HTTP exception thrown: Volume d10772fc-f691-4890-ace8-8ba362b7851b could not be found. Aug 27 02:57:35.577190 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-71f688d3-1433-4b3f-b9f9-718065a6a5c9 tempest-VolumesSnapshotsTestJSON-1454701903 tempest-VolumesSnapshotsTestJSON-1454701903-project] Request method failure captured: Aug 27 02:57:35.577190 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/os-volumes/d10772fc-f691-4890-ace8-8ba362b7851b HTTP/1.1 Aug 27 02:57:35.577190 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:57:35.577190 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:57:35.577190 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:57:35.577190 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:57:35.577190 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:57:35.577190 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:57:35.577190 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:57:35.577190 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:57:35.577190 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYgR_7W79kzstWeEBb0_3-KtxzIuBeq6YpAK5Ef6ZmBVWXyUrzb00i1-rNRLZ1vqwBIiB6a0y4c85fNJoY9dcdA2l4GEidrf4QtOk5EqF_8drcvJy0BLZ3K4mq7qHLGoHAJGBpAWabcAmtMzRd9FL4G1RE52Ti9-mvyv-GHdGcXWQ-k Aug 27 02:57:35.577190 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:57:35.577190 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:57:35.577190 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:57:35.577190 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:57:35.577190 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:57:35.577190 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:57:35.577190 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 6a50fe5379b348cfab491fafb32842e2 Aug 27 02:57:35.577190 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1454701903 Aug 27 02:57:35.577190 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:57:35.577190 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:57:35.577190 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6a50fe5379b348cfab491fafb32842e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_6a50fe5379b348cfab491fafb32842e2", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6a50fe5379b348cfab491fafb32842e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/6a50fe5379b348cfab491fafb32842e2"}]}] Aug 27 02:57:35.577190 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1454701903 Aug 27 02:57:35.577190 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 6a50fe5379b348cfab491fafb32842e2 Aug 27 02:57:35.577190 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1454701903 Aug 27 02:57:35.577190 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-VolumesSnapshotsTestJSON-1454701903-project Aug 27 02:57:35.577190 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:57:35.577190 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:57:35.577190 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: bf4b0543e5924af8876124daebad0de7 Aug 27 02:57:35.577190 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1454701903-project Aug 27 02:57:35.577190 n-d-852278-4 devstack@n-api.service[134051]: method: Aug 27 02:57:35.577190 n-d-852278-4 devstack@n-api.service[134051]: exception: Volume d10772fc-f691-4890-ace8-8ba362b7851b could not be found. Aug 27 02:57:35.577190 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': 'd10772fc-f691-4890-ace8-8ba362b7851b'} Aug 27 02:57:35.577190 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:57:35.577190 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:57:35.577190 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 02:57:35.577190 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 02:57:35.577190 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 27 02:57:35.577190 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 27 02:57:35.577190 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 27 02:57:35.577190 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 27 02:57:35.577190 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 27 02:57:35.577190 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 27 02:57:35.577190 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 27 02:57:35.577190 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 27 02:57:35.577190 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 02:57:35.577190 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 02:57:35.577190 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 02:57:35.577190 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 02:57:35.577190 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d10772fc-f691-4890-ace8-8ba362b7851b could not be found. (HTTP 404) (Request-ID: req-43d2fbc0-42f5-45ff-8e7b-4e62312c8e3d) Aug 27 02:57:35.577190 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:57:35.577190 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:57:35.577190 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:57:35.577190 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:57:35.577190 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 27 02:57:35.577190 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 27 02:57:35.577190 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 27 02:57:35.577190 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 27 02:57:35.577190 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 27 02:57:35.577190 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 27 02:57:35.577190 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 27 02:57:35.577190 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 27 02:57:35.577190 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 02:57:35.581102 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 02:57:35.581102 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 27 02:57:35.581102 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 27 02:57:35.581102 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 27 02:57:35.581102 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 27 02:57:35.581102 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 27 02:57:35.581102 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 27 02:57:35.581102 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 27 02:57:35.581102 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 27 02:57:35.581102 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 02:57:35.581102 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 02:57:35.581102 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 02:57:35.581102 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 02:57:35.581102 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d10772fc-f691-4890-ace8-8ba362b7851b could not be found. Aug 27 02:57:35.581102 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:57:35.581102 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:57:35.581102 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:57:35.581102 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:57:35.581102 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:57:35.581102 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:57:35.581102 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:57:35.581102 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:57:35.581102 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:57:35.581102 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:57:35.581102 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:57:35.581102 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:57:35.581102 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 27 02:57:35.581102 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:57:35.581102 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d10772fc-f691-4890-ace8-8ba362b7851b could not be found. Aug 27 02:57:35.581102 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:57:35.581102 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:57:35.581102 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:57:35.581102 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:57:35.581102 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:57:35.581102 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:57:35.581102 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:57:35.581102 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:57:35.581102 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d10772fc-f691-4890-ace8-8ba362b7851b could not be found. Aug 27 02:57:35.581102 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:57:35.584384 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-71f688d3-1433-4b3f-b9f9-718065a6a5c9 tempest-VolumesSnapshotsTestJSON-1454701903 tempest-VolumesSnapshotsTestJSON-1454701903-project] Returning 404 to user: Volume d10772fc-f691-4890-ace8-8ba362b7851b could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:57:35.585448 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-71f688d3-1433-4b3f-b9f9-718065a6a5c9 tempest-VolumesSnapshotsTestJSON-1454701903 tempest-VolumesSnapshotsTestJSON-1454701903-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/d10772fc-f691-4890-ace8-8ba362b7851b" status: 404 len: 109 microversion: 2.1 time: 0.053497 Aug 27 02:57:35.590661 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1745/3508] 10.222.0.70 () {58 vars in 1245 bytes} [Sat Aug 27 02:57:35 2022] GET /compute/v2.1/os-volumes/d10772fc-f691-4890-ace8-8ba362b7851b => generated 109 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:57:35.595906 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7c89fffa-d295-42a2-b50e-2c1f2575feb2 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Calling method '.version_select at 0x7f5ee7202670>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:35.701778 n-d-852278-4 devstack@n-api.service[134051]: DEBUG neutronclient.v2_0.client [None req-7c89fffa-d295-42a2-b50e-2c1f2575feb2 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 020822de-f56c-4739-8056-1159b2a26c5e does not exist", "detail": ""}} {{(pid=134051) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 02:57:35.704019 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.network.security_group_api [None req-7c89fffa-d295-42a2-b50e-2c1f2575feb2 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Neutron security group 020822de-f56c-4739-8056-1159b2a26c5e not found {{(pid=134051) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 27 02:57:35.704880 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-7c89fffa-d295-42a2-b50e-2c1f2575feb2 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] HTTP exception thrown: Security group 020822de-f56c-4739-8056-1159b2a26c5e does not exist Aug 27 02:57:35.704880 n-d-852278-4 devstack@n-api.service[134051]: Neutron server returns request_ids: ['req-7a737906-ab73-4d66-9b44-730ad1a6d213'] Aug 27 02:57:35.707844 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7c89fffa-d295-42a2-b50e-2c1f2575feb2 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Request method failure captured: Aug 27 02:57:35.707844 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/os-security-groups/020822de-f56c-4739-8056-1159b2a26c5e HTTP/1.1 Aug 27 02:57:35.707844 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:57:35.707844 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:57:35.707844 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:57:35.707844 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:57:35.707844 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:57:35.707844 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:57:35.707844 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:57:35.707844 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:57:35.707844 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYf2b88jccGp908k3vQwdmk8aWVpZgx4XAwdI__tT5JQ00leavue9yGRA0Ra6tx0k8LuwOwvFz5QHaUm9YwpVl7ey0u_0fYkHaP7j9Kliw_5Q5Xf4F9k_115SseZDZeFd_ncRBfnV98omKQ5oUaf4zu042RXCwV00aKzeJyDrzb4sII Aug 27 02:57:35.707844 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:57:35.707844 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:57:35.707844 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:57:35.707844 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:57:35.707844 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:57:35.707844 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:57:35.707844 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 2a6a888c878245cb9e5909e071c9b9c2 Aug 27 02:57:35.707844 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-SecurityGroupsTestJSON-23859158 Aug 27 02:57:35.707844 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:57:35.707844 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:57:35.707844 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2a6a888c878245cb9e5909e071c9b9c2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_2a6a888c878245cb9e5909e071c9b9c2", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2a6a888c878245cb9e5909e071c9b9c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/2a6a888c878245cb9e5909e071c9b9c2"}]}] Aug 27 02:57:35.707844 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-SecurityGroupsTestJSON-23859158 Aug 27 02:57:35.707844 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 2a6a888c878245cb9e5909e071c9b9c2 Aug 27 02:57:35.707844 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-23859158 Aug 27 02:57:35.707844 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-SecurityGroupsTestJSON-23859158-project Aug 27 02:57:35.707844 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:57:35.707844 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:57:35.707844 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: ef6381ae230a45de8b105374c2d25383 Aug 27 02:57:35.707844 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-SecurityGroupsTestJSON-23859158-project Aug 27 02:57:35.707844 n-d-852278-4 devstack@n-api.service[134051]: method: Aug 27 02:57:35.707844 n-d-852278-4 devstack@n-api.service[134051]: exception: Security group 020822de-f56c-4739-8056-1159b2a26c5e does not exist Aug 27 02:57:35.707844 n-d-852278-4 devstack@n-api.service[134051]: Neutron server returns request_ids: ['req-7a737906-ab73-4d66-9b44-730ad1a6d213'] Aug 27 02:57:35.707844 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '020822de-f56c-4739-8056-1159b2a26c5e'} Aug 27 02:57:35.707844 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:57:35.707844 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:57:35.707844 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 27 02:57:35.707844 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 27 02:57:35.707844 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:57:35.707844 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:57:35.707844 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 27 02:57:35.707844 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 27 02:57:35.707844 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:57:35.707844 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:57:35.707844 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 02:57:35.707844 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 02:57:35.707844 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:57:35.707844 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:57:35.707844 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 02:57:35.707844 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 02:57:35.707844 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:57:35.707844 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:57:35.707844 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 02:57:35.707844 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 02:57:35.707844 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:57:35.707844 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:57:35.707844 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 02:57:35.707844 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 02:57:35.707844 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 02:57:35.707844 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 02:57:35.707844 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 020822de-f56c-4739-8056-1159b2a26c5e does not exist Aug 27 02:57:35.715103 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7a737906-ab73-4d66-9b44-730ad1a6d213'] Aug 27 02:57:35.715103 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:57:35.715103 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:57:35.715103 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:57:35.715103 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:57:35.715103 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 27 02:57:35.715103 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 27 02:57:35.715103 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 27 02:57:35.715103 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 27 02:57:35.715103 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 020822de-f56c-4739-8056-1159b2a26c5e does not exist Aug 27 02:57:35.715103 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7a737906-ab73-4d66-9b44-730ad1a6d213'] Aug 27 02:57:35.715103 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:57:35.715103 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:57:35.715103 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:57:35.715103 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:57:35.715103 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:57:35.715103 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:57:35.715103 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:57:35.715103 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:57:35.715103 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:57:35.715103 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:57:35.715103 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:57:35.715103 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:57:35.715103 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 27 02:57:35.715103 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 27 02:57:35.715103 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 020822de-f56c-4739-8056-1159b2a26c5e does not exist Aug 27 02:57:35.715103 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7a737906-ab73-4d66-9b44-730ad1a6d213'] Aug 27 02:57:35.715103 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:57:35.715103 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:57:35.715103 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:57:35.715103 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:57:35.715103 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:57:35.715103 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:57:35.715103 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:57:35.715103 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:57:35.715103 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 020822de-f56c-4739-8056-1159b2a26c5e does not exist Aug 27 02:57:35.715103 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7a737906-ab73-4d66-9b44-730ad1a6d213'] Aug 27 02:57:35.715103 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:57:35.718468 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7c89fffa-d295-42a2-b50e-2c1f2575feb2 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Returning 404 to user: Security group 020822de-f56c-4739-8056-1159b2a26c5e does not exist Aug 27 02:57:35.718468 n-d-852278-4 devstack@n-api.service[134051]: Neutron server returns request_ids: ['req-7a737906-ab73-4d66-9b44-730ad1a6d213'] {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:57:35.718982 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-7c89fffa-d295-42a2-b50e-2c1f2575feb2 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] 10.222.0.70 "GET /compute/v2.1/os-security-groups/020822de-f56c-4739-8056-1159b2a26c5e" status: 404 len: 194 microversion: 2.1 time: 0.127032 Aug 27 02:57:35.719570 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1746/3509] 10.222.0.70 () {58 vars in 1269 bytes} [Sat Aug 27 02:57:35 2022] GET /compute/v2.1/os-security-groups/020822de-f56c-4739-8056-1159b2a26c5e => generated 194 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:57:35.731566 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b709b959-15a6-4445-8f7c-1d89f5d7b5f4 tempest-VolumesSnapshotsTestJSON-1454701903 tempest-VolumesSnapshotsTestJSON-1454701903-project] Calling method '.version_select at 0x7f5ede9331f0>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:35.769940 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-b709b959-15a6-4445-8f7c-1d89f5d7b5f4 tempest-VolumesSnapshotsTestJSON-1454701903 tempest-VolumesSnapshotsTestJSON-1454701903-project] HTTP exception thrown: Volume d10772fc-f691-4890-ace8-8ba362b7851b could not be found. Aug 27 02:57:35.772238 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b709b959-15a6-4445-8f7c-1d89f5d7b5f4 tempest-VolumesSnapshotsTestJSON-1454701903 tempest-VolumesSnapshotsTestJSON-1454701903-project] Request method failure captured: Aug 27 02:57:35.772238 n-d-852278-4 devstack@n-api.service[134051]: request: DELETE /compute/v2.1/os-volumes/d10772fc-f691-4890-ace8-8ba362b7851b HTTP/1.1 Aug 27 02:57:35.772238 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:57:35.772238 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:57:35.772238 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:57:35.772238 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:57:35.772238 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:57:35.772238 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:57:35.772238 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:57:35.772238 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:57:35.772238 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYgR_7W79kzstWeEBb0_3-KtxzIuBeq6YpAK5Ef6ZmBVWXyUrzb00i1-rNRLZ1vqwBIiB6a0y4c85fNJoY9dcdA2l4GEidrf4QtOk5EqF_8drcvJy0BLZ3K4mq7qHLGoHAJGBpAWabcAmtMzRd9FL4G1RE52Ti9-mvyv-GHdGcXWQ-k Aug 27 02:57:35.772238 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:57:35.772238 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:57:35.772238 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:57:35.772238 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:57:35.772238 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:57:35.772238 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:57:35.772238 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 6a50fe5379b348cfab491fafb32842e2 Aug 27 02:57:35.772238 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1454701903 Aug 27 02:57:35.772238 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:57:35.772238 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:57:35.772238 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6a50fe5379b348cfab491fafb32842e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_6a50fe5379b348cfab491fafb32842e2", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6a50fe5379b348cfab491fafb32842e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/6a50fe5379b348cfab491fafb32842e2"}]}] Aug 27 02:57:35.772238 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1454701903 Aug 27 02:57:35.772238 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 6a50fe5379b348cfab491fafb32842e2 Aug 27 02:57:35.772238 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1454701903 Aug 27 02:57:35.772238 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-VolumesSnapshotsTestJSON-1454701903-project Aug 27 02:57:35.772238 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:57:35.772238 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:57:35.772238 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: bf4b0543e5924af8876124daebad0de7 Aug 27 02:57:35.772238 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1454701903-project Aug 27 02:57:35.772238 n-d-852278-4 devstack@n-api.service[134051]: method: Aug 27 02:57:35.772238 n-d-852278-4 devstack@n-api.service[134051]: exception: Volume d10772fc-f691-4890-ace8-8ba362b7851b could not be found. Aug 27 02:57:35.772238 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': 'd10772fc-f691-4890-ace8-8ba362b7851b'} Aug 27 02:57:35.772238 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:57:35.772238 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:57:35.772238 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 02:57:35.772238 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 02:57:35.772238 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 27 02:57:35.772238 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 27 02:57:35.772238 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 27 02:57:35.772238 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 27 02:57:35.772238 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 27 02:57:35.772238 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 27 02:57:35.772238 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 27 02:57:35.772238 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 27 02:57:35.772238 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 02:57:35.772238 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 02:57:35.772238 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 02:57:35.772238 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 02:57:35.772238 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d10772fc-f691-4890-ace8-8ba362b7851b could not be found. (HTTP 404) (Request-ID: req-66cfc6a3-dfe8-4f8b-9d30-ed0f4a414586) Aug 27 02:57:35.772238 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:57:35.772238 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:57:35.772238 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:57:35.772238 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:57:35.772238 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 27 02:57:35.772238 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 27 02:57:35.772238 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 27 02:57:35.772238 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 27 02:57:35.772238 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 27 02:57:35.772238 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 27 02:57:35.772238 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 27 02:57:35.772238 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 27 02:57:35.772238 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 02:57:35.775482 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 02:57:35.775482 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 27 02:57:35.775482 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 27 02:57:35.775482 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 27 02:57:35.775482 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 27 02:57:35.775482 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 27 02:57:35.775482 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 27 02:57:35.775482 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 27 02:57:35.775482 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 27 02:57:35.775482 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 02:57:35.775482 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 02:57:35.775482 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 02:57:35.775482 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 02:57:35.775482 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d10772fc-f691-4890-ace8-8ba362b7851b could not be found. Aug 27 02:57:35.775482 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:57:35.775482 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:57:35.775482 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:57:35.775482 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:57:35.775482 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:57:35.775482 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:57:35.775482 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:57:35.775482 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:57:35.775482 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:57:35.775482 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:57:35.775482 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:57:35.775482 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:57:35.775482 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 27 02:57:35.775482 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:57:35.775482 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d10772fc-f691-4890-ace8-8ba362b7851b could not be found. Aug 27 02:57:35.775482 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:57:35.775482 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:57:35.775482 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:57:35.775482 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:57:35.775482 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:57:35.775482 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:57:35.775482 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:57:35.775482 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:57:35.775482 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d10772fc-f691-4890-ace8-8ba362b7851b could not be found. Aug 27 02:57:35.775482 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:57:35.775482 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b709b959-15a6-4445-8f7c-1d89f5d7b5f4 tempest-VolumesSnapshotsTestJSON-1454701903 tempest-VolumesSnapshotsTestJSON-1454701903-project] Returning 404 to user: Volume d10772fc-f691-4890-ace8-8ba362b7851b could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:57:35.775482 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b709b959-15a6-4445-8f7c-1d89f5d7b5f4 tempest-VolumesSnapshotsTestJSON-1454701903 tempest-VolumesSnapshotsTestJSON-1454701903-project] 10.222.0.70 "DELETE /compute/v2.1/os-volumes/d10772fc-f691-4890-ace8-8ba362b7851b" status: 404 len: 109 microversion: 2.1 time: 0.053205 Aug 27 02:57:35.775482 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1747/3510] 10.222.0.70 () {58 vars in 1248 bytes} [Sat Aug 27 02:57:35 2022] DELETE /compute/v2.1/os-volumes/d10772fc-f691-4890-ace8-8ba362b7851b => generated 109 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:57:35.779732 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a2015cb8-da2e-44b3-99c3-f399045464f0 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Calling method '.version_select at 0x7f5ede9949d0>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:36.253838 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-3256c192-5f04-46e6-ae65-519344f81389 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Flavor limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:57:36.254450 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-3256c192-5f04-46e6-ae65-519344f81389 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Image limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:57:36.255473 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-3256c192-5f04-46e6-ae65-519344f81389 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Flavor pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:57:36.256361 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-3256c192-5f04-46e6-ae65-519344f81389 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Image pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:57:36.257131 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-3256c192-5f04-46e6-ae65-519344f81389 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:57:36.261341 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a2015cb8-da2e-44b3-99c3-f399045464f0 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/d8813fb6-b445-4b49-9940-9ed5250cecaf" status: 202 len: 0 microversion: 2.1 time: 0.485644 Aug 27 02:57:36.262839 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1748/3511] 10.222.0.70 () {58 vars in 1272 bytes} [Sat Aug 27 02:57:35 2022] DELETE /compute/v2.1/os-security-groups/d8813fb6-b445-4b49-9940-9ed5250cecaf => generated 0 bytes in 488 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:57:36.269364 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-1aa13e74-af98-499e-a14c-c61a079e401d req-4e145335-96b2-4f5b-9f66-214b557f89dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fce0841b-76a8-496d-8fc0-69ad3fa9f7a6", "name": "network-vif-plugged", "status": "completed", "tag": "d0f2db9d-c256-452d-8d30-d74c91aaec32"}, {"server_uuid": "edb9e3a3-f71d-4a90-b617-167316a61e44", "name": "network-vif-plugged", "status": "completed", "tag": "ea2d074a-0c88-4878-943e-a739cc0ecf65"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:57:36.304522 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3256c192-5f04-46e6-ae65-519344f81389 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:36.310640 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-1aa13e74-af98-499e-a14c-c61a079e401d req-4e145335-96b2-4f5b-9f66-214b557f89dd service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:36.311124 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-1aa13e74-af98-499e-a14c-c61a079e401d req-4e145335-96b2-4f5b-9f66-214b557f89dd service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:36.311554 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-1aa13e74-af98-499e-a14c-c61a079e401d req-4e145335-96b2-4f5b-9f66-214b557f89dd service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:36.313027 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3256c192-5f04-46e6-ae65-519344f81389 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:36.313538 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3256c192-5f04-46e6-ae65-519344f81389 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:36.314338 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3256c192-5f04-46e6-ae65-519344f81389 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:36.314798 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3256c192-5f04-46e6-ae65-519344f81389 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:36.315223 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3256c192-5f04-46e6-ae65-519344f81389 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:36.337352 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-3256c192-5f04-46e6-ae65-519344f81389 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Getting quotas for project 952767db5f394fc4bf01c0efd65f2fb9. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:57:36.338854 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-1aa13e74-af98-499e-a14c-c61a079e401d req-4e145335-96b2-4f5b-9f66-214b557f89dd service nova] Creating event network-vif-plugged:d0f2db9d-c256-452d-8d30-d74c91aaec32 for instance fce0841b-76a8-496d-8fc0-69ad3fa9f7a6 on n-h1-852278-4 Aug 27 02:57:36.339466 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-1aa13e74-af98-499e-a14c-c61a079e401d req-4e145335-96b2-4f5b-9f66-214b557f89dd service nova] Creating event network-vif-plugged:ea2d074a-0c88-4878-943e-a739cc0ecf65 for instance edb9e3a3-f71d-4a90-b617-167316a61e44 on n-h2-852278-4 Aug 27 02:57:36.343655 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-3256c192-5f04-46e6-ae65-519344f81389 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Getting quotas for user c850bda78e664117b671910c0e68bfb9 and project 952767db5f394fc4bf01c0efd65f2fb9. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:57:36.355547 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-1aa13e74-af98-499e-a14c-c61a079e401d req-4e145335-96b2-4f5b-9f66-214b557f89dd service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.089432 Aug 27 02:57:36.359632 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-3256c192-5f04-46e6-ae65-519344f81389 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Going to run 1 instances... {{(pid=134052) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:57:36.361358 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1749/3512] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:57:36 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:57:36.363110 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-3256c192-5f04-46e6-ae65-519344f81389 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 93c96362-cc02-493d-a96b-ca19cf3a4e47] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134052) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:57:36.369297 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b06f0b06-e6a2-4bd1-a51a-d3974dbeb227 tempest-VolumesSnapshotsTestJSON-1454701903 tempest-VolumesSnapshotsTestJSON-1454701903-project] Calling method '.version_select at 0x7f5ede9335e0>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:36.419728 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-b06f0b06-e6a2-4bd1-a51a-d3974dbeb227 tempest-VolumesSnapshotsTestJSON-1454701903 tempest-VolumesSnapshotsTestJSON-1454701903-project] HTTP exception thrown: Volume d10772fc-f691-4890-ace8-8ba362b7851b could not be found. Aug 27 02:57:36.422127 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b06f0b06-e6a2-4bd1-a51a-d3974dbeb227 tempest-VolumesSnapshotsTestJSON-1454701903 tempest-VolumesSnapshotsTestJSON-1454701903-project] Request method failure captured: Aug 27 02:57:36.422127 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/os-volumes/d10772fc-f691-4890-ace8-8ba362b7851b HTTP/1.1 Aug 27 02:57:36.422127 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:57:36.422127 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:57:36.422127 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:57:36.422127 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:57:36.422127 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:57:36.422127 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:57:36.422127 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:57:36.422127 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:57:36.422127 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYgR_7W79kzstWeEBb0_3-KtxzIuBeq6YpAK5Ef6ZmBVWXyUrzb00i1-rNRLZ1vqwBIiB6a0y4c85fNJoY9dcdA2l4GEidrf4QtOk5EqF_8drcvJy0BLZ3K4mq7qHLGoHAJGBpAWabcAmtMzRd9FL4G1RE52Ti9-mvyv-GHdGcXWQ-k Aug 27 02:57:36.422127 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:57:36.422127 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:57:36.422127 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:57:36.422127 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:57:36.422127 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:57:36.422127 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:57:36.422127 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 6a50fe5379b348cfab491fafb32842e2 Aug 27 02:57:36.422127 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1454701903 Aug 27 02:57:36.422127 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:57:36.422127 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:57:36.422127 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6a50fe5379b348cfab491fafb32842e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_6a50fe5379b348cfab491fafb32842e2", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6a50fe5379b348cfab491fafb32842e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/6a50fe5379b348cfab491fafb32842e2"}]}] Aug 27 02:57:36.422127 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1454701903 Aug 27 02:57:36.422127 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 6a50fe5379b348cfab491fafb32842e2 Aug 27 02:57:36.422127 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1454701903 Aug 27 02:57:36.422127 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-VolumesSnapshotsTestJSON-1454701903-project Aug 27 02:57:36.422127 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:57:36.422127 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:57:36.422127 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: bf4b0543e5924af8876124daebad0de7 Aug 27 02:57:36.422127 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1454701903-project Aug 27 02:57:36.422127 n-d-852278-4 devstack@n-api.service[134051]: method: Aug 27 02:57:36.422127 n-d-852278-4 devstack@n-api.service[134051]: exception: Volume d10772fc-f691-4890-ace8-8ba362b7851b could not be found. Aug 27 02:57:36.422127 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': 'd10772fc-f691-4890-ace8-8ba362b7851b'} Aug 27 02:57:36.422127 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:57:36.422127 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:57:36.422127 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 02:57:36.422127 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 02:57:36.422127 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 27 02:57:36.422127 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 27 02:57:36.422127 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 27 02:57:36.422127 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 27 02:57:36.422127 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 27 02:57:36.422127 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 27 02:57:36.422127 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 27 02:57:36.422127 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 27 02:57:36.422127 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 02:57:36.422127 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 02:57:36.422127 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 02:57:36.422127 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 02:57:36.422127 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d10772fc-f691-4890-ace8-8ba362b7851b could not be found. (HTTP 404) (Request-ID: req-ca5d8ff6-8cab-4894-8b92-ddaacf993cbf) Aug 27 02:57:36.422127 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:57:36.422127 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:57:36.422127 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:57:36.422127 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:57:36.422127 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 27 02:57:36.422127 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 27 02:57:36.422127 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 27 02:57:36.422127 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 27 02:57:36.422127 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 27 02:57:36.422127 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 27 02:57:36.422127 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 27 02:57:36.422127 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 27 02:57:36.422127 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 02:57:36.425801 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 02:57:36.425801 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 27 02:57:36.425801 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 27 02:57:36.425801 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 27 02:57:36.425801 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 27 02:57:36.425801 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 27 02:57:36.425801 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 27 02:57:36.425801 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 27 02:57:36.425801 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 27 02:57:36.425801 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 02:57:36.425801 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 02:57:36.425801 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 02:57:36.425801 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 02:57:36.425801 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d10772fc-f691-4890-ace8-8ba362b7851b could not be found. Aug 27 02:57:36.425801 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:57:36.425801 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:57:36.425801 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:57:36.425801 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:57:36.425801 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:57:36.425801 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:57:36.425801 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:57:36.425801 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:57:36.425801 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:57:36.425801 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:57:36.425801 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:57:36.425801 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:57:36.425801 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 27 02:57:36.425801 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:57:36.425801 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d10772fc-f691-4890-ace8-8ba362b7851b could not be found. Aug 27 02:57:36.425801 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:57:36.425801 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:57:36.425801 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:57:36.425801 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:57:36.425801 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:57:36.425801 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:57:36.425801 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:57:36.425801 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:57:36.425801 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d10772fc-f691-4890-ace8-8ba362b7851b could not be found. Aug 27 02:57:36.425801 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:57:36.429814 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b06f0b06-e6a2-4bd1-a51a-d3974dbeb227 tempest-VolumesSnapshotsTestJSON-1454701903 tempest-VolumesSnapshotsTestJSON-1454701903-project] Returning 404 to user: Volume d10772fc-f691-4890-ace8-8ba362b7851b could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:57:36.431176 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b06f0b06-e6a2-4bd1-a51a-d3974dbeb227 tempest-VolumesSnapshotsTestJSON-1454701903 tempest-VolumesSnapshotsTestJSON-1454701903-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/d10772fc-f691-4890-ace8-8ba362b7851b" status: 404 len: 109 microversion: 2.1 time: 0.067329 Aug 27 02:57:36.439955 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-3256c192-5f04-46e6-ae65-519344f81389 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.061869 Aug 27 02:57:36.447133 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1764/3513] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 02:57:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1070 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:57:36.449193 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1750/3514] 10.222.0.70 () {58 vars in 1245 bytes} [Sat Aug 27 02:57:36 2022] GET /compute/v2.1/os-volumes/d10772fc-f691-4890-ace8-8ba362b7851b => generated 109 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:57:36.454436 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-6fe4cad1-f5c0-42b6-ae7b-9b7d7a24fa62 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Calling method '.version_select at 0x7f5ee7202af0>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:36.454804 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-747700df-4fe5-45ff-b90e-8935787d166a tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:36.455724 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-747700df-4fe5-45ff-b90e-8935787d166a tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] [instance: f8532783-21d1-4910-91ef-223c2379fd43] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:36.462460 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:57:36.464498 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-747700df-4fe5-45ff-b90e-8935787d166a tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:36.465364 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-747700df-4fe5-45ff-b90e-8935787d166a tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:36.466052 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-747700df-4fe5-45ff-b90e-8935787d166a tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:36.467392 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-747700df-4fe5-45ff-b90e-8935787d166a tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:36.468033 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-747700df-4fe5-45ff-b90e-8935787d166a tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:36.468755 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-747700df-4fe5-45ff-b90e-8935787d166a tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:36.487816 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-747700df-4fe5-45ff-b90e-8935787d166a tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] HTTP exception thrown: Instance f8532783-21d1-4910-91ef-223c2379fd43 could not be found. Aug 27 02:57:36.490124 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-747700df-4fe5-45ff-b90e-8935787d166a tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Request method failure captured: Aug 27 02:57:36.490124 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/servers/f8532783-21d1-4910-91ef-223c2379fd43 HTTP/1.1 Aug 27 02:57:36.490124 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:57:36.490124 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:57:36.490124 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:57:36.490124 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:57:36.490124 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:57:36.490124 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:57:36.490124 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:57:36.490124 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:57:36.490124 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYgAmIk1qeYpDe_41_z3CLZpppvzBHusHoiO3Z8HClpUFMtvCvKic8M_cnZzfW5QblXU_8UABYPXhGVMepHxAyhBp5Z2Bt2jcxdeOpLImWsuhYujzsZ6T0zEt8xh5eYnLVzpcGvGO7qJhR2w5kCwXa7YEJHzv1eLGFaFumIs3YwVmdQ Aug 27 02:57:36.490124 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:57:36.490124 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:57:36.490124 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:57:36.490124 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:57:36.490124 n-d-852278-4 devstack@n-api.service[134052]: X-Openstack-Nova-Api-Version: 2.26 Aug 27 02:57:36.490124 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:57:36.490124 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:57:36.490124 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 10678bb6b93c4dc59f76e689f5b20ff9 Aug 27 02:57:36.490124 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ServerTagsTestJSON-1179037858 Aug 27 02:57:36.490124 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:57:36.490124 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:57:36.490124 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/10678bb6b93c4dc59f76e689f5b20ff9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_10678bb6b93c4dc59f76e689f5b20ff9", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/10678bb6b93c4dc59f76e689f5b20ff9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/10678bb6b93c4dc59f76e689f5b20ff9"}]}] Aug 27 02:57:36.490124 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ServerTagsTestJSON-1179037858 Aug 27 02:57:36.490124 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 10678bb6b93c4dc59f76e689f5b20ff9 Aug 27 02:57:36.490124 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ServerTagsTestJSON-1179037858 Aug 27 02:57:36.490124 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ServerTagsTestJSON-1179037858-project Aug 27 02:57:36.490124 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:57:36.490124 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:57:36.490124 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: c07e9c0615234db297022024208e8e2b Aug 27 02:57:36.490124 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ServerTagsTestJSON-1179037858-project Aug 27 02:57:36.490124 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 02:57:36.490124 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance f8532783-21d1-4910-91ef-223c2379fd43 could not be found. Aug 27 02:57:36.490124 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': 'f8532783-21d1-4910-91ef-223c2379fd43'} Aug 27 02:57:36.490124 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:57:36.490124 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:57:36.490124 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:57:36.490124 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:57:36.490124 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:57:36.490124 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:57:36.490124 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:57:36.490124 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:57:36.490124 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:57:36.490124 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:57:36.490124 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8532783-21d1-4910-91ef-223c2379fd43 could not be found. Aug 27 02:57:36.490124 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:57:36.490124 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:57:36.490124 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:57:36.490124 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:57:36.490124 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:57:36.490124 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:57:36.490124 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:57:36.490124 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:57:36.490124 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:57:36.490124 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:57:36.490124 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:57:36.490124 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:57:36.490124 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:57:36.490124 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:57:36.490124 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:57:36.490124 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:57:36.490124 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8532783-21d1-4910-91ef-223c2379fd43 could not be found. Aug 27 02:57:36.490124 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:57:36.490124 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:57:36.490124 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:57:36.493534 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:57:36.493534 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:57:36.493534 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:57:36.493534 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:57:36.493534 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:57:36.493534 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8532783-21d1-4910-91ef-223c2379fd43 could not be found. Aug 27 02:57:36.493534 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:57:36.493534 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-747700df-4fe5-45ff-b90e-8935787d166a tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] Returning 404 to user: Instance f8532783-21d1-4910-91ef-223c2379fd43 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:57:36.493534 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-747700df-4fe5-45ff-b90e-8935787d166a tempest-ServerTagsTestJSON-1179037858 tempest-ServerTagsTestJSON-1179037858-project] 10.222.0.70 "GET /compute/v2.1/servers/f8532783-21d1-4910-91ef-223c2379fd43" status: 404 len: 111 microversion: 2.26 time: 0.043044 Aug 27 02:57:36.495863 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1765/3515] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:57:36 2022] GET /compute/v2.1/servers/f8532783-21d1-4910-91ef-223c2379fd43 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 02:57:36.501495 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f31ac41c-c472-494c-8937-1301aa15b31b tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:36.502377 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-f31ac41c-c472-494c-8937-1301aa15b31b tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] [instance: edb9e3a3-f71d-4a90-b617-167316a61e44] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:36.511242 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f31ac41c-c472-494c-8937-1301aa15b31b tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:36.511775 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f31ac41c-c472-494c-8937-1301aa15b31b tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:36.512202 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f31ac41c-c472-494c-8937-1301aa15b31b tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:36.518521 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f31ac41c-c472-494c-8937-1301aa15b31b tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:36.519241 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f31ac41c-c472-494c-8937-1301aa15b31b tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:36.520517 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f31ac41c-c472-494c-8937-1301aa15b31b tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:36.629333 n-d-852278-4 devstack@n-api.service[134051]: DEBUG neutronclient.v2_0.client [None req-6fe4cad1-f5c0-42b6-ae7b-9b7d7a24fa62 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d8813fb6-b445-4b49-9940-9ed5250cecaf does not exist", "detail": ""}} {{(pid=134051) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 02:57:36.630417 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.network.security_group_api [None req-6fe4cad1-f5c0-42b6-ae7b-9b7d7a24fa62 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Neutron security group d8813fb6-b445-4b49-9940-9ed5250cecaf not found {{(pid=134051) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 27 02:57:36.631199 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-6fe4cad1-f5c0-42b6-ae7b-9b7d7a24fa62 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] HTTP exception thrown: Security group d8813fb6-b445-4b49-9940-9ed5250cecaf does not exist Aug 27 02:57:36.631199 n-d-852278-4 devstack@n-api.service[134051]: Neutron server returns request_ids: ['req-b08a407a-d32c-47e1-b667-b9b86d6fdb04'] Aug 27 02:57:36.643893 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-6fe4cad1-f5c0-42b6-ae7b-9b7d7a24fa62 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Request method failure captured: Aug 27 02:57:36.643893 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/os-security-groups/d8813fb6-b445-4b49-9940-9ed5250cecaf HTTP/1.1 Aug 27 02:57:36.643893 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:57:36.643893 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:57:36.643893 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:57:36.643893 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:57:36.643893 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:57:36.643893 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:57:36.643893 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:57:36.643893 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:57:36.643893 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYf2b88jccGp908k3vQwdmk8aWVpZgx4XAwdI__tT5JQ00leavue9yGRA0Ra6tx0k8LuwOwvFz5QHaUm9YwpVl7ey0u_0fYkHaP7j9Kliw_5Q5Xf4F9k_115SseZDZeFd_ncRBfnV98omKQ5oUaf4zu042RXCwV00aKzeJyDrzb4sII Aug 27 02:57:36.643893 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:57:36.643893 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:57:36.643893 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:57:36.643893 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:57:36.643893 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:57:36.643893 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:57:36.643893 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 2a6a888c878245cb9e5909e071c9b9c2 Aug 27 02:57:36.643893 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-SecurityGroupsTestJSON-23859158 Aug 27 02:57:36.643893 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:57:36.643893 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:57:36.643893 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2a6a888c878245cb9e5909e071c9b9c2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_2a6a888c878245cb9e5909e071c9b9c2", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2a6a888c878245cb9e5909e071c9b9c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/2a6a888c878245cb9e5909e071c9b9c2"}]}] Aug 27 02:57:36.643893 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-SecurityGroupsTestJSON-23859158 Aug 27 02:57:36.643893 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 2a6a888c878245cb9e5909e071c9b9c2 Aug 27 02:57:36.643893 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-23859158 Aug 27 02:57:36.643893 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-SecurityGroupsTestJSON-23859158-project Aug 27 02:57:36.643893 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:57:36.643893 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:57:36.643893 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: ef6381ae230a45de8b105374c2d25383 Aug 27 02:57:36.643893 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-SecurityGroupsTestJSON-23859158-project Aug 27 02:57:36.643893 n-d-852278-4 devstack@n-api.service[134051]: method: Aug 27 02:57:36.643893 n-d-852278-4 devstack@n-api.service[134051]: exception: Security group d8813fb6-b445-4b49-9940-9ed5250cecaf does not exist Aug 27 02:57:36.643893 n-d-852278-4 devstack@n-api.service[134051]: Neutron server returns request_ids: ['req-b08a407a-d32c-47e1-b667-b9b86d6fdb04'] Aug 27 02:57:36.643893 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': 'd8813fb6-b445-4b49-9940-9ed5250cecaf'} Aug 27 02:57:36.643893 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:57:36.643893 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:57:36.643893 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 27 02:57:36.643893 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 27 02:57:36.643893 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:57:36.643893 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:57:36.643893 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 27 02:57:36.643893 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 27 02:57:36.643893 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:57:36.643893 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:57:36.643893 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 02:57:36.643893 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 02:57:36.643893 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:57:36.643893 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:57:36.643893 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 02:57:36.643893 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 02:57:36.643893 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:57:36.643893 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:57:36.643893 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 02:57:36.643893 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 02:57:36.643893 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:57:36.643893 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:57:36.643893 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 02:57:36.643893 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 02:57:36.643893 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 02:57:36.643893 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 02:57:36.643893 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d8813fb6-b445-4b49-9940-9ed5250cecaf does not exist Aug 27 02:57:36.647146 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b08a407a-d32c-47e1-b667-b9b86d6fdb04'] Aug 27 02:57:36.647146 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:57:36.647146 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:57:36.647146 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:57:36.647146 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:57:36.647146 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 27 02:57:36.647146 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 27 02:57:36.647146 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 27 02:57:36.647146 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 27 02:57:36.647146 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d8813fb6-b445-4b49-9940-9ed5250cecaf does not exist Aug 27 02:57:36.647146 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b08a407a-d32c-47e1-b667-b9b86d6fdb04'] Aug 27 02:57:36.647146 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:57:36.647146 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:57:36.647146 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:57:36.647146 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:57:36.647146 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:57:36.647146 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:57:36.647146 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:57:36.647146 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:57:36.647146 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:57:36.647146 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:57:36.647146 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:57:36.647146 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:57:36.647146 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 27 02:57:36.647146 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 27 02:57:36.647146 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d8813fb6-b445-4b49-9940-9ed5250cecaf does not exist Aug 27 02:57:36.647146 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b08a407a-d32c-47e1-b667-b9b86d6fdb04'] Aug 27 02:57:36.647146 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:57:36.647146 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:57:36.647146 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:57:36.647146 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:57:36.647146 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:57:36.647146 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:57:36.647146 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:57:36.647146 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:57:36.647146 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d8813fb6-b445-4b49-9940-9ed5250cecaf does not exist Aug 27 02:57:36.647146 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b08a407a-d32c-47e1-b667-b9b86d6fdb04'] Aug 27 02:57:36.647146 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:57:36.650133 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-6fe4cad1-f5c0-42b6-ae7b-9b7d7a24fa62 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Returning 404 to user: Security group d8813fb6-b445-4b49-9940-9ed5250cecaf does not exist Aug 27 02:57:36.650133 n-d-852278-4 devstack@n-api.service[134051]: Neutron server returns request_ids: ['req-b08a407a-d32c-47e1-b667-b9b86d6fdb04'] {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:57:36.651016 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-6fe4cad1-f5c0-42b6-ae7b-9b7d7a24fa62 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] 10.222.0.70 "GET /compute/v2.1/os-security-groups/d8813fb6-b445-4b49-9940-9ed5250cecaf" status: 404 len: 194 microversion: 2.1 time: 0.200504 Aug 27 02:57:36.651594 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1751/3516] 10.222.0.70 () {58 vars in 1269 bytes} [Sat Aug 27 02:57:36 2022] GET /compute/v2.1/os-security-groups/d8813fb6-b445-4b49-9940-9ed5250cecaf => generated 194 bytes in 202 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:57:36.668628 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-402cdb0e-f9cd-4630-80d1-220c79c79042 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:36.669689 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-402cdb0e-f9cd-4630-80d1-220c79c79042 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 93c96362-cc02-493d-a96b-ca19cf3a4e47] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:36.807329 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-402cdb0e-f9cd-4630-80d1-220c79c79042 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:36.815378 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-402cdb0e-f9cd-4630-80d1-220c79c79042 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/93c96362-cc02-493d-a96b-ca19cf3a4e47" status: 200 len: 1215 microversion: 2.1 time: 0.162526 Aug 27 02:57:36.818172 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1752/3517] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:57:36 2022] GET /compute/v2.1/servers/93c96362-cc02-493d-a96b-ca19cf3a4e47 => generated 1215 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:57:36.825711 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-aba781ff-6a1f-4993-9331-36800f2a39e9 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Calling method '.version_select at 0x7f5ee7269160>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:37.002840 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-f31ac41c-c472-494c-8937-1301aa15b31b tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b217f9cbc204919ba77d885315907c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2448b78114c54dd39bc85538fb973dd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:37.010887 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f31ac41c-c472-494c-8937-1301aa15b31b tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] 10.222.0.70 "GET /compute/v2.1/servers/edb9e3a3-f71d-4a90-b617-167316a61e44" status: 200 len: 1321 microversion: 2.1 time: 0.513643 Aug 27 02:57:37.011695 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1766/3518] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:57:36 2022] GET /compute/v2.1/servers/edb9e3a3-f71d-4a90-b617-167316a61e44 => generated 1321 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:57:37.189771 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-aba781ff-6a1f-4993-9331-36800f2a39e9 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] 10.222.0.70 "GET /compute/v2.1/os-security-groups" status: 200 len: 1156 microversion: 2.1 time: 0.370391 Aug 27 02:57:37.190456 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1753/3519] 10.222.0.70 () {58 vars in 1158 bytes} [Sat Aug 27 02:57:36 2022] GET /compute/v2.1/os-security-groups => generated 1156 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:57:37.213188 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4fc96e6d-f0f1-4d8a-8e17-24c00952f442 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Action: 'create', calling method: .version_select at 0x7f5ee3828d30>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2081015763", "description": "tempest-description-504632356"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:57:37.409395 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-4fc96e6d-f0f1-4d8a-8e17-24c00952f442 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] 10.222.0.70 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.200995 Aug 27 02:57:37.410858 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1767/3520] 10.222.0.70 () {60 vars in 1180 bytes} [Sat Aug 27 02:57:37 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:57:37.422891 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f79eaa16-a740-400e-9133-80a6acf9e95f tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Action: 'create', calling method: .version_select at 0x7f5ede8e9a60>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-727974237", "description": "tempest-description-1454683274"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:57:37.595018 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-f79eaa16-a740-400e-9133-80a6acf9e95f tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] 10.222.0.70 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.175852 Aug 27 02:57:37.595644 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1754/3521] 10.222.0.70 () {60 vars in 1180 bytes} [Sat Aug 27 02:57:37 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:57:37.743578 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ec3a9e4e-1414-4383-bf2b-5745e11e3132 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1865576971", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "networks": [{"uuid": "53b4444b-c159-4662-80fb-650a74ad037c"}]}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:57:37.839723 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e0d52cc1-6398-4859-9d14-40ba82aef2a2 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:37.842513 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-e0d52cc1-6398-4859-9d14-40ba82aef2a2 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 93c96362-cc02-493d-a96b-ca19cf3a4e47] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:37.845760 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.network.neutron [None req-ec3a9e4e-1414-4383-bf2b-5745e11e3132 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] validate_networks() for [('53b4444b-c159-4662-80fb-650a74ad037c', None, None, None, None, None)] {{(pid=134052) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:57:37.849355 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e0d52cc1-6398-4859-9d14-40ba82aef2a2 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:37.849984 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e0d52cc1-6398-4859-9d14-40ba82aef2a2 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:37.850519 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e0d52cc1-6398-4859-9d14-40ba82aef2a2 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:37.851350 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e0d52cc1-6398-4859-9d14-40ba82aef2a2 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:37.852079 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e0d52cc1-6398-4859-9d14-40ba82aef2a2 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:37.852923 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e0d52cc1-6398-4859-9d14-40ba82aef2a2 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:38.056913 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e0d52cc1-6398-4859-9d14-40ba82aef2a2 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:38.071305 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e0d52cc1-6398-4859-9d14-40ba82aef2a2 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/93c96362-cc02-493d-a96b-ca19cf3a4e47" status: 200 len: 1211 microversion: 2.1 time: 0.236650 Aug 27 02:57:38.088932 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1755/3522] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:57:37 2022] GET /compute/v2.1/servers/93c96362-cc02-493d-a96b-ca19cf3a4e47 => generated 1211 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:57:38.102414 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-eb765dbb-33e3-4cc5-8522-ac37f50a9945 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:38.103777 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-eb765dbb-33e3-4cc5-8522-ac37f50a9945 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] [instance: edb9e3a3-f71d-4a90-b617-167316a61e44] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:38.114287 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eb765dbb-33e3-4cc5-8522-ac37f50a9945 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:38.115117 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eb765dbb-33e3-4cc5-8522-ac37f50a9945 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:38.116210 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eb765dbb-33e3-4cc5-8522-ac37f50a9945 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:38.117138 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eb765dbb-33e3-4cc5-8522-ac37f50a9945 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:38.117856 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eb765dbb-33e3-4cc5-8522-ac37f50a9945 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:38.118529 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eb765dbb-33e3-4cc5-8522-ac37f50a9945 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:38.501626 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-eb765dbb-33e3-4cc5-8522-ac37f50a9945 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b217f9cbc204919ba77d885315907c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2448b78114c54dd39bc85538fb973dd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:38.515393 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-eb765dbb-33e3-4cc5-8522-ac37f50a9945 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] 10.222.0.70 "GET /compute/v2.1/servers/edb9e3a3-f71d-4a90-b617-167316a61e44" status: 200 len: 1321 microversion: 2.1 time: 0.424531 Aug 27 02:57:38.541049 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1756/3523] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:57:38 2022] GET /compute/v2.1/servers/edb9e3a3-f71d-4a90-b617-167316a61e44 => generated 1321 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:57:38.706018 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-ec3a9e4e-1414-4383-bf2b-5745e11e3132 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Flavor limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:57:38.706925 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-ec3a9e4e-1414-4383-bf2b-5745e11e3132 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Image limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:57:38.707593 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-ec3a9e4e-1414-4383-bf2b-5745e11e3132 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Flavor pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:57:38.708062 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-ec3a9e4e-1414-4383-bf2b-5745e11e3132 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Image pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:57:38.708508 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-ec3a9e4e-1414-4383-bf2b-5745e11e3132 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:57:38.727979 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ec3a9e4e-1414-4383-bf2b-5745e11e3132 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:38.728500 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ec3a9e4e-1414-4383-bf2b-5745e11e3132 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:38.728933 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ec3a9e4e-1414-4383-bf2b-5745e11e3132 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:38.731837 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ec3a9e4e-1414-4383-bf2b-5745e11e3132 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:38.732713 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ec3a9e4e-1414-4383-bf2b-5745e11e3132 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:38.734716 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ec3a9e4e-1414-4383-bf2b-5745e11e3132 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:38.798832 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-ec3a9e4e-1414-4383-bf2b-5745e11e3132 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Getting quotas for project 2a6a888c878245cb9e5909e071c9b9c2. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:57:38.815625 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-ec3a9e4e-1414-4383-bf2b-5745e11e3132 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Getting quotas for user ef6381ae230a45de8b105374c2d25383 and project 2a6a888c878245cb9e5909e071c9b9c2. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:57:38.832967 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-ec3a9e4e-1414-4383-bf2b-5745e11e3132 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Going to run 1 instances... {{(pid=134052) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:57:38.835400 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-ec3a9e4e-1414-4383-bf2b-5745e11e3132 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] [instance: 54682cce-6601-49d1-88f7-1c9fcaf7d370] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134052) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:57:38.897666 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ec3a9e4e-1414-4383-bf2b-5745e11e3132 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.163197 Aug 27 02:57:38.898529 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1768/3524] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 02:57:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1165 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:57:38.914542 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8f7db300-5b25-4dcb-a25b-a7e789a638dd tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:38.916592 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-8f7db300-5b25-4dcb-a25b-a7e789a638dd tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] [instance: 54682cce-6601-49d1-88f7-1c9fcaf7d370] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:39.098174 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c2a09cfb-8658-4c42-ad0f-3b2ca59ae548 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:39.098802 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-c2a09cfb-8658-4c42-ad0f-3b2ca59ae548 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 93c96362-cc02-493d-a96b-ca19cf3a4e47] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:39.114910 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c2a09cfb-8658-4c42-ad0f-3b2ca59ae548 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:39.115645 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c2a09cfb-8658-4c42-ad0f-3b2ca59ae548 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:39.116222 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c2a09cfb-8658-4c42-ad0f-3b2ca59ae548 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:39.117006 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c2a09cfb-8658-4c42-ad0f-3b2ca59ae548 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:39.117432 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c2a09cfb-8658-4c42-ad0f-3b2ca59ae548 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:39.117924 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c2a09cfb-8658-4c42-ad0f-3b2ca59ae548 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:39.706850 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-8f7db300-5b25-4dcb-a25b-a7e789a638dd tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6381ae230a45de8b105374c2d25383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a6a888c878245cb9e5909e071c9b9c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:39.719894 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-8f7db300-5b25-4dcb-a25b-a7e789a638dd tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] 10.222.0.70 "GET /compute/v2.1/servers/54682cce-6601-49d1-88f7-1c9fcaf7d370" status: 200 len: 1216 microversion: 2.1 time: 0.809549 Aug 27 02:57:39.726946 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1757/3525] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:57:38 2022] GET /compute/v2.1/servers/54682cce-6601-49d1-88f7-1c9fcaf7d370 => generated 1216 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:57:39.731589 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-c2a09cfb-8658-4c42-ad0f-3b2ca59ae548 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:39.741066 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c2a09cfb-8658-4c42-ad0f-3b2ca59ae548 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/93c96362-cc02-493d-a96b-ca19cf3a4e47" status: 200 len: 1273 microversion: 2.1 time: 0.651270 Aug 27 02:57:39.750807 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b39475eb-6e32-420a-9edf-f37c86956623 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:39.751957 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b39475eb-6e32-420a-9edf-f37c86956623 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] [instance: edb9e3a3-f71d-4a90-b617-167316a61e44] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:39.762883 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b39475eb-6e32-420a-9edf-f37c86956623 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:39.764234 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b39475eb-6e32-420a-9edf-f37c86956623 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:39.767536 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b39475eb-6e32-420a-9edf-f37c86956623 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:39.768941 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1769/3526] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:57:39 2022] GET /compute/v2.1/servers/93c96362-cc02-493d-a96b-ca19cf3a4e47 => generated 1273 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:57:39.771602 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b39475eb-6e32-420a-9edf-f37c86956623 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:39.776643 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b39475eb-6e32-420a-9edf-f37c86956623 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:39.790881 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b39475eb-6e32-420a-9edf-f37c86956623 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:40.188590 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-b39475eb-6e32-420a-9edf-f37c86956623 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b217f9cbc204919ba77d885315907c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2448b78114c54dd39bc85538fb973dd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:40.205081 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b39475eb-6e32-420a-9edf-f37c86956623 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] 10.222.0.70 "GET /compute/v2.1/servers/edb9e3a3-f71d-4a90-b617-167316a61e44" status: 200 len: 1512 microversion: 2.1 time: 0.473297 Aug 27 02:57:40.225602 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1758/3527] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:57:39 2022] GET /compute/v2.1/servers/edb9e3a3-f71d-4a90-b617-167316a61e44 => generated 1512 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:57:40.230784 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-35e95647-3762-46d6-946b-58532c7526d0 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:40.231406 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-35e95647-3762-46d6-946b-58532c7526d0 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] [instance: 02eba429-ecb3-4a5c-87ea-c049ad7aca1a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:40.256388 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-35e95647-3762-46d6-946b-58532c7526d0 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:40.256890 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-35e95647-3762-46d6-946b-58532c7526d0 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:40.257330 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-35e95647-3762-46d6-946b-58532c7526d0 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:40.258072 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-35e95647-3762-46d6-946b-58532c7526d0 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:40.258598 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-35e95647-3762-46d6-946b-58532c7526d0 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:40.259174 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-35e95647-3762-46d6-946b-58532c7526d0 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:40.602861 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-35e95647-3762-46d6-946b-58532c7526d0 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b217f9cbc204919ba77d885315907c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2448b78114c54dd39bc85538fb973dd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:40.613176 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-35e95647-3762-46d6-946b-58532c7526d0 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] 10.222.0.70 "GET /compute/v2.1/servers/02eba429-ecb3-4a5c-87ea-c049ad7aca1a" status: 200 len: 1511 microversion: 2.1 time: 0.386441 Aug 27 02:57:40.620659 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1770/3528] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:57:40 2022] GET /compute/v2.1/servers/02eba429-ecb3-4a5c-87ea-c049ad7aca1a => generated 1511 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:57:40.645362 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3dfb485d-a80c-4fae-8b38-332ded9a4072 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:40.645975 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-3dfb485d-a80c-4fae-8b38-332ded9a4072 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] [instance: fce0841b-76a8-496d-8fc0-69ad3fa9f7a6] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:40.656038 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=96 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:57:40.664127 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3dfb485d-a80c-4fae-8b38-332ded9a4072 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:40.665684 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3dfb485d-a80c-4fae-8b38-332ded9a4072 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:40.666136 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3dfb485d-a80c-4fae-8b38-332ded9a4072 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:40.673401 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3dfb485d-a80c-4fae-8b38-332ded9a4072 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:40.673876 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3dfb485d-a80c-4fae-8b38-332ded9a4072 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:40.674320 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3dfb485d-a80c-4fae-8b38-332ded9a4072 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:40.747113 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3ec0944a-6d7d-4940-bfa5-fb30e0e2ed95 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:40.748265 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-3ec0944a-6d7d-4940-bfa5-fb30e0e2ed95 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] [instance: 54682cce-6601-49d1-88f7-1c9fcaf7d370] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:40.763486 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3ec0944a-6d7d-4940-bfa5-fb30e0e2ed95 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:40.764370 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3ec0944a-6d7d-4940-bfa5-fb30e0e2ed95 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:40.765756 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3ec0944a-6d7d-4940-bfa5-fb30e0e2ed95 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:40.766622 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3ec0944a-6d7d-4940-bfa5-fb30e0e2ed95 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:40.770340 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3ec0944a-6d7d-4940-bfa5-fb30e0e2ed95 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:40.771235 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3ec0944a-6d7d-4940-bfa5-fb30e0e2ed95 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:41.058280 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-3dfb485d-a80c-4fae-8b38-332ded9a4072 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b217f9cbc204919ba77d885315907c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2448b78114c54dd39bc85538fb973dd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:41.078659 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-3dfb485d-a80c-4fae-8b38-332ded9a4072 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] 10.222.0.70 "GET /compute/v2.1/servers/fce0841b-76a8-496d-8fc0-69ad3fa9f7a6" status: 200 len: 1511 microversion: 2.1 time: 0.437278 Aug 27 02:57:41.082457 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1759/3529] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:57:40 2022] GET /compute/v2.1/servers/fce0841b-76a8-496d-8fc0-69ad3fa9f7a6 => generated 1511 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:57:41.105054 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-55adefb5-652e-40e6-999d-ca6c29d62a14 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:41.106108 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-55adefb5-652e-40e6-999d-ca6c29d62a14 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 93c96362-cc02-493d-a96b-ca19cf3a4e47] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:41.131163 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-55adefb5-652e-40e6-999d-ca6c29d62a14 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:41.140274 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-55adefb5-652e-40e6-999d-ca6c29d62a14 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:41.143706 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-55adefb5-652e-40e6-999d-ca6c29d62a14 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:41.146089 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-55adefb5-652e-40e6-999d-ca6c29d62a14 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:41.147156 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-55adefb5-652e-40e6-999d-ca6c29d62a14 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:41.152150 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-55adefb5-652e-40e6-999d-ca6c29d62a14 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:41.220381 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-3ec0944a-6d7d-4940-bfa5-fb30e0e2ed95 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6381ae230a45de8b105374c2d25383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a6a888c878245cb9e5909e071c9b9c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:41.235458 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-3ec0944a-6d7d-4940-bfa5-fb30e0e2ed95 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] 10.222.0.70 "GET /compute/v2.1/servers/54682cce-6601-49d1-88f7-1c9fcaf7d370" status: 200 len: 1268 microversion: 2.1 time: 0.493092 Aug 27 02:57:41.240493 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1771/3530] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:57:40 2022] GET /compute/v2.1/servers/54682cce-6601-49d1-88f7-1c9fcaf7d370 => generated 1268 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:57:41.255070 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-19444e68-0e9f-4184-897f-a409f79aace5 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:41.294245 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-19444e68-0e9f-4184-897f-a409f79aace5 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2b217f9cbc204919ba77d885315907c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2448b78114c54dd39bc85538fb973dd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:41.296266 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-19444e68-0e9f-4184-897f-a409f79aace5 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '2448b78114c54dd39bc85538fb973dd2'} {{(pid=134052) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 02:57:41.335364 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-19444e68-0e9f-4184-897f-a409f79aace5 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:41.336466 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-19444e68-0e9f-4184-897f-a409f79aace5 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:41.337114 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-19444e68-0e9f-4184-897f-a409f79aace5 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:41.339759 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-19444e68-0e9f-4184-897f-a409f79aace5 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:41.348052 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-19444e68-0e9f-4184-897f-a409f79aace5 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:41.348876 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-19444e68-0e9f-4184-897f-a409f79aace5 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:41.431153 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-55adefb5-652e-40e6-999d-ca6c29d62a14 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:41.443905 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-55adefb5-652e-40e6-999d-ca6c29d62a14 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/93c96362-cc02-493d-a96b-ca19cf3a4e47" status: 200 len: 1273 microversion: 2.1 time: 0.358412 Aug 27 02:57:41.446455 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1760/3531] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:57:41 2022] GET /compute/v2.1/servers/93c96362-cc02-493d-a96b-ca19cf3a4e47 => generated 1273 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:57:41.730488 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.multi_cell_list [None req-19444e68-0e9f-4184-897f-a409f79aace5 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=134052) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 02:57:41.876124 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-19444e68-0e9f-4184-897f-a409f79aace5 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b217f9cbc204919ba77d885315907c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2448b78114c54dd39bc85538fb973dd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:41.895051 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-19444e68-0e9f-4184-897f-a409f79aace5 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:41.899032 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-19444e68-0e9f-4184-897f-a409f79aace5 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:41.901467 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-19444e68-0e9f-4184-897f-a409f79aace5 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:42.265625 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a476fbd0-8978-4704-a94f-8eac81f8c0b1 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:42.266267 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-a476fbd0-8978-4704-a94f-8eac81f8c0b1 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] [instance: 54682cce-6601-49d1-88f7-1c9fcaf7d370] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:42.276243 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a476fbd0-8978-4704-a94f-8eac81f8c0b1 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:42.279419 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a476fbd0-8978-4704-a94f-8eac81f8c0b1 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:42.280765 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a476fbd0-8978-4704-a94f-8eac81f8c0b1 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:42.281553 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a476fbd0-8978-4704-a94f-8eac81f8c0b1 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:42.282025 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a476fbd0-8978-4704-a94f-8eac81f8c0b1 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:42.282462 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a476fbd0-8978-4704-a94f-8eac81f8c0b1 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:42.511094 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-a476fbd0-8978-4704-a94f-8eac81f8c0b1 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6381ae230a45de8b105374c2d25383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a6a888c878245cb9e5909e071c9b9c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:42.519731 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a476fbd0-8978-4704-a94f-8eac81f8c0b1 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] 10.222.0.70 "GET /compute/v2.1/servers/54682cce-6601-49d1-88f7-1c9fcaf7d370" status: 200 len: 1274 microversion: 2.1 time: 0.257804 Aug 27 02:57:42.538991 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1761/3532] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:57:42 2022] GET /compute/v2.1/servers/54682cce-6601-49d1-88f7-1c9fcaf7d370 => generated 1274 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:57:42.548109 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-87e58bd8-91f7-4cbe-940c-7d2259700a82 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:42.551728 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-87e58bd8-91f7-4cbe-940c-7d2259700a82 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 93c96362-cc02-493d-a96b-ca19cf3a4e47] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:42.562857 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-87e58bd8-91f7-4cbe-940c-7d2259700a82 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:42.563759 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-87e58bd8-91f7-4cbe-940c-7d2259700a82 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:42.564398 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-87e58bd8-91f7-4cbe-940c-7d2259700a82 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:42.565424 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-87e58bd8-91f7-4cbe-940c-7d2259700a82 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:42.566022 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-87e58bd8-91f7-4cbe-940c-7d2259700a82 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:42.566589 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-87e58bd8-91f7-4cbe-940c-7d2259700a82 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:43.074412 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-19444e68-0e9f-4184-897f-a409f79aace5 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] 10.222.0.70 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1515 microversion: 2.1 time: 1.832624 Aug 27 02:57:43.075321 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1772/3533] 10.222.0.70 () {58 vars in 1167 bytes} [Sat Aug 27 02:57:41 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1515 bytes in 1834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:57:43.099812 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-fad9d6dc-a3e6-419c-9c0c-5639cea1c47a tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:43.109793 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-fad9d6dc-a3e6-419c-9c0c-5639cea1c47a tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2b217f9cbc204919ba77d885315907c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2448b78114c54dd39bc85538fb973dd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:43.111921 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-fad9d6dc-a3e6-419c-9c0c-5639cea1c47a tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1118990088', 'deleted': False, 'project_id': '2448b78114c54dd39bc85538fb973dd2'} {{(pid=134052) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 02:57:43.123686 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fad9d6dc-a3e6-419c-9c0c-5639cea1c47a tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:43.124492 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fad9d6dc-a3e6-419c-9c0c-5639cea1c47a tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:43.125166 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fad9d6dc-a3e6-419c-9c0c-5639cea1c47a tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:43.126178 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fad9d6dc-a3e6-419c-9c0c-5639cea1c47a tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:43.126851 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fad9d6dc-a3e6-419c-9c0c-5639cea1c47a tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:43.127872 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fad9d6dc-a3e6-419c-9c0c-5639cea1c47a tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:43.230940 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-87e58bd8-91f7-4cbe-940c-7d2259700a82 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:43.249294 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-87e58bd8-91f7-4cbe-940c-7d2259700a82 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/93c96362-cc02-493d-a96b-ca19cf3a4e47" status: 200 len: 1315 microversion: 2.1 time: 0.699674 Aug 27 02:57:43.249958 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1762/3534] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:57:42 2022] GET /compute/v2.1/servers/93c96362-cc02-493d-a96b-ca19cf3a4e47 => generated 1315 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:57:43.292771 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.multi_cell_list [None req-fad9d6dc-a3e6-419c-9c0c-5639cea1c47a tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=134052) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 02:57:43.386451 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-fad9d6dc-a3e6-419c-9c0c-5639cea1c47a tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b217f9cbc204919ba77d885315907c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2448b78114c54dd39bc85538fb973dd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:43.394036 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fad9d6dc-a3e6-419c-9c0c-5639cea1c47a tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:43.396178 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fad9d6dc-a3e6-419c-9c0c-5639cea1c47a tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:43.396803 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fad9d6dc-a3e6-419c-9c0c-5639cea1c47a tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:43.561810 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3374cc93-576c-405e-afdc-5296a1ac12ad tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:43.566658 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-3374cc93-576c-405e-afdc-5296a1ac12ad tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] [instance: 54682cce-6601-49d1-88f7-1c9fcaf7d370] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:43.598130 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3374cc93-576c-405e-afdc-5296a1ac12ad tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:43.604010 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3374cc93-576c-405e-afdc-5296a1ac12ad tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:43.604501 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3374cc93-576c-405e-afdc-5296a1ac12ad tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:43.605417 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3374cc93-576c-405e-afdc-5296a1ac12ad tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:43.610124 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3374cc93-576c-405e-afdc-5296a1ac12ad tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:43.610962 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3374cc93-576c-405e-afdc-5296a1ac12ad tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:43.810014 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-3374cc93-576c-405e-afdc-5296a1ac12ad tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6381ae230a45de8b105374c2d25383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a6a888c878245cb9e5909e071c9b9c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:43.829048 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-3374cc93-576c-405e-afdc-5296a1ac12ad tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] 10.222.0.70 "GET /compute/v2.1/servers/54682cce-6601-49d1-88f7-1c9fcaf7d370" status: 200 len: 1274 microversion: 2.1 time: 0.287356 Aug 27 02:57:43.829890 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1763/3535] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:57:43 2022] GET /compute/v2.1/servers/54682cce-6601-49d1-88f7-1c9fcaf7d370 => generated 1274 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:57:44.147183 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-fad9d6dc-a3e6-419c-9c0c-5639cea1c47a tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] 10.222.0.70 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1118990088" status: 200 len: 1514 microversion: 2.1 time: 1.051445 Aug 27 02:57:44.148119 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1773/3536] 10.222.0.70 () {58 vars in 1263 bytes} [Sat Aug 27 02:57:43 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1118990088 => generated 1514 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:57:44.173176 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f3b38c0d-bc11-47b6-b92b-6525233006cf tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:44.178546 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-f3b38c0d-bc11-47b6-b92b-6525233006cf tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2b217f9cbc204919ba77d885315907c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2448b78114c54dd39bc85538fb973dd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:44.179374 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-f3b38c0d-bc11-47b6-b92b-6525233006cf tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '2448b78114c54dd39bc85538fb973dd2'} {{(pid=134051) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 02:57:44.185351 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f3b38c0d-bc11-47b6-b92b-6525233006cf tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:44.186047 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f3b38c0d-bc11-47b6-b92b-6525233006cf tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:44.186645 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f3b38c0d-bc11-47b6-b92b-6525233006cf tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:44.187491 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f3b38c0d-bc11-47b6-b92b-6525233006cf tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:44.188077 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f3b38c0d-bc11-47b6-b92b-6525233006cf tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:44.188656 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f3b38c0d-bc11-47b6-b92b-6525233006cf tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:44.270906 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e6b0cca7-f1c0-4e27-9319-b7aad6fb8e0f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:44.271762 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-e6b0cca7-f1c0-4e27-9319-b7aad6fb8e0f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 93c96362-cc02-493d-a96b-ca19cf3a4e47] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:44.278499 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e6b0cca7-f1c0-4e27-9319-b7aad6fb8e0f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:44.291053 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e6b0cca7-f1c0-4e27-9319-b7aad6fb8e0f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:44.291678 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e6b0cca7-f1c0-4e27-9319-b7aad6fb8e0f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:44.294765 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e6b0cca7-f1c0-4e27-9319-b7aad6fb8e0f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:44.299683 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e6b0cca7-f1c0-4e27-9319-b7aad6fb8e0f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:44.300978 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e6b0cca7-f1c0-4e27-9319-b7aad6fb8e0f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:44.370858 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.multi_cell_list [None req-f3b38c0d-bc11-47b6-b92b-6525233006cf tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=134051) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 02:57:44.378263 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=99,nova_cell1:DELETE=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:57:44.537458 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-f3b38c0d-bc11-47b6-b92b-6525233006cf tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b217f9cbc204919ba77d885315907c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2448b78114c54dd39bc85538fb973dd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:44.550354 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f3b38c0d-bc11-47b6-b92b-6525233006cf tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:44.551157 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f3b38c0d-bc11-47b6-b92b-6525233006cf tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:44.551855 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f3b38c0d-bc11-47b6-b92b-6525233006cf tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:44.801894 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-e6b0cca7-f1c0-4e27-9319-b7aad6fb8e0f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:44.816406 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e6b0cca7-f1c0-4e27-9319-b7aad6fb8e0f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/93c96362-cc02-493d-a96b-ca19cf3a4e47" status: 200 len: 1315 microversion: 2.1 time: 0.549797 Aug 27 02:57:44.836945 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1774/3537] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:57:44 2022] GET /compute/v2.1/servers/93c96362-cc02-493d-a96b-ca19cf3a4e47 => generated 1315 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:57:44.861091 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-bbd5dc7d-0b63-48a6-861a-930b0e2c47dc tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:44.866971 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-bbd5dc7d-0b63-48a6-861a-930b0e2c47dc tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] [instance: 54682cce-6601-49d1-88f7-1c9fcaf7d370] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:44.889872 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bbd5dc7d-0b63-48a6-861a-930b0e2c47dc tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:44.892678 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bbd5dc7d-0b63-48a6-861a-930b0e2c47dc tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:44.894945 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bbd5dc7d-0b63-48a6-861a-930b0e2c47dc tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:44.901755 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bbd5dc7d-0b63-48a6-861a-930b0e2c47dc tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:44.903027 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bbd5dc7d-0b63-48a6-861a-930b0e2c47dc tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:44.904944 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bbd5dc7d-0b63-48a6-861a-930b0e2c47dc tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:45.850636 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-f3b38c0d-bc11-47b6-b92b-6525233006cf tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] 10.222.0.70 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4517 microversion: 2.1 time: 1.682021 Aug 27 02:57:45.851498 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1764/3538] 10.222.0.70 () {58 vars in 1173 bytes} [Sat Aug 27 02:57:44 2022] GET /compute/v2.1/servers/detail?status=active => generated 4517 bytes in 1684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:57:45.876760 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4c7c119d-6750-4c0f-9140-971a3e4d86f4 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:45.877843 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-4c7c119d-6750-4c0f-9140-971a3e4d86f4 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 93c96362-cc02-493d-a96b-ca19cf3a4e47] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:45.884965 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4c7c119d-6750-4c0f-9140-971a3e4d86f4 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:45.885816 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4c7c119d-6750-4c0f-9140-971a3e4d86f4 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:45.886468 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4c7c119d-6750-4c0f-9140-971a3e4d86f4 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:45.887618 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4c7c119d-6750-4c0f-9140-971a3e4d86f4 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:45.888400 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4c7c119d-6750-4c0f-9140-971a3e4d86f4 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:45.889082 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4c7c119d-6750-4c0f-9140-971a3e4d86f4 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:46.010441 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-bbd5dc7d-0b63-48a6-861a-930b0e2c47dc tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6381ae230a45de8b105374c2d25383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a6a888c878245cb9e5909e071c9b9c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:46.021443 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-bbd5dc7d-0b63-48a6-861a-930b0e2c47dc tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] 10.222.0.70 "GET /compute/v2.1/servers/54682cce-6601-49d1-88f7-1c9fcaf7d370" status: 200 len: 1316 microversion: 2.1 time: 1.170603 Aug 27 02:57:46.028462 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1775/3539] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:57:44 2022] GET /compute/v2.1/servers/54682cce-6601-49d1-88f7-1c9fcaf7d370 => generated 1316 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:57:46.035025 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-7d9824e6-b827-48a9-81ab-d2823da7f68a tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:46.047386 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-7d9824e6-b827-48a9-81ab-d2823da7f68a tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2b217f9cbc204919ba77d885315907c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2448b78114c54dd39bc85538fb973dd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:46.048108 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.compute.servers [None req-7d9824e6-b827-48a9-81ab-d2823da7f68a tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Removing options 'limit' from query {{(pid=134052) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 27 02:57:46.048637 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-7d9824e6-b827-48a9-81ab-d2823da7f68a tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Searching by: {'deleted': False, 'project_id': '2448b78114c54dd39bc85538fb973dd2'} {{(pid=134052) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 02:57:46.064991 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7d9824e6-b827-48a9-81ab-d2823da7f68a tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:46.065709 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7d9824e6-b827-48a9-81ab-d2823da7f68a tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:46.066315 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7d9824e6-b827-48a9-81ab-d2823da7f68a tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:46.067147 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7d9824e6-b827-48a9-81ab-d2823da7f68a tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:46.067642 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7d9824e6-b827-48a9-81ab-d2823da7f68a tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:46.068088 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7d9824e6-b827-48a9-81ab-d2823da7f68a tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:46.149630 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-7d9824e6-b827-48a9-81ab-d2823da7f68a tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b217f9cbc204919ba77d885315907c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2448b78114c54dd39bc85538fb973dd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:46.162888 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7d9824e6-b827-48a9-81ab-d2823da7f68a tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:46.163798 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7d9824e6-b827-48a9-81ab-d2823da7f68a tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:46.164529 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7d9824e6-b827-48a9-81ab-d2823da7f68a tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:46.591450 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-4c7c119d-6750-4c0f-9140-971a3e4d86f4 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:46.600041 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-4c7c119d-6750-4c0f-9140-971a3e4d86f4 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/93c96362-cc02-493d-a96b-ca19cf3a4e47" status: 200 len: 1315 microversion: 2.1 time: 0.729757 Aug 27 02:57:46.600963 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1765/3540] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:57:45 2022] GET /compute/v2.1/servers/93c96362-cc02-493d-a96b-ca19cf3a4e47 => generated 1315 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:57:46.731388 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-7d9824e6-b827-48a9-81ab-d2823da7f68a tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] 10.222.0.70 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1661 microversion: 2.1 time: 0.700111 Aug 27 02:57:46.732043 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1776/3541] 10.222.0.70 () {58 vars in 1161 bytes} [Sat Aug 27 02:57:46 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1661 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:57:46.763664 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a9925109-9ecc-4813-aa4f-b3dd0e0eccf0 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:46.771390 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-a9925109-9ecc-4813-aa4f-b3dd0e0eccf0 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2b217f9cbc204919ba77d885315907c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2448b78114c54dd39bc85538fb973dd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:46.772138 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-a9925109-9ecc-4813-aa4f-b3dd0e0eccf0 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '2448b78114c54dd39bc85538fb973dd2'} {{(pid=134051) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 02:57:46.778608 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a9925109-9ecc-4813-aa4f-b3dd0e0eccf0 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:46.779101 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a9925109-9ecc-4813-aa4f-b3dd0e0eccf0 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:46.779538 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a9925109-9ecc-4813-aa4f-b3dd0e0eccf0 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:46.780297 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a9925109-9ecc-4813-aa4f-b3dd0e0eccf0 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:46.780726 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a9925109-9ecc-4813-aa4f-b3dd0e0eccf0 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:46.781334 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a9925109-9ecc-4813-aa4f-b3dd0e0eccf0 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:46.830895 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.multi_cell_list [None req-a9925109-9ecc-4813-aa4f-b3dd0e0eccf0 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=134051) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 02:57:46.871211 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a9925109-9ecc-4813-aa4f-b3dd0e0eccf0 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] 10.222.0.70 "GET /compute/v2.1/servers?status=active" status: 200 len: 1012 microversion: 2.1 time: 0.111920 Aug 27 02:57:46.872213 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1766/3542] 10.222.0.70 () {58 vars in 1152 bytes} [Sat Aug 27 02:57:46 2022] GET /compute/v2.1/servers?status=active => generated 1012 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:57:46.890528 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b5745364-51f3-48fc-a6d8-94629cbb0242 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:46.900003 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b5745364-51f3-48fc-a6d8-94629cbb0242 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2b217f9cbc204919ba77d885315907c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2448b78114c54dd39bc85538fb973dd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:46.901252 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.compute.servers [None req-b5745364-51f3-48fc-a6d8-94629cbb0242 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Removing options 'limit' from query {{(pid=134052) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 27 02:57:46.903483 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b5745364-51f3-48fc-a6d8-94629cbb0242 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Searching by: {'deleted': False, 'project_id': '2448b78114c54dd39bc85538fb973dd2'} {{(pid=134052) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 02:57:46.912214 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b5745364-51f3-48fc-a6d8-94629cbb0242 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:46.913279 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b5745364-51f3-48fc-a6d8-94629cbb0242 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:46.914495 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b5745364-51f3-48fc-a6d8-94629cbb0242 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:46.915646 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b5745364-51f3-48fc-a6d8-94629cbb0242 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:46.916500 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b5745364-51f3-48fc-a6d8-94629cbb0242 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:46.917321 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b5745364-51f3-48fc-a6d8-94629cbb0242 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:46.956910 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.multi_cell_list [None req-b5745364-51f3-48fc-a6d8-94629cbb0242 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=134052) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 02:57:47.016000 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b5745364-51f3-48fc-a6d8-94629cbb0242 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] 10.222.0.70 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1012 microversion: 2.1 time: 0.131829 Aug 27 02:57:47.020460 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1777/3543] 10.222.0.70 () {58 vars in 1150 bytes} [Sat Aug 27 02:57:46 2022] GET /compute/v2.1/servers?limit=100000 => generated 1012 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:57:47.032496 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-63862636-65d4-4668-877a-bb74b82eda60 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:47.054390 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-63862636-65d4-4668-877a-bb74b82eda60 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2b217f9cbc204919ba77d885315907c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2448b78114c54dd39bc85538fb973dd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:47.055407 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-63862636-65d4-4668-877a-bb74b82eda60 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Searching by: {'deleted': False, 'project_id': '2448b78114c54dd39bc85538fb973dd2'} {{(pid=134051) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 02:57:47.059769 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c369b51e-d768-4076-a1fa-155fe6221c15 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:47.060433 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-c369b51e-d768-4076-a1fa-155fe6221c15 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] [instance: 54682cce-6601-49d1-88f7-1c9fcaf7d370] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:47.063507 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-63862636-65d4-4668-877a-bb74b82eda60 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:47.064212 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-63862636-65d4-4668-877a-bb74b82eda60 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:47.066240 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-63862636-65d4-4668-877a-bb74b82eda60 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:47.067241 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-63862636-65d4-4668-877a-bb74b82eda60 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:47.067899 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-63862636-65d4-4668-877a-bb74b82eda60 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:47.068161 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c369b51e-d768-4076-a1fa-155fe6221c15 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:47.068818 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c369b51e-d768-4076-a1fa-155fe6221c15 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:47.069272 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-63862636-65d4-4668-877a-bb74b82eda60 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:47.069377 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c369b51e-d768-4076-a1fa-155fe6221c15 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:47.070061 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c369b51e-d768-4076-a1fa-155fe6221c15 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:47.070543 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c369b51e-d768-4076-a1fa-155fe6221c15 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:47.070961 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c369b51e-d768-4076-a1fa-155fe6221c15 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:47.077538 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:57:47.105905 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.multi_cell_list [None req-63862636-65d4-4668-877a-bb74b82eda60 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=134051) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 02:57:47.145505 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-63862636-65d4-4668-877a-bb74b82eda60 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] 10.222.0.70 "GET /compute/v2.1/servers" status: 200 len: 1012 microversion: 2.1 time: 0.118812 Aug 27 02:57:47.146511 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1767/3544] 10.222.0.70 () {58 vars in 1125 bytes} [Sat Aug 27 02:57:47 2022] GET /compute/v2.1/servers => generated 1012 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:57:47.162069 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-9fa54beb-e85a-41c0-ba36-679a21a8408e req-818472ae-c3c2-4ca6-9761-f0257896c055 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93c96362-cc02-493d-a96b-ca19cf3a4e47", "tag": "89392832-a58f-4596-ba39-a4d42c287569"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:57:47.179252 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-9fa54beb-e85a-41c0-ba36-679a21a8408e req-818472ae-c3c2-4ca6-9761-f0257896c055 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:47.179758 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-9fa54beb-e85a-41c0-ba36-679a21a8408e req-818472ae-c3c2-4ca6-9761-f0257896c055 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:47.180215 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-9fa54beb-e85a-41c0-ba36-679a21a8408e req-818472ae-c3c2-4ca6-9761-f0257896c055 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:47.191561 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-9fa54beb-e85a-41c0-ba36-679a21a8408e req-818472ae-c3c2-4ca6-9761-f0257896c055 service nova] Creating event network-changed:89392832-a58f-4596-ba39-a4d42c287569 for instance 93c96362-cc02-493d-a96b-ca19cf3a4e47 on n-h1-852278-4 Aug 27 02:57:47.196599 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-9fa54beb-e85a-41c0-ba36-679a21a8408e req-818472ae-c3c2-4ca6-9761-f0257896c055 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046786 Aug 27 02:57:47.197870 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1768/3545] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:57:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:57:47.203476 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d72834dc-1b0a-4717-a191-9b15b0fe6f4f tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:47.209017 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d72834dc-1b0a-4717-a191-9b15b0fe6f4f tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2b217f9cbc204919ba77d885315907c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2448b78114c54dd39bc85538fb973dd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:47.210136 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d72834dc-1b0a-4717-a191-9b15b0fe6f4f tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '2448b78114c54dd39bc85538fb973dd2'} {{(pid=134051) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 02:57:47.226540 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d72834dc-1b0a-4717-a191-9b15b0fe6f4f tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:47.227273 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d72834dc-1b0a-4717-a191-9b15b0fe6f4f tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:47.228210 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d72834dc-1b0a-4717-a191-9b15b0fe6f4f tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:47.229241 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d72834dc-1b0a-4717-a191-9b15b0fe6f4f tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:47.229993 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d72834dc-1b0a-4717-a191-9b15b0fe6f4f tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:47.230608 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d72834dc-1b0a-4717-a191-9b15b0fe6f4f tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:47.349796 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.multi_cell_list [None req-d72834dc-1b0a-4717-a191-9b15b0fe6f4f tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=134051) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 02:57:47.429755 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d72834dc-1b0a-4717-a191-9b15b0fe6f4f tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] 10.222.0.70 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 346 microversion: 2.1 time: 0.230398 Aug 27 02:57:47.430861 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1769/3546] 10.222.0.70 () {58 vars in 1146 bytes} [Sat Aug 27 02:57:47 2022] GET /compute/v2.1/servers?flavor=451 => generated 346 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:57:47.455517 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e983f113-244e-4bfe-bdf2-dc4c8916307d tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:47.467835 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e983f113-244e-4bfe-bdf2-dc4c8916307d tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2b217f9cbc204919ba77d885315907c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2448b78114c54dd39bc85538fb973dd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:47.468293 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.compute.servers [None req-e983f113-244e-4bfe-bdf2-dc4c8916307d tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Removing options 'limit' from query {{(pid=134051) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 27 02:57:47.471984 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-e983f113-244e-4bfe-bdf2-dc4c8916307d tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Searching by: {'deleted': False, 'project_id': '2448b78114c54dd39bc85538fb973dd2'} {{(pid=134051) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 02:57:47.481463 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e983f113-244e-4bfe-bdf2-dc4c8916307d tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:47.483283 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e983f113-244e-4bfe-bdf2-dc4c8916307d tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:47.487152 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e983f113-244e-4bfe-bdf2-dc4c8916307d tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:47.487152 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e983f113-244e-4bfe-bdf2-dc4c8916307d tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:47.487152 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e983f113-244e-4bfe-bdf2-dc4c8916307d tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:47.487152 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e983f113-244e-4bfe-bdf2-dc4c8916307d tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:47.551153 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e983f113-244e-4bfe-bdf2-dc4c8916307d tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] 10.222.0.70 "GET /compute/v2.1/servers?limit=1" status: 200 len: 485 microversion: 2.1 time: 0.105586 Aug 27 02:57:47.551986 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1770/3547] 10.222.0.70 () {58 vars in 1140 bytes} [Sat Aug 27 02:57:47 2022] GET /compute/v2.1/servers?limit=1 => generated 485 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:57:47.567282 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-366b6f57-bcea-4002-a19f-bb8acc74fc90 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:47.580160 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-366b6f57-bcea-4002-a19f-bb8acc74fc90 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2b217f9cbc204919ba77d885315907c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2448b78114c54dd39bc85538fb973dd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:47.581103 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-366b6f57-bcea-4002-a19f-bb8acc74fc90 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1118990088', 'deleted': False, 'project_id': '2448b78114c54dd39bc85538fb973dd2'} {{(pid=134051) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 02:57:47.582200 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-c369b51e-d768-4076-a1fa-155fe6221c15 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6381ae230a45de8b105374c2d25383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a6a888c878245cb9e5909e071c9b9c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:47.589333 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-366b6f57-bcea-4002-a19f-bb8acc74fc90 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:47.590154 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-366b6f57-bcea-4002-a19f-bb8acc74fc90 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:47.591085 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c369b51e-d768-4076-a1fa-155fe6221c15 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] 10.222.0.70 "GET /compute/v2.1/servers/54682cce-6601-49d1-88f7-1c9fcaf7d370" status: 200 len: 1316 microversion: 2.1 time: 0.549736 Aug 27 02:57:47.591444 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-366b6f57-bcea-4002-a19f-bb8acc74fc90 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:47.591717 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1778/3548] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:57:47 2022] GET /compute/v2.1/servers/54682cce-6601-49d1-88f7-1c9fcaf7d370 => generated 1316 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:57:47.592856 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-366b6f57-bcea-4002-a19f-bb8acc74fc90 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:47.593373 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-366b6f57-bcea-4002-a19f-bb8acc74fc90 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:47.593989 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-366b6f57-bcea-4002-a19f-bb8acc74fc90 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:47.626559 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-77064b7b-4f84-4297-b5b2-90455ef87e0a tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:47.627367 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-77064b7b-4f84-4297-b5b2-90455ef87e0a tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 93c96362-cc02-493d-a96b-ca19cf3a4e47] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:47.639774 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-77064b7b-4f84-4297-b5b2-90455ef87e0a tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:47.641661 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-77064b7b-4f84-4297-b5b2-90455ef87e0a tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:47.643095 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-77064b7b-4f84-4297-b5b2-90455ef87e0a tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:47.643820 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-77064b7b-4f84-4297-b5b2-90455ef87e0a tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:47.644267 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-77064b7b-4f84-4297-b5b2-90455ef87e0a tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:47.644997 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-77064b7b-4f84-4297-b5b2-90455ef87e0a tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:47.750526 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.multi_cell_list [None req-366b6f57-bcea-4002-a19f-bb8acc74fc90 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=134051) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 02:57:47.856378 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-366b6f57-bcea-4002-a19f-bb8acc74fc90 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] 10.222.0.70 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1118990088" status: 200 len: 346 microversion: 2.1 time: 0.293648 Aug 27 02:57:47.857307 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1771/3549] 10.222.0.70 () {58 vars in 1242 bytes} [Sat Aug 27 02:57:47 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1118990088 => generated 346 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:57:47.876182 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ea411281-81f4-45ad-844c-d421cd2abc4d tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:57:47.885817 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ea411281-81f4-45ad-844c-d421cd2abc4d tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:47.886300 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ea411281-81f4-45ad-844c-d421cd2abc4d tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:47.886740 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ea411281-81f4-45ad-844c-d421cd2abc4d tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:47.934427 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-ea411281-81f4-45ad-844c-d421cd2abc4d tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] [instance: 02eba429-ecb3-4a5c-87ea-c049ad7aca1a] Going to try to stop instance {{(pid=134051) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 27 02:57:48.003975 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ea411281-81f4-45ad-844c-d421cd2abc4d tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] 10.222.0.70 "POST /compute/v2.1/servers/02eba429-ecb3-4a5c-87ea-c049ad7aca1a/action" status: 202 len: 0 microversion: 2.1 time: 0.136857 Aug 27 02:57:48.009245 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1772/3550] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 02:57:47 2022] POST /compute/v2.1/servers/02eba429-ecb3-4a5c-87ea-c049ad7aca1a/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:57:48.040836 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-274d5532-938f-4ffe-8421-44e0a394aaa9 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:48.041650 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-274d5532-938f-4ffe-8421-44e0a394aaa9 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] [instance: 02eba429-ecb3-4a5c-87ea-c049ad7aca1a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:48.053735 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-274d5532-938f-4ffe-8421-44e0a394aaa9 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:48.054662 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-274d5532-938f-4ffe-8421-44e0a394aaa9 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:48.055390 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-274d5532-938f-4ffe-8421-44e0a394aaa9 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:48.056672 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-274d5532-938f-4ffe-8421-44e0a394aaa9 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:48.057405 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-274d5532-938f-4ffe-8421-44e0a394aaa9 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:48.058248 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-274d5532-938f-4ffe-8421-44e0a394aaa9 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:48.170128 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-77064b7b-4f84-4297-b5b2-90455ef87e0a tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:48.181448 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-77064b7b-4f84-4297-b5b2-90455ef87e0a tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/93c96362-cc02-493d-a96b-ca19cf3a4e47" status: 200 len: 1315 microversion: 2.1 time: 0.559744 Aug 27 02:57:48.195630 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1779/3551] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:57:47 2022] GET /compute/v2.1/servers/93c96362-cc02-493d-a96b-ca19cf3a4e47 => generated 1315 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:57:48.532520 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-274d5532-938f-4ffe-8421-44e0a394aaa9 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b217f9cbc204919ba77d885315907c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2448b78114c54dd39bc85538fb973dd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:48.543190 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-274d5532-938f-4ffe-8421-44e0a394aaa9 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] 10.222.0.70 "GET /compute/v2.1/servers/02eba429-ecb3-4a5c-87ea-c049ad7aca1a" status: 200 len: 1521 microversion: 2.1 time: 0.530993 Aug 27 02:57:48.543783 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1773/3552] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:57:48 2022] GET /compute/v2.1/servers/02eba429-ecb3-4a5c-87ea-c049ad7aca1a => generated 1521 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:57:48.611216 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f20dd7c9-b777-4f40-be2a-721e2c869b62 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:48.611848 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-f20dd7c9-b777-4f40-be2a-721e2c869b62 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] [instance: 54682cce-6601-49d1-88f7-1c9fcaf7d370] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:48.621091 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f20dd7c9-b777-4f40-be2a-721e2c869b62 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:48.621588 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f20dd7c9-b777-4f40-be2a-721e2c869b62 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:48.622027 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f20dd7c9-b777-4f40-be2a-721e2c869b62 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:48.622746 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f20dd7c9-b777-4f40-be2a-721e2c869b62 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:48.623193 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f20dd7c9-b777-4f40-be2a-721e2c869b62 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:48.625933 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f20dd7c9-b777-4f40-be2a-721e2c869b62 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:49.035193 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-f20dd7c9-b777-4f40-be2a-721e2c869b62 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6381ae230a45de8b105374c2d25383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a6a888c878245cb9e5909e071c9b9c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:49.047090 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f20dd7c9-b777-4f40-be2a-721e2c869b62 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] 10.222.0.70 "GET /compute/v2.1/servers/54682cce-6601-49d1-88f7-1c9fcaf7d370" status: 200 len: 1316 microversion: 2.1 time: 0.438989 Aug 27 02:57:49.056351 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1780/3553] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:57:48 2022] GET /compute/v2.1/servers/54682cce-6601-49d1-88f7-1c9fcaf7d370 => generated 1316 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:57:49.202972 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d2f43df0-b152-4465-aa0e-f8465d39fa10 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:49.204179 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d2f43df0-b152-4465-aa0e-f8465d39fa10 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 93c96362-cc02-493d-a96b-ca19cf3a4e47] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:49.218671 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d2f43df0-b152-4465-aa0e-f8465d39fa10 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:49.219730 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d2f43df0-b152-4465-aa0e-f8465d39fa10 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:49.220551 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d2f43df0-b152-4465-aa0e-f8465d39fa10 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:49.223572 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d2f43df0-b152-4465-aa0e-f8465d39fa10 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:49.224449 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d2f43df0-b152-4465-aa0e-f8465d39fa10 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:49.225354 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d2f43df0-b152-4465-aa0e-f8465d39fa10 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:49.307445 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-0aae828f-c43b-445c-9ebe-2a1a706901b0 req-d48ef373-dac1-4de8-84a7-e9e9f3a132e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54682cce-6601-49d1-88f7-1c9fcaf7d370", "tag": "630d16a1-f5f9-4ff7-8090-d69fbd0a36a7"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:57:49.322745 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-0aae828f-c43b-445c-9ebe-2a1a706901b0 req-d48ef373-dac1-4de8-84a7-e9e9f3a132e5 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:49.324130 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-0aae828f-c43b-445c-9ebe-2a1a706901b0 req-d48ef373-dac1-4de8-84a7-e9e9f3a132e5 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:49.325411 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-0aae828f-c43b-445c-9ebe-2a1a706901b0 req-d48ef373-dac1-4de8-84a7-e9e9f3a132e5 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:49.350640 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-0aae828f-c43b-445c-9ebe-2a1a706901b0 req-d48ef373-dac1-4de8-84a7-e9e9f3a132e5 service nova] Creating event network-changed:630d16a1-f5f9-4ff7-8090-d69fbd0a36a7 for instance 54682cce-6601-49d1-88f7-1c9fcaf7d370 on n-h2-852278-4 Aug 27 02:57:49.357645 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-0aae828f-c43b-445c-9ebe-2a1a706901b0 req-d48ef373-dac1-4de8-84a7-e9e9f3a132e5 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056280 Aug 27 02:57:49.358612 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1781/3554] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:57:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:57:49.489698 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d2f43df0-b152-4465-aa0e-f8465d39fa10 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:49.500045 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d2f43df0-b152-4465-aa0e-f8465d39fa10 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/93c96362-cc02-493d-a96b-ca19cf3a4e47" status: 200 len: 1315 microversion: 2.1 time: 0.301507 Aug 27 02:57:49.500982 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1774/3555] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:57:49 2022] GET /compute/v2.1/servers/93c96362-cc02-493d-a96b-ca19cf3a4e47 => generated 1315 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:57:49.567649 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c2ada18d-6eab-440f-a1b6-9b26f8ed199d tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:49.576763 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-c2ada18d-6eab-440f-a1b6-9b26f8ed199d tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] [instance: 02eba429-ecb3-4a5c-87ea-c049ad7aca1a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:49.587825 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c2ada18d-6eab-440f-a1b6-9b26f8ed199d tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:49.588817 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c2ada18d-6eab-440f-a1b6-9b26f8ed199d tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:49.589596 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c2ada18d-6eab-440f-a1b6-9b26f8ed199d tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:49.590531 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c2ada18d-6eab-440f-a1b6-9b26f8ed199d tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:49.591497 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c2ada18d-6eab-440f-a1b6-9b26f8ed199d tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:49.592157 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c2ada18d-6eab-440f-a1b6-9b26f8ed199d tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:49.766053 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-c2ada18d-6eab-440f-a1b6-9b26f8ed199d tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b217f9cbc204919ba77d885315907c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2448b78114c54dd39bc85538fb973dd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:49.775474 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c2ada18d-6eab-440f-a1b6-9b26f8ed199d tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] 10.222.0.70 "GET /compute/v2.1/servers/02eba429-ecb3-4a5c-87ea-c049ad7aca1a" status: 200 len: 1521 microversion: 2.1 time: 0.214916 Aug 27 02:57:49.779046 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1782/3556] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:57:49 2022] GET /compute/v2.1/servers/02eba429-ecb3-4a5c-87ea-c049ad7aca1a => generated 1521 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:57:50.001566 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a204e6dd-07d7-498a-abe4-59e9de60828f tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-1255173318", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "networks": "none"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:57:50.072523 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-a204e6dd-07d7-498a-abe4-59e9de60828f tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Flavor limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:57:50.073021 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5a7cf88d-d99b-491a-aebe-db257fe809a3 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:50.073371 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-a204e6dd-07d7-498a-abe4-59e9de60828f tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Image limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:57:50.073683 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-5a7cf88d-d99b-491a-aebe-db257fe809a3 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] [instance: 54682cce-6601-49d1-88f7-1c9fcaf7d370] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:50.074359 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-a204e6dd-07d7-498a-abe4-59e9de60828f tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Flavor pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:57:50.075074 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-a204e6dd-07d7-498a-abe4-59e9de60828f tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Image pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:57:50.075663 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-a204e6dd-07d7-498a-abe4-59e9de60828f tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:57:50.083023 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5a7cf88d-d99b-491a-aebe-db257fe809a3 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:50.084626 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5a7cf88d-d99b-491a-aebe-db257fe809a3 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:50.086353 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5a7cf88d-d99b-491a-aebe-db257fe809a3 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:50.087479 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5a7cf88d-d99b-491a-aebe-db257fe809a3 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:50.087842 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a204e6dd-07d7-498a-abe4-59e9de60828f tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:50.088336 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5a7cf88d-d99b-491a-aebe-db257fe809a3 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:50.088468 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a204e6dd-07d7-498a-abe4-59e9de60828f tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:50.089244 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5a7cf88d-d99b-491a-aebe-db257fe809a3 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:50.089536 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a204e6dd-07d7-498a-abe4-59e9de60828f tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:50.090964 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a204e6dd-07d7-498a-abe4-59e9de60828f tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:50.091446 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a204e6dd-07d7-498a-abe4-59e9de60828f tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:50.091973 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a204e6dd-07d7-498a-abe4-59e9de60828f tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:50.114148 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-a204e6dd-07d7-498a-abe4-59e9de60828f tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Getting quotas for project 4190feabcb36413fb443349aadc93a01. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:57:50.121459 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-a204e6dd-07d7-498a-abe4-59e9de60828f tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Getting quotas for user cfcc2feab6eb427cb1c1ac9093670ba2 and project 4190feabcb36413fb443349aadc93a01. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:57:50.170594 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-a204e6dd-07d7-498a-abe4-59e9de60828f tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Going to run 1 instances... {{(pid=134051) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:57:50.182759 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-a204e6dd-07d7-498a-abe4-59e9de60828f tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] [instance: d6a40f7a-6709-4e75-b3e8-f98abf1b03d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134051) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:57:50.339644 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-5a7cf88d-d99b-491a-aebe-db257fe809a3 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6381ae230a45de8b105374c2d25383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a6a888c878245cb9e5909e071c9b9c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:50.351138 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-5a7cf88d-d99b-491a-aebe-db257fe809a3 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] 10.222.0.70 "GET /compute/v2.1/servers/54682cce-6601-49d1-88f7-1c9fcaf7d370" status: 200 len: 1316 microversion: 2.1 time: 0.282328 Aug 27 02:57:50.352059 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1783/3557] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:57:50 2022] GET /compute/v2.1/servers/54682cce-6601-49d1-88f7-1c9fcaf7d370 => generated 1316 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:57:50.354270 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a204e6dd-07d7-498a-abe4-59e9de60828f tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.677186 Aug 27 02:57:50.355578 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1775/3558] 10.222.0.70 () {62 vars in 1188 bytes} [Sat Aug 27 02:57:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 679 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 27 02:57:50.370527 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-440c1181-92c0-446c-a4bc-cbbf8e9473a8 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:50.372554 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-440c1181-92c0-446c-a4bc-cbbf8e9473a8 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] [instance: d6a40f7a-6709-4e75-b3e8-f98abf1b03d8] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:50.475693 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-440c1181-92c0-446c-a4bc-cbbf8e9473a8 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcc2feab6eb427cb1c1ac9093670ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4190feabcb36413fb443349aadc93a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:50.488408 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-440c1181-92c0-446c-a4bc-cbbf8e9473a8 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcc2feab6eb427cb1c1ac9093670ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4190feabcb36413fb443349aadc93a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:50.490223 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-440c1181-92c0-446c-a4bc-cbbf8e9473a8 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcc2feab6eb427cb1c1ac9093670ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4190feabcb36413fb443349aadc93a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:50.494908 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-440c1181-92c0-446c-a4bc-cbbf8e9473a8 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] 10.222.0.70 "GET /compute/v2.1/servers/d6a40f7a-6709-4e75-b3e8-f98abf1b03d8" status: 200 len: 1278 microversion: 2.54 time: 0.126794 Aug 27 02:57:50.497261 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1784/3559] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:57:50 2022] GET /compute/v2.1/servers/d6a40f7a-6709-4e75-b3e8-f98abf1b03d8 => generated 1278 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:57:50.521612 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-53fa4fa2-9729-4164-b7bd-b220654d7809 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:50.522233 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-53fa4fa2-9729-4164-b7bd-b220654d7809 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 93c96362-cc02-493d-a96b-ca19cf3a4e47] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:50.534005 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-53fa4fa2-9729-4164-b7bd-b220654d7809 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:50.534506 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-53fa4fa2-9729-4164-b7bd-b220654d7809 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:50.537647 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-53fa4fa2-9729-4164-b7bd-b220654d7809 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:50.540754 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-53fa4fa2-9729-4164-b7bd-b220654d7809 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:50.541493 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-53fa4fa2-9729-4164-b7bd-b220654d7809 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:50.542733 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-53fa4fa2-9729-4164-b7bd-b220654d7809 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:50.799447 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5cccaa20-9a7d-4905-bb77-196144af492c tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:50.800953 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-5cccaa20-9a7d-4905-bb77-196144af492c tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] [instance: 02eba429-ecb3-4a5c-87ea-c049ad7aca1a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:50.825559 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5cccaa20-9a7d-4905-bb77-196144af492c tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:50.826072 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5cccaa20-9a7d-4905-bb77-196144af492c tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:50.826512 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5cccaa20-9a7d-4905-bb77-196144af492c tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:50.827231 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5cccaa20-9a7d-4905-bb77-196144af492c tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:50.832986 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5cccaa20-9a7d-4905-bb77-196144af492c tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:50.836648 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5cccaa20-9a7d-4905-bb77-196144af492c tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:50.898180 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-53fa4fa2-9729-4164-b7bd-b220654d7809 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:50.935642 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-53fa4fa2-9729-4164-b7bd-b220654d7809 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/93c96362-cc02-493d-a96b-ca19cf3a4e47" status: 200 len: 1315 microversion: 2.1 time: 0.416349 Aug 27 02:57:50.937501 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1776/3560] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:57:50 2022] GET /compute/v2.1/servers/93c96362-cc02-493d-a96b-ca19cf3a4e47 => generated 1315 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:57:51.377885 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-edb00783-2daf-4a1c-982b-a1b9d61df664 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:51.378593 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-edb00783-2daf-4a1c-982b-a1b9d61df664 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] [instance: 54682cce-6601-49d1-88f7-1c9fcaf7d370] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:51.387055 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-edb00783-2daf-4a1c-982b-a1b9d61df664 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:51.387549 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-edb00783-2daf-4a1c-982b-a1b9d61df664 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:51.387983 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-edb00783-2daf-4a1c-982b-a1b9d61df664 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:51.388713 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-edb00783-2daf-4a1c-982b-a1b9d61df664 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:51.389360 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-edb00783-2daf-4a1c-982b-a1b9d61df664 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:51.392124 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-edb00783-2daf-4a1c-982b-a1b9d61df664 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:51.785498 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-5cccaa20-9a7d-4905-bb77-196144af492c tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b217f9cbc204919ba77d885315907c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2448b78114c54dd39bc85538fb973dd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:51.801616 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-5cccaa20-9a7d-4905-bb77-196144af492c tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] 10.222.0.70 "GET /compute/v2.1/servers/02eba429-ecb3-4a5c-87ea-c049ad7aca1a" status: 200 len: 1521 microversion: 2.1 time: 1.000140 Aug 27 02:57:51.802913 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1785/3561] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:57:50 2022] GET /compute/v2.1/servers/02eba429-ecb3-4a5c-87ea-c049ad7aca1a => generated 1521 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:57:51.807908 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b9626b9d-4a9f-4300-a3d6-f1efce03b405 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:51.811080 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b9626b9d-4a9f-4300-a3d6-f1efce03b405 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] [instance: d6a40f7a-6709-4e75-b3e8-f98abf1b03d8] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:51.828058 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b9626b9d-4a9f-4300-a3d6-f1efce03b405 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:51.830909 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b9626b9d-4a9f-4300-a3d6-f1efce03b405 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:51.832263 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b9626b9d-4a9f-4300-a3d6-f1efce03b405 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:51.834131 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b9626b9d-4a9f-4300-a3d6-f1efce03b405 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:51.835134 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b9626b9d-4a9f-4300-a3d6-f1efce03b405 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:51.835505 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b9626b9d-4a9f-4300-a3d6-f1efce03b405 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:51.835749 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-edb00783-2daf-4a1c-982b-a1b9d61df664 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6381ae230a45de8b105374c2d25383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a6a888c878245cb9e5909e071c9b9c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:51.846352 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-edb00783-2daf-4a1c-982b-a1b9d61df664 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] 10.222.0.70 "GET /compute/v2.1/servers/54682cce-6601-49d1-88f7-1c9fcaf7d370" status: 200 len: 1316 microversion: 2.1 time: 0.473643 Aug 27 02:57:51.859825 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1777/3562] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:57:51 2022] GET /compute/v2.1/servers/54682cce-6601-49d1-88f7-1c9fcaf7d370 => generated 1316 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:57:51.960348 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-345bb845-04da-44e0-955d-8e241a9f6565 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:51.961023 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-345bb845-04da-44e0-955d-8e241a9f6565 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 93c96362-cc02-493d-a96b-ca19cf3a4e47] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:51.967403 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-345bb845-04da-44e0-955d-8e241a9f6565 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:51.967885 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-345bb845-04da-44e0-955d-8e241a9f6565 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:51.968337 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-345bb845-04da-44e0-955d-8e241a9f6565 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:51.969088 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-345bb845-04da-44e0-955d-8e241a9f6565 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:51.969531 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-345bb845-04da-44e0-955d-8e241a9f6565 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:51.969945 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-345bb845-04da-44e0-955d-8e241a9f6565 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:51.993946 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b9626b9d-4a9f-4300-a3d6-f1efce03b405 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcc2feab6eb427cb1c1ac9093670ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4190feabcb36413fb443349aadc93a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:52.003381 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b9626b9d-4a9f-4300-a3d6-f1efce03b405 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcc2feab6eb427cb1c1ac9093670ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4190feabcb36413fb443349aadc93a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:52.004930 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b9626b9d-4a9f-4300-a3d6-f1efce03b405 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcc2feab6eb427cb1c1ac9093670ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4190feabcb36413fb443349aadc93a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:52.006331 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b9626b9d-4a9f-4300-a3d6-f1efce03b405 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] 10.222.0.70 "GET /compute/v2.1/servers/d6a40f7a-6709-4e75-b3e8-f98abf1b03d8" status: 200 len: 1330 microversion: 2.54 time: 0.202167 Aug 27 02:57:52.007294 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1786/3563] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:57:51 2022] GET /compute/v2.1/servers/d6a40f7a-6709-4e75-b3e8-f98abf1b03d8 => generated 1330 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:57:52.156590 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-345bb845-04da-44e0-955d-8e241a9f6565 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:52.165490 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-345bb845-04da-44e0-955d-8e241a9f6565 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/93c96362-cc02-493d-a96b-ca19cf3a4e47" status: 200 len: 1315 microversion: 2.1 time: 0.208955 Aug 27 02:57:52.166080 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1778/3564] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:57:51 2022] GET /compute/v2.1/servers/93c96362-cc02-493d-a96b-ca19cf3a4e47 => generated 1315 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:57:52.826804 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a3c3e28e-f334-4a48-ad4f-e60038a4583b tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:52.827491 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a3c3e28e-f334-4a48-ad4f-e60038a4583b tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] [instance: 02eba429-ecb3-4a5c-87ea-c049ad7aca1a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:52.834473 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a3c3e28e-f334-4a48-ad4f-e60038a4583b tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:52.834967 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a3c3e28e-f334-4a48-ad4f-e60038a4583b tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:52.835407 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a3c3e28e-f334-4a48-ad4f-e60038a4583b tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:52.836173 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a3c3e28e-f334-4a48-ad4f-e60038a4583b tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:52.836670 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a3c3e28e-f334-4a48-ad4f-e60038a4583b tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:52.837078 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a3c3e28e-f334-4a48-ad4f-e60038a4583b tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:52.869144 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7038d5bf-6ad8-4ce2-890e-5287a9f8de58 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:52.870037 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-7038d5bf-6ad8-4ce2-890e-5287a9f8de58 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] [instance: 54682cce-6601-49d1-88f7-1c9fcaf7d370] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:52.890375 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7038d5bf-6ad8-4ce2-890e-5287a9f8de58 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:52.891197 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7038d5bf-6ad8-4ce2-890e-5287a9f8de58 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:52.891893 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7038d5bf-6ad8-4ce2-890e-5287a9f8de58 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:52.892815 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7038d5bf-6ad8-4ce2-890e-5287a9f8de58 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:52.893603 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7038d5bf-6ad8-4ce2-890e-5287a9f8de58 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:52.894213 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7038d5bf-6ad8-4ce2-890e-5287a9f8de58 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:53.077107 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-a3c3e28e-f334-4a48-ad4f-e60038a4583b tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b217f9cbc204919ba77d885315907c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2448b78114c54dd39bc85538fb973dd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:53.089907 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a3c3e28e-f334-4a48-ad4f-e60038a4583b tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] 10.222.0.70 "GET /compute/v2.1/servers/02eba429-ecb3-4a5c-87ea-c049ad7aca1a" status: 200 len: 1521 microversion: 2.1 time: 0.269193 Aug 27 02:57:53.098010 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1787/3565] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:57:52 2022] GET /compute/v2.1/servers/02eba429-ecb3-4a5c-87ea-c049ad7aca1a => generated 1521 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:57:53.108223 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-11408948-7871-4c56-963d-756098270341 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:53.108893 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-11408948-7871-4c56-963d-756098270341 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] [instance: d6a40f7a-6709-4e75-b3e8-f98abf1b03d8] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:53.110012 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-7038d5bf-6ad8-4ce2-890e-5287a9f8de58 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6381ae230a45de8b105374c2d25383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a6a888c878245cb9e5909e071c9b9c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:53.123478 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-7038d5bf-6ad8-4ce2-890e-5287a9f8de58 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] 10.222.0.70 "GET /compute/v2.1/servers/54682cce-6601-49d1-88f7-1c9fcaf7d370" status: 200 len: 1316 microversion: 2.1 time: 0.259930 Aug 27 02:57:53.129778 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-11408948-7871-4c56-963d-756098270341 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:53.130650 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-11408948-7871-4c56-963d-756098270341 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:53.131223 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-11408948-7871-4c56-963d-756098270341 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:53.132081 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-11408948-7871-4c56-963d-756098270341 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:53.132719 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-11408948-7871-4c56-963d-756098270341 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:53.133427 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-11408948-7871-4c56-963d-756098270341 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:53.134585 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1779/3566] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:57:52 2022] GET /compute/v2.1/servers/54682cce-6601-49d1-88f7-1c9fcaf7d370 => generated 1316 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:57:53.187223 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-6fcc9c7c-c4bf-401b-bfeb-b5f1624e3fa4 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:53.188224 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-6fcc9c7c-c4bf-401b-bfeb-b5f1624e3fa4 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 93c96362-cc02-493d-a96b-ca19cf3a4e47] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:53.198006 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6fcc9c7c-c4bf-401b-bfeb-b5f1624e3fa4 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:53.200543 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6fcc9c7c-c4bf-401b-bfeb-b5f1624e3fa4 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:53.200994 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6fcc9c7c-c4bf-401b-bfeb-b5f1624e3fa4 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:53.201817 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6fcc9c7c-c4bf-401b-bfeb-b5f1624e3fa4 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:53.202177 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6fcc9c7c-c4bf-401b-bfeb-b5f1624e3fa4 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:53.204620 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6fcc9c7c-c4bf-401b-bfeb-b5f1624e3fa4 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:53.215859 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:57:53.251959 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-11408948-7871-4c56-963d-756098270341 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcc2feab6eb427cb1c1ac9093670ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4190feabcb36413fb443349aadc93a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:53.262724 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-11408948-7871-4c56-963d-756098270341 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcc2feab6eb427cb1c1ac9093670ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4190feabcb36413fb443349aadc93a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:53.265019 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-11408948-7871-4c56-963d-756098270341 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcc2feab6eb427cb1c1ac9093670ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4190feabcb36413fb443349aadc93a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:53.266554 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-11408948-7871-4c56-963d-756098270341 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] 10.222.0.70 "GET /compute/v2.1/servers/d6a40f7a-6709-4e75-b3e8-f98abf1b03d8" status: 200 len: 1336 microversion: 2.54 time: 0.167403 Aug 27 02:57:53.269966 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1788/3567] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:57:53 2022] GET /compute/v2.1/servers/d6a40f7a-6709-4e75-b3e8-f98abf1b03d8 => generated 1336 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:57:53.275195 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-dd3d7fb3-1595-41e3-bd8b-c0e795f1d468 req-7d5f7c49-c937-499e-8167-b932d7d7bfe7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54682cce-6601-49d1-88f7-1c9fcaf7d370", "name": "network-vif-plugged", "status": "completed", "tag": "630d16a1-f5f9-4ff7-8090-d69fbd0a36a7"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:57:53.285668 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-dd3d7fb3-1595-41e3-bd8b-c0e795f1d468 req-7d5f7c49-c937-499e-8167-b932d7d7bfe7 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:53.286325 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-dd3d7fb3-1595-41e3-bd8b-c0e795f1d468 req-7d5f7c49-c937-499e-8167-b932d7d7bfe7 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:53.286904 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-dd3d7fb3-1595-41e3-bd8b-c0e795f1d468 req-7d5f7c49-c937-499e-8167-b932d7d7bfe7 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:53.314563 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-dd3d7fb3-1595-41e3-bd8b-c0e795f1d468 req-7d5f7c49-c937-499e-8167-b932d7d7bfe7 service nova] Creating event network-vif-plugged:630d16a1-f5f9-4ff7-8090-d69fbd0a36a7 for instance 54682cce-6601-49d1-88f7-1c9fcaf7d370 on n-h2-852278-4 Aug 27 02:57:53.328644 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-dd3d7fb3-1595-41e3-bd8b-c0e795f1d468 req-7d5f7c49-c937-499e-8167-b932d7d7bfe7 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057165 Aug 27 02:57:53.331925 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1789/3568] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:57:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:57:53.415916 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-6fcc9c7c-c4bf-401b-bfeb-b5f1624e3fa4 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:53.429247 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-6fcc9c7c-c4bf-401b-bfeb-b5f1624e3fa4 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/93c96362-cc02-493d-a96b-ca19cf3a4e47" status: 200 len: 1315 microversion: 2.1 time: 0.246124 Aug 27 02:57:53.430519 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1780/3569] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:57:53 2022] GET /compute/v2.1/servers/93c96362-cc02-493d-a96b-ca19cf3a4e47 => generated 1315 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:57:54.118301 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-69106a58-67aa-442c-b9dd-ce6541b0b3e4 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:54.120430 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-69106a58-67aa-442c-b9dd-ce6541b0b3e4 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] [instance: 02eba429-ecb3-4a5c-87ea-c049ad7aca1a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:54.132679 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-69106a58-67aa-442c-b9dd-ce6541b0b3e4 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:54.133511 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-69106a58-67aa-442c-b9dd-ce6541b0b3e4 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:54.134098 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-69106a58-67aa-442c-b9dd-ce6541b0b3e4 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:54.135412 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-69106a58-67aa-442c-b9dd-ce6541b0b3e4 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:54.136156 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-69106a58-67aa-442c-b9dd-ce6541b0b3e4 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:54.137873 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-69106a58-67aa-442c-b9dd-ce6541b0b3e4 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:54.148196 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8b36e8df-c1e9-4399-a989-e11845b900e1 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:54.149763 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-8b36e8df-c1e9-4399-a989-e11845b900e1 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] [instance: 54682cce-6601-49d1-88f7-1c9fcaf7d370] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:54.164129 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8b36e8df-c1e9-4399-a989-e11845b900e1 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:54.173120 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8b36e8df-c1e9-4399-a989-e11845b900e1 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:54.173574 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8b36e8df-c1e9-4399-a989-e11845b900e1 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:54.174309 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8b36e8df-c1e9-4399-a989-e11845b900e1 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:54.175888 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8b36e8df-c1e9-4399-a989-e11845b900e1 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:54.176434 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8b36e8df-c1e9-4399-a989-e11845b900e1 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:54.376245 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-69106a58-67aa-442c-b9dd-ce6541b0b3e4 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b217f9cbc204919ba77d885315907c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2448b78114c54dd39bc85538fb973dd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:54.389679 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-69106a58-67aa-442c-b9dd-ce6541b0b3e4 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] 10.222.0.70 "GET /compute/v2.1/servers/02eba429-ecb3-4a5c-87ea-c049ad7aca1a" status: 200 len: 1521 microversion: 2.1 time: 0.279097 Aug 27 02:57:54.392663 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1790/3570] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:57:54 2022] GET /compute/v2.1/servers/02eba429-ecb3-4a5c-87ea-c049ad7aca1a => generated 1521 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:57:54.403211 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5db7ed30-b15c-4f63-838c-d90cb98f3673 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:54.404241 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-5db7ed30-b15c-4f63-838c-d90cb98f3673 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] [instance: d6a40f7a-6709-4e75-b3e8-f98abf1b03d8] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:54.417514 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5db7ed30-b15c-4f63-838c-d90cb98f3673 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:54.418098 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-8b36e8df-c1e9-4399-a989-e11845b900e1 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6381ae230a45de8b105374c2d25383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a6a888c878245cb9e5909e071c9b9c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:54.418577 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5db7ed30-b15c-4f63-838c-d90cb98f3673 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:54.419719 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5db7ed30-b15c-4f63-838c-d90cb98f3673 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:54.420618 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5db7ed30-b15c-4f63-838c-d90cb98f3673 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:54.421577 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5db7ed30-b15c-4f63-838c-d90cb98f3673 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:54.422449 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5db7ed30-b15c-4f63-838c-d90cb98f3673 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:54.430249 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-8b36e8df-c1e9-4399-a989-e11845b900e1 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] 10.222.0.70 "GET /compute/v2.1/servers/54682cce-6601-49d1-88f7-1c9fcaf7d370" status: 200 len: 1316 microversion: 2.1 time: 0.285897 Aug 27 02:57:54.433376 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1781/3571] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:57:54 2022] GET /compute/v2.1/servers/54682cce-6601-49d1-88f7-1c9fcaf7d370 => generated 1316 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:57:54.460552 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8dd56578-ca80-47ef-9cd5-2adc9d2e78b7 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:54.461566 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-8dd56578-ca80-47ef-9cd5-2adc9d2e78b7 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 93c96362-cc02-493d-a96b-ca19cf3a4e47] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:54.471957 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8dd56578-ca80-47ef-9cd5-2adc9d2e78b7 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:54.472616 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8dd56578-ca80-47ef-9cd5-2adc9d2e78b7 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:54.473465 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8dd56578-ca80-47ef-9cd5-2adc9d2e78b7 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:54.474303 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8dd56578-ca80-47ef-9cd5-2adc9d2e78b7 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:54.475043 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8dd56578-ca80-47ef-9cd5-2adc9d2e78b7 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:54.475676 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8dd56578-ca80-47ef-9cd5-2adc9d2e78b7 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:54.545463 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-5db7ed30-b15c-4f63-838c-d90cb98f3673 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcc2feab6eb427cb1c1ac9093670ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4190feabcb36413fb443349aadc93a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:54.555507 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-5db7ed30-b15c-4f63-838c-d90cb98f3673 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcc2feab6eb427cb1c1ac9093670ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4190feabcb36413fb443349aadc93a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:54.557231 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-5db7ed30-b15c-4f63-838c-d90cb98f3673 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcc2feab6eb427cb1c1ac9093670ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4190feabcb36413fb443349aadc93a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:54.558695 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-5db7ed30-b15c-4f63-838c-d90cb98f3673 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] 10.222.0.70 "GET /compute/v2.1/servers/d6a40f7a-6709-4e75-b3e8-f98abf1b03d8" status: 200 len: 1336 microversion: 2.54 time: 0.164675 Aug 27 02:57:54.559695 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1791/3572] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:57:54 2022] GET /compute/v2.1/servers/d6a40f7a-6709-4e75-b3e8-f98abf1b03d8 => generated 1336 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:57:54.648490 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-8dd56578-ca80-47ef-9cd5-2adc9d2e78b7 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:54.657253 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-8dd56578-ca80-47ef-9cd5-2adc9d2e78b7 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/93c96362-cc02-493d-a96b-ca19cf3a4e47" status: 200 len: 1315 microversion: 2.1 time: 0.201974 Aug 27 02:57:54.657833 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1782/3573] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:57:54 2022] GET /compute/v2.1/servers/93c96362-cc02-493d-a96b-ca19cf3a4e47 => generated 1315 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:57:55.389662 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-85daba78-5dba-4bc1-913f-95927e649a93 req-3f4df7e7-4ef1-4c58-8a0f-aa136b52188f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93c96362-cc02-493d-a96b-ca19cf3a4e47", "name": "network-vif-plugged", "status": "completed", "tag": "89392832-a58f-4596-ba39-a4d42c287569"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:57:55.405229 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-85daba78-5dba-4bc1-913f-95927e649a93 req-3f4df7e7-4ef1-4c58-8a0f-aa136b52188f service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:55.405779 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-85daba78-5dba-4bc1-913f-95927e649a93 req-3f4df7e7-4ef1-4c58-8a0f-aa136b52188f service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:55.406377 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-85daba78-5dba-4bc1-913f-95927e649a93 req-3f4df7e7-4ef1-4c58-8a0f-aa136b52188f service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:55.415392 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-50747e30-fc69-4511-84cf-1fffba49ea9c tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:55.416023 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-50747e30-fc69-4511-84cf-1fffba49ea9c tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] [instance: 02eba429-ecb3-4a5c-87ea-c049ad7aca1a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:55.420361 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-85daba78-5dba-4bc1-913f-95927e649a93 req-3f4df7e7-4ef1-4c58-8a0f-aa136b52188f service nova] Creating event network-vif-plugged:89392832-a58f-4596-ba39-a4d42c287569 for instance 93c96362-cc02-493d-a96b-ca19cf3a4e47 on n-h1-852278-4 Aug 27 02:57:55.424937 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-50747e30-fc69-4511-84cf-1fffba49ea9c tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:55.425628 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-50747e30-fc69-4511-84cf-1fffba49ea9c tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:55.425771 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-85daba78-5dba-4bc1-913f-95927e649a93 req-3f4df7e7-4ef1-4c58-8a0f-aa136b52188f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050984 Aug 27 02:57:55.426449 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1792/3574] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:57:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:57:55.426970 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-50747e30-fc69-4511-84cf-1fffba49ea9c tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:55.428466 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-50747e30-fc69-4511-84cf-1fffba49ea9c tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:55.429795 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-50747e30-fc69-4511-84cf-1fffba49ea9c tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:55.431004 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-50747e30-fc69-4511-84cf-1fffba49ea9c tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:55.455349 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-2633dcb7-9587-40c8-82eb-fd7987ef8201 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:55.456388 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-2633dcb7-9587-40c8-82eb-fd7987ef8201 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] [instance: 54682cce-6601-49d1-88f7-1c9fcaf7d370] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:55.483618 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2633dcb7-9587-40c8-82eb-fd7987ef8201 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:55.487376 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2633dcb7-9587-40c8-82eb-fd7987ef8201 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:55.487845 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2633dcb7-9587-40c8-82eb-fd7987ef8201 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:55.488651 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2633dcb7-9587-40c8-82eb-fd7987ef8201 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:55.489145 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2633dcb7-9587-40c8-82eb-fd7987ef8201 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:55.489530 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2633dcb7-9587-40c8-82eb-fd7987ef8201 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:55.799598 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-50747e30-fc69-4511-84cf-1fffba49ea9c tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b217f9cbc204919ba77d885315907c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2448b78114c54dd39bc85538fb973dd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:55.809023 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-50747e30-fc69-4511-84cf-1fffba49ea9c tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] 10.222.0.70 "GET /compute/v2.1/servers/02eba429-ecb3-4a5c-87ea-c049ad7aca1a" status: 200 len: 1521 microversion: 2.1 time: 0.398437 Aug 27 02:57:55.810470 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1783/3575] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:57:55 2022] GET /compute/v2.1/servers/02eba429-ecb3-4a5c-87ea-c049ad7aca1a => generated 1521 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:57:55.816009 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-1d68ec0b-1d75-4184-a6ff-753e2c9b023d tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:55.816991 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-1d68ec0b-1d75-4184-a6ff-753e2c9b023d tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] [instance: d6a40f7a-6709-4e75-b3e8-f98abf1b03d8] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:55.824522 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1d68ec0b-1d75-4184-a6ff-753e2c9b023d tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:55.825264 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1d68ec0b-1d75-4184-a6ff-753e2c9b023d tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:55.825900 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1d68ec0b-1d75-4184-a6ff-753e2c9b023d tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:55.826759 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1d68ec0b-1d75-4184-a6ff-753e2c9b023d tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:55.827352 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1d68ec0b-1d75-4184-a6ff-753e2c9b023d tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:55.827973 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1d68ec0b-1d75-4184-a6ff-753e2c9b023d tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:55.888369 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-2633dcb7-9587-40c8-82eb-fd7987ef8201 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6381ae230a45de8b105374c2d25383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a6a888c878245cb9e5909e071c9b9c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:55.898946 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-2633dcb7-9587-40c8-82eb-fd7987ef8201 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] 10.222.0.70 "GET /compute/v2.1/servers/54682cce-6601-49d1-88f7-1c9fcaf7d370" status: 200 len: 1316 microversion: 2.1 time: 0.447519 Aug 27 02:57:55.900149 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1793/3576] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:57:55 2022] GET /compute/v2.1/servers/54682cce-6601-49d1-88f7-1c9fcaf7d370 => generated 1316 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:57:55.905265 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ae2fecef-7b67-40ce-9a1e-9169fb58b49c tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:55.906147 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-ae2fecef-7b67-40ce-9a1e-9169fb58b49c tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 93c96362-cc02-493d-a96b-ca19cf3a4e47] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:55.913073 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ae2fecef-7b67-40ce-9a1e-9169fb58b49c tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:55.913826 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ae2fecef-7b67-40ce-9a1e-9169fb58b49c tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:55.914585 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ae2fecef-7b67-40ce-9a1e-9169fb58b49c tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:55.915599 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ae2fecef-7b67-40ce-9a1e-9169fb58b49c tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:55.916140 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ae2fecef-7b67-40ce-9a1e-9169fb58b49c tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:55.916786 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ae2fecef-7b67-40ce-9a1e-9169fb58b49c tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:55.947827 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-1d68ec0b-1d75-4184-a6ff-753e2c9b023d tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcc2feab6eb427cb1c1ac9093670ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4190feabcb36413fb443349aadc93a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:55.960963 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-1d68ec0b-1d75-4184-a6ff-753e2c9b023d tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcc2feab6eb427cb1c1ac9093670ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4190feabcb36413fb443349aadc93a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:55.962933 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-1d68ec0b-1d75-4184-a6ff-753e2c9b023d tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcc2feab6eb427cb1c1ac9093670ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4190feabcb36413fb443349aadc93a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:55.964122 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-1d68ec0b-1d75-4184-a6ff-753e2c9b023d tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] 10.222.0.70 "GET /compute/v2.1/servers/d6a40f7a-6709-4e75-b3e8-f98abf1b03d8" status: 200 len: 1357 microversion: 2.54 time: 0.152458 Aug 27 02:57:55.964882 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1784/3577] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:57:55 2022] GET /compute/v2.1/servers/d6a40f7a-6709-4e75-b3e8-f98abf1b03d8 => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:57:55.997196 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c9f4ca93-1ae0-4ef3-8956-a68ce9d19f01 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Action: 'create', calling method: .version_select at 0x7f5ee72063a0>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-1050784670", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL0vBBs0HLAte2BPIDB9qtwDT16e47K6B8CaXvZqt6RFolYnE8Tyq8Vl1XJjU5dds0aA1Kl9xT30pdE9QF+UdDbnVHvI9GNhHBsiv+T7oDniLCmFulIGQrIJIsPDLKNCNw=="}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:57:56.015071 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-c9f4ca93-1ae0-4ef3-8956-a68ce9d19f01 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Getting quotas for project 4190feabcb36413fb443349aadc93a01. Resources: {'key_pairs'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:57:56.021710 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-c9f4ca93-1ae0-4ef3-8956-a68ce9d19f01 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Getting quotas for user cfcc2feab6eb427cb1c1ac9093670ba2 and project 4190feabcb36413fb443349aadc93a01. Resources: {'key_pairs'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:57:56.048792 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c9f4ca93-1ae0-4ef3-8956-a68ce9d19f01 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.54 time: 0.059045 Aug 27 02:57:56.050088 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1785/3578] 10.222.0.70 () {62 vars in 1200 bytes} [Sat Aug 27 02:57:55 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 61 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 27 02:57:56.062132 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0dac63b6-ebd8-42ee-8ce8-d4dd93aabf75 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-1050784670", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:57:56.065061 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-0dac63b6-ebd8-42ee-8ce8-d4dd93aabf75 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] [instance: d6a40f7a-6709-4e75-b3e8-f98abf1b03d8] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:56.071435 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0dac63b6-ebd8-42ee-8ce8-d4dd93aabf75 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:56.072157 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0dac63b6-ebd8-42ee-8ce8-d4dd93aabf75 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:56.072636 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0dac63b6-ebd8-42ee-8ce8-d4dd93aabf75 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:56.073331 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0dac63b6-ebd8-42ee-8ce8-d4dd93aabf75 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:56.073920 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0dac63b6-ebd8-42ee-8ce8-d4dd93aabf75 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:56.074363 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0dac63b6-ebd8-42ee-8ce8-d4dd93aabf75 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:56.103978 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-ae2fecef-7b67-40ce-9a1e-9169fb58b49c tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:56.114420 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ae2fecef-7b67-40ce-9a1e-9169fb58b49c tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/93c96362-cc02-493d-a96b-ca19cf3a4e47" status: 200 len: 1315 microversion: 2.1 time: 0.213061 Aug 27 02:57:56.121885 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1794/3579] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:57:55 2022] GET /compute/v2.1/servers/93c96362-cc02-493d-a96b-ca19cf3a4e47 => generated 1315 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:57:56.174127 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-0dac63b6-ebd8-42ee-8ce8-d4dd93aabf75 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Flavor limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:57:56.174718 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-0dac63b6-ebd8-42ee-8ce8-d4dd93aabf75 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Image limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:57:56.175349 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-0dac63b6-ebd8-42ee-8ce8-d4dd93aabf75 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Flavor pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:57:56.175905 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-0dac63b6-ebd8-42ee-8ce8-d4dd93aabf75 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Image pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:57:56.176672 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-0dac63b6-ebd8-42ee-8ce8-d4dd93aabf75 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:57:56.310352 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-0dac63b6-ebd8-42ee-8ce8-d4dd93aabf75 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] [instance: d6a40f7a-6709-4e75-b3e8-f98abf1b03d8] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:56.321069 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0dac63b6-ebd8-42ee-8ce8-d4dd93aabf75 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:56.322026 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0dac63b6-ebd8-42ee-8ce8-d4dd93aabf75 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:56.322678 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0dac63b6-ebd8-42ee-8ce8-d4dd93aabf75 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:56.323631 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0dac63b6-ebd8-42ee-8ce8-d4dd93aabf75 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:56.324478 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0dac63b6-ebd8-42ee-8ce8-d4dd93aabf75 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:56.325190 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0dac63b6-ebd8-42ee-8ce8-d4dd93aabf75 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:56.364132 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-0dac63b6-ebd8-42ee-8ce8-d4dd93aabf75 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] 10.222.0.70 "POST /compute/v2.1/servers/d6a40f7a-6709-4e75-b3e8-f98abf1b03d8/action" status: 202 len: 1140 microversion: 2.54 time: 0.307008 Aug 27 02:57:56.366215 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1786/3580] 10.222.0.70 () {62 vars in 1320 bytes} [Sat Aug 27 02:57:56 2022] POST /compute/v2.1/servers/d6a40f7a-6709-4e75-b3e8-f98abf1b03d8/action => generated 1140 bytes in 310 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Aug 27 02:57:56.392778 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-1952a198-4919-453f-92c5-1b3eb936b927 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:56.396120 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-1952a198-4919-453f-92c5-1b3eb936b927 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] [instance: d6a40f7a-6709-4e75-b3e8-f98abf1b03d8] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:56.414131 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1952a198-4919-453f-92c5-1b3eb936b927 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:56.420613 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1952a198-4919-453f-92c5-1b3eb936b927 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:56.421345 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1952a198-4919-453f-92c5-1b3eb936b927 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:56.422461 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1952a198-4919-453f-92c5-1b3eb936b927 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:56.423185 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1952a198-4919-453f-92c5-1b3eb936b927 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:56.425311 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1952a198-4919-453f-92c5-1b3eb936b927 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:56.504668 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-1952a198-4919-453f-92c5-1b3eb936b927 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcc2feab6eb427cb1c1ac9093670ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4190feabcb36413fb443349aadc93a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:56.517038 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-1952a198-4919-453f-92c5-1b3eb936b927 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcc2feab6eb427cb1c1ac9093670ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4190feabcb36413fb443349aadc93a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:56.518799 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-1952a198-4919-453f-92c5-1b3eb936b927 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcc2feab6eb427cb1c1ac9093670ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4190feabcb36413fb443349aadc93a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:56.520852 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-1952a198-4919-453f-92c5-1b3eb936b927 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] 10.222.0.70 "GET /compute/v2.1/servers/d6a40f7a-6709-4e75-b3e8-f98abf1b03d8" status: 200 len: 1409 microversion: 2.54 time: 0.139690 Aug 27 02:57:56.522062 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1795/3581] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:57:56 2022] GET /compute/v2.1/servers/d6a40f7a-6709-4e75-b3e8-f98abf1b03d8 => generated 1409 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:57:56.833553 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0b325e65-b46e-4eb9-ad7c-71cf35c801a5 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:56.834105 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-0b325e65-b46e-4eb9-ad7c-71cf35c801a5 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] [instance: 02eba429-ecb3-4a5c-87ea-c049ad7aca1a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:56.859268 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0b325e65-b46e-4eb9-ad7c-71cf35c801a5 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:56.859836 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0b325e65-b46e-4eb9-ad7c-71cf35c801a5 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:56.864637 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0b325e65-b46e-4eb9-ad7c-71cf35c801a5 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:56.865670 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0b325e65-b46e-4eb9-ad7c-71cf35c801a5 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:56.866151 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0b325e65-b46e-4eb9-ad7c-71cf35c801a5 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:56.866593 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0b325e65-b46e-4eb9-ad7c-71cf35c801a5 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:56.920489 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e06136f4-17ab-4a7d-aeb7-bb07f8b8b9be tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:56.923078 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-e06136f4-17ab-4a7d-aeb7-bb07f8b8b9be tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] [instance: 54682cce-6601-49d1-88f7-1c9fcaf7d370] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:56.927162 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=12 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:57:56.938982 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e06136f4-17ab-4a7d-aeb7-bb07f8b8b9be tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:56.939762 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e06136f4-17ab-4a7d-aeb7-bb07f8b8b9be tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:56.940359 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e06136f4-17ab-4a7d-aeb7-bb07f8b8b9be tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:56.941224 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e06136f4-17ab-4a7d-aeb7-bb07f8b8b9be tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:56.941836 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e06136f4-17ab-4a7d-aeb7-bb07f8b8b9be tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:56.942392 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e06136f4-17ab-4a7d-aeb7-bb07f8b8b9be tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:57.214078 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-0b325e65-b46e-4eb9-ad7c-71cf35c801a5 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b217f9cbc204919ba77d885315907c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2448b78114c54dd39bc85538fb973dd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:57.225646 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-e06136f4-17ab-4a7d-aeb7-bb07f8b8b9be tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6381ae230a45de8b105374c2d25383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a6a888c878245cb9e5909e071c9b9c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:57.231131 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-0b325e65-b46e-4eb9-ad7c-71cf35c801a5 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] 10.222.0.70 "GET /compute/v2.1/servers/02eba429-ecb3-4a5c-87ea-c049ad7aca1a" status: 200 len: 1521 microversion: 2.1 time: 0.394982 Aug 27 02:57:57.237468 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e06136f4-17ab-4a7d-aeb7-bb07f8b8b9be tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] 10.222.0.70 "GET /compute/v2.1/servers/54682cce-6601-49d1-88f7-1c9fcaf7d370" status: 200 len: 1504 microversion: 2.1 time: 0.322215 Aug 27 02:57:57.237728 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1787/3582] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:57:56 2022] GET /compute/v2.1/servers/02eba429-ecb3-4a5c-87ea-c049ad7aca1a => generated 1521 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:57:57.249638 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1796/3583] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:57:56 2022] GET /compute/v2.1/servers/54682cce-6601-49d1-88f7-1c9fcaf7d370 => generated 1504 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:57:57.261503 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-9ef961ff-234a-406f-953b-9be424add04d tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:57.261822 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-da165037-8645-45db-b637-b5ea3d7b844a tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2081015763"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:57:57.262124 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-9ef961ff-234a-406f-953b-9be424add04d tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 93c96362-cc02-493d-a96b-ca19cf3a4e47] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:57.262689 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-da165037-8645-45db-b637-b5ea3d7b844a tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] [instance: 54682cce-6601-49d1-88f7-1c9fcaf7d370] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:57.276862 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9ef961ff-234a-406f-953b-9be424add04d tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:57.277472 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9ef961ff-234a-406f-953b-9be424add04d tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:57.277798 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-da165037-8645-45db-b637-b5ea3d7b844a tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:57.278111 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9ef961ff-234a-406f-953b-9be424add04d tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:57.278992 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9ef961ff-234a-406f-953b-9be424add04d tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:57.279107 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-da165037-8645-45db-b637-b5ea3d7b844a tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:57.279622 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9ef961ff-234a-406f-953b-9be424add04d tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:57.279840 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-da165037-8645-45db-b637-b5ea3d7b844a tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:57.280301 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9ef961ff-234a-406f-953b-9be424add04d tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:57.281382 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-da165037-8645-45db-b637-b5ea3d7b844a tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:57.281834 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-da165037-8645-45db-b637-b5ea3d7b844a tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:57.282261 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-da165037-8645-45db-b637-b5ea3d7b844a tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:57.648204 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.network.security_group_api [None req-da165037-8645-45db-b637-b5ea3d7b844a tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Adding security group 0b1054b2-aba6-4ca8-8a63-ea6eb56c66ef to port 630d16a1-f5f9-4ff7-8090-d69fbd0a36a7 Aug 27 02:57:57.781694 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-9ef961ff-234a-406f-953b-9be424add04d tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:57.789477 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-9ef961ff-234a-406f-953b-9be424add04d tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/93c96362-cc02-493d-a96b-ca19cf3a4e47" status: 200 len: 1503 microversion: 2.1 time: 0.550527 Aug 27 02:57:57.805037 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1788/3584] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:57:57 2022] GET /compute/v2.1/servers/93c96362-cc02-493d-a96b-ca19cf3a4e47 => generated 1503 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:57:57.805037 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-1599c1ed-a6ef-4a0f-95ca-7659c5c0fbe1 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:57.805037 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-1599c1ed-a6ef-4a0f-95ca-7659c5c0fbe1 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] [instance: d6a40f7a-6709-4e75-b3e8-f98abf1b03d8] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:57.818799 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1599c1ed-a6ef-4a0f-95ca-7659c5c0fbe1 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:57.819287 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1599c1ed-a6ef-4a0f-95ca-7659c5c0fbe1 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:57.819717 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1599c1ed-a6ef-4a0f-95ca-7659c5c0fbe1 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:57.820519 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1599c1ed-a6ef-4a0f-95ca-7659c5c0fbe1 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:57.820962 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1599c1ed-a6ef-4a0f-95ca-7659c5c0fbe1 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:57.821376 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1599c1ed-a6ef-4a0f-95ca-7659c5c0fbe1 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:57.975544 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-1599c1ed-a6ef-4a0f-95ca-7659c5c0fbe1 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcc2feab6eb427cb1c1ac9093670ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4190feabcb36413fb443349aadc93a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:57.994436 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-1599c1ed-a6ef-4a0f-95ca-7659c5c0fbe1 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcc2feab6eb427cb1c1ac9093670ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4190feabcb36413fb443349aadc93a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:57.995640 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-1599c1ed-a6ef-4a0f-95ca-7659c5c0fbe1 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcc2feab6eb427cb1c1ac9093670ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4190feabcb36413fb443349aadc93a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:58.005772 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-1599c1ed-a6ef-4a0f-95ca-7659c5c0fbe1 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] 10.222.0.70 "GET /compute/v2.1/servers/d6a40f7a-6709-4e75-b3e8-f98abf1b03d8" status: 200 len: 1409 microversion: 2.54 time: 0.206147 Aug 27 02:57:58.006584 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1789/3585] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:57:57 2022] GET /compute/v2.1/servers/d6a40f7a-6709-4e75-b3e8-f98abf1b03d8 => generated 1409 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:57:58.025567 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0856d995-271b-4df1-a696-d0d82e173a18 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:57:58.030511 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-0856d995-271b-4df1-a696-d0d82e173a18 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 93c96362-cc02-493d-a96b-ca19cf3a4e47] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:58.046537 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0856d995-271b-4df1-a696-d0d82e173a18 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:58.048194 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0856d995-271b-4df1-a696-d0d82e173a18 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:58.048830 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0856d995-271b-4df1-a696-d0d82e173a18 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:58.050512 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0856d995-271b-4df1-a696-d0d82e173a18 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:58.051804 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0856d995-271b-4df1-a696-d0d82e173a18 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:58.052273 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0856d995-271b-4df1-a696-d0d82e173a18 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:58.193152 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-0856d995-271b-4df1-a696-d0d82e173a18 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "POST /compute/v2.1/servers/93c96362-cc02-493d-a96b-ca19cf3a4e47/action" status: 202 len: 0 microversion: 2.1 time: 0.185139 Aug 27 02:57:58.196274 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1790/3586] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 02:57:58 2022] POST /compute/v2.1/servers/93c96362-cc02-493d-a96b-ca19cf3a4e47/action => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:57:58.223471 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-77f727b3-bf32-48a1-9e54-9c29529f2180 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:58.228392 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-77f727b3-bf32-48a1-9e54-9c29529f2180 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 93c96362-cc02-493d-a96b-ca19cf3a4e47] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:58.236039 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-77f727b3-bf32-48a1-9e54-9c29529f2180 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:58.237514 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-77f727b3-bf32-48a1-9e54-9c29529f2180 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:58.238302 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-77f727b3-bf32-48a1-9e54-9c29529f2180 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:58.239477 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-77f727b3-bf32-48a1-9e54-9c29529f2180 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:58.240528 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-77f727b3-bf32-48a1-9e54-9c29529f2180 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:58.241158 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-77f727b3-bf32-48a1-9e54-9c29529f2180 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:58.559186 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-da165037-8645-45db-b637-b5ea3d7b844a tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] 10.222.0.70 "POST /compute/v2.1/servers/54682cce-6601-49d1-88f7-1c9fcaf7d370/action" status: 202 len: 0 microversion: 2.1 time: 1.301735 Aug 27 02:57:58.559946 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1797/3587] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 02:57:57 2022] POST /compute/v2.1/servers/54682cce-6601-49d1-88f7-1c9fcaf7d370/action => generated 0 bytes in 1303 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 02:57:58.569517 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-691e38e3-9cb0-4b65-b8b7-3a7d5ca800e9 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:58.569517 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-691e38e3-9cb0-4b65-b8b7-3a7d5ca800e9 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] [instance: 02eba429-ecb3-4a5c-87ea-c049ad7aca1a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:58.582628 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-691e38e3-9cb0-4b65-b8b7-3a7d5ca800e9 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:58.588733 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-691e38e3-9cb0-4b65-b8b7-3a7d5ca800e9 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:58.589656 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-691e38e3-9cb0-4b65-b8b7-3a7d5ca800e9 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:58.592368 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-691e38e3-9cb0-4b65-b8b7-3a7d5ca800e9 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:58.593293 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-691e38e3-9cb0-4b65-b8b7-3a7d5ca800e9 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:58.595471 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-691e38e3-9cb0-4b65-b8b7-3a7d5ca800e9 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:58.628182 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=100 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:57:58.713304 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-77f727b3-bf32-48a1-9e54-9c29529f2180 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:58.725084 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-77f727b3-bf32-48a1-9e54-9c29529f2180 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/93c96362-cc02-493d-a96b-ca19cf3a4e47" status: 200 len: 1508 microversion: 2.1 time: 0.508540 Aug 27 02:57:58.728607 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1791/3588] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:57:58 2022] GET /compute/v2.1/servers/93c96362-cc02-493d-a96b-ca19cf3a4e47 => generated 1508 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:57:58.738285 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-20e02ded-7549-49df-a5d6-0a7b8ef055c8 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Calling method '.version_select at 0x7f5ee71951f0>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:58.889779 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-691e38e3-9cb0-4b65-b8b7-3a7d5ca800e9 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b217f9cbc204919ba77d885315907c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2448b78114c54dd39bc85538fb973dd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:58.908704 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-691e38e3-9cb0-4b65-b8b7-3a7d5ca800e9 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] 10.222.0.70 "GET /compute/v2.1/servers/02eba429-ecb3-4a5c-87ea-c049ad7aca1a" status: 200 len: 1521 microversion: 2.1 time: 0.345793 Aug 27 02:57:58.910346 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1798/3589] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:57:58 2022] GET /compute/v2.1/servers/02eba429-ecb3-4a5c-87ea-c049ad7aca1a => generated 1521 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:57:58.922616 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-3eef05fc-fe76-40bb-a92d-30cd0c3ae17a req-4ac7240c-0298-4c47-95e9-c0412e5e4ff9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54682cce-6601-49d1-88f7-1c9fcaf7d370", "tag": "630d16a1-f5f9-4ff7-8090-d69fbd0a36a7"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:57:58.933320 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-3eef05fc-fe76-40bb-a92d-30cd0c3ae17a req-4ac7240c-0298-4c47-95e9-c0412e5e4ff9 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:58.933769 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-3eef05fc-fe76-40bb-a92d-30cd0c3ae17a req-4ac7240c-0298-4c47-95e9-c0412e5e4ff9 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:58.934365 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-3eef05fc-fe76-40bb-a92d-30cd0c3ae17a req-4ac7240c-0298-4c47-95e9-c0412e5e4ff9 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:58.939489 n-d-852278-4 devstack@n-api.service[134051]: DEBUG neutronclient.v2_0.client [None req-20e02ded-7549-49df-a5d6-0a7b8ef055c8 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 0b1054b2-aba6-4ca8-8a63-ea6eb56c66ef in use.", "detail": ""}} {{(pid=134051) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 02:57:58.940197 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-20e02ded-7549-49df-a5d6-0a7b8ef055c8 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] HTTP exception thrown: Security Group 0b1054b2-aba6-4ca8-8a63-ea6eb56c66ef in use. Aug 27 02:57:58.940197 n-d-852278-4 devstack@n-api.service[134051]: Neutron server returns request_ids: ['req-d6f33552-30d6-4685-9172-3b317715d493'] Aug 27 02:57:58.942339 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-20e02ded-7549-49df-a5d6-0a7b8ef055c8 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Request method failure captured: Aug 27 02:57:58.942339 n-d-852278-4 devstack@n-api.service[134051]: request: DELETE /compute/v2.1/os-security-groups/0b1054b2-aba6-4ca8-8a63-ea6eb56c66ef HTTP/1.1 Aug 27 02:57:58.942339 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:57:58.942339 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:57:58.942339 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:57:58.942339 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:57:58.942339 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:57:58.942339 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:57:58.942339 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:57:58.942339 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:57:58.942339 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYf2b88jccGp908k3vQwdmk8aWVpZgx4XAwdI__tT5JQ00leavue9yGRA0Ra6tx0k8LuwOwvFz5QHaUm9YwpVl7ey0u_0fYkHaP7j9Kliw_5Q5Xf4F9k_115SseZDZeFd_ncRBfnV98omKQ5oUaf4zu042RXCwV00aKzeJyDrzb4sII Aug 27 02:57:58.942339 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:57:58.942339 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:57:58.942339 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:57:58.942339 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:57:58.942339 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:57:58.942339 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:57:58.942339 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 2a6a888c878245cb9e5909e071c9b9c2 Aug 27 02:57:58.942339 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-SecurityGroupsTestJSON-23859158 Aug 27 02:57:58.942339 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:57:58.942339 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:57:58.942339 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2a6a888c878245cb9e5909e071c9b9c2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_2a6a888c878245cb9e5909e071c9b9c2", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2a6a888c878245cb9e5909e071c9b9c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/2a6a888c878245cb9e5909e071c9b9c2"}]}] Aug 27 02:57:58.942339 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-SecurityGroupsTestJSON-23859158 Aug 27 02:57:58.942339 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 2a6a888c878245cb9e5909e071c9b9c2 Aug 27 02:57:58.942339 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-23859158 Aug 27 02:57:58.942339 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-SecurityGroupsTestJSON-23859158-project Aug 27 02:57:58.942339 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:57:58.942339 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:57:58.942339 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: ef6381ae230a45de8b105374c2d25383 Aug 27 02:57:58.942339 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-SecurityGroupsTestJSON-23859158-project Aug 27 02:57:58.942339 n-d-852278-4 devstack@n-api.service[134051]: method: Aug 27 02:57:58.942339 n-d-852278-4 devstack@n-api.service[134051]: exception: Security Group 0b1054b2-aba6-4ca8-8a63-ea6eb56c66ef in use. Aug 27 02:57:58.942339 n-d-852278-4 devstack@n-api.service[134051]: Neutron server returns request_ids: ['req-d6f33552-30d6-4685-9172-3b317715d493'] Aug 27 02:57:58.942339 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '0b1054b2-aba6-4ca8-8a63-ea6eb56c66ef'} Aug 27 02:57:58.942339 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:57:58.942339 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:57:58.942339 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 27 02:57:58.942339 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 27 02:57:58.942339 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:57:58.942339 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:57:58.942339 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 27 02:57:58.942339 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 27 02:57:58.942339 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:57:58.942339 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:57:58.942339 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 27 02:57:58.942339 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 27 02:57:58.942339 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:57:58.942339 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:57:58.942339 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 02:57:58.942339 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 02:57:58.942339 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:57:58.942339 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:57:58.942339 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 02:57:58.942339 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 02:57:58.942339 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:57:58.942339 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:57:58.942339 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 02:57:58.942339 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 02:57:58.942339 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 02:57:58.942339 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 02:57:58.942339 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 0b1054b2-aba6-4ca8-8a63-ea6eb56c66ef in use. Aug 27 02:57:58.946370 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d6f33552-30d6-4685-9172-3b317715d493'] Aug 27 02:57:58.946370 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:57:58.946370 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:57:58.946370 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:57:58.946370 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:57:58.946370 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 27 02:57:58.946370 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 27 02:57:58.946370 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 27 02:57:58.946370 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 27 02:57:58.946370 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 0b1054b2-aba6-4ca8-8a63-ea6eb56c66ef in use. Aug 27 02:57:58.946370 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d6f33552-30d6-4685-9172-3b317715d493'] Aug 27 02:57:58.946370 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:57:58.946370 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:57:58.946370 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:57:58.946370 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:57:58.946370 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:57:58.946370 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:57:58.946370 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:57:58.946370 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:57:58.946370 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:57:58.946370 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:57:58.946370 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:57:58.946370 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:57:58.946370 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 27 02:57:58.946370 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 27 02:57:58.946370 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 0b1054b2-aba6-4ca8-8a63-ea6eb56c66ef in use. Aug 27 02:57:58.946370 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d6f33552-30d6-4685-9172-3b317715d493'] Aug 27 02:57:58.946370 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:57:58.946370 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:57:58.946370 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:57:58.946370 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:57:58.946370 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:57:58.946370 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:57:58.946370 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:57:58.946370 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:57:58.946370 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 0b1054b2-aba6-4ca8-8a63-ea6eb56c66ef in use. Aug 27 02:57:58.946370 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d6f33552-30d6-4685-9172-3b317715d493'] Aug 27 02:57:58.946370 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:57:58.946370 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-20e02ded-7549-49df-a5d6-0a7b8ef055c8 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Returning 400 to user: Security Group 0b1054b2-aba6-4ca8-8a63-ea6eb56c66ef in use. Aug 27 02:57:58.946370 n-d-852278-4 devstack@n-api.service[134051]: Neutron server returns request_ids: ['req-d6f33552-30d6-4685-9172-3b317715d493'] {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:57:58.946370 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-20e02ded-7549-49df-a5d6-0a7b8ef055c8 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/0b1054b2-aba6-4ca8-8a63-ea6eb56c66ef" status: 400 len: 185 microversion: 2.1 time: 0.212212 Aug 27 02:57:58.946370 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1792/3590] 10.222.0.70 () {58 vars in 1272 bytes} [Sat Aug 27 02:57:58 2022] DELETE /compute/v2.1/os-security-groups/0b1054b2-aba6-4ca8-8a63-ea6eb56c66ef => generated 185 bytes in 216 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 02:57:58.956979 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-3eef05fc-fe76-40bb-a92d-30cd0c3ae17a req-4ac7240c-0298-4c47-95e9-c0412e5e4ff9 service nova] Creating event network-changed:630d16a1-f5f9-4ff7-8090-d69fbd0a36a7 for instance 54682cce-6601-49d1-88f7-1c9fcaf7d370 on n-h2-852278-4 Aug 27 02:57:58.961751 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ec9fe49c-8208-47c6-9104-c86202808801 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:57:58.967811 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-3eef05fc-fe76-40bb-a92d-30cd0c3ae17a req-4ac7240c-0298-4c47-95e9-c0412e5e4ff9 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055352 Aug 27 02:57:58.969100 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1799/3591] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:57:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:57:58.973678 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-ec9fe49c-8208-47c6-9104-c86202808801 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] [instance: 54682cce-6601-49d1-88f7-1c9fcaf7d370] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:58.980690 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:57:59.007817 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ec9fe49c-8208-47c6-9104-c86202808801 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:59.009432 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ec9fe49c-8208-47c6-9104-c86202808801 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:59.010037 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ec9fe49c-8208-47c6-9104-c86202808801 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:59.012695 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ec9fe49c-8208-47c6-9104-c86202808801 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:59.013337 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ec9fe49c-8208-47c6-9104-c86202808801 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:59.015763 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ec9fe49c-8208-47c6-9104-c86202808801 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:59.034323 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-bd4fb35a-09c3-461e-9cee-6fc5becdb493 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:59.039592 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-bd4fb35a-09c3-461e-9cee-6fc5becdb493 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] [instance: d6a40f7a-6709-4e75-b3e8-f98abf1b03d8] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:59.057720 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bd4fb35a-09c3-461e-9cee-6fc5becdb493 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:59.058277 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bd4fb35a-09c3-461e-9cee-6fc5becdb493 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:59.058744 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bd4fb35a-09c3-461e-9cee-6fc5becdb493 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:59.062800 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bd4fb35a-09c3-461e-9cee-6fc5becdb493 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:59.063886 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bd4fb35a-09c3-461e-9cee-6fc5becdb493 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:59.064382 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bd4fb35a-09c3-461e-9cee-6fc5becdb493 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:59.227816 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ec9fe49c-8208-47c6-9104-c86202808801 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] 10.222.0.70 "POST /compute/v2.1/servers/54682cce-6601-49d1-88f7-1c9fcaf7d370/action" status: 202 len: 0 microversion: 2.1 time: 0.277101 Aug 27 02:57:59.229543 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1793/3592] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 02:57:58 2022] POST /compute/v2.1/servers/54682cce-6601-49d1-88f7-1c9fcaf7d370/action => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:57:59.243269 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3e84dccd-6117-4904-81f6-e6c02b0d9096 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:59.244172 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-3e84dccd-6117-4904-81f6-e6c02b0d9096 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] [instance: 54682cce-6601-49d1-88f7-1c9fcaf7d370] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:59.260246 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3e84dccd-6117-4904-81f6-e6c02b0d9096 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:59.263340 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3e84dccd-6117-4904-81f6-e6c02b0d9096 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:59.263977 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3e84dccd-6117-4904-81f6-e6c02b0d9096 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:59.266523 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3e84dccd-6117-4904-81f6-e6c02b0d9096 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:59.267000 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3e84dccd-6117-4904-81f6-e6c02b0d9096 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:59.267437 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3e84dccd-6117-4904-81f6-e6c02b0d9096 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:59.292187 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:57:59.378502 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-bd4fb35a-09c3-461e-9cee-6fc5becdb493 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcc2feab6eb427cb1c1ac9093670ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4190feabcb36413fb443349aadc93a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:59.399968 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-bd4fb35a-09c3-461e-9cee-6fc5becdb493 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcc2feab6eb427cb1c1ac9093670ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4190feabcb36413fb443349aadc93a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:59.408972 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-bd4fb35a-09c3-461e-9cee-6fc5becdb493 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcc2feab6eb427cb1c1ac9093670ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4190feabcb36413fb443349aadc93a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:59.412723 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-bd4fb35a-09c3-461e-9cee-6fc5becdb493 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] 10.222.0.70 "GET /compute/v2.1/servers/d6a40f7a-6709-4e75-b3e8-f98abf1b03d8" status: 200 len: 1409 microversion: 2.54 time: 0.386158 Aug 27 02:57:59.414674 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1800/3593] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:57:59 2022] GET /compute/v2.1/servers/d6a40f7a-6709-4e75-b3e8-f98abf1b03d8 => generated 1409 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:57:59.724569 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-3e84dccd-6117-4904-81f6-e6c02b0d9096 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6381ae230a45de8b105374c2d25383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a6a888c878245cb9e5909e071c9b9c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:59.735334 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-3e84dccd-6117-4904-81f6-e6c02b0d9096 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] 10.222.0.70 "GET /compute/v2.1/servers/54682cce-6601-49d1-88f7-1c9fcaf7d370" status: 200 len: 1575 microversion: 2.1 time: 0.500661 Aug 27 02:57:59.736558 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1794/3594] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:57:59 2022] GET /compute/v2.1/servers/54682cce-6601-49d1-88f7-1c9fcaf7d370 => generated 1575 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:57:59.745334 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e729276d-f9e2-4f04-b5bf-0e4eb6119a0b tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:59.746155 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-e729276d-f9e2-4f04-b5bf-0e4eb6119a0b tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 93c96362-cc02-493d-a96b-ca19cf3a4e47] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:59.753497 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e729276d-f9e2-4f04-b5bf-0e4eb6119a0b tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:59.754259 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e729276d-f9e2-4f04-b5bf-0e4eb6119a0b tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:59.754823 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e729276d-f9e2-4f04-b5bf-0e4eb6119a0b tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:59.755676 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e729276d-f9e2-4f04-b5bf-0e4eb6119a0b tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:59.756516 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e729276d-f9e2-4f04-b5bf-0e4eb6119a0b tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:59.757085 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e729276d-f9e2-4f04-b5bf-0e4eb6119a0b tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:59.942741 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-73bdfb5a-bcd9-4b83-ba80-cae0d79b085b tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:59.943356 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-73bdfb5a-bcd9-4b83-ba80-cae0d79b085b tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] [instance: 02eba429-ecb3-4a5c-87ea-c049ad7aca1a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:59.951663 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-73bdfb5a-bcd9-4b83-ba80-cae0d79b085b tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:59.952163 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-73bdfb5a-bcd9-4b83-ba80-cae0d79b085b tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:59.952702 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-73bdfb5a-bcd9-4b83-ba80-cae0d79b085b tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:59.953346 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-73bdfb5a-bcd9-4b83-ba80-cae0d79b085b tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:59.965118 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-73bdfb5a-bcd9-4b83-ba80-cae0d79b085b tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:59.965809 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-73bdfb5a-bcd9-4b83-ba80-cae0d79b085b tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:00.049473 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-e729276d-f9e2-4f04-b5bf-0e4eb6119a0b tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:00.061232 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e729276d-f9e2-4f04-b5bf-0e4eb6119a0b tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/93c96362-cc02-493d-a96b-ca19cf3a4e47" status: 200 len: 1488 microversion: 2.1 time: 0.319695 Aug 27 02:58:00.061858 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1801/3595] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:57:59 2022] GET /compute/v2.1/servers/93c96362-cc02-493d-a96b-ca19cf3a4e47 => generated 1488 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:58:00.082780 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6a805d43-c9b9-428b-8891-d4c9b3d7dd90 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:58:00.083538 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-6a805d43-c9b9-428b-8891-d4c9b3d7dd90 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 93c96362-cc02-493d-a96b-ca19cf3a4e47] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:00.090217 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6a805d43-c9b9-428b-8891-d4c9b3d7dd90 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:00.090938 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6a805d43-c9b9-428b-8891-d4c9b3d7dd90 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:00.091665 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6a805d43-c9b9-428b-8891-d4c9b3d7dd90 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:00.092643 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6a805d43-c9b9-428b-8891-d4c9b3d7dd90 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:00.093228 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6a805d43-c9b9-428b-8891-d4c9b3d7dd90 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:00.093792 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6a805d43-c9b9-428b-8891-d4c9b3d7dd90 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:00.101028 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=14 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:58:00.121187 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.instance [None req-6a805d43-c9b9-428b-8891-d4c9b3d7dd90 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lazy-loading 'flavor' on Instance uuid 93c96362-cc02-493d-a96b-ca19cf3a4e47 {{(pid=134052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:58:00.355787 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-6a805d43-c9b9-428b-8891-d4c9b3d7dd90 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "POST /compute/v2.1/servers/93c96362-cc02-493d-a96b-ca19cf3a4e47/action" status: 202 len: 0 microversion: 2.1 time: 0.276662 Aug 27 02:58:00.362414 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1802/3596] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 02:58:00 2022] POST /compute/v2.1/servers/93c96362-cc02-493d-a96b-ca19cf3a4e47/action => generated 0 bytes in 284 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 02:58:00.368395 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b138695c-e0bf-4283-a157-d50761900e92 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:00.375297 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b138695c-e0bf-4283-a157-d50761900e92 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 93c96362-cc02-493d-a96b-ca19cf3a4e47] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:00.385097 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b138695c-e0bf-4283-a157-d50761900e92 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:00.385896 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b138695c-e0bf-4283-a157-d50761900e92 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:00.386543 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b138695c-e0bf-4283-a157-d50761900e92 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:00.387437 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b138695c-e0bf-4283-a157-d50761900e92 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:00.388066 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b138695c-e0bf-4283-a157-d50761900e92 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:00.389392 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b138695c-e0bf-4283-a157-d50761900e92 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:00.411900 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-73bdfb5a-bcd9-4b83-ba80-cae0d79b085b tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b217f9cbc204919ba77d885315907c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2448b78114c54dd39bc85538fb973dd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:00.419935 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-73bdfb5a-bcd9-4b83-ba80-cae0d79b085b tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] 10.222.0.70 "GET /compute/v2.1/servers/02eba429-ecb3-4a5c-87ea-c049ad7aca1a" status: 200 len: 1521 microversion: 2.1 time: 0.480945 Aug 27 02:58:00.432941 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1795/3597] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:57:59 2022] GET /compute/v2.1/servers/02eba429-ecb3-4a5c-87ea-c049ad7aca1a => generated 1521 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:58:00.440985 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-2fa78770-3721-4c83-91f6-8885101a1355 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:00.442008 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-2fa78770-3721-4c83-91f6-8885101a1355 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] [instance: d6a40f7a-6709-4e75-b3e8-f98abf1b03d8] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:00.448279 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2fa78770-3721-4c83-91f6-8885101a1355 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:00.449104 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2fa78770-3721-4c83-91f6-8885101a1355 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:00.449742 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2fa78770-3721-4c83-91f6-8885101a1355 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:00.450678 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2fa78770-3721-4c83-91f6-8885101a1355 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:00.451335 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2fa78770-3721-4c83-91f6-8885101a1355 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:00.451957 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2fa78770-3721-4c83-91f6-8885101a1355 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:00.482581 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=20 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:58:00.575156 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-2fa78770-3721-4c83-91f6-8885101a1355 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcc2feab6eb427cb1c1ac9093670ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4190feabcb36413fb443349aadc93a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:00.583776 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-2fa78770-3721-4c83-91f6-8885101a1355 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcc2feab6eb427cb1c1ac9093670ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4190feabcb36413fb443349aadc93a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:00.585601 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-2fa78770-3721-4c83-91f6-8885101a1355 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcc2feab6eb427cb1c1ac9093670ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4190feabcb36413fb443349aadc93a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:00.587439 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-2fa78770-3721-4c83-91f6-8885101a1355 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] 10.222.0.70 "GET /compute/v2.1/servers/d6a40f7a-6709-4e75-b3e8-f98abf1b03d8" status: 200 len: 1409 microversion: 2.54 time: 0.152787 Aug 27 02:58:00.601202 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1796/3598] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:58:00 2022] GET /compute/v2.1/servers/d6a40f7a-6709-4e75-b3e8-f98abf1b03d8 => generated 1409 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:58:00.762414 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-56c85b2f-e870-4ec2-8871-cdccd57c94dc tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:00.764249 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-56c85b2f-e870-4ec2-8871-cdccd57c94dc tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] [instance: 54682cce-6601-49d1-88f7-1c9fcaf7d370] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:00.774018 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-56c85b2f-e870-4ec2-8871-cdccd57c94dc tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:00.777865 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-56c85b2f-e870-4ec2-8871-cdccd57c94dc tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:00.778983 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-56c85b2f-e870-4ec2-8871-cdccd57c94dc tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:00.779984 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-56c85b2f-e870-4ec2-8871-cdccd57c94dc tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:00.781342 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-56c85b2f-e870-4ec2-8871-cdccd57c94dc tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:00.782531 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-56c85b2f-e870-4ec2-8871-cdccd57c94dc tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:00.846746 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b138695c-e0bf-4283-a157-d50761900e92 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:00.855948 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b138695c-e0bf-4283-a157-d50761900e92 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/93c96362-cc02-493d-a96b-ca19cf3a4e47" status: 200 len: 1494 microversion: 2.1 time: 0.491512 Aug 27 02:58:00.856775 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1803/3599] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:58:00 2022] GET /compute/v2.1/servers/93c96362-cc02-493d-a96b-ca19cf3a4e47 => generated 1494 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:58:01.445350 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3a9d828a-6d05-49db-8f01-3e1417d6d779 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:01.446969 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-3a9d828a-6d05-49db-8f01-3e1417d6d779 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] [instance: 02eba429-ecb3-4a5c-87ea-c049ad7aca1a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:01.451063 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:58:01.455329 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3a9d828a-6d05-49db-8f01-3e1417d6d779 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:01.455848 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3a9d828a-6d05-49db-8f01-3e1417d6d779 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:01.456460 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3a9d828a-6d05-49db-8f01-3e1417d6d779 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:01.457659 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3a9d828a-6d05-49db-8f01-3e1417d6d779 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:01.458094 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3a9d828a-6d05-49db-8f01-3e1417d6d779 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:01.458767 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3a9d828a-6d05-49db-8f01-3e1417d6d779 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:01.474954 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-56c85b2f-e870-4ec2-8871-cdccd57c94dc tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6381ae230a45de8b105374c2d25383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a6a888c878245cb9e5909e071c9b9c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:01.488532 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-56c85b2f-e870-4ec2-8871-cdccd57c94dc tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] 10.222.0.70 "GET /compute/v2.1/servers/54682cce-6601-49d1-88f7-1c9fcaf7d370" status: 200 len: 1575 microversion: 2.1 time: 0.731854 Aug 27 02:58:01.490247 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1797/3600] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:58:00 2022] GET /compute/v2.1/servers/54682cce-6601-49d1-88f7-1c9fcaf7d370 => generated 1575 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:58:01.612041 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-692353ed-9c7c-490a-b498-9d5cab9b5d51 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:01.612041 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-692353ed-9c7c-490a-b498-9d5cab9b5d51 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] [instance: d6a40f7a-6709-4e75-b3e8-f98abf1b03d8] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:01.618809 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-692353ed-9c7c-490a-b498-9d5cab9b5d51 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:01.619360 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-692353ed-9c7c-490a-b498-9d5cab9b5d51 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:01.619800 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-692353ed-9c7c-490a-b498-9d5cab9b5d51 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:01.621554 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-692353ed-9c7c-490a-b498-9d5cab9b5d51 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:01.622078 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-692353ed-9c7c-490a-b498-9d5cab9b5d51 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:01.622591 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-692353ed-9c7c-490a-b498-9d5cab9b5d51 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:01.719549 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-692353ed-9c7c-490a-b498-9d5cab9b5d51 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcc2feab6eb427cb1c1ac9093670ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4190feabcb36413fb443349aadc93a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:01.732131 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-692353ed-9c7c-490a-b498-9d5cab9b5d51 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcc2feab6eb427cb1c1ac9093670ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4190feabcb36413fb443349aadc93a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:01.737662 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-3a9d828a-6d05-49db-8f01-3e1417d6d779 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b217f9cbc204919ba77d885315907c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2448b78114c54dd39bc85538fb973dd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:01.744233 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-692353ed-9c7c-490a-b498-9d5cab9b5d51 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcc2feab6eb427cb1c1ac9093670ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4190feabcb36413fb443349aadc93a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:01.748857 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-692353ed-9c7c-490a-b498-9d5cab9b5d51 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] 10.222.0.70 "GET /compute/v2.1/servers/d6a40f7a-6709-4e75-b3e8-f98abf1b03d8" status: 200 len: 1409 microversion: 2.54 time: 0.140966 Aug 27 02:58:01.750182 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-3a9d828a-6d05-49db-8f01-3e1417d6d779 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] 10.222.0.70 "GET /compute/v2.1/servers/02eba429-ecb3-4a5c-87ea-c049ad7aca1a" status: 200 len: 1521 microversion: 2.1 time: 0.308756 Aug 27 02:58:01.751723 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1798/3601] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:58:01 2022] GET /compute/v2.1/servers/d6a40f7a-6709-4e75-b3e8-f98abf1b03d8 => generated 1409 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:58:01.752417 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1804/3602] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:58:01 2022] GET /compute/v2.1/servers/02eba429-ecb3-4a5c-87ea-c049ad7aca1a => generated 1521 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:58:01.881055 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-de42b399-58f9-4173-bafd-b4d32ba5cdc6 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:01.881714 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-de42b399-58f9-4173-bafd-b4d32ba5cdc6 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 93c96362-cc02-493d-a96b-ca19cf3a4e47] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:01.893538 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-de42b399-58f9-4173-bafd-b4d32ba5cdc6 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:01.894513 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-de42b399-58f9-4173-bafd-b4d32ba5cdc6 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:01.898407 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-de42b399-58f9-4173-bafd-b4d32ba5cdc6 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:01.900747 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-de42b399-58f9-4173-bafd-b4d32ba5cdc6 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:01.902425 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-de42b399-58f9-4173-bafd-b4d32ba5cdc6 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:01.905000 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-de42b399-58f9-4173-bafd-b4d32ba5cdc6 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:02.145468 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-de42b399-58f9-4173-bafd-b4d32ba5cdc6 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:02.153749 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-de42b399-58f9-4173-bafd-b4d32ba5cdc6 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/93c96362-cc02-493d-a96b-ca19cf3a4e47" status: 200 len: 1515 microversion: 2.1 time: 0.279187 Aug 27 02:58:02.168784 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1805/3603] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:58:01 2022] GET /compute/v2.1/servers/93c96362-cc02-493d-a96b-ca19cf3a4e47 => generated 1515 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:58:02.510431 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-cfb9e6e7-beb2-47a1-9c4a-e08e5a027243 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:02.511399 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-cfb9e6e7-beb2-47a1-9c4a-e08e5a027243 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] [instance: 54682cce-6601-49d1-88f7-1c9fcaf7d370] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:02.523212 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cfb9e6e7-beb2-47a1-9c4a-e08e5a027243 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:02.525740 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cfb9e6e7-beb2-47a1-9c4a-e08e5a027243 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:02.526456 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cfb9e6e7-beb2-47a1-9c4a-e08e5a027243 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:02.530528 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cfb9e6e7-beb2-47a1-9c4a-e08e5a027243 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:02.531361 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cfb9e6e7-beb2-47a1-9c4a-e08e5a027243 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:02.532104 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cfb9e6e7-beb2-47a1-9c4a-e08e5a027243 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:02.790949 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c547b764-abc2-439c-a491-69ffdb243941 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:02.791573 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-c547b764-abc2-439c-a491-69ffdb243941 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] [instance: 02eba429-ecb3-4a5c-87ea-c049ad7aca1a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:02.797701 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c547b764-abc2-439c-a491-69ffdb243941 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:02.798196 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c547b764-abc2-439c-a491-69ffdb243941 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:02.798626 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c547b764-abc2-439c-a491-69ffdb243941 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:02.799640 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c547b764-abc2-439c-a491-69ffdb243941 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:02.800278 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c547b764-abc2-439c-a491-69ffdb243941 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:02.800939 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c547b764-abc2-439c-a491-69ffdb243941 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:02.847569 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-cfb9e6e7-beb2-47a1-9c4a-e08e5a027243 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6381ae230a45de8b105374c2d25383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a6a888c878245cb9e5909e071c9b9c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:02.856954 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-cfb9e6e7-beb2-47a1-9c4a-e08e5a027243 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] 10.222.0.70 "GET /compute/v2.1/servers/54682cce-6601-49d1-88f7-1c9fcaf7d370" status: 200 len: 1573 microversion: 2.1 time: 0.350488 Aug 27 02:58:02.858488 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1799/3604] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:58:02 2022] GET /compute/v2.1/servers/54682cce-6601-49d1-88f7-1c9fcaf7d370 => generated 1573 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:58:02.863585 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-35fbbd65-51c6-4c6a-a62e-64b02ef5129a tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:02.864193 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-35fbbd65-51c6-4c6a-a62e-64b02ef5129a tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] [instance: d6a40f7a-6709-4e75-b3e8-f98abf1b03d8] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:02.870240 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-35fbbd65-51c6-4c6a-a62e-64b02ef5129a tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:02.870977 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-35fbbd65-51c6-4c6a-a62e-64b02ef5129a tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:02.871596 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-35fbbd65-51c6-4c6a-a62e-64b02ef5129a tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:02.872510 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-35fbbd65-51c6-4c6a-a62e-64b02ef5129a tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:02.873166 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-35fbbd65-51c6-4c6a-a62e-64b02ef5129a tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:02.873775 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-35fbbd65-51c6-4c6a-a62e-64b02ef5129a tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:03.047718 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-35fbbd65-51c6-4c6a-a62e-64b02ef5129a tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcc2feab6eb427cb1c1ac9093670ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4190feabcb36413fb443349aadc93a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:03.061091 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-35fbbd65-51c6-4c6a-a62e-64b02ef5129a tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcc2feab6eb427cb1c1ac9093670ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4190feabcb36413fb443349aadc93a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:03.082202 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-35fbbd65-51c6-4c6a-a62e-64b02ef5129a tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcc2feab6eb427cb1c1ac9093670ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4190feabcb36413fb443349aadc93a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:03.083441 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-35fbbd65-51c6-4c6a-a62e-64b02ef5129a tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] 10.222.0.70 "GET /compute/v2.1/servers/d6a40f7a-6709-4e75-b3e8-f98abf1b03d8" status: 200 len: 1409 microversion: 2.54 time: 0.223807 Aug 27 02:58:03.084020 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1800/3605] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:58:02 2022] GET /compute/v2.1/servers/d6a40f7a-6709-4e75-b3e8-f98abf1b03d8 => generated 1409 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:58:03.098594 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-07d21a3f-680a-4bb7-87f0-6d2efaca7ccd tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-727974237"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:58:03.098951 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-07d21a3f-680a-4bb7-87f0-6d2efaca7ccd tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] [instance: 54682cce-6601-49d1-88f7-1c9fcaf7d370] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:03.127404 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-c547b764-abc2-439c-a491-69ffdb243941 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b217f9cbc204919ba77d885315907c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2448b78114c54dd39bc85538fb973dd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:03.130661 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-07d21a3f-680a-4bb7-87f0-6d2efaca7ccd tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:03.131360 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-07d21a3f-680a-4bb7-87f0-6d2efaca7ccd tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:03.131860 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-07d21a3f-680a-4bb7-87f0-6d2efaca7ccd tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:03.132592 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-07d21a3f-680a-4bb7-87f0-6d2efaca7ccd tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:03.133225 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-07d21a3f-680a-4bb7-87f0-6d2efaca7ccd tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:03.133801 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-07d21a3f-680a-4bb7-87f0-6d2efaca7ccd tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:03.136244 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c547b764-abc2-439c-a491-69ffdb243941 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] 10.222.0.70 "GET /compute/v2.1/servers/02eba429-ecb3-4a5c-87ea-c049ad7aca1a" status: 200 len: 1521 microversion: 2.1 time: 0.349133 Aug 27 02:58:03.136893 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1806/3606] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:58:02 2022] GET /compute/v2.1/servers/02eba429-ecb3-4a5c-87ea-c049ad7aca1a => generated 1521 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:58:03.176802 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-15b7b787-5523-4aea-8f3d-5a5bd76fd060 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:03.177425 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-15b7b787-5523-4aea-8f3d-5a5bd76fd060 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 93c96362-cc02-493d-a96b-ca19cf3a4e47] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:03.187396 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-15b7b787-5523-4aea-8f3d-5a5bd76fd060 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:03.187890 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-15b7b787-5523-4aea-8f3d-5a5bd76fd060 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:03.188343 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-15b7b787-5523-4aea-8f3d-5a5bd76fd060 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:03.192017 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-15b7b787-5523-4aea-8f3d-5a5bd76fd060 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:03.192525 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-15b7b787-5523-4aea-8f3d-5a5bd76fd060 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:03.192961 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-15b7b787-5523-4aea-8f3d-5a5bd76fd060 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:03.437339 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.network.security_group_api [None req-07d21a3f-680a-4bb7-87f0-6d2efaca7ccd tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Adding security group 878fae5a-8c58-427c-8ab9-c963c385cc0c to port 630d16a1-f5f9-4ff7-8090-d69fbd0a36a7 Aug 27 02:58:03.603320 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-15b7b787-5523-4aea-8f3d-5a5bd76fd060 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:03.623277 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-15b7b787-5523-4aea-8f3d-5a5bd76fd060 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/93c96362-cc02-493d-a96b-ca19cf3a4e47" status: 200 len: 1510 microversion: 2.1 time: 0.440531 Aug 27 02:58:03.626297 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1807/3607] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:58:03 2022] GET /compute/v2.1/servers/93c96362-cc02-493d-a96b-ca19cf3a4e47 => generated 1510 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:58:04.039175 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-07d21a3f-680a-4bb7-87f0-6d2efaca7ccd tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] 10.222.0.70 "POST /compute/v2.1/servers/54682cce-6601-49d1-88f7-1c9fcaf7d370/action" status: 202 len: 0 microversion: 2.1 time: 0.946697 Aug 27 02:58:04.042147 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1801/3608] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 02:58:03 2022] POST /compute/v2.1/servers/54682cce-6601-49d1-88f7-1c9fcaf7d370/action => generated 0 bytes in 952 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:58:04.050264 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a6368045-682f-4e76-8018-06ff94afa1ba tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Calling method '.version_select at 0x7f5ee30309d0>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:04.060210 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-aaee05bd-caae-47d9-8e43-ba7aefb9d14d req-11dba652-4183-4297-91b9-4159c79c2b8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54682cce-6601-49d1-88f7-1c9fcaf7d370", "tag": "630d16a1-f5f9-4ff7-8090-d69fbd0a36a7"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:58:04.075836 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-aaee05bd-caae-47d9-8e43-ba7aefb9d14d req-11dba652-4183-4297-91b9-4159c79c2b8b service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:04.076966 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-aaee05bd-caae-47d9-8e43-ba7aefb9d14d req-11dba652-4183-4297-91b9-4159c79c2b8b service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:04.078559 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-aaee05bd-caae-47d9-8e43-ba7aefb9d14d req-11dba652-4183-4297-91b9-4159c79c2b8b service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:04.103197 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-aaee05bd-caae-47d9-8e43-ba7aefb9d14d req-11dba652-4183-4297-91b9-4159c79c2b8b service nova] Creating event network-changed:630d16a1-f5f9-4ff7-8090-d69fbd0a36a7 for instance 54682cce-6601-49d1-88f7-1c9fcaf7d370 on n-h2-852278-4 Aug 27 02:58:04.113369 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-aaee05bd-caae-47d9-8e43-ba7aefb9d14d req-11dba652-4183-4297-91b9-4159c79c2b8b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057068 Aug 27 02:58:04.115362 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1802/3609] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:58:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:58:04.128995 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a1404010-3d96-4e76-a893-dbf3f8fa431e tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:04.130066 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-a1404010-3d96-4e76-a893-dbf3f8fa431e tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] [instance: d6a40f7a-6709-4e75-b3e8-f98abf1b03d8] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:04.142511 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a1404010-3d96-4e76-a893-dbf3f8fa431e tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:04.144508 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a1404010-3d96-4e76-a893-dbf3f8fa431e tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:04.145278 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a1404010-3d96-4e76-a893-dbf3f8fa431e tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:04.147751 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a1404010-3d96-4e76-a893-dbf3f8fa431e tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:04.148577 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a1404010-3d96-4e76-a893-dbf3f8fa431e tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:04.149356 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a1404010-3d96-4e76-a893-dbf3f8fa431e tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:04.372066 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-a1404010-3d96-4e76-a893-dbf3f8fa431e tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcc2feab6eb427cb1c1ac9093670ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4190feabcb36413fb443349aadc93a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:04.387259 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-a1404010-3d96-4e76-a893-dbf3f8fa431e tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcc2feab6eb427cb1c1ac9093670ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4190feabcb36413fb443349aadc93a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:04.389054 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-a1404010-3d96-4e76-a893-dbf3f8fa431e tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcc2feab6eb427cb1c1ac9093670ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4190feabcb36413fb443349aadc93a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:04.390520 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a1404010-3d96-4e76-a893-dbf3f8fa431e tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] 10.222.0.70 "GET /compute/v2.1/servers/d6a40f7a-6709-4e75-b3e8-f98abf1b03d8" status: 200 len: 1409 microversion: 2.54 time: 0.273697 Aug 27 02:58:04.391268 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1803/3610] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:58:04 2022] GET /compute/v2.1/servers/d6a40f7a-6709-4e75-b3e8-f98abf1b03d8 => generated 1409 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:58:04.408139 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-53fe1b46-85b3-4ae1-a3a4-c7ddd390619c tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:04.409001 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-53fe1b46-85b3-4ae1-a3a4-c7ddd390619c tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] [instance: 02eba429-ecb3-4a5c-87ea-c049ad7aca1a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:04.415859 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-53fe1b46-85b3-4ae1-a3a4-c7ddd390619c tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:04.416531 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-53fe1b46-85b3-4ae1-a3a4-c7ddd390619c tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:04.416845 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-53fe1b46-85b3-4ae1-a3a4-c7ddd390619c tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:04.417623 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-53fe1b46-85b3-4ae1-a3a4-c7ddd390619c tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:04.418019 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-53fe1b46-85b3-4ae1-a3a4-c7ddd390619c tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:04.418438 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-53fe1b46-85b3-4ae1-a3a4-c7ddd390619c tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:04.691779 n-d-852278-4 devstack@n-api.service[134052]: DEBUG neutronclient.v2_0.client [None req-a6368045-682f-4e76-8018-06ff94afa1ba tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 878fae5a-8c58-427c-8ab9-c963c385cc0c in use.", "detail": ""}} {{(pid=134052) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 02:58:04.692507 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-a6368045-682f-4e76-8018-06ff94afa1ba tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] HTTP exception thrown: Security Group 878fae5a-8c58-427c-8ab9-c963c385cc0c in use. Aug 27 02:58:04.692507 n-d-852278-4 devstack@n-api.service[134052]: Neutron server returns request_ids: ['req-0e3fd22c-1dd7-4703-8777-8fe576ca454e'] Aug 27 02:58:04.694808 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a6368045-682f-4e76-8018-06ff94afa1ba tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Request method failure captured: Aug 27 02:58:04.694808 n-d-852278-4 devstack@n-api.service[134052]: request: DELETE /compute/v2.1/os-security-groups/878fae5a-8c58-427c-8ab9-c963c385cc0c HTTP/1.1 Aug 27 02:58:04.694808 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:58:04.694808 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:58:04.694808 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:58:04.694808 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:58:04.694808 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:58:04.694808 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:58:04.694808 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:58:04.694808 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:58:04.694808 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYf2b88jccGp908k3vQwdmk8aWVpZgx4XAwdI__tT5JQ00leavue9yGRA0Ra6tx0k8LuwOwvFz5QHaUm9YwpVl7ey0u_0fYkHaP7j9Kliw_5Q5Xf4F9k_115SseZDZeFd_ncRBfnV98omKQ5oUaf4zu042RXCwV00aKzeJyDrzb4sII Aug 27 02:58:04.694808 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:58:04.694808 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:58:04.694808 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:58:04.694808 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:58:04.694808 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:58:04.694808 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:58:04.694808 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 2a6a888c878245cb9e5909e071c9b9c2 Aug 27 02:58:04.694808 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-SecurityGroupsTestJSON-23859158 Aug 27 02:58:04.694808 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:58:04.694808 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:58:04.694808 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2a6a888c878245cb9e5909e071c9b9c2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_2a6a888c878245cb9e5909e071c9b9c2", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2a6a888c878245cb9e5909e071c9b9c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/2a6a888c878245cb9e5909e071c9b9c2"}]}] Aug 27 02:58:04.694808 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-SecurityGroupsTestJSON-23859158 Aug 27 02:58:04.694808 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 2a6a888c878245cb9e5909e071c9b9c2 Aug 27 02:58:04.694808 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-23859158 Aug 27 02:58:04.694808 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-SecurityGroupsTestJSON-23859158-project Aug 27 02:58:04.694808 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:58:04.694808 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:58:04.694808 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: ef6381ae230a45de8b105374c2d25383 Aug 27 02:58:04.694808 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-SecurityGroupsTestJSON-23859158-project Aug 27 02:58:04.694808 n-d-852278-4 devstack@n-api.service[134052]: method: Aug 27 02:58:04.694808 n-d-852278-4 devstack@n-api.service[134052]: exception: Security Group 878fae5a-8c58-427c-8ab9-c963c385cc0c in use. Aug 27 02:58:04.694808 n-d-852278-4 devstack@n-api.service[134052]: Neutron server returns request_ids: ['req-0e3fd22c-1dd7-4703-8777-8fe576ca454e'] Aug 27 02:58:04.694808 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '878fae5a-8c58-427c-8ab9-c963c385cc0c'} Aug 27 02:58:04.694808 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:58:04.694808 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:58:04.694808 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 27 02:58:04.694808 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 27 02:58:04.694808 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:58:04.694808 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:58:04.694808 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 27 02:58:04.694808 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 27 02:58:04.694808 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:58:04.694808 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:58:04.694808 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 27 02:58:04.694808 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 27 02:58:04.694808 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:58:04.694808 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:58:04.694808 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 02:58:04.694808 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 02:58:04.694808 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:58:04.694808 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:58:04.694808 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 02:58:04.694808 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 02:58:04.694808 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:58:04.694808 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:58:04.694808 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 02:58:04.694808 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 02:58:04.694808 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 02:58:04.694808 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 02:58:04.694808 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 878fae5a-8c58-427c-8ab9-c963c385cc0c in use. Aug 27 02:58:04.698982 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0e3fd22c-1dd7-4703-8777-8fe576ca454e'] Aug 27 02:58:04.698982 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:58:04.698982 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:58:04.698982 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:58:04.698982 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:58:04.698982 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 27 02:58:04.698982 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 27 02:58:04.698982 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 27 02:58:04.698982 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 27 02:58:04.698982 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 878fae5a-8c58-427c-8ab9-c963c385cc0c in use. Aug 27 02:58:04.698982 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0e3fd22c-1dd7-4703-8777-8fe576ca454e'] Aug 27 02:58:04.698982 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:58:04.698982 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:58:04.698982 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:58:04.698982 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:58:04.698982 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:58:04.698982 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:58:04.698982 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:58:04.698982 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:58:04.698982 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:58:04.698982 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:58:04.698982 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:58:04.698982 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:58:04.698982 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 27 02:58:04.698982 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 27 02:58:04.698982 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 878fae5a-8c58-427c-8ab9-c963c385cc0c in use. Aug 27 02:58:04.698982 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0e3fd22c-1dd7-4703-8777-8fe576ca454e'] Aug 27 02:58:04.698982 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:58:04.698982 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:58:04.698982 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:58:04.698982 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:58:04.698982 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:58:04.698982 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:58:04.698982 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:58:04.698982 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:58:04.698982 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 878fae5a-8c58-427c-8ab9-c963c385cc0c in use. Aug 27 02:58:04.698982 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0e3fd22c-1dd7-4703-8777-8fe576ca454e'] Aug 27 02:58:04.698982 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:58:04.698982 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a6368045-682f-4e76-8018-06ff94afa1ba tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Returning 400 to user: Security Group 878fae5a-8c58-427c-8ab9-c963c385cc0c in use. Aug 27 02:58:04.698982 n-d-852278-4 devstack@n-api.service[134052]: Neutron server returns request_ids: ['req-0e3fd22c-1dd7-4703-8777-8fe576ca454e'] {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:58:04.698982 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a6368045-682f-4e76-8018-06ff94afa1ba tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/878fae5a-8c58-427c-8ab9-c963c385cc0c" status: 400 len: 185 microversion: 2.1 time: 0.650302 Aug 27 02:58:04.698982 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1808/3611] 10.222.0.70 () {58 vars in 1272 bytes} [Sat Aug 27 02:58:04 2022] DELETE /compute/v2.1/os-security-groups/878fae5a-8c58-427c-8ab9-c963c385cc0c => generated 185 bytes in 651 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 02:58:04.710947 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-94591c2f-9704-432f-8287-50d6eaf9f554 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:04.710947 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-94591c2f-9704-432f-8287-50d6eaf9f554 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 93c96362-cc02-493d-a96b-ca19cf3a4e47] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:04.743129 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-94591c2f-9704-432f-8287-50d6eaf9f554 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:04.743673 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-94591c2f-9704-432f-8287-50d6eaf9f554 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:04.744128 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-94591c2f-9704-432f-8287-50d6eaf9f554 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:04.745045 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-94591c2f-9704-432f-8287-50d6eaf9f554 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:04.745505 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-94591c2f-9704-432f-8287-50d6eaf9f554 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:04.745925 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-94591c2f-9704-432f-8287-50d6eaf9f554 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:05.299893 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-53fe1b46-85b3-4ae1-a3a4-c7ddd390619c tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b217f9cbc204919ba77d885315907c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2448b78114c54dd39bc85538fb973dd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:05.315395 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-53fe1b46-85b3-4ae1-a3a4-c7ddd390619c tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] 10.222.0.70 "GET /compute/v2.1/servers/02eba429-ecb3-4a5c-87ea-c049ad7aca1a" status: 200 len: 1521 microversion: 2.1 time: 0.911107 Aug 27 02:58:05.316235 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1804/3612] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:58:04 2022] GET /compute/v2.1/servers/02eba429-ecb3-4a5c-87ea-c049ad7aca1a => generated 1521 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:58:05.321124 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c672f292-162d-46e6-b230-9d71a86141a1 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:05.325503 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-c672f292-162d-46e6-b230-9d71a86141a1 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] [instance: 54682cce-6601-49d1-88f7-1c9fcaf7d370] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:05.347054 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c672f292-162d-46e6-b230-9d71a86141a1 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:05.347729 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c672f292-162d-46e6-b230-9d71a86141a1 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:05.348322 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c672f292-162d-46e6-b230-9d71a86141a1 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:05.349267 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c672f292-162d-46e6-b230-9d71a86141a1 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:05.349881 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c672f292-162d-46e6-b230-9d71a86141a1 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:05.350449 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c672f292-162d-46e6-b230-9d71a86141a1 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:05.384895 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-c672f292-162d-46e6-b230-9d71a86141a1 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] [instance: 54682cce-6601-49d1-88f7-1c9fcaf7d370] Going to try to terminate instance {{(pid=134051) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:58:05.485078 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-94591c2f-9704-432f-8287-50d6eaf9f554 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:05.513886 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-94591c2f-9704-432f-8287-50d6eaf9f554 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/93c96362-cc02-493d-a96b-ca19cf3a4e47" status: 200 len: 1510 microversion: 2.1 time: 0.815765 Aug 27 02:58:05.514501 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1809/3613] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:58:04 2022] GET /compute/v2.1/servers/93c96362-cc02-493d-a96b-ca19cf3a4e47 => generated 1510 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:58:05.526641 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c672f292-162d-46e6-b230-9d71a86141a1 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] 10.222.0.70 "DELETE /compute/v2.1/servers/54682cce-6601-49d1-88f7-1c9fcaf7d370" status: 204 len: 0 microversion: 2.1 time: 0.208915 Aug 27 02:58:05.527772 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1805/3614] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:58:05 2022] DELETE /compute/v2.1/servers/54682cce-6601-49d1-88f7-1c9fcaf7d370 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:58:05.544967 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e6f031c1-4b15-4781-86be-2ccae963c3d2 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:05.546066 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-e6f031c1-4b15-4781-86be-2ccae963c3d2 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] [instance: 54682cce-6601-49d1-88f7-1c9fcaf7d370] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:05.558732 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e6f031c1-4b15-4781-86be-2ccae963c3d2 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:05.559476 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-fdabee36-0c51-4674-a651-0e3b3ce4d356 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:05.560280 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e6f031c1-4b15-4781-86be-2ccae963c3d2 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:05.560904 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e6f031c1-4b15-4781-86be-2ccae963c3d2 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:05.561174 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-fdabee36-0c51-4674-a651-0e3b3ce4d356 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] [instance: d6a40f7a-6709-4e75-b3e8-f98abf1b03d8] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:05.563487 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e6f031c1-4b15-4781-86be-2ccae963c3d2 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:05.564175 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e6f031c1-4b15-4781-86be-2ccae963c3d2 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:05.564806 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e6f031c1-4b15-4781-86be-2ccae963c3d2 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:05.591885 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fdabee36-0c51-4674-a651-0e3b3ce4d356 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:05.599413 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fdabee36-0c51-4674-a651-0e3b3ce4d356 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:05.600014 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fdabee36-0c51-4674-a651-0e3b3ce4d356 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:05.603075 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fdabee36-0c51-4674-a651-0e3b3ce4d356 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:05.603563 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fdabee36-0c51-4674-a651-0e3b3ce4d356 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:05.603998 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fdabee36-0c51-4674-a651-0e3b3ce4d356 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:05.835273 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-fdabee36-0c51-4674-a651-0e3b3ce4d356 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcc2feab6eb427cb1c1ac9093670ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4190feabcb36413fb443349aadc93a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:05.849511 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-fdabee36-0c51-4674-a651-0e3b3ce4d356 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcc2feab6eb427cb1c1ac9093670ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4190feabcb36413fb443349aadc93a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:05.851041 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-fdabee36-0c51-4674-a651-0e3b3ce4d356 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcc2feab6eb427cb1c1ac9093670ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4190feabcb36413fb443349aadc93a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:05.852330 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-fdabee36-0c51-4674-a651-0e3b3ce4d356 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] 10.222.0.70 "GET /compute/v2.1/servers/d6a40f7a-6709-4e75-b3e8-f98abf1b03d8" status: 200 len: 1409 microversion: 2.54 time: 0.315418 Aug 27 02:58:05.857328 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1810/3615] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:58:05 2022] GET /compute/v2.1/servers/d6a40f7a-6709-4e75-b3e8-f98abf1b03d8 => generated 1409 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:58:05.990030 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e6f031c1-4b15-4781-86be-2ccae963c3d2 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6381ae230a45de8b105374c2d25383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a6a888c878245cb9e5909e071c9b9c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:06.002371 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e6f031c1-4b15-4781-86be-2ccae963c3d2 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] 10.222.0.70 "GET /compute/v2.1/servers/54682cce-6601-49d1-88f7-1c9fcaf7d370" status: 200 len: 1647 microversion: 2.1 time: 0.469808 Aug 27 02:58:06.004507 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1806/3616] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:58:05 2022] GET /compute/v2.1/servers/54682cce-6601-49d1-88f7-1c9fcaf7d370 => generated 1647 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:58:06.337629 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-1a6be139-d000-4c5c-9bc7-0cfa66dc93ea tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:06.338256 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-1a6be139-d000-4c5c-9bc7-0cfa66dc93ea tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] [instance: 02eba429-ecb3-4a5c-87ea-c049ad7aca1a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:06.361484 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1a6be139-d000-4c5c-9bc7-0cfa66dc93ea tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:06.361996 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1a6be139-d000-4c5c-9bc7-0cfa66dc93ea tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:06.362468 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1a6be139-d000-4c5c-9bc7-0cfa66dc93ea tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:06.363387 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1a6be139-d000-4c5c-9bc7-0cfa66dc93ea tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:06.364166 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1a6be139-d000-4c5c-9bc7-0cfa66dc93ea tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:06.364761 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1a6be139-d000-4c5c-9bc7-0cfa66dc93ea tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:06.537355 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0388b89e-a81c-4e52-9e65-930c9b044ff4 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:06.538050 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-0388b89e-a81c-4e52-9e65-930c9b044ff4 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 93c96362-cc02-493d-a96b-ca19cf3a4e47] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:06.551243 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=16 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:58:06.563734 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0388b89e-a81c-4e52-9e65-930c9b044ff4 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:06.564259 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0388b89e-a81c-4e52-9e65-930c9b044ff4 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:06.566540 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0388b89e-a81c-4e52-9e65-930c9b044ff4 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:06.567443 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0388b89e-a81c-4e52-9e65-930c9b044ff4 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:06.569886 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0388b89e-a81c-4e52-9e65-930c9b044ff4 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:06.571067 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0388b89e-a81c-4e52-9e65-930c9b044ff4 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:06.829584 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-1a6be139-d000-4c5c-9bc7-0cfa66dc93ea tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b217f9cbc204919ba77d885315907c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2448b78114c54dd39bc85538fb973dd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:06.841748 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-1a6be139-d000-4c5c-9bc7-0cfa66dc93ea tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] 10.222.0.70 "GET /compute/v2.1/servers/02eba429-ecb3-4a5c-87ea-c049ad7aca1a" status: 200 len: 1521 microversion: 2.1 time: 0.505896 Aug 27 02:58:06.842645 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1811/3617] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:58:06 2022] GET /compute/v2.1/servers/02eba429-ecb3-4a5c-87ea-c049ad7aca1a => generated 1521 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:58:06.884713 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0185fdfe-6b0f-4e15-b7e6-2178c95d60a6 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:06.885646 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-0185fdfe-6b0f-4e15-b7e6-2178c95d60a6 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] [instance: d6a40f7a-6709-4e75-b3e8-f98abf1b03d8] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:06.895276 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0185fdfe-6b0f-4e15-b7e6-2178c95d60a6 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:06.905448 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0185fdfe-6b0f-4e15-b7e6-2178c95d60a6 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:06.906207 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0185fdfe-6b0f-4e15-b7e6-2178c95d60a6 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:06.907143 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0185fdfe-6b0f-4e15-b7e6-2178c95d60a6 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:06.907788 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0185fdfe-6b0f-4e15-b7e6-2178c95d60a6 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:06.908504 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0185fdfe-6b0f-4e15-b7e6-2178c95d60a6 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:06.953361 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-0388b89e-a81c-4e52-9e65-930c9b044ff4 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:07.008753 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-0388b89e-a81c-4e52-9e65-930c9b044ff4 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/93c96362-cc02-493d-a96b-ca19cf3a4e47" status: 200 len: 1510 microversion: 2.1 time: 0.467613 Aug 27 02:58:07.009573 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1807/3618] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:58:06 2022] GET /compute/v2.1/servers/93c96362-cc02-493d-a96b-ca19cf3a4e47 => generated 1510 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:58:07.024884 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-99e0a2e0-8df7-4a34-9652-f8c0b0910e47 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:07.025903 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-99e0a2e0-8df7-4a34-9652-f8c0b0910e47 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] [instance: 54682cce-6601-49d1-88f7-1c9fcaf7d370] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:07.034079 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-99e0a2e0-8df7-4a34-9652-f8c0b0910e47 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:07.036992 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-99e0a2e0-8df7-4a34-9652-f8c0b0910e47 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:07.037673 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-99e0a2e0-8df7-4a34-9652-f8c0b0910e47 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:07.041909 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-99e0a2e0-8df7-4a34-9652-f8c0b0910e47 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:07.043284 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-99e0a2e0-8df7-4a34-9652-f8c0b0910e47 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:07.043828 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-99e0a2e0-8df7-4a34-9652-f8c0b0910e47 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:07.112253 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0185fdfe-6b0f-4e15-b7e6-2178c95d60a6 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcc2feab6eb427cb1c1ac9093670ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4190feabcb36413fb443349aadc93a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:07.126875 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0185fdfe-6b0f-4e15-b7e6-2178c95d60a6 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcc2feab6eb427cb1c1ac9093670ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4190feabcb36413fb443349aadc93a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:07.131094 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0185fdfe-6b0f-4e15-b7e6-2178c95d60a6 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcc2feab6eb427cb1c1ac9093670ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4190feabcb36413fb443349aadc93a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:07.140140 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-0185fdfe-6b0f-4e15-b7e6-2178c95d60a6 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] 10.222.0.70 "GET /compute/v2.1/servers/d6a40f7a-6709-4e75-b3e8-f98abf1b03d8" status: 200 len: 1409 microversion: 2.54 time: 0.254552 Aug 27 02:58:07.140971 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1812/3619] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:58:06 2022] GET /compute/v2.1/servers/d6a40f7a-6709-4e75-b3e8-f98abf1b03d8 => generated 1409 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:58:07.767354 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-99e0a2e0-8df7-4a34-9652-f8c0b0910e47 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6381ae230a45de8b105374c2d25383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a6a888c878245cb9e5909e071c9b9c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:07.780386 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-99e0a2e0-8df7-4a34-9652-f8c0b0910e47 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] 10.222.0.70 "GET /compute/v2.1/servers/54682cce-6601-49d1-88f7-1c9fcaf7d370" status: 200 len: 1647 microversion: 2.1 time: 0.758175 Aug 27 02:58:07.782958 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1808/3620] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:58:07 2022] GET /compute/v2.1/servers/54682cce-6601-49d1-88f7-1c9fcaf7d370 => generated 1647 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:58:07.863650 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-849a513a-4544-474c-b376-579ca28a9fc8 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:07.865100 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-849a513a-4544-474c-b376-579ca28a9fc8 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] [instance: 02eba429-ecb3-4a5c-87ea-c049ad7aca1a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:07.874350 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-849a513a-4544-474c-b376-579ca28a9fc8 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:07.878007 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-849a513a-4544-474c-b376-579ca28a9fc8 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:07.878622 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-849a513a-4544-474c-b376-579ca28a9fc8 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:07.879491 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-849a513a-4544-474c-b376-579ca28a9fc8 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:07.881042 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-849a513a-4544-474c-b376-579ca28a9fc8 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:07.882564 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-849a513a-4544-474c-b376-579ca28a9fc8 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:08.035969 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-eddb15a9-9843-454f-9e45-f98a29e1e433 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:08.041553 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-eddb15a9-9843-454f-9e45-f98a29e1e433 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 93c96362-cc02-493d-a96b-ca19cf3a4e47] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:08.067461 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eddb15a9-9843-454f-9e45-f98a29e1e433 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:08.094777 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eddb15a9-9843-454f-9e45-f98a29e1e433 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:08.095633 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eddb15a9-9843-454f-9e45-f98a29e1e433 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:08.097007 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eddb15a9-9843-454f-9e45-f98a29e1e433 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:08.098171 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eddb15a9-9843-454f-9e45-f98a29e1e433 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:08.099352 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eddb15a9-9843-454f-9e45-f98a29e1e433 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:08.496911 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-849a513a-4544-474c-b376-579ca28a9fc8 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b217f9cbc204919ba77d885315907c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2448b78114c54dd39bc85538fb973dd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:08.505868 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-849a513a-4544-474c-b376-579ca28a9fc8 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] 10.222.0.70 "GET /compute/v2.1/servers/02eba429-ecb3-4a5c-87ea-c049ad7aca1a" status: 200 len: 1521 microversion: 2.1 time: 0.646455 Aug 27 02:58:08.514633 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1813/3621] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:58:07 2022] GET /compute/v2.1/servers/02eba429-ecb3-4a5c-87ea-c049ad7aca1a => generated 1521 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:58:08.521373 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c527f015-3f73-4598-99cc-c3a8b11790b1 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:08.522064 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-c527f015-3f73-4598-99cc-c3a8b11790b1 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] [instance: d6a40f7a-6709-4e75-b3e8-f98abf1b03d8] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:08.538050 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c527f015-3f73-4598-99cc-c3a8b11790b1 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:08.538884 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c527f015-3f73-4598-99cc-c3a8b11790b1 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:08.539461 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c527f015-3f73-4598-99cc-c3a8b11790b1 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:08.540355 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c527f015-3f73-4598-99cc-c3a8b11790b1 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:08.543167 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c527f015-3f73-4598-99cc-c3a8b11790b1 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:08.543598 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c527f015-3f73-4598-99cc-c3a8b11790b1 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:08.596195 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:58:08.774911 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-c527f015-3f73-4598-99cc-c3a8b11790b1 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcc2feab6eb427cb1c1ac9093670ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4190feabcb36413fb443349aadc93a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:08.791283 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-c527f015-3f73-4598-99cc-c3a8b11790b1 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcc2feab6eb427cb1c1ac9093670ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4190feabcb36413fb443349aadc93a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:08.796121 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-c527f015-3f73-4598-99cc-c3a8b11790b1 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcc2feab6eb427cb1c1ac9093670ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4190feabcb36413fb443349aadc93a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:08.799397 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c527f015-3f73-4598-99cc-c3a8b11790b1 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] 10.222.0.70 "GET /compute/v2.1/servers/d6a40f7a-6709-4e75-b3e8-f98abf1b03d8" status: 200 len: 1409 microversion: 2.54 time: 0.282287 Aug 27 02:58:08.801916 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-eddb15a9-9843-454f-9e45-f98a29e1e433 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:08.803399 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1814/3622] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:58:08 2022] GET /compute/v2.1/servers/d6a40f7a-6709-4e75-b3e8-f98abf1b03d8 => generated 1409 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:58:08.818663 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a5ed19e0-6942-4cce-9910-69708c2b9f14 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:08.819624 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a5ed19e0-6942-4cce-9910-69708c2b9f14 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] [instance: 54682cce-6601-49d1-88f7-1c9fcaf7d370] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:08.824436 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-eddb15a9-9843-454f-9e45-f98a29e1e433 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/93c96362-cc02-493d-a96b-ca19cf3a4e47" status: 200 len: 1510 microversion: 2.1 time: 0.792743 Aug 27 02:58:08.834709 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a5ed19e0-6942-4cce-9910-69708c2b9f14 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:08.836245 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a5ed19e0-6942-4cce-9910-69708c2b9f14 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:08.836907 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a5ed19e0-6942-4cce-9910-69708c2b9f14 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:08.841239 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a5ed19e0-6942-4cce-9910-69708c2b9f14 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:08.841725 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1809/3623] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:58:08 2022] GET /compute/v2.1/servers/93c96362-cc02-493d-a96b-ca19cf3a4e47 => generated 1510 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:58:08.842187 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a5ed19e0-6942-4cce-9910-69708c2b9f14 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:08.842810 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a5ed19e0-6942-4cce-9910-69708c2b9f14 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:08.920924 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-aea5f0c8-806e-486f-882a-4386700b6fe0 req-7eca17b0-57c7-4e4c-9092-b2d0383b21bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93c96362-cc02-493d-a96b-ca19cf3a4e47", "name": "network-vif-plugged", "status": "completed", "tag": "89392832-a58f-4596-ba39-a4d42c287569"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:58:08.940819 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-aea5f0c8-806e-486f-882a-4386700b6fe0 req-7eca17b0-57c7-4e4c-9092-b2d0383b21bc service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:08.941518 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-aea5f0c8-806e-486f-882a-4386700b6fe0 req-7eca17b0-57c7-4e4c-9092-b2d0383b21bc service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:08.942441 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-aea5f0c8-806e-486f-882a-4386700b6fe0 req-7eca17b0-57c7-4e4c-9092-b2d0383b21bc service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:08.982724 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-aea5f0c8-806e-486f-882a-4386700b6fe0 req-7eca17b0-57c7-4e4c-9092-b2d0383b21bc service nova] Creating event network-vif-plugged:89392832-a58f-4596-ba39-a4d42c287569 for instance 93c96362-cc02-493d-a96b-ca19cf3a4e47 on n-h1-852278-4 Aug 27 02:58:08.993396 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-aea5f0c8-806e-486f-882a-4386700b6fe0 req-7eca17b0-57c7-4e4c-9092-b2d0383b21bc service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077039 Aug 27 02:58:08.996729 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-a5ed19e0-6942-4cce-9910-69708c2b9f14 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6381ae230a45de8b105374c2d25383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a6a888c878245cb9e5909e071c9b9c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:08.999625 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1810/3624] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:58:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:58:09.007271 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a5ed19e0-6942-4cce-9910-69708c2b9f14 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] 10.222.0.70 "GET /compute/v2.1/servers/54682cce-6601-49d1-88f7-1c9fcaf7d370" status: 200 len: 1468 microversion: 2.1 time: 0.202484 Aug 27 02:58:09.008907 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1815/3625] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:58:08 2022] GET /compute/v2.1/servers/54682cce-6601-49d1-88f7-1c9fcaf7d370 => generated 1468 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:58:09.024999 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-9b06093b-9da4-462c-a8f1-eaec96256bac req-2d138234-a706-4855-9f30-0de52976c00e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54682cce-6601-49d1-88f7-1c9fcaf7d370", "name": "network-vif-deleted", "tag": "630d16a1-f5f9-4ff7-8090-d69fbd0a36a7"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:58:09.056912 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-9b06093b-9da4-462c-a8f1-eaec96256bac req-2d138234-a706-4855-9f30-0de52976c00e service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:09.057501 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-9b06093b-9da4-462c-a8f1-eaec96256bac req-2d138234-a706-4855-9f30-0de52976c00e service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:09.058638 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-9b06093b-9da4-462c-a8f1-eaec96256bac req-2d138234-a706-4855-9f30-0de52976c00e service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:09.072559 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:58:09.101881 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-9b06093b-9da4-462c-a8f1-eaec96256bac req-2d138234-a706-4855-9f30-0de52976c00e service nova] Creating event network-vif-deleted:630d16a1-f5f9-4ff7-8090-d69fbd0a36a7 for instance 54682cce-6601-49d1-88f7-1c9fcaf7d370 on n-h2-852278-4 Aug 27 02:58:09.121902 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-9b06093b-9da4-462c-a8f1-eaec96256bac req-2d138234-a706-4855-9f30-0de52976c00e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117948 Aug 27 02:58:09.122905 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1811/3626] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:58:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:58:09.529821 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a76a14c9-1fdd-4759-8b39-8fdbd5ee2baf tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:09.530427 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a76a14c9-1fdd-4759-8b39-8fdbd5ee2baf tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] [instance: 02eba429-ecb3-4a5c-87ea-c049ad7aca1a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:09.554064 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a76a14c9-1fdd-4759-8b39-8fdbd5ee2baf tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:09.554820 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a76a14c9-1fdd-4759-8b39-8fdbd5ee2baf tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:09.555349 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a76a14c9-1fdd-4759-8b39-8fdbd5ee2baf tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:09.556066 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a76a14c9-1fdd-4759-8b39-8fdbd5ee2baf tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:09.556562 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a76a14c9-1fdd-4759-8b39-8fdbd5ee2baf tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:09.556975 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a76a14c9-1fdd-4759-8b39-8fdbd5ee2baf tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:09.828714 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-1c476d46-83d7-43c7-acf4-b12a2bf4b03c tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:09.830428 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-1c476d46-83d7-43c7-acf4-b12a2bf4b03c tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] [instance: d6a40f7a-6709-4e75-b3e8-f98abf1b03d8] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:09.844886 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1c476d46-83d7-43c7-acf4-b12a2bf4b03c tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:09.845883 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1c476d46-83d7-43c7-acf4-b12a2bf4b03c tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:09.858959 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1c476d46-83d7-43c7-acf4-b12a2bf4b03c tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:09.859802 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1c476d46-83d7-43c7-acf4-b12a2bf4b03c tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:09.860686 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1c476d46-83d7-43c7-acf4-b12a2bf4b03c tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:09.861270 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1c476d46-83d7-43c7-acf4-b12a2bf4b03c tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:09.956332 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-a76a14c9-1fdd-4759-8b39-8fdbd5ee2baf tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b217f9cbc204919ba77d885315907c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2448b78114c54dd39bc85538fb973dd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:09.979408 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a76a14c9-1fdd-4759-8b39-8fdbd5ee2baf tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] 10.222.0.70 "GET /compute/v2.1/servers/02eba429-ecb3-4a5c-87ea-c049ad7aca1a" status: 200 len: 1498 microversion: 2.1 time: 0.444607 Aug 27 02:58:09.980352 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1816/3627] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:58:09 2022] GET /compute/v2.1/servers/02eba429-ecb3-4a5c-87ea-c049ad7aca1a => generated 1498 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:58:09.996722 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-419efe69-dd35-44a3-9cfe-27a690427d5b tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:09.997747 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-419efe69-dd35-44a3-9cfe-27a690427d5b tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 93c96362-cc02-493d-a96b-ca19cf3a4e47] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:10.013177 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-419efe69-dd35-44a3-9cfe-27a690427d5b tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:10.014354 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-419efe69-dd35-44a3-9cfe-27a690427d5b tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:10.017480 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-419efe69-dd35-44a3-9cfe-27a690427d5b tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:10.018657 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-419efe69-dd35-44a3-9cfe-27a690427d5b tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:10.019666 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-419efe69-dd35-44a3-9cfe-27a690427d5b tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:10.021336 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-419efe69-dd35-44a3-9cfe-27a690427d5b tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:10.057413 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-1c476d46-83d7-43c7-acf4-b12a2bf4b03c tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcc2feab6eb427cb1c1ac9093670ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4190feabcb36413fb443349aadc93a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:10.068798 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-1c476d46-83d7-43c7-acf4-b12a2bf4b03c tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcc2feab6eb427cb1c1ac9093670ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4190feabcb36413fb443349aadc93a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:10.071443 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-1c476d46-83d7-43c7-acf4-b12a2bf4b03c tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcc2feab6eb427cb1c1ac9093670ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4190feabcb36413fb443349aadc93a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:10.073139 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-1c476d46-83d7-43c7-acf4-b12a2bf4b03c tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] 10.222.0.70 "GET /compute/v2.1/servers/d6a40f7a-6709-4e75-b3e8-f98abf1b03d8" status: 200 len: 1409 microversion: 2.54 time: 0.249841 Aug 27 02:58:10.074281 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1812/3628] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:58:09 2022] GET /compute/v2.1/servers/d6a40f7a-6709-4e75-b3e8-f98abf1b03d8 => generated 1409 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:58:10.092679 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-87b64d22-2f33-43c2-bb2a-50b376bf84a4 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:10.098605 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-87b64d22-2f33-43c2-bb2a-50b376bf84a4 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2b217f9cbc204919ba77d885315907c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2448b78114c54dd39bc85538fb973dd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:10.105973 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-87b64d22-2f33-43c2-bb2a-50b376bf84a4 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '2448b78114c54dd39bc85538fb973dd2'} {{(pid=134051) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 02:58:10.115465 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-87b64d22-2f33-43c2-bb2a-50b376bf84a4 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:10.116285 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-87b64d22-2f33-43c2-bb2a-50b376bf84a4 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:10.117152 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-87b64d22-2f33-43c2-bb2a-50b376bf84a4 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:10.118098 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-87b64d22-2f33-43c2-bb2a-50b376bf84a4 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:10.118766 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-87b64d22-2f33-43c2-bb2a-50b376bf84a4 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:10.119373 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-87b64d22-2f33-43c2-bb2a-50b376bf84a4 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:10.151737 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.multi_cell_list [None req-87b64d22-2f33-43c2-bb2a-50b376bf84a4 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=134051) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 02:58:10.189215 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-87b64d22-2f33-43c2-bb2a-50b376bf84a4 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] 10.222.0.70 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 346 microversion: 2.1 time: 0.113625 Aug 27 02:58:10.190258 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1813/3629] 10.222.0.70 () {58 vars in 1154 bytes} [Sat Aug 27 02:58:10 2022] GET /compute/v2.1/servers?status=shutoff => generated 346 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:58:10.204037 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-42a97c50-a8f5-43e2-a58c-57709856fd19 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:10.205040 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-42a97c50-a8f5-43e2-a58c-57709856fd19 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] [instance: 54682cce-6601-49d1-88f7-1c9fcaf7d370] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:10.212495 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-42a97c50-a8f5-43e2-a58c-57709856fd19 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:10.213432 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-42a97c50-a8f5-43e2-a58c-57709856fd19 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:10.214081 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-42a97c50-a8f5-43e2-a58c-57709856fd19 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:10.215079 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-42a97c50-a8f5-43e2-a58c-57709856fd19 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:10.215759 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-42a97c50-a8f5-43e2-a58c-57709856fd19 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:10.216412 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-42a97c50-a8f5-43e2-a58c-57709856fd19 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:10.235730 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-42a97c50-a8f5-43e2-a58c-57709856fd19 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] HTTP exception thrown: Instance 54682cce-6601-49d1-88f7-1c9fcaf7d370 could not be found. Aug 27 02:58:10.242713 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-42a97c50-a8f5-43e2-a58c-57709856fd19 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Request method failure captured: Aug 27 02:58:10.242713 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/54682cce-6601-49d1-88f7-1c9fcaf7d370 HTTP/1.1 Aug 27 02:58:10.242713 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:58:10.242713 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:58:10.242713 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:58:10.242713 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:58:10.242713 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:58:10.242713 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:58:10.242713 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:58:10.242713 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:58:10.242713 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYf2b88jccGp908k3vQwdmk8aWVpZgx4XAwdI__tT5JQ00leavue9yGRA0Ra6tx0k8LuwOwvFz5QHaUm9YwpVl7ey0u_0fYkHaP7j9Kliw_5Q5Xf4F9k_115SseZDZeFd_ncRBfnV98omKQ5oUaf4zu042RXCwV00aKzeJyDrzb4sII Aug 27 02:58:10.242713 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:58:10.242713 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:58:10.242713 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:58:10.242713 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:58:10.242713 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:58:10.242713 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:58:10.242713 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 2a6a888c878245cb9e5909e071c9b9c2 Aug 27 02:58:10.242713 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-SecurityGroupsTestJSON-23859158 Aug 27 02:58:10.242713 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:58:10.242713 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:58:10.242713 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2a6a888c878245cb9e5909e071c9b9c2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_2a6a888c878245cb9e5909e071c9b9c2", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2a6a888c878245cb9e5909e071c9b9c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/2a6a888c878245cb9e5909e071c9b9c2"}]}] Aug 27 02:58:10.242713 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-SecurityGroupsTestJSON-23859158 Aug 27 02:58:10.242713 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 2a6a888c878245cb9e5909e071c9b9c2 Aug 27 02:58:10.242713 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-23859158 Aug 27 02:58:10.242713 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-SecurityGroupsTestJSON-23859158-project Aug 27 02:58:10.242713 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:58:10.242713 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:58:10.242713 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: ef6381ae230a45de8b105374c2d25383 Aug 27 02:58:10.242713 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-SecurityGroupsTestJSON-23859158-project Aug 27 02:58:10.242713 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 02:58:10.242713 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance 54682cce-6601-49d1-88f7-1c9fcaf7d370 could not be found. Aug 27 02:58:10.242713 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '54682cce-6601-49d1-88f7-1c9fcaf7d370'} Aug 27 02:58:10.242713 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:58:10.242713 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:58:10.242713 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:58:10.242713 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:58:10.242713 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:58:10.242713 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:58:10.242713 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:58:10.242713 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:58:10.242713 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:58:10.242713 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:58:10.242713 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54682cce-6601-49d1-88f7-1c9fcaf7d370 could not be found. Aug 27 02:58:10.242713 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:58:10.242713 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:58:10.242713 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:58:10.242713 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:58:10.242713 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:58:10.242713 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:58:10.242713 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:58:10.242713 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:58:10.242713 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:58:10.242713 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:58:10.242713 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:58:10.242713 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:58:10.242713 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:58:10.242713 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:58:10.242713 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:58:10.242713 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:58:10.242713 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54682cce-6601-49d1-88f7-1c9fcaf7d370 could not be found. Aug 27 02:58:10.242713 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:58:10.242713 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:58:10.242713 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:58:10.246303 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:58:10.246303 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:58:10.246303 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:58:10.246303 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:58:10.246303 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:58:10.246303 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54682cce-6601-49d1-88f7-1c9fcaf7d370 could not be found. Aug 27 02:58:10.246303 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:58:10.252033 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-42a97c50-a8f5-43e2-a58c-57709856fd19 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Returning 404 to user: Instance 54682cce-6601-49d1-88f7-1c9fcaf7d370 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:58:10.254290 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-42a97c50-a8f5-43e2-a58c-57709856fd19 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] 10.222.0.70 "GET /compute/v2.1/servers/54682cce-6601-49d1-88f7-1c9fcaf7d370" status: 404 len: 111 microversion: 2.1 time: 0.055154 Aug 27 02:58:10.256790 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1814/3630] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:58:10 2022] GET /compute/v2.1/servers/54682cce-6601-49d1-88f7-1c9fcaf7d370 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:58:10.270672 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-01634607-c193-45ce-b636-8976fd4a4a7f tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:58:10.285943 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-01634607-c193-45ce-b636-8976fd4a4a7f tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:10.291898 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-01634607-c193-45ce-b636-8976fd4a4a7f tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:10.295007 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-01634607-c193-45ce-b636-8976fd4a4a7f tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:10.378847 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-01634607-c193-45ce-b636-8976fd4a4a7f tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] [instance: 02eba429-ecb3-4a5c-87ea-c049ad7aca1a] Going to try to start instance {{(pid=134051) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 27 02:58:10.433368 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-419efe69-dd35-44a3-9cfe-27a690427d5b tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:10.462446 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-419efe69-dd35-44a3-9cfe-27a690427d5b tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/93c96362-cc02-493d-a96b-ca19cf3a4e47" status: 200 len: 1510 microversion: 2.1 time: 0.476574 Aug 27 02:58:10.463396 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1817/3631] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:58:09 2022] GET /compute/v2.1/servers/93c96362-cc02-493d-a96b-ca19cf3a4e47 => generated 1510 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:58:10.483074 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0354b7f5-129a-4cb0-bfe7-8d5fe7bf7fc9 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Calling method '.version_select at 0x7f5ee2d53f70>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:10.547039 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-01634607-c193-45ce-b636-8976fd4a4a7f tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] 10.222.0.70 "POST /compute/v2.1/servers/02eba429-ecb3-4a5c-87ea-c049ad7aca1a/action" status: 202 len: 0 microversion: 2.1 time: 0.287849 Aug 27 02:58:10.547964 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1815/3632] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 02:58:10 2022] POST /compute/v2.1/servers/02eba429-ecb3-4a5c-87ea-c049ad7aca1a/action => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:58:10.558674 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4fb941bd-2ac2-40cf-866e-7e869809f1cc tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:10.559657 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-4fb941bd-2ac2-40cf-866e-7e869809f1cc tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] [instance: 02eba429-ecb3-4a5c-87ea-c049ad7aca1a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:10.567168 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4fb941bd-2ac2-40cf-866e-7e869809f1cc tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:10.568081 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4fb941bd-2ac2-40cf-866e-7e869809f1cc tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:10.568900 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4fb941bd-2ac2-40cf-866e-7e869809f1cc tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:10.569900 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4fb941bd-2ac2-40cf-866e-7e869809f1cc tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:10.571374 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4fb941bd-2ac2-40cf-866e-7e869809f1cc tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:10.572246 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4fb941bd-2ac2-40cf-866e-7e869809f1cc tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:11.269436 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-4fb941bd-2ac2-40cf-866e-7e869809f1cc tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b217f9cbc204919ba77d885315907c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2448b78114c54dd39bc85538fb973dd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:11.278924 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-4fb941bd-2ac2-40cf-866e-7e869809f1cc tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] 10.222.0.70 "GET /compute/v2.1/servers/02eba429-ecb3-4a5c-87ea-c049ad7aca1a" status: 200 len: 1507 microversion: 2.1 time: 0.726218 Aug 27 02:58:11.287222 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1816/3633] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:58:10 2022] GET /compute/v2.1/servers/02eba429-ecb3-4a5c-87ea-c049ad7aca1a => generated 1507 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:58:11.300237 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-30bf0de9-8360-4fe8-8b35-c67f0be0886b tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:11.301307 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-30bf0de9-8360-4fe8-8b35-c67f0be0886b tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] [instance: d6a40f7a-6709-4e75-b3e8-f98abf1b03d8] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:11.308263 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-30bf0de9-8360-4fe8-8b35-c67f0be0886b tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:11.316452 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-30bf0de9-8360-4fe8-8b35-c67f0be0886b tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:11.317183 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-30bf0de9-8360-4fe8-8b35-c67f0be0886b tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:11.318140 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-30bf0de9-8360-4fe8-8b35-c67f0be0886b tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:11.318834 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-30bf0de9-8360-4fe8-8b35-c67f0be0886b tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:11.319466 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-30bf0de9-8360-4fe8-8b35-c67f0be0886b tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:11.521352 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-30bf0de9-8360-4fe8-8b35-c67f0be0886b tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcc2feab6eb427cb1c1ac9093670ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4190feabcb36413fb443349aadc93a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:11.535510 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-30bf0de9-8360-4fe8-8b35-c67f0be0886b tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcc2feab6eb427cb1c1ac9093670ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4190feabcb36413fb443349aadc93a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:11.539416 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-30bf0de9-8360-4fe8-8b35-c67f0be0886b tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcc2feab6eb427cb1c1ac9093670ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4190feabcb36413fb443349aadc93a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:11.546748 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-30bf0de9-8360-4fe8-8b35-c67f0be0886b tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] 10.222.0.70 "GET /compute/v2.1/servers/d6a40f7a-6709-4e75-b3e8-f98abf1b03d8" status: 200 len: 1409 microversion: 2.54 time: 0.256008 Aug 27 02:58:11.547699 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1817/3634] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:58:11 2022] GET /compute/v2.1/servers/d6a40f7a-6709-4e75-b3e8-f98abf1b03d8 => generated 1409 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:58:11.560836 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3fc4ffc5-ac75-4e48-8594-23ff9aaeda35 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:11.562808 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-3fc4ffc5-ac75-4e48-8594-23ff9aaeda35 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 93c96362-cc02-493d-a96b-ca19cf3a4e47] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:11.579148 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3fc4ffc5-ac75-4e48-8594-23ff9aaeda35 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:11.585183 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3fc4ffc5-ac75-4e48-8594-23ff9aaeda35 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:11.585964 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3fc4ffc5-ac75-4e48-8594-23ff9aaeda35 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:11.589889 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3fc4ffc5-ac75-4e48-8594-23ff9aaeda35 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:11.592869 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3fc4ffc5-ac75-4e48-8594-23ff9aaeda35 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:11.593566 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3fc4ffc5-ac75-4e48-8594-23ff9aaeda35 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:11.749797 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-0354b7f5-129a-4cb0-bfe7-8d5fe7bf7fc9 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/0b1054b2-aba6-4ca8-8a63-ea6eb56c66ef" status: 202 len: 0 microversion: 2.1 time: 1.285098 Aug 27 02:58:11.754680 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1818/3635] 10.222.0.70 () {58 vars in 1272 bytes} [Sat Aug 27 02:58:10 2022] DELETE /compute/v2.1/os-security-groups/0b1054b2-aba6-4ca8-8a63-ea6eb56c66ef => generated 0 bytes in 1290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:58:11.760720 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-311b87a1-1f7d-4a09-b5b5-52113239556e tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Calling method '.version_select at 0x7f5ee2ef7670>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:11.976897 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-3fc4ffc5-ac75-4e48-8594-23ff9aaeda35 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:11.990729 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-3fc4ffc5-ac75-4e48-8594-23ff9aaeda35 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/93c96362-cc02-493d-a96b-ca19cf3a4e47" status: 200 len: 1510 microversion: 2.1 time: 0.439439 Aug 27 02:58:11.992807 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1818/3636] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:58:11 2022] GET /compute/v2.1/servers/93c96362-cc02-493d-a96b-ca19cf3a4e47 => generated 1510 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:58:12.307887 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-9fe8607e-e5ff-4bee-943c-6cd890ab0344 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:12.309475 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-9fe8607e-e5ff-4bee-943c-6cd890ab0344 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] [instance: 02eba429-ecb3-4a5c-87ea-c049ad7aca1a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:12.317834 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9fe8607e-e5ff-4bee-943c-6cd890ab0344 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:12.318653 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9fe8607e-e5ff-4bee-943c-6cd890ab0344 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:12.319544 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9fe8607e-e5ff-4bee-943c-6cd890ab0344 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:12.320720 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9fe8607e-e5ff-4bee-943c-6cd890ab0344 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:12.321547 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9fe8607e-e5ff-4bee-943c-6cd890ab0344 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:12.322482 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9fe8607e-e5ff-4bee-943c-6cd890ab0344 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:12.502458 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-311b87a1-1f7d-4a09-b5b5-52113239556e tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/878fae5a-8c58-427c-8ab9-c963c385cc0c" status: 202 len: 0 microversion: 2.1 time: 0.746405 Aug 27 02:58:12.505900 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1819/3637] 10.222.0.70 () {58 vars in 1272 bytes} [Sat Aug 27 02:58:11 2022] DELETE /compute/v2.1/os-security-groups/878fae5a-8c58-427c-8ab9-c963c385cc0c => generated 0 bytes in 750 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:58:12.524178 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6f313e90-85e4-4446-8658-8db609a2abc5 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Action: 'create', calling method: .version_select at 0x7f5ee7214ee0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-244440182", "description": "tempest-description-648918083"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:58:12.711326 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-9fe8607e-e5ff-4bee-943c-6cd890ab0344 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b217f9cbc204919ba77d885315907c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2448b78114c54dd39bc85538fb973dd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:12.723098 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-9fe8607e-e5ff-4bee-943c-6cd890ab0344 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] 10.222.0.70 "GET /compute/v2.1/servers/02eba429-ecb3-4a5c-87ea-c049ad7aca1a" status: 200 len: 1507 microversion: 2.1 time: 0.418291 Aug 27 02:58:12.728254 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1819/3638] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:58:12 2022] GET /compute/v2.1/servers/02eba429-ecb3-4a5c-87ea-c049ad7aca1a => generated 1507 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:58:12.738197 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-29a08677-dd48-4b78-8d41-3d637a28cb8a tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:12.739079 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-29a08677-dd48-4b78-8d41-3d637a28cb8a tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] [instance: d6a40f7a-6709-4e75-b3e8-f98abf1b03d8] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:12.749690 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-29a08677-dd48-4b78-8d41-3d637a28cb8a tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:12.750569 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-29a08677-dd48-4b78-8d41-3d637a28cb8a tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:12.751462 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-29a08677-dd48-4b78-8d41-3d637a28cb8a tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:12.752685 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-29a08677-dd48-4b78-8d41-3d637a28cb8a tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:12.753373 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-29a08677-dd48-4b78-8d41-3d637a28cb8a tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:12.754364 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-29a08677-dd48-4b78-8d41-3d637a28cb8a tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:12.928897 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-29a08677-dd48-4b78-8d41-3d637a28cb8a tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcc2feab6eb427cb1c1ac9093670ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4190feabcb36413fb443349aadc93a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:12.941769 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-29a08677-dd48-4b78-8d41-3d637a28cb8a tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcc2feab6eb427cb1c1ac9093670ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4190feabcb36413fb443349aadc93a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:12.945294 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-29a08677-dd48-4b78-8d41-3d637a28cb8a tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcc2feab6eb427cb1c1ac9093670ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4190feabcb36413fb443349aadc93a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:12.949989 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-29a08677-dd48-4b78-8d41-3d637a28cb8a tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] 10.222.0.70 "GET /compute/v2.1/servers/d6a40f7a-6709-4e75-b3e8-f98abf1b03d8" status: 200 len: 1409 microversion: 2.54 time: 0.218452 Aug 27 02:58:12.950799 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1820/3639] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:58:12 2022] GET /compute/v2.1/servers/d6a40f7a-6709-4e75-b3e8-f98abf1b03d8 => generated 1409 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:58:13.017944 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-587fe300-827f-437b-b30e-0987f3a4b138 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:13.020198 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-587fe300-827f-437b-b30e-0987f3a4b138 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 93c96362-cc02-493d-a96b-ca19cf3a4e47] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:13.052512 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-587fe300-827f-437b-b30e-0987f3a4b138 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:13.055938 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-587fe300-827f-437b-b30e-0987f3a4b138 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:13.057583 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-587fe300-827f-437b-b30e-0987f3a4b138 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:13.059226 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-587fe300-827f-437b-b30e-0987f3a4b138 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:13.064205 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-587fe300-827f-437b-b30e-0987f3a4b138 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:13.073350 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-587fe300-827f-437b-b30e-0987f3a4b138 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:13.091478 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-6f313e90-85e4-4446-8658-8db609a2abc5 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] 10.222.0.70 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.573295 Aug 27 02:58:13.092730 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1820/3640] 10.222.0.70 () {60 vars in 1180 bytes} [Sat Aug 27 02:58:12 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:58:13.105388 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-192129d6-2f6e-466d-bb02-6a51dcdd8130 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Action: 'update', calling method: .version_select at 0x7f5ee2cf28b0>, body: {"security_group": {"name": "tempest-sg-hth-18141068", "description": "tempest-description-hth-578599949"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:58:13.374130 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-587fe300-827f-437b-b30e-0987f3a4b138 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:13.382703 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-587fe300-827f-437b-b30e-0987f3a4b138 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/93c96362-cc02-493d-a96b-ca19cf3a4e47" status: 200 len: 1510 microversion: 2.1 time: 0.368885 Aug 27 02:58:13.404794 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1821/3641] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:58:13 2022] GET /compute/v2.1/servers/93c96362-cc02-493d-a96b-ca19cf3a4e47 => generated 1510 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:58:13.670523 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-192129d6-2f6e-466d-bb02-6a51dcdd8130 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] 10.222.0.70 "PUT /compute/v2.1/os-security-groups/0d807ede-9262-473b-b3b5-99a554e8ad89" status: 200 len: 215 microversion: 2.1 time: 0.569313 Aug 27 02:58:13.671139 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1821/3642] 10.222.0.70 () {60 vars in 1290 bytes} [Sat Aug 27 02:58:13 2022] PUT /compute/v2.1/os-security-groups/0d807ede-9262-473b-b3b5-99a554e8ad89 => generated 215 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:58:13.688429 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-9ca1effa-8e38-46c9-8df0-21b8604369aa tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Calling method '.version_select at 0x7f5eddec9dc0>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:13.750019 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-96a36ea7-dd14-45ba-bd9c-5369f5b6823e tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:13.750552 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-96a36ea7-dd14-45ba-bd9c-5369f5b6823e tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] [instance: 02eba429-ecb3-4a5c-87ea-c049ad7aca1a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:13.759945 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-96a36ea7-dd14-45ba-bd9c-5369f5b6823e tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:13.760700 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-96a36ea7-dd14-45ba-bd9c-5369f5b6823e tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:13.762791 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-96a36ea7-dd14-45ba-bd9c-5369f5b6823e tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:13.763870 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-96a36ea7-dd14-45ba-bd9c-5369f5b6823e tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:13.764846 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-9ca1effa-8e38-46c9-8df0-21b8604369aa tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] 10.222.0.70 "GET /compute/v2.1/os-security-groups/0d807ede-9262-473b-b3b5-99a554e8ad89" status: 200 len: 215 microversion: 2.1 time: 0.081452 Aug 27 02:58:13.764961 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-96a36ea7-dd14-45ba-bd9c-5369f5b6823e tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:13.765436 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1822/3643] 10.222.0.70 () {58 vars in 1269 bytes} [Sat Aug 27 02:58:13 2022] GET /compute/v2.1/os-security-groups/0d807ede-9262-473b-b3b5-99a554e8ad89 => generated 215 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:58:13.766910 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-96a36ea7-dd14-45ba-bd9c-5369f5b6823e tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:13.781423 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-6369bef8-bb59-4edf-8630-7f9a7e9f8b0e tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Calling method '.version_select at 0x7f5edded6c10>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:14.010308 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-96a36ea7-dd14-45ba-bd9c-5369f5b6823e tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b217f9cbc204919ba77d885315907c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2448b78114c54dd39bc85538fb973dd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:14.019959 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-96a36ea7-dd14-45ba-bd9c-5369f5b6823e tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] 10.222.0.70 "GET /compute/v2.1/servers/02eba429-ecb3-4a5c-87ea-c049ad7aca1a" status: 200 len: 1511 microversion: 2.1 time: 0.275244 Aug 27 02:58:14.020592 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1822/3644] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:58:13 2022] GET /compute/v2.1/servers/02eba429-ecb3-4a5c-87ea-c049ad7aca1a => generated 1511 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:58:14.045185 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b01e4363-24c0-4c1d-89b4-7c76c8427f9b tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:14.046983 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b01e4363-24c0-4c1d-89b4-7c76c8427f9b tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] [instance: d6a40f7a-6709-4e75-b3e8-f98abf1b03d8] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:14.057233 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b01e4363-24c0-4c1d-89b4-7c76c8427f9b tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:14.058038 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b01e4363-24c0-4c1d-89b4-7c76c8427f9b tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:14.058666 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b01e4363-24c0-4c1d-89b4-7c76c8427f9b tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:14.061193 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b01e4363-24c0-4c1d-89b4-7c76c8427f9b tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:14.061899 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b01e4363-24c0-4c1d-89b4-7c76c8427f9b tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:14.062713 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b01e4363-24c0-4c1d-89b4-7c76c8427f9b tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:14.190859 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b01e4363-24c0-4c1d-89b4-7c76c8427f9b tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcc2feab6eb427cb1c1ac9093670ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4190feabcb36413fb443349aadc93a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:14.216930 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b01e4363-24c0-4c1d-89b4-7c76c8427f9b tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcc2feab6eb427cb1c1ac9093670ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4190feabcb36413fb443349aadc93a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:14.218417 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b01e4363-24c0-4c1d-89b4-7c76c8427f9b tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcc2feab6eb427cb1c1ac9093670ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4190feabcb36413fb443349aadc93a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:14.219627 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b01e4363-24c0-4c1d-89b4-7c76c8427f9b tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] 10.222.0.70 "GET /compute/v2.1/servers/d6a40f7a-6709-4e75-b3e8-f98abf1b03d8" status: 200 len: 1409 microversion: 2.54 time: 0.194991 Aug 27 02:58:14.220199 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1823/3645] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:58:14 2022] GET /compute/v2.1/servers/d6a40f7a-6709-4e75-b3e8-f98abf1b03d8 => generated 1409 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:58:14.228421 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-60d3488c-1563-4d97-9ba5-cf1b42182099 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:14.245543 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-60d3488c-1563-4d97-9ba5-cf1b42182099 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2b217f9cbc204919ba77d885315907c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2448b78114c54dd39bc85538fb973dd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:14.246241 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.compute.servers [None req-60d3488c-1563-4d97-9ba5-cf1b42182099 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Removing options 'limit' from query {{(pid=134052) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 27 02:58:14.249089 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-60d3488c-1563-4d97-9ba5-cf1b42182099 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Searching by: {'deleted': False, 'project_id': '2448b78114c54dd39bc85538fb973dd2'} {{(pid=134052) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 02:58:14.250296 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-60d3488c-1563-4d97-9ba5-cf1b42182099 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:14.250853 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-60d3488c-1563-4d97-9ba5-cf1b42182099 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:14.251221 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-60d3488c-1563-4d97-9ba5-cf1b42182099 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:14.251943 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-60d3488c-1563-4d97-9ba5-cf1b42182099 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:14.252411 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-60d3488c-1563-4d97-9ba5-cf1b42182099 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:14.252829 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-60d3488c-1563-4d97-9ba5-cf1b42182099 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:14.254222 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-60d3488c-1563-4d97-9ba5-cf1b42182099 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] 10.222.0.70 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.030470 Aug 27 02:58:14.257664 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-6369bef8-bb59-4edf-8630-7f9a7e9f8b0e tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/0d807ede-9262-473b-b3b5-99a554e8ad89" status: 202 len: 0 microversion: 2.1 time: 0.480464 Aug 27 02:58:14.258766 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1823/3646] 10.222.0.70 () {58 vars in 1272 bytes} [Sat Aug 27 02:58:13 2022] DELETE /compute/v2.1/os-security-groups/0d807ede-9262-473b-b3b5-99a554e8ad89 => generated 0 bytes in 482 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 02:58:14.261539 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1824/3647] 10.222.0.70 () {58 vars in 1140 bytes} [Sat Aug 27 02:58:14 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:58:14.273257 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4241b990-074b-4f2c-9246-6abb71b6377a tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:14.273867 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-4241b990-074b-4f2c-9246-6abb71b6377a tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] [instance: 02eba429-ecb3-4a5c-87ea-c049ad7aca1a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:14.274245 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-5d07d13b-ec38-44dd-981e-1a5370fd5acc tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:14.274947 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-5d07d13b-ec38-44dd-981e-1a5370fd5acc tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] [instance: 54682cce-6601-49d1-88f7-1c9fcaf7d370] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:14.282942 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5d07d13b-ec38-44dd-981e-1a5370fd5acc tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:14.283797 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5d07d13b-ec38-44dd-981e-1a5370fd5acc tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:14.284489 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5d07d13b-ec38-44dd-981e-1a5370fd5acc tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:14.285515 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5d07d13b-ec38-44dd-981e-1a5370fd5acc tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:14.286225 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4241b990-074b-4f2c-9246-6abb71b6377a tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:14.287710 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5d07d13b-ec38-44dd-981e-1a5370fd5acc tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:14.287818 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4241b990-074b-4f2c-9246-6abb71b6377a tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:14.287899 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5d07d13b-ec38-44dd-981e-1a5370fd5acc tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:14.287990 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4241b990-074b-4f2c-9246-6abb71b6377a tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:14.287990 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4241b990-074b-4f2c-9246-6abb71b6377a tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:14.288269 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4241b990-074b-4f2c-9246-6abb71b6377a tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:14.292687 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4241b990-074b-4f2c-9246-6abb71b6377a tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:14.316376 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-5d07d13b-ec38-44dd-981e-1a5370fd5acc tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] HTTP exception thrown: Instance 54682cce-6601-49d1-88f7-1c9fcaf7d370 could not be found. Aug 27 02:58:14.319011 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-5d07d13b-ec38-44dd-981e-1a5370fd5acc tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Request method failure captured: Aug 27 02:58:14.319011 n-d-852278-4 devstack@n-api.service[134051]: request: DELETE /compute/v2.1/servers/54682cce-6601-49d1-88f7-1c9fcaf7d370 HTTP/1.1 Aug 27 02:58:14.319011 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:58:14.319011 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:58:14.319011 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:58:14.319011 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:58:14.319011 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:58:14.319011 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:58:14.319011 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:58:14.319011 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:58:14.319011 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYf2b88jccGp908k3vQwdmk8aWVpZgx4XAwdI__tT5JQ00leavue9yGRA0Ra6tx0k8LuwOwvFz5QHaUm9YwpVl7ey0u_0fYkHaP7j9Kliw_5Q5Xf4F9k_115SseZDZeFd_ncRBfnV98omKQ5oUaf4zu042RXCwV00aKzeJyDrzb4sII Aug 27 02:58:14.319011 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:58:14.319011 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:58:14.319011 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:58:14.319011 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:58:14.319011 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:58:14.319011 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:58:14.319011 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 2a6a888c878245cb9e5909e071c9b9c2 Aug 27 02:58:14.319011 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-SecurityGroupsTestJSON-23859158 Aug 27 02:58:14.319011 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:58:14.319011 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:58:14.319011 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2a6a888c878245cb9e5909e071c9b9c2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_2a6a888c878245cb9e5909e071c9b9c2", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2a6a888c878245cb9e5909e071c9b9c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/2a6a888c878245cb9e5909e071c9b9c2"}]}] Aug 27 02:58:14.319011 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-SecurityGroupsTestJSON-23859158 Aug 27 02:58:14.319011 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 2a6a888c878245cb9e5909e071c9b9c2 Aug 27 02:58:14.319011 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-23859158 Aug 27 02:58:14.319011 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-SecurityGroupsTestJSON-23859158-project Aug 27 02:58:14.319011 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:58:14.319011 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:58:14.319011 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: ef6381ae230a45de8b105374c2d25383 Aug 27 02:58:14.319011 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-SecurityGroupsTestJSON-23859158-project Aug 27 02:58:14.319011 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 02:58:14.319011 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance 54682cce-6601-49d1-88f7-1c9fcaf7d370 could not be found. Aug 27 02:58:14.319011 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '54682cce-6601-49d1-88f7-1c9fcaf7d370'} Aug 27 02:58:14.319011 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:58:14.319011 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:58:14.319011 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:58:14.319011 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:58:14.319011 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:58:14.319011 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:58:14.319011 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:58:14.319011 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:58:14.319011 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:58:14.319011 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:58:14.319011 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54682cce-6601-49d1-88f7-1c9fcaf7d370 could not be found. Aug 27 02:58:14.319011 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:58:14.319011 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:58:14.319011 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:58:14.319011 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:58:14.319011 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:58:14.319011 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:58:14.319011 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:58:14.319011 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:58:14.319011 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:58:14.319011 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:58:14.319011 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 02:58:14.319011 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 02:58:14.319011 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 02:58:14.319011 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 02:58:14.319011 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:58:14.319011 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:58:14.319011 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:58:14.319011 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:58:14.323554 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54682cce-6601-49d1-88f7-1c9fcaf7d370 could not be found. Aug 27 02:58:14.323554 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:58:14.323554 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:58:14.323554 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:58:14.323554 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:58:14.323554 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:58:14.323554 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:58:14.323554 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:58:14.323554 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:58:14.323554 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54682cce-6601-49d1-88f7-1c9fcaf7d370 could not be found. Aug 27 02:58:14.323554 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:58:14.323554 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-5d07d13b-ec38-44dd-981e-1a5370fd5acc tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Returning 404 to user: Instance 54682cce-6601-49d1-88f7-1c9fcaf7d370 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:58:14.325365 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-5d07d13b-ec38-44dd-981e-1a5370fd5acc tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] 10.222.0.70 "DELETE /compute/v2.1/servers/54682cce-6601-49d1-88f7-1c9fcaf7d370" status: 404 len: 111 microversion: 2.1 time: 0.055885 Aug 27 02:58:14.329119 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1824/3648] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:58:14 2022] DELETE /compute/v2.1/servers/54682cce-6601-49d1-88f7-1c9fcaf7d370 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 02:58:14.337980 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-beda6dca-4c10-42f9-a972-8046ba15085c tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:14.338584 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-beda6dca-4c10-42f9-a972-8046ba15085c tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] [instance: 54682cce-6601-49d1-88f7-1c9fcaf7d370] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:14.347266 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-beda6dca-4c10-42f9-a972-8046ba15085c tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:14.349135 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-beda6dca-4c10-42f9-a972-8046ba15085c tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:14.349135 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-beda6dca-4c10-42f9-a972-8046ba15085c tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:14.349135 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-beda6dca-4c10-42f9-a972-8046ba15085c tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:14.349389 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-beda6dca-4c10-42f9-a972-8046ba15085c tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:14.350838 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-beda6dca-4c10-42f9-a972-8046ba15085c tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:14.367129 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-beda6dca-4c10-42f9-a972-8046ba15085c tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] HTTP exception thrown: Instance 54682cce-6601-49d1-88f7-1c9fcaf7d370 could not be found. Aug 27 02:58:14.369361 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-beda6dca-4c10-42f9-a972-8046ba15085c tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Request method failure captured: Aug 27 02:58:14.369361 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/54682cce-6601-49d1-88f7-1c9fcaf7d370 HTTP/1.1 Aug 27 02:58:14.369361 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:58:14.369361 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:58:14.369361 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:58:14.369361 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:58:14.369361 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:58:14.369361 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:58:14.369361 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:58:14.369361 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:58:14.369361 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYf2b88jccGp908k3vQwdmk8aWVpZgx4XAwdI__tT5JQ00leavue9yGRA0Ra6tx0k8LuwOwvFz5QHaUm9YwpVl7ey0u_0fYkHaP7j9Kliw_5Q5Xf4F9k_115SseZDZeFd_ncRBfnV98omKQ5oUaf4zu042RXCwV00aKzeJyDrzb4sII Aug 27 02:58:14.369361 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:58:14.369361 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:58:14.369361 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:58:14.369361 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:58:14.369361 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:58:14.369361 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:58:14.369361 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 2a6a888c878245cb9e5909e071c9b9c2 Aug 27 02:58:14.369361 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-SecurityGroupsTestJSON-23859158 Aug 27 02:58:14.369361 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:58:14.369361 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:58:14.369361 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2a6a888c878245cb9e5909e071c9b9c2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_2a6a888c878245cb9e5909e071c9b9c2", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2a6a888c878245cb9e5909e071c9b9c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/2a6a888c878245cb9e5909e071c9b9c2"}]}] Aug 27 02:58:14.369361 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-SecurityGroupsTestJSON-23859158 Aug 27 02:58:14.369361 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 2a6a888c878245cb9e5909e071c9b9c2 Aug 27 02:58:14.369361 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-23859158 Aug 27 02:58:14.369361 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-SecurityGroupsTestJSON-23859158-project Aug 27 02:58:14.369361 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:58:14.369361 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:58:14.369361 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: ef6381ae230a45de8b105374c2d25383 Aug 27 02:58:14.369361 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-SecurityGroupsTestJSON-23859158-project Aug 27 02:58:14.369361 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 02:58:14.369361 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance 54682cce-6601-49d1-88f7-1c9fcaf7d370 could not be found. Aug 27 02:58:14.369361 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '54682cce-6601-49d1-88f7-1c9fcaf7d370'} Aug 27 02:58:14.369361 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:58:14.369361 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:58:14.369361 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:58:14.369361 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:58:14.369361 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:58:14.369361 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:58:14.369361 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:58:14.369361 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:58:14.369361 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:58:14.369361 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:58:14.369361 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54682cce-6601-49d1-88f7-1c9fcaf7d370 could not be found. Aug 27 02:58:14.369361 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:58:14.369361 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:58:14.369361 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:58:14.369361 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:58:14.369361 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:58:14.369361 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:58:14.369361 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:58:14.369361 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:58:14.369361 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:58:14.369361 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:58:14.369361 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:58:14.369361 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:58:14.369361 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:58:14.369361 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:58:14.369361 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:58:14.369361 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:58:14.369361 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54682cce-6601-49d1-88f7-1c9fcaf7d370 could not be found. Aug 27 02:58:14.369361 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:58:14.369361 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:58:14.369361 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:58:14.378924 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:58:14.378924 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:58:14.378924 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:58:14.378924 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:58:14.378924 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:58:14.378924 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54682cce-6601-49d1-88f7-1c9fcaf7d370 could not be found. Aug 27 02:58:14.378924 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:58:14.378924 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-beda6dca-4c10-42f9-a972-8046ba15085c tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Returning 404 to user: Instance 54682cce-6601-49d1-88f7-1c9fcaf7d370 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:58:14.378924 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-beda6dca-4c10-42f9-a972-8046ba15085c tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] 10.222.0.70 "GET /compute/v2.1/servers/54682cce-6601-49d1-88f7-1c9fcaf7d370" status: 404 len: 111 microversion: 2.1 time: 0.037239 Aug 27 02:58:14.378924 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1825/3649] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:58:14 2022] GET /compute/v2.1/servers/54682cce-6601-49d1-88f7-1c9fcaf7d370 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:58:14.385002 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-17c9e373-bca4-4887-82ba-bc71af799246 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Calling method '.version_select at 0x7f5eddec9430>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:14.448938 n-d-852278-4 devstack@n-api.service[134051]: DEBUG neutronclient.v2_0.client [None req-17c9e373-bca4-4887-82ba-bc71af799246 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 878fae5a-8c58-427c-8ab9-c963c385cc0c does not exist", "detail": ""}} {{(pid=134051) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 02:58:14.449531 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.network.security_group_api [None req-17c9e373-bca4-4887-82ba-bc71af799246 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Neutron security group 878fae5a-8c58-427c-8ab9-c963c385cc0c not found {{(pid=134051) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 27 02:58:14.450123 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-17c9e373-bca4-4887-82ba-bc71af799246 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] HTTP exception thrown: Security group 878fae5a-8c58-427c-8ab9-c963c385cc0c does not exist Aug 27 02:58:14.450123 n-d-852278-4 devstack@n-api.service[134051]: Neutron server returns request_ids: ['req-9083bfdf-5832-4ce1-9372-daae73667385'] Aug 27 02:58:14.455163 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-17c9e373-bca4-4887-82ba-bc71af799246 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Request method failure captured: Aug 27 02:58:14.455163 n-d-852278-4 devstack@n-api.service[134051]: request: DELETE /compute/v2.1/os-security-groups/878fae5a-8c58-427c-8ab9-c963c385cc0c HTTP/1.1 Aug 27 02:58:14.455163 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:58:14.455163 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:58:14.455163 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:58:14.455163 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:58:14.455163 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:58:14.455163 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:58:14.455163 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:58:14.455163 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:58:14.455163 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYf2b88jccGp908k3vQwdmk8aWVpZgx4XAwdI__tT5JQ00leavue9yGRA0Ra6tx0k8LuwOwvFz5QHaUm9YwpVl7ey0u_0fYkHaP7j9Kliw_5Q5Xf4F9k_115SseZDZeFd_ncRBfnV98omKQ5oUaf4zu042RXCwV00aKzeJyDrzb4sII Aug 27 02:58:14.455163 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:58:14.455163 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:58:14.455163 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:58:14.455163 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:58:14.455163 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:58:14.455163 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:58:14.455163 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 2a6a888c878245cb9e5909e071c9b9c2 Aug 27 02:58:14.455163 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-SecurityGroupsTestJSON-23859158 Aug 27 02:58:14.455163 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:58:14.455163 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:58:14.455163 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2a6a888c878245cb9e5909e071c9b9c2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_2a6a888c878245cb9e5909e071c9b9c2", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2a6a888c878245cb9e5909e071c9b9c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/2a6a888c878245cb9e5909e071c9b9c2"}]}] Aug 27 02:58:14.455163 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-SecurityGroupsTestJSON-23859158 Aug 27 02:58:14.455163 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 2a6a888c878245cb9e5909e071c9b9c2 Aug 27 02:58:14.455163 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-23859158 Aug 27 02:58:14.455163 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-SecurityGroupsTestJSON-23859158-project Aug 27 02:58:14.455163 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:58:14.455163 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:58:14.455163 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: ef6381ae230a45de8b105374c2d25383 Aug 27 02:58:14.455163 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-SecurityGroupsTestJSON-23859158-project Aug 27 02:58:14.455163 n-d-852278-4 devstack@n-api.service[134051]: method: Aug 27 02:58:14.455163 n-d-852278-4 devstack@n-api.service[134051]: exception: Security group 878fae5a-8c58-427c-8ab9-c963c385cc0c does not exist Aug 27 02:58:14.455163 n-d-852278-4 devstack@n-api.service[134051]: Neutron server returns request_ids: ['req-9083bfdf-5832-4ce1-9372-daae73667385'] Aug 27 02:58:14.455163 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '878fae5a-8c58-427c-8ab9-c963c385cc0c'} Aug 27 02:58:14.455163 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:58:14.455163 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:58:14.455163 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 27 02:58:14.455163 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 27 02:58:14.455163 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:58:14.455163 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:58:14.455163 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 27 02:58:14.455163 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 27 02:58:14.455163 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:58:14.455163 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:58:14.455163 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 02:58:14.455163 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 02:58:14.455163 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:58:14.455163 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:58:14.455163 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 02:58:14.455163 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 02:58:14.455163 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:58:14.455163 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:58:14.455163 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 02:58:14.455163 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 02:58:14.455163 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:58:14.455163 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:58:14.455163 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 02:58:14.455163 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 02:58:14.455163 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 02:58:14.455163 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 02:58:14.455163 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 878fae5a-8c58-427c-8ab9-c963c385cc0c does not exist Aug 27 02:58:14.459600 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9083bfdf-5832-4ce1-9372-daae73667385'] Aug 27 02:58:14.459600 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:58:14.459600 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:58:14.459600 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:58:14.459600 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:58:14.459600 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 27 02:58:14.459600 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 27 02:58:14.459600 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 27 02:58:14.459600 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 27 02:58:14.459600 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 878fae5a-8c58-427c-8ab9-c963c385cc0c does not exist Aug 27 02:58:14.459600 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9083bfdf-5832-4ce1-9372-daae73667385'] Aug 27 02:58:14.459600 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:58:14.459600 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:58:14.459600 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:58:14.459600 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:58:14.459600 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:58:14.459600 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:58:14.459600 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:58:14.459600 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:58:14.459600 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:58:14.459600 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:58:14.459600 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:58:14.459600 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:58:14.459600 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 27 02:58:14.459600 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 27 02:58:14.459600 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 878fae5a-8c58-427c-8ab9-c963c385cc0c does not exist Aug 27 02:58:14.459600 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9083bfdf-5832-4ce1-9372-daae73667385'] Aug 27 02:58:14.459600 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:58:14.459600 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:58:14.459600 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:58:14.459600 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:58:14.459600 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:58:14.459600 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:58:14.459600 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:58:14.459600 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:58:14.459600 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 878fae5a-8c58-427c-8ab9-c963c385cc0c does not exist Aug 27 02:58:14.459600 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9083bfdf-5832-4ce1-9372-daae73667385'] Aug 27 02:58:14.459600 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:58:14.459600 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-17c9e373-bca4-4887-82ba-bc71af799246 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Returning 404 to user: Security group 878fae5a-8c58-427c-8ab9-c963c385cc0c does not exist Aug 27 02:58:14.459600 n-d-852278-4 devstack@n-api.service[134051]: Neutron server returns request_ids: ['req-9083bfdf-5832-4ce1-9372-daae73667385'] {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:58:14.459600 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-17c9e373-bca4-4887-82ba-bc71af799246 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/878fae5a-8c58-427c-8ab9-c963c385cc0c" status: 404 len: 194 microversion: 2.1 time: 0.080669 Aug 27 02:58:14.459600 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1826/3650] 10.222.0.70 () {58 vars in 1272 bytes} [Sat Aug 27 02:58:14 2022] DELETE /compute/v2.1/os-security-groups/878fae5a-8c58-427c-8ab9-c963c385cc0c => generated 194 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:58:14.469998 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-48852e5e-715a-4fe0-8f5c-f38b65a9f09e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:14.470766 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-48852e5e-715a-4fe0-8f5c-f38b65a9f09e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 93c96362-cc02-493d-a96b-ca19cf3a4e47] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:14.501408 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-48852e5e-715a-4fe0-8f5c-f38b65a9f09e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:14.501811 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-48852e5e-715a-4fe0-8f5c-f38b65a9f09e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:14.502244 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-48852e5e-715a-4fe0-8f5c-f38b65a9f09e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:14.502942 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-48852e5e-715a-4fe0-8f5c-f38b65a9f09e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:14.505809 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-48852e5e-715a-4fe0-8f5c-f38b65a9f09e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:14.509472 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-48852e5e-715a-4fe0-8f5c-f38b65a9f09e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:14.544616 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-4241b990-074b-4f2c-9246-6abb71b6377a tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b217f9cbc204919ba77d885315907c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2448b78114c54dd39bc85538fb973dd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:14.558305 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-4241b990-074b-4f2c-9246-6abb71b6377a tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] 10.222.0.70 "GET /compute/v2.1/servers/02eba429-ecb3-4a5c-87ea-c049ad7aca1a" status: 200 len: 1511 microversion: 2.1 time: 0.288833 Aug 27 02:58:14.559880 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1825/3651] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:58:14 2022] GET /compute/v2.1/servers/02eba429-ecb3-4a5c-87ea-c049ad7aca1a => generated 1511 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:58:14.566154 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-92fb4498-4526-4672-b4c4-f73958f8be03 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Calling method '.version_select at 0x7f5ee2713ca0>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:14.592618 n-d-852278-4 devstack@n-api.service[134052]: DEBUG neutronclient.v2_0.client [None req-92fb4498-4526-4672-b4c4-f73958f8be03 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 0b1054b2-aba6-4ca8-8a63-ea6eb56c66ef does not exist", "detail": ""}} {{(pid=134052) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 02:58:14.593791 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.network.security_group_api [None req-92fb4498-4526-4672-b4c4-f73958f8be03 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Neutron security group 0b1054b2-aba6-4ca8-8a63-ea6eb56c66ef not found {{(pid=134052) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 27 02:58:14.594795 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-92fb4498-4526-4672-b4c4-f73958f8be03 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] HTTP exception thrown: Security group 0b1054b2-aba6-4ca8-8a63-ea6eb56c66ef does not exist Aug 27 02:58:14.594795 n-d-852278-4 devstack@n-api.service[134052]: Neutron server returns request_ids: ['req-08a062b4-0ec0-408e-876b-94bf5ca0c4ef'] Aug 27 02:58:14.597275 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-92fb4498-4526-4672-b4c4-f73958f8be03 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Request method failure captured: Aug 27 02:58:14.597275 n-d-852278-4 devstack@n-api.service[134052]: request: DELETE /compute/v2.1/os-security-groups/0b1054b2-aba6-4ca8-8a63-ea6eb56c66ef HTTP/1.1 Aug 27 02:58:14.597275 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:58:14.597275 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:58:14.597275 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:58:14.597275 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:58:14.597275 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:58:14.597275 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:58:14.597275 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:58:14.597275 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:58:14.597275 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYf2b88jccGp908k3vQwdmk8aWVpZgx4XAwdI__tT5JQ00leavue9yGRA0Ra6tx0k8LuwOwvFz5QHaUm9YwpVl7ey0u_0fYkHaP7j9Kliw_5Q5Xf4F9k_115SseZDZeFd_ncRBfnV98omKQ5oUaf4zu042RXCwV00aKzeJyDrzb4sII Aug 27 02:58:14.597275 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:58:14.597275 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:58:14.597275 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:58:14.597275 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:58:14.597275 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:58:14.597275 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:58:14.597275 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 2a6a888c878245cb9e5909e071c9b9c2 Aug 27 02:58:14.597275 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-SecurityGroupsTestJSON-23859158 Aug 27 02:58:14.597275 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:58:14.597275 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:58:14.597275 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2a6a888c878245cb9e5909e071c9b9c2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_2a6a888c878245cb9e5909e071c9b9c2", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2a6a888c878245cb9e5909e071c9b9c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/2a6a888c878245cb9e5909e071c9b9c2"}]}] Aug 27 02:58:14.597275 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-SecurityGroupsTestJSON-23859158 Aug 27 02:58:14.597275 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 2a6a888c878245cb9e5909e071c9b9c2 Aug 27 02:58:14.597275 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-23859158 Aug 27 02:58:14.597275 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-SecurityGroupsTestJSON-23859158-project Aug 27 02:58:14.597275 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:58:14.597275 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:58:14.597275 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: ef6381ae230a45de8b105374c2d25383 Aug 27 02:58:14.597275 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-SecurityGroupsTestJSON-23859158-project Aug 27 02:58:14.597275 n-d-852278-4 devstack@n-api.service[134052]: method: Aug 27 02:58:14.597275 n-d-852278-4 devstack@n-api.service[134052]: exception: Security group 0b1054b2-aba6-4ca8-8a63-ea6eb56c66ef does not exist Aug 27 02:58:14.597275 n-d-852278-4 devstack@n-api.service[134052]: Neutron server returns request_ids: ['req-08a062b4-0ec0-408e-876b-94bf5ca0c4ef'] Aug 27 02:58:14.597275 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '0b1054b2-aba6-4ca8-8a63-ea6eb56c66ef'} Aug 27 02:58:14.597275 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:58:14.597275 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:58:14.597275 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 27 02:58:14.597275 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 27 02:58:14.597275 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:58:14.597275 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:58:14.597275 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 27 02:58:14.597275 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 27 02:58:14.597275 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:58:14.597275 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:58:14.597275 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 02:58:14.597275 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 02:58:14.597275 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:58:14.597275 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:58:14.597275 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 02:58:14.597275 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 02:58:14.597275 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:58:14.597275 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:58:14.597275 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 02:58:14.597275 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 02:58:14.597275 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:58:14.597275 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:58:14.597275 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 02:58:14.597275 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 02:58:14.597275 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 02:58:14.597275 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 02:58:14.597275 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 0b1054b2-aba6-4ca8-8a63-ea6eb56c66ef does not exist Aug 27 02:58:14.600539 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-08a062b4-0ec0-408e-876b-94bf5ca0c4ef'] Aug 27 02:58:14.600539 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:58:14.600539 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:58:14.600539 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:58:14.600539 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:58:14.600539 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 27 02:58:14.600539 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 27 02:58:14.600539 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 27 02:58:14.600539 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 27 02:58:14.600539 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 0b1054b2-aba6-4ca8-8a63-ea6eb56c66ef does not exist Aug 27 02:58:14.600539 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-08a062b4-0ec0-408e-876b-94bf5ca0c4ef'] Aug 27 02:58:14.600539 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:58:14.600539 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:58:14.600539 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:58:14.600539 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:58:14.600539 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:58:14.600539 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:58:14.600539 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:58:14.600539 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:58:14.600539 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:58:14.600539 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:58:14.600539 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:58:14.600539 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:58:14.600539 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 27 02:58:14.600539 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 27 02:58:14.600539 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 0b1054b2-aba6-4ca8-8a63-ea6eb56c66ef does not exist Aug 27 02:58:14.600539 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-08a062b4-0ec0-408e-876b-94bf5ca0c4ef'] Aug 27 02:58:14.600539 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:58:14.600539 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:58:14.600539 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:58:14.600539 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:58:14.600539 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:58:14.600539 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:58:14.600539 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:58:14.600539 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:58:14.600539 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 0b1054b2-aba6-4ca8-8a63-ea6eb56c66ef does not exist Aug 27 02:58:14.600539 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-08a062b4-0ec0-408e-876b-94bf5ca0c4ef'] Aug 27 02:58:14.600539 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:58:14.604743 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-92fb4498-4526-4672-b4c4-f73958f8be03 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Returning 404 to user: Security group 0b1054b2-aba6-4ca8-8a63-ea6eb56c66ef does not exist Aug 27 02:58:14.604743 n-d-852278-4 devstack@n-api.service[134052]: Neutron server returns request_ids: ['req-08a062b4-0ec0-408e-876b-94bf5ca0c4ef'] {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:58:14.605904 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-92fb4498-4526-4672-b4c4-f73958f8be03 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/0b1054b2-aba6-4ca8-8a63-ea6eb56c66ef" status: 404 len: 194 microversion: 2.1 time: 0.044521 Aug 27 02:58:14.612411 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1826/3652] 10.222.0.70 () {58 vars in 1272 bytes} [Sat Aug 27 02:58:14 2022] DELETE /compute/v2.1/os-security-groups/0b1054b2-aba6-4ca8-8a63-ea6eb56c66ef => generated 194 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:58:14.631724 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9a64237e-04c7-4524-ace4-b91905d57006 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:14.633802 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-9a64237e-04c7-4524-ace4-b91905d57006 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] [instance: fce0841b-76a8-496d-8fc0-69ad3fa9f7a6] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:14.651325 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9a64237e-04c7-4524-ace4-b91905d57006 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:14.652012 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9a64237e-04c7-4524-ace4-b91905d57006 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:14.652643 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9a64237e-04c7-4524-ace4-b91905d57006 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:14.653529 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9a64237e-04c7-4524-ace4-b91905d57006 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:14.654670 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9a64237e-04c7-4524-ace4-b91905d57006 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:14.655461 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9a64237e-04c7-4524-ace4-b91905d57006 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:14.877525 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-48852e5e-715a-4fe0-8f5c-f38b65a9f09e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:14.887305 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-48852e5e-715a-4fe0-8f5c-f38b65a9f09e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/93c96362-cc02-493d-a96b-ca19cf3a4e47" status: 200 len: 1510 microversion: 2.1 time: 0.428751 Aug 27 02:58:14.889205 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1827/3653] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:58:14 2022] GET /compute/v2.1/servers/93c96362-cc02-493d-a96b-ca19cf3a4e47 => generated 1510 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:58:14.895309 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c0a59e63-393b-4d17-aa7c-14421825784a tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Calling method '.version_select at 0x7f5edded6c10>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:14.964756 n-d-852278-4 devstack@n-api.service[134051]: DEBUG neutronclient.v2_0.client [None req-c0a59e63-393b-4d17-aa7c-14421825784a tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d8813fb6-b445-4b49-9940-9ed5250cecaf does not exist", "detail": ""}} {{(pid=134051) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 02:58:14.965937 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.network.security_group_api [None req-c0a59e63-393b-4d17-aa7c-14421825784a tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Neutron security group d8813fb6-b445-4b49-9940-9ed5250cecaf not found {{(pid=134051) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 27 02:58:14.966957 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-c0a59e63-393b-4d17-aa7c-14421825784a tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] HTTP exception thrown: Security group d8813fb6-b445-4b49-9940-9ed5250cecaf does not exist Aug 27 02:58:14.966957 n-d-852278-4 devstack@n-api.service[134051]: Neutron server returns request_ids: ['req-ed977166-e9f9-4f71-ab9e-7abed625c6f9'] Aug 27 02:58:14.969035 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c0a59e63-393b-4d17-aa7c-14421825784a tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Request method failure captured: Aug 27 02:58:14.969035 n-d-852278-4 devstack@n-api.service[134051]: request: DELETE /compute/v2.1/os-security-groups/d8813fb6-b445-4b49-9940-9ed5250cecaf HTTP/1.1 Aug 27 02:58:14.969035 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:58:14.969035 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:58:14.969035 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:58:14.969035 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:58:14.969035 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:58:14.969035 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:58:14.969035 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:58:14.969035 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:58:14.969035 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYf2b88jccGp908k3vQwdmk8aWVpZgx4XAwdI__tT5JQ00leavue9yGRA0Ra6tx0k8LuwOwvFz5QHaUm9YwpVl7ey0u_0fYkHaP7j9Kliw_5Q5Xf4F9k_115SseZDZeFd_ncRBfnV98omKQ5oUaf4zu042RXCwV00aKzeJyDrzb4sII Aug 27 02:58:14.969035 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:58:14.969035 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:58:14.969035 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:58:14.969035 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:58:14.969035 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:58:14.969035 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:58:14.969035 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 2a6a888c878245cb9e5909e071c9b9c2 Aug 27 02:58:14.969035 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-SecurityGroupsTestJSON-23859158 Aug 27 02:58:14.969035 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:58:14.969035 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:58:14.969035 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2a6a888c878245cb9e5909e071c9b9c2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_2a6a888c878245cb9e5909e071c9b9c2", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2a6a888c878245cb9e5909e071c9b9c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/2a6a888c878245cb9e5909e071c9b9c2"}]}] Aug 27 02:58:14.969035 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-SecurityGroupsTestJSON-23859158 Aug 27 02:58:14.969035 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 2a6a888c878245cb9e5909e071c9b9c2 Aug 27 02:58:14.969035 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-23859158 Aug 27 02:58:14.969035 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-SecurityGroupsTestJSON-23859158-project Aug 27 02:58:14.969035 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:58:14.969035 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:58:14.969035 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: ef6381ae230a45de8b105374c2d25383 Aug 27 02:58:14.969035 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-SecurityGroupsTestJSON-23859158-project Aug 27 02:58:14.969035 n-d-852278-4 devstack@n-api.service[134051]: method: Aug 27 02:58:14.969035 n-d-852278-4 devstack@n-api.service[134051]: exception: Security group d8813fb6-b445-4b49-9940-9ed5250cecaf does not exist Aug 27 02:58:14.969035 n-d-852278-4 devstack@n-api.service[134051]: Neutron server returns request_ids: ['req-ed977166-e9f9-4f71-ab9e-7abed625c6f9'] Aug 27 02:58:14.969035 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': 'd8813fb6-b445-4b49-9940-9ed5250cecaf'} Aug 27 02:58:14.969035 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:58:14.969035 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:58:14.969035 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 27 02:58:14.969035 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 27 02:58:14.969035 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:58:14.969035 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:58:14.969035 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 27 02:58:14.969035 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 27 02:58:14.969035 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:58:14.969035 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:58:14.969035 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 02:58:14.969035 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 02:58:14.969035 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:58:14.969035 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:58:14.969035 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 02:58:14.969035 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 02:58:14.969035 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:58:14.969035 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:58:14.969035 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 02:58:14.969035 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 02:58:14.969035 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:58:14.969035 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:58:14.969035 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 02:58:14.969035 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 02:58:14.969035 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 02:58:14.969035 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 02:58:14.969035 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d8813fb6-b445-4b49-9940-9ed5250cecaf does not exist Aug 27 02:58:14.972241 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ed977166-e9f9-4f71-ab9e-7abed625c6f9'] Aug 27 02:58:14.972241 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:58:14.972241 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:58:14.972241 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:58:14.972241 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:58:14.972241 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 27 02:58:14.972241 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 27 02:58:14.972241 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 27 02:58:14.972241 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 27 02:58:14.972241 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d8813fb6-b445-4b49-9940-9ed5250cecaf does not exist Aug 27 02:58:14.972241 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ed977166-e9f9-4f71-ab9e-7abed625c6f9'] Aug 27 02:58:14.972241 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:58:14.972241 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:58:14.972241 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:58:14.972241 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:58:14.972241 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:58:14.972241 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:58:14.972241 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:58:14.972241 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:58:14.972241 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:58:14.972241 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:58:14.972241 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:58:14.972241 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:58:14.972241 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 27 02:58:14.972241 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 27 02:58:14.972241 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d8813fb6-b445-4b49-9940-9ed5250cecaf does not exist Aug 27 02:58:14.972241 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ed977166-e9f9-4f71-ab9e-7abed625c6f9'] Aug 27 02:58:14.972241 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:58:14.972241 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:58:14.972241 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:58:14.972241 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:58:14.972241 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:58:14.972241 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:58:14.972241 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:58:14.972241 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:58:14.972241 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d8813fb6-b445-4b49-9940-9ed5250cecaf does not exist Aug 27 02:58:14.972241 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ed977166-e9f9-4f71-ab9e-7abed625c6f9'] Aug 27 02:58:14.972241 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:58:14.972241 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c0a59e63-393b-4d17-aa7c-14421825784a tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Returning 404 to user: Security group d8813fb6-b445-4b49-9940-9ed5250cecaf does not exist Aug 27 02:58:14.972241 n-d-852278-4 devstack@n-api.service[134051]: Neutron server returns request_ids: ['req-ed977166-e9f9-4f71-ab9e-7abed625c6f9'] {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:58:14.972241 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c0a59e63-393b-4d17-aa7c-14421825784a tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/d8813fb6-b445-4b49-9940-9ed5250cecaf" status: 404 len: 194 microversion: 2.1 time: 0.080045 Aug 27 02:58:14.972241 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1828/3654] 10.222.0.70 () {58 vars in 1272 bytes} [Sat Aug 27 02:58:14 2022] DELETE /compute/v2.1/os-security-groups/d8813fb6-b445-4b49-9940-9ed5250cecaf => generated 194 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:58:14.979995 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c59f20c2-4735-427d-89ce-c36253b5fd49 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Calling method '.version_select at 0x7f5ee71c4d30>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:14.980180 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-9a64237e-04c7-4524-ace4-b91905d57006 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b217f9cbc204919ba77d885315907c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2448b78114c54dd39bc85538fb973dd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:15.025225 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9a64237e-04c7-4524-ace4-b91905d57006 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] 10.222.0.70 "GET /compute/v2.1/servers/fce0841b-76a8-496d-8fc0-69ad3fa9f7a6" status: 200 len: 1511 microversion: 2.1 time: 0.406893 Aug 27 02:58:15.027950 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1827/3655] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:58:14 2022] GET /compute/v2.1/servers/fce0841b-76a8-496d-8fc0-69ad3fa9f7a6 => generated 1511 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:58:15.050992 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f637da20-71c4-427b-a556-7aa61758c1cd tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:15.053115 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-f637da20-71c4-427b-a556-7aa61758c1cd tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] [instance: edb9e3a3-f71d-4a90-b617-167316a61e44] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:15.076693 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f637da20-71c4-427b-a556-7aa61758c1cd tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:15.076794 n-d-852278-4 devstack@n-api.service[134051]: DEBUG neutronclient.v2_0.client [None req-c59f20c2-4735-427d-89ce-c36253b5fd49 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 020822de-f56c-4739-8056-1159b2a26c5e does not exist", "detail": ""}} {{(pid=134051) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 02:58:15.076794 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.network.security_group_api [None req-c59f20c2-4735-427d-89ce-c36253b5fd49 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Neutron security group 020822de-f56c-4739-8056-1159b2a26c5e not found {{(pid=134051) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 27 02:58:15.076962 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f637da20-71c4-427b-a556-7aa61758c1cd tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:15.077047 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-c59f20c2-4735-427d-89ce-c36253b5fd49 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] HTTP exception thrown: Security group 020822de-f56c-4739-8056-1159b2a26c5e does not exist Aug 27 02:58:15.077047 n-d-852278-4 devstack@n-api.service[134051]: Neutron server returns request_ids: ['req-accd69fb-993f-4fe9-bd50-4482483416f6'] Aug 27 02:58:15.077170 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f637da20-71c4-427b-a556-7aa61758c1cd tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:15.077240 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c59f20c2-4735-427d-89ce-c36253b5fd49 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Request method failure captured: Aug 27 02:58:15.077240 n-d-852278-4 devstack@n-api.service[134051]: request: DELETE /compute/v2.1/os-security-groups/020822de-f56c-4739-8056-1159b2a26c5e HTTP/1.1 Aug 27 02:58:15.077240 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:58:15.077240 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:58:15.077240 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:58:15.077240 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:58:15.077240 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:58:15.077240 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:58:15.077240 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:58:15.077240 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:58:15.077240 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYf2b88jccGp908k3vQwdmk8aWVpZgx4XAwdI__tT5JQ00leavue9yGRA0Ra6tx0k8LuwOwvFz5QHaUm9YwpVl7ey0u_0fYkHaP7j9Kliw_5Q5Xf4F9k_115SseZDZeFd_ncRBfnV98omKQ5oUaf4zu042RXCwV00aKzeJyDrzb4sII Aug 27 02:58:15.077240 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:58:15.077240 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:58:15.077240 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:58:15.077240 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:58:15.077240 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:58:15.077240 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:58:15.077240 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 2a6a888c878245cb9e5909e071c9b9c2 Aug 27 02:58:15.077240 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-SecurityGroupsTestJSON-23859158 Aug 27 02:58:15.077240 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:58:15.077240 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:58:15.077240 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2a6a888c878245cb9e5909e071c9b9c2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_2a6a888c878245cb9e5909e071c9b9c2", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2a6a888c878245cb9e5909e071c9b9c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/2a6a888c878245cb9e5909e071c9b9c2"}]}] Aug 27 02:58:15.077240 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-SecurityGroupsTestJSON-23859158 Aug 27 02:58:15.077240 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 2a6a888c878245cb9e5909e071c9b9c2 Aug 27 02:58:15.077240 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-23859158 Aug 27 02:58:15.077240 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-SecurityGroupsTestJSON-23859158-project Aug 27 02:58:15.077240 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:58:15.077240 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:58:15.077240 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: ef6381ae230a45de8b105374c2d25383 Aug 27 02:58:15.077240 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-SecurityGroupsTestJSON-23859158-project Aug 27 02:58:15.077240 n-d-852278-4 devstack@n-api.service[134051]: method: Aug 27 02:58:15.077240 n-d-852278-4 devstack@n-api.service[134051]: exception: Security group 020822de-f56c-4739-8056-1159b2a26c5e does not exist Aug 27 02:58:15.077240 n-d-852278-4 devstack@n-api.service[134051]: Neutron server returns request_ids: ['req-accd69fb-993f-4fe9-bd50-4482483416f6'] Aug 27 02:58:15.077240 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '020822de-f56c-4739-8056-1159b2a26c5e'} Aug 27 02:58:15.077240 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:58:15.077240 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:58:15.077240 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 27 02:58:15.077240 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 27 02:58:15.077240 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:58:15.077240 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:58:15.077240 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 27 02:58:15.077240 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 27 02:58:15.077240 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:58:15.077240 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:58:15.077240 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 02:58:15.077240 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 02:58:15.077240 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:58:15.077240 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:58:15.077240 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 02:58:15.077240 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 02:58:15.077240 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:58:15.077240 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:58:15.077240 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 02:58:15.077240 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 02:58:15.077240 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:58:15.077240 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:58:15.077240 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 02:58:15.077240 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 02:58:15.077240 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 02:58:15.077240 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 02:58:15.077240 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 020822de-f56c-4739-8056-1159b2a26c5e does not exist Aug 27 02:58:15.081765 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-accd69fb-993f-4fe9-bd50-4482483416f6'] Aug 27 02:58:15.081765 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:58:15.081765 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:58:15.081765 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:58:15.081765 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:58:15.081765 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 27 02:58:15.081765 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 27 02:58:15.081765 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 27 02:58:15.081765 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 27 02:58:15.081765 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 020822de-f56c-4739-8056-1159b2a26c5e does not exist Aug 27 02:58:15.081765 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-accd69fb-993f-4fe9-bd50-4482483416f6'] Aug 27 02:58:15.081765 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:58:15.081765 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:58:15.081765 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:58:15.081765 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:58:15.081765 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:58:15.081765 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:58:15.081765 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:58:15.081765 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:58:15.081765 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:58:15.081765 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:58:15.081765 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:58:15.081765 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:58:15.081765 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 27 02:58:15.081765 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 27 02:58:15.081765 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 020822de-f56c-4739-8056-1159b2a26c5e does not exist Aug 27 02:58:15.081765 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-accd69fb-993f-4fe9-bd50-4482483416f6'] Aug 27 02:58:15.081765 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:58:15.081765 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:58:15.081765 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:58:15.081765 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:58:15.081765 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:58:15.081765 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:58:15.081765 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:58:15.081765 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:58:15.081765 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 020822de-f56c-4739-8056-1159b2a26c5e does not exist Aug 27 02:58:15.081765 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-accd69fb-993f-4fe9-bd50-4482483416f6'] Aug 27 02:58:15.081765 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:58:15.081765 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c59f20c2-4735-427d-89ce-c36253b5fd49 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Returning 404 to user: Security group 020822de-f56c-4739-8056-1159b2a26c5e does not exist Aug 27 02:58:15.081765 n-d-852278-4 devstack@n-api.service[134051]: Neutron server returns request_ids: ['req-accd69fb-993f-4fe9-bd50-4482483416f6'] {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:58:15.081765 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c59f20c2-4735-427d-89ce-c36253b5fd49 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/020822de-f56c-4739-8056-1159b2a26c5e" status: 404 len: 194 microversion: 2.1 time: 0.092717 Aug 27 02:58:15.081765 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1829/3656] 10.222.0.70 () {58 vars in 1272 bytes} [Sat Aug 27 02:58:14 2022] DELETE /compute/v2.1/os-security-groups/020822de-f56c-4739-8056-1159b2a26c5e => generated 194 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:58:15.091619 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f637da20-71c4-427b-a556-7aa61758c1cd tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:15.101336 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f637da20-71c4-427b-a556-7aa61758c1cd tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:15.102089 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f637da20-71c4-427b-a556-7aa61758c1cd tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:15.103922 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-03bd716f-2aa7-4cec-9f90-534fa8f3f465 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Calling method '.version_select at 0x7f5eddec9c10>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:15.162636 n-d-852278-4 devstack@n-api.service[134051]: DEBUG neutronclient.v2_0.client [None req-03bd716f-2aa7-4cec-9f90-534fa8f3f465 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 2e7b5a26-678c-48f7-ba68-f602f10b5adb does not exist", "detail": ""}} {{(pid=134051) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 02:58:15.163107 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.network.security_group_api [None req-03bd716f-2aa7-4cec-9f90-534fa8f3f465 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Neutron security group 2e7b5a26-678c-48f7-ba68-f602f10b5adb not found {{(pid=134051) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 27 02:58:15.163870 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-03bd716f-2aa7-4cec-9f90-534fa8f3f465 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] HTTP exception thrown: Security group 2e7b5a26-678c-48f7-ba68-f602f10b5adb does not exist Aug 27 02:58:15.163870 n-d-852278-4 devstack@n-api.service[134051]: Neutron server returns request_ids: ['req-858b88ac-e886-4f5b-91ca-46ff931f9559'] Aug 27 02:58:15.165727 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-03bd716f-2aa7-4cec-9f90-534fa8f3f465 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Request method failure captured: Aug 27 02:58:15.165727 n-d-852278-4 devstack@n-api.service[134051]: request: DELETE /compute/v2.1/os-security-groups/2e7b5a26-678c-48f7-ba68-f602f10b5adb HTTP/1.1 Aug 27 02:58:15.165727 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:58:15.165727 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:58:15.165727 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:58:15.165727 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:58:15.165727 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:58:15.165727 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:58:15.165727 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:58:15.165727 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:58:15.165727 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYf2b88jccGp908k3vQwdmk8aWVpZgx4XAwdI__tT5JQ00leavue9yGRA0Ra6tx0k8LuwOwvFz5QHaUm9YwpVl7ey0u_0fYkHaP7j9Kliw_5Q5Xf4F9k_115SseZDZeFd_ncRBfnV98omKQ5oUaf4zu042RXCwV00aKzeJyDrzb4sII Aug 27 02:58:15.165727 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:58:15.165727 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:58:15.165727 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:58:15.165727 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:58:15.165727 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:58:15.165727 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:58:15.165727 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 2a6a888c878245cb9e5909e071c9b9c2 Aug 27 02:58:15.165727 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-SecurityGroupsTestJSON-23859158 Aug 27 02:58:15.165727 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:58:15.165727 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:58:15.165727 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2a6a888c878245cb9e5909e071c9b9c2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_2a6a888c878245cb9e5909e071c9b9c2", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2a6a888c878245cb9e5909e071c9b9c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/2a6a888c878245cb9e5909e071c9b9c2"}]}] Aug 27 02:58:15.165727 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-SecurityGroupsTestJSON-23859158 Aug 27 02:58:15.165727 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 2a6a888c878245cb9e5909e071c9b9c2 Aug 27 02:58:15.165727 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-23859158 Aug 27 02:58:15.165727 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-SecurityGroupsTestJSON-23859158-project Aug 27 02:58:15.165727 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:58:15.165727 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:58:15.165727 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: ef6381ae230a45de8b105374c2d25383 Aug 27 02:58:15.165727 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-SecurityGroupsTestJSON-23859158-project Aug 27 02:58:15.165727 n-d-852278-4 devstack@n-api.service[134051]: method: Aug 27 02:58:15.165727 n-d-852278-4 devstack@n-api.service[134051]: exception: Security group 2e7b5a26-678c-48f7-ba68-f602f10b5adb does not exist Aug 27 02:58:15.165727 n-d-852278-4 devstack@n-api.service[134051]: Neutron server returns request_ids: ['req-858b88ac-e886-4f5b-91ca-46ff931f9559'] Aug 27 02:58:15.165727 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '2e7b5a26-678c-48f7-ba68-f602f10b5adb'} Aug 27 02:58:15.165727 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:58:15.165727 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:58:15.165727 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 27 02:58:15.165727 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 27 02:58:15.165727 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:58:15.165727 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:58:15.165727 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 27 02:58:15.165727 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 27 02:58:15.165727 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:58:15.165727 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:58:15.165727 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 02:58:15.165727 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 02:58:15.165727 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:58:15.165727 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:58:15.165727 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 02:58:15.165727 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 02:58:15.165727 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:58:15.165727 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:58:15.165727 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 02:58:15.165727 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 02:58:15.165727 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:58:15.165727 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:58:15.165727 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 02:58:15.165727 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 02:58:15.165727 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 02:58:15.165727 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 02:58:15.165727 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 2e7b5a26-678c-48f7-ba68-f602f10b5adb does not exist Aug 27 02:58:15.170218 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-858b88ac-e886-4f5b-91ca-46ff931f9559'] Aug 27 02:58:15.170218 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:58:15.170218 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:58:15.170218 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:58:15.170218 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:58:15.170218 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 27 02:58:15.170218 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 27 02:58:15.170218 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 27 02:58:15.170218 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 27 02:58:15.170218 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 2e7b5a26-678c-48f7-ba68-f602f10b5adb does not exist Aug 27 02:58:15.170218 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-858b88ac-e886-4f5b-91ca-46ff931f9559'] Aug 27 02:58:15.170218 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:58:15.170218 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:58:15.170218 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:58:15.170218 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:58:15.170218 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:58:15.170218 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:58:15.170218 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:58:15.170218 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:58:15.170218 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:58:15.170218 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:58:15.170218 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:58:15.170218 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:58:15.170218 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 27 02:58:15.170218 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 27 02:58:15.170218 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 2e7b5a26-678c-48f7-ba68-f602f10b5adb does not exist Aug 27 02:58:15.170218 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-858b88ac-e886-4f5b-91ca-46ff931f9559'] Aug 27 02:58:15.170218 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:58:15.170218 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:58:15.170218 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:58:15.170218 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:58:15.170218 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:58:15.170218 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:58:15.170218 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:58:15.170218 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:58:15.170218 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 2e7b5a26-678c-48f7-ba68-f602f10b5adb does not exist Aug 27 02:58:15.170218 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-858b88ac-e886-4f5b-91ca-46ff931f9559'] Aug 27 02:58:15.170218 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:58:15.170218 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-03bd716f-2aa7-4cec-9f90-534fa8f3f465 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Returning 404 to user: Security group 2e7b5a26-678c-48f7-ba68-f602f10b5adb does not exist Aug 27 02:58:15.170218 n-d-852278-4 devstack@n-api.service[134051]: Neutron server returns request_ids: ['req-858b88ac-e886-4f5b-91ca-46ff931f9559'] {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:58:15.170218 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-03bd716f-2aa7-4cec-9f90-534fa8f3f465 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/2e7b5a26-678c-48f7-ba68-f602f10b5adb" status: 404 len: 194 microversion: 2.1 time: 0.068048 Aug 27 02:58:15.170218 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1830/3657] 10.222.0.70 () {58 vars in 1272 bytes} [Sat Aug 27 02:58:15 2022] DELETE /compute/v2.1/os-security-groups/2e7b5a26-678c-48f7-ba68-f602f10b5adb => generated 194 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 02:58:15.175918 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4165f346-5764-49a9-958f-de34b1cea643 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Calling method '.version_select at 0x7f5eddef5940>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:15.257501 n-d-852278-4 devstack@n-api.service[134051]: DEBUG neutronclient.v2_0.client [None req-4165f346-5764-49a9-958f-de34b1cea643 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 7e00f5ae-c548-4406-97df-73cdf5c87dae does not exist", "detail": ""}} {{(pid=134051) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 02:58:15.258097 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.network.security_group_api [None req-4165f346-5764-49a9-958f-de34b1cea643 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Neutron security group 7e00f5ae-c548-4406-97df-73cdf5c87dae not found {{(pid=134051) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 27 02:58:15.259541 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-4165f346-5764-49a9-958f-de34b1cea643 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] HTTP exception thrown: Security group 7e00f5ae-c548-4406-97df-73cdf5c87dae does not exist Aug 27 02:58:15.259541 n-d-852278-4 devstack@n-api.service[134051]: Neutron server returns request_ids: ['req-7c37557c-fa2a-413c-9cf0-b6cf79cd1d83'] Aug 27 02:58:15.261786 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4165f346-5764-49a9-958f-de34b1cea643 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Request method failure captured: Aug 27 02:58:15.261786 n-d-852278-4 devstack@n-api.service[134051]: request: DELETE /compute/v2.1/os-security-groups/7e00f5ae-c548-4406-97df-73cdf5c87dae HTTP/1.1 Aug 27 02:58:15.261786 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:58:15.261786 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:58:15.261786 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:58:15.261786 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:58:15.261786 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:58:15.261786 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:58:15.261786 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:58:15.261786 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:58:15.261786 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYf2b88jccGp908k3vQwdmk8aWVpZgx4XAwdI__tT5JQ00leavue9yGRA0Ra6tx0k8LuwOwvFz5QHaUm9YwpVl7ey0u_0fYkHaP7j9Kliw_5Q5Xf4F9k_115SseZDZeFd_ncRBfnV98omKQ5oUaf4zu042RXCwV00aKzeJyDrzb4sII Aug 27 02:58:15.261786 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:58:15.261786 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:58:15.261786 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:58:15.261786 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:58:15.261786 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:58:15.261786 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:58:15.261786 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 2a6a888c878245cb9e5909e071c9b9c2 Aug 27 02:58:15.261786 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-SecurityGroupsTestJSON-23859158 Aug 27 02:58:15.261786 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:58:15.261786 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:58:15.261786 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2a6a888c878245cb9e5909e071c9b9c2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_2a6a888c878245cb9e5909e071c9b9c2", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2a6a888c878245cb9e5909e071c9b9c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/2a6a888c878245cb9e5909e071c9b9c2"}]}] Aug 27 02:58:15.261786 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-SecurityGroupsTestJSON-23859158 Aug 27 02:58:15.261786 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 2a6a888c878245cb9e5909e071c9b9c2 Aug 27 02:58:15.261786 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-23859158 Aug 27 02:58:15.261786 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-SecurityGroupsTestJSON-23859158-project Aug 27 02:58:15.261786 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:58:15.261786 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:58:15.261786 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: ef6381ae230a45de8b105374c2d25383 Aug 27 02:58:15.261786 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-SecurityGroupsTestJSON-23859158-project Aug 27 02:58:15.261786 n-d-852278-4 devstack@n-api.service[134051]: method: Aug 27 02:58:15.261786 n-d-852278-4 devstack@n-api.service[134051]: exception: Security group 7e00f5ae-c548-4406-97df-73cdf5c87dae does not exist Aug 27 02:58:15.261786 n-d-852278-4 devstack@n-api.service[134051]: Neutron server returns request_ids: ['req-7c37557c-fa2a-413c-9cf0-b6cf79cd1d83'] Aug 27 02:58:15.261786 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '7e00f5ae-c548-4406-97df-73cdf5c87dae'} Aug 27 02:58:15.261786 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:58:15.261786 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:58:15.261786 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 27 02:58:15.261786 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 27 02:58:15.261786 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:58:15.261786 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:58:15.261786 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 27 02:58:15.261786 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 27 02:58:15.261786 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:58:15.261786 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:58:15.261786 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 02:58:15.261786 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 02:58:15.261786 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:58:15.261786 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:58:15.261786 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 02:58:15.261786 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 02:58:15.261786 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:58:15.261786 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:58:15.261786 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 02:58:15.261786 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 02:58:15.261786 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:58:15.261786 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:58:15.261786 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 02:58:15.261786 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 02:58:15.261786 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 02:58:15.261786 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 02:58:15.261786 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 7e00f5ae-c548-4406-97df-73cdf5c87dae does not exist Aug 27 02:58:15.266592 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7c37557c-fa2a-413c-9cf0-b6cf79cd1d83'] Aug 27 02:58:15.266592 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:58:15.266592 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:58:15.266592 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:58:15.266592 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:58:15.266592 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 27 02:58:15.266592 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 27 02:58:15.266592 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 27 02:58:15.266592 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 27 02:58:15.266592 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 7e00f5ae-c548-4406-97df-73cdf5c87dae does not exist Aug 27 02:58:15.266592 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7c37557c-fa2a-413c-9cf0-b6cf79cd1d83'] Aug 27 02:58:15.266592 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:58:15.266592 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:58:15.266592 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:58:15.266592 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:58:15.266592 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:58:15.266592 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:58:15.266592 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:58:15.266592 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:58:15.266592 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:58:15.266592 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:58:15.266592 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:58:15.266592 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:58:15.266592 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 27 02:58:15.266592 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 27 02:58:15.266592 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 7e00f5ae-c548-4406-97df-73cdf5c87dae does not exist Aug 27 02:58:15.266592 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7c37557c-fa2a-413c-9cf0-b6cf79cd1d83'] Aug 27 02:58:15.266592 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:58:15.266592 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:58:15.266592 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:58:15.266592 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:58:15.266592 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:58:15.266592 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:58:15.266592 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:58:15.266592 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:58:15.266592 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 7e00f5ae-c548-4406-97df-73cdf5c87dae does not exist Aug 27 02:58:15.266592 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7c37557c-fa2a-413c-9cf0-b6cf79cd1d83'] Aug 27 02:58:15.266592 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:58:15.274907 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4165f346-5764-49a9-958f-de34b1cea643 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Returning 404 to user: Security group 7e00f5ae-c548-4406-97df-73cdf5c87dae does not exist Aug 27 02:58:15.274907 n-d-852278-4 devstack@n-api.service[134051]: Neutron server returns request_ids: ['req-7c37557c-fa2a-413c-9cf0-b6cf79cd1d83'] {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:58:15.275792 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-4165f346-5764-49a9-958f-de34b1cea643 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/7e00f5ae-c548-4406-97df-73cdf5c87dae" status: 404 len: 194 microversion: 2.1 time: 0.103953 Aug 27 02:58:15.276567 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1831/3658] 10.222.0.70 () {58 vars in 1272 bytes} [Sat Aug 27 02:58:15 2022] DELETE /compute/v2.1/os-security-groups/7e00f5ae-c548-4406-97df-73cdf5c87dae => generated 194 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 02:58:15.288618 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d3f17c3b-3c48-4984-ab41-f1ba58f6776e tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:15.290282 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d3f17c3b-3c48-4984-ab41-f1ba58f6776e tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] [instance: d6a40f7a-6709-4e75-b3e8-f98abf1b03d8] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:15.299141 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d3f17c3b-3c48-4984-ab41-f1ba58f6776e tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:15.300105 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d3f17c3b-3c48-4984-ab41-f1ba58f6776e tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:15.301023 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d3f17c3b-3c48-4984-ab41-f1ba58f6776e tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:15.301939 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d3f17c3b-3c48-4984-ab41-f1ba58f6776e tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:15.302589 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d3f17c3b-3c48-4984-ab41-f1ba58f6776e tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:15.304437 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d3f17c3b-3c48-4984-ab41-f1ba58f6776e tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:15.345938 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-f637da20-71c4-427b-a556-7aa61758c1cd tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b217f9cbc204919ba77d885315907c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2448b78114c54dd39bc85538fb973dd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:15.356617 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f637da20-71c4-427b-a556-7aa61758c1cd tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] 10.222.0.70 "GET /compute/v2.1/servers/edb9e3a3-f71d-4a90-b617-167316a61e44" status: 200 len: 1512 microversion: 2.1 time: 0.309517 Aug 27 02:58:15.357646 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1828/3659] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:58:15 2022] GET /compute/v2.1/servers/edb9e3a3-f71d-4a90-b617-167316a61e44 => generated 1512 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:58:15.363748 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-00739ec0-afc5-410c-9a3a-67e75038a84d tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:15.364472 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-00739ec0-afc5-410c-9a3a-67e75038a84d tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] [instance: 543bc953-d047-4594-a5d1-2d3a33fbfa35] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:15.379553 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-00739ec0-afc5-410c-9a3a-67e75038a84d tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:15.380346 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-00739ec0-afc5-410c-9a3a-67e75038a84d tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:15.380995 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-00739ec0-afc5-410c-9a3a-67e75038a84d tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:15.381841 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-00739ec0-afc5-410c-9a3a-67e75038a84d tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:15.382490 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-00739ec0-afc5-410c-9a3a-67e75038a84d tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:15.383093 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-00739ec0-afc5-410c-9a3a-67e75038a84d tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:15.424159 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-00739ec0-afc5-410c-9a3a-67e75038a84d tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] [instance: 543bc953-d047-4594-a5d1-2d3a33fbfa35] Going to try to terminate instance {{(pid=134052) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:58:15.498603 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d3f17c3b-3c48-4984-ab41-f1ba58f6776e tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcc2feab6eb427cb1c1ac9093670ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4190feabcb36413fb443349aadc93a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:15.559430 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d3f17c3b-3c48-4984-ab41-f1ba58f6776e tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcc2feab6eb427cb1c1ac9093670ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4190feabcb36413fb443349aadc93a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:15.567348 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d3f17c3b-3c48-4984-ab41-f1ba58f6776e tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcc2feab6eb427cb1c1ac9093670ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4190feabcb36413fb443349aadc93a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:15.571905 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-00739ec0-afc5-410c-9a3a-67e75038a84d tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] 10.222.0.70 "DELETE /compute/v2.1/servers/543bc953-d047-4594-a5d1-2d3a33fbfa35" status: 204 len: 0 microversion: 2.1 time: 0.211623 Aug 27 02:58:15.573023 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d3f17c3b-3c48-4984-ab41-f1ba58f6776e tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] 10.222.0.70 "GET /compute/v2.1/servers/d6a40f7a-6709-4e75-b3e8-f98abf1b03d8" status: 200 len: 1409 microversion: 2.54 time: 0.294122 Aug 27 02:58:15.573764 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1832/3661] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:58:15 2022] GET /compute/v2.1/servers/d6a40f7a-6709-4e75-b3e8-f98abf1b03d8 => generated 1409 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:58:15.575989 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1829/3661] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:58:15 2022] DELETE /compute/v2.1/servers/543bc953-d047-4594-a5d1-2d3a33fbfa35 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:58:15.584288 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b2224011-726c-4acf-aee2-8daa01a98442 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:15.587326 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b2224011-726c-4acf-aee2-8daa01a98442 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] [instance: 543bc953-d047-4594-a5d1-2d3a33fbfa35] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:15.595168 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b2224011-726c-4acf-aee2-8daa01a98442 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:15.595553 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d786f439-3e79-4790-b57d-ec5ddb9721ff tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:15.595672 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b2224011-726c-4acf-aee2-8daa01a98442 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:15.596188 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b2224011-726c-4acf-aee2-8daa01a98442 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:15.597214 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b2224011-726c-4acf-aee2-8daa01a98442 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:15.597740 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b2224011-726c-4acf-aee2-8daa01a98442 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:15.598758 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b2224011-726c-4acf-aee2-8daa01a98442 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:15.606440 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d786f439-3e79-4790-b57d-ec5ddb9721ff tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2b217f9cbc204919ba77d885315907c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2448b78114c54dd39bc85538fb973dd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:15.607222 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d786f439-3e79-4790-b57d-ec5ddb9721ff tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Searching by: {'ip': '172.20.0.14', 'deleted': False, 'project_id': '2448b78114c54dd39bc85538fb973dd2'} {{(pid=134051) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 02:58:15.818388 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d786f439-3e79-4790-b57d-ec5ddb9721ff tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:15.818877 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d786f439-3e79-4790-b57d-ec5ddb9721ff tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:15.819316 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d786f439-3e79-4790-b57d-ec5ddb9721ff tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:15.821270 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d786f439-3e79-4790-b57d-ec5ddb9721ff tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:15.821744 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d786f439-3e79-4790-b57d-ec5ddb9721ff tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:15.822367 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d786f439-3e79-4790-b57d-ec5ddb9721ff tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:15.952054 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.multi_cell_list [None req-d786f439-3e79-4790-b57d-ec5ddb9721ff tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=134051) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 02:58:16.035475 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d786f439-3e79-4790-b57d-ec5ddb9721ff tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] 10.222.0.70 "GET /compute/v2.1/servers?ip=172.20.0.14" status: 200 len: 346 microversion: 2.1 time: 0.459901 Aug 27 02:58:16.036767 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1833/3662] 10.222.0.70 () {58 vars in 1154 bytes} [Sat Aug 27 02:58:15 2022] GET /compute/v2.1/servers?ip=172.20.0.14 => generated 346 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:58:16.042167 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c7e60a69-156c-4821-8a7a-19c854295a74 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:16.043009 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-c7e60a69-156c-4821-8a7a-19c854295a74 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 93c96362-cc02-493d-a96b-ca19cf3a4e47] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:16.050641 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c7e60a69-156c-4821-8a7a-19c854295a74 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:16.051388 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c7e60a69-156c-4821-8a7a-19c854295a74 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:16.052262 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c7e60a69-156c-4821-8a7a-19c854295a74 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:16.054076 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c7e60a69-156c-4821-8a7a-19c854295a74 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:16.054789 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c7e60a69-156c-4821-8a7a-19c854295a74 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:16.062601 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c7e60a69-156c-4821-8a7a-19c854295a74 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:16.109905 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b2224011-726c-4acf-aee2-8daa01a98442 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6381ae230a45de8b105374c2d25383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a6a888c878245cb9e5909e071c9b9c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:16.120390 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b2224011-726c-4acf-aee2-8daa01a98442 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] 10.222.0.70 "GET /compute/v2.1/servers/543bc953-d047-4594-a5d1-2d3a33fbfa35" status: 200 len: 1647 microversion: 2.1 time: 0.543034 Aug 27 02:58:16.125262 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1830/3663] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:58:15 2022] GET /compute/v2.1/servers/543bc953-d047-4594-a5d1-2d3a33fbfa35 => generated 1647 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:58:16.148508 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-66a2f566-c57d-45ac-8bf6-48a173535255 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:16.150444 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-66a2f566-c57d-45ac-8bf6-48a173535255 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] [instance: 02eba429-ecb3-4a5c-87ea-c049ad7aca1a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:16.188190 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-66a2f566-c57d-45ac-8bf6-48a173535255 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:16.198377 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-66a2f566-c57d-45ac-8bf6-48a173535255 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:16.199189 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-66a2f566-c57d-45ac-8bf6-48a173535255 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:16.201037 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-66a2f566-c57d-45ac-8bf6-48a173535255 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:16.203836 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-66a2f566-c57d-45ac-8bf6-48a173535255 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:16.204466 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-66a2f566-c57d-45ac-8bf6-48a173535255 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:16.596980 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-c7e60a69-156c-4821-8a7a-19c854295a74 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:16.608180 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-66a2f566-c57d-45ac-8bf6-48a173535255 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b217f9cbc204919ba77d885315907c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2448b78114c54dd39bc85538fb973dd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:16.612912 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c7e60a69-156c-4821-8a7a-19c854295a74 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/93c96362-cc02-493d-a96b-ca19cf3a4e47" status: 200 len: 1510 microversion: 2.1 time: 0.574886 Aug 27 02:58:16.615492 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1834/3664] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:58:16 2022] GET /compute/v2.1/servers/93c96362-cc02-493d-a96b-ca19cf3a4e47 => generated 1510 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:58:16.620494 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4f938da7-c611-4937-bd43-f31a22900ed7 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:16.624765 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-4f938da7-c611-4937-bd43-f31a22900ed7 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] [instance: d6a40f7a-6709-4e75-b3e8-f98abf1b03d8] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:16.633843 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4f938da7-c611-4937-bd43-f31a22900ed7 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:16.634779 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-66a2f566-c57d-45ac-8bf6-48a173535255 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] 10.222.0.70 "GET /compute/v2.1/servers/02eba429-ecb3-4a5c-87ea-c049ad7aca1a" status: 200 len: 1511 microversion: 2.1 time: 0.508408 Aug 27 02:58:16.635061 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4f938da7-c611-4937-bd43-f31a22900ed7 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:16.636144 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1831/3665] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:58:16 2022] GET /compute/v2.1/servers/02eba429-ecb3-4a5c-87ea-c049ad7aca1a => generated 1511 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:58:16.636427 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4f938da7-c611-4937-bd43-f31a22900ed7 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:16.637255 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4f938da7-c611-4937-bd43-f31a22900ed7 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:16.637929 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4f938da7-c611-4937-bd43-f31a22900ed7 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:16.638558 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4f938da7-c611-4937-bd43-f31a22900ed7 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:16.658053 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0b5d6cfb-aaca-4822-89d4-c29cc305896d tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:16.659108 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-0b5d6cfb-aaca-4822-89d4-c29cc305896d tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] [instance: fce0841b-76a8-496d-8fc0-69ad3fa9f7a6] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:16.666537 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0b5d6cfb-aaca-4822-89d4-c29cc305896d tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:16.667268 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0b5d6cfb-aaca-4822-89d4-c29cc305896d tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:16.667871 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0b5d6cfb-aaca-4822-89d4-c29cc305896d tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:16.669010 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0b5d6cfb-aaca-4822-89d4-c29cc305896d tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:16.669623 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0b5d6cfb-aaca-4822-89d4-c29cc305896d tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:16.670343 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0b5d6cfb-aaca-4822-89d4-c29cc305896d tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:16.842764 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-4f938da7-c611-4937-bd43-f31a22900ed7 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcc2feab6eb427cb1c1ac9093670ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4190feabcb36413fb443349aadc93a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:16.847251 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:58:16.865602 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-4f938da7-c611-4937-bd43-f31a22900ed7 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcc2feab6eb427cb1c1ac9093670ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4190feabcb36413fb443349aadc93a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:16.867126 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-4f938da7-c611-4937-bd43-f31a22900ed7 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcc2feab6eb427cb1c1ac9093670ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4190feabcb36413fb443349aadc93a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:16.868356 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-4f938da7-c611-4937-bd43-f31a22900ed7 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] 10.222.0.70 "GET /compute/v2.1/servers/d6a40f7a-6709-4e75-b3e8-f98abf1b03d8" status: 200 len: 1409 microversion: 2.54 time: 0.251636 Aug 27 02:58:16.896667 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1835/3666] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:58:16 2022] GET /compute/v2.1/servers/d6a40f7a-6709-4e75-b3e8-f98abf1b03d8 => generated 1409 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:58:16.928344 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0b5d6cfb-aaca-4822-89d4-c29cc305896d tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b217f9cbc204919ba77d885315907c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2448b78114c54dd39bc85538fb973dd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:16.941596 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-0b5d6cfb-aaca-4822-89d4-c29cc305896d tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] 10.222.0.70 "GET /compute/v2.1/servers/fce0841b-76a8-496d-8fc0-69ad3fa9f7a6" status: 200 len: 1511 microversion: 2.1 time: 0.288203 Aug 27 02:58:16.942140 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1832/3667] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:58:16 2022] GET /compute/v2.1/servers/fce0841b-76a8-496d-8fc0-69ad3fa9f7a6 => generated 1511 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:58:16.965999 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-2f475f2d-34d6-4ae2-8ecb-590bd9832894 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:16.967036 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-2f475f2d-34d6-4ae2-8ecb-590bd9832894 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] [instance: edb9e3a3-f71d-4a90-b617-167316a61e44] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:16.980081 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2f475f2d-34d6-4ae2-8ecb-590bd9832894 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:16.980951 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2f475f2d-34d6-4ae2-8ecb-590bd9832894 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:16.991259 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2f475f2d-34d6-4ae2-8ecb-590bd9832894 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:16.992481 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2f475f2d-34d6-4ae2-8ecb-590bd9832894 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:16.993208 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2f475f2d-34d6-4ae2-8ecb-590bd9832894 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:16.993832 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2f475f2d-34d6-4ae2-8ecb-590bd9832894 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:17.149808 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8390070b-ea32-4a20-997e-9a30b0e628e5 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:17.150806 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-8390070b-ea32-4a20-997e-9a30b0e628e5 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] [instance: 543bc953-d047-4594-a5d1-2d3a33fbfa35] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:17.165852 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8390070b-ea32-4a20-997e-9a30b0e628e5 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:17.167932 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8390070b-ea32-4a20-997e-9a30b0e628e5 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:17.169245 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8390070b-ea32-4a20-997e-9a30b0e628e5 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:17.171023 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8390070b-ea32-4a20-997e-9a30b0e628e5 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:17.173363 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8390070b-ea32-4a20-997e-9a30b0e628e5 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:17.176080 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8390070b-ea32-4a20-997e-9a30b0e628e5 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:17.365170 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-2f475f2d-34d6-4ae2-8ecb-590bd9832894 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b217f9cbc204919ba77d885315907c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2448b78114c54dd39bc85538fb973dd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:17.374142 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-2f475f2d-34d6-4ae2-8ecb-590bd9832894 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] 10.222.0.70 "GET /compute/v2.1/servers/edb9e3a3-f71d-4a90-b617-167316a61e44" status: 200 len: 1512 microversion: 2.1 time: 0.413964 Aug 27 02:58:17.391503 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1836/3668] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:58:16 2022] GET /compute/v2.1/servers/edb9e3a3-f71d-4a90-b617-167316a61e44 => generated 1512 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:58:17.398451 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-365ff348-bbfb-4cef-81e0-282560d1b18a tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:17.432044 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-365ff348-bbfb-4cef-81e0-282560d1b18a tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2b217f9cbc204919ba77d885315907c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2448b78114c54dd39bc85538fb973dd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:17.440002 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-365ff348-bbfb-4cef-81e0-282560d1b18a tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Searching by: {'deleted': False, 'project_id': '2448b78114c54dd39bc85538fb973dd2'} {{(pid=134051) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 02:58:17.464572 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-365ff348-bbfb-4cef-81e0-282560d1b18a tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:17.471083 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-365ff348-bbfb-4cef-81e0-282560d1b18a tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:17.471607 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-365ff348-bbfb-4cef-81e0-282560d1b18a tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:17.474158 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-365ff348-bbfb-4cef-81e0-282560d1b18a tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:17.475240 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-365ff348-bbfb-4cef-81e0-282560d1b18a tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:17.479022 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-365ff348-bbfb-4cef-81e0-282560d1b18a tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:17.568838 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.multi_cell_list [None req-365ff348-bbfb-4cef-81e0-282560d1b18a tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=134051) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 02:58:17.636844 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-8390070b-ea32-4a20-997e-9a30b0e628e5 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6381ae230a45de8b105374c2d25383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a6a888c878245cb9e5909e071c9b9c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:17.645020 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-8390070b-ea32-4a20-997e-9a30b0e628e5 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] 10.222.0.70 "GET /compute/v2.1/servers/543bc953-d047-4594-a5d1-2d3a33fbfa35" status: 200 len: 1647 microversion: 2.1 time: 0.503160 Aug 27 02:58:17.649454 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1833/3669] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:58:17 2022] GET /compute/v2.1/servers/543bc953-d047-4594-a5d1-2d3a33fbfa35 => generated 1647 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:58:17.657765 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-56a4da72-211d-4c6b-bce0-58ce489de098 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:17.658380 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-56a4da72-211d-4c6b-bce0-58ce489de098 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 93c96362-cc02-493d-a96b-ca19cf3a4e47] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:17.681733 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-56a4da72-211d-4c6b-bce0-58ce489de098 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:17.682251 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-56a4da72-211d-4c6b-bce0-58ce489de098 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:17.689389 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-56a4da72-211d-4c6b-bce0-58ce489de098 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:17.691865 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-56a4da72-211d-4c6b-bce0-58ce489de098 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:17.692365 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-56a4da72-211d-4c6b-bce0-58ce489de098 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:17.693799 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-365ff348-bbfb-4cef-81e0-282560d1b18a tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b217f9cbc204919ba77d885315907c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2448b78114c54dd39bc85538fb973dd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:17.695447 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-56a4da72-211d-4c6b-bce0-58ce489de098 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:17.724871 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-365ff348-bbfb-4cef-81e0-282560d1b18a tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:17.725905 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-365ff348-bbfb-4cef-81e0-282560d1b18a tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:17.726418 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-365ff348-bbfb-4cef-81e0-282560d1b18a tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:18.774438 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-56a4da72-211d-4c6b-bce0-58ce489de098 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:18.785306 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-56a4da72-211d-4c6b-bce0-58ce489de098 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/93c96362-cc02-493d-a96b-ca19cf3a4e47" status: 200 len: 1510 microversion: 2.1 time: 1.134723 Aug 27 02:58:18.786266 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1834/3670] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:58:17 2022] GET /compute/v2.1/servers/93c96362-cc02-493d-a96b-ca19cf3a4e47 => generated 1510 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:58:18.795821 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-1add5c67-ef8d-468f-a050-7ebf6b27d9b3 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:18.803089 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-1add5c67-ef8d-468f-a050-7ebf6b27d9b3 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] [instance: d6a40f7a-6709-4e75-b3e8-f98abf1b03d8] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:18.810729 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1add5c67-ef8d-468f-a050-7ebf6b27d9b3 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:18.811223 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1add5c67-ef8d-468f-a050-7ebf6b27d9b3 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:18.811656 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1add5c67-ef8d-468f-a050-7ebf6b27d9b3 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:18.812469 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1add5c67-ef8d-468f-a050-7ebf6b27d9b3 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:18.812828 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1add5c67-ef8d-468f-a050-7ebf6b27d9b3 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:18.813250 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1add5c67-ef8d-468f-a050-7ebf6b27d9b3 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:18.852287 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:58:18.865383 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-365ff348-bbfb-4cef-81e0-282560d1b18a tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] 10.222.0.70 "GET /compute/v2.1/servers/detail" status: 200 len: 4517 microversion: 2.1 time: 1.471969 Aug 27 02:58:18.865922 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1837/3671] 10.222.0.70 () {58 vars in 1146 bytes} [Sat Aug 27 02:58:17 2022] GET /compute/v2.1/servers/detail => generated 4517 bytes in 1473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:58:18.870759 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-94bb2503-1d91-4529-af06-5d87b1859488 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:18.871375 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-94bb2503-1d91-4529-af06-5d87b1859488 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] [instance: 543bc953-d047-4594-a5d1-2d3a33fbfa35] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:18.878193 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-94bb2503-1d91-4529-af06-5d87b1859488 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:18.878693 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-94bb2503-1d91-4529-af06-5d87b1859488 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:18.879129 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-94bb2503-1d91-4529-af06-5d87b1859488 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:18.879832 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-94bb2503-1d91-4529-af06-5d87b1859488 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:18.880285 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-94bb2503-1d91-4529-af06-5d87b1859488 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:18.888181 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-94bb2503-1d91-4529-af06-5d87b1859488 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:19.060298 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-94bb2503-1d91-4529-af06-5d87b1859488 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6381ae230a45de8b105374c2d25383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a6a888c878245cb9e5909e071c9b9c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:19.062056 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-1add5c67-ef8d-468f-a050-7ebf6b27d9b3 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcc2feab6eb427cb1c1ac9093670ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4190feabcb36413fb443349aadc93a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:19.069918 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-94bb2503-1d91-4529-af06-5d87b1859488 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] 10.222.0.70 "GET /compute/v2.1/servers/543bc953-d047-4594-a5d1-2d3a33fbfa35" status: 200 len: 1469 microversion: 2.1 time: 0.202884 Aug 27 02:58:19.073842 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1838/3672] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:58:18 2022] GET /compute/v2.1/servers/543bc953-d047-4594-a5d1-2d3a33fbfa35 => generated 1469 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:58:19.075346 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-1add5c67-ef8d-468f-a050-7ebf6b27d9b3 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcc2feab6eb427cb1c1ac9093670ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4190feabcb36413fb443349aadc93a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:19.078038 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-1add5c67-ef8d-468f-a050-7ebf6b27d9b3 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcc2feab6eb427cb1c1ac9093670ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4190feabcb36413fb443349aadc93a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:19.082850 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-1add5c67-ef8d-468f-a050-7ebf6b27d9b3 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] 10.222.0.70 "GET /compute/v2.1/servers/d6a40f7a-6709-4e75-b3e8-f98abf1b03d8" status: 200 len: 1409 microversion: 2.54 time: 0.292828 Aug 27 02:58:19.087733 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1835/3673] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:58:18 2022] GET /compute/v2.1/servers/d6a40f7a-6709-4e75-b3e8-f98abf1b03d8 => generated 1409 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:58:19.103282 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-e6bbdeb2-90cf-4d2c-ba46-7c2311bb1a06 req-d2b3e76f-84ff-4ed0-b8f0-fc2b63b12e28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "543bc953-d047-4594-a5d1-2d3a33fbfa35", "name": "network-vif-deleted", "tag": "d252ad9d-633f-41f3-917d-80b5159c1f85"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:58:19.110134 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-af67ab7c-1a52-4897-9ed8-9e71ab953bd3 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:19.117758 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-e6bbdeb2-90cf-4d2c-ba46-7c2311bb1a06 req-d2b3e76f-84ff-4ed0-b8f0-fc2b63b12e28 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:19.120918 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-e6bbdeb2-90cf-4d2c-ba46-7c2311bb1a06 req-d2b3e76f-84ff-4ed0-b8f0-fc2b63b12e28 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:19.121525 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-e6bbdeb2-90cf-4d2c-ba46-7c2311bb1a06 req-d2b3e76f-84ff-4ed0-b8f0-fc2b63b12e28 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:19.132211 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-af67ab7c-1a52-4897-9ed8-9e71ab953bd3 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2b217f9cbc204919ba77d885315907c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2448b78114c54dd39bc85538fb973dd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:19.133924 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-af67ab7c-1a52-4897-9ed8-9e71ab953bd3 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': '2448b78114c54dd39bc85538fb973dd2'} {{(pid=134051) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 02:58:19.149569 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-e6bbdeb2-90cf-4d2c-ba46-7c2311bb1a06 req-d2b3e76f-84ff-4ed0-b8f0-fc2b63b12e28 service nova] Creating event network-vif-deleted:d252ad9d-633f-41f3-917d-80b5159c1f85 for instance 543bc953-d047-4594-a5d1-2d3a33fbfa35 on n-h2-852278-4 Aug 27 02:58:19.162753 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-e6bbdeb2-90cf-4d2c-ba46-7c2311bb1a06 req-d2b3e76f-84ff-4ed0-b8f0-fc2b63b12e28 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063900 Aug 27 02:58:19.165740 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1836/3674] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:58:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:58:19.289323 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-af67ab7c-1a52-4897-9ed8-9e71ab953bd3 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:19.290269 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-af67ab7c-1a52-4897-9ed8-9e71ab953bd3 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:19.290857 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-af67ab7c-1a52-4897-9ed8-9e71ab953bd3 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:19.292015 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-af67ab7c-1a52-4897-9ed8-9e71ab953bd3 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:19.292838 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-af67ab7c-1a52-4897-9ed8-9e71ab953bd3 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:19.293468 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-af67ab7c-1a52-4897-9ed8-9e71ab953bd3 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:19.347327 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.multi_cell_list [None req-af67ab7c-1a52-4897-9ed8-9e71ab953bd3 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=134051) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 02:58:19.421548 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-af67ab7c-1a52-4897-9ed8-9e71ab953bd3 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] 10.222.0.70 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1012 microversion: 2.1 time: 0.332395 Aug 27 02:58:19.424022 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1839/3675] 10.222.0.70 () {58 vars in 1150 bytes} [Sat Aug 27 02:58:19 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1012 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:58:19.445315 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e24377d5-27ea-4db6-8c7c-1dbccc681fdd tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:19.462107 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-e24377d5-27ea-4db6-8c7c-1dbccc681fdd tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2b217f9cbc204919ba77d885315907c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2448b78114c54dd39bc85538fb973dd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:19.465831 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-e24377d5-27ea-4db6-8c7c-1dbccc681fdd tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '2448b78114c54dd39bc85538fb973dd2'} {{(pid=134052) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 02:58:19.477571 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e24377d5-27ea-4db6-8c7c-1dbccc681fdd tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:19.478255 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e24377d5-27ea-4db6-8c7c-1dbccc681fdd tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:19.478690 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e24377d5-27ea-4db6-8c7c-1dbccc681fdd tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:19.479430 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e24377d5-27ea-4db6-8c7c-1dbccc681fdd tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:19.480077 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e24377d5-27ea-4db6-8c7c-1dbccc681fdd tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:19.481037 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e24377d5-27ea-4db6-8c7c-1dbccc681fdd tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:19.650371 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.multi_cell_list [None req-e24377d5-27ea-4db6-8c7c-1dbccc681fdd tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=134052) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 02:58:19.741451 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e24377d5-27ea-4db6-8c7c-1dbccc681fdd tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] 10.222.0.70 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1012 microversion: 2.1 time: 0.307277 Aug 27 02:58:19.742578 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1837/3676] 10.222.0.70 () {58 vars in 1212 bytes} [Sat Aug 27 02:58:19 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1012 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:58:19.755282 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-756cc211-511c-4bc3-9f9f-961623c4c6a5 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:19.762602 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-756cc211-511c-4bc3-9f9f-961623c4c6a5 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2b217f9cbc204919ba77d885315907c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2448b78114c54dd39bc85538fb973dd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:19.763783 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-756cc211-511c-4bc3-9f9f-961623c4c6a5 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '2448b78114c54dd39bc85538fb973dd2'} {{(pid=134051) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 02:58:19.778763 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-756cc211-511c-4bc3-9f9f-961623c4c6a5 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:19.784612 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-756cc211-511c-4bc3-9f9f-961623c4c6a5 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:19.785236 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-756cc211-511c-4bc3-9f9f-961623c4c6a5 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:19.786103 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-756cc211-511c-4bc3-9f9f-961623c4c6a5 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:19.786639 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-756cc211-511c-4bc3-9f9f-961623c4c6a5 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:19.787076 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-756cc211-511c-4bc3-9f9f-961623c4c6a5 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:19.812660 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-265af2f3-fbb7-4d82-8901-2077456401ab tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:19.813654 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-265af2f3-fbb7-4d82-8901-2077456401ab tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 93c96362-cc02-493d-a96b-ca19cf3a4e47] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:19.824408 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-265af2f3-fbb7-4d82-8901-2077456401ab tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:19.824918 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-265af2f3-fbb7-4d82-8901-2077456401ab tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:19.827955 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-265af2f3-fbb7-4d82-8901-2077456401ab tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:19.829104 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-265af2f3-fbb7-4d82-8901-2077456401ab tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:19.829458 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-265af2f3-fbb7-4d82-8901-2077456401ab tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:19.832429 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-265af2f3-fbb7-4d82-8901-2077456401ab tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:19.955113 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.multi_cell_list [None req-756cc211-511c-4bc3-9f9f-961623c4c6a5 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=134051) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 02:58:20.094930 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-756cc211-511c-4bc3-9f9f-961623c4c6a5 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] 10.222.0.70 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1012 microversion: 2.1 time: 0.344357 Aug 27 02:58:20.097894 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1840/3677] 10.222.0.70 () {58 vars in 1196 bytes} [Sat Aug 27 02:58:19 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1012 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:58:20.102826 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-265af2f3-fbb7-4d82-8901-2077456401ab tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:20.107166 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-77f9b89e-6f07-4392-8b42-379fc249ba4d tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:20.109628 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-77f9b89e-6f07-4392-8b42-379fc249ba4d tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] [instance: 543bc953-d047-4594-a5d1-2d3a33fbfa35] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:20.121599 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-265af2f3-fbb7-4d82-8901-2077456401ab tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/93c96362-cc02-493d-a96b-ca19cf3a4e47" status: 200 len: 1510 microversion: 2.1 time: 0.314701 Aug 27 02:58:20.123403 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1838/3678] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:58:19 2022] GET /compute/v2.1/servers/93c96362-cc02-493d-a96b-ca19cf3a4e47 => generated 1510 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:58:20.129186 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9d6360de-7069-4fe7-b8a5-4d6feafcfd93 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:20.136732 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-77f9b89e-6f07-4392-8b42-379fc249ba4d tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:20.137172 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-77f9b89e-6f07-4392-8b42-379fc249ba4d tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:20.137615 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-77f9b89e-6f07-4392-8b42-379fc249ba4d tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:20.138832 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-77f9b89e-6f07-4392-8b42-379fc249ba4d tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:20.139588 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-9d6360de-7069-4fe7-b8a5-4d6feafcfd93 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2b217f9cbc204919ba77d885315907c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2448b78114c54dd39bc85538fb973dd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:20.142070 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-9d6360de-7069-4fe7-b8a5-4d6feafcfd93 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Searching by: {'name': '1118990088', 'deleted': False, 'project_id': '2448b78114c54dd39bc85538fb973dd2'} {{(pid=134052) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 02:58:20.151616 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9d6360de-7069-4fe7-b8a5-4d6feafcfd93 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:20.152562 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9d6360de-7069-4fe7-b8a5-4d6feafcfd93 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:20.152769 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-77f9b89e-6f07-4392-8b42-379fc249ba4d tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:20.153455 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-77f9b89e-6f07-4392-8b42-379fc249ba4d tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:20.153755 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9d6360de-7069-4fe7-b8a5-4d6feafcfd93 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:20.155953 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9d6360de-7069-4fe7-b8a5-4d6feafcfd93 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:20.157343 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9d6360de-7069-4fe7-b8a5-4d6feafcfd93 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:20.158106 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9d6360de-7069-4fe7-b8a5-4d6feafcfd93 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:20.222385 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-77f9b89e-6f07-4392-8b42-379fc249ba4d tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:20.222893 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-77f9b89e-6f07-4392-8b42-379fc249ba4d tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:20.224500 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-77f9b89e-6f07-4392-8b42-379fc249ba4d tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:20.225200 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.objects.instance [None req-77f9b89e-6f07-4392-8b42-379fc249ba4d tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lazy-loading 'fault' on Instance uuid 543bc953-d047-4594-a5d1-2d3a33fbfa35 {{(pid=134051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:58:20.305691 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-77f9b89e-6f07-4392-8b42-379fc249ba4d tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6381ae230a45de8b105374c2d25383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a6a888c878245cb9e5909e071c9b9c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:20.319645 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-77f9b89e-6f07-4392-8b42-379fc249ba4d tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] 10.222.0.70 "GET /compute/v2.1/servers/543bc953-d047-4594-a5d1-2d3a33fbfa35" status: 200 len: 1306 microversion: 2.1 time: 0.217603 Aug 27 02:58:20.321019 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1841/3679] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:58:20 2022] GET /compute/v2.1/servers/543bc953-d047-4594-a5d1-2d3a33fbfa35 => generated 1306 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:58:20.362351 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f49642e0-9af6-4832-9e74-d893edfda477 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:20.363450 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-f49642e0-9af6-4832-9e74-d893edfda477 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] [instance: d6a40f7a-6709-4e75-b3e8-f98abf1b03d8] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:20.376833 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.multi_cell_list [None req-9d6360de-7069-4fe7-b8a5-4d6feafcfd93 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=134052) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 02:58:20.377436 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f49642e0-9af6-4832-9e74-d893edfda477 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:20.378555 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f49642e0-9af6-4832-9e74-d893edfda477 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:20.379376 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f49642e0-9af6-4832-9e74-d893edfda477 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:20.380907 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f49642e0-9af6-4832-9e74-d893edfda477 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:20.383974 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f49642e0-9af6-4832-9e74-d893edfda477 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:20.384779 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f49642e0-9af6-4832-9e74-d893edfda477 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:20.446369 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9d6360de-7069-4fe7-b8a5-4d6feafcfd93 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] 10.222.0.70 "GET /compute/v2.1/servers?name=1118990088" status: 200 len: 346 microversion: 2.1 time: 0.321585 Aug 27 02:58:20.455547 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1839/3680] 10.222.0.70 () {58 vars in 1156 bytes} [Sat Aug 27 02:58:20 2022] GET /compute/v2.1/servers?name=1118990088 => generated 346 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:58:20.460469 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-fceca858-cd70-4e4d-bdbd-1d36197e42df tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:20.465852 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-fceca858-cd70-4e4d-bdbd-1d36197e42df tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2b217f9cbc204919ba77d885315907c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2448b78114c54dd39bc85538fb973dd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:20.466530 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-fceca858-cd70-4e4d-bdbd-1d36197e42df tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '2448b78114c54dd39bc85538fb973dd2'} {{(pid=134052) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 02:58:20.471823 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fceca858-cd70-4e4d-bdbd-1d36197e42df tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:20.472304 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fceca858-cd70-4e4d-bdbd-1d36197e42df tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:20.472772 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fceca858-cd70-4e4d-bdbd-1d36197e42df tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:20.473481 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fceca858-cd70-4e4d-bdbd-1d36197e42df tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:20.473919 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fceca858-cd70-4e4d-bdbd-1d36197e42df tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:20.474338 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fceca858-cd70-4e4d-bdbd-1d36197e42df tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:20.581291 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.multi_cell_list [None req-fceca858-cd70-4e4d-bdbd-1d36197e42df tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=134052) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 02:58:20.606905 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-f49642e0-9af6-4832-9e74-d893edfda477 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcc2feab6eb427cb1c1ac9093670ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4190feabcb36413fb443349aadc93a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:20.624175 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-f49642e0-9af6-4832-9e74-d893edfda477 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcc2feab6eb427cb1c1ac9093670ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4190feabcb36413fb443349aadc93a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:20.628532 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-f49642e0-9af6-4832-9e74-d893edfda477 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcc2feab6eb427cb1c1ac9093670ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4190feabcb36413fb443349aadc93a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:20.630876 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-f49642e0-9af6-4832-9e74-d893edfda477 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] 10.222.0.70 "GET /compute/v2.1/servers/d6a40f7a-6709-4e75-b3e8-f98abf1b03d8" status: 200 len: 1409 microversion: 2.54 time: 0.308618 Aug 27 02:58:20.631646 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1842/3681] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:58:20 2022] GET /compute/v2.1/servers/d6a40f7a-6709-4e75-b3e8-f98abf1b03d8 => generated 1409 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:58:20.651343 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-fceca858-cd70-4e4d-bdbd-1d36197e42df tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] 10.222.0.70 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1012 microversion: 2.1 time: 0.194310 Aug 27 02:58:20.656763 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1840/3682] 10.222.0.70 () {58 vars in 1154 bytes} [Sat Aug 27 02:58:20 2022] GET /compute/v2.1/servers?name=-instance => generated 1012 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:58:20.665794 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-89dc94fa-fd2d-46e2-9026-e4db85c64fb8 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:20.671376 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-89dc94fa-fd2d-46e2-9026-e4db85c64fb8 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2b217f9cbc204919ba77d885315907c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2448b78114c54dd39bc85538fb973dd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:20.672058 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-89dc94fa-fd2d-46e2-9026-e4db85c64fb8 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-111899008', 'deleted': False, 'project_id': '2448b78114c54dd39bc85538fb973dd2'} {{(pid=134051) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 02:58:20.678483 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-89dc94fa-fd2d-46e2-9026-e4db85c64fb8 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:20.679029 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-89dc94fa-fd2d-46e2-9026-e4db85c64fb8 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:20.679608 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-89dc94fa-fd2d-46e2-9026-e4db85c64fb8 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:20.681364 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-89dc94fa-fd2d-46e2-9026-e4db85c64fb8 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:20.681899 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-89dc94fa-fd2d-46e2-9026-e4db85c64fb8 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:20.682708 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-89dc94fa-fd2d-46e2-9026-e4db85c64fb8 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:20.789355 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.multi_cell_list [None req-89dc94fa-fd2d-46e2-9026-e4db85c64fb8 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=134051) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 02:58:20.862265 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-89dc94fa-fd2d-46e2-9026-e4db85c64fb8 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] 10.222.0.70 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-111899008" status: 200 len: 346 microversion: 2.1 time: 0.200604 Aug 27 02:58:20.863175 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1843/3683] 10.222.0.70 () {58 vars in 1228 bytes} [Sat Aug 27 02:58:20 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-111899008 => generated 346 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:58:20.876448 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-02d9bddf-72b2-49a2-a3e6-f8a146c99a92 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:20.877370 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-02d9bddf-72b2-49a2-a3e6-f8a146c99a92 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] [instance: edb9e3a3-f71d-4a90-b617-167316a61e44] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:20.883118 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-02d9bddf-72b2-49a2-a3e6-f8a146c99a92 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:20.883605 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-02d9bddf-72b2-49a2-a3e6-f8a146c99a92 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:20.884039 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-02d9bddf-72b2-49a2-a3e6-f8a146c99a92 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:20.884824 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-02d9bddf-72b2-49a2-a3e6-f8a146c99a92 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:20.885224 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-02d9bddf-72b2-49a2-a3e6-f8a146c99a92 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:20.885642 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-02d9bddf-72b2-49a2-a3e6-f8a146c99a92 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:20.943574 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-02d9bddf-72b2-49a2-a3e6-f8a146c99a92 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] [instance: edb9e3a3-f71d-4a90-b617-167316a61e44] Going to try to terminate instance {{(pid=134052) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:58:21.143624 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-2972b3f6-a6a0-49a8-8daa-f1a5a07b434e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:21.144593 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-2972b3f6-a6a0-49a8-8daa-f1a5a07b434e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 93c96362-cc02-493d-a96b-ca19cf3a4e47] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:21.159159 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2972b3f6-a6a0-49a8-8daa-f1a5a07b434e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:21.161043 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2972b3f6-a6a0-49a8-8daa-f1a5a07b434e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:21.161720 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2972b3f6-a6a0-49a8-8daa-f1a5a07b434e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:21.162673 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2972b3f6-a6a0-49a8-8daa-f1a5a07b434e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:21.163629 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2972b3f6-a6a0-49a8-8daa-f1a5a07b434e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:21.164347 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2972b3f6-a6a0-49a8-8daa-f1a5a07b434e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:21.401557 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-2972b3f6-a6a0-49a8-8daa-f1a5a07b434e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:21.414040 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-2972b3f6-a6a0-49a8-8daa-f1a5a07b434e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/93c96362-cc02-493d-a96b-ca19cf3a4e47" status: 200 len: 1510 microversion: 2.1 time: 0.274405 Aug 27 02:58:21.417266 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1844/3684] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:58:21 2022] GET /compute/v2.1/servers/93c96362-cc02-493d-a96b-ca19cf3a4e47 => generated 1510 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:58:21.442043 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a9f482d8-9c05-40de-9007-3d06d4a2bdeb tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:21.445910 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-02d9bddf-72b2-49a2-a3e6-f8a146c99a92 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] 10.222.0.70 "DELETE /compute/v2.1/servers/edb9e3a3-f71d-4a90-b617-167316a61e44" status: 204 len: 0 microversion: 2.1 time: 0.574112 Aug 27 02:58:21.450852 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1841/3685] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:58:20 2022] DELETE /compute/v2.1/servers/edb9e3a3-f71d-4a90-b617-167316a61e44 => generated 0 bytes in 576 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:58:21.451026 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-a9f482d8-9c05-40de-9007-3d06d4a2bdeb tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] [instance: 543bc953-d047-4594-a5d1-2d3a33fbfa35] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:21.458329 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a9f482d8-9c05-40de-9007-3d06d4a2bdeb tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:21.459021 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a9f482d8-9c05-40de-9007-3d06d4a2bdeb tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:21.459755 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a9f482d8-9c05-40de-9007-3d06d4a2bdeb tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:21.460601 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a9f482d8-9c05-40de-9007-3d06d4a2bdeb tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:21.461262 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a9f482d8-9c05-40de-9007-3d06d4a2bdeb tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:21.466101 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a9f482d8-9c05-40de-9007-3d06d4a2bdeb tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:21.470309 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-77a0502f-285c-43c7-a47a-db1f0210ff83 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:21.471163 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-77a0502f-285c-43c7-a47a-db1f0210ff83 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] [instance: edb9e3a3-f71d-4a90-b617-167316a61e44] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:21.478353 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-77a0502f-285c-43c7-a47a-db1f0210ff83 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:21.478779 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-77a0502f-285c-43c7-a47a-db1f0210ff83 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:21.479794 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-77a0502f-285c-43c7-a47a-db1f0210ff83 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:21.480552 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-77a0502f-285c-43c7-a47a-db1f0210ff83 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:21.481003 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-77a0502f-285c-43c7-a47a-db1f0210ff83 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:21.481422 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-77a0502f-285c-43c7-a47a-db1f0210ff83 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:21.500394 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-a9f482d8-9c05-40de-9007-3d06d4a2bdeb tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] HTTP exception thrown: Instance 543bc953-d047-4594-a5d1-2d3a33fbfa35 could not be found. Aug 27 02:58:21.502772 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a9f482d8-9c05-40de-9007-3d06d4a2bdeb tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Request method failure captured: Aug 27 02:58:21.502772 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/543bc953-d047-4594-a5d1-2d3a33fbfa35 HTTP/1.1 Aug 27 02:58:21.502772 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:58:21.502772 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:58:21.502772 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:58:21.502772 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:58:21.502772 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:58:21.502772 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:58:21.502772 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:58:21.502772 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:58:21.502772 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYf2b88jccGp908k3vQwdmk8aWVpZgx4XAwdI__tT5JQ00leavue9yGRA0Ra6tx0k8LuwOwvFz5QHaUm9YwpVl7ey0u_0fYkHaP7j9Kliw_5Q5Xf4F9k_115SseZDZeFd_ncRBfnV98omKQ5oUaf4zu042RXCwV00aKzeJyDrzb4sII Aug 27 02:58:21.502772 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:58:21.502772 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:58:21.502772 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:58:21.502772 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:58:21.502772 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:58:21.502772 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:58:21.502772 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 2a6a888c878245cb9e5909e071c9b9c2 Aug 27 02:58:21.502772 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-SecurityGroupsTestJSON-23859158 Aug 27 02:58:21.502772 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:58:21.502772 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:58:21.502772 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2a6a888c878245cb9e5909e071c9b9c2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_2a6a888c878245cb9e5909e071c9b9c2", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2a6a888c878245cb9e5909e071c9b9c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/2a6a888c878245cb9e5909e071c9b9c2"}]}] Aug 27 02:58:21.502772 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-SecurityGroupsTestJSON-23859158 Aug 27 02:58:21.502772 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 2a6a888c878245cb9e5909e071c9b9c2 Aug 27 02:58:21.502772 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-23859158 Aug 27 02:58:21.502772 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-SecurityGroupsTestJSON-23859158-project Aug 27 02:58:21.502772 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:58:21.502772 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:58:21.502772 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: ef6381ae230a45de8b105374c2d25383 Aug 27 02:58:21.502772 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-SecurityGroupsTestJSON-23859158-project Aug 27 02:58:21.502772 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 02:58:21.502772 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance 543bc953-d047-4594-a5d1-2d3a33fbfa35 could not be found. Aug 27 02:58:21.502772 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '543bc953-d047-4594-a5d1-2d3a33fbfa35'} Aug 27 02:58:21.502772 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:58:21.502772 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:58:21.502772 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:58:21.502772 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:58:21.502772 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:58:21.502772 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:58:21.502772 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:58:21.502772 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:58:21.502772 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:58:21.502772 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:58:21.502772 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 543bc953-d047-4594-a5d1-2d3a33fbfa35 could not be found. Aug 27 02:58:21.502772 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:58:21.502772 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:58:21.502772 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:58:21.502772 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:58:21.502772 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:58:21.502772 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:58:21.502772 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:58:21.502772 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:58:21.502772 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:58:21.502772 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:58:21.502772 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:58:21.502772 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:58:21.502772 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:58:21.502772 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:58:21.502772 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:58:21.502772 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:58:21.502772 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 543bc953-d047-4594-a5d1-2d3a33fbfa35 could not be found. Aug 27 02:58:21.502772 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:58:21.502772 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:58:21.502772 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:58:21.507159 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:58:21.507159 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:58:21.507159 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:58:21.507159 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:58:21.507159 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:58:21.507159 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 543bc953-d047-4594-a5d1-2d3a33fbfa35 could not be found. Aug 27 02:58:21.507159 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:58:21.510986 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a9f482d8-9c05-40de-9007-3d06d4a2bdeb tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Returning 404 to user: Instance 543bc953-d047-4594-a5d1-2d3a33fbfa35 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:58:21.512076 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a9f482d8-9c05-40de-9007-3d06d4a2bdeb tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] 10.222.0.70 "GET /compute/v2.1/servers/543bc953-d047-4594-a5d1-2d3a33fbfa35" status: 404 len: 111 microversion: 2.1 time: 0.082067 Aug 27 02:58:21.513544 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1845/3686] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:58:21 2022] GET /compute/v2.1/servers/543bc953-d047-4594-a5d1-2d3a33fbfa35 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:58:21.528854 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-1e4c89b6-f1a4-4397-bfee-69003d6d5c58 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Calling method '.version_select at 0x7f5ee71c6700>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:21.760628 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-77a0502f-285c-43c7-a47a-db1f0210ff83 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b217f9cbc204919ba77d885315907c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2448b78114c54dd39bc85538fb973dd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:21.774917 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-77a0502f-285c-43c7-a47a-db1f0210ff83 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] 10.222.0.70 "GET /compute/v2.1/servers/edb9e3a3-f71d-4a90-b617-167316a61e44" status: 200 len: 1518 microversion: 2.1 time: 0.322228 Aug 27 02:58:21.784537 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1842/3687] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:58:21 2022] GET /compute/v2.1/servers/edb9e3a3-f71d-4a90-b617-167316a61e44 => generated 1518 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:58:21.790516 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-103102ce-77d7-4586-bc8f-f710d2381523 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:21.791118 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-103102ce-77d7-4586-bc8f-f710d2381523 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] [instance: d6a40f7a-6709-4e75-b3e8-f98abf1b03d8] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:21.797612 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-103102ce-77d7-4586-bc8f-f710d2381523 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:21.797894 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-103102ce-77d7-4586-bc8f-f710d2381523 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:21.798263 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-103102ce-77d7-4586-bc8f-f710d2381523 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:21.798951 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-103102ce-77d7-4586-bc8f-f710d2381523 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:21.799390 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-103102ce-77d7-4586-bc8f-f710d2381523 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:21.799796 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-103102ce-77d7-4586-bc8f-f710d2381523 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:21.931750 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-103102ce-77d7-4586-bc8f-f710d2381523 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcc2feab6eb427cb1c1ac9093670ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4190feabcb36413fb443349aadc93a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:21.944334 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-103102ce-77d7-4586-bc8f-f710d2381523 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcc2feab6eb427cb1c1ac9093670ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4190feabcb36413fb443349aadc93a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:21.946232 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-103102ce-77d7-4586-bc8f-f710d2381523 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcc2feab6eb427cb1c1ac9093670ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4190feabcb36413fb443349aadc93a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:21.947585 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-103102ce-77d7-4586-bc8f-f710d2381523 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] 10.222.0.70 "GET /compute/v2.1/servers/d6a40f7a-6709-4e75-b3e8-f98abf1b03d8" status: 200 len: 1409 microversion: 2.54 time: 0.161703 Aug 27 02:58:21.948142 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1843/3688] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:58:21 2022] GET /compute/v2.1/servers/d6a40f7a-6709-4e75-b3e8-f98abf1b03d8 => generated 1409 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:58:21.993614 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-1e4c89b6-f1a4-4397-bfee-69003d6d5c58 tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/f4af0402-e097-4969-a14c-e6a8677ed4d3" status: 202 len: 0 microversion: 2.1 time: 0.475198 Aug 27 02:58:21.994206 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1846/3689] 10.222.0.70 () {58 vars in 1272 bytes} [Sat Aug 27 02:58:21 2022] DELETE /compute/v2.1/os-security-groups/f4af0402-e097-4969-a14c-e6a8677ed4d3 => generated 0 bytes in 478 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 02:58:22.002434 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d6a769f1-f234-49a0-8071-5e7052ed4e1e tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] Calling method '.version_select at 0x7f5ee26cad30>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:22.324673 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d6a769f1-f234-49a0-8071-5e7052ed4e1e tempest-SecurityGroupsTestJSON-23859158 tempest-SecurityGroupsTestJSON-23859158-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/d1886d11-6bfb-413b-acdc-007193effed7" status: 202 len: 0 microversion: 2.1 time: 0.326003 Aug 27 02:58:22.326195 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1844/3690] 10.222.0.70 () {58 vars in 1272 bytes} [Sat Aug 27 02:58:21 2022] DELETE /compute/v2.1/os-security-groups/d1886d11-6bfb-413b-acdc-007193effed7 => generated 0 bytes in 328 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:58:22.444462 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e59f1505-11e1-45cc-9acb-142bc74bd102 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:22.447855 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-e59f1505-11e1-45cc-9acb-142bc74bd102 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 93c96362-cc02-493d-a96b-ca19cf3a4e47] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:22.467230 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e59f1505-11e1-45cc-9acb-142bc74bd102 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:22.467230 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e59f1505-11e1-45cc-9acb-142bc74bd102 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:22.471730 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e59f1505-11e1-45cc-9acb-142bc74bd102 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:22.473026 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e59f1505-11e1-45cc-9acb-142bc74bd102 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:22.476014 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e59f1505-11e1-45cc-9acb-142bc74bd102 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:22.476650 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e59f1505-11e1-45cc-9acb-142bc74bd102 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:22.802026 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a4d90c88-65c0-460d-816b-31eeb58f6277 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:22.803612 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a4d90c88-65c0-460d-816b-31eeb58f6277 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] [instance: edb9e3a3-f71d-4a90-b617-167316a61e44] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:22.816629 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a4d90c88-65c0-460d-816b-31eeb58f6277 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:22.817755 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a4d90c88-65c0-460d-816b-31eeb58f6277 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:22.818439 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a4d90c88-65c0-460d-816b-31eeb58f6277 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:22.819215 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a4d90c88-65c0-460d-816b-31eeb58f6277 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:22.819836 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a4d90c88-65c0-460d-816b-31eeb58f6277 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:22.820349 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a4d90c88-65c0-460d-816b-31eeb58f6277 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:22.877841 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e59f1505-11e1-45cc-9acb-142bc74bd102 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:22.891711 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e59f1505-11e1-45cc-9acb-142bc74bd102 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/93c96362-cc02-493d-a96b-ca19cf3a4e47" status: 200 len: 1507 microversion: 2.1 time: 0.455388 Aug 27 02:58:22.892433 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1847/3691] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:58:22 2022] GET /compute/v2.1/servers/93c96362-cc02-493d-a96b-ca19cf3a4e47 => generated 1507 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:58:22.971263 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a3109439-411a-4578-9497-56a2a495888f tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:22.972388 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-a3109439-411a-4578-9497-56a2a495888f tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] [instance: d6a40f7a-6709-4e75-b3e8-f98abf1b03d8] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:22.979363 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:58:22.981387 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a3109439-411a-4578-9497-56a2a495888f tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:22.982212 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a3109439-411a-4578-9497-56a2a495888f tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:22.982891 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a3109439-411a-4578-9497-56a2a495888f tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:22.983986 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a3109439-411a-4578-9497-56a2a495888f tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:22.985056 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a3109439-411a-4578-9497-56a2a495888f tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:22.985873 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a3109439-411a-4578-9497-56a2a495888f tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:23.178710 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-a3109439-411a-4578-9497-56a2a495888f tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcc2feab6eb427cb1c1ac9093670ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4190feabcb36413fb443349aadc93a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:23.187854 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-a3109439-411a-4578-9497-56a2a495888f tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcc2feab6eb427cb1c1ac9093670ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4190feabcb36413fb443349aadc93a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:23.202241 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-a3109439-411a-4578-9497-56a2a495888f tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcc2feab6eb427cb1c1ac9093670ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4190feabcb36413fb443349aadc93a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:23.203474 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a3109439-411a-4578-9497-56a2a495888f tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] 10.222.0.70 "GET /compute/v2.1/servers/d6a40f7a-6709-4e75-b3e8-f98abf1b03d8" status: 200 len: 1409 microversion: 2.54 time: 0.236588 Aug 27 02:58:23.204038 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1848/3692] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:58:22 2022] GET /compute/v2.1/servers/d6a40f7a-6709-4e75-b3e8-f98abf1b03d8 => generated 1409 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:58:23.441806 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-a4d90c88-65c0-460d-816b-31eeb58f6277 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b217f9cbc204919ba77d885315907c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2448b78114c54dd39bc85538fb973dd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:23.450420 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a4d90c88-65c0-460d-816b-31eeb58f6277 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] 10.222.0.70 "GET /compute/v2.1/servers/edb9e3a3-f71d-4a90-b617-167316a61e44" status: 200 len: 1518 microversion: 2.1 time: 0.654107 Aug 27 02:58:23.451008 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1845/3693] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:58:22 2022] GET /compute/v2.1/servers/edb9e3a3-f71d-4a90-b617-167316a61e44 => generated 1518 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:58:23.913177 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-59810cef-5cff-4e32-9619-939fdd34de58 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:23.914433 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-59810cef-5cff-4e32-9619-939fdd34de58 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 93c96362-cc02-493d-a96b-ca19cf3a4e47] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:23.921805 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-59810cef-5cff-4e32-9619-939fdd34de58 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:23.922551 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-59810cef-5cff-4e32-9619-939fdd34de58 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:23.923150 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-59810cef-5cff-4e32-9619-939fdd34de58 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:23.924013 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-59810cef-5cff-4e32-9619-939fdd34de58 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:23.924630 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-59810cef-5cff-4e32-9619-939fdd34de58 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:23.925194 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-59810cef-5cff-4e32-9619-939fdd34de58 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:24.233482 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9516a8fb-b1fa-4c6c-8b42-65b583d7237c tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:24.235399 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-9516a8fb-b1fa-4c6c-8b42-65b583d7237c tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] [instance: d6a40f7a-6709-4e75-b3e8-f98abf1b03d8] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:24.253179 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9516a8fb-b1fa-4c6c-8b42-65b583d7237c tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:24.254200 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9516a8fb-b1fa-4c6c-8b42-65b583d7237c tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:24.254863 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9516a8fb-b1fa-4c6c-8b42-65b583d7237c tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:24.256402 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9516a8fb-b1fa-4c6c-8b42-65b583d7237c tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:24.257216 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9516a8fb-b1fa-4c6c-8b42-65b583d7237c tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:24.257655 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9516a8fb-b1fa-4c6c-8b42-65b583d7237c tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:24.864596 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-59810cef-5cff-4e32-9619-939fdd34de58 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:24.873954 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-9516a8fb-b1fa-4c6c-8b42-65b583d7237c tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcc2feab6eb427cb1c1ac9093670ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4190feabcb36413fb443349aadc93a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:24.882191 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-59810cef-5cff-4e32-9619-939fdd34de58 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/93c96362-cc02-493d-a96b-ca19cf3a4e47" status: 200 len: 1507 microversion: 2.1 time: 0.972933 Aug 27 02:58:24.883172 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1849/3694] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:58:23 2022] GET /compute/v2.1/servers/93c96362-cc02-493d-a96b-ca19cf3a4e47 => generated 1507 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:58:24.884565 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-9516a8fb-b1fa-4c6c-8b42-65b583d7237c tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcc2feab6eb427cb1c1ac9093670ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4190feabcb36413fb443349aadc93a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:24.886178 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-9516a8fb-b1fa-4c6c-8b42-65b583d7237c tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcc2feab6eb427cb1c1ac9093670ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4190feabcb36413fb443349aadc93a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:24.888040 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a535c677-158e-4372-b4c6-f7459193add1 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:24.889525 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9516a8fb-b1fa-4c6c-8b42-65b583d7237c tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] 10.222.0.70 "GET /compute/v2.1/servers/d6a40f7a-6709-4e75-b3e8-f98abf1b03d8" status: 200 len: 1409 microversion: 2.54 time: 0.663434 Aug 27 02:58:24.892786 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-a535c677-158e-4372-b4c6-f7459193add1 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] [instance: edb9e3a3-f71d-4a90-b617-167316a61e44] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:24.892994 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1846/3695] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:58:24 2022] GET /compute/v2.1/servers/d6a40f7a-6709-4e75-b3e8-f98abf1b03d8 => generated 1409 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:58:24.919468 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a535c677-158e-4372-b4c6-f7459193add1 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:24.919968 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a535c677-158e-4372-b4c6-f7459193add1 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:24.920624 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a535c677-158e-4372-b4c6-f7459193add1 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:24.921574 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a535c677-158e-4372-b4c6-f7459193add1 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:24.922087 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a535c677-158e-4372-b4c6-f7459193add1 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:24.922577 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a535c677-158e-4372-b4c6-f7459193add1 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:25.178248 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-8f7bb69c-8e7c-47b9-a4a3-e84e970f11e9 req-0b3fe7db-1345-46c3-b2a4-be588b79f3f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edb9e3a3-f71d-4a90-b617-167316a61e44", "name": "network-vif-deleted", "tag": "ea2d074a-0c88-4878-943e-a739cc0ecf65"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:58:25.194326 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-8f7bb69c-8e7c-47b9-a4a3-e84e970f11e9 req-0b3fe7db-1345-46c3-b2a4-be588b79f3f5 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:25.194883 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-8f7bb69c-8e7c-47b9-a4a3-e84e970f11e9 req-0b3fe7db-1345-46c3-b2a4-be588b79f3f5 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:25.195323 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-8f7bb69c-8e7c-47b9-a4a3-e84e970f11e9 req-0b3fe7db-1345-46c3-b2a4-be588b79f3f5 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:25.233937 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-8f7bb69c-8e7c-47b9-a4a3-e84e970f11e9 req-0b3fe7db-1345-46c3-b2a4-be588b79f3f5 service nova] Creating event network-vif-deleted:ea2d074a-0c88-4878-943e-a739cc0ecf65 for instance edb9e3a3-f71d-4a90-b617-167316a61e44 on n-h2-852278-4 Aug 27 02:58:25.248795 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-8f7bb69c-8e7c-47b9-a4a3-e84e970f11e9 req-0b3fe7db-1345-46c3-b2a4-be588b79f3f5 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079084 Aug 27 02:58:25.251371 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1847/3696] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:58:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:58:25.263617 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-a535c677-158e-4372-b4c6-f7459193add1 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b217f9cbc204919ba77d885315907c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2448b78114c54dd39bc85538fb973dd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:25.287072 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a535c677-158e-4372-b4c6-f7459193add1 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] 10.222.0.70 "GET /compute/v2.1/servers/edb9e3a3-f71d-4a90-b617-167316a61e44" status: 200 len: 1476 microversion: 2.1 time: 0.402478 Aug 27 02:58:25.296946 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1850/3697] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:58:24 2022] GET /compute/v2.1/servers/edb9e3a3-f71d-4a90-b617-167316a61e44 => generated 1476 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:58:25.908344 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-572436fa-270e-400a-a30a-88b93890d6b9 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:25.909055 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-572436fa-270e-400a-a30a-88b93890d6b9 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 93c96362-cc02-493d-a96b-ca19cf3a4e47] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:25.928580 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-572436fa-270e-400a-a30a-88b93890d6b9 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:25.929138 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-572436fa-270e-400a-a30a-88b93890d6b9 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:25.929580 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-572436fa-270e-400a-a30a-88b93890d6b9 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:25.930290 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-572436fa-270e-400a-a30a-88b93890d6b9 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:25.930446 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0bdfd931-2522-4500-98d9-f94b8c45b2d3 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:25.930938 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-572436fa-270e-400a-a30a-88b93890d6b9 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:25.931134 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-572436fa-270e-400a-a30a-88b93890d6b9 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:25.934885 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-0bdfd931-2522-4500-98d9-f94b8c45b2d3 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] [instance: d6a40f7a-6709-4e75-b3e8-f98abf1b03d8] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:25.974344 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0bdfd931-2522-4500-98d9-f94b8c45b2d3 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:25.974947 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0bdfd931-2522-4500-98d9-f94b8c45b2d3 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:25.975402 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0bdfd931-2522-4500-98d9-f94b8c45b2d3 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:25.980839 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0bdfd931-2522-4500-98d9-f94b8c45b2d3 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:25.981476 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0bdfd931-2522-4500-98d9-f94b8c45b2d3 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:25.981989 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0bdfd931-2522-4500-98d9-f94b8c45b2d3 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:26.220027 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-0bdfd931-2522-4500-98d9-f94b8c45b2d3 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcc2feab6eb427cb1c1ac9093670ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4190feabcb36413fb443349aadc93a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:26.232554 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-0bdfd931-2522-4500-98d9-f94b8c45b2d3 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcc2feab6eb427cb1c1ac9093670ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4190feabcb36413fb443349aadc93a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:26.237112 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-0bdfd931-2522-4500-98d9-f94b8c45b2d3 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcc2feab6eb427cb1c1ac9093670ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4190feabcb36413fb443349aadc93a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:26.239652 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-0bdfd931-2522-4500-98d9-f94b8c45b2d3 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] 10.222.0.70 "GET /compute/v2.1/servers/d6a40f7a-6709-4e75-b3e8-f98abf1b03d8" status: 200 len: 1409 microversion: 2.54 time: 0.322037 Aug 27 02:58:26.244442 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1851/3698] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:58:25 2022] GET /compute/v2.1/servers/d6a40f7a-6709-4e75-b3e8-f98abf1b03d8 => generated 1409 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:58:26.322778 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-137256d1-f55a-4d3e-ab6c-2941817d289c tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:26.323645 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-137256d1-f55a-4d3e-ab6c-2941817d289c tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] [instance: edb9e3a3-f71d-4a90-b617-167316a61e44] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:26.337322 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-137256d1-f55a-4d3e-ab6c-2941817d289c tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:26.337862 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-137256d1-f55a-4d3e-ab6c-2941817d289c tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:26.339453 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-137256d1-f55a-4d3e-ab6c-2941817d289c tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:26.340249 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-137256d1-f55a-4d3e-ab6c-2941817d289c tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:26.340729 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-137256d1-f55a-4d3e-ab6c-2941817d289c tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:26.341162 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-137256d1-f55a-4d3e-ab6c-2941817d289c tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:26.387474 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=100 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:58:26.388936 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-137256d1-f55a-4d3e-ab6c-2941817d289c tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] HTTP exception thrown: Instance edb9e3a3-f71d-4a90-b617-167316a61e44 could not be found. Aug 27 02:58:26.391512 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-137256d1-f55a-4d3e-ab6c-2941817d289c tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Request method failure captured: Aug 27 02:58:26.391512 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/edb9e3a3-f71d-4a90-b617-167316a61e44 HTTP/1.1 Aug 27 02:58:26.391512 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:58:26.391512 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:58:26.391512 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:58:26.391512 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:58:26.391512 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:58:26.391512 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:58:26.391512 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:58:26.391512 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:58:26.391512 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYgHy20F8mEqewPPyVAr-i6FK-yM2bCD6VMUU6bWr42YNPGmqraxtXuFmNh0mCGA12K-H0KGbijJcDiFoF1IWn3gbEqdQMrNRRVtK68P0L7SObaS8M-aBKk6LcOnctIqmpeDYUb2yMcqLOHa3drT115scNX6yYkvD3zz-j1vY-58dKU Aug 27 02:58:26.391512 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:58:26.391512 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:58:26.391512 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:58:26.391512 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:58:26.391512 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:58:26.391512 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:58:26.391512 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 2448b78114c54dd39bc85538fb973dd2 Aug 27 02:58:26.391512 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ListServerFiltersTestJSON-1841247183 Aug 27 02:58:26.391512 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:58:26.391512 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:58:26.391512 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2448b78114c54dd39bc85538fb973dd2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_2448b78114c54dd39bc85538fb973dd2", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2448b78114c54dd39bc85538fb973dd2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/2448b78114c54dd39bc85538fb973dd2"}]}] Aug 27 02:58:26.391512 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ListServerFiltersTestJSON-1841247183 Aug 27 02:58:26.391512 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 2448b78114c54dd39bc85538fb973dd2 Aug 27 02:58:26.391512 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1841247183 Aug 27 02:58:26.391512 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ListServerFiltersTestJSON-1841247183-project Aug 27 02:58:26.391512 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:58:26.391512 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:58:26.391512 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 2b217f9cbc204919ba77d885315907c2 Aug 27 02:58:26.391512 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ListServerFiltersTestJSON-1841247183-project Aug 27 02:58:26.391512 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 02:58:26.391512 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance edb9e3a3-f71d-4a90-b617-167316a61e44 could not be found. Aug 27 02:58:26.391512 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': 'edb9e3a3-f71d-4a90-b617-167316a61e44'} Aug 27 02:58:26.391512 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:58:26.391512 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:58:26.391512 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:58:26.391512 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:58:26.391512 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:58:26.391512 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:58:26.391512 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:58:26.391512 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:58:26.391512 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:58:26.391512 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:58:26.391512 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edb9e3a3-f71d-4a90-b617-167316a61e44 could not be found. Aug 27 02:58:26.391512 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:58:26.391512 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:58:26.391512 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:58:26.391512 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:58:26.391512 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:58:26.391512 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:58:26.391512 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:58:26.391512 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:58:26.391512 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:58:26.391512 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:58:26.391512 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:58:26.391512 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:58:26.391512 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:58:26.391512 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:58:26.391512 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:58:26.391512 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:58:26.391512 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edb9e3a3-f71d-4a90-b617-167316a61e44 could not be found. Aug 27 02:58:26.391512 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:58:26.391512 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:58:26.391512 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:58:26.399029 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:58:26.399029 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:58:26.399029 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:58:26.399029 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:58:26.399029 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:58:26.399029 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edb9e3a3-f71d-4a90-b617-167316a61e44 could not be found. Aug 27 02:58:26.399029 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:58:26.399029 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-137256d1-f55a-4d3e-ab6c-2941817d289c tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Returning 404 to user: Instance edb9e3a3-f71d-4a90-b617-167316a61e44 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:58:26.399029 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-137256d1-f55a-4d3e-ab6c-2941817d289c tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] 10.222.0.70 "GET /compute/v2.1/servers/edb9e3a3-f71d-4a90-b617-167316a61e44" status: 404 len: 111 microversion: 2.1 time: 0.075309 Aug 27 02:58:26.399029 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1852/3699] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:58:26 2022] GET /compute/v2.1/servers/edb9e3a3-f71d-4a90-b617-167316a61e44 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 02:58:26.407568 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-926fe1e7-621f-4b6b-968a-40d36ff15756 req-66274b9d-c9fe-493a-b2d5-c4275620fd65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93c96362-cc02-493d-a96b-ca19cf3a4e47", "name": "network-vif-unplugged", "status": "completed", "tag": "89392832-a58f-4596-ba39-a4d42c287569"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:58:26.437874 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-926fe1e7-621f-4b6b-968a-40d36ff15756 req-66274b9d-c9fe-493a-b2d5-c4275620fd65 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:26.438383 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-926fe1e7-621f-4b6b-968a-40d36ff15756 req-66274b9d-c9fe-493a-b2d5-c4275620fd65 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:26.438814 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-926fe1e7-621f-4b6b-968a-40d36ff15756 req-66274b9d-c9fe-493a-b2d5-c4275620fd65 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:26.479675 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-926fe1e7-621f-4b6b-968a-40d36ff15756 req-66274b9d-c9fe-493a-b2d5-c4275620fd65 service nova] Creating event network-vif-unplugged:89392832-a58f-4596-ba39-a4d42c287569 for instance 93c96362-cc02-493d-a96b-ca19cf3a4e47 on n-h1-852278-4 Aug 27 02:58:26.492602 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-926fe1e7-621f-4b6b-968a-40d36ff15756 req-66274b9d-c9fe-493a-b2d5-c4275620fd65 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.092390 Aug 27 02:58:26.493546 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1853/3700] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:58:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:58:26.502630 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b1149cbe-269b-48a6-a0b4-72961fb8c8dd tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:26.508504 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b1149cbe-269b-48a6-a0b4-72961fb8c8dd tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] [instance: fce0841b-76a8-496d-8fc0-69ad3fa9f7a6] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:26.521371 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b1149cbe-269b-48a6-a0b4-72961fb8c8dd tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:26.521821 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b1149cbe-269b-48a6-a0b4-72961fb8c8dd tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:26.529067 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b1149cbe-269b-48a6-a0b4-72961fb8c8dd tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:26.530705 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b1149cbe-269b-48a6-a0b4-72961fb8c8dd tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:26.531426 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b1149cbe-269b-48a6-a0b4-72961fb8c8dd tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:26.537035 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b1149cbe-269b-48a6-a0b4-72961fb8c8dd tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:26.590783 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b1149cbe-269b-48a6-a0b4-72961fb8c8dd tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] [instance: fce0841b-76a8-496d-8fc0-69ad3fa9f7a6] Going to try to terminate instance {{(pid=134051) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:58:26.720437 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b1149cbe-269b-48a6-a0b4-72961fb8c8dd tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] 10.222.0.70 "DELETE /compute/v2.1/servers/fce0841b-76a8-496d-8fc0-69ad3fa9f7a6" status: 204 len: 0 microversion: 2.1 time: 0.222894 Aug 27 02:58:26.721925 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1854/3701] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:58:26 2022] DELETE /compute/v2.1/servers/fce0841b-76a8-496d-8fc0-69ad3fa9f7a6 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:58:26.756055 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-957e9773-711c-484e-a32d-c13bd062c10c tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:26.758894 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-957e9773-711c-484e-a32d-c13bd062c10c tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] [instance: fce0841b-76a8-496d-8fc0-69ad3fa9f7a6] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:26.772995 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-957e9773-711c-484e-a32d-c13bd062c10c tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:26.773502 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-957e9773-711c-484e-a32d-c13bd062c10c tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:26.775985 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-572436fa-270e-400a-a30a-88b93890d6b9 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:26.779320 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-957e9773-711c-484e-a32d-c13bd062c10c tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:26.780556 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-957e9773-711c-484e-a32d-c13bd062c10c tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:26.781377 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-957e9773-711c-484e-a32d-c13bd062c10c tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:26.783184 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-957e9773-711c-484e-a32d-c13bd062c10c tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:26.788961 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-572436fa-270e-400a-a30a-88b93890d6b9 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/93c96362-cc02-493d-a96b-ca19cf3a4e47" status: 200 len: 1507 microversion: 2.1 time: 0.885287 Aug 27 02:58:26.803791 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1848/3702] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:58:25 2022] GET /compute/v2.1/servers/93c96362-cc02-493d-a96b-ca19cf3a4e47 => generated 1507 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:58:27.251254 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-957e9773-711c-484e-a32d-c13bd062c10c tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b217f9cbc204919ba77d885315907c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2448b78114c54dd39bc85538fb973dd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:27.267266 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-957e9773-711c-484e-a32d-c13bd062c10c tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] 10.222.0.70 "GET /compute/v2.1/servers/fce0841b-76a8-496d-8fc0-69ad3fa9f7a6" status: 200 len: 1517 microversion: 2.1 time: 0.535286 Aug 27 02:58:27.268652 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1855/3703] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:58:26 2022] GET /compute/v2.1/servers/fce0841b-76a8-496d-8fc0-69ad3fa9f7a6 => generated 1517 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:58:27.269435 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6c6dcc8f-13ca-44ef-b752-eb1ef06edfa4 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:27.270166 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-6c6dcc8f-13ca-44ef-b752-eb1ef06edfa4 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] [instance: d6a40f7a-6709-4e75-b3e8-f98abf1b03d8] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:27.281895 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6c6dcc8f-13ca-44ef-b752-eb1ef06edfa4 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:27.282695 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6c6dcc8f-13ca-44ef-b752-eb1ef06edfa4 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:27.283031 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6c6dcc8f-13ca-44ef-b752-eb1ef06edfa4 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:27.283817 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6c6dcc8f-13ca-44ef-b752-eb1ef06edfa4 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:27.284493 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6c6dcc8f-13ca-44ef-b752-eb1ef06edfa4 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:27.285237 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6c6dcc8f-13ca-44ef-b752-eb1ef06edfa4 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:27.512876 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-6c6dcc8f-13ca-44ef-b752-eb1ef06edfa4 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcc2feab6eb427cb1c1ac9093670ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4190feabcb36413fb443349aadc93a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:27.532603 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-6c6dcc8f-13ca-44ef-b752-eb1ef06edfa4 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcc2feab6eb427cb1c1ac9093670ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4190feabcb36413fb443349aadc93a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:27.534638 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-6c6dcc8f-13ca-44ef-b752-eb1ef06edfa4 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcc2feab6eb427cb1c1ac9093670ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4190feabcb36413fb443349aadc93a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:27.537815 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-6c6dcc8f-13ca-44ef-b752-eb1ef06edfa4 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] 10.222.0.70 "GET /compute/v2.1/servers/d6a40f7a-6709-4e75-b3e8-f98abf1b03d8" status: 200 len: 1409 microversion: 2.54 time: 0.272063 Aug 27 02:58:27.540759 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1849/3704] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:58:27 2022] GET /compute/v2.1/servers/d6a40f7a-6709-4e75-b3e8-f98abf1b03d8 => generated 1409 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:58:27.811106 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-31b8b425-8f76-401d-88da-cf7a787d283f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:27.811759 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-31b8b425-8f76-401d-88da-cf7a787d283f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 93c96362-cc02-493d-a96b-ca19cf3a4e47] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:27.813972 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:58:27.825560 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-31b8b425-8f76-401d-88da-cf7a787d283f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:27.826400 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-31b8b425-8f76-401d-88da-cf7a787d283f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:27.828237 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-31b8b425-8f76-401d-88da-cf7a787d283f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:27.829320 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-31b8b425-8f76-401d-88da-cf7a787d283f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:27.830005 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-31b8b425-8f76-401d-88da-cf7a787d283f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:27.833077 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-31b8b425-8f76-401d-88da-cf7a787d283f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:28.289888 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b4fe6dd7-fe50-4716-a99a-86767d54a3bd tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:28.291610 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b4fe6dd7-fe50-4716-a99a-86767d54a3bd tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] [instance: fce0841b-76a8-496d-8fc0-69ad3fa9f7a6] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:28.326944 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b4fe6dd7-fe50-4716-a99a-86767d54a3bd tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:28.327434 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b4fe6dd7-fe50-4716-a99a-86767d54a3bd tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:28.330879 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b4fe6dd7-fe50-4716-a99a-86767d54a3bd tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:28.332676 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b4fe6dd7-fe50-4716-a99a-86767d54a3bd tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:28.333000 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b4fe6dd7-fe50-4716-a99a-86767d54a3bd tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:28.339392 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b4fe6dd7-fe50-4716-a99a-86767d54a3bd tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:28.587955 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-31b8b425-8f76-401d-88da-cf7a787d283f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:28.605463 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-31b8b425-8f76-401d-88da-cf7a787d283f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/93c96362-cc02-493d-a96b-ca19cf3a4e47" status: 200 len: 1450 microversion: 2.1 time: 0.797581 Aug 27 02:58:28.606723 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1856/3705] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:58:27 2022] GET /compute/v2.1/servers/93c96362-cc02-493d-a96b-ca19cf3a4e47 => generated 1450 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:58:28.612351 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-832fba8e-6d3f-4c80-9ef8-2e25002c7a93 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:28.613229 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-832fba8e-6d3f-4c80-9ef8-2e25002c7a93 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] [instance: d6a40f7a-6709-4e75-b3e8-f98abf1b03d8] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:28.622411 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-832fba8e-6d3f-4c80-9ef8-2e25002c7a93 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:28.629525 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-832fba8e-6d3f-4c80-9ef8-2e25002c7a93 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:28.630177 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-832fba8e-6d3f-4c80-9ef8-2e25002c7a93 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:28.631344 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-832fba8e-6d3f-4c80-9ef8-2e25002c7a93 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:28.632145 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-832fba8e-6d3f-4c80-9ef8-2e25002c7a93 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:28.632981 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-832fba8e-6d3f-4c80-9ef8-2e25002c7a93 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:28.898203 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-832fba8e-6d3f-4c80-9ef8-2e25002c7a93 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcc2feab6eb427cb1c1ac9093670ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4190feabcb36413fb443349aadc93a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:28.910373 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-832fba8e-6d3f-4c80-9ef8-2e25002c7a93 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcc2feab6eb427cb1c1ac9093670ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4190feabcb36413fb443349aadc93a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:28.923049 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-832fba8e-6d3f-4c80-9ef8-2e25002c7a93 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcc2feab6eb427cb1c1ac9093670ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4190feabcb36413fb443349aadc93a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:28.924293 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-832fba8e-6d3f-4c80-9ef8-2e25002c7a93 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] 10.222.0.70 "GET /compute/v2.1/servers/d6a40f7a-6709-4e75-b3e8-f98abf1b03d8" status: 200 len: 1415 microversion: 2.54 time: 0.316252 Aug 27 02:58:28.924889 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1857/3706] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:58:28 2022] GET /compute/v2.1/servers/d6a40f7a-6709-4e75-b3e8-f98abf1b03d8 => generated 1415 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:58:28.929800 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b2d88386-7c71-4bd4-a167-f1d4a2dfbc20 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:28.930406 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b2d88386-7c71-4bd4-a167-f1d4a2dfbc20 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:28.947991 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b2d88386-7c71-4bd4-a167-f1d4a2dfbc20 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:28.948461 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b2d88386-7c71-4bd4-a167-f1d4a2dfbc20 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:28.948896 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b2d88386-7c71-4bd4-a167-f1d4a2dfbc20 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:28.949786 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b2d88386-7c71-4bd4-a167-f1d4a2dfbc20 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:28.950388 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b2d88386-7c71-4bd4-a167-f1d4a2dfbc20 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:28.950964 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b2d88386-7c71-4bd4-a167-f1d4a2dfbc20 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:29.073588 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b4fe6dd7-fe50-4716-a99a-86767d54a3bd tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b217f9cbc204919ba77d885315907c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2448b78114c54dd39bc85538fb973dd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:29.083020 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b4fe6dd7-fe50-4716-a99a-86767d54a3bd tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] 10.222.0.70 "GET /compute/v2.1/servers/fce0841b-76a8-496d-8fc0-69ad3fa9f7a6" status: 200 len: 1517 microversion: 2.1 time: 0.796860 Aug 27 02:58:29.098458 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1850/3707] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:58:28 2022] GET /compute/v2.1/servers/fce0841b-76a8-496d-8fc0-69ad3fa9f7a6 => generated 1517 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:58:29.637451 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-b2d88386-7c71-4bd4-a167-f1d4a2dfbc20 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:29.646441 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b2d88386-7c71-4bd4-a167-f1d4a2dfbc20 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1668 microversion: 2.1 time: 0.720515 Aug 27 02:58:29.647032 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1858/3708] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:58:28 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1668 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:58:29.680966 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a87c76ac-9143-4236-b0df-d3b582b8cca2 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:29.681563 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a87c76ac-9143-4236-b0df-d3b582b8cca2 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:29.692242 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a87c76ac-9143-4236-b0df-d3b582b8cca2 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:29.692951 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a87c76ac-9143-4236-b0df-d3b582b8cca2 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:29.693571 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a87c76ac-9143-4236-b0df-d3b582b8cca2 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:29.694477 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a87c76ac-9143-4236-b0df-d3b582b8cca2 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:29.695106 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a87c76ac-9143-4236-b0df-d3b582b8cca2 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:29.695946 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a87c76ac-9143-4236-b0df-d3b582b8cca2 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:29.953073 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ab090586-4986-4779-8087-d441dc51c1f4 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:29.962030 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-ab090586-4986-4779-8087-d441dc51c1f4 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] [instance: d6a40f7a-6709-4e75-b3e8-f98abf1b03d8] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:29.970324 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ab090586-4986-4779-8087-d441dc51c1f4 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:29.971071 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ab090586-4986-4779-8087-d441dc51c1f4 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:29.972736 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ab090586-4986-4779-8087-d441dc51c1f4 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:29.978970 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ab090586-4986-4779-8087-d441dc51c1f4 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:29.980484 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ab090586-4986-4779-8087-d441dc51c1f4 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:29.983065 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ab090586-4986-4779-8087-d441dc51c1f4 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:30.012944 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-a87c76ac-9143-4236-b0df-d3b582b8cca2 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:30.016223 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:58:30.044027 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a87c76ac-9143-4236-b0df-d3b582b8cca2 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1668 microversion: 2.1 time: 0.367670 Aug 27 02:58:30.045550 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1851/3709] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:58:29 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1668 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:58:30.067935 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-65cb5fee-d243-4862-9e39-1ac982a05aaa tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:30.068569 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-65cb5fee-d243-4862-9e39-1ac982a05aaa tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:30.077186 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-65cb5fee-d243-4862-9e39-1ac982a05aaa tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:30.078308 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-65cb5fee-d243-4862-9e39-1ac982a05aaa tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:30.078747 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-65cb5fee-d243-4862-9e39-1ac982a05aaa tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:30.079443 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-65cb5fee-d243-4862-9e39-1ac982a05aaa tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:30.079916 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-65cb5fee-d243-4862-9e39-1ac982a05aaa tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:30.080402 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-65cb5fee-d243-4862-9e39-1ac982a05aaa tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:30.114946 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-ab090586-4986-4779-8087-d441dc51c1f4 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcc2feab6eb427cb1c1ac9093670ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4190feabcb36413fb443349aadc93a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:30.125060 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-ab090586-4986-4779-8087-d441dc51c1f4 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcc2feab6eb427cb1c1ac9093670ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4190feabcb36413fb443349aadc93a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:30.126945 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-ab090586-4986-4779-8087-d441dc51c1f4 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcc2feab6eb427cb1c1ac9093670ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4190feabcb36413fb443349aadc93a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:30.131056 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ab090586-4986-4779-8087-d441dc51c1f4 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] 10.222.0.70 "GET /compute/v2.1/servers/d6a40f7a-6709-4e75-b3e8-f98abf1b03d8" status: 200 len: 1415 microversion: 2.54 time: 0.181646 Aug 27 02:58:30.132401 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1859/3710] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:58:29 2022] GET /compute/v2.1/servers/d6a40f7a-6709-4e75-b3e8-f98abf1b03d8 => generated 1415 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:58:30.137692 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-960ce408-0908-4fb4-a44f-399ffe6c795d tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:30.138446 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-960ce408-0908-4fb4-a44f-399ffe6c795d tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] [instance: fce0841b-76a8-496d-8fc0-69ad3fa9f7a6] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:30.159541 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-960ce408-0908-4fb4-a44f-399ffe6c795d tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:30.160445 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-960ce408-0908-4fb4-a44f-399ffe6c795d tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:30.164814 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-960ce408-0908-4fb4-a44f-399ffe6c795d tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:30.167052 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-960ce408-0908-4fb4-a44f-399ffe6c795d tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:30.167556 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-960ce408-0908-4fb4-a44f-399ffe6c795d tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:30.168050 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-960ce408-0908-4fb4-a44f-399ffe6c795d tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:30.293615 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-960ce408-0908-4fb4-a44f-399ffe6c795d tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b217f9cbc204919ba77d885315907c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2448b78114c54dd39bc85538fb973dd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:30.298171 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-65cb5fee-d243-4862-9e39-1ac982a05aaa tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:30.307782 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-960ce408-0908-4fb4-a44f-399ffe6c795d tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] 10.222.0.70 "GET /compute/v2.1/servers/fce0841b-76a8-496d-8fc0-69ad3fa9f7a6" status: 200 len: 1306 microversion: 2.1 time: 0.173773 Aug 27 02:58:30.308757 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-65cb5fee-d243-4862-9e39-1ac982a05aaa tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1668 microversion: 2.1 time: 0.244911 Aug 27 02:58:30.314316 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1852/3711] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:58:30 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1668 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:58:30.314753 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1860/3712] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:58:30 2022] GET /compute/v2.1/servers/fce0841b-76a8-496d-8fc0-69ad3fa9f7a6 => generated 1306 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:58:30.330592 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-9c74e903-61b3-4ba1-b7dc-fd16094b2248 req-0ac80098-bc1d-4b45-9909-49328cb767ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fce0841b-76a8-496d-8fc0-69ad3fa9f7a6", "name": "network-vif-deleted", "tag": "d0f2db9d-c256-452d-8d30-d74c91aaec32"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:58:30.343550 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-1259e746-f616-469d-8dcb-b2c25b372611 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:30.344386 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-1259e746-f616-469d-8dcb-b2c25b372611 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:30.358524 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1259e746-f616-469d-8dcb-b2c25b372611 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:30.359027 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1259e746-f616-469d-8dcb-b2c25b372611 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:30.361087 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1259e746-f616-469d-8dcb-b2c25b372611 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:30.361829 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1259e746-f616-469d-8dcb-b2c25b372611 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:30.362288 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1259e746-f616-469d-8dcb-b2c25b372611 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:30.362714 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1259e746-f616-469d-8dcb-b2c25b372611 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:30.365893 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-9c74e903-61b3-4ba1-b7dc-fd16094b2248 req-0ac80098-bc1d-4b45-9909-49328cb767ff service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:30.370178 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-9c74e903-61b3-4ba1-b7dc-fd16094b2248 req-0ac80098-bc1d-4b45-9909-49328cb767ff service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:30.371416 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-9c74e903-61b3-4ba1-b7dc-fd16094b2248 req-0ac80098-bc1d-4b45-9909-49328cb767ff service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:30.417426 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-9c74e903-61b3-4ba1-b7dc-fd16094b2248 req-0ac80098-bc1d-4b45-9909-49328cb767ff service nova] Creating event network-vif-deleted:d0f2db9d-c256-452d-8d30-d74c91aaec32 for instance fce0841b-76a8-496d-8fc0-69ad3fa9f7a6 on n-h1-852278-4 Aug 27 02:58:30.448305 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-9c74e903-61b3-4ba1-b7dc-fd16094b2248 req-0ac80098-bc1d-4b45-9909-49328cb767ff service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130411 Aug 27 02:58:30.451836 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1853/3713] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:58:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:58:30.607419 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-1259e746-f616-469d-8dcb-b2c25b372611 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:30.617190 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-1259e746-f616-469d-8dcb-b2c25b372611 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1668 microversion: 2.1 time: 0.287824 Aug 27 02:58:30.624672 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1861/3714] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:58:30 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1668 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:58:30.641619 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a5fc6241-4537-496a-ac02-e671578e14d8 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:58:30.644054 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=6 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:58:30.650977 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a5fc6241-4537-496a-ac02-e671578e14d8 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:30.651463 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a5fc6241-4537-496a-ac02-e671578e14d8 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:30.651892 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a5fc6241-4537-496a-ac02-e671578e14d8 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:30.675398 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a5fc6241-4537-496a-ac02-e671578e14d8 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Going to try to stop instance {{(pid=134052) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 27 02:58:30.727062 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a5fc6241-4537-496a-ac02-e671578e14d8 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "POST /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd/action" status: 202 len: 0 microversion: 2.1 time: 0.092698 Aug 27 02:58:30.728082 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1854/3715] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 02:58:30 2022] POST /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:58:30.737522 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d9688db4-d56a-42ff-86dd-a7439a84943f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:30.738329 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d9688db4-d56a-42ff-86dd-a7439a84943f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:30.751569 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=12 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:58:30.753395 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d9688db4-d56a-42ff-86dd-a7439a84943f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:30.754073 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d9688db4-d56a-42ff-86dd-a7439a84943f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:30.754620 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d9688db4-d56a-42ff-86dd-a7439a84943f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:30.755583 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d9688db4-d56a-42ff-86dd-a7439a84943f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:30.756163 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d9688db4-d56a-42ff-86dd-a7439a84943f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:30.756705 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d9688db4-d56a-42ff-86dd-a7439a84943f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:30.904838 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d9688db4-d56a-42ff-86dd-a7439a84943f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:30.912696 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d9688db4-d56a-42ff-86dd-a7439a84943f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1678 microversion: 2.1 time: 0.179898 Aug 27 02:58:30.913335 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1862/3716] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:58:30 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1678 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:58:31.154997 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-22c15f99-90c9-4e90-8f12-526c81158117 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:31.155717 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-22c15f99-90c9-4e90-8f12-526c81158117 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] [instance: d6a40f7a-6709-4e75-b3e8-f98abf1b03d8] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:31.162540 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-22c15f99-90c9-4e90-8f12-526c81158117 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:31.163031 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-22c15f99-90c9-4e90-8f12-526c81158117 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:31.163488 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-22c15f99-90c9-4e90-8f12-526c81158117 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:31.164650 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-22c15f99-90c9-4e90-8f12-526c81158117 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:31.165144 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-22c15f99-90c9-4e90-8f12-526c81158117 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:31.165601 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-22c15f99-90c9-4e90-8f12-526c81158117 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:31.235730 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-22c15f99-90c9-4e90-8f12-526c81158117 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcc2feab6eb427cb1c1ac9093670ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4190feabcb36413fb443349aadc93a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:31.244524 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-22c15f99-90c9-4e90-8f12-526c81158117 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcc2feab6eb427cb1c1ac9093670ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4190feabcb36413fb443349aadc93a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:31.245981 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-22c15f99-90c9-4e90-8f12-526c81158117 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcc2feab6eb427cb1c1ac9093670ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4190feabcb36413fb443349aadc93a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:31.247196 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-22c15f99-90c9-4e90-8f12-526c81158117 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] 10.222.0.70 "GET /compute/v2.1/servers/d6a40f7a-6709-4e75-b3e8-f98abf1b03d8" status: 200 len: 1400 microversion: 2.54 time: 0.096702 Aug 27 02:58:31.256582 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1855/3717] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:58:31 2022] GET /compute/v2.1/servers/d6a40f7a-6709-4e75-b3e8-f98abf1b03d8 => generated 1400 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:58:31.270101 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-573b45cf-3b62-4188-9801-41d4eced01cd tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Calling method '.version_select at 0x7f5ede8d91f0>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:31.295654 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-573b45cf-3b62-4188-9801-41d4eced01cd tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1050784670" status: 204 len: 0 microversion: 2.54 time: 0.029462 Aug 27 02:58:31.296384 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1863/3718] 10.222.0.70 () {60 vars in 1319 bytes} [Sat Aug 27 02:58:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1050784670 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 02:58:31.310516 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5b23bb9b-1195-42ff-9f04-d7b8b94d10d6 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:31.311015 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-5b23bb9b-1195-42ff-9f04-d7b8b94d10d6 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] [instance: d6a40f7a-6709-4e75-b3e8-f98abf1b03d8] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:31.314097 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:58:31.318527 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5b23bb9b-1195-42ff-9f04-d7b8b94d10d6 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:31.319089 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5b23bb9b-1195-42ff-9f04-d7b8b94d10d6 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:31.319554 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5b23bb9b-1195-42ff-9f04-d7b8b94d10d6 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:31.320355 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5b23bb9b-1195-42ff-9f04-d7b8b94d10d6 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:31.320733 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5b23bb9b-1195-42ff-9f04-d7b8b94d10d6 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:31.321153 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5b23bb9b-1195-42ff-9f04-d7b8b94d10d6 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:31.336012 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-60c3a38a-a499-412d-afbe-c77d0035994a tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:31.336943 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-60c3a38a-a499-412d-afbe-c77d0035994a tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] [instance: fce0841b-76a8-496d-8fc0-69ad3fa9f7a6] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:31.344386 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-60c3a38a-a499-412d-afbe-c77d0035994a tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:31.345053 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-60c3a38a-a499-412d-afbe-c77d0035994a tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:31.345672 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-60c3a38a-a499-412d-afbe-c77d0035994a tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:31.346495 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-60c3a38a-a499-412d-afbe-c77d0035994a tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:31.347059 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-60c3a38a-a499-412d-afbe-c77d0035994a tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:31.347668 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-60c3a38a-a499-412d-afbe-c77d0035994a tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:31.356213 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-5b23bb9b-1195-42ff-9f04-d7b8b94d10d6 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] [instance: d6a40f7a-6709-4e75-b3e8-f98abf1b03d8] Going to try to terminate instance {{(pid=134052) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:58:31.362539 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-60c3a38a-a499-412d-afbe-c77d0035994a tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] HTTP exception thrown: Instance fce0841b-76a8-496d-8fc0-69ad3fa9f7a6 could not be found. Aug 27 02:58:31.365101 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-60c3a38a-a499-412d-afbe-c77d0035994a tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Request method failure captured: Aug 27 02:58:31.365101 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/fce0841b-76a8-496d-8fc0-69ad3fa9f7a6 HTTP/1.1 Aug 27 02:58:31.365101 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:58:31.365101 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:58:31.365101 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:58:31.365101 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:58:31.365101 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:58:31.365101 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:58:31.365101 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:58:31.365101 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:58:31.365101 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYgHy20F8mEqewPPyVAr-i6FK-yM2bCD6VMUU6bWr42YNPGmqraxtXuFmNh0mCGA12K-H0KGbijJcDiFoF1IWn3gbEqdQMrNRRVtK68P0L7SObaS8M-aBKk6LcOnctIqmpeDYUb2yMcqLOHa3drT115scNX6yYkvD3zz-j1vY-58dKU Aug 27 02:58:31.365101 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:58:31.365101 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:58:31.365101 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:58:31.365101 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:58:31.365101 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:58:31.365101 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:58:31.365101 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 2448b78114c54dd39bc85538fb973dd2 Aug 27 02:58:31.365101 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ListServerFiltersTestJSON-1841247183 Aug 27 02:58:31.365101 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:58:31.365101 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:58:31.365101 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2448b78114c54dd39bc85538fb973dd2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_2448b78114c54dd39bc85538fb973dd2", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2448b78114c54dd39bc85538fb973dd2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/2448b78114c54dd39bc85538fb973dd2"}]}] Aug 27 02:58:31.365101 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ListServerFiltersTestJSON-1841247183 Aug 27 02:58:31.365101 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 2448b78114c54dd39bc85538fb973dd2 Aug 27 02:58:31.365101 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1841247183 Aug 27 02:58:31.365101 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ListServerFiltersTestJSON-1841247183-project Aug 27 02:58:31.365101 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:58:31.365101 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:58:31.365101 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 2b217f9cbc204919ba77d885315907c2 Aug 27 02:58:31.365101 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ListServerFiltersTestJSON-1841247183-project Aug 27 02:58:31.365101 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 02:58:31.365101 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance fce0841b-76a8-496d-8fc0-69ad3fa9f7a6 could not be found. Aug 27 02:58:31.365101 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': 'fce0841b-76a8-496d-8fc0-69ad3fa9f7a6'} Aug 27 02:58:31.365101 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:58:31.365101 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:58:31.365101 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:58:31.365101 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:58:31.365101 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:58:31.365101 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:58:31.365101 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:58:31.365101 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:58:31.365101 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:58:31.365101 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:58:31.365101 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fce0841b-76a8-496d-8fc0-69ad3fa9f7a6 could not be found. Aug 27 02:58:31.365101 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:58:31.365101 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:58:31.365101 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:58:31.365101 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:58:31.365101 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:58:31.365101 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:58:31.365101 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:58:31.365101 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:58:31.365101 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:58:31.365101 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:58:31.365101 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:58:31.365101 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:58:31.365101 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:58:31.365101 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:58:31.365101 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:58:31.365101 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:58:31.365101 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fce0841b-76a8-496d-8fc0-69ad3fa9f7a6 could not be found. Aug 27 02:58:31.365101 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:58:31.365101 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:58:31.365101 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:58:31.369579 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:58:31.369579 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:58:31.369579 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:58:31.369579 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:58:31.369579 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:58:31.369579 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fce0841b-76a8-496d-8fc0-69ad3fa9f7a6 could not be found. Aug 27 02:58:31.369579 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:58:31.369579 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-60c3a38a-a499-412d-afbe-c77d0035994a tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Returning 404 to user: Instance fce0841b-76a8-496d-8fc0-69ad3fa9f7a6 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:58:31.369579 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-60c3a38a-a499-412d-afbe-c77d0035994a tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] 10.222.0.70 "GET /compute/v2.1/servers/fce0841b-76a8-496d-8fc0-69ad3fa9f7a6" status: 404 len: 111 microversion: 2.1 time: 0.035284 Aug 27 02:58:31.369579 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1864/3719] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:58:31 2022] GET /compute/v2.1/servers/fce0841b-76a8-496d-8fc0-69ad3fa9f7a6 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 02:58:31.375112 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-bbc5f771-c30a-43a2-ba11-517d9aa7b623 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:31.375618 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-bbc5f771-c30a-43a2-ba11-517d9aa7b623 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] [instance: 02eba429-ecb3-4a5c-87ea-c049ad7aca1a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:31.381708 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bbc5f771-c30a-43a2-ba11-517d9aa7b623 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:31.382233 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bbc5f771-c30a-43a2-ba11-517d9aa7b623 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:31.382674 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bbc5f771-c30a-43a2-ba11-517d9aa7b623 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:31.383587 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bbc5f771-c30a-43a2-ba11-517d9aa7b623 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:31.383833 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bbc5f771-c30a-43a2-ba11-517d9aa7b623 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:31.384257 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bbc5f771-c30a-43a2-ba11-517d9aa7b623 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:31.412997 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-bbc5f771-c30a-43a2-ba11-517d9aa7b623 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] [instance: 02eba429-ecb3-4a5c-87ea-c049ad7aca1a] Going to try to terminate instance {{(pid=134051) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:58:31.467994 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-5b23bb9b-1195-42ff-9f04-d7b8b94d10d6 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] 10.222.0.70 "DELETE /compute/v2.1/servers/d6a40f7a-6709-4e75-b3e8-f98abf1b03d8" status: 204 len: 0 microversion: 2.54 time: 0.160342 Aug 27 02:58:31.471662 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1856/3720] 10.222.0.70 () {60 vars in 1280 bytes} [Sat Aug 27 02:58:31 2022] DELETE /compute/v2.1/servers/d6a40f7a-6709-4e75-b3e8-f98abf1b03d8 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 02:58:31.478743 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f97396d4-5703-4114-b9bf-f7d6f0fb62e6 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:31.480336 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-f97396d4-5703-4114-b9bf-f7d6f0fb62e6 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] [instance: d6a40f7a-6709-4e75-b3e8-f98abf1b03d8] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:31.489024 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f97396d4-5703-4114-b9bf-f7d6f0fb62e6 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:31.489765 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f97396d4-5703-4114-b9bf-f7d6f0fb62e6 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:31.490353 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f97396d4-5703-4114-b9bf-f7d6f0fb62e6 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:31.492508 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f97396d4-5703-4114-b9bf-f7d6f0fb62e6 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:31.493858 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f97396d4-5703-4114-b9bf-f7d6f0fb62e6 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:31.494450 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f97396d4-5703-4114-b9bf-f7d6f0fb62e6 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:31.517264 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-bbc5f771-c30a-43a2-ba11-517d9aa7b623 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] 10.222.0.70 "DELETE /compute/v2.1/servers/02eba429-ecb3-4a5c-87ea-c049ad7aca1a" status: 204 len: 0 microversion: 2.1 time: 0.145444 Aug 27 02:58:31.520738 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1865/3721] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:58:31 2022] DELETE /compute/v2.1/servers/02eba429-ecb3-4a5c-87ea-c049ad7aca1a => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 02:58:31.532234 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4e81a2d2-42c5-452a-9990-fa4caee90f3e tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:31.533217 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-4e81a2d2-42c5-452a-9990-fa4caee90f3e tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] [instance: 02eba429-ecb3-4a5c-87ea-c049ad7aca1a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:31.541335 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4e81a2d2-42c5-452a-9990-fa4caee90f3e tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:31.542016 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4e81a2d2-42c5-452a-9990-fa4caee90f3e tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:31.542587 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4e81a2d2-42c5-452a-9990-fa4caee90f3e tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:31.543460 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4e81a2d2-42c5-452a-9990-fa4caee90f3e tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:31.544261 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4e81a2d2-42c5-452a-9990-fa4caee90f3e tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:31.544809 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4e81a2d2-42c5-452a-9990-fa4caee90f3e tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:31.572731 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-f97396d4-5703-4114-b9bf-f7d6f0fb62e6 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcc2feab6eb427cb1c1ac9093670ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4190feabcb36413fb443349aadc93a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:31.582382 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-f97396d4-5703-4114-b9bf-f7d6f0fb62e6 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcc2feab6eb427cb1c1ac9093670ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4190feabcb36413fb443349aadc93a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:31.584215 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-f97396d4-5703-4114-b9bf-f7d6f0fb62e6 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcc2feab6eb427cb1c1ac9093670ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4190feabcb36413fb443349aadc93a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:31.585583 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f97396d4-5703-4114-b9bf-f7d6f0fb62e6 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] 10.222.0.70 "GET /compute/v2.1/servers/d6a40f7a-6709-4e75-b3e8-f98abf1b03d8" status: 200 len: 1406 microversion: 2.54 time: 0.112606 Aug 27 02:58:31.586291 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1857/3722] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:58:31 2022] GET /compute/v2.1/servers/d6a40f7a-6709-4e75-b3e8-f98abf1b03d8 => generated 1406 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:58:31.692542 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-4e81a2d2-42c5-452a-9990-fa4caee90f3e tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b217f9cbc204919ba77d885315907c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2448b78114c54dd39bc85538fb973dd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:31.701202 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-4e81a2d2-42c5-452a-9990-fa4caee90f3e tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] 10.222.0.70 "GET /compute/v2.1/servers/02eba429-ecb3-4a5c-87ea-c049ad7aca1a" status: 200 len: 1517 microversion: 2.1 time: 0.175681 Aug 27 02:58:31.701826 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1866/3723] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:58:31 2022] GET /compute/v2.1/servers/02eba429-ecb3-4a5c-87ea-c049ad7aca1a => generated 1517 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:58:31.934972 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b10cfc4b-2421-4ccb-b3c0-cb02d36c8430 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:31.936299 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b10cfc4b-2421-4ccb-b3c0-cb02d36c8430 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:31.945084 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b10cfc4b-2421-4ccb-b3c0-cb02d36c8430 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:31.945911 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b10cfc4b-2421-4ccb-b3c0-cb02d36c8430 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:31.946451 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b10cfc4b-2421-4ccb-b3c0-cb02d36c8430 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:31.947608 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b10cfc4b-2421-4ccb-b3c0-cb02d36c8430 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:31.948275 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b10cfc4b-2421-4ccb-b3c0-cb02d36c8430 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:31.948937 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b10cfc4b-2421-4ccb-b3c0-cb02d36c8430 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:32.245302 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b10cfc4b-2421-4ccb-b3c0-cb02d36c8430 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:32.253943 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b10cfc4b-2421-4ccb-b3c0-cb02d36c8430 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1678 microversion: 2.1 time: 0.322881 Aug 27 02:58:32.268628 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1858/3724] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:58:31 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1678 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:58:32.609643 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-354cf43b-0f13-4d7b-bafa-c640ebb7981a tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:32.610415 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-354cf43b-0f13-4d7b-bafa-c640ebb7981a tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] [instance: d6a40f7a-6709-4e75-b3e8-f98abf1b03d8] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:32.619261 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-354cf43b-0f13-4d7b-bafa-c640ebb7981a tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:32.619935 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-354cf43b-0f13-4d7b-bafa-c640ebb7981a tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:32.620737 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-354cf43b-0f13-4d7b-bafa-c640ebb7981a tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:32.621661 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-354cf43b-0f13-4d7b-bafa-c640ebb7981a tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:32.622262 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-354cf43b-0f13-4d7b-bafa-c640ebb7981a tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:32.622858 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-354cf43b-0f13-4d7b-bafa-c640ebb7981a tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:32.726304 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-354cf43b-0f13-4d7b-bafa-c640ebb7981a tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcc2feab6eb427cb1c1ac9093670ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4190feabcb36413fb443349aadc93a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:32.730603 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a48b0ce4-817b-477f-969b-5888d6a2b84b tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:32.731454 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a48b0ce4-817b-477f-969b-5888d6a2b84b tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] [instance: 02eba429-ecb3-4a5c-87ea-c049ad7aca1a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:32.749053 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a48b0ce4-817b-477f-969b-5888d6a2b84b tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:32.751803 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-354cf43b-0f13-4d7b-bafa-c640ebb7981a tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcc2feab6eb427cb1c1ac9093670ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4190feabcb36413fb443349aadc93a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:32.753240 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a48b0ce4-817b-477f-969b-5888d6a2b84b tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:32.754110 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a48b0ce4-817b-477f-969b-5888d6a2b84b tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:32.754444 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-354cf43b-0f13-4d7b-bafa-c640ebb7981a tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcc2feab6eb427cb1c1ac9093670ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4190feabcb36413fb443349aadc93a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:32.755360 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a48b0ce4-817b-477f-969b-5888d6a2b84b tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:32.755805 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-354cf43b-0f13-4d7b-bafa-c640ebb7981a tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] 10.222.0.70 "GET /compute/v2.1/servers/d6a40f7a-6709-4e75-b3e8-f98abf1b03d8" status: 200 len: 1406 microversion: 2.54 time: 0.150423 Aug 27 02:58:32.756360 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a48b0ce4-817b-477f-969b-5888d6a2b84b tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:32.757582 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a48b0ce4-817b-477f-969b-5888d6a2b84b tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:32.758494 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1867/3725] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:58:32 2022] GET /compute/v2.1/servers/d6a40f7a-6709-4e75-b3e8-f98abf1b03d8 => generated 1406 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:58:33.277136 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-586af4ec-62f6-45c8-8587-fad1b5b12f37 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:33.277925 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-586af4ec-62f6-45c8-8587-fad1b5b12f37 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:33.284527 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-586af4ec-62f6-45c8-8587-fad1b5b12f37 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:33.288876 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-586af4ec-62f6-45c8-8587-fad1b5b12f37 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:33.290115 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-586af4ec-62f6-45c8-8587-fad1b5b12f37 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:33.291070 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-586af4ec-62f6-45c8-8587-fad1b5b12f37 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:33.292860 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-586af4ec-62f6-45c8-8587-fad1b5b12f37 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:33.294560 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-586af4ec-62f6-45c8-8587-fad1b5b12f37 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:33.313510 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-a48b0ce4-817b-477f-969b-5888d6a2b84b tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b217f9cbc204919ba77d885315907c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2448b78114c54dd39bc85538fb973dd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:33.329336 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a48b0ce4-817b-477f-969b-5888d6a2b84b tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] 10.222.0.70 "GET /compute/v2.1/servers/02eba429-ecb3-4a5c-87ea-c049ad7aca1a" status: 200 len: 1517 microversion: 2.1 time: 0.607992 Aug 27 02:58:33.331345 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1859/3726] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:58:32 2022] GET /compute/v2.1/servers/02eba429-ecb3-4a5c-87ea-c049ad7aca1a => generated 1517 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:58:33.342418 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:58:33.610296 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-586af4ec-62f6-45c8-8587-fad1b5b12f37 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:33.630020 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-586af4ec-62f6-45c8-8587-fad1b5b12f37 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1678 microversion: 2.1 time: 0.358331 Aug 27 02:58:33.632033 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1868/3727] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:58:33 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1678 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:58:33.785164 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-82c872bb-d5c2-4ed1-98da-e57f627c3b99 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:33.786878 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-82c872bb-d5c2-4ed1-98da-e57f627c3b99 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] [instance: d6a40f7a-6709-4e75-b3e8-f98abf1b03d8] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:33.797991 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-82c872bb-d5c2-4ed1-98da-e57f627c3b99 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:33.798859 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-82c872bb-d5c2-4ed1-98da-e57f627c3b99 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:33.799973 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-82c872bb-d5c2-4ed1-98da-e57f627c3b99 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:33.803641 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-82c872bb-d5c2-4ed1-98da-e57f627c3b99 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:33.805578 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-82c872bb-d5c2-4ed1-98da-e57f627c3b99 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:33.806805 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-82c872bb-d5c2-4ed1-98da-e57f627c3b99 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:33.912665 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c816f74f-488d-4f69-b255-6968c133b6fe tempest-AZV2TestJSON-1690045958 tempest-AZV2TestJSON-1690045958-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:33.914365 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c816f74f-488d-4f69-b255-6968c133b6fe tempest-AZV2TestJSON-1690045958 tempest-AZV2TestJSON-1690045958-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:33.914912 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c816f74f-488d-4f69-b255-6968c133b6fe tempest-AZV2TestJSON-1690045958 tempest-AZV2TestJSON-1690045958-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:33.915561 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c816f74f-488d-4f69-b255-6968c133b6fe tempest-AZV2TestJSON-1690045958 tempest-AZV2TestJSON-1690045958-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:33.916540 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c816f74f-488d-4f69-b255-6968c133b6fe tempest-AZV2TestJSON-1690045958 tempest-AZV2TestJSON-1690045958-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:33.917370 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c816f74f-488d-4f69-b255-6968c133b6fe tempest-AZV2TestJSON-1690045958 tempest-AZV2TestJSON-1690045958-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:33.918132 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c816f74f-488d-4f69-b255-6968c133b6fe tempest-AZV2TestJSON-1690045958 tempest-AZV2TestJSON-1690045958-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:33.921416 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-82c872bb-d5c2-4ed1-98da-e57f627c3b99 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcc2feab6eb427cb1c1ac9093670ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4190feabcb36413fb443349aadc93a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:33.944128 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-82c872bb-d5c2-4ed1-98da-e57f627c3b99 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcc2feab6eb427cb1c1ac9093670ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4190feabcb36413fb443349aadc93a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:33.945995 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-82c872bb-d5c2-4ed1-98da-e57f627c3b99 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcc2feab6eb427cb1c1ac9093670ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4190feabcb36413fb443349aadc93a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:33.947631 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-82c872bb-d5c2-4ed1-98da-e57f627c3b99 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] 10.222.0.70 "GET /compute/v2.1/servers/d6a40f7a-6709-4e75-b3e8-f98abf1b03d8" status: 200 len: 1406 microversion: 2.54 time: 0.168054 Aug 27 02:58:33.966851 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1869/3728] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:58:33 2022] GET /compute/v2.1/servers/d6a40f7a-6709-4e75-b3e8-f98abf1b03d8 => generated 1406 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:58:33.967090 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c816f74f-488d-4f69-b255-6968c133b6fe tempest-AZV2TestJSON-1690045958 tempest-AZV2TestJSON-1690045958-project] 10.222.0.70 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.257682 Aug 27 02:58:33.973607 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-dbaec936-4b0d-4085-9129-c4e84419b57b req-6aa497ed-5918-49ae-a566-ef133018572a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02eba429-ecb3-4a5c-87ea-c049ad7aca1a", "name": "network-vif-deleted", "tag": "ef643ab7-d23e-493f-ac79-153b06eccfce"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:58:33.974120 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1860/3729] 10.222.0.70 () {58 vars in 1164 bytes} [Sat Aug 27 02:58:33 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:58:33.984489 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-dbaec936-4b0d-4085-9129-c4e84419b57b req-6aa497ed-5918-49ae-a566-ef133018572a service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:33.984975 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-dbaec936-4b0d-4085-9129-c4e84419b57b req-6aa497ed-5918-49ae-a566-ef133018572a service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:33.985402 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-dbaec936-4b0d-4085-9129-c4e84419b57b req-6aa497ed-5918-49ae-a566-ef133018572a service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:33.997628 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-dbaec936-4b0d-4085-9129-c4e84419b57b req-6aa497ed-5918-49ae-a566-ef133018572a service nova] Creating event network-vif-deleted:ef643ab7-d23e-493f-ac79-153b06eccfce for instance 02eba429-ecb3-4a5c-87ea-c049ad7aca1a on n-h2-852278-4 Aug 27 02:58:34.002972 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-dbaec936-4b0d-4085-9129-c4e84419b57b req-6aa497ed-5918-49ae-a566-ef133018572a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034554 Aug 27 02:58:34.004976 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1870/3730] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:58:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:58:34.352927 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-730e4255-6652-4501-bf68-684ee5bad752 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:34.353437 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-730e4255-6652-4501-bf68-684ee5bad752 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] [instance: 02eba429-ecb3-4a5c-87ea-c049ad7aca1a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:34.367809 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-730e4255-6652-4501-bf68-684ee5bad752 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:34.368140 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-730e4255-6652-4501-bf68-684ee5bad752 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:34.370993 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-730e4255-6652-4501-bf68-684ee5bad752 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:34.372085 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-730e4255-6652-4501-bf68-684ee5bad752 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:34.373409 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-730e4255-6652-4501-bf68-684ee5bad752 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:34.375240 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-730e4255-6652-4501-bf68-684ee5bad752 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:34.478517 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-730e4255-6652-4501-bf68-684ee5bad752 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b217f9cbc204919ba77d885315907c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2448b78114c54dd39bc85538fb973dd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:34.489847 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-730e4255-6652-4501-bf68-684ee5bad752 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] 10.222.0.70 "GET /compute/v2.1/servers/02eba429-ecb3-4a5c-87ea-c049ad7aca1a" status: 200 len: 1306 microversion: 2.1 time: 0.141861 Aug 27 02:58:34.492569 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1861/3731] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:58:34 2022] GET /compute/v2.1/servers/02eba429-ecb3-4a5c-87ea-c049ad7aca1a => generated 1306 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:58:34.653051 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-1960aa09-1a4a-4d68-a557-0d4e2d599629 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:34.653863 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-1960aa09-1a4a-4d68-a557-0d4e2d599629 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:34.663992 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1960aa09-1a4a-4d68-a557-0d4e2d599629 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:34.666126 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1960aa09-1a4a-4d68-a557-0d4e2d599629 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:34.667222 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1960aa09-1a4a-4d68-a557-0d4e2d599629 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:34.668187 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1960aa09-1a4a-4d68-a557-0d4e2d599629 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:34.670236 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1960aa09-1a4a-4d68-a557-0d4e2d599629 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:34.670906 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1960aa09-1a4a-4d68-a557-0d4e2d599629 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:34.982408 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-111a8b45-2953-420c-91c5-7ac578ebfd66 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:34.983312 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-111a8b45-2953-420c-91c5-7ac578ebfd66 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] [instance: d6a40f7a-6709-4e75-b3e8-f98abf1b03d8] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:34.997126 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-111a8b45-2953-420c-91c5-7ac578ebfd66 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:34.999965 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-111a8b45-2953-420c-91c5-7ac578ebfd66 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:35.000726 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-111a8b45-2953-420c-91c5-7ac578ebfd66 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:35.002812 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-111a8b45-2953-420c-91c5-7ac578ebfd66 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:35.003977 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-111a8b45-2953-420c-91c5-7ac578ebfd66 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:35.004902 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-111a8b45-2953-420c-91c5-7ac578ebfd66 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:35.043205 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-1960aa09-1a4a-4d68-a557-0d4e2d599629 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:35.058245 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-1960aa09-1a4a-4d68-a557-0d4e2d599629 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1678 microversion: 2.1 time: 0.410802 Aug 27 02:58:35.058564 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-111a8b45-2953-420c-91c5-7ac578ebfd66 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:35.059845 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-111a8b45-2953-420c-91c5-7ac578ebfd66 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:35.060670 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-111a8b45-2953-420c-91c5-7ac578ebfd66 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:35.061625 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1871/3732] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:58:34 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1678 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:58:35.062390 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.instance [None req-111a8b45-2953-420c-91c5-7ac578ebfd66 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lazy-loading 'fault' on Instance uuid d6a40f7a-6709-4e75-b3e8-f98abf1b03d8 {{(pid=134052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:58:35.205246 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-111a8b45-2953-420c-91c5-7ac578ebfd66 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcc2feab6eb427cb1c1ac9093670ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4190feabcb36413fb443349aadc93a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:35.213974 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-111a8b45-2953-420c-91c5-7ac578ebfd66 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcc2feab6eb427cb1c1ac9093670ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4190feabcb36413fb443349aadc93a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:35.215429 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-111a8b45-2953-420c-91c5-7ac578ebfd66 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcc2feab6eb427cb1c1ac9093670ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4190feabcb36413fb443349aadc93a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:35.220920 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-111a8b45-2953-420c-91c5-7ac578ebfd66 tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] 10.222.0.70 "GET /compute/v2.1/servers/d6a40f7a-6709-4e75-b3e8-f98abf1b03d8" status: 200 len: 1411 microversion: 2.54 time: 0.243933 Aug 27 02:58:35.237604 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1862/3733] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:58:34 2022] GET /compute/v2.1/servers/d6a40f7a-6709-4e75-b3e8-f98abf1b03d8 => generated 1411 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:58:35.515189 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0c72cecd-99b1-4120-ad25-1746c202f1c9 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:35.516021 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-0c72cecd-99b1-4120-ad25-1746c202f1c9 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] [instance: 02eba429-ecb3-4a5c-87ea-c049ad7aca1a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:35.522799 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0c72cecd-99b1-4120-ad25-1746c202f1c9 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:35.524677 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0c72cecd-99b1-4120-ad25-1746c202f1c9 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:35.526644 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0c72cecd-99b1-4120-ad25-1746c202f1c9 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:35.527427 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0c72cecd-99b1-4120-ad25-1746c202f1c9 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:35.527867 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0c72cecd-99b1-4120-ad25-1746c202f1c9 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:35.528295 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0c72cecd-99b1-4120-ad25-1746c202f1c9 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:35.546838 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-0c72cecd-99b1-4120-ad25-1746c202f1c9 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] HTTP exception thrown: Instance 02eba429-ecb3-4a5c-87ea-c049ad7aca1a could not be found. Aug 27 02:58:35.550420 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0c72cecd-99b1-4120-ad25-1746c202f1c9 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Request method failure captured: Aug 27 02:58:35.550420 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/02eba429-ecb3-4a5c-87ea-c049ad7aca1a HTTP/1.1 Aug 27 02:58:35.550420 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:58:35.550420 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:58:35.550420 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:58:35.550420 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:58:35.550420 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:58:35.550420 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:58:35.550420 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:58:35.550420 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:58:35.550420 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYgHy20F8mEqewPPyVAr-i6FK-yM2bCD6VMUU6bWr42YNPGmqraxtXuFmNh0mCGA12K-H0KGbijJcDiFoF1IWn3gbEqdQMrNRRVtK68P0L7SObaS8M-aBKk6LcOnctIqmpeDYUb2yMcqLOHa3drT115scNX6yYkvD3zz-j1vY-58dKU Aug 27 02:58:35.550420 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:58:35.550420 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:58:35.550420 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:58:35.550420 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:58:35.550420 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:58:35.550420 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:58:35.550420 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 2448b78114c54dd39bc85538fb973dd2 Aug 27 02:58:35.550420 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ListServerFiltersTestJSON-1841247183 Aug 27 02:58:35.550420 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:58:35.550420 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:58:35.550420 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2448b78114c54dd39bc85538fb973dd2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_2448b78114c54dd39bc85538fb973dd2", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2448b78114c54dd39bc85538fb973dd2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/2448b78114c54dd39bc85538fb973dd2"}]}] Aug 27 02:58:35.550420 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ListServerFiltersTestJSON-1841247183 Aug 27 02:58:35.550420 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 2448b78114c54dd39bc85538fb973dd2 Aug 27 02:58:35.550420 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1841247183 Aug 27 02:58:35.550420 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ListServerFiltersTestJSON-1841247183-project Aug 27 02:58:35.550420 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:58:35.550420 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:58:35.550420 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 2b217f9cbc204919ba77d885315907c2 Aug 27 02:58:35.550420 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ListServerFiltersTestJSON-1841247183-project Aug 27 02:58:35.550420 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 02:58:35.550420 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance 02eba429-ecb3-4a5c-87ea-c049ad7aca1a could not be found. Aug 27 02:58:35.550420 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '02eba429-ecb3-4a5c-87ea-c049ad7aca1a'} Aug 27 02:58:35.550420 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:58:35.550420 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:58:35.550420 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:58:35.550420 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:58:35.550420 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:58:35.550420 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:58:35.550420 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:58:35.550420 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:58:35.550420 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:58:35.550420 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:58:35.550420 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02eba429-ecb3-4a5c-87ea-c049ad7aca1a could not be found. Aug 27 02:58:35.550420 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:58:35.550420 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:58:35.550420 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:58:35.550420 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:58:35.550420 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:58:35.550420 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:58:35.550420 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:58:35.550420 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:58:35.550420 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:58:35.550420 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:58:35.550420 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:58:35.550420 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:58:35.550420 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:58:35.550420 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:58:35.550420 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:58:35.550420 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:58:35.550420 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02eba429-ecb3-4a5c-87ea-c049ad7aca1a could not be found. Aug 27 02:58:35.550420 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:58:35.550420 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:58:35.550420 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:58:35.555240 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:58:35.555240 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:58:35.555240 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:58:35.555240 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:58:35.555240 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:58:35.555240 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02eba429-ecb3-4a5c-87ea-c049ad7aca1a could not be found. Aug 27 02:58:35.555240 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:58:35.577336 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0c72cecd-99b1-4120-ad25-1746c202f1c9 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] Returning 404 to user: Instance 02eba429-ecb3-4a5c-87ea-c049ad7aca1a could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:58:35.585147 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-0c72cecd-99b1-4120-ad25-1746c202f1c9 tempest-ListServerFiltersTestJSON-1841247183 tempest-ListServerFiltersTestJSON-1841247183-project] 10.222.0.70 "GET /compute/v2.1/servers/02eba429-ecb3-4a5c-87ea-c049ad7aca1a" status: 404 len: 111 microversion: 2.1 time: 0.073853 Aug 27 02:58:35.588454 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1872/3734] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:58:35 2022] GET /compute/v2.1/servers/02eba429-ecb3-4a5c-87ea-c049ad7aca1a => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 02:58:36.084024 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d780af07-9bd6-4c9c-9d8e-16d94dc15cd9 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:36.084663 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d780af07-9bd6-4c9c-9d8e-16d94dc15cd9 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:36.098766 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d780af07-9bd6-4c9c-9d8e-16d94dc15cd9 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:36.099340 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d780af07-9bd6-4c9c-9d8e-16d94dc15cd9 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:36.099803 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d780af07-9bd6-4c9c-9d8e-16d94dc15cd9 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:36.100565 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d780af07-9bd6-4c9c-9d8e-16d94dc15cd9 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:36.101180 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d780af07-9bd6-4c9c-9d8e-16d94dc15cd9 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:36.105850 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d780af07-9bd6-4c9c-9d8e-16d94dc15cd9 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:36.258819 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ec6b1838-a656-4d22-b0f5-e7f984591dce tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:36.259473 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-ec6b1838-a656-4d22-b0f5-e7f984591dce tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] [instance: d6a40f7a-6709-4e75-b3e8-f98abf1b03d8] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:36.271950 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ec6b1838-a656-4d22-b0f5-e7f984591dce tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:36.272551 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ec6b1838-a656-4d22-b0f5-e7f984591dce tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:36.273060 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ec6b1838-a656-4d22-b0f5-e7f984591dce tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:36.273786 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ec6b1838-a656-4d22-b0f5-e7f984591dce tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:36.277029 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ec6b1838-a656-4d22-b0f5-e7f984591dce tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:36.277029 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ec6b1838-a656-4d22-b0f5-e7f984591dce tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:36.294931 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-ec6b1838-a656-4d22-b0f5-e7f984591dce tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] HTTP exception thrown: Instance d6a40f7a-6709-4e75-b3e8-f98abf1b03d8 could not be found. Aug 27 02:58:36.303908 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ec6b1838-a656-4d22-b0f5-e7f984591dce tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Request method failure captured: Aug 27 02:58:36.303908 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/d6a40f7a-6709-4e75-b3e8-f98abf1b03d8 HTTP/1.1 Aug 27 02:58:36.303908 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:58:36.303908 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:58:36.303908 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:58:36.303908 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:58:36.303908 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:58:36.303908 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:58:36.303908 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:58:36.303908 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:58:36.303908 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYgtHKF1YJA32WPzk_qwT7pMgIn5U5QImAV1Yu0eLC96JgoRRmJXHIAzp3BDGLh_rUQ0MCXJMxH84d6KLFAitCi8uXeNQJyDopuVyWfSq4Hrv_gERrsYPaWQKEfB_KIG07BMgSfVeHMRHTVSsSdBJYD8eZtOvlnBpVic6GQ-s7WJGVA Aug 27 02:58:36.303908 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:58:36.303908 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:58:36.303908 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:58:36.303908 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:58:36.303908 n-d-852278-4 devstack@n-api.service[134051]: X-Openstack-Nova-Api-Version: 2.54 Aug 27 02:58:36.303908 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:58:36.303908 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:58:36.303908 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 4190feabcb36413fb443349aadc93a01 Aug 27 02:58:36.303908 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ServerShowV254Test-197696868 Aug 27 02:58:36.303908 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:58:36.303908 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:58:36.303908 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4190feabcb36413fb443349aadc93a01"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_4190feabcb36413fb443349aadc93a01", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4190feabcb36413fb443349aadc93a01"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/4190feabcb36413fb443349aadc93a01"}]}] Aug 27 02:58:36.303908 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ServerShowV254Test-197696868 Aug 27 02:58:36.303908 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 4190feabcb36413fb443349aadc93a01 Aug 27 02:58:36.303908 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ServerShowV254Test-197696868 Aug 27 02:58:36.303908 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ServerShowV254Test-197696868-project Aug 27 02:58:36.303908 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:58:36.303908 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:58:36.303908 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: cfcc2feab6eb427cb1c1ac9093670ba2 Aug 27 02:58:36.303908 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ServerShowV254Test-197696868-project Aug 27 02:58:36.303908 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 02:58:36.303908 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance d6a40f7a-6709-4e75-b3e8-f98abf1b03d8 could not be found. Aug 27 02:58:36.303908 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': 'd6a40f7a-6709-4e75-b3e8-f98abf1b03d8'} Aug 27 02:58:36.303908 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:58:36.303908 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:58:36.303908 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:58:36.303908 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:58:36.303908 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:58:36.303908 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:58:36.303908 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:58:36.303908 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:58:36.303908 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:58:36.303908 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:58:36.303908 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6a40f7a-6709-4e75-b3e8-f98abf1b03d8 could not be found. Aug 27 02:58:36.303908 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:58:36.303908 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:58:36.303908 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:58:36.303908 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:58:36.303908 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:58:36.303908 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:58:36.303908 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:58:36.303908 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:58:36.303908 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:58:36.303908 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:58:36.303908 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:58:36.303908 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:58:36.303908 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:58:36.303908 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:58:36.303908 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:58:36.303908 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:58:36.303908 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6a40f7a-6709-4e75-b3e8-f98abf1b03d8 could not be found. Aug 27 02:58:36.303908 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:58:36.303908 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:58:36.303908 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:58:36.311348 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:58:36.311348 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:58:36.311348 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:58:36.311348 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:58:36.311348 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:58:36.311348 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6a40f7a-6709-4e75-b3e8-f98abf1b03d8 could not be found. Aug 27 02:58:36.311348 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:58:36.311348 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ec6b1838-a656-4d22-b0f5-e7f984591dce tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] Returning 404 to user: Instance d6a40f7a-6709-4e75-b3e8-f98abf1b03d8 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:58:36.311348 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ec6b1838-a656-4d22-b0f5-e7f984591dce tempest-ServerShowV254Test-197696868 tempest-ServerShowV254Test-197696868-project] 10.222.0.70 "GET /compute/v2.1/servers/d6a40f7a-6709-4e75-b3e8-f98abf1b03d8" status: 404 len: 111 microversion: 2.54 time: 0.064189 Aug 27 02:58:36.311348 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1873/3735] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:58:36 2022] GET /compute/v2.1/servers/d6a40f7a-6709-4e75-b3e8-f98abf1b03d8 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 27 02:58:36.874686 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-d780af07-9bd6-4c9c-9d8e-16d94dc15cd9 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:36.888214 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d780af07-9bd6-4c9c-9d8e-16d94dc15cd9 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1678 microversion: 2.1 time: 0.807948 Aug 27 02:58:36.890394 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1863/3736] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:58:36 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1678 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:58:37.919617 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ad8e28c1-6047-46d0-bc82-a590ef987a40 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:37.920879 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-ad8e28c1-6047-46d0-bc82-a590ef987a40 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:37.935147 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ad8e28c1-6047-46d0-bc82-a590ef987a40 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:37.936273 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ad8e28c1-6047-46d0-bc82-a590ef987a40 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:37.937238 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ad8e28c1-6047-46d0-bc82-a590ef987a40 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:37.953628 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ad8e28c1-6047-46d0-bc82-a590ef987a40 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:37.954451 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ad8e28c1-6047-46d0-bc82-a590ef987a40 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:37.957237 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ad8e28c1-6047-46d0-bc82-a590ef987a40 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:38.299224 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-ad8e28c1-6047-46d0-bc82-a590ef987a40 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:38.315028 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ad8e28c1-6047-46d0-bc82-a590ef987a40 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1678 microversion: 2.1 time: 0.404353 Aug 27 02:58:38.315815 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1874/3737] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:58:37 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1678 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:58:39.214027 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d780af07-9bd6-4c9c-9d8e-16d94dc15cd9 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:39.215009 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d780af07-9bd6-4c9c-9d8e-16d94dc15cd9 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001331 Aug 27 02:58:39.215358 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1864/3738] 10.222.0.70 () {56 vars in 886 bytes} [Sat Aug 27 02:58:39 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 27 02:58:39.223428 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ad8e28c1-6047-46d0-bc82-a590ef987a40 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:39.225993 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ad8e28c1-6047-46d0-bc82-a590ef987a40 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.002359 Aug 27 02:58:39.227438 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1875/3739] 10.222.0.70 () {54 vars in 1035 bytes} [Sat Aug 27 02:58:39 2022] GET /compute/v2/ => generated 379 bytes in 5 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Aug 27 02:58:39.234501 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d780af07-9bd6-4c9c-9d8e-16d94dc15cd9 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:39.235444 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d780af07-9bd6-4c9c-9d8e-16d94dc15cd9 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001531 Aug 27 02:58:39.236031 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1865/3740] 10.222.0.70 () {54 vars in 1041 bytes} [Sat Aug 27 02:58:39 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:58:39.244492 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ad8e28c1-6047-46d0-bc82-a590ef987a40 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:39.246112 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ad8e28c1-6047-46d0-bc82-a590ef987a40 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002177 Aug 27 02:58:39.252377 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1876/3741] 10.222.0.70 () {56 vars in 886 bytes} [Sat Aug 27 02:58:39 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 27 02:58:39.342913 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f61ca8a1-220f-4078-a323-18734dbc92a0 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:39.343583 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-f61ca8a1-220f-4078-a323-18734dbc92a0 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:39.357476 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f61ca8a1-220f-4078-a323-18734dbc92a0 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:39.360142 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f61ca8a1-220f-4078-a323-18734dbc92a0 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:39.361020 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f61ca8a1-220f-4078-a323-18734dbc92a0 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:39.363029 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f61ca8a1-220f-4078-a323-18734dbc92a0 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:39.363679 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f61ca8a1-220f-4078-a323-18734dbc92a0 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:39.365439 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f61ca8a1-220f-4078-a323-18734dbc92a0 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:40.136298 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-f61ca8a1-220f-4078-a323-18734dbc92a0 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:40.150234 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f61ca8a1-220f-4078-a323-18734dbc92a0 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1678 microversion: 2.1 time: 0.809827 Aug 27 02:58:40.154212 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1866/3742] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:58:39 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1678 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:58:41.171451 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4863e5e2-f08e-423a-90f0-0d408f65d231 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:41.172850 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-4863e5e2-f08e-423a-90f0-0d408f65d231 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:41.181330 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4863e5e2-f08e-423a-90f0-0d408f65d231 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:41.183042 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4863e5e2-f08e-423a-90f0-0d408f65d231 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:41.183706 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4863e5e2-f08e-423a-90f0-0d408f65d231 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:41.184752 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4863e5e2-f08e-423a-90f0-0d408f65d231 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:41.185409 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4863e5e2-f08e-423a-90f0-0d408f65d231 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:41.186034 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4863e5e2-f08e-423a-90f0-0d408f65d231 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:42.043421 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-4863e5e2-f08e-423a-90f0-0d408f65d231 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:42.063190 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-4863e5e2-f08e-423a-90f0-0d408f65d231 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1678 microversion: 2.1 time: 0.895585 Aug 27 02:58:42.064081 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1877/3743] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:58:41 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1678 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:58:43.087324 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0adbd46b-8648-4b9f-932a-62469b943a71 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:43.088119 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-0adbd46b-8648-4b9f-932a-62469b943a71 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:43.105699 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0adbd46b-8648-4b9f-932a-62469b943a71 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:43.106197 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0adbd46b-8648-4b9f-932a-62469b943a71 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:43.111500 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0adbd46b-8648-4b9f-932a-62469b943a71 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:43.113870 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0adbd46b-8648-4b9f-932a-62469b943a71 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:43.114349 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0adbd46b-8648-4b9f-932a-62469b943a71 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:43.114779 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0adbd46b-8648-4b9f-932a-62469b943a71 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:43.556544 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0adbd46b-8648-4b9f-932a-62469b943a71 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:43.570403 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-0adbd46b-8648-4b9f-932a-62469b943a71 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1655 microversion: 2.1 time: 0.486934 Aug 27 02:58:43.573669 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1867/3744] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:58:43 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1655 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:58:43.594683 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-dc39c8f7-00c6-4ae3-85ff-1528076ce7a4 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:58:43.611118 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dc39c8f7-00c6-4ae3-85ff-1528076ce7a4 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:43.613997 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dc39c8f7-00c6-4ae3-85ff-1528076ce7a4 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:43.615299 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dc39c8f7-00c6-4ae3-85ff-1528076ce7a4 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:43.676774 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-dc39c8f7-00c6-4ae3-85ff-1528076ce7a4 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Going to try to start instance {{(pid=134051) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 27 02:58:43.767840 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-dc39c8f7-00c6-4ae3-85ff-1528076ce7a4 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "POST /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd/action" status: 202 len: 0 microversion: 2.1 time: 0.177417 Aug 27 02:58:43.771313 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1878/3745] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 02:58:43 2022] POST /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd/action => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:58:43.781745 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8c2f77de-bd9d-4bd8-8db5-54fa6abd59b3 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:43.810076 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-8c2f77de-bd9d-4bd8-8db5-54fa6abd59b3 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:43.831417 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8c2f77de-bd9d-4bd8-8db5-54fa6abd59b3 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:43.835479 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8c2f77de-bd9d-4bd8-8db5-54fa6abd59b3 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:43.837651 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8c2f77de-bd9d-4bd8-8db5-54fa6abd59b3 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:43.841129 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8c2f77de-bd9d-4bd8-8db5-54fa6abd59b3 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:43.844169 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8c2f77de-bd9d-4bd8-8db5-54fa6abd59b3 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:43.846034 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8c2f77de-bd9d-4bd8-8db5-54fa6abd59b3 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:43.931408 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:58:44.238158 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-8c2f77de-bd9d-4bd8-8db5-54fa6abd59b3 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:44.243649 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:58:44.267164 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-8c2f77de-bd9d-4bd8-8db5-54fa6abd59b3 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1664 microversion: 2.1 time: 0.493161 Aug 27 02:58:44.267915 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1868/3746] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:58:43 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1664 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:58:45.294723 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e79862db-1794-41e6-ab41-348182ba88a3 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:45.296199 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-e79862db-1794-41e6-ab41-348182ba88a3 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:45.315207 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e79862db-1794-41e6-ab41-348182ba88a3 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:45.322042 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e79862db-1794-41e6-ab41-348182ba88a3 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:45.322753 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e79862db-1794-41e6-ab41-348182ba88a3 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:45.323861 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e79862db-1794-41e6-ab41-348182ba88a3 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:45.324509 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e79862db-1794-41e6-ab41-348182ba88a3 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:45.325087 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e79862db-1794-41e6-ab41-348182ba88a3 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:45.918705 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e79862db-1794-41e6-ab41-348182ba88a3 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:45.932815 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e79862db-1794-41e6-ab41-348182ba88a3 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1664 microversion: 2.1 time: 0.644738 Aug 27 02:58:45.939377 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1879/3747] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:58:45 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1664 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:58:46.960092 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d9ab3398-be88-4c09-a52b-1c388246f530 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:46.961351 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d9ab3398-be88-4c09-a52b-1c388246f530 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:46.977366 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d9ab3398-be88-4c09-a52b-1c388246f530 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:46.977787 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d9ab3398-be88-4c09-a52b-1c388246f530 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:46.978223 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d9ab3398-be88-4c09-a52b-1c388246f530 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:46.978945 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d9ab3398-be88-4c09-a52b-1c388246f530 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:46.979398 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d9ab3398-be88-4c09-a52b-1c388246f530 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:46.980074 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d9ab3398-be88-4c09-a52b-1c388246f530 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:47.521085 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-d9ab3398-be88-4c09-a52b-1c388246f530 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:47.551203 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d9ab3398-be88-4c09-a52b-1c388246f530 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1668 microversion: 2.1 time: 0.596082 Aug 27 02:58:47.553688 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1869/3748] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:58:46 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1668 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:58:47.581126 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4bd16023-e69b-46bb-8aa6-02b0f5c39efa tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:47.583459 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-4bd16023-e69b-46bb-8aa6-02b0f5c39efa tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:47.600141 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4bd16023-e69b-46bb-8aa6-02b0f5c39efa tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:47.600886 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4bd16023-e69b-46bb-8aa6-02b0f5c39efa tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:47.601429 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4bd16023-e69b-46bb-8aa6-02b0f5c39efa tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:47.602360 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4bd16023-e69b-46bb-8aa6-02b0f5c39efa tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:47.603003 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4bd16023-e69b-46bb-8aa6-02b0f5c39efa tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:47.603900 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4bd16023-e69b-46bb-8aa6-02b0f5c39efa tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:48.120885 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-4bd16023-e69b-46bb-8aa6-02b0f5c39efa tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:48.134215 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-4bd16023-e69b-46bb-8aa6-02b0f5c39efa tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1668 microversion: 2.1 time: 0.564369 Aug 27 02:58:48.153308 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1880/3749] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:58:47 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1668 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:58:48.159232 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-593d8801-c4bd-4427-9a80-61fb3ac4bb18 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:48.160498 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-593d8801-c4bd-4427-9a80-61fb3ac4bb18 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:48.173607 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-593d8801-c4bd-4427-9a80-61fb3ac4bb18 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:48.174224 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-593d8801-c4bd-4427-9a80-61fb3ac4bb18 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:48.174743 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-593d8801-c4bd-4427-9a80-61fb3ac4bb18 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:48.177097 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-593d8801-c4bd-4427-9a80-61fb3ac4bb18 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:48.177631 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-593d8801-c4bd-4427-9a80-61fb3ac4bb18 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:48.178866 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-593d8801-c4bd-4427-9a80-61fb3ac4bb18 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:48.657912 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-593d8801-c4bd-4427-9a80-61fb3ac4bb18 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:48.677252 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-593d8801-c4bd-4427-9a80-61fb3ac4bb18 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1668 microversion: 2.1 time: 0.521712 Aug 27 02:58:48.698112 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1870/3750] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:58:48 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1668 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:58:48.700164 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0d4b154b-8c84-45f7-93c2-1638cdaf74fd tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:48.700896 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-0d4b154b-8c84-45f7-93c2-1638cdaf74fd tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:48.716759 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0d4b154b-8c84-45f7-93c2-1638cdaf74fd tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:48.717265 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0d4b154b-8c84-45f7-93c2-1638cdaf74fd tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:48.717705 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0d4b154b-8c84-45f7-93c2-1638cdaf74fd tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:48.718410 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0d4b154b-8c84-45f7-93c2-1638cdaf74fd tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:48.721293 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0d4b154b-8c84-45f7-93c2-1638cdaf74fd tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:48.721879 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0d4b154b-8c84-45f7-93c2-1638cdaf74fd tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:49.131779 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-0d4b154b-8c84-45f7-93c2-1638cdaf74fd tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:49.148476 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-0d4b154b-8c84-45f7-93c2-1638cdaf74fd tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1668 microversion: 2.1 time: 0.453149 Aug 27 02:58:49.150063 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1881/3751] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:58:48 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1668 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:58:49.169608 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b63c3fab-b173-454a-bcd9-ab142db383e8 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:49.170849 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b63c3fab-b173-454a-bcd9-ab142db383e8 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:49.179498 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b63c3fab-b173-454a-bcd9-ab142db383e8 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:49.180259 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b63c3fab-b173-454a-bcd9-ab142db383e8 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:49.181058 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b63c3fab-b173-454a-bcd9-ab142db383e8 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:49.181987 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b63c3fab-b173-454a-bcd9-ab142db383e8 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:49.182610 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b63c3fab-b173-454a-bcd9-ab142db383e8 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:49.183194 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b63c3fab-b173-454a-bcd9-ab142db383e8 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:49.571465 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b63c3fab-b173-454a-bcd9-ab142db383e8 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:49.584450 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b63c3fab-b173-454a-bcd9-ab142db383e8 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1668 microversion: 2.1 time: 0.417589 Aug 27 02:58:49.603846 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1871/3752] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:58:49 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1668 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:58:49.615786 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d4857a5b-3ca3-411d-9525-aad1e3ca3a1f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:58:49.616452 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d4857a5b-3ca3-411d-9525-aad1e3ca3a1f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:49.630734 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d4857a5b-3ca3-411d-9525-aad1e3ca3a1f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:49.634853 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d4857a5b-3ca3-411d-9525-aad1e3ca3a1f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:49.635321 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d4857a5b-3ca3-411d-9525-aad1e3ca3a1f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:49.637757 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d4857a5b-3ca3-411d-9525-aad1e3ca3a1f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:49.642077 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d4857a5b-3ca3-411d-9525-aad1e3ca3a1f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:49.642734 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d4857a5b-3ca3-411d-9525-aad1e3ca3a1f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:49.717666 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.instance [None req-d4857a5b-3ca3-411d-9525-aad1e3ca3a1f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lazy-loading 'flavor' on Instance uuid bb0d71f2-158d-4acc-8774-6874e7da29cd {{(pid=134052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:58:49.735096 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-bd742717-6a35-48a5-830a-cb3ed3a9c043 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:49.735831 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-bd742717-6a35-48a5-830a-cb3ed3a9c043 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] [instance: b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:49.752690 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bd742717-6a35-48a5-830a-cb3ed3a9c043 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:49.753233 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bd742717-6a35-48a5-830a-cb3ed3a9c043 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:49.764593 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bd742717-6a35-48a5-830a-cb3ed3a9c043 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:49.765500 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bd742717-6a35-48a5-830a-cb3ed3a9c043 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:49.766013 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bd742717-6a35-48a5-830a-cb3ed3a9c043 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:49.771656 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bd742717-6a35-48a5-830a-cb3ed3a9c043 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:49.869837 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-bd742717-6a35-48a5-830a-cb3ed3a9c043 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] [instance: b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7] Going to try to terminate instance {{(pid=134051) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:58:49.924965 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d4857a5b-3ca3-411d-9525-aad1e3ca3a1f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "POST /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd/action" status: 202 len: 0 microversion: 2.1 time: 0.318500 Aug 27 02:58:49.935099 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1872/3753] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 02:58:49 2022] POST /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd/action => generated 0 bytes in 326 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:58:49.968441 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-bee0b685-c66c-4837-be9b-fedfcb007ad5 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:49.968441 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-bee0b685-c66c-4837-be9b-fedfcb007ad5 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:50.002174 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bee0b685-c66c-4837-be9b-fedfcb007ad5 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:50.007529 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bee0b685-c66c-4837-be9b-fedfcb007ad5 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:50.013666 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bee0b685-c66c-4837-be9b-fedfcb007ad5 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:50.021105 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bee0b685-c66c-4837-be9b-fedfcb007ad5 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:50.029711 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bee0b685-c66c-4837-be9b-fedfcb007ad5 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:50.030274 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bee0b685-c66c-4837-be9b-fedfcb007ad5 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:50.191604 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-bd742717-6a35-48a5-830a-cb3ed3a9c043 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] 10.222.0.70 "DELETE /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7" status: 204 len: 0 microversion: 2.32 time: 0.909997 Aug 27 02:58:50.196537 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1882/3754] 10.222.0.70 () {60 vars in 1280 bytes} [Sat Aug 27 02:58:49 2022] DELETE /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 => generated 0 bytes in 912 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 02:58:50.346178 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4c2c9459-e272-4efd-a782-6e921c64a6da tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Action: 'create', calling method: .version_select at 0x7f5ede994f70>, body: {"keypair": {"name": "tempest-keypair-843179185", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMUCJ4PPh6RPyGjwGJxCpK9Yhcc3GD/8Pmfs1H6OUXCe/w+CM9Y2dDVKyQU6fEMURSRwAd7nYPOYT2mu/5ILX5ocvesI3EQXiK0YPjZfIThpmWZ/KW648IxkPgqOQz7o4A=="}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:58:50.413509 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-4c2c9459-e272-4efd-a782-6e921c64a6da tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Getting quotas for project 7503b9ec7c8e48ff95ce15b92a41118f. Resources: {'key_pairs'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:58:50.433136 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-4c2c9459-e272-4efd-a782-6e921c64a6da tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Getting quotas for user 5557a4cfdaab4a7fa40c17bf9fc9ceb7 and project 7503b9ec7c8e48ff95ce15b92a41118f. Resources: {'key_pairs'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:58:50.489995 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-4c2c9459-e272-4efd-a782-6e921c64a6da tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.291900 Aug 27 02:58:50.491232 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1883/3755] 10.222.0.70 () {60 vars in 1159 bytes} [Sat Aug 27 02:58:50 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:58:50.500630 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-6da25546-7931-4d98-bd24-42a0fe39b593 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:50.504610 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-6da25546-7931-4d98-bd24-42a0fe39b593 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] [instance: b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:50.517213 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6da25546-7931-4d98-bd24-42a0fe39b593 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:50.520118 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6da25546-7931-4d98-bd24-42a0fe39b593 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:50.520887 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6da25546-7931-4d98-bd24-42a0fe39b593 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:50.523745 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6da25546-7931-4d98-bd24-42a0fe39b593 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:50.526604 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6da25546-7931-4d98-bd24-42a0fe39b593 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:50.527383 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6da25546-7931-4d98-bd24-42a0fe39b593 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:51.978656 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-6da25546-7931-4d98-bd24-42a0fe39b593 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:51.998851 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-6da25546-7931-4d98-bd24-42a0fe39b593 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:52.003627 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-6da25546-7931-4d98-bd24-42a0fe39b593 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:52.008019 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-6da25546-7931-4d98-bd24-42a0fe39b593 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] 10.222.0.70 "GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7" status: 200 len: 2954 microversion: 2.32 time: 1.514726 Aug 27 02:58:52.025661 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1884/3756] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:58:50 2022] GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 => generated 2954 bytes in 1522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:58:52.166987 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-bee0b685-c66c-4837-be9b-fedfcb007ad5 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:52.176636 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-bee0b685-c66c-4837-be9b-fedfcb007ad5 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1676 microversion: 2.1 time: 2.237581 Aug 27 02:58:52.177069 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1873/3757] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:58:49 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1676 bytes in 2241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:58:53.038120 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-90eb0fdb-5adb-4d94-87d3-8c04e7476d26 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:53.039513 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-90eb0fdb-5adb-4d94-87d3-8c04e7476d26 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] [instance: b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:53.042868 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=3,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:58:53.059686 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-90eb0fdb-5adb-4d94-87d3-8c04e7476d26 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:53.062816 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-90eb0fdb-5adb-4d94-87d3-8c04e7476d26 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:53.063387 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-90eb0fdb-5adb-4d94-87d3-8c04e7476d26 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:53.064392 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-90eb0fdb-5adb-4d94-87d3-8c04e7476d26 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:53.066164 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-90eb0fdb-5adb-4d94-87d3-8c04e7476d26 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:53.066828 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-90eb0fdb-5adb-4d94-87d3-8c04e7476d26 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:53.201867 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-2b8d9ba0-bd7c-48cb-a448-2999a51c3243 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:53.202492 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-2b8d9ba0-bd7c-48cb-a448-2999a51c3243 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:53.242154 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2b8d9ba0-bd7c-48cb-a448-2999a51c3243 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:53.242642 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2b8d9ba0-bd7c-48cb-a448-2999a51c3243 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:53.243089 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2b8d9ba0-bd7c-48cb-a448-2999a51c3243 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:53.243808 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2b8d9ba0-bd7c-48cb-a448-2999a51c3243 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:53.248255 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2b8d9ba0-bd7c-48cb-a448-2999a51c3243 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:53.248873 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2b8d9ba0-bd7c-48cb-a448-2999a51c3243 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:54.343243 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-90eb0fdb-5adb-4d94-87d3-8c04e7476d26 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:54.365261 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-90eb0fdb-5adb-4d94-87d3-8c04e7476d26 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:54.370363 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-90eb0fdb-5adb-4d94-87d3-8c04e7476d26 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:54.371959 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-90eb0fdb-5adb-4d94-87d3-8c04e7476d26 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] 10.222.0.70 "GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7" status: 200 len: 2954 microversion: 2.32 time: 1.338184 Aug 27 02:58:54.377046 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1885/3758] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:58:53 2022] GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 => generated 2954 bytes in 1344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:58:54.386272 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-2b8d9ba0-bd7c-48cb-a448-2999a51c3243 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:54.394279 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-2b8d9ba0-bd7c-48cb-a448-2999a51c3243 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1659 microversion: 2.1 time: 1.197374 Aug 27 02:58:54.394866 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1874/3759] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:58:53 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1659 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:58:54.415284 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b5303715-bc81-4a68-bf2e-83188912f7e7 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:58:54.416197 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b5303715-bc81-4a68-bf2e-83188912f7e7 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:54.424880 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b5303715-bc81-4a68-bf2e-83188912f7e7 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:54.431595 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b5303715-bc81-4a68-bf2e-83188912f7e7 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:54.432180 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b5303715-bc81-4a68-bf2e-83188912f7e7 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:54.433544 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b5303715-bc81-4a68-bf2e-83188912f7e7 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:54.435780 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b5303715-bc81-4a68-bf2e-83188912f7e7 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:54.437671 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b5303715-bc81-4a68-bf2e-83188912f7e7 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:54.565733 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:58:54.602142 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b5303715-bc81-4a68-bf2e-83188912f7e7 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "POST /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd/action" status: 202 len: 0 microversion: 2.1 time: 0.190086 Aug 27 02:58:54.604928 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1886/3760] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 02:58:54 2022] POST /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd/action => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:58:54.612880 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d2f99fa1-a62d-4dd4-af39-8fbe69b6446f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:54.613807 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d2f99fa1-a62d-4dd4-af39-8fbe69b6446f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:54.622038 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d2f99fa1-a62d-4dd4-af39-8fbe69b6446f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:54.624942 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d2f99fa1-a62d-4dd4-af39-8fbe69b6446f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:54.625668 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d2f99fa1-a62d-4dd4-af39-8fbe69b6446f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:54.628742 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d2f99fa1-a62d-4dd4-af39-8fbe69b6446f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:54.629497 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d2f99fa1-a62d-4dd4-af39-8fbe69b6446f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:54.632026 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d2f99fa1-a62d-4dd4-af39-8fbe69b6446f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:55.419386 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-bca37fb5-4e47-408f-b8b5-24013065d63f tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:55.429454 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-bca37fb5-4e47-408f-b8b5-24013065d63f tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] [instance: b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:55.455414 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bca37fb5-4e47-408f-b8b5-24013065d63f tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:55.455872 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bca37fb5-4e47-408f-b8b5-24013065d63f tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:55.456305 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bca37fb5-4e47-408f-b8b5-24013065d63f tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:55.457245 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bca37fb5-4e47-408f-b8b5-24013065d63f tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:55.457866 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bca37fb5-4e47-408f-b8b5-24013065d63f tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:55.458468 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bca37fb5-4e47-408f-b8b5-24013065d63f tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:56.027755 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-d2f99fa1-a62d-4dd4-af39-8fbe69b6446f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:56.039327 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d2f99fa1-a62d-4dd4-af39-8fbe69b6446f tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1665 microversion: 2.1 time: 1.430317 Aug 27 02:58:56.044571 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1875/3761] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:58:54 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1665 bytes in 1436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:58:56.213736 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-638381c8-d369-409c-954f-8f499c4f1082 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Action: 'create', calling method: .version_select at 0x7f5ee71f48b0>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-735074488", "policies": ["affinity"]}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:58:56.250435 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-638381c8-d369-409c-954f-8f499c4f1082 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Getting quotas for project c47faacfcd434bf08187aad0ab70e5d9. Resources: {'server_groups'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:58:56.262453 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-638381c8-d369-409c-954f-8f499c4f1082 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Getting quotas for user 077ffba093574e27bdfb4d9a51910a8c and project c47faacfcd434bf08187aad0ab70e5d9. Resources: {'server_groups'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:58:56.358281 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-638381c8-d369-409c-954f-8f499c4f1082 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Getting quotas for project c47faacfcd434bf08187aad0ab70e5d9. Resources: {'server_groups'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:58:56.366626 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-638381c8-d369-409c-954f-8f499c4f1082 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Getting quotas for user 077ffba093574e27bdfb4d9a51910a8c and project c47faacfcd434bf08187aad0ab70e5d9. Resources: {'server_groups'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:58:56.388556 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-638381c8-d369-409c-954f-8f499c4f1082 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] 10.222.0.70 "POST /compute/v2.1/os-server-groups" status: 200 len: 183 microversion: 2.1 time: 0.342102 Aug 27 02:58:56.389610 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1876/3762] 10.222.0.70 () {60 vars in 1174 bytes} [Sat Aug 27 02:58:56 2022] POST /compute/v2.1/os-server-groups => generated 183 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:58:56.395787 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-4871d95c-66a6-4020-bc3c-584cc125e00d req-ef80b8f8-7904-4f35-9c25-de548ac3b597 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7", "name": "network-vif-unplugged", "status": "completed", "tag": "014fb24b-31f0-4751-9df3-1439a144e5d6"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:58:56.412476 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-4871d95c-66a6-4020-bc3c-584cc125e00d req-ef80b8f8-7904-4f35-9c25-de548ac3b597 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:56.413714 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-4871d95c-66a6-4020-bc3c-584cc125e00d req-ef80b8f8-7904-4f35-9c25-de548ac3b597 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:56.414363 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-4871d95c-66a6-4020-bc3c-584cc125e00d req-ef80b8f8-7904-4f35-9c25-de548ac3b597 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:56.436294 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-4871d95c-66a6-4020-bc3c-584cc125e00d req-ef80b8f8-7904-4f35-9c25-de548ac3b597 service nova] Creating event network-vif-unplugged:014fb24b-31f0-4751-9df3-1439a144e5d6 for instance b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 on n-h2-852278-4 Aug 27 02:58:56.446733 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-4871d95c-66a6-4020-bc3c-584cc125e00d req-ef80b8f8-7904-4f35-9c25-de548ac3b597 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055469 Aug 27 02:58:56.448301 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1877/3763] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:58:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:58:56.457750 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-667f8f9a-08a3-410b-9bb1-e1935616bd78 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Action: 'create', calling method: .version_select at 0x7f5ee71f4280>, body: {"server_group": {"name": "tempest-server-group-448062667", "policies": ["affinity"]}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:58:56.509008 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-667f8f9a-08a3-410b-9bb1-e1935616bd78 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Getting quotas for project c47faacfcd434bf08187aad0ab70e5d9. Resources: {'server_groups'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:58:56.515503 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-667f8f9a-08a3-410b-9bb1-e1935616bd78 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Getting quotas for user 077ffba093574e27bdfb4d9a51910a8c and project c47faacfcd434bf08187aad0ab70e5d9. Resources: {'server_groups'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:58:56.533400 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-bca37fb5-4e47-408f-b8b5-24013065d63f tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:56.545097 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-bca37fb5-4e47-408f-b8b5-24013065d63f tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:56.559686 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-bca37fb5-4e47-408f-b8b5-24013065d63f tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:56.561653 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-bca37fb5-4e47-408f-b8b5-24013065d63f tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] 10.222.0.70 "GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7" status: 200 len: 2954 microversion: 2.32 time: 1.155431 Aug 27 02:58:56.569574 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1887/3764] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:58:55 2022] GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 => generated 2954 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:58:56.577827 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-667f8f9a-08a3-410b-9bb1-e1935616bd78 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Getting quotas for project c47faacfcd434bf08187aad0ab70e5d9. Resources: {'server_groups'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:58:56.592943 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-667f8f9a-08a3-410b-9bb1-e1935616bd78 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Getting quotas for user 077ffba093574e27bdfb4d9a51910a8c and project c47faacfcd434bf08187aad0ab70e5d9. Resources: {'server_groups'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:58:56.617138 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:58:56.620338 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-667f8f9a-08a3-410b-9bb1-e1935616bd78 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] 10.222.0.70 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.169772 Aug 27 02:58:56.621506 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1878/3765] 10.222.0.70 () {60 vars in 1173 bytes} [Sat Aug 27 02:58:56 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:58:56.632355 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-455f78a7-f2d6-4427-bb5d-f664ef4ea5f2 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Action: 'create', calling method: .version_select at 0x7f5ede933d30>, body: {"server_group": {"name": "tempest-server-group-448062667", "policies": ["affinity"]}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:58:56.663769 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-455f78a7-f2d6-4427-bb5d-f664ef4ea5f2 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Getting quotas for project c47faacfcd434bf08187aad0ab70e5d9. Resources: {'server_groups'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:58:56.670006 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-455f78a7-f2d6-4427-bb5d-f664ef4ea5f2 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Getting quotas for user 077ffba093574e27bdfb4d9a51910a8c and project c47faacfcd434bf08187aad0ab70e5d9. Resources: {'server_groups'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:58:56.716335 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-455f78a7-f2d6-4427-bb5d-f664ef4ea5f2 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Getting quotas for project c47faacfcd434bf08187aad0ab70e5d9. Resources: {'server_groups'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:58:56.723801 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-455f78a7-f2d6-4427-bb5d-f664ef4ea5f2 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Getting quotas for user 077ffba093574e27bdfb4d9a51910a8c and project c47faacfcd434bf08187aad0ab70e5d9. Resources: {'server_groups'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:58:56.755310 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-455f78a7-f2d6-4427-bb5d-f664ef4ea5f2 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] 10.222.0.70 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.126974 Aug 27 02:58:56.761486 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1888/3766] 10.222.0.70 () {60 vars in 1173 bytes} [Sat Aug 27 02:58:56 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:58:56.769761 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-014a67e4-b0ab-4f32-ba71-16be988d5c25 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:56.844876 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-014a67e4-b0ab-4f32-ba71-16be988d5c25 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] 10.222.0.70 "DELETE /compute/v2.1/os-server-groups/9ebc3b3c-17db-4a22-a9f8-8d7fd432d170" status: 204 len: 0 microversion: 2.1 time: 0.082019 Aug 27 02:58:56.848535 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1879/3767] 10.222.0.70 () {58 vars in 1266 bytes} [Sat Aug 27 02:58:56 2022] DELETE /compute/v2.1/os-server-groups/9ebc3b3c-17db-4a22-a9f8-8d7fd432d170 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:58:56.854532 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-96ca5324-59cb-4479-8f5d-218345272f53 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:56.883555 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-96ca5324-59cb-4479-8f5d-218345272f53 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] 10.222.0.70 "GET /compute/v2.1/os-server-groups" status: 200 len: 333 microversion: 2.1 time: 0.033333 Aug 27 02:58:56.884865 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1889/3768] 10.222.0.70 () {58 vars in 1152 bytes} [Sat Aug 27 02:58:56 2022] GET /compute/v2.1/os-server-groups => generated 333 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:58:56.895678 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-99b03b63-656a-490d-8d5f-4bf191c49748 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:56.955384 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-99b03b63-656a-490d-8d5f-4bf191c49748 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] 10.222.0.70 "DELETE /compute/v2.1/os-server-groups/76c5042e-f5fa-4b2f-9cdf-078629b33043" status: 204 len: 0 microversion: 2.1 time: 0.063540 Aug 27 02:58:56.956349 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1880/3769] 10.222.0.70 () {58 vars in 1266 bytes} [Sat Aug 27 02:58:56 2022] DELETE /compute/v2.1/os-server-groups/76c5042e-f5fa-4b2f-9cdf-078629b33043 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:58:56.964998 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-52aedd9a-256c-4e36-aa51-82dfb076604b tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:56.986044 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-52aedd9a-256c-4e36-aa51-82dfb076604b tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] 10.222.0.70 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.025344 Aug 27 02:58:56.995506 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1890/3770] 10.222.0.70 () {58 vars in 1152 bytes} [Sat Aug 27 02:58:56 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:58:57.001601 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-dfab744a-5056-42b8-8e3c-d8ca9ce74596 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Action: 'create', calling method: .version_select at 0x7f5ee30f5700>, body: {"server_group": {"name": "tempest-server-group-1052714715", "policies": ["affinity"]}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:58:57.067087 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c456c33b-5b2e-4254-8cd4-d7e4b0e33a0e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:57.068156 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-c456c33b-5b2e-4254-8cd4-d7e4b0e33a0e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:57.072513 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-dfab744a-5056-42b8-8e3c-d8ca9ce74596 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Getting quotas for project c47faacfcd434bf08187aad0ab70e5d9. Resources: {'server_groups'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:58:57.079160 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c456c33b-5b2e-4254-8cd4-d7e4b0e33a0e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:57.085126 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c456c33b-5b2e-4254-8cd4-d7e4b0e33a0e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:57.086138 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c456c33b-5b2e-4254-8cd4-d7e4b0e33a0e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:57.087378 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-dfab744a-5056-42b8-8e3c-d8ca9ce74596 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Getting quotas for user 077ffba093574e27bdfb4d9a51910a8c and project c47faacfcd434bf08187aad0ab70e5d9. Resources: {'server_groups'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:58:57.090214 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c456c33b-5b2e-4254-8cd4-d7e4b0e33a0e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:57.099201 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c456c33b-5b2e-4254-8cd4-d7e4b0e33a0e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:57.099912 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c456c33b-5b2e-4254-8cd4-d7e4b0e33a0e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:57.224246 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-dfab744a-5056-42b8-8e3c-d8ca9ce74596 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Getting quotas for project c47faacfcd434bf08187aad0ab70e5d9. Resources: {'server_groups'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:58:57.239899 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-dfab744a-5056-42b8-8e3c-d8ca9ce74596 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Getting quotas for user 077ffba093574e27bdfb4d9a51910a8c and project c47faacfcd434bf08187aad0ab70e5d9. Resources: {'server_groups'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:58:57.266163 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-dfab744a-5056-42b8-8e3c-d8ca9ce74596 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] 10.222.0.70 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.268589 Aug 27 02:58:57.272474 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1881/3771] 10.222.0.70 () {60 vars in 1173 bytes} [Sat Aug 27 02:58:56 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:58:57.284174 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4fa142a6-a673-475c-8801-d427c7213e3f tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:57.337744 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-4fa142a6-a673-475c-8801-d427c7213e3f tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] 10.222.0.70 "DELETE /compute/v2.1/os-server-groups/9ec53a63-8e26-4414-a5a3-a1f52a7968a4" status: 204 len: 0 microversion: 2.1 time: 0.063063 Aug 27 02:58:57.338670 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1882/3772] 10.222.0.70 () {58 vars in 1266 bytes} [Sat Aug 27 02:58:57 2022] DELETE /compute/v2.1/os-server-groups/9ec53a63-8e26-4414-a5a3-a1f52a7968a4 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:58:57.350057 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f4576a22-5f87-40ed-9247-3a1269ab0395 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:57.387659 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f4576a22-5f87-40ed-9247-3a1269ab0395 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] 10.222.0.70 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.044819 Aug 27 02:58:57.389133 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1883/3773] 10.222.0.70 () {58 vars in 1152 bytes} [Sat Aug 27 02:58:57 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:58:57.402583 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6f370704-109c-4c48-a1d8-9f83ca54f8bc tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Action: 'create', calling method: .version_select at 0x7f5ee2ee3280>, body: {"server_group": {"name": "tempest-server-group-393067448", "policies": ["anti-affinity"]}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:58:57.449905 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-6f370704-109c-4c48-a1d8-9f83ca54f8bc tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Getting quotas for project c47faacfcd434bf08187aad0ab70e5d9. Resources: {'server_groups'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:58:57.468073 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-6f370704-109c-4c48-a1d8-9f83ca54f8bc tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Getting quotas for user 077ffba093574e27bdfb4d9a51910a8c and project c47faacfcd434bf08187aad0ab70e5d9. Resources: {'server_groups'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:58:57.570876 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-6f370704-109c-4c48-a1d8-9f83ca54f8bc tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Getting quotas for project c47faacfcd434bf08187aad0ab70e5d9. Resources: {'server_groups'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:58:57.585313 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-6f370704-109c-4c48-a1d8-9f83ca54f8bc tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Getting quotas for user 077ffba093574e27bdfb4d9a51910a8c and project c47faacfcd434bf08187aad0ab70e5d9. Resources: {'server_groups'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:58:57.622252 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-6f370704-109c-4c48-a1d8-9f83ca54f8bc tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] 10.222.0.70 "POST /compute/v2.1/os-server-groups" status: 200 len: 168 microversion: 2.1 time: 0.221331 Aug 27 02:58:57.623151 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1884/3774] 10.222.0.70 () {60 vars in 1173 bytes} [Sat Aug 27 02:58:57 2022] POST /compute/v2.1/os-server-groups => generated 168 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:58:57.633035 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0428222f-1b1b-4ccb-839d-4486b17ca80b tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:57.643481 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-0428222f-1b1b-4ccb-839d-4486b17ca80b tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] [instance: b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:57.658805 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0428222f-1b1b-4ccb-839d-4486b17ca80b tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:57.659472 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0428222f-1b1b-4ccb-839d-4486b17ca80b tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:57.660058 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0428222f-1b1b-4ccb-839d-4486b17ca80b tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:57.661017 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0428222f-1b1b-4ccb-839d-4486b17ca80b tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:57.661621 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0428222f-1b1b-4ccb-839d-4486b17ca80b tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:57.662194 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0428222f-1b1b-4ccb-839d-4486b17ca80b tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:57.813834 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-c456c33b-5b2e-4254-8cd4-d7e4b0e33a0e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:57.844372 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c456c33b-5b2e-4254-8cd4-d7e4b0e33a0e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1665 microversion: 2.1 time: 0.774778 Aug 27 02:58:57.847166 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1891/3775] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:58:57 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1665 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:58:57.852420 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c1260e3a-4476-4771-9daa-1adb940b1f47 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:57.957285 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c1260e3a-4476-4771-9daa-1adb940b1f47 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] 10.222.0.70 "DELETE /compute/v2.1/os-server-groups/53f1b458-fdbd-456a-a329-77d895391599" status: 204 len: 0 microversion: 2.1 time: 0.108663 Aug 27 02:58:57.965680 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1892/3776] 10.222.0.70 () {58 vars in 1266 bytes} [Sat Aug 27 02:58:57 2022] DELETE /compute/v2.1/os-server-groups/53f1b458-fdbd-456a-a329-77d895391599 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:58:57.974249 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-6f40bde8-caf1-453f-8c86-af9217a6d59e tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:57.995881 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-6f40bde8-caf1-453f-8c86-af9217a6d59e tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] 10.222.0.70 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.028757 Aug 27 02:58:57.998585 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1893/3777] 10.222.0.70 () {58 vars in 1152 bytes} [Sat Aug 27 02:58:57 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:58:58.082903 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-5a4391f9-63ca-4f7f-b81a-d4b48bded989 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-278938754", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "networks": [{"uuid": "b70a6125-f4e4-4191-a3e4-e9889a88169b"}]}, "os:scheduler_hints": {"group": "a1fd45b4-d0b5-4072-9d82-03e76576968a"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:58:58.224379 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.network.neutron [None req-5a4391f9-63ca-4f7f-b81a-d4b48bded989 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] validate_networks() for [('b70a6125-f4e4-4191-a3e4-e9889a88169b', None, None, None, None, None)] {{(pid=134051) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:58:59.389578 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0428222f-1b1b-4ccb-839d-4486b17ca80b tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:59.428277 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0428222f-1b1b-4ccb-839d-4486b17ca80b tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:59.433145 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0428222f-1b1b-4ccb-839d-4486b17ca80b tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:59.441018 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-0428222f-1b1b-4ccb-839d-4486b17ca80b tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] 10.222.0.70 "GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7" status: 200 len: 2933 microversion: 2.32 time: 1.811253 Aug 27 02:58:59.452339 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1885/3778] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:58:57 2022] GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 => generated 2933 bytes in 1818 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:58:59.458695 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-93eeec05-d4bc-4ceb-bdaa-b57133504df3 req-13637b9b-aa5b-43f0-9794-d348a1e14772 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7", "name": "network-vif-unplugged", "status": "completed", "tag": "08d8ee97-a66d-4a1f-8b10-8785838e3d14"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:58:59.486338 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-93eeec05-d4bc-4ceb-bdaa-b57133504df3 req-13637b9b-aa5b-43f0-9794-d348a1e14772 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:59.486830 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-93eeec05-d4bc-4ceb-bdaa-b57133504df3 req-13637b9b-aa5b-43f0-9794-d348a1e14772 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:59.487265 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-93eeec05-d4bc-4ceb-bdaa-b57133504df3 req-13637b9b-aa5b-43f0-9794-d348a1e14772 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:59.511278 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-93eeec05-d4bc-4ceb-bdaa-b57133504df3 req-13637b9b-aa5b-43f0-9794-d348a1e14772 service nova] Creating event network-vif-unplugged:08d8ee97-a66d-4a1f-8b10-8785838e3d14 for instance b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 on n-h2-852278-4 Aug 27 02:58:59.526495 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-93eeec05-d4bc-4ceb-bdaa-b57133504df3 req-13637b9b-aa5b-43f0-9794-d348a1e14772 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077629 Aug 27 02:58:59.532636 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1886/3779] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:58:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:58:59.556828 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-74fc11ee-6f4a-4d0f-be65-b7be339d8790 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:59.557798 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-74fc11ee-6f4a-4d0f-be65-b7be339d8790 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:59.565951 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-74fc11ee-6f4a-4d0f-be65-b7be339d8790 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:59.566635 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-74fc11ee-6f4a-4d0f-be65-b7be339d8790 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:59.567250 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-74fc11ee-6f4a-4d0f-be65-b7be339d8790 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:59.568227 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-74fc11ee-6f4a-4d0f-be65-b7be339d8790 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:59.569204 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-74fc11ee-6f4a-4d0f-be65-b7be339d8790 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:59.569536 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-74fc11ee-6f4a-4d0f-be65-b7be339d8790 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:00.713461 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-74fc11ee-6f4a-4d0f-be65-b7be339d8790 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:00.722837 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-74fc11ee-6f4a-4d0f-be65-b7be339d8790 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1668 microversion: 2.1 time: 1.188613 Aug 27 02:59:00.740905 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1887/3780] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:58:59 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1668 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:59:00.752426 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0d65cdb1-bf31-4241-9174-d36695a25c32 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:00.753601 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-0d65cdb1-bf31-4241-9174-d36695a25c32 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] [instance: b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:00.770553 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0d65cdb1-bf31-4241-9174-d36695a25c32 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:00.771485 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0d65cdb1-bf31-4241-9174-d36695a25c32 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:00.772189 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0d65cdb1-bf31-4241-9174-d36695a25c32 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:00.773384 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0d65cdb1-bf31-4241-9174-d36695a25c32 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:00.774044 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0d65cdb1-bf31-4241-9174-d36695a25c32 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:00.774696 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0d65cdb1-bf31-4241-9174-d36695a25c32 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:01.380097 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-5a4391f9-63ca-4f7f-b81a-d4b48bded989 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Flavor limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:59:01.380696 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-5a4391f9-63ca-4f7f-b81a-d4b48bded989 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Image limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:59:01.381312 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-5a4391f9-63ca-4f7f-b81a-d4b48bded989 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Flavor pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:59:01.381851 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-5a4391f9-63ca-4f7f-b81a-d4b48bded989 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Image pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:59:01.382374 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-5a4391f9-63ca-4f7f-b81a-d4b48bded989 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:59:01.421713 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5a4391f9-63ca-4f7f-b81a-d4b48bded989 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:01.426883 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5a4391f9-63ca-4f7f-b81a-d4b48bded989 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:01.428909 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5a4391f9-63ca-4f7f-b81a-d4b48bded989 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:01.429817 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5a4391f9-63ca-4f7f-b81a-d4b48bded989 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:01.437013 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5a4391f9-63ca-4f7f-b81a-d4b48bded989 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:01.437631 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5a4391f9-63ca-4f7f-b81a-d4b48bded989 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:01.450984 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0d65cdb1-bf31-4241-9174-d36695a25c32 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:01.461924 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0d65cdb1-bf31-4241-9174-d36695a25c32 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:01.476362 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0d65cdb1-bf31-4241-9174-d36695a25c32 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:01.487941 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-0d65cdb1-bf31-4241-9174-d36695a25c32 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] 10.222.0.70 "GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7" status: 200 len: 2933 microversion: 2.32 time: 0.745587 Aug 27 02:59:01.490599 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1888/3781] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:59:00 2022] GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 => generated 2933 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:59:01.505648 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d860dbe3-2195-44f8-81c9-02576ec0e11e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:01.507888 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d860dbe3-2195-44f8-81c9-02576ec0e11e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:01.528151 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-5a4391f9-63ca-4f7f-b81a-d4b48bded989 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Getting quotas for project c47faacfcd434bf08187aad0ab70e5d9. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:59:01.535697 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d860dbe3-2195-44f8-81c9-02576ec0e11e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:01.540996 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d860dbe3-2195-44f8-81c9-02576ec0e11e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:01.541608 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d860dbe3-2195-44f8-81c9-02576ec0e11e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:01.545001 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d860dbe3-2195-44f8-81c9-02576ec0e11e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:01.556238 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d860dbe3-2195-44f8-81c9-02576ec0e11e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:01.556697 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-5a4391f9-63ca-4f7f-b81a-d4b48bded989 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Getting quotas for user 077ffba093574e27bdfb4d9a51910a8c and project c47faacfcd434bf08187aad0ab70e5d9. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:59:01.557551 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d860dbe3-2195-44f8-81c9-02576ec0e11e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:01.602357 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-5a4391f9-63ca-4f7f-b81a-d4b48bded989 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Going to run 1 instances... {{(pid=134051) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:59:01.608701 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-5a4391f9-63ca-4f7f-b81a-d4b48bded989 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] [instance: d9aca1b6-0002-43b1-acc4-e110530eac17] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134051) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:59:01.714435 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-5a4391f9-63ca-4f7f-b81a-d4b48bded989 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Getting quotas for project c47faacfcd434bf08187aad0ab70e5d9. Resources: {'server_group_members'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:59:01.720832 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-5a4391f9-63ca-4f7f-b81a-d4b48bded989 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Getting quotas for user 077ffba093574e27bdfb4d9a51910a8c and project c47faacfcd434bf08187aad0ab70e5d9. Resources: {'server_group_members'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:59:01.791913 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-5a4391f9-63ca-4f7f-b81a-d4b48bded989 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Getting quotas for project c47faacfcd434bf08187aad0ab70e5d9. Resources: {'server_group_members'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:59:01.812557 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-5a4391f9-63ca-4f7f-b81a-d4b48bded989 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Getting quotas for user 077ffba093574e27bdfb4d9a51910a8c and project c47faacfcd434bf08187aad0ab70e5d9. Resources: {'server_group_members'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:59:01.851790 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-5a4391f9-63ca-4f7f-b81a-d4b48bded989 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.773737 Aug 27 02:59:01.853186 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1894/3782] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 02:58:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 3776 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:59:01.864855 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-120c0040-9775-411f-93ad-0a4923aa5f80 req-8d6fe414-42a2-47f8-8756-d557e75e32ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7", "name": "network-vif-unplugged", "status": "completed", "tag": "a013082b-68fd-42aa-a18e-2179253e7de6"}, {"server_uuid": "b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7", "name": "network-vif-unplugged", "status": "completed", "tag": "07494d6f-38b9-4b8b-930b-4c4d1abbc8b1"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:59:01.878561 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-120c0040-9775-411f-93ad-0a4923aa5f80 req-8d6fe414-42a2-47f8-8756-d557e75e32ec service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:01.879368 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-120c0040-9775-411f-93ad-0a4923aa5f80 req-8d6fe414-42a2-47f8-8756-d557e75e32ec service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:01.880362 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-120c0040-9775-411f-93ad-0a4923aa5f80 req-8d6fe414-42a2-47f8-8756-d557e75e32ec service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:01.894902 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-120c0040-9775-411f-93ad-0a4923aa5f80 req-8d6fe414-42a2-47f8-8756-d557e75e32ec service nova] Creating event network-vif-unplugged:a013082b-68fd-42aa-a18e-2179253e7de6 for instance b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 on n-h2-852278-4 Aug 27 02:59:01.895681 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-120c0040-9775-411f-93ad-0a4923aa5f80 req-8d6fe414-42a2-47f8-8756-d557e75e32ec service nova] Creating event network-vif-unplugged:07494d6f-38b9-4b8b-930b-4c4d1abbc8b1 for instance b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 on n-h2-852278-4 Aug 27 02:59:01.902624 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-120c0040-9775-411f-93ad-0a4923aa5f80 req-8d6fe414-42a2-47f8-8756-d557e75e32ec service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.047178 Aug 27 02:59:01.903709 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1895/3783] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:59:01 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:59:01.909911 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-21e5d52e-ddf0-4359-851b-2aa044cb9265 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:01.910972 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-21e5d52e-ddf0-4359-851b-2aa044cb9265 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] [instance: d9aca1b6-0002-43b1-acc4-e110530eac17] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:02.319982 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-21e5d52e-ddf0-4359-851b-2aa044cb9265 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '077ffba093574e27bdfb4d9a51910a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47faacfcd434bf08187aad0ab70e5d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:02.331231 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-21e5d52e-ddf0-4359-851b-2aa044cb9265 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] 10.222.0.70 "GET /compute/v2.1/servers/d9aca1b6-0002-43b1-acc4-e110530eac17" status: 200 len: 1212 microversion: 2.1 time: 0.425845 Aug 27 02:59:02.337635 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1896/3784] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:59:01 2022] GET /compute/v2.1/servers/d9aca1b6-0002-43b1-acc4-e110530eac17 => generated 1212 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:59:02.523610 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-68a8d453-de1e-42ca-8c79-f42e6adee7c4 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:02.524506 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-68a8d453-de1e-42ca-8c79-f42e6adee7c4 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] [instance: b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:02.539024 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-68a8d453-de1e-42ca-8c79-f42e6adee7c4 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:02.540742 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-68a8d453-de1e-42ca-8c79-f42e6adee7c4 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:02.551179 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-68a8d453-de1e-42ca-8c79-f42e6adee7c4 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:02.552350 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-68a8d453-de1e-42ca-8c79-f42e6adee7c4 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:02.553357 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-68a8d453-de1e-42ca-8c79-f42e6adee7c4 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:02.554219 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-68a8d453-de1e-42ca-8c79-f42e6adee7c4 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:02.648144 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-d860dbe3-2195-44f8-81c9-02576ec0e11e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:02.665443 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d860dbe3-2195-44f8-81c9-02576ec0e11e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1668 microversion: 2.1 time: 1.173447 Aug 27 02:59:02.673710 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1889/3785] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:59:01 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1668 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:59:02.702091 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-31bf4666-96c3-4fbb-b1f0-80b551269942 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:02.702989 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-31bf4666-96c3-4fbb-b1f0-80b551269942 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 93c96362-cc02-493d-a96b-ca19cf3a4e47] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:02.725311 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-31bf4666-96c3-4fbb-b1f0-80b551269942 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:02.726052 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-31bf4666-96c3-4fbb-b1f0-80b551269942 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:02.726685 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-31bf4666-96c3-4fbb-b1f0-80b551269942 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:02.729444 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-31bf4666-96c3-4fbb-b1f0-80b551269942 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:02.730107 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-31bf4666-96c3-4fbb-b1f0-80b551269942 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:02.730546 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-31bf4666-96c3-4fbb-b1f0-80b551269942 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:02.819058 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-31bf4666-96c3-4fbb-b1f0-80b551269942 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 93c96362-cc02-493d-a96b-ca19cf3a4e47] Going to try to terminate instance {{(pid=134052) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:59:02.831637 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.compute.api [None req-31bf4666-96c3-4fbb-b1f0-80b551269942 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 93c96362-cc02-493d-a96b-ca19cf3a4e47] Working on deleting snapshot 3964b39a-5270-4f15-9119-7d19beb87b15 from shelved instance... Aug 27 02:59:04.187639 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-68a8d453-de1e-42ca-8c79-f42e6adee7c4 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:04.224167 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-68a8d453-de1e-42ca-8c79-f42e6adee7c4 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:04.230226 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-68a8d453-de1e-42ca-8c79-f42e6adee7c4 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:04.235155 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-68a8d453-de1e-42ca-8c79-f42e6adee7c4 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] 10.222.0.70 "GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7" status: 200 len: 2912 microversion: 2.32 time: 1.713515 Aug 27 02:59:04.264702 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1897/3786] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:59:02 2022] GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 => generated 2912 bytes in 1746 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:59:04.293840 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-abe796c2-1a6b-424f-a227-c8a7cd67e3ba tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:04.294982 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-abe796c2-1a6b-424f-a227-c8a7cd67e3ba tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] [instance: d9aca1b6-0002-43b1-acc4-e110530eac17] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:04.305468 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:DELETE=3 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:59:04.308212 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-abe796c2-1a6b-424f-a227-c8a7cd67e3ba tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:04.308936 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-abe796c2-1a6b-424f-a227-c8a7cd67e3ba tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:04.312400 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-abe796c2-1a6b-424f-a227-c8a7cd67e3ba tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:04.313834 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-abe796c2-1a6b-424f-a227-c8a7cd67e3ba tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:04.314446 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-abe796c2-1a6b-424f-a227-c8a7cd67e3ba tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:04.315136 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-abe796c2-1a6b-424f-a227-c8a7cd67e3ba tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:04.545457 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-31bf4666-96c3-4fbb-b1f0-80b551269942 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 93c96362-cc02-493d-a96b-ca19cf3a4e47] Doing local delete in cell 9e3f7cc8-d9cf-4064-9831-4fdba8cfa839(cell1) {{(pid=134052) _delete /opt/stack/nova/nova/compute/api.py:2546}} Aug 27 02:59:04.548707 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-31bf4666-96c3-4fbb-b1f0-80b551269942 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:04.549433 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-31bf4666-96c3-4fbb-b1f0-80b551269942 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:04.554555 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-31bf4666-96c3-4fbb-b1f0-80b551269942 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:04.555097 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.compute.api [None req-31bf4666-96c3-4fbb-b1f0-80b551269942 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 93c96362-cc02-493d-a96b-ca19cf3a4e47] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Aug 27 02:59:04.570246 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.network.neutron [None req-31bf4666-96c3-4fbb-b1f0-80b551269942 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 93c96362-cc02-493d-a96b-ca19cf3a4e47] deallocate_for_instance() {{(pid=134052) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Aug 27 02:59:05.175858 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-abe796c2-1a6b-424f-a227-c8a7cd67e3ba tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '077ffba093574e27bdfb4d9a51910a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47faacfcd434bf08187aad0ab70e5d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:05.186454 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-abe796c2-1a6b-424f-a227-c8a7cd67e3ba tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] 10.222.0.70 "GET /compute/v2.1/servers/d9aca1b6-0002-43b1-acc4-e110530eac17" status: 200 len: 1272 microversion: 2.1 time: 0.920607 Aug 27 02:59:05.187056 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1898/3787] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:59:04 2022] GET /compute/v2.1/servers/d9aca1b6-0002-43b1-acc4-e110530eac17 => generated 1272 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:59:05.198585 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-1fdd1a87-7689-4b55-946b-6ce30ab4323c req-09b9c86d-9576-4dc8-82ea-21f469440cf5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7", "name": "network-vif-unplugged", "status": "completed", "tag": "8524810a-aaa6-4efe-ac59-2515339a1681"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:59:05.225119 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-1fdd1a87-7689-4b55-946b-6ce30ab4323c req-09b9c86d-9576-4dc8-82ea-21f469440cf5 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:05.228907 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-1fdd1a87-7689-4b55-946b-6ce30ab4323c req-09b9c86d-9576-4dc8-82ea-21f469440cf5 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:05.229624 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-1fdd1a87-7689-4b55-946b-6ce30ab4323c req-09b9c86d-9576-4dc8-82ea-21f469440cf5 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:05.249904 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-1fdd1a87-7689-4b55-946b-6ce30ab4323c req-09b9c86d-9576-4dc8-82ea-21f469440cf5 service nova] Creating event network-vif-unplugged:8524810a-aaa6-4efe-ac59-2515339a1681 for instance b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 on n-h2-852278-4 Aug 27 02:59:05.273352 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-1fdd1a87-7689-4b55-946b-6ce30ab4323c req-09b9c86d-9576-4dc8-82ea-21f469440cf5 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078266 Aug 27 02:59:05.274429 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1899/3788] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:59:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:59:05.399102 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4be910a4-27bb-4a80-80de-baaf4efbc269 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Action: 'create', calling method: .version_select at 0x7f5edf458f70>, body: {"keypair": {"name": "tempest-keypair-1655999747", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHHjSNfq6kVAdT+rLG6Of8ysDjmtAh1A7ZaomQieXNjBaZA0H0CW8OmzUm8tF7+1mHtRHwaJSuOFHpEXfUjJppWcPJYVvi61UgnZ3KwH0MAn/0qxQ9wrQgUG1+GmswjsdQ=="}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:59:05.468548 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-4be910a4-27bb-4a80-80de-baaf4efbc269 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Getting quotas for project c41649f09cbf410a9825100c498b4916. Resources: {'key_pairs'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:59:05.492967 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-4be910a4-27bb-4a80-80de-baaf4efbc269 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Getting quotas for user 0fe0328160c6472086d13907344756cb and project c41649f09cbf410a9825100c498b4916. Resources: {'key_pairs'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:59:05.547223 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-4be910a4-27bb-4a80-80de-baaf4efbc269 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.271327 Aug 27 02:59:05.548464 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1900/3789] 10.222.0.70 () {60 vars in 1159 bytes} [Sat Aug 27 02:59:05 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:59:05.553919 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-17427b14-7977-4fda-93f3-8213728e84ef req-7a5c6920-3473-4dfc-9bec-02f53c773c49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7", "name": "network-vif-deleted", "tag": "a013082b-68fd-42aa-a18e-2179253e7de6"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:59:05.579146 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-17427b14-7977-4fda-93f3-8213728e84ef req-7a5c6920-3473-4dfc-9bec-02f53c773c49 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:05.587821 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-17427b14-7977-4fda-93f3-8213728e84ef req-7a5c6920-3473-4dfc-9bec-02f53c773c49 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:05.588685 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-17427b14-7977-4fda-93f3-8213728e84ef req-7a5c6920-3473-4dfc-9bec-02f53c773c49 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:05.611477 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-17427b14-7977-4fda-93f3-8213728e84ef req-7a5c6920-3473-4dfc-9bec-02f53c773c49 service nova] Creating event network-vif-deleted:a013082b-68fd-42aa-a18e-2179253e7de6 for instance b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 on n-h2-852278-4 Aug 27 02:59:05.623936 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-17427b14-7977-4fda-93f3-8213728e84ef req-7a5c6920-3473-4dfc-9bec-02f53c773c49 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073938 Aug 27 02:59:05.628812 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1901/3790] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:59:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:59:05.641406 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d8c7d3bd-cab1-448e-96b8-18a48a7f48fb tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:05.642674 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d8c7d3bd-cab1-448e-96b8-18a48a7f48fb tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] [instance: b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:05.660055 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d8c7d3bd-cab1-448e-96b8-18a48a7f48fb tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:05.669563 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d8c7d3bd-cab1-448e-96b8-18a48a7f48fb tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:05.670208 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d8c7d3bd-cab1-448e-96b8-18a48a7f48fb tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:05.671109 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d8c7d3bd-cab1-448e-96b8-18a48a7f48fb tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:05.671716 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d8c7d3bd-cab1-448e-96b8-18a48a7f48fb tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:05.672257 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d8c7d3bd-cab1-448e-96b8-18a48a7f48fb tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:06.619619 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d8c7d3bd-cab1-448e-96b8-18a48a7f48fb tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:06.641211 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d8c7d3bd-cab1-448e-96b8-18a48a7f48fb tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:06.644596 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d8c7d3bd-cab1-448e-96b8-18a48a7f48fb tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:06.648790 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d8c7d3bd-cab1-448e-96b8-18a48a7f48fb tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] 10.222.0.70 "GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7" status: 200 len: 2751 microversion: 2.32 time: 1.018378 Aug 27 02:59:06.651748 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1902/3791] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:59:05 2022] GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 => generated 2751 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:59:06.658832 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4841e415-e8e6-4398-8b77-54d464ec4e1d tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:06.662488 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-4841e415-e8e6-4398-8b77-54d464ec4e1d tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] [instance: d9aca1b6-0002-43b1-acc4-e110530eac17] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:06.675323 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4841e415-e8e6-4398-8b77-54d464ec4e1d tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:06.676182 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4841e415-e8e6-4398-8b77-54d464ec4e1d tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:06.681060 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4841e415-e8e6-4398-8b77-54d464ec4e1d tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:06.682086 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4841e415-e8e6-4398-8b77-54d464ec4e1d tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:06.682718 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4841e415-e8e6-4398-8b77-54d464ec4e1d tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:06.683355 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4841e415-e8e6-4398-8b77-54d464ec4e1d tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:06.881526 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-4841e415-e8e6-4398-8b77-54d464ec4e1d tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '077ffba093574e27bdfb4d9a51910a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47faacfcd434bf08187aad0ab70e5d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:06.890369 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-4841e415-e8e6-4398-8b77-54d464ec4e1d tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] 10.222.0.70 "GET /compute/v2.1/servers/d9aca1b6-0002-43b1-acc4-e110530eac17" status: 200 len: 1270 microversion: 2.1 time: 0.237312 Aug 27 02:59:06.890968 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1903/3792] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:59:06 2022] GET /compute/v2.1/servers/d9aca1b6-0002-43b1-acc4-e110530eac17 => generated 1270 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:59:07.610124 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=32 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:59:07.680362 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-1c3f3b94-b4fa-4855-be95-13ceb89d1c22 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:07.681676 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-1c3f3b94-b4fa-4855-be95-13ceb89d1c22 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] [instance: b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:07.707090 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1c3f3b94-b4fa-4855-be95-13ceb89d1c22 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:07.707992 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1c3f3b94-b4fa-4855-be95-13ceb89d1c22 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:07.712468 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1c3f3b94-b4fa-4855-be95-13ceb89d1c22 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:07.714377 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1c3f3b94-b4fa-4855-be95-13ceb89d1c22 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:07.715075 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1c3f3b94-b4fa-4855-be95-13ceb89d1c22 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:07.718946 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1c3f3b94-b4fa-4855-be95-13ceb89d1c22 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:08.856926 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.network.neutron [None req-31bf4666-96c3-4fbb-b1f0-80b551269942 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 93c96362-cc02-493d-a96b-ca19cf3a4e47] Updating instance_info_cache with network_info: [] {{(pid=134052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 27 02:59:08.882346 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:59:09.023929 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-1c3f3b94-b4fa-4855-be95-13ceb89d1c22 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:09.041445 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-1c3f3b94-b4fa-4855-be95-13ceb89d1c22 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:09.050090 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-1c3f3b94-b4fa-4855-be95-13ceb89d1c22 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:09.054389 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-1c3f3b94-b4fa-4855-be95-13ceb89d1c22 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] 10.222.0.70 "GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7" status: 200 len: 2751 microversion: 2.32 time: 1.380204 Aug 27 02:59:09.058993 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1904/3793] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:59:07 2022] GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 => generated 2751 bytes in 1385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:59:09.065175 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8e924775-9c68-4a53-81b0-fb75ec1516e8 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:09.072058 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-8e924775-9c68-4a53-81b0-fb75ec1516e8 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] [instance: d9aca1b6-0002-43b1-acc4-e110530eac17] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:09.092812 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8e924775-9c68-4a53-81b0-fb75ec1516e8 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:09.093651 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8e924775-9c68-4a53-81b0-fb75ec1516e8 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:09.094240 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8e924775-9c68-4a53-81b0-fb75ec1516e8 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:09.095125 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8e924775-9c68-4a53-81b0-fb75ec1516e8 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:09.096069 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8e924775-9c68-4a53-81b0-fb75ec1516e8 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:09.096688 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8e924775-9c68-4a53-81b0-fb75ec1516e8 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:09.247160 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-8e924775-9c68-4a53-81b0-fb75ec1516e8 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '077ffba093574e27bdfb4d9a51910a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47faacfcd434bf08187aad0ab70e5d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:09.261880 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-8e924775-9c68-4a53-81b0-fb75ec1516e8 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] 10.222.0.70 "GET /compute/v2.1/servers/d9aca1b6-0002-43b1-acc4-e110530eac17" status: 200 len: 1270 microversion: 2.1 time: 0.200591 Aug 27 02:59:09.264659 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1905/3794] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:59:09 2022] GET /compute/v2.1/servers/d9aca1b6-0002-43b1-acc4-e110530eac17 => generated 1270 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:59:09.284723 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-b5eb1963-459a-47c4-8d89-d88c887f0205 req-7ad53076-a035-47f4-bbdd-fd53dbc51ce5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7", "name": "network-vif-deleted", "tag": "014fb24b-31f0-4751-9df3-1439a144e5d6"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:59:09.307321 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-b5eb1963-459a-47c4-8d89-d88c887f0205 req-7ad53076-a035-47f4-bbdd-fd53dbc51ce5 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:09.307982 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-b5eb1963-459a-47c4-8d89-d88c887f0205 req-7ad53076-a035-47f4-bbdd-fd53dbc51ce5 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:09.308588 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-b5eb1963-459a-47c4-8d89-d88c887f0205 req-7ad53076-a035-47f4-bbdd-fd53dbc51ce5 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:09.332804 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-b5eb1963-459a-47c4-8d89-d88c887f0205 req-7ad53076-a035-47f4-bbdd-fd53dbc51ce5 service nova] Creating event network-vif-deleted:014fb24b-31f0-4751-9df3-1439a144e5d6 for instance b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 on n-h2-852278-4 Aug 27 02:59:09.346010 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-b5eb1963-459a-47c4-8d89-d88c887f0205 req-7ad53076-a035-47f4-bbdd-fd53dbc51ce5 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074373 Aug 27 02:59:09.347214 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1906/3795] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:59:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:59:09.528223 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=86,nova_api:DELETE=9,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:59:09.674872 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-31bf4666-96c3-4fbb-b1f0-80b551269942 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "DELETE /compute/v2.1/servers/93c96362-cc02-493d-a96b-ca19cf3a4e47" status: 204 len: 0 microversion: 2.1 time: 6.978452 Aug 27 02:59:09.677591 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1890/3796] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:59:02 2022] DELETE /compute/v2.1/servers/93c96362-cc02-493d-a96b-ca19cf3a4e47 => generated 0 bytes in 6983 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 02:59:09.689614 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-70a91d55-fc77-4981-8be6-fad3c3738e25 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:09.690882 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-70a91d55-fc77-4981-8be6-fad3c3738e25 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 93c96362-cc02-493d-a96b-ca19cf3a4e47] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:09.702623 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-70a91d55-fc77-4981-8be6-fad3c3738e25 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:09.705202 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-70a91d55-fc77-4981-8be6-fad3c3738e25 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:09.705652 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-70a91d55-fc77-4981-8be6-fad3c3738e25 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:09.706383 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-70a91d55-fc77-4981-8be6-fad3c3738e25 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:09.708937 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-70a91d55-fc77-4981-8be6-fad3c3738e25 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:09.710427 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-70a91d55-fc77-4981-8be6-fad3c3738e25 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:09.749293 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-70a91d55-fc77-4981-8be6-fad3c3738e25 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] HTTP exception thrown: Instance 93c96362-cc02-493d-a96b-ca19cf3a4e47 could not be found. Aug 27 02:59:09.755167 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-70a91d55-fc77-4981-8be6-fad3c3738e25 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Request method failure captured: Aug 27 02:59:09.755167 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/93c96362-cc02-493d-a96b-ca19cf3a4e47 HTTP/1.1 Aug 27 02:59:09.755167 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:59:09.755167 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:59:09.755167 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:59:09.755167 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:59:09.755167 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:59:09.755167 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:59:09.755167 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:59:09.755167 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:59:09.755167 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYZ4Z8i7XrQCoJ8R1xQrljLXT0Y1KKkpWSlhl8nQzR0Gffp8SuHSAmEqH2wTow_HYUPfKDsH80AYAaprEdUsqUlgb1Dqa2tgrmc5xbHE8YE53Hq_xfoTBUsq6qNfDu_s_oKqI9wgNRhJDAuY_9xSuITf0Dzo8xZBUzkyCrp-xMPec0c Aug 27 02:59:09.755167 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:59:09.755167 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:59:09.755167 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:59:09.755167 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:59:09.755167 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:59:09.755167 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:59:09.755167 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 952767db5f394fc4bf01c0efd65f2fb9 Aug 27 02:59:09.755167 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ServerActionsTestJSON-1132885212 Aug 27 02:59:09.755167 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:59:09.755167 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:59:09.755167 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/952767db5f394fc4bf01c0efd65f2fb9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_952767db5f394fc4bf01c0efd65f2fb9", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/952767db5f394fc4bf01c0efd65f2fb9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/952767db5f394fc4bf01c0efd65f2fb9"}]}] Aug 27 02:59:09.755167 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ServerActionsTestJSON-1132885212 Aug 27 02:59:09.755167 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 952767db5f394fc4bf01c0efd65f2fb9 Aug 27 02:59:09.755167 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ServerActionsTestJSON-1132885212 Aug 27 02:59:09.755167 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ServerActionsTestJSON-1132885212-project Aug 27 02:59:09.755167 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:59:09.755167 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:59:09.755167 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: c850bda78e664117b671910c0e68bfb9 Aug 27 02:59:09.755167 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ServerActionsTestJSON-1132885212-project Aug 27 02:59:09.755167 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 02:59:09.755167 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance 93c96362-cc02-493d-a96b-ca19cf3a4e47 could not be found. Aug 27 02:59:09.755167 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '93c96362-cc02-493d-a96b-ca19cf3a4e47'} Aug 27 02:59:09.755167 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:59:09.755167 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:59:09.755167 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:59:09.755167 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:59:09.755167 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:59:09.755167 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:59:09.755167 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:59:09.755167 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:59:09.755167 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:59:09.755167 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:59:09.755167 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93c96362-cc02-493d-a96b-ca19cf3a4e47 could not be found. Aug 27 02:59:09.755167 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:59:09.755167 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:59:09.755167 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:59:09.755167 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:59:09.755167 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:59:09.755167 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:59:09.755167 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:59:09.755167 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:59:09.755167 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:59:09.755167 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:59:09.755167 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:59:09.755167 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:59:09.755167 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:59:09.755167 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:59:09.755167 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:59:09.755167 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:59:09.755167 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93c96362-cc02-493d-a96b-ca19cf3a4e47 could not be found. Aug 27 02:59:09.755167 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:59:09.755167 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:59:09.755167 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:59:09.759583 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:59:09.759583 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:59:09.759583 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:59:09.759583 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:59:09.759583 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:59:09.759583 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93c96362-cc02-493d-a96b-ca19cf3a4e47 could not be found. Aug 27 02:59:09.759583 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:59:09.762362 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-70a91d55-fc77-4981-8be6-fad3c3738e25 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Returning 404 to user: Instance 93c96362-cc02-493d-a96b-ca19cf3a4e47 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:59:09.764097 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-70a91d55-fc77-4981-8be6-fad3c3738e25 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/93c96362-cc02-493d-a96b-ca19cf3a4e47" status: 404 len: 111 microversion: 2.1 time: 0.081381 Aug 27 02:59:09.767263 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1907/3797] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:59:09 2022] GET /compute/v2.1/servers/93c96362-cc02-493d-a96b-ca19cf3a4e47 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:59:09.774181 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-37a20e52-6601-4459-bbdb-12fe7eb0d56b tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:09.775218 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-37a20e52-6601-4459-bbdb-12fe7eb0d56b tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 123a4464-d077-4253-9d13-38f63f70fc43] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:09.789526 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-37a20e52-6601-4459-bbdb-12fe7eb0d56b tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:09.790762 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-37a20e52-6601-4459-bbdb-12fe7eb0d56b tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:09.791676 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-37a20e52-6601-4459-bbdb-12fe7eb0d56b tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:09.792857 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-37a20e52-6601-4459-bbdb-12fe7eb0d56b tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:09.793392 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-37a20e52-6601-4459-bbdb-12fe7eb0d56b tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:09.793904 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-37a20e52-6601-4459-bbdb-12fe7eb0d56b tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:09.890969 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-37a20e52-6601-4459-bbdb-12fe7eb0d56b tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 123a4464-d077-4253-9d13-38f63f70fc43] Going to try to terminate instance {{(pid=134052) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:59:10.090045 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-1a763612-91ed-483e-bace-fb79679e92b3 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:10.091594 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-1a763612-91ed-483e-bace-fb79679e92b3 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] [instance: b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:10.102038 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-37a20e52-6601-4459-bbdb-12fe7eb0d56b tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "DELETE /compute/v2.1/servers/123a4464-d077-4253-9d13-38f63f70fc43" status: 204 len: 0 microversion: 2.1 time: 0.330216 Aug 27 02:59:10.103290 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1a763612-91ed-483e-bace-fb79679e92b3 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:10.105697 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1a763612-91ed-483e-bace-fb79679e92b3 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:10.106823 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1a763612-91ed-483e-bace-fb79679e92b3 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:10.107859 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1891/3798] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:59:09 2022] DELETE /compute/v2.1/servers/123a4464-d077-4253-9d13-38f63f70fc43 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:59:10.110579 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1a763612-91ed-483e-bace-fb79679e92b3 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:10.114621 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1a763612-91ed-483e-bace-fb79679e92b3 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:10.115387 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1a763612-91ed-483e-bace-fb79679e92b3 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:10.123523 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-1ad09b79-6f5d-4747-92b1-980b0221bb78 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:10.126522 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-1ad09b79-6f5d-4747-92b1-980b0221bb78 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 123a4464-d077-4253-9d13-38f63f70fc43] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:10.146107 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1ad09b79-6f5d-4747-92b1-980b0221bb78 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:10.147923 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1ad09b79-6f5d-4747-92b1-980b0221bb78 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:10.149959 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1ad09b79-6f5d-4747-92b1-980b0221bb78 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:10.151880 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1ad09b79-6f5d-4747-92b1-980b0221bb78 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:10.152656 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1ad09b79-6f5d-4747-92b1-980b0221bb78 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:10.153094 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1ad09b79-6f5d-4747-92b1-980b0221bb78 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:11.055689 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-1ad09b79-6f5d-4747-92b1-980b0221bb78 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:11.065370 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-1ad09b79-6f5d-4747-92b1-980b0221bb78 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/123a4464-d077-4253-9d13-38f63f70fc43" status: 200 len: 1466 microversion: 2.1 time: 0.955651 Aug 27 02:59:11.070955 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1892/3799] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:59:10 2022] GET /compute/v2.1/servers/123a4464-d077-4253-9d13-38f63f70fc43 => generated 1466 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:59:11.087602 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c2a29a4b-c468-49cf-8862-d764e513ab3d tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:11.088227 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-c2a29a4b-c468-49cf-8862-d764e513ab3d tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] [instance: d9aca1b6-0002-43b1-acc4-e110530eac17] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:11.097227 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c2a29a4b-c468-49cf-8862-d764e513ab3d tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:11.097720 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c2a29a4b-c468-49cf-8862-d764e513ab3d tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:11.098159 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c2a29a4b-c468-49cf-8862-d764e513ab3d tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:11.098875 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c2a29a4b-c468-49cf-8862-d764e513ab3d tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:11.099325 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c2a29a4b-c468-49cf-8862-d764e513ab3d tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:11.100683 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c2a29a4b-c468-49cf-8862-d764e513ab3d tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:11.480939 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-1a763612-91ed-483e-bace-fb79679e92b3 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:11.491186 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:59:11.499579 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-1a763612-91ed-483e-bace-fb79679e92b3 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:11.503087 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-1a763612-91ed-483e-bace-fb79679e92b3 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:11.525104 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-1a763612-91ed-483e-bace-fb79679e92b3 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] 10.222.0.70 "GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7" status: 200 len: 2591 microversion: 2.32 time: 1.440266 Aug 27 02:59:11.529040 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1908/3800] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:59:10 2022] GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 => generated 2591 bytes in 1445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:59:11.539174 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-1c232b1c-e6e4-4a90-9d2b-5cd83a505f36 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1385758676", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "73c04f6e-5590-41d2-bc5e-2c1c2572a4c3"}], "security_groups": [{"name": "tempest-securitygroup--421115509"}], "key_name": "tempest-keypair-1655999747", "user_data": "}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:59:11.916174 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-c2a29a4b-c468-49cf-8862-d764e513ab3d tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '077ffba093574e27bdfb4d9a51910a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47faacfcd434bf08187aad0ab70e5d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:11.934463 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c2a29a4b-c468-49cf-8862-d764e513ab3d tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] 10.222.0.70 "GET /compute/v2.1/servers/d9aca1b6-0002-43b1-acc4-e110530eac17" status: 200 len: 1312 microversion: 2.1 time: 0.850584 Aug 27 02:59:11.949646 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1893/3801] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:59:11 2022] GET /compute/v2.1/servers/d9aca1b6-0002-43b1-acc4-e110530eac17 => generated 1312 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:59:11.961383 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-9558072a-eb59-4c20-8f32-b35b1d42abb3 req-dca8da36-13b7-4c0d-b5fd-b8bd551f4b8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93c96362-cc02-493d-a96b-ca19cf3a4e47", "name": "network-vif-deleted", "tag": "89392832-a58f-4596-ba39-a4d42c287569"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:59:11.975108 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.network.neutron [None req-1c232b1c-e6e4-4a90-9d2b-5cd83a505f36 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] validate_networks() for [('73c04f6e-5590-41d2-bc5e-2c1c2572a4c3', None, None, None, None, None)] {{(pid=134051) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:59:12.002348 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-9558072a-eb59-4c20-8f32-b35b1d42abb3 req-dca8da36-13b7-4c0d-b5fd-b8bd551f4b8c service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:12.003370 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-9558072a-eb59-4c20-8f32-b35b1d42abb3 req-dca8da36-13b7-4c0d-b5fd-b8bd551f4b8c service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:12.003805 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-9558072a-eb59-4c20-8f32-b35b1d42abb3 req-dca8da36-13b7-4c0d-b5fd-b8bd551f4b8c service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:12.036442 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.compute.server_external_events [req-9558072a-eb59-4c20-8f32-b35b1d42abb3 req-dca8da36-13b7-4c0d-b5fd-b8bd551f4b8c service nova] Unable to find a host for instance 93c96362-cc02-493d-a96b-ca19cf3a4e47. Dropping event network-vif-deleted {{(pid=134052) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 27 02:59:12.037396 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-9558072a-eb59-4c20-8f32-b35b1d42abb3 req-dca8da36-13b7-4c0d-b5fd-b8bd551f4b8c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.085980 Aug 27 02:59:12.038805 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1894/3802] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:59:11 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 88 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 27 02:59:12.094423 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a868e015-1ee4-44b5-8123-257f0bc16756 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:12.095221 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a868e015-1ee4-44b5-8123-257f0bc16756 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 123a4464-d077-4253-9d13-38f63f70fc43] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:12.109583 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a868e015-1ee4-44b5-8123-257f0bc16756 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:12.110185 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a868e015-1ee4-44b5-8123-257f0bc16756 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:12.110722 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a868e015-1ee4-44b5-8123-257f0bc16756 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:12.111519 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a868e015-1ee4-44b5-8123-257f0bc16756 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:12.112060 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a868e015-1ee4-44b5-8123-257f0bc16756 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:12.112756 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a868e015-1ee4-44b5-8123-257f0bc16756 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:12.408476 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-a868e015-1ee4-44b5-8123-257f0bc16756 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:12.422625 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a868e015-1ee4-44b5-8123-257f0bc16756 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/123a4464-d077-4253-9d13-38f63f70fc43" status: 200 len: 1466 microversion: 2.1 time: 0.334658 Aug 27 02:59:12.423425 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1895/3803] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:59:12 2022] GET /compute/v2.1/servers/123a4464-d077-4253-9d13-38f63f70fc43 => generated 1466 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:59:12.558523 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6c964192-0ceb-4205-8b06-28e37c6150bb tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:12.559555 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-6c964192-0ceb-4205-8b06-28e37c6150bb tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] [instance: b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:12.566536 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6c964192-0ceb-4205-8b06-28e37c6150bb tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:12.567019 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6c964192-0ceb-4205-8b06-28e37c6150bb tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:12.567458 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6c964192-0ceb-4205-8b06-28e37c6150bb tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:12.573174 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6c964192-0ceb-4205-8b06-28e37c6150bb tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:12.579648 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6c964192-0ceb-4205-8b06-28e37c6150bb tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:12.580506 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6c964192-0ceb-4205-8b06-28e37c6150bb tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:13.472259 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-6c964192-0ceb-4205-8b06-28e37c6150bb tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:13.485605 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-6c964192-0ceb-4205-8b06-28e37c6150bb tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:13.490391 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-6c964192-0ceb-4205-8b06-28e37c6150bb tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:13.495252 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-6c964192-0ceb-4205-8b06-28e37c6150bb tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] 10.222.0.70 "GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7" status: 200 len: 2544 microversion: 2.32 time: 0.939745 Aug 27 02:59:13.498044 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1896/3804] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:59:12 2022] GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 => generated 2544 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:59:13.503830 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4d51e90b-599d-4862-92d7-2afaf0db4839 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:13.506211 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-4d51e90b-599d-4862-92d7-2afaf0db4839 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] [instance: d9aca1b6-0002-43b1-acc4-e110530eac17] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:13.516245 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4d51e90b-599d-4862-92d7-2afaf0db4839 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:13.517259 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4d51e90b-599d-4862-92d7-2afaf0db4839 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:13.517902 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4d51e90b-599d-4862-92d7-2afaf0db4839 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:13.522457 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4d51e90b-599d-4862-92d7-2afaf0db4839 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:13.526010 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4d51e90b-599d-4862-92d7-2afaf0db4839 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:13.530401 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4d51e90b-599d-4862-92d7-2afaf0db4839 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:13.946070 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-4d51e90b-599d-4862-92d7-2afaf0db4839 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '077ffba093574e27bdfb4d9a51910a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47faacfcd434bf08187aad0ab70e5d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:13.957047 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-4d51e90b-599d-4862-92d7-2afaf0db4839 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] 10.222.0.70 "GET /compute/v2.1/servers/d9aca1b6-0002-43b1-acc4-e110530eac17" status: 200 len: 1312 microversion: 2.1 time: 0.457430 Aug 27 02:59:13.958134 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1897/3805] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:59:13 2022] GET /compute/v2.1/servers/d9aca1b6-0002-43b1-acc4-e110530eac17 => generated 1312 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:59:13.978468 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-b108e881-8f00-4b99-84e1-181d7bb3fa31 req-941263c4-a49c-4f42-b45c-3b4f806f56ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "123a4464-d077-4253-9d13-38f63f70fc43", "name": "network-vif-deleted", "tag": "611d60d4-10eb-4ef5-a705-cd3852a652a8"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:59:14.004679 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-b108e881-8f00-4b99-84e1-181d7bb3fa31 req-941263c4-a49c-4f42-b45c-3b4f806f56ff service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:14.005569 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-b108e881-8f00-4b99-84e1-181d7bb3fa31 req-941263c4-a49c-4f42-b45c-3b4f806f56ff service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:14.005987 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-b108e881-8f00-4b99-84e1-181d7bb3fa31 req-941263c4-a49c-4f42-b45c-3b4f806f56ff service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:14.048857 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-b108e881-8f00-4b99-84e1-181d7bb3fa31 req-941263c4-a49c-4f42-b45c-3b4f806f56ff service nova] Creating event network-vif-deleted:611d60d4-10eb-4ef5-a705-cd3852a652a8 for instance 123a4464-d077-4253-9d13-38f63f70fc43 on n-h1-852278-4 Aug 27 02:59:14.057743 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-b108e881-8f00-4b99-84e1-181d7bb3fa31 req-941263c4-a49c-4f42-b45c-3b4f806f56ff service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083680 Aug 27 02:59:14.058757 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1898/3806] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:59:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:59:14.073844 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-106f0b70-5b52-4995-a10c-d3c83e300ab6 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:14.075380 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-106f0b70-5b52-4995-a10c-d3c83e300ab6 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 123a4464-d077-4253-9d13-38f63f70fc43] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:14.099061 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-106f0b70-5b52-4995-a10c-d3c83e300ab6 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:14.104328 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-106f0b70-5b52-4995-a10c-d3c83e300ab6 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:14.106801 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-106f0b70-5b52-4995-a10c-d3c83e300ab6 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:14.108296 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-106f0b70-5b52-4995-a10c-d3c83e300ab6 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:14.110296 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-106f0b70-5b52-4995-a10c-d3c83e300ab6 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:14.110901 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-106f0b70-5b52-4995-a10c-d3c83e300ab6 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:14.114942 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-1c232b1c-e6e4-4a90-9d2b-5cd83a505f36 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Flavor limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:59:14.115584 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-1c232b1c-e6e4-4a90-9d2b-5cd83a505f36 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Image limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:59:14.115886 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-1c232b1c-e6e4-4a90-9d2b-5cd83a505f36 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Flavor pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:59:14.116290 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-1c232b1c-e6e4-4a90-9d2b-5cd83a505f36 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Image pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:59:14.117186 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-1c232b1c-e6e4-4a90-9d2b-5cd83a505f36 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:59:14.130048 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1c232b1c-e6e4-4a90-9d2b-5cd83a505f36 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:14.138369 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1c232b1c-e6e4-4a90-9d2b-5cd83a505f36 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:14.143028 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1c232b1c-e6e4-4a90-9d2b-5cd83a505f36 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:14.145007 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1c232b1c-e6e4-4a90-9d2b-5cd83a505f36 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:14.145679 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1c232b1c-e6e4-4a90-9d2b-5cd83a505f36 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:14.147692 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1c232b1c-e6e4-4a90-9d2b-5cd83a505f36 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:14.148955 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-106f0b70-5b52-4995-a10c-d3c83e300ab6 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] HTTP exception thrown: Instance 123a4464-d077-4253-9d13-38f63f70fc43 could not be found. Aug 27 02:59:14.151048 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-106f0b70-5b52-4995-a10c-d3c83e300ab6 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Request method failure captured: Aug 27 02:59:14.151048 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/servers/123a4464-d077-4253-9d13-38f63f70fc43 HTTP/1.1 Aug 27 02:59:14.151048 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:59:14.151048 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:59:14.151048 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:59:14.151048 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:59:14.151048 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:59:14.151048 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:59:14.151048 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:59:14.151048 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:59:14.151048 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYZ4Z8i7XrQCoJ8R1xQrljLXT0Y1KKkpWSlhl8nQzR0Gffp8SuHSAmEqH2wTow_HYUPfKDsH80AYAaprEdUsqUlgb1Dqa2tgrmc5xbHE8YE53Hq_xfoTBUsq6qNfDu_s_oKqI9wgNRhJDAuY_9xSuITf0Dzo8xZBUzkyCrp-xMPec0c Aug 27 02:59:14.151048 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:59:14.151048 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:59:14.151048 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:59:14.151048 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:59:14.151048 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:59:14.151048 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:59:14.151048 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 952767db5f394fc4bf01c0efd65f2fb9 Aug 27 02:59:14.151048 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ServerActionsTestJSON-1132885212 Aug 27 02:59:14.151048 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:59:14.151048 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:59:14.151048 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/952767db5f394fc4bf01c0efd65f2fb9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_952767db5f394fc4bf01c0efd65f2fb9", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/952767db5f394fc4bf01c0efd65f2fb9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/952767db5f394fc4bf01c0efd65f2fb9"}]}] Aug 27 02:59:14.151048 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ServerActionsTestJSON-1132885212 Aug 27 02:59:14.151048 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 952767db5f394fc4bf01c0efd65f2fb9 Aug 27 02:59:14.151048 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ServerActionsTestJSON-1132885212 Aug 27 02:59:14.151048 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ServerActionsTestJSON-1132885212-project Aug 27 02:59:14.151048 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:59:14.151048 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:59:14.151048 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: c850bda78e664117b671910c0e68bfb9 Aug 27 02:59:14.151048 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ServerActionsTestJSON-1132885212-project Aug 27 02:59:14.151048 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 02:59:14.151048 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance 123a4464-d077-4253-9d13-38f63f70fc43 could not be found. Aug 27 02:59:14.151048 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '123a4464-d077-4253-9d13-38f63f70fc43'} Aug 27 02:59:14.151048 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:59:14.151048 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:59:14.151048 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:59:14.151048 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:59:14.151048 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:59:14.151048 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:59:14.151048 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:59:14.151048 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:59:14.151048 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:59:14.151048 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:59:14.151048 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 123a4464-d077-4253-9d13-38f63f70fc43 could not be found. Aug 27 02:59:14.151048 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:59:14.151048 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:59:14.151048 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:59:14.151048 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:59:14.151048 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:59:14.151048 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:59:14.151048 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:59:14.151048 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:59:14.151048 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:59:14.151048 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:59:14.151048 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:59:14.151048 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:59:14.151048 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:59:14.151048 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:59:14.151048 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:59:14.151048 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:59:14.151048 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 123a4464-d077-4253-9d13-38f63f70fc43 could not be found. Aug 27 02:59:14.151048 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:59:14.151048 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:59:14.151048 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:59:14.155417 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:59:14.155417 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:59:14.155417 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:59:14.155417 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:59:14.155417 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:59:14.155417 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 123a4464-d077-4253-9d13-38f63f70fc43 could not be found. Aug 27 02:59:14.155417 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:59:14.155417 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-106f0b70-5b52-4995-a10c-d3c83e300ab6 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Returning 404 to user: Instance 123a4464-d077-4253-9d13-38f63f70fc43 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:59:14.155417 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-106f0b70-5b52-4995-a10c-d3c83e300ab6 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/123a4464-d077-4253-9d13-38f63f70fc43" status: 404 len: 111 microversion: 2.1 time: 0.091666 Aug 27 02:59:14.155417 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1899/3807] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:59:14 2022] GET /compute/v2.1/servers/123a4464-d077-4253-9d13-38f63f70fc43 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:59:14.159127 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-17e28866-b2c1-429c-9bf9-1f6a4f7066e1 req-e67cf2b3-e50a-4ef4-9b7b-4c3fd56e4028 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7", "name": "network-vif-deleted", "tag": "08d8ee97-a66d-4a1f-8b10-8785838e3d14"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:59:14.169509 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-17e28866-b2c1-429c-9bf9-1f6a4f7066e1 req-e67cf2b3-e50a-4ef4-9b7b-4c3fd56e4028 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:14.169994 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-17e28866-b2c1-429c-9bf9-1f6a4f7066e1 req-e67cf2b3-e50a-4ef4-9b7b-4c3fd56e4028 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:14.170424 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-17e28866-b2c1-429c-9bf9-1f6a4f7066e1 req-e67cf2b3-e50a-4ef4-9b7b-4c3fd56e4028 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:14.183672 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-17e28866-b2c1-429c-9bf9-1f6a4f7066e1 req-e67cf2b3-e50a-4ef4-9b7b-4c3fd56e4028 service nova] Creating event network-vif-deleted:08d8ee97-a66d-4a1f-8b10-8785838e3d14 for instance b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 on n-h2-852278-4 Aug 27 02:59:14.189126 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-17e28866-b2c1-429c-9bf9-1f6a4f7066e1 req-e67cf2b3-e50a-4ef4-9b7b-4c3fd56e4028 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034451 Aug 27 02:59:14.190309 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1900/3808] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:59:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:59:14.196970 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-83c1eb52-9685-4585-805e-7873e7bda2c2 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:14.197801 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-83c1eb52-9685-4585-805e-7873e7bda2c2 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 2d6bf535-89e0-4c21-b2cf-fafcf18c4f18] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:14.215023 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-1c232b1c-e6e4-4a90-9d2b-5cd83a505f36 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Getting quotas for project c41649f09cbf410a9825100c498b4916. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:59:14.221024 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-83c1eb52-9685-4585-805e-7873e7bda2c2 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:14.221529 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-83c1eb52-9685-4585-805e-7873e7bda2c2 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:14.221982 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-83c1eb52-9685-4585-805e-7873e7bda2c2 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:14.222789 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-83c1eb52-9685-4585-805e-7873e7bda2c2 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:14.223240 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-83c1eb52-9685-4585-805e-7873e7bda2c2 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:14.223662 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-83c1eb52-9685-4585-805e-7873e7bda2c2 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:14.238316 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-1c232b1c-e6e4-4a90-9d2b-5cd83a505f36 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Getting quotas for user 0fe0328160c6472086d13907344756cb and project c41649f09cbf410a9825100c498b4916. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:59:14.276431 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-1c232b1c-e6e4-4a90-9d2b-5cd83a505f36 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Going to run 1 instances... {{(pid=134051) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:59:14.279254 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-1c232b1c-e6e4-4a90-9d2b-5cd83a505f36 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] [instance: 9d9f666f-0b19-4d87-a94a-770b5d99f349] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134051) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:59:14.307267 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-83c1eb52-9685-4585-805e-7873e7bda2c2 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 2d6bf535-89e0-4c21-b2cf-fafcf18c4f18] Going to try to terminate instance {{(pid=134052) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:59:14.412450 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-1c232b1c-e6e4-4a90-9d2b-5cd83a505f36 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.877573 Aug 27 02:59:14.422224 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1909/3809] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 02:59:11 2022] POST /compute/v2.1/servers => generated 401 bytes in 2888 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:59:14.433639 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-6ce28c59-30e9-467b-9303-e1dc69d7c941 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:14.436899 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-6ce28c59-30e9-467b-9303-e1dc69d7c941 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] [instance: 9d9f666f-0b19-4d87-a94a-770b5d99f349] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:14.530520 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-83c1eb52-9685-4585-805e-7873e7bda2c2 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "DELETE /compute/v2.1/servers/2d6bf535-89e0-4c21-b2cf-fafcf18c4f18" status: 204 len: 0 microversion: 2.1 time: 0.334949 Aug 27 02:59:14.531266 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1901/3810] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:59:14 2022] DELETE /compute/v2.1/servers/2d6bf535-89e0-4c21-b2cf-fafcf18c4f18 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:59:14.549629 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3657d48e-a42b-4360-9c5e-e123f248f0f5 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:14.551199 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-3657d48e-a42b-4360-9c5e-e123f248f0f5 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] [instance: b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:14.559365 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3657d48e-a42b-4360-9c5e-e123f248f0f5 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:14.560118 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3657d48e-a42b-4360-9c5e-e123f248f0f5 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:14.560750 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3657d48e-a42b-4360-9c5e-e123f248f0f5 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:14.561619 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3657d48e-a42b-4360-9c5e-e123f248f0f5 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:14.562207 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3657d48e-a42b-4360-9c5e-e123f248f0f5 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:14.562784 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3657d48e-a42b-4360-9c5e-e123f248f0f5 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:14.665530 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-6ce28c59-30e9-467b-9303-e1dc69d7c941 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe0328160c6472086d13907344756cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41649f09cbf410a9825100c498b4916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:14.686094 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-6ce28c59-30e9-467b-9303-e1dc69d7c941 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] 10.222.0.70 "GET /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349" status: 200 len: 1238 microversion: 2.1 time: 0.255330 Aug 27 02:59:14.694135 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1910/3811] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:59:14 2022] GET /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349 => generated 1238 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:59:14.707147 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-edbb22ae-8a20-4199-8d53-374f885d0664 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:14.707147 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-edbb22ae-8a20-4199-8d53-374f885d0664 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 2d6bf535-89e0-4c21-b2cf-fafcf18c4f18] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:14.719150 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-edbb22ae-8a20-4199-8d53-374f885d0664 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:14.719662 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-edbb22ae-8a20-4199-8d53-374f885d0664 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:14.720154 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-edbb22ae-8a20-4199-8d53-374f885d0664 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:14.721916 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-edbb22ae-8a20-4199-8d53-374f885d0664 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:14.723647 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-edbb22ae-8a20-4199-8d53-374f885d0664 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:14.725692 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-edbb22ae-8a20-4199-8d53-374f885d0664 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:15.422849 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-3657d48e-a42b-4360-9c5e-e123f248f0f5 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:15.426313 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=15,nova_cell1:DELETE=2,nova_cell1:INSERT=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:59:15.451434 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-3657d48e-a42b-4360-9c5e-e123f248f0f5 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:15.460327 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-3657d48e-a42b-4360-9c5e-e123f248f0f5 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:15.464586 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-3657d48e-a42b-4360-9c5e-e123f248f0f5 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] 10.222.0.70 "GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7" status: 200 len: 2383 microversion: 2.32 time: 0.923473 Aug 27 02:59:15.466763 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1902/3812] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:59:14 2022] GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 => generated 2383 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:59:15.475218 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-80cb7a33-eaaa-45f0-9f1d-b0479597ebdd tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:15.480249 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-80cb7a33-eaaa-45f0-9f1d-b0479597ebdd tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] [instance: d9aca1b6-0002-43b1-acc4-e110530eac17] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:15.509361 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-80cb7a33-eaaa-45f0-9f1d-b0479597ebdd tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:15.512440 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-80cb7a33-eaaa-45f0-9f1d-b0479597ebdd tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:15.513131 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-80cb7a33-eaaa-45f0-9f1d-b0479597ebdd tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:15.514044 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-80cb7a33-eaaa-45f0-9f1d-b0479597ebdd tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:15.515126 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-80cb7a33-eaaa-45f0-9f1d-b0479597ebdd tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:15.516727 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-80cb7a33-eaaa-45f0-9f1d-b0479597ebdd tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:15.673445 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-edbb22ae-8a20-4199-8d53-374f885d0664 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:15.690175 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-edbb22ae-8a20-4199-8d53-374f885d0664 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/2d6bf535-89e0-4c21-b2cf-fafcf18c4f18" status: 200 len: 1508 microversion: 2.1 time: 0.994759 Aug 27 02:59:15.693772 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1911/3813] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:59:14 2022] GET /compute/v2.1/servers/2d6bf535-89e0-4c21-b2cf-fafcf18c4f18 => generated 1508 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:59:15.715796 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8e43897e-9198-484e-ab6b-68bba797a4a9 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:15.716641 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-8e43897e-9198-484e-ab6b-68bba797a4a9 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] [instance: 9d9f666f-0b19-4d87-a94a-770b5d99f349] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:15.727217 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8e43897e-9198-484e-ab6b-68bba797a4a9 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:15.732847 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8e43897e-9198-484e-ab6b-68bba797a4a9 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:15.732847 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8e43897e-9198-484e-ab6b-68bba797a4a9 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:15.735636 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8e43897e-9198-484e-ab6b-68bba797a4a9 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:15.736125 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8e43897e-9198-484e-ab6b-68bba797a4a9 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:15.738053 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8e43897e-9198-484e-ab6b-68bba797a4a9 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:17.157877 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-8e43897e-9198-484e-ab6b-68bba797a4a9 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe0328160c6472086d13907344756cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41649f09cbf410a9825100c498b4916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:17.171878 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-8e43897e-9198-484e-ab6b-68bba797a4a9 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] 10.222.0.70 "GET /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349" status: 200 len: 1234 microversion: 2.1 time: 1.461309 Aug 27 02:59:17.182828 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1912/3814] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:59:15 2022] GET /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349 => generated 1234 bytes in 1473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:59:17.198453 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-86a7c6ed-7330-48ef-bc1d-63340c623607 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:17.202127 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-86a7c6ed-7330-48ef-bc1d-63340c623607 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] [instance: b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:17.215207 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-86a7c6ed-7330-48ef-bc1d-63340c623607 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:17.217787 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-86a7c6ed-7330-48ef-bc1d-63340c623607 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:17.219474 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-86a7c6ed-7330-48ef-bc1d-63340c623607 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:17.225280 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-86a7c6ed-7330-48ef-bc1d-63340c623607 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:17.226214 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-86a7c6ed-7330-48ef-bc1d-63340c623607 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:17.227815 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-86a7c6ed-7330-48ef-bc1d-63340c623607 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:17.933989 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-80cb7a33-eaaa-45f0-9f1d-b0479597ebdd tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '077ffba093574e27bdfb4d9a51910a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47faacfcd434bf08187aad0ab70e5d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:17.950092 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-80cb7a33-eaaa-45f0-9f1d-b0479597ebdd tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] 10.222.0.70 "GET /compute/v2.1/servers/d9aca1b6-0002-43b1-acc4-e110530eac17" status: 200 len: 1312 microversion: 2.1 time: 2.478834 Aug 27 02:59:17.950412 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1903/3815] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:59:15 2022] GET /compute/v2.1/servers/d9aca1b6-0002-43b1-acc4-e110530eac17 => generated 1312 bytes in 2483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:59:17.969716 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d8c7a65d-9b4d-4a3c-a5a3-c7659a912186 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:17.970562 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d8c7a65d-9b4d-4a3c-a5a3-c7659a912186 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 2d6bf535-89e0-4c21-b2cf-fafcf18c4f18] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:17.978645 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d8c7a65d-9b4d-4a3c-a5a3-c7659a912186 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:17.979638 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d8c7a65d-9b4d-4a3c-a5a3-c7659a912186 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:17.980232 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d8c7a65d-9b4d-4a3c-a5a3-c7659a912186 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:17.981148 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d8c7a65d-9b4d-4a3c-a5a3-c7659a912186 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:17.981760 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d8c7a65d-9b4d-4a3c-a5a3-c7659a912186 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:17.982610 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d8c7a65d-9b4d-4a3c-a5a3-c7659a912186 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:18.351220 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-86a7c6ed-7330-48ef-bc1d-63340c623607 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:18.387380 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-86a7c6ed-7330-48ef-bc1d-63340c623607 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:18.392849 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-86a7c6ed-7330-48ef-bc1d-63340c623607 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:18.397418 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-86a7c6ed-7330-48ef-bc1d-63340c623607 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] 10.222.0.70 "GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7" status: 200 len: 2383 microversion: 2.32 time: 1.212205 Aug 27 02:59:18.400339 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1913/3816] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:59:17 2022] GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 => generated 2383 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:59:18.416207 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-58dd9fd2-cf3c-4a17-b5c4-6caa29fa09af req-7526148d-eb0b-47ba-890a-db0095c3b23d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7", "name": "network-vif-deleted", "tag": "8524810a-aaa6-4efe-ac59-2515339a1681"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:59:18.450745 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-58dd9fd2-cf3c-4a17-b5c4-6caa29fa09af req-7526148d-eb0b-47ba-890a-db0095c3b23d service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:18.453229 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-58dd9fd2-cf3c-4a17-b5c4-6caa29fa09af req-7526148d-eb0b-47ba-890a-db0095c3b23d service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:18.454050 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-58dd9fd2-cf3c-4a17-b5c4-6caa29fa09af req-7526148d-eb0b-47ba-890a-db0095c3b23d service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:18.505838 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-58dd9fd2-cf3c-4a17-b5c4-6caa29fa09af req-7526148d-eb0b-47ba-890a-db0095c3b23d service nova] Creating event network-vif-deleted:8524810a-aaa6-4efe-ac59-2515339a1681 for instance b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 on n-h2-852278-4 Aug 27 02:59:18.523485 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-58dd9fd2-cf3c-4a17-b5c4-6caa29fa09af req-7526148d-eb0b-47ba-890a-db0095c3b23d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119395 Aug 27 02:59:18.526449 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1914/3817] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:59:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:59:18.551842 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-868dca52-f13f-4862-8f34-6e663641d6c7 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:18.558850 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-868dca52-f13f-4862-8f34-6e663641d6c7 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] [instance: 9d9f666f-0b19-4d87-a94a-770b5d99f349] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:18.580801 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-868dca52-f13f-4862-8f34-6e663641d6c7 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:18.583508 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-868dca52-f13f-4862-8f34-6e663641d6c7 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:18.585345 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-868dca52-f13f-4862-8f34-6e663641d6c7 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:18.591655 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-868dca52-f13f-4862-8f34-6e663641d6c7 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:18.598426 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-868dca52-f13f-4862-8f34-6e663641d6c7 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:18.599192 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-868dca52-f13f-4862-8f34-6e663641d6c7 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:18.873627 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-d8c7a65d-9b4d-4a3c-a5a3-c7659a912186 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:18.884396 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d8c7a65d-9b4d-4a3c-a5a3-c7659a912186 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/2d6bf535-89e0-4c21-b2cf-fafcf18c4f18" status: 200 len: 1508 microversion: 2.1 time: 0.919620 Aug 27 02:59:18.885500 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1904/3818] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:59:17 2022] GET /compute/v2.1/servers/2d6bf535-89e0-4c21-b2cf-fafcf18c4f18 => generated 1508 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:59:18.939348 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-868dca52-f13f-4862-8f34-6e663641d6c7 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe0328160c6472086d13907344756cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41649f09cbf410a9825100c498b4916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:18.951112 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-868dca52-f13f-4862-8f34-6e663641d6c7 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] 10.222.0.70 "GET /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349" status: 200 len: 1296 microversion: 2.1 time: 0.417581 Aug 27 02:59:18.951718 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1915/3819] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:59:18 2022] GET /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349 => generated 1296 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:59:18.975935 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-1eba8680-5304-4b7c-a813-f2b754fab824 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:18.976584 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-1eba8680-5304-4b7c-a813-f2b754fab824 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] [instance: d9aca1b6-0002-43b1-acc4-e110530eac17] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:18.995173 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1eba8680-5304-4b7c-a813-f2b754fab824 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:18.995686 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1eba8680-5304-4b7c-a813-f2b754fab824 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:18.996129 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1eba8680-5304-4b7c-a813-f2b754fab824 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:18.996875 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1eba8680-5304-4b7c-a813-f2b754fab824 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:18.997327 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1eba8680-5304-4b7c-a813-f2b754fab824 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:18.997749 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1eba8680-5304-4b7c-a813-f2b754fab824 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:19.429345 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-dea66846-1433-4ab8-962b-85221d38ac83 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:19.430650 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-dea66846-1433-4ab8-962b-85221d38ac83 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] [instance: b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:19.451168 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dea66846-1433-4ab8-962b-85221d38ac83 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:19.451728 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dea66846-1433-4ab8-962b-85221d38ac83 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:19.452188 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dea66846-1433-4ab8-962b-85221d38ac83 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:19.461322 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dea66846-1433-4ab8-962b-85221d38ac83 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:19.462229 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dea66846-1433-4ab8-962b-85221d38ac83 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:19.466999 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dea66846-1433-4ab8-962b-85221d38ac83 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:19.533080 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:59:19.658100 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-1eba8680-5304-4b7c-a813-f2b754fab824 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '077ffba093574e27bdfb4d9a51910a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47faacfcd434bf08187aad0ab70e5d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:19.672525 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-1eba8680-5304-4b7c-a813-f2b754fab824 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] 10.222.0.70 "GET /compute/v2.1/servers/d9aca1b6-0002-43b1-acc4-e110530eac17" status: 200 len: 1312 microversion: 2.1 time: 0.700252 Aug 27 02:59:19.673799 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1905/3820] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:59:18 2022] GET /compute/v2.1/servers/d9aca1b6-0002-43b1-acc4-e110530eac17 => generated 1312 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:59:19.908671 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a14bfcd1-9c4b-484c-bd6f-68a27183d056 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:19.909546 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a14bfcd1-9c4b-484c-bd6f-68a27183d056 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 2d6bf535-89e0-4c21-b2cf-fafcf18c4f18] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:19.925468 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a14bfcd1-9c4b-484c-bd6f-68a27183d056 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:19.925982 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a14bfcd1-9c4b-484c-bd6f-68a27183d056 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:19.931583 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a14bfcd1-9c4b-484c-bd6f-68a27183d056 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:19.933742 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a14bfcd1-9c4b-484c-bd6f-68a27183d056 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:19.937176 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a14bfcd1-9c4b-484c-bd6f-68a27183d056 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:19.937838 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a14bfcd1-9c4b-484c-bd6f-68a27183d056 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:20.254662 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-a14bfcd1-9c4b-484c-bd6f-68a27183d056 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:20.265356 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a14bfcd1-9c4b-484c-bd6f-68a27183d056 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/2d6bf535-89e0-4c21-b2cf-fafcf18c4f18" status: 200 len: 1466 microversion: 2.1 time: 0.362896 Aug 27 02:59:20.266353 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1906/3821] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:59:19 2022] GET /compute/v2.1/servers/2d6bf535-89e0-4c21-b2cf-fafcf18c4f18 => generated 1466 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:59:20.273599 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ba225184-5f9d-4f74-8718-67312bf5d565 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:20.274501 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-ba225184-5f9d-4f74-8718-67312bf5d565 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] [instance: 9d9f666f-0b19-4d87-a94a-770b5d99f349] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:20.288407 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ba225184-5f9d-4f74-8718-67312bf5d565 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:20.288922 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ba225184-5f9d-4f74-8718-67312bf5d565 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:20.313227 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ba225184-5f9d-4f74-8718-67312bf5d565 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:20.314233 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ba225184-5f9d-4f74-8718-67312bf5d565 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:20.314726 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ba225184-5f9d-4f74-8718-67312bf5d565 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:20.315171 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ba225184-5f9d-4f74-8718-67312bf5d565 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:20.383970 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-dea66846-1433-4ab8-962b-85221d38ac83 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:20.394854 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-dea66846-1433-4ab8-962b-85221d38ac83 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:20.403090 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-dea66846-1433-4ab8-962b-85221d38ac83 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:20.407015 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-dea66846-1433-4ab8-962b-85221d38ac83 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] 10.222.0.70 "GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7" status: 200 len: 2098 microversion: 2.32 time: 0.982399 Aug 27 02:59:20.431511 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1916/3822] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:59:19 2022] GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 => generated 2098 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:59:20.624229 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-1529e64f-f57c-4443-99c2-0478a35336fa req-df8568af-efce-46b6-b2ed-714265e1b293 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9aca1b6-0002-43b1-acc4-e110530eac17", "tag": "9d8e2478-5181-4cd4-8ace-4d8db90a3726"}, {"server_uuid": "2d6bf535-89e0-4c21-b2cf-fafcf18c4f18", "name": "network-vif-deleted", "tag": "8a321f34-88af-436b-ac87-1009ae5c3dcd"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:59:20.652379 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-1529e64f-f57c-4443-99c2-0478a35336fa req-df8568af-efce-46b6-b2ed-714265e1b293 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:20.653871 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-1529e64f-f57c-4443-99c2-0478a35336fa req-df8568af-efce-46b6-b2ed-714265e1b293 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:20.654540 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-1529e64f-f57c-4443-99c2-0478a35336fa req-df8568af-efce-46b6-b2ed-714265e1b293 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:20.681878 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-1529e64f-f57c-4443-99c2-0478a35336fa req-df8568af-efce-46b6-b2ed-714265e1b293 service nova] Creating event network-changed:9d8e2478-5181-4cd4-8ace-4d8db90a3726 for instance d9aca1b6-0002-43b1-acc4-e110530eac17 on n-h2-852278-4 Aug 27 02:59:20.693264 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-1529e64f-f57c-4443-99c2-0478a35336fa req-df8568af-efce-46b6-b2ed-714265e1b293 service nova] Creating event network-vif-deleted:8a321f34-88af-436b-ac87-1009ae5c3dcd for instance 2d6bf535-89e0-4c21-b2cf-fafcf18c4f18 on n-h2-852278-4 Aug 27 02:59:20.722482 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-1529e64f-f57c-4443-99c2-0478a35336fa req-df8568af-efce-46b6-b2ed-714265e1b293 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.098314 Aug 27 02:59:20.723392 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1917/3823] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:59:20 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:59:20.730383 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-dc0fd717-7e5e-4c35-b63a-4ac5d341523b tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:20.745084 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-dc0fd717-7e5e-4c35-b63a-4ac5d341523b tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] [instance: d9aca1b6-0002-43b1-acc4-e110530eac17] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:20.766962 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dc0fd717-7e5e-4c35-b63a-4ac5d341523b tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:20.768818 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dc0fd717-7e5e-4c35-b63a-4ac5d341523b tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:20.770756 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dc0fd717-7e5e-4c35-b63a-4ac5d341523b tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:20.772536 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dc0fd717-7e5e-4c35-b63a-4ac5d341523b tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:20.776862 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dc0fd717-7e5e-4c35-b63a-4ac5d341523b tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:20.777598 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dc0fd717-7e5e-4c35-b63a-4ac5d341523b tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:20.878536 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-ba225184-5f9d-4f74-8718-67312bf5d565 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe0328160c6472086d13907344756cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41649f09cbf410a9825100c498b4916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:20.887911 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ba225184-5f9d-4f74-8718-67312bf5d565 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] 10.222.0.70 "GET /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349" status: 200 len: 1363 microversion: 2.1 time: 0.619775 Aug 27 02:59:20.889024 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1907/3824] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:59:20 2022] GET /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349 => generated 1363 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:59:21.119929 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-dc0fd717-7e5e-4c35-b63a-4ac5d341523b tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '077ffba093574e27bdfb4d9a51910a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47faacfcd434bf08187aad0ab70e5d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:21.130647 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-dc0fd717-7e5e-4c35-b63a-4ac5d341523b tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] 10.222.0.70 "GET /compute/v2.1/servers/d9aca1b6-0002-43b1-acc4-e110530eac17" status: 200 len: 1312 microversion: 2.1 time: 0.403961 Aug 27 02:59:21.132918 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1918/3825] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:59:20 2022] GET /compute/v2.1/servers/d9aca1b6-0002-43b1-acc4-e110530eac17 => generated 1312 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:59:21.286855 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-fa1ba616-2f47-4160-b51c-979e13d0202f req-986cbd64-e1a3-40ea-9299-fc72019ba577 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d9f666f-0b19-4d87-a94a-770b5d99f349", "tag": "b31e0e71-4066-4ac6-b1eb-63996f060976"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:59:21.290327 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0bec7a9a-38f4-436a-b46e-7f28e2c050d1 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:21.292644 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-0bec7a9a-38f4-436a-b46e-7f28e2c050d1 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 2d6bf535-89e0-4c21-b2cf-fafcf18c4f18] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:21.311282 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0bec7a9a-38f4-436a-b46e-7f28e2c050d1 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:21.314576 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0bec7a9a-38f4-436a-b46e-7f28e2c050d1 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:21.315028 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0bec7a9a-38f4-436a-b46e-7f28e2c050d1 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:21.315758 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0bec7a9a-38f4-436a-b46e-7f28e2c050d1 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:21.318120 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-fa1ba616-2f47-4160-b51c-979e13d0202f req-986cbd64-e1a3-40ea-9299-fc72019ba577 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:21.318657 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-fa1ba616-2f47-4160-b51c-979e13d0202f req-986cbd64-e1a3-40ea-9299-fc72019ba577 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:21.319086 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-fa1ba616-2f47-4160-b51c-979e13d0202f req-986cbd64-e1a3-40ea-9299-fc72019ba577 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:21.323356 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0bec7a9a-38f4-436a-b46e-7f28e2c050d1 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:21.323805 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0bec7a9a-38f4-436a-b46e-7f28e2c050d1 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:21.362755 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-fa1ba616-2f47-4160-b51c-979e13d0202f req-986cbd64-e1a3-40ea-9299-fc72019ba577 service nova] Creating event network-changed:b31e0e71-4066-4ac6-b1eb-63996f060976 for instance 9d9f666f-0b19-4d87-a94a-770b5d99f349 on n-h1-852278-4 Aug 27 02:59:21.383602 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-fa1ba616-2f47-4160-b51c-979e13d0202f req-986cbd64-e1a3-40ea-9299-fc72019ba577 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105214 Aug 27 02:59:21.385823 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1908/3826] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:59:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:59:21.409004 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0bec7a9a-38f4-436a-b46e-7f28e2c050d1 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:21.410947 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0bec7a9a-38f4-436a-b46e-7f28e2c050d1 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:21.411500 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0bec7a9a-38f4-436a-b46e-7f28e2c050d1 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:21.413293 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.objects.instance [None req-0bec7a9a-38f4-436a-b46e-7f28e2c050d1 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lazy-loading 'fault' on Instance uuid 2d6bf535-89e0-4c21-b2cf-fafcf18c4f18 {{(pid=134051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:59:21.443045 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d5d34a8d-cfef-4151-9cf1-cbe10eecdb41 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:21.444866 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d5d34a8d-cfef-4151-9cf1-cbe10eecdb41 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] [instance: b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:21.461474 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d5d34a8d-cfef-4151-9cf1-cbe10eecdb41 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:21.462953 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d5d34a8d-cfef-4151-9cf1-cbe10eecdb41 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:21.463981 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d5d34a8d-cfef-4151-9cf1-cbe10eecdb41 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:21.468205 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d5d34a8d-cfef-4151-9cf1-cbe10eecdb41 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:21.469102 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d5d34a8d-cfef-4151-9cf1-cbe10eecdb41 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:21.469671 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d5d34a8d-cfef-4151-9cf1-cbe10eecdb41 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:21.516794 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-0bec7a9a-38f4-436a-b46e-7f28e2c050d1 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:21.529523 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-0bec7a9a-38f4-436a-b46e-7f28e2c050d1 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/2d6bf535-89e0-4c21-b2cf-fafcf18c4f18" status: 200 len: 1304 microversion: 2.1 time: 0.243638 Aug 27 02:59:21.532518 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1919/3827] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:59:21 2022] GET /compute/v2.1/servers/2d6bf535-89e0-4c21-b2cf-fafcf18c4f18 => generated 1304 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:59:21.736017 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-d5d34a8d-cfef-4151-9cf1-cbe10eecdb41 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:21.762636 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-d5d34a8d-cfef-4151-9cf1-cbe10eecdb41 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:21.766539 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-d5d34a8d-cfef-4151-9cf1-cbe10eecdb41 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:21.770205 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d5d34a8d-cfef-4151-9cf1-cbe10eecdb41 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] 10.222.0.70 "GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7" status: 200 len: 1604 microversion: 2.32 time: 0.334764 Aug 27 02:59:21.772763 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1909/3828] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:59:21 2022] GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 => generated 1604 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:59:21.919356 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-39fc213b-2a1c-40b7-9d02-5d7dad6f21e0 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:21.920501 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-39fc213b-2a1c-40b7-9d02-5d7dad6f21e0 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] [instance: 9d9f666f-0b19-4d87-a94a-770b5d99f349] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:21.930730 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-39fc213b-2a1c-40b7-9d02-5d7dad6f21e0 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:21.931576 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-39fc213b-2a1c-40b7-9d02-5d7dad6f21e0 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:21.932411 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-39fc213b-2a1c-40b7-9d02-5d7dad6f21e0 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:21.933397 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-39fc213b-2a1c-40b7-9d02-5d7dad6f21e0 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:21.934031 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-39fc213b-2a1c-40b7-9d02-5d7dad6f21e0 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:21.934615 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-39fc213b-2a1c-40b7-9d02-5d7dad6f21e0 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:22.152481 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-1f4c82df-03f7-4ce4-a000-30fe3fc5ab1e tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:22.153146 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-1f4c82df-03f7-4ce4-a000-30fe3fc5ab1e tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] [instance: d9aca1b6-0002-43b1-acc4-e110530eac17] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:22.163770 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1f4c82df-03f7-4ce4-a000-30fe3fc5ab1e tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:22.163997 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1f4c82df-03f7-4ce4-a000-30fe3fc5ab1e tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:22.165920 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1f4c82df-03f7-4ce4-a000-30fe3fc5ab1e tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:22.169257 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1f4c82df-03f7-4ce4-a000-30fe3fc5ab1e tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:22.169868 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1f4c82df-03f7-4ce4-a000-30fe3fc5ab1e tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:22.173158 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1f4c82df-03f7-4ce4-a000-30fe3fc5ab1e tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:22.342035 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-39fc213b-2a1c-40b7-9d02-5d7dad6f21e0 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe0328160c6472086d13907344756cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41649f09cbf410a9825100c498b4916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:22.351128 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-39fc213b-2a1c-40b7-9d02-5d7dad6f21e0 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] 10.222.0.70 "GET /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349" status: 200 len: 1363 microversion: 2.1 time: 0.442861 Aug 27 02:59:22.354663 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1920/3829] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:59:21 2022] GET /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349 => generated 1363 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:59:22.552585 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f5a06ace-98fd-4fad-8171-bc808aa73a98 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:22.554594 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-f5a06ace-98fd-4fad-8171-bc808aa73a98 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 2d6bf535-89e0-4c21-b2cf-fafcf18c4f18] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:22.569196 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f5a06ace-98fd-4fad-8171-bc808aa73a98 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:22.570355 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f5a06ace-98fd-4fad-8171-bc808aa73a98 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:22.574015 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f5a06ace-98fd-4fad-8171-bc808aa73a98 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:22.575037 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f5a06ace-98fd-4fad-8171-bc808aa73a98 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:22.576480 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f5a06ace-98fd-4fad-8171-bc808aa73a98 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:22.589196 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f5a06ace-98fd-4fad-8171-bc808aa73a98 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:22.612798 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-f5a06ace-98fd-4fad-8171-bc808aa73a98 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] HTTP exception thrown: Instance 2d6bf535-89e0-4c21-b2cf-fafcf18c4f18 could not be found. Aug 27 02:59:22.615001 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f5a06ace-98fd-4fad-8171-bc808aa73a98 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Request method failure captured: Aug 27 02:59:22.615001 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/2d6bf535-89e0-4c21-b2cf-fafcf18c4f18 HTTP/1.1 Aug 27 02:59:22.615001 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:59:22.615001 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:59:22.615001 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:59:22.615001 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:59:22.615001 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:59:22.615001 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:59:22.615001 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:59:22.615001 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:59:22.615001 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYZ4Z8i7XrQCoJ8R1xQrljLXT0Y1KKkpWSlhl8nQzR0Gffp8SuHSAmEqH2wTow_HYUPfKDsH80AYAaprEdUsqUlgb1Dqa2tgrmc5xbHE8YE53Hq_xfoTBUsq6qNfDu_s_oKqI9wgNRhJDAuY_9xSuITf0Dzo8xZBUzkyCrp-xMPec0c Aug 27 02:59:22.615001 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:59:22.615001 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:59:22.615001 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:59:22.615001 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:59:22.615001 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:59:22.615001 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:59:22.615001 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 952767db5f394fc4bf01c0efd65f2fb9 Aug 27 02:59:22.615001 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ServerActionsTestJSON-1132885212 Aug 27 02:59:22.615001 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:59:22.615001 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:59:22.615001 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/952767db5f394fc4bf01c0efd65f2fb9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_952767db5f394fc4bf01c0efd65f2fb9", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/952767db5f394fc4bf01c0efd65f2fb9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/952767db5f394fc4bf01c0efd65f2fb9"}]}] Aug 27 02:59:22.615001 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ServerActionsTestJSON-1132885212 Aug 27 02:59:22.615001 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 952767db5f394fc4bf01c0efd65f2fb9 Aug 27 02:59:22.615001 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ServerActionsTestJSON-1132885212 Aug 27 02:59:22.615001 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ServerActionsTestJSON-1132885212-project Aug 27 02:59:22.615001 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:59:22.615001 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:59:22.615001 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: c850bda78e664117b671910c0e68bfb9 Aug 27 02:59:22.615001 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ServerActionsTestJSON-1132885212-project Aug 27 02:59:22.615001 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 02:59:22.615001 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance 2d6bf535-89e0-4c21-b2cf-fafcf18c4f18 could not be found. Aug 27 02:59:22.615001 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '2d6bf535-89e0-4c21-b2cf-fafcf18c4f18'} Aug 27 02:59:22.615001 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:59:22.615001 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:59:22.615001 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:59:22.615001 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:59:22.615001 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:59:22.615001 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:59:22.615001 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:59:22.615001 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:59:22.615001 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:59:22.615001 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:59:22.615001 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d6bf535-89e0-4c21-b2cf-fafcf18c4f18 could not be found. Aug 27 02:59:22.615001 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:59:22.615001 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:59:22.615001 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:59:22.615001 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:59:22.615001 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:59:22.615001 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:59:22.615001 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:59:22.615001 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:59:22.615001 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:59:22.615001 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:59:22.615001 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:59:22.615001 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:59:22.615001 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:59:22.615001 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:59:22.615001 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:59:22.615001 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:59:22.615001 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d6bf535-89e0-4c21-b2cf-fafcf18c4f18 could not be found. Aug 27 02:59:22.615001 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:59:22.615001 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:59:22.615001 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:59:22.619143 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:59:22.619143 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:59:22.619143 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:59:22.619143 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:59:22.619143 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:59:22.619143 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d6bf535-89e0-4c21-b2cf-fafcf18c4f18 could not be found. Aug 27 02:59:22.619143 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:59:22.620653 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f5a06ace-98fd-4fad-8171-bc808aa73a98 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Returning 404 to user: Instance 2d6bf535-89e0-4c21-b2cf-fafcf18c4f18 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:59:22.621752 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-f5a06ace-98fd-4fad-8171-bc808aa73a98 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/2d6bf535-89e0-4c21-b2cf-fafcf18c4f18" status: 404 len: 111 microversion: 2.1 time: 0.073065 Aug 27 02:59:22.622862 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1921/3830] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:59:22 2022] GET /compute/v2.1/servers/2d6bf535-89e0-4c21-b2cf-fafcf18c4f18 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 02:59:22.631987 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-bf7edd13-e7b5-4f05-b324-123c9147622e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:22.636807 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-bf7edd13-e7b5-4f05-b324-123c9147622e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 228b8015-1061-46f1-a6a3-c5d0ba039660] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:22.653450 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bf7edd13-e7b5-4f05-b324-123c9147622e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:22.654124 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bf7edd13-e7b5-4f05-b324-123c9147622e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:22.654718 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bf7edd13-e7b5-4f05-b324-123c9147622e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:22.655648 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bf7edd13-e7b5-4f05-b324-123c9147622e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:22.656362 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bf7edd13-e7b5-4f05-b324-123c9147622e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:22.656936 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bf7edd13-e7b5-4f05-b324-123c9147622e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:22.665065 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-1f4c82df-03f7-4ce4-a000-30fe3fc5ab1e tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '077ffba093574e27bdfb4d9a51910a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47faacfcd434bf08187aad0ab70e5d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:22.673803 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-1f4c82df-03f7-4ce4-a000-30fe3fc5ab1e tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] 10.222.0.70 "GET /compute/v2.1/servers/d9aca1b6-0002-43b1-acc4-e110530eac17" status: 200 len: 1312 microversion: 2.1 time: 0.525271 Aug 27 02:59:22.679060 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1910/3831] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:59:22 2022] GET /compute/v2.1/servers/d9aca1b6-0002-43b1-acc4-e110530eac17 => generated 1312 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:59:22.699744 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-bf7edd13-e7b5-4f05-b324-123c9147622e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 228b8015-1061-46f1-a6a3-c5d0ba039660] Going to try to terminate instance {{(pid=134051) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:59:22.802015 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9aba4485-0df3-4279-a369-932c687b914a tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:22.803280 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-9aba4485-0df3-4279-a369-932c687b914a tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] [instance: b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:22.821182 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9aba4485-0df3-4279-a369-932c687b914a tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:22.824975 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9aba4485-0df3-4279-a369-932c687b914a tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:22.825765 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9aba4485-0df3-4279-a369-932c687b914a tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:22.828385 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9aba4485-0df3-4279-a369-932c687b914a tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:22.829019 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9aba4485-0df3-4279-a369-932c687b914a tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:22.830734 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9aba4485-0df3-4279-a369-932c687b914a tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:22.904505 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-bf7edd13-e7b5-4f05-b324-123c9147622e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "DELETE /compute/v2.1/servers/228b8015-1061-46f1-a6a3-c5d0ba039660" status: 204 len: 0 microversion: 2.1 time: 0.276033 Aug 27 02:59:22.905550 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1922/3832] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:59:22 2022] DELETE /compute/v2.1/servers/228b8015-1061-46f1-a6a3-c5d0ba039660 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:59:22.921981 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-a619c15e-656d-443e-bdff-c99b119b2b7e req-79bb3b19-491c-4b9e-88ca-d5de38cb2bb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7", "name": "network-vif-deleted", "tag": "07494d6f-38b9-4b8b-930b-4c4d1abbc8b1"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:59:22.954305 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-a619c15e-656d-443e-bdff-c99b119b2b7e req-79bb3b19-491c-4b9e-88ca-d5de38cb2bb3 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:22.958544 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-a619c15e-656d-443e-bdff-c99b119b2b7e req-79bb3b19-491c-4b9e-88ca-d5de38cb2bb3 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:22.960940 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-a619c15e-656d-443e-bdff-c99b119b2b7e req-79bb3b19-491c-4b9e-88ca-d5de38cb2bb3 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:22.982419 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-a619c15e-656d-443e-bdff-c99b119b2b7e req-79bb3b19-491c-4b9e-88ca-d5de38cb2bb3 service nova] Creating event network-vif-deleted:07494d6f-38b9-4b8b-930b-4c4d1abbc8b1 for instance b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 on n-h2-852278-4 Aug 27 02:59:22.998788 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-a619c15e-656d-443e-bdff-c99b119b2b7e req-79bb3b19-491c-4b9e-88ca-d5de38cb2bb3 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089602 Aug 27 02:59:23.001815 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1923/3833] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:59:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:59:23.018637 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7b76dc7e-ac68-45ee-a63a-1a838689f0b4 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:23.019353 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-7b76dc7e-ac68-45ee-a63a-1a838689f0b4 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 228b8015-1061-46f1-a6a3-c5d0ba039660] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:23.031533 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7b76dc7e-ac68-45ee-a63a-1a838689f0b4 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:23.032033 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7b76dc7e-ac68-45ee-a63a-1a838689f0b4 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:23.032504 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7b76dc7e-ac68-45ee-a63a-1a838689f0b4 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:23.033231 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7b76dc7e-ac68-45ee-a63a-1a838689f0b4 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:23.033687 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7b76dc7e-ac68-45ee-a63a-1a838689f0b4 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:23.034112 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7b76dc7e-ac68-45ee-a63a-1a838689f0b4 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:23.048554 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-9aba4485-0df3-4279-a369-932c687b914a tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:23.061180 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-9aba4485-0df3-4279-a369-932c687b914a tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:23.066862 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-9aba4485-0df3-4279-a369-932c687b914a tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:23.072869 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9aba4485-0df3-4279-a369-932c687b914a tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] 10.222.0.70 "GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7" status: 200 len: 1604 microversion: 2.32 time: 0.276646 Aug 27 02:59:23.076667 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1911/3834] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:59:22 2022] GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 => generated 1604 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:59:23.319067 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-7b76dc7e-ac68-45ee-a63a-1a838689f0b4 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:23.327681 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-7b76dc7e-ac68-45ee-a63a-1a838689f0b4 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/228b8015-1061-46f1-a6a3-c5d0ba039660" status: 200 len: 1495 microversion: 2.1 time: 0.324427 Aug 27 02:59:23.345181 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1924/3835] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:59:23 2022] GET /compute/v2.1/servers/228b8015-1061-46f1-a6a3-c5d0ba039660 => generated 1495 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:59:23.375215 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-1e07a6da-3b23-4870-bc71-9a90938c6a7a tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:23.376054 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-1e07a6da-3b23-4870-bc71-9a90938c6a7a tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] [instance: 9d9f666f-0b19-4d87-a94a-770b5d99f349] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:23.394852 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1e07a6da-3b23-4870-bc71-9a90938c6a7a tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:23.395597 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1e07a6da-3b23-4870-bc71-9a90938c6a7a tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:23.396207 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1e07a6da-3b23-4870-bc71-9a90938c6a7a tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:23.397156 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1e07a6da-3b23-4870-bc71-9a90938c6a7a tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:23.397763 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1e07a6da-3b23-4870-bc71-9a90938c6a7a tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:23.398336 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1e07a6da-3b23-4870-bc71-9a90938c6a7a tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:23.699333 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-6699e337-cffc-4fc8-a0e1-a001b059cf1b tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:23.700574 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-6699e337-cffc-4fc8-a0e1-a001b059cf1b tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] [instance: d9aca1b6-0002-43b1-acc4-e110530eac17] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:23.710667 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6699e337-cffc-4fc8-a0e1-a001b059cf1b tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:23.712957 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6699e337-cffc-4fc8-a0e1-a001b059cf1b tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:23.713726 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6699e337-cffc-4fc8-a0e1-a001b059cf1b tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:23.716969 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6699e337-cffc-4fc8-a0e1-a001b059cf1b tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:23.718635 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6699e337-cffc-4fc8-a0e1-a001b059cf1b tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:23.719239 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6699e337-cffc-4fc8-a0e1-a001b059cf1b tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:23.759267 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-1e07a6da-3b23-4870-bc71-9a90938c6a7a tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe0328160c6472086d13907344756cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41649f09cbf410a9825100c498b4916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:23.769187 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-1e07a6da-3b23-4870-bc71-9a90938c6a7a tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] 10.222.0.70 "GET /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349" status: 200 len: 1363 microversion: 2.1 time: 0.397788 Aug 27 02:59:23.770054 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1912/3836] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:59:23 2022] GET /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349 => generated 1363 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:59:24.103686 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-27b0e671-14f9-4e9a-93be-a31ae0046820 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:24.105076 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-27b0e671-14f9-4e9a-93be-a31ae0046820 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] [instance: b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:24.136002 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-27b0e671-14f9-4e9a-93be-a31ae0046820 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:24.141785 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-27b0e671-14f9-4e9a-93be-a31ae0046820 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:24.142592 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-27b0e671-14f9-4e9a-93be-a31ae0046820 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:24.144131 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-27b0e671-14f9-4e9a-93be-a31ae0046820 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:24.145011 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-27b0e671-14f9-4e9a-93be-a31ae0046820 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:24.145673 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-27b0e671-14f9-4e9a-93be-a31ae0046820 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:24.180412 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:59:24.432597 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-27b0e671-14f9-4e9a-93be-a31ae0046820 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:24.448568 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-27b0e671-14f9-4e9a-93be-a31ae0046820 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:24.454664 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-27b0e671-14f9-4e9a-93be-a31ae0046820 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:24.456216 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-27b0e671-14f9-4e9a-93be-a31ae0046820 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] 10.222.0.70 "GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7" status: 200 len: 1604 microversion: 2.32 time: 0.361461 Aug 27 02:59:24.457334 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1913/3837] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:59:24 2022] GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 => generated 1604 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:59:24.466157 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d2f149b5-131f-451c-ab9d-f24dc797e2e7 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:24.470610 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d2f149b5-131f-451c-ab9d-f24dc797e2e7 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 228b8015-1061-46f1-a6a3-c5d0ba039660] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:24.478731 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d2f149b5-131f-451c-ab9d-f24dc797e2e7 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:24.479419 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d2f149b5-131f-451c-ab9d-f24dc797e2e7 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:24.479996 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d2f149b5-131f-451c-ab9d-f24dc797e2e7 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:24.480889 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d2f149b5-131f-451c-ab9d-f24dc797e2e7 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:24.481481 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d2f149b5-131f-451c-ab9d-f24dc797e2e7 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:24.482040 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d2f149b5-131f-451c-ab9d-f24dc797e2e7 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:24.671555 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=40 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:59:24.962615 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-6699e337-cffc-4fc8-a0e1-a001b059cf1b tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '077ffba093574e27bdfb4d9a51910a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47faacfcd434bf08187aad0ab70e5d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:24.977184 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-6699e337-cffc-4fc8-a0e1-a001b059cf1b tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] 10.222.0.70 "GET /compute/v2.1/servers/d9aca1b6-0002-43b1-acc4-e110530eac17" status: 200 len: 1312 microversion: 2.1 time: 1.280528 Aug 27 02:59:24.991038 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1925/3838] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:59:23 2022] GET /compute/v2.1/servers/d9aca1b6-0002-43b1-acc4-e110530eac17 => generated 1312 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:59:24.996862 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-db639f6b-4d3f-4d99-b887-6c8ae93be8c6 req-77f3ae71-2c05-4c0c-9914-995a0cf14215 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9aca1b6-0002-43b1-acc4-e110530eac17", "name": "network-vif-plugged", "status": "completed", "tag": "9d8e2478-5181-4cd4-8ace-4d8db90a3726"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:59:25.009040 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-db639f6b-4d3f-4d99-b887-6c8ae93be8c6 req-77f3ae71-2c05-4c0c-9914-995a0cf14215 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:25.009819 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-db639f6b-4d3f-4d99-b887-6c8ae93be8c6 req-77f3ae71-2c05-4c0c-9914-995a0cf14215 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:25.010434 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-db639f6b-4d3f-4d99-b887-6c8ae93be8c6 req-77f3ae71-2c05-4c0c-9914-995a0cf14215 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:25.026167 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-db639f6b-4d3f-4d99-b887-6c8ae93be8c6 req-77f3ae71-2c05-4c0c-9914-995a0cf14215 service nova] Creating event network-vif-plugged:9d8e2478-5181-4cd4-8ace-4d8db90a3726 for instance d9aca1b6-0002-43b1-acc4-e110530eac17 on n-h2-852278-4 Aug 27 02:59:25.032367 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-db639f6b-4d3f-4d99-b887-6c8ae93be8c6 req-77f3ae71-2c05-4c0c-9914-995a0cf14215 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039686 Aug 27 02:59:25.034286 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1926/3839] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:59:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:59:25.047578 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7843159d-c15b-4350-882e-8bd5b6e1e050 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:25.050588 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-7843159d-c15b-4350-882e-8bd5b6e1e050 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] [instance: 9d9f666f-0b19-4d87-a94a-770b5d99f349] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:25.068119 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7843159d-c15b-4350-882e-8bd5b6e1e050 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:25.068739 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7843159d-c15b-4350-882e-8bd5b6e1e050 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:25.070237 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7843159d-c15b-4350-882e-8bd5b6e1e050 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:25.071293 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7843159d-c15b-4350-882e-8bd5b6e1e050 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:25.074381 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7843159d-c15b-4350-882e-8bd5b6e1e050 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:25.075209 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7843159d-c15b-4350-882e-8bd5b6e1e050 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:25.271568 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-d2f149b5-131f-451c-ab9d-f24dc797e2e7 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:25.290620 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d2f149b5-131f-451c-ab9d-f24dc797e2e7 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/228b8015-1061-46f1-a6a3-c5d0ba039660" status: 200 len: 1495 microversion: 2.1 time: 0.831392 Aug 27 02:59:25.292791 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1914/3840] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:59:24 2022] GET /compute/v2.1/servers/228b8015-1061-46f1-a6a3-c5d0ba039660 => generated 1495 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:59:25.481277 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ea067294-a160-454f-bd95-7952227fc746 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:25.482319 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-ea067294-a160-454f-bd95-7952227fc746 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] [instance: b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:25.522413 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ea067294-a160-454f-bd95-7952227fc746 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:25.524405 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ea067294-a160-454f-bd95-7952227fc746 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:25.524863 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ea067294-a160-454f-bd95-7952227fc746 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:25.528068 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ea067294-a160-454f-bd95-7952227fc746 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:25.530696 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ea067294-a160-454f-bd95-7952227fc746 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:25.531326 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ea067294-a160-454f-bd95-7952227fc746 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:25.703597 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-7843159d-c15b-4350-882e-8bd5b6e1e050 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe0328160c6472086d13907344756cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41649f09cbf410a9825100c498b4916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:25.719242 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-7843159d-c15b-4350-882e-8bd5b6e1e050 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] 10.222.0.70 "GET /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349" status: 200 len: 1363 microversion: 2.1 time: 0.682249 Aug 27 02:59:25.719850 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1927/3841] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:59:25 2022] GET /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349 => generated 1363 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:59:25.721100 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-ea067294-a160-454f-bd95-7952227fc746 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:25.744146 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-ea067294-a160-454f-bd95-7952227fc746 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:25.747588 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-ea067294-a160-454f-bd95-7952227fc746 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:25.749101 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ea067294-a160-454f-bd95-7952227fc746 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] 10.222.0.70 "GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7" status: 200 len: 1604 microversion: 2.32 time: 0.273725 Aug 27 02:59:25.750204 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1915/3842] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:59:25 2022] GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 => generated 1604 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:59:26.001166 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-6fa7d0b4-71dc-4c86-bdbc-93ca927a2d44 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:26.002600 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-6fa7d0b4-71dc-4c86-bdbc-93ca927a2d44 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] [instance: d9aca1b6-0002-43b1-acc4-e110530eac17] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:26.009733 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6fa7d0b4-71dc-4c86-bdbc-93ca927a2d44 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:26.010231 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6fa7d0b4-71dc-4c86-bdbc-93ca927a2d44 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:26.021510 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6fa7d0b4-71dc-4c86-bdbc-93ca927a2d44 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:26.022625 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6fa7d0b4-71dc-4c86-bdbc-93ca927a2d44 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:26.023256 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6fa7d0b4-71dc-4c86-bdbc-93ca927a2d44 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:26.023851 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6fa7d0b4-71dc-4c86-bdbc-93ca927a2d44 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:26.315436 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a34f7efb-ee40-47e4-8df5-a217ed11ad7d tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:26.316048 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a34f7efb-ee40-47e4-8df5-a217ed11ad7d tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 228b8015-1061-46f1-a6a3-c5d0ba039660] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:26.328524 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a34f7efb-ee40-47e4-8df5-a217ed11ad7d tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:26.329284 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a34f7efb-ee40-47e4-8df5-a217ed11ad7d tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:26.337407 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a34f7efb-ee40-47e4-8df5-a217ed11ad7d tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:26.338666 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a34f7efb-ee40-47e4-8df5-a217ed11ad7d tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:26.339307 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a34f7efb-ee40-47e4-8df5-a217ed11ad7d tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:26.340071 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a34f7efb-ee40-47e4-8df5-a217ed11ad7d tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:26.752574 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-a34f7efb-ee40-47e4-8df5-a217ed11ad7d tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:26.761568 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a34f7efb-ee40-47e4-8df5-a217ed11ad7d tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/228b8015-1061-46f1-a6a3-c5d0ba039660" status: 200 len: 1453 microversion: 2.1 time: 0.450078 Aug 27 02:59:26.791603 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1916/3843] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:59:26 2022] GET /compute/v2.1/servers/228b8015-1061-46f1-a6a3-c5d0ba039660 => generated 1453 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:59:26.820344 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-237f95c6-9229-4e10-b39f-d45540ba7c13 req-9df3d8ff-ffed-4440-85a2-bd6a2e479a86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "228b8015-1061-46f1-a6a3-c5d0ba039660", "name": "network-vif-deleted", "tag": "f4187e0f-f8d2-4cd3-996d-70d701cfa1f0"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:59:26.838215 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-6fa7d0b4-71dc-4c86-bdbc-93ca927a2d44 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '077ffba093574e27bdfb4d9a51910a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47faacfcd434bf08187aad0ab70e5d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:26.847502 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-237f95c6-9229-4e10-b39f-d45540ba7c13 req-9df3d8ff-ffed-4440-85a2-bd6a2e479a86 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:26.848889 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-237f95c6-9229-4e10-b39f-d45540ba7c13 req-9df3d8ff-ffed-4440-85a2-bd6a2e479a86 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:26.849650 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-237f95c6-9229-4e10-b39f-d45540ba7c13 req-9df3d8ff-ffed-4440-85a2-bd6a2e479a86 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:26.857601 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-6fa7d0b4-71dc-4c86-bdbc-93ca927a2d44 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] 10.222.0.70 "GET /compute/v2.1/servers/d9aca1b6-0002-43b1-acc4-e110530eac17" status: 200 len: 1312 microversion: 2.1 time: 0.860424 Aug 27 02:59:26.867858 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1928/3844] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:59:25 2022] GET /compute/v2.1/servers/d9aca1b6-0002-43b1-acc4-e110530eac17 => generated 1312 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:59:26.873077 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0c1bcdc4-6b75-4975-8423-7eb3acaccad6 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:26.880528 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-0c1bcdc4-6b75-4975-8423-7eb3acaccad6 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] [instance: 9d9f666f-0b19-4d87-a94a-770b5d99f349] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:26.889605 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0c1bcdc4-6b75-4975-8423-7eb3acaccad6 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:26.890331 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0c1bcdc4-6b75-4975-8423-7eb3acaccad6 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:26.890932 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0c1bcdc4-6b75-4975-8423-7eb3acaccad6 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:26.891810 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0c1bcdc4-6b75-4975-8423-7eb3acaccad6 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:26.892463 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0c1bcdc4-6b75-4975-8423-7eb3acaccad6 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:26.893067 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0c1bcdc4-6b75-4975-8423-7eb3acaccad6 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:26.915619 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-237f95c6-9229-4e10-b39f-d45540ba7c13 req-9df3d8ff-ffed-4440-85a2-bd6a2e479a86 service nova] Creating event network-vif-deleted:f4187e0f-f8d2-4cd3-996d-70d701cfa1f0 for instance 228b8015-1061-46f1-a6a3-c5d0ba039660 on n-h1-852278-4 Aug 27 02:59:26.946611 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-237f95c6-9229-4e10-b39f-d45540ba7c13 req-9df3d8ff-ffed-4440-85a2-bd6a2e479a86 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150476 Aug 27 02:59:26.952595 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1917/3845] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:59:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:59:26.975691 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-75d8324e-6508-46de-ac55-a1b73d0a0973 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:26.975790 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-75d8324e-6508-46de-ac55-a1b73d0a0973 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] [instance: b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:26.995954 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-75d8324e-6508-46de-ac55-a1b73d0a0973 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:26.997446 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-75d8324e-6508-46de-ac55-a1b73d0a0973 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:26.998009 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-75d8324e-6508-46de-ac55-a1b73d0a0973 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:26.999376 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-75d8324e-6508-46de-ac55-a1b73d0a0973 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:27.005311 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-75d8324e-6508-46de-ac55-a1b73d0a0973 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:27.007655 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-75d8324e-6508-46de-ac55-a1b73d0a0973 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:27.402026 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-75d8324e-6508-46de-ac55-a1b73d0a0973 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:27.421657 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-75d8324e-6508-46de-ac55-a1b73d0a0973 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:27.426138 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-75d8324e-6508-46de-ac55-a1b73d0a0973 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:27.428106 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-75d8324e-6508-46de-ac55-a1b73d0a0973 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] 10.222.0.70 "GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7" status: 200 len: 1604 microversion: 2.32 time: 0.470092 Aug 27 02:59:27.431100 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1918/3846] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:59:26 2022] GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 => generated 1604 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:59:27.676027 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-0c1bcdc4-6b75-4975-8423-7eb3acaccad6 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe0328160c6472086d13907344756cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41649f09cbf410a9825100c498b4916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:27.692542 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-0c1bcdc4-6b75-4975-8423-7eb3acaccad6 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] 10.222.0.70 "GET /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349" status: 200 len: 1363 microversion: 2.1 time: 0.823087 Aug 27 02:59:27.699318 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1929/3847] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:59:26 2022] GET /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349 => generated 1363 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:59:27.789192 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5fe172af-79a3-4204-a68e-9a3ed7f41af3 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:27.790092 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-5fe172af-79a3-4204-a68e-9a3ed7f41af3 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 228b8015-1061-46f1-a6a3-c5d0ba039660] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:27.800929 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5fe172af-79a3-4204-a68e-9a3ed7f41af3 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:27.816874 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5fe172af-79a3-4204-a68e-9a3ed7f41af3 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:27.817460 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5fe172af-79a3-4204-a68e-9a3ed7f41af3 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:27.818332 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5fe172af-79a3-4204-a68e-9a3ed7f41af3 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:27.822599 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5fe172af-79a3-4204-a68e-9a3ed7f41af3 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:27.824054 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5fe172af-79a3-4204-a68e-9a3ed7f41af3 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:27.885329 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4391ad24-bb81-4669-88bb-db78ea01b607 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:27.886034 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-4391ad24-bb81-4669-88bb-db78ea01b607 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] [instance: d9aca1b6-0002-43b1-acc4-e110530eac17] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:27.894338 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:59:27.910828 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5fe172af-79a3-4204-a68e-9a3ed7f41af3 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:27.911755 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4391ad24-bb81-4669-88bb-db78ea01b607 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:27.913625 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5fe172af-79a3-4204-a68e-9a3ed7f41af3 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:27.915669 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5fe172af-79a3-4204-a68e-9a3ed7f41af3 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:27.915913 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4391ad24-bb81-4669-88bb-db78ea01b607 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:27.916610 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.instance [None req-5fe172af-79a3-4204-a68e-9a3ed7f41af3 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lazy-loading 'fault' on Instance uuid 228b8015-1061-46f1-a6a3-c5d0ba039660 {{(pid=134052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:59:27.928897 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4391ad24-bb81-4669-88bb-db78ea01b607 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:27.933201 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4391ad24-bb81-4669-88bb-db78ea01b607 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:27.933711 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4391ad24-bb81-4669-88bb-db78ea01b607 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:27.934162 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4391ad24-bb81-4669-88bb-db78ea01b607 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:28.375561 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-5fe172af-79a3-4204-a68e-9a3ed7f41af3 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:28.390640 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-5fe172af-79a3-4204-a68e-9a3ed7f41af3 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/228b8015-1061-46f1-a6a3-c5d0ba039660" status: 200 len: 1305 microversion: 2.1 time: 0.605246 Aug 27 02:59:28.391585 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1919/3848] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:59:27 2022] GET /compute/v2.1/servers/228b8015-1061-46f1-a6a3-c5d0ba039660 => generated 1305 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:59:28.457491 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c6ebe340-6d85-42e4-84b4-68a609759f94 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:28.458991 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-c6ebe340-6d85-42e4-84b4-68a609759f94 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] [instance: b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:28.481271 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c6ebe340-6d85-42e4-84b4-68a609759f94 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:28.485609 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c6ebe340-6d85-42e4-84b4-68a609759f94 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:28.488938 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c6ebe340-6d85-42e4-84b4-68a609759f94 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:28.490035 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c6ebe340-6d85-42e4-84b4-68a609759f94 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:28.490875 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c6ebe340-6d85-42e4-84b4-68a609759f94 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:28.491471 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c6ebe340-6d85-42e4-84b4-68a609759f94 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:28.529404 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-4391ad24-bb81-4669-88bb-db78ea01b607 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '077ffba093574e27bdfb4d9a51910a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47faacfcd434bf08187aad0ab70e5d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:28.530471 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=100 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:59:28.545889 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-4391ad24-bb81-4669-88bb-db78ea01b607 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] 10.222.0.70 "GET /compute/v2.1/servers/d9aca1b6-0002-43b1-acc4-e110530eac17" status: 200 len: 1497 microversion: 2.1 time: 0.667002 Aug 27 02:59:28.546792 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1930/3849] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:59:27 2022] GET /compute/v2.1/servers/d9aca1b6-0002-43b1-acc4-e110530eac17 => generated 1497 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:59:28.566669 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-219991a1-b48b-4fc7-8903-8b3bd94100b3 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:28.581480 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.compute.server_groups [None req-219991a1-b48b-4fc7-8903-8b3bd94100b3 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Querying cell 9e3f7cc8-d9cf-4064-9831-4fdba8cfa839(cell1) for 1 instances {{(pid=134051) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 27 02:59:28.582567 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-219991a1-b48b-4fc7-8903-8b3bd94100b3 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:28.583201 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-219991a1-b48b-4fc7-8903-8b3bd94100b3 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:28.583780 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-219991a1-b48b-4fc7-8903-8b3bd94100b3 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:28.602600 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-219991a1-b48b-4fc7-8903-8b3bd94100b3 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] 10.222.0.70 "GET /compute/v2.1/os-server-groups/a1fd45b4-d0b5-4072-9d82-03e76576968a" status: 200 len: 221 microversion: 2.1 time: 0.039854 Aug 27 02:59:28.609142 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1931/3850] 10.222.0.70 () {58 vars in 1263 bytes} [Sat Aug 27 02:59:28 2022] GET /compute/v2.1/os-server-groups/a1fd45b4-d0b5-4072-9d82-03e76576968a => generated 221 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:59:28.614749 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-fee08dab-059d-4d49-b6bc-ba3a2c4f6238 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:28.615482 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-fee08dab-059d-4d49-b6bc-ba3a2c4f6238 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] [instance: d9aca1b6-0002-43b1-acc4-e110530eac17] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:28.622653 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fee08dab-059d-4d49-b6bc-ba3a2c4f6238 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:28.623152 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fee08dab-059d-4d49-b6bc-ba3a2c4f6238 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:28.623585 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fee08dab-059d-4d49-b6bc-ba3a2c4f6238 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:28.624327 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fee08dab-059d-4d49-b6bc-ba3a2c4f6238 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:28.624822 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fee08dab-059d-4d49-b6bc-ba3a2c4f6238 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:28.625240 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fee08dab-059d-4d49-b6bc-ba3a2c4f6238 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:28.654540 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-fee08dab-059d-4d49-b6bc-ba3a2c4f6238 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] [instance: d9aca1b6-0002-43b1-acc4-e110530eac17] Going to try to terminate instance {{(pid=134051) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:59:28.660773 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-c6ebe340-6d85-42e4-84b4-68a609759f94 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:28.676126 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-c6ebe340-6d85-42e4-84b4-68a609759f94 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:28.685852 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-c6ebe340-6d85-42e4-84b4-68a609759f94 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:28.691786 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c6ebe340-6d85-42e4-84b4-68a609759f94 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] 10.222.0.70 "GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7" status: 200 len: 1604 microversion: 2.32 time: 0.236366 Aug 27 02:59:28.708994 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1920/3851] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:59:28 2022] GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 => generated 1604 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:59:28.722844 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-74655938-b4d8-41ec-a11b-ab6a5c68dba4 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:28.723802 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:59:28.729483 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-74655938-b4d8-41ec-a11b-ab6a5c68dba4 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] [instance: 9d9f666f-0b19-4d87-a94a-770b5d99f349] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:28.742025 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-74655938-b4d8-41ec-a11b-ab6a5c68dba4 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:28.743174 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-74655938-b4d8-41ec-a11b-ab6a5c68dba4 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:28.745724 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-74655938-b4d8-41ec-a11b-ab6a5c68dba4 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:28.750733 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-74655938-b4d8-41ec-a11b-ab6a5c68dba4 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:28.751598 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-74655938-b4d8-41ec-a11b-ab6a5c68dba4 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:28.752551 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-74655938-b4d8-41ec-a11b-ab6a5c68dba4 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:28.769882 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-fee08dab-059d-4d49-b6bc-ba3a2c4f6238 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] 10.222.0.70 "DELETE /compute/v2.1/servers/d9aca1b6-0002-43b1-acc4-e110530eac17" status: 204 len: 0 microversion: 2.1 time: 0.158953 Aug 27 02:59:28.775196 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1932/3852] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:59:28 2022] DELETE /compute/v2.1/servers/d9aca1b6-0002-43b1-acc4-e110530eac17 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:59:28.781773 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-04771a54-18ab-4d77-b6fd-c5f4a8bcbc55 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:28.782788 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-04771a54-18ab-4d77-b6fd-c5f4a8bcbc55 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] [instance: d9aca1b6-0002-43b1-acc4-e110530eac17] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:28.790860 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-04771a54-18ab-4d77-b6fd-c5f4a8bcbc55 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:28.791611 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-04771a54-18ab-4d77-b6fd-c5f4a8bcbc55 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:28.792225 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-04771a54-18ab-4d77-b6fd-c5f4a8bcbc55 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:28.793282 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-04771a54-18ab-4d77-b6fd-c5f4a8bcbc55 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:28.793883 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-04771a54-18ab-4d77-b6fd-c5f4a8bcbc55 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:28.794453 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-04771a54-18ab-4d77-b6fd-c5f4a8bcbc55 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:29.090849 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-04771a54-18ab-4d77-b6fd-c5f4a8bcbc55 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '077ffba093574e27bdfb4d9a51910a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47faacfcd434bf08187aad0ab70e5d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:29.105990 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-04771a54-18ab-4d77-b6fd-c5f4a8bcbc55 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] 10.222.0.70 "GET /compute/v2.1/servers/d9aca1b6-0002-43b1-acc4-e110530eac17" status: 200 len: 1503 microversion: 2.1 time: 0.328807 Aug 27 02:59:29.106828 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1933/3853] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:59:28 2022] GET /compute/v2.1/servers/d9aca1b6-0002-43b1-acc4-e110530eac17 => generated 1503 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:59:29.112014 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-3b1153e0-77a9-48e0-8ac7-a22869698e5e req-bf9fab07-f2ab-48af-92cb-5f79de0c2a98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d9f666f-0b19-4d87-a94a-770b5d99f349", "name": "network-vif-plugged", "status": "completed", "tag": "b31e0e71-4066-4ac6-b1eb-63996f060976"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:59:29.142207 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-3b1153e0-77a9-48e0-8ac7-a22869698e5e req-bf9fab07-f2ab-48af-92cb-5f79de0c2a98 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:29.142694 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-3b1153e0-77a9-48e0-8ac7-a22869698e5e req-bf9fab07-f2ab-48af-92cb-5f79de0c2a98 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:29.143129 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-3b1153e0-77a9-48e0-8ac7-a22869698e5e req-bf9fab07-f2ab-48af-92cb-5f79de0c2a98 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:29.145688 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-74655938-b4d8-41ec-a11b-ab6a5c68dba4 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe0328160c6472086d13907344756cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41649f09cbf410a9825100c498b4916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:29.155514 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-3b1153e0-77a9-48e0-8ac7-a22869698e5e req-bf9fab07-f2ab-48af-92cb-5f79de0c2a98 service nova] Creating event network-vif-plugged:b31e0e71-4066-4ac6-b1eb-63996f060976 for instance 9d9f666f-0b19-4d87-a94a-770b5d99f349 on n-h1-852278-4 Aug 27 02:59:29.163737 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-3b1153e0-77a9-48e0-8ac7-a22869698e5e req-bf9fab07-f2ab-48af-92cb-5f79de0c2a98 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055066 Aug 27 02:59:29.163893 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-74655938-b4d8-41ec-a11b-ab6a5c68dba4 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] 10.222.0.70 "GET /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349" status: 200 len: 1363 microversion: 2.1 time: 0.444939 Aug 27 02:59:29.164802 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1934/3854] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:59:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:59:29.167254 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1921/3855] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:59:28 2022] GET /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349 => generated 1363 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:59:29.417335 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3fec27d1-5253-422d-af6e-a698b2e076ab tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:29.418505 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-3fec27d1-5253-422d-af6e-a698b2e076ab tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: 228b8015-1061-46f1-a6a3-c5d0ba039660] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:29.425615 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3fec27d1-5253-422d-af6e-a698b2e076ab tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:29.426244 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3fec27d1-5253-422d-af6e-a698b2e076ab tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:29.426844 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3fec27d1-5253-422d-af6e-a698b2e076ab tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:29.427581 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3fec27d1-5253-422d-af6e-a698b2e076ab tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:29.428390 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3fec27d1-5253-422d-af6e-a698b2e076ab tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:29.428997 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3fec27d1-5253-422d-af6e-a698b2e076ab tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:29.443117 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-3fec27d1-5253-422d-af6e-a698b2e076ab tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] HTTP exception thrown: Instance 228b8015-1061-46f1-a6a3-c5d0ba039660 could not be found. Aug 27 02:59:29.445131 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3fec27d1-5253-422d-af6e-a698b2e076ab tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Request method failure captured: Aug 27 02:59:29.445131 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/228b8015-1061-46f1-a6a3-c5d0ba039660 HTTP/1.1 Aug 27 02:59:29.445131 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:59:29.445131 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:59:29.445131 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:59:29.445131 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:59:29.445131 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:59:29.445131 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:59:29.445131 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:59:29.445131 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:59:29.445131 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYZ4Z8i7XrQCoJ8R1xQrljLXT0Y1KKkpWSlhl8nQzR0Gffp8SuHSAmEqH2wTow_HYUPfKDsH80AYAaprEdUsqUlgb1Dqa2tgrmc5xbHE8YE53Hq_xfoTBUsq6qNfDu_s_oKqI9wgNRhJDAuY_9xSuITf0Dzo8xZBUzkyCrp-xMPec0c Aug 27 02:59:29.445131 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:59:29.445131 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:59:29.445131 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:59:29.445131 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:59:29.445131 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:59:29.445131 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:59:29.445131 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 952767db5f394fc4bf01c0efd65f2fb9 Aug 27 02:59:29.445131 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ServerActionsTestJSON-1132885212 Aug 27 02:59:29.445131 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:59:29.445131 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:59:29.445131 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/952767db5f394fc4bf01c0efd65f2fb9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_952767db5f394fc4bf01c0efd65f2fb9", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/952767db5f394fc4bf01c0efd65f2fb9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/952767db5f394fc4bf01c0efd65f2fb9"}]}] Aug 27 02:59:29.445131 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ServerActionsTestJSON-1132885212 Aug 27 02:59:29.445131 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 952767db5f394fc4bf01c0efd65f2fb9 Aug 27 02:59:29.445131 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ServerActionsTestJSON-1132885212 Aug 27 02:59:29.445131 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ServerActionsTestJSON-1132885212-project Aug 27 02:59:29.445131 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:59:29.445131 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:59:29.445131 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: c850bda78e664117b671910c0e68bfb9 Aug 27 02:59:29.445131 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ServerActionsTestJSON-1132885212-project Aug 27 02:59:29.445131 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 02:59:29.445131 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance 228b8015-1061-46f1-a6a3-c5d0ba039660 could not be found. Aug 27 02:59:29.445131 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '228b8015-1061-46f1-a6a3-c5d0ba039660'} Aug 27 02:59:29.445131 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:59:29.445131 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:59:29.445131 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:59:29.445131 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:59:29.445131 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:59:29.445131 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:59:29.445131 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:59:29.445131 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:59:29.445131 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:59:29.445131 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:59:29.445131 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 228b8015-1061-46f1-a6a3-c5d0ba039660 could not be found. Aug 27 02:59:29.445131 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:59:29.445131 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:59:29.445131 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:59:29.445131 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:59:29.445131 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:59:29.445131 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:59:29.445131 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:59:29.445131 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:59:29.445131 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:59:29.445131 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:59:29.445131 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:59:29.445131 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:59:29.445131 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:59:29.445131 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:59:29.445131 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:59:29.445131 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:59:29.445131 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 228b8015-1061-46f1-a6a3-c5d0ba039660 could not be found. Aug 27 02:59:29.445131 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:59:29.445131 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:59:29.445131 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:59:29.448996 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:59:29.448996 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:59:29.448996 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:59:29.448996 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:59:29.448996 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:59:29.448996 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 228b8015-1061-46f1-a6a3-c5d0ba039660 could not be found. Aug 27 02:59:29.448996 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:59:29.448996 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3fec27d1-5253-422d-af6e-a698b2e076ab tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Returning 404 to user: Instance 228b8015-1061-46f1-a6a3-c5d0ba039660 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:59:29.448996 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-3fec27d1-5253-422d-af6e-a698b2e076ab tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/228b8015-1061-46f1-a6a3-c5d0ba039660" status: 404 len: 111 microversion: 2.1 time: 0.033730 Aug 27 02:59:29.450285 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1935/3856] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:59:29 2022] GET /compute/v2.1/servers/228b8015-1061-46f1-a6a3-c5d0ba039660 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:59:29.455659 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c65f0b7e-6622-4e32-8c55-8892a7e8a5a9 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:29.456164 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-c65f0b7e-6622-4e32-8c55-8892a7e8a5a9 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:29.463878 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c65f0b7e-6622-4e32-8c55-8892a7e8a5a9 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:29.464504 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c65f0b7e-6622-4e32-8c55-8892a7e8a5a9 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:29.464810 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c65f0b7e-6622-4e32-8c55-8892a7e8a5a9 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:29.465527 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c65f0b7e-6622-4e32-8c55-8892a7e8a5a9 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:29.465975 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c65f0b7e-6622-4e32-8c55-8892a7e8a5a9 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:29.466394 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c65f0b7e-6622-4e32-8c55-8892a7e8a5a9 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:29.494665 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-c65f0b7e-6622-4e32-8c55-8892a7e8a5a9 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Going to try to terminate instance {{(pid=134052) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:59:29.576924 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c65f0b7e-6622-4e32-8c55-8892a7e8a5a9 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "DELETE /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 204 len: 0 microversion: 2.1 time: 0.125207 Aug 27 02:59:29.577872 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1922/3857] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:59:29 2022] DELETE /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 02:59:29.586158 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-6acbd0d1-669f-451e-873d-3c0d4ea0cfb1 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:29.586691 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-6acbd0d1-669f-451e-873d-3c0d4ea0cfb1 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:29.593085 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6acbd0d1-669f-451e-873d-3c0d4ea0cfb1 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:29.593584 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6acbd0d1-669f-451e-873d-3c0d4ea0cfb1 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:29.594054 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6acbd0d1-669f-451e-873d-3c0d4ea0cfb1 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:29.594978 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6acbd0d1-669f-451e-873d-3c0d4ea0cfb1 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:29.595796 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6acbd0d1-669f-451e-873d-3c0d4ea0cfb1 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:29.596157 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6acbd0d1-669f-451e-873d-3c0d4ea0cfb1 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:29.731015 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6a804ca9-8636-4477-93a5-7317b31e42bb tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:29.732054 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-6a804ca9-8636-4477-93a5-7317b31e42bb tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] [instance: b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:29.739139 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6a804ca9-8636-4477-93a5-7317b31e42bb tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:29.739633 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6a804ca9-8636-4477-93a5-7317b31e42bb tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:29.740121 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6a804ca9-8636-4477-93a5-7317b31e42bb tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:29.740892 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6a804ca9-8636-4477-93a5-7317b31e42bb tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:29.741955 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6a804ca9-8636-4477-93a5-7317b31e42bb tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:29.742369 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6a804ca9-8636-4477-93a5-7317b31e42bb tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:29.795944 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-6acbd0d1-669f-451e-873d-3c0d4ea0cfb1 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:29.807461 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-6acbd0d1-669f-451e-873d-3c0d4ea0cfb1 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1674 microversion: 2.1 time: 0.223926 Aug 27 02:59:29.808850 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1936/3858] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:59:29 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1674 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:59:29.838328 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-6a804ca9-8636-4477-93a5-7317b31e42bb tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:29.850352 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-6a804ca9-8636-4477-93a5-7317b31e42bb tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:29.852197 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-6a804ca9-8636-4477-93a5-7317b31e42bb tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:29.853673 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-6a804ca9-8636-4477-93a5-7317b31e42bb tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] 10.222.0.70 "GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7" status: 200 len: 1604 microversion: 2.32 time: 0.131565 Aug 27 02:59:29.854770 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1923/3859] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:59:29 2022] GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 => generated 1604 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:59:30.035459 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-cf250bd5-f2f5-4f9f-8384-7a46fc2876d9 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-1861081770", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "3e7411f5-f674-4cd2-aaee-2ec4cef6451a"}], "security_groups": [{"name": "tempest-securitygroup--1593694736"}], "key_name": "tempest-keypair-843179185", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "67129381-28b2-49eb-9bd1-c54d872c809d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:59:30.131502 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-2bf73ce5-c79d-4805-8835-2122351d8917 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:30.134662 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-2bf73ce5-c79d-4805-8835-2122351d8917 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] [instance: d9aca1b6-0002-43b1-acc4-e110530eac17] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:30.142090 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2bf73ce5-c79d-4805-8835-2122351d8917 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:30.142877 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2bf73ce5-c79d-4805-8835-2122351d8917 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:30.143492 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2bf73ce5-c79d-4805-8835-2122351d8917 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:30.144450 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2bf73ce5-c79d-4805-8835-2122351d8917 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:30.145080 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2bf73ce5-c79d-4805-8835-2122351d8917 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:30.145696 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2bf73ce5-c79d-4805-8835-2122351d8917 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:30.378579 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.network.neutron [None req-cf250bd5-f2f5-4f9f-8384-7a46fc2876d9 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] validate_networks() for [('3e7411f5-f674-4cd2-aaee-2ec4cef6451a', None, None, None, None, None)] {{(pid=134051) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:59:30.569571 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-2bf73ce5-c79d-4805-8835-2122351d8917 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '077ffba093574e27bdfb4d9a51910a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47faacfcd434bf08187aad0ab70e5d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:30.583608 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-2bf73ce5-c79d-4805-8835-2122351d8917 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] 10.222.0.70 "GET /compute/v2.1/servers/d9aca1b6-0002-43b1-acc4-e110530eac17" status: 200 len: 1503 microversion: 2.1 time: 0.460313 Aug 27 02:59:30.585569 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1924/3860] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:59:30 2022] GET /compute/v2.1/servers/d9aca1b6-0002-43b1-acc4-e110530eac17 => generated 1503 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:59:30.592509 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-cc8dd99c-f962-476e-86db-aae5f716e737 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:30.594686 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-cc8dd99c-f962-476e-86db-aae5f716e737 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] [instance: 9d9f666f-0b19-4d87-a94a-770b5d99f349] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:30.602845 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cc8dd99c-f962-476e-86db-aae5f716e737 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:30.604267 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cc8dd99c-f962-476e-86db-aae5f716e737 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:30.605032 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cc8dd99c-f962-476e-86db-aae5f716e737 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:30.605838 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cc8dd99c-f962-476e-86db-aae5f716e737 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:30.606491 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cc8dd99c-f962-476e-86db-aae5f716e737 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:30.607077 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cc8dd99c-f962-476e-86db-aae5f716e737 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:31.006044 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-cc8dd99c-f962-476e-86db-aae5f716e737 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe0328160c6472086d13907344756cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41649f09cbf410a9825100c498b4916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:31.017794 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-cc8dd99c-f962-476e-86db-aae5f716e737 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] 10.222.0.70 "GET /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349" status: 200 len: 1363 microversion: 2.1 time: 0.430893 Aug 27 02:59:31.019261 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1925/3861] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:59:30 2022] GET /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349 => generated 1363 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:59:31.026998 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-03daf5dd-2899-4e36-adde-73bcf7484dd9 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:31.028225 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-03daf5dd-2899-4e36-adde-73bcf7484dd9 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:31.038000 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-03daf5dd-2899-4e36-adde-73bcf7484dd9 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:31.039071 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-03daf5dd-2899-4e36-adde-73bcf7484dd9 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:31.039777 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-03daf5dd-2899-4e36-adde-73bcf7484dd9 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:31.041657 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-03daf5dd-2899-4e36-adde-73bcf7484dd9 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:31.043798 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-03daf5dd-2899-4e36-adde-73bcf7484dd9 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:31.044708 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-03daf5dd-2899-4e36-adde-73bcf7484dd9 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:31.864626 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-03daf5dd-2899-4e36-adde-73bcf7484dd9 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:31.874707 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-03daf5dd-2899-4e36-adde-73bcf7484dd9 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1674 microversion: 2.1 time: 0.853457 Aug 27 02:59:31.889182 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1926/3862] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:59:31 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1674 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:59:31.894758 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-fe3653c4-16d5-4a0c-b71f-a041036c81be tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:31.895817 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-fe3653c4-16d5-4a0c-b71f-a041036c81be tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] [instance: b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:31.906452 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fe3653c4-16d5-4a0c-b71f-a041036c81be tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:31.907147 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fe3653c4-16d5-4a0c-b71f-a041036c81be tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:31.907885 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fe3653c4-16d5-4a0c-b71f-a041036c81be tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:31.910914 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fe3653c4-16d5-4a0c-b71f-a041036c81be tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:31.911542 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fe3653c4-16d5-4a0c-b71f-a041036c81be tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:31.912201 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fe3653c4-16d5-4a0c-b71f-a041036c81be tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:32.078120 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-fe3653c4-16d5-4a0c-b71f-a041036c81be tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:32.090777 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-fe3653c4-16d5-4a0c-b71f-a041036c81be tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:32.092629 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-fe3653c4-16d5-4a0c-b71f-a041036c81be tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:32.095665 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-fe3653c4-16d5-4a0c-b71f-a041036c81be tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] 10.222.0.70 "GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7" status: 200 len: 1604 microversion: 2.32 time: 0.203931 Aug 27 02:59:32.097475 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1927/3863] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:59:31 2022] GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 => generated 1604 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:59:32.106979 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-04885f28-8517-4c62-8133-c58d91685d61 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:32.110629 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-04885f28-8517-4c62-8133-c58d91685d61 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] [instance: d9aca1b6-0002-43b1-acc4-e110530eac17] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:32.124557 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-04885f28-8517-4c62-8133-c58d91685d61 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:32.125394 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-04885f28-8517-4c62-8133-c58d91685d61 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:32.125980 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-04885f28-8517-4c62-8133-c58d91685d61 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:32.127326 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-04885f28-8517-4c62-8133-c58d91685d61 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:32.127936 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-04885f28-8517-4c62-8133-c58d91685d61 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:32.128548 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-04885f28-8517-4c62-8133-c58d91685d61 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:32.313911 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-04885f28-8517-4c62-8133-c58d91685d61 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '077ffba093574e27bdfb4d9a51910a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47faacfcd434bf08187aad0ab70e5d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:32.326854 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-cf250bd5-f2f5-4f9f-8384-7a46fc2876d9 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Getting quotas for project 7503b9ec7c8e48ff95ce15b92a41118f. Resources: dict_keys(['metadata_items']) {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:59:32.333791 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-cf250bd5-f2f5-4f9f-8384-7a46fc2876d9 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Getting quotas for user 5557a4cfdaab4a7fa40c17bf9fc9ceb7 and project 7503b9ec7c8e48ff95ce15b92a41118f. Resources: dict_keys(['metadata_items']) {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:59:32.354419 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-04885f28-8517-4c62-8133-c58d91685d61 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] 10.222.0.70 "GET /compute/v2.1/servers/d9aca1b6-0002-43b1-acc4-e110530eac17" status: 200 len: 1461 microversion: 2.1 time: 0.238682 Aug 27 02:59:32.356833 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1928/3864] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:59:32 2022] GET /compute/v2.1/servers/d9aca1b6-0002-43b1-acc4-e110530eac17 => generated 1461 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:59:32.366150 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a6be3ee3-a04b-4d0d-94ce-bcf04a05cee6 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:32.366817 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a6be3ee3-a04b-4d0d-94ce-bcf04a05cee6 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] [instance: 9d9f666f-0b19-4d87-a94a-770b5d99f349] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:32.374670 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a6be3ee3-a04b-4d0d-94ce-bcf04a05cee6 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:32.375391 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a6be3ee3-a04b-4d0d-94ce-bcf04a05cee6 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:32.375976 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a6be3ee3-a04b-4d0d-94ce-bcf04a05cee6 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:32.378413 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a6be3ee3-a04b-4d0d-94ce-bcf04a05cee6 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:32.379067 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a6be3ee3-a04b-4d0d-94ce-bcf04a05cee6 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:32.380207 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a6be3ee3-a04b-4d0d-94ce-bcf04a05cee6 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:32.384347 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-cf250bd5-f2f5-4f9f-8384-7a46fc2876d9 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Flavor limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:59:32.384776 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-cf250bd5-f2f5-4f9f-8384-7a46fc2876d9 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Image limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:59:32.385270 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-cf250bd5-f2f5-4f9f-8384-7a46fc2876d9 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Flavor pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:59:32.385670 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-cf250bd5-f2f5-4f9f-8384-7a46fc2876d9 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Image pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:59:32.386083 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-cf250bd5-f2f5-4f9f-8384-7a46fc2876d9 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:59:32.410741 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cf250bd5-f2f5-4f9f-8384-7a46fc2876d9 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:32.411252 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cf250bd5-f2f5-4f9f-8384-7a46fc2876d9 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:32.413887 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cf250bd5-f2f5-4f9f-8384-7a46fc2876d9 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:32.414720 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cf250bd5-f2f5-4f9f-8384-7a46fc2876d9 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:32.415390 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cf250bd5-f2f5-4f9f-8384-7a46fc2876d9 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:32.418199 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cf250bd5-f2f5-4f9f-8384-7a46fc2876d9 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:32.487834 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-cf250bd5-f2f5-4f9f-8384-7a46fc2876d9 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Getting quotas for project 7503b9ec7c8e48ff95ce15b92a41118f. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:59:32.503121 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-cf250bd5-f2f5-4f9f-8384-7a46fc2876d9 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Getting quotas for user 5557a4cfdaab4a7fa40c17bf9fc9ceb7 and project 7503b9ec7c8e48ff95ce15b92a41118f. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:59:32.673708 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-cf250bd5-f2f5-4f9f-8384-7a46fc2876d9 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Going to run 1 instances... {{(pid=134051) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:59:32.677380 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-cf250bd5-f2f5-4f9f-8384-7a46fc2876d9 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] [instance: e7973075-ede5-4528-8d5f-83d994006015] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='67129381-28b2-49eb-9bd1-c54d872c809d',volume_size=None,volume_type=None)] {{(pid=134051) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:59:32.892327 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-cf250bd5-f2f5-4f9f-8384-7a46fc2876d9 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 2.861043 Aug 27 02:59:32.894221 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1937/3865] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 02:59:30 2022] POST /compute/v2.1/servers => generated 407 bytes in 2864 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:59:32.899060 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-8bb02a9f-9dbf-47de-bb49-6a88a94d5fce req-3f4f93d1-a465-4cda-8ef8-0c3bd882443d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9aca1b6-0002-43b1-acc4-e110530eac17", "name": "network-vif-deleted", "tag": "9d8e2478-5181-4cd4-8ace-4d8db90a3726"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:59:32.916213 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-8bb02a9f-9dbf-47de-bb49-6a88a94d5fce req-3f4f93d1-a465-4cda-8ef8-0c3bd882443d service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:32.917542 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-a6be3ee3-a04b-4d0d-94ce-bcf04a05cee6 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe0328160c6472086d13907344756cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41649f09cbf410a9825100c498b4916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:32.923720 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-8bb02a9f-9dbf-47de-bb49-6a88a94d5fce req-3f4f93d1-a465-4cda-8ef8-0c3bd882443d service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:32.924598 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-8bb02a9f-9dbf-47de-bb49-6a88a94d5fce req-3f4f93d1-a465-4cda-8ef8-0c3bd882443d service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:32.925583 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a6be3ee3-a04b-4d0d-94ce-bcf04a05cee6 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] 10.222.0.70 "GET /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349" status: 200 len: 1547 microversion: 2.1 time: 0.566508 Aug 27 02:59:32.945364 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1929/3866] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:59:32 2022] GET /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349 => generated 1547 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:59:32.950484 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ee48561f-ff5f-45a3-a0da-49d744a892cc tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:32.956094 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-ee48561f-ff5f-45a3-a0da-49d744a892cc tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:32.956973 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-8bb02a9f-9dbf-47de-bb49-6a88a94d5fce req-3f4f93d1-a465-4cda-8ef8-0c3bd882443d service nova] Creating event network-vif-deleted:9d8e2478-5181-4cd4-8ace-4d8db90a3726 for instance d9aca1b6-0002-43b1-acc4-e110530eac17 on n-h2-852278-4 Aug 27 02:59:32.959474 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:59:32.962985 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ee48561f-ff5f-45a3-a0da-49d744a892cc tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:32.963468 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ee48561f-ff5f-45a3-a0da-49d744a892cc tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:32.967781 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-8bb02a9f-9dbf-47de-bb49-6a88a94d5fce req-3f4f93d1-a465-4cda-8ef8-0c3bd882443d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070224 Aug 27 02:59:32.969896 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1938/3867] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:59:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:59:32.978017 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-93d771fa-e979-47ef-87a9-4f741c86ee0e tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:32.979125 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-93d771fa-e979-47ef-87a9-4f741c86ee0e tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] [instance: e7973075-ede5-4528-8d5f-83d994006015] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:32.985137 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ee48561f-ff5f-45a3-a0da-49d744a892cc tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:32.989678 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ee48561f-ff5f-45a3-a0da-49d744a892cc tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:32.990398 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ee48561f-ff5f-45a3-a0da-49d744a892cc tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:32.990974 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ee48561f-ff5f-45a3-a0da-49d744a892cc tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:33.253972 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-93d771fa-e979-47ef-87a9-4f741c86ee0e tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5557a4cfdaab4a7fa40c17bf9fc9ceb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503b9ec7c8e48ff95ce15b92a41118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:33.265230 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-93d771fa-e979-47ef-87a9-4f741c86ee0e tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] 10.222.0.70 "GET /compute/v2.1/servers/e7973075-ede5-4528-8d5f-83d994006015" status: 200 len: 1121 microversion: 2.1 time: 0.292150 Aug 27 02:59:33.265978 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1939/3868] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:59:32 2022] GET /compute/v2.1/servers/e7973075-ede5-4528-8d5f-83d994006015 => generated 1121 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:59:33.289740 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-29cff568-6f6e-41cd-b8ea-803b0697abcc tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:33.296629 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-29cff568-6f6e-41cd-b8ea-803b0697abcc tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] [instance: 9d9f666f-0b19-4d87-a94a-770b5d99f349] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:33.319371 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-29cff568-6f6e-41cd-b8ea-803b0697abcc tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:33.325337 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-29cff568-6f6e-41cd-b8ea-803b0697abcc tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:33.326733 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-29cff568-6f6e-41cd-b8ea-803b0697abcc tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:33.329209 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-29cff568-6f6e-41cd-b8ea-803b0697abcc tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:33.329788 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-29cff568-6f6e-41cd-b8ea-803b0697abcc tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:33.332164 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-29cff568-6f6e-41cd-b8ea-803b0697abcc tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:33.587886 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-ee48561f-ff5f-45a3-a0da-49d744a892cc tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:33.603704 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ee48561f-ff5f-45a3-a0da-49d744a892cc tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1674 microversion: 2.1 time: 0.656928 Aug 27 02:59:33.604704 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1930/3869] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:59:32 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1674 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:59:33.618374 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-cdb8cae2-75b9-485f-bec6-dd7ec34f619b tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:33.619240 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-cdb8cae2-75b9-485f-bec6-dd7ec34f619b tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] [instance: b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:33.629604 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cdb8cae2-75b9-485f-bec6-dd7ec34f619b tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:33.630108 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cdb8cae2-75b9-485f-bec6-dd7ec34f619b tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:33.631064 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cdb8cae2-75b9-485f-bec6-dd7ec34f619b tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:33.631805 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cdb8cae2-75b9-485f-bec6-dd7ec34f619b tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:33.633878 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cdb8cae2-75b9-485f-bec6-dd7ec34f619b tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:33.636641 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cdb8cae2-75b9-485f-bec6-dd7ec34f619b tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:33.658885 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-29cff568-6f6e-41cd-b8ea-803b0697abcc tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] 10.222.0.70 "GET /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.389289 Aug 27 02:59:33.659840 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1940/3870] 10.222.0.70 () {58 vars in 1275 bytes} [Sat Aug 27 02:59:33 2022] GET /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349/os-interface => generated 284 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:59:33.665787 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4e5e4471-092f-4589-9793-6eb3702053e9 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:33.666650 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-4e5e4471-092f-4589-9793-6eb3702053e9 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] [instance: d9aca1b6-0002-43b1-acc4-e110530eac17] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:33.676291 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4e5e4471-092f-4589-9793-6eb3702053e9 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:33.676818 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4e5e4471-092f-4589-9793-6eb3702053e9 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:33.677247 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4e5e4471-092f-4589-9793-6eb3702053e9 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:33.690514 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4e5e4471-092f-4589-9793-6eb3702053e9 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:33.690735 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4e5e4471-092f-4589-9793-6eb3702053e9 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:33.691184 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4e5e4471-092f-4589-9793-6eb3702053e9 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:33.721686 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-4e5e4471-092f-4589-9793-6eb3702053e9 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] HTTP exception thrown: Instance d9aca1b6-0002-43b1-acc4-e110530eac17 could not be found. Aug 27 02:59:33.732932 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4e5e4471-092f-4589-9793-6eb3702053e9 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Request method failure captured: Aug 27 02:59:33.732932 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/d9aca1b6-0002-43b1-acc4-e110530eac17 HTTP/1.1 Aug 27 02:59:33.732932 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:59:33.732932 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:59:33.732932 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:59:33.732932 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:59:33.732932 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:59:33.732932 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:59:33.732932 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:59:33.732932 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:59:33.732932 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYhvBeoIPAE1J_dkDVsKfHcjyZLR-B0HfA-KLWnSidELpFpq6Rzmn07ymrOqIagKR7oOTHvyV7LFkBC4DV83RUtYp3CwIBVPZx6JBEIYeMoofvoiqvoKGGsPk8pkFymyZWdKMWJDatV25h6FqdPtvrfe5AnJHag7R6fA__L8S4B9dnw Aug 27 02:59:33.732932 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:59:33.732932 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:59:33.732932 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:59:33.732932 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:59:33.732932 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:59:33.732932 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:59:33.732932 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: c47faacfcd434bf08187aad0ab70e5d9 Aug 27 02:59:33.732932 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ServerGroupTestJSON-1050994360 Aug 27 02:59:33.732932 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:59:33.732932 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:59:33.732932 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c47faacfcd434bf08187aad0ab70e5d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c47faacfcd434bf08187aad0ab70e5d9", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c47faacfcd434bf08187aad0ab70e5d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c47faacfcd434bf08187aad0ab70e5d9"}]}] Aug 27 02:59:33.732932 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ServerGroupTestJSON-1050994360 Aug 27 02:59:33.732932 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: c47faacfcd434bf08187aad0ab70e5d9 Aug 27 02:59:33.732932 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ServerGroupTestJSON-1050994360 Aug 27 02:59:33.732932 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ServerGroupTestJSON-1050994360-project Aug 27 02:59:33.732932 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:59:33.732932 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:59:33.732932 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 077ffba093574e27bdfb4d9a51910a8c Aug 27 02:59:33.732932 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ServerGroupTestJSON-1050994360-project Aug 27 02:59:33.732932 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 02:59:33.732932 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance d9aca1b6-0002-43b1-acc4-e110530eac17 could not be found. Aug 27 02:59:33.732932 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': 'd9aca1b6-0002-43b1-acc4-e110530eac17'} Aug 27 02:59:33.732932 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:59:33.732932 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:59:33.732932 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:59:33.732932 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:59:33.732932 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:59:33.732932 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:59:33.732932 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:59:33.732932 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:59:33.732932 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:59:33.732932 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:59:33.732932 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9aca1b6-0002-43b1-acc4-e110530eac17 could not be found. Aug 27 02:59:33.732932 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:59:33.732932 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:59:33.732932 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:59:33.732932 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:59:33.732932 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:59:33.732932 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:59:33.732932 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:59:33.732932 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:59:33.732932 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:59:33.732932 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:59:33.732932 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:59:33.732932 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:59:33.732932 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:59:33.732932 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:59:33.732932 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:59:33.732932 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:59:33.732932 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9aca1b6-0002-43b1-acc4-e110530eac17 could not be found. Aug 27 02:59:33.732932 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:59:33.732932 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:59:33.732932 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:59:33.737414 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:59:33.737414 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:59:33.737414 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:59:33.737414 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:59:33.737414 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:59:33.737414 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9aca1b6-0002-43b1-acc4-e110530eac17 could not be found. Aug 27 02:59:33.737414 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:59:33.738588 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4e5e4471-092f-4589-9793-6eb3702053e9 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Returning 404 to user: Instance d9aca1b6-0002-43b1-acc4-e110530eac17 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:59:33.739772 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-4e5e4471-092f-4589-9793-6eb3702053e9 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] 10.222.0.70 "GET /compute/v2.1/servers/d9aca1b6-0002-43b1-acc4-e110530eac17" status: 404 len: 111 microversion: 2.1 time: 0.078606 Aug 27 02:59:33.741134 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1941/3871] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:59:33 2022] GET /compute/v2.1/servers/d9aca1b6-0002-43b1-acc4-e110530eac17 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:59:33.753778 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-403d0506-44f5-4c6f-8e9e-4cc49e337b3b tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:33.776488 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.compute.server_groups [None req-403d0506-44f5-4c6f-8e9e-4cc49e337b3b tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Querying cell 9e3f7cc8-d9cf-4064-9831-4fdba8cfa839(cell1) for 1 instances {{(pid=134051) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 27 02:59:33.777561 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-403d0506-44f5-4c6f-8e9e-4cc49e337b3b tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:33.778193 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-403d0506-44f5-4c6f-8e9e-4cc49e337b3b tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:33.778873 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-403d0506-44f5-4c6f-8e9e-4cc49e337b3b tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:33.818722 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-403d0506-44f5-4c6f-8e9e-4cc49e337b3b tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] 10.222.0.70 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.068999 Aug 27 02:59:33.821103 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1942/3872] 10.222.0.70 () {58 vars in 1152 bytes} [Sat Aug 27 02:59:33 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:59:33.839470 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-6e3fa390-3556-4ce6-877d-a14c645cd51c tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:33.865547 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.compute.server_groups [None req-6e3fa390-3556-4ce6-877d-a14c645cd51c tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Querying cell 9e3f7cc8-d9cf-4064-9831-4fdba8cfa839(cell1) for 1 instances {{(pid=134051) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 27 02:59:33.866275 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6e3fa390-3556-4ce6-877d-a14c645cd51c tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:33.867306 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6e3fa390-3556-4ce6-877d-a14c645cd51c tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:33.868026 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6e3fa390-3556-4ce6-877d-a14c645cd51c tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:33.885702 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-6e3fa390-3556-4ce6-877d-a14c645cd51c tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] 10.222.0.70 "GET /compute/v2.1/os-server-groups/a1fd45b4-d0b5-4072-9d82-03e76576968a" status: 200 len: 183 microversion: 2.1 time: 0.057288 Aug 27 02:59:33.893336 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1943/3873] 10.222.0.70 () {58 vars in 1263 bytes} [Sat Aug 27 02:59:33 2022] GET /compute/v2.1/os-server-groups/a1fd45b4-d0b5-4072-9d82-03e76576968a => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:59:33.902320 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4404dc2f-0a24-4f5b-9c37-1273ba29f5d8 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:33.902830 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-4404dc2f-0a24-4f5b-9c37-1273ba29f5d8 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] [instance: d9aca1b6-0002-43b1-acc4-e110530eac17] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:33.911994 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4404dc2f-0a24-4f5b-9c37-1273ba29f5d8 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:33.912711 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4404dc2f-0a24-4f5b-9c37-1273ba29f5d8 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:33.913425 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4404dc2f-0a24-4f5b-9c37-1273ba29f5d8 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:33.914380 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4404dc2f-0a24-4f5b-9c37-1273ba29f5d8 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:33.914939 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4404dc2f-0a24-4f5b-9c37-1273ba29f5d8 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:33.915372 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4404dc2f-0a24-4f5b-9c37-1273ba29f5d8 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:33.939073 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-4404dc2f-0a24-4f5b-9c37-1273ba29f5d8 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] HTTP exception thrown: Instance d9aca1b6-0002-43b1-acc4-e110530eac17 could not be found. Aug 27 02:59:33.942607 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4404dc2f-0a24-4f5b-9c37-1273ba29f5d8 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Request method failure captured: Aug 27 02:59:33.942607 n-d-852278-4 devstack@n-api.service[134051]: request: DELETE /compute/v2.1/servers/d9aca1b6-0002-43b1-acc4-e110530eac17 HTTP/1.1 Aug 27 02:59:33.942607 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:59:33.942607 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:59:33.942607 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:59:33.942607 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:59:33.942607 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:59:33.942607 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:59:33.942607 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:59:33.942607 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:59:33.942607 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYhvBeoIPAE1J_dkDVsKfHcjyZLR-B0HfA-KLWnSidELpFpq6Rzmn07ymrOqIagKR7oOTHvyV7LFkBC4DV83RUtYp3CwIBVPZx6JBEIYeMoofvoiqvoKGGsPk8pkFymyZWdKMWJDatV25h6FqdPtvrfe5AnJHag7R6fA__L8S4B9dnw Aug 27 02:59:33.942607 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:59:33.942607 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:59:33.942607 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:59:33.942607 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:59:33.942607 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:59:33.942607 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:59:33.942607 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: c47faacfcd434bf08187aad0ab70e5d9 Aug 27 02:59:33.942607 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ServerGroupTestJSON-1050994360 Aug 27 02:59:33.942607 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:59:33.942607 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:59:33.942607 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c47faacfcd434bf08187aad0ab70e5d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c47faacfcd434bf08187aad0ab70e5d9", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c47faacfcd434bf08187aad0ab70e5d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c47faacfcd434bf08187aad0ab70e5d9"}]}] Aug 27 02:59:33.942607 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ServerGroupTestJSON-1050994360 Aug 27 02:59:33.942607 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: c47faacfcd434bf08187aad0ab70e5d9 Aug 27 02:59:33.942607 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ServerGroupTestJSON-1050994360 Aug 27 02:59:33.942607 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ServerGroupTestJSON-1050994360-project Aug 27 02:59:33.942607 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:59:33.942607 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:59:33.942607 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 077ffba093574e27bdfb4d9a51910a8c Aug 27 02:59:33.942607 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ServerGroupTestJSON-1050994360-project Aug 27 02:59:33.942607 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 02:59:33.942607 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance d9aca1b6-0002-43b1-acc4-e110530eac17 could not be found. Aug 27 02:59:33.942607 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': 'd9aca1b6-0002-43b1-acc4-e110530eac17'} Aug 27 02:59:33.942607 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:59:33.942607 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:59:33.942607 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:59:33.942607 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:59:33.942607 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:59:33.942607 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:59:33.942607 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:59:33.942607 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:59:33.942607 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:59:33.942607 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:59:33.942607 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9aca1b6-0002-43b1-acc4-e110530eac17 could not be found. Aug 27 02:59:33.942607 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:59:33.942607 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:59:33.942607 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:59:33.942607 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:59:33.942607 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:59:33.942607 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:59:33.942607 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:59:33.942607 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:59:33.942607 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:59:33.942607 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:59:33.942607 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 02:59:33.942607 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 02:59:33.942607 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 02:59:33.942607 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 02:59:33.942607 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:59:33.942607 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:59:33.942607 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:59:33.942607 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:59:33.947017 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9aca1b6-0002-43b1-acc4-e110530eac17 could not be found. Aug 27 02:59:33.947017 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:59:33.947017 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:59:33.947017 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:59:33.947017 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:59:33.947017 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:59:33.947017 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:59:33.947017 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:59:33.947017 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:59:33.947017 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9aca1b6-0002-43b1-acc4-e110530eac17 could not be found. Aug 27 02:59:33.947017 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:59:33.948781 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4404dc2f-0a24-4f5b-9c37-1273ba29f5d8 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Returning 404 to user: Instance d9aca1b6-0002-43b1-acc4-e110530eac17 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:59:33.950510 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-4404dc2f-0a24-4f5b-9c37-1273ba29f5d8 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] 10.222.0.70 "DELETE /compute/v2.1/servers/d9aca1b6-0002-43b1-acc4-e110530eac17" status: 404 len: 111 microversion: 2.1 time: 0.055226 Aug 27 02:59:33.953042 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1944/3874] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 02:59:33 2022] DELETE /compute/v2.1/servers/d9aca1b6-0002-43b1-acc4-e110530eac17 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:59:33.964032 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b1188398-f62a-4aa0-9ba6-b9cf8c7f6b29 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:33.965080 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b1188398-f62a-4aa0-9ba6-b9cf8c7f6b29 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] [instance: d9aca1b6-0002-43b1-acc4-e110530eac17] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:33.977043 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b1188398-f62a-4aa0-9ba6-b9cf8c7f6b29 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:33.977835 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b1188398-f62a-4aa0-9ba6-b9cf8c7f6b29 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:33.978431 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b1188398-f62a-4aa0-9ba6-b9cf8c7f6b29 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:33.979310 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b1188398-f62a-4aa0-9ba6-b9cf8c7f6b29 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:33.979915 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b1188398-f62a-4aa0-9ba6-b9cf8c7f6b29 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:33.980549 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b1188398-f62a-4aa0-9ba6-b9cf8c7f6b29 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:33.982928 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-cdb8cae2-75b9-485f-bec6-dd7ec34f619b tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:34.004057 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-cdb8cae2-75b9-485f-bec6-dd7ec34f619b tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:34.008587 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-b1188398-f62a-4aa0-9ba6-b9cf8c7f6b29 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] HTTP exception thrown: Instance d9aca1b6-0002-43b1-acc4-e110530eac17 could not be found. Aug 27 02:59:34.011034 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b1188398-f62a-4aa0-9ba6-b9cf8c7f6b29 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Request method failure captured: Aug 27 02:59:34.011034 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/d9aca1b6-0002-43b1-acc4-e110530eac17 HTTP/1.1 Aug 27 02:59:34.011034 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:59:34.011034 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:59:34.011034 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:59:34.011034 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:59:34.011034 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:59:34.011034 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:59:34.011034 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:59:34.011034 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:59:34.011034 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYhvBeoIPAE1J_dkDVsKfHcjyZLR-B0HfA-KLWnSidELpFpq6Rzmn07ymrOqIagKR7oOTHvyV7LFkBC4DV83RUtYp3CwIBVPZx6JBEIYeMoofvoiqvoKGGsPk8pkFymyZWdKMWJDatV25h6FqdPtvrfe5AnJHag7R6fA__L8S4B9dnw Aug 27 02:59:34.011034 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:59:34.011034 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:59:34.011034 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:59:34.011034 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:59:34.011034 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:59:34.011034 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:59:34.011034 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: c47faacfcd434bf08187aad0ab70e5d9 Aug 27 02:59:34.011034 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ServerGroupTestJSON-1050994360 Aug 27 02:59:34.011034 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:59:34.011034 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:59:34.011034 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c47faacfcd434bf08187aad0ab70e5d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c47faacfcd434bf08187aad0ab70e5d9", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c47faacfcd434bf08187aad0ab70e5d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c47faacfcd434bf08187aad0ab70e5d9"}]}] Aug 27 02:59:34.011034 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ServerGroupTestJSON-1050994360 Aug 27 02:59:34.011034 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: c47faacfcd434bf08187aad0ab70e5d9 Aug 27 02:59:34.011034 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ServerGroupTestJSON-1050994360 Aug 27 02:59:34.011034 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ServerGroupTestJSON-1050994360-project Aug 27 02:59:34.011034 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:59:34.011034 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:59:34.011034 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 077ffba093574e27bdfb4d9a51910a8c Aug 27 02:59:34.011034 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ServerGroupTestJSON-1050994360-project Aug 27 02:59:34.011034 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 02:59:34.011034 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance d9aca1b6-0002-43b1-acc4-e110530eac17 could not be found. Aug 27 02:59:34.011034 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': 'd9aca1b6-0002-43b1-acc4-e110530eac17'} Aug 27 02:59:34.011034 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:59:34.011034 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:59:34.011034 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:59:34.011034 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:59:34.011034 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:59:34.011034 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:59:34.011034 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:59:34.011034 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:59:34.011034 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:59:34.011034 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:59:34.011034 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9aca1b6-0002-43b1-acc4-e110530eac17 could not be found. Aug 27 02:59:34.011034 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:59:34.011034 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:59:34.011034 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:59:34.011034 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:59:34.011034 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:59:34.011034 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:59:34.011034 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:59:34.011034 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:59:34.011034 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:59:34.011034 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:59:34.011034 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:59:34.011034 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:59:34.011034 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:59:34.011034 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:59:34.011034 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:59:34.011034 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:59:34.011034 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9aca1b6-0002-43b1-acc4-e110530eac17 could not be found. Aug 27 02:59:34.011034 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:59:34.011034 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:59:34.011034 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:59:34.015940 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:59:34.015940 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:59:34.015940 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:59:34.015940 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:59:34.015940 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:59:34.015940 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9aca1b6-0002-43b1-acc4-e110530eac17 could not be found. Aug 27 02:59:34.015940 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:59:34.016416 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-cdb8cae2-75b9-485f-bec6-dd7ec34f619b tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:34.016416 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-cdb8cae2-75b9-485f-bec6-dd7ec34f619b tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] 10.222.0.70 "GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7" status: 200 len: 1604 microversion: 2.32 time: 0.407526 Aug 27 02:59:34.018986 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b1188398-f62a-4aa0-9ba6-b9cf8c7f6b29 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Returning 404 to user: Instance d9aca1b6-0002-43b1-acc4-e110530eac17 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:59:34.020025 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b1188398-f62a-4aa0-9ba6-b9cf8c7f6b29 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] 10.222.0.70 "GET /compute/v2.1/servers/d9aca1b6-0002-43b1-acc4-e110530eac17" status: 404 len: 111 microversion: 2.1 time: 0.062974 Aug 27 02:59:34.021148 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1945/3875] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:59:33 2022] GET /compute/v2.1/servers/d9aca1b6-0002-43b1-acc4-e110530eac17 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 02:59:34.029344 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1931/3876] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:59:33 2022] GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 => generated 1604 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:59:34.059039 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4b07adb0-dc10-413f-9e34-54f200618933 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:34.074462 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-4b07adb0-dc10-413f-9e34-54f200618933 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] HTTP exception thrown: Instance group 53f1b458-fdbd-456a-a329-77d895391599 could not be found. Aug 27 02:59:34.083590 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4b07adb0-dc10-413f-9e34-54f200618933 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Request method failure captured: Aug 27 02:59:34.083590 n-d-852278-4 devstack@n-api.service[134051]: request: DELETE /compute/v2.1/os-server-groups/53f1b458-fdbd-456a-a329-77d895391599 HTTP/1.1 Aug 27 02:59:34.083590 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:59:34.083590 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:59:34.083590 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:59:34.083590 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:59:34.083590 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:59:34.083590 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:59:34.083590 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:59:34.083590 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:59:34.083590 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYhvBeoIPAE1J_dkDVsKfHcjyZLR-B0HfA-KLWnSidELpFpq6Rzmn07ymrOqIagKR7oOTHvyV7LFkBC4DV83RUtYp3CwIBVPZx6JBEIYeMoofvoiqvoKGGsPk8pkFymyZWdKMWJDatV25h6FqdPtvrfe5AnJHag7R6fA__L8S4B9dnw Aug 27 02:59:34.083590 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:59:34.083590 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:59:34.083590 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:59:34.083590 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:59:34.083590 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:59:34.083590 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:59:34.083590 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: c47faacfcd434bf08187aad0ab70e5d9 Aug 27 02:59:34.083590 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ServerGroupTestJSON-1050994360 Aug 27 02:59:34.083590 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:59:34.083590 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:59:34.083590 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c47faacfcd434bf08187aad0ab70e5d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c47faacfcd434bf08187aad0ab70e5d9", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c47faacfcd434bf08187aad0ab70e5d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c47faacfcd434bf08187aad0ab70e5d9"}]}] Aug 27 02:59:34.083590 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ServerGroupTestJSON-1050994360 Aug 27 02:59:34.083590 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: c47faacfcd434bf08187aad0ab70e5d9 Aug 27 02:59:34.083590 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ServerGroupTestJSON-1050994360 Aug 27 02:59:34.083590 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ServerGroupTestJSON-1050994360-project Aug 27 02:59:34.083590 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:59:34.083590 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:59:34.083590 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 077ffba093574e27bdfb4d9a51910a8c Aug 27 02:59:34.083590 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ServerGroupTestJSON-1050994360-project Aug 27 02:59:34.083590 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 02:59:34.083590 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance group 53f1b458-fdbd-456a-a329-77d895391599 could not be found. Aug 27 02:59:34.083590 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '53f1b458-fdbd-456a-a329-77d895391599'} Aug 27 02:59:34.083590 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:59:34.083590 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:59:34.083590 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 27 02:59:34.083590 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 27 02:59:34.083590 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 02:59:34.083590 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 02:59:34.083590 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 27 02:59:34.083590 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 27 02:59:34.083590 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 02:59:34.083590 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 02:59:34.083590 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 27 02:59:34.083590 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 27 02:59:34.083590 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 53f1b458-fdbd-456a-a329-77d895391599 could not be found. Aug 27 02:59:34.083590 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:59:34.083590 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:59:34.083590 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:59:34.083590 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:59:34.083590 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:59:34.083590 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:59:34.083590 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:59:34.083590 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:59:34.083590 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:59:34.083590 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:59:34.083590 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 27 02:59:34.083590 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:59:34.083590 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 53f1b458-fdbd-456a-a329-77d895391599 could not be found. Aug 27 02:59:34.083590 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:59:34.083590 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:59:34.083590 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:59:34.083590 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:59:34.088930 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:59:34.088930 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:59:34.088930 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:59:34.088930 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:59:34.088930 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 53f1b458-fdbd-456a-a329-77d895391599 could not be found. Aug 27 02:59:34.088930 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:59:34.095916 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4b07adb0-dc10-413f-9e34-54f200618933 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Returning 404 to user: Instance group 53f1b458-fdbd-456a-a329-77d895391599 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:59:34.097188 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-4b07adb0-dc10-413f-9e34-54f200618933 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] 10.222.0.70 "DELETE /compute/v2.1/os-server-groups/53f1b458-fdbd-456a-a329-77d895391599" status: 404 len: 117 microversion: 2.1 time: 0.062156 Aug 27 02:59:34.098348 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1946/3877] 10.222.0.70 () {58 vars in 1266 bytes} [Sat Aug 27 02:59:34 2022] DELETE /compute/v2.1/os-server-groups/53f1b458-fdbd-456a-a329-77d895391599 => generated 117 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:59:34.109055 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c058fd13-bb29-420a-81eb-959c1087783d tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:34.121412 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-c058fd13-bb29-420a-81eb-959c1087783d tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] HTTP exception thrown: Instance group 9ec53a63-8e26-4414-a5a3-a1f52a7968a4 could not be found. Aug 27 02:59:34.127963 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c058fd13-bb29-420a-81eb-959c1087783d tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Request method failure captured: Aug 27 02:59:34.127963 n-d-852278-4 devstack@n-api.service[134052]: request: DELETE /compute/v2.1/os-server-groups/9ec53a63-8e26-4414-a5a3-a1f52a7968a4 HTTP/1.1 Aug 27 02:59:34.127963 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:59:34.127963 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:59:34.127963 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:59:34.127963 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:59:34.127963 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:59:34.127963 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:59:34.127963 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:59:34.127963 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:59:34.127963 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYhvBeoIPAE1J_dkDVsKfHcjyZLR-B0HfA-KLWnSidELpFpq6Rzmn07ymrOqIagKR7oOTHvyV7LFkBC4DV83RUtYp3CwIBVPZx6JBEIYeMoofvoiqvoKGGsPk8pkFymyZWdKMWJDatV25h6FqdPtvrfe5AnJHag7R6fA__L8S4B9dnw Aug 27 02:59:34.127963 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:59:34.127963 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:59:34.127963 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:59:34.127963 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:59:34.127963 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:59:34.127963 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:59:34.127963 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: c47faacfcd434bf08187aad0ab70e5d9 Aug 27 02:59:34.127963 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ServerGroupTestJSON-1050994360 Aug 27 02:59:34.127963 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:59:34.127963 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:59:34.127963 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c47faacfcd434bf08187aad0ab70e5d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c47faacfcd434bf08187aad0ab70e5d9", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c47faacfcd434bf08187aad0ab70e5d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c47faacfcd434bf08187aad0ab70e5d9"}]}] Aug 27 02:59:34.127963 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ServerGroupTestJSON-1050994360 Aug 27 02:59:34.127963 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: c47faacfcd434bf08187aad0ab70e5d9 Aug 27 02:59:34.127963 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ServerGroupTestJSON-1050994360 Aug 27 02:59:34.127963 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ServerGroupTestJSON-1050994360-project Aug 27 02:59:34.127963 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:59:34.127963 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:59:34.127963 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 077ffba093574e27bdfb4d9a51910a8c Aug 27 02:59:34.127963 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ServerGroupTestJSON-1050994360-project Aug 27 02:59:34.127963 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 02:59:34.127963 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance group 9ec53a63-8e26-4414-a5a3-a1f52a7968a4 could not be found. Aug 27 02:59:34.127963 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '9ec53a63-8e26-4414-a5a3-a1f52a7968a4'} Aug 27 02:59:34.127963 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:59:34.127963 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:59:34.127963 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 27 02:59:34.127963 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 27 02:59:34.127963 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 02:59:34.127963 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 02:59:34.127963 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 27 02:59:34.127963 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 27 02:59:34.127963 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 02:59:34.127963 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 02:59:34.127963 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 27 02:59:34.127963 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 27 02:59:34.127963 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 9ec53a63-8e26-4414-a5a3-a1f52a7968a4 could not be found. Aug 27 02:59:34.127963 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:59:34.127963 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:59:34.127963 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:59:34.127963 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:59:34.127963 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:59:34.127963 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:59:34.127963 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:59:34.127963 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:59:34.127963 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:59:34.127963 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:59:34.127963 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 27 02:59:34.127963 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:59:34.127963 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 9ec53a63-8e26-4414-a5a3-a1f52a7968a4 could not be found. Aug 27 02:59:34.127963 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:59:34.127963 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:59:34.127963 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:59:34.127963 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:59:34.132514 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:59:34.132514 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:59:34.132514 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:59:34.132514 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:59:34.132514 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 9ec53a63-8e26-4414-a5a3-a1f52a7968a4 could not be found. Aug 27 02:59:34.132514 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:59:34.135964 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c058fd13-bb29-420a-81eb-959c1087783d tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Returning 404 to user: Instance group 9ec53a63-8e26-4414-a5a3-a1f52a7968a4 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:59:34.137516 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c058fd13-bb29-420a-81eb-959c1087783d tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] 10.222.0.70 "DELETE /compute/v2.1/os-server-groups/9ec53a63-8e26-4414-a5a3-a1f52a7968a4" status: 404 len: 117 microversion: 2.1 time: 0.034994 Aug 27 02:59:34.138984 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1932/3878] 10.222.0.70 () {58 vars in 1266 bytes} [Sat Aug 27 02:59:34 2022] DELETE /compute/v2.1/os-server-groups/9ec53a63-8e26-4414-a5a3-a1f52a7968a4 => generated 117 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:59:34.149463 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-919e3bc7-9b8a-4f94-bff5-b858f633fd0d tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:34.160753 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-919e3bc7-9b8a-4f94-bff5-b858f633fd0d tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] HTTP exception thrown: Instance group 76c5042e-f5fa-4b2f-9cdf-078629b33043 could not be found. Aug 27 02:59:34.163227 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-919e3bc7-9b8a-4f94-bff5-b858f633fd0d tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Request method failure captured: Aug 27 02:59:34.163227 n-d-852278-4 devstack@n-api.service[134051]: request: DELETE /compute/v2.1/os-server-groups/76c5042e-f5fa-4b2f-9cdf-078629b33043 HTTP/1.1 Aug 27 02:59:34.163227 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:59:34.163227 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:59:34.163227 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:59:34.163227 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:59:34.163227 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:59:34.163227 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:59:34.163227 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:59:34.163227 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:59:34.163227 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYhvBeoIPAE1J_dkDVsKfHcjyZLR-B0HfA-KLWnSidELpFpq6Rzmn07ymrOqIagKR7oOTHvyV7LFkBC4DV83RUtYp3CwIBVPZx6JBEIYeMoofvoiqvoKGGsPk8pkFymyZWdKMWJDatV25h6FqdPtvrfe5AnJHag7R6fA__L8S4B9dnw Aug 27 02:59:34.163227 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:59:34.163227 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:59:34.163227 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:59:34.163227 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:59:34.163227 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:59:34.163227 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:59:34.163227 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: c47faacfcd434bf08187aad0ab70e5d9 Aug 27 02:59:34.163227 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ServerGroupTestJSON-1050994360 Aug 27 02:59:34.163227 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:59:34.163227 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:59:34.163227 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c47faacfcd434bf08187aad0ab70e5d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c47faacfcd434bf08187aad0ab70e5d9", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c47faacfcd434bf08187aad0ab70e5d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c47faacfcd434bf08187aad0ab70e5d9"}]}] Aug 27 02:59:34.163227 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ServerGroupTestJSON-1050994360 Aug 27 02:59:34.163227 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: c47faacfcd434bf08187aad0ab70e5d9 Aug 27 02:59:34.163227 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ServerGroupTestJSON-1050994360 Aug 27 02:59:34.163227 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ServerGroupTestJSON-1050994360-project Aug 27 02:59:34.163227 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:59:34.163227 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:59:34.163227 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 077ffba093574e27bdfb4d9a51910a8c Aug 27 02:59:34.163227 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ServerGroupTestJSON-1050994360-project Aug 27 02:59:34.163227 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 02:59:34.163227 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance group 76c5042e-f5fa-4b2f-9cdf-078629b33043 could not be found. Aug 27 02:59:34.163227 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '76c5042e-f5fa-4b2f-9cdf-078629b33043'} Aug 27 02:59:34.163227 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:59:34.163227 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:59:34.163227 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 27 02:59:34.163227 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 27 02:59:34.163227 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 02:59:34.163227 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 02:59:34.163227 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 27 02:59:34.163227 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 27 02:59:34.163227 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 02:59:34.163227 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 02:59:34.163227 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 27 02:59:34.163227 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 27 02:59:34.163227 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 76c5042e-f5fa-4b2f-9cdf-078629b33043 could not be found. Aug 27 02:59:34.163227 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:59:34.163227 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:59:34.163227 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:59:34.163227 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:59:34.163227 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:59:34.163227 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:59:34.163227 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:59:34.163227 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:59:34.163227 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:59:34.163227 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:59:34.163227 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 27 02:59:34.163227 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:59:34.163227 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 76c5042e-f5fa-4b2f-9cdf-078629b33043 could not be found. Aug 27 02:59:34.163227 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:59:34.163227 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:59:34.163227 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:59:34.163227 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:59:34.167579 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:59:34.167579 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:59:34.167579 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:59:34.167579 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:59:34.167579 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 76c5042e-f5fa-4b2f-9cdf-078629b33043 could not be found. Aug 27 02:59:34.167579 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:59:34.170838 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-919e3bc7-9b8a-4f94-bff5-b858f633fd0d tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Returning 404 to user: Instance group 76c5042e-f5fa-4b2f-9cdf-078629b33043 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:59:34.172397 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-919e3bc7-9b8a-4f94-bff5-b858f633fd0d tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] 10.222.0.70 "DELETE /compute/v2.1/os-server-groups/76c5042e-f5fa-4b2f-9cdf-078629b33043" status: 404 len: 117 microversion: 2.1 time: 0.029730 Aug 27 02:59:34.174327 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1947/3879] 10.222.0.70 () {58 vars in 1266 bytes} [Sat Aug 27 02:59:34 2022] DELETE /compute/v2.1/os-server-groups/76c5042e-f5fa-4b2f-9cdf-078629b33043 => generated 117 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 02:59:34.184719 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-efdfa034-e7ed-4fbc-b85c-475af335476e tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:34.194187 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-efdfa034-e7ed-4fbc-b85c-475af335476e tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] HTTP exception thrown: Instance group 9ebc3b3c-17db-4a22-a9f8-8d7fd432d170 could not be found. Aug 27 02:59:34.196401 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-efdfa034-e7ed-4fbc-b85c-475af335476e tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Request method failure captured: Aug 27 02:59:34.196401 n-d-852278-4 devstack@n-api.service[134052]: request: DELETE /compute/v2.1/os-server-groups/9ebc3b3c-17db-4a22-a9f8-8d7fd432d170 HTTP/1.1 Aug 27 02:59:34.196401 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:59:34.196401 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:59:34.196401 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:59:34.196401 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:59:34.196401 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:59:34.196401 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:59:34.196401 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:59:34.196401 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:59:34.196401 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYhvBeoIPAE1J_dkDVsKfHcjyZLR-B0HfA-KLWnSidELpFpq6Rzmn07ymrOqIagKR7oOTHvyV7LFkBC4DV83RUtYp3CwIBVPZx6JBEIYeMoofvoiqvoKGGsPk8pkFymyZWdKMWJDatV25h6FqdPtvrfe5AnJHag7R6fA__L8S4B9dnw Aug 27 02:59:34.196401 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:59:34.196401 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:59:34.196401 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:59:34.196401 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:59:34.196401 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:59:34.196401 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:59:34.196401 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: c47faacfcd434bf08187aad0ab70e5d9 Aug 27 02:59:34.196401 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ServerGroupTestJSON-1050994360 Aug 27 02:59:34.196401 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:59:34.196401 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:59:34.196401 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c47faacfcd434bf08187aad0ab70e5d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c47faacfcd434bf08187aad0ab70e5d9", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c47faacfcd434bf08187aad0ab70e5d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c47faacfcd434bf08187aad0ab70e5d9"}]}] Aug 27 02:59:34.196401 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ServerGroupTestJSON-1050994360 Aug 27 02:59:34.196401 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: c47faacfcd434bf08187aad0ab70e5d9 Aug 27 02:59:34.196401 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ServerGroupTestJSON-1050994360 Aug 27 02:59:34.196401 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ServerGroupTestJSON-1050994360-project Aug 27 02:59:34.196401 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:59:34.196401 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:59:34.196401 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 077ffba093574e27bdfb4d9a51910a8c Aug 27 02:59:34.196401 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ServerGroupTestJSON-1050994360-project Aug 27 02:59:34.196401 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 02:59:34.196401 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance group 9ebc3b3c-17db-4a22-a9f8-8d7fd432d170 could not be found. Aug 27 02:59:34.196401 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '9ebc3b3c-17db-4a22-a9f8-8d7fd432d170'} Aug 27 02:59:34.196401 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:59:34.196401 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:59:34.196401 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 27 02:59:34.196401 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 27 02:59:34.196401 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 02:59:34.196401 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 02:59:34.196401 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 27 02:59:34.196401 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 27 02:59:34.196401 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 02:59:34.196401 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 02:59:34.196401 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 27 02:59:34.196401 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 27 02:59:34.196401 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 9ebc3b3c-17db-4a22-a9f8-8d7fd432d170 could not be found. Aug 27 02:59:34.196401 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:59:34.196401 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:59:34.196401 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:59:34.196401 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:59:34.196401 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:59:34.196401 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:59:34.196401 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:59:34.196401 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:59:34.196401 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:59:34.196401 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:59:34.196401 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 27 02:59:34.196401 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:59:34.196401 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 9ebc3b3c-17db-4a22-a9f8-8d7fd432d170 could not be found. Aug 27 02:59:34.196401 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:59:34.196401 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:59:34.196401 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:59:34.196401 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:59:34.200479 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:59:34.200479 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:59:34.200479 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:59:34.200479 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:59:34.200479 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 9ebc3b3c-17db-4a22-a9f8-8d7fd432d170 could not be found. Aug 27 02:59:34.200479 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:59:34.203074 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-efdfa034-e7ed-4fbc-b85c-475af335476e tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Returning 404 to user: Instance group 9ebc3b3c-17db-4a22-a9f8-8d7fd432d170 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:59:34.204158 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-efdfa034-e7ed-4fbc-b85c-475af335476e tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] 10.222.0.70 "DELETE /compute/v2.1/os-server-groups/9ebc3b3c-17db-4a22-a9f8-8d7fd432d170" status: 404 len: 117 microversion: 2.1 time: 0.024785 Aug 27 02:59:34.205350 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1933/3880] 10.222.0.70 () {58 vars in 1266 bytes} [Sat Aug 27 02:59:34 2022] DELETE /compute/v2.1/os-server-groups/9ebc3b3c-17db-4a22-a9f8-8d7fd432d170 => generated 117 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:59:34.216608 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-95ae668b-0e9e-47da-9829-491c47b50ff0 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:34.290392 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-95ae668b-0e9e-47da-9829-491c47b50ff0 tempest-ServerGroupTestJSON-1050994360 tempest-ServerGroupTestJSON-1050994360-project] 10.222.0.70 "DELETE /compute/v2.1/os-server-groups/a1fd45b4-d0b5-4072-9d82-03e76576968a" status: 204 len: 0 microversion: 2.1 time: 0.080638 Aug 27 02:59:34.291946 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0e1d28c0-c130-4d86-bf77-4e7912e58b28 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:34.292598 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-0e1d28c0-c130-4d86-bf77-4e7912e58b28 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] [instance: e7973075-ede5-4528-8d5f-83d994006015] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:34.296776 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1948/3881] 10.222.0.70 () {58 vars in 1266 bytes} [Sat Aug 27 02:59:34 2022] DELETE /compute/v2.1/os-server-groups/a1fd45b4-d0b5-4072-9d82-03e76576968a => generated 0 bytes in 84 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:59:34.307294 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0e1d28c0-c130-4d86-bf77-4e7912e58b28 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:34.308341 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0e1d28c0-c130-4d86-bf77-4e7912e58b28 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:34.310725 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0e1d28c0-c130-4d86-bf77-4e7912e58b28 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:34.311487 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0e1d28c0-c130-4d86-bf77-4e7912e58b28 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:34.312105 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0e1d28c0-c130-4d86-bf77-4e7912e58b28 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:34.312567 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0e1d28c0-c130-4d86-bf77-4e7912e58b28 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:34.631291 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7cbba438-e59a-4e82-b4fd-506eef8b5798 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:34.631912 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-7cbba438-e59a-4e82-b4fd-506eef8b5798 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:34.651508 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7cbba438-e59a-4e82-b4fd-506eef8b5798 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:34.652281 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7cbba438-e59a-4e82-b4fd-506eef8b5798 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:34.655930 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7cbba438-e59a-4e82-b4fd-506eef8b5798 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:34.659682 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7cbba438-e59a-4e82-b4fd-506eef8b5798 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:34.660186 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7cbba438-e59a-4e82-b4fd-506eef8b5798 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:34.660653 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7cbba438-e59a-4e82-b4fd-506eef8b5798 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:34.690139 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0e1d28c0-c130-4d86-bf77-4e7912e58b28 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5557a4cfdaab4a7fa40c17bf9fc9ceb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503b9ec7c8e48ff95ce15b92a41118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:34.703040 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-0e1d28c0-c130-4d86-bf77-4e7912e58b28 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] 10.222.0.70 "GET /compute/v2.1/servers/e7973075-ede5-4528-8d5f-83d994006015" status: 200 len: 1219 microversion: 2.1 time: 0.421650 Aug 27 02:59:34.707082 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1934/3882] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:59:34 2022] GET /compute/v2.1/servers/e7973075-ede5-4528-8d5f-83d994006015 => generated 1219 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:59:35.020532 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-7cbba438-e59a-4e82-b4fd-506eef8b5798 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:35.028866 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-7cbba438-e59a-4e82-b4fd-506eef8b5798 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1608 microversion: 2.1 time: 0.403650 Aug 27 02:59:35.039074 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1949/3883] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:59:34 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1608 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:59:35.043159 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-1429cca4-df9c-4e82-b0fa-ccc8eeb876b9 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:35.043795 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-1429cca4-df9c-4e82-b0fa-ccc8eeb876b9 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] [instance: b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:35.056826 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1429cca4-df9c-4e82-b0fa-ccc8eeb876b9 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:35.057336 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1429cca4-df9c-4e82-b0fa-ccc8eeb876b9 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:35.062003 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1429cca4-df9c-4e82-b0fa-ccc8eeb876b9 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:35.062888 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1429cca4-df9c-4e82-b0fa-ccc8eeb876b9 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:35.064002 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1429cca4-df9c-4e82-b0fa-ccc8eeb876b9 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:35.064639 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1429cca4-df9c-4e82-b0fa-ccc8eeb876b9 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:35.729582 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-769c3e34-212d-4cbc-bf51-0e45747eef1b tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:35.730200 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-769c3e34-212d-4cbc-bf51-0e45747eef1b tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] [instance: e7973075-ede5-4528-8d5f-83d994006015] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:35.745174 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-769c3e34-212d-4cbc-bf51-0e45747eef1b tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:35.746578 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-769c3e34-212d-4cbc-bf51-0e45747eef1b tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:35.746578 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-769c3e34-212d-4cbc-bf51-0e45747eef1b tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:35.747068 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-769c3e34-212d-4cbc-bf51-0e45747eef1b tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:35.747524 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-769c3e34-212d-4cbc-bf51-0e45747eef1b tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:35.747944 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-769c3e34-212d-4cbc-bf51-0e45747eef1b tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:35.825932 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-1429cca4-df9c-4e82-b0fa-ccc8eeb876b9 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:35.843307 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-1429cca4-df9c-4e82-b0fa-ccc8eeb876b9 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:35.847781 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-1429cca4-df9c-4e82-b0fa-ccc8eeb876b9 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:35.851077 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-1429cca4-df9c-4e82-b0fa-ccc8eeb876b9 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] 10.222.0.70 "GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7" status: 200 len: 1604 microversion: 2.32 time: 0.811323 Aug 27 02:59:35.854534 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1935/3884] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:59:35 2022] GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 => generated 1604 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:59:35.970760 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-769c3e34-212d-4cbc-bf51-0e45747eef1b tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5557a4cfdaab4a7fa40c17bf9fc9ceb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503b9ec7c8e48ff95ce15b92a41118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:35.994414 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-769c3e34-212d-4cbc-bf51-0e45747eef1b tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] 10.222.0.70 "GET /compute/v2.1/servers/e7973075-ede5-4528-8d5f-83d994006015" status: 200 len: 1237 microversion: 2.1 time: 0.268714 Aug 27 02:59:35.994950 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1950/3885] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:59:35 2022] GET /compute/v2.1/servers/e7973075-ede5-4528-8d5f-83d994006015 => generated 1237 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:59:36.061901 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d1804724-a919-4474-97ff-425fcf43e6b6 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:36.062654 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d1804724-a919-4474-97ff-425fcf43e6b6 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:36.079529 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d1804724-a919-4474-97ff-425fcf43e6b6 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:36.080517 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d1804724-a919-4474-97ff-425fcf43e6b6 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:36.082748 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d1804724-a919-4474-97ff-425fcf43e6b6 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:36.084040 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d1804724-a919-4474-97ff-425fcf43e6b6 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:36.084812 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d1804724-a919-4474-97ff-425fcf43e6b6 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:36.086654 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d1804724-a919-4474-97ff-425fcf43e6b6 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:36.295086 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-d1804724-a919-4474-97ff-425fcf43e6b6 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850bda78e664117b671910c0e68bfb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952767db5f394fc4bf01c0efd65f2fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:36.308195 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d1804724-a919-4474-97ff-425fcf43e6b6 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 200 len: 1608 microversion: 2.1 time: 0.252102 Aug 27 02:59:36.314530 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1936/3886] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:59:36 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 1608 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:59:36.373081 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-35cd0d3d-f89b-4980-93bc-64b2657ac383 req-0c6c2805-393b-4923-ae5c-920319499e83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb0d71f2-158d-4acc-8774-6874e7da29cd", "name": "network-vif-deleted", "tag": "fe5d48cf-956a-4e15-9a8e-fdd605d313b1"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:59:36.394277 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-35cd0d3d-f89b-4980-93bc-64b2657ac383 req-0c6c2805-393b-4923-ae5c-920319499e83 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:36.396251 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-35cd0d3d-f89b-4980-93bc-64b2657ac383 req-0c6c2805-393b-4923-ae5c-920319499e83 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:36.397669 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-35cd0d3d-f89b-4980-93bc-64b2657ac383 req-0c6c2805-393b-4923-ae5c-920319499e83 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:36.434944 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-35cd0d3d-f89b-4980-93bc-64b2657ac383 req-0c6c2805-393b-4923-ae5c-920319499e83 service nova] Creating event network-vif-deleted:fe5d48cf-956a-4e15-9a8e-fdd605d313b1 for instance bb0d71f2-158d-4acc-8774-6874e7da29cd on n-h1-852278-4 Aug 27 02:59:36.449381 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-35cd0d3d-f89b-4980-93bc-64b2657ac383 req-0c6c2805-393b-4923-ae5c-920319499e83 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080177 Aug 27 02:59:36.455560 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1951/3887] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:59:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:59:36.877602 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-87c0c876-69ec-41c8-b891-da1dff1bc71a tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:36.878219 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-87c0c876-69ec-41c8-b891-da1dff1bc71a tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] [instance: b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:36.887026 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-87c0c876-69ec-41c8-b891-da1dff1bc71a tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:36.887634 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-87c0c876-69ec-41c8-b891-da1dff1bc71a tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:36.888121 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-87c0c876-69ec-41c8-b891-da1dff1bc71a tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:36.903933 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-87c0c876-69ec-41c8-b891-da1dff1bc71a tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:36.904460 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-87c0c876-69ec-41c8-b891-da1dff1bc71a tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:36.904920 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-87c0c876-69ec-41c8-b891-da1dff1bc71a tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:36.970930 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:59:37.016424 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-5135eb07-ff09-44e3-9c49-3b86607a98ca tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:37.017128 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-5135eb07-ff09-44e3-9c49-3b86607a98ca tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] [instance: e7973075-ede5-4528-8d5f-83d994006015] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:37.038485 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5135eb07-ff09-44e3-9c49-3b86607a98ca tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:37.038988 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5135eb07-ff09-44e3-9c49-3b86607a98ca tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:37.039422 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5135eb07-ff09-44e3-9c49-3b86607a98ca tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:37.040450 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5135eb07-ff09-44e3-9c49-3b86607a98ca tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:37.041067 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5135eb07-ff09-44e3-9c49-3b86607a98ca tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:37.046512 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5135eb07-ff09-44e3-9c49-3b86607a98ca tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:37.200290 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-87c0c876-69ec-41c8-b891-da1dff1bc71a tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:37.222633 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-87c0c876-69ec-41c8-b891-da1dff1bc71a tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:37.224513 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-87c0c876-69ec-41c8-b891-da1dff1bc71a tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:37.229000 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-87c0c876-69ec-41c8-b891-da1dff1bc71a tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] 10.222.0.70 "GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7" status: 200 len: 1604 microversion: 2.32 time: 0.356034 Aug 27 02:59:37.245403 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1937/3888] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:59:36 2022] GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 => generated 1604 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:59:37.289095 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-5135eb07-ff09-44e3-9c49-3b86607a98ca tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5557a4cfdaab4a7fa40c17bf9fc9ceb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503b9ec7c8e48ff95ce15b92a41118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:37.299265 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-5135eb07-ff09-44e3-9c49-3b86607a98ca tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] 10.222.0.70 "GET /compute/v2.1/servers/e7973075-ede5-4528-8d5f-83d994006015" status: 200 len: 1237 microversion: 2.1 time: 0.287838 Aug 27 02:59:37.304672 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1952/3889] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:59:37 2022] GET /compute/v2.1/servers/e7973075-ede5-4528-8d5f-83d994006015 => generated 1237 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:59:37.333582 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3a4cf204-3e66-44dd-ac39-a407f88d097e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:37.334255 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-3a4cf204-3e66-44dd-ac39-a407f88d097e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] [instance: bb0d71f2-158d-4acc-8774-6874e7da29cd] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:37.354157 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3a4cf204-3e66-44dd-ac39-a407f88d097e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:37.354677 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3a4cf204-3e66-44dd-ac39-a407f88d097e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:37.355119 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3a4cf204-3e66-44dd-ac39-a407f88d097e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:37.355849 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3a4cf204-3e66-44dd-ac39-a407f88d097e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:37.357109 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3a4cf204-3e66-44dd-ac39-a407f88d097e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:37.362072 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3a4cf204-3e66-44dd-ac39-a407f88d097e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:37.385267 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-3a4cf204-3e66-44dd-ac39-a407f88d097e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] HTTP exception thrown: Instance bb0d71f2-158d-4acc-8774-6874e7da29cd could not be found. Aug 27 02:59:37.387086 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3a4cf204-3e66-44dd-ac39-a407f88d097e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Request method failure captured: Aug 27 02:59:37.387086 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd HTTP/1.1 Aug 27 02:59:37.387086 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:59:37.387086 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:59:37.387086 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:59:37.387086 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:59:37.387086 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:59:37.387086 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:59:37.387086 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:59:37.387086 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:59:37.387086 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYZ4Z8i7XrQCoJ8R1xQrljLXT0Y1KKkpWSlhl8nQzR0Gffp8SuHSAmEqH2wTow_HYUPfKDsH80AYAaprEdUsqUlgb1Dqa2tgrmc5xbHE8YE53Hq_xfoTBUsq6qNfDu_s_oKqI9wgNRhJDAuY_9xSuITf0Dzo8xZBUzkyCrp-xMPec0c Aug 27 02:59:37.387086 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:59:37.387086 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:59:37.387086 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:59:37.387086 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:59:37.387086 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:59:37.387086 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:59:37.387086 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 952767db5f394fc4bf01c0efd65f2fb9 Aug 27 02:59:37.387086 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ServerActionsTestJSON-1132885212 Aug 27 02:59:37.387086 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:59:37.387086 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:59:37.387086 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/952767db5f394fc4bf01c0efd65f2fb9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_952767db5f394fc4bf01c0efd65f2fb9", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/952767db5f394fc4bf01c0efd65f2fb9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/952767db5f394fc4bf01c0efd65f2fb9"}]}] Aug 27 02:59:37.387086 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ServerActionsTestJSON-1132885212 Aug 27 02:59:37.387086 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 952767db5f394fc4bf01c0efd65f2fb9 Aug 27 02:59:37.387086 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ServerActionsTestJSON-1132885212 Aug 27 02:59:37.387086 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ServerActionsTestJSON-1132885212-project Aug 27 02:59:37.387086 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:59:37.387086 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:59:37.387086 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: c850bda78e664117b671910c0e68bfb9 Aug 27 02:59:37.387086 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ServerActionsTestJSON-1132885212-project Aug 27 02:59:37.387086 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 02:59:37.387086 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance bb0d71f2-158d-4acc-8774-6874e7da29cd could not be found. Aug 27 02:59:37.387086 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': 'bb0d71f2-158d-4acc-8774-6874e7da29cd'} Aug 27 02:59:37.387086 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:59:37.387086 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:59:37.387086 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:59:37.387086 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:59:37.387086 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:59:37.387086 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:59:37.387086 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:59:37.387086 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:59:37.387086 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:59:37.387086 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:59:37.387086 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb0d71f2-158d-4acc-8774-6874e7da29cd could not be found. Aug 27 02:59:37.387086 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:59:37.387086 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:59:37.387086 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:59:37.387086 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:59:37.387086 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:59:37.387086 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:59:37.387086 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:59:37.387086 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:59:37.387086 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:59:37.387086 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:59:37.387086 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:59:37.387086 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:59:37.387086 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:59:37.387086 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:59:37.387086 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:59:37.387086 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:59:37.387086 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb0d71f2-158d-4acc-8774-6874e7da29cd could not be found. Aug 27 02:59:37.387086 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:59:37.387086 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:59:37.387086 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:59:37.391518 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:59:37.391518 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:59:37.391518 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:59:37.391518 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:59:37.391518 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:59:37.391518 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb0d71f2-158d-4acc-8774-6874e7da29cd could not be found. Aug 27 02:59:37.391518 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:59:37.394353 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3a4cf204-3e66-44dd-ac39-a407f88d097e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Returning 404 to user: Instance bb0d71f2-158d-4acc-8774-6874e7da29cd could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:59:37.396114 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-3a4cf204-3e66-44dd-ac39-a407f88d097e tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd" status: 404 len: 111 microversion: 2.1 time: 0.065757 Aug 27 02:59:37.399501 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1938/3890] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:59:37 2022] GET /compute/v2.1/servers/bb0d71f2-158d-4acc-8774-6874e7da29cd => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:59:37.409004 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-063f4146-be17-4183-b233-4ff15826cc52 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] Calling method '.version_select at 0x7f5ede9811f0>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:37.459399 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-063f4146-be17-4183-b233-4ff15826cc52 tempest-ServerActionsTestJSON-1132885212 tempest-ServerActionsTestJSON-1132885212-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-370147892" status: 202 len: 0 microversion: 2.1 time: 0.055710 Aug 27 02:59:37.468531 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1953/3891] 10.222.0.70 () {58 vars in 1218 bytes} [Sat Aug 27 02:59:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-370147892 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:59:38.284067 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3346b7cb-78e1-4407-bdae-2ca5ee411aeb tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:38.292157 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-3346b7cb-78e1-4407-bdae-2ca5ee411aeb tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] [instance: b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:38.324658 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-dd411840-9f5f-40ec-bcfa-9a09f499b956 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:38.325411 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-dd411840-9f5f-40ec-bcfa-9a09f499b956 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] [instance: e7973075-ede5-4528-8d5f-83d994006015] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:38.357913 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dd411840-9f5f-40ec-bcfa-9a09f499b956 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:38.358454 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dd411840-9f5f-40ec-bcfa-9a09f499b956 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:38.358935 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dd411840-9f5f-40ec-bcfa-9a09f499b956 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:38.369633 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dd411840-9f5f-40ec-bcfa-9a09f499b956 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:38.371185 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dd411840-9f5f-40ec-bcfa-9a09f499b956 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:38.371649 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dd411840-9f5f-40ec-bcfa-9a09f499b956 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:38.376035 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3346b7cb-78e1-4407-bdae-2ca5ee411aeb tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:38.382337 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3346b7cb-78e1-4407-bdae-2ca5ee411aeb tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:38.383231 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3346b7cb-78e1-4407-bdae-2ca5ee411aeb tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:38.386132 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3346b7cb-78e1-4407-bdae-2ca5ee411aeb tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:38.387157 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3346b7cb-78e1-4407-bdae-2ca5ee411aeb tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:38.387600 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3346b7cb-78e1-4407-bdae-2ca5ee411aeb tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:38.672614 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-3346b7cb-78e1-4407-bdae-2ca5ee411aeb tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:38.689368 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-3346b7cb-78e1-4407-bdae-2ca5ee411aeb tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:38.693426 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-3346b7cb-78e1-4407-bdae-2ca5ee411aeb tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:38.701961 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-3346b7cb-78e1-4407-bdae-2ca5ee411aeb tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] 10.222.0.70 "GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7" status: 200 len: 1604 microversion: 2.32 time: 0.448770 Aug 27 02:59:38.704049 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1939/3892] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:59:38 2022] GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 => generated 1604 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:59:38.725463 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-dd411840-9f5f-40ec-bcfa-9a09f499b956 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5557a4cfdaab4a7fa40c17bf9fc9ceb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503b9ec7c8e48ff95ce15b92a41118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:38.734413 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-dd411840-9f5f-40ec-bcfa-9a09f499b956 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] 10.222.0.70 "GET /compute/v2.1/servers/e7973075-ede5-4528-8d5f-83d994006015" status: 200 len: 1237 microversion: 2.1 time: 0.415056 Aug 27 02:59:38.735527 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1954/3893] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:59:38 2022] GET /compute/v2.1/servers/e7973075-ede5-4528-8d5f-83d994006015 => generated 1237 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:59:38.747466 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-ad582387-cd6f-488b-8bab-c2621edcee34 req-f44604e0-49fc-4220-8e2e-a0a9b119b8d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d9f666f-0b19-4d87-a94a-770b5d99f349", "tag": "b31e0e71-4066-4ac6-b1eb-63996f060976"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:59:38.758381 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-ad582387-cd6f-488b-8bab-c2621edcee34 req-f44604e0-49fc-4220-8e2e-a0a9b119b8d2 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:38.759045 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-ad582387-cd6f-488b-8bab-c2621edcee34 req-f44604e0-49fc-4220-8e2e-a0a9b119b8d2 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:38.759663 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-ad582387-cd6f-488b-8bab-c2621edcee34 req-f44604e0-49fc-4220-8e2e-a0a9b119b8d2 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:38.786862 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-ad582387-cd6f-488b-8bab-c2621edcee34 req-f44604e0-49fc-4220-8e2e-a0a9b119b8d2 service nova] Creating event network-changed:b31e0e71-4066-4ac6-b1eb-63996f060976 for instance 9d9f666f-0b19-4d87-a94a-770b5d99f349 on n-h1-852278-4 Aug 27 02:59:38.792595 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-ad582387-cd6f-488b-8bab-c2621edcee34 req-f44604e0-49fc-4220-8e2e-a0a9b119b8d2 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062659 Aug 27 02:59:38.793209 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1940/3894] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:59:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:59:39.730755 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-1ed64491-8c1e-4580-9f2f-111b76951e76 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:39.734042 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-1ed64491-8c1e-4580-9f2f-111b76951e76 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] [instance: b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:39.756383 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-993f8561-c5e8-46d5-9cf6-9395808cecf9 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:39.757076 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-993f8561-c5e8-46d5-9cf6-9395808cecf9 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] [instance: e7973075-ede5-4528-8d5f-83d994006015] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:39.757365 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1ed64491-8c1e-4580-9f2f-111b76951e76 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:39.758085 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1ed64491-8c1e-4580-9f2f-111b76951e76 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:39.778069 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1ed64491-8c1e-4580-9f2f-111b76951e76 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:39.780645 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1ed64491-8c1e-4580-9f2f-111b76951e76 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:39.781366 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1ed64491-8c1e-4580-9f2f-111b76951e76 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:39.782190 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1ed64491-8c1e-4580-9f2f-111b76951e76 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:39.782791 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-993f8561-c5e8-46d5-9cf6-9395808cecf9 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:39.783287 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-993f8561-c5e8-46d5-9cf6-9395808cecf9 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:39.783724 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-993f8561-c5e8-46d5-9cf6-9395808cecf9 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:39.784454 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-993f8561-c5e8-46d5-9cf6-9395808cecf9 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:39.784901 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-993f8561-c5e8-46d5-9cf6-9395808cecf9 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:39.785318 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-993f8561-c5e8-46d5-9cf6-9395808cecf9 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:40.562689 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-1ed64491-8c1e-4580-9f2f-111b76951e76 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:40.581833 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-1ed64491-8c1e-4580-9f2f-111b76951e76 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:40.583709 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-1ed64491-8c1e-4580-9f2f-111b76951e76 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:40.585244 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-1ed64491-8c1e-4580-9f2f-111b76951e76 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] 10.222.0.70 "GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7" status: 200 len: 1604 microversion: 2.32 time: 0.859849 Aug 27 02:59:40.608890 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1955/3895] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:59:39 2022] GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 => generated 1604 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:59:41.094386 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-993f8561-c5e8-46d5-9cf6-9395808cecf9 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5557a4cfdaab4a7fa40c17bf9fc9ceb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503b9ec7c8e48ff95ce15b92a41118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:41.109291 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-993f8561-c5e8-46d5-9cf6-9395808cecf9 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] 10.222.0.70 "GET /compute/v2.1/servers/e7973075-ede5-4528-8d5f-83d994006015" status: 200 len: 1305 microversion: 2.1 time: 1.357046 Aug 27 02:59:41.121015 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1941/3896] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:59:39 2022] GET /compute/v2.1/servers/e7973075-ede5-4528-8d5f-83d994006015 => generated 1305 bytes in 1369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:59:41.632973 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-74e29ca0-634c-4aaf-9e73-51a563f79878 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:41.633590 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-74e29ca0-634c-4aaf-9e73-51a563f79878 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] [instance: b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:41.646493 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-74e29ca0-634c-4aaf-9e73-51a563f79878 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:41.647261 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-74e29ca0-634c-4aaf-9e73-51a563f79878 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:41.647892 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-74e29ca0-634c-4aaf-9e73-51a563f79878 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:41.649379 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-74e29ca0-634c-4aaf-9e73-51a563f79878 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:41.650118 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-74e29ca0-634c-4aaf-9e73-51a563f79878 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:41.650724 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-74e29ca0-634c-4aaf-9e73-51a563f79878 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:41.798903 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-74e29ca0-634c-4aaf-9e73-51a563f79878 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:41.817938 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-74e29ca0-634c-4aaf-9e73-51a563f79878 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:41.819474 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-74e29ca0-634c-4aaf-9e73-51a563f79878 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:41.827511 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-74e29ca0-634c-4aaf-9e73-51a563f79878 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] 10.222.0.70 "GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7" status: 200 len: 1604 microversion: 2.32 time: 0.200876 Aug 27 02:59:41.828138 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1956/3897] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:59:41 2022] GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 => generated 1604 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:59:42.133752 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ebb6be5b-74b1-43b4-a788-867198c9cd87 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:42.135241 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-ebb6be5b-74b1-43b4-a788-867198c9cd87 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] [instance: e7973075-ede5-4528-8d5f-83d994006015] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:42.142769 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ebb6be5b-74b1-43b4-a788-867198c9cd87 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:42.143707 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ebb6be5b-74b1-43b4-a788-867198c9cd87 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:42.144406 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ebb6be5b-74b1-43b4-a788-867198c9cd87 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:42.146207 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ebb6be5b-74b1-43b4-a788-867198c9cd87 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:42.146940 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ebb6be5b-74b1-43b4-a788-867198c9cd87 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:42.147582 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ebb6be5b-74b1-43b4-a788-867198c9cd87 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:42.502689 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-ebb6be5b-74b1-43b4-a788-867198c9cd87 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5557a4cfdaab4a7fa40c17bf9fc9ceb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503b9ec7c8e48ff95ce15b92a41118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:42.511390 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ebb6be5b-74b1-43b4-a788-867198c9cd87 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] 10.222.0.70 "GET /compute/v2.1/servers/e7973075-ede5-4528-8d5f-83d994006015" status: 200 len: 1305 microversion: 2.1 time: 0.382227 Aug 27 02:59:42.532738 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1942/3898] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:59:42 2022] GET /compute/v2.1/servers/e7973075-ede5-4528-8d5f-83d994006015 => generated 1305 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:59:42.853368 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c0d569d1-0171-4d20-9295-232b178fdd34 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:42.855118 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-c0d569d1-0171-4d20-9295-232b178fdd34 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] [instance: b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:42.858409 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:59:42.862356 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=4 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:59:42.879235 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c0d569d1-0171-4d20-9295-232b178fdd34 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:42.883002 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c0d569d1-0171-4d20-9295-232b178fdd34 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:42.890769 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c0d569d1-0171-4d20-9295-232b178fdd34 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:42.891766 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c0d569d1-0171-4d20-9295-232b178fdd34 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:42.892377 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c0d569d1-0171-4d20-9295-232b178fdd34 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:42.893054 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c0d569d1-0171-4d20-9295-232b178fdd34 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:43.087663 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-d4971aff-1433-4c23-a78e-638512243ab8 req-4dd45f2e-e4e6-4be4-b077-5e88e0e5dbeb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7973075-ede5-4528-8d5f-83d994006015", "tag": "6fdcfea5-9c16-4c87-8fdf-4781a514fa56"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:59:43.127531 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-d4971aff-1433-4c23-a78e-638512243ab8 req-4dd45f2e-e4e6-4be4-b077-5e88e0e5dbeb service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:43.127919 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-d4971aff-1433-4c23-a78e-638512243ab8 req-4dd45f2e-e4e6-4be4-b077-5e88e0e5dbeb service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:43.128853 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-d4971aff-1433-4c23-a78e-638512243ab8 req-4dd45f2e-e4e6-4be4-b077-5e88e0e5dbeb service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:43.156693 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-c0d569d1-0171-4d20-9295-232b178fdd34 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:43.166915 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-c0d569d1-0171-4d20-9295-232b178fdd34 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:43.183614 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-c0d569d1-0171-4d20-9295-232b178fdd34 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:43.186023 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c0d569d1-0171-4d20-9295-232b178fdd34 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] 10.222.0.70 "GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7" status: 200 len: 1604 microversion: 2.32 time: 0.338040 Aug 27 02:59:43.201271 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1957/3899] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:59:42 2022] GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 => generated 1604 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:59:43.204361 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-d4971aff-1433-4c23-a78e-638512243ab8 req-4dd45f2e-e4e6-4be4-b077-5e88e0e5dbeb service nova] Creating event network-changed:6fdcfea5-9c16-4c87-8fdf-4781a514fa56 for instance e7973075-ede5-4528-8d5f-83d994006015 on n-h2-852278-4 Aug 27 02:59:43.211102 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-d4971aff-1433-4c23-a78e-638512243ab8 req-4dd45f2e-e4e6-4be4-b077-5e88e0e5dbeb service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.140610 Aug 27 02:59:43.215092 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1943/3900] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 02:59:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Aug 27 02:59:43.537866 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3e44fd35-1b4e-4bcf-b33d-eca2c9a8d441 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:43.537866 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-3e44fd35-1b4e-4bcf-b33d-eca2c9a8d441 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] [instance: e7973075-ede5-4528-8d5f-83d994006015] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:43.546346 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=12 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:59:43.548065 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3e44fd35-1b4e-4bcf-b33d-eca2c9a8d441 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:43.551630 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3e44fd35-1b4e-4bcf-b33d-eca2c9a8d441 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:43.552282 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3e44fd35-1b4e-4bcf-b33d-eca2c9a8d441 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:43.553562 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3e44fd35-1b4e-4bcf-b33d-eca2c9a8d441 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:43.557199 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3e44fd35-1b4e-4bcf-b33d-eca2c9a8d441 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:43.557883 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3e44fd35-1b4e-4bcf-b33d-eca2c9a8d441 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:43.926825 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-3e44fd35-1b4e-4bcf-b33d-eca2c9a8d441 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5557a4cfdaab4a7fa40c17bf9fc9ceb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503b9ec7c8e48ff95ce15b92a41118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:43.938542 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-3e44fd35-1b4e-4bcf-b33d-eca2c9a8d441 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] 10.222.0.70 "GET /compute/v2.1/servers/e7973075-ede5-4528-8d5f-83d994006015" status: 200 len: 1305 microversion: 2.1 time: 0.405123 Aug 27 02:59:43.939751 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1958/3901] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:59:43 2022] GET /compute/v2.1/servers/e7973075-ede5-4528-8d5f-83d994006015 => generated 1305 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:59:44.214290 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3ee9c657-3ad2-4fd5-be0d-497b1ae3ec44 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:44.215007 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-3ee9c657-3ad2-4fd5-be0d-497b1ae3ec44 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] [instance: b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:44.224030 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3ee9c657-3ad2-4fd5-be0d-497b1ae3ec44 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:44.224608 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3ee9c657-3ad2-4fd5-be0d-497b1ae3ec44 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:44.225043 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3ee9c657-3ad2-4fd5-be0d-497b1ae3ec44 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:44.225768 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3ee9c657-3ad2-4fd5-be0d-497b1ae3ec44 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:44.226224 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3ee9c657-3ad2-4fd5-be0d-497b1ae3ec44 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:44.226650 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3ee9c657-3ad2-4fd5-be0d-497b1ae3ec44 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:44.328006 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3ee9c657-3ad2-4fd5-be0d-497b1ae3ec44 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:44.329686 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3ee9c657-3ad2-4fd5-be0d-497b1ae3ec44 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:44.330762 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3ee9c657-3ad2-4fd5-be0d-497b1ae3ec44 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:44.331373 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.instance [None req-3ee9c657-3ad2-4fd5-be0d-497b1ae3ec44 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lazy-loading 'fault' on Instance uuid b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 {{(pid=134052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:59:44.431636 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-3ee9c657-3ad2-4fd5-be0d-497b1ae3ec44 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:44.445756 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-3ee9c657-3ad2-4fd5-be0d-497b1ae3ec44 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:44.447064 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-3ee9c657-3ad2-4fd5-be0d-497b1ae3ec44 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57aed857618644f7adc472fc5c5e0c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e26cc78b814d498d6a931ecf300dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:44.452453 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-3ee9c657-3ad2-4fd5-be0d-497b1ae3ec44 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] 10.222.0.70 "GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7" status: 200 len: 1609 microversion: 2.32 time: 0.243720 Aug 27 02:59:44.453086 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1944/3902] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:59:44 2022] GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 => generated 1609 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:59:44.959352 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ce63b1a4-4d23-40fb-961c-7d4e0365e3e7 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:44.960660 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-ce63b1a4-4d23-40fb-961c-7d4e0365e3e7 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] [instance: e7973075-ede5-4528-8d5f-83d994006015] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:44.975931 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ce63b1a4-4d23-40fb-961c-7d4e0365e3e7 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:44.976822 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ce63b1a4-4d23-40fb-961c-7d4e0365e3e7 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:44.976965 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ce63b1a4-4d23-40fb-961c-7d4e0365e3e7 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:44.977645 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ce63b1a4-4d23-40fb-961c-7d4e0365e3e7 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:44.978274 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ce63b1a4-4d23-40fb-961c-7d4e0365e3e7 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:44.978892 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ce63b1a4-4d23-40fb-961c-7d4e0365e3e7 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:45.478750 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f47151c2-b8bc-4f74-a16c-7638d9d9e71a tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:45.479379 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-f47151c2-b8bc-4f74-a16c-7638d9d9e71a tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] [instance: b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:45.491451 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f47151c2-b8bc-4f74-a16c-7638d9d9e71a tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:45.491951 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f47151c2-b8bc-4f74-a16c-7638d9d9e71a tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:45.500552 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f47151c2-b8bc-4f74-a16c-7638d9d9e71a tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:45.501735 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f47151c2-b8bc-4f74-a16c-7638d9d9e71a tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:45.506245 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f47151c2-b8bc-4f74-a16c-7638d9d9e71a tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:45.506946 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f47151c2-b8bc-4f74-a16c-7638d9d9e71a tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:45.549110 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-f47151c2-b8bc-4f74-a16c-7638d9d9e71a tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] HTTP exception thrown: Instance b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 could not be found. Aug 27 02:59:45.551130 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f47151c2-b8bc-4f74-a16c-7638d9d9e71a tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Request method failure captured: Aug 27 02:59:45.551130 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 HTTP/1.1 Aug 27 02:59:45.551130 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:59:45.551130 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:59:45.551130 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:59:45.551130 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:59:45.551130 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:59:45.551130 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:59:45.551130 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:59:45.551130 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:59:45.551130 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYcXAiJBE_xN_2v82duUk0No01g6Q9X2yCvzIObRDu3tu0sEm529PinuIWnzFrEeyaFQfmYB3FBDm6IBoJNQlbU4c9GmUAobkoIxlTwr4zt56xhSIkl3yQfQyTCPNSHTfBEX-Vk5-DnU9OHtsg7u3BzlxAn6-DlTgejKik1dYiIJVjQ Aug 27 02:59:45.551130 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:59:45.551130 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:59:45.551130 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:59:45.551130 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:59:45.551130 n-d-852278-4 devstack@n-api.service[134052]: X-Openstack-Nova-Api-Version: 2.32 Aug 27 02:59:45.551130 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:59:45.551130 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:59:45.551130 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 10e26cc78b814d498d6a931ecf300dff Aug 27 02:59:45.551130 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-TaggedBootDevicesTest-2041100208 Aug 27 02:59:45.551130 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:59:45.551130 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:59:45.551130 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/10e26cc78b814d498d6a931ecf300dff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_10e26cc78b814d498d6a931ecf300dff", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/10e26cc78b814d498d6a931ecf300dff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/10e26cc78b814d498d6a931ecf300dff"}]}] Aug 27 02:59:45.551130 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-TaggedBootDevicesTest-2041100208 Aug 27 02:59:45.551130 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 10e26cc78b814d498d6a931ecf300dff Aug 27 02:59:45.551130 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-TaggedBootDevicesTest-2041100208 Aug 27 02:59:45.551130 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-TaggedBootDevicesTest-2041100208-project Aug 27 02:59:45.551130 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:59:45.551130 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:59:45.551130 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 57aed857618644f7adc472fc5c5e0c36 Aug 27 02:59:45.551130 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-TaggedBootDevicesTest-2041100208-project Aug 27 02:59:45.551130 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 02:59:45.551130 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 could not be found. Aug 27 02:59:45.551130 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': 'b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7'} Aug 27 02:59:45.551130 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:59:45.551130 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:59:45.551130 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:59:45.551130 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:59:45.551130 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:59:45.551130 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:59:45.551130 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:59:45.551130 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:59:45.551130 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:59:45.551130 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:59:45.551130 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 could not be found. Aug 27 02:59:45.551130 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:59:45.551130 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:59:45.551130 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:59:45.551130 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:59:45.551130 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:59:45.551130 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:59:45.551130 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:59:45.551130 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:59:45.551130 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:59:45.551130 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:59:45.551130 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:59:45.551130 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:59:45.551130 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:59:45.551130 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:59:45.551130 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:59:45.551130 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:59:45.551130 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 could not be found. Aug 27 02:59:45.551130 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:59:45.551130 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:59:45.555665 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:59:45.555665 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:59:45.555665 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:59:45.555665 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:59:45.555665 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:59:45.555665 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:59:45.555665 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 could not be found. Aug 27 02:59:45.555665 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:59:45.557534 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f47151c2-b8bc-4f74-a16c-7638d9d9e71a tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Returning 404 to user: Instance b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:59:45.561464 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f47151c2-b8bc-4f74-a16c-7638d9d9e71a tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] 10.222.0.70 "GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7" status: 404 len: 111 microversion: 2.32 time: 0.087123 Aug 27 02:59:45.566170 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1945/3903] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:59:45 2022] GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 27 02:59:45.576344 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-30319129-104c-4b3a-95de-f2a0ca692d7b tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Calling method '.version_select at 0x7f5ee309a790>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:45.634023 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-30319129-104c-4b3a-95de-f2a0ca692d7b tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1854057571" status: 204 len: 0 microversion: 2.32 time: 0.066355 Aug 27 02:59:45.634888 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1946/3904] 10.222.0.70 () {60 vars in 1262 bytes} [Sat Aug 27 02:59:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1854057571 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 02:59:46.383011 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-ce63b1a4-4d23-40fb-961c-7d4e0365e3e7 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5557a4cfdaab4a7fa40c17bf9fc9ceb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503b9ec7c8e48ff95ce15b92a41118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:46.396633 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ce63b1a4-4d23-40fb-961c-7d4e0365e3e7 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] 10.222.0.70 "GET /compute/v2.1/servers/e7973075-ede5-4528-8d5f-83d994006015" status: 200 len: 1305 microversion: 2.1 time: 1.441013 Aug 27 02:59:46.401175 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1959/3905] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:59:44 2022] GET /compute/v2.1/servers/e7973075-ede5-4528-8d5f-83d994006015 => generated 1305 bytes in 1446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:59:47.421982 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-2b6d24ce-3124-4979-a496-3c01aedcd90b tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:47.423247 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-2b6d24ce-3124-4979-a496-3c01aedcd90b tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] [instance: e7973075-ede5-4528-8d5f-83d994006015] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:47.438838 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2b6d24ce-3124-4979-a496-3c01aedcd90b tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:47.439670 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2b6d24ce-3124-4979-a496-3c01aedcd90b tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:47.440286 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2b6d24ce-3124-4979-a496-3c01aedcd90b tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:47.443259 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2b6d24ce-3124-4979-a496-3c01aedcd90b tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:47.443959 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2b6d24ce-3124-4979-a496-3c01aedcd90b tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:47.446084 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2b6d24ce-3124-4979-a496-3c01aedcd90b tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:48.158534 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-2b6d24ce-3124-4979-a496-3c01aedcd90b tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5557a4cfdaab4a7fa40c17bf9fc9ceb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503b9ec7c8e48ff95ce15b92a41118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:48.171141 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-2b6d24ce-3124-4979-a496-3c01aedcd90b tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] 10.222.0.70 "GET /compute/v2.1/servers/e7973075-ede5-4528-8d5f-83d994006015" status: 200 len: 1305 microversion: 2.1 time: 0.754192 Aug 27 02:59:48.171772 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1947/3906] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:59:47 2022] GET /compute/v2.1/servers/e7973075-ede5-4528-8d5f-83d994006015 => generated 1305 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:59:49.191449 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-5fa28100-be60-4c99-8ece-cde93c8674b3 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:49.192623 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-5fa28100-be60-4c99-8ece-cde93c8674b3 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] [instance: e7973075-ede5-4528-8d5f-83d994006015] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:49.224134 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5fa28100-be60-4c99-8ece-cde93c8674b3 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:49.230381 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5fa28100-be60-4c99-8ece-cde93c8674b3 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:49.235681 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5fa28100-be60-4c99-8ece-cde93c8674b3 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:49.238783 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5fa28100-be60-4c99-8ece-cde93c8674b3 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:49.239364 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5fa28100-be60-4c99-8ece-cde93c8674b3 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:49.245220 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5fa28100-be60-4c99-8ece-cde93c8674b3 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:49.673780 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-5fa28100-be60-4c99-8ece-cde93c8674b3 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5557a4cfdaab4a7fa40c17bf9fc9ceb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503b9ec7c8e48ff95ce15b92a41118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:49.692890 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-5fa28100-be60-4c99-8ece-cde93c8674b3 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] 10.222.0.70 "GET /compute/v2.1/servers/e7973075-ede5-4528-8d5f-83d994006015" status: 200 len: 1305 microversion: 2.1 time: 0.505275 Aug 27 02:59:49.710098 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1960/3907] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:59:49 2022] GET /compute/v2.1/servers/e7973075-ede5-4528-8d5f-83d994006015 => generated 1305 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:59:50.715892 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-741c5845-5631-4837-9828-0f4bab099992 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:50.716544 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-741c5845-5631-4837-9828-0f4bab099992 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] [instance: e7973075-ede5-4528-8d5f-83d994006015] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:50.724888 n-d-852278-4 devstack@n-api.service[134052]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 02:59:50.725046 n-d-852278-4 devstack@n-api.service[134052]: Sat Aug 27 02:59:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e7973075-ede5-4528-8d5f-83d994006015 (ip 10.222.0.70) !!! Aug 27 02:59:50.733919 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-741c5845-5631-4837-9828-0f4bab099992 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:50.734412 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-741c5845-5631-4837-9828-0f4bab099992 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:50.734861 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-741c5845-5631-4837-9828-0f4bab099992 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:50.735581 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-741c5845-5631-4837-9828-0f4bab099992 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:50.736031 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-741c5845-5631-4837-9828-0f4bab099992 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:50.736509 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-741c5845-5631-4837-9828-0f4bab099992 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:51.407974 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-741c5845-5631-4837-9828-0f4bab099992 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5557a4cfdaab4a7fa40c17bf9fc9ceb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503b9ec7c8e48ff95ce15b92a41118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:51.421140 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-741c5845-5631-4837-9828-0f4bab099992 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] 10.222.0.70 "GET /compute/v2.1/servers/e7973075-ede5-4528-8d5f-83d994006015" status: 200 len: 1305 microversion: 2.1 time: 0.709226 Aug 27 02:59:51.422055 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1948/3908] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:59:50 2022] GET /compute/v2.1/servers/e7973075-ede5-4528-8d5f-83d994006015 => generated 1305 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:59:52.444664 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b36cbf20-abc7-402a-9029-137b2b240d63 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:52.445895 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b36cbf20-abc7-402a-9029-137b2b240d63 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] [instance: e7973075-ede5-4528-8d5f-83d994006015] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:52.458289 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b36cbf20-abc7-402a-9029-137b2b240d63 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:52.459064 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b36cbf20-abc7-402a-9029-137b2b240d63 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:52.467343 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b36cbf20-abc7-402a-9029-137b2b240d63 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:52.470785 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b36cbf20-abc7-402a-9029-137b2b240d63 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:52.471430 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b36cbf20-abc7-402a-9029-137b2b240d63 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:52.472431 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b36cbf20-abc7-402a-9029-137b2b240d63 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:52.483111 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:59:53.139743 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-b36cbf20-abc7-402a-9029-137b2b240d63 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5557a4cfdaab4a7fa40c17bf9fc9ceb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503b9ec7c8e48ff95ce15b92a41118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:53.153704 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b36cbf20-abc7-402a-9029-137b2b240d63 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] 10.222.0.70 "GET /compute/v2.1/servers/e7973075-ede5-4528-8d5f-83d994006015" status: 200 len: 1293 microversion: 2.1 time: 0.715261 Aug 27 02:59:53.156437 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1961/3909] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:59:52 2022] GET /compute/v2.1/servers/e7973075-ede5-4528-8d5f-83d994006015 => generated 1293 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:59:54.180618 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-fefa47dd-d38b-42c7-9638-7de2b7294b3b tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:54.181858 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-fefa47dd-d38b-42c7-9638-7de2b7294b3b tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] [instance: e7973075-ede5-4528-8d5f-83d994006015] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:54.197083 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fefa47dd-d38b-42c7-9638-7de2b7294b3b tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:54.197787 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fefa47dd-d38b-42c7-9638-7de2b7294b3b tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:54.198392 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fefa47dd-d38b-42c7-9638-7de2b7294b3b tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:54.199276 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fefa47dd-d38b-42c7-9638-7de2b7294b3b tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:54.199725 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fefa47dd-d38b-42c7-9638-7de2b7294b3b tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:54.200147 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fefa47dd-d38b-42c7-9638-7de2b7294b3b tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:54.576211 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-fefa47dd-d38b-42c7-9638-7de2b7294b3b tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5557a4cfdaab4a7fa40c17bf9fc9ceb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503b9ec7c8e48ff95ce15b92a41118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:54.586330 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-fefa47dd-d38b-42c7-9638-7de2b7294b3b tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] 10.222.0.70 "GET /compute/v2.1/servers/e7973075-ede5-4528-8d5f-83d994006015" status: 200 len: 1293 microversion: 2.1 time: 0.410005 Aug 27 02:59:54.591280 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1949/3910] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:59:54 2022] GET /compute/v2.1/servers/e7973075-ede5-4528-8d5f-83d994006015 => generated 1293 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:59:55.619353 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4eac90b6-4408-409d-9a99-0278150d2b59 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:55.620585 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-4eac90b6-4408-409d-9a99-0278150d2b59 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] [instance: e7973075-ede5-4528-8d5f-83d994006015] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:55.635057 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4eac90b6-4408-409d-9a99-0278150d2b59 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:55.635404 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4eac90b6-4408-409d-9a99-0278150d2b59 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:55.635847 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4eac90b6-4408-409d-9a99-0278150d2b59 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:55.637208 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4eac90b6-4408-409d-9a99-0278150d2b59 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:55.637671 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4eac90b6-4408-409d-9a99-0278150d2b59 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:55.638104 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4eac90b6-4408-409d-9a99-0278150d2b59 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:56.429147 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-4eac90b6-4408-409d-9a99-0278150d2b59 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5557a4cfdaab4a7fa40c17bf9fc9ceb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503b9ec7c8e48ff95ce15b92a41118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:56.438131 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-4eac90b6-4408-409d-9a99-0278150d2b59 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] 10.222.0.70 "GET /compute/v2.1/servers/e7973075-ede5-4528-8d5f-83d994006015" status: 200 len: 1293 microversion: 2.1 time: 0.822798 Aug 27 02:59:56.463492 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1962/3911] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:59:55 2022] GET /compute/v2.1/servers/e7973075-ede5-4528-8d5f-83d994006015 => generated 1293 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:59:57.463225 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-29bb795c-7cc4-4279-b019-ff22acfe2cd0 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:57.464030 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-29bb795c-7cc4-4279-b019-ff22acfe2cd0 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] [instance: e7973075-ede5-4528-8d5f-83d994006015] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:57.479688 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-29bb795c-7cc4-4279-b019-ff22acfe2cd0 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:57.481319 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-29bb795c-7cc4-4279-b019-ff22acfe2cd0 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:57.483164 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-29bb795c-7cc4-4279-b019-ff22acfe2cd0 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:57.484962 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-29bb795c-7cc4-4279-b019-ff22acfe2cd0 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:57.485442 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-29bb795c-7cc4-4279-b019-ff22acfe2cd0 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:57.487041 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-29bb795c-7cc4-4279-b019-ff22acfe2cd0 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:58.038506 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-29bb795c-7cc4-4279-b019-ff22acfe2cd0 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5557a4cfdaab4a7fa40c17bf9fc9ceb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503b9ec7c8e48ff95ce15b92a41118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:58.054259 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-29bb795c-7cc4-4279-b019-ff22acfe2cd0 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] 10.222.0.70 "GET /compute/v2.1/servers/e7973075-ede5-4528-8d5f-83d994006015" status: 200 len: 1293 microversion: 2.1 time: 0.596372 Aug 27 02:59:58.058798 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1950/3912] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:59:57 2022] GET /compute/v2.1/servers/e7973075-ede5-4528-8d5f-83d994006015 => generated 1293 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:59:58.415364 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-9b471991-12ed-4700-8804-0ab607360ac0 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:58.415886 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-9b471991-12ed-4700-8804-0ab607360ac0 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] [instance: b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:58.432358 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9b471991-12ed-4700-8804-0ab607360ac0 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:58.432358 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9b471991-12ed-4700-8804-0ab607360ac0 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:58.437615 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9b471991-12ed-4700-8804-0ab607360ac0 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:58.438543 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9b471991-12ed-4700-8804-0ab607360ac0 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:58.439019 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9b471991-12ed-4700-8804-0ab607360ac0 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:58.439467 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9b471991-12ed-4700-8804-0ab607360ac0 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:58.455771 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-9b471991-12ed-4700-8804-0ab607360ac0 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] HTTP exception thrown: Instance b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 could not be found. Aug 27 02:59:58.458454 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-9b471991-12ed-4700-8804-0ab607360ac0 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Request method failure captured: Aug 27 02:59:58.458454 n-d-852278-4 devstack@n-api.service[134051]: request: DELETE /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 HTTP/1.1 Aug 27 02:59:58.458454 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 02:59:58.458454 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 02:59:58.458454 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 02:59:58.458454 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 02:59:58.458454 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 02:59:58.458454 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 02:59:58.458454 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 02:59:58.458454 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 02:59:58.458454 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYcXAiJBE_xN_2v82duUk0No01g6Q9X2yCvzIObRDu3tu0sEm529PinuIWnzFrEeyaFQfmYB3FBDm6IBoJNQlbU4c9GmUAobkoIxlTwr4zt56xhSIkl3yQfQyTCPNSHTfBEX-Vk5-DnU9OHtsg7u3BzlxAn6-DlTgejKik1dYiIJVjQ Aug 27 02:59:58.458454 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 02:59:58.458454 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 02:59:58.458454 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 02:59:58.458454 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 02:59:58.458454 n-d-852278-4 devstack@n-api.service[134051]: X-Openstack-Nova-Api-Version: 2.32 Aug 27 02:59:58.458454 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 02:59:58.458454 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 02:59:58.458454 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 10e26cc78b814d498d6a931ecf300dff Aug 27 02:59:58.458454 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-TaggedBootDevicesTest-2041100208 Aug 27 02:59:58.458454 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 02:59:58.458454 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 02:59:58.458454 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/10e26cc78b814d498d6a931ecf300dff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_10e26cc78b814d498d6a931ecf300dff", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/10e26cc78b814d498d6a931ecf300dff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/10e26cc78b814d498d6a931ecf300dff"}]}] Aug 27 02:59:58.458454 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-TaggedBootDevicesTest-2041100208 Aug 27 02:59:58.458454 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 10e26cc78b814d498d6a931ecf300dff Aug 27 02:59:58.458454 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-TaggedBootDevicesTest-2041100208 Aug 27 02:59:58.458454 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-TaggedBootDevicesTest-2041100208-project Aug 27 02:59:58.458454 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 02:59:58.458454 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 02:59:58.458454 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 57aed857618644f7adc472fc5c5e0c36 Aug 27 02:59:58.458454 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-TaggedBootDevicesTest-2041100208-project Aug 27 02:59:58.458454 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 02:59:58.458454 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 could not be found. Aug 27 02:59:58.458454 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': 'b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7'} Aug 27 02:59:58.458454 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:59:58.458454 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:59:58.458454 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:59:58.458454 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:59:58.458454 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:59:58.458454 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:59:58.458454 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:59:58.458454 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:59:58.458454 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:59:58.458454 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:59:58.458454 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 could not be found. Aug 27 02:59:58.458454 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:59:58.458454 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:59:58.458454 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:59:58.458454 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:59:58.458454 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:59:58.458454 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:59:58.458454 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:59:58.458454 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:59:58.458454 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:59:58.458454 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:59:58.458454 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 02:59:58.458454 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 02:59:58.458454 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 02:59:58.458454 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 02:59:58.458454 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:59:58.458454 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:59:58.458454 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:59:58.458454 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:59:58.463240 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 could not be found. Aug 27 02:59:58.463240 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:59:58.463240 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:59:58.463240 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:59:58.463240 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:59:58.463240 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:59:58.463240 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:59:58.463240 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:59:58.463240 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:59:58.463240 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 could not be found. Aug 27 02:59:58.463240 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 02:59:58.465237 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-9b471991-12ed-4700-8804-0ab607360ac0 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Returning 404 to user: Instance b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:59:58.466267 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-9b471991-12ed-4700-8804-0ab607360ac0 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] 10.222.0.70 "DELETE /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7" status: 404 len: 111 microversion: 2.32 time: 0.061045 Aug 27 02:59:58.467330 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1963/3913] 10.222.0.70 () {60 vars in 1280 bytes} [Sat Aug 27 02:59:58 2022] DELETE /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 02:59:58.476378 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-de58f9ac-9fb3-4c0d-97e6-101346002524 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:58.476907 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-de58f9ac-9fb3-4c0d-97e6-101346002524 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] [instance: b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:58.486022 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-de58f9ac-9fb3-4c0d-97e6-101346002524 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:58.486785 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-de58f9ac-9fb3-4c0d-97e6-101346002524 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:58.487298 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-de58f9ac-9fb3-4c0d-97e6-101346002524 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:58.488282 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-de58f9ac-9fb3-4c0d-97e6-101346002524 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:58.489126 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-de58f9ac-9fb3-4c0d-97e6-101346002524 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:58.489813 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-de58f9ac-9fb3-4c0d-97e6-101346002524 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:58.510181 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-de58f9ac-9fb3-4c0d-97e6-101346002524 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] HTTP exception thrown: Instance b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 could not be found. Aug 27 02:59:58.512287 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-de58f9ac-9fb3-4c0d-97e6-101346002524 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Request method failure captured: Aug 27 02:59:58.512287 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 HTTP/1.1 Aug 27 02:59:58.512287 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 02:59:58.512287 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 02:59:58.512287 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 02:59:58.512287 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 02:59:58.512287 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 02:59:58.512287 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 02:59:58.512287 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 02:59:58.512287 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 02:59:58.512287 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYcXAiJBE_xN_2v82duUk0No01g6Q9X2yCvzIObRDu3tu0sEm529PinuIWnzFrEeyaFQfmYB3FBDm6IBoJNQlbU4c9GmUAobkoIxlTwr4zt56xhSIkl3yQfQyTCPNSHTfBEX-Vk5-DnU9OHtsg7u3BzlxAn6-DlTgejKik1dYiIJVjQ Aug 27 02:59:58.512287 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 02:59:58.512287 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 02:59:58.512287 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 02:59:58.512287 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 02:59:58.512287 n-d-852278-4 devstack@n-api.service[134052]: X-Openstack-Nova-Api-Version: 2.32 Aug 27 02:59:58.512287 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 02:59:58.512287 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 02:59:58.512287 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 10e26cc78b814d498d6a931ecf300dff Aug 27 02:59:58.512287 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-TaggedBootDevicesTest-2041100208 Aug 27 02:59:58.512287 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 02:59:58.512287 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 02:59:58.512287 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/10e26cc78b814d498d6a931ecf300dff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_10e26cc78b814d498d6a931ecf300dff", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/10e26cc78b814d498d6a931ecf300dff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/10e26cc78b814d498d6a931ecf300dff"}]}] Aug 27 02:59:58.512287 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-TaggedBootDevicesTest-2041100208 Aug 27 02:59:58.512287 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 10e26cc78b814d498d6a931ecf300dff Aug 27 02:59:58.512287 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-TaggedBootDevicesTest-2041100208 Aug 27 02:59:58.512287 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-TaggedBootDevicesTest-2041100208-project Aug 27 02:59:58.512287 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 02:59:58.512287 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 02:59:58.512287 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 57aed857618644f7adc472fc5c5e0c36 Aug 27 02:59:58.512287 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-TaggedBootDevicesTest-2041100208-project Aug 27 02:59:58.512287 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 02:59:58.512287 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 could not be found. Aug 27 02:59:58.512287 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': 'b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7'} Aug 27 02:59:58.512287 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:59:58.512287 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:59:58.512287 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:59:58.512287 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:59:58.512287 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:59:58.512287 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:59:58.512287 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:59:58.512287 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:59:58.512287 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:59:58.512287 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:59:58.512287 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 could not be found. Aug 27 02:59:58.512287 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:59:58.512287 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:59:58.512287 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:59:58.512287 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:59:58.512287 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:59:58.512287 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:59:58.512287 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:59:58.512287 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:59:58.512287 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:59:58.512287 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:59:58.512287 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:59:58.512287 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:59:58.512287 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:59:58.512287 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:59:58.512287 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:59:58.512287 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:59:58.512287 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 could not be found. Aug 27 02:59:58.512287 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:59:58.512287 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:59:58.516787 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:59:58.516787 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:59:58.516787 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:59:58.516787 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:59:58.516787 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:59:58.516787 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:59:58.516787 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 could not be found. Aug 27 02:59:58.516787 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 02:59:58.518446 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-de58f9ac-9fb3-4c0d-97e6-101346002524 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] Returning 404 to user: Instance b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:59:58.519479 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-de58f9ac-9fb3-4c0d-97e6-101346002524 tempest-TaggedBootDevicesTest-2041100208 tempest-TaggedBootDevicesTest-2041100208-project] 10.222.0.70 "GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7" status: 404 len: 111 microversion: 2.32 time: 0.047637 Aug 27 02:59:58.524347 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1951/3914] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 02:59:58 2022] GET /compute/v2.1/servers/b9b54b2f-f8be-4ec1-9ec3-73d8ba32f8f7 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 02:59:59.079046 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-de8c1b38-bd0a-458c-99e8-8ead55ee8551 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:59.080081 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-de8c1b38-bd0a-458c-99e8-8ead55ee8551 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] [instance: e7973075-ede5-4528-8d5f-83d994006015] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:59.091242 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-de8c1b38-bd0a-458c-99e8-8ead55ee8551 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:59.095244 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-de8c1b38-bd0a-458c-99e8-8ead55ee8551 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:59.095988 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-de8c1b38-bd0a-458c-99e8-8ead55ee8551 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:59.097181 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-de8c1b38-bd0a-458c-99e8-8ead55ee8551 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:59.100979 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-de8c1b38-bd0a-458c-99e8-8ead55ee8551 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:59.101725 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-de8c1b38-bd0a-458c-99e8-8ead55ee8551 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:59.573060 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-de8c1b38-bd0a-458c-99e8-8ead55ee8551 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5557a4cfdaab4a7fa40c17bf9fc9ceb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503b9ec7c8e48ff95ce15b92a41118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:59.586942 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-de8c1b38-bd0a-458c-99e8-8ead55ee8551 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] 10.222.0.70 "GET /compute/v2.1/servers/e7973075-ede5-4528-8d5f-83d994006015" status: 200 len: 1293 microversion: 2.1 time: 0.509547 Aug 27 02:59:59.589580 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1964/3915] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 02:59:59 2022] GET /compute/v2.1/servers/e7973075-ede5-4528-8d5f-83d994006015 => generated 1293 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:00:00.613573 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4694b177-0f68-468e-b5fe-09cbcc8f1a94 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:00.614918 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-4694b177-0f68-468e-b5fe-09cbcc8f1a94 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] [instance: e7973075-ede5-4528-8d5f-83d994006015] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:00.633463 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4694b177-0f68-468e-b5fe-09cbcc8f1a94 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:00.635167 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4694b177-0f68-468e-b5fe-09cbcc8f1a94 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:00.635988 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4694b177-0f68-468e-b5fe-09cbcc8f1a94 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:00.636898 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4694b177-0f68-468e-b5fe-09cbcc8f1a94 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:00.638616 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4694b177-0f68-468e-b5fe-09cbcc8f1a94 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:00.640042 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4694b177-0f68-468e-b5fe-09cbcc8f1a94 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:02.288915 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-4694b177-0f68-468e-b5fe-09cbcc8f1a94 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5557a4cfdaab4a7fa40c17bf9fc9ceb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503b9ec7c8e48ff95ce15b92a41118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:02.311662 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-4694b177-0f68-468e-b5fe-09cbcc8f1a94 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] 10.222.0.70 "GET /compute/v2.1/servers/e7973075-ede5-4528-8d5f-83d994006015" status: 200 len: 1293 microversion: 2.1 time: 1.702970 Aug 27 03:00:02.326105 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1952/3916] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:00:00 2022] GET /compute/v2.1/servers/e7973075-ede5-4528-8d5f-83d994006015 => generated 1293 bytes in 1718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:00:03.217625 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-2be4ad4e-80fe-48fd-8ff7-e1abca3bf329 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-974488472", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "networks": [{"uuid": "9d99294b-814c-4ac9-833d-bfa6a42c317e"}]}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:00:03.335149 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-efc3aa04-e56a-4bf0-880c-bcd48f78130a tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:03.335770 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-efc3aa04-e56a-4bf0-880c-bcd48f78130a tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] [instance: e7973075-ede5-4528-8d5f-83d994006015] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:03.356902 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.network.neutron [None req-2be4ad4e-80fe-48fd-8ff7-e1abca3bf329 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] validate_networks() for [('9d99294b-814c-4ac9-833d-bfa6a42c317e', None, None, None, None, None)] {{(pid=134051) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:00:03.365452 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=48,nova_api:DELETE=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:00:03.374075 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-efc3aa04-e56a-4bf0-880c-bcd48f78130a tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:03.374601 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-efc3aa04-e56a-4bf0-880c-bcd48f78130a tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:03.375052 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-efc3aa04-e56a-4bf0-880c-bcd48f78130a tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:03.375790 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-efc3aa04-e56a-4bf0-880c-bcd48f78130a tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:03.376241 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-efc3aa04-e56a-4bf0-880c-bcd48f78130a tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:03.379250 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-efc3aa04-e56a-4bf0-880c-bcd48f78130a tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:04.076516 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-efc3aa04-e56a-4bf0-880c-bcd48f78130a tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5557a4cfdaab4a7fa40c17bf9fc9ceb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503b9ec7c8e48ff95ce15b92a41118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:04.084799 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-efc3aa04-e56a-4bf0-880c-bcd48f78130a tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] 10.222.0.70 "GET /compute/v2.1/servers/e7973075-ede5-4528-8d5f-83d994006015" status: 200 len: 1293 microversion: 2.1 time: 0.753514 Aug 27 03:00:04.095255 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1953/3917] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:00:03 2022] GET /compute/v2.1/servers/e7973075-ede5-4528-8d5f-83d994006015 => generated 1293 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:00:04.115796 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d63deb47-7976-445c-a20f-f4e5690019f4 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:04.120392 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d63deb47-7976-445c-a20f-f4e5690019f4 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] [instance: 9d9f666f-0b19-4d87-a94a-770b5d99f349] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:04.140689 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d63deb47-7976-445c-a20f-f4e5690019f4 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:04.152936 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d63deb47-7976-445c-a20f-f4e5690019f4 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:04.152936 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d63deb47-7976-445c-a20f-f4e5690019f4 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:04.155392 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d63deb47-7976-445c-a20f-f4e5690019f4 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:04.158620 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d63deb47-7976-445c-a20f-f4e5690019f4 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:04.159192 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d63deb47-7976-445c-a20f-f4e5690019f4 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:04.278531 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d63deb47-7976-445c-a20f-f4e5690019f4 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] 10.222.0.70 "GET /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349/ips" status: 200 len: 143 microversion: 2.1 time: 0.181714 Aug 27 03:00:04.297212 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1954/3918] 10.222.0.70 () {58 vars in 1248 bytes} [Sat Aug 27 03:00:04 2022] GET /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349/ips => generated 143 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:00:04.906021 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-2be4ad4e-80fe-48fd-8ff7-e1abca3bf329 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Flavor limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:00:04.907073 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-2be4ad4e-80fe-48fd-8ff7-e1abca3bf329 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Image limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:00:04.908038 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-2be4ad4e-80fe-48fd-8ff7-e1abca3bf329 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Flavor pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:00:04.908743 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-2be4ad4e-80fe-48fd-8ff7-e1abca3bf329 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Image pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:00:04.909501 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-2be4ad4e-80fe-48fd-8ff7-e1abca3bf329 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:00:04.935799 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2be4ad4e-80fe-48fd-8ff7-e1abca3bf329 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:04.938005 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2be4ad4e-80fe-48fd-8ff7-e1abca3bf329 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:04.945215 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2be4ad4e-80fe-48fd-8ff7-e1abca3bf329 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:04.946961 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2be4ad4e-80fe-48fd-8ff7-e1abca3bf329 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:04.947678 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2be4ad4e-80fe-48fd-8ff7-e1abca3bf329 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:04.948405 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2be4ad4e-80fe-48fd-8ff7-e1abca3bf329 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:05.009706 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-2be4ad4e-80fe-48fd-8ff7-e1abca3bf329 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Getting quotas for project b4ce2ffcdbe14ccbae3bfae7febc3319. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:00:05.036492 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-2be4ad4e-80fe-48fd-8ff7-e1abca3bf329 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Getting quotas for user 4b01cfa9fe344fc69301777595764071 and project b4ce2ffcdbe14ccbae3bfae7febc3319. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:00:05.079370 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-2be4ad4e-80fe-48fd-8ff7-e1abca3bf329 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Going to run 1 instances... {{(pid=134051) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:00:05.086386 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-2be4ad4e-80fe-48fd-8ff7-e1abca3bf329 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] [instance: 397ff5ae-2e76-4f8a-a013-7267ac623560] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134051) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:00:05.115248 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-7713ad00-fa52-41c6-9b6f-33d493526d63 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:05.116661 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-7713ad00-fa52-41c6-9b6f-33d493526d63 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] [instance: e7973075-ede5-4528-8d5f-83d994006015] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:05.133211 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7713ad00-fa52-41c6-9b6f-33d493526d63 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:05.136030 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7713ad00-fa52-41c6-9b6f-33d493526d63 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:05.139281 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7713ad00-fa52-41c6-9b6f-33d493526d63 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:05.141274 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7713ad00-fa52-41c6-9b6f-33d493526d63 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:05.143824 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7713ad00-fa52-41c6-9b6f-33d493526d63 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:05.145690 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7713ad00-fa52-41c6-9b6f-33d493526d63 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:05.262571 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-2be4ad4e-80fe-48fd-8ff7-e1abca3bf329 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.344468 Aug 27 03:00:05.266623 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1965/3919] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 03:00:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 2352 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:00:05.278445 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ffb65575-ab48-4e24-84bd-729ca3b3cef5 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:05.279077 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-ffb65575-ab48-4e24-84bd-729ca3b3cef5 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] [instance: 397ff5ae-2e76-4f8a-a013-7267ac623560] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:05.654969 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-ffb65575-ab48-4e24-84bd-729ca3b3cef5 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b01cfa9fe344fc69301777595764071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ce2ffcdbe14ccbae3bfae7febc3319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:05.664994 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ffb65575-ab48-4e24-84bd-729ca3b3cef5 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] 10.222.0.70 "GET /compute/v2.1/servers/397ff5ae-2e76-4f8a-a013-7267ac623560" status: 200 len: 1215 microversion: 2.1 time: 0.390957 Aug 27 03:00:05.671274 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1966/3920] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:00:05 2022] GET /compute/v2.1/servers/397ff5ae-2e76-4f8a-a013-7267ac623560 => generated 1215 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:00:05.718830 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-7713ad00-fa52-41c6-9b6f-33d493526d63 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5557a4cfdaab4a7fa40c17bf9fc9ceb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503b9ec7c8e48ff95ce15b92a41118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:05.746020 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-7713ad00-fa52-41c6-9b6f-33d493526d63 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] 10.222.0.70 "GET /compute/v2.1/servers/e7973075-ede5-4528-8d5f-83d994006015" status: 200 len: 1293 microversion: 2.1 time: 0.634635 Aug 27 03:00:05.747030 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1955/3921] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:00:05 2022] GET /compute/v2.1/servers/e7973075-ede5-4528-8d5f-83d994006015 => generated 1293 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:00:06.700082 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-5c3ca8c9-e4a1-4d35-85b9-b82a1c8d6b1c tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:06.706316 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-5c3ca8c9-e4a1-4d35-85b9-b82a1c8d6b1c tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] [instance: 397ff5ae-2e76-4f8a-a013-7267ac623560] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:06.745264 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5c3ca8c9-e4a1-4d35-85b9-b82a1c8d6b1c tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:06.748592 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5c3ca8c9-e4a1-4d35-85b9-b82a1c8d6b1c tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:06.758824 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5c3ca8c9-e4a1-4d35-85b9-b82a1c8d6b1c tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:06.759722 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5c3ca8c9-e4a1-4d35-85b9-b82a1c8d6b1c tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:06.767798 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5a6d3965-b008-45b5-b76f-c1fa54bc66e5 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:06.769855 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-5a6d3965-b008-45b5-b76f-c1fa54bc66e5 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] [instance: e7973075-ede5-4528-8d5f-83d994006015] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:06.772940 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5c3ca8c9-e4a1-4d35-85b9-b82a1c8d6b1c tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:06.773428 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5c3ca8c9-e4a1-4d35-85b9-b82a1c8d6b1c tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:06.805354 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5a6d3965-b008-45b5-b76f-c1fa54bc66e5 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:06.807298 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5a6d3965-b008-45b5-b76f-c1fa54bc66e5 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:06.809547 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5a6d3965-b008-45b5-b76f-c1fa54bc66e5 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:06.813052 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5a6d3965-b008-45b5-b76f-c1fa54bc66e5 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:06.814946 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5a6d3965-b008-45b5-b76f-c1fa54bc66e5 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:06.818995 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5a6d3965-b008-45b5-b76f-c1fa54bc66e5 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:06.909388 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-5c3ca8c9-e4a1-4d35-85b9-b82a1c8d6b1c tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b01cfa9fe344fc69301777595764071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ce2ffcdbe14ccbae3bfae7febc3319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:06.923248 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-5c3ca8c9-e4a1-4d35-85b9-b82a1c8d6b1c tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] 10.222.0.70 "GET /compute/v2.1/servers/397ff5ae-2e76-4f8a-a013-7267ac623560" status: 200 len: 1211 microversion: 2.1 time: 0.231592 Aug 27 03:00:06.924964 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1967/3922] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:00:06 2022] GET /compute/v2.1/servers/397ff5ae-2e76-4f8a-a013-7267ac623560 => generated 1211 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:00:07.228669 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-5a6d3965-b008-45b5-b76f-c1fa54bc66e5 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5557a4cfdaab4a7fa40c17bf9fc9ceb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503b9ec7c8e48ff95ce15b92a41118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:07.236516 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=90 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:00:07.241527 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-5a6d3965-b008-45b5-b76f-c1fa54bc66e5 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] 10.222.0.70 "GET /compute/v2.1/servers/e7973075-ede5-4528-8d5f-83d994006015" status: 200 len: 1293 microversion: 2.1 time: 0.478927 Aug 27 03:00:07.245850 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1956/3923] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:00:06 2022] GET /compute/v2.1/servers/e7973075-ede5-4528-8d5f-83d994006015 => generated 1293 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:00:07.948037 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0e04dad7-cd67-443f-aef7-c15b72084215 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:07.948694 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-0e04dad7-cd67-443f-aef7-c15b72084215 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] [instance: 397ff5ae-2e76-4f8a-a013-7267ac623560] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:07.972099 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0e04dad7-cd67-443f-aef7-c15b72084215 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:07.979631 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0e04dad7-cd67-443f-aef7-c15b72084215 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:07.980243 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0e04dad7-cd67-443f-aef7-c15b72084215 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:07.986628 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0e04dad7-cd67-443f-aef7-c15b72084215 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:07.991567 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0e04dad7-cd67-443f-aef7-c15b72084215 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:07.992342 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0e04dad7-cd67-443f-aef7-c15b72084215 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:08.250338 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-0e04dad7-cd67-443f-aef7-c15b72084215 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b01cfa9fe344fc69301777595764071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ce2ffcdbe14ccbae3bfae7febc3319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:08.266554 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-0e04dad7-cd67-443f-aef7-c15b72084215 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] 10.222.0.70 "GET /compute/v2.1/servers/397ff5ae-2e76-4f8a-a013-7267ac623560" status: 200 len: 1273 microversion: 2.1 time: 0.323244 Aug 27 03:00:08.271674 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1968/3924] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:00:07 2022] GET /compute/v2.1/servers/397ff5ae-2e76-4f8a-a013-7267ac623560 => generated 1273 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:00:08.272061 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f3a70a30-91f7-4766-a2bb-bef8a80ce94c tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:08.272722 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-f3a70a30-91f7-4766-a2bb-bef8a80ce94c tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] [instance: e7973075-ede5-4528-8d5f-83d994006015] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:08.291100 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f3a70a30-91f7-4766-a2bb-bef8a80ce94c tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:08.291622 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f3a70a30-91f7-4766-a2bb-bef8a80ce94c tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:08.292064 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f3a70a30-91f7-4766-a2bb-bef8a80ce94c tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:08.292830 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f3a70a30-91f7-4766-a2bb-bef8a80ce94c tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:08.293285 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f3a70a30-91f7-4766-a2bb-bef8a80ce94c tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:08.293717 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f3a70a30-91f7-4766-a2bb-bef8a80ce94c tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:08.817485 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-f3a70a30-91f7-4766-a2bb-bef8a80ce94c tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5557a4cfdaab4a7fa40c17bf9fc9ceb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503b9ec7c8e48ff95ce15b92a41118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:08.827746 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f3a70a30-91f7-4766-a2bb-bef8a80ce94c tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] 10.222.0.70 "GET /compute/v2.1/servers/e7973075-ede5-4528-8d5f-83d994006015" status: 200 len: 1293 microversion: 2.1 time: 0.565899 Aug 27 03:00:08.831178 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1957/3925] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:00:08 2022] GET /compute/v2.1/servers/e7973075-ede5-4528-8d5f-83d994006015 => generated 1293 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:00:08.954908 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-63c7ffb6-717d-44b5-8cb6-147fe0bf2571 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "79ce70d9-9092-4fb0-858b-5d6565740fa7"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:00:08.958111 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-63c7ffb6-717d-44b5-8cb6-147fe0bf2571 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] [instance: 9d9f666f-0b19-4d87-a94a-770b5d99f349] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:08.978546 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-63c7ffb6-717d-44b5-8cb6-147fe0bf2571 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:08.979407 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-63c7ffb6-717d-44b5-8cb6-147fe0bf2571 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:08.980040 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-63c7ffb6-717d-44b5-8cb6-147fe0bf2571 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:08.981238 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-63c7ffb6-717d-44b5-8cb6-147fe0bf2571 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:08.981912 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-63c7ffb6-717d-44b5-8cb6-147fe0bf2571 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:08.982546 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-63c7ffb6-717d-44b5-8cb6-147fe0bf2571 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:09.289829 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-629c2e85-0869-4c79-b6dd-ba008d61d624 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:09.291184 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-629c2e85-0869-4c79-b6dd-ba008d61d624 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] [instance: 397ff5ae-2e76-4f8a-a013-7267ac623560] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:09.307138 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-629c2e85-0869-4c79-b6dd-ba008d61d624 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:09.307877 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-629c2e85-0869-4c79-b6dd-ba008d61d624 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:09.308560 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-629c2e85-0869-4c79-b6dd-ba008d61d624 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:09.309430 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-629c2e85-0869-4c79-b6dd-ba008d61d624 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:09.310031 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-629c2e85-0869-4c79-b6dd-ba008d61d624 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:09.310604 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-629c2e85-0869-4c79-b6dd-ba008d61d624 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:09.563148 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-63c7ffb6-717d-44b5-8cb6-147fe0bf2571 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] 10.222.0.70 "POST /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.613321 Aug 27 03:00:09.575876 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1969/3926] 10.222.0.70 () {60 vars in 1323 bytes} [Sat Aug 27 03:00:08 2022] POST /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349/os-volume_attachments => generated 194 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:00:09.856470 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d9b665cb-0190-475e-8533-f13b86343df0 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:09.857453 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d9b665cb-0190-475e-8533-f13b86343df0 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] [instance: e7973075-ede5-4528-8d5f-83d994006015] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:09.866271 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d9b665cb-0190-475e-8533-f13b86343df0 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:09.867150 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d9b665cb-0190-475e-8533-f13b86343df0 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:09.867799 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d9b665cb-0190-475e-8533-f13b86343df0 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:09.868920 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d9b665cb-0190-475e-8533-f13b86343df0 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:09.869537 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d9b665cb-0190-475e-8533-f13b86343df0 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:09.870244 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d9b665cb-0190-475e-8533-f13b86343df0 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:09.934702 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-629c2e85-0869-4c79-b6dd-ba008d61d624 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b01cfa9fe344fc69301777595764071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ce2ffcdbe14ccbae3bfae7febc3319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:09.945812 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-629c2e85-0869-4c79-b6dd-ba008d61d624 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] 10.222.0.70 "GET /compute/v2.1/servers/397ff5ae-2e76-4f8a-a013-7267ac623560" status: 200 len: 1273 microversion: 2.1 time: 0.659967 Aug 27 03:00:09.950384 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1958/3927] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:00:09 2022] GET /compute/v2.1/servers/397ff5ae-2e76-4f8a-a013-7267ac623560 => generated 1273 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:00:10.207783 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-c572c038-62e1-45b7-a659-80ff34023282 req-33de682a-e875-4a30-90ea-7ed998600952 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7973075-ede5-4528-8d5f-83d994006015", "name": "network-vif-plugged", "status": "completed", "tag": "6fdcfea5-9c16-4c87-8fdf-4781a514fa56"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:00:10.240414 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-c572c038-62e1-45b7-a659-80ff34023282 req-33de682a-e875-4a30-90ea-7ed998600952 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:10.247837 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-c572c038-62e1-45b7-a659-80ff34023282 req-33de682a-e875-4a30-90ea-7ed998600952 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:10.248332 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-c572c038-62e1-45b7-a659-80ff34023282 req-33de682a-e875-4a30-90ea-7ed998600952 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:10.292743 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-c572c038-62e1-45b7-a659-80ff34023282 req-33de682a-e875-4a30-90ea-7ed998600952 service nova] Creating event network-vif-plugged:6fdcfea5-9c16-4c87-8fdf-4781a514fa56 for instance e7973075-ede5-4528-8d5f-83d994006015 on n-h2-852278-4 Aug 27 03:00:10.320406 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-c572c038-62e1-45b7-a659-80ff34023282 req-33de682a-e875-4a30-90ea-7ed998600952 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111974 Aug 27 03:00:10.324433 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1959/3928] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:00:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:00:10.974175 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-75e3eb43-d3fa-4cb3-bb6a-42fe455301a9 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:10.975250 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-75e3eb43-d3fa-4cb3-bb6a-42fe455301a9 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] [instance: 397ff5ae-2e76-4f8a-a013-7267ac623560] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:11.000494 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-75e3eb43-d3fa-4cb3-bb6a-42fe455301a9 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:11.002343 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-75e3eb43-d3fa-4cb3-bb6a-42fe455301a9 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:11.004162 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-75e3eb43-d3fa-4cb3-bb6a-42fe455301a9 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:11.008824 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-75e3eb43-d3fa-4cb3-bb6a-42fe455301a9 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:11.009585 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-75e3eb43-d3fa-4cb3-bb6a-42fe455301a9 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:11.010390 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-75e3eb43-d3fa-4cb3-bb6a-42fe455301a9 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:12.086475 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d9b665cb-0190-475e-8533-f13b86343df0 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5557a4cfdaab4a7fa40c17bf9fc9ceb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503b9ec7c8e48ff95ce15b92a41118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:12.102043 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d9b665cb-0190-475e-8533-f13b86343df0 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] 10.222.0.70 "GET /compute/v2.1/servers/e7973075-ede5-4528-8d5f-83d994006015" status: 200 len: 1293 microversion: 2.1 time: 2.252503 Aug 27 03:00:12.117740 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1970/3929] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:00:09 2022] GET /compute/v2.1/servers/e7973075-ede5-4528-8d5f-83d994006015 => generated 1293 bytes in 2269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:00:12.204051 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-75e3eb43-d3fa-4cb3-bb6a-42fe455301a9 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b01cfa9fe344fc69301777595764071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ce2ffcdbe14ccbae3bfae7febc3319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:12.213807 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-75e3eb43-d3fa-4cb3-bb6a-42fe455301a9 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] 10.222.0.70 "GET /compute/v2.1/servers/397ff5ae-2e76-4f8a-a013-7267ac623560" status: 200 len: 1315 microversion: 2.1 time: 1.246871 Aug 27 03:00:12.222719 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1960/3930] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:00:10 2022] GET /compute/v2.1/servers/397ff5ae-2e76-4f8a-a013-7267ac623560 => generated 1315 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:00:13.125877 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-6e622cf1-6e60-41e9-98aa-6a779163a13a tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:13.126819 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-6e622cf1-6e60-41e9-98aa-6a779163a13a tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] [instance: e7973075-ede5-4528-8d5f-83d994006015] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:13.140096 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:00:13.147739 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6e622cf1-6e60-41e9-98aa-6a779163a13a tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:13.156085 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6e622cf1-6e60-41e9-98aa-6a779163a13a tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:13.156550 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6e622cf1-6e60-41e9-98aa-6a779163a13a tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:13.157341 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6e622cf1-6e60-41e9-98aa-6a779163a13a tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:13.157813 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6e622cf1-6e60-41e9-98aa-6a779163a13a tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:13.158250 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6e622cf1-6e60-41e9-98aa-6a779163a13a tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:13.243422 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b781a225-56c0-465c-b7b4-65a1e780ddf6 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:13.244875 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b781a225-56c0-465c-b7b4-65a1e780ddf6 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] [instance: 397ff5ae-2e76-4f8a-a013-7267ac623560] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:13.274330 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b781a225-56c0-465c-b7b4-65a1e780ddf6 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:13.274330 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b781a225-56c0-465c-b7b4-65a1e780ddf6 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:13.274330 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b781a225-56c0-465c-b7b4-65a1e780ddf6 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:13.274697 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b781a225-56c0-465c-b7b4-65a1e780ddf6 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:13.275078 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b781a225-56c0-465c-b7b4-65a1e780ddf6 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:13.287598 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b781a225-56c0-465c-b7b4-65a1e780ddf6 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:14.319538 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b781a225-56c0-465c-b7b4-65a1e780ddf6 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b01cfa9fe344fc69301777595764071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ce2ffcdbe14ccbae3bfae7febc3319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:14.331624 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b781a225-56c0-465c-b7b4-65a1e780ddf6 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] 10.222.0.70 "GET /compute/v2.1/servers/397ff5ae-2e76-4f8a-a013-7267ac623560" status: 200 len: 1315 microversion: 2.1 time: 1.092318 Aug 27 03:00:14.333909 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1961/3931] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:00:13 2022] GET /compute/v2.1/servers/397ff5ae-2e76-4f8a-a013-7267ac623560 => generated 1315 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:00:14.404792 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-6e622cf1-6e60-41e9-98aa-6a779163a13a tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5557a4cfdaab4a7fa40c17bf9fc9ceb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503b9ec7c8e48ff95ce15b92a41118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:14.416482 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-6e622cf1-6e60-41e9-98aa-6a779163a13a tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] 10.222.0.70 "GET /compute/v2.1/servers/e7973075-ede5-4528-8d5f-83d994006015" status: 200 len: 1293 microversion: 2.1 time: 1.296719 Aug 27 03:00:14.420458 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1971/3932] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:00:13 2022] GET /compute/v2.1/servers/e7973075-ede5-4528-8d5f-83d994006015 => generated 1293 bytes in 1302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:00:15.277061 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-452a5b09-a7bb-4921-81a8-a1e72251b617 req-6232815c-a453-4bb5-8b6c-3f809681ef24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "397ff5ae-2e76-4f8a-a013-7267ac623560", "tag": "29fbfebc-afc9-41f7-9702-825cd1482467"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:00:15.328910 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-452a5b09-a7bb-4921-81a8-a1e72251b617 req-6232815c-a453-4bb5-8b6c-3f809681ef24 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:15.329575 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-452a5b09-a7bb-4921-81a8-a1e72251b617 req-6232815c-a453-4bb5-8b6c-3f809681ef24 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:15.332127 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-452a5b09-a7bb-4921-81a8-a1e72251b617 req-6232815c-a453-4bb5-8b6c-3f809681ef24 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:15.354049 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-45c23684-a368-437c-b668-b8e00de4987c tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:15.354665 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-45c23684-a368-437c-b668-b8e00de4987c tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] [instance: 397ff5ae-2e76-4f8a-a013-7267ac623560] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:15.356708 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:00:15.385444 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-452a5b09-a7bb-4921-81a8-a1e72251b617 req-6232815c-a453-4bb5-8b6c-3f809681ef24 service nova] Creating event network-changed:29fbfebc-afc9-41f7-9702-825cd1482467 for instance 397ff5ae-2e76-4f8a-a013-7267ac623560 on n-h1-852278-4 Aug 27 03:00:15.391162 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-45c23684-a368-437c-b668-b8e00de4987c tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:15.391663 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-45c23684-a368-437c-b668-b8e00de4987c tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:15.392100 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-45c23684-a368-437c-b668-b8e00de4987c tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:15.401024 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-45c23684-a368-437c-b668-b8e00de4987c tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:15.401698 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-45c23684-a368-437c-b668-b8e00de4987c tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:15.404530 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-45c23684-a368-437c-b668-b8e00de4987c tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:15.417687 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-452a5b09-a7bb-4921-81a8-a1e72251b617 req-6232815c-a453-4bb5-8b6c-3f809681ef24 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.146807 Aug 27 03:00:15.421746 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1962/3933] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:00:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:00:15.443989 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-93ca2615-ae31-4e60-a1db-82cf990fe176 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:15.446511 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-93ca2615-ae31-4e60-a1db-82cf990fe176 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] [instance: e7973075-ede5-4528-8d5f-83d994006015] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:15.468874 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-93ca2615-ae31-4e60-a1db-82cf990fe176 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:15.469372 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-93ca2615-ae31-4e60-a1db-82cf990fe176 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:15.469811 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-93ca2615-ae31-4e60-a1db-82cf990fe176 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:15.470525 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-93ca2615-ae31-4e60-a1db-82cf990fe176 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:15.479576 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-93ca2615-ae31-4e60-a1db-82cf990fe176 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:15.479576 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-93ca2615-ae31-4e60-a1db-82cf990fe176 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:15.664863 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=8 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:00:16.119888 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-45c23684-a368-437c-b668-b8e00de4987c tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b01cfa9fe344fc69301777595764071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ce2ffcdbe14ccbae3bfae7febc3319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:16.138487 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-45c23684-a368-437c-b668-b8e00de4987c tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] 10.222.0.70 "GET /compute/v2.1/servers/397ff5ae-2e76-4f8a-a013-7267ac623560" status: 200 len: 1315 microversion: 2.1 time: 0.780386 Aug 27 03:00:16.139431 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1972/3934] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:00:15 2022] GET /compute/v2.1/servers/397ff5ae-2e76-4f8a-a013-7267ac623560 => generated 1315 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:00:16.248272 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-93ca2615-ae31-4e60-a1db-82cf990fe176 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5557a4cfdaab4a7fa40c17bf9fc9ceb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503b9ec7c8e48ff95ce15b92a41118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:16.261984 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-93ca2615-ae31-4e60-a1db-82cf990fe176 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] 10.222.0.70 "GET /compute/v2.1/servers/e7973075-ede5-4528-8d5f-83d994006015" status: 200 len: 1484 microversion: 2.1 time: 0.823431 Aug 27 03:00:16.263730 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1963/3935] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:00:15 2022] GET /compute/v2.1/servers/e7973075-ede5-4528-8d5f-83d994006015 => generated 1484 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:00:16.286444 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-34cbe58a-bc7b-413f-9eba-6aeb8b0b06e5 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:16.287222 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-34cbe58a-bc7b-413f-9eba-6aeb8b0b06e5 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] [instance: e7973075-ede5-4528-8d5f-83d994006015] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:16.300632 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-34cbe58a-bc7b-413f-9eba-6aeb8b0b06e5 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:16.301493 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-34cbe58a-bc7b-413f-9eba-6aeb8b0b06e5 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:16.306699 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-34cbe58a-bc7b-413f-9eba-6aeb8b0b06e5 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:16.307712 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-34cbe58a-bc7b-413f-9eba-6aeb8b0b06e5 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:16.317031 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-34cbe58a-bc7b-413f-9eba-6aeb8b0b06e5 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:16.317741 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-34cbe58a-bc7b-413f-9eba-6aeb8b0b06e5 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:16.641207 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-34cbe58a-bc7b-413f-9eba-6aeb8b0b06e5 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] 10.222.0.70 "GET /compute/v2.1/servers/e7973075-ede5-4528-8d5f-83d994006015/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.358579 Aug 27 03:00:16.649193 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1973/3936] 10.222.0.70 () {58 vars in 1275 bytes} [Sat Aug 27 03:00:16 2022] GET /compute/v2.1/servers/e7973075-ede5-4528-8d5f-83d994006015/os-interface => generated 285 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:00:16.827189 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5b34da03-8c2f-465d-a012-d8fcd674d5b6 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1313928923", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "801132e4-ddd2-46d3-8f97-b5cdf536ca14"}]}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:00:16.980175 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.network.neutron [None req-5b34da03-8c2f-465d-a012-d8fcd674d5b6 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] validate_networks() for [('801132e4-ddd2-46d3-8f97-b5cdf536ca14', None, None, None, None, None)] {{(pid=134052) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:00:17.159294 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4f7d8a0b-2b3c-40d6-8192-feb62e8794e7 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:17.160639 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-4f7d8a0b-2b3c-40d6-8192-feb62e8794e7 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] [instance: 397ff5ae-2e76-4f8a-a013-7267ac623560] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:17.170089 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4f7d8a0b-2b3c-40d6-8192-feb62e8794e7 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:17.175047 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4f7d8a0b-2b3c-40d6-8192-feb62e8794e7 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:17.175768 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4f7d8a0b-2b3c-40d6-8192-feb62e8794e7 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:17.176882 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4f7d8a0b-2b3c-40d6-8192-feb62e8794e7 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:17.177607 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4f7d8a0b-2b3c-40d6-8192-feb62e8794e7 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:17.178687 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4f7d8a0b-2b3c-40d6-8192-feb62e8794e7 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:18.547065 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-4f7d8a0b-2b3c-40d6-8192-feb62e8794e7 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b01cfa9fe344fc69301777595764071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ce2ffcdbe14ccbae3bfae7febc3319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:18.558275 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-4f7d8a0b-2b3c-40d6-8192-feb62e8794e7 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] 10.222.0.70 "GET /compute/v2.1/servers/397ff5ae-2e76-4f8a-a013-7267ac623560" status: 200 len: 1315 microversion: 2.1 time: 1.402996 Aug 27 03:00:18.590205 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1974/3937] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:00:17 2022] GET /compute/v2.1/servers/397ff5ae-2e76-4f8a-a013-7267ac623560 => generated 1315 bytes in 1435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:00:19.592749 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e26a8d9c-6d7b-404d-bf75-531db7cf4b94 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:19.593499 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-e26a8d9c-6d7b-404d-bf75-531db7cf4b94 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] [instance: 397ff5ae-2e76-4f8a-a013-7267ac623560] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:19.608740 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e26a8d9c-6d7b-404d-bf75-531db7cf4b94 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:19.609264 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e26a8d9c-6d7b-404d-bf75-531db7cf4b94 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:19.614508 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e26a8d9c-6d7b-404d-bf75-531db7cf4b94 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:19.615406 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e26a8d9c-6d7b-404d-bf75-531db7cf4b94 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:19.615832 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e26a8d9c-6d7b-404d-bf75-531db7cf4b94 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:19.616258 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e26a8d9c-6d7b-404d-bf75-531db7cf4b94 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:20.785989 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-5b34da03-8c2f-465d-a012-d8fcd674d5b6 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Flavor limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:00:20.787843 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-5b34da03-8c2f-465d-a012-d8fcd674d5b6 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Image limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:00:20.788567 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-5b34da03-8c2f-465d-a012-d8fcd674d5b6 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Flavor pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:00:20.789169 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-5b34da03-8c2f-465d-a012-d8fcd674d5b6 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Image pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:00:20.789771 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-5b34da03-8c2f-465d-a012-d8fcd674d5b6 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:00:20.811395 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5b34da03-8c2f-465d-a012-d8fcd674d5b6 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:20.814503 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5b34da03-8c2f-465d-a012-d8fcd674d5b6 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:20.817238 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5b34da03-8c2f-465d-a012-d8fcd674d5b6 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:20.822780 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5b34da03-8c2f-465d-a012-d8fcd674d5b6 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:20.824929 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5b34da03-8c2f-465d-a012-d8fcd674d5b6 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:20.827977 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5b34da03-8c2f-465d-a012-d8fcd674d5b6 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:20.877639 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-5b34da03-8c2f-465d-a012-d8fcd674d5b6 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Getting quotas for project 2f10c920e826430c8cbda7e54f288606. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:00:20.885877 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-5b34da03-8c2f-465d-a012-d8fcd674d5b6 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Getting quotas for user 113050e1c2d24f8b8b522d84f7cf267b and project 2f10c920e826430c8cbda7e54f288606. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:00:20.919413 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-5b34da03-8c2f-465d-a012-d8fcd674d5b6 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Going to run 1 instances... {{(pid=134052) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:00:20.930868 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-5b34da03-8c2f-465d-a012-d8fcd674d5b6 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] [instance: 65a92ef8-24d4-4114-980a-2222eab94658] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134052) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:00:21.007157 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-5b34da03-8c2f-465d-a012-d8fcd674d5b6 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.298527 Aug 27 03:00:21.017289 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1964/3938] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 03:00:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 4309 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 03:00:21.026799 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f7dfa34b-234a-45ba-8c18-22ccdf28dca1 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:21.027444 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-f7dfa34b-234a-45ba-8c18-22ccdf28dca1 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] [instance: 65a92ef8-24d4-4114-980a-2222eab94658] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:21.393190 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-f7dfa34b-234a-45ba-8c18-22ccdf28dca1 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113050e1c2d24f8b8b522d84f7cf267b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f10c920e826430c8cbda7e54f288606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:21.406990 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f7dfa34b-234a-45ba-8c18-22ccdf28dca1 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] 10.222.0.70 "GET /compute/v2.1/servers/65a92ef8-24d4-4114-980a-2222eab94658" status: 200 len: 1224 microversion: 2.1 time: 0.388533 Aug 27 03:00:21.416959 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1965/3939] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:00:21 2022] GET /compute/v2.1/servers/65a92ef8-24d4-4114-980a-2222eab94658 => generated 1224 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:00:21.511708 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e26a8d9c-6d7b-404d-bf75-531db7cf4b94 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b01cfa9fe344fc69301777595764071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ce2ffcdbe14ccbae3bfae7febc3319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:21.532362 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e26a8d9c-6d7b-404d-bf75-531db7cf4b94 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] 10.222.0.70 "GET /compute/v2.1/servers/397ff5ae-2e76-4f8a-a013-7267ac623560" status: 200 len: 1315 microversion: 2.1 time: 1.942156 Aug 27 03:00:21.540382 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1975/3940] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:00:19 2022] GET /compute/v2.1/servers/397ff5ae-2e76-4f8a-a013-7267ac623560 => generated 1315 bytes in 1952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:00:22.428592 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0190785f-fadc-42d4-bc00-34ab63eb8126 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:22.430376 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-0190785f-fadc-42d4-bc00-34ab63eb8126 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] [instance: 65a92ef8-24d4-4114-980a-2222eab94658] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:22.454430 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0190785f-fadc-42d4-bc00-34ab63eb8126 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:22.454933 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0190785f-fadc-42d4-bc00-34ab63eb8126 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:22.455373 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0190785f-fadc-42d4-bc00-34ab63eb8126 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:22.464657 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0190785f-fadc-42d4-bc00-34ab63eb8126 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:22.465131 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0190785f-fadc-42d4-bc00-34ab63eb8126 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:22.465575 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0190785f-fadc-42d4-bc00-34ab63eb8126 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:22.555541 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e28d46e1-1b5d-4183-9dd3-fbab54eda560 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:22.556290 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-e28d46e1-1b5d-4183-9dd3-fbab54eda560 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] [instance: 397ff5ae-2e76-4f8a-a013-7267ac623560] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:22.574084 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e28d46e1-1b5d-4183-9dd3-fbab54eda560 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:22.574937 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e28d46e1-1b5d-4183-9dd3-fbab54eda560 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:22.576782 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e28d46e1-1b5d-4183-9dd3-fbab54eda560 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:22.577643 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e28d46e1-1b5d-4183-9dd3-fbab54eda560 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:22.584954 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e28d46e1-1b5d-4183-9dd3-fbab54eda560 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:22.585744 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e28d46e1-1b5d-4183-9dd3-fbab54eda560 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:22.602238 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:00:23.584335 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0190785f-fadc-42d4-bc00-34ab63eb8126 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113050e1c2d24f8b8b522d84f7cf267b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f10c920e826430c8cbda7e54f288606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:23.610255 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-0190785f-fadc-42d4-bc00-34ab63eb8126 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] 10.222.0.70 "GET /compute/v2.1/servers/65a92ef8-24d4-4114-980a-2222eab94658" status: 200 len: 1276 microversion: 2.1 time: 1.186699 Aug 27 03:00:23.626034 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1966/3941] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:00:22 2022] GET /compute/v2.1/servers/65a92ef8-24d4-4114-980a-2222eab94658 => generated 1276 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:00:23.675621 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e28d46e1-1b5d-4183-9dd3-fbab54eda560 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b01cfa9fe344fc69301777595764071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ce2ffcdbe14ccbae3bfae7febc3319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:23.683910 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e28d46e1-1b5d-4183-9dd3-fbab54eda560 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] 10.222.0.70 "GET /compute/v2.1/servers/397ff5ae-2e76-4f8a-a013-7267ac623560" status: 200 len: 1315 microversion: 2.1 time: 1.132475 Aug 27 03:00:23.686748 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1976/3942] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:00:22 2022] GET /compute/v2.1/servers/397ff5ae-2e76-4f8a-a013-7267ac623560 => generated 1315 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:00:24.631336 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b7fd9c07-4b11-4eb4-a60e-21baca54c40a tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:24.632697 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b7fd9c07-4b11-4eb4-a60e-21baca54c40a tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] [instance: 65a92ef8-24d4-4114-980a-2222eab94658] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:24.650283 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b7fd9c07-4b11-4eb4-a60e-21baca54c40a tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:24.650773 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b7fd9c07-4b11-4eb4-a60e-21baca54c40a tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:24.651254 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b7fd9c07-4b11-4eb4-a60e-21baca54c40a tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:24.651970 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b7fd9c07-4b11-4eb4-a60e-21baca54c40a tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:24.652437 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b7fd9c07-4b11-4eb4-a60e-21baca54c40a tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:24.652905 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b7fd9c07-4b11-4eb4-a60e-21baca54c40a tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:24.706805 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-821b47ca-8ae1-4955-be73-8c232cdbde02 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:24.707540 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-821b47ca-8ae1-4955-be73-8c232cdbde02 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] [instance: 397ff5ae-2e76-4f8a-a013-7267ac623560] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:24.731361 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-821b47ca-8ae1-4955-be73-8c232cdbde02 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:24.731979 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-821b47ca-8ae1-4955-be73-8c232cdbde02 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:24.732617 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-821b47ca-8ae1-4955-be73-8c232cdbde02 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:24.734079 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-821b47ca-8ae1-4955-be73-8c232cdbde02 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:24.734079 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-821b47ca-8ae1-4955-be73-8c232cdbde02 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:24.734634 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-821b47ca-8ae1-4955-be73-8c232cdbde02 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:24.876860 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b7fd9c07-4b11-4eb4-a60e-21baca54c40a tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113050e1c2d24f8b8b522d84f7cf267b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f10c920e826430c8cbda7e54f288606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:24.893395 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b7fd9c07-4b11-4eb4-a60e-21baca54c40a tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] 10.222.0.70 "GET /compute/v2.1/servers/65a92ef8-24d4-4114-980a-2222eab94658" status: 200 len: 1282 microversion: 2.1 time: 0.266008 Aug 27 03:00:24.907430 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1967/3943] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:00:24 2022] GET /compute/v2.1/servers/65a92ef8-24d4-4114-980a-2222eab94658 => generated 1282 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:00:25.541371 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-821b47ca-8ae1-4955-be73-8c232cdbde02 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b01cfa9fe344fc69301777595764071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ce2ffcdbe14ccbae3bfae7febc3319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:25.550845 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-821b47ca-8ae1-4955-be73-8c232cdbde02 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] 10.222.0.70 "GET /compute/v2.1/servers/397ff5ae-2e76-4f8a-a013-7267ac623560" status: 200 len: 1315 microversion: 2.1 time: 0.848229 Aug 27 03:00:25.555516 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1977/3944] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:00:24 2022] GET /compute/v2.1/servers/397ff5ae-2e76-4f8a-a013-7267ac623560 => generated 1315 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:00:25.589360 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0b5ff8df-70c8-4a2d-96a9-7eab986b6884 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:25.589970 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-0b5ff8df-70c8-4a2d-96a9-7eab986b6884 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] [instance: e7973075-ede5-4528-8d5f-83d994006015] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:25.605053 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0b5ff8df-70c8-4a2d-96a9-7eab986b6884 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:25.605561 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0b5ff8df-70c8-4a2d-96a9-7eab986b6884 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:25.606167 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0b5ff8df-70c8-4a2d-96a9-7eab986b6884 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:25.607079 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0b5ff8df-70c8-4a2d-96a9-7eab986b6884 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:25.607675 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0b5ff8df-70c8-4a2d-96a9-7eab986b6884 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:25.608246 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0b5ff8df-70c8-4a2d-96a9-7eab986b6884 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:25.629682 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-2389d1f0-4dbb-4133-8835-5cf72c184bcb req-a079f3cb-d3b5-427a-831f-57c104767273 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7973075-ede5-4528-8d5f-83d994006015", "tag": "6fdcfea5-9c16-4c87-8fdf-4781a514fa56"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:00:25.651419 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-2389d1f0-4dbb-4133-8835-5cf72c184bcb req-a079f3cb-d3b5-427a-831f-57c104767273 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:25.652108 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-2389d1f0-4dbb-4133-8835-5cf72c184bcb req-a079f3cb-d3b5-427a-831f-57c104767273 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:25.653718 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-2389d1f0-4dbb-4133-8835-5cf72c184bcb req-a079f3cb-d3b5-427a-831f-57c104767273 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:25.684552 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-2389d1f0-4dbb-4133-8835-5cf72c184bcb req-a079f3cb-d3b5-427a-831f-57c104767273 service nova] Creating event network-changed:6fdcfea5-9c16-4c87-8fdf-4781a514fa56 for instance e7973075-ede5-4528-8d5f-83d994006015 on n-h2-852278-4 Aug 27 03:00:25.700269 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-2389d1f0-4dbb-4133-8835-5cf72c184bcb req-a079f3cb-d3b5-427a-831f-57c104767273 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074361 Aug 27 03:00:25.704210 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1978/3945] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:00:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:00:25.916123 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-18fd46ab-6544-454c-b5e1-affc9c0fef79 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:25.918564 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-18fd46ab-6544-454c-b5e1-affc9c0fef79 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] [instance: 65a92ef8-24d4-4114-980a-2222eab94658] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:25.930985 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-18fd46ab-6544-454c-b5e1-affc9c0fef79 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:25.941275 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-18fd46ab-6544-454c-b5e1-affc9c0fef79 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:25.942149 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-18fd46ab-6544-454c-b5e1-affc9c0fef79 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:25.943989 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-18fd46ab-6544-454c-b5e1-affc9c0fef79 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:25.945115 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-18fd46ab-6544-454c-b5e1-affc9c0fef79 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:25.946149 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-18fd46ab-6544-454c-b5e1-affc9c0fef79 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:26.563605 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-18fd46ab-6544-454c-b5e1-affc9c0fef79 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113050e1c2d24f8b8b522d84f7cf267b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f10c920e826430c8cbda7e54f288606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:26.593413 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-18fd46ab-6544-454c-b5e1-affc9c0fef79 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] 10.222.0.70 "GET /compute/v2.1/servers/65a92ef8-24d4-4114-980a-2222eab94658" status: 200 len: 1282 microversion: 2.1 time: 0.682265 Aug 27 03:00:26.594753 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1979/3946] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:00:25 2022] GET /compute/v2.1/servers/65a92ef8-24d4-4114-980a-2222eab94658 => generated 1282 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:00:26.604084 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-bd55920e-79e7-4395-9c07-fc94ecd49d83 req-362e4dcc-83d6-4ca9-adcf-68cab2c20a74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "397ff5ae-2e76-4f8a-a013-7267ac623560", "name": "network-vif-plugged", "status": "completed", "tag": "29fbfebc-afc9-41f7-9702-825cd1482467"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:00:26.628161 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-bd55920e-79e7-4395-9c07-fc94ecd49d83 req-362e4dcc-83d6-4ca9-adcf-68cab2c20a74 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:26.629981 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-bd55920e-79e7-4395-9c07-fc94ecd49d83 req-362e4dcc-83d6-4ca9-adcf-68cab2c20a74 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:26.631396 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-bd55920e-79e7-4395-9c07-fc94ecd49d83 req-362e4dcc-83d6-4ca9-adcf-68cab2c20a74 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:26.712591 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-bd55920e-79e7-4395-9c07-fc94ecd49d83 req-362e4dcc-83d6-4ca9-adcf-68cab2c20a74 service nova] Creating event network-vif-plugged:29fbfebc-afc9-41f7-9702-825cd1482467 for instance 397ff5ae-2e76-4f8a-a013-7267ac623560 on n-h1-852278-4 Aug 27 03:00:26.727567 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-bd55920e-79e7-4395-9c07-fc94ecd49d83 req-362e4dcc-83d6-4ca9-adcf-68cab2c20a74 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130674 Aug 27 03:00:26.730652 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1980/3947] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:00:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:00:26.737479 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b61d31b0-6276-4b7f-ab9e-2f3ad78d22c3 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:26.745303 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b61d31b0-6276-4b7f-ab9e-2f3ad78d22c3 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] [instance: 397ff5ae-2e76-4f8a-a013-7267ac623560] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:26.767976 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b61d31b0-6276-4b7f-ab9e-2f3ad78d22c3 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:26.768648 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b61d31b0-6276-4b7f-ab9e-2f3ad78d22c3 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:26.770661 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b61d31b0-6276-4b7f-ab9e-2f3ad78d22c3 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:26.773635 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b61d31b0-6276-4b7f-ab9e-2f3ad78d22c3 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:26.774233 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b61d31b0-6276-4b7f-ab9e-2f3ad78d22c3 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:26.774776 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b61d31b0-6276-4b7f-ab9e-2f3ad78d22c3 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:27.022327 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0b5ff8df-70c8-4a2d-96a9-7eab986b6884 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5557a4cfdaab4a7fa40c17bf9fc9ceb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503b9ec7c8e48ff95ce15b92a41118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:27.061083 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-0b5ff8df-70c8-4a2d-96a9-7eab986b6884 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] 10.222.0.70 "GET /compute/v2.1/servers/e7973075-ede5-4528-8d5f-83d994006015" status: 200 len: 1484 microversion: 2.1 time: 1.468032 Aug 27 03:00:27.062933 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1968/3948] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:00:25 2022] GET /compute/v2.1/servers/e7973075-ede5-4528-8d5f-83d994006015 => generated 1484 bytes in 1478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:00:27.589498 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-b61d31b0-6276-4b7f-ab9e-2f3ad78d22c3 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b01cfa9fe344fc69301777595764071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ce2ffcdbe14ccbae3bfae7febc3319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:27.606643 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b61d31b0-6276-4b7f-ab9e-2f3ad78d22c3 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] 10.222.0.70 "GET /compute/v2.1/servers/397ff5ae-2e76-4f8a-a013-7267ac623560" status: 200 len: 1315 microversion: 2.1 time: 0.871167 Aug 27 03:00:27.608246 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1981/3949] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:00:26 2022] GET /compute/v2.1/servers/397ff5ae-2e76-4f8a-a013-7267ac623560 => generated 1315 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:00:27.615955 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-db4424af-1ec4-4f19-ae4a-6bae14455850 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:27.631084 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-db4424af-1ec4-4f19-ae4a-6bae14455850 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] [instance: 65a92ef8-24d4-4114-980a-2222eab94658] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:27.638462 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-db4424af-1ec4-4f19-ae4a-6bae14455850 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:27.639250 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-db4424af-1ec4-4f19-ae4a-6bae14455850 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:27.639857 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-db4424af-1ec4-4f19-ae4a-6bae14455850 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:27.640942 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-db4424af-1ec4-4f19-ae4a-6bae14455850 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:27.641566 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-db4424af-1ec4-4f19-ae4a-6bae14455850 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:27.642345 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-db4424af-1ec4-4f19-ae4a-6bae14455850 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:27.920220 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0f86a905-b52f-4e9e-9cf3-ee96d2d8b414 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:00:27.930659 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0f86a905-b52f-4e9e-9cf3-ee96d2d8b414 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:27.931162 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0f86a905-b52f-4e9e-9cf3-ee96d2d8b414 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:27.931609 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0f86a905-b52f-4e9e-9cf3-ee96d2d8b414 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:27.996082 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-0f86a905-b52f-4e9e-9cf3-ee96d2d8b414 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] [instance: 9d9f666f-0b19-4d87-a94a-770b5d99f349] Going to try to stop instance {{(pid=134051) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 27 03:00:28.086776 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-0f86a905-b52f-4e9e-9cf3-ee96d2d8b414 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] 10.222.0.70 "POST /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349/action" status: 202 len: 0 microversion: 2.1 time: 0.172329 Aug 27 03:00:28.093484 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1982/3950] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:00:27 2022] POST /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349/action => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:00:28.100041 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a25b3053-4dd9-4a59-bd73-574dc72c229a tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:28.101108 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-a25b3053-4dd9-4a59-bd73-574dc72c229a tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] [instance: 9d9f666f-0b19-4d87-a94a-770b5d99f349] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:28.109088 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a25b3053-4dd9-4a59-bd73-574dc72c229a tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:28.109893 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a25b3053-4dd9-4a59-bd73-574dc72c229a tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:28.110534 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a25b3053-4dd9-4a59-bd73-574dc72c229a tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:28.111526 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a25b3053-4dd9-4a59-bd73-574dc72c229a tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:28.112173 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a25b3053-4dd9-4a59-bd73-574dc72c229a tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:28.114236 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a25b3053-4dd9-4a59-bd73-574dc72c229a tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:28.286104 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-db4424af-1ec4-4f19-ae4a-6bae14455850 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113050e1c2d24f8b8b522d84f7cf267b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f10c920e826430c8cbda7e54f288606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:28.301499 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-db4424af-1ec4-4f19-ae4a-6bae14455850 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] 10.222.0.70 "GET /compute/v2.1/servers/65a92ef8-24d4-4114-980a-2222eab94658" status: 200 len: 1324 microversion: 2.1 time: 0.690131 Aug 27 03:00:28.306222 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1969/3951] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:00:27 2022] GET /compute/v2.1/servers/65a92ef8-24d4-4114-980a-2222eab94658 => generated 1324 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:00:28.641122 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f6d337a2-7083-4b51-9001-93f90b707014 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:28.642375 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-f6d337a2-7083-4b51-9001-93f90b707014 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] [instance: 397ff5ae-2e76-4f8a-a013-7267ac623560] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:28.676640 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-a25b3053-4dd9-4a59-bd73-574dc72c229a tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe0328160c6472086d13907344756cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41649f09cbf410a9825100c498b4916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:28.691833 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a25b3053-4dd9-4a59-bd73-574dc72c229a tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] 10.222.0.70 "GET /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349" status: 200 len: 1721 microversion: 2.1 time: 0.592154 Aug 27 03:00:28.692673 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1983/3952] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:00:28 2022] GET /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349 => generated 1721 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:00:28.695372 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f6d337a2-7083-4b51-9001-93f90b707014 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:28.695880 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f6d337a2-7083-4b51-9001-93f90b707014 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:28.696340 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f6d337a2-7083-4b51-9001-93f90b707014 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:28.697074 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f6d337a2-7083-4b51-9001-93f90b707014 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:28.697528 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f6d337a2-7083-4b51-9001-93f90b707014 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:28.697950 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f6d337a2-7083-4b51-9001-93f90b707014 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:29.245308 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-f6d337a2-7083-4b51-9001-93f90b707014 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b01cfa9fe344fc69301777595764071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ce2ffcdbe14ccbae3bfae7febc3319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:29.257604 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f6d337a2-7083-4b51-9001-93f90b707014 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] 10.222.0.70 "GET /compute/v2.1/servers/397ff5ae-2e76-4f8a-a013-7267ac623560" status: 200 len: 1315 microversion: 2.1 time: 0.629678 Aug 27 03:00:29.258645 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1970/3953] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:00:28 2022] GET /compute/v2.1/servers/397ff5ae-2e76-4f8a-a013-7267ac623560 => generated 1315 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:00:29.327111 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-84351719-7847-41ba-a1dd-727d453cc45b tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:29.327723 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-84351719-7847-41ba-a1dd-727d453cc45b tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] [instance: 65a92ef8-24d4-4114-980a-2222eab94658] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:29.340553 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-84351719-7847-41ba-a1dd-727d453cc45b tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:29.341060 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-84351719-7847-41ba-a1dd-727d453cc45b tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:29.346261 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-84351719-7847-41ba-a1dd-727d453cc45b tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:29.347137 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-84351719-7847-41ba-a1dd-727d453cc45b tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:29.353373 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-84351719-7847-41ba-a1dd-727d453cc45b tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:29.353892 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-84351719-7847-41ba-a1dd-727d453cc45b tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:29.722172 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-96d8c19c-8043-476a-82eb-671a47990464 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:29.723555 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-96d8c19c-8043-476a-82eb-671a47990464 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] [instance: 9d9f666f-0b19-4d87-a94a-770b5d99f349] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:29.735077 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-96d8c19c-8043-476a-82eb-671a47990464 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:29.739379 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-96d8c19c-8043-476a-82eb-671a47990464 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:29.740699 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-96d8c19c-8043-476a-82eb-671a47990464 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:29.741582 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-96d8c19c-8043-476a-82eb-671a47990464 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:29.743789 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-96d8c19c-8043-476a-82eb-671a47990464 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:29.745656 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-96d8c19c-8043-476a-82eb-671a47990464 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:30.134631 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-84351719-7847-41ba-a1dd-727d453cc45b tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113050e1c2d24f8b8b522d84f7cf267b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f10c920e826430c8cbda7e54f288606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:30.148876 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-84351719-7847-41ba-a1dd-727d453cc45b tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] 10.222.0.70 "GET /compute/v2.1/servers/65a92ef8-24d4-4114-980a-2222eab94658" status: 200 len: 1324 microversion: 2.1 time: 0.825536 Aug 27 03:00:30.149783 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1984/3954] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:00:29 2022] GET /compute/v2.1/servers/65a92ef8-24d4-4114-980a-2222eab94658 => generated 1324 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:00:30.218213 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-96d8c19c-8043-476a-82eb-671a47990464 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe0328160c6472086d13907344756cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41649f09cbf410a9825100c498b4916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:30.230409 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-96d8c19c-8043-476a-82eb-671a47990464 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] 10.222.0.70 "GET /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349" status: 200 len: 1721 microversion: 2.1 time: 0.514026 Aug 27 03:00:30.246636 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1971/3955] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:00:29 2022] GET /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349 => generated 1721 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:00:30.282195 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0049bad4-8d9d-4e9b-8334-6ed44069fe36 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:30.283208 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-0049bad4-8d9d-4e9b-8334-6ed44069fe36 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] [instance: 397ff5ae-2e76-4f8a-a013-7267ac623560] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:30.289753 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0049bad4-8d9d-4e9b-8334-6ed44069fe36 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:30.290586 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0049bad4-8d9d-4e9b-8334-6ed44069fe36 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:30.291255 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0049bad4-8d9d-4e9b-8334-6ed44069fe36 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:30.292185 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0049bad4-8d9d-4e9b-8334-6ed44069fe36 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:30.292903 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0049bad4-8d9d-4e9b-8334-6ed44069fe36 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:30.293544 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0049bad4-8d9d-4e9b-8334-6ed44069fe36 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:30.408675 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-551c7a2d-dc6f-40d4-9965-54ae32fe52a3 req-aa5e1e8a-c8f7-49ee-90a7-56286f09f310 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65a92ef8-24d4-4114-980a-2222eab94658", "tag": "a5ffa1b9-364c-453c-ae84-4abb46872f60"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:00:30.421436 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-551c7a2d-dc6f-40d4-9965-54ae32fe52a3 req-aa5e1e8a-c8f7-49ee-90a7-56286f09f310 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:30.422210 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-551c7a2d-dc6f-40d4-9965-54ae32fe52a3 req-aa5e1e8a-c8f7-49ee-90a7-56286f09f310 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:30.422800 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-551c7a2d-dc6f-40d4-9965-54ae32fe52a3 req-aa5e1e8a-c8f7-49ee-90a7-56286f09f310 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:30.440602 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-551c7a2d-dc6f-40d4-9965-54ae32fe52a3 req-aa5e1e8a-c8f7-49ee-90a7-56286f09f310 service nova] Creating event network-changed:a5ffa1b9-364c-453c-ae84-4abb46872f60 for instance 65a92ef8-24d4-4114-980a-2222eab94658 on n-h2-852278-4 Aug 27 03:00:30.457753 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-551c7a2d-dc6f-40d4-9965-54ae32fe52a3 req-aa5e1e8a-c8f7-49ee-90a7-56286f09f310 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050522 Aug 27 03:00:30.467315 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1972/3956] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:00:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:00:30.795115 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-0049bad4-8d9d-4e9b-8334-6ed44069fe36 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b01cfa9fe344fc69301777595764071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ce2ffcdbe14ccbae3bfae7febc3319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:30.803862 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-0049bad4-8d9d-4e9b-8334-6ed44069fe36 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] 10.222.0.70 "GET /compute/v2.1/servers/397ff5ae-2e76-4f8a-a013-7267ac623560" status: 200 len: 1503 microversion: 2.1 time: 0.525479 Aug 27 03:00:30.807911 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1985/3957] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:00:30 2022] GET /compute/v2.1/servers/397ff5ae-2e76-4f8a-a013-7267ac623560 => generated 1503 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:00:30.834832 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b4d86369-b2ac-4f99-8fc1-c9b61811189b tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:30.835955 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b4d86369-b2ac-4f99-8fc1-c9b61811189b tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] [instance: 397ff5ae-2e76-4f8a-a013-7267ac623560] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:30.850854 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b4d86369-b2ac-4f99-8fc1-c9b61811189b tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:30.852962 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b4d86369-b2ac-4f99-8fc1-c9b61811189b tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:30.855536 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b4d86369-b2ac-4f99-8fc1-c9b61811189b tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:30.855536 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b4d86369-b2ac-4f99-8fc1-c9b61811189b tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:30.855536 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b4d86369-b2ac-4f99-8fc1-c9b61811189b tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:30.855536 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b4d86369-b2ac-4f99-8fc1-c9b61811189b tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:30.855536 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:00:31.030173 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b4d86369-b2ac-4f99-8fc1-c9b61811189b tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] 10.222.0.70 "DELETE /compute/v2.1/servers/397ff5ae-2e76-4f8a-a013-7267ac623560/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.201358 Aug 27 03:00:31.031045 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1973/3958] 10.222.0.70 () {58 vars in 1296 bytes} [Sat Aug 27 03:00:30 2022] DELETE /compute/v2.1/servers/397ff5ae-2e76-4f8a-a013-7267ac623560/os-server-password => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:00:31.041637 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-979c9b0e-14cc-4380-8605-8a052c653bd6 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:31.042144 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-979c9b0e-14cc-4380-8605-8a052c653bd6 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] [instance: 397ff5ae-2e76-4f8a-a013-7267ac623560] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:31.050826 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-979c9b0e-14cc-4380-8605-8a052c653bd6 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:31.051352 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-979c9b0e-14cc-4380-8605-8a052c653bd6 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:31.051793 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-979c9b0e-14cc-4380-8605-8a052c653bd6 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:31.054972 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-979c9b0e-14cc-4380-8605-8a052c653bd6 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:31.056431 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-979c9b0e-14cc-4380-8605-8a052c653bd6 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:31.057263 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-979c9b0e-14cc-4380-8605-8a052c653bd6 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:31.120986 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-979c9b0e-14cc-4380-8605-8a052c653bd6 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] 10.222.0.70 "GET /compute/v2.1/servers/397ff5ae-2e76-4f8a-a013-7267ac623560/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.083694 Aug 27 03:00:31.121776 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1986/3959] 10.222.0.70 () {58 vars in 1293 bytes} [Sat Aug 27 03:00:31 2022] GET /compute/v2.1/servers/397ff5ae-2e76-4f8a-a013-7267ac623560/os-server-password => generated 16 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:00:31.132446 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-458eb29d-dd84-44df-a820-e26ee4d0c58e tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:31.132947 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-458eb29d-dd84-44df-a820-e26ee4d0c58e tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] [instance: 397ff5ae-2e76-4f8a-a013-7267ac623560] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:31.144410 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-458eb29d-dd84-44df-a820-e26ee4d0c58e tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:31.149013 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-458eb29d-dd84-44df-a820-e26ee4d0c58e tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:31.151005 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-458eb29d-dd84-44df-a820-e26ee4d0c58e tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:31.151933 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-458eb29d-dd84-44df-a820-e26ee4d0c58e tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:31.152629 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-458eb29d-dd84-44df-a820-e26ee4d0c58e tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:31.154713 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-458eb29d-dd84-44df-a820-e26ee4d0c58e tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:31.169884 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3e617de6-01b3-435f-8a23-b0a71e0a1ee7 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:31.170668 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-3e617de6-01b3-435f-8a23-b0a71e0a1ee7 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] [instance: 65a92ef8-24d4-4114-980a-2222eab94658] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:31.181667 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3e617de6-01b3-435f-8a23-b0a71e0a1ee7 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:31.182328 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3e617de6-01b3-435f-8a23-b0a71e0a1ee7 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:31.183063 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3e617de6-01b3-435f-8a23-b0a71e0a1ee7 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:31.184057 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3e617de6-01b3-435f-8a23-b0a71e0a1ee7 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:31.186680 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3e617de6-01b3-435f-8a23-b0a71e0a1ee7 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:31.187570 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3e617de6-01b3-435f-8a23-b0a71e0a1ee7 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:31.221951 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-458eb29d-dd84-44df-a820-e26ee4d0c58e tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] [instance: 397ff5ae-2e76-4f8a-a013-7267ac623560] Going to try to terminate instance {{(pid=134052) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:00:31.285682 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=4 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:00:31.341410 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-458eb29d-dd84-44df-a820-e26ee4d0c58e tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] 10.222.0.70 "DELETE /compute/v2.1/servers/397ff5ae-2e76-4f8a-a013-7267ac623560" status: 204 len: 0 microversion: 2.1 time: 0.212588 Aug 27 03:00:31.342913 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1974/3960] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 03:00:31 2022] DELETE /compute/v2.1/servers/397ff5ae-2e76-4f8a-a013-7267ac623560 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:00:31.353392 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-dba16f08-1aac-4c87-a873-7245b7efbd3e tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:31.354564 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-dba16f08-1aac-4c87-a873-7245b7efbd3e tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] [instance: 9d9f666f-0b19-4d87-a94a-770b5d99f349] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:31.369746 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dba16f08-1aac-4c87-a873-7245b7efbd3e tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:31.371438 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dba16f08-1aac-4c87-a873-7245b7efbd3e tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:31.372488 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dba16f08-1aac-4c87-a873-7245b7efbd3e tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:31.373412 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dba16f08-1aac-4c87-a873-7245b7efbd3e tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:31.374073 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dba16f08-1aac-4c87-a873-7245b7efbd3e tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:31.375313 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dba16f08-1aac-4c87-a873-7245b7efbd3e tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:31.407765 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=8 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:00:31.852243 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-3e617de6-01b3-435f-8a23-b0a71e0a1ee7 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113050e1c2d24f8b8b522d84f7cf267b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f10c920e826430c8cbda7e54f288606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:31.865553 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-3e617de6-01b3-435f-8a23-b0a71e0a1ee7 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] 10.222.0.70 "GET /compute/v2.1/servers/65a92ef8-24d4-4114-980a-2222eab94658" status: 200 len: 1324 microversion: 2.1 time: 0.697072 Aug 27 03:00:31.867464 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1987/3961] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:00:31 2022] GET /compute/v2.1/servers/65a92ef8-24d4-4114-980a-2222eab94658 => generated 1324 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:00:31.885673 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-2de5b4df-5729-49c4-95d5-204ea8b8ca51 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:31.888532 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-2de5b4df-5729-49c4-95d5-204ea8b8ca51 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] [instance: 397ff5ae-2e76-4f8a-a013-7267ac623560] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:31.900037 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2de5b4df-5729-49c4-95d5-204ea8b8ca51 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:31.901329 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2de5b4df-5729-49c4-95d5-204ea8b8ca51 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:31.902773 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2de5b4df-5729-49c4-95d5-204ea8b8ca51 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:31.907051 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2de5b4df-5729-49c4-95d5-204ea8b8ca51 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:31.914616 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2de5b4df-5729-49c4-95d5-204ea8b8ca51 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:31.915260 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2de5b4df-5729-49c4-95d5-204ea8b8ca51 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:31.966747 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-dba16f08-1aac-4c87-a873-7245b7efbd3e tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe0328160c6472086d13907344756cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41649f09cbf410a9825100c498b4916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:31.982104 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-dba16f08-1aac-4c87-a873-7245b7efbd3e tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] 10.222.0.70 "GET /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349" status: 200 len: 1721 microversion: 2.1 time: 0.637759 Aug 27 03:00:31.982898 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1975/3962] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:00:31 2022] GET /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349 => generated 1721 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:00:32.265394 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-2de5b4df-5729-49c4-95d5-204ea8b8ca51 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b01cfa9fe344fc69301777595764071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ce2ffcdbe14ccbae3bfae7febc3319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:32.279030 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-2de5b4df-5729-49c4-95d5-204ea8b8ca51 tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] 10.222.0.70 "GET /compute/v2.1/servers/397ff5ae-2e76-4f8a-a013-7267ac623560" status: 200 len: 1509 microversion: 2.1 time: 0.408276 Aug 27 03:00:32.293873 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1988/3963] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:00:31 2022] GET /compute/v2.1/servers/397ff5ae-2e76-4f8a-a013-7267ac623560 => generated 1509 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:00:32.887635 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c438a417-ecb5-495a-9f29-ff74af233c79 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:32.888251 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-c438a417-ecb5-495a-9f29-ff74af233c79 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] [instance: 65a92ef8-24d4-4114-980a-2222eab94658] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:32.896611 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c438a417-ecb5-495a-9f29-ff74af233c79 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:32.897190 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c438a417-ecb5-495a-9f29-ff74af233c79 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:32.897530 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c438a417-ecb5-495a-9f29-ff74af233c79 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:32.903007 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c438a417-ecb5-495a-9f29-ff74af233c79 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:32.903489 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c438a417-ecb5-495a-9f29-ff74af233c79 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:32.903924 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c438a417-ecb5-495a-9f29-ff74af233c79 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:33.004653 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-87bd1758-3626-4445-9414-45f7ab342aa3 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:33.005434 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-87bd1758-3626-4445-9414-45f7ab342aa3 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] [instance: 9d9f666f-0b19-4d87-a94a-770b5d99f349] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:33.017684 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-87bd1758-3626-4445-9414-45f7ab342aa3 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:33.026824 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-87bd1758-3626-4445-9414-45f7ab342aa3 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:33.027445 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-87bd1758-3626-4445-9414-45f7ab342aa3 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:33.028106 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-87bd1758-3626-4445-9414-45f7ab342aa3 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:33.028586 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-87bd1758-3626-4445-9414-45f7ab342aa3 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:33.029018 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-87bd1758-3626-4445-9414-45f7ab342aa3 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:33.380996 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-c438a417-ecb5-495a-9f29-ff74af233c79 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113050e1c2d24f8b8b522d84f7cf267b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f10c920e826430c8cbda7e54f288606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:33.405767 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c438a417-ecb5-495a-9f29-ff74af233c79 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] 10.222.0.70 "GET /compute/v2.1/servers/65a92ef8-24d4-4114-980a-2222eab94658" status: 200 len: 1324 microversion: 2.1 time: 0.521430 Aug 27 03:00:33.425441 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1976/3964] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:00:32 2022] GET /compute/v2.1/servers/65a92ef8-24d4-4114-980a-2222eab94658 => generated 1324 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:00:33.435544 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-1f927a62-912b-4817-891f-3ede6a12b93b tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:33.437677 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-1f927a62-912b-4817-891f-3ede6a12b93b tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] [instance: 397ff5ae-2e76-4f8a-a013-7267ac623560] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:33.443664 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:00:33.450815 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1f927a62-912b-4817-891f-3ede6a12b93b tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:33.451313 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1f927a62-912b-4817-891f-3ede6a12b93b tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:33.451750 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1f927a62-912b-4817-891f-3ede6a12b93b tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:33.452501 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1f927a62-912b-4817-891f-3ede6a12b93b tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:33.452956 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1f927a62-912b-4817-891f-3ede6a12b93b tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:33.453377 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1f927a62-912b-4817-891f-3ede6a12b93b tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:33.802924 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-87bd1758-3626-4445-9414-45f7ab342aa3 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe0328160c6472086d13907344756cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41649f09cbf410a9825100c498b4916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:33.820068 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-87bd1758-3626-4445-9414-45f7ab342aa3 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] 10.222.0.70 "GET /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349" status: 200 len: 1721 microversion: 2.1 time: 0.819028 Aug 27 03:00:33.841189 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1989/3965] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:00:32 2022] GET /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349 => generated 1721 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:00:34.016587 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-1f927a62-912b-4817-891f-3ede6a12b93b tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b01cfa9fe344fc69301777595764071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ce2ffcdbe14ccbae3bfae7febc3319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:34.029491 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-1f927a62-912b-4817-891f-3ede6a12b93b tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] 10.222.0.70 "GET /compute/v2.1/servers/397ff5ae-2e76-4f8a-a013-7267ac623560" status: 200 len: 1509 microversion: 2.1 time: 0.601832 Aug 27 03:00:34.031239 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1977/3966] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:00:33 2022] GET /compute/v2.1/servers/397ff5ae-2e76-4f8a-a013-7267ac623560 => generated 1509 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:00:34.234380 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-7ad5a681-44e2-4dc5-82ca-0c51184341ab req-6e802996-d9c0-45c2-b279-72f8c536ecbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "397ff5ae-2e76-4f8a-a013-7267ac623560", "name": "network-vif-deleted", "tag": "29fbfebc-afc9-41f7-9702-825cd1482467"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:00:34.263863 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-7ad5a681-44e2-4dc5-82ca-0c51184341ab req-6e802996-d9c0-45c2-b279-72f8c536ecbe service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:34.264794 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-7ad5a681-44e2-4dc5-82ca-0c51184341ab req-6e802996-d9c0-45c2-b279-72f8c536ecbe service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:34.265443 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-7ad5a681-44e2-4dc5-82ca-0c51184341ab req-6e802996-d9c0-45c2-b279-72f8c536ecbe service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:34.284693 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-7ad5a681-44e2-4dc5-82ca-0c51184341ab req-6e802996-d9c0-45c2-b279-72f8c536ecbe service nova] Creating event network-vif-deleted:29fbfebc-afc9-41f7-9702-825cd1482467 for instance 397ff5ae-2e76-4f8a-a013-7267ac623560 on n-h1-852278-4 Aug 27 03:00:34.292197 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-7ad5a681-44e2-4dc5-82ca-0c51184341ab req-6e802996-d9c0-45c2-b279-72f8c536ecbe service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061614 Aug 27 03:00:34.293472 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1990/3967] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:00:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:00:34.430408 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ed99ac46-f18e-4c71-b5f8-ce6688b3dcab tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:34.431031 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-ed99ac46-f18e-4c71-b5f8-ce6688b3dcab tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] [instance: 65a92ef8-24d4-4114-980a-2222eab94658] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:34.444684 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ed99ac46-f18e-4c71-b5f8-ce6688b3dcab tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:34.445184 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ed99ac46-f18e-4c71-b5f8-ce6688b3dcab tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:34.445627 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ed99ac46-f18e-4c71-b5f8-ce6688b3dcab tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:34.446351 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ed99ac46-f18e-4c71-b5f8-ce6688b3dcab tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:34.446807 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ed99ac46-f18e-4c71-b5f8-ce6688b3dcab tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:34.447447 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ed99ac46-f18e-4c71-b5f8-ce6688b3dcab tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:34.847184 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4065f395-e77b-4ca8-b5e1-922d88c0997d tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:34.848665 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-4065f395-e77b-4ca8-b5e1-922d88c0997d tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] [instance: 9d9f666f-0b19-4d87-a94a-770b5d99f349] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:34.862428 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4065f395-e77b-4ca8-b5e1-922d88c0997d tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:34.865763 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4065f395-e77b-4ca8-b5e1-922d88c0997d tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:34.866546 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4065f395-e77b-4ca8-b5e1-922d88c0997d tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:34.868546 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4065f395-e77b-4ca8-b5e1-922d88c0997d tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:34.872540 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4065f395-e77b-4ca8-b5e1-922d88c0997d tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:34.874007 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4065f395-e77b-4ca8-b5e1-922d88c0997d tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:35.061206 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-ed99ac46-f18e-4c71-b5f8-ce6688b3dcab tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113050e1c2d24f8b8b522d84f7cf267b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f10c920e826430c8cbda7e54f288606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:35.109375 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ed99ac46-f18e-4c71-b5f8-ce6688b3dcab tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] 10.222.0.70 "GET /compute/v2.1/servers/65a92ef8-24d4-4114-980a-2222eab94658" status: 200 len: 1324 microversion: 2.1 time: 0.681223 Aug 27 03:00:35.111214 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1978/3968] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:00:34 2022] GET /compute/v2.1/servers/65a92ef8-24d4-4114-980a-2222eab94658 => generated 1324 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:00:35.121880 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-98cf413e-f725-4f54-a1a8-8947bd9e59ad tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:35.122938 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-98cf413e-f725-4f54-a1a8-8947bd9e59ad tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] [instance: 397ff5ae-2e76-4f8a-a013-7267ac623560] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:35.147287 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-98cf413e-f725-4f54-a1a8-8947bd9e59ad tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:35.165472 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-98cf413e-f725-4f54-a1a8-8947bd9e59ad tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:35.170531 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-98cf413e-f725-4f54-a1a8-8947bd9e59ad tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:35.171376 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-98cf413e-f725-4f54-a1a8-8947bd9e59ad tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:35.174157 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-98cf413e-f725-4f54-a1a8-8947bd9e59ad tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:35.174644 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-98cf413e-f725-4f54-a1a8-8947bd9e59ad tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:35.211509 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-98cf413e-f725-4f54-a1a8-8947bd9e59ad tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] HTTP exception thrown: Instance 397ff5ae-2e76-4f8a-a013-7267ac623560 could not be found. Aug 27 03:00:35.214359 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-98cf413e-f725-4f54-a1a8-8947bd9e59ad tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Request method failure captured: Aug 27 03:00:35.214359 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/servers/397ff5ae-2e76-4f8a-a013-7267ac623560 HTTP/1.1 Aug 27 03:00:35.214359 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 03:00:35.214359 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 03:00:35.214359 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 03:00:35.214359 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 03:00:35.214359 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 03:00:35.214359 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 03:00:35.214359 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 03:00:35.214359 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 03:00:35.214359 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYiyCnWnaCMbOHduqZQyA3UnkGYxX_MTuMO00iFwC0cm4SvOMZrtXFGOyM5b-eD_L4xSUJKcOrgQOeMvbRcZ4qKtCEiclZ8SFfv0-iRLjclERuHnJw89XYmI8aWED5jVrAEEFwvZAyGIQCV2_0GNHT1ABZ7gAB46KxPRmftys-umaws Aug 27 03:00:35.214359 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 03:00:35.214359 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 03:00:35.214359 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 03:00:35.214359 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 03:00:35.214359 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 03:00:35.214359 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 03:00:35.214359 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: b4ce2ffcdbe14ccbae3bfae7febc3319 Aug 27 03:00:35.214359 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ServerPasswordTestJSON-454684231 Aug 27 03:00:35.214359 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 03:00:35.214359 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 03:00:35.214359 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b4ce2ffcdbe14ccbae3bfae7febc3319"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_b4ce2ffcdbe14ccbae3bfae7febc3319", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b4ce2ffcdbe14ccbae3bfae7febc3319"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/b4ce2ffcdbe14ccbae3bfae7febc3319"}]}] Aug 27 03:00:35.214359 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ServerPasswordTestJSON-454684231 Aug 27 03:00:35.214359 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: b4ce2ffcdbe14ccbae3bfae7febc3319 Aug 27 03:00:35.214359 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ServerPasswordTestJSON-454684231 Aug 27 03:00:35.214359 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ServerPasswordTestJSON-454684231-project Aug 27 03:00:35.214359 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 03:00:35.214359 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 03:00:35.214359 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 4b01cfa9fe344fc69301777595764071 Aug 27 03:00:35.214359 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ServerPasswordTestJSON-454684231-project Aug 27 03:00:35.214359 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 03:00:35.214359 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance 397ff5ae-2e76-4f8a-a013-7267ac623560 could not be found. Aug 27 03:00:35.214359 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '397ff5ae-2e76-4f8a-a013-7267ac623560'} Aug 27 03:00:35.214359 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:00:35.214359 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:00:35.214359 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:00:35.214359 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:00:35.214359 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:00:35.214359 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:00:35.214359 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:00:35.214359 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:00:35.214359 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:00:35.214359 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:00:35.214359 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 397ff5ae-2e76-4f8a-a013-7267ac623560 could not be found. Aug 27 03:00:35.214359 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:00:35.214359 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:00:35.214359 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:00:35.214359 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:00:35.214359 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:00:35.214359 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:00:35.214359 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:00:35.214359 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:00:35.214359 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:00:35.214359 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:00:35.214359 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:00:35.214359 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:00:35.214359 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:00:35.214359 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:00:35.214359 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:00:35.214359 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:00:35.214359 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 397ff5ae-2e76-4f8a-a013-7267ac623560 could not be found. Aug 27 03:00:35.214359 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:00:35.214359 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:00:35.214359 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:00:35.220067 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:00:35.220067 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:00:35.220067 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:00:35.220067 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:00:35.220067 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:00:35.220067 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 397ff5ae-2e76-4f8a-a013-7267ac623560 could not be found. Aug 27 03:00:35.220067 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:00:35.223604 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-98cf413e-f725-4f54-a1a8-8947bd9e59ad tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] Returning 404 to user: Instance 397ff5ae-2e76-4f8a-a013-7267ac623560 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:00:35.226386 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-98cf413e-f725-4f54-a1a8-8947bd9e59ad tempest-ServerPasswordTestJSON-454684231 tempest-ServerPasswordTestJSON-454684231-project] 10.222.0.70 "GET /compute/v2.1/servers/397ff5ae-2e76-4f8a-a013-7267ac623560" status: 404 len: 111 microversion: 2.1 time: 0.112770 Aug 27 03:00:35.228632 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1979/3969] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:00:35 2022] GET /compute/v2.1/servers/397ff5ae-2e76-4f8a-a013-7267ac623560 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:00:35.258637 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-4065f395-e77b-4ca8-b5e1-922d88c0997d tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe0328160c6472086d13907344756cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41649f09cbf410a9825100c498b4916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:35.283562 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-4065f395-e77b-4ca8-b5e1-922d88c0997d tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] 10.222.0.70 "GET /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349" status: 200 len: 1721 microversion: 2.1 time: 0.441929 Aug 27 03:00:35.284192 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1991/3970] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:00:34 2022] GET /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349 => generated 1721 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:00:36.133185 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e0a4cda4-91e0-462b-afbf-4dfd8aca45f1 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:36.134151 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-e0a4cda4-91e0-462b-afbf-4dfd8aca45f1 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] [instance: 65a92ef8-24d4-4114-980a-2222eab94658] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:36.149386 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e0a4cda4-91e0-462b-afbf-4dfd8aca45f1 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:36.151643 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e0a4cda4-91e0-462b-afbf-4dfd8aca45f1 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:36.153511 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e0a4cda4-91e0-462b-afbf-4dfd8aca45f1 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:36.155042 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e0a4cda4-91e0-462b-afbf-4dfd8aca45f1 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:36.159217 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e0a4cda4-91e0-462b-afbf-4dfd8aca45f1 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:36.160191 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e0a4cda4-91e0-462b-afbf-4dfd8aca45f1 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:36.308613 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-90910b5a-1c20-4da5-bc6b-7e733e268185 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:36.312406 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-90910b5a-1c20-4da5-bc6b-7e733e268185 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] [instance: 9d9f666f-0b19-4d87-a94a-770b5d99f349] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:36.335836 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-90910b5a-1c20-4da5-bc6b-7e733e268185 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:36.336743 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-90910b5a-1c20-4da5-bc6b-7e733e268185 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:36.337399 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-90910b5a-1c20-4da5-bc6b-7e733e268185 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:36.338373 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-90910b5a-1c20-4da5-bc6b-7e733e268185 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:36.339285 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-90910b5a-1c20-4da5-bc6b-7e733e268185 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:36.340253 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-90910b5a-1c20-4da5-bc6b-7e733e268185 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:36.614893 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-e0a4cda4-91e0-462b-afbf-4dfd8aca45f1 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113050e1c2d24f8b8b522d84f7cf267b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f10c920e826430c8cbda7e54f288606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:36.642468 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e0a4cda4-91e0-462b-afbf-4dfd8aca45f1 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] 10.222.0.70 "GET /compute/v2.1/servers/65a92ef8-24d4-4114-980a-2222eab94658" status: 200 len: 1324 microversion: 2.1 time: 0.515157 Aug 27 03:00:36.660508 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1980/3971] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:00:36 2022] GET /compute/v2.1/servers/65a92ef8-24d4-4114-980a-2222eab94658 => generated 1324 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:00:36.776364 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-90910b5a-1c20-4da5-bc6b-7e733e268185 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe0328160c6472086d13907344756cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41649f09cbf410a9825100c498b4916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:36.793993 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-90910b5a-1c20-4da5-bc6b-7e733e268185 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] 10.222.0.70 "GET /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349" status: 200 len: 1721 microversion: 2.1 time: 0.489926 Aug 27 03:00:36.795515 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1992/3972] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:00:36 2022] GET /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349 => generated 1721 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:00:37.664032 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e871be4a-c6eb-4670-9c5a-24d5c013b382 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:37.664697 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-e871be4a-c6eb-4670-9c5a-24d5c013b382 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] [instance: 65a92ef8-24d4-4114-980a-2222eab94658] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:37.675365 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e871be4a-c6eb-4670-9c5a-24d5c013b382 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:37.676070 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e871be4a-c6eb-4670-9c5a-24d5c013b382 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:37.676674 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e871be4a-c6eb-4670-9c5a-24d5c013b382 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:37.677466 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e871be4a-c6eb-4670-9c5a-24d5c013b382 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:37.678339 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e871be4a-c6eb-4670-9c5a-24d5c013b382 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:37.678795 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e871be4a-c6eb-4670-9c5a-24d5c013b382 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:37.824659 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-871b2a2c-8da0-4e18-9c20-ff8d1baa6a79 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:37.825498 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-871b2a2c-8da0-4e18-9c20-ff8d1baa6a79 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] [instance: 9d9f666f-0b19-4d87-a94a-770b5d99f349] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:37.841326 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-871b2a2c-8da0-4e18-9c20-ff8d1baa6a79 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:37.841897 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-871b2a2c-8da0-4e18-9c20-ff8d1baa6a79 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:37.842592 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-871b2a2c-8da0-4e18-9c20-ff8d1baa6a79 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:37.843367 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-871b2a2c-8da0-4e18-9c20-ff8d1baa6a79 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:37.844031 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-871b2a2c-8da0-4e18-9c20-ff8d1baa6a79 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:37.844522 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-871b2a2c-8da0-4e18-9c20-ff8d1baa6a79 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:38.241534 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-871b2a2c-8da0-4e18-9c20-ff8d1baa6a79 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe0328160c6472086d13907344756cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41649f09cbf410a9825100c498b4916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:38.269624 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-e871be4a-c6eb-4670-9c5a-24d5c013b382 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113050e1c2d24f8b8b522d84f7cf267b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f10c920e826430c8cbda7e54f288606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:38.276553 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-871b2a2c-8da0-4e18-9c20-ff8d1baa6a79 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] 10.222.0.70 "GET /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349" status: 200 len: 1721 microversion: 2.1 time: 0.457944 Aug 27 03:00:38.278904 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1993/3973] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:00:37 2022] GET /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349 => generated 1721 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:00:38.286832 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-766f059f-1d5c-46f2-8d68-d4ef6db71861 req-97af3ea0-8d55-47db-865c-adec06811b4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65a92ef8-24d4-4114-980a-2222eab94658", "name": "network-vif-plugged", "status": "completed", "tag": "a5ffa1b9-364c-453c-ae84-4abb46872f60"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:00:38.294837 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e871be4a-c6eb-4670-9c5a-24d5c013b382 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] 10.222.0.70 "GET /compute/v2.1/servers/65a92ef8-24d4-4114-980a-2222eab94658" status: 200 len: 1324 microversion: 2.1 time: 0.634991 Aug 27 03:00:38.295437 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1981/3974] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:00:37 2022] GET /compute/v2.1/servers/65a92ef8-24d4-4114-980a-2222eab94658 => generated 1324 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:00:38.308803 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-766f059f-1d5c-46f2-8d68-d4ef6db71861 req-97af3ea0-8d55-47db-865c-adec06811b4a service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:38.308803 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-766f059f-1d5c-46f2-8d68-d4ef6db71861 req-97af3ea0-8d55-47db-865c-adec06811b4a service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:38.308803 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-766f059f-1d5c-46f2-8d68-d4ef6db71861 req-97af3ea0-8d55-47db-865c-adec06811b4a service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:38.308803 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:00:38.330302 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-766f059f-1d5c-46f2-8d68-d4ef6db71861 req-97af3ea0-8d55-47db-865c-adec06811b4a service nova] Creating event network-vif-plugged:a5ffa1b9-364c-453c-ae84-4abb46872f60 for instance 65a92ef8-24d4-4114-980a-2222eab94658 on n-h2-852278-4 Aug 27 03:00:38.336225 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-766f059f-1d5c-46f2-8d68-d4ef6db71861 req-97af3ea0-8d55-47db-865c-adec06811b4a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054393 Aug 27 03:00:38.343155 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1994/3975] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:00:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:00:39.299598 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-325fc829-4740-49cd-adf4-462fa7558b4b tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:39.308693 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-325fc829-4740-49cd-adf4-462fa7558b4b tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] [instance: 9d9f666f-0b19-4d87-a94a-770b5d99f349] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:39.320814 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-325fc829-4740-49cd-adf4-462fa7558b4b tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:39.321649 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-325fc829-4740-49cd-adf4-462fa7558b4b tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:39.322655 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7b6bc9da-f49e-49cb-89f9-a13201e6077e tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:39.323304 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-7b6bc9da-f49e-49cb-89f9-a13201e6077e tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] [instance: 65a92ef8-24d4-4114-980a-2222eab94658] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:39.323501 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-325fc829-4740-49cd-adf4-462fa7558b4b tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:39.324477 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-325fc829-4740-49cd-adf4-462fa7558b4b tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:39.325868 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-325fc829-4740-49cd-adf4-462fa7558b4b tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:39.326758 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-325fc829-4740-49cd-adf4-462fa7558b4b tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:39.335243 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7b6bc9da-f49e-49cb-89f9-a13201e6077e tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:39.335931 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7b6bc9da-f49e-49cb-89f9-a13201e6077e tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:39.336588 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7b6bc9da-f49e-49cb-89f9-a13201e6077e tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:39.337471 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7b6bc9da-f49e-49cb-89f9-a13201e6077e tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:39.338082 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7b6bc9da-f49e-49cb-89f9-a13201e6077e tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:39.338666 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7b6bc9da-f49e-49cb-89f9-a13201e6077e tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:39.805112 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-325fc829-4740-49cd-adf4-462fa7558b4b tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe0328160c6472086d13907344756cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41649f09cbf410a9825100c498b4916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:39.817539 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-325fc829-4740-49cd-adf4-462fa7558b4b tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] 10.222.0.70 "GET /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349" status: 200 len: 1721 microversion: 2.1 time: 0.521896 Aug 27 03:00:39.835311 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1982/3976] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:00:39 2022] GET /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349 => generated 1721 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:00:39.857028 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-7b6bc9da-f49e-49cb-89f9-a13201e6077e tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113050e1c2d24f8b8b522d84f7cf267b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f10c920e826430c8cbda7e54f288606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:39.876017 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-7b6bc9da-f49e-49cb-89f9-a13201e6077e tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] 10.222.0.70 "GET /compute/v2.1/servers/65a92ef8-24d4-4114-980a-2222eab94658" status: 200 len: 1324 microversion: 2.1 time: 0.558366 Aug 27 03:00:39.879273 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1995/3977] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:00:39 2022] GET /compute/v2.1/servers/65a92ef8-24d4-4114-980a-2222eab94658 => generated 1324 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:00:40.844793 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6657da62-4dda-43b7-b199-dc70b1856465 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:40.845998 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-6657da62-4dda-43b7-b199-dc70b1856465 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] [instance: 9d9f666f-0b19-4d87-a94a-770b5d99f349] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:40.872250 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6657da62-4dda-43b7-b199-dc70b1856465 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:40.873050 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6657da62-4dda-43b7-b199-dc70b1856465 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:40.873646 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6657da62-4dda-43b7-b199-dc70b1856465 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:40.874576 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6657da62-4dda-43b7-b199-dc70b1856465 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:40.875387 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6657da62-4dda-43b7-b199-dc70b1856465 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:40.876215 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6657da62-4dda-43b7-b199-dc70b1856465 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:40.899162 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-36130122-d991-4071-a686-e581b51234f7 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:40.900509 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-36130122-d991-4071-a686-e581b51234f7 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] [instance: 65a92ef8-24d4-4114-980a-2222eab94658] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:40.915306 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-36130122-d991-4071-a686-e581b51234f7 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:40.924097 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-36130122-d991-4071-a686-e581b51234f7 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:40.927489 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-36130122-d991-4071-a686-e581b51234f7 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:40.930055 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-36130122-d991-4071-a686-e581b51234f7 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:40.931428 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-36130122-d991-4071-a686-e581b51234f7 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:40.932682 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-36130122-d991-4071-a686-e581b51234f7 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:41.349059 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-6657da62-4dda-43b7-b199-dc70b1856465 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe0328160c6472086d13907344756cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41649f09cbf410a9825100c498b4916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:41.358144 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-6657da62-4dda-43b7-b199-dc70b1856465 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] 10.222.0.70 "GET /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349" status: 200 len: 1721 microversion: 2.1 time: 0.517979 Aug 27 03:00:41.371365 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1983/3978] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:00:40 2022] GET /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349 => generated 1721 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:00:41.441510 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-36130122-d991-4071-a686-e581b51234f7 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113050e1c2d24f8b8b522d84f7cf267b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f10c920e826430c8cbda7e54f288606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:41.450984 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-36130122-d991-4071-a686-e581b51234f7 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] 10.222.0.70 "GET /compute/v2.1/servers/65a92ef8-24d4-4114-980a-2222eab94658" status: 200 len: 1519 microversion: 2.1 time: 0.556689 Aug 27 03:00:41.451671 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1996/3979] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:00:40 2022] GET /compute/v2.1/servers/65a92ef8-24d4-4114-980a-2222eab94658 => generated 1519 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:00:41.670600 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-31bd8c1e-5be7-4b68-b6f5-27bce23733fc tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-691926429", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "801132e4-ddd2-46d3-8f97-b5cdf536ca14"}]}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:00:41.700187 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-31bd8c1e-5be7-4b68-b6f5-27bce23733fc tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Request method failure captured: Aug 27 03:00:41.700187 n-d-852278-4 devstack@n-api.service[134052]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 03:00:41.700187 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 03:00:41.700187 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 03:00:41.700187 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 03:00:41.700187 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 242 Aug 27 03:00:41.700187 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 03:00:41.700187 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 03:00:41.700187 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 03:00:41.700187 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 03:00:41.700187 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYjAk-c9MD-ltya_JOFX2O99dXeSPIZiTsK6NyhQ0-m3iJPoAMeHGtdzbSay0pmIgpwYfw9eSEp5RA7QFodChbW5vestX3_jRmVVhIwXWaSw4OeUTIhXPdDQzS8eL6Q8uP4-2vYonkosaN1yzVd_7-AOimwNSBjDDg-nwO49IMCOCkY Aug 27 03:00:41.700187 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 03:00:41.700187 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 03:00:41.700187 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 03:00:41.700187 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 03:00:41.700187 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 03:00:41.700187 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 03:00:41.700187 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 2f10c920e826430c8cbda7e54f288606 Aug 27 03:00:41.700187 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1633991642 Aug 27 03:00:41.700187 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 03:00:41.700187 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 03:00:41.700187 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2f10c920e826430c8cbda7e54f288606"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_2f10c920e826430c8cbda7e54f288606", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2f10c920e826430c8cbda7e54f288606"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/2f10c920e826430c8cbda7e54f288606"}]}] Aug 27 03:00:41.700187 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1633991642 Aug 27 03:00:41.700187 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 2f10c920e826430c8cbda7e54f288606 Aug 27 03:00:41.700187 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1633991642 Aug 27 03:00:41.700187 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ServerMetadataNegativeTestJSON-1633991642-project Aug 27 03:00:41.700187 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 03:00:41.700187 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 03:00:41.700187 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 113050e1c2d24f8b8b522d84f7cf267b Aug 27 03:00:41.700187 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1633991642-project Aug 27 03:00:41.700187 n-d-852278-4 devstack@n-api.service[134052]: Aug 27 03:00:41.700187 n-d-852278-4 devstack@n-api.service[134052]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-691926429", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "801132e4-ddd2-46d3-8f97-b5cdf536ca14"}]}} Aug 27 03:00:41.700187 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 03:00:41.700187 n-d-852278-4 devstack@n-api.service[134052]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 03:00:41.700187 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-691926429', 'imageRef': '1552acd0-176a-4c81-b680-29d74105e9d6', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '801132e4-ddd2-46d3-8f97-b5cdf536ca14'}]}}} Aug 27 03:00:41.700187 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:00:41.700187 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:00:41.700187 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 03:00:41.700187 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 03:00:41.700187 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 03:00:41.700187 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise error Aug 27 03:00:41.700187 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 03:00:41.700187 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:00:41.700187 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 27 03:00:41.700187 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 27 03:00:41.700187 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 27 03:00:41.700187 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 27 03:00:41.700187 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 27 03:00:41.700187 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:00:41.700187 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 27 03:00:41.700187 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi {'': 'data1'} Aug 27 03:00:41.700187 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:00:41.700187 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:00:41.700187 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:00:41.700187 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:00:41.700187 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:00:41.700187 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:00:41.700187 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:00:41.700187 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:00:41.700187 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:00:41.700187 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:00:41.700187 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:00:41.704789 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:00:41.704789 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 03:00:41.704789 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 03:00:41.704789 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 03:00:41.704789 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 03:00:41.704789 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 03:00:41.704789 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 03:00:41.704789 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 03:00:41.704789 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:00:41.704789 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:00:41.704789 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:00:41.704789 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:00:41.704789 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:00:41.704789 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:00:41.704789 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 03:00:41.704789 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 03:00:41.704789 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 03:00:41.704789 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:00:41.712731 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-31bd8c1e-5be7-4b68-b6f5-27bce23733fc tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:00:41.717131 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-31bd8c1e-5be7-4b68-b6f5-27bce23733fc tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.053804 Aug 27 03:00:41.720486 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1984/3980] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 03:00:41 2022] POST /compute/v2.1/servers => generated 175 bytes in 58 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:00:41.733377 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-dfa40850-8e18-4570-a7f3-8c84bc5a3a7e tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:41.734145 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-dfa40850-8e18-4570-a7f3-8c84bc5a3a7e tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] [instance: 5dd744e6-b553-4abc-82fd-1533daec6ebe] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:41.745613 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-dfa40850-8e18-4570-a7f3-8c84bc5a3a7e tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] HTTP exception thrown: Instance 5dd744e6-b553-4abc-82fd-1533daec6ebe could not be found. Aug 27 03:00:41.750901 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-dfa40850-8e18-4570-a7f3-8c84bc5a3a7e tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Request method failure captured: Aug 27 03:00:41.750901 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/5dd744e6-b553-4abc-82fd-1533daec6ebe/metadata HTTP/1.1 Aug 27 03:00:41.750901 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 03:00:41.750901 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 03:00:41.750901 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 03:00:41.750901 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 03:00:41.750901 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 03:00:41.750901 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 03:00:41.750901 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 03:00:41.750901 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 03:00:41.750901 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYjAk-c9MD-ltya_JOFX2O99dXeSPIZiTsK6NyhQ0-m3iJPoAMeHGtdzbSay0pmIgpwYfw9eSEp5RA7QFodChbW5vestX3_jRmVVhIwXWaSw4OeUTIhXPdDQzS8eL6Q8uP4-2vYonkosaN1yzVd_7-AOimwNSBjDDg-nwO49IMCOCkY Aug 27 03:00:41.750901 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 03:00:41.750901 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 03:00:41.750901 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 03:00:41.750901 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 03:00:41.750901 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 03:00:41.750901 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 03:00:41.750901 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 2f10c920e826430c8cbda7e54f288606 Aug 27 03:00:41.750901 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1633991642 Aug 27 03:00:41.750901 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 03:00:41.750901 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 03:00:41.750901 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2f10c920e826430c8cbda7e54f288606"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_2f10c920e826430c8cbda7e54f288606", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2f10c920e826430c8cbda7e54f288606"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/2f10c920e826430c8cbda7e54f288606"}]}] Aug 27 03:00:41.750901 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1633991642 Aug 27 03:00:41.750901 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 2f10c920e826430c8cbda7e54f288606 Aug 27 03:00:41.750901 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1633991642 Aug 27 03:00:41.750901 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ServerMetadataNegativeTestJSON-1633991642-project Aug 27 03:00:41.750901 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 03:00:41.750901 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 03:00:41.750901 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 113050e1c2d24f8b8b522d84f7cf267b Aug 27 03:00:41.750901 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1633991642-project Aug 27 03:00:41.750901 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 03:00:41.750901 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance 5dd744e6-b553-4abc-82fd-1533daec6ebe could not be found. Aug 27 03:00:41.750901 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'server_id': '5dd744e6-b553-4abc-82fd-1533daec6ebe'} Aug 27 03:00:41.750901 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:00:41.750901 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:00:41.750901 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:00:41.750901 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:00:41.750901 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:00:41.750901 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:00:41.750901 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 03:00:41.750901 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 03:00:41.750901 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5dd744e6-b553-4abc-82fd-1533daec6ebe could not be found. Aug 27 03:00:41.750901 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:00:41.750901 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:00:41.750901 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:00:41.750901 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:00:41.750901 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:00:41.750901 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:00:41.750901 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:00:41.750901 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:00:41.750901 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:00:41.750901 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:00:41.750901 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Aug 27 03:00:41.750901 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Aug 27 03:00:41.750901 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:00:41.750901 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:00:41.750901 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5dd744e6-b553-4abc-82fd-1533daec6ebe could not be found. Aug 27 03:00:41.750901 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:00:41.750901 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:00:41.750901 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:00:41.750901 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:00:41.750901 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:00:41.750901 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:00:41.755642 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:00:41.755642 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:00:41.755642 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5dd744e6-b553-4abc-82fd-1533daec6ebe could not be found. Aug 27 03:00:41.755642 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:00:41.756379 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-dfa40850-8e18-4570-a7f3-8c84bc5a3a7e tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Returning 404 to user: Instance 5dd744e6-b553-4abc-82fd-1533daec6ebe could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:00:41.760411 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-dfa40850-8e18-4570-a7f3-8c84bc5a3a7e tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] 10.222.0.70 "GET /compute/v2.1/servers/5dd744e6-b553-4abc-82fd-1533daec6ebe/metadata" status: 404 len: 111 microversion: 2.1 time: 0.030674 Aug 27 03:00:41.763399 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1997/3981] 10.222.0.70 () {58 vars in 1263 bytes} [Sat Aug 27 03:00:41 2022] GET /compute/v2.1/servers/5dd744e6-b553-4abc-82fd-1533daec6ebe/metadata => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:00:41.835972 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-63aac9e1-9940-448c-9f42-76671d671f79 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2031723650", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "801132e4-ddd2-46d3-8f97-b5cdf536ca14"}]}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:00:41.842942 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-63aac9e1-9940-448c-9f42-76671d671f79 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Request method failure captured: Aug 27 03:00:41.842942 n-d-852278-4 devstack@n-api.service[134052]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 03:00:41.842942 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 03:00:41.842942 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 03:00:41.842942 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 03:00:41.842942 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 499 Aug 27 03:00:41.842942 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 03:00:41.842942 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 03:00:41.842942 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 03:00:41.842942 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 03:00:41.842942 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYjAk-c9MD-ltya_JOFX2O99dXeSPIZiTsK6NyhQ0-m3iJPoAMeHGtdzbSay0pmIgpwYfw9eSEp5RA7QFodChbW5vestX3_jRmVVhIwXWaSw4OeUTIhXPdDQzS8eL6Q8uP4-2vYonkosaN1yzVd_7-AOimwNSBjDDg-nwO49IMCOCkY Aug 27 03:00:41.842942 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 03:00:41.842942 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 03:00:41.842942 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 03:00:41.842942 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 03:00:41.842942 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 03:00:41.842942 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 03:00:41.842942 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 2f10c920e826430c8cbda7e54f288606 Aug 27 03:00:41.842942 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1633991642 Aug 27 03:00:41.842942 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 03:00:41.842942 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 03:00:41.842942 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2f10c920e826430c8cbda7e54f288606"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_2f10c920e826430c8cbda7e54f288606", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2f10c920e826430c8cbda7e54f288606"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/2f10c920e826430c8cbda7e54f288606"}]}] Aug 27 03:00:41.842942 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1633991642 Aug 27 03:00:41.842942 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 2f10c920e826430c8cbda7e54f288606 Aug 27 03:00:41.842942 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1633991642 Aug 27 03:00:41.842942 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ServerMetadataNegativeTestJSON-1633991642-project Aug 27 03:00:41.842942 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 03:00:41.842942 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 03:00:41.842942 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 113050e1c2d24f8b8b522d84f7cf267b Aug 27 03:00:41.842942 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1633991642-project Aug 27 03:00:41.842942 n-d-852278-4 devstack@n-api.service[134052]: Aug 27 03:00:41.842942 n-d-852278-4 devstack@n-api.service[134052]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2031723650", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "801132e4-ddd2-46d3-8f97-b5cdf536ca14"}]}} Aug 27 03:00:41.842942 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 03:00:41.842942 n-d-852278-4 devstack@n-api.service[134052]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 03:00:41.842942 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-2031723650', 'imageRef': '1552acd0-176a-4c81-b680-29d74105e9d6', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '801132e4-ddd2-46d3-8f97-b5cdf536ca14'}]}}} Aug 27 03:00:41.842942 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:00:41.842942 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:00:41.842942 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 03:00:41.842942 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 03:00:41.842942 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 03:00:41.842942 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise error Aug 27 03:00:41.842942 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 03:00:41.842942 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:00:41.842942 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 27 03:00:41.842942 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 27 03:00:41.842942 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 27 03:00:41.842942 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 27 03:00:41.846322 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 27 03:00:41.846322 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:00:41.846322 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 27 03:00:41.846322 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 27 03:00:41.846322 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:00:41.846322 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:00:41.846322 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:00:41.846322 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:00:41.846322 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:00:41.846322 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:00:41.846322 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:00:41.846322 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:00:41.846322 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:00:41.846322 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:00:41.846322 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:00:41.846322 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:00:41.846322 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 03:00:41.846322 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 03:00:41.846322 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 03:00:41.846322 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 03:00:41.846322 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 03:00:41.846322 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 03:00:41.846322 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 03:00:41.846322 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:00:41.846322 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:00:41.846322 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:00:41.846322 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:00:41.846322 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:00:41.846322 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:00:41.846322 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 03:00:41.846322 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 03:00:41.846322 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 03:00:41.846322 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:00:41.863327 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-63aac9e1-9940-448c-9f42-76671d671f79 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:00:41.863327 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-63aac9e1-9940-448c-9f42-76671d671f79 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.022364 Aug 27 03:00:41.863327 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1985/3982] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 03:00:41 2022] POST /compute/v2.1/servers => generated 687 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:00:41.954295 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8f0b38c4-33cd-4d31-a7c0-a293475fe3b6 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1472997317", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "801132e4-ddd2-46d3-8f97-b5cdf536ca14"}]}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:00:41.961133 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8f0b38c4-33cd-4d31-a7c0-a293475fe3b6 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Request method failure captured: Aug 27 03:00:41.961133 n-d-852278-4 devstack@n-api.service[134051]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 03:00:41.961133 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 03:00:41.961133 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 03:00:41.961133 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 03:00:41.961133 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 500 Aug 27 03:00:41.961133 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 03:00:41.961133 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 03:00:41.961133 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 03:00:41.961133 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 03:00:41.961133 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYjAk-c9MD-ltya_JOFX2O99dXeSPIZiTsK6NyhQ0-m3iJPoAMeHGtdzbSay0pmIgpwYfw9eSEp5RA7QFodChbW5vestX3_jRmVVhIwXWaSw4OeUTIhXPdDQzS8eL6Q8uP4-2vYonkosaN1yzVd_7-AOimwNSBjDDg-nwO49IMCOCkY Aug 27 03:00:41.961133 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 03:00:41.961133 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 03:00:41.961133 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 03:00:41.961133 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 03:00:41.961133 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 03:00:41.961133 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 03:00:41.961133 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 2f10c920e826430c8cbda7e54f288606 Aug 27 03:00:41.961133 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1633991642 Aug 27 03:00:41.961133 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 03:00:41.961133 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 03:00:41.961133 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2f10c920e826430c8cbda7e54f288606"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_2f10c920e826430c8cbda7e54f288606", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2f10c920e826430c8cbda7e54f288606"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/2f10c920e826430c8cbda7e54f288606"}]}] Aug 27 03:00:41.961133 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1633991642 Aug 27 03:00:41.961133 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 2f10c920e826430c8cbda7e54f288606 Aug 27 03:00:41.961133 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1633991642 Aug 27 03:00:41.961133 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ServerMetadataNegativeTestJSON-1633991642-project Aug 27 03:00:41.961133 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 03:00:41.961133 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 03:00:41.961133 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 113050e1c2d24f8b8b522d84f7cf267b Aug 27 03:00:41.961133 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1633991642-project Aug 27 03:00:41.961133 n-d-852278-4 devstack@n-api.service[134051]: Aug 27 03:00:41.961133 n-d-852278-4 devstack@n-api.service[134051]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1472997317", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "801132e4-ddd2-46d3-8f97-b5cdf536ca14"}]}} Aug 27 03:00:41.961133 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 03:00:41.961133 n-d-852278-4 devstack@n-api.service[134051]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 03:00:41.961133 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1472997317', 'imageRef': '1552acd0-176a-4c81-b680-29d74105e9d6', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '801132e4-ddd2-46d3-8f97-b5cdf536ca14'}]}}} Aug 27 03:00:41.961133 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:00:41.961133 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:00:41.961133 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 03:00:41.961133 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 03:00:41.961133 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 03:00:41.961133 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise error Aug 27 03:00:41.961133 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 03:00:41.961133 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:00:41.961133 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 27 03:00:41.961133 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 27 03:00:41.961133 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 27 03:00:41.961133 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 27 03:00:41.975063 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 27 03:00:41.975063 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:00:41.975063 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 27 03:00:41.975063 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 27 03:00:41.975063 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:00:41.975063 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:00:41.975063 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:00:41.975063 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:00:41.975063 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:00:41.975063 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:00:41.975063 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:00:41.975063 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:00:41.975063 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:00:41.975063 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:00:41.975063 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:00:41.975063 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:00:41.975063 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 03:00:41.975063 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 03:00:41.975063 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 03:00:41.975063 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 03:00:41.975063 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 03:00:41.975063 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 03:00:41.975063 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 03:00:41.975063 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:00:41.975063 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:00:41.975063 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:00:41.975063 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:00:41.975063 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:00:41.975063 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:00:41.975063 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 03:00:41.975063 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 03:00:41.975063 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 03:00:41.975063 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:00:41.975063 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8f0b38c4-33cd-4d31-a7c0-a293475fe3b6 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:00:41.975063 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-8f0b38c4-33cd-4d31-a7c0-a293475fe3b6 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.012955 Aug 27 03:00:41.975063 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1998/3983] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 03:00:41 2022] POST /compute/v2.1/servers => generated 689 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:00:42.044262 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-cc3dfb12-f20e-4338-84e8-75198ec3b83f tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-48610946", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "801132e4-ddd2-46d3-8f97-b5cdf536ca14"}]}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:00:42.049074 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-cc3dfb12-f20e-4338-84e8-75198ec3b83f tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Request method failure captured: Aug 27 03:00:42.049074 n-d-852278-4 devstack@n-api.service[134052]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 03:00:42.049074 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 03:00:42.049074 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 03:00:42.049074 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 03:00:42.049074 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 752 Aug 27 03:00:42.049074 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 03:00:42.049074 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 03:00:42.049074 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 03:00:42.049074 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 03:00:42.049074 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYjAk-c9MD-ltya_JOFX2O99dXeSPIZiTsK6NyhQ0-m3iJPoAMeHGtdzbSay0pmIgpwYfw9eSEp5RA7QFodChbW5vestX3_jRmVVhIwXWaSw4OeUTIhXPdDQzS8eL6Q8uP4-2vYonkosaN1yzVd_7-AOimwNSBjDDg-nwO49IMCOCkY Aug 27 03:00:42.049074 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 03:00:42.049074 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 03:00:42.049074 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 03:00:42.049074 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 03:00:42.049074 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 03:00:42.049074 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 03:00:42.049074 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 2f10c920e826430c8cbda7e54f288606 Aug 27 03:00:42.049074 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1633991642 Aug 27 03:00:42.049074 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 03:00:42.049074 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 03:00:42.049074 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2f10c920e826430c8cbda7e54f288606"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_2f10c920e826430c8cbda7e54f288606", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2f10c920e826430c8cbda7e54f288606"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/2f10c920e826430c8cbda7e54f288606"}]}] Aug 27 03:00:42.049074 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1633991642 Aug 27 03:00:42.049074 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 2f10c920e826430c8cbda7e54f288606 Aug 27 03:00:42.049074 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1633991642 Aug 27 03:00:42.049074 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ServerMetadataNegativeTestJSON-1633991642-project Aug 27 03:00:42.049074 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 03:00:42.049074 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 03:00:42.049074 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 113050e1c2d24f8b8b522d84f7cf267b Aug 27 03:00:42.049074 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1633991642-project Aug 27 03:00:42.049074 n-d-852278-4 devstack@n-api.service[134052]: Aug 27 03:00:42.049074 n-d-852278-4 devstack@n-api.service[134052]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-48610946", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "801132e4-ddd2-46d3-8f97-b5cdf536ca14"}]}} Aug 27 03:00:42.049074 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 03:00:42.049074 n-d-852278-4 devstack@n-api.service[134052]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 03:00:42.049074 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-48610946', 'imageRef': '1552acd0-176a-4c81-b680-29d74105e9d6', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '801132e4-ddd2-46d3-8f97-b5cdf536ca14'}]}}} Aug 27 03:00:42.049074 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:00:42.049074 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:00:42.049074 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 03:00:42.049074 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 03:00:42.049074 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 03:00:42.051708 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise error Aug 27 03:00:42.051708 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 03:00:42.051708 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:00:42.051708 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 27 03:00:42.051708 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 27 03:00:42.051708 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 27 03:00:42.051708 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 27 03:00:42.051708 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 27 03:00:42.051708 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:00:42.051708 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 27 03:00:42.051708 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 27 03:00:42.051708 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:00:42.051708 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:00:42.051708 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:00:42.051708 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:00:42.051708 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:00:42.051708 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:00:42.051708 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:00:42.051708 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:00:42.051708 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:00:42.051708 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:00:42.051708 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:00:42.051708 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:00:42.051708 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 03:00:42.051708 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 03:00:42.051708 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 03:00:42.051708 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 03:00:42.051708 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 03:00:42.051708 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 03:00:42.051708 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 03:00:42.051708 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:00:42.051708 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:00:42.051708 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:00:42.051708 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:00:42.051708 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:00:42.051708 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:00:42.051708 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 03:00:42.051708 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 03:00:42.054361 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 03:00:42.054361 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:00:42.056651 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-cc3dfb12-f20e-4338-84e8-75198ec3b83f tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:00:42.057756 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-cc3dfb12-f20e-4338-84e8-75198ec3b83f tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.019971 Aug 27 03:00:42.067387 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1986/3984] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 03:00:42 2022] POST /compute/v2.1/servers => generated 1197 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Aug 27 03:00:42.163008 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-70bd1455-0ab1-42e1-9dae-73bdb3b33738 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1033342427", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "801132e4-ddd2-46d3-8f97-b5cdf536ca14"}]}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:00:42.175088 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-70bd1455-0ab1-42e1-9dae-73bdb3b33738 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Request method failure captured: Aug 27 03:00:42.175088 n-d-852278-4 devstack@n-api.service[134051]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 03:00:42.175088 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 03:00:42.175088 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 03:00:42.175088 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 03:00:42.175088 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 1266 Aug 27 03:00:42.175088 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 03:00:42.175088 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 03:00:42.175088 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 03:00:42.175088 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 03:00:42.175088 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYjAk-c9MD-ltya_JOFX2O99dXeSPIZiTsK6NyhQ0-m3iJPoAMeHGtdzbSay0pmIgpwYfw9eSEp5RA7QFodChbW5vestX3_jRmVVhIwXWaSw4OeUTIhXPdDQzS8eL6Q8uP4-2vYonkosaN1yzVd_7-AOimwNSBjDDg-nwO49IMCOCkY Aug 27 03:00:42.175088 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 03:00:42.175088 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 03:00:42.175088 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 03:00:42.175088 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 03:00:42.175088 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 03:00:42.175088 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 03:00:42.175088 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 2f10c920e826430c8cbda7e54f288606 Aug 27 03:00:42.175088 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1633991642 Aug 27 03:00:42.175088 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 03:00:42.175088 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 03:00:42.175088 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2f10c920e826430c8cbda7e54f288606"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_2f10c920e826430c8cbda7e54f288606", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2f10c920e826430c8cbda7e54f288606"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/2f10c920e826430c8cbda7e54f288606"}]}] Aug 27 03:00:42.175088 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1633991642 Aug 27 03:00:42.175088 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 2f10c920e826430c8cbda7e54f288606 Aug 27 03:00:42.175088 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1633991642 Aug 27 03:00:42.175088 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ServerMetadataNegativeTestJSON-1633991642-project Aug 27 03:00:42.175088 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 03:00:42.175088 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 03:00:42.175088 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 113050e1c2d24f8b8b522d84f7cf267b Aug 27 03:00:42.175088 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1633991642-project Aug 27 03:00:42.175088 n-d-852278-4 devstack@n-api.service[134051]: Aug 27 03:00:42.175088 n-d-852278-4 devstack@n-api.service[134051]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1033342427", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "801132e4-ddd2-46d3-8f97-b5cdf536ca14"}]}} Aug 27 03:00:42.175088 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 03:00:42.179580 n-d-852278-4 devstack@n-api.service[134051]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 03:00:42.179580 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1033342427', 'imageRef': '1552acd0-176a-4c81-b680-29d74105e9d6', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '801132e4-ddd2-46d3-8f97-b5cdf536ca14'}]}}} Aug 27 03:00:42.179580 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:00:42.179580 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:00:42.179580 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 03:00:42.179580 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 03:00:42.179580 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 03:00:42.179580 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise error Aug 27 03:00:42.179580 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 03:00:42.179580 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:00:42.179580 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 27 03:00:42.179580 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 27 03:00:42.179580 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 27 03:00:42.179580 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 27 03:00:42.179580 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 27 03:00:42.179580 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:00:42.179580 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 27 03:00:42.181222 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 27 03:00:42.181222 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:00:42.181222 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:00:42.181222 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:00:42.181222 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:00:42.181222 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:00:42.181222 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:00:42.181222 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:00:42.181222 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:00:42.181222 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:00:42.181222 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:00:42.181222 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:00:42.181222 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:00:42.181222 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 03:00:42.181222 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 03:00:42.181222 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 03:00:42.181222 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 03:00:42.181222 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 03:00:42.181222 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 03:00:42.181222 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 03:00:42.181222 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:00:42.181222 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:00:42.181222 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:00:42.181222 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:00:42.181222 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:00:42.181222 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:00:42.181222 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 03:00:42.181222 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 03:00:42.184664 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 03:00:42.184664 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:00:42.186290 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-70bd1455-0ab1-42e1-9dae-73bdb3b33738 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:00:42.194469 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-70bd1455-0ab1-42e1-9dae-73bdb3b33738 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.040746 Aug 27 03:00:42.197581 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 1999/3985] 10.222.0.70 () {60 vars in 1148 bytes} [Sat Aug 27 03:00:42 2022] POST /compute/v2.1/servers => generated 2221 bytes in 50 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Aug 27 03:00:42.215256 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-252e5569-c424-464f-956e-d960c34f3a82 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:42.215256 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-252e5569-c424-464f-956e-d960c34f3a82 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] [instance: 9d3574d8-8d61-4f8d-89f6-86d0db9a7522] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:42.232508 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-252e5569-c424-464f-956e-d960c34f3a82 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] HTTP exception thrown: Instance 9d3574d8-8d61-4f8d-89f6-86d0db9a7522 could not be found. Aug 27 03:00:42.234382 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-252e5569-c424-464f-956e-d960c34f3a82 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Request method failure captured: Aug 27 03:00:42.234382 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/servers/9d3574d8-8d61-4f8d-89f6-86d0db9a7522/metadata/test2 HTTP/1.1 Aug 27 03:00:42.234382 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 03:00:42.234382 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 03:00:42.234382 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 03:00:42.234382 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 03:00:42.234382 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 03:00:42.234382 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 03:00:42.234382 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 03:00:42.234382 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 03:00:42.234382 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYjAk-c9MD-ltya_JOFX2O99dXeSPIZiTsK6NyhQ0-m3iJPoAMeHGtdzbSay0pmIgpwYfw9eSEp5RA7QFodChbW5vestX3_jRmVVhIwXWaSw4OeUTIhXPdDQzS8eL6Q8uP4-2vYonkosaN1yzVd_7-AOimwNSBjDDg-nwO49IMCOCkY Aug 27 03:00:42.234382 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 03:00:42.234382 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 03:00:42.234382 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 03:00:42.234382 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 03:00:42.234382 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 03:00:42.234382 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 03:00:42.234382 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 2f10c920e826430c8cbda7e54f288606 Aug 27 03:00:42.234382 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1633991642 Aug 27 03:00:42.234382 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 03:00:42.234382 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 03:00:42.234382 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2f10c920e826430c8cbda7e54f288606"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_2f10c920e826430c8cbda7e54f288606", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2f10c920e826430c8cbda7e54f288606"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/2f10c920e826430c8cbda7e54f288606"}]}] Aug 27 03:00:42.234382 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1633991642 Aug 27 03:00:42.234382 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 2f10c920e826430c8cbda7e54f288606 Aug 27 03:00:42.234382 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1633991642 Aug 27 03:00:42.234382 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ServerMetadataNegativeTestJSON-1633991642-project Aug 27 03:00:42.234382 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 03:00:42.234382 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 03:00:42.234382 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 113050e1c2d24f8b8b522d84f7cf267b Aug 27 03:00:42.234382 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1633991642-project Aug 27 03:00:42.234382 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 03:00:42.234382 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance 9d3574d8-8d61-4f8d-89f6-86d0db9a7522 could not be found. Aug 27 03:00:42.234382 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'server_id': '9d3574d8-8d61-4f8d-89f6-86d0db9a7522', 'id': 'test2'} Aug 27 03:00:42.234382 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:00:42.234382 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:00:42.234382 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:00:42.234382 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:00:42.234382 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:00:42.234382 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:00:42.234382 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 03:00:42.234382 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 03:00:42.234382 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d3574d8-8d61-4f8d-89f6-86d0db9a7522 could not be found. Aug 27 03:00:42.234382 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:00:42.234382 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:00:42.234382 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:00:42.234382 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:00:42.234382 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:00:42.234382 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:00:42.234382 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:00:42.234382 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:00:42.234382 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:00:42.234382 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:00:42.234382 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Aug 27 03:00:42.234382 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Aug 27 03:00:42.234382 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:00:42.234382 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:00:42.234382 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d3574d8-8d61-4f8d-89f6-86d0db9a7522 could not be found. Aug 27 03:00:42.234382 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:00:42.234382 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:00:42.234382 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:00:42.234382 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:00:42.234382 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:00:42.234382 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:00:42.239836 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:00:42.239836 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:00:42.239836 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d3574d8-8d61-4f8d-89f6-86d0db9a7522 could not be found. Aug 27 03:00:42.239836 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:00:42.239836 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-252e5569-c424-464f-956e-d960c34f3a82 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Returning 404 to user: Instance 9d3574d8-8d61-4f8d-89f6-86d0db9a7522 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:00:42.239836 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-252e5569-c424-464f-956e-d960c34f3a82 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] 10.222.0.70 "GET /compute/v2.1/servers/9d3574d8-8d61-4f8d-89f6-86d0db9a7522/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.031143 Aug 27 03:00:42.239836 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1987/3986] 10.222.0.70 () {58 vars in 1281 bytes} [Sat Aug 27 03:00:42 2022] GET /compute/v2.1/servers/9d3574d8-8d61-4f8d-89f6-86d0db9a7522/metadata/test2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:00:42.284034 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f04e35cf-9b3e-4f74-85ae-c5abdf91ab7a tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:42.284585 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-f04e35cf-9b3e-4f74-85ae-c5abdf91ab7a tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] [instance: 65a92ef8-24d4-4114-980a-2222eab94658] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:42.292820 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f04e35cf-9b3e-4f74-85ae-c5abdf91ab7a tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:42.294440 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f04e35cf-9b3e-4f74-85ae-c5abdf91ab7a tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:42.294945 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f04e35cf-9b3e-4f74-85ae-c5abdf91ab7a tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:42.295737 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f04e35cf-9b3e-4f74-85ae-c5abdf91ab7a tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:42.296198 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f04e35cf-9b3e-4f74-85ae-c5abdf91ab7a tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:42.296705 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f04e35cf-9b3e-4f74-85ae-c5abdf91ab7a tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:42.342739 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-f04e35cf-9b3e-4f74-85ae-c5abdf91ab7a tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] [instance: 65a92ef8-24d4-4114-980a-2222eab94658] Going to try to terminate instance {{(pid=134051) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:00:42.398746 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e65158c2-58fa-481f-8184-884c089d2b0d tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:42.399365 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-e65158c2-58fa-481f-8184-884c089d2b0d tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] [instance: 9d9f666f-0b19-4d87-a94a-770b5d99f349] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:42.405785 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e65158c2-58fa-481f-8184-884c089d2b0d tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:42.406254 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e65158c2-58fa-481f-8184-884c089d2b0d tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:42.406695 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e65158c2-58fa-481f-8184-884c089d2b0d tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:42.410972 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e65158c2-58fa-481f-8184-884c089d2b0d tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:42.411551 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e65158c2-58fa-481f-8184-884c089d2b0d tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:42.411995 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e65158c2-58fa-481f-8184-884c089d2b0d tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:42.483842 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-f04e35cf-9b3e-4f74-85ae-c5abdf91ab7a tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] 10.222.0.70 "DELETE /compute/v2.1/servers/65a92ef8-24d4-4114-980a-2222eab94658" status: 204 len: 0 microversion: 2.1 time: 0.223806 Aug 27 03:00:42.485207 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2000/3987] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 03:00:42 2022] DELETE /compute/v2.1/servers/65a92ef8-24d4-4114-980a-2222eab94658 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:00:42.495982 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4ce703cd-3355-4dd8-8aac-cf3831b68eda tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:42.497176 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-4ce703cd-3355-4dd8-8aac-cf3831b68eda tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] [instance: 65a92ef8-24d4-4114-980a-2222eab94658] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:42.530694 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4ce703cd-3355-4dd8-8aac-cf3831b68eda tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:42.532078 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4ce703cd-3355-4dd8-8aac-cf3831b68eda tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:42.535362 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4ce703cd-3355-4dd8-8aac-cf3831b68eda tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:42.536258 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4ce703cd-3355-4dd8-8aac-cf3831b68eda tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:42.536806 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4ce703cd-3355-4dd8-8aac-cf3831b68eda tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:42.537182 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4ce703cd-3355-4dd8-8aac-cf3831b68eda tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:43.516416 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-4ce703cd-3355-4dd8-8aac-cf3831b68eda tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113050e1c2d24f8b8b522d84f7cf267b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f10c920e826430c8cbda7e54f288606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:43.526680 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-4ce703cd-3355-4dd8-8aac-cf3831b68eda tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] 10.222.0.70 "GET /compute/v2.1/servers/65a92ef8-24d4-4114-980a-2222eab94658" status: 200 len: 1525 microversion: 2.1 time: 1.036694 Aug 27 03:00:43.530086 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2001/3988] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:00:42 2022] GET /compute/v2.1/servers/65a92ef8-24d4-4114-980a-2222eab94658 => generated 1525 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:00:43.673722 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-e65158c2-58fa-481f-8184-884c089d2b0d tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe0328160c6472086d13907344756cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41649f09cbf410a9825100c498b4916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:43.686554 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e65158c2-58fa-481f-8184-884c089d2b0d tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] 10.222.0.70 "GET /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349" status: 200 len: 1721 microversion: 2.1 time: 1.291658 Aug 27 03:00:43.693025 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1988/3989] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:00:42 2022] GET /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349 => generated 1721 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:00:44.555540 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-2a8ac08f-6a5f-45a5-b5c2-865f049a1791 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:44.556368 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-2a8ac08f-6a5f-45a5-b5c2-865f049a1791 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] [instance: 65a92ef8-24d4-4114-980a-2222eab94658] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:44.559943 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:00:44.581617 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2a8ac08f-6a5f-45a5-b5c2-865f049a1791 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:44.582067 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2a8ac08f-6a5f-45a5-b5c2-865f049a1791 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:44.582509 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2a8ac08f-6a5f-45a5-b5c2-865f049a1791 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:44.583363 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2a8ac08f-6a5f-45a5-b5c2-865f049a1791 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:44.583815 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2a8ac08f-6a5f-45a5-b5c2-865f049a1791 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:44.584235 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2a8ac08f-6a5f-45a5-b5c2-865f049a1791 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:44.711089 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-26d9e9ba-72c0-43d4-8cca-7f2a58b21889 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:44.712484 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-26d9e9ba-72c0-43d4-8cca-7f2a58b21889 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] [instance: 9d9f666f-0b19-4d87-a94a-770b5d99f349] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:44.724290 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-26d9e9ba-72c0-43d4-8cca-7f2a58b21889 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:44.725281 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-26d9e9ba-72c0-43d4-8cca-7f2a58b21889 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:44.726002 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-26d9e9ba-72c0-43d4-8cca-7f2a58b21889 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:44.728132 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-26d9e9ba-72c0-43d4-8cca-7f2a58b21889 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:44.730392 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-26d9e9ba-72c0-43d4-8cca-7f2a58b21889 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:44.731208 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-26d9e9ba-72c0-43d4-8cca-7f2a58b21889 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:45.406703 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-2a8ac08f-6a5f-45a5-b5c2-865f049a1791 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113050e1c2d24f8b8b522d84f7cf267b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f10c920e826430c8cbda7e54f288606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:45.414510 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-2a8ac08f-6a5f-45a5-b5c2-865f049a1791 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] 10.222.0.70 "GET /compute/v2.1/servers/65a92ef8-24d4-4114-980a-2222eab94658" status: 200 len: 1525 microversion: 2.1 time: 0.863874 Aug 27 03:00:45.415654 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2002/3990] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:00:44 2022] GET /compute/v2.1/servers/65a92ef8-24d4-4114-980a-2222eab94658 => generated 1525 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:00:45.492601 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-26d9e9ba-72c0-43d4-8cca-7f2a58b21889 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe0328160c6472086d13907344756cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41649f09cbf410a9825100c498b4916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:45.504801 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-26d9e9ba-72c0-43d4-8cca-7f2a58b21889 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] 10.222.0.70 "GET /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349" status: 200 len: 1721 microversion: 2.1 time: 0.798588 Aug 27 03:00:45.517016 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1989/3991] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:00:44 2022] GET /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349 => generated 1721 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:00:46.156677 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-3fe281b2-a2e3-4be7-90b6-49323e8f0f4a req-6f438a93-01c7-4312-8892-7b8352579a5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65a92ef8-24d4-4114-980a-2222eab94658", "name": "network-vif-unplugged", "status": "completed", "tag": "a5ffa1b9-364c-453c-ae84-4abb46872f60"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:00:46.193128 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-3fe281b2-a2e3-4be7-90b6-49323e8f0f4a req-6f438a93-01c7-4312-8892-7b8352579a5f service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:46.193870 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-3fe281b2-a2e3-4be7-90b6-49323e8f0f4a req-6f438a93-01c7-4312-8892-7b8352579a5f service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:46.194440 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-3fe281b2-a2e3-4be7-90b6-49323e8f0f4a req-6f438a93-01c7-4312-8892-7b8352579a5f service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:46.236958 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-3fe281b2-a2e3-4be7-90b6-49323e8f0f4a req-6f438a93-01c7-4312-8892-7b8352579a5f service nova] Creating event network-vif-unplugged:a5ffa1b9-364c-453c-ae84-4abb46872f60 for instance 65a92ef8-24d4-4114-980a-2222eab94658 on n-h2-852278-4 Aug 27 03:00:46.247632 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-3fe281b2-a2e3-4be7-90b6-49323e8f0f4a req-6f438a93-01c7-4312-8892-7b8352579a5f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.101745 Aug 27 03:00:46.249440 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2003/3992] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:00:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:00:46.434980 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a117a09c-fd61-49c3-936e-6e4ef698b94a tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:46.435593 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a117a09c-fd61-49c3-936e-6e4ef698b94a tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] [instance: 65a92ef8-24d4-4114-980a-2222eab94658] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:46.445024 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a117a09c-fd61-49c3-936e-6e4ef698b94a tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:46.445509 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a117a09c-fd61-49c3-936e-6e4ef698b94a tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:46.445940 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a117a09c-fd61-49c3-936e-6e4ef698b94a tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:46.446652 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a117a09c-fd61-49c3-936e-6e4ef698b94a tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:46.447100 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a117a09c-fd61-49c3-936e-6e4ef698b94a tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:46.447512 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a117a09c-fd61-49c3-936e-6e4ef698b94a tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:46.527094 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-66cc6d84-4900-4740-8586-61f19e58ea39 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:46.529057 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-66cc6d84-4900-4740-8586-61f19e58ea39 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] [instance: 9d9f666f-0b19-4d87-a94a-770b5d99f349] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:46.542250 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-66cc6d84-4900-4740-8586-61f19e58ea39 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:46.543909 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-66cc6d84-4900-4740-8586-61f19e58ea39 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:46.544364 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-66cc6d84-4900-4740-8586-61f19e58ea39 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:46.544994 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-66cc6d84-4900-4740-8586-61f19e58ea39 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:46.545439 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-66cc6d84-4900-4740-8586-61f19e58ea39 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:46.547589 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-66cc6d84-4900-4740-8586-61f19e58ea39 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:46.794453 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-a117a09c-fd61-49c3-936e-6e4ef698b94a tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113050e1c2d24f8b8b522d84f7cf267b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f10c920e826430c8cbda7e54f288606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:46.809657 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a117a09c-fd61-49c3-936e-6e4ef698b94a tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] 10.222.0.70 "GET /compute/v2.1/servers/65a92ef8-24d4-4114-980a-2222eab94658" status: 200 len: 1483 microversion: 2.1 time: 0.378468 Aug 27 03:00:46.832793 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1990/3993] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:00:46 2022] GET /compute/v2.1/servers/65a92ef8-24d4-4114-980a-2222eab94658 => generated 1483 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:00:46.941864 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-aa117bd8-3775-4eca-be14-9d925757d388 req-1badfc91-99b4-436d-a0ce-1fc65da3bd3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65a92ef8-24d4-4114-980a-2222eab94658", "name": "network-vif-deleted", "tag": "a5ffa1b9-364c-453c-ae84-4abb46872f60"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:00:46.980736 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-aa117bd8-3775-4eca-be14-9d925757d388 req-1badfc91-99b4-436d-a0ce-1fc65da3bd3d service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:46.983472 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-aa117bd8-3775-4eca-be14-9d925757d388 req-1badfc91-99b4-436d-a0ce-1fc65da3bd3d service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:46.985799 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-aa117bd8-3775-4eca-be14-9d925757d388 req-1badfc91-99b4-436d-a0ce-1fc65da3bd3d service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:47.020074 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-aa117bd8-3775-4eca-be14-9d925757d388 req-1badfc91-99b4-436d-a0ce-1fc65da3bd3d service nova] Creating event network-vif-deleted:a5ffa1b9-364c-453c-ae84-4abb46872f60 for instance 65a92ef8-24d4-4114-980a-2222eab94658 on n-h2-852278-4 Aug 27 03:00:47.038857 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-aa117bd8-3775-4eca-be14-9d925757d388 req-1badfc91-99b4-436d-a0ce-1fc65da3bd3d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098421 Aug 27 03:00:47.042658 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1991/3994] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:00:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:00:47.261103 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-66cc6d84-4900-4740-8586-61f19e58ea39 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe0328160c6472086d13907344756cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41649f09cbf410a9825100c498b4916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:47.269988 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-66cc6d84-4900-4740-8586-61f19e58ea39 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] 10.222.0.70 "GET /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349" status: 200 len: 1721 microversion: 2.1 time: 0.747003 Aug 27 03:00:47.274394 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2004/3995] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:00:46 2022] GET /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349 => generated 1721 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:00:47.845457 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e85920b4-7660-4003-9aae-de82331b0814 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:47.848176 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-e85920b4-7660-4003-9aae-de82331b0814 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] [instance: 65a92ef8-24d4-4114-980a-2222eab94658] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:47.872737 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e85920b4-7660-4003-9aae-de82331b0814 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:47.875005 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e85920b4-7660-4003-9aae-de82331b0814 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:47.877076 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e85920b4-7660-4003-9aae-de82331b0814 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:47.879186 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e85920b4-7660-4003-9aae-de82331b0814 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:47.880946 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e85920b4-7660-4003-9aae-de82331b0814 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:47.884989 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e85920b4-7660-4003-9aae-de82331b0814 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:47.960116 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e85920b4-7660-4003-9aae-de82331b0814 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:47.961370 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e85920b4-7660-4003-9aae-de82331b0814 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:47.963432 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e85920b4-7660-4003-9aae-de82331b0814 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:47.964070 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.instance [None req-e85920b4-7660-4003-9aae-de82331b0814 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Lazy-loading 'fault' on Instance uuid 65a92ef8-24d4-4114-980a-2222eab94658 {{(pid=134052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:00:48.146769 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-e85920b4-7660-4003-9aae-de82331b0814 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113050e1c2d24f8b8b522d84f7cf267b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f10c920e826430c8cbda7e54f288606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:48.160062 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e85920b4-7660-4003-9aae-de82331b0814 tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] 10.222.0.70 "GET /compute/v2.1/servers/65a92ef8-24d4-4114-980a-2222eab94658" status: 200 len: 1314 microversion: 2.1 time: 0.321007 Aug 27 03:00:48.162359 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1992/3996] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:00:47 2022] GET /compute/v2.1/servers/65a92ef8-24d4-4114-980a-2222eab94658 => generated 1314 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:00:48.296844 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-bb897f32-eaac-4853-a964-8b4adcb30d63 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:48.297368 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-bb897f32-eaac-4853-a964-8b4adcb30d63 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] [instance: 9d9f666f-0b19-4d87-a94a-770b5d99f349] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:48.307930 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bb897f32-eaac-4853-a964-8b4adcb30d63 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:48.311399 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bb897f32-eaac-4853-a964-8b4adcb30d63 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:48.312061 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bb897f32-eaac-4853-a964-8b4adcb30d63 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:48.312952 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bb897f32-eaac-4853-a964-8b4adcb30d63 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:48.315357 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bb897f32-eaac-4853-a964-8b4adcb30d63 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:48.316032 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bb897f32-eaac-4853-a964-8b4adcb30d63 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:48.574480 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-bb897f32-eaac-4853-a964-8b4adcb30d63 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe0328160c6472086d13907344756cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41649f09cbf410a9825100c498b4916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:48.590296 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-bb897f32-eaac-4853-a964-8b4adcb30d63 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] 10.222.0.70 "GET /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349" status: 200 len: 1721 microversion: 2.1 time: 0.297806 Aug 27 03:00:48.595209 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2005/3997] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:00:48 2022] GET /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349 => generated 1721 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:00:49.183072 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-390d8b9e-61e5-470d-9c40-29362446574c tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:49.184823 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-390d8b9e-61e5-470d-9c40-29362446574c tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] [instance: 65a92ef8-24d4-4114-980a-2222eab94658] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:49.192458 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-390d8b9e-61e5-470d-9c40-29362446574c tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:49.193294 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-390d8b9e-61e5-470d-9c40-29362446574c tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:49.193933 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-390d8b9e-61e5-470d-9c40-29362446574c tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:49.195242 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-390d8b9e-61e5-470d-9c40-29362446574c tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:49.195687 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-390d8b9e-61e5-470d-9c40-29362446574c tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:49.196089 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-390d8b9e-61e5-470d-9c40-29362446574c tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:49.213322 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-390d8b9e-61e5-470d-9c40-29362446574c tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] HTTP exception thrown: Instance 65a92ef8-24d4-4114-980a-2222eab94658 could not be found. Aug 27 03:00:49.215281 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-390d8b9e-61e5-470d-9c40-29362446574c tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Request method failure captured: Aug 27 03:00:49.215281 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/servers/65a92ef8-24d4-4114-980a-2222eab94658 HTTP/1.1 Aug 27 03:00:49.215281 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 03:00:49.215281 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 03:00:49.215281 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 03:00:49.215281 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 03:00:49.215281 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 03:00:49.215281 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 03:00:49.215281 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 03:00:49.215281 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 03:00:49.215281 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYjAk-c9MD-ltya_JOFX2O99dXeSPIZiTsK6NyhQ0-m3iJPoAMeHGtdzbSay0pmIgpwYfw9eSEp5RA7QFodChbW5vestX3_jRmVVhIwXWaSw4OeUTIhXPdDQzS8eL6Q8uP4-2vYonkosaN1yzVd_7-AOimwNSBjDDg-nwO49IMCOCkY Aug 27 03:00:49.215281 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 03:00:49.215281 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 03:00:49.215281 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 03:00:49.215281 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 03:00:49.215281 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 03:00:49.215281 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 03:00:49.215281 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 2f10c920e826430c8cbda7e54f288606 Aug 27 03:00:49.215281 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1633991642 Aug 27 03:00:49.215281 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 03:00:49.215281 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 03:00:49.215281 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2f10c920e826430c8cbda7e54f288606"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_2f10c920e826430c8cbda7e54f288606", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2f10c920e826430c8cbda7e54f288606"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/2f10c920e826430c8cbda7e54f288606"}]}] Aug 27 03:00:49.215281 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1633991642 Aug 27 03:00:49.215281 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 2f10c920e826430c8cbda7e54f288606 Aug 27 03:00:49.215281 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1633991642 Aug 27 03:00:49.215281 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ServerMetadataNegativeTestJSON-1633991642-project Aug 27 03:00:49.215281 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 03:00:49.215281 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 03:00:49.215281 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 113050e1c2d24f8b8b522d84f7cf267b Aug 27 03:00:49.215281 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1633991642-project Aug 27 03:00:49.215281 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 03:00:49.215281 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance 65a92ef8-24d4-4114-980a-2222eab94658 could not be found. Aug 27 03:00:49.215281 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '65a92ef8-24d4-4114-980a-2222eab94658'} Aug 27 03:00:49.215281 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:00:49.215281 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:00:49.215281 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:00:49.215281 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:00:49.215281 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:00:49.215281 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:00:49.215281 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:00:49.215281 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:00:49.215281 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:00:49.215281 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:00:49.215281 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65a92ef8-24d4-4114-980a-2222eab94658 could not be found. Aug 27 03:00:49.215281 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:00:49.215281 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:00:49.215281 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:00:49.215281 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:00:49.215281 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:00:49.215281 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:00:49.215281 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:00:49.215281 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:00:49.215281 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:00:49.215281 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:00:49.215281 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:00:49.215281 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:00:49.215281 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:00:49.215281 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:00:49.215281 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:00:49.215281 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:00:49.215281 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65a92ef8-24d4-4114-980a-2222eab94658 could not be found. Aug 27 03:00:49.215281 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:00:49.215281 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:00:49.220062 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:00:49.220062 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:00:49.220062 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:00:49.220062 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:00:49.220062 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:00:49.220062 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:00:49.220062 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65a92ef8-24d4-4114-980a-2222eab94658 could not be found. Aug 27 03:00:49.220062 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:00:49.221636 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-390d8b9e-61e5-470d-9c40-29362446574c tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] Returning 404 to user: Instance 65a92ef8-24d4-4114-980a-2222eab94658 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:00:49.222523 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-390d8b9e-61e5-470d-9c40-29362446574c tempest-ServerMetadataNegativeTestJSON-1633991642 tempest-ServerMetadataNegativeTestJSON-1633991642-project] 10.222.0.70 "GET /compute/v2.1/servers/65a92ef8-24d4-4114-980a-2222eab94658" status: 404 len: 111 microversion: 2.1 time: 0.043630 Aug 27 03:00:49.223190 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1993/3998] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:00:49 2022] GET /compute/v2.1/servers/65a92ef8-24d4-4114-980a-2222eab94658 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:00:49.618204 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-eac72686-0da9-4c1c-bd1f-4090f79f8ee9 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:49.618811 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-eac72686-0da9-4c1c-bd1f-4090f79f8ee9 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] [instance: 9d9f666f-0b19-4d87-a94a-770b5d99f349] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:49.631195 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eac72686-0da9-4c1c-bd1f-4090f79f8ee9 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:49.632074 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eac72686-0da9-4c1c-bd1f-4090f79f8ee9 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:49.632712 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eac72686-0da9-4c1c-bd1f-4090f79f8ee9 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:49.633595 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eac72686-0da9-4c1c-bd1f-4090f79f8ee9 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:49.634199 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eac72686-0da9-4c1c-bd1f-4090f79f8ee9 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:49.634772 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eac72686-0da9-4c1c-bd1f-4090f79f8ee9 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:50.281249 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-eac72686-0da9-4c1c-bd1f-4090f79f8ee9 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe0328160c6472086d13907344756cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41649f09cbf410a9825100c498b4916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:50.290331 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-eac72686-0da9-4c1c-bd1f-4090f79f8ee9 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] 10.222.0.70 "GET /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349" status: 200 len: 1721 microversion: 2.1 time: 0.676827 Aug 27 03:00:50.294907 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2006/3999] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:00:49 2022] GET /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349 => generated 1721 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:00:51.318079 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-544ac4fb-8ebb-4de3-9b9b-ee645828afb4 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:51.318738 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-544ac4fb-8ebb-4de3-9b9b-ee645828afb4 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] [instance: 9d9f666f-0b19-4d87-a94a-770b5d99f349] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:51.336018 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-544ac4fb-8ebb-4de3-9b9b-ee645828afb4 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:51.336542 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-544ac4fb-8ebb-4de3-9b9b-ee645828afb4 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:51.336977 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-544ac4fb-8ebb-4de3-9b9b-ee645828afb4 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:51.337888 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-544ac4fb-8ebb-4de3-9b9b-ee645828afb4 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:51.338495 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-544ac4fb-8ebb-4de3-9b9b-ee645828afb4 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:51.339070 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-544ac4fb-8ebb-4de3-9b9b-ee645828afb4 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:51.395149 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-492a2f00-80ca-46a2-8d19-a0e038c6701c tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:51.400495 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-492a2f00-80ca-46a2-8d19-a0e038c6701c tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5557a4cfdaab4a7fa40c17bf9fc9ceb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503b9ec7c8e48ff95ce15b92a41118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:51.403623 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-492a2f00-80ca-46a2-8d19-a0e038c6701c tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Searching by: {'deleted': False, 'project_id': '7503b9ec7c8e48ff95ce15b92a41118f'} {{(pid=134051) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 03:00:51.438157 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-492a2f00-80ca-46a2-8d19-a0e038c6701c tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:51.438990 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-492a2f00-80ca-46a2-8d19-a0e038c6701c tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:51.439951 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-492a2f00-80ca-46a2-8d19-a0e038c6701c tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:51.440936 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-492a2f00-80ca-46a2-8d19-a0e038c6701c tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:51.443727 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-492a2f00-80ca-46a2-8d19-a0e038c6701c tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:51.448855 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-492a2f00-80ca-46a2-8d19-a0e038c6701c tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:51.493110 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.multi_cell_list [None req-492a2f00-80ca-46a2-8d19-a0e038c6701c tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=134051) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 03:00:51.549365 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-492a2f00-80ca-46a2-8d19-a0e038c6701c tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] 10.222.0.70 "GET /compute/v2.1/servers" status: 200 len: 344 microversion: 2.1 time: 0.158330 Aug 27 03:00:51.559623 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2007/4000] 10.222.0.70 () {58 vars in 1125 bytes} [Sat Aug 27 03:00:51 2022] GET /compute/v2.1/servers => generated 344 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:00:51.573616 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-df0053ba-02c4-4594-9783-d0a9adf71205 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:51.586168 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-df0053ba-02c4-4594-9783-d0a9adf71205 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5557a4cfdaab4a7fa40c17bf9fc9ceb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503b9ec7c8e48ff95ce15b92a41118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:51.587257 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-df0053ba-02c4-4594-9783-d0a9adf71205 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Searching by: {'deleted': False, 'project_id': '7503b9ec7c8e48ff95ce15b92a41118f'} {{(pid=134051) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 03:00:51.593225 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-df0053ba-02c4-4594-9783-d0a9adf71205 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:51.594883 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-df0053ba-02c4-4594-9783-d0a9adf71205 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:51.595675 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-df0053ba-02c4-4594-9783-d0a9adf71205 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:51.596801 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-df0053ba-02c4-4594-9783-d0a9adf71205 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:51.597534 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-df0053ba-02c4-4594-9783-d0a9adf71205 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:51.598239 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-df0053ba-02c4-4594-9783-d0a9adf71205 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:51.631709 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.multi_cell_list [None req-df0053ba-02c4-4594-9783-d0a9adf71205 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=134051) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 03:00:51.674914 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-df0053ba-02c4-4594-9783-d0a9adf71205 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5557a4cfdaab4a7fa40c17bf9fc9ceb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503b9ec7c8e48ff95ce15b92a41118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:51.684187 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-df0053ba-02c4-4594-9783-d0a9adf71205 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:51.685777 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-df0053ba-02c4-4594-9783-d0a9adf71205 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:51.686972 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-df0053ba-02c4-4594-9783-d0a9adf71205 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:52.286231 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-544ac4fb-8ebb-4de3-9b9b-ee645828afb4 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe0328160c6472086d13907344756cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41649f09cbf410a9825100c498b4916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:52.322423 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-544ac4fb-8ebb-4de3-9b9b-ee645828afb4 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] 10.222.0.70 "GET /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349" status: 200 len: 1721 microversion: 2.1 time: 1.006563 Aug 27 03:00:52.339966 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1994/4001] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:00:51 2022] GET /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349 => generated 1721 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:00:52.355089 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-df0053ba-02c4-4594-9783-d0a9adf71205 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] 10.222.0.70 "GET /compute/v2.1/servers/detail" status: 200 len: 1605 microversion: 2.1 time: 0.793914 Aug 27 03:00:52.355908 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2008/4002] 10.222.0.70 () {58 vars in 1146 bytes} [Sat Aug 27 03:00:51 2022] GET /compute/v2.1/servers/detail => generated 1605 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:00:52.390453 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b233aa6c-a3b3-48d5-9d21-824d602f0bad tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:52.414771 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b233aa6c-a3b3-48d5-9d21-824d602f0bad tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] 10.222.0.70 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.030261 Aug 27 03:00:52.417475 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1995/4003] 10.222.0.70 () {58 vars in 1137 bytes} [Sat Aug 27 03:00:52 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:00:52.808169 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-90f3a3c7-3db1-4420-83d3-72efb58d550e tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:52.809915 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-90f3a3c7-3db1-4420-83d3-72efb58d550e tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] [instance: e7973075-ede5-4528-8d5f-83d994006015] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:52.832602 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-90f3a3c7-3db1-4420-83d3-72efb58d550e tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:52.834793 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-90f3a3c7-3db1-4420-83d3-72efb58d550e tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:52.836050 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-90f3a3c7-3db1-4420-83d3-72efb58d550e tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:52.838381 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-90f3a3c7-3db1-4420-83d3-72efb58d550e tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:52.839193 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-90f3a3c7-3db1-4420-83d3-72efb58d550e tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:52.840014 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-90f3a3c7-3db1-4420-83d3-72efb58d550e tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:52.901333 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-90f3a3c7-3db1-4420-83d3-72efb58d550e tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] [instance: e7973075-ede5-4528-8d5f-83d994006015] Going to try to terminate instance {{(pid=134051) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:00:53.087743 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-90f3a3c7-3db1-4420-83d3-72efb58d550e tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] 10.222.0.70 "DELETE /compute/v2.1/servers/e7973075-ede5-4528-8d5f-83d994006015" status: 204 len: 0 microversion: 2.1 time: 0.285866 Aug 27 03:00:53.088913 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2009/4004] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 03:00:52 2022] DELETE /compute/v2.1/servers/e7973075-ede5-4528-8d5f-83d994006015 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:00:53.107230 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-5e15bc72-fc87-4a27-b82a-a69fa7d306f9 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:53.110399 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-5e15bc72-fc87-4a27-b82a-a69fa7d306f9 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] [instance: e7973075-ede5-4528-8d5f-83d994006015] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:53.137571 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5e15bc72-fc87-4a27-b82a-a69fa7d306f9 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:53.138466 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5e15bc72-fc87-4a27-b82a-a69fa7d306f9 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:53.139192 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5e15bc72-fc87-4a27-b82a-a69fa7d306f9 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:53.141304 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5e15bc72-fc87-4a27-b82a-a69fa7d306f9 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:53.142015 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5e15bc72-fc87-4a27-b82a-a69fa7d306f9 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:53.146499 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5e15bc72-fc87-4a27-b82a-a69fa7d306f9 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:53.296800 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-7ea6d750-6831-4a9f-8ae9-e56843951a67 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-1330455185", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "networks": "none"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:00:53.391525 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-7ea6d750-6831-4a9f-8ae9-e56843951a67 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Flavor limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:00:53.392952 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-7ea6d750-6831-4a9f-8ae9-e56843951a67 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Image limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:00:53.393798 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-7ea6d750-6831-4a9f-8ae9-e56843951a67 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Flavor pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:00:53.394367 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-7ea6d750-6831-4a9f-8ae9-e56843951a67 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Image pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:00:53.395042 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-7ea6d750-6831-4a9f-8ae9-e56843951a67 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:00:53.407954 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7ea6d750-6831-4a9f-8ae9-e56843951a67 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:53.408836 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7ea6d750-6831-4a9f-8ae9-e56843951a67 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:53.409421 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7ea6d750-6831-4a9f-8ae9-e56843951a67 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:53.410463 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7ea6d750-6831-4a9f-8ae9-e56843951a67 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:53.411070 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7ea6d750-6831-4a9f-8ae9-e56843951a67 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:53.411732 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7ea6d750-6831-4a9f-8ae9-e56843951a67 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:53.434908 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-7ea6d750-6831-4a9f-8ae9-e56843951a67 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Getting quotas for project 827a290de2714759a70c51b12b520321. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:00:53.440674 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-7ea6d750-6831-4a9f-8ae9-e56843951a67 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Getting quotas for user 107c58bcdad44bc29802d2588b93e26e and project 827a290de2714759a70c51b12b520321. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:00:53.457263 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-7ea6d750-6831-4a9f-8ae9-e56843951a67 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Going to run 1 instances... {{(pid=134052) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:00:53.460225 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-7ea6d750-6831-4a9f-8ae9-e56843951a67 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] [instance: 307f8788-d4c5-4bdc-9f4a-6cb6112a5b5a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134052) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:00:53.523366 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-7ea6d750-6831-4a9f-8ae9-e56843951a67 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.485088 Aug 27 03:00:53.530294 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1996/4005] 10.222.0.70 () {62 vars in 1188 bytes} [Sat Aug 27 03:00:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 493 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 27 03:00:53.535643 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-19689931-f3b3-40d8-9cc9-973bf2306148 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:53.536708 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-19689931-f3b3-40d8-9cc9-973bf2306148 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] [instance: 9d9f666f-0b19-4d87-a94a-770b5d99f349] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:53.544637 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-19689931-f3b3-40d8-9cc9-973bf2306148 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:53.545463 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-19689931-f3b3-40d8-9cc9-973bf2306148 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:53.546068 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-19689931-f3b3-40d8-9cc9-973bf2306148 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:53.547183 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-19689931-f3b3-40d8-9cc9-973bf2306148 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:53.547833 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-19689931-f3b3-40d8-9cc9-973bf2306148 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:53.548465 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-19689931-f3b3-40d8-9cc9-973bf2306148 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:54.882628 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-5e15bc72-fc87-4a27-b82a-a69fa7d306f9 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5557a4cfdaab4a7fa40c17bf9fc9ceb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503b9ec7c8e48ff95ce15b92a41118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:54.889510 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:00:54.906436 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-5e15bc72-fc87-4a27-b82a-a69fa7d306f9 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] 10.222.0.70 "GET /compute/v2.1/servers/e7973075-ede5-4528-8d5f-83d994006015" status: 200 len: 1608 microversion: 2.1 time: 1.811836 Aug 27 03:00:54.907103 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2010/4006] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:00:53 2022] GET /compute/v2.1/servers/e7973075-ede5-4528-8d5f-83d994006015 => generated 1608 bytes in 1814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:00:54.924696 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-1b22e1be-ad0d-4837-942f-060d3e17353e tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:54.925515 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-1b22e1be-ad0d-4837-942f-060d3e17353e tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] [instance: 307f8788-d4c5-4bdc-9f4a-6cb6112a5b5a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:54.950767 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1b22e1be-ad0d-4837-942f-060d3e17353e tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:54.951280 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1b22e1be-ad0d-4837-942f-060d3e17353e tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:54.951721 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1b22e1be-ad0d-4837-942f-060d3e17353e tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:54.952473 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1b22e1be-ad0d-4837-942f-060d3e17353e tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:54.961143 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1b22e1be-ad0d-4837-942f-060d3e17353e tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:54.961970 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1b22e1be-ad0d-4837-942f-060d3e17353e tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:55.128101 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-19689931-f3b3-40d8-9cc9-973bf2306148 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe0328160c6472086d13907344756cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41649f09cbf410a9825100c498b4916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:55.144758 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-19689931-f3b3-40d8-9cc9-973bf2306148 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] 10.222.0.70 "GET /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349" status: 200 len: 1721 microversion: 2.1 time: 1.612959 Aug 27 03:00:55.145373 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1997/4007] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:00:53 2022] GET /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349 => generated 1721 bytes in 1614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:00:55.252008 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-1b22e1be-ad0d-4837-942f-060d3e17353e tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107c58bcdad44bc29802d2588b93e26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827a290de2714759a70c51b12b520321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:55.265210 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-1b22e1be-ad0d-4837-942f-060d3e17353e tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '107c58bcdad44bc29802d2588b93e26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827a290de2714759a70c51b12b520321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:55.266684 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-1b22e1be-ad0d-4837-942f-060d3e17353e tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '107c58bcdad44bc29802d2588b93e26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827a290de2714759a70c51b12b520321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:55.274770 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-1b22e1be-ad0d-4837-942f-060d3e17353e tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] 10.222.0.70 "GET /compute/v2.1/servers/307f8788-d4c5-4bdc-9f4a-6cb6112a5b5a" status: 200 len: 1330 microversion: 2.57 time: 0.366544 Aug 27 03:00:55.275628 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2011/4008] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:00:54 2022] GET /compute/v2.1/servers/307f8788-d4c5-4bdc-9f4a-6cb6112a5b5a => generated 1330 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:00:55.944357 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3e605fae-72cf-4021-ad02-b0612ff616ee tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:55.945290 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-3e605fae-72cf-4021-ad02-b0612ff616ee tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] [instance: e7973075-ede5-4528-8d5f-83d994006015] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:55.992641 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3e605fae-72cf-4021-ad02-b0612ff616ee tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:55.994364 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3e605fae-72cf-4021-ad02-b0612ff616ee tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:55.996252 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3e605fae-72cf-4021-ad02-b0612ff616ee tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:56.000778 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3e605fae-72cf-4021-ad02-b0612ff616ee tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:56.001349 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3e605fae-72cf-4021-ad02-b0612ff616ee tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:56.004219 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3e605fae-72cf-4021-ad02-b0612ff616ee tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:56.015894 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:00:56.167092 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f2034636-015b-423a-b1de-eba98d3ab08f tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:56.167712 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-f2034636-015b-423a-b1de-eba98d3ab08f tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] [instance: 9d9f666f-0b19-4d87-a94a-770b5d99f349] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:56.183290 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f2034636-015b-423a-b1de-eba98d3ab08f tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:56.186812 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f2034636-015b-423a-b1de-eba98d3ab08f tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:56.187426 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f2034636-015b-423a-b1de-eba98d3ab08f tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:56.188486 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f2034636-015b-423a-b1de-eba98d3ab08f tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:56.190734 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f2034636-015b-423a-b1de-eba98d3ab08f tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:56.192073 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f2034636-015b-423a-b1de-eba98d3ab08f tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:56.803681 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-3e605fae-72cf-4021-ad02-b0612ff616ee tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5557a4cfdaab4a7fa40c17bf9fc9ceb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503b9ec7c8e48ff95ce15b92a41118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:56.814454 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-3e605fae-72cf-4021-ad02-b0612ff616ee tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] 10.222.0.70 "GET /compute/v2.1/servers/e7973075-ede5-4528-8d5f-83d994006015" status: 200 len: 1608 microversion: 2.1 time: 0.889824 Aug 27 03:00:56.827708 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1998/4009] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:00:55 2022] GET /compute/v2.1/servers/e7973075-ede5-4528-8d5f-83d994006015 => generated 1608 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:00:56.831421 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-53c492d4-43f7-431c-a71e-836bae08d800 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:56.832031 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-53c492d4-43f7-431c-a71e-836bae08d800 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] [instance: 307f8788-d4c5-4bdc-9f4a-6cb6112a5b5a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:56.838151 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-53c492d4-43f7-431c-a71e-836bae08d800 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:56.838869 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-53c492d4-43f7-431c-a71e-836bae08d800 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:56.839449 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-53c492d4-43f7-431c-a71e-836bae08d800 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:56.840302 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-53c492d4-43f7-431c-a71e-836bae08d800 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:56.840909 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-53c492d4-43f7-431c-a71e-836bae08d800 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:56.841497 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-53c492d4-43f7-431c-a71e-836bae08d800 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:56.925067 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-53c492d4-43f7-431c-a71e-836bae08d800 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107c58bcdad44bc29802d2588b93e26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827a290de2714759a70c51b12b520321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:56.941843 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-53c492d4-43f7-431c-a71e-836bae08d800 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '107c58bcdad44bc29802d2588b93e26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827a290de2714759a70c51b12b520321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:56.944152 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-53c492d4-43f7-431c-a71e-836bae08d800 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '107c58bcdad44bc29802d2588b93e26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827a290de2714759a70c51b12b520321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:56.945572 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-53c492d4-43f7-431c-a71e-836bae08d800 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] 10.222.0.70 "GET /compute/v2.1/servers/307f8788-d4c5-4bdc-9f4a-6cb6112a5b5a" status: 200 len: 1336 microversion: 2.57 time: 0.118016 Aug 27 03:00:56.946787 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 1999/4010] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:00:56 2022] GET /compute/v2.1/servers/307f8788-d4c5-4bdc-9f4a-6cb6112a5b5a => generated 1336 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:00:57.022829 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-f2034636-015b-423a-b1de-eba98d3ab08f tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe0328160c6472086d13907344756cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41649f09cbf410a9825100c498b4916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:57.068097 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-f2034636-015b-423a-b1de-eba98d3ab08f tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] 10.222.0.70 "GET /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349" status: 200 len: 1698 microversion: 2.1 time: 0.897686 Aug 27 03:00:57.069231 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2012/4011] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:00:56 2022] GET /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349 => generated 1698 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:00:57.090128 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-730f1a0c-66e0-4f62-991f-b24a03617f1a tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:00:57.104864 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-730f1a0c-66e0-4f62-991f-b24a03617f1a tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:57.105363 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-730f1a0c-66e0-4f62-991f-b24a03617f1a tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:57.105800 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-730f1a0c-66e0-4f62-991f-b24a03617f1a tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:57.167278 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-730f1a0c-66e0-4f62-991f-b24a03617f1a tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] [instance: 9d9f666f-0b19-4d87-a94a-770b5d99f349] Going to try to start instance {{(pid=134052) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 27 03:00:57.241231 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-730f1a0c-66e0-4f62-991f-b24a03617f1a tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] 10.222.0.70 "POST /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349/action" status: 202 len: 0 microversion: 2.1 time: 0.154195 Aug 27 03:00:57.246015 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2000/4012] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:00:57 2022] POST /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349/action => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:00:57.256705 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b01268db-1939-4982-b368-619d34940a97 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:57.257327 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b01268db-1939-4982-b368-619d34940a97 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] [instance: 9d9f666f-0b19-4d87-a94a-770b5d99f349] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:57.278261 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b01268db-1939-4982-b368-619d34940a97 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:57.279529 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b01268db-1939-4982-b368-619d34940a97 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:57.279972 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b01268db-1939-4982-b368-619d34940a97 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:57.280721 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b01268db-1939-4982-b368-619d34940a97 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:57.281342 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b01268db-1939-4982-b368-619d34940a97 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:57.281898 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b01268db-1939-4982-b368-619d34940a97 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:57.772223 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-b01268db-1939-4982-b368-619d34940a97 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe0328160c6472086d13907344756cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41649f09cbf410a9825100c498b4916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:57.786276 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b01268db-1939-4982-b368-619d34940a97 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] 10.222.0.70 "GET /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349" status: 200 len: 1707 microversion: 2.1 time: 0.537288 Aug 27 03:00:57.787607 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2013/4013] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:00:57 2022] GET /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349 => generated 1707 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:00:57.836545 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c4dd03d7-eed8-425b-87ab-4bdca0315ecb tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:57.837419 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-c4dd03d7-eed8-425b-87ab-4bdca0315ecb tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] [instance: e7973075-ede5-4528-8d5f-83d994006015] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:57.847540 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c4dd03d7-eed8-425b-87ab-4bdca0315ecb tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:57.853233 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c4dd03d7-eed8-425b-87ab-4bdca0315ecb tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:57.854040 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c4dd03d7-eed8-425b-87ab-4bdca0315ecb tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:57.857072 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c4dd03d7-eed8-425b-87ab-4bdca0315ecb tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:57.858486 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c4dd03d7-eed8-425b-87ab-4bdca0315ecb tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:57.859305 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c4dd03d7-eed8-425b-87ab-4bdca0315ecb tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:57.972421 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-91adc279-726d-4349-b1d5-319c1ae4cb63 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:57.973354 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-91adc279-726d-4349-b1d5-319c1ae4cb63 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] [instance: 307f8788-d4c5-4bdc-9f4a-6cb6112a5b5a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:57.991787 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-91adc279-726d-4349-b1d5-319c1ae4cb63 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:57.998544 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-91adc279-726d-4349-b1d5-319c1ae4cb63 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:57.999272 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-91adc279-726d-4349-b1d5-319c1ae4cb63 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:58.000103 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-91adc279-726d-4349-b1d5-319c1ae4cb63 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:58.000604 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-91adc279-726d-4349-b1d5-319c1ae4cb63 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:58.001196 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-91adc279-726d-4349-b1d5-319c1ae4cb63 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:58.026429 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-c4dd03d7-eed8-425b-87ab-4bdca0315ecb tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5557a4cfdaab4a7fa40c17bf9fc9ceb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503b9ec7c8e48ff95ce15b92a41118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:58.040118 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c4dd03d7-eed8-425b-87ab-4bdca0315ecb tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] 10.222.0.70 "GET /compute/v2.1/servers/e7973075-ede5-4528-8d5f-83d994006015" status: 200 len: 1540 microversion: 2.1 time: 0.208231 Aug 27 03:00:58.041611 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2001/4014] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:00:57 2022] GET /compute/v2.1/servers/e7973075-ede5-4528-8d5f-83d994006015 => generated 1540 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:00:58.173005 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-91adc279-726d-4349-b1d5-319c1ae4cb63 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107c58bcdad44bc29802d2588b93e26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827a290de2714759a70c51b12b520321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:58.189976 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-91adc279-726d-4349-b1d5-319c1ae4cb63 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '107c58bcdad44bc29802d2588b93e26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827a290de2714759a70c51b12b520321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:58.193124 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-91adc279-726d-4349-b1d5-319c1ae4cb63 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '107c58bcdad44bc29802d2588b93e26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827a290de2714759a70c51b12b520321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:58.196835 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-91adc279-726d-4349-b1d5-319c1ae4cb63 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] 10.222.0.70 "GET /compute/v2.1/servers/307f8788-d4c5-4bdc-9f4a-6cb6112a5b5a" status: 200 len: 1357 microversion: 2.57 time: 0.229061 Aug 27 03:00:58.225105 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3e98ab14-7895-4235-8867-682ca356cead tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:00:58.226095 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2014/4015] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:00:57 2022] GET /compute/v2.1/servers/307f8788-d4c5-4bdc-9f4a-6cb6112a5b5a => generated 1357 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:00:58.231018 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-3e98ab14-7895-4235-8867-682ca356cead tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] [instance: 307f8788-d4c5-4bdc-9f4a-6cb6112a5b5a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:58.240901 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3e98ab14-7895-4235-8867-682ca356cead tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:58.241843 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3e98ab14-7895-4235-8867-682ca356cead tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:58.242519 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3e98ab14-7895-4235-8867-682ca356cead tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:58.244440 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3e98ab14-7895-4235-8867-682ca356cead tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:58.245144 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3e98ab14-7895-4235-8867-682ca356cead tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:58.245977 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3e98ab14-7895-4235-8867-682ca356cead tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:58.339716 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-956c6962-9eb4-4182-9db6-1e26ba59043e req-e6b13be9-d968-4a34-90cc-7f173a3ea4e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7973075-ede5-4528-8d5f-83d994006015", "name": "network-vif-deleted", "tag": "6fdcfea5-9c16-4c87-8fdf-4781a514fa56"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:00:58.370930 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-956c6962-9eb4-4182-9db6-1e26ba59043e req-e6b13be9-d968-4a34-90cc-7f173a3ea4e7 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:58.374091 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-956c6962-9eb4-4182-9db6-1e26ba59043e req-e6b13be9-d968-4a34-90cc-7f173a3ea4e7 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:58.374820 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-956c6962-9eb4-4182-9db6-1e26ba59043e req-e6b13be9-d968-4a34-90cc-7f173a3ea4e7 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:58.394531 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-3e98ab14-7895-4235-8867-682ca356cead tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Flavor limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:00:58.398783 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-3e98ab14-7895-4235-8867-682ca356cead tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Image limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:00:58.399998 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-3e98ab14-7895-4235-8867-682ca356cead tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Flavor pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:00:58.401885 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-3e98ab14-7895-4235-8867-682ca356cead tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Image pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:00:58.402568 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-3e98ab14-7895-4235-8867-682ca356cead tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:00:58.419924 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-956c6962-9eb4-4182-9db6-1e26ba59043e req-e6b13be9-d968-4a34-90cc-7f173a3ea4e7 service nova] Creating event network-vif-deleted:6fdcfea5-9c16-4c87-8fdf-4781a514fa56 for instance e7973075-ede5-4528-8d5f-83d994006015 on n-h2-852278-4 Aug 27 03:00:58.435797 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-956c6962-9eb4-4182-9db6-1e26ba59043e req-e6b13be9-d968-4a34-90cc-7f173a3ea4e7 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104560 Aug 27 03:00:58.438634 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2015/4016] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:00:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:00:58.569972 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-3e98ab14-7895-4235-8867-682ca356cead tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] [instance: 307f8788-d4c5-4bdc-9f4a-6cb6112a5b5a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:58.576159 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3e98ab14-7895-4235-8867-682ca356cead tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:58.576722 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3e98ab14-7895-4235-8867-682ca356cead tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:58.577161 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3e98ab14-7895-4235-8867-682ca356cead tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:58.577864 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3e98ab14-7895-4235-8867-682ca356cead tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:58.580391 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3e98ab14-7895-4235-8867-682ca356cead tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:58.581880 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3e98ab14-7895-4235-8867-682ca356cead tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:58.655473 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-3e98ab14-7895-4235-8867-682ca356cead tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] 10.222.0.70 "POST /compute/v2.1/servers/307f8788-d4c5-4bdc-9f4a-6cb6112a5b5a/action" status: 202 len: 1138 microversion: 2.57 time: 0.434652 Aug 27 03:00:58.657821 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2002/4017] 10.222.0.70 () {62 vars in 1320 bytes} [Sat Aug 27 03:00:58 2022] POST /compute/v2.1/servers/307f8788-d4c5-4bdc-9f4a-6cb6112a5b5a/action => generated 1138 bytes in 438 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 27 03:00:58.680268 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-6ed664d6-b98e-4658-9e28-81f174b1a46b tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:58.681608 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-6ed664d6-b98e-4658-9e28-81f174b1a46b tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] [instance: 307f8788-d4c5-4bdc-9f4a-6cb6112a5b5a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:58.712543 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6ed664d6-b98e-4658-9e28-81f174b1a46b tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:58.715819 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6ed664d6-b98e-4658-9e28-81f174b1a46b tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:58.717774 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6ed664d6-b98e-4658-9e28-81f174b1a46b tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:58.719935 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6ed664d6-b98e-4658-9e28-81f174b1a46b tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:58.722419 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6ed664d6-b98e-4658-9e28-81f174b1a46b tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:58.724150 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6ed664d6-b98e-4658-9e28-81f174b1a46b tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:58.810159 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-da495a83-954f-49ce-8f06-03ac8107ecc2 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:58.811711 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-da495a83-954f-49ce-8f06-03ac8107ecc2 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] [instance: 9d9f666f-0b19-4d87-a94a-770b5d99f349] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:58.819803 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-da495a83-954f-49ce-8f06-03ac8107ecc2 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:58.820619 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-da495a83-954f-49ce-8f06-03ac8107ecc2 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:58.821979 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-da495a83-954f-49ce-8f06-03ac8107ecc2 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:58.824056 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-da495a83-954f-49ce-8f06-03ac8107ecc2 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:58.824999 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-da495a83-954f-49ce-8f06-03ac8107ecc2 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:58.825872 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-da495a83-954f-49ce-8f06-03ac8107ecc2 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:58.954573 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-6ed664d6-b98e-4658-9e28-81f174b1a46b tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107c58bcdad44bc29802d2588b93e26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827a290de2714759a70c51b12b520321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:58.989391 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-6ed664d6-b98e-4658-9e28-81f174b1a46b tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '107c58bcdad44bc29802d2588b93e26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827a290de2714759a70c51b12b520321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:58.993668 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-6ed664d6-b98e-4658-9e28-81f174b1a46b tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '107c58bcdad44bc29802d2588b93e26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827a290de2714759a70c51b12b520321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:58.997928 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-6ed664d6-b98e-4658-9e28-81f174b1a46b tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] 10.222.0.70 "GET /compute/v2.1/servers/307f8788-d4c5-4bdc-9f4a-6cb6112a5b5a" status: 200 len: 1366 microversion: 2.57 time: 0.323490 Aug 27 03:00:59.027556 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2016/4018] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:00:58 2022] GET /compute/v2.1/servers/307f8788-d4c5-4bdc-9f4a-6cb6112a5b5a => generated 1366 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:00:59.062513 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b8c3752b-6fdb-48fe-a2a1-def2d9a1d01c tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:59.063483 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b8c3752b-6fdb-48fe-a2a1-def2d9a1d01c tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] [instance: e7973075-ede5-4528-8d5f-83d994006015] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:59.081737 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b8c3752b-6fdb-48fe-a2a1-def2d9a1d01c tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:59.082609 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b8c3752b-6fdb-48fe-a2a1-def2d9a1d01c tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:59.083126 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b8c3752b-6fdb-48fe-a2a1-def2d9a1d01c tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:59.083935 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b8c3752b-6fdb-48fe-a2a1-def2d9a1d01c tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:59.086927 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b8c3752b-6fdb-48fe-a2a1-def2d9a1d01c tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:59.087614 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b8c3752b-6fdb-48fe-a2a1-def2d9a1d01c tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:59.765720 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-b8c3752b-6fdb-48fe-a2a1-def2d9a1d01c tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5557a4cfdaab4a7fa40c17bf9fc9ceb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503b9ec7c8e48ff95ce15b92a41118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:59.793799 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b8c3752b-6fdb-48fe-a2a1-def2d9a1d01c tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] 10.222.0.70 "GET /compute/v2.1/servers/e7973075-ede5-4528-8d5f-83d994006015" status: 200 len: 1252 microversion: 2.1 time: 0.735270 Aug 27 03:00:59.794438 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2017/4019] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:00:59 2022] GET /compute/v2.1/servers/e7973075-ede5-4528-8d5f-83d994006015 => generated 1252 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:01:00.036163 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-75cfbf64-5b0c-4dd1-98c5-6f7bd9c01f43 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:00.036805 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-75cfbf64-5b0c-4dd1-98c5-6f7bd9c01f43 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] [instance: 307f8788-d4c5-4bdc-9f4a-6cb6112a5b5a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:00.051077 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-75cfbf64-5b0c-4dd1-98c5-6f7bd9c01f43 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:00.051663 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-75cfbf64-5b0c-4dd1-98c5-6f7bd9c01f43 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:00.052122 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-75cfbf64-5b0c-4dd1-98c5-6f7bd9c01f43 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:00.052953 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-75cfbf64-5b0c-4dd1-98c5-6f7bd9c01f43 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:00.060966 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-75cfbf64-5b0c-4dd1-98c5-6f7bd9c01f43 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:00.061712 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-75cfbf64-5b0c-4dd1-98c5-6f7bd9c01f43 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:00.398911 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-75cfbf64-5b0c-4dd1-98c5-6f7bd9c01f43 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107c58bcdad44bc29802d2588b93e26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827a290de2714759a70c51b12b520321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:00.418770 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-75cfbf64-5b0c-4dd1-98c5-6f7bd9c01f43 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '107c58bcdad44bc29802d2588b93e26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827a290de2714759a70c51b12b520321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:00.420333 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-75cfbf64-5b0c-4dd1-98c5-6f7bd9c01f43 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '107c58bcdad44bc29802d2588b93e26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827a290de2714759a70c51b12b520321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:00.427503 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-75cfbf64-5b0c-4dd1-98c5-6f7bd9c01f43 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] 10.222.0.70 "GET /compute/v2.1/servers/307f8788-d4c5-4bdc-9f4a-6cb6112a5b5a" status: 200 len: 1366 microversion: 2.57 time: 0.389676 Aug 27 03:01:00.428467 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2018/4020] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:01:00 2022] GET /compute/v2.1/servers/307f8788-d4c5-4bdc-9f4a-6cb6112a5b5a => generated 1366 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:01:00.659829 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-da495a83-954f-49ce-8f06-03ac8107ecc2 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe0328160c6472086d13907344756cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41649f09cbf410a9825100c498b4916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:00.681804 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-da495a83-954f-49ce-8f06-03ac8107ecc2 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] 10.222.0.70 "GET /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349" status: 200 len: 1707 microversion: 2.1 time: 1.868672 Aug 27 03:01:00.682900 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2003/4021] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:00:58 2022] GET /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349 => generated 1707 bytes in 1878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:01:00.815205 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-050e7837-eb4f-47b4-b055-3790ac93188a tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:00.816479 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-050e7837-eb4f-47b4-b055-3790ac93188a tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] [instance: e7973075-ede5-4528-8d5f-83d994006015] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:00.826493 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-050e7837-eb4f-47b4-b055-3790ac93188a tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:00.826986 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-050e7837-eb4f-47b4-b055-3790ac93188a tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:00.827413 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-050e7837-eb4f-47b4-b055-3790ac93188a tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:00.828115 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-050e7837-eb4f-47b4-b055-3790ac93188a tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:00.836834 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-050e7837-eb4f-47b4-b055-3790ac93188a tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:00.837308 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-050e7837-eb4f-47b4-b055-3790ac93188a tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:00.969725 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-050e7837-eb4f-47b4-b055-3790ac93188a tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5557a4cfdaab4a7fa40c17bf9fc9ceb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503b9ec7c8e48ff95ce15b92a41118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:00.980262 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-050e7837-eb4f-47b4-b055-3790ac93188a tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] 10.222.0.70 "GET /compute/v2.1/servers/e7973075-ede5-4528-8d5f-83d994006015" status: 200 len: 1252 microversion: 2.1 time: 0.168946 Aug 27 03:01:00.982770 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2019/4022] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:01:00 2022] GET /compute/v2.1/servers/e7973075-ede5-4528-8d5f-83d994006015 => generated 1252 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:01:01.458465 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4a22d589-cd31-4904-959e-82432edc0336 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:01.459403 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-4a22d589-cd31-4904-959e-82432edc0336 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] [instance: 307f8788-d4c5-4bdc-9f4a-6cb6112a5b5a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:01.482562 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4a22d589-cd31-4904-959e-82432edc0336 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:01.483958 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4a22d589-cd31-4904-959e-82432edc0336 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:01.485199 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4a22d589-cd31-4904-959e-82432edc0336 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:01.486311 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4a22d589-cd31-4904-959e-82432edc0336 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:01.486991 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4a22d589-cd31-4904-959e-82432edc0336 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:01.487791 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4a22d589-cd31-4904-959e-82432edc0336 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:01.706125 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c5738940-baaa-415f-8749-fe42e8271456 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:01.707054 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-c5738940-baaa-415f-8749-fe42e8271456 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] [instance: 9d9f666f-0b19-4d87-a94a-770b5d99f349] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:01.722889 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=4 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:01:01.725505 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:01:01.730896 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c5738940-baaa-415f-8749-fe42e8271456 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:01.734881 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c5738940-baaa-415f-8749-fe42e8271456 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:01.737073 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c5738940-baaa-415f-8749-fe42e8271456 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:01.740446 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c5738940-baaa-415f-8749-fe42e8271456 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:01.741403 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c5738940-baaa-415f-8749-fe42e8271456 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:01.742849 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c5738940-baaa-415f-8749-fe42e8271456 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:01.859055 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-4a22d589-cd31-4904-959e-82432edc0336 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107c58bcdad44bc29802d2588b93e26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827a290de2714759a70c51b12b520321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:01.873635 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-4a22d589-cd31-4904-959e-82432edc0336 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '107c58bcdad44bc29802d2588b93e26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827a290de2714759a70c51b12b520321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:01.877486 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-4a22d589-cd31-4904-959e-82432edc0336 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '107c58bcdad44bc29802d2588b93e26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827a290de2714759a70c51b12b520321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:01.882125 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-4a22d589-cd31-4904-959e-82432edc0336 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] 10.222.0.70 "GET /compute/v2.1/servers/307f8788-d4c5-4bdc-9f4a-6cb6112a5b5a" status: 200 len: 1366 microversion: 2.57 time: 0.430346 Aug 27 03:01:01.901867 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2004/4023] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:01:01 2022] GET /compute/v2.1/servers/307f8788-d4c5-4bdc-9f4a-6cb6112a5b5a => generated 1366 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:01:02.005225 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-85249d54-b0e8-4064-a2e8-5bb0b8bc975b tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:02.007536 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-85249d54-b0e8-4064-a2e8-5bb0b8bc975b tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] [instance: e7973075-ede5-4528-8d5f-83d994006015] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:02.023116 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-85249d54-b0e8-4064-a2e8-5bb0b8bc975b tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:02.024047 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-85249d54-b0e8-4064-a2e8-5bb0b8bc975b tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:02.025995 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-85249d54-b0e8-4064-a2e8-5bb0b8bc975b tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:02.027635 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-85249d54-b0e8-4064-a2e8-5bb0b8bc975b tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:02.031474 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-85249d54-b0e8-4064-a2e8-5bb0b8bc975b tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:02.032239 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-85249d54-b0e8-4064-a2e8-5bb0b8bc975b tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:02.216600 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-85249d54-b0e8-4064-a2e8-5bb0b8bc975b tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5557a4cfdaab4a7fa40c17bf9fc9ceb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503b9ec7c8e48ff95ce15b92a41118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:02.232993 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-85249d54-b0e8-4064-a2e8-5bb0b8bc975b tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] 10.222.0.70 "GET /compute/v2.1/servers/e7973075-ede5-4528-8d5f-83d994006015" status: 200 len: 1252 microversion: 2.1 time: 0.233641 Aug 27 03:01:02.233762 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2005/4024] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:01:01 2022] GET /compute/v2.1/servers/e7973075-ede5-4528-8d5f-83d994006015 => generated 1252 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:01:02.300967 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-c5738940-baaa-415f-8749-fe42e8271456 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe0328160c6472086d13907344756cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41649f09cbf410a9825100c498b4916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:02.317364 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c5738940-baaa-415f-8749-fe42e8271456 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] 10.222.0.70 "GET /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349" status: 200 len: 1711 microversion: 2.1 time: 0.615989 Aug 27 03:01:02.317982 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2020/4025] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:01:01 2022] GET /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349 => generated 1711 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:01:02.912406 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-46350779-99ca-44d1-bfe9-17ca2cf87199 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:02.915372 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-46350779-99ca-44d1-bfe9-17ca2cf87199 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] [instance: 307f8788-d4c5-4bdc-9f4a-6cb6112a5b5a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:02.925822 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-46350779-99ca-44d1-bfe9-17ca2cf87199 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:02.926510 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-46350779-99ca-44d1-bfe9-17ca2cf87199 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:02.930023 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-46350779-99ca-44d1-bfe9-17ca2cf87199 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:02.930991 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-46350779-99ca-44d1-bfe9-17ca2cf87199 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:02.931631 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-46350779-99ca-44d1-bfe9-17ca2cf87199 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:02.932228 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-46350779-99ca-44d1-bfe9-17ca2cf87199 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:03.134402 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-46350779-99ca-44d1-bfe9-17ca2cf87199 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107c58bcdad44bc29802d2588b93e26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827a290de2714759a70c51b12b520321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:03.146891 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-46350779-99ca-44d1-bfe9-17ca2cf87199 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '107c58bcdad44bc29802d2588b93e26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827a290de2714759a70c51b12b520321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:03.148412 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-46350779-99ca-44d1-bfe9-17ca2cf87199 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '107c58bcdad44bc29802d2588b93e26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827a290de2714759a70c51b12b520321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:03.149650 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-46350779-99ca-44d1-bfe9-17ca2cf87199 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] 10.222.0.70 "GET /compute/v2.1/servers/307f8788-d4c5-4bdc-9f4a-6cb6112a5b5a" status: 200 len: 1366 microversion: 2.57 time: 0.243344 Aug 27 03:01:03.165074 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2006/4026] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:01:02 2022] GET /compute/v2.1/servers/307f8788-d4c5-4bdc-9f4a-6cb6112a5b5a => generated 1366 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:01:03.257233 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b96f48d5-44e3-40b1-ae5a-881640d78b59 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:03.258033 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b96f48d5-44e3-40b1-ae5a-881640d78b59 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] [instance: e7973075-ede5-4528-8d5f-83d994006015] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:03.272418 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b96f48d5-44e3-40b1-ae5a-881640d78b59 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:03.288660 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b96f48d5-44e3-40b1-ae5a-881640d78b59 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:03.300663 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b96f48d5-44e3-40b1-ae5a-881640d78b59 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:03.301540 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b96f48d5-44e3-40b1-ae5a-881640d78b59 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:03.302092 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b96f48d5-44e3-40b1-ae5a-881640d78b59 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:03.302461 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b96f48d5-44e3-40b1-ae5a-881640d78b59 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:03.461464 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-b96f48d5-44e3-40b1-ae5a-881640d78b59 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5557a4cfdaab4a7fa40c17bf9fc9ceb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503b9ec7c8e48ff95ce15b92a41118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:03.475089 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b96f48d5-44e3-40b1-ae5a-881640d78b59 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] 10.222.0.70 "GET /compute/v2.1/servers/e7973075-ede5-4528-8d5f-83d994006015" status: 200 len: 1252 microversion: 2.1 time: 0.224689 Aug 27 03:01:03.475702 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2021/4027] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:01:03 2022] GET /compute/v2.1/servers/e7973075-ede5-4528-8d5f-83d994006015 => generated 1252 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:01:04.130960 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:01:04.131745 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=6 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:01:04.175041 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-9343db2c-11b6-41e1-8e02-e7269ef51812 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:04.175662 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-9343db2c-11b6-41e1-8e02-e7269ef51812 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] [instance: 307f8788-d4c5-4bdc-9f4a-6cb6112a5b5a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:04.185580 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9343db2c-11b6-41e1-8e02-e7269ef51812 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:04.186080 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9343db2c-11b6-41e1-8e02-e7269ef51812 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:04.186522 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9343db2c-11b6-41e1-8e02-e7269ef51812 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:04.187244 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9343db2c-11b6-41e1-8e02-e7269ef51812 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:04.187700 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9343db2c-11b6-41e1-8e02-e7269ef51812 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:04.188128 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9343db2c-11b6-41e1-8e02-e7269ef51812 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:04.297814 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-65e49bfd-a0fa-4695-8068-ac418fcebf19 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-1899459156", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "networks": [{"uuid": "efd9b7b1-6823-46c7-ba6b-cef9c6616316"}]}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:01:04.322311 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:01:04.405670 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-9343db2c-11b6-41e1-8e02-e7269ef51812 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107c58bcdad44bc29802d2588b93e26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827a290de2714759a70c51b12b520321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:04.414485 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.network.neutron [None req-65e49bfd-a0fa-4695-8068-ac418fcebf19 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] validate_networks() for [('efd9b7b1-6823-46c7-ba6b-cef9c6616316', None, None, None, None, None)] {{(pid=134052) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:01:04.424737 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-9343db2c-11b6-41e1-8e02-e7269ef51812 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '107c58bcdad44bc29802d2588b93e26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827a290de2714759a70c51b12b520321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:04.426262 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-9343db2c-11b6-41e1-8e02-e7269ef51812 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '107c58bcdad44bc29802d2588b93e26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827a290de2714759a70c51b12b520321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:04.427472 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-9343db2c-11b6-41e1-8e02-e7269ef51812 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] 10.222.0.70 "GET /compute/v2.1/servers/307f8788-d4c5-4bdc-9f4a-6cb6112a5b5a" status: 200 len: 1366 microversion: 2.57 time: 0.256352 Aug 27 03:01:04.429195 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2022/4028] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:01:04 2022] GET /compute/v2.1/servers/307f8788-d4c5-4bdc-9f4a-6cb6112a5b5a => generated 1366 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:01:04.500588 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4b4281ea-d710-4e5b-84a3-04128e7c72d9 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:04.501457 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-4b4281ea-d710-4e5b-84a3-04128e7c72d9 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] [instance: e7973075-ede5-4528-8d5f-83d994006015] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:04.515989 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4b4281ea-d710-4e5b-84a3-04128e7c72d9 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:04.516789 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4b4281ea-d710-4e5b-84a3-04128e7c72d9 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:04.519116 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4b4281ea-d710-4e5b-84a3-04128e7c72d9 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:04.520086 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4b4281ea-d710-4e5b-84a3-04128e7c72d9 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:04.521398 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4b4281ea-d710-4e5b-84a3-04128e7c72d9 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:04.526058 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4b4281ea-d710-4e5b-84a3-04128e7c72d9 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:04.689092 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-4b4281ea-d710-4e5b-84a3-04128e7c72d9 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5557a4cfdaab4a7fa40c17bf9fc9ceb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503b9ec7c8e48ff95ce15b92a41118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:04.698663 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-4b4281ea-d710-4e5b-84a3-04128e7c72d9 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] 10.222.0.70 "GET /compute/v2.1/servers/e7973075-ede5-4528-8d5f-83d994006015" status: 200 len: 1252 microversion: 2.1 time: 0.201873 Aug 27 03:01:04.701068 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2023/4029] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:01:04 2022] GET /compute/v2.1/servers/e7973075-ede5-4528-8d5f-83d994006015 => generated 1252 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:01:05.188248 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-65e49bfd-a0fa-4695-8068-ac418fcebf19 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Flavor limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:01:05.188795 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-65e49bfd-a0fa-4695-8068-ac418fcebf19 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Image limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:01:05.189164 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-65e49bfd-a0fa-4695-8068-ac418fcebf19 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Flavor pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:01:05.189574 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-65e49bfd-a0fa-4695-8068-ac418fcebf19 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Image pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:01:05.189989 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-65e49bfd-a0fa-4695-8068-ac418fcebf19 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:01:05.215514 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-65e49bfd-a0fa-4695-8068-ac418fcebf19 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:05.216009 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-65e49bfd-a0fa-4695-8068-ac418fcebf19 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:05.216483 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-65e49bfd-a0fa-4695-8068-ac418fcebf19 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:05.217194 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-65e49bfd-a0fa-4695-8068-ac418fcebf19 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:05.225979 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-65e49bfd-a0fa-4695-8068-ac418fcebf19 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:05.226617 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-65e49bfd-a0fa-4695-8068-ac418fcebf19 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:05.294862 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-65e49bfd-a0fa-4695-8068-ac418fcebf19 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Getting quotas for project 2430b54793364b119690049d8aeea6f5. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:01:05.308019 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-65e49bfd-a0fa-4695-8068-ac418fcebf19 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Getting quotas for user dba8b9c3a3644a42b8ec4535345305af and project 2430b54793364b119690049d8aeea6f5. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:01:05.348178 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-65e49bfd-a0fa-4695-8068-ac418fcebf19 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Going to run 1 instances... {{(pid=134052) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:01:05.350776 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-65e49bfd-a0fa-4695-8068-ac418fcebf19 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] [instance: 343ac6ba-ddb5-469b-8fe1-fbdba6f69ac9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134052) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:01:05.435668 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-65e49bfd-a0fa-4695-8068-ac418fcebf19 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.305414 Aug 27 03:01:05.437274 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2007/4030] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 03:01:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1308 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:01:05.448094 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8f7e4f4a-2f4e-45d3-8624-1a71668d4834 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:05.450200 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-8f7e4f4a-2f4e-45d3-8624-1a71668d4834 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] [instance: 343ac6ba-ddb5-469b-8fe1-fbdba6f69ac9] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:05.465461 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0691cc6f-6ecb-4170-851a-893f14750f3e tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:05.466080 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-0691cc6f-6ecb-4170-851a-893f14750f3e tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] [instance: 307f8788-d4c5-4bdc-9f4a-6cb6112a5b5a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:05.493430 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0691cc6f-6ecb-4170-851a-893f14750f3e tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:05.493928 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0691cc6f-6ecb-4170-851a-893f14750f3e tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:05.494364 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0691cc6f-6ecb-4170-851a-893f14750f3e tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:05.495076 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0691cc6f-6ecb-4170-851a-893f14750f3e tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:05.495527 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0691cc6f-6ecb-4170-851a-893f14750f3e tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:05.495953 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0691cc6f-6ecb-4170-851a-893f14750f3e tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:05.690745 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0691cc6f-6ecb-4170-851a-893f14750f3e tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107c58bcdad44bc29802d2588b93e26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827a290de2714759a70c51b12b520321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:05.700972 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0691cc6f-6ecb-4170-851a-893f14750f3e tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '107c58bcdad44bc29802d2588b93e26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827a290de2714759a70c51b12b520321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:05.702686 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0691cc6f-6ecb-4170-851a-893f14750f3e tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '107c58bcdad44bc29802d2588b93e26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827a290de2714759a70c51b12b520321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:05.704432 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-0691cc6f-6ecb-4170-851a-893f14750f3e tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] 10.222.0.70 "GET /compute/v2.1/servers/307f8788-d4c5-4bdc-9f4a-6cb6112a5b5a" status: 200 len: 1366 microversion: 2.57 time: 0.242530 Aug 27 03:01:05.705361 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2008/4031] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:01:05 2022] GET /compute/v2.1/servers/307f8788-d4c5-4bdc-9f4a-6cb6112a5b5a => generated 1366 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:01:05.730702 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-98a538b5-370c-4fd6-930e-d8217d5d355c tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:05.731453 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-98a538b5-370c-4fd6-930e-d8217d5d355c tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] [instance: e7973075-ede5-4528-8d5f-83d994006015] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:05.753993 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-8f7e4f4a-2f4e-45d3-8624-1a71668d4834 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba8b9c3a3644a42b8ec4535345305af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2430b54793364b119690049d8aeea6f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:05.757211 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-98a538b5-370c-4fd6-930e-d8217d5d355c tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:05.760296 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-98a538b5-370c-4fd6-930e-d8217d5d355c tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:05.761738 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-98a538b5-370c-4fd6-930e-d8217d5d355c tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:05.764364 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-98a538b5-370c-4fd6-930e-d8217d5d355c tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:05.765037 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-8f7e4f4a-2f4e-45d3-8624-1a71668d4834 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] 10.222.0.70 "GET /compute/v2.1/servers/343ac6ba-ddb5-469b-8fe1-fbdba6f69ac9" status: 200 len: 1217 microversion: 2.1 time: 0.317972 Aug 27 03:01:05.765883 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-98a538b5-370c-4fd6-930e-d8217d5d355c tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:05.766201 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2024/4032] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:01:05 2022] GET /compute/v2.1/servers/343ac6ba-ddb5-469b-8fe1-fbdba6f69ac9 => generated 1217 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:01:05.777398 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-98a538b5-370c-4fd6-930e-d8217d5d355c tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:06.019158 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-98a538b5-370c-4fd6-930e-d8217d5d355c tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5557a4cfdaab4a7fa40c17bf9fc9ceb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7503b9ec7c8e48ff95ce15b92a41118f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:06.064594 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-98a538b5-370c-4fd6-930e-d8217d5d355c tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] 10.222.0.70 "GET /compute/v2.1/servers/e7973075-ede5-4528-8d5f-83d994006015" status: 200 len: 1252 microversion: 2.1 time: 0.341614 Aug 27 03:01:06.080340 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2009/4033] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:01:05 2022] GET /compute/v2.1/servers/e7973075-ede5-4528-8d5f-83d994006015 => generated 1252 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:01:06.730184 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3e6f168d-bac4-40a9-9786-7b069da6ea6c tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:06.731557 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-3e6f168d-bac4-40a9-9786-7b069da6ea6c tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] [instance: 307f8788-d4c5-4bdc-9f4a-6cb6112a5b5a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:06.745962 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3e6f168d-bac4-40a9-9786-7b069da6ea6c tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:06.746812 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3e6f168d-bac4-40a9-9786-7b069da6ea6c tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:06.747571 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3e6f168d-bac4-40a9-9786-7b069da6ea6c tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:06.748798 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3e6f168d-bac4-40a9-9786-7b069da6ea6c tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:06.749480 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3e6f168d-bac4-40a9-9786-7b069da6ea6c tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:06.750415 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3e6f168d-bac4-40a9-9786-7b069da6ea6c tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:06.794079 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b284387d-a57d-4652-ab69-fca8ec872f15 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:06.794697 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b284387d-a57d-4652-ab69-fca8ec872f15 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] [instance: 343ac6ba-ddb5-469b-8fe1-fbdba6f69ac9] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:06.809667 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b284387d-a57d-4652-ab69-fca8ec872f15 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:06.821565 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b284387d-a57d-4652-ab69-fca8ec872f15 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:06.822478 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b284387d-a57d-4652-ab69-fca8ec872f15 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:06.823444 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b284387d-a57d-4652-ab69-fca8ec872f15 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:06.824106 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b284387d-a57d-4652-ab69-fca8ec872f15 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:06.826950 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b284387d-a57d-4652-ab69-fca8ec872f15 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:07.248524 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b284387d-a57d-4652-ab69-fca8ec872f15 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba8b9c3a3644a42b8ec4535345305af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2430b54793364b119690049d8aeea6f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:07.266857 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b284387d-a57d-4652-ab69-fca8ec872f15 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] 10.222.0.70 "GET /compute/v2.1/servers/343ac6ba-ddb5-469b-8fe1-fbdba6f69ac9" status: 200 len: 1269 microversion: 2.1 time: 0.478626 Aug 27 03:01:07.267475 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2010/4034] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:01:06 2022] GET /compute/v2.1/servers/343ac6ba-ddb5-469b-8fe1-fbdba6f69ac9 => generated 1269 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:01:07.273000 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d47c18d5-7595-400a-bcc7-77ea1e0f0a65 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:07.273608 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d47c18d5-7595-400a-bcc7-77ea1e0f0a65 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] [instance: e7973075-ede5-4528-8d5f-83d994006015] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:07.287856 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-3e6f168d-bac4-40a9-9786-7b069da6ea6c tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107c58bcdad44bc29802d2588b93e26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827a290de2714759a70c51b12b520321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:07.295886 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d47c18d5-7595-400a-bcc7-77ea1e0f0a65 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:07.296401 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d47c18d5-7595-400a-bcc7-77ea1e0f0a65 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:07.296840 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d47c18d5-7595-400a-bcc7-77ea1e0f0a65 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:07.310965 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d47c18d5-7595-400a-bcc7-77ea1e0f0a65 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:07.311492 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d47c18d5-7595-400a-bcc7-77ea1e0f0a65 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:07.311996 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d47c18d5-7595-400a-bcc7-77ea1e0f0a65 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:07.369638 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-3e6f168d-bac4-40a9-9786-7b069da6ea6c tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '107c58bcdad44bc29802d2588b93e26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827a290de2714759a70c51b12b520321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:07.374947 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-d47c18d5-7595-400a-bcc7-77ea1e0f0a65 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] HTTP exception thrown: Instance e7973075-ede5-4528-8d5f-83d994006015 could not be found. Aug 27 03:01:07.385544 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-3e6f168d-bac4-40a9-9786-7b069da6ea6c tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '107c58bcdad44bc29802d2588b93e26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827a290de2714759a70c51b12b520321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:07.386021 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d47c18d5-7595-400a-bcc7-77ea1e0f0a65 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Request method failure captured: Aug 27 03:01:07.386021 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/servers/e7973075-ede5-4528-8d5f-83d994006015 HTTP/1.1 Aug 27 03:01:07.386021 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 03:01:07.386021 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 03:01:07.386021 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 03:01:07.386021 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 03:01:07.386021 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 03:01:07.386021 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 03:01:07.386021 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 03:01:07.386021 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 03:01:07.386021 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYhpJsnaEVygcJ3c8ckSuv7aS5kSnDax5iWktKyDQpdK8kHRW5tp86WNuOjEPRlwKUnA25mAFhm97pH2aH0Oajn14AnUktPQ0c3tg1ex1tUIs2Q_rf_TOY37mNCuzXU1hwK9EJaZ7P2bNlsspAGymZDP1PJO9BWv-L_mlrCOixFSGuQ Aug 27 03:01:07.386021 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 03:01:07.386021 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 03:01:07.386021 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 03:01:07.386021 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 03:01:07.386021 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 03:01:07.386021 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 03:01:07.386021 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 7503b9ec7c8e48ff95ce15b92a41118f Aug 27 03:01:07.386021 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ServersTestBootFromVolume-1261593719 Aug 27 03:01:07.386021 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 03:01:07.386021 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 03:01:07.386021 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7503b9ec7c8e48ff95ce15b92a41118f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_7503b9ec7c8e48ff95ce15b92a41118f", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7503b9ec7c8e48ff95ce15b92a41118f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/7503b9ec7c8e48ff95ce15b92a41118f"}]}] Aug 27 03:01:07.386021 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ServersTestBootFromVolume-1261593719 Aug 27 03:01:07.386021 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 7503b9ec7c8e48ff95ce15b92a41118f Aug 27 03:01:07.386021 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ServersTestBootFromVolume-1261593719 Aug 27 03:01:07.386021 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ServersTestBootFromVolume-1261593719-project Aug 27 03:01:07.386021 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 03:01:07.386021 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 03:01:07.386021 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 5557a4cfdaab4a7fa40c17bf9fc9ceb7 Aug 27 03:01:07.386021 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ServersTestBootFromVolume-1261593719-project Aug 27 03:01:07.386021 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 03:01:07.386021 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance e7973075-ede5-4528-8d5f-83d994006015 could not be found. Aug 27 03:01:07.386021 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': 'e7973075-ede5-4528-8d5f-83d994006015'} Aug 27 03:01:07.386021 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:01:07.386021 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:01:07.386021 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:01:07.386021 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:01:07.386021 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:01:07.386021 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:01:07.386021 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:01:07.386021 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:01:07.386021 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:01:07.386021 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:01:07.386021 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7973075-ede5-4528-8d5f-83d994006015 could not be found. Aug 27 03:01:07.386021 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:01:07.386021 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:01:07.386021 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:01:07.386021 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:01:07.386021 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:01:07.386021 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:01:07.386021 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:01:07.386021 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:01:07.386021 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:01:07.386021 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:01:07.386021 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:01:07.386021 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:01:07.386021 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:01:07.386021 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:01:07.386021 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:01:07.386021 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:01:07.386021 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7973075-ede5-4528-8d5f-83d994006015 could not be found. Aug 27 03:01:07.386021 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:01:07.386021 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:01:07.386021 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:01:07.389957 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:01:07.389957 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:01:07.389957 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:01:07.389957 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:01:07.389957 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:01:07.389957 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7973075-ede5-4528-8d5f-83d994006015 could not be found. Aug 27 03:01:07.389957 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:01:07.389957 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d47c18d5-7595-400a-bcc7-77ea1e0f0a65 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Returning 404 to user: Instance e7973075-ede5-4528-8d5f-83d994006015 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:01:07.389957 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d47c18d5-7595-400a-bcc7-77ea1e0f0a65 tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] 10.222.0.70 "GET /compute/v2.1/servers/e7973075-ede5-4528-8d5f-83d994006015" status: 404 len: 111 microversion: 2.1 time: 0.119078 Aug 27 03:01:07.394113 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-3e6f168d-bac4-40a9-9786-7b069da6ea6c tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] 10.222.0.70 "GET /compute/v2.1/servers/307f8788-d4c5-4bdc-9f4a-6cb6112a5b5a" status: 200 len: 1366 microversion: 2.57 time: 0.668483 Aug 27 03:01:07.395434 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2025/4036] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:01:06 2022] GET /compute/v2.1/servers/307f8788-d4c5-4bdc-9f4a-6cb6112a5b5a => generated 1366 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:01:07.395962 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2011/4036] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:01:07 2022] GET /compute/v2.1/servers/e7973075-ede5-4528-8d5f-83d994006015 => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:01:07.405688 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-01019220-ef26-4600-a57d-331aae0c108b tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] Calling method '.version_select at 0x7f5edec720d0>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:07.467765 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-01019220-ef26-4600-a57d-331aae0c108b tempest-ServersTestBootFromVolume-1261593719 tempest-ServersTestBootFromVolume-1261593719-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-843179185" status: 202 len: 0 microversion: 2.1 time: 0.069031 Aug 27 03:01:07.472302 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2026/4037] 10.222.0.70 () {58 vars in 1218 bytes} [Sat Aug 27 03:01:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-843179185 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:01:08.287647 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9fdfc210-79c8-4ed8-b5cd-7ab252b52574 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:08.288406 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-9fdfc210-79c8-4ed8-b5cd-7ab252b52574 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] [instance: 343ac6ba-ddb5-469b-8fe1-fbdba6f69ac9] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:08.301118 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9fdfc210-79c8-4ed8-b5cd-7ab252b52574 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:08.318278 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9fdfc210-79c8-4ed8-b5cd-7ab252b52574 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:08.320547 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9fdfc210-79c8-4ed8-b5cd-7ab252b52574 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:08.321485 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9fdfc210-79c8-4ed8-b5cd-7ab252b52574 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:08.322614 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9fdfc210-79c8-4ed8-b5cd-7ab252b52574 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:08.324527 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9fdfc210-79c8-4ed8-b5cd-7ab252b52574 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:08.420944 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f384ccd2-60b3-4d06-ae16-10e7ae671703 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:08.422377 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-f384ccd2-60b3-4d06-ae16-10e7ae671703 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] [instance: 307f8788-d4c5-4bdc-9f4a-6cb6112a5b5a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:08.442212 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f384ccd2-60b3-4d06-ae16-10e7ae671703 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:08.442904 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f384ccd2-60b3-4d06-ae16-10e7ae671703 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:08.443565 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f384ccd2-60b3-4d06-ae16-10e7ae671703 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:08.445410 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f384ccd2-60b3-4d06-ae16-10e7ae671703 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:08.446961 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f384ccd2-60b3-4d06-ae16-10e7ae671703 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:08.448435 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f384ccd2-60b3-4d06-ae16-10e7ae671703 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:10.087749 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-f384ccd2-60b3-4d06-ae16-10e7ae671703 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107c58bcdad44bc29802d2588b93e26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827a290de2714759a70c51b12b520321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:10.090718 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-9fdfc210-79c8-4ed8-b5cd-7ab252b52574 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba8b9c3a3644a42b8ec4535345305af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2430b54793364b119690049d8aeea6f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:10.096826 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-f384ccd2-60b3-4d06-ae16-10e7ae671703 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '107c58bcdad44bc29802d2588b93e26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827a290de2714759a70c51b12b520321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:10.098337 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-f384ccd2-60b3-4d06-ae16-10e7ae671703 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '107c58bcdad44bc29802d2588b93e26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827a290de2714759a70c51b12b520321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:10.099543 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-f384ccd2-60b3-4d06-ae16-10e7ae671703 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] 10.222.0.70 "GET /compute/v2.1/servers/307f8788-d4c5-4bdc-9f4a-6cb6112a5b5a" status: 200 len: 1366 microversion: 2.57 time: 1.685600 Aug 27 03:01:10.104068 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9fdfc210-79c8-4ed8-b5cd-7ab252b52574 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] 10.222.0.70 "GET /compute/v2.1/servers/343ac6ba-ddb5-469b-8fe1-fbdba6f69ac9" status: 200 len: 1275 microversion: 2.1 time: 1.820609 Aug 27 03:01:10.104637 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2012/4038] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:01:08 2022] GET /compute/v2.1/servers/343ac6ba-ddb5-469b-8fe1-fbdba6f69ac9 => generated 1275 bytes in 1822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:01:10.129927 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2027/4039] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:01:08 2022] GET /compute/v2.1/servers/307f8788-d4c5-4bdc-9f4a-6cb6112a5b5a => generated 1366 bytes in 1716 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:01:11.123772 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-2a2623b5-d5cf-4bb1-9d55-560213162087 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:11.124678 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-2a2623b5-d5cf-4bb1-9d55-560213162087 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] [instance: 307f8788-d4c5-4bdc-9f4a-6cb6112a5b5a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:11.127927 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4e7c0840-7ad4-4159-ab7c-ac0fe6ecb8a4 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:11.129458 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-4e7c0840-7ad4-4159-ab7c-ac0fe6ecb8a4 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] [instance: 343ac6ba-ddb5-469b-8fe1-fbdba6f69ac9] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:11.156377 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2a2623b5-d5cf-4bb1-9d55-560213162087 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:11.159144 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4e7c0840-7ad4-4159-ab7c-ac0fe6ecb8a4 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:11.162643 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4e7c0840-7ad4-4159-ab7c-ac0fe6ecb8a4 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:11.163247 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4e7c0840-7ad4-4159-ab7c-ac0fe6ecb8a4 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:11.165328 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2a2623b5-d5cf-4bb1-9d55-560213162087 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:11.165969 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2a2623b5-d5cf-4bb1-9d55-560213162087 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:11.166102 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4e7c0840-7ad4-4159-ab7c-ac0fe6ecb8a4 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:11.166821 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2a2623b5-d5cf-4bb1-9d55-560213162087 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:11.167284 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2a2623b5-d5cf-4bb1-9d55-560213162087 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:11.167712 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2a2623b5-d5cf-4bb1-9d55-560213162087 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:11.167985 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4e7c0840-7ad4-4159-ab7c-ac0fe6ecb8a4 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:11.168917 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4e7c0840-7ad4-4159-ab7c-ac0fe6ecb8a4 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:11.181690 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:01:11.695466 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-2a2623b5-d5cf-4bb1-9d55-560213162087 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107c58bcdad44bc29802d2588b93e26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827a290de2714759a70c51b12b520321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:11.704668 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-2a2623b5-d5cf-4bb1-9d55-560213162087 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '107c58bcdad44bc29802d2588b93e26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827a290de2714759a70c51b12b520321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:11.706220 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-2a2623b5-d5cf-4bb1-9d55-560213162087 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '107c58bcdad44bc29802d2588b93e26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827a290de2714759a70c51b12b520321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:11.707485 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-2a2623b5-d5cf-4bb1-9d55-560213162087 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] 10.222.0.70 "GET /compute/v2.1/servers/307f8788-d4c5-4bdc-9f4a-6cb6112a5b5a" status: 200 len: 1366 microversion: 2.57 time: 0.588185 Aug 27 03:01:11.724772 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2013/4040] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:01:11 2022] GET /compute/v2.1/servers/307f8788-d4c5-4bdc-9f4a-6cb6112a5b5a => generated 1366 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:01:11.964632 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-4e7c0840-7ad4-4159-ab7c-ac0fe6ecb8a4 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba8b9c3a3644a42b8ec4535345305af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2430b54793364b119690049d8aeea6f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:11.973609 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-4e7c0840-7ad4-4159-ab7c-ac0fe6ecb8a4 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] 10.222.0.70 "GET /compute/v2.1/servers/343ac6ba-ddb5-469b-8fe1-fbdba6f69ac9" status: 200 len: 1317 microversion: 2.1 time: 0.851701 Aug 27 03:01:11.978173 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2028/4041] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:01:11 2022] GET /compute/v2.1/servers/343ac6ba-ddb5-469b-8fe1-fbdba6f69ac9 => generated 1317 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:01:12.732525 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5c090e3b-a092-4258-9975-f4e252a4177b tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:12.733953 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-5c090e3b-a092-4258-9975-f4e252a4177b tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] [instance: 307f8788-d4c5-4bdc-9f4a-6cb6112a5b5a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:12.743788 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5c090e3b-a092-4258-9975-f4e252a4177b tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:12.744736 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5c090e3b-a092-4258-9975-f4e252a4177b tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:12.745395 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5c090e3b-a092-4258-9975-f4e252a4177b tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:12.749752 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5c090e3b-a092-4258-9975-f4e252a4177b tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:12.750715 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5c090e3b-a092-4258-9975-f4e252a4177b tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:12.751468 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5c090e3b-a092-4258-9975-f4e252a4177b tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:12.947968 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-5c090e3b-a092-4258-9975-f4e252a4177b tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107c58bcdad44bc29802d2588b93e26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827a290de2714759a70c51b12b520321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:12.961983 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-5c090e3b-a092-4258-9975-f4e252a4177b tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '107c58bcdad44bc29802d2588b93e26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827a290de2714759a70c51b12b520321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:12.968988 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-5c090e3b-a092-4258-9975-f4e252a4177b tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '107c58bcdad44bc29802d2588b93e26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827a290de2714759a70c51b12b520321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:12.971316 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-5c090e3b-a092-4258-9975-f4e252a4177b tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] 10.222.0.70 "GET /compute/v2.1/servers/307f8788-d4c5-4bdc-9f4a-6cb6112a5b5a" status: 200 len: 1366 microversion: 2.57 time: 0.242817 Aug 27 03:01:12.978662 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2014/4042] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:01:12 2022] GET /compute/v2.1/servers/307f8788-d4c5-4bdc-9f4a-6cb6112a5b5a => generated 1366 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:01:12.998876 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d61777e3-3238-486f-ac6f-5c43e6a84ea2 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:13.000487 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d61777e3-3238-486f-ac6f-5c43e6a84ea2 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] [instance: 343ac6ba-ddb5-469b-8fe1-fbdba6f69ac9] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:13.016862 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d61777e3-3238-486f-ac6f-5c43e6a84ea2 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:13.019252 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d61777e3-3238-486f-ac6f-5c43e6a84ea2 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:13.021004 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d61777e3-3238-486f-ac6f-5c43e6a84ea2 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:13.024102 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d61777e3-3238-486f-ac6f-5c43e6a84ea2 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:13.028943 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d61777e3-3238-486f-ac6f-5c43e6a84ea2 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:13.029598 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d61777e3-3238-486f-ac6f-5c43e6a84ea2 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:13.756952 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d61777e3-3238-486f-ac6f-5c43e6a84ea2 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba8b9c3a3644a42b8ec4535345305af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2430b54793364b119690049d8aeea6f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:13.769341 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d61777e3-3238-486f-ac6f-5c43e6a84ea2 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] 10.222.0.70 "GET /compute/v2.1/servers/343ac6ba-ddb5-469b-8fe1-fbdba6f69ac9" status: 200 len: 1317 microversion: 2.1 time: 0.776201 Aug 27 03:01:13.782727 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2029/4043] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:01:12 2022] GET /compute/v2.1/servers/343ac6ba-ddb5-469b-8fe1-fbdba6f69ac9 => generated 1317 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:01:14.005173 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e87001d3-854d-491f-9876-d8955df21d7b tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:14.005866 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-e87001d3-854d-491f-9876-d8955df21d7b tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] [instance: 307f8788-d4c5-4bdc-9f4a-6cb6112a5b5a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:14.020507 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e87001d3-854d-491f-9876-d8955df21d7b tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:14.022968 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e87001d3-854d-491f-9876-d8955df21d7b tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:14.024088 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e87001d3-854d-491f-9876-d8955df21d7b tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:14.027475 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e87001d3-854d-491f-9876-d8955df21d7b tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:14.028103 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e87001d3-854d-491f-9876-d8955df21d7b tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:14.028603 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e87001d3-854d-491f-9876-d8955df21d7b tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:14.097494 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-eb4642c7-1958-4666-9910-067e524e5e95 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-1106160332", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:01:14.155453 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=100 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:01:14.207695 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.network.neutron [None req-eb4642c7-1958-4666-9910-067e524e5e95 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] validate_networks() for [('750db57b-e38b-4e42-95a1-91ef26baf91f', None, None, None, None, None)] {{(pid=134052) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:01:14.541753 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e87001d3-854d-491f-9876-d8955df21d7b tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107c58bcdad44bc29802d2588b93e26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827a290de2714759a70c51b12b520321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:14.551587 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e87001d3-854d-491f-9876-d8955df21d7b tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '107c58bcdad44bc29802d2588b93e26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827a290de2714759a70c51b12b520321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:14.553413 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e87001d3-854d-491f-9876-d8955df21d7b tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '107c58bcdad44bc29802d2588b93e26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827a290de2714759a70c51b12b520321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:14.563357 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e87001d3-854d-491f-9876-d8955df21d7b tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] 10.222.0.70 "GET /compute/v2.1/servers/307f8788-d4c5-4bdc-9f4a-6cb6112a5b5a" status: 200 len: 1366 microversion: 2.57 time: 0.563097 Aug 27 03:01:14.568041 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2030/4044] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:01:13 2022] GET /compute/v2.1/servers/307f8788-d4c5-4bdc-9f4a-6cb6112a5b5a => generated 1366 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:01:14.757600 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-9286a7e4-ddde-419a-8e1a-29c24490eede req-6f6ff7d9-23ac-4be6-8f81-5dd2072d300f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "343ac6ba-ddb5-469b-8fe1-fbdba6f69ac9", "tag": "231041ff-643a-451f-9000-8f5274da957d"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:01:14.763321 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:01:14.786878 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-9286a7e4-ddde-419a-8e1a-29c24490eede req-6f6ff7d9-23ac-4be6-8f81-5dd2072d300f service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:14.801638 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-9286a7e4-ddde-419a-8e1a-29c24490eede req-6f6ff7d9-23ac-4be6-8f81-5dd2072d300f service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:14.805656 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-9286a7e4-ddde-419a-8e1a-29c24490eede req-6f6ff7d9-23ac-4be6-8f81-5dd2072d300f service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:14.851793 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-9286a7e4-ddde-419a-8e1a-29c24490eede req-6f6ff7d9-23ac-4be6-8f81-5dd2072d300f service nova] Creating event network-changed:231041ff-643a-451f-9000-8f5274da957d for instance 343ac6ba-ddb5-469b-8fe1-fbdba6f69ac9 on n-h1-852278-4 Aug 27 03:01:14.868815 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-9286a7e4-ddde-419a-8e1a-29c24490eede req-6f6ff7d9-23ac-4be6-8f81-5dd2072d300f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.299442 Aug 27 03:01:14.872022 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2031/4045] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:01:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:01:14.883048 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-217c060f-71d3-419e-9288-3056f723aa06 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:14.886635 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-217c060f-71d3-419e-9288-3056f723aa06 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] [instance: 343ac6ba-ddb5-469b-8fe1-fbdba6f69ac9] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:14.903799 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-217c060f-71d3-419e-9288-3056f723aa06 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:14.904609 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-217c060f-71d3-419e-9288-3056f723aa06 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:14.905899 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-217c060f-71d3-419e-9288-3056f723aa06 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:14.909321 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-217c060f-71d3-419e-9288-3056f723aa06 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:14.910366 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-217c060f-71d3-419e-9288-3056f723aa06 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:14.911296 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-217c060f-71d3-419e-9288-3056f723aa06 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:15.255384 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:01:15.336423 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=6 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:01:15.762706 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:01:15.828103 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-217c060f-71d3-419e-9288-3056f723aa06 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba8b9c3a3644a42b8ec4535345305af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2430b54793364b119690049d8aeea6f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:15.844929 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-217c060f-71d3-419e-9288-3056f723aa06 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] 10.222.0.70 "GET /compute/v2.1/servers/343ac6ba-ddb5-469b-8fe1-fbdba6f69ac9" status: 200 len: 1317 microversion: 2.1 time: 0.970505 Aug 27 03:01:15.845835 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2032/4046] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:01:14 2022] GET /compute/v2.1/servers/343ac6ba-ddb5-469b-8fe1-fbdba6f69ac9 => generated 1317 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:01:15.859977 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ba6e5928-ab5f-46a6-bfe9-be7a839b9e1f tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:15.861145 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-ba6e5928-ab5f-46a6-bfe9-be7a839b9e1f tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] [instance: 307f8788-d4c5-4bdc-9f4a-6cb6112a5b5a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:15.873593 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ba6e5928-ab5f-46a6-bfe9-be7a839b9e1f tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:15.877412 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ba6e5928-ab5f-46a6-bfe9-be7a839b9e1f tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:15.878171 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ba6e5928-ab5f-46a6-bfe9-be7a839b9e1f tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:15.879247 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ba6e5928-ab5f-46a6-bfe9-be7a839b9e1f tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:15.881330 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ba6e5928-ab5f-46a6-bfe9-be7a839b9e1f tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:15.882039 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ba6e5928-ab5f-46a6-bfe9-be7a839b9e1f tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:16.166587 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-ba6e5928-ab5f-46a6-bfe9-be7a839b9e1f tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107c58bcdad44bc29802d2588b93e26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827a290de2714759a70c51b12b520321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:16.180382 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-ba6e5928-ab5f-46a6-bfe9-be7a839b9e1f tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '107c58bcdad44bc29802d2588b93e26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827a290de2714759a70c51b12b520321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:16.182289 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-ba6e5928-ab5f-46a6-bfe9-be7a839b9e1f tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '107c58bcdad44bc29802d2588b93e26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827a290de2714759a70c51b12b520321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:16.187298 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ba6e5928-ab5f-46a6-bfe9-be7a839b9e1f tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] 10.222.0.70 "GET /compute/v2.1/servers/307f8788-d4c5-4bdc-9f4a-6cb6112a5b5a" status: 200 len: 1366 microversion: 2.57 time: 0.335526 Aug 27 03:01:16.189296 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2033/4047] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:01:15 2022] GET /compute/v2.1/servers/307f8788-d4c5-4bdc-9f4a-6cb6112a5b5a => generated 1366 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:01:16.682495 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-eb4642c7-1958-4666-9910-067e524e5e95 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Flavor limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:01:16.683188 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-eb4642c7-1958-4666-9910-067e524e5e95 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Image limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:01:16.683661 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-eb4642c7-1958-4666-9910-067e524e5e95 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Flavor pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:01:16.684150 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-eb4642c7-1958-4666-9910-067e524e5e95 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Image pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:01:16.684777 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-eb4642c7-1958-4666-9910-067e524e5e95 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:01:16.700628 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-eb4642c7-1958-4666-9910-067e524e5e95 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:16.702624 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-eb4642c7-1958-4666-9910-067e524e5e95 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:16.703484 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-eb4642c7-1958-4666-9910-067e524e5e95 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:16.705246 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-eb4642c7-1958-4666-9910-067e524e5e95 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:16.707611 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-eb4642c7-1958-4666-9910-067e524e5e95 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:16.708274 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-eb4642c7-1958-4666-9910-067e524e5e95 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:16.760903 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-eb4642c7-1958-4666-9910-067e524e5e95 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Getting quotas for project fb8cb23407cc4d5db0379bf5227a0228. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:01:16.770420 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-eb4642c7-1958-4666-9910-067e524e5e95 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Getting quotas for user 074fa9d1247548f1b93becab250d4772 and project fb8cb23407cc4d5db0379bf5227a0228. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:01:16.800101 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-eb4642c7-1958-4666-9910-067e524e5e95 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Going to run 1 instances... {{(pid=134052) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:01:16.806368 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-eb4642c7-1958-4666-9910-067e524e5e95 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] [instance: 9e44ca00-de7b-4c39-893c-c61b0d845cd1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134052) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:01:16.866320 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-92489630-d867-4881-95e6-52773f20955a tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:16.867108 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-92489630-d867-4881-95e6-52773f20955a tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] [instance: 343ac6ba-ddb5-469b-8fe1-fbdba6f69ac9] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:16.884202 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-92489630-d867-4881-95e6-52773f20955a tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:16.885012 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-92489630-d867-4881-95e6-52773f20955a tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:16.885676 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-92489630-d867-4881-95e6-52773f20955a tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:16.886769 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-92489630-d867-4881-95e6-52773f20955a tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:16.887434 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-92489630-d867-4881-95e6-52773f20955a tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:16.897437 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-92489630-d867-4881-95e6-52773f20955a tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:16.958570 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-eb4642c7-1958-4666-9910-067e524e5e95 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.210710 Aug 27 03:01:16.964546 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2015/4048] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 03:01:13 2022] POST /compute/v2.1/servers => generated 383 bytes in 3214 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 03:01:16.969716 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-05aab83c-020b-49af-b9e0-29321076da43 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:16.970341 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-05aab83c-020b-49af-b9e0-29321076da43 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] [instance: 9e44ca00-de7b-4c39-893c-c61b0d845cd1] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:17.326173 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-05aab83c-020b-49af-b9e0-29321076da43 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074fa9d1247548f1b93becab250d4772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8cb23407cc4d5db0379bf5227a0228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:17.341397 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-05aab83c-020b-49af-b9e0-29321076da43 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] 10.222.0.70 "GET /compute/v2.1/servers/9e44ca00-de7b-4c39-893c-c61b0d845cd1" status: 200 len: 1223 microversion: 2.1 time: 0.375429 Aug 27 03:01:17.349133 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2016/4049] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:01:16 2022] GET /compute/v2.1/servers/9e44ca00-de7b-4c39-893c-c61b0d845cd1 => generated 1223 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:01:17.356660 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8135ee33-2f5c-44c2-9f4c-a9e61c4c7452 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:17.371439 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-8135ee33-2f5c-44c2-9f4c-a9e61c4c7452 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] [instance: 307f8788-d4c5-4bdc-9f4a-6cb6112a5b5a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:17.394512 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8135ee33-2f5c-44c2-9f4c-a9e61c4c7452 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:17.395026 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8135ee33-2f5c-44c2-9f4c-a9e61c4c7452 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:17.395459 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8135ee33-2f5c-44c2-9f4c-a9e61c4c7452 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:17.396183 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8135ee33-2f5c-44c2-9f4c-a9e61c4c7452 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:17.396652 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8135ee33-2f5c-44c2-9f4c-a9e61c4c7452 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:17.397070 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8135ee33-2f5c-44c2-9f4c-a9e61c4c7452 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:17.449812 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-92489630-d867-4881-95e6-52773f20955a tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba8b9c3a3644a42b8ec4535345305af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2430b54793364b119690049d8aeea6f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:17.461387 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-92489630-d867-4881-95e6-52773f20955a tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] 10.222.0.70 "GET /compute/v2.1/servers/343ac6ba-ddb5-469b-8fe1-fbdba6f69ac9" status: 200 len: 1317 microversion: 2.1 time: 0.599000 Aug 27 03:01:17.465913 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2034/4050] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:01:16 2022] GET /compute/v2.1/servers/343ac6ba-ddb5-469b-8fe1-fbdba6f69ac9 => generated 1317 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:01:17.623112 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-8135ee33-2f5c-44c2-9f4c-a9e61c4c7452 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107c58bcdad44bc29802d2588b93e26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827a290de2714759a70c51b12b520321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:17.632014 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-8135ee33-2f5c-44c2-9f4c-a9e61c4c7452 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '107c58bcdad44bc29802d2588b93e26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827a290de2714759a70c51b12b520321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:17.643608 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-8135ee33-2f5c-44c2-9f4c-a9e61c4c7452 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '107c58bcdad44bc29802d2588b93e26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827a290de2714759a70c51b12b520321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:17.645664 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-8135ee33-2f5c-44c2-9f4c-a9e61c4c7452 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] 10.222.0.70 "GET /compute/v2.1/servers/307f8788-d4c5-4bdc-9f4a-6cb6112a5b5a" status: 200 len: 1366 microversion: 2.57 time: 0.294014 Aug 27 03:01:17.649385 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2017/4051] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:01:17 2022] GET /compute/v2.1/servers/307f8788-d4c5-4bdc-9f4a-6cb6112a5b5a => generated 1366 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:01:18.395325 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a9751dff-6ae0-4538-acbf-ad1e4b52f40f tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:18.396597 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-a9751dff-6ae0-4538-acbf-ad1e4b52f40f tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] [instance: 9e44ca00-de7b-4c39-893c-c61b0d845cd1] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:18.411854 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a9751dff-6ae0-4538-acbf-ad1e4b52f40f tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:18.417093 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a9751dff-6ae0-4538-acbf-ad1e4b52f40f tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:18.417780 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a9751dff-6ae0-4538-acbf-ad1e4b52f40f tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:18.418706 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a9751dff-6ae0-4538-acbf-ad1e4b52f40f tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:18.419321 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a9751dff-6ae0-4538-acbf-ad1e4b52f40f tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:18.419960 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a9751dff-6ae0-4538-acbf-ad1e4b52f40f tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:18.488765 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-24f1adea-9e14-4d11-a5dd-c8ffed1c5244 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:18.489482 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-24f1adea-9e14-4d11-a5dd-c8ffed1c5244 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] [instance: 343ac6ba-ddb5-469b-8fe1-fbdba6f69ac9] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:18.520899 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-24f1adea-9e14-4d11-a5dd-c8ffed1c5244 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:18.522283 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-24f1adea-9e14-4d11-a5dd-c8ffed1c5244 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:18.523133 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-24f1adea-9e14-4d11-a5dd-c8ffed1c5244 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:18.528258 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-24f1adea-9e14-4d11-a5dd-c8ffed1c5244 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:18.528947 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-24f1adea-9e14-4d11-a5dd-c8ffed1c5244 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:18.529479 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-24f1adea-9e14-4d11-a5dd-c8ffed1c5244 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:18.671942 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-a9751dff-6ae0-4538-acbf-ad1e4b52f40f tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074fa9d1247548f1b93becab250d4772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8cb23407cc4d5db0379bf5227a0228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:18.692104 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a9751dff-6ae0-4538-acbf-ad1e4b52f40f tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] 10.222.0.70 "GET /compute/v2.1/servers/9e44ca00-de7b-4c39-893c-c61b0d845cd1" status: 200 len: 1219 microversion: 2.1 time: 0.326808 Aug 27 03:01:18.695497 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2035/4052] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:01:18 2022] GET /compute/v2.1/servers/9e44ca00-de7b-4c39-893c-c61b0d845cd1 => generated 1219 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:01:18.714088 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-102758f1-ddbf-4e94-9804-465078234d3e tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:18.719342 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-102758f1-ddbf-4e94-9804-465078234d3e tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] [instance: 307f8788-d4c5-4bdc-9f4a-6cb6112a5b5a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:18.729813 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-102758f1-ddbf-4e94-9804-465078234d3e tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:18.730870 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-102758f1-ddbf-4e94-9804-465078234d3e tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:18.731770 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-102758f1-ddbf-4e94-9804-465078234d3e tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:18.732809 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-102758f1-ddbf-4e94-9804-465078234d3e tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:18.733484 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-102758f1-ddbf-4e94-9804-465078234d3e tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:18.734168 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-102758f1-ddbf-4e94-9804-465078234d3e tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:18.965467 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-102758f1-ddbf-4e94-9804-465078234d3e tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107c58bcdad44bc29802d2588b93e26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827a290de2714759a70c51b12b520321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:18.977873 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-102758f1-ddbf-4e94-9804-465078234d3e tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '107c58bcdad44bc29802d2588b93e26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827a290de2714759a70c51b12b520321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:18.983021 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-102758f1-ddbf-4e94-9804-465078234d3e tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '107c58bcdad44bc29802d2588b93e26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827a290de2714759a70c51b12b520321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:18.992121 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-102758f1-ddbf-4e94-9804-465078234d3e tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] 10.222.0.70 "GET /compute/v2.1/servers/307f8788-d4c5-4bdc-9f4a-6cb6112a5b5a" status: 200 len: 1366 microversion: 2.57 time: 0.294185 Aug 27 03:01:19.000155 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2036/4053] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:01:18 2022] GET /compute/v2.1/servers/307f8788-d4c5-4bdc-9f4a-6cb6112a5b5a => generated 1366 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:01:19.714171 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c271f4bb-0d30-4037-96d9-680678269bca tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:19.715470 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-c271f4bb-0d30-4037-96d9-680678269bca tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] [instance: 9e44ca00-de7b-4c39-893c-c61b0d845cd1] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:19.733844 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c271f4bb-0d30-4037-96d9-680678269bca tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:19.741449 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c271f4bb-0d30-4037-96d9-680678269bca tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:19.742195 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c271f4bb-0d30-4037-96d9-680678269bca tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:19.743224 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c271f4bb-0d30-4037-96d9-680678269bca tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:19.743926 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c271f4bb-0d30-4037-96d9-680678269bca tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:19.744677 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c271f4bb-0d30-4037-96d9-680678269bca tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:20.354132 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-c271f4bb-0d30-4037-96d9-680678269bca tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074fa9d1247548f1b93becab250d4772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8cb23407cc4d5db0379bf5227a0228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:20.367592 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c271f4bb-0d30-4037-96d9-680678269bca tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] 10.222.0.70 "GET /compute/v2.1/servers/9e44ca00-de7b-4c39-893c-c61b0d845cd1" status: 200 len: 1281 microversion: 2.1 time: 0.657293 Aug 27 03:01:20.388827 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-24f1adea-9e14-4d11-a5dd-c8ffed1c5244 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba8b9c3a3644a42b8ec4535345305af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2430b54793364b119690049d8aeea6f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:20.403048 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2037/4054] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:01:19 2022] GET /compute/v2.1/servers/9e44ca00-de7b-4c39-893c-c61b0d845cd1 => generated 1281 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:01:20.407589 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-24f1adea-9e14-4d11-a5dd-c8ffed1c5244 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] 10.222.0.70 "GET /compute/v2.1/servers/343ac6ba-ddb5-469b-8fe1-fbdba6f69ac9" status: 200 len: 1317 microversion: 2.1 time: 1.922528 Aug 27 03:01:20.422716 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2018/4055] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:01:18 2022] GET /compute/v2.1/servers/343ac6ba-ddb5-469b-8fe1-fbdba6f69ac9 => generated 1317 bytes in 1927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:01:20.434104 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-fc525908-8085-468e-8100-6c89f2b4d746 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:20.434786 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-fc525908-8085-468e-8100-6c89f2b4d746 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] [instance: 307f8788-d4c5-4bdc-9f4a-6cb6112a5b5a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:20.456287 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fc525908-8085-468e-8100-6c89f2b4d746 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:20.456855 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fc525908-8085-468e-8100-6c89f2b4d746 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:20.457359 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fc525908-8085-468e-8100-6c89f2b4d746 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:20.458085 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fc525908-8085-468e-8100-6c89f2b4d746 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:20.458540 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fc525908-8085-468e-8100-6c89f2b4d746 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:20.458973 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fc525908-8085-468e-8100-6c89f2b4d746 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:20.595813 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-fc525908-8085-468e-8100-6c89f2b4d746 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107c58bcdad44bc29802d2588b93e26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827a290de2714759a70c51b12b520321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:20.609678 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-fc525908-8085-468e-8100-6c89f2b4d746 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '107c58bcdad44bc29802d2588b93e26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827a290de2714759a70c51b12b520321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:20.616249 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-fc525908-8085-468e-8100-6c89f2b4d746 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '107c58bcdad44bc29802d2588b93e26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827a290de2714759a70c51b12b520321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:20.618996 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-fc525908-8085-468e-8100-6c89f2b4d746 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] 10.222.0.70 "GET /compute/v2.1/servers/307f8788-d4c5-4bdc-9f4a-6cb6112a5b5a" status: 200 len: 1366 microversion: 2.57 time: 0.213993 Aug 27 03:01:20.621500 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2038/4056] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:01:20 2022] GET /compute/v2.1/servers/307f8788-d4c5-4bdc-9f4a-6cb6112a5b5a => generated 1366 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:01:21.398682 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d743eb6e-2724-4a9b-98e5-fa252bf6b6ba tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:21.399300 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d743eb6e-2724-4a9b-98e5-fa252bf6b6ba tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] [instance: 9e44ca00-de7b-4c39-893c-c61b0d845cd1] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:21.411112 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d743eb6e-2724-4a9b-98e5-fa252bf6b6ba tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:21.412174 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d743eb6e-2724-4a9b-98e5-fa252bf6b6ba tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:21.413152 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d743eb6e-2724-4a9b-98e5-fa252bf6b6ba tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:21.426586 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d743eb6e-2724-4a9b-98e5-fa252bf6b6ba tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:21.429256 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d743eb6e-2724-4a9b-98e5-fa252bf6b6ba tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:21.429900 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d743eb6e-2724-4a9b-98e5-fa252bf6b6ba tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:21.433549 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b7dddb75-fefb-4960-9d7e-881774cc8b63 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:21.435395 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b7dddb75-fefb-4960-9d7e-881774cc8b63 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] [instance: 343ac6ba-ddb5-469b-8fe1-fbdba6f69ac9] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:21.447132 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b7dddb75-fefb-4960-9d7e-881774cc8b63 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:21.447666 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b7dddb75-fefb-4960-9d7e-881774cc8b63 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:21.448053 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b7dddb75-fefb-4960-9d7e-881774cc8b63 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:21.449092 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b7dddb75-fefb-4960-9d7e-881774cc8b63 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:21.449226 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b7dddb75-fefb-4960-9d7e-881774cc8b63 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:21.449647 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b7dddb75-fefb-4960-9d7e-881774cc8b63 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:21.891848 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-b7dddb75-fefb-4960-9d7e-881774cc8b63 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba8b9c3a3644a42b8ec4535345305af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2430b54793364b119690049d8aeea6f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:21.908192 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b7dddb75-fefb-4960-9d7e-881774cc8b63 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] 10.222.0.70 "GET /compute/v2.1/servers/343ac6ba-ddb5-469b-8fe1-fbdba6f69ac9" status: 200 len: 1317 microversion: 2.1 time: 0.478320 Aug 27 03:01:21.908785 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2039/4057] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:01:21 2022] GET /compute/v2.1/servers/343ac6ba-ddb5-469b-8fe1-fbdba6f69ac9 => generated 1317 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:01:21.919219 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c2e3e33d-d2a7-4e7b-9999-83b8d9f94796 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:21.919219 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-c2e3e33d-d2a7-4e7b-9999-83b8d9f94796 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] [instance: 307f8788-d4c5-4bdc-9f4a-6cb6112a5b5a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:21.937999 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c2e3e33d-d2a7-4e7b-9999-83b8d9f94796 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:21.941175 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c2e3e33d-d2a7-4e7b-9999-83b8d9f94796 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:21.941732 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c2e3e33d-d2a7-4e7b-9999-83b8d9f94796 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:21.942588 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c2e3e33d-d2a7-4e7b-9999-83b8d9f94796 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:21.944807 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c2e3e33d-d2a7-4e7b-9999-83b8d9f94796 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:21.945583 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c2e3e33d-d2a7-4e7b-9999-83b8d9f94796 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:22.086742 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-c2e3e33d-d2a7-4e7b-9999-83b8d9f94796 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107c58bcdad44bc29802d2588b93e26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827a290de2714759a70c51b12b520321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:22.106839 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-c2e3e33d-d2a7-4e7b-9999-83b8d9f94796 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '107c58bcdad44bc29802d2588b93e26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827a290de2714759a70c51b12b520321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:22.108111 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-d743eb6e-2724-4a9b-98e5-fa252bf6b6ba tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074fa9d1247548f1b93becab250d4772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8cb23407cc4d5db0379bf5227a0228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:22.109105 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-c2e3e33d-d2a7-4e7b-9999-83b8d9f94796 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '107c58bcdad44bc29802d2588b93e26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827a290de2714759a70c51b12b520321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:22.111837 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c2e3e33d-d2a7-4e7b-9999-83b8d9f94796 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] 10.222.0.70 "GET /compute/v2.1/servers/307f8788-d4c5-4bdc-9f4a-6cb6112a5b5a" status: 200 len: 1366 microversion: 2.57 time: 0.202054 Aug 27 03:01:22.113102 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2040/4058] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:01:21 2022] GET /compute/v2.1/servers/307f8788-d4c5-4bdc-9f4a-6cb6112a5b5a => generated 1366 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:01:22.127479 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d743eb6e-2724-4a9b-98e5-fa252bf6b6ba tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] 10.222.0.70 "GET /compute/v2.1/servers/9e44ca00-de7b-4c39-893c-c61b0d845cd1" status: 200 len: 1323 microversion: 2.1 time: 0.733063 Aug 27 03:01:22.128945 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2019/4059] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:01:21 2022] GET /compute/v2.1/servers/9e44ca00-de7b-4c39-893c-c61b0d845cd1 => generated 1323 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:01:22.615040 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-4dd258c8-2be9-4bfc-a189-4a0012bb3d59 req-3c42cc5f-f5db-47d5-9d41-2c3240b3280d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "343ac6ba-ddb5-469b-8fe1-fbdba6f69ac9", "name": "network-vif-plugged", "status": "completed", "tag": "231041ff-643a-451f-9000-8f5274da957d"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:01:22.631404 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-4dd258c8-2be9-4bfc-a189-4a0012bb3d59 req-3c42cc5f-f5db-47d5-9d41-2c3240b3280d service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:22.638511 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-4dd258c8-2be9-4bfc-a189-4a0012bb3d59 req-3c42cc5f-f5db-47d5-9d41-2c3240b3280d service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:22.639333 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-4dd258c8-2be9-4bfc-a189-4a0012bb3d59 req-3c42cc5f-f5db-47d5-9d41-2c3240b3280d service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:22.670538 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-4dd258c8-2be9-4bfc-a189-4a0012bb3d59 req-3c42cc5f-f5db-47d5-9d41-2c3240b3280d service nova] Creating event network-vif-plugged:231041ff-643a-451f-9000-8f5274da957d for instance 343ac6ba-ddb5-469b-8fe1-fbdba6f69ac9 on n-h1-852278-4 Aug 27 03:01:22.682379 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-4dd258c8-2be9-4bfc-a189-4a0012bb3d59 req-3c42cc5f-f5db-47d5-9d41-2c3240b3280d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.182208 Aug 27 03:01:22.685139 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2041/4060] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:01:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:01:22.931383 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-084941f3-74fe-49d3-b09a-7309b8a4ea2c tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:22.932844 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-084941f3-74fe-49d3-b09a-7309b8a4ea2c tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] [instance: 343ac6ba-ddb5-469b-8fe1-fbdba6f69ac9] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:22.953154 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-084941f3-74fe-49d3-b09a-7309b8a4ea2c tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:22.953941 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-084941f3-74fe-49d3-b09a-7309b8a4ea2c tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:22.954549 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-084941f3-74fe-49d3-b09a-7309b8a4ea2c tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:22.955458 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-084941f3-74fe-49d3-b09a-7309b8a4ea2c tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:22.956792 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-084941f3-74fe-49d3-b09a-7309b8a4ea2c tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:22.962413 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-084941f3-74fe-49d3-b09a-7309b8a4ea2c tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:23.147286 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-2d401ab3-b8b4-46c8-92c7-e17d5098114a tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:23.148697 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-2d401ab3-b8b4-46c8-92c7-e17d5098114a tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] [instance: 307f8788-d4c5-4bdc-9f4a-6cb6112a5b5a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:23.164889 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2d401ab3-b8b4-46c8-92c7-e17d5098114a tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:23.168578 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2d401ab3-b8b4-46c8-92c7-e17d5098114a tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:23.171322 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2d401ab3-b8b4-46c8-92c7-e17d5098114a tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:23.174056 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2d401ab3-b8b4-46c8-92c7-e17d5098114a tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:23.174787 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2d401ab3-b8b4-46c8-92c7-e17d5098114a tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:23.178640 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2d401ab3-b8b4-46c8-92c7-e17d5098114a tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:23.351611 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-2d401ab3-b8b4-46c8-92c7-e17d5098114a tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107c58bcdad44bc29802d2588b93e26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827a290de2714759a70c51b12b520321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:23.364075 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-2d401ab3-b8b4-46c8-92c7-e17d5098114a tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '107c58bcdad44bc29802d2588b93e26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827a290de2714759a70c51b12b520321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:23.365689 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-2d401ab3-b8b4-46c8-92c7-e17d5098114a tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '107c58bcdad44bc29802d2588b93e26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827a290de2714759a70c51b12b520321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:23.379011 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-2d401ab3-b8b4-46c8-92c7-e17d5098114a tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] 10.222.0.70 "GET /compute/v2.1/servers/307f8788-d4c5-4bdc-9f4a-6cb6112a5b5a" status: 200 len: 1366 microversion: 2.57 time: 0.242296 Aug 27 03:01:23.381579 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2042/4061] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:01:23 2022] GET /compute/v2.1/servers/307f8788-d4c5-4bdc-9f4a-6cb6112a5b5a => generated 1366 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:01:23.402231 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-da1e1c93-2489-4f52-ace5-f1a8b2fa33b2 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:23.404297 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-da1e1c93-2489-4f52-ace5-f1a8b2fa33b2 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] [instance: 9e44ca00-de7b-4c39-893c-c61b0d845cd1] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:23.424801 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-da1e1c93-2489-4f52-ace5-f1a8b2fa33b2 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:23.428875 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-da1e1c93-2489-4f52-ace5-f1a8b2fa33b2 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:23.431577 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-da1e1c93-2489-4f52-ace5-f1a8b2fa33b2 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:23.434767 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-da1e1c93-2489-4f52-ace5-f1a8b2fa33b2 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:23.436846 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-da1e1c93-2489-4f52-ace5-f1a8b2fa33b2 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:23.437359 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-da1e1c93-2489-4f52-ace5-f1a8b2fa33b2 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:23.556967 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-084941f3-74fe-49d3-b09a-7309b8a4ea2c tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba8b9c3a3644a42b8ec4535345305af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2430b54793364b119690049d8aeea6f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:23.572803 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-084941f3-74fe-49d3-b09a-7309b8a4ea2c tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] 10.222.0.70 "GET /compute/v2.1/servers/343ac6ba-ddb5-469b-8fe1-fbdba6f69ac9" status: 200 len: 1317 microversion: 2.1 time: 0.645714 Aug 27 03:01:23.579658 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2020/4062] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:01:22 2022] GET /compute/v2.1/servers/343ac6ba-ddb5-469b-8fe1-fbdba6f69ac9 => generated 1317 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:01:23.611424 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-dbf2add8-fcc7-43e1-984a-c25799f44fad req-999d7fd3-b634-4d9f-b608-260fd245b403 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e44ca00-de7b-4c39-893c-c61b0d845cd1", "tag": "8445b37e-80d1-4feb-9fbc-fa886c48c08c"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:01:23.635263 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-dbf2add8-fcc7-43e1-984a-c25799f44fad req-999d7fd3-b634-4d9f-b608-260fd245b403 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:23.637067 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-dbf2add8-fcc7-43e1-984a-c25799f44fad req-999d7fd3-b634-4d9f-b608-260fd245b403 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:23.638584 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-dbf2add8-fcc7-43e1-984a-c25799f44fad req-999d7fd3-b634-4d9f-b608-260fd245b403 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:23.689599 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-dbf2add8-fcc7-43e1-984a-c25799f44fad req-999d7fd3-b634-4d9f-b608-260fd245b403 service nova] Creating event network-changed:8445b37e-80d1-4feb-9fbc-fa886c48c08c for instance 9e44ca00-de7b-4c39-893c-c61b0d845cd1 on n-h2-852278-4 Aug 27 03:01:23.708881 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-dbf2add8-fcc7-43e1-984a-c25799f44fad req-999d7fd3-b634-4d9f-b608-260fd245b403 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102660 Aug 27 03:01:23.711635 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2021/4063] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:01:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:01:23.907506 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-da1e1c93-2489-4f52-ace5-f1a8b2fa33b2 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074fa9d1247548f1b93becab250d4772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8cb23407cc4d5db0379bf5227a0228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:23.918820 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-da1e1c93-2489-4f52-ace5-f1a8b2fa33b2 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] 10.222.0.70 "GET /compute/v2.1/servers/9e44ca00-de7b-4c39-893c-c61b0d845cd1" status: 200 len: 1323 microversion: 2.1 time: 0.536106 Aug 27 03:01:23.919410 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2043/4064] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:01:23 2022] GET /compute/v2.1/servers/9e44ca00-de7b-4c39-893c-c61b0d845cd1 => generated 1323 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:01:24.410095 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ab90eb00-4455-4b58-827c-d762ae6a43d9 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:24.410804 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-ab90eb00-4455-4b58-827c-d762ae6a43d9 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] [instance: 307f8788-d4c5-4bdc-9f4a-6cb6112a5b5a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:24.425540 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ab90eb00-4455-4b58-827c-d762ae6a43d9 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:24.426503 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ab90eb00-4455-4b58-827c-d762ae6a43d9 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:24.427283 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ab90eb00-4455-4b58-827c-d762ae6a43d9 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:24.428747 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ab90eb00-4455-4b58-827c-d762ae6a43d9 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:24.429637 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ab90eb00-4455-4b58-827c-d762ae6a43d9 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:24.430307 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ab90eb00-4455-4b58-827c-d762ae6a43d9 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:24.569117 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-ab90eb00-4455-4b58-827c-d762ae6a43d9 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107c58bcdad44bc29802d2588b93e26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827a290de2714759a70c51b12b520321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:24.595068 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b154084a-dcbb-433a-b7a5-75965bb74ef0 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:24.596215 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b154084a-dcbb-433a-b7a5-75965bb74ef0 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] [instance: 343ac6ba-ddb5-469b-8fe1-fbdba6f69ac9] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:24.606077 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-ab90eb00-4455-4b58-827c-d762ae6a43d9 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '107c58bcdad44bc29802d2588b93e26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827a290de2714759a70c51b12b520321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:24.607570 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-ab90eb00-4455-4b58-827c-d762ae6a43d9 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '107c58bcdad44bc29802d2588b93e26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827a290de2714759a70c51b12b520321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:24.609316 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b154084a-dcbb-433a-b7a5-75965bb74ef0 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:24.611910 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b154084a-dcbb-433a-b7a5-75965bb74ef0 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:24.612587 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b154084a-dcbb-433a-b7a5-75965bb74ef0 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:24.614167 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ab90eb00-4455-4b58-827c-d762ae6a43d9 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] 10.222.0.70 "GET /compute/v2.1/servers/307f8788-d4c5-4bdc-9f4a-6cb6112a5b5a" status: 200 len: 1366 microversion: 2.57 time: 0.206557 Aug 27 03:01:24.615549 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b154084a-dcbb-433a-b7a5-75965bb74ef0 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:24.616199 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b154084a-dcbb-433a-b7a5-75965bb74ef0 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:24.617143 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b154084a-dcbb-433a-b7a5-75965bb74ef0 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:24.617424 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2022/4065] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:01:24 2022] GET /compute/v2.1/servers/307f8788-d4c5-4bdc-9f4a-6cb6112a5b5a => generated 1366 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:01:24.908488 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-b154084a-dcbb-433a-b7a5-75965bb74ef0 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba8b9c3a3644a42b8ec4535345305af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2430b54793364b119690049d8aeea6f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:24.926890 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b154084a-dcbb-433a-b7a5-75965bb74ef0 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] 10.222.0.70 "GET /compute/v2.1/servers/343ac6ba-ddb5-469b-8fe1-fbdba6f69ac9" status: 200 len: 1505 microversion: 2.1 time: 0.336220 Aug 27 03:01:24.927668 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2044/4066] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:01:24 2022] GET /compute/v2.1/servers/343ac6ba-ddb5-469b-8fe1-fbdba6f69ac9 => generated 1505 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:01:24.953202 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b6749d04-fb1d-48cc-b8a1-d2d29a91e1db tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:24.953845 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b6749d04-fb1d-48cc-b8a1-d2d29a91e1db tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] [instance: 343ac6ba-ddb5-469b-8fe1-fbdba6f69ac9] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:24.961126 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-69ae7591-607d-4009-a0ba-a75bf27d0789 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:24.963334 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b6749d04-fb1d-48cc-b8a1-d2d29a91e1db tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:24.964106 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-69ae7591-607d-4009-a0ba-a75bf27d0789 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] [instance: 9e44ca00-de7b-4c39-893c-c61b0d845cd1] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:24.977957 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b6749d04-fb1d-48cc-b8a1-d2d29a91e1db tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:24.980134 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b6749d04-fb1d-48cc-b8a1-d2d29a91e1db tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:24.982606 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b6749d04-fb1d-48cc-b8a1-d2d29a91e1db tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:24.984638 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b6749d04-fb1d-48cc-b8a1-d2d29a91e1db tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:24.986595 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-69ae7591-607d-4009-a0ba-a75bf27d0789 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:24.987207 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-69ae7591-607d-4009-a0ba-a75bf27d0789 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:24.987476 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b6749d04-fb1d-48cc-b8a1-d2d29a91e1db tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:24.991718 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-69ae7591-607d-4009-a0ba-a75bf27d0789 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:24.994144 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-69ae7591-607d-4009-a0ba-a75bf27d0789 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:24.995724 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-69ae7591-607d-4009-a0ba-a75bf27d0789 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:24.999849 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-69ae7591-607d-4009-a0ba-a75bf27d0789 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:25.065118 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b6749d04-fb1d-48cc-b8a1-d2d29a91e1db tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] 10.222.0.70 "GET /compute/v2.1/servers/343ac6ba-ddb5-469b-8fe1-fbdba6f69ac9/ips" status: 200 len: 108 microversion: 2.1 time: 0.115597 Aug 27 03:01:25.076245 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2045/4067] 10.222.0.70 () {58 vars in 1248 bytes} [Sat Aug 27 03:01:24 2022] GET /compute/v2.1/servers/343ac6ba-ddb5-469b-8fe1-fbdba6f69ac9/ips => generated 108 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:01:25.089038 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7efa53a1-4621-4e70-9295-9fabd8c63018 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:25.092004 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-7efa53a1-4621-4e70-9295-9fabd8c63018 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] [instance: 343ac6ba-ddb5-469b-8fe1-fbdba6f69ac9] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:25.103852 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7efa53a1-4621-4e70-9295-9fabd8c63018 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:25.107855 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7efa53a1-4621-4e70-9295-9fabd8c63018 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:25.107855 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7efa53a1-4621-4e70-9295-9fabd8c63018 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:25.107855 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7efa53a1-4621-4e70-9295-9fabd8c63018 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:25.107855 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7efa53a1-4621-4e70-9295-9fabd8c63018 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:25.107855 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7efa53a1-4621-4e70-9295-9fabd8c63018 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:25.164065 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-7efa53a1-4621-4e70-9295-9fabd8c63018 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] 10.222.0.70 "GET /compute/v2.1/servers/343ac6ba-ddb5-469b-8fe1-fbdba6f69ac9/ips" status: 200 len: 108 microversion: 2.1 time: 0.086471 Aug 27 03:01:25.167039 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2046/4068] 10.222.0.70 () {58 vars in 1248 bytes} [Sat Aug 27 03:01:25 2022] GET /compute/v2.1/servers/343ac6ba-ddb5-469b-8fe1-fbdba6f69ac9/ips => generated 108 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:01:25.185038 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b6c14b3a-399e-4b6e-ab07-75a52738a0cf tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:25.187231 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b6c14b3a-399e-4b6e-ab07-75a52738a0cf tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] [instance: 343ac6ba-ddb5-469b-8fe1-fbdba6f69ac9] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:25.202743 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b6c14b3a-399e-4b6e-ab07-75a52738a0cf tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:25.203560 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b6c14b3a-399e-4b6e-ab07-75a52738a0cf tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:25.204189 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b6c14b3a-399e-4b6e-ab07-75a52738a0cf tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:25.207193 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b6c14b3a-399e-4b6e-ab07-75a52738a0cf tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:25.208009 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b6c14b3a-399e-4b6e-ab07-75a52738a0cf tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:25.210741 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b6c14b3a-399e-4b6e-ab07-75a52738a0cf tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:25.270961 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b6c14b3a-399e-4b6e-ab07-75a52738a0cf tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] 10.222.0.70 "GET /compute/v2.1/servers/343ac6ba-ddb5-469b-8fe1-fbdba6f69ac9/ips/tempest-ServerAddressesTestJSON-146473528-network" status: 200 len: 93 microversion: 2.1 time: 0.094401 Aug 27 03:01:25.280803 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2047/4069] 10.222.0.70 () {58 vars in 1398 bytes} [Sat Aug 27 03:01:25 2022] GET /compute/v2.1/servers/343ac6ba-ddb5-469b-8fe1-fbdba6f69ac9/ips/tempest-ServerAddressesTestJSON-146473528-network => generated 93 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:01:25.288537 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-2073a8b5-71c1-4e2c-bfa2-b3532c8e0859 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:25.293935 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-2073a8b5-71c1-4e2c-bfa2-b3532c8e0859 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] [instance: 343ac6ba-ddb5-469b-8fe1-fbdba6f69ac9] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:25.307031 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2073a8b5-71c1-4e2c-bfa2-b3532c8e0859 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:25.309357 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2073a8b5-71c1-4e2c-bfa2-b3532c8e0859 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:25.309996 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2073a8b5-71c1-4e2c-bfa2-b3532c8e0859 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:25.310176 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-69ae7591-607d-4009-a0ba-a75bf27d0789 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074fa9d1247548f1b93becab250d4772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8cb23407cc4d5db0379bf5227a0228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:25.313117 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2073a8b5-71c1-4e2c-bfa2-b3532c8e0859 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:25.314619 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2073a8b5-71c1-4e2c-bfa2-b3532c8e0859 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:25.317645 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2073a8b5-71c1-4e2c-bfa2-b3532c8e0859 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:25.324682 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-69ae7591-607d-4009-a0ba-a75bf27d0789 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] 10.222.0.70 "GET /compute/v2.1/servers/9e44ca00-de7b-4c39-893c-c61b0d845cd1" status: 200 len: 1323 microversion: 2.1 time: 0.374047 Aug 27 03:01:25.325773 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2023/4070] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:01:24 2022] GET /compute/v2.1/servers/9e44ca00-de7b-4c39-893c-c61b0d845cd1 => generated 1323 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:01:25.386186 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-2073a8b5-71c1-4e2c-bfa2-b3532c8e0859 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] [instance: 343ac6ba-ddb5-469b-8fe1-fbdba6f69ac9] Going to try to terminate instance {{(pid=134051) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:01:25.422777 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=100 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:01:25.540017 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-2073a8b5-71c1-4e2c-bfa2-b3532c8e0859 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] 10.222.0.70 "DELETE /compute/v2.1/servers/343ac6ba-ddb5-469b-8fe1-fbdba6f69ac9" status: 204 len: 0 microversion: 2.1 time: 0.253506 Aug 27 03:01:25.540017 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2048/4071] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 03:01:25 2022] DELETE /compute/v2.1/servers/343ac6ba-ddb5-469b-8fe1-fbdba6f69ac9 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:01:25.551525 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3edff142-b1a0-4613-a809-3d3feee81619 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:25.552347 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-3edff142-b1a0-4613-a809-3d3feee81619 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] [instance: 343ac6ba-ddb5-469b-8fe1-fbdba6f69ac9] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:25.571741 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3edff142-b1a0-4613-a809-3d3feee81619 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:25.577359 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3edff142-b1a0-4613-a809-3d3feee81619 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:25.577973 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3edff142-b1a0-4613-a809-3d3feee81619 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:25.578805 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3edff142-b1a0-4613-a809-3d3feee81619 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:25.579333 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3edff142-b1a0-4613-a809-3d3feee81619 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:25.579818 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3edff142-b1a0-4613-a809-3d3feee81619 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:25.645754 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-2bf13d43-2134-4027-8cad-714cb874c5d2 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:25.646370 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-2bf13d43-2134-4027-8cad-714cb874c5d2 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] [instance: 307f8788-d4c5-4bdc-9f4a-6cb6112a5b5a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:25.657665 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2bf13d43-2134-4027-8cad-714cb874c5d2 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:25.658158 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2bf13d43-2134-4027-8cad-714cb874c5d2 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:25.658596 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2bf13d43-2134-4027-8cad-714cb874c5d2 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:25.659320 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2bf13d43-2134-4027-8cad-714cb874c5d2 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:25.685514 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2bf13d43-2134-4027-8cad-714cb874c5d2 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:25.688299 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2bf13d43-2134-4027-8cad-714cb874c5d2 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:25.871809 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-2bf13d43-2134-4027-8cad-714cb874c5d2 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107c58bcdad44bc29802d2588b93e26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827a290de2714759a70c51b12b520321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:25.884745 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-2bf13d43-2134-4027-8cad-714cb874c5d2 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '107c58bcdad44bc29802d2588b93e26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827a290de2714759a70c51b12b520321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:25.888710 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-2bf13d43-2134-4027-8cad-714cb874c5d2 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '107c58bcdad44bc29802d2588b93e26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827a290de2714759a70c51b12b520321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:25.891560 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-2bf13d43-2134-4027-8cad-714cb874c5d2 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] 10.222.0.70 "GET /compute/v2.1/servers/307f8788-d4c5-4bdc-9f4a-6cb6112a5b5a" status: 200 len: 1372 microversion: 2.57 time: 0.250342 Aug 27 03:01:25.895953 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2049/4072] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:01:25 2022] GET /compute/v2.1/servers/307f8788-d4c5-4bdc-9f4a-6cb6112a5b5a => generated 1372 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:01:25.977084 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-3edff142-b1a0-4613-a809-3d3feee81619 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba8b9c3a3644a42b8ec4535345305af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2430b54793364b119690049d8aeea6f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:25.990732 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-3edff142-b1a0-4613-a809-3d3feee81619 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] 10.222.0.70 "GET /compute/v2.1/servers/343ac6ba-ddb5-469b-8fe1-fbdba6f69ac9" status: 200 len: 1511 microversion: 2.1 time: 0.447447 Aug 27 03:01:26.004644 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2024/4073] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:01:25 2022] GET /compute/v2.1/servers/343ac6ba-ddb5-469b-8fe1-fbdba6f69ac9 => generated 1511 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:01:26.268005 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e77da9f2-4db2-4123-8e2c-9f9c6b3b9d16 tempest-MultipleCreateNegativeTestJSON-1421714546 tempest-MultipleCreateNegativeTestJSON-1421714546-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1005681355", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:01:26.273932 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-e77da9f2-4db2-4123-8e2c-9f9c6b3b9d16 tempest-MultipleCreateNegativeTestJSON-1421714546 tempest-MultipleCreateNegativeTestJSON-1421714546-project] HTTP exception thrown: min_count must be <= max_count Aug 27 03:01:26.275827 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e77da9f2-4db2-4123-8e2c-9f9c6b3b9d16 tempest-MultipleCreateNegativeTestJSON-1421714546 tempest-MultipleCreateNegativeTestJSON-1421714546-project] Request method failure captured: Aug 27 03:01:26.275827 n-d-852278-4 devstack@n-api.service[134051]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 03:01:26.275827 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 03:01:26.275827 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 03:01:26.275827 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 03:01:26.275827 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 184 Aug 27 03:01:26.275827 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 03:01:26.275827 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 03:01:26.275827 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 03:01:26.275827 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 03:01:26.275827 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYkF_mX6ICPexPrq0NgRMkzNTx87SC7CF6TtZJwI7voCPzJBpSdazt9sCg6PYXJhMc7orNTG8wLAzZhTwzgkISpOl5aYWlwEJzMaugAEXdC-dXGPm_e6JBGVHvuQTqn71CMNrLX17Vct0fyd6BQbA19cqT14CsurX_8kgOBBEdmyGsI Aug 27 03:01:26.275827 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 03:01:26.275827 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 03:01:26.275827 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 03:01:26.275827 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 03:01:26.275827 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 03:01:26.275827 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 03:01:26.275827 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 33529c36a6dd4ef8a4f80e058be5abf9 Aug 27 03:01:26.275827 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1421714546 Aug 27 03:01:26.275827 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 03:01:26.275827 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 03:01:26.275827 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/33529c36a6dd4ef8a4f80e058be5abf9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_33529c36a6dd4ef8a4f80e058be5abf9", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/33529c36a6dd4ef8a4f80e058be5abf9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/33529c36a6dd4ef8a4f80e058be5abf9"}]}] Aug 27 03:01:26.275827 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1421714546 Aug 27 03:01:26.275827 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 33529c36a6dd4ef8a4f80e058be5abf9 Aug 27 03:01:26.275827 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1421714546 Aug 27 03:01:26.275827 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-MultipleCreateNegativeTestJSON-1421714546-project Aug 27 03:01:26.275827 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 03:01:26.275827 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 03:01:26.275827 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: a7d7a0080e7340febab4ae18c737e02b Aug 27 03:01:26.275827 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1421714546-project Aug 27 03:01:26.275827 n-d-852278-4 devstack@n-api.service[134051]: Aug 27 03:01:26.275827 n-d-852278-4 devstack@n-api.service[134051]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1005681355", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "min_count": 3, "max_count": 2}} Aug 27 03:01:26.275827 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 03:01:26.275827 n-d-852278-4 devstack@n-api.service[134051]: exception: min_count must be <= max_count Aug 27 03:01:26.275827 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1005681355', 'imageRef': '1552acd0-176a-4c81-b680-29d74105e9d6', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Aug 27 03:01:26.275827 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:01:26.275827 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:01:26.275827 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:01:26.275827 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:01:26.275827 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:01:26.275827 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:01:26.275827 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:01:26.275827 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:01:26.275827 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:01:26.275827 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:01:26.275827 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:01:26.275827 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:01:26.275827 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:01:26.275827 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:01:26.275827 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 27 03:01:26.275827 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Aug 27 03:01:26.275827 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 27 03:01:26.275827 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Aug 27 03:01:26.275827 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:01:26.275827 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:01:26.275827 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:01:26.275827 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:01:26.275827 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:01:26.275827 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:01:26.275827 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:01:26.275827 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:01:26.275827 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Aug 27 03:01:26.275827 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:01:26.283384 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e77da9f2-4db2-4123-8e2c-9f9c6b3b9d16 tempest-MultipleCreateNegativeTestJSON-1421714546 tempest-MultipleCreateNegativeTestJSON-1421714546-project] Returning 400 to user: min_count must be <= max_count {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:01:26.284529 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e77da9f2-4db2-4123-8e2c-9f9c6b3b9d16 tempest-MultipleCreateNegativeTestJSON-1421714546 tempest-MultipleCreateNegativeTestJSON-1421714546-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.223171 Aug 27 03:01:26.285184 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2050/4074] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 03:01:26 2022] POST /compute/v2.1/servers => generated 74 bytes in 225 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 27 03:01:26.347848 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-78bb5ae5-44e3-4ca1-bcf7-cebbc3d6b152 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:26.348633 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-78bb5ae5-44e3-4ca1-bcf7-cebbc3d6b152 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] [instance: 9e44ca00-de7b-4c39-893c-c61b0d845cd1] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:26.376301 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-78bb5ae5-44e3-4ca1-bcf7-cebbc3d6b152 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:26.376921 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-78bb5ae5-44e3-4ca1-bcf7-cebbc3d6b152 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:26.377682 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-78bb5ae5-44e3-4ca1-bcf7-cebbc3d6b152 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:26.378657 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-78bb5ae5-44e3-4ca1-bcf7-cebbc3d6b152 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:26.379401 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-78bb5ae5-44e3-4ca1-bcf7-cebbc3d6b152 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:26.379988 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-78bb5ae5-44e3-4ca1-bcf7-cebbc3d6b152 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:26.506541 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-87afb78f-8f94-4776-a337-c3f0721c0019 tempest-MultipleCreateNegativeTestJSON-1421714546 tempest-MultipleCreateNegativeTestJSON-1421714546-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1894733931", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "max_count": 0}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:01:26.511010 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-87afb78f-8f94-4776-a337-c3f0721c0019 tempest-MultipleCreateNegativeTestJSON-1421714546 tempest-MultipleCreateNegativeTestJSON-1421714546-project] Request method failure captured: Aug 27 03:01:26.511010 n-d-852278-4 devstack@n-api.service[134051]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 03:01:26.511010 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 03:01:26.511010 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 03:01:26.511010 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 03:01:26.511010 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 168 Aug 27 03:01:26.511010 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 03:01:26.511010 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 03:01:26.511010 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 03:01:26.511010 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 03:01:26.511010 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYkF_mX6ICPexPrq0NgRMkzNTx87SC7CF6TtZJwI7voCPzJBpSdazt9sCg6PYXJhMc7orNTG8wLAzZhTwzgkISpOl5aYWlwEJzMaugAEXdC-dXGPm_e6JBGVHvuQTqn71CMNrLX17Vct0fyd6BQbA19cqT14CsurX_8kgOBBEdmyGsI Aug 27 03:01:26.511010 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 03:01:26.511010 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 03:01:26.511010 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 03:01:26.511010 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 03:01:26.511010 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 03:01:26.511010 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 03:01:26.511010 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 33529c36a6dd4ef8a4f80e058be5abf9 Aug 27 03:01:26.511010 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1421714546 Aug 27 03:01:26.511010 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 03:01:26.511010 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 03:01:26.511010 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/33529c36a6dd4ef8a4f80e058be5abf9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_33529c36a6dd4ef8a4f80e058be5abf9", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/33529c36a6dd4ef8a4f80e058be5abf9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/33529c36a6dd4ef8a4f80e058be5abf9"}]}] Aug 27 03:01:26.511010 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1421714546 Aug 27 03:01:26.511010 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 33529c36a6dd4ef8a4f80e058be5abf9 Aug 27 03:01:26.511010 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1421714546 Aug 27 03:01:26.511010 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-MultipleCreateNegativeTestJSON-1421714546-project Aug 27 03:01:26.511010 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 03:01:26.511010 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 03:01:26.511010 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: a7d7a0080e7340febab4ae18c737e02b Aug 27 03:01:26.511010 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1421714546-project Aug 27 03:01:26.511010 n-d-852278-4 devstack@n-api.service[134051]: Aug 27 03:01:26.511010 n-d-852278-4 devstack@n-api.service[134051]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1894733931", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "max_count": 0}} Aug 27 03:01:26.511010 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 03:01:26.511010 n-d-852278-4 devstack@n-api.service[134051]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 27 03:01:26.511010 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1894733931', 'imageRef': '1552acd0-176a-4c81-b680-29d74105e9d6', 'flavorRef': '452', 'max_count': 0}}} Aug 27 03:01:26.511010 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:01:26.511010 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:01:26.511010 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 03:01:26.511010 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 03:01:26.511010 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 03:01:26.511010 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise error Aug 27 03:01:26.511010 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 27 03:01:26.511010 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:01:26.511010 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Aug 27 03:01:26.511010 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 27 03:01:26.511010 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 27 03:01:26.511010 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 27 03:01:26.511010 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 27 03:01:26.511010 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:01:26.511010 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 27 03:01:26.511010 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi 0 Aug 27 03:01:26.511010 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:01:26.511010 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:01:26.511010 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:01:26.511010 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:01:26.511010 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:01:26.511010 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:01:26.511010 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:01:26.511010 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:01:26.511010 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:01:26.511010 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:01:26.511010 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:01:26.511010 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:01:26.511010 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 03:01:26.511010 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 03:01:26.522693 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 03:01:26.522693 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 03:01:26.522693 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 03:01:26.522693 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 03:01:26.522693 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 27 03:01:26.522693 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:01:26.522693 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:01:26.522693 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:01:26.522693 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:01:26.522693 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:01:26.522693 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:01:26.522693 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 03:01:26.522693 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 03:01:26.522693 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 27 03:01:26.522693 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:01:26.522693 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-87afb78f-8f94-4776-a337-c3f0721c0019 tempest-MultipleCreateNegativeTestJSON-1421714546 tempest-MultipleCreateNegativeTestJSON-1421714546-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:01:26.522693 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-87afb78f-8f94-4776-a337-c3f0721c0019 tempest-MultipleCreateNegativeTestJSON-1421714546 tempest-MultipleCreateNegativeTestJSON-1421714546-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.010943 Aug 27 03:01:26.522693 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2051/4075] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 03:01:26 2022] POST /compute/v2.1/servers => generated 130 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 27 03:01:26.579295 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c66bc259-b627-4ba6-a452-e0777be78d6b tempest-MultipleCreateNegativeTestJSON-1421714546 tempest-MultipleCreateNegativeTestJSON-1421714546-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1262860247", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "max_count": 2.5}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:01:26.583778 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c66bc259-b627-4ba6-a452-e0777be78d6b tempest-MultipleCreateNegativeTestJSON-1421714546 tempest-MultipleCreateNegativeTestJSON-1421714546-project] Request method failure captured: Aug 27 03:01:26.583778 n-d-852278-4 devstack@n-api.service[134051]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 03:01:26.583778 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 03:01:26.583778 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 03:01:26.583778 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 03:01:26.583778 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 170 Aug 27 03:01:26.583778 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 03:01:26.583778 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 03:01:26.583778 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 03:01:26.583778 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 03:01:26.583778 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYkF_mX6ICPexPrq0NgRMkzNTx87SC7CF6TtZJwI7voCPzJBpSdazt9sCg6PYXJhMc7orNTG8wLAzZhTwzgkISpOl5aYWlwEJzMaugAEXdC-dXGPm_e6JBGVHvuQTqn71CMNrLX17Vct0fyd6BQbA19cqT14CsurX_8kgOBBEdmyGsI Aug 27 03:01:26.583778 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 03:01:26.583778 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 03:01:26.583778 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 03:01:26.583778 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 03:01:26.583778 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 03:01:26.583778 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 03:01:26.583778 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 33529c36a6dd4ef8a4f80e058be5abf9 Aug 27 03:01:26.583778 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1421714546 Aug 27 03:01:26.583778 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 03:01:26.583778 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 03:01:26.583778 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/33529c36a6dd4ef8a4f80e058be5abf9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_33529c36a6dd4ef8a4f80e058be5abf9", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/33529c36a6dd4ef8a4f80e058be5abf9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/33529c36a6dd4ef8a4f80e058be5abf9"}]}] Aug 27 03:01:26.583778 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1421714546 Aug 27 03:01:26.583778 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 33529c36a6dd4ef8a4f80e058be5abf9 Aug 27 03:01:26.583778 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1421714546 Aug 27 03:01:26.583778 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-MultipleCreateNegativeTestJSON-1421714546-project Aug 27 03:01:26.583778 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 03:01:26.583778 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 03:01:26.583778 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: a7d7a0080e7340febab4ae18c737e02b Aug 27 03:01:26.583778 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1421714546-project Aug 27 03:01:26.583778 n-d-852278-4 devstack@n-api.service[134051]: Aug 27 03:01:26.583778 n-d-852278-4 devstack@n-api.service[134051]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1262860247", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "max_count": 2.5}} Aug 27 03:01:26.583778 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 03:01:26.583778 n-d-852278-4 devstack@n-api.service[134051]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 27 03:01:26.583778 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1262860247', 'imageRef': '1552acd0-176a-4c81-b680-29d74105e9d6', 'flavorRef': '452', 'max_count': 2.5}}} Aug 27 03:01:26.583778 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:01:26.583778 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:01:26.583778 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 03:01:26.583778 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 03:01:26.583778 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 03:01:26.583778 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise error Aug 27 03:01:26.583778 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Aug 27 03:01:26.583778 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:01:26.583778 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Aug 27 03:01:26.583778 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 27 03:01:26.583778 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 27 03:01:26.583778 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 27 03:01:26.583778 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 27 03:01:26.583778 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:01:26.583778 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 27 03:01:26.583778 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi 2.5 Aug 27 03:01:26.583778 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:01:26.583778 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:01:26.583778 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:01:26.583778 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:01:26.583778 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:01:26.583778 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:01:26.583778 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:01:26.583778 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:01:26.583778 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:01:26.583778 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:01:26.583778 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:01:26.583778 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:01:26.583778 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 03:01:26.583778 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 03:01:26.588732 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 03:01:26.588732 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 03:01:26.588732 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 03:01:26.588732 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 03:01:26.588732 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 27 03:01:26.588732 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:01:26.588732 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:01:26.588732 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:01:26.588732 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:01:26.588732 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:01:26.588732 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:01:26.588732 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 03:01:26.588732 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 03:01:26.588732 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 27 03:01:26.588732 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:01:26.588732 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c66bc259-b627-4ba6-a452-e0777be78d6b tempest-MultipleCreateNegativeTestJSON-1421714546 tempest-MultipleCreateNegativeTestJSON-1421714546-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:01:26.590908 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c66bc259-b627-4ba6-a452-e0777be78d6b tempest-MultipleCreateNegativeTestJSON-1421714546 tempest-MultipleCreateNegativeTestJSON-1421714546-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.017555 Aug 27 03:01:26.591512 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2052/4076] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 03:01:26 2022] POST /compute/v2.1/servers => generated 139 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 27 03:01:26.650492 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-eaf2b06b-28cb-4777-b721-e67078af2507 tempest-MultipleCreateNegativeTestJSON-1421714546 tempest-MultipleCreateNegativeTestJSON-1421714546-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2084445737", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "min_count": 0}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:01:26.654483 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-eaf2b06b-28cb-4777-b721-e67078af2507 tempest-MultipleCreateNegativeTestJSON-1421714546 tempest-MultipleCreateNegativeTestJSON-1421714546-project] Request method failure captured: Aug 27 03:01:26.654483 n-d-852278-4 devstack@n-api.service[134051]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 03:01:26.654483 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 03:01:26.654483 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 03:01:26.654483 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 03:01:26.654483 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 168 Aug 27 03:01:26.654483 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 03:01:26.654483 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 03:01:26.654483 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 03:01:26.654483 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 03:01:26.654483 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYkF_mX6ICPexPrq0NgRMkzNTx87SC7CF6TtZJwI7voCPzJBpSdazt9sCg6PYXJhMc7orNTG8wLAzZhTwzgkISpOl5aYWlwEJzMaugAEXdC-dXGPm_e6JBGVHvuQTqn71CMNrLX17Vct0fyd6BQbA19cqT14CsurX_8kgOBBEdmyGsI Aug 27 03:01:26.654483 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 03:01:26.654483 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 03:01:26.654483 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 03:01:26.654483 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 03:01:26.654483 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 03:01:26.654483 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 03:01:26.654483 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 33529c36a6dd4ef8a4f80e058be5abf9 Aug 27 03:01:26.654483 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1421714546 Aug 27 03:01:26.654483 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 03:01:26.654483 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 03:01:26.654483 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/33529c36a6dd4ef8a4f80e058be5abf9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_33529c36a6dd4ef8a4f80e058be5abf9", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/33529c36a6dd4ef8a4f80e058be5abf9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/33529c36a6dd4ef8a4f80e058be5abf9"}]}] Aug 27 03:01:26.654483 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1421714546 Aug 27 03:01:26.654483 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 33529c36a6dd4ef8a4f80e058be5abf9 Aug 27 03:01:26.654483 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1421714546 Aug 27 03:01:26.654483 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-MultipleCreateNegativeTestJSON-1421714546-project Aug 27 03:01:26.654483 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 03:01:26.654483 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 03:01:26.654483 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: a7d7a0080e7340febab4ae18c737e02b Aug 27 03:01:26.654483 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1421714546-project Aug 27 03:01:26.654483 n-d-852278-4 devstack@n-api.service[134051]: Aug 27 03:01:26.654483 n-d-852278-4 devstack@n-api.service[134051]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2084445737", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "min_count": 0}} Aug 27 03:01:26.654483 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 03:01:26.654483 n-d-852278-4 devstack@n-api.service[134051]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 27 03:01:26.654483 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-2084445737', 'imageRef': '1552acd0-176a-4c81-b680-29d74105e9d6', 'flavorRef': '452', 'min_count': 0}}} Aug 27 03:01:26.654483 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:01:26.654483 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:01:26.654483 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 03:01:26.654483 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 03:01:26.654483 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 03:01:26.654483 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise error Aug 27 03:01:26.654483 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 27 03:01:26.654483 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:01:26.654483 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Aug 27 03:01:26.654483 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 27 03:01:26.654483 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 27 03:01:26.654483 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 27 03:01:26.654483 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 27 03:01:26.654483 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:01:26.654483 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 27 03:01:26.654483 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi 0 Aug 27 03:01:26.654483 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:01:26.654483 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:01:26.654483 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:01:26.654483 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:01:26.654483 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:01:26.654483 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:01:26.654483 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:01:26.654483 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:01:26.654483 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:01:26.654483 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:01:26.654483 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:01:26.654483 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:01:26.654483 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 03:01:26.654483 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 03:01:26.669563 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 03:01:26.669563 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 03:01:26.669563 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 03:01:26.669563 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 03:01:26.669563 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 27 03:01:26.669563 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:01:26.669563 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:01:26.669563 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:01:26.669563 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:01:26.669563 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:01:26.669563 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:01:26.669563 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 03:01:26.669563 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 03:01:26.669563 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 27 03:01:26.669563 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:01:26.669563 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-eaf2b06b-28cb-4777-b721-e67078af2507 tempest-MultipleCreateNegativeTestJSON-1421714546 tempest-MultipleCreateNegativeTestJSON-1421714546-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:01:26.669563 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-eaf2b06b-28cb-4777-b721-e67078af2507 tempest-MultipleCreateNegativeTestJSON-1421714546 tempest-MultipleCreateNegativeTestJSON-1421714546-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.009466 Aug 27 03:01:26.669563 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2053/4077] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 03:01:26 2022] POST /compute/v2.1/servers => generated 130 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:01:26.687590 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-78bb5ae5-44e3-4ca1-bcf7-cebbc3d6b152 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074fa9d1247548f1b93becab250d4772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8cb23407cc4d5db0379bf5227a0228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:26.698521 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-78bb5ae5-44e3-4ca1-bcf7-cebbc3d6b152 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] 10.222.0.70 "GET /compute/v2.1/servers/9e44ca00-de7b-4c39-893c-c61b0d845cd1" status: 200 len: 1323 microversion: 2.1 time: 0.354408 Aug 27 03:01:26.698931 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2025/4078] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:01:26 2022] GET /compute/v2.1/servers/9e44ca00-de7b-4c39-893c-c61b0d845cd1 => generated 1323 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:01:26.736271 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-97b0122d-6271-4ae5-af9c-3a33a505bc47 tempest-MultipleCreateNegativeTestJSON-1421714546 tempest-MultipleCreateNegativeTestJSON-1421714546-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-628153252", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "min_count": 2.5}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:01:26.740524 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-97b0122d-6271-4ae5-af9c-3a33a505bc47 tempest-MultipleCreateNegativeTestJSON-1421714546 tempest-MultipleCreateNegativeTestJSON-1421714546-project] Request method failure captured: Aug 27 03:01:26.740524 n-d-852278-4 devstack@n-api.service[134051]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 03:01:26.740524 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 03:01:26.740524 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 03:01:26.740524 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 03:01:26.740524 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 169 Aug 27 03:01:26.740524 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 03:01:26.740524 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 03:01:26.740524 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 03:01:26.740524 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 03:01:26.740524 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYkF_mX6ICPexPrq0NgRMkzNTx87SC7CF6TtZJwI7voCPzJBpSdazt9sCg6PYXJhMc7orNTG8wLAzZhTwzgkISpOl5aYWlwEJzMaugAEXdC-dXGPm_e6JBGVHvuQTqn71CMNrLX17Vct0fyd6BQbA19cqT14CsurX_8kgOBBEdmyGsI Aug 27 03:01:26.740524 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 03:01:26.740524 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 03:01:26.740524 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 03:01:26.740524 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 03:01:26.740524 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 03:01:26.740524 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 03:01:26.740524 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 33529c36a6dd4ef8a4f80e058be5abf9 Aug 27 03:01:26.740524 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1421714546 Aug 27 03:01:26.740524 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 03:01:26.740524 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 03:01:26.740524 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/33529c36a6dd4ef8a4f80e058be5abf9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_33529c36a6dd4ef8a4f80e058be5abf9", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/33529c36a6dd4ef8a4f80e058be5abf9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/33529c36a6dd4ef8a4f80e058be5abf9"}]}] Aug 27 03:01:26.740524 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1421714546 Aug 27 03:01:26.740524 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 33529c36a6dd4ef8a4f80e058be5abf9 Aug 27 03:01:26.740524 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1421714546 Aug 27 03:01:26.740524 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-MultipleCreateNegativeTestJSON-1421714546-project Aug 27 03:01:26.740524 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 03:01:26.740524 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 03:01:26.740524 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: a7d7a0080e7340febab4ae18c737e02b Aug 27 03:01:26.740524 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1421714546-project Aug 27 03:01:26.740524 n-d-852278-4 devstack@n-api.service[134051]: Aug 27 03:01:26.740524 n-d-852278-4 devstack@n-api.service[134051]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-628153252", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "min_count": 2.5}} Aug 27 03:01:26.740524 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 03:01:26.740524 n-d-852278-4 devstack@n-api.service[134051]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 27 03:01:26.740524 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-628153252', 'imageRef': '1552acd0-176a-4c81-b680-29d74105e9d6', 'flavorRef': '452', 'min_count': 2.5}}} Aug 27 03:01:26.740524 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:01:26.740524 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:01:26.740524 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 03:01:26.740524 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 03:01:26.740524 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 03:01:26.740524 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise error Aug 27 03:01:26.740524 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Aug 27 03:01:26.740524 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:01:26.740524 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Aug 27 03:01:26.740524 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 27 03:01:26.740524 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 27 03:01:26.740524 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 27 03:01:26.740524 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 27 03:01:26.740524 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:01:26.740524 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 27 03:01:26.740524 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi 2.5 Aug 27 03:01:26.740524 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:01:26.740524 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:01:26.740524 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:01:26.740524 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:01:26.740524 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:01:26.740524 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:01:26.740524 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:01:26.740524 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:01:26.740524 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:01:26.740524 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:01:26.740524 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:01:26.740524 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:01:26.740524 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 03:01:26.740524 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 03:01:26.745224 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 03:01:26.745224 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 03:01:26.745224 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 03:01:26.745224 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 03:01:26.745224 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 27 03:01:26.745224 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:01:26.745224 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:01:26.745224 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:01:26.745224 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:01:26.745224 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:01:26.745224 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:01:26.745224 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 03:01:26.745224 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 03:01:26.745224 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 27 03:01:26.745224 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:01:26.745224 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-97b0122d-6271-4ae5-af9c-3a33a505bc47 tempest-MultipleCreateNegativeTestJSON-1421714546 tempest-MultipleCreateNegativeTestJSON-1421714546-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:01:26.745224 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-97b0122d-6271-4ae5-af9c-3a33a505bc47 tempest-MultipleCreateNegativeTestJSON-1421714546 tempest-MultipleCreateNegativeTestJSON-1421714546-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.011130 Aug 27 03:01:26.745224 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2054/4079] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 03:01:26 2022] POST /compute/v2.1/servers => generated 139 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:01:26.920847 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-701f4087-cdf1-4482-bef9-7a7b38d9a387 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:26.921448 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-701f4087-cdf1-4482-bef9-7a7b38d9a387 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] [instance: 307f8788-d4c5-4bdc-9f4a-6cb6112a5b5a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:26.923491 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:01:26.943492 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-701f4087-cdf1-4482-bef9-7a7b38d9a387 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:26.943820 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-701f4087-cdf1-4482-bef9-7a7b38d9a387 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:26.944424 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-701f4087-cdf1-4482-bef9-7a7b38d9a387 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:26.945016 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-701f4087-cdf1-4482-bef9-7a7b38d9a387 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:26.945463 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-701f4087-cdf1-4482-bef9-7a7b38d9a387 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:26.945883 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-701f4087-cdf1-4482-bef9-7a7b38d9a387 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:27.015271 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ef6b21a9-5b28-4442-962c-829c5ac3e59b tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:27.015943 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-ef6b21a9-5b28-4442-962c-829c5ac3e59b tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] [instance: 343ac6ba-ddb5-469b-8fe1-fbdba6f69ac9] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:27.034978 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ef6b21a9-5b28-4442-962c-829c5ac3e59b tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:27.035483 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ef6b21a9-5b28-4442-962c-829c5ac3e59b tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:27.035917 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ef6b21a9-5b28-4442-962c-829c5ac3e59b tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:27.036656 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ef6b21a9-5b28-4442-962c-829c5ac3e59b tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:27.037106 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ef6b21a9-5b28-4442-962c-829c5ac3e59b tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:27.037526 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ef6b21a9-5b28-4442-962c-829c5ac3e59b tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:27.330707 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=8 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:01:27.492728 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-701f4087-cdf1-4482-bef9-7a7b38d9a387 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107c58bcdad44bc29802d2588b93e26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827a290de2714759a70c51b12b520321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:27.502664 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-701f4087-cdf1-4482-bef9-7a7b38d9a387 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '107c58bcdad44bc29802d2588b93e26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827a290de2714759a70c51b12b520321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:27.505440 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-701f4087-cdf1-4482-bef9-7a7b38d9a387 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '107c58bcdad44bc29802d2588b93e26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827a290de2714759a70c51b12b520321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:27.507067 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-701f4087-cdf1-4482-bef9-7a7b38d9a387 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] 10.222.0.70 "GET /compute/v2.1/servers/307f8788-d4c5-4bdc-9f4a-6cb6112a5b5a" status: 200 len: 1372 microversion: 2.57 time: 0.590217 Aug 27 03:01:27.507863 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2026/4080] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:01:26 2022] GET /compute/v2.1/servers/307f8788-d4c5-4bdc-9f4a-6cb6112a5b5a => generated 1372 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:01:27.722446 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f4d5daec-04cf-412c-9c1a-88ead1b60c90 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:27.724738 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-f4d5daec-04cf-412c-9c1a-88ead1b60c90 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] [instance: 9e44ca00-de7b-4c39-893c-c61b0d845cd1] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:27.744290 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f4d5daec-04cf-412c-9c1a-88ead1b60c90 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:27.745220 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f4d5daec-04cf-412c-9c1a-88ead1b60c90 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:27.746246 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f4d5daec-04cf-412c-9c1a-88ead1b60c90 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:27.747119 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f4d5daec-04cf-412c-9c1a-88ead1b60c90 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:27.747692 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f4d5daec-04cf-412c-9c1a-88ead1b60c90 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:27.748914 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f4d5daec-04cf-412c-9c1a-88ead1b60c90 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:27.977118 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-ef6b21a9-5b28-4442-962c-829c5ac3e59b tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba8b9c3a3644a42b8ec4535345305af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2430b54793364b119690049d8aeea6f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:27.993726 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ef6b21a9-5b28-4442-962c-829c5ac3e59b tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] 10.222.0.70 "GET /compute/v2.1/servers/343ac6ba-ddb5-469b-8fe1-fbdba6f69ac9" status: 200 len: 1511 microversion: 2.1 time: 0.985387 Aug 27 03:01:27.996757 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2055/4081] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:01:27 2022] GET /compute/v2.1/servers/343ac6ba-ddb5-469b-8fe1-fbdba6f69ac9 => generated 1511 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:01:28.302853 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-f4d5daec-04cf-412c-9c1a-88ead1b60c90 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074fa9d1247548f1b93becab250d4772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8cb23407cc4d5db0379bf5227a0228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:28.320037 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f4d5daec-04cf-412c-9c1a-88ead1b60c90 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] 10.222.0.70 "GET /compute/v2.1/servers/9e44ca00-de7b-4c39-893c-c61b0d845cd1" status: 200 len: 1323 microversion: 2.1 time: 0.605987 Aug 27 03:01:28.320920 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2027/4082] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:01:27 2022] GET /compute/v2.1/servers/9e44ca00-de7b-4c39-893c-c61b0d845cd1 => generated 1323 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:01:28.543636 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-775ae72a-eea0-4966-ac1e-31834cdd0fea tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:28.546755 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-775ae72a-eea0-4966-ac1e-31834cdd0fea tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] [instance: 307f8788-d4c5-4bdc-9f4a-6cb6112a5b5a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:28.571465 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-775ae72a-eea0-4966-ac1e-31834cdd0fea tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:28.578733 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-775ae72a-eea0-4966-ac1e-31834cdd0fea tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:28.579440 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-775ae72a-eea0-4966-ac1e-31834cdd0fea tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:28.581772 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-775ae72a-eea0-4966-ac1e-31834cdd0fea tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:28.582285 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-775ae72a-eea0-4966-ac1e-31834cdd0fea tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:28.585928 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-775ae72a-eea0-4966-ac1e-31834cdd0fea tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:29.015459 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3b06b459-383a-49b2-abb1-6fd8bdf73346 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:29.016132 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-3b06b459-383a-49b2-abb1-6fd8bdf73346 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] [instance: 343ac6ba-ddb5-469b-8fe1-fbdba6f69ac9] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:29.064584 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3b06b459-383a-49b2-abb1-6fd8bdf73346 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:29.066732 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3b06b459-383a-49b2-abb1-6fd8bdf73346 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:29.068202 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3b06b459-383a-49b2-abb1-6fd8bdf73346 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:29.069253 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3b06b459-383a-49b2-abb1-6fd8bdf73346 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:29.069658 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-775ae72a-eea0-4966-ac1e-31834cdd0fea tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107c58bcdad44bc29802d2588b93e26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827a290de2714759a70c51b12b520321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:29.070495 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3b06b459-383a-49b2-abb1-6fd8bdf73346 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:29.071166 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3b06b459-383a-49b2-abb1-6fd8bdf73346 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:29.079342 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-775ae72a-eea0-4966-ac1e-31834cdd0fea tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '107c58bcdad44bc29802d2588b93e26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827a290de2714759a70c51b12b520321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:29.081632 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-775ae72a-eea0-4966-ac1e-31834cdd0fea tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '107c58bcdad44bc29802d2588b93e26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827a290de2714759a70c51b12b520321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:29.083042 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-775ae72a-eea0-4966-ac1e-31834cdd0fea tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] 10.222.0.70 "GET /compute/v2.1/servers/307f8788-d4c5-4bdc-9f4a-6cb6112a5b5a" status: 200 len: 1372 microversion: 2.57 time: 0.551778 Aug 27 03:01:29.084356 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2056/4083] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:01:28 2022] GET /compute/v2.1/servers/307f8788-d4c5-4bdc-9f4a-6cb6112a5b5a => generated 1372 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:01:29.104891 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-0c520d49-0d8d-4805-93f6-bf69c58b6ff2 req-230b6ed7-3dea-4fc2-85e0-0411db598c1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "343ac6ba-ddb5-469b-8fe1-fbdba6f69ac9", "name": "network-vif-deleted", "tag": "231041ff-643a-451f-9000-8f5274da957d"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:01:29.129899 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-0c520d49-0d8d-4805-93f6-bf69c58b6ff2 req-230b6ed7-3dea-4fc2-85e0-0411db598c1b service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:29.132836 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-0c520d49-0d8d-4805-93f6-bf69c58b6ff2 req-230b6ed7-3dea-4fc2-85e0-0411db598c1b service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:29.133607 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-0c520d49-0d8d-4805-93f6-bf69c58b6ff2 req-230b6ed7-3dea-4fc2-85e0-0411db598c1b service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:29.181915 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-0c520d49-0d8d-4805-93f6-bf69c58b6ff2 req-230b6ed7-3dea-4fc2-85e0-0411db598c1b service nova] Creating event network-vif-deleted:231041ff-643a-451f-9000-8f5274da957d for instance 343ac6ba-ddb5-469b-8fe1-fbdba6f69ac9 on n-h1-852278-4 Aug 27 03:01:29.187656 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-0c520d49-0d8d-4805-93f6-bf69c58b6ff2 req-230b6ed7-3dea-4fc2-85e0-0411db598c1b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101749 Aug 27 03:01:29.188728 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2057/4084] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:01:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:01:29.221987 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-3b06b459-383a-49b2-abb1-6fd8bdf73346 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba8b9c3a3644a42b8ec4535345305af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2430b54793364b119690049d8aeea6f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:29.230964 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-3b06b459-383a-49b2-abb1-6fd8bdf73346 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] 10.222.0.70 "GET /compute/v2.1/servers/343ac6ba-ddb5-469b-8fe1-fbdba6f69ac9" status: 200 len: 1469 microversion: 2.1 time: 0.220298 Aug 27 03:01:29.233080 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2028/4085] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:01:29 2022] GET /compute/v2.1/servers/343ac6ba-ddb5-469b-8fe1-fbdba6f69ac9 => generated 1469 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:01:29.346275 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-5f1dcd85-12cf-48cd-a839-1efb073eb67f tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:29.347040 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-5f1dcd85-12cf-48cd-a839-1efb073eb67f tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] [instance: 9e44ca00-de7b-4c39-893c-c61b0d845cd1] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:29.371621 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5f1dcd85-12cf-48cd-a839-1efb073eb67f tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:29.372604 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5f1dcd85-12cf-48cd-a839-1efb073eb67f tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:29.376584 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5f1dcd85-12cf-48cd-a839-1efb073eb67f tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:29.378883 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5f1dcd85-12cf-48cd-a839-1efb073eb67f tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:29.379603 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5f1dcd85-12cf-48cd-a839-1efb073eb67f tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:29.380633 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5f1dcd85-12cf-48cd-a839-1efb073eb67f tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:29.626635 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-5f1dcd85-12cf-48cd-a839-1efb073eb67f tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074fa9d1247548f1b93becab250d4772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8cb23407cc4d5db0379bf5227a0228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:29.639633 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-5f1dcd85-12cf-48cd-a839-1efb073eb67f tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] 10.222.0.70 "GET /compute/v2.1/servers/9e44ca00-de7b-4c39-893c-c61b0d845cd1" status: 200 len: 1323 microversion: 2.1 time: 0.298357 Aug 27 03:01:29.640851 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2058/4086] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:01:29 2022] GET /compute/v2.1/servers/9e44ca00-de7b-4c39-893c-c61b0d845cd1 => generated 1323 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:01:30.109544 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d2edb6b7-eba2-4f17-bdda-7cb9a5de1ba3 tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-2091976047", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "networks": "none"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:01:30.110640 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d2dfba33-16b0-4eb6-8fe3-f0c592dffc61 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:30.111416 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d2dfba33-16b0-4eb6-8fe3-f0c592dffc61 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] [instance: 307f8788-d4c5-4bdc-9f4a-6cb6112a5b5a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:30.120304 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d2dfba33-16b0-4eb6-8fe3-f0c592dffc61 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:30.120850 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d2dfba33-16b0-4eb6-8fe3-f0c592dffc61 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:30.121632 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d2dfba33-16b0-4eb6-8fe3-f0c592dffc61 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:30.122741 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d2dfba33-16b0-4eb6-8fe3-f0c592dffc61 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:30.123419 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d2dfba33-16b0-4eb6-8fe3-f0c592dffc61 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:30.124089 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d2dfba33-16b0-4eb6-8fe3-f0c592dffc61 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:30.195905 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-d2edb6b7-eba2-4f17-bdda-7cb9a5de1ba3 tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] Flavor limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:01:30.196671 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-d2edb6b7-eba2-4f17-bdda-7cb9a5de1ba3 tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] Image limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:01:30.197340 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-d2edb6b7-eba2-4f17-bdda-7cb9a5de1ba3 tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] Flavor pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:01:30.197957 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-d2edb6b7-eba2-4f17-bdda-7cb9a5de1ba3 tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] Image pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:01:30.198581 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-d2edb6b7-eba2-4f17-bdda-7cb9a5de1ba3 tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:01:30.209702 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d2edb6b7-eba2-4f17-bdda-7cb9a5de1ba3 tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:30.210743 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d2edb6b7-eba2-4f17-bdda-7cb9a5de1ba3 tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:30.212187 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d2edb6b7-eba2-4f17-bdda-7cb9a5de1ba3 tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:30.213196 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d2edb6b7-eba2-4f17-bdda-7cb9a5de1ba3 tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:30.213849 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d2edb6b7-eba2-4f17-bdda-7cb9a5de1ba3 tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:30.214466 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d2edb6b7-eba2-4f17-bdda-7cb9a5de1ba3 tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:30.236512 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-d2edb6b7-eba2-4f17-bdda-7cb9a5de1ba3 tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] Getting quotas for project f376adb5640d4e0398a0213511fa3600. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:01:30.243333 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-d2edb6b7-eba2-4f17-bdda-7cb9a5de1ba3 tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] Getting quotas for user 2227b9cc7d9e4c5197dcd4aab63db2c4 and project f376adb5640d4e0398a0213511fa3600. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:01:30.248716 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d2dfba33-16b0-4eb6-8fe3-f0c592dffc61 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107c58bcdad44bc29802d2588b93e26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827a290de2714759a70c51b12b520321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:30.262140 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d2edb6b7-eba2-4f17-bdda-7cb9a5de1ba3 tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] Going to run 1 instances... {{(pid=134052) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:01:30.265792 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d2edb6b7-eba2-4f17-bdda-7cb9a5de1ba3 tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] [instance: edceebb6-8b39-4d52-9ee5-811329676649] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134052) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:01:30.269952 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d2dfba33-16b0-4eb6-8fe3-f0c592dffc61 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '107c58bcdad44bc29802d2588b93e26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827a290de2714759a70c51b12b520321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:30.273496 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d2dfba33-16b0-4eb6-8fe3-f0c592dffc61 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '107c58bcdad44bc29802d2588b93e26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827a290de2714759a70c51b12b520321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:30.275851 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d2dfba33-16b0-4eb6-8fe3-f0c592dffc61 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] 10.222.0.70 "GET /compute/v2.1/servers/307f8788-d4c5-4bdc-9f4a-6cb6112a5b5a" status: 200 len: 1357 microversion: 2.57 time: 0.170435 Aug 27 03:01:30.277332 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2059/4087] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:01:30 2022] GET /compute/v2.1/servers/307f8788-d4c5-4bdc-9f4a-6cb6112a5b5a => generated 1357 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:01:30.284194 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-159df621-dded-4421-8099-77bf8b3f7ab0 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:30.285226 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-159df621-dded-4421-8099-77bf8b3f7ab0 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] [instance: 343ac6ba-ddb5-469b-8fe1-fbdba6f69ac9] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:30.311803 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-159df621-dded-4421-8099-77bf8b3f7ab0 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:30.312766 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-159df621-dded-4421-8099-77bf8b3f7ab0 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:30.313535 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-159df621-dded-4421-8099-77bf8b3f7ab0 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:30.314522 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-159df621-dded-4421-8099-77bf8b3f7ab0 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:30.317176 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-159df621-dded-4421-8099-77bf8b3f7ab0 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:30.317891 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-159df621-dded-4421-8099-77bf8b3f7ab0 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:30.368296 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-159df621-dded-4421-8099-77bf8b3f7ab0 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] HTTP exception thrown: Instance 343ac6ba-ddb5-469b-8fe1-fbdba6f69ac9 could not be found. Aug 27 03:01:30.368296 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-159df621-dded-4421-8099-77bf8b3f7ab0 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Request method failure captured: Aug 27 03:01:30.368296 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/343ac6ba-ddb5-469b-8fe1-fbdba6f69ac9 HTTP/1.1 Aug 27 03:01:30.368296 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 03:01:30.368296 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 03:01:30.368296 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 03:01:30.368296 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 03:01:30.368296 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 03:01:30.368296 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 03:01:30.368296 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 03:01:30.368296 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 03:01:30.368296 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYjvTnln6ESNncRVlx9of63ewBCwovQJZXvpSb3TSADf0xh0NDkScjCGN23wA9CLmkIW8b8-YaweXBiANfT-fAeqsWQkMbpH5j46dvST1KmiBkbezJFIsfbOvrPIafR1tdsHrFxeSHazBfgdcLcDNDgBy1FCDIu6qrf9WId5qnyytM8 Aug 27 03:01:30.368296 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 03:01:30.368296 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 03:01:30.368296 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 03:01:30.368296 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 03:01:30.368296 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 03:01:30.368296 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 03:01:30.368296 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 2430b54793364b119690049d8aeea6f5 Aug 27 03:01:30.368296 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ServerAddressesTestJSON-1037117007 Aug 27 03:01:30.368296 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 03:01:30.368296 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 03:01:30.368296 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2430b54793364b119690049d8aeea6f5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_2430b54793364b119690049d8aeea6f5", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2430b54793364b119690049d8aeea6f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/2430b54793364b119690049d8aeea6f5"}]}] Aug 27 03:01:30.368296 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ServerAddressesTestJSON-1037117007 Aug 27 03:01:30.368296 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 2430b54793364b119690049d8aeea6f5 Aug 27 03:01:30.368296 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ServerAddressesTestJSON-1037117007 Aug 27 03:01:30.368296 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ServerAddressesTestJSON-1037117007-project Aug 27 03:01:30.368296 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 03:01:30.368296 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 03:01:30.368296 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: dba8b9c3a3644a42b8ec4535345305af Aug 27 03:01:30.368296 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ServerAddressesTestJSON-1037117007-project Aug 27 03:01:30.368296 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 03:01:30.368296 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance 343ac6ba-ddb5-469b-8fe1-fbdba6f69ac9 could not be found. Aug 27 03:01:30.368296 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '343ac6ba-ddb5-469b-8fe1-fbdba6f69ac9'} Aug 27 03:01:30.368296 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:01:30.368296 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:01:30.368296 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:01:30.368296 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:01:30.368296 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:01:30.368296 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:01:30.368296 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:01:30.368296 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:01:30.368296 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:01:30.368296 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:01:30.368296 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 343ac6ba-ddb5-469b-8fe1-fbdba6f69ac9 could not be found. Aug 27 03:01:30.368296 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:01:30.368296 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:01:30.368296 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:01:30.368296 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:01:30.368296 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:01:30.368296 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:01:30.368296 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:01:30.368296 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:01:30.368296 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:01:30.368296 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:01:30.368296 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:01:30.368296 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:01:30.368296 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:01:30.368296 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:01:30.368296 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:01:30.368296 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:01:30.372753 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 343ac6ba-ddb5-469b-8fe1-fbdba6f69ac9 could not be found. Aug 27 03:01:30.372753 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:01:30.372753 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:01:30.372753 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:01:30.372753 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:01:30.372753 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:01:30.372753 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:01:30.372753 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:01:30.372753 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:01:30.372753 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 343ac6ba-ddb5-469b-8fe1-fbdba6f69ac9 could not be found. Aug 27 03:01:30.372753 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:01:30.372753 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-159df621-dded-4421-8099-77bf8b3f7ab0 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] Returning 404 to user: Instance 343ac6ba-ddb5-469b-8fe1-fbdba6f69ac9 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:01:30.378306 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d2edb6b7-eba2-4f17-bdda-7cb9a5de1ba3 tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.398186 Aug 27 03:01:30.378708 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-159df621-dded-4421-8099-77bf8b3f7ab0 tempest-ServerAddressesTestJSON-1037117007 tempest-ServerAddressesTestJSON-1037117007-project] 10.222.0.70 "GET /compute/v2.1/servers/343ac6ba-ddb5-469b-8fe1-fbdba6f69ac9" status: 404 len: 111 microversion: 2.1 time: 0.089479 Aug 27 03:01:30.378864 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2029/4088] 10.222.0.70 () {62 vars in 1188 bytes} [Sat Aug 27 03:01:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 401 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 27 03:01:30.379011 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2060/4089] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:01:30 2022] GET /compute/v2.1/servers/343ac6ba-ddb5-469b-8fe1-fbdba6f69ac9 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:01:30.379158 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-1d9b53ee-c11c-4cfb-af40-e14ffb9ed122 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:30.379158 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-1d9b53ee-c11c-4cfb-af40-e14ffb9ed122 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] [instance: 307f8788-d4c5-4bdc-9f4a-6cb6112a5b5a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:30.383456 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a28276fa-2597-4c65-b7d5-6bdd4ad2cc24 tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:30.384501 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-a28276fa-2597-4c65-b7d5-6bdd4ad2cc24 tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] [instance: edceebb6-8b39-4d52-9ee5-811329676649] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:30.408030 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1d9b53ee-c11c-4cfb-af40-e14ffb9ed122 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:30.408577 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1d9b53ee-c11c-4cfb-af40-e14ffb9ed122 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:30.411364 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1d9b53ee-c11c-4cfb-af40-e14ffb9ed122 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:30.413100 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1d9b53ee-c11c-4cfb-af40-e14ffb9ed122 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:30.413594 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1d9b53ee-c11c-4cfb-af40-e14ffb9ed122 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:30.414035 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1d9b53ee-c11c-4cfb-af40-e14ffb9ed122 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:30.486666 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-1d9b53ee-c11c-4cfb-af40-e14ffb9ed122 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] [instance: 307f8788-d4c5-4bdc-9f4a-6cb6112a5b5a] Going to try to terminate instance {{(pid=134052) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:01:30.647622 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-1d9b53ee-c11c-4cfb-af40-e14ffb9ed122 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] 10.222.0.70 "DELETE /compute/v2.1/servers/307f8788-d4c5-4bdc-9f4a-6cb6112a5b5a" status: 204 len: 0 microversion: 2.57 time: 0.276355 Aug 27 03:01:30.649964 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2030/4090] 10.222.0.70 () {60 vars in 1280 bytes} [Sat Aug 27 03:01:30 2022] DELETE /compute/v2.1/servers/307f8788-d4c5-4bdc-9f4a-6cb6112a5b5a => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 03:01:30.658533 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-36d53539-09a2-475a-8ff2-4e302b57dd1c req-4b4ce83e-4d26-4604-a484-e1e818019d60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e44ca00-de7b-4c39-893c-c61b0d845cd1", "name": "network-vif-plugged", "status": "completed", "tag": "8445b37e-80d1-4feb-9fbc-fa886c48c08c"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:01:30.673955 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-36d53539-09a2-475a-8ff2-4e302b57dd1c req-4b4ce83e-4d26-4604-a484-e1e818019d60 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:30.677773 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-36d53539-09a2-475a-8ff2-4e302b57dd1c req-4b4ce83e-4d26-4604-a484-e1e818019d60 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:30.679488 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-36d53539-09a2-475a-8ff2-4e302b57dd1c req-4b4ce83e-4d26-4604-a484-e1e818019d60 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:30.698813 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:01:30.702461 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-36d53539-09a2-475a-8ff2-4e302b57dd1c req-4b4ce83e-4d26-4604-a484-e1e818019d60 service nova] Creating event network-vif-plugged:8445b37e-80d1-4feb-9fbc-fa886c48c08c for instance 9e44ca00-de7b-4c39-893c-c61b0d845cd1 on n-h2-852278-4 Aug 27 03:01:30.714365 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-36d53539-09a2-475a-8ff2-4e302b57dd1c req-4b4ce83e-4d26-4604-a484-e1e818019d60 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061504 Aug 27 03:01:30.715752 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2031/4091] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:01:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:01:30.726045 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3611a898-f761-495f-a6c9-2c997971c5df tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:30.728144 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-3611a898-f761-495f-a6c9-2c997971c5df tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] [instance: 307f8788-d4c5-4bdc-9f4a-6cb6112a5b5a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:30.738023 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:01:30.742836 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3611a898-f761-495f-a6c9-2c997971c5df tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:30.743597 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3611a898-f761-495f-a6c9-2c997971c5df tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:30.744376 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3611a898-f761-495f-a6c9-2c997971c5df tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:30.745252 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3611a898-f761-495f-a6c9-2c997971c5df tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:30.745862 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3611a898-f761-495f-a6c9-2c997971c5df tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:30.746532 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3611a898-f761-495f-a6c9-2c997971c5df tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:30.839998 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-a28276fa-2597-4c65-b7d5-6bdd4ad2cc24 tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2227b9cc7d9e4c5197dcd4aab63db2c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f376adb5640d4e0398a0213511fa3600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:30.869651 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-a28276fa-2597-4c65-b7d5-6bdd4ad2cc24 tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2227b9cc7d9e4c5197dcd4aab63db2c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f376adb5640d4e0398a0213511fa3600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:30.876029 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-a28276fa-2597-4c65-b7d5-6bdd4ad2cc24 tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2227b9cc7d9e4c5197dcd4aab63db2c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f376adb5640d4e0398a0213511fa3600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:30.879572 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a28276fa-2597-4c65-b7d5-6bdd4ad2cc24 tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] 10.222.0.70 "GET /compute/v2.1/servers/edceebb6-8b39-4d52-9ee5-811329676649" status: 200 len: 1281 microversion: 2.47 time: 0.503613 Aug 27 03:01:30.885370 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2061/4092] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:01:30 2022] GET /compute/v2.1/servers/edceebb6-8b39-4d52-9ee5-811329676649 => generated 1281 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:01:30.896358 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-dfe5701e-524c-4ef0-aee5-b932a1498238 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:30.897372 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-dfe5701e-524c-4ef0-aee5-b932a1498238 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] [instance: 9e44ca00-de7b-4c39-893c-c61b0d845cd1] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:30.912170 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dfe5701e-524c-4ef0-aee5-b932a1498238 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:30.914287 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dfe5701e-524c-4ef0-aee5-b932a1498238 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:30.916497 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dfe5701e-524c-4ef0-aee5-b932a1498238 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:30.925845 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dfe5701e-524c-4ef0-aee5-b932a1498238 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:30.927771 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dfe5701e-524c-4ef0-aee5-b932a1498238 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:30.929424 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dfe5701e-524c-4ef0-aee5-b932a1498238 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:31.174467 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-3611a898-f761-495f-a6c9-2c997971c5df tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107c58bcdad44bc29802d2588b93e26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827a290de2714759a70c51b12b520321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:31.186982 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-3611a898-f761-495f-a6c9-2c997971c5df tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '107c58bcdad44bc29802d2588b93e26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827a290de2714759a70c51b12b520321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:31.193028 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-3611a898-f761-495f-a6c9-2c997971c5df tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '107c58bcdad44bc29802d2588b93e26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827a290de2714759a70c51b12b520321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:31.197151 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-3611a898-f761-495f-a6c9-2c997971c5df tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] 10.222.0.70 "GET /compute/v2.1/servers/307f8788-d4c5-4bdc-9f4a-6cb6112a5b5a" status: 200 len: 1363 microversion: 2.57 time: 0.478791 Aug 27 03:01:31.212381 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2032/4093] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:01:30 2022] GET /compute/v2.1/servers/307f8788-d4c5-4bdc-9f4a-6cb6112a5b5a => generated 1363 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:01:31.811981 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-dfe5701e-524c-4ef0-aee5-b932a1498238 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074fa9d1247548f1b93becab250d4772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8cb23407cc4d5db0379bf5227a0228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:31.820601 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-dfe5701e-524c-4ef0-aee5-b932a1498238 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] 10.222.0.70 "GET /compute/v2.1/servers/9e44ca00-de7b-4c39-893c-c61b0d845cd1" status: 200 len: 1323 microversion: 2.1 time: 0.933825 Aug 27 03:01:31.821219 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2062/4094] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:01:30 2022] GET /compute/v2.1/servers/9e44ca00-de7b-4c39-893c-c61b0d845cd1 => generated 1323 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:01:31.915395 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e30f8d8d-4a80-453a-954e-7dc74f18e74e tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:31.916138 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-e30f8d8d-4a80-453a-954e-7dc74f18e74e tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] [instance: edceebb6-8b39-4d52-9ee5-811329676649] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:31.939460 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e30f8d8d-4a80-453a-954e-7dc74f18e74e tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:31.939982 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e30f8d8d-4a80-453a-954e-7dc74f18e74e tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:31.940446 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e30f8d8d-4a80-453a-954e-7dc74f18e74e tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:31.941239 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e30f8d8d-4a80-453a-954e-7dc74f18e74e tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:31.941743 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e30f8d8d-4a80-453a-954e-7dc74f18e74e tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:31.945707 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e30f8d8d-4a80-453a-954e-7dc74f18e74e tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:32.096627 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-e30f8d8d-4a80-453a-954e-7dc74f18e74e tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2227b9cc7d9e4c5197dcd4aab63db2c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f376adb5640d4e0398a0213511fa3600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:32.111778 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-e30f8d8d-4a80-453a-954e-7dc74f18e74e tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2227b9cc7d9e4c5197dcd4aab63db2c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f376adb5640d4e0398a0213511fa3600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:32.125811 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-e30f8d8d-4a80-453a-954e-7dc74f18e74e tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2227b9cc7d9e4c5197dcd4aab63db2c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f376adb5640d4e0398a0213511fa3600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:32.127513 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e30f8d8d-4a80-453a-954e-7dc74f18e74e tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] 10.222.0.70 "GET /compute/v2.1/servers/edceebb6-8b39-4d52-9ee5-811329676649" status: 200 len: 1333 microversion: 2.47 time: 0.224791 Aug 27 03:01:32.143400 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2033/4095] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:01:31 2022] GET /compute/v2.1/servers/edceebb6-8b39-4d52-9ee5-811329676649 => generated 1333 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:01:32.221582 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d6dc4560-b262-4e54-9105-d7ffbc18a875 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:32.222251 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d6dc4560-b262-4e54-9105-d7ffbc18a875 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] [instance: 307f8788-d4c5-4bdc-9f4a-6cb6112a5b5a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:32.235697 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d6dc4560-b262-4e54-9105-d7ffbc18a875 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:32.236343 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d6dc4560-b262-4e54-9105-d7ffbc18a875 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:32.236861 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d6dc4560-b262-4e54-9105-d7ffbc18a875 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:32.237657 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d6dc4560-b262-4e54-9105-d7ffbc18a875 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:32.238316 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d6dc4560-b262-4e54-9105-d7ffbc18a875 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:32.238803 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d6dc4560-b262-4e54-9105-d7ffbc18a875 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:32.359278 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d6dc4560-b262-4e54-9105-d7ffbc18a875 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107c58bcdad44bc29802d2588b93e26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827a290de2714759a70c51b12b520321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:32.380476 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d6dc4560-b262-4e54-9105-d7ffbc18a875 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '107c58bcdad44bc29802d2588b93e26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827a290de2714759a70c51b12b520321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:32.383000 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d6dc4560-b262-4e54-9105-d7ffbc18a875 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '107c58bcdad44bc29802d2588b93e26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827a290de2714759a70c51b12b520321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:32.385714 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d6dc4560-b262-4e54-9105-d7ffbc18a875 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] 10.222.0.70 "GET /compute/v2.1/servers/307f8788-d4c5-4bdc-9f4a-6cb6112a5b5a" status: 200 len: 1363 microversion: 2.57 time: 0.169500 Aug 27 03:01:32.386663 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2063/4096] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:01:32 2022] GET /compute/v2.1/servers/307f8788-d4c5-4bdc-9f4a-6cb6112a5b5a => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:01:32.843019 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-1280d401-eaf8-4f41-8e57-efa66c266645 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:32.844364 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-1280d401-eaf8-4f41-8e57-efa66c266645 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] [instance: 9e44ca00-de7b-4c39-893c-c61b0d845cd1] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:32.856077 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1280d401-eaf8-4f41-8e57-efa66c266645 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:32.857223 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1280d401-eaf8-4f41-8e57-efa66c266645 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:32.858164 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1280d401-eaf8-4f41-8e57-efa66c266645 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:32.859388 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1280d401-eaf8-4f41-8e57-efa66c266645 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:32.862312 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1280d401-eaf8-4f41-8e57-efa66c266645 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:32.863665 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1280d401-eaf8-4f41-8e57-efa66c266645 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:33.154256 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-aa83e314-3df8-454b-8127-6e65f8bfea79 tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:33.155752 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-aa83e314-3df8-454b-8127-6e65f8bfea79 tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] [instance: edceebb6-8b39-4d52-9ee5-811329676649] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:33.164296 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-aa83e314-3df8-454b-8127-6e65f8bfea79 tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:33.165277 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-aa83e314-3df8-454b-8127-6e65f8bfea79 tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:33.166008 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-aa83e314-3df8-454b-8127-6e65f8bfea79 tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:33.166957 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-aa83e314-3df8-454b-8127-6e65f8bfea79 tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:33.168342 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-aa83e314-3df8-454b-8127-6e65f8bfea79 tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:33.168982 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-aa83e314-3df8-454b-8127-6e65f8bfea79 tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:33.282982 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-1280d401-eaf8-4f41-8e57-efa66c266645 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074fa9d1247548f1b93becab250d4772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8cb23407cc4d5db0379bf5227a0228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:33.299360 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-1280d401-eaf8-4f41-8e57-efa66c266645 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] 10.222.0.70 "GET /compute/v2.1/servers/9e44ca00-de7b-4c39-893c-c61b0d845cd1" status: 200 len: 1323 microversion: 2.1 time: 0.458242 Aug 27 03:01:33.302907 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2034/4097] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:01:32 2022] GET /compute/v2.1/servers/9e44ca00-de7b-4c39-893c-c61b0d845cd1 => generated 1323 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:01:33.307911 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-aa83e314-3df8-454b-8127-6e65f8bfea79 tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2227b9cc7d9e4c5197dcd4aab63db2c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f376adb5640d4e0398a0213511fa3600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:33.325941 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-aa83e314-3df8-454b-8127-6e65f8bfea79 tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2227b9cc7d9e4c5197dcd4aab63db2c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f376adb5640d4e0398a0213511fa3600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:33.328176 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-aa83e314-3df8-454b-8127-6e65f8bfea79 tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2227b9cc7d9e4c5197dcd4aab63db2c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f376adb5640d4e0398a0213511fa3600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:33.331682 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-aa83e314-3df8-454b-8127-6e65f8bfea79 tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] 10.222.0.70 "GET /compute/v2.1/servers/edceebb6-8b39-4d52-9ee5-811329676649" status: 200 len: 1339 microversion: 2.47 time: 0.183682 Aug 27 03:01:33.333455 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2064/4098] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:01:33 2022] GET /compute/v2.1/servers/edceebb6-8b39-4d52-9ee5-811329676649 => generated 1339 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:01:33.410263 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b2f5ec87-ba82-41bb-96a6-9f8cc1ff8af6 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:33.410793 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b2f5ec87-ba82-41bb-96a6-9f8cc1ff8af6 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] [instance: 307f8788-d4c5-4bdc-9f4a-6cb6112a5b5a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:33.425324 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b2f5ec87-ba82-41bb-96a6-9f8cc1ff8af6 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:33.426264 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b2f5ec87-ba82-41bb-96a6-9f8cc1ff8af6 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:33.426928 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b2f5ec87-ba82-41bb-96a6-9f8cc1ff8af6 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:33.428773 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b2f5ec87-ba82-41bb-96a6-9f8cc1ff8af6 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:33.429661 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b2f5ec87-ba82-41bb-96a6-9f8cc1ff8af6 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:33.430319 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b2f5ec87-ba82-41bb-96a6-9f8cc1ff8af6 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:33.615770 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b2f5ec87-ba82-41bb-96a6-9f8cc1ff8af6 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107c58bcdad44bc29802d2588b93e26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827a290de2714759a70c51b12b520321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:33.629691 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b2f5ec87-ba82-41bb-96a6-9f8cc1ff8af6 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '107c58bcdad44bc29802d2588b93e26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827a290de2714759a70c51b12b520321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:33.631631 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b2f5ec87-ba82-41bb-96a6-9f8cc1ff8af6 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '107c58bcdad44bc29802d2588b93e26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827a290de2714759a70c51b12b520321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:33.633400 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b2f5ec87-ba82-41bb-96a6-9f8cc1ff8af6 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] 10.222.0.70 "GET /compute/v2.1/servers/307f8788-d4c5-4bdc-9f4a-6cb6112a5b5a" status: 200 len: 1363 microversion: 2.57 time: 0.227359 Aug 27 03:01:33.636566 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2035/4099] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:01:33 2022] GET /compute/v2.1/servers/307f8788-d4c5-4bdc-9f4a-6cb6112a5b5a => generated 1363 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:01:34.323470 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f7b56738-1016-41f5-a3e1-bd94e29cd57b tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:34.324422 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-f7b56738-1016-41f5-a3e1-bd94e29cd57b tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] [instance: 9e44ca00-de7b-4c39-893c-c61b0d845cd1] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:34.346908 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f7b56738-1016-41f5-a3e1-bd94e29cd57b tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:34.347464 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f7b56738-1016-41f5-a3e1-bd94e29cd57b tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:34.347906 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f7b56738-1016-41f5-a3e1-bd94e29cd57b tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:34.349893 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f7b56738-1016-41f5-a3e1-bd94e29cd57b tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:34.349893 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f7b56738-1016-41f5-a3e1-bd94e29cd57b tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:34.349893 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f7b56738-1016-41f5-a3e1-bd94e29cd57b tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:34.362556 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5ea5a842-0177-4e6a-b074-cc548d727f62 tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:34.363840 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-5ea5a842-0177-4e6a-b074-cc548d727f62 tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] [instance: edceebb6-8b39-4d52-9ee5-811329676649] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:34.392522 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5ea5a842-0177-4e6a-b074-cc548d727f62 tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:34.393023 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5ea5a842-0177-4e6a-b074-cc548d727f62 tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:34.393457 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5ea5a842-0177-4e6a-b074-cc548d727f62 tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:34.394316 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5ea5a842-0177-4e6a-b074-cc548d727f62 tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:34.399817 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5ea5a842-0177-4e6a-b074-cc548d727f62 tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:34.400377 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5ea5a842-0177-4e6a-b074-cc548d727f62 tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:34.621498 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-5ea5a842-0177-4e6a-b074-cc548d727f62 tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2227b9cc7d9e4c5197dcd4aab63db2c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f376adb5640d4e0398a0213511fa3600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:34.648370 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-5ea5a842-0177-4e6a-b074-cc548d727f62 tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2227b9cc7d9e4c5197dcd4aab63db2c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f376adb5640d4e0398a0213511fa3600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:34.651569 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-5ea5a842-0177-4e6a-b074-cc548d727f62 tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2227b9cc7d9e4c5197dcd4aab63db2c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f376adb5640d4e0398a0213511fa3600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:34.674624 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-5ea5a842-0177-4e6a-b074-cc548d727f62 tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] 10.222.0.70 "GET /compute/v2.1/servers/edceebb6-8b39-4d52-9ee5-811329676649" status: 200 len: 1339 microversion: 2.47 time: 0.320393 Aug 27 03:01:34.675333 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2036/4100] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:01:34 2022] GET /compute/v2.1/servers/edceebb6-8b39-4d52-9ee5-811329676649 => generated 1339 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:01:34.708622 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b8aa15bc-1dd9-413a-a301-08e5b9fbf7b1 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:34.708952 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b8aa15bc-1dd9-413a-a301-08e5b9fbf7b1 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] [instance: 307f8788-d4c5-4bdc-9f4a-6cb6112a5b5a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:34.739138 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-f7b56738-1016-41f5-a3e1-bd94e29cd57b tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074fa9d1247548f1b93becab250d4772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8cb23407cc4d5db0379bf5227a0228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:34.756222 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-f7b56738-1016-41f5-a3e1-bd94e29cd57b tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] 10.222.0.70 "GET /compute/v2.1/servers/9e44ca00-de7b-4c39-893c-c61b0d845cd1" status: 200 len: 1517 microversion: 2.1 time: 0.436537 Aug 27 03:01:34.759726 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b8aa15bc-1dd9-413a-a301-08e5b9fbf7b1 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:34.760274 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2065/4101] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:01:34 2022] GET /compute/v2.1/servers/9e44ca00-de7b-4c39-893c-c61b0d845cd1 => generated 1517 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:01:34.772344 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b8aa15bc-1dd9-413a-a301-08e5b9fbf7b1 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:34.772344 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b8aa15bc-1dd9-413a-a301-08e5b9fbf7b1 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:34.773894 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b8aa15bc-1dd9-413a-a301-08e5b9fbf7b1 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:34.775340 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b8aa15bc-1dd9-413a-a301-08e5b9fbf7b1 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:34.778812 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b8aa15bc-1dd9-413a-a301-08e5b9fbf7b1 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:34.787586 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-43f6f1f9-a6ed-45f7-a9ba-ec74aea044bd tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:01:34.790049 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-43f6f1f9-a6ed-45f7-a9ba-ec74aea044bd tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] [instance: 9e44ca00-de7b-4c39-893c-c61b0d845cd1] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:34.822833 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-43f6f1f9-a6ed-45f7-a9ba-ec74aea044bd tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:34.839753 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-b8aa15bc-1dd9-413a-a301-08e5b9fbf7b1 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] HTTP exception thrown: Instance 307f8788-d4c5-4bdc-9f4a-6cb6112a5b5a could not be found. Aug 27 03:01:34.842200 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b8aa15bc-1dd9-413a-a301-08e5b9fbf7b1 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Request method failure captured: Aug 27 03:01:34.842200 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/servers/307f8788-d4c5-4bdc-9f4a-6cb6112a5b5a HTTP/1.1 Aug 27 03:01:34.842200 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 03:01:34.842200 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 03:01:34.842200 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 03:01:34.842200 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 03:01:34.842200 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 03:01:34.842200 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 03:01:34.842200 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 03:01:34.842200 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 03:01:34.842200 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYjkbqgJgsr3hyc81KpOlVkhbPH8hTmcErQjxmB07X1nFXx07NbTwpsPJ96lYABGUdoZIBr8EZxgP_sm2xJZVvB8gfIM0URDT7N_88841oa5sOBQoliA0B_3xyYjpxBHL6Agg0HRLEhyQP_ddIN5GVgUBkEmAPmPYX_U7YptboG33CI Aug 27 03:01:34.842200 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 03:01:34.842200 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 03:01:34.842200 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 03:01:34.842200 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 03:01:34.842200 n-d-852278-4 devstack@n-api.service[134052]: X-Openstack-Nova-Api-Version: 2.57 Aug 27 03:01:34.842200 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 03:01:34.842200 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 03:01:34.842200 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 827a290de2714759a70c51b12b520321 Aug 27 03:01:34.842200 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ServerShowV257Test-2041847120 Aug 27 03:01:34.842200 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 03:01:34.842200 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 03:01:34.842200 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/827a290de2714759a70c51b12b520321"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_827a290de2714759a70c51b12b520321", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/827a290de2714759a70c51b12b520321"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/827a290de2714759a70c51b12b520321"}]}] Aug 27 03:01:34.842200 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ServerShowV257Test-2041847120 Aug 27 03:01:34.842200 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 827a290de2714759a70c51b12b520321 Aug 27 03:01:34.842200 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ServerShowV257Test-2041847120 Aug 27 03:01:34.842200 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ServerShowV257Test-2041847120-project Aug 27 03:01:34.842200 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 03:01:34.842200 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 03:01:34.842200 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 107c58bcdad44bc29802d2588b93e26e Aug 27 03:01:34.842200 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ServerShowV257Test-2041847120-project Aug 27 03:01:34.842200 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 03:01:34.842200 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance 307f8788-d4c5-4bdc-9f4a-6cb6112a5b5a could not be found. Aug 27 03:01:34.842200 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '307f8788-d4c5-4bdc-9f4a-6cb6112a5b5a'} Aug 27 03:01:34.842200 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:01:34.842200 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:01:34.842200 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:01:34.842200 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:01:34.842200 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:01:34.842200 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:01:34.842200 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:01:34.842200 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:01:34.842200 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:01:34.842200 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:01:34.842200 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 307f8788-d4c5-4bdc-9f4a-6cb6112a5b5a could not be found. Aug 27 03:01:34.842200 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:01:34.842200 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:01:34.842200 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:01:34.842200 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:01:34.842200 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:01:34.842200 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:01:34.842200 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:01:34.842200 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:01:34.842200 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:01:34.842200 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:01:34.842200 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:01:34.842200 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:01:34.842200 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:01:34.842200 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:01:34.842200 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:01:34.842200 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:01:34.842200 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 307f8788-d4c5-4bdc-9f4a-6cb6112a5b5a could not be found. Aug 27 03:01:34.842200 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:01:34.842200 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:01:34.842200 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:01:34.846665 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:01:34.846665 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:01:34.846665 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:01:34.846665 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:01:34.846665 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:01:34.846665 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 307f8788-d4c5-4bdc-9f4a-6cb6112a5b5a could not be found. Aug 27 03:01:34.846665 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:01:34.846665 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b8aa15bc-1dd9-413a-a301-08e5b9fbf7b1 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] Returning 404 to user: Instance 307f8788-d4c5-4bdc-9f4a-6cb6112a5b5a could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:01:34.846665 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b8aa15bc-1dd9-413a-a301-08e5b9fbf7b1 tempest-ServerShowV257Test-2041847120 tempest-ServerShowV257Test-2041847120-project] 10.222.0.70 "GET /compute/v2.1/servers/307f8788-d4c5-4bdc-9f4a-6cb6112a5b5a" status: 404 len: 111 microversion: 2.57 time: 0.163188 Aug 27 03:01:34.846665 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2037/4102] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:01:34 2022] GET /compute/v2.1/servers/307f8788-d4c5-4bdc-9f4a-6cb6112a5b5a => generated 111 bytes in 169 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:01:34.854194 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-43f6f1f9-a6ed-45f7-a9ba-ec74aea044bd tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.031s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:34.855968 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-43f6f1f9-a6ed-45f7-a9ba-ec74aea044bd tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:34.857680 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-43f6f1f9-a6ed-45f7-a9ba-ec74aea044bd tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:34.860476 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-43f6f1f9-a6ed-45f7-a9ba-ec74aea044bd tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:34.862664 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-43f6f1f9-a6ed-45f7-a9ba-ec74aea044bd tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:34.906721 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.objects.instance [None req-43f6f1f9-a6ed-45f7-a9ba-ec74aea044bd tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lazy-loading 'flavor' on Instance uuid 9e44ca00-de7b-4c39-893c-c61b0d845cd1 {{(pid=134051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:01:35.122084 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-43f6f1f9-a6ed-45f7-a9ba-ec74aea044bd tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] 10.222.0.70 "POST /compute/v2.1/servers/9e44ca00-de7b-4c39-893c-c61b0d845cd1/action" status: 200 len: 32 microversion: 2.1 time: 0.344815 Aug 27 03:01:35.138742 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2066/4103] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:01:34 2022] POST /compute/v2.1/servers/9e44ca00-de7b-4c39-893c-c61b0d845cd1/action => generated 32 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:01:35.140751 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-252aacab-b280-4ee4-82e7-bb2c3ffc1a4e tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:35.143204 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-252aacab-b280-4ee4-82e7-bb2c3ffc1a4e tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] [instance: 9e44ca00-de7b-4c39-893c-c61b0d845cd1] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:35.154580 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-252aacab-b280-4ee4-82e7-bb2c3ffc1a4e tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:35.155232 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-252aacab-b280-4ee4-82e7-bb2c3ffc1a4e tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:35.158176 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-252aacab-b280-4ee4-82e7-bb2c3ffc1a4e tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:35.159505 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-252aacab-b280-4ee4-82e7-bb2c3ffc1a4e tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:35.160269 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-252aacab-b280-4ee4-82e7-bb2c3ffc1a4e tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:35.161078 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-252aacab-b280-4ee4-82e7-bb2c3ffc1a4e tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:35.701541 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f597eb4c-0a70-43ce-97eb-57ed8a40bc9c tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:35.702814 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-f597eb4c-0a70-43ce-97eb-57ed8a40bc9c tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] [instance: edceebb6-8b39-4d52-9ee5-811329676649] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:35.714298 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f597eb4c-0a70-43ce-97eb-57ed8a40bc9c tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:35.718544 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f597eb4c-0a70-43ce-97eb-57ed8a40bc9c tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:35.719221 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f597eb4c-0a70-43ce-97eb-57ed8a40bc9c tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:35.720157 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f597eb4c-0a70-43ce-97eb-57ed8a40bc9c tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:35.721582 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f597eb4c-0a70-43ce-97eb-57ed8a40bc9c tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:35.723505 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f597eb4c-0a70-43ce-97eb-57ed8a40bc9c tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:35.769306 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-252aacab-b280-4ee4-82e7-bb2c3ffc1a4e tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074fa9d1247548f1b93becab250d4772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8cb23407cc4d5db0379bf5227a0228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:35.787600 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-252aacab-b280-4ee4-82e7-bb2c3ffc1a4e tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] 10.222.0.70 "GET /compute/v2.1/servers/9e44ca00-de7b-4c39-893c-c61b0d845cd1" status: 200 len: 1523 microversion: 2.1 time: 0.655983 Aug 27 03:01:35.792084 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2038/4104] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:01:35 2022] GET /compute/v2.1/servers/9e44ca00-de7b-4c39-893c-c61b0d845cd1 => generated 1523 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:01:35.931657 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-f597eb4c-0a70-43ce-97eb-57ed8a40bc9c tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2227b9cc7d9e4c5197dcd4aab63db2c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f376adb5640d4e0398a0213511fa3600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:35.948142 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-f597eb4c-0a70-43ce-97eb-57ed8a40bc9c tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2227b9cc7d9e4c5197dcd4aab63db2c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f376adb5640d4e0398a0213511fa3600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:35.951449 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-f597eb4c-0a70-43ce-97eb-57ed8a40bc9c tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2227b9cc7d9e4c5197dcd4aab63db2c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f376adb5640d4e0398a0213511fa3600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:35.955398 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-f597eb4c-0a70-43ce-97eb-57ed8a40bc9c tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] 10.222.0.70 "GET /compute/v2.1/servers/edceebb6-8b39-4d52-9ee5-811329676649" status: 200 len: 1360 microversion: 2.47 time: 0.259815 Aug 27 03:01:35.957081 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2067/4105] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:01:35 2022] GET /compute/v2.1/servers/edceebb6-8b39-4d52-9ee5-811329676649 => generated 1360 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:01:35.962103 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6c00c38e-1d37-4984-ba80-86e3d70a5321 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:35.962758 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-6c00c38e-1d37-4984-ba80-86e3d70a5321 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] [instance: 9d9f666f-0b19-4d87-a94a-770b5d99f349] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:35.983284 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-756225eb-6b0b-4551-be4e-9b6fec2f1b5f tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1425203784"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:01:35.983619 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6c00c38e-1d37-4984-ba80-86e3d70a5321 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:35.984554 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6c00c38e-1d37-4984-ba80-86e3d70a5321 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:35.986168 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6c00c38e-1d37-4984-ba80-86e3d70a5321 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:35.986582 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-756225eb-6b0b-4551-be4e-9b6fec2f1b5f tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] [instance: edceebb6-8b39-4d52-9ee5-811329676649] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:35.990480 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6c00c38e-1d37-4984-ba80-86e3d70a5321 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:35.992489 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6c00c38e-1d37-4984-ba80-86e3d70a5321 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:35.994005 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6c00c38e-1d37-4984-ba80-86e3d70a5321 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:36.001608 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-756225eb-6b0b-4551-be4e-9b6fec2f1b5f tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:36.002215 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-756225eb-6b0b-4551-be4e-9b6fec2f1b5f tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:36.004117 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-756225eb-6b0b-4551-be4e-9b6fec2f1b5f tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:36.007275 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-756225eb-6b0b-4551-be4e-9b6fec2f1b5f tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:36.008218 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-756225eb-6b0b-4551-be4e-9b6fec2f1b5f tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:36.010328 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-756225eb-6b0b-4551-be4e-9b6fec2f1b5f tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:36.172983 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.instance [None req-6c00c38e-1d37-4984-ba80-86e3d70a5321 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lazy-loading 'services' on Instance uuid 9d9f666f-0b19-4d87-a94a-770b5d99f349 {{(pid=134052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:01:36.366907 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-6c00c38e-1d37-4984-ba80-86e3d70a5321 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] 10.222.0.70 "DELETE /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349/os-volume_attachments/79ce70d9-9092-4fb0-858b-5d6565740fa7" status: 202 len: 0 microversion: 2.1 time: 0.414717 Aug 27 03:01:36.367816 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2039/4106] 10.222.0.70 () {58 vars in 1416 bytes} [Sat Aug 27 03:01:35 2022] DELETE /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349/os-volume_attachments/79ce70d9-9092-4fb0-858b-5d6565740fa7 => generated 0 bytes in 417 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:01:36.471578 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:01:36.509585 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-756225eb-6b0b-4551-be4e-9b6fec2f1b5f tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] 10.222.0.70 "POST /compute/v2.1/servers/edceebb6-8b39-4d52-9ee5-811329676649/action" status: 202 len: 52 microversion: 2.47 time: 0.529331 Aug 27 03:01:36.514230 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2068/4107] 10.222.0.70 () {62 vars in 1319 bytes} [Sat Aug 27 03:01:35 2022] POST /compute/v2.1/servers/edceebb6-8b39-4d52-9ee5-811329676649/action => generated 52 bytes in 533 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Aug 27 03:01:36.523708 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-1d94c82f-e2cb-4a30-8681-cdb057b46706 tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:36.524288 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-1d94c82f-e2cb-4a30-8681-cdb057b46706 tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] [instance: edceebb6-8b39-4d52-9ee5-811329676649] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:36.544063 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1d94c82f-e2cb-4a30-8681-cdb057b46706 tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:36.544700 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1d94c82f-e2cb-4a30-8681-cdb057b46706 tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:36.546194 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1d94c82f-e2cb-4a30-8681-cdb057b46706 tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:36.547571 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1d94c82f-e2cb-4a30-8681-cdb057b46706 tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:36.548048 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1d94c82f-e2cb-4a30-8681-cdb057b46706 tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:36.548580 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1d94c82f-e2cb-4a30-8681-cdb057b46706 tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:36.605916 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-1d94c82f-e2cb-4a30-8681-cdb057b46706 tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] [instance: edceebb6-8b39-4d52-9ee5-811329676649] Going to try to terminate instance {{(pid=134052) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:01:36.777494 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-1d94c82f-e2cb-4a30-8681-cdb057b46706 tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] 10.222.0.70 "DELETE /compute/v2.1/servers/edceebb6-8b39-4d52-9ee5-811329676649" status: 204 len: 0 microversion: 2.47 time: 0.258494 Aug 27 03:01:36.778588 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2040/4108] 10.222.0.70 () {60 vars in 1280 bytes} [Sat Aug 27 03:01:36 2022] DELETE /compute/v2.1/servers/edceebb6-8b39-4d52-9ee5-811329676649 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 03:01:36.789513 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-75478604-d333-4c5f-88e3-921f60f48711 tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:36.790349 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-75478604-d333-4c5f-88e3-921f60f48711 tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] [instance: edceebb6-8b39-4d52-9ee5-811329676649] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:36.797897 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-75478604-d333-4c5f-88e3-921f60f48711 tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:36.798551 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-75478604-d333-4c5f-88e3-921f60f48711 tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:36.799334 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-75478604-d333-4c5f-88e3-921f60f48711 tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:36.800882 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-75478604-d333-4c5f-88e3-921f60f48711 tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:36.801654 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-75478604-d333-4c5f-88e3-921f60f48711 tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:36.802361 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-75478604-d333-4c5f-88e3-921f60f48711 tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:36.812719 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4343157f-4b4c-4d9f-9110-8676e1163bdb tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:36.813529 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-4343157f-4b4c-4d9f-9110-8676e1163bdb tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] [instance: 9e44ca00-de7b-4c39-893c-c61b0d845cd1] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:36.821507 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4343157f-4b4c-4d9f-9110-8676e1163bdb tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:36.822832 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4343157f-4b4c-4d9f-9110-8676e1163bdb tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:36.823552 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4343157f-4b4c-4d9f-9110-8676e1163bdb tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:36.824793 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4343157f-4b4c-4d9f-9110-8676e1163bdb tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:36.825414 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4343157f-4b4c-4d9f-9110-8676e1163bdb tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:36.826151 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4343157f-4b4c-4d9f-9110-8676e1163bdb tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:37.355239 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-75478604-d333-4c5f-88e3-921f60f48711 tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2227b9cc7d9e4c5197dcd4aab63db2c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f376adb5640d4e0398a0213511fa3600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:37.381910 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-75478604-d333-4c5f-88e3-921f60f48711 tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2227b9cc7d9e4c5197dcd4aab63db2c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f376adb5640d4e0398a0213511fa3600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:37.383673 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-75478604-d333-4c5f-88e3-921f60f48711 tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2227b9cc7d9e4c5197dcd4aab63db2c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f376adb5640d4e0398a0213511fa3600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:37.394958 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-75478604-d333-4c5f-88e3-921f60f48711 tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] 10.222.0.70 "GET /compute/v2.1/servers/edceebb6-8b39-4d52-9ee5-811329676649" status: 200 len: 1366 microversion: 2.47 time: 0.609188 Aug 27 03:01:37.396523 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2069/4109] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:01:36 2022] GET /compute/v2.1/servers/edceebb6-8b39-4d52-9ee5-811329676649 => generated 1366 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:01:38.037696 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-4343157f-4b4c-4d9f-9110-8676e1163bdb tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074fa9d1247548f1b93becab250d4772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8cb23407cc4d5db0379bf5227a0228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:38.054397 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-4343157f-4b4c-4d9f-9110-8676e1163bdb tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] 10.222.0.70 "GET /compute/v2.1/servers/9e44ca00-de7b-4c39-893c-c61b0d845cd1" status: 200 len: 1523 microversion: 2.1 time: 1.240298 Aug 27 03:01:38.055388 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2041/4110] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:01:36 2022] GET /compute/v2.1/servers/9e44ca00-de7b-4c39-893c-c61b0d845cd1 => generated 1523 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:01:38.441598 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e041ef5b-4bbd-4951-b5b1-2b41b609ec53 tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:38.442217 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-e041ef5b-4bbd-4951-b5b1-2b41b609ec53 tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] [instance: edceebb6-8b39-4d52-9ee5-811329676649] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:38.465233 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e041ef5b-4bbd-4951-b5b1-2b41b609ec53 tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:38.465746 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e041ef5b-4bbd-4951-b5b1-2b41b609ec53 tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:38.473383 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e041ef5b-4bbd-4951-b5b1-2b41b609ec53 tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:38.478420 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e041ef5b-4bbd-4951-b5b1-2b41b609ec53 tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:38.482673 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e041ef5b-4bbd-4951-b5b1-2b41b609ec53 tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:38.488048 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e041ef5b-4bbd-4951-b5b1-2b41b609ec53 tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:38.650116 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e041ef5b-4bbd-4951-b5b1-2b41b609ec53 tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2227b9cc7d9e4c5197dcd4aab63db2c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f376adb5640d4e0398a0213511fa3600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:38.658625 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e041ef5b-4bbd-4951-b5b1-2b41b609ec53 tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2227b9cc7d9e4c5197dcd4aab63db2c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f376adb5640d4e0398a0213511fa3600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:38.660163 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e041ef5b-4bbd-4951-b5b1-2b41b609ec53 tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2227b9cc7d9e4c5197dcd4aab63db2c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f376adb5640d4e0398a0213511fa3600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:38.663482 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e041ef5b-4bbd-4951-b5b1-2b41b609ec53 tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] 10.222.0.70 "GET /compute/v2.1/servers/edceebb6-8b39-4d52-9ee5-811329676649" status: 200 len: 1366 microversion: 2.47 time: 0.227721 Aug 27 03:01:38.667527 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2070/4111] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:01:38 2022] GET /compute/v2.1/servers/edceebb6-8b39-4d52-9ee5-811329676649 => generated 1366 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:01:39.077046 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-659909ee-d359-407c-9e7c-94a6255828ab tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:39.078779 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-659909ee-d359-407c-9e7c-94a6255828ab tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] [instance: 9e44ca00-de7b-4c39-893c-c61b0d845cd1] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:39.103787 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-659909ee-d359-407c-9e7c-94a6255828ab tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:39.112495 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-659909ee-d359-407c-9e7c-94a6255828ab tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:39.115014 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-659909ee-d359-407c-9e7c-94a6255828ab tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:39.121855 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-659909ee-d359-407c-9e7c-94a6255828ab tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:39.123380 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-659909ee-d359-407c-9e7c-94a6255828ab tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:39.125507 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-659909ee-d359-407c-9e7c-94a6255828ab tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:39.551398 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-659909ee-d359-407c-9e7c-94a6255828ab tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074fa9d1247548f1b93becab250d4772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8cb23407cc4d5db0379bf5227a0228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:39.562442 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-659909ee-d359-407c-9e7c-94a6255828ab tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] 10.222.0.70 "GET /compute/v2.1/servers/9e44ca00-de7b-4c39-893c-c61b0d845cd1" status: 200 len: 1523 microversion: 2.1 time: 0.491283 Aug 27 03:01:39.569775 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2042/4112] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:01:39 2022] GET /compute/v2.1/servers/9e44ca00-de7b-4c39-893c-c61b0d845cd1 => generated 1523 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:01:39.698968 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a5af386c-585a-4c0b-8b67-d54cb5e2cb57 tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:39.701484 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a5af386c-585a-4c0b-8b67-d54cb5e2cb57 tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] [instance: edceebb6-8b39-4d52-9ee5-811329676649] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:39.729244 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a5af386c-585a-4c0b-8b67-d54cb5e2cb57 tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:39.730127 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a5af386c-585a-4c0b-8b67-d54cb5e2cb57 tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:39.730783 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a5af386c-585a-4c0b-8b67-d54cb5e2cb57 tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:39.731726 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a5af386c-585a-4c0b-8b67-d54cb5e2cb57 tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:39.733599 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a5af386c-585a-4c0b-8b67-d54cb5e2cb57 tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:39.735507 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a5af386c-585a-4c0b-8b67-d54cb5e2cb57 tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:39.740170 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ee3604fb-b754-4d45-b825-489385fec1d7 tempest-QuotasTestJSON-1437407790 tempest-QuotasTestJSON-1437407790-project] Calling method '.version_select at 0x7f5edeee7550>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:39.866683 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ee3604fb-b754-4d45-b825-489385fec1d7 tempest-QuotasTestJSON-1437407790 tempest-QuotasTestJSON-1437407790-project] 10.222.0.70 "GET /compute/v2.1/os-quota-sets/740da8aaf54c4a06afcd0bebd21d1bce/defaults" status: 200 len: 371 microversion: 2.1 time: 0.411251 Aug 27 03:01:39.867623 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2071/4113] 10.222.0.70 () {58 vars in 1269 bytes} [Sat Aug 27 03:01:39 2022] GET /compute/v2.1/os-quota-sets/740da8aaf54c4a06afcd0bebd21d1bce/defaults => generated 371 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:01:39.891264 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-2a7c9a15-d263-4123-afdd-aea420cbeb87 tempest-QuotasTestJSON-1437407790 tempest-QuotasTestJSON-1437407790-project] Calling method '.version_select at 0x7f5edef32280>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:40.009773 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-2a7c9a15-d263-4123-afdd-aea420cbeb87 tempest-QuotasTestJSON-1437407790 tempest-QuotasTestJSON-1437407790-project] 10.222.0.70 "GET /compute/v2.1/os-quota-sets/740da8aaf54c4a06afcd0bebd21d1bce" status: 200 len: 371 microversion: 2.1 time: 0.122812 Aug 27 03:01:40.010922 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2072/4114] 10.222.0.70 () {58 vars in 1242 bytes} [Sat Aug 27 03:01:39 2022] GET /compute/v2.1/os-quota-sets/740da8aaf54c4a06afcd0bebd21d1bce => generated 371 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:01:40.016676 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-a5af386c-585a-4c0b-8b67-d54cb5e2cb57 tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2227b9cc7d9e4c5197dcd4aab63db2c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f376adb5640d4e0398a0213511fa3600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:40.035334 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-a5af386c-585a-4c0b-8b67-d54cb5e2cb57 tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2227b9cc7d9e4c5197dcd4aab63db2c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f376adb5640d4e0398a0213511fa3600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:40.038812 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-a5af386c-585a-4c0b-8b67-d54cb5e2cb57 tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2227b9cc7d9e4c5197dcd4aab63db2c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f376adb5640d4e0398a0213511fa3600', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:40.042473 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a5af386c-585a-4c0b-8b67-d54cb5e2cb57 tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] 10.222.0.70 "GET /compute/v2.1/servers/edceebb6-8b39-4d52-9ee5-811329676649" status: 200 len: 1366 microversion: 2.47 time: 0.353189 Aug 27 03:01:40.043467 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-317171d8-99aa-4bb0-9a6e-44bd6dc3a7a8 tempest-QuotasTestJSON-1437407790 tempest-QuotasTestJSON-1437407790-project] Calling method '.version_select at 0x7f5eded10430>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:40.049488 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2043/4115] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:01:39 2022] GET /compute/v2.1/servers/edceebb6-8b39-4d52-9ee5-811329676649 => generated 1366 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:01:40.164656 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-317171d8-99aa-4bb0-9a6e-44bd6dc3a7a8 tempest-QuotasTestJSON-1437407790 tempest-QuotasTestJSON-1437407790-project] 10.222.0.70 "GET /compute/v2.1/os-quota-sets/740da8aaf54c4a06afcd0bebd21d1bce/defaults" status: 200 len: 371 microversion: 2.1 time: 0.137702 Aug 27 03:01:40.165867 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2073/4116] 10.222.0.70 () {58 vars in 1269 bytes} [Sat Aug 27 03:01:40 2022] GET /compute/v2.1/os-quota-sets/740da8aaf54c4a06afcd0bebd21d1bce/defaults => generated 371 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:01:40.181566 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c60a043b-bb7f-4307-aaaf-4a6f0b71c68a tempest-QuotasTestJSON-1437407790 tempest-QuotasTestJSON-1437407790-project] Calling method '.version_select at 0x7f5ee2dffd30>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:40.234577 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:01:40.254980 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=6 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:01:40.321164 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c60a043b-bb7f-4307-aaaf-4a6f0b71c68a tempest-QuotasTestJSON-1437407790 tempest-QuotasTestJSON-1437407790-project] 10.222.0.70 "GET /compute/v2.1/os-quota-sets/740da8aaf54c4a06afcd0bebd21d1bce" status: 200 len: 371 microversion: 2.1 time: 0.145355 Aug 27 03:01:40.322913 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2044/4117] 10.222.0.70 () {58 vars in 1242 bytes} [Sat Aug 27 03:01:40 2022] GET /compute/v2.1/os-quota-sets/740da8aaf54c4a06afcd0bebd21d1bce => generated 371 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:01:40.334748 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0b3e8aaa-c0f7-43b7-a2d1-67ea1c5b0a27 tempest-QuotasTestJSON-1437407790 tempest-QuotasTestJSON-1437407790-project] Calling method '.version_select at 0x7f5edeb50f70>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:40.519231 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-0b3e8aaa-c0f7-43b7-a2d1-67ea1c5b0a27 tempest-QuotasTestJSON-1437407790 tempest-QuotasTestJSON-1437407790-project] 10.222.0.70 "GET /compute/v2.1/os-quota-sets/740da8aaf54c4a06afcd0bebd21d1bce?user_id=dcea943a84784383957b0d625db4c2a2" status: 200 len: 371 microversion: 2.1 time: 0.187573 Aug 27 03:01:40.521511 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2074/4118] 10.222.0.70 () {58 vars in 1323 bytes} [Sat Aug 27 03:01:40 2022] GET /compute/v2.1/os-quota-sets/740da8aaf54c4a06afcd0bebd21d1bce?user_id=dcea943a84784383957b0d625db4c2a2 => generated 371 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:01:40.590405 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a0adabeb-acae-4f6a-b172-ff668f11112f tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:40.591026 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a0adabeb-acae-4f6a-b172-ff668f11112f tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] [instance: 9e44ca00-de7b-4c39-893c-c61b0d845cd1] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:40.607419 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a0adabeb-acae-4f6a-b172-ff668f11112f tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:40.610159 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a0adabeb-acae-4f6a-b172-ff668f11112f tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:40.610609 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a0adabeb-acae-4f6a-b172-ff668f11112f tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:40.611333 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a0adabeb-acae-4f6a-b172-ff668f11112f tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:40.611782 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a0adabeb-acae-4f6a-b172-ff668f11112f tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:40.612199 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a0adabeb-acae-4f6a-b172-ff668f11112f tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:41.071897 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-a0adabeb-acae-4f6a-b172-ff668f11112f tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074fa9d1247548f1b93becab250d4772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8cb23407cc4d5db0379bf5227a0228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:41.075376 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-00d54243-9eee-446c-afba-965b8faca855 tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:41.076121 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-00d54243-9eee-446c-afba-965b8faca855 tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] [instance: edceebb6-8b39-4d52-9ee5-811329676649] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:41.091007 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a0adabeb-acae-4f6a-b172-ff668f11112f tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] 10.222.0.70 "GET /compute/v2.1/servers/9e44ca00-de7b-4c39-893c-c61b0d845cd1" status: 200 len: 1523 microversion: 2.1 time: 0.504503 Aug 27 03:01:41.094560 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2045/4119] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:01:40 2022] GET /compute/v2.1/servers/9e44ca00-de7b-4c39-893c-c61b0d845cd1 => generated 1523 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:01:41.120118 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-00d54243-9eee-446c-afba-965b8faca855 tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:41.120962 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-00d54243-9eee-446c-afba-965b8faca855 tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:41.123402 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-00d54243-9eee-446c-afba-965b8faca855 tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:41.130211 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-00d54243-9eee-446c-afba-965b8faca855 tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:41.132341 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-00d54243-9eee-446c-afba-965b8faca855 tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:41.136017 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-00d54243-9eee-446c-afba-965b8faca855 tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:41.178919 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-00d54243-9eee-446c-afba-965b8faca855 tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] HTTP exception thrown: Instance edceebb6-8b39-4d52-9ee5-811329676649 could not be found. Aug 27 03:01:41.184281 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-00d54243-9eee-446c-afba-965b8faca855 tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] Request method failure captured: Aug 27 03:01:41.184281 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/edceebb6-8b39-4d52-9ee5-811329676649 HTTP/1.1 Aug 27 03:01:41.184281 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 03:01:41.184281 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 03:01:41.184281 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 03:01:41.184281 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 03:01:41.184281 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 03:01:41.184281 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 03:01:41.184281 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 03:01:41.184281 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 03:01:41.184281 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYkJRBgBuBZ5GPs30_aHN5Qy1xmMpHCgof345mib2c5nSZVxYRLRgRQwN9skIx8zJ9rp52y28_WuiqSG0Ev5Gi0_aanTz3dT1HVb-atZny3phGSjZSIrM0jaTfvtINy76ddZO8OGtCrmBjcmke283bhynMA7LtKfK6BKWvkD0TwhG1o Aug 27 03:01:41.184281 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 03:01:41.184281 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 03:01:41.184281 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 03:01:41.184281 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 03:01:41.184281 n-d-852278-4 devstack@n-api.service[134051]: X-Openstack-Nova-Api-Version: 2.47 Aug 27 03:01:41.184281 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 03:01:41.184281 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 03:01:41.184281 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: f376adb5640d4e0398a0213511fa3600 Aug 27 03:01:41.184281 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ServersAaction247Test-1171439405 Aug 27 03:01:41.184281 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 03:01:41.184281 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 03:01:41.184281 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f376adb5640d4e0398a0213511fa3600"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f376adb5640d4e0398a0213511fa3600", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f376adb5640d4e0398a0213511fa3600"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f376adb5640d4e0398a0213511fa3600"}]}] Aug 27 03:01:41.184281 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ServersAaction247Test-1171439405 Aug 27 03:01:41.184281 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: f376adb5640d4e0398a0213511fa3600 Aug 27 03:01:41.184281 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ServersAaction247Test-1171439405 Aug 27 03:01:41.184281 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ServersAaction247Test-1171439405-project Aug 27 03:01:41.184281 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 03:01:41.184281 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 03:01:41.184281 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 2227b9cc7d9e4c5197dcd4aab63db2c4 Aug 27 03:01:41.184281 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ServersAaction247Test-1171439405-project Aug 27 03:01:41.184281 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 03:01:41.184281 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance edceebb6-8b39-4d52-9ee5-811329676649 could not be found. Aug 27 03:01:41.184281 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': 'edceebb6-8b39-4d52-9ee5-811329676649'} Aug 27 03:01:41.184281 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:01:41.184281 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:01:41.184281 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:01:41.184281 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:01:41.184281 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:01:41.184281 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:01:41.184281 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:01:41.184281 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:01:41.184281 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:01:41.184281 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:01:41.184281 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edceebb6-8b39-4d52-9ee5-811329676649 could not be found. Aug 27 03:01:41.184281 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:01:41.184281 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:01:41.184281 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:01:41.184281 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:01:41.184281 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:01:41.184281 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:01:41.184281 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:01:41.184281 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:01:41.184281 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:01:41.184281 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:01:41.184281 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:01:41.184281 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:01:41.184281 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:01:41.184281 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:01:41.184281 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:01:41.184281 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:01:41.184281 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edceebb6-8b39-4d52-9ee5-811329676649 could not be found. Aug 27 03:01:41.184281 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:01:41.184281 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:01:41.189088 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:01:41.189088 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:01:41.189088 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:01:41.189088 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:01:41.189088 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:01:41.189088 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:01:41.189088 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edceebb6-8b39-4d52-9ee5-811329676649 could not be found. Aug 27 03:01:41.189088 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:01:41.192055 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-00d54243-9eee-446c-afba-965b8faca855 tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] Returning 404 to user: Instance edceebb6-8b39-4d52-9ee5-811329676649 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:01:41.195582 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-00d54243-9eee-446c-afba-965b8faca855 tempest-ServersAaction247Test-1171439405 tempest-ServersAaction247Test-1171439405-project] 10.222.0.70 "GET /compute/v2.1/servers/edceebb6-8b39-4d52-9ee5-811329676649" status: 404 len: 111 microversion: 2.47 time: 0.124319 Aug 27 03:01:41.202023 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2075/4120] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:01:41 2022] GET /compute/v2.1/servers/edceebb6-8b39-4d52-9ee5-811329676649 => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:01:42.115015 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-7b806408-3478-485e-85e5-02b119d14e9a tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:42.116968 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-7b806408-3478-485e-85e5-02b119d14e9a tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] [instance: 9e44ca00-de7b-4c39-893c-c61b0d845cd1] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:42.132900 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7b806408-3478-485e-85e5-02b119d14e9a tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:42.136057 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7b806408-3478-485e-85e5-02b119d14e9a tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:42.138146 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7b806408-3478-485e-85e5-02b119d14e9a tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:42.140449 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7b806408-3478-485e-85e5-02b119d14e9a tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:42.141354 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7b806408-3478-485e-85e5-02b119d14e9a tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:42.142328 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7b806408-3478-485e-85e5-02b119d14e9a tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:42.431764 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-7b806408-3478-485e-85e5-02b119d14e9a tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074fa9d1247548f1b93becab250d4772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8cb23407cc4d5db0379bf5227a0228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:42.445470 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-7b806408-3478-485e-85e5-02b119d14e9a tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] 10.222.0.70 "GET /compute/v2.1/servers/9e44ca00-de7b-4c39-893c-c61b0d845cd1" status: 200 len: 1523 microversion: 2.1 time: 0.336359 Aug 27 03:01:42.446799 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2046/4121] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:01:42 2022] GET /compute/v2.1/servers/9e44ca00-de7b-4c39-893c-c61b0d845cd1 => generated 1523 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:01:43.467659 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0eb04296-1e23-4a17-9c4e-0b74aa29cd37 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:43.470626 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-0eb04296-1e23-4a17-9c4e-0b74aa29cd37 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] [instance: 9e44ca00-de7b-4c39-893c-c61b0d845cd1] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:43.505460 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0eb04296-1e23-4a17-9c4e-0b74aa29cd37 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:43.506183 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0eb04296-1e23-4a17-9c4e-0b74aa29cd37 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:43.508521 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0eb04296-1e23-4a17-9c4e-0b74aa29cd37 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:43.509478 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0eb04296-1e23-4a17-9c4e-0b74aa29cd37 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:43.510823 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0eb04296-1e23-4a17-9c4e-0b74aa29cd37 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:43.512852 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0eb04296-1e23-4a17-9c4e-0b74aa29cd37 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:43.830021 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-0eb04296-1e23-4a17-9c4e-0b74aa29cd37 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074fa9d1247548f1b93becab250d4772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8cb23407cc4d5db0379bf5227a0228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:43.842914 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-0eb04296-1e23-4a17-9c4e-0b74aa29cd37 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] 10.222.0.70 "GET /compute/v2.1/servers/9e44ca00-de7b-4c39-893c-c61b0d845cd1" status: 200 len: 1523 microversion: 2.1 time: 0.379442 Aug 27 03:01:43.844570 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2076/4122] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:01:43 2022] GET /compute/v2.1/servers/9e44ca00-de7b-4c39-893c-c61b0d845cd1 => generated 1523 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:01:44.868046 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-bc468762-8e9f-4eac-92d5-6b02151b4836 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:44.872190 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-bc468762-8e9f-4eac-92d5-6b02151b4836 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] [instance: 9e44ca00-de7b-4c39-893c-c61b0d845cd1] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:44.885462 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bc468762-8e9f-4eac-92d5-6b02151b4836 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:44.887515 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bc468762-8e9f-4eac-92d5-6b02151b4836 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:44.888869 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bc468762-8e9f-4eac-92d5-6b02151b4836 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:44.892568 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bc468762-8e9f-4eac-92d5-6b02151b4836 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:44.894101 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bc468762-8e9f-4eac-92d5-6b02151b4836 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:44.895669 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bc468762-8e9f-4eac-92d5-6b02151b4836 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:45.298091 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-bc468762-8e9f-4eac-92d5-6b02151b4836 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074fa9d1247548f1b93becab250d4772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8cb23407cc4d5db0379bf5227a0228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:45.306083 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:01:45.331421 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-bc468762-8e9f-4eac-92d5-6b02151b4836 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] 10.222.0.70 "GET /compute/v2.1/servers/9e44ca00-de7b-4c39-893c-c61b0d845cd1" status: 200 len: 1523 microversion: 2.1 time: 0.467111 Aug 27 03:01:45.335440 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2047/4123] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:01:44 2022] GET /compute/v2.1/servers/9e44ca00-de7b-4c39-893c-c61b0d845cd1 => generated 1523 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:01:46.355726 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-1cb1d40a-34ca-4dd6-b85b-68822b553781 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:46.356372 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-1cb1d40a-34ca-4dd6-b85b-68822b553781 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] [instance: 9e44ca00-de7b-4c39-893c-c61b0d845cd1] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:46.360757 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:01:46.383599 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1cb1d40a-34ca-4dd6-b85b-68822b553781 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:46.384844 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1cb1d40a-34ca-4dd6-b85b-68822b553781 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:46.386994 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1cb1d40a-34ca-4dd6-b85b-68822b553781 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:46.389038 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1cb1d40a-34ca-4dd6-b85b-68822b553781 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:46.390516 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1cb1d40a-34ca-4dd6-b85b-68822b553781 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:46.392096 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1cb1d40a-34ca-4dd6-b85b-68822b553781 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:46.821112 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-aafe0c73-7daf-4dc9-b7ae-2d2c5db7260e tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:01:46.833686 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-aafe0c73-7daf-4dc9-b7ae-2d2c5db7260e tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:46.835247 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-aafe0c73-7daf-4dc9-b7ae-2d2c5db7260e tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:46.836084 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-aafe0c73-7daf-4dc9-b7ae-2d2c5db7260e tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:46.927725 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-aafe0c73-7daf-4dc9-b7ae-2d2c5db7260e tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] [instance: 9d9f666f-0b19-4d87-a94a-770b5d99f349] Going to try to stop instance {{(pid=134052) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 27 03:01:47.091906 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-aafe0c73-7daf-4dc9-b7ae-2d2c5db7260e tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] 10.222.0.70 "POST /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349/action" status: 202 len: 0 microversion: 2.1 time: 0.275841 Aug 27 03:01:47.095492 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2048/4124] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:01:46 2022] POST /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349/action => generated 0 bytes in 281 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:01:47.150634 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-2da5786c-87a0-424a-ba09-fb3dddf5a580 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:47.162400 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-2da5786c-87a0-424a-ba09-fb3dddf5a580 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] [instance: 9d9f666f-0b19-4d87-a94a-770b5d99f349] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:47.182205 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2da5786c-87a0-424a-ba09-fb3dddf5a580 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:47.182717 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2da5786c-87a0-424a-ba09-fb3dddf5a580 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:47.183149 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2da5786c-87a0-424a-ba09-fb3dddf5a580 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:47.184343 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2da5786c-87a0-424a-ba09-fb3dddf5a580 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:47.184957 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2da5786c-87a0-424a-ba09-fb3dddf5a580 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:47.185667 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2da5786c-87a0-424a-ba09-fb3dddf5a580 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:47.259763 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-1cb1d40a-34ca-4dd6-b85b-68822b553781 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074fa9d1247548f1b93becab250d4772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8cb23407cc4d5db0379bf5227a0228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:47.273887 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-1cb1d40a-34ca-4dd6-b85b-68822b553781 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] 10.222.0.70 "GET /compute/v2.1/servers/9e44ca00-de7b-4c39-893c-c61b0d845cd1" status: 200 len: 1523 microversion: 2.1 time: 0.922508 Aug 27 03:01:47.277264 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2077/4125] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:01:46 2022] GET /compute/v2.1/servers/9e44ca00-de7b-4c39-893c-c61b0d845cd1 => generated 1523 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:01:48.085942 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-2da5786c-87a0-424a-ba09-fb3dddf5a580 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe0328160c6472086d13907344756cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41649f09cbf410a9825100c498b4916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:48.095450 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-2da5786c-87a0-424a-ba09-fb3dddf5a580 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] 10.222.0.70 "GET /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349" status: 200 len: 1675 microversion: 2.1 time: 0.995260 Aug 27 03:01:48.102504 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2049/4126] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:01:47 2022] GET /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349 => generated 1675 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:01:48.298112 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ca31a300-4c6d-48cb-9bbf-2e0dfad41ee6 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:48.298726 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-ca31a300-4c6d-48cb-9bbf-2e0dfad41ee6 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] [instance: 9e44ca00-de7b-4c39-893c-c61b0d845cd1] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:48.311343 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ca31a300-4c6d-48cb-9bbf-2e0dfad41ee6 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:48.312948 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ca31a300-4c6d-48cb-9bbf-2e0dfad41ee6 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:48.328137 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ca31a300-4c6d-48cb-9bbf-2e0dfad41ee6 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:48.331026 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ca31a300-4c6d-48cb-9bbf-2e0dfad41ee6 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:48.332563 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ca31a300-4c6d-48cb-9bbf-2e0dfad41ee6 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:48.334235 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ca31a300-4c6d-48cb-9bbf-2e0dfad41ee6 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:48.972122 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-ca31a300-4c6d-48cb-9bbf-2e0dfad41ee6 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074fa9d1247548f1b93becab250d4772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8cb23407cc4d5db0379bf5227a0228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:48.982837 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ca31a300-4c6d-48cb-9bbf-2e0dfad41ee6 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] 10.222.0.70 "GET /compute/v2.1/servers/9e44ca00-de7b-4c39-893c-c61b0d845cd1" status: 200 len: 1523 microversion: 2.1 time: 0.691021 Aug 27 03:01:48.998961 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2078/4127] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:01:48 2022] GET /compute/v2.1/servers/9e44ca00-de7b-4c39-893c-c61b0d845cd1 => generated 1523 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:01:49.129259 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d428bde2-4ba6-49f2-a831-cab2a93dbc7c tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:49.130041 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d428bde2-4ba6-49f2-a831-cab2a93dbc7c tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] [instance: 9d9f666f-0b19-4d87-a94a-770b5d99f349] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:49.144650 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d428bde2-4ba6-49f2-a831-cab2a93dbc7c tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:49.148966 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d428bde2-4ba6-49f2-a831-cab2a93dbc7c tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:49.149560 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d428bde2-4ba6-49f2-a831-cab2a93dbc7c tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:49.150590 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d428bde2-4ba6-49f2-a831-cab2a93dbc7c tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:49.151267 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d428bde2-4ba6-49f2-a831-cab2a93dbc7c tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:49.154090 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d428bde2-4ba6-49f2-a831-cab2a93dbc7c tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:49.769716 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-d428bde2-4ba6-49f2-a831-cab2a93dbc7c tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe0328160c6472086d13907344756cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41649f09cbf410a9825100c498b4916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:49.779952 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d428bde2-4ba6-49f2-a831-cab2a93dbc7c tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] 10.222.0.70 "GET /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349" status: 200 len: 1675 microversion: 2.1 time: 0.654603 Aug 27 03:01:49.783188 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2050/4128] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:01:49 2022] GET /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349 => generated 1675 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:01:50.005405 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-68e82aa3-2189-4bc4-9771-40abd28c7210 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:50.007042 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-68e82aa3-2189-4bc4-9771-40abd28c7210 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] [instance: 9e44ca00-de7b-4c39-893c-c61b0d845cd1] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:50.029705 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-68e82aa3-2189-4bc4-9771-40abd28c7210 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:50.036198 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-68e82aa3-2189-4bc4-9771-40abd28c7210 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:50.039106 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-68e82aa3-2189-4bc4-9771-40abd28c7210 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:50.046179 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-68e82aa3-2189-4bc4-9771-40abd28c7210 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:50.046997 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-68e82aa3-2189-4bc4-9771-40abd28c7210 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:50.048244 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-68e82aa3-2189-4bc4-9771-40abd28c7210 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:50.509954 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=8 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:01:50.806152 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9fb669f5-35de-404d-8dbe-59c83fc2f886 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:50.807293 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-9fb669f5-35de-404d-8dbe-59c83fc2f886 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] [instance: 9d9f666f-0b19-4d87-a94a-770b5d99f349] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:50.818520 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:01:50.834826 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9fb669f5-35de-404d-8dbe-59c83fc2f886 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:50.839445 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9fb669f5-35de-404d-8dbe-59c83fc2f886 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:50.842176 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9fb669f5-35de-404d-8dbe-59c83fc2f886 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:50.844007 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9fb669f5-35de-404d-8dbe-59c83fc2f886 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:50.846490 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9fb669f5-35de-404d-8dbe-59c83fc2f886 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:50.847165 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9fb669f5-35de-404d-8dbe-59c83fc2f886 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:50.866258 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-68e82aa3-2189-4bc4-9771-40abd28c7210 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074fa9d1247548f1b93becab250d4772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8cb23407cc4d5db0379bf5227a0228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:50.881648 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-68e82aa3-2189-4bc4-9771-40abd28c7210 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] 10.222.0.70 "GET /compute/v2.1/servers/9e44ca00-de7b-4c39-893c-c61b0d845cd1" status: 200 len: 1523 microversion: 2.1 time: 0.880733 Aug 27 03:01:50.884236 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2079/4129] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:01:49 2022] GET /compute/v2.1/servers/9e44ca00-de7b-4c39-893c-c61b0d845cd1 => generated 1523 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:01:51.412510 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-9fb669f5-35de-404d-8dbe-59c83fc2f886 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe0328160c6472086d13907344756cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41649f09cbf410a9825100c498b4916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:51.421653 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9fb669f5-35de-404d-8dbe-59c83fc2f886 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] 10.222.0.70 "GET /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349" status: 200 len: 1675 microversion: 2.1 time: 0.620597 Aug 27 03:01:51.422255 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2051/4130] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:01:50 2022] GET /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349 => generated 1675 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:01:51.904472 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d80a56b4-9071-4c41-ab5e-054c888bb818 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:51.905090 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d80a56b4-9071-4c41-ab5e-054c888bb818 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] [instance: 9e44ca00-de7b-4c39-893c-c61b0d845cd1] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:51.919980 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d80a56b4-9071-4c41-ab5e-054c888bb818 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:51.920452 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d80a56b4-9071-4c41-ab5e-054c888bb818 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:51.922503 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d80a56b4-9071-4c41-ab5e-054c888bb818 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:51.923444 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d80a56b4-9071-4c41-ab5e-054c888bb818 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:51.928723 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d80a56b4-9071-4c41-ab5e-054c888bb818 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:51.937736 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d80a56b4-9071-4c41-ab5e-054c888bb818 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:52.460622 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-faa49c2d-73f1-45e5-9a20-489657a7cbd4 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:52.462078 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-faa49c2d-73f1-45e5-9a20-489657a7cbd4 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] [instance: 9d9f666f-0b19-4d87-a94a-770b5d99f349] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:52.473567 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-faa49c2d-73f1-45e5-9a20-489657a7cbd4 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:52.479619 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-faa49c2d-73f1-45e5-9a20-489657a7cbd4 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:52.480296 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-faa49c2d-73f1-45e5-9a20-489657a7cbd4 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:52.481353 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-faa49c2d-73f1-45e5-9a20-489657a7cbd4 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:52.482027 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-faa49c2d-73f1-45e5-9a20-489657a7cbd4 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:52.484701 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-faa49c2d-73f1-45e5-9a20-489657a7cbd4 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:52.992955 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d80a56b4-9071-4c41-ab5e-054c888bb818 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074fa9d1247548f1b93becab250d4772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8cb23407cc4d5db0379bf5227a0228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:53.001315 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d80a56b4-9071-4c41-ab5e-054c888bb818 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] 10.222.0.70 "GET /compute/v2.1/servers/9e44ca00-de7b-4c39-893c-c61b0d845cd1" status: 200 len: 1523 microversion: 2.1 time: 1.100756 Aug 27 03:01:53.001917 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2080/4131] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:01:51 2022] GET /compute/v2.1/servers/9e44ca00-de7b-4c39-893c-c61b0d845cd1 => generated 1523 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:01:54.021605 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b7e85044-fcb5-4b82-87a7-ab7dee4062c8 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:54.022208 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b7e85044-fcb5-4b82-87a7-ab7dee4062c8 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] [instance: 9e44ca00-de7b-4c39-893c-c61b0d845cd1] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:54.032240 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b7e85044-fcb5-4b82-87a7-ab7dee4062c8 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:54.032801 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b7e85044-fcb5-4b82-87a7-ab7dee4062c8 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:54.033248 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b7e85044-fcb5-4b82-87a7-ab7dee4062c8 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:54.033976 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b7e85044-fcb5-4b82-87a7-ab7dee4062c8 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:54.034469 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b7e85044-fcb5-4b82-87a7-ab7dee4062c8 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:54.034901 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b7e85044-fcb5-4b82-87a7-ab7dee4062c8 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:54.260627 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-faa49c2d-73f1-45e5-9a20-489657a7cbd4 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe0328160c6472086d13907344756cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41649f09cbf410a9825100c498b4916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:54.272280 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-faa49c2d-73f1-45e5-9a20-489657a7cbd4 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] 10.222.0.70 "GET /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349" status: 200 len: 1675 microversion: 2.1 time: 1.821375 Aug 27 03:01:54.275909 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2052/4132] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:01:52 2022] GET /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349 => generated 1675 bytes in 1827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:01:54.942927 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-b7e85044-fcb5-4b82-87a7-ab7dee4062c8 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074fa9d1247548f1b93becab250d4772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8cb23407cc4d5db0379bf5227a0228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:54.954485 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b7e85044-fcb5-4b82-87a7-ab7dee4062c8 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] 10.222.0.70 "GET /compute/v2.1/servers/9e44ca00-de7b-4c39-893c-c61b0d845cd1" status: 200 len: 1523 microversion: 2.1 time: 0.936872 Aug 27 03:01:54.964609 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2081/4133] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:01:54 2022] GET /compute/v2.1/servers/9e44ca00-de7b-4c39-893c-c61b0d845cd1 => generated 1523 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:01:55.301455 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-75b394e1-1b3f-4050-9f4f-305a73341349 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:55.302077 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-75b394e1-1b3f-4050-9f4f-305a73341349 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] [instance: 9d9f666f-0b19-4d87-a94a-770b5d99f349] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:55.315575 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-75b394e1-1b3f-4050-9f4f-305a73341349 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:55.316098 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-75b394e1-1b3f-4050-9f4f-305a73341349 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:55.316594 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-75b394e1-1b3f-4050-9f4f-305a73341349 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:55.317312 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-75b394e1-1b3f-4050-9f4f-305a73341349 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:55.317768 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-75b394e1-1b3f-4050-9f4f-305a73341349 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:55.318199 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-75b394e1-1b3f-4050-9f4f-305a73341349 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:55.977935 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-6d52695d-30e8-492f-9191-60805247b3ae tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:55.978552 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-6d52695d-30e8-492f-9191-60805247b3ae tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] [instance: 9e44ca00-de7b-4c39-893c-c61b0d845cd1] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:55.991365 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6d52695d-30e8-492f-9191-60805247b3ae tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:55.991873 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6d52695d-30e8-492f-9191-60805247b3ae tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:55.994023 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6d52695d-30e8-492f-9191-60805247b3ae tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:55.997322 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6d52695d-30e8-492f-9191-60805247b3ae tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:55.999544 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6d52695d-30e8-492f-9191-60805247b3ae tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:56.002646 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6d52695d-30e8-492f-9191-60805247b3ae tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:56.093789 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-75b394e1-1b3f-4050-9f4f-305a73341349 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe0328160c6472086d13907344756cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41649f09cbf410a9825100c498b4916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:56.103880 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-75b394e1-1b3f-4050-9f4f-305a73341349 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] 10.222.0.70 "GET /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349" status: 200 len: 1675 microversion: 2.1 time: 0.806290 Aug 27 03:01:56.109837 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2053/4134] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:01:55 2022] GET /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349 => generated 1675 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:01:56.882898 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-6d52695d-30e8-492f-9191-60805247b3ae tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074fa9d1247548f1b93becab250d4772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8cb23407cc4d5db0379bf5227a0228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:56.911951 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-6d52695d-30e8-492f-9191-60805247b3ae tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] 10.222.0.70 "GET /compute/v2.1/servers/9e44ca00-de7b-4c39-893c-c61b0d845cd1" status: 200 len: 1523 microversion: 2.1 time: 0.937956 Aug 27 03:01:56.927584 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2082/4135] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:01:55 2022] GET /compute/v2.1/servers/9e44ca00-de7b-4c39-893c-c61b0d845cd1 => generated 1523 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:01:57.129906 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-45385e0b-b739-4701-8034-26ab6403d966 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:57.130847 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-45385e0b-b739-4701-8034-26ab6403d966 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] [instance: 9d9f666f-0b19-4d87-a94a-770b5d99f349] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:57.142903 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-45385e0b-b739-4701-8034-26ab6403d966 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:57.147973 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-45385e0b-b739-4701-8034-26ab6403d966 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:57.148638 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-45385e0b-b739-4701-8034-26ab6403d966 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:57.149668 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-45385e0b-b739-4701-8034-26ab6403d966 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:57.156336 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-45385e0b-b739-4701-8034-26ab6403d966 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:57.161228 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-45385e0b-b739-4701-8034-26ab6403d966 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:57.892725 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-45385e0b-b739-4701-8034-26ab6403d966 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe0328160c6472086d13907344756cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41649f09cbf410a9825100c498b4916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:57.913058 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-45385e0b-b739-4701-8034-26ab6403d966 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] 10.222.0.70 "GET /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349" status: 200 len: 1675 microversion: 2.1 time: 0.785677 Aug 27 03:01:57.915473 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2054/4136] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:01:57 2022] GET /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349 => generated 1675 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:01:57.945381 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8033de74-8195-40ed-9871-950ce4e62fea tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:57.947423 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-8033de74-8195-40ed-9871-950ce4e62fea tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] [instance: 9e44ca00-de7b-4c39-893c-c61b0d845cd1] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:57.969312 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8033de74-8195-40ed-9871-950ce4e62fea tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:57.971193 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8033de74-8195-40ed-9871-950ce4e62fea tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:57.972094 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8033de74-8195-40ed-9871-950ce4e62fea tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:57.976820 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8033de74-8195-40ed-9871-950ce4e62fea tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:57.977550 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8033de74-8195-40ed-9871-950ce4e62fea tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:57.978194 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8033de74-8195-40ed-9871-950ce4e62fea tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:58.942959 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-00b82b3a-98fd-48af-b9c0-f940eefd7ef0 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:58.945050 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-00b82b3a-98fd-48af-b9c0-f940eefd7ef0 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] [instance: 9d9f666f-0b19-4d87-a94a-770b5d99f349] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:58.975358 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-00b82b3a-98fd-48af-b9c0-f940eefd7ef0 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:58.975947 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-00b82b3a-98fd-48af-b9c0-f940eefd7ef0 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:58.976563 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-00b82b3a-98fd-48af-b9c0-f940eefd7ef0 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:58.979754 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-00b82b3a-98fd-48af-b9c0-f940eefd7ef0 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:58.985462 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-00b82b3a-98fd-48af-b9c0-f940eefd7ef0 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:58.986642 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-00b82b3a-98fd-48af-b9c0-f940eefd7ef0 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:59.068236 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-8033de74-8195-40ed-9871-950ce4e62fea tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074fa9d1247548f1b93becab250d4772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8cb23407cc4d5db0379bf5227a0228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:59.085288 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-8033de74-8195-40ed-9871-950ce4e62fea tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] 10.222.0.70 "GET /compute/v2.1/servers/9e44ca00-de7b-4c39-893c-c61b0d845cd1" status: 200 len: 1523 microversion: 2.1 time: 1.152221 Aug 27 03:01:59.097056 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2083/4137] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:01:57 2022] GET /compute/v2.1/servers/9e44ca00-de7b-4c39-893c-c61b0d845cd1 => generated 1523 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:01:59.822512 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-00b82b3a-98fd-48af-b9c0-f940eefd7ef0 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe0328160c6472086d13907344756cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41649f09cbf410a9825100c498b4916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:59.835884 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-00b82b3a-98fd-48af-b9c0-f940eefd7ef0 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] 10.222.0.70 "GET /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349" status: 200 len: 1652 microversion: 2.1 time: 0.899298 Aug 27 03:01:59.837078 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2055/4138] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:01:58 2022] GET /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349 => generated 1652 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:01:59.862450 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b7db60b1-1720-4a7d-a1af-de47e3a97535 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:01:59.875882 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b7db60b1-1720-4a7d-a1af-de47e3a97535 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:59.877191 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b7db60b1-1720-4a7d-a1af-de47e3a97535 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:59.877848 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b7db60b1-1720-4a7d-a1af-de47e3a97535 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:59.940112 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b7db60b1-1720-4a7d-a1af-de47e3a97535 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] [instance: 9d9f666f-0b19-4d87-a94a-770b5d99f349] Going to try to start instance {{(pid=134051) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 27 03:02:00.062648 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b7db60b1-1720-4a7d-a1af-de47e3a97535 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] 10.222.0.70 "POST /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349/action" status: 202 len: 0 microversion: 2.1 time: 0.205452 Aug 27 03:02:00.063583 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2084/4139] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:01:59 2022] POST /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349/action => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:02:00.073614 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6bdb1b10-a3f0-492b-ae8d-c9f04f2a9326 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:00.074402 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-6bdb1b10-a3f0-492b-ae8d-c9f04f2a9326 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] [instance: 9d9f666f-0b19-4d87-a94a-770b5d99f349] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:00.088694 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6bdb1b10-a3f0-492b-ae8d-c9f04f2a9326 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:00.089757 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6bdb1b10-a3f0-492b-ae8d-c9f04f2a9326 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:00.090887 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6bdb1b10-a3f0-492b-ae8d-c9f04f2a9326 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:00.093812 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6bdb1b10-a3f0-492b-ae8d-c9f04f2a9326 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:00.094637 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6bdb1b10-a3f0-492b-ae8d-c9f04f2a9326 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:00.096062 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6bdb1b10-a3f0-492b-ae8d-c9f04f2a9326 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:00.116432 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-76a2c004-83da-48ce-8f1d-706de29cb1e2 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:00.117840 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-76a2c004-83da-48ce-8f1d-706de29cb1e2 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] [instance: 9e44ca00-de7b-4c39-893c-c61b0d845cd1] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:00.137524 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-76a2c004-83da-48ce-8f1d-706de29cb1e2 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:00.158862 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-76a2c004-83da-48ce-8f1d-706de29cb1e2 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:00.159479 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-76a2c004-83da-48ce-8f1d-706de29cb1e2 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:00.160263 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-76a2c004-83da-48ce-8f1d-706de29cb1e2 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:00.160766 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-76a2c004-83da-48ce-8f1d-706de29cb1e2 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:00.164969 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-76a2c004-83da-48ce-8f1d-706de29cb1e2 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:01.051591 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-6bdb1b10-a3f0-492b-ae8d-c9f04f2a9326 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe0328160c6472086d13907344756cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41649f09cbf410a9825100c498b4916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:01.063061 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-6bdb1b10-a3f0-492b-ae8d-c9f04f2a9326 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] 10.222.0.70 "GET /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349" status: 200 len: 1661 microversion: 2.1 time: 0.993979 Aug 27 03:02:01.065437 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2056/4140] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:02:00 2022] GET /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349 => generated 1661 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:02:01.112524 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-76a2c004-83da-48ce-8f1d-706de29cb1e2 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074fa9d1247548f1b93becab250d4772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8cb23407cc4d5db0379bf5227a0228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:01.122889 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-76a2c004-83da-48ce-8f1d-706de29cb1e2 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] 10.222.0.70 "GET /compute/v2.1/servers/9e44ca00-de7b-4c39-893c-c61b0d845cd1" status: 200 len: 1523 microversion: 2.1 time: 1.016617 Aug 27 03:02:01.126896 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2085/4141] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:02:00 2022] GET /compute/v2.1/servers/9e44ca00-de7b-4c39-893c-c61b0d845cd1 => generated 1523 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:02:02.088085 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f807d296-75c2-4dc9-82cc-676abc763c65 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:02.089321 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-f807d296-75c2-4dc9-82cc-676abc763c65 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] [instance: 9d9f666f-0b19-4d87-a94a-770b5d99f349] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:02.129363 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f807d296-75c2-4dc9-82cc-676abc763c65 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:02.130060 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f807d296-75c2-4dc9-82cc-676abc763c65 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:02.130429 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f807d296-75c2-4dc9-82cc-676abc763c65 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:02.132055 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f807d296-75c2-4dc9-82cc-676abc763c65 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:02.133348 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f807d296-75c2-4dc9-82cc-676abc763c65 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:02.136346 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f807d296-75c2-4dc9-82cc-676abc763c65 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:02.262539 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-df8f2ac9-c7e9-45bc-bf08-b82a3ba88670 tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-52191290", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "networks": [{"uuid": "2353bc3b-ea41-482d-ba66-b05de8381ca5"}]}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:02:02.290107 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:02:02.446453 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.network.neutron [None req-df8f2ac9-c7e9-45bc-bf08-b82a3ba88670 tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] validate_networks() for [('2353bc3b-ea41-482d-ba66-b05de8381ca5', None, None, None, None, None)] {{(pid=134052) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:02:03.440301 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-f807d296-75c2-4dc9-82cc-676abc763c65 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe0328160c6472086d13907344756cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41649f09cbf410a9825100c498b4916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:03.459357 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-f807d296-75c2-4dc9-82cc-676abc763c65 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] 10.222.0.70 "GET /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349" status: 200 len: 1661 microversion: 2.1 time: 1.375861 Aug 27 03:02:03.459963 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2086/4142] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:02:02 2022] GET /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349 => generated 1661 bytes in 1377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:02:03.483809 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-97f79268-5bec-40a9-9f6c-8a611d857aa5 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:03.484451 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-97f79268-5bec-40a9-9f6c-8a611d857aa5 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] [instance: 9e44ca00-de7b-4c39-893c-c61b0d845cd1] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:03.513917 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-97f79268-5bec-40a9-9f6c-8a611d857aa5 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:03.514478 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-97f79268-5bec-40a9-9f6c-8a611d857aa5 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:03.514934 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-97f79268-5bec-40a9-9f6c-8a611d857aa5 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:03.515698 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-97f79268-5bec-40a9-9f6c-8a611d857aa5 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:03.516164 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-97f79268-5bec-40a9-9f6c-8a611d857aa5 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:03.516651 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-97f79268-5bec-40a9-9f6c-8a611d857aa5 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:04.676073 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-df8f2ac9-c7e9-45bc-bf08-b82a3ba88670 tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Flavor limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:02:04.677332 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-df8f2ac9-c7e9-45bc-bf08-b82a3ba88670 tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Image limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:02:04.678008 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-df8f2ac9-c7e9-45bc-bf08-b82a3ba88670 tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Flavor pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:02:04.679068 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-df8f2ac9-c7e9-45bc-bf08-b82a3ba88670 tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Image pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:02:04.679666 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-df8f2ac9-c7e9-45bc-bf08-b82a3ba88670 tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:02:04.702099 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-df8f2ac9-c7e9-45bc-bf08-b82a3ba88670 tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:04.710688 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-df8f2ac9-c7e9-45bc-bf08-b82a3ba88670 tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:04.711234 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-df8f2ac9-c7e9-45bc-bf08-b82a3ba88670 tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:04.712274 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-df8f2ac9-c7e9-45bc-bf08-b82a3ba88670 tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:04.712919 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-df8f2ac9-c7e9-45bc-bf08-b82a3ba88670 tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:04.714623 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-df8f2ac9-c7e9-45bc-bf08-b82a3ba88670 tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:04.740930 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-97f79268-5bec-40a9-9f6c-8a611d857aa5 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074fa9d1247548f1b93becab250d4772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8cb23407cc4d5db0379bf5227a0228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:04.748916 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-97f79268-5bec-40a9-9f6c-8a611d857aa5 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] 10.222.0.70 "GET /compute/v2.1/servers/9e44ca00-de7b-4c39-893c-c61b0d845cd1" status: 200 len: 1523 microversion: 2.1 time: 1.273600 Aug 27 03:02:04.749521 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2087/4143] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:02:03 2022] GET /compute/v2.1/servers/9e44ca00-de7b-4c39-893c-c61b0d845cd1 => generated 1523 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:02:04.758010 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c944a535-815b-44e2-bce9-da4558f4bbc6 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:04.758618 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-c944a535-815b-44e2-bce9-da4558f4bbc6 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] [instance: 9d9f666f-0b19-4d87-a94a-770b5d99f349] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:04.774036 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c944a535-815b-44e2-bce9-da4558f4bbc6 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:04.774535 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c944a535-815b-44e2-bce9-da4558f4bbc6 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:04.774982 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c944a535-815b-44e2-bce9-da4558f4bbc6 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:04.782321 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c944a535-815b-44e2-bce9-da4558f4bbc6 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:04.783057 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c944a535-815b-44e2-bce9-da4558f4bbc6 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:04.783517 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c944a535-815b-44e2-bce9-da4558f4bbc6 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:04.788369 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-df8f2ac9-c7e9-45bc-bf08-b82a3ba88670 tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Getting quotas for project 9d7a7f13f33342e3b29af0038862d625. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:02:04.807264 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-df8f2ac9-c7e9-45bc-bf08-b82a3ba88670 tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Getting quotas for user 0923e34eebfc4e289756d4c06897b771 and project 9d7a7f13f33342e3b29af0038862d625. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:02:04.849467 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-df8f2ac9-c7e9-45bc-bf08-b82a3ba88670 tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Going to run 1 instances... {{(pid=134052) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:02:04.852403 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-df8f2ac9-c7e9-45bc-bf08-b82a3ba88670 tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] [instance: 973cd6c9-b655-47b5-ac63-c6c033d3c408] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134052) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:02:04.854409 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:02:04.992128 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-df8f2ac9-c7e9-45bc-bf08-b82a3ba88670 tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.117497 Aug 27 03:02:04.995533 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2057/4144] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 03:02:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 3125 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:02:05.029612 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3654005d-4711-41fb-aafa-10c6c74b4dee tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:05.051940 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-3654005d-4711-41fb-aafa-10c6c74b4dee tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] [instance: 973cd6c9-b655-47b5-ac63-c6c033d3c408] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:05.249457 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-3654005d-4711-41fb-aafa-10c6c74b4dee tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0923e34eebfc4e289756d4c06897b771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7a7f13f33342e3b29af0038862d625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:05.267916 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-3654005d-4711-41fb-aafa-10c6c74b4dee tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] 10.222.0.70 "GET /compute/v2.1/servers/973cd6c9-b655-47b5-ac63-c6c033d3c408" status: 200 len: 1223 microversion: 2.1 time: 0.254257 Aug 27 03:02:05.268785 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2058/4145] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:02:05 2022] GET /compute/v2.1/servers/973cd6c9-b655-47b5-ac63-c6c033d3c408 => generated 1223 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:02:05.608641 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-c944a535-815b-44e2-bce9-da4558f4bbc6 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe0328160c6472086d13907344756cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41649f09cbf410a9825100c498b4916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:05.617398 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c944a535-815b-44e2-bce9-da4558f4bbc6 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] 10.222.0.70 "GET /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349" status: 200 len: 1665 microversion: 2.1 time: 0.866745 Aug 27 03:02:05.622694 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2088/4146] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:02:04 2022] GET /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349 => generated 1665 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:02:05.770712 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0c97c2f0-25eb-45c9-98e8-c2da0d050aa8 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:05.771448 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-0c97c2f0-25eb-45c9-98e8-c2da0d050aa8 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] [instance: 9e44ca00-de7b-4c39-893c-c61b0d845cd1] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:05.790680 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0c97c2f0-25eb-45c9-98e8-c2da0d050aa8 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:05.790680 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0c97c2f0-25eb-45c9-98e8-c2da0d050aa8 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:05.790680 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0c97c2f0-25eb-45c9-98e8-c2da0d050aa8 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:05.790680 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0c97c2f0-25eb-45c9-98e8-c2da0d050aa8 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:05.790680 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0c97c2f0-25eb-45c9-98e8-c2da0d050aa8 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:05.790680 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0c97c2f0-25eb-45c9-98e8-c2da0d050aa8 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:06.289667 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-840131f1-eaac-4d60-8484-d5176fc48bdb tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:06.290282 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-840131f1-eaac-4d60-8484-d5176fc48bdb tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] [instance: 973cd6c9-b655-47b5-ac63-c6c033d3c408] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:06.314058 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-840131f1-eaac-4d60-8484-d5176fc48bdb tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:06.318450 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-840131f1-eaac-4d60-8484-d5176fc48bdb tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:06.320158 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-840131f1-eaac-4d60-8484-d5176fc48bdb tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:06.325372 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-840131f1-eaac-4d60-8484-d5176fc48bdb tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:06.327574 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-840131f1-eaac-4d60-8484-d5176fc48bdb tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:06.331583 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-840131f1-eaac-4d60-8484-d5176fc48bdb tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:06.581650 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-840131f1-eaac-4d60-8484-d5176fc48bdb tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0923e34eebfc4e289756d4c06897b771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7a7f13f33342e3b29af0038862d625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:06.592629 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-840131f1-eaac-4d60-8484-d5176fc48bdb tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] 10.222.0.70 "GET /compute/v2.1/servers/973cd6c9-b655-47b5-ac63-c6c033d3c408" status: 200 len: 1219 microversion: 2.1 time: 0.306903 Aug 27 03:02:06.609261 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2089/4147] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:02:06 2022] GET /compute/v2.1/servers/973cd6c9-b655-47b5-ac63-c6c033d3c408 => generated 1219 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:02:06.793308 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0c97c2f0-25eb-45c9-98e8-c2da0d050aa8 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074fa9d1247548f1b93becab250d4772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8cb23407cc4d5db0379bf5227a0228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:06.810210 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-0c97c2f0-25eb-45c9-98e8-c2da0d050aa8 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] 10.222.0.70 "GET /compute/v2.1/servers/9e44ca00-de7b-4c39-893c-c61b0d845cd1" status: 200 len: 1503 microversion: 2.1 time: 1.043753 Aug 27 03:02:06.811994 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2059/4148] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:02:05 2022] GET /compute/v2.1/servers/9e44ca00-de7b-4c39-893c-c61b0d845cd1 => generated 1503 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:02:06.835917 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a21a6cd7-077d-4868-9f1b-2f1a5131c1a7 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Action: 'create', calling method: .version_select at 0x7f5ee72063a0>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-82442500", "description": "tempest-description-1168255481"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:02:07.834870 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-7a9519a1-3889-4750-acda-c6ace210a45c tempest-ServerGroup264TestJSON-1505825188 tempest-ServerGroup264TestJSON-1505825188-project] Action: 'create', calling method: .version_select at 0x7f5ee26b1310>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:02:07.880160 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-7a9519a1-3889-4750-acda-c6ace210a45c tempest-ServerGroup264TestJSON-1505825188 tempest-ServerGroup264TestJSON-1505825188-project] Getting quotas for project d2fe1708fc47414baeb7efbda417a8a4. Resources: {'server_groups'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:02:07.893962 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-7a9519a1-3889-4750-acda-c6ace210a45c tempest-ServerGroup264TestJSON-1505825188 tempest-ServerGroup264TestJSON-1505825188-project] Getting quotas for user b3fb08ca69a34ae39f4d787623a480e0 and project d2fe1708fc47414baeb7efbda417a8a4. Resources: {'server_groups'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:02:07.944709 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a21a6cd7-077d-4868-9f1b-2f1a5131c1a7 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] 10.222.0.70 "POST /compute/v2.1/os-security-groups" status: 200 len: 249 microversion: 2.1 time: 1.114119 Aug 27 03:02:07.945322 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2090/4149] 10.222.0.70 () {60 vars in 1180 bytes} [Sat Aug 27 03:02:06 2022] POST /compute/v2.1/os-security-groups => generated 249 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:02:07.961924 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-06e5df33-12c6-4eb3-b795-5b5c4243d8ae tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:07.962534 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-06e5df33-12c6-4eb3-b795-5b5c4243d8ae tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] [instance: 973cd6c9-b655-47b5-ac63-c6c033d3c408] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:07.973420 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-7a9519a1-3889-4750-acda-c6ace210a45c tempest-ServerGroup264TestJSON-1505825188 tempest-ServerGroup264TestJSON-1505825188-project] Getting quotas for project d2fe1708fc47414baeb7efbda417a8a4. Resources: {'server_groups'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:02:07.978768 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-06e5df33-12c6-4eb3-b795-5b5c4243d8ae tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:07.979263 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-06e5df33-12c6-4eb3-b795-5b5c4243d8ae tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:07.979703 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-06e5df33-12c6-4eb3-b795-5b5c4243d8ae tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:07.990151 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-06e5df33-12c6-4eb3-b795-5b5c4243d8ae tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:07.990772 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-06e5df33-12c6-4eb3-b795-5b5c4243d8ae tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:07.991222 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-06e5df33-12c6-4eb3-b795-5b5c4243d8ae tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:07.991453 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-7a9519a1-3889-4750-acda-c6ace210a45c tempest-ServerGroup264TestJSON-1505825188 tempest-ServerGroup264TestJSON-1505825188-project] Getting quotas for user b3fb08ca69a34ae39f4d787623a480e0 and project d2fe1708fc47414baeb7efbda417a8a4. Resources: {'server_groups'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:02:08.030025 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-7a9519a1-3889-4750-acda-c6ace210a45c tempest-ServerGroup264TestJSON-1505825188 tempest-ServerGroup264TestJSON-1505825188-project] 10.222.0.70 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.827060 Aug 27 03:02:08.035288 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2060/4150] 10.222.0.70 () {62 vars in 1214 bytes} [Sat Aug 27 03:02:07 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 03:02:08.048944 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-dcdf72e7-a1c5-4610-95ad-5632d7c1f6b9 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-82442500"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:02:08.050673 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-dcdf72e7-a1c5-4610-95ad-5632d7c1f6b9 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] [instance: 9e44ca00-de7b-4c39-893c-c61b0d845cd1] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:08.072642 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dcdf72e7-a1c5-4610-95ad-5632d7c1f6b9 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:08.073624 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dcdf72e7-a1c5-4610-95ad-5632d7c1f6b9 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:08.075459 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dcdf72e7-a1c5-4610-95ad-5632d7c1f6b9 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:08.076552 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dcdf72e7-a1c5-4610-95ad-5632d7c1f6b9 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:08.078588 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dcdf72e7-a1c5-4610-95ad-5632d7c1f6b9 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:08.080554 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dcdf72e7-a1c5-4610-95ad-5632d7c1f6b9 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:08.233483 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-06e5df33-12c6-4eb3-b795-5b5c4243d8ae tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0923e34eebfc4e289756d4c06897b771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7a7f13f33342e3b29af0038862d625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:08.245042 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-06e5df33-12c6-4eb3-b795-5b5c4243d8ae tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] 10.222.0.70 "GET /compute/v2.1/servers/973cd6c9-b655-47b5-ac63-c6c033d3c408" status: 200 len: 1281 microversion: 2.1 time: 0.287557 Aug 27 03:02:08.246981 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2091/4151] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:02:07 2022] GET /compute/v2.1/servers/973cd6c9-b655-47b5-ac63-c6c033d3c408 => generated 1281 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:02:08.276742 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3a695307-0e69-4da1-93b8-6a407b5ff7b9 tempest-ServerGroup264TestJSON-1505825188 tempest-ServerGroup264TestJSON-1505825188-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:08.309516 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-3a695307-0e69-4da1-93b8-6a407b5ff7b9 tempest-ServerGroup264TestJSON-1505825188 tempest-ServerGroup264TestJSON-1505825188-project] 10.222.0.70 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.044265 Aug 27 03:02:08.313437 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2092/4152] 10.222.0.70 () {60 vars in 1193 bytes} [Sat Aug 27 03:02:08 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:02:08.331372 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a66a210b-290b-4f45-b523-de4d0f7c8918 tempest-ServerGroup264TestJSON-1505825188 tempest-ServerGroup264TestJSON-1505825188-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:08.360538 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a66a210b-290b-4f45-b523-de4d0f7c8918 tempest-ServerGroup264TestJSON-1505825188 tempest-ServerGroup264TestJSON-1505825188-project] 10.222.0.70 "GET /compute/v2.1/os-server-groups/2afc8486-2641-46a6-8a2e-8021d4c62a6d" status: 200 len: 235 microversion: 2.64 time: 0.038819 Aug 27 03:02:08.369825 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2093/4153] 10.222.0.70 () {60 vars in 1304 bytes} [Sat Aug 27 03:02:08 2022] GET /compute/v2.1/os-server-groups/2afc8486-2641-46a6-8a2e-8021d4c62a6d => generated 235 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:02:08.381619 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-db2f51b4-4ffe-4391-ad4f-2bc6318b5233 tempest-ServerGroup264TestJSON-1505825188 tempest-ServerGroup264TestJSON-1505825188-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:08.476732 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-db2f51b4-4ffe-4391-ad4f-2bc6318b5233 tempest-ServerGroup264TestJSON-1505825188 tempest-ServerGroup264TestJSON-1505825188-project] 10.222.0.70 "DELETE /compute/v2.1/os-server-groups/2afc8486-2641-46a6-8a2e-8021d4c62a6d" status: 204 len: 0 microversion: 2.64 time: 0.105382 Aug 27 03:02:08.477629 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2094/4154] 10.222.0.70 () {60 vars in 1307 bytes} [Sat Aug 27 03:02:08 2022] DELETE /compute/v2.1/os-server-groups/2afc8486-2641-46a6-8a2e-8021d4c62a6d => generated 0 bytes in 107 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 03:02:08.486676 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c63b4be9-5bcb-4b3c-be50-624c6b37ab2f tempest-ServerGroup264TestJSON-1505825188 tempest-ServerGroup264TestJSON-1505825188-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:08.500801 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-c63b4be9-5bcb-4b3c-be50-624c6b37ab2f tempest-ServerGroup264TestJSON-1505825188 tempest-ServerGroup264TestJSON-1505825188-project] HTTP exception thrown: Instance group 2afc8486-2641-46a6-8a2e-8021d4c62a6d could not be found. Aug 27 03:02:08.507710 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c63b4be9-5bcb-4b3c-be50-624c6b37ab2f tempest-ServerGroup264TestJSON-1505825188 tempest-ServerGroup264TestJSON-1505825188-project] Request method failure captured: Aug 27 03:02:08.507710 n-d-852278-4 devstack@n-api.service[134051]: request: DELETE /compute/v2.1/os-server-groups/2afc8486-2641-46a6-8a2e-8021d4c62a6d HTTP/1.1 Aug 27 03:02:08.507710 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 03:02:08.507710 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 03:02:08.507710 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 03:02:08.507710 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 03:02:08.507710 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 03:02:08.507710 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 03:02:08.507710 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 03:02:08.507710 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 03:02:08.507710 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYkvsOMPHsi0CUKU5a77VpoQ8eHRQc5bfZbIruUal2Bf9KZf9Kx-KhliCXTJMyMW98QdyIErnFOif_5DAztQm8IlMZea0JNGCqC4Lgh2nmx99PCg8r7sld50M1psEcHsYX5RT_Vwr_jTiTC_li0bLole1fIyBICBOvgLtOSjPJ7qz08 Aug 27 03:02:08.507710 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 03:02:08.507710 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 03:02:08.507710 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 03:02:08.507710 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 03:02:08.507710 n-d-852278-4 devstack@n-api.service[134051]: X-Openstack-Nova-Api-Version: 2.64 Aug 27 03:02:08.507710 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 03:02:08.507710 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 03:02:08.507710 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: d2fe1708fc47414baeb7efbda417a8a4 Aug 27 03:02:08.507710 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ServerGroup264TestJSON-1505825188 Aug 27 03:02:08.507710 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 03:02:08.507710 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 03:02:08.507710 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d2fe1708fc47414baeb7efbda417a8a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d2fe1708fc47414baeb7efbda417a8a4", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d2fe1708fc47414baeb7efbda417a8a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d2fe1708fc47414baeb7efbda417a8a4"}]}] Aug 27 03:02:08.507710 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ServerGroup264TestJSON-1505825188 Aug 27 03:02:08.507710 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: d2fe1708fc47414baeb7efbda417a8a4 Aug 27 03:02:08.507710 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ServerGroup264TestJSON-1505825188 Aug 27 03:02:08.507710 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ServerGroup264TestJSON-1505825188-project Aug 27 03:02:08.507710 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 03:02:08.507710 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 03:02:08.507710 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: b3fb08ca69a34ae39f4d787623a480e0 Aug 27 03:02:08.507710 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ServerGroup264TestJSON-1505825188-project Aug 27 03:02:08.507710 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 03:02:08.507710 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance group 2afc8486-2641-46a6-8a2e-8021d4c62a6d could not be found. Aug 27 03:02:08.507710 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '2afc8486-2641-46a6-8a2e-8021d4c62a6d'} Aug 27 03:02:08.507710 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:02:08.507710 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:02:08.507710 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 27 03:02:08.507710 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 27 03:02:08.507710 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 03:02:08.507710 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 03:02:08.507710 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 27 03:02:08.507710 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 27 03:02:08.507710 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 03:02:08.507710 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 03:02:08.507710 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 27 03:02:08.507710 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 27 03:02:08.507710 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 2afc8486-2641-46a6-8a2e-8021d4c62a6d could not be found. Aug 27 03:02:08.507710 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:02:08.507710 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:02:08.507710 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:02:08.507710 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:02:08.507710 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:02:08.507710 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:02:08.507710 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:02:08.507710 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:02:08.507710 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:02:08.507710 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:02:08.507710 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 27 03:02:08.507710 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:02:08.507710 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 2afc8486-2641-46a6-8a2e-8021d4c62a6d could not be found. Aug 27 03:02:08.507710 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:02:08.507710 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:02:08.507710 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:02:08.507710 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:02:08.512830 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:02:08.512830 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:02:08.512830 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:02:08.512830 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:02:08.512830 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 2afc8486-2641-46a6-8a2e-8021d4c62a6d could not be found. Aug 27 03:02:08.512830 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:02:08.519275 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c63b4be9-5bcb-4b3c-be50-624c6b37ab2f tempest-ServerGroup264TestJSON-1505825188 tempest-ServerGroup264TestJSON-1505825188-project] Returning 404 to user: Instance group 2afc8486-2641-46a6-8a2e-8021d4c62a6d could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:02:08.530929 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c63b4be9-5bcb-4b3c-be50-624c6b37ab2f tempest-ServerGroup264TestJSON-1505825188 tempest-ServerGroup264TestJSON-1505825188-project] 10.222.0.70 "DELETE /compute/v2.1/os-server-groups/2afc8486-2641-46a6-8a2e-8021d4c62a6d" status: 404 len: 117 microversion: 2.64 time: 0.046227 Aug 27 03:02:08.532375 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2095/4155] 10.222.0.70 () {60 vars in 1307 bytes} [Sat Aug 27 03:02:08 2022] DELETE /compute/v2.1/os-server-groups/2afc8486-2641-46a6-8a2e-8021d4c62a6d => generated 117 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 27 03:02:08.626554 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.network.security_group_api [None req-dcdf72e7-a1c5-4610-95ad-5632d7c1f6b9 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Adding security group c7f03ff7-ab4c-4e2b-917e-d659ea23c2d6 to port 8445b37e-80d1-4feb-9fbc-fa886c48c08c Aug 27 03:02:09.266849 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-6a63c190-dff5-4e29-aaef-79f6b4fb9e83 tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:09.267447 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-6a63c190-dff5-4e29-aaef-79f6b4fb9e83 tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] [instance: 973cd6c9-b655-47b5-ac63-c6c033d3c408] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:09.274861 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6a63c190-dff5-4e29-aaef-79f6b4fb9e83 tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:09.275357 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6a63c190-dff5-4e29-aaef-79f6b4fb9e83 tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:09.275790 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6a63c190-dff5-4e29-aaef-79f6b4fb9e83 tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:09.276686 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6a63c190-dff5-4e29-aaef-79f6b4fb9e83 tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:09.277150 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6a63c190-dff5-4e29-aaef-79f6b4fb9e83 tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:09.277578 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6a63c190-dff5-4e29-aaef-79f6b4fb9e83 tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:09.453306 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-6a63c190-dff5-4e29-aaef-79f6b4fb9e83 tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0923e34eebfc4e289756d4c06897b771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7a7f13f33342e3b29af0038862d625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:09.470665 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-6a63c190-dff5-4e29-aaef-79f6b4fb9e83 tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] 10.222.0.70 "GET /compute/v2.1/servers/973cd6c9-b655-47b5-ac63-c6c033d3c408" status: 200 len: 1281 microversion: 2.1 time: 0.207493 Aug 27 03:02:09.480774 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2096/4156] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:02:09 2022] GET /compute/v2.1/servers/973cd6c9-b655-47b5-ac63-c6c033d3c408 => generated 1281 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:02:09.858095 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-dcdf72e7-a1c5-4610-95ad-5632d7c1f6b9 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] 10.222.0.70 "POST /compute/v2.1/servers/9e44ca00-de7b-4c39-893c-c61b0d845cd1/action" status: 202 len: 0 microversion: 2.1 time: 1.820706 Aug 27 03:02:09.859382 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2061/4157] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:02:08 2022] POST /compute/v2.1/servers/9e44ca00-de7b-4c39-893c-c61b0d845cd1/action => generated 0 bytes in 1823 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:02:09.874520 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b1c3ca1a-d2b3-4101-b265-feaf17a9b5f0 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-82442500"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:02:09.875931 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b1c3ca1a-d2b3-4101-b265-feaf17a9b5f0 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] [instance: 9e44ca00-de7b-4c39-893c-c61b0d845cd1] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:09.883767 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b1c3ca1a-d2b3-4101-b265-feaf17a9b5f0 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:09.885727 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b1c3ca1a-d2b3-4101-b265-feaf17a9b5f0 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:09.888802 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b1c3ca1a-d2b3-4101-b265-feaf17a9b5f0 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:09.893462 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b1c3ca1a-d2b3-4101-b265-feaf17a9b5f0 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:09.893988 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b1c3ca1a-d2b3-4101-b265-feaf17a9b5f0 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:09.894425 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b1c3ca1a-d2b3-4101-b265-feaf17a9b5f0 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:09.955625 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-5e422108-8dc9-485d-81a5-9b969764dcdd req-9112f396-5d02-4bb3-ac8c-de2e23ee3792 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e44ca00-de7b-4c39-893c-c61b0d845cd1", "tag": "8445b37e-80d1-4feb-9fbc-fa886c48c08c"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:02:09.993274 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-5e422108-8dc9-485d-81a5-9b969764dcdd req-9112f396-5d02-4bb3-ac8c-de2e23ee3792 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:09.993774 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-5e422108-8dc9-485d-81a5-9b969764dcdd req-9112f396-5d02-4bb3-ac8c-de2e23ee3792 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:09.994207 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-5e422108-8dc9-485d-81a5-9b969764dcdd req-9112f396-5d02-4bb3-ac8c-de2e23ee3792 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:10.025215 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-5e422108-8dc9-485d-81a5-9b969764dcdd req-9112f396-5d02-4bb3-ac8c-de2e23ee3792 service nova] Creating event network-changed:8445b37e-80d1-4feb-9fbc-fa886c48c08c for instance 9e44ca00-de7b-4c39-893c-c61b0d845cd1 on n-h2-852278-4 Aug 27 03:02:10.051870 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-5e422108-8dc9-485d-81a5-9b969764dcdd req-9112f396-5d02-4bb3-ac8c-de2e23ee3792 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100407 Aug 27 03:02:10.052545 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2062/4158] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:02:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:02:10.423055 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.network.security_group_api [None req-b1c3ca1a-d2b3-4101-b265-feaf17a9b5f0 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Removing security group c7f03ff7-ab4c-4e2b-917e-d659ea23c2d6 from port 8445b37e-80d1-4feb-9fbc-fa886c48c08c Aug 27 03:02:10.501114 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-74dc0ba0-73af-4bc8-8e57-e33ee3bca071 tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:10.504028 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-74dc0ba0-73af-4bc8-8e57-e33ee3bca071 tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] [instance: 973cd6c9-b655-47b5-ac63-c6c033d3c408] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:10.530579 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-74dc0ba0-73af-4bc8-8e57-e33ee3bca071 tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:10.531128 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-74dc0ba0-73af-4bc8-8e57-e33ee3bca071 tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:10.531579 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-74dc0ba0-73af-4bc8-8e57-e33ee3bca071 tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:10.532429 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-74dc0ba0-73af-4bc8-8e57-e33ee3bca071 tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:10.532986 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-74dc0ba0-73af-4bc8-8e57-e33ee3bca071 tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:10.533706 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-74dc0ba0-73af-4bc8-8e57-e33ee3bca071 tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:11.567498 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-74dc0ba0-73af-4bc8-8e57-e33ee3bca071 tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0923e34eebfc4e289756d4c06897b771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7a7f13f33342e3b29af0038862d625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:11.578040 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-74dc0ba0-73af-4bc8-8e57-e33ee3bca071 tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] 10.222.0.70 "GET /compute/v2.1/servers/973cd6c9-b655-47b5-ac63-c6c033d3c408" status: 200 len: 1323 microversion: 2.1 time: 1.082821 Aug 27 03:02:11.582706 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2063/4159] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:02:10 2022] GET /compute/v2.1/servers/973cd6c9-b655-47b5-ac63-c6c033d3c408 => generated 1323 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:02:12.358346 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b1c3ca1a-d2b3-4101-b265-feaf17a9b5f0 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] 10.222.0.70 "POST /compute/v2.1/servers/9e44ca00-de7b-4c39-893c-c61b0d845cd1/action" status: 202 len: 0 microversion: 2.1 time: 2.494046 Aug 27 03:02:12.359928 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2097/4160] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:02:09 2022] POST /compute/v2.1/servers/9e44ca00-de7b-4c39-893c-c61b0d845cd1/action => generated 0 bytes in 2496 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:02:12.370084 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-1ca1b4f5-8f28-4f5a-a6d4-21d1ce52dd88 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Action: 'create', calling method: .version_select at 0x7f5ee2419550>, body: {"pool": null} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:02:12.409533 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-d68149ca-bd29-4ebc-8549-438d79dcafe4 req-e4240b3d-643f-4e07-ac29-ee5e80e9ab4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e44ca00-de7b-4c39-893c-c61b0d845cd1", "tag": "8445b37e-80d1-4feb-9fbc-fa886c48c08c"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:02:12.429447 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-d68149ca-bd29-4ebc-8549-438d79dcafe4 req-e4240b3d-643f-4e07-ac29-ee5e80e9ab4a service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:12.430283 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-d68149ca-bd29-4ebc-8549-438d79dcafe4 req-e4240b3d-643f-4e07-ac29-ee5e80e9ab4a service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:12.430913 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-d68149ca-bd29-4ebc-8549-438d79dcafe4 req-e4240b3d-643f-4e07-ac29-ee5e80e9ab4a service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:12.444426 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-d68149ca-bd29-4ebc-8549-438d79dcafe4 req-e4240b3d-643f-4e07-ac29-ee5e80e9ab4a service nova] Creating event network-changed:8445b37e-80d1-4feb-9fbc-fa886c48c08c for instance 9e44ca00-de7b-4c39-893c-c61b0d845cd1 on n-h2-852278-4 Aug 27 03:02:12.459254 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-d68149ca-bd29-4ebc-8549-438d79dcafe4 req-e4240b3d-643f-4e07-ac29-ee5e80e9ab4a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054907 Aug 27 03:02:12.461499 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2098/4161] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:02:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:02:12.602516 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-80d97655-218d-4a32-a823-ec3790e09ab5 tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:12.606316 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-80d97655-218d-4a32-a823-ec3790e09ab5 tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] [instance: 973cd6c9-b655-47b5-ac63-c6c033d3c408] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:12.614618 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-80d97655-218d-4a32-a823-ec3790e09ab5 tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:12.615475 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-80d97655-218d-4a32-a823-ec3790e09ab5 tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:12.616300 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-80d97655-218d-4a32-a823-ec3790e09ab5 tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:12.617839 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-80d97655-218d-4a32-a823-ec3790e09ab5 tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:12.619612 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-80d97655-218d-4a32-a823-ec3790e09ab5 tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:12.620273 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-80d97655-218d-4a32-a823-ec3790e09ab5 tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:13.326935 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-80d97655-218d-4a32-a823-ec3790e09ab5 tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0923e34eebfc4e289756d4c06897b771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7a7f13f33342e3b29af0038862d625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:13.336329 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-80d97655-218d-4a32-a823-ec3790e09ab5 tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] 10.222.0.70 "GET /compute/v2.1/servers/973cd6c9-b655-47b5-ac63-c6c033d3c408" status: 200 len: 1323 microversion: 2.1 time: 0.738138 Aug 27 03:02:13.337852 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2099/4162] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:02:12 2022] GET /compute/v2.1/servers/973cd6c9-b655-47b5-ac63-c6c033d3c408 => generated 1323 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:02:14.358194 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-285dd2e3-8b5e-46ef-bf28-21f6e3e22a9c tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:14.358789 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-285dd2e3-8b5e-46ef-bf28-21f6e3e22a9c tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] [instance: 973cd6c9-b655-47b5-ac63-c6c033d3c408] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:14.372078 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-285dd2e3-8b5e-46ef-bf28-21f6e3e22a9c tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:14.373317 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-285dd2e3-8b5e-46ef-bf28-21f6e3e22a9c tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:14.374069 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-285dd2e3-8b5e-46ef-bf28-21f6e3e22a9c tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:14.374880 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-285dd2e3-8b5e-46ef-bf28-21f6e3e22a9c tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:14.375774 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-285dd2e3-8b5e-46ef-bf28-21f6e3e22a9c tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:14.376608 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-285dd2e3-8b5e-46ef-bf28-21f6e3e22a9c tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:14.747827 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:02:14.878844 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-285dd2e3-8b5e-46ef-bf28-21f6e3e22a9c tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0923e34eebfc4e289756d4c06897b771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7a7f13f33342e3b29af0038862d625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:14.890420 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-285dd2e3-8b5e-46ef-bf28-21f6e3e22a9c tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] 10.222.0.70 "GET /compute/v2.1/servers/973cd6c9-b655-47b5-ac63-c6c033d3c408" status: 200 len: 1323 microversion: 2.1 time: 0.536444 Aug 27 03:02:14.893192 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2100/4163] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:02:14 2022] GET /compute/v2.1/servers/973cd6c9-b655-47b5-ac63-c6c033d3c408 => generated 1323 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:02:14.901110 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-74ce4a5c-7444-4646-8e0f-ec1cf0cb4557 req-b378b64e-f363-4e04-bf36-74b5c4a4231e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "973cd6c9-b655-47b5-ac63-c6c033d3c408", "tag": "0e8f6e0b-a992-48ef-ba88-165c47d4a4c3"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:02:14.917661 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-74ce4a5c-7444-4646-8e0f-ec1cf0cb4557 req-b378b64e-f363-4e04-bf36-74b5c4a4231e service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:14.919750 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-74ce4a5c-7444-4646-8e0f-ec1cf0cb4557 req-b378b64e-f363-4e04-bf36-74b5c4a4231e service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:14.923388 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-74ce4a5c-7444-4646-8e0f-ec1cf0cb4557 req-b378b64e-f363-4e04-bf36-74b5c4a4231e service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:14.939148 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-74ce4a5c-7444-4646-8e0f-ec1cf0cb4557 req-b378b64e-f363-4e04-bf36-74b5c4a4231e service nova] Creating event network-changed:0e8f6e0b-a992-48ef-ba88-165c47d4a4c3 for instance 973cd6c9-b655-47b5-ac63-c6c033d3c408 on n-h1-852278-4 Aug 27 03:02:14.947329 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-74ce4a5c-7444-4646-8e0f-ec1cf0cb4557 req-b378b64e-f363-4e04-bf36-74b5c4a4231e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051744 Aug 27 03:02:14.950276 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2101/4164] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:02:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:02:15.914637 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-fa4e2047-bdc8-430d-ae61-7e0913b84f2b tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:15.916084 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-fa4e2047-bdc8-430d-ae61-7e0913b84f2b tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] [instance: 973cd6c9-b655-47b5-ac63-c6c033d3c408] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:15.931626 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fa4e2047-bdc8-430d-ae61-7e0913b84f2b tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:15.932405 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fa4e2047-bdc8-430d-ae61-7e0913b84f2b tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:15.933024 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fa4e2047-bdc8-430d-ae61-7e0913b84f2b tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:15.935348 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fa4e2047-bdc8-430d-ae61-7e0913b84f2b tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:15.938289 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fa4e2047-bdc8-430d-ae61-7e0913b84f2b tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:15.939011 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fa4e2047-bdc8-430d-ae61-7e0913b84f2b tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:16.279735 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-fa4e2047-bdc8-430d-ae61-7e0913b84f2b tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0923e34eebfc4e289756d4c06897b771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7a7f13f33342e3b29af0038862d625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:16.293292 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-fa4e2047-bdc8-430d-ae61-7e0913b84f2b tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] 10.222.0.70 "GET /compute/v2.1/servers/973cd6c9-b655-47b5-ac63-c6c033d3c408" status: 200 len: 1323 microversion: 2.1 time: 0.382368 Aug 27 03:02:16.295370 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2102/4165] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:02:15 2022] GET /compute/v2.1/servers/973cd6c9-b655-47b5-ac63-c6c033d3c408 => generated 1323 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:02:16.326054 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-1ca1b4f5-8f28-4f5a-a6d4-21d1ce52dd88 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] 10.222.0.70 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.960423 Aug 27 03:02:16.334100 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2064/4166] 10.222.0.70 () {60 vars in 1170 bytes} [Sat Aug 27 03:02:12 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3969 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:02:16.339480 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8e4e55da-35ad-4652-8511-a7f13ebb41c9 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.0.191"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:02:16.342930 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-8e4e55da-35ad-4652-8511-a7f13ebb41c9 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] [instance: 9e44ca00-de7b-4c39-893c-c61b0d845cd1] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:16.349780 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8e4e55da-35ad-4652-8511-a7f13ebb41c9 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:16.350268 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8e4e55da-35ad-4652-8511-a7f13ebb41c9 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:16.350703 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8e4e55da-35ad-4652-8511-a7f13ebb41c9 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:16.351782 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8e4e55da-35ad-4652-8511-a7f13ebb41c9 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:16.352244 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8e4e55da-35ad-4652-8511-a7f13ebb41c9 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:16.352786 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8e4e55da-35ad-4652-8511-a7f13ebb41c9 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:16.389959 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8e4e55da-35ad-4652-8511-a7f13ebb41c9 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Acquiring lock "refresh_cache-9e44ca00-de7b-4c39-893c-c61b0d845cd1" {{(pid=134051) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 27 03:02:16.390220 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8e4e55da-35ad-4652-8511-a7f13ebb41c9 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Acquired lock "refresh_cache-9e44ca00-de7b-4c39-893c-c61b0d845cd1" {{(pid=134051) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 27 03:02:17.315849 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a2a2dd37-84ca-4d23-b921-633544cc92cf tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:17.316838 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a2a2dd37-84ca-4d23-b921-633544cc92cf tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] [instance: 973cd6c9-b655-47b5-ac63-c6c033d3c408] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:17.322711 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a2a2dd37-84ca-4d23-b921-633544cc92cf tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:17.323464 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a2a2dd37-84ca-4d23-b921-633544cc92cf tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:17.323662 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a2a2dd37-84ca-4d23-b921-633544cc92cf tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:17.324357 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a2a2dd37-84ca-4d23-b921-633544cc92cf tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:17.325135 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a2a2dd37-84ca-4d23-b921-633544cc92cf tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:17.325278 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a2a2dd37-84ca-4d23-b921-633544cc92cf tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:17.348686 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:02:17.999640 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-a2a2dd37-84ca-4d23-b921-633544cc92cf tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0923e34eebfc4e289756d4c06897b771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7a7f13f33342e3b29af0038862d625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:18.008305 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a2a2dd37-84ca-4d23-b921-633544cc92cf tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] 10.222.0.70 "GET /compute/v2.1/servers/973cd6c9-b655-47b5-ac63-c6c033d3c408" status: 200 len: 1323 microversion: 2.1 time: 0.697199 Aug 27 03:02:18.027097 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2065/4167] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:02:17 2022] GET /compute/v2.1/servers/973cd6c9-b655-47b5-ac63-c6c033d3c408 => generated 1323 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:02:19.037101 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-44870040-f0dd-4c83-b36c-a7ab6596dd0b tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:19.038460 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-44870040-f0dd-4c83-b36c-a7ab6596dd0b tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] [instance: 973cd6c9-b655-47b5-ac63-c6c033d3c408] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:19.050730 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.network.neutron [None req-8e4e55da-35ad-4652-8511-a7f13ebb41c9 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] [instance: 9e44ca00-de7b-4c39-893c-c61b0d845cd1] Building network info cache for instance {{(pid=134051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 27 03:02:19.061309 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=16 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:02:19.079690 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-44870040-f0dd-4c83-b36c-a7ab6596dd0b tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:19.082937 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-44870040-f0dd-4c83-b36c-a7ab6596dd0b tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:19.083404 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-44870040-f0dd-4c83-b36c-a7ab6596dd0b tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:19.088723 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-44870040-f0dd-4c83-b36c-a7ab6596dd0b tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:19.093071 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-44870040-f0dd-4c83-b36c-a7ab6596dd0b tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:19.093563 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-44870040-f0dd-4c83-b36c-a7ab6596dd0b tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:19.342109 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-44870040-f0dd-4c83-b36c-a7ab6596dd0b tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0923e34eebfc4e289756d4c06897b771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7a7f13f33342e3b29af0038862d625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:19.351283 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-44870040-f0dd-4c83-b36c-a7ab6596dd0b tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] 10.222.0.70 "GET /compute/v2.1/servers/973cd6c9-b655-47b5-ac63-c6c033d3c408" status: 200 len: 1323 microversion: 2.1 time: 0.321246 Aug 27 03:02:19.373004 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2066/4168] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:02:19 2022] GET /compute/v2.1/servers/973cd6c9-b655-47b5-ac63-c6c033d3c408 => generated 1323 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:02:19.384757 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-33efc1fa-b215-4fb7-bab7-6fbbd9396b01 req-c0af85d0-a45e-41df-bbfe-274789a6ac84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e44ca00-de7b-4c39-893c-c61b0d845cd1", "tag": "8445b37e-80d1-4feb-9fbc-fa886c48c08c"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:02:19.407161 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-33efc1fa-b215-4fb7-bab7-6fbbd9396b01 req-c0af85d0-a45e-41df-bbfe-274789a6ac84 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:19.409410 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-33efc1fa-b215-4fb7-bab7-6fbbd9396b01 req-c0af85d0-a45e-41df-bbfe-274789a6ac84 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:19.410256 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-33efc1fa-b215-4fb7-bab7-6fbbd9396b01 req-c0af85d0-a45e-41df-bbfe-274789a6ac84 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:19.434551 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-33efc1fa-b215-4fb7-bab7-6fbbd9396b01 req-c0af85d0-a45e-41df-bbfe-274789a6ac84 service nova] Creating event network-changed:8445b37e-80d1-4feb-9fbc-fa886c48c08c for instance 9e44ca00-de7b-4c39-893c-c61b0d845cd1 on n-h2-852278-4 Aug 27 03:02:19.444087 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-33efc1fa-b215-4fb7-bab7-6fbbd9396b01 req-c0af85d0-a45e-41df-bbfe-274789a6ac84 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069452 Aug 27 03:02:19.448878 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2067/4169] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:02:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:02:20.360234 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-c6094861-cd66-401d-b12f-49560e59b5c3 req-189f4f39-9e64-4d9e-a6ec-eef2c54162c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "973cd6c9-b655-47b5-ac63-c6c033d3c408", "name": "network-vif-plugged", "status": "completed", "tag": "0e8f6e0b-a992-48ef-ba88-165c47d4a4c3"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:02:20.381391 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-c6094861-cd66-401d-b12f-49560e59b5c3 req-189f4f39-9e64-4d9e-a6ec-eef2c54162c5 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:20.382340 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-c6094861-cd66-401d-b12f-49560e59b5c3 req-189f4f39-9e64-4d9e-a6ec-eef2c54162c5 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:20.382977 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-c6094861-cd66-401d-b12f-49560e59b5c3 req-189f4f39-9e64-4d9e-a6ec-eef2c54162c5 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:20.443178 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-c6094861-cd66-401d-b12f-49560e59b5c3 req-189f4f39-9e64-4d9e-a6ec-eef2c54162c5 service nova] Creating event network-vif-plugged:0e8f6e0b-a992-48ef-ba88-165c47d4a4c3 for instance 973cd6c9-b655-47b5-ac63-c6c033d3c408 on n-h1-852278-4 Aug 27 03:02:20.451879 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-c6094861-cd66-401d-b12f-49560e59b5c3 req-189f4f39-9e64-4d9e-a6ec-eef2c54162c5 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096981 Aug 27 03:02:20.452544 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2068/4170] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:02:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:02:20.459039 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b426d771-7edf-4e35-932b-6ce860c5fd54 tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:20.459712 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b426d771-7edf-4e35-932b-6ce860c5fd54 tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] [instance: 973cd6c9-b655-47b5-ac63-c6c033d3c408] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:20.483512 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b426d771-7edf-4e35-932b-6ce860c5fd54 tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:20.484353 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b426d771-7edf-4e35-932b-6ce860c5fd54 tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:20.485013 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b426d771-7edf-4e35-932b-6ce860c5fd54 tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:20.485975 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b426d771-7edf-4e35-932b-6ce860c5fd54 tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:20.486650 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b426d771-7edf-4e35-932b-6ce860c5fd54 tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:20.488574 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b426d771-7edf-4e35-932b-6ce860c5fd54 tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:21.186358 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b426d771-7edf-4e35-932b-6ce860c5fd54 tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0923e34eebfc4e289756d4c06897b771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7a7f13f33342e3b29af0038862d625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:21.195129 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b426d771-7edf-4e35-932b-6ce860c5fd54 tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] 10.222.0.70 "GET /compute/v2.1/servers/973cd6c9-b655-47b5-ac63-c6c033d3c408" status: 200 len: 1323 microversion: 2.1 time: 0.740834 Aug 27 03:02:21.196025 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2069/4171] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:02:20 2022] GET /compute/v2.1/servers/973cd6c9-b655-47b5-ac63-c6c033d3c408 => generated 1323 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:02:21.749246 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.network.neutron [None req-8e4e55da-35ad-4652-8511-a7f13ebb41c9 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] [instance: 9e44ca00-de7b-4c39-893c-c61b0d845cd1] Updating instance_info_cache with network_info: [{"id": "8445b37e-80d1-4feb-9fbc-fa886c48c08c", "address": "fa:16:3e:4b:b8:34", "network": {"id": "750db57b-e38b-4e42-95a1-91ef26baf91f", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-539031234-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.0.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "fb8cb23407cc4d5db0379bf5227a0228", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap8445b37e-80", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=134051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 27 03:02:21.759803 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8e4e55da-35ad-4652-8511-a7f13ebb41c9 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Releasing lock "refresh_cache-9e44ca00-de7b-4c39-893c-c61b0d845cd1" {{(pid=134051) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 27 03:02:21.764338 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-8e4e55da-35ad-4652-8511-a7f13ebb41c9 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] 10.222.0.70 "POST /compute/v2.1/servers/9e44ca00-de7b-4c39-893c-c61b0d845cd1/action" status: 202 len: 0 microversion: 2.1 time: 5.428913 Aug 27 03:02:21.770489 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2103/4172] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:02:16 2022] POST /compute/v2.1/servers/9e44ca00-de7b-4c39-893c-c61b0d845cd1/action => generated 0 bytes in 5436 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 27 03:02:21.781653 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8689394a-6cfe-4fdf-981b-9f79aac6ced8 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.0.191"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:02:22.139695 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-8689394a-6cfe-4fdf-981b-9f79aac6ced8 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] [instance: 9e44ca00-de7b-4c39-893c-c61b0d845cd1] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:22.147032 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8689394a-6cfe-4fdf-981b-9f79aac6ced8 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:22.147531 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8689394a-6cfe-4fdf-981b-9f79aac6ced8 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:22.147965 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8689394a-6cfe-4fdf-981b-9f79aac6ced8 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:22.148718 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8689394a-6cfe-4fdf-981b-9f79aac6ced8 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:22.149170 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8689394a-6cfe-4fdf-981b-9f79aac6ced8 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:22.149592 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8689394a-6cfe-4fdf-981b-9f79aac6ced8 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:22.217287 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c105ae03-1d87-449f-b47f-2735256353bd tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:22.218369 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-c105ae03-1d87-449f-b47f-2735256353bd tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] [instance: 973cd6c9-b655-47b5-ac63-c6c033d3c408] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:22.225894 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=55,nova_api:DELETE=3 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:02:22.242144 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c105ae03-1d87-449f-b47f-2735256353bd tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:22.242966 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c105ae03-1d87-449f-b47f-2735256353bd tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:22.247581 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c105ae03-1d87-449f-b47f-2735256353bd tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:22.251225 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c105ae03-1d87-449f-b47f-2735256353bd tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:22.252356 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c105ae03-1d87-449f-b47f-2735256353bd tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:22.257184 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c105ae03-1d87-449f-b47f-2735256353bd tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:22.535522 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8689394a-6cfe-4fdf-981b-9f79aac6ced8 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Acquiring lock "refresh_cache-9e44ca00-de7b-4c39-893c-c61b0d845cd1" {{(pid=134052) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 27 03:02:22.536155 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8689394a-6cfe-4fdf-981b-9f79aac6ced8 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Acquired lock "refresh_cache-9e44ca00-de7b-4c39-893c-c61b0d845cd1" {{(pid=134052) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 27 03:02:22.640346 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-c105ae03-1d87-449f-b47f-2735256353bd tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0923e34eebfc4e289756d4c06897b771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7a7f13f33342e3b29af0038862d625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:22.655443 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c105ae03-1d87-449f-b47f-2735256353bd tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] 10.222.0.70 "GET /compute/v2.1/servers/973cd6c9-b655-47b5-ac63-c6c033d3c408" status: 200 len: 1520 microversion: 2.1 time: 0.442220 Aug 27 03:02:22.656996 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2104/4173] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:02:22 2022] GET /compute/v2.1/servers/973cd6c9-b655-47b5-ac63-c6c033d3c408 => generated 1520 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:02:22.684687 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-89e18588-54f9-4d28-a04f-f456e87188ef tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:22.685243 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-89e18588-54f9-4d28-a04f-f456e87188ef tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] [instance: 973cd6c9-b655-47b5-ac63-c6c033d3c408] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:22.694822 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-89e18588-54f9-4d28-a04f-f456e87188ef tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:22.696986 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-89e18588-54f9-4d28-a04f-f456e87188ef tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:22.697802 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-89e18588-54f9-4d28-a04f-f456e87188ef tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:22.698832 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-89e18588-54f9-4d28-a04f-f456e87188ef tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:22.700097 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-89e18588-54f9-4d28-a04f-f456e87188ef tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:22.700705 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-89e18588-54f9-4d28-a04f-f456e87188ef tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:22.785966 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-89e18588-54f9-4d28-a04f-f456e87188ef tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] HTTP exception thrown: Instance is not a member of specified network Aug 27 03:02:22.794726 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-89e18588-54f9-4d28-a04f-f456e87188ef tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Request method failure captured: Aug 27 03:02:22.794726 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/973cd6c9-b655-47b5-ac63-c6c033d3c408/ips/invalid HTTP/1.1 Aug 27 03:02:22.794726 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 03:02:22.794726 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 03:02:22.794726 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 03:02:22.794726 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 03:02:22.794726 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 03:02:22.794726 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 03:02:22.794726 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 03:02:22.794726 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 03:02:22.794726 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYkpJ1mGUrUjUDbfKYHgRc-H981f_yGwVgwBBf9KmzGjepekUeAUWhp81IOEkWAvC9Nu-89M9CXGntBJNHUAOyftEedw3fofMDGxButDYN_dXCESnJejPqKk5-imp7k2fh2jLGP_-GvWKBTrbtttbcgmjWyU51nxYlasXejXED_cWHk Aug 27 03:02:22.794726 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 03:02:22.794726 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 03:02:22.794726 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 03:02:22.794726 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 03:02:22.794726 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 03:02:22.794726 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 03:02:22.794726 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 9d7a7f13f33342e3b29af0038862d625 Aug 27 03:02:22.794726 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1563027824 Aug 27 03:02:22.794726 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 03:02:22.794726 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 03:02:22.794726 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9d7a7f13f33342e3b29af0038862d625"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_9d7a7f13f33342e3b29af0038862d625", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9d7a7f13f33342e3b29af0038862d625"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/9d7a7f13f33342e3b29af0038862d625"}]}] Aug 27 03:02:22.794726 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1563027824 Aug 27 03:02:22.794726 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 9d7a7f13f33342e3b29af0038862d625 Aug 27 03:02:22.794726 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1563027824 Aug 27 03:02:22.794726 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ServerAddressesNegativeTestJSON-1563027824-project Aug 27 03:02:22.794726 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 03:02:22.794726 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 03:02:22.794726 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 0923e34eebfc4e289756d4c06897b771 Aug 27 03:02:22.794726 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1563027824-project Aug 27 03:02:22.794726 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 03:02:22.794726 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance is not a member of specified network Aug 27 03:02:22.794726 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'server_id': '973cd6c9-b655-47b5-ac63-c6c033d3c408', 'id': 'invalid'} Aug 27 03:02:22.794726 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:02:22.794726 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:02:22.794726 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:02:22.794726 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:02:22.794726 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:02:22.794726 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:02:22.794726 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:02:22.794726 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:02:22.794726 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Aug 27 03:02:22.794726 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 27 03:02:22.794726 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Aug 27 03:02:22.794726 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:02:22.794726 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:02:22.794726 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:02:22.794726 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:02:22.794726 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:02:22.794726 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:02:22.794726 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:02:22.794726 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:02:22.794726 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Aug 27 03:02:22.794726 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:02:22.800769 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-89e18588-54f9-4d28-a04f-f456e87188ef tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Returning 404 to user: Instance is not a member of specified network {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:02:22.803308 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-89e18588-54f9-4d28-a04f-f456e87188ef tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] 10.222.0.70 "GET /compute/v2.1/servers/973cd6c9-b655-47b5-ac63-c6c033d3c408/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.124614 Aug 27 03:02:22.805359 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2105/4174] 10.222.0.70 () {58 vars in 1272 bytes} [Sat Aug 27 03:02:22 2022] GET /compute/v2.1/servers/973cd6c9-b655-47b5-ac63-c6c033d3c408/ips/invalid => generated 91 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 03:02:22.814644 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-2ae05058-487b-4535-81c0-1c17a2d805e2 tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:22.815297 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-2ae05058-487b-4535-81c0-1c17a2d805e2 tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Failed to fetch instance by id 999 {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 27 03:02:22.815911 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-2ae05058-487b-4535-81c0-1c17a2d805e2 tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] HTTP exception thrown: Instance 999 could not be found. Aug 27 03:02:22.817477 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-2ae05058-487b-4535-81c0-1c17a2d805e2 tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Request method failure captured: Aug 27 03:02:22.817477 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Aug 27 03:02:22.817477 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 03:02:22.817477 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 03:02:22.817477 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 03:02:22.817477 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 03:02:22.817477 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 03:02:22.817477 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 03:02:22.817477 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 03:02:22.817477 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 03:02:22.817477 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYkpJ1mGUrUjUDbfKYHgRc-H981f_yGwVgwBBf9KmzGjepekUeAUWhp81IOEkWAvC9Nu-89M9CXGntBJNHUAOyftEedw3fofMDGxButDYN_dXCESnJejPqKk5-imp7k2fh2jLGP_-GvWKBTrbtttbcgmjWyU51nxYlasXejXED_cWHk Aug 27 03:02:22.817477 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 03:02:22.817477 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 03:02:22.817477 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 03:02:22.817477 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 03:02:22.817477 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 03:02:22.817477 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 03:02:22.817477 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 9d7a7f13f33342e3b29af0038862d625 Aug 27 03:02:22.817477 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1563027824 Aug 27 03:02:22.817477 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 03:02:22.817477 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 03:02:22.817477 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9d7a7f13f33342e3b29af0038862d625"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_9d7a7f13f33342e3b29af0038862d625", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9d7a7f13f33342e3b29af0038862d625"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/9d7a7f13f33342e3b29af0038862d625"}]}] Aug 27 03:02:22.817477 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1563027824 Aug 27 03:02:22.817477 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 9d7a7f13f33342e3b29af0038862d625 Aug 27 03:02:22.817477 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1563027824 Aug 27 03:02:22.817477 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ServerAddressesNegativeTestJSON-1563027824-project Aug 27 03:02:22.817477 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 03:02:22.817477 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 03:02:22.817477 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 0923e34eebfc4e289756d4c06897b771 Aug 27 03:02:22.817477 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1563027824-project Aug 27 03:02:22.817477 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 03:02:22.817477 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance 999 could not be found. Aug 27 03:02:22.817477 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'server_id': '999'} Aug 27 03:02:22.817477 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:02:22.817477 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:02:22.817477 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:02:22.817477 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:02:22.817477 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 27 03:02:22.817477 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 27 03:02:22.817477 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Aug 27 03:02:22.817477 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:02:22.817477 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:02:22.817477 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:02:22.817477 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:02:22.817477 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:02:22.817477 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:02:22.817477 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:02:22.817477 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:02:22.817477 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:02:22.817477 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:02:22.817477 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Aug 27 03:02:22.817477 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Aug 27 03:02:22.817477 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:02:22.817477 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:02:22.817477 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Aug 27 03:02:22.817477 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:02:22.817477 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:02:22.817477 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:02:22.817477 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:02:22.817477 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:02:22.817477 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:02:22.817477 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:02:22.817477 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:02:22.817477 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Aug 27 03:02:22.817477 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:02:22.823457 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-2ae05058-487b-4535-81c0-1c17a2d805e2 tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Returning 404 to user: Instance 999 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:02:22.823457 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-2ae05058-487b-4535-81c0-1c17a2d805e2 tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] 10.222.0.70 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.010258 Aug 27 03:02:22.827682 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2106/4175] 10.222.0.70 () {58 vars in 1149 bytes} [Sat Aug 27 03:02:22 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 03:02:22.833375 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d5c09949-aea4-486f-9eae-86687d44a3ba tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:22.833982 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d5c09949-aea4-486f-9eae-86687d44a3ba tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] [instance: 973cd6c9-b655-47b5-ac63-c6c033d3c408] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:22.842413 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d5c09949-aea4-486f-9eae-86687d44a3ba tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:22.843019 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d5c09949-aea4-486f-9eae-86687d44a3ba tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:22.843559 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d5c09949-aea4-486f-9eae-86687d44a3ba tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:22.844538 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d5c09949-aea4-486f-9eae-86687d44a3ba tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:22.845104 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d5c09949-aea4-486f-9eae-86687d44a3ba tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:22.845625 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d5c09949-aea4-486f-9eae-86687d44a3ba tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:22.881223 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d5c09949-aea4-486f-9eae-86687d44a3ba tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] [instance: 973cd6c9-b655-47b5-ac63-c6c033d3c408] Going to try to terminate instance {{(pid=134051) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:02:23.029053 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d5c09949-aea4-486f-9eae-86687d44a3ba tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] 10.222.0.70 "DELETE /compute/v2.1/servers/973cd6c9-b655-47b5-ac63-c6c033d3c408" status: 204 len: 0 microversion: 2.1 time: 0.198299 Aug 27 03:02:23.030592 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2107/4176] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 03:02:22 2022] DELETE /compute/v2.1/servers/973cd6c9-b655-47b5-ac63-c6c033d3c408 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:02:23.046338 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e5efc39a-21af-4f58-9b0c-5d488f95f037 tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:23.048366 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-e5efc39a-21af-4f58-9b0c-5d488f95f037 tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] [instance: 973cd6c9-b655-47b5-ac63-c6c033d3c408] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:23.060187 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e5efc39a-21af-4f58-9b0c-5d488f95f037 tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:23.061228 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e5efc39a-21af-4f58-9b0c-5d488f95f037 tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:23.062724 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e5efc39a-21af-4f58-9b0c-5d488f95f037 tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:23.065003 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e5efc39a-21af-4f58-9b0c-5d488f95f037 tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:23.065685 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e5efc39a-21af-4f58-9b0c-5d488f95f037 tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:23.067104 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e5efc39a-21af-4f58-9b0c-5d488f95f037 tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:23.437961 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e5efc39a-21af-4f58-9b0c-5d488f95f037 tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0923e34eebfc4e289756d4c06897b771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7a7f13f33342e3b29af0038862d625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:23.470015 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e5efc39a-21af-4f58-9b0c-5d488f95f037 tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] 10.222.0.70 "GET /compute/v2.1/servers/973cd6c9-b655-47b5-ac63-c6c033d3c408" status: 200 len: 1526 microversion: 2.1 time: 0.433867 Aug 27 03:02:23.492130 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2108/4177] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:02:23 2022] GET /compute/v2.1/servers/973cd6c9-b655-47b5-ac63-c6c033d3c408 => generated 1526 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:02:23.795392 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.network.neutron [None req-8689394a-6cfe-4fdf-981b-9f79aac6ced8 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] [instance: 9e44ca00-de7b-4c39-893c-c61b0d845cd1] Building network info cache for instance {{(pid=134052) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 27 03:02:23.804130 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-b52087f8-84eb-436e-9e7e-724f1e988a3d req-f3915a37-9d47-4245-a551-40719af9788c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e44ca00-de7b-4c39-893c-c61b0d845cd1", "tag": "8445b37e-80d1-4feb-9fbc-fa886c48c08c"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:02:23.822217 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-b52087f8-84eb-436e-9e7e-724f1e988a3d req-f3915a37-9d47-4245-a551-40719af9788c service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:23.822690 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-b52087f8-84eb-436e-9e7e-724f1e988a3d req-f3915a37-9d47-4245-a551-40719af9788c service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:23.823407 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-b52087f8-84eb-436e-9e7e-724f1e988a3d req-f3915a37-9d47-4245-a551-40719af9788c service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:23.849668 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-b52087f8-84eb-436e-9e7e-724f1e988a3d req-f3915a37-9d47-4245-a551-40719af9788c service nova] Creating event network-changed:8445b37e-80d1-4feb-9fbc-fa886c48c08c for instance 9e44ca00-de7b-4c39-893c-c61b0d845cd1 on n-h2-852278-4 Aug 27 03:02:23.861794 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-b52087f8-84eb-436e-9e7e-724f1e988a3d req-f3915a37-9d47-4245-a551-40719af9788c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058727 Aug 27 03:02:23.864278 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2109/4178] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:02:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:02:24.494799 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-6c65f71f-1498-46f6-8f30-011f9737c795 tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:24.495580 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-6c65f71f-1498-46f6-8f30-011f9737c795 tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] [instance: 973cd6c9-b655-47b5-ac63-c6c033d3c408] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:24.503669 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6c65f71f-1498-46f6-8f30-011f9737c795 tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:24.505050 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6c65f71f-1498-46f6-8f30-011f9737c795 tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:24.505952 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6c65f71f-1498-46f6-8f30-011f9737c795 tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:24.507196 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6c65f71f-1498-46f6-8f30-011f9737c795 tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:24.508518 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6c65f71f-1498-46f6-8f30-011f9737c795 tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:24.509882 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6c65f71f-1498-46f6-8f30-011f9737c795 tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:25.120413 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-6c65f71f-1498-46f6-8f30-011f9737c795 tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0923e34eebfc4e289756d4c06897b771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7a7f13f33342e3b29af0038862d625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:25.135639 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-6c65f71f-1498-46f6-8f30-011f9737c795 tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] 10.222.0.70 "GET /compute/v2.1/servers/973cd6c9-b655-47b5-ac63-c6c033d3c408" status: 200 len: 1526 microversion: 2.1 time: 0.645527 Aug 27 03:02:25.136665 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2110/4179] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:02:24 2022] GET /compute/v2.1/servers/973cd6c9-b655-47b5-ac63-c6c033d3c408 => generated 1526 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:02:25.863081 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.network.neutron [None req-8689394a-6cfe-4fdf-981b-9f79aac6ced8 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] [instance: 9e44ca00-de7b-4c39-893c-c61b0d845cd1] Updating instance_info_cache with network_info: [{"id": "8445b37e-80d1-4feb-9fbc-fa886c48c08c", "address": "fa:16:3e:4b:b8:34", "network": {"id": "750db57b-e38b-4e42-95a1-91ef26baf91f", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-539031234-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "fb8cb23407cc4d5db0379bf5227a0228", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap8445b37e-80", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=134052) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 27 03:02:25.878500 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8689394a-6cfe-4fdf-981b-9f79aac6ced8 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Releasing lock "refresh_cache-9e44ca00-de7b-4c39-893c-c61b0d845cd1" {{(pid=134052) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 27 03:02:25.880205 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-8689394a-6cfe-4fdf-981b-9f79aac6ced8 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] 10.222.0.70 "POST /compute/v2.1/servers/9e44ca00-de7b-4c39-893c-c61b0d845cd1/action" status: 202 len: 0 microversion: 2.1 time: 4.108094 Aug 27 03:02:25.881070 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2070/4180] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:02:21 2022] POST /compute/v2.1/servers/9e44ca00-de7b-4c39-893c-c61b0d845cd1/action => generated 0 bytes in 4110 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 27 03:02:25.894331 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-fd38f007-83df-4ccf-95d2-a2b364abf0fc tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Calling method '.version_select at 0x7f5ede193a60>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:26.167643 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-1bfadbaf-5892-4630-864e-d2e599edbce3 tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:26.174122 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-1bfadbaf-5892-4630-864e-d2e599edbce3 tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] [instance: 973cd6c9-b655-47b5-ac63-c6c033d3c408] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:26.200910 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1bfadbaf-5892-4630-864e-d2e599edbce3 tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:26.204132 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1bfadbaf-5892-4630-864e-d2e599edbce3 tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:26.204885 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1bfadbaf-5892-4630-864e-d2e599edbce3 tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:26.206333 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1bfadbaf-5892-4630-864e-d2e599edbce3 tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:26.207145 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1bfadbaf-5892-4630-864e-d2e599edbce3 tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:26.207818 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1bfadbaf-5892-4630-864e-d2e599edbce3 tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:26.435059 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-1bfadbaf-5892-4630-864e-d2e599edbce3 tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0923e34eebfc4e289756d4c06897b771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7a7f13f33342e3b29af0038862d625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:26.464169 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-1bfadbaf-5892-4630-864e-d2e599edbce3 tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] 10.222.0.70 "GET /compute/v2.1/servers/973cd6c9-b655-47b5-ac63-c6c033d3c408" status: 200 len: 1484 microversion: 2.1 time: 0.305926 Aug 27 03:02:26.467788 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2071/4181] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:02:26 2022] GET /compute/v2.1/servers/973cd6c9-b655-47b5-ac63-c6c033d3c408 => generated 1484 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:02:26.673468 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-429bdd10-6271-4082-b411-2df182262dde req-65aff798-fd51-403b-bb8d-88df524bb00f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "973cd6c9-b655-47b5-ac63-c6c033d3c408", "name": "network-vif-deleted", "tag": "0e8f6e0b-a992-48ef-ba88-165c47d4a4c3"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:02:26.689913 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-429bdd10-6271-4082-b411-2df182262dde req-65aff798-fd51-403b-bb8d-88df524bb00f service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:26.699402 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-429bdd10-6271-4082-b411-2df182262dde req-65aff798-fd51-403b-bb8d-88df524bb00f service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:26.700098 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-429bdd10-6271-4082-b411-2df182262dde req-65aff798-fd51-403b-bb8d-88df524bb00f service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:26.722709 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-429bdd10-6271-4082-b411-2df182262dde req-65aff798-fd51-403b-bb8d-88df524bb00f service nova] Creating event network-vif-deleted:0e8f6e0b-a992-48ef-ba88-165c47d4a4c3 for instance 973cd6c9-b655-47b5-ac63-c6c033d3c408 on n-h1-852278-4 Aug 27 03:02:26.729014 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-429bdd10-6271-4082-b411-2df182262dde req-65aff798-fd51-403b-bb8d-88df524bb00f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061293 Aug 27 03:02:26.730347 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2072/4182] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:02:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:02:26.954388 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-75ef6643-3d20-478d-b511-4c55504d1e50 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-877971118", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:02:27.047207 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.network.neutron [None req-75ef6643-3d20-478d-b511-4c55504d1e50 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] validate_networks() for [('76f32197-3cb6-489f-ba19-28a1d5f1755a', None, None, None, None, None)] {{(pid=134052) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:02:27.500841 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-fd38f007-83df-4ccf-95d2-a2b364abf0fc tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] 10.222.0.70 "DELETE /compute/v2.1/os-floating-ips/cd752728-a784-4b10-8414-8b5c1cf575a7" status: 202 len: 0 microversion: 2.1 time: 1.614963 Aug 27 03:02:27.501874 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2111/4183] 10.222.0.70 () {58 vars in 1263 bytes} [Sat Aug 27 03:02:25 2022] DELETE /compute/v2.1/os-floating-ips/cd752728-a784-4b10-8414-8b5c1cf575a7 => generated 0 bytes in 1617 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:02:27.506479 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b3275baa-9ddd-4ddd-a5ca-dfc51b6701aa tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:27.507089 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b3275baa-9ddd-4ddd-a5ca-dfc51b6701aa tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] [instance: 973cd6c9-b655-47b5-ac63-c6c033d3c408] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:27.516030 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b3275baa-9ddd-4ddd-a5ca-dfc51b6701aa tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:27.516030 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b3275baa-9ddd-4ddd-a5ca-dfc51b6701aa tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:27.516211 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b3275baa-9ddd-4ddd-a5ca-dfc51b6701aa tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:27.516988 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b3275baa-9ddd-4ddd-a5ca-dfc51b6701aa tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:27.517615 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b3275baa-9ddd-4ddd-a5ca-dfc51b6701aa tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:27.518107 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b3275baa-9ddd-4ddd-a5ca-dfc51b6701aa tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:27.544757 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-b3275baa-9ddd-4ddd-a5ca-dfc51b6701aa tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] HTTP exception thrown: Instance 973cd6c9-b655-47b5-ac63-c6c033d3c408 could not be found. Aug 27 03:02:27.547007 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b3275baa-9ddd-4ddd-a5ca-dfc51b6701aa tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Request method failure captured: Aug 27 03:02:27.547007 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/973cd6c9-b655-47b5-ac63-c6c033d3c408 HTTP/1.1 Aug 27 03:02:27.547007 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 03:02:27.547007 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 03:02:27.547007 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 03:02:27.547007 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 03:02:27.547007 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 03:02:27.547007 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 03:02:27.547007 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 03:02:27.547007 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 03:02:27.547007 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYkpJ1mGUrUjUDbfKYHgRc-H981f_yGwVgwBBf9KmzGjepekUeAUWhp81IOEkWAvC9Nu-89M9CXGntBJNHUAOyftEedw3fofMDGxButDYN_dXCESnJejPqKk5-imp7k2fh2jLGP_-GvWKBTrbtttbcgmjWyU51nxYlasXejXED_cWHk Aug 27 03:02:27.547007 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 03:02:27.547007 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 03:02:27.547007 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 03:02:27.547007 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 03:02:27.547007 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 03:02:27.547007 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 03:02:27.547007 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 9d7a7f13f33342e3b29af0038862d625 Aug 27 03:02:27.547007 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1563027824 Aug 27 03:02:27.547007 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 03:02:27.547007 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 03:02:27.547007 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9d7a7f13f33342e3b29af0038862d625"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_9d7a7f13f33342e3b29af0038862d625", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9d7a7f13f33342e3b29af0038862d625"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/9d7a7f13f33342e3b29af0038862d625"}]}] Aug 27 03:02:27.547007 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1563027824 Aug 27 03:02:27.547007 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 9d7a7f13f33342e3b29af0038862d625 Aug 27 03:02:27.547007 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1563027824 Aug 27 03:02:27.547007 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ServerAddressesNegativeTestJSON-1563027824-project Aug 27 03:02:27.547007 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 03:02:27.547007 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 03:02:27.547007 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 0923e34eebfc4e289756d4c06897b771 Aug 27 03:02:27.547007 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1563027824-project Aug 27 03:02:27.547007 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 03:02:27.547007 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance 973cd6c9-b655-47b5-ac63-c6c033d3c408 could not be found. Aug 27 03:02:27.547007 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '973cd6c9-b655-47b5-ac63-c6c033d3c408'} Aug 27 03:02:27.547007 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:02:27.547007 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:02:27.547007 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:02:27.547007 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:02:27.547007 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:02:27.547007 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:02:27.547007 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:02:27.547007 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:02:27.547007 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:02:27.547007 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:02:27.547007 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 973cd6c9-b655-47b5-ac63-c6c033d3c408 could not be found. Aug 27 03:02:27.547007 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:02:27.547007 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:02:27.547007 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:02:27.547007 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:02:27.547007 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:02:27.547007 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:02:27.547007 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:02:27.547007 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:02:27.547007 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:02:27.547007 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:02:27.547007 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:02:27.547007 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:02:27.547007 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:02:27.547007 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:02:27.547007 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:02:27.547007 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:02:27.547007 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 973cd6c9-b655-47b5-ac63-c6c033d3c408 could not be found. Aug 27 03:02:27.547007 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:02:27.547007 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:02:27.552923 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:02:27.552923 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:02:27.552923 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:02:27.552923 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:02:27.552923 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:02:27.552923 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:02:27.552923 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 973cd6c9-b655-47b5-ac63-c6c033d3c408 could not be found. Aug 27 03:02:27.552923 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:02:27.552923 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b3275baa-9ddd-4ddd-a5ca-dfc51b6701aa tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] Returning 404 to user: Instance 973cd6c9-b655-47b5-ac63-c6c033d3c408 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:02:27.552923 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b3275baa-9ddd-4ddd-a5ca-dfc51b6701aa tempest-ServerAddressesNegativeTestJSON-1563027824 tempest-ServerAddressesNegativeTestJSON-1563027824-project] 10.222.0.70 "GET /compute/v2.1/servers/973cd6c9-b655-47b5-ac63-c6c033d3c408" status: 404 len: 111 microversion: 2.1 time: 0.049012 Aug 27 03:02:27.554657 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2112/4184] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:02:27 2022] GET /compute/v2.1/servers/973cd6c9-b655-47b5-ac63-c6c033d3c408 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:02:27.558418 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-21d4f53b-9a66-43f1-badc-03337f27b678 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Calling method '.version_select at 0x7f5edf05d790>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:27.970055 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-75ef6643-3d20-478d-b511-4c55504d1e50 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Flavor limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:02:27.971191 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-75ef6643-3d20-478d-b511-4c55504d1e50 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Image limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:02:27.973038 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-75ef6643-3d20-478d-b511-4c55504d1e50 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Flavor pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:02:27.973834 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-75ef6643-3d20-478d-b511-4c55504d1e50 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Image pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:02:27.974320 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-75ef6643-3d20-478d-b511-4c55504d1e50 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:02:27.993812 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-75ef6643-3d20-478d-b511-4c55504d1e50 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:27.994309 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-75ef6643-3d20-478d-b511-4c55504d1e50 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:27.994747 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-75ef6643-3d20-478d-b511-4c55504d1e50 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:27.995487 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-75ef6643-3d20-478d-b511-4c55504d1e50 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:27.995936 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-75ef6643-3d20-478d-b511-4c55504d1e50 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:27.997056 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-75ef6643-3d20-478d-b511-4c55504d1e50 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:28.010027 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-21d4f53b-9a66-43f1-badc-03337f27b678 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/c7f03ff7-ab4c-4e2b-917e-d659ea23c2d6" status: 202 len: 0 microversion: 2.1 time: 0.455292 Aug 27 03:02:28.010703 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2113/4185] 10.222.0.70 () {58 vars in 1272 bytes} [Sat Aug 27 03:02:27 2022] DELETE /compute/v2.1/os-security-groups/c7f03ff7-ab4c-4e2b-917e-d659ea23c2d6 => generated 0 bytes in 457 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:02:28.021796 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b8bb6e9f-c1e2-4b4b-a7e8-1545122425cd tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:28.022334 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b8bb6e9f-c1e2-4b4b-a7e8-1545122425cd tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] [instance: 9e44ca00-de7b-4c39-893c-c61b0d845cd1] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:28.023139 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-75ef6643-3d20-478d-b511-4c55504d1e50 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Getting quotas for project 1b4ca527ba3b49539b528ec8950aef78. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:02:28.030689 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-75ef6643-3d20-478d-b511-4c55504d1e50 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Getting quotas for user 36697e722bef4a33ab158e9b2f87596a and project 1b4ca527ba3b49539b528ec8950aef78. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:02:28.044807 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b8bb6e9f-c1e2-4b4b-a7e8-1545122425cd tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:28.045369 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b8bb6e9f-c1e2-4b4b-a7e8-1545122425cd tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:28.045805 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b8bb6e9f-c1e2-4b4b-a7e8-1545122425cd tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:28.047065 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b8bb6e9f-c1e2-4b4b-a7e8-1545122425cd tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:28.047525 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b8bb6e9f-c1e2-4b4b-a7e8-1545122425cd tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:28.047946 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b8bb6e9f-c1e2-4b4b-a7e8-1545122425cd tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:28.055354 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=96,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:02:28.058475 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-75ef6643-3d20-478d-b511-4c55504d1e50 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Going to run 1 instances... {{(pid=134052) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:02:28.066990 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-75ef6643-3d20-478d-b511-4c55504d1e50 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: f09bcfaf-4282-4434-8bb8-6dda7b337ae5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134052) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:02:28.127232 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b8bb6e9f-c1e2-4b4b-a7e8-1545122425cd tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] [instance: 9e44ca00-de7b-4c39-893c-c61b0d845cd1] Going to try to terminate instance {{(pid=134051) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:02:28.170293 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-75ef6643-3d20-478d-b511-4c55504d1e50 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.438450 Aug 27 03:02:28.177696 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2073/4186] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 03:02:26 2022] POST /compute/v2.1/servers => generated 383 bytes in 1446 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:02:28.183630 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-04836dca-def3-427e-8812-7545f285ecbb tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:28.184250 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-04836dca-def3-427e-8812-7545f285ecbb tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: f09bcfaf-4282-4434-8bb8-6dda7b337ae5] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:28.330308 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-04836dca-def3-427e-8812-7545f285ecbb tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36697e722bef4a33ab158e9b2f87596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4ca527ba3b49539b528ec8950aef78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:28.335913 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b8bb6e9f-c1e2-4b4b-a7e8-1545122425cd tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] 10.222.0.70 "DELETE /compute/v2.1/servers/9e44ca00-de7b-4c39-893c-c61b0d845cd1" status: 204 len: 0 microversion: 2.1 time: 0.320520 Aug 27 03:02:28.340658 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2114/4187] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 03:02:28 2022] DELETE /compute/v2.1/servers/9e44ca00-de7b-4c39-893c-c61b0d845cd1 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:02:28.342722 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-04836dca-def3-427e-8812-7545f285ecbb tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "GET /compute/v2.1/servers/f09bcfaf-4282-4434-8bb8-6dda7b337ae5" status: 200 len: 1221 microversion: 2.1 time: 0.163043 Aug 27 03:02:28.343818 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2074/4188] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:02:28 2022] GET /compute/v2.1/servers/f09bcfaf-4282-4434-8bb8-6dda7b337ae5 => generated 1221 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:02:28.349516 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4e4df614-e2e5-435d-9a0a-697a2d3d9202 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:28.351095 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-4e4df614-e2e5-435d-9a0a-697a2d3d9202 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] [instance: 9e44ca00-de7b-4c39-893c-c61b0d845cd1] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:28.358853 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4e4df614-e2e5-435d-9a0a-697a2d3d9202 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:28.359526 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4e4df614-e2e5-435d-9a0a-697a2d3d9202 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:28.360149 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4e4df614-e2e5-435d-9a0a-697a2d3d9202 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:28.361252 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4e4df614-e2e5-435d-9a0a-697a2d3d9202 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:28.362010 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4e4df614-e2e5-435d-9a0a-697a2d3d9202 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:28.363020 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4e4df614-e2e5-435d-9a0a-697a2d3d9202 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:28.552351 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-14bc62aa-fc83-4e3b-8613-88a4e6132ff2 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1351901060", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:02:28.649477 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.network.neutron [None req-14bc62aa-fc83-4e3b-8613-88a4e6132ff2 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] validate_networks() for [('76f32197-3cb6-489f-ba19-28a1d5f1755a', None, None, None, None, None)] {{(pid=134052) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:02:28.688531 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-4e4df614-e2e5-435d-9a0a-697a2d3d9202 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074fa9d1247548f1b93becab250d4772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8cb23407cc4d5db0379bf5227a0228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:28.696844 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-4e4df614-e2e5-435d-9a0a-697a2d3d9202 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] 10.222.0.70 "GET /compute/v2.1/servers/9e44ca00-de7b-4c39-893c-c61b0d845cd1" status: 200 len: 1509 microversion: 2.1 time: 0.351480 Aug 27 03:02:28.700163 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2115/4189] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:02:28 2022] GET /compute/v2.1/servers/9e44ca00-de7b-4c39-893c-c61b0d845cd1 => generated 1509 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:02:29.468105 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-14bc62aa-fc83-4e3b-8613-88a4e6132ff2 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Flavor limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:02:29.469306 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-14bc62aa-fc83-4e3b-8613-88a4e6132ff2 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Image limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:02:29.470241 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-14bc62aa-fc83-4e3b-8613-88a4e6132ff2 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Flavor pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:02:29.471691 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-14bc62aa-fc83-4e3b-8613-88a4e6132ff2 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Image pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:02:29.472953 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-14bc62aa-fc83-4e3b-8613-88a4e6132ff2 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:02:29.498657 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-14bc62aa-fc83-4e3b-8613-88a4e6132ff2 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:29.499712 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-14bc62aa-fc83-4e3b-8613-88a4e6132ff2 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:29.502038 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-14bc62aa-fc83-4e3b-8613-88a4e6132ff2 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:29.504590 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-14bc62aa-fc83-4e3b-8613-88a4e6132ff2 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:29.506158 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-14bc62aa-fc83-4e3b-8613-88a4e6132ff2 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:29.506960 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-14bc62aa-fc83-4e3b-8613-88a4e6132ff2 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:29.535217 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-14bc62aa-fc83-4e3b-8613-88a4e6132ff2 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Getting quotas for project 1b4ca527ba3b49539b528ec8950aef78. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:02:29.543406 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-14bc62aa-fc83-4e3b-8613-88a4e6132ff2 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Getting quotas for user 36697e722bef4a33ab158e9b2f87596a and project 1b4ca527ba3b49539b528ec8950aef78. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:02:29.551064 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:02:29.566726 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-14bc62aa-fc83-4e3b-8613-88a4e6132ff2 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Going to run 1 instances... {{(pid=134052) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:02:29.569974 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-14bc62aa-fc83-4e3b-8613-88a4e6132ff2 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: ecbf3ab5-9736-491e-b120-6a30d40bc328] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134052) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:02:29.652633 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-14bc62aa-fc83-4e3b-8613-88a4e6132ff2 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.105127 Aug 27 03:02:29.661346 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2075/4190] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 03:02:28 2022] POST /compute/v2.1/servers => generated 383 bytes in 1115 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 03:02:29.664412 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-6a2daa69-81fa-45fc-9fbe-4516ee669fcd tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:29.665207 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-6a2daa69-81fa-45fc-9fbe-4516ee669fcd tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: ecbf3ab5-9736-491e-b120-6a30d40bc328] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:29.726796 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4be583ee-4aea-43e2-b762-ffecfe0f9154 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:29.727420 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-4be583ee-4aea-43e2-b762-ffecfe0f9154 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] [instance: 9e44ca00-de7b-4c39-893c-c61b0d845cd1] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:29.742208 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4be583ee-4aea-43e2-b762-ffecfe0f9154 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:29.744989 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4be583ee-4aea-43e2-b762-ffecfe0f9154 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:29.746887 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4be583ee-4aea-43e2-b762-ffecfe0f9154 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:29.747983 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4be583ee-4aea-43e2-b762-ffecfe0f9154 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:29.751488 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4be583ee-4aea-43e2-b762-ffecfe0f9154 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:29.752151 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4be583ee-4aea-43e2-b762-ffecfe0f9154 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:29.791031 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-6a2daa69-81fa-45fc-9fbe-4516ee669fcd tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36697e722bef4a33ab158e9b2f87596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4ca527ba3b49539b528ec8950aef78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:29.802976 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-6a2daa69-81fa-45fc-9fbe-4516ee669fcd tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "GET /compute/v2.1/servers/ecbf3ab5-9736-491e-b120-6a30d40bc328" status: 200 len: 1222 microversion: 2.1 time: 0.142923 Aug 27 03:02:29.803897 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2116/4191] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:02:29 2022] GET /compute/v2.1/servers/ecbf3ab5-9736-491e-b120-6a30d40bc328 => generated 1222 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:02:30.471857 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-4be583ee-4aea-43e2-b762-ffecfe0f9154 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074fa9d1247548f1b93becab250d4772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8cb23407cc4d5db0379bf5227a0228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:30.486924 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-4be583ee-4aea-43e2-b762-ffecfe0f9154 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] 10.222.0.70 "GET /compute/v2.1/servers/9e44ca00-de7b-4c39-893c-c61b0d845cd1" status: 200 len: 1509 microversion: 2.1 time: 0.765875 Aug 27 03:02:30.498824 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2076/4192] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:02:29 2022] GET /compute/v2.1/servers/9e44ca00-de7b-4c39-893c-c61b0d845cd1 => generated 1509 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:02:30.823808 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e36f3895-f550-40ee-8080-79fdfdf38df2 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:30.825352 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-e36f3895-f550-40ee-8080-79fdfdf38df2 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: ecbf3ab5-9736-491e-b120-6a30d40bc328] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:30.838566 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e36f3895-f550-40ee-8080-79fdfdf38df2 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:30.847829 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e36f3895-f550-40ee-8080-79fdfdf38df2 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:30.848571 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e36f3895-f550-40ee-8080-79fdfdf38df2 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:30.850105 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e36f3895-f550-40ee-8080-79fdfdf38df2 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:30.850770 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e36f3895-f550-40ee-8080-79fdfdf38df2 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:30.851388 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e36f3895-f550-40ee-8080-79fdfdf38df2 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:31.041852 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e36f3895-f550-40ee-8080-79fdfdf38df2 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36697e722bef4a33ab158e9b2f87596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4ca527ba3b49539b528ec8950aef78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:31.051968 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e36f3895-f550-40ee-8080-79fdfdf38df2 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "GET /compute/v2.1/servers/ecbf3ab5-9736-491e-b120-6a30d40bc328" status: 200 len: 1274 microversion: 2.1 time: 0.232400 Aug 27 03:02:31.052970 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2117/4193] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:02:30 2022] GET /compute/v2.1/servers/ecbf3ab5-9736-491e-b120-6a30d40bc328 => generated 1274 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:02:31.510102 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-84a9b296-1309-421f-9c56-f652989491b8 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:31.512146 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-84a9b296-1309-421f-9c56-f652989491b8 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] [instance: 9e44ca00-de7b-4c39-893c-c61b0d845cd1] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:31.525940 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-84a9b296-1309-421f-9c56-f652989491b8 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:31.530468 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-84a9b296-1309-421f-9c56-f652989491b8 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:31.531206 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-84a9b296-1309-421f-9c56-f652989491b8 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:31.536183 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-84a9b296-1309-421f-9c56-f652989491b8 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:31.537141 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-84a9b296-1309-421f-9c56-f652989491b8 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:31.537805 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-84a9b296-1309-421f-9c56-f652989491b8 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:32.074128 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8c9c1a5e-168f-4a79-9ae3-5af108a112da tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:32.075443 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-8c9c1a5e-168f-4a79-9ae3-5af108a112da tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: ecbf3ab5-9736-491e-b120-6a30d40bc328] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:32.090550 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8c9c1a5e-168f-4a79-9ae3-5af108a112da tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:32.091455 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8c9c1a5e-168f-4a79-9ae3-5af108a112da tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:32.092339 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8c9c1a5e-168f-4a79-9ae3-5af108a112da tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:32.096782 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8c9c1a5e-168f-4a79-9ae3-5af108a112da tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:32.097480 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8c9c1a5e-168f-4a79-9ae3-5af108a112da tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:32.098132 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8c9c1a5e-168f-4a79-9ae3-5af108a112da tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:32.373512 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-8c9c1a5e-168f-4a79-9ae3-5af108a112da tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36697e722bef4a33ab158e9b2f87596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4ca527ba3b49539b528ec8950aef78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:32.398822 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-8c9c1a5e-168f-4a79-9ae3-5af108a112da tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "GET /compute/v2.1/servers/ecbf3ab5-9736-491e-b120-6a30d40bc328" status: 200 len: 1280 microversion: 2.1 time: 0.328481 Aug 27 03:02:32.405415 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2118/4194] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:02:32 2022] GET /compute/v2.1/servers/ecbf3ab5-9736-491e-b120-6a30d40bc328 => generated 1280 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:02:32.599750 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-84a9b296-1309-421f-9c56-f652989491b8 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074fa9d1247548f1b93becab250d4772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8cb23407cc4d5db0379bf5227a0228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:32.611822 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-84a9b296-1309-421f-9c56-f652989491b8 tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] 10.222.0.70 "GET /compute/v2.1/servers/9e44ca00-de7b-4c39-893c-c61b0d845cd1" status: 200 len: 1509 microversion: 2.1 time: 1.105753 Aug 27 03:02:32.614627 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2077/4195] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:02:31 2022] GET /compute/v2.1/servers/9e44ca00-de7b-4c39-893c-c61b0d845cd1 => generated 1509 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:02:32.878911 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-01454124-e890-44f7-b41e-6c230e4b7970 req-a4b753ca-2a44-4db9-bbea-de0c4e5a2d40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e44ca00-de7b-4c39-893c-c61b0d845cd1", "name": "network-vif-deleted", "tag": "8445b37e-80d1-4feb-9fbc-fa886c48c08c"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:02:32.892303 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-01454124-e890-44f7-b41e-6c230e4b7970 req-a4b753ca-2a44-4db9-bbea-de0c4e5a2d40 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:32.894354 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-01454124-e890-44f7-b41e-6c230e4b7970 req-a4b753ca-2a44-4db9-bbea-de0c4e5a2d40 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:32.894983 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-01454124-e890-44f7-b41e-6c230e4b7970 req-a4b753ca-2a44-4db9-bbea-de0c4e5a2d40 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:32.933999 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-01454124-e890-44f7-b41e-6c230e4b7970 req-a4b753ca-2a44-4db9-bbea-de0c4e5a2d40 service nova] Creating event network-vif-deleted:8445b37e-80d1-4feb-9fbc-fa886c48c08c for instance 9e44ca00-de7b-4c39-893c-c61b0d845cd1 on n-h2-852278-4 Aug 27 03:02:32.943166 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-01454124-e890-44f7-b41e-6c230e4b7970 req-a4b753ca-2a44-4db9-bbea-de0c4e5a2d40 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075981 Aug 27 03:02:32.944035 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2119/4196] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:02:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:02:33.426740 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e70ac159-e864-47fe-aa5c-0ebcb0344889 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:33.427472 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-e70ac159-e864-47fe-aa5c-0ebcb0344889 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: ecbf3ab5-9736-491e-b120-6a30d40bc328] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:33.435229 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e70ac159-e864-47fe-aa5c-0ebcb0344889 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:33.435971 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e70ac159-e864-47fe-aa5c-0ebcb0344889 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:33.436648 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e70ac159-e864-47fe-aa5c-0ebcb0344889 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:33.437766 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e70ac159-e864-47fe-aa5c-0ebcb0344889 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:33.438388 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e70ac159-e864-47fe-aa5c-0ebcb0344889 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:33.439321 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e70ac159-e864-47fe-aa5c-0ebcb0344889 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:33.633581 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-e70ac159-e864-47fe-aa5c-0ebcb0344889 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36697e722bef4a33ab158e9b2f87596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4ca527ba3b49539b528ec8950aef78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:33.641047 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-9ea871e4-2545-4481-ab74-e8b93c4e182f tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:33.645539 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-9ea871e4-2545-4481-ab74-e8b93c4e182f tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] [instance: 9e44ca00-de7b-4c39-893c-c61b0d845cd1] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:33.654648 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e70ac159-e864-47fe-aa5c-0ebcb0344889 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "GET /compute/v2.1/servers/ecbf3ab5-9736-491e-b120-6a30d40bc328" status: 200 len: 1280 microversion: 2.1 time: 0.228940 Aug 27 03:02:33.655688 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2078/4197] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:02:33 2022] GET /compute/v2.1/servers/ecbf3ab5-9736-491e-b120-6a30d40bc328 => generated 1280 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:02:33.657897 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9ea871e4-2545-4481-ab74-e8b93c4e182f tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:33.658591 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9ea871e4-2545-4481-ab74-e8b93c4e182f tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:33.659184 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9ea871e4-2545-4481-ab74-e8b93c4e182f tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:33.660224 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9ea871e4-2545-4481-ab74-e8b93c4e182f tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:33.660971 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9ea871e4-2545-4481-ab74-e8b93c4e182f tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:33.661553 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9ea871e4-2545-4481-ab74-e8b93c4e182f tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:33.681766 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-9ea871e4-2545-4481-ab74-e8b93c4e182f tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] HTTP exception thrown: Instance 9e44ca00-de7b-4c39-893c-c61b0d845cd1 could not be found. Aug 27 03:02:33.683809 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-9ea871e4-2545-4481-ab74-e8b93c4e182f tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Request method failure captured: Aug 27 03:02:33.683809 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/9e44ca00-de7b-4c39-893c-c61b0d845cd1 HTTP/1.1 Aug 27 03:02:33.683809 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 03:02:33.683809 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 03:02:33.683809 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 03:02:33.683809 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 03:02:33.683809 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 03:02:33.683809 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 03:02:33.683809 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 03:02:33.683809 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 03:02:33.683809 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYj5pjea5yiK8YFhNSwQEsxhiAhAvRqt4Z6psb0FesMo1EEmDUlkuqmokF6EEsswB0O5mvKVn014okaWPUb4D0kK39x6EcMN2XUVc5-RhWDfhUO8Eet1LF2Z_io--gZxu6ZxD9zARnujzzh_umwk0VVuJzl6daDMjntwoZI50y9_uFM Aug 27 03:02:33.683809 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 03:02:33.683809 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 03:02:33.683809 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 03:02:33.683809 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 03:02:33.683809 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 03:02:33.683809 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 03:02:33.683809 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: fb8cb23407cc4d5db0379bf5227a0228 Aug 27 03:02:33.683809 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-1422367138 Aug 27 03:02:33.683809 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 03:02:33.683809 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 03:02:33.683809 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/fb8cb23407cc4d5db0379bf5227a0228"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_fb8cb23407cc4d5db0379bf5227a0228", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/fb8cb23407cc4d5db0379bf5227a0228"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/fb8cb23407cc4d5db0379bf5227a0228"}]}] Aug 27 03:02:33.683809 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-1422367138 Aug 27 03:02:33.683809 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: fb8cb23407cc4d5db0379bf5227a0228 Aug 27 03:02:33.683809 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-1422367138 Aug 27 03:02:33.683809 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ServerRescueTestJSONUnderV235-1422367138-project Aug 27 03:02:33.683809 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 03:02:33.683809 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 03:02:33.683809 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 074fa9d1247548f1b93becab250d4772 Aug 27 03:02:33.683809 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-1422367138-project Aug 27 03:02:33.683809 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 03:02:33.683809 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance 9e44ca00-de7b-4c39-893c-c61b0d845cd1 could not be found. Aug 27 03:02:33.683809 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '9e44ca00-de7b-4c39-893c-c61b0d845cd1'} Aug 27 03:02:33.683809 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:02:33.683809 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:02:33.683809 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:02:33.683809 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:02:33.683809 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:02:33.683809 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:02:33.683809 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:02:33.683809 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:02:33.683809 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:02:33.683809 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:02:33.683809 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e44ca00-de7b-4c39-893c-c61b0d845cd1 could not be found. Aug 27 03:02:33.683809 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:02:33.683809 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:02:33.683809 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:02:33.683809 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:02:33.683809 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:02:33.683809 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:02:33.683809 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:02:33.683809 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:02:33.683809 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:02:33.683809 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:02:33.683809 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:02:33.683809 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:02:33.683809 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:02:33.683809 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:02:33.683809 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:02:33.683809 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:02:33.683809 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e44ca00-de7b-4c39-893c-c61b0d845cd1 could not be found. Aug 27 03:02:33.683809 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:02:33.683809 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:02:33.688343 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:02:33.688343 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:02:33.688343 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:02:33.688343 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:02:33.688343 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:02:33.688343 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:02:33.688343 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e44ca00-de7b-4c39-893c-c61b0d845cd1 could not be found. Aug 27 03:02:33.688343 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:02:33.689951 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-9ea871e4-2545-4481-ab74-e8b93c4e182f tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] Returning 404 to user: Instance 9e44ca00-de7b-4c39-893c-c61b0d845cd1 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:02:33.692862 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-9ea871e4-2545-4481-ab74-e8b93c4e182f tempest-ServerRescueTestJSONUnderV235-1422367138 tempest-ServerRescueTestJSONUnderV235-1422367138-project] 10.222.0.70 "GET /compute/v2.1/servers/9e44ca00-de7b-4c39-893c-c61b0d845cd1" status: 404 len: 111 microversion: 2.1 time: 0.061937 Aug 27 03:02:33.695930 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2120/4198] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:02:33 2022] GET /compute/v2.1/servers/9e44ca00-de7b-4c39-893c-c61b0d845cd1 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 03:02:34.675549 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5866e080-15fe-4bac-9a2f-9af90040cb0a tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:34.676162 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-5866e080-15fe-4bac-9a2f-9af90040cb0a tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: ecbf3ab5-9736-491e-b120-6a30d40bc328] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:34.683905 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5866e080-15fe-4bac-9a2f-9af90040cb0a tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:34.684532 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5866e080-15fe-4bac-9a2f-9af90040cb0a tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:34.684971 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5866e080-15fe-4bac-9a2f-9af90040cb0a tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:34.685675 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5866e080-15fe-4bac-9a2f-9af90040cb0a tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:34.686453 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5866e080-15fe-4bac-9a2f-9af90040cb0a tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:34.686775 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5866e080-15fe-4bac-9a2f-9af90040cb0a tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:35.627981 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-5866e080-15fe-4bac-9a2f-9af90040cb0a tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36697e722bef4a33ab158e9b2f87596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4ca527ba3b49539b528ec8950aef78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:35.641797 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-5866e080-15fe-4bac-9a2f-9af90040cb0a tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "GET /compute/v2.1/servers/ecbf3ab5-9736-491e-b120-6a30d40bc328" status: 200 len: 1322 microversion: 2.1 time: 0.970180 Aug 27 03:02:35.657945 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2079/4199] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:02:34 2022] GET /compute/v2.1/servers/ecbf3ab5-9736-491e-b120-6a30d40bc328 => generated 1322 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:02:36.291703 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-4815359c-da27-40f3-b3e1-6289d8a45b09 req-f79254c9-0a43-4049-b7bd-48d5f4040584 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f09bcfaf-4282-4434-8bb8-6dda7b337ae5", "tag": "222b37be-dd90-4b02-89dc-f798562315e3"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:02:36.323251 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-4815359c-da27-40f3-b3e1-6289d8a45b09 req-f79254c9-0a43-4049-b7bd-48d5f4040584 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:36.325226 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-4815359c-da27-40f3-b3e1-6289d8a45b09 req-f79254c9-0a43-4049-b7bd-48d5f4040584 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:36.327444 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-4815359c-da27-40f3-b3e1-6289d8a45b09 req-f79254c9-0a43-4049-b7bd-48d5f4040584 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:36.360162 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-4815359c-da27-40f3-b3e1-6289d8a45b09 req-f79254c9-0a43-4049-b7bd-48d5f4040584 service nova] Creating event network-changed:222b37be-dd90-4b02-89dc-f798562315e3 for instance f09bcfaf-4282-4434-8bb8-6dda7b337ae5 on n-h1-852278-4 Aug 27 03:02:36.378522 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-4815359c-da27-40f3-b3e1-6289d8a45b09 req-f79254c9-0a43-4049-b7bd-48d5f4040584 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089032 Aug 27 03:02:36.381515 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2121/4200] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:02:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:02:36.666974 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a4b33a76-7686-4da6-ab5c-040fd8cd282c tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:36.668820 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a4b33a76-7686-4da6-ab5c-040fd8cd282c tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: ecbf3ab5-9736-491e-b120-6a30d40bc328] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:36.683607 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a4b33a76-7686-4da6-ab5c-040fd8cd282c tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:36.684959 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a4b33a76-7686-4da6-ab5c-040fd8cd282c tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:36.688243 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a4b33a76-7686-4da6-ab5c-040fd8cd282c tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:36.693568 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a4b33a76-7686-4da6-ab5c-040fd8cd282c tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:36.695106 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a4b33a76-7686-4da6-ab5c-040fd8cd282c tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:36.695742 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a4b33a76-7686-4da6-ab5c-040fd8cd282c tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:37.179715 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-a4b33a76-7686-4da6-ab5c-040fd8cd282c tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36697e722bef4a33ab158e9b2f87596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4ca527ba3b49539b528ec8950aef78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:37.217729 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a4b33a76-7686-4da6-ab5c-040fd8cd282c tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "GET /compute/v2.1/servers/ecbf3ab5-9736-491e-b120-6a30d40bc328" status: 200 len: 1322 microversion: 2.1 time: 0.555002 Aug 27 03:02:37.222252 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2080/4201] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:02:36 2022] GET /compute/v2.1/servers/ecbf3ab5-9736-491e-b120-6a30d40bc328 => generated 1322 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:02:38.243755 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ae2275b8-3ba5-478d-ae6d-e632f9e35871 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:38.245409 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-ae2275b8-3ba5-478d-ae6d-e632f9e35871 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: ecbf3ab5-9736-491e-b120-6a30d40bc328] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:38.251873 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ae2275b8-3ba5-478d-ae6d-e632f9e35871 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:38.252567 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ae2275b8-3ba5-478d-ae6d-e632f9e35871 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:38.253257 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ae2275b8-3ba5-478d-ae6d-e632f9e35871 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:38.254240 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ae2275b8-3ba5-478d-ae6d-e632f9e35871 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:38.254796 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ae2275b8-3ba5-478d-ae6d-e632f9e35871 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:38.255478 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ae2275b8-3ba5-478d-ae6d-e632f9e35871 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:38.603956 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ff26f85e-be78-43b8-8b18-2baed9385641 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:38.606255 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-ff26f85e-be78-43b8-8b18-2baed9385641 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] [instance: 9d9f666f-0b19-4d87-a94a-770b5d99f349] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:38.613866 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ff26f85e-be78-43b8-8b18-2baed9385641 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:38.614357 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ff26f85e-be78-43b8-8b18-2baed9385641 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:38.614781 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ff26f85e-be78-43b8-8b18-2baed9385641 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:38.615493 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ff26f85e-be78-43b8-8b18-2baed9385641 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:38.615941 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ff26f85e-be78-43b8-8b18-2baed9385641 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:38.616356 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ff26f85e-be78-43b8-8b18-2baed9385641 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:38.648646 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ff26f85e-be78-43b8-8b18-2baed9385641 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] 10.222.0.70 "GET /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048644 Aug 27 03:02:38.649218 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2081/4202] 10.222.0.70 () {58 vars in 1302 bytes} [Sat Aug 27 03:02:38 2022] GET /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:02:38.680102 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-4ab5836b-7013-4c96-9ca6-acd26b5a1c87 req-1342d096-a4f5-4630-87ba-d4bf76589b94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecbf3ab5-9736-491e-b120-6a30d40bc328", "tag": "fe8e4bb9-146c-466a-a5e4-473027c2de5d"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:02:38.689610 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-4ab5836b-7013-4c96-9ca6-acd26b5a1c87 req-1342d096-a4f5-4630-87ba-d4bf76589b94 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:38.690198 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-4ab5836b-7013-4c96-9ca6-acd26b5a1c87 req-1342d096-a4f5-4630-87ba-d4bf76589b94 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:38.690639 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-4ab5836b-7013-4c96-9ca6-acd26b5a1c87 req-1342d096-a4f5-4630-87ba-d4bf76589b94 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:38.706325 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-4ab5836b-7013-4c96-9ca6-acd26b5a1c87 req-1342d096-a4f5-4630-87ba-d4bf76589b94 service nova] Creating event network-changed:fe8e4bb9-146c-466a-a5e4-473027c2de5d for instance ecbf3ab5-9736-491e-b120-6a30d40bc328 on n-h2-852278-4 Aug 27 03:02:38.716999 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-4ab5836b-7013-4c96-9ca6-acd26b5a1c87 req-1342d096-a4f5-4630-87ba-d4bf76589b94 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040701 Aug 27 03:02:38.717961 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2082/4203] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:02:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:02:38.725763 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-bb60b298-1d8b-4812-9807-e3d8cce8129d tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:38.726343 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-bb60b298-1d8b-4812-9807-e3d8cce8129d tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] [instance: 9d9f666f-0b19-4d87-a94a-770b5d99f349] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:38.733123 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bb60b298-1d8b-4812-9807-e3d8cce8129d tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:38.733611 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bb60b298-1d8b-4812-9807-e3d8cce8129d tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:38.734037 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bb60b298-1d8b-4812-9807-e3d8cce8129d tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:38.734930 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bb60b298-1d8b-4812-9807-e3d8cce8129d tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:38.735570 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bb60b298-1d8b-4812-9807-e3d8cce8129d tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:38.735985 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bb60b298-1d8b-4812-9807-e3d8cce8129d tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:38.764735 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-bb60b298-1d8b-4812-9807-e3d8cce8129d tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] [instance: 9d9f666f-0b19-4d87-a94a-770b5d99f349] Going to try to terminate instance {{(pid=134052) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:02:38.945472 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-bb60b298-1d8b-4812-9807-e3d8cce8129d tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] 10.222.0.70 "DELETE /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349" status: 204 len: 0 microversion: 2.1 time: 0.225941 Aug 27 03:02:38.946154 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2083/4204] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 03:02:38 2022] DELETE /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:02:38.964619 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-630f020e-7908-47b5-9a2e-e1df30a383df tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:38.965497 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-630f020e-7908-47b5-9a2e-e1df30a383df tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] [instance: 9d9f666f-0b19-4d87-a94a-770b5d99f349] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:38.972947 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-630f020e-7908-47b5-9a2e-e1df30a383df tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:38.974060 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-630f020e-7908-47b5-9a2e-e1df30a383df tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:38.974678 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-630f020e-7908-47b5-9a2e-e1df30a383df tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:38.975703 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-630f020e-7908-47b5-9a2e-e1df30a383df tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:38.976162 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-630f020e-7908-47b5-9a2e-e1df30a383df tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:38.976748 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-630f020e-7908-47b5-9a2e-e1df30a383df tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:38.985162 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:02:39.219575 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-ae2275b8-3ba5-478d-ae6d-e632f9e35871 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36697e722bef4a33ab158e9b2f87596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4ca527ba3b49539b528ec8950aef78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:39.237726 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ae2275b8-3ba5-478d-ae6d-e632f9e35871 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "GET /compute/v2.1/servers/ecbf3ab5-9736-491e-b120-6a30d40bc328" status: 200 len: 1322 microversion: 2.1 time: 0.998977 Aug 27 03:02:39.240451 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2122/4205] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:02:38 2022] GET /compute/v2.1/servers/ecbf3ab5-9736-491e-b120-6a30d40bc328 => generated 1322 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:02:39.418426 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-630f020e-7908-47b5-9a2e-e1df30a383df tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe0328160c6472086d13907344756cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41649f09cbf410a9825100c498b4916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:39.432964 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-630f020e-7908-47b5-9a2e-e1df30a383df tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] 10.222.0.70 "GET /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349" status: 200 len: 1671 microversion: 2.1 time: 0.482293 Aug 27 03:02:39.433578 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2084/4206] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:02:38 2022] GET /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349 => generated 1671 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:02:40.260131 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-5c43affe-439d-4a4e-996f-2c4f6f4761fb tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:40.260894 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-5c43affe-439d-4a4e-996f-2c4f6f4761fb tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: ecbf3ab5-9736-491e-b120-6a30d40bc328] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:40.264002 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:02:40.270935 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5c43affe-439d-4a4e-996f-2c4f6f4761fb tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:40.271678 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5c43affe-439d-4a4e-996f-2c4f6f4761fb tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:40.272335 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5c43affe-439d-4a4e-996f-2c4f6f4761fb tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:40.273447 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5c43affe-439d-4a4e-996f-2c4f6f4761fb tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:40.275234 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5c43affe-439d-4a4e-996f-2c4f6f4761fb tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:40.275910 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5c43affe-439d-4a4e-996f-2c4f6f4761fb tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:40.455492 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-13d35798-415c-490d-b9e8-438e4ccb15e7 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:40.456095 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-13d35798-415c-490d-b9e8-438e4ccb15e7 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] [instance: 9d9f666f-0b19-4d87-a94a-770b5d99f349] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:40.465891 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=4 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:02:40.466548 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=14 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:02:40.469814 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-13d35798-415c-490d-b9e8-438e4ccb15e7 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:40.470311 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-13d35798-415c-490d-b9e8-438e4ccb15e7 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:40.470753 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-13d35798-415c-490d-b9e8-438e4ccb15e7 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:40.471505 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-13d35798-415c-490d-b9e8-438e4ccb15e7 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:40.471961 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-13d35798-415c-490d-b9e8-438e4ccb15e7 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:40.472417 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-13d35798-415c-490d-b9e8-438e4ccb15e7 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:41.155495 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-5c43affe-439d-4a4e-996f-2c4f6f4761fb tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36697e722bef4a33ab158e9b2f87596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4ca527ba3b49539b528ec8950aef78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:41.179454 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-5c43affe-439d-4a4e-996f-2c4f6f4761fb tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "GET /compute/v2.1/servers/ecbf3ab5-9736-491e-b120-6a30d40bc328" status: 200 len: 1322 microversion: 2.1 time: 0.924283 Aug 27 03:02:41.181670 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2123/4207] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:02:40 2022] GET /compute/v2.1/servers/ecbf3ab5-9736-491e-b120-6a30d40bc328 => generated 1322 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:02:41.365807 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-13d35798-415c-490d-b9e8-438e4ccb15e7 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe0328160c6472086d13907344756cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41649f09cbf410a9825100c498b4916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:41.383494 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-13d35798-415c-490d-b9e8-438e4ccb15e7 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] 10.222.0.70 "GET /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349" status: 200 len: 1671 microversion: 2.1 time: 0.932099 Aug 27 03:02:41.387640 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2085/4208] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:02:40 2022] GET /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349 => generated 1671 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:02:42.202221 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7306eeda-dbc0-40a3-bab6-dbc96b4e015a tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:42.202848 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-7306eeda-dbc0-40a3-bab6-dbc96b4e015a tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: ecbf3ab5-9736-491e-b120-6a30d40bc328] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:42.211609 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7306eeda-dbc0-40a3-bab6-dbc96b4e015a tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:42.212427 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7306eeda-dbc0-40a3-bab6-dbc96b4e015a tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:42.213026 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7306eeda-dbc0-40a3-bab6-dbc96b4e015a tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:42.213918 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7306eeda-dbc0-40a3-bab6-dbc96b4e015a tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:42.214554 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7306eeda-dbc0-40a3-bab6-dbc96b4e015a tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:42.215133 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7306eeda-dbc0-40a3-bab6-dbc96b4e015a tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:42.376288 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-aca008a5-59c6-43af-bcb5-611404426617 req-9e6be568-0b58-41cb-9175-bdc15825fa34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f09bcfaf-4282-4434-8bb8-6dda7b337ae5", "name": "network-vif-plugged", "status": "completed", "tag": "222b37be-dd90-4b02-89dc-f798562315e3"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:02:42.407821 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-aca008a5-59c6-43af-bcb5-611404426617 req-9e6be568-0b58-41cb-9175-bdc15825fa34 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:42.408369 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-aca008a5-59c6-43af-bcb5-611404426617 req-9e6be568-0b58-41cb-9175-bdc15825fa34 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:42.408808 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-aca008a5-59c6-43af-bcb5-611404426617 req-9e6be568-0b58-41cb-9175-bdc15825fa34 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:42.440015 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-aca008a5-59c6-43af-bcb5-611404426617 req-9e6be568-0b58-41cb-9175-bdc15825fa34 service nova] Creating event network-vif-plugged:222b37be-dd90-4b02-89dc-f798562315e3 for instance f09bcfaf-4282-4434-8bb8-6dda7b337ae5 on n-h1-852278-4 Aug 27 03:02:42.468445 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-aca008a5-59c6-43af-bcb5-611404426617 req-9e6be568-0b58-41cb-9175-bdc15825fa34 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096226 Aug 27 03:02:42.469841 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2086/4209] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:02:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:02:42.477239 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-05228884-99f6-4d16-bbd7-79399f055878 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:42.478197 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-05228884-99f6-4d16-bbd7-79399f055878 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] [instance: 9d9f666f-0b19-4d87-a94a-770b5d99f349] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:42.485926 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-05228884-99f6-4d16-bbd7-79399f055878 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:42.486714 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-05228884-99f6-4d16-bbd7-79399f055878 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:42.487313 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-05228884-99f6-4d16-bbd7-79399f055878 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:42.488452 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-05228884-99f6-4d16-bbd7-79399f055878 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:42.489152 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-05228884-99f6-4d16-bbd7-79399f055878 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:42.490645 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-05228884-99f6-4d16-bbd7-79399f055878 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:43.135996 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-05228884-99f6-4d16-bbd7-79399f055878 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe0328160c6472086d13907344756cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41649f09cbf410a9825100c498b4916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:43.147726 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-05228884-99f6-4d16-bbd7-79399f055878 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] 10.222.0.70 "GET /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349" status: 200 len: 1604 microversion: 2.1 time: 0.676288 Aug 27 03:02:43.148349 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2087/4210] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:02:42 2022] GET /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349 => generated 1604 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:02:43.214527 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-7306eeda-dbc0-40a3-bab6-dbc96b4e015a tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36697e722bef4a33ab158e9b2f87596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4ca527ba3b49539b528ec8950aef78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:43.230059 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-7306eeda-dbc0-40a3-bab6-dbc96b4e015a tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "GET /compute/v2.1/servers/ecbf3ab5-9736-491e-b120-6a30d40bc328" status: 200 len: 1322 microversion: 2.1 time: 1.031921 Aug 27 03:02:43.232063 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2124/4211] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:02:42 2022] GET /compute/v2.1/servers/ecbf3ab5-9736-491e-b120-6a30d40bc328 => generated 1322 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:02:44.169001 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3bab1bc6-b569-409a-ab67-1b88e60e4916 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:44.169616 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-3bab1bc6-b569-409a-ab67-1b88e60e4916 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] [instance: 9d9f666f-0b19-4d87-a94a-770b5d99f349] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:44.181120 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3bab1bc6-b569-409a-ab67-1b88e60e4916 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:44.182315 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3bab1bc6-b569-409a-ab67-1b88e60e4916 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:44.183002 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3bab1bc6-b569-409a-ab67-1b88e60e4916 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:44.184183 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3bab1bc6-b569-409a-ab67-1b88e60e4916 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:44.184871 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3bab1bc6-b569-409a-ab67-1b88e60e4916 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:44.186011 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3bab1bc6-b569-409a-ab67-1b88e60e4916 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:44.187999 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-0b018a88-a0ed-43ca-9044-1a20d3eb7eb3 req-997a333a-aa53-48fc-a6ce-33fd7efb9e9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d9f666f-0b19-4d87-a94a-770b5d99f349", "name": "network-vif-deleted", "tag": "b31e0e71-4066-4ac6-b1eb-63996f060976"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:02:44.212127 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-0b018a88-a0ed-43ca-9044-1a20d3eb7eb3 req-997a333a-aa53-48fc-a6ce-33fd7efb9e9a service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:44.223272 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-0b018a88-a0ed-43ca-9044-1a20d3eb7eb3 req-997a333a-aa53-48fc-a6ce-33fd7efb9e9a service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:44.225608 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-0b018a88-a0ed-43ca-9044-1a20d3eb7eb3 req-997a333a-aa53-48fc-a6ce-33fd7efb9e9a service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:44.226815 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3bab1bc6-b569-409a-ab67-1b88e60e4916 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:44.227835 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3bab1bc6-b569-409a-ab67-1b88e60e4916 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:44.228458 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3bab1bc6-b569-409a-ab67-1b88e60e4916 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:44.229055 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.objects.instance [None req-3bab1bc6-b569-409a-ab67-1b88e60e4916 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lazy-loading 'fault' on Instance uuid 9d9f666f-0b19-4d87-a94a-770b5d99f349 {{(pid=134051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:02:44.263214 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-0b018a88-a0ed-43ca-9044-1a20d3eb7eb3 req-997a333a-aa53-48fc-a6ce-33fd7efb9e9a service nova] Creating event network-vif-deleted:b31e0e71-4066-4ac6-b1eb-63996f060976 for instance 9d9f666f-0b19-4d87-a94a-770b5d99f349 on n-h1-852278-4 Aug 27 03:02:44.274321 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-0b018a88-a0ed-43ca-9044-1a20d3eb7eb3 req-997a333a-aa53-48fc-a6ce-33fd7efb9e9a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.491514 Aug 27 03:02:44.277781 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2088/4212] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:02:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:02:44.291729 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-45327ebe-284e-4970-a4ea-40e5c9d52bc9 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:44.295295 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-45327ebe-284e-4970-a4ea-40e5c9d52bc9 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: ecbf3ab5-9736-491e-b120-6a30d40bc328] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:44.311400 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-45327ebe-284e-4970-a4ea-40e5c9d52bc9 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:44.314833 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-45327ebe-284e-4970-a4ea-40e5c9d52bc9 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:44.316345 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-45327ebe-284e-4970-a4ea-40e5c9d52bc9 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:44.317594 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-45327ebe-284e-4970-a4ea-40e5c9d52bc9 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:44.318711 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-45327ebe-284e-4970-a4ea-40e5c9d52bc9 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:44.321282 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-45327ebe-284e-4970-a4ea-40e5c9d52bc9 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:44.355314 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-3bab1bc6-b569-409a-ab67-1b88e60e4916 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe0328160c6472086d13907344756cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41649f09cbf410a9825100c498b4916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:44.372544 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-3bab1bc6-b569-409a-ab67-1b88e60e4916 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] 10.222.0.70 "GET /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349" status: 200 len: 1328 microversion: 2.1 time: 0.202995 Aug 27 03:02:44.374586 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2125/4213] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:02:44 2022] GET /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349 => generated 1328 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:02:44.822362 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-45327ebe-284e-4970-a4ea-40e5c9d52bc9 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36697e722bef4a33ab158e9b2f87596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4ca527ba3b49539b528ec8950aef78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:44.856870 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-45327ebe-284e-4970-a4ea-40e5c9d52bc9 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "GET /compute/v2.1/servers/ecbf3ab5-9736-491e-b120-6a30d40bc328" status: 200 len: 1322 microversion: 2.1 time: 0.575866 Aug 27 03:02:44.859665 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2089/4214] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:02:44 2022] GET /compute/v2.1/servers/ecbf3ab5-9736-491e-b120-6a30d40bc328 => generated 1322 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:02:45.156132 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-d99e8b7d-bd1f-4846-bfc1-d8f35b916036 req-bbe215a8-e2eb-442b-aabf-73f0173cf8bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecbf3ab5-9736-491e-b120-6a30d40bc328", "name": "network-vif-plugged", "status": "completed", "tag": "fe8e4bb9-146c-466a-a5e4-473027c2de5d"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:02:45.178469 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-d99e8b7d-bd1f-4846-bfc1-d8f35b916036 req-bbe215a8-e2eb-442b-aabf-73f0173cf8bd service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:45.181049 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-d99e8b7d-bd1f-4846-bfc1-d8f35b916036 req-bbe215a8-e2eb-442b-aabf-73f0173cf8bd service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:45.181489 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-d99e8b7d-bd1f-4846-bfc1-d8f35b916036 req-bbe215a8-e2eb-442b-aabf-73f0173cf8bd service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:45.207573 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-d99e8b7d-bd1f-4846-bfc1-d8f35b916036 req-bbe215a8-e2eb-442b-aabf-73f0173cf8bd service nova] Creating event network-vif-plugged:fe8e4bb9-146c-466a-a5e4-473027c2de5d for instance ecbf3ab5-9736-491e-b120-6a30d40bc328 on n-h2-852278-4 Aug 27 03:02:45.216062 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-d99e8b7d-bd1f-4846-bfc1-d8f35b916036 req-bbe215a8-e2eb-442b-aabf-73f0173cf8bd service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064231 Aug 27 03:02:45.216737 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2126/4215] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:02:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:02:45.401583 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-7c6934a9-7512-44fc-97d9-9706d51b847b tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:45.403932 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-7c6934a9-7512-44fc-97d9-9706d51b847b tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] [instance: 9d9f666f-0b19-4d87-a94a-770b5d99f349] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:45.425027 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7c6934a9-7512-44fc-97d9-9706d51b847b tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:45.427233 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7c6934a9-7512-44fc-97d9-9706d51b847b tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:45.428901 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7c6934a9-7512-44fc-97d9-9706d51b847b tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:45.431466 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7c6934a9-7512-44fc-97d9-9706d51b847b tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:45.432148 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7c6934a9-7512-44fc-97d9-9706d51b847b tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:45.432827 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7c6934a9-7512-44fc-97d9-9706d51b847b tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:45.471304 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-7c6934a9-7512-44fc-97d9-9706d51b847b tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] HTTP exception thrown: Instance 9d9f666f-0b19-4d87-a94a-770b5d99f349 could not be found. Aug 27 03:02:45.474282 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-7c6934a9-7512-44fc-97d9-9706d51b847b tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Request method failure captured: Aug 27 03:02:45.474282 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349 HTTP/1.1 Aug 27 03:02:45.474282 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 03:02:45.474282 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 03:02:45.474282 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 03:02:45.474282 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 03:02:45.474282 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 03:02:45.474282 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 03:02:45.474282 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 03:02:45.474282 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 03:02:45.474282 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYh4T6KHxaTZJBBHXZTREoUFYIGfNOdOuQS9rVBAoTmtYgGzbYoji8YcA-t0cWcB0wQwSjmzMvJXZdi9q2Mzh_A_c5i66IyVTXL_4Lo0NqHsfjpuVhaPlibe0sz--CuBXEnCq_urvlNyiMlyg87cKEW53bWd1zKdP9wd4mpCJhEO-Mk Aug 27 03:02:45.474282 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 03:02:45.474282 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 03:02:45.474282 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 03:02:45.474282 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 03:02:45.474282 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 03:02:45.474282 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 03:02:45.474282 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: c41649f09cbf410a9825100c498b4916 Aug 27 03:02:45.474282 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-AttachVolumeTestJSON-1209514206 Aug 27 03:02:45.474282 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 03:02:45.474282 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 03:02:45.474282 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c41649f09cbf410a9825100c498b4916"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c41649f09cbf410a9825100c498b4916", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c41649f09cbf410a9825100c498b4916"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c41649f09cbf410a9825100c498b4916"}]}] Aug 27 03:02:45.474282 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-AttachVolumeTestJSON-1209514206 Aug 27 03:02:45.474282 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: c41649f09cbf410a9825100c498b4916 Aug 27 03:02:45.474282 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1209514206 Aug 27 03:02:45.474282 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-AttachVolumeTestJSON-1209514206-project Aug 27 03:02:45.474282 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 03:02:45.474282 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 03:02:45.474282 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 0fe0328160c6472086d13907344756cb Aug 27 03:02:45.474282 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-AttachVolumeTestJSON-1209514206-project Aug 27 03:02:45.474282 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 03:02:45.474282 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance 9d9f666f-0b19-4d87-a94a-770b5d99f349 could not be found. Aug 27 03:02:45.474282 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '9d9f666f-0b19-4d87-a94a-770b5d99f349'} Aug 27 03:02:45.474282 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:02:45.474282 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:02:45.474282 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:02:45.474282 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:02:45.474282 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:02:45.474282 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:02:45.474282 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:02:45.474282 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:02:45.474282 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:02:45.474282 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:02:45.474282 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d9f666f-0b19-4d87-a94a-770b5d99f349 could not be found. Aug 27 03:02:45.474282 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:02:45.474282 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:02:45.474282 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:02:45.474282 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:02:45.474282 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:02:45.474282 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:02:45.474282 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:02:45.474282 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:02:45.474282 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:02:45.474282 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:02:45.474282 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:02:45.474282 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:02:45.474282 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:02:45.474282 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:02:45.474282 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:02:45.474282 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:02:45.474282 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d9f666f-0b19-4d87-a94a-770b5d99f349 could not be found. Aug 27 03:02:45.474282 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:02:45.474282 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:02:45.474282 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:02:45.480866 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:02:45.480866 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:02:45.480866 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:02:45.480866 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:02:45.480866 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:02:45.480866 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d9f666f-0b19-4d87-a94a-770b5d99f349 could not be found. Aug 27 03:02:45.480866 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:02:45.483556 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-7c6934a9-7512-44fc-97d9-9706d51b847b tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Returning 404 to user: Instance 9d9f666f-0b19-4d87-a94a-770b5d99f349 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:02:45.485023 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-7c6934a9-7512-44fc-97d9-9706d51b847b tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] 10.222.0.70 "GET /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349" status: 404 len: 111 microversion: 2.1 time: 0.092135 Aug 27 03:02:45.486529 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2090/4216] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:02:45 2022] GET /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:02:45.497087 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e6c873af-b4bf-4fe0-b7cf-d8b500efef58 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Calling method '.version_select at 0x7f5eddcf90d0>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:45.533863 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e6c873af-b4bf-4fe0-b7cf-d8b500efef58 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1655999747" status: 202 len: 0 microversion: 2.1 time: 0.038960 Aug 27 03:02:45.534819 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2127/4217] 10.222.0.70 () {58 vars in 1221 bytes} [Sat Aug 27 03:02:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1655999747 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:02:45.879366 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-fdaef448-0e52-44af-87c9-806839a3fcba tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:45.880216 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-fdaef448-0e52-44af-87c9-806839a3fcba tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: ecbf3ab5-9736-491e-b120-6a30d40bc328] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:45.887946 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fdaef448-0e52-44af-87c9-806839a3fcba tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:45.889451 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fdaef448-0e52-44af-87c9-806839a3fcba tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:45.890093 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fdaef448-0e52-44af-87c9-806839a3fcba tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:45.890980 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fdaef448-0e52-44af-87c9-806839a3fcba tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:45.891595 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fdaef448-0e52-44af-87c9-806839a3fcba tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:45.892175 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fdaef448-0e52-44af-87c9-806839a3fcba tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:46.318426 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-fdaef448-0e52-44af-87c9-806839a3fcba tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36697e722bef4a33ab158e9b2f87596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4ca527ba3b49539b528ec8950aef78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:46.329160 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-fdaef448-0e52-44af-87c9-806839a3fcba tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "GET /compute/v2.1/servers/ecbf3ab5-9736-491e-b120-6a30d40bc328" status: 200 len: 1322 microversion: 2.1 time: 0.454620 Aug 27 03:02:46.342281 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2091/4218] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:02:45 2022] GET /compute/v2.1/servers/ecbf3ab5-9736-491e-b120-6a30d40bc328 => generated 1322 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:02:47.354567 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-1494162c-f64e-4d56-aa67-1d889b87492f tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:47.355942 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-1494162c-f64e-4d56-aa67-1d889b87492f tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: ecbf3ab5-9736-491e-b120-6a30d40bc328] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:47.362923 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1494162c-f64e-4d56-aa67-1d889b87492f tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:47.363696 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1494162c-f64e-4d56-aa67-1d889b87492f tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:47.364398 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1494162c-f64e-4d56-aa67-1d889b87492f tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:47.365405 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1494162c-f64e-4d56-aa67-1d889b87492f tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:47.366019 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1494162c-f64e-4d56-aa67-1d889b87492f tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:47.366623 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1494162c-f64e-4d56-aa67-1d889b87492f tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:47.668145 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-1494162c-f64e-4d56-aa67-1d889b87492f tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36697e722bef4a33ab158e9b2f87596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4ca527ba3b49539b528ec8950aef78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:47.682609 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-1494162c-f64e-4d56-aa67-1d889b87492f tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "GET /compute/v2.1/servers/ecbf3ab5-9736-491e-b120-6a30d40bc328" status: 200 len: 1516 microversion: 2.1 time: 0.336357 Aug 27 03:02:47.683519 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2128/4219] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:02:47 2022] GET /compute/v2.1/servers/ecbf3ab5-9736-491e-b120-6a30d40bc328 => generated 1516 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:02:47.703239 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c3f8117a-0096-46d2-bea2-aaaa181af4bc tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:02:47.707201 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-c3f8117a-0096-46d2-bea2-aaaa181af4bc tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: ecbf3ab5-9736-491e-b120-6a30d40bc328] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:47.715603 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c3f8117a-0096-46d2-bea2-aaaa181af4bc tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:47.716389 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c3f8117a-0096-46d2-bea2-aaaa181af4bc tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:47.717030 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c3f8117a-0096-46d2-bea2-aaaa181af4bc tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:47.717959 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c3f8117a-0096-46d2-bea2-aaaa181af4bc tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:47.718562 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c3f8117a-0096-46d2-bea2-aaaa181af4bc tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:47.719143 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c3f8117a-0096-46d2-bea2-aaaa181af4bc tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:47.753467 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.instance [None req-c3f8117a-0096-46d2-bea2-aaaa181af4bc tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lazy-loading 'flavor' on Instance uuid ecbf3ab5-9736-491e-b120-6a30d40bc328 {{(pid=134052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:02:47.850238 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c3f8117a-0096-46d2-bea2-aaaa181af4bc tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "POST /compute/v2.1/servers/ecbf3ab5-9736-491e-b120-6a30d40bc328/action" status: 200 len: 32 microversion: 2.1 time: 0.148500 Aug 27 03:02:47.866474 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-6c91cd20-e281-4a1c-8c6b-b7e2cb9a7b8e tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:47.867734 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-6c91cd20-e281-4a1c-8c6b-b7e2cb9a7b8e tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: ecbf3ab5-9736-491e-b120-6a30d40bc328] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:47.872342 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2092/4220] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:02:47 2022] POST /compute/v2.1/servers/ecbf3ab5-9736-491e-b120-6a30d40bc328/action => generated 32 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:02:47.884164 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6c91cd20-e281-4a1c-8c6b-b7e2cb9a7b8e tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:47.884882 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6c91cd20-e281-4a1c-8c6b-b7e2cb9a7b8e tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:47.887742 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c2b853ec-6b72-4c6c-8464-7e796f650045 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Action: 'create', calling method: .version_select at 0x7f5ee30919d0>, body: {"keypair": {"name": "tempest-keypair-645928241", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCY2zn1H2F4vuWDJOkfzxvCcDPt8m7bWGOQFdklqMqi9dESSwmuoKJ8JUSt5f6ruOjgFcNIqYglBUCaR3L+6YjueAFDpQU+Kg3AaOc2+DzFJuwmrx0eOJ9OPdC2idKhJSg=="}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:02:47.888131 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6c91cd20-e281-4a1c-8c6b-b7e2cb9a7b8e tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:47.889701 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6c91cd20-e281-4a1c-8c6b-b7e2cb9a7b8e tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:47.890331 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6c91cd20-e281-4a1c-8c6b-b7e2cb9a7b8e tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:47.891873 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6c91cd20-e281-4a1c-8c6b-b7e2cb9a7b8e tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:47.930471 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-c2b853ec-6b72-4c6c-8464-7e796f650045 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Getting quotas for project c41649f09cbf410a9825100c498b4916. Resources: {'key_pairs'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:02:47.942445 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-c2b853ec-6b72-4c6c-8464-7e796f650045 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Getting quotas for user 0fe0328160c6472086d13907344756cb and project c41649f09cbf410a9825100c498b4916. Resources: {'key_pairs'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:02:47.982554 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c2b853ec-6b72-4c6c-8464-7e796f650045 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.107423 Aug 27 03:02:47.983813 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2093/4221] 10.222.0.70 () {60 vars in 1159 bytes} [Sat Aug 27 03:02:47 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:02:48.289668 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-6c91cd20-e281-4a1c-8c6b-b7e2cb9a7b8e tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36697e722bef4a33ab158e9b2f87596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4ca527ba3b49539b528ec8950aef78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:48.302050 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-6c91cd20-e281-4a1c-8c6b-b7e2cb9a7b8e tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "GET /compute/v2.1/servers/ecbf3ab5-9736-491e-b120-6a30d40bc328" status: 200 len: 1522 microversion: 2.1 time: 0.442954 Aug 27 03:02:48.325218 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2129/4222] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:02:47 2022] GET /compute/v2.1/servers/ecbf3ab5-9736-491e-b120-6a30d40bc328 => generated 1522 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:02:49.338075 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c2a2ddc7-a344-4bda-88f5-7bca01e22895 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:49.339455 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-c2a2ddc7-a344-4bda-88f5-7bca01e22895 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: ecbf3ab5-9736-491e-b120-6a30d40bc328] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:49.366271 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c2a2ddc7-a344-4bda-88f5-7bca01e22895 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:49.366271 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c2a2ddc7-a344-4bda-88f5-7bca01e22895 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:49.368165 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c2a2ddc7-a344-4bda-88f5-7bca01e22895 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:49.371011 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c2a2ddc7-a344-4bda-88f5-7bca01e22895 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:49.372572 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c2a2ddc7-a344-4bda-88f5-7bca01e22895 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:49.374010 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c2a2ddc7-a344-4bda-88f5-7bca01e22895 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:50.116185 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-c2a2ddc7-a344-4bda-88f5-7bca01e22895 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36697e722bef4a33ab158e9b2f87596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4ca527ba3b49539b528ec8950aef78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:50.137194 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c2a2ddc7-a344-4bda-88f5-7bca01e22895 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "GET /compute/v2.1/servers/ecbf3ab5-9736-491e-b120-6a30d40bc328" status: 200 len: 1522 microversion: 2.1 time: 0.809361 Aug 27 03:02:50.143662 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2094/4223] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:02:49 2022] GET /compute/v2.1/servers/ecbf3ab5-9736-491e-b120-6a30d40bc328 => generated 1522 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:02:51.160762 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8f049eb6-179e-4e72-9a14-0b30479cbe95 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:51.161406 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-8f049eb6-179e-4e72-9a14-0b30479cbe95 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: ecbf3ab5-9736-491e-b120-6a30d40bc328] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:51.176877 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8f049eb6-179e-4e72-9a14-0b30479cbe95 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:51.177366 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8f049eb6-179e-4e72-9a14-0b30479cbe95 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:51.177798 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8f049eb6-179e-4e72-9a14-0b30479cbe95 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:51.197826 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8f049eb6-179e-4e72-9a14-0b30479cbe95 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:51.198348 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8f049eb6-179e-4e72-9a14-0b30479cbe95 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:51.199559 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8f049eb6-179e-4e72-9a14-0b30479cbe95 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:51.817063 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-8f049eb6-179e-4e72-9a14-0b30479cbe95 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36697e722bef4a33ab158e9b2f87596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4ca527ba3b49539b528ec8950aef78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:51.834601 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-8f049eb6-179e-4e72-9a14-0b30479cbe95 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "GET /compute/v2.1/servers/ecbf3ab5-9736-491e-b120-6a30d40bc328" status: 200 len: 1522 microversion: 2.1 time: 0.680072 Aug 27 03:02:51.836888 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2130/4224] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:02:51 2022] GET /compute/v2.1/servers/ecbf3ab5-9736-491e-b120-6a30d40bc328 => generated 1522 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:02:52.043793 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-16131d61-4f0f-4bd4-9e45-7591d6c73944 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1256333572", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:02:52.122456 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.network.neutron [None req-16131d61-4f0f-4bd4-9e45-7591d6c73944 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] validate_networks() for [('ef35040d-7f47-4e48-bab5-bc23ac5b1c2b', None, None, None, None, None)] {{(pid=134052) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:02:52.862569 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-90a851b6-5b4c-4e87-bcac-956d652dcaa0 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:52.863182 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-90a851b6-5b4c-4e87-bcac-956d652dcaa0 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: ecbf3ab5-9736-491e-b120-6a30d40bc328] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:52.882761 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:02:52.884353 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-90a851b6-5b4c-4e87-bcac-956d652dcaa0 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:52.898558 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-90a851b6-5b4c-4e87-bcac-956d652dcaa0 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:52.899127 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-90a851b6-5b4c-4e87-bcac-956d652dcaa0 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:52.900143 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-90a851b6-5b4c-4e87-bcac-956d652dcaa0 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:52.900652 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-90a851b6-5b4c-4e87-bcac-956d652dcaa0 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:52.901076 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-90a851b6-5b4c-4e87-bcac-956d652dcaa0 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:53.272520 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-16131d61-4f0f-4bd4-9e45-7591d6c73944 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Flavor limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:02:53.273107 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-16131d61-4f0f-4bd4-9e45-7591d6c73944 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Image limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:02:53.273841 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-16131d61-4f0f-4bd4-9e45-7591d6c73944 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Flavor pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:02:53.274318 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-16131d61-4f0f-4bd4-9e45-7591d6c73944 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Image pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:02:53.274740 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-16131d61-4f0f-4bd4-9e45-7591d6c73944 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:02:53.301572 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-16131d61-4f0f-4bd4-9e45-7591d6c73944 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:53.302280 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-16131d61-4f0f-4bd4-9e45-7591d6c73944 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:53.302930 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-16131d61-4f0f-4bd4-9e45-7591d6c73944 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:53.306956 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-16131d61-4f0f-4bd4-9e45-7591d6c73944 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:53.307609 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-16131d61-4f0f-4bd4-9e45-7591d6c73944 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:53.311823 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-16131d61-4f0f-4bd4-9e45-7591d6c73944 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:53.357720 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-16131d61-4f0f-4bd4-9e45-7591d6c73944 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Getting quotas for project fc32a1b54e30415eb8f0e6df5e8b7be6. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:02:53.371770 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-16131d61-4f0f-4bd4-9e45-7591d6c73944 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Getting quotas for user e0c3da1faaee46ca94d2a2543851f3f6 and project fc32a1b54e30415eb8f0e6df5e8b7be6. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:02:53.406067 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-16131d61-4f0f-4bd4-9e45-7591d6c73944 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Going to run 1 instances... {{(pid=134052) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:02:53.410509 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-16131d61-4f0f-4bd4-9e45-7591d6c73944 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] [instance: 0069592c-7187-4b4d-ab74-3a1a3bc3de80] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134052) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:02:53.523204 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-90a851b6-5b4c-4e87-bcac-956d652dcaa0 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36697e722bef4a33ab158e9b2f87596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4ca527ba3b49539b528ec8950aef78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:53.531733 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-16131d61-4f0f-4bd4-9e45-7591d6c73944 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.682259 Aug 27 03:02:53.532478 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2095/4225] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 03:02:51 2022] POST /compute/v2.1/servers => generated 383 bytes in 1684 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:02:53.560117 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-90a851b6-5b4c-4e87-bcac-956d652dcaa0 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "GET /compute/v2.1/servers/ecbf3ab5-9736-491e-b120-6a30d40bc328" status: 200 len: 1522 microversion: 2.1 time: 0.701603 Aug 27 03:02:53.562456 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2131/4226] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:02:52 2022] GET /compute/v2.1/servers/ecbf3ab5-9736-491e-b120-6a30d40bc328 => generated 1522 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:02:53.563277 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-110c04da-5b95-4312-ac68-26aa0e3cd229 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:53.564156 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-110c04da-5b95-4312-ac68-26aa0e3cd229 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] [instance: 0069592c-7187-4b4d-ab74-3a1a3bc3de80] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:53.708878 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-110c04da-5b95-4312-ac68-26aa0e3cd229 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c3da1faaee46ca94d2a2543851f3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32a1b54e30415eb8f0e6df5e8b7be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:53.712503 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c5587f8b-4723-4f9b-b3a6-d41d3a9d8eb7 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1569156535", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "73c04f6e-5590-41d2-bc5e-2c1c2572a4c3"}], "security_groups": [{"name": "tempest-securitygroup--1170942070"}], "key_name": "tempest-keypair-645928241", "user_data": "}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:02:53.717305 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-110c04da-5b95-4312-ac68-26aa0e3cd229 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] 10.222.0.70 "GET /compute/v2.1/servers/0069592c-7187-4b4d-ab74-3a1a3bc3de80" status: 200 len: 1214 microversion: 2.1 time: 0.161830 Aug 27 03:02:53.731047 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2096/4227] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:02:53 2022] GET /compute/v2.1/servers/0069592c-7187-4b4d-ab74-3a1a3bc3de80 => generated 1214 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:02:54.082822 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.network.neutron [None req-c5587f8b-4723-4f9b-b3a6-d41d3a9d8eb7 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] validate_networks() for [('73c04f6e-5590-41d2-bc5e-2c1c2572a4c3', None, None, None, None, None)] {{(pid=134051) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:02:54.588447 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4a148f5c-6591-4190-8f2f-41b96fde6ad7 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:54.592036 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-4a148f5c-6591-4190-8f2f-41b96fde6ad7 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: ecbf3ab5-9736-491e-b120-6a30d40bc328] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:54.610046 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4a148f5c-6591-4190-8f2f-41b96fde6ad7 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:54.611061 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4a148f5c-6591-4190-8f2f-41b96fde6ad7 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:54.611738 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4a148f5c-6591-4190-8f2f-41b96fde6ad7 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:54.612633 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4a148f5c-6591-4190-8f2f-41b96fde6ad7 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:54.613273 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4a148f5c-6591-4190-8f2f-41b96fde6ad7 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:54.613810 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4a148f5c-6591-4190-8f2f-41b96fde6ad7 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:55.136097 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-4a148f5c-6591-4190-8f2f-41b96fde6ad7 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36697e722bef4a33ab158e9b2f87596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4ca527ba3b49539b528ec8950aef78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:55.148089 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-4a148f5c-6591-4190-8f2f-41b96fde6ad7 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "GET /compute/v2.1/servers/ecbf3ab5-9736-491e-b120-6a30d40bc328" status: 200 len: 1522 microversion: 2.1 time: 0.566137 Aug 27 03:02:55.148766 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2097/4228] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:02:54 2022] GET /compute/v2.1/servers/ecbf3ab5-9736-491e-b120-6a30d40bc328 => generated 1522 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:02:55.165148 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f082dfba-fa7f-4d7a-a010-93c25dae98ba tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:55.165691 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-f082dfba-fa7f-4d7a-a010-93c25dae98ba tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] [instance: 0069592c-7187-4b4d-ab74-3a1a3bc3de80] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:55.183431 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f082dfba-fa7f-4d7a-a010-93c25dae98ba tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:55.183938 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f082dfba-fa7f-4d7a-a010-93c25dae98ba tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:55.190633 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f082dfba-fa7f-4d7a-a010-93c25dae98ba tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:55.191416 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f082dfba-fa7f-4d7a-a010-93c25dae98ba tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:55.191969 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f082dfba-fa7f-4d7a-a010-93c25dae98ba tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:55.192436 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f082dfba-fa7f-4d7a-a010-93c25dae98ba tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:55.322185 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-f082dfba-fa7f-4d7a-a010-93c25dae98ba tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c3da1faaee46ca94d2a2543851f3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32a1b54e30415eb8f0e6df5e8b7be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:55.347927 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f082dfba-fa7f-4d7a-a010-93c25dae98ba tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] 10.222.0.70 "GET /compute/v2.1/servers/0069592c-7187-4b4d-ab74-3a1a3bc3de80" status: 200 len: 1274 microversion: 2.1 time: 0.196962 Aug 27 03:02:55.349448 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2098/4229] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:02:55 2022] GET /compute/v2.1/servers/0069592c-7187-4b4d-ab74-3a1a3bc3de80 => generated 1274 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:02:56.179717 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-977e6821-efbf-4e1e-85bc-e3eeb9184099 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:56.181095 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-977e6821-efbf-4e1e-85bc-e3eeb9184099 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: ecbf3ab5-9736-491e-b120-6a30d40bc328] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:56.194285 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-977e6821-efbf-4e1e-85bc-e3eeb9184099 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:56.197161 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-977e6821-efbf-4e1e-85bc-e3eeb9184099 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:56.197647 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-977e6821-efbf-4e1e-85bc-e3eeb9184099 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:56.198448 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-977e6821-efbf-4e1e-85bc-e3eeb9184099 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:56.203400 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-977e6821-efbf-4e1e-85bc-e3eeb9184099 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:56.204872 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-977e6821-efbf-4e1e-85bc-e3eeb9184099 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:56.274717 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-c5587f8b-4723-4f9b-b3a6-d41d3a9d8eb7 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Flavor limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:02:56.275428 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-c5587f8b-4723-4f9b-b3a6-d41d3a9d8eb7 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Image limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:02:56.276045 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-c5587f8b-4723-4f9b-b3a6-d41d3a9d8eb7 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Flavor pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:02:56.276700 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-c5587f8b-4723-4f9b-b3a6-d41d3a9d8eb7 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Image pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:02:56.277323 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-c5587f8b-4723-4f9b-b3a6-d41d3a9d8eb7 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:02:56.298570 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c5587f8b-4723-4f9b-b3a6-d41d3a9d8eb7 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:56.303552 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c5587f8b-4723-4f9b-b3a6-d41d3a9d8eb7 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:56.309463 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c5587f8b-4723-4f9b-b3a6-d41d3a9d8eb7 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:56.310972 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c5587f8b-4723-4f9b-b3a6-d41d3a9d8eb7 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:56.311638 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c5587f8b-4723-4f9b-b3a6-d41d3a9d8eb7 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:56.312253 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c5587f8b-4723-4f9b-b3a6-d41d3a9d8eb7 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:56.379685 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-c5587f8b-4723-4f9b-b3a6-d41d3a9d8eb7 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Getting quotas for project c41649f09cbf410a9825100c498b4916. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:02:56.387088 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-c5587f8b-4723-4f9b-b3a6-d41d3a9d8eb7 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Getting quotas for user 0fe0328160c6472086d13907344756cb and project c41649f09cbf410a9825100c498b4916. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:02:56.433385 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-c5587f8b-4723-4f9b-b3a6-d41d3a9d8eb7 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Going to run 1 instances... {{(pid=134051) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:02:56.439904 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-c5587f8b-4723-4f9b-b3a6-d41d3a9d8eb7 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] [instance: f90d78a8-dea6-45c3-933c-8184ff4858b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134051) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:02:56.503447 n-d-852278-4 devstack@n-api.service[134051]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c5587f8b-4723-4f9b-b3a6-d41d3a9d8eb7 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] [6698c758-4a05-41fa-9c20-a838e0029970] AMQP server on 10.222.0.70:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 27 03:02:56.744368 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-977e6821-efbf-4e1e-85bc-e3eeb9184099 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36697e722bef4a33ab158e9b2f87596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4ca527ba3b49539b528ec8950aef78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:56.758487 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-977e6821-efbf-4e1e-85bc-e3eeb9184099 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "GET /compute/v2.1/servers/ecbf3ab5-9736-491e-b120-6a30d40bc328" status: 200 len: 1522 microversion: 2.1 time: 0.584223 Aug 27 03:02:56.763040 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2099/4230] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:02:56 2022] GET /compute/v2.1/servers/ecbf3ab5-9736-491e-b120-6a30d40bc328 => generated 1522 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:02:56.774846 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-54fd2b37-a746-4c78-ab27-362d521a4ae6 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:56.775453 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-54fd2b37-a746-4c78-ab27-362d521a4ae6 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] [instance: 0069592c-7187-4b4d-ab74-3a1a3bc3de80] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:56.791494 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-54fd2b37-a746-4c78-ab27-362d521a4ae6 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:56.793051 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-54fd2b37-a746-4c78-ab27-362d521a4ae6 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:56.793474 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-54fd2b37-a746-4c78-ab27-362d521a4ae6 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:56.796514 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-54fd2b37-a746-4c78-ab27-362d521a4ae6 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:56.797166 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-54fd2b37-a746-4c78-ab27-362d521a4ae6 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:56.797816 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-54fd2b37-a746-4c78-ab27-362d521a4ae6 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:56.927145 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-54fd2b37-a746-4c78-ab27-362d521a4ae6 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c3da1faaee46ca94d2a2543851f3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32a1b54e30415eb8f0e6df5e8b7be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:56.937096 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-54fd2b37-a746-4c78-ab27-362d521a4ae6 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] 10.222.0.70 "GET /compute/v2.1/servers/0069592c-7187-4b4d-ab74-3a1a3bc3de80" status: 200 len: 1272 microversion: 2.1 time: 0.172693 Aug 27 03:02:56.938394 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2100/4231] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:02:56 2022] GET /compute/v2.1/servers/0069592c-7187-4b4d-ab74-3a1a3bc3de80 => generated 1272 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:02:57.517816 n-d-852278-4 devstack@n-api.service[134051]: INFO oslo.messaging._drivers.impl_rabbit [None req-c5587f8b-4723-4f9b-b3a6-d41d3a9d8eb7 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] [6698c758-4a05-41fa-9c20-a838e0029970] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 50842. Aug 27 03:02:57.527614 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c5587f8b-4723-4f9b-b3a6-d41d3a9d8eb7 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.821969 Aug 27 03:02:57.530137 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2132/4232] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 03:02:53 2022] POST /compute/v2.1/servers => generated 402 bytes in 3825 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 03:02:57.541199 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a6085420-821e-4270-9533-f68e7d59f6e6 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:57.541809 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a6085420-821e-4270-9533-f68e7d59f6e6 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] [instance: f90d78a8-dea6-45c3-933c-8184ff4858b1] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:57.616871 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-a6085420-821e-4270-9533-f68e7d59f6e6 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe0328160c6472086d13907344756cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41649f09cbf410a9825100c498b4916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:57.624563 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a6085420-821e-4270-9533-f68e7d59f6e6 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] 10.222.0.70 "GET /compute/v2.1/servers/f90d78a8-dea6-45c3-933c-8184ff4858b1" status: 200 len: 1237 microversion: 2.1 time: 0.087475 Aug 27 03:02:57.628029 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2101/4233] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:02:57 2022] GET /compute/v2.1/servers/f90d78a8-dea6-45c3-933c-8184ff4858b1 => generated 1237 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:02:57.787269 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e80b0f9b-a4e8-4f66-ad32-8572836e1c2a tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:57.789582 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-e80b0f9b-a4e8-4f66-ad32-8572836e1c2a tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: ecbf3ab5-9736-491e-b120-6a30d40bc328] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:57.819201 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e80b0f9b-a4e8-4f66-ad32-8572836e1c2a tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:57.830394 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e80b0f9b-a4e8-4f66-ad32-8572836e1c2a tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:57.832559 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e80b0f9b-a4e8-4f66-ad32-8572836e1c2a tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:57.836241 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e80b0f9b-a4e8-4f66-ad32-8572836e1c2a tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:57.840957 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e80b0f9b-a4e8-4f66-ad32-8572836e1c2a tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:57.841502 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e80b0f9b-a4e8-4f66-ad32-8572836e1c2a tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:57.966181 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5c2f2e03-0787-4793-8554-ed26b6d1850a tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:57.966811 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-5c2f2e03-0787-4793-8554-ed26b6d1850a tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] [instance: 0069592c-7187-4b4d-ab74-3a1a3bc3de80] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:57.999080 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5c2f2e03-0787-4793-8554-ed26b6d1850a tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:57.999485 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5c2f2e03-0787-4793-8554-ed26b6d1850a tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:58.008537 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5c2f2e03-0787-4793-8554-ed26b6d1850a tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:58.015039 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5c2f2e03-0787-4793-8554-ed26b6d1850a tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:58.020752 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5c2f2e03-0787-4793-8554-ed26b6d1850a tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:58.022048 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5c2f2e03-0787-4793-8554-ed26b6d1850a tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:58.206195 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e80b0f9b-a4e8-4f66-ad32-8572836e1c2a tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36697e722bef4a33ab158e9b2f87596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4ca527ba3b49539b528ec8950aef78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:58.212912 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:02:58.217491 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e80b0f9b-a4e8-4f66-ad32-8572836e1c2a tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "GET /compute/v2.1/servers/ecbf3ab5-9736-491e-b120-6a30d40bc328" status: 200 len: 1522 microversion: 2.1 time: 0.439064 Aug 27 03:02:58.218645 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2133/4234] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:02:57 2022] GET /compute/v2.1/servers/ecbf3ab5-9736-491e-b120-6a30d40bc328 => generated 1522 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:02:58.290329 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-6f7bbdf9-ae4d-4986-afce-e616ef96bb23 req-6fe1a957-a5d4-4ea3-a541-e7c2cdafb770 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0069592c-7187-4b4d-ab74-3a1a3bc3de80", "tag": "3e000d21-3244-41a2-8197-507cf2017f67"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:02:58.336942 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-6f7bbdf9-ae4d-4986-afce-e616ef96bb23 req-6fe1a957-a5d4-4ea3-a541-e7c2cdafb770 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:58.339858 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-6f7bbdf9-ae4d-4986-afce-e616ef96bb23 req-6fe1a957-a5d4-4ea3-a541-e7c2cdafb770 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:58.340558 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-6f7bbdf9-ae4d-4986-afce-e616ef96bb23 req-6fe1a957-a5d4-4ea3-a541-e7c2cdafb770 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:58.357703 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-5c2f2e03-0787-4793-8554-ed26b6d1850a tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c3da1faaee46ca94d2a2543851f3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32a1b54e30415eb8f0e6df5e8b7be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:58.369674 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-5c2f2e03-0787-4793-8554-ed26b6d1850a tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] 10.222.0.70 "GET /compute/v2.1/servers/0069592c-7187-4b4d-ab74-3a1a3bc3de80" status: 200 len: 1314 microversion: 2.1 time: 0.413813 Aug 27 03:02:58.370671 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2102/4235] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:02:57 2022] GET /compute/v2.1/servers/0069592c-7187-4b4d-ab74-3a1a3bc3de80 => generated 1314 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:02:58.372351 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-6f7bbdf9-ae4d-4986-afce-e616ef96bb23 req-6fe1a957-a5d4-4ea3-a541-e7c2cdafb770 service nova] Creating event network-changed:3e000d21-3244-41a2-8197-507cf2017f67 for instance 0069592c-7187-4b4d-ab74-3a1a3bc3de80 on n-h2-852278-4 Aug 27 03:02:58.389363 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-6f7bbdf9-ae4d-4986-afce-e616ef96bb23 req-6fe1a957-a5d4-4ea3-a541-e7c2cdafb770 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109114 Aug 27 03:02:58.390281 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2134/4236] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:02:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:02:58.645728 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9283cd2a-4b3a-445f-8463-a13db8f2b774 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:58.646547 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-9283cd2a-4b3a-445f-8463-a13db8f2b774 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] [instance: f90d78a8-dea6-45c3-933c-8184ff4858b1] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:58.654220 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9283cd2a-4b3a-445f-8463-a13db8f2b774 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:58.654731 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9283cd2a-4b3a-445f-8463-a13db8f2b774 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:58.655171 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9283cd2a-4b3a-445f-8463-a13db8f2b774 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:58.656404 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9283cd2a-4b3a-445f-8463-a13db8f2b774 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:58.657062 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9283cd2a-4b3a-445f-8463-a13db8f2b774 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:58.657697 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9283cd2a-4b3a-445f-8463-a13db8f2b774 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:58.752396 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-9283cd2a-4b3a-445f-8463-a13db8f2b774 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe0328160c6472086d13907344756cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41649f09cbf410a9825100c498b4916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:58.764610 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9283cd2a-4b3a-445f-8463-a13db8f2b774 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] 10.222.0.70 "GET /compute/v2.1/servers/f90d78a8-dea6-45c3-933c-8184ff4858b1" status: 200 len: 1233 microversion: 2.1 time: 0.122980 Aug 27 03:02:58.765801 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2103/4237] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:02:58 2022] GET /compute/v2.1/servers/f90d78a8-dea6-45c3-933c-8184ff4858b1 => generated 1233 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:02:59.240441 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d8b8c159-bb38-4132-bd8c-5fa6a8b0efdc tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:59.241700 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d8b8c159-bb38-4132-bd8c-5fa6a8b0efdc tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: ecbf3ab5-9736-491e-b120-6a30d40bc328] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:59.249302 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d8b8c159-bb38-4132-bd8c-5fa6a8b0efdc tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:59.250306 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d8b8c159-bb38-4132-bd8c-5fa6a8b0efdc tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:59.250748 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d8b8c159-bb38-4132-bd8c-5fa6a8b0efdc tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:59.251657 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d8b8c159-bb38-4132-bd8c-5fa6a8b0efdc tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:59.253721 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d8b8c159-bb38-4132-bd8c-5fa6a8b0efdc tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:59.254405 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d8b8c159-bb38-4132-bd8c-5fa6a8b0efdc tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:59.393742 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9fbff4b8-ed2d-49f7-ae39-8b42b0d75a46 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:59.394374 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-9fbff4b8-ed2d-49f7-ae39-8b42b0d75a46 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] [instance: 0069592c-7187-4b4d-ab74-3a1a3bc3de80] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:59.406318 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9fbff4b8-ed2d-49f7-ae39-8b42b0d75a46 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:59.406974 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9fbff4b8-ed2d-49f7-ae39-8b42b0d75a46 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:59.407524 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9fbff4b8-ed2d-49f7-ae39-8b42b0d75a46 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:59.408469 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9fbff4b8-ed2d-49f7-ae39-8b42b0d75a46 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:59.408989 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9fbff4b8-ed2d-49f7-ae39-8b42b0d75a46 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:59.409522 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9fbff4b8-ed2d-49f7-ae39-8b42b0d75a46 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:59.432659 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:02:59.518049 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d8b8c159-bb38-4132-bd8c-5fa6a8b0efdc tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36697e722bef4a33ab158e9b2f87596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4ca527ba3b49539b528ec8950aef78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:59.527701 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d8b8c159-bb38-4132-bd8c-5fa6a8b0efdc tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "GET /compute/v2.1/servers/ecbf3ab5-9736-491e-b120-6a30d40bc328" status: 200 len: 1522 microversion: 2.1 time: 0.292573 Aug 27 03:02:59.528805 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2135/4238] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:02:59 2022] GET /compute/v2.1/servers/ecbf3ab5-9736-491e-b120-6a30d40bc328 => generated 1522 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:02:59.643479 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-9fbff4b8-ed2d-49f7-ae39-8b42b0d75a46 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c3da1faaee46ca94d2a2543851f3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32a1b54e30415eb8f0e6df5e8b7be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:59.654034 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9fbff4b8-ed2d-49f7-ae39-8b42b0d75a46 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] 10.222.0.70 "GET /compute/v2.1/servers/0069592c-7187-4b4d-ab74-3a1a3bc3de80" status: 200 len: 1314 microversion: 2.1 time: 0.264420 Aug 27 03:02:59.664522 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2104/4239] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:02:59 2022] GET /compute/v2.1/servers/0069592c-7187-4b4d-ab74-3a1a3bc3de80 => generated 1314 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:02:59.790164 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-04b9e760-91f6-49ad-83ac-afdc1ee29d6d tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:59.790164 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-04b9e760-91f6-49ad-83ac-afdc1ee29d6d tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] [instance: f90d78a8-dea6-45c3-933c-8184ff4858b1] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:59.799768 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-04b9e760-91f6-49ad-83ac-afdc1ee29d6d tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:59.800279 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-04b9e760-91f6-49ad-83ac-afdc1ee29d6d tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:59.800754 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-04b9e760-91f6-49ad-83ac-afdc1ee29d6d tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:59.801486 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-04b9e760-91f6-49ad-83ac-afdc1ee29d6d tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:59.801947 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-04b9e760-91f6-49ad-83ac-afdc1ee29d6d tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:59.802379 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-04b9e760-91f6-49ad-83ac-afdc1ee29d6d tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:00.044919 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-04b9e760-91f6-49ad-83ac-afdc1ee29d6d tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe0328160c6472086d13907344756cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41649f09cbf410a9825100c498b4916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:00.055187 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-04b9e760-91f6-49ad-83ac-afdc1ee29d6d tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] 10.222.0.70 "GET /compute/v2.1/servers/f90d78a8-dea6-45c3-933c-8184ff4858b1" status: 200 len: 1295 microversion: 2.1 time: 0.273210 Aug 27 03:03:00.055787 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2136/4240] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:02:59 2022] GET /compute/v2.1/servers/f90d78a8-dea6-45c3-933c-8184ff4858b1 => generated 1295 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:03:00.269432 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-74317027-761a-4134-8c56-f7aacd697dd0 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-1586793441", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "networks": [{"uuid": "961028dd-9dfc-4287-bc1b-27b14d79a81a"}]}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:03:00.293507 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:03:00.395791 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.network.neutron [None req-74317027-761a-4134-8c56-f7aacd697dd0 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] validate_networks() for [('961028dd-9dfc-4287-bc1b-27b14d79a81a', None, None, None, None, None)] {{(pid=134052) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:03:00.549357 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-2d7ce152-17fb-461c-a193-9ca398af93da tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:00.550845 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-2d7ce152-17fb-461c-a193-9ca398af93da tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: ecbf3ab5-9736-491e-b120-6a30d40bc328] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:00.572838 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2d7ce152-17fb-461c-a193-9ca398af93da tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:00.578498 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2d7ce152-17fb-461c-a193-9ca398af93da tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:00.580081 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2d7ce152-17fb-461c-a193-9ca398af93da tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:00.581301 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2d7ce152-17fb-461c-a193-9ca398af93da tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:00.582243 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2d7ce152-17fb-461c-a193-9ca398af93da tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:00.588899 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2d7ce152-17fb-461c-a193-9ca398af93da tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:00.872801 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-2d7ce152-17fb-461c-a193-9ca398af93da tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36697e722bef4a33ab158e9b2f87596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4ca527ba3b49539b528ec8950aef78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:00.881853 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-2d7ce152-17fb-461c-a193-9ca398af93da tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "GET /compute/v2.1/servers/ecbf3ab5-9736-491e-b120-6a30d40bc328" status: 200 len: 1522 microversion: 2.1 time: 0.336643 Aug 27 03:03:00.887026 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2137/4241] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:00 2022] GET /compute/v2.1/servers/ecbf3ab5-9736-491e-b120-6a30d40bc328 => generated 1522 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:03:00.901549 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ac7a5aa9-7ab1-4f82-9eec-9238e3ca482f tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:00.902573 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-ac7a5aa9-7ab1-4f82-9eec-9238e3ca482f tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] [instance: 0069592c-7187-4b4d-ab74-3a1a3bc3de80] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:00.916882 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ac7a5aa9-7ab1-4f82-9eec-9238e3ca482f tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:00.917673 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ac7a5aa9-7ab1-4f82-9eec-9238e3ca482f tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:00.918363 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ac7a5aa9-7ab1-4f82-9eec-9238e3ca482f tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:00.919356 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ac7a5aa9-7ab1-4f82-9eec-9238e3ca482f tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:00.920033 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ac7a5aa9-7ab1-4f82-9eec-9238e3ca482f tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:00.925476 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ac7a5aa9-7ab1-4f82-9eec-9238e3ca482f tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:01.330168 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-74317027-761a-4134-8c56-f7aacd697dd0 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Flavor limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:03:01.332131 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-74317027-761a-4134-8c56-f7aacd697dd0 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Image limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:03:01.333163 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-74317027-761a-4134-8c56-f7aacd697dd0 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Flavor pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:03:01.333751 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-74317027-761a-4134-8c56-f7aacd697dd0 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Image pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:03:01.334168 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-74317027-761a-4134-8c56-f7aacd697dd0 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:03:01.351770 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-74317027-761a-4134-8c56-f7aacd697dd0 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:01.352608 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-74317027-761a-4134-8c56-f7aacd697dd0 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:01.353039 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-74317027-761a-4134-8c56-f7aacd697dd0 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:01.353886 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-74317027-761a-4134-8c56-f7aacd697dd0 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:01.354337 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-74317027-761a-4134-8c56-f7aacd697dd0 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:01.354757 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-74317027-761a-4134-8c56-f7aacd697dd0 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:01.399683 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-74317027-761a-4134-8c56-f7aacd697dd0 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Getting quotas for project 6b8d6664c463420bad9a5bfb6d747db4. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:03:01.410665 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-74317027-761a-4134-8c56-f7aacd697dd0 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Getting quotas for user 13a4e6dcf5df46fcad30430a9b9a08ee and project 6b8d6664c463420bad9a5bfb6d747db4. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:03:01.445579 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-74317027-761a-4134-8c56-f7aacd697dd0 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Going to run 1 instances... {{(pid=134052) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:03:01.447993 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-74317027-761a-4134-8c56-f7aacd697dd0 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: dc5b167d-847f-428c-8cae-3eef7bdffe9f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134052) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:03:01.459911 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-ac7a5aa9-7ab1-4f82-9eec-9238e3ca482f tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c3da1faaee46ca94d2a2543851f3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32a1b54e30415eb8f0e6df5e8b7be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:01.475006 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ac7a5aa9-7ab1-4f82-9eec-9238e3ca482f tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] 10.222.0.70 "GET /compute/v2.1/servers/0069592c-7187-4b4d-ab74-3a1a3bc3de80" status: 200 len: 1314 microversion: 2.1 time: 0.586470 Aug 27 03:03:01.476746 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2138/4242] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:00 2022] GET /compute/v2.1/servers/0069592c-7187-4b4d-ab74-3a1a3bc3de80 => generated 1314 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:03:01.487549 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-fc10cb1d-ff76-48b8-b749-c4b2faaee15c tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:01.493820 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-fc10cb1d-ff76-48b8-b749-c4b2faaee15c tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] [instance: f90d78a8-dea6-45c3-933c-8184ff4858b1] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:01.511415 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fc10cb1d-ff76-48b8-b749-c4b2faaee15c tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:01.513899 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fc10cb1d-ff76-48b8-b749-c4b2faaee15c tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:01.514581 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fc10cb1d-ff76-48b8-b749-c4b2faaee15c tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:01.515528 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fc10cb1d-ff76-48b8-b749-c4b2faaee15c tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:01.523986 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fc10cb1d-ff76-48b8-b749-c4b2faaee15c tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:01.524919 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fc10cb1d-ff76-48b8-b749-c4b2faaee15c tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:01.533079 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-74317027-761a-4134-8c56-f7aacd697dd0 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.458885 Aug 27 03:03:01.539722 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2105/4243] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 03:03:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1466 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:03:01.545638 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8595dbe0-be61-4897-b93f-76cba7f0a86a tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:01.546600 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-8595dbe0-be61-4897-b93f-76cba7f0a86a tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: dc5b167d-847f-428c-8cae-3eef7bdffe9f] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:01.616174 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-8595dbe0-be61-4897-b93f-76cba7f0a86a tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:01.626071 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-8595dbe0-be61-4897-b93f-76cba7f0a86a tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/dc5b167d-847f-428c-8cae-3eef7bdffe9f" status: 200 len: 1193 microversion: 2.1 time: 0.084415 Aug 27 03:03:01.646848 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2106/4244] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:01 2022] GET /compute/v2.1/servers/dc5b167d-847f-428c-8cae-3eef7bdffe9f => generated 1193 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:03:01.786901 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-fc10cb1d-ff76-48b8-b749-c4b2faaee15c tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe0328160c6472086d13907344756cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41649f09cbf410a9825100c498b4916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:01.813756 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-fc10cb1d-ff76-48b8-b749-c4b2faaee15c tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] 10.222.0.70 "GET /compute/v2.1/servers/f90d78a8-dea6-45c3-933c-8184ff4858b1" status: 200 len: 1363 microversion: 2.1 time: 0.335678 Aug 27 03:03:01.814430 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2139/4245] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:01 2022] GET /compute/v2.1/servers/f90d78a8-dea6-45c3-933c-8184ff4858b1 => generated 1363 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:03:01.907306 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f887e656-f52c-4ec0-9c27-cf428e7f90fb tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:01.908534 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-f887e656-f52c-4ec0-9c27-cf428e7f90fb tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: ecbf3ab5-9736-491e-b120-6a30d40bc328] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:01.923833 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f887e656-f52c-4ec0-9c27-cf428e7f90fb tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:01.932570 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f887e656-f52c-4ec0-9c27-cf428e7f90fb tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:01.933410 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f887e656-f52c-4ec0-9c27-cf428e7f90fb tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:01.936828 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f887e656-f52c-4ec0-9c27-cf428e7f90fb tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:01.937651 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f887e656-f52c-4ec0-9c27-cf428e7f90fb tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:01.938524 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f887e656-f52c-4ec0-9c27-cf428e7f90fb tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:02.185946 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-f887e656-f52c-4ec0-9c27-cf428e7f90fb tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36697e722bef4a33ab158e9b2f87596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4ca527ba3b49539b528ec8950aef78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:02.206468 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f887e656-f52c-4ec0-9c27-cf428e7f90fb tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "GET /compute/v2.1/servers/ecbf3ab5-9736-491e-b120-6a30d40bc328" status: 200 len: 1522 microversion: 2.1 time: 0.302719 Aug 27 03:03:02.207586 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2107/4246] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:01 2022] GET /compute/v2.1/servers/ecbf3ab5-9736-491e-b120-6a30d40bc328 => generated 1522 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:03:02.499624 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7d0de2cf-49a4-44a0-a7bb-9cdea6414010 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:02.500258 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-7d0de2cf-49a4-44a0-a7bb-9cdea6414010 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] [instance: 0069592c-7187-4b4d-ab74-3a1a3bc3de80] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:02.512736 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7d0de2cf-49a4-44a0-a7bb-9cdea6414010 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:02.513238 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7d0de2cf-49a4-44a0-a7bb-9cdea6414010 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:02.513683 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7d0de2cf-49a4-44a0-a7bb-9cdea6414010 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:02.514404 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7d0de2cf-49a4-44a0-a7bb-9cdea6414010 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:02.514858 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7d0de2cf-49a4-44a0-a7bb-9cdea6414010 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:02.545263 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7d0de2cf-49a4-44a0-a7bb-9cdea6414010 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:02.654493 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d8fffd15-c9e7-46dc-8383-d690c3ecd032 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:02.655217 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d8fffd15-c9e7-46dc-8383-d690c3ecd032 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: dc5b167d-847f-428c-8cae-3eef7bdffe9f] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:02.669021 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d8fffd15-c9e7-46dc-8383-d690c3ecd032 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:02.669587 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d8fffd15-c9e7-46dc-8383-d690c3ecd032 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:02.670034 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d8fffd15-c9e7-46dc-8383-d690c3ecd032 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:02.670758 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d8fffd15-c9e7-46dc-8383-d690c3ecd032 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:02.672443 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d8fffd15-c9e7-46dc-8383-d690c3ecd032 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:02.673537 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d8fffd15-c9e7-46dc-8383-d690c3ecd032 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:02.835733 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-d8fffd15-c9e7-46dc-8383-d690c3ecd032 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:02.852959 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d8fffd15-c9e7-46dc-8383-d690c3ecd032 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/dc5b167d-847f-428c-8cae-3eef7bdffe9f" status: 200 len: 1189 microversion: 2.1 time: 0.203701 Aug 27 03:03:02.861427 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2108/4247] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:02 2022] GET /compute/v2.1/servers/dc5b167d-847f-428c-8cae-3eef7bdffe9f => generated 1189 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:03:02.866665 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e42b0dfb-f330-4776-b24a-c3ef1af9c3ac tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:02.877562 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-e42b0dfb-f330-4776-b24a-c3ef1af9c3ac tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] [instance: f90d78a8-dea6-45c3-933c-8184ff4858b1] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:02.891725 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e42b0dfb-f330-4776-b24a-c3ef1af9c3ac tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:02.892483 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e42b0dfb-f330-4776-b24a-c3ef1af9c3ac tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:02.892767 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e42b0dfb-f330-4776-b24a-c3ef1af9c3ac tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:02.893484 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e42b0dfb-f330-4776-b24a-c3ef1af9c3ac tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:02.893937 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e42b0dfb-f330-4776-b24a-c3ef1af9c3ac tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:02.894354 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e42b0dfb-f330-4776-b24a-c3ef1af9c3ac tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:03.230808 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-7d0de2cf-49a4-44a0-a7bb-9cdea6414010 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c3da1faaee46ca94d2a2543851f3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32a1b54e30415eb8f0e6df5e8b7be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:03.245940 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-7d0de2cf-49a4-44a0-a7bb-9cdea6414010 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] 10.222.0.70 "GET /compute/v2.1/servers/0069592c-7187-4b4d-ab74-3a1a3bc3de80" status: 200 len: 1314 microversion: 2.1 time: 0.750349 Aug 27 03:03:03.251267 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2140/4248] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:02 2022] GET /compute/v2.1/servers/0069592c-7187-4b4d-ab74-3a1a3bc3de80 => generated 1314 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:03:03.261891 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-af08444b-0ec8-4e20-a7e8-699b79897e13 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:03.264818 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-af08444b-0ec8-4e20-a7e8-699b79897e13 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: ecbf3ab5-9736-491e-b120-6a30d40bc328] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:03.281097 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-af08444b-0ec8-4e20-a7e8-699b79897e13 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:03.281606 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-af08444b-0ec8-4e20-a7e8-699b79897e13 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:03.282046 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-af08444b-0ec8-4e20-a7e8-699b79897e13 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:03.282764 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-af08444b-0ec8-4e20-a7e8-699b79897e13 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:03.286325 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-af08444b-0ec8-4e20-a7e8-699b79897e13 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:03.286922 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-af08444b-0ec8-4e20-a7e8-699b79897e13 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:03.762518 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-e42b0dfb-f330-4776-b24a-c3ef1af9c3ac tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe0328160c6472086d13907344756cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41649f09cbf410a9825100c498b4916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:03.771539 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e42b0dfb-f330-4776-b24a-c3ef1af9c3ac tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] 10.222.0.70 "GET /compute/v2.1/servers/f90d78a8-dea6-45c3-933c-8184ff4858b1" status: 200 len: 1363 microversion: 2.1 time: 0.908725 Aug 27 03:03:03.786163 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2109/4249] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:02 2022] GET /compute/v2.1/servers/f90d78a8-dea6-45c3-933c-8184ff4858b1 => generated 1363 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:03:03.793921 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-07a79e11-9814-4bc1-a2d0-c680179eec0a req-2bdf88a7-3e0e-49c6-b5d1-bb0ac193a72d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f90d78a8-dea6-45c3-933c-8184ff4858b1", "tag": "fe53e38f-6288-438a-8ab5-3cd8c1e3f433"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:03:03.809104 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-07a79e11-9814-4bc1-a2d0-c680179eec0a req-2bdf88a7-3e0e-49c6-b5d1-bb0ac193a72d service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:03.809741 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-07a79e11-9814-4bc1-a2d0-c680179eec0a req-2bdf88a7-3e0e-49c6-b5d1-bb0ac193a72d service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:03.810359 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-07a79e11-9814-4bc1-a2d0-c680179eec0a req-2bdf88a7-3e0e-49c6-b5d1-bb0ac193a72d service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:03.823463 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-07a79e11-9814-4bc1-a2d0-c680179eec0a req-2bdf88a7-3e0e-49c6-b5d1-bb0ac193a72d service nova] Creating event network-changed:fe53e38f-6288-438a-8ab5-3cd8c1e3f433 for instance f90d78a8-dea6-45c3-933c-8184ff4858b1 on n-h1-852278-4 Aug 27 03:03:03.830488 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-07a79e11-9814-4bc1-a2d0-c680179eec0a req-2bdf88a7-3e0e-49c6-b5d1-bb0ac193a72d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042253 Aug 27 03:03:03.831438 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2110/4250] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:03:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:03:03.884002 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8c4e7b1e-7ea3-4988-b852-6d03cfba0e58 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:03.885831 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-8c4e7b1e-7ea3-4988-b852-6d03cfba0e58 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: dc5b167d-847f-428c-8cae-3eef7bdffe9f] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:03.894734 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8c4e7b1e-7ea3-4988-b852-6d03cfba0e58 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:03.895782 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8c4e7b1e-7ea3-4988-b852-6d03cfba0e58 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:03.902371 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8c4e7b1e-7ea3-4988-b852-6d03cfba0e58 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:03.903609 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8c4e7b1e-7ea3-4988-b852-6d03cfba0e58 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:03.904336 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8c4e7b1e-7ea3-4988-b852-6d03cfba0e58 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:03.904967 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8c4e7b1e-7ea3-4988-b852-6d03cfba0e58 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:04.097039 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-8c4e7b1e-7ea3-4988-b852-6d03cfba0e58 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:04.109873 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-8c4e7b1e-7ea3-4988-b852-6d03cfba0e58 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/dc5b167d-847f-428c-8cae-3eef7bdffe9f" status: 200 len: 1251 microversion: 2.1 time: 0.230460 Aug 27 03:03:04.116478 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2111/4251] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:03 2022] GET /compute/v2.1/servers/dc5b167d-847f-428c-8cae-3eef7bdffe9f => generated 1251 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:03:04.133779 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-af08444b-0ec8-4e20-a7e8-699b79897e13 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36697e722bef4a33ab158e9b2f87596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4ca527ba3b49539b528ec8950aef78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:04.146661 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-af08444b-0ec8-4e20-a7e8-699b79897e13 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "GET /compute/v2.1/servers/ecbf3ab5-9736-491e-b120-6a30d40bc328" status: 200 len: 1522 microversion: 2.1 time: 0.893934 Aug 27 03:03:04.150106 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2141/4252] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:03 2022] GET /compute/v2.1/servers/ecbf3ab5-9736-491e-b120-6a30d40bc328 => generated 1522 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:03:04.283840 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-21c94fc3-1e35-40da-b073-5b5b65d5378d tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:04.285433 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-21c94fc3-1e35-40da-b073-5b5b65d5378d tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] [instance: 0069592c-7187-4b4d-ab74-3a1a3bc3de80] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:04.299522 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-21c94fc3-1e35-40da-b073-5b5b65d5378d tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:04.300256 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-21c94fc3-1e35-40da-b073-5b5b65d5378d tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:04.300799 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-21c94fc3-1e35-40da-b073-5b5b65d5378d tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:04.302483 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-21c94fc3-1e35-40da-b073-5b5b65d5378d tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:04.302942 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-21c94fc3-1e35-40da-b073-5b5b65d5378d tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:04.303380 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-21c94fc3-1e35-40da-b073-5b5b65d5378d tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:04.655178 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-efe6b1c9-f627-41c5-94f4-5a7ac4ed857b req-68ea8419-37a1-4f5f-8ea0-1bd4a18b3946 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0069592c-7187-4b4d-ab74-3a1a3bc3de80", "name": "network-vif-plugged", "status": "completed", "tag": "3e000d21-3244-41a2-8197-507cf2017f67"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:03:04.656041 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-21c94fc3-1e35-40da-b073-5b5b65d5378d tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c3da1faaee46ca94d2a2543851f3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32a1b54e30415eb8f0e6df5e8b7be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:04.667974 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-efe6b1c9-f627-41c5-94f4-5a7ac4ed857b req-68ea8419-37a1-4f5f-8ea0-1bd4a18b3946 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:04.668691 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-efe6b1c9-f627-41c5-94f4-5a7ac4ed857b req-68ea8419-37a1-4f5f-8ea0-1bd4a18b3946 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:04.669609 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-efe6b1c9-f627-41c5-94f4-5a7ac4ed857b req-68ea8419-37a1-4f5f-8ea0-1bd4a18b3946 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:04.675271 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-21c94fc3-1e35-40da-b073-5b5b65d5378d tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] 10.222.0.70 "GET /compute/v2.1/servers/0069592c-7187-4b4d-ab74-3a1a3bc3de80" status: 200 len: 1314 microversion: 2.1 time: 0.405655 Aug 27 03:03:04.676293 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2112/4253] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:04 2022] GET /compute/v2.1/servers/0069592c-7187-4b4d-ab74-3a1a3bc3de80 => generated 1314 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:03:04.685682 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-efe6b1c9-f627-41c5-94f4-5a7ac4ed857b req-68ea8419-37a1-4f5f-8ea0-1bd4a18b3946 service nova] Creating event network-vif-plugged:3e000d21-3244-41a2-8197-507cf2017f67 for instance 0069592c-7187-4b4d-ab74-3a1a3bc3de80 on n-h2-852278-4 Aug 27 03:03:04.691683 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-efe6b1c9-f627-41c5-94f4-5a7ac4ed857b req-68ea8419-37a1-4f5f-8ea0-1bd4a18b3946 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040346 Aug 27 03:03:04.693093 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2142/4254] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:03:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:03:04.797338 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3fd8290a-268f-4784-b34d-f56c841d837d tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:04.798118 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-3fd8290a-268f-4784-b34d-f56c841d837d tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] [instance: f90d78a8-dea6-45c3-933c-8184ff4858b1] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:04.805421 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3fd8290a-268f-4784-b34d-f56c841d837d tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:04.806167 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3fd8290a-268f-4784-b34d-f56c841d837d tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:04.806674 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3fd8290a-268f-4784-b34d-f56c841d837d tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:04.807639 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3fd8290a-268f-4784-b34d-f56c841d837d tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:04.808112 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3fd8290a-268f-4784-b34d-f56c841d837d tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:04.808683 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3fd8290a-268f-4784-b34d-f56c841d837d tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:05.138273 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-45888f8b-6e7e-4232-b7b2-062fa46345b7 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:05.139018 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-45888f8b-6e7e-4232-b7b2-062fa46345b7 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: dc5b167d-847f-428c-8cae-3eef7bdffe9f] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:05.146551 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-45888f8b-6e7e-4232-b7b2-062fa46345b7 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:05.147322 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-45888f8b-6e7e-4232-b7b2-062fa46345b7 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:05.147946 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-45888f8b-6e7e-4232-b7b2-062fa46345b7 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:05.148788 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-45888f8b-6e7e-4232-b7b2-062fa46345b7 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:05.149534 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-45888f8b-6e7e-4232-b7b2-062fa46345b7 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:05.150193 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-45888f8b-6e7e-4232-b7b2-062fa46345b7 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:05.195849 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-3fd8290a-268f-4784-b34d-f56c841d837d tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe0328160c6472086d13907344756cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41649f09cbf410a9825100c498b4916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:05.213531 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-3fd8290a-268f-4784-b34d-f56c841d837d tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] 10.222.0.70 "GET /compute/v2.1/servers/f90d78a8-dea6-45c3-933c-8184ff4858b1" status: 200 len: 1363 microversion: 2.1 time: 0.420401 Aug 27 03:03:05.214482 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2113/4255] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:04 2022] GET /compute/v2.1/servers/f90d78a8-dea6-45c3-933c-8184ff4858b1 => generated 1363 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:03:05.220645 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4ded7b56-93c9-4376-8115-122ce5127b42 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:05.222121 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-4ded7b56-93c9-4376-8115-122ce5127b42 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: ecbf3ab5-9736-491e-b120-6a30d40bc328] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:05.234446 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4ded7b56-93c9-4376-8115-122ce5127b42 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:05.235034 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4ded7b56-93c9-4376-8115-122ce5127b42 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:05.235536 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4ded7b56-93c9-4376-8115-122ce5127b42 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:05.236392 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4ded7b56-93c9-4376-8115-122ce5127b42 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:05.236928 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4ded7b56-93c9-4376-8115-122ce5127b42 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:05.237386 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4ded7b56-93c9-4376-8115-122ce5127b42 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:05.289027 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-45888f8b-6e7e-4232-b7b2-062fa46345b7 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:05.299961 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-45888f8b-6e7e-4232-b7b2-062fa46345b7 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/dc5b167d-847f-428c-8cae-3eef7bdffe9f" status: 200 len: 1251 microversion: 2.1 time: 0.166347 Aug 27 03:03:05.301150 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2143/4256] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:05 2022] GET /compute/v2.1/servers/dc5b167d-847f-428c-8cae-3eef7bdffe9f => generated 1251 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:03:05.609150 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-4ded7b56-93c9-4376-8115-122ce5127b42 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36697e722bef4a33ab158e9b2f87596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4ca527ba3b49539b528ec8950aef78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:05.649687 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-4ded7b56-93c9-4376-8115-122ce5127b42 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "GET /compute/v2.1/servers/ecbf3ab5-9736-491e-b120-6a30d40bc328" status: 200 len: 1522 microversion: 2.1 time: 0.429255 Aug 27 03:03:05.650662 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2114/4257] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:05 2022] GET /compute/v2.1/servers/ecbf3ab5-9736-491e-b120-6a30d40bc328 => generated 1522 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:03:05.696642 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-98b2bacb-be32-4d90-92b3-1066a333226b tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:05.697899 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-98b2bacb-be32-4d90-92b3-1066a333226b tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] [instance: 0069592c-7187-4b4d-ab74-3a1a3bc3de80] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:05.705296 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-98b2bacb-be32-4d90-92b3-1066a333226b tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:05.705792 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-98b2bacb-be32-4d90-92b3-1066a333226b tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:05.706229 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-98b2bacb-be32-4d90-92b3-1066a333226b tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:05.706935 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-98b2bacb-be32-4d90-92b3-1066a333226b tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:05.707572 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-98b2bacb-be32-4d90-92b3-1066a333226b tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:05.708150 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-98b2bacb-be32-4d90-92b3-1066a333226b tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:06.023725 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-98b2bacb-be32-4d90-92b3-1066a333226b tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c3da1faaee46ca94d2a2543851f3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32a1b54e30415eb8f0e6df5e8b7be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:06.036423 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-98b2bacb-be32-4d90-92b3-1066a333226b tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] 10.222.0.70 "GET /compute/v2.1/servers/0069592c-7187-4b4d-ab74-3a1a3bc3de80" status: 200 len: 1314 microversion: 2.1 time: 0.343746 Aug 27 03:03:06.040700 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2144/4258] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:05 2022] GET /compute/v2.1/servers/0069592c-7187-4b4d-ab74-3a1a3bc3de80 => generated 1314 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:03:06.234835 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c023e6f9-6e54-489d-8adf-b1112ef64ced tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:06.236135 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-c023e6f9-6e54-489d-8adf-b1112ef64ced tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] [instance: f90d78a8-dea6-45c3-933c-8184ff4858b1] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:06.244648 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c023e6f9-6e54-489d-8adf-b1112ef64ced tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:06.245439 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c023e6f9-6e54-489d-8adf-b1112ef64ced tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:06.246164 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c023e6f9-6e54-489d-8adf-b1112ef64ced tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:06.247349 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c023e6f9-6e54-489d-8adf-b1112ef64ced tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:06.248761 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c023e6f9-6e54-489d-8adf-b1112ef64ced tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:06.249388 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c023e6f9-6e54-489d-8adf-b1112ef64ced tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:06.329707 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0cacfbf8-2b94-43ab-a0b7-63b89bd529be tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:06.330447 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-0cacfbf8-2b94-43ab-a0b7-63b89bd529be tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: dc5b167d-847f-428c-8cae-3eef7bdffe9f] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:06.339077 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0cacfbf8-2b94-43ab-a0b7-63b89bd529be tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:06.341085 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0cacfbf8-2b94-43ab-a0b7-63b89bd529be tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:06.341496 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0cacfbf8-2b94-43ab-a0b7-63b89bd529be tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:06.342466 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0cacfbf8-2b94-43ab-a0b7-63b89bd529be tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:06.343199 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0cacfbf8-2b94-43ab-a0b7-63b89bd529be tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:06.343623 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0cacfbf8-2b94-43ab-a0b7-63b89bd529be tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:06.351796 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:03:06.404081 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=6 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:03:06.618290 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-c023e6f9-6e54-489d-8adf-b1112ef64ced tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe0328160c6472086d13907344756cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41649f09cbf410a9825100c498b4916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:06.633002 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c023e6f9-6e54-489d-8adf-b1112ef64ced tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] 10.222.0.70 "GET /compute/v2.1/servers/f90d78a8-dea6-45c3-933c-8184ff4858b1" status: 200 len: 1363 microversion: 2.1 time: 0.401820 Aug 27 03:03:06.641018 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2115/4259] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:06 2022] GET /compute/v2.1/servers/f90d78a8-dea6-45c3-933c-8184ff4858b1 => generated 1363 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:03:06.671851 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6019f52c-4029-44d2-b566-fbd3400cb7ac tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:06.672935 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-6019f52c-4029-44d2-b566-fbd3400cb7ac tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: ecbf3ab5-9736-491e-b120-6a30d40bc328] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:06.680162 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6019f52c-4029-44d2-b566-fbd3400cb7ac tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:06.681661 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6019f52c-4029-44d2-b566-fbd3400cb7ac tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:06.682448 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6019f52c-4029-44d2-b566-fbd3400cb7ac tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:06.684007 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6019f52c-4029-44d2-b566-fbd3400cb7ac tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:06.684715 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6019f52c-4029-44d2-b566-fbd3400cb7ac tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:06.685605 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6019f52c-4029-44d2-b566-fbd3400cb7ac tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:06.712879 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-0cacfbf8-2b94-43ab-a0b7-63b89bd529be tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:06.723984 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-0cacfbf8-2b94-43ab-a0b7-63b89bd529be tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/dc5b167d-847f-428c-8cae-3eef7bdffe9f" status: 200 len: 1293 microversion: 2.1 time: 0.406848 Aug 27 03:03:06.725797 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2145/4260] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:06 2022] GET /compute/v2.1/servers/dc5b167d-847f-428c-8cae-3eef7bdffe9f => generated 1293 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:03:07.024136 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-6019f52c-4029-44d2-b566-fbd3400cb7ac tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36697e722bef4a33ab158e9b2f87596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4ca527ba3b49539b528ec8950aef78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:07.036190 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-6019f52c-4029-44d2-b566-fbd3400cb7ac tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "GET /compute/v2.1/servers/ecbf3ab5-9736-491e-b120-6a30d40bc328" status: 200 len: 1522 microversion: 2.1 time: 0.368937 Aug 27 03:03:07.041765 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2116/4261] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:06 2022] GET /compute/v2.1/servers/ecbf3ab5-9736-491e-b120-6a30d40bc328 => generated 1522 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:03:07.062866 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a25a6b16-216d-4690-a376-cba32c8c0a60 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:07.063621 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-a25a6b16-216d-4690-a376-cba32c8c0a60 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] [instance: 0069592c-7187-4b4d-ab74-3a1a3bc3de80] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:07.069975 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a25a6b16-216d-4690-a376-cba32c8c0a60 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:07.070629 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a25a6b16-216d-4690-a376-cba32c8c0a60 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:07.071098 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a25a6b16-216d-4690-a376-cba32c8c0a60 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:07.071801 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a25a6b16-216d-4690-a376-cba32c8c0a60 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:07.072252 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a25a6b16-216d-4690-a376-cba32c8c0a60 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:07.072699 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a25a6b16-216d-4690-a376-cba32c8c0a60 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:07.260026 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-0ec1f5d0-1c06-4c46-94c9-85f80f826523 req-58612fc8-d01d-4d7b-aedd-7453a29c5f20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc5b167d-847f-428c-8cae-3eef7bdffe9f", "tag": "f4a994bc-fc12-4bf9-a419-726c70aea3cd"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:03:07.271092 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-0ec1f5d0-1c06-4c46-94c9-85f80f826523 req-58612fc8-d01d-4d7b-aedd-7453a29c5f20 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:07.271572 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-0ec1f5d0-1c06-4c46-94c9-85f80f826523 req-58612fc8-d01d-4d7b-aedd-7453a29c5f20 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:07.272001 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-0ec1f5d0-1c06-4c46-94c9-85f80f826523 req-58612fc8-d01d-4d7b-aedd-7453a29c5f20 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:07.285657 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-0ec1f5d0-1c06-4c46-94c9-85f80f826523 req-58612fc8-d01d-4d7b-aedd-7453a29c5f20 service nova] Creating event network-changed:f4a994bc-fc12-4bf9-a419-726c70aea3cd for instance dc5b167d-847f-428c-8cae-3eef7bdffe9f on n-h1-852278-4 Aug 27 03:03:07.293000 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-0ec1f5d0-1c06-4c46-94c9-85f80f826523 req-58612fc8-d01d-4d7b-aedd-7453a29c5f20 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036814 Aug 27 03:03:07.294052 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2117/4262] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:03:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:03:07.657064 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-56a158eb-f0eb-4d14-8639-e4635f7421c9 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:07.658526 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-56a158eb-f0eb-4d14-8639-e4635f7421c9 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] [instance: f90d78a8-dea6-45c3-933c-8184ff4858b1] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:07.665942 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-56a158eb-f0eb-4d14-8639-e4635f7421c9 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:07.666451 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-56a158eb-f0eb-4d14-8639-e4635f7421c9 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:07.666894 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-56a158eb-f0eb-4d14-8639-e4635f7421c9 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:07.667617 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-56a158eb-f0eb-4d14-8639-e4635f7421c9 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:07.668064 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-56a158eb-f0eb-4d14-8639-e4635f7421c9 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:07.668791 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-56a158eb-f0eb-4d14-8639-e4635f7421c9 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:07.797569 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-a25a6b16-216d-4690-a376-cba32c8c0a60 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c3da1faaee46ca94d2a2543851f3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32a1b54e30415eb8f0e6df5e8b7be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:07.807252 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a25a6b16-216d-4690-a376-cba32c8c0a60 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] 10.222.0.70 "GET /compute/v2.1/servers/0069592c-7187-4b4d-ab74-3a1a3bc3de80" status: 200 len: 1500 microversion: 2.1 time: 0.748436 Aug 27 03:03:07.813838 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2146/4263] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:07 2022] GET /compute/v2.1/servers/0069592c-7187-4b4d-ab74-3a1a3bc3de80 => generated 1500 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:03:07.822923 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b29471f0-7698-40e4-a6f8-aac073250640 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:07.823808 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b29471f0-7698-40e4-a6f8-aac073250640 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: dc5b167d-847f-428c-8cae-3eef7bdffe9f] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:07.831472 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b29471f0-7698-40e4-a6f8-aac073250640 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:07.832194 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b29471f0-7698-40e4-a6f8-aac073250640 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:07.833100 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b29471f0-7698-40e4-a6f8-aac073250640 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:07.833938 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b29471f0-7698-40e4-a6f8-aac073250640 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:07.834448 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b29471f0-7698-40e4-a6f8-aac073250640 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:07.834873 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b29471f0-7698-40e4-a6f8-aac073250640 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:08.074766 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-56a158eb-f0eb-4d14-8639-e4635f7421c9 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe0328160c6472086d13907344756cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41649f09cbf410a9825100c498b4916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:08.083853 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-56a158eb-f0eb-4d14-8639-e4635f7421c9 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] 10.222.0.70 "GET /compute/v2.1/servers/f90d78a8-dea6-45c3-933c-8184ff4858b1" status: 200 len: 1363 microversion: 2.1 time: 0.432165 Aug 27 03:03:08.098135 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2118/4264] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:07 2022] GET /compute/v2.1/servers/f90d78a8-dea6-45c3-933c-8184ff4858b1 => generated 1363 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:03:08.104200 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-1a718124-7d24-4586-8e22-5e085fd0bc68 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:03:08.106624 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-1a718124-7d24-4586-8e22-5e085fd0bc68 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] [instance: 0069592c-7187-4b4d-ab74-3a1a3bc3de80] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:08.113057 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1a718124-7d24-4586-8e22-5e085fd0bc68 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:08.113627 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1a718124-7d24-4586-8e22-5e085fd0bc68 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:08.114295 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1a718124-7d24-4586-8e22-5e085fd0bc68 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:08.115083 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1a718124-7d24-4586-8e22-5e085fd0bc68 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:08.115769 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1a718124-7d24-4586-8e22-5e085fd0bc68 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:08.116260 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1a718124-7d24-4586-8e22-5e085fd0bc68 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:08.142762 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.instance [None req-1a718124-7d24-4586-8e22-5e085fd0bc68 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lazy-loading 'flavor' on Instance uuid 0069592c-7187-4b4d-ab74-3a1a3bc3de80 {{(pid=134052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:03:08.232180 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-1a718124-7d24-4586-8e22-5e085fd0bc68 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] 10.222.0.70 "POST /compute/v2.1/servers/0069592c-7187-4b4d-ab74-3a1a3bc3de80/action" status: 200 len: 32 microversion: 2.1 time: 0.131788 Aug 27 03:03:08.232908 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2119/4265] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:03:08 2022] POST /compute/v2.1/servers/0069592c-7187-4b4d-ab74-3a1a3bc3de80/action => generated 32 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:03:08.241101 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a9aa06db-6181-4a8c-b3a2-73fd23600835 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:08.241984 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a9aa06db-6181-4a8c-b3a2-73fd23600835 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: ecbf3ab5-9736-491e-b120-6a30d40bc328] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:08.250654 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a9aa06db-6181-4a8c-b3a2-73fd23600835 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:08.251436 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a9aa06db-6181-4a8c-b3a2-73fd23600835 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:08.252118 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a9aa06db-6181-4a8c-b3a2-73fd23600835 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:08.254128 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a9aa06db-6181-4a8c-b3a2-73fd23600835 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:08.254784 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a9aa06db-6181-4a8c-b3a2-73fd23600835 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:08.255405 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a9aa06db-6181-4a8c-b3a2-73fd23600835 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:08.265722 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-b29471f0-7698-40e4-a6f8-aac073250640 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:08.280610 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b29471f0-7698-40e4-a6f8-aac073250640 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/dc5b167d-847f-428c-8cae-3eef7bdffe9f" status: 200 len: 1293 microversion: 2.1 time: 0.464993 Aug 27 03:03:08.294278 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2147/4266] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:07 2022] GET /compute/v2.1/servers/dc5b167d-847f-428c-8cae-3eef7bdffe9f => generated 1293 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:03:08.300347 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-30a20760-d745-47da-88b8-22ecebdc3b0f tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:08.301052 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-30a20760-d745-47da-88b8-22ecebdc3b0f tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] [instance: 0069592c-7187-4b4d-ab74-3a1a3bc3de80] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:08.313091 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-30a20760-d745-47da-88b8-22ecebdc3b0f tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:08.316179 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-30a20760-d745-47da-88b8-22ecebdc3b0f tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:08.318378 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-30a20760-d745-47da-88b8-22ecebdc3b0f tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:08.320781 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-30a20760-d745-47da-88b8-22ecebdc3b0f tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:08.321662 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-30a20760-d745-47da-88b8-22ecebdc3b0f tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:08.323759 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-30a20760-d745-47da-88b8-22ecebdc3b0f tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:08.859409 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-a9aa06db-6181-4a8c-b3a2-73fd23600835 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36697e722bef4a33ab158e9b2f87596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4ca527ba3b49539b528ec8950aef78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:08.871880 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a9aa06db-6181-4a8c-b3a2-73fd23600835 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "GET /compute/v2.1/servers/ecbf3ab5-9736-491e-b120-6a30d40bc328" status: 200 len: 1522 microversion: 2.1 time: 0.637432 Aug 27 03:03:08.874050 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2120/4267] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:08 2022] GET /compute/v2.1/servers/ecbf3ab5-9736-491e-b120-6a30d40bc328 => generated 1522 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:03:08.960968 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-30a20760-d745-47da-88b8-22ecebdc3b0f tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c3da1faaee46ca94d2a2543851f3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32a1b54e30415eb8f0e6df5e8b7be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:08.975722 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-30a20760-d745-47da-88b8-22ecebdc3b0f tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] 10.222.0.70 "GET /compute/v2.1/servers/0069592c-7187-4b4d-ab74-3a1a3bc3de80" status: 200 len: 1506 microversion: 2.1 time: 0.692349 Aug 27 03:03:08.977925 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2148/4268] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:08 2022] GET /compute/v2.1/servers/0069592c-7187-4b4d-ab74-3a1a3bc3de80 => generated 1506 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:03:09.106232 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4c9a6f06-e8b0-4f87-8334-3f7131d9f3b3 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:09.106862 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-4c9a6f06-e8b0-4f87-8334-3f7131d9f3b3 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] [instance: f90d78a8-dea6-45c3-933c-8184ff4858b1] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:09.119949 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4c9a6f06-e8b0-4f87-8334-3f7131d9f3b3 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:09.120271 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4c9a6f06-e8b0-4f87-8334-3f7131d9f3b3 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:09.124971 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4c9a6f06-e8b0-4f87-8334-3f7131d9f3b3 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:09.125633 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4c9a6f06-e8b0-4f87-8334-3f7131d9f3b3 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:09.126100 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4c9a6f06-e8b0-4f87-8334-3f7131d9f3b3 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:09.126526 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4c9a6f06-e8b0-4f87-8334-3f7131d9f3b3 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:09.304570 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-145fc9c9-b3aa-4bf8-b21b-3dd54d690d5e tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:09.305597 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-145fc9c9-b3aa-4bf8-b21b-3dd54d690d5e tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: dc5b167d-847f-428c-8cae-3eef7bdffe9f] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:09.316987 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-145fc9c9-b3aa-4bf8-b21b-3dd54d690d5e tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:09.319994 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-145fc9c9-b3aa-4bf8-b21b-3dd54d690d5e tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:09.321873 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-145fc9c9-b3aa-4bf8-b21b-3dd54d690d5e tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:09.325233 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-145fc9c9-b3aa-4bf8-b21b-3dd54d690d5e tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:09.326738 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-145fc9c9-b3aa-4bf8-b21b-3dd54d690d5e tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:09.327882 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-145fc9c9-b3aa-4bf8-b21b-3dd54d690d5e tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:09.597072 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-4c9a6f06-e8b0-4f87-8334-3f7131d9f3b3 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe0328160c6472086d13907344756cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41649f09cbf410a9825100c498b4916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:09.607003 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-4c9a6f06-e8b0-4f87-8334-3f7131d9f3b3 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] 10.222.0.70 "GET /compute/v2.1/servers/f90d78a8-dea6-45c3-933c-8184ff4858b1" status: 200 len: 1363 microversion: 2.1 time: 0.505298 Aug 27 03:03:09.607937 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2121/4269] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:09 2022] GET /compute/v2.1/servers/f90d78a8-dea6-45c3-933c-8184ff4858b1 => generated 1363 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:03:09.822631 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-145fc9c9-b3aa-4bf8-b21b-3dd54d690d5e tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:09.830820 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-145fc9c9-b3aa-4bf8-b21b-3dd54d690d5e tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/dc5b167d-847f-428c-8cae-3eef7bdffe9f" status: 200 len: 1293 microversion: 2.1 time: 0.532596 Aug 27 03:03:09.831410 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2149/4270] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:09 2022] GET /compute/v2.1/servers/dc5b167d-847f-428c-8cae-3eef7bdffe9f => generated 1293 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:03:09.894181 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-19be3ee9-42c7-4575-ba0f-9da01ebd6c57 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:09.895574 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-19be3ee9-42c7-4575-ba0f-9da01ebd6c57 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: ecbf3ab5-9736-491e-b120-6a30d40bc328] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:09.902370 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-19be3ee9-42c7-4575-ba0f-9da01ebd6c57 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:09.903040 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-19be3ee9-42c7-4575-ba0f-9da01ebd6c57 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:09.903658 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-19be3ee9-42c7-4575-ba0f-9da01ebd6c57 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:09.904552 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-19be3ee9-42c7-4575-ba0f-9da01ebd6c57 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:09.905300 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-19be3ee9-42c7-4575-ba0f-9da01ebd6c57 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:09.905882 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-19be3ee9-42c7-4575-ba0f-9da01ebd6c57 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:09.912889 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:03:10.006454 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d7733ad0-cf15-4674-8321-857117df4ee9 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:10.007137 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d7733ad0-cf15-4674-8321-857117df4ee9 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] [instance: 0069592c-7187-4b4d-ab74-3a1a3bc3de80] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:10.023515 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d7733ad0-cf15-4674-8321-857117df4ee9 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:10.023978 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d7733ad0-cf15-4674-8321-857117df4ee9 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:10.025015 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d7733ad0-cf15-4674-8321-857117df4ee9 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:10.026282 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d7733ad0-cf15-4674-8321-857117df4ee9 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:10.027200 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d7733ad0-cf15-4674-8321-857117df4ee9 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:10.027839 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d7733ad0-cf15-4674-8321-857117df4ee9 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:10.767213 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-19be3ee9-42c7-4575-ba0f-9da01ebd6c57 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36697e722bef4a33ab158e9b2f87596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4ca527ba3b49539b528ec8950aef78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:10.785097 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-19be3ee9-42c7-4575-ba0f-9da01ebd6c57 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "GET /compute/v2.1/servers/ecbf3ab5-9736-491e-b120-6a30d40bc328" status: 200 len: 1522 microversion: 2.1 time: 0.894734 Aug 27 03:03:10.786377 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2122/4271] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:09 2022] GET /compute/v2.1/servers/ecbf3ab5-9736-491e-b120-6a30d40bc328 => generated 1522 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:03:10.800065 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-847dfbd0-db57-47a6-bdd8-ccd0e0d61ce1 req-756e2fe9-3fe7-40cd-a81c-39c71a5e2525 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f90d78a8-dea6-45c3-933c-8184ff4858b1", "name": "network-vif-plugged", "status": "completed", "tag": "fe53e38f-6288-438a-8ab5-3cd8c1e3f433"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:03:10.814381 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-847dfbd0-db57-47a6-bdd8-ccd0e0d61ce1 req-756e2fe9-3fe7-40cd-a81c-39c71a5e2525 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:10.815311 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-847dfbd0-db57-47a6-bdd8-ccd0e0d61ce1 req-756e2fe9-3fe7-40cd-a81c-39c71a5e2525 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:10.815999 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-847dfbd0-db57-47a6-bdd8-ccd0e0d61ce1 req-756e2fe9-3fe7-40cd-a81c-39c71a5e2525 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:10.831198 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-847dfbd0-db57-47a6-bdd8-ccd0e0d61ce1 req-756e2fe9-3fe7-40cd-a81c-39c71a5e2525 service nova] Creating event network-vif-plugged:fe53e38f-6288-438a-8ab5-3cd8c1e3f433 for instance f90d78a8-dea6-45c3-933c-8184ff4858b1 on n-h1-852278-4 Aug 27 03:03:10.840174 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-847dfbd0-db57-47a6-bdd8-ccd0e0d61ce1 req-756e2fe9-3fe7-40cd-a81c-39c71a5e2525 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049871 Aug 27 03:03:10.842179 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2123/4272] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:03:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:03:10.854876 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9b8dd83d-7de4-4008-b73b-1b55912313c0 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:10.856323 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-9b8dd83d-7de4-4008-b73b-1b55912313c0 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] [instance: f90d78a8-dea6-45c3-933c-8184ff4858b1] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:10.867519 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9b8dd83d-7de4-4008-b73b-1b55912313c0 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:10.868344 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9b8dd83d-7de4-4008-b73b-1b55912313c0 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:10.870517 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9b8dd83d-7de4-4008-b73b-1b55912313c0 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:10.873183 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9b8dd83d-7de4-4008-b73b-1b55912313c0 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:10.874646 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9b8dd83d-7de4-4008-b73b-1b55912313c0 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:10.875263 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9b8dd83d-7de4-4008-b73b-1b55912313c0 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:11.004228 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d7733ad0-cf15-4674-8321-857117df4ee9 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c3da1faaee46ca94d2a2543851f3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32a1b54e30415eb8f0e6df5e8b7be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:11.023976 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d7733ad0-cf15-4674-8321-857117df4ee9 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] 10.222.0.70 "GET /compute/v2.1/servers/0069592c-7187-4b4d-ab74-3a1a3bc3de80" status: 200 len: 1506 microversion: 2.1 time: 1.026644 Aug 27 03:03:11.026125 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2150/4273] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:09 2022] GET /compute/v2.1/servers/0069592c-7187-4b4d-ab74-3a1a3bc3de80 => generated 1506 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:03:11.042495 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ca5709bb-d910-4352-8de2-4a2b6c4b3132 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:11.049072 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-ca5709bb-d910-4352-8de2-4a2b6c4b3132 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: dc5b167d-847f-428c-8cae-3eef7bdffe9f] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:11.060991 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ca5709bb-d910-4352-8de2-4a2b6c4b3132 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:11.061892 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ca5709bb-d910-4352-8de2-4a2b6c4b3132 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:11.062602 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ca5709bb-d910-4352-8de2-4a2b6c4b3132 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:11.063605 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ca5709bb-d910-4352-8de2-4a2b6c4b3132 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:11.064378 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ca5709bb-d910-4352-8de2-4a2b6c4b3132 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:11.065271 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ca5709bb-d910-4352-8de2-4a2b6c4b3132 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:11.363637 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=4 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:03:11.420585 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-9b8dd83d-7de4-4008-b73b-1b55912313c0 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe0328160c6472086d13907344756cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41649f09cbf410a9825100c498b4916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:11.435672 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9b8dd83d-7de4-4008-b73b-1b55912313c0 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] 10.222.0.70 "GET /compute/v2.1/servers/f90d78a8-dea6-45c3-933c-8184ff4858b1" status: 200 len: 1363 microversion: 2.1 time: 0.584848 Aug 27 03:03:11.436388 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2124/4274] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:10 2022] GET /compute/v2.1/servers/f90d78a8-dea6-45c3-933c-8184ff4858b1 => generated 1363 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:03:11.451507 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-ca5709bb-d910-4352-8de2-4a2b6c4b3132 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:11.454000 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=100 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:03:11.462847 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ca5709bb-d910-4352-8de2-4a2b6c4b3132 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/dc5b167d-847f-428c-8cae-3eef7bdffe9f" status: 200 len: 1293 microversion: 2.1 time: 0.435294 Aug 27 03:03:11.473167 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2151/4275] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:11 2022] GET /compute/v2.1/servers/dc5b167d-847f-428c-8cae-3eef7bdffe9f => generated 1293 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:03:11.808101 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-2f9f2c86-c650-4247-9ac0-064fa9e4a6b1 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:11.808832 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-2f9f2c86-c650-4247-9ac0-064fa9e4a6b1 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: ecbf3ab5-9736-491e-b120-6a30d40bc328] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:11.810845 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=22 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:03:11.816582 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2f9f2c86-c650-4247-9ac0-064fa9e4a6b1 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:11.817468 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2f9f2c86-c650-4247-9ac0-064fa9e4a6b1 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:11.818049 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2f9f2c86-c650-4247-9ac0-064fa9e4a6b1 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:11.819246 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2f9f2c86-c650-4247-9ac0-064fa9e4a6b1 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:11.819936 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2f9f2c86-c650-4247-9ac0-064fa9e4a6b1 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:11.820700 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2f9f2c86-c650-4247-9ac0-064fa9e4a6b1 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:11.987252 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-2f9f2c86-c650-4247-9ac0-064fa9e4a6b1 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36697e722bef4a33ab158e9b2f87596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4ca527ba3b49539b528ec8950aef78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:12.001330 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-2f9f2c86-c650-4247-9ac0-064fa9e4a6b1 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "GET /compute/v2.1/servers/ecbf3ab5-9736-491e-b120-6a30d40bc328" status: 200 len: 1522 microversion: 2.1 time: 0.197364 Aug 27 03:03:12.003605 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2125/4276] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:11 2022] GET /compute/v2.1/servers/ecbf3ab5-9736-491e-b120-6a30d40bc328 => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:03:12.048270 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-464432bc-7d86-4913-96b5-f0b63f7616f4 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:12.049131 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-464432bc-7d86-4913-96b5-f0b63f7616f4 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] [instance: 0069592c-7187-4b4d-ab74-3a1a3bc3de80] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:12.066901 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-464432bc-7d86-4913-96b5-f0b63f7616f4 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:12.068123 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-464432bc-7d86-4913-96b5-f0b63f7616f4 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:12.068593 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-464432bc-7d86-4913-96b5-f0b63f7616f4 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:12.069523 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-464432bc-7d86-4913-96b5-f0b63f7616f4 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:12.070169 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-464432bc-7d86-4913-96b5-f0b63f7616f4 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:12.070757 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-464432bc-7d86-4913-96b5-f0b63f7616f4 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:12.418062 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-464432bc-7d86-4913-96b5-f0b63f7616f4 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c3da1faaee46ca94d2a2543851f3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32a1b54e30415eb8f0e6df5e8b7be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:12.434145 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-464432bc-7d86-4913-96b5-f0b63f7616f4 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] 10.222.0.70 "GET /compute/v2.1/servers/0069592c-7187-4b4d-ab74-3a1a3bc3de80" status: 200 len: 1506 microversion: 2.1 time: 0.389524 Aug 27 03:03:12.435405 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2152/4277] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:12 2022] GET /compute/v2.1/servers/0069592c-7187-4b4d-ab74-3a1a3bc3de80 => generated 1506 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:03:12.458903 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-02ea8500-73f0-4274-915f-5db663af1343 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:12.460240 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-02ea8500-73f0-4274-915f-5db663af1343 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] [instance: f90d78a8-dea6-45c3-933c-8184ff4858b1] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:12.469625 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-02ea8500-73f0-4274-915f-5db663af1343 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:12.470557 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-02ea8500-73f0-4274-915f-5db663af1343 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:12.490604 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-965013ac-9fb8-4b43-9602-58865a11b7bd tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:12.493653 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-965013ac-9fb8-4b43-9602-58865a11b7bd tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: dc5b167d-847f-428c-8cae-3eef7bdffe9f] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:12.505430 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-02ea8500-73f0-4274-915f-5db663af1343 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.033s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:12.507057 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-02ea8500-73f0-4274-915f-5db663af1343 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:12.507817 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-02ea8500-73f0-4274-915f-5db663af1343 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:12.508705 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-02ea8500-73f0-4274-915f-5db663af1343 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:12.516449 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-965013ac-9fb8-4b43-9602-58865a11b7bd tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:12.517978 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-965013ac-9fb8-4b43-9602-58865a11b7bd tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:12.518436 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-965013ac-9fb8-4b43-9602-58865a11b7bd tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:12.519173 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-965013ac-9fb8-4b43-9602-58865a11b7bd tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:12.522966 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-965013ac-9fb8-4b43-9602-58865a11b7bd tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:12.523762 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-965013ac-9fb8-4b43-9602-58865a11b7bd tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:12.827173 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-02ea8500-73f0-4274-915f-5db663af1343 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe0328160c6472086d13907344756cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41649f09cbf410a9825100c498b4916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:12.838603 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-02ea8500-73f0-4274-915f-5db663af1343 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] 10.222.0.70 "GET /compute/v2.1/servers/f90d78a8-dea6-45c3-933c-8184ff4858b1" status: 200 len: 1547 microversion: 2.1 time: 0.385125 Aug 27 03:03:12.839839 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2126/4278] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:12 2022] GET /compute/v2.1/servers/f90d78a8-dea6-45c3-933c-8184ff4858b1 => generated 1547 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:03:12.862629 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-965013ac-9fb8-4b43-9602-58865a11b7bd tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:12.867770 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d7d9b75d-2231-4bb7-a2ff-94aaf3327c8e tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:12.868682 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d7d9b75d-2231-4bb7-a2ff-94aaf3327c8e tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] [instance: f90d78a8-dea6-45c3-933c-8184ff4858b1] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:12.878120 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-965013ac-9fb8-4b43-9602-58865a11b7bd tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/dc5b167d-847f-428c-8cae-3eef7bdffe9f" status: 200 len: 1293 microversion: 2.1 time: 0.396417 Aug 27 03:03:12.879624 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2153/4279] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:12 2022] GET /compute/v2.1/servers/dc5b167d-847f-428c-8cae-3eef7bdffe9f => generated 1293 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:03:12.886433 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d7d9b75d-2231-4bb7-a2ff-94aaf3327c8e tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:12.887770 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d7d9b75d-2231-4bb7-a2ff-94aaf3327c8e tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:12.889213 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d7d9b75d-2231-4bb7-a2ff-94aaf3327c8e tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:12.891101 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d7d9b75d-2231-4bb7-a2ff-94aaf3327c8e tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:12.913183 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d7d9b75d-2231-4bb7-a2ff-94aaf3327c8e tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:12.913645 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d7d9b75d-2231-4bb7-a2ff-94aaf3327c8e tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:13.024157 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-70bdd885-ab20-43fe-a018-06e30d2811cf tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:13.024940 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-70bdd885-ab20-43fe-a018-06e30d2811cf tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: ecbf3ab5-9736-491e-b120-6a30d40bc328] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:13.037964 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-70bdd885-ab20-43fe-a018-06e30d2811cf tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:13.038623 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-70bdd885-ab20-43fe-a018-06e30d2811cf tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:13.039160 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-70bdd885-ab20-43fe-a018-06e30d2811cf tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:13.039984 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-70bdd885-ab20-43fe-a018-06e30d2811cf tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:13.040566 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-70bdd885-ab20-43fe-a018-06e30d2811cf tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:13.041186 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-70bdd885-ab20-43fe-a018-06e30d2811cf tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:13.046478 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d7d9b75d-2231-4bb7-a2ff-94aaf3327c8e tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] 10.222.0.70 "GET /compute/v2.1/servers/f90d78a8-dea6-45c3-933c-8184ff4858b1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.190313 Aug 27 03:03:13.047631 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2127/4280] 10.222.0.70 () {58 vars in 1275 bytes} [Sat Aug 27 03:03:12 2022] GET /compute/v2.1/servers/f90d78a8-dea6-45c3-933c-8184ff4858b1/os-interface => generated 284 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:03:13.455370 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-cd45d26a-620a-46e2-a523-58b6be803a24 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:13.455999 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-cd45d26a-620a-46e2-a523-58b6be803a24 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] [instance: 0069592c-7187-4b4d-ab74-3a1a3bc3de80] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:13.467597 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cd45d26a-620a-46e2-a523-58b6be803a24 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:13.469169 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cd45d26a-620a-46e2-a523-58b6be803a24 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:13.469780 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cd45d26a-620a-46e2-a523-58b6be803a24 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:13.470774 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cd45d26a-620a-46e2-a523-58b6be803a24 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:13.471476 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cd45d26a-620a-46e2-a523-58b6be803a24 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:13.472842 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cd45d26a-620a-46e2-a523-58b6be803a24 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:13.517411 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-70bdd885-ab20-43fe-a018-06e30d2811cf tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36697e722bef4a33ab158e9b2f87596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4ca527ba3b49539b528ec8950aef78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:13.535185 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-70bdd885-ab20-43fe-a018-06e30d2811cf tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "GET /compute/v2.1/servers/ecbf3ab5-9736-491e-b120-6a30d40bc328" status: 200 len: 1522 microversion: 2.1 time: 0.514979 Aug 27 03:03:13.536430 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2154/4281] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:13 2022] GET /compute/v2.1/servers/ecbf3ab5-9736-491e-b120-6a30d40bc328 => generated 1522 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:03:13.904801 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-efd19e0f-f810-4be3-849f-e2f9d93db5cb tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:13.906081 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-efd19e0f-f810-4be3-849f-e2f9d93db5cb tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: dc5b167d-847f-428c-8cae-3eef7bdffe9f] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:13.925305 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-efd19e0f-f810-4be3-849f-e2f9d93db5cb tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:13.926341 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-efd19e0f-f810-4be3-849f-e2f9d93db5cb tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:13.926998 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-efd19e0f-f810-4be3-849f-e2f9d93db5cb tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:13.928691 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-efd19e0f-f810-4be3-849f-e2f9d93db5cb tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:13.929664 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-efd19e0f-f810-4be3-849f-e2f9d93db5cb tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:13.930457 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-efd19e0f-f810-4be3-849f-e2f9d93db5cb tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:14.123869 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-cd45d26a-620a-46e2-a523-58b6be803a24 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c3da1faaee46ca94d2a2543851f3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32a1b54e30415eb8f0e6df5e8b7be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:14.132538 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-cd45d26a-620a-46e2-a523-58b6be803a24 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] 10.222.0.70 "GET /compute/v2.1/servers/0069592c-7187-4b4d-ab74-3a1a3bc3de80" status: 200 len: 1506 microversion: 2.1 time: 0.680954 Aug 27 03:03:14.133373 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2128/4282] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:13 2022] GET /compute/v2.1/servers/0069592c-7187-4b4d-ab74-3a1a3bc3de80 => generated 1506 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:03:14.237393 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-efd19e0f-f810-4be3-849f-e2f9d93db5cb tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:14.276504 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-efd19e0f-f810-4be3-849f-e2f9d93db5cb tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/dc5b167d-847f-428c-8cae-3eef7bdffe9f" status: 200 len: 1293 microversion: 2.1 time: 0.375602 Aug 27 03:03:14.277594 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2155/4283] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:13 2022] GET /compute/v2.1/servers/dc5b167d-847f-428c-8cae-3eef7bdffe9f => generated 1293 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:03:14.563011 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0630fd59-521e-42e8-8784-98fd26757ef2 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:14.566613 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-0630fd59-521e-42e8-8784-98fd26757ef2 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: ecbf3ab5-9736-491e-b120-6a30d40bc328] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:14.583346 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0630fd59-521e-42e8-8784-98fd26757ef2 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:14.584094 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0630fd59-521e-42e8-8784-98fd26757ef2 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:14.584737 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0630fd59-521e-42e8-8784-98fd26757ef2 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:14.585668 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0630fd59-521e-42e8-8784-98fd26757ef2 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:14.586272 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0630fd59-521e-42e8-8784-98fd26757ef2 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:14.587264 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0630fd59-521e-42e8-8784-98fd26757ef2 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:14.990156 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0630fd59-521e-42e8-8784-98fd26757ef2 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36697e722bef4a33ab158e9b2f87596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4ca527ba3b49539b528ec8950aef78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:14.998972 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-0630fd59-521e-42e8-8784-98fd26757ef2 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "GET /compute/v2.1/servers/ecbf3ab5-9736-491e-b120-6a30d40bc328" status: 200 len: 1522 microversion: 2.1 time: 0.443878 Aug 27 03:03:14.999353 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2129/4284] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:14 2022] GET /compute/v2.1/servers/ecbf3ab5-9736-491e-b120-6a30d40bc328 => generated 1522 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:03:15.154071 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0f75fc06-7106-4a76-8e8c-b4b15aaf57cb tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:15.156641 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-0f75fc06-7106-4a76-8e8c-b4b15aaf57cb tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] [instance: 0069592c-7187-4b4d-ab74-3a1a3bc3de80] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:15.171966 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0f75fc06-7106-4a76-8e8c-b4b15aaf57cb tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:15.172710 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0f75fc06-7106-4a76-8e8c-b4b15aaf57cb tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:15.173422 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0f75fc06-7106-4a76-8e8c-b4b15aaf57cb tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:15.174421 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0f75fc06-7106-4a76-8e8c-b4b15aaf57cb tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:15.175047 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0f75fc06-7106-4a76-8e8c-b4b15aaf57cb tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:15.175638 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0f75fc06-7106-4a76-8e8c-b4b15aaf57cb tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:15.301222 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9a49b6aa-5a97-41ec-8ba5-e6855cc0beb4 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:15.302735 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-9a49b6aa-5a97-41ec-8ba5-e6855cc0beb4 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: dc5b167d-847f-428c-8cae-3eef7bdffe9f] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:15.320869 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9a49b6aa-5a97-41ec-8ba5-e6855cc0beb4 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:15.321948 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9a49b6aa-5a97-41ec-8ba5-e6855cc0beb4 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:15.322572 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9a49b6aa-5a97-41ec-8ba5-e6855cc0beb4 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:15.323543 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9a49b6aa-5a97-41ec-8ba5-e6855cc0beb4 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:15.324193 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9a49b6aa-5a97-41ec-8ba5-e6855cc0beb4 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:15.324810 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9a49b6aa-5a97-41ec-8ba5-e6855cc0beb4 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:16.147382 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-9a49b6aa-5a97-41ec-8ba5-e6855cc0beb4 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:16.148707 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-0f75fc06-7106-4a76-8e8c-b4b15aaf57cb tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c3da1faaee46ca94d2a2543851f3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32a1b54e30415eb8f0e6df5e8b7be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:16.172895 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-0f75fc06-7106-4a76-8e8c-b4b15aaf57cb tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] 10.222.0.70 "GET /compute/v2.1/servers/0069592c-7187-4b4d-ab74-3a1a3bc3de80" status: 200 len: 1506 microversion: 2.1 time: 1.014848 Aug 27 03:03:16.174068 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2156/4285] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:15 2022] GET /compute/v2.1/servers/0069592c-7187-4b4d-ab74-3a1a3bc3de80 => generated 1506 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:03:16.176743 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9a49b6aa-5a97-41ec-8ba5-e6855cc0beb4 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/dc5b167d-847f-428c-8cae-3eef7bdffe9f" status: 200 len: 1293 microversion: 2.1 time: 0.878061 Aug 27 03:03:16.179339 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2130/4286] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:15 2022] GET /compute/v2.1/servers/dc5b167d-847f-428c-8cae-3eef7bdffe9f => generated 1293 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:03:16.190705 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-8c5b89f4-8ab0-4620-9b99-8a3e82647f76 req-a6532333-313d-471c-b9e6-60ed1c5c675d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f90d78a8-dea6-45c3-933c-8184ff4858b1", "tag": "fe53e38f-6288-438a-8ab5-3cd8c1e3f433"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:03:16.195903 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4a284f85-9540-4cb4-8f7b-f22e6ef77799 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:16.196793 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-4a284f85-9540-4cb4-8f7b-f22e6ef77799 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: ecbf3ab5-9736-491e-b120-6a30d40bc328] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:16.225224 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4a284f85-9540-4cb4-8f7b-f22e6ef77799 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:16.226203 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4a284f85-9540-4cb4-8f7b-f22e6ef77799 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:16.226920 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4a284f85-9540-4cb4-8f7b-f22e6ef77799 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:16.229240 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4a284f85-9540-4cb4-8f7b-f22e6ef77799 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:16.230638 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-8c5b89f4-8ab0-4620-9b99-8a3e82647f76 req-a6532333-313d-471c-b9e6-60ed1c5c675d service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:16.230911 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4a284f85-9540-4cb4-8f7b-f22e6ef77799 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:16.231562 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4a284f85-9540-4cb4-8f7b-f22e6ef77799 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:16.236958 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-8c5b89f4-8ab0-4620-9b99-8a3e82647f76 req-a6532333-313d-471c-b9e6-60ed1c5c675d service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:16.237927 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-8c5b89f4-8ab0-4620-9b99-8a3e82647f76 req-a6532333-313d-471c-b9e6-60ed1c5c675d service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:16.293148 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-8c5b89f4-8ab0-4620-9b99-8a3e82647f76 req-a6532333-313d-471c-b9e6-60ed1c5c675d service nova] Creating event network-changed:fe53e38f-6288-438a-8ab5-3cd8c1e3f433 for instance f90d78a8-dea6-45c3-933c-8184ff4858b1 on n-h1-852278-4 Aug 27 03:03:16.306762 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-8c5b89f4-8ab0-4620-9b99-8a3e82647f76 req-a6532333-313d-471c-b9e6-60ed1c5c675d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130987 Aug 27 03:03:16.315395 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2157/4287] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:03:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:03:16.711132 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-4a284f85-9540-4cb4-8f7b-f22e6ef77799 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36697e722bef4a33ab158e9b2f87596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4ca527ba3b49539b528ec8950aef78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:16.729764 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-4a284f85-9540-4cb4-8f7b-f22e6ef77799 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "GET /compute/v2.1/servers/ecbf3ab5-9736-491e-b120-6a30d40bc328" status: 200 len: 1522 microversion: 2.1 time: 0.547954 Aug 27 03:03:16.732234 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2131/4288] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:16 2022] GET /compute/v2.1/servers/ecbf3ab5-9736-491e-b120-6a30d40bc328 => generated 1522 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:03:17.211393 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-49577eb0-6d33-439a-986b-503fce4db03b tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:17.213431 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-49577eb0-6d33-439a-986b-503fce4db03b tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: dc5b167d-847f-428c-8cae-3eef7bdffe9f] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:17.215535 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-afb37fe3-745f-449e-b2d7-d892fec1caf6 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:17.217141 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-afb37fe3-745f-449e-b2d7-d892fec1caf6 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] [instance: 0069592c-7187-4b4d-ab74-3a1a3bc3de80] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:17.226408 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-afb37fe3-745f-449e-b2d7-d892fec1caf6 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:17.227490 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-afb37fe3-745f-449e-b2d7-d892fec1caf6 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:17.228133 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-afb37fe3-745f-449e-b2d7-d892fec1caf6 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:17.231515 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-49577eb0-6d33-439a-986b-503fce4db03b tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:17.232406 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-49577eb0-6d33-439a-986b-503fce4db03b tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:17.232940 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-49577eb0-6d33-439a-986b-503fce4db03b tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:17.233747 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-49577eb0-6d33-439a-986b-503fce4db03b tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:17.234444 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-49577eb0-6d33-439a-986b-503fce4db03b tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:17.235192 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-49577eb0-6d33-439a-986b-503fce4db03b tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:17.238855 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-afb37fe3-745f-449e-b2d7-d892fec1caf6 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:17.239793 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-afb37fe3-745f-449e-b2d7-d892fec1caf6 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:17.240463 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-afb37fe3-745f-449e-b2d7-d892fec1caf6 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:17.655919 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-49577eb0-6d33-439a-986b-503fce4db03b tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:17.668655 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-49577eb0-6d33-439a-986b-503fce4db03b tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/dc5b167d-847f-428c-8cae-3eef7bdffe9f" status: 200 len: 1293 microversion: 2.1 time: 0.459503 Aug 27 03:03:17.668655 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2158/4289] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:17 2022] GET /compute/v2.1/servers/dc5b167d-847f-428c-8cae-3eef7bdffe9f => generated 1293 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:03:17.681820 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-778b708c-2049-4cfe-83ff-1e57c02a8fdf req-5aa87b6d-67b0-43e4-9c7d-03bbd6a6cae9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc5b167d-847f-428c-8cae-3eef7bdffe9f", "name": "network-vif-plugged", "status": "completed", "tag": "f4a994bc-fc12-4bf9-a419-726c70aea3cd"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:03:17.701460 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-778b708c-2049-4cfe-83ff-1e57c02a8fdf req-5aa87b6d-67b0-43e4-9c7d-03bbd6a6cae9 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:17.705929 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-778b708c-2049-4cfe-83ff-1e57c02a8fdf req-5aa87b6d-67b0-43e4-9c7d-03bbd6a6cae9 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:17.706636 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-778b708c-2049-4cfe-83ff-1e57c02a8fdf req-5aa87b6d-67b0-43e4-9c7d-03bbd6a6cae9 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:17.728223 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-778b708c-2049-4cfe-83ff-1e57c02a8fdf req-5aa87b6d-67b0-43e4-9c7d-03bbd6a6cae9 service nova] Creating event network-vif-plugged:f4a994bc-fc12-4bf9-a419-726c70aea3cd for instance dc5b167d-847f-428c-8cae-3eef7bdffe9f on n-h1-852278-4 Aug 27 03:03:17.739702 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-778b708c-2049-4cfe-83ff-1e57c02a8fdf req-5aa87b6d-67b0-43e4-9c7d-03bbd6a6cae9 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071264 Aug 27 03:03:17.744822 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2159/4290] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:03:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:03:17.762322 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ba1b7784-10e9-4cdd-82ff-677d5c8a241c tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:17.763326 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-ba1b7784-10e9-4cdd-82ff-677d5c8a241c tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: ecbf3ab5-9736-491e-b120-6a30d40bc328] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:17.771708 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ba1b7784-10e9-4cdd-82ff-677d5c8a241c tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:17.772849 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ba1b7784-10e9-4cdd-82ff-677d5c8a241c tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:17.773467 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ba1b7784-10e9-4cdd-82ff-677d5c8a241c tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:17.774366 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ba1b7784-10e9-4cdd-82ff-677d5c8a241c tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:17.774985 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ba1b7784-10e9-4cdd-82ff-677d5c8a241c tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:17.775582 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ba1b7784-10e9-4cdd-82ff-677d5c8a241c tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:17.791958 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-afb37fe3-745f-449e-b2d7-d892fec1caf6 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c3da1faaee46ca94d2a2543851f3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32a1b54e30415eb8f0e6df5e8b7be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:17.818621 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-afb37fe3-745f-449e-b2d7-d892fec1caf6 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] 10.222.0.70 "GET /compute/v2.1/servers/0069592c-7187-4b4d-ab74-3a1a3bc3de80" status: 200 len: 1506 microversion: 2.1 time: 0.608811 Aug 27 03:03:17.821695 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2132/4291] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:17 2022] GET /compute/v2.1/servers/0069592c-7187-4b4d-ab74-3a1a3bc3de80 => generated 1506 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:03:18.017007 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-ba1b7784-10e9-4cdd-82ff-677d5c8a241c tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36697e722bef4a33ab158e9b2f87596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4ca527ba3b49539b528ec8950aef78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:18.026107 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ba1b7784-10e9-4cdd-82ff-677d5c8a241c tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "GET /compute/v2.1/servers/ecbf3ab5-9736-491e-b120-6a30d40bc328" status: 200 len: 1502 microversion: 2.1 time: 0.275836 Aug 27 03:03:18.026725 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2160/4292] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:17 2022] GET /compute/v2.1/servers/ecbf3ab5-9736-491e-b120-6a30d40bc328 => generated 1502 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:03:18.051220 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-000905d1-3f06-4fdb-a5a5-c8e6c096300f tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:18.052488 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-000905d1-3f06-4fdb-a5a5-c8e6c096300f tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: f09bcfaf-4282-4434-8bb8-6dda7b337ae5] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:18.061061 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-000905d1-3f06-4fdb-a5a5-c8e6c096300f tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:18.061665 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-000905d1-3f06-4fdb-a5a5-c8e6c096300f tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:18.062269 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-000905d1-3f06-4fdb-a5a5-c8e6c096300f tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:18.063103 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-000905d1-3f06-4fdb-a5a5-c8e6c096300f tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:18.063663 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-000905d1-3f06-4fdb-a5a5-c8e6c096300f tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:18.064480 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-000905d1-3f06-4fdb-a5a5-c8e6c096300f tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:18.207478 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-000905d1-3f06-4fdb-a5a5-c8e6c096300f tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36697e722bef4a33ab158e9b2f87596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4ca527ba3b49539b528ec8950aef78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:18.215756 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-000905d1-3f06-4fdb-a5a5-c8e6c096300f tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "GET /compute/v2.1/servers/f09bcfaf-4282-4434-8bb8-6dda7b337ae5" status: 200 len: 1515 microversion: 2.1 time: 0.171120 Aug 27 03:03:18.228643 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2133/4293] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:18 2022] GET /compute/v2.1/servers/f09bcfaf-4282-4434-8bb8-6dda7b337ae5 => generated 1515 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:03:18.239008 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c8e838d7-6c40-412f-af24-1480f184a4f0 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:03:18.242679 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-c8e838d7-6c40-412f-af24-1480f184a4f0 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: 45c00581-6b69-4363-a5f3-6ee9d4e9d768] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:18.249179 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-c8e838d7-6c40-412f-af24-1480f184a4f0 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] HTTP exception thrown: Instance 45c00581-6b69-4363-a5f3-6ee9d4e9d768 could not be found. Aug 27 03:03:18.254673 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c8e838d7-6c40-412f-af24-1480f184a4f0 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Request method failure captured: Aug 27 03:03:18.254673 n-d-852278-4 devstack@n-api.service[134051]: request: POST /compute/v2.1/servers/45c00581-6b69-4363-a5f3-6ee9d4e9d768/action HTTP/1.1 Aug 27 03:03:18.254673 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 03:03:18.254673 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 03:03:18.254673 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 03:03:18.254673 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 14 Aug 27 03:03:18.254673 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 03:03:18.254673 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 03:03:18.254673 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 03:03:18.254673 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 03:03:18.254673 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYlCR9c_onisOtljFF_OKffaCMw1fqcK8AqJdNG9qzhexbiOAQUtNy-3x5VJrEQxLYuHD403zeJPmdfi74lzmVkRKznv6JROTBAXqcugDUkBzjF_9CFKpQVmUlF9UkBSehtKOGnnrCFpHwE0Yb7XTVGDotoY0qf8klSZfatljLqnj-Y Aug 27 03:03:18.254673 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 03:03:18.254673 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 03:03:18.254673 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 03:03:18.254673 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 03:03:18.254673 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 03:03:18.254673 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 03:03:18.254673 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 1b4ca527ba3b49539b528ec8950aef78 Aug 27 03:03:18.254673 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1447006165 Aug 27 03:03:18.254673 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 03:03:18.254673 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 03:03:18.254673 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/1b4ca527ba3b49539b528ec8950aef78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_1b4ca527ba3b49539b528ec8950aef78", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/1b4ca527ba3b49539b528ec8950aef78"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/1b4ca527ba3b49539b528ec8950aef78"}]}] Aug 27 03:03:18.254673 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1447006165 Aug 27 03:03:18.254673 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 1b4ca527ba3b49539b528ec8950aef78 Aug 27 03:03:18.254673 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1447006165 Aug 27 03:03:18.254673 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ServerRescueNegativeTestJSON-1447006165-project Aug 27 03:03:18.254673 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 03:03:18.254673 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 03:03:18.254673 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 36697e722bef4a33ab158e9b2f87596a Aug 27 03:03:18.254673 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1447006165-project Aug 27 03:03:18.254673 n-d-852278-4 devstack@n-api.service[134051]: Aug 27 03:03:18.254673 n-d-852278-4 devstack@n-api.service[134051]: {"rescue": {}} Aug 27 03:03:18.254673 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 03:03:18.254673 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance 45c00581-6b69-4363-a5f3-6ee9d4e9d768 could not be found. Aug 27 03:03:18.254673 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '45c00581-6b69-4363-a5f3-6ee9d4e9d768', 'body': {'rescue': {}}} Aug 27 03:03:18.254673 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:03:18.254673 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:03:18.254673 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:03:18.254673 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:03:18.254673 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:03:18.254673 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:03:18.254673 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 03:03:18.254673 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 03:03:18.254673 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45c00581-6b69-4363-a5f3-6ee9d4e9d768 could not be found. Aug 27 03:03:18.254673 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:03:18.254673 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:03:18.254673 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:03:18.254673 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:03:18.254673 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:03:18.254673 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:03:18.254673 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:03:18.254673 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:03:18.254673 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:03:18.254673 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:03:18.254673 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:03:18.254673 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:03:18.254673 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Aug 27 03:03:18.254673 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 27 03:03:18.254673 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:03:18.254673 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:03:18.254673 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45c00581-6b69-4363-a5f3-6ee9d4e9d768 could not be found. Aug 27 03:03:18.254673 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:03:18.254673 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:03:18.254673 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:03:18.254673 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:03:18.259649 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:03:18.259649 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:03:18.259649 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:03:18.259649 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:03:18.259649 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45c00581-6b69-4363-a5f3-6ee9d4e9d768 could not be found. Aug 27 03:03:18.259649 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:03:18.259649 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c8e838d7-6c40-412f-af24-1480f184a4f0 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Returning 404 to user: Instance 45c00581-6b69-4363-a5f3-6ee9d4e9d768 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:03:18.259649 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c8e838d7-6c40-412f-af24-1480f184a4f0 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "POST /compute/v2.1/servers/45c00581-6b69-4363-a5f3-6ee9d4e9d768/action" status: 404 len: 111 microversion: 2.1 time: 0.022240 Aug 27 03:03:18.261359 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2161/4294] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:03:18 2022] POST /compute/v2.1/servers/45c00581-6b69-4363-a5f3-6ee9d4e9d768/action => generated 111 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:03:18.267145 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-1f2cd06b-872a-4f51-b103-60091eff4f8c tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:03:18.267678 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-1f2cd06b-872a-4f51-b103-60091eff4f8c tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: f09bcfaf-4282-4434-8bb8-6dda7b337ae5] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:18.273936 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1f2cd06b-872a-4f51-b103-60091eff4f8c tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:18.274547 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1f2cd06b-872a-4f51-b103-60091eff4f8c tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:18.274984 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1f2cd06b-872a-4f51-b103-60091eff4f8c tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:18.275694 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1f2cd06b-872a-4f51-b103-60091eff4f8c tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:18.276139 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1f2cd06b-872a-4f51-b103-60091eff4f8c tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:18.276591 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1f2cd06b-872a-4f51-b103-60091eff4f8c tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:18.344440 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-1f2cd06b-872a-4f51-b103-60091eff4f8c tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "POST /compute/v2.1/servers/f09bcfaf-4282-4434-8bb8-6dda7b337ae5/action" status: 202 len: 0 microversion: 2.1 time: 0.080997 Aug 27 03:03:18.345481 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2134/4295] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:03:18 2022] POST /compute/v2.1/servers/f09bcfaf-4282-4434-8bb8-6dda7b337ae5/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:03:18.354254 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-48bee277-0346-40e0-8064-c691805bb92c tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:18.355250 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-48bee277-0346-40e0-8064-c691805bb92c tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: f09bcfaf-4282-4434-8bb8-6dda7b337ae5] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:18.362576 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-48bee277-0346-40e0-8064-c691805bb92c tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:18.363131 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-48bee277-0346-40e0-8064-c691805bb92c tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:18.363651 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-48bee277-0346-40e0-8064-c691805bb92c tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:18.364591 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-48bee277-0346-40e0-8064-c691805bb92c tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:18.365131 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-48bee277-0346-40e0-8064-c691805bb92c tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:18.365578 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-48bee277-0346-40e0-8064-c691805bb92c tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:18.518227 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-48bee277-0346-40e0-8064-c691805bb92c tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36697e722bef4a33ab158e9b2f87596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4ca527ba3b49539b528ec8950aef78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:18.526760 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-48bee277-0346-40e0-8064-c691805bb92c tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "GET /compute/v2.1/servers/f09bcfaf-4282-4434-8bb8-6dda7b337ae5" status: 200 len: 1520 microversion: 2.1 time: 0.176401 Aug 27 03:03:18.527346 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2162/4296] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:18 2022] GET /compute/v2.1/servers/f09bcfaf-4282-4434-8bb8-6dda7b337ae5 => generated 1520 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:03:18.691911 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9d640319-96d2-4d29-a7d5-15290568de8f tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:18.692827 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-9d640319-96d2-4d29-a7d5-15290568de8f tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: dc5b167d-847f-428c-8cae-3eef7bdffe9f] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:18.699379 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9d640319-96d2-4d29-a7d5-15290568de8f tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:18.699866 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9d640319-96d2-4d29-a7d5-15290568de8f tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:18.700297 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9d640319-96d2-4d29-a7d5-15290568de8f tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:18.700995 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9d640319-96d2-4d29-a7d5-15290568de8f tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:18.701445 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9d640319-96d2-4d29-a7d5-15290568de8f tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:18.701893 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9d640319-96d2-4d29-a7d5-15290568de8f tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:18.843930 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-9d640319-96d2-4d29-a7d5-15290568de8f tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:18.846362 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e84786fe-b71a-4558-a369-45aeadce6937 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:18.850999 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-e84786fe-b71a-4558-a369-45aeadce6937 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] [instance: 0069592c-7187-4b4d-ab74-3a1a3bc3de80] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:18.860790 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9d640319-96d2-4d29-a7d5-15290568de8f tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/dc5b167d-847f-428c-8cae-3eef7bdffe9f" status: 200 len: 1293 microversion: 2.1 time: 0.173955 Aug 27 03:03:18.863054 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e84786fe-b71a-4558-a369-45aeadce6937 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:18.863786 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2135/4297] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:18 2022] GET /compute/v2.1/servers/dc5b167d-847f-428c-8cae-3eef7bdffe9f => generated 1293 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:03:18.864299 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e84786fe-b71a-4558-a369-45aeadce6937 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:18.864971 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e84786fe-b71a-4558-a369-45aeadce6937 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:18.865867 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e84786fe-b71a-4558-a369-45aeadce6937 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:18.866472 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e84786fe-b71a-4558-a369-45aeadce6937 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:18.867230 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e84786fe-b71a-4558-a369-45aeadce6937 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:19.039915 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e84786fe-b71a-4558-a369-45aeadce6937 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c3da1faaee46ca94d2a2543851f3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32a1b54e30415eb8f0e6df5e8b7be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:19.047802 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e84786fe-b71a-4558-a369-45aeadce6937 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] 10.222.0.70 "GET /compute/v2.1/servers/0069592c-7187-4b4d-ab74-3a1a3bc3de80" status: 200 len: 1506 microversion: 2.1 time: 0.209440 Aug 27 03:03:19.048476 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2163/4298] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:18 2022] GET /compute/v2.1/servers/0069592c-7187-4b4d-ab74-3a1a3bc3de80 => generated 1506 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:03:19.547803 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e02c420b-44d7-4b09-a6af-fbca4125625f tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:19.548518 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-e02c420b-44d7-4b09-a6af-fbca4125625f tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: f09bcfaf-4282-4434-8bb8-6dda7b337ae5] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:19.558044 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e02c420b-44d7-4b09-a6af-fbca4125625f tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:19.558873 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e02c420b-44d7-4b09-a6af-fbca4125625f tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:19.559516 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e02c420b-44d7-4b09-a6af-fbca4125625f tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:19.560506 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e02c420b-44d7-4b09-a6af-fbca4125625f tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:19.561019 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e02c420b-44d7-4b09-a6af-fbca4125625f tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:19.561717 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e02c420b-44d7-4b09-a6af-fbca4125625f tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:19.777714 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-e02c420b-44d7-4b09-a6af-fbca4125625f tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36697e722bef4a33ab158e9b2f87596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4ca527ba3b49539b528ec8950aef78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:19.786163 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e02c420b-44d7-4b09-a6af-fbca4125625f tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "GET /compute/v2.1/servers/f09bcfaf-4282-4434-8bb8-6dda7b337ae5" status: 200 len: 1500 microversion: 2.1 time: 0.242321 Aug 27 03:03:19.786800 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2136/4299] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:19 2022] GET /compute/v2.1/servers/f09bcfaf-4282-4434-8bb8-6dda7b337ae5 => generated 1500 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:03:19.808206 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0f160c33-4144-4365-8e28-4979de77782c tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:03:19.811241 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-0f160c33-4144-4365-8e28-4979de77782c tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: f09bcfaf-4282-4434-8bb8-6dda7b337ae5] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:19.821152 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0f160c33-4144-4365-8e28-4979de77782c tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:19.821152 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0f160c33-4144-4365-8e28-4979de77782c tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:19.821152 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0f160c33-4144-4365-8e28-4979de77782c tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:19.821152 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0f160c33-4144-4365-8e28-4979de77782c tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:19.822282 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0f160c33-4144-4365-8e28-4979de77782c tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:19.822282 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0f160c33-4144-4365-8e28-4979de77782c tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:19.851859 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.objects.instance [None req-0f160c33-4144-4365-8e28-4979de77782c tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lazy-loading 'flavor' on Instance uuid f09bcfaf-4282-4434-8bb8-6dda7b337ae5 {{(pid=134051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:03:19.884679 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-2b9d8ddc-8e6e-4323-9027-627ca13e362c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:19.885358 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-2b9d8ddc-8e6e-4323-9027-627ca13e362c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: dc5b167d-847f-428c-8cae-3eef7bdffe9f] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:19.894550 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-0f160c33-4144-4365-8e28-4979de77782c tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] HTTP exception thrown: Cannot 'rescue' instance f09bcfaf-4282-4434-8bb8-6dda7b337ae5 while it is in vm_state paused Aug 27 03:03:19.899410 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0f160c33-4144-4365-8e28-4979de77782c tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Request method failure captured: Aug 27 03:03:19.899410 n-d-852278-4 devstack@n-api.service[134051]: request: POST /compute/v2.1/servers/f09bcfaf-4282-4434-8bb8-6dda7b337ae5/action HTTP/1.1 Aug 27 03:03:19.899410 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 03:03:19.899410 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 03:03:19.899410 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 03:03:19.899410 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 14 Aug 27 03:03:19.899410 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 03:03:19.899410 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 03:03:19.899410 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 03:03:19.899410 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 03:03:19.899410 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYlCR9c_onisOtljFF_OKffaCMw1fqcK8AqJdNG9qzhexbiOAQUtNy-3x5VJrEQxLYuHD403zeJPmdfi74lzmVkRKznv6JROTBAXqcugDUkBzjF_9CFKpQVmUlF9UkBSehtKOGnnrCFpHwE0Yb7XTVGDotoY0qf8klSZfatljLqnj-Y Aug 27 03:03:19.899410 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 03:03:19.899410 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 03:03:19.899410 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 03:03:19.899410 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 03:03:19.899410 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 03:03:19.899410 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 03:03:19.899410 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 1b4ca527ba3b49539b528ec8950aef78 Aug 27 03:03:19.899410 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1447006165 Aug 27 03:03:19.899410 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 03:03:19.899410 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 03:03:19.899410 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/1b4ca527ba3b49539b528ec8950aef78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_1b4ca527ba3b49539b528ec8950aef78", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/1b4ca527ba3b49539b528ec8950aef78"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/1b4ca527ba3b49539b528ec8950aef78"}]}] Aug 27 03:03:19.899410 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1447006165 Aug 27 03:03:19.899410 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 1b4ca527ba3b49539b528ec8950aef78 Aug 27 03:03:19.899410 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1447006165 Aug 27 03:03:19.899410 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ServerRescueNegativeTestJSON-1447006165-project Aug 27 03:03:19.899410 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 03:03:19.899410 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 03:03:19.899410 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 36697e722bef4a33ab158e9b2f87596a Aug 27 03:03:19.899410 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1447006165-project Aug 27 03:03:19.899410 n-d-852278-4 devstack@n-api.service[134051]: Aug 27 03:03:19.899410 n-d-852278-4 devstack@n-api.service[134051]: {"rescue": {}} Aug 27 03:03:19.899410 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 03:03:19.899410 n-d-852278-4 devstack@n-api.service[134051]: exception: Cannot 'rescue' instance f09bcfaf-4282-4434-8bb8-6dda7b337ae5 while it is in vm_state paused Aug 27 03:03:19.899410 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': 'f09bcfaf-4282-4434-8bb8-6dda7b337ae5', 'body': {'rescue': {}}} Aug 27 03:03:19.899410 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:03:19.899410 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:03:19.899410 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Aug 27 03:03:19.899410 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Aug 27 03:03:19.899410 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Aug 27 03:03:19.899410 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 27 03:03:19.899410 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 03:03:19.899410 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 03:03:19.899410 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 27 03:03:19.899410 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 27 03:03:19.899410 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f09bcfaf-4282-4434-8bb8-6dda7b337ae5 in vm_state paused. Cannot rescue while the instance is in this state. Aug 27 03:03:19.899410 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:03:19.899410 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:03:19.899410 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:03:19.899410 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:03:19.899410 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:03:19.899410 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:03:19.899410 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:03:19.899410 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:03:19.899410 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:03:19.899410 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:03:19.899410 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:03:19.899410 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:03:19.899410 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Aug 27 03:03:19.899410 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Aug 27 03:03:19.899410 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 27 03:03:19.899410 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 27 03:03:19.899410 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance f09bcfaf-4282-4434-8bb8-6dda7b337ae5 while it is in vm_state paused Aug 27 03:03:19.899410 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:03:19.904158 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:03:19.904158 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:03:19.904158 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:03:19.904158 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:03:19.904158 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:03:19.904158 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:03:19.904158 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:03:19.904158 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance f09bcfaf-4282-4434-8bb8-6dda7b337ae5 while it is in vm_state paused Aug 27 03:03:19.904158 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:03:19.904158 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0f160c33-4144-4365-8e28-4979de77782c tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Returning 409 to user: Cannot 'rescue' instance f09bcfaf-4282-4434-8bb8-6dda7b337ae5 while it is in vm_state paused {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:03:19.904841 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2b9d8ddc-8e6e-4323-9027-627ca13e362c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:19.904841 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2b9d8ddc-8e6e-4323-9027-627ca13e362c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:19.905010 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-0f160c33-4144-4365-8e28-4979de77782c tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "POST /compute/v2.1/servers/f09bcfaf-4282-4434-8bb8-6dda7b337ae5/action" status: 409 len: 144 microversion: 2.1 time: 0.099580 Aug 27 03:03:19.905093 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2b9d8ddc-8e6e-4323-9027-627ca13e362c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:19.905181 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2164/4300] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:03:19 2022] POST /compute/v2.1/servers/f09bcfaf-4282-4434-8bb8-6dda7b337ae5/action => generated 144 bytes in 101 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 27 03:03:19.905263 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2b9d8ddc-8e6e-4323-9027-627ca13e362c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:19.906798 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2b9d8ddc-8e6e-4323-9027-627ca13e362c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:19.908013 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2b9d8ddc-8e6e-4323-9027-627ca13e362c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:19.914308 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-be48093d-4eb4-4d83-8600-a842dd416514 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:03:19.914919 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-be48093d-4eb4-4d83-8600-a842dd416514 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: f09bcfaf-4282-4434-8bb8-6dda7b337ae5] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:19.935805 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-be48093d-4eb4-4d83-8600-a842dd416514 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:19.936334 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-be48093d-4eb4-4d83-8600-a842dd416514 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:19.936782 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-be48093d-4eb4-4d83-8600-a842dd416514 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:19.937504 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-be48093d-4eb4-4d83-8600-a842dd416514 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:19.937960 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-be48093d-4eb4-4d83-8600-a842dd416514 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:19.938384 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-be48093d-4eb4-4d83-8600-a842dd416514 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:20.074245 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-be48093d-4eb4-4d83-8600-a842dd416514 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "POST /compute/v2.1/servers/f09bcfaf-4282-4434-8bb8-6dda7b337ae5/action" status: 202 len: 0 microversion: 2.1 time: 0.164276 Aug 27 03:03:20.074948 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2165/4301] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:03:19 2022] POST /compute/v2.1/servers/f09bcfaf-4282-4434-8bb8-6dda7b337ae5/action => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:03:20.087243 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ef228283-6c95-46b3-bd2c-50614a055264 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:20.088033 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-ef228283-6c95-46b3-bd2c-50614a055264 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] [instance: 0069592c-7187-4b4d-ab74-3a1a3bc3de80] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:20.096291 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ef228283-6c95-46b3-bd2c-50614a055264 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:20.096954 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ef228283-6c95-46b3-bd2c-50614a055264 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:20.097545 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ef228283-6c95-46b3-bd2c-50614a055264 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:20.098514 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ef228283-6c95-46b3-bd2c-50614a055264 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:20.098950 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ef228283-6c95-46b3-bd2c-50614a055264 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:20.099470 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ef228283-6c95-46b3-bd2c-50614a055264 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:20.128409 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-2b9d8ddc-8e6e-4323-9027-627ca13e362c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:20.137612 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-2b9d8ddc-8e6e-4323-9027-627ca13e362c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/dc5b167d-847f-428c-8cae-3eef7bdffe9f" status: 200 len: 1473 microversion: 2.1 time: 0.257059 Aug 27 03:03:20.142958 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2137/4302] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:19 2022] GET /compute/v2.1/servers/dc5b167d-847f-428c-8cae-3eef7bdffe9f => generated 1473 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:03:20.160830 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9b794889-66f8-4499-8615-3e0caee267b9 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:20.161917 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-9b794889-66f8-4499-8615-3e0caee267b9 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: f09bcfaf-4282-4434-8bb8-6dda7b337ae5] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:20.180348 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9b794889-66f8-4499-8615-3e0caee267b9 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:20.183166 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9b794889-66f8-4499-8615-3e0caee267b9 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:20.186381 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9b794889-66f8-4499-8615-3e0caee267b9 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:20.187782 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9b794889-66f8-4499-8615-3e0caee267b9 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:20.189611 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9b794889-66f8-4499-8615-3e0caee267b9 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:20.191791 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9b794889-66f8-4499-8615-3e0caee267b9 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:20.316862 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-ef228283-6c95-46b3-bd2c-50614a055264 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c3da1faaee46ca94d2a2543851f3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32a1b54e30415eb8f0e6df5e8b7be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:20.325875 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ef228283-6c95-46b3-bd2c-50614a055264 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] 10.222.0.70 "GET /compute/v2.1/servers/0069592c-7187-4b4d-ab74-3a1a3bc3de80" status: 200 len: 1506 microversion: 2.1 time: 0.249483 Aug 27 03:03:20.336427 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2166/4303] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:20 2022] GET /compute/v2.1/servers/0069592c-7187-4b4d-ab74-3a1a3bc3de80 => generated 1506 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:03:20.336427 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-206e111d-a460-4230-becd-e9d370cecd8c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-762883874", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:03:20.391765 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.network.neutron [None req-206e111d-a460-4230-becd-e9d370cecd8c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] validate_networks() for [('961028dd-9dfc-4287-bc1b-27b14d79a81a', None, None, None, None, None)] {{(pid=134051) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:03:20.437159 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-9b794889-66f8-4499-8615-3e0caee267b9 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36697e722bef4a33ab158e9b2f87596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4ca527ba3b49539b528ec8950aef78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:20.441213 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:03:20.446576 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9b794889-66f8-4499-8615-3e0caee267b9 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "GET /compute/v2.1/servers/f09bcfaf-4282-4434-8bb8-6dda7b337ae5" status: 200 len: 1507 microversion: 2.1 time: 0.302163 Aug 27 03:03:20.447405 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2138/4304] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:20 2022] GET /compute/v2.1/servers/f09bcfaf-4282-4434-8bb8-6dda7b337ae5 => generated 1507 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:03:20.799484 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-206e111d-a460-4230-becd-e9d370cecd8c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Flavor limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:03:20.800013 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-206e111d-a460-4230-becd-e9d370cecd8c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Image limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:03:20.800598 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-206e111d-a460-4230-becd-e9d370cecd8c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Flavor pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:03:20.801082 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-206e111d-a460-4230-becd-e9d370cecd8c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Image pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:03:20.801722 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-206e111d-a460-4230-becd-e9d370cecd8c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:03:20.811347 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-206e111d-a460-4230-becd-e9d370cecd8c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:20.812015 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-206e111d-a460-4230-becd-e9d370cecd8c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:20.812457 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-206e111d-a460-4230-becd-e9d370cecd8c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:20.813288 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-206e111d-a460-4230-becd-e9d370cecd8c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:20.813803 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-206e111d-a460-4230-becd-e9d370cecd8c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:20.814343 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-206e111d-a460-4230-becd-e9d370cecd8c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:20.833182 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-206e111d-a460-4230-becd-e9d370cecd8c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Getting quotas for project 6b8d6664c463420bad9a5bfb6d747db4. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:03:20.839699 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-206e111d-a460-4230-becd-e9d370cecd8c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Getting quotas for user 13a4e6dcf5df46fcad30430a9b9a08ee and project 6b8d6664c463420bad9a5bfb6d747db4. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:03:20.853024 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-206e111d-a460-4230-becd-e9d370cecd8c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Going to run 1 instances... {{(pid=134051) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:03:20.855505 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-206e111d-a460-4230-becd-e9d370cecd8c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: 815ce93a-b022-4309-b493-787ee68ffd96] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134051) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:03:20.868911 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:03:20.906710 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-206e111d-a460-4230-becd-e9d370cecd8c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.578598 Aug 27 03:03:20.907967 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2167/4305] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 03:03:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 580 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:03:20.919441 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e6dd0f98-a748-4425-8b74-ded8c57d54de tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:20.920355 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-e6dd0f98-a748-4425-8b74-ded8c57d54de tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: 815ce93a-b022-4309-b493-787ee68ffd96] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:20.942044 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-e6dd0f98-a748-4425-8b74-ded8c57d54de tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: 815ce93a-b022-4309-b493-787ee68ffd96] Going to try to terminate instance {{(pid=134052) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:03:21.012031 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e6dd0f98-a748-4425-8b74-ded8c57d54de tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "DELETE /compute/v2.1/servers/815ce93a-b022-4309-b493-787ee68ffd96" status: 204 len: 0 microversion: 2.1 time: 0.097002 Aug 27 03:03:21.013168 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2139/4306] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 03:03:20 2022] DELETE /compute/v2.1/servers/815ce93a-b022-4309-b493-787ee68ffd96 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 03:03:21.022318 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-cf0f73de-3461-473c-a584-6eb8b543712a tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:21.023219 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-cf0f73de-3461-473c-a584-6eb8b543712a tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: 815ce93a-b022-4309-b493-787ee68ffd96] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:21.039139 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-cf0f73de-3461-473c-a584-6eb8b543712a tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] HTTP exception thrown: Instance 815ce93a-b022-4309-b493-787ee68ffd96 could not be found. Aug 27 03:03:21.048765 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-cf0f73de-3461-473c-a584-6eb8b543712a tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Request method failure captured: Aug 27 03:03:21.048765 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/815ce93a-b022-4309-b493-787ee68ffd96 HTTP/1.1 Aug 27 03:03:21.048765 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 03:03:21.048765 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 03:03:21.048765 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 03:03:21.048765 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 03:03:21.048765 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 03:03:21.048765 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 03:03:21.048765 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 03:03:21.048765 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 03:03:21.048765 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYljOihuPJQy-4KxXQ6OhbQw2FQiYByi8_J9EYziHxHrRpgpXLGNvb0hsYYYVptKud4yCoN0X9GxdS_QRHpRChZ0P7CrkMR6MvE3oNyvsgDIOynlxCCmMse1aD34uMngOe0Z8wMpnS_90nVB9LjwZPMQBiRDrvzydhSu6jwK0Njtp_4 Aug 27 03:03:21.048765 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 03:03:21.048765 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 03:03:21.048765 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 03:03:21.048765 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 03:03:21.048765 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 03:03:21.048765 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 03:03:21.048765 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 6b8d6664c463420bad9a5bfb6d747db4 Aug 27 03:03:21.048765 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ServersTestJSON-252485458 Aug 27 03:03:21.048765 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 03:03:21.048765 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 03:03:21.048765 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6b8d6664c463420bad9a5bfb6d747db4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_6b8d6664c463420bad9a5bfb6d747db4", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6b8d6664c463420bad9a5bfb6d747db4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/6b8d6664c463420bad9a5bfb6d747db4"}]}] Aug 27 03:03:21.048765 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ServersTestJSON-252485458 Aug 27 03:03:21.048765 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 6b8d6664c463420bad9a5bfb6d747db4 Aug 27 03:03:21.048765 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ServersTestJSON-252485458 Aug 27 03:03:21.048765 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ServersTestJSON-252485458-project Aug 27 03:03:21.048765 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 03:03:21.048765 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 03:03:21.048765 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 13a4e6dcf5df46fcad30430a9b9a08ee Aug 27 03:03:21.048765 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ServersTestJSON-252485458-project Aug 27 03:03:21.048765 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 03:03:21.048765 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance 815ce93a-b022-4309-b493-787ee68ffd96 could not be found. Aug 27 03:03:21.048765 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '815ce93a-b022-4309-b493-787ee68ffd96'} Aug 27 03:03:21.048765 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:03:21.048765 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:03:21.048765 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2932, in _get_instance Aug 27 03:03:21.048765 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi build_req = objects.BuildRequest.get_by_instance_uuid( Aug 27 03:03:21.048765 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 03:03:21.048765 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 03:03:21.048765 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 177, in get_by_instance_uuid Aug 27 03:03:21.048765 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi db_req = cls._get_by_instance_uuid_from_db(context, instance_uuid) Aug 27 03:03:21.048765 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 03:03:21.048765 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 03:03:21.048765 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 172, in _get_by_instance_uuid_from_db Aug 27 03:03:21.048765 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.BuildRequestNotFound(uuid=instance_uuid) Aug 27 03:03:21.048765 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.BuildRequestNotFound: BuildRequest not found for instance 815ce93a-b022-4309-b493-787ee68ffd96 Aug 27 03:03:21.048765 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:03:21.048765 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:03:21.048765 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:03:21.048765 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:03:21.048765 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:03:21.048765 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:03:21.048765 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:03:21.048765 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:03:21.048765 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2944, in _get_instance Aug 27 03:03:21.048765 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 03:03:21.048765 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 815ce93a-b022-4309-b493-787ee68ffd96 could not be found. Aug 27 03:03:21.048765 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:03:21.048765 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:03:21.048765 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:03:21.048765 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:03:21.048765 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:03:21.048765 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:03:21.053668 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:03:21.053668 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:03:21.053668 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:03:21.053668 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:03:21.053668 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:03:21.053668 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:03:21.053668 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:03:21.053668 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:03:21.053668 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:03:21.053668 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:03:21.053668 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 815ce93a-b022-4309-b493-787ee68ffd96 could not be found. Aug 27 03:03:21.053668 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:03:21.053668 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:03:21.053668 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:03:21.053668 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:03:21.053668 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:03:21.053668 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:03:21.053668 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:03:21.053668 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:03:21.053668 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 815ce93a-b022-4309-b493-787ee68ffd96 could not be found. Aug 27 03:03:21.053668 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:03:21.053668 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-cf0f73de-3461-473c-a584-6eb8b543712a tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Returning 404 to user: Instance 815ce93a-b022-4309-b493-787ee68ffd96 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:03:21.053668 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-cf0f73de-3461-473c-a584-6eb8b543712a tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/815ce93a-b022-4309-b493-787ee68ffd96" status: 404 len: 111 microversion: 2.1 time: 0.033237 Aug 27 03:03:21.053668 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2168/4307] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:21 2022] GET /compute/v2.1/servers/815ce93a-b022-4309-b493-787ee68ffd96 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:03:21.106965 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-589b8bc7-ecab-4bd4-a333-b878863999c0 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-2079821253", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "961028dd-9dfc-4287-bc1b-27b14d79a81a"}]}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:03:21.118140 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:03:21.172974 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.network.neutron [None req-589b8bc7-ecab-4bd4-a333-b878863999c0 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] validate_networks() for [('961028dd-9dfc-4287-bc1b-27b14d79a81a', None, None, None, None, None)] {{(pid=134052) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:03:21.347563 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-9b933e99-87a0-4dab-af2a-bb247c6de819 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:21.348503 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-9b933e99-87a0-4dab-af2a-bb247c6de819 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] [instance: 0069592c-7187-4b4d-ab74-3a1a3bc3de80] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:21.359713 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9b933e99-87a0-4dab-af2a-bb247c6de819 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:21.360540 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9b933e99-87a0-4dab-af2a-bb247c6de819 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:21.361213 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9b933e99-87a0-4dab-af2a-bb247c6de819 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:21.361940 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9b933e99-87a0-4dab-af2a-bb247c6de819 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:21.362677 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9b933e99-87a0-4dab-af2a-bb247c6de819 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:21.363285 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9b933e99-87a0-4dab-af2a-bb247c6de819 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:21.696342 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-9b933e99-87a0-4dab-af2a-bb247c6de819 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c3da1faaee46ca94d2a2543851f3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32a1b54e30415eb8f0e6df5e8b7be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:21.704880 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-9b933e99-87a0-4dab-af2a-bb247c6de819 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] 10.222.0.70 "GET /compute/v2.1/servers/0069592c-7187-4b4d-ab74-3a1a3bc3de80" status: 200 len: 1506 microversion: 2.1 time: 0.361421 Aug 27 03:03:21.713953 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2169/4308] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:21 2022] GET /compute/v2.1/servers/0069592c-7187-4b4d-ab74-3a1a3bc3de80 => generated 1506 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:03:21.719304 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-bc3ade90-7d02-4ead-83bf-bf1b34f90a82 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:21.719951 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-bc3ade90-7d02-4ead-83bf-bf1b34f90a82 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: f09bcfaf-4282-4434-8bb8-6dda7b337ae5] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:21.726304 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bc3ade90-7d02-4ead-83bf-bf1b34f90a82 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:21.727030 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bc3ade90-7d02-4ead-83bf-bf1b34f90a82 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:21.727458 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bc3ade90-7d02-4ead-83bf-bf1b34f90a82 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:21.728140 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bc3ade90-7d02-4ead-83bf-bf1b34f90a82 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:21.728826 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bc3ade90-7d02-4ead-83bf-bf1b34f90a82 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:21.729232 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bc3ade90-7d02-4ead-83bf-bf1b34f90a82 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:21.991858 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-589b8bc7-ecab-4bd4-a333-b878863999c0 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Flavor limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:03:21.992920 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-589b8bc7-ecab-4bd4-a333-b878863999c0 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Image limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:03:21.993628 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-589b8bc7-ecab-4bd4-a333-b878863999c0 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Flavor pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:03:21.994554 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-589b8bc7-ecab-4bd4-a333-b878863999c0 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Image pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:03:21.995160 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-589b8bc7-ecab-4bd4-a333-b878863999c0 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:03:22.007878 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-589b8bc7-ecab-4bd4-a333-b878863999c0 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:22.008384 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-589b8bc7-ecab-4bd4-a333-b878863999c0 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:22.008821 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-589b8bc7-ecab-4bd4-a333-b878863999c0 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:22.009538 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-589b8bc7-ecab-4bd4-a333-b878863999c0 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:22.009978 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-589b8bc7-ecab-4bd4-a333-b878863999c0 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:22.010587 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-589b8bc7-ecab-4bd4-a333-b878863999c0 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:22.035722 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-589b8bc7-ecab-4bd4-a333-b878863999c0 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Getting quotas for project 6b8d6664c463420bad9a5bfb6d747db4. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:03:22.041182 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-589b8bc7-ecab-4bd4-a333-b878863999c0 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Getting quotas for user 13a4e6dcf5df46fcad30430a9b9a08ee and project 6b8d6664c463420bad9a5bfb6d747db4. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:03:22.047543 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-bc3ade90-7d02-4ead-83bf-bf1b34f90a82 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36697e722bef4a33ab158e9b2f87596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4ca527ba3b49539b528ec8950aef78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:22.057134 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-bc3ade90-7d02-4ead-83bf-bf1b34f90a82 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "GET /compute/v2.1/servers/f09bcfaf-4282-4434-8bb8-6dda7b337ae5" status: 200 len: 1515 microversion: 2.1 time: 0.341843 Aug 27 03:03:22.057294 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-589b8bc7-ecab-4bd4-a333-b878863999c0 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Going to run 1 instances... {{(pid=134052) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:03:22.058041 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2170/4309] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:21 2022] GET /compute/v2.1/servers/f09bcfaf-4282-4434-8bb8-6dda7b337ae5 => generated 1515 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:03:22.065479 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-589b8bc7-ecab-4bd4-a333-b878863999c0 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: 70ffdc7b-f46e-4e13-b330-86109bc8ff60] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134052) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:03:22.115936 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-589b8bc7-ecab-4bd4-a333-b878863999c0 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.013852 Aug 27 03:03:22.116993 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2140/4310] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 03:03:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1016 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:03:22.127490 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8b53fada-2dce-4863-a0aa-7d7087934fae tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:22.128549 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-8b53fada-2dce-4863-a0aa-7d7087934fae tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: 70ffdc7b-f46e-4e13-b330-86109bc8ff60] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:22.289226 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-8b53fada-2dce-4863-a0aa-7d7087934fae tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:22.308745 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-8b53fada-2dce-4863-a0aa-7d7087934fae tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/70ffdc7b-f46e-4e13-b330-86109bc8ff60" status: 200 len: 1221 microversion: 2.1 time: 0.175979 Aug 27 03:03:22.311098 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2171/4311] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:22 2022] GET /compute/v2.1/servers/70ffdc7b-f46e-4e13-b330-86109bc8ff60 => generated 1221 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:03:22.726645 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-64a886be-cda8-498a-bdf3-323fcbcdcdf1 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:22.727435 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-64a886be-cda8-498a-bdf3-323fcbcdcdf1 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] [instance: 0069592c-7187-4b4d-ab74-3a1a3bc3de80] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:22.738823 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-64a886be-cda8-498a-bdf3-323fcbcdcdf1 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:22.739350 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-64a886be-cda8-498a-bdf3-323fcbcdcdf1 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:22.740821 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-64a886be-cda8-498a-bdf3-323fcbcdcdf1 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:22.741559 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-64a886be-cda8-498a-bdf3-323fcbcdcdf1 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:22.743651 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-64a886be-cda8-498a-bdf3-323fcbcdcdf1 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:22.744123 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-64a886be-cda8-498a-bdf3-323fcbcdcdf1 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:23.333168 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-11c4f32e-2c58-4678-a1dd-97b8f42ecf33 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:23.335326 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-11c4f32e-2c58-4678-a1dd-97b8f42ecf33 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: 70ffdc7b-f46e-4e13-b330-86109bc8ff60] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:23.357583 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-11c4f32e-2c58-4678-a1dd-97b8f42ecf33 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:23.360015 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-11c4f32e-2c58-4678-a1dd-97b8f42ecf33 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:23.364271 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-11c4f32e-2c58-4678-a1dd-97b8f42ecf33 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:23.365482 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-11c4f32e-2c58-4678-a1dd-97b8f42ecf33 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:23.367446 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-11c4f32e-2c58-4678-a1dd-97b8f42ecf33 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:23.369039 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-11c4f32e-2c58-4678-a1dd-97b8f42ecf33 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:23.403003 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:03:23.563136 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-64a886be-cda8-498a-bdf3-323fcbcdcdf1 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c3da1faaee46ca94d2a2543851f3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32a1b54e30415eb8f0e6df5e8b7be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:23.596043 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-64a886be-cda8-498a-bdf3-323fcbcdcdf1 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] 10.222.0.70 "GET /compute/v2.1/servers/0069592c-7187-4b4d-ab74-3a1a3bc3de80" status: 200 len: 1506 microversion: 2.1 time: 0.868480 Aug 27 03:03:23.599747 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2141/4312] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:22 2022] GET /compute/v2.1/servers/0069592c-7187-4b4d-ab74-3a1a3bc3de80 => generated 1506 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:03:23.668469 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-11c4f32e-2c58-4678-a1dd-97b8f42ecf33 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:23.679614 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-11c4f32e-2c58-4678-a1dd-97b8f42ecf33 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/70ffdc7b-f46e-4e13-b330-86109bc8ff60" status: 200 len: 1273 microversion: 2.1 time: 0.351868 Aug 27 03:03:23.686883 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2172/4313] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:23 2022] GET /compute/v2.1/servers/70ffdc7b-f46e-4e13-b330-86109bc8ff60 => generated 1273 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:03:24.621947 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5df1004a-bae5-47c0-9a7a-1896ab64c521 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:24.623546 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-5df1004a-bae5-47c0-9a7a-1896ab64c521 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] [instance: 0069592c-7187-4b4d-ab74-3a1a3bc3de80] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:24.644686 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5df1004a-bae5-47c0-9a7a-1896ab64c521 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:24.644686 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5df1004a-bae5-47c0-9a7a-1896ab64c521 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:24.644686 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5df1004a-bae5-47c0-9a7a-1896ab64c521 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:24.644686 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5df1004a-bae5-47c0-9a7a-1896ab64c521 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:24.644686 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5df1004a-bae5-47c0-9a7a-1896ab64c521 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:24.644686 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5df1004a-bae5-47c0-9a7a-1896ab64c521 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:24.656117 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d0c40e0f-77e4-43f0-b341-042c2703c4b7 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:03:24.658836 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d0c40e0f-77e4-43f0-b341-042c2703c4b7 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: f09bcfaf-4282-4434-8bb8-6dda7b337ae5] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:24.679336 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d0c40e0f-77e4-43f0-b341-042c2703c4b7 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:24.693488 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d0c40e0f-77e4-43f0-b341-042c2703c4b7 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:24.693488 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d0c40e0f-77e4-43f0-b341-042c2703c4b7 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:24.694275 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d0c40e0f-77e4-43f0-b341-042c2703c4b7 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:24.694740 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d0c40e0f-77e4-43f0-b341-042c2703c4b7 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:24.695169 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d0c40e0f-77e4-43f0-b341-042c2703c4b7 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:24.729851 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.objects.instance [None req-d0c40e0f-77e4-43f0-b341-042c2703c4b7 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lazy-loading 'flavor' on Instance uuid f09bcfaf-4282-4434-8bb8-6dda7b337ae5 {{(pid=134051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:03:24.845249 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d0c40e0f-77e4-43f0-b341-042c2703c4b7 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "POST /compute/v2.1/servers/f09bcfaf-4282-4434-8bb8-6dda7b337ae5/action" status: 200 len: 32 microversion: 2.1 time: 0.193676 Aug 27 03:03:24.846738 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2173/4314] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:03:24 2022] POST /compute/v2.1/servers/f09bcfaf-4282-4434-8bb8-6dda7b337ae5/action => generated 32 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:03:24.855174 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ef63afd6-67a4-4a14-8e41-cfd6268e7490 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:24.856105 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-ef63afd6-67a4-4a14-8e41-cfd6268e7490 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: 70ffdc7b-f46e-4e13-b330-86109bc8ff60] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:24.867510 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ef63afd6-67a4-4a14-8e41-cfd6268e7490 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:24.868097 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ef63afd6-67a4-4a14-8e41-cfd6268e7490 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:24.868694 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ef63afd6-67a4-4a14-8e41-cfd6268e7490 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:24.869841 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ef63afd6-67a4-4a14-8e41-cfd6268e7490 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:24.870348 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ef63afd6-67a4-4a14-8e41-cfd6268e7490 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:24.871190 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ef63afd6-67a4-4a14-8e41-cfd6268e7490 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:25.028104 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-ef63afd6-67a4-4a14-8e41-cfd6268e7490 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:25.037887 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ef63afd6-67a4-4a14-8e41-cfd6268e7490 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/70ffdc7b-f46e-4e13-b330-86109bc8ff60" status: 200 len: 1279 microversion: 2.1 time: 0.189465 Aug 27 03:03:25.038841 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2174/4315] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:24 2022] GET /compute/v2.1/servers/70ffdc7b-f46e-4e13-b330-86109bc8ff60 => generated 1279 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:03:25.057344 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-17081cde-c5a6-4ceb-9512-9a5ff5d0f1b4 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:25.058233 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-17081cde-c5a6-4ceb-9512-9a5ff5d0f1b4 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: f09bcfaf-4282-4434-8bb8-6dda7b337ae5] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:25.064846 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-17081cde-c5a6-4ceb-9512-9a5ff5d0f1b4 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:25.065589 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-17081cde-c5a6-4ceb-9512-9a5ff5d0f1b4 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:25.066216 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-17081cde-c5a6-4ceb-9512-9a5ff5d0f1b4 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:25.067098 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-17081cde-c5a6-4ceb-9512-9a5ff5d0f1b4 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:25.067695 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-17081cde-c5a6-4ceb-9512-9a5ff5d0f1b4 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:25.068349 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-17081cde-c5a6-4ceb-9512-9a5ff5d0f1b4 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:25.128083 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-5df1004a-bae5-47c0-9a7a-1896ab64c521 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c3da1faaee46ca94d2a2543851f3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32a1b54e30415eb8f0e6df5e8b7be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:25.138651 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-5df1004a-bae5-47c0-9a7a-1896ab64c521 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] 10.222.0.70 "GET /compute/v2.1/servers/0069592c-7187-4b4d-ab74-3a1a3bc3de80" status: 200 len: 1506 microversion: 2.1 time: 0.520751 Aug 27 03:03:25.139863 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2142/4316] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:24 2022] GET /compute/v2.1/servers/0069592c-7187-4b4d-ab74-3a1a3bc3de80 => generated 1506 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:03:25.718567 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-17081cde-c5a6-4ceb-9512-9a5ff5d0f1b4 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36697e722bef4a33ab158e9b2f87596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4ca527ba3b49539b528ec8950aef78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:25.736075 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-17081cde-c5a6-4ceb-9512-9a5ff5d0f1b4 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "GET /compute/v2.1/servers/f09bcfaf-4282-4434-8bb8-6dda7b337ae5" status: 200 len: 1521 microversion: 2.1 time: 0.682148 Aug 27 03:03:25.737889 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2175/4317] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:25 2022] GET /compute/v2.1/servers/f09bcfaf-4282-4434-8bb8-6dda7b337ae5 => generated 1521 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:03:26.060031 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a9acb68f-4d09-4633-901d-a3944d7f5103 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:26.060675 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a9acb68f-4d09-4633-901d-a3944d7f5103 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: 70ffdc7b-f46e-4e13-b330-86109bc8ff60] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:26.087459 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a9acb68f-4d09-4633-901d-a3944d7f5103 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:26.088290 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a9acb68f-4d09-4633-901d-a3944d7f5103 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:26.088978 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a9acb68f-4d09-4633-901d-a3944d7f5103 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:26.100454 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a9acb68f-4d09-4633-901d-a3944d7f5103 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:26.101219 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a9acb68f-4d09-4633-901d-a3944d7f5103 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:26.102553 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a9acb68f-4d09-4633-901d-a3944d7f5103 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:26.163147 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-dcd589fc-179a-46be-bc00-7d5b5f02b342 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:26.164367 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-dcd589fc-179a-46be-bc00-7d5b5f02b342 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] [instance: 0069592c-7187-4b4d-ab74-3a1a3bc3de80] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:26.177377 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dcd589fc-179a-46be-bc00-7d5b5f02b342 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:26.178128 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dcd589fc-179a-46be-bc00-7d5b5f02b342 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:26.181008 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dcd589fc-179a-46be-bc00-7d5b5f02b342 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:26.182945 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dcd589fc-179a-46be-bc00-7d5b5f02b342 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:26.183646 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dcd589fc-179a-46be-bc00-7d5b5f02b342 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:26.186538 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dcd589fc-179a-46be-bc00-7d5b5f02b342 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:26.656125 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-a9acb68f-4d09-4633-901d-a3944d7f5103 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:26.664523 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a9acb68f-4d09-4633-901d-a3944d7f5103 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/70ffdc7b-f46e-4e13-b330-86109bc8ff60" status: 200 len: 1321 microversion: 2.1 time: 0.608799 Aug 27 03:03:26.677449 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2143/4318] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:26 2022] GET /compute/v2.1/servers/70ffdc7b-f46e-4e13-b330-86109bc8ff60 => generated 1321 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:03:26.704942 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-dcd589fc-179a-46be-bc00-7d5b5f02b342 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c3da1faaee46ca94d2a2543851f3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32a1b54e30415eb8f0e6df5e8b7be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:26.731533 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-dcd589fc-179a-46be-bc00-7d5b5f02b342 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] 10.222.0.70 "GET /compute/v2.1/servers/0069592c-7187-4b4d-ab74-3a1a3bc3de80" status: 200 len: 1506 microversion: 2.1 time: 0.575053 Aug 27 03:03:26.746664 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2176/4319] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:26 2022] GET /compute/v2.1/servers/0069592c-7187-4b4d-ab74-3a1a3bc3de80 => generated 1506 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:03:26.758104 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-7acb997c-664c-42dc-881c-672e0cdc07f8 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:26.758816 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-7acb997c-664c-42dc-881c-672e0cdc07f8 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: f09bcfaf-4282-4434-8bb8-6dda7b337ae5] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:26.769885 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7acb997c-664c-42dc-881c-672e0cdc07f8 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:26.770403 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7acb997c-664c-42dc-881c-672e0cdc07f8 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:26.770882 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7acb997c-664c-42dc-881c-672e0cdc07f8 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:26.771596 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7acb997c-664c-42dc-881c-672e0cdc07f8 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:26.772062 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7acb997c-664c-42dc-881c-672e0cdc07f8 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:26.772742 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7acb997c-664c-42dc-881c-672e0cdc07f8 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:27.115393 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-7acb997c-664c-42dc-881c-672e0cdc07f8 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36697e722bef4a33ab158e9b2f87596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4ca527ba3b49539b528ec8950aef78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:27.129133 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-7acb997c-664c-42dc-881c-672e0cdc07f8 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "GET /compute/v2.1/servers/f09bcfaf-4282-4434-8bb8-6dda7b337ae5" status: 200 len: 1521 microversion: 2.1 time: 0.375100 Aug 27 03:03:27.130866 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2144/4320] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:26 2022] GET /compute/v2.1/servers/f09bcfaf-4282-4434-8bb8-6dda7b337ae5 => generated 1521 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:03:27.688980 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-607d92b0-e6e0-441d-ad13-4d3517f79912 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:27.689839 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-607d92b0-e6e0-441d-ad13-4d3517f79912 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: 70ffdc7b-f46e-4e13-b330-86109bc8ff60] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:27.698671 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-607d92b0-e6e0-441d-ad13-4d3517f79912 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:27.699441 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-607d92b0-e6e0-441d-ad13-4d3517f79912 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:27.700079 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-607d92b0-e6e0-441d-ad13-4d3517f79912 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:27.701035 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-607d92b0-e6e0-441d-ad13-4d3517f79912 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:27.701699 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-607d92b0-e6e0-441d-ad13-4d3517f79912 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:27.702286 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-607d92b0-e6e0-441d-ad13-4d3517f79912 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:27.756692 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-7557db5e-fed5-4d16-a619-5d0da0e5f6a5 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:27.757735 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-7557db5e-fed5-4d16-a619-5d0da0e5f6a5 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] [instance: 0069592c-7187-4b4d-ab74-3a1a3bc3de80] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:27.764713 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7557db5e-fed5-4d16-a619-5d0da0e5f6a5 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:27.765755 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7557db5e-fed5-4d16-a619-5d0da0e5f6a5 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:27.766436 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7557db5e-fed5-4d16-a619-5d0da0e5f6a5 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:27.767526 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7557db5e-fed5-4d16-a619-5d0da0e5f6a5 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:27.768221 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7557db5e-fed5-4d16-a619-5d0da0e5f6a5 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:27.769754 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7557db5e-fed5-4d16-a619-5d0da0e5f6a5 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:28.043539 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-607d92b0-e6e0-441d-ad13-4d3517f79912 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:28.053236 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-7557db5e-fed5-4d16-a619-5d0da0e5f6a5 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c3da1faaee46ca94d2a2543851f3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32a1b54e30415eb8f0e6df5e8b7be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:28.071063 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-607d92b0-e6e0-441d-ad13-4d3517f79912 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/70ffdc7b-f46e-4e13-b330-86109bc8ff60" status: 200 len: 1321 microversion: 2.1 time: 0.389447 Aug 27 03:03:28.074940 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-7557db5e-fed5-4d16-a619-5d0da0e5f6a5 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] 10.222.0.70 "GET /compute/v2.1/servers/0069592c-7187-4b4d-ab74-3a1a3bc3de80" status: 200 len: 1506 microversion: 2.1 time: 0.324040 Aug 27 03:03:28.076655 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2177/4321] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:27 2022] GET /compute/v2.1/servers/70ffdc7b-f46e-4e13-b330-86109bc8ff60 => generated 1321 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:03:28.078017 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2145/4322] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:27 2022] GET /compute/v2.1/servers/0069592c-7187-4b4d-ab74-3a1a3bc3de80 => generated 1506 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:03:28.141081 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-300078cc-2b82-4cea-84f0-2a85daa5fae1 req-00f3b02d-4f45-4c28-95ef-916ab713af81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70ffdc7b-f46e-4e13-b330-86109bc8ff60", "tag": "6117624d-8201-482a-afd7-2152c74a6dc6"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:03:28.152144 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c40ae819-58e8-427d-a380-67ca1caa98f9 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:28.152781 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-c40ae819-58e8-427d-a380-67ca1caa98f9 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: f09bcfaf-4282-4434-8bb8-6dda7b337ae5] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:28.175854 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c40ae819-58e8-427d-a380-67ca1caa98f9 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:28.176368 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c40ae819-58e8-427d-a380-67ca1caa98f9 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:28.176811 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c40ae819-58e8-427d-a380-67ca1caa98f9 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:28.177522 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c40ae819-58e8-427d-a380-67ca1caa98f9 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:28.177970 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c40ae819-58e8-427d-a380-67ca1caa98f9 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:28.178391 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c40ae819-58e8-427d-a380-67ca1caa98f9 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:28.184578 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-300078cc-2b82-4cea-84f0-2a85daa5fae1 req-00f3b02d-4f45-4c28-95ef-916ab713af81 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:28.185060 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-300078cc-2b82-4cea-84f0-2a85daa5fae1 req-00f3b02d-4f45-4c28-95ef-916ab713af81 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:28.187773 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-300078cc-2b82-4cea-84f0-2a85daa5fae1 req-00f3b02d-4f45-4c28-95ef-916ab713af81 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:28.202468 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-300078cc-2b82-4cea-84f0-2a85daa5fae1 req-00f3b02d-4f45-4c28-95ef-916ab713af81 service nova] Creating event network-changed:6117624d-8201-482a-afd7-2152c74a6dc6 for instance 70ffdc7b-f46e-4e13-b330-86109bc8ff60 on n-h2-852278-4 Aug 27 03:03:28.210208 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-300078cc-2b82-4cea-84f0-2a85daa5fae1 req-00f3b02d-4f45-4c28-95ef-916ab713af81 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072452 Aug 27 03:03:28.211787 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2178/4323] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:03:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:03:28.473062 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-c40ae819-58e8-427d-a380-67ca1caa98f9 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36697e722bef4a33ab158e9b2f87596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4ca527ba3b49539b528ec8950aef78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:28.481841 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c40ae819-58e8-427d-a380-67ca1caa98f9 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "GET /compute/v2.1/servers/f09bcfaf-4282-4434-8bb8-6dda7b337ae5" status: 200 len: 1521 microversion: 2.1 time: 0.334179 Aug 27 03:03:28.482569 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2146/4324] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:28 2022] GET /compute/v2.1/servers/f09bcfaf-4282-4434-8bb8-6dda7b337ae5 => generated 1521 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:03:29.098392 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-fcbec074-18a4-4c07-b98d-6fdce91931b1 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:29.100492 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-fcbec074-18a4-4c07-b98d-6fdce91931b1 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: 70ffdc7b-f46e-4e13-b330-86109bc8ff60] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:29.102095 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-91fce975-0cd8-4f8a-8920-3fb60fda9f0d tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:29.102911 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-91fce975-0cd8-4f8a-8920-3fb60fda9f0d tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] [instance: 0069592c-7187-4b4d-ab74-3a1a3bc3de80] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:29.109456 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fcbec074-18a4-4c07-b98d-6fdce91931b1 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:29.109948 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fcbec074-18a4-4c07-b98d-6fdce91931b1 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:29.110536 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-91fce975-0cd8-4f8a-8920-3fb60fda9f0d tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:29.111146 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-91fce975-0cd8-4f8a-8920-3fb60fda9f0d tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:29.111275 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fcbec074-18a4-4c07-b98d-6fdce91931b1 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:29.111890 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fcbec074-18a4-4c07-b98d-6fdce91931b1 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:29.112111 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-91fce975-0cd8-4f8a-8920-3fb60fda9f0d tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:29.112383 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fcbec074-18a4-4c07-b98d-6fdce91931b1 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:29.112821 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fcbec074-18a4-4c07-b98d-6fdce91931b1 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:29.113382 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-91fce975-0cd8-4f8a-8920-3fb60fda9f0d tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:29.113981 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-91fce975-0cd8-4f8a-8920-3fb60fda9f0d tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:29.114555 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-91fce975-0cd8-4f8a-8920-3fb60fda9f0d tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:29.443028 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-91fce975-0cd8-4f8a-8920-3fb60fda9f0d tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c3da1faaee46ca94d2a2543851f3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32a1b54e30415eb8f0e6df5e8b7be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:29.450262 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-fcbec074-18a4-4c07-b98d-6fdce91931b1 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:29.459236 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-fcbec074-18a4-4c07-b98d-6fdce91931b1 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/70ffdc7b-f46e-4e13-b330-86109bc8ff60" status: 200 len: 1321 microversion: 2.1 time: 0.366599 Aug 27 03:03:29.475638 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-91fce975-0cd8-4f8a-8920-3fb60fda9f0d tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] 10.222.0.70 "GET /compute/v2.1/servers/0069592c-7187-4b4d-ab74-3a1a3bc3de80" status: 200 len: 1506 microversion: 2.1 time: 0.377300 Aug 27 03:03:29.476247 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2147/4325] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:29 2022] GET /compute/v2.1/servers/0069592c-7187-4b4d-ab74-3a1a3bc3de80 => generated 1506 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:03:29.476703 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2179/4326] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:29 2022] GET /compute/v2.1/servers/70ffdc7b-f46e-4e13-b330-86109bc8ff60 => generated 1321 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:03:29.503121 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-718bd7a3-e050-401f-a821-660a7ef327a9 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:29.503941 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-718bd7a3-e050-401f-a821-660a7ef327a9 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: f09bcfaf-4282-4434-8bb8-6dda7b337ae5] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:29.510166 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-718bd7a3-e050-401f-a821-660a7ef327a9 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:29.510790 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-718bd7a3-e050-401f-a821-660a7ef327a9 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:29.511330 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-718bd7a3-e050-401f-a821-660a7ef327a9 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:29.512303 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-718bd7a3-e050-401f-a821-660a7ef327a9 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:29.512857 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-718bd7a3-e050-401f-a821-660a7ef327a9 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:29.513347 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-718bd7a3-e050-401f-a821-660a7ef327a9 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:29.793534 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-718bd7a3-e050-401f-a821-660a7ef327a9 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36697e722bef4a33ab158e9b2f87596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4ca527ba3b49539b528ec8950aef78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:29.806525 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-718bd7a3-e050-401f-a821-660a7ef327a9 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "GET /compute/v2.1/servers/f09bcfaf-4282-4434-8bb8-6dda7b337ae5" status: 200 len: 1521 microversion: 2.1 time: 0.307253 Aug 27 03:03:29.807135 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2180/4327] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:29 2022] GET /compute/v2.1/servers/f09bcfaf-4282-4434-8bb8-6dda7b337ae5 => generated 1521 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:03:30.480246 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ffc90b4d-f154-41f6-9ddd-27fc5868cb92 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:30.480951 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-ffc90b4d-f154-41f6-9ddd-27fc5868cb92 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: 70ffdc7b-f46e-4e13-b330-86109bc8ff60] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:30.488792 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ffc90b4d-f154-41f6-9ddd-27fc5868cb92 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:30.489160 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ffc90b4d-f154-41f6-9ddd-27fc5868cb92 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:30.489782 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ffc90b4d-f154-41f6-9ddd-27fc5868cb92 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:30.490640 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ffc90b4d-f154-41f6-9ddd-27fc5868cb92 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:30.491261 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ffc90b4d-f154-41f6-9ddd-27fc5868cb92 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:30.496365 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-55f21387-2e34-466c-8846-eab1fa8ec25a tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:30.496949 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-55f21387-2e34-466c-8846-eab1fa8ec25a tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] [instance: 0069592c-7187-4b4d-ab74-3a1a3bc3de80] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:30.501578 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ffc90b4d-f154-41f6-9ddd-27fc5868cb92 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:30.509626 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-55f21387-2e34-466c-8846-eab1fa8ec25a tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:30.510419 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-55f21387-2e34-466c-8846-eab1fa8ec25a tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:30.511014 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-55f21387-2e34-466c-8846-eab1fa8ec25a tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:30.511886 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-55f21387-2e34-466c-8846-eab1fa8ec25a tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:30.512525 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-55f21387-2e34-466c-8846-eab1fa8ec25a tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:30.513105 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-55f21387-2e34-466c-8846-eab1fa8ec25a tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:30.822933 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:03:30.863913 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-55f21387-2e34-466c-8846-eab1fa8ec25a tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c3da1faaee46ca94d2a2543851f3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32a1b54e30415eb8f0e6df5e8b7be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:30.872413 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-55f21387-2e34-466c-8846-eab1fa8ec25a tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] 10.222.0.70 "GET /compute/v2.1/servers/0069592c-7187-4b4d-ab74-3a1a3bc3de80" status: 200 len: 1506 microversion: 2.1 time: 0.379830 Aug 27 03:03:30.873839 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2181/4328] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:30 2022] GET /compute/v2.1/servers/0069592c-7187-4b4d-ab74-3a1a3bc3de80 => generated 1506 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:03:30.878754 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a3932164-86da-4507-a6c9-0aea9e71ec4c tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:30.879571 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-a3932164-86da-4507-a6c9-0aea9e71ec4c tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: f09bcfaf-4282-4434-8bb8-6dda7b337ae5] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:30.885907 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a3932164-86da-4507-a6c9-0aea9e71ec4c tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:30.886546 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a3932164-86da-4507-a6c9-0aea9e71ec4c tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:30.887054 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a3932164-86da-4507-a6c9-0aea9e71ec4c tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:30.887827 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a3932164-86da-4507-a6c9-0aea9e71ec4c tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:30.888543 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a3932164-86da-4507-a6c9-0aea9e71ec4c tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:30.889038 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a3932164-86da-4507-a6c9-0aea9e71ec4c tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:30.902301 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-ffc90b4d-f154-41f6-9ddd-27fc5868cb92 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:30.936187 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ffc90b4d-f154-41f6-9ddd-27fc5868cb92 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/70ffdc7b-f46e-4e13-b330-86109bc8ff60" status: 200 len: 1321 microversion: 2.1 time: 0.460236 Aug 27 03:03:30.949828 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2148/4329] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:30 2022] GET /compute/v2.1/servers/70ffdc7b-f46e-4e13-b330-86109bc8ff60 => generated 1321 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:03:31.083428 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-a3932164-86da-4507-a6c9-0aea9e71ec4c tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36697e722bef4a33ab158e9b2f87596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4ca527ba3b49539b528ec8950aef78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:31.097720 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a3932164-86da-4507-a6c9-0aea9e71ec4c tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "GET /compute/v2.1/servers/f09bcfaf-4282-4434-8bb8-6dda7b337ae5" status: 200 len: 1521 microversion: 2.1 time: 0.222596 Aug 27 03:03:31.098401 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2182/4330] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:30 2022] GET /compute/v2.1/servers/f09bcfaf-4282-4434-8bb8-6dda7b337ae5 => generated 1521 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:03:31.893725 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-92676453-6e13-46aa-a3b4-914032f14202 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:31.894376 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-92676453-6e13-46aa-a3b4-914032f14202 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] [instance: 0069592c-7187-4b4d-ab74-3a1a3bc3de80] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:31.901439 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-92676453-6e13-46aa-a3b4-914032f14202 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:31.901918 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-92676453-6e13-46aa-a3b4-914032f14202 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:31.902344 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-92676453-6e13-46aa-a3b4-914032f14202 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:31.903032 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-92676453-6e13-46aa-a3b4-914032f14202 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:31.903473 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-92676453-6e13-46aa-a3b4-914032f14202 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:31.903945 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-92676453-6e13-46aa-a3b4-914032f14202 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:31.960661 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-6e570ac4-7216-412e-9fac-77041811ae5d tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:31.961913 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-6e570ac4-7216-412e-9fac-77041811ae5d tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: 70ffdc7b-f46e-4e13-b330-86109bc8ff60] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:31.971269 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6e570ac4-7216-412e-9fac-77041811ae5d tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:31.971758 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6e570ac4-7216-412e-9fac-77041811ae5d tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:31.972187 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6e570ac4-7216-412e-9fac-77041811ae5d tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:31.972931 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6e570ac4-7216-412e-9fac-77041811ae5d tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:31.973374 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6e570ac4-7216-412e-9fac-77041811ae5d tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:31.973849 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6e570ac4-7216-412e-9fac-77041811ae5d tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:32.027108 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:03:32.048874 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=8 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:03:32.275759 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-92676453-6e13-46aa-a3b4-914032f14202 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c3da1faaee46ca94d2a2543851f3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32a1b54e30415eb8f0e6df5e8b7be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:32.280962 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-6e570ac4-7216-412e-9fac-77041811ae5d tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:32.292890 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-92676453-6e13-46aa-a3b4-914032f14202 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] 10.222.0.70 "GET /compute/v2.1/servers/0069592c-7187-4b4d-ab74-3a1a3bc3de80" status: 200 len: 1506 microversion: 2.1 time: 0.402872 Aug 27 03:03:32.293390 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2149/4331] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:31 2022] GET /compute/v2.1/servers/0069592c-7187-4b4d-ab74-3a1a3bc3de80 => generated 1506 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:03:32.294961 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=8 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:03:32.298425 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-6e570ac4-7216-412e-9fac-77041811ae5d tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/70ffdc7b-f46e-4e13-b330-86109bc8ff60" status: 200 len: 1321 microversion: 2.1 time: 0.343793 Aug 27 03:03:32.299236 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2183/4332] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:31 2022] GET /compute/v2.1/servers/70ffdc7b-f46e-4e13-b330-86109bc8ff60 => generated 1321 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:03:32.302964 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-dd1fba86-9a12-4ad2-8885-ab6082cc74be tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:32.303732 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-dd1fba86-9a12-4ad2-8885-ab6082cc74be tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: f09bcfaf-4282-4434-8bb8-6dda7b337ae5] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:32.312146 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dd1fba86-9a12-4ad2-8885-ab6082cc74be tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:32.312890 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dd1fba86-9a12-4ad2-8885-ab6082cc74be tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:32.313417 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dd1fba86-9a12-4ad2-8885-ab6082cc74be tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:32.314399 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dd1fba86-9a12-4ad2-8885-ab6082cc74be tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:32.315073 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dd1fba86-9a12-4ad2-8885-ab6082cc74be tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:32.315566 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dd1fba86-9a12-4ad2-8885-ab6082cc74be tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:32.520213 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-dd1fba86-9a12-4ad2-8885-ab6082cc74be tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36697e722bef4a33ab158e9b2f87596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4ca527ba3b49539b528ec8950aef78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:32.528699 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-dd1fba86-9a12-4ad2-8885-ab6082cc74be tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "GET /compute/v2.1/servers/f09bcfaf-4282-4434-8bb8-6dda7b337ae5" status: 200 len: 1521 microversion: 2.1 time: 0.234295 Aug 27 03:03:32.529438 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2150/4333] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:32 2022] GET /compute/v2.1/servers/f09bcfaf-4282-4434-8bb8-6dda7b337ae5 => generated 1521 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:03:33.319204 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0fcfe6bb-703f-4762-a736-5627f8b41631 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:33.320807 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3055c441-6a15-47e4-91a0-f966815e5401 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:33.321260 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-3055c441-6a15-47e4-91a0-f966815e5401 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: 70ffdc7b-f46e-4e13-b330-86109bc8ff60] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:33.322962 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-0fcfe6bb-703f-4762-a736-5627f8b41631 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] [instance: 0069592c-7187-4b4d-ab74-3a1a3bc3de80] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:33.333475 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3055c441-6a15-47e4-91a0-f966815e5401 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:33.333980 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3055c441-6a15-47e4-91a0-f966815e5401 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:33.334436 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3055c441-6a15-47e4-91a0-f966815e5401 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:33.336066 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0fcfe6bb-703f-4762-a736-5627f8b41631 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:33.336428 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3055c441-6a15-47e4-91a0-f966815e5401 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:33.338416 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0fcfe6bb-703f-4762-a736-5627f8b41631 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:33.338589 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3055c441-6a15-47e4-91a0-f966815e5401 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:33.338873 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3055c441-6a15-47e4-91a0-f966815e5401 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:33.340025 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0fcfe6bb-703f-4762-a736-5627f8b41631 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:33.341275 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0fcfe6bb-703f-4762-a736-5627f8b41631 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:33.342301 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0fcfe6bb-703f-4762-a736-5627f8b41631 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:33.344029 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0fcfe6bb-703f-4762-a736-5627f8b41631 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:33.892216 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-0fcfe6bb-703f-4762-a736-5627f8b41631 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c3da1faaee46ca94d2a2543851f3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32a1b54e30415eb8f0e6df5e8b7be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:33.904198 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-3055c441-6a15-47e4-91a0-f966815e5401 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:33.905250 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-0fcfe6bb-703f-4762-a736-5627f8b41631 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] 10.222.0.70 "GET /compute/v2.1/servers/0069592c-7187-4b4d-ab74-3a1a3bc3de80" status: 200 len: 1506 microversion: 2.1 time: 0.592608 Aug 27 03:03:33.916635 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2184/4334] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:33 2022] GET /compute/v2.1/servers/0069592c-7187-4b4d-ab74-3a1a3bc3de80 => generated 1506 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:03:33.916635 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-010fb5fd-d077-42d3-87e5-c319e4a5653a tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:33.916635 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-010fb5fd-d077-42d3-87e5-c319e4a5653a tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: f09bcfaf-4282-4434-8bb8-6dda7b337ae5] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:33.917035 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-3055c441-6a15-47e4-91a0-f966815e5401 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/70ffdc7b-f46e-4e13-b330-86109bc8ff60" status: 200 len: 1321 microversion: 2.1 time: 0.598970 Aug 27 03:03:33.926037 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-010fb5fd-d077-42d3-87e5-c319e4a5653a tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:33.926714 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-010fb5fd-d077-42d3-87e5-c319e4a5653a tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:33.927315 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-010fb5fd-d077-42d3-87e5-c319e4a5653a tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:33.928175 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-010fb5fd-d077-42d3-87e5-c319e4a5653a tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:33.928809 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-010fb5fd-d077-42d3-87e5-c319e4a5653a tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:33.930773 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2151/4335] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:33 2022] GET /compute/v2.1/servers/70ffdc7b-f46e-4e13-b330-86109bc8ff60 => generated 1321 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:03:33.932933 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-010fb5fd-d077-42d3-87e5-c319e4a5653a tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:34.193726 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-010fb5fd-d077-42d3-87e5-c319e4a5653a tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36697e722bef4a33ab158e9b2f87596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4ca527ba3b49539b528ec8950aef78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:34.201618 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-010fb5fd-d077-42d3-87e5-c319e4a5653a tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "GET /compute/v2.1/servers/f09bcfaf-4282-4434-8bb8-6dda7b337ae5" status: 200 len: 1521 microversion: 2.1 time: 0.294811 Aug 27 03:03:34.202199 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2185/4336] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:33 2022] GET /compute/v2.1/servers/f09bcfaf-4282-4434-8bb8-6dda7b337ae5 => generated 1521 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:03:34.770203 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-a175cadb-8dfe-451f-9178-1f4eec3a323d req-8b320630-7f5b-4a1e-ae1e-65ac70de456f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70ffdc7b-f46e-4e13-b330-86109bc8ff60", "name": "network-vif-plugged", "status": "completed", "tag": "6117624d-8201-482a-afd7-2152c74a6dc6"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:03:34.783118 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-a175cadb-8dfe-451f-9178-1f4eec3a323d req-8b320630-7f5b-4a1e-ae1e-65ac70de456f service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:34.784134 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-a175cadb-8dfe-451f-9178-1f4eec3a323d req-8b320630-7f5b-4a1e-ae1e-65ac70de456f service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:34.784898 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-a175cadb-8dfe-451f-9178-1f4eec3a323d req-8b320630-7f5b-4a1e-ae1e-65ac70de456f service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:34.798651 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-a175cadb-8dfe-451f-9178-1f4eec3a323d req-8b320630-7f5b-4a1e-ae1e-65ac70de456f service nova] Creating event network-vif-plugged:6117624d-8201-482a-afd7-2152c74a6dc6 for instance 70ffdc7b-f46e-4e13-b330-86109bc8ff60 on n-h2-852278-4 Aug 27 03:03:34.803803 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-a175cadb-8dfe-451f-9178-1f4eec3a323d req-8b320630-7f5b-4a1e-ae1e-65ac70de456f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037660 Aug 27 03:03:34.805617 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2152/4337] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:03:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:03:34.947454 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-97fd016a-86a4-41f7-ab2a-b69531ee36f1 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:34.949660 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5c055af7-8fb3-42ec-aa5b-f63b5263bebe tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:34.950428 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-97fd016a-86a4-41f7-ab2a-b69531ee36f1 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] [instance: 0069592c-7187-4b4d-ab74-3a1a3bc3de80] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:34.955679 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-5c055af7-8fb3-42ec-aa5b-f63b5263bebe tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: 70ffdc7b-f46e-4e13-b330-86109bc8ff60] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:34.970288 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5c055af7-8fb3-42ec-aa5b-f63b5263bebe tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:34.970783 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5c055af7-8fb3-42ec-aa5b-f63b5263bebe tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:34.973327 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-97fd016a-86a4-41f7-ab2a-b69531ee36f1 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:34.973823 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-97fd016a-86a4-41f7-ab2a-b69531ee36f1 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:34.974258 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-97fd016a-86a4-41f7-ab2a-b69531ee36f1 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:34.974976 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-97fd016a-86a4-41f7-ab2a-b69531ee36f1 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:34.975428 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-97fd016a-86a4-41f7-ab2a-b69531ee36f1 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:34.975849 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-97fd016a-86a4-41f7-ab2a-b69531ee36f1 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:34.983158 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5c055af7-8fb3-42ec-aa5b-f63b5263bebe tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:34.983685 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5c055af7-8fb3-42ec-aa5b-f63b5263bebe tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:34.984777 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5c055af7-8fb3-42ec-aa5b-f63b5263bebe tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:34.985238 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5c055af7-8fb3-42ec-aa5b-f63b5263bebe tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:35.314774 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-97fd016a-86a4-41f7-ab2a-b69531ee36f1 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c3da1faaee46ca94d2a2543851f3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32a1b54e30415eb8f0e6df5e8b7be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:35.328161 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-97fd016a-86a4-41f7-ab2a-b69531ee36f1 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] 10.222.0.70 "GET /compute/v2.1/servers/0069592c-7187-4b4d-ab74-3a1a3bc3de80" status: 200 len: 1506 microversion: 2.1 time: 0.400666 Aug 27 03:03:35.330105 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2186/4338] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:34 2022] GET /compute/v2.1/servers/0069592c-7187-4b4d-ab74-3a1a3bc3de80 => generated 1506 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:03:35.336238 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e8b5f0ff-1ce8-411d-ab5c-52f5e65746af tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:35.337064 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-e8b5f0ff-1ce8-411d-ab5c-52f5e65746af tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: f09bcfaf-4282-4434-8bb8-6dda7b337ae5] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:35.344481 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e8b5f0ff-1ce8-411d-ab5c-52f5e65746af tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:35.345209 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e8b5f0ff-1ce8-411d-ab5c-52f5e65746af tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:35.345641 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e8b5f0ff-1ce8-411d-ab5c-52f5e65746af tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:35.346528 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e8b5f0ff-1ce8-411d-ab5c-52f5e65746af tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:35.346973 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e8b5f0ff-1ce8-411d-ab5c-52f5e65746af tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:35.347391 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e8b5f0ff-1ce8-411d-ab5c-52f5e65746af tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:35.400207 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-5c055af7-8fb3-42ec-aa5b-f63b5263bebe tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:35.410626 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-5c055af7-8fb3-42ec-aa5b-f63b5263bebe tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/70ffdc7b-f46e-4e13-b330-86109bc8ff60" status: 200 len: 1321 microversion: 2.1 time: 0.473945 Aug 27 03:03:35.412230 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2153/4339] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:34 2022] GET /compute/v2.1/servers/70ffdc7b-f46e-4e13-b330-86109bc8ff60 => generated 1321 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:03:35.647029 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e8b5f0ff-1ce8-411d-ab5c-52f5e65746af tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36697e722bef4a33ab158e9b2f87596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4ca527ba3b49539b528ec8950aef78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:35.649750 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:03:35.658120 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e8b5f0ff-1ce8-411d-ab5c-52f5e65746af tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "GET /compute/v2.1/servers/f09bcfaf-4282-4434-8bb8-6dda7b337ae5" status: 200 len: 1521 microversion: 2.1 time: 0.326308 Aug 27 03:03:35.659150 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2187/4340] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:35 2022] GET /compute/v2.1/servers/f09bcfaf-4282-4434-8bb8-6dda7b337ae5 => generated 1521 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:03:36.349054 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f0bca214-3e26-4290-9733-d6d0c8f53f7e tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:36.350378 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-f0bca214-3e26-4290-9733-d6d0c8f53f7e tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] [instance: 0069592c-7187-4b4d-ab74-3a1a3bc3de80] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:36.357587 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f0bca214-3e26-4290-9733-d6d0c8f53f7e tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:36.358123 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f0bca214-3e26-4290-9733-d6d0c8f53f7e tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:36.358802 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f0bca214-3e26-4290-9733-d6d0c8f53f7e tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:36.359488 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f0bca214-3e26-4290-9733-d6d0c8f53f7e tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:36.360129 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f0bca214-3e26-4290-9733-d6d0c8f53f7e tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:36.360930 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f0bca214-3e26-4290-9733-d6d0c8f53f7e tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:36.434861 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-89dad522-5810-4f08-bed6-b84c199d3c6c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:36.435604 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-89dad522-5810-4f08-bed6-b84c199d3c6c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: 70ffdc7b-f46e-4e13-b330-86109bc8ff60] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:36.445732 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-89dad522-5810-4f08-bed6-b84c199d3c6c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:36.446368 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-89dad522-5810-4f08-bed6-b84c199d3c6c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:36.447635 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-89dad522-5810-4f08-bed6-b84c199d3c6c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:36.448359 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-89dad522-5810-4f08-bed6-b84c199d3c6c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:36.448804 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-89dad522-5810-4f08-bed6-b84c199d3c6c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:36.449385 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-89dad522-5810-4f08-bed6-b84c199d3c6c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:36.686541 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-f0bca214-3e26-4290-9733-d6d0c8f53f7e tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c3da1faaee46ca94d2a2543851f3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32a1b54e30415eb8f0e6df5e8b7be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:36.721880 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f0bca214-3e26-4290-9733-d6d0c8f53f7e tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] 10.222.0.70 "GET /compute/v2.1/servers/0069592c-7187-4b4d-ab74-3a1a3bc3de80" status: 200 len: 1506 microversion: 2.1 time: 0.376716 Aug 27 03:03:36.727792 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2154/4341] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:36 2022] GET /compute/v2.1/servers/0069592c-7187-4b4d-ab74-3a1a3bc3de80 => generated 1506 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:03:36.736680 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-89dad522-5810-4f08-bed6-b84c199d3c6c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:36.737713 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-93e62c11-8bc9-4b96-bfa0-a3b9158af28b tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:36.739169 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-93e62c11-8bc9-4b96-bfa0-a3b9158af28b tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: f09bcfaf-4282-4434-8bb8-6dda7b337ae5] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:36.751551 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-89dad522-5810-4f08-bed6-b84c199d3c6c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/70ffdc7b-f46e-4e13-b330-86109bc8ff60" status: 200 len: 1321 microversion: 2.1 time: 0.320439 Aug 27 03:03:36.754498 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-93e62c11-8bc9-4b96-bfa0-a3b9158af28b tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:36.756918 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-93e62c11-8bc9-4b96-bfa0-a3b9158af28b tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:36.758553 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-93e62c11-8bc9-4b96-bfa0-a3b9158af28b tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:36.759502 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-93e62c11-8bc9-4b96-bfa0-a3b9158af28b tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:36.760241 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-93e62c11-8bc9-4b96-bfa0-a3b9158af28b tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:36.760873 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-93e62c11-8bc9-4b96-bfa0-a3b9158af28b tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:36.764476 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2188/4342] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:36 2022] GET /compute/v2.1/servers/70ffdc7b-f46e-4e13-b330-86109bc8ff60 => generated 1321 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:03:37.031989 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-93e62c11-8bc9-4b96-bfa0-a3b9158af28b tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36697e722bef4a33ab158e9b2f87596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4ca527ba3b49539b528ec8950aef78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:37.048611 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-93e62c11-8bc9-4b96-bfa0-a3b9158af28b tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "GET /compute/v2.1/servers/f09bcfaf-4282-4434-8bb8-6dda7b337ae5" status: 200 len: 1521 microversion: 2.1 time: 0.319064 Aug 27 03:03:37.050320 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2155/4343] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:36 2022] GET /compute/v2.1/servers/f09bcfaf-4282-4434-8bb8-6dda7b337ae5 => generated 1521 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:03:37.746627 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-497bde69-894a-4237-9360-95005ff45bff tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:37.747250 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-497bde69-894a-4237-9360-95005ff45bff tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] [instance: 0069592c-7187-4b4d-ab74-3a1a3bc3de80] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:37.754450 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-497bde69-894a-4237-9360-95005ff45bff tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:37.755337 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-497bde69-894a-4237-9360-95005ff45bff tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:37.756060 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-497bde69-894a-4237-9360-95005ff45bff tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:37.757386 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-497bde69-894a-4237-9360-95005ff45bff tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:37.758287 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-497bde69-894a-4237-9360-95005ff45bff tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:37.758913 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-497bde69-894a-4237-9360-95005ff45bff tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:37.779445 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ef8ec275-88d6-46b1-a04e-8e2c10b11a77 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:37.780142 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-ef8ec275-88d6-46b1-a04e-8e2c10b11a77 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: 70ffdc7b-f46e-4e13-b330-86109bc8ff60] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:37.795980 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ef8ec275-88d6-46b1-a04e-8e2c10b11a77 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:37.804229 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ef8ec275-88d6-46b1-a04e-8e2c10b11a77 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:37.818061 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ef8ec275-88d6-46b1-a04e-8e2c10b11a77 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:37.819078 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ef8ec275-88d6-46b1-a04e-8e2c10b11a77 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:37.821194 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ef8ec275-88d6-46b1-a04e-8e2c10b11a77 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:37.824824 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ef8ec275-88d6-46b1-a04e-8e2c10b11a77 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:38.355824 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-ef8ec275-88d6-46b1-a04e-8e2c10b11a77 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:38.364592 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ef8ec275-88d6-46b1-a04e-8e2c10b11a77 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/70ffdc7b-f46e-4e13-b330-86109bc8ff60" status: 200 len: 1501 microversion: 2.1 time: 0.592960 Aug 27 03:03:38.365807 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2156/4344] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:37 2022] GET /compute/v2.1/servers/70ffdc7b-f46e-4e13-b330-86109bc8ff60 => generated 1501 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:03:38.370978 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9eb22de2-1cc1-45ca-bee2-6fda3a8ae87d tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:38.371797 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-9eb22de2-1cc1-45ca-bee2-6fda3a8ae87d tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: f09bcfaf-4282-4434-8bb8-6dda7b337ae5] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:38.379873 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9eb22de2-1cc1-45ca-bee2-6fda3a8ae87d tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:38.380859 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9eb22de2-1cc1-45ca-bee2-6fda3a8ae87d tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:38.381609 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9eb22de2-1cc1-45ca-bee2-6fda3a8ae87d tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:38.382896 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9eb22de2-1cc1-45ca-bee2-6fda3a8ae87d tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:38.383872 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9eb22de2-1cc1-45ca-bee2-6fda3a8ae87d tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:38.385100 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9eb22de2-1cc1-45ca-bee2-6fda3a8ae87d tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:38.533451 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-497bde69-894a-4237-9360-95005ff45bff tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c3da1faaee46ca94d2a2543851f3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32a1b54e30415eb8f0e6df5e8b7be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:38.551764 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-497bde69-894a-4237-9360-95005ff45bff tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] 10.222.0.70 "GET /compute/v2.1/servers/0069592c-7187-4b4d-ab74-3a1a3bc3de80" status: 200 len: 1506 microversion: 2.1 time: 0.808191 Aug 27 03:03:38.565671 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2189/4345] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:37 2022] GET /compute/v2.1/servers/0069592c-7187-4b4d-ab74-3a1a3bc3de80 => generated 1506 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:03:38.567578 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b67fde03-51d5-4a7b-979d-83a809624963 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:38.569208 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b67fde03-51d5-4a7b-979d-83a809624963 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: 70ffdc7b-f46e-4e13-b330-86109bc8ff60] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:38.583573 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b67fde03-51d5-4a7b-979d-83a809624963 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:38.588758 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b67fde03-51d5-4a7b-979d-83a809624963 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:38.589410 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b67fde03-51d5-4a7b-979d-83a809624963 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:38.590319 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b67fde03-51d5-4a7b-979d-83a809624963 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:38.590885 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b67fde03-51d5-4a7b-979d-83a809624963 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:38.591418 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b67fde03-51d5-4a7b-979d-83a809624963 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:38.797137 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-9eb22de2-1cc1-45ca-bee2-6fda3a8ae87d tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36697e722bef4a33ab158e9b2f87596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4ca527ba3b49539b528ec8950aef78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:38.813289 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=100 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:03:38.820969 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9eb22de2-1cc1-45ca-bee2-6fda3a8ae87d tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "GET /compute/v2.1/servers/f09bcfaf-4282-4434-8bb8-6dda7b337ae5" status: 200 len: 1521 microversion: 2.1 time: 0.453861 Aug 27 03:03:38.822859 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2157/4346] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:38 2022] GET /compute/v2.1/servers/f09bcfaf-4282-4434-8bb8-6dda7b337ae5 => generated 1521 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:03:38.901563 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-b67fde03-51d5-4a7b-979d-83a809624963 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:38.937100 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b67fde03-51d5-4a7b-979d-83a809624963 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/70ffdc7b-f46e-4e13-b330-86109bc8ff60" status: 200 len: 1501 microversion: 2.1 time: 0.378488 Aug 27 03:03:38.952703 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2190/4347] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:38 2022] GET /compute/v2.1/servers/70ffdc7b-f46e-4e13-b330-86109bc8ff60 => generated 1501 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:03:38.960998 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-615dcd5c-82f9-47f0-96fc-259a18e688a4 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:38.961498 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-615dcd5c-82f9-47f0-96fc-259a18e688a4 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: 70ffdc7b-f46e-4e13-b330-86109bc8ff60] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:38.972374 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-615dcd5c-82f9-47f0-96fc-259a18e688a4 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:38.973128 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-615dcd5c-82f9-47f0-96fc-259a18e688a4 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:38.973786 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-615dcd5c-82f9-47f0-96fc-259a18e688a4 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:38.974815 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-615dcd5c-82f9-47f0-96fc-259a18e688a4 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:38.975826 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-615dcd5c-82f9-47f0-96fc-259a18e688a4 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:38.976456 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-615dcd5c-82f9-47f0-96fc-259a18e688a4 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:39.056405 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-615dcd5c-82f9-47f0-96fc-259a18e688a4 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: 70ffdc7b-f46e-4e13-b330-86109bc8ff60] Going to try to terminate instance {{(pid=134052) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:03:39.246504 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-615dcd5c-82f9-47f0-96fc-259a18e688a4 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "DELETE /compute/v2.1/servers/70ffdc7b-f46e-4e13-b330-86109bc8ff60" status: 204 len: 0 microversion: 2.1 time: 0.292235 Aug 27 03:03:39.247430 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2158/4348] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 03:03:38 2022] DELETE /compute/v2.1/servers/70ffdc7b-f46e-4e13-b330-86109bc8ff60 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:03:39.263037 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-19de8b76-73a0-4c7f-8e3f-1493b3ef07cb tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:39.263667 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-19de8b76-73a0-4c7f-8e3f-1493b3ef07cb tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: 70ffdc7b-f46e-4e13-b330-86109bc8ff60] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:39.274486 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-19de8b76-73a0-4c7f-8e3f-1493b3ef07cb tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:39.274998 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-19de8b76-73a0-4c7f-8e3f-1493b3ef07cb tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:39.275437 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-19de8b76-73a0-4c7f-8e3f-1493b3ef07cb tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:39.276165 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-19de8b76-73a0-4c7f-8e3f-1493b3ef07cb tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:39.276654 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-19de8b76-73a0-4c7f-8e3f-1493b3ef07cb tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:39.277148 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-19de8b76-73a0-4c7f-8e3f-1493b3ef07cb tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:39.585356 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9d276a51-01f8-4bdd-84fe-a931eec4f666 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:39.588162 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-9d276a51-01f8-4bdd-84fe-a931eec4f666 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] [instance: 0069592c-7187-4b4d-ab74-3a1a3bc3de80] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:39.614684 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9d276a51-01f8-4bdd-84fe-a931eec4f666 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:39.615530 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9d276a51-01f8-4bdd-84fe-a931eec4f666 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:39.617856 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-19de8b76-73a0-4c7f-8e3f-1493b3ef07cb tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:39.618552 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9d276a51-01f8-4bdd-84fe-a931eec4f666 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:39.622454 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9d276a51-01f8-4bdd-84fe-a931eec4f666 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:39.623697 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9d276a51-01f8-4bdd-84fe-a931eec4f666 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:39.625423 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9d276a51-01f8-4bdd-84fe-a931eec4f666 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:39.642847 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-19de8b76-73a0-4c7f-8e3f-1493b3ef07cb tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/70ffdc7b-f46e-4e13-b330-86109bc8ff60" status: 200 len: 1507 microversion: 2.1 time: 0.387753 Aug 27 03:03:39.661587 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2191/4349] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:39 2022] GET /compute/v2.1/servers/70ffdc7b-f46e-4e13-b330-86109bc8ff60 => generated 1507 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:03:39.843279 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-aeb81b08-181a-404f-b5a5-be37e69c6e29 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:39.843887 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-aeb81b08-181a-404f-b5a5-be37e69c6e29 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: f09bcfaf-4282-4434-8bb8-6dda7b337ae5] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:39.861534 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-aeb81b08-181a-404f-b5a5-be37e69c6e29 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:39.865808 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-aeb81b08-181a-404f-b5a5-be37e69c6e29 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:39.868906 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-aeb81b08-181a-404f-b5a5-be37e69c6e29 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:39.870029 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-aeb81b08-181a-404f-b5a5-be37e69c6e29 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:39.870664 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-aeb81b08-181a-404f-b5a5-be37e69c6e29 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:39.871267 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-aeb81b08-181a-404f-b5a5-be37e69c6e29 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:40.691901 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-aeb81b08-181a-404f-b5a5-be37e69c6e29 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36697e722bef4a33ab158e9b2f87596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4ca527ba3b49539b528ec8950aef78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:40.694628 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-9d276a51-01f8-4bdd-84fe-a931eec4f666 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c3da1faaee46ca94d2a2543851f3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32a1b54e30415eb8f0e6df5e8b7be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:40.702593 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9d276a51-01f8-4bdd-84fe-a931eec4f666 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] 10.222.0.70 "GET /compute/v2.1/servers/0069592c-7187-4b4d-ab74-3a1a3bc3de80" status: 200 len: 1486 microversion: 2.1 time: 1.130988 Aug 27 03:03:40.716758 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2159/4350] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:39 2022] GET /compute/v2.1/servers/0069592c-7187-4b4d-ab74-3a1a3bc3de80 => generated 1486 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:03:40.717879 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-aeb81b08-181a-404f-b5a5-be37e69c6e29 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "GET /compute/v2.1/servers/f09bcfaf-4282-4434-8bb8-6dda7b337ae5" status: 200 len: 1501 microversion: 2.1 time: 0.878347 Aug 27 03:03:40.721453 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2192/4351] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:39 2022] GET /compute/v2.1/servers/f09bcfaf-4282-4434-8bb8-6dda7b337ae5 => generated 1501 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:03:40.729574 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-91cd734f-acdc-48a6-945f-a494c2742586 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:40.729782 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-91cd734f-acdc-48a6-945f-a494c2742586 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: 70ffdc7b-f46e-4e13-b330-86109bc8ff60] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:40.739917 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-91cd734f-acdc-48a6-945f-a494c2742586 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:40.740357 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-91cd734f-acdc-48a6-945f-a494c2742586 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:40.740808 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-91cd734f-acdc-48a6-945f-a494c2742586 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:40.741524 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-91cd734f-acdc-48a6-945f-a494c2742586 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:40.741974 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-91cd734f-acdc-48a6-945f-a494c2742586 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:40.742396 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-91cd734f-acdc-48a6-945f-a494c2742586 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:40.755498 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-dce0d6fe-bd41-4f42-a8ed-2561a776d65b tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "771115e1-5d63-432e-8d49-5ae04e13a0e4"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:03:40.761619 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-dce0d6fe-bd41-4f42-a8ed-2561a776d65b tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: f09bcfaf-4282-4434-8bb8-6dda7b337ae5] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:40.790548 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dce0d6fe-bd41-4f42-a8ed-2561a776d65b tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:40.791456 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dce0d6fe-bd41-4f42-a8ed-2561a776d65b tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:40.792210 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dce0d6fe-bd41-4f42-a8ed-2561a776d65b tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:40.796055 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dce0d6fe-bd41-4f42-a8ed-2561a776d65b tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:40.797490 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dce0d6fe-bd41-4f42-a8ed-2561a776d65b tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:40.798087 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dce0d6fe-bd41-4f42-a8ed-2561a776d65b tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:40.890836 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-dce0d6fe-bd41-4f42-a8ed-2561a776d65b tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] HTTP exception thrown: Cannot 'attach_volume' instance f09bcfaf-4282-4434-8bb8-6dda7b337ae5 while it is in vm_state rescued Aug 27 03:03:40.895181 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-dce0d6fe-bd41-4f42-a8ed-2561a776d65b tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Request method failure captured: Aug 27 03:03:40.895181 n-d-852278-4 devstack@n-api.service[134051]: request: POST /compute/v2.1/servers/f09bcfaf-4282-4434-8bb8-6dda7b337ae5/os-volume_attachments HTTP/1.1 Aug 27 03:03:40.895181 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 03:03:40.895181 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 03:03:40.895181 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 03:03:40.895181 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 74 Aug 27 03:03:40.895181 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 03:03:40.895181 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 03:03:40.895181 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 03:03:40.895181 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 03:03:40.895181 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYlCR9c_onisOtljFF_OKffaCMw1fqcK8AqJdNG9qzhexbiOAQUtNy-3x5VJrEQxLYuHD403zeJPmdfi74lzmVkRKznv6JROTBAXqcugDUkBzjF_9CFKpQVmUlF9UkBSehtKOGnnrCFpHwE0Yb7XTVGDotoY0qf8klSZfatljLqnj-Y Aug 27 03:03:40.895181 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 03:03:40.895181 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 03:03:40.895181 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 03:03:40.895181 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 03:03:40.895181 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 03:03:40.895181 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 03:03:40.895181 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 1b4ca527ba3b49539b528ec8950aef78 Aug 27 03:03:40.895181 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1447006165 Aug 27 03:03:40.895181 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 03:03:40.895181 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 03:03:40.895181 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/1b4ca527ba3b49539b528ec8950aef78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_1b4ca527ba3b49539b528ec8950aef78", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/1b4ca527ba3b49539b528ec8950aef78"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/1b4ca527ba3b49539b528ec8950aef78"}]}] Aug 27 03:03:40.895181 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1447006165 Aug 27 03:03:40.895181 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 1b4ca527ba3b49539b528ec8950aef78 Aug 27 03:03:40.895181 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1447006165 Aug 27 03:03:40.895181 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ServerRescueNegativeTestJSON-1447006165-project Aug 27 03:03:40.895181 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 03:03:40.895181 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 03:03:40.895181 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 36697e722bef4a33ab158e9b2f87596a Aug 27 03:03:40.895181 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1447006165-project Aug 27 03:03:40.895181 n-d-852278-4 devstack@n-api.service[134051]: Aug 27 03:03:40.895181 n-d-852278-4 devstack@n-api.service[134051]: {"volumeAttachment": {"volumeId": "771115e1-5d63-432e-8d49-5ae04e13a0e4"}} Aug 27 03:03:40.895181 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 03:03:40.895181 n-d-852278-4 devstack@n-api.service[134051]: exception: Cannot 'attach_volume' instance f09bcfaf-4282-4434-8bb8-6dda7b337ae5 while it is in vm_state rescued Aug 27 03:03:40.895181 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'server_id': 'f09bcfaf-4282-4434-8bb8-6dda7b337ae5', 'body': {'volumeAttachment': {'volumeId': '771115e1-5d63-432e-8d49-5ae04e13a0e4'}}} Aug 27 03:03:40.895181 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:03:40.895181 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:03:40.895181 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 27 03:03:40.895181 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 27 03:03:40.895181 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 03:03:40.895181 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 03:03:40.895181 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 27 03:03:40.895181 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 27 03:03:40.895181 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f09bcfaf-4282-4434-8bb8-6dda7b337ae5 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 27 03:03:40.895181 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:03:40.895181 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:03:40.895181 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:03:40.895181 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:03:40.895181 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:03:40.895181 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:03:40.895181 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:03:40.895181 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:03:40.895181 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:03:40.895181 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:03:40.895181 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:03:40.895181 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:03:40.895181 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:03:40.895181 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:03:40.895181 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:03:40.895181 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:03:40.895181 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 27 03:03:40.895181 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 27 03:03:40.899966 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 27 03:03:40.899966 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 27 03:03:40.899966 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance f09bcfaf-4282-4434-8bb8-6dda7b337ae5 while it is in vm_state rescued Aug 27 03:03:40.899966 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:03:40.899966 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:03:40.899966 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:03:40.899966 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:03:40.899966 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:03:40.899966 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:03:40.899966 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:03:40.899966 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:03:40.899966 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance f09bcfaf-4282-4434-8bb8-6dda7b337ae5 while it is in vm_state rescued Aug 27 03:03:40.899966 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:03:40.906155 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-dce0d6fe-bd41-4f42-a8ed-2561a776d65b tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Returning 409 to user: Cannot 'attach_volume' instance f09bcfaf-4282-4434-8bb8-6dda7b337ae5 while it is in vm_state rescued {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:03:40.919504 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-dce0d6fe-bd41-4f42-a8ed-2561a776d65b tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "POST /compute/v2.1/servers/f09bcfaf-4282-4434-8bb8-6dda7b337ae5/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.180358 Aug 27 03:03:40.928106 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2193/4352] 10.222.0.70 () {60 vars in 1323 bytes} [Sat Aug 27 03:03:40 2022] POST /compute/v2.1/servers/f09bcfaf-4282-4434-8bb8-6dda7b337ae5/os-volume_attachments => generated 152 bytes in 190 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 27 03:03:40.944460 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-53e09518-c84e-4666-888a-9609f0e3a61a tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:03:40.945043 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-53e09518-c84e-4666-888a-9609f0e3a61a tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: f09bcfaf-4282-4434-8bb8-6dda7b337ae5] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:40.952619 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-53e09518-c84e-4666-888a-9609f0e3a61a tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:40.953336 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-53e09518-c84e-4666-888a-9609f0e3a61a tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:40.953863 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-53e09518-c84e-4666-888a-9609f0e3a61a tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:40.955353 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-53e09518-c84e-4666-888a-9609f0e3a61a tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:40.956708 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-53e09518-c84e-4666-888a-9609f0e3a61a tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:40.957596 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-53e09518-c84e-4666-888a-9609f0e3a61a tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:41.088269 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-53e09518-c84e-4666-888a-9609f0e3a61a tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "POST /compute/v2.1/servers/f09bcfaf-4282-4434-8bb8-6dda7b337ae5/action" status: 202 len: 0 microversion: 2.1 time: 0.152460 Aug 27 03:03:41.090135 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2194/4353] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:03:40 2022] POST /compute/v2.1/servers/f09bcfaf-4282-4434-8bb8-6dda7b337ae5/action => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:03:41.097976 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3976a4ac-a70d-48d7-961b-9f6a74b46cbe tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-811581451", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:03:41.146780 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-91cd734f-acdc-48a6-945f-a494c2742586 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:41.155301 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-91cd734f-acdc-48a6-945f-a494c2742586 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/70ffdc7b-f46e-4e13-b330-86109bc8ff60" status: 200 len: 1507 microversion: 2.1 time: 0.437314 Aug 27 03:03:41.158230 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2160/4354] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:40 2022] GET /compute/v2.1/servers/70ffdc7b-f46e-4e13-b330-86109bc8ff60 => generated 1507 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:03:41.177430 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-1103285b-5820-4be9-939c-5109fff62e34 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:41.181177 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-1103285b-5820-4be9-939c-5109fff62e34 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: f09bcfaf-4282-4434-8bb8-6dda7b337ae5] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:41.199946 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1103285b-5820-4be9-939c-5109fff62e34 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:41.200922 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1103285b-5820-4be9-939c-5109fff62e34 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:41.201578 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1103285b-5820-4be9-939c-5109fff62e34 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:41.202516 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1103285b-5820-4be9-939c-5109fff62e34 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:41.203242 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1103285b-5820-4be9-939c-5109fff62e34 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:41.203896 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1103285b-5820-4be9-939c-5109fff62e34 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:41.229606 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.network.neutron [None req-3976a4ac-a70d-48d7-961b-9f6a74b46cbe tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] validate_networks() for [('ef35040d-7f47-4e48-bab5-bc23ac5b1c2b', None, None, None, None, None)] {{(pid=134051) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:03:41.801063 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-1103285b-5820-4be9-939c-5109fff62e34 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36697e722bef4a33ab158e9b2f87596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4ca527ba3b49539b528ec8950aef78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:41.810601 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-1103285b-5820-4be9-939c-5109fff62e34 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "GET /compute/v2.1/servers/f09bcfaf-4282-4434-8bb8-6dda7b337ae5" status: 200 len: 1509 microversion: 2.1 time: 0.649877 Aug 27 03:03:41.811196 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2161/4355] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:41 2022] GET /compute/v2.1/servers/f09bcfaf-4282-4434-8bb8-6dda7b337ae5 => generated 1509 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:03:42.180954 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-77ecba24-5e1b-4776-90fc-281ef7a542a4 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:42.182646 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-77ecba24-5e1b-4776-90fc-281ef7a542a4 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: 70ffdc7b-f46e-4e13-b330-86109bc8ff60] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:42.190074 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-77ecba24-5e1b-4776-90fc-281ef7a542a4 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:42.190849 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-77ecba24-5e1b-4776-90fc-281ef7a542a4 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:42.191426 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-77ecba24-5e1b-4776-90fc-281ef7a542a4 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:42.192336 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-77ecba24-5e1b-4776-90fc-281ef7a542a4 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:42.193127 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-77ecba24-5e1b-4776-90fc-281ef7a542a4 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:42.193879 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-77ecba24-5e1b-4776-90fc-281ef7a542a4 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:42.687334 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-77ecba24-5e1b-4776-90fc-281ef7a542a4 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:42.727306 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-77ecba24-5e1b-4776-90fc-281ef7a542a4 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/70ffdc7b-f46e-4e13-b330-86109bc8ff60" status: 200 len: 1507 microversion: 2.1 time: 0.550200 Aug 27 03:03:42.730286 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2162/4356] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:42 2022] GET /compute/v2.1/servers/70ffdc7b-f46e-4e13-b330-86109bc8ff60 => generated 1507 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:03:42.791321 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-3976a4ac-a70d-48d7-961b-9f6a74b46cbe tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Flavor limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:03:42.791846 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-3976a4ac-a70d-48d7-961b-9f6a74b46cbe tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Image limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:03:42.792353 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-3976a4ac-a70d-48d7-961b-9f6a74b46cbe tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Flavor pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:03:42.792823 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-3976a4ac-a70d-48d7-961b-9f6a74b46cbe tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Image pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:03:42.793388 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-3976a4ac-a70d-48d7-961b-9f6a74b46cbe tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:03:42.809977 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3976a4ac-a70d-48d7-961b-9f6a74b46cbe tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:42.810884 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3976a4ac-a70d-48d7-961b-9f6a74b46cbe tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:42.811395 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3976a4ac-a70d-48d7-961b-9f6a74b46cbe tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:42.812292 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3976a4ac-a70d-48d7-961b-9f6a74b46cbe tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:42.812907 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3976a4ac-a70d-48d7-961b-9f6a74b46cbe tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:42.813407 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3976a4ac-a70d-48d7-961b-9f6a74b46cbe tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:42.831654 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-2c1592dd-a962-44ce-92fa-aa911b85e88d tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:42.832925 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-2c1592dd-a962-44ce-92fa-aa911b85e88d tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: f09bcfaf-4282-4434-8bb8-6dda7b337ae5] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:42.842496 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2c1592dd-a962-44ce-92fa-aa911b85e88d tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:42.844937 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2c1592dd-a962-44ce-92fa-aa911b85e88d tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:42.845613 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2c1592dd-a962-44ce-92fa-aa911b85e88d tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:42.850588 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2c1592dd-a962-44ce-92fa-aa911b85e88d tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:42.853288 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2c1592dd-a962-44ce-92fa-aa911b85e88d tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:42.853941 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2c1592dd-a962-44ce-92fa-aa911b85e88d tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:42.855064 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-3976a4ac-a70d-48d7-961b-9f6a74b46cbe tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Getting quotas for project fc32a1b54e30415eb8f0e6df5e8b7be6. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:03:42.867759 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-3976a4ac-a70d-48d7-961b-9f6a74b46cbe tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Getting quotas for user e0c3da1faaee46ca94d2a2543851f3f6 and project fc32a1b54e30415eb8f0e6df5e8b7be6. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:03:42.899997 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-3976a4ac-a70d-48d7-961b-9f6a74b46cbe tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Going to run 1 instances... {{(pid=134051) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:03:42.909210 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-3976a4ac-a70d-48d7-961b-9f6a74b46cbe tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] [instance: 92522ed7-8ac4-44b3-94b0-0aa3941cdbae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134051) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:03:43.027895 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-3976a4ac-a70d-48d7-961b-9f6a74b46cbe tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.935877 Aug 27 03:03:43.029165 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2195/4357] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 03:03:41 2022] POST /compute/v2.1/servers => generated 383 bytes in 1938 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:03:43.034790 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-ad972308-92e0-4e23-8e9c-8a566f717387 req-9131f61d-5a1b-4232-8591-8c2a0b35bb29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70ffdc7b-f46e-4e13-b330-86109bc8ff60", "name": "network-vif-deleted", "tag": "6117624d-8201-482a-afd7-2152c74a6dc6"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:03:43.047269 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-ad972308-92e0-4e23-8e9c-8a566f717387 req-9131f61d-5a1b-4232-8591-8c2a0b35bb29 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:43.048264 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-ad972308-92e0-4e23-8e9c-8a566f717387 req-9131f61d-5a1b-4232-8591-8c2a0b35bb29 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:43.049720 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-ad972308-92e0-4e23-8e9c-8a566f717387 req-9131f61d-5a1b-4232-8591-8c2a0b35bb29 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:43.101169 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-ad972308-92e0-4e23-8e9c-8a566f717387 req-9131f61d-5a1b-4232-8591-8c2a0b35bb29 service nova] Creating event network-vif-deleted:6117624d-8201-482a-afd7-2152c74a6dc6 for instance 70ffdc7b-f46e-4e13-b330-86109bc8ff60 on n-h2-852278-4 Aug 27 03:03:43.134438 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-ad972308-92e0-4e23-8e9c-8a566f717387 req-9131f61d-5a1b-4232-8591-8c2a0b35bb29 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103411 Aug 27 03:03:43.151827 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2196/4358] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:03:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:03:43.179298 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-58d21658-6ada-45d8-8dcf-bca13e705b00 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:43.187408 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-58d21658-6ada-45d8-8dcf-bca13e705b00 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] [instance: 92522ed7-8ac4-44b3-94b0-0aa3941cdbae] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:43.225664 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-2c1592dd-a962-44ce-92fa-aa911b85e88d tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36697e722bef4a33ab158e9b2f87596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4ca527ba3b49539b528ec8950aef78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:43.238925 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-2c1592dd-a962-44ce-92fa-aa911b85e88d tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "GET /compute/v2.1/servers/f09bcfaf-4282-4434-8bb8-6dda7b337ae5" status: 200 len: 1509 microversion: 2.1 time: 0.410251 Aug 27 03:03:43.239526 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2163/4359] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:42 2022] GET /compute/v2.1/servers/f09bcfaf-4282-4434-8bb8-6dda7b337ae5 => generated 1509 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:03:43.332757 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-58d21658-6ada-45d8-8dcf-bca13e705b00 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c3da1faaee46ca94d2a2543851f3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32a1b54e30415eb8f0e6df5e8b7be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:43.342760 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-58d21658-6ada-45d8-8dcf-bca13e705b00 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] 10.222.0.70 "GET /compute/v2.1/servers/92522ed7-8ac4-44b3-94b0-0aa3941cdbae" status: 200 len: 1213 microversion: 2.1 time: 0.185729 Aug 27 03:03:43.353118 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2197/4360] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:43 2022] GET /compute/v2.1/servers/92522ed7-8ac4-44b3-94b0-0aa3941cdbae => generated 1213 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:03:43.763635 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b7ea4e75-ed2a-4553-9a24-1f9127fd8f59 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:43.764651 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b7ea4e75-ed2a-4553-9a24-1f9127fd8f59 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: 70ffdc7b-f46e-4e13-b330-86109bc8ff60] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:43.773697 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b7ea4e75-ed2a-4553-9a24-1f9127fd8f59 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:43.774445 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b7ea4e75-ed2a-4553-9a24-1f9127fd8f59 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:43.775162 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b7ea4e75-ed2a-4553-9a24-1f9127fd8f59 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:43.776195 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b7ea4e75-ed2a-4553-9a24-1f9127fd8f59 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:43.776911 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b7ea4e75-ed2a-4553-9a24-1f9127fd8f59 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:43.777528 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b7ea4e75-ed2a-4553-9a24-1f9127fd8f59 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:43.792630 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-b7ea4e75-ed2a-4553-9a24-1f9127fd8f59 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] HTTP exception thrown: Instance 70ffdc7b-f46e-4e13-b330-86109bc8ff60 could not be found. Aug 27 03:03:43.794612 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b7ea4e75-ed2a-4553-9a24-1f9127fd8f59 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Request method failure captured: Aug 27 03:03:43.794612 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/servers/70ffdc7b-f46e-4e13-b330-86109bc8ff60 HTTP/1.1 Aug 27 03:03:43.794612 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 03:03:43.794612 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 03:03:43.794612 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 03:03:43.794612 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 03:03:43.794612 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 03:03:43.794612 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 03:03:43.794612 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 03:03:43.794612 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 03:03:43.794612 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYljOihuPJQy-4KxXQ6OhbQw2FQiYByi8_J9EYziHxHrRpgpXLGNvb0hsYYYVptKud4yCoN0X9GxdS_QRHpRChZ0P7CrkMR6MvE3oNyvsgDIOynlxCCmMse1aD34uMngOe0Z8wMpnS_90nVB9LjwZPMQBiRDrvzydhSu6jwK0Njtp_4 Aug 27 03:03:43.794612 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 03:03:43.794612 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 03:03:43.794612 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 03:03:43.794612 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 03:03:43.794612 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 03:03:43.794612 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 03:03:43.794612 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 6b8d6664c463420bad9a5bfb6d747db4 Aug 27 03:03:43.794612 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ServersTestJSON-252485458 Aug 27 03:03:43.794612 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 03:03:43.794612 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 03:03:43.794612 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6b8d6664c463420bad9a5bfb6d747db4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_6b8d6664c463420bad9a5bfb6d747db4", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6b8d6664c463420bad9a5bfb6d747db4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/6b8d6664c463420bad9a5bfb6d747db4"}]}] Aug 27 03:03:43.794612 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ServersTestJSON-252485458 Aug 27 03:03:43.794612 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 6b8d6664c463420bad9a5bfb6d747db4 Aug 27 03:03:43.794612 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ServersTestJSON-252485458 Aug 27 03:03:43.794612 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ServersTestJSON-252485458-project Aug 27 03:03:43.794612 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 03:03:43.794612 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 03:03:43.794612 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 13a4e6dcf5df46fcad30430a9b9a08ee Aug 27 03:03:43.794612 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ServersTestJSON-252485458-project Aug 27 03:03:43.794612 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 03:03:43.794612 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance 70ffdc7b-f46e-4e13-b330-86109bc8ff60 could not be found. Aug 27 03:03:43.794612 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '70ffdc7b-f46e-4e13-b330-86109bc8ff60'} Aug 27 03:03:43.794612 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:03:43.794612 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:03:43.794612 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:03:43.794612 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:03:43.794612 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:03:43.794612 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:03:43.794612 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:03:43.794612 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:03:43.794612 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:03:43.794612 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:03:43.794612 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70ffdc7b-f46e-4e13-b330-86109bc8ff60 could not be found. Aug 27 03:03:43.794612 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:03:43.794612 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:03:43.794612 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:03:43.794612 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:03:43.794612 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:03:43.794612 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:03:43.794612 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:03:43.794612 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:03:43.794612 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:03:43.794612 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:03:43.794612 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:03:43.794612 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:03:43.794612 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:03:43.794612 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:03:43.794612 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:03:43.794612 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:03:43.794612 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70ffdc7b-f46e-4e13-b330-86109bc8ff60 could not be found. Aug 27 03:03:43.794612 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:03:43.794612 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:03:43.794612 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:03:43.794612 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:03:43.799038 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:03:43.799038 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:03:43.799038 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:03:43.799038 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:03:43.799038 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70ffdc7b-f46e-4e13-b330-86109bc8ff60 could not be found. Aug 27 03:03:43.799038 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:03:43.801011 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b7ea4e75-ed2a-4553-9a24-1f9127fd8f59 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Returning 404 to user: Instance 70ffdc7b-f46e-4e13-b330-86109bc8ff60 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:03:43.802222 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b7ea4e75-ed2a-4553-9a24-1f9127fd8f59 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/70ffdc7b-f46e-4e13-b330-86109bc8ff60" status: 404 len: 111 microversion: 2.1 time: 0.044729 Aug 27 03:03:43.803405 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2164/4361] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:43 2022] GET /compute/v2.1/servers/70ffdc7b-f46e-4e13-b330-86109bc8ff60 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:03:43.818414 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d07d5e52-8bb4-4ebd-a67e-fe3b131dc03a tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Action: 'create', calling method: .version_select at 0x7f5eddcbec10>, body: {"keypair": {"name": "tempest-key-1721505323", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDxWfr9OVRSdwpGZ4p2rL2qe8tm27jwLcXSp0729msJK6jKFTQcr0bN0Y+VM+UoNxugJgvmvJSY/t85QSru6WrgjPnOKwESTjfr1jfNtLjxsZYK0sURpRfgWA1+V4pleaA=="}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:03:43.849169 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-d07d5e52-8bb4-4ebd-a67e-fe3b131dc03a tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Getting quotas for project 6b8d6664c463420bad9a5bfb6d747db4. Resources: {'key_pairs'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:03:43.855244 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-d07d5e52-8bb4-4ebd-a67e-fe3b131dc03a tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Getting quotas for user 13a4e6dcf5df46fcad30430a9b9a08ee and project 6b8d6664c463420bad9a5bfb6d747db4. Resources: {'key_pairs'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:03:43.892063 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d07d5e52-8bb4-4ebd-a67e-fe3b131dc03a tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 382 microversion: 2.1 time: 0.079550 Aug 27 03:03:43.895932 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2198/4362] 10.222.0.70 () {60 vars in 1159 bytes} [Sat Aug 27 03:03:43 2022] POST /compute/v2.1/os-keypairs => generated 382 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:03:43.905552 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a010cf6e-5d17-4c88-bec5-0fa5d5aee61e tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '.version_select at 0x7f5ee1f059d0>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:43.910171 n-d-852278-4 devstack@n-api.service[134052]: WARNING oslo_db.sqlalchemy.utils [None req-a010cf6e-5d17-4c88-bec5-0fa5d5aee61e tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 27 03:03:43.917468 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a010cf6e-5d17-4c88-bec5-0fa5d5aee61e tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/os-keypairs" status: 200 len: 351 microversion: 2.1 time: 0.015984 Aug 27 03:03:43.930067 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2165/4363] 10.222.0.70 () {58 vars in 1137 bytes} [Sat Aug 27 03:03:43 2022] GET /compute/v2.1/os-keypairs => generated 351 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:03:44.051634 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-fad46c94-5f43-4413-80b4-896c1c48fe93 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-292083098", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "key_name": "tempest-key-1721505323", "networks": [{"uuid": "961028dd-9dfc-4287-bc1b-27b14d79a81a"}]}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:03:44.116651 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.network.neutron [None req-fad46c94-5f43-4413-80b4-896c1c48fe93 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] validate_networks() for [('961028dd-9dfc-4287-bc1b-27b14d79a81a', None, None, None, None, None)] {{(pid=134051) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:03:44.262533 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8d02ecbf-5345-49a3-b853-c222270cd6d0 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:44.263143 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-8d02ecbf-5345-49a3-b853-c222270cd6d0 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: f09bcfaf-4282-4434-8bb8-6dda7b337ae5] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:44.270417 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8d02ecbf-5345-49a3-b853-c222270cd6d0 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:44.271153 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8d02ecbf-5345-49a3-b853-c222270cd6d0 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:44.271595 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8d02ecbf-5345-49a3-b853-c222270cd6d0 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:44.272299 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8d02ecbf-5345-49a3-b853-c222270cd6d0 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:44.272999 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8d02ecbf-5345-49a3-b853-c222270cd6d0 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:44.273592 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8d02ecbf-5345-49a3-b853-c222270cd6d0 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:44.482741 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:INSERT=7,nova_api:SELECT=93 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:03:44.638358 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-8d02ecbf-5345-49a3-b853-c222270cd6d0 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36697e722bef4a33ab158e9b2f87596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4ca527ba3b49539b528ec8950aef78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:44.654492 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-8d02ecbf-5345-49a3-b853-c222270cd6d0 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "GET /compute/v2.1/servers/f09bcfaf-4282-4434-8bb8-6dda7b337ae5" status: 200 len: 1509 microversion: 2.1 time: 0.395945 Aug 27 03:03:44.660841 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2166/4364] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:44 2022] GET /compute/v2.1/servers/f09bcfaf-4282-4434-8bb8-6dda7b337ae5 => generated 1509 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:03:44.674548 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-1930793a-3cca-4525-9289-d679468e2636 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:44.675696 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-1930793a-3cca-4525-9289-d679468e2636 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] [instance: 92522ed7-8ac4-44b3-94b0-0aa3941cdbae] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:44.691689 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1930793a-3cca-4525-9289-d679468e2636 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:44.692234 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1930793a-3cca-4525-9289-d679468e2636 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:44.692692 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1930793a-3cca-4525-9289-d679468e2636 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:44.693785 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1930793a-3cca-4525-9289-d679468e2636 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:44.694443 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1930793a-3cca-4525-9289-d679468e2636 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:44.694870 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1930793a-3cca-4525-9289-d679468e2636 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:45.191779 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-1930793a-3cca-4525-9289-d679468e2636 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c3da1faaee46ca94d2a2543851f3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32a1b54e30415eb8f0e6df5e8b7be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:45.208746 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-1930793a-3cca-4525-9289-d679468e2636 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] 10.222.0.70 "GET /compute/v2.1/servers/92522ed7-8ac4-44b3-94b0-0aa3941cdbae" status: 200 len: 1271 microversion: 2.1 time: 0.545668 Aug 27 03:03:45.210226 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2167/4365] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:44 2022] GET /compute/v2.1/servers/92522ed7-8ac4-44b3-94b0-0aa3941cdbae => generated 1271 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:03:45.263734 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-fad46c94-5f43-4413-80b4-896c1c48fe93 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Flavor limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:03:45.264191 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-fad46c94-5f43-4413-80b4-896c1c48fe93 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Image limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:03:45.264653 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-fad46c94-5f43-4413-80b4-896c1c48fe93 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Flavor pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:03:45.265206 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-fad46c94-5f43-4413-80b4-896c1c48fe93 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Image pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:03:45.265472 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-fad46c94-5f43-4413-80b4-896c1c48fe93 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:03:45.285789 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fad46c94-5f43-4413-80b4-896c1c48fe93 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:45.286290 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fad46c94-5f43-4413-80b4-896c1c48fe93 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:45.286731 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fad46c94-5f43-4413-80b4-896c1c48fe93 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:45.287496 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fad46c94-5f43-4413-80b4-896c1c48fe93 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:45.287952 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fad46c94-5f43-4413-80b4-896c1c48fe93 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:45.288406 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fad46c94-5f43-4413-80b4-896c1c48fe93 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:45.320893 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-fad46c94-5f43-4413-80b4-896c1c48fe93 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Getting quotas for project 6b8d6664c463420bad9a5bfb6d747db4. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:03:45.335425 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-fad46c94-5f43-4413-80b4-896c1c48fe93 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Getting quotas for user 13a4e6dcf5df46fcad30430a9b9a08ee and project 6b8d6664c463420bad9a5bfb6d747db4. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:03:45.349648 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-fad46c94-5f43-4413-80b4-896c1c48fe93 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Going to run 1 instances... {{(pid=134051) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:03:45.352494 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-fad46c94-5f43-4413-80b4-896c1c48fe93 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: 3807799b-58bc-4e72-9bb6-563595c15618] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134051) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:03:45.412341 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-fad46c94-5f43-4413-80b4-896c1c48fe93 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.364889 Aug 27 03:03:45.418523 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2199/4366] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 03:03:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1367 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:03:45.423893 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e4139e7e-1c49-468d-9b98-b8f8395f022e tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:45.424654 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-e4139e7e-1c49-468d-9b98-b8f8395f022e tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: 3807799b-58bc-4e72-9bb6-563595c15618] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:45.503139 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-e4139e7e-1c49-468d-9b98-b8f8395f022e tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:45.514872 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e4139e7e-1c49-468d-9b98-b8f8395f022e tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/3807799b-58bc-4e72-9bb6-563595c15618" status: 200 len: 1228 microversion: 2.1 time: 0.094731 Aug 27 03:03:45.520086 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2168/4367] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:45 2022] GET /compute/v2.1/servers/3807799b-58bc-4e72-9bb6-563595c15618 => generated 1228 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:03:45.675214 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c7ae343e-ac38-4a4a-9e61-a19ae79b9384 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:45.676042 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-c7ae343e-ac38-4a4a-9e61-a19ae79b9384 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: f09bcfaf-4282-4434-8bb8-6dda7b337ae5] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:45.686160 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c7ae343e-ac38-4a4a-9e61-a19ae79b9384 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:45.686903 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c7ae343e-ac38-4a4a-9e61-a19ae79b9384 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:45.687521 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c7ae343e-ac38-4a4a-9e61-a19ae79b9384 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:45.688422 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c7ae343e-ac38-4a4a-9e61-a19ae79b9384 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:45.689070 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c7ae343e-ac38-4a4a-9e61-a19ae79b9384 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:45.689662 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c7ae343e-ac38-4a4a-9e61-a19ae79b9384 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:46.060651 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-c7ae343e-ac38-4a4a-9e61-a19ae79b9384 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36697e722bef4a33ab158e9b2f87596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4ca527ba3b49539b528ec8950aef78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:46.076655 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c7ae343e-ac38-4a4a-9e61-a19ae79b9384 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "GET /compute/v2.1/servers/f09bcfaf-4282-4434-8bb8-6dda7b337ae5" status: 200 len: 1515 microversion: 2.1 time: 0.405465 Aug 27 03:03:46.078036 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2200/4368] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:45 2022] GET /compute/v2.1/servers/f09bcfaf-4282-4434-8bb8-6dda7b337ae5 => generated 1515 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:03:46.234128 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-28128920-d375-4e4f-9634-8811a39ed235 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:46.234742 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-28128920-d375-4e4f-9634-8811a39ed235 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] [instance: 92522ed7-8ac4-44b3-94b0-0aa3941cdbae] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:46.253644 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-28128920-d375-4e4f-9634-8811a39ed235 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:46.254453 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-28128920-d375-4e4f-9634-8811a39ed235 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:46.254997 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-28128920-d375-4e4f-9634-8811a39ed235 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:46.256071 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-28128920-d375-4e4f-9634-8811a39ed235 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:46.256792 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-28128920-d375-4e4f-9634-8811a39ed235 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:46.257710 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-28128920-d375-4e4f-9634-8811a39ed235 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:46.546656 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-afa6435e-3923-44e2-bd8f-037dc37ed352 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:46.547987 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-afa6435e-3923-44e2-bd8f-037dc37ed352 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: 3807799b-58bc-4e72-9bb6-563595c15618] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:46.566562 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-afa6435e-3923-44e2-bd8f-037dc37ed352 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:46.569302 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-afa6435e-3923-44e2-bd8f-037dc37ed352 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:46.570803 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-afa6435e-3923-44e2-bd8f-037dc37ed352 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:46.571726 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-afa6435e-3923-44e2-bd8f-037dc37ed352 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:46.573979 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-afa6435e-3923-44e2-bd8f-037dc37ed352 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:46.574420 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-afa6435e-3923-44e2-bd8f-037dc37ed352 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:46.700740 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-28128920-d375-4e4f-9634-8811a39ed235 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c3da1faaee46ca94d2a2543851f3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32a1b54e30415eb8f0e6df5e8b7be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:46.716934 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-28128920-d375-4e4f-9634-8811a39ed235 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] 10.222.0.70 "GET /compute/v2.1/servers/92522ed7-8ac4-44b3-94b0-0aa3941cdbae" status: 200 len: 1313 microversion: 2.1 time: 0.486528 Aug 27 03:03:46.717541 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2169/4369] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:46 2022] GET /compute/v2.1/servers/92522ed7-8ac4-44b3-94b0-0aa3941cdbae => generated 1313 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:03:46.747308 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-afa6435e-3923-44e2-bd8f-037dc37ed352 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:46.757486 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-afa6435e-3923-44e2-bd8f-037dc37ed352 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/3807799b-58bc-4e72-9bb6-563595c15618" status: 200 len: 1224 microversion: 2.1 time: 0.220494 Aug 27 03:03:46.769806 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2201/4370] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:46 2022] GET /compute/v2.1/servers/3807799b-58bc-4e72-9bb6-563595c15618 => generated 1224 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:03:47.748457 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e3af957a-ecb3-46ef-a96a-87420a20c3d8 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:47.751794 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-e3af957a-ecb3-46ef-a96a-87420a20c3d8 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] [instance: 92522ed7-8ac4-44b3-94b0-0aa3941cdbae] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:47.763737 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e3af957a-ecb3-46ef-a96a-87420a20c3d8 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:47.764832 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e3af957a-ecb3-46ef-a96a-87420a20c3d8 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:47.765469 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e3af957a-ecb3-46ef-a96a-87420a20c3d8 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:47.766990 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e3af957a-ecb3-46ef-a96a-87420a20c3d8 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:47.768282 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e3af957a-ecb3-46ef-a96a-87420a20c3d8 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:47.768508 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e3af957a-ecb3-46ef-a96a-87420a20c3d8 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:47.782357 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-71d888e9-2cd0-4397-96f3-13f9a51f279b tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:47.782971 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-71d888e9-2cd0-4397-96f3-13f9a51f279b tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: 3807799b-58bc-4e72-9bb6-563595c15618] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:47.793574 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-71d888e9-2cd0-4397-96f3-13f9a51f279b tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:47.794073 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-71d888e9-2cd0-4397-96f3-13f9a51f279b tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:47.794699 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-71d888e9-2cd0-4397-96f3-13f9a51f279b tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:47.795942 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-71d888e9-2cd0-4397-96f3-13f9a51f279b tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:47.796482 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-71d888e9-2cd0-4397-96f3-13f9a51f279b tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:47.797038 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-71d888e9-2cd0-4397-96f3-13f9a51f279b tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:47.970871 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-71d888e9-2cd0-4397-96f3-13f9a51f279b tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:47.980341 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-71d888e9-2cd0-4397-96f3-13f9a51f279b tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/3807799b-58bc-4e72-9bb6-563595c15618" status: 200 len: 1286 microversion: 2.1 time: 0.201944 Aug 27 03:03:47.987379 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2202/4371] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:47 2022] GET /compute/v2.1/servers/3807799b-58bc-4e72-9bb6-563595c15618 => generated 1286 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:03:48.574159 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-e3af957a-ecb3-46ef-a96a-87420a20c3d8 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c3da1faaee46ca94d2a2543851f3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32a1b54e30415eb8f0e6df5e8b7be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:48.583059 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e3af957a-ecb3-46ef-a96a-87420a20c3d8 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] 10.222.0.70 "GET /compute/v2.1/servers/92522ed7-8ac4-44b3-94b0-0aa3941cdbae" status: 200 len: 1313 microversion: 2.1 time: 0.848992 Aug 27 03:03:48.583667 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2170/4372] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:47 2022] GET /compute/v2.1/servers/92522ed7-8ac4-44b3-94b0-0aa3941cdbae => generated 1313 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:03:48.750969 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-3147e804-ba22-42b4-b68b-c7d15fc062f2 req-c8b775a0-7048-46cc-bb51-6ce9332dc7ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92522ed7-8ac4-44b3-94b0-0aa3941cdbae", "tag": "6fe9e210-ea15-4e46-ad72-84a07d6eedce"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:03:48.768262 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-3147e804-ba22-42b4-b68b-c7d15fc062f2 req-c8b775a0-7048-46cc-bb51-6ce9332dc7ad service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:48.768878 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-3147e804-ba22-42b4-b68b-c7d15fc062f2 req-c8b775a0-7048-46cc-bb51-6ce9332dc7ad service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:48.769448 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-3147e804-ba22-42b4-b68b-c7d15fc062f2 req-c8b775a0-7048-46cc-bb51-6ce9332dc7ad service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:48.776275 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-01aba2b3-d32d-493a-9f93-5af7ff8e185f tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Action: 'create', calling method: .version_select at 0x7f5ee2709dc0>, body: {"keypair": {"name": "tempest-keypair-229843751", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNwz1PzYNQj6rUdHbmgl7cJkRGx7yLypniVEK5LLxX81O35xUAWMb7IK7HHw1KhbuI6XHdafzjSYhF+T5Epkl2xU5BSu4aEE5Trp4BZUEQfUx2REM5usfEMyb4/geAXnNA=="}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:03:48.784406 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-3147e804-ba22-42b4-b68b-c7d15fc062f2 req-c8b775a0-7048-46cc-bb51-6ce9332dc7ad service nova] Creating event network-changed:6fe9e210-ea15-4e46-ad72-84a07d6eedce for instance 92522ed7-8ac4-44b3-94b0-0aa3941cdbae on n-h2-852278-4 Aug 27 03:03:48.790669 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-3147e804-ba22-42b4-b68b-c7d15fc062f2 req-c8b775a0-7048-46cc-bb51-6ce9332dc7ad service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044124 Aug 27 03:03:48.791539 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2203/4373] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:03:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:03:48.793927 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-01aba2b3-d32d-493a-9f93-5af7ff8e185f tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Getting quotas for project 1b4ca527ba3b49539b528ec8950aef78. Resources: {'key_pairs'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:03:48.799967 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-01aba2b3-d32d-493a-9f93-5af7ff8e185f tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Getting quotas for user 36697e722bef4a33ab158e9b2f87596a and project 1b4ca527ba3b49539b528ec8950aef78. Resources: {'key_pairs'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:03:48.825783 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-01aba2b3-d32d-493a-9f93-5af7ff8e185f tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.053530 Aug 27 03:03:48.826442 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2171/4374] 10.222.0.70 () {60 vars in 1159 bytes} [Sat Aug 27 03:03:48 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:03:49.007876 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-5a6d8bbc-f24e-47ee-b257-f60188b30422 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:49.008637 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-5a6d8bbc-f24e-47ee-b257-f60188b30422 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: 3807799b-58bc-4e72-9bb6-563595c15618] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:49.017378 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5a6d8bbc-f24e-47ee-b257-f60188b30422 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:49.018193 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5a6d8bbc-f24e-47ee-b257-f60188b30422 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:49.018794 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5a6d8bbc-f24e-47ee-b257-f60188b30422 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:49.019726 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5a6d8bbc-f24e-47ee-b257-f60188b30422 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:49.020372 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5a6d8bbc-f24e-47ee-b257-f60188b30422 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:49.020953 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5a6d8bbc-f24e-47ee-b257-f60188b30422 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:49.178075 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-5a6d8bbc-f24e-47ee-b257-f60188b30422 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:49.191276 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-5a6d8bbc-f24e-47ee-b257-f60188b30422 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/3807799b-58bc-4e72-9bb6-563595c15618" status: 200 len: 1286 microversion: 2.1 time: 0.187574 Aug 27 03:03:49.194042 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2204/4375] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:49 2022] GET /compute/v2.1/servers/3807799b-58bc-4e72-9bb6-563595c15618 => generated 1286 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:03:49.608447 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c850d1f4-c420-45ab-abfb-62269c2befb2 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:49.609553 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-c850d1f4-c420-45ab-abfb-62269c2befb2 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] [instance: 92522ed7-8ac4-44b3-94b0-0aa3941cdbae] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:49.621075 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c850d1f4-c420-45ab-abfb-62269c2befb2 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:49.622031 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c850d1f4-c420-45ab-abfb-62269c2befb2 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:49.622692 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c850d1f4-c420-45ab-abfb-62269c2befb2 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:49.623874 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c850d1f4-c420-45ab-abfb-62269c2befb2 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:49.624923 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c850d1f4-c420-45ab-abfb-62269c2befb2 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:49.625832 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c850d1f4-c420-45ab-abfb-62269c2befb2 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:50.060277 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b8401b86-ea8e-44d5-9de2-7a3117222375 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:50.061720 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b8401b86-ea8e-44d5-9de2-7a3117222375 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] [instance: f90d78a8-dea6-45c3-933c-8184ff4858b1] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:50.087289 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b8401b86-ea8e-44d5-9de2-7a3117222375 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:50.088243 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b8401b86-ea8e-44d5-9de2-7a3117222375 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:50.089031 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b8401b86-ea8e-44d5-9de2-7a3117222375 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:50.089960 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b8401b86-ea8e-44d5-9de2-7a3117222375 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:50.090835 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b8401b86-ea8e-44d5-9de2-7a3117222375 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:50.091468 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b8401b86-ea8e-44d5-9de2-7a3117222375 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:50.125558 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b8401b86-ea8e-44d5-9de2-7a3117222375 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] 10.222.0.70 "GET /compute/v2.1/servers/f90d78a8-dea6-45c3-933c-8184ff4858b1/ips" status: 200 len: 143 microversion: 2.1 time: 0.070077 Aug 27 03:03:50.127499 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2205/4376] 10.222.0.70 () {58 vars in 1248 bytes} [Sat Aug 27 03:03:50 2022] GET /compute/v2.1/servers/f90d78a8-dea6-45c3-933c-8184ff4858b1/ips => generated 143 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:03:50.158992 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-c850d1f4-c420-45ab-abfb-62269c2befb2 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c3da1faaee46ca94d2a2543851f3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32a1b54e30415eb8f0e6df5e8b7be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:50.177098 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c850d1f4-c420-45ab-abfb-62269c2befb2 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] 10.222.0.70 "GET /compute/v2.1/servers/92522ed7-8ac4-44b3-94b0-0aa3941cdbae" status: 200 len: 1313 microversion: 2.1 time: 0.576755 Aug 27 03:03:50.186197 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2172/4377] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:49 2022] GET /compute/v2.1/servers/92522ed7-8ac4-44b3-94b0-0aa3941cdbae => generated 1313 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:03:50.217323 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-decd0b2b-1026-4ca9-b6d2-c13875626bf5 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:50.218362 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-decd0b2b-1026-4ca9-b6d2-c13875626bf5 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: 3807799b-58bc-4e72-9bb6-563595c15618] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:50.227131 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-decd0b2b-1026-4ca9-b6d2-c13875626bf5 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:50.227891 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-decd0b2b-1026-4ca9-b6d2-c13875626bf5 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:50.228686 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-decd0b2b-1026-4ca9-b6d2-c13875626bf5 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:50.229565 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-decd0b2b-1026-4ca9-b6d2-c13875626bf5 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:50.230337 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-decd0b2b-1026-4ca9-b6d2-c13875626bf5 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:50.231125 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-decd0b2b-1026-4ca9-b6d2-c13875626bf5 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:50.368227 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-92bca4ee-cf4d-4110-abe7-bfb1e5bfc297 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-37441478", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "76f32197-3cb6-489f-ba19-28a1d5f1755a"}], "security_groups": [{"name": "tempest-securitygroup--145051857"}], "key_name": "tempest-keypair-229843751", "user_data": "}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:03:50.645759 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-decd0b2b-1026-4ca9-b6d2-c13875626bf5 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:50.655511 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-decd0b2b-1026-4ca9-b6d2-c13875626bf5 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/3807799b-58bc-4e72-9bb6-563595c15618" status: 200 len: 1328 microversion: 2.1 time: 0.445980 Aug 27 03:03:50.656566 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2206/4378] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:50 2022] GET /compute/v2.1/servers/3807799b-58bc-4e72-9bb6-563595c15618 => generated 1328 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:03:50.667719 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.network.neutron [None req-92bca4ee-cf4d-4110-abe7-bfb1e5bfc297 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] validate_networks() for [('76f32197-3cb6-489f-ba19-28a1d5f1755a', None, None, None, None, None)] {{(pid=134052) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:03:51.200526 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-81a85e76-c651-43db-a9be-ad245be108b4 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:51.201341 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-81a85e76-c651-43db-a9be-ad245be108b4 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] [instance: 92522ed7-8ac4-44b3-94b0-0aa3941cdbae] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:51.213486 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-81a85e76-c651-43db-a9be-ad245be108b4 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:51.217238 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-81a85e76-c651-43db-a9be-ad245be108b4 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:51.218500 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-81a85e76-c651-43db-a9be-ad245be108b4 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:51.224590 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-81a85e76-c651-43db-a9be-ad245be108b4 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:51.227047 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-81a85e76-c651-43db-a9be-ad245be108b4 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:51.228093 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-81a85e76-c651-43db-a9be-ad245be108b4 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:51.882683 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:03:51.945810 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-81a85e76-c651-43db-a9be-ad245be108b4 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c3da1faaee46ca94d2a2543851f3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32a1b54e30415eb8f0e6df5e8b7be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:51.970633 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-81a85e76-c651-43db-a9be-ad245be108b4 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] 10.222.0.70 "GET /compute/v2.1/servers/92522ed7-8ac4-44b3-94b0-0aa3941cdbae" status: 200 len: 1313 microversion: 2.1 time: 0.775005 Aug 27 03:03:51.980559 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2207/4379] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:51 2022] GET /compute/v2.1/servers/92522ed7-8ac4-44b3-94b0-0aa3941cdbae => generated 1313 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:03:51.987345 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ee81e96d-32d7-412d-bc0d-042fb9b1a2f3 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8f0b94b9-8572-4142-8fd7-d2de7af3b73c"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:03:51.994549 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-ee81e96d-32d7-412d-bc0d-042fb9b1a2f3 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] [instance: f90d78a8-dea6-45c3-933c-8184ff4858b1] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:52.003129 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ee81e96d-32d7-412d-bc0d-042fb9b1a2f3 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:52.003778 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ee81e96d-32d7-412d-bc0d-042fb9b1a2f3 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:52.004342 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ee81e96d-32d7-412d-bc0d-042fb9b1a2f3 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:52.005238 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ee81e96d-32d7-412d-bc0d-042fb9b1a2f3 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:52.005732 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ee81e96d-32d7-412d-bc0d-042fb9b1a2f3 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:52.006257 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ee81e96d-32d7-412d-bc0d-042fb9b1a2f3 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:52.090353 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:03:52.310402 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ee81e96d-32d7-412d-bc0d-042fb9b1a2f3 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] 10.222.0.70 "POST /compute/v2.1/servers/f90d78a8-dea6-45c3-933c-8184ff4858b1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.328138 Aug 27 03:03:52.311308 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2208/4380] 10.222.0.70 () {60 vars in 1323 bytes} [Sat Aug 27 03:03:51 2022] POST /compute/v2.1/servers/f90d78a8-dea6-45c3-933c-8184ff4858b1/os-volume_attachments => generated 194 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:03:52.340552 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-72ba3e0c-bc07-4770-8bb6-8e4c11ba81f0 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:52.341567 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-72ba3e0c-bc07-4770-8bb6-8e4c11ba81f0 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: 3807799b-58bc-4e72-9bb6-563595c15618] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:52.349097 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-72ba3e0c-bc07-4770-8bb6-8e4c11ba81f0 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:52.349713 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-72ba3e0c-bc07-4770-8bb6-8e4c11ba81f0 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:52.350262 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-72ba3e0c-bc07-4770-8bb6-8e4c11ba81f0 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:52.351213 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-72ba3e0c-bc07-4770-8bb6-8e4c11ba81f0 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:52.351752 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-72ba3e0c-bc07-4770-8bb6-8e4c11ba81f0 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:52.352419 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-72ba3e0c-bc07-4770-8bb6-8e4c11ba81f0 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:52.871222 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-92bca4ee-cf4d-4110-abe7-bfb1e5bfc297 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Flavor limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:03:52.871885 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-92bca4ee-cf4d-4110-abe7-bfb1e5bfc297 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Image limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:03:52.873022 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-92bca4ee-cf4d-4110-abe7-bfb1e5bfc297 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Flavor pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:03:52.873655 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-92bca4ee-cf4d-4110-abe7-bfb1e5bfc297 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Image pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:03:52.874230 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-92bca4ee-cf4d-4110-abe7-bfb1e5bfc297 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:03:52.890655 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-92bca4ee-cf4d-4110-abe7-bfb1e5bfc297 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:52.898520 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-92bca4ee-cf4d-4110-abe7-bfb1e5bfc297 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:52.899324 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-92bca4ee-cf4d-4110-abe7-bfb1e5bfc297 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:52.900711 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-92bca4ee-cf4d-4110-abe7-bfb1e5bfc297 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:52.901684 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-92bca4ee-cf4d-4110-abe7-bfb1e5bfc297 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:52.902349 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-92bca4ee-cf4d-4110-abe7-bfb1e5bfc297 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:52.955262 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-92bca4ee-cf4d-4110-abe7-bfb1e5bfc297 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Getting quotas for project 1b4ca527ba3b49539b528ec8950aef78. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:03:52.968998 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-92bca4ee-cf4d-4110-abe7-bfb1e5bfc297 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Getting quotas for user 36697e722bef4a33ab158e9b2f87596a and project 1b4ca527ba3b49539b528ec8950aef78. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:03:53.010863 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-92bca4ee-cf4d-4110-abe7-bfb1e5bfc297 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Going to run 1 instances... {{(pid=134052) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:03:53.013481 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-92bca4ee-cf4d-4110-abe7-bfb1e5bfc297 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: cd881214-dd67-4897-9167-335d7e48d789] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134052) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:03:53.053282 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-72ba3e0c-bc07-4770-8bb6-8e4c11ba81f0 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:53.067932 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-72ba3e0c-bc07-4770-8bb6-8e4c11ba81f0 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/3807799b-58bc-4e72-9bb6-563595c15618" status: 200 len: 1328 microversion: 2.1 time: 0.738559 Aug 27 03:03:53.068751 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2209/4381] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:52 2022] GET /compute/v2.1/servers/3807799b-58bc-4e72-9bb6-563595c15618 => generated 1328 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:03:53.082412 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f9bf6a88-cc31-4495-a814-bdf28a01c850 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:53.083407 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-f9bf6a88-cc31-4495-a814-bdf28a01c850 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] [instance: 92522ed7-8ac4-44b3-94b0-0aa3941cdbae] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:53.101916 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f9bf6a88-cc31-4495-a814-bdf28a01c850 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:53.102973 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f9bf6a88-cc31-4495-a814-bdf28a01c850 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:53.103112 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f9bf6a88-cc31-4495-a814-bdf28a01c850 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:53.103769 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f9bf6a88-cc31-4495-a814-bdf28a01c850 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:53.104420 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f9bf6a88-cc31-4495-a814-bdf28a01c850 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:53.105098 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f9bf6a88-cc31-4495-a814-bdf28a01c850 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:53.113654 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-92bca4ee-cf4d-4110-abe7-bfb1e5bfc297 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 2.749659 Aug 27 03:03:53.115388 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2173/4382] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 03:03:50 2022] POST /compute/v2.1/servers => generated 408 bytes in 2753 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:03:53.128885 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b70d6afb-6349-45b3-a25d-cd260af532d2 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:53.143670 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b70d6afb-6349-45b3-a25d-cd260af532d2 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: cd881214-dd67-4897-9167-335d7e48d789] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:53.382060 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b70d6afb-6349-45b3-a25d-cd260af532d2 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36697e722bef4a33ab158e9b2f87596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4ca527ba3b49539b528ec8950aef78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:53.390257 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b70d6afb-6349-45b3-a25d-cd260af532d2 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "GET /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789" status: 200 len: 1243 microversion: 2.1 time: 0.266746 Aug 27 03:03:53.394056 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2174/4383] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:53 2022] GET /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789 => generated 1243 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:03:53.517221 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-05baef88-0160-44b5-b262-a8df8d5e9a82 req-27a4c1f6-e5f3-407f-b139-9866307a89dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3807799b-58bc-4e72-9bb6-563595c15618", "tag": "004e840c-8366-4b43-90bb-bbada32664a5"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:03:53.540869 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-05baef88-0160-44b5-b262-a8df8d5e9a82 req-27a4c1f6-e5f3-407f-b139-9866307a89dd service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:53.543645 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-05baef88-0160-44b5-b262-a8df8d5e9a82 req-27a4c1f6-e5f3-407f-b139-9866307a89dd service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:53.544337 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-05baef88-0160-44b5-b262-a8df8d5e9a82 req-27a4c1f6-e5f3-407f-b139-9866307a89dd service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:53.573522 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-05baef88-0160-44b5-b262-a8df8d5e9a82 req-27a4c1f6-e5f3-407f-b139-9866307a89dd service nova] Creating event network-changed:004e840c-8366-4b43-90bb-bbada32664a5 for instance 3807799b-58bc-4e72-9bb6-563595c15618 on n-h1-852278-4 Aug 27 03:03:53.584543 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-05baef88-0160-44b5-b262-a8df8d5e9a82 req-27a4c1f6-e5f3-407f-b139-9866307a89dd service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071052 Aug 27 03:03:53.586605 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2175/4384] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:03:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:03:54.091522 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5c805491-8b74-458a-817c-f52701864742 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:54.093319 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-5c805491-8b74-458a-817c-f52701864742 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: 3807799b-58bc-4e72-9bb6-563595c15618] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:54.104693 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5c805491-8b74-458a-817c-f52701864742 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:54.110986 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5c805491-8b74-458a-817c-f52701864742 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:54.111908 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5c805491-8b74-458a-817c-f52701864742 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:54.112797 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5c805491-8b74-458a-817c-f52701864742 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:54.113361 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5c805491-8b74-458a-817c-f52701864742 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:54.114028 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5c805491-8b74-458a-817c-f52701864742 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:54.341421 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-f9bf6a88-cc31-4495-a814-bdf28a01c850 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c3da1faaee46ca94d2a2543851f3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32a1b54e30415eb8f0e6df5e8b7be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:54.352099 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-f9bf6a88-cc31-4495-a814-bdf28a01c850 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] 10.222.0.70 "GET /compute/v2.1/servers/92522ed7-8ac4-44b3-94b0-0aa3941cdbae" status: 200 len: 1313 microversion: 2.1 time: 1.282129 Aug 27 03:03:54.353470 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2210/4385] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:53 2022] GET /compute/v2.1/servers/92522ed7-8ac4-44b3-94b0-0aa3941cdbae => generated 1313 bytes in 1284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:03:54.418094 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8fb2a82b-b9fb-49b4-9552-bc3c813326c3 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:54.418995 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-8fb2a82b-b9fb-49b4-9552-bc3c813326c3 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: cd881214-dd67-4897-9167-335d7e48d789] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:54.425983 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8fb2a82b-b9fb-49b4-9552-bc3c813326c3 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:54.426656 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8fb2a82b-b9fb-49b4-9552-bc3c813326c3 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:54.427200 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8fb2a82b-b9fb-49b4-9552-bc3c813326c3 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:54.428184 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8fb2a82b-b9fb-49b4-9552-bc3c813326c3 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:54.428873 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8fb2a82b-b9fb-49b4-9552-bc3c813326c3 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:54.429712 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8fb2a82b-b9fb-49b4-9552-bc3c813326c3 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:54.552879 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-8fb2a82b-b9fb-49b4-9552-bc3c813326c3 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36697e722bef4a33ab158e9b2f87596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4ca527ba3b49539b528ec8950aef78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:54.563999 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-8fb2a82b-b9fb-49b4-9552-bc3c813326c3 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "GET /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789" status: 200 len: 1295 microversion: 2.1 time: 0.149646 Aug 27 03:03:54.565192 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2211/4386] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:54 2022] GET /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789 => generated 1295 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:03:54.600742 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-5c805491-8b74-458a-817c-f52701864742 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:54.613421 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-5c805491-8b74-458a-817c-f52701864742 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/3807799b-58bc-4e72-9bb6-563595c15618" status: 200 len: 1328 microversion: 2.1 time: 0.526394 Aug 27 03:03:54.615105 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2176/4387] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:54 2022] GET /compute/v2.1/servers/3807799b-58bc-4e72-9bb6-563595c15618 => generated 1328 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:03:55.004736 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-ffb153a4-1e14-47a6-96a0-67335091e38f req-3bdc924d-fbe8-4956-8a1c-00a74e035a6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92522ed7-8ac4-44b3-94b0-0aa3941cdbae", "name": "network-vif-plugged", "status": "completed", "tag": "6fe9e210-ea15-4e46-ad72-84a07d6eedce"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:03:55.018160 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-ffb153a4-1e14-47a6-96a0-67335091e38f req-3bdc924d-fbe8-4956-8a1c-00a74e035a6d service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:55.023875 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-ffb153a4-1e14-47a6-96a0-67335091e38f req-3bdc924d-fbe8-4956-8a1c-00a74e035a6d service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:55.025718 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-ffb153a4-1e14-47a6-96a0-67335091e38f req-3bdc924d-fbe8-4956-8a1c-00a74e035a6d service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:55.057515 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-ffb153a4-1e14-47a6-96a0-67335091e38f req-3bdc924d-fbe8-4956-8a1c-00a74e035a6d service nova] Creating event network-vif-plugged:6fe9e210-ea15-4e46-ad72-84a07d6eedce for instance 92522ed7-8ac4-44b3-94b0-0aa3941cdbae on n-h2-852278-4 Aug 27 03:03:55.070338 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-ffb153a4-1e14-47a6-96a0-67335091e38f req-3bdc924d-fbe8-4956-8a1c-00a74e035a6d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071684 Aug 27 03:03:55.076588 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2212/4388] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:03:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:03:55.374433 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-88b5b34b-32c3-4f18-bd24-9ff1104c4943 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:55.377021 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-88b5b34b-32c3-4f18-bd24-9ff1104c4943 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] [instance: 92522ed7-8ac4-44b3-94b0-0aa3941cdbae] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:55.385357 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-88b5b34b-32c3-4f18-bd24-9ff1104c4943 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:55.386236 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-88b5b34b-32c3-4f18-bd24-9ff1104c4943 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:55.387049 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-88b5b34b-32c3-4f18-bd24-9ff1104c4943 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:55.388145 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-88b5b34b-32c3-4f18-bd24-9ff1104c4943 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:55.388835 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-88b5b34b-32c3-4f18-bd24-9ff1104c4943 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:55.389458 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-88b5b34b-32c3-4f18-bd24-9ff1104c4943 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:55.587987 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c9474a1d-10dd-4cb0-8f2e-b92f0b4e98ab tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:55.590615 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-c9474a1d-10dd-4cb0-8f2e-b92f0b4e98ab tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: cd881214-dd67-4897-9167-335d7e48d789] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:55.599588 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=4 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:03:55.605679 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=18 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:03:55.618952 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c9474a1d-10dd-4cb0-8f2e-b92f0b4e98ab tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:55.622725 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c9474a1d-10dd-4cb0-8f2e-b92f0b4e98ab tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:55.623546 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c9474a1d-10dd-4cb0-8f2e-b92f0b4e98ab tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:55.626498 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c9474a1d-10dd-4cb0-8f2e-b92f0b4e98ab tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:55.630566 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c9474a1d-10dd-4cb0-8f2e-b92f0b4e98ab tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:55.631390 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c9474a1d-10dd-4cb0-8f2e-b92f0b4e98ab tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:55.695779 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-88b5b34b-32c3-4f18-bd24-9ff1104c4943 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c3da1faaee46ca94d2a2543851f3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32a1b54e30415eb8f0e6df5e8b7be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:55.707585 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-88b5b34b-32c3-4f18-bd24-9ff1104c4943 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] 10.222.0.70 "GET /compute/v2.1/servers/92522ed7-8ac4-44b3-94b0-0aa3941cdbae" status: 200 len: 1313 microversion: 2.1 time: 0.337347 Aug 27 03:03:55.708209 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2177/4389] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:55 2022] GET /compute/v2.1/servers/92522ed7-8ac4-44b3-94b0-0aa3941cdbae => generated 1313 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:03:55.720343 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-03a1e3e1-33f4-41c6-87e2-95d51687e350 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:55.721061 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-03a1e3e1-33f4-41c6-87e2-95d51687e350 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: 3807799b-58bc-4e72-9bb6-563595c15618] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:55.741398 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-03a1e3e1-33f4-41c6-87e2-95d51687e350 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:55.741904 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-03a1e3e1-33f4-41c6-87e2-95d51687e350 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:55.742378 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-03a1e3e1-33f4-41c6-87e2-95d51687e350 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:55.743155 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-03a1e3e1-33f4-41c6-87e2-95d51687e350 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:55.745780 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-03a1e3e1-33f4-41c6-87e2-95d51687e350 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:55.746191 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-03a1e3e1-33f4-41c6-87e2-95d51687e350 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:55.755167 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-c9474a1d-10dd-4cb0-8f2e-b92f0b4e98ab tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36697e722bef4a33ab158e9b2f87596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4ca527ba3b49539b528ec8950aef78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:55.766280 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c9474a1d-10dd-4cb0-8f2e-b92f0b4e98ab tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "GET /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789" status: 200 len: 1301 microversion: 2.1 time: 0.183000 Aug 27 03:03:55.769055 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2213/4390] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:55 2022] GET /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789 => generated 1301 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:03:56.082707 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-03a1e3e1-33f4-41c6-87e2-95d51687e350 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:56.087199 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:03:56.095638 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-03a1e3e1-33f4-41c6-87e2-95d51687e350 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/3807799b-58bc-4e72-9bb6-563595c15618" status: 200 len: 1328 microversion: 2.1 time: 0.386151 Aug 27 03:03:56.111659 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2178/4391] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:55 2022] GET /compute/v2.1/servers/3807799b-58bc-4e72-9bb6-563595c15618 => generated 1328 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:03:56.731375 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-1fe89f19-da9c-4e9b-a5e6-a1d36e515a61 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:56.731998 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-1fe89f19-da9c-4e9b-a5e6-a1d36e515a61 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] [instance: 92522ed7-8ac4-44b3-94b0-0aa3941cdbae] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:56.746951 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1fe89f19-da9c-4e9b-a5e6-a1d36e515a61 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:56.747452 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1fe89f19-da9c-4e9b-a5e6-a1d36e515a61 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:56.748092 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1fe89f19-da9c-4e9b-a5e6-a1d36e515a61 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:56.749110 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1fe89f19-da9c-4e9b-a5e6-a1d36e515a61 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:56.749767 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1fe89f19-da9c-4e9b-a5e6-a1d36e515a61 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:56.751187 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1fe89f19-da9c-4e9b-a5e6-a1d36e515a61 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:56.792930 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-1b41f680-df67-4be6-b080-072e7daec70e tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:56.794182 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-1b41f680-df67-4be6-b080-072e7daec70e tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: cd881214-dd67-4897-9167-335d7e48d789] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:56.802313 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1b41f680-df67-4be6-b080-072e7daec70e tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:56.817127 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1b41f680-df67-4be6-b080-072e7daec70e tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:56.817834 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1b41f680-df67-4be6-b080-072e7daec70e tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:56.819994 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1b41f680-df67-4be6-b080-072e7daec70e tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:56.820661 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1b41f680-df67-4be6-b080-072e7daec70e tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:56.824976 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1b41f680-df67-4be6-b080-072e7daec70e tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:57.759891 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-1fe89f19-da9c-4e9b-a5e6-a1d36e515a61 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c3da1faaee46ca94d2a2543851f3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32a1b54e30415eb8f0e6df5e8b7be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:57.770769 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-1fe89f19-da9c-4e9b-a5e6-a1d36e515a61 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] 10.222.0.70 "GET /compute/v2.1/servers/92522ed7-8ac4-44b3-94b0-0aa3941cdbae" status: 200 len: 1498 microversion: 2.1 time: 1.043367 Aug 27 03:03:57.788505 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2214/4392] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:56 2022] GET /compute/v2.1/servers/92522ed7-8ac4-44b3-94b0-0aa3941cdbae => generated 1498 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:03:57.788505 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-6c85aefc-8354-4a23-ae53-9a55dfdd774c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:57.788505 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-6c85aefc-8354-4a23-ae53-9a55dfdd774c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: 3807799b-58bc-4e72-9bb6-563595c15618] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:57.801610 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6c85aefc-8354-4a23-ae53-9a55dfdd774c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:57.802107 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6c85aefc-8354-4a23-ae53-9a55dfdd774c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:57.802562 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6c85aefc-8354-4a23-ae53-9a55dfdd774c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:57.803263 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6c85aefc-8354-4a23-ae53-9a55dfdd774c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:57.803716 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6c85aefc-8354-4a23-ae53-9a55dfdd774c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:57.804488 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6c85aefc-8354-4a23-ae53-9a55dfdd774c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:57.834733 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-1b41f680-df67-4be6-b080-072e7daec70e tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36697e722bef4a33ab158e9b2f87596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4ca527ba3b49539b528ec8950aef78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:57.844944 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-1b41f680-df67-4be6-b080-072e7daec70e tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "GET /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789" status: 200 len: 1368 microversion: 2.1 time: 1.056588 Aug 27 03:03:57.845440 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2179/4393] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:56 2022] GET /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789 => generated 1368 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:03:57.850183 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-48284348-ff5a-4390-81c2-47b9b6d3ff34 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:03:57.871526 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-48284348-ff5a-4390-81c2-47b9b6d3ff34 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] [instance: 92522ed7-8ac4-44b3-94b0-0aa3941cdbae] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:57.895814 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-48284348-ff5a-4390-81c2-47b9b6d3ff34 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:57.896335 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-48284348-ff5a-4390-81c2-47b9b6d3ff34 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:57.896781 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-48284348-ff5a-4390-81c2-47b9b6d3ff34 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:57.897497 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-48284348-ff5a-4390-81c2-47b9b6d3ff34 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:57.897954 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-48284348-ff5a-4390-81c2-47b9b6d3ff34 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:57.898383 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-48284348-ff5a-4390-81c2-47b9b6d3ff34 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:57.991879 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.instance [None req-48284348-ff5a-4390-81c2-47b9b6d3ff34 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lazy-loading 'flavor' on Instance uuid 92522ed7-8ac4-44b3-94b0-0aa3941cdbae {{(pid=134052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:03:58.208093 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-48284348-ff5a-4390-81c2-47b9b6d3ff34 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] 10.222.0.70 "POST /compute/v2.1/servers/92522ed7-8ac4-44b3-94b0-0aa3941cdbae/action" status: 200 len: 32 microversion: 2.1 time: 0.361553 Aug 27 03:03:58.208892 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2180/4394] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:03:57 2022] POST /compute/v2.1/servers/92522ed7-8ac4-44b3-94b0-0aa3941cdbae/action => generated 32 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:03:58.238254 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0ca05976-d27d-4ebb-87f8-426b199ffd10 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:58.239129 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-0ca05976-d27d-4ebb-87f8-426b199ffd10 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] [instance: 92522ed7-8ac4-44b3-94b0-0aa3941cdbae] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:58.246472 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0ca05976-d27d-4ebb-87f8-426b199ffd10 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:58.247006 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0ca05976-d27d-4ebb-87f8-426b199ffd10 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:58.247445 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0ca05976-d27d-4ebb-87f8-426b199ffd10 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:58.248150 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0ca05976-d27d-4ebb-87f8-426b199ffd10 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:58.264825 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0ca05976-d27d-4ebb-87f8-426b199ffd10 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:58.265555 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0ca05976-d27d-4ebb-87f8-426b199ffd10 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:58.790770 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-6c85aefc-8354-4a23-ae53-9a55dfdd774c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:58.805303 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-6c85aefc-8354-4a23-ae53-9a55dfdd774c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/3807799b-58bc-4e72-9bb6-563595c15618" status: 200 len: 1328 microversion: 2.1 time: 1.027851 Aug 27 03:03:58.810523 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2215/4395] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:57 2022] GET /compute/v2.1/servers/3807799b-58bc-4e72-9bb6-563595c15618 => generated 1328 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:03:58.870662 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-dbaa995e-3350-4571-b047-17dcb5bf4e8d tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:58.871738 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-dbaa995e-3350-4571-b047-17dcb5bf4e8d tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: cd881214-dd67-4897-9167-335d7e48d789] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:58.881766 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dbaa995e-3350-4571-b047-17dcb5bf4e8d tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:58.886127 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dbaa995e-3350-4571-b047-17dcb5bf4e8d tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:58.886957 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dbaa995e-3350-4571-b047-17dcb5bf4e8d tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:58.888035 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dbaa995e-3350-4571-b047-17dcb5bf4e8d tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:58.888762 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dbaa995e-3350-4571-b047-17dcb5bf4e8d tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:58.889426 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dbaa995e-3350-4571-b047-17dcb5bf4e8d tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:59.078256 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0ca05976-d27d-4ebb-87f8-426b199ffd10 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c3da1faaee46ca94d2a2543851f3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32a1b54e30415eb8f0e6df5e8b7be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:59.102129 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-0ca05976-d27d-4ebb-87f8-426b199ffd10 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] 10.222.0.70 "GET /compute/v2.1/servers/92522ed7-8ac4-44b3-94b0-0aa3941cdbae" status: 200 len: 1504 microversion: 2.1 time: 0.885838 Aug 27 03:03:59.103602 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2181/4396] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:58 2022] GET /compute/v2.1/servers/92522ed7-8ac4-44b3-94b0-0aa3941cdbae => generated 1504 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:03:59.368911 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-cc40c166-afee-4e3b-9945-28989f516e73 req-aa62e216-77b3-4de9-a8ff-1f8142581b4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd881214-dd67-4897-9167-335d7e48d789", "tag": "2f521791-b088-40a6-a31a-f7d14fcd7ae4"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:03:59.379375 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-cc40c166-afee-4e3b-9945-28989f516e73 req-aa62e216-77b3-4de9-a8ff-1f8142581b4b service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:59.379854 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-cc40c166-afee-4e3b-9945-28989f516e73 req-aa62e216-77b3-4de9-a8ff-1f8142581b4b service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:59.380283 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-cc40c166-afee-4e3b-9945-28989f516e73 req-aa62e216-77b3-4de9-a8ff-1f8142581b4b service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:59.392876 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-cc40c166-afee-4e3b-9945-28989f516e73 req-aa62e216-77b3-4de9-a8ff-1f8142581b4b service nova] Creating event network-changed:2f521791-b088-40a6-a31a-f7d14fcd7ae4 for instance cd881214-dd67-4897-9167-335d7e48d789 on n-h2-852278-4 Aug 27 03:03:59.398278 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-cc40c166-afee-4e3b-9945-28989f516e73 req-aa62e216-77b3-4de9-a8ff-1f8142581b4b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033938 Aug 27 03:03:59.399417 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2182/4397] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:03:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:03:59.758606 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-dbaa995e-3350-4571-b047-17dcb5bf4e8d tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36697e722bef4a33ab158e9b2f87596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4ca527ba3b49539b528ec8950aef78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:59.767913 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-dbaa995e-3350-4571-b047-17dcb5bf4e8d tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "GET /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789" status: 200 len: 1368 microversion: 2.1 time: 0.901458 Aug 27 03:03:59.768563 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2216/4398] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:58 2022] GET /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789 => generated 1368 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:03:59.832078 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-de36c6b1-858a-492e-82df-796480ad094a tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:59.832904 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-de36c6b1-858a-492e-82df-796480ad094a tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: 3807799b-58bc-4e72-9bb6-563595c15618] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:59.845998 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-de36c6b1-858a-492e-82df-796480ad094a tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:59.847704 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-de36c6b1-858a-492e-82df-796480ad094a tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:59.848414 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-de36c6b1-858a-492e-82df-796480ad094a tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:59.849417 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-de36c6b1-858a-492e-82df-796480ad094a tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:59.850113 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-de36c6b1-858a-492e-82df-796480ad094a tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:59.850902 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-de36c6b1-858a-492e-82df-796480ad094a tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:00.123060 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c7f1a431-ffe1-41ad-9e65-a0ba408bcbd4 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:00.124486 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-c7f1a431-ffe1-41ad-9e65-a0ba408bcbd4 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] [instance: 92522ed7-8ac4-44b3-94b0-0aa3941cdbae] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:00.138508 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c7f1a431-ffe1-41ad-9e65-a0ba408bcbd4 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:00.139013 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c7f1a431-ffe1-41ad-9e65-a0ba408bcbd4 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:00.139470 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c7f1a431-ffe1-41ad-9e65-a0ba408bcbd4 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:00.149090 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c7f1a431-ffe1-41ad-9e65-a0ba408bcbd4 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:00.149769 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c7f1a431-ffe1-41ad-9e65-a0ba408bcbd4 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:00.150234 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c7f1a431-ffe1-41ad-9e65-a0ba408bcbd4 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:00.323073 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-de36c6b1-858a-492e-82df-796480ad094a tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:04:00.336759 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-de36c6b1-858a-492e-82df-796480ad094a tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/3807799b-58bc-4e72-9bb6-563595c15618" status: 200 len: 1328 microversion: 2.1 time: 0.510117 Aug 27 03:04:00.338049 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2183/4399] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:03:59 2022] GET /compute/v2.1/servers/3807799b-58bc-4e72-9bb6-563595c15618 => generated 1328 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:04:00.551051 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-c7f1a431-ffe1-41ad-9e65-a0ba408bcbd4 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c3da1faaee46ca94d2a2543851f3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32a1b54e30415eb8f0e6df5e8b7be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:04:00.564343 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c7f1a431-ffe1-41ad-9e65-a0ba408bcbd4 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] 10.222.0.70 "GET /compute/v2.1/servers/92522ed7-8ac4-44b3-94b0-0aa3941cdbae" status: 200 len: 1504 microversion: 2.1 time: 0.445091 Aug 27 03:04:00.576741 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2217/4400] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:04:00 2022] GET /compute/v2.1/servers/92522ed7-8ac4-44b3-94b0-0aa3941cdbae => generated 1504 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:04:00.796051 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d8ed66b7-303d-419b-bf9a-b4d89e2ca483 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:00.796785 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d8ed66b7-303d-419b-bf9a-b4d89e2ca483 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: cd881214-dd67-4897-9167-335d7e48d789] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:00.805618 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d8ed66b7-303d-419b-bf9a-b4d89e2ca483 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:00.808933 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d8ed66b7-303d-419b-bf9a-b4d89e2ca483 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:00.810825 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d8ed66b7-303d-419b-bf9a-b4d89e2ca483 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:00.812071 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d8ed66b7-303d-419b-bf9a-b4d89e2ca483 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:00.812653 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d8ed66b7-303d-419b-bf9a-b4d89e2ca483 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:00.813498 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d8ed66b7-303d-419b-bf9a-b4d89e2ca483 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:00.896846 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-4b1e9045-525b-4574-8582-114921875dbc req-fb2d3c31-0890-4e35-866b-328ab7661875 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3807799b-58bc-4e72-9bb6-563595c15618", "name": "network-vif-plugged", "status": "completed", "tag": "004e840c-8366-4b43-90bb-bbada32664a5"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:04:00.919477 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-4b1e9045-525b-4574-8582-114921875dbc req-fb2d3c31-0890-4e35-866b-328ab7661875 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:00.919962 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-4b1e9045-525b-4574-8582-114921875dbc req-fb2d3c31-0890-4e35-866b-328ab7661875 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:00.920415 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-4b1e9045-525b-4574-8582-114921875dbc req-fb2d3c31-0890-4e35-866b-328ab7661875 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:00.940378 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-4b1e9045-525b-4574-8582-114921875dbc req-fb2d3c31-0890-4e35-866b-328ab7661875 service nova] Creating event network-vif-plugged:004e840c-8366-4b43-90bb-bbada32664a5 for instance 3807799b-58bc-4e72-9bb6-563595c15618 on n-h1-852278-4 Aug 27 03:04:00.954512 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-4b1e9045-525b-4574-8582-114921875dbc req-fb2d3c31-0890-4e35-866b-328ab7661875 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061432 Aug 27 03:04:00.955237 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2218/4401] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:04:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:04:01.049481 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-d8ed66b7-303d-419b-bf9a-b4d89e2ca483 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36697e722bef4a33ab158e9b2f87596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4ca527ba3b49539b528ec8950aef78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:04:01.074046 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d8ed66b7-303d-419b-bf9a-b4d89e2ca483 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "GET /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789" status: 200 len: 1368 microversion: 2.1 time: 0.281580 Aug 27 03:04:01.075783 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2184/4402] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:04:00 2022] GET /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789 => generated 1368 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:04:01.362682 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-5defb2dd-f8a9-4603-9ad1-076b8859bd1c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:01.363488 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-5defb2dd-f8a9-4603-9ad1-076b8859bd1c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: 3807799b-58bc-4e72-9bb6-563595c15618] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:01.409370 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5defb2dd-f8a9-4603-9ad1-076b8859bd1c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:01.413509 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5defb2dd-f8a9-4603-9ad1-076b8859bd1c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:01.413960 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5defb2dd-f8a9-4603-9ad1-076b8859bd1c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:01.416196 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5defb2dd-f8a9-4603-9ad1-076b8859bd1c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:01.416700 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5defb2dd-f8a9-4603-9ad1-076b8859bd1c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:01.422139 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5defb2dd-f8a9-4603-9ad1-076b8859bd1c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:01.591487 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-05876eba-4416-47f0-9405-cc9072d7a479 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:01.592104 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-05876eba-4416-47f0-9405-cc9072d7a479 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] [instance: 92522ed7-8ac4-44b3-94b0-0aa3941cdbae] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:01.600747 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-05876eba-4416-47f0-9405-cc9072d7a479 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:01.601743 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-05876eba-4416-47f0-9405-cc9072d7a479 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:01.602346 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-05876eba-4416-47f0-9405-cc9072d7a479 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:01.603424 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-05876eba-4416-47f0-9405-cc9072d7a479 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:01.603867 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-05876eba-4416-47f0-9405-cc9072d7a479 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:01.604485 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-05876eba-4416-47f0-9405-cc9072d7a479 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:01.634581 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-5defb2dd-f8a9-4603-9ad1-076b8859bd1c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:04:01.644174 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-5defb2dd-f8a9-4603-9ad1-076b8859bd1c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/3807799b-58bc-4e72-9bb6-563595c15618" status: 200 len: 1328 microversion: 2.1 time: 0.286718 Aug 27 03:04:01.645354 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2219/4403] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:04:01 2022] GET /compute/v2.1/servers/3807799b-58bc-4e72-9bb6-563595c15618 => generated 1328 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:04:01.945356 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-05876eba-4416-47f0-9405-cc9072d7a479 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c3da1faaee46ca94d2a2543851f3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32a1b54e30415eb8f0e6df5e8b7be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:04:01.954256 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-05876eba-4416-47f0-9405-cc9072d7a479 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] 10.222.0.70 "GET /compute/v2.1/servers/92522ed7-8ac4-44b3-94b0-0aa3941cdbae" status: 200 len: 1504 microversion: 2.1 time: 0.366822 Aug 27 03:04:01.955469 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2185/4404] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:04:01 2022] GET /compute/v2.1/servers/92522ed7-8ac4-44b3-94b0-0aa3941cdbae => generated 1504 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:04:02.097259 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-668aa14a-3baa-43c7-a6e3-51b853cb72a1 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:02.097976 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-668aa14a-3baa-43c7-a6e3-51b853cb72a1 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: cd881214-dd67-4897-9167-335d7e48d789] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:02.108540 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-668aa14a-3baa-43c7-a6e3-51b853cb72a1 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:02.109032 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-668aa14a-3baa-43c7-a6e3-51b853cb72a1 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:02.109468 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-668aa14a-3baa-43c7-a6e3-51b853cb72a1 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:02.110274 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-668aa14a-3baa-43c7-a6e3-51b853cb72a1 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:02.110731 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-668aa14a-3baa-43c7-a6e3-51b853cb72a1 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:02.111150 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-668aa14a-3baa-43c7-a6e3-51b853cb72a1 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:02.498184 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-668aa14a-3baa-43c7-a6e3-51b853cb72a1 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36697e722bef4a33ab158e9b2f87596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4ca527ba3b49539b528ec8950aef78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:04:02.512389 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-668aa14a-3baa-43c7-a6e3-51b853cb72a1 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "GET /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789" status: 200 len: 1368 microversion: 2.1 time: 0.418846 Aug 27 03:04:02.527187 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2220/4405] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:04:02 2022] GET /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789 => generated 1368 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:04:02.682766 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-336b5cc7-30f2-4ecc-9dbd-310df72fca26 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:02.683326 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-336b5cc7-30f2-4ecc-9dbd-310df72fca26 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: 3807799b-58bc-4e72-9bb6-563595c15618] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:02.706773 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-336b5cc7-30f2-4ecc-9dbd-310df72fca26 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:02.707285 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-336b5cc7-30f2-4ecc-9dbd-310df72fca26 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:02.707734 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-336b5cc7-30f2-4ecc-9dbd-310df72fca26 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:02.710986 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-336b5cc7-30f2-4ecc-9dbd-310df72fca26 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:02.712092 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-336b5cc7-30f2-4ecc-9dbd-310df72fca26 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:02.712736 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-336b5cc7-30f2-4ecc-9dbd-310df72fca26 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:02.931726 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-336b5cc7-30f2-4ecc-9dbd-310df72fca26 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:04:02.947589 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:04:02.952981 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-336b5cc7-30f2-4ecc-9dbd-310df72fca26 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/3807799b-58bc-4e72-9bb6-563595c15618" status: 200 len: 1509 microversion: 2.1 time: 0.285005 Aug 27 03:04:02.968824 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2186/4406] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:04:02 2022] GET /compute/v2.1/servers/3807799b-58bc-4e72-9bb6-563595c15618 => generated 1509 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:04:02.982119 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-bb231345-7243-4bb6-a6a5-b155a7f4cd64 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:02.983011 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-bb231345-7243-4bb6-a6a5-b155a7f4cd64 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] [instance: 92522ed7-8ac4-44b3-94b0-0aa3941cdbae] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:02.993105 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bb231345-7243-4bb6-a6a5-b155a7f4cd64 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:02.993890 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bb231345-7243-4bb6-a6a5-b155a7f4cd64 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:02.997073 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-585ace42-f4a2-4dd4-9009-8dda0007f07e tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:02.997798 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bb231345-7243-4bb6-a6a5-b155a7f4cd64 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:02.998745 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bb231345-7243-4bb6-a6a5-b155a7f4cd64 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:02.999269 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bb231345-7243-4bb6-a6a5-b155a7f4cd64 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:02.999764 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bb231345-7243-4bb6-a6a5-b155a7f4cd64 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:03.003622 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-585ace42-f4a2-4dd4-9009-8dda0007f07e tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: 3807799b-58bc-4e72-9bb6-563595c15618] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:03.018627 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-585ace42-f4a2-4dd4-9009-8dda0007f07e tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:03.019238 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-585ace42-f4a2-4dd4-9009-8dda0007f07e tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:03.019775 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-585ace42-f4a2-4dd4-9009-8dda0007f07e tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:03.021705 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-585ace42-f4a2-4dd4-9009-8dda0007f07e tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:03.024065 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-585ace42-f4a2-4dd4-9009-8dda0007f07e tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:03.024687 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-585ace42-f4a2-4dd4-9009-8dda0007f07e tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:03.266711 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-bb231345-7243-4bb6-a6a5-b155a7f4cd64 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c3da1faaee46ca94d2a2543851f3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32a1b54e30415eb8f0e6df5e8b7be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:04:03.280557 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-bb231345-7243-4bb6-a6a5-b155a7f4cd64 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] 10.222.0.70 "GET /compute/v2.1/servers/92522ed7-8ac4-44b3-94b0-0aa3941cdbae" status: 200 len: 1504 microversion: 2.1 time: 0.302848 Aug 27 03:04:03.292377 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2221/4407] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:04:02 2022] GET /compute/v2.1/servers/92522ed7-8ac4-44b3-94b0-0aa3941cdbae => generated 1504 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:04:03.324089 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-585ace42-f4a2-4dd4-9009-8dda0007f07e tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:04:03.333965 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-585ace42-f4a2-4dd4-9009-8dda0007f07e tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/3807799b-58bc-4e72-9bb6-563595c15618" status: 200 len: 1509 microversion: 2.1 time: 0.342828 Aug 27 03:04:03.335183 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2187/4408] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:04:02 2022] GET /compute/v2.1/servers/3807799b-58bc-4e72-9bb6-563595c15618 => generated 1509 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:04:03.369974 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4d8ac7c3-7040-4c51-832c-6a7fdd13a355 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:03.370806 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-4d8ac7c3-7040-4c51-832c-6a7fdd13a355 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: 3807799b-58bc-4e72-9bb6-563595c15618] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:03.382110 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4d8ac7c3-7040-4c51-832c-6a7fdd13a355 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:03.383367 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4d8ac7c3-7040-4c51-832c-6a7fdd13a355 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:03.384145 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4d8ac7c3-7040-4c51-832c-6a7fdd13a355 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:03.385440 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4d8ac7c3-7040-4c51-832c-6a7fdd13a355 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:03.386498 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4d8ac7c3-7040-4c51-832c-6a7fdd13a355 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:03.387580 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4d8ac7c3-7040-4c51-832c-6a7fdd13a355 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:03.434389 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-4d8ac7c3-7040-4c51-832c-6a7fdd13a355 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: 3807799b-58bc-4e72-9bb6-563595c15618] Going to try to terminate instance {{(pid=134051) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:04:03.519761 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-4d8ac7c3-7040-4c51-832c-6a7fdd13a355 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "DELETE /compute/v2.1/servers/3807799b-58bc-4e72-9bb6-563595c15618" status: 204 len: 0 microversion: 2.1 time: 0.155492 Aug 27 03:04:03.526539 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2222/4409] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 03:04:03 2022] DELETE /compute/v2.1/servers/3807799b-58bc-4e72-9bb6-563595c15618 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:04:03.541596 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-402d8df4-83e0-430f-abe9-68c979ce49bc tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:03.543491 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-402d8df4-83e0-430f-abe9-68c979ce49bc tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: cd881214-dd67-4897-9167-335d7e48d789] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:03.551648 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-402d8df4-83e0-430f-abe9-68c979ce49bc tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:03.552162 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-402d8df4-83e0-430f-abe9-68c979ce49bc tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:03.552776 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-402d8df4-83e0-430f-abe9-68c979ce49bc tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:03.553594 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-402d8df4-83e0-430f-abe9-68c979ce49bc tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:03.554011 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9f2c56b6-07f5-4cb3-8d4c-a5ce9ec374b0 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:03.554467 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-402d8df4-83e0-430f-abe9-68c979ce49bc tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:03.554879 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-402d8df4-83e0-430f-abe9-68c979ce49bc tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:03.555636 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-9f2c56b6-07f5-4cb3-8d4c-a5ce9ec374b0 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: 3807799b-58bc-4e72-9bb6-563595c15618] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:03.564768 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=14 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:04:03.574298 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9f2c56b6-07f5-4cb3-8d4c-a5ce9ec374b0 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:03.575173 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9f2c56b6-07f5-4cb3-8d4c-a5ce9ec374b0 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:03.575781 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9f2c56b6-07f5-4cb3-8d4c-a5ce9ec374b0 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:03.581751 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9f2c56b6-07f5-4cb3-8d4c-a5ce9ec374b0 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:03.582660 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9f2c56b6-07f5-4cb3-8d4c-a5ce9ec374b0 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:03.583094 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9f2c56b6-07f5-4cb3-8d4c-a5ce9ec374b0 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:03.783480 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-9f2c56b6-07f5-4cb3-8d4c-a5ce9ec374b0 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:04:03.788604 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-402d8df4-83e0-430f-abe9-68c979ce49bc tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36697e722bef4a33ab158e9b2f87596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4ca527ba3b49539b528ec8950aef78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:04:03.791419 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:04:03.796440 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9f2c56b6-07f5-4cb3-8d4c-a5ce9ec374b0 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/3807799b-58bc-4e72-9bb6-563595c15618" status: 200 len: 1515 microversion: 2.1 time: 0.267111 Aug 27 03:04:03.797847 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2188/4410] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:04:03 2022] GET /compute/v2.1/servers/3807799b-58bc-4e72-9bb6-563595c15618 => generated 1515 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:04:03.802060 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-402d8df4-83e0-430f-abe9-68c979ce49bc tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "GET /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789" status: 200 len: 1368 microversion: 2.1 time: 0.268970 Aug 27 03:04:03.802927 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2223/4411] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:04:03 2022] GET /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789 => generated 1368 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:04:04.305452 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8764ee18-4c8d-4b23-b73f-e3422000b86e tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:04.306311 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-8764ee18-4c8d-4b23-b73f-e3422000b86e tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] [instance: 92522ed7-8ac4-44b3-94b0-0aa3941cdbae] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:04.313953 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8764ee18-4c8d-4b23-b73f-e3422000b86e tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:04.315050 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8764ee18-4c8d-4b23-b73f-e3422000b86e tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:04.315701 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8764ee18-4c8d-4b23-b73f-e3422000b86e tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:04.316770 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8764ee18-4c8d-4b23-b73f-e3422000b86e tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:04.317432 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8764ee18-4c8d-4b23-b73f-e3422000b86e tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:04.318064 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8764ee18-4c8d-4b23-b73f-e3422000b86e tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:04.548839 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-8764ee18-4c8d-4b23-b73f-e3422000b86e tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c3da1faaee46ca94d2a2543851f3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32a1b54e30415eb8f0e6df5e8b7be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:04:04.561049 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-8764ee18-4c8d-4b23-b73f-e3422000b86e tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] 10.222.0.70 "GET /compute/v2.1/servers/92522ed7-8ac4-44b3-94b0-0aa3941cdbae" status: 200 len: 1504 microversion: 2.1 time: 0.261250 Aug 27 03:04:04.562120 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2189/4412] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:04:04 2022] GET /compute/v2.1/servers/92522ed7-8ac4-44b3-94b0-0aa3941cdbae => generated 1504 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:04:04.820324 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b5d62f30-003b-4821-b33c-eaab4e25e18f tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:04.821630 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b5d62f30-003b-4821-b33c-eaab4e25e18f tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: 3807799b-58bc-4e72-9bb6-563595c15618] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:04.823738 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-58455039-c896-4c6f-8300-1e29cb42264d tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:04.825252 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-58455039-c896-4c6f-8300-1e29cb42264d tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: cd881214-dd67-4897-9167-335d7e48d789] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:04.830234 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b5d62f30-003b-4821-b33c-eaab4e25e18f tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:04.830969 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b5d62f30-003b-4821-b33c-eaab4e25e18f tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:04.831414 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b5d62f30-003b-4821-b33c-eaab4e25e18f tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:04.832125 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b5d62f30-003b-4821-b33c-eaab4e25e18f tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:04.832786 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b5d62f30-003b-4821-b33c-eaab4e25e18f tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:04.833380 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b5d62f30-003b-4821-b33c-eaab4e25e18f tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:04.833848 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-58455039-c896-4c6f-8300-1e29cb42264d tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:04.834580 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-58455039-c896-4c6f-8300-1e29cb42264d tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:04.835259 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-58455039-c896-4c6f-8300-1e29cb42264d tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:04.836685 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-58455039-c896-4c6f-8300-1e29cb42264d tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:04.837380 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-58455039-c896-4c6f-8300-1e29cb42264d tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:04.839472 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-58455039-c896-4c6f-8300-1e29cb42264d tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:05.052964 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-b5d62f30-003b-4821-b33c-eaab4e25e18f tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:04:05.058766 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-58455039-c896-4c6f-8300-1e29cb42264d tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36697e722bef4a33ab158e9b2f87596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4ca527ba3b49539b528ec8950aef78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:04:05.066977 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-58455039-c896-4c6f-8300-1e29cb42264d tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "GET /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789" status: 200 len: 1368 microversion: 2.1 time: 0.247539 Aug 27 03:04:05.068198 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2190/4413] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:04:04 2022] GET /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789 => generated 1368 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:04:05.077076 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b5d62f30-003b-4821-b33c-eaab4e25e18f tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/3807799b-58bc-4e72-9bb6-563595c15618" status: 200 len: 1515 microversion: 2.1 time: 0.252683 Aug 27 03:04:05.078290 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2224/4414] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:04:04 2022] GET /compute/v2.1/servers/3807799b-58bc-4e72-9bb6-563595c15618 => generated 1515 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:04:05.584956 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8a2fe780-a266-4bb7-9b65-e282e4472433 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:05.585590 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-8a2fe780-a266-4bb7-9b65-e282e4472433 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] [instance: 92522ed7-8ac4-44b3-94b0-0aa3941cdbae] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:05.601773 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8a2fe780-a266-4bb7-9b65-e282e4472433 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:05.602269 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8a2fe780-a266-4bb7-9b65-e282e4472433 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:05.602699 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8a2fe780-a266-4bb7-9b65-e282e4472433 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:05.603555 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8a2fe780-a266-4bb7-9b65-e282e4472433 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:05.604006 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8a2fe780-a266-4bb7-9b65-e282e4472433 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:05.604451 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8a2fe780-a266-4bb7-9b65-e282e4472433 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:05.882376 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-8a2fe780-a266-4bb7-9b65-e282e4472433 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c3da1faaee46ca94d2a2543851f3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32a1b54e30415eb8f0e6df5e8b7be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:04:05.895519 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-8a2fe780-a266-4bb7-9b65-e282e4472433 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] 10.222.0.70 "GET /compute/v2.1/servers/92522ed7-8ac4-44b3-94b0-0aa3941cdbae" status: 200 len: 1504 microversion: 2.1 time: 0.317393 Aug 27 03:04:05.900641 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2191/4415] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:04:05 2022] GET /compute/v2.1/servers/92522ed7-8ac4-44b3-94b0-0aa3941cdbae => generated 1504 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:04:05.969055 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0b8ca48f-d63e-4431-8404-51b1cff52d13 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:05.971695 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-0b8ca48f-d63e-4431-8404-51b1cff52d13 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] [instance: f90d78a8-dea6-45c3-933c-8184ff4858b1] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:05.980154 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0b8ca48f-d63e-4431-8404-51b1cff52d13 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:05.980548 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0b8ca48f-d63e-4431-8404-51b1cff52d13 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:05.980905 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0b8ca48f-d63e-4431-8404-51b1cff52d13 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:05.981612 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0b8ca48f-d63e-4431-8404-51b1cff52d13 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:05.982061 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0b8ca48f-d63e-4431-8404-51b1cff52d13 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:05.982475 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0b8ca48f-d63e-4431-8404-51b1cff52d13 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:06.039942 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-0b8ca48f-d63e-4431-8404-51b1cff52d13 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] 10.222.0.70 "GET /compute/v2.1/servers/f90d78a8-dea6-45c3-933c-8184ff4858b1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077053 Aug 27 03:04:06.047173 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2225/4416] 10.222.0.70 () {58 vars in 1302 bytes} [Sat Aug 27 03:04:05 2022] GET /compute/v2.1/servers/f90d78a8-dea6-45c3-933c-8184ff4858b1/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:04:06.052431 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c40cfb80-8c7b-4115-9595-8e2db357ba4a tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:06.053239 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-c40cfb80-8c7b-4115-9595-8e2db357ba4a tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] [instance: f90d78a8-dea6-45c3-933c-8184ff4858b1] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:06.061972 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c40cfb80-8c7b-4115-9595-8e2db357ba4a tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:06.062785 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c40cfb80-8c7b-4115-9595-8e2db357ba4a tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:06.063478 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c40cfb80-8c7b-4115-9595-8e2db357ba4a tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:06.064439 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c40cfb80-8c7b-4115-9595-8e2db357ba4a tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:06.065114 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c40cfb80-8c7b-4115-9595-8e2db357ba4a tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:06.065760 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c40cfb80-8c7b-4115-9595-8e2db357ba4a tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:06.088360 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-bd262115-2554-4fba-a52d-3ade9f64f0eb tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:06.089259 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-bd262115-2554-4fba-a52d-3ade9f64f0eb tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: cd881214-dd67-4897-9167-335d7e48d789] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:06.099372 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bd262115-2554-4fba-a52d-3ade9f64f0eb tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:06.099864 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bd262115-2554-4fba-a52d-3ade9f64f0eb tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:06.100301 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bd262115-2554-4fba-a52d-3ade9f64f0eb tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:06.103511 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bd262115-2554-4fba-a52d-3ade9f64f0eb tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:06.103982 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bd262115-2554-4fba-a52d-3ade9f64f0eb tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:06.104440 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bd262115-2554-4fba-a52d-3ade9f64f0eb tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:06.121427 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c40cfb80-8c7b-4115-9595-8e2db357ba4a tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] 10.222.0.70 "GET /compute/v2.1/servers/f90d78a8-dea6-45c3-933c-8184ff4858b1/os-volume_attachments/8f0b94b9-8572-4142-8fd7-d2de7af3b73c" status: 200 len: 194 microversion: 2.1 time: 0.073583 Aug 27 03:04:06.123230 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2192/4417] 10.222.0.70 () {58 vars in 1413 bytes} [Sat Aug 27 03:04:06 2022] GET /compute/v2.1/servers/f90d78a8-dea6-45c3-933c-8184ff4858b1/os-volume_attachments/8f0b94b9-8572-4142-8fd7-d2de7af3b73c => generated 194 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:04:06.130121 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-72f1346f-725a-4a30-9602-28d501e1f8b7 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:06.131005 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-72f1346f-725a-4a30-9602-28d501e1f8b7 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: 3807799b-58bc-4e72-9bb6-563595c15618] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:06.145191 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-72f1346f-725a-4a30-9602-28d501e1f8b7 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:06.146048 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-72f1346f-725a-4a30-9602-28d501e1f8b7 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:06.147470 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-72f1346f-725a-4a30-9602-28d501e1f8b7 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:06.148485 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-72f1346f-725a-4a30-9602-28d501e1f8b7 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:06.149186 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-72f1346f-725a-4a30-9602-28d501e1f8b7 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:06.149831 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-72f1346f-725a-4a30-9602-28d501e1f8b7 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:06.354092 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-72f1346f-725a-4a30-9602-28d501e1f8b7 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:04:06.370137 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-72f1346f-725a-4a30-9602-28d501e1f8b7 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/3807799b-58bc-4e72-9bb6-563595c15618" status: 200 len: 1473 microversion: 2.1 time: 0.245540 Aug 27 03:04:06.381712 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2193/4418] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:04:06 2022] GET /compute/v2.1/servers/3807799b-58bc-4e72-9bb6-563595c15618 => generated 1473 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:04:06.393521 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-39e520d6-bbf3-474d-bc88-57d376d2cd1c req-47f82892-195e-4375-90cc-18e5ba966322 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3807799b-58bc-4e72-9bb6-563595c15618", "name": "network-vif-deleted", "tag": "004e840c-8366-4b43-90bb-bbada32664a5"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:04:06.416719 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-39e520d6-bbf3-474d-bc88-57d376d2cd1c req-47f82892-195e-4375-90cc-18e5ba966322 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:06.417550 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-39e520d6-bbf3-474d-bc88-57d376d2cd1c req-47f82892-195e-4375-90cc-18e5ba966322 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:06.418202 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-39e520d6-bbf3-474d-bc88-57d376d2cd1c req-47f82892-195e-4375-90cc-18e5ba966322 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:06.431388 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:04:06.437876 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-39e520d6-bbf3-474d-bc88-57d376d2cd1c req-47f82892-195e-4375-90cc-18e5ba966322 service nova] Creating event network-vif-deleted:004e840c-8366-4b43-90bb-bbada32664a5 for instance 3807799b-58bc-4e72-9bb6-563595c15618 on n-h1-852278-4 Aug 27 03:04:06.445762 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-39e520d6-bbf3-474d-bc88-57d376d2cd1c req-47f82892-195e-4375-90cc-18e5ba966322 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062801 Aug 27 03:04:06.456023 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2194/4419] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:04:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:04:06.616428 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-bd262115-2554-4fba-a52d-3ade9f64f0eb tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36697e722bef4a33ab158e9b2f87596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4ca527ba3b49539b528ec8950aef78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:04:06.650519 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-bd262115-2554-4fba-a52d-3ade9f64f0eb tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "GET /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789" status: 200 len: 1368 microversion: 2.1 time: 0.564587 Aug 27 03:04:06.660872 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2226/4420] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:04:06 2022] GET /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789 => generated 1368 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:04:06.933401 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9b5a1043-603e-43e3-806a-69b52e5a8218 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:06.934963 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-9b5a1043-603e-43e3-806a-69b52e5a8218 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] [instance: 92522ed7-8ac4-44b3-94b0-0aa3941cdbae] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:06.942208 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9b5a1043-603e-43e3-806a-69b52e5a8218 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:06.942803 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9b5a1043-603e-43e3-806a-69b52e5a8218 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:06.943516 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9b5a1043-603e-43e3-806a-69b52e5a8218 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:06.944533 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9b5a1043-603e-43e3-806a-69b52e5a8218 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:06.945218 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9b5a1043-603e-43e3-806a-69b52e5a8218 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:06.945905 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9b5a1043-603e-43e3-806a-69b52e5a8218 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:06.994028 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-2b18f975-e3e6-477e-98e4-b504af01001e req-ee2d5d0b-f665-4ea9-bf40-5e3b7ffb2bbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd881214-dd67-4897-9167-335d7e48d789", "name": "network-vif-plugged", "status": "completed", "tag": "2f521791-b088-40a6-a31a-f7d14fcd7ae4"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:04:07.021460 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-2b18f975-e3e6-477e-98e4-b504af01001e req-ee2d5d0b-f665-4ea9-bf40-5e3b7ffb2bbb service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:07.021949 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-2b18f975-e3e6-477e-98e4-b504af01001e req-ee2d5d0b-f665-4ea9-bf40-5e3b7ffb2bbb service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:07.026007 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-2b18f975-e3e6-477e-98e4-b504af01001e req-ee2d5d0b-f665-4ea9-bf40-5e3b7ffb2bbb service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:07.052905 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-2b18f975-e3e6-477e-98e4-b504af01001e req-ee2d5d0b-f665-4ea9-bf40-5e3b7ffb2bbb service nova] Creating event network-vif-plugged:2f521791-b088-40a6-a31a-f7d14fcd7ae4 for instance cd881214-dd67-4897-9167-335d7e48d789 on n-h2-852278-4 Aug 27 03:04:07.068184 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-2b18f975-e3e6-477e-98e4-b504af01001e req-ee2d5d0b-f665-4ea9-bf40-5e3b7ffb2bbb service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076376 Aug 27 03:04:07.069439 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2227/4421] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:04:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:04:07.330354 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-9b5a1043-603e-43e3-806a-69b52e5a8218 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c3da1faaee46ca94d2a2543851f3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32a1b54e30415eb8f0e6df5e8b7be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:04:07.345235 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9b5a1043-603e-43e3-806a-69b52e5a8218 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] 10.222.0.70 "GET /compute/v2.1/servers/92522ed7-8ac4-44b3-94b0-0aa3941cdbae" status: 200 len: 1504 microversion: 2.1 time: 0.426839 Aug 27 03:04:07.346162 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2195/4422] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:04:06 2022] GET /compute/v2.1/servers/92522ed7-8ac4-44b3-94b0-0aa3941cdbae => generated 1504 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:04:07.403743 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a7d20087-4834-4f06-8a4b-5da33e404acb tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:07.405846 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-a7d20087-4834-4f06-8a4b-5da33e404acb tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: 3807799b-58bc-4e72-9bb6-563595c15618] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:07.419756 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a7d20087-4834-4f06-8a4b-5da33e404acb tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:07.420637 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a7d20087-4834-4f06-8a4b-5da33e404acb tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:07.421267 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a7d20087-4834-4f06-8a4b-5da33e404acb tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:07.422182 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a7d20087-4834-4f06-8a4b-5da33e404acb tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:07.422923 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a7d20087-4834-4f06-8a4b-5da33e404acb tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:07.430072 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a7d20087-4834-4f06-8a4b-5da33e404acb tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:07.464852 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-a7d20087-4834-4f06-8a4b-5da33e404acb tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] HTTP exception thrown: Instance 3807799b-58bc-4e72-9bb6-563595c15618 could not be found. Aug 27 03:04:07.471004 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a7d20087-4834-4f06-8a4b-5da33e404acb tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Request method failure captured: Aug 27 03:04:07.471004 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/3807799b-58bc-4e72-9bb6-563595c15618 HTTP/1.1 Aug 27 03:04:07.471004 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 03:04:07.471004 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 03:04:07.471004 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 03:04:07.471004 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 03:04:07.471004 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 03:04:07.471004 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 03:04:07.471004 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 03:04:07.471004 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 03:04:07.471004 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYljOihuPJQy-4KxXQ6OhbQw2FQiYByi8_J9EYziHxHrRpgpXLGNvb0hsYYYVptKud4yCoN0X9GxdS_QRHpRChZ0P7CrkMR6MvE3oNyvsgDIOynlxCCmMse1aD34uMngOe0Z8wMpnS_90nVB9LjwZPMQBiRDrvzydhSu6jwK0Njtp_4 Aug 27 03:04:07.471004 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 03:04:07.471004 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 03:04:07.471004 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 03:04:07.471004 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 03:04:07.471004 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 03:04:07.471004 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 03:04:07.471004 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 6b8d6664c463420bad9a5bfb6d747db4 Aug 27 03:04:07.471004 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ServersTestJSON-252485458 Aug 27 03:04:07.471004 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 03:04:07.471004 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 03:04:07.471004 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6b8d6664c463420bad9a5bfb6d747db4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_6b8d6664c463420bad9a5bfb6d747db4", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6b8d6664c463420bad9a5bfb6d747db4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/6b8d6664c463420bad9a5bfb6d747db4"}]}] Aug 27 03:04:07.471004 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ServersTestJSON-252485458 Aug 27 03:04:07.471004 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 6b8d6664c463420bad9a5bfb6d747db4 Aug 27 03:04:07.471004 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ServersTestJSON-252485458 Aug 27 03:04:07.471004 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ServersTestJSON-252485458-project Aug 27 03:04:07.471004 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 03:04:07.471004 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 03:04:07.471004 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 13a4e6dcf5df46fcad30430a9b9a08ee Aug 27 03:04:07.471004 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ServersTestJSON-252485458-project Aug 27 03:04:07.471004 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 03:04:07.471004 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance 3807799b-58bc-4e72-9bb6-563595c15618 could not be found. Aug 27 03:04:07.471004 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '3807799b-58bc-4e72-9bb6-563595c15618'} Aug 27 03:04:07.471004 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:04:07.471004 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:04:07.471004 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:04:07.471004 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:04:07.471004 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:04:07.471004 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:04:07.471004 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:04:07.471004 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:04:07.471004 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:04:07.471004 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:04:07.471004 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3807799b-58bc-4e72-9bb6-563595c15618 could not be found. Aug 27 03:04:07.471004 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:04:07.471004 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:04:07.471004 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:04:07.471004 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:04:07.471004 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:04:07.471004 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:04:07.471004 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:04:07.471004 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:04:07.471004 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:04:07.471004 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:04:07.471004 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:04:07.471004 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:04:07.471004 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:04:07.471004 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:04:07.471004 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:04:07.471004 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:04:07.471004 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3807799b-58bc-4e72-9bb6-563595c15618 could not be found. Aug 27 03:04:07.471004 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:04:07.471004 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:04:07.471004 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:04:07.471004 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:04:07.477818 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:04:07.477818 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:04:07.477818 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:04:07.477818 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:04:07.477818 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3807799b-58bc-4e72-9bb6-563595c15618 could not be found. Aug 27 03:04:07.477818 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:04:07.477818 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a7d20087-4834-4f06-8a4b-5da33e404acb tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Returning 404 to user: Instance 3807799b-58bc-4e72-9bb6-563595c15618 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:04:07.477818 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a7d20087-4834-4f06-8a4b-5da33e404acb tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/3807799b-58bc-4e72-9bb6-563595c15618" status: 404 len: 111 microversion: 2.1 time: 0.073237 Aug 27 03:04:07.477818 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2228/4423] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:04:07 2022] GET /compute/v2.1/servers/3807799b-58bc-4e72-9bb6-563595c15618 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:04:07.486413 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9d157311-4b51-4ef7-8987-7c7b1816553f tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '.version_select at 0x7f5ee1ee13a0>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:07.536880 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9d157311-4b51-4ef7-8987-7c7b1816553f tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-key-1721505323" status: 202 len: 0 microversion: 2.1 time: 0.057560 Aug 27 03:04:07.537797 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2196/4424] 10.222.0.70 () {58 vars in 1209 bytes} [Sat Aug 27 03:04:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-1721505323 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:04:07.674258 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-1fa8e829-6811-4a59-ab38-2f6a7577d91a tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:07.676716 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-1fa8e829-6811-4a59-ab38-2f6a7577d91a tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: cd881214-dd67-4897-9167-335d7e48d789] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:07.687900 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1fa8e829-6811-4a59-ab38-2f6a7577d91a tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:07.697025 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1fa8e829-6811-4a59-ab38-2f6a7577d91a tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:07.697691 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1fa8e829-6811-4a59-ab38-2f6a7577d91a tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:07.698639 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1fa8e829-6811-4a59-ab38-2f6a7577d91a tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:07.698777 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-51e6cc95-aaa4-4429-a34e-53fbfd793000 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1084653579", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "networks": [{"uuid": "961028dd-9dfc-4287-bc1b-27b14d79a81a"}]}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:04:07.704856 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1fa8e829-6811-4a59-ab38-2f6a7577d91a tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:07.705493 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1fa8e829-6811-4a59-ab38-2f6a7577d91a tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:07.808298 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.network.neutron [None req-51e6cc95-aaa4-4429-a34e-53fbfd793000 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] validate_networks() for [('961028dd-9dfc-4287-bc1b-27b14d79a81a', None, None, None, None, None)] {{(pid=134052) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:04:08.088233 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-1fa8e829-6811-4a59-ab38-2f6a7577d91a tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36697e722bef4a33ab158e9b2f87596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4ca527ba3b49539b528ec8950aef78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:04:08.097354 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-1fa8e829-6811-4a59-ab38-2f6a7577d91a tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "GET /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789" status: 200 len: 1368 microversion: 2.1 time: 0.427414 Aug 27 03:04:08.098537 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2229/4425] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:04:07 2022] GET /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789 => generated 1368 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:04:08.365604 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-60c23796-5490-47b4-a862-a3184fe7b61f tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:08.366591 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-60c23796-5490-47b4-a862-a3184fe7b61f tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] [instance: 92522ed7-8ac4-44b3-94b0-0aa3941cdbae] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:08.373107 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-60c23796-5490-47b4-a862-a3184fe7b61f tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:08.373590 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-60c23796-5490-47b4-a862-a3184fe7b61f tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:08.374041 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-60c23796-5490-47b4-a862-a3184fe7b61f tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:08.374750 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-60c23796-5490-47b4-a862-a3184fe7b61f tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:08.375165 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-60c23796-5490-47b4-a862-a3184fe7b61f tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:08.376177 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-60c23796-5490-47b4-a862-a3184fe7b61f tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:09.010068 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-51e6cc95-aaa4-4429-a34e-53fbfd793000 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Flavor limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:04:09.011711 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-51e6cc95-aaa4-4429-a34e-53fbfd793000 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Image limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:04:09.012372 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-51e6cc95-aaa4-4429-a34e-53fbfd793000 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Flavor pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:04:09.012924 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-51e6cc95-aaa4-4429-a34e-53fbfd793000 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Image pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:04:09.013799 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-51e6cc95-aaa4-4429-a34e-53fbfd793000 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:04:09.027886 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-60c23796-5490-47b4-a862-a3184fe7b61f tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c3da1faaee46ca94d2a2543851f3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32a1b54e30415eb8f0e6df5e8b7be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:04:09.028347 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-51e6cc95-aaa4-4429-a34e-53fbfd793000 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:09.029234 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-51e6cc95-aaa4-4429-a34e-53fbfd793000 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:09.029827 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-51e6cc95-aaa4-4429-a34e-53fbfd793000 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:09.030722 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-51e6cc95-aaa4-4429-a34e-53fbfd793000 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:09.031442 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-51e6cc95-aaa4-4429-a34e-53fbfd793000 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:09.033094 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-51e6cc95-aaa4-4429-a34e-53fbfd793000 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:09.044014 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-60c23796-5490-47b4-a862-a3184fe7b61f tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] 10.222.0.70 "GET /compute/v2.1/servers/92522ed7-8ac4-44b3-94b0-0aa3941cdbae" status: 200 len: 1504 microversion: 2.1 time: 0.682388 Aug 27 03:04:09.048561 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2230/4426] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:04:08 2022] GET /compute/v2.1/servers/92522ed7-8ac4-44b3-94b0-0aa3941cdbae => generated 1504 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:04:09.061111 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-21981096-8537-4c92-be1b-3ac11b6048c6 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "089d136d-e93f-43ad-b964-d595133aadcf"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:04:09.069929 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-21981096-8537-4c92-be1b-3ac11b6048c6 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] [instance: f90d78a8-dea6-45c3-933c-8184ff4858b1] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:09.084293 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-51e6cc95-aaa4-4429-a34e-53fbfd793000 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Getting quotas for project 6b8d6664c463420bad9a5bfb6d747db4. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:04:09.085680 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-21981096-8537-4c92-be1b-3ac11b6048c6 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:09.086555 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-21981096-8537-4c92-be1b-3ac11b6048c6 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:09.086701 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-21981096-8537-4c92-be1b-3ac11b6048c6 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:09.087322 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-21981096-8537-4c92-be1b-3ac11b6048c6 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:09.087775 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-21981096-8537-4c92-be1b-3ac11b6048c6 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:09.088200 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-21981096-8537-4c92-be1b-3ac11b6048c6 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:09.090029 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-51e6cc95-aaa4-4429-a34e-53fbfd793000 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Getting quotas for user 13a4e6dcf5df46fcad30430a9b9a08ee and project 6b8d6664c463420bad9a5bfb6d747db4. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:04:09.106735 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-51e6cc95-aaa4-4429-a34e-53fbfd793000 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Going to run 1 instances... {{(pid=134052) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:04:09.110076 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-51e6cc95-aaa4-4429-a34e-53fbfd793000 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: d8e61004-a8c1-4880-82b3-133f361a0dfc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134052) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:04:09.167603 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-51e6cc95-aaa4-4429-a34e-53fbfd793000 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.473063 Aug 27 03:04:09.169172 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2197/4427] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 03:04:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1475 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 03:04:09.186897 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3f0b0c21-e96d-49ed-b404-8d969aaa36d0 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:09.194404 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-3f0b0c21-e96d-49ed-b404-8d969aaa36d0 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: cd881214-dd67-4897-9167-335d7e48d789] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:09.204777 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3f0b0c21-e96d-49ed-b404-8d969aaa36d0 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:09.205592 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3f0b0c21-e96d-49ed-b404-8d969aaa36d0 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:09.206283 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3f0b0c21-e96d-49ed-b404-8d969aaa36d0 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:09.208015 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3f0b0c21-e96d-49ed-b404-8d969aaa36d0 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:09.208775 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3f0b0c21-e96d-49ed-b404-8d969aaa36d0 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:09.209504 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3f0b0c21-e96d-49ed-b404-8d969aaa36d0 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:09.499146 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-21981096-8537-4c92-be1b-3ac11b6048c6 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] 10.222.0.70 "POST /compute/v2.1/servers/f90d78a8-dea6-45c3-933c-8184ff4858b1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.448029 Aug 27 03:04:09.527288 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-3f0b0c21-e96d-49ed-b404-8d969aaa36d0 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36697e722bef4a33ab158e9b2f87596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4ca527ba3b49539b528ec8950aef78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:04:09.538934 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-3f0b0c21-e96d-49ed-b404-8d969aaa36d0 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "GET /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789" status: 200 len: 1562 microversion: 2.1 time: 0.368436 Aug 27 03:04:09.545550 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2231/4428] 10.222.0.70 () {60 vars in 1323 bytes} [Sat Aug 27 03:04:09 2022] POST /compute/v2.1/servers/f90d78a8-dea6-45c3-933c-8184ff4858b1/os-volume_attachments => generated 194 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:04:09.550007 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2198/4429] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:04:09 2022] GET /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789 => generated 1562 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:04:09.558803 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e1a421f3-3b59-4c21-974b-1ddff1c1fe4d tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:09.560330 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-e1a421f3-3b59-4c21-974b-1ddff1c1fe4d tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: d8e61004-a8c1-4880-82b3-133f361a0dfc] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:09.580862 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c8f948a7-4326-4483-9cd3-37b1c919c882 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:09.581662 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-c8f948a7-4326-4483-9cd3-37b1c919c882 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: cd881214-dd67-4897-9167-335d7e48d789] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:09.602898 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c8f948a7-4326-4483-9cd3-37b1c919c882 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:09.603920 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c8f948a7-4326-4483-9cd3-37b1c919c882 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:09.604630 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c8f948a7-4326-4483-9cd3-37b1c919c882 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:09.607525 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c8f948a7-4326-4483-9cd3-37b1c919c882 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:09.610971 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c8f948a7-4326-4483-9cd3-37b1c919c882 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:09.611683 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c8f948a7-4326-4483-9cd3-37b1c919c882 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:09.678092 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e1a421f3-3b59-4c21-974b-1ddff1c1fe4d tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:04:09.686911 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e1a421f3-3b59-4c21-974b-1ddff1c1fe4d tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/d8e61004-a8c1-4880-82b3-133f361a0dfc" status: 200 len: 1209 microversion: 2.1 time: 0.139296 Aug 27 03:04:09.690285 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2232/4430] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:04:09 2022] GET /compute/v2.1/servers/d8e61004-a8c1-4880-82b3-133f361a0dfc => generated 1209 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:04:09.780874 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c8f948a7-4326-4483-9cd3-37b1c919c882 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "GET /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.210929 Aug 27 03:04:09.782019 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2199/4431] 10.222.0.70 () {58 vars in 1275 bytes} [Sat Aug 27 03:04:09 2022] GET /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789/os-interface => generated 284 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:04:10.073283 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-2ac60ecf-12f3-43da-ab79-5d5b8269ec43 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:10.073899 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-2ac60ecf-12f3-43da-ab79-5d5b8269ec43 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] [instance: 92522ed7-8ac4-44b3-94b0-0aa3941cdbae] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:10.083203 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2ac60ecf-12f3-43da-ab79-5d5b8269ec43 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:10.083998 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2ac60ecf-12f3-43da-ab79-5d5b8269ec43 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:10.084644 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2ac60ecf-12f3-43da-ab79-5d5b8269ec43 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:10.085529 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2ac60ecf-12f3-43da-ab79-5d5b8269ec43 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:10.086148 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2ac60ecf-12f3-43da-ab79-5d5b8269ec43 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:10.086736 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2ac60ecf-12f3-43da-ab79-5d5b8269ec43 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:10.282635 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-2ac60ecf-12f3-43da-ab79-5d5b8269ec43 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c3da1faaee46ca94d2a2543851f3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32a1b54e30415eb8f0e6df5e8b7be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:04:10.292253 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-2ac60ecf-12f3-43da-ab79-5d5b8269ec43 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] 10.222.0.70 "GET /compute/v2.1/servers/92522ed7-8ac4-44b3-94b0-0aa3941cdbae" status: 200 len: 1504 microversion: 2.1 time: 0.222872 Aug 27 03:04:10.293117 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2233/4432] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:04:10 2022] GET /compute/v2.1/servers/92522ed7-8ac4-44b3-94b0-0aa3941cdbae => generated 1504 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:04:10.710852 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-73db15fc-e831-4974-8561-a2fd334a4b8e tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:10.712029 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-73db15fc-e831-4974-8561-a2fd334a4b8e tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: d8e61004-a8c1-4880-82b3-133f361a0dfc] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:10.726874 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-73db15fc-e831-4974-8561-a2fd334a4b8e tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:10.727370 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-73db15fc-e831-4974-8561-a2fd334a4b8e tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:10.727800 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-73db15fc-e831-4974-8561-a2fd334a4b8e tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:10.728529 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-73db15fc-e831-4974-8561-a2fd334a4b8e tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:10.729146 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-73db15fc-e831-4974-8561-a2fd334a4b8e tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:10.729726 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-73db15fc-e831-4974-8561-a2fd334a4b8e tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:10.799894 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-73db15fc-e831-4974-8561-a2fd334a4b8e tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:04:10.808394 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-73db15fc-e831-4974-8561-a2fd334a4b8e tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/d8e61004-a8c1-4880-82b3-133f361a0dfc" status: 200 len: 1261 microversion: 2.1 time: 0.102479 Aug 27 03:04:10.810547 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2200/4433] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:04:10 2022] GET /compute/v2.1/servers/d8e61004-a8c1-4880-82b3-133f361a0dfc => generated 1261 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:04:11.316364 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b4bc3e5b-5e9b-48a7-b26f-b39d7b567b1c tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:11.317007 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b4bc3e5b-5e9b-48a7-b26f-b39d7b567b1c tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] [instance: 92522ed7-8ac4-44b3-94b0-0aa3941cdbae] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:11.332189 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b4bc3e5b-5e9b-48a7-b26f-b39d7b567b1c tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:11.332772 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b4bc3e5b-5e9b-48a7-b26f-b39d7b567b1c tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:11.334965 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b4bc3e5b-5e9b-48a7-b26f-b39d7b567b1c tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:11.335812 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b4bc3e5b-5e9b-48a7-b26f-b39d7b567b1c tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:11.336289 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b4bc3e5b-5e9b-48a7-b26f-b39d7b567b1c tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:11.336925 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b4bc3e5b-5e9b-48a7-b26f-b39d7b567b1c tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:11.832210 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4212acd9-1c59-4385-b950-5d424999cb6f tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:11.833615 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-4212acd9-1c59-4385-b950-5d424999cb6f tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: d8e61004-a8c1-4880-82b3-133f361a0dfc] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:11.842547 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4212acd9-1c59-4385-b950-5d424999cb6f tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:11.843491 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4212acd9-1c59-4385-b950-5d424999cb6f tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:11.844163 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4212acd9-1c59-4385-b950-5d424999cb6f tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:11.845083 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4212acd9-1c59-4385-b950-5d424999cb6f tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:11.845738 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4212acd9-1c59-4385-b950-5d424999cb6f tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:11.846378 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4212acd9-1c59-4385-b950-5d424999cb6f tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:11.888908 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-b4bc3e5b-5e9b-48a7-b26f-b39d7b567b1c tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c3da1faaee46ca94d2a2543851f3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32a1b54e30415eb8f0e6df5e8b7be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:04:11.898025 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b4bc3e5b-5e9b-48a7-b26f-b39d7b567b1c tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] 10.222.0.70 "GET /compute/v2.1/servers/92522ed7-8ac4-44b3-94b0-0aa3941cdbae" status: 200 len: 1504 microversion: 2.1 time: 0.586985 Aug 27 03:04:11.898665 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2234/4434] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:04:11 2022] GET /compute/v2.1/servers/92522ed7-8ac4-44b3-94b0-0aa3941cdbae => generated 1504 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:04:12.034292 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-03e10ce9-02e6-43bc-831f-bb05a08f6ef1 req-04d37216-c0c0-45f1-a99b-53b3fb8924aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd881214-dd67-4897-9167-335d7e48d789", "tag": "2f521791-b088-40a6-a31a-f7d14fcd7ae4"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:04:12.059247 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-03e10ce9-02e6-43bc-831f-bb05a08f6ef1 req-04d37216-c0c0-45f1-a99b-53b3fb8924aa service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:12.062990 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-03e10ce9-02e6-43bc-831f-bb05a08f6ef1 req-04d37216-c0c0-45f1-a99b-53b3fb8924aa service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:12.063725 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-03e10ce9-02e6-43bc-831f-bb05a08f6ef1 req-04d37216-c0c0-45f1-a99b-53b3fb8924aa service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:12.106388 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-03e10ce9-02e6-43bc-831f-bb05a08f6ef1 req-04d37216-c0c0-45f1-a99b-53b3fb8924aa service nova] Creating event network-changed:2f521791-b088-40a6-a31a-f7d14fcd7ae4 for instance cd881214-dd67-4897-9167-335d7e48d789 on n-h2-852278-4 Aug 27 03:04:12.127447 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-03e10ce9-02e6-43bc-831f-bb05a08f6ef1 req-04d37216-c0c0-45f1-a99b-53b3fb8924aa service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097656 Aug 27 03:04:12.133283 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2235/4435] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:04:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:04:12.189226 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-4212acd9-1c59-4385-b950-5d424999cb6f tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:04:12.204545 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-4212acd9-1c59-4385-b950-5d424999cb6f tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/d8e61004-a8c1-4880-82b3-133f361a0dfc" status: 200 len: 1267 microversion: 2.1 time: 0.375838 Aug 27 03:04:12.208659 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2201/4436] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:04:11 2022] GET /compute/v2.1/servers/d8e61004-a8c1-4880-82b3-133f361a0dfc => generated 1267 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:04:12.946431 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8a69bbf0-86da-4ba4-9ad6-db4eb4f75c82 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:12.946431 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-8a69bbf0-86da-4ba4-9ad6-db4eb4f75c82 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] [instance: 92522ed7-8ac4-44b3-94b0-0aa3941cdbae] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:13.027146 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8a69bbf0-86da-4ba4-9ad6-db4eb4f75c82 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:13.027640 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8a69bbf0-86da-4ba4-9ad6-db4eb4f75c82 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:13.037697 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8a69bbf0-86da-4ba4-9ad6-db4eb4f75c82 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:13.042136 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8a69bbf0-86da-4ba4-9ad6-db4eb4f75c82 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:13.043459 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8a69bbf0-86da-4ba4-9ad6-db4eb4f75c82 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:13.044121 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8a69bbf0-86da-4ba4-9ad6-db4eb4f75c82 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:13.228530 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-734ace5a-692d-4795-8295-39ce75acbba2 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:13.229361 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-734ace5a-692d-4795-8295-39ce75acbba2 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: d8e61004-a8c1-4880-82b3-133f361a0dfc] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:13.253163 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-734ace5a-692d-4795-8295-39ce75acbba2 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:13.256682 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-734ace5a-692d-4795-8295-39ce75acbba2 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:13.257544 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-734ace5a-692d-4795-8295-39ce75acbba2 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:13.258743 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-734ace5a-692d-4795-8295-39ce75acbba2 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:13.261316 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-734ace5a-692d-4795-8295-39ce75acbba2 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:13.265759 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-734ace5a-692d-4795-8295-39ce75acbba2 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:14.281325 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-734ace5a-692d-4795-8295-39ce75acbba2 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:04:14.282707 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-8a69bbf0-86da-4ba4-9ad6-db4eb4f75c82 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c3da1faaee46ca94d2a2543851f3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32a1b54e30415eb8f0e6df5e8b7be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:04:14.294002 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-734ace5a-692d-4795-8295-39ce75acbba2 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/d8e61004-a8c1-4880-82b3-133f361a0dfc" status: 200 len: 1309 microversion: 2.1 time: 1.069702 Aug 27 03:04:14.295093 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2202/4437] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:04:13 2022] GET /compute/v2.1/servers/d8e61004-a8c1-4880-82b3-133f361a0dfc => generated 1309 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:04:14.296063 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-8a69bbf0-86da-4ba4-9ad6-db4eb4f75c82 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] 10.222.0.70 "GET /compute/v2.1/servers/92522ed7-8ac4-44b3-94b0-0aa3941cdbae" status: 200 len: 1504 microversion: 2.1 time: 1.380064 Aug 27 03:04:14.299663 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2236/4438] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:04:12 2022] GET /compute/v2.1/servers/92522ed7-8ac4-44b3-94b0-0aa3941cdbae => generated 1504 bytes in 1384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:04:15.315416 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a62fe748-bfc7-4f26-9478-af1bb58bbc78 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:15.316028 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a62fe748-bfc7-4f26-9478-af1bb58bbc78 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: d8e61004-a8c1-4880-82b3-133f361a0dfc] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:15.328004 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-31b60f91-d751-4814-983a-831c864af1e5 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:15.329865 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-31b60f91-d751-4814-983a-831c864af1e5 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] [instance: 92522ed7-8ac4-44b3-94b0-0aa3941cdbae] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:15.333880 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a62fe748-bfc7-4f26-9478-af1bb58bbc78 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:15.334551 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a62fe748-bfc7-4f26-9478-af1bb58bbc78 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:15.335315 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a62fe748-bfc7-4f26-9478-af1bb58bbc78 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:15.336217 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a62fe748-bfc7-4f26-9478-af1bb58bbc78 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:15.336847 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a62fe748-bfc7-4f26-9478-af1bb58bbc78 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:15.337429 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a62fe748-bfc7-4f26-9478-af1bb58bbc78 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:15.364813 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:04:15.371883 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-31b60f91-d751-4814-983a-831c864af1e5 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:15.372648 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-31b60f91-d751-4814-983a-831c864af1e5 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:15.373747 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-31b60f91-d751-4814-983a-831c864af1e5 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:15.374668 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-31b60f91-d751-4814-983a-831c864af1e5 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:15.375292 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-31b60f91-d751-4814-983a-831c864af1e5 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:15.375941 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-31b60f91-d751-4814-983a-831c864af1e5 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:16.209065 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-31b60f91-d751-4814-983a-831c864af1e5 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c3da1faaee46ca94d2a2543851f3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32a1b54e30415eb8f0e6df5e8b7be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:04:16.215208 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-a62fe748-bfc7-4f26-9478-af1bb58bbc78 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:04:16.218721 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-31b60f91-d751-4814-983a-831c864af1e5 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] 10.222.0.70 "GET /compute/v2.1/servers/92522ed7-8ac4-44b3-94b0-0aa3941cdbae" status: 200 len: 1504 microversion: 2.1 time: 0.897408 Aug 27 03:04:16.223392 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2237/4439] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:04:15 2022] GET /compute/v2.1/servers/92522ed7-8ac4-44b3-94b0-0aa3941cdbae => generated 1504 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:04:16.242044 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a62fe748-bfc7-4f26-9478-af1bb58bbc78 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/d8e61004-a8c1-4880-82b3-133f361a0dfc" status: 200 len: 1309 microversion: 2.1 time: 0.930555 Aug 27 03:04:16.242907 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2203/4440] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:04:15 2022] GET /compute/v2.1/servers/d8e61004-a8c1-4880-82b3-133f361a0dfc => generated 1309 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:04:16.558442 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-2c3ee6ec-4836-4262-aada-4f23fd0e3cab req-8187bdcf-df3e-45f3-ae20-0fa92825b4ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8e61004-a8c1-4880-82b3-133f361a0dfc", "tag": "9982dd2b-2350-45ae-a8e5-12cd3add9bf3"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:04:16.580342 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-2c3ee6ec-4836-4262-aada-4f23fd0e3cab req-8187bdcf-df3e-45f3-ae20-0fa92825b4ec service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:16.581108 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-2c3ee6ec-4836-4262-aada-4f23fd0e3cab req-8187bdcf-df3e-45f3-ae20-0fa92825b4ec service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:16.581709 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-2c3ee6ec-4836-4262-aada-4f23fd0e3cab req-8187bdcf-df3e-45f3-ae20-0fa92825b4ec service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:16.602517 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-2c3ee6ec-4836-4262-aada-4f23fd0e3cab req-8187bdcf-df3e-45f3-ae20-0fa92825b4ec service nova] Creating event network-changed:9982dd2b-2350-45ae-a8e5-12cd3add9bf3 for instance d8e61004-a8c1-4880-82b3-133f361a0dfc on n-h1-852278-4 Aug 27 03:04:16.608155 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-2c3ee6ec-4836-4262-aada-4f23fd0e3cab req-8187bdcf-df3e-45f3-ae20-0fa92825b4ec service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054200 Aug 27 03:04:16.609312 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2238/4441] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:04:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:04:17.242830 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-af370b4b-568e-407b-84c6-286535e5cebb tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:17.244129 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-af370b4b-568e-407b-84c6-286535e5cebb tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] [instance: 92522ed7-8ac4-44b3-94b0-0aa3941cdbae] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:17.252150 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-af370b4b-568e-407b-84c6-286535e5cebb tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:17.253186 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-af370b4b-568e-407b-84c6-286535e5cebb tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:17.253776 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-af370b4b-568e-407b-84c6-286535e5cebb tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:17.254676 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-af370b4b-568e-407b-84c6-286535e5cebb tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:17.255111 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-af370b4b-568e-407b-84c6-286535e5cebb tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:17.255875 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-af370b4b-568e-407b-84c6-286535e5cebb tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:17.264698 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-2b1e0173-41ec-45f5-9327-c0d0f5d202e8 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:17.265467 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-2b1e0173-41ec-45f5-9327-c0d0f5d202e8 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: d8e61004-a8c1-4880-82b3-133f361a0dfc] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:17.280813 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2b1e0173-41ec-45f5-9327-c0d0f5d202e8 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:17.281689 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2b1e0173-41ec-45f5-9327-c0d0f5d202e8 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:17.282310 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2b1e0173-41ec-45f5-9327-c0d0f5d202e8 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:17.283453 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2b1e0173-41ec-45f5-9327-c0d0f5d202e8 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:17.284059 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2b1e0173-41ec-45f5-9327-c0d0f5d202e8 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:17.284663 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2b1e0173-41ec-45f5-9327-c0d0f5d202e8 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:17.554779 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-af370b4b-568e-407b-84c6-286535e5cebb tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c3da1faaee46ca94d2a2543851f3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32a1b54e30415eb8f0e6df5e8b7be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:04:17.565884 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-af370b4b-568e-407b-84c6-286535e5cebb tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] 10.222.0.70 "GET /compute/v2.1/servers/92522ed7-8ac4-44b3-94b0-0aa3941cdbae" status: 200 len: 1504 microversion: 2.1 time: 0.327506 Aug 27 03:04:17.571309 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2204/4442] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:04:17 2022] GET /compute/v2.1/servers/92522ed7-8ac4-44b3-94b0-0aa3941cdbae => generated 1504 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:04:17.605048 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-2b1e0173-41ec-45f5-9327-c0d0f5d202e8 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:04:17.615126 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-2b1e0173-41ec-45f5-9327-c0d0f5d202e8 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/d8e61004-a8c1-4880-82b3-133f361a0dfc" status: 200 len: 1309 microversion: 2.1 time: 0.355829 Aug 27 03:04:17.617022 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2239/4443] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:04:17 2022] GET /compute/v2.1/servers/d8e61004-a8c1-4880-82b3-133f361a0dfc => generated 1309 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:04:18.591509 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b0ed1966-9538-4731-bdf1-7acf76a0e041 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:18.592144 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b0ed1966-9538-4731-bdf1-7acf76a0e041 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] [instance: 92522ed7-8ac4-44b3-94b0-0aa3941cdbae] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:18.608029 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b0ed1966-9538-4731-bdf1-7acf76a0e041 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:18.608564 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b0ed1966-9538-4731-bdf1-7acf76a0e041 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:18.609014 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b0ed1966-9538-4731-bdf1-7acf76a0e041 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:18.609716 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b0ed1966-9538-4731-bdf1-7acf76a0e041 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:18.610227 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b0ed1966-9538-4731-bdf1-7acf76a0e041 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:18.610651 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b0ed1966-9538-4731-bdf1-7acf76a0e041 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:18.638223 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0e1e180c-8bfb-44bf-834d-7584e92cb383 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:18.638840 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-0e1e180c-8bfb-44bf-834d-7584e92cb383 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: d8e61004-a8c1-4880-82b3-133f361a0dfc] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:18.650521 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0e1e180c-8bfb-44bf-834d-7584e92cb383 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:18.651016 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0e1e180c-8bfb-44bf-834d-7584e92cb383 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:18.651451 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0e1e180c-8bfb-44bf-834d-7584e92cb383 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:18.652168 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0e1e180c-8bfb-44bf-834d-7584e92cb383 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:18.658782 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0e1e180c-8bfb-44bf-834d-7584e92cb383 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:18.659280 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0e1e180c-8bfb-44bf-834d-7584e92cb383 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:19.020070 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b0ed1966-9538-4731-bdf1-7acf76a0e041 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c3da1faaee46ca94d2a2543851f3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32a1b54e30415eb8f0e6df5e8b7be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:04:19.029024 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b0ed1966-9538-4731-bdf1-7acf76a0e041 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] 10.222.0.70 "GET /compute/v2.1/servers/92522ed7-8ac4-44b3-94b0-0aa3941cdbae" status: 200 len: 1504 microversion: 2.1 time: 0.441865 Aug 27 03:04:19.032971 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2205/4444] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:04:18 2022] GET /compute/v2.1/servers/92522ed7-8ac4-44b3-94b0-0aa3941cdbae => generated 1504 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:04:19.121819 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-0e1e180c-8bfb-44bf-834d-7584e92cb383 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:04:19.132498 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-0e1e180c-8bfb-44bf-834d-7584e92cb383 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/d8e61004-a8c1-4880-82b3-133f361a0dfc" status: 200 len: 1309 microversion: 2.1 time: 0.499299 Aug 27 03:04:19.133133 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2240/4445] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:04:18 2022] GET /compute/v2.1/servers/d8e61004-a8c1-4880-82b3-133f361a0dfc => generated 1309 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:04:20.051443 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-db840d6a-c2db-430a-9700-007b394af3b4 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:20.052039 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-db840d6a-c2db-430a-9700-007b394af3b4 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] [instance: 92522ed7-8ac4-44b3-94b0-0aa3941cdbae] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:20.060338 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:04:20.062238 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=6 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:04:20.069227 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-db840d6a-c2db-430a-9700-007b394af3b4 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:20.069862 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-db840d6a-c2db-430a-9700-007b394af3b4 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:20.070338 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-db840d6a-c2db-430a-9700-007b394af3b4 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:20.071089 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-db840d6a-c2db-430a-9700-007b394af3b4 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:20.071853 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-db840d6a-c2db-430a-9700-007b394af3b4 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:20.072478 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-db840d6a-c2db-430a-9700-007b394af3b4 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:20.153718 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e80dc5ec-f0bd-49ed-b75a-2fcedf30704c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:20.154330 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-e80dc5ec-f0bd-49ed-b75a-2fcedf30704c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: d8e61004-a8c1-4880-82b3-133f361a0dfc] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:20.158458 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:04:20.163138 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e80dc5ec-f0bd-49ed-b75a-2fcedf30704c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:20.163635 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e80dc5ec-f0bd-49ed-b75a-2fcedf30704c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:20.164084 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e80dc5ec-f0bd-49ed-b75a-2fcedf30704c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:20.164817 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e80dc5ec-f0bd-49ed-b75a-2fcedf30704c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:20.165690 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e80dc5ec-f0bd-49ed-b75a-2fcedf30704c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:20.166275 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e80dc5ec-f0bd-49ed-b75a-2fcedf30704c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:20.438902 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-db840d6a-c2db-430a-9700-007b394af3b4 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c3da1faaee46ca94d2a2543851f3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32a1b54e30415eb8f0e6df5e8b7be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:04:20.448935 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-db840d6a-c2db-430a-9700-007b394af3b4 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] 10.222.0.70 "GET /compute/v2.1/servers/92522ed7-8ac4-44b3-94b0-0aa3941cdbae" status: 200 len: 1504 microversion: 2.1 time: 0.401613 Aug 27 03:04:20.461643 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2206/4446] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:04:20 2022] GET /compute/v2.1/servers/92522ed7-8ac4-44b3-94b0-0aa3941cdbae => generated 1504 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:04:20.463641 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e80dc5ec-f0bd-49ed-b75a-2fcedf30704c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:04:20.485791 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e80dc5ec-f0bd-49ed-b75a-2fcedf30704c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/d8e61004-a8c1-4880-82b3-133f361a0dfc" status: 200 len: 1309 microversion: 2.1 time: 0.335323 Aug 27 03:04:20.496574 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2241/4447] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:04:20 2022] GET /compute/v2.1/servers/d8e61004-a8c1-4880-82b3-133f361a0dfc => generated 1309 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:04:21.472443 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-dacaaac4-c6be-41f7-8f54-9ac978b2903d tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:21.473016 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-dacaaac4-c6be-41f7-8f54-9ac978b2903d tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] [instance: 92522ed7-8ac4-44b3-94b0-0aa3941cdbae] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:21.475482 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:04:21.484780 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dacaaac4-c6be-41f7-8f54-9ac978b2903d tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:21.484780 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dacaaac4-c6be-41f7-8f54-9ac978b2903d tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:21.484780 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dacaaac4-c6be-41f7-8f54-9ac978b2903d tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:21.484780 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dacaaac4-c6be-41f7-8f54-9ac978b2903d tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:21.484780 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dacaaac4-c6be-41f7-8f54-9ac978b2903d tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:21.484780 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dacaaac4-c6be-41f7-8f54-9ac978b2903d tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:21.511439 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-9a560139-e7b9-4566-b88d-d2410c524362 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:21.512031 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-9a560139-e7b9-4566-b88d-d2410c524362 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: d8e61004-a8c1-4880-82b3-133f361a0dfc] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:21.519409 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9a560139-e7b9-4566-b88d-d2410c524362 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:21.520226 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9a560139-e7b9-4566-b88d-d2410c524362 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:21.520851 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9a560139-e7b9-4566-b88d-d2410c524362 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:21.521775 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9a560139-e7b9-4566-b88d-d2410c524362 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:21.522393 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9a560139-e7b9-4566-b88d-d2410c524362 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:21.522990 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9a560139-e7b9-4566-b88d-d2410c524362 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:21.709646 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-9a560139-e7b9-4566-b88d-d2410c524362 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:04:21.711383 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-dacaaac4-c6be-41f7-8f54-9ac978b2903d tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c3da1faaee46ca94d2a2543851f3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32a1b54e30415eb8f0e6df5e8b7be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:04:21.712475 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:04:21.720729 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-9a560139-e7b9-4566-b88d-d2410c524362 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/d8e61004-a8c1-4880-82b3-133f361a0dfc" status: 200 len: 1309 microversion: 2.1 time: 0.212544 Aug 27 03:04:21.722265 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-dacaaac4-c6be-41f7-8f54-9ac978b2903d tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] 10.222.0.70 "GET /compute/v2.1/servers/92522ed7-8ac4-44b3-94b0-0aa3941cdbae" status: 200 len: 1504 microversion: 2.1 time: 0.254503 Aug 27 03:04:21.722996 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2242/4448] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:04:21 2022] GET /compute/v2.1/servers/d8e61004-a8c1-4880-82b3-133f361a0dfc => generated 1309 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:04:21.723148 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2207/4449] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:04:21 2022] GET /compute/v2.1/servers/92522ed7-8ac4-44b3-94b0-0aa3941cdbae => generated 1504 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:04:22.749771 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d4c06d2c-0b3b-4a0b-98cd-9d24e4e073d0 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:22.752856 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-434e36ef-e0da-4d47-9543-0672dd8d42b5 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:22.754564 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d4c06d2c-0b3b-4a0b-98cd-9d24e4e073d0 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] [instance: 92522ed7-8ac4-44b3-94b0-0aa3941cdbae] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:22.755468 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-434e36ef-e0da-4d47-9543-0672dd8d42b5 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: d8e61004-a8c1-4880-82b3-133f361a0dfc] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:22.768557 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-434e36ef-e0da-4d47-9543-0672dd8d42b5 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:22.769045 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-434e36ef-e0da-4d47-9543-0672dd8d42b5 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:22.769443 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-434e36ef-e0da-4d47-9543-0672dd8d42b5 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:22.770143 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-434e36ef-e0da-4d47-9543-0672dd8d42b5 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:22.770580 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-434e36ef-e0da-4d47-9543-0672dd8d42b5 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:22.770991 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-434e36ef-e0da-4d47-9543-0672dd8d42b5 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:22.777550 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d4c06d2c-0b3b-4a0b-98cd-9d24e4e073d0 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:22.778058 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d4c06d2c-0b3b-4a0b-98cd-9d24e4e073d0 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:22.778497 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d4c06d2c-0b3b-4a0b-98cd-9d24e4e073d0 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:22.779427 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d4c06d2c-0b3b-4a0b-98cd-9d24e4e073d0 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:22.779904 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d4c06d2c-0b3b-4a0b-98cd-9d24e4e073d0 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:22.780350 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d4c06d2c-0b3b-4a0b-98cd-9d24e4e073d0 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:23.060466 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-434e36ef-e0da-4d47-9543-0672dd8d42b5 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:04:23.073590 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-434e36ef-e0da-4d47-9543-0672dd8d42b5 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/d8e61004-a8c1-4880-82b3-133f361a0dfc" status: 200 len: 1309 microversion: 2.1 time: 0.331610 Aug 27 03:04:23.075267 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2208/4450] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:04:22 2022] GET /compute/v2.1/servers/d8e61004-a8c1-4880-82b3-133f361a0dfc => generated 1309 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:04:23.095281 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-a0fc4cbd-6068-48a8-858a-e0130ab74d0c req-3a5aef29-ce04-488d-98bb-58ea167f4e7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8e61004-a8c1-4880-82b3-133f361a0dfc", "name": "network-vif-plugged", "status": "completed", "tag": "9982dd2b-2350-45ae-a8e5-12cd3add9bf3"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:04:23.109328 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-a0fc4cbd-6068-48a8-858a-e0130ab74d0c req-3a5aef29-ce04-488d-98bb-58ea167f4e7b service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:23.110213 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-a0fc4cbd-6068-48a8-858a-e0130ab74d0c req-3a5aef29-ce04-488d-98bb-58ea167f4e7b service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:23.110848 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-a0fc4cbd-6068-48a8-858a-e0130ab74d0c req-3a5aef29-ce04-488d-98bb-58ea167f4e7b service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:23.124638 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-a0fc4cbd-6068-48a8-858a-e0130ab74d0c req-3a5aef29-ce04-488d-98bb-58ea167f4e7b service nova] Creating event network-vif-plugged:9982dd2b-2350-45ae-a8e5-12cd3add9bf3 for instance d8e61004-a8c1-4880-82b3-133f361a0dfc on n-h1-852278-4 Aug 27 03:04:23.132002 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-a0fc4cbd-6068-48a8-858a-e0130ab74d0c req-3a5aef29-ce04-488d-98bb-58ea167f4e7b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054683 Aug 27 03:04:23.133042 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2209/4451] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:04:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:04:23.143148 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d4c06d2c-0b3b-4a0b-98cd-9d24e4e073d0 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c3da1faaee46ca94d2a2543851f3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32a1b54e30415eb8f0e6df5e8b7be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:04:23.155619 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d4c06d2c-0b3b-4a0b-98cd-9d24e4e073d0 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] 10.222.0.70 "GET /compute/v2.1/servers/92522ed7-8ac4-44b3-94b0-0aa3941cdbae" status: 200 len: 1504 microversion: 2.1 time: 0.413695 Aug 27 03:04:23.156998 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2243/4452] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:04:22 2022] GET /compute/v2.1/servers/92522ed7-8ac4-44b3-94b0-0aa3941cdbae => generated 1504 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:04:23.157617 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a297f585-1e75-485f-bd75-758a222f2c6a tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:23.160192 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a297f585-1e75-485f-bd75-758a222f2c6a tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] [instance: f90d78a8-dea6-45c3-933c-8184ff4858b1] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:23.166994 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a297f585-1e75-485f-bd75-758a222f2c6a tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:23.167721 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a297f585-1e75-485f-bd75-758a222f2c6a tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:23.168370 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a297f585-1e75-485f-bd75-758a222f2c6a tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:23.169247 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a297f585-1e75-485f-bd75-758a222f2c6a tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:23.169859 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a297f585-1e75-485f-bd75-758a222f2c6a tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:23.170449 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a297f585-1e75-485f-bd75-758a222f2c6a tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:23.211839 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a297f585-1e75-485f-bd75-758a222f2c6a tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] 10.222.0.70 "GET /compute/v2.1/servers/f90d78a8-dea6-45c3-933c-8184ff4858b1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.058734 Aug 27 03:04:23.213226 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2210/4453] 10.222.0.70 () {58 vars in 1302 bytes} [Sat Aug 27 03:04:23 2022] GET /compute/v2.1/servers/f90d78a8-dea6-45c3-933c-8184ff4858b1/os-volume_attachments => generated 371 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:04:23.359242 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-44798ebc-6bdd-4b88-b03c-b331b4377499 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:23.359900 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-44798ebc-6bdd-4b88-b03c-b331b4377499 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] [instance: f90d78a8-dea6-45c3-933c-8184ff4858b1] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:23.366573 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-44798ebc-6bdd-4b88-b03c-b331b4377499 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:23.367557 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-44798ebc-6bdd-4b88-b03c-b331b4377499 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:23.368295 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-44798ebc-6bdd-4b88-b03c-b331b4377499 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:23.369255 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-44798ebc-6bdd-4b88-b03c-b331b4377499 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:23.369960 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-44798ebc-6bdd-4b88-b03c-b331b4377499 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:23.370740 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-44798ebc-6bdd-4b88-b03c-b331b4377499 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:23.407839 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-44798ebc-6bdd-4b88-b03c-b331b4377499 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] 10.222.0.70 "GET /compute/v2.1/servers/f90d78a8-dea6-45c3-933c-8184ff4858b1/os-volume_attachments/8f0b94b9-8572-4142-8fd7-d2de7af3b73c" status: 200 len: 194 microversion: 2.1 time: 0.052655 Aug 27 03:04:23.408501 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2244/4454] 10.222.0.70 () {58 vars in 1413 bytes} [Sat Aug 27 03:04:23 2022] GET /compute/v2.1/servers/f90d78a8-dea6-45c3-933c-8184ff4858b1/os-volume_attachments/8f0b94b9-8572-4142-8fd7-d2de7af3b73c => generated 194 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:04:23.423120 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-26563c36-8f9e-4914-b66f-ac62a4fabfc9 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:23.424933 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-26563c36-8f9e-4914-b66f-ac62a4fabfc9 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] [instance: f90d78a8-dea6-45c3-933c-8184ff4858b1] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:23.439529 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-26563c36-8f9e-4914-b66f-ac62a4fabfc9 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:23.440065 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-26563c36-8f9e-4914-b66f-ac62a4fabfc9 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:23.442713 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-26563c36-8f9e-4914-b66f-ac62a4fabfc9 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:23.443687 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-26563c36-8f9e-4914-b66f-ac62a4fabfc9 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:23.444327 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-26563c36-8f9e-4914-b66f-ac62a4fabfc9 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:23.444931 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-26563c36-8f9e-4914-b66f-ac62a4fabfc9 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:23.561407 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.instance [None req-26563c36-8f9e-4914-b66f-ac62a4fabfc9 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lazy-loading 'services' on Instance uuid f90d78a8-dea6-45c3-933c-8184ff4858b1 {{(pid=134052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:04:23.655919 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-26563c36-8f9e-4914-b66f-ac62a4fabfc9 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] 10.222.0.70 "DELETE /compute/v2.1/servers/f90d78a8-dea6-45c3-933c-8184ff4858b1/os-volume_attachments/8f0b94b9-8572-4142-8fd7-d2de7af3b73c" status: 202 len: 0 microversion: 2.1 time: 0.239067 Aug 27 03:04:23.656753 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2211/4455] 10.222.0.70 () {58 vars in 1416 bytes} [Sat Aug 27 03:04:23 2022] DELETE /compute/v2.1/servers/f90d78a8-dea6-45c3-933c-8184ff4858b1/os-volume_attachments/8f0b94b9-8572-4142-8fd7-d2de7af3b73c => generated 0 bytes in 241 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:04:24.095601 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-22da7d8e-b6c5-4006-a570-e8bacab14b7d tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:24.096851 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-22da7d8e-b6c5-4006-a570-e8bacab14b7d tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: d8e61004-a8c1-4880-82b3-133f361a0dfc] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:24.118250 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-22da7d8e-b6c5-4006-a570-e8bacab14b7d tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:24.119084 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-22da7d8e-b6c5-4006-a570-e8bacab14b7d tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:24.119528 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-22da7d8e-b6c5-4006-a570-e8bacab14b7d tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:24.121525 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-22da7d8e-b6c5-4006-a570-e8bacab14b7d tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:24.122215 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-22da7d8e-b6c5-4006-a570-e8bacab14b7d tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:24.122667 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-22da7d8e-b6c5-4006-a570-e8bacab14b7d tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:24.177512 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9a2f4d4b-a11b-47ab-a9c0-5052d3a26978 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:24.178996 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-9a2f4d4b-a11b-47ab-a9c0-5052d3a26978 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] [instance: 92522ed7-8ac4-44b3-94b0-0aa3941cdbae] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:24.187523 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9a2f4d4b-a11b-47ab-a9c0-5052d3a26978 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:24.188421 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9a2f4d4b-a11b-47ab-a9c0-5052d3a26978 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:24.189148 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9a2f4d4b-a11b-47ab-a9c0-5052d3a26978 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:24.190184 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9a2f4d4b-a11b-47ab-a9c0-5052d3a26978 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:24.190780 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9a2f4d4b-a11b-47ab-a9c0-5052d3a26978 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:24.191384 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9a2f4d4b-a11b-47ab-a9c0-5052d3a26978 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:24.321109 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-22da7d8e-b6c5-4006-a570-e8bacab14b7d tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:04:24.330610 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-22da7d8e-b6c5-4006-a570-e8bacab14b7d tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/d8e61004-a8c1-4880-82b3-133f361a0dfc" status: 200 len: 1309 microversion: 2.1 time: 0.238789 Aug 27 03:04:24.331922 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2245/4456] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:04:24 2022] GET /compute/v2.1/servers/d8e61004-a8c1-4880-82b3-133f361a0dfc => generated 1309 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:04:24.385363 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-9a2f4d4b-a11b-47ab-a9c0-5052d3a26978 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c3da1faaee46ca94d2a2543851f3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32a1b54e30415eb8f0e6df5e8b7be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:04:24.393432 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9a2f4d4b-a11b-47ab-a9c0-5052d3a26978 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] 10.222.0.70 "GET /compute/v2.1/servers/92522ed7-8ac4-44b3-94b0-0aa3941cdbae" status: 200 len: 1504 microversion: 2.1 time: 0.220560 Aug 27 03:04:24.394015 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2212/4457] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:04:24 2022] GET /compute/v2.1/servers/92522ed7-8ac4-44b3-94b0-0aa3941cdbae => generated 1504 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:04:25.351948 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3cdba410-eca6-4637-bc9d-a3ddf2c6aece tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:25.352566 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-3cdba410-eca6-4637-bc9d-a3ddf2c6aece tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: d8e61004-a8c1-4880-82b3-133f361a0dfc] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:25.360908 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3cdba410-eca6-4637-bc9d-a3ddf2c6aece tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:25.368493 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3cdba410-eca6-4637-bc9d-a3ddf2c6aece tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:25.369675 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3cdba410-eca6-4637-bc9d-a3ddf2c6aece tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:25.371614 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3cdba410-eca6-4637-bc9d-a3ddf2c6aece tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:25.372264 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3cdba410-eca6-4637-bc9d-a3ddf2c6aece tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:25.372995 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3cdba410-eca6-4637-bc9d-a3ddf2c6aece tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:25.414529 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-87386cc4-7965-44d6-b7c3-033549ce8d9b tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:25.432707 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-87386cc4-7965-44d6-b7c3-033549ce8d9b tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] [instance: 92522ed7-8ac4-44b3-94b0-0aa3941cdbae] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:25.464992 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-87386cc4-7965-44d6-b7c3-033549ce8d9b tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:25.468210 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-87386cc4-7965-44d6-b7c3-033549ce8d9b tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:25.469059 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-87386cc4-7965-44d6-b7c3-033549ce8d9b tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:25.471457 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-87386cc4-7965-44d6-b7c3-033549ce8d9b tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:25.475854 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-87386cc4-7965-44d6-b7c3-033549ce8d9b tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:25.476893 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-87386cc4-7965-44d6-b7c3-033549ce8d9b tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:25.522300 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:04:25.657872 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-3cdba410-eca6-4637-bc9d-a3ddf2c6aece tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:04:25.668708 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-3cdba410-eca6-4637-bc9d-a3ddf2c6aece tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/d8e61004-a8c1-4880-82b3-133f361a0dfc" status: 200 len: 1489 microversion: 2.1 time: 0.319878 Aug 27 03:04:25.670068 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2246/4458] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:04:25 2022] GET /compute/v2.1/servers/d8e61004-a8c1-4880-82b3-133f361a0dfc => generated 1489 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:04:25.705516 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-87386cc4-7965-44d6-b7c3-033549ce8d9b tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c3da1faaee46ca94d2a2543851f3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32a1b54e30415eb8f0e6df5e8b7be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:04:25.735267 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-87386cc4-7965-44d6-b7c3-033549ce8d9b tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] 10.222.0.70 "GET /compute/v2.1/servers/92522ed7-8ac4-44b3-94b0-0aa3941cdbae" status: 200 len: 1504 microversion: 2.1 time: 0.323700 Aug 27 03:04:25.737968 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2213/4459] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:04:25 2022] GET /compute/v2.1/servers/92522ed7-8ac4-44b3-94b0-0aa3941cdbae => generated 1504 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:04:25.859350 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-55e56533-5f8a-4581-9a74-808b11be5e94 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1084653579", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "networks": [{"uuid": "961028dd-9dfc-4287-bc1b-27b14d79a81a"}]}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:04:25.931872 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.network.neutron [None req-55e56533-5f8a-4581-9a74-808b11be5e94 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] validate_networks() for [('961028dd-9dfc-4287-bc1b-27b14d79a81a', None, None, None, None, None)] {{(pid=134051) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:04:26.757273 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-34d08d48-aa63-4e30-ae19-9a7b65212cca tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:26.758542 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-34d08d48-aa63-4e30-ae19-9a7b65212cca tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] [instance: 92522ed7-8ac4-44b3-94b0-0aa3941cdbae] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:26.769886 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-34d08d48-aa63-4e30-ae19-9a7b65212cca tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:26.770679 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-34d08d48-aa63-4e30-ae19-9a7b65212cca tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:26.771302 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-34d08d48-aa63-4e30-ae19-9a7b65212cca tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:26.772232 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-34d08d48-aa63-4e30-ae19-9a7b65212cca tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:26.774797 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-34d08d48-aa63-4e30-ae19-9a7b65212cca tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:26.775450 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-34d08d48-aa63-4e30-ae19-9a7b65212cca tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:26.945548 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-55e56533-5f8a-4581-9a74-808b11be5e94 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Flavor limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:04:26.946138 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-55e56533-5f8a-4581-9a74-808b11be5e94 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Image limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:04:26.946890 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-55e56533-5f8a-4581-9a74-808b11be5e94 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Flavor pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:04:26.947568 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-55e56533-5f8a-4581-9a74-808b11be5e94 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Image pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:04:26.948500 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-55e56533-5f8a-4581-9a74-808b11be5e94 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:04:26.975613 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-55e56533-5f8a-4581-9a74-808b11be5e94 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:26.976528 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-55e56533-5f8a-4581-9a74-808b11be5e94 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:26.977261 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-55e56533-5f8a-4581-9a74-808b11be5e94 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:26.978566 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-55e56533-5f8a-4581-9a74-808b11be5e94 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:26.979332 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-55e56533-5f8a-4581-9a74-808b11be5e94 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:26.980234 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-55e56533-5f8a-4581-9a74-808b11be5e94 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:27.033602 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-55e56533-5f8a-4581-9a74-808b11be5e94 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Getting quotas for project 6b8d6664c463420bad9a5bfb6d747db4. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:04:27.041956 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-55e56533-5f8a-4581-9a74-808b11be5e94 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Getting quotas for user 13a4e6dcf5df46fcad30430a9b9a08ee and project 6b8d6664c463420bad9a5bfb6d747db4. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:04:27.068998 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-55e56533-5f8a-4581-9a74-808b11be5e94 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Going to run 1 instances... {{(pid=134051) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:04:27.072550 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-55e56533-5f8a-4581-9a74-808b11be5e94 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: 8a65899b-549f-4312-bf67-a1ca9a8f79d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134051) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:04:27.130603 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-34d08d48-aa63-4e30-ae19-9a7b65212cca tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c3da1faaee46ca94d2a2543851f3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32a1b54e30415eb8f0e6df5e8b7be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:04:27.139595 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-34d08d48-aa63-4e30-ae19-9a7b65212cca tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] 10.222.0.70 "GET /compute/v2.1/servers/92522ed7-8ac4-44b3-94b0-0aa3941cdbae" status: 200 len: 1504 microversion: 2.1 time: 0.386191 Aug 27 03:04:27.140383 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2214/4460] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:04:26 2022] GET /compute/v2.1/servers/92522ed7-8ac4-44b3-94b0-0aa3941cdbae => generated 1504 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:04:27.157548 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-55e56533-5f8a-4581-9a74-808b11be5e94 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.302394 Aug 27 03:04:27.158795 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2247/4461] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 03:04:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1305 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:04:27.169691 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-72d5ec1b-b1e8-46a8-93e2-3c246d1e8ba3 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:27.170304 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-72d5ec1b-b1e8-46a8-93e2-3c246d1e8ba3 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: 8a65899b-549f-4312-bf67-a1ca9a8f79d7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:27.249603 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-72d5ec1b-b1e8-46a8-93e2-3c246d1e8ba3 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:04:27.258025 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-72d5ec1b-b1e8-46a8-93e2-3c246d1e8ba3 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/8a65899b-549f-4312-bf67-a1ca9a8f79d7" status: 200 len: 1209 microversion: 2.1 time: 0.092182 Aug 27 03:04:27.259896 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2215/4462] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:04:27 2022] GET /compute/v2.1/servers/8a65899b-549f-4312-bf67-a1ca9a8f79d7 => generated 1209 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:04:28.167177 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-677ef65a-a39f-49e5-929d-7d284eff0525 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:28.168777 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-677ef65a-a39f-49e5-929d-7d284eff0525 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] [instance: 92522ed7-8ac4-44b3-94b0-0aa3941cdbae] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:28.178491 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-677ef65a-a39f-49e5-929d-7d284eff0525 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:28.179719 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-677ef65a-a39f-49e5-929d-7d284eff0525 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:28.180596 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-677ef65a-a39f-49e5-929d-7d284eff0525 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:28.183550 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-677ef65a-a39f-49e5-929d-7d284eff0525 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:28.184936 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-677ef65a-a39f-49e5-929d-7d284eff0525 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:28.186789 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-677ef65a-a39f-49e5-929d-7d284eff0525 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:28.280133 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-43c40ce7-1b96-4cb0-bb6a-28c440687743 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:28.281362 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-43c40ce7-1b96-4cb0-bb6a-28c440687743 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: 8a65899b-549f-4312-bf67-a1ca9a8f79d7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:28.311598 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-43c40ce7-1b96-4cb0-bb6a-28c440687743 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:28.326545 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-43c40ce7-1b96-4cb0-bb6a-28c440687743 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:28.328936 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-43c40ce7-1b96-4cb0-bb6a-28c440687743 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:28.329878 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-43c40ce7-1b96-4cb0-bb6a-28c440687743 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:28.330672 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-43c40ce7-1b96-4cb0-bb6a-28c440687743 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:28.331506 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-43c40ce7-1b96-4cb0-bb6a-28c440687743 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:28.522397 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-677ef65a-a39f-49e5-929d-7d284eff0525 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c3da1faaee46ca94d2a2543851f3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32a1b54e30415eb8f0e6df5e8b7be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:04:28.538675 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-677ef65a-a39f-49e5-929d-7d284eff0525 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] 10.222.0.70 "GET /compute/v2.1/servers/92522ed7-8ac4-44b3-94b0-0aa3941cdbae" status: 200 len: 1504 microversion: 2.1 time: 0.374785 Aug 27 03:04:28.562365 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2248/4463] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:04:28 2022] GET /compute/v2.1/servers/92522ed7-8ac4-44b3-94b0-0aa3941cdbae => generated 1504 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:04:28.599499 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-43c40ce7-1b96-4cb0-bb6a-28c440687743 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:04:28.609498 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-43c40ce7-1b96-4cb0-bb6a-28c440687743 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/8a65899b-549f-4312-bf67-a1ca9a8f79d7" status: 200 len: 1261 microversion: 2.1 time: 0.334718 Aug 27 03:04:28.612746 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2216/4464] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:04:28 2022] GET /compute/v2.1/servers/8a65899b-549f-4312-bf67-a1ca9a8f79d7 => generated 1261 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:04:29.571512 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-fc2ec56f-b2a7-430d-94a2-c93f00e8f2da tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:29.572099 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-fc2ec56f-b2a7-430d-94a2-c93f00e8f2da tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] [instance: 92522ed7-8ac4-44b3-94b0-0aa3941cdbae] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:29.580336 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fc2ec56f-b2a7-430d-94a2-c93f00e8f2da tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:29.580830 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fc2ec56f-b2a7-430d-94a2-c93f00e8f2da tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:29.581711 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fc2ec56f-b2a7-430d-94a2-c93f00e8f2da tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:29.582447 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fc2ec56f-b2a7-430d-94a2-c93f00e8f2da tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:29.583032 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fc2ec56f-b2a7-430d-94a2-c93f00e8f2da tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:29.583671 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fc2ec56f-b2a7-430d-94a2-c93f00e8f2da tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:29.634048 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a83e47d9-8a3f-42fc-a379-f64e1eb83fb3 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:29.634645 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a83e47d9-8a3f-42fc-a379-f64e1eb83fb3 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: 8a65899b-549f-4312-bf67-a1ca9a8f79d7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:29.647219 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a83e47d9-8a3f-42fc-a379-f64e1eb83fb3 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:29.647707 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a83e47d9-8a3f-42fc-a379-f64e1eb83fb3 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:29.656484 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a83e47d9-8a3f-42fc-a379-f64e1eb83fb3 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:29.657505 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a83e47d9-8a3f-42fc-a379-f64e1eb83fb3 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:29.657984 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a83e47d9-8a3f-42fc-a379-f64e1eb83fb3 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:29.658888 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a83e47d9-8a3f-42fc-a379-f64e1eb83fb3 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:29.834575 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-a83e47d9-8a3f-42fc-a379-f64e1eb83fb3 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:04:29.852079 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a83e47d9-8a3f-42fc-a379-f64e1eb83fb3 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/8a65899b-549f-4312-bf67-a1ca9a8f79d7" status: 200 len: 1267 microversion: 2.1 time: 0.222979 Aug 27 03:04:29.867849 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2217/4465] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:04:29 2022] GET /compute/v2.1/servers/8a65899b-549f-4312-bf67-a1ca9a8f79d7 => generated 1267 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:04:30.124846 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-fc2ec56f-b2a7-430d-94a2-c93f00e8f2da tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c3da1faaee46ca94d2a2543851f3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32a1b54e30415eb8f0e6df5e8b7be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:04:30.133403 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-fc2ec56f-b2a7-430d-94a2-c93f00e8f2da tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] 10.222.0.70 "GET /compute/v2.1/servers/92522ed7-8ac4-44b3-94b0-0aa3941cdbae" status: 200 len: 1484 microversion: 2.1 time: 0.566857 Aug 27 03:04:30.144805 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2249/4466] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:04:29 2022] GET /compute/v2.1/servers/92522ed7-8ac4-44b3-94b0-0aa3941cdbae => generated 1484 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:04:30.154232 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c5820da4-b1f0-4799-b938-b2992e895b37 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:04:30.155002 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-c5820da4-b1f0-4799-b938-b2992e895b37 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] [instance: 92522ed7-8ac4-44b3-94b0-0aa3941cdbae] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:30.163062 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c5820da4-b1f0-4799-b938-b2992e895b37 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:30.164303 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c5820da4-b1f0-4799-b938-b2992e895b37 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:30.165008 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c5820da4-b1f0-4799-b938-b2992e895b37 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:30.166318 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c5820da4-b1f0-4799-b938-b2992e895b37 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:30.166886 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c5820da4-b1f0-4799-b938-b2992e895b37 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:30.168450 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c5820da4-b1f0-4799-b938-b2992e895b37 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:30.252881 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c5820da4-b1f0-4799-b938-b2992e895b37 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] 10.222.0.70 "POST /compute/v2.1/servers/92522ed7-8ac4-44b3-94b0-0aa3941cdbae/action" status: 202 len: 0 microversion: 2.1 time: 0.102119 Aug 27 03:04:30.254124 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2218/4467] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:04:30 2022] POST /compute/v2.1/servers/92522ed7-8ac4-44b3-94b0-0aa3941cdbae/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:04:30.269724 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-2bcc6c02-6e00-4133-b8df-8e884389339d tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:30.273735 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-2bcc6c02-6e00-4133-b8df-8e884389339d tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] [instance: 92522ed7-8ac4-44b3-94b0-0aa3941cdbae] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:30.285651 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2bcc6c02-6e00-4133-b8df-8e884389339d tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:30.287384 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2bcc6c02-6e00-4133-b8df-8e884389339d tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:30.288085 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2bcc6c02-6e00-4133-b8df-8e884389339d tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:30.289501 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2bcc6c02-6e00-4133-b8df-8e884389339d tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:30.290220 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2bcc6c02-6e00-4133-b8df-8e884389339d tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:30.290918 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2bcc6c02-6e00-4133-b8df-8e884389339d tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:30.677226 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-2bcc6c02-6e00-4133-b8df-8e884389339d tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c3da1faaee46ca94d2a2543851f3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32a1b54e30415eb8f0e6df5e8b7be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:04:30.691928 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-2bcc6c02-6e00-4133-b8df-8e884389339d tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] 10.222.0.70 "GET /compute/v2.1/servers/92522ed7-8ac4-44b3-94b0-0aa3941cdbae" status: 200 len: 1492 microversion: 2.1 time: 0.432707 Aug 27 03:04:30.692542 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2250/4468] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:04:30 2022] GET /compute/v2.1/servers/92522ed7-8ac4-44b3-94b0-0aa3941cdbae => generated 1492 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:04:30.883222 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-17f16e9e-082b-4d6f-844c-3de4b957a1bd tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:30.884661 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-17f16e9e-082b-4d6f-844c-3de4b957a1bd tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: 8a65899b-549f-4312-bf67-a1ca9a8f79d7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:30.897638 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-17f16e9e-082b-4d6f-844c-3de4b957a1bd tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:30.899670 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-17f16e9e-082b-4d6f-844c-3de4b957a1bd tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:30.901073 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-17f16e9e-082b-4d6f-844c-3de4b957a1bd tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:30.903092 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-17f16e9e-082b-4d6f-844c-3de4b957a1bd tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:30.906007 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-17f16e9e-082b-4d6f-844c-3de4b957a1bd tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:30.906802 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-17f16e9e-082b-4d6f-844c-3de4b957a1bd tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:31.368099 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-17f16e9e-082b-4d6f-844c-3de4b957a1bd tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:04:31.380201 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-17f16e9e-082b-4d6f-844c-3de4b957a1bd tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/8a65899b-549f-4312-bf67-a1ca9a8f79d7" status: 200 len: 1309 microversion: 2.1 time: 0.502531 Aug 27 03:04:31.383183 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2219/4469] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:04:30 2022] GET /compute/v2.1/servers/8a65899b-549f-4312-bf67-a1ca9a8f79d7 => generated 1309 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:04:31.462068 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-78859e48-9f58-4861-90c1-1cc7ec5272f8 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:31.463503 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-78859e48-9f58-4861-90c1-1cc7ec5272f8 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] [instance: f90d78a8-dea6-45c3-933c-8184ff4858b1] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:31.472056 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-78859e48-9f58-4861-90c1-1cc7ec5272f8 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:31.472824 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-78859e48-9f58-4861-90c1-1cc7ec5272f8 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:31.473579 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-78859e48-9f58-4861-90c1-1cc7ec5272f8 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:31.474463 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-78859e48-9f58-4861-90c1-1cc7ec5272f8 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:31.475143 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-78859e48-9f58-4861-90c1-1cc7ec5272f8 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:31.475781 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-78859e48-9f58-4861-90c1-1cc7ec5272f8 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:31.512938 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-78859e48-9f58-4861-90c1-1cc7ec5272f8 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] 10.222.0.70 "GET /compute/v2.1/servers/f90d78a8-dea6-45c3-933c-8184ff4858b1/os-volume_attachments/089d136d-e93f-43ad-b964-d595133aadcf" status: 200 len: 194 microversion: 2.1 time: 0.054601 Aug 27 03:04:31.514071 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2251/4470] 10.222.0.70 () {58 vars in 1413 bytes} [Sat Aug 27 03:04:31 2022] GET /compute/v2.1/servers/f90d78a8-dea6-45c3-933c-8184ff4858b1/os-volume_attachments/089d136d-e93f-43ad-b964-d595133aadcf => generated 194 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:04:31.525939 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-57f91b2e-7cf8-4e66-a959-63fc8e343d97 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:31.526634 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-57f91b2e-7cf8-4e66-a959-63fc8e343d97 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] [instance: f90d78a8-dea6-45c3-933c-8184ff4858b1] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:31.548075 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-57f91b2e-7cf8-4e66-a959-63fc8e343d97 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:31.548594 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-57f91b2e-7cf8-4e66-a959-63fc8e343d97 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:31.549187 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-57f91b2e-7cf8-4e66-a959-63fc8e343d97 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:31.549912 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-57f91b2e-7cf8-4e66-a959-63fc8e343d97 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:31.550362 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-57f91b2e-7cf8-4e66-a959-63fc8e343d97 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:31.552398 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-57f91b2e-7cf8-4e66-a959-63fc8e343d97 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:31.676762 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.instance [None req-57f91b2e-7cf8-4e66-a959-63fc8e343d97 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lazy-loading 'services' on Instance uuid f90d78a8-dea6-45c3-933c-8184ff4858b1 {{(pid=134052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:04:31.720049 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-90291e0a-7b8c-45df-9f6d-e74cc89934ad tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:31.721748 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-90291e0a-7b8c-45df-9f6d-e74cc89934ad tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] [instance: 92522ed7-8ac4-44b3-94b0-0aa3941cdbae] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:31.733456 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-90291e0a-7b8c-45df-9f6d-e74cc89934ad tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:31.734326 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-90291e0a-7b8c-45df-9f6d-e74cc89934ad tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:31.734962 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-90291e0a-7b8c-45df-9f6d-e74cc89934ad tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:31.744057 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-90291e0a-7b8c-45df-9f6d-e74cc89934ad tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:31.747997 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-90291e0a-7b8c-45df-9f6d-e74cc89934ad tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:31.748853 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-90291e0a-7b8c-45df-9f6d-e74cc89934ad tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:31.817953 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-57f91b2e-7cf8-4e66-a959-63fc8e343d97 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] 10.222.0.70 "DELETE /compute/v2.1/servers/f90d78a8-dea6-45c3-933c-8184ff4858b1/os-volume_attachments/089d136d-e93f-43ad-b964-d595133aadcf" status: 202 len: 0 microversion: 2.1 time: 0.295833 Aug 27 03:04:31.818567 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2220/4471] 10.222.0.70 () {58 vars in 1416 bytes} [Sat Aug 27 03:04:31 2022] DELETE /compute/v2.1/servers/f90d78a8-dea6-45c3-933c-8184ff4858b1/os-volume_attachments/089d136d-e93f-43ad-b964-d595133aadcf => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 03:04:32.085901 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-90291e0a-7b8c-45df-9f6d-e74cc89934ad tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c3da1faaee46ca94d2a2543851f3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32a1b54e30415eb8f0e6df5e8b7be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:04:32.098752 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-90291e0a-7b8c-45df-9f6d-e74cc89934ad tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] 10.222.0.70 "GET /compute/v2.1/servers/92522ed7-8ac4-44b3-94b0-0aa3941cdbae" status: 200 len: 1492 microversion: 2.1 time: 0.387568 Aug 27 03:04:32.099909 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2252/4472] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:04:31 2022] GET /compute/v2.1/servers/92522ed7-8ac4-44b3-94b0-0aa3941cdbae => generated 1492 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:04:32.191024 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-dcec1dd2-4234-468e-ae64-736fee851676 req-171a18e3-c9f2-4fe4-a06a-19e355a59dcd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a65899b-549f-4312-bf67-a1ca9a8f79d7", "tag": "984a8cb7-1e8f-4e81-a97f-833a7e52f85b"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:04:32.200762 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-dcec1dd2-4234-468e-ae64-736fee851676 req-171a18e3-c9f2-4fe4-a06a-19e355a59dcd service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:32.201222 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-dcec1dd2-4234-468e-ae64-736fee851676 req-171a18e3-c9f2-4fe4-a06a-19e355a59dcd service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:32.201886 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-dcec1dd2-4234-468e-ae64-736fee851676 req-171a18e3-c9f2-4fe4-a06a-19e355a59dcd service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:32.215540 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-dcec1dd2-4234-468e-ae64-736fee851676 req-171a18e3-c9f2-4fe4-a06a-19e355a59dcd service nova] Creating event network-changed:984a8cb7-1e8f-4e81-a97f-833a7e52f85b for instance 8a65899b-549f-4312-bf67-a1ca9a8f79d7 on n-h1-852278-4 Aug 27 03:04:32.221466 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-dcec1dd2-4234-468e-ae64-736fee851676 req-171a18e3-c9f2-4fe4-a06a-19e355a59dcd service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035320 Aug 27 03:04:32.222671 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2221/4473] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:04:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:04:32.415195 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-5745aff6-8974-4956-a372-4cb56f156a58 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:32.420664 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-5745aff6-8974-4956-a372-4cb56f156a58 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: 8a65899b-549f-4312-bf67-a1ca9a8f79d7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:32.437626 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5745aff6-8974-4956-a372-4cb56f156a58 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:32.438461 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5745aff6-8974-4956-a372-4cb56f156a58 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:32.438918 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5745aff6-8974-4956-a372-4cb56f156a58 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:32.439884 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5745aff6-8974-4956-a372-4cb56f156a58 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:32.440376 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5745aff6-8974-4956-a372-4cb56f156a58 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:32.440773 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5745aff6-8974-4956-a372-4cb56f156a58 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:32.884862 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-5745aff6-8974-4956-a372-4cb56f156a58 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:04:32.900353 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-5745aff6-8974-4956-a372-4cb56f156a58 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/8a65899b-549f-4312-bf67-a1ca9a8f79d7" status: 200 len: 1309 microversion: 2.1 time: 0.496824 Aug 27 03:04:32.900961 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2253/4474] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:04:32 2022] GET /compute/v2.1/servers/8a65899b-549f-4312-bf67-a1ca9a8f79d7 => generated 1309 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:04:33.120747 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-7b640737-f1e9-43a7-9f61-5ea54cac4969 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:33.121418 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-7b640737-f1e9-43a7-9f61-5ea54cac4969 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] [instance: 92522ed7-8ac4-44b3-94b0-0aa3941cdbae] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:33.136568 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7b640737-f1e9-43a7-9f61-5ea54cac4969 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:33.137266 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7b640737-f1e9-43a7-9f61-5ea54cac4969 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:33.137932 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7b640737-f1e9-43a7-9f61-5ea54cac4969 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:33.138838 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7b640737-f1e9-43a7-9f61-5ea54cac4969 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:33.139456 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7b640737-f1e9-43a7-9f61-5ea54cac4969 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:33.140180 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7b640737-f1e9-43a7-9f61-5ea54cac4969 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:33.494786 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-7b640737-f1e9-43a7-9f61-5ea54cac4969 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c3da1faaee46ca94d2a2543851f3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32a1b54e30415eb8f0e6df5e8b7be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:04:33.504541 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-7b640737-f1e9-43a7-9f61-5ea54cac4969 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] 10.222.0.70 "GET /compute/v2.1/servers/92522ed7-8ac4-44b3-94b0-0aa3941cdbae" status: 200 len: 1492 microversion: 2.1 time: 0.387866 Aug 27 03:04:33.519981 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2222/4475] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:04:33 2022] GET /compute/v2.1/servers/92522ed7-8ac4-44b3-94b0-0aa3941cdbae => generated 1492 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:04:33.921195 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8ff2b790-28de-4651-a855-735d8699f54b tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:33.922442 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-8ff2b790-28de-4651-a855-735d8699f54b tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: 8a65899b-549f-4312-bf67-a1ca9a8f79d7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:33.932412 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8ff2b790-28de-4651-a855-735d8699f54b tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:33.933074 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8ff2b790-28de-4651-a855-735d8699f54b tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:33.933720 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8ff2b790-28de-4651-a855-735d8699f54b tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:33.935950 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8ff2b790-28de-4651-a855-735d8699f54b tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:33.936493 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8ff2b790-28de-4651-a855-735d8699f54b tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:33.937110 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8ff2b790-28de-4651-a855-735d8699f54b tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:34.194186 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-8ff2b790-28de-4651-a855-735d8699f54b tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:04:34.216016 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-8ff2b790-28de-4651-a855-735d8699f54b tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/8a65899b-549f-4312-bf67-a1ca9a8f79d7" status: 200 len: 1309 microversion: 2.1 time: 0.298544 Aug 27 03:04:34.217245 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2254/4476] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:04:33 2022] GET /compute/v2.1/servers/8a65899b-549f-4312-bf67-a1ca9a8f79d7 => generated 1309 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:04:34.525970 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-68e893a8-87aa-4a77-8a18-d7d18671ba08 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:34.534663 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-68e893a8-87aa-4a77-8a18-d7d18671ba08 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] [instance: 92522ed7-8ac4-44b3-94b0-0aa3941cdbae] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:34.548897 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-68e893a8-87aa-4a77-8a18-d7d18671ba08 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:34.549749 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-68e893a8-87aa-4a77-8a18-d7d18671ba08 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:34.550807 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-68e893a8-87aa-4a77-8a18-d7d18671ba08 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:34.551931 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-68e893a8-87aa-4a77-8a18-d7d18671ba08 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:34.552654 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-68e893a8-87aa-4a77-8a18-d7d18671ba08 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:34.553402 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-68e893a8-87aa-4a77-8a18-d7d18671ba08 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:34.762826 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-68e893a8-87aa-4a77-8a18-d7d18671ba08 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c3da1faaee46ca94d2a2543851f3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32a1b54e30415eb8f0e6df5e8b7be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:04:34.773362 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-68e893a8-87aa-4a77-8a18-d7d18671ba08 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] 10.222.0.70 "GET /compute/v2.1/servers/92522ed7-8ac4-44b3-94b0-0aa3941cdbae" status: 200 len: 1498 microversion: 2.1 time: 0.251312 Aug 27 03:04:34.774315 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2223/4477] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:04:34 2022] GET /compute/v2.1/servers/92522ed7-8ac4-44b3-94b0-0aa3941cdbae => generated 1498 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:04:34.811639 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-40ea297a-cbd4-464b-87eb-ba3bfdb09193 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:34.812747 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-40ea297a-cbd4-464b-87eb-ba3bfdb09193 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] [instance: 92522ed7-8ac4-44b3-94b0-0aa3941cdbae] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:34.824557 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-40ea297a-cbd4-464b-87eb-ba3bfdb09193 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:34.825618 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-40ea297a-cbd4-464b-87eb-ba3bfdb09193 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:34.826321 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-40ea297a-cbd4-464b-87eb-ba3bfdb09193 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:34.827350 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-40ea297a-cbd4-464b-87eb-ba3bfdb09193 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:34.833151 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-40ea297a-cbd4-464b-87eb-ba3bfdb09193 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:34.833930 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-40ea297a-cbd4-464b-87eb-ba3bfdb09193 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:34.865331 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-40ea297a-cbd4-464b-87eb-ba3bfdb09193 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] [instance: 92522ed7-8ac4-44b3-94b0-0aa3941cdbae] Going to try to terminate instance {{(pid=134051) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:04:35.011836 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-40ea297a-cbd4-464b-87eb-ba3bfdb09193 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] 10.222.0.70 "DELETE /compute/v2.1/servers/92522ed7-8ac4-44b3-94b0-0aa3941cdbae" status: 204 len: 0 microversion: 2.1 time: 0.203946 Aug 27 03:04:35.016433 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2255/4478] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 03:04:34 2022] DELETE /compute/v2.1/servers/92522ed7-8ac4-44b3-94b0-0aa3941cdbae => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:04:35.020875 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4c03be16-ed82-47ef-acde-79c2bf3b1d03 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:35.021484 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-4c03be16-ed82-47ef-acde-79c2bf3b1d03 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] [instance: 92522ed7-8ac4-44b3-94b0-0aa3941cdbae] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:35.030383 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4c03be16-ed82-47ef-acde-79c2bf3b1d03 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:35.033163 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4c03be16-ed82-47ef-acde-79c2bf3b1d03 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:35.033877 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4c03be16-ed82-47ef-acde-79c2bf3b1d03 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:35.035821 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4c03be16-ed82-47ef-acde-79c2bf3b1d03 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:35.037324 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4c03be16-ed82-47ef-acde-79c2bf3b1d03 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:35.039467 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4c03be16-ed82-47ef-acde-79c2bf3b1d03 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:35.241422 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-1edf3d12-0c81-47d4-a3a4-d49530cb081e tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:35.242121 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-1edf3d12-0c81-47d4-a3a4-d49530cb081e tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: 8a65899b-549f-4312-bf67-a1ca9a8f79d7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:35.256099 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-4c03be16-ed82-47ef-acde-79c2bf3b1d03 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c3da1faaee46ca94d2a2543851f3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32a1b54e30415eb8f0e6df5e8b7be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:04:35.266269 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1edf3d12-0c81-47d4-a3a4-d49530cb081e tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:35.266784 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-4c03be16-ed82-47ef-acde-79c2bf3b1d03 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] 10.222.0.70 "GET /compute/v2.1/servers/92522ed7-8ac4-44b3-94b0-0aa3941cdbae" status: 200 len: 1504 microversion: 2.1 time: 0.249163 Aug 27 03:04:35.266940 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1edf3d12-0c81-47d4-a3a4-d49530cb081e tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:35.267316 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1edf3d12-0c81-47d4-a3a4-d49530cb081e tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:35.268059 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1edf3d12-0c81-47d4-a3a4-d49530cb081e tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:35.268536 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1edf3d12-0c81-47d4-a3a4-d49530cb081e tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:35.268979 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2224/4479] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:04:35 2022] GET /compute/v2.1/servers/92522ed7-8ac4-44b3-94b0-0aa3941cdbae => generated 1504 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:04:35.269110 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1edf3d12-0c81-47d4-a3a4-d49530cb081e tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:35.558507 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-1edf3d12-0c81-47d4-a3a4-d49530cb081e tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:04:35.568219 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-1edf3d12-0c81-47d4-a3a4-d49530cb081e tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/8a65899b-549f-4312-bf67-a1ca9a8f79d7" status: 200 len: 1309 microversion: 2.1 time: 0.332811 Aug 27 03:04:35.569437 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2256/4480] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:04:35 2022] GET /compute/v2.1/servers/8a65899b-549f-4312-bf67-a1ca9a8f79d7 => generated 1309 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:04:36.292383 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-25faa4ef-b868-4ddf-9f42-ff35f0f07be6 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:36.293642 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-25faa4ef-b868-4ddf-9f42-ff35f0f07be6 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] [instance: 92522ed7-8ac4-44b3-94b0-0aa3941cdbae] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:36.307763 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-25faa4ef-b868-4ddf-9f42-ff35f0f07be6 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:36.311608 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-25faa4ef-b868-4ddf-9f42-ff35f0f07be6 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:36.312287 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-25faa4ef-b868-4ddf-9f42-ff35f0f07be6 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:36.313546 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-25faa4ef-b868-4ddf-9f42-ff35f0f07be6 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:36.313849 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-25faa4ef-b868-4ddf-9f42-ff35f0f07be6 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:36.314271 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-25faa4ef-b868-4ddf-9f42-ff35f0f07be6 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:36.594930 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-797ef285-3e05-4197-a3cd-a2d7546abdbe tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:36.596236 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-797ef285-3e05-4197-a3cd-a2d7546abdbe tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: 8a65899b-549f-4312-bf67-a1ca9a8f79d7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:36.606712 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-797ef285-3e05-4197-a3cd-a2d7546abdbe tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:36.607594 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-797ef285-3e05-4197-a3cd-a2d7546abdbe tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:36.608193 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-797ef285-3e05-4197-a3cd-a2d7546abdbe tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:36.609862 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-797ef285-3e05-4197-a3cd-a2d7546abdbe tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:36.610483 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-797ef285-3e05-4197-a3cd-a2d7546abdbe tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:36.611074 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-797ef285-3e05-4197-a3cd-a2d7546abdbe tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:37.007801 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:04:37.050914 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=6 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:04:37.255595 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:04:37.290054 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-25faa4ef-b868-4ddf-9f42-ff35f0f07be6 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c3da1faaee46ca94d2a2543851f3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32a1b54e30415eb8f0e6df5e8b7be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:04:37.307206 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-25faa4ef-b868-4ddf-9f42-ff35f0f07be6 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] 10.222.0.70 "GET /compute/v2.1/servers/92522ed7-8ac4-44b3-94b0-0aa3941cdbae" status: 200 len: 1504 microversion: 2.1 time: 1.018678 Aug 27 03:04:37.307897 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2225/4481] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:04:36 2022] GET /compute/v2.1/servers/92522ed7-8ac4-44b3-94b0-0aa3941cdbae => generated 1504 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:04:37.312869 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-797ef285-3e05-4197-a3cd-a2d7546abdbe tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:04:37.326862 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-797ef285-3e05-4197-a3cd-a2d7546abdbe tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/8a65899b-549f-4312-bf67-a1ca9a8f79d7" status: 200 len: 1309 microversion: 2.1 time: 0.740791 Aug 27 03:04:37.340018 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2257/4482] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:04:36 2022] GET /compute/v2.1/servers/8a65899b-549f-4312-bf67-a1ca9a8f79d7 => generated 1309 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:04:38.327962 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-1512941e-f636-4432-bf5a-889eeb0631c6 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:38.328768 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-1512941e-f636-4432-bf5a-889eeb0631c6 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] [instance: 92522ed7-8ac4-44b3-94b0-0aa3941cdbae] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:38.347260 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b302250c-067a-4d7a-a249-0e8d5cf2b648 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:38.347936 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b302250c-067a-4d7a-a249-0e8d5cf2b648 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: 8a65899b-549f-4312-bf67-a1ca9a8f79d7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:38.349272 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1512941e-f636-4432-bf5a-889eeb0631c6 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:38.349790 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1512941e-f636-4432-bf5a-889eeb0631c6 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:38.350232 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1512941e-f636-4432-bf5a-889eeb0631c6 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:38.350980 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1512941e-f636-4432-bf5a-889eeb0631c6 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:38.351432 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1512941e-f636-4432-bf5a-889eeb0631c6 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:38.351864 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1512941e-f636-4432-bf5a-889eeb0631c6 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:38.363081 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b302250c-067a-4d7a-a249-0e8d5cf2b648 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:38.363592 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b302250c-067a-4d7a-a249-0e8d5cf2b648 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:38.364041 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b302250c-067a-4d7a-a249-0e8d5cf2b648 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:38.364796 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b302250c-067a-4d7a-a249-0e8d5cf2b648 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:38.365245 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b302250c-067a-4d7a-a249-0e8d5cf2b648 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:38.373155 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b302250c-067a-4d7a-a249-0e8d5cf2b648 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:38.411344 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:04:38.718094 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-1512941e-f636-4432-bf5a-889eeb0631c6 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c3da1faaee46ca94d2a2543851f3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32a1b54e30415eb8f0e6df5e8b7be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:04:38.728060 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-1512941e-f636-4432-bf5a-889eeb0631c6 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] 10.222.0.70 "GET /compute/v2.1/servers/92522ed7-8ac4-44b3-94b0-0aa3941cdbae" status: 200 len: 1504 microversion: 2.1 time: 0.403922 Aug 27 03:04:38.732697 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2226/4483] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:04:38 2022] GET /compute/v2.1/servers/92522ed7-8ac4-44b3-94b0-0aa3941cdbae => generated 1504 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:04:39.242521 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-b302250c-067a-4d7a-a249-0e8d5cf2b648 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:04:39.255960 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b302250c-067a-4d7a-a249-0e8d5cf2b648 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/8a65899b-549f-4312-bf67-a1ca9a8f79d7" status: 200 len: 1309 microversion: 2.1 time: 0.912524 Aug 27 03:04:39.259169 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2258/4484] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:04:38 2022] GET /compute/v2.1/servers/8a65899b-549f-4312-bf67-a1ca9a8f79d7 => generated 1309 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:04:39.416850 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-a9b41f18-e703-4db8-935e-ea96a04ec0fb req-7e513cfb-23c9-430a-8696-d29114810137 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92522ed7-8ac4-44b3-94b0-0aa3941cdbae", "name": "network-vif-deleted", "tag": "6fe9e210-ea15-4e46-ad72-84a07d6eedce"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:04:39.441047 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-a9b41f18-e703-4db8-935e-ea96a04ec0fb req-7e513cfb-23c9-430a-8696-d29114810137 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:39.441567 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-a9b41f18-e703-4db8-935e-ea96a04ec0fb req-7e513cfb-23c9-430a-8696-d29114810137 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:39.444173 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-a9b41f18-e703-4db8-935e-ea96a04ec0fb req-7e513cfb-23c9-430a-8696-d29114810137 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:39.466001 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-a9b41f18-e703-4db8-935e-ea96a04ec0fb req-7e513cfb-23c9-430a-8696-d29114810137 service nova] Creating event network-vif-deleted:6fe9e210-ea15-4e46-ad72-84a07d6eedce for instance 92522ed7-8ac4-44b3-94b0-0aa3941cdbae on n-h2-852278-4 Aug 27 03:04:39.482056 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-a9b41f18-e703-4db8-935e-ea96a04ec0fb req-7e513cfb-23c9-430a-8696-d29114810137 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068691 Aug 27 03:04:39.485513 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2227/4485] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:04:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:04:39.729542 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-eaccc98c-940f-4480-9504-0ab7e106070a req-50257090-97fe-4bb3-9a56-df10f807de93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a65899b-549f-4312-bf67-a1ca9a8f79d7", "name": "network-vif-plugged", "status": "completed", "tag": "984a8cb7-1e8f-4e81-a97f-833a7e52f85b"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:04:39.753815 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a41b20f0-a95c-4929-b3b7-4aae776e5f7e tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:39.754524 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a41b20f0-a95c-4929-b3b7-4aae776e5f7e tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] [instance: 92522ed7-8ac4-44b3-94b0-0aa3941cdbae] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:39.767673 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a41b20f0-a95c-4929-b3b7-4aae776e5f7e tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:39.770562 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-eaccc98c-940f-4480-9504-0ab7e106070a req-50257090-97fe-4bb3-9a56-df10f807de93 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:39.771158 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-eaccc98c-940f-4480-9504-0ab7e106070a req-50257090-97fe-4bb3-9a56-df10f807de93 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:39.778821 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a41b20f0-a95c-4929-b3b7-4aae776e5f7e tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:39.779318 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a41b20f0-a95c-4929-b3b7-4aae776e5f7e tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:39.780078 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a41b20f0-a95c-4929-b3b7-4aae776e5f7e tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:39.780571 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a41b20f0-a95c-4929-b3b7-4aae776e5f7e tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:39.780994 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a41b20f0-a95c-4929-b3b7-4aae776e5f7e tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:39.786850 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-eaccc98c-940f-4480-9504-0ab7e106070a req-50257090-97fe-4bb3-9a56-df10f807de93 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:39.830594 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-eaccc98c-940f-4480-9504-0ab7e106070a req-50257090-97fe-4bb3-9a56-df10f807de93 service nova] Creating event network-vif-plugged:984a8cb7-1e8f-4e81-a97f-833a7e52f85b for instance 8a65899b-549f-4312-bf67-a1ca9a8f79d7 on n-h1-852278-4 Aug 27 03:04:39.842256 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-eaccc98c-940f-4480-9504-0ab7e106070a req-50257090-97fe-4bb3-9a56-df10f807de93 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117465 Aug 27 03:04:39.850221 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2259/4486] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:04:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:04:39.903688 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-860aca60-995a-4bff-96dc-3b4dd55c1501 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:39.906075 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-860aca60-995a-4bff-96dc-3b4dd55c1501 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] [instance: f90d78a8-dea6-45c3-933c-8184ff4858b1] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:39.915165 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a41b20f0-a95c-4929-b3b7-4aae776e5f7e tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:39.915935 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a41b20f0-a95c-4929-b3b7-4aae776e5f7e tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:39.916611 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a41b20f0-a95c-4929-b3b7-4aae776e5f7e tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:39.917175 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.instance [None req-a41b20f0-a95c-4929-b3b7-4aae776e5f7e tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lazy-loading 'fault' on Instance uuid 92522ed7-8ac4-44b3-94b0-0aa3941cdbae {{(pid=134052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:04:39.936734 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-860aca60-995a-4bff-96dc-3b4dd55c1501 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:39.937544 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-860aca60-995a-4bff-96dc-3b4dd55c1501 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:39.939544 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-860aca60-995a-4bff-96dc-3b4dd55c1501 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:39.940519 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-860aca60-995a-4bff-96dc-3b4dd55c1501 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:39.942826 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-860aca60-995a-4bff-96dc-3b4dd55c1501 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:39.951748 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-860aca60-995a-4bff-96dc-3b4dd55c1501 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:40.002250 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-860aca60-995a-4bff-96dc-3b4dd55c1501 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] 10.222.0.70 "GET /compute/v2.1/servers/f90d78a8-dea6-45c3-933c-8184ff4858b1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.102786 Aug 27 03:04:40.003058 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2260/4487] 10.222.0.70 () {58 vars in 1302 bytes} [Sat Aug 27 03:04:39 2022] GET /compute/v2.1/servers/f90d78a8-dea6-45c3-933c-8184ff4858b1/os-volume_attachments => generated 25 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 27 03:04:40.015345 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-a41b20f0-a95c-4929-b3b7-4aae776e5f7e tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c3da1faaee46ca94d2a2543851f3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32a1b54e30415eb8f0e6df5e8b7be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:04:40.031907 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a41b20f0-a95c-4929-b3b7-4aae776e5f7e tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] 10.222.0.70 "GET /compute/v2.1/servers/92522ed7-8ac4-44b3-94b0-0aa3941cdbae" status: 200 len: 1303 microversion: 2.1 time: 0.280678 Aug 27 03:04:40.037098 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2228/4488] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:04:39 2022] GET /compute/v2.1/servers/92522ed7-8ac4-44b3-94b0-0aa3941cdbae => generated 1303 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:04:40.172089 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0daa8532-1238-43f5-904c-485335edb610 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:40.176510 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-0daa8532-1238-43f5-904c-485335edb610 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] [instance: f90d78a8-dea6-45c3-933c-8184ff4858b1] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:40.187547 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0daa8532-1238-43f5-904c-485335edb610 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:40.190526 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0daa8532-1238-43f5-904c-485335edb610 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:40.194137 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0daa8532-1238-43f5-904c-485335edb610 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:40.195046 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0daa8532-1238-43f5-904c-485335edb610 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:40.195766 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0daa8532-1238-43f5-904c-485335edb610 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:40.196350 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0daa8532-1238-43f5-904c-485335edb610 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:40.263205 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-0daa8532-1238-43f5-904c-485335edb610 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] 10.222.0.70 "GET /compute/v2.1/servers/f90d78a8-dea6-45c3-933c-8184ff4858b1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.096692 Aug 27 03:04:40.267313 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2261/4489] 10.222.0.70 () {58 vars in 1302 bytes} [Sat Aug 27 03:04:40 2022] GET /compute/v2.1/servers/f90d78a8-dea6-45c3-933c-8184ff4858b1/os-volume_attachments => generated 25 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:04:40.297396 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b1c9f987-a124-4d16-84d2-5acfc016dbf6 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:40.300777 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b1c9f987-a124-4d16-84d2-5acfc016dbf6 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: 8a65899b-549f-4312-bf67-a1ca9a8f79d7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:40.355997 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b1c9f987-a124-4d16-84d2-5acfc016dbf6 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:40.361206 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b1c9f987-a124-4d16-84d2-5acfc016dbf6 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:40.362707 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b1c9f987-a124-4d16-84d2-5acfc016dbf6 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:40.363096 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b1c9f987-a124-4d16-84d2-5acfc016dbf6 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:40.363554 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b1c9f987-a124-4d16-84d2-5acfc016dbf6 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:40.363968 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b1c9f987-a124-4d16-84d2-5acfc016dbf6 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:40.465335 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-918c1230-c7b6-41bd-98d9-8f72f5b7354d tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:40.468051 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-918c1230-c7b6-41bd-98d9-8f72f5b7354d tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] [instance: f90d78a8-dea6-45c3-933c-8184ff4858b1] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:40.482238 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-918c1230-c7b6-41bd-98d9-8f72f5b7354d tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:40.485023 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-918c1230-c7b6-41bd-98d9-8f72f5b7354d tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:40.485692 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-918c1230-c7b6-41bd-98d9-8f72f5b7354d tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:40.486615 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-918c1230-c7b6-41bd-98d9-8f72f5b7354d tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:40.487469 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-918c1230-c7b6-41bd-98d9-8f72f5b7354d tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:40.490923 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-918c1230-c7b6-41bd-98d9-8f72f5b7354d tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:40.523366 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-918c1230-c7b6-41bd-98d9-8f72f5b7354d tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] [instance: f90d78a8-dea6-45c3-933c-8184ff4858b1] Going to try to terminate instance {{(pid=134051) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:04:40.665553 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-918c1230-c7b6-41bd-98d9-8f72f5b7354d tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] 10.222.0.70 "DELETE /compute/v2.1/servers/f90d78a8-dea6-45c3-933c-8184ff4858b1" status: 204 len: 0 microversion: 2.1 time: 0.203443 Aug 27 03:04:40.671713 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2262/4490] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 03:04:40 2022] DELETE /compute/v2.1/servers/f90d78a8-dea6-45c3-933c-8184ff4858b1 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 03:04:40.682381 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b105cb47-ecd7-43ad-8323-baf8ce3fad39 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:40.683859 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b105cb47-ecd7-43ad-8323-baf8ce3fad39 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] [instance: f90d78a8-dea6-45c3-933c-8184ff4858b1] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:40.708868 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b1c9f987-a124-4d16-84d2-5acfc016dbf6 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:04:40.721500 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b105cb47-ecd7-43ad-8323-baf8ce3fad39 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:40.722823 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b105cb47-ecd7-43ad-8323-baf8ce3fad39 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:40.723192 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b1c9f987-a124-4d16-84d2-5acfc016dbf6 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/8a65899b-549f-4312-bf67-a1ca9a8f79d7" status: 200 len: 1309 microversion: 2.1 time: 0.442751 Aug 27 03:04:40.725520 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b105cb47-ecd7-43ad-8323-baf8ce3fad39 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:40.726071 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2229/4491] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:04:40 2022] GET /compute/v2.1/servers/8a65899b-549f-4312-bf67-a1ca9a8f79d7 => generated 1309 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:04:40.728094 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b105cb47-ecd7-43ad-8323-baf8ce3fad39 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:40.728743 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b105cb47-ecd7-43ad-8323-baf8ce3fad39 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:40.730914 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b105cb47-ecd7-43ad-8323-baf8ce3fad39 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:41.060111 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-b105cb47-ecd7-43ad-8323-baf8ce3fad39 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe0328160c6472086d13907344756cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41649f09cbf410a9825100c498b4916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:04:41.074513 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b105cb47-ecd7-43ad-8323-baf8ce3fad39 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] 10.222.0.70 "GET /compute/v2.1/servers/f90d78a8-dea6-45c3-933c-8184ff4858b1" status: 200 len: 1671 microversion: 2.1 time: 0.399805 Aug 27 03:04:41.076682 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2263/4492] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:04:40 2022] GET /compute/v2.1/servers/f90d78a8-dea6-45c3-933c-8184ff4858b1 => generated 1671 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:04:41.081399 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-55d4703b-1ac3-43a3-b88a-4697a9b93ba6 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:41.082030 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-55d4703b-1ac3-43a3-b88a-4697a9b93ba6 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] [instance: 92522ed7-8ac4-44b3-94b0-0aa3941cdbae] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:41.093221 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-55d4703b-1ac3-43a3-b88a-4697a9b93ba6 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:41.096927 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-55d4703b-1ac3-43a3-b88a-4697a9b93ba6 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:41.097758 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-55d4703b-1ac3-43a3-b88a-4697a9b93ba6 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:41.100137 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-55d4703b-1ac3-43a3-b88a-4697a9b93ba6 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:41.102956 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-55d4703b-1ac3-43a3-b88a-4697a9b93ba6 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:41.106799 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-55d4703b-1ac3-43a3-b88a-4697a9b93ba6 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:41.142261 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-55d4703b-1ac3-43a3-b88a-4697a9b93ba6 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] HTTP exception thrown: Instance 92522ed7-8ac4-44b3-94b0-0aa3941cdbae could not be found. Aug 27 03:04:41.143955 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-55d4703b-1ac3-43a3-b88a-4697a9b93ba6 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Request method failure captured: Aug 27 03:04:41.143955 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/servers/92522ed7-8ac4-44b3-94b0-0aa3941cdbae HTTP/1.1 Aug 27 03:04:41.143955 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 03:04:41.143955 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 03:04:41.143955 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 03:04:41.143955 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 03:04:41.143955 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 03:04:41.143955 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 03:04:41.143955 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 03:04:41.143955 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 03:04:41.143955 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYlbJOl9e08fctHjMhNbWGG6H2k4rzPkjc-Otyp81dKrAeYDQfJcNL-uKovVPra9Vh2F8gIEk9tJgtgT4vQ0WDrsWBVMcxd25MmTWiOwT07V1mLq8tfqW6R0QifAOGctbmFZOw4udUGApcIMDdk_IstzJQBIH1AXcp8cCB5p7pZUcUU Aug 27 03:04:41.143955 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 03:04:41.143955 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 03:04:41.143955 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 03:04:41.143955 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 03:04:41.143955 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 03:04:41.143955 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 03:04:41.143955 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: fc32a1b54e30415eb8f0e6df5e8b7be6 Aug 27 03:04:41.143955 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ServerRescueTestJSON-1904833970 Aug 27 03:04:41.143955 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 03:04:41.143955 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 03:04:41.143955 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/fc32a1b54e30415eb8f0e6df5e8b7be6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_fc32a1b54e30415eb8f0e6df5e8b7be6", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/fc32a1b54e30415eb8f0e6df5e8b7be6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/fc32a1b54e30415eb8f0e6df5e8b7be6"}]}] Aug 27 03:04:41.143955 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ServerRescueTestJSON-1904833970 Aug 27 03:04:41.143955 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: fc32a1b54e30415eb8f0e6df5e8b7be6 Aug 27 03:04:41.143955 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ServerRescueTestJSON-1904833970 Aug 27 03:04:41.143955 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ServerRescueTestJSON-1904833970-project Aug 27 03:04:41.143955 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 03:04:41.143955 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 03:04:41.143955 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: e0c3da1faaee46ca94d2a2543851f3f6 Aug 27 03:04:41.143955 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ServerRescueTestJSON-1904833970-project Aug 27 03:04:41.143955 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 03:04:41.143955 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance 92522ed7-8ac4-44b3-94b0-0aa3941cdbae could not be found. Aug 27 03:04:41.143955 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '92522ed7-8ac4-44b3-94b0-0aa3941cdbae'} Aug 27 03:04:41.143955 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:04:41.143955 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:04:41.143955 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:04:41.143955 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:04:41.143955 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:04:41.143955 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:04:41.143955 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:04:41.143955 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:04:41.143955 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:04:41.143955 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:04:41.143955 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92522ed7-8ac4-44b3-94b0-0aa3941cdbae could not be found. Aug 27 03:04:41.143955 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:04:41.143955 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:04:41.143955 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:04:41.143955 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:04:41.143955 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:04:41.143955 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:04:41.143955 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:04:41.143955 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:04:41.143955 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:04:41.143955 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:04:41.143955 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:04:41.143955 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:04:41.143955 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:04:41.143955 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:04:41.143955 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:04:41.143955 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:04:41.143955 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92522ed7-8ac4-44b3-94b0-0aa3941cdbae could not be found. Aug 27 03:04:41.143955 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:04:41.143955 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:04:41.143955 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:04:41.148841 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:04:41.148841 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:04:41.148841 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:04:41.148841 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:04:41.148841 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:04:41.148841 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92522ed7-8ac4-44b3-94b0-0aa3941cdbae could not be found. Aug 27 03:04:41.148841 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:04:41.150783 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-55d4703b-1ac3-43a3-b88a-4697a9b93ba6 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Returning 404 to user: Instance 92522ed7-8ac4-44b3-94b0-0aa3941cdbae could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:04:41.152115 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-55d4703b-1ac3-43a3-b88a-4697a9b93ba6 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] 10.222.0.70 "GET /compute/v2.1/servers/92522ed7-8ac4-44b3-94b0-0aa3941cdbae" status: 404 len: 111 microversion: 2.1 time: 0.094055 Aug 27 03:04:41.157568 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2230/4493] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:04:41 2022] GET /compute/v2.1/servers/92522ed7-8ac4-44b3-94b0-0aa3941cdbae => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:04:41.166471 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-465dc3e7-3ec8-452d-8147-34b1fd3aa754 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:41.166965 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-465dc3e7-3ec8-452d-8147-34b1fd3aa754 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] [instance: 0069592c-7187-4b4d-ab74-3a1a3bc3de80] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:41.178821 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-465dc3e7-3ec8-452d-8147-34b1fd3aa754 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:41.180375 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-465dc3e7-3ec8-452d-8147-34b1fd3aa754 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:41.181656 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-465dc3e7-3ec8-452d-8147-34b1fd3aa754 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:41.183983 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-465dc3e7-3ec8-452d-8147-34b1fd3aa754 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:41.186299 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-465dc3e7-3ec8-452d-8147-34b1fd3aa754 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:41.186922 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-465dc3e7-3ec8-452d-8147-34b1fd3aa754 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:41.235939 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-465dc3e7-3ec8-452d-8147-34b1fd3aa754 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] [instance: 0069592c-7187-4b4d-ab74-3a1a3bc3de80] Going to try to terminate instance {{(pid=134051) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:04:41.370085 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-465dc3e7-3ec8-452d-8147-34b1fd3aa754 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] 10.222.0.70 "DELETE /compute/v2.1/servers/0069592c-7187-4b4d-ab74-3a1a3bc3de80" status: 204 len: 0 microversion: 2.1 time: 0.208319 Aug 27 03:04:41.372049 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2264/4494] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 03:04:41 2022] DELETE /compute/v2.1/servers/0069592c-7187-4b4d-ab74-3a1a3bc3de80 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:04:41.391889 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-7fe1e719-f74c-4204-bad9-d903a7bfba60 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:41.393532 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-7fe1e719-f74c-4204-bad9-d903a7bfba60 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] [instance: 0069592c-7187-4b4d-ab74-3a1a3bc3de80] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:41.411179 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7fe1e719-f74c-4204-bad9-d903a7bfba60 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:41.411901 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7fe1e719-f74c-4204-bad9-d903a7bfba60 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:41.412549 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7fe1e719-f74c-4204-bad9-d903a7bfba60 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:41.413490 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7fe1e719-f74c-4204-bad9-d903a7bfba60 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:41.414116 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7fe1e719-f74c-4204-bad9-d903a7bfba60 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:41.414699 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7fe1e719-f74c-4204-bad9-d903a7bfba60 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:41.419801 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:04:41.604152 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-7fe1e719-f74c-4204-bad9-d903a7bfba60 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c3da1faaee46ca94d2a2543851f3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32a1b54e30415eb8f0e6df5e8b7be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:04:41.619616 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-7fe1e719-f74c-4204-bad9-d903a7bfba60 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] 10.222.0.70 "GET /compute/v2.1/servers/0069592c-7187-4b4d-ab74-3a1a3bc3de80" status: 200 len: 1492 microversion: 2.1 time: 0.241839 Aug 27 03:04:41.621307 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2231/4495] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:04:41 2022] GET /compute/v2.1/servers/0069592c-7187-4b4d-ab74-3a1a3bc3de80 => generated 1492 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:04:41.747005 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-367409af-f56f-4fcd-9c13-cacd36eb8f44 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:41.747827 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-367409af-f56f-4fcd-9c13-cacd36eb8f44 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: 8a65899b-549f-4312-bf67-a1ca9a8f79d7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:41.754509 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-367409af-f56f-4fcd-9c13-cacd36eb8f44 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:41.755000 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-367409af-f56f-4fcd-9c13-cacd36eb8f44 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:41.755434 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-367409af-f56f-4fcd-9c13-cacd36eb8f44 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:41.756137 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-367409af-f56f-4fcd-9c13-cacd36eb8f44 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:41.757527 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-367409af-f56f-4fcd-9c13-cacd36eb8f44 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:41.757957 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-367409af-f56f-4fcd-9c13-cacd36eb8f44 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:41.911749 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-367409af-f56f-4fcd-9c13-cacd36eb8f44 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:04:41.931870 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-367409af-f56f-4fcd-9c13-cacd36eb8f44 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/8a65899b-549f-4312-bf67-a1ca9a8f79d7" status: 200 len: 1309 microversion: 2.1 time: 0.189545 Aug 27 03:04:41.932515 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2265/4496] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:04:41 2022] GET /compute/v2.1/servers/8a65899b-549f-4312-bf67-a1ca9a8f79d7 => generated 1309 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:04:42.097949 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-67de024d-93bd-41a8-92db-9aa8a41a7a52 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:42.098604 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-67de024d-93bd-41a8-92db-9aa8a41a7a52 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] [instance: f90d78a8-dea6-45c3-933c-8184ff4858b1] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:42.106294 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-67de024d-93bd-41a8-92db-9aa8a41a7a52 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:42.107397 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-67de024d-93bd-41a8-92db-9aa8a41a7a52 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:42.107990 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-67de024d-93bd-41a8-92db-9aa8a41a7a52 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:42.108890 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-67de024d-93bd-41a8-92db-9aa8a41a7a52 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:42.109523 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-67de024d-93bd-41a8-92db-9aa8a41a7a52 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:42.110164 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-67de024d-93bd-41a8-92db-9aa8a41a7a52 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:42.337203 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-67de024d-93bd-41a8-92db-9aa8a41a7a52 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe0328160c6472086d13907344756cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41649f09cbf410a9825100c498b4916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:04:42.346425 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-67de024d-93bd-41a8-92db-9aa8a41a7a52 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] 10.222.0.70 "GET /compute/v2.1/servers/f90d78a8-dea6-45c3-933c-8184ff4858b1" status: 200 len: 1671 microversion: 2.1 time: 0.253003 Aug 27 03:04:42.347631 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2232/4497] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:04:42 2022] GET /compute/v2.1/servers/f90d78a8-dea6-45c3-933c-8184ff4858b1 => generated 1671 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:04:42.649567 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-65aa117f-c00c-4d82-8716-a9fde8d1a002 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:42.651167 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-65aa117f-c00c-4d82-8716-a9fde8d1a002 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] [instance: 0069592c-7187-4b4d-ab74-3a1a3bc3de80] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:42.675238 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-65aa117f-c00c-4d82-8716-a9fde8d1a002 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:42.676164 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-65aa117f-c00c-4d82-8716-a9fde8d1a002 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:42.676917 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-65aa117f-c00c-4d82-8716-a9fde8d1a002 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:42.677946 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-65aa117f-c00c-4d82-8716-a9fde8d1a002 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:42.678559 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-65aa117f-c00c-4d82-8716-a9fde8d1a002 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:42.679178 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-65aa117f-c00c-4d82-8716-a9fde8d1a002 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:42.911256 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-65aa117f-c00c-4d82-8716-a9fde8d1a002 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c3da1faaee46ca94d2a2543851f3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32a1b54e30415eb8f0e6df5e8b7be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:04:42.922648 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-65aa117f-c00c-4d82-8716-a9fde8d1a002 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] 10.222.0.70 "GET /compute/v2.1/servers/0069592c-7187-4b4d-ab74-3a1a3bc3de80" status: 200 len: 1492 microversion: 2.1 time: 0.283699 Aug 27 03:04:42.925553 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2266/4498] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:04:42 2022] GET /compute/v2.1/servers/0069592c-7187-4b4d-ab74-3a1a3bc3de80 => generated 1492 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:04:42.958245 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8c054a2c-9f65-4d6f-8de8-273618a6fa5b tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:42.960737 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-8c054a2c-9f65-4d6f-8de8-273618a6fa5b tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: 8a65899b-549f-4312-bf67-a1ca9a8f79d7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:42.973541 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8c054a2c-9f65-4d6f-8de8-273618a6fa5b tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:42.974903 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8c054a2c-9f65-4d6f-8de8-273618a6fa5b tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:42.975909 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8c054a2c-9f65-4d6f-8de8-273618a6fa5b tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:42.978666 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8c054a2c-9f65-4d6f-8de8-273618a6fa5b tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:42.979761 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8c054a2c-9f65-4d6f-8de8-273618a6fa5b tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:42.987131 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8c054a2c-9f65-4d6f-8de8-273618a6fa5b tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:43.331043 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-8c054a2c-9f65-4d6f-8de8-273618a6fa5b tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:04:43.340288 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-8c054a2c-9f65-4d6f-8de8-273618a6fa5b tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/8a65899b-549f-4312-bf67-a1ca9a8f79d7" status: 200 len: 1490 microversion: 2.1 time: 0.390096 Aug 27 03:04:43.355015 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2233/4499] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:04:42 2022] GET /compute/v2.1/servers/8a65899b-549f-4312-bf67-a1ca9a8f79d7 => generated 1490 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:04:43.362022 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-33ef6374-d1e4-49c5-ae6a-12e1d8351de7 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:43.363141 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-33ef6374-d1e4-49c5-ae6a-12e1d8351de7 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: d8e61004-a8c1-4880-82b3-133f361a0dfc] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:43.371997 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b7cc57e5-f9fd-434a-8871-635c2348ea86 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:43.376118 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b7cc57e5-f9fd-434a-8871-635c2348ea86 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] [instance: f90d78a8-dea6-45c3-933c-8184ff4858b1] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:43.381290 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-33ef6374-d1e4-49c5-ae6a-12e1d8351de7 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:43.383838 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-33ef6374-d1e4-49c5-ae6a-12e1d8351de7 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:43.388300 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-33ef6374-d1e4-49c5-ae6a-12e1d8351de7 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:43.389418 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-33ef6374-d1e4-49c5-ae6a-12e1d8351de7 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:43.390519 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-33ef6374-d1e4-49c5-ae6a-12e1d8351de7 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:43.392301 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b7cc57e5-f9fd-434a-8871-635c2348ea86 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:43.393126 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-33ef6374-d1e4-49c5-ae6a-12e1d8351de7 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:43.396743 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b7cc57e5-f9fd-434a-8871-635c2348ea86 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:43.397524 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b7cc57e5-f9fd-434a-8871-635c2348ea86 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:43.398492 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b7cc57e5-f9fd-434a-8871-635c2348ea86 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:43.402184 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b7cc57e5-f9fd-434a-8871-635c2348ea86 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:43.403703 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b7cc57e5-f9fd-434a-8871-635c2348ea86 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:43.891108 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b7cc57e5-f9fd-434a-8871-635c2348ea86 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe0328160c6472086d13907344756cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41649f09cbf410a9825100c498b4916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:04:43.902670 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b7cc57e5-f9fd-434a-8871-635c2348ea86 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] 10.222.0.70 "GET /compute/v2.1/servers/f90d78a8-dea6-45c3-933c-8184ff4858b1" status: 200 len: 1671 microversion: 2.1 time: 0.537008 Aug 27 03:04:43.903512 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2234/4500] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:04:43 2022] GET /compute/v2.1/servers/f90d78a8-dea6-45c3-933c-8184ff4858b1 => generated 1671 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:04:43.981722 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a897fbfa-d09c-48d9-977c-0d2b4882ee8b tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:43.982496 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a897fbfa-d09c-48d9-977c-0d2b4882ee8b tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] [instance: 0069592c-7187-4b4d-ab74-3a1a3bc3de80] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:44.013057 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a897fbfa-d09c-48d9-977c-0d2b4882ee8b tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:44.013942 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a897fbfa-d09c-48d9-977c-0d2b4882ee8b tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:44.014563 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a897fbfa-d09c-48d9-977c-0d2b4882ee8b tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:44.015459 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a897fbfa-d09c-48d9-977c-0d2b4882ee8b tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:44.016150 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a897fbfa-d09c-48d9-977c-0d2b4882ee8b tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:44.016782 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a897fbfa-d09c-48d9-977c-0d2b4882ee8b tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:44.064909 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-33ef6374-d1e4-49c5-ae6a-12e1d8351de7 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:04:44.074859 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-33ef6374-d1e4-49c5-ae6a-12e1d8351de7 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/d8e61004-a8c1-4880-82b3-133f361a0dfc" status: 200 len: 1489 microversion: 2.1 time: 0.716772 Aug 27 03:04:44.095651 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2267/4501] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:04:43 2022] GET /compute/v2.1/servers/d8e61004-a8c1-4880-82b3-133f361a0dfc => generated 1489 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:04:44.101072 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-63cacba0-a87c-4980-a013-38063cdb2703 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:44.113185 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-63cacba0-a87c-4980-a013-38063cdb2703 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: 8a65899b-549f-4312-bf67-a1ca9a8f79d7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:44.121835 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-63cacba0-a87c-4980-a013-38063cdb2703 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:44.122482 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-63cacba0-a87c-4980-a013-38063cdb2703 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:44.123023 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-63cacba0-a87c-4980-a013-38063cdb2703 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:44.123830 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-63cacba0-a87c-4980-a013-38063cdb2703 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:44.124566 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-63cacba0-a87c-4980-a013-38063cdb2703 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:44.125250 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-63cacba0-a87c-4980-a013-38063cdb2703 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:44.548426 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-63cacba0-a87c-4980-a013-38063cdb2703 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:04:44.588103 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-63cacba0-a87c-4980-a013-38063cdb2703 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/8a65899b-549f-4312-bf67-a1ca9a8f79d7" status: 200 len: 1490 microversion: 2.1 time: 0.481225 Aug 27 03:04:44.591109 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2268/4502] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:04:44 2022] GET /compute/v2.1/servers/8a65899b-549f-4312-bf67-a1ca9a8f79d7 => generated 1490 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:04:44.615460 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0dd20226-a193-4d8b-a895-9d151565bf47 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:44.615963 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-0dd20226-a193-4d8b-a895-9d151565bf47 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: 8a65899b-549f-4312-bf67-a1ca9a8f79d7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:44.628931 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0dd20226-a193-4d8b-a895-9d151565bf47 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:44.629645 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0dd20226-a193-4d8b-a895-9d151565bf47 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:44.630254 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0dd20226-a193-4d8b-a895-9d151565bf47 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:44.630960 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0dd20226-a193-4d8b-a895-9d151565bf47 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:44.632468 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0dd20226-a193-4d8b-a895-9d151565bf47 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:44.633152 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0dd20226-a193-4d8b-a895-9d151565bf47 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:44.640277 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-a897fbfa-d09c-48d9-977c-0d2b4882ee8b tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c3da1faaee46ca94d2a2543851f3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32a1b54e30415eb8f0e6df5e8b7be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:04:44.648275 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a897fbfa-d09c-48d9-977c-0d2b4882ee8b tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] 10.222.0.70 "GET /compute/v2.1/servers/0069592c-7187-4b4d-ab74-3a1a3bc3de80" status: 200 len: 1492 microversion: 2.1 time: 0.701816 Aug 27 03:04:44.648907 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2235/4503] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:04:43 2022] GET /compute/v2.1/servers/0069592c-7187-4b4d-ab74-3a1a3bc3de80 => generated 1492 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:04:44.667929 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-0dd20226-a193-4d8b-a895-9d151565bf47 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: 8a65899b-549f-4312-bf67-a1ca9a8f79d7] Going to try to terminate instance {{(pid=134051) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:04:44.786514 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=3 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:04:44.815955 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-0dd20226-a193-4d8b-a895-9d151565bf47 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "DELETE /compute/v2.1/servers/8a65899b-549f-4312-bf67-a1ca9a8f79d7" status: 204 len: 0 microversion: 2.1 time: 0.209095 Aug 27 03:04:44.816602 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2269/4504] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 03:04:44 2022] DELETE /compute/v2.1/servers/8a65899b-549f-4312-bf67-a1ca9a8f79d7 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:04:44.829609 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a6f39547-5457-4837-9dc6-987d0eaee4db tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:44.831063 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a6f39547-5457-4837-9dc6-987d0eaee4db tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: 8a65899b-549f-4312-bf67-a1ca9a8f79d7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:44.841824 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a6f39547-5457-4837-9dc6-987d0eaee4db tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:44.842591 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a6f39547-5457-4837-9dc6-987d0eaee4db tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:44.844122 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a6f39547-5457-4837-9dc6-987d0eaee4db tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:44.845273 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a6f39547-5457-4837-9dc6-987d0eaee4db tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:44.846553 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a6f39547-5457-4837-9dc6-987d0eaee4db tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:44.847290 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a6f39547-5457-4837-9dc6-987d0eaee4db tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:44.933133 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7be71612-333d-4af7-bf8c-df210f39ec79 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:44.934519 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-7be71612-333d-4af7-bf8c-df210f39ec79 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] [instance: f90d78a8-dea6-45c3-933c-8184ff4858b1] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:44.948460 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7be71612-333d-4af7-bf8c-df210f39ec79 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:44.949393 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7be71612-333d-4af7-bf8c-df210f39ec79 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:44.950540 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7be71612-333d-4af7-bf8c-df210f39ec79 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:44.951980 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7be71612-333d-4af7-bf8c-df210f39ec79 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:44.952792 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7be71612-333d-4af7-bf8c-df210f39ec79 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:44.953521 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7be71612-333d-4af7-bf8c-df210f39ec79 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:45.080268 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-7be71612-333d-4af7-bf8c-df210f39ec79 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe0328160c6472086d13907344756cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41649f09cbf410a9825100c498b4916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:04:45.083338 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:04:45.098417 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-7be71612-333d-4af7-bf8c-df210f39ec79 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] 10.222.0.70 "GET /compute/v2.1/servers/f90d78a8-dea6-45c3-933c-8184ff4858b1" status: 200 len: 1603 microversion: 2.1 time: 0.172647 Aug 27 03:04:45.099160 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2270/4505] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:04:44 2022] GET /compute/v2.1/servers/f90d78a8-dea6-45c3-933c-8184ff4858b1 => generated 1603 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:04:45.322661 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-a6f39547-5457-4837-9dc6-987d0eaee4db tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:04:45.337756 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a6f39547-5457-4837-9dc6-987d0eaee4db tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/8a65899b-549f-4312-bf67-a1ca9a8f79d7" status: 200 len: 1496 microversion: 2.1 time: 0.513652 Aug 27 03:04:45.341410 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2236/4506] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:04:44 2022] GET /compute/v2.1/servers/8a65899b-549f-4312-bf67-a1ca9a8f79d7 => generated 1496 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:04:45.375310 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-bb767b59-62f0-4920-9b76-39f76be9ba09 req-0e95c2e9-4ac8-4246-9a26-37ae117d3d78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0069592c-7187-4b4d-ab74-3a1a3bc3de80", "name": "network-vif-deleted", "tag": "3e000d21-3244-41a2-8197-507cf2017f67"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:04:45.397232 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-bb767b59-62f0-4920-9b76-39f76be9ba09 req-0e95c2e9-4ac8-4246-9a26-37ae117d3d78 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:45.397712 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-bb767b59-62f0-4920-9b76-39f76be9ba09 req-0e95c2e9-4ac8-4246-9a26-37ae117d3d78 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:45.398143 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-bb767b59-62f0-4920-9b76-39f76be9ba09 req-0e95c2e9-4ac8-4246-9a26-37ae117d3d78 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:45.426922 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-bb767b59-62f0-4920-9b76-39f76be9ba09 req-0e95c2e9-4ac8-4246-9a26-37ae117d3d78 service nova] Creating event network-vif-deleted:3e000d21-3244-41a2-8197-507cf2017f67 for instance 0069592c-7187-4b4d-ab74-3a1a3bc3de80 on n-h2-852278-4 Aug 27 03:04:45.433424 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-bb767b59-62f0-4920-9b76-39f76be9ba09 req-0e95c2e9-4ac8-4246-9a26-37ae117d3d78 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062434 Aug 27 03:04:45.434550 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2271/4507] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:04:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:04:45.671729 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5afd7ee5-01bc-4c5e-9336-e654686d2e27 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:45.677276 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-5afd7ee5-01bc-4c5e-9336-e654686d2e27 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] [instance: 0069592c-7187-4b4d-ab74-3a1a3bc3de80] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:45.693589 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5afd7ee5-01bc-4c5e-9336-e654686d2e27 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:45.694256 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5afd7ee5-01bc-4c5e-9336-e654686d2e27 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:45.695992 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5afd7ee5-01bc-4c5e-9336-e654686d2e27 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:45.698053 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5afd7ee5-01bc-4c5e-9336-e654686d2e27 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:45.705235 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5afd7ee5-01bc-4c5e-9336-e654686d2e27 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:45.707576 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5afd7ee5-01bc-4c5e-9336-e654686d2e27 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:45.775106 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5afd7ee5-01bc-4c5e-9336-e654686d2e27 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:45.776078 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5afd7ee5-01bc-4c5e-9336-e654686d2e27 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:45.776787 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5afd7ee5-01bc-4c5e-9336-e654686d2e27 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:45.777644 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.instance [None req-5afd7ee5-01bc-4c5e-9336-e654686d2e27 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lazy-loading 'fault' on Instance uuid 0069592c-7187-4b4d-ab74-3a1a3bc3de80 {{(pid=134052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:04:45.831761 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-5afd7ee5-01bc-4c5e-9336-e654686d2e27 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c3da1faaee46ca94d2a2543851f3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32a1b54e30415eb8f0e6df5e8b7be6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:04:45.841140 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-5afd7ee5-01bc-4c5e-9336-e654686d2e27 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] 10.222.0.70 "GET /compute/v2.1/servers/0069592c-7187-4b4d-ab74-3a1a3bc3de80" status: 200 len: 1304 microversion: 2.1 time: 0.174682 Aug 27 03:04:45.842487 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2237/4508] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:04:45 2022] GET /compute/v2.1/servers/0069592c-7187-4b4d-ab74-3a1a3bc3de80 => generated 1304 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:04:46.122196 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-70abe523-c8c9-45c0-9904-0816ef29abdd tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:46.122897 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-70abe523-c8c9-45c0-9904-0816ef29abdd tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] [instance: f90d78a8-dea6-45c3-933c-8184ff4858b1] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:46.136219 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-70abe523-c8c9-45c0-9904-0816ef29abdd tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:46.136740 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-70abe523-c8c9-45c0-9904-0816ef29abdd tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:46.137173 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-70abe523-c8c9-45c0-9904-0816ef29abdd tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:46.137887 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-70abe523-c8c9-45c0-9904-0816ef29abdd tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:46.138340 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-70abe523-c8c9-45c0-9904-0816ef29abdd tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:46.138758 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-70abe523-c8c9-45c0-9904-0816ef29abdd tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:46.147934 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4316524a-5cd4-4ace-9dc8-18e6ba8a4958 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "880ae5ba-8aed-42f6-9916-fc0c66ee40ff"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:04:46.150599 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-4316524a-5cd4-4ace-9dc8-18e6ba8a4958 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: cd881214-dd67-4897-9167-335d7e48d789] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:46.168121 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4316524a-5cd4-4ace-9dc8-18e6ba8a4958 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:46.172614 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4316524a-5cd4-4ace-9dc8-18e6ba8a4958 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:46.176842 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4316524a-5cd4-4ace-9dc8-18e6ba8a4958 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:46.181296 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4316524a-5cd4-4ace-9dc8-18e6ba8a4958 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:46.182614 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4316524a-5cd4-4ace-9dc8-18e6ba8a4958 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:46.183421 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4316524a-5cd4-4ace-9dc8-18e6ba8a4958 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:46.262847 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-70abe523-c8c9-45c0-9904-0816ef29abdd tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:46.263334 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-70abe523-c8c9-45c0-9904-0816ef29abdd tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:46.266116 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-70abe523-c8c9-45c0-9904-0816ef29abdd tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:46.267601 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.objects.instance [None req-70abe523-c8c9-45c0-9904-0816ef29abdd tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lazy-loading 'fault' on Instance uuid f90d78a8-dea6-45c3-933c-8184ff4858b1 {{(pid=134051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:04:46.348777 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-70abe523-c8c9-45c0-9904-0816ef29abdd tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe0328160c6472086d13907344756cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41649f09cbf410a9825100c498b4916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:04:46.362716 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-70abe523-c8c9-45c0-9904-0816ef29abdd tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] 10.222.0.70 "GET /compute/v2.1/servers/f90d78a8-dea6-45c3-933c-8184ff4858b1" status: 200 len: 1327 microversion: 2.1 time: 0.242376 Aug 27 03:04:46.367630 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2272/4509] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:04:46 2022] GET /compute/v2.1/servers/f90d78a8-dea6-45c3-933c-8184ff4858b1 => generated 1327 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:04:46.372720 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d2c561ee-76e4-4c4d-be83-b1cc7c61d4bd tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:46.380785 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d2c561ee-76e4-4c4d-be83-b1cc7c61d4bd tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: 8a65899b-549f-4312-bf67-a1ca9a8f79d7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:46.410147 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d2c561ee-76e4-4c4d-be83-b1cc7c61d4bd tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:46.410983 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d2c561ee-76e4-4c4d-be83-b1cc7c61d4bd tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:46.411730 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d2c561ee-76e4-4c4d-be83-b1cc7c61d4bd tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:46.413623 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d2c561ee-76e4-4c4d-be83-b1cc7c61d4bd tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:46.414108 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d2c561ee-76e4-4c4d-be83-b1cc7c61d4bd tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:46.414568 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d2c561ee-76e4-4c4d-be83-b1cc7c61d4bd tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:46.874171 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-4316524a-5cd4-4ace-9dc8-18e6ba8a4958 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "POST /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.730412 Aug 27 03:04:46.897341 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2238/4510] 10.222.0.70 () {60 vars in 1323 bytes} [Sat Aug 27 03:04:46 2022] POST /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789/os-volume_attachments => generated 194 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:04:46.922890 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-01e7e717-4a85-49d4-b2d2-82eb9d1c4c65 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:46.925140 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-01e7e717-4a85-49d4-b2d2-82eb9d1c4c65 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] [instance: 0069592c-7187-4b4d-ab74-3a1a3bc3de80] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:46.949754 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-01e7e717-4a85-49d4-b2d2-82eb9d1c4c65 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:46.953786 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-01e7e717-4a85-49d4-b2d2-82eb9d1c4c65 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:46.956109 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-01e7e717-4a85-49d4-b2d2-82eb9d1c4c65 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:46.959471 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-01e7e717-4a85-49d4-b2d2-82eb9d1c4c65 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:46.962201 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-01e7e717-4a85-49d4-b2d2-82eb9d1c4c65 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:46.964640 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-01e7e717-4a85-49d4-b2d2-82eb9d1c4c65 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:47.030704 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-01e7e717-4a85-49d4-b2d2-82eb9d1c4c65 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] HTTP exception thrown: Instance 0069592c-7187-4b4d-ab74-3a1a3bc3de80 could not be found. Aug 27 03:04:47.032521 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-01e7e717-4a85-49d4-b2d2-82eb9d1c4c65 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Request method failure captured: Aug 27 03:04:47.032521 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/servers/0069592c-7187-4b4d-ab74-3a1a3bc3de80 HTTP/1.1 Aug 27 03:04:47.032521 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 03:04:47.032521 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 03:04:47.032521 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 03:04:47.032521 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 03:04:47.032521 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 03:04:47.032521 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 03:04:47.032521 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 03:04:47.032521 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 03:04:47.032521 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYlbJOl9e08fctHjMhNbWGG6H2k4rzPkjc-Otyp81dKrAeYDQfJcNL-uKovVPra9Vh2F8gIEk9tJgtgT4vQ0WDrsWBVMcxd25MmTWiOwT07V1mLq8tfqW6R0QifAOGctbmFZOw4udUGApcIMDdk_IstzJQBIH1AXcp8cCB5p7pZUcUU Aug 27 03:04:47.032521 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 03:04:47.032521 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 03:04:47.032521 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 03:04:47.032521 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 03:04:47.032521 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 03:04:47.032521 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 03:04:47.032521 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: fc32a1b54e30415eb8f0e6df5e8b7be6 Aug 27 03:04:47.032521 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ServerRescueTestJSON-1904833970 Aug 27 03:04:47.032521 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 03:04:47.032521 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 03:04:47.032521 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/fc32a1b54e30415eb8f0e6df5e8b7be6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_fc32a1b54e30415eb8f0e6df5e8b7be6", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/fc32a1b54e30415eb8f0e6df5e8b7be6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/fc32a1b54e30415eb8f0e6df5e8b7be6"}]}] Aug 27 03:04:47.032521 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ServerRescueTestJSON-1904833970 Aug 27 03:04:47.032521 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: fc32a1b54e30415eb8f0e6df5e8b7be6 Aug 27 03:04:47.032521 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ServerRescueTestJSON-1904833970 Aug 27 03:04:47.032521 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ServerRescueTestJSON-1904833970-project Aug 27 03:04:47.032521 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 03:04:47.032521 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 03:04:47.032521 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: e0c3da1faaee46ca94d2a2543851f3f6 Aug 27 03:04:47.032521 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ServerRescueTestJSON-1904833970-project Aug 27 03:04:47.032521 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 03:04:47.032521 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance 0069592c-7187-4b4d-ab74-3a1a3bc3de80 could not be found. Aug 27 03:04:47.032521 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '0069592c-7187-4b4d-ab74-3a1a3bc3de80'} Aug 27 03:04:47.032521 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:04:47.032521 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:04:47.032521 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:04:47.032521 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:04:47.032521 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:04:47.032521 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:04:47.032521 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:04:47.032521 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:04:47.032521 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:04:47.032521 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:04:47.032521 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0069592c-7187-4b4d-ab74-3a1a3bc3de80 could not be found. Aug 27 03:04:47.032521 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:04:47.032521 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:04:47.032521 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:04:47.032521 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:04:47.032521 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:04:47.032521 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:04:47.032521 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:04:47.032521 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:04:47.032521 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:04:47.032521 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:04:47.032521 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:04:47.032521 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:04:47.032521 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:04:47.032521 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:04:47.032521 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:04:47.032521 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:04:47.032521 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0069592c-7187-4b4d-ab74-3a1a3bc3de80 could not be found. Aug 27 03:04:47.032521 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:04:47.032521 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:04:47.032521 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:04:47.038547 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:04:47.038547 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:04:47.038547 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:04:47.038547 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:04:47.038547 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:04:47.038547 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0069592c-7187-4b4d-ab74-3a1a3bc3de80 could not be found. Aug 27 03:04:47.038547 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:04:47.038547 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-01e7e717-4a85-49d4-b2d2-82eb9d1c4c65 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] Returning 404 to user: Instance 0069592c-7187-4b4d-ab74-3a1a3bc3de80 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:04:47.038547 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-01e7e717-4a85-49d4-b2d2-82eb9d1c4c65 tempest-ServerRescueTestJSON-1904833970 tempest-ServerRescueTestJSON-1904833970-project] 10.222.0.70 "GET /compute/v2.1/servers/0069592c-7187-4b4d-ab74-3a1a3bc3de80" status: 404 len: 111 microversion: 2.1 time: 0.134468 Aug 27 03:04:47.044403 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2239/4511] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:04:46 2022] GET /compute/v2.1/servers/0069592c-7187-4b4d-ab74-3a1a3bc3de80 => generated 111 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:04:47.252392 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d2c561ee-76e4-4c4d-be83-b1cc7c61d4bd tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:04:47.264032 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d2c561ee-76e4-4c4d-be83-b1cc7c61d4bd tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/8a65899b-549f-4312-bf67-a1ca9a8f79d7" status: 200 len: 1496 microversion: 2.1 time: 0.895205 Aug 27 03:04:47.272740 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2273/4512] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:04:46 2022] GET /compute/v2.1/servers/8a65899b-549f-4312-bf67-a1ca9a8f79d7 => generated 1496 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:04:47.406560 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0af0b725-2f5e-4c51-a130-0dce663b2b16 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:47.407249 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-0af0b725-2f5e-4c51-a130-0dce663b2b16 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] [instance: f90d78a8-dea6-45c3-933c-8184ff4858b1] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:47.423115 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0af0b725-2f5e-4c51-a130-0dce663b2b16 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:47.423642 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0af0b725-2f5e-4c51-a130-0dce663b2b16 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:47.430389 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0af0b725-2f5e-4c51-a130-0dce663b2b16 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:47.431912 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0af0b725-2f5e-4c51-a130-0dce663b2b16 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:47.432672 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0af0b725-2f5e-4c51-a130-0dce663b2b16 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:47.433559 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0af0b725-2f5e-4c51-a130-0dce663b2b16 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:47.452882 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-0af0b725-2f5e-4c51-a130-0dce663b2b16 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] HTTP exception thrown: Instance f90d78a8-dea6-45c3-933c-8184ff4858b1 could not be found. Aug 27 03:04:47.455445 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0af0b725-2f5e-4c51-a130-0dce663b2b16 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Request method failure captured: Aug 27 03:04:47.455445 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/servers/f90d78a8-dea6-45c3-933c-8184ff4858b1 HTTP/1.1 Aug 27 03:04:47.455445 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 03:04:47.455445 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 03:04:47.455445 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 03:04:47.455445 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 03:04:47.455445 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 03:04:47.455445 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 03:04:47.455445 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 03:04:47.455445 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 03:04:47.455445 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYh4T6KHxaTZJBBHXZTREoUFYIGfNOdOuQS9rVBAoTmtYgGzbYoji8YcA-t0cWcB0wQwSjmzMvJXZdi9q2Mzh_A_c5i66IyVTXL_4Lo0NqHsfjpuVhaPlibe0sz--CuBXEnCq_urvlNyiMlyg87cKEW53bWd1zKdP9wd4mpCJhEO-Mk Aug 27 03:04:47.455445 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 03:04:47.455445 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 03:04:47.455445 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 03:04:47.455445 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 03:04:47.455445 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 03:04:47.455445 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 03:04:47.455445 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: c41649f09cbf410a9825100c498b4916 Aug 27 03:04:47.455445 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-AttachVolumeTestJSON-1209514206 Aug 27 03:04:47.455445 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 03:04:47.455445 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 03:04:47.455445 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c41649f09cbf410a9825100c498b4916"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c41649f09cbf410a9825100c498b4916", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c41649f09cbf410a9825100c498b4916"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c41649f09cbf410a9825100c498b4916"}]}] Aug 27 03:04:47.455445 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-AttachVolumeTestJSON-1209514206 Aug 27 03:04:47.455445 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: c41649f09cbf410a9825100c498b4916 Aug 27 03:04:47.455445 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1209514206 Aug 27 03:04:47.455445 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-AttachVolumeTestJSON-1209514206-project Aug 27 03:04:47.455445 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 03:04:47.455445 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 03:04:47.455445 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 0fe0328160c6472086d13907344756cb Aug 27 03:04:47.455445 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-AttachVolumeTestJSON-1209514206-project Aug 27 03:04:47.455445 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 03:04:47.455445 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance f90d78a8-dea6-45c3-933c-8184ff4858b1 could not be found. Aug 27 03:04:47.455445 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': 'f90d78a8-dea6-45c3-933c-8184ff4858b1'} Aug 27 03:04:47.455445 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:04:47.455445 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:04:47.455445 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:04:47.455445 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:04:47.455445 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:04:47.455445 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:04:47.455445 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:04:47.455445 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:04:47.455445 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:04:47.455445 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:04:47.455445 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f90d78a8-dea6-45c3-933c-8184ff4858b1 could not be found. Aug 27 03:04:47.455445 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:04:47.455445 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:04:47.455445 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:04:47.455445 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:04:47.455445 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:04:47.455445 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:04:47.455445 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:04:47.455445 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:04:47.455445 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:04:47.455445 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:04:47.455445 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:04:47.455445 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:04:47.455445 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:04:47.455445 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:04:47.455445 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:04:47.455445 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:04:47.455445 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f90d78a8-dea6-45c3-933c-8184ff4858b1 could not be found. Aug 27 03:04:47.455445 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:04:47.455445 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:04:47.455445 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:04:47.460536 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:04:47.460536 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:04:47.460536 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:04:47.460536 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:04:47.460536 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:04:47.460536 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f90d78a8-dea6-45c3-933c-8184ff4858b1 could not be found. Aug 27 03:04:47.460536 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:04:47.462990 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0af0b725-2f5e-4c51-a130-0dce663b2b16 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Returning 404 to user: Instance f90d78a8-dea6-45c3-933c-8184ff4858b1 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:04:47.464080 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-0af0b725-2f5e-4c51-a130-0dce663b2b16 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] 10.222.0.70 "GET /compute/v2.1/servers/f90d78a8-dea6-45c3-933c-8184ff4858b1" status: 404 len: 111 microversion: 2.1 time: 0.075050 Aug 27 03:04:47.472086 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2240/4513] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:04:47 2022] GET /compute/v2.1/servers/f90d78a8-dea6-45c3-933c-8184ff4858b1 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:04:47.473657 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-cc1246f4-e61f-42d4-be13-870293de631a tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Calling method '.version_select at 0x7f5eddc14280>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:47.491904 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-eb5b54d4-be68-4236-adea-7f11f62b6f61 req-9fd6f3db-fea8-473e-98ab-ac937cd02b78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f90d78a8-dea6-45c3-933c-8184ff4858b1", "name": "network-vif-deleted", "tag": "fe53e38f-6288-438a-8ab5-3cd8c1e3f433"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:04:47.517196 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-cc1246f4-e61f-42d4-be13-870293de631a tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-645928241" status: 202 len: 0 microversion: 2.1 time: 0.046476 Aug 27 03:04:47.522622 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2274/4514] 10.222.0.70 () {58 vars in 1218 bytes} [Sat Aug 27 03:04:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-645928241 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 03:04:47.523625 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-eb5b54d4-be68-4236-adea-7f11f62b6f61 req-9fd6f3db-fea8-473e-98ab-ac937cd02b78 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:47.524571 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-eb5b54d4-be68-4236-adea-7f11f62b6f61 req-9fd6f3db-fea8-473e-98ab-ac937cd02b78 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:47.525886 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-eb5b54d4-be68-4236-adea-7f11f62b6f61 req-9fd6f3db-fea8-473e-98ab-ac937cd02b78 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:47.565203 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-eb5b54d4-be68-4236-adea-7f11f62b6f61 req-9fd6f3db-fea8-473e-98ab-ac937cd02b78 service nova] Creating event network-vif-deleted:fe53e38f-6288-438a-8ab5-3cd8c1e3f433 for instance f90d78a8-dea6-45c3-933c-8184ff4858b1 on n-h1-852278-4 Aug 27 03:04:47.578175 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-eb5b54d4-be68-4236-adea-7f11f62b6f61 req-9fd6f3db-fea8-473e-98ab-ac937cd02b78 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093529 Aug 27 03:04:47.580100 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2241/4515] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:04:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:04:48.294169 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a567fef3-0b9a-477b-af61-1c4ddd78f9a1 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:48.295389 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-a567fef3-0b9a-477b-af61-1c4ddd78f9a1 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: 8a65899b-549f-4312-bf67-a1ca9a8f79d7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:48.335707 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a567fef3-0b9a-477b-af61-1c4ddd78f9a1 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:48.345528 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a567fef3-0b9a-477b-af61-1c4ddd78f9a1 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:48.349206 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a567fef3-0b9a-477b-af61-1c4ddd78f9a1 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:48.350517 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a567fef3-0b9a-477b-af61-1c4ddd78f9a1 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:48.354046 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a567fef3-0b9a-477b-af61-1c4ddd78f9a1 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:48.354938 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a567fef3-0b9a-477b-af61-1c4ddd78f9a1 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:49.576041 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-a567fef3-0b9a-477b-af61-1c4ddd78f9a1 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:04:49.595668 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a567fef3-0b9a-477b-af61-1c4ddd78f9a1 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/8a65899b-549f-4312-bf67-a1ca9a8f79d7" status: 200 len: 1454 microversion: 2.1 time: 1.313750 Aug 27 03:04:49.603714 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2275/4516] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:04:48 2022] GET /compute/v2.1/servers/8a65899b-549f-4312-bf67-a1ca9a8f79d7 => generated 1454 bytes in 1322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:04:49.665316 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-f941973b-0365-40af-a30a-855ba50d0dd3 req-d90ab356-0cdc-48f4-8db1-6282ae278254 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a65899b-549f-4312-bf67-a1ca9a8f79d7", "name": "network-vif-deleted", "tag": "984a8cb7-1e8f-4e81-a97f-833a7e52f85b"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:04:49.723709 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-f941973b-0365-40af-a30a-855ba50d0dd3 req-d90ab356-0cdc-48f4-8db1-6282ae278254 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:49.725442 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-f941973b-0365-40af-a30a-855ba50d0dd3 req-d90ab356-0cdc-48f4-8db1-6282ae278254 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:49.733701 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-f941973b-0365-40af-a30a-855ba50d0dd3 req-d90ab356-0cdc-48f4-8db1-6282ae278254 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:49.797027 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-f941973b-0365-40af-a30a-855ba50d0dd3 req-d90ab356-0cdc-48f4-8db1-6282ae278254 service nova] Creating event network-vif-deleted:984a8cb7-1e8f-4e81-a97f-833a7e52f85b for instance 8a65899b-549f-4312-bf67-a1ca9a8f79d7 on n-h1-852278-4 Aug 27 03:04:49.822344 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-f941973b-0365-40af-a30a-855ba50d0dd3 req-d90ab356-0cdc-48f4-8db1-6282ae278254 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.162175 Aug 27 03:04:49.826952 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2242/4517] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:04:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:04:50.625559 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ec6504b3-06ca-434b-9a62-c5d2fe02fe87 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:50.627763 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-ec6504b3-06ca-434b-9a62-c5d2fe02fe87 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: 8a65899b-549f-4312-bf67-a1ca9a8f79d7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:50.640761 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ec6504b3-06ca-434b-9a62-c5d2fe02fe87 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:50.641632 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ec6504b3-06ca-434b-9a62-c5d2fe02fe87 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:50.642336 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ec6504b3-06ca-434b-9a62-c5d2fe02fe87 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:50.644666 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ec6504b3-06ca-434b-9a62-c5d2fe02fe87 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:50.645699 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ec6504b3-06ca-434b-9a62-c5d2fe02fe87 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:50.646430 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ec6504b3-06ca-434b-9a62-c5d2fe02fe87 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:50.711398 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ec6504b3-06ca-434b-9a62-c5d2fe02fe87 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:50.712355 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ec6504b3-06ca-434b-9a62-c5d2fe02fe87 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:50.714059 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ec6504b3-06ca-434b-9a62-c5d2fe02fe87 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:50.716919 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.objects.instance [None req-ec6504b3-06ca-434b-9a62-c5d2fe02fe87 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lazy-loading 'fault' on Instance uuid 8a65899b-549f-4312-bf67-a1ca9a8f79d7 {{(pid=134051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:04:50.848362 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-ec6504b3-06ca-434b-9a62-c5d2fe02fe87 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:04:50.870936 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ec6504b3-06ca-434b-9a62-c5d2fe02fe87 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/8a65899b-549f-4312-bf67-a1ca9a8f79d7" status: 200 len: 1299 microversion: 2.1 time: 0.251432 Aug 27 03:04:50.871850 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2276/4518] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:04:50 2022] GET /compute/v2.1/servers/8a65899b-549f-4312-bf67-a1ca9a8f79d7 => generated 1299 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:04:51.899198 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-cd16db26-7bcf-4f52-b60f-3f95cdb2de5c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:51.900648 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-cd16db26-7bcf-4f52-b60f-3f95cdb2de5c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: 8a65899b-549f-4312-bf67-a1ca9a8f79d7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:51.914614 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=78 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:04:51.925283 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cd16db26-7bcf-4f52-b60f-3f95cdb2de5c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:51.929214 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cd16db26-7bcf-4f52-b60f-3f95cdb2de5c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:51.931674 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cd16db26-7bcf-4f52-b60f-3f95cdb2de5c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:51.934007 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cd16db26-7bcf-4f52-b60f-3f95cdb2de5c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:51.937345 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cd16db26-7bcf-4f52-b60f-3f95cdb2de5c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:51.942332 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cd16db26-7bcf-4f52-b60f-3f95cdb2de5c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:52.009148 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-cd16db26-7bcf-4f52-b60f-3f95cdb2de5c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] HTTP exception thrown: Instance 8a65899b-549f-4312-bf67-a1ca9a8f79d7 could not be found. Aug 27 03:04:52.012858 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-cd16db26-7bcf-4f52-b60f-3f95cdb2de5c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Request method failure captured: Aug 27 03:04:52.012858 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/servers/8a65899b-549f-4312-bf67-a1ca9a8f79d7 HTTP/1.1 Aug 27 03:04:52.012858 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 03:04:52.012858 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 03:04:52.012858 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 03:04:52.012858 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 03:04:52.012858 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 03:04:52.012858 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 03:04:52.012858 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 03:04:52.012858 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 03:04:52.012858 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYljOihuPJQy-4KxXQ6OhbQw2FQiYByi8_J9EYziHxHrRpgpXLGNvb0hsYYYVptKud4yCoN0X9GxdS_QRHpRChZ0P7CrkMR6MvE3oNyvsgDIOynlxCCmMse1aD34uMngOe0Z8wMpnS_90nVB9LjwZPMQBiRDrvzydhSu6jwK0Njtp_4 Aug 27 03:04:52.012858 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 03:04:52.012858 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 03:04:52.012858 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 03:04:52.012858 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 03:04:52.012858 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 03:04:52.012858 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 03:04:52.012858 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 6b8d6664c463420bad9a5bfb6d747db4 Aug 27 03:04:52.012858 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ServersTestJSON-252485458 Aug 27 03:04:52.012858 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 03:04:52.012858 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 03:04:52.012858 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6b8d6664c463420bad9a5bfb6d747db4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_6b8d6664c463420bad9a5bfb6d747db4", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6b8d6664c463420bad9a5bfb6d747db4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/6b8d6664c463420bad9a5bfb6d747db4"}]}] Aug 27 03:04:52.012858 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ServersTestJSON-252485458 Aug 27 03:04:52.012858 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 6b8d6664c463420bad9a5bfb6d747db4 Aug 27 03:04:52.012858 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ServersTestJSON-252485458 Aug 27 03:04:52.012858 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ServersTestJSON-252485458-project Aug 27 03:04:52.012858 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 03:04:52.012858 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 03:04:52.012858 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 13a4e6dcf5df46fcad30430a9b9a08ee Aug 27 03:04:52.012858 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ServersTestJSON-252485458-project Aug 27 03:04:52.012858 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 03:04:52.012858 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance 8a65899b-549f-4312-bf67-a1ca9a8f79d7 could not be found. Aug 27 03:04:52.012858 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '8a65899b-549f-4312-bf67-a1ca9a8f79d7'} Aug 27 03:04:52.012858 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:04:52.012858 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:04:52.012858 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:04:52.012858 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:04:52.012858 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:04:52.012858 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:04:52.012858 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:04:52.012858 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:04:52.012858 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:04:52.012858 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:04:52.012858 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a65899b-549f-4312-bf67-a1ca9a8f79d7 could not be found. Aug 27 03:04:52.012858 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:04:52.012858 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:04:52.012858 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:04:52.012858 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:04:52.012858 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:04:52.012858 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:04:52.012858 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:04:52.012858 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:04:52.012858 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:04:52.012858 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:04:52.012858 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:04:52.012858 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:04:52.012858 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:04:52.012858 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:04:52.012858 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:04:52.012858 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:04:52.012858 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a65899b-549f-4312-bf67-a1ca9a8f79d7 could not be found. Aug 27 03:04:52.012858 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:04:52.012858 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:04:52.012858 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:04:52.012858 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:04:52.019426 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:04:52.019426 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:04:52.019426 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:04:52.019426 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:04:52.019426 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a65899b-549f-4312-bf67-a1ca9a8f79d7 could not be found. Aug 27 03:04:52.019426 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:04:52.022886 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-cd16db26-7bcf-4f52-b60f-3f95cdb2de5c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Returning 404 to user: Instance 8a65899b-549f-4312-bf67-a1ca9a8f79d7 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:04:52.025150 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-cd16db26-7bcf-4f52-b60f-3f95cdb2de5c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/8a65899b-549f-4312-bf67-a1ca9a8f79d7" status: 404 len: 111 microversion: 2.1 time: 0.133621 Aug 27 03:04:52.027531 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2243/4519] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:04:51 2022] GET /compute/v2.1/servers/8a65899b-549f-4312-bf67-a1ca9a8f79d7 => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:04:52.036490 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-2fbd192f-cbfb-4fd4-98fe-ba79b54727ef tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:52.037180 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-2fbd192f-cbfb-4fd4-98fe-ba79b54727ef tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: d8e61004-a8c1-4880-82b3-133f361a0dfc] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:52.049286 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2fbd192f-cbfb-4fd4-98fe-ba79b54727ef tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:52.053138 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2fbd192f-cbfb-4fd4-98fe-ba79b54727ef tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:52.053588 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2fbd192f-cbfb-4fd4-98fe-ba79b54727ef tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:52.056598 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2fbd192f-cbfb-4fd4-98fe-ba79b54727ef tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:52.057728 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2fbd192f-cbfb-4fd4-98fe-ba79b54727ef tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:52.066826 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2fbd192f-cbfb-4fd4-98fe-ba79b54727ef tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:52.138201 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-2fbd192f-cbfb-4fd4-98fe-ba79b54727ef tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: d8e61004-a8c1-4880-82b3-133f361a0dfc] Going to try to terminate instance {{(pid=134051) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:04:52.474215 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-2fbd192f-cbfb-4fd4-98fe-ba79b54727ef tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "DELETE /compute/v2.1/servers/d8e61004-a8c1-4880-82b3-133f361a0dfc" status: 204 len: 0 microversion: 2.1 time: 0.442310 Aug 27 03:04:52.477335 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2277/4520] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 03:04:52 2022] DELETE /compute/v2.1/servers/d8e61004-a8c1-4880-82b3-133f361a0dfc => generated 0 bytes in 446 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:04:52.486361 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3e55aa11-fe7b-4409-bbe1-80db9060f617 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:52.486937 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-3e55aa11-fe7b-4409-bbe1-80db9060f617 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: d8e61004-a8c1-4880-82b3-133f361a0dfc] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:52.508824 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3e55aa11-fe7b-4409-bbe1-80db9060f617 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:52.509401 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3e55aa11-fe7b-4409-bbe1-80db9060f617 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:52.509884 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3e55aa11-fe7b-4409-bbe1-80db9060f617 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:52.510641 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3e55aa11-fe7b-4409-bbe1-80db9060f617 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:52.511087 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3e55aa11-fe7b-4409-bbe1-80db9060f617 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:52.511503 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3e55aa11-fe7b-4409-bbe1-80db9060f617 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:53.328472 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-3e55aa11-fe7b-4409-bbe1-80db9060f617 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:04:53.354449 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-3e55aa11-fe7b-4409-bbe1-80db9060f617 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/d8e61004-a8c1-4880-82b3-133f361a0dfc" status: 200 len: 1495 microversion: 2.1 time: 0.870405 Aug 27 03:04:53.359167 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2244/4521] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:04:52 2022] GET /compute/v2.1/servers/d8e61004-a8c1-4880-82b3-133f361a0dfc => generated 1495 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:04:54.380503 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-95377404-3c7d-43b5-be0d-19792b9ab52f tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:54.381225 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-95377404-3c7d-43b5-be0d-19792b9ab52f tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: d8e61004-a8c1-4880-82b3-133f361a0dfc] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:54.419480 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-95377404-3c7d-43b5-be0d-19792b9ab52f tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:54.421843 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-95377404-3c7d-43b5-be0d-19792b9ab52f tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:54.422327 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-95377404-3c7d-43b5-be0d-19792b9ab52f tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:54.423095 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-95377404-3c7d-43b5-be0d-19792b9ab52f tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:54.423556 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-95377404-3c7d-43b5-be0d-19792b9ab52f tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:54.433516 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-95377404-3c7d-43b5-be0d-19792b9ab52f tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:55.570369 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-95377404-3c7d-43b5-be0d-19792b9ab52f tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:04:55.581651 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-95377404-3c7d-43b5-be0d-19792b9ab52f tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/d8e61004-a8c1-4880-82b3-133f361a0dfc" status: 200 len: 1495 microversion: 2.1 time: 1.206048 Aug 27 03:04:55.586052 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2278/4522] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:04:54 2022] GET /compute/v2.1/servers/d8e61004-a8c1-4880-82b3-133f361a0dfc => generated 1495 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:04:55.828170 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-227326d1-8e79-4afa-9692-b50a9ce8fc08 req-9b846509-46b9-46d8-a231-9225906d96b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8e61004-a8c1-4880-82b3-133f361a0dfc", "name": "network-vif-deleted", "tag": "9982dd2b-2350-45ae-a8e5-12cd3add9bf3"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:04:55.861754 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-227326d1-8e79-4afa-9692-b50a9ce8fc08 req-9b846509-46b9-46d8-a231-9225906d96b8 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:55.862042 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-227326d1-8e79-4afa-9692-b50a9ce8fc08 req-9b846509-46b9-46d8-a231-9225906d96b8 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:55.862473 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-227326d1-8e79-4afa-9692-b50a9ce8fc08 req-9b846509-46b9-46d8-a231-9225906d96b8 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:55.910624 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-227326d1-8e79-4afa-9692-b50a9ce8fc08 req-9b846509-46b9-46d8-a231-9225906d96b8 service nova] Creating event network-vif-deleted:9982dd2b-2350-45ae-a8e5-12cd3add9bf3 for instance d8e61004-a8c1-4880-82b3-133f361a0dfc on n-h1-852278-4 Aug 27 03:04:55.919404 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-227326d1-8e79-4afa-9692-b50a9ce8fc08 req-9b846509-46b9-46d8-a231-9225906d96b8 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094996 Aug 27 03:04:55.927345 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2245/4523] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:04:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:04:56.607767 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-2c8cfc39-f773-45cd-aec6-0d0bb61cbad7 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:56.609115 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-2c8cfc39-f773-45cd-aec6-0d0bb61cbad7 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: d8e61004-a8c1-4880-82b3-133f361a0dfc] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:56.622793 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2c8cfc39-f773-45cd-aec6-0d0bb61cbad7 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:56.626563 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2c8cfc39-f773-45cd-aec6-0d0bb61cbad7 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:56.632850 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2c8cfc39-f773-45cd-aec6-0d0bb61cbad7 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:56.633992 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2c8cfc39-f773-45cd-aec6-0d0bb61cbad7 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:56.634634 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2c8cfc39-f773-45cd-aec6-0d0bb61cbad7 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:56.636858 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2c8cfc39-f773-45cd-aec6-0d0bb61cbad7 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:56.780961 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2c8cfc39-f773-45cd-aec6-0d0bb61cbad7 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:56.781493 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2c8cfc39-f773-45cd-aec6-0d0bb61cbad7 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:56.781980 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2c8cfc39-f773-45cd-aec6-0d0bb61cbad7 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:56.782438 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.objects.instance [None req-2c8cfc39-f773-45cd-aec6-0d0bb61cbad7 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lazy-loading 'fault' on Instance uuid d8e61004-a8c1-4880-82b3-133f361a0dfc {{(pid=134051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:04:56.942058 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-2c8cfc39-f773-45cd-aec6-0d0bb61cbad7 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:04:56.952514 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-2c8cfc39-f773-45cd-aec6-0d0bb61cbad7 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/d8e61004-a8c1-4880-82b3-133f361a0dfc" status: 200 len: 1299 microversion: 2.1 time: 0.349237 Aug 27 03:04:56.955200 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2279/4524] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:04:56 2022] GET /compute/v2.1/servers/d8e61004-a8c1-4880-82b3-133f361a0dfc => generated 1299 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:04:57.984213 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-61826feb-ef5e-4f2a-8777-137f135c8657 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:57.987045 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-61826feb-ef5e-4f2a-8777-137f135c8657 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: d8e61004-a8c1-4880-82b3-133f361a0dfc] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:58.011432 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-61826feb-ef5e-4f2a-8777-137f135c8657 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:58.013408 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-61826feb-ef5e-4f2a-8777-137f135c8657 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:58.017032 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-61826feb-ef5e-4f2a-8777-137f135c8657 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:58.020627 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-61826feb-ef5e-4f2a-8777-137f135c8657 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:58.023875 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-61826feb-ef5e-4f2a-8777-137f135c8657 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:58.029225 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-61826feb-ef5e-4f2a-8777-137f135c8657 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:58.076652 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-61826feb-ef5e-4f2a-8777-137f135c8657 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] HTTP exception thrown: Instance d8e61004-a8c1-4880-82b3-133f361a0dfc could not be found. Aug 27 03:04:58.086002 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-61826feb-ef5e-4f2a-8777-137f135c8657 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Request method failure captured: Aug 27 03:04:58.086002 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/servers/d8e61004-a8c1-4880-82b3-133f361a0dfc HTTP/1.1 Aug 27 03:04:58.086002 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 03:04:58.086002 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 03:04:58.086002 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 03:04:58.086002 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 03:04:58.086002 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 03:04:58.086002 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 03:04:58.086002 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 03:04:58.086002 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 03:04:58.086002 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYljOihuPJQy-4KxXQ6OhbQw2FQiYByi8_J9EYziHxHrRpgpXLGNvb0hsYYYVptKud4yCoN0X9GxdS_QRHpRChZ0P7CrkMR6MvE3oNyvsgDIOynlxCCmMse1aD34uMngOe0Z8wMpnS_90nVB9LjwZPMQBiRDrvzydhSu6jwK0Njtp_4 Aug 27 03:04:58.086002 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 03:04:58.086002 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 03:04:58.086002 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 03:04:58.086002 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 03:04:58.086002 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 03:04:58.086002 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 03:04:58.086002 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 6b8d6664c463420bad9a5bfb6d747db4 Aug 27 03:04:58.086002 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ServersTestJSON-252485458 Aug 27 03:04:58.086002 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 03:04:58.086002 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 03:04:58.086002 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6b8d6664c463420bad9a5bfb6d747db4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_6b8d6664c463420bad9a5bfb6d747db4", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6b8d6664c463420bad9a5bfb6d747db4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/6b8d6664c463420bad9a5bfb6d747db4"}]}] Aug 27 03:04:58.086002 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ServersTestJSON-252485458 Aug 27 03:04:58.086002 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 6b8d6664c463420bad9a5bfb6d747db4 Aug 27 03:04:58.086002 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ServersTestJSON-252485458 Aug 27 03:04:58.086002 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ServersTestJSON-252485458-project Aug 27 03:04:58.086002 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 03:04:58.086002 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 03:04:58.086002 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 13a4e6dcf5df46fcad30430a9b9a08ee Aug 27 03:04:58.086002 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ServersTestJSON-252485458-project Aug 27 03:04:58.086002 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 03:04:58.086002 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance d8e61004-a8c1-4880-82b3-133f361a0dfc could not be found. Aug 27 03:04:58.086002 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': 'd8e61004-a8c1-4880-82b3-133f361a0dfc'} Aug 27 03:04:58.086002 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:04:58.086002 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:04:58.086002 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:04:58.086002 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:04:58.086002 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:04:58.086002 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:04:58.086002 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:04:58.086002 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:04:58.086002 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:04:58.086002 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:04:58.086002 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8e61004-a8c1-4880-82b3-133f361a0dfc could not be found. Aug 27 03:04:58.086002 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:04:58.086002 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:04:58.086002 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:04:58.086002 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:04:58.086002 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:04:58.086002 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:04:58.086002 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:04:58.086002 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:04:58.086002 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:04:58.086002 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:04:58.086002 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:04:58.086002 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:04:58.086002 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:04:58.086002 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:04:58.086002 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:04:58.086002 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:04:58.086002 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8e61004-a8c1-4880-82b3-133f361a0dfc could not be found. Aug 27 03:04:58.086002 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:04:58.086002 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:04:58.086002 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:04:58.086002 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:04:58.092660 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:04:58.092660 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:04:58.092660 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:04:58.092660 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:04:58.092660 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8e61004-a8c1-4880-82b3-133f361a0dfc could not be found. Aug 27 03:04:58.092660 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:04:58.098277 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-61826feb-ef5e-4f2a-8777-137f135c8657 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Returning 404 to user: Instance d8e61004-a8c1-4880-82b3-133f361a0dfc could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:04:58.099551 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-61826feb-ef5e-4f2a-8777-137f135c8657 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/d8e61004-a8c1-4880-82b3-133f361a0dfc" status: 404 len: 111 microversion: 2.1 time: 0.125828 Aug 27 03:04:58.102200 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2246/4525] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:04:57 2022] GET /compute/v2.1/servers/d8e61004-a8c1-4880-82b3-133f361a0dfc => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:04:58.367961 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-1b343054-89ee-4ce7-9cbf-cc15a580d2b3 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-721203118", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "networks": [{"uuid": "961028dd-9dfc-4287-bc1b-27b14d79a81a"}]}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:04:58.517907 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.network.neutron [None req-1b343054-89ee-4ce7-9cbf-cc15a580d2b3 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] validate_networks() for [('961028dd-9dfc-4287-bc1b-27b14d79a81a', None, None, None, None, None)] {{(pid=134051) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:04:59.756684 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-1b343054-89ee-4ce7-9cbf-cc15a580d2b3 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Flavor limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:04:59.757921 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-1b343054-89ee-4ce7-9cbf-cc15a580d2b3 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Image limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:04:59.757921 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-1b343054-89ee-4ce7-9cbf-cc15a580d2b3 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Flavor pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:04:59.759113 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-1b343054-89ee-4ce7-9cbf-cc15a580d2b3 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Image pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:04:59.759613 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-1b343054-89ee-4ce7-9cbf-cc15a580d2b3 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:04:59.777249 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1b343054-89ee-4ce7-9cbf-cc15a580d2b3 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:59.778044 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1b343054-89ee-4ce7-9cbf-cc15a580d2b3 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:59.778670 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1b343054-89ee-4ce7-9cbf-cc15a580d2b3 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:59.779628 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1b343054-89ee-4ce7-9cbf-cc15a580d2b3 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:59.780257 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1b343054-89ee-4ce7-9cbf-cc15a580d2b3 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:59.780879 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1b343054-89ee-4ce7-9cbf-cc15a580d2b3 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:59.825974 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-1b343054-89ee-4ce7-9cbf-cc15a580d2b3 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Getting quotas for project 6b8d6664c463420bad9a5bfb6d747db4. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:04:59.838711 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-1b343054-89ee-4ce7-9cbf-cc15a580d2b3 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Getting quotas for user 13a4e6dcf5df46fcad30430a9b9a08ee and project 6b8d6664c463420bad9a5bfb6d747db4. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:04:59.864752 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-1b343054-89ee-4ce7-9cbf-cc15a580d2b3 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Going to run 1 instances... {{(pid=134051) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:04:59.868205 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-1b343054-89ee-4ce7-9cbf-cc15a580d2b3 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: f1af7d0e-6991-4b4f-83ef-1008fb6d4f58] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134051) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:04:59.946888 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-1b343054-89ee-4ce7-9cbf-cc15a580d2b3 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.582878 Aug 27 03:04:59.949178 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2280/4526] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 03:04:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1586 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:04:59.960709 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ad33d925-e53f-472c-8908-aefc98015d5f tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:59.961470 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-ad33d925-e53f-472c-8908-aefc98015d5f tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: f1af7d0e-6991-4b4f-83ef-1008fb6d4f58] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:00.075793 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-ad33d925-e53f-472c-8908-aefc98015d5f tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:00.090976 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ad33d925-e53f-472c-8908-aefc98015d5f tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/f1af7d0e-6991-4b4f-83ef-1008fb6d4f58" status: 200 len: 1208 microversion: 2.1 time: 0.134622 Aug 27 03:05:00.096527 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2247/4527] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:04:59 2022] GET /compute/v2.1/servers/f1af7d0e-6991-4b4f-83ef-1008fb6d4f58 => generated 1208 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:01.122304 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f4c3c195-5b29-4248-93a9-e87b3fce9ac5 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:01.125115 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-f4c3c195-5b29-4248-93a9-e87b3fce9ac5 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: f1af7d0e-6991-4b4f-83ef-1008fb6d4f58] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:01.153400 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f4c3c195-5b29-4248-93a9-e87b3fce9ac5 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:01.162200 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f4c3c195-5b29-4248-93a9-e87b3fce9ac5 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:01.168190 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f4c3c195-5b29-4248-93a9-e87b3fce9ac5 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:01.181002 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f4c3c195-5b29-4248-93a9-e87b3fce9ac5 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:01.183906 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f4c3c195-5b29-4248-93a9-e87b3fce9ac5 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:01.202127 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f4c3c195-5b29-4248-93a9-e87b3fce9ac5 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:01.379135 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-f4c3c195-5b29-4248-93a9-e87b3fce9ac5 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:01.389507 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-f4c3c195-5b29-4248-93a9-e87b3fce9ac5 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/f1af7d0e-6991-4b4f-83ef-1008fb6d4f58" status: 200 len: 1204 microversion: 2.1 time: 0.279060 Aug 27 03:05:01.394114 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2281/4528] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:01 2022] GET /compute/v2.1/servers/f1af7d0e-6991-4b4f-83ef-1008fb6d4f58 => generated 1204 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:02.436478 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d86845f7-9139-4e64-a70e-a99289b68dff tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:02.437098 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d86845f7-9139-4e64-a70e-a99289b68dff tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: f1af7d0e-6991-4b4f-83ef-1008fb6d4f58] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:02.451753 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d86845f7-9139-4e64-a70e-a99289b68dff tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:02.473665 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d86845f7-9139-4e64-a70e-a99289b68dff tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:02.474742 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d86845f7-9139-4e64-a70e-a99289b68dff tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:02.476780 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d86845f7-9139-4e64-a70e-a99289b68dff tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:02.478934 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d86845f7-9139-4e64-a70e-a99289b68dff tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:02.479580 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d86845f7-9139-4e64-a70e-a99289b68dff tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:02.726079 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-d86845f7-9139-4e64-a70e-a99289b68dff tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:02.738706 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d86845f7-9139-4e64-a70e-a99289b68dff tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/f1af7d0e-6991-4b4f-83ef-1008fb6d4f58" status: 200 len: 1266 microversion: 2.1 time: 0.317833 Aug 27 03:05:02.744070 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2248/4529] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:02 2022] GET /compute/v2.1/servers/f1af7d0e-6991-4b4f-83ef-1008fb6d4f58 => generated 1266 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:03.759924 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d3e18b22-b518-4401-b263-eb6424b8f738 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:03.760938 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d3e18b22-b518-4401-b263-eb6424b8f738 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: f1af7d0e-6991-4b4f-83ef-1008fb6d4f58] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:03.773968 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d3e18b22-b518-4401-b263-eb6424b8f738 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:03.776254 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d3e18b22-b518-4401-b263-eb6424b8f738 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:03.777033 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d3e18b22-b518-4401-b263-eb6424b8f738 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:03.778548 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d3e18b22-b518-4401-b263-eb6424b8f738 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:03.780141 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d3e18b22-b518-4401-b263-eb6424b8f738 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:03.782607 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d3e18b22-b518-4401-b263-eb6424b8f738 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:03.972256 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d3e18b22-b518-4401-b263-eb6424b8f738 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:03.989824 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d3e18b22-b518-4401-b263-eb6424b8f738 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/f1af7d0e-6991-4b4f-83ef-1008fb6d4f58" status: 200 len: 1266 microversion: 2.1 time: 0.230759 Aug 27 03:05:03.991491 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2282/4530] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:03 2022] GET /compute/v2.1/servers/f1af7d0e-6991-4b4f-83ef-1008fb6d4f58 => generated 1266 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:05.012168 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5ec73a02-d55b-4347-97ff-bbb6a7f239f0 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:05.013471 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-5ec73a02-d55b-4347-97ff-bbb6a7f239f0 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: f1af7d0e-6991-4b4f-83ef-1008fb6d4f58] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:05.022161 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5ec73a02-d55b-4347-97ff-bbb6a7f239f0 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:05.022952 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5ec73a02-d55b-4347-97ff-bbb6a7f239f0 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:05.023571 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5ec73a02-d55b-4347-97ff-bbb6a7f239f0 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:05.025182 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5ec73a02-d55b-4347-97ff-bbb6a7f239f0 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:05.026323 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5ec73a02-d55b-4347-97ff-bbb6a7f239f0 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:05.026937 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5ec73a02-d55b-4347-97ff-bbb6a7f239f0 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:05.698366 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7b1231a0-15e9-4445-ade8-5d26d0af227c tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:05:05.701477 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-7b1231a0-15e9-4445-ade8-5d26d0af227c tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: cd881214-dd67-4897-9167-335d7e48d789] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:05.718754 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7b1231a0-15e9-4445-ade8-5d26d0af227c tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:05.719532 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7b1231a0-15e9-4445-ade8-5d26d0af227c tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:05.720175 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7b1231a0-15e9-4445-ade8-5d26d0af227c tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:05.721135 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7b1231a0-15e9-4445-ade8-5d26d0af227c tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:05.723280 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7b1231a0-15e9-4445-ade8-5d26d0af227c tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:05.724879 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7b1231a0-15e9-4445-ade8-5d26d0af227c tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:05.784626 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.objects.instance [None req-7b1231a0-15e9-4445-ade8-5d26d0af227c tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lazy-loading 'flavor' on Instance uuid cd881214-dd67-4897-9167-335d7e48d789 {{(pid=134051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:05:06.167190 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-7b1231a0-15e9-4445-ade8-5d26d0af227c tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "POST /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789/action" status: 200 len: 32 microversion: 2.1 time: 0.475403 Aug 27 03:05:06.176532 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2283/4531] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:05:05 2022] POST /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789/action => generated 32 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 27 03:05:06.195060 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e36cc67d-23c3-4c47-bf0a-c31adcf14b41 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:06.198191 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-e36cc67d-23c3-4c47-bf0a-c31adcf14b41 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: cd881214-dd67-4897-9167-335d7e48d789] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:06.236456 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e36cc67d-23c3-4c47-bf0a-c31adcf14b41 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:06.239815 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e36cc67d-23c3-4c47-bf0a-c31adcf14b41 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:06.240865 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e36cc67d-23c3-4c47-bf0a-c31adcf14b41 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:06.241913 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e36cc67d-23c3-4c47-bf0a-c31adcf14b41 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:06.244371 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e36cc67d-23c3-4c47-bf0a-c31adcf14b41 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:06.247681 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e36cc67d-23c3-4c47-bf0a-c31adcf14b41 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:06.679314 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-5ec73a02-d55b-4347-97ff-bbb6a7f239f0 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:06.688586 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-5ec73a02-d55b-4347-97ff-bbb6a7f239f0 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/f1af7d0e-6991-4b4f-83ef-1008fb6d4f58" status: 200 len: 1308 microversion: 2.1 time: 1.680525 Aug 27 03:05:06.693681 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2249/4532] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:05 2022] GET /compute/v2.1/servers/f1af7d0e-6991-4b4f-83ef-1008fb6d4f58 => generated 1308 bytes in 1686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:07.037591 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9a2e1bd6-f616-46d1-85af-0843dd323d6d tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:07.038372 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-9a2e1bd6-f616-46d1-85af-0843dd323d6d tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] [instance: f90d78a8-dea6-45c3-933c-8184ff4858b1] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:07.051819 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9a2e1bd6-f616-46d1-85af-0843dd323d6d tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:07.052343 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9a2e1bd6-f616-46d1-85af-0843dd323d6d tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:07.052803 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9a2e1bd6-f616-46d1-85af-0843dd323d6d tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:07.053528 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9a2e1bd6-f616-46d1-85af-0843dd323d6d tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:07.053981 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9a2e1bd6-f616-46d1-85af-0843dd323d6d tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:07.054407 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9a2e1bd6-f616-46d1-85af-0843dd323d6d tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:07.094043 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-9a2e1bd6-f616-46d1-85af-0843dd323d6d tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] HTTP exception thrown: Instance f90d78a8-dea6-45c3-933c-8184ff4858b1 could not be found. Aug 27 03:05:07.097147 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9a2e1bd6-f616-46d1-85af-0843dd323d6d tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Request method failure captured: Aug 27 03:05:07.097147 n-d-852278-4 devstack@n-api.service[134052]: request: DELETE /compute/v2.1/servers/f90d78a8-dea6-45c3-933c-8184ff4858b1 HTTP/1.1 Aug 27 03:05:07.097147 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 03:05:07.097147 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 03:05:07.097147 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 03:05:07.097147 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 03:05:07.097147 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 03:05:07.097147 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 03:05:07.097147 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 03:05:07.097147 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 03:05:07.097147 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYh4T6KHxaTZJBBHXZTREoUFYIGfNOdOuQS9rVBAoTmtYgGzbYoji8YcA-t0cWcB0wQwSjmzMvJXZdi9q2Mzh_A_c5i66IyVTXL_4Lo0NqHsfjpuVhaPlibe0sz--CuBXEnCq_urvlNyiMlyg87cKEW53bWd1zKdP9wd4mpCJhEO-Mk Aug 27 03:05:07.097147 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 03:05:07.097147 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 03:05:07.097147 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 03:05:07.097147 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 03:05:07.097147 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 03:05:07.097147 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 03:05:07.097147 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: c41649f09cbf410a9825100c498b4916 Aug 27 03:05:07.097147 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-AttachVolumeTestJSON-1209514206 Aug 27 03:05:07.097147 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 03:05:07.097147 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 03:05:07.097147 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c41649f09cbf410a9825100c498b4916"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c41649f09cbf410a9825100c498b4916", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c41649f09cbf410a9825100c498b4916"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c41649f09cbf410a9825100c498b4916"}]}] Aug 27 03:05:07.097147 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-AttachVolumeTestJSON-1209514206 Aug 27 03:05:07.097147 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: c41649f09cbf410a9825100c498b4916 Aug 27 03:05:07.097147 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1209514206 Aug 27 03:05:07.097147 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-AttachVolumeTestJSON-1209514206-project Aug 27 03:05:07.097147 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 03:05:07.097147 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 03:05:07.097147 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 0fe0328160c6472086d13907344756cb Aug 27 03:05:07.097147 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-AttachVolumeTestJSON-1209514206-project Aug 27 03:05:07.097147 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 03:05:07.097147 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance f90d78a8-dea6-45c3-933c-8184ff4858b1 could not be found. Aug 27 03:05:07.097147 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': 'f90d78a8-dea6-45c3-933c-8184ff4858b1'} Aug 27 03:05:07.097147 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:05:07.097147 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:05:07.097147 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:05:07.097147 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:05:07.097147 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:05:07.097147 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:05:07.097147 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:05:07.097147 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:05:07.097147 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:05:07.097147 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:05:07.097147 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f90d78a8-dea6-45c3-933c-8184ff4858b1 could not be found. Aug 27 03:05:07.097147 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:05:07.097147 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:05:07.097147 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:05:07.097147 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:05:07.097147 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:05:07.097147 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:05:07.097147 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:05:07.097147 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:05:07.097147 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:05:07.097147 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:05:07.097147 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 03:05:07.097147 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 03:05:07.097147 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 03:05:07.097147 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 03:05:07.097147 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:05:07.097147 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:05:07.097147 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:05:07.097147 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:05:07.102522 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f90d78a8-dea6-45c3-933c-8184ff4858b1 could not be found. Aug 27 03:05:07.102522 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:05:07.102522 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:05:07.102522 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:05:07.102522 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:05:07.102522 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:05:07.102522 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:05:07.102522 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:05:07.102522 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:05:07.102522 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f90d78a8-dea6-45c3-933c-8184ff4858b1 could not be found. Aug 27 03:05:07.102522 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:05:07.115344 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9a2e1bd6-f616-46d1-85af-0843dd323d6d tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Returning 404 to user: Instance f90d78a8-dea6-45c3-933c-8184ff4858b1 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:05:07.127507 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9a2e1bd6-f616-46d1-85af-0843dd323d6d tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] 10.222.0.70 "DELETE /compute/v2.1/servers/f90d78a8-dea6-45c3-933c-8184ff4858b1" status: 404 len: 111 microversion: 2.1 time: 0.094035 Aug 27 03:05:07.128709 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2250/4533] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 03:05:07 2022] DELETE /compute/v2.1/servers/f90d78a8-dea6-45c3-933c-8184ff4858b1 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:05:07.136825 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e1e876a3-9166-4ad1-8073-3d0c200641a4 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:07.137693 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-e1e876a3-9166-4ad1-8073-3d0c200641a4 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] [instance: f90d78a8-dea6-45c3-933c-8184ff4858b1] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:07.148442 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e1e876a3-9166-4ad1-8073-3d0c200641a4 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:07.155525 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e1e876a3-9166-4ad1-8073-3d0c200641a4 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:07.156897 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e1e876a3-9166-4ad1-8073-3d0c200641a4 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:07.158842 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e1e876a3-9166-4ad1-8073-3d0c200641a4 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:07.163597 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e1e876a3-9166-4ad1-8073-3d0c200641a4 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:07.164341 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e1e876a3-9166-4ad1-8073-3d0c200641a4 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:07.201136 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-e1e876a3-9166-4ad1-8073-3d0c200641a4 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] HTTP exception thrown: Instance f90d78a8-dea6-45c3-933c-8184ff4858b1 could not be found. Aug 27 03:05:07.203269 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e1e876a3-9166-4ad1-8073-3d0c200641a4 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Request method failure captured: Aug 27 03:05:07.203269 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/servers/f90d78a8-dea6-45c3-933c-8184ff4858b1 HTTP/1.1 Aug 27 03:05:07.203269 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 03:05:07.203269 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 03:05:07.203269 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 03:05:07.203269 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 03:05:07.203269 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 03:05:07.203269 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 03:05:07.203269 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 03:05:07.203269 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 03:05:07.203269 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYh4T6KHxaTZJBBHXZTREoUFYIGfNOdOuQS9rVBAoTmtYgGzbYoji8YcA-t0cWcB0wQwSjmzMvJXZdi9q2Mzh_A_c5i66IyVTXL_4Lo0NqHsfjpuVhaPlibe0sz--CuBXEnCq_urvlNyiMlyg87cKEW53bWd1zKdP9wd4mpCJhEO-Mk Aug 27 03:05:07.203269 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 03:05:07.203269 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 03:05:07.203269 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 03:05:07.203269 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 03:05:07.203269 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 03:05:07.203269 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 03:05:07.203269 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: c41649f09cbf410a9825100c498b4916 Aug 27 03:05:07.203269 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-AttachVolumeTestJSON-1209514206 Aug 27 03:05:07.203269 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 03:05:07.203269 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 03:05:07.203269 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c41649f09cbf410a9825100c498b4916"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c41649f09cbf410a9825100c498b4916", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c41649f09cbf410a9825100c498b4916"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c41649f09cbf410a9825100c498b4916"}]}] Aug 27 03:05:07.203269 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-AttachVolumeTestJSON-1209514206 Aug 27 03:05:07.203269 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: c41649f09cbf410a9825100c498b4916 Aug 27 03:05:07.203269 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1209514206 Aug 27 03:05:07.203269 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-AttachVolumeTestJSON-1209514206-project Aug 27 03:05:07.203269 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 03:05:07.203269 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 03:05:07.203269 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 0fe0328160c6472086d13907344756cb Aug 27 03:05:07.203269 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-AttachVolumeTestJSON-1209514206-project Aug 27 03:05:07.203269 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 03:05:07.203269 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance f90d78a8-dea6-45c3-933c-8184ff4858b1 could not be found. Aug 27 03:05:07.203269 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': 'f90d78a8-dea6-45c3-933c-8184ff4858b1'} Aug 27 03:05:07.203269 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:05:07.203269 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:05:07.203269 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:05:07.203269 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:05:07.203269 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:05:07.203269 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:05:07.203269 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:05:07.203269 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:05:07.203269 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:05:07.203269 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:05:07.203269 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f90d78a8-dea6-45c3-933c-8184ff4858b1 could not be found. Aug 27 03:05:07.203269 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:05:07.203269 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:05:07.203269 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:05:07.203269 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:05:07.203269 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:05:07.203269 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:05:07.203269 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:05:07.203269 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:05:07.203269 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:05:07.203269 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:05:07.203269 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:05:07.203269 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:05:07.203269 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:05:07.203269 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:05:07.203269 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:05:07.203269 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:05:07.203269 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f90d78a8-dea6-45c3-933c-8184ff4858b1 could not be found. Aug 27 03:05:07.203269 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:05:07.203269 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:05:07.203269 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:05:07.207893 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:05:07.207893 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:05:07.207893 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:05:07.207893 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:05:07.207893 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:05:07.207893 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f90d78a8-dea6-45c3-933c-8184ff4858b1 could not be found. Aug 27 03:05:07.207893 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:05:07.210173 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e1e876a3-9166-4ad1-8073-3d0c200641a4 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Returning 404 to user: Instance f90d78a8-dea6-45c3-933c-8184ff4858b1 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:05:07.211283 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e1e876a3-9166-4ad1-8073-3d0c200641a4 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] 10.222.0.70 "GET /compute/v2.1/servers/f90d78a8-dea6-45c3-933c-8184ff4858b1" status: 404 len: 111 microversion: 2.1 time: 0.078696 Aug 27 03:05:07.217544 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2251/4534] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:07 2022] GET /compute/v2.1/servers/f90d78a8-dea6-45c3-933c-8184ff4858b1 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 03:05:07.438208 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e36cc67d-23c3-4c47-bf0a-c31adcf14b41 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36697e722bef4a33ab158e9b2f87596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4ca527ba3b49539b528ec8950aef78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:07.445680 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e36cc67d-23c3-4c47-bf0a-c31adcf14b41 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "GET /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789" status: 200 len: 1733 microversion: 2.1 time: 1.265660 Aug 27 03:05:07.461332 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2284/4535] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:06 2022] GET /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789 => generated 1733 bytes in 1271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:07.716144 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b1228ee4-8b98-4516-9579-ba1b588dcceb tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:07.717391 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b1228ee4-8b98-4516-9579-ba1b588dcceb tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: f1af7d0e-6991-4b4f-83ef-1008fb6d4f58] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:07.738912 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b1228ee4-8b98-4516-9579-ba1b588dcceb tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:07.740988 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b1228ee4-8b98-4516-9579-ba1b588dcceb tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:07.741680 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b1228ee4-8b98-4516-9579-ba1b588dcceb tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:07.744022 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b1228ee4-8b98-4516-9579-ba1b588dcceb tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:07.747018 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b1228ee4-8b98-4516-9579-ba1b588dcceb tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:07.747705 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b1228ee4-8b98-4516-9579-ba1b588dcceb tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:08.470312 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-31870615-856d-42f3-b8c2-f7a8cb4b96f9 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:08.471552 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-31870615-856d-42f3-b8c2-f7a8cb4b96f9 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: cd881214-dd67-4897-9167-335d7e48d789] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:08.483620 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-31870615-856d-42f3-b8c2-f7a8cb4b96f9 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:08.486841 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-31870615-856d-42f3-b8c2-f7a8cb4b96f9 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:08.487321 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-31870615-856d-42f3-b8c2-f7a8cb4b96f9 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:08.488084 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-31870615-856d-42f3-b8c2-f7a8cb4b96f9 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:08.488585 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-31870615-856d-42f3-b8c2-f7a8cb4b96f9 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:08.489022 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-31870615-856d-42f3-b8c2-f7a8cb4b96f9 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:08.503969 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:05:09.099139 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b1228ee4-8b98-4516-9579-ba1b588dcceb tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:09.108120 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b1228ee4-8b98-4516-9579-ba1b588dcceb tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/f1af7d0e-6991-4b4f-83ef-1008fb6d4f58" status: 200 len: 1308 microversion: 2.1 time: 1.398420 Aug 27 03:05:09.116593 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2252/4536] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:07 2022] GET /compute/v2.1/servers/f1af7d0e-6991-4b4f-83ef-1008fb6d4f58 => generated 1308 bytes in 1408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:09.210487 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-31870615-856d-42f3-b8c2-f7a8cb4b96f9 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36697e722bef4a33ab158e9b2f87596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4ca527ba3b49539b528ec8950aef78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:09.226493 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-31870615-856d-42f3-b8c2-f7a8cb4b96f9 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "GET /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789" status: 200 len: 1733 microversion: 2.1 time: 0.761239 Aug 27 03:05:09.240606 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2285/4537] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:08 2022] GET /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789 => generated 1733 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:05:09.469943 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-13395b53-4b6e-4e9f-9b01-8151cdfd0e5c tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-673346988", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "networks": [{"uuid": "7efdc19e-82eb-4610-897e-db10a92a0c7c"}]}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:05:09.581330 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.network.neutron [None req-13395b53-4b6e-4e9f-9b01-8151cdfd0e5c tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] validate_networks() for [('7efdc19e-82eb-4610-897e-db10a92a0c7c', None, None, None, None, None)] {{(pid=134052) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:05:09.875646 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-3a270ec7-bc1f-48c1-8a98-53db1fccf2c4 req-de60b21c-84a0-46d3-ada1-f87f314592a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1af7d0e-6991-4b4f-83ef-1008fb6d4f58", "tag": "95a1ae00-538a-4280-b210-05cf3ec10f51"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:05:09.894095 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:05:09.896440 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=6 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:05:09.903550 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-3a270ec7-bc1f-48c1-8a98-53db1fccf2c4 req-de60b21c-84a0-46d3-ada1-f87f314592a3 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:09.904034 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-3a270ec7-bc1f-48c1-8a98-53db1fccf2c4 req-de60b21c-84a0-46d3-ada1-f87f314592a3 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:09.904500 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-3a270ec7-bc1f-48c1-8a98-53db1fccf2c4 req-de60b21c-84a0-46d3-ada1-f87f314592a3 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:09.946234 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-3a270ec7-bc1f-48c1-8a98-53db1fccf2c4 req-de60b21c-84a0-46d3-ada1-f87f314592a3 service nova] Creating event network-changed:95a1ae00-538a-4280-b210-05cf3ec10f51 for instance f1af7d0e-6991-4b4f-83ef-1008fb6d4f58 on n-h2-852278-4 Aug 27 03:05:09.956957 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-3a270ec7-bc1f-48c1-8a98-53db1fccf2c4 req-de60b21c-84a0-46d3-ada1-f87f314592a3 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087104 Aug 27 03:05:09.957931 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2286/4538] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:05:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:05:10.090470 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:05:10.138521 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a9ff82c9-f618-4564-b3c3-20d37b051c16 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:10.139242 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-a9ff82c9-f618-4564-b3c3-20d37b051c16 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: f1af7d0e-6991-4b4f-83ef-1008fb6d4f58] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:10.146720 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a9ff82c9-f618-4564-b3c3-20d37b051c16 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:10.147219 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a9ff82c9-f618-4564-b3c3-20d37b051c16 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:10.147958 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a9ff82c9-f618-4564-b3c3-20d37b051c16 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:10.149822 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a9ff82c9-f618-4564-b3c3-20d37b051c16 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:10.150552 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a9ff82c9-f618-4564-b3c3-20d37b051c16 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:10.151430 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a9ff82c9-f618-4564-b3c3-20d37b051c16 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:10.856768 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-a9ff82c9-f618-4564-b3c3-20d37b051c16 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:10.875492 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a9ff82c9-f618-4564-b3c3-20d37b051c16 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/f1af7d0e-6991-4b4f-83ef-1008fb6d4f58" status: 200 len: 1308 microversion: 2.1 time: 0.741799 Aug 27 03:05:10.876462 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2287/4539] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:10 2022] GET /compute/v2.1/servers/f1af7d0e-6991-4b4f-83ef-1008fb6d4f58 => generated 1308 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:05:10.896504 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-954ba8c5-9eec-49be-a1ad-bd1f0131f3b3 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:10.897152 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-954ba8c5-9eec-49be-a1ad-bd1f0131f3b3 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: cd881214-dd67-4897-9167-335d7e48d789] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:10.907597 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-954ba8c5-9eec-49be-a1ad-bd1f0131f3b3 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:10.908491 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-954ba8c5-9eec-49be-a1ad-bd1f0131f3b3 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:10.909199 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-954ba8c5-9eec-49be-a1ad-bd1f0131f3b3 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:10.910158 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-954ba8c5-9eec-49be-a1ad-bd1f0131f3b3 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:10.911612 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-954ba8c5-9eec-49be-a1ad-bd1f0131f3b3 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:10.912260 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-954ba8c5-9eec-49be-a1ad-bd1f0131f3b3 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:11.216593 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-954ba8c5-9eec-49be-a1ad-bd1f0131f3b3 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36697e722bef4a33ab158e9b2f87596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4ca527ba3b49539b528ec8950aef78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:11.226131 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-13395b53-4b6e-4e9f-9b01-8151cdfd0e5c tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Flavor limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:05:11.227191 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-13395b53-4b6e-4e9f-9b01-8151cdfd0e5c tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Image limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:05:11.227890 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-13395b53-4b6e-4e9f-9b01-8151cdfd0e5c tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Flavor pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:05:11.228565 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-13395b53-4b6e-4e9f-9b01-8151cdfd0e5c tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Image pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:05:11.229345 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-13395b53-4b6e-4e9f-9b01-8151cdfd0e5c tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:05:11.231867 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-954ba8c5-9eec-49be-a1ad-bd1f0131f3b3 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "GET /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789" status: 200 len: 1733 microversion: 2.1 time: 0.353401 Aug 27 03:05:11.232622 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2288/4540] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:10 2022] GET /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789 => generated 1733 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:11.244154 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-13395b53-4b6e-4e9f-9b01-8151cdfd0e5c tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:11.244986 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-13395b53-4b6e-4e9f-9b01-8151cdfd0e5c tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:11.245425 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-13395b53-4b6e-4e9f-9b01-8151cdfd0e5c tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:11.246178 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-13395b53-4b6e-4e9f-9b01-8151cdfd0e5c tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:11.248818 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-13395b53-4b6e-4e9f-9b01-8151cdfd0e5c tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:11.250216 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-13395b53-4b6e-4e9f-9b01-8151cdfd0e5c tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:11.282059 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:05:11.324620 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-13395b53-4b6e-4e9f-9b01-8151cdfd0e5c tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Getting quotas for project 3b9e672ac89e41ff82355daa83e852bd. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:05:11.333073 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-13395b53-4b6e-4e9f-9b01-8151cdfd0e5c tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Getting quotas for user 204c90820f6d4c64b31367aaf098325c and project 3b9e672ac89e41ff82355daa83e852bd. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:05:11.356965 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-13395b53-4b6e-4e9f-9b01-8151cdfd0e5c tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Going to run 1 instances... {{(pid=134052) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:05:11.360667 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-13395b53-4b6e-4e9f-9b01-8151cdfd0e5c tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134052) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:05:11.444112 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-13395b53-4b6e-4e9f-9b01-8151cdfd0e5c tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.326104 Aug 27 03:05:11.456322 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2253/4541] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 03:05:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 2339 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:05:11.462993 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-6c089478-970d-4790-ab3e-16d820ca00a8 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:11.463714 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-6c089478-970d-4790-ab3e-16d820ca00a8 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:11.617524 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-6c089478-970d-4790-ab3e-16d820ca00a8 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:11.643138 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-6c089478-970d-4790-ab3e-16d820ca00a8 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1216 microversion: 2.1 time: 0.185935 Aug 27 03:05:11.644694 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2289/4542] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:11 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1216 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:05:11.898207 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-026b20e8-cc13-4642-8837-be6d21c44fa5 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:11.899381 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-026b20e8-cc13-4642-8837-be6d21c44fa5 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: f1af7d0e-6991-4b4f-83ef-1008fb6d4f58] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:11.911011 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-026b20e8-cc13-4642-8837-be6d21c44fa5 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:11.913924 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-026b20e8-cc13-4642-8837-be6d21c44fa5 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:11.915383 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-026b20e8-cc13-4642-8837-be6d21c44fa5 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:11.917979 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-026b20e8-cc13-4642-8837-be6d21c44fa5 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:11.919556 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-026b20e8-cc13-4642-8837-be6d21c44fa5 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:11.920253 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-026b20e8-cc13-4642-8837-be6d21c44fa5 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:12.256212 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-61941502-1883-44dd-a75e-4bdeaeafcf39 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:12.257568 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-61941502-1883-44dd-a75e-4bdeaeafcf39 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: cd881214-dd67-4897-9167-335d7e48d789] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:12.282795 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-61941502-1883-44dd-a75e-4bdeaeafcf39 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:12.283328 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-61941502-1883-44dd-a75e-4bdeaeafcf39 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:12.283937 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-61941502-1883-44dd-a75e-4bdeaeafcf39 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:12.284548 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-61941502-1883-44dd-a75e-4bdeaeafcf39 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:12.285006 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-61941502-1883-44dd-a75e-4bdeaeafcf39 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:12.285579 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-61941502-1883-44dd-a75e-4bdeaeafcf39 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:12.373006 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-026b20e8-cc13-4642-8837-be6d21c44fa5 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:12.396463 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-026b20e8-cc13-4642-8837-be6d21c44fa5 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/f1af7d0e-6991-4b4f-83ef-1008fb6d4f58" status: 200 len: 1308 microversion: 2.1 time: 0.502952 Aug 27 03:05:12.399972 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2254/4543] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:11 2022] GET /compute/v2.1/servers/f1af7d0e-6991-4b4f-83ef-1008fb6d4f58 => generated 1308 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:12.669471 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-315c7f39-83ad-467a-9ea1-e9bcd71d2369 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:12.670094 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-315c7f39-83ad-467a-9ea1-e9bcd71d2369 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:12.680490 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-315c7f39-83ad-467a-9ea1-e9bcd71d2369 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:12.681028 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-315c7f39-83ad-467a-9ea1-e9bcd71d2369 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:12.681508 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-315c7f39-83ad-467a-9ea1-e9bcd71d2369 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:12.691549 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-315c7f39-83ad-467a-9ea1-e9bcd71d2369 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:12.692491 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-315c7f39-83ad-467a-9ea1-e9bcd71d2369 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:12.693008 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-315c7f39-83ad-467a-9ea1-e9bcd71d2369 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:13.126587 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-315c7f39-83ad-467a-9ea1-e9bcd71d2369 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:13.145647 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-315c7f39-83ad-467a-9ea1-e9bcd71d2369 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1268 microversion: 2.1 time: 0.480226 Aug 27 03:05:13.146583 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2255/4544] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:12 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1268 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:05:13.152057 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3447286f-438e-4a94-8991-4f6516fe52e0 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:13.152932 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-3447286f-438e-4a94-8991-4f6516fe52e0 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] [instance: 9d9f666f-0b19-4d87-a94a-770b5d99f349] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:13.174646 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3447286f-438e-4a94-8991-4f6516fe52e0 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:13.175407 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3447286f-438e-4a94-8991-4f6516fe52e0 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:13.176032 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3447286f-438e-4a94-8991-4f6516fe52e0 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:13.176959 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3447286f-438e-4a94-8991-4f6516fe52e0 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:13.177575 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3447286f-438e-4a94-8991-4f6516fe52e0 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:13.178152 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3447286f-438e-4a94-8991-4f6516fe52e0 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:13.214637 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-61941502-1883-44dd-a75e-4bdeaeafcf39 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36697e722bef4a33ab158e9b2f87596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4ca527ba3b49539b528ec8950aef78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:13.221619 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-3447286f-438e-4a94-8991-4f6516fe52e0 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] HTTP exception thrown: Instance 9d9f666f-0b19-4d87-a94a-770b5d99f349 could not be found. Aug 27 03:05:13.224697 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3447286f-438e-4a94-8991-4f6516fe52e0 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Request method failure captured: Aug 27 03:05:13.224697 n-d-852278-4 devstack@n-api.service[134052]: request: DELETE /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349 HTTP/1.1 Aug 27 03:05:13.224697 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 03:05:13.224697 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 03:05:13.224697 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 03:05:13.224697 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 03:05:13.224697 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 03:05:13.224697 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 03:05:13.224697 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 03:05:13.224697 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 03:05:13.224697 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYh4T6KHxaTZJBBHXZTREoUFYIGfNOdOuQS9rVBAoTmtYgGzbYoji8YcA-t0cWcB0wQwSjmzMvJXZdi9q2Mzh_A_c5i66IyVTXL_4Lo0NqHsfjpuVhaPlibe0sz--CuBXEnCq_urvlNyiMlyg87cKEW53bWd1zKdP9wd4mpCJhEO-Mk Aug 27 03:05:13.224697 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 03:05:13.224697 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 03:05:13.224697 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 03:05:13.224697 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 03:05:13.224697 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 03:05:13.224697 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 03:05:13.224697 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: c41649f09cbf410a9825100c498b4916 Aug 27 03:05:13.224697 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-AttachVolumeTestJSON-1209514206 Aug 27 03:05:13.224697 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 03:05:13.224697 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 03:05:13.224697 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c41649f09cbf410a9825100c498b4916"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c41649f09cbf410a9825100c498b4916", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c41649f09cbf410a9825100c498b4916"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c41649f09cbf410a9825100c498b4916"}]}] Aug 27 03:05:13.224697 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-AttachVolumeTestJSON-1209514206 Aug 27 03:05:13.224697 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: c41649f09cbf410a9825100c498b4916 Aug 27 03:05:13.224697 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1209514206 Aug 27 03:05:13.224697 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-AttachVolumeTestJSON-1209514206-project Aug 27 03:05:13.224697 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 03:05:13.224697 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 03:05:13.224697 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 0fe0328160c6472086d13907344756cb Aug 27 03:05:13.224697 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-AttachVolumeTestJSON-1209514206-project Aug 27 03:05:13.224697 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 03:05:13.224697 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance 9d9f666f-0b19-4d87-a94a-770b5d99f349 could not be found. Aug 27 03:05:13.224697 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '9d9f666f-0b19-4d87-a94a-770b5d99f349'} Aug 27 03:05:13.224697 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:05:13.224697 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:05:13.224697 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:05:13.224697 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:05:13.224697 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:05:13.224697 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:05:13.224697 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:05:13.224697 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:05:13.224697 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:05:13.224697 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:05:13.224697 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d9f666f-0b19-4d87-a94a-770b5d99f349 could not be found. Aug 27 03:05:13.224697 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:05:13.224697 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:05:13.224697 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:05:13.224697 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:05:13.224697 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:05:13.224697 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:05:13.224697 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:05:13.224697 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:05:13.224697 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:05:13.224697 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:05:13.224697 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 03:05:13.224697 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 03:05:13.224697 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 03:05:13.224697 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 03:05:13.224697 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:05:13.224697 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:05:13.224697 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:05:13.224697 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:05:13.229653 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d9f666f-0b19-4d87-a94a-770b5d99f349 could not be found. Aug 27 03:05:13.229653 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:05:13.229653 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:05:13.229653 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:05:13.229653 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:05:13.229653 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:05:13.229653 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:05:13.229653 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:05:13.229653 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:05:13.229653 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d9f666f-0b19-4d87-a94a-770b5d99f349 could not be found. Aug 27 03:05:13.229653 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:05:13.235787 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3447286f-438e-4a94-8991-4f6516fe52e0 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Returning 404 to user: Instance 9d9f666f-0b19-4d87-a94a-770b5d99f349 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:05:13.236918 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-3447286f-438e-4a94-8991-4f6516fe52e0 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] 10.222.0.70 "DELETE /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349" status: 404 len: 111 microversion: 2.1 time: 0.089103 Aug 27 03:05:13.242064 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2256/4545] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 03:05:13 2022] DELETE /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:05:13.246321 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-61941502-1883-44dd-a75e-4bdeaeafcf39 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "GET /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789" status: 200 len: 1733 microversion: 2.1 time: 0.994225 Aug 27 03:05:13.254568 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-277f9730-cab3-4054-b033-bbfb7b1ae781 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:13.257592 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-277f9730-cab3-4054-b033-bbfb7b1ae781 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] [instance: 9d9f666f-0b19-4d87-a94a-770b5d99f349] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:13.260424 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2290/4546] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:12 2022] GET /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789 => generated 1733 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:13.286018 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-277f9730-cab3-4054-b033-bbfb7b1ae781 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:13.293575 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-277f9730-cab3-4054-b033-bbfb7b1ae781 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:13.294680 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-277f9730-cab3-4054-b033-bbfb7b1ae781 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:13.295751 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-277f9730-cab3-4054-b033-bbfb7b1ae781 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:13.302165 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-277f9730-cab3-4054-b033-bbfb7b1ae781 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:13.302891 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-277f9730-cab3-4054-b033-bbfb7b1ae781 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:13.335382 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-277f9730-cab3-4054-b033-bbfb7b1ae781 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] HTTP exception thrown: Instance 9d9f666f-0b19-4d87-a94a-770b5d99f349 could not be found. Aug 27 03:05:13.337488 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-277f9730-cab3-4054-b033-bbfb7b1ae781 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Request method failure captured: Aug 27 03:05:13.337488 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349 HTTP/1.1 Aug 27 03:05:13.337488 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 03:05:13.337488 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 03:05:13.337488 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 03:05:13.337488 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 03:05:13.337488 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 03:05:13.337488 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 03:05:13.337488 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 03:05:13.337488 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 03:05:13.337488 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYh4T6KHxaTZJBBHXZTREoUFYIGfNOdOuQS9rVBAoTmtYgGzbYoji8YcA-t0cWcB0wQwSjmzMvJXZdi9q2Mzh_A_c5i66IyVTXL_4Lo0NqHsfjpuVhaPlibe0sz--CuBXEnCq_urvlNyiMlyg87cKEW53bWd1zKdP9wd4mpCJhEO-Mk Aug 27 03:05:13.337488 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 03:05:13.337488 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 03:05:13.337488 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 03:05:13.337488 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 03:05:13.337488 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 03:05:13.337488 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 03:05:13.337488 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: c41649f09cbf410a9825100c498b4916 Aug 27 03:05:13.337488 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-AttachVolumeTestJSON-1209514206 Aug 27 03:05:13.337488 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 03:05:13.337488 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 03:05:13.337488 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c41649f09cbf410a9825100c498b4916"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c41649f09cbf410a9825100c498b4916", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c41649f09cbf410a9825100c498b4916"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c41649f09cbf410a9825100c498b4916"}]}] Aug 27 03:05:13.337488 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-AttachVolumeTestJSON-1209514206 Aug 27 03:05:13.337488 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: c41649f09cbf410a9825100c498b4916 Aug 27 03:05:13.337488 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1209514206 Aug 27 03:05:13.337488 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-AttachVolumeTestJSON-1209514206-project Aug 27 03:05:13.337488 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 03:05:13.337488 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 03:05:13.337488 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 0fe0328160c6472086d13907344756cb Aug 27 03:05:13.337488 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-AttachVolumeTestJSON-1209514206-project Aug 27 03:05:13.337488 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 03:05:13.337488 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance 9d9f666f-0b19-4d87-a94a-770b5d99f349 could not be found. Aug 27 03:05:13.337488 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '9d9f666f-0b19-4d87-a94a-770b5d99f349'} Aug 27 03:05:13.337488 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:05:13.337488 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:05:13.337488 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:05:13.337488 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:05:13.337488 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:05:13.337488 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:05:13.337488 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:05:13.337488 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:05:13.337488 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:05:13.337488 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:05:13.337488 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d9f666f-0b19-4d87-a94a-770b5d99f349 could not be found. Aug 27 03:05:13.337488 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:05:13.337488 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:05:13.337488 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:05:13.337488 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:05:13.337488 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:05:13.337488 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:05:13.337488 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:05:13.337488 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:05:13.337488 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:05:13.337488 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:05:13.337488 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:05:13.337488 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:05:13.337488 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:05:13.337488 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:05:13.337488 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:05:13.337488 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:05:13.337488 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d9f666f-0b19-4d87-a94a-770b5d99f349 could not be found. Aug 27 03:05:13.337488 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:05:13.337488 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:05:13.337488 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:05:13.343160 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:05:13.343160 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:05:13.343160 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:05:13.343160 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:05:13.343160 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:05:13.343160 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d9f666f-0b19-4d87-a94a-770b5d99f349 could not be found. Aug 27 03:05:13.343160 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:05:13.349849 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-277f9730-cab3-4054-b033-bbfb7b1ae781 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] Returning 404 to user: Instance 9d9f666f-0b19-4d87-a94a-770b5d99f349 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:05:13.350856 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-277f9730-cab3-4054-b033-bbfb7b1ae781 tempest-AttachVolumeTestJSON-1209514206 tempest-AttachVolumeTestJSON-1209514206-project] 10.222.0.70 "GET /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349" status: 404 len: 111 microversion: 2.1 time: 0.104559 Aug 27 03:05:13.357021 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2257/4547] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:13 2022] GET /compute/v2.1/servers/9d9f666f-0b19-4d87-a94a-770b5d99f349 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:05:13.423228 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4b8b213d-83d5-4170-b6b6-22c66a5eb399 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:13.423856 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-4b8b213d-83d5-4170-b6b6-22c66a5eb399 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: f1af7d0e-6991-4b4f-83ef-1008fb6d4f58] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:13.435709 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4b8b213d-83d5-4170-b6b6-22c66a5eb399 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:13.436214 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4b8b213d-83d5-4170-b6b6-22c66a5eb399 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:13.436722 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4b8b213d-83d5-4170-b6b6-22c66a5eb399 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:13.440021 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4b8b213d-83d5-4170-b6b6-22c66a5eb399 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:13.442301 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4b8b213d-83d5-4170-b6b6-22c66a5eb399 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:13.442929 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4b8b213d-83d5-4170-b6b6-22c66a5eb399 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:14.086393 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-4b8b213d-83d5-4170-b6b6-22c66a5eb399 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:14.101682 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-4b8b213d-83d5-4170-b6b6-22c66a5eb399 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/f1af7d0e-6991-4b4f-83ef-1008fb6d4f58" status: 200 len: 1308 microversion: 2.1 time: 0.684828 Aug 27 03:05:14.102293 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2291/4548] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:13 2022] GET /compute/v2.1/servers/f1af7d0e-6991-4b4f-83ef-1008fb6d4f58 => generated 1308 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:14.166771 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f79e318b-cf30-4ff1-a844-bb6b5e69560f tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:14.168045 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-f79e318b-cf30-4ff1-a844-bb6b5e69560f tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:14.183417 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f79e318b-cf30-4ff1-a844-bb6b5e69560f tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:14.193456 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f79e318b-cf30-4ff1-a844-bb6b5e69560f tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:14.194138 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f79e318b-cf30-4ff1-a844-bb6b5e69560f tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:14.195246 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f79e318b-cf30-4ff1-a844-bb6b5e69560f tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:14.195937 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f79e318b-cf30-4ff1-a844-bb6b5e69560f tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:14.196619 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f79e318b-cf30-4ff1-a844-bb6b5e69560f tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:14.273845 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-80e6685f-9667-407c-9809-c0dc5772529c tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:14.274476 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-80e6685f-9667-407c-9809-c0dc5772529c tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: cd881214-dd67-4897-9167-335d7e48d789] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:14.297872 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-80e6685f-9667-407c-9809-c0dc5772529c tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:14.298270 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-80e6685f-9667-407c-9809-c0dc5772529c tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:14.298712 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-80e6685f-9667-407c-9809-c0dc5772529c tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:14.299423 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-80e6685f-9667-407c-9809-c0dc5772529c tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:14.311455 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-80e6685f-9667-407c-9809-c0dc5772529c tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:14.318185 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-80e6685f-9667-407c-9809-c0dc5772529c tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:14.562306 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-f79e318b-cf30-4ff1-a844-bb6b5e69560f tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:14.585143 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f79e318b-cf30-4ff1-a844-bb6b5e69560f tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1274 microversion: 2.1 time: 0.422087 Aug 27 03:05:14.586102 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2258/4549] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:14 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1274 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:15.035156 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-80e6685f-9667-407c-9809-c0dc5772529c tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36697e722bef4a33ab158e9b2f87596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4ca527ba3b49539b528ec8950aef78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:15.044804 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-80e6685f-9667-407c-9809-c0dc5772529c tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "GET /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789" status: 200 len: 1733 microversion: 2.1 time: 0.781381 Aug 27 03:05:15.045413 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2292/4550] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:14 2022] GET /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789 => generated 1733 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:05:15.122770 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-7d87c7e5-8097-4d71-b283-5ff628cdbc8b tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:15.123392 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-7d87c7e5-8097-4d71-b283-5ff628cdbc8b tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: f1af7d0e-6991-4b4f-83ef-1008fb6d4f58] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:15.132748 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7d87c7e5-8097-4d71-b283-5ff628cdbc8b tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:15.133244 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7d87c7e5-8097-4d71-b283-5ff628cdbc8b tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:15.133685 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7d87c7e5-8097-4d71-b283-5ff628cdbc8b tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:15.134405 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7d87c7e5-8097-4d71-b283-5ff628cdbc8b tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:15.134853 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7d87c7e5-8097-4d71-b283-5ff628cdbc8b tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:15.135275 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7d87c7e5-8097-4d71-b283-5ff628cdbc8b tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:15.453272 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-7d87c7e5-8097-4d71-b283-5ff628cdbc8b tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:15.473819 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-7d87c7e5-8097-4d71-b283-5ff628cdbc8b tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/f1af7d0e-6991-4b4f-83ef-1008fb6d4f58" status: 200 len: 1308 microversion: 2.1 time: 0.354820 Aug 27 03:05:15.474440 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2259/4551] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:15 2022] GET /compute/v2.1/servers/f1af7d0e-6991-4b4f-83ef-1008fb6d4f58 => generated 1308 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:15.608444 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-62ce1dac-a3c6-4b07-89cb-179c5763a5cd tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:15.609679 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-62ce1dac-a3c6-4b07-89cb-179c5763a5cd tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:15.612731 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:05:15.635319 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-62ce1dac-a3c6-4b07-89cb-179c5763a5cd tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:15.636112 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-62ce1dac-a3c6-4b07-89cb-179c5763a5cd tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:15.636819 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-62ce1dac-a3c6-4b07-89cb-179c5763a5cd tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:15.637919 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-62ce1dac-a3c6-4b07-89cb-179c5763a5cd tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:15.638886 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-62ce1dac-a3c6-4b07-89cb-179c5763a5cd tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:15.639795 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-62ce1dac-a3c6-4b07-89cb-179c5763a5cd tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:15.953470 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-62ce1dac-a3c6-4b07-89cb-179c5763a5cd tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:15.977092 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-62ce1dac-a3c6-4b07-89cb-179c5763a5cd tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1316 microversion: 2.1 time: 0.372507 Aug 27 03:05:15.992139 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2293/4552] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:15 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1316 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:16.066820 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-1843624c-248a-4427-9bbf-e14fc3779325 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:16.067713 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-1843624c-248a-4427-9bbf-e14fc3779325 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: cd881214-dd67-4897-9167-335d7e48d789] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:16.085202 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1843624c-248a-4427-9bbf-e14fc3779325 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:16.085705 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1843624c-248a-4427-9bbf-e14fc3779325 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:16.086398 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1843624c-248a-4427-9bbf-e14fc3779325 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:16.087449 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1843624c-248a-4427-9bbf-e14fc3779325 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:16.088110 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1843624c-248a-4427-9bbf-e14fc3779325 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:16.088778 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1843624c-248a-4427-9bbf-e14fc3779325 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:16.497607 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e5a2c53d-1573-4cf6-a18a-03b8a26a0416 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:16.498633 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-e5a2c53d-1573-4cf6-a18a-03b8a26a0416 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: f1af7d0e-6991-4b4f-83ef-1008fb6d4f58] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:16.510318 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e5a2c53d-1573-4cf6-a18a-03b8a26a0416 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:16.512346 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e5a2c53d-1573-4cf6-a18a-03b8a26a0416 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:16.514615 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e5a2c53d-1573-4cf6-a18a-03b8a26a0416 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:16.520162 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e5a2c53d-1573-4cf6-a18a-03b8a26a0416 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:16.520822 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e5a2c53d-1573-4cf6-a18a-03b8a26a0416 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:16.521282 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e5a2c53d-1573-4cf6-a18a-03b8a26a0416 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:16.563157 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-1843624c-248a-4427-9bbf-e14fc3779325 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36697e722bef4a33ab158e9b2f87596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4ca527ba3b49539b528ec8950aef78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:16.602104 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-1843624c-248a-4427-9bbf-e14fc3779325 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "GET /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789" status: 200 len: 1733 microversion: 2.1 time: 0.539279 Aug 27 03:05:16.604041 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2260/4553] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:16 2022] GET /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789 => generated 1733 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:16.863396 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e5a2c53d-1573-4cf6-a18a-03b8a26a0416 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:16.876333 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e5a2c53d-1573-4cf6-a18a-03b8a26a0416 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/f1af7d0e-6991-4b4f-83ef-1008fb6d4f58" status: 200 len: 1308 microversion: 2.1 time: 0.385366 Aug 27 03:05:16.885201 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2294/4554] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:16 2022] GET /compute/v2.1/servers/f1af7d0e-6991-4b4f-83ef-1008fb6d4f58 => generated 1308 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:05:16.974492 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-d65217bb-e58f-44e2-bd0c-c81dcf655b44 req-c07ddc2b-8cf2-4779-9492-d6c40cfeca37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72ffd032-b609-4e42-90d9-5454ac648eeb", "tag": "7a8cf46b-6b49-415b-b564-a266edc89536"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:05:17.004076 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-d65217bb-e58f-44e2-bd0c-c81dcf655b44 req-c07ddc2b-8cf2-4779-9492-d6c40cfeca37 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:17.004629 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-d65217bb-e58f-44e2-bd0c-c81dcf655b44 req-c07ddc2b-8cf2-4779-9492-d6c40cfeca37 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:17.005080 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-d65217bb-e58f-44e2-bd0c-c81dcf655b44 req-c07ddc2b-8cf2-4779-9492-d6c40cfeca37 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:17.016053 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-eded7f55-8f2d-4c28-ae8e-f2a257c26520 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:17.016987 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-eded7f55-8f2d-4c28-ae8e-f2a257c26520 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:17.027384 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eded7f55-8f2d-4c28-ae8e-f2a257c26520 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:17.030566 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eded7f55-8f2d-4c28-ae8e-f2a257c26520 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:17.032028 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eded7f55-8f2d-4c28-ae8e-f2a257c26520 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:17.035549 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eded7f55-8f2d-4c28-ae8e-f2a257c26520 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:17.036279 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eded7f55-8f2d-4c28-ae8e-f2a257c26520 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:17.036958 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eded7f55-8f2d-4c28-ae8e-f2a257c26520 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:17.048149 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-d65217bb-e58f-44e2-bd0c-c81dcf655b44 req-c07ddc2b-8cf2-4779-9492-d6c40cfeca37 service nova] Creating event network-changed:7a8cf46b-6b49-415b-b564-a266edc89536 for instance 72ffd032-b609-4e42-90d9-5454ac648eeb on n-h1-852278-4 Aug 27 03:05:17.061463 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-d65217bb-e58f-44e2-bd0c-c81dcf655b44 req-c07ddc2b-8cf2-4779-9492-d6c40cfeca37 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091343 Aug 27 03:05:17.063140 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2261/4555] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:05:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:05:17.475277 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-96fef433-ad7d-4d35-8123-dfb8e6ef2ff7 req-af564dcf-71ca-4442-85d3-b191cf16418a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1af7d0e-6991-4b4f-83ef-1008fb6d4f58", "name": "network-vif-plugged", "status": "completed", "tag": "95a1ae00-538a-4280-b210-05cf3ec10f51"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:05:17.500997 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-96fef433-ad7d-4d35-8123-dfb8e6ef2ff7 req-af564dcf-71ca-4442-85d3-b191cf16418a service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:17.501489 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-96fef433-ad7d-4d35-8123-dfb8e6ef2ff7 req-af564dcf-71ca-4442-85d3-b191cf16418a service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:17.501921 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-96fef433-ad7d-4d35-8123-dfb8e6ef2ff7 req-af564dcf-71ca-4442-85d3-b191cf16418a service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:17.529101 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-96fef433-ad7d-4d35-8123-dfb8e6ef2ff7 req-af564dcf-71ca-4442-85d3-b191cf16418a service nova] Creating event network-vif-plugged:95a1ae00-538a-4280-b210-05cf3ec10f51 for instance f1af7d0e-6991-4b4f-83ef-1008fb6d4f58 on n-h2-852278-4 Aug 27 03:05:17.544717 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-96fef433-ad7d-4d35-8123-dfb8e6ef2ff7 req-af564dcf-71ca-4442-85d3-b191cf16418a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074272 Aug 27 03:05:17.545387 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2262/4556] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:05:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:05:17.588598 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-eded7f55-8f2d-4c28-ae8e-f2a257c26520 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:17.609221 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-eded7f55-8f2d-4c28-ae8e-f2a257c26520 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1316 microversion: 2.1 time: 0.597802 Aug 27 03:05:17.609890 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2295/4557] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:17 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1316 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:05:17.631791 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-56c8cc97-4dcf-4c02-be51-492bfbaac037 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:17.633416 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-56c8cc97-4dcf-4c02-be51-492bfbaac037 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: cd881214-dd67-4897-9167-335d7e48d789] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:17.646620 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-56c8cc97-4dcf-4c02-be51-492bfbaac037 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:17.647120 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-56c8cc97-4dcf-4c02-be51-492bfbaac037 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:17.647558 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-56c8cc97-4dcf-4c02-be51-492bfbaac037 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:17.648269 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-56c8cc97-4dcf-4c02-be51-492bfbaac037 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:17.648932 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-56c8cc97-4dcf-4c02-be51-492bfbaac037 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:17.649547 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-56c8cc97-4dcf-4c02-be51-492bfbaac037 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:17.903322 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-bc830132-782d-428c-ac75-05d46ab04672 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:17.904075 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-bc830132-782d-428c-ac75-05d46ab04672 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: f1af7d0e-6991-4b4f-83ef-1008fb6d4f58] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:17.918964 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bc830132-782d-428c-ac75-05d46ab04672 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:17.919760 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bc830132-782d-428c-ac75-05d46ab04672 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:17.920711 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bc830132-782d-428c-ac75-05d46ab04672 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:17.922798 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bc830132-782d-428c-ac75-05d46ab04672 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:17.923696 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bc830132-782d-428c-ac75-05d46ab04672 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:17.924351 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bc830132-782d-428c-ac75-05d46ab04672 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:18.636998 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-56c8cc97-4dcf-4c02-be51-492bfbaac037 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36697e722bef4a33ab158e9b2f87596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4ca527ba3b49539b528ec8950aef78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:18.647613 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-56c8cc97-4dcf-4c02-be51-492bfbaac037 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "GET /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789" status: 200 len: 1733 microversion: 2.1 time: 1.020502 Aug 27 03:05:18.654570 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2263/4558] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:17 2022] GET /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789 => generated 1733 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:18.665997 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-53419106-1f04-49d8-8852-ba9e40b127b5 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:18.666607 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-53419106-1f04-49d8-8852-ba9e40b127b5 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:18.679205 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-bc830132-782d-428c-ac75-05d46ab04672 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:18.682172 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-53419106-1f04-49d8-8852-ba9e40b127b5 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:18.683811 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-53419106-1f04-49d8-8852-ba9e40b127b5 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:18.684510 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-53419106-1f04-49d8-8852-ba9e40b127b5 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:18.685578 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-53419106-1f04-49d8-8852-ba9e40b127b5 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:18.686320 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-53419106-1f04-49d8-8852-ba9e40b127b5 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:18.686968 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-53419106-1f04-49d8-8852-ba9e40b127b5 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:18.696084 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-bc830132-782d-428c-ac75-05d46ab04672 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/f1af7d0e-6991-4b4f-83ef-1008fb6d4f58" status: 200 len: 1308 microversion: 2.1 time: 0.798562 Aug 27 03:05:18.704853 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2296/4559] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:17 2022] GET /compute/v2.1/servers/f1af7d0e-6991-4b4f-83ef-1008fb6d4f58 => generated 1308 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:05:19.023610 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-53419106-1f04-49d8-8852-ba9e40b127b5 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:19.032031 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-53419106-1f04-49d8-8852-ba9e40b127b5 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1316 microversion: 2.1 time: 0.376305 Aug 27 03:05:19.032954 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2264/4560] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:18 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1316 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:19.675503 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a991ea75-00ff-4a1e-8fd7-1eabd7114e54 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:19.677342 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-a991ea75-00ff-4a1e-8fd7-1eabd7114e54 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: cd881214-dd67-4897-9167-335d7e48d789] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:19.696483 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a991ea75-00ff-4a1e-8fd7-1eabd7114e54 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:19.698193 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a991ea75-00ff-4a1e-8fd7-1eabd7114e54 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:19.698831 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a991ea75-00ff-4a1e-8fd7-1eabd7114e54 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:19.699769 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a991ea75-00ff-4a1e-8fd7-1eabd7114e54 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:19.700512 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a991ea75-00ff-4a1e-8fd7-1eabd7114e54 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:19.701398 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a991ea75-00ff-4a1e-8fd7-1eabd7114e54 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:19.729103 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-40b3bdcd-ef7e-4dba-980d-e99dbec2a21c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:19.729727 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-40b3bdcd-ef7e-4dba-980d-e99dbec2a21c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: f1af7d0e-6991-4b4f-83ef-1008fb6d4f58] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:19.744947 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-40b3bdcd-ef7e-4dba-980d-e99dbec2a21c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:19.748798 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-40b3bdcd-ef7e-4dba-980d-e99dbec2a21c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:19.752513 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-40b3bdcd-ef7e-4dba-980d-e99dbec2a21c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:19.753769 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-40b3bdcd-ef7e-4dba-980d-e99dbec2a21c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:19.754470 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-40b3bdcd-ef7e-4dba-980d-e99dbec2a21c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:19.755095 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-40b3bdcd-ef7e-4dba-980d-e99dbec2a21c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:20.749727 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-a991ea75-00ff-4a1e-8fd7-1eabd7114e54 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36697e722bef4a33ab158e9b2f87596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4ca527ba3b49539b528ec8950aef78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:20.758877 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a991ea75-00ff-4a1e-8fd7-1eabd7114e54 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "GET /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789" status: 200 len: 1733 microversion: 2.1 time: 1.087712 Aug 27 03:05:20.760081 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2297/4561] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:19 2022] GET /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789 => generated 1733 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:20.764828 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a111173e-1e64-459f-8859-9ed29fd78fa0 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:20.765697 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-a111173e-1e64-459f-8859-9ed29fd78fa0 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:20.771763 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a111173e-1e64-459f-8859-9ed29fd78fa0 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:20.772582 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a111173e-1e64-459f-8859-9ed29fd78fa0 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:20.773132 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a111173e-1e64-459f-8859-9ed29fd78fa0 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:20.773773 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a111173e-1e64-459f-8859-9ed29fd78fa0 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:20.774202 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a111173e-1e64-459f-8859-9ed29fd78fa0 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:20.774643 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a111173e-1e64-459f-8859-9ed29fd78fa0 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:20.843174 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-40b3bdcd-ef7e-4dba-980d-e99dbec2a21c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:20.854549 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-40b3bdcd-ef7e-4dba-980d-e99dbec2a21c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/f1af7d0e-6991-4b4f-83ef-1008fb6d4f58" status: 200 len: 1488 microversion: 2.1 time: 1.133667 Aug 27 03:05:20.861984 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2265/4562] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:19 2022] GET /compute/v2.1/servers/f1af7d0e-6991-4b4f-83ef-1008fb6d4f58 => generated 1488 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:20.894378 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d388baf7-8333-4cfa-89a0-897ee1eb20af tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:05:20.905723 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d388baf7-8333-4cfa-89a0-897ee1eb20af tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: f1af7d0e-6991-4b4f-83ef-1008fb6d4f58] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:20.918709 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d388baf7-8333-4cfa-89a0-897ee1eb20af tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:20.919451 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d388baf7-8333-4cfa-89a0-897ee1eb20af tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:20.920084 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d388baf7-8333-4cfa-89a0-897ee1eb20af tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:20.921068 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d388baf7-8333-4cfa-89a0-897ee1eb20af tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:20.921784 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d388baf7-8333-4cfa-89a0-897ee1eb20af tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:20.922645 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d388baf7-8333-4cfa-89a0-897ee1eb20af tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:21.034420 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d388baf7-8333-4cfa-89a0-897ee1eb20af tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "PUT /compute/v2.1/servers/f1af7d0e-6991-4b4f-83ef-1008fb6d4f58" status: 200 len: 1083 microversion: 2.1 time: 0.155404 Aug 27 03:05:21.036535 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2266/4563] 10.222.0.70 () {60 vars in 1256 bytes} [Sat Aug 27 03:05:20 2022] PUT /compute/v2.1/servers/f1af7d0e-6991-4b4f-83ef-1008fb6d4f58 => generated 1083 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:21.058425 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4c8aacfc-a58d-43ab-aedd-9200331453f7 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:21.059668 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-4c8aacfc-a58d-43ab-aedd-9200331453f7 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: f1af7d0e-6991-4b4f-83ef-1008fb6d4f58] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:21.068539 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4c8aacfc-a58d-43ab-aedd-9200331453f7 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:21.069505 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4c8aacfc-a58d-43ab-aedd-9200331453f7 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:21.070771 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4c8aacfc-a58d-43ab-aedd-9200331453f7 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:21.072677 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4c8aacfc-a58d-43ab-aedd-9200331453f7 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:21.073442 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4c8aacfc-a58d-43ab-aedd-9200331453f7 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:21.074115 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4c8aacfc-a58d-43ab-aedd-9200331453f7 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:21.183001 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-a111173e-1e64-459f-8859-9ed29fd78fa0 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:21.193427 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a111173e-1e64-459f-8859-9ed29fd78fa0 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1316 microversion: 2.1 time: 0.432113 Aug 27 03:05:21.194069 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2298/4564] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:20 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1316 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:21.281429 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:05:21.348407 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=6 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:05:21.466274 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-4c8aacfc-a58d-43ab-aedd-9200331453f7 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:21.477451 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-4c8aacfc-a58d-43ab-aedd-9200331453f7 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/f1af7d0e-6991-4b4f-83ef-1008fb6d4f58" status: 200 len: 1509 microversion: 2.1 time: 0.427764 Aug 27 03:05:21.480661 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2267/4565] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:21 2022] GET /compute/v2.1/servers/f1af7d0e-6991-4b4f-83ef-1008fb6d4f58 => generated 1509 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:21.513351 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-9cfa0276-e797-474a-90fd-021dae8913bf tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:21.516065 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-9cfa0276-e797-474a-90fd-021dae8913bf tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: f1af7d0e-6991-4b4f-83ef-1008fb6d4f58] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:21.539035 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9cfa0276-e797-474a-90fd-021dae8913bf tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:21.539550 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9cfa0276-e797-474a-90fd-021dae8913bf tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:21.547490 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9cfa0276-e797-474a-90fd-021dae8913bf tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:21.548501 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9cfa0276-e797-474a-90fd-021dae8913bf tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:21.548966 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9cfa0276-e797-474a-90fd-021dae8913bf tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:21.549386 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9cfa0276-e797-474a-90fd-021dae8913bf tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:21.650244 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:05:21.787788 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-45c609a7-d3da-48bf-a1d1-61d02103d53e tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:21.787788 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-45c609a7-d3da-48bf-a1d1-61d02103d53e tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: cd881214-dd67-4897-9167-335d7e48d789] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:21.794013 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-45c609a7-d3da-48bf-a1d1-61d02103d53e tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:21.794504 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-45c609a7-d3da-48bf-a1d1-61d02103d53e tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:21.794938 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-45c609a7-d3da-48bf-a1d1-61d02103d53e tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:21.797474 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-45c609a7-d3da-48bf-a1d1-61d02103d53e tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:21.797936 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-45c609a7-d3da-48bf-a1d1-61d02103d53e tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:21.798357 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-45c609a7-d3da-48bf-a1d1-61d02103d53e tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:22.099821 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-9cfa0276-e797-474a-90fd-021dae8913bf tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:22.115308 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-9cfa0276-e797-474a-90fd-021dae8913bf tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/f1af7d0e-6991-4b4f-83ef-1008fb6d4f58" status: 200 len: 1509 microversion: 2.1 time: 0.616487 Aug 27 03:05:22.116529 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2299/4566] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:21 2022] GET /compute/v2.1/servers/f1af7d0e-6991-4b4f-83ef-1008fb6d4f58 => generated 1509 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:22.151826 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-9c6f85f1-ac54-493e-98df-cce50049f4e9 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:22.152918 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-9c6f85f1-ac54-493e-98df-cce50049f4e9 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: f1af7d0e-6991-4b4f-83ef-1008fb6d4f58] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:22.163217 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9c6f85f1-ac54-493e-98df-cce50049f4e9 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:22.164051 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9c6f85f1-ac54-493e-98df-cce50049f4e9 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:22.165456 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9c6f85f1-ac54-493e-98df-cce50049f4e9 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:22.167806 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9c6f85f1-ac54-493e-98df-cce50049f4e9 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:22.168664 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9c6f85f1-ac54-493e-98df-cce50049f4e9 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:22.169269 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9c6f85f1-ac54-493e-98df-cce50049f4e9 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:22.188871 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-45c609a7-d3da-48bf-a1d1-61d02103d53e tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36697e722bef4a33ab158e9b2f87596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4ca527ba3b49539b528ec8950aef78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:22.213562 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-45c609a7-d3da-48bf-a1d1-61d02103d53e tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "GET /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789" status: 200 len: 1733 microversion: 2.1 time: 0.436263 Aug 27 03:05:22.214247 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2268/4567] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:21 2022] GET /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789 => generated 1733 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:05:22.225415 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3eeb674b-1621-49ec-9573-265996dda8bc tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:22.226032 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-3eeb674b-1621-49ec-9573-265996dda8bc tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:22.232550 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:05:22.248472 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3eeb674b-1621-49ec-9573-265996dda8bc tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:22.250633 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-9c6f85f1-ac54-493e-98df-cce50049f4e9 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: f1af7d0e-6991-4b4f-83ef-1008fb6d4f58] Going to try to terminate instance {{(pid=134051) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:05:22.251494 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3eeb674b-1621-49ec-9573-265996dda8bc tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:22.265386 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3eeb674b-1621-49ec-9573-265996dda8bc tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:22.267712 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3eeb674b-1621-49ec-9573-265996dda8bc tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:22.269828 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3eeb674b-1621-49ec-9573-265996dda8bc tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:22.272043 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3eeb674b-1621-49ec-9573-265996dda8bc tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:22.443219 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-9c6f85f1-ac54-493e-98df-cce50049f4e9 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "DELETE /compute/v2.1/servers/f1af7d0e-6991-4b4f-83ef-1008fb6d4f58" status: 204 len: 0 microversion: 2.1 time: 0.302449 Aug 27 03:05:22.443755 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2300/4568] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 03:05:22 2022] DELETE /compute/v2.1/servers/f1af7d0e-6991-4b4f-83ef-1008fb6d4f58 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:05:22.456463 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-2a4ccb20-2e01-465a-8fce-1e487443d051 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:22.457169 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-2a4ccb20-2e01-465a-8fce-1e487443d051 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: f1af7d0e-6991-4b4f-83ef-1008fb6d4f58] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:22.478177 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2a4ccb20-2e01-465a-8fce-1e487443d051 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:22.482866 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2a4ccb20-2e01-465a-8fce-1e487443d051 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:22.485200 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2a4ccb20-2e01-465a-8fce-1e487443d051 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:22.485854 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2a4ccb20-2e01-465a-8fce-1e487443d051 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:22.486461 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2a4ccb20-2e01-465a-8fce-1e487443d051 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:22.486749 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2a4ccb20-2e01-465a-8fce-1e487443d051 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:22.831668 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-3eeb674b-1621-49ec-9573-265996dda8bc tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:22.836547 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-2a4ccb20-2e01-465a-8fce-1e487443d051 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:22.843226 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-3eeb674b-1621-49ec-9573-265996dda8bc tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1316 microversion: 2.1 time: 0.627533 Aug 27 03:05:22.844144 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2269/4569] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:22 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1316 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:22.857676 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:05:22.857676 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-2a4ccb20-2e01-465a-8fce-1e487443d051 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/f1af7d0e-6991-4b4f-83ef-1008fb6d4f58" status: 200 len: 1515 microversion: 2.1 time: 0.400431 Aug 27 03:05:22.857676 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2301/4570] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:22 2022] GET /compute/v2.1/servers/f1af7d0e-6991-4b4f-83ef-1008fb6d4f58 => generated 1515 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:23.127733 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-9e81d5f9-8172-438e-9695-a1b9a37ddbaf req-bcd08978-03d2-43e9-8902-f577df8f80cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72ffd032-b609-4e42-90d9-5454ac648eeb", "name": "network-vif-plugged", "status": "completed", "tag": "7a8cf46b-6b49-415b-b564-a266edc89536"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:05:23.158610 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-9e81d5f9-8172-438e-9695-a1b9a37ddbaf req-bcd08978-03d2-43e9-8902-f577df8f80cc service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:23.162707 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-9e81d5f9-8172-438e-9695-a1b9a37ddbaf req-bcd08978-03d2-43e9-8902-f577df8f80cc service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:23.163261 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-9e81d5f9-8172-438e-9695-a1b9a37ddbaf req-bcd08978-03d2-43e9-8902-f577df8f80cc service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:23.186114 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-9e81d5f9-8172-438e-9695-a1b9a37ddbaf req-bcd08978-03d2-43e9-8902-f577df8f80cc service nova] Creating event network-vif-plugged:7a8cf46b-6b49-415b-b564-a266edc89536 for instance 72ffd032-b609-4e42-90d9-5454ac648eeb on n-h1-852278-4 Aug 27 03:05:23.192225 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-9e81d5f9-8172-438e-9695-a1b9a37ddbaf req-bcd08978-03d2-43e9-8902-f577df8f80cc service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073535 Aug 27 03:05:23.193079 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2302/4571] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:05:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:05:23.237925 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ba22438c-ddaa-47a9-bb33-ef25d050076e tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:23.238606 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-ba22438c-ddaa-47a9-bb33-ef25d050076e tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: cd881214-dd67-4897-9167-335d7e48d789] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:23.246857 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ba22438c-ddaa-47a9-bb33-ef25d050076e tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:23.247786 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ba22438c-ddaa-47a9-bb33-ef25d050076e tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:23.248230 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ba22438c-ddaa-47a9-bb33-ef25d050076e tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:23.249280 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ba22438c-ddaa-47a9-bb33-ef25d050076e tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:23.250112 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ba22438c-ddaa-47a9-bb33-ef25d050076e tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:23.250460 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ba22438c-ddaa-47a9-bb33-ef25d050076e tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:23.520032 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-ba22438c-ddaa-47a9-bb33-ef25d050076e tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36697e722bef4a33ab158e9b2f87596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4ca527ba3b49539b528ec8950aef78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:23.538478 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ba22438c-ddaa-47a9-bb33-ef25d050076e tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "GET /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789" status: 200 len: 1733 microversion: 2.1 time: 0.307933 Aug 27 03:05:23.556586 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2270/4572] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:23 2022] GET /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789 => generated 1733 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:23.867988 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7f5b93df-948a-49e9-99e6-3f402cb7beb7 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:23.868935 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-7f5b93df-948a-49e9-99e6-3f402cb7beb7 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:23.875722 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-bb5b923d-d2e5-4b06-9bf9-0dd70b17ed7a tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:23.876911 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-bb5b923d-d2e5-4b06-9bf9-0dd70b17ed7a tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: f1af7d0e-6991-4b4f-83ef-1008fb6d4f58] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:23.895912 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bb5b923d-d2e5-4b06-9bf9-0dd70b17ed7a tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:23.898717 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bb5b923d-d2e5-4b06-9bf9-0dd70b17ed7a tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:23.899683 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bb5b923d-d2e5-4b06-9bf9-0dd70b17ed7a tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:23.900695 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7f5b93df-948a-49e9-99e6-3f402cb7beb7 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:23.902592 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bb5b923d-d2e5-4b06-9bf9-0dd70b17ed7a tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:23.903411 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7f5b93df-948a-49e9-99e6-3f402cb7beb7 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:23.903852 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7f5b93df-948a-49e9-99e6-3f402cb7beb7 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:23.904603 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7f5b93df-948a-49e9-99e6-3f402cb7beb7 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:23.905323 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7f5b93df-948a-49e9-99e6-3f402cb7beb7 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:23.905573 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7f5b93df-948a-49e9-99e6-3f402cb7beb7 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:23.907778 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bb5b923d-d2e5-4b06-9bf9-0dd70b17ed7a tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:23.908349 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bb5b923d-d2e5-4b06-9bf9-0dd70b17ed7a tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:24.308098 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-bb5b923d-d2e5-4b06-9bf9-0dd70b17ed7a tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:24.316114 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-bb5b923d-d2e5-4b06-9bf9-0dd70b17ed7a tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/f1af7d0e-6991-4b4f-83ef-1008fb6d4f58" status: 200 len: 1515 microversion: 2.1 time: 0.445624 Aug 27 03:05:24.316771 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2271/4573] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:23 2022] GET /compute/v2.1/servers/f1af7d0e-6991-4b4f-83ef-1008fb6d4f58 => generated 1515 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:05:24.342857 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-7f5b93df-948a-49e9-99e6-3f402cb7beb7 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:24.351750 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-7f5b93df-948a-49e9-99e6-3f402cb7beb7 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1316 microversion: 2.1 time: 0.488802 Aug 27 03:05:24.352969 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2303/4574] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:23 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1316 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:24.559399 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0c6427ae-f186-4820-812a-58c1018caf52 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:24.560493 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-0c6427ae-f186-4820-812a-58c1018caf52 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: cd881214-dd67-4897-9167-335d7e48d789] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:24.573791 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0c6427ae-f186-4820-812a-58c1018caf52 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:24.578964 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0c6427ae-f186-4820-812a-58c1018caf52 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:24.580603 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0c6427ae-f186-4820-812a-58c1018caf52 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:24.581460 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0c6427ae-f186-4820-812a-58c1018caf52 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:24.583268 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0c6427ae-f186-4820-812a-58c1018caf52 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:24.583707 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0c6427ae-f186-4820-812a-58c1018caf52 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:24.680351 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:05:24.727919 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-a61f2474-dbf1-4942-a864-e5b33e0475d3 req-ac34052f-a5f4-4e1a-af30-4a5f92a28b05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1af7d0e-6991-4b4f-83ef-1008fb6d4f58", "name": "network-vif-deleted", "tag": "95a1ae00-538a-4280-b210-05cf3ec10f51"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:05:24.748999 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-a61f2474-dbf1-4942-a864-e5b33e0475d3 req-ac34052f-a5f4-4e1a-af30-4a5f92a28b05 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:24.749532 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-a61f2474-dbf1-4942-a864-e5b33e0475d3 req-ac34052f-a5f4-4e1a-af30-4a5f92a28b05 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:24.749989 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-a61f2474-dbf1-4942-a864-e5b33e0475d3 req-ac34052f-a5f4-4e1a-af30-4a5f92a28b05 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:24.780537 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-a61f2474-dbf1-4942-a864-e5b33e0475d3 req-ac34052f-a5f4-4e1a-af30-4a5f92a28b05 service nova] Creating event network-vif-deleted:95a1ae00-538a-4280-b210-05cf3ec10f51 for instance f1af7d0e-6991-4b4f-83ef-1008fb6d4f58 on n-h2-852278-4 Aug 27 03:05:24.805053 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-a61f2474-dbf1-4942-a864-e5b33e0475d3 req-ac34052f-a5f4-4e1a-af30-4a5f92a28b05 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088557 Aug 27 03:05:24.809601 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2304/4575] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:05:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Aug 27 03:05:25.006207 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0c6427ae-f186-4820-812a-58c1018caf52 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36697e722bef4a33ab158e9b2f87596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4ca527ba3b49539b528ec8950aef78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:25.023497 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-0c6427ae-f186-4820-812a-58c1018caf52 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "GET /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789" status: 200 len: 1733 microversion: 2.1 time: 0.467855 Aug 27 03:05:25.024204 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2272/4576] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:24 2022] GET /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789 => generated 1733 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:25.339176 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-6b52063e-66b7-4e9c-bdd1-f988da4ac438 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:25.340153 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-6b52063e-66b7-4e9c-bdd1-f988da4ac438 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: f1af7d0e-6991-4b4f-83ef-1008fb6d4f58] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:25.347767 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6b52063e-66b7-4e9c-bdd1-f988da4ac438 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:25.348969 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6b52063e-66b7-4e9c-bdd1-f988da4ac438 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:25.349619 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6b52063e-66b7-4e9c-bdd1-f988da4ac438 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:25.350498 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6b52063e-66b7-4e9c-bdd1-f988da4ac438 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:25.351114 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6b52063e-66b7-4e9c-bdd1-f988da4ac438 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:25.351705 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6b52063e-66b7-4e9c-bdd1-f988da4ac438 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:25.375149 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f91e2b92-645d-4088-9a69-f3c82c382a78 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:25.377759 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-f91e2b92-645d-4088-9a69-f3c82c382a78 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:25.387706 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f91e2b92-645d-4088-9a69-f3c82c382a78 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:25.388903 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f91e2b92-645d-4088-9a69-f3c82c382a78 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:25.390236 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f91e2b92-645d-4088-9a69-f3c82c382a78 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:25.391356 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f91e2b92-645d-4088-9a69-f3c82c382a78 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:25.392133 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f91e2b92-645d-4088-9a69-f3c82c382a78 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:25.393721 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f91e2b92-645d-4088-9a69-f3c82c382a78 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:25.418712 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6b52063e-66b7-4e9c-bdd1-f988da4ac438 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:25.419484 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6b52063e-66b7-4e9c-bdd1-f988da4ac438 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:25.420327 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6b52063e-66b7-4e9c-bdd1-f988da4ac438 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:25.421012 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.objects.instance [None req-6b52063e-66b7-4e9c-bdd1-f988da4ac438 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lazy-loading 'fault' on Instance uuid f1af7d0e-6991-4b4f-83ef-1008fb6d4f58 {{(pid=134051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:05:25.473316 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-6b52063e-66b7-4e9c-bdd1-f988da4ac438 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:25.483382 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-6b52063e-66b7-4e9c-bdd1-f988da4ac438 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/f1af7d0e-6991-4b4f-83ef-1008fb6d4f58" status: 200 len: 1319 microversion: 2.1 time: 0.148356 Aug 27 03:05:25.484483 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2305/4577] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:25 2022] GET /compute/v2.1/servers/f1af7d0e-6991-4b4f-83ef-1008fb6d4f58 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:25.613799 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-f91e2b92-645d-4088-9a69-f3c82c382a78 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:25.622466 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f91e2b92-645d-4088-9a69-f3c82c382a78 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1504 microversion: 2.1 time: 0.252720 Aug 27 03:05:25.628257 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2273/4578] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:25 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1504 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:25.748973 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-65d50b83-0a64-49a8-a5c6-b9a9018f4777 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1886646917", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "networks": [{"uuid": "7efdc19e-82eb-4610-897e-db10a92a0c7c"}]}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:05:25.811860 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.network.neutron [None req-65d50b83-0a64-49a8-a5c6-b9a9018f4777 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] validate_networks() for [('7efdc19e-82eb-4610-897e-db10a92a0c7c', None, None, None, None, None)] {{(pid=134051) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:05:26.052724 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-2f6169b9-4368-419a-bfd3-0a3b92eab631 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:26.053821 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-2f6169b9-4368-419a-bfd3-0a3b92eab631 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: cd881214-dd67-4897-9167-335d7e48d789] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:26.061491 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2f6169b9-4368-419a-bfd3-0a3b92eab631 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:26.063750 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2f6169b9-4368-419a-bfd3-0a3b92eab631 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:26.064505 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2f6169b9-4368-419a-bfd3-0a3b92eab631 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:26.065525 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2f6169b9-4368-419a-bfd3-0a3b92eab631 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:26.066717 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2f6169b9-4368-419a-bfd3-0a3b92eab631 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:26.067390 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2f6169b9-4368-419a-bfd3-0a3b92eab631 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:26.362252 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-2f6169b9-4368-419a-bfd3-0a3b92eab631 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36697e722bef4a33ab158e9b2f87596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4ca527ba3b49539b528ec8950aef78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:26.372355 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-2f6169b9-4368-419a-bfd3-0a3b92eab631 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "GET /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789" status: 200 len: 1733 microversion: 2.1 time: 0.324493 Aug 27 03:05:26.388163 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2274/4579] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:26 2022] GET /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789 => generated 1733 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:26.505854 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-92937401-b3e8-48e1-9f0d-228e43e0dc73 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:26.506849 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-92937401-b3e8-48e1-9f0d-228e43e0dc73 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: f1af7d0e-6991-4b4f-83ef-1008fb6d4f58] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:26.516801 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-92937401-b3e8-48e1-9f0d-228e43e0dc73 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:26.518463 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-92937401-b3e8-48e1-9f0d-228e43e0dc73 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:26.522991 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-92937401-b3e8-48e1-9f0d-228e43e0dc73 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:26.523870 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-92937401-b3e8-48e1-9f0d-228e43e0dc73 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:26.524398 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-92937401-b3e8-48e1-9f0d-228e43e0dc73 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:26.524776 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-92937401-b3e8-48e1-9f0d-228e43e0dc73 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:26.564742 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-92937401-b3e8-48e1-9f0d-228e43e0dc73 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] HTTP exception thrown: Instance f1af7d0e-6991-4b4f-83ef-1008fb6d4f58 could not be found. Aug 27 03:05:26.569187 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-92937401-b3e8-48e1-9f0d-228e43e0dc73 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Request method failure captured: Aug 27 03:05:26.569187 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/servers/f1af7d0e-6991-4b4f-83ef-1008fb6d4f58 HTTP/1.1 Aug 27 03:05:26.569187 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 03:05:26.569187 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 03:05:26.569187 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 03:05:26.569187 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 03:05:26.569187 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 03:05:26.569187 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 03:05:26.569187 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 03:05:26.569187 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 03:05:26.569187 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYljOihuPJQy-4KxXQ6OhbQw2FQiYByi8_J9EYziHxHrRpgpXLGNvb0hsYYYVptKud4yCoN0X9GxdS_QRHpRChZ0P7CrkMR6MvE3oNyvsgDIOynlxCCmMse1aD34uMngOe0Z8wMpnS_90nVB9LjwZPMQBiRDrvzydhSu6jwK0Njtp_4 Aug 27 03:05:26.569187 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 03:05:26.569187 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 03:05:26.569187 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 03:05:26.569187 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 03:05:26.569187 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 03:05:26.569187 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 03:05:26.569187 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 6b8d6664c463420bad9a5bfb6d747db4 Aug 27 03:05:26.569187 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ServersTestJSON-252485458 Aug 27 03:05:26.569187 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 03:05:26.569187 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 03:05:26.569187 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6b8d6664c463420bad9a5bfb6d747db4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_6b8d6664c463420bad9a5bfb6d747db4", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6b8d6664c463420bad9a5bfb6d747db4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/6b8d6664c463420bad9a5bfb6d747db4"}]}] Aug 27 03:05:26.569187 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ServersTestJSON-252485458 Aug 27 03:05:26.569187 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 6b8d6664c463420bad9a5bfb6d747db4 Aug 27 03:05:26.569187 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ServersTestJSON-252485458 Aug 27 03:05:26.569187 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ServersTestJSON-252485458-project Aug 27 03:05:26.569187 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 03:05:26.569187 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 03:05:26.569187 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 13a4e6dcf5df46fcad30430a9b9a08ee Aug 27 03:05:26.569187 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ServersTestJSON-252485458-project Aug 27 03:05:26.569187 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 03:05:26.569187 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance f1af7d0e-6991-4b4f-83ef-1008fb6d4f58 could not be found. Aug 27 03:05:26.569187 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': 'f1af7d0e-6991-4b4f-83ef-1008fb6d4f58'} Aug 27 03:05:26.569187 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:05:26.569187 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:05:26.569187 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:05:26.569187 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:05:26.569187 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:05:26.569187 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:05:26.569187 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:05:26.569187 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:05:26.569187 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:05:26.569187 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:05:26.569187 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1af7d0e-6991-4b4f-83ef-1008fb6d4f58 could not be found. Aug 27 03:05:26.569187 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:05:26.569187 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:05:26.569187 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:05:26.569187 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:05:26.569187 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:05:26.569187 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:05:26.569187 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:05:26.569187 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:05:26.569187 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:05:26.569187 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:05:26.569187 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:05:26.569187 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:05:26.569187 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:05:26.569187 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:05:26.569187 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:05:26.569187 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:05:26.569187 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1af7d0e-6991-4b4f-83ef-1008fb6d4f58 could not be found. Aug 27 03:05:26.569187 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:05:26.569187 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:05:26.569187 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:05:26.569187 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:05:26.577421 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:05:26.577421 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:05:26.577421 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:05:26.577421 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:05:26.577421 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1af7d0e-6991-4b4f-83ef-1008fb6d4f58 could not be found. Aug 27 03:05:26.577421 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:05:26.577421 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-92937401-b3e8-48e1-9f0d-228e43e0dc73 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Returning 404 to user: Instance f1af7d0e-6991-4b4f-83ef-1008fb6d4f58 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:05:26.577421 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-92937401-b3e8-48e1-9f0d-228e43e0dc73 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/f1af7d0e-6991-4b4f-83ef-1008fb6d4f58" status: 404 len: 111 microversion: 2.1 time: 0.070024 Aug 27 03:05:26.577421 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2275/4580] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:26 2022] GET /compute/v2.1/servers/f1af7d0e-6991-4b4f-83ef-1008fb6d4f58 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:05:26.764458 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-65d50b83-0a64-49a8-a5c6-b9a9018f4777 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Flavor limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:05:26.765354 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-65d50b83-0a64-49a8-a5c6-b9a9018f4777 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Image limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:05:26.765617 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-65d50b83-0a64-49a8-a5c6-b9a9018f4777 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Flavor pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:05:26.765787 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-65d50b83-0a64-49a8-a5c6-b9a9018f4777 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Image pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:05:26.766197 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-65d50b83-0a64-49a8-a5c6-b9a9018f4777 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:05:26.770836 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-74a8cc35-8f6f-4f53-96a2-2fe218f98f3d tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1063927561", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "networks": [{"uuid": "961028dd-9dfc-4287-bc1b-27b14d79a81a"}]}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:05:26.781042 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-65d50b83-0a64-49a8-a5c6-b9a9018f4777 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:26.788832 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-65d50b83-0a64-49a8-a5c6-b9a9018f4777 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:26.789545 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-65d50b83-0a64-49a8-a5c6-b9a9018f4777 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:26.790530 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-65d50b83-0a64-49a8-a5c6-b9a9018f4777 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:26.791167 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-65d50b83-0a64-49a8-a5c6-b9a9018f4777 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:26.791771 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-65d50b83-0a64-49a8-a5c6-b9a9018f4777 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:26.818609 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-65d50b83-0a64-49a8-a5c6-b9a9018f4777 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Getting quotas for project 3b9e672ac89e41ff82355daa83e852bd. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:05:26.826029 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-65d50b83-0a64-49a8-a5c6-b9a9018f4777 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Getting quotas for user 204c90820f6d4c64b31367aaf098325c and project 3b9e672ac89e41ff82355daa83e852bd. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:05:26.841017 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-65d50b83-0a64-49a8-a5c6-b9a9018f4777 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Going to run 1 instances... {{(pid=134051) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:05:26.843572 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-65d50b83-0a64-49a8-a5c6-b9a9018f4777 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: b297dc39-8475-45f7-ab5e-20a3db6d1e44] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134051) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:05:26.855756 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.network.neutron [None req-74a8cc35-8f6f-4f53-96a2-2fe218f98f3d tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] validate_networks() for [('961028dd-9dfc-4287-bc1b-27b14d79a81a', None, None, None, None, None)] {{(pid=134052) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:05:26.930848 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-65d50b83-0a64-49a8-a5c6-b9a9018f4777 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.185945 Aug 27 03:05:26.944406 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2306/4581] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 03:05:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1200 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:05:26.953781 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-96fe536e-5b09-473a-bb59-30f8f8863613 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:26.958941 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-96fe536e-5b09-473a-bb59-30f8f8863613 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: b297dc39-8475-45f7-ab5e-20a3db6d1e44] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:27.133400 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-96fe536e-5b09-473a-bb59-30f8f8863613 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:27.141699 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-96fe536e-5b09-473a-bb59-30f8f8863613 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/b297dc39-8475-45f7-ab5e-20a3db6d1e44" status: 200 len: 1217 microversion: 2.1 time: 0.195797 Aug 27 03:05:27.142374 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2307/4582] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:26 2022] GET /compute/v2.1/servers/b297dc39-8475-45f7-ab5e-20a3db6d1e44 => generated 1217 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:27.395774 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0dff2140-b709-44e7-b361-66f00ba0c03e tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:27.396846 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-0dff2140-b709-44e7-b361-66f00ba0c03e tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: cd881214-dd67-4897-9167-335d7e48d789] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:27.411157 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0dff2140-b709-44e7-b361-66f00ba0c03e tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:27.413817 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0dff2140-b709-44e7-b361-66f00ba0c03e tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:27.414472 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0dff2140-b709-44e7-b361-66f00ba0c03e tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:27.415565 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0dff2140-b709-44e7-b361-66f00ba0c03e tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:27.417696 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0dff2140-b709-44e7-b361-66f00ba0c03e tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:27.420969 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0dff2140-b709-44e7-b361-66f00ba0c03e tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:28.538551 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-0dff2140-b709-44e7-b361-66f00ba0c03e tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36697e722bef4a33ab158e9b2f87596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4ca527ba3b49539b528ec8950aef78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:28.549628 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-0dff2140-b709-44e7-b361-66f00ba0c03e tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "GET /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789" status: 200 len: 1733 microversion: 2.1 time: 1.158328 Aug 27 03:05:28.550228 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2308/4583] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:27 2022] GET /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789 => generated 1733 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:05:28.556220 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-9f043773-5b10-4f1c-a6e4-47543300b3b1 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:28.557067 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-9f043773-5b10-4f1c-a6e4-47543300b3b1 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: b297dc39-8475-45f7-ab5e-20a3db6d1e44] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:28.563632 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9f043773-5b10-4f1c-a6e4-47543300b3b1 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:28.564142 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9f043773-5b10-4f1c-a6e4-47543300b3b1 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:28.564782 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9f043773-5b10-4f1c-a6e4-47543300b3b1 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:28.565695 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9f043773-5b10-4f1c-a6e4-47543300b3b1 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:28.566186 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9f043773-5b10-4f1c-a6e4-47543300b3b1 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:28.566613 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9f043773-5b10-4f1c-a6e4-47543300b3b1 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:28.724822 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-9f043773-5b10-4f1c-a6e4-47543300b3b1 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:28.733022 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-74a8cc35-8f6f-4f53-96a2-2fe218f98f3d tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Flavor limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:05:28.733523 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-9f043773-5b10-4f1c-a6e4-47543300b3b1 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/b297dc39-8475-45f7-ab5e-20a3db6d1e44" status: 200 len: 1287 microversion: 2.1 time: 0.181767 Aug 27 03:05:28.744537 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2309/4584] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:28 2022] GET /compute/v2.1/servers/b297dc39-8475-45f7-ab5e-20a3db6d1e44 => generated 1287 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:28.746370 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-74a8cc35-8f6f-4f53-96a2-2fe218f98f3d tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Image limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:05:28.750283 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-74a8cc35-8f6f-4f53-96a2-2fe218f98f3d tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Flavor pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:05:28.751458 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-74a8cc35-8f6f-4f53-96a2-2fe218f98f3d tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Image pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:05:28.751982 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-74a8cc35-8f6f-4f53-96a2-2fe218f98f3d tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:05:28.765416 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-74a8cc35-8f6f-4f53-96a2-2fe218f98f3d tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:28.765416 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-74a8cc35-8f6f-4f53-96a2-2fe218f98f3d tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:28.765416 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-74a8cc35-8f6f-4f53-96a2-2fe218f98f3d tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:28.765416 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-74a8cc35-8f6f-4f53-96a2-2fe218f98f3d tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:28.765416 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-74a8cc35-8f6f-4f53-96a2-2fe218f98f3d tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:28.765416 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-74a8cc35-8f6f-4f53-96a2-2fe218f98f3d tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:28.785686 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-74a8cc35-8f6f-4f53-96a2-2fe218f98f3d tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Getting quotas for project 6b8d6664c463420bad9a5bfb6d747db4. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:05:28.793248 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-74a8cc35-8f6f-4f53-96a2-2fe218f98f3d tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Getting quotas for user 13a4e6dcf5df46fcad30430a9b9a08ee and project 6b8d6664c463420bad9a5bfb6d747db4. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:05:28.817442 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-74a8cc35-8f6f-4f53-96a2-2fe218f98f3d tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Going to run 1 instances... {{(pid=134052) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:05:28.822345 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-74a8cc35-8f6f-4f53-96a2-2fe218f98f3d tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: eeb71517-05bf-488e-98b1-04d8a140e079] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134052) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:05:28.903973 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-74a8cc35-8f6f-4f53-96a2-2fe218f98f3d tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.138287 Aug 27 03:05:28.915587 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-fd297da4-2f66-4bbc-b5df-73df5fbbcd9e tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:28.916198 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-fd297da4-2f66-4bbc-b5df-73df5fbbcd9e tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: eeb71517-05bf-488e-98b1-04d8a140e079] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:28.917606 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2276/4585] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 03:05:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 2153 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 03:05:29.040944 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-fd297da4-2f66-4bbc-b5df-73df5fbbcd9e tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:29.059668 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-fd297da4-2f66-4bbc-b5df-73df5fbbcd9e tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/eeb71517-05bf-488e-98b1-04d8a140e079" status: 200 len: 1209 microversion: 2.1 time: 0.147816 Aug 27 03:05:29.060278 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2310/4586] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:28 2022] GET /compute/v2.1/servers/eeb71517-05bf-488e-98b1-04d8a140e079 => generated 1209 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:05:29.571752 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-461164a8-3a64-4e2c-9f78-242ab40e8ec6 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:29.572655 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-461164a8-3a64-4e2c-9f78-242ab40e8ec6 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: cd881214-dd67-4897-9167-335d7e48d789] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:29.581791 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-461164a8-3a64-4e2c-9f78-242ab40e8ec6 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:29.585754 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-461164a8-3a64-4e2c-9f78-242ab40e8ec6 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:29.589465 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-461164a8-3a64-4e2c-9f78-242ab40e8ec6 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:29.590419 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-461164a8-3a64-4e2c-9f78-242ab40e8ec6 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:29.591205 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-461164a8-3a64-4e2c-9f78-242ab40e8ec6 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:29.592295 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-461164a8-3a64-4e2c-9f78-242ab40e8ec6 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:29.756504 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-26fd9281-ec1c-42c2-a0dc-2dac6dde93ff tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:29.757191 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-26fd9281-ec1c-42c2-a0dc-2dac6dde93ff tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: b297dc39-8475-45f7-ab5e-20a3db6d1e44] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:29.774558 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-26fd9281-ec1c-42c2-a0dc-2dac6dde93ff tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:29.774705 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-26fd9281-ec1c-42c2-a0dc-2dac6dde93ff tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:29.775078 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-26fd9281-ec1c-42c2-a0dc-2dac6dde93ff tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:29.775797 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-26fd9281-ec1c-42c2-a0dc-2dac6dde93ff tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:29.776238 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-26fd9281-ec1c-42c2-a0dc-2dac6dde93ff tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:29.776977 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-26fd9281-ec1c-42c2-a0dc-2dac6dde93ff tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:30.033854 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-461164a8-3a64-4e2c-9f78-242ab40e8ec6 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36697e722bef4a33ab158e9b2f87596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4ca527ba3b49539b528ec8950aef78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:30.043562 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-26fd9281-ec1c-42c2-a0dc-2dac6dde93ff tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:30.048250 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-461164a8-3a64-4e2c-9f78-242ab40e8ec6 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "GET /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789" status: 200 len: 1733 microversion: 2.1 time: 0.476883 Aug 27 03:05:30.056605 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2277/4587] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:29 2022] GET /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789 => generated 1733 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:30.061661 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-26fd9281-ec1c-42c2-a0dc-2dac6dde93ff tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/b297dc39-8475-45f7-ab5e-20a3db6d1e44" status: 200 len: 1275 microversion: 2.1 time: 0.306883 Aug 27 03:05:30.062721 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2311/4588] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:29 2022] GET /compute/v2.1/servers/b297dc39-8475-45f7-ab5e-20a3db6d1e44 => generated 1275 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:05:30.082280 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b963a3ce-561d-4ffb-b6d1-ed0a27ea06a2 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:30.082833 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b963a3ce-561d-4ffb-b6d1-ed0a27ea06a2 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: eeb71517-05bf-488e-98b1-04d8a140e079] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:30.092387 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b963a3ce-561d-4ffb-b6d1-ed0a27ea06a2 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:30.095653 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b963a3ce-561d-4ffb-b6d1-ed0a27ea06a2 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:30.096288 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b963a3ce-561d-4ffb-b6d1-ed0a27ea06a2 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:30.099232 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b963a3ce-561d-4ffb-b6d1-ed0a27ea06a2 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:30.099702 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b963a3ce-561d-4ffb-b6d1-ed0a27ea06a2 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:30.100137 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b963a3ce-561d-4ffb-b6d1-ed0a27ea06a2 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:30.280300 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b963a3ce-561d-4ffb-b6d1-ed0a27ea06a2 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:30.290573 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b963a3ce-561d-4ffb-b6d1-ed0a27ea06a2 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/eeb71517-05bf-488e-98b1-04d8a140e079" status: 200 len: 1261 microversion: 2.1 time: 0.212146 Aug 27 03:05:30.300831 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2278/4589] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:30 2022] GET /compute/v2.1/servers/eeb71517-05bf-488e-98b1-04d8a140e079 => generated 1261 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:31.069888 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-01a22826-7f7e-4e9c-9088-bf9ebede2bfb tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:31.070519 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-01a22826-7f7e-4e9c-9088-bf9ebede2bfb tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: cd881214-dd67-4897-9167-335d7e48d789] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:31.080650 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-01a22826-7f7e-4e9c-9088-bf9ebede2bfb tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:31.081552 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-01a22826-7f7e-4e9c-9088-bf9ebede2bfb tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:31.084147 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-01a22826-7f7e-4e9c-9088-bf9ebede2bfb tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:31.085314 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-01a22826-7f7e-4e9c-9088-bf9ebede2bfb tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:31.085951 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-01a22826-7f7e-4e9c-9088-bf9ebede2bfb tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:31.086652 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-01a22826-7f7e-4e9c-9088-bf9ebede2bfb tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:31.088490 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d0faf51e-83e5-4335-9933-3912bcc356fc tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:31.090796 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d0faf51e-83e5-4335-9933-3912bcc356fc tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: b297dc39-8475-45f7-ab5e-20a3db6d1e44] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:31.103118 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d0faf51e-83e5-4335-9933-3912bcc356fc tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:31.104683 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d0faf51e-83e5-4335-9933-3912bcc356fc tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:31.105328 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d0faf51e-83e5-4335-9933-3912bcc356fc tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:31.106503 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d0faf51e-83e5-4335-9933-3912bcc356fc tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:31.107158 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d0faf51e-83e5-4335-9933-3912bcc356fc tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:31.107783 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d0faf51e-83e5-4335-9933-3912bcc356fc tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:31.966834 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-d0faf51e-83e5-4335-9933-3912bcc356fc tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:31.992813 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d0faf51e-83e5-4335-9933-3912bcc356fc tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/b297dc39-8475-45f7-ab5e-20a3db6d1e44" status: 200 len: 1317 microversion: 2.1 time: 0.911748 Aug 27 03:05:31.994140 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2279/4590] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:31 2022] GET /compute/v2.1/servers/b297dc39-8475-45f7-ab5e-20a3db6d1e44 => generated 1317 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:32.006076 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-01a22826-7f7e-4e9c-9088-bf9ebede2bfb tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36697e722bef4a33ab158e9b2f87596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4ca527ba3b49539b528ec8950aef78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:32.012927 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-194d72a0-eb24-4977-a41d-c80935f31a73 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:32.013536 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-194d72a0-eb24-4977-a41d-c80935f31a73 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: eeb71517-05bf-488e-98b1-04d8a140e079] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:32.023809 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-01a22826-7f7e-4e9c-9088-bf9ebede2bfb tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "GET /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789" status: 200 len: 1733 microversion: 2.1 time: 0.957671 Aug 27 03:05:32.031526 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-194d72a0-eb24-4977-a41d-c80935f31a73 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:32.034602 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-194d72a0-eb24-4977-a41d-c80935f31a73 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:32.035204 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-194d72a0-eb24-4977-a41d-c80935f31a73 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:32.036087 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-194d72a0-eb24-4977-a41d-c80935f31a73 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:32.036806 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-194d72a0-eb24-4977-a41d-c80935f31a73 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:32.037555 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-194d72a0-eb24-4977-a41d-c80935f31a73 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:32.042479 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2312/4591] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:31 2022] GET /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789 => generated 1733 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:32.270261 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-194d72a0-eb24-4977-a41d-c80935f31a73 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:32.286967 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-194d72a0-eb24-4977-a41d-c80935f31a73 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/eeb71517-05bf-488e-98b1-04d8a140e079" status: 200 len: 1267 microversion: 2.1 time: 0.291445 Aug 27 03:05:32.289064 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2280/4592] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:31 2022] GET /compute/v2.1/servers/eeb71517-05bf-488e-98b1-04d8a140e079 => generated 1267 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:32.838832 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-03d277b5-bc0d-4276-9fb8-6ab3141651b6 req-c1458f80-7929-42a4-ba0a-a909a56cd6f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b297dc39-8475-45f7-ab5e-20a3db6d1e44", "tag": "aaa4a20c-2efa-461b-bac9-66758d39643c"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:05:32.858564 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-03d277b5-bc0d-4276-9fb8-6ab3141651b6 req-c1458f80-7929-42a4-ba0a-a909a56cd6f4 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:32.861084 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-03d277b5-bc0d-4276-9fb8-6ab3141651b6 req-c1458f80-7929-42a4-ba0a-a909a56cd6f4 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:32.863391 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-03d277b5-bc0d-4276-9fb8-6ab3141651b6 req-c1458f80-7929-42a4-ba0a-a909a56cd6f4 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:32.890278 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-03d277b5-bc0d-4276-9fb8-6ab3141651b6 req-c1458f80-7929-42a4-ba0a-a909a56cd6f4 service nova] Creating event network-changed:aaa4a20c-2efa-461b-bac9-66758d39643c for instance b297dc39-8475-45f7-ab5e-20a3db6d1e44 on n-h2-852278-4 Aug 27 03:05:32.902123 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-03d277b5-bc0d-4276-9fb8-6ab3141651b6 req-c1458f80-7929-42a4-ba0a-a909a56cd6f4 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070576 Aug 27 03:05:32.903253 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2313/4593] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:05:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:05:33.019012 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-1be4f513-fbcc-4116-9ade-c513d58ead99 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:33.020003 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-1be4f513-fbcc-4116-9ade-c513d58ead99 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: b297dc39-8475-45f7-ab5e-20a3db6d1e44] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:33.032568 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1be4f513-fbcc-4116-9ade-c513d58ead99 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:33.034491 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1be4f513-fbcc-4116-9ade-c513d58ead99 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:33.035498 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1be4f513-fbcc-4116-9ade-c513d58ead99 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:33.037119 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1be4f513-fbcc-4116-9ade-c513d58ead99 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:33.039618 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1be4f513-fbcc-4116-9ade-c513d58ead99 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:33.041291 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1be4f513-fbcc-4116-9ade-c513d58ead99 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:33.054556 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c6b8d1b8-80c6-411f-9a0a-b2b04ff9c4c4 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:33.056234 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-c6b8d1b8-80c6-411f-9a0a-b2b04ff9c4c4 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: cd881214-dd67-4897-9167-335d7e48d789] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:33.069641 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c6b8d1b8-80c6-411f-9a0a-b2b04ff9c4c4 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:33.070420 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c6b8d1b8-80c6-411f-9a0a-b2b04ff9c4c4 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:33.071102 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c6b8d1b8-80c6-411f-9a0a-b2b04ff9c4c4 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:33.072065 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c6b8d1b8-80c6-411f-9a0a-b2b04ff9c4c4 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:33.074851 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c6b8d1b8-80c6-411f-9a0a-b2b04ff9c4c4 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:33.076047 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c6b8d1b8-80c6-411f-9a0a-b2b04ff9c4c4 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:33.506473 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-1be4f513-fbcc-4116-9ade-c513d58ead99 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:33.519204 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-1be4f513-fbcc-4116-9ade-c513d58ead99 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/b297dc39-8475-45f7-ab5e-20a3db6d1e44" status: 200 len: 1317 microversion: 2.1 time: 0.504996 Aug 27 03:05:33.525355 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2281/4594] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:33 2022] GET /compute/v2.1/servers/b297dc39-8475-45f7-ab5e-20a3db6d1e44 => generated 1317 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:33.532117 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9730380d-61a3-4356-9baa-caea58429dc3 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:33.533121 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-9730380d-61a3-4356-9baa-caea58429dc3 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: eeb71517-05bf-488e-98b1-04d8a140e079] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:33.562951 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9730380d-61a3-4356-9baa-caea58429dc3 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:33.562951 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9730380d-61a3-4356-9baa-caea58429dc3 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:33.562951 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9730380d-61a3-4356-9baa-caea58429dc3 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:33.562951 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9730380d-61a3-4356-9baa-caea58429dc3 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:33.568051 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9730380d-61a3-4356-9baa-caea58429dc3 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:33.568941 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9730380d-61a3-4356-9baa-caea58429dc3 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:33.880713 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-c6b8d1b8-80c6-411f-9a0a-b2b04ff9c4c4 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36697e722bef4a33ab158e9b2f87596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4ca527ba3b49539b528ec8950aef78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:33.890197 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c6b8d1b8-80c6-411f-9a0a-b2b04ff9c4c4 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "GET /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789" status: 200 len: 1733 microversion: 2.1 time: 0.839799 Aug 27 03:05:33.895711 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2314/4595] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:33 2022] GET /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789 => generated 1733 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:34.124477 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-9730380d-61a3-4356-9baa-caea58429dc3 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:34.138295 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9730380d-61a3-4356-9baa-caea58429dc3 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/eeb71517-05bf-488e-98b1-04d8a140e079" status: 200 len: 1309 microversion: 2.1 time: 0.611406 Aug 27 03:05:34.152329 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2282/4596] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:33 2022] GET /compute/v2.1/servers/eeb71517-05bf-488e-98b1-04d8a140e079 => generated 1309 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:34.541331 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d0f2c23c-9791-4e83-b8ae-42e2907cf6bd tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:34.541924 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d0f2c23c-9791-4e83-b8ae-42e2907cf6bd tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: b297dc39-8475-45f7-ab5e-20a3db6d1e44] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:34.558168 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d0f2c23c-9791-4e83-b8ae-42e2907cf6bd tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:34.573048 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d0f2c23c-9791-4e83-b8ae-42e2907cf6bd tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:34.573656 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d0f2c23c-9791-4e83-b8ae-42e2907cf6bd tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:34.574428 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d0f2c23c-9791-4e83-b8ae-42e2907cf6bd tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:34.575657 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d0f2c23c-9791-4e83-b8ae-42e2907cf6bd tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:34.577042 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d0f2c23c-9791-4e83-b8ae-42e2907cf6bd tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:34.807760 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d0f2c23c-9791-4e83-b8ae-42e2907cf6bd tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:34.821791 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d0f2c23c-9791-4e83-b8ae-42e2907cf6bd tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/b297dc39-8475-45f7-ab5e-20a3db6d1e44" status: 200 len: 1317 microversion: 2.1 time: 0.283097 Aug 27 03:05:34.823111 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2315/4597] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:34 2022] GET /compute/v2.1/servers/b297dc39-8475-45f7-ab5e-20a3db6d1e44 => generated 1317 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:34.919619 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-02326028-6e83-4ff5-b84e-652f32458079 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:34.921468 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-02326028-6e83-4ff5-b84e-652f32458079 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: cd881214-dd67-4897-9167-335d7e48d789] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:34.945761 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-02326028-6e83-4ff5-b84e-652f32458079 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:34.948905 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-02326028-6e83-4ff5-b84e-652f32458079 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:34.950534 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-02326028-6e83-4ff5-b84e-652f32458079 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:34.952352 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-02326028-6e83-4ff5-b84e-652f32458079 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:34.955478 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-2b6a5723-8c2f-4f7b-9b3c-515636abde99 req-fb32c5a5-472b-4bfd-9c41-2121f0acef19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eeb71517-05bf-488e-98b1-04d8a140e079", "tag": "67c64bad-d441-4030-8e5e-0cfd79ea5647"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:05:34.960121 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-02326028-6e83-4ff5-b84e-652f32458079 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:34.961763 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-02326028-6e83-4ff5-b84e-652f32458079 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:34.979058 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-2b6a5723-8c2f-4f7b-9b3c-515636abde99 req-fb32c5a5-472b-4bfd-9c41-2121f0acef19 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:34.980123 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-2b6a5723-8c2f-4f7b-9b3c-515636abde99 req-fb32c5a5-472b-4bfd-9c41-2121f0acef19 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:34.981963 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-2b6a5723-8c2f-4f7b-9b3c-515636abde99 req-fb32c5a5-472b-4bfd-9c41-2121f0acef19 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:35.015877 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-2b6a5723-8c2f-4f7b-9b3c-515636abde99 req-fb32c5a5-472b-4bfd-9c41-2121f0acef19 service nova] Creating event network-changed:67c64bad-d441-4030-8e5e-0cfd79ea5647 for instance eeb71517-05bf-488e-98b1-04d8a140e079 on n-h2-852278-4 Aug 27 03:05:35.025985 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-2b6a5723-8c2f-4f7b-9b3c-515636abde99 req-fb32c5a5-472b-4bfd-9c41-2121f0acef19 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074142 Aug 27 03:05:35.026875 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2316/4598] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:05:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:05:35.172222 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f398afcd-9902-4ca3-a055-28c431df01b2 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:35.172857 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-f398afcd-9902-4ca3-a055-28c431df01b2 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: eeb71517-05bf-488e-98b1-04d8a140e079] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:35.179543 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f398afcd-9902-4ca3-a055-28c431df01b2 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:35.180353 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f398afcd-9902-4ca3-a055-28c431df01b2 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:35.180782 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f398afcd-9902-4ca3-a055-28c431df01b2 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:35.181469 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f398afcd-9902-4ca3-a055-28c431df01b2 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:35.193105 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f398afcd-9902-4ca3-a055-28c431df01b2 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:35.193823 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f398afcd-9902-4ca3-a055-28c431df01b2 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:35.368861 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-02326028-6e83-4ff5-b84e-652f32458079 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36697e722bef4a33ab158e9b2f87596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4ca527ba3b49539b528ec8950aef78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:35.386956 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-02326028-6e83-4ff5-b84e-652f32458079 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "GET /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789" status: 200 len: 1733 microversion: 2.1 time: 0.470200 Aug 27 03:05:35.402811 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2283/4599] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:34 2022] GET /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789 => generated 1733 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:35.484666 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-f398afcd-9902-4ca3-a055-28c431df01b2 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:35.498190 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-f398afcd-9902-4ca3-a055-28c431df01b2 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/eeb71517-05bf-488e-98b1-04d8a140e079" status: 200 len: 1309 microversion: 2.1 time: 0.330324 Aug 27 03:05:35.500270 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2317/4600] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:35 2022] GET /compute/v2.1/servers/eeb71517-05bf-488e-98b1-04d8a140e079 => generated 1309 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:05:35.843164 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c63adbbb-6bbc-4dc5-872e-1a9b3122c426 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:35.844208 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-c63adbbb-6bbc-4dc5-872e-1a9b3122c426 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: b297dc39-8475-45f7-ab5e-20a3db6d1e44] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:35.852059 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c63adbbb-6bbc-4dc5-872e-1a9b3122c426 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:35.853211 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c63adbbb-6bbc-4dc5-872e-1a9b3122c426 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:35.853545 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c63adbbb-6bbc-4dc5-872e-1a9b3122c426 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:35.854629 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c63adbbb-6bbc-4dc5-872e-1a9b3122c426 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:35.855869 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c63adbbb-6bbc-4dc5-872e-1a9b3122c426 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:35.857785 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c63adbbb-6bbc-4dc5-872e-1a9b3122c426 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:36.415215 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-163fed3d-9581-4ee9-bc0d-81d94d385bad tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:36.417011 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-163fed3d-9581-4ee9-bc0d-81d94d385bad tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: cd881214-dd67-4897-9167-335d7e48d789] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:36.430584 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-163fed3d-9581-4ee9-bc0d-81d94d385bad tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:36.431344 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-163fed3d-9581-4ee9-bc0d-81d94d385bad tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:36.432698 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-163fed3d-9581-4ee9-bc0d-81d94d385bad tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:36.435104 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-163fed3d-9581-4ee9-bc0d-81d94d385bad tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:36.435740 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-163fed3d-9581-4ee9-bc0d-81d94d385bad tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:36.436844 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-163fed3d-9581-4ee9-bc0d-81d94d385bad tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:36.691922 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-c63adbbb-6bbc-4dc5-872e-1a9b3122c426 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:36.699816 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c63adbbb-6bbc-4dc5-872e-1a9b3122c426 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/b297dc39-8475-45f7-ab5e-20a3db6d1e44" status: 200 len: 1317 microversion: 2.1 time: 0.860542 Aug 27 03:05:36.713041 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2284/4601] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:35 2022] GET /compute/v2.1/servers/b297dc39-8475-45f7-ab5e-20a3db6d1e44 => generated 1317 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:36.719364 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b8ba858f-5b51-4026-acb4-8962a625ffe5 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:36.720511 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b8ba858f-5b51-4026-acb4-8962a625ffe5 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: eeb71517-05bf-488e-98b1-04d8a140e079] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:36.738323 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b8ba858f-5b51-4026-acb4-8962a625ffe5 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:36.739204 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b8ba858f-5b51-4026-acb4-8962a625ffe5 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:36.739942 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b8ba858f-5b51-4026-acb4-8962a625ffe5 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:36.741023 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b8ba858f-5b51-4026-acb4-8962a625ffe5 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:36.741733 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b8ba858f-5b51-4026-acb4-8962a625ffe5 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:36.742381 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b8ba858f-5b51-4026-acb4-8962a625ffe5 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:36.807054 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:05:36.855664 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-163fed3d-9581-4ee9-bc0d-81d94d385bad tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36697e722bef4a33ab158e9b2f87596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4ca527ba3b49539b528ec8950aef78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:36.864890 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-163fed3d-9581-4ee9-bc0d-81d94d385bad tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "GET /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789" status: 200 len: 1733 microversion: 2.1 time: 0.455065 Aug 27 03:05:36.865488 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2318/4602] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:36 2022] GET /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789 => generated 1733 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:05:37.127687 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b8ba858f-5b51-4026-acb4-8962a625ffe5 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:37.145059 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b8ba858f-5b51-4026-acb4-8962a625ffe5 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/eeb71517-05bf-488e-98b1-04d8a140e079" status: 200 len: 1309 microversion: 2.1 time: 0.429723 Aug 27 03:05:37.146652 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2285/4603] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:36 2022] GET /compute/v2.1/servers/eeb71517-05bf-488e-98b1-04d8a140e079 => generated 1309 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:37.724658 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-5ebc9cd8-94de-472b-88a9-7f41f6ea701e tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:37.725468 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-5ebc9cd8-94de-472b-88a9-7f41f6ea701e tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: b297dc39-8475-45f7-ab5e-20a3db6d1e44] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:37.736251 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5ebc9cd8-94de-472b-88a9-7f41f6ea701e tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:37.737532 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5ebc9cd8-94de-472b-88a9-7f41f6ea701e tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:37.741207 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5ebc9cd8-94de-472b-88a9-7f41f6ea701e tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:37.743009 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5ebc9cd8-94de-472b-88a9-7f41f6ea701e tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:37.744540 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5ebc9cd8-94de-472b-88a9-7f41f6ea701e tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:37.747753 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5ebc9cd8-94de-472b-88a9-7f41f6ea701e tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:37.889706 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-70119bba-d6f7-4a32-a20d-a7d0e4c52956 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:37.890518 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-70119bba-d6f7-4a32-a20d-a7d0e4c52956 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: cd881214-dd67-4897-9167-335d7e48d789] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:37.907703 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-70119bba-d6f7-4a32-a20d-a7d0e4c52956 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:37.908884 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-70119bba-d6f7-4a32-a20d-a7d0e4c52956 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:37.916263 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-70119bba-d6f7-4a32-a20d-a7d0e4c52956 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:37.931675 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-70119bba-d6f7-4a32-a20d-a7d0e4c52956 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:37.932236 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-70119bba-d6f7-4a32-a20d-a7d0e4c52956 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:37.932715 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-70119bba-d6f7-4a32-a20d-a7d0e4c52956 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:38.268106 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-5ebc9cd8-94de-472b-88a9-7f41f6ea701e tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:38.281538 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-5ebc9cd8-94de-472b-88a9-7f41f6ea701e tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/b297dc39-8475-45f7-ab5e-20a3db6d1e44" status: 200 len: 1317 microversion: 2.1 time: 0.560359 Aug 27 03:05:38.284664 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2319/4604] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:37 2022] GET /compute/v2.1/servers/b297dc39-8475-45f7-ab5e-20a3db6d1e44 => generated 1317 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:38.299948 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-019a60a5-ffdf-4785-9bd0-df3bb35181c6 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:38.303946 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-019a60a5-ffdf-4785-9bd0-df3bb35181c6 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: eeb71517-05bf-488e-98b1-04d8a140e079] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:38.316511 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-019a60a5-ffdf-4785-9bd0-df3bb35181c6 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:38.317009 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-019a60a5-ffdf-4785-9bd0-df3bb35181c6 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:38.320510 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-019a60a5-ffdf-4785-9bd0-df3bb35181c6 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:38.323168 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-019a60a5-ffdf-4785-9bd0-df3bb35181c6 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:38.323676 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-019a60a5-ffdf-4785-9bd0-df3bb35181c6 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:38.324118 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-019a60a5-ffdf-4785-9bd0-df3bb35181c6 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:38.708099 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-70119bba-d6f7-4a32-a20d-a7d0e4c52956 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36697e722bef4a33ab158e9b2f87596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4ca527ba3b49539b528ec8950aef78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:38.729424 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-70119bba-d6f7-4a32-a20d-a7d0e4c52956 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "GET /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789" status: 200 len: 1713 microversion: 2.1 time: 0.842508 Aug 27 03:05:38.731504 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2286/4605] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:37 2022] GET /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789 => generated 1713 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:38.828564 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-019a60a5-ffdf-4785-9bd0-df3bb35181c6 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:38.837695 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-019a60a5-ffdf-4785-9bd0-df3bb35181c6 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/eeb71517-05bf-488e-98b1-04d8a140e079" status: 200 len: 1309 microversion: 2.1 time: 0.551500 Aug 27 03:05:38.852709 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2320/4606] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:38 2022] GET /compute/v2.1/servers/eeb71517-05bf-488e-98b1-04d8a140e079 => generated 1309 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:38.955257 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9bdf9614-df49-4eae-90f2-5be627a13eb2 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:38.957584 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-9bdf9614-df49-4eae-90f2-5be627a13eb2 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: cd881214-dd67-4897-9167-335d7e48d789] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:38.963622 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:05:38.965745 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=6 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:05:38.969661 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9bdf9614-df49-4eae-90f2-5be627a13eb2 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:38.970477 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9bdf9614-df49-4eae-90f2-5be627a13eb2 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:38.971414 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9bdf9614-df49-4eae-90f2-5be627a13eb2 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:38.973005 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9bdf9614-df49-4eae-90f2-5be627a13eb2 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:38.973725 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9bdf9614-df49-4eae-90f2-5be627a13eb2 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:38.974742 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9bdf9614-df49-4eae-90f2-5be627a13eb2 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:39.191724 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-9bdf9614-df49-4eae-90f2-5be627a13eb2 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] HTTP exception thrown: Cannot 'detach_volume' instance cd881214-dd67-4897-9167-335d7e48d789 while it is in vm_state rescued Aug 27 03:05:39.195006 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9bdf9614-df49-4eae-90f2-5be627a13eb2 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Request method failure captured: Aug 27 03:05:39.195006 n-d-852278-4 devstack@n-api.service[134052]: request: DELETE /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789/os-volume_attachments/880ae5ba-8aed-42f6-9916-fc0c66ee40ff HTTP/1.1 Aug 27 03:05:39.195006 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 03:05:39.195006 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 03:05:39.195006 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 03:05:39.195006 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 03:05:39.195006 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 03:05:39.195006 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 03:05:39.195006 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 03:05:39.195006 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 03:05:39.195006 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYlCR9c_onisOtljFF_OKffaCMw1fqcK8AqJdNG9qzhexbiOAQUtNy-3x5VJrEQxLYuHD403zeJPmdfi74lzmVkRKznv6JROTBAXqcugDUkBzjF_9CFKpQVmUlF9UkBSehtKOGnnrCFpHwE0Yb7XTVGDotoY0qf8klSZfatljLqnj-Y Aug 27 03:05:39.195006 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 03:05:39.195006 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 03:05:39.195006 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 03:05:39.195006 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 03:05:39.195006 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 03:05:39.195006 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 03:05:39.195006 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 1b4ca527ba3b49539b528ec8950aef78 Aug 27 03:05:39.195006 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1447006165 Aug 27 03:05:39.195006 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 03:05:39.195006 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 03:05:39.195006 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/1b4ca527ba3b49539b528ec8950aef78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_1b4ca527ba3b49539b528ec8950aef78", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/1b4ca527ba3b49539b528ec8950aef78"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/1b4ca527ba3b49539b528ec8950aef78"}]}] Aug 27 03:05:39.195006 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1447006165 Aug 27 03:05:39.195006 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 1b4ca527ba3b49539b528ec8950aef78 Aug 27 03:05:39.195006 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1447006165 Aug 27 03:05:39.195006 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ServerRescueNegativeTestJSON-1447006165-project Aug 27 03:05:39.195006 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 03:05:39.195006 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 03:05:39.195006 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 36697e722bef4a33ab158e9b2f87596a Aug 27 03:05:39.195006 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1447006165-project Aug 27 03:05:39.195006 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 03:05:39.195006 n-d-852278-4 devstack@n-api.service[134052]: exception: Cannot 'detach_volume' instance cd881214-dd67-4897-9167-335d7e48d789 while it is in vm_state rescued Aug 27 03:05:39.195006 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'server_id': 'cd881214-dd67-4897-9167-335d7e48d789', 'id': '880ae5ba-8aed-42f6-9916-fc0c66ee40ff'} Aug 27 03:05:39.195006 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:05:39.195006 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:05:39.195006 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 27 03:05:39.195006 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 27 03:05:39.195006 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 03:05:39.195006 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 03:05:39.195006 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 27 03:05:39.195006 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 27 03:05:39.195006 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance cd881214-dd67-4897-9167-335d7e48d789 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 27 03:05:39.195006 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:05:39.195006 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:05:39.195006 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:05:39.195006 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:05:39.195006 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:05:39.195006 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:05:39.195006 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:05:39.195006 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:05:39.195006 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:05:39.195006 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:05:39.195006 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 27 03:05:39.195006 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 27 03:05:39.195006 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 27 03:05:39.195006 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 27 03:05:39.195006 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance cd881214-dd67-4897-9167-335d7e48d789 while it is in vm_state rescued Aug 27 03:05:39.195006 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:05:39.195006 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:05:39.195006 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:05:39.195006 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:05:39.205253 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:05:39.205253 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:05:39.205253 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:05:39.205253 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:05:39.205253 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance cd881214-dd67-4897-9167-335d7e48d789 while it is in vm_state rescued Aug 27 03:05:39.205253 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:05:39.209622 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9bdf9614-df49-4eae-90f2-5be627a13eb2 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Returning 409 to user: Cannot 'detach_volume' instance cd881214-dd67-4897-9167-335d7e48d789 while it is in vm_state rescued {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:05:39.211460 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9bdf9614-df49-4eae-90f2-5be627a13eb2 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "DELETE /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789/os-volume_attachments/880ae5ba-8aed-42f6-9916-fc0c66ee40ff" status: 409 len: 152 microversion: 2.1 time: 0.262675 Aug 27 03:05:39.213821 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2287/4607] 10.222.0.70 () {58 vars in 1416 bytes} [Sat Aug 27 03:05:38 2022] DELETE /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789/os-volume_attachments/880ae5ba-8aed-42f6-9916-fc0c66ee40ff => generated 152 bytes in 266 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 27 03:05:39.222201 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c8c53046-474c-435a-b10d-4273245e0bce tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:05:39.223130 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-c8c53046-474c-435a-b10d-4273245e0bce tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: cd881214-dd67-4897-9167-335d7e48d789] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:39.228975 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=10 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:05:39.231377 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c8c53046-474c-435a-b10d-4273245e0bce tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:39.232268 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c8c53046-474c-435a-b10d-4273245e0bce tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:39.232998 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c8c53046-474c-435a-b10d-4273245e0bce tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:39.234003 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c8c53046-474c-435a-b10d-4273245e0bce tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:39.234681 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c8c53046-474c-435a-b10d-4273245e0bce tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:39.235328 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c8c53046-474c-435a-b10d-4273245e0bce tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:39.310500 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0030aa29-346d-4d3c-a153-74cfb67f2fe8 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:39.312250 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-0030aa29-346d-4d3c-a153-74cfb67f2fe8 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: b297dc39-8475-45f7-ab5e-20a3db6d1e44] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:39.328176 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0030aa29-346d-4d3c-a153-74cfb67f2fe8 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:39.330052 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0030aa29-346d-4d3c-a153-74cfb67f2fe8 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:39.331268 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0030aa29-346d-4d3c-a153-74cfb67f2fe8 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:39.336857 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0030aa29-346d-4d3c-a153-74cfb67f2fe8 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:39.337486 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0030aa29-346d-4d3c-a153-74cfb67f2fe8 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:39.338054 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0030aa29-346d-4d3c-a153-74cfb67f2fe8 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:39.365133 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c8c53046-474c-435a-b10d-4273245e0bce tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "POST /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789/action" status: 202 len: 0 microversion: 2.1 time: 0.138601 Aug 27 03:05:39.365840 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2321/4608] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:05:39 2022] POST /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789/action => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:05:39.381935 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f78d8227-9e1b-4bd7-9f21-91bfee22efbd tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:39.381935 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-f78d8227-9e1b-4bd7-9f21-91bfee22efbd tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: cd881214-dd67-4897-9167-335d7e48d789] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:39.407110 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f78d8227-9e1b-4bd7-9f21-91bfee22efbd tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:39.407694 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f78d8227-9e1b-4bd7-9f21-91bfee22efbd tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:39.408032 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f78d8227-9e1b-4bd7-9f21-91bfee22efbd tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:39.408770 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f78d8227-9e1b-4bd7-9f21-91bfee22efbd tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:39.409216 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f78d8227-9e1b-4bd7-9f21-91bfee22efbd tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:39.409640 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f78d8227-9e1b-4bd7-9f21-91bfee22efbd tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:39.479951 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:05:39.868222 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0030aa29-346d-4d3c-a153-74cfb67f2fe8 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:39.878626 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-0030aa29-346d-4d3c-a153-74cfb67f2fe8 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/b297dc39-8475-45f7-ab5e-20a3db6d1e44" status: 200 len: 1317 microversion: 2.1 time: 0.579413 Aug 27 03:05:39.892325 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2288/4609] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:39 2022] GET /compute/v2.1/servers/b297dc39-8475-45f7-ab5e-20a3db6d1e44 => generated 1317 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:39.899021 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-5e0762ec-f756-4fad-9ecc-7dced8c0139c req-362c329a-eedd-4c33-a18a-b8240c6d3b46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b297dc39-8475-45f7-ab5e-20a3db6d1e44", "name": "network-vif-plugged", "status": "completed", "tag": "aaa4a20c-2efa-461b-bac9-66758d39643c"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:05:39.925228 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-5e0762ec-f756-4fad-9ecc-7dced8c0139c req-362c329a-eedd-4c33-a18a-b8240c6d3b46 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:39.927034 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-5e0762ec-f756-4fad-9ecc-7dced8c0139c req-362c329a-eedd-4c33-a18a-b8240c6d3b46 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:39.941600 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-5e0762ec-f756-4fad-9ecc-7dced8c0139c req-362c329a-eedd-4c33-a18a-b8240c6d3b46 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:39.999517 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-5e0762ec-f756-4fad-9ecc-7dced8c0139c req-362c329a-eedd-4c33-a18a-b8240c6d3b46 service nova] Creating event network-vif-plugged:aaa4a20c-2efa-461b-bac9-66758d39643c for instance b297dc39-8475-45f7-ab5e-20a3db6d1e44 on n-h2-852278-4 Aug 27 03:05:40.014688 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-5e0762ec-f756-4fad-9ecc-7dced8c0139c req-362c329a-eedd-4c33-a18a-b8240c6d3b46 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124352 Aug 27 03:05:40.017164 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2289/4610] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:05:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:05:40.044826 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-1842a092-293d-4e9f-945d-bd3466e107a3 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:40.046929 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-1842a092-293d-4e9f-945d-bd3466e107a3 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: eeb71517-05bf-488e-98b1-04d8a140e079] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:40.076501 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1842a092-293d-4e9f-945d-bd3466e107a3 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:40.079534 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1842a092-293d-4e9f-945d-bd3466e107a3 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:40.080473 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1842a092-293d-4e9f-945d-bd3466e107a3 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:40.082334 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1842a092-293d-4e9f-945d-bd3466e107a3 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:40.083433 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1842a092-293d-4e9f-945d-bd3466e107a3 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:40.085502 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1842a092-293d-4e9f-945d-bd3466e107a3 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:40.194674 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-f78d8227-9e1b-4bd7-9f21-91bfee22efbd tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36697e722bef4a33ab158e9b2f87596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4ca527ba3b49539b528ec8950aef78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:40.209307 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-f78d8227-9e1b-4bd7-9f21-91bfee22efbd tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "GET /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789" status: 200 len: 1721 microversion: 2.1 time: 0.838705 Aug 27 03:05:40.212636 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2322/4611] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:39 2022] GET /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789 => generated 1721 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:05:40.899276 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-bf4016c5-335b-4eb1-87bd-fbf3bb4ed007 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:40.900010 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-bf4016c5-335b-4eb1-87bd-fbf3bb4ed007 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: b297dc39-8475-45f7-ab5e-20a3db6d1e44] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:40.911729 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bf4016c5-335b-4eb1-87bd-fbf3bb4ed007 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:40.912232 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bf4016c5-335b-4eb1-87bd-fbf3bb4ed007 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:40.912699 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bf4016c5-335b-4eb1-87bd-fbf3bb4ed007 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:40.921254 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bf4016c5-335b-4eb1-87bd-fbf3bb4ed007 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:40.921254 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bf4016c5-335b-4eb1-87bd-fbf3bb4ed007 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:40.922156 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bf4016c5-335b-4eb1-87bd-fbf3bb4ed007 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:41.090829 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-1842a092-293d-4e9f-945d-bd3466e107a3 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:41.099888 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-1842a092-293d-4e9f-945d-bd3466e107a3 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/eeb71517-05bf-488e-98b1-04d8a140e079" status: 200 len: 1309 microversion: 2.1 time: 1.080793 Aug 27 03:05:41.116466 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2290/4612] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:40 2022] GET /compute/v2.1/servers/eeb71517-05bf-488e-98b1-04d8a140e079 => generated 1309 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:41.232883 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f0114b55-b6b9-42a1-844f-24d0a2b37ced tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:41.233723 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-f0114b55-b6b9-42a1-844f-24d0a2b37ced tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: cd881214-dd67-4897-9167-335d7e48d789] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:41.250922 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f0114b55-b6b9-42a1-844f-24d0a2b37ced tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:41.251577 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f0114b55-b6b9-42a1-844f-24d0a2b37ced tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:41.252154 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f0114b55-b6b9-42a1-844f-24d0a2b37ced tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:41.253018 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f0114b55-b6b9-42a1-844f-24d0a2b37ced tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:41.253578 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f0114b55-b6b9-42a1-844f-24d0a2b37ced tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:41.254264 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f0114b55-b6b9-42a1-844f-24d0a2b37ced tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:41.299354 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=100 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:05:41.880937 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-f0114b55-b6b9-42a1-844f-24d0a2b37ced tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36697e722bef4a33ab158e9b2f87596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4ca527ba3b49539b528ec8950aef78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:41.896179 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f0114b55-b6b9-42a1-844f-24d0a2b37ced tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "GET /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789" status: 200 len: 1721 microversion: 2.1 time: 0.667123 Aug 27 03:05:41.897810 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2291/4613] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:41 2022] GET /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789 => generated 1721 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:05:41.902306 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-bf4016c5-335b-4eb1-87bd-fbf3bb4ed007 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:41.917512 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-bf4016c5-335b-4eb1-87bd-fbf3bb4ed007 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/b297dc39-8475-45f7-ab5e-20a3db6d1e44" status: 200 len: 1317 microversion: 2.1 time: 1.022182 Aug 27 03:05:41.933764 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2323/4614] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:40 2022] GET /compute/v2.1/servers/b297dc39-8475-45f7-ab5e-20a3db6d1e44 => generated 1317 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:42.130573 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-43728c20-4019-4acf-b98b-7b73a1213a0b tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:42.131281 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-43728c20-4019-4acf-b98b-7b73a1213a0b tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: eeb71517-05bf-488e-98b1-04d8a140e079] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:42.147664 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-43728c20-4019-4acf-b98b-7b73a1213a0b tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:42.148567 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-43728c20-4019-4acf-b98b-7b73a1213a0b tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:42.150891 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-43728c20-4019-4acf-b98b-7b73a1213a0b tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:42.161318 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-43728c20-4019-4acf-b98b-7b73a1213a0b tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:42.162013 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-43728c20-4019-4acf-b98b-7b73a1213a0b tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:42.163054 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-43728c20-4019-4acf-b98b-7b73a1213a0b tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:42.383072 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-43728c20-4019-4acf-b98b-7b73a1213a0b tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:42.392127 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-43728c20-4019-4acf-b98b-7b73a1213a0b tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/eeb71517-05bf-488e-98b1-04d8a140e079" status: 200 len: 1309 microversion: 2.1 time: 0.265602 Aug 27 03:05:42.393719 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2292/4615] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:42 2022] GET /compute/v2.1/servers/eeb71517-05bf-488e-98b1-04d8a140e079 => generated 1309 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:42.920303 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-81d23cc4-35c6-4a0e-a58c-40f75e54d87b tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:42.921160 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-81d23cc4-35c6-4a0e-a58c-40f75e54d87b tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: cd881214-dd67-4897-9167-335d7e48d789] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:42.942292 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-81d23cc4-35c6-4a0e-a58c-40f75e54d87b tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:42.944819 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-81d23cc4-35c6-4a0e-a58c-40f75e54d87b tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:42.945406 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6f0af9e1-edec-4521-bfa3-0dd581fb72c9 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:42.946152 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-6f0af9e1-edec-4521-bfa3-0dd581fb72c9 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: b297dc39-8475-45f7-ab5e-20a3db6d1e44] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:42.946711 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-81d23cc4-35c6-4a0e-a58c-40f75e54d87b tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:42.949665 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-81d23cc4-35c6-4a0e-a58c-40f75e54d87b tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:42.953154 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-81d23cc4-35c6-4a0e-a58c-40f75e54d87b tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:42.955400 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-81d23cc4-35c6-4a0e-a58c-40f75e54d87b tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:42.961115 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6f0af9e1-edec-4521-bfa3-0dd581fb72c9 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:42.961750 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6f0af9e1-edec-4521-bfa3-0dd581fb72c9 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:42.962401 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6f0af9e1-edec-4521-bfa3-0dd581fb72c9 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:42.963118 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6f0af9e1-edec-4521-bfa3-0dd581fb72c9 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:42.963567 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6f0af9e1-edec-4521-bfa3-0dd581fb72c9 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:42.963990 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6f0af9e1-edec-4521-bfa3-0dd581fb72c9 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:43.234804 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-81d23cc4-35c6-4a0e-a58c-40f75e54d87b tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36697e722bef4a33ab158e9b2f87596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4ca527ba3b49539b528ec8950aef78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:43.251623 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-81d23cc4-35c6-4a0e-a58c-40f75e54d87b tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "GET /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789" status: 200 len: 1721 microversion: 2.1 time: 0.336156 Aug 27 03:05:43.265075 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-6f0af9e1-edec-4521-bfa3-0dd581fb72c9 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:43.268910 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2324/4616] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:42 2022] GET /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789 => generated 1721 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:43.277470 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-6f0af9e1-edec-4521-bfa3-0dd581fb72c9 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/b297dc39-8475-45f7-ab5e-20a3db6d1e44" status: 200 len: 1506 microversion: 2.1 time: 0.342140 Aug 27 03:05:43.279319 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2293/4617] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:42 2022] GET /compute/v2.1/servers/b297dc39-8475-45f7-ab5e-20a3db6d1e44 => generated 1506 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:43.303421 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-9f5edd7b-e509-4ef1-955a-71258b78205f tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:43.304229 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-9f5edd7b-e509-4ef1-955a-71258b78205f tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: b297dc39-8475-45f7-ab5e-20a3db6d1e44] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:43.312399 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9f5edd7b-e509-4ef1-955a-71258b78205f tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:43.313174 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9f5edd7b-e509-4ef1-955a-71258b78205f tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:43.313894 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9f5edd7b-e509-4ef1-955a-71258b78205f tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:43.314774 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9f5edd7b-e509-4ef1-955a-71258b78205f tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:43.315502 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9f5edd7b-e509-4ef1-955a-71258b78205f tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:43.316341 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9f5edd7b-e509-4ef1-955a-71258b78205f tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:43.348323 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-9f5edd7b-e509-4ef1-955a-71258b78205f tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: b297dc39-8475-45f7-ab5e-20a3db6d1e44] Going to try to terminate instance {{(pid=134051) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:05:43.415519 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-686673d4-b90d-4e2a-8214-5fc86f5c5890 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:43.416397 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-686673d4-b90d-4e2a-8214-5fc86f5c5890 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: eeb71517-05bf-488e-98b1-04d8a140e079] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:43.425161 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-686673d4-b90d-4e2a-8214-5fc86f5c5890 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:43.433944 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-686673d4-b90d-4e2a-8214-5fc86f5c5890 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:43.434637 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-686673d4-b90d-4e2a-8214-5fc86f5c5890 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:43.441664 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-686673d4-b90d-4e2a-8214-5fc86f5c5890 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:43.443332 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-686673d4-b90d-4e2a-8214-5fc86f5c5890 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:43.444467 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-686673d4-b90d-4e2a-8214-5fc86f5c5890 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:43.558571 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-9f5edd7b-e509-4ef1-955a-71258b78205f tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "DELETE /compute/v2.1/servers/b297dc39-8475-45f7-ab5e-20a3db6d1e44" status: 204 len: 0 microversion: 2.1 time: 0.260718 Aug 27 03:05:43.565697 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2325/4618] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 03:05:43 2022] DELETE /compute/v2.1/servers/b297dc39-8475-45f7-ab5e-20a3db6d1e44 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:05:43.577205 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-92575a6f-1d12-4782-a3d3-0c3fcb5c9260 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:43.577999 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-92575a6f-1d12-4782-a3d3-0c3fcb5c9260 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: b297dc39-8475-45f7-ab5e-20a3db6d1e44] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:43.607560 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-92575a6f-1d12-4782-a3d3-0c3fcb5c9260 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:43.608286 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-92575a6f-1d12-4782-a3d3-0c3fcb5c9260 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:43.608702 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-92575a6f-1d12-4782-a3d3-0c3fcb5c9260 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:43.609678 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-92575a6f-1d12-4782-a3d3-0c3fcb5c9260 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:43.613343 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-92575a6f-1d12-4782-a3d3-0c3fcb5c9260 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:43.615763 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-92575a6f-1d12-4782-a3d3-0c3fcb5c9260 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:43.808071 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-686673d4-b90d-4e2a-8214-5fc86f5c5890 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:43.831632 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-686673d4-b90d-4e2a-8214-5fc86f5c5890 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/eeb71517-05bf-488e-98b1-04d8a140e079" status: 200 len: 1309 microversion: 2.1 time: 0.420356 Aug 27 03:05:43.832604 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2294/4619] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:43 2022] GET /compute/v2.1/servers/eeb71517-05bf-488e-98b1-04d8a140e079 => generated 1309 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:43.839719 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-aab1af9d-50d9-4e34-947f-40faef52a1d5 req-d3c20f66-5662-48ba-8958-d4bb1387b855 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eeb71517-05bf-488e-98b1-04d8a140e079", "name": "network-vif-plugged", "status": "completed", "tag": "67c64bad-d441-4030-8e5e-0cfd79ea5647"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:05:43.852257 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-aab1af9d-50d9-4e34-947f-40faef52a1d5 req-d3c20f66-5662-48ba-8958-d4bb1387b855 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:43.853139 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-aab1af9d-50d9-4e34-947f-40faef52a1d5 req-d3c20f66-5662-48ba-8958-d4bb1387b855 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:43.853756 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-aab1af9d-50d9-4e34-947f-40faef52a1d5 req-d3c20f66-5662-48ba-8958-d4bb1387b855 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:43.877656 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-aab1af9d-50d9-4e34-947f-40faef52a1d5 req-d3c20f66-5662-48ba-8958-d4bb1387b855 service nova] Creating event network-vif-plugged:67c64bad-d441-4030-8e5e-0cfd79ea5647 for instance eeb71517-05bf-488e-98b1-04d8a140e079 on n-h2-852278-4 Aug 27 03:05:43.887245 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-aab1af9d-50d9-4e34-947f-40faef52a1d5 req-d3c20f66-5662-48ba-8958-d4bb1387b855 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052841 Aug 27 03:05:43.889566 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2295/4620] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:05:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:05:43.911830 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-92575a6f-1d12-4782-a3d3-0c3fcb5c9260 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:43.922713 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-92575a6f-1d12-4782-a3d3-0c3fcb5c9260 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/b297dc39-8475-45f7-ab5e-20a3db6d1e44" status: 200 len: 1512 microversion: 2.1 time: 0.349722 Aug 27 03:05:43.924604 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2326/4621] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:43 2022] GET /compute/v2.1/servers/b297dc39-8475-45f7-ab5e-20a3db6d1e44 => generated 1512 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:05:44.280537 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f290f9cc-f6df-4b1d-b6d9-551d9c50222a tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:44.281323 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-f290f9cc-f6df-4b1d-b6d9-551d9c50222a tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: cd881214-dd67-4897-9167-335d7e48d789] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:44.292834 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f290f9cc-f6df-4b1d-b6d9-551d9c50222a tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:44.293407 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f290f9cc-f6df-4b1d-b6d9-551d9c50222a tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:44.294573 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f290f9cc-f6df-4b1d-b6d9-551d9c50222a tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:44.296075 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f290f9cc-f6df-4b1d-b6d9-551d9c50222a tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:44.298191 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f290f9cc-f6df-4b1d-b6d9-551d9c50222a tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:44.298724 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f290f9cc-f6df-4b1d-b6d9-551d9c50222a tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:44.561985 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-f290f9cc-f6df-4b1d-b6d9-551d9c50222a tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36697e722bef4a33ab158e9b2f87596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4ca527ba3b49539b528ec8950aef78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:44.572148 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f290f9cc-f6df-4b1d-b6d9-551d9c50222a tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "GET /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789" status: 200 len: 1721 microversion: 2.1 time: 0.296215 Aug 27 03:05:44.588870 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2296/4622] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:44 2022] GET /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789 => generated 1721 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:44.866279 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0ae4b1be-ede5-4c7c-8de9-a2204746c828 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:44.869221 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-0ae4b1be-ede5-4c7c-8de9-a2204746c828 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: eeb71517-05bf-488e-98b1-04d8a140e079] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:44.872195 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:05:44.902222 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0ae4b1be-ede5-4c7c-8de9-a2204746c828 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:44.903143 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0ae4b1be-ede5-4c7c-8de9-a2204746c828 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:44.903836 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0ae4b1be-ede5-4c7c-8de9-a2204746c828 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:44.905093 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0ae4b1be-ede5-4c7c-8de9-a2204746c828 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:44.905860 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0ae4b1be-ede5-4c7c-8de9-a2204746c828 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:44.906510 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0ae4b1be-ede5-4c7c-8de9-a2204746c828 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:44.945478 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5111aac3-1fe3-4e7f-868d-1fa63bf6baf0 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:44.946567 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-5111aac3-1fe3-4e7f-868d-1fa63bf6baf0 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: b297dc39-8475-45f7-ab5e-20a3db6d1e44] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:44.958419 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5111aac3-1fe3-4e7f-868d-1fa63bf6baf0 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:44.959018 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5111aac3-1fe3-4e7f-868d-1fa63bf6baf0 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:44.965810 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5111aac3-1fe3-4e7f-868d-1fa63bf6baf0 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:44.965810 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5111aac3-1fe3-4e7f-868d-1fa63bf6baf0 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:44.965810 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5111aac3-1fe3-4e7f-868d-1fa63bf6baf0 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:44.965810 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5111aac3-1fe3-4e7f-868d-1fa63bf6baf0 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:45.414334 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-5111aac3-1fe3-4e7f-868d-1fa63bf6baf0 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:45.423831 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-5111aac3-1fe3-4e7f-868d-1fa63bf6baf0 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/b297dc39-8475-45f7-ab5e-20a3db6d1e44" status: 200 len: 1512 microversion: 2.1 time: 0.482447 Aug 27 03:05:45.437164 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2297/4623] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:44 2022] GET /compute/v2.1/servers/b297dc39-8475-45f7-ab5e-20a3db6d1e44 => generated 1512 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:45.445877 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-0ae4b1be-ede5-4c7c-8de9-a2204746c828 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:45.460526 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-0ae4b1be-ede5-4c7c-8de9-a2204746c828 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/eeb71517-05bf-488e-98b1-04d8a140e079" status: 200 len: 1309 microversion: 2.1 time: 0.605875 Aug 27 03:05:45.461723 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2327/4624] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:44 2022] GET /compute/v2.1/servers/eeb71517-05bf-488e-98b1-04d8a140e079 => generated 1309 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:45.599102 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-282af4c9-f13f-4b28-bf9f-e97947c0e2e1 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:45.599717 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-282af4c9-f13f-4b28-bf9f-e97947c0e2e1 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: cd881214-dd67-4897-9167-335d7e48d789] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:45.605946 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-282af4c9-f13f-4b28-bf9f-e97947c0e2e1 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:45.606536 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-282af4c9-f13f-4b28-bf9f-e97947c0e2e1 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:45.607218 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-282af4c9-f13f-4b28-bf9f-e97947c0e2e1 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:45.608196 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-282af4c9-f13f-4b28-bf9f-e97947c0e2e1 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:45.608952 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-282af4c9-f13f-4b28-bf9f-e97947c0e2e1 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:45.609536 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-282af4c9-f13f-4b28-bf9f-e97947c0e2e1 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:45.889196 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-282af4c9-f13f-4b28-bf9f-e97947c0e2e1 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36697e722bef4a33ab158e9b2f87596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4ca527ba3b49539b528ec8950aef78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:45.903195 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-282af4c9-f13f-4b28-bf9f-e97947c0e2e1 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "GET /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789" status: 200 len: 1727 microversion: 2.1 time: 0.308166 Aug 27 03:05:45.904430 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2298/4625] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:45 2022] GET /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789 => generated 1727 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:45.924355 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b4238fbd-7c16-4aea-aca6-a4072351033c tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:45.925156 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b4238fbd-7c16-4aea-aca6-a4072351033c tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: cd881214-dd67-4897-9167-335d7e48d789] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:45.943646 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b4238fbd-7c16-4aea-aca6-a4072351033c tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:45.946465 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b4238fbd-7c16-4aea-aca6-a4072351033c tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:45.947327 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b4238fbd-7c16-4aea-aca6-a4072351033c tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:45.949414 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b4238fbd-7c16-4aea-aca6-a4072351033c tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:45.951529 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b4238fbd-7c16-4aea-aca6-a4072351033c tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:45.952531 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b4238fbd-7c16-4aea-aca6-a4072351033c tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:46.185635 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-be13b6d8-fe40-44f7-8658-ea18f4c1b954 req-c6cf2874-ef79-4776-8941-db4aaadf9204 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b297dc39-8475-45f7-ab5e-20a3db6d1e44", "name": "network-vif-deleted", "tag": "aaa4a20c-2efa-461b-bac9-66758d39643c"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:05:46.193300 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b4238fbd-7c16-4aea-aca6-a4072351033c tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "GET /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.273220 Aug 27 03:05:46.194045 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2328/4626] 10.222.0.70 () {58 vars in 1275 bytes} [Sat Aug 27 03:05:45 2022] GET /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789/os-interface => generated 284 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:05:46.214628 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-be13b6d8-fe40-44f7-8658-ea18f4c1b954 req-c6cf2874-ef79-4776-8941-db4aaadf9204 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:46.215106 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-be13b6d8-fe40-44f7-8658-ea18f4c1b954 req-c6cf2874-ef79-4776-8941-db4aaadf9204 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:46.215536 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-be13b6d8-fe40-44f7-8658-ea18f4c1b954 req-c6cf2874-ef79-4776-8941-db4aaadf9204 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:46.251435 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-be13b6d8-fe40-44f7-8658-ea18f4c1b954 req-c6cf2874-ef79-4776-8941-db4aaadf9204 service nova] Creating event network-vif-deleted:aaa4a20c-2efa-461b-bac9-66758d39643c for instance b297dc39-8475-45f7-ab5e-20a3db6d1e44 on n-h2-852278-4 Aug 27 03:05:46.264267 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-be13b6d8-fe40-44f7-8658-ea18f4c1b954 req-c6cf2874-ef79-4776-8941-db4aaadf9204 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082092 Aug 27 03:05:46.265313 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2299/4627] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:05:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:05:46.447315 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-edac1645-55fa-4023-8c04-0d23f8e4751e tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:46.448949 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-edac1645-55fa-4023-8c04-0d23f8e4751e tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: b297dc39-8475-45f7-ab5e-20a3db6d1e44] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:46.465461 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-edac1645-55fa-4023-8c04-0d23f8e4751e tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:46.467446 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-edac1645-55fa-4023-8c04-0d23f8e4751e tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:46.467934 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-edac1645-55fa-4023-8c04-0d23f8e4751e tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:46.468733 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-edac1645-55fa-4023-8c04-0d23f8e4751e tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:46.474438 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-edac1645-55fa-4023-8c04-0d23f8e4751e tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:46.475627 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-edac1645-55fa-4023-8c04-0d23f8e4751e tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:46.486927 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d27e4155-ea4f-4a3e-99d2-79225fcbb217 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:46.488668 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d27e4155-ea4f-4a3e-99d2-79225fcbb217 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: eeb71517-05bf-488e-98b1-04d8a140e079] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:46.506162 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d27e4155-ea4f-4a3e-99d2-79225fcbb217 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:46.507259 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d27e4155-ea4f-4a3e-99d2-79225fcbb217 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:46.508720 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d27e4155-ea4f-4a3e-99d2-79225fcbb217 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:46.510557 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d27e4155-ea4f-4a3e-99d2-79225fcbb217 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:46.511590 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d27e4155-ea4f-4a3e-99d2-79225fcbb217 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:46.512786 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d27e4155-ea4f-4a3e-99d2-79225fcbb217 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:46.573094 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-edac1645-55fa-4023-8c04-0d23f8e4751e tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:46.574103 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-edac1645-55fa-4023-8c04-0d23f8e4751e tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:46.575971 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-edac1645-55fa-4023-8c04-0d23f8e4751e tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:46.578314 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.objects.instance [None req-edac1645-55fa-4023-8c04-0d23f8e4751e tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lazy-loading 'fault' on Instance uuid b297dc39-8475-45f7-ab5e-20a3db6d1e44 {{(pid=134051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:05:46.675406 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-edac1645-55fa-4023-8c04-0d23f8e4751e tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:46.691207 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-edac1645-55fa-4023-8c04-0d23f8e4751e tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/b297dc39-8475-45f7-ab5e-20a3db6d1e44" status: 200 len: 1307 microversion: 2.1 time: 0.248513 Aug 27 03:05:46.694673 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2329/4628] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:46 2022] GET /compute/v2.1/servers/b297dc39-8475-45f7-ab5e-20a3db6d1e44 => generated 1307 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:47.184572 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-d27e4155-ea4f-4a3e-99d2-79225fcbb217 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:47.197023 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d27e4155-ea4f-4a3e-99d2-79225fcbb217 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/eeb71517-05bf-488e-98b1-04d8a140e079" status: 200 len: 1309 microversion: 2.1 time: 0.716775 Aug 27 03:05:47.199530 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2300/4629] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:46 2022] GET /compute/v2.1/servers/eeb71517-05bf-488e-98b1-04d8a140e079 => generated 1309 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:05:47.715857 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-215f40a2-a408-4a0e-9aa5-17a6eb37de7e tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:47.716673 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-215f40a2-a408-4a0e-9aa5-17a6eb37de7e tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: b297dc39-8475-45f7-ab5e-20a3db6d1e44] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:47.724418 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-215f40a2-a408-4a0e-9aa5-17a6eb37de7e tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:47.725066 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-215f40a2-a408-4a0e-9aa5-17a6eb37de7e tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:47.725786 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-215f40a2-a408-4a0e-9aa5-17a6eb37de7e tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:47.727046 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-215f40a2-a408-4a0e-9aa5-17a6eb37de7e tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:47.727595 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-215f40a2-a408-4a0e-9aa5-17a6eb37de7e tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:47.728277 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-215f40a2-a408-4a0e-9aa5-17a6eb37de7e tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:47.755759 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-215f40a2-a408-4a0e-9aa5-17a6eb37de7e tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] HTTP exception thrown: Instance b297dc39-8475-45f7-ab5e-20a3db6d1e44 could not be found. Aug 27 03:05:47.758157 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-215f40a2-a408-4a0e-9aa5-17a6eb37de7e tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Request method failure captured: Aug 27 03:05:47.758157 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/b297dc39-8475-45f7-ab5e-20a3db6d1e44 HTTP/1.1 Aug 27 03:05:47.758157 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 03:05:47.758157 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 03:05:47.758157 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 03:05:47.758157 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 03:05:47.758157 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 03:05:47.758157 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 03:05:47.758157 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 03:05:47.758157 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 03:05:47.758157 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYnkbLTKVFjPQ5m3U2fG0N9Vjn4DkHnl17m4V7uHpwM3jvJACULLjB_xlJxNaWj4ki5CLI0R9EDG2yAGWVsjkvndQFsX9xXnPLGqFClIfHjZt1hqpj87tFD2RLalZegHNDkz7eKDMcWIs2wG0Lp8X-uNjMToWPkkmABfSYkxwHfHBds Aug 27 03:05:47.758157 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 03:05:47.758157 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 03:05:47.758157 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 03:05:47.758157 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 03:05:47.758157 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 03:05:47.758157 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 03:05:47.758157 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 3b9e672ac89e41ff82355daa83e852bd Aug 27 03:05:47.758157 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:05:47.758157 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 03:05:47.758157 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 03:05:47.758157 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3b9e672ac89e41ff82355daa83e852bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3b9e672ac89e41ff82355daa83e852bd", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3b9e672ac89e41ff82355daa83e852bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3b9e672ac89e41ff82355daa83e852bd"}]}] Aug 27 03:05:47.758157 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:05:47.758157 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 3b9e672ac89e41ff82355daa83e852bd Aug 27 03:05:47.758157 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:05:47.758157 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ServersNegativeTestJSON-1795266674-project Aug 27 03:05:47.758157 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 03:05:47.758157 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 03:05:47.758157 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 204c90820f6d4c64b31367aaf098325c Aug 27 03:05:47.758157 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ServersNegativeTestJSON-1795266674-project Aug 27 03:05:47.758157 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 03:05:47.758157 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance b297dc39-8475-45f7-ab5e-20a3db6d1e44 could not be found. Aug 27 03:05:47.758157 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': 'b297dc39-8475-45f7-ab5e-20a3db6d1e44'} Aug 27 03:05:47.758157 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:05:47.758157 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:05:47.758157 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:05:47.758157 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:05:47.758157 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:05:47.758157 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:05:47.758157 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:05:47.758157 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:05:47.758157 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:05:47.758157 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:05:47.758157 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b297dc39-8475-45f7-ab5e-20a3db6d1e44 could not be found. Aug 27 03:05:47.758157 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:05:47.758157 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:05:47.758157 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:05:47.758157 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:05:47.758157 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:05:47.758157 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:05:47.758157 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:05:47.758157 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:05:47.758157 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:05:47.758157 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:05:47.758157 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:05:47.758157 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:05:47.758157 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:05:47.758157 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:05:47.758157 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:05:47.758157 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:05:47.758157 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b297dc39-8475-45f7-ab5e-20a3db6d1e44 could not be found. Aug 27 03:05:47.758157 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:05:47.758157 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:05:47.758157 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:05:47.766025 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:05:47.766025 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:05:47.766025 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:05:47.766025 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:05:47.766025 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:05:47.766025 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b297dc39-8475-45f7-ab5e-20a3db6d1e44 could not be found. Aug 27 03:05:47.766025 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:05:47.769199 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-215f40a2-a408-4a0e-9aa5-17a6eb37de7e tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Returning 404 to user: Instance b297dc39-8475-45f7-ab5e-20a3db6d1e44 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:05:47.770783 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-215f40a2-a408-4a0e-9aa5-17a6eb37de7e tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/b297dc39-8475-45f7-ab5e-20a3db6d1e44" status: 404 len: 111 microversion: 2.1 time: 0.059768 Aug 27 03:05:47.772085 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2330/4630] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:47 2022] GET /compute/v2.1/servers/b297dc39-8475-45f7-ab5e-20a3db6d1e44 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:05:47.781006 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-95a3bdc2-3633-4653-a56f-e54c23c1a34f tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:47.782302 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-95a3bdc2-3633-4653-a56f-e54c23c1a34f tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:47.790527 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-95a3bdc2-3633-4653-a56f-e54c23c1a34f tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:47.791405 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-95a3bdc2-3633-4653-a56f-e54c23c1a34f tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:47.792172 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-95a3bdc2-3633-4653-a56f-e54c23c1a34f tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:47.793352 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-95a3bdc2-3633-4653-a56f-e54c23c1a34f tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:47.794218 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-95a3bdc2-3633-4653-a56f-e54c23c1a34f tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:47.794885 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-95a3bdc2-3633-4653-a56f-e54c23c1a34f tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:47.992298 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-95a3bdc2-3633-4653-a56f-e54c23c1a34f tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:48.002316 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-95a3bdc2-3633-4653-a56f-e54c23c1a34f tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1504 microversion: 2.1 time: 0.225164 Aug 27 03:05:48.003100 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2301/4631] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:47 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1504 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:05:48.179227 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-5df0b2b4-f7bb-4ceb-810f-8e0a2ade5278 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "networks": [{"uuid": "7efdc19e-82eb-4610-897e-db10a92a0c7c"}]}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:05:48.185199 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-5df0b2b4-f7bb-4ceb-810f-8e0a2ade5278 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Request method failure captured: Aug 27 03:05:48.185199 n-d-852278-4 devstack@n-api.service[134051]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 03:05:48.185199 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 03:05:48.185199 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 03:05:48.185199 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 03:05:48.185199 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 163 Aug 27 03:05:48.185199 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 03:05:48.185199 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 03:05:48.185199 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 03:05:48.185199 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 03:05:48.185199 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYnkbLTKVFjPQ5m3U2fG0N9Vjn4DkHnl17m4V7uHpwM3jvJACULLjB_xlJxNaWj4ki5CLI0R9EDG2yAGWVsjkvndQFsX9xXnPLGqFClIfHjZt1hqpj87tFD2RLalZegHNDkz7eKDMcWIs2wG0Lp8X-uNjMToWPkkmABfSYkxwHfHBds Aug 27 03:05:48.185199 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 03:05:48.185199 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 03:05:48.185199 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 03:05:48.185199 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 03:05:48.185199 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 03:05:48.185199 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 03:05:48.185199 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 3b9e672ac89e41ff82355daa83e852bd Aug 27 03:05:48.185199 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:05:48.185199 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 03:05:48.185199 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 03:05:48.185199 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3b9e672ac89e41ff82355daa83e852bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3b9e672ac89e41ff82355daa83e852bd", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3b9e672ac89e41ff82355daa83e852bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3b9e672ac89e41ff82355daa83e852bd"}]}] Aug 27 03:05:48.185199 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:05:48.185199 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 3b9e672ac89e41ff82355daa83e852bd Aug 27 03:05:48.185199 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:05:48.185199 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ServersNegativeTestJSON-1795266674-project Aug 27 03:05:48.185199 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 03:05:48.185199 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 03:05:48.185199 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 204c90820f6d4c64b31367aaf098325c Aug 27 03:05:48.185199 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ServersNegativeTestJSON-1795266674-project Aug 27 03:05:48.185199 n-d-852278-4 devstack@n-api.service[134051]: Aug 27 03:05:48.185199 n-d-852278-4 devstack@n-api.service[134051]: {"server": {"name": 12345, "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "networks": [{"uuid": "7efdc19e-82eb-4610-897e-db10a92a0c7c"}]}} Aug 27 03:05:48.185199 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 03:05:48.185199 n-d-852278-4 devstack@n-api.service[134051]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Aug 27 03:05:48.185199 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'body': {'server': {'name': 12345, 'imageRef': '1552acd0-176a-4c81-b680-29d74105e9d6', 'flavorRef': '452', 'networks': [{'uuid': '7efdc19e-82eb-4610-897e-db10a92a0c7c'}]}}} Aug 27 03:05:48.185199 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:05:48.185199 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:05:48.185199 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 03:05:48.185199 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 03:05:48.185199 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 03:05:48.185199 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise error Aug 27 03:05:48.185199 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Aug 27 03:05:48.185199 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:05:48.185199 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Aug 27 03:05:48.185199 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 27 03:05:48.185199 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:05:48.185199 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 27 03:05:48.185199 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi 12345 Aug 27 03:05:48.185199 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:05:48.185199 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:05:48.185199 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:05:48.185199 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:05:48.185199 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:05:48.185199 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:05:48.185199 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:05:48.185199 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:05:48.185199 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:05:48.185199 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:05:48.185199 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:05:48.185199 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:05:48.185199 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 03:05:48.185199 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 03:05:48.185199 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 03:05:48.185199 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 03:05:48.185199 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 03:05:48.190799 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 03:05:48.190799 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Aug 27 03:05:48.190799 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:05:48.190799 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:05:48.190799 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:05:48.190799 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:05:48.190799 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:05:48.190799 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:05:48.190799 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 03:05:48.190799 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 03:05:48.190799 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Aug 27 03:05:48.190799 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:05:48.193559 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-5df0b2b4-f7bb-4ceb-810f-8e0a2ade5278 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:05:48.194741 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-5df0b2b4-f7bb-4ceb-810f-8e0a2ade5278 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.021090 Aug 27 03:05:48.196731 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2331/4632] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 03:05:48 2022] POST /compute/v2.1/servers => generated 127 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:05:48.205595 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-2cba9f45-4876-4454-80ef-9052cd7914b9 req-bfce163c-05e3-4c3c-8074-e2a0fbcc259e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd881214-dd67-4897-9167-335d7e48d789", "tag": "2f521791-b088-40a6-a31a-f7d14fcd7ae4"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:05:48.242714 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-23f41e6c-62ab-4380-8ebd-0b4c1de8bfc9 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:48.248785 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-23f41e6c-62ab-4380-8ebd-0b4c1de8bfc9 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:48.249396 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-2cba9f45-4876-4454-80ef-9052cd7914b9 req-bfce163c-05e3-4c3c-8074-e2a0fbcc259e service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:48.251333 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-2cba9f45-4876-4454-80ef-9052cd7914b9 req-bfce163c-05e3-4c3c-8074-e2a0fbcc259e service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:48.252822 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-2cba9f45-4876-4454-80ef-9052cd7914b9 req-bfce163c-05e3-4c3c-8074-e2a0fbcc259e service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:48.264055 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-23f41e6c-62ab-4380-8ebd-0b4c1de8bfc9 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:48.264824 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-23f41e6c-62ab-4380-8ebd-0b4c1de8bfc9 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:48.265330 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-23f41e6c-62ab-4380-8ebd-0b4c1de8bfc9 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:48.266758 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-23f41e6c-62ab-4380-8ebd-0b4c1de8bfc9 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:48.267972 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-23f41e6c-62ab-4380-8ebd-0b4c1de8bfc9 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:48.268683 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-23f41e6c-62ab-4380-8ebd-0b4c1de8bfc9 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:48.282154 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-2cba9f45-4876-4454-80ef-9052cd7914b9 req-bfce163c-05e3-4c3c-8074-e2a0fbcc259e service nova] Creating event network-changed:2f521791-b088-40a6-a31a-f7d14fcd7ae4 for instance cd881214-dd67-4897-9167-335d7e48d789 on n-h2-852278-4 Aug 27 03:05:48.289596 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-2cba9f45-4876-4454-80ef-9052cd7914b9 req-bfce163c-05e3-4c3c-8074-e2a0fbcc259e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088215 Aug 27 03:05:48.291483 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2302/4633] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:05:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:05:48.320997 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0fe6538c-13fe-4083-872c-7b9bfbd10507 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:48.321901 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-0fe6538c-13fe-4083-872c-7b9bfbd10507 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: eeb71517-05bf-488e-98b1-04d8a140e079] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:48.333811 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0fe6538c-13fe-4083-872c-7b9bfbd10507 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:48.334815 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0fe6538c-13fe-4083-872c-7b9bfbd10507 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:48.335485 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0fe6538c-13fe-4083-872c-7b9bfbd10507 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:48.336569 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0fe6538c-13fe-4083-872c-7b9bfbd10507 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:48.337338 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0fe6538c-13fe-4083-872c-7b9bfbd10507 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:48.338089 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0fe6538c-13fe-4083-872c-7b9bfbd10507 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:48.708174 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-23f41e6c-62ab-4380-8ebd-0b4c1de8bfc9 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:48.720663 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-23f41e6c-62ab-4380-8ebd-0b4c1de8bfc9 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1504 microversion: 2.1 time: 0.507715 Aug 27 03:05:48.723321 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2332/4634] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:48 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1504 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:48.744704 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-6626813c-67e7-4754-aa25-e16ca5b0e39a tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:48.745631 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-6626813c-67e7-4754-aa25-e16ca5b0e39a tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:48.752422 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6626813c-67e7-4754-aa25-e16ca5b0e39a tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:48.753145 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6626813c-67e7-4754-aa25-e16ca5b0e39a tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:48.753864 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6626813c-67e7-4754-aa25-e16ca5b0e39a tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:48.754763 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6626813c-67e7-4754-aa25-e16ca5b0e39a tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:48.755215 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6626813c-67e7-4754-aa25-e16ca5b0e39a tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:48.755826 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6626813c-67e7-4754-aa25-e16ca5b0e39a tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:48.860930 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0fe6538c-13fe-4083-872c-7b9bfbd10507 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:48.882679 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-0fe6538c-13fe-4083-872c-7b9bfbd10507 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/eeb71517-05bf-488e-98b1-04d8a140e079" status: 200 len: 1490 microversion: 2.1 time: 0.588787 Aug 27 03:05:48.884302 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2303/4635] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:48 2022] GET /compute/v2.1/servers/eeb71517-05bf-488e-98b1-04d8a140e079 => generated 1490 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:48.905147 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-2a1f8645-09aa-4593-8abb-d0c4e3f23ad6 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1126337679"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:05:48.907832 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-2a1f8645-09aa-4593-8abb-d0c4e3f23ad6 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: eeb71517-05bf-488e-98b1-04d8a140e079] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:48.917390 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2a1f8645-09aa-4593-8abb-d0c4e3f23ad6 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:48.918655 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2a1f8645-09aa-4593-8abb-d0c4e3f23ad6 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:48.919265 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2a1f8645-09aa-4593-8abb-d0c4e3f23ad6 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:48.920166 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2a1f8645-09aa-4593-8abb-d0c4e3f23ad6 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:48.920845 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2a1f8645-09aa-4593-8abb-d0c4e3f23ad6 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:48.921466 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2a1f8645-09aa-4593-8abb-d0c4e3f23ad6 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:49.018519 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-2a1f8645-09aa-4593-8abb-d0c4e3f23ad6 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "PUT /compute/v2.1/servers/eeb71517-05bf-488e-98b1-04d8a140e079" status: 200 len: 1075 microversion: 2.1 time: 0.117437 Aug 27 03:05:49.031907 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2304/4636] 10.222.0.70 () {60 vars in 1256 bytes} [Sat Aug 27 03:05:48 2022] PUT /compute/v2.1/servers/eeb71517-05bf-488e-98b1-04d8a140e079 => generated 1075 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:05:49.040208 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-de242563-bd6b-4525-86bc-ab4cee49ae6c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:49.040964 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-de242563-bd6b-4525-86bc-ab4cee49ae6c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: eeb71517-05bf-488e-98b1-04d8a140e079] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:49.055397 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-de242563-bd6b-4525-86bc-ab4cee49ae6c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:49.055898 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-de242563-bd6b-4525-86bc-ab4cee49ae6c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:49.056370 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-de242563-bd6b-4525-86bc-ab4cee49ae6c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:49.057095 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-de242563-bd6b-4525-86bc-ab4cee49ae6c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:49.062377 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-de242563-bd6b-4525-86bc-ab4cee49ae6c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:49.062826 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-de242563-bd6b-4525-86bc-ab4cee49ae6c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:49.139368 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-6626813c-67e7-4754-aa25-e16ca5b0e39a tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:49.147834 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-6626813c-67e7-4754-aa25-e16ca5b0e39a tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1504 microversion: 2.1 time: 0.407315 Aug 27 03:05:49.148454 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2333/4637] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:48 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1504 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:05:49.428085 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-de242563-bd6b-4525-86bc-ab4cee49ae6c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:49.448101 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-de242563-bd6b-4525-86bc-ab4cee49ae6c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/eeb71517-05bf-488e-98b1-04d8a140e079" status: 200 len: 1501 microversion: 2.1 time: 0.413018 Aug 27 03:05:49.450228 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2305/4638] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:49 2022] GET /compute/v2.1/servers/eeb71517-05bf-488e-98b1-04d8a140e079 => generated 1501 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:05:49.475549 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-172baf4c-a8a5-45af-9214-89bcfc77de9c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:49.476416 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-172baf4c-a8a5-45af-9214-89bcfc77de9c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: eeb71517-05bf-488e-98b1-04d8a140e079] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:49.494020 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-172baf4c-a8a5-45af-9214-89bcfc77de9c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:49.496080 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-172baf4c-a8a5-45af-9214-89bcfc77de9c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:49.496852 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-172baf4c-a8a5-45af-9214-89bcfc77de9c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:49.498307 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-172baf4c-a8a5-45af-9214-89bcfc77de9c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:49.500191 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-172baf4c-a8a5-45af-9214-89bcfc77de9c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:49.501483 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-172baf4c-a8a5-45af-9214-89bcfc77de9c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:49.707486 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-172baf4c-a8a5-45af-9214-89bcfc77de9c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:49.715904 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-172baf4c-a8a5-45af-9214-89bcfc77de9c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/eeb71517-05bf-488e-98b1-04d8a140e079" status: 200 len: 1501 microversion: 2.1 time: 0.245606 Aug 27 03:05:49.716525 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2334/4639] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:49 2022] GET /compute/v2.1/servers/eeb71517-05bf-488e-98b1-04d8a140e079 => generated 1501 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:49.739962 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-03105709-0eaa-4faf-afa1-e28cf485b12e tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:05:49.747198 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-03105709-0eaa-4faf-afa1-e28cf485b12e tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:49.747804 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-03105709-0eaa-4faf-afa1-e28cf485b12e tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:49.748337 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-03105709-0eaa-4faf-afa1-e28cf485b12e tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:49.779238 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-03105709-0eaa-4faf-afa1-e28cf485b12e tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: eeb71517-05bf-488e-98b1-04d8a140e079] Going to try to stop instance {{(pid=134052) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 27 03:05:49.843570 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-03105709-0eaa-4faf-afa1-e28cf485b12e tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "POST /compute/v2.1/servers/eeb71517-05bf-488e-98b1-04d8a140e079/action" status: 202 len: 0 microversion: 2.1 time: 0.107569 Aug 27 03:05:49.844300 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2306/4640] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:05:49 2022] POST /compute/v2.1/servers/eeb71517-05bf-488e-98b1-04d8a140e079/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:05:49.852663 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-bb022092-29ea-4eac-b935-c350a90039ae tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:49.853384 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-bb022092-29ea-4eac-b935-c350a90039ae tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: eeb71517-05bf-488e-98b1-04d8a140e079] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:49.866882 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bb022092-29ea-4eac-b935-c350a90039ae tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:49.867714 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bb022092-29ea-4eac-b935-c350a90039ae tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:49.868361 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bb022092-29ea-4eac-b935-c350a90039ae tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:49.869534 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bb022092-29ea-4eac-b935-c350a90039ae tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:49.870509 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bb022092-29ea-4eac-b935-c350a90039ae tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:49.871303 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bb022092-29ea-4eac-b935-c350a90039ae tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:50.174594 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-bb022092-29ea-4eac-b935-c350a90039ae tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:50.184229 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-bb022092-29ea-4eac-b935-c350a90039ae tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/eeb71517-05bf-488e-98b1-04d8a140e079" status: 200 len: 1511 microversion: 2.1 time: 0.335389 Aug 27 03:05:50.187556 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2335/4641] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:49 2022] GET /compute/v2.1/servers/eeb71517-05bf-488e-98b1-04d8a140e079 => generated 1511 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:50.313538 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-c5d2ee2a-3759-4bc5-862b-e8f312383ff4 req-4f181493-2443-43b3-9fd3-96c3639e0511 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd881214-dd67-4897-9167-335d7e48d789", "tag": "2f521791-b088-40a6-a31a-f7d14fcd7ae4"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:05:50.329527 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-c5d2ee2a-3759-4bc5-862b-e8f312383ff4 req-4f181493-2443-43b3-9fd3-96c3639e0511 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:50.330346 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-c5d2ee2a-3759-4bc5-862b-e8f312383ff4 req-4f181493-2443-43b3-9fd3-96c3639e0511 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:50.330997 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-c5d2ee2a-3759-4bc5-862b-e8f312383ff4 req-4f181493-2443-43b3-9fd3-96c3639e0511 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:50.348283 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-c5d2ee2a-3759-4bc5-862b-e8f312383ff4 req-4f181493-2443-43b3-9fd3-96c3639e0511 service nova] Creating event network-changed:2f521791-b088-40a6-a31a-f7d14fcd7ae4 for instance cd881214-dd67-4897-9167-335d7e48d789 on n-h2-852278-4 Aug 27 03:05:50.353996 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-c5d2ee2a-3759-4bc5-862b-e8f312383ff4 req-4f181493-2443-43b3-9fd3-96c3639e0511 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047248 Aug 27 03:05:50.362345 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2307/4642] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:05:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:05:51.207336 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-db10f7be-37f6-42e3-b71d-80568d0a3062 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:51.207948 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-db10f7be-37f6-42e3-b71d-80568d0a3062 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: eeb71517-05bf-488e-98b1-04d8a140e079] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:51.221325 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-db10f7be-37f6-42e3-b71d-80568d0a3062 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:51.222652 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-db10f7be-37f6-42e3-b71d-80568d0a3062 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:51.224261 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-db10f7be-37f6-42e3-b71d-80568d0a3062 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:51.225189 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-db10f7be-37f6-42e3-b71d-80568d0a3062 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:51.229371 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-db10f7be-37f6-42e3-b71d-80568d0a3062 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:51.229962 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-db10f7be-37f6-42e3-b71d-80568d0a3062 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:51.240790 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-074a255e-599c-4a2e-8f53-8a73d0f7c8ad tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-529490591", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "0f5db49b-7e56-4f50-b211-79fe776ef23d", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "7efdc19e-82eb-4610-897e-db10a92a0c7c"}]}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:05:51.374497 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-074a255e-599c-4a2e-8f53-8a73d0f7c8ad tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] HTTP exception thrown: Block Device 0f5db49b-7e56-4f50-b211-79fe776ef23d is not bootable. Aug 27 03:05:51.389928 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-074a255e-599c-4a2e-8f53-8a73d0f7c8ad tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Request method failure captured: Aug 27 03:05:51.389928 n-d-852278-4 devstack@n-api.service[134052]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 03:05:51.389928 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 03:05:51.389928 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 03:05:51.389928 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 03:05:51.389928 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 357 Aug 27 03:05:51.389928 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 03:05:51.389928 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 03:05:51.389928 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 03:05:51.389928 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 03:05:51.389928 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYnkbLTKVFjPQ5m3U2fG0N9Vjn4DkHnl17m4V7uHpwM3jvJACULLjB_xlJxNaWj4ki5CLI0R9EDG2yAGWVsjkvndQFsX9xXnPLGqFClIfHjZt1hqpj87tFD2RLalZegHNDkz7eKDMcWIs2wG0Lp8X-uNjMToWPkkmABfSYkxwHfHBds Aug 27 03:05:51.389928 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 03:05:51.389928 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 03:05:51.389928 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 03:05:51.389928 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 03:05:51.389928 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 03:05:51.389928 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 03:05:51.389928 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 3b9e672ac89e41ff82355daa83e852bd Aug 27 03:05:51.389928 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:05:51.389928 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 03:05:51.389928 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 03:05:51.389928 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3b9e672ac89e41ff82355daa83e852bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3b9e672ac89e41ff82355daa83e852bd", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3b9e672ac89e41ff82355daa83e852bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3b9e672ac89e41ff82355daa83e852bd"}]}] Aug 27 03:05:51.389928 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:05:51.389928 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 3b9e672ac89e41ff82355daa83e852bd Aug 27 03:05:51.389928 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:05:51.389928 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ServersNegativeTestJSON-1795266674-project Aug 27 03:05:51.389928 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 03:05:51.389928 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 03:05:51.389928 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 204c90820f6d4c64b31367aaf098325c Aug 27 03:05:51.389928 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ServersNegativeTestJSON-1795266674-project Aug 27 03:05:51.389928 n-d-852278-4 devstack@n-api.service[134052]: Aug 27 03:05:51.389928 n-d-852278-4 devstack@n-api.service[134052]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-529490591", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "0f5db49b-7e56-4f50-b211-79fe776ef23d", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "7efdc19e-82eb-4610-897e-db10a92a0c7c"}]}} Aug 27 03:05:51.389928 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 03:05:51.389928 n-d-852278-4 devstack@n-api.service[134052]: exception: Block Device 0f5db49b-7e56-4f50-b211-79fe776ef23d is not bootable. Aug 27 03:05:51.389928 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-529490591', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': '0f5db49b-7e56-4f50-b211-79fe776ef23d'}], 'networks': [{'uuid': '7efdc19e-82eb-4610-897e-db10a92a0c7c'}]}}} Aug 27 03:05:51.389928 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:05:51.389928 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:05:51.389928 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 27 03:05:51.389928 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 27 03:05:51.389928 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 27 03:05:51.389928 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 27 03:05:51.389928 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Aug 27 03:05:51.389928 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Aug 27 03:05:51.389928 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Aug 27 03:05:51.389928 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Aug 27 03:05:51.389928 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device 0f5db49b-7e56-4f50-b211-79fe776ef23d is not bootable. Aug 27 03:05:51.389928 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:05:51.389928 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:05:51.389928 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:05:51.389928 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:05:51.389928 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:05:51.389928 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:05:51.389928 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:05:51.389928 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:05:51.389928 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:05:51.389928 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:05:51.389928 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:05:51.389928 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:05:51.389928 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:05:51.395243 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:05:51.395243 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:05:51.395243 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:05:51.395243 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 27 03:05:51.395243 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 27 03:05:51.395243 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 27 03:05:51.395243 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device 0f5db49b-7e56-4f50-b211-79fe776ef23d is not bootable. Aug 27 03:05:51.395243 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:05:51.395243 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:05:51.395243 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:05:51.395243 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:05:51.395243 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:05:51.395243 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:05:51.395243 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:05:51.395243 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:05:51.395243 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device 0f5db49b-7e56-4f50-b211-79fe776ef23d is not bootable. Aug 27 03:05:51.395243 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:05:51.398615 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-074a255e-599c-4a2e-8f53-8a73d0f7c8ad tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Returning 400 to user: Block Device 0f5db49b-7e56-4f50-b211-79fe776ef23d is not bootable. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:05:51.400116 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-074a255e-599c-4a2e-8f53-8a73d0f7c8ad tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.164334 Aug 27 03:05:51.400994 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2308/4643] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 03:05:51 2022] POST /compute/v2.1/servers => generated 110 bytes in 166 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 27 03:05:51.411232 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f14915c9-6968-48c0-8db2-e60fcbbe5bcc tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:51.411981 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-f14915c9-6968-48c0-8db2-e60fcbbe5bcc tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:51.430842 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f14915c9-6968-48c0-8db2-e60fcbbe5bcc tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:51.431325 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f14915c9-6968-48c0-8db2-e60fcbbe5bcc tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:51.431752 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f14915c9-6968-48c0-8db2-e60fcbbe5bcc tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:51.432611 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f14915c9-6968-48c0-8db2-e60fcbbe5bcc tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:51.433246 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f14915c9-6968-48c0-8db2-e60fcbbe5bcc tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:51.433859 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f14915c9-6968-48c0-8db2-e60fcbbe5bcc tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:51.498586 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-db10f7be-37f6-42e3-b71d-80568d0a3062 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:51.509503 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-db10f7be-37f6-42e3-b71d-80568d0a3062 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/eeb71517-05bf-488e-98b1-04d8a140e079" status: 200 len: 1511 microversion: 2.1 time: 0.306157 Aug 27 03:05:51.510502 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2336/4644] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:51 2022] GET /compute/v2.1/servers/eeb71517-05bf-488e-98b1-04d8a140e079 => generated 1511 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:51.693120 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-f14915c9-6968-48c0-8db2-e60fcbbe5bcc tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:51.696966 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:05:51.702033 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f14915c9-6968-48c0-8db2-e60fcbbe5bcc tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1504 microversion: 2.1 time: 0.296438 Aug 27 03:05:51.702678 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2309/4645] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:51 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1504 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:05:51.724973 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d75ebe3c-2ab6-437e-aefa-89ff6d80b0de tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:51.725811 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d75ebe3c-2ab6-437e-aefa-89ff6d80b0de tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:51.733266 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d75ebe3c-2ab6-437e-aefa-89ff6d80b0de tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:51.745718 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d75ebe3c-2ab6-437e-aefa-89ff6d80b0de tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:51.746422 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d75ebe3c-2ab6-437e-aefa-89ff6d80b0de tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:51.747193 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d75ebe3c-2ab6-437e-aefa-89ff6d80b0de tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:51.748810 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d75ebe3c-2ab6-437e-aefa-89ff6d80b0de tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:51.750569 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d75ebe3c-2ab6-437e-aefa-89ff6d80b0de tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:52.019463 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d75ebe3c-2ab6-437e-aefa-89ff6d80b0de tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:52.028851 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d75ebe3c-2ab6-437e-aefa-89ff6d80b0de tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1504 microversion: 2.1 time: 0.308453 Aug 27 03:05:52.029709 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2337/4646] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:51 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1504 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:52.531344 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9c07a3be-b06d-4979-a312-5e6f12dbc9fc tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:52.532344 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-9c07a3be-b06d-4979-a312-5e6f12dbc9fc tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: eeb71517-05bf-488e-98b1-04d8a140e079] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:52.535519 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:05:52.542733 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9c07a3be-b06d-4979-a312-5e6f12dbc9fc tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:52.543420 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9c07a3be-b06d-4979-a312-5e6f12dbc9fc tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:52.544031 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9c07a3be-b06d-4979-a312-5e6f12dbc9fc tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:52.544952 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9c07a3be-b06d-4979-a312-5e6f12dbc9fc tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:52.545567 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9c07a3be-b06d-4979-a312-5e6f12dbc9fc tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:52.546874 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9c07a3be-b06d-4979-a312-5e6f12dbc9fc tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:52.769897 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-9c07a3be-b06d-4979-a312-5e6f12dbc9fc tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:52.780741 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9c07a3be-b06d-4979-a312-5e6f12dbc9fc tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/eeb71517-05bf-488e-98b1-04d8a140e079" status: 200 len: 1511 microversion: 2.1 time: 0.254439 Aug 27 03:05:52.796396 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2310/4647] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:52 2022] GET /compute/v2.1/servers/eeb71517-05bf-488e-98b1-04d8a140e079 => generated 1511 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:53.691628 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e8ab9e6e-e62a-410c-8398-fecfbdc1f700 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-477976300", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "1552acd0-176a-4c81-b680-29d74105e9d6", "destination_type": "local"}, {"source_type": "volume", "uuid": "1d801775-8a49-4412-b600-283fec4775e9", "destination_type": "invalid"}], "networks": [{"uuid": "7efdc19e-82eb-4610-897e-db10a92a0c7c"}]}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:05:53.698014 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e8ab9e6e-e62a-410c-8398-fecfbdc1f700 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Request method failure captured: Aug 27 03:05:53.698014 n-d-852278-4 devstack@n-api.service[134051]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 03:05:53.698014 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 03:05:53.698014 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 03:05:53.698014 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 03:05:53.698014 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 494 Aug 27 03:05:53.698014 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 03:05:53.698014 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 03:05:53.698014 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 03:05:53.698014 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 03:05:53.698014 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYnkbLTKVFjPQ5m3U2fG0N9Vjn4DkHnl17m4V7uHpwM3jvJACULLjB_xlJxNaWj4ki5CLI0R9EDG2yAGWVsjkvndQFsX9xXnPLGqFClIfHjZt1hqpj87tFD2RLalZegHNDkz7eKDMcWIs2wG0Lp8X-uNjMToWPkkmABfSYkxwHfHBds Aug 27 03:05:53.698014 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 03:05:53.698014 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 03:05:53.698014 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 03:05:53.698014 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 03:05:53.698014 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 03:05:53.698014 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 03:05:53.698014 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 3b9e672ac89e41ff82355daa83e852bd Aug 27 03:05:53.698014 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:05:53.698014 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 03:05:53.698014 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 03:05:53.698014 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3b9e672ac89e41ff82355daa83e852bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3b9e672ac89e41ff82355daa83e852bd", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3b9e672ac89e41ff82355daa83e852bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3b9e672ac89e41ff82355daa83e852bd"}]}] Aug 27 03:05:53.698014 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:05:53.698014 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 3b9e672ac89e41ff82355daa83e852bd Aug 27 03:05:53.698014 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:05:53.698014 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ServersNegativeTestJSON-1795266674-project Aug 27 03:05:53.698014 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 03:05:53.698014 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 03:05:53.698014 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 204c90820f6d4c64b31367aaf098325c Aug 27 03:05:53.698014 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ServersNegativeTestJSON-1795266674-project Aug 27 03:05:53.698014 n-d-852278-4 devstack@n-api.service[134051]: Aug 27 03:05:53.698014 n-d-852278-4 devstack@n-api.service[134051]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-477976300", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "1552acd0-176a-4c81-b680-29d74105e9d6", "destination_type": "local"}, {"source_type": "volume", "uuid": "1d801775-8a49-4412-b600-283fec4775e9", "destination_type": "invalid"}], "networks": [{"uuid": "7efdc19e-82eb-4610-897e-db10a92a0c7c"}]}} Aug 27 03:05:53.698014 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 03:05:53.698014 n-d-852278-4 devstack@n-api.service[134051]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Aug 27 03:05:53.698014 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-477976300', 'imageRef': '1552acd0-176a-4c81-b680-29d74105e9d6', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': '1552acd0-176a-4c81-b680-29d74105e9d6', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '1d801775-8a49-4412-b600-283fec4775e9', 'destination_type': 'invalid'}], 'networks': [{'uuid': '7efdc19e-82eb-4610-897e-db10a92a0c7c'}]}}} Aug 27 03:05:53.698014 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:05:53.698014 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:05:53.698014 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 03:05:53.698014 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 03:05:53.698014 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 03:05:53.698014 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise error Aug 27 03:05:53.698014 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Aug 27 03:05:53.698014 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:05:53.698014 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Aug 27 03:05:53.698014 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Aug 27 03:05:53.698014 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:05:53.698014 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Aug 27 03:05:53.698014 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi 'invalid' Aug 27 03:05:53.698014 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:05:53.698014 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:05:53.698014 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:05:53.698014 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:05:53.698014 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:05:53.698014 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:05:53.698014 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:05:53.698014 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:05:53.698014 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:05:53.703049 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:05:53.703049 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:05:53.703049 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:05:53.703049 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 03:05:53.703049 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 03:05:53.703049 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 03:05:53.703049 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 03:05:53.703049 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 03:05:53.703049 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 03:05:53.703049 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Aug 27 03:05:53.703049 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:05:53.703049 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:05:53.703049 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:05:53.703049 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:05:53.703049 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:05:53.703049 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:05:53.703049 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 03:05:53.703049 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 03:05:53.703049 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Aug 27 03:05:53.703049 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:05:53.706857 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e8ab9e6e-e62a-410c-8398-fecfbdc1f700 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:05:53.708332 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e8ab9e6e-e62a-410c-8398-fecfbdc1f700 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.022278 Aug 27 03:05:53.709213 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2338/4648] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 03:05:53 2022] POST /compute/v2.1/servers => generated 155 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:05:53.718289 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3285ca4f-0270-405d-967e-69529ccabb8d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:53.718901 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-3285ca4f-0270-405d-967e-69529ccabb8d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:53.727550 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3285ca4f-0270-405d-967e-69529ccabb8d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:53.728023 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3285ca4f-0270-405d-967e-69529ccabb8d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:53.728487 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3285ca4f-0270-405d-967e-69529ccabb8d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:53.729188 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3285ca4f-0270-405d-967e-69529ccabb8d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:53.729641 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3285ca4f-0270-405d-967e-69529ccabb8d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:53.730159 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3285ca4f-0270-405d-967e-69529ccabb8d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:53.806622 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-785e5868-c03e-4ab1-91b4-2f1984ed2df9 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:53.807443 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-785e5868-c03e-4ab1-91b4-2f1984ed2df9 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: eeb71517-05bf-488e-98b1-04d8a140e079] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:53.818540 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-785e5868-c03e-4ab1-91b4-2f1984ed2df9 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:53.819048 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-785e5868-c03e-4ab1-91b4-2f1984ed2df9 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:53.819851 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-785e5868-c03e-4ab1-91b4-2f1984ed2df9 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:53.820629 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-785e5868-c03e-4ab1-91b4-2f1984ed2df9 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:53.821255 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-785e5868-c03e-4ab1-91b4-2f1984ed2df9 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:53.821852 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-785e5868-c03e-4ab1-91b4-2f1984ed2df9 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:53.896660 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-3285ca4f-0270-405d-967e-69529ccabb8d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:53.908732 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-3285ca4f-0270-405d-967e-69529ccabb8d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1504 microversion: 2.1 time: 0.194746 Aug 27 03:05:53.910476 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2311/4649] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:53 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1504 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:53.939191 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-91493efe-c063-4509-b070-53c548767f1d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:53.940410 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-91493efe-c063-4509-b070-53c548767f1d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:53.949121 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-91493efe-c063-4509-b070-53c548767f1d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:53.951625 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-91493efe-c063-4509-b070-53c548767f1d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:53.953738 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-91493efe-c063-4509-b070-53c548767f1d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:53.954491 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-91493efe-c063-4509-b070-53c548767f1d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:53.954954 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-91493efe-c063-4509-b070-53c548767f1d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:53.955483 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-91493efe-c063-4509-b070-53c548767f1d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:54.074059 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-785e5868-c03e-4ab1-91b4-2f1984ed2df9 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:54.082227 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-785e5868-c03e-4ab1-91b4-2f1984ed2df9 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/eeb71517-05bf-488e-98b1-04d8a140e079" status: 200 len: 1511 microversion: 2.1 time: 0.284528 Aug 27 03:05:54.083060 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2339/4650] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:53 2022] GET /compute/v2.1/servers/eeb71517-05bf-488e-98b1-04d8a140e079 => generated 1511 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:54.137785 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-91493efe-c063-4509-b070-53c548767f1d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:54.145607 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-91493efe-c063-4509-b070-53c548767f1d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1504 microversion: 2.1 time: 0.212727 Aug 27 03:05:54.146185 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2312/4651] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:53 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1504 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:54.293663 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-2f65b9b8-b0ba-4bd9-9da7-405eef272406 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2062588011", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "7efdc19e-82eb-4610-897e-db10a92a0c7c"}]}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:05:54.307361 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-2f65b9b8-b0ba-4bd9-9da7-405eef272406 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Request method failure captured: Aug 27 03:05:54.307361 n-d-852278-4 devstack@n-api.service[134051]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 03:05:54.307361 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 03:05:54.307361 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 03:05:54.307361 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 03:05:54.307361 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 492 Aug 27 03:05:54.307361 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 03:05:54.307361 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 03:05:54.307361 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 03:05:54.307361 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 03:05:54.307361 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYnkbLTKVFjPQ5m3U2fG0N9Vjn4DkHnl17m4V7uHpwM3jvJACULLjB_xlJxNaWj4ki5CLI0R9EDG2yAGWVsjkvndQFsX9xXnPLGqFClIfHjZt1hqpj87tFD2RLalZegHNDkz7eKDMcWIs2wG0Lp8X-uNjMToWPkkmABfSYkxwHfHBds Aug 27 03:05:54.307361 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 03:05:54.307361 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 03:05:54.307361 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 03:05:54.307361 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 03:05:54.307361 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 03:05:54.307361 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 03:05:54.307361 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 3b9e672ac89e41ff82355daa83e852bd Aug 27 03:05:54.307361 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:05:54.307361 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 03:05:54.307361 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 03:05:54.307361 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3b9e672ac89e41ff82355daa83e852bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3b9e672ac89e41ff82355daa83e852bd", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3b9e672ac89e41ff82355daa83e852bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3b9e672ac89e41ff82355daa83e852bd"}]}] Aug 27 03:05:54.307361 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:05:54.307361 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 3b9e672ac89e41ff82355daa83e852bd Aug 27 03:05:54.307361 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:05:54.307361 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ServersNegativeTestJSON-1795266674-project Aug 27 03:05:54.307361 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 03:05:54.307361 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 03:05:54.307361 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 204c90820f6d4c64b31367aaf098325c Aug 27 03:05:54.307361 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ServersNegativeTestJSON-1795266674-project Aug 27 03:05:54.307361 n-d-852278-4 devstack@n-api.service[134051]: Aug 27 03:05:54.307361 n-d-852278-4 devstack@n-api.service[134051]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2062588011", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "7efdc19e-82eb-4610-897e-db10a92a0c7c"}]}} Aug 27 03:05:54.307361 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 03:05:54.307361 n-d-852278-4 devstack@n-api.service[134051]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 27 03:05:54.307361 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2062588011', 'imageRef': '1552acd0-176a-4c81-b680-29d74105e9d6', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '7efdc19e-82eb-4610-897e-db10a92a0c7c'}]}}} Aug 27 03:05:54.307361 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:05:54.307361 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:05:54.307361 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 03:05:54.307361 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 03:05:54.307361 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 03:05:54.307361 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise error Aug 27 03:05:54.307361 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 27 03:05:54.307361 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:05:54.307361 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Aug 27 03:05:54.307361 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Aug 27 03:05:54.307361 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:05:54.307361 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Aug 27 03:05:54.310908 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Aug 27 03:05:54.310908 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:05:54.310908 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:05:54.310908 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:05:54.310908 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:05:54.310908 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:05:54.310908 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:05:54.310908 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:05:54.310908 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:05:54.310908 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:05:54.310908 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:05:54.310908 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:05:54.310908 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:05:54.310908 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 03:05:54.310908 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 03:05:54.310908 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 03:05:54.310908 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 03:05:54.310908 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 03:05:54.310908 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 03:05:54.310908 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 27 03:05:54.310908 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:05:54.310908 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:05:54.310908 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:05:54.310908 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:05:54.310908 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:05:54.310908 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:05:54.310908 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 03:05:54.310908 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 03:05:54.310908 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 27 03:05:54.310908 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:05:54.310908 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-2f65b9b8-b0ba-4bd9-9da7-405eef272406 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:05:54.310908 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-2f65b9b8-b0ba-4bd9-9da7-405eef272406 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.019114 Aug 27 03:05:54.310908 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2340/4652] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 03:05:54 2022] POST /compute/v2.1/servers => generated 624 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:05:54.321741 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-47c7142e-621f-4fd2-b0c8-b77ef496f11d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:54.323155 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-47c7142e-621f-4fd2-b0c8-b77ef496f11d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:54.335645 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-47c7142e-621f-4fd2-b0c8-b77ef496f11d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:54.336127 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-47c7142e-621f-4fd2-b0c8-b77ef496f11d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:54.336576 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-47c7142e-621f-4fd2-b0c8-b77ef496f11d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:54.337654 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-47c7142e-621f-4fd2-b0c8-b77ef496f11d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:54.338527 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-47c7142e-621f-4fd2-b0c8-b77ef496f11d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:54.338941 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-47c7142e-621f-4fd2-b0c8-b77ef496f11d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:54.531753 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-47c7142e-621f-4fd2-b0c8-b77ef496f11d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:54.542301 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-47c7142e-621f-4fd2-b0c8-b77ef496f11d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1504 microversion: 2.1 time: 0.225126 Aug 27 03:05:54.543709 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2313/4653] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:54 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1504 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:54.565469 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4c8518e2-7935-46c3-ac7f-a3ee402d836c tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:54.566413 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-4c8518e2-7935-46c3-ac7f-a3ee402d836c tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:54.574768 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4c8518e2-7935-46c3-ac7f-a3ee402d836c tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:54.575572 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4c8518e2-7935-46c3-ac7f-a3ee402d836c tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:54.576209 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4c8518e2-7935-46c3-ac7f-a3ee402d836c tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:54.577216 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4c8518e2-7935-46c3-ac7f-a3ee402d836c tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:54.577904 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4c8518e2-7935-46c3-ac7f-a3ee402d836c tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:54.578385 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4c8518e2-7935-46c3-ac7f-a3ee402d836c tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:54.583843 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:05:54.718175 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-4c8518e2-7935-46c3-ac7f-a3ee402d836c tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:54.727105 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-4c8518e2-7935-46c3-ac7f-a3ee402d836c tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1504 microversion: 2.1 time: 0.166324 Aug 27 03:05:54.727675 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2341/4654] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:54 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1504 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:54.879434 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6a29e4cf-d39b-4520-a3ee-c9b2b1331017 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "networks": [{"uuid": "7efdc19e-82eb-4610-897e-db10a92a0c7c"}]}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:05:54.883362 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6a29e4cf-d39b-4520-a3ee-c9b2b1331017 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Request method failure captured: Aug 27 03:05:54.883362 n-d-852278-4 devstack@n-api.service[134052]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 03:05:54.883362 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 03:05:54.883362 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 03:05:54.883362 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 03:05:54.883362 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 416 Aug 27 03:05:54.883362 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 03:05:54.883362 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 03:05:54.883362 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 03:05:54.883362 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 03:05:54.883362 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYnkbLTKVFjPQ5m3U2fG0N9Vjn4DkHnl17m4V7uHpwM3jvJACULLjB_xlJxNaWj4ki5CLI0R9EDG2yAGWVsjkvndQFsX9xXnPLGqFClIfHjZt1hqpj87tFD2RLalZegHNDkz7eKDMcWIs2wG0Lp8X-uNjMToWPkkmABfSYkxwHfHBds Aug 27 03:05:54.883362 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 03:05:54.883362 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 03:05:54.883362 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 03:05:54.883362 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 03:05:54.883362 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 03:05:54.883362 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 03:05:54.883362 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 3b9e672ac89e41ff82355daa83e852bd Aug 27 03:05:54.883362 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:05:54.883362 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 03:05:54.883362 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 03:05:54.883362 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3b9e672ac89e41ff82355daa83e852bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3b9e672ac89e41ff82355daa83e852bd", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3b9e672ac89e41ff82355daa83e852bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3b9e672ac89e41ff82355daa83e852bd"}]}] Aug 27 03:05:54.883362 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:05:54.883362 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 3b9e672ac89e41ff82355daa83e852bd Aug 27 03:05:54.883362 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:05:54.883362 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ServersNegativeTestJSON-1795266674-project Aug 27 03:05:54.883362 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 03:05:54.883362 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 03:05:54.883362 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 204c90820f6d4c64b31367aaf098325c Aug 27 03:05:54.883362 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ServersNegativeTestJSON-1795266674-project Aug 27 03:05:54.883362 n-d-852278-4 devstack@n-api.service[134052]: Aug 27 03:05:54.883362 n-d-852278-4 devstack@n-api.service[134052]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "networks": [{"uuid": "7efdc19e-82eb-4610-897e-db10a92a0c7c"}]}} Aug 27 03:05:54.883362 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 03:05:54.883362 n-d-852278-4 devstack@n-api.service[134052]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 27 03:05:54.883362 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': '1552acd0-176a-4c81-b680-29d74105e9d6', 'flavorRef': '452', 'networks': [{'uuid': '7efdc19e-82eb-4610-897e-db10a92a0c7c'}]}}} Aug 27 03:05:54.883362 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:05:54.883362 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:05:54.883362 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 03:05:54.883362 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 03:05:54.883362 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 03:05:54.883362 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise error Aug 27 03:05:54.883362 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 27 03:05:54.883362 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:05:54.883362 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Aug 27 03:05:54.883362 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 27 03:05:54.883362 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:05:54.883362 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 27 03:05:54.883362 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 27 03:05:54.883362 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:05:54.883362 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:05:54.891225 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:05:54.891225 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:05:54.891225 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:05:54.891225 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:05:54.891225 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:05:54.891225 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:05:54.891225 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:05:54.891225 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:05:54.891225 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:05:54.891225 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:05:54.891225 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 03:05:54.891225 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 03:05:54.891225 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 03:05:54.891225 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 03:05:54.891225 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 03:05:54.891225 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 03:05:54.891225 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 27 03:05:54.891225 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:05:54.891225 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:05:54.891225 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:05:54.891225 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:05:54.891225 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:05:54.891225 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:05:54.891225 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 03:05:54.891225 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 03:05:54.891225 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 27 03:05:54.891225 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:05:54.891225 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6a29e4cf-d39b-4520-a3ee-c9b2b1331017 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:05:54.891225 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-6a29e4cf-d39b-4520-a3ee-c9b2b1331017 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.011279 Aug 27 03:05:54.891225 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2314/4655] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 03:05:54 2022] POST /compute/v2.1/servers => generated 619 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:05:54.895499 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c83e9c3e-10fa-423a-9d58-5ebf2ea921f8 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:54.895999 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-c83e9c3e-10fa-423a-9d58-5ebf2ea921f8 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:54.902527 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c83e9c3e-10fa-423a-9d58-5ebf2ea921f8 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:54.903041 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c83e9c3e-10fa-423a-9d58-5ebf2ea921f8 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:54.903477 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c83e9c3e-10fa-423a-9d58-5ebf2ea921f8 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:54.904170 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c83e9c3e-10fa-423a-9d58-5ebf2ea921f8 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:54.904730 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c83e9c3e-10fa-423a-9d58-5ebf2ea921f8 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:54.905404 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c83e9c3e-10fa-423a-9d58-5ebf2ea921f8 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:55.099759 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-c83e9c3e-10fa-423a-9d58-5ebf2ea921f8 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:55.103024 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4f50dcdc-8e51-4e02-8dbf-626233944de2 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:55.103626 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-4f50dcdc-8e51-4e02-8dbf-626233944de2 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: eeb71517-05bf-488e-98b1-04d8a140e079] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:55.110953 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c83e9c3e-10fa-423a-9d58-5ebf2ea921f8 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1504 microversion: 2.1 time: 0.219195 Aug 27 03:05:55.111811 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2342/4656] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:54 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1504 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:05:55.115286 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4f50dcdc-8e51-4e02-8dbf-626233944de2 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:55.115770 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4f50dcdc-8e51-4e02-8dbf-626233944de2 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:55.116196 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4f50dcdc-8e51-4e02-8dbf-626233944de2 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:55.116912 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4f50dcdc-8e51-4e02-8dbf-626233944de2 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:55.117349 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4f50dcdc-8e51-4e02-8dbf-626233944de2 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:55.123195 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4f50dcdc-8e51-4e02-8dbf-626233944de2 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:55.139787 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-33edc21f-a71d-428a-8a7c-f3465a59d58f tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:55.140233 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-33edc21f-a71d-428a-8a7c-f3465a59d58f tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:55.153938 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-33edc21f-a71d-428a-8a7c-f3465a59d58f tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:55.154433 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-33edc21f-a71d-428a-8a7c-f3465a59d58f tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:55.154871 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-33edc21f-a71d-428a-8a7c-f3465a59d58f tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:55.155644 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-33edc21f-a71d-428a-8a7c-f3465a59d58f tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:55.156096 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-33edc21f-a71d-428a-8a7c-f3465a59d58f tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:55.156550 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-33edc21f-a71d-428a-8a7c-f3465a59d58f tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:55.352571 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-4f50dcdc-8e51-4e02-8dbf-626233944de2 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:55.366544 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-4f50dcdc-8e51-4e02-8dbf-626233944de2 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/eeb71517-05bf-488e-98b1-04d8a140e079" status: 200 len: 1511 microversion: 2.1 time: 0.267157 Aug 27 03:05:55.367147 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2315/4657] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:55 2022] GET /compute/v2.1/servers/eeb71517-05bf-488e-98b1-04d8a140e079 => generated 1511 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:05:55.398714 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-33edc21f-a71d-428a-8a7c-f3465a59d58f tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:55.410708 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-33edc21f-a71d-428a-8a7c-f3465a59d58f tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1504 microversion: 2.1 time: 0.277225 Aug 27 03:05:55.412976 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2343/4658] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:55 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1504 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:55.561106 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5a5cf610-2b2b-4896-be45-f86230e6dbda tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-499629345", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": -1, "networks": [{"uuid": "7efdc19e-82eb-4610-897e-db10a92a0c7c"}]}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:05:55.589215 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-5a5cf610-2b2b-4896-be45-f86230e6dbda tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] HTTP exception thrown: Flavor -1 could not be found. Aug 27 03:05:55.592415 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5a5cf610-2b2b-4896-be45-f86230e6dbda tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Request method failure captured: Aug 27 03:05:55.592415 n-d-852278-4 devstack@n-api.service[134052]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 03:05:55.592415 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 03:05:55.592415 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 03:05:55.592415 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 03:05:55.592415 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 205 Aug 27 03:05:55.592415 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 03:05:55.592415 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 03:05:55.592415 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 03:05:55.592415 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 03:05:55.592415 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYnkbLTKVFjPQ5m3U2fG0N9Vjn4DkHnl17m4V7uHpwM3jvJACULLjB_xlJxNaWj4ki5CLI0R9EDG2yAGWVsjkvndQFsX9xXnPLGqFClIfHjZt1hqpj87tFD2RLalZegHNDkz7eKDMcWIs2wG0Lp8X-uNjMToWPkkmABfSYkxwHfHBds Aug 27 03:05:55.592415 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 03:05:55.592415 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 03:05:55.592415 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 03:05:55.592415 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 03:05:55.592415 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 03:05:55.592415 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 03:05:55.592415 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 3b9e672ac89e41ff82355daa83e852bd Aug 27 03:05:55.592415 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:05:55.592415 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 03:05:55.592415 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 03:05:55.592415 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3b9e672ac89e41ff82355daa83e852bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3b9e672ac89e41ff82355daa83e852bd", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3b9e672ac89e41ff82355daa83e852bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3b9e672ac89e41ff82355daa83e852bd"}]}] Aug 27 03:05:55.592415 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:05:55.592415 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 3b9e672ac89e41ff82355daa83e852bd Aug 27 03:05:55.592415 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:05:55.592415 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ServersNegativeTestJSON-1795266674-project Aug 27 03:05:55.592415 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 03:05:55.592415 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 03:05:55.592415 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 204c90820f6d4c64b31367aaf098325c Aug 27 03:05:55.592415 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ServersNegativeTestJSON-1795266674-project Aug 27 03:05:55.592415 n-d-852278-4 devstack@n-api.service[134052]: Aug 27 03:05:55.592415 n-d-852278-4 devstack@n-api.service[134052]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-499629345", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": -1, "networks": [{"uuid": "7efdc19e-82eb-4610-897e-db10a92a0c7c"}]}} Aug 27 03:05:55.592415 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 03:05:55.592415 n-d-852278-4 devstack@n-api.service[134052]: exception: Flavor -1 could not be found. Aug 27 03:05:55.592415 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-499629345', 'imageRef': '1552acd0-176a-4c81-b680-29d74105e9d6', 'flavorRef': -1, 'networks': [{'uuid': '7efdc19e-82eb-4610-897e-db10a92a0c7c'}]}}} Aug 27 03:05:55.592415 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:05:55.592415 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:05:55.592415 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Aug 27 03:05:55.592415 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Aug 27 03:05:55.592415 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 27 03:05:55.592415 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 27 03:05:55.592415 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 03:05:55.592415 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 03:05:55.592415 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 27 03:05:55.592415 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 27 03:05:55.592415 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 27 03:05:55.592415 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:05:55.592415 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 27 03:05:55.592415 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 27 03:05:55.592415 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Aug 27 03:05:55.592415 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:05:55.592415 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:05:55.592415 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:05:55.592415 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:05:55.592415 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:05:55.592415 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:05:55.592415 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:05:55.592415 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:05:55.592415 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:05:55.592415 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:05:55.592415 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:05:55.592415 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:05:55.597479 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:05:55.597479 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:05:55.597479 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:05:55.597479 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:05:55.597479 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 27 03:05:55.597479 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 27 03:05:55.597479 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 27 03:05:55.597479 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Aug 27 03:05:55.597479 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:05:55.597479 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:05:55.597479 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:05:55.597479 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:05:55.597479 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:05:55.597479 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:05:55.597479 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:05:55.597479 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:05:55.597479 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Aug 27 03:05:55.597479 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:05:55.605508 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5a5cf610-2b2b-4896-be45-f86230e6dbda tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:05:55.606890 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-5a5cf610-2b2b-4896-be45-f86230e6dbda tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.054331 Aug 27 03:05:55.611253 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2316/4659] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 03:05:55 2022] POST /compute/v2.1/servers => generated 73 bytes in 59 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 27 03:05:55.616370 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-eb6cac10-0816-42b9-b033-edb422211f22 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:55.617041 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-eb6cac10-0816-42b9-b033-edb422211f22 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:55.623894 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eb6cac10-0816-42b9-b033-edb422211f22 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:55.624718 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eb6cac10-0816-42b9-b033-edb422211f22 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:55.625313 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eb6cac10-0816-42b9-b033-edb422211f22 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:55.626177 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eb6cac10-0816-42b9-b033-edb422211f22 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:55.626871 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eb6cac10-0816-42b9-b033-edb422211f22 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:55.627472 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eb6cac10-0816-42b9-b033-edb422211f22 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:55.781296 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-eb6cac10-0816-42b9-b033-edb422211f22 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:55.789476 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-eb6cac10-0816-42b9-b033-edb422211f22 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1504 microversion: 2.1 time: 0.177304 Aug 27 03:05:55.800336 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2344/4660] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:55 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1504 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:55.811969 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f02a3999-0694-4d3e-a0cc-4bc4ba4c3d4d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:55.812956 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-f02a3999-0694-4d3e-a0cc-4bc4ba4c3d4d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:55.820289 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f02a3999-0694-4d3e-a0cc-4bc4ba4c3d4d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:55.821373 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f02a3999-0694-4d3e-a0cc-4bc4ba4c3d4d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:55.822297 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f02a3999-0694-4d3e-a0cc-4bc4ba4c3d4d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:55.823245 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f02a3999-0694-4d3e-a0cc-4bc4ba4c3d4d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:55.823914 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f02a3999-0694-4d3e-a0cc-4bc4ba4c3d4d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:55.824586 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f02a3999-0694-4d3e-a0cc-4bc4ba4c3d4d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:55.977061 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-f02a3999-0694-4d3e-a0cc-4bc4ba4c3d4d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:55.998162 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f02a3999-0694-4d3e-a0cc-4bc4ba4c3d4d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1504 microversion: 2.1 time: 0.190165 Aug 27 03:05:55.999341 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2317/4661] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:55 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1504 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:56.070323 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b0a6d6c3-dd26-4543-8b12-641ebcaa7499 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-239106389", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "7efdc19e-82eb-4610-897e-db10a92a0c7c"}]}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:05:56.075696 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b0a6d6c3-dd26-4543-8b12-641ebcaa7499 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Request method failure captured: Aug 27 03:05:56.075696 n-d-852278-4 devstack@n-api.service[134051]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 03:05:56.075696 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 03:05:56.075696 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 03:05:56.075696 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 03:05:56.075696 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 172 Aug 27 03:05:56.075696 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 03:05:56.075696 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 03:05:56.075696 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 03:05:56.075696 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 03:05:56.075696 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYnkbLTKVFjPQ5m3U2fG0N9Vjn4DkHnl17m4V7uHpwM3jvJACULLjB_xlJxNaWj4ki5CLI0R9EDG2yAGWVsjkvndQFsX9xXnPLGqFClIfHjZt1hqpj87tFD2RLalZegHNDkz7eKDMcWIs2wG0Lp8X-uNjMToWPkkmABfSYkxwHfHBds Aug 27 03:05:56.075696 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 03:05:56.075696 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 03:05:56.075696 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 03:05:56.075696 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 03:05:56.075696 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 03:05:56.075696 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 03:05:56.075696 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 3b9e672ac89e41ff82355daa83e852bd Aug 27 03:05:56.075696 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:05:56.075696 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 03:05:56.075696 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 03:05:56.075696 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3b9e672ac89e41ff82355daa83e852bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3b9e672ac89e41ff82355daa83e852bd", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3b9e672ac89e41ff82355daa83e852bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3b9e672ac89e41ff82355daa83e852bd"}]}] Aug 27 03:05:56.075696 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:05:56.075696 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 3b9e672ac89e41ff82355daa83e852bd Aug 27 03:05:56.075696 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:05:56.075696 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ServersNegativeTestJSON-1795266674-project Aug 27 03:05:56.075696 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 03:05:56.075696 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 03:05:56.075696 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 204c90820f6d4c64b31367aaf098325c Aug 27 03:05:56.075696 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ServersNegativeTestJSON-1795266674-project Aug 27 03:05:56.075696 n-d-852278-4 devstack@n-api.service[134051]: Aug 27 03:05:56.075696 n-d-852278-4 devstack@n-api.service[134051]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-239106389", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "7efdc19e-82eb-4610-897e-db10a92a0c7c"}]}} Aug 27 03:05:56.075696 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 03:05:56.075696 n-d-852278-4 devstack@n-api.service[134051]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Aug 27 03:05:56.075696 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-239106389', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '7efdc19e-82eb-4610-897e-db10a92a0c7c'}]}}} Aug 27 03:05:56.075696 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:05:56.075696 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:05:56.075696 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 03:05:56.075696 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 03:05:56.075696 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 03:05:56.075696 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise error Aug 27 03:05:56.075696 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Aug 27 03:05:56.075696 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:05:56.075696 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Aug 27 03:05:56.075696 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Aug 27 03:05:56.075696 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Aug 27 03:05:56.075696 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:05:56.075696 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 27 03:05:56.075696 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi -1 Aug 27 03:05:56.075696 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:05:56.075696 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:05:56.075696 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:05:56.075696 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:05:56.075696 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:05:56.075696 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:05:56.075696 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:05:56.075696 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:05:56.075696 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:05:56.075696 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:05:56.075696 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:05:56.075696 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:05:56.075696 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 03:05:56.075696 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 03:05:56.075696 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 03:05:56.081361 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 03:05:56.081361 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 03:05:56.081361 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 03:05:56.081361 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Aug 27 03:05:56.081361 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:05:56.081361 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:05:56.081361 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:05:56.081361 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:05:56.081361 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:05:56.081361 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:05:56.081361 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 03:05:56.081361 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 03:05:56.081361 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Aug 27 03:05:56.081361 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:05:56.084222 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b0a6d6c3-dd26-4543-8b12-641ebcaa7499 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:05:56.085313 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b0a6d6c3-dd26-4543-8b12-641ebcaa7499 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.019745 Aug 27 03:05:56.086148 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2345/4662] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 03:05:56 2022] POST /compute/v2.1/servers => generated 145 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:05:56.095564 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d3eba732-eaa2-44b5-9b7c-db0297bcc1bf tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:56.096474 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d3eba732-eaa2-44b5-9b7c-db0297bcc1bf tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:56.105910 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d3eba732-eaa2-44b5-9b7c-db0297bcc1bf tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:56.106403 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d3eba732-eaa2-44b5-9b7c-db0297bcc1bf tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:56.106839 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d3eba732-eaa2-44b5-9b7c-db0297bcc1bf tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:56.107615 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d3eba732-eaa2-44b5-9b7c-db0297bcc1bf tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:56.108060 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d3eba732-eaa2-44b5-9b7c-db0297bcc1bf tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:56.108624 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d3eba732-eaa2-44b5-9b7c-db0297bcc1bf tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:56.388636 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d30a28ef-c0f0-405f-abd7-3c7bf806c758 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:56.389584 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d30a28ef-c0f0-405f-abd7-3c7bf806c758 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: eeb71517-05bf-488e-98b1-04d8a140e079] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:56.400238 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d30a28ef-c0f0-405f-abd7-3c7bf806c758 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:56.400764 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d30a28ef-c0f0-405f-abd7-3c7bf806c758 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:56.401198 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d30a28ef-c0f0-405f-abd7-3c7bf806c758 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:56.401927 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d30a28ef-c0f0-405f-abd7-3c7bf806c758 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:56.402409 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d30a28ef-c0f0-405f-abd7-3c7bf806c758 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:56.402831 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d30a28ef-c0f0-405f-abd7-3c7bf806c758 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:56.816973 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d30a28ef-c0f0-405f-abd7-3c7bf806c758 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:56.828093 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d30a28ef-c0f0-405f-abd7-3c7bf806c758 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/eeb71517-05bf-488e-98b1-04d8a140e079" status: 200 len: 1511 microversion: 2.1 time: 0.443136 Aug 27 03:05:56.830089 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2346/4663] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:56 2022] GET /compute/v2.1/servers/eeb71517-05bf-488e-98b1-04d8a140e079 => generated 1511 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:05:56.842252 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-d3eba732-eaa2-44b5-9b7c-db0297bcc1bf tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:56.853984 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d3eba732-eaa2-44b5-9b7c-db0297bcc1bf tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1504 microversion: 2.1 time: 0.760512 Aug 27 03:05:56.855154 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2318/4664] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:56 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1504 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:56.877802 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-948d9016-f768-460f-a49a-dabb3fae30ca tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:56.878537 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-948d9016-f768-460f-a49a-dabb3fae30ca tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:56.885987 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-948d9016-f768-460f-a49a-dabb3fae30ca tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:56.887264 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-948d9016-f768-460f-a49a-dabb3fae30ca tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:56.887776 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-948d9016-f768-460f-a49a-dabb3fae30ca tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:56.888575 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-948d9016-f768-460f-a49a-dabb3fae30ca tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:56.889203 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-948d9016-f768-460f-a49a-dabb3fae30ca tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:56.889691 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-948d9016-f768-460f-a49a-dabb3fae30ca tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:57.071918 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-948d9016-f768-460f-a49a-dabb3fae30ca tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:57.079813 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-948d9016-f768-460f-a49a-dabb3fae30ca tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1504 microversion: 2.1 time: 0.206532 Aug 27 03:05:57.080403 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2347/4665] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:56 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1504 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:57.140460 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-cf90d12c-cd8c-4c40-9dd4-f38f9033d9ed tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-100611424", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:05:57.145960 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-cf90d12c-cd8c-4c40-9dd4-f38f9033d9ed tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 27 03:05:57.147785 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-cf90d12c-cd8c-4c40-9dd4-f38f9033d9ed tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Request method failure captured: Aug 27 03:05:57.147785 n-d-852278-4 devstack@n-api.service[134052]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 03:05:57.147785 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 03:05:57.147785 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 03:05:57.147785 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 03:05:57.147785 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 215 Aug 27 03:05:57.147785 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 03:05:57.147785 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 03:05:57.147785 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 03:05:57.147785 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 03:05:57.147785 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYnkbLTKVFjPQ5m3U2fG0N9Vjn4DkHnl17m4V7uHpwM3jvJACULLjB_xlJxNaWj4ki5CLI0R9EDG2yAGWVsjkvndQFsX9xXnPLGqFClIfHjZt1hqpj87tFD2RLalZegHNDkz7eKDMcWIs2wG0Lp8X-uNjMToWPkkmABfSYkxwHfHBds Aug 27 03:05:57.147785 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 03:05:57.147785 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 03:05:57.147785 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 03:05:57.147785 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 03:05:57.147785 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 03:05:57.147785 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 03:05:57.147785 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 3b9e672ac89e41ff82355daa83e852bd Aug 27 03:05:57.147785 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:05:57.147785 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 03:05:57.147785 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 03:05:57.147785 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3b9e672ac89e41ff82355daa83e852bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3b9e672ac89e41ff82355daa83e852bd", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3b9e672ac89e41ff82355daa83e852bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3b9e672ac89e41ff82355daa83e852bd"}]}] Aug 27 03:05:57.147785 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:05:57.147785 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 3b9e672ac89e41ff82355daa83e852bd Aug 27 03:05:57.147785 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:05:57.147785 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ServersNegativeTestJSON-1795266674-project Aug 27 03:05:57.147785 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 03:05:57.147785 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 03:05:57.147785 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 204c90820f6d4c64b31367aaf098325c Aug 27 03:05:57.147785 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ServersNegativeTestJSON-1795266674-project Aug 27 03:05:57.147785 n-d-852278-4 devstack@n-api.service[134052]: Aug 27 03:05:57.147785 n-d-852278-4 devstack@n-api.service[134052]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-100611424", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Aug 27 03:05:57.147785 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 03:05:57.147785 n-d-852278-4 devstack@n-api.service[134052]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 27 03:05:57.147785 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-100611424', 'imageRef': '1552acd0-176a-4c81-b680-29d74105e9d6', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Aug 27 03:05:57.147785 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:05:57.147785 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:05:57.147785 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:05:57.147785 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:05:57.147785 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:05:57.147785 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:05:57.147785 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:05:57.147785 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:05:57.147785 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:05:57.147785 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:05:57.147785 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:05:57.147785 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:05:57.147785 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:05:57.147785 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:05:57.147785 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 27 03:05:57.147785 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Aug 27 03:05:57.147785 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Aug 27 03:05:57.147785 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Aug 27 03:05:57.147785 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Aug 27 03:05:57.147785 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Aug 27 03:05:57.147785 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self._validate_network_id( Aug 27 03:05:57.147785 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Aug 27 03:05:57.147785 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 27 03:05:57.147785 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 27 03:05:57.147785 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:05:57.147785 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:05:57.154245 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:05:57.154245 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:05:57.154245 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:05:57.154245 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:05:57.154245 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:05:57.154245 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:05:57.154245 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 27 03:05:57.154245 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:05:57.154245 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-cf90d12c-cd8c-4c40-9dd4-f38f9033d9ed tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:05:57.154245 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-cf90d12c-cd8c-4c40-9dd4-f38f9033d9ed tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.012603 Aug 27 03:05:57.154245 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2319/4666] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 03:05:57 2022] POST /compute/v2.1/servers => generated 123 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:05:57.157989 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-52244f6a-d70b-4772-9119-7b5fd5c6cb40 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:57.158614 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-52244f6a-d70b-4772-9119-7b5fd5c6cb40 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:57.165065 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-52244f6a-d70b-4772-9119-7b5fd5c6cb40 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:57.165549 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-52244f6a-d70b-4772-9119-7b5fd5c6cb40 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:57.165995 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-52244f6a-d70b-4772-9119-7b5fd5c6cb40 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:57.167103 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-52244f6a-d70b-4772-9119-7b5fd5c6cb40 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:57.168104 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-52244f6a-d70b-4772-9119-7b5fd5c6cb40 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:57.168620 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-52244f6a-d70b-4772-9119-7b5fd5c6cb40 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:57.322606 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-52244f6a-d70b-4772-9119-7b5fd5c6cb40 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:57.332420 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-52244f6a-d70b-4772-9119-7b5fd5c6cb40 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1504 microversion: 2.1 time: 0.178077 Aug 27 03:05:57.333708 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2348/4667] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:57 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1504 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:57.354808 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-fffc96e2-d8f1-4016-bd5e-00aed156e2d2 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:57.355687 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-fffc96e2-d8f1-4016-bd5e-00aed156e2d2 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:57.363483 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fffc96e2-d8f1-4016-bd5e-00aed156e2d2 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:57.363972 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fffc96e2-d8f1-4016-bd5e-00aed156e2d2 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:57.364462 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fffc96e2-d8f1-4016-bd5e-00aed156e2d2 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:57.365377 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fffc96e2-d8f1-4016-bd5e-00aed156e2d2 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:57.365898 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fffc96e2-d8f1-4016-bd5e-00aed156e2d2 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:57.366309 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fffc96e2-d8f1-4016-bd5e-00aed156e2d2 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:57.559230 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-fffc96e2-d8f1-4016-bd5e-00aed156e2d2 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:57.567990 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-fffc96e2-d8f1-4016-bd5e-00aed156e2d2 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1504 microversion: 2.1 time: 0.217226 Aug 27 03:05:57.568676 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2320/4668] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:57 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1504 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:57.651538 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-47fcad76-4aa3-45c7-aa94-a101d2af3d8a tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1024598806", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "key_name": "tempest-key-1076534990", "networks": [{"uuid": "7efdc19e-82eb-4610-897e-db10a92a0c7c"}]}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:05:57.759258 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.network.neutron [None req-47fcad76-4aa3-45c7-aa94-a101d2af3d8a tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] validate_networks() for [('7efdc19e-82eb-4610-897e-db10a92a0c7c', None, None, None, None, None)] {{(pid=134051) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:05:57.853708 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c17f2b0d-2413-46e1-bd31-5a0d0e6e6281 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:57.854489 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-c17f2b0d-2413-46e1-bd31-5a0d0e6e6281 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: eeb71517-05bf-488e-98b1-04d8a140e079] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:57.864356 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c17f2b0d-2413-46e1-bd31-5a0d0e6e6281 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:57.864858 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c17f2b0d-2413-46e1-bd31-5a0d0e6e6281 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:57.865344 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c17f2b0d-2413-46e1-bd31-5a0d0e6e6281 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:57.867432 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c17f2b0d-2413-46e1-bd31-5a0d0e6e6281 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:57.867933 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c17f2b0d-2413-46e1-bd31-5a0d0e6e6281 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:57.868504 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c17f2b0d-2413-46e1-bd31-5a0d0e6e6281 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:58.134565 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-47fcad76-4aa3-45c7-aa94-a101d2af3d8a tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] HTTP exception thrown: Invalid key_name provided. Aug 27 03:05:58.137813 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-47fcad76-4aa3-45c7-aa94-a101d2af3d8a tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Request method failure captured: Aug 27 03:05:58.137813 n-d-852278-4 devstack@n-api.service[134051]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 03:05:58.137813 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 03:05:58.137813 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 03:05:58.137813 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 03:05:58.137813 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 247 Aug 27 03:05:58.137813 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 03:05:58.137813 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 03:05:58.137813 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 03:05:58.137813 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 03:05:58.137813 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYnkbLTKVFjPQ5m3U2fG0N9Vjn4DkHnl17m4V7uHpwM3jvJACULLjB_xlJxNaWj4ki5CLI0R9EDG2yAGWVsjkvndQFsX9xXnPLGqFClIfHjZt1hqpj87tFD2RLalZegHNDkz7eKDMcWIs2wG0Lp8X-uNjMToWPkkmABfSYkxwHfHBds Aug 27 03:05:58.137813 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 03:05:58.137813 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 03:05:58.137813 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 03:05:58.137813 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 03:05:58.137813 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 03:05:58.137813 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 03:05:58.137813 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 3b9e672ac89e41ff82355daa83e852bd Aug 27 03:05:58.137813 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:05:58.137813 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 03:05:58.137813 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 03:05:58.137813 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3b9e672ac89e41ff82355daa83e852bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3b9e672ac89e41ff82355daa83e852bd", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3b9e672ac89e41ff82355daa83e852bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3b9e672ac89e41ff82355daa83e852bd"}]}] Aug 27 03:05:58.137813 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:05:58.137813 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 3b9e672ac89e41ff82355daa83e852bd Aug 27 03:05:58.137813 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:05:58.137813 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ServersNegativeTestJSON-1795266674-project Aug 27 03:05:58.137813 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 03:05:58.137813 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 03:05:58.137813 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 204c90820f6d4c64b31367aaf098325c Aug 27 03:05:58.137813 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ServersNegativeTestJSON-1795266674-project Aug 27 03:05:58.137813 n-d-852278-4 devstack@n-api.service[134051]: Aug 27 03:05:58.137813 n-d-852278-4 devstack@n-api.service[134051]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1024598806", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "key_name": "tempest-key-1076534990", "networks": [{"uuid": "7efdc19e-82eb-4610-897e-db10a92a0c7c"}]}} Aug 27 03:05:58.137813 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 03:05:58.137813 n-d-852278-4 devstack@n-api.service[134051]: exception: Invalid key_name provided. Aug 27 03:05:58.137813 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1024598806', 'imageRef': '1552acd0-176a-4c81-b680-29d74105e9d6', 'flavorRef': '452', 'key_name': 'tempest-key-1076534990', 'networks': [{'uuid': '7efdc19e-82eb-4610-897e-db10a92a0c7c'}]}}} Aug 27 03:05:58.137813 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:05:58.137813 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:05:58.137813 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 27 03:05:58.137813 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 27 03:05:58.137813 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 27 03:05:58.137813 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 27 03:05:58.137813 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Aug 27 03:05:58.137813 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 27 03:05:58.137813 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1089, in _validate_and_build_base_options Aug 27 03:05:58.137813 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Aug 27 03:05:58.137813 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 03:05:58.137813 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 03:05:58.137813 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Aug 27 03:05:58.137813 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Aug 27 03:05:58.137813 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Aug 27 03:05:58.137813 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Aug 27 03:05:58.137813 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 03:05:58.137813 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 03:05:58.137813 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Aug 27 03:05:58.137813 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Aug 27 03:05:58.137813 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-1076534990 not found for user 204c90820f6d4c64b31367aaf098325c Aug 27 03:05:58.137813 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:05:58.137813 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:05:58.137813 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:05:58.137813 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:05:58.137813 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:05:58.143269 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:05:58.143269 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:05:58.143269 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:05:58.143269 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:05:58.143269 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:05:58.143269 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:05:58.143269 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:05:58.143269 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:05:58.143269 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:05:58.143269 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:05:58.143269 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:05:58.143269 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 27 03:05:58.143269 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Aug 27 03:05:58.143269 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 27 03:05:58.143269 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Aug 27 03:05:58.143269 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:05:58.143269 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:05:58.143269 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:05:58.143269 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:05:58.143269 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:05:58.143269 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:05:58.143269 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:05:58.143269 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:05:58.143269 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Aug 27 03:05:58.143269 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:05:58.143269 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-47fcad76-4aa3-45c7-aa94-a101d2af3d8a tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Returning 400 to user: Invalid key_name provided. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:05:58.143269 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-47fcad76-4aa3-45c7-aa94-a101d2af3d8a tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.494859 Aug 27 03:05:58.148934 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2349/4669] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 03:05:57 2022] POST /compute/v2.1/servers => generated 70 bytes in 498 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 27 03:05:58.155178 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a492158c-9b45-434f-ae0d-ac7cc4cf52cb tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:58.156177 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-a492158c-9b45-434f-ae0d-ac7cc4cf52cb tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:58.173445 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a492158c-9b45-434f-ae0d-ac7cc4cf52cb tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:58.173933 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a492158c-9b45-434f-ae0d-ac7cc4cf52cb tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:58.174440 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a492158c-9b45-434f-ae0d-ac7cc4cf52cb tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:58.175360 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a492158c-9b45-434f-ae0d-ac7cc4cf52cb tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:58.175917 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a492158c-9b45-434f-ae0d-ac7cc4cf52cb tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:58.177840 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a492158c-9b45-434f-ae0d-ac7cc4cf52cb tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:58.195711 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-c17f2b0d-2413-46e1-bd31-5a0d0e6e6281 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:58.204740 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c17f2b0d-2413-46e1-bd31-5a0d0e6e6281 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/eeb71517-05bf-488e-98b1-04d8a140e079" status: 200 len: 1511 microversion: 2.1 time: 0.358030 Aug 27 03:05:58.218539 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2321/4670] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:57 2022] GET /compute/v2.1/servers/eeb71517-05bf-488e-98b1-04d8a140e079 => generated 1511 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:05:58.354616 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-a492158c-9b45-434f-ae0d-ac7cc4cf52cb tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:58.363851 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a492158c-9b45-434f-ae0d-ac7cc4cf52cb tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1504 microversion: 2.1 time: 0.214183 Aug 27 03:05:58.364477 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2350/4671] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:58 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1504 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:05:58.384682 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-682eff65-93c9-432c-80c5-298a3c2dea19 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:58.385271 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-682eff65-93c9-432c-80c5-298a3c2dea19 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:58.393401 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-682eff65-93c9-432c-80c5-298a3c2dea19 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:58.393882 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-682eff65-93c9-432c-80c5-298a3c2dea19 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:58.394310 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-682eff65-93c9-432c-80c5-298a3c2dea19 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:58.395001 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-682eff65-93c9-432c-80c5-298a3c2dea19 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:58.395441 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-682eff65-93c9-432c-80c5-298a3c2dea19 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:58.395860 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-682eff65-93c9-432c-80c5-298a3c2dea19 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:58.583002 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-682eff65-93c9-432c-80c5-298a3c2dea19 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:58.595933 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-682eff65-93c9-432c-80c5-298a3c2dea19 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1504 microversion: 2.1 time: 0.214723 Aug 27 03:05:58.596827 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2322/4672] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:58 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1504 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:58.656098 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-13c931af-5964-4432-8277-5eae947b0a42 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-342868808", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "7efdc19e-82eb-4610-897e-db10a92a0c7c"}]}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:05:58.766116 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.network.security_group_api [None req-13c931af-5964-4432-8277-5eae947b0a42 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Neutron security group does_not_exist not found {{(pid=134051) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Aug 27 03:05:58.766948 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-13c931af-5964-4432-8277-5eae947b0a42 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Aug 27 03:05:58.776545 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-13c931af-5964-4432-8277-5eae947b0a42 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Request method failure captured: Aug 27 03:05:58.776545 n-d-852278-4 devstack@n-api.service[134051]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 03:05:58.776545 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 03:05:58.776545 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 03:05:58.776545 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 03:05:58.776545 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 257 Aug 27 03:05:58.776545 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 03:05:58.776545 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 03:05:58.776545 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 03:05:58.776545 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 03:05:58.776545 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYnkbLTKVFjPQ5m3U2fG0N9Vjn4DkHnl17m4V7uHpwM3jvJACULLjB_xlJxNaWj4ki5CLI0R9EDG2yAGWVsjkvndQFsX9xXnPLGqFClIfHjZt1hqpj87tFD2RLalZegHNDkz7eKDMcWIs2wG0Lp8X-uNjMToWPkkmABfSYkxwHfHBds Aug 27 03:05:58.776545 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 03:05:58.776545 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 03:05:58.776545 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 03:05:58.776545 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 03:05:58.776545 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 03:05:58.776545 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 03:05:58.776545 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 3b9e672ac89e41ff82355daa83e852bd Aug 27 03:05:58.776545 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:05:58.776545 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 03:05:58.776545 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 03:05:58.776545 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3b9e672ac89e41ff82355daa83e852bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3b9e672ac89e41ff82355daa83e852bd", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3b9e672ac89e41ff82355daa83e852bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3b9e672ac89e41ff82355daa83e852bd"}]}] Aug 27 03:05:58.776545 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:05:58.776545 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 3b9e672ac89e41ff82355daa83e852bd Aug 27 03:05:58.776545 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:05:58.776545 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ServersNegativeTestJSON-1795266674-project Aug 27 03:05:58.776545 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 03:05:58.776545 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 03:05:58.776545 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 204c90820f6d4c64b31367aaf098325c Aug 27 03:05:58.776545 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ServersNegativeTestJSON-1795266674-project Aug 27 03:05:58.776545 n-d-852278-4 devstack@n-api.service[134051]: Aug 27 03:05:58.776545 n-d-852278-4 devstack@n-api.service[134051]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-342868808", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "7efdc19e-82eb-4610-897e-db10a92a0c7c"}]}} Aug 27 03:05:58.776545 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 03:05:58.776545 n-d-852278-4 devstack@n-api.service[134051]: exception: Unable to find security_group with name or id 'does_not_exist' Aug 27 03:05:58.776545 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-342868808', 'imageRef': '1552acd0-176a-4c81-b680-29d74105e9d6', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '7efdc19e-82eb-4610-897e-db10a92a0c7c'}]}}} Aug 27 03:05:58.776545 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:05:58.776545 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:05:58.776545 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Aug 27 03:05:58.776545 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Aug 27 03:05:58.776545 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:05:58.776545 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:05:58.776545 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Aug 27 03:05:58.776545 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Aug 27 03:05:58.776545 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Aug 27 03:05:58.776545 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:05:58.776545 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:05:58.776545 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:05:58.776545 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:05:58.776545 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Aug 27 03:05:58.776545 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Aug 27 03:05:58.776545 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:05:58.776545 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:05:58.776545 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Aug 27 03:05:58.776545 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Aug 27 03:05:58.776545 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Aug 27 03:05:58.776545 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:05:58.776545 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:05:58.776545 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:05:58.776545 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:05:58.776545 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Aug 27 03:05:58.776545 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Aug 27 03:05:58.784809 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Aug 27 03:05:58.784809 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Aug 27 03:05:58.784809 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Aug 27 03:05:58.784809 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Aug 27 03:05:58.784809 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:05:58.784809 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:05:58.784809 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Aug 27 03:05:58.784809 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Aug 27 03:05:58.784809 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Aug 27 03:05:58.784809 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:05:58.784809 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:05:58.784809 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:05:58.784809 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:05:58.784809 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 27 03:05:58.784809 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 27 03:05:58.784809 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 27 03:05:58.784809 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 27 03:05:58.784809 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Aug 27 03:05:58.784809 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 27 03:05:58.784809 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Aug 27 03:05:58.784809 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Aug 27 03:05:58.784809 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Aug 27 03:05:58.784809 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Aug 27 03:05:58.784809 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Aug 27 03:05:58.784809 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 27 03:05:58.784809 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Aug 27 03:05:58.784809 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:05:58.784809 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:05:58.784809 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:05:58.784809 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:05:58.784809 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:05:58.784809 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:05:58.784809 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:05:58.784809 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:05:58.784809 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:05:58.784809 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:05:58.784809 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:05:58.784809 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:05:58.784809 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:05:58.784809 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:05:58.784809 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:05:58.784809 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:05:58.784809 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 27 03:05:58.784809 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 27 03:05:58.784809 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 27 03:05:58.784809 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Aug 27 03:05:58.784809 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:05:58.784809 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:05:58.784809 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:05:58.784809 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:05:58.784809 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:05:58.784809 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:05:58.784809 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:05:58.784809 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:05:58.784809 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Aug 27 03:05:58.784809 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:05:58.784809 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-13c931af-5964-4432-8277-5eae947b0a42 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:05:58.795300 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-13c931af-5964-4432-8277-5eae947b0a42 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.126251 Aug 27 03:05:58.795300 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2351/4673] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 03:05:58 2022] POST /compute/v2.1/servers => generated 106 bytes in 127 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:05:58.800728 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-fdc842c5-09de-4099-9d03-528bdbca92f9 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:58.801645 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-fdc842c5-09de-4099-9d03-528bdbca92f9 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:58.809401 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fdc842c5-09de-4099-9d03-528bdbca92f9 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:58.810905 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fdc842c5-09de-4099-9d03-528bdbca92f9 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:58.811650 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fdc842c5-09de-4099-9d03-528bdbca92f9 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:58.812916 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fdc842c5-09de-4099-9d03-528bdbca92f9 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:58.813909 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fdc842c5-09de-4099-9d03-528bdbca92f9 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:58.814619 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fdc842c5-09de-4099-9d03-528bdbca92f9 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:59.016916 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-fdc842c5-09de-4099-9d03-528bdbca92f9 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:59.030411 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-fdc842c5-09de-4099-9d03-528bdbca92f9 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1504 microversion: 2.1 time: 0.235786 Aug 27 03:05:59.031135 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2323/4674] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:58 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1504 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:59.054072 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e1575daf-911f-4eb2-aa79-5a9759858833 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:59.054072 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-e1575daf-911f-4eb2-aa79-5a9759858833 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:59.061269 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e1575daf-911f-4eb2-aa79-5a9759858833 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:59.062007 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e1575daf-911f-4eb2-aa79-5a9759858833 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:59.062461 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e1575daf-911f-4eb2-aa79-5a9759858833 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:59.063592 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e1575daf-911f-4eb2-aa79-5a9759858833 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:59.064054 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e1575daf-911f-4eb2-aa79-5a9759858833 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:59.064519 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e1575daf-911f-4eb2-aa79-5a9759858833 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:59.226588 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-bc4cf43e-5072-4e11-ac46-805f169123fb tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:59.227993 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-bc4cf43e-5072-4e11-ac46-805f169123fb tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: eeb71517-05bf-488e-98b1-04d8a140e079] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:59.237907 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bc4cf43e-5072-4e11-ac46-805f169123fb tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:59.239761 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bc4cf43e-5072-4e11-ac46-805f169123fb tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:59.240641 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bc4cf43e-5072-4e11-ac46-805f169123fb tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:59.241877 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bc4cf43e-5072-4e11-ac46-805f169123fb tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:59.242936 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bc4cf43e-5072-4e11-ac46-805f169123fb tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:59.243463 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bc4cf43e-5072-4e11-ac46-805f169123fb tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:59.257225 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e1575daf-911f-4eb2-aa79-5a9759858833 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:59.268550 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e1575daf-911f-4eb2-aa79-5a9759858833 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1504 microversion: 2.1 time: 0.220607 Aug 27 03:05:59.269253 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2352/4675] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:59 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1504 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:59.289565 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-1685d747-c395-424a-b843-49a6263dd02d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:59.290439 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-1685d747-c395-424a-b843-49a6263dd02d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: f740d97a-07bc-40d5-b8da-d094caf575a8] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:59.296944 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-1685d747-c395-424a-b843-49a6263dd02d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] HTTP exception thrown: Instance f740d97a-07bc-40d5-b8da-d094caf575a8 could not be found. Aug 27 03:05:59.298935 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-1685d747-c395-424a-b843-49a6263dd02d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Request method failure captured: Aug 27 03:05:59.298935 n-d-852278-4 devstack@n-api.service[134051]: request: DELETE /compute/v2.1/servers/f740d97a-07bc-40d5-b8da-d094caf575a8 HTTP/1.1 Aug 27 03:05:59.298935 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 03:05:59.298935 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 03:05:59.298935 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 03:05:59.298935 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 03:05:59.298935 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 03:05:59.298935 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 03:05:59.298935 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 03:05:59.298935 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 03:05:59.298935 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYnkbLTKVFjPQ5m3U2fG0N9Vjn4DkHnl17m4V7uHpwM3jvJACULLjB_xlJxNaWj4ki5CLI0R9EDG2yAGWVsjkvndQFsX9xXnPLGqFClIfHjZt1hqpj87tFD2RLalZegHNDkz7eKDMcWIs2wG0Lp8X-uNjMToWPkkmABfSYkxwHfHBds Aug 27 03:05:59.298935 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 03:05:59.298935 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 03:05:59.298935 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 03:05:59.298935 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 03:05:59.298935 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 03:05:59.298935 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 03:05:59.298935 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 3b9e672ac89e41ff82355daa83e852bd Aug 27 03:05:59.298935 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:05:59.298935 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 03:05:59.298935 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 03:05:59.298935 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3b9e672ac89e41ff82355daa83e852bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3b9e672ac89e41ff82355daa83e852bd", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3b9e672ac89e41ff82355daa83e852bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3b9e672ac89e41ff82355daa83e852bd"}]}] Aug 27 03:05:59.298935 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:05:59.298935 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 3b9e672ac89e41ff82355daa83e852bd Aug 27 03:05:59.298935 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:05:59.298935 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ServersNegativeTestJSON-1795266674-project Aug 27 03:05:59.298935 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 03:05:59.298935 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 03:05:59.298935 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 204c90820f6d4c64b31367aaf098325c Aug 27 03:05:59.298935 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ServersNegativeTestJSON-1795266674-project Aug 27 03:05:59.298935 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 03:05:59.298935 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance f740d97a-07bc-40d5-b8da-d094caf575a8 could not be found. Aug 27 03:05:59.298935 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': 'f740d97a-07bc-40d5-b8da-d094caf575a8'} Aug 27 03:05:59.298935 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:05:59.298935 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:05:59.298935 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:05:59.298935 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:05:59.298935 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:05:59.298935 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:05:59.298935 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 03:05:59.298935 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 03:05:59.298935 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f740d97a-07bc-40d5-b8da-d094caf575a8 could not be found. Aug 27 03:05:59.298935 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:05:59.298935 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:05:59.298935 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:05:59.298935 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:05:59.298935 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:05:59.298935 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:05:59.298935 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:05:59.298935 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:05:59.298935 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:05:59.298935 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:05:59.298935 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 03:05:59.298935 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 03:05:59.298935 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 03:05:59.298935 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 03:05:59.298935 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:05:59.298935 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:05:59.298935 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:05:59.298935 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:05:59.298935 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f740d97a-07bc-40d5-b8da-d094caf575a8 could not be found. Aug 27 03:05:59.298935 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:05:59.298935 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:05:59.303908 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:05:59.303908 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:05:59.303908 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:05:59.303908 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:05:59.303908 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:05:59.303908 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:05:59.303908 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f740d97a-07bc-40d5-b8da-d094caf575a8 could not be found. Aug 27 03:05:59.303908 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:05:59.307038 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-1685d747-c395-424a-b843-49a6263dd02d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Returning 404 to user: Instance f740d97a-07bc-40d5-b8da-d094caf575a8 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:05:59.308797 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-1685d747-c395-424a-b843-49a6263dd02d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "DELETE /compute/v2.1/servers/f740d97a-07bc-40d5-b8da-d094caf575a8" status: 404 len: 111 microversion: 2.1 time: 0.023098 Aug 27 03:05:59.309753 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2353/4676] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 03:05:59 2022] DELETE /compute/v2.1/servers/f740d97a-07bc-40d5-b8da-d094caf575a8 => generated 111 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 03:05:59.318377 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-6ff6adce-6d88-4c59-bf13-5467cb10d7c8 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:59.319397 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-6ff6adce-6d88-4c59-bf13-5467cb10d7c8 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:59.327594 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6ff6adce-6d88-4c59-bf13-5467cb10d7c8 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:59.328543 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6ff6adce-6d88-4c59-bf13-5467cb10d7c8 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:59.329226 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6ff6adce-6d88-4c59-bf13-5467cb10d7c8 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:59.330208 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6ff6adce-6d88-4c59-bf13-5467cb10d7c8 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:59.330918 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6ff6adce-6d88-4c59-bf13-5467cb10d7c8 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:59.331607 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6ff6adce-6d88-4c59-bf13-5467cb10d7c8 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:59.565488 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-6ff6adce-6d88-4c59-bf13-5467cb10d7c8 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:59.578586 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-6ff6adce-6d88-4c59-bf13-5467cb10d7c8 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1504 microversion: 2.1 time: 0.264189 Aug 27 03:05:59.579566 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2354/4677] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:59 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1504 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:59.608554 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-69e5def1-b953-462e-a975-cca878e0f2c9 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:59.609594 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-69e5def1-b953-462e-a975-cca878e0f2c9 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:59.618187 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-69e5def1-b953-462e-a975-cca878e0f2c9 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:59.620532 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-69e5def1-b953-462e-a975-cca878e0f2c9 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:59.625686 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-69e5def1-b953-462e-a975-cca878e0f2c9 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:59.626799 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-69e5def1-b953-462e-a975-cca878e0f2c9 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:59.627652 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-69e5def1-b953-462e-a975-cca878e0f2c9 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:59.628338 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-69e5def1-b953-462e-a975-cca878e0f2c9 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:59.838878 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-bc4cf43e-5072-4e11-ac46-805f169123fb tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:59.847359 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-bc4cf43e-5072-4e11-ac46-805f169123fb tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/eeb71517-05bf-488e-98b1-04d8a140e079" status: 200 len: 1511 microversion: 2.1 time: 0.625380 Aug 27 03:05:59.850132 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2324/4678] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:59 2022] GET /compute/v2.1/servers/eeb71517-05bf-488e-98b1-04d8a140e079 => generated 1511 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:05:59.883732 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-69e5def1-b953-462e-a975-cca878e0f2c9 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:59.895744 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-69e5def1-b953-462e-a975-cca878e0f2c9 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1504 microversion: 2.1 time: 0.290003 Aug 27 03:05:59.902522 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2355/4679] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:59 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1504 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:59.917937 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3e0900f8-9a80-4a86-986a-f783f4a96501 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:59.919359 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-3e0900f8-9a80-4a86-986a-f783f4a96501 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Failed to fetch instance by id 9223372036854775808 {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 27 03:05:59.920111 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-3e0900f8-9a80-4a86-986a-f783f4a96501 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Aug 27 03:05:59.922600 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3e0900f8-9a80-4a86-986a-f783f4a96501 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Request method failure captured: Aug 27 03:05:59.922600 n-d-852278-4 devstack@n-api.service[134052]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Aug 27 03:05:59.922600 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 03:05:59.922600 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 03:05:59.922600 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 03:05:59.922600 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 03:05:59.922600 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 03:05:59.922600 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 03:05:59.922600 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 03:05:59.922600 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 03:05:59.922600 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYnkbLTKVFjPQ5m3U2fG0N9Vjn4DkHnl17m4V7uHpwM3jvJACULLjB_xlJxNaWj4ki5CLI0R9EDG2yAGWVsjkvndQFsX9xXnPLGqFClIfHjZt1hqpj87tFD2RLalZegHNDkz7eKDMcWIs2wG0Lp8X-uNjMToWPkkmABfSYkxwHfHBds Aug 27 03:05:59.922600 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 03:05:59.922600 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 03:05:59.922600 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 03:05:59.922600 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 03:05:59.922600 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 03:05:59.922600 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 03:05:59.922600 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 3b9e672ac89e41ff82355daa83e852bd Aug 27 03:05:59.922600 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:05:59.922600 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 03:05:59.922600 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 03:05:59.922600 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3b9e672ac89e41ff82355daa83e852bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3b9e672ac89e41ff82355daa83e852bd", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3b9e672ac89e41ff82355daa83e852bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3b9e672ac89e41ff82355daa83e852bd"}]}] Aug 27 03:05:59.922600 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:05:59.922600 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 3b9e672ac89e41ff82355daa83e852bd Aug 27 03:05:59.922600 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:05:59.922600 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ServersNegativeTestJSON-1795266674-project Aug 27 03:05:59.922600 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 03:05:59.922600 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 03:05:59.922600 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 204c90820f6d4c64b31367aaf098325c Aug 27 03:05:59.922600 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ServersNegativeTestJSON-1795266674-project Aug 27 03:05:59.922600 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 03:05:59.922600 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance 9223372036854775808 could not be found. Aug 27 03:05:59.922600 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '9223372036854775808'} Aug 27 03:05:59.922600 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:05:59.922600 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:05:59.922600 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:05:59.922600 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:05:59.922600 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 27 03:05:59.922600 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 27 03:05:59.922600 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Aug 27 03:05:59.922600 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:05:59.922600 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:05:59.922600 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:05:59.922600 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:05:59.922600 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:05:59.922600 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:05:59.922600 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:05:59.922600 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:05:59.922600 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:05:59.922600 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:05:59.922600 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 03:05:59.922600 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 03:05:59.922600 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 03:05:59.922600 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 03:05:59.922600 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:05:59.922600 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:05:59.922600 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:05:59.922600 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:05:59.922600 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Aug 27 03:05:59.922600 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:05:59.922600 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:05:59.922600 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:05:59.922600 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:05:59.922600 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:05:59.928492 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:05:59.928492 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:05:59.928492 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:05:59.928492 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Aug 27 03:05:59.928492 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:05:59.931178 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3e0900f8-9a80-4a86-986a-f783f4a96501 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:05:59.932222 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-3e0900f8-9a80-4a86-986a-f783f4a96501 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.019426 Aug 27 03:05:59.933500 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2325/4680] 10.222.0.70 () {58 vars in 1188 bytes} [Sat Aug 27 03:05:59 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 03:05:59.944675 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-1d7c7f62-d969-4377-941f-bee0ec4c15f6 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:59.945629 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-1d7c7f62-d969-4377-941f-bee0ec4c15f6 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:59.953398 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1d7c7f62-d969-4377-941f-bee0ec4c15f6 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:59.954440 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1d7c7f62-d969-4377-941f-bee0ec4c15f6 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:59.955324 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1d7c7f62-d969-4377-941f-bee0ec4c15f6 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:59.956404 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1d7c7f62-d969-4377-941f-bee0ec4c15f6 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:59.957374 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1d7c7f62-d969-4377-941f-bee0ec4c15f6 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:59.958249 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1d7c7f62-d969-4377-941f-bee0ec4c15f6 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:00.170369 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-1d7c7f62-d969-4377-941f-bee0ec4c15f6 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:00.178959 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-1d7c7f62-d969-4377-941f-bee0ec4c15f6 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1504 microversion: 2.1 time: 0.241179 Aug 27 03:06:00.180763 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2356/4681] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:59 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1504 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:00.203037 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e6b48679-78fd-4df2-8777-9ea71362116f tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:00.203779 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-e6b48679-78fd-4df2-8777-9ea71362116f tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:00.211916 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e6b48679-78fd-4df2-8777-9ea71362116f tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:00.213002 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e6b48679-78fd-4df2-8777-9ea71362116f tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:00.215720 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e6b48679-78fd-4df2-8777-9ea71362116f tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:00.218012 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e6b48679-78fd-4df2-8777-9ea71362116f tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:00.218576 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e6b48679-78fd-4df2-8777-9ea71362116f tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:00.219246 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e6b48679-78fd-4df2-8777-9ea71362116f tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:00.389960 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-e6b48679-78fd-4df2-8777-9ea71362116f tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:00.398135 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e6b48679-78fd-4df2-8777-9ea71362116f tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1504 microversion: 2.1 time: 0.199106 Aug 27 03:06:00.398705 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2326/4682] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:00 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1504 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:00.433949 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8447a070-fef2-4a79-98f1-d11f1072ad1e tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:00.434818 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-8447a070-fef2-4a79-98f1-d11f1072ad1e tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Failed to fetch instance by id -1 {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 27 03:06:00.439822 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-8447a070-fef2-4a79-98f1-d11f1072ad1e tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] HTTP exception thrown: Instance -1 could not be found. Aug 27 03:06:00.441502 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8447a070-fef2-4a79-98f1-d11f1072ad1e tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Request method failure captured: Aug 27 03:06:00.441502 n-d-852278-4 devstack@n-api.service[134051]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Aug 27 03:06:00.441502 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 03:06:00.441502 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 03:06:00.441502 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 03:06:00.441502 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 03:06:00.441502 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 03:06:00.441502 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 03:06:00.441502 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 03:06:00.441502 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 03:06:00.441502 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYnkbLTKVFjPQ5m3U2fG0N9Vjn4DkHnl17m4V7uHpwM3jvJACULLjB_xlJxNaWj4ki5CLI0R9EDG2yAGWVsjkvndQFsX9xXnPLGqFClIfHjZt1hqpj87tFD2RLalZegHNDkz7eKDMcWIs2wG0Lp8X-uNjMToWPkkmABfSYkxwHfHBds Aug 27 03:06:00.441502 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 03:06:00.441502 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 03:06:00.441502 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 03:06:00.441502 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 03:06:00.441502 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 03:06:00.441502 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 03:06:00.441502 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 3b9e672ac89e41ff82355daa83e852bd Aug 27 03:06:00.441502 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:06:00.441502 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 03:06:00.441502 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 03:06:00.441502 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3b9e672ac89e41ff82355daa83e852bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3b9e672ac89e41ff82355daa83e852bd", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3b9e672ac89e41ff82355daa83e852bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3b9e672ac89e41ff82355daa83e852bd"}]}] Aug 27 03:06:00.441502 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:06:00.441502 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 3b9e672ac89e41ff82355daa83e852bd Aug 27 03:06:00.441502 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:06:00.441502 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ServersNegativeTestJSON-1795266674-project Aug 27 03:06:00.441502 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 03:06:00.441502 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 03:06:00.441502 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 204c90820f6d4c64b31367aaf098325c Aug 27 03:06:00.441502 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ServersNegativeTestJSON-1795266674-project Aug 27 03:06:00.441502 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 03:06:00.441502 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance -1 could not be found. Aug 27 03:06:00.441502 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '-1'} Aug 27 03:06:00.441502 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:06:00.441502 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:00.441502 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:06:00.441502 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:06:00.441502 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 27 03:06:00.441502 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 27 03:06:00.441502 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Aug 27 03:06:00.441502 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:00.441502 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:06:00.441502 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:00.441502 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:00.441502 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:06:00.441502 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:06:00.441502 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:06:00.441502 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:06:00.441502 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:06:00.441502 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:06:00.441502 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 03:06:00.441502 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 03:06:00.441502 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 03:06:00.441502 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 03:06:00.441502 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:06:00.441502 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:06:00.441502 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:06:00.441502 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:06:00.441502 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Aug 27 03:06:00.441502 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:00.441502 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:06:00.441502 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:00.441502 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:00.441502 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:06:00.441502 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:06:00.447411 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:06:00.447411 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:06:00.447411 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Aug 27 03:06:00.447411 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:00.447411 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8447a070-fef2-4a79-98f1-d11f1072ad1e tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Returning 404 to user: Instance -1 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:06:00.447411 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-8447a070-fef2-4a79-98f1-d11f1072ad1e tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.023671 Aug 27 03:06:00.449959 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2357/4683] 10.222.0.70 () {58 vars in 1137 bytes} [Sat Aug 27 03:06:00 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 03:06:00.466502 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-232aa154-d6de-4672-985c-ec839480f4c0 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:00.467492 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-232aa154-d6de-4672-985c-ec839480f4c0 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:00.484081 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-232aa154-d6de-4672-985c-ec839480f4c0 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:00.485073 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-232aa154-d6de-4672-985c-ec839480f4c0 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:00.485955 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-232aa154-d6de-4672-985c-ec839480f4c0 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:00.488117 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-232aa154-d6de-4672-985c-ec839480f4c0 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:00.491025 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-232aa154-d6de-4672-985c-ec839480f4c0 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:00.491787 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-232aa154-d6de-4672-985c-ec839480f4c0 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:00.659200 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-232aa154-d6de-4672-985c-ec839480f4c0 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:00.674776 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-232aa154-d6de-4672-985c-ec839480f4c0 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1504 microversion: 2.1 time: 0.223443 Aug 27 03:06:00.687034 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2327/4684] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:00 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1504 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:00.702984 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4f8572f2-aa8d-4249-8a48-a8832cbe5811 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:00.703630 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-4f8572f2-aa8d-4249-8a48-a8832cbe5811 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:00.711331 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4f8572f2-aa8d-4249-8a48-a8832cbe5811 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:00.712154 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4f8572f2-aa8d-4249-8a48-a8832cbe5811 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:00.712594 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4f8572f2-aa8d-4249-8a48-a8832cbe5811 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:00.713664 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4f8572f2-aa8d-4249-8a48-a8832cbe5811 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:00.714419 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4f8572f2-aa8d-4249-8a48-a8832cbe5811 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:00.715130 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4f8572f2-aa8d-4249-8a48-a8832cbe5811 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:00.868864 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-de8cf7f8-0324-48fd-8be8-aca5e40f9cd0 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:00.869657 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-de8cf7f8-0324-48fd-8be8-aca5e40f9cd0 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: eeb71517-05bf-488e-98b1-04d8a140e079] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:00.877606 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-4f8572f2-aa8d-4249-8a48-a8832cbe5811 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:00.887342 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-4f8572f2-aa8d-4249-8a48-a8832cbe5811 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1504 microversion: 2.1 time: 0.189518 Aug 27 03:06:00.893315 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2358/4685] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:00 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1504 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:00.893633 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-de8cf7f8-0324-48fd-8be8-aca5e40f9cd0 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:00.894354 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-de8cf7f8-0324-48fd-8be8-aca5e40f9cd0 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:00.894918 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-de8cf7f8-0324-48fd-8be8-aca5e40f9cd0 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:00.895802 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-de8cf7f8-0324-48fd-8be8-aca5e40f9cd0 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:00.896376 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-de8cf7f8-0324-48fd-8be8-aca5e40f9cd0 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:00.896904 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-de8cf7f8-0324-48fd-8be8-aca5e40f9cd0 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:00.917262 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0c8571dc-b093-4e28-af34-b4ba78dc6766 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:06:00.918006 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-0c8571dc-b093-4e28-af34-b4ba78dc6766 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: e6c22733-a8c2-45fb-a821-7e882930935f] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:00.924141 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-0c8571dc-b093-4e28-af34-b4ba78dc6766 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] HTTP exception thrown: Instance e6c22733-a8c2-45fb-a821-7e882930935f could not be found. Aug 27 03:06:00.935298 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0c8571dc-b093-4e28-af34-b4ba78dc6766 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Request method failure captured: Aug 27 03:06:00.935298 n-d-852278-4 devstack@n-api.service[134051]: request: POST /compute/v2.1/servers/e6c22733-a8c2-45fb-a821-7e882930935f/action HTTP/1.1 Aug 27 03:06:00.935298 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 03:06:00.935298 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 03:06:00.935298 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 03:06:00.935298 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 19 Aug 27 03:06:00.935298 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 03:06:00.935298 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 03:06:00.935298 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 03:06:00.935298 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 03:06:00.935298 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYnkbLTKVFjPQ5m3U2fG0N9Vjn4DkHnl17m4V7uHpwM3jvJACULLjB_xlJxNaWj4ki5CLI0R9EDG2yAGWVsjkvndQFsX9xXnPLGqFClIfHjZt1hqpj87tFD2RLalZegHNDkz7eKDMcWIs2wG0Lp8X-uNjMToWPkkmABfSYkxwHfHBds Aug 27 03:06:00.935298 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 03:06:00.935298 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 03:06:00.935298 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 03:06:00.935298 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 03:06:00.935298 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 03:06:00.935298 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 03:06:00.935298 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 3b9e672ac89e41ff82355daa83e852bd Aug 27 03:06:00.935298 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:06:00.935298 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 03:06:00.935298 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 03:06:00.935298 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3b9e672ac89e41ff82355daa83e852bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3b9e672ac89e41ff82355daa83e852bd", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3b9e672ac89e41ff82355daa83e852bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3b9e672ac89e41ff82355daa83e852bd"}]}] Aug 27 03:06:00.935298 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:06:00.935298 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 3b9e672ac89e41ff82355daa83e852bd Aug 27 03:06:00.935298 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:06:00.935298 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ServersNegativeTestJSON-1795266674-project Aug 27 03:06:00.935298 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 03:06:00.935298 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 03:06:00.935298 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 204c90820f6d4c64b31367aaf098325c Aug 27 03:06:00.935298 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ServersNegativeTestJSON-1795266674-project Aug 27 03:06:00.935298 n-d-852278-4 devstack@n-api.service[134051]: Aug 27 03:06:00.935298 n-d-852278-4 devstack@n-api.service[134051]: {"forceDelete": {}} Aug 27 03:06:00.935298 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 03:06:00.935298 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance e6c22733-a8c2-45fb-a821-7e882930935f could not be found. Aug 27 03:06:00.935298 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': 'e6c22733-a8c2-45fb-a821-7e882930935f', 'body': {'forceDelete': {}}} Aug 27 03:06:00.935298 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:06:00.935298 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:00.935298 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:06:00.935298 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:06:00.935298 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:06:00.935298 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:06:00.935298 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 03:06:00.935298 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 03:06:00.935298 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6c22733-a8c2-45fb-a821-7e882930935f could not be found. Aug 27 03:06:00.935298 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:00.935298 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:06:00.935298 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:00.935298 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:00.935298 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:06:00.935298 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:06:00.935298 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:06:00.935298 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:06:00.935298 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:06:00.935298 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:06:00.935298 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Aug 27 03:06:00.935298 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 27 03:06:00.935298 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:06:00.935298 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:06:00.935298 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6c22733-a8c2-45fb-a821-7e882930935f could not be found. Aug 27 03:06:00.935298 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:00.935298 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:06:00.935298 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:00.935298 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:00.935298 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:06:00.935298 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:06:00.941053 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:06:00.941053 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:06:00.941053 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6c22733-a8c2-45fb-a821-7e882930935f could not be found. Aug 27 03:06:00.941053 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:00.942947 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0c8571dc-b093-4e28-af34-b4ba78dc6766 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Returning 404 to user: Instance e6c22733-a8c2-45fb-a821-7e882930935f could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:06:00.944064 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-0c8571dc-b093-4e28-af34-b4ba78dc6766 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "POST /compute/v2.1/servers/e6c22733-a8c2-45fb-a821-7e882930935f/action" status: 404 len: 111 microversion: 2.1 time: 0.031422 Aug 27 03:06:00.949698 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2359/4686] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:06:00 2022] POST /compute/v2.1/servers/e6c22733-a8c2-45fb-a821-7e882930935f/action => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 03:06:00.958082 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-1d45d39a-ca07-4c63-b0e3-d84c540ff072 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:00.958854 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-1d45d39a-ca07-4c63-b0e3-d84c540ff072 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:00.975619 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1d45d39a-ca07-4c63-b0e3-d84c540ff072 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:00.976287 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1d45d39a-ca07-4c63-b0e3-d84c540ff072 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:00.977645 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1d45d39a-ca07-4c63-b0e3-d84c540ff072 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:00.979487 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1d45d39a-ca07-4c63-b0e3-d84c540ff072 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:00.981223 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1d45d39a-ca07-4c63-b0e3-d84c540ff072 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:00.983333 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1d45d39a-ca07-4c63-b0e3-d84c540ff072 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:01.121007 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-de8cf7f8-0324-48fd-8be8-aca5e40f9cd0 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:01.134100 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-de8cf7f8-0324-48fd-8be8-aca5e40f9cd0 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/eeb71517-05bf-488e-98b1-04d8a140e079" status: 200 len: 1511 microversion: 2.1 time: 0.269268 Aug 27 03:06:01.134828 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2328/4687] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:00 2022] GET /compute/v2.1/servers/eeb71517-05bf-488e-98b1-04d8a140e079 => generated 1511 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:01.214001 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-1d45d39a-ca07-4c63-b0e3-d84c540ff072 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:01.224299 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-1d45d39a-ca07-4c63-b0e3-d84c540ff072 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1504 microversion: 2.1 time: 0.270052 Aug 27 03:06:01.225476 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2360/4688] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:00 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1504 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:06:01.249288 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-40f2aa5a-a364-4964-b6a1-d3055bcfb40b tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:01.249972 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-40f2aa5a-a364-4964-b6a1-d3055bcfb40b tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:01.268013 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-40f2aa5a-a364-4964-b6a1-d3055bcfb40b tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:01.268643 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-40f2aa5a-a364-4964-b6a1-d3055bcfb40b tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:01.269146 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-40f2aa5a-a364-4964-b6a1-d3055bcfb40b tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:01.269914 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-40f2aa5a-a364-4964-b6a1-d3055bcfb40b tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:01.270550 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-40f2aa5a-a364-4964-b6a1-d3055bcfb40b tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:01.271133 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-40f2aa5a-a364-4964-b6a1-d3055bcfb40b tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:01.472055 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-40f2aa5a-a364-4964-b6a1-d3055bcfb40b tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:01.486064 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-40f2aa5a-a364-4964-b6a1-d3055bcfb40b tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1504 microversion: 2.1 time: 0.240700 Aug 27 03:06:01.486668 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2329/4689] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:01 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1504 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:01.507956 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d7f7d6b2-0560-4422-b37f-0f406b8c5005 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:06:01.510517 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d7f7d6b2-0560-4422-b37f-0f406b8c5005 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 000f1092-addc-45f0-a81b-e5b464edf504] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:01.516588 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-d7f7d6b2-0560-4422-b37f-0f406b8c5005 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] HTTP exception thrown: Instance 000f1092-addc-45f0-a81b-e5b464edf504 could not be found. Aug 27 03:06:01.532700 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d7f7d6b2-0560-4422-b37f-0f406b8c5005 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Request method failure captured: Aug 27 03:06:01.532700 n-d-852278-4 devstack@n-api.service[134051]: request: POST /compute/v2.1/servers/000f1092-addc-45f0-a81b-e5b464edf504/action HTTP/1.1 Aug 27 03:06:01.532700 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 03:06:01.532700 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 03:06:01.532700 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 03:06:01.532700 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 39 Aug 27 03:06:01.532700 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 03:06:01.532700 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 03:06:01.532700 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 03:06:01.532700 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 03:06:01.532700 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYnkbLTKVFjPQ5m3U2fG0N9Vjn4DkHnl17m4V7uHpwM3jvJACULLjB_xlJxNaWj4ki5CLI0R9EDG2yAGWVsjkvndQFsX9xXnPLGqFClIfHjZt1hqpj87tFD2RLalZegHNDkz7eKDMcWIs2wG0Lp8X-uNjMToWPkkmABfSYkxwHfHBds Aug 27 03:06:01.532700 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 03:06:01.532700 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 03:06:01.532700 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 03:06:01.532700 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 03:06:01.532700 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 03:06:01.532700 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 03:06:01.532700 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 3b9e672ac89e41ff82355daa83e852bd Aug 27 03:06:01.532700 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:06:01.532700 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 03:06:01.532700 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 03:06:01.532700 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3b9e672ac89e41ff82355daa83e852bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3b9e672ac89e41ff82355daa83e852bd", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3b9e672ac89e41ff82355daa83e852bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3b9e672ac89e41ff82355daa83e852bd"}]}] Aug 27 03:06:01.532700 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:06:01.532700 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 3b9e672ac89e41ff82355daa83e852bd Aug 27 03:06:01.532700 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:06:01.532700 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ServersNegativeTestJSON-1795266674-project Aug 27 03:06:01.532700 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 03:06:01.532700 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 03:06:01.532700 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 204c90820f6d4c64b31367aaf098325c Aug 27 03:06:01.532700 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ServersNegativeTestJSON-1795266674-project Aug 27 03:06:01.532700 n-d-852278-4 devstack@n-api.service[134051]: Aug 27 03:06:01.532700 n-d-852278-4 devstack@n-api.service[134051]: {"os-getConsoleOutput": {"length": 10}} Aug 27 03:06:01.532700 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 03:06:01.532700 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance 000f1092-addc-45f0-a81b-e5b464edf504 could not be found. Aug 27 03:06:01.532700 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '000f1092-addc-45f0-a81b-e5b464edf504', 'body': {'os-getConsoleOutput': {'length': 10}}} Aug 27 03:06:01.532700 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:06:01.532700 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:01.532700 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:06:01.532700 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:06:01.532700 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:06:01.532700 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:06:01.532700 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 03:06:01.532700 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 03:06:01.532700 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 000f1092-addc-45f0-a81b-e5b464edf504 could not be found. Aug 27 03:06:01.532700 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:01.532700 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:06:01.532700 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:01.532700 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:01.532700 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:06:01.532700 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:06:01.532700 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:06:01.532700 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:06:01.532700 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:06:01.532700 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:06:01.532700 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:06:01.532700 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:06:01.532700 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Aug 27 03:06:01.532700 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 27 03:06:01.532700 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:06:01.532700 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:06:01.532700 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 000f1092-addc-45f0-a81b-e5b464edf504 could not be found. Aug 27 03:06:01.532700 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:01.532700 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:06:01.532700 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:01.532700 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:01.538304 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:06:01.538304 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:06:01.538304 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:06:01.538304 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:06:01.538304 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 000f1092-addc-45f0-a81b-e5b464edf504 could not be found. Aug 27 03:06:01.538304 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:01.538304 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d7f7d6b2-0560-4422-b37f-0f406b8c5005 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Returning 404 to user: Instance 000f1092-addc-45f0-a81b-e5b464edf504 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:06:01.538304 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d7f7d6b2-0560-4422-b37f-0f406b8c5005 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "POST /compute/v2.1/servers/000f1092-addc-45f0-a81b-e5b464edf504/action" status: 404 len: 111 microversion: 2.1 time: 0.022552 Aug 27 03:06:01.538304 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2361/4690] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:06:01 2022] POST /compute/v2.1/servers/000f1092-addc-45f0-a81b-e5b464edf504/action => generated 111 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:06:01.551299 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8018a49e-c4ad-42b7-be79-5050732247f3 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:01.554162 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-8018a49e-c4ad-42b7-be79-5050732247f3 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:01.570678 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8018a49e-c4ad-42b7-be79-5050732247f3 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:01.572183 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8018a49e-c4ad-42b7-be79-5050732247f3 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:01.572771 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8018a49e-c4ad-42b7-be79-5050732247f3 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:01.575609 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8018a49e-c4ad-42b7-be79-5050732247f3 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:01.576249 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8018a49e-c4ad-42b7-be79-5050732247f3 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:01.578217 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8018a49e-c4ad-42b7-be79-5050732247f3 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:01.633145 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=100 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:06:01.821674 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-8018a49e-c4ad-42b7-be79-5050732247f3 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:01.840802 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-8018a49e-c4ad-42b7-be79-5050732247f3 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1504 microversion: 2.1 time: 0.300837 Aug 27 03:06:01.841412 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2330/4691] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:01 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1504 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:01.867344 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-91e41f83-799e-4ea5-bffd-bd462814a711 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:01.870052 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-91e41f83-799e-4ea5-bffd-bd462814a711 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:01.904918 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-91e41f83-799e-4ea5-bffd-bd462814a711 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:01.909515 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-91e41f83-799e-4ea5-bffd-bd462814a711 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:01.910271 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-91e41f83-799e-4ea5-bffd-bd462814a711 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:01.912705 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-91e41f83-799e-4ea5-bffd-bd462814a711 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:01.915382 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-91e41f83-799e-4ea5-bffd-bd462814a711 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:01.916827 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-91e41f83-799e-4ea5-bffd-bd462814a711 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:02.158611 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-32737897-ee35-4a85-9a0c-1f6e3a127f8d tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:02.159380 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-32737897-ee35-4a85-9a0c-1f6e3a127f8d tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: eeb71517-05bf-488e-98b1-04d8a140e079] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:02.176056 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-32737897-ee35-4a85-9a0c-1f6e3a127f8d tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:02.178198 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-32737897-ee35-4a85-9a0c-1f6e3a127f8d tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:02.179171 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-32737897-ee35-4a85-9a0c-1f6e3a127f8d tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:02.181100 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-32737897-ee35-4a85-9a0c-1f6e3a127f8d tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:02.184141 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-32737897-ee35-4a85-9a0c-1f6e3a127f8d tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:02.186141 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-32737897-ee35-4a85-9a0c-1f6e3a127f8d tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:02.354944 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-91e41f83-799e-4ea5-bffd-bd462814a711 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:02.365786 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-91e41f83-799e-4ea5-bffd-bd462814a711 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1504 microversion: 2.1 time: 0.502455 Aug 27 03:06:02.366387 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2362/4692] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:01 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1504 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:02.388449 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8ba61c25-01d7-4a78-93ce-b99e86e7fded tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:02.389349 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-8ba61c25-01d7-4a78-93ce-b99e86e7fded tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: ceb645ef-b545-465f-91e9-9e4d9c5fefb1] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:02.399730 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-8ba61c25-01d7-4a78-93ce-b99e86e7fded tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] HTTP exception thrown: Instance ceb645ef-b545-465f-91e9-9e4d9c5fefb1 could not be found. Aug 27 03:06:02.401672 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8ba61c25-01d7-4a78-93ce-b99e86e7fded tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Request method failure captured: Aug 27 03:06:02.401672 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/ceb645ef-b545-465f-91e9-9e4d9c5fefb1 HTTP/1.1 Aug 27 03:06:02.401672 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 03:06:02.401672 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 03:06:02.401672 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 03:06:02.401672 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 03:06:02.401672 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 03:06:02.401672 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 03:06:02.401672 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 03:06:02.401672 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 03:06:02.401672 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYnkbLTKVFjPQ5m3U2fG0N9Vjn4DkHnl17m4V7uHpwM3jvJACULLjB_xlJxNaWj4ki5CLI0R9EDG2yAGWVsjkvndQFsX9xXnPLGqFClIfHjZt1hqpj87tFD2RLalZegHNDkz7eKDMcWIs2wG0Lp8X-uNjMToWPkkmABfSYkxwHfHBds Aug 27 03:06:02.401672 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 03:06:02.401672 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 03:06:02.401672 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 03:06:02.401672 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 03:06:02.401672 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 03:06:02.401672 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 03:06:02.401672 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 3b9e672ac89e41ff82355daa83e852bd Aug 27 03:06:02.401672 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:06:02.401672 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 03:06:02.401672 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 03:06:02.401672 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3b9e672ac89e41ff82355daa83e852bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3b9e672ac89e41ff82355daa83e852bd", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3b9e672ac89e41ff82355daa83e852bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3b9e672ac89e41ff82355daa83e852bd"}]}] Aug 27 03:06:02.401672 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:06:02.401672 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 3b9e672ac89e41ff82355daa83e852bd Aug 27 03:06:02.401672 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:06:02.401672 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ServersNegativeTestJSON-1795266674-project Aug 27 03:06:02.401672 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 03:06:02.401672 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 03:06:02.401672 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 204c90820f6d4c64b31367aaf098325c Aug 27 03:06:02.401672 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ServersNegativeTestJSON-1795266674-project Aug 27 03:06:02.401672 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 03:06:02.401672 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance ceb645ef-b545-465f-91e9-9e4d9c5fefb1 could not be found. Aug 27 03:06:02.401672 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': 'ceb645ef-b545-465f-91e9-9e4d9c5fefb1'} Aug 27 03:06:02.401672 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:06:02.401672 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:02.401672 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:06:02.401672 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:06:02.401672 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:06:02.401672 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:06:02.401672 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 03:06:02.401672 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 03:06:02.401672 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ceb645ef-b545-465f-91e9-9e4d9c5fefb1 could not be found. Aug 27 03:06:02.401672 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:02.401672 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:06:02.401672 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:02.401672 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:02.401672 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:06:02.401672 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:06:02.401672 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:06:02.401672 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:06:02.401672 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:06:02.401672 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:06:02.401672 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:06:02.401672 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:06:02.401672 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:06:02.401672 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:06:02.401672 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:06:02.401672 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:06:02.401672 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ceb645ef-b545-465f-91e9-9e4d9c5fefb1 could not be found. Aug 27 03:06:02.401672 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:02.401672 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:06:02.401672 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:02.401672 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:02.401672 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:06:02.406440 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:06:02.406440 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:06:02.406440 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:06:02.406440 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ceb645ef-b545-465f-91e9-9e4d9c5fefb1 could not be found. Aug 27 03:06:02.406440 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:02.416023 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8ba61c25-01d7-4a78-93ce-b99e86e7fded tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Returning 404 to user: Instance ceb645ef-b545-465f-91e9-9e4d9c5fefb1 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:06:02.418711 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-8ba61c25-01d7-4a78-93ce-b99e86e7fded tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/ceb645ef-b545-465f-91e9-9e4d9c5fefb1" status: 404 len: 111 microversion: 2.1 time: 0.034501 Aug 27 03:06:02.419548 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2363/4693] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:02 2022] GET /compute/v2.1/servers/ceb645ef-b545-465f-91e9-9e4d9c5fefb1 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 03:06:02.433574 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-9f0eda10-b8d2-4029-bf02-6712db3bcafa tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:02.434519 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-9f0eda10-b8d2-4029-bf02-6712db3bcafa tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:02.448410 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9f0eda10-b8d2-4029-bf02-6712db3bcafa tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:02.448919 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9f0eda10-b8d2-4029-bf02-6712db3bcafa tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:02.449367 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9f0eda10-b8d2-4029-bf02-6712db3bcafa tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:02.450087 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9f0eda10-b8d2-4029-bf02-6712db3bcafa tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:02.450540 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9f0eda10-b8d2-4029-bf02-6712db3bcafa tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:02.450992 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9f0eda10-b8d2-4029-bf02-6712db3bcafa tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:02.553118 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-32737897-ee35-4a85-9a0c-1f6e3a127f8d tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:02.561310 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-32737897-ee35-4a85-9a0c-1f6e3a127f8d tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/eeb71517-05bf-488e-98b1-04d8a140e079" status: 200 len: 1511 microversion: 2.1 time: 0.407601 Aug 27 03:06:02.576007 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2331/4694] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:02 2022] GET /compute/v2.1/servers/eeb71517-05bf-488e-98b1-04d8a140e079 => generated 1511 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:02.730597 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-9f0eda10-b8d2-4029-bf02-6712db3bcafa tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:02.743753 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-9f0eda10-b8d2-4029-bf02-6712db3bcafa tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1504 microversion: 2.1 time: 0.319625 Aug 27 03:06:02.745914 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2364/4695] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:02 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1504 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:02.776798 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-eb7921d2-324f-441f-8415-168ad681c1fd tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:02.777427 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-eb7921d2-324f-441f-8415-168ad681c1fd tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:02.785482 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-eb7921d2-324f-441f-8415-168ad681c1fd tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:02.789093 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-eb7921d2-324f-441f-8415-168ad681c1fd tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:02.790860 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-eb7921d2-324f-441f-8415-168ad681c1fd tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:02.791941 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-eb7921d2-324f-441f-8415-168ad681c1fd tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:02.796768 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-eb7921d2-324f-441f-8415-168ad681c1fd tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:02.797994 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-eb7921d2-324f-441f-8415-168ad681c1fd tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:03.032368 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-eb7921d2-324f-441f-8415-168ad681c1fd tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:03.042276 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-eb7921d2-324f-441f-8415-168ad681c1fd tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1504 microversion: 2.1 time: 0.273709 Aug 27 03:06:03.043894 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2332/4696] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:02 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1504 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:03.185338 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-cdaf9621-cb04-4ae4-8093-00b3d8608aeb tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-688196235", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "7efdc19e-82eb-4610-897e-db10a92a0c7c"}]}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:06:03.206878 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-cdaf9621-cb04-4ae4-8093-00b3d8608aeb tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Request method failure captured: Aug 27 03:06:03.206878 n-d-852278-4 devstack@n-api.service[134051]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 03:06:03.206878 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 03:06:03.206878 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 03:06:03.206878 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 03:06:03.206878 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 237 Aug 27 03:06:03.206878 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 03:06:03.206878 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 03:06:03.206878 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 03:06:03.206878 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 03:06:03.206878 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYnkbLTKVFjPQ5m3U2fG0N9Vjn4DkHnl17m4V7uHpwM3jvJACULLjB_xlJxNaWj4ki5CLI0R9EDG2yAGWVsjkvndQFsX9xXnPLGqFClIfHjZt1hqpj87tFD2RLalZegHNDkz7eKDMcWIs2wG0Lp8X-uNjMToWPkkmABfSYkxwHfHBds Aug 27 03:06:03.206878 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 03:06:03.206878 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 03:06:03.206878 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 03:06:03.206878 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 03:06:03.206878 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 03:06:03.206878 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 03:06:03.206878 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 3b9e672ac89e41ff82355daa83e852bd Aug 27 03:06:03.206878 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:06:03.206878 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 03:06:03.206878 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 03:06:03.206878 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3b9e672ac89e41ff82355daa83e852bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3b9e672ac89e41ff82355daa83e852bd", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3b9e672ac89e41ff82355daa83e852bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3b9e672ac89e41ff82355daa83e852bd"}]}] Aug 27 03:06:03.206878 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:06:03.206878 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 3b9e672ac89e41ff82355daa83e852bd Aug 27 03:06:03.206878 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:06:03.206878 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ServersNegativeTestJSON-1795266674-project Aug 27 03:06:03.206878 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 03:06:03.206878 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 03:06:03.206878 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 204c90820f6d4c64b31367aaf098325c Aug 27 03:06:03.206878 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ServersNegativeTestJSON-1795266674-project Aug 27 03:06:03.206878 n-d-852278-4 devstack@n-api.service[134051]: Aug 27 03:06:03.206878 n-d-852278-4 devstack@n-api.service[134051]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-688196235", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "7efdc19e-82eb-4610-897e-db10a92a0c7c"}]}} Aug 27 03:06:03.206878 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 03:06:03.206878 n-d-852278-4 devstack@n-api.service[134051]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Aug 27 03:06:03.206878 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-688196235', 'imageRef': '1552acd0-176a-4c81-b680-29d74105e9d6', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '7efdc19e-82eb-4610-897e-db10a92a0c7c'}]}}} Aug 27 03:06:03.206878 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:06:03.206878 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:03.206878 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 27 03:06:03.206878 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 27 03:06:03.206878 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 236, in is_ipv4 Aug 27 03:06:03.206878 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Aug 27 03:06:03.206878 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Aug 27 03:06:03.206878 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Aug 27 03:06:03.206878 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Aug 27 03:06:03.206878 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Aug 27 03:06:03.206878 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Aug 27 03:06:03.206878 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:03.206878 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 27 03:06:03.206878 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:03.206878 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:03.206878 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 03:06:03.206878 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 03:06:03.206878 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 03:06:03.206878 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise error Aug 27 03:06:03.206878 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Aug 27 03:06:03.206878 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:03.206878 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Aug 27 03:06:03.206878 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Aug 27 03:06:03.206878 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:03.206878 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 27 03:06:03.206878 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Aug 27 03:06:03.206878 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:03.206878 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:06:03.206878 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:03.206878 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:03.212632 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:06:03.212632 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:06:03.212632 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:06:03.212632 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:06:03.212632 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:06:03.212632 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:06:03.212632 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:06:03.212632 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:06:03.212632 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 03:06:03.212632 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 03:06:03.212632 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 03:06:03.212632 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 03:06:03.212632 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 03:06:03.212632 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 03:06:03.212632 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Aug 27 03:06:03.212632 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:03.212632 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:06:03.212632 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:03.212632 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:03.212632 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:06:03.212632 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:06:03.212632 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 03:06:03.212632 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 03:06:03.212632 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Aug 27 03:06:03.212632 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:03.216125 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-cdaf9621-cb04-4ae4-8093-00b3d8608aeb tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:06:03.218314 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-cdaf9621-cb04-4ae4-8093-00b3d8608aeb tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.037156 Aug 27 03:06:03.219610 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2365/4697] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 03:06:03 2022] POST /compute/v2.1/servers => generated 139 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:06:03.228931 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-df75eba0-7982-4dcf-994f-5e4404f46d9d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:03.229870 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-df75eba0-7982-4dcf-994f-5e4404f46d9d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:03.236467 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-df75eba0-7982-4dcf-994f-5e4404f46d9d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:03.237013 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-df75eba0-7982-4dcf-994f-5e4404f46d9d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:03.237613 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-df75eba0-7982-4dcf-994f-5e4404f46d9d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:03.238623 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-df75eba0-7982-4dcf-994f-5e4404f46d9d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:03.239302 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-df75eba0-7982-4dcf-994f-5e4404f46d9d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:03.239999 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-df75eba0-7982-4dcf-994f-5e4404f46d9d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:03.387909 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-df75eba0-7982-4dcf-994f-5e4404f46d9d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:03.396451 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-df75eba0-7982-4dcf-994f-5e4404f46d9d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1504 microversion: 2.1 time: 0.172241 Aug 27 03:06:03.397352 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2333/4698] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:03 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1504 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:03.417171 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c6195cc2-763a-4618-82a3-e80448e62f20 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:03.417761 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-c6195cc2-763a-4618-82a3-e80448e62f20 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:03.425847 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c6195cc2-763a-4618-82a3-e80448e62f20 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:03.426337 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c6195cc2-763a-4618-82a3-e80448e62f20 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:03.426877 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c6195cc2-763a-4618-82a3-e80448e62f20 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:03.427518 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c6195cc2-763a-4618-82a3-e80448e62f20 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:03.428161 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c6195cc2-763a-4618-82a3-e80448e62f20 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:03.428620 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c6195cc2-763a-4618-82a3-e80448e62f20 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:03.580137 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-c6195cc2-763a-4618-82a3-e80448e62f20 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:03.582782 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-016860f8-825e-487e-b886-9e7c0fcbbd0e tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:03.583483 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-016860f8-825e-487e-b886-9e7c0fcbbd0e tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: eeb71517-05bf-488e-98b1-04d8a140e079] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:03.586550 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=100 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:06:03.589997 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c6195cc2-763a-4618-82a3-e80448e62f20 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1504 microversion: 2.1 time: 0.176607 Aug 27 03:06:03.590210 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-016860f8-825e-487e-b886-9e7c0fcbbd0e tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:03.591039 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2366/4699] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:03 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1504 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:03.605103 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-016860f8-825e-487e-b886-9e7c0fcbbd0e tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:03.605681 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-016860f8-825e-487e-b886-9e7c0fcbbd0e tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:03.606609 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-016860f8-825e-487e-b886-9e7c0fcbbd0e tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:03.607114 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-016860f8-825e-487e-b886-9e7c0fcbbd0e tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:03.612949 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-016860f8-825e-487e-b886-9e7c0fcbbd0e tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:03.779149 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-016860f8-825e-487e-b886-9e7c0fcbbd0e tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:03.788812 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-016860f8-825e-487e-b886-9e7c0fcbbd0e tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/eeb71517-05bf-488e-98b1-04d8a140e079" status: 200 len: 1511 microversion: 2.1 time: 0.210210 Aug 27 03:06:03.789593 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2334/4700] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:03 2022] GET /compute/v2.1/servers/eeb71517-05bf-488e-98b1-04d8a140e079 => generated 1511 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:03.827077 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-feee35b6-d34c-4fc5-8668-3fe4c3a2f5ad tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-165131894", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "7efdc19e-82eb-4610-897e-db10a92a0c7c"}]}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:06:03.831939 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-feee35b6-d34c-4fc5-8668-3fe4c3a2f5ad tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Request method failure captured: Aug 27 03:06:03.831939 n-d-852278-4 devstack@n-api.service[134051]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 03:06:03.831939 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 03:06:03.831939 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 03:06:03.831939 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 03:06:03.831939 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 234 Aug 27 03:06:03.831939 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 03:06:03.831939 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 03:06:03.831939 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 03:06:03.831939 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 03:06:03.831939 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYnkbLTKVFjPQ5m3U2fG0N9Vjn4DkHnl17m4V7uHpwM3jvJACULLjB_xlJxNaWj4ki5CLI0R9EDG2yAGWVsjkvndQFsX9xXnPLGqFClIfHjZt1hqpj87tFD2RLalZegHNDkz7eKDMcWIs2wG0Lp8X-uNjMToWPkkmABfSYkxwHfHBds Aug 27 03:06:03.831939 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 03:06:03.831939 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 03:06:03.831939 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 03:06:03.831939 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 03:06:03.831939 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 03:06:03.831939 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 03:06:03.831939 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 3b9e672ac89e41ff82355daa83e852bd Aug 27 03:06:03.831939 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:06:03.831939 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 03:06:03.831939 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 03:06:03.831939 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3b9e672ac89e41ff82355daa83e852bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3b9e672ac89e41ff82355daa83e852bd", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3b9e672ac89e41ff82355daa83e852bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3b9e672ac89e41ff82355daa83e852bd"}]}] Aug 27 03:06:03.831939 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:06:03.831939 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 3b9e672ac89e41ff82355daa83e852bd Aug 27 03:06:03.831939 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:06:03.831939 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ServersNegativeTestJSON-1795266674-project Aug 27 03:06:03.831939 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 03:06:03.831939 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 03:06:03.831939 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 204c90820f6d4c64b31367aaf098325c Aug 27 03:06:03.831939 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ServersNegativeTestJSON-1795266674-project Aug 27 03:06:03.831939 n-d-852278-4 devstack@n-api.service[134051]: Aug 27 03:06:03.831939 n-d-852278-4 devstack@n-api.service[134051]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-165131894", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "7efdc19e-82eb-4610-897e-db10a92a0c7c"}]}} Aug 27 03:06:03.831939 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 03:06:03.831939 n-d-852278-4 devstack@n-api.service[134051]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Aug 27 03:06:03.831939 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-165131894', 'imageRef': '1552acd0-176a-4c81-b680-29d74105e9d6', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '7efdc19e-82eb-4610-897e-db10a92a0c7c'}]}}} Aug 27 03:06:03.831939 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:06:03.831939 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:03.831939 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 27 03:06:03.831939 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 27 03:06:03.831939 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 243, in is_ipv6 Aug 27 03:06:03.831939 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Aug 27 03:06:03.831939 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Aug 27 03:06:03.831939 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Aug 27 03:06:03.831939 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Aug 27 03:06:03.831939 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Aug 27 03:06:03.831939 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Aug 27 03:06:03.831939 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:03.831939 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 27 03:06:03.831939 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:03.831939 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:03.831939 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 03:06:03.831939 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 03:06:03.831939 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 03:06:03.831939 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise error Aug 27 03:06:03.831939 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Aug 27 03:06:03.831939 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:03.831939 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Aug 27 03:06:03.831939 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Aug 27 03:06:03.831939 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:03.831939 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 27 03:06:03.831939 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi 'notvalid' Aug 27 03:06:03.831939 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:03.831939 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:06:03.831939 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:03.831939 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:03.837530 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:06:03.837530 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:06:03.837530 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:06:03.837530 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:06:03.837530 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:06:03.837530 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:06:03.837530 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:06:03.837530 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:06:03.837530 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 03:06:03.837530 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 03:06:03.837530 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 03:06:03.837530 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 03:06:03.837530 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 03:06:03.837530 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 03:06:03.837530 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Aug 27 03:06:03.837530 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:03.837530 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:06:03.837530 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:03.837530 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:03.837530 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:06:03.837530 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:06:03.837530 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 03:06:03.837530 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 03:06:03.837530 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Aug 27 03:06:03.837530 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:03.837530 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-feee35b6-d34c-4fc5-8668-3fe4c3a2f5ad tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:06:03.837530 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-feee35b6-d34c-4fc5-8668-3fe4c3a2f5ad tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.010928 Aug 27 03:06:03.837530 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2367/4701] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 03:06:03 2022] POST /compute/v2.1/servers => generated 133 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:06:03.842726 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-97e982a4-4c3c-448f-888f-9bac4ff8bb9a tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:03.843344 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-97e982a4-4c3c-448f-888f-9bac4ff8bb9a tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:03.852895 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-97e982a4-4c3c-448f-888f-9bac4ff8bb9a tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:03.853391 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-97e982a4-4c3c-448f-888f-9bac4ff8bb9a tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:03.853828 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-97e982a4-4c3c-448f-888f-9bac4ff8bb9a tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:03.854678 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-97e982a4-4c3c-448f-888f-9bac4ff8bb9a tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:03.855136 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-97e982a4-4c3c-448f-888f-9bac4ff8bb9a tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:03.855558 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-97e982a4-4c3c-448f-888f-9bac4ff8bb9a tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:04.026279 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-97e982a4-4c3c-448f-888f-9bac4ff8bb9a tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:04.035573 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-97e982a4-4c3c-448f-888f-9bac4ff8bb9a tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1504 microversion: 2.1 time: 0.196628 Aug 27 03:06:04.036874 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2335/4702] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:03 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1504 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:04.058683 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ccca43e9-3fba-4e9b-aac3-8a530c636e9e tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:04.059703 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-ccca43e9-3fba-4e9b-aac3-8a530c636e9e tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:04.070767 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ccca43e9-3fba-4e9b-aac3-8a530c636e9e tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:04.071761 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ccca43e9-3fba-4e9b-aac3-8a530c636e9e tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:04.072464 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ccca43e9-3fba-4e9b-aac3-8a530c636e9e tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:04.073963 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ccca43e9-3fba-4e9b-aac3-8a530c636e9e tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:04.074752 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ccca43e9-3fba-4e9b-aac3-8a530c636e9e tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:04.075517 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ccca43e9-3fba-4e9b-aac3-8a530c636e9e tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:04.275006 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-ccca43e9-3fba-4e9b-aac3-8a530c636e9e tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:04.283663 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ccca43e9-3fba-4e9b-aac3-8a530c636e9e tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1504 microversion: 2.1 time: 0.229655 Aug 27 03:06:04.284407 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2368/4703] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:04 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1504 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:04.304749 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c425686d-8c45-46fd-9d28-fb26e60e2dc2 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:06:04.305601 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-c425686d-8c45-46fd-9d28-fb26e60e2dc2 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: fde718a6-825c-4585-a1fa-b0356446db99] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:04.311629 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-c425686d-8c45-46fd-9d28-fb26e60e2dc2 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] HTTP exception thrown: Instance fde718a6-825c-4585-a1fa-b0356446db99 could not be found. Aug 27 03:06:04.321793 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c425686d-8c45-46fd-9d28-fb26e60e2dc2 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Request method failure captured: Aug 27 03:06:04.321793 n-d-852278-4 devstack@n-api.service[134052]: request: POST /compute/v2.1/servers/fde718a6-825c-4585-a1fa-b0356446db99/action HTTP/1.1 Aug 27 03:06:04.321793 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 03:06:04.321793 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 03:06:04.321793 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 03:06:04.321793 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 13 Aug 27 03:06:04.321793 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 03:06:04.321793 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 03:06:04.321793 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 03:06:04.321793 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 03:06:04.321793 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYnkbLTKVFjPQ5m3U2fG0N9Vjn4DkHnl17m4V7uHpwM3jvJACULLjB_xlJxNaWj4ki5CLI0R9EDG2yAGWVsjkvndQFsX9xXnPLGqFClIfHjZt1hqpj87tFD2RLalZegHNDkz7eKDMcWIs2wG0Lp8X-uNjMToWPkkmABfSYkxwHfHBds Aug 27 03:06:04.321793 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 03:06:04.321793 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 03:06:04.321793 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 03:06:04.321793 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 03:06:04.321793 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 03:06:04.321793 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 03:06:04.321793 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 3b9e672ac89e41ff82355daa83e852bd Aug 27 03:06:04.321793 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:06:04.321793 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 03:06:04.321793 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 03:06:04.321793 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3b9e672ac89e41ff82355daa83e852bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3b9e672ac89e41ff82355daa83e852bd", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3b9e672ac89e41ff82355daa83e852bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3b9e672ac89e41ff82355daa83e852bd"}]}] Aug 27 03:06:04.321793 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:06:04.321793 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 3b9e672ac89e41ff82355daa83e852bd Aug 27 03:06:04.321793 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:06:04.321793 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ServersNegativeTestJSON-1795266674-project Aug 27 03:06:04.321793 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 03:06:04.321793 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 03:06:04.321793 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 204c90820f6d4c64b31367aaf098325c Aug 27 03:06:04.321793 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ServersNegativeTestJSON-1795266674-project Aug 27 03:06:04.321793 n-d-852278-4 devstack@n-api.service[134052]: Aug 27 03:06:04.321793 n-d-852278-4 devstack@n-api.service[134052]: {"pause": {}} Aug 27 03:06:04.321793 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 03:06:04.321793 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance fde718a6-825c-4585-a1fa-b0356446db99 could not be found. Aug 27 03:06:04.321793 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': 'fde718a6-825c-4585-a1fa-b0356446db99', 'body': {'pause': {}}} Aug 27 03:06:04.321793 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:06:04.321793 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:04.321793 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:06:04.321793 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:06:04.321793 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:06:04.321793 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:06:04.321793 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 03:06:04.321793 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 03:06:04.321793 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fde718a6-825c-4585-a1fa-b0356446db99 could not be found. Aug 27 03:06:04.321793 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:06:04.321793 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:06:04.321793 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:06:04.321793 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:04.321793 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:06:04.321793 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:06:04.321793 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:06:04.321793 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:06:04.321793 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:06:04.321793 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:06:04.321793 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Aug 27 03:06:04.321793 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Aug 27 03:06:04.321793 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:06:04.321793 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:06:04.321793 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fde718a6-825c-4585-a1fa-b0356446db99 could not be found. Aug 27 03:06:04.321793 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:06:04.321793 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:06:04.321793 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:06:04.321793 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:04.321793 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:06:04.321793 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:06:04.327768 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:06:04.327768 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:06:04.327768 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fde718a6-825c-4585-a1fa-b0356446db99 could not be found. Aug 27 03:06:04.327768 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:06:04.327768 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c425686d-8c45-46fd-9d28-fb26e60e2dc2 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Returning 404 to user: Instance fde718a6-825c-4585-a1fa-b0356446db99 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:06:04.327768 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c425686d-8c45-46fd-9d28-fb26e60e2dc2 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "POST /compute/v2.1/servers/fde718a6-825c-4585-a1fa-b0356446db99/action" status: 404 len: 111 microversion: 2.1 time: 0.024989 Aug 27 03:06:04.337359 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8f21824b-c4d6-416b-a1cb-195a109b8b98 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:04.338401 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-8f21824b-c4d6-416b-a1cb-195a109b8b98 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:04.341502 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2336/4704] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:06:04 2022] POST /compute/v2.1/servers/fde718a6-825c-4585-a1fa-b0356446db99/action => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 03:06:04.344986 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8f21824b-c4d6-416b-a1cb-195a109b8b98 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:04.345571 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8f21824b-c4d6-416b-a1cb-195a109b8b98 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:04.346203 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8f21824b-c4d6-416b-a1cb-195a109b8b98 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:04.347035 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8f21824b-c4d6-416b-a1cb-195a109b8b98 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:04.347592 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8f21824b-c4d6-416b-a1cb-195a109b8b98 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:04.348486 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8f21824b-c4d6-416b-a1cb-195a109b8b98 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:04.568798 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-8f21824b-c4d6-416b-a1cb-195a109b8b98 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:04.585624 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-8f21824b-c4d6-416b-a1cb-195a109b8b98 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1504 microversion: 2.1 time: 0.252131 Aug 27 03:06:04.601245 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2369/4705] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:04 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1504 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:06:04.612238 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-35822d4d-bc41-4966-95c8-f85a6f4f9087 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:04.613575 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-35822d4d-bc41-4966-95c8-f85a6f4f9087 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:04.623699 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-35822d4d-bc41-4966-95c8-f85a6f4f9087 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:04.625315 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-35822d4d-bc41-4966-95c8-f85a6f4f9087 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:04.626050 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-35822d4d-bc41-4966-95c8-f85a6f4f9087 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:04.627372 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-35822d4d-bc41-4966-95c8-f85a6f4f9087 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:04.628293 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-35822d4d-bc41-4966-95c8-f85a6f4f9087 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:04.629036 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-35822d4d-bc41-4966-95c8-f85a6f4f9087 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:04.810308 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c3fdbdea-9dff-4e2f-9ac1-756adfa06e47 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:04.811010 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-c3fdbdea-9dff-4e2f-9ac1-756adfa06e47 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: eeb71517-05bf-488e-98b1-04d8a140e079] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:04.819814 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c3fdbdea-9dff-4e2f-9ac1-756adfa06e47 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:04.820351 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c3fdbdea-9dff-4e2f-9ac1-756adfa06e47 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:04.824989 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c3fdbdea-9dff-4e2f-9ac1-756adfa06e47 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:04.825763 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c3fdbdea-9dff-4e2f-9ac1-756adfa06e47 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:04.826295 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c3fdbdea-9dff-4e2f-9ac1-756adfa06e47 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:04.826738 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c3fdbdea-9dff-4e2f-9ac1-756adfa06e47 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:04.877650 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-35822d4d-bc41-4966-95c8-f85a6f4f9087 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:04.891109 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-35822d4d-bc41-4966-95c8-f85a6f4f9087 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1504 microversion: 2.1 time: 0.284044 Aug 27 03:06:04.891934 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2337/4706] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:04 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1504 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:04.915528 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6689d3b1-8153-4b12-8590-9293affd0ce4 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:06:04.916354 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-6689d3b1-8153-4b12-8590-9293affd0ce4 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:04.926494 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6689d3b1-8153-4b12-8590-9293affd0ce4 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:04.927675 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6689d3b1-8153-4b12-8590-9293affd0ce4 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:04.931033 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6689d3b1-8153-4b12-8590-9293affd0ce4 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:04.931968 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6689d3b1-8153-4b12-8590-9293affd0ce4 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:04.932618 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6689d3b1-8153-4b12-8590-9293affd0ce4 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:04.936706 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6689d3b1-8153-4b12-8590-9293affd0ce4 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:05.041556 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-c3fdbdea-9dff-4e2f-9ac1-756adfa06e47 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:05.052808 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-6689d3b1-8153-4b12-8590-9293affd0ce4 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "POST /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb/action" status: 202 len: 0 microversion: 2.1 time: 0.140663 Aug 27 03:06:05.053004 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c3fdbdea-9dff-4e2f-9ac1-756adfa06e47 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/eeb71517-05bf-488e-98b1-04d8a140e079" status: 200 len: 1511 microversion: 2.1 time: 0.245920 Aug 27 03:06:05.053344 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2370/4707] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:04 2022] GET /compute/v2.1/servers/eeb71517-05bf-488e-98b1-04d8a140e079 => generated 1511 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:05.054558 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2338/4708] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:06:04 2022] POST /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb/action => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:06:05.063637 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-768e64c7-ec61-43b6-baee-764f9b00e2f7 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:05.064902 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-768e64c7-ec61-43b6-baee-764f9b00e2f7 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:05.073285 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-768e64c7-ec61-43b6-baee-764f9b00e2f7 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:05.074155 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-768e64c7-ec61-43b6-baee-764f9b00e2f7 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:05.075192 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-768e64c7-ec61-43b6-baee-764f9b00e2f7 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:05.076825 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-768e64c7-ec61-43b6-baee-764f9b00e2f7 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:05.077669 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-768e64c7-ec61-43b6-baee-764f9b00e2f7 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:05.078363 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-768e64c7-ec61-43b6-baee-764f9b00e2f7 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:05.253857 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-768e64c7-ec61-43b6-baee-764f9b00e2f7 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:05.262045 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-768e64c7-ec61-43b6-baee-764f9b00e2f7 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1509 microversion: 2.1 time: 0.203049 Aug 27 03:06:05.264690 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2371/4709] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:05 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1509 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:06:06.078366 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-77f23b08-5b1a-4b9f-be7b-621fc74854ee tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:06.079560 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-77f23b08-5b1a-4b9f-be7b-621fc74854ee tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: eeb71517-05bf-488e-98b1-04d8a140e079] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:06.089082 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-77f23b08-5b1a-4b9f-be7b-621fc74854ee tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:06.089738 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-77f23b08-5b1a-4b9f-be7b-621fc74854ee tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:06.090287 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-77f23b08-5b1a-4b9f-be7b-621fc74854ee tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:06.091290 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-77f23b08-5b1a-4b9f-be7b-621fc74854ee tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:06.091849 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-77f23b08-5b1a-4b9f-be7b-621fc74854ee tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:06.092397 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-77f23b08-5b1a-4b9f-be7b-621fc74854ee tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:06.287435 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-99169462-9b9d-45f6-8663-20b5493f2851 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:06.289062 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-99169462-9b9d-45f6-8663-20b5493f2851 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:06.296938 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-99169462-9b9d-45f6-8663-20b5493f2851 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:06.297685 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-99169462-9b9d-45f6-8663-20b5493f2851 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:06.298405 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-99169462-9b9d-45f6-8663-20b5493f2851 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:06.299658 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-99169462-9b9d-45f6-8663-20b5493f2851 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:06.300479 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-99169462-9b9d-45f6-8663-20b5493f2851 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:06.301144 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-99169462-9b9d-45f6-8663-20b5493f2851 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:06.394490 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-77f23b08-5b1a-4b9f-be7b-621fc74854ee tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:06.403757 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-77f23b08-5b1a-4b9f-be7b-621fc74854ee tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/eeb71517-05bf-488e-98b1-04d8a140e079" status: 200 len: 1511 microversion: 2.1 time: 0.332505 Aug 27 03:06:06.406926 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2339/4710] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:06 2022] GET /compute/v2.1/servers/eeb71517-05bf-488e-98b1-04d8a140e079 => generated 1511 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:06.592729 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-99169462-9b9d-45f6-8663-20b5493f2851 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:06.606361 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-99169462-9b9d-45f6-8663-20b5493f2851 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1489 microversion: 2.1 time: 0.324114 Aug 27 03:06:06.607355 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2372/4711] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:06 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1489 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:06.631548 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-259a0640-217e-481a-a64b-53df5975ccc6 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:06:06.632537 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-259a0640-217e-481a-a64b-53df5975ccc6 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:06.643790 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-259a0640-217e-481a-a64b-53df5975ccc6 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:06.647410 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-259a0640-217e-481a-a64b-53df5975ccc6 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:06.647962 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-259a0640-217e-481a-a64b-53df5975ccc6 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:06.654079 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-259a0640-217e-481a-a64b-53df5975ccc6 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:06.654754 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-259a0640-217e-481a-a64b-53df5975ccc6 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:06.655333 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-259a0640-217e-481a-a64b-53df5975ccc6 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:06.709325 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-259a0640-217e-481a-a64b-53df5975ccc6 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] HTTP exception thrown: Cannot 'pause' instance 72ffd032-b609-4e42-90d9-5454ac648eeb while it is in vm_state paused Aug 27 03:06:06.711506 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-259a0640-217e-481a-a64b-53df5975ccc6 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Request method failure captured: Aug 27 03:06:06.711506 n-d-852278-4 devstack@n-api.service[134052]: request: POST /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb/action HTTP/1.1 Aug 27 03:06:06.711506 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 03:06:06.711506 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 03:06:06.711506 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 03:06:06.711506 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 13 Aug 27 03:06:06.711506 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 03:06:06.711506 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 03:06:06.711506 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 03:06:06.711506 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 03:06:06.711506 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYnkbLTKVFjPQ5m3U2fG0N9Vjn4DkHnl17m4V7uHpwM3jvJACULLjB_xlJxNaWj4ki5CLI0R9EDG2yAGWVsjkvndQFsX9xXnPLGqFClIfHjZt1hqpj87tFD2RLalZegHNDkz7eKDMcWIs2wG0Lp8X-uNjMToWPkkmABfSYkxwHfHBds Aug 27 03:06:06.711506 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 03:06:06.711506 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 03:06:06.711506 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 03:06:06.711506 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 03:06:06.711506 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 03:06:06.711506 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 03:06:06.711506 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 3b9e672ac89e41ff82355daa83e852bd Aug 27 03:06:06.711506 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:06:06.711506 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 03:06:06.711506 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 03:06:06.711506 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3b9e672ac89e41ff82355daa83e852bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3b9e672ac89e41ff82355daa83e852bd", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3b9e672ac89e41ff82355daa83e852bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3b9e672ac89e41ff82355daa83e852bd"}]}] Aug 27 03:06:06.711506 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:06:06.711506 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 3b9e672ac89e41ff82355daa83e852bd Aug 27 03:06:06.711506 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:06:06.711506 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ServersNegativeTestJSON-1795266674-project Aug 27 03:06:06.711506 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 03:06:06.711506 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 03:06:06.711506 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 204c90820f6d4c64b31367aaf098325c Aug 27 03:06:06.711506 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ServersNegativeTestJSON-1795266674-project Aug 27 03:06:06.711506 n-d-852278-4 devstack@n-api.service[134052]: Aug 27 03:06:06.711506 n-d-852278-4 devstack@n-api.service[134052]: {"pause": {}} Aug 27 03:06:06.711506 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 03:06:06.711506 n-d-852278-4 devstack@n-api.service[134052]: exception: Cannot 'pause' instance 72ffd032-b609-4e42-90d9-5454ac648eeb while it is in vm_state paused Aug 27 03:06:06.711506 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '72ffd032-b609-4e42-90d9-5454ac648eeb', 'body': {'pause': {}}} Aug 27 03:06:06.711506 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:06:06.711506 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:06.711506 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Aug 27 03:06:06.711506 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Aug 27 03:06:06.711506 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 03:06:06.711506 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 03:06:06.711506 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 27 03:06:06.711506 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 27 03:06:06.711506 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 72ffd032-b609-4e42-90d9-5454ac648eeb in vm_state paused. Cannot pause while the instance is in this state. Aug 27 03:06:06.711506 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:06:06.711506 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:06:06.711506 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:06:06.711506 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:06.711506 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:06:06.711506 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:06:06.711506 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:06:06.711506 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:06:06.711506 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:06:06.711506 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:06:06.711506 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Aug 27 03:06:06.711506 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 27 03:06:06.711506 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 27 03:06:06.711506 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 27 03:06:06.711506 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 72ffd032-b609-4e42-90d9-5454ac648eeb while it is in vm_state paused Aug 27 03:06:06.711506 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:06:06.711506 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:06:06.711506 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:06:06.711506 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:06.711506 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:06:06.787240 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:06:06.787240 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:06:06.787240 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:06:06.787240 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 72ffd032-b609-4e42-90d9-5454ac648eeb while it is in vm_state paused Aug 27 03:06:06.787240 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:06:06.787240 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-259a0640-217e-481a-a64b-53df5975ccc6 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Returning 409 to user: Cannot 'pause' instance 72ffd032-b609-4e42-90d9-5454ac648eeb while it is in vm_state paused {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:06:06.787240 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-259a0640-217e-481a-a64b-53df5975ccc6 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "POST /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb/action" status: 409 len: 143 microversion: 2.1 time: 0.100188 Aug 27 03:06:06.787240 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2340/4712] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:06:06 2022] POST /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb/action => generated 143 bytes in 110 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 27 03:06:06.790493 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ceb5a83e-2278-48bc-88d6-ee3bb2cae853 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:06:06.790493 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-ceb5a83e-2278-48bc-88d6-ee3bb2cae853 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:06.790493 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ceb5a83e-2278-48bc-88d6-ee3bb2cae853 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:06.790493 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ceb5a83e-2278-48bc-88d6-ee3bb2cae853 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:06.790493 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ceb5a83e-2278-48bc-88d6-ee3bb2cae853 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:06.790493 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ceb5a83e-2278-48bc-88d6-ee3bb2cae853 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:06.790493 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ceb5a83e-2278-48bc-88d6-ee3bb2cae853 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:06.790493 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ceb5a83e-2278-48bc-88d6-ee3bb2cae853 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:06.863926 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ceb5a83e-2278-48bc-88d6-ee3bb2cae853 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "POST /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb/action" status: 202 len: 0 microversion: 2.1 time: 0.116428 Aug 27 03:06:06.874256 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3f28ef25-2298-4207-bf59-656f9631b924 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:06.875249 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-3f28ef25-2298-4207-bf59-656f9631b924 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:06.878915 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2373/4713] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:06:06 2022] POST /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:06:06.884752 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3f28ef25-2298-4207-bf59-656f9631b924 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:06.885657 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3f28ef25-2298-4207-bf59-656f9631b924 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:06.886453 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3f28ef25-2298-4207-bf59-656f9631b924 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:06.887412 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3f28ef25-2298-4207-bf59-656f9631b924 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:06.888220 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3f28ef25-2298-4207-bf59-656f9631b924 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:06.888870 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3f28ef25-2298-4207-bf59-656f9631b924 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:07.187627 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-3f28ef25-2298-4207-bf59-656f9631b924 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:07.235794 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-3f28ef25-2298-4207-bf59-656f9631b924 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1496 microversion: 2.1 time: 0.363270 Aug 27 03:06:07.240619 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2341/4714] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:06 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1496 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:07.429380 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-35c4cfa7-690b-4538-9c49-5593ad46583f tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:07.430538 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-35c4cfa7-690b-4538-9c49-5593ad46583f tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: eeb71517-05bf-488e-98b1-04d8a140e079] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:07.443443 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-35c4cfa7-690b-4538-9c49-5593ad46583f tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:07.444104 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-35c4cfa7-690b-4538-9c49-5593ad46583f tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:07.444856 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-35c4cfa7-690b-4538-9c49-5593ad46583f tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:07.445735 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-35c4cfa7-690b-4538-9c49-5593ad46583f tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:07.446328 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-35c4cfa7-690b-4538-9c49-5593ad46583f tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:07.446895 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-35c4cfa7-690b-4538-9c49-5593ad46583f tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:07.746292 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-35c4cfa7-690b-4538-9c49-5593ad46583f tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:07.758524 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-35c4cfa7-690b-4538-9c49-5593ad46583f tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/eeb71517-05bf-488e-98b1-04d8a140e079" status: 200 len: 1511 microversion: 2.1 time: 0.334725 Aug 27 03:06:07.774329 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2374/4715] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:07 2022] GET /compute/v2.1/servers/eeb71517-05bf-488e-98b1-04d8a140e079 => generated 1511 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:06:08.265881 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e0f890f6-3de6-48a4-a702-8476512fe104 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:08.266641 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-e0f890f6-3de6-48a4-a702-8476512fe104 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:08.281139 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e0f890f6-3de6-48a4-a702-8476512fe104 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:08.281953 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e0f890f6-3de6-48a4-a702-8476512fe104 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:08.282512 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e0f890f6-3de6-48a4-a702-8476512fe104 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:08.283373 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e0f890f6-3de6-48a4-a702-8476512fe104 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:08.284295 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e0f890f6-3de6-48a4-a702-8476512fe104 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:08.284754 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e0f890f6-3de6-48a4-a702-8476512fe104 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:08.527672 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-e0f890f6-3de6-48a4-a702-8476512fe104 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:08.539357 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e8709bc1-01cc-4520-ab75-816b73e9d342 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1488197711", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "networks": [{"uuid": "8521d297-b625-4a0b-9a27-8f0bb47922bd"}]}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:06:08.549395 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e0f890f6-3de6-48a4-a702-8476512fe104 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1504 microversion: 2.1 time: 0.289009 Aug 27 03:06:08.556688 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2342/4716] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:08 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1504 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:08.580229 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-92f1a036-d957-441a-94be-1fa9b8d8894e tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:08.581663 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-92f1a036-d957-441a-94be-1fa9b8d8894e tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:08.594883 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-92f1a036-d957-441a-94be-1fa9b8d8894e tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:08.595731 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-92f1a036-d957-441a-94be-1fa9b8d8894e tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:08.596628 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-92f1a036-d957-441a-94be-1fa9b8d8894e tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:08.599420 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-92f1a036-d957-441a-94be-1fa9b8d8894e tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:08.600120 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-92f1a036-d957-441a-94be-1fa9b8d8894e tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:08.601400 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-92f1a036-d957-441a-94be-1fa9b8d8894e tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:08.654859 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.network.neutron [None req-e8709bc1-01cc-4520-ab75-816b73e9d342 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] validate_networks() for [('8521d297-b625-4a0b-9a27-8f0bb47922bd', None, None, None, None, None)] {{(pid=134051) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:06:08.959203 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-92f1a036-d957-441a-94be-1fa9b8d8894e tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:08.967582 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-92f1a036-d957-441a-94be-1fa9b8d8894e tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1504 microversion: 2.1 time: 0.392098 Aug 27 03:06:08.968595 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2343/4717] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:08 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1504 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:08.973543 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-650550a5-8ac9-4a9e-8f2c-e619ee63f997 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:08.974316 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-650550a5-8ac9-4a9e-8f2c-e619ee63f997 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: eeb71517-05bf-488e-98b1-04d8a140e079] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:08.990422 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-650550a5-8ac9-4a9e-8f2c-e619ee63f997 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:08.991082 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-650550a5-8ac9-4a9e-8f2c-e619ee63f997 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:08.991774 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-650550a5-8ac9-4a9e-8f2c-e619ee63f997 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:08.992661 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-650550a5-8ac9-4a9e-8f2c-e619ee63f997 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:08.993250 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-650550a5-8ac9-4a9e-8f2c-e619ee63f997 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:08.993820 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-650550a5-8ac9-4a9e-8f2c-e619ee63f997 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:09.376441 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-650550a5-8ac9-4a9e-8f2c-e619ee63f997 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:09.389192 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-650550a5-8ac9-4a9e-8f2c-e619ee63f997 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/eeb71517-05bf-488e-98b1-04d8a140e079" status: 200 len: 1511 microversion: 2.1 time: 0.419191 Aug 27 03:06:09.390730 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2344/4718] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:08 2022] GET /compute/v2.1/servers/eeb71517-05bf-488e-98b1-04d8a140e079 => generated 1511 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:09.405914 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-411d5de1-30fd-4c86-b4e6-c0df10e61b48 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:06:09.410314 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-411d5de1-30fd-4c86-b4e6-c0df10e61b48 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: b297dc39-8475-45f7-ab5e-20a3db6d1e44] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:09.425946 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-411d5de1-30fd-4c86-b4e6-c0df10e61b48 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:09.426441 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-411d5de1-30fd-4c86-b4e6-c0df10e61b48 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:09.426880 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-411d5de1-30fd-4c86-b4e6-c0df10e61b48 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:09.427755 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-411d5de1-30fd-4c86-b4e6-c0df10e61b48 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:09.428204 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-411d5de1-30fd-4c86-b4e6-c0df10e61b48 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:09.430733 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-411d5de1-30fd-4c86-b4e6-c0df10e61b48 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:09.441252 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-e8709bc1-01cc-4520-ab75-816b73e9d342 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Flavor limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:06:09.441671 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-e8709bc1-01cc-4520-ab75-816b73e9d342 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Image limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:06:09.442415 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-e8709bc1-01cc-4520-ab75-816b73e9d342 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Flavor pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:06:09.442829 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-e8709bc1-01cc-4520-ab75-816b73e9d342 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Image pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:06:09.443245 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-e8709bc1-01cc-4520-ab75-816b73e9d342 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:06:09.458369 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e8709bc1-01cc-4520-ab75-816b73e9d342 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:09.458868 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e8709bc1-01cc-4520-ab75-816b73e9d342 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:09.460063 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e8709bc1-01cc-4520-ab75-816b73e9d342 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:09.461457 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e8709bc1-01cc-4520-ab75-816b73e9d342 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:09.462141 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e8709bc1-01cc-4520-ab75-816b73e9d342 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:09.462861 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e8709bc1-01cc-4520-ab75-816b73e9d342 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:09.469614 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-411d5de1-30fd-4c86-b4e6-c0df10e61b48 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] HTTP exception thrown: Instance b297dc39-8475-45f7-ab5e-20a3db6d1e44 could not be found. Aug 27 03:06:09.471431 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-411d5de1-30fd-4c86-b4e6-c0df10e61b48 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Request method failure captured: Aug 27 03:06:09.471431 n-d-852278-4 devstack@n-api.service[134052]: request: POST /compute/v2.1/servers/b297dc39-8475-45f7-ab5e-20a3db6d1e44/action HTTP/1.1 Aug 27 03:06:09.471431 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 03:06:09.471431 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 03:06:09.471431 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 03:06:09.471431 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 28 Aug 27 03:06:09.471431 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 03:06:09.471431 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 03:06:09.471431 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 03:06:09.471431 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 03:06:09.471431 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYnkbLTKVFjPQ5m3U2fG0N9Vjn4DkHnl17m4V7uHpwM3jvJACULLjB_xlJxNaWj4ki5CLI0R9EDG2yAGWVsjkvndQFsX9xXnPLGqFClIfHjZt1hqpj87tFD2RLalZegHNDkz7eKDMcWIs2wG0Lp8X-uNjMToWPkkmABfSYkxwHfHBds Aug 27 03:06:09.471431 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 03:06:09.471431 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 03:06:09.471431 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 03:06:09.471431 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 03:06:09.471431 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 03:06:09.471431 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 03:06:09.471431 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 3b9e672ac89e41ff82355daa83e852bd Aug 27 03:06:09.471431 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:06:09.471431 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 03:06:09.471431 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 03:06:09.471431 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3b9e672ac89e41ff82355daa83e852bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3b9e672ac89e41ff82355daa83e852bd", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3b9e672ac89e41ff82355daa83e852bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3b9e672ac89e41ff82355daa83e852bd"}]}] Aug 27 03:06:09.471431 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:06:09.471431 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 3b9e672ac89e41ff82355daa83e852bd Aug 27 03:06:09.471431 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:06:09.471431 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ServersNegativeTestJSON-1795266674-project Aug 27 03:06:09.471431 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 03:06:09.471431 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 03:06:09.471431 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 204c90820f6d4c64b31367aaf098325c Aug 27 03:06:09.471431 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ServersNegativeTestJSON-1795266674-project Aug 27 03:06:09.471431 n-d-852278-4 devstack@n-api.service[134052]: Aug 27 03:06:09.471431 n-d-852278-4 devstack@n-api.service[134052]: {"reboot": {"type": "SOFT"}} Aug 27 03:06:09.471431 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 03:06:09.471431 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance b297dc39-8475-45f7-ab5e-20a3db6d1e44 could not be found. Aug 27 03:06:09.471431 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': 'b297dc39-8475-45f7-ab5e-20a3db6d1e44', 'body': {'reboot': {'type': 'SOFT'}}} Aug 27 03:06:09.471431 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:06:09.471431 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:09.471431 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:06:09.471431 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:06:09.471431 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:06:09.471431 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:06:09.471431 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:06:09.471431 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:06:09.471431 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:06:09.471431 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:06:09.471431 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b297dc39-8475-45f7-ab5e-20a3db6d1e44 could not be found. Aug 27 03:06:09.471431 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:06:09.471431 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:06:09.471431 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:06:09.471431 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:09.471431 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:06:09.471431 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:06:09.471431 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:06:09.471431 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:06:09.471431 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:06:09.471431 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:06:09.471431 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:06:09.471431 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:06:09.471431 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Aug 27 03:06:09.471431 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 27 03:06:09.471431 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:06:09.471431 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:06:09.471431 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:06:09.471431 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:06:09.474901 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b297dc39-8475-45f7-ab5e-20a3db6d1e44 could not be found. Aug 27 03:06:09.474901 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:06:09.474901 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:06:09.474901 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:06:09.474901 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:09.474901 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:06:09.474901 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:06:09.474901 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:06:09.474901 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:06:09.474901 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b297dc39-8475-45f7-ab5e-20a3db6d1e44 could not be found. Aug 27 03:06:09.474901 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:06:09.474901 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-411d5de1-30fd-4c86-b4e6-c0df10e61b48 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Returning 404 to user: Instance b297dc39-8475-45f7-ab5e-20a3db6d1e44 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:06:09.474901 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-411d5de1-30fd-4c86-b4e6-c0df10e61b48 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "POST /compute/v2.1/servers/b297dc39-8475-45f7-ab5e-20a3db6d1e44/action" status: 404 len: 111 microversion: 2.1 time: 0.080493 Aug 27 03:06:09.474901 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2345/4719] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:06:09 2022] POST /compute/v2.1/servers/b297dc39-8475-45f7-ab5e-20a3db6d1e44/action => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:06:09.485751 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9ee5e192-8ebf-4b9e-9ffd-87b60a32c391 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:09.486389 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-9ee5e192-8ebf-4b9e-9ffd-87b60a32c391 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:09.496025 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9ee5e192-8ebf-4b9e-9ffd-87b60a32c391 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:09.496613 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9ee5e192-8ebf-4b9e-9ffd-87b60a32c391 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:09.503761 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9ee5e192-8ebf-4b9e-9ffd-87b60a32c391 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:09.504798 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9ee5e192-8ebf-4b9e-9ffd-87b60a32c391 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:09.505537 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9ee5e192-8ebf-4b9e-9ffd-87b60a32c391 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:09.506121 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9ee5e192-8ebf-4b9e-9ffd-87b60a32c391 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:09.532805 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-e8709bc1-01cc-4520-ab75-816b73e9d342 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Getting quotas for project 88d58ec8819c4af9bb00a08e2ca12708. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:06:09.539364 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-e8709bc1-01cc-4520-ab75-816b73e9d342 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Getting quotas for user 0f3f67480c8a4ab8b538d4bebfa12d47 and project 88d58ec8819c4af9bb00a08e2ca12708. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:06:09.556114 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-e8709bc1-01cc-4520-ab75-816b73e9d342 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Going to run 1 instances... {{(pid=134051) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:06:09.559277 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-e8709bc1-01cc-4520-ab75-816b73e9d342 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] [instance: 879f248c-09b1-4e34-982e-bb8b75be03ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134051) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:06:09.592756 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:06:09.613519 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e8709bc1-01cc-4520-ab75-816b73e9d342 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.083851 Aug 27 03:06:09.614622 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2375/4720] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 03:06:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1086 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:06:09.626653 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-553cd77c-842e-41b2-a51b-6c17f7fb8a45 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:09.627276 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-553cd77c-842e-41b2-a51b-6c17f7fb8a45 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] [instance: 879f248c-09b1-4e34-982e-bb8b75be03ce] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:09.766485 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-553cd77c-842e-41b2-a51b-6c17f7fb8a45 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3f67480c8a4ab8b538d4bebfa12d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d58ec8819c4af9bb00a08e2ca12708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:09.784607 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-553cd77c-842e-41b2-a51b-6c17f7fb8a45 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] 10.222.0.70 "GET /compute/v2.1/servers/879f248c-09b1-4e34-982e-bb8b75be03ce" status: 200 len: 1214 microversion: 2.1 time: 0.162039 Aug 27 03:06:09.792489 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2376/4721] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:09 2022] GET /compute/v2.1/servers/879f248c-09b1-4e34-982e-bb8b75be03ce => generated 1214 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:06:09.856583 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-9ee5e192-8ebf-4b9e-9ffd-87b60a32c391 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:09.865224 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9ee5e192-8ebf-4b9e-9ffd-87b60a32c391 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1504 microversion: 2.1 time: 0.386486 Aug 27 03:06:09.868752 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2346/4722] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:09 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1504 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:06:09.893174 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ebb55097-0f41-435b-aa5b-ddfe945f35cb tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:09.893803 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-ebb55097-0f41-435b-aa5b-ddfe945f35cb tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:09.903018 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ebb55097-0f41-435b-aa5b-ddfe945f35cb tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:09.903539 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ebb55097-0f41-435b-aa5b-ddfe945f35cb tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:09.904049 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ebb55097-0f41-435b-aa5b-ddfe945f35cb tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:09.904725 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ebb55097-0f41-435b-aa5b-ddfe945f35cb tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:09.905536 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ebb55097-0f41-435b-aa5b-ddfe945f35cb tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:09.905969 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ebb55097-0f41-435b-aa5b-ddfe945f35cb tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:10.172552 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-ebb55097-0f41-435b-aa5b-ddfe945f35cb tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:10.201191 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ebb55097-0f41-435b-aa5b-ddfe945f35cb tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1504 microversion: 2.1 time: 0.313420 Aug 27 03:06:10.211851 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2377/4723] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:09 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1504 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:10.222008 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d8cb06ed-2bab-4003-bdac-5d55d504943f tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:06:10.225243 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d8cb06ed-2bab-4003-bdac-5d55d504943f tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: fe5cd4ad-a708-4016-85fd-0502dda69d28] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:10.239602 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-d8cb06ed-2bab-4003-bdac-5d55d504943f tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] HTTP exception thrown: Instance fe5cd4ad-a708-4016-85fd-0502dda69d28 could not be found. Aug 27 03:06:10.241437 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d8cb06ed-2bab-4003-bdac-5d55d504943f tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Request method failure captured: Aug 27 03:06:10.241437 n-d-852278-4 devstack@n-api.service[134052]: request: POST /compute/v2.1/servers/fe5cd4ad-a708-4016-85fd-0502dda69d28/action HTTP/1.1 Aug 27 03:06:10.241437 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 03:06:10.241437 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 03:06:10.241437 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 03:06:10.241437 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 28 Aug 27 03:06:10.241437 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 03:06:10.241437 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 03:06:10.241437 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 03:06:10.241437 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 03:06:10.241437 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYnkbLTKVFjPQ5m3U2fG0N9Vjn4DkHnl17m4V7uHpwM3jvJACULLjB_xlJxNaWj4ki5CLI0R9EDG2yAGWVsjkvndQFsX9xXnPLGqFClIfHjZt1hqpj87tFD2RLalZegHNDkz7eKDMcWIs2wG0Lp8X-uNjMToWPkkmABfSYkxwHfHBds Aug 27 03:06:10.241437 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 03:06:10.241437 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 03:06:10.241437 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 03:06:10.241437 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 03:06:10.241437 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 03:06:10.241437 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 03:06:10.241437 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 3b9e672ac89e41ff82355daa83e852bd Aug 27 03:06:10.241437 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:06:10.241437 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 03:06:10.241437 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 03:06:10.241437 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3b9e672ac89e41ff82355daa83e852bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3b9e672ac89e41ff82355daa83e852bd", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3b9e672ac89e41ff82355daa83e852bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3b9e672ac89e41ff82355daa83e852bd"}]}] Aug 27 03:06:10.241437 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:06:10.241437 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 3b9e672ac89e41ff82355daa83e852bd Aug 27 03:06:10.241437 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:06:10.241437 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ServersNegativeTestJSON-1795266674-project Aug 27 03:06:10.241437 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 03:06:10.241437 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 03:06:10.241437 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 204c90820f6d4c64b31367aaf098325c Aug 27 03:06:10.241437 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ServersNegativeTestJSON-1795266674-project Aug 27 03:06:10.241437 n-d-852278-4 devstack@n-api.service[134052]: Aug 27 03:06:10.241437 n-d-852278-4 devstack@n-api.service[134052]: {"reboot": {"type": "SOFT"}} Aug 27 03:06:10.241437 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 03:06:10.241437 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance fe5cd4ad-a708-4016-85fd-0502dda69d28 could not be found. Aug 27 03:06:10.241437 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': 'fe5cd4ad-a708-4016-85fd-0502dda69d28', 'body': {'reboot': {'type': 'SOFT'}}} Aug 27 03:06:10.241437 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:06:10.241437 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:10.241437 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:06:10.241437 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:06:10.241437 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:06:10.241437 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:06:10.241437 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 03:06:10.241437 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 03:06:10.241437 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe5cd4ad-a708-4016-85fd-0502dda69d28 could not be found. Aug 27 03:06:10.241437 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:06:10.241437 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:06:10.241437 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:06:10.241437 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:10.241437 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:06:10.241437 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:06:10.241437 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:06:10.241437 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:06:10.241437 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:06:10.241437 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:06:10.241437 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:06:10.241437 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:06:10.241437 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Aug 27 03:06:10.241437 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 27 03:06:10.241437 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:06:10.241437 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:06:10.241437 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:06:10.241437 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:06:10.241437 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe5cd4ad-a708-4016-85fd-0502dda69d28 could not be found. Aug 27 03:06:10.241437 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:06:10.244527 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:06:10.244527 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:06:10.244527 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:10.244527 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:06:10.244527 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:06:10.244527 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:06:10.244527 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:06:10.244527 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe5cd4ad-a708-4016-85fd-0502dda69d28 could not be found. Aug 27 03:06:10.244527 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:06:10.246497 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d8cb06ed-2bab-4003-bdac-5d55d504943f tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Returning 404 to user: Instance fe5cd4ad-a708-4016-85fd-0502dda69d28 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:06:10.247894 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d8cb06ed-2bab-4003-bdac-5d55d504943f tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "POST /compute/v2.1/servers/fe5cd4ad-a708-4016-85fd-0502dda69d28/action" status: 404 len: 111 microversion: 2.1 time: 0.029801 Aug 27 03:06:10.248735 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2347/4724] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:06:10 2022] POST /compute/v2.1/servers/fe5cd4ad-a708-4016-85fd-0502dda69d28/action => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:06:10.260103 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-6b02168f-81ef-46d4-9cfd-4135c031d44a tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:10.260741 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-6b02168f-81ef-46d4-9cfd-4135c031d44a tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:10.267839 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6b02168f-81ef-46d4-9cfd-4135c031d44a tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:10.268454 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6b02168f-81ef-46d4-9cfd-4135c031d44a tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:10.268787 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6b02168f-81ef-46d4-9cfd-4135c031d44a tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:10.269499 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6b02168f-81ef-46d4-9cfd-4135c031d44a tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:10.269948 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6b02168f-81ef-46d4-9cfd-4135c031d44a tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:10.270375 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6b02168f-81ef-46d4-9cfd-4135c031d44a tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:10.411577 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-1ce3db6b-7a9f-43b2-8b95-bee3d4c644aa tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:10.412790 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-1ce3db6b-7a9f-43b2-8b95-bee3d4c644aa tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: eeb71517-05bf-488e-98b1-04d8a140e079] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:10.424488 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1ce3db6b-7a9f-43b2-8b95-bee3d4c644aa tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:10.425665 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1ce3db6b-7a9f-43b2-8b95-bee3d4c644aa tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:10.426550 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1ce3db6b-7a9f-43b2-8b95-bee3d4c644aa tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:10.428213 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1ce3db6b-7a9f-43b2-8b95-bee3d4c644aa tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:10.429346 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1ce3db6b-7a9f-43b2-8b95-bee3d4c644aa tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:10.430652 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1ce3db6b-7a9f-43b2-8b95-bee3d4c644aa tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:10.514239 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-6b02168f-81ef-46d4-9cfd-4135c031d44a tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:10.537121 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-6b02168f-81ef-46d4-9cfd-4135c031d44a tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1504 microversion: 2.1 time: 0.282998 Aug 27 03:06:10.539377 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2378/4725] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:10 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1504 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:10.562327 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-17b0bb8e-a964-465a-9032-8fc8db1a1077 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:10.563562 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-17b0bb8e-a964-465a-9032-8fc8db1a1077 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:10.570230 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-17b0bb8e-a964-465a-9032-8fc8db1a1077 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:10.570972 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-17b0bb8e-a964-465a-9032-8fc8db1a1077 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:10.571554 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-17b0bb8e-a964-465a-9032-8fc8db1a1077 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:10.573138 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-17b0bb8e-a964-465a-9032-8fc8db1a1077 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:10.573642 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-17b0bb8e-a964-465a-9032-8fc8db1a1077 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:10.574081 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-17b0bb8e-a964-465a-9032-8fc8db1a1077 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:10.828685 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-1ce3db6b-7a9f-43b2-8b95-bee3d4c644aa tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:10.836890 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-1ce3db6b-7a9f-43b2-8b95-bee3d4c644aa tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/eeb71517-05bf-488e-98b1-04d8a140e079" status: 200 len: 1511 microversion: 2.1 time: 0.429081 Aug 27 03:06:10.843810 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2348/4726] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:10 2022] GET /compute/v2.1/servers/eeb71517-05bf-488e-98b1-04d8a140e079 => generated 1511 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:10.849304 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9e0ae72f-ec35-4e49-919e-7ec34de778fa tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:10.854371 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-9e0ae72f-ec35-4e49-919e-7ec34de778fa tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] [instance: 879f248c-09b1-4e34-982e-bb8b75be03ce] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:10.873377 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9e0ae72f-ec35-4e49-919e-7ec34de778fa tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:10.873932 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9e0ae72f-ec35-4e49-919e-7ec34de778fa tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:10.874370 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9e0ae72f-ec35-4e49-919e-7ec34de778fa tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:10.875101 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9e0ae72f-ec35-4e49-919e-7ec34de778fa tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:10.875536 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9e0ae72f-ec35-4e49-919e-7ec34de778fa tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:10.875957 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9e0ae72f-ec35-4e49-919e-7ec34de778fa tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:10.882330 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:06:10.910033 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-17b0bb8e-a964-465a-9032-8fc8db1a1077 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:10.919268 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-17b0bb8e-a964-465a-9032-8fc8db1a1077 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1504 microversion: 2.1 time: 0.361827 Aug 27 03:06:10.924864 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2379/4727] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:10 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1504 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:06:10.949006 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-5a20aff5-af40-40e6-8827-73eda849b2d1 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:06:10.952054 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-5a20aff5-af40-40e6-8827-73eda849b2d1 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: b297dc39-8475-45f7-ab5e-20a3db6d1e44] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:10.965122 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5a20aff5-af40-40e6-8827-73eda849b2d1 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:10.967975 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5a20aff5-af40-40e6-8827-73eda849b2d1 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:10.968617 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5a20aff5-af40-40e6-8827-73eda849b2d1 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:10.969821 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5a20aff5-af40-40e6-8827-73eda849b2d1 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:10.972785 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5a20aff5-af40-40e6-8827-73eda849b2d1 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:10.973257 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5a20aff5-af40-40e6-8827-73eda849b2d1 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:11.008210 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-5a20aff5-af40-40e6-8827-73eda849b2d1 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] HTTP exception thrown: Instance b297dc39-8475-45f7-ab5e-20a3db6d1e44 could not be found. Aug 27 03:06:11.010127 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-5a20aff5-af40-40e6-8827-73eda849b2d1 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Request method failure captured: Aug 27 03:06:11.010127 n-d-852278-4 devstack@n-api.service[134051]: request: POST /compute/v2.1/servers/b297dc39-8475-45f7-ab5e-20a3db6d1e44/action HTTP/1.1 Aug 27 03:06:11.010127 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 03:06:11.010127 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 03:06:11.010127 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 03:06:11.010127 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 65 Aug 27 03:06:11.010127 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 03:06:11.010127 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 03:06:11.010127 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 03:06:11.010127 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 03:06:11.010127 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYnkbLTKVFjPQ5m3U2fG0N9Vjn4DkHnl17m4V7uHpwM3jvJACULLjB_xlJxNaWj4ki5CLI0R9EDG2yAGWVsjkvndQFsX9xXnPLGqFClIfHjZt1hqpj87tFD2RLalZegHNDkz7eKDMcWIs2wG0Lp8X-uNjMToWPkkmABfSYkxwHfHBds Aug 27 03:06:11.010127 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 03:06:11.010127 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 03:06:11.010127 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 03:06:11.010127 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 03:06:11.010127 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 03:06:11.010127 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 03:06:11.010127 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 3b9e672ac89e41ff82355daa83e852bd Aug 27 03:06:11.010127 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:06:11.010127 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 03:06:11.010127 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 03:06:11.010127 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3b9e672ac89e41ff82355daa83e852bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3b9e672ac89e41ff82355daa83e852bd", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3b9e672ac89e41ff82355daa83e852bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3b9e672ac89e41ff82355daa83e852bd"}]}] Aug 27 03:06:11.010127 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:06:11.010127 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 3b9e672ac89e41ff82355daa83e852bd Aug 27 03:06:11.010127 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:06:11.010127 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ServersNegativeTestJSON-1795266674-project Aug 27 03:06:11.010127 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 03:06:11.010127 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 03:06:11.010127 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 204c90820f6d4c64b31367aaf098325c Aug 27 03:06:11.010127 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ServersNegativeTestJSON-1795266674-project Aug 27 03:06:11.010127 n-d-852278-4 devstack@n-api.service[134051]: Aug 27 03:06:11.010127 n-d-852278-4 devstack@n-api.service[134051]: {"rebuild": {"imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6"}} Aug 27 03:06:11.010127 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 03:06:11.010127 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance b297dc39-8475-45f7-ab5e-20a3db6d1e44 could not be found. Aug 27 03:06:11.010127 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': 'b297dc39-8475-45f7-ab5e-20a3db6d1e44', 'body': {'rebuild': {'imageRef': '1552acd0-176a-4c81-b680-29d74105e9d6'}}} Aug 27 03:06:11.010127 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:06:11.010127 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:11.010127 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:06:11.010127 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:06:11.010127 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:06:11.010127 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:06:11.010127 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:06:11.010127 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:06:11.010127 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:06:11.010127 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:06:11.010127 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b297dc39-8475-45f7-ab5e-20a3db6d1e44 could not be found. Aug 27 03:06:11.010127 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:11.010127 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:06:11.010127 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:11.010127 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:11.010127 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:06:11.010127 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:06:11.010127 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:06:11.010127 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:06:11.010127 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:06:11.010127 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:06:11.010127 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:06:11.010127 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:06:11.010127 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:06:11.010127 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:06:11.010127 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:06:11.010127 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:06:11.010127 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Aug 27 03:06:11.010127 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Aug 27 03:06:11.013079 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 27 03:06:11.013079 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:06:11.013079 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:06:11.013079 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:06:11.013079 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:06:11.013079 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b297dc39-8475-45f7-ab5e-20a3db6d1e44 could not be found. Aug 27 03:06:11.013079 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:11.013079 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:06:11.013079 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:11.013079 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:11.013079 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:06:11.013079 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:06:11.013079 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:06:11.013079 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:06:11.013079 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b297dc39-8475-45f7-ab5e-20a3db6d1e44 could not be found. Aug 27 03:06:11.013079 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:11.013079 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-5a20aff5-af40-40e6-8827-73eda849b2d1 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Returning 404 to user: Instance b297dc39-8475-45f7-ab5e-20a3db6d1e44 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:06:11.013079 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-5a20aff5-af40-40e6-8827-73eda849b2d1 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "POST /compute/v2.1/servers/b297dc39-8475-45f7-ab5e-20a3db6d1e44/action" status: 404 len: 111 microversion: 2.1 time: 0.067190 Aug 27 03:06:11.013079 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2380/4728] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:06:10 2022] POST /compute/v2.1/servers/b297dc39-8475-45f7-ab5e-20a3db6d1e44/action => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:06:11.016379 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-9e0ae72f-ec35-4e49-919e-7ec34de778fa tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3f67480c8a4ab8b538d4bebfa12d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d58ec8819c4af9bb00a08e2ca12708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:11.022764 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-30e81301-74a0-4955-80e8-2551f6759af3 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:11.023727 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-30e81301-74a0-4955-80e8-2551f6759af3 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:11.026969 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9e0ae72f-ec35-4e49-919e-7ec34de778fa tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] 10.222.0.70 "GET /compute/v2.1/servers/879f248c-09b1-4e34-982e-bb8b75be03ce" status: 200 len: 1266 microversion: 2.1 time: 0.181638 Aug 27 03:06:11.030319 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2349/4729] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:10 2022] GET /compute/v2.1/servers/879f248c-09b1-4e34-982e-bb8b75be03ce => generated 1266 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:11.031180 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-30e81301-74a0-4955-80e8-2551f6759af3 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:11.031978 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-30e81301-74a0-4955-80e8-2551f6759af3 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:11.032618 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-30e81301-74a0-4955-80e8-2551f6759af3 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:11.033627 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-30e81301-74a0-4955-80e8-2551f6759af3 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:11.034270 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-30e81301-74a0-4955-80e8-2551f6759af3 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:11.034847 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-30e81301-74a0-4955-80e8-2551f6759af3 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:11.210286 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-30e81301-74a0-4955-80e8-2551f6759af3 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:11.218099 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-30e81301-74a0-4955-80e8-2551f6759af3 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1504 microversion: 2.1 time: 0.200840 Aug 27 03:06:11.218782 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2381/4730] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:11 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1504 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:11.239534 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8392eef1-84d6-46e4-9a17-dc5b2436e29f tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:11.240149 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-8392eef1-84d6-46e4-9a17-dc5b2436e29f tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:11.246411 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8392eef1-84d6-46e4-9a17-dc5b2436e29f tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:11.246899 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8392eef1-84d6-46e4-9a17-dc5b2436e29f tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:11.247496 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8392eef1-84d6-46e4-9a17-dc5b2436e29f tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:11.248196 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8392eef1-84d6-46e4-9a17-dc5b2436e29f tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:11.248841 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8392eef1-84d6-46e4-9a17-dc5b2436e29f tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:11.249413 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8392eef1-84d6-46e4-9a17-dc5b2436e29f tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:11.408230 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-8392eef1-84d6-46e4-9a17-dc5b2436e29f tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:11.417622 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-8392eef1-84d6-46e4-9a17-dc5b2436e29f tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1504 microversion: 2.1 time: 0.181978 Aug 27 03:06:11.420396 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2350/4731] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:11 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1504 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:11.439443 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c35a50c7-dbd5-4213-bac5-734d5188eaea tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:06:11.448608 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-c35a50c7-dbd5-4213-bac5-734d5188eaea tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 907b546f-1458-4688-90e1-97318e39c030] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:11.464954 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-c35a50c7-dbd5-4213-bac5-734d5188eaea tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] HTTP exception thrown: Instance 907b546f-1458-4688-90e1-97318e39c030 could not be found. Aug 27 03:06:11.467057 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c35a50c7-dbd5-4213-bac5-734d5188eaea tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Request method failure captured: Aug 27 03:06:11.467057 n-d-852278-4 devstack@n-api.service[134051]: request: POST /compute/v2.1/servers/907b546f-1458-4688-90e1-97318e39c030/action HTTP/1.1 Aug 27 03:06:11.467057 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 03:06:11.467057 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 03:06:11.467057 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 03:06:11.467057 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 65 Aug 27 03:06:11.467057 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 03:06:11.467057 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 03:06:11.467057 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 03:06:11.467057 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 03:06:11.467057 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYnkbLTKVFjPQ5m3U2fG0N9Vjn4DkHnl17m4V7uHpwM3jvJACULLjB_xlJxNaWj4ki5CLI0R9EDG2yAGWVsjkvndQFsX9xXnPLGqFClIfHjZt1hqpj87tFD2RLalZegHNDkz7eKDMcWIs2wG0Lp8X-uNjMToWPkkmABfSYkxwHfHBds Aug 27 03:06:11.467057 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 03:06:11.467057 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 03:06:11.467057 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 03:06:11.467057 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 03:06:11.467057 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 03:06:11.467057 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 03:06:11.467057 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 3b9e672ac89e41ff82355daa83e852bd Aug 27 03:06:11.467057 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:06:11.467057 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 03:06:11.467057 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 03:06:11.467057 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3b9e672ac89e41ff82355daa83e852bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3b9e672ac89e41ff82355daa83e852bd", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3b9e672ac89e41ff82355daa83e852bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3b9e672ac89e41ff82355daa83e852bd"}]}] Aug 27 03:06:11.467057 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:06:11.467057 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 3b9e672ac89e41ff82355daa83e852bd Aug 27 03:06:11.467057 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:06:11.467057 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ServersNegativeTestJSON-1795266674-project Aug 27 03:06:11.467057 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 03:06:11.467057 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 03:06:11.467057 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 204c90820f6d4c64b31367aaf098325c Aug 27 03:06:11.467057 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ServersNegativeTestJSON-1795266674-project Aug 27 03:06:11.467057 n-d-852278-4 devstack@n-api.service[134051]: Aug 27 03:06:11.467057 n-d-852278-4 devstack@n-api.service[134051]: {"rebuild": {"imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6"}} Aug 27 03:06:11.467057 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 03:06:11.467057 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance 907b546f-1458-4688-90e1-97318e39c030 could not be found. Aug 27 03:06:11.467057 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '907b546f-1458-4688-90e1-97318e39c030', 'body': {'rebuild': {'imageRef': '1552acd0-176a-4c81-b680-29d74105e9d6'}}} Aug 27 03:06:11.467057 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:06:11.467057 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:11.467057 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:06:11.467057 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:06:11.467057 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:06:11.467057 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:06:11.467057 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 03:06:11.467057 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 03:06:11.467057 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 907b546f-1458-4688-90e1-97318e39c030 could not be found. Aug 27 03:06:11.467057 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:11.467057 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:06:11.467057 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:11.467057 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:11.467057 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:06:11.467057 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:06:11.467057 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:06:11.467057 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:06:11.467057 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:06:11.467057 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:06:11.467057 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:06:11.467057 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:06:11.467057 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:06:11.467057 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:06:11.467057 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:06:11.467057 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:06:11.467057 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Aug 27 03:06:11.467057 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Aug 27 03:06:11.467057 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 27 03:06:11.467057 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:06:11.470940 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:06:11.470940 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:06:11.470940 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:06:11.470940 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 907b546f-1458-4688-90e1-97318e39c030 could not be found. Aug 27 03:06:11.470940 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:11.470940 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:06:11.470940 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:11.470940 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:11.470940 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:06:11.470940 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:06:11.470940 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:06:11.470940 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:06:11.470940 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 907b546f-1458-4688-90e1-97318e39c030 could not be found. Aug 27 03:06:11.470940 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:11.470940 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c35a50c7-dbd5-4213-bac5-734d5188eaea tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Returning 404 to user: Instance 907b546f-1458-4688-90e1-97318e39c030 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:06:11.470940 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c35a50c7-dbd5-4213-bac5-734d5188eaea tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "POST /compute/v2.1/servers/907b546f-1458-4688-90e1-97318e39c030/action" status: 404 len: 111 microversion: 2.1 time: 0.034902 Aug 27 03:06:11.470940 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2382/4732] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:06:11 2022] POST /compute/v2.1/servers/907b546f-1458-4688-90e1-97318e39c030/action => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:06:11.479751 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-da8dfa17-04fb-40af-a34d-4fdc3d71f9a1 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:11.480630 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-da8dfa17-04fb-40af-a34d-4fdc3d71f9a1 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:11.489097 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-da8dfa17-04fb-40af-a34d-4fdc3d71f9a1 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:11.489706 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-da8dfa17-04fb-40af-a34d-4fdc3d71f9a1 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:11.490200 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-da8dfa17-04fb-40af-a34d-4fdc3d71f9a1 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:11.491020 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-da8dfa17-04fb-40af-a34d-4fdc3d71f9a1 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:11.491583 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-da8dfa17-04fb-40af-a34d-4fdc3d71f9a1 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:11.492165 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-da8dfa17-04fb-40af-a34d-4fdc3d71f9a1 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:11.776988 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-da8dfa17-04fb-40af-a34d-4fdc3d71f9a1 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:11.786139 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-da8dfa17-04fb-40af-a34d-4fdc3d71f9a1 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1504 microversion: 2.1 time: 0.311774 Aug 27 03:06:11.787390 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2351/4733] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:11 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1504 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:06:11.807858 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-2b77c399-de0d-44e7-a459-e24d29efcfd4 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:11.809562 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-2b77c399-de0d-44e7-a459-e24d29efcfd4 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:11.818302 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2b77c399-de0d-44e7-a459-e24d29efcfd4 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:11.819233 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2b77c399-de0d-44e7-a459-e24d29efcfd4 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:11.819912 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2b77c399-de0d-44e7-a459-e24d29efcfd4 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:11.820888 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2b77c399-de0d-44e7-a459-e24d29efcfd4 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:11.821543 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2b77c399-de0d-44e7-a459-e24d29efcfd4 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:11.822182 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2b77c399-de0d-44e7-a459-e24d29efcfd4 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:11.860468 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-45cd435d-899e-4fd9-bac6-7536023c2f5e tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:11.861077 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-45cd435d-899e-4fd9-bac6-7536023c2f5e tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: eeb71517-05bf-488e-98b1-04d8a140e079] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:11.868799 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-45cd435d-899e-4fd9-bac6-7536023c2f5e tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:11.869332 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-45cd435d-899e-4fd9-bac6-7536023c2f5e tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:11.869824 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-45cd435d-899e-4fd9-bac6-7536023c2f5e tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:11.872522 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-45cd435d-899e-4fd9-bac6-7536023c2f5e tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:11.874760 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-45cd435d-899e-4fd9-bac6-7536023c2f5e tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:11.876531 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-45cd435d-899e-4fd9-bac6-7536023c2f5e tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:12.150971 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-2b77c399-de0d-44e7-a459-e24d29efcfd4 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:12.160703 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-2b77c399-de0d-44e7-a459-e24d29efcfd4 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1504 microversion: 2.1 time: 0.357129 Aug 27 03:06:12.162842 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2383/4734] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:11 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1504 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:12.171448 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a0f040f2-ce67-4712-b304-0d2d31c323e1 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:12.172895 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-a0f040f2-ce67-4712-b304-0d2d31c323e1 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] [instance: 879f248c-09b1-4e34-982e-bb8b75be03ce] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:12.184963 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a0f040f2-ce67-4712-b304-0d2d31c323e1 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:12.186059 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a0f040f2-ce67-4712-b304-0d2d31c323e1 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:12.187018 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a0f040f2-ce67-4712-b304-0d2d31c323e1 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:12.187972 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a0f040f2-ce67-4712-b304-0d2d31c323e1 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:12.188732 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a0f040f2-ce67-4712-b304-0d2d31c323e1 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:12.189706 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a0f040f2-ce67-4712-b304-0d2d31c323e1 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:12.213426 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-45cd435d-899e-4fd9-bac6-7536023c2f5e tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:12.222177 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-45cd435d-899e-4fd9-bac6-7536023c2f5e tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/eeb71517-05bf-488e-98b1-04d8a140e079" status: 200 len: 1511 microversion: 2.1 time: 0.365652 Aug 27 03:06:12.222780 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2352/4735] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:11 2022] GET /compute/v2.1/servers/eeb71517-05bf-488e-98b1-04d8a140e079 => generated 1511 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:06:12.239435 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d48d8fc0-e896-40df-aacc-847f955fe652 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:06:12.239977 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d48d8fc0-e896-40df-aacc-847f955fe652 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 0fc137e8-c1b4-4070-9357-1442fc1c1ce6] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:12.250271 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-d48d8fc0-e896-40df-aacc-847f955fe652 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] HTTP exception thrown: Instance 0fc137e8-c1b4-4070-9357-1442fc1c1ce6 could not be found. Aug 27 03:06:12.252020 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d48d8fc0-e896-40df-aacc-847f955fe652 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Request method failure captured: Aug 27 03:06:12.252020 n-d-852278-4 devstack@n-api.service[134052]: request: POST /compute/v2.1/servers/0fc137e8-c1b4-4070-9357-1442fc1c1ce6/action HTTP/1.1 Aug 27 03:06:12.252020 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 03:06:12.252020 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 03:06:12.252020 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 03:06:12.252020 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 15 Aug 27 03:06:12.252020 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 03:06:12.252020 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 03:06:12.252020 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 03:06:12.252020 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 03:06:12.252020 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYnkbLTKVFjPQ5m3U2fG0N9Vjn4DkHnl17m4V7uHpwM3jvJACULLjB_xlJxNaWj4ki5CLI0R9EDG2yAGWVsjkvndQFsX9xXnPLGqFClIfHjZt1hqpj87tFD2RLalZegHNDkz7eKDMcWIs2wG0Lp8X-uNjMToWPkkmABfSYkxwHfHBds Aug 27 03:06:12.252020 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 03:06:12.252020 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 03:06:12.252020 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 03:06:12.252020 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 03:06:12.252020 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 03:06:12.252020 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 03:06:12.252020 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 3b9e672ac89e41ff82355daa83e852bd Aug 27 03:06:12.252020 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:06:12.252020 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 03:06:12.252020 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 03:06:12.252020 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3b9e672ac89e41ff82355daa83e852bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3b9e672ac89e41ff82355daa83e852bd", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3b9e672ac89e41ff82355daa83e852bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3b9e672ac89e41ff82355daa83e852bd"}]}] Aug 27 03:06:12.252020 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:06:12.252020 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 3b9e672ac89e41ff82355daa83e852bd Aug 27 03:06:12.252020 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:06:12.252020 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ServersNegativeTestJSON-1795266674-project Aug 27 03:06:12.252020 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 03:06:12.252020 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 03:06:12.252020 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 204c90820f6d4c64b31367aaf098325c Aug 27 03:06:12.252020 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ServersNegativeTestJSON-1795266674-project Aug 27 03:06:12.252020 n-d-852278-4 devstack@n-api.service[134052]: Aug 27 03:06:12.252020 n-d-852278-4 devstack@n-api.service[134052]: {"restore": {}} Aug 27 03:06:12.252020 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 03:06:12.252020 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance 0fc137e8-c1b4-4070-9357-1442fc1c1ce6 could not be found. Aug 27 03:06:12.252020 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '0fc137e8-c1b4-4070-9357-1442fc1c1ce6', 'body': {'restore': {}}} Aug 27 03:06:12.252020 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:06:12.252020 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:12.252020 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:06:12.252020 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:06:12.252020 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:06:12.252020 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:06:12.252020 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 03:06:12.252020 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 03:06:12.252020 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fc137e8-c1b4-4070-9357-1442fc1c1ce6 could not be found. Aug 27 03:06:12.252020 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:06:12.252020 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:06:12.252020 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:06:12.252020 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:12.252020 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:06:12.252020 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:06:12.252020 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:06:12.252020 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:06:12.252020 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:06:12.252020 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:06:12.252020 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Aug 27 03:06:12.252020 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 27 03:06:12.252020 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:06:12.252020 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:06:12.252020 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fc137e8-c1b4-4070-9357-1442fc1c1ce6 could not be found. Aug 27 03:06:12.252020 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:06:12.252020 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:06:12.252020 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:06:12.252020 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:12.252020 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:06:12.252020 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:06:12.255122 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:06:12.255122 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:06:12.255122 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fc137e8-c1b4-4070-9357-1442fc1c1ce6 could not be found. Aug 27 03:06:12.255122 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:06:12.255122 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d48d8fc0-e896-40df-aacc-847f955fe652 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Returning 404 to user: Instance 0fc137e8-c1b4-4070-9357-1442fc1c1ce6 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:06:12.255122 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d48d8fc0-e896-40df-aacc-847f955fe652 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "POST /compute/v2.1/servers/0fc137e8-c1b4-4070-9357-1442fc1c1ce6/action" status: 404 len: 111 microversion: 2.1 time: 0.029753 Aug 27 03:06:12.256883 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2353/4736] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:06:12 2022] POST /compute/v2.1/servers/0fc137e8-c1b4-4070-9357-1442fc1c1ce6/action => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:06:12.261912 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9f670fcf-fd56-49aa-995a-09b77a73b738 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:12.262516 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-9f670fcf-fd56-49aa-995a-09b77a73b738 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:12.273457 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9f670fcf-fd56-49aa-995a-09b77a73b738 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:12.273957 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9f670fcf-fd56-49aa-995a-09b77a73b738 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:12.274396 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9f670fcf-fd56-49aa-995a-09b77a73b738 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:12.275101 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9f670fcf-fd56-49aa-995a-09b77a73b738 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:12.275554 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9f670fcf-fd56-49aa-995a-09b77a73b738 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:12.275975 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9f670fcf-fd56-49aa-995a-09b77a73b738 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:12.335610 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-a0f040f2-ce67-4712-b304-0d2d31c323e1 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3f67480c8a4ab8b538d4bebfa12d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d58ec8819c4af9bb00a08e2ca12708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:12.343729 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a0f040f2-ce67-4712-b304-0d2d31c323e1 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] 10.222.0.70 "GET /compute/v2.1/servers/879f248c-09b1-4e34-982e-bb8b75be03ce" status: 200 len: 1272 microversion: 2.1 time: 0.179422 Aug 27 03:06:12.344350 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2384/4737] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:12 2022] GET /compute/v2.1/servers/879f248c-09b1-4e34-982e-bb8b75be03ce => generated 1272 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:12.545204 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-9f670fcf-fd56-49aa-995a-09b77a73b738 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:12.554488 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9f670fcf-fd56-49aa-995a-09b77a73b738 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1504 microversion: 2.1 time: 0.296240 Aug 27 03:06:12.556091 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2354/4738] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:12 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1504 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:12.576570 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-49882d49-9bd7-4a4e-9923-09c8282aa49a tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:12.577476 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-49882d49-9bd7-4a4e-9923-09c8282aa49a tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:12.584710 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-49882d49-9bd7-4a4e-9923-09c8282aa49a tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:12.585231 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-49882d49-9bd7-4a4e-9923-09c8282aa49a tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:12.585656 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-49882d49-9bd7-4a4e-9923-09c8282aa49a tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:12.586362 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-49882d49-9bd7-4a4e-9923-09c8282aa49a tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:12.586810 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-49882d49-9bd7-4a4e-9923-09c8282aa49a tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:12.587537 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-49882d49-9bd7-4a4e-9923-09c8282aa49a tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:13.215560 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-49882d49-9bd7-4a4e-9923-09c8282aa49a tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:13.224920 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-49882d49-9bd7-4a4e-9923-09c8282aa49a tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1504 microversion: 2.1 time: 0.653086 Aug 27 03:06:13.225519 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2385/4739] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:12 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1504 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:13.244445 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-069dceff-5ed7-489a-9da8-e29113c98986 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:13.252177 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c44a46bc-25a3-4cf4-b0c9-f8ea085c6065 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:06:13.253219 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-c44a46bc-25a3-4cf4-b0c9-f8ea085c6065 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:13.255873 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-069dceff-5ed7-489a-9da8-e29113c98986 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: eeb71517-05bf-488e-98b1-04d8a140e079] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:13.259436 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c44a46bc-25a3-4cf4-b0c9-f8ea085c6065 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:13.260266 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c44a46bc-25a3-4cf4-b0c9-f8ea085c6065 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:13.260936 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c44a46bc-25a3-4cf4-b0c9-f8ea085c6065 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:13.261981 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c44a46bc-25a3-4cf4-b0c9-f8ea085c6065 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:13.262904 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c44a46bc-25a3-4cf4-b0c9-f8ea085c6065 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:13.263739 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c44a46bc-25a3-4cf4-b0c9-f8ea085c6065 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:13.265263 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-069dceff-5ed7-489a-9da8-e29113c98986 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:13.265813 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-069dceff-5ed7-489a-9da8-e29113c98986 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:13.266397 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-069dceff-5ed7-489a-9da8-e29113c98986 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:13.268240 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-069dceff-5ed7-489a-9da8-e29113c98986 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:13.268739 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-069dceff-5ed7-489a-9da8-e29113c98986 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:13.269189 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-069dceff-5ed7-489a-9da8-e29113c98986 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:13.293301 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-c44a46bc-25a3-4cf4-b0c9-f8ea085c6065 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] HTTP exception thrown: Cannot 'restore' instance 72ffd032-b609-4e42-90d9-5454ac648eeb while it is in vm_state active Aug 27 03:06:13.295266 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c44a46bc-25a3-4cf4-b0c9-f8ea085c6065 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Request method failure captured: Aug 27 03:06:13.295266 n-d-852278-4 devstack@n-api.service[134051]: request: POST /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb/action HTTP/1.1 Aug 27 03:06:13.295266 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 03:06:13.295266 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 03:06:13.295266 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 03:06:13.295266 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 15 Aug 27 03:06:13.295266 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 03:06:13.295266 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 03:06:13.295266 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 03:06:13.295266 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 03:06:13.295266 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYnkbLTKVFjPQ5m3U2fG0N9Vjn4DkHnl17m4V7uHpwM3jvJACULLjB_xlJxNaWj4ki5CLI0R9EDG2yAGWVsjkvndQFsX9xXnPLGqFClIfHjZt1hqpj87tFD2RLalZegHNDkz7eKDMcWIs2wG0Lp8X-uNjMToWPkkmABfSYkxwHfHBds Aug 27 03:06:13.295266 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 03:06:13.295266 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 03:06:13.295266 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 03:06:13.295266 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 03:06:13.295266 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 03:06:13.295266 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 03:06:13.295266 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 3b9e672ac89e41ff82355daa83e852bd Aug 27 03:06:13.295266 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:06:13.295266 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 03:06:13.295266 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 03:06:13.295266 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3b9e672ac89e41ff82355daa83e852bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3b9e672ac89e41ff82355daa83e852bd", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3b9e672ac89e41ff82355daa83e852bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3b9e672ac89e41ff82355daa83e852bd"}]}] Aug 27 03:06:13.295266 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:06:13.295266 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 3b9e672ac89e41ff82355daa83e852bd Aug 27 03:06:13.295266 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:06:13.295266 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ServersNegativeTestJSON-1795266674-project Aug 27 03:06:13.295266 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 03:06:13.295266 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 03:06:13.295266 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 204c90820f6d4c64b31367aaf098325c Aug 27 03:06:13.295266 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ServersNegativeTestJSON-1795266674-project Aug 27 03:06:13.295266 n-d-852278-4 devstack@n-api.service[134051]: Aug 27 03:06:13.295266 n-d-852278-4 devstack@n-api.service[134051]: {"restore": {}} Aug 27 03:06:13.295266 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 03:06:13.295266 n-d-852278-4 devstack@n-api.service[134051]: exception: Cannot 'restore' instance 72ffd032-b609-4e42-90d9-5454ac648eeb while it is in vm_state active Aug 27 03:06:13.295266 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '72ffd032-b609-4e42-90d9-5454ac648eeb', 'body': {'restore': {}}} Aug 27 03:06:13.295266 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:06:13.295266 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:13.295266 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Aug 27 03:06:13.295266 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Aug 27 03:06:13.295266 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 03:06:13.295266 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 03:06:13.295266 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 27 03:06:13.295266 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 27 03:06:13.295266 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 72ffd032-b609-4e42-90d9-5454ac648eeb in vm_state active. Cannot restore while the instance is in this state. Aug 27 03:06:13.295266 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:13.295266 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:06:13.295266 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:13.295266 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:13.295266 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:06:13.295266 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:06:13.295266 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:06:13.295266 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:06:13.295266 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:06:13.295266 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:06:13.295266 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Aug 27 03:06:13.295266 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 27 03:06:13.295266 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 27 03:06:13.295266 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 27 03:06:13.295266 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 72ffd032-b609-4e42-90d9-5454ac648eeb while it is in vm_state active Aug 27 03:06:13.295266 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:13.295266 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:06:13.295266 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:13.295266 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:13.295266 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:06:13.298422 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:06:13.298422 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:06:13.298422 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:06:13.298422 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 72ffd032-b609-4e42-90d9-5454ac648eeb while it is in vm_state active Aug 27 03:06:13.298422 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:13.300090 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c44a46bc-25a3-4cf4-b0c9-f8ea085c6065 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Returning 409 to user: Cannot 'restore' instance 72ffd032-b609-4e42-90d9-5454ac648eeb while it is in vm_state active {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:06:13.301211 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c44a46bc-25a3-4cf4-b0c9-f8ea085c6065 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "POST /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb/action" status: 409 len: 145 microversion: 2.1 time: 0.053308 Aug 27 03:06:13.306015 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2386/4740] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:06:13 2022] POST /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb/action => generated 145 bytes in 64 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 27 03:06:13.311936 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-417f8ad2-5019-4829-8465-5d7c734c39b3 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:13.312981 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-417f8ad2-5019-4829-8465-5d7c734c39b3 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:13.319391 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-417f8ad2-5019-4829-8465-5d7c734c39b3 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:13.320144 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-417f8ad2-5019-4829-8465-5d7c734c39b3 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:13.320729 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-417f8ad2-5019-4829-8465-5d7c734c39b3 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:13.321542 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-417f8ad2-5019-4829-8465-5d7c734c39b3 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:13.322087 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-417f8ad2-5019-4829-8465-5d7c734c39b3 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:13.323264 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-417f8ad2-5019-4829-8465-5d7c734c39b3 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:13.330244 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:06:13.588848 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-069dceff-5ed7-489a-9da8-e29113c98986 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:13.600275 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-069dceff-5ed7-489a-9da8-e29113c98986 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/eeb71517-05bf-488e-98b1-04d8a140e079" status: 200 len: 1511 microversion: 2.1 time: 0.358603 Aug 27 03:06:13.601797 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2355/4741] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:13 2022] GET /compute/v2.1/servers/eeb71517-05bf-488e-98b1-04d8a140e079 => generated 1511 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:13.618222 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3cc5a0ad-f75a-4a08-83b3-1f8543fb8883 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:13.625964 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-3cc5a0ad-f75a-4a08-83b3-1f8543fb8883 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] [instance: 879f248c-09b1-4e34-982e-bb8b75be03ce] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:13.632889 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3cc5a0ad-f75a-4a08-83b3-1f8543fb8883 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:13.633606 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3cc5a0ad-f75a-4a08-83b3-1f8543fb8883 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:13.634242 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3cc5a0ad-f75a-4a08-83b3-1f8543fb8883 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:13.635119 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3cc5a0ad-f75a-4a08-83b3-1f8543fb8883 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:13.635738 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3cc5a0ad-f75a-4a08-83b3-1f8543fb8883 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:13.636400 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3cc5a0ad-f75a-4a08-83b3-1f8543fb8883 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:13.684634 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-417f8ad2-5019-4829-8465-5d7c734c39b3 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:13.694439 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-417f8ad2-5019-4829-8465-5d7c734c39b3 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1504 microversion: 2.1 time: 0.386490 Aug 27 03:06:13.695343 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2387/4742] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:13 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1504 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:13.719876 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3c8e3b55-11cc-42cd-8213-ed242f448c58 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:13.720756 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-3c8e3b55-11cc-42cd-8213-ed242f448c58 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:13.736683 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3c8e3b55-11cc-42cd-8213-ed242f448c58 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:13.737459 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3c8e3b55-11cc-42cd-8213-ed242f448c58 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:13.738032 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3c8e3b55-11cc-42cd-8213-ed242f448c58 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:13.738892 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3c8e3b55-11cc-42cd-8213-ed242f448c58 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:13.739512 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3c8e3b55-11cc-42cd-8213-ed242f448c58 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:13.741801 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3c8e3b55-11cc-42cd-8213-ed242f448c58 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:13.987316 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-3cc5a0ad-f75a-4a08-83b3-1f8543fb8883 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3f67480c8a4ab8b538d4bebfa12d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d58ec8819c4af9bb00a08e2ca12708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:13.996841 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-3cc5a0ad-f75a-4a08-83b3-1f8543fb8883 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] 10.222.0.70 "GET /compute/v2.1/servers/879f248c-09b1-4e34-982e-bb8b75be03ce" status: 200 len: 1314 microversion: 2.1 time: 0.392225 Aug 27 03:06:14.011235 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2356/4743] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:13 2022] GET /compute/v2.1/servers/879f248c-09b1-4e34-982e-bb8b75be03ce => generated 1314 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:14.041838 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-3c8e3b55-11cc-42cd-8213-ed242f448c58 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:14.056814 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-3c8e3b55-11cc-42cd-8213-ed242f448c58 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1504 microversion: 2.1 time: 0.341809 Aug 27 03:06:14.058111 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2388/4744] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:13 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1504 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:14.085826 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a2243624-9324-4655-a0d8-f0382e81ffc9 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:06:14.086359 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a2243624-9324-4655-a0d8-f0382e81ffc9 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: e711541d-2ce5-40c6-b77a-14a366b32750] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:14.105603 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-a2243624-9324-4655-a0d8-f0382e81ffc9 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] HTTP exception thrown: Instance e711541d-2ce5-40c6-b77a-14a366b32750 could not be found. Aug 27 03:06:14.117611 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a2243624-9324-4655-a0d8-f0382e81ffc9 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Request method failure captured: Aug 27 03:06:14.117611 n-d-852278-4 devstack@n-api.service[134052]: request: POST /compute/v2.1/servers/e711541d-2ce5-40c6-b77a-14a366b32750/action HTTP/1.1 Aug 27 03:06:14.117611 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 03:06:14.117611 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 03:06:14.117611 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 03:06:14.117611 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 14 Aug 27 03:06:14.117611 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 03:06:14.117611 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 03:06:14.117611 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 03:06:14.117611 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 03:06:14.117611 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYnkbLTKVFjPQ5m3U2fG0N9Vjn4DkHnl17m4V7uHpwM3jvJACULLjB_xlJxNaWj4ki5CLI0R9EDG2yAGWVsjkvndQFsX9xXnPLGqFClIfHjZt1hqpj87tFD2RLalZegHNDkz7eKDMcWIs2wG0Lp8X-uNjMToWPkkmABfSYkxwHfHBds Aug 27 03:06:14.117611 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 03:06:14.117611 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 03:06:14.117611 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 03:06:14.117611 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 03:06:14.117611 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 03:06:14.117611 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 03:06:14.117611 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 3b9e672ac89e41ff82355daa83e852bd Aug 27 03:06:14.117611 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:06:14.117611 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 03:06:14.117611 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 03:06:14.117611 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3b9e672ac89e41ff82355daa83e852bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3b9e672ac89e41ff82355daa83e852bd", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3b9e672ac89e41ff82355daa83e852bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3b9e672ac89e41ff82355daa83e852bd"}]}] Aug 27 03:06:14.117611 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:06:14.117611 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 3b9e672ac89e41ff82355daa83e852bd Aug 27 03:06:14.117611 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:06:14.117611 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ServersNegativeTestJSON-1795266674-project Aug 27 03:06:14.117611 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 03:06:14.117611 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 03:06:14.117611 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 204c90820f6d4c64b31367aaf098325c Aug 27 03:06:14.117611 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ServersNegativeTestJSON-1795266674-project Aug 27 03:06:14.117611 n-d-852278-4 devstack@n-api.service[134052]: Aug 27 03:06:14.117611 n-d-852278-4 devstack@n-api.service[134052]: {"resume": {}} Aug 27 03:06:14.117611 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 03:06:14.117611 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance e711541d-2ce5-40c6-b77a-14a366b32750 could not be found. Aug 27 03:06:14.117611 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': 'e711541d-2ce5-40c6-b77a-14a366b32750', 'body': {'resume': {}}} Aug 27 03:06:14.117611 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:06:14.117611 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:14.117611 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:06:14.117611 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:06:14.117611 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:06:14.117611 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:06:14.117611 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 03:06:14.117611 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 03:06:14.117611 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e711541d-2ce5-40c6-b77a-14a366b32750 could not be found. Aug 27 03:06:14.117611 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:06:14.117611 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:06:14.117611 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:06:14.117611 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:14.117611 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:06:14.117611 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:06:14.117611 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:06:14.117611 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:06:14.117611 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:06:14.117611 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:06:14.117611 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Aug 27 03:06:14.117611 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Aug 27 03:06:14.117611 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:06:14.117611 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:06:14.117611 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e711541d-2ce5-40c6-b77a-14a366b32750 could not be found. Aug 27 03:06:14.117611 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:06:14.117611 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:06:14.117611 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:06:14.117611 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:14.117611 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:06:14.117611 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:06:14.121002 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:06:14.121002 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:06:14.121002 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e711541d-2ce5-40c6-b77a-14a366b32750 could not be found. Aug 27 03:06:14.121002 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:06:14.121002 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a2243624-9324-4655-a0d8-f0382e81ffc9 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Returning 404 to user: Instance e711541d-2ce5-40c6-b77a-14a366b32750 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:06:14.123519 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a2243624-9324-4655-a0d8-f0382e81ffc9 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "POST /compute/v2.1/servers/e711541d-2ce5-40c6-b77a-14a366b32750/action" status: 404 len: 111 microversion: 2.1 time: 0.041984 Aug 27 03:06:14.130421 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2357/4745] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:06:14 2022] POST /compute/v2.1/servers/e711541d-2ce5-40c6-b77a-14a366b32750/action => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 03:06:14.135745 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a29be498-c028-4b0c-a445-f31977ac4505 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:14.144500 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-a29be498-c028-4b0c-a445-f31977ac4505 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:14.163498 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a29be498-c028-4b0c-a445-f31977ac4505 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:14.164020 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a29be498-c028-4b0c-a445-f31977ac4505 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:14.164501 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a29be498-c028-4b0c-a445-f31977ac4505 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:14.165487 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a29be498-c028-4b0c-a445-f31977ac4505 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:14.166135 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a29be498-c028-4b0c-a445-f31977ac4505 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:14.166745 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a29be498-c028-4b0c-a445-f31977ac4505 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:14.441671 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-a29be498-c028-4b0c-a445-f31977ac4505 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:14.453024 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a29be498-c028-4b0c-a445-f31977ac4505 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1504 microversion: 2.1 time: 0.321160 Aug 27 03:06:14.453623 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2389/4746] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:14 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1504 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:14.476561 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-7cca7eeb-7e9a-42ac-8e51-1f7b223ef692 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:14.477467 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-7cca7eeb-7e9a-42ac-8e51-1f7b223ef692 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:14.485717 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7cca7eeb-7e9a-42ac-8e51-1f7b223ef692 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:14.486432 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7cca7eeb-7e9a-42ac-8e51-1f7b223ef692 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:14.487036 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7cca7eeb-7e9a-42ac-8e51-1f7b223ef692 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:14.487895 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7cca7eeb-7e9a-42ac-8e51-1f7b223ef692 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:14.488513 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7cca7eeb-7e9a-42ac-8e51-1f7b223ef692 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:14.489074 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7cca7eeb-7e9a-42ac-8e51-1f7b223ef692 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:14.626177 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-494ad1fe-65e7-42d6-b678-962f9fe5fd28 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:14.629029 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-494ad1fe-65e7-42d6-b678-962f9fe5fd28 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: eeb71517-05bf-488e-98b1-04d8a140e079] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:14.638663 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-494ad1fe-65e7-42d6-b678-962f9fe5fd28 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:14.639574 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-494ad1fe-65e7-42d6-b678-962f9fe5fd28 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:14.640361 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-494ad1fe-65e7-42d6-b678-962f9fe5fd28 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:14.641330 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-494ad1fe-65e7-42d6-b678-962f9fe5fd28 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:14.642184 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-494ad1fe-65e7-42d6-b678-962f9fe5fd28 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:14.642786 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-494ad1fe-65e7-42d6-b678-962f9fe5fd28 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:14.851359 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-7cca7eeb-7e9a-42ac-8e51-1f7b223ef692 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:14.876431 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-7cca7eeb-7e9a-42ac-8e51-1f7b223ef692 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1504 microversion: 2.1 time: 0.403674 Aug 27 03:06:14.878821 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2358/4747] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:14 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1504 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:14.942327 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-494ad1fe-65e7-42d6-b678-962f9fe5fd28 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:14.950223 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-494ad1fe-65e7-42d6-b678-962f9fe5fd28 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/eeb71517-05bf-488e-98b1-04d8a140e079" status: 200 len: 1511 microversion: 2.1 time: 0.331916 Aug 27 03:06:14.951016 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2390/4748] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:14 2022] GET /compute/v2.1/servers/eeb71517-05bf-488e-98b1-04d8a140e079 => generated 1511 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:06:14.972447 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-76497c55-4fff-402d-9e62-e0902fde7b1c tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:06:14.973416 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-76497c55-4fff-402d-9e62-e0902fde7b1c tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:14.982955 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-76497c55-4fff-402d-9e62-e0902fde7b1c tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:14.984031 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-76497c55-4fff-402d-9e62-e0902fde7b1c tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:14.984701 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-76497c55-4fff-402d-9e62-e0902fde7b1c tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:14.985661 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-76497c55-4fff-402d-9e62-e0902fde7b1c tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:14.986324 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-76497c55-4fff-402d-9e62-e0902fde7b1c tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:14.986947 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-76497c55-4fff-402d-9e62-e0902fde7b1c tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:15.019808 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-76497c55-4fff-402d-9e62-e0902fde7b1c tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] HTTP exception thrown: Cannot 'resume' instance 72ffd032-b609-4e42-90d9-5454ac648eeb while it is in vm_state active Aug 27 03:06:15.021911 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-76497c55-4fff-402d-9e62-e0902fde7b1c tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Request method failure captured: Aug 27 03:06:15.021911 n-d-852278-4 devstack@n-api.service[134051]: request: POST /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb/action HTTP/1.1 Aug 27 03:06:15.021911 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 03:06:15.021911 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 03:06:15.021911 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 03:06:15.021911 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 14 Aug 27 03:06:15.021911 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 03:06:15.021911 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 03:06:15.021911 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 03:06:15.021911 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 03:06:15.021911 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYnkbLTKVFjPQ5m3U2fG0N9Vjn4DkHnl17m4V7uHpwM3jvJACULLjB_xlJxNaWj4ki5CLI0R9EDG2yAGWVsjkvndQFsX9xXnPLGqFClIfHjZt1hqpj87tFD2RLalZegHNDkz7eKDMcWIs2wG0Lp8X-uNjMToWPkkmABfSYkxwHfHBds Aug 27 03:06:15.021911 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 03:06:15.021911 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 03:06:15.021911 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 03:06:15.021911 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 03:06:15.021911 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 03:06:15.021911 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 03:06:15.021911 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 3b9e672ac89e41ff82355daa83e852bd Aug 27 03:06:15.021911 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:06:15.021911 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 03:06:15.021911 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 03:06:15.021911 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3b9e672ac89e41ff82355daa83e852bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3b9e672ac89e41ff82355daa83e852bd", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3b9e672ac89e41ff82355daa83e852bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3b9e672ac89e41ff82355daa83e852bd"}]}] Aug 27 03:06:15.021911 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:06:15.021911 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 3b9e672ac89e41ff82355daa83e852bd Aug 27 03:06:15.021911 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:06:15.021911 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ServersNegativeTestJSON-1795266674-project Aug 27 03:06:15.021911 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 03:06:15.021911 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 03:06:15.021911 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 204c90820f6d4c64b31367aaf098325c Aug 27 03:06:15.021911 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ServersNegativeTestJSON-1795266674-project Aug 27 03:06:15.021911 n-d-852278-4 devstack@n-api.service[134051]: Aug 27 03:06:15.021911 n-d-852278-4 devstack@n-api.service[134051]: {"resume": {}} Aug 27 03:06:15.021911 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 03:06:15.021911 n-d-852278-4 devstack@n-api.service[134051]: exception: Cannot 'resume' instance 72ffd032-b609-4e42-90d9-5454ac648eeb while it is in vm_state active Aug 27 03:06:15.021911 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '72ffd032-b609-4e42-90d9-5454ac648eeb', 'body': {'resume': {}}} Aug 27 03:06:15.021911 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:06:15.021911 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:15.021911 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Aug 27 03:06:15.021911 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Aug 27 03:06:15.021911 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 03:06:15.021911 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 03:06:15.021911 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Aug 27 03:06:15.021911 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 27 03:06:15.021911 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 27 03:06:15.021911 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 27 03:06:15.021911 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 72ffd032-b609-4e42-90d9-5454ac648eeb in vm_state active. Cannot resume while the instance is in this state. Aug 27 03:06:15.021911 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:15.021911 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:06:15.021911 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:15.021911 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:15.021911 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:06:15.021911 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:06:15.021911 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:06:15.021911 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:06:15.021911 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:06:15.021911 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:06:15.021911 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Aug 27 03:06:15.021911 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 27 03:06:15.021911 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 27 03:06:15.021911 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 27 03:06:15.021911 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 72ffd032-b609-4e42-90d9-5454ac648eeb while it is in vm_state active Aug 27 03:06:15.021911 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:15.021911 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:06:15.021911 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:15.024988 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:15.024988 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:06:15.024988 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:06:15.024988 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:06:15.024988 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:06:15.024988 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 72ffd032-b609-4e42-90d9-5454ac648eeb while it is in vm_state active Aug 27 03:06:15.024988 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:15.026733 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-76497c55-4fff-402d-9e62-e0902fde7b1c tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Returning 409 to user: Cannot 'resume' instance 72ffd032-b609-4e42-90d9-5454ac648eeb while it is in vm_state active {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:06:15.027798 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-76497c55-4fff-402d-9e62-e0902fde7b1c tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "POST /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb/action" status: 409 len: 144 microversion: 2.1 time: 0.059623 Aug 27 03:06:15.028609 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2391/4749] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:06:14 2022] POST /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb/action => generated 144 bytes in 77 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 27 03:06:15.036122 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-da1d6281-9c9a-4324-8dbf-bd4afafb1749 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:15.041046 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-da1d6281-9c9a-4324-8dbf-bd4afafb1749 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] [instance: 879f248c-09b1-4e34-982e-bb8b75be03ce] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:15.049150 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-da1d6281-9c9a-4324-8dbf-bd4afafb1749 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:15.049668 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-da1d6281-9c9a-4324-8dbf-bd4afafb1749 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:15.050105 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-da1d6281-9c9a-4324-8dbf-bd4afafb1749 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:15.051432 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-da1d6281-9c9a-4324-8dbf-bd4afafb1749 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:15.051900 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-da1d6281-9c9a-4324-8dbf-bd4afafb1749 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:15.052344 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-da1d6281-9c9a-4324-8dbf-bd4afafb1749 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:15.242312 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-d8486935-e117-4291-956d-3bb0612c0710 req-2dec97d6-d9e0-4159-a7d1-4e73dd05ec41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "879f248c-09b1-4e34-982e-bb8b75be03ce", "tag": "17e98da5-b4f5-4a1e-918f-2bd27122b546"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:06:15.261504 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-d8486935-e117-4291-956d-3bb0612c0710 req-2dec97d6-d9e0-4159-a7d1-4e73dd05ec41 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:15.261989 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-d8486935-e117-4291-956d-3bb0612c0710 req-2dec97d6-d9e0-4159-a7d1-4e73dd05ec41 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:15.264930 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-d8486935-e117-4291-956d-3bb0612c0710 req-2dec97d6-d9e0-4159-a7d1-4e73dd05ec41 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:15.285024 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-d8486935-e117-4291-956d-3bb0612c0710 req-2dec97d6-d9e0-4159-a7d1-4e73dd05ec41 service nova] Creating event network-changed:17e98da5-b4f5-4a1e-918f-2bd27122b546 for instance 879f248c-09b1-4e34-982e-bb8b75be03ce on n-h2-852278-4 Aug 27 03:06:15.290663 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-d8486935-e117-4291-956d-3bb0612c0710 req-2dec97d6-d9e0-4159-a7d1-4e73dd05ec41 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.408892 Aug 27 03:06:15.291703 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2359/4750] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:06:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:06:15.297914 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-abad1cbf-630b-4fdd-ad51-4e67b19d835f tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:15.299127 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-abad1cbf-630b-4fdd-ad51-4e67b19d835f tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:15.307850 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-abad1cbf-630b-4fdd-ad51-4e67b19d835f tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:15.308523 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-abad1cbf-630b-4fdd-ad51-4e67b19d835f tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:15.309298 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-abad1cbf-630b-4fdd-ad51-4e67b19d835f tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:15.310118 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-abad1cbf-630b-4fdd-ad51-4e67b19d835f tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:15.311849 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-abad1cbf-630b-4fdd-ad51-4e67b19d835f tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:15.312787 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-abad1cbf-630b-4fdd-ad51-4e67b19d835f tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:15.437034 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-da1d6281-9c9a-4324-8dbf-bd4afafb1749 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3f67480c8a4ab8b538d4bebfa12d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d58ec8819c4af9bb00a08e2ca12708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:15.445717 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-da1d6281-9c9a-4324-8dbf-bd4afafb1749 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] 10.222.0.70 "GET /compute/v2.1/servers/879f248c-09b1-4e34-982e-bb8b75be03ce" status: 200 len: 1314 microversion: 2.1 time: 0.415794 Aug 27 03:06:15.447159 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2392/4751] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:15 2022] GET /compute/v2.1/servers/879f248c-09b1-4e34-982e-bb8b75be03ce => generated 1314 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:15.591162 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-abad1cbf-630b-4fdd-ad51-4e67b19d835f tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:15.601495 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-abad1cbf-630b-4fdd-ad51-4e67b19d835f tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1504 microversion: 2.1 time: 0.307800 Aug 27 03:06:15.618999 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2360/4752] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:15 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1504 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:15.627547 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-fa1c0ee0-9be0-4ef4-b102-99ff593b3346 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:15.628155 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-fa1c0ee0-9be0-4ef4-b102-99ff593b3346 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:15.634788 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fa1c0ee0-9be0-4ef4-b102-99ff593b3346 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:15.637020 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fa1c0ee0-9be0-4ef4-b102-99ff593b3346 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:15.637607 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fa1c0ee0-9be0-4ef4-b102-99ff593b3346 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:15.638918 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fa1c0ee0-9be0-4ef4-b102-99ff593b3346 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:15.639739 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fa1c0ee0-9be0-4ef4-b102-99ff593b3346 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:15.640377 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fa1c0ee0-9be0-4ef4-b102-99ff593b3346 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:15.972194 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8eaf6aa5-b937-4cda-ace7-84c9cc85cc0b tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:15.972680 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-8eaf6aa5-b937-4cda-ace7-84c9cc85cc0b tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: eeb71517-05bf-488e-98b1-04d8a140e079] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:15.982617 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8eaf6aa5-b937-4cda-ace7-84c9cc85cc0b tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:15.984098 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8eaf6aa5-b937-4cda-ace7-84c9cc85cc0b tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:15.984814 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8eaf6aa5-b937-4cda-ace7-84c9cc85cc0b tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:15.985941 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8eaf6aa5-b937-4cda-ace7-84c9cc85cc0b tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:15.989368 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8eaf6aa5-b937-4cda-ace7-84c9cc85cc0b tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:15.991044 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8eaf6aa5-b937-4cda-ace7-84c9cc85cc0b tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:16.177218 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-fa1c0ee0-9be0-4ef4-b102-99ff593b3346 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:16.193216 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-fa1c0ee0-9be0-4ef4-b102-99ff593b3346 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1504 microversion: 2.1 time: 0.569100 Aug 27 03:06:16.194521 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2393/4753] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:15 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1504 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:16.307856 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-8eaf6aa5-b937-4cda-ace7-84c9cc85cc0b tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:16.318678 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-8eaf6aa5-b937-4cda-ace7-84c9cc85cc0b tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/eeb71517-05bf-488e-98b1-04d8a140e079" status: 200 len: 1488 microversion: 2.1 time: 0.351467 Aug 27 03:06:16.320458 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2361/4754] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:15 2022] GET /compute/v2.1/servers/eeb71517-05bf-488e-98b1-04d8a140e079 => generated 1488 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:16.341687 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f50cf4d0-c278-460f-9185-3c368aa20d44 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-806879773"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:06:16.345576 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-f50cf4d0-c278-460f-9185-3c368aa20d44 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: eeb71517-05bf-488e-98b1-04d8a140e079] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:16.368281 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e92be673-2889-49f6-8c2a-e80f35960405 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "networks": [{"uuid": "7efdc19e-82eb-4610-897e-db10a92a0c7c"}]}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:06:16.372303 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f50cf4d0-c278-460f-9185-3c368aa20d44 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:16.372965 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f50cf4d0-c278-460f-9185-3c368aa20d44 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:16.374415 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f50cf4d0-c278-460f-9185-3c368aa20d44 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:16.376992 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e92be673-2889-49f6-8c2a-e80f35960405 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Request method failure captured: Aug 27 03:06:16.376992 n-d-852278-4 devstack@n-api.service[134052]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 03:06:16.376992 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 03:06:16.376992 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 03:06:16.376992 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 03:06:16.376992 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 160 Aug 27 03:06:16.376992 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 03:06:16.376992 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 03:06:16.376992 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 03:06:16.376992 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 03:06:16.376992 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYnkbLTKVFjPQ5m3U2fG0N9Vjn4DkHnl17m4V7uHpwM3jvJACULLjB_xlJxNaWj4ki5CLI0R9EDG2yAGWVsjkvndQFsX9xXnPLGqFClIfHjZt1hqpj87tFD2RLalZegHNDkz7eKDMcWIs2wG0Lp8X-uNjMToWPkkmABfSYkxwHfHBds Aug 27 03:06:16.376992 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 03:06:16.376992 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 03:06:16.376992 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 03:06:16.376992 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 03:06:16.376992 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 03:06:16.376992 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 03:06:16.376992 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 3b9e672ac89e41ff82355daa83e852bd Aug 27 03:06:16.376992 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:06:16.376992 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 03:06:16.376992 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 03:06:16.376992 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3b9e672ac89e41ff82355daa83e852bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3b9e672ac89e41ff82355daa83e852bd", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3b9e672ac89e41ff82355daa83e852bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3b9e672ac89e41ff82355daa83e852bd"}]}] Aug 27 03:06:16.376992 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:06:16.376992 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 3b9e672ac89e41ff82355daa83e852bd Aug 27 03:06:16.376992 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:06:16.376992 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ServersNegativeTestJSON-1795266674-project Aug 27 03:06:16.376992 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 03:06:16.376992 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 03:06:16.376992 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 204c90820f6d4c64b31367aaf098325c Aug 27 03:06:16.376992 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ServersNegativeTestJSON-1795266674-project Aug 27 03:06:16.376992 n-d-852278-4 devstack@n-api.service[134052]: Aug 27 03:06:16.376992 n-d-852278-4 devstack@n-api.service[134052]: {"server": {"name": "", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "networks": [{"uuid": "7efdc19e-82eb-4610-897e-db10a92a0c7c"}]}} Aug 27 03:06:16.376992 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 03:06:16.376992 n-d-852278-4 devstack@n-api.service[134052]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 27 03:06:16.376992 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'body': {'server': {'name': '', 'imageRef': '1552acd0-176a-4c81-b680-29d74105e9d6', 'flavorRef': '452', 'networks': [{'uuid': '7efdc19e-82eb-4610-897e-db10a92a0c7c'}]}}} Aug 27 03:06:16.376992 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:06:16.376992 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:16.376992 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 03:06:16.376992 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 03:06:16.376992 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 03:06:16.376992 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise error Aug 27 03:06:16.376992 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 27 03:06:16.376992 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:06:16.376992 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Aug 27 03:06:16.376992 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 27 03:06:16.376992 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:06:16.376992 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 27 03:06:16.376992 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi '' Aug 27 03:06:16.376992 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:06:16.376992 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:06:16.376992 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:06:16.376992 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:16.376992 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:06:16.376992 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:06:16.376992 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:06:16.376992 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:06:16.376992 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:06:16.376992 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:06:16.376992 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:06:16.376992 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:06:16.376992 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 03:06:16.376992 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 03:06:16.376992 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 03:06:16.376992 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 03:06:16.376992 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 03:06:16.381968 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 03:06:16.381968 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 27 03:06:16.381968 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:06:16.381968 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:06:16.381968 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:06:16.381968 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:16.381968 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:06:16.381968 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:06:16.381968 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 03:06:16.381968 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 03:06:16.381968 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 27 03:06:16.381968 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:06:16.382676 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f50cf4d0-c278-460f-9185-3c368aa20d44 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:16.382676 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f50cf4d0-c278-460f-9185-3c368aa20d44 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:16.383159 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f50cf4d0-c278-460f-9185-3c368aa20d44 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:16.383893 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e92be673-2889-49f6-8c2a-e80f35960405 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:06:16.389482 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e92be673-2889-49f6-8c2a-e80f35960405 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.027240 Aug 27 03:06:16.390257 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2362/4755] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 03:06:16 2022] POST /compute/v2.1/servers => generated 108 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:06:16.405048 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-1781a1bd-7896-46ce-a828-7ea521ba7f6d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:16.414469 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-1781a1bd-7896-46ce-a828-7ea521ba7f6d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:16.427542 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1781a1bd-7896-46ce-a828-7ea521ba7f6d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:16.428059 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1781a1bd-7896-46ce-a828-7ea521ba7f6d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:16.430297 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1781a1bd-7896-46ce-a828-7ea521ba7f6d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:16.431727 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1781a1bd-7896-46ce-a828-7ea521ba7f6d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:16.432205 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1781a1bd-7896-46ce-a828-7ea521ba7f6d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:16.432730 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1781a1bd-7896-46ce-a828-7ea521ba7f6d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:16.473403 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-f50cf4d0-c278-460f-9185-3c368aa20d44 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "PUT /compute/v2.1/servers/eeb71517-05bf-488e-98b1-04d8a140e079" status: 200 len: 1060 microversion: 2.1 time: 0.136952 Aug 27 03:06:16.474402 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2394/4756] 10.222.0.70 () {60 vars in 1256 bytes} [Sat Aug 27 03:06:16 2022] PUT /compute/v2.1/servers/eeb71517-05bf-488e-98b1-04d8a140e079 => generated 1060 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:06:16.499335 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f1f260da-3485-4e2c-bcb0-2010d8611475 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:16.499954 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-f1f260da-3485-4e2c-bcb0-2010d8611475 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] [instance: 879f248c-09b1-4e34-982e-bb8b75be03ce] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:16.507708 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f1f260da-3485-4e2c-bcb0-2010d8611475 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:16.509119 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f1f260da-3485-4e2c-bcb0-2010d8611475 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:16.509706 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f1f260da-3485-4e2c-bcb0-2010d8611475 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:16.511044 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f1f260da-3485-4e2c-bcb0-2010d8611475 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:16.511637 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f1f260da-3485-4e2c-bcb0-2010d8611475 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:16.512343 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f1f260da-3485-4e2c-bcb0-2010d8611475 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:17.138710 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-1781a1bd-7896-46ce-a828-7ea521ba7f6d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:17.152066 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-1781a1bd-7896-46ce-a828-7ea521ba7f6d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1504 microversion: 2.1 time: 0.751556 Aug 27 03:06:17.167169 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2363/4757] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:16 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1504 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:17.173647 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-fb33a212-3151-43e4-bbea-68671e4dfd91 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:17.174536 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-fb33a212-3151-43e4-bbea-68671e4dfd91 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: eeb71517-05bf-488e-98b1-04d8a140e079] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:17.182076 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=100 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:06:17.184086 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fb33a212-3151-43e4-bbea-68671e4dfd91 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:17.184915 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fb33a212-3151-43e4-bbea-68671e4dfd91 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:17.185609 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fb33a212-3151-43e4-bbea-68671e4dfd91 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:17.188188 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fb33a212-3151-43e4-bbea-68671e4dfd91 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:17.189212 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fb33a212-3151-43e4-bbea-68671e4dfd91 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:17.189845 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fb33a212-3151-43e4-bbea-68671e4dfd91 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:17.328173 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-f1f260da-3485-4e2c-bcb0-2010d8611475 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3f67480c8a4ab8b538d4bebfa12d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d58ec8819c4af9bb00a08e2ca12708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:17.336804 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-f1f260da-3485-4e2c-bcb0-2010d8611475 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] 10.222.0.70 "GET /compute/v2.1/servers/879f248c-09b1-4e34-982e-bb8b75be03ce" status: 200 len: 1314 microversion: 2.1 time: 0.861042 Aug 27 03:06:17.340667 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2395/4758] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:16 2022] GET /compute/v2.1/servers/879f248c-09b1-4e34-982e-bb8b75be03ce => generated 1314 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:17.355208 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0b932e2b-f582-484a-8fc9-d29ccc89d141 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:17.356096 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-0b932e2b-f582-484a-8fc9-d29ccc89d141 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:17.371482 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0b932e2b-f582-484a-8fc9-d29ccc89d141 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:17.371999 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0b932e2b-f582-484a-8fc9-d29ccc89d141 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:17.372473 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0b932e2b-f582-484a-8fc9-d29ccc89d141 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:17.375480 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0b932e2b-f582-484a-8fc9-d29ccc89d141 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:17.375957 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0b932e2b-f582-484a-8fc9-d29ccc89d141 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:17.376431 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0b932e2b-f582-484a-8fc9-d29ccc89d141 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:18.499792 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-fb33a212-3151-43e4-bbea-68671e4dfd91 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:18.505892 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-0b932e2b-f582-484a-8fc9-d29ccc89d141 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:18.514904 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-fb33a212-3151-43e4-bbea-68671e4dfd91 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/eeb71517-05bf-488e-98b1-04d8a140e079" status: 200 len: 1487 microversion: 2.1 time: 1.345265 Aug 27 03:06:18.528340 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2364/4759] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:17 2022] GET /compute/v2.1/servers/eeb71517-05bf-488e-98b1-04d8a140e079 => generated 1487 bytes in 1347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:18.528340 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5d3ed30f-4b6e-4c2b-b63d-b1bf2688b354 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:18.528713 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-5d3ed30f-4b6e-4c2b-b63d-b1bf2688b354 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] [instance: 879f248c-09b1-4e34-982e-bb8b75be03ce] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:18.538254 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-0b932e2b-f582-484a-8fc9-d29ccc89d141 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1504 microversion: 2.1 time: 1.193147 Aug 27 03:06:18.541362 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2396/4760] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:17 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1504 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:18.544095 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5d3ed30f-4b6e-4c2b-b63d-b1bf2688b354 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:18.544796 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5d3ed30f-4b6e-4c2b-b63d-b1bf2688b354 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:18.545245 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5d3ed30f-4b6e-4c2b-b63d-b1bf2688b354 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:18.546499 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5d3ed30f-4b6e-4c2b-b63d-b1bf2688b354 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:18.546945 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5d3ed30f-4b6e-4c2b-b63d-b1bf2688b354 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:18.547364 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5d3ed30f-4b6e-4c2b-b63d-b1bf2688b354 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:18.553835 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-96559f0b-a0a2-48ed-bc4f-6e84af2fa9ff tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:18.556281 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-96559f0b-a0a2-48ed-bc4f-6e84af2fa9ff tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: cd881214-dd67-4897-9167-335d7e48d789] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:18.574673 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-96559f0b-a0a2-48ed-bc4f-6e84af2fa9ff tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:18.575263 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-96559f0b-a0a2-48ed-bc4f-6e84af2fa9ff tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:18.578573 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-96559f0b-a0a2-48ed-bc4f-6e84af2fa9ff tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:18.579457 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-96559f0b-a0a2-48ed-bc4f-6e84af2fa9ff tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:18.580006 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-96559f0b-a0a2-48ed-bc4f-6e84af2fa9ff tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:18.580691 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-96559f0b-a0a2-48ed-bc4f-6e84af2fa9ff tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:18.726971 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.objects.instance [None req-96559f0b-a0a2-48ed-bc4f-6e84af2fa9ff tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lazy-loading 'services' on Instance uuid cd881214-dd67-4897-9167-335d7e48d789 {{(pid=134051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:06:18.865947 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-96559f0b-a0a2-48ed-bc4f-6e84af2fa9ff tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "DELETE /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789/os-volume_attachments/880ae5ba-8aed-42f6-9916-fc0c66ee40ff" status: 202 len: 0 microversion: 2.1 time: 0.322949 Aug 27 03:06:18.870865 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2397/4761] 10.222.0.70 () {58 vars in 1416 bytes} [Sat Aug 27 03:06:18 2022] DELETE /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789/os-volume_attachments/880ae5ba-8aed-42f6-9916-fc0c66ee40ff => generated 0 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:06:18.877232 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-87006eb3-eeaf-40c9-81a9-b5ad56b0299a tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:18.878222 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-87006eb3-eeaf-40c9-81a9-b5ad56b0299a tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: eeb71517-05bf-488e-98b1-04d8a140e079] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:18.886755 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-87006eb3-eeaf-40c9-81a9-b5ad56b0299a tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:18.887535 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-87006eb3-eeaf-40c9-81a9-b5ad56b0299a tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:18.888222 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-87006eb3-eeaf-40c9-81a9-b5ad56b0299a tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:18.889352 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-87006eb3-eeaf-40c9-81a9-b5ad56b0299a tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:18.890119 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-87006eb3-eeaf-40c9-81a9-b5ad56b0299a tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:18.891094 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-87006eb3-eeaf-40c9-81a9-b5ad56b0299a tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:19.160355 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-5d3ed30f-4b6e-4c2b-b63d-b1bf2688b354 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3f67480c8a4ab8b538d4bebfa12d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d58ec8819c4af9bb00a08e2ca12708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:19.169182 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-5d3ed30f-4b6e-4c2b-b63d-b1bf2688b354 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] 10.222.0.70 "GET /compute/v2.1/servers/879f248c-09b1-4e34-982e-bb8b75be03ce" status: 200 len: 1314 microversion: 2.1 time: 0.652506 Aug 27 03:06:19.170983 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2365/4762] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:18 2022] GET /compute/v2.1/servers/879f248c-09b1-4e34-982e-bb8b75be03ce => generated 1314 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:19.177049 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-43051851-0432-4558-82c5-74ddeac08218 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:06:19.177896 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-43051851-0432-4558-82c5-74ddeac08218 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: a6a9dc99-9af6-4cf3-ba1f-74ddbfbd3101] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:19.184643 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-43051851-0432-4558-82c5-74ddeac08218 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] HTTP exception thrown: Instance a6a9dc99-9af6-4cf3-ba1f-74ddbfbd3101 could not be found. Aug 27 03:06:19.193804 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-43051851-0432-4558-82c5-74ddeac08218 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Request method failure captured: Aug 27 03:06:19.193804 n-d-852278-4 devstack@n-api.service[134052]: request: POST /compute/v2.1/servers/a6a9dc99-9af6-4cf3-ba1f-74ddbfbd3101/action HTTP/1.1 Aug 27 03:06:19.193804 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 03:06:19.193804 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 03:06:19.193804 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 03:06:19.193804 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 14 Aug 27 03:06:19.193804 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 03:06:19.193804 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 03:06:19.193804 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 03:06:19.193804 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 03:06:19.193804 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYnkbLTKVFjPQ5m3U2fG0N9Vjn4DkHnl17m4V7uHpwM3jvJACULLjB_xlJxNaWj4ki5CLI0R9EDG2yAGWVsjkvndQFsX9xXnPLGqFClIfHjZt1hqpj87tFD2RLalZegHNDkz7eKDMcWIs2wG0Lp8X-uNjMToWPkkmABfSYkxwHfHBds Aug 27 03:06:19.193804 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 03:06:19.193804 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 03:06:19.193804 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 03:06:19.193804 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 03:06:19.193804 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 03:06:19.193804 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 03:06:19.193804 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 3b9e672ac89e41ff82355daa83e852bd Aug 27 03:06:19.193804 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:06:19.193804 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 03:06:19.193804 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 03:06:19.193804 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3b9e672ac89e41ff82355daa83e852bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3b9e672ac89e41ff82355daa83e852bd", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3b9e672ac89e41ff82355daa83e852bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3b9e672ac89e41ff82355daa83e852bd"}]}] Aug 27 03:06:19.193804 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:06:19.193804 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 3b9e672ac89e41ff82355daa83e852bd Aug 27 03:06:19.193804 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:06:19.193804 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ServersNegativeTestJSON-1795266674-project Aug 27 03:06:19.193804 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 03:06:19.193804 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 03:06:19.193804 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 204c90820f6d4c64b31367aaf098325c Aug 27 03:06:19.193804 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ServersNegativeTestJSON-1795266674-project Aug 27 03:06:19.193804 n-d-852278-4 devstack@n-api.service[134052]: Aug 27 03:06:19.193804 n-d-852278-4 devstack@n-api.service[134052]: {"shelve": {}} Aug 27 03:06:19.193804 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 03:06:19.193804 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance a6a9dc99-9af6-4cf3-ba1f-74ddbfbd3101 could not be found. Aug 27 03:06:19.193804 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': 'a6a9dc99-9af6-4cf3-ba1f-74ddbfbd3101', 'body': {'shelve': {}}} Aug 27 03:06:19.193804 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:06:19.193804 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:19.193804 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:06:19.193804 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:06:19.193804 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:06:19.193804 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:06:19.193804 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 03:06:19.193804 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 03:06:19.193804 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6a9dc99-9af6-4cf3-ba1f-74ddbfbd3101 could not be found. Aug 27 03:06:19.193804 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:06:19.193804 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:06:19.193804 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:06:19.193804 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:19.193804 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:06:19.193804 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:06:19.193804 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:06:19.193804 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:06:19.193804 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:06:19.193804 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:06:19.193804 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Aug 27 03:06:19.193804 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 27 03:06:19.193804 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:06:19.193804 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:06:19.193804 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6a9dc99-9af6-4cf3-ba1f-74ddbfbd3101 could not be found. Aug 27 03:06:19.193804 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:06:19.193804 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:06:19.193804 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:06:19.193804 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:19.193804 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:06:19.193804 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:06:19.198109 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:06:19.198109 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:06:19.198109 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6a9dc99-9af6-4cf3-ba1f-74ddbfbd3101 could not be found. Aug 27 03:06:19.198109 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:06:19.198109 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-43051851-0432-4558-82c5-74ddeac08218 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Returning 404 to user: Instance a6a9dc99-9af6-4cf3-ba1f-74ddbfbd3101 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:06:19.198109 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-43051851-0432-4558-82c5-74ddeac08218 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "POST /compute/v2.1/servers/a6a9dc99-9af6-4cf3-ba1f-74ddbfbd3101/action" status: 404 len: 111 microversion: 2.1 time: 0.024295 Aug 27 03:06:19.198109 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2366/4763] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:06:19 2022] POST /compute/v2.1/servers/a6a9dc99-9af6-4cf3-ba1f-74ddbfbd3101/action => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:06:19.204846 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ebfdd35b-e602-49a3-aba6-76bcf88df048 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:19.207599 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-ebfdd35b-e602-49a3-aba6-76bcf88df048 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: cd881214-dd67-4897-9167-335d7e48d789] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:19.215115 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ebfdd35b-e602-49a3-aba6-76bcf88df048 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:19.215763 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ebfdd35b-e602-49a3-aba6-76bcf88df048 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:19.216474 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ebfdd35b-e602-49a3-aba6-76bcf88df048 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:19.217827 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ebfdd35b-e602-49a3-aba6-76bcf88df048 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:19.218560 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ebfdd35b-e602-49a3-aba6-76bcf88df048 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:19.219171 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ebfdd35b-e602-49a3-aba6-76bcf88df048 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:19.252197 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ebfdd35b-e602-49a3-aba6-76bcf88df048 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "GET /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052890 Aug 27 03:06:19.252824 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2367/4764] 10.222.0.70 () {58 vars in 1302 bytes} [Sat Aug 27 03:06:19 2022] GET /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:06:19.257529 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-67a5849c-0088-409f-86f1-badd4554fa8c tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:19.258300 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-67a5849c-0088-409f-86f1-badd4554fa8c tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:19.264764 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-67a5849c-0088-409f-86f1-badd4554fa8c tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:19.265251 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-67a5849c-0088-409f-86f1-badd4554fa8c tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:19.265728 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-67a5849c-0088-409f-86f1-badd4554fa8c tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:19.266426 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-67a5849c-0088-409f-86f1-badd4554fa8c tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:19.266863 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-67a5849c-0088-409f-86f1-badd4554fa8c tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:19.267454 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-67a5849c-0088-409f-86f1-badd4554fa8c tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:19.362371 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-87006eb3-eeaf-40c9-81a9-b5ad56b0299a tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:19.372294 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-87006eb3-eeaf-40c9-81a9-b5ad56b0299a tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/eeb71517-05bf-488e-98b1-04d8a140e079" status: 200 len: 1487 microversion: 2.1 time: 0.499617 Aug 27 03:06:19.373108 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2398/4765] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:18 2022] GET /compute/v2.1/servers/eeb71517-05bf-488e-98b1-04d8a140e079 => generated 1487 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:19.393372 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-cfe38bae-9837-4ef5-a004-929d24176215 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:19.393865 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-cfe38bae-9837-4ef5-a004-929d24176215 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: eeb71517-05bf-488e-98b1-04d8a140e079] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:19.400351 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cfe38bae-9837-4ef5-a004-929d24176215 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:19.400858 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cfe38bae-9837-4ef5-a004-929d24176215 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:19.401298 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cfe38bae-9837-4ef5-a004-929d24176215 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:19.402139 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cfe38bae-9837-4ef5-a004-929d24176215 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:19.402557 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cfe38bae-9837-4ef5-a004-929d24176215 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:19.402988 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cfe38bae-9837-4ef5-a004-929d24176215 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:19.436029 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-cfe38bae-9837-4ef5-a004-929d24176215 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: eeb71517-05bf-488e-98b1-04d8a140e079] Going to try to terminate instance {{(pid=134051) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:06:19.503943 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:06:19.534492 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-67a5849c-0088-409f-86f1-badd4554fa8c tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:19.550301 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-67a5849c-0088-409f-86f1-badd4554fa8c tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1504 microversion: 2.1 time: 0.295344 Aug 27 03:06:19.551276 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2368/4766] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:19 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1504 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:19.574167 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-45947ab9-212b-4682-8389-1dea4f71be1b tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:19.574958 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-45947ab9-212b-4682-8389-1dea4f71be1b tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:19.583014 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-45947ab9-212b-4682-8389-1dea4f71be1b tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:19.584239 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-45947ab9-212b-4682-8389-1dea4f71be1b tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:19.585352 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-45947ab9-212b-4682-8389-1dea4f71be1b tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:19.586426 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-45947ab9-212b-4682-8389-1dea4f71be1b tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:19.587062 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-45947ab9-212b-4682-8389-1dea4f71be1b tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:19.587636 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-45947ab9-212b-4682-8389-1dea4f71be1b tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:19.622346 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-cfe38bae-9837-4ef5-a004-929d24176215 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "DELETE /compute/v2.1/servers/eeb71517-05bf-488e-98b1-04d8a140e079" status: 204 len: 0 microversion: 2.1 time: 0.230775 Aug 27 03:06:19.625263 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2399/4767] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 03:06:19 2022] DELETE /compute/v2.1/servers/eeb71517-05bf-488e-98b1-04d8a140e079 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:06:19.650468 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-54321a3b-6052-43e1-aaf8-8fa33bc9a2b2 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:19.651205 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-54321a3b-6052-43e1-aaf8-8fa33bc9a2b2 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: eeb71517-05bf-488e-98b1-04d8a140e079] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:19.672893 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-54321a3b-6052-43e1-aaf8-8fa33bc9a2b2 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:19.674635 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-54321a3b-6052-43e1-aaf8-8fa33bc9a2b2 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:19.677904 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-54321a3b-6052-43e1-aaf8-8fa33bc9a2b2 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:19.678980 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-54321a3b-6052-43e1-aaf8-8fa33bc9a2b2 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:19.681632 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-54321a3b-6052-43e1-aaf8-8fa33bc9a2b2 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:19.682235 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-54321a3b-6052-43e1-aaf8-8fa33bc9a2b2 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:19.781651 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=8 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:06:19.921367 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-45947ab9-212b-4682-8389-1dea4f71be1b tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:19.932084 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-45947ab9-212b-4682-8389-1dea4f71be1b tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1504 microversion: 2.1 time: 0.362831 Aug 27 03:06:19.934910 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2369/4768] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:19 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1504 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:06:19.953770 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ec4c827b-c6e5-43e6-8d27-1f108e80bd79 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:06:19.954580 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-ec4c827b-c6e5-43e6-8d27-1f108e80bd79 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:19.962315 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ec4c827b-c6e5-43e6-8d27-1f108e80bd79 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:19.964912 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ec4c827b-c6e5-43e6-8d27-1f108e80bd79 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:19.966861 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ec4c827b-c6e5-43e6-8d27-1f108e80bd79 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:19.967959 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ec4c827b-c6e5-43e6-8d27-1f108e80bd79 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:19.969371 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ec4c827b-c6e5-43e6-8d27-1f108e80bd79 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:19.969999 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ec4c827b-c6e5-43e6-8d27-1f108e80bd79 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:20.008190 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=100 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:06:20.027416 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.instance [None req-ec4c827b-c6e5-43e6-8d27-1f108e80bd79 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lazy-loading 'flavor' on Instance uuid 72ffd032-b609-4e42-90d9-5454ac648eeb {{(pid=134052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:06:20.099653 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-54321a3b-6052-43e1-aaf8-8fa33bc9a2b2 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:20.112840 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-54321a3b-6052-43e1-aaf8-8fa33bc9a2b2 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/eeb71517-05bf-488e-98b1-04d8a140e079" status: 200 len: 1493 microversion: 2.1 time: 0.482435 Aug 27 03:06:20.113991 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2400/4769] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:19 2022] GET /compute/v2.1/servers/eeb71517-05bf-488e-98b1-04d8a140e079 => generated 1493 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:20.192291 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a9eb7314-a4b7-42e1-a848-4f562d9eb06d tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:20.193220 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-a9eb7314-a4b7-42e1-a848-4f562d9eb06d tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] [instance: 879f248c-09b1-4e34-982e-bb8b75be03ce] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:20.207865 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a9eb7314-a4b7-42e1-a848-4f562d9eb06d tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:20.208622 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a9eb7314-a4b7-42e1-a848-4f562d9eb06d tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:20.209157 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a9eb7314-a4b7-42e1-a848-4f562d9eb06d tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:20.209975 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a9eb7314-a4b7-42e1-a848-4f562d9eb06d tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:20.213222 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a9eb7314-a4b7-42e1-a848-4f562d9eb06d tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:20.213785 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a9eb7314-a4b7-42e1-a848-4f562d9eb06d tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:20.218521 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:06:20.399317 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ec4c827b-c6e5-43e6-8d27-1f108e80bd79 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "POST /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb/action" status: 202 len: 0 microversion: 2.1 time: 0.449346 Aug 27 03:06:20.407414 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2370/4770] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:06:19 2022] POST /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb/action => generated 0 bytes in 455 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 03:06:20.419107 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-1b8ae8e2-e155-40fe-9367-e5c21aa0b2b3 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:20.425215 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-1b8ae8e2-e155-40fe-9367-e5c21aa0b2b3 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: cd881214-dd67-4897-9167-335d7e48d789] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:20.435169 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1b8ae8e2-e155-40fe-9367-e5c21aa0b2b3 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:20.440514 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1b8ae8e2-e155-40fe-9367-e5c21aa0b2b3 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:20.441099 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1b8ae8e2-e155-40fe-9367-e5c21aa0b2b3 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:20.450833 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1b8ae8e2-e155-40fe-9367-e5c21aa0b2b3 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:20.458157 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1b8ae8e2-e155-40fe-9367-e5c21aa0b2b3 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:20.458657 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1b8ae8e2-e155-40fe-9367-e5c21aa0b2b3 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:20.544603 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-1b8ae8e2-e155-40fe-9367-e5c21aa0b2b3 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "GET /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.138505 Aug 27 03:06:20.545245 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2371/4771] 10.222.0.70 () {58 vars in 1302 bytes} [Sat Aug 27 03:06:20 2022] GET /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789/os-volume_attachments => generated 197 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:06:20.557223 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-1b585600-19d8-4544-8a86-8f51aea8254d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:20.559714 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-a9eb7314-a4b7-42e1-a848-4f562d9eb06d tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3f67480c8a4ab8b538d4bebfa12d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d58ec8819c4af9bb00a08e2ca12708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:20.560178 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-1b585600-19d8-4544-8a86-8f51aea8254d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:20.569421 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a9eb7314-a4b7-42e1-a848-4f562d9eb06d tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] 10.222.0.70 "GET /compute/v2.1/servers/879f248c-09b1-4e34-982e-bb8b75be03ce" status: 200 len: 1314 microversion: 2.1 time: 0.381485 Aug 27 03:06:20.573590 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1b585600-19d8-4544-8a86-8f51aea8254d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:20.574747 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2401/4772] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:20 2022] GET /compute/v2.1/servers/879f248c-09b1-4e34-982e-bb8b75be03ce => generated 1314 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:06:20.588628 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1b585600-19d8-4544-8a86-8f51aea8254d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:20.594756 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1b585600-19d8-4544-8a86-8f51aea8254d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:20.595561 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1b585600-19d8-4544-8a86-8f51aea8254d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:20.596525 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1b585600-19d8-4544-8a86-8f51aea8254d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:20.596973 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1b585600-19d8-4544-8a86-8f51aea8254d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:20.894618 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-1b585600-19d8-4544-8a86-8f51aea8254d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:20.908992 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-1b585600-19d8-4544-8a86-8f51aea8254d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1510 microversion: 2.1 time: 0.362732 Aug 27 03:06:20.909778 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2372/4773] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:20 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1510 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:21.136571 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-31247dcc-a07b-4a1f-936c-15a84e4e753c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:21.137774 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-31247dcc-a07b-4a1f-936c-15a84e4e753c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: eeb71517-05bf-488e-98b1-04d8a140e079] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:21.152988 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-31247dcc-a07b-4a1f-936c-15a84e4e753c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:21.160105 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-31247dcc-a07b-4a1f-936c-15a84e4e753c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:21.163861 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-31247dcc-a07b-4a1f-936c-15a84e4e753c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:21.165275 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-31247dcc-a07b-4a1f-936c-15a84e4e753c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:21.167087 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-31247dcc-a07b-4a1f-936c-15a84e4e753c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:21.169109 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-31247dcc-a07b-4a1f-936c-15a84e4e753c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:21.486027 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-31247dcc-a07b-4a1f-936c-15a84e4e753c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:21.506171 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-31247dcc-a07b-4a1f-936c-15a84e4e753c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/eeb71517-05bf-488e-98b1-04d8a140e079" status: 200 len: 1493 microversion: 2.1 time: 0.375114 Aug 27 03:06:21.509319 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2402/4774] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:21 2022] GET /compute/v2.1/servers/eeb71517-05bf-488e-98b1-04d8a140e079 => generated 1493 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:21.556508 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b2956f2b-d2c2-4e66-9a0d-628b7fda67e0 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:21.559464 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b2956f2b-d2c2-4e66-9a0d-628b7fda67e0 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: cd881214-dd67-4897-9167-335d7e48d789] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:21.574880 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b2956f2b-d2c2-4e66-9a0d-628b7fda67e0 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:21.575984 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b2956f2b-d2c2-4e66-9a0d-628b7fda67e0 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:21.576832 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b2956f2b-d2c2-4e66-9a0d-628b7fda67e0 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:21.584488 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b2956f2b-d2c2-4e66-9a0d-628b7fda67e0 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:21.585213 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b2956f2b-d2c2-4e66-9a0d-628b7fda67e0 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:21.585871 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b2956f2b-d2c2-4e66-9a0d-628b7fda67e0 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:21.596081 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-886cba6a-9cf9-408f-98e3-5e875ee5c82b tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:21.597271 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-886cba6a-9cf9-408f-98e3-5e875ee5c82b tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] [instance: 879f248c-09b1-4e34-982e-bb8b75be03ce] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:21.620113 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-886cba6a-9cf9-408f-98e3-5e875ee5c82b tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:21.620528 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-886cba6a-9cf9-408f-98e3-5e875ee5c82b tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:21.621055 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-886cba6a-9cf9-408f-98e3-5e875ee5c82b tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:21.621894 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-886cba6a-9cf9-408f-98e3-5e875ee5c82b tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:21.622360 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-886cba6a-9cf9-408f-98e3-5e875ee5c82b tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:21.622791 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-886cba6a-9cf9-408f-98e3-5e875ee5c82b tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:21.702407 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b2956f2b-d2c2-4e66-9a0d-628b7fda67e0 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "GET /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.150298 Aug 27 03:06:21.704207 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2373/4775] 10.222.0.70 () {58 vars in 1302 bytes} [Sat Aug 27 03:06:21 2022] GET /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789/os-volume_attachments => generated 197 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:06:21.931839 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-1d15c4f9-0dd1-4cec-aff6-031a281decc6 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:21.932477 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-1d15c4f9-0dd1-4cec-aff6-031a281decc6 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:21.943462 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1d15c4f9-0dd1-4cec-aff6-031a281decc6 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:21.943990 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1d15c4f9-0dd1-4cec-aff6-031a281decc6 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:21.944455 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1d15c4f9-0dd1-4cec-aff6-031a281decc6 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:21.945173 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1d15c4f9-0dd1-4cec-aff6-031a281decc6 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:21.945623 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1d15c4f9-0dd1-4cec-aff6-031a281decc6 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:21.946046 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1d15c4f9-0dd1-4cec-aff6-031a281decc6 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:22.170639 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-886cba6a-9cf9-408f-98e3-5e875ee5c82b tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3f67480c8a4ab8b538d4bebfa12d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d58ec8819c4af9bb00a08e2ca12708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:22.184807 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-886cba6a-9cf9-408f-98e3-5e875ee5c82b tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] 10.222.0.70 "GET /compute/v2.1/servers/879f248c-09b1-4e34-982e-bb8b75be03ce" status: 200 len: 1314 microversion: 2.1 time: 0.593742 Aug 27 03:06:22.204559 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2403/4776] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:21 2022] GET /compute/v2.1/servers/879f248c-09b1-4e34-982e-bb8b75be03ce => generated 1314 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:22.214842 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-6fa2c0db-6d13-4b0b-9217-9c8564e62d1f req-14f298e5-7ff0-4e49-b703-32b9807ade25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eeb71517-05bf-488e-98b1-04d8a140e079", "name": "network-vif-deleted", "tag": "67c64bad-d441-4030-8e5e-0cfd79ea5647"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:06:22.229572 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-6fa2c0db-6d13-4b0b-9217-9c8564e62d1f req-14f298e5-7ff0-4e49-b703-32b9807ade25 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:22.230267 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-6fa2c0db-6d13-4b0b-9217-9c8564e62d1f req-14f298e5-7ff0-4e49-b703-32b9807ade25 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:22.230852 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-6fa2c0db-6d13-4b0b-9217-9c8564e62d1f req-14f298e5-7ff0-4e49-b703-32b9807ade25 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:22.248547 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-6fa2c0db-6d13-4b0b-9217-9c8564e62d1f req-14f298e5-7ff0-4e49-b703-32b9807ade25 service nova] Creating event network-vif-deleted:67c64bad-d441-4030-8e5e-0cfd79ea5647 for instance eeb71517-05bf-488e-98b1-04d8a140e079 on n-h2-852278-4 Aug 27 03:06:22.271904 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-6fa2c0db-6d13-4b0b-9217-9c8564e62d1f req-14f298e5-7ff0-4e49-b703-32b9807ade25 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065333 Aug 27 03:06:22.279217 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2404/4777] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:06:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:06:22.512187 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-1d15c4f9-0dd1-4cec-aff6-031a281decc6 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:22.534129 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-1d15c4f9-0dd1-4cec-aff6-031a281decc6 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1510 microversion: 2.1 time: 0.605694 Aug 27 03:06:22.539265 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2374/4778] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:21 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1510 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:22.553861 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-98dc02f5-e656-4536-9695-58399542747f tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:22.555621 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-98dc02f5-e656-4536-9695-58399542747f tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: eeb71517-05bf-488e-98b1-04d8a140e079] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:22.574359 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-98dc02f5-e656-4536-9695-58399542747f tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:22.575203 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-98dc02f5-e656-4536-9695-58399542747f tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:22.575833 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-98dc02f5-e656-4536-9695-58399542747f tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:22.578662 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-98dc02f5-e656-4536-9695-58399542747f tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:22.582037 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-98dc02f5-e656-4536-9695-58399542747f tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:22.582858 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-98dc02f5-e656-4536-9695-58399542747f tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:22.708738 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-98dc02f5-e656-4536-9695-58399542747f tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:22.709575 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-98dc02f5-e656-4536-9695-58399542747f tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:22.712276 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-98dc02f5-e656-4536-9695-58399542747f tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:22.713017 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.objects.instance [None req-98dc02f5-e656-4536-9695-58399542747f tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lazy-loading 'fault' on Instance uuid eeb71517-05bf-488e-98b1-04d8a140e079 {{(pid=134051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:06:22.719988 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-38f00dc7-ff61-4ebe-b38e-245d37578e19 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:22.723241 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-38f00dc7-ff61-4ebe-b38e-245d37578e19 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: cd881214-dd67-4897-9167-335d7e48d789] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:22.741067 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-38f00dc7-ff61-4ebe-b38e-245d37578e19 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:22.741634 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-38f00dc7-ff61-4ebe-b38e-245d37578e19 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:22.742077 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-38f00dc7-ff61-4ebe-b38e-245d37578e19 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:22.747188 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-38f00dc7-ff61-4ebe-b38e-245d37578e19 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:22.747882 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-38f00dc7-ff61-4ebe-b38e-245d37578e19 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:22.748360 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-38f00dc7-ff61-4ebe-b38e-245d37578e19 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:22.855132 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-38f00dc7-ff61-4ebe-b38e-245d37578e19 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "GET /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.142585 Aug 27 03:06:22.860285 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2375/4779] 10.222.0.70 () {58 vars in 1302 bytes} [Sat Aug 27 03:06:22 2022] GET /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789/os-volume_attachments => generated 197 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:06:22.867122 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-98dc02f5-e656-4536-9695-58399542747f tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:22.882456 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-98dc02f5-e656-4536-9695-58399542747f tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/eeb71517-05bf-488e-98b1-04d8a140e079" status: 200 len: 1309 microversion: 2.1 time: 0.333084 Aug 27 03:06:22.884047 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2405/4780] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:22 2022] GET /compute/v2.1/servers/eeb71517-05bf-488e-98b1-04d8a140e079 => generated 1309 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:23.212422 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-998de9f8-e90f-4952-851f-78091c1d2009 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:23.213975 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-998de9f8-e90f-4952-851f-78091c1d2009 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] [instance: 879f248c-09b1-4e34-982e-bb8b75be03ce] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:23.234174 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-998de9f8-e90f-4952-851f-78091c1d2009 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:23.235528 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-998de9f8-e90f-4952-851f-78091c1d2009 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:23.236472 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-998de9f8-e90f-4952-851f-78091c1d2009 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:23.240552 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-998de9f8-e90f-4952-851f-78091c1d2009 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:23.241788 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-998de9f8-e90f-4952-851f-78091c1d2009 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:23.245677 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-998de9f8-e90f-4952-851f-78091c1d2009 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:23.616239 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-998de9f8-e90f-4952-851f-78091c1d2009 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3f67480c8a4ab8b538d4bebfa12d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d58ec8819c4af9bb00a08e2ca12708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:23.633887 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-998de9f8-e90f-4952-851f-78091c1d2009 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] 10.222.0.70 "GET /compute/v2.1/servers/879f248c-09b1-4e34-982e-bb8b75be03ce" status: 200 len: 1314 microversion: 2.1 time: 0.427582 Aug 27 03:06:23.645095 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2406/4781] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:23 2022] GET /compute/v2.1/servers/879f248c-09b1-4e34-982e-bb8b75be03ce => generated 1314 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:23.656709 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-30b30a30-e02c-49b0-81f3-d7028149c033 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:23.657496 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-30b30a30-e02c-49b0-81f3-d7028149c033 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:23.668421 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-30b30a30-e02c-49b0-81f3-d7028149c033 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:23.669519 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-30b30a30-e02c-49b0-81f3-d7028149c033 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:23.670113 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-30b30a30-e02c-49b0-81f3-d7028149c033 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:23.671057 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-30b30a30-e02c-49b0-81f3-d7028149c033 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:23.671656 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-30b30a30-e02c-49b0-81f3-d7028149c033 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:23.672515 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-30b30a30-e02c-49b0-81f3-d7028149c033 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:23.686436 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-33b172c6-981e-4911-b4a4-0b8200579e8b req-b846b44b-f6bb-4748-9955-b950c9dcc034 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "879f248c-09b1-4e34-982e-bb8b75be03ce", "name": "network-vif-plugged", "status": "completed", "tag": "17e98da5-b4f5-4a1e-918f-2bd27122b546"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:06:23.725258 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-33b172c6-981e-4911-b4a4-0b8200579e8b req-b846b44b-f6bb-4748-9955-b950c9dcc034 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:23.727163 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-33b172c6-981e-4911-b4a4-0b8200579e8b req-b846b44b-f6bb-4748-9955-b950c9dcc034 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:23.729976 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-33b172c6-981e-4911-b4a4-0b8200579e8b req-b846b44b-f6bb-4748-9955-b950c9dcc034 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:23.788166 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-33b172c6-981e-4911-b4a4-0b8200579e8b req-b846b44b-f6bb-4748-9955-b950c9dcc034 service nova] Creating event network-vif-plugged:17e98da5-b4f5-4a1e-918f-2bd27122b546 for instance 879f248c-09b1-4e34-982e-bb8b75be03ce on n-h2-852278-4 Aug 27 03:06:23.801266 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-33b172c6-981e-4911-b4a4-0b8200579e8b req-b846b44b-f6bb-4748-9955-b950c9dcc034 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.694686 Aug 27 03:06:23.801900 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2376/4782] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:06:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:06:23.874001 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-70c6f93a-73a0-4304-8792-16bf330a271b tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:23.876393 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-70c6f93a-73a0-4304-8792-16bf330a271b tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: cd881214-dd67-4897-9167-335d7e48d789] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:23.896354 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-70c6f93a-73a0-4304-8792-16bf330a271b tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:23.898833 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-70c6f93a-73a0-4304-8792-16bf330a271b tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:23.899605 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-70c6f93a-73a0-4304-8792-16bf330a271b tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:23.903459 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-70c6f93a-73a0-4304-8792-16bf330a271b tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:23.905206 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-70c6f93a-73a0-4304-8792-16bf330a271b tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:23.905826 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-70c6f93a-73a0-4304-8792-16bf330a271b tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:24.009335 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-70c6f93a-73a0-4304-8792-16bf330a271b tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "GET /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.144238 Aug 27 03:06:24.013467 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2377/4783] 10.222.0.70 () {58 vars in 1302 bytes} [Sat Aug 27 03:06:23 2022] GET /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789/os-volume_attachments => generated 197 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:06:24.024842 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e22e6952-7b1f-4a69-a551-3d1ec3aa4031 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:24.025640 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-e22e6952-7b1f-4a69-a551-3d1ec3aa4031 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: eeb71517-05bf-488e-98b1-04d8a140e079] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:24.040436 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e22e6952-7b1f-4a69-a551-3d1ec3aa4031 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:24.041112 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e22e6952-7b1f-4a69-a551-3d1ec3aa4031 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:24.044865 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e22e6952-7b1f-4a69-a551-3d1ec3aa4031 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:24.046033 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e22e6952-7b1f-4a69-a551-3d1ec3aa4031 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:24.046648 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e22e6952-7b1f-4a69-a551-3d1ec3aa4031 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:24.048766 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e22e6952-7b1f-4a69-a551-3d1ec3aa4031 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:24.081608 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-e22e6952-7b1f-4a69-a551-3d1ec3aa4031 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] HTTP exception thrown: Instance eeb71517-05bf-488e-98b1-04d8a140e079 could not be found. Aug 27 03:06:24.085769 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e22e6952-7b1f-4a69-a551-3d1ec3aa4031 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Request method failure captured: Aug 27 03:06:24.085769 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/servers/eeb71517-05bf-488e-98b1-04d8a140e079 HTTP/1.1 Aug 27 03:06:24.085769 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 03:06:24.085769 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 03:06:24.085769 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 03:06:24.085769 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 03:06:24.085769 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 03:06:24.085769 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 03:06:24.085769 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 03:06:24.085769 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 03:06:24.085769 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYljOihuPJQy-4KxXQ6OhbQw2FQiYByi8_J9EYziHxHrRpgpXLGNvb0hsYYYVptKud4yCoN0X9GxdS_QRHpRChZ0P7CrkMR6MvE3oNyvsgDIOynlxCCmMse1aD34uMngOe0Z8wMpnS_90nVB9LjwZPMQBiRDrvzydhSu6jwK0Njtp_4 Aug 27 03:06:24.085769 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 03:06:24.085769 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 03:06:24.085769 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 03:06:24.085769 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 03:06:24.085769 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 03:06:24.085769 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 03:06:24.085769 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 6b8d6664c463420bad9a5bfb6d747db4 Aug 27 03:06:24.085769 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ServersTestJSON-252485458 Aug 27 03:06:24.085769 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 03:06:24.085769 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 03:06:24.085769 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6b8d6664c463420bad9a5bfb6d747db4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_6b8d6664c463420bad9a5bfb6d747db4", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6b8d6664c463420bad9a5bfb6d747db4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/6b8d6664c463420bad9a5bfb6d747db4"}]}] Aug 27 03:06:24.085769 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ServersTestJSON-252485458 Aug 27 03:06:24.085769 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 6b8d6664c463420bad9a5bfb6d747db4 Aug 27 03:06:24.085769 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ServersTestJSON-252485458 Aug 27 03:06:24.085769 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ServersTestJSON-252485458-project Aug 27 03:06:24.085769 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 03:06:24.085769 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 03:06:24.085769 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 13a4e6dcf5df46fcad30430a9b9a08ee Aug 27 03:06:24.085769 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ServersTestJSON-252485458-project Aug 27 03:06:24.085769 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 03:06:24.085769 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance eeb71517-05bf-488e-98b1-04d8a140e079 could not be found. Aug 27 03:06:24.085769 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': 'eeb71517-05bf-488e-98b1-04d8a140e079'} Aug 27 03:06:24.085769 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:06:24.085769 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:24.085769 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:06:24.085769 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:06:24.085769 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:06:24.085769 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:06:24.085769 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:06:24.085769 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:06:24.085769 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:06:24.085769 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:06:24.085769 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eeb71517-05bf-488e-98b1-04d8a140e079 could not be found. Aug 27 03:06:24.085769 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:06:24.085769 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:06:24.085769 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:06:24.085769 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:24.085769 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:06:24.085769 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:06:24.085769 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:06:24.085769 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:06:24.085769 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:06:24.085769 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:06:24.085769 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:06:24.085769 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:06:24.085769 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:06:24.085769 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:06:24.085769 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:06:24.085769 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:06:24.085769 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eeb71517-05bf-488e-98b1-04d8a140e079 could not be found. Aug 27 03:06:24.085769 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:06:24.085769 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:06:24.085769 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:06:24.085769 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:24.090053 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:06:24.090053 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:06:24.090053 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:06:24.090053 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:06:24.090053 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eeb71517-05bf-488e-98b1-04d8a140e079 could not be found. Aug 27 03:06:24.090053 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:06:24.094723 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e22e6952-7b1f-4a69-a551-3d1ec3aa4031 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Returning 404 to user: Instance eeb71517-05bf-488e-98b1-04d8a140e079 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:06:24.095868 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e22e6952-7b1f-4a69-a551-3d1ec3aa4031 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/eeb71517-05bf-488e-98b1-04d8a140e079" status: 404 len: 111 microversion: 2.1 time: 0.080790 Aug 27 03:06:24.096639 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2378/4784] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:24 2022] GET /compute/v2.1/servers/eeb71517-05bf-488e-98b1-04d8a140e079 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:06:24.123140 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6a417162-2d45-4196-815e-14b29435d777 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:24.126237 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-6a417162-2d45-4196-815e-14b29435d777 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: eeb71517-05bf-488e-98b1-04d8a140e079] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:24.142923 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6a417162-2d45-4196-815e-14b29435d777 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:24.143654 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6a417162-2d45-4196-815e-14b29435d777 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:24.144219 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6a417162-2d45-4196-815e-14b29435d777 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:24.145095 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6a417162-2d45-4196-815e-14b29435d777 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:24.147542 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6a417162-2d45-4196-815e-14b29435d777 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:24.148167 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6a417162-2d45-4196-815e-14b29435d777 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:24.184144 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-6a417162-2d45-4196-815e-14b29435d777 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] HTTP exception thrown: Instance eeb71517-05bf-488e-98b1-04d8a140e079 could not be found. Aug 27 03:06:24.186029 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6a417162-2d45-4196-815e-14b29435d777 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Request method failure captured: Aug 27 03:06:24.186029 n-d-852278-4 devstack@n-api.service[134052]: request: DELETE /compute/v2.1/servers/eeb71517-05bf-488e-98b1-04d8a140e079 HTTP/1.1 Aug 27 03:06:24.186029 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 03:06:24.186029 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 03:06:24.186029 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 03:06:24.186029 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 03:06:24.186029 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 03:06:24.186029 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 03:06:24.186029 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 03:06:24.186029 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 03:06:24.186029 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYljOihuPJQy-4KxXQ6OhbQw2FQiYByi8_J9EYziHxHrRpgpXLGNvb0hsYYYVptKud4yCoN0X9GxdS_QRHpRChZ0P7CrkMR6MvE3oNyvsgDIOynlxCCmMse1aD34uMngOe0Z8wMpnS_90nVB9LjwZPMQBiRDrvzydhSu6jwK0Njtp_4 Aug 27 03:06:24.186029 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 03:06:24.186029 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 03:06:24.186029 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 03:06:24.186029 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 03:06:24.186029 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 03:06:24.186029 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 03:06:24.186029 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 6b8d6664c463420bad9a5bfb6d747db4 Aug 27 03:06:24.186029 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ServersTestJSON-252485458 Aug 27 03:06:24.186029 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 03:06:24.186029 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 03:06:24.186029 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6b8d6664c463420bad9a5bfb6d747db4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_6b8d6664c463420bad9a5bfb6d747db4", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6b8d6664c463420bad9a5bfb6d747db4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/6b8d6664c463420bad9a5bfb6d747db4"}]}] Aug 27 03:06:24.186029 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ServersTestJSON-252485458 Aug 27 03:06:24.186029 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 6b8d6664c463420bad9a5bfb6d747db4 Aug 27 03:06:24.186029 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ServersTestJSON-252485458 Aug 27 03:06:24.186029 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ServersTestJSON-252485458-project Aug 27 03:06:24.186029 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 03:06:24.186029 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 03:06:24.186029 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 13a4e6dcf5df46fcad30430a9b9a08ee Aug 27 03:06:24.186029 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ServersTestJSON-252485458-project Aug 27 03:06:24.186029 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 03:06:24.186029 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance eeb71517-05bf-488e-98b1-04d8a140e079 could not be found. Aug 27 03:06:24.186029 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': 'eeb71517-05bf-488e-98b1-04d8a140e079'} Aug 27 03:06:24.186029 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:06:24.186029 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:24.186029 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:06:24.186029 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:06:24.186029 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:06:24.186029 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:06:24.186029 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:06:24.186029 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:06:24.186029 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:06:24.186029 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:06:24.186029 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eeb71517-05bf-488e-98b1-04d8a140e079 could not be found. Aug 27 03:06:24.186029 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:06:24.186029 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:06:24.186029 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:06:24.186029 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:24.186029 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:06:24.186029 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:06:24.186029 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:06:24.186029 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:06:24.186029 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:06:24.186029 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:06:24.186029 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 03:06:24.186029 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 03:06:24.186029 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 03:06:24.186029 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 03:06:24.186029 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:06:24.186029 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:06:24.186029 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:06:24.186029 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:06:24.186029 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eeb71517-05bf-488e-98b1-04d8a140e079 could not be found. Aug 27 03:06:24.189982 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:06:24.189982 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:06:24.189982 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:06:24.189982 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:24.189982 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:06:24.189982 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:06:24.189982 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:06:24.189982 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:06:24.189982 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eeb71517-05bf-488e-98b1-04d8a140e079 could not be found. Aug 27 03:06:24.189982 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:06:24.192570 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6a417162-2d45-4196-815e-14b29435d777 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Returning 404 to user: Instance eeb71517-05bf-488e-98b1-04d8a140e079 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:06:24.197136 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-6a417162-2d45-4196-815e-14b29435d777 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "DELETE /compute/v2.1/servers/eeb71517-05bf-488e-98b1-04d8a140e079" status: 404 len: 111 microversion: 2.1 time: 0.084542 Aug 27 03:06:24.215026 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2379/4785] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 03:06:24 2022] DELETE /compute/v2.1/servers/eeb71517-05bf-488e-98b1-04d8a140e079 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:06:24.231904 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-bc60ebd1-ef4f-4240-b401-7df2ba092802 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:24.234112 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-bc60ebd1-ef4f-4240-b401-7df2ba092802 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: eeb71517-05bf-488e-98b1-04d8a140e079] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:24.253664 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bc60ebd1-ef4f-4240-b401-7df2ba092802 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:24.255321 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-30b30a30-e02c-49b0-81f3-d7028149c033 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:24.256653 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bc60ebd1-ef4f-4240-b401-7df2ba092802 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:24.257282 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bc60ebd1-ef4f-4240-b401-7df2ba092802 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:24.259481 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bc60ebd1-ef4f-4240-b401-7df2ba092802 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:24.265532 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bc60ebd1-ef4f-4240-b401-7df2ba092802 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:24.266270 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bc60ebd1-ef4f-4240-b401-7df2ba092802 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:24.268346 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-30b30a30-e02c-49b0-81f3-d7028149c033 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1510 microversion: 2.1 time: 0.616816 Aug 27 03:06:24.269818 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2407/4786] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:23 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1510 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:24.290238 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-bc60ebd1-ef4f-4240-b401-7df2ba092802 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] HTTP exception thrown: Instance eeb71517-05bf-488e-98b1-04d8a140e079 could not be found. Aug 27 03:06:24.292067 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-bc60ebd1-ef4f-4240-b401-7df2ba092802 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Request method failure captured: Aug 27 03:06:24.292067 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/servers/eeb71517-05bf-488e-98b1-04d8a140e079 HTTP/1.1 Aug 27 03:06:24.292067 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 03:06:24.292067 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 03:06:24.292067 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 03:06:24.292067 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 03:06:24.292067 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 03:06:24.292067 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 03:06:24.292067 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 03:06:24.292067 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 03:06:24.292067 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYljOihuPJQy-4KxXQ6OhbQw2FQiYByi8_J9EYziHxHrRpgpXLGNvb0hsYYYVptKud4yCoN0X9GxdS_QRHpRChZ0P7CrkMR6MvE3oNyvsgDIOynlxCCmMse1aD34uMngOe0Z8wMpnS_90nVB9LjwZPMQBiRDrvzydhSu6jwK0Njtp_4 Aug 27 03:06:24.292067 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 03:06:24.292067 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 03:06:24.292067 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 03:06:24.292067 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 03:06:24.292067 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 03:06:24.292067 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 03:06:24.292067 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 6b8d6664c463420bad9a5bfb6d747db4 Aug 27 03:06:24.292067 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ServersTestJSON-252485458 Aug 27 03:06:24.292067 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 03:06:24.292067 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 03:06:24.292067 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6b8d6664c463420bad9a5bfb6d747db4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_6b8d6664c463420bad9a5bfb6d747db4", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6b8d6664c463420bad9a5bfb6d747db4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/6b8d6664c463420bad9a5bfb6d747db4"}]}] Aug 27 03:06:24.292067 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ServersTestJSON-252485458 Aug 27 03:06:24.292067 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 6b8d6664c463420bad9a5bfb6d747db4 Aug 27 03:06:24.292067 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ServersTestJSON-252485458 Aug 27 03:06:24.292067 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ServersTestJSON-252485458-project Aug 27 03:06:24.292067 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 03:06:24.292067 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 03:06:24.292067 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 13a4e6dcf5df46fcad30430a9b9a08ee Aug 27 03:06:24.292067 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ServersTestJSON-252485458-project Aug 27 03:06:24.292067 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 03:06:24.292067 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance eeb71517-05bf-488e-98b1-04d8a140e079 could not be found. Aug 27 03:06:24.292067 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': 'eeb71517-05bf-488e-98b1-04d8a140e079'} Aug 27 03:06:24.292067 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:06:24.292067 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:24.292067 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:06:24.292067 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:06:24.292067 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:06:24.292067 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:06:24.292067 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:06:24.292067 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:06:24.292067 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:06:24.292067 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:06:24.292067 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eeb71517-05bf-488e-98b1-04d8a140e079 could not be found. Aug 27 03:06:24.292067 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:06:24.292067 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:06:24.292067 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:06:24.292067 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:24.292067 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:06:24.292067 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:06:24.292067 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:06:24.292067 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:06:24.292067 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:06:24.292067 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:06:24.292067 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:06:24.292067 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:06:24.292067 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:06:24.292067 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:06:24.292067 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:06:24.292067 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:06:24.292067 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eeb71517-05bf-488e-98b1-04d8a140e079 could not be found. Aug 27 03:06:24.292067 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:06:24.292067 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:06:24.292067 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:06:24.292067 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:24.296079 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:06:24.296079 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:06:24.296079 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:06:24.296079 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:06:24.296079 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eeb71517-05bf-488e-98b1-04d8a140e079 could not be found. Aug 27 03:06:24.296079 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:06:24.299049 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-bc60ebd1-ef4f-4240-b401-7df2ba092802 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Returning 404 to user: Instance eeb71517-05bf-488e-98b1-04d8a140e079 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:06:24.300171 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-bc60ebd1-ef4f-4240-b401-7df2ba092802 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/eeb71517-05bf-488e-98b1-04d8a140e079" status: 404 len: 111 microversion: 2.1 time: 0.083889 Aug 27 03:06:24.304583 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2380/4787] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:24 2022] GET /compute/v2.1/servers/eeb71517-05bf-488e-98b1-04d8a140e079 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:06:24.317723 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3cd6ec9c-adb8-4b7f-865a-19ace1393e9c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:24.318307 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-3cd6ec9c-adb8-4b7f-865a-19ace1393e9c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: f1af7d0e-6991-4b4f-83ef-1008fb6d4f58] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:24.342003 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3cd6ec9c-adb8-4b7f-865a-19ace1393e9c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:24.343112 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3cd6ec9c-adb8-4b7f-865a-19ace1393e9c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:24.343580 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3cd6ec9c-adb8-4b7f-865a-19ace1393e9c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:24.344348 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3cd6ec9c-adb8-4b7f-865a-19ace1393e9c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:24.344811 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3cd6ec9c-adb8-4b7f-865a-19ace1393e9c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:24.345243 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3cd6ec9c-adb8-4b7f-865a-19ace1393e9c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:24.385393 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-3cd6ec9c-adb8-4b7f-865a-19ace1393e9c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] HTTP exception thrown: Instance f1af7d0e-6991-4b4f-83ef-1008fb6d4f58 could not be found. Aug 27 03:06:24.390090 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3cd6ec9c-adb8-4b7f-865a-19ace1393e9c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Request method failure captured: Aug 27 03:06:24.390090 n-d-852278-4 devstack@n-api.service[134051]: request: DELETE /compute/v2.1/servers/f1af7d0e-6991-4b4f-83ef-1008fb6d4f58 HTTP/1.1 Aug 27 03:06:24.390090 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 03:06:24.390090 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 03:06:24.390090 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 03:06:24.390090 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 03:06:24.390090 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 03:06:24.390090 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 03:06:24.390090 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 03:06:24.390090 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 03:06:24.390090 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYljOihuPJQy-4KxXQ6OhbQw2FQiYByi8_J9EYziHxHrRpgpXLGNvb0hsYYYVptKud4yCoN0X9GxdS_QRHpRChZ0P7CrkMR6MvE3oNyvsgDIOynlxCCmMse1aD34uMngOe0Z8wMpnS_90nVB9LjwZPMQBiRDrvzydhSu6jwK0Njtp_4 Aug 27 03:06:24.390090 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 03:06:24.390090 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 03:06:24.390090 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 03:06:24.390090 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 03:06:24.390090 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 03:06:24.390090 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 03:06:24.390090 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 6b8d6664c463420bad9a5bfb6d747db4 Aug 27 03:06:24.390090 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ServersTestJSON-252485458 Aug 27 03:06:24.390090 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 03:06:24.390090 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 03:06:24.390090 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6b8d6664c463420bad9a5bfb6d747db4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_6b8d6664c463420bad9a5bfb6d747db4", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6b8d6664c463420bad9a5bfb6d747db4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/6b8d6664c463420bad9a5bfb6d747db4"}]}] Aug 27 03:06:24.390090 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ServersTestJSON-252485458 Aug 27 03:06:24.390090 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 6b8d6664c463420bad9a5bfb6d747db4 Aug 27 03:06:24.390090 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ServersTestJSON-252485458 Aug 27 03:06:24.390090 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ServersTestJSON-252485458-project Aug 27 03:06:24.390090 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 03:06:24.390090 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 03:06:24.390090 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 13a4e6dcf5df46fcad30430a9b9a08ee Aug 27 03:06:24.390090 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ServersTestJSON-252485458-project Aug 27 03:06:24.390090 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 03:06:24.390090 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance f1af7d0e-6991-4b4f-83ef-1008fb6d4f58 could not be found. Aug 27 03:06:24.390090 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': 'f1af7d0e-6991-4b4f-83ef-1008fb6d4f58'} Aug 27 03:06:24.390090 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:06:24.390090 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:24.390090 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:06:24.390090 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:06:24.390090 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:06:24.390090 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:06:24.390090 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:06:24.390090 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:06:24.390090 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:06:24.390090 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:06:24.390090 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1af7d0e-6991-4b4f-83ef-1008fb6d4f58 could not be found. Aug 27 03:06:24.390090 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:24.390090 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:06:24.390090 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:24.390090 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:24.390090 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:06:24.390090 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:06:24.390090 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:06:24.390090 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:06:24.390090 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:06:24.390090 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:06:24.390090 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 03:06:24.390090 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 03:06:24.390090 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 03:06:24.390090 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 03:06:24.390090 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:06:24.390090 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:06:24.390090 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:06:24.390090 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:06:24.390090 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1af7d0e-6991-4b4f-83ef-1008fb6d4f58 could not be found. Aug 27 03:06:24.393431 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:24.393431 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:06:24.393431 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:24.393431 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:24.393431 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:06:24.393431 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:06:24.393431 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:06:24.393431 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:06:24.393431 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1af7d0e-6991-4b4f-83ef-1008fb6d4f58 could not be found. Aug 27 03:06:24.393431 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:24.393431 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3cd6ec9c-adb8-4b7f-865a-19ace1393e9c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Returning 404 to user: Instance f1af7d0e-6991-4b4f-83ef-1008fb6d4f58 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:06:24.393431 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-3cd6ec9c-adb8-4b7f-865a-19ace1393e9c tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "DELETE /compute/v2.1/servers/f1af7d0e-6991-4b4f-83ef-1008fb6d4f58" status: 404 len: 111 microversion: 2.1 time: 0.085347 Aug 27 03:06:24.401250 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-2ab3354c-6a02-4315-b59d-418d8181c8ed tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:24.401876 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-2ab3354c-6a02-4315-b59d-418d8181c8ed tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: f1af7d0e-6991-4b4f-83ef-1008fb6d4f58] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:24.406488 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2408/4788] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 03:06:24 2022] DELETE /compute/v2.1/servers/f1af7d0e-6991-4b4f-83ef-1008fb6d4f58 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:06:24.409220 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2ab3354c-6a02-4315-b59d-418d8181c8ed tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:24.409709 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2ab3354c-6a02-4315-b59d-418d8181c8ed tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:24.410149 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2ab3354c-6a02-4315-b59d-418d8181c8ed tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:24.411027 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2ab3354c-6a02-4315-b59d-418d8181c8ed tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:24.411574 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2ab3354c-6a02-4315-b59d-418d8181c8ed tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:24.412277 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2ab3354c-6a02-4315-b59d-418d8181c8ed tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:24.440229 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-2ab3354c-6a02-4315-b59d-418d8181c8ed tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] HTTP exception thrown: Instance f1af7d0e-6991-4b4f-83ef-1008fb6d4f58 could not be found. Aug 27 03:06:24.442250 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-2ab3354c-6a02-4315-b59d-418d8181c8ed tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Request method failure captured: Aug 27 03:06:24.442250 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/servers/f1af7d0e-6991-4b4f-83ef-1008fb6d4f58 HTTP/1.1 Aug 27 03:06:24.442250 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 03:06:24.442250 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 03:06:24.442250 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 03:06:24.442250 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 03:06:24.442250 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 03:06:24.442250 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 03:06:24.442250 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 03:06:24.442250 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 03:06:24.442250 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYljOihuPJQy-4KxXQ6OhbQw2FQiYByi8_J9EYziHxHrRpgpXLGNvb0hsYYYVptKud4yCoN0X9GxdS_QRHpRChZ0P7CrkMR6MvE3oNyvsgDIOynlxCCmMse1aD34uMngOe0Z8wMpnS_90nVB9LjwZPMQBiRDrvzydhSu6jwK0Njtp_4 Aug 27 03:06:24.442250 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 03:06:24.442250 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 03:06:24.442250 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 03:06:24.442250 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 03:06:24.442250 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 03:06:24.442250 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 03:06:24.442250 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 6b8d6664c463420bad9a5bfb6d747db4 Aug 27 03:06:24.442250 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ServersTestJSON-252485458 Aug 27 03:06:24.442250 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 03:06:24.442250 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 03:06:24.442250 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6b8d6664c463420bad9a5bfb6d747db4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_6b8d6664c463420bad9a5bfb6d747db4", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6b8d6664c463420bad9a5bfb6d747db4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/6b8d6664c463420bad9a5bfb6d747db4"}]}] Aug 27 03:06:24.442250 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ServersTestJSON-252485458 Aug 27 03:06:24.442250 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 6b8d6664c463420bad9a5bfb6d747db4 Aug 27 03:06:24.442250 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ServersTestJSON-252485458 Aug 27 03:06:24.442250 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ServersTestJSON-252485458-project Aug 27 03:06:24.442250 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 03:06:24.442250 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 03:06:24.442250 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 13a4e6dcf5df46fcad30430a9b9a08ee Aug 27 03:06:24.442250 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ServersTestJSON-252485458-project Aug 27 03:06:24.442250 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 03:06:24.442250 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance f1af7d0e-6991-4b4f-83ef-1008fb6d4f58 could not be found. Aug 27 03:06:24.442250 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': 'f1af7d0e-6991-4b4f-83ef-1008fb6d4f58'} Aug 27 03:06:24.442250 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:06:24.442250 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:24.442250 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:06:24.442250 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:06:24.442250 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:06:24.442250 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:06:24.442250 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:06:24.442250 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:06:24.442250 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:06:24.442250 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:06:24.442250 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1af7d0e-6991-4b4f-83ef-1008fb6d4f58 could not be found. Aug 27 03:06:24.442250 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:06:24.442250 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:06:24.442250 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:06:24.442250 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:24.442250 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:06:24.442250 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:06:24.442250 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:06:24.442250 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:06:24.442250 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:06:24.442250 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:06:24.442250 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:06:24.442250 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:06:24.442250 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:06:24.442250 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:06:24.442250 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:06:24.442250 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:06:24.442250 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1af7d0e-6991-4b4f-83ef-1008fb6d4f58 could not be found. Aug 27 03:06:24.442250 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:06:24.442250 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:06:24.442250 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:06:24.442250 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:24.446245 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:06:24.446245 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:06:24.446245 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:06:24.446245 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:06:24.446245 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1af7d0e-6991-4b4f-83ef-1008fb6d4f58 could not be found. Aug 27 03:06:24.446245 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:06:24.450598 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-2ab3354c-6a02-4315-b59d-418d8181c8ed tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Returning 404 to user: Instance f1af7d0e-6991-4b4f-83ef-1008fb6d4f58 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:06:24.454238 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-2ab3354c-6a02-4315-b59d-418d8181c8ed tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/f1af7d0e-6991-4b4f-83ef-1008fb6d4f58" status: 404 len: 111 microversion: 2.1 time: 0.057945 Aug 27 03:06:24.466517 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-60b07be0-a74f-4caa-a466-23ae74a751fb tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:24.467057 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-60b07be0-a74f-4caa-a466-23ae74a751fb tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: 8a65899b-549f-4312-bf67-a1ca9a8f79d7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:24.472384 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2381/4789] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:24 2022] GET /compute/v2.1/servers/f1af7d0e-6991-4b4f-83ef-1008fb6d4f58 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 03:06:24.478080 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-60b07be0-a74f-4caa-a466-23ae74a751fb tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:24.478580 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-60b07be0-a74f-4caa-a466-23ae74a751fb tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:24.479018 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-60b07be0-a74f-4caa-a466-23ae74a751fb tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:24.483119 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-60b07be0-a74f-4caa-a466-23ae74a751fb tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:24.484694 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-60b07be0-a74f-4caa-a466-23ae74a751fb tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:24.487398 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-60b07be0-a74f-4caa-a466-23ae74a751fb tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:24.531003 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-60b07be0-a74f-4caa-a466-23ae74a751fb tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] HTTP exception thrown: Instance 8a65899b-549f-4312-bf67-a1ca9a8f79d7 could not be found. Aug 27 03:06:24.532721 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-60b07be0-a74f-4caa-a466-23ae74a751fb tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Request method failure captured: Aug 27 03:06:24.532721 n-d-852278-4 devstack@n-api.service[134051]: request: DELETE /compute/v2.1/servers/8a65899b-549f-4312-bf67-a1ca9a8f79d7 HTTP/1.1 Aug 27 03:06:24.532721 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 03:06:24.532721 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 03:06:24.532721 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 03:06:24.532721 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 03:06:24.532721 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 03:06:24.532721 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 03:06:24.532721 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 03:06:24.532721 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 03:06:24.532721 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYljOihuPJQy-4KxXQ6OhbQw2FQiYByi8_J9EYziHxHrRpgpXLGNvb0hsYYYVptKud4yCoN0X9GxdS_QRHpRChZ0P7CrkMR6MvE3oNyvsgDIOynlxCCmMse1aD34uMngOe0Z8wMpnS_90nVB9LjwZPMQBiRDrvzydhSu6jwK0Njtp_4 Aug 27 03:06:24.532721 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 03:06:24.532721 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 03:06:24.532721 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 03:06:24.532721 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 03:06:24.532721 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 03:06:24.532721 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 03:06:24.532721 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 6b8d6664c463420bad9a5bfb6d747db4 Aug 27 03:06:24.532721 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ServersTestJSON-252485458 Aug 27 03:06:24.532721 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 03:06:24.532721 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 03:06:24.532721 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6b8d6664c463420bad9a5bfb6d747db4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_6b8d6664c463420bad9a5bfb6d747db4", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6b8d6664c463420bad9a5bfb6d747db4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/6b8d6664c463420bad9a5bfb6d747db4"}]}] Aug 27 03:06:24.532721 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ServersTestJSON-252485458 Aug 27 03:06:24.532721 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 6b8d6664c463420bad9a5bfb6d747db4 Aug 27 03:06:24.532721 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ServersTestJSON-252485458 Aug 27 03:06:24.532721 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ServersTestJSON-252485458-project Aug 27 03:06:24.532721 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 03:06:24.532721 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 03:06:24.532721 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 13a4e6dcf5df46fcad30430a9b9a08ee Aug 27 03:06:24.532721 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ServersTestJSON-252485458-project Aug 27 03:06:24.532721 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 03:06:24.532721 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance 8a65899b-549f-4312-bf67-a1ca9a8f79d7 could not be found. Aug 27 03:06:24.532721 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '8a65899b-549f-4312-bf67-a1ca9a8f79d7'} Aug 27 03:06:24.532721 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:06:24.532721 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:24.532721 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:06:24.532721 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:06:24.532721 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:06:24.532721 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:06:24.532721 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:06:24.532721 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:06:24.532721 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:06:24.532721 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:06:24.532721 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a65899b-549f-4312-bf67-a1ca9a8f79d7 could not be found. Aug 27 03:06:24.532721 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:24.532721 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:06:24.532721 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:24.532721 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:24.532721 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:06:24.532721 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:06:24.532721 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:06:24.532721 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:06:24.532721 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:06:24.532721 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:06:24.532721 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 03:06:24.532721 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 03:06:24.532721 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 03:06:24.532721 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 03:06:24.532721 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:06:24.532721 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:06:24.532721 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:06:24.532721 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:06:24.532721 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a65899b-549f-4312-bf67-a1ca9a8f79d7 could not be found. Aug 27 03:06:24.535975 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:24.535975 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:06:24.535975 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:24.535975 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:24.535975 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:06:24.535975 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:06:24.535975 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:06:24.535975 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:06:24.535975 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a65899b-549f-4312-bf67-a1ca9a8f79d7 could not be found. Aug 27 03:06:24.535975 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:24.537641 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-60b07be0-a74f-4caa-a466-23ae74a751fb tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Returning 404 to user: Instance 8a65899b-549f-4312-bf67-a1ca9a8f79d7 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:06:24.538573 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-60b07be0-a74f-4caa-a466-23ae74a751fb tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "DELETE /compute/v2.1/servers/8a65899b-549f-4312-bf67-a1ca9a8f79d7" status: 404 len: 111 microversion: 2.1 time: 0.077764 Aug 27 03:06:24.539158 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2409/4790] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 03:06:24 2022] DELETE /compute/v2.1/servers/8a65899b-549f-4312-bf67-a1ca9a8f79d7 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:06:24.547520 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e0d03bab-2b2b-48a2-9203-98795d030711 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:24.548302 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-e0d03bab-2b2b-48a2-9203-98795d030711 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: 8a65899b-549f-4312-bf67-a1ca9a8f79d7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:24.557079 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e0d03bab-2b2b-48a2-9203-98795d030711 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:24.557573 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e0d03bab-2b2b-48a2-9203-98795d030711 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:24.561855 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e0d03bab-2b2b-48a2-9203-98795d030711 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:24.562716 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e0d03bab-2b2b-48a2-9203-98795d030711 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:24.563202 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e0d03bab-2b2b-48a2-9203-98795d030711 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:24.563641 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e0d03bab-2b2b-48a2-9203-98795d030711 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:24.590946 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-e0d03bab-2b2b-48a2-9203-98795d030711 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] HTTP exception thrown: Instance 8a65899b-549f-4312-bf67-a1ca9a8f79d7 could not be found. Aug 27 03:06:24.597038 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e0d03bab-2b2b-48a2-9203-98795d030711 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Request method failure captured: Aug 27 03:06:24.597038 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/servers/8a65899b-549f-4312-bf67-a1ca9a8f79d7 HTTP/1.1 Aug 27 03:06:24.597038 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 03:06:24.597038 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 03:06:24.597038 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 03:06:24.597038 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 03:06:24.597038 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 03:06:24.597038 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 03:06:24.597038 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 03:06:24.597038 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 03:06:24.597038 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYljOihuPJQy-4KxXQ6OhbQw2FQiYByi8_J9EYziHxHrRpgpXLGNvb0hsYYYVptKud4yCoN0X9GxdS_QRHpRChZ0P7CrkMR6MvE3oNyvsgDIOynlxCCmMse1aD34uMngOe0Z8wMpnS_90nVB9LjwZPMQBiRDrvzydhSu6jwK0Njtp_4 Aug 27 03:06:24.597038 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 03:06:24.597038 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 03:06:24.597038 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 03:06:24.597038 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 03:06:24.597038 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 03:06:24.597038 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 03:06:24.597038 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 6b8d6664c463420bad9a5bfb6d747db4 Aug 27 03:06:24.597038 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ServersTestJSON-252485458 Aug 27 03:06:24.597038 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 03:06:24.597038 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 03:06:24.597038 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6b8d6664c463420bad9a5bfb6d747db4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_6b8d6664c463420bad9a5bfb6d747db4", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6b8d6664c463420bad9a5bfb6d747db4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/6b8d6664c463420bad9a5bfb6d747db4"}]}] Aug 27 03:06:24.597038 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ServersTestJSON-252485458 Aug 27 03:06:24.597038 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 6b8d6664c463420bad9a5bfb6d747db4 Aug 27 03:06:24.597038 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ServersTestJSON-252485458 Aug 27 03:06:24.597038 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ServersTestJSON-252485458-project Aug 27 03:06:24.597038 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 03:06:24.597038 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 03:06:24.597038 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 13a4e6dcf5df46fcad30430a9b9a08ee Aug 27 03:06:24.597038 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ServersTestJSON-252485458-project Aug 27 03:06:24.597038 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 03:06:24.597038 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance 8a65899b-549f-4312-bf67-a1ca9a8f79d7 could not be found. Aug 27 03:06:24.597038 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '8a65899b-549f-4312-bf67-a1ca9a8f79d7'} Aug 27 03:06:24.597038 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:06:24.597038 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:24.597038 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:06:24.597038 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:06:24.597038 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:06:24.597038 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:06:24.597038 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:06:24.597038 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:06:24.597038 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:06:24.597038 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:06:24.597038 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a65899b-549f-4312-bf67-a1ca9a8f79d7 could not be found. Aug 27 03:06:24.597038 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:06:24.597038 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:06:24.597038 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:06:24.597038 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:24.597038 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:06:24.597038 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:06:24.597038 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:06:24.597038 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:06:24.597038 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:06:24.597038 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:06:24.597038 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:06:24.597038 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:06:24.597038 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:06:24.597038 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:06:24.597038 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:06:24.597038 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:06:24.597038 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a65899b-549f-4312-bf67-a1ca9a8f79d7 could not be found. Aug 27 03:06:24.597038 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:06:24.597038 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:06:24.597038 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:06:24.597038 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:24.600968 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:06:24.600968 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:06:24.600968 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:06:24.600968 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:06:24.600968 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a65899b-549f-4312-bf67-a1ca9a8f79d7 could not be found. Aug 27 03:06:24.600968 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:06:24.604840 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e0d03bab-2b2b-48a2-9203-98795d030711 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Returning 404 to user: Instance 8a65899b-549f-4312-bf67-a1ca9a8f79d7 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:06:24.607511 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e0d03bab-2b2b-48a2-9203-98795d030711 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/8a65899b-549f-4312-bf67-a1ca9a8f79d7" status: 404 len: 111 microversion: 2.1 time: 0.064112 Aug 27 03:06:24.616842 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f5fa54b1-f6b7-4415-93a3-abd461f3a7bd tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:24.617777 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-f5fa54b1-f6b7-4415-93a3-abd461f3a7bd tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: d8e61004-a8c1-4880-82b3-133f361a0dfc] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:24.624211 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2382/4791] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:24 2022] GET /compute/v2.1/servers/8a65899b-549f-4312-bf67-a1ca9a8f79d7 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:06:24.629623 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f5fa54b1-f6b7-4415-93a3-abd461f3a7bd tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:24.630364 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f5fa54b1-f6b7-4415-93a3-abd461f3a7bd tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:24.630975 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f5fa54b1-f6b7-4415-93a3-abd461f3a7bd tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:24.633901 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f5fa54b1-f6b7-4415-93a3-abd461f3a7bd tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:24.634849 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f5fa54b1-f6b7-4415-93a3-abd461f3a7bd tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:24.635489 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f5fa54b1-f6b7-4415-93a3-abd461f3a7bd tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:24.658485 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-daa0a53a-6f7a-4095-9466-4a92bf962def tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:24.659427 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-daa0a53a-6f7a-4095-9466-4a92bf962def tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] [instance: 879f248c-09b1-4e34-982e-bb8b75be03ce] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:24.675364 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-daa0a53a-6f7a-4095-9466-4a92bf962def tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:24.676639 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-daa0a53a-6f7a-4095-9466-4a92bf962def tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:24.679088 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-daa0a53a-6f7a-4095-9466-4a92bf962def tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:24.682835 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-daa0a53a-6f7a-4095-9466-4a92bf962def tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:24.685106 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-daa0a53a-6f7a-4095-9466-4a92bf962def tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:24.687364 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-daa0a53a-6f7a-4095-9466-4a92bf962def tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:24.700976 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-f5fa54b1-f6b7-4415-93a3-abd461f3a7bd tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] HTTP exception thrown: Instance d8e61004-a8c1-4880-82b3-133f361a0dfc could not be found. Aug 27 03:06:24.703403 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f5fa54b1-f6b7-4415-93a3-abd461f3a7bd tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Request method failure captured: Aug 27 03:06:24.703403 n-d-852278-4 devstack@n-api.service[134051]: request: DELETE /compute/v2.1/servers/d8e61004-a8c1-4880-82b3-133f361a0dfc HTTP/1.1 Aug 27 03:06:24.703403 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 03:06:24.703403 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 03:06:24.703403 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 03:06:24.703403 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 03:06:24.703403 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 03:06:24.703403 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 03:06:24.703403 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 03:06:24.703403 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 03:06:24.703403 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYljOihuPJQy-4KxXQ6OhbQw2FQiYByi8_J9EYziHxHrRpgpXLGNvb0hsYYYVptKud4yCoN0X9GxdS_QRHpRChZ0P7CrkMR6MvE3oNyvsgDIOynlxCCmMse1aD34uMngOe0Z8wMpnS_90nVB9LjwZPMQBiRDrvzydhSu6jwK0Njtp_4 Aug 27 03:06:24.703403 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 03:06:24.703403 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 03:06:24.703403 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 03:06:24.703403 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 03:06:24.703403 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 03:06:24.703403 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 03:06:24.703403 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 6b8d6664c463420bad9a5bfb6d747db4 Aug 27 03:06:24.703403 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ServersTestJSON-252485458 Aug 27 03:06:24.703403 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 03:06:24.703403 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 03:06:24.703403 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6b8d6664c463420bad9a5bfb6d747db4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_6b8d6664c463420bad9a5bfb6d747db4", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6b8d6664c463420bad9a5bfb6d747db4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/6b8d6664c463420bad9a5bfb6d747db4"}]}] Aug 27 03:06:24.703403 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ServersTestJSON-252485458 Aug 27 03:06:24.703403 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 6b8d6664c463420bad9a5bfb6d747db4 Aug 27 03:06:24.703403 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ServersTestJSON-252485458 Aug 27 03:06:24.703403 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ServersTestJSON-252485458-project Aug 27 03:06:24.703403 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 03:06:24.703403 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 03:06:24.703403 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 13a4e6dcf5df46fcad30430a9b9a08ee Aug 27 03:06:24.703403 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ServersTestJSON-252485458-project Aug 27 03:06:24.703403 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 03:06:24.703403 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance d8e61004-a8c1-4880-82b3-133f361a0dfc could not be found. Aug 27 03:06:24.703403 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': 'd8e61004-a8c1-4880-82b3-133f361a0dfc'} Aug 27 03:06:24.703403 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:06:24.703403 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:24.703403 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:06:24.703403 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:06:24.703403 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:06:24.703403 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:06:24.703403 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:06:24.703403 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:06:24.703403 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:06:24.703403 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:06:24.703403 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8e61004-a8c1-4880-82b3-133f361a0dfc could not be found. Aug 27 03:06:24.703403 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:24.703403 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:06:24.703403 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:24.703403 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:24.703403 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:06:24.703403 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:06:24.703403 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:06:24.703403 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:06:24.703403 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:06:24.703403 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:06:24.703403 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 03:06:24.703403 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 03:06:24.703403 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 03:06:24.703403 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 03:06:24.703403 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:06:24.703403 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:06:24.703403 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:06:24.703403 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:06:24.703403 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8e61004-a8c1-4880-82b3-133f361a0dfc could not be found. Aug 27 03:06:24.706899 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:24.706899 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:06:24.706899 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:24.706899 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:24.706899 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:06:24.706899 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:06:24.706899 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:06:24.706899 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:06:24.706899 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8e61004-a8c1-4880-82b3-133f361a0dfc could not be found. Aug 27 03:06:24.706899 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:24.710933 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f5fa54b1-f6b7-4415-93a3-abd461f3a7bd tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Returning 404 to user: Instance d8e61004-a8c1-4880-82b3-133f361a0dfc could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:06:24.720072 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-f5fa54b1-f6b7-4415-93a3-abd461f3a7bd tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "DELETE /compute/v2.1/servers/d8e61004-a8c1-4880-82b3-133f361a0dfc" status: 404 len: 111 microversion: 2.1 time: 0.107056 Aug 27 03:06:24.727230 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2410/4792] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 03:06:24 2022] DELETE /compute/v2.1/servers/d8e61004-a8c1-4880-82b3-133f361a0dfc => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 03:06:24.746170 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7e78b729-fd30-4c8b-8963-6d40aff39d62 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:24.747743 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-7e78b729-fd30-4c8b-8963-6d40aff39d62 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: d8e61004-a8c1-4880-82b3-133f361a0dfc] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:24.780405 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7e78b729-fd30-4c8b-8963-6d40aff39d62 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:24.781034 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7e78b729-fd30-4c8b-8963-6d40aff39d62 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:24.786584 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7e78b729-fd30-4c8b-8963-6d40aff39d62 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:24.787539 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7e78b729-fd30-4c8b-8963-6d40aff39d62 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:24.794157 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7e78b729-fd30-4c8b-8963-6d40aff39d62 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:24.794678 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7e78b729-fd30-4c8b-8963-6d40aff39d62 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:24.829579 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-7e78b729-fd30-4c8b-8963-6d40aff39d62 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] HTTP exception thrown: Instance d8e61004-a8c1-4880-82b3-133f361a0dfc could not be found. Aug 27 03:06:24.831800 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7e78b729-fd30-4c8b-8963-6d40aff39d62 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Request method failure captured: Aug 27 03:06:24.831800 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/d8e61004-a8c1-4880-82b3-133f361a0dfc HTTP/1.1 Aug 27 03:06:24.831800 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 03:06:24.831800 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 03:06:24.831800 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 03:06:24.831800 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 03:06:24.831800 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 03:06:24.831800 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 03:06:24.831800 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 03:06:24.831800 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 03:06:24.831800 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYljOihuPJQy-4KxXQ6OhbQw2FQiYByi8_J9EYziHxHrRpgpXLGNvb0hsYYYVptKud4yCoN0X9GxdS_QRHpRChZ0P7CrkMR6MvE3oNyvsgDIOynlxCCmMse1aD34uMngOe0Z8wMpnS_90nVB9LjwZPMQBiRDrvzydhSu6jwK0Njtp_4 Aug 27 03:06:24.831800 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 03:06:24.831800 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 03:06:24.831800 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 03:06:24.831800 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 03:06:24.831800 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 03:06:24.831800 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 03:06:24.831800 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 6b8d6664c463420bad9a5bfb6d747db4 Aug 27 03:06:24.831800 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ServersTestJSON-252485458 Aug 27 03:06:24.831800 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 03:06:24.831800 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 03:06:24.831800 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6b8d6664c463420bad9a5bfb6d747db4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_6b8d6664c463420bad9a5bfb6d747db4", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6b8d6664c463420bad9a5bfb6d747db4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/6b8d6664c463420bad9a5bfb6d747db4"}]}] Aug 27 03:06:24.831800 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ServersTestJSON-252485458 Aug 27 03:06:24.831800 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 6b8d6664c463420bad9a5bfb6d747db4 Aug 27 03:06:24.831800 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ServersTestJSON-252485458 Aug 27 03:06:24.831800 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ServersTestJSON-252485458-project Aug 27 03:06:24.831800 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 03:06:24.831800 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 03:06:24.831800 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 13a4e6dcf5df46fcad30430a9b9a08ee Aug 27 03:06:24.831800 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ServersTestJSON-252485458-project Aug 27 03:06:24.831800 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 03:06:24.831800 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance d8e61004-a8c1-4880-82b3-133f361a0dfc could not be found. Aug 27 03:06:24.831800 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': 'd8e61004-a8c1-4880-82b3-133f361a0dfc'} Aug 27 03:06:24.831800 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:06:24.831800 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:24.831800 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:06:24.831800 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:06:24.831800 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:06:24.831800 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:06:24.831800 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:06:24.831800 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:06:24.831800 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:06:24.831800 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:06:24.831800 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8e61004-a8c1-4880-82b3-133f361a0dfc could not be found. Aug 27 03:06:24.831800 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:24.831800 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:06:24.831800 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:24.831800 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:24.831800 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:06:24.831800 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:06:24.831800 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:06:24.831800 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:06:24.831800 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:06:24.831800 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:06:24.831800 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:06:24.831800 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:06:24.831800 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:06:24.831800 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:06:24.831800 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:06:24.831800 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:06:24.831800 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8e61004-a8c1-4880-82b3-133f361a0dfc could not be found. Aug 27 03:06:24.831800 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:24.831800 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:06:24.831800 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:24.831800 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:24.836011 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:06:24.836011 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:06:24.836011 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:06:24.836011 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:06:24.836011 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8e61004-a8c1-4880-82b3-133f361a0dfc could not be found. Aug 27 03:06:24.836011 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:24.839630 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7e78b729-fd30-4c8b-8963-6d40aff39d62 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Returning 404 to user: Instance d8e61004-a8c1-4880-82b3-133f361a0dfc could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:06:24.841114 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-7e78b729-fd30-4c8b-8963-6d40aff39d62 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/d8e61004-a8c1-4880-82b3-133f361a0dfc" status: 404 len: 111 microversion: 2.1 time: 0.112202 Aug 27 03:06:24.841850 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2411/4793] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:24 2022] GET /compute/v2.1/servers/d8e61004-a8c1-4880-82b3-133f361a0dfc => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:06:24.855476 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-63fd71b8-ce44-4348-8637-30e81db67eed tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:24.858431 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-63fd71b8-ce44-4348-8637-30e81db67eed tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: 3807799b-58bc-4e72-9bb6-563595c15618] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:24.874024 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-63fd71b8-ce44-4348-8637-30e81db67eed tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:24.876828 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-63fd71b8-ce44-4348-8637-30e81db67eed tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:24.884810 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-63fd71b8-ce44-4348-8637-30e81db67eed tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:24.888690 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-63fd71b8-ce44-4348-8637-30e81db67eed tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:24.889617 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-63fd71b8-ce44-4348-8637-30e81db67eed tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:24.891887 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-63fd71b8-ce44-4348-8637-30e81db67eed tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:24.924380 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-63fd71b8-ce44-4348-8637-30e81db67eed tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] HTTP exception thrown: Instance 3807799b-58bc-4e72-9bb6-563595c15618 could not be found. Aug 27 03:06:24.926309 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-63fd71b8-ce44-4348-8637-30e81db67eed tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Request method failure captured: Aug 27 03:06:24.926309 n-d-852278-4 devstack@n-api.service[134051]: request: DELETE /compute/v2.1/servers/3807799b-58bc-4e72-9bb6-563595c15618 HTTP/1.1 Aug 27 03:06:24.926309 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 03:06:24.926309 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 03:06:24.926309 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 03:06:24.926309 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 03:06:24.926309 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 03:06:24.926309 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 03:06:24.926309 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 03:06:24.926309 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 03:06:24.926309 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYljOihuPJQy-4KxXQ6OhbQw2FQiYByi8_J9EYziHxHrRpgpXLGNvb0hsYYYVptKud4yCoN0X9GxdS_QRHpRChZ0P7CrkMR6MvE3oNyvsgDIOynlxCCmMse1aD34uMngOe0Z8wMpnS_90nVB9LjwZPMQBiRDrvzydhSu6jwK0Njtp_4 Aug 27 03:06:24.926309 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 03:06:24.926309 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 03:06:24.926309 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 03:06:24.926309 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 03:06:24.926309 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 03:06:24.926309 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 03:06:24.926309 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 6b8d6664c463420bad9a5bfb6d747db4 Aug 27 03:06:24.926309 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ServersTestJSON-252485458 Aug 27 03:06:24.926309 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 03:06:24.926309 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 03:06:24.926309 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6b8d6664c463420bad9a5bfb6d747db4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_6b8d6664c463420bad9a5bfb6d747db4", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6b8d6664c463420bad9a5bfb6d747db4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/6b8d6664c463420bad9a5bfb6d747db4"}]}] Aug 27 03:06:24.926309 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ServersTestJSON-252485458 Aug 27 03:06:24.926309 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 6b8d6664c463420bad9a5bfb6d747db4 Aug 27 03:06:24.926309 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ServersTestJSON-252485458 Aug 27 03:06:24.926309 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ServersTestJSON-252485458-project Aug 27 03:06:24.926309 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 03:06:24.926309 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 03:06:24.926309 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 13a4e6dcf5df46fcad30430a9b9a08ee Aug 27 03:06:24.926309 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ServersTestJSON-252485458-project Aug 27 03:06:24.926309 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 03:06:24.926309 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance 3807799b-58bc-4e72-9bb6-563595c15618 could not be found. Aug 27 03:06:24.926309 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '3807799b-58bc-4e72-9bb6-563595c15618'} Aug 27 03:06:24.926309 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:06:24.926309 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:24.926309 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:06:24.926309 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:06:24.926309 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:06:24.926309 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:06:24.926309 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:06:24.926309 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:06:24.926309 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:06:24.926309 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:06:24.926309 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3807799b-58bc-4e72-9bb6-563595c15618 could not be found. Aug 27 03:06:24.926309 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:24.926309 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:06:24.926309 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:24.926309 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:24.926309 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:06:24.926309 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:06:24.926309 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:06:24.926309 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:06:24.926309 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:06:24.926309 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:06:24.926309 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 03:06:24.926309 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 03:06:24.926309 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 03:06:24.926309 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 03:06:24.926309 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:06:24.926309 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:06:24.926309 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:06:24.926309 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:06:24.926309 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3807799b-58bc-4e72-9bb6-563595c15618 could not be found. Aug 27 03:06:24.929540 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:24.929540 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:06:24.929540 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:24.929540 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:24.929540 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:06:24.929540 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:06:24.929540 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:06:24.929540 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:06:24.929540 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3807799b-58bc-4e72-9bb6-563595c15618 could not be found. Aug 27 03:06:24.929540 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:24.935887 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-63fd71b8-ce44-4348-8637-30e81db67eed tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Returning 404 to user: Instance 3807799b-58bc-4e72-9bb6-563595c15618 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:06:24.946340 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-63fd71b8-ce44-4348-8637-30e81db67eed tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "DELETE /compute/v2.1/servers/3807799b-58bc-4e72-9bb6-563595c15618" status: 404 len: 111 microversion: 2.1 time: 0.097765 Aug 27 03:06:24.947269 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2412/4794] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 03:06:24 2022] DELETE /compute/v2.1/servers/3807799b-58bc-4e72-9bb6-563595c15618 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:06:24.958206 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-471229a7-7f99-478e-8b4b-14d3bcbb668a tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:24.959330 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-471229a7-7f99-478e-8b4b-14d3bcbb668a tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: 3807799b-58bc-4e72-9bb6-563595c15618] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:24.968341 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-471229a7-7f99-478e-8b4b-14d3bcbb668a tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:24.969218 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-471229a7-7f99-478e-8b4b-14d3bcbb668a tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:24.969917 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-471229a7-7f99-478e-8b4b-14d3bcbb668a tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:24.970864 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-471229a7-7f99-478e-8b4b-14d3bcbb668a tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:24.971551 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-471229a7-7f99-478e-8b4b-14d3bcbb668a tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:24.972223 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-471229a7-7f99-478e-8b4b-14d3bcbb668a tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:24.991227 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-471229a7-7f99-478e-8b4b-14d3bcbb668a tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] HTTP exception thrown: Instance 3807799b-58bc-4e72-9bb6-563595c15618 could not be found. Aug 27 03:06:24.997658 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-471229a7-7f99-478e-8b4b-14d3bcbb668a tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Request method failure captured: Aug 27 03:06:24.997658 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/3807799b-58bc-4e72-9bb6-563595c15618 HTTP/1.1 Aug 27 03:06:24.997658 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 03:06:24.997658 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 03:06:24.997658 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 03:06:24.997658 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 03:06:24.997658 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 03:06:24.997658 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 03:06:24.997658 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 03:06:24.997658 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 03:06:24.997658 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYljOihuPJQy-4KxXQ6OhbQw2FQiYByi8_J9EYziHxHrRpgpXLGNvb0hsYYYVptKud4yCoN0X9GxdS_QRHpRChZ0P7CrkMR6MvE3oNyvsgDIOynlxCCmMse1aD34uMngOe0Z8wMpnS_90nVB9LjwZPMQBiRDrvzydhSu6jwK0Njtp_4 Aug 27 03:06:24.997658 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 03:06:24.997658 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 03:06:24.997658 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 03:06:24.997658 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 03:06:24.997658 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 03:06:24.997658 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 03:06:24.997658 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 6b8d6664c463420bad9a5bfb6d747db4 Aug 27 03:06:24.997658 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ServersTestJSON-252485458 Aug 27 03:06:24.997658 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 03:06:24.997658 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 03:06:24.997658 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6b8d6664c463420bad9a5bfb6d747db4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_6b8d6664c463420bad9a5bfb6d747db4", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6b8d6664c463420bad9a5bfb6d747db4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/6b8d6664c463420bad9a5bfb6d747db4"}]}] Aug 27 03:06:24.997658 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ServersTestJSON-252485458 Aug 27 03:06:24.997658 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 6b8d6664c463420bad9a5bfb6d747db4 Aug 27 03:06:24.997658 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ServersTestJSON-252485458 Aug 27 03:06:24.997658 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ServersTestJSON-252485458-project Aug 27 03:06:24.997658 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 03:06:24.997658 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 03:06:24.997658 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 13a4e6dcf5df46fcad30430a9b9a08ee Aug 27 03:06:24.997658 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ServersTestJSON-252485458-project Aug 27 03:06:24.997658 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 03:06:24.997658 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance 3807799b-58bc-4e72-9bb6-563595c15618 could not be found. Aug 27 03:06:24.997658 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '3807799b-58bc-4e72-9bb6-563595c15618'} Aug 27 03:06:24.997658 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:06:24.997658 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:24.997658 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:06:24.997658 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:06:24.997658 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:06:24.997658 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:06:24.997658 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:06:24.997658 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:06:24.997658 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:06:24.997658 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:06:24.997658 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3807799b-58bc-4e72-9bb6-563595c15618 could not be found. Aug 27 03:06:24.997658 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:24.997658 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:06:24.997658 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:24.997658 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:24.997658 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:06:24.997658 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:06:24.997658 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:06:24.997658 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:06:24.997658 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:06:24.997658 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:06:24.997658 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:06:24.997658 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:06:24.997658 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:06:24.997658 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:06:24.997658 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:06:24.997658 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:06:24.997658 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3807799b-58bc-4e72-9bb6-563595c15618 could not be found. Aug 27 03:06:24.997658 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:24.997658 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:06:24.997658 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:24.997658 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:25.001206 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:06:25.001206 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:06:25.001206 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:06:25.001206 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:06:25.001206 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3807799b-58bc-4e72-9bb6-563595c15618 could not be found. Aug 27 03:06:25.001206 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:25.003186 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-471229a7-7f99-478e-8b4b-14d3bcbb668a tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Returning 404 to user: Instance 3807799b-58bc-4e72-9bb6-563595c15618 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:06:25.006104 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-471229a7-7f99-478e-8b4b-14d3bcbb668a tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/3807799b-58bc-4e72-9bb6-563595c15618" status: 404 len: 111 microversion: 2.1 time: 0.054268 Aug 27 03:06:25.008525 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2413/4795] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:24 2022] GET /compute/v2.1/servers/3807799b-58bc-4e72-9bb6-563595c15618 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 03:06:25.018030 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-41227174-de61-4faa-9ead-a07718ab79b2 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:25.018914 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-41227174-de61-4faa-9ead-a07718ab79b2 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: 70ffdc7b-f46e-4e13-b330-86109bc8ff60] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:25.029239 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-41227174-de61-4faa-9ead-a07718ab79b2 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:25.032041 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-41227174-de61-4faa-9ead-a07718ab79b2 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:25.032856 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-41227174-de61-4faa-9ead-a07718ab79b2 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:25.038782 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-41227174-de61-4faa-9ead-a07718ab79b2 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:25.040968 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-41227174-de61-4faa-9ead-a07718ab79b2 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:25.042701 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-41227174-de61-4faa-9ead-a07718ab79b2 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:25.065052 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-41227174-de61-4faa-9ead-a07718ab79b2 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] HTTP exception thrown: Instance 70ffdc7b-f46e-4e13-b330-86109bc8ff60 could not be found. Aug 27 03:06:25.067196 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-41227174-de61-4faa-9ead-a07718ab79b2 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Request method failure captured: Aug 27 03:06:25.067196 n-d-852278-4 devstack@n-api.service[134051]: request: DELETE /compute/v2.1/servers/70ffdc7b-f46e-4e13-b330-86109bc8ff60 HTTP/1.1 Aug 27 03:06:25.067196 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 03:06:25.067196 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 03:06:25.067196 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 03:06:25.067196 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 03:06:25.067196 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 03:06:25.067196 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 03:06:25.067196 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 03:06:25.067196 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 03:06:25.067196 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYljOihuPJQy-4KxXQ6OhbQw2FQiYByi8_J9EYziHxHrRpgpXLGNvb0hsYYYVptKud4yCoN0X9GxdS_QRHpRChZ0P7CrkMR6MvE3oNyvsgDIOynlxCCmMse1aD34uMngOe0Z8wMpnS_90nVB9LjwZPMQBiRDrvzydhSu6jwK0Njtp_4 Aug 27 03:06:25.067196 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 03:06:25.067196 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 03:06:25.067196 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 03:06:25.067196 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 03:06:25.067196 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 03:06:25.067196 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 03:06:25.067196 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 6b8d6664c463420bad9a5bfb6d747db4 Aug 27 03:06:25.067196 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ServersTestJSON-252485458 Aug 27 03:06:25.067196 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 03:06:25.067196 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 03:06:25.067196 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6b8d6664c463420bad9a5bfb6d747db4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_6b8d6664c463420bad9a5bfb6d747db4", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6b8d6664c463420bad9a5bfb6d747db4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/6b8d6664c463420bad9a5bfb6d747db4"}]}] Aug 27 03:06:25.067196 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ServersTestJSON-252485458 Aug 27 03:06:25.067196 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 6b8d6664c463420bad9a5bfb6d747db4 Aug 27 03:06:25.067196 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ServersTestJSON-252485458 Aug 27 03:06:25.067196 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ServersTestJSON-252485458-project Aug 27 03:06:25.067196 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 03:06:25.067196 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 03:06:25.067196 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 13a4e6dcf5df46fcad30430a9b9a08ee Aug 27 03:06:25.067196 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ServersTestJSON-252485458-project Aug 27 03:06:25.067196 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 03:06:25.067196 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance 70ffdc7b-f46e-4e13-b330-86109bc8ff60 could not be found. Aug 27 03:06:25.067196 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '70ffdc7b-f46e-4e13-b330-86109bc8ff60'} Aug 27 03:06:25.067196 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:06:25.067196 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:25.067196 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:06:25.067196 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:06:25.067196 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:06:25.067196 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:06:25.067196 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:06:25.067196 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:06:25.067196 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:06:25.067196 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:06:25.067196 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70ffdc7b-f46e-4e13-b330-86109bc8ff60 could not be found. Aug 27 03:06:25.067196 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:25.067196 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:06:25.067196 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:25.067196 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:25.067196 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:06:25.067196 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:06:25.067196 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:06:25.067196 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:06:25.067196 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:06:25.067196 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:06:25.067196 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 03:06:25.067196 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 03:06:25.067196 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 03:06:25.067196 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 03:06:25.067196 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:06:25.067196 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:06:25.067196 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:06:25.067196 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:06:25.067196 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70ffdc7b-f46e-4e13-b330-86109bc8ff60 could not be found. Aug 27 03:06:25.070818 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:25.070818 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:06:25.070818 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:25.070818 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:25.070818 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:06:25.070818 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:06:25.070818 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:06:25.070818 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:06:25.070818 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70ffdc7b-f46e-4e13-b330-86109bc8ff60 could not be found. Aug 27 03:06:25.070818 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:25.070818 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-41227174-de61-4faa-9ead-a07718ab79b2 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Returning 404 to user: Instance 70ffdc7b-f46e-4e13-b330-86109bc8ff60 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:06:25.070818 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-41227174-de61-4faa-9ead-a07718ab79b2 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "DELETE /compute/v2.1/servers/70ffdc7b-f46e-4e13-b330-86109bc8ff60" status: 404 len: 111 microversion: 2.1 time: 0.055525 Aug 27 03:06:25.070818 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2414/4796] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 03:06:25 2022] DELETE /compute/v2.1/servers/70ffdc7b-f46e-4e13-b330-86109bc8ff60 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:06:25.076449 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ab8f6f1f-a682-4e22-97f9-97d213f999a1 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:25.079076 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-ab8f6f1f-a682-4e22-97f9-97d213f999a1 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: cd881214-dd67-4897-9167-335d7e48d789] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:25.085924 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ab8f6f1f-a682-4e22-97f9-97d213f999a1 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:25.086607 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ab8f6f1f-a682-4e22-97f9-97d213f999a1 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:25.087154 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ab8f6f1f-a682-4e22-97f9-97d213f999a1 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:25.088007 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ab8f6f1f-a682-4e22-97f9-97d213f999a1 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:25.088601 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ab8f6f1f-a682-4e22-97f9-97d213f999a1 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:25.089154 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ab8f6f1f-a682-4e22-97f9-97d213f999a1 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:25.137206 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ab8f6f1f-a682-4e22-97f9-97d213f999a1 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "GET /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064844 Aug 27 03:06:25.138146 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2415/4797] 10.222.0.70 () {58 vars in 1302 bytes} [Sat Aug 27 03:06:25 2022] GET /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:06:25.151542 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-97f481e7-36bb-4431-b762-c296d5980d4a tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:25.152595 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-97f481e7-36bb-4431-b762-c296d5980d4a tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: 70ffdc7b-f46e-4e13-b330-86109bc8ff60] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:25.159592 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-97f481e7-36bb-4431-b762-c296d5980d4a tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:25.162063 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-97f481e7-36bb-4431-b762-c296d5980d4a tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:25.165962 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-97f481e7-36bb-4431-b762-c296d5980d4a tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:25.168215 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-97f481e7-36bb-4431-b762-c296d5980d4a tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:25.169174 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-97f481e7-36bb-4431-b762-c296d5980d4a tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:25.170744 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-97f481e7-36bb-4431-b762-c296d5980d4a tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:25.186799 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-97f481e7-36bb-4431-b762-c296d5980d4a tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] HTTP exception thrown: Instance 70ffdc7b-f46e-4e13-b330-86109bc8ff60 could not be found. Aug 27 03:06:25.188834 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-97f481e7-36bb-4431-b762-c296d5980d4a tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Request method failure captured: Aug 27 03:06:25.188834 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/70ffdc7b-f46e-4e13-b330-86109bc8ff60 HTTP/1.1 Aug 27 03:06:25.188834 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 03:06:25.188834 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 03:06:25.188834 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 03:06:25.188834 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 03:06:25.188834 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 03:06:25.188834 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 03:06:25.188834 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 03:06:25.188834 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 03:06:25.188834 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYljOihuPJQy-4KxXQ6OhbQw2FQiYByi8_J9EYziHxHrRpgpXLGNvb0hsYYYVptKud4yCoN0X9GxdS_QRHpRChZ0P7CrkMR6MvE3oNyvsgDIOynlxCCmMse1aD34uMngOe0Z8wMpnS_90nVB9LjwZPMQBiRDrvzydhSu6jwK0Njtp_4 Aug 27 03:06:25.188834 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 03:06:25.188834 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 03:06:25.188834 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 03:06:25.188834 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 03:06:25.188834 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 03:06:25.188834 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 03:06:25.188834 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 6b8d6664c463420bad9a5bfb6d747db4 Aug 27 03:06:25.188834 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ServersTestJSON-252485458 Aug 27 03:06:25.188834 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 03:06:25.188834 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 03:06:25.188834 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6b8d6664c463420bad9a5bfb6d747db4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_6b8d6664c463420bad9a5bfb6d747db4", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6b8d6664c463420bad9a5bfb6d747db4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/6b8d6664c463420bad9a5bfb6d747db4"}]}] Aug 27 03:06:25.188834 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ServersTestJSON-252485458 Aug 27 03:06:25.188834 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 6b8d6664c463420bad9a5bfb6d747db4 Aug 27 03:06:25.188834 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ServersTestJSON-252485458 Aug 27 03:06:25.188834 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ServersTestJSON-252485458-project Aug 27 03:06:25.188834 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 03:06:25.188834 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 03:06:25.188834 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 13a4e6dcf5df46fcad30430a9b9a08ee Aug 27 03:06:25.188834 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ServersTestJSON-252485458-project Aug 27 03:06:25.188834 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 03:06:25.188834 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance 70ffdc7b-f46e-4e13-b330-86109bc8ff60 could not be found. Aug 27 03:06:25.188834 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '70ffdc7b-f46e-4e13-b330-86109bc8ff60'} Aug 27 03:06:25.188834 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:06:25.188834 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:25.188834 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:06:25.188834 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:06:25.188834 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:06:25.188834 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:06:25.188834 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:06:25.188834 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:06:25.188834 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:06:25.188834 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:06:25.188834 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70ffdc7b-f46e-4e13-b330-86109bc8ff60 could not be found. Aug 27 03:06:25.188834 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:25.188834 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:06:25.188834 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:25.188834 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:25.188834 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:06:25.188834 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:06:25.188834 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:06:25.188834 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:06:25.188834 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:06:25.188834 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:06:25.188834 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:06:25.188834 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:06:25.188834 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:06:25.188834 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:06:25.188834 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:06:25.188834 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:06:25.188834 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70ffdc7b-f46e-4e13-b330-86109bc8ff60 could not be found. Aug 27 03:06:25.188834 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:25.188834 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:06:25.188834 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:25.188834 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:25.192033 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:06:25.192033 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:06:25.192033 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:06:25.192033 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:06:25.192033 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70ffdc7b-f46e-4e13-b330-86109bc8ff60 could not be found. Aug 27 03:06:25.192033 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:25.196163 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-97f481e7-36bb-4431-b762-c296d5980d4a tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Returning 404 to user: Instance 70ffdc7b-f46e-4e13-b330-86109bc8ff60 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:06:25.197290 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-97f481e7-36bb-4431-b762-c296d5980d4a tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/70ffdc7b-f46e-4e13-b330-86109bc8ff60" status: 404 len: 111 microversion: 2.1 time: 0.058001 Aug 27 03:06:25.198098 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2416/4798] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:25 2022] GET /compute/v2.1/servers/70ffdc7b-f46e-4e13-b330-86109bc8ff60 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:06:25.207332 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4a939c0f-63be-445f-bc72-435a256ae8fc tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:25.207830 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-4a939c0f-63be-445f-bc72-435a256ae8fc tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: 815ce93a-b022-4309-b493-787ee68ffd96] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:25.214195 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-4a939c0f-63be-445f-bc72-435a256ae8fc tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] HTTP exception thrown: Instance 815ce93a-b022-4309-b493-787ee68ffd96 could not be found. Aug 27 03:06:25.216608 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4a939c0f-63be-445f-bc72-435a256ae8fc tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Request method failure captured: Aug 27 03:06:25.216608 n-d-852278-4 devstack@n-api.service[134051]: request: DELETE /compute/v2.1/servers/815ce93a-b022-4309-b493-787ee68ffd96 HTTP/1.1 Aug 27 03:06:25.216608 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 03:06:25.216608 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 03:06:25.216608 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 03:06:25.216608 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 03:06:25.216608 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 03:06:25.216608 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 03:06:25.216608 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 03:06:25.216608 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 03:06:25.216608 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYljOihuPJQy-4KxXQ6OhbQw2FQiYByi8_J9EYziHxHrRpgpXLGNvb0hsYYYVptKud4yCoN0X9GxdS_QRHpRChZ0P7CrkMR6MvE3oNyvsgDIOynlxCCmMse1aD34uMngOe0Z8wMpnS_90nVB9LjwZPMQBiRDrvzydhSu6jwK0Njtp_4 Aug 27 03:06:25.216608 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 03:06:25.216608 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 03:06:25.216608 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 03:06:25.216608 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 03:06:25.216608 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 03:06:25.216608 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 03:06:25.216608 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 6b8d6664c463420bad9a5bfb6d747db4 Aug 27 03:06:25.216608 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ServersTestJSON-252485458 Aug 27 03:06:25.216608 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 03:06:25.216608 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 03:06:25.216608 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6b8d6664c463420bad9a5bfb6d747db4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_6b8d6664c463420bad9a5bfb6d747db4", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6b8d6664c463420bad9a5bfb6d747db4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/6b8d6664c463420bad9a5bfb6d747db4"}]}] Aug 27 03:06:25.216608 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ServersTestJSON-252485458 Aug 27 03:06:25.216608 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 6b8d6664c463420bad9a5bfb6d747db4 Aug 27 03:06:25.216608 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ServersTestJSON-252485458 Aug 27 03:06:25.216608 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ServersTestJSON-252485458-project Aug 27 03:06:25.216608 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 03:06:25.216608 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 03:06:25.216608 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 13a4e6dcf5df46fcad30430a9b9a08ee Aug 27 03:06:25.216608 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ServersTestJSON-252485458-project Aug 27 03:06:25.216608 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 03:06:25.216608 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance 815ce93a-b022-4309-b493-787ee68ffd96 could not be found. Aug 27 03:06:25.216608 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '815ce93a-b022-4309-b493-787ee68ffd96'} Aug 27 03:06:25.216608 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:06:25.216608 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:25.216608 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:06:25.216608 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:06:25.216608 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:06:25.216608 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:06:25.216608 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 03:06:25.216608 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 03:06:25.216608 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 815ce93a-b022-4309-b493-787ee68ffd96 could not be found. Aug 27 03:06:25.216608 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:25.216608 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:06:25.216608 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:25.216608 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:25.216608 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:06:25.216608 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:06:25.216608 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:06:25.216608 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:06:25.216608 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:06:25.216608 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:06:25.216608 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 03:06:25.216608 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 03:06:25.216608 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 03:06:25.216608 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 03:06:25.216608 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:06:25.216608 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:06:25.216608 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:06:25.216608 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:06:25.216608 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 815ce93a-b022-4309-b493-787ee68ffd96 could not be found. Aug 27 03:06:25.216608 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:25.216608 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:06:25.216608 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:25.219940 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:25.219940 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:06:25.219940 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:06:25.219940 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:06:25.219940 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:06:25.219940 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 815ce93a-b022-4309-b493-787ee68ffd96 could not be found. Aug 27 03:06:25.219940 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:25.219940 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4a939c0f-63be-445f-bc72-435a256ae8fc tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Returning 404 to user: Instance 815ce93a-b022-4309-b493-787ee68ffd96 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:06:25.219940 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-4a939c0f-63be-445f-bc72-435a256ae8fc tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "DELETE /compute/v2.1/servers/815ce93a-b022-4309-b493-787ee68ffd96" status: 404 len: 111 microversion: 2.1 time: 0.015956 Aug 27 03:06:25.222993 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2417/4799] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 03:06:25 2022] DELETE /compute/v2.1/servers/815ce93a-b022-4309-b493-787ee68ffd96 => generated 111 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:06:25.227812 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f5807da2-3737-42b9-bc41-524bc0764e27 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:25.228921 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-f5807da2-3737-42b9-bc41-524bc0764e27 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: 815ce93a-b022-4309-b493-787ee68ffd96] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:25.238462 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-f5807da2-3737-42b9-bc41-524bc0764e27 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] HTTP exception thrown: Instance 815ce93a-b022-4309-b493-787ee68ffd96 could not be found. Aug 27 03:06:25.240883 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f5807da2-3737-42b9-bc41-524bc0764e27 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Request method failure captured: Aug 27 03:06:25.240883 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/815ce93a-b022-4309-b493-787ee68ffd96 HTTP/1.1 Aug 27 03:06:25.240883 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 03:06:25.240883 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 03:06:25.240883 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 03:06:25.240883 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 03:06:25.240883 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 03:06:25.240883 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 03:06:25.240883 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 03:06:25.240883 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 03:06:25.240883 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYljOihuPJQy-4KxXQ6OhbQw2FQiYByi8_J9EYziHxHrRpgpXLGNvb0hsYYYVptKud4yCoN0X9GxdS_QRHpRChZ0P7CrkMR6MvE3oNyvsgDIOynlxCCmMse1aD34uMngOe0Z8wMpnS_90nVB9LjwZPMQBiRDrvzydhSu6jwK0Njtp_4 Aug 27 03:06:25.240883 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 03:06:25.240883 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 03:06:25.240883 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 03:06:25.240883 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 03:06:25.240883 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 03:06:25.240883 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 03:06:25.240883 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 6b8d6664c463420bad9a5bfb6d747db4 Aug 27 03:06:25.240883 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ServersTestJSON-252485458 Aug 27 03:06:25.240883 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 03:06:25.240883 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 03:06:25.240883 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6b8d6664c463420bad9a5bfb6d747db4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_6b8d6664c463420bad9a5bfb6d747db4", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6b8d6664c463420bad9a5bfb6d747db4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/6b8d6664c463420bad9a5bfb6d747db4"}]}] Aug 27 03:06:25.240883 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ServersTestJSON-252485458 Aug 27 03:06:25.240883 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 6b8d6664c463420bad9a5bfb6d747db4 Aug 27 03:06:25.240883 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ServersTestJSON-252485458 Aug 27 03:06:25.240883 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ServersTestJSON-252485458-project Aug 27 03:06:25.240883 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 03:06:25.240883 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 03:06:25.240883 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 13a4e6dcf5df46fcad30430a9b9a08ee Aug 27 03:06:25.240883 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ServersTestJSON-252485458-project Aug 27 03:06:25.240883 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 03:06:25.240883 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance 815ce93a-b022-4309-b493-787ee68ffd96 could not be found. Aug 27 03:06:25.240883 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '815ce93a-b022-4309-b493-787ee68ffd96'} Aug 27 03:06:25.240883 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:06:25.240883 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:25.240883 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:06:25.240883 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:06:25.240883 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:06:25.240883 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:06:25.240883 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 03:06:25.240883 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 03:06:25.240883 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 815ce93a-b022-4309-b493-787ee68ffd96 could not be found. Aug 27 03:06:25.240883 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:25.240883 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:06:25.240883 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:25.240883 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:25.240883 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:06:25.240883 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:06:25.240883 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:06:25.240883 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:06:25.240883 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:06:25.240883 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:06:25.240883 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:06:25.240883 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:06:25.240883 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:06:25.240883 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:06:25.240883 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:06:25.240883 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:06:25.240883 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 815ce93a-b022-4309-b493-787ee68ffd96 could not be found. Aug 27 03:06:25.240883 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:25.240883 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:06:25.240883 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:25.240883 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:25.240883 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:06:25.240883 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:06:25.244129 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:06:25.244129 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:06:25.244129 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 815ce93a-b022-4309-b493-787ee68ffd96 could not be found. Aug 27 03:06:25.244129 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:25.245901 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f5807da2-3737-42b9-bc41-524bc0764e27 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Returning 404 to user: Instance 815ce93a-b022-4309-b493-787ee68ffd96 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:06:25.247016 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-f5807da2-3737-42b9-bc41-524bc0764e27 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/815ce93a-b022-4309-b493-787ee68ffd96" status: 404 len: 111 microversion: 2.1 time: 0.023350 Aug 27 03:06:25.251279 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2418/4800] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:25 2022] GET /compute/v2.1/servers/815ce93a-b022-4309-b493-787ee68ffd96 => generated 111 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:06:25.257760 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7ef6e9a9-d358-4cc2-8318-24ff2850fcb2 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:25.259109 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-7ef6e9a9-d358-4cc2-8318-24ff2850fcb2 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: dc5b167d-847f-428c-8cae-3eef7bdffe9f] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:25.267856 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7ef6e9a9-d358-4cc2-8318-24ff2850fcb2 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:25.268697 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7ef6e9a9-d358-4cc2-8318-24ff2850fcb2 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:25.269304 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7ef6e9a9-d358-4cc2-8318-24ff2850fcb2 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:25.271570 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7ef6e9a9-d358-4cc2-8318-24ff2850fcb2 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:25.272498 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7ef6e9a9-d358-4cc2-8318-24ff2850fcb2 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:25.273703 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7ef6e9a9-d358-4cc2-8318-24ff2850fcb2 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:25.330504 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-7ef6e9a9-d358-4cc2-8318-24ff2850fcb2 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: dc5b167d-847f-428c-8cae-3eef7bdffe9f] Going to try to terminate instance {{(pid=134051) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:06:25.501308 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=98,nova_api:UPDATE=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:06:25.526751 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-7ef6e9a9-d358-4cc2-8318-24ff2850fcb2 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "DELETE /compute/v2.1/servers/dc5b167d-847f-428c-8cae-3eef7bdffe9f" status: 204 len: 0 microversion: 2.1 time: 0.273298 Aug 27 03:06:25.529656 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2419/4801] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 03:06:25 2022] DELETE /compute/v2.1/servers/dc5b167d-847f-428c-8cae-3eef7bdffe9f => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:06:25.541959 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-67570256-aa55-4457-926e-55a3d8628eee tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:25.543731 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-67570256-aa55-4457-926e-55a3d8628eee tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:25.552370 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-67570256-aa55-4457-926e-55a3d8628eee tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:25.553061 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-67570256-aa55-4457-926e-55a3d8628eee tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:25.554272 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-67570256-aa55-4457-926e-55a3d8628eee tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:25.555881 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-67570256-aa55-4457-926e-55a3d8628eee tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:25.556495 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-67570256-aa55-4457-926e-55a3d8628eee tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:25.557038 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-67570256-aa55-4457-926e-55a3d8628eee tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:25.909455 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-daa0a53a-6f7a-4095-9466-4a92bf962def tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3f67480c8a4ab8b538d4bebfa12d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d58ec8819c4af9bb00a08e2ca12708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:25.917948 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-daa0a53a-6f7a-4095-9466-4a92bf962def tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] 10.222.0.70 "GET /compute/v2.1/servers/879f248c-09b1-4e34-982e-bb8b75be03ce" status: 200 len: 1314 microversion: 2.1 time: 1.264384 Aug 27 03:06:25.931437 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2383/4802] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:24 2022] GET /compute/v2.1/servers/879f248c-09b1-4e34-982e-bb8b75be03ce => generated 1314 bytes in 1279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:06:25.936888 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8d173cf0-7c16-481e-9f02-f43c4ecb4819 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:25.937736 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-8d173cf0-7c16-481e-9f02-f43c4ecb4819 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: dc5b167d-847f-428c-8cae-3eef7bdffe9f] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:25.944911 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8d173cf0-7c16-481e-9f02-f43c4ecb4819 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:25.946448 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8d173cf0-7c16-481e-9f02-f43c4ecb4819 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:25.947086 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8d173cf0-7c16-481e-9f02-f43c4ecb4819 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:25.948006 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8d173cf0-7c16-481e-9f02-f43c4ecb4819 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:25.948699 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8d173cf0-7c16-481e-9f02-f43c4ecb4819 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:25.949321 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8d173cf0-7c16-481e-9f02-f43c4ecb4819 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:25.982049 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-67570256-aa55-4457-926e-55a3d8628eee tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:25.995269 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-67570256-aa55-4457-926e-55a3d8628eee tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1510 microversion: 2.1 time: 0.464009 Aug 27 03:06:25.997955 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2420/4803] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:25 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1510 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:26.150383 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8a07d65d-4fbf-493a-ba34-2b4382255d0d tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:26.152368 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-8a07d65d-4fbf-493a-ba34-2b4382255d0d tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: cd881214-dd67-4897-9167-335d7e48d789] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:26.168100 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8a07d65d-4fbf-493a-ba34-2b4382255d0d tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:26.169178 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8a07d65d-4fbf-493a-ba34-2b4382255d0d tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:26.169178 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8a07d65d-4fbf-493a-ba34-2b4382255d0d tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:26.169685 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8a07d65d-4fbf-493a-ba34-2b4382255d0d tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:26.170131 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8a07d65d-4fbf-493a-ba34-2b4382255d0d tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:26.170613 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8a07d65d-4fbf-493a-ba34-2b4382255d0d tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:26.229500 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-8a07d65d-4fbf-493a-ba34-2b4382255d0d tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "GET /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083245 Aug 27 03:06:26.232634 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2421/4804] 10.222.0.70 () {58 vars in 1302 bytes} [Sat Aug 27 03:06:26 2022] GET /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:06:26.234493 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-8d173cf0-7c16-481e-9f02-f43c4ecb4819 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:26.244385 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-8d173cf0-7c16-481e-9f02-f43c4ecb4819 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/dc5b167d-847f-428c-8cae-3eef7bdffe9f" status: 200 len: 1479 microversion: 2.1 time: 0.311535 Aug 27 03:06:26.261840 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2384/4805] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:25 2022] GET /compute/v2.1/servers/dc5b167d-847f-428c-8cae-3eef7bdffe9f => generated 1479 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:26.938940 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ad89a203-ebd0-4618-861b-228afe6d0b2b tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:26.939592 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-ad89a203-ebd0-4618-861b-228afe6d0b2b tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] [instance: 879f248c-09b1-4e34-982e-bb8b75be03ce] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:26.957307 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ad89a203-ebd0-4618-861b-228afe6d0b2b tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:26.960181 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ad89a203-ebd0-4618-861b-228afe6d0b2b tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:26.960670 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ad89a203-ebd0-4618-861b-228afe6d0b2b tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:26.965478 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ad89a203-ebd0-4618-861b-228afe6d0b2b tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:26.965941 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ad89a203-ebd0-4618-861b-228afe6d0b2b tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:26.966386 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ad89a203-ebd0-4618-861b-228afe6d0b2b tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:27.018291 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-41aa698c-e0e1-436c-bfa4-ab77f9df84f2 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:27.019547 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-41aa698c-e0e1-436c-bfa4-ab77f9df84f2 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:27.032933 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-41aa698c-e0e1-436c-bfa4-ab77f9df84f2 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:27.033689 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-41aa698c-e0e1-436c-bfa4-ab77f9df84f2 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:27.034271 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-41aa698c-e0e1-436c-bfa4-ab77f9df84f2 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:27.035174 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-41aa698c-e0e1-436c-bfa4-ab77f9df84f2 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:27.035781 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-41aa698c-e0e1-436c-bfa4-ab77f9df84f2 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:27.042441 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-41aa698c-e0e1-436c-bfa4-ab77f9df84f2 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:27.538427 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-ad89a203-ebd0-4618-861b-228afe6d0b2b tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3f67480c8a4ab8b538d4bebfa12d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d58ec8819c4af9bb00a08e2ca12708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:27.548882 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ad89a203-ebd0-4618-861b-228afe6d0b2b tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] 10.222.0.70 "GET /compute/v2.1/servers/879f248c-09b1-4e34-982e-bb8b75be03ce" status: 200 len: 1497 microversion: 2.1 time: 0.613944 Aug 27 03:06:27.549477 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2422/4806] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:26 2022] GET /compute/v2.1/servers/879f248c-09b1-4e34-982e-bb8b75be03ce => generated 1497 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:27.555603 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-817251d3-96a4-4c6f-9c0e-041234c2f1ed tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:27.564005 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-817251d3-96a4-4c6f-9c0e-041234c2f1ed tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: cd881214-dd67-4897-9167-335d7e48d789] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:27.570810 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-817251d3-96a4-4c6f-9c0e-041234c2f1ed tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:27.571530 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-817251d3-96a4-4c6f-9c0e-041234c2f1ed tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:27.572493 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-817251d3-96a4-4c6f-9c0e-041234c2f1ed tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:27.573932 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-817251d3-96a4-4c6f-9c0e-041234c2f1ed tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:27.574660 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-817251d3-96a4-4c6f-9c0e-041234c2f1ed tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:27.575222 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-817251d3-96a4-4c6f-9c0e-041234c2f1ed tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:27.620126 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:06:27.623909 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-817251d3-96a4-4c6f-9c0e-041234c2f1ed tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "GET /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.072988 Aug 27 03:06:27.625329 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2423/4807] 10.222.0.70 () {58 vars in 1302 bytes} [Sat Aug 27 03:06:27 2022] GET /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789/os-volume_attachments => generated 25 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:06:27.638147 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-1b60fd15-022d-4f80-ad24-a7b486298901 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:27.638833 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-1b60fd15-022d-4f80-ad24-a7b486298901 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: dc5b167d-847f-428c-8cae-3eef7bdffe9f] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:27.660325 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1b60fd15-022d-4f80-ad24-a7b486298901 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:27.660964 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1b60fd15-022d-4f80-ad24-a7b486298901 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:27.661407 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1b60fd15-022d-4f80-ad24-a7b486298901 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:27.662329 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1b60fd15-022d-4f80-ad24-a7b486298901 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:27.662769 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1b60fd15-022d-4f80-ad24-a7b486298901 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:27.663193 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1b60fd15-022d-4f80-ad24-a7b486298901 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:27.794480 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-41aa698c-e0e1-436c-bfa4-ab77f9df84f2 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:27.807695 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-41aa698c-e0e1-436c-bfa4-ab77f9df84f2 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1510 microversion: 2.1 time: 0.794019 Aug 27 03:06:27.809010 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2385/4808] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:27 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1510 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:27.825590 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a49cf108-9ba5-4b28-90ea-22f13d898f60 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:06:27.836755 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a49cf108-9ba5-4b28-90ea-22f13d898f60 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: ecbf3ab5-9736-491e-b120-6a30d40bc328] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:27.898246 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a49cf108-9ba5-4b28-90ea-22f13d898f60 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:27.900622 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a49cf108-9ba5-4b28-90ea-22f13d898f60 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:27.901268 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a49cf108-9ba5-4b28-90ea-22f13d898f60 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:27.902613 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a49cf108-9ba5-4b28-90ea-22f13d898f60 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:27.904064 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a49cf108-9ba5-4b28-90ea-22f13d898f60 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:27.904923 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a49cf108-9ba5-4b28-90ea-22f13d898f60 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:27.949372 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-a49cf108-9ba5-4b28-90ea-22f13d898f60 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] HTTP exception thrown: Cannot 'reboot' instance ecbf3ab5-9736-491e-b120-6a30d40bc328 while it is in vm_state rescued Aug 27 03:06:27.951363 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a49cf108-9ba5-4b28-90ea-22f13d898f60 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Request method failure captured: Aug 27 03:06:27.951363 n-d-852278-4 devstack@n-api.service[134052]: request: POST /compute/v2.1/servers/ecbf3ab5-9736-491e-b120-6a30d40bc328/action HTTP/1.1 Aug 27 03:06:27.951363 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 03:06:27.951363 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 03:06:27.951363 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 03:06:27.951363 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 28 Aug 27 03:06:27.951363 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 03:06:27.951363 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 03:06:27.951363 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 03:06:27.951363 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 03:06:27.951363 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYlCR9c_onisOtljFF_OKffaCMw1fqcK8AqJdNG9qzhexbiOAQUtNy-3x5VJrEQxLYuHD403zeJPmdfi74lzmVkRKznv6JROTBAXqcugDUkBzjF_9CFKpQVmUlF9UkBSehtKOGnnrCFpHwE0Yb7XTVGDotoY0qf8klSZfatljLqnj-Y Aug 27 03:06:27.951363 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 03:06:27.951363 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 03:06:27.951363 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 03:06:27.951363 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 03:06:27.951363 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 03:06:27.951363 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 03:06:27.951363 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 1b4ca527ba3b49539b528ec8950aef78 Aug 27 03:06:27.951363 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1447006165 Aug 27 03:06:27.951363 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 03:06:27.951363 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 03:06:27.951363 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/1b4ca527ba3b49539b528ec8950aef78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_1b4ca527ba3b49539b528ec8950aef78", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/1b4ca527ba3b49539b528ec8950aef78"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/1b4ca527ba3b49539b528ec8950aef78"}]}] Aug 27 03:06:27.951363 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1447006165 Aug 27 03:06:27.951363 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 1b4ca527ba3b49539b528ec8950aef78 Aug 27 03:06:27.951363 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1447006165 Aug 27 03:06:27.951363 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ServerRescueNegativeTestJSON-1447006165-project Aug 27 03:06:27.951363 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 03:06:27.951363 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 03:06:27.951363 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 36697e722bef4a33ab158e9b2f87596a Aug 27 03:06:27.951363 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1447006165-project Aug 27 03:06:27.951363 n-d-852278-4 devstack@n-api.service[134052]: Aug 27 03:06:27.951363 n-d-852278-4 devstack@n-api.service[134052]: {"reboot": {"type": "HARD"}} Aug 27 03:06:27.951363 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 03:06:27.951363 n-d-852278-4 devstack@n-api.service[134052]: exception: Cannot 'reboot' instance ecbf3ab5-9736-491e-b120-6a30d40bc328 while it is in vm_state rescued Aug 27 03:06:27.951363 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': 'ecbf3ab5-9736-491e-b120-6a30d40bc328', 'body': {'reboot': {'type': 'HARD'}}} Aug 27 03:06:27.951363 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:06:27.951363 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:27.951363 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Aug 27 03:06:27.951363 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Aug 27 03:06:27.951363 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 03:06:27.951363 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 03:06:27.951363 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3552, in reboot Aug 27 03:06:27.951363 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Aug 27 03:06:27.951363 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 27 03:06:27.951363 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 27 03:06:27.951363 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ecbf3ab5-9736-491e-b120-6a30d40bc328 in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Aug 27 03:06:27.951363 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:06:27.951363 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:06:27.951363 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:06:27.951363 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:27.951363 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:06:27.951363 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:06:27.951363 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:06:27.951363 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:06:27.951363 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:06:27.951363 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:06:27.951363 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:06:27.951363 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:06:27.951363 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Aug 27 03:06:27.951363 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 27 03:06:27.951363 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 27 03:06:27.951363 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 27 03:06:27.958401 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance ecbf3ab5-9736-491e-b120-6a30d40bc328 while it is in vm_state rescued Aug 27 03:06:27.958401 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:06:27.958401 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:06:27.958401 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:06:27.958401 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:27.958401 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:06:27.958401 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:06:27.958401 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:06:27.958401 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:06:27.958401 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance ecbf3ab5-9736-491e-b120-6a30d40bc328 while it is in vm_state rescued Aug 27 03:06:27.958401 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:06:27.958401 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a49cf108-9ba5-4b28-90ea-22f13d898f60 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Returning 409 to user: Cannot 'reboot' instance ecbf3ab5-9736-491e-b120-6a30d40bc328 while it is in vm_state rescued {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:06:27.958401 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a49cf108-9ba5-4b28-90ea-22f13d898f60 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "POST /compute/v2.1/servers/ecbf3ab5-9736-491e-b120-6a30d40bc328/action" status: 409 len: 145 microversion: 2.1 time: 0.141992 Aug 27 03:06:27.958401 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2386/4809] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:06:27 2022] POST /compute/v2.1/servers/ecbf3ab5-9736-491e-b120-6a30d40bc328/action => generated 145 bytes in 143 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 27 03:06:27.963868 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6f584fa4-e0f1-4ac8-805e-08c6f57dcd0b tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:06:27.969634 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-6f584fa4-e0f1-4ac8-805e-08c6f57dcd0b tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: ecbf3ab5-9736-491e-b120-6a30d40bc328] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:27.997434 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6f584fa4-e0f1-4ac8-805e-08c6f57dcd0b tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:27.998504 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6f584fa4-e0f1-4ac8-805e-08c6f57dcd0b tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:27.999490 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6f584fa4-e0f1-4ac8-805e-08c6f57dcd0b tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:28.000860 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6f584fa4-e0f1-4ac8-805e-08c6f57dcd0b tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:28.001795 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6f584fa4-e0f1-4ac8-805e-08c6f57dcd0b tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:28.002442 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6f584fa4-e0f1-4ac8-805e-08c6f57dcd0b tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:28.037577 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-6f584fa4-e0f1-4ac8-805e-08c6f57dcd0b tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] HTTP exception thrown: Cannot 'rebuild' instance ecbf3ab5-9736-491e-b120-6a30d40bc328 while it is in vm_state rescued Aug 27 03:06:28.039348 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6f584fa4-e0f1-4ac8-805e-08c6f57dcd0b tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Request method failure captured: Aug 27 03:06:28.039348 n-d-852278-4 devstack@n-api.service[134052]: request: POST /compute/v2.1/servers/ecbf3ab5-9736-491e-b120-6a30d40bc328/action HTTP/1.1 Aug 27 03:06:28.039348 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 03:06:28.039348 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 03:06:28.039348 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 03:06:28.039348 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 65 Aug 27 03:06:28.039348 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 03:06:28.039348 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 03:06:28.039348 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 03:06:28.039348 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 03:06:28.039348 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYlCR9c_onisOtljFF_OKffaCMw1fqcK8AqJdNG9qzhexbiOAQUtNy-3x5VJrEQxLYuHD403zeJPmdfi74lzmVkRKznv6JROTBAXqcugDUkBzjF_9CFKpQVmUlF9UkBSehtKOGnnrCFpHwE0Yb7XTVGDotoY0qf8klSZfatljLqnj-Y Aug 27 03:06:28.039348 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 03:06:28.039348 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 03:06:28.039348 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 03:06:28.039348 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 03:06:28.039348 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 03:06:28.039348 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 03:06:28.039348 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 1b4ca527ba3b49539b528ec8950aef78 Aug 27 03:06:28.039348 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1447006165 Aug 27 03:06:28.039348 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 03:06:28.039348 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 03:06:28.039348 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/1b4ca527ba3b49539b528ec8950aef78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_1b4ca527ba3b49539b528ec8950aef78", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/1b4ca527ba3b49539b528ec8950aef78"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/1b4ca527ba3b49539b528ec8950aef78"}]}] Aug 27 03:06:28.039348 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1447006165 Aug 27 03:06:28.039348 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 1b4ca527ba3b49539b528ec8950aef78 Aug 27 03:06:28.039348 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1447006165 Aug 27 03:06:28.039348 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ServerRescueNegativeTestJSON-1447006165-project Aug 27 03:06:28.039348 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 03:06:28.039348 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 03:06:28.039348 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 36697e722bef4a33ab158e9b2f87596a Aug 27 03:06:28.039348 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1447006165-project Aug 27 03:06:28.039348 n-d-852278-4 devstack@n-api.service[134052]: Aug 27 03:06:28.039348 n-d-852278-4 devstack@n-api.service[134052]: {"rebuild": {"imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6"}} Aug 27 03:06:28.039348 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 03:06:28.039348 n-d-852278-4 devstack@n-api.service[134052]: exception: Cannot 'rebuild' instance ecbf3ab5-9736-491e-b120-6a30d40bc328 while it is in vm_state rescued Aug 27 03:06:28.039348 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': 'ecbf3ab5-9736-491e-b120-6a30d40bc328', 'body': {'rebuild': {'imageRef': '1552acd0-176a-4c81-b680-29d74105e9d6'}}} Aug 27 03:06:28.039348 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:06:28.039348 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:28.039348 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1220, in _action_rebuild Aug 27 03:06:28.039348 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Aug 27 03:06:28.039348 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Aug 27 03:06:28.039348 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 27 03:06:28.039348 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 27 03:06:28.039348 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 27 03:06:28.039348 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 03:06:28.039348 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 03:06:28.039348 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 27 03:06:28.039348 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 27 03:06:28.039348 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ecbf3ab5-9736-491e-b120-6a30d40bc328 in vm_state rescued. Cannot rebuild while the instance is in this state. Aug 27 03:06:28.039348 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:06:28.039348 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:06:28.039348 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:06:28.039348 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:28.039348 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:06:28.039348 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:06:28.039348 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:06:28.039348 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:06:28.039348 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:06:28.039348 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:06:28.039348 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:06:28.039348 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:06:28.039348 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:06:28.039348 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:06:28.039348 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:06:28.043131 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:06:28.043131 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Aug 27 03:06:28.043131 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1228, in _action_rebuild Aug 27 03:06:28.043131 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 27 03:06:28.043131 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 27 03:06:28.043131 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 27 03:06:28.043131 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance ecbf3ab5-9736-491e-b120-6a30d40bc328 while it is in vm_state rescued Aug 27 03:06:28.043131 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:06:28.043131 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:06:28.043131 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:06:28.043131 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:28.043131 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:06:28.043131 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:06:28.043131 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:06:28.043131 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:06:28.043131 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance ecbf3ab5-9736-491e-b120-6a30d40bc328 while it is in vm_state rescued Aug 27 03:06:28.043131 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:06:28.043131 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6f584fa4-e0f1-4ac8-805e-08c6f57dcd0b tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Returning 409 to user: Cannot 'rebuild' instance ecbf3ab5-9736-491e-b120-6a30d40bc328 while it is in vm_state rescued {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:06:28.043131 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-6f584fa4-e0f1-4ac8-805e-08c6f57dcd0b tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "POST /compute/v2.1/servers/ecbf3ab5-9736-491e-b120-6a30d40bc328/action" status: 409 len: 146 microversion: 2.1 time: 0.081438 Aug 27 03:06:28.047183 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2387/4810] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:06:27 2022] POST /compute/v2.1/servers/ecbf3ab5-9736-491e-b120-6a30d40bc328/action => generated 146 bytes in 88 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 27 03:06:28.053072 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-32d15cb8-9487-4ded-a498-73480fe92465 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:28.053849 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-32d15cb8-9487-4ded-a498-73480fe92465 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: cd881214-dd67-4897-9167-335d7e48d789] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:28.064335 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-32d15cb8-9487-4ded-a498-73480fe92465 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:28.064842 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-32d15cb8-9487-4ded-a498-73480fe92465 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:28.065473 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-32d15cb8-9487-4ded-a498-73480fe92465 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:28.066219 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-32d15cb8-9487-4ded-a498-73480fe92465 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:28.066656 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-32d15cb8-9487-4ded-a498-73480fe92465 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:28.067079 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-32d15cb8-9487-4ded-a498-73480fe92465 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:28.101612 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-32d15cb8-9487-4ded-a498-73480fe92465 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: cd881214-dd67-4897-9167-335d7e48d789] Going to try to terminate instance {{(pid=134052) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:06:28.149212 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:06:28.219150 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-1b60fd15-022d-4f80-ad24-a7b486298901 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:28.225373 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-32d15cb8-9487-4ded-a498-73480fe92465 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "DELETE /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789" status: 204 len: 0 microversion: 2.1 time: 0.176537 Aug 27 03:06:28.226438 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2388/4811] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 03:06:28 2022] DELETE /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:06:28.236793 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-1b60fd15-022d-4f80-ad24-a7b486298901 tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/dc5b167d-847f-428c-8cae-3eef7bdffe9f" status: 200 len: 1479 microversion: 2.1 time: 0.602685 Aug 27 03:06:28.236793 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2424/4812] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:27 2022] GET /compute/v2.1/servers/dc5b167d-847f-428c-8cae-3eef7bdffe9f => generated 1479 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:28.247170 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-949524db-ec76-4528-bc2c-de06501b2f32 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:28.247597 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-949524db-ec76-4528-bc2c-de06501b2f32 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] [instance: 879f248c-09b1-4e34-982e-bb8b75be03ce] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:28.255598 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-949524db-ec76-4528-bc2c-de06501b2f32 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:28.256232 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-549a2746-8ab2-4e00-bad0-0f6582d665ca tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:28.256586 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-949524db-ec76-4528-bc2c-de06501b2f32 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:28.257129 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-949524db-ec76-4528-bc2c-de06501b2f32 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:28.257364 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-549a2746-8ab2-4e00-bad0-0f6582d665ca tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: cd881214-dd67-4897-9167-335d7e48d789] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:28.257743 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-949524db-ec76-4528-bc2c-de06501b2f32 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:28.259410 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-949524db-ec76-4528-bc2c-de06501b2f32 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:28.260974 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-949524db-ec76-4528-bc2c-de06501b2f32 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:28.267965 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-549a2746-8ab2-4e00-bad0-0f6582d665ca tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:28.268859 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-549a2746-8ab2-4e00-bad0-0f6582d665ca tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:28.269976 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-549a2746-8ab2-4e00-bad0-0f6582d665ca tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:28.270959 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-549a2746-8ab2-4e00-bad0-0f6582d665ca tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:28.271632 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-549a2746-8ab2-4e00-bad0-0f6582d665ca tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:28.272222 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-549a2746-8ab2-4e00-bad0-0f6582d665ca tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:28.293434 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-949524db-ec76-4528-bc2c-de06501b2f32 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] [instance: 879f248c-09b1-4e34-982e-bb8b75be03ce] Going to try to terminate instance {{(pid=134051) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:06:28.389874 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-949524db-ec76-4528-bc2c-de06501b2f32 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] 10.222.0.70 "DELETE /compute/v2.1/servers/879f248c-09b1-4e34-982e-bb8b75be03ce" status: 204 len: 0 microversion: 2.1 time: 0.146225 Aug 27 03:06:28.390508 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2425/4813] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 03:06:28 2022] DELETE /compute/v2.1/servers/879f248c-09b1-4e34-982e-bb8b75be03ce => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 03:06:28.400512 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c3602ff2-873e-44fe-99b1-cdc8f71ef799 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:28.401251 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-c3602ff2-873e-44fe-99b1-cdc8f71ef799 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] [instance: 879f248c-09b1-4e34-982e-bb8b75be03ce] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:28.410008 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c3602ff2-873e-44fe-99b1-cdc8f71ef799 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:28.410559 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c3602ff2-873e-44fe-99b1-cdc8f71ef799 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:28.411014 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c3602ff2-873e-44fe-99b1-cdc8f71ef799 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:28.412044 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c3602ff2-873e-44fe-99b1-cdc8f71ef799 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:28.412779 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c3602ff2-873e-44fe-99b1-cdc8f71ef799 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:28.413243 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c3602ff2-873e-44fe-99b1-cdc8f71ef799 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:28.993966 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-549a2746-8ab2-4e00-bad0-0f6582d665ca tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36697e722bef4a33ab158e9b2f87596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4ca527ba3b49539b528ec8950aef78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:29.003628 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-549a2746-8ab2-4e00-bad0-0f6582d665ca tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "GET /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789" status: 200 len: 1687 microversion: 2.1 time: 0.764441 Aug 27 03:06:29.004475 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2389/4814] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:28 2022] GET /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789 => generated 1687 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:29.009269 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-74f1cfbb-be1e-4e0f-a68f-770b6622466d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:29.010044 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-74f1cfbb-be1e-4e0f-a68f-770b6622466d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:29.016917 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-74f1cfbb-be1e-4e0f-a68f-770b6622466d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:29.017687 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-74f1cfbb-be1e-4e0f-a68f-770b6622466d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:29.018472 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-74f1cfbb-be1e-4e0f-a68f-770b6622466d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:29.019372 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-74f1cfbb-be1e-4e0f-a68f-770b6622466d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:29.019977 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-74f1cfbb-be1e-4e0f-a68f-770b6622466d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:29.020884 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-74f1cfbb-be1e-4e0f-a68f-770b6622466d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:29.131027 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-c3602ff2-873e-44fe-99b1-cdc8f71ef799 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3f67480c8a4ab8b538d4bebfa12d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d58ec8819c4af9bb00a08e2ca12708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:29.142471 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c3602ff2-873e-44fe-99b1-cdc8f71ef799 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] 10.222.0.70 "GET /compute/v2.1/servers/879f248c-09b1-4e34-982e-bb8b75be03ce" status: 200 len: 1503 microversion: 2.1 time: 0.747455 Aug 27 03:06:29.143064 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2426/4815] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:28 2022] GET /compute/v2.1/servers/879f248c-09b1-4e34-982e-bb8b75be03ce => generated 1503 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:29.226702 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-048c790e-9b81-4f7c-93f6-c753144c339a req-17059a88-3d94-4dfe-abce-39e0497670a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc5b167d-847f-428c-8cae-3eef7bdffe9f", "name": "network-vif-deleted", "tag": "f4a994bc-fc12-4bf9-a419-726c70aea3cd"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:06:29.243945 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-048c790e-9b81-4f7c-93f6-c753144c339a req-17059a88-3d94-4dfe-abce-39e0497670a3 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:29.244823 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-048c790e-9b81-4f7c-93f6-c753144c339a req-17059a88-3d94-4dfe-abce-39e0497670a3 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:29.245267 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-048c790e-9b81-4f7c-93f6-c753144c339a req-17059a88-3d94-4dfe-abce-39e0497670a3 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:29.268718 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-048c790e-9b81-4f7c-93f6-c753144c339a req-17059a88-3d94-4dfe-abce-39e0497670a3 service nova] Creating event network-vif-deleted:f4a994bc-fc12-4bf9-a419-726c70aea3cd for instance dc5b167d-847f-428c-8cae-3eef7bdffe9f on n-h1-852278-4 Aug 27 03:06:29.279826 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-048c790e-9b81-4f7c-93f6-c753144c339a req-17059a88-3d94-4dfe-abce-39e0497670a3 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058038 Aug 27 03:06:29.281249 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2427/4816] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:06:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:06:29.289049 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b96c4a65-2de0-4717-a639-168a90ab096a tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:29.289941 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b96c4a65-2de0-4717-a639-168a90ab096a tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: dc5b167d-847f-428c-8cae-3eef7bdffe9f] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:29.298935 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b96c4a65-2de0-4717-a639-168a90ab096a tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:29.299757 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b96c4a65-2de0-4717-a639-168a90ab096a tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:29.300561 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b96c4a65-2de0-4717-a639-168a90ab096a tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:29.301955 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b96c4a65-2de0-4717-a639-168a90ab096a tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:29.302562 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b96c4a65-2de0-4717-a639-168a90ab096a tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:29.304528 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b96c4a65-2de0-4717-a639-168a90ab096a tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:29.405715 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-74f1cfbb-be1e-4e0f-a68f-770b6622466d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:29.408246 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-b96c4a65-2de0-4717-a639-168a90ab096a tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a4e6dcf5df46fcad30430a9b9a08ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b8d6664c463420bad9a5bfb6d747db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:29.421462 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-74f1cfbb-be1e-4e0f-a68f-770b6622466d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1510 microversion: 2.1 time: 0.414366 Aug 27 03:06:29.422353 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2390/4817] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:29 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1510 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:29.429553 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b96c4a65-2de0-4717-a639-168a90ab096a tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/dc5b167d-847f-428c-8cae-3eef7bdffe9f" status: 200 len: 1278 microversion: 2.1 time: 0.146585 Aug 27 03:06:29.430883 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2428/4818] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:29 2022] GET /compute/v2.1/servers/dc5b167d-847f-428c-8cae-3eef7bdffe9f => generated 1278 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:30.028760 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6632e2df-9e9c-4037-a96f-b576d708d876 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:30.029487 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-6632e2df-9e9c-4037-a96f-b576d708d876 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: cd881214-dd67-4897-9167-335d7e48d789] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:30.044531 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6632e2df-9e9c-4037-a96f-b576d708d876 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:30.045368 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6632e2df-9e9c-4037-a96f-b576d708d876 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:30.047429 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6632e2df-9e9c-4037-a96f-b576d708d876 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:30.048915 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6632e2df-9e9c-4037-a96f-b576d708d876 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:30.049386 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6632e2df-9e9c-4037-a96f-b576d708d876 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:30.049843 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6632e2df-9e9c-4037-a96f-b576d708d876 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:30.164021 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c119f3a9-18ed-4867-af11-a42a619b6561 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:30.164930 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-c119f3a9-18ed-4867-af11-a42a619b6561 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] [instance: 879f248c-09b1-4e34-982e-bb8b75be03ce] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:30.173326 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c119f3a9-18ed-4867-af11-a42a619b6561 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:30.174080 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c119f3a9-18ed-4867-af11-a42a619b6561 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:30.174769 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c119f3a9-18ed-4867-af11-a42a619b6561 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:30.175626 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c119f3a9-18ed-4867-af11-a42a619b6561 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:30.176556 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c119f3a9-18ed-4867-af11-a42a619b6561 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:30.177136 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c119f3a9-18ed-4867-af11-a42a619b6561 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:30.330444 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-6632e2df-9e9c-4037-a96f-b576d708d876 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36697e722bef4a33ab158e9b2f87596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4ca527ba3b49539b528ec8950aef78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:30.349170 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-6632e2df-9e9c-4037-a96f-b576d708d876 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "GET /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789" status: 200 len: 1687 microversion: 2.1 time: 0.323111 Aug 27 03:06:30.350228 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2391/4819] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:30 2022] GET /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789 => generated 1687 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:30.388103 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-c119f3a9-18ed-4867-af11-a42a619b6561 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3f67480c8a4ab8b538d4bebfa12d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d58ec8819c4af9bb00a08e2ca12708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:30.407984 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c119f3a9-18ed-4867-af11-a42a619b6561 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] 10.222.0.70 "GET /compute/v2.1/servers/879f248c-09b1-4e34-982e-bb8b75be03ce" status: 200 len: 1503 microversion: 2.1 time: 0.240531 Aug 27 03:06:30.409715 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2429/4820] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:30 2022] GET /compute/v2.1/servers/879f248c-09b1-4e34-982e-bb8b75be03ce => generated 1503 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:06:30.448351 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f9d2c82b-7533-4b31-983f-e6e7178dc22a tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:30.448827 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-f9d2c82b-7533-4b31-983f-e6e7178dc22a tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:30.452782 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a3a11d4c-b61e-43ce-8b59-e891feef393f tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:30.455972 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-a3a11d4c-b61e-43ce-8b59-e891feef393f tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] [instance: dc5b167d-847f-428c-8cae-3eef7bdffe9f] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:30.456108 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f9d2c82b-7533-4b31-983f-e6e7178dc22a tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:30.456681 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f9d2c82b-7533-4b31-983f-e6e7178dc22a tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:30.457119 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f9d2c82b-7533-4b31-983f-e6e7178dc22a tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:30.457830 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f9d2c82b-7533-4b31-983f-e6e7178dc22a tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:30.458460 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f9d2c82b-7533-4b31-983f-e6e7178dc22a tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:30.459718 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f9d2c82b-7533-4b31-983f-e6e7178dc22a tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:30.466624 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a3a11d4c-b61e-43ce-8b59-e891feef393f tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:30.480747 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a3a11d4c-b61e-43ce-8b59-e891feef393f tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:30.481257 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a3a11d4c-b61e-43ce-8b59-e891feef393f tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:30.482019 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a3a11d4c-b61e-43ce-8b59-e891feef393f tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:30.482492 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a3a11d4c-b61e-43ce-8b59-e891feef393f tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:30.482975 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a3a11d4c-b61e-43ce-8b59-e891feef393f tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:30.511549 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-a3a11d4c-b61e-43ce-8b59-e891feef393f tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] HTTP exception thrown: Instance dc5b167d-847f-428c-8cae-3eef7bdffe9f could not be found. Aug 27 03:06:30.513355 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a3a11d4c-b61e-43ce-8b59-e891feef393f tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Request method failure captured: Aug 27 03:06:30.513355 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/dc5b167d-847f-428c-8cae-3eef7bdffe9f HTTP/1.1 Aug 27 03:06:30.513355 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 03:06:30.513355 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 03:06:30.513355 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 03:06:30.513355 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 03:06:30.513355 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 03:06:30.513355 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 03:06:30.513355 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 03:06:30.513355 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 03:06:30.513355 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYljOihuPJQy-4KxXQ6OhbQw2FQiYByi8_J9EYziHxHrRpgpXLGNvb0hsYYYVptKud4yCoN0X9GxdS_QRHpRChZ0P7CrkMR6MvE3oNyvsgDIOynlxCCmMse1aD34uMngOe0Z8wMpnS_90nVB9LjwZPMQBiRDrvzydhSu6jwK0Njtp_4 Aug 27 03:06:30.513355 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 03:06:30.513355 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 03:06:30.513355 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 03:06:30.513355 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 03:06:30.513355 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 03:06:30.513355 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 03:06:30.513355 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 6b8d6664c463420bad9a5bfb6d747db4 Aug 27 03:06:30.513355 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ServersTestJSON-252485458 Aug 27 03:06:30.513355 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 03:06:30.513355 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 03:06:30.513355 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6b8d6664c463420bad9a5bfb6d747db4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_6b8d6664c463420bad9a5bfb6d747db4", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6b8d6664c463420bad9a5bfb6d747db4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/6b8d6664c463420bad9a5bfb6d747db4"}]}] Aug 27 03:06:30.513355 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ServersTestJSON-252485458 Aug 27 03:06:30.513355 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 6b8d6664c463420bad9a5bfb6d747db4 Aug 27 03:06:30.513355 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ServersTestJSON-252485458 Aug 27 03:06:30.513355 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ServersTestJSON-252485458-project Aug 27 03:06:30.513355 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 03:06:30.513355 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 03:06:30.513355 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 13a4e6dcf5df46fcad30430a9b9a08ee Aug 27 03:06:30.513355 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ServersTestJSON-252485458-project Aug 27 03:06:30.513355 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 03:06:30.513355 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance dc5b167d-847f-428c-8cae-3eef7bdffe9f could not be found. Aug 27 03:06:30.513355 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': 'dc5b167d-847f-428c-8cae-3eef7bdffe9f'} Aug 27 03:06:30.513355 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:06:30.513355 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:30.513355 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:06:30.513355 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:06:30.513355 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:06:30.513355 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:06:30.513355 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:06:30.513355 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:06:30.513355 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:06:30.513355 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:06:30.513355 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc5b167d-847f-428c-8cae-3eef7bdffe9f could not be found. Aug 27 03:06:30.513355 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:30.513355 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:06:30.513355 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:30.513355 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:30.513355 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:06:30.513355 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:06:30.513355 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:06:30.513355 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:06:30.513355 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:06:30.513355 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:06:30.513355 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:06:30.513355 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:06:30.513355 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:06:30.513355 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:06:30.513355 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:06:30.513355 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:06:30.513355 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc5b167d-847f-428c-8cae-3eef7bdffe9f could not be found. Aug 27 03:06:30.513355 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:30.513355 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:06:30.513355 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:30.513355 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:30.520816 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:06:30.520816 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:06:30.520816 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:06:30.520816 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:06:30.520816 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc5b167d-847f-428c-8cae-3eef7bdffe9f could not be found. Aug 27 03:06:30.520816 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:30.520816 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a3a11d4c-b61e-43ce-8b59-e891feef393f tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] Returning 404 to user: Instance dc5b167d-847f-428c-8cae-3eef7bdffe9f could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:06:30.520816 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a3a11d4c-b61e-43ce-8b59-e891feef393f tempest-ServersTestJSON-252485458 tempest-ServersTestJSON-252485458-project] 10.222.0.70 "GET /compute/v2.1/servers/dc5b167d-847f-428c-8cae-3eef7bdffe9f" status: 404 len: 111 microversion: 2.1 time: 0.068945 Aug 27 03:06:30.520816 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2430/4821] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:30 2022] GET /compute/v2.1/servers/dc5b167d-847f-428c-8cae-3eef7bdffe9f => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:06:30.679276 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-f9d2c82b-7533-4b31-983f-e6e7178dc22a tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:30.691196 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f9d2c82b-7533-4b31-983f-e6e7178dc22a tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1510 microversion: 2.1 time: 0.249385 Aug 27 03:06:30.691801 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2392/4822] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:30 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1510 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:31.371633 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-efcba6e2-9717-4346-82d9-4b45a5679227 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:31.372250 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-efcba6e2-9717-4346-82d9-4b45a5679227 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: cd881214-dd67-4897-9167-335d7e48d789] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:31.380003 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-efcba6e2-9717-4346-82d9-4b45a5679227 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:31.380540 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-efcba6e2-9717-4346-82d9-4b45a5679227 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:31.388545 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-efcba6e2-9717-4346-82d9-4b45a5679227 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:31.389464 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-efcba6e2-9717-4346-82d9-4b45a5679227 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:31.389949 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-efcba6e2-9717-4346-82d9-4b45a5679227 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:31.390399 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-efcba6e2-9717-4346-82d9-4b45a5679227 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:31.429632 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a1a8f44b-9fcf-4344-ac50-10f1633046b2 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:31.430721 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a1a8f44b-9fcf-4344-ac50-10f1633046b2 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] [instance: 879f248c-09b1-4e34-982e-bb8b75be03ce] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:31.449197 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a1a8f44b-9fcf-4344-ac50-10f1633046b2 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:31.449811 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a1a8f44b-9fcf-4344-ac50-10f1633046b2 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:31.450132 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a1a8f44b-9fcf-4344-ac50-10f1633046b2 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:31.450883 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a1a8f44b-9fcf-4344-ac50-10f1633046b2 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:31.451342 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a1a8f44b-9fcf-4344-ac50-10f1633046b2 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:31.462145 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a1a8f44b-9fcf-4344-ac50-10f1633046b2 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:31.690608 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-efcba6e2-9717-4346-82d9-4b45a5679227 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36697e722bef4a33ab158e9b2f87596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4ca527ba3b49539b528ec8950aef78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:31.701950 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-efcba6e2-9717-4346-82d9-4b45a5679227 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "GET /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789" status: 200 len: 1687 microversion: 2.1 time: 0.333658 Aug 27 03:06:31.716521 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2431/4823] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:31 2022] GET /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789 => generated 1687 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:31.731506 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ee7641fd-6d3f-4912-bc78-76967dc26fc4 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:31.732602 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-ee7641fd-6d3f-4912-bc78-76967dc26fc4 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:31.750480 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ee7641fd-6d3f-4912-bc78-76967dc26fc4 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:31.751694 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ee7641fd-6d3f-4912-bc78-76967dc26fc4 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:31.753599 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ee7641fd-6d3f-4912-bc78-76967dc26fc4 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:31.754652 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ee7641fd-6d3f-4912-bc78-76967dc26fc4 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:31.755896 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ee7641fd-6d3f-4912-bc78-76967dc26fc4 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:31.757581 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ee7641fd-6d3f-4912-bc78-76967dc26fc4 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:31.804550 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-a1a8f44b-9fcf-4344-ac50-10f1633046b2 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3f67480c8a4ab8b538d4bebfa12d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d58ec8819c4af9bb00a08e2ca12708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:31.817561 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a1a8f44b-9fcf-4344-ac50-10f1633046b2 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] 10.222.0.70 "GET /compute/v2.1/servers/879f248c-09b1-4e34-982e-bb8b75be03ce" status: 200 len: 1503 microversion: 2.1 time: 0.392926 Aug 27 03:06:31.822178 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2393/4824] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:31 2022] GET /compute/v2.1/servers/879f248c-09b1-4e34-982e-bb8b75be03ce => generated 1503 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:06:32.094927 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-ee7641fd-6d3f-4912-bc78-76967dc26fc4 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:32.105137 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ee7641fd-6d3f-4912-bc78-76967dc26fc4 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1531 microversion: 2.1 time: 0.386999 Aug 27 03:06:32.105821 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2432/4825] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:31 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1531 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:32.726375 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d79558ef-bc12-4955-a654-9e9eccad1a7c tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:32.728641 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d79558ef-bc12-4955-a654-9e9eccad1a7c tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: cd881214-dd67-4897-9167-335d7e48d789] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:32.746180 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d79558ef-bc12-4955-a654-9e9eccad1a7c tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:32.746651 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d79558ef-bc12-4955-a654-9e9eccad1a7c tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:32.747095 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d79558ef-bc12-4955-a654-9e9eccad1a7c tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:32.747818 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d79558ef-bc12-4955-a654-9e9eccad1a7c tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:32.748644 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d79558ef-bc12-4955-a654-9e9eccad1a7c tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:32.757028 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d79558ef-bc12-4955-a654-9e9eccad1a7c tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:32.844793 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e3ab3356-c5b9-4304-9ead-26fe104cdf19 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:32.846440 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-e3ab3356-c5b9-4304-9ead-26fe104cdf19 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] [instance: 879f248c-09b1-4e34-982e-bb8b75be03ce] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:32.864869 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e3ab3356-c5b9-4304-9ead-26fe104cdf19 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:32.866618 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e3ab3356-c5b9-4304-9ead-26fe104cdf19 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:32.867938 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e3ab3356-c5b9-4304-9ead-26fe104cdf19 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:32.873481 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e3ab3356-c5b9-4304-9ead-26fe104cdf19 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:32.876223 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e3ab3356-c5b9-4304-9ead-26fe104cdf19 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:32.878136 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e3ab3356-c5b9-4304-9ead-26fe104cdf19 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:33.997722 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-d79558ef-bc12-4955-a654-9e9eccad1a7c tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36697e722bef4a33ab158e9b2f87596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4ca527ba3b49539b528ec8950aef78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:34.013097 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d79558ef-bc12-4955-a654-9e9eccad1a7c tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "GET /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789" status: 200 len: 1687 microversion: 2.1 time: 1.293631 Aug 27 03:06:34.013935 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2394/4826] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:32 2022] GET /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789 => generated 1687 bytes in 1295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:34.029973 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e7a4da05-0309-439a-94ae-22c975114e7d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:34.034863 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-e7a4da05-0309-439a-94ae-22c975114e7d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:34.048755 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e7a4da05-0309-439a-94ae-22c975114e7d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:34.054234 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e7a4da05-0309-439a-94ae-22c975114e7d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:34.056426 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e7a4da05-0309-439a-94ae-22c975114e7d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:34.057295 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e7a4da05-0309-439a-94ae-22c975114e7d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:34.059557 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e7a4da05-0309-439a-94ae-22c975114e7d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:34.061154 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e7a4da05-0309-439a-94ae-22c975114e7d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:34.188023 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e3ab3356-c5b9-4304-9ead-26fe104cdf19 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3f67480c8a4ab8b538d4bebfa12d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d58ec8819c4af9bb00a08e2ca12708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:34.210112 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e3ab3356-c5b9-4304-9ead-26fe104cdf19 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] 10.222.0.70 "GET /compute/v2.1/servers/879f248c-09b1-4e34-982e-bb8b75be03ce" status: 200 len: 1503 microversion: 2.1 time: 1.372312 Aug 27 03:06:34.212677 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2433/4827] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:32 2022] GET /compute/v2.1/servers/879f248c-09b1-4e34-982e-bb8b75be03ce => generated 1503 bytes in 1376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:06:35.037617 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-495b6e2e-0d59-442a-9d0e-dd0763b80364 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:35.038215 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-495b6e2e-0d59-442a-9d0e-dd0763b80364 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: cd881214-dd67-4897-9167-335d7e48d789] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:35.058643 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-495b6e2e-0d59-442a-9d0e-dd0763b80364 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:35.059161 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-495b6e2e-0d59-442a-9d0e-dd0763b80364 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:35.059609 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-495b6e2e-0d59-442a-9d0e-dd0763b80364 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:35.067811 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-495b6e2e-0d59-442a-9d0e-dd0763b80364 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:35.068456 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-495b6e2e-0d59-442a-9d0e-dd0763b80364 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:35.068920 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-495b6e2e-0d59-442a-9d0e-dd0763b80364 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:35.323290 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-495b6e2e-0d59-442a-9d0e-dd0763b80364 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36697e722bef4a33ab158e9b2f87596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4ca527ba3b49539b528ec8950aef78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:35.335451 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-495b6e2e-0d59-442a-9d0e-dd0763b80364 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "GET /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789" status: 200 len: 1620 microversion: 2.1 time: 0.302716 Aug 27 03:06:35.343543 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2434/4828] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:35 2022] GET /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789 => generated 1620 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:35.353652 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-9252b543-1a6f-41f0-9123-0d139447e191 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:35.354990 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-9252b543-1a6f-41f0-9123-0d139447e191 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] [instance: 879f248c-09b1-4e34-982e-bb8b75be03ce] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:35.375208 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9252b543-1a6f-41f0-9123-0d139447e191 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:35.377767 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9252b543-1a6f-41f0-9123-0d139447e191 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:35.384468 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9252b543-1a6f-41f0-9123-0d139447e191 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:35.388951 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9252b543-1a6f-41f0-9123-0d139447e191 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:35.389582 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9252b543-1a6f-41f0-9123-0d139447e191 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:35.390143 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9252b543-1a6f-41f0-9123-0d139447e191 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:35.517823 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-e7a4da05-0309-439a-94ae-22c975114e7d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:35.541210 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e7a4da05-0309-439a-94ae-22c975114e7d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1526 microversion: 2.1 time: 1.525195 Aug 27 03:06:35.543057 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2395/4829] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:34 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1526 bytes in 1528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:35.572417 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-97b72bf5-2f7c-43ba-86e8-fe439f03f3e1 req-dc8b2c19-1ce6-47e8-ab3a-4b546df79d34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd881214-dd67-4897-9167-335d7e48d789", "name": "network-vif-deleted", "tag": "2f521791-b088-40a6-a31a-f7d14fcd7ae4"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:06:35.626050 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-97b72bf5-2f7c-43ba-86e8-fe439f03f3e1 req-dc8b2c19-1ce6-47e8-ab3a-4b546df79d34 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:35.628382 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-97b72bf5-2f7c-43ba-86e8-fe439f03f3e1 req-dc8b2c19-1ce6-47e8-ab3a-4b546df79d34 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:35.630033 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-97b72bf5-2f7c-43ba-86e8-fe439f03f3e1 req-dc8b2c19-1ce6-47e8-ab3a-4b546df79d34 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:35.714910 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-97b72bf5-2f7c-43ba-86e8-fe439f03f3e1 req-dc8b2c19-1ce6-47e8-ab3a-4b546df79d34 service nova] Creating event network-vif-deleted:2f521791-b088-40a6-a31a-f7d14fcd7ae4 for instance cd881214-dd67-4897-9167-335d7e48d789 on n-h2-852278-4 Aug 27 03:06:35.741139 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-97b72bf5-2f7c-43ba-86e8-fe439f03f3e1 req-dc8b2c19-1ce6-47e8-ab3a-4b546df79d34 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.189070 Aug 27 03:06:35.748124 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2396/4830] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:06:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:06:35.980906 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-9252b543-1a6f-41f0-9123-0d139447e191 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3f67480c8a4ab8b538d4bebfa12d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d58ec8819c4af9bb00a08e2ca12708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:35.997376 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-9252b543-1a6f-41f0-9123-0d139447e191 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] 10.222.0.70 "GET /compute/v2.1/servers/879f248c-09b1-4e34-982e-bb8b75be03ce" status: 200 len: 1503 microversion: 2.1 time: 0.651822 Aug 27 03:06:36.016532 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2435/4831] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:35 2022] GET /compute/v2.1/servers/879f248c-09b1-4e34-982e-bb8b75be03ce => generated 1503 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:36.364542 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-431d8e84-c348-4d0a-af64-1cfc17e1ea9e tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:36.365303 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-431d8e84-c348-4d0a-af64-1cfc17e1ea9e tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: cd881214-dd67-4897-9167-335d7e48d789] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:36.407529 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-431d8e84-c348-4d0a-af64-1cfc17e1ea9e tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:36.409884 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-431d8e84-c348-4d0a-af64-1cfc17e1ea9e tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:36.411082 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-431d8e84-c348-4d0a-af64-1cfc17e1ea9e tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:36.412961 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-431d8e84-c348-4d0a-af64-1cfc17e1ea9e tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:36.415896 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-431d8e84-c348-4d0a-af64-1cfc17e1ea9e tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:36.418768 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-431d8e84-c348-4d0a-af64-1cfc17e1ea9e tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:36.490460 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-431d8e84-c348-4d0a-af64-1cfc17e1ea9e tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] HTTP exception thrown: Instance cd881214-dd67-4897-9167-335d7e48d789 could not be found. Aug 27 03:06:36.498486 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-431d8e84-c348-4d0a-af64-1cfc17e1ea9e tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Request method failure captured: Aug 27 03:06:36.498486 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789 HTTP/1.1 Aug 27 03:06:36.498486 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 03:06:36.498486 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 03:06:36.498486 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 03:06:36.498486 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 03:06:36.498486 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 03:06:36.498486 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 03:06:36.498486 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 03:06:36.498486 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 03:06:36.498486 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYlCR9c_onisOtljFF_OKffaCMw1fqcK8AqJdNG9qzhexbiOAQUtNy-3x5VJrEQxLYuHD403zeJPmdfi74lzmVkRKznv6JROTBAXqcugDUkBzjF_9CFKpQVmUlF9UkBSehtKOGnnrCFpHwE0Yb7XTVGDotoY0qf8klSZfatljLqnj-Y Aug 27 03:06:36.498486 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 03:06:36.498486 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 03:06:36.498486 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 03:06:36.498486 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 03:06:36.498486 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 03:06:36.498486 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 03:06:36.498486 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 1b4ca527ba3b49539b528ec8950aef78 Aug 27 03:06:36.498486 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1447006165 Aug 27 03:06:36.498486 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 03:06:36.498486 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 03:06:36.498486 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/1b4ca527ba3b49539b528ec8950aef78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_1b4ca527ba3b49539b528ec8950aef78", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/1b4ca527ba3b49539b528ec8950aef78"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/1b4ca527ba3b49539b528ec8950aef78"}]}] Aug 27 03:06:36.498486 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1447006165 Aug 27 03:06:36.498486 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 1b4ca527ba3b49539b528ec8950aef78 Aug 27 03:06:36.498486 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1447006165 Aug 27 03:06:36.498486 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ServerRescueNegativeTestJSON-1447006165-project Aug 27 03:06:36.498486 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 03:06:36.498486 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 03:06:36.498486 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 36697e722bef4a33ab158e9b2f87596a Aug 27 03:06:36.498486 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1447006165-project Aug 27 03:06:36.498486 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 03:06:36.498486 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance cd881214-dd67-4897-9167-335d7e48d789 could not be found. Aug 27 03:06:36.498486 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': 'cd881214-dd67-4897-9167-335d7e48d789'} Aug 27 03:06:36.498486 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:06:36.498486 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:36.498486 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:06:36.498486 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:06:36.498486 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:06:36.498486 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:06:36.498486 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:06:36.498486 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:06:36.498486 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:06:36.498486 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:06:36.498486 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd881214-dd67-4897-9167-335d7e48d789 could not be found. Aug 27 03:06:36.498486 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:06:36.498486 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:06:36.498486 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:06:36.498486 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:36.498486 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:06:36.498486 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:06:36.498486 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:06:36.498486 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:06:36.498486 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:06:36.498486 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:06:36.498486 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:06:36.498486 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:06:36.498486 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:06:36.498486 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:06:36.498486 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:06:36.498486 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:06:36.498486 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd881214-dd67-4897-9167-335d7e48d789 could not be found. Aug 27 03:06:36.498486 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:06:36.498486 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:06:36.502196 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:06:36.502196 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:36.502196 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:06:36.502196 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:06:36.502196 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:06:36.502196 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:06:36.502196 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd881214-dd67-4897-9167-335d7e48d789 could not be found. Aug 27 03:06:36.502196 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:06:36.512277 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-431d8e84-c348-4d0a-af64-1cfc17e1ea9e tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Returning 404 to user: Instance cd881214-dd67-4897-9167-335d7e48d789 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:06:36.529414 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-431d8e84-c348-4d0a-af64-1cfc17e1ea9e tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "GET /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789" status: 404 len: 111 microversion: 2.1 time: 0.170346 Aug 27 03:06:36.532429 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2397/4832] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:36 2022] GET /compute/v2.1/servers/cd881214-dd67-4897-9167-335d7e48d789 => generated 111 bytes in 176 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:06:36.541795 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c25aef5b-f3b7-4961-881c-220be3a0873d tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '.version_select at 0x7f5edeb0eca0>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:36.567578 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-dd2feaac-1bb7-435b-8c14-84ec33815fbd tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:36.568197 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-dd2feaac-1bb7-435b-8c14-84ec33815fbd tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:36.591052 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dd2feaac-1bb7-435b-8c14-84ec33815fbd tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:36.591688 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dd2feaac-1bb7-435b-8c14-84ec33815fbd tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:36.592880 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dd2feaac-1bb7-435b-8c14-84ec33815fbd tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:36.595882 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dd2feaac-1bb7-435b-8c14-84ec33815fbd tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:36.601251 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dd2feaac-1bb7-435b-8c14-84ec33815fbd tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:36.601949 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dd2feaac-1bb7-435b-8c14-84ec33815fbd tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:36.639639 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c25aef5b-f3b7-4961-881c-220be3a0873d tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-229843751" status: 202 len: 0 microversion: 2.1 time: 0.098808 Aug 27 03:06:36.642761 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2436/4833] 10.222.0.70 () {58 vars in 1218 bytes} [Sat Aug 27 03:06:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-229843751 => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:06:37.022239 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8c9aa1ef-38bc-48a2-b371-f25fe433919a tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:37.031238 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-8c9aa1ef-38bc-48a2-b371-f25fe433919a tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] [instance: 879f248c-09b1-4e34-982e-bb8b75be03ce] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:37.048512 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8c9aa1ef-38bc-48a2-b371-f25fe433919a tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:37.049265 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8c9aa1ef-38bc-48a2-b371-f25fe433919a tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:37.050011 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8c9aa1ef-38bc-48a2-b371-f25fe433919a tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:37.050987 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8c9aa1ef-38bc-48a2-b371-f25fe433919a tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:37.053183 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8c9aa1ef-38bc-48a2-b371-f25fe433919a tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:37.055015 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8c9aa1ef-38bc-48a2-b371-f25fe433919a tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:37.073675 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-8c9aa1ef-38bc-48a2-b371-f25fe433919a tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] HTTP exception thrown: Instance 879f248c-09b1-4e34-982e-bb8b75be03ce could not be found. Aug 27 03:06:37.075922 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8c9aa1ef-38bc-48a2-b371-f25fe433919a tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Request method failure captured: Aug 27 03:06:37.075922 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/879f248c-09b1-4e34-982e-bb8b75be03ce HTTP/1.1 Aug 27 03:06:37.075922 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 03:06:37.075922 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 03:06:37.075922 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 03:06:37.075922 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 03:06:37.075922 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 03:06:37.075922 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 03:06:37.075922 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 03:06:37.075922 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 03:06:37.075922 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYodMCDYqYb6vQsQ-_MqS42TmHHJ_V0CE-cb7lzdQenfJUwXHNz-rUWO-mk4V0bTfn-ZOcYS5PAggcRVtmomXPQMyhJYv4uBQNhaHK6D9rE7S2YpmZThaTWUURQ5ay62N-Vj_jAHdfeMHMhBZWG0Mc6scC2IdAtIag2PVfNJIeXKUKM Aug 27 03:06:37.075922 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 03:06:37.075922 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 03:06:37.075922 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 03:06:37.075922 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 03:06:37.075922 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 03:06:37.075922 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 03:06:37.075922 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 88d58ec8819c4af9bb00a08e2ca12708 Aug 27 03:06:37.075922 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-VolumesActionsTest-1251134472 Aug 27 03:06:37.075922 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 03:06:37.075922 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 03:06:37.075922 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/88d58ec8819c4af9bb00a08e2ca12708"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_88d58ec8819c4af9bb00a08e2ca12708", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/88d58ec8819c4af9bb00a08e2ca12708"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/88d58ec8819c4af9bb00a08e2ca12708"}]}] Aug 27 03:06:37.075922 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-VolumesActionsTest-1251134472 Aug 27 03:06:37.075922 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 88d58ec8819c4af9bb00a08e2ca12708 Aug 27 03:06:37.075922 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-VolumesActionsTest-1251134472 Aug 27 03:06:37.075922 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-VolumesActionsTest-1251134472-project Aug 27 03:06:37.075922 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 03:06:37.075922 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 03:06:37.075922 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 0f3f67480c8a4ab8b538d4bebfa12d47 Aug 27 03:06:37.075922 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-VolumesActionsTest-1251134472-project Aug 27 03:06:37.075922 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 03:06:37.075922 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance 879f248c-09b1-4e34-982e-bb8b75be03ce could not be found. Aug 27 03:06:37.075922 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '879f248c-09b1-4e34-982e-bb8b75be03ce'} Aug 27 03:06:37.075922 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:06:37.075922 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:37.075922 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:06:37.075922 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:06:37.075922 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:06:37.075922 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:06:37.075922 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:06:37.075922 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:06:37.075922 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:06:37.075922 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:06:37.075922 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 879f248c-09b1-4e34-982e-bb8b75be03ce could not be found. Aug 27 03:06:37.075922 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:37.075922 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:06:37.075922 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:37.075922 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:37.075922 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:06:37.075922 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:06:37.075922 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:06:37.075922 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:06:37.075922 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:06:37.075922 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:06:37.075922 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:06:37.075922 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:06:37.075922 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:06:37.075922 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:06:37.075922 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:06:37.075922 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:06:37.075922 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 879f248c-09b1-4e34-982e-bb8b75be03ce could not be found. Aug 27 03:06:37.075922 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:37.075922 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:06:37.075922 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:37.085206 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:37.085206 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:06:37.085206 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:06:37.085206 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:06:37.085206 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:06:37.085206 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 879f248c-09b1-4e34-982e-bb8b75be03ce could not be found. Aug 27 03:06:37.085206 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:37.088672 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8c9aa1ef-38bc-48a2-b371-f25fe433919a tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Returning 404 to user: Instance 879f248c-09b1-4e34-982e-bb8b75be03ce could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:06:37.090968 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-8c9aa1ef-38bc-48a2-b371-f25fe433919a tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] 10.222.0.70 "GET /compute/v2.1/servers/879f248c-09b1-4e34-982e-bb8b75be03ce" status: 404 len: 111 microversion: 2.1 time: 0.075922 Aug 27 03:06:37.092341 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2437/4834] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:37 2022] GET /compute/v2.1/servers/879f248c-09b1-4e34-982e-bb8b75be03ce => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:06:37.186137 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-dd2feaac-1bb7-435b-8c14-84ec33815fbd tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:37.197452 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-dd2feaac-1bb7-435b-8c14-84ec33815fbd tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1526 microversion: 2.1 time: 0.634951 Aug 27 03:06:37.204867 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2398/4835] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:36 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1526 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:37.371775 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a4a19090-1fbb-49c9-a8ce-762d0ae9b297 tempest-PortsAdminExtendedAttrsTestJSON-112738975 tempest-PortsAdminExtendedAttrsTestJSON-112738975-project-admin] Calling method '.version_select at 0x7f5ede19f160>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:37.374276 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a4a19090-1fbb-49c9-a8ce-762d0ae9b297 tempest-PortsAdminExtendedAttrsTestJSON-112738975 tempest-PortsAdminExtendedAttrsTestJSON-112738975-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:37.375077 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a4a19090-1fbb-49c9-a8ce-762d0ae9b297 tempest-PortsAdminExtendedAttrsTestJSON-112738975 tempest-PortsAdminExtendedAttrsTestJSON-112738975-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:37.375517 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a4a19090-1fbb-49c9-a8ce-762d0ae9b297 tempest-PortsAdminExtendedAttrsTestJSON-112738975 tempest-PortsAdminExtendedAttrsTestJSON-112738975-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:37.390990 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ab4de74b-48db-4791-a666-f79d9a077ee3 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-819604744", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "networks": [{"uuid": "8521d297-b625-4a0b-9a27-8f0bb47922bd"}]}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:06:37.440808 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a4a19090-1fbb-49c9-a8ce-762d0ae9b297 tempest-PortsAdminExtendedAttrsTestJSON-112738975 tempest-PortsAdminExtendedAttrsTestJSON-112738975-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:37.444167 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a4a19090-1fbb-49c9-a8ce-762d0ae9b297 tempest-PortsAdminExtendedAttrsTestJSON-112738975 tempest-PortsAdminExtendedAttrsTestJSON-112738975-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:37.444713 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a4a19090-1fbb-49c9-a8ce-762d0ae9b297 tempest-PortsAdminExtendedAttrsTestJSON-112738975 tempest-PortsAdminExtendedAttrsTestJSON-112738975-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:37.484077 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a4a19090-1fbb-49c9-a8ce-762d0ae9b297 tempest-PortsAdminExtendedAttrsTestJSON-112738975 tempest-PortsAdminExtendedAttrsTestJSON-112738975-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:37.485222 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a4a19090-1fbb-49c9-a8ce-762d0ae9b297 tempest-PortsAdminExtendedAttrsTestJSON-112738975 tempest-PortsAdminExtendedAttrsTestJSON-112738975-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:37.485681 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a4a19090-1fbb-49c9-a8ce-762d0ae9b297 tempest-PortsAdminExtendedAttrsTestJSON-112738975 tempest-PortsAdminExtendedAttrsTestJSON-112738975-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:37.495273 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a4a19090-1fbb-49c9-a8ce-762d0ae9b297 tempest-PortsAdminExtendedAttrsTestJSON-112738975 tempest-PortsAdminExtendedAttrsTestJSON-112738975-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.401146 Aug 27 03:06:37.502929 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2438/4836] 10.222.0.70 () {58 vars in 1146 bytes} [Sat Aug 27 03:06:37 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:06:37.780761 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-0504a4bb-2b82-4d4d-829c-bf3a95c56923 req-aad2b3cc-a4f7-4ef0-8cbd-af61bc9b28c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "879f248c-09b1-4e34-982e-bb8b75be03ce", "name": "network-vif-deleted", "tag": "17e98da5-b4f5-4a1e-918f-2bd27122b546"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:06:37.827336 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-0504a4bb-2b82-4d4d-829c-bf3a95c56923 req-aad2b3cc-a4f7-4ef0-8cbd-af61bc9b28c3 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:37.827795 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-0504a4bb-2b82-4d4d-829c-bf3a95c56923 req-aad2b3cc-a4f7-4ef0-8cbd-af61bc9b28c3 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:37.828228 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-0504a4bb-2b82-4d4d-829c-bf3a95c56923 req-aad2b3cc-a4f7-4ef0-8cbd-af61bc9b28c3 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:37.860969 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-0504a4bb-2b82-4d4d-829c-bf3a95c56923 req-aad2b3cc-a4f7-4ef0-8cbd-af61bc9b28c3 service nova] Creating event network-vif-deleted:17e98da5-b4f5-4a1e-918f-2bd27122b546 for instance 879f248c-09b1-4e34-982e-bb8b75be03ce on n-h2-852278-4 Aug 27 03:06:37.872889 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-0504a4bb-2b82-4d4d-829c-bf3a95c56923 req-aad2b3cc-a4f7-4ef0-8cbd-af61bc9b28c3 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093543 Aug 27 03:06:37.874167 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2439/4837] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:06:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:06:38.220082 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d4aa9626-50b8-4efa-8f00-9af6c9ce5474 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:38.221057 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d4aa9626-50b8-4efa-8f00-9af6c9ce5474 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:38.231104 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d4aa9626-50b8-4efa-8f00-9af6c9ce5474 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:38.233936 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d4aa9626-50b8-4efa-8f00-9af6c9ce5474 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:38.234578 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d4aa9626-50b8-4efa-8f00-9af6c9ce5474 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:38.237736 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d4aa9626-50b8-4efa-8f00-9af6c9ce5474 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:38.238367 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d4aa9626-50b8-4efa-8f00-9af6c9ce5474 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:38.238986 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d4aa9626-50b8-4efa-8f00-9af6c9ce5474 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:39.287630 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d4aa9626-50b8-4efa-8f00-9af6c9ce5474 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:39.303944 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d4aa9626-50b8-4efa-8f00-9af6c9ce5474 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1526 microversion: 2.1 time: 1.088354 Aug 27 03:06:39.333510 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2440/4838] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:38 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1526 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:06:39.343876 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-94e24f6c-b9a1-4c4f-8638-98e7a41a175f req-e7d6ce84-38f3-4061-8c10-01c6b485de62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72ffd032-b609-4e42-90d9-5454ac648eeb", "name": "network-vif-plugged", "status": "completed", "tag": "7a8cf46b-6b49-415b-b564-a266edc89536"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:06:39.369292 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-94e24f6c-b9a1-4c4f-8638-98e7a41a175f req-e7d6ce84-38f3-4061-8c10-01c6b485de62 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:39.372067 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-94e24f6c-b9a1-4c4f-8638-98e7a41a175f req-e7d6ce84-38f3-4061-8c10-01c6b485de62 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:39.374951 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-94e24f6c-b9a1-4c4f-8638-98e7a41a175f req-e7d6ce84-38f3-4061-8c10-01c6b485de62 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:39.408470 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-94e24f6c-b9a1-4c4f-8638-98e7a41a175f req-e7d6ce84-38f3-4061-8c10-01c6b485de62 service nova] Creating event network-vif-plugged:7a8cf46b-6b49-415b-b564-a266edc89536 for instance 72ffd032-b609-4e42-90d9-5454ac648eeb on n-h1-852278-4 Aug 27 03:06:39.419860 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-94e24f6c-b9a1-4c4f-8638-98e7a41a175f req-e7d6ce84-38f3-4061-8c10-01c6b485de62 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084568 Aug 27 03:06:39.422654 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2441/4839] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:06:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:06:40.338272 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-70ca64e3-4f08-4add-b5f6-bbb7512dc00b tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:40.343843 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-70ca64e3-4f08-4add-b5f6-bbb7512dc00b tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:40.370325 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-70ca64e3-4f08-4add-b5f6-bbb7512dc00b tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:40.374874 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-70ca64e3-4f08-4add-b5f6-bbb7512dc00b tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:40.375390 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-70ca64e3-4f08-4add-b5f6-bbb7512dc00b tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:40.376151 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-70ca64e3-4f08-4add-b5f6-bbb7512dc00b tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:40.379165 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-70ca64e3-4f08-4add-b5f6-bbb7512dc00b tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:40.379609 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-70ca64e3-4f08-4add-b5f6-bbb7512dc00b tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:40.745039 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-70ca64e3-4f08-4add-b5f6-bbb7512dc00b tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:40.754544 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-70ca64e3-4f08-4add-b5f6-bbb7512dc00b tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1526 microversion: 2.1 time: 0.425798 Aug 27 03:06:40.755141 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2442/4840] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:40 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1526 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:06:41.786838 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3faea477-2d2e-4509-8ac6-ebf8fd035228 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:41.789086 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-3faea477-2d2e-4509-8ac6-ebf8fd035228 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:41.824025 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3faea477-2d2e-4509-8ac6-ebf8fd035228 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:41.824857 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3faea477-2d2e-4509-8ac6-ebf8fd035228 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:41.825468 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3faea477-2d2e-4509-8ac6-ebf8fd035228 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:41.826623 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3faea477-2d2e-4509-8ac6-ebf8fd035228 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:41.827295 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3faea477-2d2e-4509-8ac6-ebf8fd035228 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:41.827872 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3faea477-2d2e-4509-8ac6-ebf8fd035228 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:41.853440 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:06:42.331075 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-3faea477-2d2e-4509-8ac6-ebf8fd035228 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:42.346698 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-3faea477-2d2e-4509-8ac6-ebf8fd035228 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1526 microversion: 2.1 time: 0.562603 Aug 27 03:06:42.349194 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2443/4841] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:41 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1526 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:43.370859 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8182baac-d119-4398-b492-9b3771be1459 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:43.372563 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-8182baac-d119-4398-b492-9b3771be1459 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:43.385579 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8182baac-d119-4398-b492-9b3771be1459 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:43.386496 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8182baac-d119-4398-b492-9b3771be1459 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:43.387196 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8182baac-d119-4398-b492-9b3771be1459 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:43.389119 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8182baac-d119-4398-b492-9b3771be1459 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:43.389832 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8182baac-d119-4398-b492-9b3771be1459 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:43.391127 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8182baac-d119-4398-b492-9b3771be1459 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:43.743244 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-8182baac-d119-4398-b492-9b3771be1459 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:43.756704 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-8182baac-d119-4398-b492-9b3771be1459 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1526 microversion: 2.1 time: 0.392823 Aug 27 03:06:43.757562 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2444/4842] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:43 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1526 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:44.779871 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-256ad8d0-7704-4c75-922f-b8edf153e0b5 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:44.780522 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-256ad8d0-7704-4c75-922f-b8edf153e0b5 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:44.812417 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-256ad8d0-7704-4c75-922f-b8edf153e0b5 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:44.813071 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-256ad8d0-7704-4c75-922f-b8edf153e0b5 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:44.813697 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-256ad8d0-7704-4c75-922f-b8edf153e0b5 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:44.816849 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-256ad8d0-7704-4c75-922f-b8edf153e0b5 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:44.818713 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-256ad8d0-7704-4c75-922f-b8edf153e0b5 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:44.819168 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-256ad8d0-7704-4c75-922f-b8edf153e0b5 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:46.084665 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-256ad8d0-7704-4c75-922f-b8edf153e0b5 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:46.093600 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-256ad8d0-7704-4c75-922f-b8edf153e0b5 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1526 microversion: 2.1 time: 1.318231 Aug 27 03:06:46.095330 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2445/4843] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:44 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1526 bytes in 1321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:47.115995 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b5c55485-074e-4d5f-b7c4-69b78180f705 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:47.116785 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b5c55485-074e-4d5f-b7c4-69b78180f705 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:47.137821 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b5c55485-074e-4d5f-b7c4-69b78180f705 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:47.138349 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b5c55485-074e-4d5f-b7c4-69b78180f705 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:47.138828 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b5c55485-074e-4d5f-b7c4-69b78180f705 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:47.139724 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b5c55485-074e-4d5f-b7c4-69b78180f705 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:47.145231 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b5c55485-074e-4d5f-b7c4-69b78180f705 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:47.146139 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b5c55485-074e-4d5f-b7c4-69b78180f705 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:47.190848 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:06:47.424839 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:06:47.596093 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-b5c55485-074e-4d5f-b7c4-69b78180f705 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:47.606266 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b5c55485-074e-4d5f-b7c4-69b78180f705 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1526 microversion: 2.1 time: 0.495035 Aug 27 03:06:47.627999 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2446/4844] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:47 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1526 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:06:48.648939 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-60a06910-c2cb-456a-9e13-ada5b7bd01ce tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:48.650334 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-60a06910-c2cb-456a-9e13-ada5b7bd01ce tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:48.669405 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-60a06910-c2cb-456a-9e13-ada5b7bd01ce tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:48.671377 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-60a06910-c2cb-456a-9e13-ada5b7bd01ce tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:48.674752 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-60a06910-c2cb-456a-9e13-ada5b7bd01ce tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:48.675785 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-60a06910-c2cb-456a-9e13-ada5b7bd01ce tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:48.679691 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-60a06910-c2cb-456a-9e13-ada5b7bd01ce tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:48.683289 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-60a06910-c2cb-456a-9e13-ada5b7bd01ce tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:49.484880 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-60a06910-c2cb-456a-9e13-ada5b7bd01ce tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:49.495277 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-60a06910-c2cb-456a-9e13-ada5b7bd01ce tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1526 microversion: 2.1 time: 0.850468 Aug 27 03:06:49.501474 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2447/4845] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:48 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1526 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:50.517361 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-2649de9d-8525-47f0-b7ac-9ed743a3ad05 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:50.519145 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-2649de9d-8525-47f0-b7ac-9ed743a3ad05 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:50.529263 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2649de9d-8525-47f0-b7ac-9ed743a3ad05 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:50.534495 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2649de9d-8525-47f0-b7ac-9ed743a3ad05 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:50.536064 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2649de9d-8525-47f0-b7ac-9ed743a3ad05 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:50.538268 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2649de9d-8525-47f0-b7ac-9ed743a3ad05 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:50.542664 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2649de9d-8525-47f0-b7ac-9ed743a3ad05 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:50.544834 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2649de9d-8525-47f0-b7ac-9ed743a3ad05 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:50.987114 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-2649de9d-8525-47f0-b7ac-9ed743a3ad05 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:51.004207 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-2649de9d-8525-47f0-b7ac-9ed743a3ad05 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1526 microversion: 2.1 time: 0.488460 Aug 27 03:06:51.007975 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2448/4846] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:50 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1526 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:52.026218 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0b7f5599-cbf5-4558-9feb-780719176e93 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:52.026953 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-0b7f5599-cbf5-4558-9feb-780719176e93 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:52.048710 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0b7f5599-cbf5-4558-9feb-780719176e93 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:52.052904 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0b7f5599-cbf5-4558-9feb-780719176e93 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:52.053595 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0b7f5599-cbf5-4558-9feb-780719176e93 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:52.054522 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0b7f5599-cbf5-4558-9feb-780719176e93 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:52.055792 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0b7f5599-cbf5-4558-9feb-780719176e93 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:52.058575 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0b7f5599-cbf5-4558-9feb-780719176e93 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:53.000661 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-0b7f5599-cbf5-4558-9feb-780719176e93 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:53.014180 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-0b7f5599-cbf5-4558-9feb-780719176e93 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1526 microversion: 2.1 time: 0.991731 Aug 27 03:06:53.015497 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2449/4847] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:52 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1526 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:53.025477 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b1c3d707-35a8-4379-8176-2f37a148fc53 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:53.026255 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b1c3d707-35a8-4379-8176-2f37a148fc53 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: ecbf3ab5-9736-491e-b120-6a30d40bc328] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:53.034421 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b1c3d707-35a8-4379-8176-2f37a148fc53 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:53.035144 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b1c3d707-35a8-4379-8176-2f37a148fc53 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:53.036042 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b1c3d707-35a8-4379-8176-2f37a148fc53 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:53.036927 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b1c3d707-35a8-4379-8176-2f37a148fc53 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:53.037602 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b1c3d707-35a8-4379-8176-2f37a148fc53 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:53.038368 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b1c3d707-35a8-4379-8176-2f37a148fc53 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:53.085039 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b1c3d707-35a8-4379-8176-2f37a148fc53 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: ecbf3ab5-9736-491e-b120-6a30d40bc328] Going to try to terminate instance {{(pid=134051) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:06:53.233176 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b1c3d707-35a8-4379-8176-2f37a148fc53 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "DELETE /compute/v2.1/servers/ecbf3ab5-9736-491e-b120-6a30d40bc328" status: 204 len: 0 microversion: 2.1 time: 0.214916 Aug 27 03:06:53.234809 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2450/4848] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 03:06:53 2022] DELETE /compute/v2.1/servers/ecbf3ab5-9736-491e-b120-6a30d40bc328 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:06:53.265019 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-2f162069-801a-4c91-8dfa-9e52665c5bfe tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:53.265883 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-2f162069-801a-4c91-8dfa-9e52665c5bfe tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: ecbf3ab5-9736-491e-b120-6a30d40bc328] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:53.289053 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2f162069-801a-4c91-8dfa-9e52665c5bfe tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:53.302111 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2f162069-801a-4c91-8dfa-9e52665c5bfe tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:53.305632 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2f162069-801a-4c91-8dfa-9e52665c5bfe tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:53.306453 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2f162069-801a-4c91-8dfa-9e52665c5bfe tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:53.310431 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2f162069-801a-4c91-8dfa-9e52665c5bfe tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:53.313728 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2f162069-801a-4c91-8dfa-9e52665c5bfe tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:53.330441 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.network.neutron [None req-ab4de74b-48db-4791-a666-f79d9a077ee3 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] validate_networks() for [('8521d297-b625-4a0b-9a27-8f0bb47922bd', None, None, None, None, None)] {{(pid=134052) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:06:53.724438 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-2f162069-801a-4c91-8dfa-9e52665c5bfe tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36697e722bef4a33ab158e9b2f87596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4ca527ba3b49539b528ec8950aef78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:53.733801 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-2f162069-801a-4c91-8dfa-9e52665c5bfe tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "GET /compute/v2.1/servers/ecbf3ab5-9736-491e-b120-6a30d40bc328" status: 200 len: 1508 microversion: 2.1 time: 0.493596 Aug 27 03:06:53.749079 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2451/4849] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:53 2022] GET /compute/v2.1/servers/ecbf3ab5-9736-491e-b120-6a30d40bc328 => generated 1508 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:54.036263 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-dac0f77f-2c87-4329-9457-2d5c7379637d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:54.036945 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-dac0f77f-2c87-4329-9457-2d5c7379637d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:54.048990 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dac0f77f-2c87-4329-9457-2d5c7379637d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:54.054859 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dac0f77f-2c87-4329-9457-2d5c7379637d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:54.061081 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dac0f77f-2c87-4329-9457-2d5c7379637d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:54.062987 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dac0f77f-2c87-4329-9457-2d5c7379637d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:54.064536 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dac0f77f-2c87-4329-9457-2d5c7379637d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:54.065724 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dac0f77f-2c87-4329-9457-2d5c7379637d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:54.566619 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-dac0f77f-2c87-4329-9457-2d5c7379637d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:54.590733 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-dac0f77f-2c87-4329-9457-2d5c7379637d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1526 microversion: 2.1 time: 0.556281 Aug 27 03:06:54.604621 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2452/4850] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:54 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1526 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:06:54.664894 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-ab4de74b-48db-4791-a666-f79d9a077ee3 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Flavor limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:06:54.665519 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-ab4de74b-48db-4791-a666-f79d9a077ee3 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Image limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:06:54.666011 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-ab4de74b-48db-4791-a666-f79d9a077ee3 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Flavor pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:06:54.666472 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-ab4de74b-48db-4791-a666-f79d9a077ee3 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Image pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:06:54.667070 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-ab4de74b-48db-4791-a666-f79d9a077ee3 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:06:54.717250 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ab4de74b-48db-4791-a666-f79d9a077ee3 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:54.717977 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ab4de74b-48db-4791-a666-f79d9a077ee3 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:54.722774 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ab4de74b-48db-4791-a666-f79d9a077ee3 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:54.725465 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ab4de74b-48db-4791-a666-f79d9a077ee3 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:54.734039 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ab4de74b-48db-4791-a666-f79d9a077ee3 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:54.738037 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ab4de74b-48db-4791-a666-f79d9a077ee3 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:54.762025 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-da1273c1-a92e-4d31-8d87-6dce74c2ef06 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:54.762966 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-da1273c1-a92e-4d31-8d87-6dce74c2ef06 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: ecbf3ab5-9736-491e-b120-6a30d40bc328] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:54.785778 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-da1273c1-a92e-4d31-8d87-6dce74c2ef06 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:54.788163 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-da1273c1-a92e-4d31-8d87-6dce74c2ef06 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:54.789039 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-da1273c1-a92e-4d31-8d87-6dce74c2ef06 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:54.790088 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-da1273c1-a92e-4d31-8d87-6dce74c2ef06 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:54.793982 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-da1273c1-a92e-4d31-8d87-6dce74c2ef06 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:54.797989 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-ab4de74b-48db-4791-a666-f79d9a077ee3 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Getting quotas for project 88d58ec8819c4af9bb00a08e2ca12708. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:06:54.798162 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-da1273c1-a92e-4d31-8d87-6dce74c2ef06 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:54.810754 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-ab4de74b-48db-4791-a666-f79d9a077ee3 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Getting quotas for user 0f3f67480c8a4ab8b538d4bebfa12d47 and project 88d58ec8819c4af9bb00a08e2ca12708. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:06:54.841167 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-ab4de74b-48db-4791-a666-f79d9a077ee3 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Going to run 1 instances... {{(pid=134052) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:06:54.846918 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-ab4de74b-48db-4791-a666-f79d9a077ee3 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] [instance: 02896196-d318-4e33-b3ae-3db4b22e62b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134052) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:06:55.078739 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ab4de74b-48db-4791-a666-f79d9a077ee3 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 17.692935 Aug 27 03:06:55.080932 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2399/4851] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 03:06:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 17699 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:06:55.102341 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b51c5a65-6e54-48a8-9d4a-360afb5973c2 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:55.103307 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b51c5a65-6e54-48a8-9d4a-360afb5973c2 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] [instance: 02896196-d318-4e33-b3ae-3db4b22e62b8] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:55.190758 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-da1273c1-a92e-4d31-8d87-6dce74c2ef06 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36697e722bef4a33ab158e9b2f87596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4ca527ba3b49539b528ec8950aef78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:55.208426 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-da1273c1-a92e-4d31-8d87-6dce74c2ef06 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "GET /compute/v2.1/servers/ecbf3ab5-9736-491e-b120-6a30d40bc328" status: 200 len: 1508 microversion: 2.1 time: 0.446612 Aug 27 03:06:55.209696 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2453/4852] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:54 2022] GET /compute/v2.1/servers/ecbf3ab5-9736-491e-b120-6a30d40bc328 => generated 1508 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:06:55.254761 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b51c5a65-6e54-48a8-9d4a-360afb5973c2 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3f67480c8a4ab8b538d4bebfa12d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d58ec8819c4af9bb00a08e2ca12708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:55.263806 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b51c5a65-6e54-48a8-9d4a-360afb5973c2 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] 10.222.0.70 "GET /compute/v2.1/servers/02896196-d318-4e33-b3ae-3db4b22e62b8" status: 200 len: 1213 microversion: 2.1 time: 0.175926 Aug 27 03:06:55.272448 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2400/4853] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:55 2022] GET /compute/v2.1/servers/02896196-d318-4e33-b3ae-3db4b22e62b8 => generated 1213 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:55.620058 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8f6331b1-6b56-448b-926b-d221e836ccae tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:55.620968 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-8f6331b1-6b56-448b-926b-d221e836ccae tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:55.623071 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:06:55.640539 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8f6331b1-6b56-448b-926b-d221e836ccae tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:55.641740 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8f6331b1-6b56-448b-926b-d221e836ccae tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:55.642655 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8f6331b1-6b56-448b-926b-d221e836ccae tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:55.646407 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8f6331b1-6b56-448b-926b-d221e836ccae tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:55.647423 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8f6331b1-6b56-448b-926b-d221e836ccae tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:55.647884 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8f6331b1-6b56-448b-926b-d221e836ccae tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:56.232032 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-52273596-d16a-4644-8de4-061fae3ee62d tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:56.232746 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-52273596-d16a-4644-8de4-061fae3ee62d tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: ecbf3ab5-9736-491e-b120-6a30d40bc328] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:56.255184 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-8f6331b1-6b56-448b-926b-d221e836ccae tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:56.257580 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-52273596-d16a-4644-8de4-061fae3ee62d tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:56.258091 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-52273596-d16a-4644-8de4-061fae3ee62d tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:56.258541 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-52273596-d16a-4644-8de4-061fae3ee62d tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:56.259260 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-52273596-d16a-4644-8de4-061fae3ee62d tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:56.270713 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-8f6331b1-6b56-448b-926b-d221e836ccae tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1526 microversion: 2.1 time: 0.656048 Aug 27 03:06:56.271570 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2454/4854] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:55 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1526 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:56.287588 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-58adc28f-a9cb-44c7-8caa-a0019219a1c8 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:56.288532 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-58adc28f-a9cb-44c7-8caa-a0019219a1c8 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] [instance: 02896196-d318-4e33-b3ae-3db4b22e62b8] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:56.299119 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-58adc28f-a9cb-44c7-8caa-a0019219a1c8 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:56.301708 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-52273596-d16a-4644-8de4-061fae3ee62d tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.042s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:56.302174 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-52273596-d16a-4644-8de4-061fae3ee62d tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:56.302626 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-58adc28f-a9cb-44c7-8caa-a0019219a1c8 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:56.303341 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-58adc28f-a9cb-44c7-8caa-a0019219a1c8 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:56.304235 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-58adc28f-a9cb-44c7-8caa-a0019219a1c8 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:56.307136 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-58adc28f-a9cb-44c7-8caa-a0019219a1c8 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:56.307742 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-58adc28f-a9cb-44c7-8caa-a0019219a1c8 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:56.506892 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-58adc28f-a9cb-44c7-8caa-a0019219a1c8 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3f67480c8a4ab8b538d4bebfa12d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d58ec8819c4af9bb00a08e2ca12708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:56.517913 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-58adc28f-a9cb-44c7-8caa-a0019219a1c8 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] 10.222.0.70 "GET /compute/v2.1/servers/02896196-d318-4e33-b3ae-3db4b22e62b8" status: 200 len: 1209 microversion: 2.1 time: 0.234259 Aug 27 03:06:56.523223 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2455/4855] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:56 2022] GET /compute/v2.1/servers/02896196-d318-4e33-b3ae-3db4b22e62b8 => generated 1209 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:06:56.891249 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-52273596-d16a-4644-8de4-061fae3ee62d tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36697e722bef4a33ab158e9b2f87596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4ca527ba3b49539b528ec8950aef78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:56.901211 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-52273596-d16a-4644-8de4-061fae3ee62d tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "GET /compute/v2.1/servers/ecbf3ab5-9736-491e-b120-6a30d40bc328" status: 200 len: 1508 microversion: 2.1 time: 0.674011 Aug 27 03:06:56.901800 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2401/4856] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:56 2022] GET /compute/v2.1/servers/ecbf3ab5-9736-491e-b120-6a30d40bc328 => generated 1508 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:57.299227 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e9b661b9-49a4-4ed0-be21-e94953630dc8 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:57.299624 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-e9b661b9-49a4-4ed0-be21-e94953630dc8 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:57.309166 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e9b661b9-49a4-4ed0-be21-e94953630dc8 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:57.309955 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e9b661b9-49a4-4ed0-be21-e94953630dc8 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:57.317120 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e9b661b9-49a4-4ed0-be21-e94953630dc8 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:57.322614 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e9b661b9-49a4-4ed0-be21-e94953630dc8 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:57.323364 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e9b661b9-49a4-4ed0-be21-e94953630dc8 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:57.323957 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e9b661b9-49a4-4ed0-be21-e94953630dc8 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:57.547251 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4ffb0380-e096-48c6-bcc5-72afba8bd780 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:57.549895 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-4ffb0380-e096-48c6-bcc5-72afba8bd780 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] [instance: 02896196-d318-4e33-b3ae-3db4b22e62b8] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:57.569838 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4ffb0380-e096-48c6-bcc5-72afba8bd780 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:57.572003 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4ffb0380-e096-48c6-bcc5-72afba8bd780 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:57.574374 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4ffb0380-e096-48c6-bcc5-72afba8bd780 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:57.575352 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4ffb0380-e096-48c6-bcc5-72afba8bd780 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:57.576855 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4ffb0380-e096-48c6-bcc5-72afba8bd780 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:57.578523 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4ffb0380-e096-48c6-bcc5-72afba8bd780 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:58.210771 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-4ffb0380-e096-48c6-bcc5-72afba8bd780 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3f67480c8a4ab8b538d4bebfa12d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d58ec8819c4af9bb00a08e2ca12708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:58.219249 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-4ffb0380-e096-48c6-bcc5-72afba8bd780 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] 10.222.0.70 "GET /compute/v2.1/servers/02896196-d318-4e33-b3ae-3db4b22e62b8" status: 200 len: 1271 microversion: 2.1 time: 0.679871 Aug 27 03:06:58.229973 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2402/4857] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:57 2022] GET /compute/v2.1/servers/02896196-d318-4e33-b3ae-3db4b22e62b8 => generated 1271 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:58.248425 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-ec7503fb-b7f8-4269-b1e4-16f35592ea6f req-4cd15439-1162-4463-9814-0853cce87b91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecbf3ab5-9736-491e-b120-6a30d40bc328", "name": "network-vif-deleted", "tag": "fe8e4bb9-146c-466a-a5e4-473027c2de5d"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:06:58.296980 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-ec7503fb-b7f8-4269-b1e4-16f35592ea6f req-4cd15439-1162-4463-9814-0853cce87b91 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:58.297621 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-ec7503fb-b7f8-4269-b1e4-16f35592ea6f req-4cd15439-1162-4463-9814-0853cce87b91 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:58.298157 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-ec7503fb-b7f8-4269-b1e4-16f35592ea6f req-4cd15439-1162-4463-9814-0853cce87b91 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:58.354007 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-ec7503fb-b7f8-4269-b1e4-16f35592ea6f req-4cd15439-1162-4463-9814-0853cce87b91 service nova] Creating event network-vif-deleted:fe8e4bb9-146c-466a-a5e4-473027c2de5d for instance ecbf3ab5-9736-491e-b120-6a30d40bc328 on n-h2-852278-4 Aug 27 03:06:58.411590 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-ec7503fb-b7f8-4269-b1e4-16f35592ea6f req-4cd15439-1162-4463-9814-0853cce87b91 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.178239 Aug 27 03:06:58.412751 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2403/4858] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:06:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:06:58.420673 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9fb5b784-b541-4001-b214-ffc75448de51 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:58.421595 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-9fb5b784-b541-4001-b214-ffc75448de51 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: ecbf3ab5-9736-491e-b120-6a30d40bc328] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:58.443361 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9fb5b784-b541-4001-b214-ffc75448de51 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:58.444387 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9fb5b784-b541-4001-b214-ffc75448de51 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:58.445003 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9fb5b784-b541-4001-b214-ffc75448de51 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:58.446180 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9fb5b784-b541-4001-b214-ffc75448de51 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:58.447410 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9fb5b784-b541-4001-b214-ffc75448de51 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:58.447993 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9fb5b784-b541-4001-b214-ffc75448de51 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:58.549978 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9fb5b784-b541-4001-b214-ffc75448de51 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:58.551218 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9fb5b784-b541-4001-b214-ffc75448de51 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:58.551958 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9fb5b784-b541-4001-b214-ffc75448de51 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:58.553653 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.instance [None req-9fb5b784-b541-4001-b214-ffc75448de51 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lazy-loading 'fault' on Instance uuid ecbf3ab5-9736-491e-b120-6a30d40bc328 {{(pid=134052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:06:58.646443 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e9b661b9-49a4-4ed0-be21-e94953630dc8 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:58.656494 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e9b661b9-49a4-4ed0-be21-e94953630dc8 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1526 microversion: 2.1 time: 1.365175 Aug 27 03:06:58.663205 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2456/4859] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:57 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1526 bytes in 1373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:58.723046 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-9fb5b784-b541-4001-b214-ffc75448de51 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36697e722bef4a33ab158e9b2f87596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4ca527ba3b49539b528ec8950aef78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:58.730769 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9fb5b784-b541-4001-b214-ffc75448de51 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "GET /compute/v2.1/servers/ecbf3ab5-9736-491e-b120-6a30d40bc328" status: 200 len: 1312 microversion: 2.1 time: 0.316617 Aug 27 03:06:58.731386 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2404/4860] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:58 2022] GET /compute/v2.1/servers/ecbf3ab5-9736-491e-b120-6a30d40bc328 => generated 1312 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:59.249345 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7c64c3a3-fa7c-4f75-b246-a041b315f69c tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:59.250189 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-7c64c3a3-fa7c-4f75-b246-a041b315f69c tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] [instance: 02896196-d318-4e33-b3ae-3db4b22e62b8] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:59.266368 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7c64c3a3-fa7c-4f75-b246-a041b315f69c tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:59.266882 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7c64c3a3-fa7c-4f75-b246-a041b315f69c tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:59.267329 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7c64c3a3-fa7c-4f75-b246-a041b315f69c tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:59.268076 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7c64c3a3-fa7c-4f75-b246-a041b315f69c tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:59.268559 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7c64c3a3-fa7c-4f75-b246-a041b315f69c tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:59.268993 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7c64c3a3-fa7c-4f75-b246-a041b315f69c tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:59.579434 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-7c64c3a3-fa7c-4f75-b246-a041b315f69c tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3f67480c8a4ab8b538d4bebfa12d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d58ec8819c4af9bb00a08e2ca12708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:59.593951 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-7c64c3a3-fa7c-4f75-b246-a041b315f69c tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] 10.222.0.70 "GET /compute/v2.1/servers/02896196-d318-4e33-b3ae-3db4b22e62b8" status: 200 len: 1271 microversion: 2.1 time: 0.347463 Aug 27 03:06:59.595803 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2457/4861] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:59 2022] GET /compute/v2.1/servers/02896196-d318-4e33-b3ae-3db4b22e62b8 => generated 1271 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:59.687985 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ce91d420-241e-467e-9f50-211073d53396 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:59.689455 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-ce91d420-241e-467e-9f50-211073d53396 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:59.698925 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ce91d420-241e-467e-9f50-211073d53396 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:59.699647 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ce91d420-241e-467e-9f50-211073d53396 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:59.700302 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ce91d420-241e-467e-9f50-211073d53396 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:59.701687 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ce91d420-241e-467e-9f50-211073d53396 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:59.702766 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ce91d420-241e-467e-9f50-211073d53396 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:59.703335 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ce91d420-241e-467e-9f50-211073d53396 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:59.759904 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b49fa34d-1f4b-4a18-b598-fa7d62323511 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:59.761515 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b49fa34d-1f4b-4a18-b598-fa7d62323511 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: ecbf3ab5-9736-491e-b120-6a30d40bc328] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:59.770396 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b49fa34d-1f4b-4a18-b598-fa7d62323511 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:59.771184 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b49fa34d-1f4b-4a18-b598-fa7d62323511 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:59.771769 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b49fa34d-1f4b-4a18-b598-fa7d62323511 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:59.772730 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b49fa34d-1f4b-4a18-b598-fa7d62323511 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:59.773323 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b49fa34d-1f4b-4a18-b598-fa7d62323511 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:59.773891 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b49fa34d-1f4b-4a18-b598-fa7d62323511 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:59.777515 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:06:59.803352 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-b49fa34d-1f4b-4a18-b598-fa7d62323511 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] HTTP exception thrown: Instance ecbf3ab5-9736-491e-b120-6a30d40bc328 could not be found. Aug 27 03:06:59.822626 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b49fa34d-1f4b-4a18-b598-fa7d62323511 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Request method failure captured: Aug 27 03:06:59.822626 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/ecbf3ab5-9736-491e-b120-6a30d40bc328 HTTP/1.1 Aug 27 03:06:59.822626 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 03:06:59.822626 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 03:06:59.822626 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 03:06:59.822626 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 03:06:59.822626 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 03:06:59.822626 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 03:06:59.822626 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 03:06:59.822626 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 03:06:59.822626 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYlCR9c_onisOtljFF_OKffaCMw1fqcK8AqJdNG9qzhexbiOAQUtNy-3x5VJrEQxLYuHD403zeJPmdfi74lzmVkRKznv6JROTBAXqcugDUkBzjF_9CFKpQVmUlF9UkBSehtKOGnnrCFpHwE0Yb7XTVGDotoY0qf8klSZfatljLqnj-Y Aug 27 03:06:59.822626 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 03:06:59.822626 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 03:06:59.822626 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 03:06:59.822626 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 03:06:59.822626 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 03:06:59.822626 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 03:06:59.822626 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 1b4ca527ba3b49539b528ec8950aef78 Aug 27 03:06:59.822626 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1447006165 Aug 27 03:06:59.822626 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 03:06:59.822626 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 03:06:59.822626 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/1b4ca527ba3b49539b528ec8950aef78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_1b4ca527ba3b49539b528ec8950aef78", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/1b4ca527ba3b49539b528ec8950aef78"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/1b4ca527ba3b49539b528ec8950aef78"}]}] Aug 27 03:06:59.822626 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1447006165 Aug 27 03:06:59.822626 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 1b4ca527ba3b49539b528ec8950aef78 Aug 27 03:06:59.822626 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1447006165 Aug 27 03:06:59.822626 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ServerRescueNegativeTestJSON-1447006165-project Aug 27 03:06:59.822626 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 03:06:59.822626 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 03:06:59.822626 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 36697e722bef4a33ab158e9b2f87596a Aug 27 03:06:59.822626 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1447006165-project Aug 27 03:06:59.822626 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 03:06:59.822626 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance ecbf3ab5-9736-491e-b120-6a30d40bc328 could not be found. Aug 27 03:06:59.822626 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': 'ecbf3ab5-9736-491e-b120-6a30d40bc328'} Aug 27 03:06:59.822626 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:06:59.822626 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:59.822626 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:06:59.822626 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:06:59.822626 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:06:59.822626 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:06:59.822626 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:06:59.822626 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:06:59.822626 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:06:59.822626 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:06:59.822626 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ecbf3ab5-9736-491e-b120-6a30d40bc328 could not be found. Aug 27 03:06:59.822626 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:59.822626 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:06:59.822626 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:59.822626 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:59.822626 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:06:59.822626 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:06:59.822626 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:06:59.822626 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:06:59.822626 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:06:59.822626 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:06:59.822626 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:06:59.822626 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:06:59.822626 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:06:59.822626 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:06:59.822626 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:06:59.822626 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:06:59.822626 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ecbf3ab5-9736-491e-b120-6a30d40bc328 could not be found. Aug 27 03:06:59.822626 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:59.822626 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:06:59.826834 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:59.826834 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:59.826834 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:06:59.826834 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:06:59.826834 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:06:59.826834 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:06:59.826834 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ecbf3ab5-9736-491e-b120-6a30d40bc328 could not be found. Aug 27 03:06:59.826834 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:06:59.826834 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b49fa34d-1f4b-4a18-b598-fa7d62323511 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Returning 404 to user: Instance ecbf3ab5-9736-491e-b120-6a30d40bc328 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:06:59.826834 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b49fa34d-1f4b-4a18-b598-fa7d62323511 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "GET /compute/v2.1/servers/ecbf3ab5-9736-491e-b120-6a30d40bc328" status: 404 len: 111 microversion: 2.1 time: 0.077209 Aug 27 03:06:59.834687 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2458/4862] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:59 2022] GET /compute/v2.1/servers/ecbf3ab5-9736-491e-b120-6a30d40bc328 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 03:06:59.843175 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8ecb014e-df92-40ff-844f-37f7e0e6ad34 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:59.843682 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-8ecb014e-df92-40ff-844f-37f7e0e6ad34 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: f09bcfaf-4282-4434-8bb8-6dda7b337ae5] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:59.887126 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8ecb014e-df92-40ff-844f-37f7e0e6ad34 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:59.887647 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8ecb014e-df92-40ff-844f-37f7e0e6ad34 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:59.888100 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8ecb014e-df92-40ff-844f-37f7e0e6ad34 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:59.888931 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8ecb014e-df92-40ff-844f-37f7e0e6ad34 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:59.889397 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8ecb014e-df92-40ff-844f-37f7e0e6ad34 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:59.889831 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8ecb014e-df92-40ff-844f-37f7e0e6ad34 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:59.995974 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-8ecb014e-df92-40ff-844f-37f7e0e6ad34 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: f09bcfaf-4282-4434-8bb8-6dda7b337ae5] Going to try to terminate instance {{(pid=134051) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:07:00.340457 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-8ecb014e-df92-40ff-844f-37f7e0e6ad34 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "DELETE /compute/v2.1/servers/f09bcfaf-4282-4434-8bb8-6dda7b337ae5" status: 204 len: 0 microversion: 2.1 time: 0.500422 Aug 27 03:07:00.347207 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2459/4863] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 03:06:59 2022] DELETE /compute/v2.1/servers/f09bcfaf-4282-4434-8bb8-6dda7b337ae5 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:07:00.376003 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f860f2db-df6b-474c-9603-e9d2f6d3a5d5 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:00.379717 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-f860f2db-df6b-474c-9603-e9d2f6d3a5d5 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: f09bcfaf-4282-4434-8bb8-6dda7b337ae5] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:00.397684 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f860f2db-df6b-474c-9603-e9d2f6d3a5d5 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:00.398696 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f860f2db-df6b-474c-9603-e9d2f6d3a5d5 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:00.401735 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f860f2db-df6b-474c-9603-e9d2f6d3a5d5 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:00.405198 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f860f2db-df6b-474c-9603-e9d2f6d3a5d5 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:00.406876 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f860f2db-df6b-474c-9603-e9d2f6d3a5d5 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:00.411540 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f860f2db-df6b-474c-9603-e9d2f6d3a5d5 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:01.433763 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-ce91d420-241e-467e-9f50-211073d53396 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:01.443135 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ce91d420-241e-467e-9f50-211073d53396 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1526 microversion: 2.1 time: 1.760062 Aug 27 03:07:01.448112 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2405/4864] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:59 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1526 bytes in 1769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:01.456083 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c0fb2a5c-4e94-44c2-941b-4db6d0e3ad9a tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:01.461479 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-c0fb2a5c-4e94-44c2-941b-4db6d0e3ad9a tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] [instance: 02896196-d318-4e33-b3ae-3db4b22e62b8] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:01.471752 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c0fb2a5c-4e94-44c2-941b-4db6d0e3ad9a tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:01.472248 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c0fb2a5c-4e94-44c2-941b-4db6d0e3ad9a tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:01.476859 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c0fb2a5c-4e94-44c2-941b-4db6d0e3ad9a tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:01.477618 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c0fb2a5c-4e94-44c2-941b-4db6d0e3ad9a tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:01.478085 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c0fb2a5c-4e94-44c2-941b-4db6d0e3ad9a tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:01.480469 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c0fb2a5c-4e94-44c2-941b-4db6d0e3ad9a tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:01.575694 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-f860f2db-df6b-474c-9603-e9d2f6d3a5d5 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36697e722bef4a33ab158e9b2f87596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4ca527ba3b49539b528ec8950aef78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:01.585392 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-f860f2db-df6b-474c-9603-e9d2f6d3a5d5 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "GET /compute/v2.1/servers/f09bcfaf-4282-4434-8bb8-6dda7b337ae5" status: 200 len: 1521 microversion: 2.1 time: 1.233231 Aug 27 03:07:01.597249 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2460/4865] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:00 2022] GET /compute/v2.1/servers/f09bcfaf-4282-4434-8bb8-6dda7b337ae5 => generated 1521 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:01.956894 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-c0fb2a5c-4e94-44c2-941b-4db6d0e3ad9a tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3f67480c8a4ab8b538d4bebfa12d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d58ec8819c4af9bb00a08e2ca12708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:01.966134 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c0fb2a5c-4e94-44c2-941b-4db6d0e3ad9a tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] 10.222.0.70 "GET /compute/v2.1/servers/02896196-d318-4e33-b3ae-3db4b22e62b8" status: 200 len: 1313 microversion: 2.1 time: 0.516553 Aug 27 03:07:01.972490 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2406/4866] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:01 2022] GET /compute/v2.1/servers/02896196-d318-4e33-b3ae-3db4b22e62b8 => generated 1313 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:02.468631 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-adaad80c-4d8a-4ecd-91c2-8cab3241e24d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:02.469445 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-adaad80c-4d8a-4ecd-91c2-8cab3241e24d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:02.478893 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-adaad80c-4d8a-4ecd-91c2-8cab3241e24d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:02.495105 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-adaad80c-4d8a-4ecd-91c2-8cab3241e24d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:02.499333 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-adaad80c-4d8a-4ecd-91c2-8cab3241e24d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:02.505372 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-adaad80c-4d8a-4ecd-91c2-8cab3241e24d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:02.508541 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-adaad80c-4d8a-4ecd-91c2-8cab3241e24d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:02.511604 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-adaad80c-4d8a-4ecd-91c2-8cab3241e24d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:02.622012 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-48f62a09-ced5-45f5-b3f5-8fd136c01aff tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:02.623358 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-48f62a09-ced5-45f5-b3f5-8fd136c01aff tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: f09bcfaf-4282-4434-8bb8-6dda7b337ae5] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:02.643050 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-48f62a09-ced5-45f5-b3f5-8fd136c01aff tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:02.643631 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-48f62a09-ced5-45f5-b3f5-8fd136c01aff tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:02.644189 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-48f62a09-ced5-45f5-b3f5-8fd136c01aff tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:02.645116 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-48f62a09-ced5-45f5-b3f5-8fd136c01aff tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:02.645672 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-48f62a09-ced5-45f5-b3f5-8fd136c01aff tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:02.646216 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-48f62a09-ced5-45f5-b3f5-8fd136c01aff tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:03.027491 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-adaad80c-4d8a-4ecd-91c2-8cab3241e24d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:03.047795 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-adaad80c-4d8a-4ecd-91c2-8cab3241e24d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1526 microversion: 2.1 time: 0.583136 Aug 27 03:07:03.048719 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2461/4867] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:02 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1526 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:03.068040 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-5ea1fc9c-68dc-4f9f-ae0d-8971918ffd90 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:03.071731 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-5ea1fc9c-68dc-4f9f-ae0d-8971918ffd90 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] [instance: 02896196-d318-4e33-b3ae-3db4b22e62b8] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:03.094403 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5ea1fc9c-68dc-4f9f-ae0d-8971918ffd90 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:03.096122 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5ea1fc9c-68dc-4f9f-ae0d-8971918ffd90 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:03.100487 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5ea1fc9c-68dc-4f9f-ae0d-8971918ffd90 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:03.113425 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5ea1fc9c-68dc-4f9f-ae0d-8971918ffd90 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:03.113928 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5ea1fc9c-68dc-4f9f-ae0d-8971918ffd90 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:03.114397 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5ea1fc9c-68dc-4f9f-ae0d-8971918ffd90 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:03.215640 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-48f62a09-ced5-45f5-b3f5-8fd136c01aff tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36697e722bef4a33ab158e9b2f87596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4ca527ba3b49539b528ec8950aef78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:03.228355 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-48f62a09-ced5-45f5-b3f5-8fd136c01aff tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "GET /compute/v2.1/servers/f09bcfaf-4282-4434-8bb8-6dda7b337ae5" status: 200 len: 1521 microversion: 2.1 time: 0.605869 Aug 27 03:07:03.229221 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2407/4868] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:02 2022] GET /compute/v2.1/servers/f09bcfaf-4282-4434-8bb8-6dda7b337ae5 => generated 1521 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:03.694404 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-5ea1fc9c-68dc-4f9f-ae0d-8971918ffd90 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3f67480c8a4ab8b538d4bebfa12d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d58ec8819c4af9bb00a08e2ca12708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:03.714869 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-5ea1fc9c-68dc-4f9f-ae0d-8971918ffd90 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] 10.222.0.70 "GET /compute/v2.1/servers/02896196-d318-4e33-b3ae-3db4b22e62b8" status: 200 len: 1313 microversion: 2.1 time: 0.664304 Aug 27 03:07:03.729467 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2462/4869] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:03 2022] GET /compute/v2.1/servers/02896196-d318-4e33-b3ae-3db4b22e62b8 => generated 1313 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:04.071195 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-420dd8fd-3aa5-43c7-ad9d-bd592b0754cb tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:04.072487 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-420dd8fd-3aa5-43c7-ad9d-bd592b0754cb tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:04.086013 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-420dd8fd-3aa5-43c7-ad9d-bd592b0754cb tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:04.089518 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-420dd8fd-3aa5-43c7-ad9d-bd592b0754cb tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:04.091344 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-420dd8fd-3aa5-43c7-ad9d-bd592b0754cb tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:04.093763 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-420dd8fd-3aa5-43c7-ad9d-bd592b0754cb tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:04.094424 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-420dd8fd-3aa5-43c7-ad9d-bd592b0754cb tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:04.099379 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-420dd8fd-3aa5-43c7-ad9d-bd592b0754cb tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:04.360800 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-99ad9caf-7f6f-4140-9255-12dfcb07836a tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-1715594196", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "networks": [{"uuid": "889261c3-8612-4010-b4d2-acb4793130eb"}]}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:07:04.443231 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.network.neutron [None req-99ad9caf-7f6f-4140-9255-12dfcb07836a tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] validate_networks() for [('889261c3-8612-4010-b4d2-acb4793130eb', None, None, None, None, None)] {{(pid=134051) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:07:04.681168 n-d-852278-4 devstack@n-api.service[134052]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:07:04.681344 n-d-852278-4 devstack@n-api.service[134052]: Sat Aug 27 03:07:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb (ip 10.222.0.70) !!! Aug 27 03:07:04.767947 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:07:05.072356 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-420dd8fd-3aa5-43c7-ad9d-bd592b0754cb tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:05.085913 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-420dd8fd-3aa5-43c7-ad9d-bd592b0754cb tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1526 microversion: 2.1 time: 1.019220 Aug 27 03:07:05.097623 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2408/4870] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:04 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1526 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:05.103404 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0defdfc1-8a72-4082-bda0-d0cc894813f4 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:05.104025 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-0defdfc1-8a72-4082-bda0-d0cc894813f4 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: f09bcfaf-4282-4434-8bb8-6dda7b337ae5] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:05.111467 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0defdfc1-8a72-4082-bda0-d0cc894813f4 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:05.123000 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0defdfc1-8a72-4082-bda0-d0cc894813f4 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:05.123817 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0defdfc1-8a72-4082-bda0-d0cc894813f4 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:05.125471 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0defdfc1-8a72-4082-bda0-d0cc894813f4 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:05.126190 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0defdfc1-8a72-4082-bda0-d0cc894813f4 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:05.128598 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0defdfc1-8a72-4082-bda0-d0cc894813f4 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:05.259821 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=8 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:07:05.820903 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0defdfc1-8a72-4082-bda0-d0cc894813f4 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36697e722bef4a33ab158e9b2f87596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4ca527ba3b49539b528ec8950aef78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:05.837832 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-0defdfc1-8a72-4082-bda0-d0cc894813f4 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "GET /compute/v2.1/servers/f09bcfaf-4282-4434-8bb8-6dda7b337ae5" status: 200 len: 1521 microversion: 2.1 time: 0.738563 Aug 27 03:07:05.838761 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2409/4871] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:05 2022] GET /compute/v2.1/servers/f09bcfaf-4282-4434-8bb8-6dda7b337ae5 => generated 1521 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:05.845264 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a3978c31-9988-4a37-a0f2-7ceb5798645f tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:05.845794 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a3978c31-9988-4a37-a0f2-7ceb5798645f tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] [instance: 02896196-d318-4e33-b3ae-3db4b22e62b8] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:05.860108 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a3978c31-9988-4a37-a0f2-7ceb5798645f tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:05.861031 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a3978c31-9988-4a37-a0f2-7ceb5798645f tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:05.861758 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a3978c31-9988-4a37-a0f2-7ceb5798645f tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:05.862659 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a3978c31-9988-4a37-a0f2-7ceb5798645f tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:05.870012 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a3978c31-9988-4a37-a0f2-7ceb5798645f tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:05.870665 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a3978c31-9988-4a37-a0f2-7ceb5798645f tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:06.376580 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-99ad9caf-7f6f-4140-9255-12dfcb07836a tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Flavor limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:07:06.377028 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-99ad9caf-7f6f-4140-9255-12dfcb07836a tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Image limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:07:06.377442 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-99ad9caf-7f6f-4140-9255-12dfcb07836a tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Flavor pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:07:06.379120 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-99ad9caf-7f6f-4140-9255-12dfcb07836a tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Image pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:07:06.379565 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-99ad9caf-7f6f-4140-9255-12dfcb07836a tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:07:06.381883 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-a3978c31-9988-4a37-a0f2-7ceb5798645f tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3f67480c8a4ab8b538d4bebfa12d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d58ec8819c4af9bb00a08e2ca12708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:06.389257 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-99ad9caf-7f6f-4140-9255-12dfcb07836a tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:06.389981 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-99ad9caf-7f6f-4140-9255-12dfcb07836a tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:06.390820 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-99ad9caf-7f6f-4140-9255-12dfcb07836a tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:06.391725 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-99ad9caf-7f6f-4140-9255-12dfcb07836a tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:06.392509 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-99ad9caf-7f6f-4140-9255-12dfcb07836a tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:06.393105 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-99ad9caf-7f6f-4140-9255-12dfcb07836a tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:06.398389 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a3978c31-9988-4a37-a0f2-7ceb5798645f tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] 10.222.0.70 "GET /compute/v2.1/servers/02896196-d318-4e33-b3ae-3db4b22e62b8" status: 200 len: 1313 microversion: 2.1 time: 0.558388 Aug 27 03:07:06.399787 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2410/4872] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:05 2022] GET /compute/v2.1/servers/02896196-d318-4e33-b3ae-3db4b22e62b8 => generated 1313 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:06.417909 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-2959ca13-d37b-46c9-842c-4529060fb5da req-41e63d02-89a3-4493-a355-60b1dacfff6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02896196-d318-4e33-b3ae-3db4b22e62b8", "tag": "41e9dd03-84f2-460d-8f48-5112b78e9548"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:07:06.424981 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-99ad9caf-7f6f-4140-9255-12dfcb07836a tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Getting quotas for project 61112e2aab784cb9a8d84877896eb5be. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:07:06.432983 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-99ad9caf-7f6f-4140-9255-12dfcb07836a tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Getting quotas for user b5b4ba598d3d451f9adf430ceb87df01 and project 61112e2aab784cb9a8d84877896eb5be. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:07:06.436650 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-2959ca13-d37b-46c9-842c-4529060fb5da req-41e63d02-89a3-4493-a355-60b1dacfff6d service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:06.437654 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-2959ca13-d37b-46c9-842c-4529060fb5da req-41e63d02-89a3-4493-a355-60b1dacfff6d service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:06.438232 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-2959ca13-d37b-46c9-842c-4529060fb5da req-41e63d02-89a3-4493-a355-60b1dacfff6d service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:06.459911 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-2959ca13-d37b-46c9-842c-4529060fb5da req-41e63d02-89a3-4493-a355-60b1dacfff6d service nova] Creating event network-changed:41e9dd03-84f2-460d-8f48-5112b78e9548 for instance 02896196-d318-4e33-b3ae-3db4b22e62b8 on n-h2-852278-4 Aug 27 03:07:06.466470 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-99ad9caf-7f6f-4140-9255-12dfcb07836a tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Going to run 1 instances... {{(pid=134051) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:07:06.469300 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-99ad9caf-7f6f-4140-9255-12dfcb07836a tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] [instance: d4525755-0392-4591-855c-2daf081ff9f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134051) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:07:06.470397 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-2959ca13-d37b-46c9-842c-4529060fb5da req-41e63d02-89a3-4493-a355-60b1dacfff6d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068056 Aug 27 03:07:06.471035 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2411/4873] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:07:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:07:06.477320 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b15ae38b-9e32-4e24-81a0-5c63c87602bb tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:06.478167 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b15ae38b-9e32-4e24-81a0-5c63c87602bb tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:06.487388 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b15ae38b-9e32-4e24-81a0-5c63c87602bb tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:06.488715 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b15ae38b-9e32-4e24-81a0-5c63c87602bb tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:06.489696 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b15ae38b-9e32-4e24-81a0-5c63c87602bb tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:06.493740 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b15ae38b-9e32-4e24-81a0-5c63c87602bb tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:06.494470 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b15ae38b-9e32-4e24-81a0-5c63c87602bb tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:06.495202 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b15ae38b-9e32-4e24-81a0-5c63c87602bb tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:06.548866 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-99ad9caf-7f6f-4140-9255-12dfcb07836a tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.413274 Aug 27 03:07:06.550270 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2463/4874] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 03:07:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 2415 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:07:06.560642 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8b210f41-f061-493f-b10e-36aec9fcceb7 tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:06.574711 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-8b210f41-f061-493f-b10e-36aec9fcceb7 tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] [instance: d4525755-0392-4591-855c-2daf081ff9f3] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:06.678233 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-8b210f41-f061-493f-b10e-36aec9fcceb7 tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b4ba598d3d451f9adf430ceb87df01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61112e2aab784cb9a8d84877896eb5be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:06.686019 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-8b210f41-f061-493f-b10e-36aec9fcceb7 tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] 10.222.0.70 "GET /compute/v2.1/servers/d4525755-0392-4591-855c-2daf081ff9f3" status: 200 len: 1228 microversion: 2.1 time: 0.129358 Aug 27 03:07:06.686607 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2464/4875] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:06 2022] GET /compute/v2.1/servers/d4525755-0392-4591-855c-2daf081ff9f3 => generated 1228 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:06.781843 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b15ae38b-9e32-4e24-81a0-5c63c87602bb tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:06.793990 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b15ae38b-9e32-4e24-81a0-5c63c87602bb tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1508 microversion: 2.1 time: 0.321738 Aug 27 03:07:06.794602 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2412/4876] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:06 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1508 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:06.860019 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-6485dd49-b820-4a0f-87c3-a4ee2835e6e5 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:06.860653 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-6485dd49-b820-4a0f-87c3-a4ee2835e6e5 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: f09bcfaf-4282-4434-8bb8-6dda7b337ae5] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:06.869275 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6485dd49-b820-4a0f-87c3-a4ee2835e6e5 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:06.869958 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6485dd49-b820-4a0f-87c3-a4ee2835e6e5 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:06.870553 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6485dd49-b820-4a0f-87c3-a4ee2835e6e5 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:06.871257 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6485dd49-b820-4a0f-87c3-a4ee2835e6e5 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:06.871701 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6485dd49-b820-4a0f-87c3-a4ee2835e6e5 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:06.872132 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6485dd49-b820-4a0f-87c3-a4ee2835e6e5 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:06.963867 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-6485dd49-b820-4a0f-87c3-a4ee2835e6e5 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36697e722bef4a33ab158e9b2f87596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4ca527ba3b49539b528ec8950aef78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:06.974204 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-6485dd49-b820-4a0f-87c3-a4ee2835e6e5 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "GET /compute/v2.1/servers/f09bcfaf-4282-4434-8bb8-6dda7b337ae5" status: 200 len: 1479 microversion: 2.1 time: 0.119052 Aug 27 03:07:06.975212 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2465/4877] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:06 2022] GET /compute/v2.1/servers/f09bcfaf-4282-4434-8bb8-6dda7b337ae5 => generated 1479 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:07.419451 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0fab9394-7730-411e-8e10-cdb53616eb4c tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:07.420123 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-0fab9394-7730-411e-8e10-cdb53616eb4c tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] [instance: 02896196-d318-4e33-b3ae-3db4b22e62b8] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:07.430861 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0fab9394-7730-411e-8e10-cdb53616eb4c tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:07.439033 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0fab9394-7730-411e-8e10-cdb53616eb4c tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:07.439551 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0fab9394-7730-411e-8e10-cdb53616eb4c tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:07.440418 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0fab9394-7730-411e-8e10-cdb53616eb4c tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:07.440876 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0fab9394-7730-411e-8e10-cdb53616eb4c tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:07.455257 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0fab9394-7730-411e-8e10-cdb53616eb4c tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:07.708451 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-14e44ece-37e5-4fa1-9c15-522bc6c4e587 tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:07.709633 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-14e44ece-37e5-4fa1-9c15-522bc6c4e587 tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] [instance: d4525755-0392-4591-855c-2daf081ff9f3] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:07.718375 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-14e44ece-37e5-4fa1-9c15-522bc6c4e587 tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:07.721538 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-14e44ece-37e5-4fa1-9c15-522bc6c4e587 tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:07.722086 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-14e44ece-37e5-4fa1-9c15-522bc6c4e587 tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:07.723817 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-14e44ece-37e5-4fa1-9c15-522bc6c4e587 tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:07.724468 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-14e44ece-37e5-4fa1-9c15-522bc6c4e587 tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:07.725792 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-14e44ece-37e5-4fa1-9c15-522bc6c4e587 tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:07.923859 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-14e44ece-37e5-4fa1-9c15-522bc6c4e587 tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b4ba598d3d451f9adf430ceb87df01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61112e2aab784cb9a8d84877896eb5be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:07.935203 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-14e44ece-37e5-4fa1-9c15-522bc6c4e587 tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] 10.222.0.70 "GET /compute/v2.1/servers/d4525755-0392-4591-855c-2daf081ff9f3" status: 200 len: 1224 microversion: 2.1 time: 0.231553 Aug 27 03:07:07.935866 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2466/4878] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:07 2022] GET /compute/v2.1/servers/d4525755-0392-4591-855c-2daf081ff9f3 => generated 1224 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:07.945994 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-eaa66f9f-0849-4dba-8110-f89b5d06981d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:07.949197 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-eaa66f9f-0849-4dba-8110-f89b5d06981d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:07.961840 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eaa66f9f-0849-4dba-8110-f89b5d06981d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:07.962369 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eaa66f9f-0849-4dba-8110-f89b5d06981d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:07.962818 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eaa66f9f-0849-4dba-8110-f89b5d06981d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:07.963630 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eaa66f9f-0849-4dba-8110-f89b5d06981d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:07.964094 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eaa66f9f-0849-4dba-8110-f89b5d06981d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:07.965145 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eaa66f9f-0849-4dba-8110-f89b5d06981d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:08.100299 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0fab9394-7730-411e-8e10-cdb53616eb4c tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3f67480c8a4ab8b538d4bebfa12d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d58ec8819c4af9bb00a08e2ca12708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:08.113162 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-0fab9394-7730-411e-8e10-cdb53616eb4c tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] 10.222.0.70 "GET /compute/v2.1/servers/02896196-d318-4e33-b3ae-3db4b22e62b8" status: 200 len: 1313 microversion: 2.1 time: 0.694873 Aug 27 03:07:08.114705 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2413/4879] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:07 2022] GET /compute/v2.1/servers/02896196-d318-4e33-b3ae-3db4b22e62b8 => generated 1313 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:08.129232 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f1df6d16-3924-4254-a025-bcc207d7e3bf tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:08.129867 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-f1df6d16-3924-4254-a025-bcc207d7e3bf tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: f09bcfaf-4282-4434-8bb8-6dda7b337ae5] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:08.155737 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f1df6d16-3924-4254-a025-bcc207d7e3bf tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:08.158342 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f1df6d16-3924-4254-a025-bcc207d7e3bf tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:08.159002 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f1df6d16-3924-4254-a025-bcc207d7e3bf tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:08.159901 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f1df6d16-3924-4254-a025-bcc207d7e3bf tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:08.162225 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f1df6d16-3924-4254-a025-bcc207d7e3bf tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:08.162829 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f1df6d16-3924-4254-a025-bcc207d7e3bf tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:08.262496 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f1df6d16-3924-4254-a025-bcc207d7e3bf tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:08.263670 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f1df6d16-3924-4254-a025-bcc207d7e3bf tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:08.264121 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f1df6d16-3924-4254-a025-bcc207d7e3bf tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:08.264607 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.instance [None req-f1df6d16-3924-4254-a025-bcc207d7e3bf tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lazy-loading 'fault' on Instance uuid f09bcfaf-4282-4434-8bb8-6dda7b337ae5 {{(pid=134052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:07:08.500196 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-f1df6d16-3924-4254-a025-bcc207d7e3bf tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36697e722bef4a33ab158e9b2f87596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4ca527ba3b49539b528ec8950aef78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:08.508221 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f1df6d16-3924-4254-a025-bcc207d7e3bf tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "GET /compute/v2.1/servers/f09bcfaf-4282-4434-8bb8-6dda7b337ae5" status: 200 len: 1311 microversion: 2.1 time: 0.392370 Aug 27 03:07:08.512842 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2414/4880] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:08 2022] GET /compute/v2.1/servers/f09bcfaf-4282-4434-8bb8-6dda7b337ae5 => generated 1311 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:08.539865 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-4956bc5b-ad90-4ee6-bf4f-0ba1ea4bfa3d req-d03bd15f-6c34-450d-bd73-9e537a933acb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f09bcfaf-4282-4434-8bb8-6dda7b337ae5", "name": "network-vif-deleted", "tag": "222b37be-dd90-4b02-89dc-f798562315e3"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:07:08.551241 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-4956bc5b-ad90-4ee6-bf4f-0ba1ea4bfa3d req-d03bd15f-6c34-450d-bd73-9e537a933acb service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:08.551731 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-4956bc5b-ad90-4ee6-bf4f-0ba1ea4bfa3d req-d03bd15f-6c34-450d-bd73-9e537a933acb service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:08.552163 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-4956bc5b-ad90-4ee6-bf4f-0ba1ea4bfa3d req-d03bd15f-6c34-450d-bd73-9e537a933acb service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:08.553669 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-eaa66f9f-0849-4dba-8110-f89b5d06981d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:08.562063 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-eaa66f9f-0849-4dba-8110-f89b5d06981d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1511 microversion: 2.1 time: 0.622962 Aug 27 03:07:08.566279 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2467/4881] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:07 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1511 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:08.577379 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-4956bc5b-ad90-4ee6-bf4f-0ba1ea4bfa3d req-d03bd15f-6c34-450d-bd73-9e537a933acb service nova] Creating event network-vif-deleted:222b37be-dd90-4b02-89dc-f798562315e3 for instance f09bcfaf-4282-4434-8bb8-6dda7b337ae5 on n-h1-852278-4 Aug 27 03:07:08.582383 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-eb133be5-456e-4e28-bdec-7332727e6e98 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:08.583186 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-eb133be5-456e-4e28-bdec-7332727e6e98 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:08.588072 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-4956bc5b-ad90-4ee6-bf4f-0ba1ea4bfa3d req-d03bd15f-6c34-450d-bd73-9e537a933acb service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051966 Aug 27 03:07:08.589895 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eb133be5-456e-4e28-bdec-7332727e6e98 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:08.590547 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eb133be5-456e-4e28-bdec-7332727e6e98 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:08.591137 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eb133be5-456e-4e28-bdec-7332727e6e98 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:08.592061 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2415/4882] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:07:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:07:08.592331 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eb133be5-456e-4e28-bdec-7332727e6e98 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:08.592938 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eb133be5-456e-4e28-bdec-7332727e6e98 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:08.593513 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eb133be5-456e-4e28-bdec-7332727e6e98 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:08.824902 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-eb133be5-456e-4e28-bdec-7332727e6e98 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:08.837026 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-eb133be5-456e-4e28-bdec-7332727e6e98 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1451 microversion: 2.1 time: 0.256502 Aug 27 03:07:08.861004 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2468/4883] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:08 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1451 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:07:08.891917 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e29c8f84-a166-4bee-945e-c54c94959917 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:07:08.894995 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-e29c8f84-a166-4bee-945e-c54c94959917 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:08.905385 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e29c8f84-a166-4bee-945e-c54c94959917 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:08.906219 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e29c8f84-a166-4bee-945e-c54c94959917 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:08.906727 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e29c8f84-a166-4bee-945e-c54c94959917 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:08.907527 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e29c8f84-a166-4bee-945e-c54c94959917 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:08.908051 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e29c8f84-a166-4bee-945e-c54c94959917 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:08.908569 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e29c8f84-a166-4bee-945e-c54c94959917 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:08.955202 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0e769ed2-5456-4829-b9d3-10f654770ae4 tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:08.955816 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-0e769ed2-5456-4829-b9d3-10f654770ae4 tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] [instance: d4525755-0392-4591-855c-2daf081ff9f3] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:08.962838 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0e769ed2-5456-4829-b9d3-10f654770ae4 tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:08.963338 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0e769ed2-5456-4829-b9d3-10f654770ae4 tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:08.971562 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0e769ed2-5456-4829-b9d3-10f654770ae4 tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:08.972889 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0e769ed2-5456-4829-b9d3-10f654770ae4 tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:08.973111 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.instance [None req-e29c8f84-a166-4bee-945e-c54c94959917 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lazy-loading 'flavor' on Instance uuid 72ffd032-b609-4e42-90d9-5454ac648eeb {{(pid=134052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:07:08.976534 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0e769ed2-5456-4829-b9d3-10f654770ae4 tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:08.977184 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0e769ed2-5456-4829-b9d3-10f654770ae4 tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:08.999247 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-e29c8f84-a166-4bee-945e-c54c94959917 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] HTTP exception thrown: Cannot 'shelve' instance 72ffd032-b609-4e42-90d9-5454ac648eeb while it is in vm_state shelved_offloaded Aug 27 03:07:09.005361 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e29c8f84-a166-4bee-945e-c54c94959917 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Request method failure captured: Aug 27 03:07:09.005361 n-d-852278-4 devstack@n-api.service[134052]: request: POST /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb/action HTTP/1.1 Aug 27 03:07:09.005361 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 03:07:09.005361 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 03:07:09.005361 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 03:07:09.005361 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 14 Aug 27 03:07:09.005361 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 03:07:09.005361 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 03:07:09.005361 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 03:07:09.005361 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 03:07:09.005361 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYnkbLTKVFjPQ5m3U2fG0N9Vjn4DkHnl17m4V7uHpwM3jvJACULLjB_xlJxNaWj4ki5CLI0R9EDG2yAGWVsjkvndQFsX9xXnPLGqFClIfHjZt1hqpj87tFD2RLalZegHNDkz7eKDMcWIs2wG0Lp8X-uNjMToWPkkmABfSYkxwHfHBds Aug 27 03:07:09.005361 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 03:07:09.005361 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 03:07:09.005361 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 03:07:09.005361 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 03:07:09.005361 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 03:07:09.005361 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 03:07:09.005361 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 3b9e672ac89e41ff82355daa83e852bd Aug 27 03:07:09.005361 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:07:09.005361 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 03:07:09.005361 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 03:07:09.005361 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3b9e672ac89e41ff82355daa83e852bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3b9e672ac89e41ff82355daa83e852bd", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3b9e672ac89e41ff82355daa83e852bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3b9e672ac89e41ff82355daa83e852bd"}]}] Aug 27 03:07:09.005361 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:07:09.005361 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 3b9e672ac89e41ff82355daa83e852bd Aug 27 03:07:09.005361 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:07:09.005361 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ServersNegativeTestJSON-1795266674-project Aug 27 03:07:09.005361 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 03:07:09.005361 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 03:07:09.005361 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 204c90820f6d4c64b31367aaf098325c Aug 27 03:07:09.005361 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ServersNegativeTestJSON-1795266674-project Aug 27 03:07:09.005361 n-d-852278-4 devstack@n-api.service[134052]: Aug 27 03:07:09.005361 n-d-852278-4 devstack@n-api.service[134052]: {"shelve": {}} Aug 27 03:07:09.005361 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 03:07:09.005361 n-d-852278-4 devstack@n-api.service[134052]: exception: Cannot 'shelve' instance 72ffd032-b609-4e42-90d9-5454ac648eeb while it is in vm_state shelved_offloaded Aug 27 03:07:09.005361 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '72ffd032-b609-4e42-90d9-5454ac648eeb', 'body': {'shelve': {}}} Aug 27 03:07:09.005361 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:07:09.005361 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:07:09.005361 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Aug 27 03:07:09.005361 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Aug 27 03:07:09.005361 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 27 03:07:09.005361 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 27 03:07:09.005361 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Aug 27 03:07:09.005361 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 27 03:07:09.005361 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 27 03:07:09.005361 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 27 03:07:09.005361 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 03:07:09.005361 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 03:07:09.005361 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 27 03:07:09.005361 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 27 03:07:09.005361 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 72ffd032-b609-4e42-90d9-5454ac648eeb in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Aug 27 03:07:09.005361 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:07:09.005361 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:07:09.005361 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:07:09.005361 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:07:09.005361 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:07:09.005361 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:07:09.005361 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:07:09.005361 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:07:09.005361 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:07:09.005361 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:07:09.005361 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Aug 27 03:07:09.005361 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 27 03:07:09.005361 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 27 03:07:09.012582 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 27 03:07:09.012582 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 72ffd032-b609-4e42-90d9-5454ac648eeb while it is in vm_state shelved_offloaded Aug 27 03:07:09.012582 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:07:09.012582 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:07:09.012582 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:07:09.012582 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:07:09.012582 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:07:09.012582 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:07:09.012582 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:07:09.012582 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:07:09.012582 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 72ffd032-b609-4e42-90d9-5454ac648eeb while it is in vm_state shelved_offloaded Aug 27 03:07:09.012582 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:07:09.012582 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e29c8f84-a166-4bee-945e-c54c94959917 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Returning 409 to user: Cannot 'shelve' instance 72ffd032-b609-4e42-90d9-5454ac648eeb while it is in vm_state shelved_offloaded {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:07:09.012582 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e29c8f84-a166-4bee-945e-c54c94959917 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "POST /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb/action" status: 409 len: 155 microversion: 2.1 time: 0.119371 Aug 27 03:07:09.012582 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2416/4884] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:07:08 2022] POST /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb/action => generated 155 bytes in 125 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 27 03:07:09.025639 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a26a8c2e-e53e-402a-b206-e503c25ad655 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:07:09.027391 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a26a8c2e-e53e-402a-b206-e503c25ad655 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:09.044839 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a26a8c2e-e53e-402a-b206-e503c25ad655 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:09.045425 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a26a8c2e-e53e-402a-b206-e503c25ad655 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:09.045872 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a26a8c2e-e53e-402a-b206-e503c25ad655 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:09.047664 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a26a8c2e-e53e-402a-b206-e503c25ad655 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:09.048279 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a26a8c2e-e53e-402a-b206-e503c25ad655 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:09.048868 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a26a8c2e-e53e-402a-b206-e503c25ad655 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:09.124158 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-0e769ed2-5456-4829-b9d3-10f654770ae4 tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b4ba598d3d451f9adf430ceb87df01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61112e2aab784cb9a8d84877896eb5be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:09.132650 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-0e769ed2-5456-4829-b9d3-10f654770ae4 tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] 10.222.0.70 "GET /compute/v2.1/servers/d4525755-0392-4591-855c-2daf081ff9f3" status: 200 len: 1288 microversion: 2.1 time: 0.181230 Aug 27 03:07:09.138062 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2469/4885] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:08 2022] GET /compute/v2.1/servers/d4525755-0392-4591-855c-2daf081ff9f3 => generated 1288 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:09.151671 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ce8df92b-a8bc-42cd-89e7-d497633db66d tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:09.152594 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-ce8df92b-a8bc-42cd-89e7-d497633db66d tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] [instance: 02896196-d318-4e33-b3ae-3db4b22e62b8] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:09.166697 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a26a8c2e-e53e-402a-b206-e503c25ad655 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=134052) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 27 03:07:09.167675 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ce8df92b-a8bc-42cd-89e7-d497633db66d tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:09.168437 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ce8df92b-a8bc-42cd-89e7-d497633db66d tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:09.168878 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ce8df92b-a8bc-42cd-89e7-d497633db66d tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:09.170086 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ce8df92b-a8bc-42cd-89e7-d497633db66d tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:09.173034 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ce8df92b-a8bc-42cd-89e7-d497633db66d tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:09.173663 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ce8df92b-a8bc-42cd-89e7-d497633db66d tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:09.247078 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:07:09.277788 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a26a8c2e-e53e-402a-b206-e503c25ad655 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "POST /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb/action" status: 202 len: 0 microversion: 2.1 time: 0.261965 Aug 27 03:07:09.279044 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2417/4886] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:07:09 2022] POST /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb/action => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:07:09.289078 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c74f9ede-efc4-4c92-96ee-392a87ce9098 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:09.289960 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-c74f9ede-efc4-4c92-96ee-392a87ce9098 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:09.298603 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c74f9ede-efc4-4c92-96ee-392a87ce9098 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:09.299286 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c74f9ede-efc4-4c92-96ee-392a87ce9098 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:09.300074 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c74f9ede-efc4-4c92-96ee-392a87ce9098 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:09.301323 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c74f9ede-efc4-4c92-96ee-392a87ce9098 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:09.302215 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c74f9ede-efc4-4c92-96ee-392a87ce9098 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:09.302988 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c74f9ede-efc4-4c92-96ee-392a87ce9098 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:09.452949 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-ce8df92b-a8bc-42cd-89e7-d497633db66d tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3f67480c8a4ab8b538d4bebfa12d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d58ec8819c4af9bb00a08e2ca12708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:09.462667 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ce8df92b-a8bc-42cd-89e7-d497633db66d tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] 10.222.0.70 "GET /compute/v2.1/servers/02896196-d318-4e33-b3ae-3db4b22e62b8" status: 200 len: 1313 microversion: 2.1 time: 0.320489 Aug 27 03:07:09.464549 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2470/4887] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:09 2022] GET /compute/v2.1/servers/02896196-d318-4e33-b3ae-3db4b22e62b8 => generated 1313 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:09.539313 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-17ee09b1-2d8a-4402-908c-712077fb76b9 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:09.539980 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-17ee09b1-2d8a-4402-908c-712077fb76b9 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] [instance: f09bcfaf-4282-4434-8bb8-6dda7b337ae5] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:09.562951 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-17ee09b1-2d8a-4402-908c-712077fb76b9 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:09.566404 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-17ee09b1-2d8a-4402-908c-712077fb76b9 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:09.570222 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-17ee09b1-2d8a-4402-908c-712077fb76b9 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:09.570222 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-17ee09b1-2d8a-4402-908c-712077fb76b9 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:09.570222 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-17ee09b1-2d8a-4402-908c-712077fb76b9 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:09.570222 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-17ee09b1-2d8a-4402-908c-712077fb76b9 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:09.592723 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-17ee09b1-2d8a-4402-908c-712077fb76b9 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] HTTP exception thrown: Instance f09bcfaf-4282-4434-8bb8-6dda7b337ae5 could not be found. Aug 27 03:07:09.595355 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-17ee09b1-2d8a-4402-908c-712077fb76b9 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Request method failure captured: Aug 27 03:07:09.595355 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/f09bcfaf-4282-4434-8bb8-6dda7b337ae5 HTTP/1.1 Aug 27 03:07:09.595355 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 03:07:09.595355 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 03:07:09.595355 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 03:07:09.595355 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 03:07:09.595355 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 03:07:09.595355 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 03:07:09.595355 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 03:07:09.595355 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 03:07:09.595355 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYlCR9c_onisOtljFF_OKffaCMw1fqcK8AqJdNG9qzhexbiOAQUtNy-3x5VJrEQxLYuHD403zeJPmdfi74lzmVkRKznv6JROTBAXqcugDUkBzjF_9CFKpQVmUlF9UkBSehtKOGnnrCFpHwE0Yb7XTVGDotoY0qf8klSZfatljLqnj-Y Aug 27 03:07:09.595355 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 03:07:09.595355 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 03:07:09.595355 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 03:07:09.595355 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 03:07:09.595355 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 03:07:09.595355 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 03:07:09.595355 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 1b4ca527ba3b49539b528ec8950aef78 Aug 27 03:07:09.595355 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1447006165 Aug 27 03:07:09.595355 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 03:07:09.595355 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 03:07:09.595355 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/1b4ca527ba3b49539b528ec8950aef78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_1b4ca527ba3b49539b528ec8950aef78", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/1b4ca527ba3b49539b528ec8950aef78"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/1b4ca527ba3b49539b528ec8950aef78"}]}] Aug 27 03:07:09.595355 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1447006165 Aug 27 03:07:09.595355 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 1b4ca527ba3b49539b528ec8950aef78 Aug 27 03:07:09.595355 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1447006165 Aug 27 03:07:09.595355 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ServerRescueNegativeTestJSON-1447006165-project Aug 27 03:07:09.595355 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 03:07:09.595355 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 03:07:09.595355 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 36697e722bef4a33ab158e9b2f87596a Aug 27 03:07:09.595355 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1447006165-project Aug 27 03:07:09.595355 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 03:07:09.595355 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance f09bcfaf-4282-4434-8bb8-6dda7b337ae5 could not be found. Aug 27 03:07:09.595355 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': 'f09bcfaf-4282-4434-8bb8-6dda7b337ae5'} Aug 27 03:07:09.595355 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:07:09.595355 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:07:09.595355 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:07:09.595355 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:07:09.595355 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:07:09.595355 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:07:09.595355 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:07:09.595355 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:07:09.595355 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:07:09.595355 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:07:09.595355 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f09bcfaf-4282-4434-8bb8-6dda7b337ae5 could not be found. Aug 27 03:07:09.595355 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:07:09.595355 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:07:09.595355 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:07:09.595355 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:07:09.595355 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:07:09.595355 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:07:09.595355 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:07:09.595355 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:07:09.595355 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:07:09.595355 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:07:09.595355 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:07:09.595355 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:07:09.595355 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:07:09.595355 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:07:09.595355 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:07:09.595355 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:07:09.595355 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f09bcfaf-4282-4434-8bb8-6dda7b337ae5 could not be found. Aug 27 03:07:09.595355 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:07:09.595355 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:07:09.599485 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:07:09.599485 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:07:09.599485 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:07:09.599485 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:07:09.599485 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:07:09.599485 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:07:09.599485 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f09bcfaf-4282-4434-8bb8-6dda7b337ae5 could not be found. Aug 27 03:07:09.599485 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:07:09.599485 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-17ee09b1-2d8a-4402-908c-712077fb76b9 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] Returning 404 to user: Instance f09bcfaf-4282-4434-8bb8-6dda7b337ae5 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:07:09.599485 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-17ee09b1-2d8a-4402-908c-712077fb76b9 tempest-ServerRescueNegativeTestJSON-1447006165 tempest-ServerRescueNegativeTestJSON-1447006165-project] 10.222.0.70 "GET /compute/v2.1/servers/f09bcfaf-4282-4434-8bb8-6dda7b337ae5" status: 404 len: 111 microversion: 2.1 time: 0.067942 Aug 27 03:07:09.599485 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2471/4888] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:09 2022] GET /compute/v2.1/servers/f09bcfaf-4282-4434-8bb8-6dda7b337ae5 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 03:07:09.704095 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-c74f9ede-efc4-4c92-96ee-392a87ce9098 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:09.719837 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c74f9ede-efc4-4c92-96ee-392a87ce9098 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1459 microversion: 2.1 time: 0.436129 Aug 27 03:07:09.720959 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2418/4889] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:09 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1459 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:07:10.160611 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-86c4ff52-8cb5-4a09-bcae-9f50e5c80a92 tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:10.161250 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-86c4ff52-8cb5-4a09-bcae-9f50e5c80a92 tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] [instance: d4525755-0392-4591-855c-2daf081ff9f3] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:10.174319 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-86c4ff52-8cb5-4a09-bcae-9f50e5c80a92 tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:10.175965 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-86c4ff52-8cb5-4a09-bcae-9f50e5c80a92 tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:10.176945 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-86c4ff52-8cb5-4a09-bcae-9f50e5c80a92 tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:10.177699 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-86c4ff52-8cb5-4a09-bcae-9f50e5c80a92 tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:10.178157 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-86c4ff52-8cb5-4a09-bcae-9f50e5c80a92 tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:10.178577 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-86c4ff52-8cb5-4a09-bcae-9f50e5c80a92 tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:10.484723 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-06bdaa7d-6452-4639-81c8-6be0de37a00e tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:10.485350 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-06bdaa7d-6452-4639-81c8-6be0de37a00e tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] [instance: 02896196-d318-4e33-b3ae-3db4b22e62b8] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:10.498780 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-06bdaa7d-6452-4639-81c8-6be0de37a00e tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:10.499195 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-06bdaa7d-6452-4639-81c8-6be0de37a00e tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:10.499637 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-06bdaa7d-6452-4639-81c8-6be0de37a00e tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:10.500382 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-06bdaa7d-6452-4639-81c8-6be0de37a00e tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:10.502014 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-06bdaa7d-6452-4639-81c8-6be0de37a00e tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:10.502447 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-06bdaa7d-6452-4639-81c8-6be0de37a00e tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:10.868155 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-86c4ff52-8cb5-4a09-bcae-9f50e5c80a92 tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b4ba598d3d451f9adf430ceb87df01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61112e2aab784cb9a8d84877896eb5be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:10.882597 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-86c4ff52-8cb5-4a09-bcae-9f50e5c80a92 tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] 10.222.0.70 "GET /compute/v2.1/servers/d4525755-0392-4591-855c-2daf081ff9f3" status: 200 len: 1286 microversion: 2.1 time: 0.726059 Aug 27 03:07:10.883216 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2472/4890] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:10 2022] GET /compute/v2.1/servers/d4525755-0392-4591-855c-2daf081ff9f3 => generated 1286 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:10.890421 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-623e8ee1-5874-4c0c-92e6-42fac8b34a1e req-0d001eef-4ad8-45db-96b9-6e0bc189ee1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72ffd032-b609-4e42-90d9-5454ac648eeb", "name": "network-vif-unplugged", "status": "completed", "tag": "7a8cf46b-6b49-415b-b564-a266edc89536"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:07:10.904108 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-623e8ee1-5874-4c0c-92e6-42fac8b34a1e req-0d001eef-4ad8-45db-96b9-6e0bc189ee1e service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:10.904844 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-623e8ee1-5874-4c0c-92e6-42fac8b34a1e req-0d001eef-4ad8-45db-96b9-6e0bc189ee1e service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:10.905433 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-623e8ee1-5874-4c0c-92e6-42fac8b34a1e req-0d001eef-4ad8-45db-96b9-6e0bc189ee1e service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:10.918067 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.compute.server_external_events [req-623e8ee1-5874-4c0c-92e6-42fac8b34a1e req-0d001eef-4ad8-45db-96b9-6e0bc189ee1e service nova] Unable to find a host for instance 72ffd032-b609-4e42-90d9-5454ac648eeb. Dropping event network-vif-unplugged {{(pid=134051) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 27 03:07:10.919288 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-623e8ee1-5874-4c0c-92e6-42fac8b34a1e req-0d001eef-4ad8-45db-96b9-6e0bc189ee1e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.034868 Aug 27 03:07:10.920141 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2473/4891] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:07:10 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 36 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 27 03:07:10.928693 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-56c1bbce-a136-4c3a-9132-edb64db123bd tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:10.929973 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-56c1bbce-a136-4c3a-9132-edb64db123bd tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:10.937143 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-56c1bbce-a136-4c3a-9132-edb64db123bd tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:10.938484 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-56c1bbce-a136-4c3a-9132-edb64db123bd tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:10.939139 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-56c1bbce-a136-4c3a-9132-edb64db123bd tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:10.940597 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-56c1bbce-a136-4c3a-9132-edb64db123bd tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:10.941277 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-56c1bbce-a136-4c3a-9132-edb64db123bd tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:10.941914 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-56c1bbce-a136-4c3a-9132-edb64db123bd tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:11.292154 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-06bdaa7d-6452-4639-81c8-6be0de37a00e tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3f67480c8a4ab8b538d4bebfa12d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d58ec8819c4af9bb00a08e2ca12708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:11.318586 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-06bdaa7d-6452-4639-81c8-6be0de37a00e tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] 10.222.0.70 "GET /compute/v2.1/servers/02896196-d318-4e33-b3ae-3db4b22e62b8" status: 200 len: 1313 microversion: 2.1 time: 0.835791 Aug 27 03:07:11.321475 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2419/4892] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:10 2022] GET /compute/v2.1/servers/02896196-d318-4e33-b3ae-3db4b22e62b8 => generated 1313 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:07:11.468288 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-56c1bbce-a136-4c3a-9132-edb64db123bd tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:11.499593 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-56c1bbce-a136-4c3a-9132-edb64db123bd tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1459 microversion: 2.1 time: 0.561653 Aug 27 03:07:11.502973 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2474/4893] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:10 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1459 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:11.903049 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-2d1ea036-8a91-4794-91dc-b59cb8679882 tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:11.903918 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-2d1ea036-8a91-4794-91dc-b59cb8679882 tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] [instance: d4525755-0392-4591-855c-2daf081ff9f3] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:11.930084 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2d1ea036-8a91-4794-91dc-b59cb8679882 tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:11.931223 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2d1ea036-8a91-4794-91dc-b59cb8679882 tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:11.933962 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2d1ea036-8a91-4794-91dc-b59cb8679882 tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:11.936140 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2d1ea036-8a91-4794-91dc-b59cb8679882 tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:11.936863 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2d1ea036-8a91-4794-91dc-b59cb8679882 tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:11.938867 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2d1ea036-8a91-4794-91dc-b59cb8679882 tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:12.343797 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-34bad400-2502-4dae-b8fa-7eb30d6faea1 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:12.344853 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-34bad400-2502-4dae-b8fa-7eb30d6faea1 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] [instance: 02896196-d318-4e33-b3ae-3db4b22e62b8] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:12.355147 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-2d1ea036-8a91-4794-91dc-b59cb8679882 tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b4ba598d3d451f9adf430ceb87df01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61112e2aab784cb9a8d84877896eb5be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:12.358364 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-34bad400-2502-4dae-b8fa-7eb30d6faea1 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:12.361523 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-34bad400-2502-4dae-b8fa-7eb30d6faea1 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:12.363385 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-34bad400-2502-4dae-b8fa-7eb30d6faea1 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:12.364358 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-34bad400-2502-4dae-b8fa-7eb30d6faea1 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:12.367238 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-34bad400-2502-4dae-b8fa-7eb30d6faea1 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:12.367356 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-2d1ea036-8a91-4794-91dc-b59cb8679882 tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] 10.222.0.70 "GET /compute/v2.1/servers/d4525755-0392-4591-855c-2daf081ff9f3" status: 200 len: 1328 microversion: 2.1 time: 0.467741 Aug 27 03:07:12.368011 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-34bad400-2502-4dae-b8fa-7eb30d6faea1 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:12.382954 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2420/4894] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:11 2022] GET /compute/v2.1/servers/d4525755-0392-4591-855c-2daf081ff9f3 => generated 1328 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:12.523300 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0b322d66-4036-47f2-8708-5f0870ecdfd0 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:12.524139 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-0b322d66-4036-47f2-8708-5f0870ecdfd0 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:12.541145 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0b322d66-4036-47f2-8708-5f0870ecdfd0 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:12.541991 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0b322d66-4036-47f2-8708-5f0870ecdfd0 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:12.543950 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0b322d66-4036-47f2-8708-5f0870ecdfd0 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:12.559376 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0b322d66-4036-47f2-8708-5f0870ecdfd0 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:12.561007 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0b322d66-4036-47f2-8708-5f0870ecdfd0 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:12.562226 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0b322d66-4036-47f2-8708-5f0870ecdfd0 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:13.217393 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-34bad400-2502-4dae-b8fa-7eb30d6faea1 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3f67480c8a4ab8b538d4bebfa12d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d58ec8819c4af9bb00a08e2ca12708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:13.229712 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-34bad400-2502-4dae-b8fa-7eb30d6faea1 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] 10.222.0.70 "GET /compute/v2.1/servers/02896196-d318-4e33-b3ae-3db4b22e62b8" status: 200 len: 1313 microversion: 2.1 time: 0.891859 Aug 27 03:07:13.235746 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2475/4895] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:12 2022] GET /compute/v2.1/servers/02896196-d318-4e33-b3ae-3db4b22e62b8 => generated 1313 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:13.250914 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-e611bce5-5e8b-4dbc-ab7d-cd2af5d50e86 req-e704215f-0363-417c-9d78-3c597fc9599d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02896196-d318-4e33-b3ae-3db4b22e62b8", "name": "network-vif-plugged", "status": "completed", "tag": "41e9dd03-84f2-460d-8f48-5112b78e9548"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:07:13.275977 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-e611bce5-5e8b-4dbc-ab7d-cd2af5d50e86 req-e704215f-0363-417c-9d78-3c597fc9599d service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:13.276531 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-e611bce5-5e8b-4dbc-ab7d-cd2af5d50e86 req-e704215f-0363-417c-9d78-3c597fc9599d service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:13.279958 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-e611bce5-5e8b-4dbc-ab7d-cd2af5d50e86 req-e704215f-0363-417c-9d78-3c597fc9599d service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:13.325830 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-e611bce5-5e8b-4dbc-ab7d-cd2af5d50e86 req-e704215f-0363-417c-9d78-3c597fc9599d service nova] Creating event network-vif-plugged:41e9dd03-84f2-460d-8f48-5112b78e9548 for instance 02896196-d318-4e33-b3ae-3db4b22e62b8 on n-h2-852278-4 Aug 27 03:07:13.354716 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-e611bce5-5e8b-4dbc-ab7d-cd2af5d50e86 req-e704215f-0363-417c-9d78-3c597fc9599d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112135 Aug 27 03:07:13.355316 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2476/4896] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:07:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:07:13.388512 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d512284b-e971-44a0-a89b-51eae43836b7 tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:13.389926 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d512284b-e971-44a0-a89b-51eae43836b7 tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] [instance: d4525755-0392-4591-855c-2daf081ff9f3] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:13.396800 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0b322d66-4036-47f2-8708-5f0870ecdfd0 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:13.404881 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-0b322d66-4036-47f2-8708-5f0870ecdfd0 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1517 microversion: 2.1 time: 0.886008 Aug 27 03:07:13.409793 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d512284b-e971-44a0-a89b-51eae43836b7 tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:13.410606 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d512284b-e971-44a0-a89b-51eae43836b7 tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:13.411184 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2421/4897] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:12 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1517 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:13.412881 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d512284b-e971-44a0-a89b-51eae43836b7 tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:13.413669 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d512284b-e971-44a0-a89b-51eae43836b7 tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:13.414134 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d512284b-e971-44a0-a89b-51eae43836b7 tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:13.414561 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d512284b-e971-44a0-a89b-51eae43836b7 tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:13.476231 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:07:13.998378 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d512284b-e971-44a0-a89b-51eae43836b7 tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b4ba598d3d451f9adf430ceb87df01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61112e2aab784cb9a8d84877896eb5be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:14.014879 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d512284b-e971-44a0-a89b-51eae43836b7 tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] 10.222.0.70 "GET /compute/v2.1/servers/d4525755-0392-4591-855c-2daf081ff9f3" status: 200 len: 1328 microversion: 2.1 time: 0.631061 Aug 27 03:07:14.042524 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2477/4898] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:13 2022] GET /compute/v2.1/servers/d4525755-0392-4591-855c-2daf081ff9f3 => generated 1328 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:07:14.086700 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-e40b8376-d8c7-4520-b79c-d4a5cf73a54e req-449ba6e1-b5f2-4cde-b9e9-7c1e4201663b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4525755-0392-4591-855c-2daf081ff9f3", "tag": "0b2b5452-c0ab-40cb-a7b3-f2b36d3d27f9"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:07:14.111372 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-e40b8376-d8c7-4520-b79c-d4a5cf73a54e req-449ba6e1-b5f2-4cde-b9e9-7c1e4201663b service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:14.112133 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-e40b8376-d8c7-4520-b79c-d4a5cf73a54e req-449ba6e1-b5f2-4cde-b9e9-7c1e4201663b service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:14.112732 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-e40b8376-d8c7-4520-b79c-d4a5cf73a54e req-449ba6e1-b5f2-4cde-b9e9-7c1e4201663b service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:14.132165 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-e40b8376-d8c7-4520-b79c-d4a5cf73a54e req-449ba6e1-b5f2-4cde-b9e9-7c1e4201663b service nova] Creating event network-changed:0b2b5452-c0ab-40cb-a7b3-f2b36d3d27f9 for instance d4525755-0392-4591-855c-2daf081ff9f3 on n-h1-852278-4 Aug 27 03:07:14.141416 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-e40b8376-d8c7-4520-b79c-d4a5cf73a54e req-449ba6e1-b5f2-4cde-b9e9-7c1e4201663b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054976 Aug 27 03:07:14.142266 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2422/4899] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:07:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:07:14.256087 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f28aa04a-d399-4164-abdf-54eed1507caf tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:14.256750 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-f28aa04a-d399-4164-abdf-54eed1507caf tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] [instance: 02896196-d318-4e33-b3ae-3db4b22e62b8] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:14.280338 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f28aa04a-d399-4164-abdf-54eed1507caf tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:14.280859 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f28aa04a-d399-4164-abdf-54eed1507caf tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:14.281301 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f28aa04a-d399-4164-abdf-54eed1507caf tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:14.282025 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f28aa04a-d399-4164-abdf-54eed1507caf tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:14.282483 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f28aa04a-d399-4164-abdf-54eed1507caf tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:14.282914 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f28aa04a-d399-4164-abdf-54eed1507caf tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:14.432097 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-89f2a27c-a9ca-4eca-9872-493ac0b94e95 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:14.433734 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-89f2a27c-a9ca-4eca-9872-493ac0b94e95 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:14.447048 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-89f2a27c-a9ca-4eca-9872-493ac0b94e95 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:14.447652 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-89f2a27c-a9ca-4eca-9872-493ac0b94e95 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:14.448162 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-89f2a27c-a9ca-4eca-9872-493ac0b94e95 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:14.448988 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-89f2a27c-a9ca-4eca-9872-493ac0b94e95 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:14.449517 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-89f2a27c-a9ca-4eca-9872-493ac0b94e95 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:14.453962 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-89f2a27c-a9ca-4eca-9872-493ac0b94e95 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:16.190507 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-89f2a27c-a9ca-4eca-9872-493ac0b94e95 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:16.204529 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-89f2a27c-a9ca-4eca-9872-493ac0b94e95 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1517 microversion: 2.1 time: 1.773359 Aug 27 03:07:16.209534 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2423/4900] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:14 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1517 bytes in 1783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:16.210835 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-f28aa04a-d399-4164-abdf-54eed1507caf tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3f67480c8a4ab8b538d4bebfa12d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d58ec8819c4af9bb00a08e2ca12708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:16.223373 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-f28aa04a-d399-4164-abdf-54eed1507caf tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] 10.222.0.70 "GET /compute/v2.1/servers/02896196-d318-4e33-b3ae-3db4b22e62b8" status: 200 len: 1313 microversion: 2.1 time: 1.970984 Aug 27 03:07:16.226787 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2478/4901] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:14 2022] GET /compute/v2.1/servers/02896196-d318-4e33-b3ae-3db4b22e62b8 => generated 1313 bytes in 1975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:16.255172 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6164efb9-861f-4369-92ae-ed93874d7b29 tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:16.255805 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-6164efb9-861f-4369-92ae-ed93874d7b29 tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] [instance: d4525755-0392-4591-855c-2daf081ff9f3] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:16.279755 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6164efb9-861f-4369-92ae-ed93874d7b29 tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:16.280522 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6164efb9-861f-4369-92ae-ed93874d7b29 tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:16.282339 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6164efb9-861f-4369-92ae-ed93874d7b29 tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:16.283217 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6164efb9-861f-4369-92ae-ed93874d7b29 tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:16.283736 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6164efb9-861f-4369-92ae-ed93874d7b29 tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:16.301230 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6164efb9-861f-4369-92ae-ed93874d7b29 tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:17.150661 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-6164efb9-861f-4369-92ae-ed93874d7b29 tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b4ba598d3d451f9adf430ceb87df01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61112e2aab784cb9a8d84877896eb5be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:17.164035 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-6164efb9-861f-4369-92ae-ed93874d7b29 tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] 10.222.0.70 "GET /compute/v2.1/servers/d4525755-0392-4591-855c-2daf081ff9f3" status: 200 len: 1328 microversion: 2.1 time: 0.948656 Aug 27 03:07:17.170375 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2424/4902] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:16 2022] GET /compute/v2.1/servers/d4525755-0392-4591-855c-2daf081ff9f3 => generated 1328 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:17.232858 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-5a49f843-80b7-4aa1-ae6e-2c43659246e5 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:17.233492 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-5a49f843-80b7-4aa1-ae6e-2c43659246e5 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:17.235961 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:07:17.237492 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=8 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:07:17.247146 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-56c8eec7-24f7-4242-8455-81a391bfb94f tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:17.248470 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-56c8eec7-24f7-4242-8455-81a391bfb94f tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] [instance: 02896196-d318-4e33-b3ae-3db4b22e62b8] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:17.259965 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5a49f843-80b7-4aa1-ae6e-2c43659246e5 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:17.260956 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5a49f843-80b7-4aa1-ae6e-2c43659246e5 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:17.262035 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5a49f843-80b7-4aa1-ae6e-2c43659246e5 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:17.263825 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5a49f843-80b7-4aa1-ae6e-2c43659246e5 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:17.264751 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5a49f843-80b7-4aa1-ae6e-2c43659246e5 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:17.265392 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5a49f843-80b7-4aa1-ae6e-2c43659246e5 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:17.266282 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-56c8eec7-24f7-4242-8455-81a391bfb94f tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:17.266785 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-56c8eec7-24f7-4242-8455-81a391bfb94f tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:17.267235 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-56c8eec7-24f7-4242-8455-81a391bfb94f tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:17.267941 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-56c8eec7-24f7-4242-8455-81a391bfb94f tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:17.268408 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-56c8eec7-24f7-4242-8455-81a391bfb94f tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:17.269044 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-56c8eec7-24f7-4242-8455-81a391bfb94f tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:17.681134 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-56c8eec7-24f7-4242-8455-81a391bfb94f tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3f67480c8a4ab8b538d4bebfa12d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d58ec8819c4af9bb00a08e2ca12708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:17.731741 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-56c8eec7-24f7-4242-8455-81a391bfb94f tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] 10.222.0.70 "GET /compute/v2.1/servers/02896196-d318-4e33-b3ae-3db4b22e62b8" status: 200 len: 1496 microversion: 2.1 time: 0.488530 Aug 27 03:07:17.736306 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2425/4903] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:17 2022] GET /compute/v2.1/servers/02896196-d318-4e33-b3ae-3db4b22e62b8 => generated 1496 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:07:17.740284 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-5a49f843-80b7-4aa1-ae6e-2c43659246e5 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:17.786354 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-5a49f843-80b7-4aa1-ae6e-2c43659246e5 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1517 microversion: 2.1 time: 0.557892 Aug 27 03:07:17.804423 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2479/4904] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:17 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1517 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:18.185344 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e3b5eccb-c584-44f0-a36b-00c707e91266 tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:18.186188 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-e3b5eccb-c584-44f0-a36b-00c707e91266 tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] [instance: d4525755-0392-4591-855c-2daf081ff9f3] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:18.194818 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:07:18.201318 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e3b5eccb-c584-44f0-a36b-00c707e91266 tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:18.202181 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e3b5eccb-c584-44f0-a36b-00c707e91266 tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:18.202837 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e3b5eccb-c584-44f0-a36b-00c707e91266 tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:18.203948 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e3b5eccb-c584-44f0-a36b-00c707e91266 tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:18.205589 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e3b5eccb-c584-44f0-a36b-00c707e91266 tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:18.207020 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e3b5eccb-c584-44f0-a36b-00c707e91266 tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:18.758485 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-53d2c6f8-a4a4-495c-a1cf-8651e9716a44 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:18.759152 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-53d2c6f8-a4a4-495c-a1cf-8651e9716a44 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] [instance: 02896196-d318-4e33-b3ae-3db4b22e62b8] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:18.771165 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-53d2c6f8-a4a4-495c-a1cf-8651e9716a44 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:18.771675 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-53d2c6f8-a4a4-495c-a1cf-8651e9716a44 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:18.774062 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-53d2c6f8-a4a4-495c-a1cf-8651e9716a44 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:18.775653 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-53d2c6f8-a4a4-495c-a1cf-8651e9716a44 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:18.776126 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-53d2c6f8-a4a4-495c-a1cf-8651e9716a44 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:18.777954 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-53d2c6f8-a4a4-495c-a1cf-8651e9716a44 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:18.870639 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-53d2c6f8-a4a4-495c-a1cf-8651e9716a44 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] [instance: 02896196-d318-4e33-b3ae-3db4b22e62b8] Going to try to terminate instance {{(pid=134051) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:07:19.074648 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-53d2c6f8-a4a4-495c-a1cf-8651e9716a44 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] 10.222.0.70 "DELETE /compute/v2.1/servers/02896196-d318-4e33-b3ae-3db4b22e62b8" status: 204 len: 0 microversion: 2.1 time: 0.320461 Aug 27 03:07:19.086044 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2480/4905] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 03:07:18 2022] DELETE /compute/v2.1/servers/02896196-d318-4e33-b3ae-3db4b22e62b8 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 03:07:19.095421 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-eff333a0-0694-405d-8c52-6c2fe94f3eec tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:19.097878 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-eff333a0-0694-405d-8c52-6c2fe94f3eec tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:19.108788 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-e3b5eccb-c584-44f0-a36b-00c707e91266 tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b4ba598d3d451f9adf430ceb87df01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61112e2aab784cb9a8d84877896eb5be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:19.111353 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eff333a0-0694-405d-8c52-6c2fe94f3eec tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:19.112163 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eff333a0-0694-405d-8c52-6c2fe94f3eec tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:19.112828 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eff333a0-0694-405d-8c52-6c2fe94f3eec tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:19.113832 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eff333a0-0694-405d-8c52-6c2fe94f3eec tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:19.114921 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eff333a0-0694-405d-8c52-6c2fe94f3eec tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:19.115533 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eff333a0-0694-405d-8c52-6c2fe94f3eec tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:19.122290 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e3b5eccb-c584-44f0-a36b-00c707e91266 tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] 10.222.0.70 "GET /compute/v2.1/servers/d4525755-0392-4591-855c-2daf081ff9f3" status: 200 len: 1328 microversion: 2.1 time: 0.941392 Aug 27 03:07:19.124874 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2426/4906] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:18 2022] GET /compute/v2.1/servers/d4525755-0392-4591-855c-2daf081ff9f3 => generated 1328 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:19.131446 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-324f1860-af84-438a-ab34-c139d7275b82 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:19.156907 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-324f1860-af84-438a-ab34-c139d7275b82 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] [instance: 02896196-d318-4e33-b3ae-3db4b22e62b8] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:19.180096 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-324f1860-af84-438a-ab34-c139d7275b82 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:19.180950 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-324f1860-af84-438a-ab34-c139d7275b82 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:19.181388 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-324f1860-af84-438a-ab34-c139d7275b82 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:19.182360 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-324f1860-af84-438a-ab34-c139d7275b82 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:19.182951 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-324f1860-af84-438a-ab34-c139d7275b82 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:19.183509 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-324f1860-af84-438a-ab34-c139d7275b82 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:20.013372 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-324f1860-af84-438a-ab34-c139d7275b82 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3f67480c8a4ab8b538d4bebfa12d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d58ec8819c4af9bb00a08e2ca12708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:20.021499 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-324f1860-af84-438a-ab34-c139d7275b82 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] 10.222.0.70 "GET /compute/v2.1/servers/02896196-d318-4e33-b3ae-3db4b22e62b8" status: 200 len: 1502 microversion: 2.1 time: 0.895050 Aug 27 03:07:20.022099 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2427/4907] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:19 2022] GET /compute/v2.1/servers/02896196-d318-4e33-b3ae-3db4b22e62b8 => generated 1502 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:20.151249 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-af4ed7ef-3105-4019-9c6c-4e612379929b tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:20.156899 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-af4ed7ef-3105-4019-9c6c-4e612379929b tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] [instance: d4525755-0392-4591-855c-2daf081ff9f3] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:20.183876 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-af4ed7ef-3105-4019-9c6c-4e612379929b tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:20.197380 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-af4ed7ef-3105-4019-9c6c-4e612379929b tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:20.197959 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-af4ed7ef-3105-4019-9c6c-4e612379929b tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:20.210223 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-af4ed7ef-3105-4019-9c6c-4e612379929b tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:20.210922 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-af4ed7ef-3105-4019-9c6c-4e612379929b tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:20.213757 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-af4ed7ef-3105-4019-9c6c-4e612379929b tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:20.283556 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-eff333a0-0694-405d-8c52-6c2fe94f3eec tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:20.335870 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-eff333a0-0694-405d-8c52-6c2fe94f3eec tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1517 microversion: 2.1 time: 1.216866 Aug 27 03:07:20.340011 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2481/4908] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:19 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1517 bytes in 1253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:20.841583 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-af4ed7ef-3105-4019-9c6c-4e612379929b tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b4ba598d3d451f9adf430ceb87df01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61112e2aab784cb9a8d84877896eb5be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:20.856339 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-af4ed7ef-3105-4019-9c6c-4e612379929b tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] 10.222.0.70 "GET /compute/v2.1/servers/d4525755-0392-4591-855c-2daf081ff9f3" status: 200 len: 1328 microversion: 2.1 time: 0.712885 Aug 27 03:07:20.860371 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2428/4909] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:20 2022] GET /compute/v2.1/servers/d4525755-0392-4591-855c-2daf081ff9f3 => generated 1328 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:21.044861 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-43a5a1fc-7e7c-497f-9add-a2203f35dea1 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:21.045489 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-43a5a1fc-7e7c-497f-9add-a2203f35dea1 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] [instance: 02896196-d318-4e33-b3ae-3db4b22e62b8] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:21.079087 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-43a5a1fc-7e7c-497f-9add-a2203f35dea1 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:21.080574 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-43a5a1fc-7e7c-497f-9add-a2203f35dea1 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:21.081036 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-43a5a1fc-7e7c-497f-9add-a2203f35dea1 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:21.084541 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-43a5a1fc-7e7c-497f-9add-a2203f35dea1 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:21.086984 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-43a5a1fc-7e7c-497f-9add-a2203f35dea1 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:21.087458 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-43a5a1fc-7e7c-497f-9add-a2203f35dea1 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:21.366615 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e868d636-c123-4f27-9418-002f2039bbc1 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:21.367715 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-e868d636-c123-4f27-9418-002f2039bbc1 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:21.386007 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e868d636-c123-4f27-9418-002f2039bbc1 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:21.396907 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e868d636-c123-4f27-9418-002f2039bbc1 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:21.397362 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e868d636-c123-4f27-9418-002f2039bbc1 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:21.398129 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e868d636-c123-4f27-9418-002f2039bbc1 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:21.398581 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e868d636-c123-4f27-9418-002f2039bbc1 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:21.398993 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e868d636-c123-4f27-9418-002f2039bbc1 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:21.725762 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-43a5a1fc-7e7c-497f-9add-a2203f35dea1 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3f67480c8a4ab8b538d4bebfa12d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d58ec8819c4af9bb00a08e2ca12708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:21.761157 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-43a5a1fc-7e7c-497f-9add-a2203f35dea1 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] 10.222.0.70 "GET /compute/v2.1/servers/02896196-d318-4e33-b3ae-3db4b22e62b8" status: 200 len: 1502 microversion: 2.1 time: 0.720100 Aug 27 03:07:21.772619 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2482/4910] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:21 2022] GET /compute/v2.1/servers/02896196-d318-4e33-b3ae-3db4b22e62b8 => generated 1502 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:21.899120 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-942d3c9d-1545-4da5-8ee1-5ffeb1524e9c tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:21.900338 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-942d3c9d-1545-4da5-8ee1-5ffeb1524e9c tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] [instance: d4525755-0392-4591-855c-2daf081ff9f3] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:21.926652 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-942d3c9d-1545-4da5-8ee1-5ffeb1524e9c tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:21.927200 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-942d3c9d-1545-4da5-8ee1-5ffeb1524e9c tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:21.927657 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-942d3c9d-1545-4da5-8ee1-5ffeb1524e9c tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:21.928420 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-942d3c9d-1545-4da5-8ee1-5ffeb1524e9c tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:21.933873 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-942d3c9d-1545-4da5-8ee1-5ffeb1524e9c tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:21.934827 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-942d3c9d-1545-4da5-8ee1-5ffeb1524e9c tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:22.424275 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-e868d636-c123-4f27-9418-002f2039bbc1 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:22.461687 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e868d636-c123-4f27-9418-002f2039bbc1 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1517 microversion: 2.1 time: 1.094105 Aug 27 03:07:22.483597 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2429/4911] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:21 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1517 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:07:22.495666 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-98dcb058-d3eb-4aaf-9506-b26c8dca9ca1 req-1521e9bc-904a-4639-a203-31a6d160b129 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02896196-d318-4e33-b3ae-3db4b22e62b8", "name": "network-vif-deleted", "tag": "41e9dd03-84f2-460d-8f48-5112b78e9548"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:07:22.548684 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-98dcb058-d3eb-4aaf-9506-b26c8dca9ca1 req-1521e9bc-904a-4639-a203-31a6d160b129 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:22.564971 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-98dcb058-d3eb-4aaf-9506-b26c8dca9ca1 req-1521e9bc-904a-4639-a203-31a6d160b129 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:22.565648 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-98dcb058-d3eb-4aaf-9506-b26c8dca9ca1 req-1521e9bc-904a-4639-a203-31a6d160b129 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:22.590915 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-98dcb058-d3eb-4aaf-9506-b26c8dca9ca1 req-1521e9bc-904a-4639-a203-31a6d160b129 service nova] Creating event network-vif-deleted:41e9dd03-84f2-460d-8f48-5112b78e9548 for instance 02896196-d318-4e33-b3ae-3db4b22e62b8 on n-h2-852278-4 Aug 27 03:07:22.601995 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-98dcb058-d3eb-4aaf-9506-b26c8dca9ca1 req-1521e9bc-904a-4639-a203-31a6d160b129 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116931 Aug 27 03:07:22.605731 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2430/4912] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:07:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:07:22.614931 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-27c4226e-a5f6-4fb9-aeb0-1f88098897c1 req-a8d73ca9-3943-45b5-8a78-7c257fa5f354 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4525755-0392-4591-855c-2daf081ff9f3", "name": "network-vif-plugged", "status": "completed", "tag": "0b2b5452-c0ab-40cb-a7b3-f2b36d3d27f9"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:07:22.641374 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-27c4226e-a5f6-4fb9-aeb0-1f88098897c1 req-a8d73ca9-3943-45b5-8a78-7c257fa5f354 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:22.643407 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-27c4226e-a5f6-4fb9-aeb0-1f88098897c1 req-a8d73ca9-3943-45b5-8a78-7c257fa5f354 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:22.645719 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-27c4226e-a5f6-4fb9-aeb0-1f88098897c1 req-a8d73ca9-3943-45b5-8a78-7c257fa5f354 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:22.677870 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-27c4226e-a5f6-4fb9-aeb0-1f88098897c1 req-a8d73ca9-3943-45b5-8a78-7c257fa5f354 service nova] Creating event network-vif-plugged:0b2b5452-c0ab-40cb-a7b3-f2b36d3d27f9 for instance d4525755-0392-4591-855c-2daf081ff9f3 on n-h1-852278-4 Aug 27 03:07:22.691490 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-27c4226e-a5f6-4fb9-aeb0-1f88098897c1 req-a8d73ca9-3943-45b5-8a78-7c257fa5f354 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084122 Aug 27 03:07:22.695273 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2431/4913] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:07:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:07:22.741545 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-942d3c9d-1545-4da5-8ee1-5ffeb1524e9c tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b4ba598d3d451f9adf430ceb87df01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61112e2aab784cb9a8d84877896eb5be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:22.753850 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-942d3c9d-1545-4da5-8ee1-5ffeb1524e9c tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] 10.222.0.70 "GET /compute/v2.1/servers/d4525755-0392-4591-855c-2daf081ff9f3" status: 200 len: 1328 microversion: 2.1 time: 0.863037 Aug 27 03:07:22.757953 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2483/4914] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:21 2022] GET /compute/v2.1/servers/d4525755-0392-4591-855c-2daf081ff9f3 => generated 1328 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:22.797666 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-78ec2086-5d87-4d29-ab2f-5f5b21df9e0e tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:22.798544 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-78ec2086-5d87-4d29-ab2f-5f5b21df9e0e tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] [instance: 02896196-d318-4e33-b3ae-3db4b22e62b8] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:22.815681 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-78ec2086-5d87-4d29-ab2f-5f5b21df9e0e tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:22.824643 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-78ec2086-5d87-4d29-ab2f-5f5b21df9e0e tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:22.826173 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-78ec2086-5d87-4d29-ab2f-5f5b21df9e0e tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:22.828330 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-78ec2086-5d87-4d29-ab2f-5f5b21df9e0e tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:22.829525 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-78ec2086-5d87-4d29-ab2f-5f5b21df9e0e tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:22.832291 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-78ec2086-5d87-4d29-ab2f-5f5b21df9e0e tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:22.954675 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-78ec2086-5d87-4d29-ab2f-5f5b21df9e0e tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:22.954675 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-78ec2086-5d87-4d29-ab2f-5f5b21df9e0e tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:22.954675 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-78ec2086-5d87-4d29-ab2f-5f5b21df9e0e tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:22.955076 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.objects.instance [None req-78ec2086-5d87-4d29-ab2f-5f5b21df9e0e tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lazy-loading 'fault' on Instance uuid 02896196-d318-4e33-b3ae-3db4b22e62b8 {{(pid=134051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:07:23.091907 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-78ec2086-5d87-4d29-ab2f-5f5b21df9e0e tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3f67480c8a4ab8b538d4bebfa12d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d58ec8819c4af9bb00a08e2ca12708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:23.115195 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e0a5b019-e52b-4e44-ba69-e374595ba83d tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-383891537", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "networks": "none"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:07:23.116061 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-78ec2086-5d87-4d29-ab2f-5f5b21df9e0e tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] 10.222.0.70 "GET /compute/v2.1/servers/02896196-d318-4e33-b3ae-3db4b22e62b8" status: 200 len: 1303 microversion: 2.1 time: 0.311794 Aug 27 03:07:23.116881 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2484/4915] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:22 2022] GET /compute/v2.1/servers/02896196-d318-4e33-b3ae-3db4b22e62b8 => generated 1303 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:07:23.210841 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-e0a5b019-e52b-4e44-ba69-e374595ba83d tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Flavor limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:07:23.211603 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-e0a5b019-e52b-4e44-ba69-e374595ba83d tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Image limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:07:23.212390 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-e0a5b019-e52b-4e44-ba69-e374595ba83d tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Flavor pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:07:23.213158 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-e0a5b019-e52b-4e44-ba69-e374595ba83d tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Image pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:07:23.213781 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-e0a5b019-e52b-4e44-ba69-e374595ba83d tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:07:23.225608 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e0a5b019-e52b-4e44-ba69-e374595ba83d tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:23.226659 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e0a5b019-e52b-4e44-ba69-e374595ba83d tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:23.227320 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e0a5b019-e52b-4e44-ba69-e374595ba83d tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:23.228983 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e0a5b019-e52b-4e44-ba69-e374595ba83d tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:23.240443 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e0a5b019-e52b-4e44-ba69-e374595ba83d tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:23.241437 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e0a5b019-e52b-4e44-ba69-e374595ba83d tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:23.291929 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-e0a5b019-e52b-4e44-ba69-e374595ba83d tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Getting quotas for project 4a4333b5357f49e883b72e96bdafb682. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:07:23.299317 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-e0a5b019-e52b-4e44-ba69-e374595ba83d tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Getting quotas for user e34c5fc51d324c8e8adb3b9c5cd30b6c and project 4a4333b5357f49e883b72e96bdafb682. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:07:23.313664 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-e0a5b019-e52b-4e44-ba69-e374595ba83d tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Going to run 1 instances... {{(pid=134052) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:07:23.316304 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-e0a5b019-e52b-4e44-ba69-e374595ba83d tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] [instance: b4627c24-32f3-4d51-ac9f-3e78aff94796] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134052) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:07:23.385645 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e0a5b019-e52b-4e44-ba69-e374595ba83d tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.661302 Aug 27 03:07:23.399811 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-06a8c62d-6aca-4d2a-aadf-4273187440fd tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:23.400833 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-06a8c62d-6aca-4d2a-aadf-4273187440fd tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] [instance: b4627c24-32f3-4d51-ac9f-3e78aff94796] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:23.405530 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2432/4916] 10.222.0.70 () {62 vars in 1188 bytes} [Sat Aug 27 03:07:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 682 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 27 03:07:23.491650 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8697acc6-f60b-452d-804e-e686d6a2be66 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:23.493051 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-8697acc6-f60b-452d-804e-e686d6a2be66 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:23.496058 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-06a8c62d-6aca-4d2a-aadf-4273187440fd tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34c5fc51d324c8e8adb3b9c5cd30b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4333b5357f49e883b72e96bdafb682', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:23.514423 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8697acc6-f60b-452d-804e-e686d6a2be66 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:23.519749 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8697acc6-f60b-452d-804e-e686d6a2be66 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:23.520203 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8697acc6-f60b-452d-804e-e686d6a2be66 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:23.520987 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8697acc6-f60b-452d-804e-e686d6a2be66 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:23.521474 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8697acc6-f60b-452d-804e-e686d6a2be66 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:23.521899 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8697acc6-f60b-452d-804e-e686d6a2be66 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:23.523889 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-06a8c62d-6aca-4d2a-aadf-4273187440fd tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e34c5fc51d324c8e8adb3b9c5cd30b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4333b5357f49e883b72e96bdafb682', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:23.539259 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-06a8c62d-6aca-4d2a-aadf-4273187440fd tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e34c5fc51d324c8e8adb3b9c5cd30b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4333b5357f49e883b72e96bdafb682', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:23.540507 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-06a8c62d-6aca-4d2a-aadf-4273187440fd tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] 10.222.0.70 "GET /compute/v2.1/servers/b4627c24-32f3-4d51-ac9f-3e78aff94796" status: 200 len: 1277 microversion: 2.47 time: 0.145462 Aug 27 03:07:23.541087 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2485/4917] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:07:23 2022] GET /compute/v2.1/servers/b4627c24-32f3-4d51-ac9f-3e78aff94796 => generated 1277 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:07:23.780325 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-bd12a3e1-574d-4fa4-8f2c-e18cfb20035e tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:23.781545 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-bd12a3e1-574d-4fa4-8f2c-e18cfb20035e tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] [instance: d4525755-0392-4591-855c-2daf081ff9f3] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:23.793953 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bd12a3e1-574d-4fa4-8f2c-e18cfb20035e tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:23.794463 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bd12a3e1-574d-4fa4-8f2c-e18cfb20035e tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:23.794965 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bd12a3e1-574d-4fa4-8f2c-e18cfb20035e tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:23.795695 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bd12a3e1-574d-4fa4-8f2c-e18cfb20035e tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:23.796156 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bd12a3e1-574d-4fa4-8f2c-e18cfb20035e tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:23.801245 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bd12a3e1-574d-4fa4-8f2c-e18cfb20035e tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:23.895554 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-8697acc6-f60b-452d-804e-e686d6a2be66 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:23.909697 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-8697acc6-f60b-452d-804e-e686d6a2be66 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1517 microversion: 2.1 time: 0.423238 Aug 27 03:07:23.910483 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2433/4918] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:23 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1517 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:07:23.935235 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-27e3fd09-bcb9-482c-b977-b5832b81e64d tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1725466109", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "networks": "none"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:07:24.066089 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-27e3fd09-bcb9-482c-b977-b5832b81e64d tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Flavor limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:07:24.066955 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-27e3fd09-bcb9-482c-b977-b5832b81e64d tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Image limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:07:24.067708 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-27e3fd09-bcb9-482c-b977-b5832b81e64d tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Flavor pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:07:24.068407 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-27e3fd09-bcb9-482c-b977-b5832b81e64d tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Image pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:07:24.070593 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-27e3fd09-bcb9-482c-b977-b5832b81e64d tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:07:24.087313 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-bd12a3e1-574d-4fa4-8f2c-e18cfb20035e tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b4ba598d3d451f9adf430ceb87df01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61112e2aab784cb9a8d84877896eb5be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:24.107520 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-bd12a3e1-574d-4fa4-8f2c-e18cfb20035e tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] 10.222.0.70 "GET /compute/v2.1/servers/d4525755-0392-4591-855c-2daf081ff9f3" status: 200 len: 1328 microversion: 2.1 time: 0.332088 Aug 27 03:07:24.114429 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-27e3fd09-bcb9-482c-b977-b5832b81e64d tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:24.118357 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-27e3fd09-bcb9-482c-b977-b5832b81e64d tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:24.119777 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-27e3fd09-bcb9-482c-b977-b5832b81e64d tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:24.120681 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2486/4919] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:23 2022] GET /compute/v2.1/servers/d4525755-0392-4591-855c-2daf081ff9f3 => generated 1328 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:07:24.124697 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-27e3fd09-bcb9-482c-b977-b5832b81e64d tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:24.125413 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-27e3fd09-bcb9-482c-b977-b5832b81e64d tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:24.126018 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-27e3fd09-bcb9-482c-b977-b5832b81e64d tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:24.139846 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-172df271-a5ac-42e5-944f-229184c46da1 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:24.141608 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-172df271-a5ac-42e5-944f-229184c46da1 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] [instance: 02896196-d318-4e33-b3ae-3db4b22e62b8] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:24.160435 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-172df271-a5ac-42e5-944f-229184c46da1 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:24.166251 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-172df271-a5ac-42e5-944f-229184c46da1 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:24.167031 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-172df271-a5ac-42e5-944f-229184c46da1 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:24.167988 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-172df271-a5ac-42e5-944f-229184c46da1 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:24.174480 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-172df271-a5ac-42e5-944f-229184c46da1 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:24.175009 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-172df271-a5ac-42e5-944f-229184c46da1 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:24.190686 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-27e3fd09-bcb9-482c-b977-b5832b81e64d tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Getting quotas for project 4a4333b5357f49e883b72e96bdafb682. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:07:24.205695 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-27e3fd09-bcb9-482c-b977-b5832b81e64d tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Getting quotas for user e34c5fc51d324c8e8adb3b9c5cd30b6c and project 4a4333b5357f49e883b72e96bdafb682. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:07:24.215610 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-172df271-a5ac-42e5-944f-229184c46da1 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] HTTP exception thrown: Instance 02896196-d318-4e33-b3ae-3db4b22e62b8 could not be found. Aug 27 03:07:24.229414 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-172df271-a5ac-42e5-944f-229184c46da1 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Request method failure captured: Aug 27 03:07:24.229414 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/02896196-d318-4e33-b3ae-3db4b22e62b8 HTTP/1.1 Aug 27 03:07:24.229414 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 03:07:24.229414 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 03:07:24.229414 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 03:07:24.229414 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 03:07:24.229414 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 03:07:24.229414 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 03:07:24.229414 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 03:07:24.229414 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 03:07:24.229414 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYodMCDYqYb6vQsQ-_MqS42TmHHJ_V0CE-cb7lzdQenfJUwXHNz-rUWO-mk4V0bTfn-ZOcYS5PAggcRVtmomXPQMyhJYv4uBQNhaHK6D9rE7S2YpmZThaTWUURQ5ay62N-Vj_jAHdfeMHMhBZWG0Mc6scC2IdAtIag2PVfNJIeXKUKM Aug 27 03:07:24.229414 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 03:07:24.229414 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 03:07:24.229414 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 03:07:24.229414 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 03:07:24.229414 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 03:07:24.229414 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 03:07:24.229414 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 88d58ec8819c4af9bb00a08e2ca12708 Aug 27 03:07:24.229414 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-VolumesActionsTest-1251134472 Aug 27 03:07:24.229414 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 03:07:24.229414 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 03:07:24.229414 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/88d58ec8819c4af9bb00a08e2ca12708"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_88d58ec8819c4af9bb00a08e2ca12708", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/88d58ec8819c4af9bb00a08e2ca12708"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/88d58ec8819c4af9bb00a08e2ca12708"}]}] Aug 27 03:07:24.229414 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-VolumesActionsTest-1251134472 Aug 27 03:07:24.229414 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 88d58ec8819c4af9bb00a08e2ca12708 Aug 27 03:07:24.229414 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-VolumesActionsTest-1251134472 Aug 27 03:07:24.229414 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-VolumesActionsTest-1251134472-project Aug 27 03:07:24.229414 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 03:07:24.229414 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 03:07:24.229414 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 0f3f67480c8a4ab8b538d4bebfa12d47 Aug 27 03:07:24.229414 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-VolumesActionsTest-1251134472-project Aug 27 03:07:24.229414 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 03:07:24.229414 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance 02896196-d318-4e33-b3ae-3db4b22e62b8 could not be found. Aug 27 03:07:24.229414 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '02896196-d318-4e33-b3ae-3db4b22e62b8'} Aug 27 03:07:24.229414 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:07:24.229414 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:07:24.229414 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:07:24.229414 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:07:24.229414 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:07:24.229414 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:07:24.229414 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:07:24.229414 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:07:24.229414 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:07:24.229414 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:07:24.229414 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02896196-d318-4e33-b3ae-3db4b22e62b8 could not be found. Aug 27 03:07:24.229414 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:07:24.229414 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:07:24.229414 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:07:24.229414 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:07:24.229414 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:07:24.229414 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:07:24.229414 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:07:24.229414 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:07:24.229414 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:07:24.229414 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:07:24.229414 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:07:24.229414 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:07:24.229414 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:07:24.229414 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:07:24.229414 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:07:24.229414 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:07:24.229414 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02896196-d318-4e33-b3ae-3db4b22e62b8 could not be found. Aug 27 03:07:24.229414 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:07:24.229414 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:07:24.229414 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:07:24.233302 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:07:24.233302 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:07:24.233302 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:07:24.233302 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:07:24.233302 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:07:24.233302 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02896196-d318-4e33-b3ae-3db4b22e62b8 could not be found. Aug 27 03:07:24.233302 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:07:24.233690 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-27e3fd09-bcb9-482c-b977-b5832b81e64d tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Going to run 1 instances... {{(pid=134052) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:07:24.238148 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-172df271-a5ac-42e5-944f-229184c46da1 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] Returning 404 to user: Instance 02896196-d318-4e33-b3ae-3db4b22e62b8 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:07:24.240259 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-27e3fd09-bcb9-482c-b977-b5832b81e64d tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] [instance: 69be36fb-3a1b-480f-8613-5aa3881944ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134052) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:07:24.253937 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-172df271-a5ac-42e5-944f-229184c46da1 tempest-VolumesActionsTest-1251134472 tempest-VolumesActionsTest-1251134472-project] 10.222.0.70 "GET /compute/v2.1/servers/02896196-d318-4e33-b3ae-3db4b22e62b8" status: 404 len: 111 microversion: 2.1 time: 0.118642 Aug 27 03:07:24.255129 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2487/4920] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:24 2022] GET /compute/v2.1/servers/02896196-d318-4e33-b3ae-3db4b22e62b8 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 03:07:24.433543 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-27e3fd09-bcb9-482c-b977-b5832b81e64d tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.518390 Aug 27 03:07:24.439799 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2434/4921] 10.222.0.70 () {62 vars in 1188 bytes} [Sat Aug 27 03:07:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 528 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 27 03:07:24.451925 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-5fcb2033-f0f9-413c-908a-9cbb8bcdc52a tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:07:24.455062 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-5fcb2033-f0f9-413c-908a-9cbb8bcdc52a tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] [instance: 69be36fb-3a1b-480f-8613-5aa3881944ab] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:24.460951 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:07:24.594328 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-5fcb2033-f0f9-413c-908a-9cbb8bcdc52a tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] 10.222.0.70 "PUT /compute/v2.1/servers/69be36fb-3a1b-480f-8613-5aa3881944ab" status: 200 len: 992 microversion: 2.47 time: 0.146249 Aug 27 03:07:24.600988 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2488/4922] 10.222.0.70 () {62 vars in 1297 bytes} [Sat Aug 27 03:07:24 2022] PUT /compute/v2.1/servers/69be36fb-3a1b-480f-8613-5aa3881944ab => generated 992 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:07:24.617569 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ff0ed355-c016-49a5-961b-8a38dfca77e6 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:24.619675 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-ff0ed355-c016-49a5-961b-8a38dfca77e6 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] [instance: 69be36fb-3a1b-480f-8613-5aa3881944ab] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:24.814796 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-ff0ed355-c016-49a5-961b-8a38dfca77e6 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34c5fc51d324c8e8adb3b9c5cd30b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4333b5357f49e883b72e96bdafb682', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:24.837106 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-ff0ed355-c016-49a5-961b-8a38dfca77e6 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e34c5fc51d324c8e8adb3b9c5cd30b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4333b5357f49e883b72e96bdafb682', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:24.842616 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-ff0ed355-c016-49a5-961b-8a38dfca77e6 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e34c5fc51d324c8e8adb3b9c5cd30b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4333b5357f49e883b72e96bdafb682', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:24.866294 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ff0ed355-c016-49a5-961b-8a38dfca77e6 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] 10.222.0.70 "GET /compute/v2.1/servers/69be36fb-3a1b-480f-8613-5aa3881944ab" status: 200 len: 1278 microversion: 2.47 time: 0.231256 Aug 27 03:07:24.867539 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2435/4923] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:07:24 2022] GET /compute/v2.1/servers/69be36fb-3a1b-480f-8613-5aa3881944ab => generated 1278 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:07:24.934910 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d29f2742-e534-4eb5-9b8a-fb7714a6b42f tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:24.935605 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d29f2742-e534-4eb5-9b8a-fb7714a6b42f tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:24.946135 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d29f2742-e534-4eb5-9b8a-fb7714a6b42f tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:24.947132 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d29f2742-e534-4eb5-9b8a-fb7714a6b42f tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:24.947757 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d29f2742-e534-4eb5-9b8a-fb7714a6b42f tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:24.948691 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d29f2742-e534-4eb5-9b8a-fb7714a6b42f tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:24.949321 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d29f2742-e534-4eb5-9b8a-fb7714a6b42f tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:24.949916 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d29f2742-e534-4eb5-9b8a-fb7714a6b42f tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:25.130855 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-41bc29f2-0694-46a7-a36b-ab51614e749c tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:25.132612 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-41bc29f2-0694-46a7-a36b-ab51614e749c tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] [instance: d4525755-0392-4591-855c-2daf081ff9f3] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:25.150540 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-41bc29f2-0694-46a7-a36b-ab51614e749c tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:25.151033 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-41bc29f2-0694-46a7-a36b-ab51614e749c tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:25.151479 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-41bc29f2-0694-46a7-a36b-ab51614e749c tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:25.152193 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-41bc29f2-0694-46a7-a36b-ab51614e749c tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:25.152679 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-41bc29f2-0694-46a7-a36b-ab51614e749c tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:25.153100 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-41bc29f2-0694-46a7-a36b-ab51614e749c tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:25.541481 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d29f2742-e534-4eb5-9b8a-fb7714a6b42f tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:25.559786 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d29f2742-e534-4eb5-9b8a-fb7714a6b42f tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1517 microversion: 2.1 time: 0.625068 Aug 27 03:07:25.560518 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2489/4924] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:24 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1517 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:25.742042 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-41bc29f2-0694-46a7-a36b-ab51614e749c tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b4ba598d3d451f9adf430ceb87df01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61112e2aab784cb9a8d84877896eb5be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:25.754209 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-41bc29f2-0694-46a7-a36b-ab51614e749c tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] 10.222.0.70 "GET /compute/v2.1/servers/d4525755-0392-4591-855c-2daf081ff9f3" status: 200 len: 1528 microversion: 2.1 time: 0.628800 Aug 27 03:07:25.756409 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2436/4925] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:25 2022] GET /compute/v2.1/servers/d4525755-0392-4591-855c-2daf081ff9f3 => generated 1528 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:07:25.792569 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d9236a9b-9810-4873-ad69-fcea6aea767a tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:25.796837 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d9236a9b-9810-4873-ad69-fcea6aea767a tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] [instance: d4525755-0392-4591-855c-2daf081ff9f3] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:25.810411 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d9236a9b-9810-4873-ad69-fcea6aea767a tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:25.811511 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d9236a9b-9810-4873-ad69-fcea6aea767a tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:25.812387 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d9236a9b-9810-4873-ad69-fcea6aea767a tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:25.813298 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d9236a9b-9810-4873-ad69-fcea6aea767a tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:25.814092 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d9236a9b-9810-4873-ad69-fcea6aea767a tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:25.814757 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d9236a9b-9810-4873-ad69-fcea6aea767a tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:25.890767 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8da8fe18-9156-4182-9231-839a005cdcb9 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:25.891773 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-8da8fe18-9156-4182-9231-839a005cdcb9 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] [instance: 69be36fb-3a1b-480f-8613-5aa3881944ab] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:25.900818 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8da8fe18-9156-4182-9231-839a005cdcb9 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:25.901618 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8da8fe18-9156-4182-9231-839a005cdcb9 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:25.902201 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8da8fe18-9156-4182-9231-839a005cdcb9 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:25.903074 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8da8fe18-9156-4182-9231-839a005cdcb9 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:25.903661 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8da8fe18-9156-4182-9231-839a005cdcb9 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:25.904281 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8da8fe18-9156-4182-9231-839a005cdcb9 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:26.210370 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-8da8fe18-9156-4182-9231-839a005cdcb9 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34c5fc51d324c8e8adb3b9c5cd30b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4333b5357f49e883b72e96bdafb682', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:26.236374 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-8da8fe18-9156-4182-9231-839a005cdcb9 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e34c5fc51d324c8e8adb3b9c5cd30b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4333b5357f49e883b72e96bdafb682', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:26.242434 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-8da8fe18-9156-4182-9231-839a005cdcb9 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e34c5fc51d324c8e8adb3b9c5cd30b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4333b5357f49e883b72e96bdafb682', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:26.243916 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-8da8fe18-9156-4182-9231-839a005cdcb9 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] 10.222.0.70 "GET /compute/v2.1/servers/69be36fb-3a1b-480f-8613-5aa3881944ab" status: 200 len: 1274 microversion: 2.47 time: 0.357580 Aug 27 03:07:26.247066 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2437/4926] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:07:25 2022] GET /compute/v2.1/servers/69be36fb-3a1b-480f-8613-5aa3881944ab => generated 1274 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:07:26.366726 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d9236a9b-9810-4873-ad69-fcea6aea767a tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b4ba598d3d451f9adf430ceb87df01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61112e2aab784cb9a8d84877896eb5be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:26.381134 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d9236a9b-9810-4873-ad69-fcea6aea767a tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] 10.222.0.70 "GET /compute/v2.1/servers/d4525755-0392-4591-855c-2daf081ff9f3" status: 200 len: 1528 microversion: 2.1 time: 0.603585 Aug 27 03:07:26.397837 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2490/4927] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:25 2022] GET /compute/v2.1/servers/d4525755-0392-4591-855c-2daf081ff9f3 => generated 1528 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:26.585654 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-90899270-b152-4e9d-8367-693d69f6cf09 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:26.586264 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-90899270-b152-4e9d-8367-693d69f6cf09 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:26.598286 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-90899270-b152-4e9d-8367-693d69f6cf09 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:26.599041 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-90899270-b152-4e9d-8367-693d69f6cf09 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:26.599633 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-90899270-b152-4e9d-8367-693d69f6cf09 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:26.600535 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-90899270-b152-4e9d-8367-693d69f6cf09 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:26.601131 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-90899270-b152-4e9d-8367-693d69f6cf09 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:26.601696 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-90899270-b152-4e9d-8367-693d69f6cf09 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:26.933168 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-1a54efbe-09d0-41a2-ac89-152eb3c4186b tempest-ServersNegativeTestMultiTenantJSON-181611047 tempest-ServersNegativeTestMultiTenantJSON-181611047-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:26.934410 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-1a54efbe-09d0-41a2-ac89-152eb3c4186b tempest-ServersNegativeTestMultiTenantJSON-181611047 tempest-ServersNegativeTestMultiTenantJSON-181611047-project] [instance: d4525755-0392-4591-855c-2daf081ff9f3] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:26.961318 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1a54efbe-09d0-41a2-ac89-152eb3c4186b tempest-ServersNegativeTestMultiTenantJSON-181611047 tempest-ServersNegativeTestMultiTenantJSON-181611047-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:26.964394 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1a54efbe-09d0-41a2-ac89-152eb3c4186b tempest-ServersNegativeTestMultiTenantJSON-181611047 tempest-ServersNegativeTestMultiTenantJSON-181611047-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:26.966623 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1a54efbe-09d0-41a2-ac89-152eb3c4186b tempest-ServersNegativeTestMultiTenantJSON-181611047 tempest-ServersNegativeTestMultiTenantJSON-181611047-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:26.969270 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1a54efbe-09d0-41a2-ac89-152eb3c4186b tempest-ServersNegativeTestMultiTenantJSON-181611047 tempest-ServersNegativeTestMultiTenantJSON-181611047-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:26.972452 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1a54efbe-09d0-41a2-ac89-152eb3c4186b tempest-ServersNegativeTestMultiTenantJSON-181611047 tempest-ServersNegativeTestMultiTenantJSON-181611047-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:26.973064 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1a54efbe-09d0-41a2-ac89-152eb3c4186b tempest-ServersNegativeTestMultiTenantJSON-181611047 tempest-ServersNegativeTestMultiTenantJSON-181611047-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:26.991011 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-90899270-b152-4e9d-8367-693d69f6cf09 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:27.010629 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-90899270-b152-4e9d-8367-693d69f6cf09 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1517 microversion: 2.1 time: 0.420535 Aug 27 03:07:27.014505 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2491/4928] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:26 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1517 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:27.031836 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-1a54efbe-09d0-41a2-ac89-152eb3c4186b tempest-ServersNegativeTestMultiTenantJSON-181611047 tempest-ServersNegativeTestMultiTenantJSON-181611047-project] HTTP exception thrown: Instance d4525755-0392-4591-855c-2daf081ff9f3 could not be found. Aug 27 03:07:27.033882 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-1a54efbe-09d0-41a2-ac89-152eb3c4186b tempest-ServersNegativeTestMultiTenantJSON-181611047 tempest-ServersNegativeTestMultiTenantJSON-181611047-project] Request method failure captured: Aug 27 03:07:27.033882 n-d-852278-4 devstack@n-api.service[134052]: request: DELETE /compute/v2.1/servers/d4525755-0392-4591-855c-2daf081ff9f3 HTTP/1.1 Aug 27 03:07:27.033882 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 03:07:27.033882 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 03:07:27.033882 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 03:07:27.033882 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 03:07:27.033882 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 03:07:27.033882 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 03:07:27.033882 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 03:07:27.033882 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 03:07:27.033882 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYpX9rJKH8rsTRGRN41pjrobo8nByB48OrhHqCWmYBiEQyzGnhMx48793OW93G29BZf4LEmfv-rPt88myd7HTTke618z4P-BbGZZ8aIKPXKNBTawEVnrvZ3xBeKdlAKOJQUxhcLSQ8xVS76lfaVpOdAyVgR8M_0XLg_fVzFIx1ID2cU Aug 27 03:07:27.033882 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 03:07:27.033882 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 03:07:27.033882 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 03:07:27.033882 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 03:07:27.033882 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 03:07:27.033882 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 03:07:27.033882 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 5e29f939b28e4a1b8ef9bfadbf546583 Aug 27 03:07:27.033882 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-181611047 Aug 27 03:07:27.033882 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 03:07:27.033882 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 03:07:27.033882 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5e29f939b28e4a1b8ef9bfadbf546583"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_5e29f939b28e4a1b8ef9bfadbf546583", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5e29f939b28e4a1b8ef9bfadbf546583"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/5e29f939b28e4a1b8ef9bfadbf546583"}]}] Aug 27 03:07:27.033882 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-181611047 Aug 27 03:07:27.033882 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 5e29f939b28e4a1b8ef9bfadbf546583 Aug 27 03:07:27.033882 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-181611047 Aug 27 03:07:27.033882 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ServersNegativeTestMultiTenantJSON-181611047-project Aug 27 03:07:27.033882 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 03:07:27.033882 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 03:07:27.033882 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 8dd6cc106bcd4536814b64d0a75164f3 Aug 27 03:07:27.033882 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-181611047-project Aug 27 03:07:27.033882 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 03:07:27.033882 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance d4525755-0392-4591-855c-2daf081ff9f3 could not be found. Aug 27 03:07:27.033882 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': 'd4525755-0392-4591-855c-2daf081ff9f3'} Aug 27 03:07:27.033882 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:07:27.033882 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:07:27.033882 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:07:27.033882 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:07:27.033882 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:07:27.033882 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:07:27.033882 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:07:27.033882 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:07:27.033882 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:07:27.033882 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:07:27.033882 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4525755-0392-4591-855c-2daf081ff9f3 could not be found. Aug 27 03:07:27.033882 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:07:27.033882 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:07:27.033882 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:07:27.033882 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:07:27.033882 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:07:27.033882 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:07:27.033882 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:07:27.033882 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:07:27.033882 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:07:27.033882 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:07:27.033882 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 03:07:27.033882 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 03:07:27.033882 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 03:07:27.033882 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 03:07:27.033882 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:07:27.033882 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:07:27.033882 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:07:27.033882 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:07:27.038011 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4525755-0392-4591-855c-2daf081ff9f3 could not be found. Aug 27 03:07:27.038011 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:07:27.038011 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:07:27.038011 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:07:27.038011 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:07:27.038011 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:07:27.038011 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:07:27.038011 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:07:27.038011 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:07:27.038011 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4525755-0392-4591-855c-2daf081ff9f3 could not be found. Aug 27 03:07:27.038011 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:07:27.039365 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-1a54efbe-09d0-41a2-ac89-152eb3c4186b tempest-ServersNegativeTestMultiTenantJSON-181611047 tempest-ServersNegativeTestMultiTenantJSON-181611047-project] Returning 404 to user: Instance d4525755-0392-4591-855c-2daf081ff9f3 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:07:27.046025 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-1a54efbe-09d0-41a2-ac89-152eb3c4186b tempest-ServersNegativeTestMultiTenantJSON-181611047 tempest-ServersNegativeTestMultiTenantJSON-181611047-project] 10.222.0.70 "DELETE /compute/v2.1/servers/d4525755-0392-4591-855c-2daf081ff9f3" status: 404 len: 111 microversion: 2.1 time: 0.626590 Aug 27 03:07:27.046835 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2438/4929] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 03:07:26 2022] DELETE /compute/v2.1/servers/d4525755-0392-4591-855c-2daf081ff9f3 => generated 111 bytes in 628 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:07:27.057203 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-088ca0e7-6bd0-47c3-8d0d-8f939c92da34 tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:27.058154 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-088ca0e7-6bd0-47c3-8d0d-8f939c92da34 tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] [instance: d4525755-0392-4591-855c-2daf081ff9f3] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:27.069041 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-088ca0e7-6bd0-47c3-8d0d-8f939c92da34 tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:27.069758 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-088ca0e7-6bd0-47c3-8d0d-8f939c92da34 tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:27.070525 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-088ca0e7-6bd0-47c3-8d0d-8f939c92da34 tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:27.071711 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-088ca0e7-6bd0-47c3-8d0d-8f939c92da34 tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:27.072755 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-088ca0e7-6bd0-47c3-8d0d-8f939c92da34 tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:27.073549 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-088ca0e7-6bd0-47c3-8d0d-8f939c92da34 tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:27.276200 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-2e7f47c1-ce7e-43dc-a3bd-6a1408699ed3 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:27.277410 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-2e7f47c1-ce7e-43dc-a3bd-6a1408699ed3 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] [instance: 69be36fb-3a1b-480f-8613-5aa3881944ab] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:27.292327 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2e7f47c1-ce7e-43dc-a3bd-6a1408699ed3 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:27.293144 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2e7f47c1-ce7e-43dc-a3bd-6a1408699ed3 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:27.294445 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2e7f47c1-ce7e-43dc-a3bd-6a1408699ed3 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:27.298788 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2e7f47c1-ce7e-43dc-a3bd-6a1408699ed3 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:27.299438 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2e7f47c1-ce7e-43dc-a3bd-6a1408699ed3 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:27.300918 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2e7f47c1-ce7e-43dc-a3bd-6a1408699ed3 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:27.313324 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:07:27.525235 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-088ca0e7-6bd0-47c3-8d0d-8f939c92da34 tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b4ba598d3d451f9adf430ceb87df01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61112e2aab784cb9a8d84877896eb5be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:27.540836 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-088ca0e7-6bd0-47c3-8d0d-8f939c92da34 tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] 10.222.0.70 "GET /compute/v2.1/servers/d4525755-0392-4591-855c-2daf081ff9f3" status: 200 len: 1528 microversion: 2.1 time: 0.483966 Aug 27 03:07:27.542136 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2492/4930] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:27 2022] GET /compute/v2.1/servers/d4525755-0392-4591-855c-2daf081ff9f3 => generated 1528 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:27.567997 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-92bdf748-ccaa-4ac7-be41-d9881c488d07 tempest-ServersNegativeTestMultiTenantJSON-181611047 tempest-ServersNegativeTestMultiTenantJSON-181611047-project] Action: 'update', calling method: >, body: {"server": {"name": "d4525755-0392-4591-855c-2daf081ff9f3_new"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:07:27.570863 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-92bdf748-ccaa-4ac7-be41-d9881c488d07 tempest-ServersNegativeTestMultiTenantJSON-181611047 tempest-ServersNegativeTestMultiTenantJSON-181611047-project] [instance: d4525755-0392-4591-855c-2daf081ff9f3] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:27.577823 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-2e7f47c1-ce7e-43dc-a3bd-6a1408699ed3 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34c5fc51d324c8e8adb3b9c5cd30b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4333b5357f49e883b72e96bdafb682', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:27.581250 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-92bdf748-ccaa-4ac7-be41-d9881c488d07 tempest-ServersNegativeTestMultiTenantJSON-181611047 tempest-ServersNegativeTestMultiTenantJSON-181611047-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:27.582036 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-92bdf748-ccaa-4ac7-be41-d9881c488d07 tempest-ServersNegativeTestMultiTenantJSON-181611047 tempest-ServersNegativeTestMultiTenantJSON-181611047-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:27.582715 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-92bdf748-ccaa-4ac7-be41-d9881c488d07 tempest-ServersNegativeTestMultiTenantJSON-181611047 tempest-ServersNegativeTestMultiTenantJSON-181611047-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:27.583730 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-92bdf748-ccaa-4ac7-be41-d9881c488d07 tempest-ServersNegativeTestMultiTenantJSON-181611047 tempest-ServersNegativeTestMultiTenantJSON-181611047-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:27.584440 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-92bdf748-ccaa-4ac7-be41-d9881c488d07 tempest-ServersNegativeTestMultiTenantJSON-181611047 tempest-ServersNegativeTestMultiTenantJSON-181611047-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:27.585100 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-92bdf748-ccaa-4ac7-be41-d9881c488d07 tempest-ServersNegativeTestMultiTenantJSON-181611047 tempest-ServersNegativeTestMultiTenantJSON-181611047-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:27.595438 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-2e7f47c1-ce7e-43dc-a3bd-6a1408699ed3 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e34c5fc51d324c8e8adb3b9c5cd30b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4333b5357f49e883b72e96bdafb682', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:27.603034 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-92bdf748-ccaa-4ac7-be41-d9881c488d07 tempest-ServersNegativeTestMultiTenantJSON-181611047 tempest-ServersNegativeTestMultiTenantJSON-181611047-project] HTTP exception thrown: Instance d4525755-0392-4591-855c-2daf081ff9f3 could not be found. Aug 27 03:07:27.605308 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-92bdf748-ccaa-4ac7-be41-d9881c488d07 tempest-ServersNegativeTestMultiTenantJSON-181611047 tempest-ServersNegativeTestMultiTenantJSON-181611047-project] Request method failure captured: Aug 27 03:07:27.605308 n-d-852278-4 devstack@n-api.service[134051]: request: PUT /compute/v2.1/servers/d4525755-0392-4591-855c-2daf081ff9f3 HTTP/1.1 Aug 27 03:07:27.605308 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 03:07:27.605308 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 03:07:27.605308 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 03:07:27.605308 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 64 Aug 27 03:07:27.605308 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 03:07:27.605308 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 03:07:27.605308 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 03:07:27.605308 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 03:07:27.605308 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYpX9rJKH8rsTRGRN41pjrobo8nByB48OrhHqCWmYBiEQyzGnhMx48793OW93G29BZf4LEmfv-rPt88myd7HTTke618z4P-BbGZZ8aIKPXKNBTawEVnrvZ3xBeKdlAKOJQUxhcLSQ8xVS76lfaVpOdAyVgR8M_0XLg_fVzFIx1ID2cU Aug 27 03:07:27.605308 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 03:07:27.605308 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 03:07:27.605308 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 03:07:27.605308 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 03:07:27.605308 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 03:07:27.605308 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 03:07:27.605308 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 5e29f939b28e4a1b8ef9bfadbf546583 Aug 27 03:07:27.605308 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-181611047 Aug 27 03:07:27.605308 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 03:07:27.605308 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 03:07:27.605308 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5e29f939b28e4a1b8ef9bfadbf546583"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_5e29f939b28e4a1b8ef9bfadbf546583", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5e29f939b28e4a1b8ef9bfadbf546583"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/5e29f939b28e4a1b8ef9bfadbf546583"}]}] Aug 27 03:07:27.605308 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-181611047 Aug 27 03:07:27.605308 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 5e29f939b28e4a1b8ef9bfadbf546583 Aug 27 03:07:27.605308 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-181611047 Aug 27 03:07:27.605308 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ServersNegativeTestMultiTenantJSON-181611047-project Aug 27 03:07:27.605308 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 03:07:27.605308 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 03:07:27.605308 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 8dd6cc106bcd4536814b64d0a75164f3 Aug 27 03:07:27.605308 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-181611047-project Aug 27 03:07:27.605308 n-d-852278-4 devstack@n-api.service[134051]: Aug 27 03:07:27.605308 n-d-852278-4 devstack@n-api.service[134051]: {"server": {"name": "d4525755-0392-4591-855c-2daf081ff9f3_new"}} Aug 27 03:07:27.605308 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 03:07:27.605308 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance d4525755-0392-4591-855c-2daf081ff9f3 could not be found. Aug 27 03:07:27.605308 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': 'd4525755-0392-4591-855c-2daf081ff9f3', 'body': {'server': {'name': 'd4525755-0392-4591-855c-2daf081ff9f3_new'}}} Aug 27 03:07:27.605308 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:07:27.605308 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:07:27.605308 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:07:27.605308 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:07:27.605308 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:07:27.605308 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:07:27.605308 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:07:27.605308 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:07:27.605308 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:07:27.605308 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:07:27.605308 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4525755-0392-4591-855c-2daf081ff9f3 could not be found. Aug 27 03:07:27.605308 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:07:27.605308 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:07:27.605308 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:07:27.605308 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:07:27.605308 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:07:27.605308 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:07:27.605308 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:07:27.605308 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:07:27.605308 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:07:27.605308 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:07:27.605308 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:07:27.605308 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:07:27.605308 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:07:27.605308 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:07:27.605308 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:07:27.605308 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:07:27.605308 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 27 03:07:27.609613 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Aug 27 03:07:27.609613 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Aug 27 03:07:27.609613 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:07:27.609613 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:07:27.609613 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:07:27.609613 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:07:27.609613 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4525755-0392-4591-855c-2daf081ff9f3 could not be found. Aug 27 03:07:27.609613 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:07:27.609613 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:07:27.609613 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:07:27.609613 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:07:27.609613 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:07:27.609613 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:07:27.609613 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:07:27.609613 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:07:27.609613 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4525755-0392-4591-855c-2daf081ff9f3 could not be found. Aug 27 03:07:27.609613 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:07:27.611513 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-92bdf748-ccaa-4ac7-be41-d9881c488d07 tempest-ServersNegativeTestMultiTenantJSON-181611047 tempest-ServersNegativeTestMultiTenantJSON-181611047-project] Returning 404 to user: Instance d4525755-0392-4591-855c-2daf081ff9f3 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:07:27.612247 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-2e7f47c1-ce7e-43dc-a3bd-6a1408699ed3 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e34c5fc51d324c8e8adb3b9c5cd30b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4333b5357f49e883b72e96bdafb682', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:27.612904 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-92bdf748-ccaa-4ac7-be41-d9881c488d07 tempest-ServersNegativeTestMultiTenantJSON-181611047 tempest-ServersNegativeTestMultiTenantJSON-181611047-project] 10.222.0.70 "PUT /compute/v2.1/servers/d4525755-0392-4591-855c-2daf081ff9f3" status: 404 len: 111 microversion: 2.1 time: 0.051320 Aug 27 03:07:27.613661 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2493/4931] 10.222.0.70 () {60 vars in 1256 bytes} [Sat Aug 27 03:07:27 2022] PUT /compute/v2.1/servers/d4525755-0392-4591-855c-2daf081ff9f3 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 03:07:27.623662 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-42fdc2f0-1930-4714-b9f9-f6537d3bc56d tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:27.624831 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-42fdc2f0-1930-4714-b9f9-f6537d3bc56d tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] [instance: d4525755-0392-4591-855c-2daf081ff9f3] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:27.632918 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-42fdc2f0-1930-4714-b9f9-f6537d3bc56d tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:27.634122 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-2e7f47c1-ce7e-43dc-a3bd-6a1408699ed3 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] 10.222.0.70 "GET /compute/v2.1/servers/69be36fb-3a1b-480f-8613-5aa3881944ab" status: 200 len: 1330 microversion: 2.47 time: 0.362079 Aug 27 03:07:27.638106 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-42fdc2f0-1930-4714-b9f9-f6537d3bc56d tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:27.639025 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-42fdc2f0-1930-4714-b9f9-f6537d3bc56d tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:27.639976 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-42fdc2f0-1930-4714-b9f9-f6537d3bc56d tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:27.640693 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-42fdc2f0-1930-4714-b9f9-f6537d3bc56d tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:27.641835 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-42fdc2f0-1930-4714-b9f9-f6537d3bc56d tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:27.649557 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2439/4932] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:07:27 2022] GET /compute/v2.1/servers/69be36fb-3a1b-480f-8613-5aa3881944ab => generated 1330 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:07:27.683736 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-42fdc2f0-1930-4714-b9f9-f6537d3bc56d tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] [instance: d4525755-0392-4591-855c-2daf081ff9f3] Going to try to terminate instance {{(pid=134051) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:07:27.732849 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:07:27.879067 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-42fdc2f0-1930-4714-b9f9-f6537d3bc56d tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] 10.222.0.70 "DELETE /compute/v2.1/servers/d4525755-0392-4591-855c-2daf081ff9f3" status: 204 len: 0 microversion: 2.1 time: 0.259793 Aug 27 03:07:27.880415 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2494/4933] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 03:07:27 2022] DELETE /compute/v2.1/servers/d4525755-0392-4591-855c-2daf081ff9f3 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:07:27.889133 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-48e159e3-31e2-47e3-b955-30a99e1378cd tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:27.890513 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-48e159e3-31e2-47e3-b955-30a99e1378cd tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] [instance: d4525755-0392-4591-855c-2daf081ff9f3] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:27.898956 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-48e159e3-31e2-47e3-b955-30a99e1378cd tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:27.899613 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-48e159e3-31e2-47e3-b955-30a99e1378cd tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:27.900304 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-48e159e3-31e2-47e3-b955-30a99e1378cd tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:27.901513 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-48e159e3-31e2-47e3-b955-30a99e1378cd tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:27.902113 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-48e159e3-31e2-47e3-b955-30a99e1378cd tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:27.902757 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-48e159e3-31e2-47e3-b955-30a99e1378cd tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:28.033480 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0b8fbf38-e338-47bc-8aca-155eccbdd652 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:28.034436 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-0b8fbf38-e338-47bc-8aca-155eccbdd652 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:28.043573 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0b8fbf38-e338-47bc-8aca-155eccbdd652 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:28.050942 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0b8fbf38-e338-47bc-8aca-155eccbdd652 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:28.051911 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0b8fbf38-e338-47bc-8aca-155eccbdd652 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:28.053182 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0b8fbf38-e338-47bc-8aca-155eccbdd652 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:28.053796 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0b8fbf38-e338-47bc-8aca-155eccbdd652 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:28.054396 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0b8fbf38-e338-47bc-8aca-155eccbdd652 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:28.187508 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-48e159e3-31e2-47e3-b955-30a99e1378cd tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b4ba598d3d451f9adf430ceb87df01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61112e2aab784cb9a8d84877896eb5be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:28.203172 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-48e159e3-31e2-47e3-b955-30a99e1378cd tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] 10.222.0.70 "GET /compute/v2.1/servers/d4525755-0392-4591-855c-2daf081ff9f3" status: 200 len: 1534 microversion: 2.1 time: 0.317570 Aug 27 03:07:28.208949 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2440/4934] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:27 2022] GET /compute/v2.1/servers/d4525755-0392-4591-855c-2daf081ff9f3 => generated 1534 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:28.327924 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-0b8fbf38-e338-47bc-8aca-155eccbdd652 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:28.338515 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-0b8fbf38-e338-47bc-8aca-155eccbdd652 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1517 microversion: 2.1 time: 0.309569 Aug 27 03:07:28.343221 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2495/4935] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:28 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1517 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:07:28.665217 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f3f07b6c-bfc7-41b7-baa0-85671a2a0c4e tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:28.666878 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-f3f07b6c-bfc7-41b7-baa0-85671a2a0c4e tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] [instance: 69be36fb-3a1b-480f-8613-5aa3881944ab] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:28.686554 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f3f07b6c-bfc7-41b7-baa0-85671a2a0c4e tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:28.688330 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f3f07b6c-bfc7-41b7-baa0-85671a2a0c4e tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:28.689042 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f3f07b6c-bfc7-41b7-baa0-85671a2a0c4e tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:28.690340 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f3f07b6c-bfc7-41b7-baa0-85671a2a0c4e tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:28.692122 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f3f07b6c-bfc7-41b7-baa0-85671a2a0c4e tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:28.692852 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f3f07b6c-bfc7-41b7-baa0-85671a2a0c4e tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:28.912723 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-f3f07b6c-bfc7-41b7-baa0-85671a2a0c4e tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34c5fc51d324c8e8adb3b9c5cd30b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4333b5357f49e883b72e96bdafb682', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:28.934281 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-f3f07b6c-bfc7-41b7-baa0-85671a2a0c4e tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e34c5fc51d324c8e8adb3b9c5cd30b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4333b5357f49e883b72e96bdafb682', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:28.945251 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-f3f07b6c-bfc7-41b7-baa0-85671a2a0c4e tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e34c5fc51d324c8e8adb3b9c5cd30b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4333b5357f49e883b72e96bdafb682', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:28.949184 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f3f07b6c-bfc7-41b7-baa0-85671a2a0c4e tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] 10.222.0.70 "GET /compute/v2.1/servers/69be36fb-3a1b-480f-8613-5aa3881944ab" status: 200 len: 1336 microversion: 2.47 time: 0.289195 Aug 27 03:07:28.955313 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2441/4936] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:07:28 2022] GET /compute/v2.1/servers/69be36fb-3a1b-480f-8613-5aa3881944ab => generated 1336 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:07:29.239731 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-667163a1-4492-421f-8986-331a1fad7844 tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:29.241063 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-667163a1-4492-421f-8986-331a1fad7844 tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] [instance: d4525755-0392-4591-855c-2daf081ff9f3] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:29.258071 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-667163a1-4492-421f-8986-331a1fad7844 tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:29.261161 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-667163a1-4492-421f-8986-331a1fad7844 tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:29.261788 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-667163a1-4492-421f-8986-331a1fad7844 tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:29.262953 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-667163a1-4492-421f-8986-331a1fad7844 tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:29.263621 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-667163a1-4492-421f-8986-331a1fad7844 tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:29.267906 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-667163a1-4492-421f-8986-331a1fad7844 tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:29.367420 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-378f0ecf-08f6-4cd5-b1d4-2c632a5c06cb tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:29.368024 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-378f0ecf-08f6-4cd5-b1d4-2c632a5c06cb tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:29.374907 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-378f0ecf-08f6-4cd5-b1d4-2c632a5c06cb tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:29.378680 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-378f0ecf-08f6-4cd5-b1d4-2c632a5c06cb tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:29.389083 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-378f0ecf-08f6-4cd5-b1d4-2c632a5c06cb tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:29.390148 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-378f0ecf-08f6-4cd5-b1d4-2c632a5c06cb tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:29.390623 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-378f0ecf-08f6-4cd5-b1d4-2c632a5c06cb tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:29.391052 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-378f0ecf-08f6-4cd5-b1d4-2c632a5c06cb tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:30.174521 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-378f0ecf-08f6-4cd5-b1d4-2c632a5c06cb tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:30.209776 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-378f0ecf-08f6-4cd5-b1d4-2c632a5c06cb tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1517 microversion: 2.1 time: 0.846428 Aug 27 03:07:30.239581 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2442/4937] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:29 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1517 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:07:30.241382 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-667163a1-4492-421f-8986-331a1fad7844 tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b4ba598d3d451f9adf430ceb87df01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61112e2aab784cb9a8d84877896eb5be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:30.253549 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-203ed950-f3cb-43ac-8d66-0b1229d1108b tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:30.254391 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-203ed950-f3cb-43ac-8d66-0b1229d1108b tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] [instance: 69be36fb-3a1b-480f-8613-5aa3881944ab] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:30.257364 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-667163a1-4492-421f-8986-331a1fad7844 tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] 10.222.0.70 "GET /compute/v2.1/servers/d4525755-0392-4591-855c-2daf081ff9f3" status: 200 len: 1534 microversion: 2.1 time: 1.020254 Aug 27 03:07:30.261727 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2496/4938] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:29 2022] GET /compute/v2.1/servers/d4525755-0392-4591-855c-2daf081ff9f3 => generated 1534 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:30.263327 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-203ed950-f3cb-43ac-8d66-0b1229d1108b tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:30.264042 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-203ed950-f3cb-43ac-8d66-0b1229d1108b tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:30.264769 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-203ed950-f3cb-43ac-8d66-0b1229d1108b tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:30.266627 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-203ed950-f3cb-43ac-8d66-0b1229d1108b tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:30.267313 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-203ed950-f3cb-43ac-8d66-0b1229d1108b tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:30.267952 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-203ed950-f3cb-43ac-8d66-0b1229d1108b tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:30.393722 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-203ed950-f3cb-43ac-8d66-0b1229d1108b tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34c5fc51d324c8e8adb3b9c5cd30b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4333b5357f49e883b72e96bdafb682', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:30.405661 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-203ed950-f3cb-43ac-8d66-0b1229d1108b tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e34c5fc51d324c8e8adb3b9c5cd30b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4333b5357f49e883b72e96bdafb682', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:30.407425 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-203ed950-f3cb-43ac-8d66-0b1229d1108b tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e34c5fc51d324c8e8adb3b9c5cd30b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4333b5357f49e883b72e96bdafb682', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:30.410200 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-203ed950-f3cb-43ac-8d66-0b1229d1108b tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] 10.222.0.70 "GET /compute/v2.1/servers/69be36fb-3a1b-480f-8613-5aa3881944ab" status: 200 len: 1336 microversion: 2.47 time: 0.164939 Aug 27 03:07:30.411932 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2443/4939] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:07:30 2022] GET /compute/v2.1/servers/69be36fb-3a1b-480f-8613-5aa3881944ab => generated 1336 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:07:31.256202 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-49f1c063-8549-41ec-b971-c85c01abcf77 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:31.257133 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-49f1c063-8549-41ec-b971-c85c01abcf77 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:31.278036 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-49f1c063-8549-41ec-b971-c85c01abcf77 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:31.282125 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-49f1c063-8549-41ec-b971-c85c01abcf77 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:31.284656 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-49f1c063-8549-41ec-b971-c85c01abcf77 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:31.286195 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0f0dfea3-a7fc-4641-8071-3d9e9f876400 tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:31.287373 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-0f0dfea3-a7fc-4641-8071-3d9e9f876400 tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] [instance: d4525755-0392-4591-855c-2daf081ff9f3] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:31.288411 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-49f1c063-8549-41ec-b971-c85c01abcf77 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:31.292342 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-49f1c063-8549-41ec-b971-c85c01abcf77 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:31.293381 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-49f1c063-8549-41ec-b971-c85c01abcf77 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:31.303660 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0f0dfea3-a7fc-4641-8071-3d9e9f876400 tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:31.304729 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0f0dfea3-a7fc-4641-8071-3d9e9f876400 tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:31.305392 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0f0dfea3-a7fc-4641-8071-3d9e9f876400 tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:31.307466 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0f0dfea3-a7fc-4641-8071-3d9e9f876400 tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:31.308118 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0f0dfea3-a7fc-4641-8071-3d9e9f876400 tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:31.309875 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0f0dfea3-a7fc-4641-8071-3d9e9f876400 tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:31.768875 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-49f1c063-8549-41ec-b971-c85c01abcf77 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:31.799838 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-49f1c063-8549-41ec-b971-c85c01abcf77 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1517 microversion: 2.1 time: 0.550142 Aug 27 03:07:31.809296 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2497/4940] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:31 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1517 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:31.837778 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b62bf320-ef9e-4707-9563-a3ab40acc3ba tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:31.852741 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b62bf320-ef9e-4707-9563-a3ab40acc3ba tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] [instance: 69be36fb-3a1b-480f-8613-5aa3881944ab] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:31.859679 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0f0dfea3-a7fc-4641-8071-3d9e9f876400 tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b4ba598d3d451f9adf430ceb87df01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61112e2aab784cb9a8d84877896eb5be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:31.880335 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-0f0dfea3-a7fc-4641-8071-3d9e9f876400 tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] 10.222.0.70 "GET /compute/v2.1/servers/d4525755-0392-4591-855c-2daf081ff9f3" status: 200 len: 1534 microversion: 2.1 time: 0.596540 Aug 27 03:07:31.905278 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b62bf320-ef9e-4707-9563-a3ab40acc3ba tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:31.905856 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b62bf320-ef9e-4707-9563-a3ab40acc3ba tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:31.906325 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b62bf320-ef9e-4707-9563-a3ab40acc3ba tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:31.910945 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2444/4941] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:31 2022] GET /compute/v2.1/servers/d4525755-0392-4591-855c-2daf081ff9f3 => generated 1534 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:31.920903 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b62bf320-ef9e-4707-9563-a3ab40acc3ba tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:31.921319 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b62bf320-ef9e-4707-9563-a3ab40acc3ba tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:31.931369 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b62bf320-ef9e-4707-9563-a3ab40acc3ba tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:31.951193 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-e1e9b807-17e4-44eb-a0d8-7e20630b2607 req-50e6a0d2-07fd-490a-8d0d-97a8b41c2d13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4525755-0392-4591-855c-2daf081ff9f3", "name": "network-vif-deleted", "tag": "0b2b5452-c0ab-40cb-a7b3-f2b36d3d27f9"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:07:32.007971 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-e1e9b807-17e4-44eb-a0d8-7e20630b2607 req-50e6a0d2-07fd-490a-8d0d-97a8b41c2d13 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:32.009040 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-e1e9b807-17e4-44eb-a0d8-7e20630b2607 req-50e6a0d2-07fd-490a-8d0d-97a8b41c2d13 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:32.010421 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-e1e9b807-17e4-44eb-a0d8-7e20630b2607 req-50e6a0d2-07fd-490a-8d0d-97a8b41c2d13 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:32.043943 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-e1e9b807-17e4-44eb-a0d8-7e20630b2607 req-50e6a0d2-07fd-490a-8d0d-97a8b41c2d13 service nova] Creating event network-vif-deleted:0b2b5452-c0ab-40cb-a7b3-f2b36d3d27f9 for instance d4525755-0392-4591-855c-2daf081ff9f3 on n-h1-852278-4 Aug 27 03:07:32.067902 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-e1e9b807-17e4-44eb-a0d8-7e20630b2607 req-50e6a0d2-07fd-490a-8d0d-97a8b41c2d13 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133629 Aug 27 03:07:32.068920 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2445/4942] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:07:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:07:32.229781 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-b62bf320-ef9e-4707-9563-a3ab40acc3ba tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34c5fc51d324c8e8adb3b9c5cd30b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4333b5357f49e883b72e96bdafb682', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:32.244862 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-b62bf320-ef9e-4707-9563-a3ab40acc3ba tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e34c5fc51d324c8e8adb3b9c5cd30b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4333b5357f49e883b72e96bdafb682', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:32.246335 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-b62bf320-ef9e-4707-9563-a3ab40acc3ba tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e34c5fc51d324c8e8adb3b9c5cd30b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4333b5357f49e883b72e96bdafb682', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:32.247750 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b62bf320-ef9e-4707-9563-a3ab40acc3ba tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] 10.222.0.70 "GET /compute/v2.1/servers/69be36fb-3a1b-480f-8613-5aa3881944ab" status: 200 len: 1357 microversion: 2.47 time: 0.437154 Aug 27 03:07:32.248342 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2498/4943] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:07:31 2022] GET /compute/v2.1/servers/69be36fb-3a1b-480f-8613-5aa3881944ab => generated 1357 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:07:32.275392 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f8b74ab4-4ff7-4d73-a735-eb5b8dba7f5e tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:07:32.278531 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-f8b74ab4-4ff7-4d73-a735-eb5b8dba7f5e tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] [instance: 69be36fb-3a1b-480f-8613-5aa3881944ab] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:32.289948 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f8b74ab4-4ff7-4d73-a735-eb5b8dba7f5e tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:32.293971 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f8b74ab4-4ff7-4d73-a735-eb5b8dba7f5e tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:32.294826 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f8b74ab4-4ff7-4d73-a735-eb5b8dba7f5e tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:32.296179 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f8b74ab4-4ff7-4d73-a735-eb5b8dba7f5e tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:32.297771 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f8b74ab4-4ff7-4d73-a735-eb5b8dba7f5e tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:32.298335 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f8b74ab4-4ff7-4d73-a735-eb5b8dba7f5e tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:32.469907 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-f8b74ab4-4ff7-4d73-a735-eb5b8dba7f5e tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Flavor limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:07:32.470307 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-f8b74ab4-4ff7-4d73-a735-eb5b8dba7f5e tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Image limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:07:32.470782 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-f8b74ab4-4ff7-4d73-a735-eb5b8dba7f5e tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Flavor pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:07:32.471185 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-f8b74ab4-4ff7-4d73-a735-eb5b8dba7f5e tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Image pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:07:32.471625 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-f8b74ab4-4ff7-4d73-a735-eb5b8dba7f5e tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:07:32.619141 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-f8b74ab4-4ff7-4d73-a735-eb5b8dba7f5e tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] [instance: 69be36fb-3a1b-480f-8613-5aa3881944ab] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:32.628195 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f8b74ab4-4ff7-4d73-a735-eb5b8dba7f5e tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:32.629102 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f8b74ab4-4ff7-4d73-a735-eb5b8dba7f5e tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:32.629678 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f8b74ab4-4ff7-4d73-a735-eb5b8dba7f5e tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:32.630534 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f8b74ab4-4ff7-4d73-a735-eb5b8dba7f5e tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:32.631444 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f8b74ab4-4ff7-4d73-a735-eb5b8dba7f5e tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:32.632011 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f8b74ab4-4ff7-4d73-a735-eb5b8dba7f5e tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:32.694898 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f8b74ab4-4ff7-4d73-a735-eb5b8dba7f5e tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] 10.222.0.70 "POST /compute/v2.1/servers/69be36fb-3a1b-480f-8613-5aa3881944ab/action" status: 202 len: 1079 microversion: 2.47 time: 0.423786 Aug 27 03:07:32.695532 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2446/4944] 10.222.0.70 () {62 vars in 1319 bytes} [Sat Aug 27 03:07:32 2022] POST /compute/v2.1/servers/69be36fb-3a1b-480f-8613-5aa3881944ab/action => generated 1079 bytes in 425 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Aug 27 03:07:32.714564 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f80f048c-2cab-47b3-b959-34878d6cc641 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:32.720609 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-f80f048c-2cab-47b3-b959-34878d6cc641 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] [instance: 69be36fb-3a1b-480f-8613-5aa3881944ab] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:32.812499 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f80f048c-2cab-47b3-b959-34878d6cc641 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:32.824501 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f80f048c-2cab-47b3-b959-34878d6cc641 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:32.825307 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f80f048c-2cab-47b3-b959-34878d6cc641 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:32.831781 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f80f048c-2cab-47b3-b959-34878d6cc641 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:32.833247 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f80f048c-2cab-47b3-b959-34878d6cc641 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:32.835329 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-7056ebf8-9706-4b59-91cb-6573d2f9d59b tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:32.836332 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f80f048c-2cab-47b3-b959-34878d6cc641 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:32.837457 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-7056ebf8-9706-4b59-91cb-6573d2f9d59b tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:32.902669 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7056ebf8-9706-4b59-91cb-6573d2f9d59b tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:32.903930 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7056ebf8-9706-4b59-91cb-6573d2f9d59b tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:32.903930 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7056ebf8-9706-4b59-91cb-6573d2f9d59b tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:32.910075 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7056ebf8-9706-4b59-91cb-6573d2f9d59b tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:32.916248 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7056ebf8-9706-4b59-91cb-6573d2f9d59b tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:32.925683 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7056ebf8-9706-4b59-91cb-6573d2f9d59b tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:33.114413 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-f80f048c-2cab-47b3-b959-34878d6cc641 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34c5fc51d324c8e8adb3b9c5cd30b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4333b5357f49e883b72e96bdafb682', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:33.136921 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-f80f048c-2cab-47b3-b959-34878d6cc641 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e34c5fc51d324c8e8adb3b9c5cd30b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4333b5357f49e883b72e96bdafb682', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:33.139161 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-f80f048c-2cab-47b3-b959-34878d6cc641 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e34c5fc51d324c8e8adb3b9c5cd30b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4333b5357f49e883b72e96bdafb682', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:33.140786 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-f80f048c-2cab-47b3-b959-34878d6cc641 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] 10.222.0.70 "GET /compute/v2.1/servers/69be36fb-3a1b-480f-8613-5aa3881944ab" status: 200 len: 1366 microversion: 2.47 time: 0.431310 Aug 27 03:07:33.142011 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2499/4945] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:07:32 2022] GET /compute/v2.1/servers/69be36fb-3a1b-480f-8613-5aa3881944ab => generated 1366 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:07:33.150453 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a82f4967-91bd-4ba5-8b51-d7d01794b30c tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:33.151362 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-a82f4967-91bd-4ba5-8b51-d7d01794b30c tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] [instance: d4525755-0392-4591-855c-2daf081ff9f3] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:33.166148 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a82f4967-91bd-4ba5-8b51-d7d01794b30c tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:33.173145 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a82f4967-91bd-4ba5-8b51-d7d01794b30c tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:33.173801 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a82f4967-91bd-4ba5-8b51-d7d01794b30c tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:33.174646 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a82f4967-91bd-4ba5-8b51-d7d01794b30c tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:33.183453 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a82f4967-91bd-4ba5-8b51-d7d01794b30c tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:33.184036 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a82f4967-91bd-4ba5-8b51-d7d01794b30c tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:33.209303 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-a82f4967-91bd-4ba5-8b51-d7d01794b30c tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] HTTP exception thrown: Instance d4525755-0392-4591-855c-2daf081ff9f3 could not be found. Aug 27 03:07:33.211396 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a82f4967-91bd-4ba5-8b51-d7d01794b30c tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Request method failure captured: Aug 27 03:07:33.211396 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/d4525755-0392-4591-855c-2daf081ff9f3 HTTP/1.1 Aug 27 03:07:33.211396 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 03:07:33.211396 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 03:07:33.211396 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 03:07:33.211396 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 03:07:33.211396 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 03:07:33.211396 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 03:07:33.211396 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 03:07:33.211396 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 03:07:33.211396 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYpK88Kysn5JrqD0-KGCCnYa99bE4SYXLCgJYNIJTp9bdwxKdrQycrxSDIS2XbbXloAJyUeeuMKue2QWaBsY8QA-YCyRe26FKKX12ONFDS-6cbd6pw_dVp8mxlVGbr2zarPcvlJNGvhu_i7u-MjOGgMTpqx6Jv2Izp_4awEUqgyhi-o Aug 27 03:07:33.211396 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 03:07:33.211396 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 03:07:33.211396 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 03:07:33.211396 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 03:07:33.211396 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 03:07:33.211396 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 03:07:33.211396 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 61112e2aab784cb9a8d84877896eb5be Aug 27 03:07:33.211396 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1128915589 Aug 27 03:07:33.211396 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 03:07:33.211396 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 03:07:33.211396 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/61112e2aab784cb9a8d84877896eb5be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_61112e2aab784cb9a8d84877896eb5be", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/61112e2aab784cb9a8d84877896eb5be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/61112e2aab784cb9a8d84877896eb5be"}]}] Aug 27 03:07:33.211396 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1128915589 Aug 27 03:07:33.211396 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 61112e2aab784cb9a8d84877896eb5be Aug 27 03:07:33.211396 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1128915589 Aug 27 03:07:33.211396 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1128915589-project Aug 27 03:07:33.211396 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 03:07:33.211396 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 03:07:33.211396 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: b5b4ba598d3d451f9adf430ceb87df01 Aug 27 03:07:33.211396 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1128915589-project Aug 27 03:07:33.211396 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 03:07:33.211396 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance d4525755-0392-4591-855c-2daf081ff9f3 could not be found. Aug 27 03:07:33.211396 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': 'd4525755-0392-4591-855c-2daf081ff9f3'} Aug 27 03:07:33.211396 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:07:33.211396 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:07:33.211396 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:07:33.211396 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:07:33.211396 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:07:33.211396 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:07:33.211396 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:07:33.211396 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:07:33.211396 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:07:33.211396 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:07:33.211396 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4525755-0392-4591-855c-2daf081ff9f3 could not be found. Aug 27 03:07:33.211396 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:07:33.211396 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:07:33.211396 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:07:33.211396 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:07:33.211396 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:07:33.211396 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:07:33.211396 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:07:33.211396 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:07:33.211396 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:07:33.211396 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:07:33.211396 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:07:33.211396 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:07:33.211396 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:07:33.211396 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:07:33.211396 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:07:33.211396 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:07:33.211396 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4525755-0392-4591-855c-2daf081ff9f3 could not be found. Aug 27 03:07:33.211396 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:07:33.215009 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:07:33.215009 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:07:33.215009 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:07:33.215009 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:07:33.215009 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:07:33.215009 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:07:33.215009 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:07:33.215009 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4525755-0392-4591-855c-2daf081ff9f3 could not be found. Aug 27 03:07:33.215009 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:07:33.219124 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a82f4967-91bd-4ba5-8b51-d7d01794b30c tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] Returning 404 to user: Instance d4525755-0392-4591-855c-2daf081ff9f3 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:07:33.220375 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a82f4967-91bd-4ba5-8b51-d7d01794b30c tempest-ServersNegativeTestMultiTenantJSON-1128915589 tempest-ServersNegativeTestMultiTenantJSON-1128915589-project] 10.222.0.70 "GET /compute/v2.1/servers/d4525755-0392-4591-855c-2daf081ff9f3" status: 404 len: 111 microversion: 2.1 time: 0.077052 Aug 27 03:07:33.223879 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2500/4946] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:33 2022] GET /compute/v2.1/servers/d4525755-0392-4591-855c-2daf081ff9f3 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:07:33.304518 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-7056ebf8-9706-4b59-91cb-6573d2f9d59b tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:33.314413 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-7056ebf8-9706-4b59-91cb-6573d2f9d59b tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1517 microversion: 2.1 time: 0.486483 Aug 27 03:07:33.320631 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2447/4947] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:32 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1517 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:34.170347 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d6232a97-03b3-4dbd-9b6b-34cd2c807d83 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:34.170976 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d6232a97-03b3-4dbd-9b6b-34cd2c807d83 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] [instance: 69be36fb-3a1b-480f-8613-5aa3881944ab] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:34.183664 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:07:34.186381 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d6232a97-03b3-4dbd-9b6b-34cd2c807d83 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:34.210163 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d6232a97-03b3-4dbd-9b6b-34cd2c807d83 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:34.211140 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d6232a97-03b3-4dbd-9b6b-34cd2c807d83 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:34.215822 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d6232a97-03b3-4dbd-9b6b-34cd2c807d83 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:34.231156 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d6232a97-03b3-4dbd-9b6b-34cd2c807d83 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:34.231603 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d6232a97-03b3-4dbd-9b6b-34cd2c807d83 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:34.345754 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-38bb8217-0b58-4137-9d88-4a9bc1d15cd2 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:34.347129 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-38bb8217-0b58-4137-9d88-4a9bc1d15cd2 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:34.349380 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=4 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:07:34.389005 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-38bb8217-0b58-4137-9d88-4a9bc1d15cd2 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:34.397472 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-38bb8217-0b58-4137-9d88-4a9bc1d15cd2 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:34.404468 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-38bb8217-0b58-4137-9d88-4a9bc1d15cd2 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:34.418569 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-38bb8217-0b58-4137-9d88-4a9bc1d15cd2 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:34.419168 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-38bb8217-0b58-4137-9d88-4a9bc1d15cd2 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:34.419667 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-38bb8217-0b58-4137-9d88-4a9bc1d15cd2 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:34.737247 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d6232a97-03b3-4dbd-9b6b-34cd2c807d83 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34c5fc51d324c8e8adb3b9c5cd30b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4333b5357f49e883b72e96bdafb682', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:34.751983 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d6232a97-03b3-4dbd-9b6b-34cd2c807d83 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e34c5fc51d324c8e8adb3b9c5cd30b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4333b5357f49e883b72e96bdafb682', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:34.759440 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d6232a97-03b3-4dbd-9b6b-34cd2c807d83 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e34c5fc51d324c8e8adb3b9c5cd30b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4333b5357f49e883b72e96bdafb682', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:34.760896 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d6232a97-03b3-4dbd-9b6b-34cd2c807d83 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] 10.222.0.70 "GET /compute/v2.1/servers/69be36fb-3a1b-480f-8613-5aa3881944ab" status: 200 len: 1366 microversion: 2.47 time: 0.596342 Aug 27 03:07:34.763990 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2501/4948] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:07:34 2022] GET /compute/v2.1/servers/69be36fb-3a1b-480f-8613-5aa3881944ab => generated 1366 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:07:34.822924 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=14 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:07:35.375168 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-38bb8217-0b58-4137-9d88-4a9bc1d15cd2 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:35.390495 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-38bb8217-0b58-4137-9d88-4a9bc1d15cd2 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1517 microversion: 2.1 time: 1.045187 Aug 27 03:07:35.406004 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2448/4949] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:34 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1517 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:07:35.793353 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7812558c-4845-4af0-8271-db60800123d8 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:35.794086 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-7812558c-4845-4af0-8271-db60800123d8 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] [instance: 69be36fb-3a1b-480f-8613-5aa3881944ab] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:35.809741 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7812558c-4845-4af0-8271-db60800123d8 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:35.810273 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7812558c-4845-4af0-8271-db60800123d8 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:35.810719 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7812558c-4845-4af0-8271-db60800123d8 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:35.811444 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7812558c-4845-4af0-8271-db60800123d8 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:35.811886 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7812558c-4845-4af0-8271-db60800123d8 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:35.812325 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7812558c-4845-4af0-8271-db60800123d8 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:36.280438 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-7812558c-4845-4af0-8271-db60800123d8 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34c5fc51d324c8e8adb3b9c5cd30b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4333b5357f49e883b72e96bdafb682', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:36.295666 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-7812558c-4845-4af0-8271-db60800123d8 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e34c5fc51d324c8e8adb3b9c5cd30b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4333b5357f49e883b72e96bdafb682', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:36.297941 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-7812558c-4845-4af0-8271-db60800123d8 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e34c5fc51d324c8e8adb3b9c5cd30b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4333b5357f49e883b72e96bdafb682', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:36.307618 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-7812558c-4845-4af0-8271-db60800123d8 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] 10.222.0.70 "GET /compute/v2.1/servers/69be36fb-3a1b-480f-8613-5aa3881944ab" status: 200 len: 1366 microversion: 2.47 time: 0.521320 Aug 27 03:07:36.309637 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2502/4950] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:07:35 2022] GET /compute/v2.1/servers/69be36fb-3a1b-480f-8613-5aa3881944ab => generated 1366 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:07:36.412988 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-35ebb7d1-f7c7-400a-94eb-c3544f1bde30 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:36.414964 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-35ebb7d1-f7c7-400a-94eb-c3544f1bde30 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:36.424819 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-35ebb7d1-f7c7-400a-94eb-c3544f1bde30 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:36.430383 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-35ebb7d1-f7c7-400a-94eb-c3544f1bde30 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:36.431437 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-35ebb7d1-f7c7-400a-94eb-c3544f1bde30 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:36.432359 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-35ebb7d1-f7c7-400a-94eb-c3544f1bde30 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:36.432985 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-35ebb7d1-f7c7-400a-94eb-c3544f1bde30 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:36.433690 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-35ebb7d1-f7c7-400a-94eb-c3544f1bde30 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:36.778166 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-35ebb7d1-f7c7-400a-94eb-c3544f1bde30 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:36.787079 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-35ebb7d1-f7c7-400a-94eb-c3544f1bde30 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1517 microversion: 2.1 time: 0.378737 Aug 27 03:07:36.805310 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2449/4951] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:36 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1517 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:37.331807 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d7cd59c1-9388-46ff-928b-66f61982a248 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:37.333108 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d7cd59c1-9388-46ff-928b-66f61982a248 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] [instance: 69be36fb-3a1b-480f-8613-5aa3881944ab] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:37.347834 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d7cd59c1-9388-46ff-928b-66f61982a248 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:37.348635 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d7cd59c1-9388-46ff-928b-66f61982a248 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:37.350336 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d7cd59c1-9388-46ff-928b-66f61982a248 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:37.360361 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d7cd59c1-9388-46ff-928b-66f61982a248 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:37.361068 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d7cd59c1-9388-46ff-928b-66f61982a248 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:37.361527 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d7cd59c1-9388-46ff-928b-66f61982a248 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:37.477262 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d7cd59c1-9388-46ff-928b-66f61982a248 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34c5fc51d324c8e8adb3b9c5cd30b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4333b5357f49e883b72e96bdafb682', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:37.495586 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d7cd59c1-9388-46ff-928b-66f61982a248 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e34c5fc51d324c8e8adb3b9c5cd30b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4333b5357f49e883b72e96bdafb682', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:37.497942 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d7cd59c1-9388-46ff-928b-66f61982a248 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e34c5fc51d324c8e8adb3b9c5cd30b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4333b5357f49e883b72e96bdafb682', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:37.507229 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d7cd59c1-9388-46ff-928b-66f61982a248 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] 10.222.0.70 "GET /compute/v2.1/servers/69be36fb-3a1b-480f-8613-5aa3881944ab" status: 200 len: 1366 microversion: 2.47 time: 0.179870 Aug 27 03:07:37.527783 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2503/4952] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:07:37 2022] GET /compute/v2.1/servers/69be36fb-3a1b-480f-8613-5aa3881944ab => generated 1366 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:07:37.826849 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-578652d6-b2ad-4d6e-a9a5-d9a6dac3515d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:37.827696 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-578652d6-b2ad-4d6e-a9a5-d9a6dac3515d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:37.838654 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-578652d6-b2ad-4d6e-a9a5-d9a6dac3515d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:37.839145 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-578652d6-b2ad-4d6e-a9a5-d9a6dac3515d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:37.839583 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-578652d6-b2ad-4d6e-a9a5-d9a6dac3515d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:37.840298 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-578652d6-b2ad-4d6e-a9a5-d9a6dac3515d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:37.840770 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-578652d6-b2ad-4d6e-a9a5-d9a6dac3515d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:37.841247 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-578652d6-b2ad-4d6e-a9a5-d9a6dac3515d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:38.342137 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-578652d6-b2ad-4d6e-a9a5-d9a6dac3515d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:38.351180 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-578652d6-b2ad-4d6e-a9a5-d9a6dac3515d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1517 microversion: 2.1 time: 0.528848 Aug 27 03:07:38.352038 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2450/4953] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:37 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1517 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:38.539950 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ad7cb76f-00a6-41c3-8f2f-fc331bcded87 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:38.540643 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-ad7cb76f-00a6-41c3-8f2f-fc331bcded87 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] [instance: 69be36fb-3a1b-480f-8613-5aa3881944ab] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:38.550087 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ad7cb76f-00a6-41c3-8f2f-fc331bcded87 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:38.555345 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ad7cb76f-00a6-41c3-8f2f-fc331bcded87 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:38.556346 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ad7cb76f-00a6-41c3-8f2f-fc331bcded87 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:38.559016 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ad7cb76f-00a6-41c3-8f2f-fc331bcded87 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:38.559660 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ad7cb76f-00a6-41c3-8f2f-fc331bcded87 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:38.561163 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ad7cb76f-00a6-41c3-8f2f-fc331bcded87 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:38.762932 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-ad7cb76f-00a6-41c3-8f2f-fc331bcded87 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34c5fc51d324c8e8adb3b9c5cd30b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4333b5357f49e883b72e96bdafb682', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:38.779174 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-ad7cb76f-00a6-41c3-8f2f-fc331bcded87 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e34c5fc51d324c8e8adb3b9c5cd30b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4333b5357f49e883b72e96bdafb682', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:38.781117 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-ad7cb76f-00a6-41c3-8f2f-fc331bcded87 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e34c5fc51d324c8e8adb3b9c5cd30b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4333b5357f49e883b72e96bdafb682', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:38.793223 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ad7cb76f-00a6-41c3-8f2f-fc331bcded87 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] 10.222.0.70 "GET /compute/v2.1/servers/69be36fb-3a1b-480f-8613-5aa3881944ab" status: 200 len: 1366 microversion: 2.47 time: 0.258053 Aug 27 03:07:38.795905 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2504/4954] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:07:38 2022] GET /compute/v2.1/servers/69be36fb-3a1b-480f-8613-5aa3881944ab => generated 1366 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:07:39.081746 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-4dd8303e-eda5-4d58-8514-ee3571e7a322 req-c5b5d800-2238-4db0-af9d-156dafa40020 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72ffd032-b609-4e42-90d9-5454ac648eeb", "name": "network-vif-plugged", "status": "completed", "tag": "7a8cf46b-6b49-415b-b564-a266edc89536"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:07:39.107187 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-4dd8303e-eda5-4d58-8514-ee3571e7a322 req-c5b5d800-2238-4db0-af9d-156dafa40020 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:39.109665 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-4dd8303e-eda5-4d58-8514-ee3571e7a322 req-c5b5d800-2238-4db0-af9d-156dafa40020 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:39.110271 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-4dd8303e-eda5-4d58-8514-ee3571e7a322 req-c5b5d800-2238-4db0-af9d-156dafa40020 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:39.135147 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-4dd8303e-eda5-4d58-8514-ee3571e7a322 req-c5b5d800-2238-4db0-af9d-156dafa40020 service nova] Creating event network-vif-plugged:7a8cf46b-6b49-415b-b564-a266edc89536 for instance 72ffd032-b609-4e42-90d9-5454ac648eeb on n-h1-852278-4 Aug 27 03:07:39.145297 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-4dd8303e-eda5-4d58-8514-ee3571e7a322 req-c5b5d800-2238-4db0-af9d-156dafa40020 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069146 Aug 27 03:07:39.150030 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2451/4955] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:07:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:07:39.377631 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-42456b0b-8a7c-4e85-9b08-06ed10ee2b56 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:39.378626 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-42456b0b-8a7c-4e85-9b08-06ed10ee2b56 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:39.391344 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-42456b0b-8a7c-4e85-9b08-06ed10ee2b56 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:39.392519 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-42456b0b-8a7c-4e85-9b08-06ed10ee2b56 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:39.393465 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-42456b0b-8a7c-4e85-9b08-06ed10ee2b56 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:39.394743 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-42456b0b-8a7c-4e85-9b08-06ed10ee2b56 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:39.396855 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-42456b0b-8a7c-4e85-9b08-06ed10ee2b56 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:39.398196 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-42456b0b-8a7c-4e85-9b08-06ed10ee2b56 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:39.819223 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-304faa3f-c8fc-49f7-b009-a6cb645bcbff tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:39.820672 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-304faa3f-c8fc-49f7-b009-a6cb645bcbff tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] [instance: 69be36fb-3a1b-480f-8613-5aa3881944ab] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:39.846266 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-304faa3f-c8fc-49f7-b009-a6cb645bcbff tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:39.847269 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-304faa3f-c8fc-49f7-b009-a6cb645bcbff tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:39.847862 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-304faa3f-c8fc-49f7-b009-a6cb645bcbff tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:39.848959 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-304faa3f-c8fc-49f7-b009-a6cb645bcbff tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:39.850625 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-304faa3f-c8fc-49f7-b009-a6cb645bcbff tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:39.851370 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-304faa3f-c8fc-49f7-b009-a6cb645bcbff tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:40.021769 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-42456b0b-8a7c-4e85-9b08-06ed10ee2b56 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:40.035228 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-42456b0b-8a7c-4e85-9b08-06ed10ee2b56 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1517 microversion: 2.1 time: 0.662624 Aug 27 03:07:40.048372 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2505/4956] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:39 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1517 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:40.121710 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-304faa3f-c8fc-49f7-b009-a6cb645bcbff tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34c5fc51d324c8e8adb3b9c5cd30b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4333b5357f49e883b72e96bdafb682', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:40.137189 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-304faa3f-c8fc-49f7-b009-a6cb645bcbff tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e34c5fc51d324c8e8adb3b9c5cd30b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4333b5357f49e883b72e96bdafb682', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:40.140292 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-304faa3f-c8fc-49f7-b009-a6cb645bcbff tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e34c5fc51d324c8e8adb3b9c5cd30b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4333b5357f49e883b72e96bdafb682', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:40.142157 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-304faa3f-c8fc-49f7-b009-a6cb645bcbff tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] 10.222.0.70 "GET /compute/v2.1/servers/69be36fb-3a1b-480f-8613-5aa3881944ab" status: 200 len: 1366 microversion: 2.47 time: 0.327377 Aug 27 03:07:40.162757 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2452/4957] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:07:39 2022] GET /compute/v2.1/servers/69be36fb-3a1b-480f-8613-5aa3881944ab => generated 1366 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:07:41.057819 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d7003ca8-aadc-4139-b23a-787ee4b5bd1e tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:41.059123 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d7003ca8-aadc-4139-b23a-787ee4b5bd1e tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:41.082934 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d7003ca8-aadc-4139-b23a-787ee4b5bd1e tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:41.083488 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d7003ca8-aadc-4139-b23a-787ee4b5bd1e tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:41.086239 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d7003ca8-aadc-4139-b23a-787ee4b5bd1e tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:41.086993 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d7003ca8-aadc-4139-b23a-787ee4b5bd1e tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:41.087454 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d7003ca8-aadc-4139-b23a-787ee4b5bd1e tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:41.087885 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d7003ca8-aadc-4139-b23a-787ee4b5bd1e tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:41.207516 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0301a049-c201-4e5c-a97c-6ca6563ecbad tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:41.207516 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-0301a049-c201-4e5c-a97c-6ca6563ecbad tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] [instance: 69be36fb-3a1b-480f-8613-5aa3881944ab] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:41.207516 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0301a049-c201-4e5c-a97c-6ca6563ecbad tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:41.207516 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0301a049-c201-4e5c-a97c-6ca6563ecbad tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:41.207516 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0301a049-c201-4e5c-a97c-6ca6563ecbad tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:41.207516 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0301a049-c201-4e5c-a97c-6ca6563ecbad tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:41.207516 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0301a049-c201-4e5c-a97c-6ca6563ecbad tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:41.207516 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0301a049-c201-4e5c-a97c-6ca6563ecbad tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:41.423260 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d7003ca8-aadc-4139-b23a-787ee4b5bd1e tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:41.432014 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d7003ca8-aadc-4139-b23a-787ee4b5bd1e tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1517 microversion: 2.1 time: 0.379612 Aug 27 03:07:41.443663 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2506/4958] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:41 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1517 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:41.486932 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0301a049-c201-4e5c-a97c-6ca6563ecbad tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34c5fc51d324c8e8adb3b9c5cd30b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4333b5357f49e883b72e96bdafb682', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:41.500735 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0301a049-c201-4e5c-a97c-6ca6563ecbad tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e34c5fc51d324c8e8adb3b9c5cd30b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4333b5357f49e883b72e96bdafb682', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:41.502790 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0301a049-c201-4e5c-a97c-6ca6563ecbad tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e34c5fc51d324c8e8adb3b9c5cd30b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4333b5357f49e883b72e96bdafb682', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:41.504377 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-0301a049-c201-4e5c-a97c-6ca6563ecbad tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] 10.222.0.70 "GET /compute/v2.1/servers/69be36fb-3a1b-480f-8613-5aa3881944ab" status: 200 len: 1366 microversion: 2.47 time: 0.340133 Aug 27 03:07:41.521947 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2453/4959] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:07:41 2022] GET /compute/v2.1/servers/69be36fb-3a1b-480f-8613-5aa3881944ab => generated 1366 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:07:42.462308 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3c858a8e-5b46-4602-881f-f00e41b3f40b tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:42.463929 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-3c858a8e-5b46-4602-881f-f00e41b3f40b tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:42.482270 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3c858a8e-5b46-4602-881f-f00e41b3f40b tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:42.488730 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3c858a8e-5b46-4602-881f-f00e41b3f40b tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:42.492291 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3c858a8e-5b46-4602-881f-f00e41b3f40b tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:42.495660 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3c858a8e-5b46-4602-881f-f00e41b3f40b tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:42.498511 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3c858a8e-5b46-4602-881f-f00e41b3f40b tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:42.499201 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3c858a8e-5b46-4602-881f-f00e41b3f40b tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:42.530573 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-cb59f12d-bdd4-4823-bb80-f25e395d2f01 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:42.531936 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-cb59f12d-bdd4-4823-bb80-f25e395d2f01 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] [instance: 69be36fb-3a1b-480f-8613-5aa3881944ab] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:42.545264 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cb59f12d-bdd4-4823-bb80-f25e395d2f01 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:42.546059 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cb59f12d-bdd4-4823-bb80-f25e395d2f01 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:42.548459 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cb59f12d-bdd4-4823-bb80-f25e395d2f01 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:42.549394 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cb59f12d-bdd4-4823-bb80-f25e395d2f01 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:42.551228 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cb59f12d-bdd4-4823-bb80-f25e395d2f01 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:42.551852 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cb59f12d-bdd4-4823-bb80-f25e395d2f01 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:42.775596 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-cb59f12d-bdd4-4823-bb80-f25e395d2f01 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34c5fc51d324c8e8adb3b9c5cd30b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4333b5357f49e883b72e96bdafb682', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:42.790961 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-cb59f12d-bdd4-4823-bb80-f25e395d2f01 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e34c5fc51d324c8e8adb3b9c5cd30b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4333b5357f49e883b72e96bdafb682', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:42.794623 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-cb59f12d-bdd4-4823-bb80-f25e395d2f01 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e34c5fc51d324c8e8adb3b9c5cd30b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4333b5357f49e883b72e96bdafb682', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:42.795893 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-cb59f12d-bdd4-4823-bb80-f25e395d2f01 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] 10.222.0.70 "GET /compute/v2.1/servers/69be36fb-3a1b-480f-8613-5aa3881944ab" status: 200 len: 1366 microversion: 2.47 time: 0.272338 Aug 27 03:07:42.810933 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2454/4960] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:07:42 2022] GET /compute/v2.1/servers/69be36fb-3a1b-480f-8613-5aa3881944ab => generated 1366 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:07:42.920950 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-3c858a8e-5b46-4602-881f-f00e41b3f40b tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:42.930231 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-3c858a8e-5b46-4602-881f-f00e41b3f40b tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1517 microversion: 2.1 time: 0.471978 Aug 27 03:07:42.931144 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2507/4961] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:42 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1517 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:43.824430 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0b11539f-8f3c-47e5-9317-e3b31335746d tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:43.825668 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-0b11539f-8f3c-47e5-9317-e3b31335746d tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] [instance: 69be36fb-3a1b-480f-8613-5aa3881944ab] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:43.842458 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0b11539f-8f3c-47e5-9317-e3b31335746d tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:43.844751 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0b11539f-8f3c-47e5-9317-e3b31335746d tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:43.845908 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0b11539f-8f3c-47e5-9317-e3b31335746d tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:43.849002 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0b11539f-8f3c-47e5-9317-e3b31335746d tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:43.849802 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0b11539f-8f3c-47e5-9317-e3b31335746d tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:43.850998 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0b11539f-8f3c-47e5-9317-e3b31335746d tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:43.866418 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:07:43.952408 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-968c77ef-6cae-4dd2-bca0-a5f2ffee3f4d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:43.953176 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-968c77ef-6cae-4dd2-bca0-a5f2ffee3f4d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:43.971932 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-968c77ef-6cae-4dd2-bca0-a5f2ffee3f4d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:43.973627 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-968c77ef-6cae-4dd2-bca0-a5f2ffee3f4d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:43.978901 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-968c77ef-6cae-4dd2-bca0-a5f2ffee3f4d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:43.985442 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-968c77ef-6cae-4dd2-bca0-a5f2ffee3f4d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:43.986406 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-968c77ef-6cae-4dd2-bca0-a5f2ffee3f4d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:43.988897 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-968c77ef-6cae-4dd2-bca0-a5f2ffee3f4d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:44.035274 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0b11539f-8f3c-47e5-9317-e3b31335746d tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34c5fc51d324c8e8adb3b9c5cd30b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4333b5357f49e883b72e96bdafb682', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:44.057736 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0b11539f-8f3c-47e5-9317-e3b31335746d tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e34c5fc51d324c8e8adb3b9c5cd30b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4333b5357f49e883b72e96bdafb682', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:44.059580 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0b11539f-8f3c-47e5-9317-e3b31335746d tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e34c5fc51d324c8e8adb3b9c5cd30b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4333b5357f49e883b72e96bdafb682', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:44.069315 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-0b11539f-8f3c-47e5-9317-e3b31335746d tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] 10.222.0.70 "GET /compute/v2.1/servers/69be36fb-3a1b-480f-8613-5aa3881944ab" status: 200 len: 1366 microversion: 2.47 time: 0.249618 Aug 27 03:07:44.070535 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2455/4962] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:07:43 2022] GET /compute/v2.1/servers/69be36fb-3a1b-480f-8613-5aa3881944ab => generated 1366 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:07:44.463028 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-968c77ef-6cae-4dd2-bca0-a5f2ffee3f4d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:44.472044 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-968c77ef-6cae-4dd2-bca0-a5f2ffee3f4d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1504 microversion: 2.1 time: 0.524844 Aug 27 03:07:44.477438 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2508/4963] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:43 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1504 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:07:44.500217 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-97dc1daf-9384-4e8d-abea-417a7da9eb53 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:44.502201 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-97dc1daf-9384-4e8d-abea-417a7da9eb53 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:44.519621 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-97dc1daf-9384-4e8d-abea-417a7da9eb53 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:44.523994 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-97dc1daf-9384-4e8d-abea-417a7da9eb53 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:44.526713 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-97dc1daf-9384-4e8d-abea-417a7da9eb53 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:44.528970 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-97dc1daf-9384-4e8d-abea-417a7da9eb53 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:44.543734 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-97dc1daf-9384-4e8d-abea-417a7da9eb53 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:44.548551 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-97dc1daf-9384-4e8d-abea-417a7da9eb53 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:45.079127 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-97dc1daf-9384-4e8d-abea-417a7da9eb53 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:45.094754 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-6586d3e8-efc9-4b67-baec-bbc034a01f23 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:45.096375 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-6586d3e8-efc9-4b67-baec-bbc034a01f23 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] [instance: 69be36fb-3a1b-480f-8613-5aa3881944ab] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:45.107764 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6586d3e8-efc9-4b67-baec-bbc034a01f23 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:45.113912 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-97dc1daf-9384-4e8d-abea-417a7da9eb53 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1504 microversion: 2.1 time: 0.618685 Aug 27 03:07:45.114793 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6586d3e8-efc9-4b67-baec-bbc034a01f23 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:45.115692 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6586d3e8-efc9-4b67-baec-bbc034a01f23 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:45.116764 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6586d3e8-efc9-4b67-baec-bbc034a01f23 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:45.117408 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6586d3e8-efc9-4b67-baec-bbc034a01f23 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:45.118007 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6586d3e8-efc9-4b67-baec-bbc034a01f23 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:45.122178 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2456/4964] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:44 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1504 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:45.146033 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-948ba1dd-6ca3-4850-a58e-54a45ec93567 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:45.147390 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-948ba1dd-6ca3-4850-a58e-54a45ec93567 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:45.165112 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-948ba1dd-6ca3-4850-a58e-54a45ec93567 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:45.166031 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-948ba1dd-6ca3-4850-a58e-54a45ec93567 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:45.166664 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-948ba1dd-6ca3-4850-a58e-54a45ec93567 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:45.167548 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-948ba1dd-6ca3-4850-a58e-54a45ec93567 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:45.168165 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-948ba1dd-6ca3-4850-a58e-54a45ec93567 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:45.174702 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-948ba1dd-6ca3-4850-a58e-54a45ec93567 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:45.959252 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-6586d3e8-efc9-4b67-baec-bbc034a01f23 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34c5fc51d324c8e8adb3b9c5cd30b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4333b5357f49e883b72e96bdafb682', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:45.993722 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-6586d3e8-efc9-4b67-baec-bbc034a01f23 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e34c5fc51d324c8e8adb3b9c5cd30b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4333b5357f49e883b72e96bdafb682', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:45.995561 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-6586d3e8-efc9-4b67-baec-bbc034a01f23 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e34c5fc51d324c8e8adb3b9c5cd30b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4333b5357f49e883b72e96bdafb682', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:45.997063 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-6586d3e8-efc9-4b67-baec-bbc034a01f23 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] 10.222.0.70 "GET /compute/v2.1/servers/69be36fb-3a1b-480f-8613-5aa3881944ab" status: 200 len: 1366 microversion: 2.47 time: 0.907706 Aug 27 03:07:46.000639 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2509/4965] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:07:45 2022] GET /compute/v2.1/servers/69be36fb-3a1b-480f-8613-5aa3881944ab => generated 1366 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:07:46.535243 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-948ba1dd-6ca3-4850-a58e-54a45ec93567 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:46.546265 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-948ba1dd-6ca3-4850-a58e-54a45ec93567 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1504 microversion: 2.1 time: 1.407733 Aug 27 03:07:46.563596 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2457/4966] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:45 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1504 bytes in 1412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:46.580650 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-41aa269c-aa54-4332-96b4-839d4417c729 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:07:46.593958 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-41aa269c-aa54-4332-96b4-839d4417c729 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] HTTP exception thrown: Instance 5e7db986-8056-41b4-9b20-0c16dc673e6b has no mapping to a cell. Aug 27 03:07:46.607805 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-41aa269c-aa54-4332-96b4-839d4417c729 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Request method failure captured: Aug 27 03:07:46.607805 n-d-852278-4 devstack@n-api.service[134051]: request: POST /compute/v2.1/servers/5e7db986-8056-41b4-9b20-0c16dc673e6b/action HTTP/1.1 Aug 27 03:07:46.607805 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 03:07:46.607805 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 03:07:46.607805 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 03:07:46.607805 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 15 Aug 27 03:07:46.607805 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 03:07:46.607805 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 03:07:46.607805 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 03:07:46.607805 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 03:07:46.607805 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYnkbLTKVFjPQ5m3U2fG0N9Vjn4DkHnl17m4V7uHpwM3jvJACULLjB_xlJxNaWj4ki5CLI0R9EDG2yAGWVsjkvndQFsX9xXnPLGqFClIfHjZt1hqpj87tFD2RLalZegHNDkz7eKDMcWIs2wG0Lp8X-uNjMToWPkkmABfSYkxwHfHBds Aug 27 03:07:46.607805 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 03:07:46.607805 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 03:07:46.607805 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 03:07:46.607805 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 03:07:46.607805 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 03:07:46.607805 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 03:07:46.607805 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 3b9e672ac89e41ff82355daa83e852bd Aug 27 03:07:46.607805 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:07:46.607805 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 03:07:46.607805 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 03:07:46.607805 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3b9e672ac89e41ff82355daa83e852bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3b9e672ac89e41ff82355daa83e852bd", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3b9e672ac89e41ff82355daa83e852bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3b9e672ac89e41ff82355daa83e852bd"}]}] Aug 27 03:07:46.607805 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:07:46.607805 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 3b9e672ac89e41ff82355daa83e852bd Aug 27 03:07:46.607805 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:07:46.607805 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ServersNegativeTestJSON-1795266674-project Aug 27 03:07:46.607805 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 03:07:46.607805 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 03:07:46.607805 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 204c90820f6d4c64b31367aaf098325c Aug 27 03:07:46.607805 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ServersNegativeTestJSON-1795266674-project Aug 27 03:07:46.607805 n-d-852278-4 devstack@n-api.service[134051]: Aug 27 03:07:46.607805 n-d-852278-4 devstack@n-api.service[134051]: {"os-stop": {}} Aug 27 03:07:46.607805 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 03:07:46.607805 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance 5e7db986-8056-41b4-9b20-0c16dc673e6b has no mapping to a cell. Aug 27 03:07:46.607805 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '5e7db986-8056-41b4-9b20-0c16dc673e6b', 'body': {'os-stop': {}}} Aug 27 03:07:46.607805 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:07:46.607805 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:07:46.607805 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1408, in _get_instance Aug 27 03:07:46.607805 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Aug 27 03:07:46.607805 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 03:07:46.607805 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 03:07:46.607805 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Aug 27 03:07:46.607805 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Aug 27 03:07:46.607805 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 03:07:46.607805 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 03:07:46.607805 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Aug 27 03:07:46.607805 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Aug 27 03:07:46.607805 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance 5e7db986-8056-41b4-9b20-0c16dc673e6b has no mapping to a cell. Aug 27 03:07:46.607805 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:07:46.607805 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:07:46.607805 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:07:46.607805 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:07:46.607805 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:07:46.607805 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:07:46.607805 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:07:46.607805 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:07:46.607805 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:07:46.607805 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:07:46.607805 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1441, in _stop_server Aug 27 03:07:46.607805 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Aug 27 03:07:46.607805 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1415, in _get_instance Aug 27 03:07:46.607805 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:07:46.607805 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e7db986-8056-41b4-9b20-0c16dc673e6b has no mapping to a cell. Aug 27 03:07:46.611398 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:07:46.611398 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:07:46.611398 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:07:46.611398 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:07:46.611398 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:07:46.611398 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:07:46.611398 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:07:46.611398 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:07:46.611398 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e7db986-8056-41b4-9b20-0c16dc673e6b has no mapping to a cell. Aug 27 03:07:46.611398 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:07:46.612991 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-41aa269c-aa54-4332-96b4-839d4417c729 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Returning 404 to user: Instance 5e7db986-8056-41b4-9b20-0c16dc673e6b has no mapping to a cell. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:07:46.613946 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-41aa269c-aa54-4332-96b4-839d4417c729 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "POST /compute/v2.1/servers/5e7db986-8056-41b4-9b20-0c16dc673e6b/action" status: 404 len: 117 microversion: 2.1 time: 0.049074 Aug 27 03:07:46.619700 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2510/4967] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:07:46 2022] POST /compute/v2.1/servers/5e7db986-8056-41b4-9b20-0c16dc673e6b/action => generated 117 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:07:46.626057 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c1f1faa5-5880-4f5b-b589-6f3ddd766c2d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:46.627392 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-c1f1faa5-5880-4f5b-b589-6f3ddd766c2d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:46.675010 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c1f1faa5-5880-4f5b-b589-6f3ddd766c2d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:46.680070 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c1f1faa5-5880-4f5b-b589-6f3ddd766c2d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:46.689229 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c1f1faa5-5880-4f5b-b589-6f3ddd766c2d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:46.690099 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c1f1faa5-5880-4f5b-b589-6f3ddd766c2d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:46.695459 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c1f1faa5-5880-4f5b-b589-6f3ddd766c2d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:46.698091 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c1f1faa5-5880-4f5b-b589-6f3ddd766c2d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:47.026067 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-202ba520-dc50-4673-a26b-61e6094df765 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:47.035044 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-202ba520-dc50-4673-a26b-61e6094df765 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] [instance: 69be36fb-3a1b-480f-8613-5aa3881944ab] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:47.051647 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-202ba520-dc50-4673-a26b-61e6094df765 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:47.054522 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-202ba520-dc50-4673-a26b-61e6094df765 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:47.057798 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-202ba520-dc50-4673-a26b-61e6094df765 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:47.063367 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-202ba520-dc50-4673-a26b-61e6094df765 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:47.064368 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-202ba520-dc50-4673-a26b-61e6094df765 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:47.065089 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-202ba520-dc50-4673-a26b-61e6094df765 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:47.321353 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-202ba520-dc50-4673-a26b-61e6094df765 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34c5fc51d324c8e8adb3b9c5cd30b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4333b5357f49e883b72e96bdafb682', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:47.337084 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-202ba520-dc50-4673-a26b-61e6094df765 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e34c5fc51d324c8e8adb3b9c5cd30b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4333b5357f49e883b72e96bdafb682', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:47.341166 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-202ba520-dc50-4673-a26b-61e6094df765 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e34c5fc51d324c8e8adb3b9c5cd30b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4333b5357f49e883b72e96bdafb682', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:47.345677 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-202ba520-dc50-4673-a26b-61e6094df765 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] 10.222.0.70 "GET /compute/v2.1/servers/69be36fb-3a1b-480f-8613-5aa3881944ab" status: 200 len: 1366 microversion: 2.47 time: 0.322784 Aug 27 03:07:47.346526 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2511/4968] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:07:47 2022] GET /compute/v2.1/servers/69be36fb-3a1b-480f-8613-5aa3881944ab => generated 1366 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:07:47.378568 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-c1f1faa5-5880-4f5b-b589-6f3ddd766c2d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:47.394126 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c1f1faa5-5880-4f5b-b589-6f3ddd766c2d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1504 microversion: 2.1 time: 0.772842 Aug 27 03:07:47.396771 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2458/4969] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:46 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1504 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:47.419000 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-00faf5ed-a37a-4336-add1-0ef06fee9923 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:47.421425 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-00faf5ed-a37a-4336-add1-0ef06fee9923 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:47.435636 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-00faf5ed-a37a-4336-add1-0ef06fee9923 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:47.440757 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-00faf5ed-a37a-4336-add1-0ef06fee9923 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:47.441253 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-00faf5ed-a37a-4336-add1-0ef06fee9923 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:47.443202 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-00faf5ed-a37a-4336-add1-0ef06fee9923 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:47.445078 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-00faf5ed-a37a-4336-add1-0ef06fee9923 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:47.445555 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-00faf5ed-a37a-4336-add1-0ef06fee9923 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:47.481460 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:07:47.850192 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-00faf5ed-a37a-4336-add1-0ef06fee9923 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:47.866125 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-00faf5ed-a37a-4336-add1-0ef06fee9923 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1504 microversion: 2.1 time: 0.447856 Aug 27 03:07:47.881847 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2512/4970] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:47 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1504 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:47.892455 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-be004244-9d62-4a05-9e66-9f807521ac36 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:07:47.893003 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-be004244-9d62-4a05-9e66-9f807521ac36 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 76e3c65c-7788-4cdc-a359-cbaa96743dd4] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:47.903983 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:07:47.913213 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-be004244-9d62-4a05-9e66-9f807521ac36 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] HTTP exception thrown: Instance 76e3c65c-7788-4cdc-a359-cbaa96743dd4 could not be found. Aug 27 03:07:47.922163 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-be004244-9d62-4a05-9e66-9f807521ac36 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Request method failure captured: Aug 27 03:07:47.922163 n-d-852278-4 devstack@n-api.service[134052]: request: POST /compute/v2.1/servers/76e3c65c-7788-4cdc-a359-cbaa96743dd4/action HTTP/1.1 Aug 27 03:07:47.922163 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 03:07:47.922163 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 03:07:47.922163 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 03:07:47.922163 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 15 Aug 27 03:07:47.922163 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 03:07:47.922163 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 03:07:47.922163 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 03:07:47.922163 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 03:07:47.922163 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYnkbLTKVFjPQ5m3U2fG0N9Vjn4DkHnl17m4V7uHpwM3jvJACULLjB_xlJxNaWj4ki5CLI0R9EDG2yAGWVsjkvndQFsX9xXnPLGqFClIfHjZt1hqpj87tFD2RLalZegHNDkz7eKDMcWIs2wG0Lp8X-uNjMToWPkkmABfSYkxwHfHBds Aug 27 03:07:47.922163 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 03:07:47.922163 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 03:07:47.922163 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 03:07:47.922163 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 03:07:47.922163 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 03:07:47.922163 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 03:07:47.922163 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 3b9e672ac89e41ff82355daa83e852bd Aug 27 03:07:47.922163 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:07:47.922163 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 03:07:47.922163 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 03:07:47.922163 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3b9e672ac89e41ff82355daa83e852bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3b9e672ac89e41ff82355daa83e852bd", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3b9e672ac89e41ff82355daa83e852bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3b9e672ac89e41ff82355daa83e852bd"}]}] Aug 27 03:07:47.922163 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:07:47.922163 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 3b9e672ac89e41ff82355daa83e852bd Aug 27 03:07:47.922163 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:07:47.922163 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ServersNegativeTestJSON-1795266674-project Aug 27 03:07:47.922163 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 03:07:47.922163 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 03:07:47.922163 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 204c90820f6d4c64b31367aaf098325c Aug 27 03:07:47.922163 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ServersNegativeTestJSON-1795266674-project Aug 27 03:07:47.922163 n-d-852278-4 devstack@n-api.service[134052]: Aug 27 03:07:47.922163 n-d-852278-4 devstack@n-api.service[134052]: {"suspend": {}} Aug 27 03:07:47.922163 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 03:07:47.922163 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance 76e3c65c-7788-4cdc-a359-cbaa96743dd4 could not be found. Aug 27 03:07:47.922163 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '76e3c65c-7788-4cdc-a359-cbaa96743dd4', 'body': {'suspend': {}}} Aug 27 03:07:47.922163 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:07:47.922163 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:07:47.922163 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:07:47.922163 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:07:47.922163 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:07:47.922163 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:07:47.922163 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 03:07:47.922163 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 03:07:47.922163 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76e3c65c-7788-4cdc-a359-cbaa96743dd4 could not be found. Aug 27 03:07:47.922163 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:07:47.922163 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:07:47.922163 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:07:47.922163 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:07:47.922163 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:07:47.922163 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:07:47.922163 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:07:47.922163 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:07:47.922163 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:07:47.922163 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:07:47.922163 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Aug 27 03:07:47.922163 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Aug 27 03:07:47.922163 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:07:47.922163 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:07:47.922163 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76e3c65c-7788-4cdc-a359-cbaa96743dd4 could not be found. Aug 27 03:07:47.922163 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:07:47.922163 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:07:47.922163 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:07:47.922163 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:07:47.922163 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:07:47.922163 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:07:47.926240 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:07:47.926240 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:07:47.926240 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76e3c65c-7788-4cdc-a359-cbaa96743dd4 could not be found. Aug 27 03:07:47.926240 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:07:47.926240 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-be004244-9d62-4a05-9e66-9f807521ac36 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Returning 404 to user: Instance 76e3c65c-7788-4cdc-a359-cbaa96743dd4 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:07:47.926240 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-be004244-9d62-4a05-9e66-9f807521ac36 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "POST /compute/v2.1/servers/76e3c65c-7788-4cdc-a359-cbaa96743dd4/action" status: 404 len: 111 microversion: 2.1 time: 0.037622 Aug 27 03:07:47.929967 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2459/4971] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:07:47 2022] POST /compute/v2.1/servers/76e3c65c-7788-4cdc-a359-cbaa96743dd4/action => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:07:47.935589 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-bd6213b2-03e0-4cfe-bab5-0436744a0412 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:47.936617 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-bd6213b2-03e0-4cfe-bab5-0436744a0412 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:47.945212 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bd6213b2-03e0-4cfe-bab5-0436744a0412 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:47.945762 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bd6213b2-03e0-4cfe-bab5-0436744a0412 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:47.946182 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bd6213b2-03e0-4cfe-bab5-0436744a0412 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:47.949184 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bd6213b2-03e0-4cfe-bab5-0436744a0412 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:47.949659 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bd6213b2-03e0-4cfe-bab5-0436744a0412 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:47.950094 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bd6213b2-03e0-4cfe-bab5-0436744a0412 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:48.378579 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0568bdf3-c237-485b-b6af-81ff272a819b tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:48.379537 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-0568bdf3-c237-485b-b6af-81ff272a819b tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] [instance: 69be36fb-3a1b-480f-8613-5aa3881944ab] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:48.396182 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0568bdf3-c237-485b-b6af-81ff272a819b tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:48.397783 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0568bdf3-c237-485b-b6af-81ff272a819b tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:48.399534 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0568bdf3-c237-485b-b6af-81ff272a819b tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:48.400878 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0568bdf3-c237-485b-b6af-81ff272a819b tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:48.403590 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0568bdf3-c237-485b-b6af-81ff272a819b tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:48.404273 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0568bdf3-c237-485b-b6af-81ff272a819b tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:48.419926 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-bd6213b2-03e0-4cfe-bab5-0436744a0412 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:48.434148 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-bd6213b2-03e0-4cfe-bab5-0436744a0412 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1504 microversion: 2.1 time: 0.502500 Aug 27 03:07:48.453877 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2513/4972] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:47 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1504 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:07:48.469059 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-baee3434-d9cf-4fe4-9b5b-1c8191dafe83 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:48.470495 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-baee3434-d9cf-4fe4-9b5b-1c8191dafe83 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:48.497380 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-baee3434-d9cf-4fe4-9b5b-1c8191dafe83 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:48.504271 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-baee3434-d9cf-4fe4-9b5b-1c8191dafe83 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:48.504766 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-baee3434-d9cf-4fe4-9b5b-1c8191dafe83 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:48.508726 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-baee3434-d9cf-4fe4-9b5b-1c8191dafe83 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:48.511459 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-baee3434-d9cf-4fe4-9b5b-1c8191dafe83 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:48.512039 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-baee3434-d9cf-4fe4-9b5b-1c8191dafe83 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:48.630788 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0568bdf3-c237-485b-b6af-81ff272a819b tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34c5fc51d324c8e8adb3b9c5cd30b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4333b5357f49e883b72e96bdafb682', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:48.654174 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0568bdf3-c237-485b-b6af-81ff272a819b tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e34c5fc51d324c8e8adb3b9c5cd30b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4333b5357f49e883b72e96bdafb682', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:48.656813 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0568bdf3-c237-485b-b6af-81ff272a819b tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e34c5fc51d324c8e8adb3b9c5cd30b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4333b5357f49e883b72e96bdafb682', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:48.660067 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-0568bdf3-c237-485b-b6af-81ff272a819b tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] 10.222.0.70 "GET /compute/v2.1/servers/69be36fb-3a1b-480f-8613-5aa3881944ab" status: 200 len: 1366 microversion: 2.47 time: 0.290385 Aug 27 03:07:48.663637 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2460/4973] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:07:48 2022] GET /compute/v2.1/servers/69be36fb-3a1b-480f-8613-5aa3881944ab => generated 1366 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:07:49.266960 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-baee3434-d9cf-4fe4-9b5b-1c8191dafe83 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:49.278896 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-baee3434-d9cf-4fe4-9b5b-1c8191dafe83 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1504 microversion: 2.1 time: 0.821527 Aug 27 03:07:49.284920 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2514/4974] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:48 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1504 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:49.309436 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-bbab6df2-27db-40fd-946a-73b1032bc36b tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:07:49.310842 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-bbab6df2-27db-40fd-946a-73b1032bc36b tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:49.330577 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bbab6df2-27db-40fd-946a-73b1032bc36b tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:49.333039 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bbab6df2-27db-40fd-946a-73b1032bc36b tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:49.336898 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bbab6df2-27db-40fd-946a-73b1032bc36b tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:49.338221 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bbab6df2-27db-40fd-946a-73b1032bc36b tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:49.338943 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bbab6df2-27db-40fd-946a-73b1032bc36b tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:49.339813 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bbab6df2-27db-40fd-946a-73b1032bc36b tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:49.401308 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.instance [None req-bbab6df2-27db-40fd-946a-73b1032bc36b tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lazy-loading 'flavor' on Instance uuid 72ffd032-b609-4e42-90d9-5454ac648eeb {{(pid=134052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:07:49.612273 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-bbab6df2-27db-40fd-946a-73b1032bc36b tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "POST /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb/action" status: 202 len: 0 microversion: 2.1 time: 0.313016 Aug 27 03:07:49.614034 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2461/4975] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:07:49 2022] POST /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb/action => generated 0 bytes in 315 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:07:49.625139 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-5d4224dc-41a9-44e3-98f5-be4a1aa5201f tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:49.628290 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-5d4224dc-41a9-44e3-98f5-be4a1aa5201f tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:49.636284 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5d4224dc-41a9-44e3-98f5-be4a1aa5201f tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:49.637491 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5d4224dc-41a9-44e3-98f5-be4a1aa5201f tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:49.638165 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5d4224dc-41a9-44e3-98f5-be4a1aa5201f tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:49.639068 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5d4224dc-41a9-44e3-98f5-be4a1aa5201f tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:49.639672 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5d4224dc-41a9-44e3-98f5-be4a1aa5201f tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:49.640565 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5d4224dc-41a9-44e3-98f5-be4a1aa5201f tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:49.695198 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b27bb84d-80ae-4df6-b0f6-f9d3f2ea9f07 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:49.696351 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b27bb84d-80ae-4df6-b0f6-f9d3f2ea9f07 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] [instance: 69be36fb-3a1b-480f-8613-5aa3881944ab] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:49.708238 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b27bb84d-80ae-4df6-b0f6-f9d3f2ea9f07 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:49.709583 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b27bb84d-80ae-4df6-b0f6-f9d3f2ea9f07 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:49.710382 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b27bb84d-80ae-4df6-b0f6-f9d3f2ea9f07 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:49.711267 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b27bb84d-80ae-4df6-b0f6-f9d3f2ea9f07 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:49.712594 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b27bb84d-80ae-4df6-b0f6-f9d3f2ea9f07 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:49.713390 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b27bb84d-80ae-4df6-b0f6-f9d3f2ea9f07 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:49.883577 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b27bb84d-80ae-4df6-b0f6-f9d3f2ea9f07 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34c5fc51d324c8e8adb3b9c5cd30b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4333b5357f49e883b72e96bdafb682', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:49.907258 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b27bb84d-80ae-4df6-b0f6-f9d3f2ea9f07 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e34c5fc51d324c8e8adb3b9c5cd30b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4333b5357f49e883b72e96bdafb682', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:49.916821 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b27bb84d-80ae-4df6-b0f6-f9d3f2ea9f07 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e34c5fc51d324c8e8adb3b9c5cd30b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4333b5357f49e883b72e96bdafb682', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:49.922361 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b27bb84d-80ae-4df6-b0f6-f9d3f2ea9f07 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] 10.222.0.70 "GET /compute/v2.1/servers/69be36fb-3a1b-480f-8613-5aa3881944ab" status: 200 len: 1366 microversion: 2.47 time: 0.234778 Aug 27 03:07:49.923029 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2462/4976] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:07:49 2022] GET /compute/v2.1/servers/69be36fb-3a1b-480f-8613-5aa3881944ab => generated 1366 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:07:50.015093 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-5d4224dc-41a9-44e3-98f5-be4a1aa5201f tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:50.023175 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-5d4224dc-41a9-44e3-98f5-be4a1aa5201f tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1512 microversion: 2.1 time: 0.405338 Aug 27 03:07:50.032770 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2515/4977] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:49 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1512 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:50.953228 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9851e50e-e7b5-4a6d-a717-23b28c77b537 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:50.954393 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-9851e50e-e7b5-4a6d-a717-23b28c77b537 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] [instance: 69be36fb-3a1b-480f-8613-5aa3881944ab] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:50.987793 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9851e50e-e7b5-4a6d-a717-23b28c77b537 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:50.996106 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9851e50e-e7b5-4a6d-a717-23b28c77b537 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:50.998567 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9851e50e-e7b5-4a6d-a717-23b28c77b537 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:51.014066 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9851e50e-e7b5-4a6d-a717-23b28c77b537 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:51.020507 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9851e50e-e7b5-4a6d-a717-23b28c77b537 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:51.021588 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9851e50e-e7b5-4a6d-a717-23b28c77b537 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:51.043428 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8e6651d0-3b4e-4dc7-b836-992626149da8 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:51.044882 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-8e6651d0-3b4e-4dc7-b836-992626149da8 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:51.059786 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8e6651d0-3b4e-4dc7-b836-992626149da8 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:51.060670 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8e6651d0-3b4e-4dc7-b836-992626149da8 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:51.061326 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8e6651d0-3b4e-4dc7-b836-992626149da8 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:51.062596 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8e6651d0-3b4e-4dc7-b836-992626149da8 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:51.063272 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8e6651d0-3b4e-4dc7-b836-992626149da8 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:51.063958 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8e6651d0-3b4e-4dc7-b836-992626149da8 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:51.258186 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-9851e50e-e7b5-4a6d-a717-23b28c77b537 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34c5fc51d324c8e8adb3b9c5cd30b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4333b5357f49e883b72e96bdafb682', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:51.270820 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-9851e50e-e7b5-4a6d-a717-23b28c77b537 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e34c5fc51d324c8e8adb3b9c5cd30b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4333b5357f49e883b72e96bdafb682', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:51.275676 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-9851e50e-e7b5-4a6d-a717-23b28c77b537 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e34c5fc51d324c8e8adb3b9c5cd30b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4333b5357f49e883b72e96bdafb682', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:51.282975 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9851e50e-e7b5-4a6d-a717-23b28c77b537 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] 10.222.0.70 "GET /compute/v2.1/servers/69be36fb-3a1b-480f-8613-5aa3881944ab" status: 200 len: 1366 microversion: 2.47 time: 0.341012 Aug 27 03:07:51.286880 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2463/4978] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:07:50 2022] GET /compute/v2.1/servers/69be36fb-3a1b-480f-8613-5aa3881944ab => generated 1366 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:07:51.453355 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-8e6651d0-3b4e-4dc7-b836-992626149da8 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:51.462143 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-8e6651d0-3b4e-4dc7-b836-992626149da8 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1495 microversion: 2.1 time: 0.422580 Aug 27 03:07:51.466886 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2516/4979] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:51 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1495 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:07:51.490913 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-72c567f5-24c6-4830-9ed2-f71ea9c622eb tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:07:51.491942 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-72c567f5-24c6-4830-9ed2-f71ea9c622eb tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:51.505374 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-72c567f5-24c6-4830-9ed2-f71ea9c622eb tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:51.506103 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-72c567f5-24c6-4830-9ed2-f71ea9c622eb tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:51.509299 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-72c567f5-24c6-4830-9ed2-f71ea9c622eb tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:51.510224 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-72c567f5-24c6-4830-9ed2-f71ea9c622eb tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:51.510967 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-72c567f5-24c6-4830-9ed2-f71ea9c622eb tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:51.511549 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-72c567f5-24c6-4830-9ed2-f71ea9c622eb tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:51.580578 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.instance [None req-72c567f5-24c6-4830-9ed2-f71ea9c622eb tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lazy-loading 'flavor' on Instance uuid 72ffd032-b609-4e42-90d9-5454ac648eeb {{(pid=134052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:07:51.608080 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-72c567f5-24c6-4830-9ed2-f71ea9c622eb tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] HTTP exception thrown: Cannot 'suspend' instance 72ffd032-b609-4e42-90d9-5454ac648eeb while it is in vm_state suspended Aug 27 03:07:51.610963 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-72c567f5-24c6-4830-9ed2-f71ea9c622eb tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Request method failure captured: Aug 27 03:07:51.610963 n-d-852278-4 devstack@n-api.service[134052]: request: POST /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb/action HTTP/1.1 Aug 27 03:07:51.610963 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 03:07:51.610963 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 03:07:51.610963 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 03:07:51.610963 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 15 Aug 27 03:07:51.610963 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 03:07:51.610963 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 03:07:51.610963 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 03:07:51.610963 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 03:07:51.610963 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYnkbLTKVFjPQ5m3U2fG0N9Vjn4DkHnl17m4V7uHpwM3jvJACULLjB_xlJxNaWj4ki5CLI0R9EDG2yAGWVsjkvndQFsX9xXnPLGqFClIfHjZt1hqpj87tFD2RLalZegHNDkz7eKDMcWIs2wG0Lp8X-uNjMToWPkkmABfSYkxwHfHBds Aug 27 03:07:51.610963 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 03:07:51.610963 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 03:07:51.610963 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 03:07:51.610963 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 03:07:51.610963 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 03:07:51.610963 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 03:07:51.610963 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 3b9e672ac89e41ff82355daa83e852bd Aug 27 03:07:51.610963 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:07:51.610963 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 03:07:51.610963 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 03:07:51.610963 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3b9e672ac89e41ff82355daa83e852bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3b9e672ac89e41ff82355daa83e852bd", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3b9e672ac89e41ff82355daa83e852bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3b9e672ac89e41ff82355daa83e852bd"}]}] Aug 27 03:07:51.610963 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:07:51.610963 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 3b9e672ac89e41ff82355daa83e852bd Aug 27 03:07:51.610963 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:07:51.610963 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ServersNegativeTestJSON-1795266674-project Aug 27 03:07:51.610963 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 03:07:51.610963 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 03:07:51.610963 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 204c90820f6d4c64b31367aaf098325c Aug 27 03:07:51.610963 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ServersNegativeTestJSON-1795266674-project Aug 27 03:07:51.610963 n-d-852278-4 devstack@n-api.service[134052]: Aug 27 03:07:51.610963 n-d-852278-4 devstack@n-api.service[134052]: {"suspend": {}} Aug 27 03:07:51.610963 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 03:07:51.610963 n-d-852278-4 devstack@n-api.service[134052]: exception: Cannot 'suspend' instance 72ffd032-b609-4e42-90d9-5454ac648eeb while it is in vm_state suspended Aug 27 03:07:51.610963 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '72ffd032-b609-4e42-90d9-5454ac648eeb', 'body': {'suspend': {}}} Aug 27 03:07:51.610963 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:07:51.610963 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:07:51.610963 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Aug 27 03:07:51.610963 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Aug 27 03:07:51.610963 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 27 03:07:51.610963 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 27 03:07:51.610963 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Aug 27 03:07:51.610963 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 27 03:07:51.610963 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 27 03:07:51.610963 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 27 03:07:51.610963 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Aug 27 03:07:51.610963 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 27 03:07:51.610963 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 03:07:51.610963 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 03:07:51.610963 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 27 03:07:51.610963 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 27 03:07:51.610963 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 72ffd032-b609-4e42-90d9-5454ac648eeb in vm_state suspended. Cannot suspend while the instance is in this state. Aug 27 03:07:51.610963 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:07:51.610963 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:07:51.610963 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:07:51.610963 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:07:51.610963 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:07:51.610963 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:07:51.610963 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:07:51.610963 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:07:51.610963 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:07:51.610963 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:07:51.610963 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Aug 27 03:07:51.610963 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 27 03:07:51.615474 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 27 03:07:51.615474 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 27 03:07:51.615474 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 72ffd032-b609-4e42-90d9-5454ac648eeb while it is in vm_state suspended Aug 27 03:07:51.615474 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:07:51.615474 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:07:51.615474 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:07:51.615474 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:07:51.615474 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:07:51.615474 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:07:51.615474 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:07:51.615474 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:07:51.615474 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 72ffd032-b609-4e42-90d9-5454ac648eeb while it is in vm_state suspended Aug 27 03:07:51.615474 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:07:51.617456 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-72c567f5-24c6-4830-9ed2-f71ea9c622eb tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Returning 409 to user: Cannot 'suspend' instance 72ffd032-b609-4e42-90d9-5454ac648eeb while it is in vm_state suspended {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:07:51.619197 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-72c567f5-24c6-4830-9ed2-f71ea9c622eb tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "POST /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb/action" status: 409 len: 148 microversion: 2.1 time: 0.132597 Aug 27 03:07:51.620258 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2464/4980] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:07:51 2022] POST /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb/action => generated 148 bytes in 135 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 27 03:07:51.629254 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-35e2dd26-eb00-495e-ad78-c2a9b4bea8ed tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:07:51.630043 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-35e2dd26-eb00-495e-ad78-c2a9b4bea8ed tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:51.639063 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-35e2dd26-eb00-495e-ad78-c2a9b4bea8ed tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:51.639914 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-35e2dd26-eb00-495e-ad78-c2a9b4bea8ed tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:51.640534 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-35e2dd26-eb00-495e-ad78-c2a9b4bea8ed tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:51.641403 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-35e2dd26-eb00-495e-ad78-c2a9b4bea8ed tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:51.642385 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-35e2dd26-eb00-495e-ad78-c2a9b4bea8ed tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:51.643361 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-35e2dd26-eb00-495e-ad78-c2a9b4bea8ed tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:51.772672 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-35e2dd26-eb00-495e-ad78-c2a9b4bea8ed tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "POST /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb/action" status: 202 len: 0 microversion: 2.1 time: 0.147870 Aug 27 03:07:51.773551 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2517/4981] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:07:51 2022] POST /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb/action => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:07:51.790198 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-1ba959fe-7a55-4377-a76f-b646d347b500 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:51.793540 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-1ba959fe-7a55-4377-a76f-b646d347b500 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:51.813104 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1ba959fe-7a55-4377-a76f-b646d347b500 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:51.813628 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1ba959fe-7a55-4377-a76f-b646d347b500 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:51.814076 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1ba959fe-7a55-4377-a76f-b646d347b500 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:51.817981 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1ba959fe-7a55-4377-a76f-b646d347b500 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:51.836639 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1ba959fe-7a55-4377-a76f-b646d347b500 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:51.837196 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1ba959fe-7a55-4377-a76f-b646d347b500 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:52.314829 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-619cf846-aa86-4e66-9e70-9bb30f790866 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:52.315721 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-619cf846-aa86-4e66-9e70-9bb30f790866 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] [instance: 69be36fb-3a1b-480f-8613-5aa3881944ab] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:52.323070 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-619cf846-aa86-4e66-9e70-9bb30f790866 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:52.334249 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-619cf846-aa86-4e66-9e70-9bb30f790866 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:52.334972 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-619cf846-aa86-4e66-9e70-9bb30f790866 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:52.336230 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-619cf846-aa86-4e66-9e70-9bb30f790866 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:52.336972 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-619cf846-aa86-4e66-9e70-9bb30f790866 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:52.337638 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-619cf846-aa86-4e66-9e70-9bb30f790866 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:52.716002 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-619cf846-aa86-4e66-9e70-9bb30f790866 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34c5fc51d324c8e8adb3b9c5cd30b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4333b5357f49e883b72e96bdafb682', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:52.733212 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-619cf846-aa86-4e66-9e70-9bb30f790866 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e34c5fc51d324c8e8adb3b9c5cd30b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4333b5357f49e883b72e96bdafb682', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:52.734670 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-1ba959fe-7a55-4377-a76f-b646d347b500 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:52.754921 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-1ba959fe-7a55-4377-a76f-b646d347b500 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1501 microversion: 2.1 time: 0.968908 Aug 27 03:07:52.756110 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2465/4982] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:51 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1501 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:52.759142 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-619cf846-aa86-4e66-9e70-9bb30f790866 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e34c5fc51d324c8e8adb3b9c5cd30b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4333b5357f49e883b72e96bdafb682', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:52.761244 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-619cf846-aa86-4e66-9e70-9bb30f790866 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] 10.222.0.70 "GET /compute/v2.1/servers/69be36fb-3a1b-480f-8613-5aa3881944ab" status: 200 len: 1366 microversion: 2.47 time: 0.450642 Aug 27 03:07:52.762241 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2518/4983] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:07:52 2022] GET /compute/v2.1/servers/69be36fb-3a1b-480f-8613-5aa3881944ab => generated 1366 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:07:53.779075 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-41b872ad-9a42-4232-84fd-49bd1d641194 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:53.779690 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-41b872ad-9a42-4232-84fd-49bd1d641194 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:53.792221 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-41b872ad-9a42-4232-84fd-49bd1d641194 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:53.804760 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-41b872ad-9a42-4232-84fd-49bd1d641194 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:53.808676 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-41b872ad-9a42-4232-84fd-49bd1d641194 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:53.814334 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3cf49711-b034-41b1-8954-495f4103d5ba tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:53.815482 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-3cf49711-b034-41b1-8954-495f4103d5ba tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] [instance: 69be36fb-3a1b-480f-8613-5aa3881944ab] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:53.815838 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-41b872ad-9a42-4232-84fd-49bd1d641194 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:53.817184 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-41b872ad-9a42-4232-84fd-49bd1d641194 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:53.819370 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-41b872ad-9a42-4232-84fd-49bd1d641194 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:53.838415 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3cf49711-b034-41b1-8954-495f4103d5ba tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:53.839272 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3cf49711-b034-41b1-8954-495f4103d5ba tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:53.839886 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3cf49711-b034-41b1-8954-495f4103d5ba tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:53.840829 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3cf49711-b034-41b1-8954-495f4103d5ba tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:53.841464 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3cf49711-b034-41b1-8954-495f4103d5ba tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:53.842058 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3cf49711-b034-41b1-8954-495f4103d5ba tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:54.199179 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-3cf49711-b034-41b1-8954-495f4103d5ba tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34c5fc51d324c8e8adb3b9c5cd30b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4333b5357f49e883b72e96bdafb682', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:54.212235 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-3cf49711-b034-41b1-8954-495f4103d5ba tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e34c5fc51d324c8e8adb3b9c5cd30b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4333b5357f49e883b72e96bdafb682', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:54.217267 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-3cf49711-b034-41b1-8954-495f4103d5ba tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e34c5fc51d324c8e8adb3b9c5cd30b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4333b5357f49e883b72e96bdafb682', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:54.218523 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-3cf49711-b034-41b1-8954-495f4103d5ba tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] 10.222.0.70 "GET /compute/v2.1/servers/69be36fb-3a1b-480f-8613-5aa3881944ab" status: 200 len: 1366 microversion: 2.47 time: 0.408186 Aug 27 03:07:54.219100 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2519/4984] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:07:53 2022] GET /compute/v2.1/servers/69be36fb-3a1b-480f-8613-5aa3881944ab => generated 1366 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:07:54.491888 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-41b872ad-9a42-4232-84fd-49bd1d641194 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:54.509723 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-41b872ad-9a42-4232-84fd-49bd1d641194 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1501 microversion: 2.1 time: 0.736397 Aug 27 03:07:54.511688 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2466/4985] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:53 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1501 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:55.243019 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e2db9ffb-f85f-4028-991c-9001cde1a881 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:55.244459 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-e2db9ffb-f85f-4028-991c-9001cde1a881 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] [instance: 69be36fb-3a1b-480f-8613-5aa3881944ab] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:55.260578 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:07:55.267134 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e2db9ffb-f85f-4028-991c-9001cde1a881 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:55.271787 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e2db9ffb-f85f-4028-991c-9001cde1a881 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:55.272535 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e2db9ffb-f85f-4028-991c-9001cde1a881 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:55.274447 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e2db9ffb-f85f-4028-991c-9001cde1a881 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:55.279768 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e2db9ffb-f85f-4028-991c-9001cde1a881 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:55.280536 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e2db9ffb-f85f-4028-991c-9001cde1a881 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:55.530571 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ed285d60-3f1c-4739-8216-9e284d12e453 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:55.531806 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-ed285d60-3f1c-4739-8216-9e284d12e453 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:55.544351 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ed285d60-3f1c-4739-8216-9e284d12e453 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:55.546429 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ed285d60-3f1c-4739-8216-9e284d12e453 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:55.547072 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ed285d60-3f1c-4739-8216-9e284d12e453 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:55.547972 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ed285d60-3f1c-4739-8216-9e284d12e453 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:55.554210 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ed285d60-3f1c-4739-8216-9e284d12e453 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:55.554906 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ed285d60-3f1c-4739-8216-9e284d12e453 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:55.893740 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e2db9ffb-f85f-4028-991c-9001cde1a881 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34c5fc51d324c8e8adb3b9c5cd30b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4333b5357f49e883b72e96bdafb682', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:55.903114 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e2db9ffb-f85f-4028-991c-9001cde1a881 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e34c5fc51d324c8e8adb3b9c5cd30b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4333b5357f49e883b72e96bdafb682', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:55.925759 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e2db9ffb-f85f-4028-991c-9001cde1a881 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e34c5fc51d324c8e8adb3b9c5cd30b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4333b5357f49e883b72e96bdafb682', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:55.940749 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e2db9ffb-f85f-4028-991c-9001cde1a881 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] 10.222.0.70 "GET /compute/v2.1/servers/69be36fb-3a1b-480f-8613-5aa3881944ab" status: 200 len: 1366 microversion: 2.47 time: 0.689350 Aug 27 03:07:55.956391 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2520/4986] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:07:55 2022] GET /compute/v2.1/servers/69be36fb-3a1b-480f-8613-5aa3881944ab => generated 1366 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:07:56.335652 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-ed285d60-3f1c-4739-8216-9e284d12e453 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:56.344774 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ed285d60-3f1c-4739-8216-9e284d12e453 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1504 microversion: 2.1 time: 0.818068 Aug 27 03:07:56.351550 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2467/4987] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:55 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1504 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:56.379047 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8d0ffdef-0b5e-49aa-b7c6-60f4464658d2 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:56.380986 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-8d0ffdef-0b5e-49aa-b7c6-60f4464658d2 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:56.390197 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8d0ffdef-0b5e-49aa-b7c6-60f4464658d2 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:56.391093 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8d0ffdef-0b5e-49aa-b7c6-60f4464658d2 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:56.392155 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8d0ffdef-0b5e-49aa-b7c6-60f4464658d2 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:56.393144 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8d0ffdef-0b5e-49aa-b7c6-60f4464658d2 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:56.393754 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8d0ffdef-0b5e-49aa-b7c6-60f4464658d2 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:56.394368 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8d0ffdef-0b5e-49aa-b7c6-60f4464658d2 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:56.751609 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-8d0ffdef-0b5e-49aa-b7c6-60f4464658d2 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:56.763579 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-8d0ffdef-0b5e-49aa-b7c6-60f4464658d2 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1504 microversion: 2.1 time: 0.388541 Aug 27 03:07:56.764194 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2521/4988] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:56 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1504 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:56.787927 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-342bf01c-04f6-4fad-a5f0-90faffc5c096 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:07:56.788549 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-342bf01c-04f6-4fad-a5f0-90faffc5c096 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 2d5a6100-ac60-46dd-bec7-c9ee7c9cf3b2] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:56.810937 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-342bf01c-04f6-4fad-a5f0-90faffc5c096 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] HTTP exception thrown: Instance 2d5a6100-ac60-46dd-bec7-c9ee7c9cf3b2 could not be found. Aug 27 03:07:56.812538 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-342bf01c-04f6-4fad-a5f0-90faffc5c096 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Request method failure captured: Aug 27 03:07:56.812538 n-d-852278-4 devstack@n-api.service[134052]: request: POST /compute/v2.1/servers/2d5a6100-ac60-46dd-bec7-c9ee7c9cf3b2/action HTTP/1.1 Aug 27 03:07:56.812538 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 03:07:56.812538 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 03:07:56.812538 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 03:07:56.812538 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 15 Aug 27 03:07:56.812538 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 03:07:56.812538 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 03:07:56.812538 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 03:07:56.812538 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 03:07:56.812538 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYnkbLTKVFjPQ5m3U2fG0N9Vjn4DkHnl17m4V7uHpwM3jvJACULLjB_xlJxNaWj4ki5CLI0R9EDG2yAGWVsjkvndQFsX9xXnPLGqFClIfHjZt1hqpj87tFD2RLalZegHNDkz7eKDMcWIs2wG0Lp8X-uNjMToWPkkmABfSYkxwHfHBds Aug 27 03:07:56.812538 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 03:07:56.812538 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 03:07:56.812538 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 03:07:56.812538 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 03:07:56.812538 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 03:07:56.812538 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 03:07:56.812538 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 3b9e672ac89e41ff82355daa83e852bd Aug 27 03:07:56.812538 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:07:56.812538 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 03:07:56.812538 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 03:07:56.812538 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3b9e672ac89e41ff82355daa83e852bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3b9e672ac89e41ff82355daa83e852bd", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3b9e672ac89e41ff82355daa83e852bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3b9e672ac89e41ff82355daa83e852bd"}]}] Aug 27 03:07:56.812538 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:07:56.812538 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 3b9e672ac89e41ff82355daa83e852bd Aug 27 03:07:56.812538 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:07:56.812538 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ServersNegativeTestJSON-1795266674-project Aug 27 03:07:56.812538 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 03:07:56.812538 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 03:07:56.812538 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 204c90820f6d4c64b31367aaf098325c Aug 27 03:07:56.812538 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ServersNegativeTestJSON-1795266674-project Aug 27 03:07:56.812538 n-d-852278-4 devstack@n-api.service[134052]: Aug 27 03:07:56.812538 n-d-852278-4 devstack@n-api.service[134052]: {"unpause": {}} Aug 27 03:07:56.812538 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 03:07:56.812538 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance 2d5a6100-ac60-46dd-bec7-c9ee7c9cf3b2 could not be found. Aug 27 03:07:56.812538 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '2d5a6100-ac60-46dd-bec7-c9ee7c9cf3b2', 'body': {'unpause': {}}} Aug 27 03:07:56.812538 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:07:56.812538 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:07:56.812538 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:07:56.812538 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:07:56.812538 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:07:56.812538 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:07:56.812538 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 03:07:56.812538 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 03:07:56.812538 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d5a6100-ac60-46dd-bec7-c9ee7c9cf3b2 could not be found. Aug 27 03:07:56.812538 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:07:56.812538 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:07:56.812538 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:07:56.812538 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:07:56.812538 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:07:56.812538 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:07:56.812538 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:07:56.812538 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:07:56.812538 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:07:56.812538 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:07:56.812538 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Aug 27 03:07:56.812538 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Aug 27 03:07:56.812538 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:07:56.812538 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:07:56.812538 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d5a6100-ac60-46dd-bec7-c9ee7c9cf3b2 could not be found. Aug 27 03:07:56.812538 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:07:56.812538 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:07:56.812538 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:07:56.812538 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:07:56.812538 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:07:56.812538 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:07:56.817713 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:07:56.817713 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:07:56.817713 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d5a6100-ac60-46dd-bec7-c9ee7c9cf3b2 could not be found. Aug 27 03:07:56.817713 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:07:56.817713 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-342bf01c-04f6-4fad-a5f0-90faffc5c096 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Returning 404 to user: Instance 2d5a6100-ac60-46dd-bec7-c9ee7c9cf3b2 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:07:56.817713 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-342bf01c-04f6-4fad-a5f0-90faffc5c096 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "POST /compute/v2.1/servers/2d5a6100-ac60-46dd-bec7-c9ee7c9cf3b2/action" status: 404 len: 111 microversion: 2.1 time: 0.030209 Aug 27 03:07:56.825969 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d0b01e7c-063b-4ae4-bad3-f803578d4568 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:56.826746 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2468/4989] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:07:56 2022] POST /compute/v2.1/servers/2d5a6100-ac60-46dd-bec7-c9ee7c9cf3b2/action => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:07:56.827129 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d0b01e7c-063b-4ae4-bad3-f803578d4568 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:56.842817 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d0b01e7c-063b-4ae4-bad3-f803578d4568 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:56.844189 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d0b01e7c-063b-4ae4-bad3-f803578d4568 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:56.846231 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d0b01e7c-063b-4ae4-bad3-f803578d4568 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:56.848001 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d0b01e7c-063b-4ae4-bad3-f803578d4568 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:56.852789 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d0b01e7c-063b-4ae4-bad3-f803578d4568 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:56.853521 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d0b01e7c-063b-4ae4-bad3-f803578d4568 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:56.969239 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8e331f4c-9877-4ee4-aa18-3d7f2872da4b tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:56.970125 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-8e331f4c-9877-4ee4-aa18-3d7f2872da4b tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] [instance: 69be36fb-3a1b-480f-8613-5aa3881944ab] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:56.984545 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8e331f4c-9877-4ee4-aa18-3d7f2872da4b tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:56.985532 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8e331f4c-9877-4ee4-aa18-3d7f2872da4b tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:56.986526 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8e331f4c-9877-4ee4-aa18-3d7f2872da4b tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:56.988005 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8e331f4c-9877-4ee4-aa18-3d7f2872da4b tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:56.991864 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8e331f4c-9877-4ee4-aa18-3d7f2872da4b tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:56.992825 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8e331f4c-9877-4ee4-aa18-3d7f2872da4b tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:57.205365 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-8e331f4c-9877-4ee4-aa18-3d7f2872da4b tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34c5fc51d324c8e8adb3b9c5cd30b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4333b5357f49e883b72e96bdafb682', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:57.218823 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-8e331f4c-9877-4ee4-aa18-3d7f2872da4b tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e34c5fc51d324c8e8adb3b9c5cd30b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4333b5357f49e883b72e96bdafb682', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:57.220850 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-8e331f4c-9877-4ee4-aa18-3d7f2872da4b tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e34c5fc51d324c8e8adb3b9c5cd30b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4333b5357f49e883b72e96bdafb682', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:57.223320 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-8e331f4c-9877-4ee4-aa18-3d7f2872da4b tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] 10.222.0.70 "GET /compute/v2.1/servers/69be36fb-3a1b-480f-8613-5aa3881944ab" status: 200 len: 1366 microversion: 2.47 time: 0.257180 Aug 27 03:07:57.226540 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2469/4990] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:07:56 2022] GET /compute/v2.1/servers/69be36fb-3a1b-480f-8613-5aa3881944ab => generated 1366 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:07:57.425350 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d0b01e7c-063b-4ae4-bad3-f803578d4568 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:57.441477 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d0b01e7c-063b-4ae4-bad3-f803578d4568 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1504 microversion: 2.1 time: 0.621241 Aug 27 03:07:57.443324 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2522/4991] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:56 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1504 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:57.472387 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c0cb2f23-5ac2-4f2c-aa00-6b0c33bd4994 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:57.473551 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-c0cb2f23-5ac2-4f2c-aa00-6b0c33bd4994 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:57.493425 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c0cb2f23-5ac2-4f2c-aa00-6b0c33bd4994 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:57.494015 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c0cb2f23-5ac2-4f2c-aa00-6b0c33bd4994 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:57.495569 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c0cb2f23-5ac2-4f2c-aa00-6b0c33bd4994 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:57.496570 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c0cb2f23-5ac2-4f2c-aa00-6b0c33bd4994 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:57.499741 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c0cb2f23-5ac2-4f2c-aa00-6b0c33bd4994 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:57.500206 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c0cb2f23-5ac2-4f2c-aa00-6b0c33bd4994 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:57.959104 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-c0cb2f23-5ac2-4f2c-aa00-6b0c33bd4994 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:57.985744 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c0cb2f23-5ac2-4f2c-aa00-6b0c33bd4994 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1504 microversion: 2.1 time: 0.516636 Aug 27 03:07:58.000337 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2470/4992] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:57 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1504 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:07:58.010539 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ebcedfba-af38-4677-b770-c35aa0e06c04 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:07:58.011400 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-ebcedfba-af38-4677-b770-c35aa0e06c04 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:58.022405 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ebcedfba-af38-4677-b770-c35aa0e06c04 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:58.026363 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ebcedfba-af38-4677-b770-c35aa0e06c04 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:58.027332 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ebcedfba-af38-4677-b770-c35aa0e06c04 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:58.029495 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ebcedfba-af38-4677-b770-c35aa0e06c04 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:58.031248 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ebcedfba-af38-4677-b770-c35aa0e06c04 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:58.032854 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ebcedfba-af38-4677-b770-c35aa0e06c04 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:58.127330 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-ebcedfba-af38-4677-b770-c35aa0e06c04 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] HTTP exception thrown: Cannot 'unpause' instance 72ffd032-b609-4e42-90d9-5454ac648eeb while it is in vm_state active Aug 27 03:07:58.133115 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ebcedfba-af38-4677-b770-c35aa0e06c04 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Request method failure captured: Aug 27 03:07:58.133115 n-d-852278-4 devstack@n-api.service[134051]: request: POST /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb/action HTTP/1.1 Aug 27 03:07:58.133115 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 03:07:58.133115 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 03:07:58.133115 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 03:07:58.133115 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 15 Aug 27 03:07:58.133115 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 03:07:58.133115 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 03:07:58.133115 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 03:07:58.133115 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 03:07:58.133115 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYnkbLTKVFjPQ5m3U2fG0N9Vjn4DkHnl17m4V7uHpwM3jvJACULLjB_xlJxNaWj4ki5CLI0R9EDG2yAGWVsjkvndQFsX9xXnPLGqFClIfHjZt1hqpj87tFD2RLalZegHNDkz7eKDMcWIs2wG0Lp8X-uNjMToWPkkmABfSYkxwHfHBds Aug 27 03:07:58.133115 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 03:07:58.133115 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 03:07:58.133115 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 03:07:58.133115 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 03:07:58.133115 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 03:07:58.133115 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 03:07:58.133115 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 3b9e672ac89e41ff82355daa83e852bd Aug 27 03:07:58.133115 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:07:58.133115 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 03:07:58.133115 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 03:07:58.133115 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3b9e672ac89e41ff82355daa83e852bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3b9e672ac89e41ff82355daa83e852bd", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3b9e672ac89e41ff82355daa83e852bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3b9e672ac89e41ff82355daa83e852bd"}]}] Aug 27 03:07:58.133115 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:07:58.133115 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 3b9e672ac89e41ff82355daa83e852bd Aug 27 03:07:58.133115 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:07:58.133115 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ServersNegativeTestJSON-1795266674-project Aug 27 03:07:58.133115 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 03:07:58.133115 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 03:07:58.133115 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 204c90820f6d4c64b31367aaf098325c Aug 27 03:07:58.133115 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ServersNegativeTestJSON-1795266674-project Aug 27 03:07:58.133115 n-d-852278-4 devstack@n-api.service[134051]: Aug 27 03:07:58.133115 n-d-852278-4 devstack@n-api.service[134051]: {"unpause": {}} Aug 27 03:07:58.133115 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 03:07:58.133115 n-d-852278-4 devstack@n-api.service[134051]: exception: Cannot 'unpause' instance 72ffd032-b609-4e42-90d9-5454ac648eeb while it is in vm_state active Aug 27 03:07:58.133115 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '72ffd032-b609-4e42-90d9-5454ac648eeb', 'body': {'unpause': {}}} Aug 27 03:07:58.133115 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:07:58.133115 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:07:58.133115 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Aug 27 03:07:58.133115 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Aug 27 03:07:58.133115 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 03:07:58.133115 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 03:07:58.133115 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 27 03:07:58.133115 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 27 03:07:58.133115 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 72ffd032-b609-4e42-90d9-5454ac648eeb in vm_state active. Cannot unpause while the instance is in this state. Aug 27 03:07:58.133115 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:07:58.133115 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:07:58.133115 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:07:58.133115 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:07:58.133115 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:07:58.133115 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:07:58.133115 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:07:58.133115 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:07:58.133115 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:07:58.133115 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:07:58.133115 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Aug 27 03:07:58.133115 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 27 03:07:58.133115 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 27 03:07:58.133115 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 27 03:07:58.133115 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 72ffd032-b609-4e42-90d9-5454ac648eeb while it is in vm_state active Aug 27 03:07:58.133115 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:07:58.133115 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:07:58.133115 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:07:58.133115 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:07:58.133115 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:07:58.136884 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:07:58.136884 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:07:58.136884 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:07:58.136884 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 72ffd032-b609-4e42-90d9-5454ac648eeb while it is in vm_state active Aug 27 03:07:58.136884 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:07:58.140993 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ebcedfba-af38-4677-b770-c35aa0e06c04 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Returning 409 to user: Cannot 'unpause' instance 72ffd032-b609-4e42-90d9-5454ac648eeb while it is in vm_state active {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:07:58.142120 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ebcedfba-af38-4677-b770-c35aa0e06c04 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "POST /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb/action" status: 409 len: 145 microversion: 2.1 time: 0.135889 Aug 27 03:07:58.150335 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2523/4993] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:07:58 2022] POST /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb/action => generated 145 bytes in 145 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 27 03:07:58.155366 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a0f4152d-3a21-46c7-a933-4a3a269af232 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:58.156000 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a0f4152d-3a21-46c7-a933-4a3a269af232 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:58.163739 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a0f4152d-3a21-46c7-a933-4a3a269af232 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:58.166767 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a0f4152d-3a21-46c7-a933-4a3a269af232 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:58.168855 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a0f4152d-3a21-46c7-a933-4a3a269af232 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:58.170860 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a0f4152d-3a21-46c7-a933-4a3a269af232 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:58.172898 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a0f4152d-3a21-46c7-a933-4a3a269af232 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:58.173526 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a0f4152d-3a21-46c7-a933-4a3a269af232 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:58.249744 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-cc12f3ff-f15e-4965-8d1c-f4e987e16de2 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:58.250715 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-cc12f3ff-f15e-4965-8d1c-f4e987e16de2 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] [instance: 69be36fb-3a1b-480f-8613-5aa3881944ab] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:58.258671 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cc12f3ff-f15e-4965-8d1c-f4e987e16de2 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:58.259399 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cc12f3ff-f15e-4965-8d1c-f4e987e16de2 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:58.260054 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cc12f3ff-f15e-4965-8d1c-f4e987e16de2 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:58.261054 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cc12f3ff-f15e-4965-8d1c-f4e987e16de2 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:58.263579 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cc12f3ff-f15e-4965-8d1c-f4e987e16de2 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:58.264241 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cc12f3ff-f15e-4965-8d1c-f4e987e16de2 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:58.406276 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-cc12f3ff-f15e-4965-8d1c-f4e987e16de2 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34c5fc51d324c8e8adb3b9c5cd30b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4333b5357f49e883b72e96bdafb682', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:58.433384 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-cc12f3ff-f15e-4965-8d1c-f4e987e16de2 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e34c5fc51d324c8e8adb3b9c5cd30b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4333b5357f49e883b72e96bdafb682', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:58.435170 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-cc12f3ff-f15e-4965-8d1c-f4e987e16de2 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e34c5fc51d324c8e8adb3b9c5cd30b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4333b5357f49e883b72e96bdafb682', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:58.437531 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-cc12f3ff-f15e-4965-8d1c-f4e987e16de2 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] 10.222.0.70 "GET /compute/v2.1/servers/69be36fb-3a1b-480f-8613-5aa3881944ab" status: 200 len: 1366 microversion: 2.47 time: 0.191896 Aug 27 03:07:58.438671 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2524/4994] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:07:58 2022] GET /compute/v2.1/servers/69be36fb-3a1b-480f-8613-5aa3881944ab => generated 1366 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:07:58.684956 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-a0f4152d-3a21-46c7-a933-4a3a269af232 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:58.697966 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a0f4152d-3a21-46c7-a933-4a3a269af232 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1504 microversion: 2.1 time: 0.545658 Aug 27 03:07:58.700823 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2471/4995] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:58 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1504 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:58.727147 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-32635b8d-a86a-42fe-a05f-67eea15d9484 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:58.739434 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-32635b8d-a86a-42fe-a05f-67eea15d9484 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:58.756296 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-32635b8d-a86a-42fe-a05f-67eea15d9484 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:58.756830 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-32635b8d-a86a-42fe-a05f-67eea15d9484 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:58.757271 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-32635b8d-a86a-42fe-a05f-67eea15d9484 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:58.758006 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-32635b8d-a86a-42fe-a05f-67eea15d9484 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:58.758462 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-32635b8d-a86a-42fe-a05f-67eea15d9484 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:58.758891 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-32635b8d-a86a-42fe-a05f-67eea15d9484 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:59.220010 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-32635b8d-a86a-42fe-a05f-67eea15d9484 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:59.228143 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-32635b8d-a86a-42fe-a05f-67eea15d9484 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1504 microversion: 2.1 time: 0.504877 Aug 27 03:07:59.229343 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2525/4996] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:58 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1504 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:59.253317 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9d416314-67f6-438a-a449-20a9fd5fa4e2 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:07:59.254592 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-9d416314-67f6-438a-a449-20a9fd5fa4e2 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 325457d2-7862-4c74-9807-302ac07b6737] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:59.271619 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-9d416314-67f6-438a-a449-20a9fd5fa4e2 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] HTTP exception thrown: Instance 325457d2-7862-4c74-9807-302ac07b6737 could not be found. Aug 27 03:07:59.275683 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9d416314-67f6-438a-a449-20a9fd5fa4e2 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Request method failure captured: Aug 27 03:07:59.275683 n-d-852278-4 devstack@n-api.service[134052]: request: POST /compute/v2.1/servers/325457d2-7862-4c74-9807-302ac07b6737/action HTTP/1.1 Aug 27 03:07:59.275683 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 03:07:59.275683 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 03:07:59.275683 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 03:07:59.275683 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 18 Aug 27 03:07:59.275683 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 03:07:59.275683 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 03:07:59.275683 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 03:07:59.275683 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 03:07:59.275683 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYnkbLTKVFjPQ5m3U2fG0N9Vjn4DkHnl17m4V7uHpwM3jvJACULLjB_xlJxNaWj4ki5CLI0R9EDG2yAGWVsjkvndQFsX9xXnPLGqFClIfHjZt1hqpj87tFD2RLalZegHNDkz7eKDMcWIs2wG0Lp8X-uNjMToWPkkmABfSYkxwHfHBds Aug 27 03:07:59.275683 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 03:07:59.275683 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 03:07:59.275683 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 03:07:59.275683 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 03:07:59.275683 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 03:07:59.275683 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 03:07:59.275683 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 3b9e672ac89e41ff82355daa83e852bd Aug 27 03:07:59.275683 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:07:59.275683 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 03:07:59.275683 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 03:07:59.275683 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3b9e672ac89e41ff82355daa83e852bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3b9e672ac89e41ff82355daa83e852bd", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3b9e672ac89e41ff82355daa83e852bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3b9e672ac89e41ff82355daa83e852bd"}]}] Aug 27 03:07:59.275683 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:07:59.275683 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 3b9e672ac89e41ff82355daa83e852bd Aug 27 03:07:59.275683 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:07:59.275683 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ServersNegativeTestJSON-1795266674-project Aug 27 03:07:59.275683 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 03:07:59.275683 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 03:07:59.275683 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 204c90820f6d4c64b31367aaf098325c Aug 27 03:07:59.275683 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ServersNegativeTestJSON-1795266674-project Aug 27 03:07:59.275683 n-d-852278-4 devstack@n-api.service[134052]: Aug 27 03:07:59.275683 n-d-852278-4 devstack@n-api.service[134052]: {"unshelve": null} Aug 27 03:07:59.275683 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 03:07:59.275683 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance 325457d2-7862-4c74-9807-302ac07b6737 could not be found. Aug 27 03:07:59.275683 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '325457d2-7862-4c74-9807-302ac07b6737', 'body': {'unshelve': None}} Aug 27 03:07:59.275683 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:07:59.275683 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:07:59.275683 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:07:59.275683 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:07:59.275683 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:07:59.275683 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:07:59.275683 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 03:07:59.275683 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 03:07:59.275683 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 325457d2-7862-4c74-9807-302ac07b6737 could not be found. Aug 27 03:07:59.275683 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:07:59.275683 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:07:59.275683 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:07:59.275683 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:07:59.275683 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:07:59.275683 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:07:59.275683 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:07:59.275683 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:07:59.275683 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:07:59.275683 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:07:59.275683 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:07:59.275683 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:07:59.275683 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:07:59.275683 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:07:59.275683 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Aug 27 03:07:59.275683 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 27 03:07:59.275683 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:07:59.275683 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:07:59.275683 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 325457d2-7862-4c74-9807-302ac07b6737 could not be found. Aug 27 03:07:59.275683 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:07:59.275683 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:07:59.280058 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:07:59.280058 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:07:59.280058 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:07:59.280058 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:07:59.280058 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:07:59.280058 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:07:59.280058 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 325457d2-7862-4c74-9807-302ac07b6737 could not be found. Aug 27 03:07:59.280058 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:07:59.285884 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9d416314-67f6-438a-a449-20a9fd5fa4e2 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Returning 404 to user: Instance 325457d2-7862-4c74-9807-302ac07b6737 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:07:59.289298 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9d416314-67f6-438a-a449-20a9fd5fa4e2 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "POST /compute/v2.1/servers/325457d2-7862-4c74-9807-302ac07b6737/action" status: 404 len: 111 microversion: 2.1 time: 0.040083 Aug 27 03:07:59.291804 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2472/4997] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:07:59 2022] POST /compute/v2.1/servers/325457d2-7862-4c74-9807-302ac07b6737/action => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:07:59.301238 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-45b6497c-b3e4-4deb-bb76-64b35c59c9c7 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:59.302443 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-45b6497c-b3e4-4deb-bb76-64b35c59c9c7 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:59.315176 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-45b6497c-b3e4-4deb-bb76-64b35c59c9c7 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:59.315676 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-45b6497c-b3e4-4deb-bb76-64b35c59c9c7 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:59.316116 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-45b6497c-b3e4-4deb-bb76-64b35c59c9c7 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:59.324216 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-45b6497c-b3e4-4deb-bb76-64b35c59c9c7 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:59.331856 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-45b6497c-b3e4-4deb-bb76-64b35c59c9c7 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:59.331856 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-45b6497c-b3e4-4deb-bb76-64b35c59c9c7 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:59.462341 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9d5a2186-e24f-4d1a-a09a-2cd40b3382fb tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:59.462963 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-9d5a2186-e24f-4d1a-a09a-2cd40b3382fb tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] [instance: 69be36fb-3a1b-480f-8613-5aa3881944ab] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:59.470498 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9d5a2186-e24f-4d1a-a09a-2cd40b3382fb tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:59.470987 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9d5a2186-e24f-4d1a-a09a-2cd40b3382fb tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:59.471424 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9d5a2186-e24f-4d1a-a09a-2cd40b3382fb tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:59.472422 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9d5a2186-e24f-4d1a-a09a-2cd40b3382fb tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:59.473111 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9d5a2186-e24f-4d1a-a09a-2cd40b3382fb tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:59.473758 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9d5a2186-e24f-4d1a-a09a-2cd40b3382fb tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:59.495889 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:07:59.751426 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-9d5a2186-e24f-4d1a-a09a-2cd40b3382fb tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34c5fc51d324c8e8adb3b9c5cd30b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4333b5357f49e883b72e96bdafb682', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:59.762524 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-9d5a2186-e24f-4d1a-a09a-2cd40b3382fb tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e34c5fc51d324c8e8adb3b9c5cd30b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4333b5357f49e883b72e96bdafb682', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:59.768196 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-9d5a2186-e24f-4d1a-a09a-2cd40b3382fb tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e34c5fc51d324c8e8adb3b9c5cd30b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4333b5357f49e883b72e96bdafb682', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:59.775508 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9d5a2186-e24f-4d1a-a09a-2cd40b3382fb tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] 10.222.0.70 "GET /compute/v2.1/servers/69be36fb-3a1b-480f-8613-5aa3881944ab" status: 200 len: 1366 microversion: 2.47 time: 0.313244 Aug 27 03:07:59.776695 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2473/4998] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:07:59 2022] GET /compute/v2.1/servers/69be36fb-3a1b-480f-8613-5aa3881944ab => generated 1366 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:07:59.934803 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-45b6497c-b3e4-4deb-bb76-64b35c59c9c7 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:59.949471 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-45b6497c-b3e4-4deb-bb76-64b35c59c9c7 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1504 microversion: 2.1 time: 0.652058 Aug 27 03:07:59.955422 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2526/4999] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:59 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1504 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:59.975717 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-cf1d4d7c-5362-435e-9788-cd4692d54d8d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:59.976407 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-cf1d4d7c-5362-435e-9788-cd4692d54d8d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:00.000527 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cf1d4d7c-5362-435e-9788-cd4692d54d8d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:00.002172 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cf1d4d7c-5362-435e-9788-cd4692d54d8d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:00.002623 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cf1d4d7c-5362-435e-9788-cd4692d54d8d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:00.003348 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cf1d4d7c-5362-435e-9788-cd4692d54d8d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:00.006442 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cf1d4d7c-5362-435e-9788-cd4692d54d8d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:00.006893 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cf1d4d7c-5362-435e-9788-cd4692d54d8d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:00.342537 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-cf1d4d7c-5362-435e-9788-cd4692d54d8d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:00.357848 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-cf1d4d7c-5362-435e-9788-cd4692d54d8d tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1504 microversion: 2.1 time: 0.384197 Aug 27 03:08:00.358711 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2474/5000] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:59 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1504 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:00.383424 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3a766a86-fc7c-45c6-9479-ce7a6fca1f3c tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:08:00.386946 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-3a766a86-fc7c-45c6-9479-ce7a6fca1f3c tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:00.397941 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3a766a86-fc7c-45c6-9479-ce7a6fca1f3c tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:00.399250 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3a766a86-fc7c-45c6-9479-ce7a6fca1f3c tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:00.400153 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3a766a86-fc7c-45c6-9479-ce7a6fca1f3c tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:00.401148 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3a766a86-fc7c-45c6-9479-ce7a6fca1f3c tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:00.401760 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3a766a86-fc7c-45c6-9479-ce7a6fca1f3c tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:00.402341 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3a766a86-fc7c-45c6-9479-ce7a6fca1f3c tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:00.564758 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-3a766a86-fc7c-45c6-9479-ce7a6fca1f3c tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] HTTP exception thrown: Cannot 'unshelve' instance 72ffd032-b609-4e42-90d9-5454ac648eeb while it is in vm_state active Aug 27 03:08:00.566659 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3a766a86-fc7c-45c6-9479-ce7a6fca1f3c tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Request method failure captured: Aug 27 03:08:00.566659 n-d-852278-4 devstack@n-api.service[134051]: request: POST /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb/action HTTP/1.1 Aug 27 03:08:00.566659 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 03:08:00.566659 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 03:08:00.566659 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 03:08:00.566659 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 18 Aug 27 03:08:00.566659 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 03:08:00.566659 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 03:08:00.566659 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 03:08:00.566659 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 03:08:00.566659 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYnkbLTKVFjPQ5m3U2fG0N9Vjn4DkHnl17m4V7uHpwM3jvJACULLjB_xlJxNaWj4ki5CLI0R9EDG2yAGWVsjkvndQFsX9xXnPLGqFClIfHjZt1hqpj87tFD2RLalZegHNDkz7eKDMcWIs2wG0Lp8X-uNjMToWPkkmABfSYkxwHfHBds Aug 27 03:08:00.566659 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 03:08:00.566659 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 03:08:00.566659 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 03:08:00.566659 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 03:08:00.566659 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 03:08:00.566659 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 03:08:00.566659 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 3b9e672ac89e41ff82355daa83e852bd Aug 27 03:08:00.566659 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:08:00.566659 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 03:08:00.566659 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 03:08:00.566659 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3b9e672ac89e41ff82355daa83e852bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3b9e672ac89e41ff82355daa83e852bd", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3b9e672ac89e41ff82355daa83e852bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3b9e672ac89e41ff82355daa83e852bd"}]}] Aug 27 03:08:00.566659 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:08:00.566659 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 3b9e672ac89e41ff82355daa83e852bd Aug 27 03:08:00.566659 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:08:00.566659 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ServersNegativeTestJSON-1795266674-project Aug 27 03:08:00.566659 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 03:08:00.566659 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 03:08:00.566659 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 204c90820f6d4c64b31367aaf098325c Aug 27 03:08:00.566659 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ServersNegativeTestJSON-1795266674-project Aug 27 03:08:00.566659 n-d-852278-4 devstack@n-api.service[134051]: Aug 27 03:08:00.566659 n-d-852278-4 devstack@n-api.service[134051]: {"unshelve": null} Aug 27 03:08:00.566659 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 03:08:00.566659 n-d-852278-4 devstack@n-api.service[134051]: exception: Cannot 'unshelve' instance 72ffd032-b609-4e42-90d9-5454ac648eeb while it is in vm_state active Aug 27 03:08:00.566659 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '72ffd032-b609-4e42-90d9-5454ac648eeb', 'body': {'unshelve': None}} Aug 27 03:08:00.566659 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:08:00.566659 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:00.566659 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Aug 27 03:08:00.566659 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Aug 27 03:08:00.566659 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 27 03:08:00.566659 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 03:08:00.566659 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 03:08:00.566659 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 03:08:00.566659 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 27 03:08:00.566659 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 27 03:08:00.566659 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 72ffd032-b609-4e42-90d9-5454ac648eeb in vm_state active. Cannot unshelve while the instance is in this state. Aug 27 03:08:00.566659 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:08:00.566659 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:00.566659 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:08:00.566659 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:00.566659 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:00.566659 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:00.566659 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:08:00.566659 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:08:00.566659 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:08:00.566659 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:08:00.566659 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:08:00.566659 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:08:00.566659 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:08:00.566659 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:08:00.566659 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Aug 27 03:08:00.566659 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Aug 27 03:08:00.566659 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 27 03:08:00.566659 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 27 03:08:00.570448 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 72ffd032-b609-4e42-90d9-5454ac648eeb while it is in vm_state active Aug 27 03:08:00.570448 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:08:00.570448 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:00.570448 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:08:00.570448 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:00.570448 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:00.570448 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:00.570448 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:08:00.570448 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:08:00.570448 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 72ffd032-b609-4e42-90d9-5454ac648eeb while it is in vm_state active Aug 27 03:08:00.570448 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:08:00.570448 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3a766a86-fc7c-45c6-9479-ce7a6fca1f3c tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Returning 409 to user: Cannot 'unshelve' instance 72ffd032-b609-4e42-90d9-5454ac648eeb while it is in vm_state active {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:08:00.570448 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-3a766a86-fc7c-45c6-9479-ce7a6fca1f3c tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "POST /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb/action" status: 409 len: 146 microversion: 2.1 time: 0.190838 Aug 27 03:08:00.572283 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2527/5001] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:08:00 2022] POST /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb/action => generated 146 bytes in 197 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 27 03:08:00.578149 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d958ce6f-b941-4309-8f30-126559c2647e tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:00.578775 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d958ce6f-b941-4309-8f30-126559c2647e tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:00.586369 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d958ce6f-b941-4309-8f30-126559c2647e tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:00.586861 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d958ce6f-b941-4309-8f30-126559c2647e tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:00.587566 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d958ce6f-b941-4309-8f30-126559c2647e tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:00.588284 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d958ce6f-b941-4309-8f30-126559c2647e tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:00.588753 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d958ce6f-b941-4309-8f30-126559c2647e tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:00.589176 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d958ce6f-b941-4309-8f30-126559c2647e tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:00.763462 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-d958ce6f-b941-4309-8f30-126559c2647e tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:00.773334 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d958ce6f-b941-4309-8f30-126559c2647e tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1504 microversion: 2.1 time: 0.199694 Aug 27 03:08:00.779018 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2475/5002] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:00 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1504 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:08:00.800652 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d3ca11b8-316a-40da-ad49-d9dcc86cc64f tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:00.801278 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d3ca11b8-316a-40da-ad49-d9dcc86cc64f tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:00.810149 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-2183ef3a-1615-4499-8f2a-5bd98e6c496b tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:00.812760 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-2183ef3a-1615-4499-8f2a-5bd98e6c496b tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] [instance: 69be36fb-3a1b-480f-8613-5aa3881944ab] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:00.819651 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d3ca11b8-316a-40da-ad49-d9dcc86cc64f tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:00.820170 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d3ca11b8-316a-40da-ad49-d9dcc86cc64f tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:00.820642 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d3ca11b8-316a-40da-ad49-d9dcc86cc64f tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:00.821379 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d3ca11b8-316a-40da-ad49-d9dcc86cc64f tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:00.821835 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d3ca11b8-316a-40da-ad49-d9dcc86cc64f tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:00.822262 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d3ca11b8-316a-40da-ad49-d9dcc86cc64f tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:00.828563 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2183ef3a-1615-4499-8f2a-5bd98e6c496b tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:00.829697 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2183ef3a-1615-4499-8f2a-5bd98e6c496b tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:00.830365 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2183ef3a-1615-4499-8f2a-5bd98e6c496b tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:00.831536 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2183ef3a-1615-4499-8f2a-5bd98e6c496b tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:00.833114 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2183ef3a-1615-4499-8f2a-5bd98e6c496b tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:00.833794 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2183ef3a-1615-4499-8f2a-5bd98e6c496b tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:00.937336 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:08:01.104535 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-2183ef3a-1615-4499-8f2a-5bd98e6c496b tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34c5fc51d324c8e8adb3b9c5cd30b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4333b5357f49e883b72e96bdafb682', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:01.116746 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-2183ef3a-1615-4499-8f2a-5bd98e6c496b tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e34c5fc51d324c8e8adb3b9c5cd30b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4333b5357f49e883b72e96bdafb682', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:01.118524 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-2183ef3a-1615-4499-8f2a-5bd98e6c496b tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e34c5fc51d324c8e8adb3b9c5cd30b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4333b5357f49e883b72e96bdafb682', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:01.123800 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-2183ef3a-1615-4499-8f2a-5bd98e6c496b tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] 10.222.0.70 "GET /compute/v2.1/servers/69be36fb-3a1b-480f-8613-5aa3881944ab" status: 200 len: 1372 microversion: 2.47 time: 0.321267 Aug 27 03:08:01.124572 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2476/5003] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:08:00 2022] GET /compute/v2.1/servers/69be36fb-3a1b-480f-8613-5aa3881944ab => generated 1372 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:08:01.289469 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d3ca11b8-316a-40da-ad49-d9dcc86cc64f tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:01.311961 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d3ca11b8-316a-40da-ad49-d9dcc86cc64f tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1504 microversion: 2.1 time: 0.515935 Aug 27 03:08:01.321527 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2528/5004] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:00 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1504 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:01.343304 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3728e5e2-6cdd-43e9-bb3d-ffc46f3e8a9a tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2007279052_updated"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:08:01.353364 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-3728e5e2-6cdd-43e9-bb3d-ffc46f3e8a9a tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 7078dc6b-1b47-406d-a62f-1fdc25f98886] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:01.370143 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-3728e5e2-6cdd-43e9-bb3d-ffc46f3e8a9a tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] HTTP exception thrown: Instance 7078dc6b-1b47-406d-a62f-1fdc25f98886 could not be found. Aug 27 03:08:01.385538 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3728e5e2-6cdd-43e9-bb3d-ffc46f3e8a9a tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Request method failure captured: Aug 27 03:08:01.385538 n-d-852278-4 devstack@n-api.service[134052]: request: PUT /compute/v2.1/servers/7078dc6b-1b47-406d-a62f-1fdc25f98886 HTTP/1.1 Aug 27 03:08:01.385538 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 03:08:01.385538 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 03:08:01.385538 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 03:08:01.385538 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 81 Aug 27 03:08:01.385538 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 03:08:01.385538 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 03:08:01.385538 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 03:08:01.385538 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 03:08:01.385538 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYnkbLTKVFjPQ5m3U2fG0N9Vjn4DkHnl17m4V7uHpwM3jvJACULLjB_xlJxNaWj4ki5CLI0R9EDG2yAGWVsjkvndQFsX9xXnPLGqFClIfHjZt1hqpj87tFD2RLalZegHNDkz7eKDMcWIs2wG0Lp8X-uNjMToWPkkmABfSYkxwHfHBds Aug 27 03:08:01.385538 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 03:08:01.385538 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 03:08:01.385538 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 03:08:01.385538 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 03:08:01.385538 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 03:08:01.385538 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 03:08:01.385538 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 3b9e672ac89e41ff82355daa83e852bd Aug 27 03:08:01.385538 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:08:01.385538 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 03:08:01.385538 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 03:08:01.385538 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3b9e672ac89e41ff82355daa83e852bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3b9e672ac89e41ff82355daa83e852bd", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3b9e672ac89e41ff82355daa83e852bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3b9e672ac89e41ff82355daa83e852bd"}]}] Aug 27 03:08:01.385538 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:08:01.385538 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 3b9e672ac89e41ff82355daa83e852bd Aug 27 03:08:01.385538 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:08:01.385538 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ServersNegativeTestJSON-1795266674-project Aug 27 03:08:01.385538 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 03:08:01.385538 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 03:08:01.385538 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 204c90820f6d4c64b31367aaf098325c Aug 27 03:08:01.385538 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ServersNegativeTestJSON-1795266674-project Aug 27 03:08:01.385538 n-d-852278-4 devstack@n-api.service[134052]: Aug 27 03:08:01.385538 n-d-852278-4 devstack@n-api.service[134052]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2007279052_updated"}} Aug 27 03:08:01.385538 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 03:08:01.385538 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance 7078dc6b-1b47-406d-a62f-1fdc25f98886 could not be found. Aug 27 03:08:01.385538 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '7078dc6b-1b47-406d-a62f-1fdc25f98886', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2007279052_updated'}}} Aug 27 03:08:01.385538 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:08:01.385538 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:01.385538 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:08:01.385538 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:08:01.385538 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:08:01.385538 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:08:01.385538 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 03:08:01.385538 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 03:08:01.385538 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7078dc6b-1b47-406d-a62f-1fdc25f98886 could not be found. Aug 27 03:08:01.385538 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:08:01.385538 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:01.385538 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:08:01.385538 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:01.385538 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:01.385538 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:01.385538 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:08:01.385538 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:08:01.385538 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:08:01.385538 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:08:01.385538 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:08:01.385538 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:08:01.385538 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:08:01.385538 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:08:01.385538 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:08:01.385538 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:08:01.385538 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 27 03:08:01.385538 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Aug 27 03:08:01.385538 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Aug 27 03:08:01.385538 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:08:01.393486 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:08:01.393486 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:08:01.393486 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:08:01.393486 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7078dc6b-1b47-406d-a62f-1fdc25f98886 could not be found. Aug 27 03:08:01.393486 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:08:01.393486 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:01.393486 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:08:01.393486 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:01.393486 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:01.393486 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:01.393486 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:08:01.393486 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:08:01.393486 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7078dc6b-1b47-406d-a62f-1fdc25f98886 could not be found. Aug 27 03:08:01.393486 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:08:01.393486 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3728e5e2-6cdd-43e9-bb3d-ffc46f3e8a9a tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Returning 404 to user: Instance 7078dc6b-1b47-406d-a62f-1fdc25f98886 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:08:01.393486 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-3728e5e2-6cdd-43e9-bb3d-ffc46f3e8a9a tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "PUT /compute/v2.1/servers/7078dc6b-1b47-406d-a62f-1fdc25f98886" status: 404 len: 111 microversion: 2.1 time: 0.050077 Aug 27 03:08:01.393486 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2477/5005] 10.222.0.70 () {60 vars in 1256 bytes} [Sat Aug 27 03:08:01 2022] PUT /compute/v2.1/servers/7078dc6b-1b47-406d-a62f-1fdc25f98886 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:08:01.403075 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-bab3eb54-9844-4360-ae46-c9df5aa71547 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:01.403946 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-bab3eb54-9844-4360-ae46-c9df5aa71547 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:01.440600 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bab3eb54-9844-4360-ae46-c9df5aa71547 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:01.446587 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bab3eb54-9844-4360-ae46-c9df5aa71547 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:01.449162 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bab3eb54-9844-4360-ae46-c9df5aa71547 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:01.450082 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bab3eb54-9844-4360-ae46-c9df5aa71547 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:01.451366 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bab3eb54-9844-4360-ae46-c9df5aa71547 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:01.463207 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bab3eb54-9844-4360-ae46-c9df5aa71547 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:01.824250 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-bab3eb54-9844-4360-ae46-c9df5aa71547 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:01.838844 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-bab3eb54-9844-4360-ae46-c9df5aa71547 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1504 microversion: 2.1 time: 0.442131 Aug 27 03:08:01.840715 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2529/5006] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:01 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1504 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:01.864454 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-7ed3549e-ec0a-4a30-a260-74dfdd83d723 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:01.865337 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-7ed3549e-ec0a-4a30-a260-74dfdd83d723 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:01.877807 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7ed3549e-ec0a-4a30-a260-74dfdd83d723 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:01.880950 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7ed3549e-ec0a-4a30-a260-74dfdd83d723 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:01.881614 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7ed3549e-ec0a-4a30-a260-74dfdd83d723 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:01.882371 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7ed3549e-ec0a-4a30-a260-74dfdd83d723 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:01.882828 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7ed3549e-ec0a-4a30-a260-74dfdd83d723 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:01.884569 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7ed3549e-ec0a-4a30-a260-74dfdd83d723 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:02.134963 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-7ed3549e-ec0a-4a30-a260-74dfdd83d723 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:02.146663 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-7ed3549e-ec0a-4a30-a260-74dfdd83d723 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1504 microversion: 2.1 time: 0.285980 Aug 27 03:08:02.153735 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-35f0ff15-1be8-4422-af27-ea04fd5f7fbe tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:02.155027 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-35f0ff15-1be8-4422-af27-ea04fd5f7fbe tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] [instance: 69be36fb-3a1b-480f-8613-5aa3881944ab] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:02.165087 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2478/5007] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:01 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1504 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:02.167547 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-35f0ff15-1be8-4422-af27-ea04fd5f7fbe tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:02.168208 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-35f0ff15-1be8-4422-af27-ea04fd5f7fbe tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:02.170434 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-35f0ff15-1be8-4422-af27-ea04fd5f7fbe tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:02.171456 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-35f0ff15-1be8-4422-af27-ea04fd5f7fbe tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:02.172181 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-35f0ff15-1be8-4422-af27-ea04fd5f7fbe tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:02.174843 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-35f0ff15-1be8-4422-af27-ea04fd5f7fbe tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:02.186834 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c0c87aba-f94c-4d66-b2e0-846a71542f3f tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:08:02.205945 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c0c87aba-f94c-4d66-b2e0-846a71542f3f tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Request method failure captured: Aug 27 03:08:02.205945 n-d-852278-4 devstack@n-api.service[134052]: request: PUT /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb HTTP/1.1 Aug 27 03:08:02.205945 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 03:08:02.205945 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 03:08:02.205945 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 03:08:02.205945 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 280 Aug 27 03:08:02.205945 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 03:08:02.205945 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 03:08:02.205945 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 03:08:02.205945 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 03:08:02.205945 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYnkbLTKVFjPQ5m3U2fG0N9Vjn4DkHnl17m4V7uHpwM3jvJACULLjB_xlJxNaWj4ki5CLI0R9EDG2yAGWVsjkvndQFsX9xXnPLGqFClIfHjZt1hqpj87tFD2RLalZegHNDkz7eKDMcWIs2wG0Lp8X-uNjMToWPkkmABfSYkxwHfHBds Aug 27 03:08:02.205945 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 03:08:02.205945 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 03:08:02.205945 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 03:08:02.205945 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 03:08:02.205945 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 03:08:02.205945 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 03:08:02.205945 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 3b9e672ac89e41ff82355daa83e852bd Aug 27 03:08:02.205945 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:08:02.205945 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 03:08:02.205945 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 03:08:02.205945 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3b9e672ac89e41ff82355daa83e852bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3b9e672ac89e41ff82355daa83e852bd", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3b9e672ac89e41ff82355daa83e852bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3b9e672ac89e41ff82355daa83e852bd"}]}] Aug 27 03:08:02.205945 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:08:02.205945 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 3b9e672ac89e41ff82355daa83e852bd Aug 27 03:08:02.205945 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:08:02.205945 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ServersNegativeTestJSON-1795266674-project Aug 27 03:08:02.205945 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 03:08:02.205945 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 03:08:02.205945 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 204c90820f6d4c64b31367aaf098325c Aug 27 03:08:02.205945 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ServersNegativeTestJSON-1795266674-project Aug 27 03:08:02.205945 n-d-852278-4 devstack@n-api.service[134052]: Aug 27 03:08:02.205945 n-d-852278-4 devstack@n-api.service[134052]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 27 03:08:02.205945 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 03:08:02.205945 n-d-852278-4 devstack@n-api.service[134052]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 27 03:08:02.205945 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '72ffd032-b609-4e42-90d9-5454ac648eeb', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 27 03:08:02.205945 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:08:02.205945 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:02.205945 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 03:08:02.205945 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 03:08:02.205945 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 03:08:02.205945 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise error Aug 27 03:08:02.205945 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 27 03:08:02.205945 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:08:02.205945 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Aug 27 03:08:02.205945 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 27 03:08:02.205945 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:08:02.205945 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 27 03:08:02.205945 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 27 03:08:02.205945 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:08:02.205945 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:02.205945 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:08:02.205945 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:02.209207 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:02.209207 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:02.209207 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:08:02.209207 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:08:02.209207 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:08:02.209207 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:08:02.209207 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:08:02.209207 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:08:02.209207 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 03:08:02.209207 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 03:08:02.209207 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 03:08:02.209207 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 03:08:02.209207 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 03:08:02.209207 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 03:08:02.209207 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 27 03:08:02.209207 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:08:02.209207 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:02.209207 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:08:02.209207 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:02.209207 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:02.209207 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:02.209207 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 03:08:02.209207 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 03:08:02.209207 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 27 03:08:02.209207 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:08:02.213629 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c0c87aba-f94c-4d66-b2e0-846a71542f3f tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:08:02.215553 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c0c87aba-f94c-4d66-b2e0-846a71542f3f tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "PUT /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 400 len: 619 microversion: 2.1 time: 0.033218 Aug 27 03:08:02.219698 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2479/5008] 10.222.0.70 () {60 vars in 1257 bytes} [Sat Aug 27 03:08:02 2022] PUT /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 619 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:08:02.239299 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ffbb9507-55c6-4a97-96db-0ac9ca4ac527 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:02.240218 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-ffbb9507-55c6-4a97-96db-0ac9ca4ac527 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:02.275056 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ffbb9507-55c6-4a97-96db-0ac9ca4ac527 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:02.276883 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ffbb9507-55c6-4a97-96db-0ac9ca4ac527 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:02.277487 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ffbb9507-55c6-4a97-96db-0ac9ca4ac527 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:02.281772 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ffbb9507-55c6-4a97-96db-0ac9ca4ac527 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:02.282799 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ffbb9507-55c6-4a97-96db-0ac9ca4ac527 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:02.283451 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ffbb9507-55c6-4a97-96db-0ac9ca4ac527 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:02.426166 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-35f0ff15-1be8-4422-af27-ea04fd5f7fbe tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34c5fc51d324c8e8adb3b9c5cd30b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4333b5357f49e883b72e96bdafb682', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:02.443523 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-35f0ff15-1be8-4422-af27-ea04fd5f7fbe tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e34c5fc51d324c8e8adb3b9c5cd30b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4333b5357f49e883b72e96bdafb682', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:02.445266 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-35f0ff15-1be8-4422-af27-ea04fd5f7fbe tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e34c5fc51d324c8e8adb3b9c5cd30b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4333b5357f49e883b72e96bdafb682', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:02.453993 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-35f0ff15-1be8-4422-af27-ea04fd5f7fbe tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] 10.222.0.70 "GET /compute/v2.1/servers/69be36fb-3a1b-480f-8613-5aa3881944ab" status: 200 len: 1357 microversion: 2.47 time: 0.305239 Aug 27 03:08:02.478061 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2530/5009] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:08:02 2022] GET /compute/v2.1/servers/69be36fb-3a1b-480f-8613-5aa3881944ab => generated 1357 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:08:02.484020 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-fd74ae2e-f187-4a69-9c29-d296a0ebb67a tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:02.512070 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-fd74ae2e-f187-4a69-9c29-d296a0ebb67a tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e34c5fc51d324c8e8adb3b9c5cd30b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4333b5357f49e883b72e96bdafb682', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:02.514014 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-fd74ae2e-f187-4a69-9c29-d296a0ebb67a tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Searching by: {'deleted': False, 'project_id': '4a4333b5357f49e883b72e96bdafb682'} {{(pid=134051) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 03:08:02.541386 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fd74ae2e-f187-4a69-9c29-d296a0ebb67a tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:02.541871 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fd74ae2e-f187-4a69-9c29-d296a0ebb67a tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:02.542302 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fd74ae2e-f187-4a69-9c29-d296a0ebb67a tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:02.543028 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fd74ae2e-f187-4a69-9c29-d296a0ebb67a tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:02.543480 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fd74ae2e-f187-4a69-9c29-d296a0ebb67a tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:02.543896 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fd74ae2e-f187-4a69-9c29-d296a0ebb67a tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:02.657442 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-ffbb9507-55c6-4a97-96db-0ac9ca4ac527 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:02.670050 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ffbb9507-55c6-4a97-96db-0ac9ca4ac527 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1504 microversion: 2.1 time: 0.445168 Aug 27 03:08:02.686011 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2480/5010] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:02 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1504 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:02.695771 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.multi_cell_list [None req-fd74ae2e-f187-4a69-9c29-d296a0ebb67a tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=134051) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 03:08:02.700355 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-afe5164a-b879-40d6-bc15-2f7d17c52a76 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:02.701224 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-afe5164a-b879-40d6-bc15-2f7d17c52a76 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:02.708819 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-afe5164a-b879-40d6-bc15-2f7d17c52a76 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:02.709526 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-afe5164a-b879-40d6-bc15-2f7d17c52a76 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:02.710115 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-afe5164a-b879-40d6-bc15-2f7d17c52a76 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:02.711084 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-afe5164a-b879-40d6-bc15-2f7d17c52a76 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:02.711721 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-afe5164a-b879-40d6-bc15-2f7d17c52a76 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:02.712450 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-afe5164a-b879-40d6-bc15-2f7d17c52a76 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:02.817827 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-fd74ae2e-f187-4a69-9c29-d296a0ebb67a tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34c5fc51d324c8e8adb3b9c5cd30b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4333b5357f49e883b72e96bdafb682', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:02.825931 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fd74ae2e-f187-4a69-9c29-d296a0ebb67a tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:02.829854 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fd74ae2e-f187-4a69-9c29-d296a0ebb67a tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:02.830517 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fd74ae2e-f187-4a69-9c29-d296a0ebb67a tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:02.859130 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-fd74ae2e-f187-4a69-9c29-d296a0ebb67a tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e34c5fc51d324c8e8adb3b9c5cd30b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4333b5357f49e883b72e96bdafb682', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:02.862505 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-fd74ae2e-f187-4a69-9c29-d296a0ebb67a tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e34c5fc51d324c8e8adb3b9c5cd30b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4333b5357f49e883b72e96bdafb682', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:03.109441 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-fd74ae2e-f187-4a69-9c29-d296a0ebb67a tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] 10.222.0.70 "GET /compute/v2.1/servers/detail" status: 200 len: 2706 microversion: 2.47 time: 0.630013 Aug 27 03:08:03.112719 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2531/5011] 10.222.0.70 () {60 vars in 1187 bytes} [Sat Aug 27 03:08:02 2022] GET /compute/v2.1/servers/detail => generated 2706 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:08:03.145303 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e8fa4303-6163-4306-90a7-e4ff1e75d0df tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:03.145838 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-e8fa4303-6163-4306-90a7-e4ff1e75d0df tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] [instance: 69be36fb-3a1b-480f-8613-5aa3881944ab] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:03.170279 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e8fa4303-6163-4306-90a7-e4ff1e75d0df tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:03.171667 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e8fa4303-6163-4306-90a7-e4ff1e75d0df tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:03.172923 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e8fa4303-6163-4306-90a7-e4ff1e75d0df tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:03.173841 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e8fa4303-6163-4306-90a7-e4ff1e75d0df tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:03.174454 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e8fa4303-6163-4306-90a7-e4ff1e75d0df tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:03.175037 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e8fa4303-6163-4306-90a7-e4ff1e75d0df tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:03.194384 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-afe5164a-b879-40d6-bc15-2f7d17c52a76 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:03.210825 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-afe5164a-b879-40d6-bc15-2f7d17c52a76 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1504 microversion: 2.1 time: 0.520255 Aug 27 03:08:03.225856 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2481/5012] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:02 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1504 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:03.228960 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-e8fa4303-6163-4306-90a7-e4ff1e75d0df tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] [instance: 69be36fb-3a1b-480f-8613-5aa3881944ab] Going to try to terminate instance {{(pid=134051) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:08:03.234098 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-04c3fef4-5f76-467e-ad9b-b4ab96f7fbdf tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:08:03.238389 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-04c3fef4-5f76-467e-ad9b-b4ab96f7fbdf tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Request method failure captured: Aug 27 03:08:03.238389 n-d-852278-4 devstack@n-api.service[134052]: request: PUT /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb HTTP/1.1 Aug 27 03:08:03.238389 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 03:08:03.238389 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 03:08:03.238389 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 03:08:03.238389 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 24 Aug 27 03:08:03.238389 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 03:08:03.238389 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 03:08:03.238389 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 03:08:03.238389 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 03:08:03.238389 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYnkbLTKVFjPQ5m3U2fG0N9Vjn4DkHnl17m4V7uHpwM3jvJACULLjB_xlJxNaWj4ki5CLI0R9EDG2yAGWVsjkvndQFsX9xXnPLGqFClIfHjZt1hqpj87tFD2RLalZegHNDkz7eKDMcWIs2wG0Lp8X-uNjMToWPkkmABfSYkxwHfHBds Aug 27 03:08:03.238389 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 03:08:03.238389 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 03:08:03.238389 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 03:08:03.238389 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 03:08:03.238389 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 03:08:03.238389 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 03:08:03.238389 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 3b9e672ac89e41ff82355daa83e852bd Aug 27 03:08:03.238389 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:08:03.238389 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 03:08:03.238389 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 03:08:03.238389 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3b9e672ac89e41ff82355daa83e852bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3b9e672ac89e41ff82355daa83e852bd", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3b9e672ac89e41ff82355daa83e852bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3b9e672ac89e41ff82355daa83e852bd"}]}] Aug 27 03:08:03.238389 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:08:03.238389 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 3b9e672ac89e41ff82355daa83e852bd Aug 27 03:08:03.238389 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:08:03.238389 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ServersNegativeTestJSON-1795266674-project Aug 27 03:08:03.238389 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 03:08:03.238389 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 03:08:03.238389 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 204c90820f6d4c64b31367aaf098325c Aug 27 03:08:03.238389 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ServersNegativeTestJSON-1795266674-project Aug 27 03:08:03.238389 n-d-852278-4 devstack@n-api.service[134052]: Aug 27 03:08:03.238389 n-d-852278-4 devstack@n-api.service[134052]: {"server": {"name": ""}} Aug 27 03:08:03.238389 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 03:08:03.238389 n-d-852278-4 devstack@n-api.service[134052]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 27 03:08:03.238389 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '72ffd032-b609-4e42-90d9-5454ac648eeb', 'body': {'server': {'name': ''}}} Aug 27 03:08:03.238389 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:08:03.238389 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:03.238389 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 03:08:03.238389 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 03:08:03.238389 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 03:08:03.238389 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise error Aug 27 03:08:03.238389 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 27 03:08:03.238389 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:08:03.238389 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Aug 27 03:08:03.238389 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 27 03:08:03.238389 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:08:03.238389 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 27 03:08:03.238389 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi '' Aug 27 03:08:03.238389 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:08:03.238389 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:03.238389 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:08:03.238389 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:03.238389 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:03.238389 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:03.238389 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:08:03.238389 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:08:03.238389 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:08:03.238389 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:08:03.238389 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:08:03.238389 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:08:03.238389 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 03:08:03.238389 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 03:08:03.238389 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 03:08:03.238389 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 03:08:03.238389 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 03:08:03.238389 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 03:08:03.242149 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 27 03:08:03.242149 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:08:03.242149 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:03.242149 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:08:03.242149 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:03.242149 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:03.242149 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:03.242149 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 03:08:03.242149 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 03:08:03.242149 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 27 03:08:03.242149 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:08:03.244254 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-04c3fef4-5f76-467e-ad9b-b4ab96f7fbdf tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:08:03.245387 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-04c3fef4-5f76-467e-ad9b-b4ab96f7fbdf tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "PUT /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 400 len: 108 microversion: 2.1 time: 0.015388 Aug 27 03:08:03.258247 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2482/5013] 10.222.0.70 () {60 vars in 1256 bytes} [Sat Aug 27 03:08:03 2022] PUT /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 108 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:08:03.271523 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-30823e33-ad20-4964-b1f6-074f15610462 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:03.275682 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-30823e33-ad20-4964-b1f6-074f15610462 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:03.291783 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-30823e33-ad20-4964-b1f6-074f15610462 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:03.292803 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-30823e33-ad20-4964-b1f6-074f15610462 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:03.293484 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-30823e33-ad20-4964-b1f6-074f15610462 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:03.294551 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-30823e33-ad20-4964-b1f6-074f15610462 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:03.295313 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-30823e33-ad20-4964-b1f6-074f15610462 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:03.295977 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-30823e33-ad20-4964-b1f6-074f15610462 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:03.478237 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e8fa4303-6163-4306-90a7-e4ff1e75d0df tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] 10.222.0.70 "DELETE /compute/v2.1/servers/69be36fb-3a1b-480f-8613-5aa3881944ab" status: 204 len: 0 microversion: 2.47 time: 0.338311 Aug 27 03:08:03.479163 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2532/5014] 10.222.0.70 () {60 vars in 1280 bytes} [Sat Aug 27 03:08:03 2022] DELETE /compute/v2.1/servers/69be36fb-3a1b-480f-8613-5aa3881944ab => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 03:08:03.491788 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-013d0046-38af-4844-8b93-ba0ecde69f7a tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:03.493921 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-013d0046-38af-4844-8b93-ba0ecde69f7a tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] [instance: 69be36fb-3a1b-480f-8613-5aa3881944ab] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:03.508370 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-013d0046-38af-4844-8b93-ba0ecde69f7a tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:03.511256 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-013d0046-38af-4844-8b93-ba0ecde69f7a tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:03.512017 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-013d0046-38af-4844-8b93-ba0ecde69f7a tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:03.513133 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-013d0046-38af-4844-8b93-ba0ecde69f7a tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:03.515280 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-013d0046-38af-4844-8b93-ba0ecde69f7a tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:03.515952 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-013d0046-38af-4844-8b93-ba0ecde69f7a tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:03.614871 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-30823e33-ad20-4964-b1f6-074f15610462 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:03.623606 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-30823e33-ad20-4964-b1f6-074f15610462 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1504 microversion: 2.1 time: 0.359758 Aug 27 03:08:03.629062 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2483/5015] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:03 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1504 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:03.730202 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-013d0046-38af-4844-8b93-ba0ecde69f7a tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34c5fc51d324c8e8adb3b9c5cd30b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4333b5357f49e883b72e96bdafb682', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:03.743710 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-013d0046-38af-4844-8b93-ba0ecde69f7a tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e34c5fc51d324c8e8adb3b9c5cd30b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4333b5357f49e883b72e96bdafb682', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:03.750168 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-013d0046-38af-4844-8b93-ba0ecde69f7a tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e34c5fc51d324c8e8adb3b9c5cd30b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4333b5357f49e883b72e96bdafb682', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:03.754834 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-013d0046-38af-4844-8b93-ba0ecde69f7a tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] 10.222.0.70 "GET /compute/v2.1/servers/69be36fb-3a1b-480f-8613-5aa3881944ab" status: 200 len: 1363 microversion: 2.47 time: 0.268815 Aug 27 03:08:03.755625 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2533/5016] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:08:03 2022] GET /compute/v2.1/servers/69be36fb-3a1b-480f-8613-5aa3881944ab => generated 1363 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:08:04.785761 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f21d5717-bd7b-4383-9344-dcb1659c5382 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:04.786395 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-f21d5717-bd7b-4383-9344-dcb1659c5382 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] [instance: 69be36fb-3a1b-480f-8613-5aa3881944ab] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:04.801111 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f21d5717-bd7b-4383-9344-dcb1659c5382 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:04.801883 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f21d5717-bd7b-4383-9344-dcb1659c5382 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:04.802513 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f21d5717-bd7b-4383-9344-dcb1659c5382 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:04.803407 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f21d5717-bd7b-4383-9344-dcb1659c5382 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:04.805333 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f21d5717-bd7b-4383-9344-dcb1659c5382 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:04.806302 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f21d5717-bd7b-4383-9344-dcb1659c5382 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:04.895761 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-f21d5717-bd7b-4383-9344-dcb1659c5382 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34c5fc51d324c8e8adb3b9c5cd30b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4333b5357f49e883b72e96bdafb682', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:04.907465 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-f21d5717-bd7b-4383-9344-dcb1659c5382 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e34c5fc51d324c8e8adb3b9c5cd30b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4333b5357f49e883b72e96bdafb682', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:04.910895 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-f21d5717-bd7b-4383-9344-dcb1659c5382 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e34c5fc51d324c8e8adb3b9c5cd30b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4333b5357f49e883b72e96bdafb682', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:04.913284 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f21d5717-bd7b-4383-9344-dcb1659c5382 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] 10.222.0.70 "GET /compute/v2.1/servers/69be36fb-3a1b-480f-8613-5aa3881944ab" status: 200 len: 1363 microversion: 2.47 time: 0.138150 Aug 27 03:08:04.926497 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2484/5017] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:08:04 2022] GET /compute/v2.1/servers/69be36fb-3a1b-480f-8613-5aa3881944ab => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:08:05.953219 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e1d2ab35-e17c-4f81-9e83-c075b348da85 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:05.956128 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-e1d2ab35-e17c-4f81-9e83-c075b348da85 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] [instance: 69be36fb-3a1b-480f-8613-5aa3881944ab] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:05.978452 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e1d2ab35-e17c-4f81-9e83-c075b348da85 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:05.980017 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e1d2ab35-e17c-4f81-9e83-c075b348da85 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:05.980755 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e1d2ab35-e17c-4f81-9e83-c075b348da85 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:05.998227 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e1d2ab35-e17c-4f81-9e83-c075b348da85 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:06.013011 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e1d2ab35-e17c-4f81-9e83-c075b348da85 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:06.019601 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e1d2ab35-e17c-4f81-9e83-c075b348da85 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:06.188649 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e1d2ab35-e17c-4f81-9e83-c075b348da85 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:06.191417 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e1d2ab35-e17c-4f81-9e83-c075b348da85 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:06.191887 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e1d2ab35-e17c-4f81-9e83-c075b348da85 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:06.192367 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.objects.instance [None req-e1d2ab35-e17c-4f81-9e83-c075b348da85 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lazy-loading 'fault' on Instance uuid 69be36fb-3a1b-480f-8613-5aa3881944ab {{(pid=134051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:08:06.299454 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e1d2ab35-e17c-4f81-9e83-c075b348da85 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34c5fc51d324c8e8adb3b9c5cd30b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4333b5357f49e883b72e96bdafb682', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:06.307843 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e1d2ab35-e17c-4f81-9e83-c075b348da85 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e34c5fc51d324c8e8adb3b9c5cd30b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4333b5357f49e883b72e96bdafb682', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:06.313289 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e1d2ab35-e17c-4f81-9e83-c075b348da85 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e34c5fc51d324c8e8adb3b9c5cd30b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4333b5357f49e883b72e96bdafb682', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:06.318024 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e1d2ab35-e17c-4f81-9e83-c075b348da85 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] 10.222.0.70 "GET /compute/v2.1/servers/69be36fb-3a1b-480f-8613-5aa3881944ab" status: 200 len: 1368 microversion: 2.47 time: 0.369452 Aug 27 03:08:06.318741 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2534/5018] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:08:05 2022] GET /compute/v2.1/servers/69be36fb-3a1b-480f-8613-5aa3881944ab => generated 1368 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:08:06.665811 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-36dad0be-c253-4df4-be3c-a69aa27afb52 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Action: 'create', calling method: .version_select at 0x7f5ee2f81550>, body: {"keypair": {"name": "tempest-keypair-1356932145", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJDTYibsANrYFZGPDMP19hGWDonfehiWjbKTJZbSuNfl2ZhGKYqlia15ZtEyFI9ee3fzGRgio+veRmmQpHNpWE05Kzy5ZLCL+9qqIgkvGclpCsnqnJZKx/6aP162BTnHVw=="}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:08:06.727709 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-36dad0be-c253-4df4-be3c-a69aa27afb52 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Getting quotas for project 819c3b9e6e3c4a868b1ba77f48ff2e56. Resources: {'key_pairs'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:08:06.747386 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-36dad0be-c253-4df4-be3c-a69aa27afb52 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Getting quotas for user 8bf00e5925fa4227a2fe0b6b155a4ee4 and project 819c3b9e6e3c4a868b1ba77f48ff2e56. Resources: {'key_pairs'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:08:06.815081 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-36dad0be-c253-4df4-be3c-a69aa27afb52 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.404362 Aug 27 03:08:06.816452 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2485/5019] 10.222.0.70 () {62 vars in 1200 bytes} [Sat Aug 27 03:08:06 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 406 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 27 03:08:07.360010 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d80e9c72-d2c6-4c59-b951-7b3b322c9a24 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:07.361202 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d80e9c72-d2c6-4c59-b951-7b3b322c9a24 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] [instance: 69be36fb-3a1b-480f-8613-5aa3881944ab] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:07.375995 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d80e9c72-d2c6-4c59-b951-7b3b322c9a24 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:07.376546 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d80e9c72-d2c6-4c59-b951-7b3b322c9a24 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:07.377000 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d80e9c72-d2c6-4c59-b951-7b3b322c9a24 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:07.377738 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d80e9c72-d2c6-4c59-b951-7b3b322c9a24 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:07.378197 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d80e9c72-d2c6-4c59-b951-7b3b322c9a24 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:07.378622 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d80e9c72-d2c6-4c59-b951-7b3b322c9a24 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:07.412603 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-d80e9c72-d2c6-4c59-b951-7b3b322c9a24 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] HTTP exception thrown: Instance 69be36fb-3a1b-480f-8613-5aa3881944ab could not be found. Aug 27 03:08:07.414226 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d80e9c72-d2c6-4c59-b951-7b3b322c9a24 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Request method failure captured: Aug 27 03:08:07.414226 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/69be36fb-3a1b-480f-8613-5aa3881944ab HTTP/1.1 Aug 27 03:08:07.414226 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 03:08:07.414226 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 03:08:07.414226 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 03:08:07.414226 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 03:08:07.414226 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 03:08:07.414226 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 03:08:07.414226 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 03:08:07.414226 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 03:08:07.414226 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYpqez7il--AXEXLahhJPC24stP0vHG6TW-pBnqIHYvwBYKuKrt4AhEVVnjTSi4zxv3HtRdA4xsoTORMJ_a_43_XZXo0Xx0AOrWtJJR3tNAg1mhiWW6Ukp6W7ZaI_EbcQToYJfQHyjkKI1yTO4raEBjtsD_AkGc16WjFry39sW4X_v4 Aug 27 03:08:07.414226 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 03:08:07.414226 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 03:08:07.414226 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 03:08:07.414226 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 03:08:07.414226 n-d-852278-4 devstack@n-api.service[134051]: X-Openstack-Nova-Api-Version: 2.47 Aug 27 03:08:07.414226 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 03:08:07.414226 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 03:08:07.414226 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 4a4333b5357f49e883b72e96bdafb682 Aug 27 03:08:07.414226 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ServerShowV247Test-523011610 Aug 27 03:08:07.414226 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 03:08:07.414226 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 03:08:07.414226 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4a4333b5357f49e883b72e96bdafb682"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_4a4333b5357f49e883b72e96bdafb682", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4a4333b5357f49e883b72e96bdafb682"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/4a4333b5357f49e883b72e96bdafb682"}]}] Aug 27 03:08:07.414226 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ServerShowV247Test-523011610 Aug 27 03:08:07.414226 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 4a4333b5357f49e883b72e96bdafb682 Aug 27 03:08:07.414226 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ServerShowV247Test-523011610 Aug 27 03:08:07.414226 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ServerShowV247Test-523011610-project Aug 27 03:08:07.414226 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 03:08:07.414226 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 03:08:07.414226 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: e34c5fc51d324c8e8adb3b9c5cd30b6c Aug 27 03:08:07.414226 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ServerShowV247Test-523011610-project Aug 27 03:08:07.414226 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 03:08:07.414226 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance 69be36fb-3a1b-480f-8613-5aa3881944ab could not be found. Aug 27 03:08:07.414226 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '69be36fb-3a1b-480f-8613-5aa3881944ab'} Aug 27 03:08:07.414226 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:08:07.414226 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:07.414226 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:08:07.414226 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:08:07.414226 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:08:07.414226 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:08:07.414226 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:08:07.414226 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:08:07.414226 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:08:07.414226 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:08:07.414226 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69be36fb-3a1b-480f-8613-5aa3881944ab could not be found. Aug 27 03:08:07.414226 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:08:07.414226 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:07.414226 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:08:07.414226 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:07.414226 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:07.414226 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:07.414226 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:08:07.414226 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:08:07.414226 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:08:07.414226 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:08:07.414226 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:08:07.414226 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:08:07.414226 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:08:07.414226 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:08:07.414226 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:08:07.414226 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:08:07.414226 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69be36fb-3a1b-480f-8613-5aa3881944ab could not be found. Aug 27 03:08:07.414226 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:08:07.414226 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:07.414226 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:08:07.420231 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:07.420231 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:07.420231 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:07.420231 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:08:07.420231 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:08:07.420231 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69be36fb-3a1b-480f-8613-5aa3881944ab could not be found. Aug 27 03:08:07.420231 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:08:07.420231 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d80e9c72-d2c6-4c59-b951-7b3b322c9a24 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Returning 404 to user: Instance 69be36fb-3a1b-480f-8613-5aa3881944ab could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:08:07.420231 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d80e9c72-d2c6-4c59-b951-7b3b322c9a24 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] 10.222.0.70 "GET /compute/v2.1/servers/69be36fb-3a1b-480f-8613-5aa3881944ab" status: 404 len: 111 microversion: 2.47 time: 0.072212 Aug 27 03:08:07.426227 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-30f734dd-b2a7-4ef8-9f2e-6c91d9fb3c7f tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:07.426728 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-30f734dd-b2a7-4ef8-9f2e-6c91d9fb3c7f tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] [instance: b4627c24-32f3-4d51-ac9f-3e78aff94796] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:07.442678 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2535/5020] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:08:07 2022] GET /compute/v2.1/servers/69be36fb-3a1b-480f-8613-5aa3881944ab => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 27 03:08:07.444525 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-30f734dd-b2a7-4ef8-9f2e-6c91d9fb3c7f tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:07.445027 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-30f734dd-b2a7-4ef8-9f2e-6c91d9fb3c7f tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:07.445460 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-30f734dd-b2a7-4ef8-9f2e-6c91d9fb3c7f tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:07.446342 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-30f734dd-b2a7-4ef8-9f2e-6c91d9fb3c7f tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:07.446944 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-30f734dd-b2a7-4ef8-9f2e-6c91d9fb3c7f tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:07.447516 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-30f734dd-b2a7-4ef8-9f2e-6c91d9fb3c7f tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:07.476252 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-30f734dd-b2a7-4ef8-9f2e-6c91d9fb3c7f tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] [instance: b4627c24-32f3-4d51-ac9f-3e78aff94796] Going to try to terminate instance {{(pid=134052) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:08:07.669503 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-30f734dd-b2a7-4ef8-9f2e-6c91d9fb3c7f tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] 10.222.0.70 "DELETE /compute/v2.1/servers/b4627c24-32f3-4d51-ac9f-3e78aff94796" status: 204 len: 0 microversion: 2.47 time: 0.247951 Aug 27 03:08:07.670982 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2486/5021] 10.222.0.70 () {60 vars in 1280 bytes} [Sat Aug 27 03:08:07 2022] DELETE /compute/v2.1/servers/b4627c24-32f3-4d51-ac9f-3e78aff94796 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 27 03:08:07.680063 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-88a1ae68-d041-44e9-900a-1751fc1dd81d tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:07.682113 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-88a1ae68-d041-44e9-900a-1751fc1dd81d tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] [instance: b4627c24-32f3-4d51-ac9f-3e78aff94796] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:07.693874 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-88a1ae68-d041-44e9-900a-1751fc1dd81d tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:07.694750 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-88a1ae68-d041-44e9-900a-1751fc1dd81d tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:07.695402 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-88a1ae68-d041-44e9-900a-1751fc1dd81d tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:07.700252 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-88a1ae68-d041-44e9-900a-1751fc1dd81d tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:07.701811 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-88a1ae68-d041-44e9-900a-1751fc1dd81d tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:07.702487 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-88a1ae68-d041-44e9-900a-1751fc1dd81d tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:08.965364 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-88a1ae68-d041-44e9-900a-1751fc1dd81d tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34c5fc51d324c8e8adb3b9c5cd30b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4333b5357f49e883b72e96bdafb682', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:08.974774 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-88a1ae68-d041-44e9-900a-1751fc1dd81d tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e34c5fc51d324c8e8adb3b9c5cd30b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4333b5357f49e883b72e96bdafb682', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:08.976222 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-88a1ae68-d041-44e9-900a-1751fc1dd81d tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e34c5fc51d324c8e8adb3b9c5cd30b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4333b5357f49e883b72e96bdafb682', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:08.995555 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-88a1ae68-d041-44e9-900a-1751fc1dd81d tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] 10.222.0.70 "GET /compute/v2.1/servers/b4627c24-32f3-4d51-ac9f-3e78aff94796" status: 200 len: 1362 microversion: 2.47 time: 1.317498 Aug 27 03:08:09.006603 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2536/5022] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:08:07 2022] GET /compute/v2.1/servers/b4627c24-32f3-4d51-ac9f-3e78aff94796 => generated 1362 bytes in 1330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:08:10.021609 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5fa06086-6e90-41cc-83ba-2cc81aad36a6 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:10.022372 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-5fa06086-6e90-41cc-83ba-2cc81aad36a6 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] [instance: b4627c24-32f3-4d51-ac9f-3e78aff94796] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:10.046596 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5fa06086-6e90-41cc-83ba-2cc81aad36a6 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:10.047099 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5fa06086-6e90-41cc-83ba-2cc81aad36a6 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:10.047544 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5fa06086-6e90-41cc-83ba-2cc81aad36a6 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:10.048284 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5fa06086-6e90-41cc-83ba-2cc81aad36a6 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:10.048764 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5fa06086-6e90-41cc-83ba-2cc81aad36a6 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:10.049186 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5fa06086-6e90-41cc-83ba-2cc81aad36a6 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:10.294059 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-5fa06086-6e90-41cc-83ba-2cc81aad36a6 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34c5fc51d324c8e8adb3b9c5cd30b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4333b5357f49e883b72e96bdafb682', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:10.303204 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-5fa06086-6e90-41cc-83ba-2cc81aad36a6 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e34c5fc51d324c8e8adb3b9c5cd30b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4333b5357f49e883b72e96bdafb682', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:10.310325 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-5fa06086-6e90-41cc-83ba-2cc81aad36a6 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e34c5fc51d324c8e8adb3b9c5cd30b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4333b5357f49e883b72e96bdafb682', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:10.311665 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-5fa06086-6e90-41cc-83ba-2cc81aad36a6 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] 10.222.0.70 "GET /compute/v2.1/servers/b4627c24-32f3-4d51-ac9f-3e78aff94796" status: 200 len: 1362 microversion: 2.47 time: 0.296199 Aug 27 03:08:10.312269 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2487/5023] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:08:10 2022] GET /compute/v2.1/servers/b4627c24-32f3-4d51-ac9f-3e78aff94796 => generated 1362 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:08:10.713110 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-aadf1771-7ed6-441a-909d-680948fcd299 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-634402125", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b682410a-8656-4b1d-93c8-feff8a0d8bf0"}], "security_groups": [{"name": "tempest-securitygroup--1404926536"}], "key_name": "tempest-keypair-1356932145", "user_data": "}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:08:10.937745 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.network.neutron [None req-aadf1771-7ed6-441a-909d-680948fcd299 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] validate_networks() for [('b682410a-8656-4b1d-93c8-feff8a0d8bf0', None, None, None, None, None)] {{(pid=134051) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:08:11.348715 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b255a599-f2e2-4fac-84c1-7b8c3952d67d tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:11.349335 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b255a599-f2e2-4fac-84c1-7b8c3952d67d tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] [instance: b4627c24-32f3-4d51-ac9f-3e78aff94796] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:11.363438 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b255a599-f2e2-4fac-84c1-7b8c3952d67d tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:11.363930 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b255a599-f2e2-4fac-84c1-7b8c3952d67d tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:11.375704 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b255a599-f2e2-4fac-84c1-7b8c3952d67d tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:11.377044 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b255a599-f2e2-4fac-84c1-7b8c3952d67d tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:11.377706 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b255a599-f2e2-4fac-84c1-7b8c3952d67d tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:11.378296 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b255a599-f2e2-4fac-84c1-7b8c3952d67d tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:11.443490 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b255a599-f2e2-4fac-84c1-7b8c3952d67d tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:11.444211 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b255a599-f2e2-4fac-84c1-7b8c3952d67d tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:11.444946 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b255a599-f2e2-4fac-84c1-7b8c3952d67d tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:11.455642 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.instance [None req-b255a599-f2e2-4fac-84c1-7b8c3952d67d tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lazy-loading 'fault' on Instance uuid b4627c24-32f3-4d51-ac9f-3e78aff94796 {{(pid=134052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:08:11.699623 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b255a599-f2e2-4fac-84c1-7b8c3952d67d tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34c5fc51d324c8e8adb3b9c5cd30b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4333b5357f49e883b72e96bdafb682', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:11.708094 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b255a599-f2e2-4fac-84c1-7b8c3952d67d tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e34c5fc51d324c8e8adb3b9c5cd30b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4333b5357f49e883b72e96bdafb682', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:11.709563 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b255a599-f2e2-4fac-84c1-7b8c3952d67d tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e34c5fc51d324c8e8adb3b9c5cd30b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4333b5357f49e883b72e96bdafb682', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:11.715265 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b255a599-f2e2-4fac-84c1-7b8c3952d67d tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] 10.222.0.70 "GET /compute/v2.1/servers/b4627c24-32f3-4d51-ac9f-3e78aff94796" status: 200 len: 1367 microversion: 2.47 time: 0.370446 Aug 27 03:08:11.715906 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2488/5024] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:08:11 2022] GET /compute/v2.1/servers/b4627c24-32f3-4d51-ac9f-3e78aff94796 => generated 1367 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:08:12.450880 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-aadf1771-7ed6-441a-909d-680948fcd299 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Flavor limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:08:12.451876 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-aadf1771-7ed6-441a-909d-680948fcd299 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Image limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:08:12.452527 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-aadf1771-7ed6-441a-909d-680948fcd299 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Flavor pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:08:12.453079 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-aadf1771-7ed6-441a-909d-680948fcd299 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Image pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:08:12.453694 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-aadf1771-7ed6-441a-909d-680948fcd299 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:08:12.471398 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-aadf1771-7ed6-441a-909d-680948fcd299 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:12.474616 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-aadf1771-7ed6-441a-909d-680948fcd299 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:12.475240 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-aadf1771-7ed6-441a-909d-680948fcd299 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:12.476953 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-aadf1771-7ed6-441a-909d-680948fcd299 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:12.479657 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-aadf1771-7ed6-441a-909d-680948fcd299 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:12.480356 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-aadf1771-7ed6-441a-909d-680948fcd299 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:12.522364 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-aadf1771-7ed6-441a-909d-680948fcd299 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Getting quotas for project 819c3b9e6e3c4a868b1ba77f48ff2e56. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:08:12.532440 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-aadf1771-7ed6-441a-909d-680948fcd299 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Getting quotas for user 8bf00e5925fa4227a2fe0b6b155a4ee4 and project 819c3b9e6e3c4a868b1ba77f48ff2e56. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:08:12.546825 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-aadf1771-7ed6-441a-909d-680948fcd299 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Going to run 1 instances... {{(pid=134051) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:08:12.550251 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-aadf1771-7ed6-441a-909d-680948fcd299 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134051) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:08:12.622994 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-aadf1771-7ed6-441a-909d-680948fcd299 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.914298 Aug 27 03:08:12.624521 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2537/5025] 10.222.0.70 () {62 vars in 1188 bytes} [Sat Aug 27 03:08:10 2022] POST /compute/v2.1/servers => generated 402 bytes in 1916 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 27 03:08:12.635172 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f60241df-c1e5-4def-81cc-b44da5ed95c7 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:12.635881 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-f60241df-c1e5-4def-81cc-b44da5ed95c7 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:12.741835 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-2b4f0593-b816-4379-b2d4-acfe5cb16e26 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:12.742508 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-2b4f0593-b816-4379-b2d4-acfe5cb16e26 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] [instance: b4627c24-32f3-4d51-ac9f-3e78aff94796] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:12.759070 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2b4f0593-b816-4379-b2d4-acfe5cb16e26 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:12.766402 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2b4f0593-b816-4379-b2d4-acfe5cb16e26 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:12.767901 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2b4f0593-b816-4379-b2d4-acfe5cb16e26 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:12.768686 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2b4f0593-b816-4379-b2d4-acfe5cb16e26 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:12.769737 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-f60241df-c1e5-4def-81cc-b44da5ed95c7 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:12.770655 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2b4f0593-b816-4379-b2d4-acfe5cb16e26 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:12.772416 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2b4f0593-b816-4379-b2d4-acfe5cb16e26 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:12.794266 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-f60241df-c1e5-4def-81cc-b44da5ed95c7 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:12.801294 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-f60241df-c1e5-4def-81cc-b44da5ed95c7 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:12.803662 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f60241df-c1e5-4def-81cc-b44da5ed95c7 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22" status: 200 len: 1281 microversion: 2.20 time: 0.172566 Aug 27 03:08:12.807451 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2489/5026] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:08:12 2022] GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22 => generated 1281 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:08:12.817210 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-2b4f0593-b816-4379-b2d4-acfe5cb16e26 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] HTTP exception thrown: Instance b4627c24-32f3-4d51-ac9f-3e78aff94796 could not be found. Aug 27 03:08:12.818774 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-2b4f0593-b816-4379-b2d4-acfe5cb16e26 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Request method failure captured: Aug 27 03:08:12.818774 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/b4627c24-32f3-4d51-ac9f-3e78aff94796 HTTP/1.1 Aug 27 03:08:12.818774 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 03:08:12.818774 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 03:08:12.818774 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 03:08:12.818774 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 03:08:12.818774 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 03:08:12.818774 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 03:08:12.818774 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 03:08:12.818774 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 03:08:12.818774 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYpqez7il--AXEXLahhJPC24stP0vHG6TW-pBnqIHYvwBYKuKrt4AhEVVnjTSi4zxv3HtRdA4xsoTORMJ_a_43_XZXo0Xx0AOrWtJJR3tNAg1mhiWW6Ukp6W7ZaI_EbcQToYJfQHyjkKI1yTO4raEBjtsD_AkGc16WjFry39sW4X_v4 Aug 27 03:08:12.818774 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 03:08:12.818774 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 03:08:12.818774 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 03:08:12.818774 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 03:08:12.818774 n-d-852278-4 devstack@n-api.service[134051]: X-Openstack-Nova-Api-Version: 2.47 Aug 27 03:08:12.818774 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 03:08:12.818774 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 03:08:12.818774 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 4a4333b5357f49e883b72e96bdafb682 Aug 27 03:08:12.818774 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ServerShowV247Test-523011610 Aug 27 03:08:12.818774 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 03:08:12.818774 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 03:08:12.818774 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4a4333b5357f49e883b72e96bdafb682"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_4a4333b5357f49e883b72e96bdafb682", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4a4333b5357f49e883b72e96bdafb682"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/4a4333b5357f49e883b72e96bdafb682"}]}] Aug 27 03:08:12.818774 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ServerShowV247Test-523011610 Aug 27 03:08:12.818774 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 4a4333b5357f49e883b72e96bdafb682 Aug 27 03:08:12.818774 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ServerShowV247Test-523011610 Aug 27 03:08:12.818774 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ServerShowV247Test-523011610-project Aug 27 03:08:12.818774 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 03:08:12.818774 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 03:08:12.818774 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: e34c5fc51d324c8e8adb3b9c5cd30b6c Aug 27 03:08:12.818774 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ServerShowV247Test-523011610-project Aug 27 03:08:12.818774 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 03:08:12.818774 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance b4627c24-32f3-4d51-ac9f-3e78aff94796 could not be found. Aug 27 03:08:12.818774 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': 'b4627c24-32f3-4d51-ac9f-3e78aff94796'} Aug 27 03:08:12.818774 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:08:12.818774 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:12.818774 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:08:12.818774 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:08:12.818774 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:08:12.818774 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:08:12.818774 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:08:12.818774 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:08:12.818774 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:08:12.818774 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:08:12.818774 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4627c24-32f3-4d51-ac9f-3e78aff94796 could not be found. Aug 27 03:08:12.818774 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:08:12.818774 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:12.818774 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:08:12.818774 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:12.818774 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:12.818774 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:12.818774 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:08:12.818774 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:08:12.818774 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:08:12.818774 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:08:12.818774 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:08:12.818774 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:08:12.818774 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:08:12.818774 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:08:12.818774 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:08:12.818774 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:08:12.818774 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4627c24-32f3-4d51-ac9f-3e78aff94796 could not be found. Aug 27 03:08:12.818774 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:08:12.818774 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:12.818774 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:08:12.823191 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:12.823191 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:12.823191 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:12.823191 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:08:12.823191 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:08:12.823191 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4627c24-32f3-4d51-ac9f-3e78aff94796 could not be found. Aug 27 03:08:12.823191 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:08:12.826808 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-2b4f0593-b816-4379-b2d4-acfe5cb16e26 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] Returning 404 to user: Instance b4627c24-32f3-4d51-ac9f-3e78aff94796 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:08:12.827683 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-2b4f0593-b816-4379-b2d4-acfe5cb16e26 tempest-ServerShowV247Test-523011610 tempest-ServerShowV247Test-523011610-project] 10.222.0.70 "GET /compute/v2.1/servers/b4627c24-32f3-4d51-ac9f-3e78aff94796" status: 404 len: 111 microversion: 2.47 time: 0.091744 Aug 27 03:08:12.828257 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2538/5027] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:08:12 2022] GET /compute/v2.1/servers/b4627c24-32f3-4d51-ac9f-3e78aff94796 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 27 03:08:13.023396 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3dd1052c-1e8a-4081-96de-48907c3de93b tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:13.025022 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-3dd1052c-1e8a-4081-96de-48907c3de93b tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: b297dc39-8475-45f7-ab5e-20a3db6d1e44] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:13.090254 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3dd1052c-1e8a-4081-96de-48907c3de93b tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:13.090818 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3dd1052c-1e8a-4081-96de-48907c3de93b tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:13.099862 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3dd1052c-1e8a-4081-96de-48907c3de93b tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:13.102851 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3dd1052c-1e8a-4081-96de-48907c3de93b tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:13.104777 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3dd1052c-1e8a-4081-96de-48907c3de93b tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:13.106459 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3dd1052c-1e8a-4081-96de-48907c3de93b tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:13.158547 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-3dd1052c-1e8a-4081-96de-48907c3de93b tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] HTTP exception thrown: Instance b297dc39-8475-45f7-ab5e-20a3db6d1e44 could not be found. Aug 27 03:08:13.169392 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3dd1052c-1e8a-4081-96de-48907c3de93b tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Request method failure captured: Aug 27 03:08:13.169392 n-d-852278-4 devstack@n-api.service[134052]: request: DELETE /compute/v2.1/servers/b297dc39-8475-45f7-ab5e-20a3db6d1e44 HTTP/1.1 Aug 27 03:08:13.169392 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 03:08:13.169392 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 03:08:13.169392 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 03:08:13.169392 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 03:08:13.169392 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 03:08:13.169392 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 03:08:13.169392 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 03:08:13.169392 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 03:08:13.169392 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYnkbLTKVFjPQ5m3U2fG0N9Vjn4DkHnl17m4V7uHpwM3jvJACULLjB_xlJxNaWj4ki5CLI0R9EDG2yAGWVsjkvndQFsX9xXnPLGqFClIfHjZt1hqpj87tFD2RLalZegHNDkz7eKDMcWIs2wG0Lp8X-uNjMToWPkkmABfSYkxwHfHBds Aug 27 03:08:13.169392 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 03:08:13.169392 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 03:08:13.169392 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 03:08:13.169392 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 03:08:13.169392 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 03:08:13.169392 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 03:08:13.169392 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 3b9e672ac89e41ff82355daa83e852bd Aug 27 03:08:13.169392 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:08:13.169392 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 03:08:13.169392 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 03:08:13.169392 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3b9e672ac89e41ff82355daa83e852bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3b9e672ac89e41ff82355daa83e852bd", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3b9e672ac89e41ff82355daa83e852bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3b9e672ac89e41ff82355daa83e852bd"}]}] Aug 27 03:08:13.169392 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:08:13.169392 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 3b9e672ac89e41ff82355daa83e852bd Aug 27 03:08:13.169392 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:08:13.169392 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ServersNegativeTestJSON-1795266674-project Aug 27 03:08:13.169392 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 03:08:13.169392 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 03:08:13.169392 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 204c90820f6d4c64b31367aaf098325c Aug 27 03:08:13.169392 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ServersNegativeTestJSON-1795266674-project Aug 27 03:08:13.169392 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 03:08:13.169392 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance b297dc39-8475-45f7-ab5e-20a3db6d1e44 could not be found. Aug 27 03:08:13.169392 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': 'b297dc39-8475-45f7-ab5e-20a3db6d1e44'} Aug 27 03:08:13.169392 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:08:13.169392 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:13.169392 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:08:13.169392 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:08:13.169392 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:08:13.169392 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:08:13.169392 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:08:13.169392 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:08:13.169392 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:08:13.169392 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:08:13.169392 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b297dc39-8475-45f7-ab5e-20a3db6d1e44 could not be found. Aug 27 03:08:13.169392 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:08:13.169392 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:13.169392 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:08:13.169392 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:13.169392 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:13.169392 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:13.169392 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:08:13.169392 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:08:13.169392 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:08:13.169392 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:08:13.169392 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 03:08:13.169392 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 03:08:13.169392 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 03:08:13.169392 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 03:08:13.169392 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:08:13.169392 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:08:13.169392 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:08:13.169392 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:08:13.174079 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b297dc39-8475-45f7-ab5e-20a3db6d1e44 could not be found. Aug 27 03:08:13.174079 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:08:13.174079 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:13.174079 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:08:13.174079 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:13.174079 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:13.174079 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:13.174079 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:08:13.174079 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:08:13.174079 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b297dc39-8475-45f7-ab5e-20a3db6d1e44 could not be found. Aug 27 03:08:13.174079 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:08:13.176507 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3dd1052c-1e8a-4081-96de-48907c3de93b tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Returning 404 to user: Instance b297dc39-8475-45f7-ab5e-20a3db6d1e44 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:08:13.180846 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-3dd1052c-1e8a-4081-96de-48907c3de93b tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "DELETE /compute/v2.1/servers/b297dc39-8475-45f7-ab5e-20a3db6d1e44" status: 404 len: 111 microversion: 2.1 time: 0.171860 Aug 27 03:08:13.184941 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2490/5028] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 03:08:13 2022] DELETE /compute/v2.1/servers/b297dc39-8475-45f7-ab5e-20a3db6d1e44 => generated 111 bytes in 178 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:08:13.193369 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7c245e81-e28a-4007-a48a-cabb4745ac4b tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:13.194836 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-7c245e81-e28a-4007-a48a-cabb4745ac4b tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: b297dc39-8475-45f7-ab5e-20a3db6d1e44] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:13.214921 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7c245e81-e28a-4007-a48a-cabb4745ac4b tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:13.216069 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7c245e81-e28a-4007-a48a-cabb4745ac4b tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:13.216939 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7c245e81-e28a-4007-a48a-cabb4745ac4b tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:13.221018 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7c245e81-e28a-4007-a48a-cabb4745ac4b tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:13.223700 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7c245e81-e28a-4007-a48a-cabb4745ac4b tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:13.225039 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7c245e81-e28a-4007-a48a-cabb4745ac4b tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:13.297394 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-7c245e81-e28a-4007-a48a-cabb4745ac4b tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] HTTP exception thrown: Instance b297dc39-8475-45f7-ab5e-20a3db6d1e44 could not be found. Aug 27 03:08:13.299326 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7c245e81-e28a-4007-a48a-cabb4745ac4b tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Request method failure captured: Aug 27 03:08:13.299326 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/b297dc39-8475-45f7-ab5e-20a3db6d1e44 HTTP/1.1 Aug 27 03:08:13.299326 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 03:08:13.299326 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 03:08:13.299326 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 03:08:13.299326 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 03:08:13.299326 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 03:08:13.299326 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 03:08:13.299326 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 03:08:13.299326 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 03:08:13.299326 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYnkbLTKVFjPQ5m3U2fG0N9Vjn4DkHnl17m4V7uHpwM3jvJACULLjB_xlJxNaWj4ki5CLI0R9EDG2yAGWVsjkvndQFsX9xXnPLGqFClIfHjZt1hqpj87tFD2RLalZegHNDkz7eKDMcWIs2wG0Lp8X-uNjMToWPkkmABfSYkxwHfHBds Aug 27 03:08:13.299326 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 03:08:13.299326 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 03:08:13.299326 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 03:08:13.299326 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 03:08:13.299326 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 03:08:13.299326 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 03:08:13.299326 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 3b9e672ac89e41ff82355daa83e852bd Aug 27 03:08:13.299326 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:08:13.299326 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 03:08:13.299326 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 03:08:13.299326 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3b9e672ac89e41ff82355daa83e852bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3b9e672ac89e41ff82355daa83e852bd", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3b9e672ac89e41ff82355daa83e852bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3b9e672ac89e41ff82355daa83e852bd"}]}] Aug 27 03:08:13.299326 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:08:13.299326 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 3b9e672ac89e41ff82355daa83e852bd Aug 27 03:08:13.299326 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:08:13.299326 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ServersNegativeTestJSON-1795266674-project Aug 27 03:08:13.299326 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 03:08:13.299326 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 03:08:13.299326 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 204c90820f6d4c64b31367aaf098325c Aug 27 03:08:13.299326 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ServersNegativeTestJSON-1795266674-project Aug 27 03:08:13.299326 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 03:08:13.299326 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance b297dc39-8475-45f7-ab5e-20a3db6d1e44 could not be found. Aug 27 03:08:13.299326 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': 'b297dc39-8475-45f7-ab5e-20a3db6d1e44'} Aug 27 03:08:13.299326 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:08:13.299326 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:13.299326 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:08:13.299326 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:08:13.299326 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:08:13.299326 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:08:13.299326 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:08:13.299326 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:08:13.299326 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:08:13.299326 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:08:13.299326 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b297dc39-8475-45f7-ab5e-20a3db6d1e44 could not be found. Aug 27 03:08:13.299326 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:08:13.299326 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:13.299326 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:08:13.299326 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:13.299326 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:13.299326 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:13.299326 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:08:13.299326 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:08:13.299326 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:08:13.299326 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:08:13.299326 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:08:13.299326 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:08:13.299326 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:08:13.299326 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:08:13.299326 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:08:13.299326 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:08:13.299326 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b297dc39-8475-45f7-ab5e-20a3db6d1e44 could not be found. Aug 27 03:08:13.299326 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:08:13.299326 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:13.299326 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:08:13.303656 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:13.303656 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:13.303656 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:13.303656 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:08:13.303656 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:08:13.303656 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b297dc39-8475-45f7-ab5e-20a3db6d1e44 could not be found. Aug 27 03:08:13.303656 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:08:13.303656 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7c245e81-e28a-4007-a48a-cabb4745ac4b tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Returning 404 to user: Instance b297dc39-8475-45f7-ab5e-20a3db6d1e44 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:08:13.307485 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-7c245e81-e28a-4007-a48a-cabb4745ac4b tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/b297dc39-8475-45f7-ab5e-20a3db6d1e44" status: 404 len: 111 microversion: 2.1 time: 0.112130 Aug 27 03:08:13.308578 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2539/5029] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:13 2022] GET /compute/v2.1/servers/b297dc39-8475-45f7-ab5e-20a3db6d1e44 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:08:13.317166 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b4a6428c-e547-4cba-8ea6-4308874af3a9 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:13.317909 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b4a6428c-e547-4cba-8ea6-4308874af3a9 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:13.330128 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b4a6428c-e547-4cba-8ea6-4308874af3a9 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:13.333159 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b4a6428c-e547-4cba-8ea6-4308874af3a9 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:13.333804 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b4a6428c-e547-4cba-8ea6-4308874af3a9 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:13.334695 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b4a6428c-e547-4cba-8ea6-4308874af3a9 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:13.335331 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b4a6428c-e547-4cba-8ea6-4308874af3a9 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:13.336168 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b4a6428c-e547-4cba-8ea6-4308874af3a9 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:13.374379 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b4a6428c-e547-4cba-8ea6-4308874af3a9 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Going to try to terminate instance {{(pid=134052) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:08:13.522130 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:08:13.582884 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b4a6428c-e547-4cba-8ea6-4308874af3a9 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "DELETE /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 204 len: 0 microversion: 2.1 time: 0.270173 Aug 27 03:08:13.592264 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-194de9a2-31d8-48c3-8aac-3ec372081c48 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:13.593631 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-194de9a2-31d8-48c3-8aac-3ec372081c48 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:13.595311 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2491/5030] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 03:08:13 2022] DELETE /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 0 bytes in 272 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:08:13.602062 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-194de9a2-31d8-48c3-8aac-3ec372081c48 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:13.607592 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-194de9a2-31d8-48c3-8aac-3ec372081c48 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:13.608415 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-194de9a2-31d8-48c3-8aac-3ec372081c48 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:13.609377 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-194de9a2-31d8-48c3-8aac-3ec372081c48 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:13.612258 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-194de9a2-31d8-48c3-8aac-3ec372081c48 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:13.612966 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-194de9a2-31d8-48c3-8aac-3ec372081c48 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:13.832274 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-23f028de-7cc8-4a44-948c-0158edabb67d tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:13.833212 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-23f028de-7cc8-4a44-948c-0158edabb67d tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:13.843148 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-23f028de-7cc8-4a44-948c-0158edabb67d tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:13.856504 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-23f028de-7cc8-4a44-948c-0158edabb67d tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:13.859202 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-23f028de-7cc8-4a44-948c-0158edabb67d tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:13.864895 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-23f028de-7cc8-4a44-948c-0158edabb67d tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:13.865608 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-23f028de-7cc8-4a44-948c-0158edabb67d tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:13.866400 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-23f028de-7cc8-4a44-948c-0158edabb67d tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:13.871359 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-194de9a2-31d8-48c3-8aac-3ec372081c48 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:13.892439 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-194de9a2-31d8-48c3-8aac-3ec372081c48 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1510 microversion: 2.1 time: 0.304060 Aug 27 03:08:13.912999 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2540/5031] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:13 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1510 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:14.050445 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-23f028de-7cc8-4a44-948c-0158edabb67d tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:14.068042 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-23f028de-7cc8-4a44-948c-0158edabb67d tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:14.075170 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-23f028de-7cc8-4a44-948c-0158edabb67d tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:14.077029 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-23f028de-7cc8-4a44-948c-0158edabb67d tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22" status: 200 len: 1285 microversion: 2.20 time: 0.249728 Aug 27 03:08:14.093053 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2492/5032] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:08:13 2022] GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22 => generated 1285 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:08:14.913885 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-9576bf93-334f-4822-9639-90fd988e1295 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:14.915212 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-9576bf93-334f-4822-9639-90fd988e1295 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:14.927769 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9576bf93-334f-4822-9639-90fd988e1295 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:14.943952 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9576bf93-334f-4822-9639-90fd988e1295 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:14.944904 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9576bf93-334f-4822-9639-90fd988e1295 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:14.946131 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9576bf93-334f-4822-9639-90fd988e1295 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:14.953368 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9576bf93-334f-4822-9639-90fd988e1295 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:14.954110 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9576bf93-334f-4822-9639-90fd988e1295 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:15.108653 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-60d8936c-4497-4e35-a3d6-fa6088820d26 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:15.109505 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-60d8936c-4497-4e35-a3d6-fa6088820d26 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:15.118009 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-60d8936c-4497-4e35-a3d6-fa6088820d26 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:15.118665 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-60d8936c-4497-4e35-a3d6-fa6088820d26 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:15.119176 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-60d8936c-4497-4e35-a3d6-fa6088820d26 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:15.122264 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-60d8936c-4497-4e35-a3d6-fa6088820d26 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:15.130690 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-60d8936c-4497-4e35-a3d6-fa6088820d26 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:15.131568 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-60d8936c-4497-4e35-a3d6-fa6088820d26 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:15.390310 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-60d8936c-4497-4e35-a3d6-fa6088820d26 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:15.417992 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-60d8936c-4497-4e35-a3d6-fa6088820d26 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:15.429332 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-60d8936c-4497-4e35-a3d6-fa6088820d26 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:15.434423 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-60d8936c-4497-4e35-a3d6-fa6088820d26 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22" status: 200 len: 1339 microversion: 2.20 time: 0.331908 Aug 27 03:08:15.448590 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2493/5033] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:08:15 2022] GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22 => generated 1339 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:08:15.644125 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-9576bf93-334f-4822-9639-90fd988e1295 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:15.667867 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-9576bf93-334f-4822-9639-90fd988e1295 tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1510 microversion: 2.1 time: 0.755401 Aug 27 03:08:15.683117 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2541/5034] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:14 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1510 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:16.461514 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-69ea8a1a-6b53-4818-af11-853ea6d8a7e3 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:16.463089 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-69ea8a1a-6b53-4818-af11-853ea6d8a7e3 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:16.483942 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-69ea8a1a-6b53-4818-af11-853ea6d8a7e3 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:16.487372 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-69ea8a1a-6b53-4818-af11-853ea6d8a7e3 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:16.490134 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-69ea8a1a-6b53-4818-af11-853ea6d8a7e3 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:16.493405 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-69ea8a1a-6b53-4818-af11-853ea6d8a7e3 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:16.497113 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-69ea8a1a-6b53-4818-af11-853ea6d8a7e3 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:16.497597 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-69ea8a1a-6b53-4818-af11-853ea6d8a7e3 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:16.618328 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-cbe52971-717f-48c5-85c6-70a62acd576c req-06c1a5a8-913e-4910-92ad-b7115d3d322c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72ffd032-b609-4e42-90d9-5454ac648eeb", "name": "network-vif-deleted", "tag": "7a8cf46b-6b49-415b-b564-a266edc89536"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:08:16.643663 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-cbe52971-717f-48c5-85c6-70a62acd576c req-06c1a5a8-913e-4910-92ad-b7115d3d322c service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:16.643969 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-cbe52971-717f-48c5-85c6-70a62acd576c req-06c1a5a8-913e-4910-92ad-b7115d3d322c service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:16.644445 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-cbe52971-717f-48c5-85c6-70a62acd576c req-06c1a5a8-913e-4910-92ad-b7115d3d322c service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:16.670737 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-cbe52971-717f-48c5-85c6-70a62acd576c req-06c1a5a8-913e-4910-92ad-b7115d3d322c service nova] Creating event network-vif-deleted:7a8cf46b-6b49-415b-b564-a266edc89536 for instance 72ffd032-b609-4e42-90d9-5454ac648eeb on n-h1-852278-4 Aug 27 03:08:16.685470 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-cbe52971-717f-48c5-85c6-70a62acd576c req-06c1a5a8-913e-4910-92ad-b7115d3d322c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.494002 Aug 27 03:08:16.686115 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2494/5035] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:08:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:08:16.692977 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-40fc8962-6b48-4617-8169-e2c8aab6b1cb tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:16.699818 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-40fc8962-6b48-4617-8169-e2c8aab6b1cb tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:16.713635 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-40fc8962-6b48-4617-8169-e2c8aab6b1cb tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:16.714990 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-40fc8962-6b48-4617-8169-e2c8aab6b1cb tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:16.715547 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-40fc8962-6b48-4617-8169-e2c8aab6b1cb tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:16.716466 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-40fc8962-6b48-4617-8169-e2c8aab6b1cb tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:16.717102 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-40fc8962-6b48-4617-8169-e2c8aab6b1cb tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:16.718005 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-40fc8962-6b48-4617-8169-e2c8aab6b1cb tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:16.766912 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-40fc8962-6b48-4617-8169-e2c8aab6b1cb tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:16.767791 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-40fc8962-6b48-4617-8169-e2c8aab6b1cb tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:16.769103 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-40fc8962-6b48-4617-8169-e2c8aab6b1cb tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:16.769775 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.instance [None req-40fc8962-6b48-4617-8169-e2c8aab6b1cb tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lazy-loading 'fault' on Instance uuid 72ffd032-b609-4e42-90d9-5454ac648eeb {{(pid=134052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:08:16.857062 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-69ea8a1a-6b53-4818-af11-853ea6d8a7e3 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:16.867259 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-69ea8a1a-6b53-4818-af11-853ea6d8a7e3 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:16.874990 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-69ea8a1a-6b53-4818-af11-853ea6d8a7e3 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:16.876539 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-69ea8a1a-6b53-4818-af11-853ea6d8a7e3 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22" status: 200 len: 1339 microversion: 2.20 time: 0.420856 Aug 27 03:08:16.877540 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2542/5036] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:08:16 2022] GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22 => generated 1339 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:08:16.968994 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-40fc8962-6b48-4617-8169-e2c8aab6b1cb tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '204c90820f6d4c64b31367aaf098325c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9e672ac89e41ff82355daa83e852bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:16.980354 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-40fc8962-6b48-4617-8169-e2c8aab6b1cb tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 200 len: 1306 microversion: 2.1 time: 0.293002 Aug 27 03:08:16.990585 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2495/5037] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:16 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 1306 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:17.899164 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-56906ab6-5b13-4239-9092-26c8e3b2514d tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:17.899786 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-56906ab6-5b13-4239-9092-26c8e3b2514d tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:17.918102 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-56906ab6-5b13-4239-9092-26c8e3b2514d tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:17.918771 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-56906ab6-5b13-4239-9092-26c8e3b2514d tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:17.919275 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-56906ab6-5b13-4239-9092-26c8e3b2514d tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:17.920034 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-56906ab6-5b13-4239-9092-26c8e3b2514d tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:17.920542 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-56906ab6-5b13-4239-9092-26c8e3b2514d tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:17.920956 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-56906ab6-5b13-4239-9092-26c8e3b2514d tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:18.013904 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5d6e0f55-001f-4375-8406-f1229eb08d9a tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:18.015898 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-5d6e0f55-001f-4375-8406-f1229eb08d9a tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] [instance: 72ffd032-b609-4e42-90d9-5454ac648eeb] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:18.048753 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5d6e0f55-001f-4375-8406-f1229eb08d9a tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:18.053558 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5d6e0f55-001f-4375-8406-f1229eb08d9a tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:18.061023 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5d6e0f55-001f-4375-8406-f1229eb08d9a tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:18.067993 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5d6e0f55-001f-4375-8406-f1229eb08d9a tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:18.068869 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5d6e0f55-001f-4375-8406-f1229eb08d9a tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:18.069978 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5d6e0f55-001f-4375-8406-f1229eb08d9a tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:18.127984 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-5d6e0f55-001f-4375-8406-f1229eb08d9a tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] HTTP exception thrown: Instance 72ffd032-b609-4e42-90d9-5454ac648eeb could not be found. Aug 27 03:08:18.134926 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5d6e0f55-001f-4375-8406-f1229eb08d9a tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Request method failure captured: Aug 27 03:08:18.134926 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb HTTP/1.1 Aug 27 03:08:18.134926 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 03:08:18.134926 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 03:08:18.134926 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 03:08:18.134926 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 03:08:18.134926 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 03:08:18.134926 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 03:08:18.134926 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 03:08:18.134926 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 03:08:18.134926 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYnkbLTKVFjPQ5m3U2fG0N9Vjn4DkHnl17m4V7uHpwM3jvJACULLjB_xlJxNaWj4ki5CLI0R9EDG2yAGWVsjkvndQFsX9xXnPLGqFClIfHjZt1hqpj87tFD2RLalZegHNDkz7eKDMcWIs2wG0Lp8X-uNjMToWPkkmABfSYkxwHfHBds Aug 27 03:08:18.134926 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 03:08:18.134926 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 03:08:18.134926 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 03:08:18.134926 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 03:08:18.134926 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 03:08:18.134926 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 03:08:18.134926 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 3b9e672ac89e41ff82355daa83e852bd Aug 27 03:08:18.134926 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:08:18.134926 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 03:08:18.134926 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 03:08:18.134926 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3b9e672ac89e41ff82355daa83e852bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3b9e672ac89e41ff82355daa83e852bd", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3b9e672ac89e41ff82355daa83e852bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3b9e672ac89e41ff82355daa83e852bd"}]}] Aug 27 03:08:18.134926 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:08:18.134926 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 3b9e672ac89e41ff82355daa83e852bd Aug 27 03:08:18.134926 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1795266674 Aug 27 03:08:18.134926 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ServersNegativeTestJSON-1795266674-project Aug 27 03:08:18.134926 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 03:08:18.134926 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 03:08:18.134926 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 204c90820f6d4c64b31367aaf098325c Aug 27 03:08:18.134926 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ServersNegativeTestJSON-1795266674-project Aug 27 03:08:18.134926 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 03:08:18.134926 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance 72ffd032-b609-4e42-90d9-5454ac648eeb could not be found. Aug 27 03:08:18.134926 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '72ffd032-b609-4e42-90d9-5454ac648eeb'} Aug 27 03:08:18.134926 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:08:18.134926 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:18.134926 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:08:18.134926 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:08:18.134926 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:08:18.134926 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:08:18.134926 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:08:18.134926 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:08:18.134926 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:08:18.134926 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:08:18.134926 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72ffd032-b609-4e42-90d9-5454ac648eeb could not be found. Aug 27 03:08:18.134926 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:08:18.134926 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:18.134926 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:08:18.134926 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:18.134926 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:18.134926 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:18.134926 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:08:18.134926 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:08:18.134926 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:08:18.134926 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:08:18.134926 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:08:18.134926 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:08:18.134926 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:08:18.134926 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:08:18.134926 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:08:18.134926 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:08:18.134926 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72ffd032-b609-4e42-90d9-5454ac648eeb could not be found. Aug 27 03:08:18.134926 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:08:18.134926 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:18.134926 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:08:18.139626 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:18.139626 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:18.139626 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:18.139626 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:08:18.139626 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:08:18.139626 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72ffd032-b609-4e42-90d9-5454ac648eeb could not be found. Aug 27 03:08:18.139626 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:08:18.139626 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5d6e0f55-001f-4375-8406-f1229eb08d9a tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] Returning 404 to user: Instance 72ffd032-b609-4e42-90d9-5454ac648eeb could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:08:18.139626 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-5d6e0f55-001f-4375-8406-f1229eb08d9a tempest-ServersNegativeTestJSON-1795266674 tempest-ServersNegativeTestJSON-1795266674-project] 10.222.0.70 "GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb" status: 404 len: 111 microversion: 2.1 time: 0.127681 Aug 27 03:08:18.145439 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2496/5038] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:18 2022] GET /compute/v2.1/servers/72ffd032-b609-4e42-90d9-5454ac648eeb => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 03:08:18.769327 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-56906ab6-5b13-4239-9092-26c8e3b2514d tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:18.782728 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-56906ab6-5b13-4239-9092-26c8e3b2514d tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:18.785782 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-56906ab6-5b13-4239-9092-26c8e3b2514d tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:18.788066 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-56906ab6-5b13-4239-9092-26c8e3b2514d tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22" status: 200 len: 1407 microversion: 2.20 time: 0.892759 Aug 27 03:08:18.808155 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2543/5039] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:08:17 2022] GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22 => generated 1407 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:08:19.126061 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-b0d6c742-a227-4050-af95-26391493aefd req-753f1f0d-909b-4e02-b6bb-8c2819080a24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73ee7f75-b081-4f5c-90b0-e0d1b27b9a22", "tag": "130f85a4-751a-4a52-92c2-d7a99bb65d41"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:08:19.162130 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=1,nova_api:UPDATE=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:08:19.169833 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-b0d6c742-a227-4050-af95-26391493aefd req-753f1f0d-909b-4e02-b6bb-8c2819080a24 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:19.171218 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-b0d6c742-a227-4050-af95-26391493aefd req-753f1f0d-909b-4e02-b6bb-8c2819080a24 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:19.176111 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-b0d6c742-a227-4050-af95-26391493aefd req-753f1f0d-909b-4e02-b6bb-8c2819080a24 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:19.213477 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-b0d6c742-a227-4050-af95-26391493aefd req-753f1f0d-909b-4e02-b6bb-8c2819080a24 service nova] Creating event network-changed:130f85a4-751a-4a52-92c2-d7a99bb65d41 for instance 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22 on n-h2-852278-4 Aug 27 03:08:19.226458 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-b0d6c742-a227-4050-af95-26391493aefd req-753f1f0d-909b-4e02-b6bb-8c2819080a24 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106297 Aug 27 03:08:19.228149 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2497/5040] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:08:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:08:19.815429 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-97073b72-50c2-450f-b0b5-53710a92f89c tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:19.816041 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-97073b72-50c2-450f-b0b5-53710a92f89c tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:19.828908 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-97073b72-50c2-450f-b0b5-53710a92f89c tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:19.829409 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-97073b72-50c2-450f-b0b5-53710a92f89c tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:19.829842 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-97073b72-50c2-450f-b0b5-53710a92f89c tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:19.831126 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-97073b72-50c2-450f-b0b5-53710a92f89c tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:19.831595 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-97073b72-50c2-450f-b0b5-53710a92f89c tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:19.834381 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-97073b72-50c2-450f-b0b5-53710a92f89c tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:20.189801 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-97073b72-50c2-450f-b0b5-53710a92f89c tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:20.203165 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-97073b72-50c2-450f-b0b5-53710a92f89c tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:20.207724 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-97073b72-50c2-450f-b0b5-53710a92f89c tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:20.212234 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-97073b72-50c2-450f-b0b5-53710a92f89c tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22" status: 200 len: 1407 microversion: 2.20 time: 0.399798 Aug 27 03:08:20.216188 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2544/5041] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:08:19 2022] GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22 => generated 1407 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:08:21.240223 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-788f2a65-5c68-4aa1-842d-04bff20afcd4 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:21.240909 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-788f2a65-5c68-4aa1-842d-04bff20afcd4 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:21.254248 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-788f2a65-5c68-4aa1-842d-04bff20afcd4 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:21.254735 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-788f2a65-5c68-4aa1-842d-04bff20afcd4 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:21.255163 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-788f2a65-5c68-4aa1-842d-04bff20afcd4 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:21.261156 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-788f2a65-5c68-4aa1-842d-04bff20afcd4 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:21.261823 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-788f2a65-5c68-4aa1-842d-04bff20afcd4 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:21.265603 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-788f2a65-5c68-4aa1-842d-04bff20afcd4 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:21.787943 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-788f2a65-5c68-4aa1-842d-04bff20afcd4 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:21.797375 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-788f2a65-5c68-4aa1-842d-04bff20afcd4 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:21.799063 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-788f2a65-5c68-4aa1-842d-04bff20afcd4 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:21.800461 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-788f2a65-5c68-4aa1-842d-04bff20afcd4 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22" status: 200 len: 1407 microversion: 2.20 time: 0.565041 Aug 27 03:08:21.801530 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2498/5042] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:08:21 2022] GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22 => generated 1407 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:08:22.824608 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-609e8724-3e5d-4f27-a24e-1526677be42b tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:22.825441 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-609e8724-3e5d-4f27-a24e-1526677be42b tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:22.839942 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=4 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:08:22.840894 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=8 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:08:22.846504 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-609e8724-3e5d-4f27-a24e-1526677be42b tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:22.848900 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-609e8724-3e5d-4f27-a24e-1526677be42b tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:22.849387 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-609e8724-3e5d-4f27-a24e-1526677be42b tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:22.854270 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-609e8724-3e5d-4f27-a24e-1526677be42b tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:22.854756 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-609e8724-3e5d-4f27-a24e-1526677be42b tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:22.855197 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-609e8724-3e5d-4f27-a24e-1526677be42b tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:22.869637 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:08:23.253782 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-609e8724-3e5d-4f27-a24e-1526677be42b tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:23.267944 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-609e8724-3e5d-4f27-a24e-1526677be42b tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:23.272805 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-609e8724-3e5d-4f27-a24e-1526677be42b tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:23.279129 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-609e8724-3e5d-4f27-a24e-1526677be42b tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22" status: 200 len: 1407 microversion: 2.20 time: 0.457450 Aug 27 03:08:23.280191 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2545/5043] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:08:22 2022] GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22 => generated 1407 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:08:24.303244 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e4c1eeba-0480-47ba-bfaa-c070cb6b32c3 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:24.304486 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-e4c1eeba-0480-47ba-bfaa-c070cb6b32c3 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:24.308039 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=6 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:08:24.319617 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e4c1eeba-0480-47ba-bfaa-c070cb6b32c3 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:24.320385 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e4c1eeba-0480-47ba-bfaa-c070cb6b32c3 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:24.324925 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e4c1eeba-0480-47ba-bfaa-c070cb6b32c3 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:24.325927 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e4c1eeba-0480-47ba-bfaa-c070cb6b32c3 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:24.326548 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e4c1eeba-0480-47ba-bfaa-c070cb6b32c3 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:24.327129 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e4c1eeba-0480-47ba-bfaa-c070cb6b32c3 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:24.816395 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-75993ce1-deef-401e-890f-eabca86f3dd9 req-b052dac8-67af-4aaf-90e2-0ee83a5fec43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73ee7f75-b081-4f5c-90b0-e0d1b27b9a22", "name": "network-vif-plugged", "status": "completed", "tag": "130f85a4-751a-4a52-92c2-d7a99bb65d41"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:08:24.832053 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-75993ce1-deef-401e-890f-eabca86f3dd9 req-b052dac8-67af-4aaf-90e2-0ee83a5fec43 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:24.832894 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-75993ce1-deef-401e-890f-eabca86f3dd9 req-b052dac8-67af-4aaf-90e2-0ee83a5fec43 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:24.833471 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-75993ce1-deef-401e-890f-eabca86f3dd9 req-b052dac8-67af-4aaf-90e2-0ee83a5fec43 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:24.852692 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-75993ce1-deef-401e-890f-eabca86f3dd9 req-b052dac8-67af-4aaf-90e2-0ee83a5fec43 service nova] Creating event network-vif-plugged:130f85a4-751a-4a52-92c2-d7a99bb65d41 for instance 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22 on n-h2-852278-4 Aug 27 03:08:24.864267 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-75993ce1-deef-401e-890f-eabca86f3dd9 req-b052dac8-67af-4aaf-90e2-0ee83a5fec43 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055314 Aug 27 03:08:24.865127 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2546/5044] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:08:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:08:25.199274 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-e4c1eeba-0480-47ba-bfaa-c070cb6b32c3 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:25.214235 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-e4c1eeba-0480-47ba-bfaa-c070cb6b32c3 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:25.220265 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-e4c1eeba-0480-47ba-bfaa-c070cb6b32c3 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:25.223953 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e4c1eeba-0480-47ba-bfaa-c070cb6b32c3 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22" status: 200 len: 1407 microversion: 2.20 time: 0.924711 Aug 27 03:08:25.241751 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2499/5045] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:08:24 2022] GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22 => generated 1407 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:08:26.269546 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-5f229388-8ab9-4e60-a359-25e24d57d7ce tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:26.270539 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-5f229388-8ab9-4e60-a359-25e24d57d7ce tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:26.276687 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:08:26.289648 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5f229388-8ab9-4e60-a359-25e24d57d7ce tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:26.292582 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5f229388-8ab9-4e60-a359-25e24d57d7ce tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:26.293231 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5f229388-8ab9-4e60-a359-25e24d57d7ce tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:26.295722 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5f229388-8ab9-4e60-a359-25e24d57d7ce tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:26.296924 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5f229388-8ab9-4e60-a359-25e24d57d7ce tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:26.298490 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5f229388-8ab9-4e60-a359-25e24d57d7ce tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:26.983278 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-5f229388-8ab9-4e60-a359-25e24d57d7ce tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:27.025088 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-5f229388-8ab9-4e60-a359-25e24d57d7ce tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:27.032117 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-5f229388-8ab9-4e60-a359-25e24d57d7ce tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:27.035334 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-5f229388-8ab9-4e60-a359-25e24d57d7ce tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22" status: 200 len: 1407 microversion: 2.20 time: 0.770542 Aug 27 03:08:27.041949 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2547/5046] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:08:26 2022] GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22 => generated 1407 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:08:28.062856 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b1f70594-23d3-4fc7-bf8a-a669ae70f7a8 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:28.064191 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b1f70594-23d3-4fc7-bf8a-a669ae70f7a8 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:28.086773 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b1f70594-23d3-4fc7-bf8a-a669ae70f7a8 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:28.087727 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b1f70594-23d3-4fc7-bf8a-a669ae70f7a8 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:28.088866 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b1f70594-23d3-4fc7-bf8a-a669ae70f7a8 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:28.090245 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b1f70594-23d3-4fc7-bf8a-a669ae70f7a8 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:28.091769 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b1f70594-23d3-4fc7-bf8a-a669ae70f7a8 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:28.093093 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b1f70594-23d3-4fc7-bf8a-a669ae70f7a8 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:28.572833 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b1f70594-23d3-4fc7-bf8a-a669ae70f7a8 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:28.589195 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b1f70594-23d3-4fc7-bf8a-a669ae70f7a8 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:28.603530 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b1f70594-23d3-4fc7-bf8a-a669ae70f7a8 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:28.605652 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b1f70594-23d3-4fc7-bf8a-a669ae70f7a8 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22" status: 200 len: 1599 microversion: 2.20 time: 0.546847 Aug 27 03:08:28.610793 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2500/5047] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:08:28 2022] GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22 => generated 1599 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:08:28.635572 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b2e64656-a494-4f2e-8384-43d2f29b221a tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:28.653475 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b2e64656-a494-4f2e-8384-43d2f29b221a tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:28.673705 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b2e64656-a494-4f2e-8384-43d2f29b221a tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:28.682106 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b2e64656-a494-4f2e-8384-43d2f29b221a tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:28.682868 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b2e64656-a494-4f2e-8384-43d2f29b221a tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:28.685577 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b2e64656-a494-4f2e-8384-43d2f29b221a tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:28.686062 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b2e64656-a494-4f2e-8384-43d2f29b221a tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:28.686492 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b2e64656-a494-4f2e-8384-43d2f29b221a tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:28.888369 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b2e64656-a494-4f2e-8384-43d2f29b221a tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.257725 Aug 27 03:08:28.889735 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2548/5048] 10.222.0.70 () {60 vars in 1316 bytes} [Sat Aug 27 03:08:28 2022] GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22/os-interface => generated 285 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:08:30.926978 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-5a6430b6-91a3-44ce-992c-7b1b179d5f3d req-4966d118-61b9-421f-b5ab-41d91f0b0a4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73ee7f75-b081-4f5c-90b0-e0d1b27b9a22", "tag": "130f85a4-751a-4a52-92c2-d7a99bb65d41"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:08:30.963954 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-5a6430b6-91a3-44ce-992c-7b1b179d5f3d req-4966d118-61b9-421f-b5ab-41d91f0b0a4e service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:30.964467 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-5a6430b6-91a3-44ce-992c-7b1b179d5f3d req-4966d118-61b9-421f-b5ab-41d91f0b0a4e service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:30.964898 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-5a6430b6-91a3-44ce-992c-7b1b179d5f3d req-4966d118-61b9-421f-b5ab-41d91f0b0a4e service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:31.003054 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-5a6430b6-91a3-44ce-992c-7b1b179d5f3d req-4966d118-61b9-421f-b5ab-41d91f0b0a4e service nova] Creating event network-changed:130f85a4-751a-4a52-92c2-d7a99bb65d41 for instance 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22 on n-h2-852278-4 Aug 27 03:08:31.024149 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-5a6430b6-91a3-44ce-992c-7b1b179d5f3d req-4966d118-61b9-421f-b5ab-41d91f0b0a4e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108324 Aug 27 03:08:31.025099 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2501/5049] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:08:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:08:40.739750 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=3 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:08:40.740542 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=17 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:08:41.193713 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3d6614eb-8b81-4c0d-8892-e9c6a9f22832 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Action: 'create', calling method: .version_select at 0x7f5eded9f8b0>, body: {"keypair": {"name": "tempest-keypair-157767419", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNZg2+FGNhpBY8VZ9Tyr6svhbnF5XhGw7zk1Ah4hHlSYiTwa0Q10ESitfWewjCC1xXkFaEt4mhRMY3QJ/ytk0rv9sX6u3/wEyzMVWEpLjrg+ycub/E8SJBucbAR1pDhqIA=="}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:08:41.230702 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-3d6614eb-8b81-4c0d-8892-e9c6a9f22832 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Getting quotas for project b92af206e05f44cf948b7c25d1acc139. Resources: {'key_pairs'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:08:41.246115 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-3d6614eb-8b81-4c0d-8892-e9c6a9f22832 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Getting quotas for user a549f85910184bf7a697cce7fa3dff96 and project b92af206e05f44cf948b7c25d1acc139. Resources: {'key_pairs'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:08:41.345514 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-3d6614eb-8b81-4c0d-8892-e9c6a9f22832 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.607914 Aug 27 03:08:41.346798 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2549/5050] 10.222.0.70 () {60 vars in 1159 bytes} [Sat Aug 27 03:08:40 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:08:44.236044 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=9 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:08:44.238286 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=46 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:08:44.245597 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-2f5b547b-ce60-40e4-b7f8-cc86227d2528 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1272910563", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a7b97b39-d409-4ab1-957a-8381e0b7ec94"}], "security_groups": [{"name": "tempest-securitygroup--1498731904"}], "key_name": "tempest-keypair-157767419", "user_data": "}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:08:44.542953 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.network.neutron [None req-2f5b547b-ce60-40e4-b7f8-cc86227d2528 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] validate_networks() for [('a7b97b39-d409-4ab1-957a-8381e0b7ec94', None, None, None, None, None)] {{(pid=134052) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:08:45.519120 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-2f5b547b-ce60-40e4-b7f8-cc86227d2528 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Flavor limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:08:45.520295 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-2f5b547b-ce60-40e4-b7f8-cc86227d2528 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Image limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:08:45.521050 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-2f5b547b-ce60-40e4-b7f8-cc86227d2528 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Flavor pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:08:45.521630 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-2f5b547b-ce60-40e4-b7f8-cc86227d2528 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Image pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:08:45.522208 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-2f5b547b-ce60-40e4-b7f8-cc86227d2528 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:08:45.539782 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2f5b547b-ce60-40e4-b7f8-cc86227d2528 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:45.540809 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2f5b547b-ce60-40e4-b7f8-cc86227d2528 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:45.541476 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2f5b547b-ce60-40e4-b7f8-cc86227d2528 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:45.542469 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2f5b547b-ce60-40e4-b7f8-cc86227d2528 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:45.548345 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2f5b547b-ce60-40e4-b7f8-cc86227d2528 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:45.549131 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2f5b547b-ce60-40e4-b7f8-cc86227d2528 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:45.589538 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-2f5b547b-ce60-40e4-b7f8-cc86227d2528 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Getting quotas for project b92af206e05f44cf948b7c25d1acc139. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:08:45.601846 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-2f5b547b-ce60-40e4-b7f8-cc86227d2528 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Getting quotas for user a549f85910184bf7a697cce7fa3dff96 and project b92af206e05f44cf948b7c25d1acc139. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:08:45.636599 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-2f5b547b-ce60-40e4-b7f8-cc86227d2528 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Going to run 1 instances... {{(pid=134052) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:08:45.647059 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-2f5b547b-ce60-40e4-b7f8-cc86227d2528 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 28d2e08f-ea2f-42f2-beb5-bfdc368b9014] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134052) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:08:45.782654 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-2f5b547b-ce60-40e4-b7f8-cc86227d2528 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.542573 Aug 27 03:08:45.783724 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2502/5051] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 03:08:44 2022] POST /compute/v2.1/servers => generated 402 bytes in 1551 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:08:45.796372 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-54cbb7cd-be23-4222-b0c3-3ce99a1c4cc6 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:45.796989 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-54cbb7cd-be23-4222-b0c3-3ce99a1c4cc6 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 28d2e08f-ea2f-42f2-beb5-bfdc368b9014] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:46.147483 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-54cbb7cd-be23-4222-b0c3-3ce99a1c4cc6 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a549f85910184bf7a697cce7fa3dff96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92af206e05f44cf948b7c25d1acc139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:46.160172 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-54cbb7cd-be23-4222-b0c3-3ce99a1c4cc6 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "GET /compute/v2.1/servers/28d2e08f-ea2f-42f2-beb5-bfdc368b9014" status: 200 len: 1241 microversion: 2.1 time: 0.368458 Aug 27 03:08:46.160814 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2550/5052] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:45 2022] GET /compute/v2.1/servers/28d2e08f-ea2f-42f2-beb5-bfdc368b9014 => generated 1241 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:47.183867 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-39b7bd8d-17db-4865-9f0e-b03c492ba884 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:47.186530 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-39b7bd8d-17db-4865-9f0e-b03c492ba884 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 28d2e08f-ea2f-42f2-beb5-bfdc368b9014] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:47.222893 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-39b7bd8d-17db-4865-9f0e-b03c492ba884 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:47.226117 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-39b7bd8d-17db-4865-9f0e-b03c492ba884 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:47.229936 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-39b7bd8d-17db-4865-9f0e-b03c492ba884 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:47.233737 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-39b7bd8d-17db-4865-9f0e-b03c492ba884 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:47.235553 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-39b7bd8d-17db-4865-9f0e-b03c492ba884 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:47.236356 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-39b7bd8d-17db-4865-9f0e-b03c492ba884 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:47.399178 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-39b7bd8d-17db-4865-9f0e-b03c492ba884 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a549f85910184bf7a697cce7fa3dff96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92af206e05f44cf948b7c25d1acc139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:47.415637 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-39b7bd8d-17db-4865-9f0e-b03c492ba884 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "GET /compute/v2.1/servers/28d2e08f-ea2f-42f2-beb5-bfdc368b9014" status: 200 len: 1237 microversion: 2.1 time: 0.238853 Aug 27 03:08:47.418434 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2503/5053] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:47 2022] GET /compute/v2.1/servers/28d2e08f-ea2f-42f2-beb5-bfdc368b9014 => generated 1237 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:48.443053 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a060804e-9f98-4204-a54b-d36242833690 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:48.443677 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-a060804e-9f98-4204-a54b-d36242833690 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 28d2e08f-ea2f-42f2-beb5-bfdc368b9014] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:48.452154 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a060804e-9f98-4204-a54b-d36242833690 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:48.452674 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a060804e-9f98-4204-a54b-d36242833690 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:48.459369 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a060804e-9f98-4204-a54b-d36242833690 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:48.463330 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a060804e-9f98-4204-a54b-d36242833690 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:48.464045 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a060804e-9f98-4204-a54b-d36242833690 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:48.464742 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a060804e-9f98-4204-a54b-d36242833690 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:48.614997 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-a060804e-9f98-4204-a54b-d36242833690 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a549f85910184bf7a697cce7fa3dff96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92af206e05f44cf948b7c25d1acc139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:48.623983 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a060804e-9f98-4204-a54b-d36242833690 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "GET /compute/v2.1/servers/28d2e08f-ea2f-42f2-beb5-bfdc368b9014" status: 200 len: 1311 microversion: 2.1 time: 0.189118 Aug 27 03:08:48.624929 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2551/5054] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:48 2022] GET /compute/v2.1/servers/28d2e08f-ea2f-42f2-beb5-bfdc368b9014 => generated 1311 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:49.647051 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0bfc5cad-255f-4ec0-b3f2-5525f1ce3011 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:49.648286 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-0bfc5cad-255f-4ec0-b3f2-5525f1ce3011 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 28d2e08f-ea2f-42f2-beb5-bfdc368b9014] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:49.661801 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0bfc5cad-255f-4ec0-b3f2-5525f1ce3011 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:49.665751 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0bfc5cad-255f-4ec0-b3f2-5525f1ce3011 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:49.666221 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0bfc5cad-255f-4ec0-b3f2-5525f1ce3011 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:49.669554 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0bfc5cad-255f-4ec0-b3f2-5525f1ce3011 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:49.670032 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0bfc5cad-255f-4ec0-b3f2-5525f1ce3011 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:49.672888 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0bfc5cad-255f-4ec0-b3f2-5525f1ce3011 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:49.977572 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0bfc5cad-255f-4ec0-b3f2-5525f1ce3011 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a549f85910184bf7a697cce7fa3dff96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92af206e05f44cf948b7c25d1acc139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:49.999467 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-0bfc5cad-255f-4ec0-b3f2-5525f1ce3011 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "GET /compute/v2.1/servers/28d2e08f-ea2f-42f2-beb5-bfdc368b9014" status: 200 len: 1367 microversion: 2.1 time: 0.358645 Aug 27 03:08:50.000668 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2504/5055] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:49 2022] GET /compute/v2.1/servers/28d2e08f-ea2f-42f2-beb5-bfdc368b9014 => generated 1367 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:51.019742 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-822dc3ba-aba7-457c-ad68-80d9142aef47 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:51.020644 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-822dc3ba-aba7-457c-ad68-80d9142aef47 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 28d2e08f-ea2f-42f2-beb5-bfdc368b9014] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:51.033060 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-822dc3ba-aba7-457c-ad68-80d9142aef47 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:51.033588 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-822dc3ba-aba7-457c-ad68-80d9142aef47 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:51.041728 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-822dc3ba-aba7-457c-ad68-80d9142aef47 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:51.042996 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-822dc3ba-aba7-457c-ad68-80d9142aef47 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:51.043767 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-822dc3ba-aba7-457c-ad68-80d9142aef47 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:51.044414 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-822dc3ba-aba7-457c-ad68-80d9142aef47 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:51.342077 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-822dc3ba-aba7-457c-ad68-80d9142aef47 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a549f85910184bf7a697cce7fa3dff96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92af206e05f44cf948b7c25d1acc139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:51.354744 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-822dc3ba-aba7-457c-ad68-80d9142aef47 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "GET /compute/v2.1/servers/28d2e08f-ea2f-42f2-beb5-bfdc368b9014" status: 200 len: 1367 microversion: 2.1 time: 0.336511 Aug 27 03:08:51.359395 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2552/5056] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:51 2022] GET /compute/v2.1/servers/28d2e08f-ea2f-42f2-beb5-bfdc368b9014 => generated 1367 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:52.270448 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-109d1c9d-1e6d-4e15-a2be-f1a41092f6ff req-482cdfff-e3e8-4cc7-85ab-9225a984120b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28d2e08f-ea2f-42f2-beb5-bfdc368b9014", "tag": "2402421f-b741-41f8-8a5a-d7796c14f7fd"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:08:52.288618 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-109d1c9d-1e6d-4e15-a2be-f1a41092f6ff req-482cdfff-e3e8-4cc7-85ab-9225a984120b service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:52.289247 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-109d1c9d-1e6d-4e15-a2be-f1a41092f6ff req-482cdfff-e3e8-4cc7-85ab-9225a984120b service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:52.289614 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-109d1c9d-1e6d-4e15-a2be-f1a41092f6ff req-482cdfff-e3e8-4cc7-85ab-9225a984120b service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:52.312662 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-109d1c9d-1e6d-4e15-a2be-f1a41092f6ff req-482cdfff-e3e8-4cc7-85ab-9225a984120b service nova] Creating event network-changed:2402421f-b741-41f8-8a5a-d7796c14f7fd for instance 28d2e08f-ea2f-42f2-beb5-bfdc368b9014 on n-h1-852278-4 Aug 27 03:08:52.334489 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-109d1c9d-1e6d-4e15-a2be-f1a41092f6ff req-482cdfff-e3e8-4cc7-85ab-9225a984120b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067817 Aug 27 03:08:52.335165 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2505/5057] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:08:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:08:52.382694 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-05cac8eb-07e3-4a9c-bb67-1fb7a6342d23 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:52.387839 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-05cac8eb-07e3-4a9c-bb67-1fb7a6342d23 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 28d2e08f-ea2f-42f2-beb5-bfdc368b9014] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:52.411464 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-05cac8eb-07e3-4a9c-bb67-1fb7a6342d23 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:52.413855 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-05cac8eb-07e3-4a9c-bb67-1fb7a6342d23 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:52.414582 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-05cac8eb-07e3-4a9c-bb67-1fb7a6342d23 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:52.416089 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-05cac8eb-07e3-4a9c-bb67-1fb7a6342d23 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:52.419287 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-05cac8eb-07e3-4a9c-bb67-1fb7a6342d23 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:52.419983 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-05cac8eb-07e3-4a9c-bb67-1fb7a6342d23 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:52.698888 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-05cac8eb-07e3-4a9c-bb67-1fb7a6342d23 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a549f85910184bf7a697cce7fa3dff96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92af206e05f44cf948b7c25d1acc139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:52.710326 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-05cac8eb-07e3-4a9c-bb67-1fb7a6342d23 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "GET /compute/v2.1/servers/28d2e08f-ea2f-42f2-beb5-bfdc368b9014" status: 200 len: 1367 microversion: 2.1 time: 0.334693 Aug 27 03:08:52.711136 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2553/5058] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:52 2022] GET /compute/v2.1/servers/28d2e08f-ea2f-42f2-beb5-bfdc368b9014 => generated 1367 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:53.734968 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d6e08304-4b18-438b-87f2-ad81394263e9 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:53.736265 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d6e08304-4b18-438b-87f2-ad81394263e9 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 28d2e08f-ea2f-42f2-beb5-bfdc368b9014] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:53.744412 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d6e08304-4b18-438b-87f2-ad81394263e9 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:53.744998 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d6e08304-4b18-438b-87f2-ad81394263e9 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:53.745835 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d6e08304-4b18-438b-87f2-ad81394263e9 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:53.746840 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d6e08304-4b18-438b-87f2-ad81394263e9 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:53.747490 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d6e08304-4b18-438b-87f2-ad81394263e9 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:53.750505 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d6e08304-4b18-438b-87f2-ad81394263e9 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:53.934991 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-d6e08304-4b18-438b-87f2-ad81394263e9 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a549f85910184bf7a697cce7fa3dff96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92af206e05f44cf948b7c25d1acc139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:53.943758 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d6e08304-4b18-438b-87f2-ad81394263e9 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "GET /compute/v2.1/servers/28d2e08f-ea2f-42f2-beb5-bfdc368b9014" status: 200 len: 1367 microversion: 2.1 time: 0.215852 Aug 27 03:08:53.945190 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2506/5059] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:53 2022] GET /compute/v2.1/servers/28d2e08f-ea2f-42f2-beb5-bfdc368b9014 => generated 1367 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:54.966115 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4768f43b-316a-48d3-816d-8a48a68cb841 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:54.967634 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-4768f43b-316a-48d3-816d-8a48a68cb841 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 28d2e08f-ea2f-42f2-beb5-bfdc368b9014] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:54.991212 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4768f43b-316a-48d3-816d-8a48a68cb841 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:54.991734 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4768f43b-316a-48d3-816d-8a48a68cb841 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:54.993439 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4768f43b-316a-48d3-816d-8a48a68cb841 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:54.994231 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4768f43b-316a-48d3-816d-8a48a68cb841 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:54.995147 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4768f43b-316a-48d3-816d-8a48a68cb841 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:54.995147 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4768f43b-316a-48d3-816d-8a48a68cb841 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:55.281076 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-4768f43b-316a-48d3-816d-8a48a68cb841 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a549f85910184bf7a697cce7fa3dff96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92af206e05f44cf948b7c25d1acc139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:55.294493 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-4768f43b-316a-48d3-816d-8a48a68cb841 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "GET /compute/v2.1/servers/28d2e08f-ea2f-42f2-beb5-bfdc368b9014" status: 200 len: 1367 microversion: 2.1 time: 0.329613 Aug 27 03:08:55.295324 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2554/5060] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:54 2022] GET /compute/v2.1/servers/28d2e08f-ea2f-42f2-beb5-bfdc368b9014 => generated 1367 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:56.323864 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f4c91f26-3578-4fb9-a087-4d95371cd725 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:56.325159 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-f4c91f26-3578-4fb9-a087-4d95371cd725 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 28d2e08f-ea2f-42f2-beb5-bfdc368b9014] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:56.347578 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:08:56.348925 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=6 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:08:56.351338 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f4c91f26-3578-4fb9-a087-4d95371cd725 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:56.351904 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f4c91f26-3578-4fb9-a087-4d95371cd725 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:56.352702 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f4c91f26-3578-4fb9-a087-4d95371cd725 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:56.355465 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f4c91f26-3578-4fb9-a087-4d95371cd725 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:56.356950 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f4c91f26-3578-4fb9-a087-4d95371cd725 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:56.357404 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f4c91f26-3578-4fb9-a087-4d95371cd725 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:56.723816 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-f4c91f26-3578-4fb9-a087-4d95371cd725 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a549f85910184bf7a697cce7fa3dff96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92af206e05f44cf948b7c25d1acc139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:56.738761 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f4c91f26-3578-4fb9-a087-4d95371cd725 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "GET /compute/v2.1/servers/28d2e08f-ea2f-42f2-beb5-bfdc368b9014" status: 200 len: 1367 microversion: 2.1 time: 0.426193 Aug 27 03:08:56.740557 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2507/5061] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:56 2022] GET /compute/v2.1/servers/28d2e08f-ea2f-42f2-beb5-bfdc368b9014 => generated 1367 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:57.221098 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=6 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:08:57.546370 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c1643edf-0624-4ade-aee4-62cea080b67a tempest-PortsAdminExtendedAttrsIpV6TestJSON-349205476 tempest-PortsAdminExtendedAttrsIpV6TestJSON-349205476-project-admin] Calling method '.version_select at 0x7f5ede8f7ca0>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:57.548192 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c1643edf-0624-4ade-aee4-62cea080b67a tempest-PortsAdminExtendedAttrsIpV6TestJSON-349205476 tempest-PortsAdminExtendedAttrsIpV6TestJSON-349205476-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:57.548730 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c1643edf-0624-4ade-aee4-62cea080b67a tempest-PortsAdminExtendedAttrsIpV6TestJSON-349205476 tempest-PortsAdminExtendedAttrsIpV6TestJSON-349205476-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:57.550051 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c1643edf-0624-4ade-aee4-62cea080b67a tempest-PortsAdminExtendedAttrsIpV6TestJSON-349205476 tempest-PortsAdminExtendedAttrsIpV6TestJSON-349205476-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:57.569843 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c1643edf-0624-4ade-aee4-62cea080b67a tempest-PortsAdminExtendedAttrsIpV6TestJSON-349205476 tempest-PortsAdminExtendedAttrsIpV6TestJSON-349205476-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:57.570257 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c1643edf-0624-4ade-aee4-62cea080b67a tempest-PortsAdminExtendedAttrsIpV6TestJSON-349205476 tempest-PortsAdminExtendedAttrsIpV6TestJSON-349205476-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:57.571533 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c1643edf-0624-4ade-aee4-62cea080b67a tempest-PortsAdminExtendedAttrsIpV6TestJSON-349205476 tempest-PortsAdminExtendedAttrsIpV6TestJSON-349205476-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:57.584734 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c1643edf-0624-4ade-aee4-62cea080b67a tempest-PortsAdminExtendedAttrsIpV6TestJSON-349205476 tempest-PortsAdminExtendedAttrsIpV6TestJSON-349205476-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:57.585141 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c1643edf-0624-4ade-aee4-62cea080b67a tempest-PortsAdminExtendedAttrsIpV6TestJSON-349205476 tempest-PortsAdminExtendedAttrsIpV6TestJSON-349205476-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:57.585595 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c1643edf-0624-4ade-aee4-62cea080b67a tempest-PortsAdminExtendedAttrsIpV6TestJSON-349205476 tempest-PortsAdminExtendedAttrsIpV6TestJSON-349205476-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:57.594957 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c1643edf-0624-4ade-aee4-62cea080b67a tempest-PortsAdminExtendedAttrsIpV6TestJSON-349205476 tempest-PortsAdminExtendedAttrsIpV6TestJSON-349205476-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.382645 Aug 27 03:08:57.603357 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2555/5062] 10.222.0.70 () {58 vars in 1146 bytes} [Sat Aug 27 03:08:57 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:08:57.760770 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5850b6f7-c461-4bd1-9de9-d47c0ac4aec5 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:57.761524 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-5850b6f7-c461-4bd1-9de9-d47c0ac4aec5 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 28d2e08f-ea2f-42f2-beb5-bfdc368b9014] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:57.773215 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5850b6f7-c461-4bd1-9de9-d47c0ac4aec5 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:57.773833 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5850b6f7-c461-4bd1-9de9-d47c0ac4aec5 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:57.774526 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5850b6f7-c461-4bd1-9de9-d47c0ac4aec5 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:57.784782 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5850b6f7-c461-4bd1-9de9-d47c0ac4aec5 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:57.786543 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5850b6f7-c461-4bd1-9de9-d47c0ac4aec5 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:57.787190 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5850b6f7-c461-4bd1-9de9-d47c0ac4aec5 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:57.981712 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-5850b6f7-c461-4bd1-9de9-d47c0ac4aec5 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a549f85910184bf7a697cce7fa3dff96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92af206e05f44cf948b7c25d1acc139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:57.993240 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-5850b6f7-c461-4bd1-9de9-d47c0ac4aec5 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "GET /compute/v2.1/servers/28d2e08f-ea2f-42f2-beb5-bfdc368b9014" status: 200 len: 1367 microversion: 2.1 time: 0.236355 Aug 27 03:08:57.993986 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2508/5063] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:57 2022] GET /compute/v2.1/servers/28d2e08f-ea2f-42f2-beb5-bfdc368b9014 => generated 1367 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:58.268834 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e93229d8-a646-4eab-a5e2-2255c0016dae tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:58.270816 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-e93229d8-a646-4eab-a5e2-2255c0016dae tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:58.289033 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e93229d8-a646-4eab-a5e2-2255c0016dae tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:58.291309 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e93229d8-a646-4eab-a5e2-2255c0016dae tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:58.292122 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e93229d8-a646-4eab-a5e2-2255c0016dae tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:58.298080 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e93229d8-a646-4eab-a5e2-2255c0016dae tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:58.298589 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e93229d8-a646-4eab-a5e2-2255c0016dae tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:58.299010 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e93229d8-a646-4eab-a5e2-2255c0016dae tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:58.340737 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e93229d8-a646-4eab-a5e2-2255c0016dae tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22/ips" status: 200 len: 151 microversion: 2.20 time: 0.092983 Aug 27 03:08:58.342843 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2556/5064] 10.222.0.70 () {60 vars in 1289 bytes} [Sat Aug 27 03:08:58 2022] GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22/ips => generated 151 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:08:58.940437 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-544cc63f-bb36-4540-9ace-5c210372da14 req-174b1123-0867-4465-a9d4-f1658c7874a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28d2e08f-ea2f-42f2-beb5-bfdc368b9014", "name": "network-vif-plugged", "status": "completed", "tag": "2402421f-b741-41f8-8a5a-d7796c14f7fd"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:08:58.961381 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-544cc63f-bb36-4540-9ace-5c210372da14 req-174b1123-0867-4465-a9d4-f1658c7874a6 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:58.964382 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-544cc63f-bb36-4540-9ace-5c210372da14 req-174b1123-0867-4465-a9d4-f1658c7874a6 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:58.966518 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-544cc63f-bb36-4540-9ace-5c210372da14 req-174b1123-0867-4465-a9d4-f1658c7874a6 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:59.017155 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-46dd721a-f7df-47bf-93f1-dfe2bd85d723 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:59.018280 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-46dd721a-f7df-47bf-93f1-dfe2bd85d723 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 28d2e08f-ea2f-42f2-beb5-bfdc368b9014] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:59.021156 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-544cc63f-bb36-4540-9ace-5c210372da14 req-174b1123-0867-4465-a9d4-f1658c7874a6 service nova] Creating event network-vif-plugged:2402421f-b741-41f8-8a5a-d7796c14f7fd for instance 28d2e08f-ea2f-42f2-beb5-bfdc368b9014 on n-h1-852278-4 Aug 27 03:08:59.031814 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-46dd721a-f7df-47bf-93f1-dfe2bd85d723 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:59.032671 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-46dd721a-f7df-47bf-93f1-dfe2bd85d723 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:59.033298 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-46dd721a-f7df-47bf-93f1-dfe2bd85d723 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:59.034201 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-46dd721a-f7df-47bf-93f1-dfe2bd85d723 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:59.034837 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-46dd721a-f7df-47bf-93f1-dfe2bd85d723 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:59.036042 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-46dd721a-f7df-47bf-93f1-dfe2bd85d723 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:59.036995 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-544cc63f-bb36-4540-9ace-5c210372da14 req-174b1123-0867-4465-a9d4-f1658c7874a6 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100332 Aug 27 03:08:59.041958 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2509/5065] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:08:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:08:59.280865 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-46dd721a-f7df-47bf-93f1-dfe2bd85d723 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a549f85910184bf7a697cce7fa3dff96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92af206e05f44cf948b7c25d1acc139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:59.299892 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-46dd721a-f7df-47bf-93f1-dfe2bd85d723 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "GET /compute/v2.1/servers/28d2e08f-ea2f-42f2-beb5-bfdc368b9014" status: 200 len: 1367 microversion: 2.1 time: 0.286314 Aug 27 03:08:59.304728 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2557/5066] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:59 2022] GET /compute/v2.1/servers/28d2e08f-ea2f-42f2-beb5-bfdc368b9014 => generated 1367 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:09:00.336889 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8e4b766b-769f-4af3-a3c7-8eae97b5c909 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:00.337595 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-8e4b766b-769f-4af3-a3c7-8eae97b5c909 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 28d2e08f-ea2f-42f2-beb5-bfdc368b9014] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:00.354517 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8e4b766b-769f-4af3-a3c7-8eae97b5c909 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:00.355206 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8e4b766b-769f-4af3-a3c7-8eae97b5c909 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:00.355817 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8e4b766b-769f-4af3-a3c7-8eae97b5c909 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:00.356774 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8e4b766b-769f-4af3-a3c7-8eae97b5c909 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:00.357684 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8e4b766b-769f-4af3-a3c7-8eae97b5c909 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:00.358429 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8e4b766b-769f-4af3-a3c7-8eae97b5c909 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:00.740357 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-8e4b766b-769f-4af3-a3c7-8eae97b5c909 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a549f85910184bf7a697cce7fa3dff96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92af206e05f44cf948b7c25d1acc139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:00.754750 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-8e4b766b-769f-4af3-a3c7-8eae97b5c909 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "GET /compute/v2.1/servers/28d2e08f-ea2f-42f2-beb5-bfdc368b9014" status: 200 len: 1367 microversion: 2.1 time: 0.422885 Aug 27 03:09:00.756100 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2510/5067] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:00 2022] GET /compute/v2.1/servers/28d2e08f-ea2f-42f2-beb5-bfdc368b9014 => generated 1367 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:01.779502 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3f7fb51f-deb3-411f-87d6-e036cc711fd0 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:01.780114 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-3f7fb51f-deb3-411f-87d6-e036cc711fd0 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 28d2e08f-ea2f-42f2-beb5-bfdc368b9014] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:01.790980 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3f7fb51f-deb3-411f-87d6-e036cc711fd0 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:01.791977 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3f7fb51f-deb3-411f-87d6-e036cc711fd0 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:01.793181 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3f7fb51f-deb3-411f-87d6-e036cc711fd0 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:01.794675 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3f7fb51f-deb3-411f-87d6-e036cc711fd0 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:01.795587 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3f7fb51f-deb3-411f-87d6-e036cc711fd0 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:01.796232 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3f7fb51f-deb3-411f-87d6-e036cc711fd0 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:01.941418 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a816ad05-73b2-4cb5-b637-82bff14e4fff tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:09:01.941960 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a816ad05-73b2-4cb5-b637-82bff14e4fff tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:01.951330 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a816ad05-73b2-4cb5-b637-82bff14e4fff tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:01.951656 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a816ad05-73b2-4cb5-b637-82bff14e4fff tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:01.952085 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a816ad05-73b2-4cb5-b637-82bff14e4fff tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:01.965231 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a816ad05-73b2-4cb5-b637-82bff14e4fff tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:01.965722 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a816ad05-73b2-4cb5-b637-82bff14e4fff tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:01.966155 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a816ad05-73b2-4cb5-b637-82bff14e4fff tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:01.994669 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.instance [None req-a816ad05-73b2-4cb5-b637-82bff14e4fff tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lazy-loading 'flavor' on Instance uuid 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22 {{(pid=134052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:09:02.021500 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-3f7fb51f-deb3-411f-87d6-e036cc711fd0 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a549f85910184bf7a697cce7fa3dff96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92af206e05f44cf948b7c25d1acc139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:02.029789 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-3f7fb51f-deb3-411f-87d6-e036cc711fd0 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "GET /compute/v2.1/servers/28d2e08f-ea2f-42f2-beb5-bfdc368b9014" status: 200 len: 1557 microversion: 2.1 time: 0.255169 Aug 27 03:09:02.044440 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2558/5068] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:01 2022] GET /compute/v2.1/servers/28d2e08f-ea2f-42f2-beb5-bfdc368b9014 => generated 1557 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:02.057547 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-bf3077e2-2355-44ae-9ee2-cdb65df744fa tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:02.058071 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-bf3077e2-2355-44ae-9ee2-cdb65df744fa tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 28d2e08f-ea2f-42f2-beb5-bfdc368b9014] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:02.078363 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bf3077e2-2355-44ae-9ee2-cdb65df744fa tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:02.078931 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bf3077e2-2355-44ae-9ee2-cdb65df744fa tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:02.079390 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bf3077e2-2355-44ae-9ee2-cdb65df744fa tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:02.080538 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bf3077e2-2355-44ae-9ee2-cdb65df744fa tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:02.081170 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bf3077e2-2355-44ae-9ee2-cdb65df744fa tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:02.081753 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bf3077e2-2355-44ae-9ee2-cdb65df744fa tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:02.245566 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-bf3077e2-2355-44ae-9ee2-cdb65df744fa tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "GET /compute/v2.1/servers/28d2e08f-ea2f-42f2-beb5-bfdc368b9014/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.196622 Aug 27 03:09:02.246248 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2559/5069] 10.222.0.70 () {58 vars in 1275 bytes} [Sat Aug 27 03:09:02 2022] GET /compute/v2.1/servers/28d2e08f-ea2f-42f2-beb5-bfdc368b9014/os-interface => generated 285 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:09:02.266799 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a816ad05-73b2-4cb5-b637-82bff14e4fff tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "POST /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22/action" status: 202 len: 0 microversion: 2.20 time: 0.329170 Aug 27 03:09:02.268700 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2511/5070] 10.222.0.70 () {62 vars in 1319 bytes} [Sat Aug 27 03:09:01 2022] POST /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22/action => generated 0 bytes in 331 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 27 03:09:02.276947 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ea6bf5be-3380-4f5f-9b65-4c63f2a9a8e7 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:02.277729 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-ea6bf5be-3380-4f5f-9b65-4c63f2a9a8e7 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:02.285589 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ea6bf5be-3380-4f5f-9b65-4c63f2a9a8e7 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:02.286525 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ea6bf5be-3380-4f5f-9b65-4c63f2a9a8e7 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:02.287272 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ea6bf5be-3380-4f5f-9b65-4c63f2a9a8e7 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:02.288525 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ea6bf5be-3380-4f5f-9b65-4c63f2a9a8e7 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:02.289243 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ea6bf5be-3380-4f5f-9b65-4c63f2a9a8e7 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:02.290039 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ea6bf5be-3380-4f5f-9b65-4c63f2a9a8e7 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:02.544194 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-ea6bf5be-3380-4f5f-9b65-4c63f2a9a8e7 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:02.554916 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-ea6bf5be-3380-4f5f-9b65-4c63f2a9a8e7 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:02.557427 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-ea6bf5be-3380-4f5f-9b65-4c63f2a9a8e7 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:02.559043 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ea6bf5be-3380-4f5f-9b65-4c63f2a9a8e7 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22" status: 200 len: 1723 microversion: 2.20 time: 0.286606 Aug 27 03:09:02.560693 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2560/5071] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:09:02 2022] GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22 => generated 1723 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:09:03.603596 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0760bfc3-66fa-4451-a410-d4e10930527d tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:03.605154 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-0760bfc3-66fa-4451-a410-d4e10930527d tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:03.615527 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0760bfc3-66fa-4451-a410-d4e10930527d tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:03.619960 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0760bfc3-66fa-4451-a410-d4e10930527d tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:03.621279 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0760bfc3-66fa-4451-a410-d4e10930527d tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:03.625022 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0760bfc3-66fa-4451-a410-d4e10930527d tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:03.626611 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0760bfc3-66fa-4451-a410-d4e10930527d tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:03.628334 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0760bfc3-66fa-4451-a410-d4e10930527d tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:03.957527 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0760bfc3-66fa-4451-a410-d4e10930527d tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:03.970925 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0760bfc3-66fa-4451-a410-d4e10930527d tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:03.974963 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0760bfc3-66fa-4451-a410-d4e10930527d tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:03.977595 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-0760bfc3-66fa-4451-a410-d4e10930527d tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22" status: 200 len: 1723 microversion: 2.20 time: 0.391616 Aug 27 03:09:03.981045 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2512/5072] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:09:03 2022] GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22 => generated 1723 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:09:04.070401 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-803294d4-f88b-4c6d-80e7-de382f14f593 req-5ec7a303-b7f2-48fd-be20-f779f2aae405 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28d2e08f-ea2f-42f2-beb5-bfdc368b9014", "tag": "2402421f-b741-41f8-8a5a-d7796c14f7fd"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:09:04.119438 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-803294d4-f88b-4c6d-80e7-de382f14f593 req-5ec7a303-b7f2-48fd-be20-f779f2aae405 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:04.119957 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-803294d4-f88b-4c6d-80e7-de382f14f593 req-5ec7a303-b7f2-48fd-be20-f779f2aae405 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:04.120428 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-803294d4-f88b-4c6d-80e7-de382f14f593 req-5ec7a303-b7f2-48fd-be20-f779f2aae405 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:04.151506 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-803294d4-f88b-4c6d-80e7-de382f14f593 req-5ec7a303-b7f2-48fd-be20-f779f2aae405 service nova] Creating event network-changed:2402421f-b741-41f8-8a5a-d7796c14f7fd for instance 28d2e08f-ea2f-42f2-beb5-bfdc368b9014 on n-h1-852278-4 Aug 27 03:09:04.161190 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-803294d4-f88b-4c6d-80e7-de382f14f593 req-5ec7a303-b7f2-48fd-be20-f779f2aae405 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100379 Aug 27 03:09:04.171546 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2561/5073] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:09:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:09:05.013003 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-856c5053-0a25-4d8c-a043-8f172629c743 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:05.014232 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-856c5053-0a25-4d8c-a043-8f172629c743 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:05.029676 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-856c5053-0a25-4d8c-a043-8f172629c743 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:05.030462 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-856c5053-0a25-4d8c-a043-8f172629c743 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:05.031104 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-856c5053-0a25-4d8c-a043-8f172629c743 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:05.032103 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-856c5053-0a25-4d8c-a043-8f172629c743 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:05.033007 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-856c5053-0a25-4d8c-a043-8f172629c743 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:05.033639 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-856c5053-0a25-4d8c-a043-8f172629c743 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:05.354381 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-856c5053-0a25-4d8c-a043-8f172629c743 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:05.364518 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-856c5053-0a25-4d8c-a043-8f172629c743 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:05.370661 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-856c5053-0a25-4d8c-a043-8f172629c743 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:05.374318 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-856c5053-0a25-4d8c-a043-8f172629c743 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22" status: 200 len: 1723 microversion: 2.20 time: 0.366181 Aug 27 03:09:05.374952 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2513/5074] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:09:05 2022] GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22 => generated 1723 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:09:06.401763 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e504f072-0411-42b3-867f-3f47a75e6740 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:06.403499 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-e504f072-0411-42b3-867f-3f47a75e6740 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:06.420175 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e504f072-0411-42b3-867f-3f47a75e6740 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:06.421497 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e504f072-0411-42b3-867f-3f47a75e6740 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:06.422170 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e504f072-0411-42b3-867f-3f47a75e6740 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:06.425116 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e504f072-0411-42b3-867f-3f47a75e6740 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:06.426889 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e504f072-0411-42b3-867f-3f47a75e6740 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:06.428832 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e504f072-0411-42b3-867f-3f47a75e6740 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:06.732378 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e504f072-0411-42b3-867f-3f47a75e6740 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:06.752967 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e504f072-0411-42b3-867f-3f47a75e6740 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:06.760107 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e504f072-0411-42b3-867f-3f47a75e6740 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:06.761458 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e504f072-0411-42b3-867f-3f47a75e6740 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22" status: 200 len: 1723 microversion: 2.20 time: 0.365978 Aug 27 03:09:06.762000 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2562/5075] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:09:06 2022] GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22 => generated 1723 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:09:07.786498 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-07d401a4-0430-41df-9c14-8115133d1823 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:07.788057 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-07d401a4-0430-41df-9c14-8115133d1823 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:07.804065 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-07d401a4-0430-41df-9c14-8115133d1823 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:07.808454 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-07d401a4-0430-41df-9c14-8115133d1823 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:07.809889 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-07d401a4-0430-41df-9c14-8115133d1823 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:07.811724 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-07d401a4-0430-41df-9c14-8115133d1823 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:07.812378 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-07d401a4-0430-41df-9c14-8115133d1823 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:07.814886 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-07d401a4-0430-41df-9c14-8115133d1823 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:08.151836 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-07d401a4-0430-41df-9c14-8115133d1823 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:08.172890 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-07d401a4-0430-41df-9c14-8115133d1823 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:08.179385 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-07d401a4-0430-41df-9c14-8115133d1823 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:08.182041 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-07d401a4-0430-41df-9c14-8115133d1823 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22" status: 200 len: 1723 microversion: 2.20 time: 0.399762 Aug 27 03:09:08.182891 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2514/5076] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:09:07 2022] GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22 => generated 1723 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:09:09.205702 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-515fef4e-4375-44dc-952d-739e3feee292 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:09.206316 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-515fef4e-4375-44dc-952d-739e3feee292 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:09.223013 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-515fef4e-4375-44dc-952d-739e3feee292 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:09.223771 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-515fef4e-4375-44dc-952d-739e3feee292 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:09.224418 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-515fef4e-4375-44dc-952d-739e3feee292 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:09.225772 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-515fef4e-4375-44dc-952d-739e3feee292 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:09.226366 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-515fef4e-4375-44dc-952d-739e3feee292 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:09.226927 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-515fef4e-4375-44dc-952d-739e3feee292 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:09.570895 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-515fef4e-4375-44dc-952d-739e3feee292 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:09.583762 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-515fef4e-4375-44dc-952d-739e3feee292 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:09.586101 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-515fef4e-4375-44dc-952d-739e3feee292 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:09.587316 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-515fef4e-4375-44dc-952d-739e3feee292 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22" status: 200 len: 1723 microversion: 2.20 time: 0.385604 Aug 27 03:09:09.588266 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2563/5077] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:09:09 2022] GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22 => generated 1723 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:09:10.615617 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c4b358b1-3507-4127-ba40-2b5863f57fb3 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:10.617087 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-c4b358b1-3507-4127-ba40-2b5863f57fb3 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:10.625693 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c4b358b1-3507-4127-ba40-2b5863f57fb3 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:10.631766 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c4b358b1-3507-4127-ba40-2b5863f57fb3 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:10.632491 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c4b358b1-3507-4127-ba40-2b5863f57fb3 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:10.633366 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c4b358b1-3507-4127-ba40-2b5863f57fb3 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:10.639759 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c4b358b1-3507-4127-ba40-2b5863f57fb3 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:10.640969 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c4b358b1-3507-4127-ba40-2b5863f57fb3 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:10.905298 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-c4b358b1-3507-4127-ba40-2b5863f57fb3 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:10.917573 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-c4b358b1-3507-4127-ba40-2b5863f57fb3 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:10.927037 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-c4b358b1-3507-4127-ba40-2b5863f57fb3 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:10.935269 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c4b358b1-3507-4127-ba40-2b5863f57fb3 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22" status: 200 len: 1723 microversion: 2.20 time: 0.324216 Aug 27 03:09:10.936158 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2515/5078] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:09:10 2022] GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22 => generated 1723 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:09:11.959709 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-19cddaa5-62f2-4283-a2ee-d2975bcd890a tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:11.960347 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-19cddaa5-62f2-4283-a2ee-d2975bcd890a tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:11.964137 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:09:11.989708 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-19cddaa5-62f2-4283-a2ee-d2975bcd890a tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:11.990748 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-19cddaa5-62f2-4283-a2ee-d2975bcd890a tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:11.991360 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-19cddaa5-62f2-4283-a2ee-d2975bcd890a tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:11.992671 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-19cddaa5-62f2-4283-a2ee-d2975bcd890a tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:11.993286 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-19cddaa5-62f2-4283-a2ee-d2975bcd890a tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:11.993865 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-19cddaa5-62f2-4283-a2ee-d2975bcd890a tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:12.001211 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=71 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:09:12.221393 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-19cddaa5-62f2-4283-a2ee-d2975bcd890a tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:12.233603 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-19cddaa5-62f2-4283-a2ee-d2975bcd890a tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:12.246539 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-19cddaa5-62f2-4283-a2ee-d2975bcd890a tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:12.248910 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-19cddaa5-62f2-4283-a2ee-d2975bcd890a tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22" status: 200 len: 1723 microversion: 2.20 time: 0.293405 Aug 27 03:09:12.252081 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2564/5079] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:09:11 2022] GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22 => generated 1723 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:09:13.272091 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0a8c8fd4-370a-4cd7-b690-2f588f985ba9 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:13.272732 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-0a8c8fd4-370a-4cd7-b690-2f588f985ba9 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:13.288904 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0a8c8fd4-370a-4cd7-b690-2f588f985ba9 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:13.289590 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0a8c8fd4-370a-4cd7-b690-2f588f985ba9 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:13.290175 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0a8c8fd4-370a-4cd7-b690-2f588f985ba9 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:13.291220 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0a8c8fd4-370a-4cd7-b690-2f588f985ba9 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:13.291848 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0a8c8fd4-370a-4cd7-b690-2f588f985ba9 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:13.292534 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0a8c8fd4-370a-4cd7-b690-2f588f985ba9 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:13.563120 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0a8c8fd4-370a-4cd7-b690-2f588f985ba9 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:13.576414 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0a8c8fd4-370a-4cd7-b690-2f588f985ba9 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:13.579812 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0a8c8fd4-370a-4cd7-b690-2f588f985ba9 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:13.581156 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-0a8c8fd4-370a-4cd7-b690-2f588f985ba9 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22" status: 200 len: 1744 microversion: 2.20 time: 0.313050 Aug 27 03:09:13.583622 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2516/5080] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:09:13 2022] GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22 => generated 1744 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:09:14.609443 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0bea9968-6695-4c2b-bcf8-7c45fdda4354 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:14.610760 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-0bea9968-6695-4c2b-bcf8-7c45fdda4354 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:14.621519 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0bea9968-6695-4c2b-bcf8-7c45fdda4354 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:14.622417 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0bea9968-6695-4c2b-bcf8-7c45fdda4354 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:14.622905 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0bea9968-6695-4c2b-bcf8-7c45fdda4354 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:14.623686 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0bea9968-6695-4c2b-bcf8-7c45fdda4354 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:14.624646 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0bea9968-6695-4c2b-bcf8-7c45fdda4354 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:14.625127 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0bea9968-6695-4c2b-bcf8-7c45fdda4354 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:14.960587 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-0bea9968-6695-4c2b-bcf8-7c45fdda4354 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:14.971080 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-0bea9968-6695-4c2b-bcf8-7c45fdda4354 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:14.978837 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-0bea9968-6695-4c2b-bcf8-7c45fdda4354 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:14.981361 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-0bea9968-6695-4c2b-bcf8-7c45fdda4354 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22" status: 200 len: 1744 microversion: 2.20 time: 0.377315 Aug 27 03:09:14.984286 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2565/5081] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:09:14 2022] GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22 => generated 1744 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:09:16.013349 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-471e61e7-1b53-4bc2-b03d-4cca5380876f tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:16.014667 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-471e61e7-1b53-4bc2-b03d-4cca5380876f tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:16.022170 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:09:16.065202 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-471e61e7-1b53-4bc2-b03d-4cca5380876f tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:16.066362 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-471e61e7-1b53-4bc2-b03d-4cca5380876f tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:16.067029 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-471e61e7-1b53-4bc2-b03d-4cca5380876f tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:16.068137 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-471e61e7-1b53-4bc2-b03d-4cca5380876f tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:16.069583 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-471e61e7-1b53-4bc2-b03d-4cca5380876f tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:16.070264 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-471e61e7-1b53-4bc2-b03d-4cca5380876f tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:16.077991 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:09:16.363747 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-471e61e7-1b53-4bc2-b03d-4cca5380876f tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:16.389978 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-471e61e7-1b53-4bc2-b03d-4cca5380876f tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:16.395184 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-471e61e7-1b53-4bc2-b03d-4cca5380876f tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:16.397352 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-471e61e7-1b53-4bc2-b03d-4cca5380876f tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22" status: 200 len: 1739 microversion: 2.20 time: 0.389988 Aug 27 03:09:16.400388 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2517/5082] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:09:16 2022] GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22 => generated 1739 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:09:16.733615 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-1378fdfe-ddb1-4caf-9e23-89be8203f709 req-14d94b86-4fe9-442c-8d2b-3ec2a96df084 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73ee7f75-b081-4f5c-90b0-e0d1b27b9a22", "name": "network-vif-plugged", "status": "completed", "tag": "130f85a4-751a-4a52-92c2-d7a99bb65d41"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:09:16.755596 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-1378fdfe-ddb1-4caf-9e23-89be8203f709 req-14d94b86-4fe9-442c-8d2b-3ec2a96df084 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:16.759013 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-1378fdfe-ddb1-4caf-9e23-89be8203f709 req-14d94b86-4fe9-442c-8d2b-3ec2a96df084 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:16.761440 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-1378fdfe-ddb1-4caf-9e23-89be8203f709 req-14d94b86-4fe9-442c-8d2b-3ec2a96df084 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:16.781280 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-1378fdfe-ddb1-4caf-9e23-89be8203f709 req-14d94b86-4fe9-442c-8d2b-3ec2a96df084 service nova] Creating event network-vif-plugged:130f85a4-751a-4a52-92c2-d7a99bb65d41 for instance 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22 on n-h2-852278-4 Aug 27 03:09:16.788746 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-1378fdfe-ddb1-4caf-9e23-89be8203f709 req-14d94b86-4fe9-442c-8d2b-3ec2a96df084 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059501 Aug 27 03:09:16.790262 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2566/5083] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:09:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:09:17.429867 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d2397186-d596-4f5f-a070-833a3da9b7d3 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:17.430504 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d2397186-d596-4f5f-a070-833a3da9b7d3 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:17.458501 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d2397186-d596-4f5f-a070-833a3da9b7d3 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:17.459271 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d2397186-d596-4f5f-a070-833a3da9b7d3 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:17.462542 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d2397186-d596-4f5f-a070-833a3da9b7d3 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:17.466591 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d2397186-d596-4f5f-a070-833a3da9b7d3 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:17.477008 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d2397186-d596-4f5f-a070-833a3da9b7d3 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:17.479536 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d2397186-d596-4f5f-a070-833a3da9b7d3 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:18.047381 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-d2397186-d596-4f5f-a070-833a3da9b7d3 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:18.056998 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-d2397186-d596-4f5f-a070-833a3da9b7d3 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:18.058501 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-d2397186-d596-4f5f-a070-833a3da9b7d3 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:18.065913 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d2397186-d596-4f5f-a070-833a3da9b7d3 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22" status: 200 len: 1739 microversion: 2.20 time: 0.642097 Aug 27 03:09:18.068694 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2518/5084] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:09:17 2022] GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22 => generated 1739 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:09:19.094477 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-76f0669c-9816-4a6e-ba84-afc3046c1ba1 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:19.095440 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-76f0669c-9816-4a6e-ba84-afc3046c1ba1 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:19.114101 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-76f0669c-9816-4a6e-ba84-afc3046c1ba1 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:19.119717 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-76f0669c-9816-4a6e-ba84-afc3046c1ba1 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:19.121891 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-76f0669c-9816-4a6e-ba84-afc3046c1ba1 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:19.122816 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-76f0669c-9816-4a6e-ba84-afc3046c1ba1 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:19.127849 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-76f0669c-9816-4a6e-ba84-afc3046c1ba1 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:19.128559 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-76f0669c-9816-4a6e-ba84-afc3046c1ba1 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:19.640015 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-76f0669c-9816-4a6e-ba84-afc3046c1ba1 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:19.656902 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-76f0669c-9816-4a6e-ba84-afc3046c1ba1 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:19.661534 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-76f0669c-9816-4a6e-ba84-afc3046c1ba1 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:19.662816 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-76f0669c-9816-4a6e-ba84-afc3046c1ba1 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22" status: 200 len: 1739 microversion: 2.20 time: 0.573764 Aug 27 03:09:19.669605 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2567/5085] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:09:19 2022] GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22 => generated 1739 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:09:20.688080 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-93beb284-f599-4db8-b1c3-5e9c6af8a754 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:20.688814 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-93beb284-f599-4db8-b1c3-5e9c6af8a754 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:20.704087 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-93beb284-f599-4db8-b1c3-5e9c6af8a754 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:20.704953 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-93beb284-f599-4db8-b1c3-5e9c6af8a754 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:20.706507 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-93beb284-f599-4db8-b1c3-5e9c6af8a754 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:20.711564 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-93beb284-f599-4db8-b1c3-5e9c6af8a754 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:20.714157 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-93beb284-f599-4db8-b1c3-5e9c6af8a754 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:20.714856 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-93beb284-f599-4db8-b1c3-5e9c6af8a754 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:21.434074 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-93beb284-f599-4db8-b1c3-5e9c6af8a754 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:21.450651 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-93beb284-f599-4db8-b1c3-5e9c6af8a754 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:21.456866 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-93beb284-f599-4db8-b1c3-5e9c6af8a754 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:21.460714 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-93beb284-f599-4db8-b1c3-5e9c6af8a754 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22" status: 200 len: 1739 microversion: 2.20 time: 0.776615 Aug 27 03:09:21.481191 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2519/5086] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:09:20 2022] GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22 => generated 1739 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:09:22.636192 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7521100d-a059-4a56-bbea-f584f4f83a8b tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:22.636192 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-7521100d-a059-4a56-bbea-f584f4f83a8b tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:22.636192 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7521100d-a059-4a56-bbea-f584f4f83a8b tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:22.636192 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7521100d-a059-4a56-bbea-f584f4f83a8b tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:22.636192 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7521100d-a059-4a56-bbea-f584f4f83a8b tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:22.636192 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7521100d-a059-4a56-bbea-f584f4f83a8b tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:22.636192 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7521100d-a059-4a56-bbea-f584f4f83a8b tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:22.636192 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7521100d-a059-4a56-bbea-f584f4f83a8b tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:22.918535 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-7521100d-a059-4a56-bbea-f584f4f83a8b tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:22.936605 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-7521100d-a059-4a56-bbea-f584f4f83a8b tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:22.938185 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-7521100d-a059-4a56-bbea-f584f4f83a8b tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:22.939427 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-7521100d-a059-4a56-bbea-f584f4f83a8b tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22" status: 200 len: 1739 microversion: 2.20 time: 0.457408 Aug 27 03:09:22.952758 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2568/5087] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:09:22 2022] GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22 => generated 1739 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:09:23.963175 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-bdd5e4f4-33cb-424a-a708-d57d29a5b775 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:23.965169 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-bdd5e4f4-33cb-424a-a708-d57d29a5b775 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:23.982935 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bdd5e4f4-33cb-424a-a708-d57d29a5b775 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:23.983679 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bdd5e4f4-33cb-424a-a708-d57d29a5b775 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:23.984346 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bdd5e4f4-33cb-424a-a708-d57d29a5b775 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:23.985323 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bdd5e4f4-33cb-424a-a708-d57d29a5b775 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:23.985998 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bdd5e4f4-33cb-424a-a708-d57d29a5b775 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:23.986613 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bdd5e4f4-33cb-424a-a708-d57d29a5b775 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:24.282866 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-bdd5e4f4-33cb-424a-a708-d57d29a5b775 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:24.293550 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-bdd5e4f4-33cb-424a-a708-d57d29a5b775 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:24.299603 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-bdd5e4f4-33cb-424a-a708-d57d29a5b775 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:24.311990 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-bdd5e4f4-33cb-424a-a708-d57d29a5b775 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22" status: 200 len: 1739 microversion: 2.20 time: 0.353073 Aug 27 03:09:24.351426 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2520/5088] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:09:23 2022] GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22 => generated 1739 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:09:25.351301 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-61237599-7e0f-4a0a-9726-6e2e3db7e1a9 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:25.351897 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-61237599-7e0f-4a0a-9726-6e2e3db7e1a9 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:25.366995 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-61237599-7e0f-4a0a-9726-6e2e3db7e1a9 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:25.371263 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-61237599-7e0f-4a0a-9726-6e2e3db7e1a9 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:25.374902 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-61237599-7e0f-4a0a-9726-6e2e3db7e1a9 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:25.381356 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-61237599-7e0f-4a0a-9726-6e2e3db7e1a9 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:25.381856 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-61237599-7e0f-4a0a-9726-6e2e3db7e1a9 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:25.382298 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-61237599-7e0f-4a0a-9726-6e2e3db7e1a9 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:25.664033 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-61237599-7e0f-4a0a-9726-6e2e3db7e1a9 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:25.674856 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-61237599-7e0f-4a0a-9726-6e2e3db7e1a9 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:25.676441 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-61237599-7e0f-4a0a-9726-6e2e3db7e1a9 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:25.677624 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-61237599-7e0f-4a0a-9726-6e2e3db7e1a9 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22" status: 200 len: 1739 microversion: 2.20 time: 0.330595 Aug 27 03:09:25.678547 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2569/5089] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:09:25 2022] GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22 => generated 1739 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:09:26.703665 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a1e124d3-d1f6-4c51-8325-deb6172260e2 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:26.704343 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a1e124d3-d1f6-4c51-8325-deb6172260e2 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:26.719082 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a1e124d3-d1f6-4c51-8325-deb6172260e2 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:26.721864 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a1e124d3-d1f6-4c51-8325-deb6172260e2 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:26.722615 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a1e124d3-d1f6-4c51-8325-deb6172260e2 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:26.728494 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a1e124d3-d1f6-4c51-8325-deb6172260e2 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:26.731168 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a1e124d3-d1f6-4c51-8325-deb6172260e2 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:26.733268 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a1e124d3-d1f6-4c51-8325-deb6172260e2 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:27.150449 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-a1e124d3-d1f6-4c51-8325-deb6172260e2 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:27.184940 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-a1e124d3-d1f6-4c51-8325-deb6172260e2 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:27.187339 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-a1e124d3-d1f6-4c51-8325-deb6172260e2 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:27.188659 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a1e124d3-d1f6-4c51-8325-deb6172260e2 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22" status: 200 len: 1739 microversion: 2.20 time: 0.489778 Aug 27 03:09:27.214025 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2521/5090] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:09:26 2022] GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22 => generated 1739 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:09:28.215834 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4407207a-8fae-441a-8983-527fe584c3ee tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:28.218012 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-4407207a-8fae-441a-8983-527fe584c3ee tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:28.250702 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4407207a-8fae-441a-8983-527fe584c3ee tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:28.252340 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4407207a-8fae-441a-8983-527fe584c3ee tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:28.253208 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4407207a-8fae-441a-8983-527fe584c3ee tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:28.258282 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4407207a-8fae-441a-8983-527fe584c3ee tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:28.262882 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4407207a-8fae-441a-8983-527fe584c3ee tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:28.263724 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4407207a-8fae-441a-8983-527fe584c3ee tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:28.501178 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-4407207a-8fae-441a-8983-527fe584c3ee tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:28.513773 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-4407207a-8fae-441a-8983-527fe584c3ee tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:28.515628 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-4407207a-8fae-441a-8983-527fe584c3ee tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:28.517585 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-4407207a-8fae-441a-8983-527fe584c3ee tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22" status: 200 len: 1739 microversion: 2.20 time: 0.306099 Aug 27 03:09:28.519188 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2570/5091] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:09:28 2022] GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22 => generated 1739 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:09:29.544585 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ed996631-ef32-420b-b31c-cb4cf754b065 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:29.545182 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-ed996631-ef32-420b-b31c-cb4cf754b065 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:29.581126 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ed996631-ef32-420b-b31c-cb4cf754b065 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:29.582944 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ed996631-ef32-420b-b31c-cb4cf754b065 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:29.584078 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ed996631-ef32-420b-b31c-cb4cf754b065 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:29.585045 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ed996631-ef32-420b-b31c-cb4cf754b065 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:29.585620 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ed996631-ef32-420b-b31c-cb4cf754b065 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:29.587498 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ed996631-ef32-420b-b31c-cb4cf754b065 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:30.018127 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-ed996631-ef32-420b-b31c-cb4cf754b065 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:30.035986 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-ed996631-ef32-420b-b31c-cb4cf754b065 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:30.037813 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-ed996631-ef32-420b-b31c-cb4cf754b065 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:30.039273 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ed996631-ef32-420b-b31c-cb4cf754b065 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22" status: 200 len: 1739 microversion: 2.20 time: 0.498796 Aug 27 03:09:30.052036 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2522/5092] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:09:29 2022] GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22 => generated 1739 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:09:31.075535 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3ae897fb-5706-4857-b572-f378ecdd050c tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:31.076330 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-3ae897fb-5706-4857-b572-f378ecdd050c tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:31.101498 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3ae897fb-5706-4857-b572-f378ecdd050c tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:31.104329 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3ae897fb-5706-4857-b572-f378ecdd050c tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:31.107421 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3ae897fb-5706-4857-b572-f378ecdd050c tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:31.111961 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3ae897fb-5706-4857-b572-f378ecdd050c tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:31.117459 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3ae897fb-5706-4857-b572-f378ecdd050c tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:31.121626 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3ae897fb-5706-4857-b572-f378ecdd050c tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:31.596087 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-3ae897fb-5706-4857-b572-f378ecdd050c tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:31.622149 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-3ae897fb-5706-4857-b572-f378ecdd050c tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:31.628262 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-3ae897fb-5706-4857-b572-f378ecdd050c tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:31.636157 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-3ae897fb-5706-4857-b572-f378ecdd050c tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22" status: 200 len: 1739 microversion: 2.20 time: 0.565174 Aug 27 03:09:31.642682 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2571/5093] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:09:31 2022] GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22 => generated 1739 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:09:32.665905 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d9515b68-bc28-49af-bddd-f50da40ddc11 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:32.666604 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d9515b68-bc28-49af-bddd-f50da40ddc11 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:32.684843 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d9515b68-bc28-49af-bddd-f50da40ddc11 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:32.685361 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d9515b68-bc28-49af-bddd-f50da40ddc11 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:32.691036 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d9515b68-bc28-49af-bddd-f50da40ddc11 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:32.691807 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d9515b68-bc28-49af-bddd-f50da40ddc11 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:32.692267 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d9515b68-bc28-49af-bddd-f50da40ddc11 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:32.697909 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d9515b68-bc28-49af-bddd-f50da40ddc11 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:33.230513 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-d9515b68-bc28-49af-bddd-f50da40ddc11 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:33.241384 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-d9515b68-bc28-49af-bddd-f50da40ddc11 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:33.246555 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-d9515b68-bc28-49af-bddd-f50da40ddc11 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:33.253642 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d9515b68-bc28-49af-bddd-f50da40ddc11 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22" status: 200 len: 1739 microversion: 2.20 time: 0.593433 Aug 27 03:09:33.254267 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2523/5094] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:09:32 2022] GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22 => generated 1739 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:09:34.308113 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f93c5e53-9559-49d4-b0cb-5cb1089205ae tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:34.309380 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-f93c5e53-9559-49d4-b0cb-5cb1089205ae tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:34.337157 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f93c5e53-9559-49d4-b0cb-5cb1089205ae tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:34.342012 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f93c5e53-9559-49d4-b0cb-5cb1089205ae tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:34.361144 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f93c5e53-9559-49d4-b0cb-5cb1089205ae tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:34.362122 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f93c5e53-9559-49d4-b0cb-5cb1089205ae tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:34.362756 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f93c5e53-9559-49d4-b0cb-5cb1089205ae tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:34.363364 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f93c5e53-9559-49d4-b0cb-5cb1089205ae tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:34.957453 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-f93c5e53-9559-49d4-b0cb-5cb1089205ae tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:34.971024 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-f93c5e53-9559-49d4-b0cb-5cb1089205ae tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:34.974468 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-f93c5e53-9559-49d4-b0cb-5cb1089205ae tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:34.977113 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-f93c5e53-9559-49d4-b0cb-5cb1089205ae tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22" status: 200 len: 1739 microversion: 2.20 time: 0.685971 Aug 27 03:09:34.978788 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2572/5095] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:09:34 2022] GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22 => generated 1739 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:09:36.002024 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-71cf18ea-2857-4840-ac12-883ac8c3cf50 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:36.005461 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-71cf18ea-2857-4840-ac12-883ac8c3cf50 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:36.038028 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-71cf18ea-2857-4840-ac12-883ac8c3cf50 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:36.038637 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-71cf18ea-2857-4840-ac12-883ac8c3cf50 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:36.039099 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-71cf18ea-2857-4840-ac12-883ac8c3cf50 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:36.039887 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-71cf18ea-2857-4840-ac12-883ac8c3cf50 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:36.040341 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-71cf18ea-2857-4840-ac12-883ac8c3cf50 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:36.040794 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-71cf18ea-2857-4840-ac12-883ac8c3cf50 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:36.674870 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-71cf18ea-2857-4840-ac12-883ac8c3cf50 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:36.689954 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-71cf18ea-2857-4840-ac12-883ac8c3cf50 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:36.697209 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-71cf18ea-2857-4840-ac12-883ac8c3cf50 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:36.698803 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-71cf18ea-2857-4840-ac12-883ac8c3cf50 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22" status: 200 len: 1721 microversion: 2.20 time: 0.701234 Aug 27 03:09:36.702183 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2524/5096] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:09:35 2022] GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22 => generated 1721 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:09:37.721932 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-56394ee6-1dbe-4608-a440-14314522f960 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:37.722544 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-56394ee6-1dbe-4608-a440-14314522f960 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:37.735803 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-56394ee6-1dbe-4608-a440-14314522f960 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:37.736611 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-56394ee6-1dbe-4608-a440-14314522f960 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:37.737197 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-56394ee6-1dbe-4608-a440-14314522f960 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:37.738056 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-56394ee6-1dbe-4608-a440-14314522f960 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:37.738653 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-56394ee6-1dbe-4608-a440-14314522f960 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:37.740126 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-56394ee6-1dbe-4608-a440-14314522f960 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:37.982942 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8bdcfb99-4b8d-420c-95c6-b3036ba551b5 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:37.985314 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-8bdcfb99-4b8d-420c-95c6-b3036ba551b5 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 28d2e08f-ea2f-42f2-beb5-bfdc368b9014] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:38.003803 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8bdcfb99-4b8d-420c-95c6-b3036ba551b5 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:38.011097 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8bdcfb99-4b8d-420c-95c6-b3036ba551b5 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:38.012919 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8bdcfb99-4b8d-420c-95c6-b3036ba551b5 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:38.018969 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8bdcfb99-4b8d-420c-95c6-b3036ba551b5 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:38.020613 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8bdcfb99-4b8d-420c-95c6-b3036ba551b5 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:38.023424 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8bdcfb99-4b8d-420c-95c6-b3036ba551b5 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:38.068453 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-8bdcfb99-4b8d-420c-95c6-b3036ba551b5 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "GET /compute/v2.1/servers/28d2e08f-ea2f-42f2-beb5-bfdc368b9014/ips" status: 200 len: 150 microversion: 2.1 time: 0.091024 Aug 27 03:09:38.076610 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2525/5097] 10.222.0.70 () {58 vars in 1248 bytes} [Sat Aug 27 03:09:37 2022] GET /compute/v2.1/servers/28d2e08f-ea2f-42f2-beb5-bfdc368b9014/ips => generated 150 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:09:38.386015 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-56394ee6-1dbe-4608-a440-14314522f960 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:38.456857 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-56394ee6-1dbe-4608-a440-14314522f960 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:38.470422 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-56394ee6-1dbe-4608-a440-14314522f960 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:38.485686 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-56394ee6-1dbe-4608-a440-14314522f960 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22" status: 200 len: 1721 microversion: 2.20 time: 0.755164 Aug 27 03:09:38.489944 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2573/5098] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:09:37 2022] GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22 => generated 1721 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:09:39.517803 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6f402511-38be-49fc-bee4-0c15f93a7d03 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:39.518257 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-6f402511-38be-49fc-bee4-0c15f93a7d03 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:39.532605 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6f402511-38be-49fc-bee4-0c15f93a7d03 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:39.533013 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6f402511-38be-49fc-bee4-0c15f93a7d03 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:39.533449 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6f402511-38be-49fc-bee4-0c15f93a7d03 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:39.538781 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6f402511-38be-49fc-bee4-0c15f93a7d03 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:39.539333 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6f402511-38be-49fc-bee4-0c15f93a7d03 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:39.539779 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6f402511-38be-49fc-bee4-0c15f93a7d03 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:39.567589 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-ca1df36e-b6b3-4c0c-8c13-5260f9ecb812 req-fcdbff48-96d5-4624-8e10-9a951efa29d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73ee7f75-b081-4f5c-90b0-e0d1b27b9a22", "name": "network-vif-unplugged", "status": "completed", "tag": "130f85a4-751a-4a52-92c2-d7a99bb65d41"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:09:39.590475 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-ca1df36e-b6b3-4c0c-8c13-5260f9ecb812 req-fcdbff48-96d5-4624-8e10-9a951efa29d7 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:39.591323 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-ca1df36e-b6b3-4c0c-8c13-5260f9ecb812 req-fcdbff48-96d5-4624-8e10-9a951efa29d7 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:39.592798 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-ca1df36e-b6b3-4c0c-8c13-5260f9ecb812 req-fcdbff48-96d5-4624-8e10-9a951efa29d7 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:39.622789 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.compute.server_external_events [req-ca1df36e-b6b3-4c0c-8c13-5260f9ecb812 req-fcdbff48-96d5-4624-8e10-9a951efa29d7 service nova] Unable to find a host for instance 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22. Dropping event network-vif-unplugged {{(pid=134051) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 27 03:09:39.624047 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-ca1df36e-b6b3-4c0c-8c13-5260f9ecb812 req-fcdbff48-96d5-4624-8e10-9a951efa29d7 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.060730 Aug 27 03:09:39.625600 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2574/5099] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:09:39 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 62 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 27 03:09:39.887979 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-6f402511-38be-49fc-bee4-0c15f93a7d03 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:39.899689 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-6f402511-38be-49fc-bee4-0c15f93a7d03 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:39.910907 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-6f402511-38be-49fc-bee4-0c15f93a7d03 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:39.915078 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-6f402511-38be-49fc-bee4-0c15f93a7d03 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22" status: 200 len: 1664 microversion: 2.20 time: 0.401931 Aug 27 03:09:39.918372 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2526/5100] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:09:39 2022] GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22 => generated 1664 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:09:39.944877 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-67f60ec6-b22e-4842-a26b-3f7322fadd35 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d985901a-c523-4a09-8411-9d19c7fd904d"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:09:39.948558 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-67f60ec6-b22e-4842-a26b-3f7322fadd35 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:39.962118 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-67f60ec6-b22e-4842-a26b-3f7322fadd35 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:39.962581 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-67f60ec6-b22e-4842-a26b-3f7322fadd35 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:39.963021 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-67f60ec6-b22e-4842-a26b-3f7322fadd35 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:39.963735 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-67f60ec6-b22e-4842-a26b-3f7322fadd35 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:39.964186 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-67f60ec6-b22e-4842-a26b-3f7322fadd35 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:39.977746 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-67f60ec6-b22e-4842-a26b-3f7322fadd35 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:40.632834 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-67f60ec6-b22e-4842-a26b-3f7322fadd35 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "POST /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.691940 Aug 27 03:09:40.636349 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2575/5101] 10.222.0.70 () {62 vars in 1364 bytes} [Sat Aug 27 03:09:39 2022] POST /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22/os-volume_attachments => generated 188 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:09:40.813542 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-95139498-95b0-4f35-8fa0-a7bb9979082d tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:09:40.814839 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-95139498-95b0-4f35-8fa0-a7bb9979082d tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:40.826917 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-95139498-95b0-4f35-8fa0-a7bb9979082d tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:40.827714 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-95139498-95b0-4f35-8fa0-a7bb9979082d tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:40.828345 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-95139498-95b0-4f35-8fa0-a7bb9979082d tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:40.829320 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-95139498-95b0-4f35-8fa0-a7bb9979082d tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:40.830248 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-95139498-95b0-4f35-8fa0-a7bb9979082d tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:40.830863 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-95139498-95b0-4f35-8fa0-a7bb9979082d tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:40.971468 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-70bfc903-7a7f-4cee-9806-120a85d0f8c5 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7737120c-3e21-4aa7-bcde-628dd680682a"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:09:40.974220 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-70bfc903-7a7f-4cee-9806-120a85d0f8c5 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 28d2e08f-ea2f-42f2-beb5-bfdc368b9014] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:40.990616 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-95139498-95b0-4f35-8fa0-a7bb9979082d tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=134052) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 27 03:09:40.998582 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-70bfc903-7a7f-4cee-9806-120a85d0f8c5 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:41.009110 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-70bfc903-7a7f-4cee-9806-120a85d0f8c5 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:41.010062 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-70bfc903-7a7f-4cee-9806-120a85d0f8c5 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:41.011599 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-70bfc903-7a7f-4cee-9806-120a85d0f8c5 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:41.012167 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-70bfc903-7a7f-4cee-9806-120a85d0f8c5 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:41.012719 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-70bfc903-7a7f-4cee-9806-120a85d0f8c5 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:41.149312 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-95139498-95b0-4f35-8fa0-a7bb9979082d tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "POST /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22/action" status: 202 len: 0 microversion: 2.20 time: 0.339714 Aug 27 03:09:41.158236 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2527/5102] 10.222.0.70 () {62 vars in 1319 bytes} [Sat Aug 27 03:09:40 2022] POST /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22/action => generated 0 bytes in 349 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:09:41.166214 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-43c039ae-c7e4-447f-9d94-0ce826f61e56 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:41.166819 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-43c039ae-c7e4-447f-9d94-0ce826f61e56 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:41.205507 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-43c039ae-c7e4-447f-9d94-0ce826f61e56 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:41.205993 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-43c039ae-c7e4-447f-9d94-0ce826f61e56 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:41.206417 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-43c039ae-c7e4-447f-9d94-0ce826f61e56 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:41.209846 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-43c039ae-c7e4-447f-9d94-0ce826f61e56 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:41.210562 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-43c039ae-c7e4-447f-9d94-0ce826f61e56 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:41.211143 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-43c039ae-c7e4-447f-9d94-0ce826f61e56 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:41.540201 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-70bfc903-7a7f-4cee-9806-120a85d0f8c5 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "POST /compute/v2.1/servers/28d2e08f-ea2f-42f2-beb5-bfdc368b9014/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.573784 Aug 27 03:09:41.547930 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2576/5103] 10.222.0.70 () {60 vars in 1323 bytes} [Sat Aug 27 03:09:40 2022] POST /compute/v2.1/servers/28d2e08f-ea2f-42f2-beb5-bfdc368b9014/os-volume_attachments => generated 194 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:09:41.904271 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-43c039ae-c7e4-447f-9d94-0ce826f61e56 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:41.914615 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-43c039ae-c7e4-447f-9d94-0ce826f61e56 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:41.926966 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-43c039ae-c7e4-447f-9d94-0ce826f61e56 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:41.933571 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-43c039ae-c7e4-447f-9d94-0ce826f61e56 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22" status: 200 len: 1750 microversion: 2.20 time: 0.770374 Aug 27 03:09:41.944370 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2528/5104] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:09:41 2022] GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22 => generated 1750 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:09:42.963780 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8126436f-2427-4817-8829-2fde38f25049 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:42.964602 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-8126436f-2427-4817-8829-2fde38f25049 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:42.966647 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=26 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:09:42.991050 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8126436f-2427-4817-8829-2fde38f25049 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:42.995055 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8126436f-2427-4817-8829-2fde38f25049 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:42.996936 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8126436f-2427-4817-8829-2fde38f25049 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:42.998380 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8126436f-2427-4817-8829-2fde38f25049 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:43.004786 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8126436f-2427-4817-8829-2fde38f25049 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:43.005525 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8126436f-2427-4817-8829-2fde38f25049 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:43.042180 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=84,nova_cell1:INSERT=4,nova_cell1:UPDATE=6 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:09:43.861972 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-8126436f-2427-4817-8829-2fde38f25049 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:43.871684 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-8126436f-2427-4817-8829-2fde38f25049 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:43.873162 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-8126436f-2427-4817-8829-2fde38f25049 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:43.874337 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-8126436f-2427-4817-8829-2fde38f25049 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22" status: 200 len: 1750 microversion: 2.20 time: 0.918855 Aug 27 03:09:43.882985 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2577/5105] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:09:42 2022] GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22 => generated 1750 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:09:44.897800 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-64879a32-cd5b-44f4-ae61-872924ee9c79 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:44.898418 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-64879a32-cd5b-44f4-ae61-872924ee9c79 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:44.905678 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-64879a32-cd5b-44f4-ae61-872924ee9c79 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:44.917121 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-64879a32-cd5b-44f4-ae61-872924ee9c79 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:44.917701 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-64879a32-cd5b-44f4-ae61-872924ee9c79 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:44.937301 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-64879a32-cd5b-44f4-ae61-872924ee9c79 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:44.937955 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-64879a32-cd5b-44f4-ae61-872924ee9c79 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:44.938370 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-64879a32-cd5b-44f4-ae61-872924ee9c79 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:45.273717 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-64879a32-cd5b-44f4-ae61-872924ee9c79 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:45.288747 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-64879a32-cd5b-44f4-ae61-872924ee9c79 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:45.290525 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-64879a32-cd5b-44f4-ae61-872924ee9c79 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:45.295566 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-64879a32-cd5b-44f4-ae61-872924ee9c79 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22" status: 200 len: 1752 microversion: 2.20 time: 0.402063 Aug 27 03:09:45.296177 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2529/5106] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:09:44 2022] GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22 => generated 1752 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:09:46.323956 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-de67e162-b3df-4a53-8bf1-0b1cebad0d9f tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:46.323956 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-de67e162-b3df-4a53-8bf1-0b1cebad0d9f tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:46.332356 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-de67e162-b3df-4a53-8bf1-0b1cebad0d9f tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:46.332862 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-de67e162-b3df-4a53-8bf1-0b1cebad0d9f tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:46.333305 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-de67e162-b3df-4a53-8bf1-0b1cebad0d9f tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:46.334048 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-de67e162-b3df-4a53-8bf1-0b1cebad0d9f tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:46.334470 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-de67e162-b3df-4a53-8bf1-0b1cebad0d9f tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:46.334909 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-de67e162-b3df-4a53-8bf1-0b1cebad0d9f tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:46.690382 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-de67e162-b3df-4a53-8bf1-0b1cebad0d9f tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:46.713386 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-de67e162-b3df-4a53-8bf1-0b1cebad0d9f tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:46.715633 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-de67e162-b3df-4a53-8bf1-0b1cebad0d9f tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:46.717862 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-de67e162-b3df-4a53-8bf1-0b1cebad0d9f tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22" status: 200 len: 1752 microversion: 2.20 time: 0.402719 Aug 27 03:09:46.719015 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2578/5107] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:09:46 2022] GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22 => generated 1752 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:09:47.740150 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0246315c-07d0-49c2-9149-ee8aa49e1f33 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:47.740793 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-0246315c-07d0-49c2-9149-ee8aa49e1f33 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:47.745054 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:09:47.794445 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0246315c-07d0-49c2-9149-ee8aa49e1f33 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:47.796936 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0246315c-07d0-49c2-9149-ee8aa49e1f33 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:47.798366 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0246315c-07d0-49c2-9149-ee8aa49e1f33 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:47.799285 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0246315c-07d0-49c2-9149-ee8aa49e1f33 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:47.802330 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0246315c-07d0-49c2-9149-ee8aa49e1f33 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:47.802979 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0246315c-07d0-49c2-9149-ee8aa49e1f33 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:47.819415 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:09:48.002037 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0246315c-07d0-49c2-9149-ee8aa49e1f33 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:48.012454 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0246315c-07d0-49c2-9149-ee8aa49e1f33 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:48.016272 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0246315c-07d0-49c2-9149-ee8aa49e1f33 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:48.017774 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-0246315c-07d0-49c2-9149-ee8aa49e1f33 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22" status: 200 len: 1752 microversion: 2.20 time: 0.281577 Aug 27 03:09:48.019041 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2530/5108] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:09:47 2022] GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22 => generated 1752 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:09:49.042218 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f32330e3-efff-4286-89ee-61ba07d6fd1f tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:49.042891 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-f32330e3-efff-4286-89ee-61ba07d6fd1f tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:49.053885 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f32330e3-efff-4286-89ee-61ba07d6fd1f tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:49.054374 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f32330e3-efff-4286-89ee-61ba07d6fd1f tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:49.054808 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f32330e3-efff-4286-89ee-61ba07d6fd1f tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:49.055509 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f32330e3-efff-4286-89ee-61ba07d6fd1f tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:49.055952 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f32330e3-efff-4286-89ee-61ba07d6fd1f tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:49.056408 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f32330e3-efff-4286-89ee-61ba07d6fd1f tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:49.729335 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-f32330e3-efff-4286-89ee-61ba07d6fd1f tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:49.743419 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-f32330e3-efff-4286-89ee-61ba07d6fd1f tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:49.745478 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-f32330e3-efff-4286-89ee-61ba07d6fd1f tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:49.746952 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-f32330e3-efff-4286-89ee-61ba07d6fd1f tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22" status: 200 len: 1752 microversion: 2.20 time: 0.709197 Aug 27 03:09:49.747776 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2579/5109] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:09:49 2022] GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22 => generated 1752 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:09:50.773916 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d3b82e86-1626-40ce-a580-2c39b8aa0909 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:50.775522 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d3b82e86-1626-40ce-a580-2c39b8aa0909 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:50.785987 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d3b82e86-1626-40ce-a580-2c39b8aa0909 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:50.786851 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d3b82e86-1626-40ce-a580-2c39b8aa0909 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:50.787499 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d3b82e86-1626-40ce-a580-2c39b8aa0909 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:50.788950 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d3b82e86-1626-40ce-a580-2c39b8aa0909 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:50.789926 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d3b82e86-1626-40ce-a580-2c39b8aa0909 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:50.790869 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d3b82e86-1626-40ce-a580-2c39b8aa0909 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:51.052258 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-d3b82e86-1626-40ce-a580-2c39b8aa0909 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:51.073339 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-d3b82e86-1626-40ce-a580-2c39b8aa0909 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:51.076232 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-d3b82e86-1626-40ce-a580-2c39b8aa0909 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:51.077855 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d3b82e86-1626-40ce-a580-2c39b8aa0909 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22" status: 200 len: 1752 microversion: 2.20 time: 0.309812 Aug 27 03:09:51.079550 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2531/5110] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:09:50 2022] GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22 => generated 1752 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:09:52.110660 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-11ac8591-e73b-46ac-8272-52ba40938fa3 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:52.112083 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-11ac8591-e73b-46ac-8272-52ba40938fa3 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:52.120730 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-11ac8591-e73b-46ac-8272-52ba40938fa3 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:52.121444 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-11ac8591-e73b-46ac-8272-52ba40938fa3 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:52.122069 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-11ac8591-e73b-46ac-8272-52ba40938fa3 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:52.123002 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-11ac8591-e73b-46ac-8272-52ba40938fa3 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:52.123625 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-11ac8591-e73b-46ac-8272-52ba40938fa3 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:52.124269 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-11ac8591-e73b-46ac-8272-52ba40938fa3 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:52.394798 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-11ac8591-e73b-46ac-8272-52ba40938fa3 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:52.405358 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-11ac8591-e73b-46ac-8272-52ba40938fa3 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:52.406844 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-11ac8591-e73b-46ac-8272-52ba40938fa3 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:52.408326 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-11ac8591-e73b-46ac-8272-52ba40938fa3 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22" status: 200 len: 1752 microversion: 2.20 time: 0.302374 Aug 27 03:09:52.409311 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2580/5111] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:09:52 2022] GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22 => generated 1752 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:09:53.432253 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b3a2979f-9af0-4305-9e02-0ba18c2fcb69 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:53.433674 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b3a2979f-9af0-4305-9e02-0ba18c2fcb69 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:53.441708 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b3a2979f-9af0-4305-9e02-0ba18c2fcb69 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:53.442592 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b3a2979f-9af0-4305-9e02-0ba18c2fcb69 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:53.443264 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b3a2979f-9af0-4305-9e02-0ba18c2fcb69 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:53.444205 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b3a2979f-9af0-4305-9e02-0ba18c2fcb69 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:53.444898 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b3a2979f-9af0-4305-9e02-0ba18c2fcb69 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:53.445551 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b3a2979f-9af0-4305-9e02-0ba18c2fcb69 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:53.847740 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b3a2979f-9af0-4305-9e02-0ba18c2fcb69 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:53.860425 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b3a2979f-9af0-4305-9e02-0ba18c2fcb69 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:53.861873 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b3a2979f-9af0-4305-9e02-0ba18c2fcb69 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:53.863067 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b3a2979f-9af0-4305-9e02-0ba18c2fcb69 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22" status: 200 len: 1752 microversion: 2.20 time: 0.435850 Aug 27 03:09:53.876334 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2532/5112] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:09:53 2022] GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22 => generated 1752 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:09:54.886433 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e570e05a-ea42-4b57-b669-ba8d9653a481 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:54.887047 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-e570e05a-ea42-4b57-b669-ba8d9653a481 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:54.903458 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e570e05a-ea42-4b57-b669-ba8d9653a481 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:54.903964 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e570e05a-ea42-4b57-b669-ba8d9653a481 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:54.904435 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e570e05a-ea42-4b57-b669-ba8d9653a481 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:54.909637 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e570e05a-ea42-4b57-b669-ba8d9653a481 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:54.910367 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e570e05a-ea42-4b57-b669-ba8d9653a481 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:54.911401 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e570e05a-ea42-4b57-b669-ba8d9653a481 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:55.219842 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e570e05a-ea42-4b57-b669-ba8d9653a481 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:55.242885 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e570e05a-ea42-4b57-b669-ba8d9653a481 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:55.246651 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e570e05a-ea42-4b57-b669-ba8d9653a481 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:55.249848 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e570e05a-ea42-4b57-b669-ba8d9653a481 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22" status: 200 len: 1752 microversion: 2.20 time: 0.367172 Aug 27 03:09:55.251074 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2581/5113] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:09:54 2022] GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22 => generated 1752 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:09:56.280227 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b5af47b7-2d86-449c-8b9d-6272199b78c8 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:56.281023 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b5af47b7-2d86-449c-8b9d-6272199b78c8 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:56.298743 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b5af47b7-2d86-449c-8b9d-6272199b78c8 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:56.300351 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b5af47b7-2d86-449c-8b9d-6272199b78c8 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:56.301040 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b5af47b7-2d86-449c-8b9d-6272199b78c8 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:56.302589 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b5af47b7-2d86-449c-8b9d-6272199b78c8 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:56.303490 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b5af47b7-2d86-449c-8b9d-6272199b78c8 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:56.304518 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b5af47b7-2d86-449c-8b9d-6272199b78c8 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:56.621152 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b5af47b7-2d86-449c-8b9d-6272199b78c8 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:56.641532 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b5af47b7-2d86-449c-8b9d-6272199b78c8 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:56.643225 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b5af47b7-2d86-449c-8b9d-6272199b78c8 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:56.644591 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b5af47b7-2d86-449c-8b9d-6272199b78c8 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22" status: 200 len: 1808 microversion: 2.20 time: 0.371219 Aug 27 03:09:56.645577 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2533/5114] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:09:56 2022] GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22 => generated 1808 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:09:57.669929 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-5918a01c-e419-4c41-b766-139db622ffd1 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:57.672726 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-5918a01c-e419-4c41-b766-139db622ffd1 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:57.684347 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5918a01c-e419-4c41-b766-139db622ffd1 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:57.684842 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5918a01c-e419-4c41-b766-139db622ffd1 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:57.685284 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5918a01c-e419-4c41-b766-139db622ffd1 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:57.686001 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5918a01c-e419-4c41-b766-139db622ffd1 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:57.686453 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5918a01c-e419-4c41-b766-139db622ffd1 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:57.689357 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5918a01c-e419-4c41-b766-139db622ffd1 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:58.242306 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d998e2ec-8333-45ae-9513-470ab2fc98c5 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Action: 'create', calling method: .version_select at 0x7f5ee2438d30>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-1473935662", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAj6iXHoPmHqXqy+ZvogtBRrovbDS0MUuYS25fW93nqdfZIHVrf/BHEXtmO7mp5ggYcaaCUu89uM/4jnLcENqudp46i3454xiSxvZsiZ3LLX4VYjxxoGahPR41oH3HxIKg=="}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:09:58.265383 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-d998e2ec-8333-45ae-9513-470ab2fc98c5 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Getting quotas for project 971ec7583d924ac3981bc789db78a733. Resources: {'key_pairs'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:09:58.274086 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-d998e2ec-8333-45ae-9513-470ab2fc98c5 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Getting quotas for user 355b96770f7e4f338ef21fc49c8de54d and project 971ec7583d924ac3981bc789db78a733. Resources: {'key_pairs'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:09:58.312262 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d998e2ec-8333-45ae-9513-470ab2fc98c5 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.074499 Aug 27 03:09:58.314213 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2534/5115] 10.222.0.70 () {60 vars in 1159 bytes} [Sat Aug 27 03:09:58 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:10:00.423089 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-5918a01c-e419-4c41-b766-139db622ffd1 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:00.452835 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-5918a01c-e419-4c41-b766-139db622ffd1 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:00.463376 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-5918a01c-e419-4c41-b766-139db622ffd1 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:00.467239 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-5918a01c-e419-4c41-b766-139db622ffd1 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22" status: 200 len: 1808 microversion: 2.20 time: 2.803349 Aug 27 03:10:00.481155 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2582/5116] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:09:57 2022] GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22 => generated 1808 bytes in 2816 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:10:01.072418 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-25dc4c52-30e5-4819-ab0e-baf24b6f75df tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-1933080861", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "7334809f-be8f-497a-b37d-8c7d1b45e5a5", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-1473935662", "security_groups": [{"name": "tempest-secgroup-smoke-1267810048"}], "networks": [{"uuid": "c8836233-7ac5-45e2-8da6-869c080e241f"}]}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:10:01.467044 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.network.neutron [None req-25dc4c52-30e5-4819-ab0e-baf24b6f75df tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] validate_networks() for [('c8836233-7ac5-45e2-8da6-869c080e241f', None, None, None, None, None)] {{(pid=134052) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:10:01.495757 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c90efc70-cc42-48db-9f03-8904c9276d49 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:01.497157 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-c90efc70-cc42-48db-9f03-8904c9276d49 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:01.517822 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c90efc70-cc42-48db-9f03-8904c9276d49 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:01.519371 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c90efc70-cc42-48db-9f03-8904c9276d49 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:01.520531 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c90efc70-cc42-48db-9f03-8904c9276d49 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:01.521917 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c90efc70-cc42-48db-9f03-8904c9276d49 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:01.522818 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c90efc70-cc42-48db-9f03-8904c9276d49 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:01.525673 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c90efc70-cc42-48db-9f03-8904c9276d49 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:02.010926 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-c90efc70-cc42-48db-9f03-8904c9276d49 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:02.036630 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-c90efc70-cc42-48db-9f03-8904c9276d49 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:02.055039 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-c90efc70-cc42-48db-9f03-8904c9276d49 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:02.061415 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c90efc70-cc42-48db-9f03-8904c9276d49 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22" status: 200 len: 1808 microversion: 2.20 time: 0.571041 Aug 27 03:10:02.088346 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2583/5117] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:10:01 2022] GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22 => generated 1808 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:10:02.676017 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-25dc4c52-30e5-4819-ab0e-baf24b6f75df tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Flavor limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:10:02.676509 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-25dc4c52-30e5-4819-ab0e-baf24b6f75df tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Image limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:10:02.677009 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-25dc4c52-30e5-4819-ab0e-baf24b6f75df tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Flavor pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:10:02.677420 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-25dc4c52-30e5-4819-ab0e-baf24b6f75df tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Image pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:10:02.677832 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-25dc4c52-30e5-4819-ab0e-baf24b6f75df tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:10:02.693559 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-25dc4c52-30e5-4819-ab0e-baf24b6f75df tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:02.694044 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-25dc4c52-30e5-4819-ab0e-baf24b6f75df tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:02.697972 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-25dc4c52-30e5-4819-ab0e-baf24b6f75df tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:02.699700 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-25dc4c52-30e5-4819-ab0e-baf24b6f75df tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:02.701947 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-25dc4c52-30e5-4819-ab0e-baf24b6f75df tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:02.703074 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-25dc4c52-30e5-4819-ab0e-baf24b6f75df tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:02.749658 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-25dc4c52-30e5-4819-ab0e-baf24b6f75df tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Getting quotas for project 971ec7583d924ac3981bc789db78a733. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:10:02.756476 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-25dc4c52-30e5-4819-ab0e-baf24b6f75df tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Getting quotas for user 355b96770f7e4f338ef21fc49c8de54d and project 971ec7583d924ac3981bc789db78a733. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:10:02.852125 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-25dc4c52-30e5-4819-ab0e-baf24b6f75df tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Going to run 1 instances... {{(pid=134052) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:10:02.856426 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-25dc4c52-30e5-4819-ab0e-baf24b6f75df tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] [instance: e3b6b87a-f60c-4bda-8591-0c387e31bb4f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7334809f-be8f-497a-b37d-8c7d1b45e5a5',volume_size=None,volume_type=None)] {{(pid=134052) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:10:03.103381 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-6dae6fd6-8dd6-420c-b956-b51cdd673c99 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:03.104607 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-6dae6fd6-8dd6-420c-b956-b51cdd673c99 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:03.114818 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6dae6fd6-8dd6-420c-b956-b51cdd673c99 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:03.117889 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6dae6fd6-8dd6-420c-b956-b51cdd673c99 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:03.120290 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6dae6fd6-8dd6-420c-b956-b51cdd673c99 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:03.123233 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6dae6fd6-8dd6-420c-b956-b51cdd673c99 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:03.124637 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6dae6fd6-8dd6-420c-b956-b51cdd673c99 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:03.127180 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6dae6fd6-8dd6-420c-b956-b51cdd673c99 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:03.163390 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-25dc4c52-30e5-4819-ab0e-baf24b6f75df tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.096493 Aug 27 03:10:03.164114 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2535/5118] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 03:10:01 2022] POST /compute/v2.1/servers => generated 406 bytes in 2099 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:10:03.188020 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b9b2d3b3-1d4f-45ff-937f-6acc78a78f88 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:03.188890 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b9b2d3b3-1d4f-45ff-937f-6acc78a78f88 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] [instance: e3b6b87a-f60c-4bda-8591-0c387e31bb4f] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:03.406430 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b9b2d3b3-1d4f-45ff-937f-6acc78a78f88 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '355b96770f7e4f338ef21fc49c8de54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971ec7583d924ac3981bc789db78a733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:03.413929 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b9b2d3b3-1d4f-45ff-937f-6acc78a78f88 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] 10.222.0.70 "GET /compute/v2.1/servers/e3b6b87a-f60c-4bda-8591-0c387e31bb4f" status: 200 len: 1099 microversion: 2.1 time: 0.241424 Aug 27 03:10:03.420052 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2536/5119] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:03 2022] GET /compute/v2.1/servers/e3b6b87a-f60c-4bda-8591-0c387e31bb4f => generated 1099 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:03.542551 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-6dae6fd6-8dd6-420c-b956-b51cdd673c99 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:03.553342 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-6dae6fd6-8dd6-420c-b956-b51cdd673c99 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:03.554832 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-6dae6fd6-8dd6-420c-b956-b51cdd673c99 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:03.560801 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-6dae6fd6-8dd6-420c-b956-b51cdd673c99 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22" status: 200 len: 1808 microversion: 2.20 time: 0.461326 Aug 27 03:10:03.565595 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2584/5120] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:10:03 2022] GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22 => generated 1808 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:10:04.436207 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-2d736a29-6d6c-4100-a8d1-cb219359dde8 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:04.437745 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-2d736a29-6d6c-4100-a8d1-cb219359dde8 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] [instance: e3b6b87a-f60c-4bda-8591-0c387e31bb4f] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:04.447537 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2d736a29-6d6c-4100-a8d1-cb219359dde8 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:04.448215 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2d736a29-6d6c-4100-a8d1-cb219359dde8 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:04.449189 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2d736a29-6d6c-4100-a8d1-cb219359dde8 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:04.450259 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2d736a29-6d6c-4100-a8d1-cb219359dde8 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:04.450970 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2d736a29-6d6c-4100-a8d1-cb219359dde8 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:04.451609 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2d736a29-6d6c-4100-a8d1-cb219359dde8 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:04.572595 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-2d736a29-6d6c-4100-a8d1-cb219359dde8 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '355b96770f7e4f338ef21fc49c8de54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971ec7583d924ac3981bc789db78a733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:04.592062 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0eaddf7a-b3e0-49c3-911b-92c206b77960 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:04.592732 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-2d736a29-6d6c-4100-a8d1-cb219359dde8 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] 10.222.0.70 "GET /compute/v2.1/servers/e3b6b87a-f60c-4bda-8591-0c387e31bb4f" status: 200 len: 1149 microversion: 2.1 time: 0.158904 Aug 27 03:10:04.592870 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-0eaddf7a-b3e0-49c3-911b-92c206b77960 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:04.600827 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0eaddf7a-b3e0-49c3-911b-92c206b77960 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:04.601554 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0eaddf7a-b3e0-49c3-911b-92c206b77960 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:04.602160 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0eaddf7a-b3e0-49c3-911b-92c206b77960 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:04.603048 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0eaddf7a-b3e0-49c3-911b-92c206b77960 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:04.603654 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0eaddf7a-b3e0-49c3-911b-92c206b77960 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:04.604303 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0eaddf7a-b3e0-49c3-911b-92c206b77960 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:04.605045 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2537/5121] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:04 2022] GET /compute/v2.1/servers/e3b6b87a-f60c-4bda-8591-0c387e31bb4f => generated 1149 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:05.328696 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-0eaddf7a-b3e0-49c3-911b-92c206b77960 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:05.337903 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-0eaddf7a-b3e0-49c3-911b-92c206b77960 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:05.339376 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-0eaddf7a-b3e0-49c3-911b-92c206b77960 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:05.340901 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-0eaddf7a-b3e0-49c3-911b-92c206b77960 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22" status: 200 len: 1808 microversion: 2.20 time: 0.755061 Aug 27 03:10:05.341896 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2585/5122] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:10:04 2022] GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22 => generated 1808 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:10:05.618706 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b57428a1-beea-4bcd-a1e5-e35439402d26 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:05.619484 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b57428a1-beea-4bcd-a1e5-e35439402d26 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] [instance: e3b6b87a-f60c-4bda-8591-0c387e31bb4f] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:05.634113 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b57428a1-beea-4bcd-a1e5-e35439402d26 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:05.635630 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b57428a1-beea-4bcd-a1e5-e35439402d26 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:05.639242 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b57428a1-beea-4bcd-a1e5-e35439402d26 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:05.640218 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b57428a1-beea-4bcd-a1e5-e35439402d26 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:05.641124 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b57428a1-beea-4bcd-a1e5-e35439402d26 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:05.645691 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b57428a1-beea-4bcd-a1e5-e35439402d26 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:05.784714 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b57428a1-beea-4bcd-a1e5-e35439402d26 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '355b96770f7e4f338ef21fc49c8de54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971ec7583d924ac3981bc789db78a733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:05.805484 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b57428a1-beea-4bcd-a1e5-e35439402d26 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] 10.222.0.70 "GET /compute/v2.1/servers/e3b6b87a-f60c-4bda-8591-0c387e31bb4f" status: 200 len: 1141 microversion: 2.1 time: 0.189731 Aug 27 03:10:05.820647 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2538/5123] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:05 2022] GET /compute/v2.1/servers/e3b6b87a-f60c-4bda-8591-0c387e31bb4f => generated 1141 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:06.364710 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-828e41ba-0a5d-435d-8a24-1ea2b6ea3152 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:06.366051 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-828e41ba-0a5d-435d-8a24-1ea2b6ea3152 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:06.383795 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-828e41ba-0a5d-435d-8a24-1ea2b6ea3152 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:06.388674 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-828e41ba-0a5d-435d-8a24-1ea2b6ea3152 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:06.389110 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-828e41ba-0a5d-435d-8a24-1ea2b6ea3152 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:06.389957 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-828e41ba-0a5d-435d-8a24-1ea2b6ea3152 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:06.390431 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-828e41ba-0a5d-435d-8a24-1ea2b6ea3152 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:06.390890 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-828e41ba-0a5d-435d-8a24-1ea2b6ea3152 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:06.827294 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-7f6b45f0-e5a4-45c9-b96f-46dbf92d9b06 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:06.827910 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-7f6b45f0-e5a4-45c9-b96f-46dbf92d9b06 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] [instance: e3b6b87a-f60c-4bda-8591-0c387e31bb4f] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:06.856133 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7f6b45f0-e5a4-45c9-b96f-46dbf92d9b06 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:06.862198 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7f6b45f0-e5a4-45c9-b96f-46dbf92d9b06 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:06.862198 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7f6b45f0-e5a4-45c9-b96f-46dbf92d9b06 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:06.862198 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7f6b45f0-e5a4-45c9-b96f-46dbf92d9b06 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:06.868562 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7f6b45f0-e5a4-45c9-b96f-46dbf92d9b06 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:06.869084 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7f6b45f0-e5a4-45c9-b96f-46dbf92d9b06 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:07.070874 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-7f6b45f0-e5a4-45c9-b96f-46dbf92d9b06 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '355b96770f7e4f338ef21fc49c8de54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971ec7583d924ac3981bc789db78a733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:07.094365 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-7f6b45f0-e5a4-45c9-b96f-46dbf92d9b06 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] 10.222.0.70 "GET /compute/v2.1/servers/e3b6b87a-f60c-4bda-8591-0c387e31bb4f" status: 200 len: 1197 microversion: 2.1 time: 0.269445 Aug 27 03:10:07.096097 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2539/5124] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:06 2022] GET /compute/v2.1/servers/e3b6b87a-f60c-4bda-8591-0c387e31bb4f => generated 1197 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:07.204639 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-828e41ba-0a5d-435d-8a24-1ea2b6ea3152 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:07.224509 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-828e41ba-0a5d-435d-8a24-1ea2b6ea3152 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:07.233292 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-828e41ba-0a5d-435d-8a24-1ea2b6ea3152 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:07.235341 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-828e41ba-0a5d-435d-8a24-1ea2b6ea3152 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22" status: 200 len: 1808 microversion: 2.20 time: 0.874668 Aug 27 03:10:07.244244 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2586/5125] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:10:06 2022] GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22 => generated 1808 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:10:07.373005 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6868e543-d3fa-49c1-8c5d-46c0d856334f tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Action: 'create', calling method: .version_select at 0x7f5ee3091700>, body: {"keypair": {"name": "tempest-keypair-737449516", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGkiggJ6BSVezErdS64CJ28JZUG0Ce35eB07pZ5QfcMm5aIUHNVGjXnkbvh76fiIceT4mL+jtC6o4Ct000skZgKFofQBsQNU+vXHY9QdENYrZge+/rBeyW9Zo46nFEJ/QQ=="}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:10:07.410496 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-6868e543-d3fa-49c1-8c5d-46c0d856334f tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Getting quotas for project b92af206e05f44cf948b7c25d1acc139. Resources: {'key_pairs'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:10:07.417458 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-6868e543-d3fa-49c1-8c5d-46c0d856334f tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Getting quotas for user a549f85910184bf7a697cce7fa3dff96 and project b92af206e05f44cf948b7c25d1acc139. Resources: {'key_pairs'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:10:07.479373 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-6868e543-d3fa-49c1-8c5d-46c0d856334f tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.108972 Aug 27 03:10:07.481586 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2540/5126] 10.222.0.70 () {60 vars in 1159 bytes} [Sat Aug 27 03:10:07 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:10:08.123885 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-59821f68-6c62-45c6-8616-c2809ada227b tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:08.127802 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-59821f68-6c62-45c6-8616-c2809ada227b tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] [instance: e3b6b87a-f60c-4bda-8591-0c387e31bb4f] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:08.139346 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-59821f68-6c62-45c6-8616-c2809ada227b tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:08.145151 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-59821f68-6c62-45c6-8616-c2809ada227b tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:08.148665 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-59821f68-6c62-45c6-8616-c2809ada227b tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:08.150088 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-59821f68-6c62-45c6-8616-c2809ada227b tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:08.152191 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-59821f68-6c62-45c6-8616-c2809ada227b tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:08.153501 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-59821f68-6c62-45c6-8616-c2809ada227b tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:08.271748 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-51f5ebfe-338a-4400-9a95-38640a85e53d tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:08.272450 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-51f5ebfe-338a-4400-9a95-38640a85e53d tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:08.296419 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-51f5ebfe-338a-4400-9a95-38640a85e53d tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:08.297246 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-51f5ebfe-338a-4400-9a95-38640a85e53d tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:08.297600 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-51f5ebfe-338a-4400-9a95-38640a85e53d tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:08.304432 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-51f5ebfe-338a-4400-9a95-38640a85e53d tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:08.305940 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-51f5ebfe-338a-4400-9a95-38640a85e53d tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:08.306723 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-51f5ebfe-338a-4400-9a95-38640a85e53d tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:08.399436 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-59821f68-6c62-45c6-8616-c2809ada227b tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '355b96770f7e4f338ef21fc49c8de54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971ec7583d924ac3981bc789db78a733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:08.412777 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-59821f68-6c62-45c6-8616-c2809ada227b tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] 10.222.0.70 "GET /compute/v2.1/servers/e3b6b87a-f60c-4bda-8591-0c387e31bb4f" status: 200 len: 1215 microversion: 2.1 time: 0.295176 Aug 27 03:10:08.454174 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2587/5127] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:08 2022] GET /compute/v2.1/servers/e3b6b87a-f60c-4bda-8591-0c387e31bb4f => generated 1215 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:09.194108 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-51f5ebfe-338a-4400-9a95-38640a85e53d tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:09.223794 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-51f5ebfe-338a-4400-9a95-38640a85e53d tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:09.229083 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-51f5ebfe-338a-4400-9a95-38640a85e53d tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:09.243733 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-51f5ebfe-338a-4400-9a95-38640a85e53d tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22" status: 200 len: 1808 microversion: 2.20 time: 0.970803 Aug 27 03:10:09.246754 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2541/5128] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:10:08 2022] GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22 => generated 1808 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:10:09.460696 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-982cd0db-2c29-45df-9431-bad448e773ff tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:09.462136 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-982cd0db-2c29-45df-9431-bad448e773ff tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] [instance: e3b6b87a-f60c-4bda-8591-0c387e31bb4f] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:09.487501 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-982cd0db-2c29-45df-9431-bad448e773ff tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:09.490349 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-982cd0db-2c29-45df-9431-bad448e773ff tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:09.493671 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-982cd0db-2c29-45df-9431-bad448e773ff tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:09.501008 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-982cd0db-2c29-45df-9431-bad448e773ff tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:09.505307 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-982cd0db-2c29-45df-9431-bad448e773ff tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:09.506128 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-982cd0db-2c29-45df-9431-bad448e773ff tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:10.272754 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8a39a1d5-6f55-4574-ab4c-cde6e40c9cab tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:10.273336 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-8a39a1d5-6f55-4574-ab4c-cde6e40c9cab tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:10.292120 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8a39a1d5-6f55-4574-ab4c-cde6e40c9cab tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:10.292707 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8a39a1d5-6f55-4574-ab4c-cde6e40c9cab tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:10.293146 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8a39a1d5-6f55-4574-ab4c-cde6e40c9cab tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:10.293861 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8a39a1d5-6f55-4574-ab4c-cde6e40c9cab tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:10.294468 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8a39a1d5-6f55-4574-ab4c-cde6e40c9cab tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:10.294901 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8a39a1d5-6f55-4574-ab4c-cde6e40c9cab tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:10.447859 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-982cd0db-2c29-45df-9431-bad448e773ff tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '355b96770f7e4f338ef21fc49c8de54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971ec7583d924ac3981bc789db78a733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:10.459188 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-982cd0db-2c29-45df-9431-bad448e773ff tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] 10.222.0.70 "GET /compute/v2.1/servers/e3b6b87a-f60c-4bda-8591-0c387e31bb4f" status: 200 len: 1215 microversion: 2.1 time: 1.004609 Aug 27 03:10:10.461104 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2588/5129] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:09 2022] GET /compute/v2.1/servers/e3b6b87a-f60c-4bda-8591-0c387e31bb4f => generated 1215 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:10.697865 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-8a39a1d5-6f55-4574-ab4c-cde6e40c9cab tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:10.712996 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-8a39a1d5-6f55-4574-ab4c-cde6e40c9cab tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:10.715390 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-8a39a1d5-6f55-4574-ab4c-cde6e40c9cab tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:10.721221 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-8a39a1d5-6f55-4574-ab4c-cde6e40c9cab tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22" status: 200 len: 1808 microversion: 2.20 time: 0.452549 Aug 27 03:10:10.721940 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2542/5130] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:10:10 2022] GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22 => generated 1808 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:10:10.759864 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-6c0a6d2c-6da8-4e97-8221-9b6354132db8 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1775389180", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a7b97b39-d409-4ab1-957a-8381e0b7ec94"}], "security_groups": [{"name": "tempest-securitygroup--1294271245"}], "key_name": "tempest-keypair-737449516", "user_data": "}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:10:11.069632 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.network.neutron [None req-6c0a6d2c-6da8-4e97-8221-9b6354132db8 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] validate_networks() for [('a7b97b39-d409-4ab1-957a-8381e0b7ec94', None, None, None, None, None)] {{(pid=134051) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:10:11.482148 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c56a69be-b60e-42d0-9d90-783dc1483911 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:11.482753 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-c56a69be-b60e-42d0-9d90-783dc1483911 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] [instance: e3b6b87a-f60c-4bda-8591-0c387e31bb4f] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:11.492895 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c56a69be-b60e-42d0-9d90-783dc1483911 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:11.495981 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c56a69be-b60e-42d0-9d90-783dc1483911 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:11.496650 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c56a69be-b60e-42d0-9d90-783dc1483911 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:11.497551 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c56a69be-b60e-42d0-9d90-783dc1483911 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:11.500343 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c56a69be-b60e-42d0-9d90-783dc1483911 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:11.501074 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c56a69be-b60e-42d0-9d90-783dc1483911 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:11.994575 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-c56a69be-b60e-42d0-9d90-783dc1483911 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '355b96770f7e4f338ef21fc49c8de54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971ec7583d924ac3981bc789db78a733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:12.034364 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c56a69be-b60e-42d0-9d90-783dc1483911 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] 10.222.0.70 "GET /compute/v2.1/servers/e3b6b87a-f60c-4bda-8591-0c387e31bb4f" status: 200 len: 1283 microversion: 2.1 time: 0.555729 Aug 27 03:10:12.035619 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2543/5131] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:11 2022] GET /compute/v2.1/servers/e3b6b87a-f60c-4bda-8591-0c387e31bb4f => generated 1283 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:10:12.046298 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d737dc57-474d-4d81-b2e2-ee0006223f24 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:12.047665 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d737dc57-474d-4d81-b2e2-ee0006223f24 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:12.081183 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d737dc57-474d-4d81-b2e2-ee0006223f24 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:12.081960 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d737dc57-474d-4d81-b2e2-ee0006223f24 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:12.082501 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d737dc57-474d-4d81-b2e2-ee0006223f24 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:12.083364 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d737dc57-474d-4d81-b2e2-ee0006223f24 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:12.085206 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d737dc57-474d-4d81-b2e2-ee0006223f24 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:12.087327 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d737dc57-474d-4d81-b2e2-ee0006223f24 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:12.719817 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:10:12.807999 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-d737dc57-474d-4d81-b2e2-ee0006223f24 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:12.825477 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-6c0a6d2c-6da8-4e97-8221-9b6354132db8 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Flavor limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:10:12.826471 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-d737dc57-474d-4d81-b2e2-ee0006223f24 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:12.826793 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-6c0a6d2c-6da8-4e97-8221-9b6354132db8 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Image limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:10:12.827428 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-6c0a6d2c-6da8-4e97-8221-9b6354132db8 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Flavor pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:10:12.828138 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-6c0a6d2c-6da8-4e97-8221-9b6354132db8 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Image pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:10:12.828828 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-6c0a6d2c-6da8-4e97-8221-9b6354132db8 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:10:12.829760 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-d737dc57-474d-4d81-b2e2-ee0006223f24 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:12.831240 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d737dc57-474d-4d81-b2e2-ee0006223f24 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22" status: 200 len: 1808 microversion: 2.20 time: 0.794229 Aug 27 03:10:12.831944 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2544/5132] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:10:12 2022] GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22 => generated 1808 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:10:12.854384 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6c0a6d2c-6da8-4e97-8221-9b6354132db8 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:12.856046 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6c0a6d2c-6da8-4e97-8221-9b6354132db8 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:12.856939 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6c0a6d2c-6da8-4e97-8221-9b6354132db8 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:12.857853 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6c0a6d2c-6da8-4e97-8221-9b6354132db8 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:12.858520 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6c0a6d2c-6da8-4e97-8221-9b6354132db8 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:12.859129 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6c0a6d2c-6da8-4e97-8221-9b6354132db8 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:12.904755 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-6c0a6d2c-6da8-4e97-8221-9b6354132db8 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Getting quotas for project b92af206e05f44cf948b7c25d1acc139. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:10:12.924187 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-6c0a6d2c-6da8-4e97-8221-9b6354132db8 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Getting quotas for user a549f85910184bf7a697cce7fa3dff96 and project b92af206e05f44cf948b7c25d1acc139. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:10:12.946811 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-6c0a6d2c-6da8-4e97-8221-9b6354132db8 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Going to run 1 instances... {{(pid=134051) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:10:12.949715 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-6c0a6d2c-6da8-4e97-8221-9b6354132db8 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 77d55af2-92db-4882-a218-690b4752270f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134051) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:10:12.999705 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:10:13.039211 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-6c0a6d2c-6da8-4e97-8221-9b6354132db8 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.282823 Aug 27 03:10:13.049405 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2589/5133] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 03:10:10 2022] POST /compute/v2.1/servers => generated 402 bytes in 2294 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:10:13.061887 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-616fc067-a28e-431d-affe-8df86244dea5 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:13.062746 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-616fc067-a28e-431d-affe-8df86244dea5 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] [instance: e3b6b87a-f60c-4bda-8591-0c387e31bb4f] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:13.069427 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-19eac077-d91d-44c8-97e2-a618a1f922b5 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:13.071569 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-616fc067-a28e-431d-affe-8df86244dea5 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:13.072248 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-616fc067-a28e-431d-affe-8df86244dea5 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:13.072758 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-616fc067-a28e-431d-affe-8df86244dea5 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:13.073540 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-616fc067-a28e-431d-affe-8df86244dea5 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:13.073995 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-616fc067-a28e-431d-affe-8df86244dea5 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:13.074420 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-616fc067-a28e-431d-affe-8df86244dea5 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:13.080063 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-19eac077-d91d-44c8-97e2-a618a1f922b5 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 77d55af2-92db-4882-a218-690b4752270f] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:13.128600 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=76 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:10:13.346722 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-19eac077-d91d-44c8-97e2-a618a1f922b5 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a549f85910184bf7a697cce7fa3dff96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92af206e05f44cf948b7c25d1acc139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:13.371126 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-19eac077-d91d-44c8-97e2-a618a1f922b5 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "GET /compute/v2.1/servers/77d55af2-92db-4882-a218-690b4752270f" status: 200 len: 1241 microversion: 2.1 time: 0.320058 Aug 27 03:10:13.373157 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2545/5134] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:13 2022] GET /compute/v2.1/servers/77d55af2-92db-4882-a218-690b4752270f => generated 1241 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:10:13.645323 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-616fc067-a28e-431d-affe-8df86244dea5 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '355b96770f7e4f338ef21fc49c8de54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971ec7583d924ac3981bc789db78a733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:13.653560 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-616fc067-a28e-431d-affe-8df86244dea5 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] 10.222.0.70 "GET /compute/v2.1/servers/e3b6b87a-f60c-4bda-8591-0c387e31bb4f" status: 200 len: 1283 microversion: 2.1 time: 0.599932 Aug 27 03:10:13.670650 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2590/5135] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:13 2022] GET /compute/v2.1/servers/e3b6b87a-f60c-4bda-8591-0c387e31bb4f => generated 1283 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:13.855838 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c21b8e74-8a31-4c7c-b9ab-97e14b6fe49b tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:13.856759 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-c21b8e74-8a31-4c7c-b9ab-97e14b6fe49b tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:13.882695 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c21b8e74-8a31-4c7c-b9ab-97e14b6fe49b tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:13.885338 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c21b8e74-8a31-4c7c-b9ab-97e14b6fe49b tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:13.885777 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c21b8e74-8a31-4c7c-b9ab-97e14b6fe49b tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:13.889803 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c21b8e74-8a31-4c7c-b9ab-97e14b6fe49b tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:13.890321 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c21b8e74-8a31-4c7c-b9ab-97e14b6fe49b tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:13.890751 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c21b8e74-8a31-4c7c-b9ab-97e14b6fe49b tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:13.955556 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-92d965b9-a6b5-4c99-8d2d-0e77ade983c2 req-cd37a647-65c7-440d-9460-f9e6deab0a80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3b6b87a-f60c-4bda-8591-0c387e31bb4f", "tag": "d9c24bb5-0bef-42a7-bf54-a86f3cdac10f"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:10:13.990901 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-92d965b9-a6b5-4c99-8d2d-0e77ade983c2 req-cd37a647-65c7-440d-9460-f9e6deab0a80 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:13.994289 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-92d965b9-a6b5-4c99-8d2d-0e77ade983c2 req-cd37a647-65c7-440d-9460-f9e6deab0a80 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:13.994947 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-92d965b9-a6b5-4c99-8d2d-0e77ade983c2 req-cd37a647-65c7-440d-9460-f9e6deab0a80 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:14.038106 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-92d965b9-a6b5-4c99-8d2d-0e77ade983c2 req-cd37a647-65c7-440d-9460-f9e6deab0a80 service nova] Creating event network-changed:d9c24bb5-0bef-42a7-bf54-a86f3cdac10f for instance e3b6b87a-f60c-4bda-8591-0c387e31bb4f on n-h2-852278-4 Aug 27 03:10:14.058008 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-92d965b9-a6b5-4c99-8d2d-0e77ade983c2 req-cd37a647-65c7-440d-9460-f9e6deab0a80 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109422 Aug 27 03:10:14.062402 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2591/5136] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:10:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Aug 27 03:10:14.394255 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-46158354-cb8b-4edc-930f-48edc5e94697 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:14.394977 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-46158354-cb8b-4edc-930f-48edc5e94697 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 77d55af2-92db-4882-a218-690b4752270f] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:14.419098 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-46158354-cb8b-4edc-930f-48edc5e94697 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:14.421375 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-46158354-cb8b-4edc-930f-48edc5e94697 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:14.422008 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-46158354-cb8b-4edc-930f-48edc5e94697 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:14.422866 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-46158354-cb8b-4edc-930f-48edc5e94697 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:14.424123 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-46158354-cb8b-4edc-930f-48edc5e94697 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:14.426147 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-46158354-cb8b-4edc-930f-48edc5e94697 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:14.928909 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-c21b8e74-8a31-4c7c-b9ab-97e14b6fe49b tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:14.945707 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-c21b8e74-8a31-4c7c-b9ab-97e14b6fe49b tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:14.949839 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-c21b8e74-8a31-4c7c-b9ab-97e14b6fe49b tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:14.951411 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c21b8e74-8a31-4c7c-b9ab-97e14b6fe49b tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22" status: 200 len: 1808 microversion: 2.20 time: 1.100955 Aug 27 03:10:14.952400 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2546/5137] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:10:13 2022] GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22 => generated 1808 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:10:14.957876 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4d194965-9e19-4f3f-aa73-cba3dd434d4c tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:14.958779 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-4d194965-9e19-4f3f-aa73-cba3dd434d4c tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] [instance: e3b6b87a-f60c-4bda-8591-0c387e31bb4f] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:14.966331 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4d194965-9e19-4f3f-aa73-cba3dd434d4c tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:14.967181 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4d194965-9e19-4f3f-aa73-cba3dd434d4c tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:14.967937 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4d194965-9e19-4f3f-aa73-cba3dd434d4c tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:14.969051 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4d194965-9e19-4f3f-aa73-cba3dd434d4c tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:14.970933 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4d194965-9e19-4f3f-aa73-cba3dd434d4c tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:14.971649 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4d194965-9e19-4f3f-aa73-cba3dd434d4c tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:15.052514 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-46158354-cb8b-4edc-930f-48edc5e94697 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a549f85910184bf7a697cce7fa3dff96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92af206e05f44cf948b7c25d1acc139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:15.073800 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-46158354-cb8b-4edc-930f-48edc5e94697 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "GET /compute/v2.1/servers/77d55af2-92db-4882-a218-690b4752270f" status: 200 len: 1237 microversion: 2.1 time: 0.684138 Aug 27 03:10:15.077104 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2592/5138] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:14 2022] GET /compute/v2.1/servers/77d55af2-92db-4882-a218-690b4752270f => generated 1237 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:10:15.589324 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-4d194965-9e19-4f3f-aa73-cba3dd434d4c tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '355b96770f7e4f338ef21fc49c8de54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971ec7583d924ac3981bc789db78a733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:15.597676 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-4d194965-9e19-4f3f-aa73-cba3dd434d4c tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] 10.222.0.70 "GET /compute/v2.1/servers/e3b6b87a-f60c-4bda-8591-0c387e31bb4f" status: 200 len: 1283 microversion: 2.1 time: 0.643910 Aug 27 03:10:15.601023 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2547/5139] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:14 2022] GET /compute/v2.1/servers/e3b6b87a-f60c-4bda-8591-0c387e31bb4f => generated 1283 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:15.977673 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-916433dc-ca23-4775-b827-d3434ed31b2a tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:15.978420 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-916433dc-ca23-4775-b827-d3434ed31b2a tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:15.994616 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-916433dc-ca23-4775-b827-d3434ed31b2a tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:16.000429 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-916433dc-ca23-4775-b827-d3434ed31b2a tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:16.001993 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-916433dc-ca23-4775-b827-d3434ed31b2a tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:16.005355 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-916433dc-ca23-4775-b827-d3434ed31b2a tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:16.008917 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-916433dc-ca23-4775-b827-d3434ed31b2a tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:16.009760 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-916433dc-ca23-4775-b827-d3434ed31b2a tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:16.095187 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-81526155-ba51-4b8b-a8dc-63105619148c tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:16.095939 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-81526155-ba51-4b8b-a8dc-63105619148c tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 77d55af2-92db-4882-a218-690b4752270f] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:16.105269 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-81526155-ba51-4b8b-a8dc-63105619148c tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:16.106221 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-81526155-ba51-4b8b-a8dc-63105619148c tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:16.106943 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-81526155-ba51-4b8b-a8dc-63105619148c tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:16.112454 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-81526155-ba51-4b8b-a8dc-63105619148c tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:16.113044 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-81526155-ba51-4b8b-a8dc-63105619148c tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:16.113493 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-81526155-ba51-4b8b-a8dc-63105619148c tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:16.239790 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-81526155-ba51-4b8b-a8dc-63105619148c tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a549f85910184bf7a697cce7fa3dff96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92af206e05f44cf948b7c25d1acc139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:16.251865 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-81526155-ba51-4b8b-a8dc-63105619148c tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "GET /compute/v2.1/servers/77d55af2-92db-4882-a218-690b4752270f" status: 200 len: 1299 microversion: 2.1 time: 0.158159 Aug 27 03:10:16.252938 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2548/5140] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:16 2022] GET /compute/v2.1/servers/77d55af2-92db-4882-a218-690b4752270f => generated 1299 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:16.280261 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-916433dc-ca23-4775-b827-d3434ed31b2a tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:16.304115 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-916433dc-ca23-4775-b827-d3434ed31b2a tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:16.305871 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-916433dc-ca23-4775-b827-d3434ed31b2a tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:16.307951 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-916433dc-ca23-4775-b827-d3434ed31b2a tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22" status: 200 len: 1808 microversion: 2.20 time: 0.333562 Aug 27 03:10:16.308930 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2593/5141] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:10:15 2022] GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22 => generated 1808 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:10:16.626133 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-7e5e8cf2-50cc-4f16-9473-2a00dd129ac9 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:16.627115 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-7e5e8cf2-50cc-4f16-9473-2a00dd129ac9 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] [instance: e3b6b87a-f60c-4bda-8591-0c387e31bb4f] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:16.643612 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7e5e8cf2-50cc-4f16-9473-2a00dd129ac9 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:16.653975 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7e5e8cf2-50cc-4f16-9473-2a00dd129ac9 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:16.656942 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7e5e8cf2-50cc-4f16-9473-2a00dd129ac9 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:16.663609 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7e5e8cf2-50cc-4f16-9473-2a00dd129ac9 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:16.674942 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7e5e8cf2-50cc-4f16-9473-2a00dd129ac9 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:16.678314 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7e5e8cf2-50cc-4f16-9473-2a00dd129ac9 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:17.008018 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-7e5e8cf2-50cc-4f16-9473-2a00dd129ac9 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '355b96770f7e4f338ef21fc49c8de54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971ec7583d924ac3981bc789db78a733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:17.020026 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-7e5e8cf2-50cc-4f16-9473-2a00dd129ac9 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] 10.222.0.70 "GET /compute/v2.1/servers/e3b6b87a-f60c-4bda-8591-0c387e31bb4f" status: 200 len: 1283 microversion: 2.1 time: 0.398831 Aug 27 03:10:17.021042 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2549/5142] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:16 2022] GET /compute/v2.1/servers/e3b6b87a-f60c-4bda-8591-0c387e31bb4f => generated 1283 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:17.279621 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ccdc680b-637b-4c16-b3f4-071628e9e365 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:17.281312 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-ccdc680b-637b-4c16-b3f4-071628e9e365 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 77d55af2-92db-4882-a218-690b4752270f] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:17.291438 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ccdc680b-637b-4c16-b3f4-071628e9e365 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:17.293046 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ccdc680b-637b-4c16-b3f4-071628e9e365 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:17.293719 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ccdc680b-637b-4c16-b3f4-071628e9e365 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:17.294790 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ccdc680b-637b-4c16-b3f4-071628e9e365 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:17.295475 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ccdc680b-637b-4c16-b3f4-071628e9e365 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:17.296115 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ccdc680b-637b-4c16-b3f4-071628e9e365 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:17.333106 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-36e34581-0e23-489e-981b-634ad5ff0e5e tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:17.334045 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-36e34581-0e23-489e-981b-634ad5ff0e5e tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:17.345107 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-36e34581-0e23-489e-981b-634ad5ff0e5e tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:17.349820 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-36e34581-0e23-489e-981b-634ad5ff0e5e tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:17.350302 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-36e34581-0e23-489e-981b-634ad5ff0e5e tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:17.351055 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-36e34581-0e23-489e-981b-634ad5ff0e5e tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:17.353769 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-36e34581-0e23-489e-981b-634ad5ff0e5e tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:17.358940 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-36e34581-0e23-489e-981b-634ad5ff0e5e tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:17.807013 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-36e34581-0e23-489e-981b-634ad5ff0e5e tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:17.816279 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-ccdc680b-637b-4c16-b3f4-071628e9e365 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a549f85910184bf7a697cce7fa3dff96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92af206e05f44cf948b7c25d1acc139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:17.820891 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-36e34581-0e23-489e-981b-634ad5ff0e5e tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:17.823592 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-36e34581-0e23-489e-981b-634ad5ff0e5e tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:17.825031 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-36e34581-0e23-489e-981b-634ad5ff0e5e tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22" status: 200 len: 1808 microversion: 2.20 time: 0.496969 Aug 27 03:10:17.827044 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ccdc680b-637b-4c16-b3f4-071628e9e365 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "GET /compute/v2.1/servers/77d55af2-92db-4882-a218-690b4752270f" status: 200 len: 1367 microversion: 2.1 time: 0.557185 Aug 27 03:10:17.828906 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2594/5143] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:17 2022] GET /compute/v2.1/servers/77d55af2-92db-4882-a218-690b4752270f => generated 1367 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:17.833778 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2550/5144] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:10:17 2022] GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22 => generated 1808 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:10:17.990088 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-a2c5b760-a37e-4a28-807a-219f6d22f05f req-c260a927-1e1b-4546-9267-5794885e8266 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77d55af2-92db-4882-a218-690b4752270f", "tag": "41a4e1ef-a14b-421b-b753-fcdfbfdc42c2"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:10:18.003295 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-a2c5b760-a37e-4a28-807a-219f6d22f05f req-c260a927-1e1b-4546-9267-5794885e8266 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:18.013933 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-a2c5b760-a37e-4a28-807a-219f6d22f05f req-c260a927-1e1b-4546-9267-5794885e8266 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:18.014694 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-a2c5b760-a37e-4a28-807a-219f6d22f05f req-c260a927-1e1b-4546-9267-5794885e8266 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:18.031133 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-a2c5b760-a37e-4a28-807a-219f6d22f05f req-c260a927-1e1b-4546-9267-5794885e8266 service nova] Creating event network-changed:41a4e1ef-a14b-421b-b753-fcdfbfdc42c2 for instance 77d55af2-92db-4882-a218-690b4752270f on n-h1-852278-4 Aug 27 03:10:18.037512 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-a2c5b760-a37e-4a28-807a-219f6d22f05f req-c260a927-1e1b-4546-9267-5794885e8266 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054597 Aug 27 03:10:18.038417 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2595/5145] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:10:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:10:18.044019 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-11258b00-1bc4-408d-b362-7205b9fc029d tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:18.044895 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-11258b00-1bc4-408d-b362-7205b9fc029d tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] [instance: e3b6b87a-f60c-4bda-8591-0c387e31bb4f] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:18.067715 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=5 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:10:18.071758 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-11258b00-1bc4-408d-b362-7205b9fc029d tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:18.073970 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-11258b00-1bc4-408d-b362-7205b9fc029d tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:18.076351 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-11258b00-1bc4-408d-b362-7205b9fc029d tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:18.077472 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-11258b00-1bc4-408d-b362-7205b9fc029d tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:18.080288 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-11258b00-1bc4-408d-b362-7205b9fc029d tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:18.081459 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-11258b00-1bc4-408d-b362-7205b9fc029d tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:18.148516 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=98 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:10:18.338198 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-11258b00-1bc4-408d-b362-7205b9fc029d tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '355b96770f7e4f338ef21fc49c8de54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971ec7583d924ac3981bc789db78a733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:18.362212 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-11258b00-1bc4-408d-b362-7205b9fc029d tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] 10.222.0.70 "GET /compute/v2.1/servers/e3b6b87a-f60c-4bda-8591-0c387e31bb4f" status: 200 len: 1271 microversion: 2.1 time: 0.317498 Aug 27 03:10:18.363884 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2551/5146] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:18 2022] GET /compute/v2.1/servers/e3b6b87a-f60c-4bda-8591-0c387e31bb4f => generated 1271 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:18.851334 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-2214003f-877c-4a32-b4e5-379841780508 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:18.852055 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-73a778a7-2116-4b0f-bdcb-b8faf007dacc tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:18.852199 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-2214003f-877c-4a32-b4e5-379841780508 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 77d55af2-92db-4882-a218-690b4752270f] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:18.853028 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-73a778a7-2116-4b0f-bdcb-b8faf007dacc tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:18.871215 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2214003f-877c-4a32-b4e5-379841780508 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:18.876660 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2214003f-877c-4a32-b4e5-379841780508 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:18.877209 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2214003f-877c-4a32-b4e5-379841780508 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:18.877747 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-73a778a7-2116-4b0f-bdcb-b8faf007dacc tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:18.878423 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2214003f-877c-4a32-b4e5-379841780508 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:18.883953 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2214003f-877c-4a32-b4e5-379841780508 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:18.883953 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2214003f-877c-4a32-b4e5-379841780508 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:18.884956 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-73a778a7-2116-4b0f-bdcb-b8faf007dacc tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:18.885842 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-73a778a7-2116-4b0f-bdcb-b8faf007dacc tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:18.888773 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-73a778a7-2116-4b0f-bdcb-b8faf007dacc tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:18.889422 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-73a778a7-2116-4b0f-bdcb-b8faf007dacc tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:18.892286 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-73a778a7-2116-4b0f-bdcb-b8faf007dacc tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:19.265475 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-73a778a7-2116-4b0f-bdcb-b8faf007dacc tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:19.277840 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-73a778a7-2116-4b0f-bdcb-b8faf007dacc tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:19.280246 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-73a778a7-2116-4b0f-bdcb-b8faf007dacc tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:19.282462 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-73a778a7-2116-4b0f-bdcb-b8faf007dacc tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22" status: 200 len: 1808 microversion: 2.20 time: 0.437199 Aug 27 03:10:19.283324 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2552/5147] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:10:18 2022] GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22 => generated 1808 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:10:19.301238 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-2214003f-877c-4a32-b4e5-379841780508 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a549f85910184bf7a697cce7fa3dff96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92af206e05f44cf948b7c25d1acc139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:19.314286 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-2214003f-877c-4a32-b4e5-379841780508 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "GET /compute/v2.1/servers/77d55af2-92db-4882-a218-690b4752270f" status: 200 len: 1367 microversion: 2.1 time: 0.468309 Aug 27 03:10:19.314979 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2596/5148] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:18 2022] GET /compute/v2.1/servers/77d55af2-92db-4882-a218-690b4752270f => generated 1367 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:19.385691 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9414bcb2-13eb-4d0b-afe3-a7964b29cfc2 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:19.387348 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-9414bcb2-13eb-4d0b-afe3-a7964b29cfc2 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] [instance: e3b6b87a-f60c-4bda-8591-0c387e31bb4f] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:19.396712 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9414bcb2-13eb-4d0b-afe3-a7964b29cfc2 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:19.397437 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9414bcb2-13eb-4d0b-afe3-a7964b29cfc2 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:19.398084 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9414bcb2-13eb-4d0b-afe3-a7964b29cfc2 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:19.399182 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9414bcb2-13eb-4d0b-afe3-a7964b29cfc2 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:19.399864 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9414bcb2-13eb-4d0b-afe3-a7964b29cfc2 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:19.400630 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9414bcb2-13eb-4d0b-afe3-a7964b29cfc2 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:19.590939 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-9414bcb2-13eb-4d0b-afe3-a7964b29cfc2 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '355b96770f7e4f338ef21fc49c8de54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971ec7583d924ac3981bc789db78a733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:19.601362 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9414bcb2-13eb-4d0b-afe3-a7964b29cfc2 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] 10.222.0.70 "GET /compute/v2.1/servers/e3b6b87a-f60c-4bda-8591-0c387e31bb4f" status: 200 len: 1271 microversion: 2.1 time: 0.221091 Aug 27 03:10:19.602925 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2553/5149] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:19 2022] GET /compute/v2.1/servers/e3b6b87a-f60c-4bda-8591-0c387e31bb4f => generated 1271 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:20.310764 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-27e61c43-83ed-48b1-91bc-37a351d42e40 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:20.311380 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-27e61c43-83ed-48b1-91bc-37a351d42e40 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:20.321772 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-27e61c43-83ed-48b1-91bc-37a351d42e40 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:20.322265 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-27e61c43-83ed-48b1-91bc-37a351d42e40 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:20.322700 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-27e61c43-83ed-48b1-91bc-37a351d42e40 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:20.323492 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-27e61c43-83ed-48b1-91bc-37a351d42e40 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:20.323941 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-27e61c43-83ed-48b1-91bc-37a351d42e40 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:20.334427 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-27e61c43-83ed-48b1-91bc-37a351d42e40 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:20.335156 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f4c804fb-c7c7-4ebc-8af1-b32e6e31bd2f tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:20.335940 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-f4c804fb-c7c7-4ebc-8af1-b32e6e31bd2f tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 77d55af2-92db-4882-a218-690b4752270f] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:20.344425 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f4c804fb-c7c7-4ebc-8af1-b32e6e31bd2f tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:20.344425 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f4c804fb-c7c7-4ebc-8af1-b32e6e31bd2f tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:20.344838 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f4c804fb-c7c7-4ebc-8af1-b32e6e31bd2f tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:20.345579 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f4c804fb-c7c7-4ebc-8af1-b32e6e31bd2f tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:20.346049 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f4c804fb-c7c7-4ebc-8af1-b32e6e31bd2f tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:20.346696 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f4c804fb-c7c7-4ebc-8af1-b32e6e31bd2f tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:20.603406 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-f4c804fb-c7c7-4ebc-8af1-b32e6e31bd2f tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a549f85910184bf7a697cce7fa3dff96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92af206e05f44cf948b7c25d1acc139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:20.629156 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f4c804fb-c7c7-4ebc-8af1-b32e6e31bd2f tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "GET /compute/v2.1/servers/77d55af2-92db-4882-a218-690b4752270f" status: 200 len: 1367 microversion: 2.1 time: 0.297541 Aug 27 03:10:20.629631 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2554/5150] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:20 2022] GET /compute/v2.1/servers/77d55af2-92db-4882-a218-690b4752270f => generated 1367 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:10:20.634348 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b2971c47-41b3-45ac-ab1c-8fcda883a78e tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:20.634888 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b2971c47-41b3-45ac-ab1c-8fcda883a78e tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] [instance: e3b6b87a-f60c-4bda-8591-0c387e31bb4f] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:20.649704 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b2971c47-41b3-45ac-ab1c-8fcda883a78e tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:20.650148 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b2971c47-41b3-45ac-ab1c-8fcda883a78e tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:20.650514 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b2971c47-41b3-45ac-ab1c-8fcda883a78e tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:20.651220 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b2971c47-41b3-45ac-ab1c-8fcda883a78e tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:20.661619 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b2971c47-41b3-45ac-ab1c-8fcda883a78e tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:20.662222 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b2971c47-41b3-45ac-ab1c-8fcda883a78e tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:20.678520 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-27e61c43-83ed-48b1-91bc-37a351d42e40 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:20.689842 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-27e61c43-83ed-48b1-91bc-37a351d42e40 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:20.692019 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-27e61c43-83ed-48b1-91bc-37a351d42e40 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:20.694127 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-27e61c43-83ed-48b1-91bc-37a351d42e40 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22" status: 200 len: 1808 microversion: 2.20 time: 0.388572 Aug 27 03:10:20.695172 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2597/5151] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:10:20 2022] GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22 => generated 1808 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:10:20.835475 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b2971c47-41b3-45ac-ab1c-8fcda883a78e tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '355b96770f7e4f338ef21fc49c8de54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971ec7583d924ac3981bc789db78a733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:20.846215 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b2971c47-41b3-45ac-ab1c-8fcda883a78e tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] 10.222.0.70 "GET /compute/v2.1/servers/e3b6b87a-f60c-4bda-8591-0c387e31bb4f" status: 200 len: 1271 microversion: 2.1 time: 0.215439 Aug 27 03:10:20.847676 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2555/5152] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:20 2022] GET /compute/v2.1/servers/e3b6b87a-f60c-4bda-8591-0c387e31bb4f => generated 1271 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:20.877024 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-bd2f3be4-72d2-4133-a88d-688110af58cf req-7df1dd8b-7e37-4bec-836e-876f0676bd9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73ee7f75-b081-4f5c-90b0-e0d1b27b9a22", "name": "network-vif-plugged", "status": "completed", "tag": "130f85a4-751a-4a52-92c2-d7a99bb65d41"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:10:20.899900 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-bd2f3be4-72d2-4133-a88d-688110af58cf req-7df1dd8b-7e37-4bec-836e-876f0676bd9a service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:20.900419 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-bd2f3be4-72d2-4133-a88d-688110af58cf req-7df1dd8b-7e37-4bec-836e-876f0676bd9a service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:20.900854 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-bd2f3be4-72d2-4133-a88d-688110af58cf req-7df1dd8b-7e37-4bec-836e-876f0676bd9a service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:20.914438 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-bd2f3be4-72d2-4133-a88d-688110af58cf req-7df1dd8b-7e37-4bec-836e-876f0676bd9a service nova] Creating event network-vif-plugged:130f85a4-751a-4a52-92c2-d7a99bb65d41 for instance 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22 on n-h2-852278-4 Aug 27 03:10:20.934621 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-bd2f3be4-72d2-4133-a88d-688110af58cf req-7df1dd8b-7e37-4bec-836e-876f0676bd9a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061519 Aug 27 03:10:20.935607 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2598/5153] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:10:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:10:21.649458 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-107e30c3-66bc-48d6-9e2c-ed4705f78f03 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:21.650773 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-107e30c3-66bc-48d6-9e2c-ed4705f78f03 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 77d55af2-92db-4882-a218-690b4752270f] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:21.657454 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-107e30c3-66bc-48d6-9e2c-ed4705f78f03 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:21.658013 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-107e30c3-66bc-48d6-9e2c-ed4705f78f03 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:21.658445 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-107e30c3-66bc-48d6-9e2c-ed4705f78f03 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:21.659142 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-107e30c3-66bc-48d6-9e2c-ed4705f78f03 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:21.659582 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-107e30c3-66bc-48d6-9e2c-ed4705f78f03 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:21.659997 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-107e30c3-66bc-48d6-9e2c-ed4705f78f03 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:21.718780 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-fc024f4d-34ea-4e4e-83c8-bf883e6db176 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:21.720568 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-fc024f4d-34ea-4e4e-83c8-bf883e6db176 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:21.727526 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fc024f4d-34ea-4e4e-83c8-bf883e6db176 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:21.728347 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fc024f4d-34ea-4e4e-83c8-bf883e6db176 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:21.729254 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fc024f4d-34ea-4e4e-83c8-bf883e6db176 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:21.730497 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fc024f4d-34ea-4e4e-83c8-bf883e6db176 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:21.731294 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fc024f4d-34ea-4e4e-83c8-bf883e6db176 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:21.731678 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fc024f4d-34ea-4e4e-83c8-bf883e6db176 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:21.854426 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-107e30c3-66bc-48d6-9e2c-ed4705f78f03 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a549f85910184bf7a697cce7fa3dff96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92af206e05f44cf948b7c25d1acc139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:21.868148 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-107e30c3-66bc-48d6-9e2c-ed4705f78f03 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "GET /compute/v2.1/servers/77d55af2-92db-4882-a218-690b4752270f" status: 200 len: 1367 microversion: 2.1 time: 0.223130 Aug 27 03:10:21.869209 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2556/5154] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:21 2022] GET /compute/v2.1/servers/77d55af2-92db-4882-a218-690b4752270f => generated 1367 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:21.874267 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-7d93c183-f98a-4006-8416-c950e5c95eba tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:21.875625 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-7d93c183-f98a-4006-8416-c950e5c95eba tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] [instance: e3b6b87a-f60c-4bda-8591-0c387e31bb4f] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:21.886635 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7d93c183-f98a-4006-8416-c950e5c95eba tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:21.887425 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7d93c183-f98a-4006-8416-c950e5c95eba tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:21.887873 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7d93c183-f98a-4006-8416-c950e5c95eba tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:21.889311 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7d93c183-f98a-4006-8416-c950e5c95eba tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:21.889979 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7d93c183-f98a-4006-8416-c950e5c95eba tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:21.890811 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7d93c183-f98a-4006-8416-c950e5c95eba tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:21.923334 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-fc024f4d-34ea-4e4e-83c8-bf883e6db176 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:21.934390 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-fc024f4d-34ea-4e4e-83c8-bf883e6db176 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:21.936385 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-fc024f4d-34ea-4e4e-83c8-bf883e6db176 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:21.938447 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-fc024f4d-34ea-4e4e-83c8-bf883e6db176 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22" status: 200 len: 1808 microversion: 2.20 time: 0.224761 Aug 27 03:10:21.939551 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2599/5155] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:10:21 2022] GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22 => generated 1808 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:10:22.035687 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-7d93c183-f98a-4006-8416-c950e5c95eba tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '355b96770f7e4f338ef21fc49c8de54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971ec7583d924ac3981bc789db78a733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:22.048881 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-7d93c183-f98a-4006-8416-c950e5c95eba tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] 10.222.0.70 "GET /compute/v2.1/servers/e3b6b87a-f60c-4bda-8591-0c387e31bb4f" status: 200 len: 1271 microversion: 2.1 time: 0.178258 Aug 27 03:10:22.049950 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2557/5156] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:21 2022] GET /compute/v2.1/servers/e3b6b87a-f60c-4bda-8591-0c387e31bb4f => generated 1271 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:22.888437 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a1f70c58-b26b-4da2-9562-a78aa2ff33bd tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:22.889116 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-a1f70c58-b26b-4da2-9562-a78aa2ff33bd tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 77d55af2-92db-4882-a218-690b4752270f] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:22.897979 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:10:22.906857 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a1f70c58-b26b-4da2-9562-a78aa2ff33bd tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:22.907371 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a1f70c58-b26b-4da2-9562-a78aa2ff33bd tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:22.907814 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a1f70c58-b26b-4da2-9562-a78aa2ff33bd tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:22.908761 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a1f70c58-b26b-4da2-9562-a78aa2ff33bd tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:22.909326 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a1f70c58-b26b-4da2-9562-a78aa2ff33bd tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:22.909857 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a1f70c58-b26b-4da2-9562-a78aa2ff33bd tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:22.949418 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=6 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:10:22.961833 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9cbe0986-2ae8-4a1a-8e68-51e83c1800f3 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:22.962463 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-9cbe0986-2ae8-4a1a-8e68-51e83c1800f3 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:22.982993 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9cbe0986-2ae8-4a1a-8e68-51e83c1800f3 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:22.983910 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9cbe0986-2ae8-4a1a-8e68-51e83c1800f3 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:22.984559 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9cbe0986-2ae8-4a1a-8e68-51e83c1800f3 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:22.985508 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9cbe0986-2ae8-4a1a-8e68-51e83c1800f3 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:22.986205 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9cbe0986-2ae8-4a1a-8e68-51e83c1800f3 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:22.988966 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9cbe0986-2ae8-4a1a-8e68-51e83c1800f3 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:23.352067 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=18 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:10:23.466387 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-9cbe0986-2ae8-4a1a-8e68-51e83c1800f3 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:23.478012 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-9cbe0986-2ae8-4a1a-8e68-51e83c1800f3 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:23.480492 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-9cbe0986-2ae8-4a1a-8e68-51e83c1800f3 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:23.481964 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9cbe0986-2ae8-4a1a-8e68-51e83c1800f3 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22" status: 200 len: 1808 microversion: 2.20 time: 0.524489 Aug 27 03:10:23.498929 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2558/5157] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:10:22 2022] GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22 => generated 1808 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:10:23.505208 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-a1f70c58-b26b-4da2-9562-a78aa2ff33bd tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a549f85910184bf7a697cce7fa3dff96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92af206e05f44cf948b7c25d1acc139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:23.505662 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4929b2c1-9794-4a0e-b4ba-35ad3af1cfac tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:23.506376 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-4929b2c1-9794-4a0e-b4ba-35ad3af1cfac tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] [instance: e3b6b87a-f60c-4bda-8591-0c387e31bb4f] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:23.513835 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4929b2c1-9794-4a0e-b4ba-35ad3af1cfac tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:23.514442 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4929b2c1-9794-4a0e-b4ba-35ad3af1cfac tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:23.514970 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4929b2c1-9794-4a0e-b4ba-35ad3af1cfac tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:23.515767 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4929b2c1-9794-4a0e-b4ba-35ad3af1cfac tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:23.516342 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4929b2c1-9794-4a0e-b4ba-35ad3af1cfac tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:23.516930 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4929b2c1-9794-4a0e-b4ba-35ad3af1cfac tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:23.528295 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a1f70c58-b26b-4da2-9562-a78aa2ff33bd tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "GET /compute/v2.1/servers/77d55af2-92db-4882-a218-690b4752270f" status: 200 len: 1367 microversion: 2.1 time: 0.644186 Aug 27 03:10:23.529100 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2600/5158] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:22 2022] GET /compute/v2.1/servers/77d55af2-92db-4882-a218-690b4752270f => generated 1367 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:23.775381 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-4929b2c1-9794-4a0e-b4ba-35ad3af1cfac tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '355b96770f7e4f338ef21fc49c8de54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971ec7583d924ac3981bc789db78a733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:23.788988 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-4929b2c1-9794-4a0e-b4ba-35ad3af1cfac tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] 10.222.0.70 "GET /compute/v2.1/servers/e3b6b87a-f60c-4bda-8591-0c387e31bb4f" status: 200 len: 1271 microversion: 2.1 time: 0.288559 Aug 27 03:10:23.790446 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2559/5159] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:23 2022] GET /compute/v2.1/servers/e3b6b87a-f60c-4bda-8591-0c387e31bb4f => generated 1271 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:24.510359 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-5ed4ec38-0725-4b5a-9e54-e873c04cd16e tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:24.511038 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-5ed4ec38-0725-4b5a-9e54-e873c04cd16e tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:24.520836 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5ed4ec38-0725-4b5a-9e54-e873c04cd16e tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:24.521586 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5ed4ec38-0725-4b5a-9e54-e873c04cd16e tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:24.522232 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5ed4ec38-0725-4b5a-9e54-e873c04cd16e tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:24.526983 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5ed4ec38-0725-4b5a-9e54-e873c04cd16e tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:24.527675 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5ed4ec38-0725-4b5a-9e54-e873c04cd16e tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:24.528283 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5ed4ec38-0725-4b5a-9e54-e873c04cd16e tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:24.551814 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a6ec6c69-ceb8-4b90-a943-f4d8692de932 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:24.552595 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a6ec6c69-ceb8-4b90-a943-f4d8692de932 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 77d55af2-92db-4882-a218-690b4752270f] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:24.569912 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a6ec6c69-ceb8-4b90-a943-f4d8692de932 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:24.574308 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a6ec6c69-ceb8-4b90-a943-f4d8692de932 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:24.576115 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a6ec6c69-ceb8-4b90-a943-f4d8692de932 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:24.582758 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a6ec6c69-ceb8-4b90-a943-f4d8692de932 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:24.583541 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a6ec6c69-ceb8-4b90-a943-f4d8692de932 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:24.586292 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a6ec6c69-ceb8-4b90-a943-f4d8692de932 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:24.944507 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-5ed4ec38-0725-4b5a-9e54-e873c04cd16e tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:24.964631 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-5ed4ec38-0725-4b5a-9e54-e873c04cd16e tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:24.973864 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-5ed4ec38-0725-4b5a-9e54-e873c04cd16e tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:24.975455 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-5ed4ec38-0725-4b5a-9e54-e873c04cd16e tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22" status: 200 len: 1795 microversion: 2.20 time: 0.470220 Aug 27 03:10:24.976600 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2601/5160] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:10:24 2022] GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22 => generated 1795 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:10:25.003396 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-bf3d8cd5-8202-41ff-9a61-b5d3b00186ac tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:25.004628 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-bf3d8cd5-8202-41ff-9a61-b5d3b00186ac tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] [instance: e3b6b87a-f60c-4bda-8591-0c387e31bb4f] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:25.015948 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bf3d8cd5-8202-41ff-9a61-b5d3b00186ac tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:25.016742 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bf3d8cd5-8202-41ff-9a61-b5d3b00186ac tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:25.017384 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bf3d8cd5-8202-41ff-9a61-b5d3b00186ac tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:25.018293 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bf3d8cd5-8202-41ff-9a61-b5d3b00186ac tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:25.018898 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bf3d8cd5-8202-41ff-9a61-b5d3b00186ac tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:25.019477 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bf3d8cd5-8202-41ff-9a61-b5d3b00186ac tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:25.069280 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-a6ec6c69-ceb8-4b90-a943-f4d8692de932 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a549f85910184bf7a697cce7fa3dff96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92af206e05f44cf948b7c25d1acc139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:25.095102 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a6ec6c69-ceb8-4b90-a943-f4d8692de932 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "GET /compute/v2.1/servers/77d55af2-92db-4882-a218-690b4752270f" status: 200 len: 1367 microversion: 2.1 time: 0.542652 Aug 27 03:10:25.096104 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2560/5161] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:24 2022] GET /compute/v2.1/servers/77d55af2-92db-4882-a218-690b4752270f => generated 1367 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:25.248362 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-bf3d8cd5-8202-41ff-9a61-b5d3b00186ac tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '355b96770f7e4f338ef21fc49c8de54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971ec7583d924ac3981bc789db78a733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:25.261033 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-bf3d8cd5-8202-41ff-9a61-b5d3b00186ac tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] 10.222.0.70 "GET /compute/v2.1/servers/e3b6b87a-f60c-4bda-8591-0c387e31bb4f" status: 200 len: 1271 microversion: 2.1 time: 0.282170 Aug 27 03:10:25.261817 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2602/5162] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:24 2022] GET /compute/v2.1/servers/e3b6b87a-f60c-4bda-8591-0c387e31bb4f => generated 1271 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:25.593037 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-f005dccb-ed52-4ed6-85a7-b4a7436ed63a req-d8ec2acd-d699-4264-87b8-fdbdfa1a1188 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77d55af2-92db-4882-a218-690b4752270f", "name": "network-vif-plugged", "status": "completed", "tag": "41a4e1ef-a14b-421b-b753-fcdfbfdc42c2"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:10:25.610375 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-f005dccb-ed52-4ed6-85a7-b4a7436ed63a req-d8ec2acd-d699-4264-87b8-fdbdfa1a1188 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:25.611101 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-f005dccb-ed52-4ed6-85a7-b4a7436ed63a req-d8ec2acd-d699-4264-87b8-fdbdfa1a1188 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:25.611688 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-f005dccb-ed52-4ed6-85a7-b4a7436ed63a req-d8ec2acd-d699-4264-87b8-fdbdfa1a1188 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:25.628189 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-f005dccb-ed52-4ed6-85a7-b4a7436ed63a req-d8ec2acd-d699-4264-87b8-fdbdfa1a1188 service nova] Creating event network-vif-plugged:41a4e1ef-a14b-421b-b753-fcdfbfdc42c2 for instance 77d55af2-92db-4882-a218-690b4752270f on n-h1-852278-4 Aug 27 03:10:25.634223 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-f005dccb-ed52-4ed6-85a7-b4a7436ed63a req-d8ec2acd-d699-4264-87b8-fdbdfa1a1188 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047644 Aug 27 03:10:25.635379 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2561/5163] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:10:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:10:26.117181 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d527be18-0bf0-490e-9af6-fcaeb60af1d4 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:26.117793 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d527be18-0bf0-490e-9af6-fcaeb60af1d4 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 77d55af2-92db-4882-a218-690b4752270f] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:26.148511 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d527be18-0bf0-490e-9af6-fcaeb60af1d4 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:26.149028 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d527be18-0bf0-490e-9af6-fcaeb60af1d4 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:26.151112 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d527be18-0bf0-490e-9af6-fcaeb60af1d4 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:26.151996 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d527be18-0bf0-490e-9af6-fcaeb60af1d4 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:26.155687 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d527be18-0bf0-490e-9af6-fcaeb60af1d4 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:26.156595 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d527be18-0bf0-490e-9af6-fcaeb60af1d4 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:26.291432 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-348601a1-04ff-4194-aeda-e1b60dbae315 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:26.292216 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-348601a1-04ff-4194-aeda-e1b60dbae315 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] [instance: e3b6b87a-f60c-4bda-8591-0c387e31bb4f] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:26.304797 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-348601a1-04ff-4194-aeda-e1b60dbae315 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:26.305295 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-348601a1-04ff-4194-aeda-e1b60dbae315 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:26.309217 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-348601a1-04ff-4194-aeda-e1b60dbae315 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:26.311011 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-348601a1-04ff-4194-aeda-e1b60dbae315 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:26.311710 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-348601a1-04ff-4194-aeda-e1b60dbae315 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:26.312296 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-348601a1-04ff-4194-aeda-e1b60dbae315 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:26.465584 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d527be18-0bf0-490e-9af6-fcaeb60af1d4 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a549f85910184bf7a697cce7fa3dff96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92af206e05f44cf948b7c25d1acc139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:26.474165 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d527be18-0bf0-490e-9af6-fcaeb60af1d4 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "GET /compute/v2.1/servers/77d55af2-92db-4882-a218-690b4752270f" status: 200 len: 1367 microversion: 2.1 time: 0.360766 Aug 27 03:10:26.474761 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2603/5164] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:26 2022] GET /compute/v2.1/servers/77d55af2-92db-4882-a218-690b4752270f => generated 1367 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:26.570104 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-348601a1-04ff-4194-aeda-e1b60dbae315 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '355b96770f7e4f338ef21fc49c8de54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971ec7583d924ac3981bc789db78a733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:26.581212 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-348601a1-04ff-4194-aeda-e1b60dbae315 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] 10.222.0.70 "GET /compute/v2.1/servers/e3b6b87a-f60c-4bda-8591-0c387e31bb4f" status: 200 len: 1271 microversion: 2.1 time: 0.299130 Aug 27 03:10:26.583217 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2562/5165] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:26 2022] GET /compute/v2.1/servers/e3b6b87a-f60c-4bda-8591-0c387e31bb4f => generated 1271 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:27.496531 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7aadf6cc-17e2-4d39-8759-67e7e35e47b3 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:27.497697 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-7aadf6cc-17e2-4d39-8759-67e7e35e47b3 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 77d55af2-92db-4882-a218-690b4752270f] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:27.505698 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7aadf6cc-17e2-4d39-8759-67e7e35e47b3 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:27.506542 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7aadf6cc-17e2-4d39-8759-67e7e35e47b3 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:27.507354 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7aadf6cc-17e2-4d39-8759-67e7e35e47b3 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:27.508300 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7aadf6cc-17e2-4d39-8759-67e7e35e47b3 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:27.509006 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7aadf6cc-17e2-4d39-8759-67e7e35e47b3 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:27.509616 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7aadf6cc-17e2-4d39-8759-67e7e35e47b3 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:27.606866 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-1bf9e55f-126e-4e0c-bdda-c95c9de753ce tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:27.607428 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-1bf9e55f-126e-4e0c-bdda-c95c9de753ce tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] [instance: e3b6b87a-f60c-4bda-8591-0c387e31bb4f] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:27.617664 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1bf9e55f-126e-4e0c-bdda-c95c9de753ce tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:27.618157 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1bf9e55f-126e-4e0c-bdda-c95c9de753ce tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:27.619042 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1bf9e55f-126e-4e0c-bdda-c95c9de753ce tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:27.621144 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1bf9e55f-126e-4e0c-bdda-c95c9de753ce tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:27.621610 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1bf9e55f-126e-4e0c-bdda-c95c9de753ce tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:27.622220 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1bf9e55f-126e-4e0c-bdda-c95c9de753ce tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:27.710650 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-7aadf6cc-17e2-4d39-8759-67e7e35e47b3 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a549f85910184bf7a697cce7fa3dff96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92af206e05f44cf948b7c25d1acc139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:27.720756 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-7aadf6cc-17e2-4d39-8759-67e7e35e47b3 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "GET /compute/v2.1/servers/77d55af2-92db-4882-a218-690b4752270f" status: 200 len: 1556 microversion: 2.1 time: 0.228330 Aug 27 03:10:27.737797 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2604/5166] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:27 2022] GET /compute/v2.1/servers/77d55af2-92db-4882-a218-690b4752270f => generated 1556 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:27.744859 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f71e0683-c856-4be2-8daf-fc84ec640995 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:27.745652 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-f71e0683-c856-4be2-8daf-fc84ec640995 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 77d55af2-92db-4882-a218-690b4752270f] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:27.752887 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f71e0683-c856-4be2-8daf-fc84ec640995 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:27.753559 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f71e0683-c856-4be2-8daf-fc84ec640995 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:27.754222 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f71e0683-c856-4be2-8daf-fc84ec640995 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:27.755789 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f71e0683-c856-4be2-8daf-fc84ec640995 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:27.756443 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f71e0683-c856-4be2-8daf-fc84ec640995 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:27.757018 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f71e0683-c856-4be2-8daf-fc84ec640995 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:27.947775 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-f71e0683-c856-4be2-8daf-fc84ec640995 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "GET /compute/v2.1/servers/77d55af2-92db-4882-a218-690b4752270f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.207435 Aug 27 03:10:27.948558 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2605/5167] 10.222.0.70 () {58 vars in 1275 bytes} [Sat Aug 27 03:10:27 2022] GET /compute/v2.1/servers/77d55af2-92db-4882-a218-690b4752270f/os-interface => generated 284 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:10:27.957727 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-1bf9e55f-126e-4e0c-bdda-c95c9de753ce tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '355b96770f7e4f338ef21fc49c8de54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971ec7583d924ac3981bc789db78a733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:27.966411 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-1bf9e55f-126e-4e0c-bdda-c95c9de753ce tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] 10.222.0.70 "GET /compute/v2.1/servers/e3b6b87a-f60c-4bda-8591-0c387e31bb4f" status: 200 len: 1271 microversion: 2.1 time: 0.367253 Aug 27 03:10:27.969663 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2563/5168] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:27 2022] GET /compute/v2.1/servers/e3b6b87a-f60c-4bda-8591-0c387e31bb4f => generated 1271 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:28.925173 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-00ea6315-5454-4acd-88a8-46ac3b7cb869 req-3a989d94-db94-46be-af9b-dcc6e82111ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3b6b87a-f60c-4bda-8591-0c387e31bb4f", "name": "network-vif-plugged", "status": "completed", "tag": "d9c24bb5-0bef-42a7-bf54-a86f3cdac10f"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:10:28.942961 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-00ea6315-5454-4acd-88a8-46ac3b7cb869 req-3a989d94-db94-46be-af9b-dcc6e82111ae service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:28.947395 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-00ea6315-5454-4acd-88a8-46ac3b7cb869 req-3a989d94-db94-46be-af9b-dcc6e82111ae service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:28.948896 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-00ea6315-5454-4acd-88a8-46ac3b7cb869 req-3a989d94-db94-46be-af9b-dcc6e82111ae service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:28.993182 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e12c41ce-3183-44e8-b700-1f68db99bc45 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:28.993917 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-e12c41ce-3183-44e8-b700-1f68db99bc45 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] [instance: e3b6b87a-f60c-4bda-8591-0c387e31bb4f] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:28.994568 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-00ea6315-5454-4acd-88a8-46ac3b7cb869 req-3a989d94-db94-46be-af9b-dcc6e82111ae service nova] Creating event network-vif-plugged:d9c24bb5-0bef-42a7-bf54-a86f3cdac10f for instance e3b6b87a-f60c-4bda-8591-0c387e31bb4f on n-h2-852278-4 Aug 27 03:10:29.005909 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-00ea6315-5454-4acd-88a8-46ac3b7cb869 req-3a989d94-db94-46be-af9b-dcc6e82111ae service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085024 Aug 27 03:10:29.009928 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2606/5169] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:10:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:10:29.024152 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e12c41ce-3183-44e8-b700-1f68db99bc45 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:29.024691 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e12c41ce-3183-44e8-b700-1f68db99bc45 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:29.025135 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e12c41ce-3183-44e8-b700-1f68db99bc45 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:29.025879 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e12c41ce-3183-44e8-b700-1f68db99bc45 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:29.026360 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e12c41ce-3183-44e8-b700-1f68db99bc45 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:29.026800 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e12c41ce-3183-44e8-b700-1f68db99bc45 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:29.543065 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-e12c41ce-3183-44e8-b700-1f68db99bc45 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '355b96770f7e4f338ef21fc49c8de54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971ec7583d924ac3981bc789db78a733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:29.551874 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e12c41ce-3183-44e8-b700-1f68db99bc45 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] 10.222.0.70 "GET /compute/v2.1/servers/e3b6b87a-f60c-4bda-8591-0c387e31bb4f" status: 200 len: 1271 microversion: 2.1 time: 0.565110 Aug 27 03:10:29.557568 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2564/5170] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:28 2022] GET /compute/v2.1/servers/e3b6b87a-f60c-4bda-8591-0c387e31bb4f => generated 1271 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:10:30.032886 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-63b901cc-bc76-4bc3-bf3d-c5849d5157ca req-ecf0ba03-858e-4d87-9b0d-e125b4184576 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77d55af2-92db-4882-a218-690b4752270f", "tag": "41a4e1ef-a14b-421b-b753-fcdfbfdc42c2"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:10:30.058541 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-63b901cc-bc76-4bc3-bf3d-c5849d5157ca req-ecf0ba03-858e-4d87-9b0d-e125b4184576 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:30.059415 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-63b901cc-bc76-4bc3-bf3d-c5849d5157ca req-ecf0ba03-858e-4d87-9b0d-e125b4184576 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:30.059863 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-63b901cc-bc76-4bc3-bf3d-c5849d5157ca req-ecf0ba03-858e-4d87-9b0d-e125b4184576 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:30.083509 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-63b901cc-bc76-4bc3-bf3d-c5849d5157ca req-ecf0ba03-858e-4d87-9b0d-e125b4184576 service nova] Creating event network-changed:41a4e1ef-a14b-421b-b753-fcdfbfdc42c2 for instance 77d55af2-92db-4882-a218-690b4752270f on n-h1-852278-4 Aug 27 03:10:30.101105 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-63b901cc-bc76-4bc3-bf3d-c5849d5157ca req-ecf0ba03-858e-4d87-9b0d-e125b4184576 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071976 Aug 27 03:10:30.101573 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2607/5171] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:10:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:10:30.578764 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5f01a728-33a1-492e-b85c-4c5f11508501 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:30.579483 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-5f01a728-33a1-492e-b85c-4c5f11508501 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] [instance: e3b6b87a-f60c-4bda-8591-0c387e31bb4f] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:30.594869 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5f01a728-33a1-492e-b85c-4c5f11508501 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:30.595845 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5f01a728-33a1-492e-b85c-4c5f11508501 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:30.596547 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5f01a728-33a1-492e-b85c-4c5f11508501 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:30.600642 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5f01a728-33a1-492e-b85c-4c5f11508501 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:30.601409 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5f01a728-33a1-492e-b85c-4c5f11508501 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:30.602165 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5f01a728-33a1-492e-b85c-4c5f11508501 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:30.955843 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-5f01a728-33a1-492e-b85c-4c5f11508501 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '355b96770f7e4f338ef21fc49c8de54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971ec7583d924ac3981bc789db78a733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:30.980747 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-5f01a728-33a1-492e-b85c-4c5f11508501 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] 10.222.0.70 "GET /compute/v2.1/servers/e3b6b87a-f60c-4bda-8591-0c387e31bb4f" status: 200 len: 1271 microversion: 2.1 time: 0.406295 Aug 27 03:10:30.983833 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2565/5172] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:30 2022] GET /compute/v2.1/servers/e3b6b87a-f60c-4bda-8591-0c387e31bb4f => generated 1271 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:32.009674 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-eda21816-c140-4d88-a65e-ae3cd6b5533b tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:32.011687 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-eda21816-c140-4d88-a65e-ae3cd6b5533b tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] [instance: e3b6b87a-f60c-4bda-8591-0c387e31bb4f] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:32.019205 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eda21816-c140-4d88-a65e-ae3cd6b5533b tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:32.020063 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eda21816-c140-4d88-a65e-ae3cd6b5533b tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:32.021356 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eda21816-c140-4d88-a65e-ae3cd6b5533b tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:32.022416 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eda21816-c140-4d88-a65e-ae3cd6b5533b tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:32.023161 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eda21816-c140-4d88-a65e-ae3cd6b5533b tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:32.023815 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eda21816-c140-4d88-a65e-ae3cd6b5533b tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:32.247572 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-eda21816-c140-4d88-a65e-ae3cd6b5533b tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '355b96770f7e4f338ef21fc49c8de54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971ec7583d924ac3981bc789db78a733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:32.256025 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-eda21816-c140-4d88-a65e-ae3cd6b5533b tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] 10.222.0.70 "GET /compute/v2.1/servers/e3b6b87a-f60c-4bda-8591-0c387e31bb4f" status: 200 len: 1459 microversion: 2.1 time: 0.252589 Aug 27 03:10:32.257240 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2608/5173] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:32 2022] GET /compute/v2.1/servers/e3b6b87a-f60c-4bda-8591-0c387e31bb4f => generated 1459 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:32.279257 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4a111598-8726-4773-8380-d8c130b0eeed tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:32.280569 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-4a111598-8726-4773-8380-d8c130b0eeed tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] [instance: e3b6b87a-f60c-4bda-8591-0c387e31bb4f] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:32.288886 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4a111598-8726-4773-8380-d8c130b0eeed tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:32.289940 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4a111598-8726-4773-8380-d8c130b0eeed tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:32.290124 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4a111598-8726-4773-8380-d8c130b0eeed tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:32.291094 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4a111598-8726-4773-8380-d8c130b0eeed tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:32.291876 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4a111598-8726-4773-8380-d8c130b0eeed tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:32.292531 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4a111598-8726-4773-8380-d8c130b0eeed tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:32.657732 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-4a111598-8726-4773-8380-d8c130b0eeed tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '355b96770f7e4f338ef21fc49c8de54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971ec7583d924ac3981bc789db78a733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:32.669183 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-4a111598-8726-4773-8380-d8c130b0eeed tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] 10.222.0.70 "GET /compute/v2.1/servers/e3b6b87a-f60c-4bda-8591-0c387e31bb4f" status: 200 len: 1459 microversion: 2.1 time: 0.395136 Aug 27 03:10:32.692841 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2566/5174] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:32 2022] GET /compute/v2.1/servers/e3b6b87a-f60c-4bda-8591-0c387e31bb4f => generated 1459 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:35.218975 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-4790335e-ec98-4956-a5e6-dbf67be09cc1 req-d4e5cc0e-5a1d-4feb-8d2d-2982666a12b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3b6b87a-f60c-4bda-8591-0c387e31bb4f", "tag": "d9c24bb5-0bef-42a7-bf54-a86f3cdac10f"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:10:35.238145 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-4790335e-ec98-4956-a5e6-dbf67be09cc1 req-d4e5cc0e-5a1d-4feb-8d2d-2982666a12b6 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:35.238635 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-4790335e-ec98-4956-a5e6-dbf67be09cc1 req-d4e5cc0e-5a1d-4feb-8d2d-2982666a12b6 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:35.239071 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-4790335e-ec98-4956-a5e6-dbf67be09cc1 req-d4e5cc0e-5a1d-4feb-8d2d-2982666a12b6 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:35.267229 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-4790335e-ec98-4956-a5e6-dbf67be09cc1 req-d4e5cc0e-5a1d-4feb-8d2d-2982666a12b6 service nova] Creating event network-changed:d9c24bb5-0bef-42a7-bf54-a86f3cdac10f for instance e3b6b87a-f60c-4bda-8591-0c387e31bb4f on n-h2-852278-4 Aug 27 03:10:35.278540 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-4790335e-ec98-4956-a5e6-dbf67be09cc1 req-d4e5cc0e-5a1d-4feb-8d2d-2982666a12b6 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063900 Aug 27 03:10:35.279167 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2609/5175] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:10:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:10:37.411696 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-02b77379-e394-415c-84bc-5cfb565a0c91 req-b1278ac1-93a0-4e19-84ce-481dfb5b0f2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3b6b87a-f60c-4bda-8591-0c387e31bb4f", "tag": "d9c24bb5-0bef-42a7-bf54-a86f3cdac10f"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:10:37.443993 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-02b77379-e394-415c-84bc-5cfb565a0c91 req-b1278ac1-93a0-4e19-84ce-481dfb5b0f2d service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:37.443993 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-02b77379-e394-415c-84bc-5cfb565a0c91 req-b1278ac1-93a0-4e19-84ce-481dfb5b0f2d service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:37.443993 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-02b77379-e394-415c-84bc-5cfb565a0c91 req-b1278ac1-93a0-4e19-84ce-481dfb5b0f2d service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:37.468575 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-02b77379-e394-415c-84bc-5cfb565a0c91 req-b1278ac1-93a0-4e19-84ce-481dfb5b0f2d service nova] Creating event network-changed:d9c24bb5-0bef-42a7-bf54-a86f3cdac10f for instance e3b6b87a-f60c-4bda-8591-0c387e31bb4f on n-h2-852278-4 Aug 27 03:10:37.472233 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-02b77379-e394-415c-84bc-5cfb565a0c91 req-b1278ac1-93a0-4e19-84ce-481dfb5b0f2d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064754 Aug 27 03:10:37.473622 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2567/5176] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:10:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:10:39.493905 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-80c21789-80ad-4ffb-9278-cf7bdf4809e5 req-efd38508-b887-4590-92be-f6fa796737d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3b6b87a-f60c-4bda-8591-0c387e31bb4f", "tag": "d9c24bb5-0bef-42a7-bf54-a86f3cdac10f"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:10:39.535973 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-80c21789-80ad-4ffb-9278-cf7bdf4809e5 req-efd38508-b887-4590-92be-f6fa796737d7 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:39.540714 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-80c21789-80ad-4ffb-9278-cf7bdf4809e5 req-efd38508-b887-4590-92be-f6fa796737d7 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:39.543384 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-80c21789-80ad-4ffb-9278-cf7bdf4809e5 req-efd38508-b887-4590-92be-f6fa796737d7 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:39.577504 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-80c21789-80ad-4ffb-9278-cf7bdf4809e5 req-efd38508-b887-4590-92be-f6fa796737d7 service nova] Creating event network-changed:d9c24bb5-0bef-42a7-bf54-a86f3cdac10f for instance e3b6b87a-f60c-4bda-8591-0c387e31bb4f on n-h2-852278-4 Aug 27 03:10:39.585584 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-80c21789-80ad-4ffb-9278-cf7bdf4809e5 req-efd38508-b887-4590-92be-f6fa796737d7 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096224 Aug 27 03:10:39.587459 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2610/5177] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:10:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:10:42.373359 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4e5d9ccb-12f0-4842-ac8e-96a3efa58c25 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-607744183", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "networks": [{"uuid": "daeace72-47da-4a10-b3e2-1b6dcf17ffaa"}]}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:10:42.432899 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.network.neutron [None req-4e5d9ccb-12f0-4842-ac8e-96a3efa58c25 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] validate_networks() for [('daeace72-47da-4a10-b3e2-1b6dcf17ffaa', None, None, None, None, None)] {{(pid=134052) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:10:42.928743 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-4e5d9ccb-12f0-4842-ac8e-96a3efa58c25 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Flavor limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:10:42.929169 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-4e5d9ccb-12f0-4842-ac8e-96a3efa58c25 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Image limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:10:42.929651 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-4e5d9ccb-12f0-4842-ac8e-96a3efa58c25 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Flavor pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:10:42.930059 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-4e5d9ccb-12f0-4842-ac8e-96a3efa58c25 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Image pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:10:42.930475 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-4e5d9ccb-12f0-4842-ac8e-96a3efa58c25 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:10:42.939802 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4e5d9ccb-12f0-4842-ac8e-96a3efa58c25 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:42.940285 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4e5d9ccb-12f0-4842-ac8e-96a3efa58c25 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:42.940750 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4e5d9ccb-12f0-4842-ac8e-96a3efa58c25 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:42.941481 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4e5d9ccb-12f0-4842-ac8e-96a3efa58c25 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:42.941933 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4e5d9ccb-12f0-4842-ac8e-96a3efa58c25 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:42.942359 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4e5d9ccb-12f0-4842-ac8e-96a3efa58c25 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:42.960363 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-4e5d9ccb-12f0-4842-ac8e-96a3efa58c25 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Getting quotas for project 852f3aff4a69491abbd546875918b004. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:10:42.966544 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-4e5d9ccb-12f0-4842-ac8e-96a3efa58c25 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Getting quotas for user e2b68d81dbdb474cac2060aa9d7bb502 and project 852f3aff4a69491abbd546875918b004. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:10:42.979676 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-4e5d9ccb-12f0-4842-ac8e-96a3efa58c25 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Going to run 1 instances... {{(pid=134052) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:10:42.982184 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-4e5d9ccb-12f0-4842-ac8e-96a3efa58c25 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] [instance: ecf965e2-f12b-48bf-852c-4ddb1e930f5c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134052) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:10:43.039333 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-4e5d9ccb-12f0-4842-ac8e-96a3efa58c25 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.673158 Aug 27 03:10:43.040475 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2568/5178] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 03:10:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 675 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:10:43.074051 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-97a0f24b-f303-494c-8e42-068168fd64e3 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:43.093375 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-97a0f24b-f303-494c-8e42-068168fd64e3 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] [instance: ecf965e2-f12b-48bf-852c-4ddb1e930f5c] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:43.095729 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=43 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:10:43.194536 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-97a0f24b-f303-494c-8e42-068168fd64e3 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b68d81dbdb474cac2060aa9d7bb502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852f3aff4a69491abbd546875918b004', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:43.202774 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-97a0f24b-f303-494c-8e42-068168fd64e3 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] 10.222.0.70 "GET /compute/v2.1/servers/ecf965e2-f12b-48bf-852c-4ddb1e930f5c" status: 200 len: 1218 microversion: 2.1 time: 0.153995 Aug 27 03:10:43.202774 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2611/5179] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:43 2022] GET /compute/v2.1/servers/ecf965e2-f12b-48bf-852c-4ddb1e930f5c => generated 1218 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:10:44.224095 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-7c73d11f-882a-4a95-93cf-a7fa110ac88e tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:44.224733 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-7c73d11f-882a-4a95-93cf-a7fa110ac88e tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] [instance: ecf965e2-f12b-48bf-852c-4ddb1e930f5c] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:44.233449 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7c73d11f-882a-4a95-93cf-a7fa110ac88e tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:44.234153 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7c73d11f-882a-4a95-93cf-a7fa110ac88e tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:44.234794 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7c73d11f-882a-4a95-93cf-a7fa110ac88e tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:44.235511 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7c73d11f-882a-4a95-93cf-a7fa110ac88e tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:44.235965 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7c73d11f-882a-4a95-93cf-a7fa110ac88e tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:44.236421 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7c73d11f-882a-4a95-93cf-a7fa110ac88e tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:44.308385 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-7c73d11f-882a-4a95-93cf-a7fa110ac88e tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b68d81dbdb474cac2060aa9d7bb502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852f3aff4a69491abbd546875918b004', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:44.320856 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=100 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:10:44.325359 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-7c73d11f-882a-4a95-93cf-a7fa110ac88e tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] 10.222.0.70 "GET /compute/v2.1/servers/ecf965e2-f12b-48bf-852c-4ddb1e930f5c" status: 200 len: 1270 microversion: 2.1 time: 0.106212 Aug 27 03:10:44.326565 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2569/5180] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:44 2022] GET /compute/v2.1/servers/ecf965e2-f12b-48bf-852c-4ddb1e930f5c => generated 1270 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:45.359148 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b398b20b-c9a4-4463-9ec9-86994561757e tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:45.360437 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b398b20b-c9a4-4463-9ec9-86994561757e tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] [instance: ecf965e2-f12b-48bf-852c-4ddb1e930f5c] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:45.373079 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b398b20b-c9a4-4463-9ec9-86994561757e tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:45.373857 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b398b20b-c9a4-4463-9ec9-86994561757e tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:45.375869 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b398b20b-c9a4-4463-9ec9-86994561757e tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:45.376634 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b398b20b-c9a4-4463-9ec9-86994561757e tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:45.377289 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b398b20b-c9a4-4463-9ec9-86994561757e tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:45.378732 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b398b20b-c9a4-4463-9ec9-86994561757e tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:45.407554 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=94 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:10:45.690952 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-b398b20b-c9a4-4463-9ec9-86994561757e tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b68d81dbdb474cac2060aa9d7bb502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852f3aff4a69491abbd546875918b004', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:45.699080 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b398b20b-c9a4-4463-9ec9-86994561757e tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] 10.222.0.70 "GET /compute/v2.1/servers/ecf965e2-f12b-48bf-852c-4ddb1e930f5c" status: 200 len: 1318 microversion: 2.1 time: 0.348625 Aug 27 03:10:45.700003 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2612/5181] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:45 2022] GET /compute/v2.1/servers/ecf965e2-f12b-48bf-852c-4ddb1e930f5c => generated 1318 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:46.283580 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-7a1e944e-3eeb-405a-a245-a18ad6df0703 req-491c2fc0-b268-4395-a1e9-3d32eef7ea00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecf965e2-f12b-48bf-852c-4ddb1e930f5c", "tag": "d2237cb6-ff7b-4cf9-b5d8-bd5e428d4ed4"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:10:46.318205 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-7a1e944e-3eeb-405a-a245-a18ad6df0703 req-491c2fc0-b268-4395-a1e9-3d32eef7ea00 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:46.318698 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-7a1e944e-3eeb-405a-a245-a18ad6df0703 req-491c2fc0-b268-4395-a1e9-3d32eef7ea00 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:46.319135 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-7a1e944e-3eeb-405a-a245-a18ad6df0703 req-491c2fc0-b268-4395-a1e9-3d32eef7ea00 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:46.340811 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-7a1e944e-3eeb-405a-a245-a18ad6df0703 req-491c2fc0-b268-4395-a1e9-3d32eef7ea00 service nova] Creating event network-changed:d2237cb6-ff7b-4cf9-b5d8-bd5e428d4ed4 for instance ecf965e2-f12b-48bf-852c-4ddb1e930f5c on n-h2-852278-4 Aug 27 03:10:46.352155 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-7a1e944e-3eeb-405a-a245-a18ad6df0703 req-491c2fc0-b268-4395-a1e9-3d32eef7ea00 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075059 Aug 27 03:10:46.357150 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2570/5182] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:10:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:10:46.724814 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-57c959ca-d168-4e0e-98e2-c550f884f8b1 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:46.725451 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-57c959ca-d168-4e0e-98e2-c550f884f8b1 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] [instance: ecf965e2-f12b-48bf-852c-4ddb1e930f5c] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:46.749242 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-57c959ca-d168-4e0e-98e2-c550f884f8b1 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:46.749993 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-57c959ca-d168-4e0e-98e2-c550f884f8b1 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:46.750440 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-57c959ca-d168-4e0e-98e2-c550f884f8b1 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:46.751183 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-57c959ca-d168-4e0e-98e2-c550f884f8b1 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:46.751653 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-57c959ca-d168-4e0e-98e2-c550f884f8b1 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:46.752080 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-57c959ca-d168-4e0e-98e2-c550f884f8b1 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:47.520131 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-57c959ca-d168-4e0e-98e2-c550f884f8b1 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b68d81dbdb474cac2060aa9d7bb502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852f3aff4a69491abbd546875918b004', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:47.529148 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-57c959ca-d168-4e0e-98e2-c550f884f8b1 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] 10.222.0.70 "GET /compute/v2.1/servers/ecf965e2-f12b-48bf-852c-4ddb1e930f5c" status: 200 len: 1318 microversion: 2.1 time: 0.812253 Aug 27 03:10:47.529742 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2613/5183] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:46 2022] GET /compute/v2.1/servers/ecf965e2-f12b-48bf-852c-4ddb1e930f5c => generated 1318 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:48.550833 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0da63bfa-d571-4ab0-8081-ff0f0e7b2450 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:48.552161 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-0da63bfa-d571-4ab0-8081-ff0f0e7b2450 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] [instance: ecf965e2-f12b-48bf-852c-4ddb1e930f5c] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:48.556217 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:10:48.567009 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0da63bfa-d571-4ab0-8081-ff0f0e7b2450 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:48.568761 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0da63bfa-d571-4ab0-8081-ff0f0e7b2450 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:48.569559 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0da63bfa-d571-4ab0-8081-ff0f0e7b2450 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:48.570440 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0da63bfa-d571-4ab0-8081-ff0f0e7b2450 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:48.571031 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0da63bfa-d571-4ab0-8081-ff0f0e7b2450 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:48.571609 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0da63bfa-d571-4ab0-8081-ff0f0e7b2450 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:48.839087 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0da63bfa-d571-4ab0-8081-ff0f0e7b2450 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b68d81dbdb474cac2060aa9d7bb502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852f3aff4a69491abbd546875918b004', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:48.852704 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-0da63bfa-d571-4ab0-8081-ff0f0e7b2450 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] 10.222.0.70 "GET /compute/v2.1/servers/ecf965e2-f12b-48bf-852c-4ddb1e930f5c" status: 200 len: 1318 microversion: 2.1 time: 0.305271 Aug 27 03:10:48.857410 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2571/5184] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:48 2022] GET /compute/v2.1/servers/ecf965e2-f12b-48bf-852c-4ddb1e930f5c => generated 1318 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:49.877097 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-613f08ec-eaf3-4749-8c2e-4d98e6c721d4 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:49.877606 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-613f08ec-eaf3-4749-8c2e-4d98e6c721d4 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] [instance: ecf965e2-f12b-48bf-852c-4ddb1e930f5c] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:49.884617 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-613f08ec-eaf3-4749-8c2e-4d98e6c721d4 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:49.885326 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-613f08ec-eaf3-4749-8c2e-4d98e6c721d4 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:49.885792 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-613f08ec-eaf3-4749-8c2e-4d98e6c721d4 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:49.886547 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-613f08ec-eaf3-4749-8c2e-4d98e6c721d4 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:49.886994 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-613f08ec-eaf3-4749-8c2e-4d98e6c721d4 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:49.887417 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-613f08ec-eaf3-4749-8c2e-4d98e6c721d4 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:50.071299 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-613f08ec-eaf3-4749-8c2e-4d98e6c721d4 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b68d81dbdb474cac2060aa9d7bb502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852f3aff4a69491abbd546875918b004', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:50.081364 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-613f08ec-eaf3-4749-8c2e-4d98e6c721d4 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] 10.222.0.70 "GET /compute/v2.1/servers/ecf965e2-f12b-48bf-852c-4ddb1e930f5c" status: 200 len: 1318 microversion: 2.1 time: 0.208126 Aug 27 03:10:50.082967 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2614/5185] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:49 2022] GET /compute/v2.1/servers/ecf965e2-f12b-48bf-852c-4ddb1e930f5c => generated 1318 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:51.114687 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-166c1992-b846-4222-b978-d782141cb197 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:51.115319 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-166c1992-b846-4222-b978-d782141cb197 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] [instance: ecf965e2-f12b-48bf-852c-4ddb1e930f5c] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:51.144071 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-166c1992-b846-4222-b978-d782141cb197 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:51.144600 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-166c1992-b846-4222-b978-d782141cb197 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:51.145049 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-166c1992-b846-4222-b978-d782141cb197 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:51.145810 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-166c1992-b846-4222-b978-d782141cb197 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:51.146257 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-166c1992-b846-4222-b978-d782141cb197 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:51.146669 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-166c1992-b846-4222-b978-d782141cb197 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:51.351977 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-166c1992-b846-4222-b978-d782141cb197 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b68d81dbdb474cac2060aa9d7bb502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852f3aff4a69491abbd546875918b004', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:51.377116 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-166c1992-b846-4222-b978-d782141cb197 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] 10.222.0.70 "GET /compute/v2.1/servers/ecf965e2-f12b-48bf-852c-4ddb1e930f5c" status: 200 len: 1318 microversion: 2.1 time: 0.267434 Aug 27 03:10:51.377723 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2572/5186] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:51 2022] GET /compute/v2.1/servers/ecf965e2-f12b-48bf-852c-4ddb1e930f5c => generated 1318 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:52.398577 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ddcb2dbf-f02c-432b-a578-ef985b806d5a tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:52.399948 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-ddcb2dbf-f02c-432b-a578-ef985b806d5a tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] [instance: ecf965e2-f12b-48bf-852c-4ddb1e930f5c] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:52.407252 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ddcb2dbf-f02c-432b-a578-ef985b806d5a tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:52.408077 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ddcb2dbf-f02c-432b-a578-ef985b806d5a tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:52.408536 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ddcb2dbf-f02c-432b-a578-ef985b806d5a tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:52.409609 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ddcb2dbf-f02c-432b-a578-ef985b806d5a tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:52.410134 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ddcb2dbf-f02c-432b-a578-ef985b806d5a tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:52.410788 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ddcb2dbf-f02c-432b-a578-ef985b806d5a tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:52.620759 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-ddcb2dbf-f02c-432b-a578-ef985b806d5a tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b68d81dbdb474cac2060aa9d7bb502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852f3aff4a69491abbd546875918b004', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:52.630270 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ddcb2dbf-f02c-432b-a578-ef985b806d5a tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] 10.222.0.70 "GET /compute/v2.1/servers/ecf965e2-f12b-48bf-852c-4ddb1e930f5c" status: 200 len: 1318 microversion: 2.1 time: 0.236053 Aug 27 03:10:52.630865 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2615/5187] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:52 2022] GET /compute/v2.1/servers/ecf965e2-f12b-48bf-852c-4ddb1e930f5c => generated 1318 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:52.935405 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-58156b1d-971d-442b-bc06-36285cd413c3 req-aa42807f-f1ba-4ff2-9790-b56e6715ae01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecf965e2-f12b-48bf-852c-4ddb1e930f5c", "name": "network-vif-plugged", "status": "completed", "tag": "d2237cb6-ff7b-4cf9-b5d8-bd5e428d4ed4"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:10:52.948953 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-58156b1d-971d-442b-bc06-36285cd413c3 req-aa42807f-f1ba-4ff2-9790-b56e6715ae01 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:52.949692 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-58156b1d-971d-442b-bc06-36285cd413c3 req-aa42807f-f1ba-4ff2-9790-b56e6715ae01 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:52.950310 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-58156b1d-971d-442b-bc06-36285cd413c3 req-aa42807f-f1ba-4ff2-9790-b56e6715ae01 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:52.955815 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:10:52.966732 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-58156b1d-971d-442b-bc06-36285cd413c3 req-aa42807f-f1ba-4ff2-9790-b56e6715ae01 service nova] Creating event network-vif-plugged:d2237cb6-ff7b-4cf9-b5d8-bd5e428d4ed4 for instance ecf965e2-f12b-48bf-852c-4ddb1e930f5c on n-h2-852278-4 Aug 27 03:10:52.981156 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-58156b1d-971d-442b-bc06-36285cd413c3 req-aa42807f-f1ba-4ff2-9790-b56e6715ae01 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055935 Aug 27 03:10:52.982871 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2573/5188] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:10:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:10:53.655740 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-fc1e858d-3567-4c04-b34c-7abf1b8e4d39 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:53.656544 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-fc1e858d-3567-4c04-b34c-7abf1b8e4d39 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] [instance: ecf965e2-f12b-48bf-852c-4ddb1e930f5c] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:53.658730 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:10:53.666702 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fc1e858d-3567-4c04-b34c-7abf1b8e4d39 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:53.667510 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fc1e858d-3567-4c04-b34c-7abf1b8e4d39 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:53.668113 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fc1e858d-3567-4c04-b34c-7abf1b8e4d39 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:53.669040 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fc1e858d-3567-4c04-b34c-7abf1b8e4d39 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:53.669513 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fc1e858d-3567-4c04-b34c-7abf1b8e4d39 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:53.669943 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fc1e858d-3567-4c04-b34c-7abf1b8e4d39 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:53.810830 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-fc1e858d-3567-4c04-b34c-7abf1b8e4d39 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b68d81dbdb474cac2060aa9d7bb502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852f3aff4a69491abbd546875918b004', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:53.820911 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-fc1e858d-3567-4c04-b34c-7abf1b8e4d39 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] 10.222.0.70 "GET /compute/v2.1/servers/ecf965e2-f12b-48bf-852c-4ddb1e930f5c" status: 200 len: 1318 microversion: 2.1 time: 0.168473 Aug 27 03:10:53.821912 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2616/5189] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:53 2022] GET /compute/v2.1/servers/ecf965e2-f12b-48bf-852c-4ddb1e930f5c => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:54.842270 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=6 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:10:54.848468 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-25bfdbd0-6e03-4b85-8e86-379b9f738e14 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:54.850202 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-25bfdbd0-6e03-4b85-8e86-379b9f738e14 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] [instance: ecf965e2-f12b-48bf-852c-4ddb1e930f5c] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:54.857347 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-25bfdbd0-6e03-4b85-8e86-379b9f738e14 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:54.857841 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-25bfdbd0-6e03-4b85-8e86-379b9f738e14 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:54.858354 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-25bfdbd0-6e03-4b85-8e86-379b9f738e14 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:54.859127 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-25bfdbd0-6e03-4b85-8e86-379b9f738e14 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:54.859627 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-25bfdbd0-6e03-4b85-8e86-379b9f738e14 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:54.860272 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-25bfdbd0-6e03-4b85-8e86-379b9f738e14 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:55.040815 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-25bfdbd0-6e03-4b85-8e86-379b9f738e14 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b68d81dbdb474cac2060aa9d7bb502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852f3aff4a69491abbd546875918b004', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:55.052212 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-25bfdbd0-6e03-4b85-8e86-379b9f738e14 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] 10.222.0.70 "GET /compute/v2.1/servers/ecf965e2-f12b-48bf-852c-4ddb1e930f5c" status: 200 len: 1507 microversion: 2.1 time: 0.210539 Aug 27 03:10:55.068352 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2574/5190] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:54 2022] GET /compute/v2.1/servers/ecf965e2-f12b-48bf-852c-4ddb1e930f5c => generated 1507 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:55.739178 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-9305863d-042b-4d77-8ce6-dda554093cbe tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:55.740882 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-9305863d-042b-4d77-8ce6-dda554093cbe tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:55.748402 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9305863d-042b-4d77-8ce6-dda554093cbe tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:55.749128 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9305863d-042b-4d77-8ce6-dda554093cbe tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:55.749769 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9305863d-042b-4d77-8ce6-dda554093cbe tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:55.750704 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9305863d-042b-4d77-8ce6-dda554093cbe tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:55.751388 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9305863d-042b-4d77-8ce6-dda554093cbe tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:55.751955 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9305863d-042b-4d77-8ce6-dda554093cbe tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:55.786234 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-9305863d-042b-4d77-8ce6-dda554093cbe tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22/os-volume_attachments/d985901a-c523-4a09-8411-9d19c7fd904d" status: 200 len: 194 microversion: 2.20 time: 0.051755 Aug 27 03:10:55.787549 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2617/5191] 10.222.0.70 () {60 vars in 1454 bytes} [Sat Aug 27 03:10:55 2022] GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22/os-volume_attachments/d985901a-c523-4a09-8411-9d19c7fd904d => generated 194 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:10:55.898163 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-cbba7096-e8f1-4cc8-9a80-195e50da353a tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:55.898879 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-cbba7096-e8f1-4cc8-9a80-195e50da353a tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:55.908400 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cbba7096-e8f1-4cc8-9a80-195e50da353a tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:55.909593 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cbba7096-e8f1-4cc8-9a80-195e50da353a tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:55.910451 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cbba7096-e8f1-4cc8-9a80-195e50da353a tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:55.911620 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cbba7096-e8f1-4cc8-9a80-195e50da353a tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:55.912441 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cbba7096-e8f1-4cc8-9a80-195e50da353a tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:55.913071 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cbba7096-e8f1-4cc8-9a80-195e50da353a tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:56.068158 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.instance [None req-cbba7096-e8f1-4cc8-9a80-195e50da353a tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lazy-loading 'services' on Instance uuid 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22 {{(pid=134052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:10:56.214248 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-cbba7096-e8f1-4cc8-9a80-195e50da353a tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "DELETE /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22/os-volume_attachments/d985901a-c523-4a09-8411-9d19c7fd904d" status: 202 len: 0 microversion: 2.20 time: 0.320232 Aug 27 03:10:56.215375 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2575/5192] 10.222.0.70 () {60 vars in 1457 bytes} [Sat Aug 27 03:10:55 2022] DELETE /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22/os-volume_attachments/d985901a-c523-4a09-8411-9d19c7fd904d => generated 0 bytes in 323 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:10:56.224557 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-2b505f42-4246-48b2-8ab9-a6529b9764f9 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:56.227689 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-2b505f42-4246-48b2-8ab9-a6529b9764f9 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:56.241544 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2b505f42-4246-48b2-8ab9-a6529b9764f9 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:56.243095 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2b505f42-4246-48b2-8ab9-a6529b9764f9 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:56.254917 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2b505f42-4246-48b2-8ab9-a6529b9764f9 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:56.257999 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2b505f42-4246-48b2-8ab9-a6529b9764f9 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:56.258494 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2b505f42-4246-48b2-8ab9-a6529b9764f9 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:56.258938 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2b505f42-4246-48b2-8ab9-a6529b9764f9 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:56.356711 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-2b505f42-4246-48b2-8ab9-a6529b9764f9 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.136755 Aug 27 03:10:56.358714 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2618/5193] 10.222.0.70 () {60 vars in 1343 bytes} [Sat Aug 27 03:10:56 2022] GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22/os-volume_attachments => generated 197 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 03:10:57.370671 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-15a45848-cf32-405b-9965-c6b4161a4afb tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:57.373144 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-15a45848-cf32-405b-9965-c6b4161a4afb tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:57.402514 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-15a45848-cf32-405b-9965-c6b4161a4afb tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:57.403009 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-15a45848-cf32-405b-9965-c6b4161a4afb tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:57.403451 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-15a45848-cf32-405b-9965-c6b4161a4afb tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:57.404168 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-15a45848-cf32-405b-9965-c6b4161a4afb tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:57.419290 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-15a45848-cf32-405b-9965-c6b4161a4afb tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:57.420758 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-15a45848-cf32-405b-9965-c6b4161a4afb tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:57.512794 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-15a45848-cf32-405b-9965-c6b4161a4afb tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.147155 Aug 27 03:10:57.514091 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2576/5194] 10.222.0.70 () {60 vars in 1343 bytes} [Sat Aug 27 03:10:57 2022] GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22/os-volume_attachments => generated 197 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:10:58.525263 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-550b119a-2f6b-42c4-a08a-2010bc1e668c tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:58.527742 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-550b119a-2f6b-42c4-a08a-2010bc1e668c tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:58.574123 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-550b119a-2f6b-42c4-a08a-2010bc1e668c tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:58.574626 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-550b119a-2f6b-42c4-a08a-2010bc1e668c tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:58.578500 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-550b119a-2f6b-42c4-a08a-2010bc1e668c tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:58.579267 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-550b119a-2f6b-42c4-a08a-2010bc1e668c tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:58.579734 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-550b119a-2f6b-42c4-a08a-2010bc1e668c tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:58.580169 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-550b119a-2f6b-42c4-a08a-2010bc1e668c tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:58.651603 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-550b119a-2f6b-42c4-a08a-2010bc1e668c tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.130373 Aug 27 03:10:58.654186 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2619/5195] 10.222.0.70 () {60 vars in 1343 bytes} [Sat Aug 27 03:10:58 2022] GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22/os-volume_attachments => generated 197 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:10:59.184443 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-fad4496c-5177-467a-8151-87ef0f3215e8 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:59.184992 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-fad4496c-5177-467a-8151-87ef0f3215e8 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 77d55af2-92db-4882-a218-690b4752270f] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:59.194381 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fad4496c-5177-467a-8151-87ef0f3215e8 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:59.194865 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fad4496c-5177-467a-8151-87ef0f3215e8 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:59.195297 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fad4496c-5177-467a-8151-87ef0f3215e8 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:59.196012 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fad4496c-5177-467a-8151-87ef0f3215e8 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:59.196491 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fad4496c-5177-467a-8151-87ef0f3215e8 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:59.196912 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fad4496c-5177-467a-8151-87ef0f3215e8 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:59.264580 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-fad4496c-5177-467a-8151-87ef0f3215e8 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "GET /compute/v2.1/servers/77d55af2-92db-4882-a218-690b4752270f/ips" status: 200 len: 148 microversion: 2.1 time: 0.083964 Aug 27 03:10:59.265181 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2577/5196] 10.222.0.70 () {58 vars in 1248 bytes} [Sat Aug 27 03:10:59 2022] GET /compute/v2.1/servers/77d55af2-92db-4882-a218-690b4752270f/ips => generated 148 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:10:59.277458 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f0f3be91-76eb-46ee-bbb3-4c0cf6905f42 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7737120c-3e21-4aa7-bcde-628dd680682a"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:10:59.281123 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-f0f3be91-76eb-46ee-bbb3-4c0cf6905f42 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 77d55af2-92db-4882-a218-690b4752270f] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:59.297666 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f0f3be91-76eb-46ee-bbb3-4c0cf6905f42 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:59.299356 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f0f3be91-76eb-46ee-bbb3-4c0cf6905f42 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:59.300132 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f0f3be91-76eb-46ee-bbb3-4c0cf6905f42 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:59.301366 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f0f3be91-76eb-46ee-bbb3-4c0cf6905f42 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:59.303515 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f0f3be91-76eb-46ee-bbb3-4c0cf6905f42 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:59.304203 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f0f3be91-76eb-46ee-bbb3-4c0cf6905f42 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:59.469819 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-f0f3be91-76eb-46ee-bbb3-4c0cf6905f42 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] HTTP exception thrown: Invalid volume: volume 7737120c-3e21-4aa7-bcde-628dd680682a is already attached to instances: 28d2e08f-ea2f-42f2-beb5-bfdc368b9014 Aug 27 03:10:59.472273 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f0f3be91-76eb-46ee-bbb3-4c0cf6905f42 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Request method failure captured: Aug 27 03:10:59.472273 n-d-852278-4 devstack@n-api.service[134051]: request: POST /compute/v2.1/servers/77d55af2-92db-4882-a218-690b4752270f/os-volume_attachments HTTP/1.1 Aug 27 03:10:59.472273 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 03:10:59.472273 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 03:10:59.472273 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 03:10:59.472273 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 74 Aug 27 03:10:59.472273 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 03:10:59.472273 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 03:10:59.472273 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 03:10:59.472273 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 03:10:59.472273 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYq440P3xsAabxN7nGlE2F1Ccxicf_9DU586MSNagRbCITstsgHyyHbnbZoUsiVfiyCUhE6F_2SvHrXIrDKvSEnzb0XjME8fkYvCR9LlCkoQHUfv6A1aESh1h-tIQR1qbnjbVFsJiiWy_WcC2U4qzkQvsEYcwujqY5DDaX4NjUQt4DA Aug 27 03:10:59.472273 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 03:10:59.472273 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 03:10:59.472273 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 03:10:59.472273 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 03:10:59.472273 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 03:10:59.472273 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 03:10:59.472273 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: b92af206e05f44cf948b7c25d1acc139 Aug 27 03:10:59.472273 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-AttachVolumeNegativeTest-878461886 Aug 27 03:10:59.472273 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 03:10:59.472273 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 03:10:59.472273 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b92af206e05f44cf948b7c25d1acc139"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_b92af206e05f44cf948b7c25d1acc139", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b92af206e05f44cf948b7c25d1acc139"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/b92af206e05f44cf948b7c25d1acc139"}]}] Aug 27 03:10:59.472273 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-AttachVolumeNegativeTest-878461886 Aug 27 03:10:59.472273 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: b92af206e05f44cf948b7c25d1acc139 Aug 27 03:10:59.472273 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-878461886 Aug 27 03:10:59.472273 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-AttachVolumeNegativeTest-878461886-project Aug 27 03:10:59.472273 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 03:10:59.472273 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 03:10:59.472273 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: a549f85910184bf7a697cce7fa3dff96 Aug 27 03:10:59.472273 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-AttachVolumeNegativeTest-878461886-project Aug 27 03:10:59.472273 n-d-852278-4 devstack@n-api.service[134051]: Aug 27 03:10:59.472273 n-d-852278-4 devstack@n-api.service[134051]: {"volumeAttachment": {"volumeId": "7737120c-3e21-4aa7-bcde-628dd680682a"}} Aug 27 03:10:59.472273 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 03:10:59.472273 n-d-852278-4 devstack@n-api.service[134051]: exception: Invalid volume: volume 7737120c-3e21-4aa7-bcde-628dd680682a is already attached to instances: 28d2e08f-ea2f-42f2-beb5-bfdc368b9014 Aug 27 03:10:59.472273 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'server_id': '77d55af2-92db-4882-a218-690b4752270f', 'body': {'volumeAttachment': {'volumeId': '7737120c-3e21-4aa7-bcde-628dd680682a'}}} Aug 27 03:10:59.472273 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:10:59.472273 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:10:59.472273 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 27 03:10:59.472273 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 27 03:10:59.472273 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 03:10:59.472273 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 03:10:59.472273 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 27 03:10:59.472273 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 27 03:10:59.472273 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 27 03:10:59.472273 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 27 03:10:59.472273 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 27 03:10:59.472273 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 27 03:10:59.472273 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 7737120c-3e21-4aa7-bcde-628dd680682a is already attached to instances: 28d2e08f-ea2f-42f2-beb5-bfdc368b9014 Aug 27 03:10:59.472273 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:10:59.472273 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:10:59.472273 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:10:59.472273 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:10:59.472273 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:10:59.472273 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:10:59.472273 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:10:59.472273 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:10:59.472273 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:10:59.472273 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:10:59.472273 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:10:59.472273 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:10:59.472273 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:10:59.472273 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:10:59.477163 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:10:59.477163 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:10:59.477163 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 27 03:10:59.477163 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 27 03:10:59.477163 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 7737120c-3e21-4aa7-bcde-628dd680682a is already attached to instances: 28d2e08f-ea2f-42f2-beb5-bfdc368b9014 Aug 27 03:10:59.477163 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:10:59.477163 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:10:59.477163 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:10:59.477163 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:10:59.477163 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:10:59.477163 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:10:59.477163 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:10:59.477163 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:10:59.477163 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 7737120c-3e21-4aa7-bcde-628dd680682a is already attached to instances: 28d2e08f-ea2f-42f2-beb5-bfdc368b9014 Aug 27 03:10:59.477163 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:10:59.481115 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f0f3be91-76eb-46ee-bbb3-4c0cf6905f42 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Returning 400 to user: Invalid volume: volume 7737120c-3e21-4aa7-bcde-628dd680682a is already attached to instances: 28d2e08f-ea2f-42f2-beb5-bfdc368b9014 {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:10:59.482484 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-f0f3be91-76eb-46ee-bbb3-4c0cf6905f42 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "POST /compute/v2.1/servers/77d55af2-92db-4882-a218-690b4752270f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.209653 Aug 27 03:10:59.484036 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2620/5197] 10.222.0.70 () {60 vars in 1323 bytes} [Sat Aug 27 03:10:59 2022] POST /compute/v2.1/servers/77d55af2-92db-4882-a218-690b4752270f/os-volume_attachments => generated 174 bytes in 212 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:10:59.492953 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9112e03d-8ea7-4dee-9ba3-8d882c04e339 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:59.493771 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-9112e03d-8ea7-4dee-9ba3-8d882c04e339 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 77d55af2-92db-4882-a218-690b4752270f] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:59.504364 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9112e03d-8ea7-4dee-9ba3-8d882c04e339 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:59.507316 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9112e03d-8ea7-4dee-9ba3-8d882c04e339 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:59.508083 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9112e03d-8ea7-4dee-9ba3-8d882c04e339 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:59.509105 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9112e03d-8ea7-4dee-9ba3-8d882c04e339 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:59.511574 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9112e03d-8ea7-4dee-9ba3-8d882c04e339 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:59.513312 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9112e03d-8ea7-4dee-9ba3-8d882c04e339 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:59.595557 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-9112e03d-8ea7-4dee-9ba3-8d882c04e339 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 77d55af2-92db-4882-a218-690b4752270f] Going to try to terminate instance {{(pid=134052) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:10:59.666992 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-94d2fb99-9ae0-4e54-b803-1aada5bac4f2 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:59.671404 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-94d2fb99-9ae0-4e54-b803-1aada5bac4f2 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:59.702510 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-94d2fb99-9ae0-4e54-b803-1aada5bac4f2 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:59.703883 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-94d2fb99-9ae0-4e54-b803-1aada5bac4f2 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:59.706831 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-94d2fb99-9ae0-4e54-b803-1aada5bac4f2 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:59.745762 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-94d2fb99-9ae0-4e54-b803-1aada5bac4f2 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:59.750449 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-94d2fb99-9ae0-4e54-b803-1aada5bac4f2 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.037s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:59.753724 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-94d2fb99-9ae0-4e54-b803-1aada5bac4f2 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:59.813204 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9112e03d-8ea7-4dee-9ba3-8d882c04e339 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "DELETE /compute/v2.1/servers/77d55af2-92db-4882-a218-690b4752270f" status: 204 len: 0 microversion: 2.1 time: 0.320304 Aug 27 03:10:59.813948 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2578/5198] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 03:10:59 2022] DELETE /compute/v2.1/servers/77d55af2-92db-4882-a218-690b4752270f => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:10:59.815323 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-94d2fb99-9ae0-4e54-b803-1aada5bac4f2 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.153180 Aug 27 03:10:59.822376 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2621/5199] 10.222.0.70 () {60 vars in 1343 bytes} [Sat Aug 27 03:10:59 2022] GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22/os-volume_attachments => generated 197 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 03:10:59.827478 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-2e20a4f0-bde5-438c-a875-955962423888 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:59.828647 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-2e20a4f0-bde5-438c-a875-955962423888 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 77d55af2-92db-4882-a218-690b4752270f] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:59.837873 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2e20a4f0-bde5-438c-a875-955962423888 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:59.839099 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2e20a4f0-bde5-438c-a875-955962423888 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:59.840056 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2e20a4f0-bde5-438c-a875-955962423888 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:59.841035 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2e20a4f0-bde5-438c-a875-955962423888 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:59.841752 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2e20a4f0-bde5-438c-a875-955962423888 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:59.842602 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2e20a4f0-bde5-438c-a875-955962423888 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:00.083474 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-2e20a4f0-bde5-438c-a875-955962423888 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a549f85910184bf7a697cce7fa3dff96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92af206e05f44cf948b7c25d1acc139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:00.098849 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-2e20a4f0-bde5-438c-a875-955962423888 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "GET /compute/v2.1/servers/77d55af2-92db-4882-a218-690b4752270f" status: 200 len: 1680 microversion: 2.1 time: 0.277293 Aug 27 03:11:00.101662 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2579/5200] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:59 2022] GET /compute/v2.1/servers/77d55af2-92db-4882-a218-690b4752270f => generated 1680 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:00.829928 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d83b4195-9fdd-46d4-b5ba-11166d0fe148 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:00.832303 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d83b4195-9fdd-46d4-b5ba-11166d0fe148 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:00.860529 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d83b4195-9fdd-46d4-b5ba-11166d0fe148 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:00.861795 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d83b4195-9fdd-46d4-b5ba-11166d0fe148 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:00.865525 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d83b4195-9fdd-46d4-b5ba-11166d0fe148 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:00.868838 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d83b4195-9fdd-46d4-b5ba-11166d0fe148 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:00.870538 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d83b4195-9fdd-46d4-b5ba-11166d0fe148 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:00.872921 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d83b4195-9fdd-46d4-b5ba-11166d0fe148 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:00.927595 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d83b4195-9fdd-46d4-b5ba-11166d0fe148 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.103379 Aug 27 03:11:00.928198 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2622/5201] 10.222.0.70 () {60 vars in 1343 bytes} [Sat Aug 27 03:11:00 2022] GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:11:01.124225 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0384fdf4-9e43-4ef4-bb4b-aa60ed09ac3a tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:01.125517 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-0384fdf4-9e43-4ef4-bb4b-aa60ed09ac3a tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 77d55af2-92db-4882-a218-690b4752270f] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:01.145070 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0384fdf4-9e43-4ef4-bb4b-aa60ed09ac3a tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:01.145865 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0384fdf4-9e43-4ef4-bb4b-aa60ed09ac3a tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:01.147948 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0384fdf4-9e43-4ef4-bb4b-aa60ed09ac3a tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:01.148754 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0384fdf4-9e43-4ef4-bb4b-aa60ed09ac3a tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:01.149208 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0384fdf4-9e43-4ef4-bb4b-aa60ed09ac3a tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:01.149692 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0384fdf4-9e43-4ef4-bb4b-aa60ed09ac3a tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:01.546382 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0384fdf4-9e43-4ef4-bb4b-aa60ed09ac3a tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a549f85910184bf7a697cce7fa3dff96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92af206e05f44cf948b7c25d1acc139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:01.572119 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-0384fdf4-9e43-4ef4-bb4b-aa60ed09ac3a tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "GET /compute/v2.1/servers/77d55af2-92db-4882-a218-690b4752270f" status: 200 len: 1680 microversion: 2.1 time: 0.451751 Aug 27 03:11:01.574024 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2580/5202] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:01 2022] GET /compute/v2.1/servers/77d55af2-92db-4882-a218-690b4752270f => generated 1680 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:01.940209 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-9e6378ee-f8a0-4831-97bb-62cea9a2941c tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:01.942506 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-9e6378ee-f8a0-4831-97bb-62cea9a2941c tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:01.957266 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9e6378ee-f8a0-4831-97bb-62cea9a2941c tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:01.958490 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9e6378ee-f8a0-4831-97bb-62cea9a2941c tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:01.963228 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9e6378ee-f8a0-4831-97bb-62cea9a2941c tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:01.964473 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9e6378ee-f8a0-4831-97bb-62cea9a2941c tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:01.965166 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9e6378ee-f8a0-4831-97bb-62cea9a2941c tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:01.965825 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9e6378ee-f8a0-4831-97bb-62cea9a2941c tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:02.033695 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-9e6378ee-f8a0-4831-97bb-62cea9a2941c tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.098048 Aug 27 03:11:02.034675 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2623/5203] 10.222.0.70 () {60 vars in 1343 bytes} [Sat Aug 27 03:11:01 2022] GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:11:02.596251 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4133a129-6bd2-4587-86db-2610ce9c532a tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:02.597148 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-4133a129-6bd2-4587-86db-2610ce9c532a tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 77d55af2-92db-4882-a218-690b4752270f] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:02.621168 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4133a129-6bd2-4587-86db-2610ce9c532a tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:02.623855 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4133a129-6bd2-4587-86db-2610ce9c532a tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:02.625087 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4133a129-6bd2-4587-86db-2610ce9c532a tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:02.628045 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4133a129-6bd2-4587-86db-2610ce9c532a tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:02.628967 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4133a129-6bd2-4587-86db-2610ce9c532a tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:02.632397 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4133a129-6bd2-4587-86db-2610ce9c532a tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:02.920268 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-4133a129-6bd2-4587-86db-2610ce9c532a tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a549f85910184bf7a697cce7fa3dff96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92af206e05f44cf948b7c25d1acc139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:02.931880 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-4133a129-6bd2-4587-86db-2610ce9c532a tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "GET /compute/v2.1/servers/77d55af2-92db-4882-a218-690b4752270f" status: 200 len: 1612 microversion: 2.1 time: 0.340057 Aug 27 03:11:02.933992 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2581/5204] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:02 2022] GET /compute/v2.1/servers/77d55af2-92db-4882-a218-690b4752270f => generated 1612 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:11:03.022395 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-8aa14364-4966-4415-9e44-c486d1e42742 req-19121f21-b53c-437b-8265-db4dced6478c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77d55af2-92db-4882-a218-690b4752270f", "name": "network-vif-deleted", "tag": "41a4e1ef-a14b-421b-b753-fcdfbfdc42c2"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:11:03.048999 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-43ecda3a-8225-4d9e-9309-7f7966a45a43 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:03.051728 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-43ecda3a-8225-4d9e-9309-7f7966a45a43 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:03.065168 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-8aa14364-4966-4415-9e44-c486d1e42742 req-19121f21-b53c-437b-8265-db4dced6478c service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:03.068535 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-8aa14364-4966-4415-9e44-c486d1e42742 req-19121f21-b53c-437b-8265-db4dced6478c service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:03.069235 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-8aa14364-4966-4415-9e44-c486d1e42742 req-19121f21-b53c-437b-8265-db4dced6478c service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:03.072462 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-43ecda3a-8225-4d9e-9309-7f7966a45a43 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:03.083973 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-43ecda3a-8225-4d9e-9309-7f7966a45a43 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:03.086224 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-43ecda3a-8225-4d9e-9309-7f7966a45a43 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:03.089441 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-43ecda3a-8225-4d9e-9309-7f7966a45a43 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:03.091400 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-43ecda3a-8225-4d9e-9309-7f7966a45a43 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:03.094397 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-43ecda3a-8225-4d9e-9309-7f7966a45a43 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:03.126188 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-8aa14364-4966-4415-9e44-c486d1e42742 req-19121f21-b53c-437b-8265-db4dced6478c service nova] Creating event network-vif-deleted:41a4e1ef-a14b-421b-b753-fcdfbfdc42c2 for instance 77d55af2-92db-4882-a218-690b4752270f on n-h1-852278-4 Aug 27 03:11:03.155014 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-8aa14364-4966-4415-9e44-c486d1e42742 req-19121f21-b53c-437b-8265-db4dced6478c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136186 Aug 27 03:11:03.164771 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2624/5205] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:11:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:11:03.214481 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-43ecda3a-8225-4d9e-9309-7f7966a45a43 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.170829 Aug 27 03:11:03.215837 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2582/5206] 10.222.0.70 () {60 vars in 1343 bytes} [Sat Aug 27 03:11:03 2022] GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22/os-volume_attachments => generated 197 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 03:11:03.966304 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0ba4df20-4904-4935-8174-46e491fc4204 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:03.983675 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-0ba4df20-4904-4935-8174-46e491fc4204 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 77d55af2-92db-4882-a218-690b4752270f] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:04.013360 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0ba4df20-4904-4935-8174-46e491fc4204 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:04.014528 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0ba4df20-4904-4935-8174-46e491fc4204 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:04.015128 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0ba4df20-4904-4935-8174-46e491fc4204 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:04.016146 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0ba4df20-4904-4935-8174-46e491fc4204 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:04.016835 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0ba4df20-4904-4935-8174-46e491fc4204 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:04.018055 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0ba4df20-4904-4935-8174-46e491fc4204 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:04.036968 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-0ba4df20-4904-4935-8174-46e491fc4204 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] HTTP exception thrown: Instance 77d55af2-92db-4882-a218-690b4752270f could not be found. Aug 27 03:11:04.040393 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0ba4df20-4904-4935-8174-46e491fc4204 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Request method failure captured: Aug 27 03:11:04.040393 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/77d55af2-92db-4882-a218-690b4752270f HTTP/1.1 Aug 27 03:11:04.040393 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 03:11:04.040393 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 03:11:04.040393 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 03:11:04.040393 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 03:11:04.040393 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 03:11:04.040393 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 03:11:04.040393 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 03:11:04.040393 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 03:11:04.040393 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYq440P3xsAabxN7nGlE2F1Ccxicf_9DU586MSNagRbCITstsgHyyHbnbZoUsiVfiyCUhE6F_2SvHrXIrDKvSEnzb0XjME8fkYvCR9LlCkoQHUfv6A1aESh1h-tIQR1qbnjbVFsJiiWy_WcC2U4qzkQvsEYcwujqY5DDaX4NjUQt4DA Aug 27 03:11:04.040393 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 03:11:04.040393 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 03:11:04.040393 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 03:11:04.040393 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 03:11:04.040393 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 03:11:04.040393 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 03:11:04.040393 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: b92af206e05f44cf948b7c25d1acc139 Aug 27 03:11:04.040393 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-AttachVolumeNegativeTest-878461886 Aug 27 03:11:04.040393 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 03:11:04.040393 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 03:11:04.040393 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b92af206e05f44cf948b7c25d1acc139"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_b92af206e05f44cf948b7c25d1acc139", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b92af206e05f44cf948b7c25d1acc139"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/b92af206e05f44cf948b7c25d1acc139"}]}] Aug 27 03:11:04.040393 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-AttachVolumeNegativeTest-878461886 Aug 27 03:11:04.040393 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: b92af206e05f44cf948b7c25d1acc139 Aug 27 03:11:04.040393 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-878461886 Aug 27 03:11:04.040393 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-AttachVolumeNegativeTest-878461886-project Aug 27 03:11:04.040393 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 03:11:04.040393 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 03:11:04.040393 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: a549f85910184bf7a697cce7fa3dff96 Aug 27 03:11:04.040393 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-AttachVolumeNegativeTest-878461886-project Aug 27 03:11:04.040393 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 03:11:04.040393 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance 77d55af2-92db-4882-a218-690b4752270f could not be found. Aug 27 03:11:04.040393 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '77d55af2-92db-4882-a218-690b4752270f'} Aug 27 03:11:04.040393 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:11:04.040393 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:04.040393 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:11:04.040393 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:11:04.040393 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:11:04.040393 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:11:04.040393 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:11:04.040393 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:11:04.040393 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:11:04.040393 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:11:04.040393 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77d55af2-92db-4882-a218-690b4752270f could not be found. Aug 27 03:11:04.040393 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:11:04.040393 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:11:04.040393 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:11:04.040393 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:04.040393 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:11:04.040393 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:11:04.040393 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:11:04.040393 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:11:04.040393 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:11:04.040393 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:11:04.040393 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:11:04.040393 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:11:04.040393 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:11:04.040393 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:11:04.040393 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:11:04.040393 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:11:04.040393 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77d55af2-92db-4882-a218-690b4752270f could not be found. Aug 27 03:11:04.040393 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:11:04.040393 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:11:04.040393 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:11:04.046104 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:04.046104 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:11:04.046104 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:11:04.046104 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:11:04.046104 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:11:04.046104 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77d55af2-92db-4882-a218-690b4752270f could not be found. Aug 27 03:11:04.046104 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:11:04.048157 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0ba4df20-4904-4935-8174-46e491fc4204 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Returning 404 to user: Instance 77d55af2-92db-4882-a218-690b4752270f could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:11:04.049416 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-0ba4df20-4904-4935-8174-46e491fc4204 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "GET /compute/v2.1/servers/77d55af2-92db-4882-a218-690b4752270f" status: 404 len: 111 microversion: 2.1 time: 0.098011 Aug 27 03:11:04.061526 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-22b3bc4c-5afa-4ac7-91d0-24ddf6cae871 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '.version_select at 0x7f5ee2e30e50>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:04.069153 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2625/5207] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:03 2022] GET /compute/v2.1/servers/77d55af2-92db-4882-a218-690b4752270f => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:11:04.091772 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-22b3bc4c-5afa-4ac7-91d0-24ddf6cae871 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-737449516" status: 202 len: 0 microversion: 2.1 time: 0.035753 Aug 27 03:11:04.097134 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2583/5208] 10.222.0.70 () {58 vars in 1218 bytes} [Sat Aug 27 03:11:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-737449516 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:11:04.229149 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-cdfdb37d-1796-41e2-84b2-517d8bb6b467 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:04.231867 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-cdfdb37d-1796-41e2-84b2-517d8bb6b467 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:04.260062 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cdfdb37d-1796-41e2-84b2-517d8bb6b467 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:04.262050 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cdfdb37d-1796-41e2-84b2-517d8bb6b467 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:04.262513 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cdfdb37d-1796-41e2-84b2-517d8bb6b467 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:04.263236 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cdfdb37d-1796-41e2-84b2-517d8bb6b467 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:04.268600 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cdfdb37d-1796-41e2-84b2-517d8bb6b467 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:04.269163 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cdfdb37d-1796-41e2-84b2-517d8bb6b467 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:04.365085 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-cdfdb37d-1796-41e2-84b2-517d8bb6b467 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.141398 Aug 27 03:11:04.380434 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2626/5209] 10.222.0.70 () {60 vars in 1343 bytes} [Sat Aug 27 03:11:04 2022] GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22/os-volume_attachments => generated 197 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:11:05.378143 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f4795657-23d8-49d2-8ec6-0b065cdcccd8 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:05.383785 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-f4795657-23d8-49d2-8ec6-0b065cdcccd8 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:05.409142 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f4795657-23d8-49d2-8ec6-0b065cdcccd8 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:05.409933 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f4795657-23d8-49d2-8ec6-0b065cdcccd8 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:05.410384 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f4795657-23d8-49d2-8ec6-0b065cdcccd8 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:05.411124 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f4795657-23d8-49d2-8ec6-0b065cdcccd8 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:05.411572 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f4795657-23d8-49d2-8ec6-0b065cdcccd8 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:05.411992 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f4795657-23d8-49d2-8ec6-0b065cdcccd8 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:05.516001 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f4795657-23d8-49d2-8ec6-0b065cdcccd8 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.143271 Aug 27 03:11:05.517198 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2584/5210] 10.222.0.70 () {60 vars in 1343 bytes} [Sat Aug 27 03:11:05 2022] GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22/os-volume_attachments => generated 25 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:05.580539 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-385e3aa7-4fb5-493a-8c29-b8b8f6ccaea2 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:05.581547 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-385e3aa7-4fb5-493a-8c29-b8b8f6ccaea2 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 28d2e08f-ea2f-42f2-beb5-bfdc368b9014] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:05.593486 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-385e3aa7-4fb5-493a-8c29-b8b8f6ccaea2 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:05.594057 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-385e3aa7-4fb5-493a-8c29-b8b8f6ccaea2 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:05.594640 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-385e3aa7-4fb5-493a-8c29-b8b8f6ccaea2 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:05.595582 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-385e3aa7-4fb5-493a-8c29-b8b8f6ccaea2 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:05.596560 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-385e3aa7-4fb5-493a-8c29-b8b8f6ccaea2 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:05.597913 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-385e3aa7-4fb5-493a-8c29-b8b8f6ccaea2 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:05.644298 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-519c48ea-e1e5-4296-9207-8f50de0b9a4e tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:05.645032 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-519c48ea-e1e5-4296-9207-8f50de0b9a4e tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:05.652344 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-519c48ea-e1e5-4296-9207-8f50de0b9a4e tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:05.653445 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-519c48ea-e1e5-4296-9207-8f50de0b9a4e tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:05.654050 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-519c48ea-e1e5-4296-9207-8f50de0b9a4e tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:05.655328 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-519c48ea-e1e5-4296-9207-8f50de0b9a4e tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:05.656007 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-519c48ea-e1e5-4296-9207-8f50de0b9a4e tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:05.656632 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-519c48ea-e1e5-4296-9207-8f50de0b9a4e tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:05.687965 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-519c48ea-e1e5-4296-9207-8f50de0b9a4e tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22] Going to try to terminate instance {{(pid=134052) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:11:05.737688 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:11:05.761100 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.objects.instance [None req-385e3aa7-4fb5-493a-8c29-b8b8f6ccaea2 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lazy-loading 'services' on Instance uuid 28d2e08f-ea2f-42f2-beb5-bfdc368b9014 {{(pid=134051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:11:05.831673 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-519c48ea-e1e5-4296-9207-8f50de0b9a4e tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "DELETE /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22" status: 204 len: 0 microversion: 2.20 time: 0.191890 Aug 27 03:11:05.832276 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2585/5211] 10.222.0.70 () {60 vars in 1280 bytes} [Sat Aug 27 03:11:05 2022] DELETE /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 27 03:11:05.847160 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3ddb67c8-f4d5-4148-a33b-c466f1b33d39 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:05.851562 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-3ddb67c8-f4d5-4148-a33b-c466f1b33d39 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:05.866913 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3ddb67c8-f4d5-4148-a33b-c466f1b33d39 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:05.867883 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3ddb67c8-f4d5-4148-a33b-c466f1b33d39 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:05.868371 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3ddb67c8-f4d5-4148-a33b-c466f1b33d39 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:05.871138 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3ddb67c8-f4d5-4148-a33b-c466f1b33d39 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:05.871770 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3ddb67c8-f4d5-4148-a33b-c466f1b33d39 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:05.874196 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3ddb67c8-f4d5-4148-a33b-c466f1b33d39 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:05.928151 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-385e3aa7-4fb5-493a-8c29-b8b8f6ccaea2 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "DELETE /compute/v2.1/servers/28d2e08f-ea2f-42f2-beb5-bfdc368b9014/os-volume_attachments/7737120c-3e21-4aa7-bcde-628dd680682a" status: 202 len: 0 microversion: 2.1 time: 0.351410 Aug 27 03:11:05.931772 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2627/5212] 10.222.0.70 () {58 vars in 1416 bytes} [Sat Aug 27 03:11:05 2022] DELETE /compute/v2.1/servers/28d2e08f-ea2f-42f2-beb5-bfdc368b9014/os-volume_attachments/7737120c-3e21-4aa7-bcde-628dd680682a => generated 0 bytes in 356 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:11:05.942642 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-65a44973-4c6c-40ae-9bac-393407ef0bf2 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:05.945237 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-65a44973-4c6c-40ae-9bac-393407ef0bf2 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 28d2e08f-ea2f-42f2-beb5-bfdc368b9014] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:05.953020 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-65a44973-4c6c-40ae-9bac-393407ef0bf2 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:05.953616 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-65a44973-4c6c-40ae-9bac-393407ef0bf2 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:05.954087 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-65a44973-4c6c-40ae-9bac-393407ef0bf2 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:05.954985 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-65a44973-4c6c-40ae-9bac-393407ef0bf2 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:05.955441 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-65a44973-4c6c-40ae-9bac-393407ef0bf2 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:05.955853 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-65a44973-4c6c-40ae-9bac-393407ef0bf2 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:06.008168 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-65a44973-4c6c-40ae-9bac-393407ef0bf2 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "GET /compute/v2.1/servers/28d2e08f-ea2f-42f2-beb5-bfdc368b9014/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071831 Aug 27 03:11:06.008791 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2628/5213] 10.222.0.70 () {58 vars in 1302 bytes} [Sat Aug 27 03:11:05 2022] GET /compute/v2.1/servers/28d2e08f-ea2f-42f2-beb5-bfdc368b9014/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:11:06.188682 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-3ddb67c8-f4d5-4148-a33b-c466f1b33d39 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:06.199049 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-3ddb67c8-f4d5-4148-a33b-c466f1b33d39 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:06.201697 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-3ddb67c8-f4d5-4148-a33b-c466f1b33d39 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:06.202981 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-3ddb67c8-f4d5-4148-a33b-c466f1b33d39 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22" status: 200 len: 1723 microversion: 2.20 time: 0.366269 Aug 27 03:11:06.204393 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2586/5214] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:11:05 2022] GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22 => generated 1723 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:11:07.023599 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-9bcbdfdb-6cb9-4f8b-96b3-13067b6c1511 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:07.027589 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-9bcbdfdb-6cb9-4f8b-96b3-13067b6c1511 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 28d2e08f-ea2f-42f2-beb5-bfdc368b9014] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:07.058808 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9bcbdfdb-6cb9-4f8b-96b3-13067b6c1511 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:07.059540 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9bcbdfdb-6cb9-4f8b-96b3-13067b6c1511 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:07.060229 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9bcbdfdb-6cb9-4f8b-96b3-13067b6c1511 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:07.061173 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9bcbdfdb-6cb9-4f8b-96b3-13067b6c1511 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:07.061781 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9bcbdfdb-6cb9-4f8b-96b3-13067b6c1511 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:07.062513 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9bcbdfdb-6cb9-4f8b-96b3-13067b6c1511 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:07.081717 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:11:07.106155 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-9bcbdfdb-6cb9-4f8b-96b3-13067b6c1511 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "GET /compute/v2.1/servers/28d2e08f-ea2f-42f2-beb5-bfdc368b9014/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088901 Aug 27 03:11:07.107368 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2629/5215] 10.222.0.70 () {58 vars in 1302 bytes} [Sat Aug 27 03:11:07 2022] GET /compute/v2.1/servers/28d2e08f-ea2f-42f2-beb5-bfdc368b9014/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:11:07.229260 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-bb8f195e-81a5-4dda-86c0-38716ef1d282 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:07.230061 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-bb8f195e-81a5-4dda-86c0-38716ef1d282 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:07.239834 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bb8f195e-81a5-4dda-86c0-38716ef1d282 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:07.240589 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bb8f195e-81a5-4dda-86c0-38716ef1d282 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:07.241242 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bb8f195e-81a5-4dda-86c0-38716ef1d282 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:07.242178 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bb8f195e-81a5-4dda-86c0-38716ef1d282 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:07.243121 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bb8f195e-81a5-4dda-86c0-38716ef1d282 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:07.243757 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bb8f195e-81a5-4dda-86c0-38716ef1d282 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:07.696446 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-bb8f195e-81a5-4dda-86c0-38716ef1d282 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:07.715328 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-bb8f195e-81a5-4dda-86c0-38716ef1d282 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:07.727058 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-bb8f195e-81a5-4dda-86c0-38716ef1d282 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:07.735466 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-bb8f195e-81a5-4dda-86c0-38716ef1d282 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22" status: 200 len: 1723 microversion: 2.20 time: 0.512519 Aug 27 03:11:07.743128 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2587/5216] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:11:07 2022] GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22 => generated 1723 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:11:08.120648 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b67914a8-44e9-49ad-887a-ee2c774eaa3d tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:08.122864 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b67914a8-44e9-49ad-887a-ee2c774eaa3d tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 28d2e08f-ea2f-42f2-beb5-bfdc368b9014] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:08.130965 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b67914a8-44e9-49ad-887a-ee2c774eaa3d tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:08.131464 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b67914a8-44e9-49ad-887a-ee2c774eaa3d tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:08.137872 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b67914a8-44e9-49ad-887a-ee2c774eaa3d tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:08.138793 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b67914a8-44e9-49ad-887a-ee2c774eaa3d tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:08.139260 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b67914a8-44e9-49ad-887a-ee2c774eaa3d tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:08.139705 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b67914a8-44e9-49ad-887a-ee2c774eaa3d tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:08.220612 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b67914a8-44e9-49ad-887a-ee2c774eaa3d tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "GET /compute/v2.1/servers/28d2e08f-ea2f-42f2-beb5-bfdc368b9014/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.105140 Aug 27 03:11:08.221574 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2630/5217] 10.222.0.70 () {58 vars in 1302 bytes} [Sat Aug 27 03:11:08 2022] GET /compute/v2.1/servers/28d2e08f-ea2f-42f2-beb5-bfdc368b9014/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:11:08.765876 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a8dd00d0-0599-4f39-812f-dd12da04363d tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:08.767849 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a8dd00d0-0599-4f39-812f-dd12da04363d tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:08.785104 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a8dd00d0-0599-4f39-812f-dd12da04363d tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:08.785993 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a8dd00d0-0599-4f39-812f-dd12da04363d tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:08.786666 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a8dd00d0-0599-4f39-812f-dd12da04363d tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:08.789343 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a8dd00d0-0599-4f39-812f-dd12da04363d tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:08.790048 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a8dd00d0-0599-4f39-812f-dd12da04363d tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:08.791817 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a8dd00d0-0599-4f39-812f-dd12da04363d tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:09.233641 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-111d1df8-9681-417d-83cc-a9a39f3eb74a tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:09.236621 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-111d1df8-9681-417d-83cc-a9a39f3eb74a tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 28d2e08f-ea2f-42f2-beb5-bfdc368b9014] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:09.264297 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-111d1df8-9681-417d-83cc-a9a39f3eb74a tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:09.268664 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-111d1df8-9681-417d-83cc-a9a39f3eb74a tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:09.271115 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-111d1df8-9681-417d-83cc-a9a39f3eb74a tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:09.272130 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-111d1df8-9681-417d-83cc-a9a39f3eb74a tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:09.272850 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-111d1df8-9681-417d-83cc-a9a39f3eb74a tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:09.277049 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-111d1df8-9681-417d-83cc-a9a39f3eb74a tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:09.354702 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-111d1df8-9681-417d-83cc-a9a39f3eb74a tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "GET /compute/v2.1/servers/28d2e08f-ea2f-42f2-beb5-bfdc368b9014/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.125014 Aug 27 03:11:09.364153 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2631/5218] 10.222.0.70 () {58 vars in 1302 bytes} [Sat Aug 27 03:11:09 2022] GET /compute/v2.1/servers/28d2e08f-ea2f-42f2-beb5-bfdc368b9014/os-volume_attachments => generated 197 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:11:09.476976 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-a8dd00d0-0599-4f39-812f-dd12da04363d tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:09.486935 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-a8dd00d0-0599-4f39-812f-dd12da04363d tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:09.494040 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-a8dd00d0-0599-4f39-812f-dd12da04363d tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:09.495321 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a8dd00d0-0599-4f39-812f-dd12da04363d tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22" status: 200 len: 1723 microversion: 2.20 time: 0.733889 Aug 27 03:11:09.495902 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2588/5219] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:11:08 2022] GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22 => generated 1723 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:11:10.226573 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-f5c27cfd-10b0-439f-bd9c-f6a72de4030f req-703aa270-2c8f-476e-b34e-8669b60305e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73ee7f75-b081-4f5c-90b0-e0d1b27b9a22", "name": "network-vif-deleted", "tag": "130f85a4-751a-4a52-92c2-d7a99bb65d41"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:11:10.258414 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-f5c27cfd-10b0-439f-bd9c-f6a72de4030f req-703aa270-2c8f-476e-b34e-8669b60305e5 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:10.259051 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-f5c27cfd-10b0-439f-bd9c-f6a72de4030f req-703aa270-2c8f-476e-b34e-8669b60305e5 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:10.259377 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-f5c27cfd-10b0-439f-bd9c-f6a72de4030f req-703aa270-2c8f-476e-b34e-8669b60305e5 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:10.301652 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-f5c27cfd-10b0-439f-bd9c-f6a72de4030f req-703aa270-2c8f-476e-b34e-8669b60305e5 service nova] Creating event network-vif-deleted:130f85a4-751a-4a52-92c2-d7a99bb65d41 for instance 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22 on n-h2-852278-4 Aug 27 03:11:10.322689 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-f5c27cfd-10b0-439f-bd9c-f6a72de4030f req-703aa270-2c8f-476e-b34e-8669b60305e5 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100239 Aug 27 03:11:10.323735 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2632/5220] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:11:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:11:10.368355 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f8c45281-137f-4b19-9370-800d0d03308a tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:10.371771 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-f8c45281-137f-4b19-9370-800d0d03308a tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 28d2e08f-ea2f-42f2-beb5-bfdc368b9014] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:10.388941 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f8c45281-137f-4b19-9370-800d0d03308a tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:10.391941 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f8c45281-137f-4b19-9370-800d0d03308a tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:10.395909 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f8c45281-137f-4b19-9370-800d0d03308a tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:10.397127 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f8c45281-137f-4b19-9370-800d0d03308a tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:10.397914 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f8c45281-137f-4b19-9370-800d0d03308a tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:10.398556 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f8c45281-137f-4b19-9370-800d0d03308a tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:10.499637 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f8c45281-137f-4b19-9370-800d0d03308a tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "GET /compute/v2.1/servers/28d2e08f-ea2f-42f2-beb5-bfdc368b9014/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.135464 Aug 27 03:11:10.504622 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2589/5221] 10.222.0.70 () {58 vars in 1302 bytes} [Sat Aug 27 03:11:10 2022] GET /compute/v2.1/servers/28d2e08f-ea2f-42f2-beb5-bfdc368b9014/os-volume_attachments => generated 197 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:11:10.523987 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-398106ce-d2b7-4ad5-8a0f-fe639b92fe9e tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:10.524976 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-398106ce-d2b7-4ad5-8a0f-fe639b92fe9e tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:10.538285 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-398106ce-d2b7-4ad5-8a0f-fe639b92fe9e tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:10.538882 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-398106ce-d2b7-4ad5-8a0f-fe639b92fe9e tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:10.539324 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-398106ce-d2b7-4ad5-8a0f-fe639b92fe9e tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:10.540041 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-398106ce-d2b7-4ad5-8a0f-fe639b92fe9e tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:10.543041 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-398106ce-d2b7-4ad5-8a0f-fe639b92fe9e tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:10.543722 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-398106ce-d2b7-4ad5-8a0f-fe639b92fe9e tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:10.625856 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-398106ce-d2b7-4ad5-8a0f-fe639b92fe9e tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:10.628931 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-398106ce-d2b7-4ad5-8a0f-fe639b92fe9e tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:10.630678 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-398106ce-d2b7-4ad5-8a0f-fe639b92fe9e tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:10.632211 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.objects.instance [None req-398106ce-d2b7-4ad5-8a0f-fe639b92fe9e tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lazy-loading 'fault' on Instance uuid 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22 {{(pid=134051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:11:10.766287 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-398106ce-d2b7-4ad5-8a0f-fe639b92fe9e tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:10.781156 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-398106ce-d2b7-4ad5-8a0f-fe639b92fe9e tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:10.782675 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-398106ce-d2b7-4ad5-8a0f-fe639b92fe9e tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:10.787669 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-398106ce-d2b7-4ad5-8a0f-fe639b92fe9e tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22" status: 200 len: 1371 microversion: 2.20 time: 0.268610 Aug 27 03:11:10.788338 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2633/5222] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:11:10 2022] GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22 => generated 1371 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:11:11.512913 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ede7a20e-aeb1-455d-9d6c-9791f5a391c3 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:11.516057 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-ede7a20e-aeb1-455d-9d6c-9791f5a391c3 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 28d2e08f-ea2f-42f2-beb5-bfdc368b9014] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:11.539942 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ede7a20e-aeb1-455d-9d6c-9791f5a391c3 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:11.540468 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ede7a20e-aeb1-455d-9d6c-9791f5a391c3 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:11.540958 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ede7a20e-aeb1-455d-9d6c-9791f5a391c3 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:11.547828 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ede7a20e-aeb1-455d-9d6c-9791f5a391c3 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:11.548419 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ede7a20e-aeb1-455d-9d6c-9791f5a391c3 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:11.548781 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ede7a20e-aeb1-455d-9d6c-9791f5a391c3 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:11.637298 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ede7a20e-aeb1-455d-9d6c-9791f5a391c3 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "GET /compute/v2.1/servers/28d2e08f-ea2f-42f2-beb5-bfdc368b9014/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.129455 Aug 27 03:11:11.641334 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2590/5223] 10.222.0.70 () {58 vars in 1302 bytes} [Sat Aug 27 03:11:11 2022] GET /compute/v2.1/servers/28d2e08f-ea2f-42f2-beb5-bfdc368b9014/os-volume_attachments => generated 197 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:11:11.811723 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-263a8444-176f-4e4a-930c-7d88e47f6ac4 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:11.813129 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-263a8444-176f-4e4a-930c-7d88e47f6ac4 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:11.820793 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-263a8444-176f-4e4a-930c-7d88e47f6ac4 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:11.821640 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-263a8444-176f-4e4a-930c-7d88e47f6ac4 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:11.826149 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-263a8444-176f-4e4a-930c-7d88e47f6ac4 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:11.827249 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-263a8444-176f-4e4a-930c-7d88e47f6ac4 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:11.827959 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-263a8444-176f-4e4a-930c-7d88e47f6ac4 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:11.828701 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-263a8444-176f-4e4a-930c-7d88e47f6ac4 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:11.862148 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-263a8444-176f-4e4a-930c-7d88e47f6ac4 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] HTTP exception thrown: Instance 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22 could not be found. Aug 27 03:11:11.870833 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-263a8444-176f-4e4a-930c-7d88e47f6ac4 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Request method failure captured: Aug 27 03:11:11.870833 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22 HTTP/1.1 Aug 27 03:11:11.870833 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 03:11:11.870833 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 03:11:11.870833 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 03:11:11.870833 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 03:11:11.870833 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 03:11:11.870833 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 03:11:11.870833 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 03:11:11.870833 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 03:11:11.870833 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYqWWBpisv0Y8BINTYOfeSZSS55yPb6M12y-rc1hhmIPImd6bLtUWZpUUXyiIiteGM7399fAWs_B2GKs6-_BwLz39cKeITvdmoIjDZ89MdWoiFFHRkq5uSO4e0ZVvUZ3R-WTlC_O1Cb_D8e8r6b7FTtA4CE_fUyeGUkz3HkySTmRbvk Aug 27 03:11:11.870833 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 03:11:11.870833 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 03:11:11.870833 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 03:11:11.870833 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 03:11:11.870833 n-d-852278-4 devstack@n-api.service[134051]: X-Openstack-Nova-Api-Version: 2.20 Aug 27 03:11:11.870833 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 03:11:11.870833 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 03:11:11.870833 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 819c3b9e6e3c4a868b1ba77f48ff2e56 Aug 27 03:11:11.870833 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1336453815 Aug 27 03:11:11.870833 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 03:11:11.870833 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 03:11:11.870833 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/819c3b9e6e3c4a868b1ba77f48ff2e56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_819c3b9e6e3c4a868b1ba77f48ff2e56", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/819c3b9e6e3c4a868b1ba77f48ff2e56"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/819c3b9e6e3c4a868b1ba77f48ff2e56"}]}] Aug 27 03:11:11.870833 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1336453815 Aug 27 03:11:11.870833 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 819c3b9e6e3c4a868b1ba77f48ff2e56 Aug 27 03:11:11.870833 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1336453815 Aug 27 03:11:11.870833 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-AttachVolumeShelveTestJSON-1336453815-project Aug 27 03:11:11.870833 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 03:11:11.870833 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 03:11:11.870833 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 8bf00e5925fa4227a2fe0b6b155a4ee4 Aug 27 03:11:11.870833 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1336453815-project Aug 27 03:11:11.870833 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 03:11:11.870833 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22 could not be found. Aug 27 03:11:11.870833 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '73ee7f75-b081-4f5c-90b0-e0d1b27b9a22'} Aug 27 03:11:11.870833 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:11:11.870833 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:11.870833 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:11:11.870833 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:11:11.870833 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:11:11.870833 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:11:11.870833 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:11:11.870833 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:11:11.870833 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:11:11.870833 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:11:11.870833 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22 could not be found. Aug 27 03:11:11.870833 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:11:11.870833 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:11:11.870833 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:11:11.870833 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:11.870833 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:11:11.870833 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:11:11.870833 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:11:11.870833 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:11:11.870833 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:11:11.870833 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:11:11.870833 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:11:11.870833 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:11:11.870833 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:11:11.870833 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:11:11.870833 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:11:11.870833 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:11:11.870833 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22 could not be found. Aug 27 03:11:11.870833 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:11:11.870833 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:11:11.876431 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:11:11.876431 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:11.876431 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:11:11.876431 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:11:11.876431 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:11:11.876431 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:11:11.876431 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22 could not be found. Aug 27 03:11:11.876431 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:11:11.878600 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-263a8444-176f-4e4a-930c-7d88e47f6ac4 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Returning 404 to user: Instance 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:11:11.879728 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-263a8444-176f-4e4a-930c-7d88e47f6ac4 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22" status: 404 len: 111 microversion: 2.20 time: 0.072455 Aug 27 03:11:11.881279 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2634/5224] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:11:11 2022] GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:11:11.889797 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a608eae4-2fec-4f9c-b5f9-82c3f4a183d3 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '.version_select at 0x7f5ee35e2e50>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:11.937228 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a608eae4-2fec-4f9c-b5f9-82c3f4a183d3 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1356932145" status: 204 len: 0 microversion: 2.20 time: 0.051445 Aug 27 03:11:11.940709 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2591/5225] 10.222.0.70 () {60 vars in 1262 bytes} [Sat Aug 27 03:11:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1356932145 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 03:11:12.653426 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-71301845-7fef-4c94-aca0-4356d676bed6 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:12.656255 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-71301845-7fef-4c94-aca0-4356d676bed6 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 28d2e08f-ea2f-42f2-beb5-bfdc368b9014] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:12.673601 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-71301845-7fef-4c94-aca0-4356d676bed6 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:12.674496 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-71301845-7fef-4c94-aca0-4356d676bed6 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:12.675160 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-71301845-7fef-4c94-aca0-4356d676bed6 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:12.676118 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-71301845-7fef-4c94-aca0-4356d676bed6 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:12.676807 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-71301845-7fef-4c94-aca0-4356d676bed6 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:12.677476 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-71301845-7fef-4c94-aca0-4356d676bed6 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:12.744747 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-71301845-7fef-4c94-aca0-4356d676bed6 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "GET /compute/v2.1/servers/28d2e08f-ea2f-42f2-beb5-bfdc368b9014/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095657 Aug 27 03:11:12.750419 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2635/5226] 10.222.0.70 () {58 vars in 1302 bytes} [Sat Aug 27 03:11:12 2022] GET /compute/v2.1/servers/28d2e08f-ea2f-42f2-beb5-bfdc368b9014/os-volume_attachments => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:11:13.187711 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-35dded8f-e54e-4b52-bed5-aa19b31f7bc7 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:13.196541 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-35dded8f-e54e-4b52-bed5-aa19b31f7bc7 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] [instance: e3b6b87a-f60c-4bda-8591-0c387e31bb4f] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:13.208836 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-16377742-ae81-418f-9e6a-64efd8f51b99 req-1defbb25-aef0-4eec-93b0-b64baba76457 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3b6b87a-f60c-4bda-8591-0c387e31bb4f", "tag": "d9c24bb5-0bef-42a7-bf54-a86f3cdac10f"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:11:13.242092 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-35dded8f-e54e-4b52-bed5-aa19b31f7bc7 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:13.242860 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-35dded8f-e54e-4b52-bed5-aa19b31f7bc7 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:13.243988 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=54 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:11:13.244677 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-35dded8f-e54e-4b52-bed5-aa19b31f7bc7 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:13.246687 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-35dded8f-e54e-4b52-bed5-aa19b31f7bc7 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:13.248516 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-35dded8f-e54e-4b52-bed5-aa19b31f7bc7 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:13.249157 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-35dded8f-e54e-4b52-bed5-aa19b31f7bc7 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:13.249666 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-16377742-ae81-418f-9e6a-64efd8f51b99 req-1defbb25-aef0-4eec-93b0-b64baba76457 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:13.251254 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-16377742-ae81-418f-9e6a-64efd8f51b99 req-1defbb25-aef0-4eec-93b0-b64baba76457 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:13.253268 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-16377742-ae81-418f-9e6a-64efd8f51b99 req-1defbb25-aef0-4eec-93b0-b64baba76457 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:13.286636 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-16377742-ae81-418f-9e6a-64efd8f51b99 req-1defbb25-aef0-4eec-93b0-b64baba76457 service nova] Creating event network-changed:d9c24bb5-0bef-42a7-bf54-a86f3cdac10f for instance e3b6b87a-f60c-4bda-8591-0c387e31bb4f on n-h2-852278-4 Aug 27 03:11:13.294091 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-16377742-ae81-418f-9e6a-64efd8f51b99 req-1defbb25-aef0-4eec-93b0-b64baba76457 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094375 Aug 27 03:11:13.295743 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2636/5227] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:11:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:11:13.321370 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-35dded8f-e54e-4b52-bed5-aa19b31f7bc7 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] [instance: e3b6b87a-f60c-4bda-8591-0c387e31bb4f] Going to try to terminate instance {{(pid=134052) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:11:13.432097 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-35dded8f-e54e-4b52-bed5-aa19b31f7bc7 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] 10.222.0.70 "DELETE /compute/v2.1/servers/e3b6b87a-f60c-4bda-8591-0c387e31bb4f" status: 204 len: 0 microversion: 2.1 time: 0.252159 Aug 27 03:11:13.434760 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2592/5228] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 03:11:13 2022] DELETE /compute/v2.1/servers/e3b6b87a-f60c-4bda-8591-0c387e31bb4f => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:11:13.445394 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-71de3467-a97a-41c4-946a-b81e17b0cdfe tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:13.446798 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-71de3467-a97a-41c4-946a-b81e17b0cdfe tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] [instance: e3b6b87a-f60c-4bda-8591-0c387e31bb4f] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:13.460582 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-71de3467-a97a-41c4-946a-b81e17b0cdfe tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:13.464570 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-71de3467-a97a-41c4-946a-b81e17b0cdfe tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:13.466084 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-71de3467-a97a-41c4-946a-b81e17b0cdfe tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:13.467173 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-71de3467-a97a-41c4-946a-b81e17b0cdfe tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:13.476370 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-71de3467-a97a-41c4-946a-b81e17b0cdfe tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:13.477865 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-71de3467-a97a-41c4-946a-b81e17b0cdfe tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:13.759665 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-04d9e366-04ec-4671-a6db-cda113a07f09 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:13.763314 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-04d9e366-04ec-4671-a6db-cda113a07f09 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 28d2e08f-ea2f-42f2-beb5-bfdc368b9014] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:13.783290 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-04d9e366-04ec-4671-a6db-cda113a07f09 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:13.789489 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-04d9e366-04ec-4671-a6db-cda113a07f09 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:13.789866 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-04d9e366-04ec-4671-a6db-cda113a07f09 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:13.790999 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-04d9e366-04ec-4671-a6db-cda113a07f09 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:13.791105 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-04d9e366-04ec-4671-a6db-cda113a07f09 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:13.796408 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-04d9e366-04ec-4671-a6db-cda113a07f09 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:13.880931 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-04d9e366-04ec-4671-a6db-cda113a07f09 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "GET /compute/v2.1/servers/28d2e08f-ea2f-42f2-beb5-bfdc368b9014/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.126505 Aug 27 03:11:13.885834 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2593/5229] 10.222.0.70 () {58 vars in 1302 bytes} [Sat Aug 27 03:11:13 2022] GET /compute/v2.1/servers/28d2e08f-ea2f-42f2-beb5-bfdc368b9014/os-volume_attachments => generated 197 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:11:13.896468 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b8338226-f377-43fd-8264-9a9f07332196 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Action: 'create', calling method: .version_select at 0x7f5ee33f8af0>, body: {"keypair": {"name": "tempest-keypair-231993650", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNrMuaRP8QL9wDBfE4hNQAsvoWmJD5Z9JDxP3n5g+G7+Ljx1RsYA08ZKdz2BPi6jKFLrSyXXYjRZ1zAmSr0DD/JxXI7l9+yEqgS19y0XQ8bspIzfzvmjnQudpdFnMwRPew=="}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:11:13.919415 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-b8338226-f377-43fd-8264-9a9f07332196 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Getting quotas for project 819c3b9e6e3c4a868b1ba77f48ff2e56. Resources: {'key_pairs'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:11:13.925834 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-b8338226-f377-43fd-8264-9a9f07332196 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Getting quotas for user 8bf00e5925fa4227a2fe0b6b155a4ee4 and project 819c3b9e6e3c4a868b1ba77f48ff2e56. Resources: {'key_pairs'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:11:13.970034 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b8338226-f377-43fd-8264-9a9f07332196 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.085617 Aug 27 03:11:13.970964 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2594/5230] 10.222.0.70 () {62 vars in 1200 bytes} [Sat Aug 27 03:11:13 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 88 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 27 03:11:14.092933 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-71de3467-a97a-41c4-946a-b81e17b0cdfe tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '355b96770f7e4f338ef21fc49c8de54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971ec7583d924ac3981bc789db78a733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:14.106936 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-71de3467-a97a-41c4-946a-b81e17b0cdfe tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] 10.222.0.70 "GET /compute/v2.1/servers/e3b6b87a-f60c-4bda-8591-0c387e31bb4f" status: 200 len: 1584 microversion: 2.1 time: 0.666071 Aug 27 03:11:14.112271 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2637/5231] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:13 2022] GET /compute/v2.1/servers/e3b6b87a-f60c-4bda-8591-0c387e31bb4f => generated 1584 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:14.898632 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d9175e97-ee17-48de-8eb7-01366a27489e tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:14.903896 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d9175e97-ee17-48de-8eb7-01366a27489e tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 28d2e08f-ea2f-42f2-beb5-bfdc368b9014] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:14.928643 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d9175e97-ee17-48de-8eb7-01366a27489e tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:14.928860 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d9175e97-ee17-48de-8eb7-01366a27489e tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:14.929286 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d9175e97-ee17-48de-8eb7-01366a27489e tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:14.930008 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d9175e97-ee17-48de-8eb7-01366a27489e tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:14.930464 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d9175e97-ee17-48de-8eb7-01366a27489e tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:14.935955 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d9175e97-ee17-48de-8eb7-01366a27489e tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:15.014997 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d9175e97-ee17-48de-8eb7-01366a27489e tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "GET /compute/v2.1/servers/28d2e08f-ea2f-42f2-beb5-bfdc368b9014/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.124739 Aug 27 03:11:15.030756 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2595/5232] 10.222.0.70 () {58 vars in 1302 bytes} [Sat Aug 27 03:11:14 2022] GET /compute/v2.1/servers/28d2e08f-ea2f-42f2-beb5-bfdc368b9014/os-volume_attachments => generated 25 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:11:15.112589 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7f0e12ac-4346-45d4-872e-4b0fa80bc6cc tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:15.113473 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-7f0e12ac-4346-45d4-872e-4b0fa80bc6cc tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 28d2e08f-ea2f-42f2-beb5-bfdc368b9014] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:15.121434 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7f0e12ac-4346-45d4-872e-4b0fa80bc6cc tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:15.122217 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7f0e12ac-4346-45d4-872e-4b0fa80bc6cc tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:15.122865 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7f0e12ac-4346-45d4-872e-4b0fa80bc6cc tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:15.123786 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7f0e12ac-4346-45d4-872e-4b0fa80bc6cc tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:15.124501 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7f0e12ac-4346-45d4-872e-4b0fa80bc6cc tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:15.125152 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7f0e12ac-4346-45d4-872e-4b0fa80bc6cc tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:15.135871 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-fbab4ee1-343e-41cf-8384-79d7197efe01 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:15.136895 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-fbab4ee1-343e-41cf-8384-79d7197efe01 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] [instance: e3b6b87a-f60c-4bda-8591-0c387e31bb4f] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:15.149125 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fbab4ee1-343e-41cf-8384-79d7197efe01 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:15.158517 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fbab4ee1-343e-41cf-8384-79d7197efe01 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:15.164717 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fbab4ee1-343e-41cf-8384-79d7197efe01 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:15.166754 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fbab4ee1-343e-41cf-8384-79d7197efe01 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:15.168566 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fbab4ee1-343e-41cf-8384-79d7197efe01 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:15.170882 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fbab4ee1-343e-41cf-8384-79d7197efe01 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:15.232553 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-7f0e12ac-4346-45d4-872e-4b0fa80bc6cc tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 28d2e08f-ea2f-42f2-beb5-bfdc368b9014] Going to try to terminate instance {{(pid=134051) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:11:15.433800 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-7f0e12ac-4346-45d4-872e-4b0fa80bc6cc tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "DELETE /compute/v2.1/servers/28d2e08f-ea2f-42f2-beb5-bfdc368b9014" status: 204 len: 0 microversion: 2.1 time: 0.324990 Aug 27 03:11:15.434396 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2638/5233] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 03:11:15 2022] DELETE /compute/v2.1/servers/28d2e08f-ea2f-42f2-beb5-bfdc368b9014 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:11:15.444283 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4f1fd933-655b-4764-838c-d265617cd57e tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:15.445010 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-4f1fd933-655b-4764-838c-d265617cd57e tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 28d2e08f-ea2f-42f2-beb5-bfdc368b9014] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:15.458412 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4f1fd933-655b-4764-838c-d265617cd57e tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:15.464551 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4f1fd933-655b-4764-838c-d265617cd57e tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:15.465242 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4f1fd933-655b-4764-838c-d265617cd57e tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:15.467463 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4f1fd933-655b-4764-838c-d265617cd57e tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:15.468104 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4f1fd933-655b-4764-838c-d265617cd57e tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:15.471458 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4f1fd933-655b-4764-838c-d265617cd57e tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:15.975671 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-fbab4ee1-343e-41cf-8384-79d7197efe01 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '355b96770f7e4f338ef21fc49c8de54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971ec7583d924ac3981bc789db78a733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:15.997161 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-fbab4ee1-343e-41cf-8384-79d7197efe01 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] 10.222.0.70 "GET /compute/v2.1/servers/e3b6b87a-f60c-4bda-8591-0c387e31bb4f" status: 200 len: 1584 microversion: 2.1 time: 0.861436 Aug 27 03:11:16.008560 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2596/5234] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:15 2022] GET /compute/v2.1/servers/e3b6b87a-f60c-4bda-8591-0c387e31bb4f => generated 1584 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:11:16.085258 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-4f1fd933-655b-4764-838c-d265617cd57e tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a549f85910184bf7a697cce7fa3dff96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92af206e05f44cf948b7c25d1acc139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:16.102135 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-4f1fd933-655b-4764-838c-d265617cd57e tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "GET /compute/v2.1/servers/28d2e08f-ea2f-42f2-beb5-bfdc368b9014" status: 200 len: 1682 microversion: 2.1 time: 0.663102 Aug 27 03:11:16.108887 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2639/5235] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:15 2022] GET /compute/v2.1/servers/28d2e08f-ea2f-42f2-beb5-bfdc368b9014 => generated 1682 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:16.766174 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-83c6ecfe-537f-47f5-a3d5-5d762e61620f tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1972934759", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b682410a-8656-4b1d-93c8-feff8a0d8bf0"}], "security_groups": [{"name": "tempest-securitygroup--646576601"}], "key_name": "tempest-keypair-231993650", "user_data": "}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:11:17.024136 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-f46ecfc1-bdce-4535-92f7-81868feb9612 req-9f5be2cc-d673-4890-874a-7134c04807bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3b6b87a-f60c-4bda-8591-0c387e31bb4f", "name": "network-vif-deleted", "tag": "d9c24bb5-0bef-42a7-bf54-a86f3cdac10f"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:11:17.038967 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-f46ecfc1-bdce-4535-92f7-81868feb9612 req-9f5be2cc-d673-4890-874a-7134c04807bc service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:17.039472 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-f46ecfc1-bdce-4535-92f7-81868feb9612 req-9f5be2cc-d673-4890-874a-7134c04807bc service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:17.039983 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-f46ecfc1-bdce-4535-92f7-81868feb9612 req-9f5be2cc-d673-4890-874a-7134c04807bc service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:17.081556 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-f46ecfc1-bdce-4535-92f7-81868feb9612 req-9f5be2cc-d673-4890-874a-7134c04807bc service nova] Creating event network-vif-deleted:d9c24bb5-0bef-42a7-bf54-a86f3cdac10f for instance e3b6b87a-f60c-4bda-8591-0c387e31bb4f on n-h2-852278-4 Aug 27 03:11:17.103083 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-f46ecfc1-bdce-4535-92f7-81868feb9612 req-9f5be2cc-d673-4890-874a-7134c04807bc service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.359693 Aug 27 03:11:17.104022 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.network.neutron [None req-83c6ecfe-537f-47f5-a3d5-5d762e61620f tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] validate_networks() for [('b682410a-8656-4b1d-93c8-feff8a0d8bf0', None, None, None, None, None)] {{(pid=134051) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:11:17.105679 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2597/5236] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:11:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:11:17.114285 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-890c7684-95fb-49e7-8317-5b1a70248c8f tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:17.115245 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-890c7684-95fb-49e7-8317-5b1a70248c8f tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] [instance: e3b6b87a-f60c-4bda-8591-0c387e31bb4f] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:17.124610 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-890c7684-95fb-49e7-8317-5b1a70248c8f tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:17.126364 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-890c7684-95fb-49e7-8317-5b1a70248c8f tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:17.127349 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-890c7684-95fb-49e7-8317-5b1a70248c8f tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:17.128797 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-890c7684-95fb-49e7-8317-5b1a70248c8f tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:17.129447 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-890c7684-95fb-49e7-8317-5b1a70248c8f tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:17.130427 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-890c7684-95fb-49e7-8317-5b1a70248c8f tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:17.230350 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-890c7684-95fb-49e7-8317-5b1a70248c8f tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '355b96770f7e4f338ef21fc49c8de54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971ec7583d924ac3981bc789db78a733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:17.242023 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-890c7684-95fb-49e7-8317-5b1a70248c8f tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] 10.222.0.70 "GET /compute/v2.1/servers/e3b6b87a-f60c-4bda-8591-0c387e31bb4f" status: 200 len: 1230 microversion: 2.1 time: 0.134194 Aug 27 03:11:17.243784 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2598/5237] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:17 2022] GET /compute/v2.1/servers/e3b6b87a-f60c-4bda-8591-0c387e31bb4f => generated 1230 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:17.254116 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ab716544-bf00-4f66-93c3-124dbfd599b1 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:17.262682 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-ab716544-bf00-4f66-93c3-124dbfd599b1 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 28d2e08f-ea2f-42f2-beb5-bfdc368b9014] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:17.283099 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ab716544-bf00-4f66-93c3-124dbfd599b1 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:17.284753 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ab716544-bf00-4f66-93c3-124dbfd599b1 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:17.290315 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ab716544-bf00-4f66-93c3-124dbfd599b1 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:17.298465 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ab716544-bf00-4f66-93c3-124dbfd599b1 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:17.300533 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ab716544-bf00-4f66-93c3-124dbfd599b1 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:17.303357 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ab716544-bf00-4f66-93c3-124dbfd599b1 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:17.763155 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-ab716544-bf00-4f66-93c3-124dbfd599b1 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a549f85910184bf7a697cce7fa3dff96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92af206e05f44cf948b7c25d1acc139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:17.772206 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ab716544-bf00-4f66-93c3-124dbfd599b1 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "GET /compute/v2.1/servers/28d2e08f-ea2f-42f2-beb5-bfdc368b9014" status: 200 len: 1682 microversion: 2.1 time: 0.526189 Aug 27 03:11:17.775594 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2599/5238] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:17 2022] GET /compute/v2.1/servers/28d2e08f-ea2f-42f2-beb5-bfdc368b9014 => generated 1682 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:18.056566 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-83c6ecfe-537f-47f5-a3d5-5d762e61620f tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Flavor limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:11:18.058585 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-83c6ecfe-537f-47f5-a3d5-5d762e61620f tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Image limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:11:18.059450 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-83c6ecfe-537f-47f5-a3d5-5d762e61620f tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Flavor pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:11:18.060086 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-83c6ecfe-537f-47f5-a3d5-5d762e61620f tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Image pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:11:18.061660 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-83c6ecfe-537f-47f5-a3d5-5d762e61620f tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:11:18.082991 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-83c6ecfe-537f-47f5-a3d5-5d762e61620f tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:18.089984 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-83c6ecfe-537f-47f5-a3d5-5d762e61620f tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:18.091173 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-83c6ecfe-537f-47f5-a3d5-5d762e61620f tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:18.092144 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-83c6ecfe-537f-47f5-a3d5-5d762e61620f tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:18.095093 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-83c6ecfe-537f-47f5-a3d5-5d762e61620f tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:18.096193 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-83c6ecfe-537f-47f5-a3d5-5d762e61620f tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:18.158488 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-83c6ecfe-537f-47f5-a3d5-5d762e61620f tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Getting quotas for project 819c3b9e6e3c4a868b1ba77f48ff2e56. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:11:18.174901 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-83c6ecfe-537f-47f5-a3d5-5d762e61620f tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Getting quotas for user 8bf00e5925fa4227a2fe0b6b155a4ee4 and project 819c3b9e6e3c4a868b1ba77f48ff2e56. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:11:18.204300 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-83c6ecfe-537f-47f5-a3d5-5d762e61620f tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Going to run 1 instances... {{(pid=134051) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:11:18.206898 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-83c6ecfe-537f-47f5-a3d5-5d762e61620f tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 7e810377-eeef-436c-8fab-69fa71243a9d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134051) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:11:18.263730 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9354d70d-8f4d-4eef-b865-48aac0815902 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:18.264499 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-9354d70d-8f4d-4eef-b865-48aac0815902 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] [instance: e3b6b87a-f60c-4bda-8591-0c387e31bb4f] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:18.284485 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9354d70d-8f4d-4eef-b865-48aac0815902 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:18.285886 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9354d70d-8f4d-4eef-b865-48aac0815902 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:18.290958 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9354d70d-8f4d-4eef-b865-48aac0815902 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:18.292175 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9354d70d-8f4d-4eef-b865-48aac0815902 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:18.295275 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9354d70d-8f4d-4eef-b865-48aac0815902 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:18.296055 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9354d70d-8f4d-4eef-b865-48aac0815902 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:18.350426 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-83c6ecfe-537f-47f5-a3d5-5d762e61620f tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.589686 Aug 27 03:11:18.351685 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2640/5239] 10.222.0.70 () {62 vars in 1188 bytes} [Sat Aug 27 03:11:16 2022] POST /compute/v2.1/servers => generated 401 bytes in 1592 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 27 03:11:18.364889 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-0521344e-d410-4871-8631-bd16ca6f5f75 req-95416004-1fcf-466b-b25f-a52f256bf7e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28d2e08f-ea2f-42f2-beb5-bfdc368b9014", "name": "network-vif-deleted", "tag": "2402421f-b741-41f8-8a5a-d7796c14f7fd"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:11:18.382461 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-0521344e-d410-4871-8631-bd16ca6f5f75 req-95416004-1fcf-466b-b25f-a52f256bf7e0 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:18.383251 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-0521344e-d410-4871-8631-bd16ca6f5f75 req-95416004-1fcf-466b-b25f-a52f256bf7e0 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:18.383829 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-0521344e-d410-4871-8631-bd16ca6f5f75 req-95416004-1fcf-466b-b25f-a52f256bf7e0 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:18.415017 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-0521344e-d410-4871-8631-bd16ca6f5f75 req-95416004-1fcf-466b-b25f-a52f256bf7e0 service nova] Creating event network-vif-deleted:2402421f-b741-41f8-8a5a-d7796c14f7fd for instance 28d2e08f-ea2f-42f2-beb5-bfdc368b9014 on n-h1-852278-4 Aug 27 03:11:18.423919 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-0521344e-d410-4871-8631-bd16ca6f5f75 req-95416004-1fcf-466b-b25f-a52f256bf7e0 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069556 Aug 27 03:11:18.429035 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2641/5240] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:11:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:11:18.445580 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c0ba97d4-c4a0-4733-b8d4-6d45d57a8dca tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:18.446461 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-c0ba97d4-c4a0-4733-b8d4-6d45d57a8dca tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 7e810377-eeef-436c-8fab-69fa71243a9d] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:18.620349 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-9354d70d-8f4d-4eef-b865-48aac0815902 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '355b96770f7e4f338ef21fc49c8de54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971ec7583d924ac3981bc789db78a733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:18.621437 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-c0ba97d4-c4a0-4733-b8d4-6d45d57a8dca tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:18.630323 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-c0ba97d4-c4a0-4733-b8d4-6d45d57a8dca tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:18.634247 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-c0ba97d4-c4a0-4733-b8d4-6d45d57a8dca tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:18.635769 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c0ba97d4-c4a0-4733-b8d4-6d45d57a8dca tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d" status: 200 len: 1281 microversion: 2.20 time: 0.202191 Aug 27 03:11:18.637411 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2642/5241] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:11:18 2022] GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d => generated 1281 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:11:18.660301 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9354d70d-8f4d-4eef-b865-48aac0815902 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] 10.222.0.70 "GET /compute/v2.1/servers/e3b6b87a-f60c-4bda-8591-0c387e31bb4f" status: 200 len: 1230 microversion: 2.1 time: 0.400683 Aug 27 03:11:18.672345 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2600/5242] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:18 2022] GET /compute/v2.1/servers/e3b6b87a-f60c-4bda-8591-0c387e31bb4f => generated 1230 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:11:18.799071 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-9634e92d-511f-41e1-8d68-cbdd91379841 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:18.799688 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-9634e92d-511f-41e1-8d68-cbdd91379841 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 28d2e08f-ea2f-42f2-beb5-bfdc368b9014] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:18.830951 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9634e92d-511f-41e1-8d68-cbdd91379841 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:18.831739 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9634e92d-511f-41e1-8d68-cbdd91379841 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:18.833797 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9634e92d-511f-41e1-8d68-cbdd91379841 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:18.834523 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9634e92d-511f-41e1-8d68-cbdd91379841 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:18.834975 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9634e92d-511f-41e1-8d68-cbdd91379841 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:18.835396 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9634e92d-511f-41e1-8d68-cbdd91379841 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:18.942956 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9634e92d-511f-41e1-8d68-cbdd91379841 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:18.943442 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9634e92d-511f-41e1-8d68-cbdd91379841 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:18.943875 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9634e92d-511f-41e1-8d68-cbdd91379841 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:18.946540 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.objects.instance [None req-9634e92d-511f-41e1-8d68-cbdd91379841 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lazy-loading 'fault' on Instance uuid 28d2e08f-ea2f-42f2-beb5-bfdc368b9014 {{(pid=134051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:11:19.058182 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-9634e92d-511f-41e1-8d68-cbdd91379841 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a549f85910184bf7a697cce7fa3dff96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92af206e05f44cf948b7c25d1acc139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:19.082582 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-9634e92d-511f-41e1-8d68-cbdd91379841 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "GET /compute/v2.1/servers/28d2e08f-ea2f-42f2-beb5-bfdc368b9014" status: 200 len: 1331 microversion: 2.1 time: 0.273875 Aug 27 03:11:19.083761 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2643/5243] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:18 2022] GET /compute/v2.1/servers/28d2e08f-ea2f-42f2-beb5-bfdc368b9014 => generated 1331 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:19.662136 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-70b358cc-afe2-45d3-87a1-3e70140ae672 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:19.662619 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-70b358cc-afe2-45d3-87a1-3e70140ae672 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 7e810377-eeef-436c-8fab-69fa71243a9d] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:19.667494 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=3,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:11:19.683940 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4b8a6ed4-fa80-4118-80c4-66503c922da2 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:19.684860 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-4b8a6ed4-fa80-4118-80c4-66503c922da2 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] [instance: e3b6b87a-f60c-4bda-8591-0c387e31bb4f] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:19.689084 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-70b358cc-afe2-45d3-87a1-3e70140ae672 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:19.694519 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-70b358cc-afe2-45d3-87a1-3e70140ae672 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:19.695325 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-70b358cc-afe2-45d3-87a1-3e70140ae672 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:19.697927 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-70b358cc-afe2-45d3-87a1-3e70140ae672 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:19.702722 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-70b358cc-afe2-45d3-87a1-3e70140ae672 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:19.703393 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4b8a6ed4-fa80-4118-80c4-66503c922da2 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:19.704046 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-70b358cc-afe2-45d3-87a1-3e70140ae672 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:19.704810 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4b8a6ed4-fa80-4118-80c4-66503c922da2 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:19.707429 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4b8a6ed4-fa80-4118-80c4-66503c922da2 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:19.708729 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4b8a6ed4-fa80-4118-80c4-66503c922da2 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:19.712218 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4b8a6ed4-fa80-4118-80c4-66503c922da2 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:19.713575 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4b8a6ed4-fa80-4118-80c4-66503c922da2 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:20.349714 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-70b358cc-afe2-45d3-87a1-3e70140ae672 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:20.362470 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-70b358cc-afe2-45d3-87a1-3e70140ae672 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:20.368591 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-70b358cc-afe2-45d3-87a1-3e70140ae672 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:20.369845 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-70b358cc-afe2-45d3-87a1-3e70140ae672 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d" status: 200 len: 1277 microversion: 2.20 time: 0.714742 Aug 27 03:11:20.388331 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2601/5244] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:11:19 2022] GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d => generated 1277 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:11:20.397156 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-65fb6e27-be4b-4d7b-afa6-d61b22554bc4 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:20.400098 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-65fb6e27-be4b-4d7b-afa6-d61b22554bc4 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 28d2e08f-ea2f-42f2-beb5-bfdc368b9014] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:20.413745 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-65fb6e27-be4b-4d7b-afa6-d61b22554bc4 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:20.414254 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-65fb6e27-be4b-4d7b-afa6-d61b22554bc4 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:20.414692 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-65fb6e27-be4b-4d7b-afa6-d61b22554bc4 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:20.415420 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-65fb6e27-be4b-4d7b-afa6-d61b22554bc4 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:20.419927 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-4b8a6ed4-fa80-4118-80c4-66503c922da2 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '355b96770f7e4f338ef21fc49c8de54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971ec7583d924ac3981bc789db78a733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:20.428028 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-4b8a6ed4-fa80-4118-80c4-66503c922da2 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] 10.222.0.70 "GET /compute/v2.1/servers/e3b6b87a-f60c-4bda-8591-0c387e31bb4f" status: 200 len: 1230 microversion: 2.1 time: 0.748644 Aug 27 03:11:20.440461 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-65fb6e27-be4b-4d7b-afa6-d61b22554bc4 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:20.440461 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-65fb6e27-be4b-4d7b-afa6-d61b22554bc4 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:20.440767 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2644/5245] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:19 2022] GET /compute/v2.1/servers/e3b6b87a-f60c-4bda-8591-0c387e31bb4f => generated 1230 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:20.445412 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-65fb6e27-be4b-4d7b-afa6-d61b22554bc4 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] HTTP exception thrown: Instance 28d2e08f-ea2f-42f2-beb5-bfdc368b9014 could not be found. Aug 27 03:11:20.448254 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-65fb6e27-be4b-4d7b-afa6-d61b22554bc4 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Request method failure captured: Aug 27 03:11:20.448254 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/servers/28d2e08f-ea2f-42f2-beb5-bfdc368b9014 HTTP/1.1 Aug 27 03:11:20.448254 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 03:11:20.448254 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 03:11:20.448254 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 03:11:20.448254 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 03:11:20.448254 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 03:11:20.448254 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 03:11:20.448254 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 03:11:20.448254 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 03:11:20.448254 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYq440P3xsAabxN7nGlE2F1Ccxicf_9DU586MSNagRbCITstsgHyyHbnbZoUsiVfiyCUhE6F_2SvHrXIrDKvSEnzb0XjME8fkYvCR9LlCkoQHUfv6A1aESh1h-tIQR1qbnjbVFsJiiWy_WcC2U4qzkQvsEYcwujqY5DDaX4NjUQt4DA Aug 27 03:11:20.448254 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 03:11:20.448254 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 03:11:20.448254 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 03:11:20.448254 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 03:11:20.448254 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 03:11:20.448254 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 03:11:20.448254 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: b92af206e05f44cf948b7c25d1acc139 Aug 27 03:11:20.448254 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-AttachVolumeNegativeTest-878461886 Aug 27 03:11:20.448254 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 03:11:20.448254 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 03:11:20.448254 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b92af206e05f44cf948b7c25d1acc139"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_b92af206e05f44cf948b7c25d1acc139", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b92af206e05f44cf948b7c25d1acc139"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/b92af206e05f44cf948b7c25d1acc139"}]}] Aug 27 03:11:20.448254 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-AttachVolumeNegativeTest-878461886 Aug 27 03:11:20.448254 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: b92af206e05f44cf948b7c25d1acc139 Aug 27 03:11:20.448254 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-878461886 Aug 27 03:11:20.448254 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-AttachVolumeNegativeTest-878461886-project Aug 27 03:11:20.448254 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 03:11:20.448254 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 03:11:20.448254 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: a549f85910184bf7a697cce7fa3dff96 Aug 27 03:11:20.448254 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-AttachVolumeNegativeTest-878461886-project Aug 27 03:11:20.448254 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 03:11:20.448254 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance 28d2e08f-ea2f-42f2-beb5-bfdc368b9014 could not be found. Aug 27 03:11:20.448254 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '28d2e08f-ea2f-42f2-beb5-bfdc368b9014'} Aug 27 03:11:20.448254 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:11:20.448254 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:20.448254 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:11:20.448254 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:11:20.448254 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:11:20.448254 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:11:20.448254 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:11:20.448254 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:11:20.448254 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:11:20.448254 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:11:20.448254 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28d2e08f-ea2f-42f2-beb5-bfdc368b9014 could not be found. Aug 27 03:11:20.448254 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:11:20.448254 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:11:20.448254 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:11:20.448254 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:20.448254 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:11:20.448254 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:11:20.448254 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:11:20.448254 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:11:20.448254 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:11:20.448254 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:11:20.448254 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:11:20.448254 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:11:20.448254 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:11:20.448254 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:11:20.448254 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:11:20.448254 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:11:20.448254 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28d2e08f-ea2f-42f2-beb5-bfdc368b9014 could not be found. Aug 27 03:11:20.448254 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:11:20.448254 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:11:20.448254 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:11:20.452141 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:20.452141 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:11:20.452141 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:11:20.452141 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:11:20.452141 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:11:20.452141 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28d2e08f-ea2f-42f2-beb5-bfdc368b9014 could not be found. Aug 27 03:11:20.452141 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:11:20.452141 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-65fb6e27-be4b-4d7b-afa6-d61b22554bc4 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Returning 404 to user: Instance 28d2e08f-ea2f-42f2-beb5-bfdc368b9014 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:11:20.452141 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-65fb6e27-be4b-4d7b-afa6-d61b22554bc4 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "GET /compute/v2.1/servers/28d2e08f-ea2f-42f2-beb5-bfdc368b9014" status: 404 len: 111 microversion: 2.1 time: 0.060242 Aug 27 03:11:20.452141 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2602/5246] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:20 2022] GET /compute/v2.1/servers/28d2e08f-ea2f-42f2-beb5-bfdc368b9014 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:11:20.459635 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-fa4bb2cb-59c0-4a4f-8957-3a91e7705461 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '.version_select at 0x7f5ede996d30>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:20.466198 n-d-852278-4 devstack@n-api.service[134051]: ERROR oslo.messaging._drivers.impl_rabbit [None req-fa4bb2cb-59c0-4a4f-8957-3a91e7705461 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [f1aafa46-37af-4041-a1e3-3fd9730c0ab1] AMQP server on 10.222.0.70:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 27 03:11:21.396156 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0f241bca-1290-4142-afdf-7d28830fafd6 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:21.397485 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-0f241bca-1290-4142-afdf-7d28830fafd6 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 7e810377-eeef-436c-8fab-69fa71243a9d] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:21.415175 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0f241bca-1290-4142-afdf-7d28830fafd6 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:21.415684 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0f241bca-1290-4142-afdf-7d28830fafd6 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:21.416225 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0f241bca-1290-4142-afdf-7d28830fafd6 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:21.416919 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0f241bca-1290-4142-afdf-7d28830fafd6 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:21.417432 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0f241bca-1290-4142-afdf-7d28830fafd6 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:21.417873 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0f241bca-1290-4142-afdf-7d28830fafd6 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:21.450255 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:11:21.475597 n-d-852278-4 devstack@n-api.service[134051]: INFO oslo.messaging._drivers.impl_rabbit [None req-fa4bb2cb-59c0-4a4f-8957-3a91e7705461 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [f1aafa46-37af-4041-a1e3-3fd9730c0ab1] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 35708. Aug 27 03:11:21.510860 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-fa4bb2cb-59c0-4a4f-8957-3a91e7705461 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-157767419" status: 202 len: 0 microversion: 2.1 time: 1.054239 Aug 27 03:11:21.515086 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2645/5247] 10.222.0.70 () {58 vars in 1218 bytes} [Sat Aug 27 03:11:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-157767419 => generated 0 bytes in 1060 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:11:21.529068 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-5f41b003-1006-428a-8d89-89f6a07ce380 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:21.529686 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-5f41b003-1006-428a-8d89-89f6a07ce380 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] [instance: e3b6b87a-f60c-4bda-8591-0c387e31bb4f] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:21.549434 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5f41b003-1006-428a-8d89-89f6a07ce380 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:21.549985 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5f41b003-1006-428a-8d89-89f6a07ce380 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:21.550976 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5f41b003-1006-428a-8d89-89f6a07ce380 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:21.551330 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5f41b003-1006-428a-8d89-89f6a07ce380 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:21.551787 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5f41b003-1006-428a-8d89-89f6a07ce380 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:21.552213 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5f41b003-1006-428a-8d89-89f6a07ce380 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:21.607360 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0f241bca-1290-4142-afdf-7d28830fafd6 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:21.618088 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0f241bca-1290-4142-afdf-7d28830fafd6 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:21.624223 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0f241bca-1290-4142-afdf-7d28830fafd6 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:21.625431 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-0f241bca-1290-4142-afdf-7d28830fafd6 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d" status: 200 len: 1339 microversion: 2.20 time: 0.233908 Aug 27 03:11:21.626014 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2603/5248] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:11:21 2022] GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d => generated 1339 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:11:21.670599 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-5f41b003-1006-428a-8d89-89f6a07ce380 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '355b96770f7e4f338ef21fc49c8de54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971ec7583d924ac3981bc789db78a733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:21.679919 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-5f41b003-1006-428a-8d89-89f6a07ce380 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] 10.222.0.70 "GET /compute/v2.1/servers/e3b6b87a-f60c-4bda-8591-0c387e31bb4f" status: 200 len: 1230 microversion: 2.1 time: 0.161442 Aug 27 03:11:21.684133 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2646/5249] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:21 2022] GET /compute/v2.1/servers/e3b6b87a-f60c-4bda-8591-0c387e31bb4f => generated 1230 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:22.651718 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-fe488d6f-805c-4db6-a5c8-82f8cb673086 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:22.652437 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-fe488d6f-805c-4db6-a5c8-82f8cb673086 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 7e810377-eeef-436c-8fab-69fa71243a9d] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:22.677486 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fe488d6f-805c-4db6-a5c8-82f8cb673086 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:22.679769 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fe488d6f-805c-4db6-a5c8-82f8cb673086 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:22.680226 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fe488d6f-805c-4db6-a5c8-82f8cb673086 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:22.684511 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fe488d6f-805c-4db6-a5c8-82f8cb673086 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:22.684811 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fe488d6f-805c-4db6-a5c8-82f8cb673086 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:22.685249 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fe488d6f-805c-4db6-a5c8-82f8cb673086 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:22.708788 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-38b17bf1-5098-47fb-90cf-661b8a643231 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:22.710165 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-38b17bf1-5098-47fb-90cf-661b8a643231 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] [instance: e3b6b87a-f60c-4bda-8591-0c387e31bb4f] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:22.719349 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-38b17bf1-5098-47fb-90cf-661b8a643231 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:22.720458 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-38b17bf1-5098-47fb-90cf-661b8a643231 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:22.721516 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-38b17bf1-5098-47fb-90cf-661b8a643231 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:22.722477 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-38b17bf1-5098-47fb-90cf-661b8a643231 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:22.723786 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-38b17bf1-5098-47fb-90cf-661b8a643231 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:22.724471 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-38b17bf1-5098-47fb-90cf-661b8a643231 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:22.909209 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-38b17bf1-5098-47fb-90cf-661b8a643231 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '355b96770f7e4f338ef21fc49c8de54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971ec7583d924ac3981bc789db78a733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:22.934808 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-38b17bf1-5098-47fb-90cf-661b8a643231 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] 10.222.0.70 "GET /compute/v2.1/servers/e3b6b87a-f60c-4bda-8591-0c387e31bb4f" status: 200 len: 1230 microversion: 2.1 time: 0.232543 Aug 27 03:11:22.951308 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2647/5250] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:22 2022] GET /compute/v2.1/servers/e3b6b87a-f60c-4bda-8591-0c387e31bb4f => generated 1230 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:23.467266 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-fe488d6f-805c-4db6-a5c8-82f8cb673086 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:23.486718 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-fe488d6f-805c-4db6-a5c8-82f8cb673086 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:23.499963 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-fe488d6f-805c-4db6-a5c8-82f8cb673086 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:23.504363 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-fe488d6f-805c-4db6-a5c8-82f8cb673086 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d" status: 200 len: 1406 microversion: 2.20 time: 0.857787 Aug 27 03:11:23.508365 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2604/5251] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:11:22 2022] GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d => generated 1406 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:11:23.961724 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-32c872dc-5ffa-44fd-b022-64e8384bf27b tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:23.962345 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-32c872dc-5ffa-44fd-b022-64e8384bf27b tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] [instance: e3b6b87a-f60c-4bda-8591-0c387e31bb4f] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:23.998532 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-32c872dc-5ffa-44fd-b022-64e8384bf27b tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:23.999042 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-32c872dc-5ffa-44fd-b022-64e8384bf27b tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:24.000788 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-32c872dc-5ffa-44fd-b022-64e8384bf27b tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:24.003770 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-32c872dc-5ffa-44fd-b022-64e8384bf27b tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:24.004274 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-32c872dc-5ffa-44fd-b022-64e8384bf27b tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:24.004752 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-32c872dc-5ffa-44fd-b022-64e8384bf27b tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:24.161293 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-32c872dc-5ffa-44fd-b022-64e8384bf27b tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '355b96770f7e4f338ef21fc49c8de54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971ec7583d924ac3981bc789db78a733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:24.174738 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-32c872dc-5ffa-44fd-b022-64e8384bf27b tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] 10.222.0.70 "GET /compute/v2.1/servers/e3b6b87a-f60c-4bda-8591-0c387e31bb4f" status: 200 len: 1230 microversion: 2.1 time: 0.216768 Aug 27 03:11:24.176099 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2648/5252] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:23 2022] GET /compute/v2.1/servers/e3b6b87a-f60c-4bda-8591-0c387e31bb4f => generated 1230 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:24.387878 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6bf190ab-661f-48a7-9254-a7dc86d1c83c tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Action: 'create', calling method: .version_select at 0x7f5ee2d53430>, body: {"keypair": {"name": "tempest-keypair-2032077909", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPwsVZzD2u/63yKwaTeeTbF5YhbFocjGYnE7lChDdK7u3IMHXqZV5r5T1/MRzlDc4CU7piJZNDR3VBCUw1bXKcyWiEsv6HKzF8I/Cpb+Y1zBiJCGBZX78tjdSjbckM7buQ=="}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:11:24.414989 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=4 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:11:24.442585 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-6bf190ab-661f-48a7-9254-a7dc86d1c83c tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Getting quotas for project b92af206e05f44cf948b7c25d1acc139. Resources: {'key_pairs'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:11:24.456681 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-6bf190ab-661f-48a7-9254-a7dc86d1c83c tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Getting quotas for user a549f85910184bf7a697cce7fa3dff96 and project b92af206e05f44cf948b7c25d1acc139. Resources: {'key_pairs'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:11:24.522137 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-6bf190ab-661f-48a7-9254-a7dc86d1c83c tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.139125 Aug 27 03:11:24.523219 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2605/5253] 10.222.0.70 () {60 vars in 1159 bytes} [Sat Aug 27 03:11:24 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:11:24.528785 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d5bce394-9134-4298-9928-71f0dbba5870 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:24.529502 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d5bce394-9134-4298-9928-71f0dbba5870 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 7e810377-eeef-436c-8fab-69fa71243a9d] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:24.537039 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d5bce394-9134-4298-9928-71f0dbba5870 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:24.549329 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d5bce394-9134-4298-9928-71f0dbba5870 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:24.550970 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d5bce394-9134-4298-9928-71f0dbba5870 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:24.553404 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d5bce394-9134-4298-9928-71f0dbba5870 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:24.555254 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d5bce394-9134-4298-9928-71f0dbba5870 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:24.555864 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d5bce394-9134-4298-9928-71f0dbba5870 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:24.570618 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:11:24.933884 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-f70e0097-cc9d-4eb4-a551-c81f677383ac req-9ef01934-e0e9-4006-96e2-31969412dc3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e810377-eeef-436c-8fab-69fa71243a9d", "tag": "2c3d5445-7fe3-4101-9cf9-d7b63e882f1e"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:11:24.953284 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-f70e0097-cc9d-4eb4-a551-c81f677383ac req-9ef01934-e0e9-4006-96e2-31969412dc3c service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:24.953786 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-f70e0097-cc9d-4eb4-a551-c81f677383ac req-9ef01934-e0e9-4006-96e2-31969412dc3c service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:24.954216 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-f70e0097-cc9d-4eb4-a551-c81f677383ac req-9ef01934-e0e9-4006-96e2-31969412dc3c service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:24.978833 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-f70e0097-cc9d-4eb4-a551-c81f677383ac req-9ef01934-e0e9-4006-96e2-31969412dc3c service nova] Creating event network-changed:2c3d5445-7fe3-4101-9cf9-d7b63e882f1e for instance 7e810377-eeef-436c-8fab-69fa71243a9d on n-h1-852278-4 Aug 27 03:11:24.984266 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-f70e0097-cc9d-4eb4-a551-c81f677383ac req-9ef01934-e0e9-4006-96e2-31969412dc3c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057292 Aug 27 03:11:24.985709 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2606/5254] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:11:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:11:25.201160 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-dc666006-f496-4eca-8ce5-53dd0031554d tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:25.202037 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-dc666006-f496-4eca-8ce5-53dd0031554d tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] [instance: e3b6b87a-f60c-4bda-8591-0c387e31bb4f] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:25.221568 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dc666006-f496-4eca-8ce5-53dd0031554d tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:25.222225 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dc666006-f496-4eca-8ce5-53dd0031554d tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:25.222772 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dc666006-f496-4eca-8ce5-53dd0031554d tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:25.223649 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dc666006-f496-4eca-8ce5-53dd0031554d tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:25.224212 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dc666006-f496-4eca-8ce5-53dd0031554d tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:25.224879 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dc666006-f496-4eca-8ce5-53dd0031554d tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:25.400075 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d5bce394-9134-4298-9928-71f0dbba5870 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:25.410261 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d5bce394-9134-4298-9928-71f0dbba5870 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:25.411716 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d5bce394-9134-4298-9928-71f0dbba5870 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:25.412895 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d5bce394-9134-4298-9928-71f0dbba5870 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d" status: 200 len: 1406 microversion: 2.20 time: 0.888348 Aug 27 03:11:25.413468 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2649/5255] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:11:24 2022] GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d => generated 1406 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:11:25.439957 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-dc666006-f496-4eca-8ce5-53dd0031554d tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '355b96770f7e4f338ef21fc49c8de54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971ec7583d924ac3981bc789db78a733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:25.454079 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-dc666006-f496-4eca-8ce5-53dd0031554d tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] 10.222.0.70 "GET /compute/v2.1/servers/e3b6b87a-f60c-4bda-8591-0c387e31bb4f" status: 200 len: 1230 microversion: 2.1 time: 0.258579 Aug 27 03:11:25.456596 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2607/5256] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:25 2022] GET /compute/v2.1/servers/e3b6b87a-f60c-4bda-8591-0c387e31bb4f => generated 1230 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:26.437050 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0857aa6d-4345-4e83-b1c2-240e96950695 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:26.438562 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-0857aa6d-4345-4e83-b1c2-240e96950695 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 7e810377-eeef-436c-8fab-69fa71243a9d] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:26.452361 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0857aa6d-4345-4e83-b1c2-240e96950695 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:26.453606 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0857aa6d-4345-4e83-b1c2-240e96950695 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:26.456958 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0857aa6d-4345-4e83-b1c2-240e96950695 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:26.458575 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0857aa6d-4345-4e83-b1c2-240e96950695 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:26.460382 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0857aa6d-4345-4e83-b1c2-240e96950695 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:26.461774 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0857aa6d-4345-4e83-b1c2-240e96950695 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:26.479389 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-7bbdddde-71e5-4f4b-ba2f-a69947537411 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:26.480012 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-7bbdddde-71e5-4f4b-ba2f-a69947537411 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] [instance: e3b6b87a-f60c-4bda-8591-0c387e31bb4f] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:26.493379 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7bbdddde-71e5-4f4b-ba2f-a69947537411 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:26.494126 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7bbdddde-71e5-4f4b-ba2f-a69947537411 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:26.494885 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7bbdddde-71e5-4f4b-ba2f-a69947537411 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:26.495798 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7bbdddde-71e5-4f4b-ba2f-a69947537411 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:26.496438 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7bbdddde-71e5-4f4b-ba2f-a69947537411 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:26.497020 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7bbdddde-71e5-4f4b-ba2f-a69947537411 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:26.659287 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-7bbdddde-71e5-4f4b-ba2f-a69947537411 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '355b96770f7e4f338ef21fc49c8de54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971ec7583d924ac3981bc789db78a733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:26.672189 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-7bbdddde-71e5-4f4b-ba2f-a69947537411 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] 10.222.0.70 "GET /compute/v2.1/servers/e3b6b87a-f60c-4bda-8591-0c387e31bb4f" status: 200 len: 1230 microversion: 2.1 time: 0.196776 Aug 27 03:11:26.672850 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2608/5257] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:26 2022] GET /compute/v2.1/servers/e3b6b87a-f60c-4bda-8591-0c387e31bb4f => generated 1230 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:26.814880 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-592e0012-b7c6-49d2-a8e2-53922f862537 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "de2737e4-cffb-44ca-9b0f-a7aab49a964f", "device": "/dev/sdb"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:11:26.820488 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-592e0012-b7c6-49d2-a8e2-53922f862537 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] [instance: ecf965e2-f12b-48bf-852c-4ddb1e930f5c] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:26.829188 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-592e0012-b7c6-49d2-a8e2-53922f862537 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:26.831611 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-592e0012-b7c6-49d2-a8e2-53922f862537 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:26.834077 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-592e0012-b7c6-49d2-a8e2-53922f862537 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:26.836422 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-592e0012-b7c6-49d2-a8e2-53922f862537 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:26.838546 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-592e0012-b7c6-49d2-a8e2-53922f862537 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:26.842146 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-592e0012-b7c6-49d2-a8e2-53922f862537 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:26.879307 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-0857aa6d-4345-4e83-b1c2-240e96950695 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:26.890586 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-0857aa6d-4345-4e83-b1c2-240e96950695 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:26.900898 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-0857aa6d-4345-4e83-b1c2-240e96950695 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:26.902689 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-0857aa6d-4345-4e83-b1c2-240e96950695 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d" status: 200 len: 1406 microversion: 2.20 time: 0.471205 Aug 27 03:11:26.903903 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2650/5258] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:11:26 2022] GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d => generated 1406 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:11:27.326243 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-592e0012-b7c6-49d2-a8e2-53922f862537 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] 10.222.0.70 "POST /compute/v2.1/servers/ecf965e2-f12b-48bf-852c-4ddb1e930f5c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.522841 Aug 27 03:11:27.326925 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2609/5259] 10.222.0.70 () {60 vars in 1323 bytes} [Sat Aug 27 03:11:26 2022] POST /compute/v2.1/servers/ecf965e2-f12b-48bf-852c-4ddb1e930f5c/os-volume_attachments => generated 194 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:11:27.697628 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e0c15b51-731a-4c4f-b3a0-41a9a5339361 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:27.698851 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-e0c15b51-731a-4c4f-b3a0-41a9a5339361 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] [instance: e3b6b87a-f60c-4bda-8591-0c387e31bb4f] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:27.709824 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e0c15b51-731a-4c4f-b3a0-41a9a5339361 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:27.710364 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e0c15b51-731a-4c4f-b3a0-41a9a5339361 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:27.710806 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e0c15b51-731a-4c4f-b3a0-41a9a5339361 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:27.711523 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e0c15b51-731a-4c4f-b3a0-41a9a5339361 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:27.711975 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e0c15b51-731a-4c4f-b3a0-41a9a5339361 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:27.712424 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e0c15b51-731a-4c4f-b3a0-41a9a5339361 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:27.790187 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e0c15b51-731a-4c4f-b3a0-41a9a5339361 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '355b96770f7e4f338ef21fc49c8de54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971ec7583d924ac3981bc789db78a733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:27.812543 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e0c15b51-731a-4c4f-b3a0-41a9a5339361 tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] 10.222.0.70 "GET /compute/v2.1/servers/e3b6b87a-f60c-4bda-8591-0c387e31bb4f" status: 200 len: 1230 microversion: 2.1 time: 0.118684 Aug 27 03:11:27.813511 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2651/5260] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:27 2022] GET /compute/v2.1/servers/e3b6b87a-f60c-4bda-8591-0c387e31bb4f => generated 1230 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:27.931039 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-58155066-c247-4632-b909-e22adfc96fb8 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:27.932186 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-58155066-c247-4632-b909-e22adfc96fb8 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 7e810377-eeef-436c-8fab-69fa71243a9d] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:27.950533 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-58155066-c247-4632-b909-e22adfc96fb8 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:27.951395 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-58155066-c247-4632-b909-e22adfc96fb8 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:27.952093 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-58155066-c247-4632-b909-e22adfc96fb8 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:27.953310 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-58155066-c247-4632-b909-e22adfc96fb8 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:27.954015 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-58155066-c247-4632-b909-e22adfc96fb8 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:27.954681 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-58155066-c247-4632-b909-e22adfc96fb8 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:28.258587 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-58155066-c247-4632-b909-e22adfc96fb8 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:28.284942 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-58155066-c247-4632-b909-e22adfc96fb8 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:28.290406 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-58155066-c247-4632-b909-e22adfc96fb8 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:28.292537 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-58155066-c247-4632-b909-e22adfc96fb8 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d" status: 200 len: 1406 microversion: 2.20 time: 0.366065 Aug 27 03:11:28.293458 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2610/5261] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:11:27 2022] GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d => generated 1406 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:11:28.655821 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f694bfb0-1e6f-439d-a896-f5cac54ced18 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-390165290", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a7b97b39-d409-4ab1-957a-8381e0b7ec94"}], "security_groups": [{"name": "tempest-securitygroup--695788296"}], "key_name": "tempest-keypair-2032077909", "user_data": "}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:11:28.670487 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:11:28.672053 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=8 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:11:28.787317 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.network.neutron [None req-f694bfb0-1e6f-439d-a896-f5cac54ced18 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] validate_networks() for [('a7b97b39-d409-4ab1-957a-8381e0b7ec94', None, None, None, None, None)] {{(pid=134051) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:11:28.980056 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3e68a253-b772-4e6e-be6a-6eae636e27ca tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:28.980865 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-3e68a253-b772-4e6e-be6a-6eae636e27ca tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] [instance: e3b6b87a-f60c-4bda-8591-0c387e31bb4f] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:28.995744 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3e68a253-b772-4e6e-be6a-6eae636e27ca tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:29.001632 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3e68a253-b772-4e6e-be6a-6eae636e27ca tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:29.002003 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3e68a253-b772-4e6e-be6a-6eae636e27ca tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:29.002765 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3e68a253-b772-4e6e-be6a-6eae636e27ca tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:29.008791 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3e68a253-b772-4e6e-be6a-6eae636e27ca tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:29.009300 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3e68a253-b772-4e6e-be6a-6eae636e27ca tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:29.039657 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-3e68a253-b772-4e6e-be6a-6eae636e27ca tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] HTTP exception thrown: Instance e3b6b87a-f60c-4bda-8591-0c387e31bb4f could not be found. Aug 27 03:11:29.041459 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3e68a253-b772-4e6e-be6a-6eae636e27ca tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Request method failure captured: Aug 27 03:11:29.041459 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/servers/e3b6b87a-f60c-4bda-8591-0c387e31bb4f HTTP/1.1 Aug 27 03:11:29.041459 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 03:11:29.041459 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 03:11:29.041459 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 03:11:29.041459 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 03:11:29.041459 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 03:11:29.041459 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 03:11:29.041459 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 03:11:29.041459 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 03:11:29.041459 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYoqAvIkk5ce-3_-r-YMSzm8orPoBk1OsRzEBjYR7u7akaydX32EQXp8DucdfW6IWxIQsU4bu9dLk2J32oUCVfQqN2N_g-uAQHFM0BeKXlJ-XYsvo7m63_JT6fSGuVK_n0NaC-wk9wV3WX_Agzn3fPEqJbRHZrNn04eGWg7zf9ycRu0 Aug 27 03:11:29.041459 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 03:11:29.041459 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 03:11:29.041459 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 03:11:29.041459 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 03:11:29.041459 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 03:11:29.041459 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 03:11:29.041459 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 971ec7583d924ac3981bc789db78a733 Aug 27 03:11:29.041459 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-TestVolumeBackupRestore-1372451431 Aug 27 03:11:29.041459 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 03:11:29.041459 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 03:11:29.041459 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/971ec7583d924ac3981bc789db78a733"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_971ec7583d924ac3981bc789db78a733", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/971ec7583d924ac3981bc789db78a733"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/971ec7583d924ac3981bc789db78a733"}]}] Aug 27 03:11:29.041459 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-TestVolumeBackupRestore-1372451431 Aug 27 03:11:29.041459 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 971ec7583d924ac3981bc789db78a733 Aug 27 03:11:29.041459 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-TestVolumeBackupRestore-1372451431 Aug 27 03:11:29.041459 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-TestVolumeBackupRestore-1372451431-project Aug 27 03:11:29.041459 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 03:11:29.041459 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 03:11:29.041459 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 355b96770f7e4f338ef21fc49c8de54d Aug 27 03:11:29.041459 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-TestVolumeBackupRestore-1372451431-project Aug 27 03:11:29.041459 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 03:11:29.041459 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance e3b6b87a-f60c-4bda-8591-0c387e31bb4f could not be found. Aug 27 03:11:29.041459 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': 'e3b6b87a-f60c-4bda-8591-0c387e31bb4f'} Aug 27 03:11:29.041459 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:11:29.041459 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:29.041459 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:11:29.041459 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:11:29.041459 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:11:29.041459 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:11:29.041459 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:11:29.041459 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:11:29.041459 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:11:29.041459 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:11:29.041459 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3b6b87a-f60c-4bda-8591-0c387e31bb4f could not be found. Aug 27 03:11:29.041459 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:11:29.041459 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:11:29.041459 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:11:29.041459 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:29.041459 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:11:29.041459 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:11:29.041459 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:11:29.041459 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:11:29.041459 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:11:29.041459 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:11:29.041459 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:11:29.041459 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:11:29.041459 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:11:29.041459 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:11:29.041459 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:11:29.041459 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:11:29.041459 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3b6b87a-f60c-4bda-8591-0c387e31bb4f could not be found. Aug 27 03:11:29.041459 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:11:29.041459 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:11:29.041459 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:11:29.046753 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:29.046753 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:11:29.046753 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:11:29.046753 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:11:29.046753 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:11:29.046753 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3b6b87a-f60c-4bda-8591-0c387e31bb4f could not be found. Aug 27 03:11:29.046753 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:11:29.046753 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3e68a253-b772-4e6e-be6a-6eae636e27ca tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Returning 404 to user: Instance e3b6b87a-f60c-4bda-8591-0c387e31bb4f could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:11:29.046753 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-3e68a253-b772-4e6e-be6a-6eae636e27ca tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] 10.222.0.70 "GET /compute/v2.1/servers/e3b6b87a-f60c-4bda-8591-0c387e31bb4f" status: 404 len: 111 microversion: 2.1 time: 0.215177 Aug 27 03:11:29.046753 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2611/5262] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:28 2022] GET /compute/v2.1/servers/e3b6b87a-f60c-4bda-8591-0c387e31bb4f => generated 111 bytes in 218 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 03:11:29.315741 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-40da4604-7747-4965-9237-666cf8434a8e tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] Calling method '.version_select at 0x7f5ee339b9d0>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:29.356071 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-40da4604-7747-4965-9237-666cf8434a8e tempest-TestVolumeBackupRestore-1372451431 tempest-TestVolumeBackupRestore-1372451431-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1473935662" status: 202 len: 0 microversion: 2.1 time: 0.043121 Aug 27 03:11:29.358893 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2612/5263] 10.222.0.70 () {58 vars in 1269 bytes} [Sat Aug 27 03:11:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1473935662 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 03:11:29.368252 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6ff36b18-0f7b-47da-9264-b7a71ef0aa26 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:29.368921 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-6ff36b18-0f7b-47da-9264-b7a71ef0aa26 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 7e810377-eeef-436c-8fab-69fa71243a9d] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:29.394410 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6ff36b18-0f7b-47da-9264-b7a71ef0aa26 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:29.394935 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6ff36b18-0f7b-47da-9264-b7a71ef0aa26 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:29.395353 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6ff36b18-0f7b-47da-9264-b7a71ef0aa26 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:29.396073 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6ff36b18-0f7b-47da-9264-b7a71ef0aa26 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:29.396568 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6ff36b18-0f7b-47da-9264-b7a71ef0aa26 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:29.396994 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6ff36b18-0f7b-47da-9264-b7a71ef0aa26 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:29.487353 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-f694bfb0-1e6f-439d-a896-f5cac54ced18 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Flavor limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:11:29.487777 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-f694bfb0-1e6f-439d-a896-f5cac54ced18 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Image limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:11:29.488591 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-f694bfb0-1e6f-439d-a896-f5cac54ced18 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Flavor pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:11:29.489247 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-f694bfb0-1e6f-439d-a896-f5cac54ced18 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Image pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:11:29.489862 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-f694bfb0-1e6f-439d-a896-f5cac54ced18 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:11:29.508105 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f694bfb0-1e6f-439d-a896-f5cac54ced18 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:29.510954 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f694bfb0-1e6f-439d-a896-f5cac54ced18 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:29.511462 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f694bfb0-1e6f-439d-a896-f5cac54ced18 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:29.512238 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f694bfb0-1e6f-439d-a896-f5cac54ced18 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:29.513863 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f694bfb0-1e6f-439d-a896-f5cac54ced18 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:29.514297 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f694bfb0-1e6f-439d-a896-f5cac54ced18 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:29.555675 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-f694bfb0-1e6f-439d-a896-f5cac54ced18 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Getting quotas for project b92af206e05f44cf948b7c25d1acc139. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:11:29.565617 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-f694bfb0-1e6f-439d-a896-f5cac54ced18 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Getting quotas for user a549f85910184bf7a697cce7fa3dff96 and project b92af206e05f44cf948b7c25d1acc139. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:11:29.599896 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-f694bfb0-1e6f-439d-a896-f5cac54ced18 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Going to run 1 instances... {{(pid=134051) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:11:29.607509 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-f694bfb0-1e6f-439d-a896-f5cac54ced18 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 3ae351e6-e583-4f93-bdae-771141c96703] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134051) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:11:29.679312 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-6ff36b18-0f7b-47da-9264-b7a71ef0aa26 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:29.713763 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-6ff36b18-0f7b-47da-9264-b7a71ef0aa26 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:29.721411 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-6ff36b18-0f7b-47da-9264-b7a71ef0aa26 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:29.723992 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-f694bfb0-1e6f-439d-a896-f5cac54ced18 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.074485 Aug 27 03:11:29.725672 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-6ff36b18-0f7b-47da-9264-b7a71ef0aa26 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d" status: 200 len: 1406 microversion: 2.20 time: 0.365770 Aug 27 03:11:29.727565 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2613/5264] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:11:29 2022] GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d => generated 1406 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:11:29.729929 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2652/5265] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 03:11:28 2022] POST /compute/v2.1/servers => generated 401 bytes in 1081 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 03:11:29.744120 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d403f985-ad66-4fdc-8de8-f59937d83e9a tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:29.749058 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d403f985-ad66-4fdc-8de8-f59937d83e9a tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 3ae351e6-e583-4f93-bdae-771141c96703] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:29.914409 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-d403f985-ad66-4fdc-8de8-f59937d83e9a tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a549f85910184bf7a697cce7fa3dff96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92af206e05f44cf948b7c25d1acc139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:29.933044 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d403f985-ad66-4fdc-8de8-f59937d83e9a tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "GET /compute/v2.1/servers/3ae351e6-e583-4f93-bdae-771141c96703" status: 200 len: 1241 microversion: 2.1 time: 0.195526 Aug 27 03:11:29.933888 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2614/5266] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:29 2022] GET /compute/v2.1/servers/3ae351e6-e583-4f93-bdae-771141c96703 => generated 1241 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:30.755675 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3ecf599f-9ae5-452e-9b85-09ffa94ccf08 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:30.756248 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-3ecf599f-9ae5-452e-9b85-09ffa94ccf08 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 7e810377-eeef-436c-8fab-69fa71243a9d] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:30.767472 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3ecf599f-9ae5-452e-9b85-09ffa94ccf08 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:30.767970 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3ecf599f-9ae5-452e-9b85-09ffa94ccf08 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:30.776058 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3ecf599f-9ae5-452e-9b85-09ffa94ccf08 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:30.777021 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3ecf599f-9ae5-452e-9b85-09ffa94ccf08 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:30.777508 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3ecf599f-9ae5-452e-9b85-09ffa94ccf08 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:30.781727 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3ecf599f-9ae5-452e-9b85-09ffa94ccf08 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:30.952524 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6eaa2007-e657-44e7-8270-d9c49d5c451e tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:30.953145 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-6eaa2007-e657-44e7-8270-d9c49d5c451e tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 3ae351e6-e583-4f93-bdae-771141c96703] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:30.974116 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6eaa2007-e657-44e7-8270-d9c49d5c451e tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:30.974629 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6eaa2007-e657-44e7-8270-d9c49d5c451e tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:30.975080 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6eaa2007-e657-44e7-8270-d9c49d5c451e tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:30.975863 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6eaa2007-e657-44e7-8270-d9c49d5c451e tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:30.976417 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6eaa2007-e657-44e7-8270-d9c49d5c451e tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:30.976889 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6eaa2007-e657-44e7-8270-d9c49d5c451e tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:31.096375 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-3ecf599f-9ae5-452e-9b85-09ffa94ccf08 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:31.116283 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-3ecf599f-9ae5-452e-9b85-09ffa94ccf08 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:31.123844 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-3ecf599f-9ae5-452e-9b85-09ffa94ccf08 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:31.125460 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-3ecf599f-9ae5-452e-9b85-09ffa94ccf08 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d" status: 200 len: 1406 microversion: 2.20 time: 0.379373 Aug 27 03:11:31.141065 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2653/5267] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:11:30 2022] GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d => generated 1406 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:11:31.173744 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-6eaa2007-e657-44e7-8270-d9c49d5c451e tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a549f85910184bf7a697cce7fa3dff96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92af206e05f44cf948b7c25d1acc139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:31.183313 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-6eaa2007-e657-44e7-8270-d9c49d5c451e tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "GET /compute/v2.1/servers/3ae351e6-e583-4f93-bdae-771141c96703" status: 200 len: 1293 microversion: 2.1 time: 0.234344 Aug 27 03:11:31.200050 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2615/5268] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:30 2022] GET /compute/v2.1/servers/3ae351e6-e583-4f93-bdae-771141c96703 => generated 1293 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:31.482448 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-d9f804f0-9276-4b49-ac31-9a2e99e57229 req-bfcb0db0-ca2e-44b6-88b1-230e00e1e437 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e810377-eeef-436c-8fab-69fa71243a9d", "name": "network-vif-plugged", "status": "completed", "tag": "2c3d5445-7fe3-4101-9cf9-d7b63e882f1e"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:11:31.500701 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-d9f804f0-9276-4b49-ac31-9a2e99e57229 req-bfcb0db0-ca2e-44b6-88b1-230e00e1e437 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:31.501128 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-d9f804f0-9276-4b49-ac31-9a2e99e57229 req-bfcb0db0-ca2e-44b6-88b1-230e00e1e437 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:31.501651 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-d9f804f0-9276-4b49-ac31-9a2e99e57229 req-bfcb0db0-ca2e-44b6-88b1-230e00e1e437 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:31.550258 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-d9f804f0-9276-4b49-ac31-9a2e99e57229 req-bfcb0db0-ca2e-44b6-88b1-230e00e1e437 service nova] Creating event network-vif-plugged:2c3d5445-7fe3-4101-9cf9-d7b63e882f1e for instance 7e810377-eeef-436c-8fab-69fa71243a9d on n-h1-852278-4 Aug 27 03:11:31.563387 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-d9f804f0-9276-4b49-ac31-9a2e99e57229 req-bfcb0db0-ca2e-44b6-88b1-230e00e1e437 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.195453 Aug 27 03:11:31.572451 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2654/5269] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:11:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:11:32.152479 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-cb632e4f-fdd8-41f9-a2e4-6990e0c1bc70 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:32.153980 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-cb632e4f-fdd8-41f9-a2e4-6990e0c1bc70 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 7e810377-eeef-436c-8fab-69fa71243a9d] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:32.168978 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cb632e4f-fdd8-41f9-a2e4-6990e0c1bc70 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:32.170152 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cb632e4f-fdd8-41f9-a2e4-6990e0c1bc70 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:32.170753 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cb632e4f-fdd8-41f9-a2e4-6990e0c1bc70 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:32.172088 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cb632e4f-fdd8-41f9-a2e4-6990e0c1bc70 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:32.172834 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cb632e4f-fdd8-41f9-a2e4-6990e0c1bc70 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:32.174130 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cb632e4f-fdd8-41f9-a2e4-6990e0c1bc70 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:32.210114 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-257a52ce-ecd6-45dc-a57c-68bbc1f23f90 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:32.210971 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-257a52ce-ecd6-45dc-a57c-68bbc1f23f90 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 3ae351e6-e583-4f93-bdae-771141c96703] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:32.228732 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-257a52ce-ecd6-45dc-a57c-68bbc1f23f90 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:32.229272 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-257a52ce-ecd6-45dc-a57c-68bbc1f23f90 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:32.233490 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-257a52ce-ecd6-45dc-a57c-68bbc1f23f90 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:32.235106 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-257a52ce-ecd6-45dc-a57c-68bbc1f23f90 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:32.235511 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-257a52ce-ecd6-45dc-a57c-68bbc1f23f90 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:32.238712 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-257a52ce-ecd6-45dc-a57c-68bbc1f23f90 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:32.351624 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-257a52ce-ecd6-45dc-a57c-68bbc1f23f90 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a549f85910184bf7a697cce7fa3dff96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92af206e05f44cf948b7c25d1acc139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:32.366926 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-257a52ce-ecd6-45dc-a57c-68bbc1f23f90 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "GET /compute/v2.1/servers/3ae351e6-e583-4f93-bdae-771141c96703" status: 200 len: 1299 microversion: 2.1 time: 0.163327 Aug 27 03:11:32.380957 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2655/5270] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:32 2022] GET /compute/v2.1/servers/3ae351e6-e583-4f93-bdae-771141c96703 => generated 1299 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:32.501974 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-cb632e4f-fdd8-41f9-a2e4-6990e0c1bc70 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:32.513966 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-cb632e4f-fdd8-41f9-a2e4-6990e0c1bc70 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:32.517204 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-cb632e4f-fdd8-41f9-a2e4-6990e0c1bc70 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:32.518950 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-cb632e4f-fdd8-41f9-a2e4-6990e0c1bc70 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d" status: 200 len: 1406 microversion: 2.20 time: 0.372587 Aug 27 03:11:32.519641 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2616/5271] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:11:32 2022] GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d => generated 1406 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:11:33.391513 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0378ab3b-e5b4-47e1-8b64-eaa037f0c069 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:33.393288 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-0378ab3b-e5b4-47e1-8b64-eaa037f0c069 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 3ae351e6-e583-4f93-bdae-771141c96703] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:33.405054 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0378ab3b-e5b4-47e1-8b64-eaa037f0c069 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:33.405857 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0378ab3b-e5b4-47e1-8b64-eaa037f0c069 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:33.406491 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0378ab3b-e5b4-47e1-8b64-eaa037f0c069 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:33.407468 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0378ab3b-e5b4-47e1-8b64-eaa037f0c069 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:33.408224 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0378ab3b-e5b4-47e1-8b64-eaa037f0c069 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:33.409127 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0378ab3b-e5b4-47e1-8b64-eaa037f0c069 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:33.543588 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f3197e23-5e91-46ae-9edf-68dd051294fa tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:33.544258 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-f3197e23-5e91-46ae-9edf-68dd051294fa tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 7e810377-eeef-436c-8fab-69fa71243a9d] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:33.556550 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-0378ab3b-e5b4-47e1-8b64-eaa037f0c069 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a549f85910184bf7a697cce7fa3dff96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92af206e05f44cf948b7c25d1acc139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:33.565704 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-0378ab3b-e5b4-47e1-8b64-eaa037f0c069 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "GET /compute/v2.1/servers/3ae351e6-e583-4f93-bdae-771141c96703" status: 200 len: 1299 microversion: 2.1 time: 0.179583 Aug 27 03:11:33.566303 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2656/5272] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:33 2022] GET /compute/v2.1/servers/3ae351e6-e583-4f93-bdae-771141c96703 => generated 1299 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:33.578435 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f3197e23-5e91-46ae-9edf-68dd051294fa tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:33.579225 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f3197e23-5e91-46ae-9edf-68dd051294fa tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:33.579832 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f3197e23-5e91-46ae-9edf-68dd051294fa tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:33.581680 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f3197e23-5e91-46ae-9edf-68dd051294fa tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:33.582304 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f3197e23-5e91-46ae-9edf-68dd051294fa tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:33.582886 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f3197e23-5e91-46ae-9edf-68dd051294fa tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:33.862448 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-f3197e23-5e91-46ae-9edf-68dd051294fa tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:33.874353 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-f3197e23-5e91-46ae-9edf-68dd051294fa tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:33.876303 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-f3197e23-5e91-46ae-9edf-68dd051294fa tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:33.877720 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f3197e23-5e91-46ae-9edf-68dd051294fa tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d" status: 200 len: 1597 microversion: 2.20 time: 0.338490 Aug 27 03:11:33.878807 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2617/5273] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:11:33 2022] GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d => generated 1597 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:11:33.900253 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-2c5b5588-eeca-48dc-9e8c-176c5088b9b4 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:33.900756 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-2c5b5588-eeca-48dc-9e8c-176c5088b9b4 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 7e810377-eeef-436c-8fab-69fa71243a9d] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:33.909793 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2c5b5588-eeca-48dc-9e8c-176c5088b9b4 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:33.910530 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2c5b5588-eeca-48dc-9e8c-176c5088b9b4 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:33.911190 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2c5b5588-eeca-48dc-9e8c-176c5088b9b4 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:33.912120 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2c5b5588-eeca-48dc-9e8c-176c5088b9b4 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:33.912822 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2c5b5588-eeca-48dc-9e8c-176c5088b9b4 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:33.913443 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2c5b5588-eeca-48dc-9e8c-176c5088b9b4 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:34.042952 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-2c5b5588-eeca-48dc-9e8c-176c5088b9b4 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.146860 Aug 27 03:11:34.043775 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2657/5274] 10.222.0.70 () {60 vars in 1316 bytes} [Sat Aug 27 03:11:33 2022] GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d/os-interface => generated 284 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:11:34.590205 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0287decd-ad1b-4e96-a517-fe98908907d1 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:34.590826 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-0287decd-ad1b-4e96-a517-fe98908907d1 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 3ae351e6-e583-4f93-bdae-771141c96703] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:34.605213 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0287decd-ad1b-4e96-a517-fe98908907d1 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:34.605766 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0287decd-ad1b-4e96-a517-fe98908907d1 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:34.607484 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0287decd-ad1b-4e96-a517-fe98908907d1 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:34.608302 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0287decd-ad1b-4e96-a517-fe98908907d1 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:34.608818 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0287decd-ad1b-4e96-a517-fe98908907d1 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:34.609258 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0287decd-ad1b-4e96-a517-fe98908907d1 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:35.303850 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0287decd-ad1b-4e96-a517-fe98908907d1 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a549f85910184bf7a697cce7fa3dff96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92af206e05f44cf948b7c25d1acc139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:35.320218 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-0287decd-ad1b-4e96-a517-fe98908907d1 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "GET /compute/v2.1/servers/3ae351e6-e583-4f93-bdae-771141c96703" status: 200 len: 1366 microversion: 2.1 time: 0.732297 Aug 27 03:11:35.323858 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2618/5275] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:34 2022] GET /compute/v2.1/servers/3ae351e6-e583-4f93-bdae-771141c96703 => generated 1366 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:36.107446 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-f07b2d5d-0f5e-4d9c-9c96-bd2f3c260021 req-204e5698-d69a-4814-9821-1885eeec6ac5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ae351e6-e583-4f93-bdae-771141c96703", "tag": "dea2772d-a5ac-4f5e-91a4-f6586f7f18e8"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:11:36.123738 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-f07b2d5d-0f5e-4d9c-9c96-bd2f3c260021 req-204e5698-d69a-4814-9821-1885eeec6ac5 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:36.124615 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-f07b2d5d-0f5e-4d9c-9c96-bd2f3c260021 req-204e5698-d69a-4814-9821-1885eeec6ac5 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:36.125361 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-f07b2d5d-0f5e-4d9c-9c96-bd2f3c260021 req-204e5698-d69a-4814-9821-1885eeec6ac5 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:36.143856 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-f07b2d5d-0f5e-4d9c-9c96-bd2f3c260021 req-204e5698-d69a-4814-9821-1885eeec6ac5 service nova] Creating event network-changed:dea2772d-a5ac-4f5e-91a4-f6586f7f18e8 for instance 3ae351e6-e583-4f93-bdae-771141c96703 on n-h1-852278-4 Aug 27 03:11:36.149556 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-f07b2d5d-0f5e-4d9c-9c96-bd2f3c260021 req-204e5698-d69a-4814-9821-1885eeec6ac5 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047004 Aug 27 03:11:36.150474 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2658/5276] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:11:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:11:36.343367 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-7b7bc890-8bd1-43a4-8c66-85c966509334 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:36.343992 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-7b7bc890-8bd1-43a4-8c66-85c966509334 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 3ae351e6-e583-4f93-bdae-771141c96703] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:36.359979 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7b7bc890-8bd1-43a4-8c66-85c966509334 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:36.360850 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7b7bc890-8bd1-43a4-8c66-85c966509334 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:36.360946 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7b7bc890-8bd1-43a4-8c66-85c966509334 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:36.361634 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7b7bc890-8bd1-43a4-8c66-85c966509334 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:36.362090 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7b7bc890-8bd1-43a4-8c66-85c966509334 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:36.365967 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7b7bc890-8bd1-43a4-8c66-85c966509334 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:37.017919 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-7b7bc890-8bd1-43a4-8c66-85c966509334 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a549f85910184bf7a697cce7fa3dff96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92af206e05f44cf948b7c25d1acc139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:37.032876 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-7b7bc890-8bd1-43a4-8c66-85c966509334 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "GET /compute/v2.1/servers/3ae351e6-e583-4f93-bdae-771141c96703" status: 200 len: 1366 microversion: 2.1 time: 0.693342 Aug 27 03:11:37.033228 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-3a136319-2b7b-42c4-bcf4-58b07103c250 req-dd48b2de-08e9-4bad-8ff2-677e736f45dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e810377-eeef-436c-8fab-69fa71243a9d", "tag": "2c3d5445-7fe3-4101-9cf9-d7b63e882f1e"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:11:37.034225 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2619/5277] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:36 2022] GET /compute/v2.1/servers/3ae351e6-e583-4f93-bdae-771141c96703 => generated 1366 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:37.054003 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-3a136319-2b7b-42c4-bcf4-58b07103c250 req-dd48b2de-08e9-4bad-8ff2-677e736f45dc service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:37.054694 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-3a136319-2b7b-42c4-bcf4-58b07103c250 req-dd48b2de-08e9-4bad-8ff2-677e736f45dc service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:37.055333 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-3a136319-2b7b-42c4-bcf4-58b07103c250 req-dd48b2de-08e9-4bad-8ff2-677e736f45dc service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:37.082008 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-3a136319-2b7b-42c4-bcf4-58b07103c250 req-dd48b2de-08e9-4bad-8ff2-677e736f45dc service nova] Creating event network-changed:2c3d5445-7fe3-4101-9cf9-d7b63e882f1e for instance 7e810377-eeef-436c-8fab-69fa71243a9d on n-h1-852278-4 Aug 27 03:11:37.102161 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-3a136319-2b7b-42c4-bcf4-58b07103c250 req-dd48b2de-08e9-4bad-8ff2-677e736f45dc service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072966 Aug 27 03:11:37.109384 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2659/5278] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:11:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:11:38.054469 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-95d0f4df-15df-4b79-9240-ab70f305a763 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:38.055900 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-95d0f4df-15df-4b79-9240-ab70f305a763 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 3ae351e6-e583-4f93-bdae-771141c96703] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:38.072215 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-95d0f4df-15df-4b79-9240-ab70f305a763 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:38.073108 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-95d0f4df-15df-4b79-9240-ab70f305a763 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:38.073709 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-95d0f4df-15df-4b79-9240-ab70f305a763 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:38.074638 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-95d0f4df-15df-4b79-9240-ab70f305a763 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:38.075246 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-95d0f4df-15df-4b79-9240-ab70f305a763 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:38.075826 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-95d0f4df-15df-4b79-9240-ab70f305a763 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:38.584461 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-95d0f4df-15df-4b79-9240-ab70f305a763 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a549f85910184bf7a697cce7fa3dff96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92af206e05f44cf948b7c25d1acc139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:38.612125 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-95d0f4df-15df-4b79-9240-ab70f305a763 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "GET /compute/v2.1/servers/3ae351e6-e583-4f93-bdae-771141c96703" status: 200 len: 1366 microversion: 2.1 time: 0.560863 Aug 27 03:11:38.614700 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2620/5279] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:38 2022] GET /compute/v2.1/servers/3ae351e6-e583-4f93-bdae-771141c96703 => generated 1366 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:39.638337 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a8b2335e-3d29-444d-ac31-c23d7e65097f tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:39.639156 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-a8b2335e-3d29-444d-ac31-c23d7e65097f tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 3ae351e6-e583-4f93-bdae-771141c96703] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:39.643543 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:11:39.644285 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=6 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:11:39.663453 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a8b2335e-3d29-444d-ac31-c23d7e65097f tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:39.665871 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a8b2335e-3d29-444d-ac31-c23d7e65097f tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:39.666736 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a8b2335e-3d29-444d-ac31-c23d7e65097f tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:39.668522 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a8b2335e-3d29-444d-ac31-c23d7e65097f tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:39.669232 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a8b2335e-3d29-444d-ac31-c23d7e65097f tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:39.670399 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a8b2335e-3d29-444d-ac31-c23d7e65097f tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:40.057525 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-a8b2335e-3d29-444d-ac31-c23d7e65097f tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a549f85910184bf7a697cce7fa3dff96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92af206e05f44cf948b7c25d1acc139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:40.070718 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a8b2335e-3d29-444d-ac31-c23d7e65097f tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "GET /compute/v2.1/servers/3ae351e6-e583-4f93-bdae-771141c96703" status: 200 len: 1366 microversion: 2.1 time: 0.437241 Aug 27 03:11:40.071654 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2660/5280] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:39 2022] GET /compute/v2.1/servers/3ae351e6-e583-4f93-bdae-771141c96703 => generated 1366 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:41.091220 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b616981f-6891-4536-a779-7f440196a038 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:41.091848 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b616981f-6891-4536-a779-7f440196a038 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 3ae351e6-e583-4f93-bdae-771141c96703] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:41.096214 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=6 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:11:41.102443 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b616981f-6891-4536-a779-7f440196a038 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:41.102938 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b616981f-6891-4536-a779-7f440196a038 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:41.103379 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b616981f-6891-4536-a779-7f440196a038 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:41.104155 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b616981f-6891-4536-a779-7f440196a038 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:41.104637 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b616981f-6891-4536-a779-7f440196a038 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:41.105053 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b616981f-6891-4536-a779-7f440196a038 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:41.560026 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b616981f-6891-4536-a779-7f440196a038 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a549f85910184bf7a697cce7fa3dff96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92af206e05f44cf948b7c25d1acc139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:41.569115 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b616981f-6891-4536-a779-7f440196a038 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "GET /compute/v2.1/servers/3ae351e6-e583-4f93-bdae-771141c96703" status: 200 len: 1366 microversion: 2.1 time: 0.481786 Aug 27 03:11:41.570086 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2621/5281] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:41 2022] GET /compute/v2.1/servers/3ae351e6-e583-4f93-bdae-771141c96703 => generated 1366 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:11:41.635090 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-eff2b95e-7476-4c8c-a596-4e0f3e287122 req-b1c2accd-833e-489c-9a03-3a5470f2f307 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ae351e6-e583-4f93-bdae-771141c96703", "name": "network-vif-plugged", "status": "completed", "tag": "dea2772d-a5ac-4f5e-91a4-f6586f7f18e8"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:11:41.667066 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-eff2b95e-7476-4c8c-a596-4e0f3e287122 req-b1c2accd-833e-489c-9a03-3a5470f2f307 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:41.676786 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-eff2b95e-7476-4c8c-a596-4e0f3e287122 req-b1c2accd-833e-489c-9a03-3a5470f2f307 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:41.677561 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-eff2b95e-7476-4c8c-a596-4e0f3e287122 req-b1c2accd-833e-489c-9a03-3a5470f2f307 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:41.707181 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-eff2b95e-7476-4c8c-a596-4e0f3e287122 req-b1c2accd-833e-489c-9a03-3a5470f2f307 service nova] Creating event network-vif-plugged:dea2772d-a5ac-4f5e-91a4-f6586f7f18e8 for instance 3ae351e6-e583-4f93-bdae-771141c96703 on n-h1-852278-4 Aug 27 03:11:41.715008 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-eff2b95e-7476-4c8c-a596-4e0f3e287122 req-b1c2accd-833e-489c-9a03-3a5470f2f307 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083555 Aug 27 03:11:41.716358 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2661/5282] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:11:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:11:42.594603 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4252387f-ec46-4472-a98a-36dd2c29e7ae tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:42.595942 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-4252387f-ec46-4472-a98a-36dd2c29e7ae tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 3ae351e6-e583-4f93-bdae-771141c96703] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:42.626153 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4252387f-ec46-4472-a98a-36dd2c29e7ae tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:42.628329 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4252387f-ec46-4472-a98a-36dd2c29e7ae tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:42.629218 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4252387f-ec46-4472-a98a-36dd2c29e7ae tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:42.630255 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4252387f-ec46-4472-a98a-36dd2c29e7ae tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:42.630927 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4252387f-ec46-4472-a98a-36dd2c29e7ae tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:42.631577 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4252387f-ec46-4472-a98a-36dd2c29e7ae tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:42.941898 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-4252387f-ec46-4472-a98a-36dd2c29e7ae tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a549f85910184bf7a697cce7fa3dff96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92af206e05f44cf948b7c25d1acc139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:42.961385 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-4252387f-ec46-4472-a98a-36dd2c29e7ae tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "GET /compute/v2.1/servers/3ae351e6-e583-4f93-bdae-771141c96703" status: 200 len: 1366 microversion: 2.1 time: 0.372330 Aug 27 03:11:42.963551 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2622/5283] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:42 2022] GET /compute/v2.1/servers/3ae351e6-e583-4f93-bdae-771141c96703 => generated 1366 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:11:43.988007 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e2da6a53-c7e6-4471-b367-74066a1df4ea tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:43.989680 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-e2da6a53-c7e6-4471-b367-74066a1df4ea tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 3ae351e6-e583-4f93-bdae-771141c96703] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:44.009401 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=1,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:11:44.014921 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e2da6a53-c7e6-4471-b367-74066a1df4ea tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:44.015426 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e2da6a53-c7e6-4471-b367-74066a1df4ea tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:44.020153 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e2da6a53-c7e6-4471-b367-74066a1df4ea tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:44.023637 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e2da6a53-c7e6-4471-b367-74066a1df4ea tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:44.024550 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e2da6a53-c7e6-4471-b367-74066a1df4ea tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:44.032658 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e2da6a53-c7e6-4471-b367-74066a1df4ea tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:44.728631 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e2da6a53-c7e6-4471-b367-74066a1df4ea tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a549f85910184bf7a697cce7fa3dff96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92af206e05f44cf948b7c25d1acc139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:44.741283 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e2da6a53-c7e6-4471-b367-74066a1df4ea tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "GET /compute/v2.1/servers/3ae351e6-e583-4f93-bdae-771141c96703" status: 200 len: 1555 microversion: 2.1 time: 0.759036 Aug 27 03:11:44.742527 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2662/5284] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:43 2022] GET /compute/v2.1/servers/3ae351e6-e583-4f93-bdae-771141c96703 => generated 1555 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:44.775599 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d3027188-e444-4a4e-b2cf-6e1b76dfc091 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:44.776174 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d3027188-e444-4a4e-b2cf-6e1b76dfc091 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 3ae351e6-e583-4f93-bdae-771141c96703] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:44.804260 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d3027188-e444-4a4e-b2cf-6e1b76dfc091 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:44.805202 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d3027188-e444-4a4e-b2cf-6e1b76dfc091 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:44.807484 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d3027188-e444-4a4e-b2cf-6e1b76dfc091 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:44.810153 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d3027188-e444-4a4e-b2cf-6e1b76dfc091 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:44.816986 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d3027188-e444-4a4e-b2cf-6e1b76dfc091 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:44.817334 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d3027188-e444-4a4e-b2cf-6e1b76dfc091 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:44.859766 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:11:45.052367 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d3027188-e444-4a4e-b2cf-6e1b76dfc091 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "GET /compute/v2.1/servers/3ae351e6-e583-4f93-bdae-771141c96703/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.289451 Aug 27 03:11:45.053018 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2623/5285] 10.222.0.70 () {58 vars in 1275 bytes} [Sat Aug 27 03:11:44 2022] GET /compute/v2.1/servers/3ae351e6-e583-4f93-bdae-771141c96703/os-interface => generated 284 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:11:46.500099 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-6b1c9ab5-e1b6-4de6-a76e-4bbb7823108e req-481b7f4c-5891-4e8a-b273-f8a4261fcc33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ae351e6-e583-4f93-bdae-771141c96703", "tag": "dea2772d-a5ac-4f5e-91a4-f6586f7f18e8"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:11:46.512194 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-6b1c9ab5-e1b6-4de6-a76e-4bbb7823108e req-481b7f4c-5891-4e8a-b273-f8a4261fcc33 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:46.512680 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-6b1c9ab5-e1b6-4de6-a76e-4bbb7823108e req-481b7f4c-5891-4e8a-b273-f8a4261fcc33 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:46.513113 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-6b1c9ab5-e1b6-4de6-a76e-4bbb7823108e req-481b7f4c-5891-4e8a-b273-f8a4261fcc33 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:46.527219 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-6b1c9ab5-e1b6-4de6-a76e-4bbb7823108e req-481b7f4c-5891-4e8a-b273-f8a4261fcc33 service nova] Creating event network-changed:dea2772d-a5ac-4f5e-91a4-f6586f7f18e8 for instance 3ae351e6-e583-4f93-bdae-771141c96703 on n-h1-852278-4 Aug 27 03:11:46.533456 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-6b1c9ab5-e1b6-4de6-a76e-4bbb7823108e req-481b7f4c-5891-4e8a-b273-f8a4261fcc33 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037718 Aug 27 03:11:46.544693 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2663/5286] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:11:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:12:06.197820 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:12:06.198788 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=3 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:12:06.205521 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-24a6f06b-1a26-4686-9277-027c64ca7266 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:06.206245 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-24a6f06b-1a26-4686-9277-027c64ca7266 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] [instance: ecf965e2-f12b-48bf-852c-4ddb1e930f5c] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:06.217738 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-24a6f06b-1a26-4686-9277-027c64ca7266 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:06.218606 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-24a6f06b-1a26-4686-9277-027c64ca7266 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:06.219314 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-24a6f06b-1a26-4686-9277-027c64ca7266 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:06.220795 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-24a6f06b-1a26-4686-9277-027c64ca7266 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:06.221695 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-24a6f06b-1a26-4686-9277-027c64ca7266 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:06.222291 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-24a6f06b-1a26-4686-9277-027c64ca7266 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:06.328614 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.instance [None req-24a6f06b-1a26-4686-9277-027c64ca7266 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lazy-loading 'services' on Instance uuid ecf965e2-f12b-48bf-852c-4ddb1e930f5c {{(pid=134052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:12:06.429081 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-24a6f06b-1a26-4686-9277-027c64ca7266 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] 10.222.0.70 "DELETE /compute/v2.1/servers/ecf965e2-f12b-48bf-852c-4ddb1e930f5c/os-volume_attachments/de2737e4-cffb-44ca-9b0f-a7aab49a964f" status: 202 len: 0 microversion: 2.1 time: 0.233068 Aug 27 03:12:06.431587 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2624/5287] 10.222.0.70 () {58 vars in 1416 bytes} [Sat Aug 27 03:12:06 2022] DELETE /compute/v2.1/servers/ecf965e2-f12b-48bf-852c-4ddb1e930f5c/os-volume_attachments/de2737e4-cffb-44ca-9b0f-a7aab49a964f => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:12:10.538663 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=3 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:12:10.539967 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=63 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:12:10.544754 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d6ae9deb-87de-4002-bf12-27f8720b23d6 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:10.545278 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d6ae9deb-87de-4002-bf12-27f8720b23d6 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 7e810377-eeef-436c-8fab-69fa71243a9d] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:10.552984 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d6ae9deb-87de-4002-bf12-27f8720b23d6 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:10.553479 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d6ae9deb-87de-4002-bf12-27f8720b23d6 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:10.553923 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d6ae9deb-87de-4002-bf12-27f8720b23d6 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:10.554660 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d6ae9deb-87de-4002-bf12-27f8720b23d6 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:10.555098 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d6ae9deb-87de-4002-bf12-27f8720b23d6 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:10.556492 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d6ae9deb-87de-4002-bf12-27f8720b23d6 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:10.584817 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d6ae9deb-87de-4002-bf12-27f8720b23d6 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d/ips" status: 200 len: 151 microversion: 2.20 time: 0.048017 Aug 27 03:12:10.592542 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2664/5288] 10.222.0.70 () {60 vars in 1289 bytes} [Sat Aug 27 03:12:10 2022] GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d/ips => generated 151 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:12:11.977168 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8c4b780b-bf42-42e4-bd9a-8d8433270e4f tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:11.977746 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-8c4b780b-bf42-42e4-bd9a-8d8433270e4f tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] [instance: ecf965e2-f12b-48bf-852c-4ddb1e930f5c] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:11.996579 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8c4b780b-bf42-42e4-bd9a-8d8433270e4f tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:11.998038 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8c4b780b-bf42-42e4-bd9a-8d8433270e4f tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:11.998642 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8c4b780b-bf42-42e4-bd9a-8d8433270e4f tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:11.999526 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8c4b780b-bf42-42e4-bd9a-8d8433270e4f tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:12.000112 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8c4b780b-bf42-42e4-bd9a-8d8433270e4f tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:12.000717 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8c4b780b-bf42-42e4-bd9a-8d8433270e4f tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:12.030145 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-8c4b780b-bf42-42e4-bd9a-8d8433270e4f tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] [instance: ecf965e2-f12b-48bf-852c-4ddb1e930f5c] Going to try to terminate instance {{(pid=134052) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:12:12.121170 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-8c4b780b-bf42-42e4-bd9a-8d8433270e4f tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] 10.222.0.70 "DELETE /compute/v2.1/servers/ecf965e2-f12b-48bf-852c-4ddb1e930f5c" status: 204 len: 0 microversion: 2.1 time: 0.148835 Aug 27 03:12:12.122852 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2625/5289] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 03:12:11 2022] DELETE /compute/v2.1/servers/ecf965e2-f12b-48bf-852c-4ddb1e930f5c => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:12:12.130800 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e4a32f0e-72cd-40ec-a640-6a15a1193224 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:12.131551 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-e4a32f0e-72cd-40ec-a640-6a15a1193224 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] [instance: ecf965e2-f12b-48bf-852c-4ddb1e930f5c] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:12.139195 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e4a32f0e-72cd-40ec-a640-6a15a1193224 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:12.139871 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e4a32f0e-72cd-40ec-a640-6a15a1193224 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:12.140579 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e4a32f0e-72cd-40ec-a640-6a15a1193224 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:12.141348 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e4a32f0e-72cd-40ec-a640-6a15a1193224 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:12.142001 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e4a32f0e-72cd-40ec-a640-6a15a1193224 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:12.142493 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e4a32f0e-72cd-40ec-a640-6a15a1193224 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:12.500073 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4c9078e9-3a7a-4b54-9c0a-dc0a084e9d01 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:12:12.500809 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-4c9078e9-3a7a-4b54-9c0a-dc0a084e9d01 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 7e810377-eeef-436c-8fab-69fa71243a9d] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:12.507965 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4c9078e9-3a7a-4b54-9c0a-dc0a084e9d01 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:12.508495 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4c9078e9-3a7a-4b54-9c0a-dc0a084e9d01 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:12.509124 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4c9078e9-3a7a-4b54-9c0a-dc0a084e9d01 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:12.509885 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4c9078e9-3a7a-4b54-9c0a-dc0a084e9d01 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:12.510336 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4c9078e9-3a7a-4b54-9c0a-dc0a084e9d01 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:12.510763 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4c9078e9-3a7a-4b54-9c0a-dc0a084e9d01 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:12.539751 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.instance [None req-4c9078e9-3a7a-4b54-9c0a-dc0a084e9d01 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lazy-loading 'flavor' on Instance uuid 7e810377-eeef-436c-8fab-69fa71243a9d {{(pid=134052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:12:12.554676 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e4a32f0e-72cd-40ec-a640-6a15a1193224 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b68d81dbdb474cac2060aa9d7bb502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852f3aff4a69491abbd546875918b004', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:12.563402 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e4a32f0e-72cd-40ec-a640-6a15a1193224 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] 10.222.0.70 "GET /compute/v2.1/servers/ecf965e2-f12b-48bf-852c-4ddb1e930f5c" status: 200 len: 1513 microversion: 2.1 time: 0.436761 Aug 27 03:12:12.564454 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2665/5290] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:12 2022] GET /compute/v2.1/servers/ecf965e2-f12b-48bf-852c-4ddb1e930f5c => generated 1513 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:12:12.737842 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-4c9078e9-3a7a-4b54-9c0a-dc0a084e9d01 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "POST /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d/action" status: 202 len: 0 microversion: 2.20 time: 0.243958 Aug 27 03:12:12.740744 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2626/5291] 10.222.0.70 () {62 vars in 1319 bytes} [Sat Aug 27 03:12:12 2022] POST /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d/action => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 27 03:12:12.747393 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f5b31b67-a1b9-4169-9f5f-7b9f68af716a tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:12.747996 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-f5b31b67-a1b9-4169-9f5f-7b9f68af716a tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 7e810377-eeef-436c-8fab-69fa71243a9d] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:12.754072 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f5b31b67-a1b9-4169-9f5f-7b9f68af716a tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:12.754544 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f5b31b67-a1b9-4169-9f5f-7b9f68af716a tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:12.755017 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f5b31b67-a1b9-4169-9f5f-7b9f68af716a tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:12.755674 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f5b31b67-a1b9-4169-9f5f-7b9f68af716a tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:12.756254 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f5b31b67-a1b9-4169-9f5f-7b9f68af716a tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:12.756763 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f5b31b67-a1b9-4169-9f5f-7b9f68af716a tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:12.950774 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-f5b31b67-a1b9-4169-9f5f-7b9f68af716a tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:12.961377 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-f5b31b67-a1b9-4169-9f5f-7b9f68af716a tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:12.963360 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-f5b31b67-a1b9-4169-9f5f-7b9f68af716a tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:12.964782 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-f5b31b67-a1b9-4169-9f5f-7b9f68af716a tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d" status: 200 len: 1722 microversion: 2.20 time: 0.221395 Aug 27 03:12:12.968385 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2666/5292] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:12:12 2022] GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d => generated 1722 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:12:13.588099 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-2be5dbd1-1c10-4b9e-81bb-c8819cf5e1c0 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:13.589373 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-2be5dbd1-1c10-4b9e-81bb-c8819cf5e1c0 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] [instance: ecf965e2-f12b-48bf-852c-4ddb1e930f5c] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:13.596699 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2be5dbd1-1c10-4b9e-81bb-c8819cf5e1c0 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:13.597564 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2be5dbd1-1c10-4b9e-81bb-c8819cf5e1c0 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:13.598259 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2be5dbd1-1c10-4b9e-81bb-c8819cf5e1c0 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:13.599434 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2be5dbd1-1c10-4b9e-81bb-c8819cf5e1c0 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:13.600208 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2be5dbd1-1c10-4b9e-81bb-c8819cf5e1c0 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:13.600856 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2be5dbd1-1c10-4b9e-81bb-c8819cf5e1c0 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:13.844113 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-2be5dbd1-1c10-4b9e-81bb-c8819cf5e1c0 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b68d81dbdb474cac2060aa9d7bb502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852f3aff4a69491abbd546875918b004', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:13.863537 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-2be5dbd1-1c10-4b9e-81bb-c8819cf5e1c0 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] 10.222.0.70 "GET /compute/v2.1/servers/ecf965e2-f12b-48bf-852c-4ddb1e930f5c" status: 200 len: 1513 microversion: 2.1 time: 0.280382 Aug 27 03:12:13.866209 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2627/5293] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:13 2022] GET /compute/v2.1/servers/ecf965e2-f12b-48bf-852c-4ddb1e930f5c => generated 1513 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:14.002111 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7ed011df-a128-49ea-9490-40aa9cc3a00e tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:14.003452 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-7ed011df-a128-49ea-9490-40aa9cc3a00e tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 7e810377-eeef-436c-8fab-69fa71243a9d] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:14.011320 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7ed011df-a128-49ea-9490-40aa9cc3a00e tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:14.012243 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7ed011df-a128-49ea-9490-40aa9cc3a00e tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:14.012974 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7ed011df-a128-49ea-9490-40aa9cc3a00e tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:14.013892 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7ed011df-a128-49ea-9490-40aa9cc3a00e tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:14.014545 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7ed011df-a128-49ea-9490-40aa9cc3a00e tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:14.015226 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7ed011df-a128-49ea-9490-40aa9cc3a00e tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:14.284236 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-4519e5a1-0eb4-4e33-b959-6607ecae9e6c req-631ef8a0-6ade-4470-bf32-e6f873750258 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecf965e2-f12b-48bf-852c-4ddb1e930f5c", "name": "network-vif-deleted", "tag": "d2237cb6-ff7b-4cf9-b5d8-bd5e428d4ed4"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:12:14.307545 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-4519e5a1-0eb4-4e33-b959-6607ecae9e6c req-631ef8a0-6ade-4470-bf32-e6f873750258 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:14.308024 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-4519e5a1-0eb4-4e33-b959-6607ecae9e6c req-631ef8a0-6ade-4470-bf32-e6f873750258 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:14.308972 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-4519e5a1-0eb4-4e33-b959-6607ecae9e6c req-631ef8a0-6ade-4470-bf32-e6f873750258 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:14.322398 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-4519e5a1-0eb4-4e33-b959-6607ecae9e6c req-631ef8a0-6ade-4470-bf32-e6f873750258 service nova] Creating event network-vif-deleted:d2237cb6-ff7b-4cf9-b5d8-bd5e428d4ed4 for instance ecf965e2-f12b-48bf-852c-4ddb1e930f5c on n-h2-852278-4 Aug 27 03:12:14.328249 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-4519e5a1-0eb4-4e33-b959-6607ecae9e6c req-631ef8a0-6ade-4470-bf32-e6f873750258 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049923 Aug 27 03:12:14.329768 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2628/5294] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:12:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:12:14.351936 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-7ed011df-a128-49ea-9490-40aa9cc3a00e tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:14.360831 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-7ed011df-a128-49ea-9490-40aa9cc3a00e tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:14.362280 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-7ed011df-a128-49ea-9490-40aa9cc3a00e tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:14.370523 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-7ed011df-a128-49ea-9490-40aa9cc3a00e tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d" status: 200 len: 1722 microversion: 2.20 time: 0.375009 Aug 27 03:12:14.380678 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2667/5295] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:12:13 2022] GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d => generated 1722 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:12:14.888205 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-323933aa-4121-4a85-b3e3-2d5a4497af24 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:14.889111 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-323933aa-4121-4a85-b3e3-2d5a4497af24 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] [instance: ecf965e2-f12b-48bf-852c-4ddb1e930f5c] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:14.903093 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-323933aa-4121-4a85-b3e3-2d5a4497af24 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:14.903587 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-323933aa-4121-4a85-b3e3-2d5a4497af24 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:14.904019 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-323933aa-4121-4a85-b3e3-2d5a4497af24 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:14.904753 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-323933aa-4121-4a85-b3e3-2d5a4497af24 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:14.905209 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-323933aa-4121-4a85-b3e3-2d5a4497af24 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:14.905633 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-323933aa-4121-4a85-b3e3-2d5a4497af24 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:14.919848 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-323933aa-4121-4a85-b3e3-2d5a4497af24 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] HTTP exception thrown: Instance ecf965e2-f12b-48bf-852c-4ddb1e930f5c could not be found. Aug 27 03:12:14.921554 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-323933aa-4121-4a85-b3e3-2d5a4497af24 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Request method failure captured: Aug 27 03:12:14.921554 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/servers/ecf965e2-f12b-48bf-852c-4ddb1e930f5c HTTP/1.1 Aug 27 03:12:14.921554 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 03:12:14.921554 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 03:12:14.921554 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 03:12:14.921554 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 03:12:14.921554 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 03:12:14.921554 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 03:12:14.921554 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 03:12:14.921554 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 03:12:14.921554 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYrbClWrjG76oRRYTrdiCzd0iFX2FbghZ5KoVjS5o2gAY7flwxWlD4d8oF8F9WMJEqs-n7UsCx5OXBnpLwqcbTn2CM48Y4CgnlU7P7WHjxIi5KT0wx7wTyLxwozeh0ACmy0JK9laNIfWp9qmXPG-kiq4jZlXMCv9KmPNWu9kflCXCK4 Aug 27 03:12:14.921554 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 03:12:14.921554 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 03:12:14.921554 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 03:12:14.921554 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 03:12:14.921554 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 03:12:14.921554 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 03:12:14.921554 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 852f3aff4a69491abbd546875918b004 Aug 27 03:12:14.921554 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1556711590 Aug 27 03:12:14.921554 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 03:12:14.921554 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 03:12:14.921554 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/852f3aff4a69491abbd546875918b004"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_852f3aff4a69491abbd546875918b004", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/852f3aff4a69491abbd546875918b004"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/852f3aff4a69491abbd546875918b004"}]}] Aug 27 03:12:14.921554 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-VolumesSnapshotTestJSON-1556711590 Aug 27 03:12:14.921554 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 852f3aff4a69491abbd546875918b004 Aug 27 03:12:14.921554 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1556711590 Aug 27 03:12:14.921554 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-VolumesSnapshotTestJSON-1556711590-project Aug 27 03:12:14.921554 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 03:12:14.921554 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 03:12:14.921554 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: e2b68d81dbdb474cac2060aa9d7bb502 Aug 27 03:12:14.921554 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-VolumesSnapshotTestJSON-1556711590-project Aug 27 03:12:14.921554 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 03:12:14.921554 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance ecf965e2-f12b-48bf-852c-4ddb1e930f5c could not be found. Aug 27 03:12:14.921554 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': 'ecf965e2-f12b-48bf-852c-4ddb1e930f5c'} Aug 27 03:12:14.921554 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:12:14.921554 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:12:14.921554 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:12:14.921554 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:12:14.921554 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:12:14.921554 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:12:14.921554 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:12:14.921554 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:12:14.921554 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:12:14.921554 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:12:14.921554 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ecf965e2-f12b-48bf-852c-4ddb1e930f5c could not be found. Aug 27 03:12:14.921554 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:12:14.921554 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:12:14.921554 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:12:14.921554 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:12:14.921554 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:12:14.921554 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:12:14.921554 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:12:14.921554 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:12:14.921554 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:12:14.921554 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:12:14.921554 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:12:14.921554 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:12:14.921554 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:12:14.921554 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:12:14.921554 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:12:14.921554 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:12:14.921554 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ecf965e2-f12b-48bf-852c-4ddb1e930f5c could not be found. Aug 27 03:12:14.921554 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:12:14.921554 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:12:14.921554 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:12:14.926120 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:12:14.926120 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:12:14.926120 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:12:14.926120 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:12:14.926120 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:12:14.926120 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ecf965e2-f12b-48bf-852c-4ddb1e930f5c could not be found. Aug 27 03:12:14.926120 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:12:14.926120 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-323933aa-4121-4a85-b3e3-2d5a4497af24 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Returning 404 to user: Instance ecf965e2-f12b-48bf-852c-4ddb1e930f5c could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:12:14.926120 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-323933aa-4121-4a85-b3e3-2d5a4497af24 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] 10.222.0.70 "GET /compute/v2.1/servers/ecf965e2-f12b-48bf-852c-4ddb1e930f5c" status: 404 len: 111 microversion: 2.1 time: 0.040191 Aug 27 03:12:14.927845 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2629/5296] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:14 2022] GET /compute/v2.1/servers/ecf965e2-f12b-48bf-852c-4ddb1e930f5c => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:12:15.395681 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-73893d4b-61d8-410d-bf63-6d6fdb552727 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:15.397584 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-73893d4b-61d8-410d-bf63-6d6fdb552727 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 7e810377-eeef-436c-8fab-69fa71243a9d] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:15.407041 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-73893d4b-61d8-410d-bf63-6d6fdb552727 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:15.409309 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-73893d4b-61d8-410d-bf63-6d6fdb552727 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:15.410194 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-73893d4b-61d8-410d-bf63-6d6fdb552727 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:15.411119 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-73893d4b-61d8-410d-bf63-6d6fdb552727 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:15.412240 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-73893d4b-61d8-410d-bf63-6d6fdb552727 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:15.412900 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-73893d4b-61d8-410d-bf63-6d6fdb552727 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:15.616118 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-73893d4b-61d8-410d-bf63-6d6fdb552727 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:15.629387 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-73893d4b-61d8-410d-bf63-6d6fdb552727 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:15.630598 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-73893d4b-61d8-410d-bf63-6d6fdb552727 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:15.632445 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-73893d4b-61d8-410d-bf63-6d6fdb552727 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d" status: 200 len: 1722 microversion: 2.20 time: 0.241749 Aug 27 03:12:15.633766 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2668/5297] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:12:15 2022] GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d => generated 1722 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:12:16.660495 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4bf4ab20-2518-4457-9b12-e61b50a761b9 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:16.661730 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-4bf4ab20-2518-4457-9b12-e61b50a761b9 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 7e810377-eeef-436c-8fab-69fa71243a9d] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:16.669786 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4bf4ab20-2518-4457-9b12-e61b50a761b9 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:16.670541 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4bf4ab20-2518-4457-9b12-e61b50a761b9 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:16.671153 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4bf4ab20-2518-4457-9b12-e61b50a761b9 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:16.672141 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4bf4ab20-2518-4457-9b12-e61b50a761b9 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:16.672775 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4bf4ab20-2518-4457-9b12-e61b50a761b9 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:16.673346 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4bf4ab20-2518-4457-9b12-e61b50a761b9 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:16.829370 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-4bf4ab20-2518-4457-9b12-e61b50a761b9 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:16.838550 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-4bf4ab20-2518-4457-9b12-e61b50a761b9 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:16.840550 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-4bf4ab20-2518-4457-9b12-e61b50a761b9 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:16.841779 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-4bf4ab20-2518-4457-9b12-e61b50a761b9 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d" status: 200 len: 1722 microversion: 2.20 time: 0.185377 Aug 27 03:12:16.842485 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2630/5298] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:12:16 2022] GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d => generated 1722 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:12:17.867526 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-fd17c530-80e7-461c-9bac-8f00f706db52 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:17.868971 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-fd17c530-80e7-461c-9bac-8f00f706db52 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 7e810377-eeef-436c-8fab-69fa71243a9d] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:17.876296 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fd17c530-80e7-461c-9bac-8f00f706db52 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:17.876959 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fd17c530-80e7-461c-9bac-8f00f706db52 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:17.877463 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fd17c530-80e7-461c-9bac-8f00f706db52 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:17.878244 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fd17c530-80e7-461c-9bac-8f00f706db52 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:17.878859 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fd17c530-80e7-461c-9bac-8f00f706db52 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:17.879284 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fd17c530-80e7-461c-9bac-8f00f706db52 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:18.091513 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-fd17c530-80e7-461c-9bac-8f00f706db52 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:18.114065 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-fd17c530-80e7-461c-9bac-8f00f706db52 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:18.115677 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-fd17c530-80e7-461c-9bac-8f00f706db52 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:18.116935 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-fd17c530-80e7-461c-9bac-8f00f706db52 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d" status: 200 len: 1722 microversion: 2.20 time: 0.253559 Aug 27 03:12:18.125038 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2669/5299] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:12:17 2022] GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d => generated 1722 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:12:19.140517 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6d697887-9658-43d8-980d-a7d65f778755 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:19.141156 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-6d697887-9658-43d8-980d-a7d65f778755 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 7e810377-eeef-436c-8fab-69fa71243a9d] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:19.152379 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6d697887-9658-43d8-980d-a7d65f778755 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:19.152880 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6d697887-9658-43d8-980d-a7d65f778755 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:19.153384 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6d697887-9658-43d8-980d-a7d65f778755 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:19.154286 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6d697887-9658-43d8-980d-a7d65f778755 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:19.154756 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6d697887-9658-43d8-980d-a7d65f778755 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:19.155180 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6d697887-9658-43d8-980d-a7d65f778755 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:19.318454 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-6d697887-9658-43d8-980d-a7d65f778755 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:19.331934 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-6d697887-9658-43d8-980d-a7d65f778755 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:19.338400 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-6d697887-9658-43d8-980d-a7d65f778755 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:19.339933 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-6d697887-9658-43d8-980d-a7d65f778755 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d" status: 200 len: 1722 microversion: 2.20 time: 0.204020 Aug 27 03:12:19.352735 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2631/5300] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:12:19 2022] GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d => generated 1722 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:12:20.292710 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-da2e2589-5de7-4a2e-85b4-41d118a185e0 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:20.293185 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-da2e2589-5de7-4a2e-85b4-41d118a185e0 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 3ae351e6-e583-4f93-bdae-771141c96703] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:20.309304 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-da2e2589-5de7-4a2e-85b4-41d118a185e0 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:20.310015 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-da2e2589-5de7-4a2e-85b4-41d118a185e0 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:20.310613 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-da2e2589-5de7-4a2e-85b4-41d118a185e0 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:20.311489 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-da2e2589-5de7-4a2e-85b4-41d118a185e0 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:20.312720 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-da2e2589-5de7-4a2e-85b4-41d118a185e0 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:20.313307 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-da2e2589-5de7-4a2e-85b4-41d118a185e0 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:20.360250 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-da2e2589-5de7-4a2e-85b4-41d118a185e0 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "GET /compute/v2.1/servers/3ae351e6-e583-4f93-bdae-771141c96703/ips" status: 200 len: 148 microversion: 2.1 time: 0.071694 Aug 27 03:12:20.360865 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2670/5301] 10.222.0.70 () {58 vars in 1248 bytes} [Sat Aug 27 03:12:20 2022] GET /compute/v2.1/servers/3ae351e6-e583-4f93-bdae-771141c96703/ips => generated 148 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:12:20.365902 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8d2f1e75-74b9-48c1-8724-3105110add4d tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:20.376215 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-8d2f1e75-74b9-48c1-8724-3105110add4d tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 7e810377-eeef-436c-8fab-69fa71243a9d] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:20.397308 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8d2f1e75-74b9-48c1-8724-3105110add4d tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:20.413051 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8d2f1e75-74b9-48c1-8724-3105110add4d tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:20.413521 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8d2f1e75-74b9-48c1-8724-3105110add4d tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:20.414296 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8d2f1e75-74b9-48c1-8724-3105110add4d tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:20.414763 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8d2f1e75-74b9-48c1-8724-3105110add4d tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:20.415196 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8d2f1e75-74b9-48c1-8724-3105110add4d tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:20.703808 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-8d2f1e75-74b9-48c1-8724-3105110add4d tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:20.715730 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-8d2f1e75-74b9-48c1-8724-3105110add4d tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:20.718176 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-8d2f1e75-74b9-48c1-8724-3105110add4d tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:20.720688 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-8d2f1e75-74b9-48c1-8724-3105110add4d tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d" status: 200 len: 1722 microversion: 2.20 time: 0.359962 Aug 27 03:12:20.722336 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2632/5302] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:12:20 2022] GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d => generated 1722 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:12:21.751227 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8f4e64e8-e58c-4edd-949b-53ca6cf6c22d tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:21.751837 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-8f4e64e8-e58c-4edd-949b-53ca6cf6c22d tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 7e810377-eeef-436c-8fab-69fa71243a9d] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:21.760095 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8f4e64e8-e58c-4edd-949b-53ca6cf6c22d tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:21.761105 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8f4e64e8-e58c-4edd-949b-53ca6cf6c22d tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:21.761784 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8f4e64e8-e58c-4edd-949b-53ca6cf6c22d tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:21.762712 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8f4e64e8-e58c-4edd-949b-53ca6cf6c22d tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:21.763354 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8f4e64e8-e58c-4edd-949b-53ca6cf6c22d tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:21.763967 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8f4e64e8-e58c-4edd-949b-53ca6cf6c22d tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:22.004361 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-8f4e64e8-e58c-4edd-949b-53ca6cf6c22d tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:22.018385 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-8f4e64e8-e58c-4edd-949b-53ca6cf6c22d tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:22.020290 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-8f4e64e8-e58c-4edd-949b-53ca6cf6c22d tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:22.030133 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-8f4e64e8-e58c-4edd-949b-53ca6cf6c22d tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d" status: 200 len: 1722 microversion: 2.20 time: 0.287055 Aug 27 03:12:22.032091 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2671/5303] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:12:21 2022] GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d => generated 1722 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:12:22.171690 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e7281947-fb11-4716-a663-1794b2b9e61b tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1259309429", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "networks": [{"uuid": "daeace72-47da-4a10-b3e2-1b6dcf17ffaa"}]}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:12:22.261461 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.network.neutron [None req-e7281947-fb11-4716-a663-1794b2b9e61b tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] validate_networks() for [('daeace72-47da-4a10-b3e2-1b6dcf17ffaa', None, None, None, None, None)] {{(pid=134052) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:12:22.899243 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-e7281947-fb11-4716-a663-1794b2b9e61b tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Flavor limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:12:22.900129 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-e7281947-fb11-4716-a663-1794b2b9e61b tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Image limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:12:22.900881 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-e7281947-fb11-4716-a663-1794b2b9e61b tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Flavor pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:12:22.901646 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-e7281947-fb11-4716-a663-1794b2b9e61b tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Image pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:12:22.902273 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-e7281947-fb11-4716-a663-1794b2b9e61b tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:12:22.912701 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e7281947-fb11-4716-a663-1794b2b9e61b tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:22.914153 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e7281947-fb11-4716-a663-1794b2b9e61b tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:22.914847 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e7281947-fb11-4716-a663-1794b2b9e61b tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:22.915629 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e7281947-fb11-4716-a663-1794b2b9e61b tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:22.916240 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e7281947-fb11-4716-a663-1794b2b9e61b tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:22.916867 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e7281947-fb11-4716-a663-1794b2b9e61b tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:22.935994 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-e7281947-fb11-4716-a663-1794b2b9e61b tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Getting quotas for project 852f3aff4a69491abbd546875918b004. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:12:22.946563 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-e7281947-fb11-4716-a663-1794b2b9e61b tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Getting quotas for user e2b68d81dbdb474cac2060aa9d7bb502 and project 852f3aff4a69491abbd546875918b004. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:12:22.965270 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-e7281947-fb11-4716-a663-1794b2b9e61b tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Going to run 1 instances... {{(pid=134052) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:12:22.967585 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-e7281947-fb11-4716-a663-1794b2b9e61b tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] [instance: 600d5a60-00ec-42b4-8128-b8213548e55a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134052) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:12:23.027354 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e7281947-fb11-4716-a663-1794b2b9e61b tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.882087 Aug 27 03:12:23.033849 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2633/5304] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 03:12:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 895 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:12:23.040099 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4fc2f27e-f4bc-4b13-a1be-6797e7954e94 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:23.041405 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-4fc2f27e-f4bc-4b13-a1be-6797e7954e94 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] [instance: 600d5a60-00ec-42b4-8128-b8213548e55a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:23.053234 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-dcd8cfa1-8858-4e02-baec-23a5b4013689 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:23.054061 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-dcd8cfa1-8858-4e02-baec-23a5b4013689 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 7e810377-eeef-436c-8fab-69fa71243a9d] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:23.062759 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dcd8cfa1-8858-4e02-baec-23a5b4013689 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:23.063353 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dcd8cfa1-8858-4e02-baec-23a5b4013689 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:23.063663 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dcd8cfa1-8858-4e02-baec-23a5b4013689 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:23.074336 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dcd8cfa1-8858-4e02-baec-23a5b4013689 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:23.075174 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dcd8cfa1-8858-4e02-baec-23a5b4013689 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:23.076909 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dcd8cfa1-8858-4e02-baec-23a5b4013689 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:23.183111 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-4fc2f27e-f4bc-4b13-a1be-6797e7954e94 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b68d81dbdb474cac2060aa9d7bb502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852f3aff4a69491abbd546875918b004', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:23.193746 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-4fc2f27e-f4bc-4b13-a1be-6797e7954e94 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] 10.222.0.70 "GET /compute/v2.1/servers/600d5a60-00ec-42b4-8128-b8213548e55a" status: 200 len: 1219 microversion: 2.1 time: 0.157732 Aug 27 03:12:23.204175 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2672/5305] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:23 2022] GET /compute/v2.1/servers/600d5a60-00ec-42b4-8128-b8213548e55a => generated 1219 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:12:23.220466 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e3699890-9642-4bef-8ce4-1fa46ae4d399 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2999443f-f830-464e-9d80-c094aecf5013"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:12:23.223393 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-e3699890-9642-4bef-8ce4-1fa46ae4d399 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 3ae351e6-e583-4f93-bdae-771141c96703] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:23.231504 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e3699890-9642-4bef-8ce4-1fa46ae4d399 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:23.232206 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e3699890-9642-4bef-8ce4-1fa46ae4d399 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:23.232858 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e3699890-9642-4bef-8ce4-1fa46ae4d399 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:23.233754 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e3699890-9642-4bef-8ce4-1fa46ae4d399 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:23.234375 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e3699890-9642-4bef-8ce4-1fa46ae4d399 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:23.234964 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e3699890-9642-4bef-8ce4-1fa46ae4d399 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:23.387579 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-dcd8cfa1-8858-4e02-baec-23a5b4013689 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:23.396278 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-dcd8cfa1-8858-4e02-baec-23a5b4013689 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:23.397771 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-dcd8cfa1-8858-4e02-baec-23a5b4013689 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:23.398945 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-dcd8cfa1-8858-4e02-baec-23a5b4013689 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d" status: 200 len: 1722 microversion: 2.20 time: 0.349689 Aug 27 03:12:23.400174 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2634/5306] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:12:23 2022] GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d => generated 1722 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:12:23.694547 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e3699890-9642-4bef-8ce4-1fa46ae4d399 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "POST /compute/v2.1/servers/3ae351e6-e583-4f93-bdae-771141c96703/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.485561 Aug 27 03:12:23.696901 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2673/5307] 10.222.0.70 () {60 vars in 1323 bytes} [Sat Aug 27 03:12:23 2022] POST /compute/v2.1/servers/3ae351e6-e583-4f93-bdae-771141c96703/os-volume_attachments => generated 194 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:12:24.215517 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-7ece6aac-1b05-48d1-8b50-b915222d8437 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:24.216219 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-7ece6aac-1b05-48d1-8b50-b915222d8437 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] [instance: 600d5a60-00ec-42b4-8128-b8213548e55a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:24.224569 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7ece6aac-1b05-48d1-8b50-b915222d8437 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:24.225206 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7ece6aac-1b05-48d1-8b50-b915222d8437 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:24.225778 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7ece6aac-1b05-48d1-8b50-b915222d8437 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:24.226555 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7ece6aac-1b05-48d1-8b50-b915222d8437 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:24.227074 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7ece6aac-1b05-48d1-8b50-b915222d8437 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:24.227556 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7ece6aac-1b05-48d1-8b50-b915222d8437 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:24.314035 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-7ece6aac-1b05-48d1-8b50-b915222d8437 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b68d81dbdb474cac2060aa9d7bb502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852f3aff4a69491abbd546875918b004', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:24.325293 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-7ece6aac-1b05-48d1-8b50-b915222d8437 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] 10.222.0.70 "GET /compute/v2.1/servers/600d5a60-00ec-42b4-8128-b8213548e55a" status: 200 len: 1271 microversion: 2.1 time: 0.114193 Aug 27 03:12:24.329922 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2635/5308] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:24 2022] GET /compute/v2.1/servers/600d5a60-00ec-42b4-8128-b8213548e55a => generated 1271 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:24.428763 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-928fb9bc-1a76-4cc4-8d3c-66ce365f1320 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:24.429485 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-928fb9bc-1a76-4cc4-8d3c-66ce365f1320 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 7e810377-eeef-436c-8fab-69fa71243a9d] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:24.438125 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-928fb9bc-1a76-4cc4-8d3c-66ce365f1320 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:24.438887 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-928fb9bc-1a76-4cc4-8d3c-66ce365f1320 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:24.439490 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-928fb9bc-1a76-4cc4-8d3c-66ce365f1320 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:24.440385 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-928fb9bc-1a76-4cc4-8d3c-66ce365f1320 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:24.440999 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-928fb9bc-1a76-4cc4-8d3c-66ce365f1320 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:24.441587 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-928fb9bc-1a76-4cc4-8d3c-66ce365f1320 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:24.702731 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-928fb9bc-1a76-4cc4-8d3c-66ce365f1320 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:24.715188 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-928fb9bc-1a76-4cc4-8d3c-66ce365f1320 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:24.717302 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-928fb9bc-1a76-4cc4-8d3c-66ce365f1320 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:24.718706 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-928fb9bc-1a76-4cc4-8d3c-66ce365f1320 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d" status: 200 len: 1722 microversion: 2.20 time: 0.296497 Aug 27 03:12:24.720403 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2674/5309] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:12:24 2022] GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d => generated 1722 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:12:25.346496 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b5f6e138-3767-4a12-a515-5c19fa3c1175 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:25.347110 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b5f6e138-3767-4a12-a515-5c19fa3c1175 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] [instance: 600d5a60-00ec-42b4-8128-b8213548e55a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:25.380773 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b5f6e138-3767-4a12-a515-5c19fa3c1175 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:25.382027 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b5f6e138-3767-4a12-a515-5c19fa3c1175 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:25.386044 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b5f6e138-3767-4a12-a515-5c19fa3c1175 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:25.387092 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b5f6e138-3767-4a12-a515-5c19fa3c1175 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:25.387916 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b5f6e138-3767-4a12-a515-5c19fa3c1175 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:25.391717 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b5f6e138-3767-4a12-a515-5c19fa3c1175 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:25.658435 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b5f6e138-3767-4a12-a515-5c19fa3c1175 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b68d81dbdb474cac2060aa9d7bb502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852f3aff4a69491abbd546875918b004', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:25.670380 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b5f6e138-3767-4a12-a515-5c19fa3c1175 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] 10.222.0.70 "GET /compute/v2.1/servers/600d5a60-00ec-42b4-8128-b8213548e55a" status: 200 len: 1319 microversion: 2.1 time: 0.325826 Aug 27 03:12:25.671008 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2636/5310] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:25 2022] GET /compute/v2.1/servers/600d5a60-00ec-42b4-8128-b8213548e55a => generated 1319 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:25.745509 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7f112115-63a1-488a-9101-263545aab3cf tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:25.746881 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-7f112115-63a1-488a-9101-263545aab3cf tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 7e810377-eeef-436c-8fab-69fa71243a9d] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:25.757287 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7f112115-63a1-488a-9101-263545aab3cf tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:25.758353 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7f112115-63a1-488a-9101-263545aab3cf tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:25.759046 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7f112115-63a1-488a-9101-263545aab3cf tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:25.760123 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7f112115-63a1-488a-9101-263545aab3cf tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:25.760908 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7f112115-63a1-488a-9101-263545aab3cf tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:25.761530 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7f112115-63a1-488a-9101-263545aab3cf tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:26.176467 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-7f112115-63a1-488a-9101-263545aab3cf tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:26.188156 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-7f112115-63a1-488a-9101-263545aab3cf tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:26.190059 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-7f112115-63a1-488a-9101-263545aab3cf tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:26.192930 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-7f112115-63a1-488a-9101-263545aab3cf tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d" status: 200 len: 1722 microversion: 2.20 time: 0.451721 Aug 27 03:12:26.194239 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2675/5311] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:12:25 2022] GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d => generated 1722 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:12:26.442251 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-c318338e-9915-42e5-a41e-7a3730ab8c2f req-3c372c82-220b-4c7a-a792-0097988262a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "600d5a60-00ec-42b4-8128-b8213548e55a", "tag": "5263700c-2dba-4299-a2f2-1d49926128b1"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:12:26.464300 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-c318338e-9915-42e5-a41e-7a3730ab8c2f req-3c372c82-220b-4c7a-a792-0097988262a9 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:26.464818 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-c318338e-9915-42e5-a41e-7a3730ab8c2f req-3c372c82-220b-4c7a-a792-0097988262a9 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:26.466771 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-c318338e-9915-42e5-a41e-7a3730ab8c2f req-3c372c82-220b-4c7a-a792-0097988262a9 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:26.512123 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-c318338e-9915-42e5-a41e-7a3730ab8c2f req-3c372c82-220b-4c7a-a792-0097988262a9 service nova] Creating event network-changed:5263700c-2dba-4299-a2f2-1d49926128b1 for instance 600d5a60-00ec-42b4-8128-b8213548e55a on n-h2-852278-4 Aug 27 03:12:26.518512 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-c318338e-9915-42e5-a41e-7a3730ab8c2f req-3c372c82-220b-4c7a-a792-0097988262a9 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083741 Aug 27 03:12:26.519408 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2637/5312] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:12:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:12:26.693526 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-81f1e939-455e-4f33-9f20-c4c6a6ce4e0c tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:26.694138 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-81f1e939-455e-4f33-9f20-c4c6a6ce4e0c tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] [instance: 600d5a60-00ec-42b4-8128-b8213548e55a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:26.706558 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-81f1e939-455e-4f33-9f20-c4c6a6ce4e0c tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:26.707290 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-81f1e939-455e-4f33-9f20-c4c6a6ce4e0c tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:26.708187 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-81f1e939-455e-4f33-9f20-c4c6a6ce4e0c tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:26.709207 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-81f1e939-455e-4f33-9f20-c4c6a6ce4e0c tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:26.709851 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-81f1e939-455e-4f33-9f20-c4c6a6ce4e0c tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:26.710486 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-81f1e939-455e-4f33-9f20-c4c6a6ce4e0c tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:27.216412 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-7f46de6b-eb98-4c2b-8d93-9647e32155d4 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:27.217204 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-7f46de6b-eb98-4c2b-8d93-9647e32155d4 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 7e810377-eeef-436c-8fab-69fa71243a9d] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:27.243418 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-81f1e939-455e-4f33-9f20-c4c6a6ce4e0c tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b68d81dbdb474cac2060aa9d7bb502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852f3aff4a69491abbd546875918b004', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:27.243967 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7f46de6b-eb98-4c2b-8d93-9647e32155d4 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:27.243967 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7f46de6b-eb98-4c2b-8d93-9647e32155d4 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:27.243967 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7f46de6b-eb98-4c2b-8d93-9647e32155d4 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:27.243967 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7f46de6b-eb98-4c2b-8d93-9647e32155d4 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:27.243967 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7f46de6b-eb98-4c2b-8d93-9647e32155d4 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:27.243967 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7f46de6b-eb98-4c2b-8d93-9647e32155d4 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:27.245401 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-81f1e939-455e-4f33-9f20-c4c6a6ce4e0c tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] 10.222.0.70 "GET /compute/v2.1/servers/600d5a60-00ec-42b4-8128-b8213548e55a" status: 200 len: 1319 microversion: 2.1 time: 0.555668 Aug 27 03:12:27.249115 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2676/5313] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:26 2022] GET /compute/v2.1/servers/600d5a60-00ec-42b4-8128-b8213548e55a => generated 1319 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:27.512869 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-7f46de6b-eb98-4c2b-8d93-9647e32155d4 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:27.522132 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:12:27.525464 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-7f46de6b-eb98-4c2b-8d93-9647e32155d4 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:27.527834 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-7f46de6b-eb98-4c2b-8d93-9647e32155d4 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:27.530325 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-7f46de6b-eb98-4c2b-8d93-9647e32155d4 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d" status: 200 len: 1722 microversion: 2.20 time: 0.318156 Aug 27 03:12:27.531699 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2638/5314] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:12:27 2022] GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d => generated 1722 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:12:28.272297 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-bd4b6c3d-73cf-4221-9c49-1380a0186c3e tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:28.272926 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-bd4b6c3d-73cf-4221-9c49-1380a0186c3e tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] [instance: 600d5a60-00ec-42b4-8128-b8213548e55a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:28.287108 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bd4b6c3d-73cf-4221-9c49-1380a0186c3e tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:28.287516 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bd4b6c3d-73cf-4221-9c49-1380a0186c3e tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:28.287960 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bd4b6c3d-73cf-4221-9c49-1380a0186c3e tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:28.288877 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bd4b6c3d-73cf-4221-9c49-1380a0186c3e tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:28.289330 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bd4b6c3d-73cf-4221-9c49-1380a0186c3e tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:28.290710 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bd4b6c3d-73cf-4221-9c49-1380a0186c3e tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:28.500370 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-bd4b6c3d-73cf-4221-9c49-1380a0186c3e tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b68d81dbdb474cac2060aa9d7bb502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852f3aff4a69491abbd546875918b004', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:28.512114 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-bd4b6c3d-73cf-4221-9c49-1380a0186c3e tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] 10.222.0.70 "GET /compute/v2.1/servers/600d5a60-00ec-42b4-8128-b8213548e55a" status: 200 len: 1319 microversion: 2.1 time: 0.243583 Aug 27 03:12:28.513268 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2677/5315] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:28 2022] GET /compute/v2.1/servers/600d5a60-00ec-42b4-8128-b8213548e55a => generated 1319 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:28.556180 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-880d08ca-5053-4d6d-8004-718861457ee8 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:28.557548 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-880d08ca-5053-4d6d-8004-718861457ee8 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 7e810377-eeef-436c-8fab-69fa71243a9d] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:28.566785 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-880d08ca-5053-4d6d-8004-718861457ee8 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:28.567323 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-880d08ca-5053-4d6d-8004-718861457ee8 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:28.567767 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-880d08ca-5053-4d6d-8004-718861457ee8 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:28.568553 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-880d08ca-5053-4d6d-8004-718861457ee8 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:28.569011 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-880d08ca-5053-4d6d-8004-718861457ee8 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:28.569488 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-880d08ca-5053-4d6d-8004-718861457ee8 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:28.827857 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-880d08ca-5053-4d6d-8004-718861457ee8 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:28.835883 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-880d08ca-5053-4d6d-8004-718861457ee8 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:28.850266 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-880d08ca-5053-4d6d-8004-718861457ee8 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:28.851957 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-880d08ca-5053-4d6d-8004-718861457ee8 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d" status: 200 len: 1743 microversion: 2.20 time: 0.300653 Aug 27 03:12:28.867575 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2639/5316] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:12:28 2022] GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d => generated 1743 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:12:29.535267 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-55cf65ba-d24e-45b0-9365-9fd5f553ffa2 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:29.536532 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-55cf65ba-d24e-45b0-9365-9fd5f553ffa2 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] [instance: 600d5a60-00ec-42b4-8128-b8213548e55a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:29.556137 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-55cf65ba-d24e-45b0-9365-9fd5f553ffa2 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:29.556809 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-55cf65ba-d24e-45b0-9365-9fd5f553ffa2 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:29.557381 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-55cf65ba-d24e-45b0-9365-9fd5f553ffa2 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:29.558895 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-55cf65ba-d24e-45b0-9365-9fd5f553ffa2 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:29.559826 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-55cf65ba-d24e-45b0-9365-9fd5f553ffa2 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:29.560642 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-55cf65ba-d24e-45b0-9365-9fd5f553ffa2 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:29.815846 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-55cf65ba-d24e-45b0-9365-9fd5f553ffa2 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b68d81dbdb474cac2060aa9d7bb502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852f3aff4a69491abbd546875918b004', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:29.835193 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-55cf65ba-d24e-45b0-9365-9fd5f553ffa2 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] 10.222.0.70 "GET /compute/v2.1/servers/600d5a60-00ec-42b4-8128-b8213548e55a" status: 200 len: 1319 microversion: 2.1 time: 0.305443 Aug 27 03:12:29.836980 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2678/5317] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:29 2022] GET /compute/v2.1/servers/600d5a60-00ec-42b4-8128-b8213548e55a => generated 1319 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:29.876614 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9ca642c9-e058-4463-bbab-c93455e92b1f tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:29.878049 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-9ca642c9-e058-4463-bbab-c93455e92b1f tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 7e810377-eeef-436c-8fab-69fa71243a9d] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:29.888137 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9ca642c9-e058-4463-bbab-c93455e92b1f tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:29.889050 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9ca642c9-e058-4463-bbab-c93455e92b1f tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:29.889916 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9ca642c9-e058-4463-bbab-c93455e92b1f tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:29.891033 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9ca642c9-e058-4463-bbab-c93455e92b1f tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:29.891712 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9ca642c9-e058-4463-bbab-c93455e92b1f tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:29.892556 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9ca642c9-e058-4463-bbab-c93455e92b1f tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:30.151838 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-9ca642c9-e058-4463-bbab-c93455e92b1f tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:30.166011 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-9ca642c9-e058-4463-bbab-c93455e92b1f tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:30.168158 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-9ca642c9-e058-4463-bbab-c93455e92b1f tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:30.171209 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9ca642c9-e058-4463-bbab-c93455e92b1f tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d" status: 200 len: 1743 microversion: 2.20 time: 0.299335 Aug 27 03:12:30.173231 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2640/5318] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:12:29 2022] GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d => generated 1743 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:12:30.857068 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-cb4e9dc3-1fdc-4852-902c-516cda38574e tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:30.857683 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-cb4e9dc3-1fdc-4852-902c-516cda38574e tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] [instance: 600d5a60-00ec-42b4-8128-b8213548e55a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:30.869626 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cb4e9dc3-1fdc-4852-902c-516cda38574e tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:30.870114 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cb4e9dc3-1fdc-4852-902c-516cda38574e tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:30.870553 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cb4e9dc3-1fdc-4852-902c-516cda38574e tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:30.871259 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cb4e9dc3-1fdc-4852-902c-516cda38574e tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:30.871710 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cb4e9dc3-1fdc-4852-902c-516cda38574e tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:30.872134 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cb4e9dc3-1fdc-4852-902c-516cda38574e tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:31.032576 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-cb4e9dc3-1fdc-4852-902c-516cda38574e tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b68d81dbdb474cac2060aa9d7bb502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852f3aff4a69491abbd546875918b004', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:31.041333 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-cb4e9dc3-1fdc-4852-902c-516cda38574e tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] 10.222.0.70 "GET /compute/v2.1/servers/600d5a60-00ec-42b4-8128-b8213548e55a" status: 200 len: 1319 microversion: 2.1 time: 0.188410 Aug 27 03:12:31.042113 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2679/5319] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:30 2022] GET /compute/v2.1/servers/600d5a60-00ec-42b4-8128-b8213548e55a => generated 1319 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:31.193773 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6b7f9645-79bd-4985-abac-6d5d8e92271f tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:31.194384 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-6b7f9645-79bd-4985-abac-6d5d8e92271f tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 7e810377-eeef-436c-8fab-69fa71243a9d] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:31.201877 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6b7f9645-79bd-4985-abac-6d5d8e92271f tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:31.202422 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6b7f9645-79bd-4985-abac-6d5d8e92271f tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:31.202916 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6b7f9645-79bd-4985-abac-6d5d8e92271f tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:31.203745 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6b7f9645-79bd-4985-abac-6d5d8e92271f tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:31.204199 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6b7f9645-79bd-4985-abac-6d5d8e92271f tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:31.204653 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6b7f9645-79bd-4985-abac-6d5d8e92271f tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:31.360615 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-a14ab6eb-3c06-4a2b-96fd-8027e5a1b4d4 req-d16f8554-811b-4eb3-9a9c-f971b56a4d1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "600d5a60-00ec-42b4-8128-b8213548e55a", "name": "network-vif-plugged", "status": "completed", "tag": "5263700c-2dba-4299-a2f2-1d49926128b1"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:12:31.379852 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-a14ab6eb-3c06-4a2b-96fd-8027e5a1b4d4 req-d16f8554-811b-4eb3-9a9c-f971b56a4d1d service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:31.383777 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-a14ab6eb-3c06-4a2b-96fd-8027e5a1b4d4 req-d16f8554-811b-4eb3-9a9c-f971b56a4d1d service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:31.384389 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-a14ab6eb-3c06-4a2b-96fd-8027e5a1b4d4 req-d16f8554-811b-4eb3-9a9c-f971b56a4d1d service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:31.425430 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-6b7f9645-79bd-4985-abac-6d5d8e92271f tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:31.431422 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-a14ab6eb-3c06-4a2b-96fd-8027e5a1b4d4 req-d16f8554-811b-4eb3-9a9c-f971b56a4d1d service nova] Creating event network-vif-plugged:5263700c-2dba-4299-a2f2-1d49926128b1 for instance 600d5a60-00ec-42b4-8128-b8213548e55a on n-h2-852278-4 Aug 27 03:12:31.437543 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-6b7f9645-79bd-4985-abac-6d5d8e92271f tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:31.439527 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-6b7f9645-79bd-4985-abac-6d5d8e92271f tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:31.441262 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-6b7f9645-79bd-4985-abac-6d5d8e92271f tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d" status: 200 len: 1738 microversion: 2.20 time: 0.251762 Aug 27 03:12:31.442490 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2641/5320] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:12:31 2022] GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d => generated 1738 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:12:31.451925 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-a14ab6eb-3c06-4a2b-96fd-8027e5a1b4d4 req-d16f8554-811b-4eb3-9a9c-f971b56a4d1d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095793 Aug 27 03:12:31.453171 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2680/5321] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:12:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:12:32.062673 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-7c50ebb6-8d31-4362-a463-d8808a7f922c tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:32.063416 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-7c50ebb6-8d31-4362-a463-d8808a7f922c tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] [instance: 600d5a60-00ec-42b4-8128-b8213548e55a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:32.071259 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7c50ebb6-8d31-4362-a463-d8808a7f922c tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:32.072159 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7c50ebb6-8d31-4362-a463-d8808a7f922c tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:32.072855 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7c50ebb6-8d31-4362-a463-d8808a7f922c tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:32.073827 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7c50ebb6-8d31-4362-a463-d8808a7f922c tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:32.074499 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7c50ebb6-8d31-4362-a463-d8808a7f922c tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:32.075125 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7c50ebb6-8d31-4362-a463-d8808a7f922c tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:32.299104 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-7c50ebb6-8d31-4362-a463-d8808a7f922c tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b68d81dbdb474cac2060aa9d7bb502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852f3aff4a69491abbd546875918b004', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:32.314159 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-7c50ebb6-8d31-4362-a463-d8808a7f922c tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] 10.222.0.70 "GET /compute/v2.1/servers/600d5a60-00ec-42b4-8128-b8213548e55a" status: 200 len: 1319 microversion: 2.1 time: 0.255292 Aug 27 03:12:32.315693 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2642/5322] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:32 2022] GET /compute/v2.1/servers/600d5a60-00ec-42b4-8128-b8213548e55a => generated 1319 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:32.470718 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4ecd6832-c0ed-448e-a96f-412b175502d5 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:32.471388 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-4ecd6832-c0ed-448e-a96f-412b175502d5 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 7e810377-eeef-436c-8fab-69fa71243a9d] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:32.487867 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4ecd6832-c0ed-448e-a96f-412b175502d5 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:32.488396 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4ecd6832-c0ed-448e-a96f-412b175502d5 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:32.488839 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4ecd6832-c0ed-448e-a96f-412b175502d5 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:32.489553 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4ecd6832-c0ed-448e-a96f-412b175502d5 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:32.490189 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4ecd6832-c0ed-448e-a96f-412b175502d5 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:32.490775 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4ecd6832-c0ed-448e-a96f-412b175502d5 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:32.516236 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:12:32.701179 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-4ecd6832-c0ed-448e-a96f-412b175502d5 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:32.713005 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-4ecd6832-c0ed-448e-a96f-412b175502d5 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:32.716660 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-4ecd6832-c0ed-448e-a96f-412b175502d5 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:32.718237 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-4ecd6832-c0ed-448e-a96f-412b175502d5 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d" status: 200 len: 1738 microversion: 2.20 time: 0.252964 Aug 27 03:12:32.719023 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2681/5323] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:12:32 2022] GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d => generated 1738 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:12:33.340814 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-eefd0a51-d5ae-49a0-abeb-6e4d72a00b05 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:33.345475 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-eefd0a51-d5ae-49a0-abeb-6e4d72a00b05 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] [instance: 600d5a60-00ec-42b4-8128-b8213548e55a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:33.348046 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:12:33.350249 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=6 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:12:33.369349 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-eefd0a51-d5ae-49a0-abeb-6e4d72a00b05 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:33.370314 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-eefd0a51-d5ae-49a0-abeb-6e4d72a00b05 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:33.370976 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-eefd0a51-d5ae-49a0-abeb-6e4d72a00b05 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:33.371943 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-eefd0a51-d5ae-49a0-abeb-6e4d72a00b05 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:33.372865 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-eefd0a51-d5ae-49a0-abeb-6e4d72a00b05 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:33.373513 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-eefd0a51-d5ae-49a0-abeb-6e4d72a00b05 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:33.473251 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-c994b8ea-2b69-417d-8a3a-9abad659157f req-6e498bd1-d448-4f73-85ba-bf435292adc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e810377-eeef-436c-8fab-69fa71243a9d", "name": "network-vif-plugged", "status": "completed", "tag": "2c3d5445-7fe3-4101-9cf9-d7b63e882f1e"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:12:33.487526 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:12:33.492815 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-c994b8ea-2b69-417d-8a3a-9abad659157f req-6e498bd1-d448-4f73-85ba-bf435292adc1 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:33.494922 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-c994b8ea-2b69-417d-8a3a-9abad659157f req-6e498bd1-d448-4f73-85ba-bf435292adc1 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:33.495498 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-c994b8ea-2b69-417d-8a3a-9abad659157f req-6e498bd1-d448-4f73-85ba-bf435292adc1 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:33.522289 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-c994b8ea-2b69-417d-8a3a-9abad659157f req-6e498bd1-d448-4f73-85ba-bf435292adc1 service nova] Creating event network-vif-plugged:2c3d5445-7fe3-4101-9cf9-d7b63e882f1e for instance 7e810377-eeef-436c-8fab-69fa71243a9d on n-h1-852278-4 Aug 27 03:12:33.535585 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-c994b8ea-2b69-417d-8a3a-9abad659157f req-6e498bd1-d448-4f73-85ba-bf435292adc1 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065865 Aug 27 03:12:33.536683 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2682/5324] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:12:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:12:33.606508 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-eefd0a51-d5ae-49a0-abeb-6e4d72a00b05 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b68d81dbdb474cac2060aa9d7bb502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852f3aff4a69491abbd546875918b004', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:33.628853 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-eefd0a51-d5ae-49a0-abeb-6e4d72a00b05 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] 10.222.0.70 "GET /compute/v2.1/servers/600d5a60-00ec-42b4-8128-b8213548e55a" status: 200 len: 1508 microversion: 2.1 time: 0.297416 Aug 27 03:12:33.645063 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2643/5325] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:33 2022] GET /compute/v2.1/servers/600d5a60-00ec-42b4-8128-b8213548e55a => generated 1508 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:33.657157 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b7105f4f-8a10-4e41-98fa-b6e516087929 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d9b64656-34a6-4705-9f2b-d86997bbfd7a", "device": "/dev/sdb"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:12:33.660992 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b7105f4f-8a10-4e41-98fa-b6e516087929 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] [instance: 600d5a60-00ec-42b4-8128-b8213548e55a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:33.678110 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b7105f4f-8a10-4e41-98fa-b6e516087929 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:33.682670 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b7105f4f-8a10-4e41-98fa-b6e516087929 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:33.683827 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b7105f4f-8a10-4e41-98fa-b6e516087929 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:33.685527 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b7105f4f-8a10-4e41-98fa-b6e516087929 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:33.689554 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b7105f4f-8a10-4e41-98fa-b6e516087929 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:33.690281 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b7105f4f-8a10-4e41-98fa-b6e516087929 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:33.759249 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8e4aa3cc-7185-4d00-9a34-6d84e54d1dd5 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:33.760148 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-8e4aa3cc-7185-4d00-9a34-6d84e54d1dd5 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 7e810377-eeef-436c-8fab-69fa71243a9d] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:33.774603 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8e4aa3cc-7185-4d00-9a34-6d84e54d1dd5 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:33.775903 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8e4aa3cc-7185-4d00-9a34-6d84e54d1dd5 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:33.779658 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8e4aa3cc-7185-4d00-9a34-6d84e54d1dd5 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:33.780596 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8e4aa3cc-7185-4d00-9a34-6d84e54d1dd5 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:33.781217 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8e4aa3cc-7185-4d00-9a34-6d84e54d1dd5 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:33.781805 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8e4aa3cc-7185-4d00-9a34-6d84e54d1dd5 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:34.046869 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-8e4aa3cc-7185-4d00-9a34-6d84e54d1dd5 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:34.059675 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-8e4aa3cc-7185-4d00-9a34-6d84e54d1dd5 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:34.061824 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-8e4aa3cc-7185-4d00-9a34-6d84e54d1dd5 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:34.063468 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-8e4aa3cc-7185-4d00-9a34-6d84e54d1dd5 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d" status: 200 len: 1738 microversion: 2.20 time: 0.321812 Aug 27 03:12:34.065111 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2644/5326] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:12:33 2022] GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d => generated 1738 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:12:34.171708 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b7105f4f-8a10-4e41-98fa-b6e516087929 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] 10.222.0.70 "POST /compute/v2.1/servers/600d5a60-00ec-42b4-8128-b8213548e55a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.508815 Aug 27 03:12:34.174822 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2683/5327] 10.222.0.70 () {60 vars in 1323 bytes} [Sat Aug 27 03:12:33 2022] POST /compute/v2.1/servers/600d5a60-00ec-42b4-8128-b8213548e55a/os-volume_attachments => generated 194 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:12:35.091320 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-2ff58341-1239-4adf-9a9a-f7588c8e3a2b tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:35.092660 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-2ff58341-1239-4adf-9a9a-f7588c8e3a2b tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 7e810377-eeef-436c-8fab-69fa71243a9d] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:35.119642 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2ff58341-1239-4adf-9a9a-f7588c8e3a2b tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:35.121820 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2ff58341-1239-4adf-9a9a-f7588c8e3a2b tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:35.125988 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2ff58341-1239-4adf-9a9a-f7588c8e3a2b tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:35.127251 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2ff58341-1239-4adf-9a9a-f7588c8e3a2b tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:35.128635 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2ff58341-1239-4adf-9a9a-f7588c8e3a2b tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:35.129602 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2ff58341-1239-4adf-9a9a-f7588c8e3a2b tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:35.370542 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-2ff58341-1239-4adf-9a9a-f7588c8e3a2b tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:35.382150 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-2ff58341-1239-4adf-9a9a-f7588c8e3a2b tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:35.386530 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-2ff58341-1239-4adf-9a9a-f7588c8e3a2b tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:35.388305 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-2ff58341-1239-4adf-9a9a-f7588c8e3a2b tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d" status: 200 len: 1738 microversion: 2.20 time: 0.302558 Aug 27 03:12:35.404497 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2645/5328] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:12:35 2022] GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d => generated 1738 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:12:36.428801 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-6e931410-4175-4a28-9527-cc2bba5c9f8e tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:36.429554 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-6e931410-4175-4a28-9527-cc2bba5c9f8e tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 7e810377-eeef-436c-8fab-69fa71243a9d] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:36.439450 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6e931410-4175-4a28-9527-cc2bba5c9f8e tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:36.439948 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6e931410-4175-4a28-9527-cc2bba5c9f8e tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:36.440405 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6e931410-4175-4a28-9527-cc2bba5c9f8e tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:36.441293 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6e931410-4175-4a28-9527-cc2bba5c9f8e tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:36.441742 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6e931410-4175-4a28-9527-cc2bba5c9f8e tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:36.442162 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6e931410-4175-4a28-9527-cc2bba5c9f8e tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:36.712686 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6b994c8a-def6-4409-89e1-48c9c1139210 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2999443f-f830-464e-9d80-c094aecf5013"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:12:36.715692 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-6b994c8a-def6-4409-89e1-48c9c1139210 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 3ae351e6-e583-4f93-bdae-771141c96703] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:36.725793 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:12:36.743969 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6b994c8a-def6-4409-89e1-48c9c1139210 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:36.747914 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6b994c8a-def6-4409-89e1-48c9c1139210 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:36.749427 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6b994c8a-def6-4409-89e1-48c9c1139210 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:36.756263 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6b994c8a-def6-4409-89e1-48c9c1139210 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:36.757098 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6b994c8a-def6-4409-89e1-48c9c1139210 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:36.758827 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6b994c8a-def6-4409-89e1-48c9c1139210 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:36.836400 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-6e931410-4175-4a28-9527-cc2bba5c9f8e tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:36.846095 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-6e931410-4175-4a28-9527-cc2bba5c9f8e tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:36.847728 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-6e931410-4175-4a28-9527-cc2bba5c9f8e tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:36.849683 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-6e931410-4175-4a28-9527-cc2bba5c9f8e tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d" status: 200 len: 1738 microversion: 2.20 time: 0.441589 Aug 27 03:12:36.865193 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2684/5329] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:12:36 2022] GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d => generated 1738 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:12:36.948908 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-6b994c8a-def6-4409-89e1-48c9c1139210 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] HTTP exception thrown: Invalid volume: volume 2999443f-f830-464e-9d80-c094aecf5013 is already attached to instances: 3ae351e6-e583-4f93-bdae-771141c96703 Aug 27 03:12:36.950931 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6b994c8a-def6-4409-89e1-48c9c1139210 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Request method failure captured: Aug 27 03:12:36.950931 n-d-852278-4 devstack@n-api.service[134052]: request: POST /compute/v2.1/servers/3ae351e6-e583-4f93-bdae-771141c96703/os-volume_attachments HTTP/1.1 Aug 27 03:12:36.950931 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 03:12:36.950931 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 03:12:36.950931 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 03:12:36.950931 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 74 Aug 27 03:12:36.950931 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 03:12:36.950931 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 03:12:36.950931 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 03:12:36.950931 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 03:12:36.950931 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYq440P3xsAabxN7nGlE2F1Ccxicf_9DU586MSNagRbCITstsgHyyHbnbZoUsiVfiyCUhE6F_2SvHrXIrDKvSEnzb0XjME8fkYvCR9LlCkoQHUfv6A1aESh1h-tIQR1qbnjbVFsJiiWy_WcC2U4qzkQvsEYcwujqY5DDaX4NjUQt4DA Aug 27 03:12:36.950931 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 03:12:36.950931 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 03:12:36.950931 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 03:12:36.950931 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 03:12:36.950931 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 03:12:36.950931 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 03:12:36.950931 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: b92af206e05f44cf948b7c25d1acc139 Aug 27 03:12:36.950931 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-AttachVolumeNegativeTest-878461886 Aug 27 03:12:36.950931 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 03:12:36.950931 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 03:12:36.950931 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b92af206e05f44cf948b7c25d1acc139"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_b92af206e05f44cf948b7c25d1acc139", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b92af206e05f44cf948b7c25d1acc139"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/b92af206e05f44cf948b7c25d1acc139"}]}] Aug 27 03:12:36.950931 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-AttachVolumeNegativeTest-878461886 Aug 27 03:12:36.950931 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: b92af206e05f44cf948b7c25d1acc139 Aug 27 03:12:36.950931 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-878461886 Aug 27 03:12:36.950931 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-AttachVolumeNegativeTest-878461886-project Aug 27 03:12:36.950931 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 03:12:36.950931 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 03:12:36.950931 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: a549f85910184bf7a697cce7fa3dff96 Aug 27 03:12:36.950931 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-AttachVolumeNegativeTest-878461886-project Aug 27 03:12:36.950931 n-d-852278-4 devstack@n-api.service[134052]: Aug 27 03:12:36.950931 n-d-852278-4 devstack@n-api.service[134052]: {"volumeAttachment": {"volumeId": "2999443f-f830-464e-9d80-c094aecf5013"}} Aug 27 03:12:36.950931 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 03:12:36.950931 n-d-852278-4 devstack@n-api.service[134052]: exception: Invalid volume: volume 2999443f-f830-464e-9d80-c094aecf5013 is already attached to instances: 3ae351e6-e583-4f93-bdae-771141c96703 Aug 27 03:12:36.950931 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'server_id': '3ae351e6-e583-4f93-bdae-771141c96703', 'body': {'volumeAttachment': {'volumeId': '2999443f-f830-464e-9d80-c094aecf5013'}}} Aug 27 03:12:36.950931 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:12:36.950931 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:12:36.950931 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 27 03:12:36.950931 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 27 03:12:36.950931 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 03:12:36.950931 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 03:12:36.950931 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 27 03:12:36.950931 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 27 03:12:36.950931 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 27 03:12:36.950931 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 27 03:12:36.950931 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 27 03:12:36.950931 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 27 03:12:36.950931 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 2999443f-f830-464e-9d80-c094aecf5013 is already attached to instances: 3ae351e6-e583-4f93-bdae-771141c96703 Aug 27 03:12:36.950931 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:12:36.950931 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:12:36.950931 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:12:36.950931 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:12:36.950931 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:12:36.950931 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:12:36.950931 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:12:36.950931 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:12:36.950931 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:12:36.950931 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:12:36.950931 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:12:36.950931 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:12:36.950931 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:12:36.950931 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:12:36.956016 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:12:36.956016 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:12:36.956016 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 27 03:12:36.956016 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 27 03:12:36.956016 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 2999443f-f830-464e-9d80-c094aecf5013 is already attached to instances: 3ae351e6-e583-4f93-bdae-771141c96703 Aug 27 03:12:36.956016 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:12:36.956016 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:12:36.956016 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:12:36.956016 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:12:36.956016 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:12:36.956016 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:12:36.956016 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:12:36.956016 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:12:36.956016 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 2999443f-f830-464e-9d80-c094aecf5013 is already attached to instances: 3ae351e6-e583-4f93-bdae-771141c96703 Aug 27 03:12:36.956016 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:12:36.958985 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6b994c8a-def6-4409-89e1-48c9c1139210 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Returning 400 to user: Invalid volume: volume 2999443f-f830-464e-9d80-c094aecf5013 is already attached to instances: 3ae351e6-e583-4f93-bdae-771141c96703 {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:12:36.960079 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-6b994c8a-def6-4409-89e1-48c9c1139210 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "POST /compute/v2.1/servers/3ae351e6-e583-4f93-bdae-771141c96703/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.252041 Aug 27 03:12:36.961116 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2646/5330] 10.222.0.70 () {60 vars in 1323 bytes} [Sat Aug 27 03:12:36 2022] POST /compute/v2.1/servers/3ae351e6-e583-4f93-bdae-771141c96703/os-volume_attachments => generated 174 bytes in 254 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:12:37.086354 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-5379f336-1d20-454c-85b3-30aa7aa46c65 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:37.087663 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-5379f336-1d20-454c-85b3-30aa7aa46c65 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 3ae351e6-e583-4f93-bdae-771141c96703] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:37.095920 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5379f336-1d20-454c-85b3-30aa7aa46c65 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:37.096706 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5379f336-1d20-454c-85b3-30aa7aa46c65 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:37.097387 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5379f336-1d20-454c-85b3-30aa7aa46c65 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:37.098324 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5379f336-1d20-454c-85b3-30aa7aa46c65 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:37.098986 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5379f336-1d20-454c-85b3-30aa7aa46c65 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:37.099784 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5379f336-1d20-454c-85b3-30aa7aa46c65 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:37.272177 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.objects.instance [None req-5379f336-1d20-454c-85b3-30aa7aa46c65 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lazy-loading 'services' on Instance uuid 3ae351e6-e583-4f93-bdae-771141c96703 {{(pid=134051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:12:37.393576 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-5379f336-1d20-454c-85b3-30aa7aa46c65 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "DELETE /compute/v2.1/servers/3ae351e6-e583-4f93-bdae-771141c96703/os-volume_attachments/2999443f-f830-464e-9d80-c094aecf5013" status: 202 len: 0 microversion: 2.1 time: 0.311299 Aug 27 03:12:37.394530 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2685/5331] 10.222.0.70 () {58 vars in 1416 bytes} [Sat Aug 27 03:12:37 2022] DELETE /compute/v2.1/servers/3ae351e6-e583-4f93-bdae-771141c96703/os-volume_attachments/2999443f-f830-464e-9d80-c094aecf5013 => generated 0 bytes in 313 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:12:37.402665 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9f877437-fd97-457f-858a-21d888ac8629 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:37.405538 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-9f877437-fd97-457f-858a-21d888ac8629 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 3ae351e6-e583-4f93-bdae-771141c96703] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:37.420219 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9f877437-fd97-457f-858a-21d888ac8629 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:37.420735 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9f877437-fd97-457f-858a-21d888ac8629 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:37.421173 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9f877437-fd97-457f-858a-21d888ac8629 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:37.421893 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9f877437-fd97-457f-858a-21d888ac8629 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:37.422344 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9f877437-fd97-457f-858a-21d888ac8629 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:37.422775 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9f877437-fd97-457f-858a-21d888ac8629 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:37.524099 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9f877437-fd97-457f-858a-21d888ac8629 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "GET /compute/v2.1/servers/3ae351e6-e583-4f93-bdae-771141c96703/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.124395 Aug 27 03:12:37.525348 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2647/5332] 10.222.0.70 () {58 vars in 1302 bytes} [Sat Aug 27 03:12:37 2022] GET /compute/v2.1/servers/3ae351e6-e583-4f93-bdae-771141c96703/os-volume_attachments => generated 197 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:12:37.876095 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ce3b98f7-b5e7-40e4-bb74-08a55dea0dc4 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:37.877515 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-ce3b98f7-b5e7-40e4-bb74-08a55dea0dc4 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 7e810377-eeef-436c-8fab-69fa71243a9d] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:37.896226 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ce3b98f7-b5e7-40e4-bb74-08a55dea0dc4 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:37.897114 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ce3b98f7-b5e7-40e4-bb74-08a55dea0dc4 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:37.897758 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ce3b98f7-b5e7-40e4-bb74-08a55dea0dc4 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:37.899680 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ce3b98f7-b5e7-40e4-bb74-08a55dea0dc4 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:37.900800 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ce3b98f7-b5e7-40e4-bb74-08a55dea0dc4 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:37.901902 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ce3b98f7-b5e7-40e4-bb74-08a55dea0dc4 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:38.226181 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-ce3b98f7-b5e7-40e4-bb74-08a55dea0dc4 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:38.238609 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-ce3b98f7-b5e7-40e4-bb74-08a55dea0dc4 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:38.240713 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-ce3b98f7-b5e7-40e4-bb74-08a55dea0dc4 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:38.244184 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ce3b98f7-b5e7-40e4-bb74-08a55dea0dc4 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d" status: 200 len: 1738 microversion: 2.20 time: 0.372792 Aug 27 03:12:38.257396 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2686/5333] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:12:37 2022] GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d => generated 1738 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:12:38.537177 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-22d04e66-e2c6-47ec-9179-46e8c48db998 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:38.540024 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-22d04e66-e2c6-47ec-9179-46e8c48db998 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 3ae351e6-e583-4f93-bdae-771141c96703] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:38.547688 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-22d04e66-e2c6-47ec-9179-46e8c48db998 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:38.548542 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-22d04e66-e2c6-47ec-9179-46e8c48db998 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:38.549185 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-22d04e66-e2c6-47ec-9179-46e8c48db998 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:38.550074 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-22d04e66-e2c6-47ec-9179-46e8c48db998 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:38.550718 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-22d04e66-e2c6-47ec-9179-46e8c48db998 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:38.551308 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-22d04e66-e2c6-47ec-9179-46e8c48db998 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:38.595403 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-22d04e66-e2c6-47ec-9179-46e8c48db998 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "GET /compute/v2.1/servers/3ae351e6-e583-4f93-bdae-771141c96703/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062302 Aug 27 03:12:38.600704 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2648/5334] 10.222.0.70 () {58 vars in 1302 bytes} [Sat Aug 27 03:12:38 2022] GET /compute/v2.1/servers/3ae351e6-e583-4f93-bdae-771141c96703/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:12:39.271425 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b9d648f9-21a9-4635-87d0-ae084406614c tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:39.271425 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b9d648f9-21a9-4635-87d0-ae084406614c tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 7e810377-eeef-436c-8fab-69fa71243a9d] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:39.280878 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b9d648f9-21a9-4635-87d0-ae084406614c tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:39.281546 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b9d648f9-21a9-4635-87d0-ae084406614c tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:39.282096 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b9d648f9-21a9-4635-87d0-ae084406614c tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:39.282917 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b9d648f9-21a9-4635-87d0-ae084406614c tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:39.283495 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b9d648f9-21a9-4635-87d0-ae084406614c tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:39.284018 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b9d648f9-21a9-4635-87d0-ae084406614c tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:39.546700 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-b9d648f9-21a9-4635-87d0-ae084406614c tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:39.560421 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-b9d648f9-21a9-4635-87d0-ae084406614c tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:39.562354 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-b9d648f9-21a9-4635-87d0-ae084406614c tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:39.563988 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b9d648f9-21a9-4635-87d0-ae084406614c tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d" status: 200 len: 1738 microversion: 2.20 time: 0.298404 Aug 27 03:12:39.565660 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2687/5335] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:12:39 2022] GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d => generated 1738 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:12:39.614042 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-28b0777c-dc3d-4ce4-a42a-222f538ddb5b tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:39.618269 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-28b0777c-dc3d-4ce4-a42a-222f538ddb5b tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 3ae351e6-e583-4f93-bdae-771141c96703] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:39.648154 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-28b0777c-dc3d-4ce4-a42a-222f538ddb5b tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:39.648674 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-28b0777c-dc3d-4ce4-a42a-222f538ddb5b tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:39.649108 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-28b0777c-dc3d-4ce4-a42a-222f538ddb5b tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:39.658569 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-28b0777c-dc3d-4ce4-a42a-222f538ddb5b tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:39.659062 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-28b0777c-dc3d-4ce4-a42a-222f538ddb5b tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:39.659913 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-28b0777c-dc3d-4ce4-a42a-222f538ddb5b tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:39.736465 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-28b0777c-dc3d-4ce4-a42a-222f538ddb5b tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "GET /compute/v2.1/servers/3ae351e6-e583-4f93-bdae-771141c96703/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.132854 Aug 27 03:12:39.741462 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2649/5336] 10.222.0.70 () {58 vars in 1302 bytes} [Sat Aug 27 03:12:39 2022] GET /compute/v2.1/servers/3ae351e6-e583-4f93-bdae-771141c96703/os-volume_attachments => generated 197 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:12:40.590655 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-70b656f2-b13a-4df1-8a5f-7b3fc2e40120 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:40.591941 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-70b656f2-b13a-4df1-8a5f-7b3fc2e40120 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 7e810377-eeef-436c-8fab-69fa71243a9d] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:40.605997 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=51 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:12:40.608691 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-70b656f2-b13a-4df1-8a5f-7b3fc2e40120 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:40.609495 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-70b656f2-b13a-4df1-8a5f-7b3fc2e40120 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:40.610157 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-70b656f2-b13a-4df1-8a5f-7b3fc2e40120 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:40.611078 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-70b656f2-b13a-4df1-8a5f-7b3fc2e40120 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:40.611854 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-70b656f2-b13a-4df1-8a5f-7b3fc2e40120 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:40.612573 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-70b656f2-b13a-4df1-8a5f-7b3fc2e40120 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:40.749338 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8c34fa5d-484d-49ad-9dd9-9b4676ddb7e9 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:40.761793 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-8c34fa5d-484d-49ad-9dd9-9b4676ddb7e9 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 3ae351e6-e583-4f93-bdae-771141c96703] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:40.770070 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8c34fa5d-484d-49ad-9dd9-9b4676ddb7e9 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:40.770826 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8c34fa5d-484d-49ad-9dd9-9b4676ddb7e9 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:40.771432 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8c34fa5d-484d-49ad-9dd9-9b4676ddb7e9 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:40.772616 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8c34fa5d-484d-49ad-9dd9-9b4676ddb7e9 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:40.773225 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8c34fa5d-484d-49ad-9dd9-9b4676ddb7e9 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:40.773929 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8c34fa5d-484d-49ad-9dd9-9b4676ddb7e9 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:40.874245 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-8c34fa5d-484d-49ad-9dd9-9b4676ddb7e9 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "GET /compute/v2.1/servers/3ae351e6-e583-4f93-bdae-771141c96703/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.129089 Aug 27 03:12:40.875174 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2650/5337] 10.222.0.70 () {58 vars in 1302 bytes} [Sat Aug 27 03:12:40 2022] GET /compute/v2.1/servers/3ae351e6-e583-4f93-bdae-771141c96703/os-volume_attachments => generated 197 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:12:40.963966 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-70b656f2-b13a-4df1-8a5f-7b3fc2e40120 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:40.973646 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-70b656f2-b13a-4df1-8a5f-7b3fc2e40120 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:40.979473 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-70b656f2-b13a-4df1-8a5f-7b3fc2e40120 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:40.989335 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-70b656f2-b13a-4df1-8a5f-7b3fc2e40120 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d" status: 200 len: 1738 microversion: 2.20 time: 0.403056 Aug 27 03:12:40.990192 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2688/5338] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:12:40 2022] GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d => generated 1738 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:12:41.887973 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4a2b8a1c-9334-4115-9afd-8071af2ccb2b tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:41.890977 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-4a2b8a1c-9334-4115-9afd-8071af2ccb2b tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 3ae351e6-e583-4f93-bdae-771141c96703] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:41.904791 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4a2b8a1c-9334-4115-9afd-8071af2ccb2b tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:41.912879 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4a2b8a1c-9334-4115-9afd-8071af2ccb2b tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:41.913700 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4a2b8a1c-9334-4115-9afd-8071af2ccb2b tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:41.914709 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4a2b8a1c-9334-4115-9afd-8071af2ccb2b tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:41.915586 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4a2b8a1c-9334-4115-9afd-8071af2ccb2b tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:41.916260 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4a2b8a1c-9334-4115-9afd-8071af2ccb2b tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:41.961989 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-4a2b8a1c-9334-4115-9afd-8071af2ccb2b tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "GET /compute/v2.1/servers/3ae351e6-e583-4f93-bdae-771141c96703/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078607 Aug 27 03:12:41.963359 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2651/5339] 10.222.0.70 () {58 vars in 1302 bytes} [Sat Aug 27 03:12:41 2022] GET /compute/v2.1/servers/3ae351e6-e583-4f93-bdae-771141c96703/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:12:42.017331 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8a8d28dc-b525-4263-b83f-c5f787d83b14 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:42.018619 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-8a8d28dc-b525-4263-b83f-c5f787d83b14 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 7e810377-eeef-436c-8fab-69fa71243a9d] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:42.026210 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8a8d28dc-b525-4263-b83f-c5f787d83b14 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:42.027071 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8a8d28dc-b525-4263-b83f-c5f787d83b14 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:42.027684 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8a8d28dc-b525-4263-b83f-c5f787d83b14 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:42.028647 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8a8d28dc-b525-4263-b83f-c5f787d83b14 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:42.029283 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8a8d28dc-b525-4263-b83f-c5f787d83b14 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:42.029866 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8a8d28dc-b525-4263-b83f-c5f787d83b14 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:42.284049 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-8a8d28dc-b525-4263-b83f-c5f787d83b14 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:42.293634 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-8a8d28dc-b525-4263-b83f-c5f787d83b14 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:42.305937 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-8a8d28dc-b525-4263-b83f-c5f787d83b14 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:42.307189 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-8a8d28dc-b525-4263-b83f-c5f787d83b14 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d" status: 200 len: 1738 microversion: 2.20 time: 0.294100 Aug 27 03:12:42.320416 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2689/5340] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:12:42 2022] GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d => generated 1738 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:12:42.977704 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-7c4f775c-d83b-4949-9e56-158b41bee39d tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:42.985969 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-7c4f775c-d83b-4949-9e56-158b41bee39d tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 3ae351e6-e583-4f93-bdae-771141c96703] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:43.001048 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7c4f775c-d83b-4949-9e56-158b41bee39d tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:43.002698 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7c4f775c-d83b-4949-9e56-158b41bee39d tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:43.003604 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7c4f775c-d83b-4949-9e56-158b41bee39d tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:43.006281 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7c4f775c-d83b-4949-9e56-158b41bee39d tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:43.007993 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7c4f775c-d83b-4949-9e56-158b41bee39d tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:43.009582 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7c4f775c-d83b-4949-9e56-158b41bee39d tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:43.097748 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-7c4f775c-d83b-4949-9e56-158b41bee39d tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "GET /compute/v2.1/servers/3ae351e6-e583-4f93-bdae-771141c96703/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.126517 Aug 27 03:12:43.099080 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2652/5341] 10.222.0.70 () {58 vars in 1302 bytes} [Sat Aug 27 03:12:42 2022] GET /compute/v2.1/servers/3ae351e6-e583-4f93-bdae-771141c96703/os-volume_attachments => generated 197 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:12:43.334519 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-bf0e9880-7f8f-4aae-ba58-8ebcb1db66f8 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:43.335877 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-bf0e9880-7f8f-4aae-ba58-8ebcb1db66f8 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 7e810377-eeef-436c-8fab-69fa71243a9d] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:43.344210 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bf0e9880-7f8f-4aae-ba58-8ebcb1db66f8 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:43.345119 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bf0e9880-7f8f-4aae-ba58-8ebcb1db66f8 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:43.345953 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bf0e9880-7f8f-4aae-ba58-8ebcb1db66f8 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:43.347424 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bf0e9880-7f8f-4aae-ba58-8ebcb1db66f8 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:43.348585 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bf0e9880-7f8f-4aae-ba58-8ebcb1db66f8 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:43.349573 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bf0e9880-7f8f-4aae-ba58-8ebcb1db66f8 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:43.527132 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-bf0e9880-7f8f-4aae-ba58-8ebcb1db66f8 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:43.539143 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-bf0e9880-7f8f-4aae-ba58-8ebcb1db66f8 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:43.540810 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-bf0e9880-7f8f-4aae-ba58-8ebcb1db66f8 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:43.542100 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-bf0e9880-7f8f-4aae-ba58-8ebcb1db66f8 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d" status: 200 len: 1738 microversion: 2.20 time: 0.211527 Aug 27 03:12:43.557907 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2690/5342] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:12:43 2022] GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d => generated 1738 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:12:44.111441 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-efa2829f-c360-4459-9c22-35af8d6ebd48 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:44.114113 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-efa2829f-c360-4459-9c22-35af8d6ebd48 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 3ae351e6-e583-4f93-bdae-771141c96703] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:44.127131 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-efa2829f-c360-4459-9c22-35af8d6ebd48 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:44.128046 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-efa2829f-c360-4459-9c22-35af8d6ebd48 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:44.128046 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-efa2829f-c360-4459-9c22-35af8d6ebd48 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:44.128815 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-efa2829f-c360-4459-9c22-35af8d6ebd48 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:44.129211 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-efa2829f-c360-4459-9c22-35af8d6ebd48 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:44.129628 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-efa2829f-c360-4459-9c22-35af8d6ebd48 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:44.211781 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-efa2829f-c360-4459-9c22-35af8d6ebd48 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "GET /compute/v2.1/servers/3ae351e6-e583-4f93-bdae-771141c96703/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.104386 Aug 27 03:12:44.216489 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2653/5343] 10.222.0.70 () {58 vars in 1302 bytes} [Sat Aug 27 03:12:44 2022] GET /compute/v2.1/servers/3ae351e6-e583-4f93-bdae-771141c96703/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:12:44.567399 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-978908e0-f890-4a1f-a199-f11d6971da9f tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:44.568927 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-978908e0-f890-4a1f-a199-f11d6971da9f tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 7e810377-eeef-436c-8fab-69fa71243a9d] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:44.577196 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-978908e0-f890-4a1f-a199-f11d6971da9f tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:44.578044 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-978908e0-f890-4a1f-a199-f11d6971da9f tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:44.578821 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-978908e0-f890-4a1f-a199-f11d6971da9f tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:44.579926 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-978908e0-f890-4a1f-a199-f11d6971da9f tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:44.580600 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-978908e0-f890-4a1f-a199-f11d6971da9f tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:44.581213 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-978908e0-f890-4a1f-a199-f11d6971da9f tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:44.817041 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-978908e0-f890-4a1f-a199-f11d6971da9f tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:44.826824 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-978908e0-f890-4a1f-a199-f11d6971da9f tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:44.829587 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-978908e0-f890-4a1f-a199-f11d6971da9f tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:44.831003 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-978908e0-f890-4a1f-a199-f11d6971da9f tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d" status: 200 len: 1738 microversion: 2.20 time: 0.267621 Aug 27 03:12:44.835343 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2691/5344] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:12:44 2022] GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d => generated 1738 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:12:45.223218 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f6610a22-ec0c-458f-81c3-68ac4396490f tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:45.225681 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-f6610a22-ec0c-458f-81c3-68ac4396490f tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 3ae351e6-e583-4f93-bdae-771141c96703] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:45.232757 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f6610a22-ec0c-458f-81c3-68ac4396490f tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:45.233477 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f6610a22-ec0c-458f-81c3-68ac4396490f tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:45.234218 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f6610a22-ec0c-458f-81c3-68ac4396490f tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:45.235091 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f6610a22-ec0c-458f-81c3-68ac4396490f tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:45.235823 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f6610a22-ec0c-458f-81c3-68ac4396490f tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:45.236437 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f6610a22-ec0c-458f-81c3-68ac4396490f tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:45.271881 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f6610a22-ec0c-458f-81c3-68ac4396490f tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "GET /compute/v2.1/servers/3ae351e6-e583-4f93-bdae-771141c96703/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052543 Aug 27 03:12:45.274421 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2654/5345] 10.222.0.70 () {58 vars in 1302 bytes} [Sat Aug 27 03:12:45 2022] GET /compute/v2.1/servers/3ae351e6-e583-4f93-bdae-771141c96703/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:12:45.435524 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7ccec83d-8a4b-4783-8a5e-50d3e833f1b9 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:45.436504 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-7ccec83d-8a4b-4783-8a5e-50d3e833f1b9 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 3ae351e6-e583-4f93-bdae-771141c96703] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:45.447660 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7ccec83d-8a4b-4783-8a5e-50d3e833f1b9 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:45.449053 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7ccec83d-8a4b-4783-8a5e-50d3e833f1b9 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:45.457335 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7ccec83d-8a4b-4783-8a5e-50d3e833f1b9 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:45.458455 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7ccec83d-8a4b-4783-8a5e-50d3e833f1b9 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:45.459105 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7ccec83d-8a4b-4783-8a5e-50d3e833f1b9 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:45.459703 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7ccec83d-8a4b-4783-8a5e-50d3e833f1b9 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:45.495631 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-7ccec83d-8a4b-4783-8a5e-50d3e833f1b9 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 3ae351e6-e583-4f93-bdae-771141c96703] Going to try to terminate instance {{(pid=134051) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:12:45.644054 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-7ccec83d-8a4b-4783-8a5e-50d3e833f1b9 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "DELETE /compute/v2.1/servers/3ae351e6-e583-4f93-bdae-771141c96703" status: 204 len: 0 microversion: 2.1 time: 0.213461 Aug 27 03:12:45.644793 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2692/5346] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 03:12:45 2022] DELETE /compute/v2.1/servers/3ae351e6-e583-4f93-bdae-771141c96703 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:12:45.659430 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-13b3d41a-4111-4210-8311-babc7838ee8e tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:45.660134 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-13b3d41a-4111-4210-8311-babc7838ee8e tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 3ae351e6-e583-4f93-bdae-771141c96703] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:45.667630 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-13b3d41a-4111-4210-8311-babc7838ee8e tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:45.667921 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-13b3d41a-4111-4210-8311-babc7838ee8e tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:45.668376 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-13b3d41a-4111-4210-8311-babc7838ee8e tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:45.669098 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-13b3d41a-4111-4210-8311-babc7838ee8e tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:45.669589 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-13b3d41a-4111-4210-8311-babc7838ee8e tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:45.670016 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-13b3d41a-4111-4210-8311-babc7838ee8e tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:45.693591 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=100 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:12:45.826977 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-13b3d41a-4111-4210-8311-babc7838ee8e tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a549f85910184bf7a697cce7fa3dff96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92af206e05f44cf948b7c25d1acc139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:45.835530 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-13b3d41a-4111-4210-8311-babc7838ee8e tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "GET /compute/v2.1/servers/3ae351e6-e583-4f93-bdae-771141c96703" status: 200 len: 1679 microversion: 2.1 time: 0.186336 Aug 27 03:12:45.849118 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2655/5347] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:45 2022] GET /compute/v2.1/servers/3ae351e6-e583-4f93-bdae-771141c96703 => generated 1679 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:45.860341 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-76ac38b7-bd54-4377-a30b-9c0c9b9e813c tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:45.861153 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-76ac38b7-bd54-4377-a30b-9c0c9b9e813c tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 7e810377-eeef-436c-8fab-69fa71243a9d] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:45.867708 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-76ac38b7-bd54-4377-a30b-9c0c9b9e813c tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:45.868575 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-76ac38b7-bd54-4377-a30b-9c0c9b9e813c tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:45.869265 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-76ac38b7-bd54-4377-a30b-9c0c9b9e813c tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:45.870167 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-76ac38b7-bd54-4377-a30b-9c0c9b9e813c tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:45.870692 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-76ac38b7-bd54-4377-a30b-9c0c9b9e813c tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:45.871179 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-76ac38b7-bd54-4377-a30b-9c0c9b9e813c tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:46.061035 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-76ac38b7-bd54-4377-a30b-9c0c9b9e813c tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:46.090385 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-76ac38b7-bd54-4377-a30b-9c0c9b9e813c tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:46.092196 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-76ac38b7-bd54-4377-a30b-9c0c9b9e813c tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:46.093576 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-76ac38b7-bd54-4377-a30b-9c0c9b9e813c tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d" status: 200 len: 1720 microversion: 2.20 time: 0.238500 Aug 27 03:12:46.094601 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2693/5348] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:12:45 2022] GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d => generated 1720 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:12:46.859271 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6fc59c95-351b-446d-a896-e24fc8649f17 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:46.859845 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-6fc59c95-351b-446d-a896-e24fc8649f17 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 3ae351e6-e583-4f93-bdae-771141c96703] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:46.867787 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6fc59c95-351b-446d-a896-e24fc8649f17 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:46.868570 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6fc59c95-351b-446d-a896-e24fc8649f17 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:46.869008 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6fc59c95-351b-446d-a896-e24fc8649f17 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:46.869706 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6fc59c95-351b-446d-a896-e24fc8649f17 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:46.870305 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6fc59c95-351b-446d-a896-e24fc8649f17 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:46.870886 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6fc59c95-351b-446d-a896-e24fc8649f17 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:47.026706 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-6fc59c95-351b-446d-a896-e24fc8649f17 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a549f85910184bf7a697cce7fa3dff96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92af206e05f44cf948b7c25d1acc139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:47.035612 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-6fc59c95-351b-446d-a896-e24fc8649f17 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "GET /compute/v2.1/servers/3ae351e6-e583-4f93-bdae-771141c96703" status: 200 len: 1679 microversion: 2.1 time: 0.180547 Aug 27 03:12:47.036207 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2656/5349] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:46 2022] GET /compute/v2.1/servers/3ae351e6-e583-4f93-bdae-771141c96703 => generated 1679 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:47.117888 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f7f11501-cb62-4544-b321-b60a5ba0dd13 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:47.118692 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-f7f11501-cb62-4544-b321-b60a5ba0dd13 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 7e810377-eeef-436c-8fab-69fa71243a9d] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:47.126353 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f7f11501-cb62-4544-b321-b60a5ba0dd13 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:47.126832 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f7f11501-cb62-4544-b321-b60a5ba0dd13 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:47.127271 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f7f11501-cb62-4544-b321-b60a5ba0dd13 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:47.127973 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f7f11501-cb62-4544-b321-b60a5ba0dd13 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:47.128466 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f7f11501-cb62-4544-b321-b60a5ba0dd13 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:47.128905 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f7f11501-cb62-4544-b321-b60a5ba0dd13 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:47.330750 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-f7f11501-cb62-4544-b321-b60a5ba0dd13 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:47.339528 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-f7f11501-cb62-4544-b321-b60a5ba0dd13 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:47.341314 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-f7f11501-cb62-4544-b321-b60a5ba0dd13 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:47.342491 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-f7f11501-cb62-4544-b321-b60a5ba0dd13 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d" status: 200 len: 1720 microversion: 2.20 time: 0.229461 Aug 27 03:12:47.343058 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2694/5350] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:12:47 2022] GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d => generated 1720 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:12:48.057534 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-1045a0d8-51a0-4d4e-baac-60cc97200892 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:48.059101 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-1045a0d8-51a0-4d4e-baac-60cc97200892 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 3ae351e6-e583-4f93-bdae-771141c96703] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:48.069178 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1045a0d8-51a0-4d4e-baac-60cc97200892 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:48.069872 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1045a0d8-51a0-4d4e-baac-60cc97200892 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:48.070485 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1045a0d8-51a0-4d4e-baac-60cc97200892 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:48.071388 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1045a0d8-51a0-4d4e-baac-60cc97200892 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:48.071991 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1045a0d8-51a0-4d4e-baac-60cc97200892 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:48.072645 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1045a0d8-51a0-4d4e-baac-60cc97200892 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:48.154252 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-1045a0d8-51a0-4d4e-baac-60cc97200892 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a549f85910184bf7a697cce7fa3dff96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92af206e05f44cf948b7c25d1acc139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:48.176366 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-1045a0d8-51a0-4d4e-baac-60cc97200892 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "GET /compute/v2.1/servers/3ae351e6-e583-4f93-bdae-771141c96703" status: 200 len: 1612 microversion: 2.1 time: 0.122759 Aug 27 03:12:48.188360 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2657/5351] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:48 2022] GET /compute/v2.1/servers/3ae351e6-e583-4f93-bdae-771141c96703 => generated 1612 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:48.225199 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-a32aa3e6-aa5e-44f9-b7fd-2c9402382e02 req-bb3007ca-f8d6-4dca-9a76-e655e498c1eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ae351e6-e583-4f93-bdae-771141c96703", "name": "network-vif-deleted", "tag": "dea2772d-a5ac-4f5e-91a4-f6586f7f18e8"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:12:48.255164 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-a32aa3e6-aa5e-44f9-b7fd-2c9402382e02 req-bb3007ca-f8d6-4dca-9a76-e655e498c1eb service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:48.256749 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-a32aa3e6-aa5e-44f9-b7fd-2c9402382e02 req-bb3007ca-f8d6-4dca-9a76-e655e498c1eb service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:48.257411 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-a32aa3e6-aa5e-44f9-b7fd-2c9402382e02 req-bb3007ca-f8d6-4dca-9a76-e655e498c1eb service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:48.288071 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:12:48.291814 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-a32aa3e6-aa5e-44f9-b7fd-2c9402382e02 req-bb3007ca-f8d6-4dca-9a76-e655e498c1eb service nova] Creating event network-vif-deleted:dea2772d-a5ac-4f5e-91a4-f6586f7f18e8 for instance 3ae351e6-e583-4f93-bdae-771141c96703 on n-h1-852278-4 Aug 27 03:12:48.299413 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-a32aa3e6-aa5e-44f9-b7fd-2c9402382e02 req-bb3007ca-f8d6-4dca-9a76-e655e498c1eb service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078082 Aug 27 03:12:48.300945 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2695/5352] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:12:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:12:48.366750 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4acf0cce-fb1c-4433-b430-194ff009689b tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:48.367650 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-4acf0cce-fb1c-4433-b430-194ff009689b tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 7e810377-eeef-436c-8fab-69fa71243a9d] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:48.374404 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4acf0cce-fb1c-4433-b430-194ff009689b tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:48.375172 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4acf0cce-fb1c-4433-b430-194ff009689b tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:48.375617 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4acf0cce-fb1c-4433-b430-194ff009689b tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:48.376353 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4acf0cce-fb1c-4433-b430-194ff009689b tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:48.376798 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4acf0cce-fb1c-4433-b430-194ff009689b tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:48.377222 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4acf0cce-fb1c-4433-b430-194ff009689b tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:48.515896 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-4acf0cce-fb1c-4433-b430-194ff009689b tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:48.527700 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-4acf0cce-fb1c-4433-b430-194ff009689b tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:48.529697 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-4acf0cce-fb1c-4433-b430-194ff009689b tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:48.531214 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-4acf0cce-fb1c-4433-b430-194ff009689b tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d" status: 200 len: 1720 microversion: 2.20 time: 0.168697 Aug 27 03:12:48.531937 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2658/5353] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:12:48 2022] GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d => generated 1720 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:12:49.199429 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f102111b-e74f-4d2c-a9b5-3c462adf998a tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:49.200131 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-f102111b-e74f-4d2c-a9b5-3c462adf998a tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 3ae351e6-e583-4f93-bdae-771141c96703] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:49.209102 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f102111b-e74f-4d2c-a9b5-3c462adf998a tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:49.209593 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f102111b-e74f-4d2c-a9b5-3c462adf998a tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:49.210030 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f102111b-e74f-4d2c-a9b5-3c462adf998a tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:49.210909 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f102111b-e74f-4d2c-a9b5-3c462adf998a tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:49.211401 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f102111b-e74f-4d2c-a9b5-3c462adf998a tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:49.211826 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f102111b-e74f-4d2c-a9b5-3c462adf998a tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:49.251269 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f102111b-e74f-4d2c-a9b5-3c462adf998a tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:49.252465 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f102111b-e74f-4d2c-a9b5-3c462adf998a tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:49.253066 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f102111b-e74f-4d2c-a9b5-3c462adf998a tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:49.253529 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.objects.instance [None req-f102111b-e74f-4d2c-a9b5-3c462adf998a tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lazy-loading 'fault' on Instance uuid 3ae351e6-e583-4f93-bdae-771141c96703 {{(pid=134051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:12:49.301372 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-f102111b-e74f-4d2c-a9b5-3c462adf998a tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a549f85910184bf7a697cce7fa3dff96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92af206e05f44cf948b7c25d1acc139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:49.310345 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-f102111b-e74f-4d2c-a9b5-3c462adf998a tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "GET /compute/v2.1/servers/3ae351e6-e583-4f93-bdae-771141c96703" status: 200 len: 1331 microversion: 2.1 time: 0.115394 Aug 27 03:12:49.311251 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2696/5354] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:49 2022] GET /compute/v2.1/servers/3ae351e6-e583-4f93-bdae-771141c96703 => generated 1331 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:49.555492 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-bac01d88-64e6-408f-aa4a-178a1d499865 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:49.556119 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-bac01d88-64e6-408f-aa4a-178a1d499865 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 7e810377-eeef-436c-8fab-69fa71243a9d] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:49.585050 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bac01d88-64e6-408f-aa4a-178a1d499865 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:49.585559 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bac01d88-64e6-408f-aa4a-178a1d499865 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:49.586001 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bac01d88-64e6-408f-aa4a-178a1d499865 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:49.586729 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bac01d88-64e6-408f-aa4a-178a1d499865 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:49.587210 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bac01d88-64e6-408f-aa4a-178a1d499865 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:49.587638 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bac01d88-64e6-408f-aa4a-178a1d499865 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:49.608018 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-ed28250a-fe67-4394-ad81-10ab3b13c5ac req-d1d87353-c74a-467f-b0b8-53a47c80d327 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e810377-eeef-436c-8fab-69fa71243a9d", "name": "network-vif-unplugged", "status": "completed", "tag": "2c3d5445-7fe3-4101-9cf9-d7b63e882f1e"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:12:49.617936 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-ed28250a-fe67-4394-ad81-10ab3b13c5ac req-d1d87353-c74a-467f-b0b8-53a47c80d327 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:49.619290 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-ed28250a-fe67-4394-ad81-10ab3b13c5ac req-d1d87353-c74a-467f-b0b8-53a47c80d327 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:49.619994 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-ed28250a-fe67-4394-ad81-10ab3b13c5ac req-d1d87353-c74a-467f-b0b8-53a47c80d327 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:49.637995 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-ed28250a-fe67-4394-ad81-10ab3b13c5ac req-d1d87353-c74a-467f-b0b8-53a47c80d327 service nova] Creating event network-vif-unplugged:2c3d5445-7fe3-4101-9cf9-d7b63e882f1e for instance 7e810377-eeef-436c-8fab-69fa71243a9d on n-h1-852278-4 Aug 27 03:12:49.681414 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-ed28250a-fe67-4394-ad81-10ab3b13c5ac req-d1d87353-c74a-467f-b0b8-53a47c80d327 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.062000 Aug 27 03:12:49.682501 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2697/5355] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:12:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:12:49.767676 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-bac01d88-64e6-408f-aa4a-178a1d499865 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:49.784938 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-bac01d88-64e6-408f-aa4a-178a1d499865 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:49.786855 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-bac01d88-64e6-408f-aa4a-178a1d499865 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:49.788102 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-bac01d88-64e6-408f-aa4a-178a1d499865 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d" status: 200 len: 1723 microversion: 2.20 time: 0.236804 Aug 27 03:12:49.789415 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2659/5356] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:12:49 2022] GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d => generated 1723 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:12:49.815656 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3f6e3211-b283-4d14-a8d4-a02913b01e7d tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ea85d8c9-7ba6-4953-ad4a-1feade77824c"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:12:49.818245 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-3f6e3211-b283-4d14-a8d4-a02913b01e7d tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 7e810377-eeef-436c-8fab-69fa71243a9d] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:49.830126 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3f6e3211-b283-4d14-a8d4-a02913b01e7d tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:49.830623 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3f6e3211-b283-4d14-a8d4-a02913b01e7d tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:49.831144 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3f6e3211-b283-4d14-a8d4-a02913b01e7d tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:49.831982 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3f6e3211-b283-4d14-a8d4-a02913b01e7d tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:49.832660 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3f6e3211-b283-4d14-a8d4-a02913b01e7d tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:49.833390 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3f6e3211-b283-4d14-a8d4-a02913b01e7d tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:50.128689 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-3f6e3211-b283-4d14-a8d4-a02913b01e7d tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "POST /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.318049 Aug 27 03:12:50.129622 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2698/5357] 10.222.0.70 () {62 vars in 1364 bytes} [Sat Aug 27 03:12:49 2022] POST /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d/os-volume_attachments => generated 188 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:12:50.266188 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-113e3299-f2f5-431d-8446-b65e385ca866 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:50.266696 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-113e3299-f2f5-431d-8446-b65e385ca866 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 7e810377-eeef-436c-8fab-69fa71243a9d] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:50.277122 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-113e3299-f2f5-431d-8446-b65e385ca866 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:50.277549 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-113e3299-f2f5-431d-8446-b65e385ca866 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:50.277974 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-113e3299-f2f5-431d-8446-b65e385ca866 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:50.278748 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-113e3299-f2f5-431d-8446-b65e385ca866 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:50.279227 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-113e3299-f2f5-431d-8446-b65e385ca866 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:50.279739 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-113e3299-f2f5-431d-8446-b65e385ca866 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:50.332910 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-9f07050a-f023-4be0-b429-d8c2b082f45c tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:50.334325 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-9f07050a-f023-4be0-b429-d8c2b082f45c tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 3ae351e6-e583-4f93-bdae-771141c96703] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:50.353504 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9f07050a-f023-4be0-b429-d8c2b082f45c tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:50.354000 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9f07050a-f023-4be0-b429-d8c2b082f45c tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:50.354718 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9f07050a-f023-4be0-b429-d8c2b082f45c tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:50.355882 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9f07050a-f023-4be0-b429-d8c2b082f45c tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:50.356633 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9f07050a-f023-4be0-b429-d8c2b082f45c tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:50.358358 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9f07050a-f023-4be0-b429-d8c2b082f45c tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:50.378299 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-9f07050a-f023-4be0-b429-d8c2b082f45c tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] HTTP exception thrown: Instance 3ae351e6-e583-4f93-bdae-771141c96703 could not be found. Aug 27 03:12:50.380073 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-9f07050a-f023-4be0-b429-d8c2b082f45c tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Request method failure captured: Aug 27 03:12:50.380073 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/3ae351e6-e583-4f93-bdae-771141c96703 HTTP/1.1 Aug 27 03:12:50.380073 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 03:12:50.380073 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 03:12:50.380073 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 03:12:50.380073 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 03:12:50.380073 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 03:12:50.380073 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 03:12:50.380073 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 03:12:50.380073 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 03:12:50.380073 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYq440P3xsAabxN7nGlE2F1Ccxicf_9DU586MSNagRbCITstsgHyyHbnbZoUsiVfiyCUhE6F_2SvHrXIrDKvSEnzb0XjME8fkYvCR9LlCkoQHUfv6A1aESh1h-tIQR1qbnjbVFsJiiWy_WcC2U4qzkQvsEYcwujqY5DDaX4NjUQt4DA Aug 27 03:12:50.380073 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 03:12:50.380073 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 03:12:50.380073 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 03:12:50.380073 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 03:12:50.380073 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 03:12:50.380073 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 03:12:50.380073 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: b92af206e05f44cf948b7c25d1acc139 Aug 27 03:12:50.380073 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-AttachVolumeNegativeTest-878461886 Aug 27 03:12:50.380073 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 03:12:50.380073 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 03:12:50.380073 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b92af206e05f44cf948b7c25d1acc139"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_b92af206e05f44cf948b7c25d1acc139", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b92af206e05f44cf948b7c25d1acc139"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/b92af206e05f44cf948b7c25d1acc139"}]}] Aug 27 03:12:50.380073 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-AttachVolumeNegativeTest-878461886 Aug 27 03:12:50.380073 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: b92af206e05f44cf948b7c25d1acc139 Aug 27 03:12:50.380073 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-878461886 Aug 27 03:12:50.380073 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-AttachVolumeNegativeTest-878461886-project Aug 27 03:12:50.380073 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 03:12:50.380073 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 03:12:50.380073 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: a549f85910184bf7a697cce7fa3dff96 Aug 27 03:12:50.380073 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-AttachVolumeNegativeTest-878461886-project Aug 27 03:12:50.380073 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 03:12:50.380073 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance 3ae351e6-e583-4f93-bdae-771141c96703 could not be found. Aug 27 03:12:50.380073 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '3ae351e6-e583-4f93-bdae-771141c96703'} Aug 27 03:12:50.380073 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:12:50.380073 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:12:50.380073 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:12:50.380073 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:12:50.380073 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:12:50.380073 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:12:50.380073 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:12:50.380073 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:12:50.380073 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:12:50.380073 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:12:50.380073 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ae351e6-e583-4f93-bdae-771141c96703 could not be found. Aug 27 03:12:50.380073 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:12:50.380073 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:12:50.380073 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:12:50.380073 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:12:50.380073 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:12:50.380073 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:12:50.380073 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:12:50.380073 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:12:50.380073 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:12:50.380073 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:12:50.380073 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:12:50.380073 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:12:50.380073 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:12:50.380073 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:12:50.380073 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:12:50.380073 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:12:50.380073 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ae351e6-e583-4f93-bdae-771141c96703 could not be found. Aug 27 03:12:50.380073 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:12:50.380073 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:12:50.380073 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:12:50.384612 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:12:50.384612 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:12:50.384612 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:12:50.384612 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:12:50.384612 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:12:50.384612 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ae351e6-e583-4f93-bdae-771141c96703 could not be found. Aug 27 03:12:50.384612 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:12:50.384612 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-9f07050a-f023-4be0-b429-d8c2b082f45c tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Returning 404 to user: Instance 3ae351e6-e583-4f93-bdae-771141c96703 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:12:50.384612 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-9f07050a-f023-4be0-b429-d8c2b082f45c tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "GET /compute/v2.1/servers/3ae351e6-e583-4f93-bdae-771141c96703" status: 404 len: 111 microversion: 2.1 time: 0.053976 Aug 27 03:12:50.384612 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2699/5358] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:50 2022] GET /compute/v2.1/servers/3ae351e6-e583-4f93-bdae-771141c96703 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 03:12:50.390847 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-49d38237-1b63-4a77-94bc-443678980010 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '.version_select at 0x7f5eddb234c0>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:50.411544 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-49d38237-1b63-4a77-94bc-443678980010 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2032077909" status: 202 len: 0 microversion: 2.1 time: 0.024803 Aug 27 03:12:50.412354 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2700/5359] 10.222.0.70 () {58 vars in 1221 bytes} [Sat Aug 27 03:12:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2032077909 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 03:12:50.564614 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-113e3299-f2f5-431d-8446-b65e385ca866 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "DELETE /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d/os-volume_attachments/ea85d8c9-7ba6-4953-ad4a-1feade77824c" status: 202 len: 0 microversion: 2.20 time: 0.302262 Aug 27 03:12:50.565609 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2660/5360] 10.222.0.70 () {60 vars in 1457 bytes} [Sat Aug 27 03:12:50 2022] DELETE /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d/os-volume_attachments/ea85d8c9-7ba6-4953-ad4a-1feade77824c => generated 0 bytes in 305 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:12:50.652192 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-002f39e5-473c-4df3-a756-5d46633af8ce tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:12:50.652888 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-002f39e5-473c-4df3-a756-5d46633af8ce tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 7e810377-eeef-436c-8fab-69fa71243a9d] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:50.668978 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-002f39e5-473c-4df3-a756-5d46633af8ce tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:50.669572 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-002f39e5-473c-4df3-a756-5d46633af8ce tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:50.670023 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-002f39e5-473c-4df3-a756-5d46633af8ce tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:50.670762 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-002f39e5-473c-4df3-a756-5d46633af8ce tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:50.671215 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-002f39e5-473c-4df3-a756-5d46633af8ce tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:50.671644 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-002f39e5-473c-4df3-a756-5d46633af8ce tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:50.706770 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-002f39e5-473c-4df3-a756-5d46633af8ce tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 7e810377-eeef-436c-8fab-69fa71243a9d] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=134051) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 27 03:12:50.778316 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-002f39e5-473c-4df3-a756-5d46633af8ce tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "POST /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d/action" status: 202 len: 0 microversion: 2.20 time: 0.130062 Aug 27 03:12:50.779216 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2701/5361] 10.222.0.70 () {62 vars in 1319 bytes} [Sat Aug 27 03:12:50 2022] POST /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:12:50.787408 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f94475db-f008-4e65-8e47-3990d415ded3 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:50.788015 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-f94475db-f008-4e65-8e47-3990d415ded3 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 7e810377-eeef-436c-8fab-69fa71243a9d] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:50.794289 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f94475db-f008-4e65-8e47-3990d415ded3 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:50.794775 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f94475db-f008-4e65-8e47-3990d415ded3 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:50.795203 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f94475db-f008-4e65-8e47-3990d415ded3 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:50.796629 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f94475db-f008-4e65-8e47-3990d415ded3 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:50.796629 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f94475db-f008-4e65-8e47-3990d415ded3 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:50.796942 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f94475db-f008-4e65-8e47-3990d415ded3 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:50.963181 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-f94475db-f008-4e65-8e47-3990d415ded3 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:50.972546 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-f94475db-f008-4e65-8e47-3990d415ded3 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:50.974546 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-f94475db-f008-4e65-8e47-3990d415ded3 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:50.977445 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f94475db-f008-4e65-8e47-3990d415ded3 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d" status: 200 len: 1671 microversion: 2.20 time: 0.193866 Aug 27 03:12:50.979202 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2661/5362] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:12:50 2022] GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d => generated 1671 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:12:51.570908 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-246c086c-a3c8-447b-83a8-1fb67e051253 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Action: 'create', calling method: .version_select at 0x7f5edf511280>, body: {"keypair": {"name": "tempest-keypair-582734471", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEUxOr2tkL7WpBH16WI+Ks9Yle105i1Z/qpEnsAlkSFyZrxyzt3n3l+0RBkAhwp3y22VmrunxSqgYhfRZ4GgsGSQAWLDSVhDdGM1MLjoDHgmtt5ZMA0u0LclglZRKEQ9+A=="}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:12:51.590166 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-246c086c-a3c8-447b-83a8-1fb67e051253 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Getting quotas for project b92af206e05f44cf948b7c25d1acc139. Resources: {'key_pairs'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:12:51.595773 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-246c086c-a3c8-447b-83a8-1fb67e051253 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Getting quotas for user a549f85910184bf7a697cce7fa3dff96 and project b92af206e05f44cf948b7c25d1acc139. Resources: {'key_pairs'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:12:51.623184 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-246c086c-a3c8-447b-83a8-1fb67e051253 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.059948 Aug 27 03:12:51.624534 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2702/5363] 10.222.0.70 () {60 vars in 1159 bytes} [Sat Aug 27 03:12:51 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:12:52.001059 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-aa0026c2-1dd7-4236-ac75-a576c97fc3f2 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:52.001660 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-aa0026c2-1dd7-4236-ac75-a576c97fc3f2 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 7e810377-eeef-436c-8fab-69fa71243a9d] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:52.026658 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-aa0026c2-1dd7-4236-ac75-a576c97fc3f2 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:52.027153 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-aa0026c2-1dd7-4236-ac75-a576c97fc3f2 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:52.027589 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-aa0026c2-1dd7-4236-ac75-a576c97fc3f2 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:52.028299 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-aa0026c2-1dd7-4236-ac75-a576c97fc3f2 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:52.029032 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-aa0026c2-1dd7-4236-ac75-a576c97fc3f2 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:52.029389 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-aa0026c2-1dd7-4236-ac75-a576c97fc3f2 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:52.254334 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-aa0026c2-1dd7-4236-ac75-a576c97fc3f2 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:52.265290 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-aa0026c2-1dd7-4236-ac75-a576c97fc3f2 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:52.266752 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-aa0026c2-1dd7-4236-ac75-a576c97fc3f2 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:52.270739 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-aa0026c2-1dd7-4236-ac75-a576c97fc3f2 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d" status: 200 len: 1671 microversion: 2.20 time: 0.271798 Aug 27 03:12:52.274871 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2662/5364] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:12:51 2022] GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d => generated 1671 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:12:53.295924 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b28cac8e-c1df-4cca-bf9f-2ff25259b11e tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:53.297183 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b28cac8e-c1df-4cca-bf9f-2ff25259b11e tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 7e810377-eeef-436c-8fab-69fa71243a9d] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:53.310052 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b28cac8e-c1df-4cca-bf9f-2ff25259b11e tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:53.310804 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b28cac8e-c1df-4cca-bf9f-2ff25259b11e tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:53.311402 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b28cac8e-c1df-4cca-bf9f-2ff25259b11e tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:53.315588 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b28cac8e-c1df-4cca-bf9f-2ff25259b11e tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:53.316232 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b28cac8e-c1df-4cca-bf9f-2ff25259b11e tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:53.316872 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b28cac8e-c1df-4cca-bf9f-2ff25259b11e tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:53.573103 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-b28cac8e-c1df-4cca-bf9f-2ff25259b11e tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:53.593721 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-b28cac8e-c1df-4cca-bf9f-2ff25259b11e tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:53.595778 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-b28cac8e-c1df-4cca-bf9f-2ff25259b11e tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:53.597698 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b28cac8e-c1df-4cca-bf9f-2ff25259b11e tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d" status: 200 len: 1729 microversion: 2.20 time: 0.305445 Aug 27 03:12:53.598945 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2703/5365] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:12:53 2022] GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d => generated 1729 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:12:54.099503 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a3a11ec1-2c03-4b3a-ae48-8e05347f66f3 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1802002708", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a7b97b39-d409-4ab1-957a-8381e0b7ec94"}], "security_groups": [{"name": "tempest-securitygroup--1707339419"}], "key_name": "tempest-keypair-582734471", "user_data": "}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:12:54.254345 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.network.neutron [None req-a3a11ec1-2c03-4b3a-ae48-8e05347f66f3 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] validate_networks() for [('a7b97b39-d409-4ab1-957a-8381e0b7ec94', None, None, None, None, None)] {{(pid=134052) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:12:54.671006 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-dca6a3a6-aa13-4ee5-b09f-14c2e8353c0f tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:54.673621 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-dca6a3a6-aa13-4ee5-b09f-14c2e8353c0f tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 7e810377-eeef-436c-8fab-69fa71243a9d] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:54.724466 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dca6a3a6-aa13-4ee5-b09f-14c2e8353c0f tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:54.752828 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dca6a3a6-aa13-4ee5-b09f-14c2e8353c0f tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:54.753979 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dca6a3a6-aa13-4ee5-b09f-14c2e8353c0f tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:54.760392 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dca6a3a6-aa13-4ee5-b09f-14c2e8353c0f tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:54.761814 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dca6a3a6-aa13-4ee5-b09f-14c2e8353c0f tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:54.763610 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dca6a3a6-aa13-4ee5-b09f-14c2e8353c0f tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:55.314642 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-dca6a3a6-aa13-4ee5-b09f-14c2e8353c0f tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:55.316721 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-a3a11ec1-2c03-4b3a-ae48-8e05347f66f3 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Flavor limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:12:55.321117 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-a3a11ec1-2c03-4b3a-ae48-8e05347f66f3 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Image limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:12:55.323259 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-a3a11ec1-2c03-4b3a-ae48-8e05347f66f3 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Flavor pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:12:55.325195 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-a3a11ec1-2c03-4b3a-ae48-8e05347f66f3 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Image pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:12:55.326741 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-dca6a3a6-aa13-4ee5-b09f-14c2e8353c0f tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:55.327153 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-a3a11ec1-2c03-4b3a-ae48-8e05347f66f3 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:12:55.328803 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-dca6a3a6-aa13-4ee5-b09f-14c2e8353c0f tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:55.330286 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-dca6a3a6-aa13-4ee5-b09f-14c2e8353c0f tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d" status: 200 len: 1729 microversion: 2.20 time: 0.709475 Aug 27 03:12:55.344834 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2704/5366] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:12:54 2022] GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d => generated 1729 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:12:55.357047 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a3a11ec1-2c03-4b3a-ae48-8e05347f66f3 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:55.364050 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a3a11ec1-2c03-4b3a-ae48-8e05347f66f3 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:55.366134 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a3a11ec1-2c03-4b3a-ae48-8e05347f66f3 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:55.368196 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a3a11ec1-2c03-4b3a-ae48-8e05347f66f3 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:55.369038 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a3a11ec1-2c03-4b3a-ae48-8e05347f66f3 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:55.370460 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a3a11ec1-2c03-4b3a-ae48-8e05347f66f3 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:55.395231 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-a3a11ec1-2c03-4b3a-ae48-8e05347f66f3 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Getting quotas for project b92af206e05f44cf948b7c25d1acc139. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:12:55.401967 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-a3a11ec1-2c03-4b3a-ae48-8e05347f66f3 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Getting quotas for user a549f85910184bf7a697cce7fa3dff96 and project b92af206e05f44cf948b7c25d1acc139. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:12:55.443822 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a3a11ec1-2c03-4b3a-ae48-8e05347f66f3 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Going to run 1 instances... {{(pid=134052) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:12:55.450937 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a3a11ec1-2c03-4b3a-ae48-8e05347f66f3 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 0c24d379-bb60-46d3-8f49-1c3310a970fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134052) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:12:55.550477 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a3a11ec1-2c03-4b3a-ae48-8e05347f66f3 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.454568 Aug 27 03:12:55.553737 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2663/5367] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 03:12:54 2022] POST /compute/v2.1/servers => generated 402 bytes in 1459 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:12:55.565994 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3e4e354e-c637-46b9-89d9-542660a63501 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:55.567318 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-3e4e354e-c637-46b9-89d9-542660a63501 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 0c24d379-bb60-46d3-8f49-1c3310a970fc] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:55.649296 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-3e4e354e-c637-46b9-89d9-542660a63501 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a549f85910184bf7a697cce7fa3dff96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92af206e05f44cf948b7c25d1acc139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:55.659801 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-3e4e354e-c637-46b9-89d9-542660a63501 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "GET /compute/v2.1/servers/0c24d379-bb60-46d3-8f49-1c3310a970fc" status: 200 len: 1241 microversion: 2.1 time: 0.098116 Aug 27 03:12:55.661279 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2705/5368] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:55 2022] GET /compute/v2.1/servers/0c24d379-bb60-46d3-8f49-1c3310a970fc => generated 1241 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:56.356482 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f2ee8029-a15e-4b8a-854a-91bae201ad07 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:56.357826 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-f2ee8029-a15e-4b8a-854a-91bae201ad07 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 7e810377-eeef-436c-8fab-69fa71243a9d] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:56.380253 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f2ee8029-a15e-4b8a-854a-91bae201ad07 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:56.383807 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f2ee8029-a15e-4b8a-854a-91bae201ad07 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:56.385283 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f2ee8029-a15e-4b8a-854a-91bae201ad07 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:56.388799 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f2ee8029-a15e-4b8a-854a-91bae201ad07 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:56.390011 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f2ee8029-a15e-4b8a-854a-91bae201ad07 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:56.391419 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f2ee8029-a15e-4b8a-854a-91bae201ad07 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:56.683982 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-1ff71a72-af4f-4c8b-8f82-aa4ce50ab533 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:56.685831 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-1ff71a72-af4f-4c8b-8f82-aa4ce50ab533 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 0c24d379-bb60-46d3-8f49-1c3310a970fc] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:56.704693 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1ff71a72-af4f-4c8b-8f82-aa4ce50ab533 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:56.708295 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1ff71a72-af4f-4c8b-8f82-aa4ce50ab533 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:56.708883 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1ff71a72-af4f-4c8b-8f82-aa4ce50ab533 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:56.710103 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1ff71a72-af4f-4c8b-8f82-aa4ce50ab533 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:56.710666 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1ff71a72-af4f-4c8b-8f82-aa4ce50ab533 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:56.711249 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1ff71a72-af4f-4c8b-8f82-aa4ce50ab533 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:56.938944 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-1ff71a72-af4f-4c8b-8f82-aa4ce50ab533 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a549f85910184bf7a697cce7fa3dff96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92af206e05f44cf948b7c25d1acc139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:56.947796 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-1ff71a72-af4f-4c8b-8f82-aa4ce50ab533 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "GET /compute/v2.1/servers/0c24d379-bb60-46d3-8f49-1c3310a970fc" status: 200 len: 1245 microversion: 2.1 time: 0.269543 Aug 27 03:12:56.966318 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-f2ee8029-a15e-4b8a-854a-91bae201ad07 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:56.972490 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2706/5369] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:56 2022] GET /compute/v2.1/servers/0c24d379-bb60-46d3-8f49-1c3310a970fc => generated 1245 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:56.985097 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-f2ee8029-a15e-4b8a-854a-91bae201ad07 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:56.987170 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-f2ee8029-a15e-4b8a-854a-91bae201ad07 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:56.988789 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f2ee8029-a15e-4b8a-854a-91bae201ad07 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d" status: 200 len: 1729 microversion: 2.20 time: 0.637906 Aug 27 03:12:56.991168 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2664/5370] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:12:56 2022] GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d => generated 1729 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:12:57.982556 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4596f239-f7d4-4eb7-8512-63a13bcf7453 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:57.983172 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-4596f239-f7d4-4eb7-8512-63a13bcf7453 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 0c24d379-bb60-46d3-8f49-1c3310a970fc] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:58.000469 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4596f239-f7d4-4eb7-8512-63a13bcf7453 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:58.004894 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4596f239-f7d4-4eb7-8512-63a13bcf7453 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:58.005364 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4596f239-f7d4-4eb7-8512-63a13bcf7453 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:58.015289 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9401e635-60e4-4298-97cf-266da00f7b1c tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:58.015892 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-9401e635-60e4-4298-97cf-266da00f7b1c tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 7e810377-eeef-436c-8fab-69fa71243a9d] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:58.022172 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4596f239-f7d4-4eb7-8512-63a13bcf7453 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:58.024638 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4596f239-f7d4-4eb7-8512-63a13bcf7453 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:58.031909 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4596f239-f7d4-4eb7-8512-63a13bcf7453 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:58.040816 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9401e635-60e4-4298-97cf-266da00f7b1c tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:58.041322 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9401e635-60e4-4298-97cf-266da00f7b1c tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:58.041765 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9401e635-60e4-4298-97cf-266da00f7b1c tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:58.042494 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9401e635-60e4-4298-97cf-266da00f7b1c tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:58.042945 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9401e635-60e4-4298-97cf-266da00f7b1c tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:58.043368 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9401e635-60e4-4298-97cf-266da00f7b1c tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:58.419142 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-4596f239-f7d4-4eb7-8512-63a13bcf7453 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a549f85910184bf7a697cce7fa3dff96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92af206e05f44cf948b7c25d1acc139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:58.427985 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-4596f239-f7d4-4eb7-8512-63a13bcf7453 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "GET /compute/v2.1/servers/0c24d379-bb60-46d3-8f49-1c3310a970fc" status: 200 len: 1293 microversion: 2.1 time: 0.449552 Aug 27 03:12:58.428605 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2707/5371] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:57 2022] GET /compute/v2.1/servers/0c24d379-bb60-46d3-8f49-1c3310a970fc => generated 1293 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:58.603881 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-9401e635-60e4-4298-97cf-266da00f7b1c tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:58.617691 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-9401e635-60e4-4298-97cf-266da00f7b1c tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:58.619612 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-9401e635-60e4-4298-97cf-266da00f7b1c tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:58.621059 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9401e635-60e4-4298-97cf-266da00f7b1c tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d" status: 200 len: 1729 microversion: 2.20 time: 0.609808 Aug 27 03:12:58.641897 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2665/5372] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:12:58 2022] GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d => generated 1729 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:12:59.451358 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c92af700-70a2-4e36-8c15-f70939be70e2 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:59.457025 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-c92af700-70a2-4e36-8c15-f70939be70e2 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 0c24d379-bb60-46d3-8f49-1c3310a970fc] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:59.474206 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c92af700-70a2-4e36-8c15-f70939be70e2 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:59.477546 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c92af700-70a2-4e36-8c15-f70939be70e2 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:59.482512 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c92af700-70a2-4e36-8c15-f70939be70e2 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:59.485348 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c92af700-70a2-4e36-8c15-f70939be70e2 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:59.496393 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c92af700-70a2-4e36-8c15-f70939be70e2 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:59.501417 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c92af700-70a2-4e36-8c15-f70939be70e2 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:59.649965 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d23c5380-8825-46ed-82bb-7f112d16c75b tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:59.651211 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d23c5380-8825-46ed-82bb-7f112d16c75b tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 7e810377-eeef-436c-8fab-69fa71243a9d] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:59.666785 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d23c5380-8825-46ed-82bb-7f112d16c75b tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:59.667294 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d23c5380-8825-46ed-82bb-7f112d16c75b tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:59.667737 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d23c5380-8825-46ed-82bb-7f112d16c75b tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:59.668504 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d23c5380-8825-46ed-82bb-7f112d16c75b tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:59.668960 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d23c5380-8825-46ed-82bb-7f112d16c75b tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:59.669391 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d23c5380-8825-46ed-82bb-7f112d16c75b tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:59.692639 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-c92af700-70a2-4e36-8c15-f70939be70e2 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a549f85910184bf7a697cce7fa3dff96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92af206e05f44cf948b7c25d1acc139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:59.706757 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c92af700-70a2-4e36-8c15-f70939be70e2 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "GET /compute/v2.1/servers/0c24d379-bb60-46d3-8f49-1c3310a970fc" status: 200 len: 1299 microversion: 2.1 time: 0.259950 Aug 27 03:12:59.712300 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2708/5373] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:59 2022] GET /compute/v2.1/servers/0c24d379-bb60-46d3-8f49-1c3310a970fc => generated 1299 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:00.142109 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-d23c5380-8825-46ed-82bb-7f112d16c75b tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:00.158471 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-d23c5380-8825-46ed-82bb-7f112d16c75b tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:00.160281 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-d23c5380-8825-46ed-82bb-7f112d16c75b tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:00.163168 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d23c5380-8825-46ed-82bb-7f112d16c75b tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d" status: 200 len: 1729 microversion: 2.20 time: 0.516223 Aug 27 03:13:00.186102 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2666/5374] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:12:59 2022] GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d => generated 1729 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:13:00.734712 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-83d8ca15-5467-4519-bbb6-2e1a54418be9 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:00.735339 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-83d8ca15-5467-4519-bbb6-2e1a54418be9 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 0c24d379-bb60-46d3-8f49-1c3310a970fc] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:00.772777 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-83d8ca15-5467-4519-bbb6-2e1a54418be9 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:00.773299 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-83d8ca15-5467-4519-bbb6-2e1a54418be9 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:00.773722 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-83d8ca15-5467-4519-bbb6-2e1a54418be9 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:00.774492 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-83d8ca15-5467-4519-bbb6-2e1a54418be9 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:00.774939 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-83d8ca15-5467-4519-bbb6-2e1a54418be9 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:00.775369 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-83d8ca15-5467-4519-bbb6-2e1a54418be9 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:01.118663 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-83d8ca15-5467-4519-bbb6-2e1a54418be9 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a549f85910184bf7a697cce7fa3dff96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92af206e05f44cf948b7c25d1acc139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:01.131110 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-83d8ca15-5467-4519-bbb6-2e1a54418be9 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "GET /compute/v2.1/servers/0c24d379-bb60-46d3-8f49-1c3310a970fc" status: 200 len: 1367 microversion: 2.1 time: 0.400343 Aug 27 03:13:01.131915 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2709/5375] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:00 2022] GET /compute/v2.1/servers/0c24d379-bb60-46d3-8f49-1c3310a970fc => generated 1367 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:01.194539 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-cf02118c-78c9-4db2-bfa1-b841b8e0fe91 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:01.196256 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-cf02118c-78c9-4db2-bfa1-b841b8e0fe91 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 7e810377-eeef-436c-8fab-69fa71243a9d] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:01.217596 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cf02118c-78c9-4db2-bfa1-b841b8e0fe91 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:01.223809 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cf02118c-78c9-4db2-bfa1-b841b8e0fe91 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:01.224276 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cf02118c-78c9-4db2-bfa1-b841b8e0fe91 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:01.233309 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cf02118c-78c9-4db2-bfa1-b841b8e0fe91 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:01.234038 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cf02118c-78c9-4db2-bfa1-b841b8e0fe91 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:01.234669 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cf02118c-78c9-4db2-bfa1-b841b8e0fe91 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:01.554653 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-cf02118c-78c9-4db2-bfa1-b841b8e0fe91 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:01.563929 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-cf02118c-78c9-4db2-bfa1-b841b8e0fe91 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:01.569178 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-cf02118c-78c9-4db2-bfa1-b841b8e0fe91 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:01.571508 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-cf02118c-78c9-4db2-bfa1-b841b8e0fe91 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d" status: 200 len: 1729 microversion: 2.20 time: 0.381742 Aug 27 03:13:01.580274 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2667/5376] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:13:01 2022] GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d => generated 1729 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:13:02.158851 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-102219a4-0e66-4713-8a04-372cf9c6bb53 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:02.162524 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-102219a4-0e66-4713-8a04-372cf9c6bb53 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 0c24d379-bb60-46d3-8f49-1c3310a970fc] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:02.176840 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-102219a4-0e66-4713-8a04-372cf9c6bb53 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:02.178617 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-102219a4-0e66-4713-8a04-372cf9c6bb53 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:02.181063 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-102219a4-0e66-4713-8a04-372cf9c6bb53 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:02.182192 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-102219a4-0e66-4713-8a04-372cf9c6bb53 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:02.184143 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-102219a4-0e66-4713-8a04-372cf9c6bb53 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:02.186223 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-102219a4-0e66-4713-8a04-372cf9c6bb53 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:02.590972 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-102219a4-0e66-4713-8a04-372cf9c6bb53 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a549f85910184bf7a697cce7fa3dff96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92af206e05f44cf948b7c25d1acc139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:02.599362 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-102219a4-0e66-4713-8a04-372cf9c6bb53 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "GET /compute/v2.1/servers/0c24d379-bb60-46d3-8f49-1c3310a970fc" status: 200 len: 1367 microversion: 2.1 time: 0.447380 Aug 27 03:13:02.601339 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2710/5377] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:02 2022] GET /compute/v2.1/servers/0c24d379-bb60-46d3-8f49-1c3310a970fc => generated 1367 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:02.606652 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a7caec67-ba7d-475c-957a-87df4fc1520f tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:02.607267 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a7caec67-ba7d-475c-957a-87df4fc1520f tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 7e810377-eeef-436c-8fab-69fa71243a9d] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:02.618333 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a7caec67-ba7d-475c-957a-87df4fc1520f tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:02.618826 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a7caec67-ba7d-475c-957a-87df4fc1520f tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:02.619262 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a7caec67-ba7d-475c-957a-87df4fc1520f tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:02.619986 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a7caec67-ba7d-475c-957a-87df4fc1520f tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:02.629369 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a7caec67-ba7d-475c-957a-87df4fc1520f tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:02.630143 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a7caec67-ba7d-475c-957a-87df4fc1520f tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:02.899414 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-a7caec67-ba7d-475c-957a-87df4fc1520f tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:02.910145 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-a7caec67-ba7d-475c-957a-87df4fc1520f tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:02.913526 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-a7caec67-ba7d-475c-957a-87df4fc1520f tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:02.917227 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-12032d19-a1fa-484f-83d1-7bf9fb8b02fa req-6e8e83af-223b-43b6-817e-0cb13f198420 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c24d379-bb60-46d3-8f49-1c3310a970fc", "tag": "69a75ca6-aed1-48db-afb8-a2896ce706c7"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:13:02.919326 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a7caec67-ba7d-475c-957a-87df4fc1520f tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d" status: 200 len: 1729 microversion: 2.20 time: 0.316648 Aug 27 03:13:02.924779 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2668/5378] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:13:02 2022] GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d => generated 1729 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:13:02.976563 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-12032d19-a1fa-484f-83d1-7bf9fb8b02fa req-6e8e83af-223b-43b6-817e-0cb13f198420 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:02.977264 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-12032d19-a1fa-484f-83d1-7bf9fb8b02fa req-6e8e83af-223b-43b6-817e-0cb13f198420 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:02.977917 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-12032d19-a1fa-484f-83d1-7bf9fb8b02fa req-6e8e83af-223b-43b6-817e-0cb13f198420 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:03.034482 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-12032d19-a1fa-484f-83d1-7bf9fb8b02fa req-6e8e83af-223b-43b6-817e-0cb13f198420 service nova] Creating event network-changed:69a75ca6-aed1-48db-afb8-a2896ce706c7 for instance 0c24d379-bb60-46d3-8f49-1c3310a970fc on n-h1-852278-4 Aug 27 03:13:03.048112 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-12032d19-a1fa-484f-83d1-7bf9fb8b02fa req-6e8e83af-223b-43b6-817e-0cb13f198420 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134432 Aug 27 03:13:03.049287 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2711/5379] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:13:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:13:03.629440 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-2a64221f-fe16-4532-8e57-afe115dd150e tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:03.630427 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-2a64221f-fe16-4532-8e57-afe115dd150e tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 0c24d379-bb60-46d3-8f49-1c3310a970fc] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:03.649215 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2a64221f-fe16-4532-8e57-afe115dd150e tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:03.653532 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2a64221f-fe16-4532-8e57-afe115dd150e tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:03.654313 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2a64221f-fe16-4532-8e57-afe115dd150e tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:03.658701 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2a64221f-fe16-4532-8e57-afe115dd150e tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:03.660258 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2a64221f-fe16-4532-8e57-afe115dd150e tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:03.662311 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2a64221f-fe16-4532-8e57-afe115dd150e tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:03.945274 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-580bcca4-0982-49ab-8bdd-42b9c1f1d69a tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:03.945971 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-580bcca4-0982-49ab-8bdd-42b9c1f1d69a tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 7e810377-eeef-436c-8fab-69fa71243a9d] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:03.972620 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-580bcca4-0982-49ab-8bdd-42b9c1f1d69a tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:03.973173 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-580bcca4-0982-49ab-8bdd-42b9c1f1d69a tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:03.974852 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-580bcca4-0982-49ab-8bdd-42b9c1f1d69a tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:03.975590 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-580bcca4-0982-49ab-8bdd-42b9c1f1d69a tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:03.980493 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-580bcca4-0982-49ab-8bdd-42b9c1f1d69a tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:03.982719 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-580bcca4-0982-49ab-8bdd-42b9c1f1d69a tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:03.992704 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-2a64221f-fe16-4532-8e57-afe115dd150e tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a549f85910184bf7a697cce7fa3dff96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92af206e05f44cf948b7c25d1acc139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:04.005895 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-2a64221f-fe16-4532-8e57-afe115dd150e tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "GET /compute/v2.1/servers/0c24d379-bb60-46d3-8f49-1c3310a970fc" status: 200 len: 1367 microversion: 2.1 time: 0.384040 Aug 27 03:13:04.019368 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2669/5380] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:03 2022] GET /compute/v2.1/servers/0c24d379-bb60-46d3-8f49-1c3310a970fc => generated 1367 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:04.263391 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-580bcca4-0982-49ab-8bdd-42b9c1f1d69a tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:04.272520 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-580bcca4-0982-49ab-8bdd-42b9c1f1d69a tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:04.275491 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-580bcca4-0982-49ab-8bdd-42b9c1f1d69a tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:04.276943 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-580bcca4-0982-49ab-8bdd-42b9c1f1d69a tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d" status: 200 len: 1729 microversion: 2.20 time: 0.337908 Aug 27 03:13:04.292779 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2712/5381] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:13:03 2022] GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d => generated 1729 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:13:05.027164 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-703ebb02-7ca2-4bcb-814f-343277eff2e3 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:05.027766 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-703ebb02-7ca2-4bcb-814f-343277eff2e3 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 0c24d379-bb60-46d3-8f49-1c3310a970fc] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:05.036379 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-703ebb02-7ca2-4bcb-814f-343277eff2e3 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:05.045207 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-703ebb02-7ca2-4bcb-814f-343277eff2e3 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:05.045696 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-703ebb02-7ca2-4bcb-814f-343277eff2e3 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:05.046576 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-703ebb02-7ca2-4bcb-814f-343277eff2e3 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:05.046891 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-703ebb02-7ca2-4bcb-814f-343277eff2e3 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:05.047313 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-703ebb02-7ca2-4bcb-814f-343277eff2e3 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:05.096279 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:13:05.225149 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-703ebb02-7ca2-4bcb-814f-343277eff2e3 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a549f85910184bf7a697cce7fa3dff96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92af206e05f44cf948b7c25d1acc139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:05.233911 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-703ebb02-7ca2-4bcb-814f-343277eff2e3 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "GET /compute/v2.1/servers/0c24d379-bb60-46d3-8f49-1c3310a970fc" status: 200 len: 1367 microversion: 2.1 time: 0.210828 Aug 27 03:13:05.240489 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2670/5382] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:05 2022] GET /compute/v2.1/servers/0c24d379-bb60-46d3-8f49-1c3310a970fc => generated 1367 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:05.301718 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-083762ed-9c4f-4a87-8259-806f0b20bac8 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:05.302726 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-083762ed-9c4f-4a87-8259-806f0b20bac8 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 7e810377-eeef-436c-8fab-69fa71243a9d] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:05.312628 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-083762ed-9c4f-4a87-8259-806f0b20bac8 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:05.313300 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-083762ed-9c4f-4a87-8259-806f0b20bac8 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:05.313886 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-083762ed-9c4f-4a87-8259-806f0b20bac8 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:05.315098 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-083762ed-9c4f-4a87-8259-806f0b20bac8 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:05.315670 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-083762ed-9c4f-4a87-8259-806f0b20bac8 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:05.316210 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-083762ed-9c4f-4a87-8259-806f0b20bac8 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:05.342848 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:13:05.554059 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-083762ed-9c4f-4a87-8259-806f0b20bac8 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:05.566836 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-083762ed-9c4f-4a87-8259-806f0b20bac8 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:05.577640 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-083762ed-9c4f-4a87-8259-806f0b20bac8 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:05.582502 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-083762ed-9c4f-4a87-8259-806f0b20bac8 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d" status: 200 len: 1729 microversion: 2.20 time: 0.284777 Aug 27 03:13:05.583304 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2713/5383] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:13:05 2022] GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d => generated 1729 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:13:06.261628 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-da4a8693-7175-4886-a2c7-76ef0336e0fe tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:06.262489 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-da4a8693-7175-4886-a2c7-76ef0336e0fe tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 0c24d379-bb60-46d3-8f49-1c3310a970fc] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:06.265717 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:13:06.266469 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=6 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:13:06.272358 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-da4a8693-7175-4886-a2c7-76ef0336e0fe tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:06.272992 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-da4a8693-7175-4886-a2c7-76ef0336e0fe tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:06.273542 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-da4a8693-7175-4886-a2c7-76ef0336e0fe tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:06.274430 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-da4a8693-7175-4886-a2c7-76ef0336e0fe tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:06.275039 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-da4a8693-7175-4886-a2c7-76ef0336e0fe tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:06.277049 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-da4a8693-7175-4886-a2c7-76ef0336e0fe tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:06.499228 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-da4a8693-7175-4886-a2c7-76ef0336e0fe tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a549f85910184bf7a697cce7fa3dff96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92af206e05f44cf948b7c25d1acc139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:06.507872 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-da4a8693-7175-4886-a2c7-76ef0336e0fe tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "GET /compute/v2.1/servers/0c24d379-bb60-46d3-8f49-1c3310a970fc" status: 200 len: 1367 microversion: 2.1 time: 0.250402 Aug 27 03:13:06.508663 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2671/5384] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:06 2022] GET /compute/v2.1/servers/0c24d379-bb60-46d3-8f49-1c3310a970fc => generated 1367 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:13:06.611294 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=6 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:13:06.738852 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3a394e93-2b79-48a8-a0f9-a20e463fb3b2 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:06.739642 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-3a394e93-2b79-48a8-a0f9-a20e463fb3b2 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 7e810377-eeef-436c-8fab-69fa71243a9d] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:06.746211 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3a394e93-2b79-48a8-a0f9-a20e463fb3b2 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:06.746777 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3a394e93-2b79-48a8-a0f9-a20e463fb3b2 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:06.747283 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3a394e93-2b79-48a8-a0f9-a20e463fb3b2 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:06.748058 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3a394e93-2b79-48a8-a0f9-a20e463fb3b2 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:06.748692 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3a394e93-2b79-48a8-a0f9-a20e463fb3b2 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:06.749183 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3a394e93-2b79-48a8-a0f9-a20e463fb3b2 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:06.891707 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-3a394e93-2b79-48a8-a0f9-a20e463fb3b2 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:06.913932 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-3a394e93-2b79-48a8-a0f9-a20e463fb3b2 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:06.916157 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-3a394e93-2b79-48a8-a0f9-a20e463fb3b2 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:06.922279 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-3a394e93-2b79-48a8-a0f9-a20e463fb3b2 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d" status: 200 len: 1729 microversion: 2.20 time: 0.312774 Aug 27 03:13:06.929962 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2714/5385] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:13:06 2022] GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d => generated 1729 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:13:07.535266 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9617620a-9d04-4083-a4ba-e14bdf06b5e6 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:07.537043 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-9617620a-9d04-4083-a4ba-e14bdf06b5e6 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 0c24d379-bb60-46d3-8f49-1c3310a970fc] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:07.547982 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:13:07.569210 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9617620a-9d04-4083-a4ba-e14bdf06b5e6 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:07.572746 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9617620a-9d04-4083-a4ba-e14bdf06b5e6 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:07.575062 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9617620a-9d04-4083-a4ba-e14bdf06b5e6 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:07.576026 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9617620a-9d04-4083-a4ba-e14bdf06b5e6 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:07.577364 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9617620a-9d04-4083-a4ba-e14bdf06b5e6 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:07.578946 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9617620a-9d04-4083-a4ba-e14bdf06b5e6 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:07.862945 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-9617620a-9d04-4083-a4ba-e14bdf06b5e6 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a549f85910184bf7a697cce7fa3dff96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92af206e05f44cf948b7c25d1acc139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:07.874698 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9617620a-9d04-4083-a4ba-e14bdf06b5e6 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "GET /compute/v2.1/servers/0c24d379-bb60-46d3-8f49-1c3310a970fc" status: 200 len: 1367 microversion: 2.1 time: 0.347643 Aug 27 03:13:07.884506 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2672/5386] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:07 2022] GET /compute/v2.1/servers/0c24d379-bb60-46d3-8f49-1c3310a970fc => generated 1367 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:07.948870 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-cf472935-f07f-4882-8d26-f6e4b3dee61c tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:07.949938 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-cf472935-f07f-4882-8d26-f6e4b3dee61c tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 7e810377-eeef-436c-8fab-69fa71243a9d] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:07.966594 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cf472935-f07f-4882-8d26-f6e4b3dee61c tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:07.967941 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cf472935-f07f-4882-8d26-f6e4b3dee61c tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:07.969256 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cf472935-f07f-4882-8d26-f6e4b3dee61c tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:07.970257 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cf472935-f07f-4882-8d26-f6e4b3dee61c tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:07.970822 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cf472935-f07f-4882-8d26-f6e4b3dee61c tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:07.971590 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cf472935-f07f-4882-8d26-f6e4b3dee61c tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:08.262436 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-cf472935-f07f-4882-8d26-f6e4b3dee61c tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:08.283924 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-cf472935-f07f-4882-8d26-f6e4b3dee61c tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:08.285199 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-cf472935-f07f-4882-8d26-f6e4b3dee61c tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:08.286502 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-cf472935-f07f-4882-8d26-f6e4b3dee61c tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d" status: 200 len: 1729 microversion: 2.20 time: 0.345821 Aug 27 03:13:08.301094 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2715/5387] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:13:07 2022] GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d => generated 1729 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:13:08.520413 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3e6bbd92-b2a5-4666-8fe7-cab6843d8332 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:08.520978 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-3e6bbd92-b2a5-4666-8fe7-cab6843d8332 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] [instance: 600d5a60-00ec-42b4-8128-b8213548e55a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:08.527815 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3e6bbd92-b2a5-4666-8fe7-cab6843d8332 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:08.528301 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3e6bbd92-b2a5-4666-8fe7-cab6843d8332 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:08.528779 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3e6bbd92-b2a5-4666-8fe7-cab6843d8332 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:08.529501 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3e6bbd92-b2a5-4666-8fe7-cab6843d8332 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:08.529948 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3e6bbd92-b2a5-4666-8fe7-cab6843d8332 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:08.530364 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3e6bbd92-b2a5-4666-8fe7-cab6843d8332 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:08.629848 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.instance [None req-3e6bbd92-b2a5-4666-8fe7-cab6843d8332 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lazy-loading 'services' on Instance uuid 600d5a60-00ec-42b4-8128-b8213548e55a {{(pid=134052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:13:08.719670 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-3e6bbd92-b2a5-4666-8fe7-cab6843d8332 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] 10.222.0.70 "DELETE /compute/v2.1/servers/600d5a60-00ec-42b4-8128-b8213548e55a/os-volume_attachments/d9b64656-34a6-4705-9f2b-d86997bbfd7a" status: 202 len: 0 microversion: 2.1 time: 0.203516 Aug 27 03:13:08.720663 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2673/5388] 10.222.0.70 () {58 vars in 1416 bytes} [Sat Aug 27 03:13:08 2022] DELETE /compute/v2.1/servers/600d5a60-00ec-42b4-8128-b8213548e55a/os-volume_attachments/d9b64656-34a6-4705-9f2b-d86997bbfd7a => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:13:08.895157 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d15b9801-2a27-4cf6-859f-c8ed4291339d tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:08.895780 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d15b9801-2a27-4cf6-859f-c8ed4291339d tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 0c24d379-bb60-46d3-8f49-1c3310a970fc] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:08.902367 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d15b9801-2a27-4cf6-859f-c8ed4291339d tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:08.902997 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d15b9801-2a27-4cf6-859f-c8ed4291339d tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:08.903275 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d15b9801-2a27-4cf6-859f-c8ed4291339d tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:08.904167 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d15b9801-2a27-4cf6-859f-c8ed4291339d tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:08.904649 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d15b9801-2a27-4cf6-859f-c8ed4291339d tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:08.905084 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d15b9801-2a27-4cf6-859f-c8ed4291339d tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:09.061621 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d15b9801-2a27-4cf6-859f-c8ed4291339d tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a549f85910184bf7a697cce7fa3dff96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92af206e05f44cf948b7c25d1acc139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:09.071584 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d15b9801-2a27-4cf6-859f-c8ed4291339d tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "GET /compute/v2.1/servers/0c24d379-bb60-46d3-8f49-1c3310a970fc" status: 200 len: 1367 microversion: 2.1 time: 0.180296 Aug 27 03:13:09.072448 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2716/5389] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:08 2022] GET /compute/v2.1/servers/0c24d379-bb60-46d3-8f49-1c3310a970fc => generated 1367 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:09.329168 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5646b839-3844-4aee-b1d3-e4b68fc3eb1b tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:09.330135 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-5646b839-3844-4aee-b1d3-e4b68fc3eb1b tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 7e810377-eeef-436c-8fab-69fa71243a9d] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:09.351811 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5646b839-3844-4aee-b1d3-e4b68fc3eb1b tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:09.352382 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5646b839-3844-4aee-b1d3-e4b68fc3eb1b tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:09.353096 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5646b839-3844-4aee-b1d3-e4b68fc3eb1b tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:09.353836 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5646b839-3844-4aee-b1d3-e4b68fc3eb1b tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:09.354471 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5646b839-3844-4aee-b1d3-e4b68fc3eb1b tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:09.359754 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5646b839-3844-4aee-b1d3-e4b68fc3eb1b tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:09.634496 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-5646b839-3844-4aee-b1d3-e4b68fc3eb1b tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:09.662288 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-5646b839-3844-4aee-b1d3-e4b68fc3eb1b tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:09.663974 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-5646b839-3844-4aee-b1d3-e4b68fc3eb1b tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:09.665547 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-5646b839-3844-4aee-b1d3-e4b68fc3eb1b tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d" status: 200 len: 1729 microversion: 2.20 time: 0.353612 Aug 27 03:13:09.666122 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2674/5390] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:13:09 2022] GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d => generated 1729 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:13:09.915377 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-c957e668-e1b5-44fe-a5b6-d02699d02edb req-9339b243-3bf2-414e-844a-155c7f280816 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e810377-eeef-436c-8fab-69fa71243a9d", "name": "network-vif-plugged", "status": "completed", "tag": "2c3d5445-7fe3-4101-9cf9-d7b63e882f1e"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:13:09.952492 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-c957e668-e1b5-44fe-a5b6-d02699d02edb req-9339b243-3bf2-414e-844a-155c7f280816 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:09.952983 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-c957e668-e1b5-44fe-a5b6-d02699d02edb req-9339b243-3bf2-414e-844a-155c7f280816 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:09.953461 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-c957e668-e1b5-44fe-a5b6-d02699d02edb req-9339b243-3bf2-414e-844a-155c7f280816 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:10.016791 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-c957e668-e1b5-44fe-a5b6-d02699d02edb req-9339b243-3bf2-414e-844a-155c7f280816 service nova] Creating event network-vif-plugged:2c3d5445-7fe3-4101-9cf9-d7b63e882f1e for instance 7e810377-eeef-436c-8fab-69fa71243a9d on n-h1-852278-4 Aug 27 03:13:10.048205 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-c957e668-e1b5-44fe-a5b6-d02699d02edb req-9339b243-3bf2-414e-844a-155c7f280816 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136166 Aug 27 03:13:10.049979 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2717/5391] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:13:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:13:10.095855 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d683af59-f029-4cd0-84c6-3422f31f458e tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:10.096530 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d683af59-f029-4cd0-84c6-3422f31f458e tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 0c24d379-bb60-46d3-8f49-1c3310a970fc] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:10.114393 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d683af59-f029-4cd0-84c6-3422f31f458e tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:10.114933 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d683af59-f029-4cd0-84c6-3422f31f458e tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:10.115382 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d683af59-f029-4cd0-84c6-3422f31f458e tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:10.116113 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d683af59-f029-4cd0-84c6-3422f31f458e tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:10.116679 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d683af59-f029-4cd0-84c6-3422f31f458e tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:10.117030 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d683af59-f029-4cd0-84c6-3422f31f458e tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:10.370949 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-d683af59-f029-4cd0-84c6-3422f31f458e tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a549f85910184bf7a697cce7fa3dff96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92af206e05f44cf948b7c25d1acc139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:10.381129 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d683af59-f029-4cd0-84c6-3422f31f458e tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "GET /compute/v2.1/servers/0c24d379-bb60-46d3-8f49-1c3310a970fc" status: 200 len: 1367 microversion: 2.1 time: 0.289682 Aug 27 03:13:10.401834 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2675/5392] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:10 2022] GET /compute/v2.1/servers/0c24d379-bb60-46d3-8f49-1c3310a970fc => generated 1367 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:10.689786 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3e0d1c2b-e13c-48bb-87c6-f9cd4959c933 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:10.690484 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-3e0d1c2b-e13c-48bb-87c6-f9cd4959c933 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 7e810377-eeef-436c-8fab-69fa71243a9d] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:10.701108 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:13:10.704006 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3e0d1c2b-e13c-48bb-87c6-f9cd4959c933 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:10.704547 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3e0d1c2b-e13c-48bb-87c6-f9cd4959c933 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:10.704988 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3e0d1c2b-e13c-48bb-87c6-f9cd4959c933 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:10.708993 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3e0d1c2b-e13c-48bb-87c6-f9cd4959c933 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:10.709507 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3e0d1c2b-e13c-48bb-87c6-f9cd4959c933 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:10.711503 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3e0d1c2b-e13c-48bb-87c6-f9cd4959c933 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:11.006322 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-3e0d1c2b-e13c-48bb-87c6-f9cd4959c933 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:11.020835 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-3e0d1c2b-e13c-48bb-87c6-f9cd4959c933 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:11.024621 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-3e0d1c2b-e13c-48bb-87c6-f9cd4959c933 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:11.041240 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-3e0d1c2b-e13c-48bb-87c6-f9cd4959c933 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d" status: 200 len: 1729 microversion: 2.20 time: 0.341502 Aug 27 03:13:11.042406 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2718/5393] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:13:10 2022] GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d => generated 1729 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:13:11.402992 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-39ee3e6c-60e5-45b7-84c9-f6584c8288f5 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:11.403611 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-39ee3e6c-60e5-45b7-84c9-f6584c8288f5 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 0c24d379-bb60-46d3-8f49-1c3310a970fc] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:11.410524 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-39ee3e6c-60e5-45b7-84c9-f6584c8288f5 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:11.416216 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-39ee3e6c-60e5-45b7-84c9-f6584c8288f5 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:11.416216 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-39ee3e6c-60e5-45b7-84c9-f6584c8288f5 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:11.416216 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-39ee3e6c-60e5-45b7-84c9-f6584c8288f5 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:11.416216 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-39ee3e6c-60e5-45b7-84c9-f6584c8288f5 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:11.416216 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-39ee3e6c-60e5-45b7-84c9-f6584c8288f5 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:11.615700 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-39ee3e6c-60e5-45b7-84c9-f6584c8288f5 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a549f85910184bf7a697cce7fa3dff96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92af206e05f44cf948b7c25d1acc139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:11.624527 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-39ee3e6c-60e5-45b7-84c9-f6584c8288f5 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "GET /compute/v2.1/servers/0c24d379-bb60-46d3-8f49-1c3310a970fc" status: 200 len: 1367 microversion: 2.1 time: 0.225316 Aug 27 03:13:11.625382 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2676/5394] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:11 2022] GET /compute/v2.1/servers/0c24d379-bb60-46d3-8f49-1c3310a970fc => generated 1367 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:12.067899 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a805edeb-ded2-4ccb-8e60-08c67ca11783 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:12.070974 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-a805edeb-ded2-4ccb-8e60-08c67ca11783 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 7e810377-eeef-436c-8fab-69fa71243a9d] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:12.083397 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a805edeb-ded2-4ccb-8e60-08c67ca11783 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:12.085216 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a805edeb-ded2-4ccb-8e60-08c67ca11783 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:12.086338 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a805edeb-ded2-4ccb-8e60-08c67ca11783 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:12.087706 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a805edeb-ded2-4ccb-8e60-08c67ca11783 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:12.089062 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a805edeb-ded2-4ccb-8e60-08c67ca11783 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:12.089700 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a805edeb-ded2-4ccb-8e60-08c67ca11783 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:12.096439 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-c3be0179-cfe8-42f4-a9c1-3a9c5c404e04 req-e8b2454e-5049-4923-9458-af5eb0fa5231 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c24d379-bb60-46d3-8f49-1c3310a970fc", "name": "network-vif-plugged", "status": "completed", "tag": "69a75ca6-aed1-48db-afb8-a2896ce706c7"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:13:12.114258 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-c3be0179-cfe8-42f4-a9c1-3a9c5c404e04 req-e8b2454e-5049-4923-9458-af5eb0fa5231 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:12.114957 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-c3be0179-cfe8-42f4-a9c1-3a9c5c404e04 req-e8b2454e-5049-4923-9458-af5eb0fa5231 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:12.115390 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-c3be0179-cfe8-42f4-a9c1-3a9c5c404e04 req-e8b2454e-5049-4923-9458-af5eb0fa5231 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:12.146040 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-c3be0179-cfe8-42f4-a9c1-3a9c5c404e04 req-e8b2454e-5049-4923-9458-af5eb0fa5231 service nova] Creating event network-vif-plugged:69a75ca6-aed1-48db-afb8-a2896ce706c7 for instance 0c24d379-bb60-46d3-8f49-1c3310a970fc on n-h1-852278-4 Aug 27 03:13:12.151675 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-c3be0179-cfe8-42f4-a9c1-3a9c5c404e04 req-e8b2454e-5049-4923-9458-af5eb0fa5231 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060737 Aug 27 03:13:12.152583 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2677/5395] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:13:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:13:12.281521 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-a805edeb-ded2-4ccb-8e60-08c67ca11783 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:12.293644 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-a805edeb-ded2-4ccb-8e60-08c67ca11783 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:12.295173 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-a805edeb-ded2-4ccb-8e60-08c67ca11783 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:12.296599 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a805edeb-ded2-4ccb-8e60-08c67ca11783 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d" status: 200 len: 1729 microversion: 2.20 time: 0.235203 Aug 27 03:13:12.308654 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2719/5396] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:13:12 2022] GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d => generated 1729 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:13:12.649775 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0644cb86-c4d8-4457-8431-8a9cc4c430a0 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:12.651261 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-0644cb86-c4d8-4457-8431-8a9cc4c430a0 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 0c24d379-bb60-46d3-8f49-1c3310a970fc] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:12.659259 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0644cb86-c4d8-4457-8431-8a9cc4c430a0 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:12.660044 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0644cb86-c4d8-4457-8431-8a9cc4c430a0 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:12.660726 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0644cb86-c4d8-4457-8431-8a9cc4c430a0 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:12.661633 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0644cb86-c4d8-4457-8431-8a9cc4c430a0 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:12.662279 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0644cb86-c4d8-4457-8431-8a9cc4c430a0 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:12.662881 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0644cb86-c4d8-4457-8431-8a9cc4c430a0 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:12.816517 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0644cb86-c4d8-4457-8431-8a9cc4c430a0 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a549f85910184bf7a697cce7fa3dff96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92af206e05f44cf948b7c25d1acc139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:12.825722 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-0644cb86-c4d8-4457-8431-8a9cc4c430a0 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "GET /compute/v2.1/servers/0c24d379-bb60-46d3-8f49-1c3310a970fc" status: 200 len: 1367 microversion: 2.1 time: 0.183455 Aug 27 03:13:12.826612 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2678/5397] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:12 2022] GET /compute/v2.1/servers/0c24d379-bb60-46d3-8f49-1c3310a970fc => generated 1367 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:13.319373 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-abf25063-63cb-432c-ae6d-18938e6a24b6 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:13.319990 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-abf25063-63cb-432c-ae6d-18938e6a24b6 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 7e810377-eeef-436c-8fab-69fa71243a9d] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:13.327124 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-abf25063-63cb-432c-ae6d-18938e6a24b6 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:13.327614 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-abf25063-63cb-432c-ae6d-18938e6a24b6 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:13.328053 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-abf25063-63cb-432c-ae6d-18938e6a24b6 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:13.328783 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-abf25063-63cb-432c-ae6d-18938e6a24b6 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:13.329249 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-abf25063-63cb-432c-ae6d-18938e6a24b6 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:13.329783 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-abf25063-63cb-432c-ae6d-18938e6a24b6 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:13.471756 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-abf25063-63cb-432c-ae6d-18938e6a24b6 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:13.482112 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-abf25063-63cb-432c-ae6d-18938e6a24b6 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:13.483893 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-abf25063-63cb-432c-ae6d-18938e6a24b6 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:13.485419 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-abf25063-63cb-432c-ae6d-18938e6a24b6 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d" status: 200 len: 1716 microversion: 2.20 time: 0.170023 Aug 27 03:13:13.486202 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2720/5398] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:13:13 2022] GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d => generated 1716 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:13:13.847761 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c68cf9cd-6450-4e75-84dd-bfc8f7e0c884 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:13.848420 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-c68cf9cd-6450-4e75-84dd-bfc8f7e0c884 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 0c24d379-bb60-46d3-8f49-1c3310a970fc] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:13.864033 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c68cf9cd-6450-4e75-84dd-bfc8f7e0c884 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:13.865102 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c68cf9cd-6450-4e75-84dd-bfc8f7e0c884 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:13.865845 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c68cf9cd-6450-4e75-84dd-bfc8f7e0c884 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:13.866782 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c68cf9cd-6450-4e75-84dd-bfc8f7e0c884 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:13.867476 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c68cf9cd-6450-4e75-84dd-bfc8f7e0c884 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:13.868122 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c68cf9cd-6450-4e75-84dd-bfc8f7e0c884 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:14.016742 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-c68cf9cd-6450-4e75-84dd-bfc8f7e0c884 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a549f85910184bf7a697cce7fa3dff96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92af206e05f44cf948b7c25d1acc139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:14.024773 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c68cf9cd-6450-4e75-84dd-bfc8f7e0c884 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "GET /compute/v2.1/servers/0c24d379-bb60-46d3-8f49-1c3310a970fc" status: 200 len: 1556 microversion: 2.1 time: 0.181308 Aug 27 03:13:14.025366 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2679/5399] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:13 2022] GET /compute/v2.1/servers/0c24d379-bb60-46d3-8f49-1c3310a970fc => generated 1556 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:14.045497 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a0169556-de1e-47f6-828d-16f0550421a6 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:14.046296 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-a0169556-de1e-47f6-828d-16f0550421a6 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 0c24d379-bb60-46d3-8f49-1c3310a970fc] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:14.052982 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a0169556-de1e-47f6-828d-16f0550421a6 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:14.053693 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a0169556-de1e-47f6-828d-16f0550421a6 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:14.054292 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a0169556-de1e-47f6-828d-16f0550421a6 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:14.055215 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a0169556-de1e-47f6-828d-16f0550421a6 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:14.056142 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a0169556-de1e-47f6-828d-16f0550421a6 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:14.057002 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a0169556-de1e-47f6-828d-16f0550421a6 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:14.160067 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a0169556-de1e-47f6-828d-16f0550421a6 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "GET /compute/v2.1/servers/0c24d379-bb60-46d3-8f49-1c3310a970fc/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.118711 Aug 27 03:13:14.167725 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2721/5400] 10.222.0.70 () {58 vars in 1275 bytes} [Sat Aug 27 03:13:14 2022] GET /compute/v2.1/servers/0c24d379-bb60-46d3-8f49-1c3310a970fc/os-interface => generated 284 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:13:14.596046 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-52f87bfd-6ccc-4b67-a25f-9990695184f2 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:14.596852 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-52f87bfd-6ccc-4b67-a25f-9990695184f2 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] [instance: 600d5a60-00ec-42b4-8128-b8213548e55a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:14.603382 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-52f87bfd-6ccc-4b67-a25f-9990695184f2 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:14.604107 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-52f87bfd-6ccc-4b67-a25f-9990695184f2 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:14.605154 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-52f87bfd-6ccc-4b67-a25f-9990695184f2 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:14.606056 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-52f87bfd-6ccc-4b67-a25f-9990695184f2 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:14.606676 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-52f87bfd-6ccc-4b67-a25f-9990695184f2 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:14.607267 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-52f87bfd-6ccc-4b67-a25f-9990695184f2 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:14.635214 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-52f87bfd-6ccc-4b67-a25f-9990695184f2 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] [instance: 600d5a60-00ec-42b4-8128-b8213548e55a] Going to try to terminate instance {{(pid=134052) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:13:14.729202 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-52f87bfd-6ccc-4b67-a25f-9990695184f2 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] 10.222.0.70 "DELETE /compute/v2.1/servers/600d5a60-00ec-42b4-8128-b8213548e55a" status: 204 len: 0 microversion: 2.1 time: 0.136353 Aug 27 03:13:14.733118 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2680/5401] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 03:13:14 2022] DELETE /compute/v2.1/servers/600d5a60-00ec-42b4-8128-b8213548e55a => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:13:14.743511 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7d50e472-1672-4860-beda-c00fa6abc4a5 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:14.745343 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-7d50e472-1672-4860-beda-c00fa6abc4a5 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] [instance: 600d5a60-00ec-42b4-8128-b8213548e55a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:14.754166 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7d50e472-1672-4860-beda-c00fa6abc4a5 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:14.755007 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7d50e472-1672-4860-beda-c00fa6abc4a5 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:14.755605 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7d50e472-1672-4860-beda-c00fa6abc4a5 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:14.756669 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7d50e472-1672-4860-beda-c00fa6abc4a5 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:14.757917 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7d50e472-1672-4860-beda-c00fa6abc4a5 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:14.758633 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7d50e472-1672-4860-beda-c00fa6abc4a5 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:14.926885 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-7d50e472-1672-4860-beda-c00fa6abc4a5 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b68d81dbdb474cac2060aa9d7bb502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852f3aff4a69491abbd546875918b004', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:14.935550 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-7d50e472-1672-4860-beda-c00fa6abc4a5 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] 10.222.0.70 "GET /compute/v2.1/servers/600d5a60-00ec-42b4-8128-b8213548e55a" status: 200 len: 1514 microversion: 2.1 time: 0.200480 Aug 27 03:13:14.936363 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2722/5402] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:14 2022] GET /compute/v2.1/servers/600d5a60-00ec-42b4-8128-b8213548e55a => generated 1514 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:15.645646 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-86269331-020f-43a3-98dd-ca030df8ab18 req-c7b83276-1aa9-48f1-b85d-bbb089ba9dd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c24d379-bb60-46d3-8f49-1c3310a970fc", "tag": "69a75ca6-aed1-48db-afb8-a2896ce706c7"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:13:15.655257 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-86269331-020f-43a3-98dd-ca030df8ab18 req-c7b83276-1aa9-48f1-b85d-bbb089ba9dd5 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:15.656074 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-86269331-020f-43a3-98dd-ca030df8ab18 req-c7b83276-1aa9-48f1-b85d-bbb089ba9dd5 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:15.656783 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-86269331-020f-43a3-98dd-ca030df8ab18 req-c7b83276-1aa9-48f1-b85d-bbb089ba9dd5 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:15.669200 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-86269331-020f-43a3-98dd-ca030df8ab18 req-c7b83276-1aa9-48f1-b85d-bbb089ba9dd5 service nova] Creating event network-changed:69a75ca6-aed1-48db-afb8-a2896ce706c7 for instance 0c24d379-bb60-46d3-8f49-1c3310a970fc on n-h1-852278-4 Aug 27 03:13:15.674571 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-86269331-020f-43a3-98dd-ca030df8ab18 req-c7b83276-1aa9-48f1-b85d-bbb089ba9dd5 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033905 Aug 27 03:13:15.675926 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2681/5403] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:13:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:13:15.969194 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-1f87a562-094b-404e-98de-fe76ff35be35 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:15.970114 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-1f87a562-094b-404e-98de-fe76ff35be35 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] [instance: 600d5a60-00ec-42b4-8128-b8213548e55a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:15.988540 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1f87a562-094b-404e-98de-fe76ff35be35 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:15.989703 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1f87a562-094b-404e-98de-fe76ff35be35 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:15.990364 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1f87a562-094b-404e-98de-fe76ff35be35 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:15.991815 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1f87a562-094b-404e-98de-fe76ff35be35 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:15.992756 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1f87a562-094b-404e-98de-fe76ff35be35 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:15.993483 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1f87a562-094b-404e-98de-fe76ff35be35 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:16.231275 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-1f87a562-094b-404e-98de-fe76ff35be35 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b68d81dbdb474cac2060aa9d7bb502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852f3aff4a69491abbd546875918b004', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:16.247869 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-1f87a562-094b-404e-98de-fe76ff35be35 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] 10.222.0.70 "GET /compute/v2.1/servers/600d5a60-00ec-42b4-8128-b8213548e55a" status: 200 len: 1514 microversion: 2.1 time: 0.281476 Aug 27 03:13:16.248548 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2723/5404] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:15 2022] GET /compute/v2.1/servers/600d5a60-00ec-42b4-8128-b8213548e55a => generated 1514 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:16.839000 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-04d37fd8-e249-4963-b67a-db38c79dacc9 req-b5a90f77-b8a0-48db-a876-ba9ac1ca7d24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "600d5a60-00ec-42b4-8128-b8213548e55a", "name": "network-vif-deleted", "tag": "5263700c-2dba-4299-a2f2-1d49926128b1"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:13:16.861662 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-04d37fd8-e249-4963-b67a-db38c79dacc9 req-b5a90f77-b8a0-48db-a876-ba9ac1ca7d24 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:16.862438 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-04d37fd8-e249-4963-b67a-db38c79dacc9 req-b5a90f77-b8a0-48db-a876-ba9ac1ca7d24 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:16.862993 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-04d37fd8-e249-4963-b67a-db38c79dacc9 req-b5a90f77-b8a0-48db-a876-ba9ac1ca7d24 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:16.878242 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-04d37fd8-e249-4963-b67a-db38c79dacc9 req-b5a90f77-b8a0-48db-a876-ba9ac1ca7d24 service nova] Creating event network-vif-deleted:5263700c-2dba-4299-a2f2-1d49926128b1 for instance 600d5a60-00ec-42b4-8128-b8213548e55a on n-h2-852278-4 Aug 27 03:13:16.885163 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-04d37fd8-e249-4963-b67a-db38c79dacc9 req-b5a90f77-b8a0-48db-a876-ba9ac1ca7d24 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051850 Aug 27 03:13:16.886404 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2682/5405] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:13:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:13:17.271402 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-2f185bef-8288-48a3-a6cd-c37173de5ac5 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:17.272069 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-2f185bef-8288-48a3-a6cd-c37173de5ac5 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] [instance: 600d5a60-00ec-42b4-8128-b8213548e55a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:17.280206 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2f185bef-8288-48a3-a6cd-c37173de5ac5 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:17.280721 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2f185bef-8288-48a3-a6cd-c37173de5ac5 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:17.281330 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2f185bef-8288-48a3-a6cd-c37173de5ac5 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:17.282256 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2f185bef-8288-48a3-a6cd-c37173de5ac5 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:17.282880 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2f185bef-8288-48a3-a6cd-c37173de5ac5 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:17.283465 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2f185bef-8288-48a3-a6cd-c37173de5ac5 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:17.326254 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2f185bef-8288-48a3-a6cd-c37173de5ac5 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:17.326988 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2f185bef-8288-48a3-a6cd-c37173de5ac5 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:17.327583 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2f185bef-8288-48a3-a6cd-c37173de5ac5 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:17.328197 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.objects.instance [None req-2f185bef-8288-48a3-a6cd-c37173de5ac5 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lazy-loading 'fault' on Instance uuid 600d5a60-00ec-42b4-8128-b8213548e55a {{(pid=134051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:13:17.381602 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-2f185bef-8288-48a3-a6cd-c37173de5ac5 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b68d81dbdb474cac2060aa9d7bb502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852f3aff4a69491abbd546875918b004', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:17.391749 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-2f185bef-8288-48a3-a6cd-c37173de5ac5 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] 10.222.0.70 "GET /compute/v2.1/servers/600d5a60-00ec-42b4-8128-b8213548e55a" status: 200 len: 1309 microversion: 2.1 time: 0.126407 Aug 27 03:13:17.394162 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2724/5406] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:17 2022] GET /compute/v2.1/servers/600d5a60-00ec-42b4-8128-b8213548e55a => generated 1309 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:18.415537 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-cccc2b3e-b90c-4cb2-ab83-79fd02435d73 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:18.416211 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-cccc2b3e-b90c-4cb2-ab83-79fd02435d73 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] [instance: 600d5a60-00ec-42b4-8128-b8213548e55a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:18.428491 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cccc2b3e-b90c-4cb2-ab83-79fd02435d73 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:18.429042 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cccc2b3e-b90c-4cb2-ab83-79fd02435d73 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:18.429473 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cccc2b3e-b90c-4cb2-ab83-79fd02435d73 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:18.430180 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cccc2b3e-b90c-4cb2-ab83-79fd02435d73 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:18.430863 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cccc2b3e-b90c-4cb2-ab83-79fd02435d73 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:18.431480 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cccc2b3e-b90c-4cb2-ab83-79fd02435d73 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:18.446111 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-cccc2b3e-b90c-4cb2-ab83-79fd02435d73 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] HTTP exception thrown: Instance 600d5a60-00ec-42b4-8128-b8213548e55a could not be found. Aug 27 03:13:18.448019 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-cccc2b3e-b90c-4cb2-ab83-79fd02435d73 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Request method failure captured: Aug 27 03:13:18.448019 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/servers/600d5a60-00ec-42b4-8128-b8213548e55a HTTP/1.1 Aug 27 03:13:18.448019 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 03:13:18.448019 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 03:13:18.448019 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 03:13:18.448019 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 03:13:18.448019 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 03:13:18.448019 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 03:13:18.448019 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 03:13:18.448019 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 03:13:18.448019 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYrbClWrjG76oRRYTrdiCzd0iFX2FbghZ5KoVjS5o2gAY7flwxWlD4d8oF8F9WMJEqs-n7UsCx5OXBnpLwqcbTn2CM48Y4CgnlU7P7WHjxIi5KT0wx7wTyLxwozeh0ACmy0JK9laNIfWp9qmXPG-kiq4jZlXMCv9KmPNWu9kflCXCK4 Aug 27 03:13:18.448019 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 03:13:18.448019 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 03:13:18.448019 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 03:13:18.448019 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 03:13:18.448019 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 03:13:18.448019 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 03:13:18.448019 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 852f3aff4a69491abbd546875918b004 Aug 27 03:13:18.448019 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1556711590 Aug 27 03:13:18.448019 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 03:13:18.448019 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 03:13:18.448019 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/852f3aff4a69491abbd546875918b004"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_852f3aff4a69491abbd546875918b004", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/852f3aff4a69491abbd546875918b004"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/852f3aff4a69491abbd546875918b004"}]}] Aug 27 03:13:18.448019 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-VolumesSnapshotTestJSON-1556711590 Aug 27 03:13:18.448019 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 852f3aff4a69491abbd546875918b004 Aug 27 03:13:18.448019 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1556711590 Aug 27 03:13:18.448019 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-VolumesSnapshotTestJSON-1556711590-project Aug 27 03:13:18.448019 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 03:13:18.448019 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 03:13:18.448019 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: e2b68d81dbdb474cac2060aa9d7bb502 Aug 27 03:13:18.448019 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-VolumesSnapshotTestJSON-1556711590-project Aug 27 03:13:18.448019 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 03:13:18.448019 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance 600d5a60-00ec-42b4-8128-b8213548e55a could not be found. Aug 27 03:13:18.448019 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '600d5a60-00ec-42b4-8128-b8213548e55a'} Aug 27 03:13:18.448019 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:13:18.448019 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:13:18.448019 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:13:18.448019 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:13:18.448019 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:13:18.448019 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:13:18.448019 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:13:18.448019 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:13:18.448019 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:13:18.448019 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:13:18.448019 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 600d5a60-00ec-42b4-8128-b8213548e55a could not be found. Aug 27 03:13:18.448019 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:13:18.448019 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:13:18.448019 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:13:18.448019 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:13:18.448019 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:13:18.448019 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:13:18.448019 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:13:18.448019 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:13:18.448019 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:13:18.448019 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:13:18.448019 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:13:18.448019 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:13:18.448019 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:13:18.448019 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:13:18.448019 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:13:18.448019 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:13:18.448019 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 600d5a60-00ec-42b4-8128-b8213548e55a could not be found. Aug 27 03:13:18.448019 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:13:18.448019 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:13:18.448019 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:13:18.453577 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:13:18.453577 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:13:18.453577 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:13:18.453577 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:13:18.453577 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:13:18.453577 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 600d5a60-00ec-42b4-8128-b8213548e55a could not be found. Aug 27 03:13:18.453577 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:13:18.453577 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-cccc2b3e-b90c-4cb2-ab83-79fd02435d73 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] Returning 404 to user: Instance 600d5a60-00ec-42b4-8128-b8213548e55a could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:13:18.453577 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-cccc2b3e-b90c-4cb2-ab83-79fd02435d73 tempest-VolumesSnapshotTestJSON-1556711590 tempest-VolumesSnapshotTestJSON-1556711590-project] 10.222.0.70 "GET /compute/v2.1/servers/600d5a60-00ec-42b4-8128-b8213548e55a" status: 404 len: 111 microversion: 2.1 time: 0.039314 Aug 27 03:13:18.453577 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2683/5407] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:18 2022] GET /compute/v2.1/servers/600d5a60-00ec-42b4-8128-b8213548e55a => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:13:46.739430 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-9679a236-61e5-49d3-afe2-f48c666503bc tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:46.742591 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-9679a236-61e5-49d3-afe2-f48c666503bc tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 7e810377-eeef-436c-8fab-69fa71243a9d] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:46.748918 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=15 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:13:46.750174 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=64 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:13:46.753029 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9679a236-61e5-49d3-afe2-f48c666503bc tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:46.753715 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9679a236-61e5-49d3-afe2-f48c666503bc tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:46.754614 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9679a236-61e5-49d3-afe2-f48c666503bc tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:46.755619 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9679a236-61e5-49d3-afe2-f48c666503bc tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:46.757422 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9679a236-61e5-49d3-afe2-f48c666503bc tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:46.757422 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9679a236-61e5-49d3-afe2-f48c666503bc tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:46.816455 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-9679a236-61e5-49d3-afe2-f48c666503bc tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.077750 Aug 27 03:13:46.825350 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2725/5408] 10.222.0.70 () {60 vars in 1343 bytes} [Sat Aug 27 03:13:46 2022] GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d/os-volume_attachments => generated 25 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:46.948166 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-05ea146f-ee67-4be6-8c05-64e5d8a76e9a tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:46.949208 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-05ea146f-ee67-4be6-8c05-64e5d8a76e9a tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 7e810377-eeef-436c-8fab-69fa71243a9d] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:46.952048 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:13:46.953973 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=76,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:13:46.984234 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-05ea146f-ee67-4be6-8c05-64e5d8a76e9a tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:46.987914 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-05ea146f-ee67-4be6-8c05-64e5d8a76e9a tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:46.989780 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-05ea146f-ee67-4be6-8c05-64e5d8a76e9a tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:46.991109 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-05ea146f-ee67-4be6-8c05-64e5d8a76e9a tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:47.003964 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-05ea146f-ee67-4be6-8c05-64e5d8a76e9a tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:47.016844 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-05ea146f-ee67-4be6-8c05-64e5d8a76e9a tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:47.113212 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-05ea146f-ee67-4be6-8c05-64e5d8a76e9a tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 7e810377-eeef-436c-8fab-69fa71243a9d] Going to try to terminate instance {{(pid=134052) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:13:47.303746 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-05ea146f-ee67-4be6-8c05-64e5d8a76e9a tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "DELETE /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d" status: 204 len: 0 microversion: 2.20 time: 0.359407 Aug 27 03:13:47.306281 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2684/5409] 10.222.0.70 () {60 vars in 1280 bytes} [Sat Aug 27 03:13:46 2022] DELETE /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d => generated 0 bytes in 363 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 03:13:47.315407 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-56c40f11-8e6a-427f-9596-df5fa38a2a20 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:47.316298 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-56c40f11-8e6a-427f-9596-df5fa38a2a20 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 7e810377-eeef-436c-8fab-69fa71243a9d] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:47.338217 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-56c40f11-8e6a-427f-9596-df5fa38a2a20 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:47.338945 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-56c40f11-8e6a-427f-9596-df5fa38a2a20 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:47.342345 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-56c40f11-8e6a-427f-9596-df5fa38a2a20 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:47.343680 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-56c40f11-8e6a-427f-9596-df5fa38a2a20 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:47.347300 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-56c40f11-8e6a-427f-9596-df5fa38a2a20 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:47.348181 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-56c40f11-8e6a-427f-9596-df5fa38a2a20 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:47.650303 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-56c40f11-8e6a-427f-9596-df5fa38a2a20 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:47.663091 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-56c40f11-8e6a-427f-9596-df5fa38a2a20 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:47.665017 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-56c40f11-8e6a-427f-9596-df5fa38a2a20 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:47.666412 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-56c40f11-8e6a-427f-9596-df5fa38a2a20 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d" status: 200 len: 1722 microversion: 2.20 time: 0.355233 Aug 27 03:13:47.667173 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2726/5410] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:13:47 2022] GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d => generated 1722 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:13:48.696294 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-cf5e6611-7fa0-4acd-84d9-517d0eefbe4e tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:48.697214 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-cf5e6611-7fa0-4acd-84d9-517d0eefbe4e tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 7e810377-eeef-436c-8fab-69fa71243a9d] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:48.754591 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cf5e6611-7fa0-4acd-84d9-517d0eefbe4e tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:48.755396 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cf5e6611-7fa0-4acd-84d9-517d0eefbe4e tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:48.756792 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cf5e6611-7fa0-4acd-84d9-517d0eefbe4e tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:48.757919 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cf5e6611-7fa0-4acd-84d9-517d0eefbe4e tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:48.760212 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cf5e6611-7fa0-4acd-84d9-517d0eefbe4e tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:48.763088 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cf5e6611-7fa0-4acd-84d9-517d0eefbe4e tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:49.094303 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-cf5e6611-7fa0-4acd-84d9-517d0eefbe4e tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:49.104069 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-cf5e6611-7fa0-4acd-84d9-517d0eefbe4e tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:49.105662 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-cf5e6611-7fa0-4acd-84d9-517d0eefbe4e tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:49.107119 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-cf5e6611-7fa0-4acd-84d9-517d0eefbe4e tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d" status: 200 len: 1722 microversion: 2.20 time: 0.417279 Aug 27 03:13:49.108369 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2685/5411] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:13:48 2022] GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d => generated 1722 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:13:50.130677 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4264f8ac-dd9d-4ccc-a474-b8a2b25a2bc1 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:50.131276 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-4264f8ac-dd9d-4ccc-a474-b8a2b25a2bc1 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 7e810377-eeef-436c-8fab-69fa71243a9d] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:50.138982 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4264f8ac-dd9d-4ccc-a474-b8a2b25a2bc1 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:50.139730 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4264f8ac-dd9d-4ccc-a474-b8a2b25a2bc1 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:50.140357 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4264f8ac-dd9d-4ccc-a474-b8a2b25a2bc1 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:50.141237 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4264f8ac-dd9d-4ccc-a474-b8a2b25a2bc1 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:50.141841 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4264f8ac-dd9d-4ccc-a474-b8a2b25a2bc1 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:50.142417 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4264f8ac-dd9d-4ccc-a474-b8a2b25a2bc1 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:50.313001 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-4264f8ac-dd9d-4ccc-a474-b8a2b25a2bc1 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:50.324823 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-4264f8ac-dd9d-4ccc-a474-b8a2b25a2bc1 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:50.327979 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-4264f8ac-dd9d-4ccc-a474-b8a2b25a2bc1 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:50.329369 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-4264f8ac-dd9d-4ccc-a474-b8a2b25a2bc1 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d" status: 200 len: 1722 microversion: 2.20 time: 0.202655 Aug 27 03:13:50.330559 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2727/5412] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:13:50 2022] GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d => generated 1722 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:13:51.352903 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-2b2d168b-ec85-4e71-94ac-ef8632ec2293 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:51.353543 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-2b2d168b-ec85-4e71-94ac-ef8632ec2293 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 7e810377-eeef-436c-8fab-69fa71243a9d] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:51.382770 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2b2d168b-ec85-4e71-94ac-ef8632ec2293 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:51.384617 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2b2d168b-ec85-4e71-94ac-ef8632ec2293 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:51.386997 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2b2d168b-ec85-4e71-94ac-ef8632ec2293 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:51.389281 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2b2d168b-ec85-4e71-94ac-ef8632ec2293 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:51.391211 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2b2d168b-ec85-4e71-94ac-ef8632ec2293 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:51.392586 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2b2d168b-ec85-4e71-94ac-ef8632ec2293 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:51.490960 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2b2d168b-ec85-4e71-94ac-ef8632ec2293 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:51.491451 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2b2d168b-ec85-4e71-94ac-ef8632ec2293 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:51.495158 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2b2d168b-ec85-4e71-94ac-ef8632ec2293 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:51.497454 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.objects.instance [None req-2b2d168b-ec85-4e71-94ac-ef8632ec2293 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lazy-loading 'fault' on Instance uuid 7e810377-eeef-436c-8fab-69fa71243a9d {{(pid=134051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:13:51.637793 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-2b2d168b-ec85-4e71-94ac-ef8632ec2293 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:51.651520 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-2b2d168b-ec85-4e71-94ac-ef8632ec2293 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:51.653020 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-2b2d168b-ec85-4e71-94ac-ef8632ec2293 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8bf00e5925fa4227a2fe0b6b155a4ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819c3b9e6e3c4a868b1ba77f48ff2e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:51.659562 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-2b2d168b-ec85-4e71-94ac-ef8632ec2293 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d" status: 200 len: 1371 microversion: 2.20 time: 0.305872 Aug 27 03:13:51.662741 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2728/5413] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:13:51 2022] GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d => generated 1371 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:13:51.682199 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-ece3fd8c-9247-48b7-8417-eda4d9459a10 req-91318a05-0431-4081-adfb-6fad5479df56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e810377-eeef-436c-8fab-69fa71243a9d", "name": "network-vif-deleted", "tag": "2c3d5445-7fe3-4101-9cf9-d7b63e882f1e"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:13:51.718834 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-ece3fd8c-9247-48b7-8417-eda4d9459a10 req-91318a05-0431-4081-adfb-6fad5479df56 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:51.724812 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-ece3fd8c-9247-48b7-8417-eda4d9459a10 req-91318a05-0431-4081-adfb-6fad5479df56 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:51.726469 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-ece3fd8c-9247-48b7-8417-eda4d9459a10 req-91318a05-0431-4081-adfb-6fad5479df56 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:51.773308 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-ece3fd8c-9247-48b7-8417-eda4d9459a10 req-91318a05-0431-4081-adfb-6fad5479df56 service nova] Creating event network-vif-deleted:2c3d5445-7fe3-4101-9cf9-d7b63e882f1e for instance 7e810377-eeef-436c-8fab-69fa71243a9d on n-h1-852278-4 Aug 27 03:13:51.786204 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-ece3fd8c-9247-48b7-8417-eda4d9459a10 req-91318a05-0431-4081-adfb-6fad5479df56 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.689322 Aug 27 03:13:51.800029 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2686/5414] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:13:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:13:51.965230 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-eaac1779-2a26-4daa-a714-ca29b2886c5c tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:51.966249 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-eaac1779-2a26-4daa-a714-ca29b2886c5c tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 0c24d379-bb60-46d3-8f49-1c3310a970fc] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:51.977976 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eaac1779-2a26-4daa-a714-ca29b2886c5c tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:51.980758 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eaac1779-2a26-4daa-a714-ca29b2886c5c tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:51.981222 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eaac1779-2a26-4daa-a714-ca29b2886c5c tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:51.988058 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eaac1779-2a26-4daa-a714-ca29b2886c5c tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:51.990123 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eaac1779-2a26-4daa-a714-ca29b2886c5c tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:51.995797 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eaac1779-2a26-4daa-a714-ca29b2886c5c tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:52.046335 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-eaac1779-2a26-4daa-a714-ca29b2886c5c tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "GET /compute/v2.1/servers/0c24d379-bb60-46d3-8f49-1c3310a970fc/ips" status: 200 len: 149 microversion: 2.1 time: 0.381646 Aug 27 03:13:52.049415 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2729/5415] 10.222.0.70 () {58 vars in 1248 bytes} [Sat Aug 27 03:13:51 2022] GET /compute/v2.1/servers/0c24d379-bb60-46d3-8f49-1c3310a970fc/ips => generated 149 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:13:52.692918 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4a0aaa37-4e95-4867-9677-1023d435da1d tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:52.693765 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-4a0aaa37-4e95-4867-9677-1023d435da1d tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 7e810377-eeef-436c-8fab-69fa71243a9d] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:52.715023 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4a0aaa37-4e95-4867-9677-1023d435da1d tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:52.715526 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4a0aaa37-4e95-4867-9677-1023d435da1d tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:52.715963 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4a0aaa37-4e95-4867-9677-1023d435da1d tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:52.716712 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4a0aaa37-4e95-4867-9677-1023d435da1d tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:52.717155 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4a0aaa37-4e95-4867-9677-1023d435da1d tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:52.717579 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4a0aaa37-4e95-4867-9677-1023d435da1d tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:52.769152 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-4a0aaa37-4e95-4867-9677-1023d435da1d tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] HTTP exception thrown: Instance 7e810377-eeef-436c-8fab-69fa71243a9d could not be found. Aug 27 03:13:52.772233 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4a0aaa37-4e95-4867-9677-1023d435da1d tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Request method failure captured: Aug 27 03:13:52.772233 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d HTTP/1.1 Aug 27 03:13:52.772233 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 03:13:52.772233 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 03:13:52.772233 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 03:13:52.772233 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 03:13:52.772233 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 03:13:52.772233 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 03:13:52.772233 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 03:13:52.772233 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 03:13:52.772233 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYqWWBpisv0Y8BINTYOfeSZSS55yPb6M12y-rc1hhmIPImd6bLtUWZpUUXyiIiteGM7399fAWs_B2GKs6-_BwLz39cKeITvdmoIjDZ89MdWoiFFHRkq5uSO4e0ZVvUZ3R-WTlC_O1Cb_D8e8r6b7FTtA4CE_fUyeGUkz3HkySTmRbvk Aug 27 03:13:52.772233 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 03:13:52.772233 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 03:13:52.772233 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 03:13:52.772233 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 03:13:52.772233 n-d-852278-4 devstack@n-api.service[134052]: X-Openstack-Nova-Api-Version: 2.20 Aug 27 03:13:52.772233 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 03:13:52.772233 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 03:13:52.772233 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 819c3b9e6e3c4a868b1ba77f48ff2e56 Aug 27 03:13:52.772233 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1336453815 Aug 27 03:13:52.772233 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 03:13:52.772233 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 03:13:52.772233 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/819c3b9e6e3c4a868b1ba77f48ff2e56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_819c3b9e6e3c4a868b1ba77f48ff2e56", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/819c3b9e6e3c4a868b1ba77f48ff2e56"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/819c3b9e6e3c4a868b1ba77f48ff2e56"}]}] Aug 27 03:13:52.772233 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1336453815 Aug 27 03:13:52.772233 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 819c3b9e6e3c4a868b1ba77f48ff2e56 Aug 27 03:13:52.772233 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1336453815 Aug 27 03:13:52.772233 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-AttachVolumeShelveTestJSON-1336453815-project Aug 27 03:13:52.772233 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 03:13:52.772233 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 03:13:52.772233 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 8bf00e5925fa4227a2fe0b6b155a4ee4 Aug 27 03:13:52.772233 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1336453815-project Aug 27 03:13:52.772233 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 03:13:52.772233 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance 7e810377-eeef-436c-8fab-69fa71243a9d could not be found. Aug 27 03:13:52.772233 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '7e810377-eeef-436c-8fab-69fa71243a9d'} Aug 27 03:13:52.772233 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:13:52.772233 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:13:52.772233 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:13:52.772233 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:13:52.772233 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:13:52.772233 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:13:52.772233 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:13:52.772233 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:13:52.772233 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:13:52.772233 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:13:52.772233 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e810377-eeef-436c-8fab-69fa71243a9d could not be found. Aug 27 03:13:52.772233 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:13:52.772233 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:13:52.772233 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:13:52.772233 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:13:52.772233 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:13:52.772233 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:13:52.772233 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:13:52.772233 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:13:52.772233 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:13:52.772233 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:13:52.772233 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:13:52.772233 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:13:52.772233 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:13:52.772233 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:13:52.772233 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:13:52.772233 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:13:52.772233 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e810377-eeef-436c-8fab-69fa71243a9d could not be found. Aug 27 03:13:52.772233 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:13:52.772233 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:13:52.778533 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:13:52.778533 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:13:52.778533 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:13:52.778533 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:13:52.778533 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:13:52.778533 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:13:52.778533 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e810377-eeef-436c-8fab-69fa71243a9d could not be found. Aug 27 03:13:52.778533 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:13:52.778533 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4a0aaa37-4e95-4867-9677-1023d435da1d tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Returning 404 to user: Instance 7e810377-eeef-436c-8fab-69fa71243a9d could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:13:52.778533 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-4a0aaa37-4e95-4867-9677-1023d435da1d tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d" status: 404 len: 111 microversion: 2.20 time: 0.086821 Aug 27 03:13:52.778533 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2687/5416] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:13:52 2022] GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:13:52.795927 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-1854af27-6e2f-4c72-8f30-8b8bc5e69983 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '.version_select at 0x7f5ededfc550>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:52.868336 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-1854af27-6e2f-4c72-8f30-8b8bc5e69983 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-231993650" status: 204 len: 0 microversion: 2.20 time: 0.087022 Aug 27 03:13:52.872903 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2730/5417] 10.222.0.70 () {60 vars in 1259 bytes} [Sat Aug 27 03:13:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-231993650 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 03:13:56.035291 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d3711317-b68b-4bd0-adff-6285d1af6c91 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e10094c6-d84b-4939-898e-6b187edd895b"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:13:56.038141 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d3711317-b68b-4bd0-adff-6285d1af6c91 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 0c24d379-bb60-46d3-8f49-1c3310a970fc] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:56.060900 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d3711317-b68b-4bd0-adff-6285d1af6c91 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:56.061555 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d3711317-b68b-4bd0-adff-6285d1af6c91 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:56.061999 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d3711317-b68b-4bd0-adff-6285d1af6c91 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:56.062754 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d3711317-b68b-4bd0-adff-6285d1af6c91 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:56.063209 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d3711317-b68b-4bd0-adff-6285d1af6c91 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:56.063630 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d3711317-b68b-4bd0-adff-6285d1af6c91 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:56.307797 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-18b9a513-d3d0-497b-b032-53523c587889 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Action: 'create', calling method: .version_select at 0x7f5ee71c4790>, body: {"keypair": {"name": "tempest-TestServerBasicOps-615301463", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGDtRZkHAvHb1Vhz26P3OK+7ipbj6zMuPJwQ37PaxQC30PUBluhh9bTnpWpI/l5nX29oM1IXTdPHbuaCHsB+u5/deEO/vpstIAtXTZsJ1MUpXoRCTjgm4+vNjtlAxRLZVQ=="}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:13:56.382447 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-18b9a513-d3d0-497b-b032-53523c587889 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Getting quotas for project 8e6a6e91351a4d4187c894fc9562886a. Resources: {'key_pairs'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:13:56.400280 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-18b9a513-d3d0-497b-b032-53523c587889 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Getting quotas for user 0ca3c3142d0449fd8c32b2d24b8da633 and project 8e6a6e91351a4d4187c894fc9562886a. Resources: {'key_pairs'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:13:56.442998 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-18b9a513-d3d0-497b-b032-53523c587889 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.277405 Aug 27 03:13:56.443613 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2731/5418] 10.222.0.70 () {60 vars in 1159 bytes} [Sat Aug 27 03:13:56 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:13:56.582615 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d3711317-b68b-4bd0-adff-6285d1af6c91 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "POST /compute/v2.1/servers/0c24d379-bb60-46d3-8f49-1c3310a970fc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.551944 Aug 27 03:13:56.590489 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2688/5419] 10.222.0.70 () {60 vars in 1323 bytes} [Sat Aug 27 03:13:56 2022] POST /compute/v2.1/servers/0c24d379-bb60-46d3-8f49-1c3310a970fc/os-volume_attachments => generated 194 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:13:58.119327 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-38740f09-e8a0-4532-9cdf-69741b9b54e5 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:58.119949 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-38740f09-e8a0-4532-9cdf-69741b9b54e5 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 7e810377-eeef-436c-8fab-69fa71243a9d] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:58.135095 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-38740f09-e8a0-4532-9cdf-69741b9b54e5 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:58.139251 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-38740f09-e8a0-4532-9cdf-69741b9b54e5 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:58.140188 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-38740f09-e8a0-4532-9cdf-69741b9b54e5 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:58.141195 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-38740f09-e8a0-4532-9cdf-69741b9b54e5 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:58.141878 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-38740f09-e8a0-4532-9cdf-69741b9b54e5 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:58.143476 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-38740f09-e8a0-4532-9cdf-69741b9b54e5 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:58.198291 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-38740f09-e8a0-4532-9cdf-69741b9b54e5 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] HTTP exception thrown: Instance 7e810377-eeef-436c-8fab-69fa71243a9d could not be found. Aug 27 03:13:58.200166 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-38740f09-e8a0-4532-9cdf-69741b9b54e5 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Request method failure captured: Aug 27 03:13:58.200166 n-d-852278-4 devstack@n-api.service[134051]: request: DELETE /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d HTTP/1.1 Aug 27 03:13:58.200166 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 03:13:58.200166 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 03:13:58.200166 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 03:13:58.200166 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 03:13:58.200166 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 03:13:58.200166 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 03:13:58.200166 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 03:13:58.200166 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 03:13:58.200166 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYqWWBpisv0Y8BINTYOfeSZSS55yPb6M12y-rc1hhmIPImd6bLtUWZpUUXyiIiteGM7399fAWs_B2GKs6-_BwLz39cKeITvdmoIjDZ89MdWoiFFHRkq5uSO4e0ZVvUZ3R-WTlC_O1Cb_D8e8r6b7FTtA4CE_fUyeGUkz3HkySTmRbvk Aug 27 03:13:58.200166 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 03:13:58.200166 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 03:13:58.200166 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 03:13:58.200166 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 03:13:58.200166 n-d-852278-4 devstack@n-api.service[134051]: X-Openstack-Nova-Api-Version: 2.20 Aug 27 03:13:58.200166 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 03:13:58.200166 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 03:13:58.200166 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 819c3b9e6e3c4a868b1ba77f48ff2e56 Aug 27 03:13:58.200166 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1336453815 Aug 27 03:13:58.200166 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 03:13:58.200166 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 03:13:58.200166 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/819c3b9e6e3c4a868b1ba77f48ff2e56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_819c3b9e6e3c4a868b1ba77f48ff2e56", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/819c3b9e6e3c4a868b1ba77f48ff2e56"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/819c3b9e6e3c4a868b1ba77f48ff2e56"}]}] Aug 27 03:13:58.200166 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1336453815 Aug 27 03:13:58.200166 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 819c3b9e6e3c4a868b1ba77f48ff2e56 Aug 27 03:13:58.200166 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1336453815 Aug 27 03:13:58.200166 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-AttachVolumeShelveTestJSON-1336453815-project Aug 27 03:13:58.200166 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 03:13:58.200166 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 03:13:58.200166 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 8bf00e5925fa4227a2fe0b6b155a4ee4 Aug 27 03:13:58.200166 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1336453815-project Aug 27 03:13:58.200166 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 03:13:58.200166 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance 7e810377-eeef-436c-8fab-69fa71243a9d could not be found. Aug 27 03:13:58.200166 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '7e810377-eeef-436c-8fab-69fa71243a9d'} Aug 27 03:13:58.200166 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:13:58.200166 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:13:58.200166 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:13:58.200166 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:13:58.200166 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:13:58.200166 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:13:58.200166 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:13:58.200166 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:13:58.200166 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:13:58.200166 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:13:58.200166 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e810377-eeef-436c-8fab-69fa71243a9d could not be found. Aug 27 03:13:58.200166 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:13:58.200166 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:13:58.200166 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:13:58.200166 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:13:58.200166 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:13:58.200166 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:13:58.200166 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:13:58.200166 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:13:58.200166 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:13:58.200166 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:13:58.200166 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 03:13:58.200166 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 03:13:58.200166 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 03:13:58.200166 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 03:13:58.200166 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:13:58.200166 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:13:58.200166 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:13:58.200166 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:13:58.210502 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e810377-eeef-436c-8fab-69fa71243a9d could not be found. Aug 27 03:13:58.210502 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:13:58.210502 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:13:58.210502 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:13:58.210502 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:13:58.210502 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:13:58.210502 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:13:58.210502 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:13:58.210502 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:13:58.210502 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e810377-eeef-436c-8fab-69fa71243a9d could not be found. Aug 27 03:13:58.210502 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:13:58.210502 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-38740f09-e8a0-4532-9cdf-69741b9b54e5 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Returning 404 to user: Instance 7e810377-eeef-436c-8fab-69fa71243a9d could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:13:58.210502 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-38740f09-e8a0-4532-9cdf-69741b9b54e5 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "DELETE /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d" status: 404 len: 111 microversion: 2.20 time: 0.089725 Aug 27 03:13:58.210502 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2732/5420] 10.222.0.70 () {60 vars in 1280 bytes} [Sat Aug 27 03:13:58 2022] DELETE /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:13:58.214598 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-87d7fd21-bc55-4a7c-a72d-b90b22c986c7 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:58.215321 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-87d7fd21-bc55-4a7c-a72d-b90b22c986c7 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 7e810377-eeef-436c-8fab-69fa71243a9d] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:58.233484 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-87d7fd21-bc55-4a7c-a72d-b90b22c986c7 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:58.234559 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-87d7fd21-bc55-4a7c-a72d-b90b22c986c7 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:58.235213 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-87d7fd21-bc55-4a7c-a72d-b90b22c986c7 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:58.236215 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-87d7fd21-bc55-4a7c-a72d-b90b22c986c7 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:58.238879 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-87d7fd21-bc55-4a7c-a72d-b90b22c986c7 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:58.239961 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-87d7fd21-bc55-4a7c-a72d-b90b22c986c7 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:58.284730 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-87d7fd21-bc55-4a7c-a72d-b90b22c986c7 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] HTTP exception thrown: Instance 7e810377-eeef-436c-8fab-69fa71243a9d could not be found. Aug 27 03:13:58.287788 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-87d7fd21-bc55-4a7c-a72d-b90b22c986c7 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Request method failure captured: Aug 27 03:13:58.287788 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d HTTP/1.1 Aug 27 03:13:58.287788 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 03:13:58.287788 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 03:13:58.287788 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 03:13:58.287788 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 03:13:58.287788 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 03:13:58.287788 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 03:13:58.287788 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 03:13:58.287788 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 03:13:58.287788 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYqWWBpisv0Y8BINTYOfeSZSS55yPb6M12y-rc1hhmIPImd6bLtUWZpUUXyiIiteGM7399fAWs_B2GKs6-_BwLz39cKeITvdmoIjDZ89MdWoiFFHRkq5uSO4e0ZVvUZ3R-WTlC_O1Cb_D8e8r6b7FTtA4CE_fUyeGUkz3HkySTmRbvk Aug 27 03:13:58.287788 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 03:13:58.287788 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 03:13:58.287788 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 03:13:58.287788 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 03:13:58.287788 n-d-852278-4 devstack@n-api.service[134052]: X-Openstack-Nova-Api-Version: 2.20 Aug 27 03:13:58.287788 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 03:13:58.287788 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 03:13:58.287788 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 819c3b9e6e3c4a868b1ba77f48ff2e56 Aug 27 03:13:58.287788 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1336453815 Aug 27 03:13:58.287788 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 03:13:58.287788 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 03:13:58.287788 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/819c3b9e6e3c4a868b1ba77f48ff2e56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_819c3b9e6e3c4a868b1ba77f48ff2e56", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/819c3b9e6e3c4a868b1ba77f48ff2e56"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/819c3b9e6e3c4a868b1ba77f48ff2e56"}]}] Aug 27 03:13:58.287788 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1336453815 Aug 27 03:13:58.287788 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 819c3b9e6e3c4a868b1ba77f48ff2e56 Aug 27 03:13:58.287788 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1336453815 Aug 27 03:13:58.287788 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-AttachVolumeShelveTestJSON-1336453815-project Aug 27 03:13:58.287788 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 03:13:58.287788 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 03:13:58.287788 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 8bf00e5925fa4227a2fe0b6b155a4ee4 Aug 27 03:13:58.287788 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1336453815-project Aug 27 03:13:58.287788 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 03:13:58.287788 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance 7e810377-eeef-436c-8fab-69fa71243a9d could not be found. Aug 27 03:13:58.287788 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '7e810377-eeef-436c-8fab-69fa71243a9d'} Aug 27 03:13:58.287788 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:13:58.287788 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:13:58.287788 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:13:58.287788 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:13:58.287788 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:13:58.287788 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:13:58.287788 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:13:58.287788 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:13:58.287788 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:13:58.287788 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:13:58.287788 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e810377-eeef-436c-8fab-69fa71243a9d could not be found. Aug 27 03:13:58.287788 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:13:58.287788 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:13:58.287788 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:13:58.287788 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:13:58.287788 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:13:58.287788 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:13:58.287788 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:13:58.287788 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:13:58.287788 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:13:58.287788 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:13:58.287788 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:13:58.287788 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:13:58.287788 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:13:58.287788 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:13:58.287788 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:13:58.287788 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:13:58.287788 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e810377-eeef-436c-8fab-69fa71243a9d could not be found. Aug 27 03:13:58.287788 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:13:58.287788 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:13:58.293990 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:13:58.293990 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:13:58.293990 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:13:58.293990 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:13:58.293990 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:13:58.293990 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:13:58.293990 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e810377-eeef-436c-8fab-69fa71243a9d could not be found. Aug 27 03:13:58.293990 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:13:58.296267 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-87d7fd21-bc55-4a7c-a72d-b90b22c986c7 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Returning 404 to user: Instance 7e810377-eeef-436c-8fab-69fa71243a9d could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:13:58.300637 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-87d7fd21-bc55-4a7c-a72d-b90b22c986c7 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d" status: 404 len: 111 microversion: 2.20 time: 0.093479 Aug 27 03:13:58.301656 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2689/5421] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:13:58 2022] GET /compute/v2.1/servers/7e810377-eeef-436c-8fab-69fa71243a9d => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:13:58.401473 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-65860751-c3d5-4ed2-bcfc-e38e5538145b tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-1850033745", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-615301463", "security_groups": [{"name": "tempest-secgroup-smoke-568993183"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "d3e0b537-b6c3-4361-b902-c01ea119ab90"}]}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:13:58.659686 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.network.neutron [None req-65860751-c3d5-4ed2-bcfc-e38e5538145b tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] validate_networks() for [('d3e0b537-b6c3-4361-b902-c01ea119ab90', None, None, None, None, None)] {{(pid=134051) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:13:59.646682 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-65860751-c3d5-4ed2-bcfc-e38e5538145b tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Getting quotas for project 8e6a6e91351a4d4187c894fc9562886a. Resources: dict_keys(['metadata_items']) {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:13:59.657615 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-65860751-c3d5-4ed2-bcfc-e38e5538145b tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Getting quotas for user 0ca3c3142d0449fd8c32b2d24b8da633 and project 8e6a6e91351a4d4187c894fc9562886a. Resources: dict_keys(['metadata_items']) {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:13:59.697893 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-65860751-c3d5-4ed2-bcfc-e38e5538145b tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Flavor limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:13:59.709161 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-65860751-c3d5-4ed2-bcfc-e38e5538145b tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Image limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:13:59.711208 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-65860751-c3d5-4ed2-bcfc-e38e5538145b tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Flavor pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:13:59.715451 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-65860751-c3d5-4ed2-bcfc-e38e5538145b tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Image pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:13:59.716052 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-65860751-c3d5-4ed2-bcfc-e38e5538145b tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:13:59.735898 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-65860751-c3d5-4ed2-bcfc-e38e5538145b tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:59.739633 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-65860751-c3d5-4ed2-bcfc-e38e5538145b tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:59.740104 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-65860751-c3d5-4ed2-bcfc-e38e5538145b tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:59.743608 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-65860751-c3d5-4ed2-bcfc-e38e5538145b tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:59.747976 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-65860751-c3d5-4ed2-bcfc-e38e5538145b tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:59.748833 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-65860751-c3d5-4ed2-bcfc-e38e5538145b tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:59.798626 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-65860751-c3d5-4ed2-bcfc-e38e5538145b tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Getting quotas for project 8e6a6e91351a4d4187c894fc9562886a. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:13:59.808736 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-65860751-c3d5-4ed2-bcfc-e38e5538145b tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Getting quotas for user 0ca3c3142d0449fd8c32b2d24b8da633 and project 8e6a6e91351a4d4187c894fc9562886a. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:13:59.825947 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-65860751-c3d5-4ed2-bcfc-e38e5538145b tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Going to run 1 instances... {{(pid=134051) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:13:59.828714 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-65860751-c3d5-4ed2-bcfc-e38e5538145b tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] [instance: 87d21254-70b6-4272-9b1f-23556ead1aa4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134051) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:14:00.015851 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-65860751-c3d5-4ed2-bcfc-e38e5538145b tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.619124 Aug 27 03:14:00.016863 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2733/5422] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 03:13:58 2022] POST /compute/v2.1/servers => generated 405 bytes in 1621 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:14:00.027676 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-50849f07-16f4-4ed8-9d6f-8c6de5e37fe5 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:00.028421 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-50849f07-16f4-4ed8-9d6f-8c6de5e37fe5 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] [instance: 87d21254-70b6-4272-9b1f-23556ead1aa4] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:00.145423 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-50849f07-16f4-4ed8-9d6f-8c6de5e37fe5 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca3c3142d0449fd8c32b2d24b8da633', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6a6e91351a4d4187c894fc9562886a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:00.154482 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-50849f07-16f4-4ed8-9d6f-8c6de5e37fe5 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] 10.222.0.70 "GET /compute/v2.1/servers/87d21254-70b6-4272-9b1f-23556ead1aa4" status: 200 len: 1302 microversion: 2.1 time: 0.130778 Aug 27 03:14:00.177303 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2690/5423] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:00 2022] GET /compute/v2.1/servers/87d21254-70b6-4272-9b1f-23556ead1aa4 => generated 1302 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:01.177034 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-9c7a8b58-b912-4172-a868-cd6d23e1431b tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:01.177594 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-9c7a8b58-b912-4172-a868-cd6d23e1431b tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] [instance: 87d21254-70b6-4272-9b1f-23556ead1aa4] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:01.195989 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9c7a8b58-b912-4172-a868-cd6d23e1431b tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:01.196529 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9c7a8b58-b912-4172-a868-cd6d23e1431b tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:01.208388 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9c7a8b58-b912-4172-a868-cd6d23e1431b tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:01.209699 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9c7a8b58-b912-4172-a868-cd6d23e1431b tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:01.211189 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9c7a8b58-b912-4172-a868-cd6d23e1431b tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:01.211762 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9c7a8b58-b912-4172-a868-cd6d23e1431b tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:01.423544 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-9c7a8b58-b912-4172-a868-cd6d23e1431b tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca3c3142d0449fd8c32b2d24b8da633', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6a6e91351a4d4187c894fc9562886a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:01.446229 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-9c7a8b58-b912-4172-a868-cd6d23e1431b tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] 10.222.0.70 "GET /compute/v2.1/servers/87d21254-70b6-4272-9b1f-23556ead1aa4" status: 200 len: 1306 microversion: 2.1 time: 0.274138 Aug 27 03:14:01.464588 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2734/5424] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:01 2022] GET /compute/v2.1/servers/87d21254-70b6-4272-9b1f-23556ead1aa4 => generated 1306 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:02.479349 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0cee0310-bf56-442f-aac9-2979d558b411 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:02.481068 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-0cee0310-bf56-442f-aac9-2979d558b411 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] [instance: 87d21254-70b6-4272-9b1f-23556ead1aa4] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:02.490250 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0cee0310-bf56-442f-aac9-2979d558b411 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:02.491242 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0cee0310-bf56-442f-aac9-2979d558b411 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:02.491869 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0cee0310-bf56-442f-aac9-2979d558b411 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:02.493562 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0cee0310-bf56-442f-aac9-2979d558b411 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:02.494186 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0cee0310-bf56-442f-aac9-2979d558b411 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:02.494797 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0cee0310-bf56-442f-aac9-2979d558b411 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:02.621001 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0cee0310-bf56-442f-aac9-2979d558b411 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca3c3142d0449fd8c32b2d24b8da633', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6a6e91351a4d4187c894fc9562886a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:02.634478 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-0cee0310-bf56-442f-aac9-2979d558b411 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] 10.222.0.70 "GET /compute/v2.1/servers/87d21254-70b6-4272-9b1f-23556ead1aa4" status: 200 len: 1360 microversion: 2.1 time: 0.159348 Aug 27 03:14:02.651265 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2691/5425] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:02 2022] GET /compute/v2.1/servers/87d21254-70b6-4272-9b1f-23556ead1aa4 => generated 1360 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:03.661401 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a36334ed-1a44-4eac-b8a9-4f14de396275 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:03.663286 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-a36334ed-1a44-4eac-b8a9-4f14de396275 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] [instance: 87d21254-70b6-4272-9b1f-23556ead1aa4] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:03.677476 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a36334ed-1a44-4eac-b8a9-4f14de396275 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:03.679938 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a36334ed-1a44-4eac-b8a9-4f14de396275 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:03.681082 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a36334ed-1a44-4eac-b8a9-4f14de396275 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:03.682150 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a36334ed-1a44-4eac-b8a9-4f14de396275 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:03.692886 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a36334ed-1a44-4eac-b8a9-4f14de396275 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:03.694270 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a36334ed-1a44-4eac-b8a9-4f14de396275 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:04.153274 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-a36334ed-1a44-4eac-b8a9-4f14de396275 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca3c3142d0449fd8c32b2d24b8da633', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6a6e91351a4d4187c894fc9562886a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:04.162276 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a36334ed-1a44-4eac-b8a9-4f14de396275 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] 10.222.0.70 "GET /compute/v2.1/servers/87d21254-70b6-4272-9b1f-23556ead1aa4" status: 200 len: 1427 microversion: 2.1 time: 0.507037 Aug 27 03:14:04.179627 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2735/5426] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:03 2022] GET /compute/v2.1/servers/87d21254-70b6-4272-9b1f-23556ead1aa4 => generated 1427 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:04.654723 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-f452409e-c01e-4453-9a0b-5d5d951ada35 req-a327b093-43f5-4a14-9753-c2bf1ecf5873 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87d21254-70b6-4272-9b1f-23556ead1aa4", "tag": "c3159f4d-cd03-47f3-bdfb-8d68dbc1dd88"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:14:04.676356 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-f452409e-c01e-4453-9a0b-5d5d951ada35 req-a327b093-43f5-4a14-9753-c2bf1ecf5873 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:04.676858 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-f452409e-c01e-4453-9a0b-5d5d951ada35 req-a327b093-43f5-4a14-9753-c2bf1ecf5873 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:04.677291 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-f452409e-c01e-4453-9a0b-5d5d951ada35 req-a327b093-43f5-4a14-9753-c2bf1ecf5873 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:04.702025 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-f452409e-c01e-4453-9a0b-5d5d951ada35 req-a327b093-43f5-4a14-9753-c2bf1ecf5873 service nova] Creating event network-changed:c3159f4d-cd03-47f3-bdfb-8d68dbc1dd88 for instance 87d21254-70b6-4272-9b1f-23556ead1aa4 on n-h2-852278-4 Aug 27 03:14:04.732738 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-f452409e-c01e-4453-9a0b-5d5d951ada35 req-a327b093-43f5-4a14-9753-c2bf1ecf5873 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076488 Aug 27 03:14:04.732738 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2692/5427] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:14:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:14:05.189076 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b1c7aa10-af4e-4d73-a9ff-eb8039be3604 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:05.190577 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b1c7aa10-af4e-4d73-a9ff-eb8039be3604 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] [instance: 87d21254-70b6-4272-9b1f-23556ead1aa4] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:05.204611 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b1c7aa10-af4e-4d73-a9ff-eb8039be3604 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:05.207348 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b1c7aa10-af4e-4d73-a9ff-eb8039be3604 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:05.209305 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b1c7aa10-af4e-4d73-a9ff-eb8039be3604 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:05.210357 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b1c7aa10-af4e-4d73-a9ff-eb8039be3604 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:05.212563 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b1c7aa10-af4e-4d73-a9ff-eb8039be3604 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:05.213188 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b1c7aa10-af4e-4d73-a9ff-eb8039be3604 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:05.495400 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-b1c7aa10-af4e-4d73-a9ff-eb8039be3604 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca3c3142d0449fd8c32b2d24b8da633', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6a6e91351a4d4187c894fc9562886a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:05.505059 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b1c7aa10-af4e-4d73-a9ff-eb8039be3604 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] 10.222.0.70 "GET /compute/v2.1/servers/87d21254-70b6-4272-9b1f-23556ead1aa4" status: 200 len: 1427 microversion: 2.1 time: 0.322004 Aug 27 03:14:05.520979 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2736/5428] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:05 2022] GET /compute/v2.1/servers/87d21254-70b6-4272-9b1f-23556ead1aa4 => generated 1427 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:06.530393 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-7fc0c05f-b976-4430-b001-f900b491aca6 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:06.530393 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-7fc0c05f-b976-4430-b001-f900b491aca6 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] [instance: 87d21254-70b6-4272-9b1f-23556ead1aa4] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:06.551060 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7fc0c05f-b976-4430-b001-f900b491aca6 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:06.551657 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7fc0c05f-b976-4430-b001-f900b491aca6 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:06.552005 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7fc0c05f-b976-4430-b001-f900b491aca6 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:06.552731 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7fc0c05f-b976-4430-b001-f900b491aca6 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:06.553175 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7fc0c05f-b976-4430-b001-f900b491aca6 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:06.553653 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7fc0c05f-b976-4430-b001-f900b491aca6 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:07.050005 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-7fc0c05f-b976-4430-b001-f900b491aca6 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca3c3142d0449fd8c32b2d24b8da633', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6a6e91351a4d4187c894fc9562886a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:07.060797 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-7fc0c05f-b976-4430-b001-f900b491aca6 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] 10.222.0.70 "GET /compute/v2.1/servers/87d21254-70b6-4272-9b1f-23556ead1aa4" status: 200 len: 1427 microversion: 2.1 time: 0.537456 Aug 27 03:14:07.078258 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2693/5429] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:06 2022] GET /compute/v2.1/servers/87d21254-70b6-4272-9b1f-23556ead1aa4 => generated 1427 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:07.509148 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-9b6a9abb-fb51-4f3e-8901-5ddc537a6c3b tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:07.510306 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-9b6a9abb-fb51-4f3e-8901-5ddc537a6c3b tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:07.519059 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9b6a9abb-fb51-4f3e-8901-5ddc537a6c3b tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:07.519587 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9b6a9abb-fb51-4f3e-8901-5ddc537a6c3b tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:07.520019 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9b6a9abb-fb51-4f3e-8901-5ddc537a6c3b tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:07.520765 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9b6a9abb-fb51-4f3e-8901-5ddc537a6c3b tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:07.521210 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9b6a9abb-fb51-4f3e-8901-5ddc537a6c3b tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:07.521628 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9b6a9abb-fb51-4f3e-8901-5ddc537a6c3b tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:07.543977 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-9b6a9abb-fb51-4f3e-8901-5ddc537a6c3b tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] HTTP exception thrown: Instance 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22 could not be found. Aug 27 03:14:07.546770 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-9b6a9abb-fb51-4f3e-8901-5ddc537a6c3b tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Request method failure captured: Aug 27 03:14:07.546770 n-d-852278-4 devstack@n-api.service[134051]: request: DELETE /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22 HTTP/1.1 Aug 27 03:14:07.546770 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 03:14:07.546770 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 03:14:07.546770 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 03:14:07.546770 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 03:14:07.546770 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 03:14:07.546770 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 03:14:07.546770 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 03:14:07.546770 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 03:14:07.546770 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYqWWBpisv0Y8BINTYOfeSZSS55yPb6M12y-rc1hhmIPImd6bLtUWZpUUXyiIiteGM7399fAWs_B2GKs6-_BwLz39cKeITvdmoIjDZ89MdWoiFFHRkq5uSO4e0ZVvUZ3R-WTlC_O1Cb_D8e8r6b7FTtA4CE_fUyeGUkz3HkySTmRbvk Aug 27 03:14:07.546770 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 03:14:07.546770 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 03:14:07.546770 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 03:14:07.546770 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 03:14:07.546770 n-d-852278-4 devstack@n-api.service[134051]: X-Openstack-Nova-Api-Version: 2.20 Aug 27 03:14:07.546770 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 03:14:07.546770 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 03:14:07.546770 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 819c3b9e6e3c4a868b1ba77f48ff2e56 Aug 27 03:14:07.546770 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1336453815 Aug 27 03:14:07.546770 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 03:14:07.546770 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 03:14:07.546770 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/819c3b9e6e3c4a868b1ba77f48ff2e56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_819c3b9e6e3c4a868b1ba77f48ff2e56", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/819c3b9e6e3c4a868b1ba77f48ff2e56"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/819c3b9e6e3c4a868b1ba77f48ff2e56"}]}] Aug 27 03:14:07.546770 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1336453815 Aug 27 03:14:07.546770 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 819c3b9e6e3c4a868b1ba77f48ff2e56 Aug 27 03:14:07.546770 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1336453815 Aug 27 03:14:07.546770 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-AttachVolumeShelveTestJSON-1336453815-project Aug 27 03:14:07.546770 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 03:14:07.546770 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 03:14:07.546770 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 8bf00e5925fa4227a2fe0b6b155a4ee4 Aug 27 03:14:07.546770 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1336453815-project Aug 27 03:14:07.546770 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 03:14:07.546770 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22 could not be found. Aug 27 03:14:07.546770 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '73ee7f75-b081-4f5c-90b0-e0d1b27b9a22'} Aug 27 03:14:07.546770 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:14:07.546770 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:14:07.546770 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:14:07.546770 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:14:07.546770 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:14:07.546770 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:14:07.546770 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:14:07.546770 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:14:07.546770 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:14:07.546770 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:14:07.546770 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22 could not be found. Aug 27 03:14:07.546770 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:14:07.546770 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:14:07.546770 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:14:07.546770 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:14:07.546770 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:14:07.546770 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:14:07.546770 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:14:07.546770 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:14:07.546770 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:14:07.546770 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:14:07.546770 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 03:14:07.546770 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 03:14:07.546770 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 03:14:07.546770 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 03:14:07.546770 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:14:07.546770 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:14:07.546770 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:14:07.546770 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:14:07.551736 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22 could not be found. Aug 27 03:14:07.551736 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:14:07.551736 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:14:07.551736 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:14:07.551736 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:14:07.551736 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:14:07.551736 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:14:07.551736 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:14:07.551736 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:14:07.551736 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22 could not be found. Aug 27 03:14:07.551736 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:14:07.553746 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-9b6a9abb-fb51-4f3e-8901-5ddc537a6c3b tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Returning 404 to user: Instance 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:14:07.555936 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-9b6a9abb-fb51-4f3e-8901-5ddc537a6c3b tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "DELETE /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22" status: 404 len: 111 microversion: 2.20 time: 0.052568 Aug 27 03:14:07.557356 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2737/5430] 10.222.0.70 () {60 vars in 1280 bytes} [Sat Aug 27 03:14:07 2022] DELETE /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:14:07.565971 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d7d51941-d7a8-433b-8eeb-2675f8a3cd59 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:07.567155 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d7d51941-d7a8-433b-8eeb-2675f8a3cd59 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] [instance: 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:07.574435 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d7d51941-d7a8-433b-8eeb-2675f8a3cd59 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:07.575152 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d7d51941-d7a8-433b-8eeb-2675f8a3cd59 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:07.575905 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d7d51941-d7a8-433b-8eeb-2675f8a3cd59 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:07.576819 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d7d51941-d7a8-433b-8eeb-2675f8a3cd59 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:07.577424 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d7d51941-d7a8-433b-8eeb-2675f8a3cd59 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:07.578008 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d7d51941-d7a8-433b-8eeb-2675f8a3cd59 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:07.592828 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-d7d51941-d7a8-433b-8eeb-2675f8a3cd59 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] HTTP exception thrown: Instance 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22 could not be found. Aug 27 03:14:07.594964 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d7d51941-d7a8-433b-8eeb-2675f8a3cd59 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Request method failure captured: Aug 27 03:14:07.594964 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22 HTTP/1.1 Aug 27 03:14:07.594964 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 03:14:07.594964 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 03:14:07.594964 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 03:14:07.594964 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 03:14:07.594964 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 03:14:07.594964 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 03:14:07.594964 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 03:14:07.594964 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 03:14:07.594964 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYqWWBpisv0Y8BINTYOfeSZSS55yPb6M12y-rc1hhmIPImd6bLtUWZpUUXyiIiteGM7399fAWs_B2GKs6-_BwLz39cKeITvdmoIjDZ89MdWoiFFHRkq5uSO4e0ZVvUZ3R-WTlC_O1Cb_D8e8r6b7FTtA4CE_fUyeGUkz3HkySTmRbvk Aug 27 03:14:07.594964 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 03:14:07.594964 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 03:14:07.594964 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 03:14:07.594964 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 03:14:07.594964 n-d-852278-4 devstack@n-api.service[134052]: X-Openstack-Nova-Api-Version: 2.20 Aug 27 03:14:07.594964 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 03:14:07.594964 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 03:14:07.594964 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 819c3b9e6e3c4a868b1ba77f48ff2e56 Aug 27 03:14:07.594964 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1336453815 Aug 27 03:14:07.594964 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 03:14:07.594964 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 03:14:07.594964 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/819c3b9e6e3c4a868b1ba77f48ff2e56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_819c3b9e6e3c4a868b1ba77f48ff2e56", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/819c3b9e6e3c4a868b1ba77f48ff2e56"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/819c3b9e6e3c4a868b1ba77f48ff2e56"}]}] Aug 27 03:14:07.594964 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1336453815 Aug 27 03:14:07.594964 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 819c3b9e6e3c4a868b1ba77f48ff2e56 Aug 27 03:14:07.594964 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1336453815 Aug 27 03:14:07.594964 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-AttachVolumeShelveTestJSON-1336453815-project Aug 27 03:14:07.594964 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 03:14:07.594964 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 03:14:07.594964 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 8bf00e5925fa4227a2fe0b6b155a4ee4 Aug 27 03:14:07.594964 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1336453815-project Aug 27 03:14:07.594964 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 03:14:07.594964 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22 could not be found. Aug 27 03:14:07.594964 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '73ee7f75-b081-4f5c-90b0-e0d1b27b9a22'} Aug 27 03:14:07.594964 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:14:07.594964 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:14:07.594964 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:14:07.594964 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:14:07.594964 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:14:07.594964 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:14:07.594964 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:14:07.594964 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:14:07.594964 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:14:07.594964 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:14:07.594964 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22 could not be found. Aug 27 03:14:07.594964 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:14:07.594964 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:14:07.594964 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:14:07.594964 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:14:07.594964 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:14:07.594964 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:14:07.594964 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:14:07.594964 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:14:07.594964 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:14:07.594964 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:14:07.594964 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:14:07.594964 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:14:07.594964 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:14:07.594964 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:14:07.594964 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:14:07.594964 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:14:07.594964 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22 could not be found. Aug 27 03:14:07.594964 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:14:07.594964 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:14:07.600660 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:14:07.600660 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:14:07.600660 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:14:07.600660 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:14:07.600660 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:14:07.600660 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:14:07.600660 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22 could not be found. Aug 27 03:14:07.600660 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:14:07.602207 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d7d51941-d7a8-433b-8eeb-2675f8a3cd59 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] Returning 404 to user: Instance 73ee7f75-b081-4f5c-90b0-e0d1b27b9a22 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:14:07.603440 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d7d51941-d7a8-433b-8eeb-2675f8a3cd59 tempest-AttachVolumeShelveTestJSON-1336453815 tempest-AttachVolumeShelveTestJSON-1336453815-project] 10.222.0.70 "GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22" status: 404 len: 111 microversion: 2.20 time: 0.041491 Aug 27 03:14:07.608284 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2694/5431] 10.222.0.70 () {60 vars in 1277 bytes} [Sat Aug 27 03:14:07 2022] GET /compute/v2.1/servers/73ee7f75-b081-4f5c-90b0-e0d1b27b9a22 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:14:08.087447 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-dd84998c-6d9e-4662-88c5-e21dab913284 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:08.088072 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-dd84998c-6d9e-4662-88c5-e21dab913284 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] [instance: 87d21254-70b6-4272-9b1f-23556ead1aa4] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:08.106125 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dd84998c-6d9e-4662-88c5-e21dab913284 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:08.107288 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dd84998c-6d9e-4662-88c5-e21dab913284 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:08.107713 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dd84998c-6d9e-4662-88c5-e21dab913284 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:08.109830 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dd84998c-6d9e-4662-88c5-e21dab913284 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:08.112981 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dd84998c-6d9e-4662-88c5-e21dab913284 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:08.113626 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dd84998c-6d9e-4662-88c5-e21dab913284 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:08.403400 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-dd84998c-6d9e-4662-88c5-e21dab913284 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca3c3142d0449fd8c32b2d24b8da633', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6a6e91351a4d4187c894fc9562886a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:08.414141 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-dd84998c-6d9e-4662-88c5-e21dab913284 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] 10.222.0.70 "GET /compute/v2.1/servers/87d21254-70b6-4272-9b1f-23556ead1aa4" status: 200 len: 1427 microversion: 2.1 time: 0.331972 Aug 27 03:14:08.415593 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2738/5432] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:08 2022] GET /compute/v2.1/servers/87d21254-70b6-4272-9b1f-23556ead1aa4 => generated 1427 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:09.440740 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-65a354c2-b9d2-4dd4-a6bc-e87178fd89b1 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:09.442286 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-65a354c2-b9d2-4dd4-a6bc-e87178fd89b1 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] [instance: 87d21254-70b6-4272-9b1f-23556ead1aa4] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:09.455373 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-65a354c2-b9d2-4dd4-a6bc-e87178fd89b1 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:09.455373 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-65a354c2-b9d2-4dd4-a6bc-e87178fd89b1 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:09.455373 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-65a354c2-b9d2-4dd4-a6bc-e87178fd89b1 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:09.461484 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-65a354c2-b9d2-4dd4-a6bc-e87178fd89b1 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:09.461996 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-65a354c2-b9d2-4dd4-a6bc-e87178fd89b1 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:09.462441 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-65a354c2-b9d2-4dd4-a6bc-e87178fd89b1 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:09.635973 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-65a354c2-b9d2-4dd4-a6bc-e87178fd89b1 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca3c3142d0449fd8c32b2d24b8da633', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6a6e91351a4d4187c894fc9562886a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:09.644499 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-65a354c2-b9d2-4dd4-a6bc-e87178fd89b1 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] 10.222.0.70 "GET /compute/v2.1/servers/87d21254-70b6-4272-9b1f-23556ead1aa4" status: 200 len: 1427 microversion: 2.1 time: 0.208803 Aug 27 03:14:09.645079 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2695/5433] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:09 2022] GET /compute/v2.1/servers/87d21254-70b6-4272-9b1f-23556ead1aa4 => generated 1427 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:09.916719 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-8dabe50e-157f-4bd9-b07c-c7f398175caf req-13f8cc6b-7e37-495b-878f-bcfc03312a28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87d21254-70b6-4272-9b1f-23556ead1aa4", "name": "network-vif-plugged", "status": "completed", "tag": "c3159f4d-cd03-47f3-bdfb-8d68dbc1dd88"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:14:09.925589 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:14:09.928929 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=14 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:14:09.946926 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-8dabe50e-157f-4bd9-b07c-c7f398175caf req-13f8cc6b-7e37-495b-878f-bcfc03312a28 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:09.947711 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-8dabe50e-157f-4bd9-b07c-c7f398175caf req-13f8cc6b-7e37-495b-878f-bcfc03312a28 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:09.948352 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-8dabe50e-157f-4bd9-b07c-c7f398175caf req-13f8cc6b-7e37-495b-878f-bcfc03312a28 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:09.985338 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-8dabe50e-157f-4bd9-b07c-c7f398175caf req-13f8cc6b-7e37-495b-878f-bcfc03312a28 service nova] Creating event network-vif-plugged:c3159f4d-cd03-47f3-bdfb-8d68dbc1dd88 for instance 87d21254-70b6-4272-9b1f-23556ead1aa4 on n-h2-852278-4 Aug 27 03:14:09.995324 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-8dabe50e-157f-4bd9-b07c-c7f398175caf req-13f8cc6b-7e37-495b-878f-bcfc03312a28 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083766 Aug 27 03:14:09.996698 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2739/5434] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:14:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:14:10.666337 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-dae8a59f-4f83-4ce7-b903-5d3d220579a4 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:10.666948 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-dae8a59f-4f83-4ce7-b903-5d3d220579a4 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] [instance: 87d21254-70b6-4272-9b1f-23556ead1aa4] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:10.669427 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:14:10.678612 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dae8a59f-4f83-4ce7-b903-5d3d220579a4 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:10.679052 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dae8a59f-4f83-4ce7-b903-5d3d220579a4 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:10.679521 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dae8a59f-4f83-4ce7-b903-5d3d220579a4 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:10.680291 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dae8a59f-4f83-4ce7-b903-5d3d220579a4 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:10.680768 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dae8a59f-4f83-4ce7-b903-5d3d220579a4 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:10.681191 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dae8a59f-4f83-4ce7-b903-5d3d220579a4 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:10.911571 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-dae8a59f-4f83-4ce7-b903-5d3d220579a4 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca3c3142d0449fd8c32b2d24b8da633', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6a6e91351a4d4187c894fc9562886a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:10.927227 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-dae8a59f-4f83-4ce7-b903-5d3d220579a4 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] 10.222.0.70 "GET /compute/v2.1/servers/87d21254-70b6-4272-9b1f-23556ead1aa4" status: 200 len: 1427 microversion: 2.1 time: 0.264335 Aug 27 03:14:10.928239 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2696/5435] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:10 2022] GET /compute/v2.1/servers/87d21254-70b6-4272-9b1f-23556ead1aa4 => generated 1427 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:11.957098 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-bf4965ca-ad23-4d75-b84e-176084c7791a tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:11.959511 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-bf4965ca-ad23-4d75-b84e-176084c7791a tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] [instance: 87d21254-70b6-4272-9b1f-23556ead1aa4] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:11.972059 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bf4965ca-ad23-4d75-b84e-176084c7791a tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:11.980764 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bf4965ca-ad23-4d75-b84e-176084c7791a tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:11.990902 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bf4965ca-ad23-4d75-b84e-176084c7791a tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:11.995886 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bf4965ca-ad23-4d75-b84e-176084c7791a tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:11.996687 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bf4965ca-ad23-4d75-b84e-176084c7791a tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:11.997398 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bf4965ca-ad23-4d75-b84e-176084c7791a tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:12.673175 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-bf4965ca-ad23-4d75-b84e-176084c7791a tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca3c3142d0449fd8c32b2d24b8da633', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6a6e91351a4d4187c894fc9562886a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:12.682260 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-bf4965ca-ad23-4d75-b84e-176084c7791a tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] 10.222.0.70 "GET /compute/v2.1/servers/87d21254-70b6-4272-9b1f-23556ead1aa4" status: 200 len: 1606 microversion: 2.1 time: 0.735584 Aug 27 03:14:12.682839 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2740/5436] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:11 2022] GET /compute/v2.1/servers/87d21254-70b6-4272-9b1f-23556ead1aa4 => generated 1606 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:12.702774 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-7557156c-991b-487a-9daf-fc232871a92e tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:12.703401 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-7557156c-991b-487a-9daf-fc232871a92e tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] [instance: 87d21254-70b6-4272-9b1f-23556ead1aa4] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:12.710259 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7557156c-991b-487a-9daf-fc232871a92e tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:12.710730 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7557156c-991b-487a-9daf-fc232871a92e tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:12.711475 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7557156c-991b-487a-9daf-fc232871a92e tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:12.712074 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7557156c-991b-487a-9daf-fc232871a92e tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:12.712532 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7557156c-991b-487a-9daf-fc232871a92e tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:12.712968 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7557156c-991b-487a-9daf-fc232871a92e tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:12.978570 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-7557156c-991b-487a-9daf-fc232871a92e tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca3c3142d0449fd8c32b2d24b8da633', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6a6e91351a4d4187c894fc9562886a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:12.991706 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-7557156c-991b-487a-9daf-fc232871a92e tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] 10.222.0.70 "GET /compute/v2.1/servers/87d21254-70b6-4272-9b1f-23556ead1aa4" status: 200 len: 1606 microversion: 2.1 time: 0.292635 Aug 27 03:14:12.998664 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2697/5437] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:12 2022] GET /compute/v2.1/servers/87d21254-70b6-4272-9b1f-23556ead1aa4 => generated 1606 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:13.011467 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c50b267b-1d50-4756-b0e9-b12b8f5230c3 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:13.012070 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-c50b267b-1d50-4756-b0e9-b12b8f5230c3 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] [instance: 87d21254-70b6-4272-9b1f-23556ead1aa4] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:13.031847 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c50b267b-1d50-4756-b0e9-b12b8f5230c3 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:13.032657 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c50b267b-1d50-4756-b0e9-b12b8f5230c3 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:13.033276 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c50b267b-1d50-4756-b0e9-b12b8f5230c3 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:13.034151 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c50b267b-1d50-4756-b0e9-b12b8f5230c3 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:13.034764 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c50b267b-1d50-4756-b0e9-b12b8f5230c3 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:13.035342 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c50b267b-1d50-4756-b0e9-b12b8f5230c3 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:13.311324 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-c50b267b-1d50-4756-b0e9-b12b8f5230c3 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca3c3142d0449fd8c32b2d24b8da633', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6a6e91351a4d4187c894fc9562886a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:13.322155 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c50b267b-1d50-4756-b0e9-b12b8f5230c3 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] 10.222.0.70 "GET /compute/v2.1/servers/87d21254-70b6-4272-9b1f-23556ead1aa4" status: 200 len: 1606 microversion: 2.1 time: 0.314603 Aug 27 03:14:13.333056 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2741/5438] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:13 2022] GET /compute/v2.1/servers/87d21254-70b6-4272-9b1f-23556ead1aa4 => generated 1606 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:13.762947 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-2b96427d-07c9-4fd5-b1fe-549fea26cd9c tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:13.763949 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-2b96427d-07c9-4fd5-b1fe-549fea26cd9c tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 0c24d379-bb60-46d3-8f49-1c3310a970fc] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:13.775631 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2b96427d-07c9-4fd5-b1fe-549fea26cd9c tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:13.777132 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2b96427d-07c9-4fd5-b1fe-549fea26cd9c tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:13.777876 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2b96427d-07c9-4fd5-b1fe-549fea26cd9c tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:13.780369 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2b96427d-07c9-4fd5-b1fe-549fea26cd9c tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:13.780971 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2b96427d-07c9-4fd5-b1fe-549fea26cd9c tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:13.782616 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2b96427d-07c9-4fd5-b1fe-549fea26cd9c tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:14.020866 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.instance [None req-2b96427d-07c9-4fd5-b1fe-549fea26cd9c tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lazy-loading 'services' on Instance uuid 0c24d379-bb60-46d3-8f49-1c3310a970fc {{(pid=134052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:14:14.145751 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-2b96427d-07c9-4fd5-b1fe-549fea26cd9c tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "DELETE /compute/v2.1/servers/0c24d379-bb60-46d3-8f49-1c3310a970fc/os-volume_attachments/e10094c6-d84b-4939-898e-6b187edd895b" status: 202 len: 0 microversion: 2.1 time: 0.387868 Aug 27 03:14:14.147706 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2698/5439] 10.222.0.70 () {58 vars in 1416 bytes} [Sat Aug 27 03:14:13 2022] DELETE /compute/v2.1/servers/0c24d379-bb60-46d3-8f49-1c3310a970fc/os-volume_attachments/e10094c6-d84b-4939-898e-6b187edd895b => generated 0 bytes in 392 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:14:14.156449 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-06f5ba40-deb3-4af0-adb9-46f7f819ac94 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:14.158971 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-06f5ba40-deb3-4af0-adb9-46f7f819ac94 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 0c24d379-bb60-46d3-8f49-1c3310a970fc] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:14.176086 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-06f5ba40-deb3-4af0-adb9-46f7f819ac94 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:14.176625 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-06f5ba40-deb3-4af0-adb9-46f7f819ac94 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:14.179392 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-06f5ba40-deb3-4af0-adb9-46f7f819ac94 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:14.180191 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-06f5ba40-deb3-4af0-adb9-46f7f819ac94 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:14.182005 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-06f5ba40-deb3-4af0-adb9-46f7f819ac94 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:14.183346 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-06f5ba40-deb3-4af0-adb9-46f7f819ac94 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:14.253661 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-06f5ba40-deb3-4af0-adb9-46f7f819ac94 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "GET /compute/v2.1/servers/0c24d379-bb60-46d3-8f49-1c3310a970fc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.101636 Aug 27 03:14:14.254572 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2742/5440] 10.222.0.70 () {58 vars in 1302 bytes} [Sat Aug 27 03:14:14 2022] GET /compute/v2.1/servers/0c24d379-bb60-46d3-8f49-1c3310a970fc/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:14:15.039046 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-982934d1-79ae-4570-87ed-8b4d85e59f5c tempest-VolumesGetTestJSON-1013557294 tempest-VolumesGetTestJSON-1013557294-project] Action: 'create', calling method: .version_select at 0x7f5ee23ba3a0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-701542347", "metadata": {"Type": "work"}}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:14:15.270503 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-36c42ae1-9ef7-43ba-ad17-9420527414b7 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:15.275352 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-36c42ae1-9ef7-43ba-ad17-9420527414b7 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 0c24d379-bb60-46d3-8f49-1c3310a970fc] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:15.288921 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-36c42ae1-9ef7-43ba-ad17-9420527414b7 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:15.290143 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-36c42ae1-9ef7-43ba-ad17-9420527414b7 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:15.291237 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-36c42ae1-9ef7-43ba-ad17-9420527414b7 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:15.292903 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-36c42ae1-9ef7-43ba-ad17-9420527414b7 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:15.294016 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-36c42ae1-9ef7-43ba-ad17-9420527414b7 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:15.295459 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-36c42ae1-9ef7-43ba-ad17-9420527414b7 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:15.362617 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-36c42ae1-9ef7-43ba-ad17-9420527414b7 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "GET /compute/v2.1/servers/0c24d379-bb60-46d3-8f49-1c3310a970fc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.099342 Aug 27 03:14:15.371053 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2743/5441] 10.222.0.70 () {58 vars in 1302 bytes} [Sat Aug 27 03:14:15 2022] GET /compute/v2.1/servers/0c24d379-bb60-46d3-8f49-1c3310a970fc/os-volume_attachments => generated 197 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:14:15.908446 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-982934d1-79ae-4570-87ed-8b4d85e59f5c tempest-VolumesGetTestJSON-1013557294 tempest-VolumesGetTestJSON-1013557294-project] 10.222.0.70 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 1.029424 Aug 27 03:14:15.917223 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2699/5442] 10.222.0.70 () {60 vars in 1156 bytes} [Sat Aug 27 03:14:14 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 1039 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 27 03:14:15.924531 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-13dfb8c2-e8e5-4a73-bc6d-a65fc773de3a tempest-VolumesGetTestJSON-1013557294 tempest-VolumesGetTestJSON-1013557294-project] Calling method '.version_select at 0x7f5ede97d040>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:15.942115 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-16554a49-e188-4a40-bb02-471d2b23258e req-2ed09830-e01d-465b-a86c-a86347272e2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87d21254-70b6-4272-9b1f-23556ead1aa4", "tag": "c3159f4d-cd03-47f3-bdfb-8d68dbc1dd88"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:14:15.966535 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-16554a49-e188-4a40-bb02-471d2b23258e req-2ed09830-e01d-465b-a86c-a86347272e2d service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:15.967022 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-16554a49-e188-4a40-bb02-471d2b23258e req-2ed09830-e01d-465b-a86c-a86347272e2d service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:15.967666 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-16554a49-e188-4a40-bb02-471d2b23258e req-2ed09830-e01d-465b-a86c-a86347272e2d service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:15.997583 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-16554a49-e188-4a40-bb02-471d2b23258e req-2ed09830-e01d-465b-a86c-a86347272e2d service nova] Creating event network-changed:c3159f4d-cd03-47f3-bdfb-8d68dbc1dd88 for instance 87d21254-70b6-4272-9b1f-23556ead1aa4 on n-h2-852278-4 Aug 27 03:14:16.016073 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-16554a49-e188-4a40-bb02-471d2b23258e req-2ed09830-e01d-465b-a86c-a86347272e2d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079078 Aug 27 03:14:16.017263 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2700/5443] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:14:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:14:16.186388 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-13dfb8c2-e8e5-4a73-bc6d-a65fc773de3a tempest-VolumesGetTestJSON-1013557294 tempest-VolumesGetTestJSON-1013557294-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/d2e43518-2c77-4293-99e8-5584f1600e05" status: 200 len: 352 microversion: 2.1 time: 0.268762 Aug 27 03:14:16.192359 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2744/5444] 10.222.0.70 () {58 vars in 1245 bytes} [Sat Aug 27 03:14:15 2022] GET /compute/v2.1/os-volumes/d2e43518-2c77-4293-99e8-5584f1600e05 => generated 352 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:14:16.379602 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a3cda43b-1dff-4243-8455-741a10a5aed5 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:16.382634 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a3cda43b-1dff-4243-8455-741a10a5aed5 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 0c24d379-bb60-46d3-8f49-1c3310a970fc] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:16.389632 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a3cda43b-1dff-4243-8455-741a10a5aed5 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:16.390603 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a3cda43b-1dff-4243-8455-741a10a5aed5 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:16.391283 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a3cda43b-1dff-4243-8455-741a10a5aed5 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:16.392253 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a3cda43b-1dff-4243-8455-741a10a5aed5 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:16.401827 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a3cda43b-1dff-4243-8455-741a10a5aed5 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:16.402654 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a3cda43b-1dff-4243-8455-741a10a5aed5 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:16.462304 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a3cda43b-1dff-4243-8455-741a10a5aed5 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "GET /compute/v2.1/servers/0c24d379-bb60-46d3-8f49-1c3310a970fc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087442 Aug 27 03:14:16.464462 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2701/5445] 10.222.0.70 () {58 vars in 1302 bytes} [Sat Aug 27 03:14:16 2022] GET /compute/v2.1/servers/0c24d379-bb60-46d3-8f49-1c3310a970fc/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:14:17.200206 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7cb4f303-0a53-4cb8-93d7-3d68aea62ea4 tempest-VolumesGetTestJSON-1013557294 tempest-VolumesGetTestJSON-1013557294-project] Calling method '.version_select at 0x7f5ee71c99d0>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:17.250280 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-7cb4f303-0a53-4cb8-93d7-3d68aea62ea4 tempest-VolumesGetTestJSON-1013557294 tempest-VolumesGetTestJSON-1013557294-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/d2e43518-2c77-4293-99e8-5584f1600e05" status: 200 len: 353 microversion: 2.1 time: 0.053859 Aug 27 03:14:17.251334 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2745/5446] 10.222.0.70 () {58 vars in 1245 bytes} [Sat Aug 27 03:14:17 2022] GET /compute/v2.1/os-volumes/d2e43518-2c77-4293-99e8-5584f1600e05 => generated 353 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:14:17.263830 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b7467e98-40cd-42ca-a852-350739623ccf tempest-VolumesGetTestJSON-1013557294 tempest-VolumesGetTestJSON-1013557294-project] Calling method '.version_select at 0x7f5ee23ba5e0>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:17.320946 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b7467e98-40cd-42ca-a852-350739623ccf tempest-VolumesGetTestJSON-1013557294 tempest-VolumesGetTestJSON-1013557294-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/d2e43518-2c77-4293-99e8-5584f1600e05" status: 200 len: 353 microversion: 2.1 time: 0.061533 Aug 27 03:14:17.321726 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2702/5447] 10.222.0.70 () {58 vars in 1245 bytes} [Sat Aug 27 03:14:17 2022] GET /compute/v2.1/os-volumes/d2e43518-2c77-4293-99e8-5584f1600e05 => generated 353 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:14:17.338595 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-785cf1d9-3661-48c2-af12-f00349f258cb tempest-VolumesGetTestJSON-1013557294 tempest-VolumesGetTestJSON-1013557294-project] Calling method '.version_select at 0x7f5eddab81f0>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:17.412484 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-785cf1d9-3661-48c2-af12-f00349f258cb tempest-VolumesGetTestJSON-1013557294 tempest-VolumesGetTestJSON-1013557294-project] 10.222.0.70 "DELETE /compute/v2.1/os-volumes/d2e43518-2c77-4293-99e8-5584f1600e05" status: 202 len: 0 microversion: 2.1 time: 0.079359 Aug 27 03:14:17.416089 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2746/5448] 10.222.0.70 () {58 vars in 1248 bytes} [Sat Aug 27 03:14:17 2022] DELETE /compute/v2.1/os-volumes/d2e43518-2c77-4293-99e8-5584f1600e05 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:14:17.422051 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-11e84375-ee17-457d-8ca0-f096b79ab776 tempest-VolumesGetTestJSON-1013557294 tempest-VolumesGetTestJSON-1013557294-project] Calling method '.version_select at 0x7f5ee727b790>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:17.477122 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-98c835c7-bf7e-4e1c-b137-c2cbdc770c86 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:17.482663 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-11e84375-ee17-457d-8ca0-f096b79ab776 tempest-VolumesGetTestJSON-1013557294 tempest-VolumesGetTestJSON-1013557294-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/d2e43518-2c77-4293-99e8-5584f1600e05" status: 200 len: 352 microversion: 2.1 time: 0.064883 Aug 27 03:14:17.483258 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2703/5449] 10.222.0.70 () {58 vars in 1245 bytes} [Sat Aug 27 03:14:17 2022] GET /compute/v2.1/os-volumes/d2e43518-2c77-4293-99e8-5584f1600e05 => generated 352 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:14:17.489501 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-98c835c7-bf7e-4e1c-b137-c2cbdc770c86 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 0c24d379-bb60-46d3-8f49-1c3310a970fc] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:17.491721 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=72,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:14:17.512008 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-98c835c7-bf7e-4e1c-b137-c2cbdc770c86 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:17.512914 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-98c835c7-bf7e-4e1c-b137-c2cbdc770c86 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:17.513558 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-98c835c7-bf7e-4e1c-b137-c2cbdc770c86 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:17.514288 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-98c835c7-bf7e-4e1c-b137-c2cbdc770c86 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:17.514743 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-98c835c7-bf7e-4e1c-b137-c2cbdc770c86 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:17.515169 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-98c835c7-bf7e-4e1c-b137-c2cbdc770c86 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:17.518579 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=87 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:14:17.553904 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-98c835c7-bf7e-4e1c-b137-c2cbdc770c86 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "GET /compute/v2.1/servers/0c24d379-bb60-46d3-8f49-1c3310a970fc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082185 Aug 27 03:14:17.555136 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2747/5450] 10.222.0.70 () {58 vars in 1302 bytes} [Sat Aug 27 03:14:17 2022] GET /compute/v2.1/servers/0c24d379-bb60-46d3-8f49-1c3310a970fc/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:14:18.498064 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-7ae10f49-fc65-4180-94fd-62496e54f607 tempest-VolumesGetTestJSON-1013557294 tempest-VolumesGetTestJSON-1013557294-project] Calling method '.version_select at 0x7f5ee718d700>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:18.569124 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-5a66b129-404b-4121-ab2a-de628bbd6002 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:18.571915 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-5a66b129-404b-4121-ab2a-de628bbd6002 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 0c24d379-bb60-46d3-8f49-1c3310a970fc] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:18.574053 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-7ae10f49-fc65-4180-94fd-62496e54f607 tempest-VolumesGetTestJSON-1013557294 tempest-VolumesGetTestJSON-1013557294-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/d2e43518-2c77-4293-99e8-5584f1600e05" status: 200 len: 352 microversion: 2.1 time: 0.081708 Aug 27 03:14:18.575132 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2704/5451] 10.222.0.70 () {58 vars in 1245 bytes} [Sat Aug 27 03:14:18 2022] GET /compute/v2.1/os-volumes/d2e43518-2c77-4293-99e8-5584f1600e05 => generated 352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:14:18.593130 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5a66b129-404b-4121-ab2a-de628bbd6002 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:18.593957 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5a66b129-404b-4121-ab2a-de628bbd6002 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:18.594711 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5a66b129-404b-4121-ab2a-de628bbd6002 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:18.595493 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5a66b129-404b-4121-ab2a-de628bbd6002 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:18.596929 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5a66b129-404b-4121-ab2a-de628bbd6002 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:18.597572 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5a66b129-404b-4121-ab2a-de628bbd6002 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:18.630333 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-5a66b129-404b-4121-ab2a-de628bbd6002 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "GET /compute/v2.1/servers/0c24d379-bb60-46d3-8f49-1c3310a970fc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066604 Aug 27 03:14:18.631026 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2748/5452] 10.222.0.70 () {58 vars in 1302 bytes} [Sat Aug 27 03:14:18 2022] GET /compute/v2.1/servers/0c24d379-bb60-46d3-8f49-1c3310a970fc/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:14:19.588928 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6eb59567-f7b3-4f89-ab37-423c9014da48 tempest-VolumesGetTestJSON-1013557294 tempest-VolumesGetTestJSON-1013557294-project] Calling method '.version_select at 0x7f5ee23f89d0>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:19.643762 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c73b09f4-4261-4b72-8c46-f90182bcd925 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:19.646120 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-c73b09f4-4261-4b72-8c46-f90182bcd925 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 0c24d379-bb60-46d3-8f49-1c3310a970fc] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:19.660825 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c73b09f4-4261-4b72-8c46-f90182bcd925 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:19.661331 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c73b09f4-4261-4b72-8c46-f90182bcd925 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:19.661994 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c73b09f4-4261-4b72-8c46-f90182bcd925 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:19.663046 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c73b09f4-4261-4b72-8c46-f90182bcd925 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:19.663729 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c73b09f4-4261-4b72-8c46-f90182bcd925 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:19.664380 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c73b09f4-4261-4b72-8c46-f90182bcd925 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:19.699569 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-6eb59567-f7b3-4f89-ab37-423c9014da48 tempest-VolumesGetTestJSON-1013557294 tempest-VolumesGetTestJSON-1013557294-project] HTTP exception thrown: Volume d2e43518-2c77-4293-99e8-5584f1600e05 could not be found. Aug 27 03:14:19.736702 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6eb59567-f7b3-4f89-ab37-423c9014da48 tempest-VolumesGetTestJSON-1013557294 tempest-VolumesGetTestJSON-1013557294-project] Request method failure captured: Aug 27 03:14:19.736702 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/os-volumes/d2e43518-2c77-4293-99e8-5584f1600e05 HTTP/1.1 Aug 27 03:14:19.736702 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 03:14:19.736702 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 03:14:19.736702 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 03:14:19.736702 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 03:14:19.736702 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 03:14:19.736702 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 03:14:19.736702 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 03:14:19.736702 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 03:14:19.736702 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYwGEUxeykxExOM8y0VN0DtAETfGF44v4wiHIgh1nyNtrIYpmb0c4hamyjuBeo_fTqrcoxBtgbNwVstMT6EtXAJp1IGh2qcFZSi3ZtHyJ7Duf4s97BKr90PFQigrobw6i_eImoeP-dgRQTPWgK3f_eZ66ZPdiTsf7ilMB6nifjfs_UA Aug 27 03:14:19.736702 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 03:14:19.736702 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 03:14:19.736702 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 03:14:19.736702 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 03:14:19.736702 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 03:14:19.736702 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 03:14:19.736702 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 0c9e4b999a1a40c9b36ffe2fd8f1fe0d Aug 27 03:14:19.736702 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-VolumesGetTestJSON-1013557294 Aug 27 03:14:19.736702 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 03:14:19.736702 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 03:14:19.736702 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0c9e4b999a1a40c9b36ffe2fd8f1fe0d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_0c9e4b999a1a40c9b36ffe2fd8f1fe0d", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0c9e4b999a1a40c9b36ffe2fd8f1fe0d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/0c9e4b999a1a40c9b36ffe2fd8f1fe0d"}]}] Aug 27 03:14:19.736702 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-VolumesGetTestJSON-1013557294 Aug 27 03:14:19.736702 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 0c9e4b999a1a40c9b36ffe2fd8f1fe0d Aug 27 03:14:19.736702 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-VolumesGetTestJSON-1013557294 Aug 27 03:14:19.736702 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-VolumesGetTestJSON-1013557294-project Aug 27 03:14:19.736702 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 03:14:19.736702 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 03:14:19.736702 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: ac7f12995ce8426ab4c6a29d3c0933e9 Aug 27 03:14:19.736702 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-VolumesGetTestJSON-1013557294-project Aug 27 03:14:19.736702 n-d-852278-4 devstack@n-api.service[134052]: method: Aug 27 03:14:19.736702 n-d-852278-4 devstack@n-api.service[134052]: exception: Volume d2e43518-2c77-4293-99e8-5584f1600e05 could not be found. Aug 27 03:14:19.736702 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': 'd2e43518-2c77-4293-99e8-5584f1600e05'} Aug 27 03:14:19.736702 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:14:19.736702 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:14:19.736702 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 03:14:19.736702 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 03:14:19.736702 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 27 03:14:19.736702 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 27 03:14:19.736702 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 27 03:14:19.736702 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 27 03:14:19.736702 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 27 03:14:19.736702 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 27 03:14:19.736702 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 27 03:14:19.736702 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 27 03:14:19.736702 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 03:14:19.736702 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 03:14:19.736702 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 03:14:19.736702 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 03:14:19.736702 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d2e43518-2c77-4293-99e8-5584f1600e05 could not be found. (HTTP 404) (Request-ID: req-457680f0-64aa-499a-9e2d-6f686ca10881) Aug 27 03:14:19.736702 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:14:19.736702 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:14:19.736702 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:14:19.736702 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:14:19.736702 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 27 03:14:19.736702 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 27 03:14:19.736702 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 27 03:14:19.736702 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 27 03:14:19.736702 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 27 03:14:19.736702 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 27 03:14:19.736702 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 27 03:14:19.736702 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 27 03:14:19.736702 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 03:14:19.746256 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 03:14:19.746256 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 27 03:14:19.746256 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 27 03:14:19.746256 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 27 03:14:19.746256 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 27 03:14:19.746256 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 27 03:14:19.746256 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 27 03:14:19.746256 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 27 03:14:19.746256 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 27 03:14:19.746256 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 03:14:19.746256 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 03:14:19.746256 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 03:14:19.746256 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 03:14:19.746256 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d2e43518-2c77-4293-99e8-5584f1600e05 could not be found. Aug 27 03:14:19.746256 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:14:19.746256 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:14:19.746256 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:14:19.746256 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:14:19.746256 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:14:19.746256 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:14:19.746256 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:14:19.746256 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:14:19.746256 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:14:19.746256 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:14:19.746256 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:14:19.746256 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:14:19.746256 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 27 03:14:19.746256 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:14:19.746256 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d2e43518-2c77-4293-99e8-5584f1600e05 could not be found. Aug 27 03:14:19.746256 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:14:19.746256 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:14:19.746256 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:14:19.746256 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:14:19.746256 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:14:19.746256 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:14:19.746256 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:14:19.746256 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:14:19.746256 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d2e43518-2c77-4293-99e8-5584f1600e05 could not be found. Aug 27 03:14:19.746256 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:14:19.746256 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6eb59567-f7b3-4f89-ab37-423c9014da48 tempest-VolumesGetTestJSON-1013557294 tempest-VolumesGetTestJSON-1013557294-project] Returning 404 to user: Volume d2e43518-2c77-4293-99e8-5584f1600e05 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:14:19.746256 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-6eb59567-f7b3-4f89-ab37-423c9014da48 tempest-VolumesGetTestJSON-1013557294 tempest-VolumesGetTestJSON-1013557294-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/d2e43518-2c77-4293-99e8-5584f1600e05" status: 404 len: 109 microversion: 2.1 time: 0.154110 Aug 27 03:14:19.746256 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2705/5453] 10.222.0.70 () {58 vars in 1245 bytes} [Sat Aug 27 03:14:19 2022] GET /compute/v2.1/os-volumes/d2e43518-2c77-4293-99e8-5584f1600e05 => generated 109 bytes in 156 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:14:19.757220 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c73b09f4-4261-4b72-8c46-f90182bcd925 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "GET /compute/v2.1/servers/0c24d379-bb60-46d3-8f49-1c3310a970fc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.099954 Aug 27 03:14:19.770951 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2749/5454] 10.222.0.70 () {58 vars in 1302 bytes} [Sat Aug 27 03:14:19 2022] GET /compute/v2.1/servers/0c24d379-bb60-46d3-8f49-1c3310a970fc/os-volume_attachments => generated 197 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:14:20.762257 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a078befc-17a5-4fac-9599-44b00601e346 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:20.766415 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a078befc-17a5-4fac-9599-44b00601e346 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 0c24d379-bb60-46d3-8f49-1c3310a970fc] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:20.770818 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:14:20.779677 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a078befc-17a5-4fac-9599-44b00601e346 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:20.781210 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a078befc-17a5-4fac-9599-44b00601e346 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:20.781815 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a078befc-17a5-4fac-9599-44b00601e346 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:20.782944 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a078befc-17a5-4fac-9599-44b00601e346 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:20.783556 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a078befc-17a5-4fac-9599-44b00601e346 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:20.784166 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a078befc-17a5-4fac-9599-44b00601e346 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:20.810191 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:14:20.826002 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a078befc-17a5-4fac-9599-44b00601e346 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "GET /compute/v2.1/servers/0c24d379-bb60-46d3-8f49-1c3310a970fc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.069216 Aug 27 03:14:20.827613 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2706/5455] 10.222.0.70 () {58 vars in 1302 bytes} [Sat Aug 27 03:14:20 2022] GET /compute/v2.1/servers/0c24d379-bb60-46d3-8f49-1c3310a970fc/os-volume_attachments => generated 25 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:14:20.935247 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-212a9687-a6a5-4203-81e4-3f42b5f6e608 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:20.936264 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-212a9687-a6a5-4203-81e4-3f42b5f6e608 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 0c24d379-bb60-46d3-8f49-1c3310a970fc] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:20.948462 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-212a9687-a6a5-4203-81e4-3f42b5f6e608 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:20.949896 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-212a9687-a6a5-4203-81e4-3f42b5f6e608 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:20.950727 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-212a9687-a6a5-4203-81e4-3f42b5f6e608 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:20.951698 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-212a9687-a6a5-4203-81e4-3f42b5f6e608 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:20.952346 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-212a9687-a6a5-4203-81e4-3f42b5f6e608 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:20.952938 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-212a9687-a6a5-4203-81e4-3f42b5f6e608 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:20.986895 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-212a9687-a6a5-4203-81e4-3f42b5f6e608 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 0c24d379-bb60-46d3-8f49-1c3310a970fc] Going to try to terminate instance {{(pid=134051) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:14:21.138126 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-212a9687-a6a5-4203-81e4-3f42b5f6e608 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "DELETE /compute/v2.1/servers/0c24d379-bb60-46d3-8f49-1c3310a970fc" status: 204 len: 0 microversion: 2.1 time: 0.207112 Aug 27 03:14:21.138982 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2750/5456] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 03:14:20 2022] DELETE /compute/v2.1/servers/0c24d379-bb60-46d3-8f49-1c3310a970fc => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:14:21.147759 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-46ddeb20-460e-4214-aec3-7b538954ae83 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:21.148754 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-46ddeb20-460e-4214-aec3-7b538954ae83 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 0c24d379-bb60-46d3-8f49-1c3310a970fc] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:21.155829 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-46ddeb20-460e-4214-aec3-7b538954ae83 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:21.156607 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-46ddeb20-460e-4214-aec3-7b538954ae83 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:21.157042 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-46ddeb20-460e-4214-aec3-7b538954ae83 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:21.157936 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-46ddeb20-460e-4214-aec3-7b538954ae83 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:21.158568 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-46ddeb20-460e-4214-aec3-7b538954ae83 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:21.159166 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-46ddeb20-460e-4214-aec3-7b538954ae83 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:21.365835 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-46ddeb20-460e-4214-aec3-7b538954ae83 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a549f85910184bf7a697cce7fa3dff96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92af206e05f44cf948b7c25d1acc139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:21.374044 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-46ddeb20-460e-4214-aec3-7b538954ae83 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "GET /compute/v2.1/servers/0c24d379-bb60-46d3-8f49-1c3310a970fc" status: 200 len: 1681 microversion: 2.1 time: 0.230744 Aug 27 03:14:21.378339 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2707/5457] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:21 2022] GET /compute/v2.1/servers/0c24d379-bb60-46d3-8f49-1c3310a970fc => generated 1681 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:22.399952 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-56032018-83e0-4fd3-ba9d-560bb7febc9f tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:22.401264 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-56032018-83e0-4fd3-ba9d-560bb7febc9f tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 0c24d379-bb60-46d3-8f49-1c3310a970fc] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:22.419768 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-56032018-83e0-4fd3-ba9d-560bb7febc9f tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:22.420791 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-56032018-83e0-4fd3-ba9d-560bb7febc9f tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:22.421566 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-56032018-83e0-4fd3-ba9d-560bb7febc9f tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:22.422630 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-56032018-83e0-4fd3-ba9d-560bb7febc9f tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:22.423905 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-56032018-83e0-4fd3-ba9d-560bb7febc9f tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:22.424538 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-56032018-83e0-4fd3-ba9d-560bb7febc9f tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:22.680383 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-56032018-83e0-4fd3-ba9d-560bb7febc9f tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a549f85910184bf7a697cce7fa3dff96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92af206e05f44cf948b7c25d1acc139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:22.703035 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-56032018-83e0-4fd3-ba9d-560bb7febc9f tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "GET /compute/v2.1/servers/0c24d379-bb60-46d3-8f49-1c3310a970fc" status: 200 len: 1681 microversion: 2.1 time: 0.308044 Aug 27 03:14:22.706860 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2751/5458] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:22 2022] GET /compute/v2.1/servers/0c24d379-bb60-46d3-8f49-1c3310a970fc => generated 1681 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:23.727327 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8d9c8a4e-d8e0-4038-9328-f8709507c891 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:23.727928 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-8d9c8a4e-d8e0-4038-9328-f8709507c891 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 0c24d379-bb60-46d3-8f49-1c3310a970fc] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:23.737647 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8d9c8a4e-d8e0-4038-9328-f8709507c891 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:23.738763 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8d9c8a4e-d8e0-4038-9328-f8709507c891 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:23.739731 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8d9c8a4e-d8e0-4038-9328-f8709507c891 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:23.741145 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8d9c8a4e-d8e0-4038-9328-f8709507c891 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:23.742259 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8d9c8a4e-d8e0-4038-9328-f8709507c891 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:23.742947 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8d9c8a4e-d8e0-4038-9328-f8709507c891 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:23.838706 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-8d9c8a4e-d8e0-4038-9328-f8709507c891 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a549f85910184bf7a697cce7fa3dff96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92af206e05f44cf948b7c25d1acc139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:23.851005 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-8d9c8a4e-d8e0-4038-9328-f8709507c891 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "GET /compute/v2.1/servers/0c24d379-bb60-46d3-8f49-1c3310a970fc" status: 200 len: 1613 microversion: 2.1 time: 0.127428 Aug 27 03:14:23.863540 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2708/5459] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:23 2022] GET /compute/v2.1/servers/0c24d379-bb60-46d3-8f49-1c3310a970fc => generated 1613 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:24.397126 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-19832592-f4cc-4245-954f-772336cde7b5 req-71057b18-d3ce-4070-aaf4-70b217e41311 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c24d379-bb60-46d3-8f49-1c3310a970fc", "name": "network-vif-deleted", "tag": "69a75ca6-aed1-48db-afb8-a2896ce706c7"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:14:24.422075 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-19832592-f4cc-4245-954f-772336cde7b5 req-71057b18-d3ce-4070-aaf4-70b217e41311 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:24.422819 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-19832592-f4cc-4245-954f-772336cde7b5 req-71057b18-d3ce-4070-aaf4-70b217e41311 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:24.423428 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-19832592-f4cc-4245-954f-772336cde7b5 req-71057b18-d3ce-4070-aaf4-70b217e41311 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:24.453833 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-19832592-f4cc-4245-954f-772336cde7b5 req-71057b18-d3ce-4070-aaf4-70b217e41311 service nova] Creating event network-vif-deleted:69a75ca6-aed1-48db-afb8-a2896ce706c7 for instance 0c24d379-bb60-46d3-8f49-1c3310a970fc on n-h1-852278-4 Aug 27 03:14:24.477966 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-19832592-f4cc-4245-954f-772336cde7b5 req-71057b18-d3ce-4070-aaf4-70b217e41311 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083815 Aug 27 03:14:24.480608 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2752/5460] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:14:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:14:24.872751 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-cf1fa568-e5f0-484c-9cbe-5cea847d841d tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:24.873365 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-cf1fa568-e5f0-484c-9cbe-5cea847d841d tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 0c24d379-bb60-46d3-8f49-1c3310a970fc] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:24.886589 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cf1fa568-e5f0-484c-9cbe-5cea847d841d tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:24.887372 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cf1fa568-e5f0-484c-9cbe-5cea847d841d tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:24.888045 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cf1fa568-e5f0-484c-9cbe-5cea847d841d tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:24.888990 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cf1fa568-e5f0-484c-9cbe-5cea847d841d tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:24.889445 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cf1fa568-e5f0-484c-9cbe-5cea847d841d tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:24.889868 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cf1fa568-e5f0-484c-9cbe-5cea847d841d tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:24.948523 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cf1fa568-e5f0-484c-9cbe-5cea847d841d tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:24.949150 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cf1fa568-e5f0-484c-9cbe-5cea847d841d tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:24.949428 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cf1fa568-e5f0-484c-9cbe-5cea847d841d tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:24.949893 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.instance [None req-cf1fa568-e5f0-484c-9cbe-5cea847d841d tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lazy-loading 'fault' on Instance uuid 0c24d379-bb60-46d3-8f49-1c3310a970fc {{(pid=134052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:14:25.023886 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-cf1fa568-e5f0-484c-9cbe-5cea847d841d tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a549f85910184bf7a697cce7fa3dff96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92af206e05f44cf948b7c25d1acc139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:25.035142 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-cf1fa568-e5f0-484c-9cbe-5cea847d841d tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "GET /compute/v2.1/servers/0c24d379-bb60-46d3-8f49-1c3310a970fc" status: 200 len: 1331 microversion: 2.1 time: 0.166405 Aug 27 03:14:25.039368 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2709/5461] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:24 2022] GET /compute/v2.1/servers/0c24d379-bb60-46d3-8f49-1c3310a970fc => generated 1331 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:26.067291 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a66c87e8-d6bb-4e19-8454-5c9f203f6159 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:26.069921 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-a66c87e8-d6bb-4e19-8454-5c9f203f6159 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 0c24d379-bb60-46d3-8f49-1c3310a970fc] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:26.082780 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a66c87e8-d6bb-4e19-8454-5c9f203f6159 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:26.083185 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a66c87e8-d6bb-4e19-8454-5c9f203f6159 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:26.083623 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a66c87e8-d6bb-4e19-8454-5c9f203f6159 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:26.087886 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a66c87e8-d6bb-4e19-8454-5c9f203f6159 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:26.088797 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a66c87e8-d6bb-4e19-8454-5c9f203f6159 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:26.089757 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a66c87e8-d6bb-4e19-8454-5c9f203f6159 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:26.112952 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-a66c87e8-d6bb-4e19-8454-5c9f203f6159 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] HTTP exception thrown: Instance 0c24d379-bb60-46d3-8f49-1c3310a970fc could not be found. Aug 27 03:14:26.115361 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a66c87e8-d6bb-4e19-8454-5c9f203f6159 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Request method failure captured: Aug 27 03:14:26.115361 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/0c24d379-bb60-46d3-8f49-1c3310a970fc HTTP/1.1 Aug 27 03:14:26.115361 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 03:14:26.115361 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 03:14:26.115361 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 03:14:26.115361 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 03:14:26.115361 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 03:14:26.115361 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 03:14:26.115361 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 03:14:26.115361 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 03:14:26.115361 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYq440P3xsAabxN7nGlE2F1Ccxicf_9DU586MSNagRbCITstsgHyyHbnbZoUsiVfiyCUhE6F_2SvHrXIrDKvSEnzb0XjME8fkYvCR9LlCkoQHUfv6A1aESh1h-tIQR1qbnjbVFsJiiWy_WcC2U4qzkQvsEYcwujqY5DDaX4NjUQt4DA Aug 27 03:14:26.115361 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 03:14:26.115361 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 03:14:26.115361 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 03:14:26.115361 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 03:14:26.115361 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 03:14:26.115361 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 03:14:26.115361 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: b92af206e05f44cf948b7c25d1acc139 Aug 27 03:14:26.115361 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-AttachVolumeNegativeTest-878461886 Aug 27 03:14:26.115361 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 03:14:26.115361 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 03:14:26.115361 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b92af206e05f44cf948b7c25d1acc139"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_b92af206e05f44cf948b7c25d1acc139", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b92af206e05f44cf948b7c25d1acc139"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/b92af206e05f44cf948b7c25d1acc139"}]}] Aug 27 03:14:26.115361 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-AttachVolumeNegativeTest-878461886 Aug 27 03:14:26.115361 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: b92af206e05f44cf948b7c25d1acc139 Aug 27 03:14:26.115361 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-878461886 Aug 27 03:14:26.115361 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-AttachVolumeNegativeTest-878461886-project Aug 27 03:14:26.115361 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 03:14:26.115361 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 03:14:26.115361 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: a549f85910184bf7a697cce7fa3dff96 Aug 27 03:14:26.115361 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-AttachVolumeNegativeTest-878461886-project Aug 27 03:14:26.115361 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 03:14:26.115361 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance 0c24d379-bb60-46d3-8f49-1c3310a970fc could not be found. Aug 27 03:14:26.115361 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '0c24d379-bb60-46d3-8f49-1c3310a970fc'} Aug 27 03:14:26.115361 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:14:26.115361 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:14:26.115361 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:14:26.115361 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:14:26.115361 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:14:26.115361 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:14:26.115361 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:14:26.115361 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:14:26.115361 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:14:26.115361 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:14:26.115361 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c24d379-bb60-46d3-8f49-1c3310a970fc could not be found. Aug 27 03:14:26.115361 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:14:26.115361 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:14:26.115361 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:14:26.115361 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:14:26.115361 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:14:26.115361 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:14:26.115361 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:14:26.115361 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:14:26.115361 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:14:26.115361 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:14:26.115361 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:14:26.115361 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:14:26.115361 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:14:26.115361 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:14:26.115361 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:14:26.115361 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:14:26.115361 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c24d379-bb60-46d3-8f49-1c3310a970fc could not be found. Aug 27 03:14:26.115361 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:14:26.115361 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:14:26.115361 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:14:26.120964 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:14:26.120964 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:14:26.120964 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:14:26.120964 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:14:26.120964 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:14:26.120964 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c24d379-bb60-46d3-8f49-1c3310a970fc could not be found. Aug 27 03:14:26.120964 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:14:26.122444 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a66c87e8-d6bb-4e19-8454-5c9f203f6159 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Returning 404 to user: Instance 0c24d379-bb60-46d3-8f49-1c3310a970fc could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:14:26.123634 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a66c87e8-d6bb-4e19-8454-5c9f203f6159 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "GET /compute/v2.1/servers/0c24d379-bb60-46d3-8f49-1c3310a970fc" status: 404 len: 111 microversion: 2.1 time: 0.067473 Aug 27 03:14:26.124381 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2753/5462] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:26 2022] GET /compute/v2.1/servers/0c24d379-bb60-46d3-8f49-1c3310a970fc => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:14:26.138095 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d635771d-74ea-4113-a0b6-0c7da7a7bd64 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '.version_select at 0x7f5ee1d95790>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:26.160707 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d635771d-74ea-4113-a0b6-0c7da7a7bd64 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-582734471" status: 202 len: 0 microversion: 2.1 time: 0.026589 Aug 27 03:14:26.164407 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2710/5463] 10.222.0.70 () {58 vars in 1218 bytes} [Sat Aug 27 03:14:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-582734471 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:14:31.464991 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a104bf4c-3e35-4740-8b1d-4780fdf6da2a tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:31.465570 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-a104bf4c-3e35-4740-8b1d-4780fdf6da2a tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 0c24d379-bb60-46d3-8f49-1c3310a970fc] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:31.481906 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a104bf4c-3e35-4740-8b1d-4780fdf6da2a tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:31.482345 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a104bf4c-3e35-4740-8b1d-4780fdf6da2a tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:31.484993 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a104bf4c-3e35-4740-8b1d-4780fdf6da2a tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:31.485842 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a104bf4c-3e35-4740-8b1d-4780fdf6da2a tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:31.486318 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a104bf4c-3e35-4740-8b1d-4780fdf6da2a tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:31.488288 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a104bf4c-3e35-4740-8b1d-4780fdf6da2a tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:31.532334 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-a104bf4c-3e35-4740-8b1d-4780fdf6da2a tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] HTTP exception thrown: Instance 0c24d379-bb60-46d3-8f49-1c3310a970fc could not be found. Aug 27 03:14:31.537619 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a104bf4c-3e35-4740-8b1d-4780fdf6da2a tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Request method failure captured: Aug 27 03:14:31.537619 n-d-852278-4 devstack@n-api.service[134051]: request: DELETE /compute/v2.1/servers/0c24d379-bb60-46d3-8f49-1c3310a970fc HTTP/1.1 Aug 27 03:14:31.537619 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 03:14:31.537619 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 03:14:31.537619 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 03:14:31.537619 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 03:14:31.537619 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 03:14:31.537619 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 03:14:31.537619 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 03:14:31.537619 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 03:14:31.537619 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYq440P3xsAabxN7nGlE2F1Ccxicf_9DU586MSNagRbCITstsgHyyHbnbZoUsiVfiyCUhE6F_2SvHrXIrDKvSEnzb0XjME8fkYvCR9LlCkoQHUfv6A1aESh1h-tIQR1qbnjbVFsJiiWy_WcC2U4qzkQvsEYcwujqY5DDaX4NjUQt4DA Aug 27 03:14:31.537619 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 03:14:31.537619 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 03:14:31.537619 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 03:14:31.537619 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 03:14:31.537619 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 03:14:31.537619 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 03:14:31.537619 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: b92af206e05f44cf948b7c25d1acc139 Aug 27 03:14:31.537619 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-AttachVolumeNegativeTest-878461886 Aug 27 03:14:31.537619 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 03:14:31.537619 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 03:14:31.537619 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b92af206e05f44cf948b7c25d1acc139"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_b92af206e05f44cf948b7c25d1acc139", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b92af206e05f44cf948b7c25d1acc139"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/b92af206e05f44cf948b7c25d1acc139"}]}] Aug 27 03:14:31.537619 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-AttachVolumeNegativeTest-878461886 Aug 27 03:14:31.537619 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: b92af206e05f44cf948b7c25d1acc139 Aug 27 03:14:31.537619 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-878461886 Aug 27 03:14:31.537619 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-AttachVolumeNegativeTest-878461886-project Aug 27 03:14:31.537619 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 03:14:31.537619 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 03:14:31.537619 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: a549f85910184bf7a697cce7fa3dff96 Aug 27 03:14:31.537619 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-AttachVolumeNegativeTest-878461886-project Aug 27 03:14:31.537619 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 03:14:31.537619 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance 0c24d379-bb60-46d3-8f49-1c3310a970fc could not be found. Aug 27 03:14:31.537619 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '0c24d379-bb60-46d3-8f49-1c3310a970fc'} Aug 27 03:14:31.537619 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:14:31.537619 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:14:31.537619 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:14:31.537619 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:14:31.537619 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:14:31.537619 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:14:31.537619 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:14:31.537619 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:14:31.537619 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:14:31.537619 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:14:31.537619 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c24d379-bb60-46d3-8f49-1c3310a970fc could not be found. Aug 27 03:14:31.537619 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:14:31.537619 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:14:31.537619 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:14:31.537619 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:14:31.537619 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:14:31.537619 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:14:31.537619 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:14:31.537619 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:14:31.537619 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:14:31.537619 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:14:31.537619 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 03:14:31.537619 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 03:14:31.537619 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 03:14:31.537619 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 03:14:31.537619 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:14:31.537619 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:14:31.537619 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:14:31.537619 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:14:31.541918 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c24d379-bb60-46d3-8f49-1c3310a970fc could not be found. Aug 27 03:14:31.541918 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:14:31.541918 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:14:31.541918 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:14:31.541918 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:14:31.541918 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:14:31.541918 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:14:31.541918 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:14:31.541918 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:14:31.541918 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c24d379-bb60-46d3-8f49-1c3310a970fc could not be found. Aug 27 03:14:31.541918 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:14:31.541918 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a104bf4c-3e35-4740-8b1d-4780fdf6da2a tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Returning 404 to user: Instance 0c24d379-bb60-46d3-8f49-1c3310a970fc could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:14:31.541918 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a104bf4c-3e35-4740-8b1d-4780fdf6da2a tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "DELETE /compute/v2.1/servers/0c24d379-bb60-46d3-8f49-1c3310a970fc" status: 404 len: 111 microversion: 2.1 time: 0.082178 Aug 27 03:14:31.548663 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2754/5464] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 03:14:31 2022] DELETE /compute/v2.1/servers/0c24d379-bb60-46d3-8f49-1c3310a970fc => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:14:31.551587 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a60ff463-1180-46e2-888f-023dd42f9c72 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:31.552200 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a60ff463-1180-46e2-888f-023dd42f9c72 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 0c24d379-bb60-46d3-8f49-1c3310a970fc] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:31.573682 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a60ff463-1180-46e2-888f-023dd42f9c72 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:31.576553 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a60ff463-1180-46e2-888f-023dd42f9c72 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:31.577474 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a60ff463-1180-46e2-888f-023dd42f9c72 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:31.579339 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a60ff463-1180-46e2-888f-023dd42f9c72 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:31.580271 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a60ff463-1180-46e2-888f-023dd42f9c72 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:31.582892 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a60ff463-1180-46e2-888f-023dd42f9c72 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:31.603926 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-a60ff463-1180-46e2-888f-023dd42f9c72 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] HTTP exception thrown: Instance 0c24d379-bb60-46d3-8f49-1c3310a970fc could not be found. Aug 27 03:14:31.616565 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a60ff463-1180-46e2-888f-023dd42f9c72 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Request method failure captured: Aug 27 03:14:31.616565 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/servers/0c24d379-bb60-46d3-8f49-1c3310a970fc HTTP/1.1 Aug 27 03:14:31.616565 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 03:14:31.616565 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 03:14:31.616565 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 03:14:31.616565 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 03:14:31.616565 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 03:14:31.616565 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 03:14:31.616565 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 03:14:31.616565 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 03:14:31.616565 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYq440P3xsAabxN7nGlE2F1Ccxicf_9DU586MSNagRbCITstsgHyyHbnbZoUsiVfiyCUhE6F_2SvHrXIrDKvSEnzb0XjME8fkYvCR9LlCkoQHUfv6A1aESh1h-tIQR1qbnjbVFsJiiWy_WcC2U4qzkQvsEYcwujqY5DDaX4NjUQt4DA Aug 27 03:14:31.616565 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 03:14:31.616565 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 03:14:31.616565 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 03:14:31.616565 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 03:14:31.616565 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 03:14:31.616565 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 03:14:31.616565 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: b92af206e05f44cf948b7c25d1acc139 Aug 27 03:14:31.616565 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-AttachVolumeNegativeTest-878461886 Aug 27 03:14:31.616565 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 03:14:31.616565 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 03:14:31.616565 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b92af206e05f44cf948b7c25d1acc139"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_b92af206e05f44cf948b7c25d1acc139", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b92af206e05f44cf948b7c25d1acc139"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/b92af206e05f44cf948b7c25d1acc139"}]}] Aug 27 03:14:31.616565 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-AttachVolumeNegativeTest-878461886 Aug 27 03:14:31.616565 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: b92af206e05f44cf948b7c25d1acc139 Aug 27 03:14:31.616565 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-878461886 Aug 27 03:14:31.616565 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-AttachVolumeNegativeTest-878461886-project Aug 27 03:14:31.616565 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 03:14:31.616565 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 03:14:31.616565 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: a549f85910184bf7a697cce7fa3dff96 Aug 27 03:14:31.616565 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-AttachVolumeNegativeTest-878461886-project Aug 27 03:14:31.616565 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 03:14:31.616565 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance 0c24d379-bb60-46d3-8f49-1c3310a970fc could not be found. Aug 27 03:14:31.616565 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '0c24d379-bb60-46d3-8f49-1c3310a970fc'} Aug 27 03:14:31.616565 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:14:31.616565 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:14:31.616565 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:14:31.616565 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:14:31.616565 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:14:31.616565 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:14:31.616565 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:14:31.616565 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:14:31.616565 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:14:31.616565 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:14:31.616565 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c24d379-bb60-46d3-8f49-1c3310a970fc could not be found. Aug 27 03:14:31.616565 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:14:31.616565 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:14:31.616565 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:14:31.616565 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:14:31.616565 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:14:31.616565 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:14:31.616565 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:14:31.616565 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:14:31.616565 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:14:31.616565 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:14:31.616565 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:14:31.616565 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:14:31.616565 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:14:31.616565 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:14:31.616565 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:14:31.616565 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:14:31.616565 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c24d379-bb60-46d3-8f49-1c3310a970fc could not be found. Aug 27 03:14:31.616565 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:14:31.616565 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:14:31.616565 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:14:31.622850 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:14:31.622850 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:14:31.622850 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:14:31.622850 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:14:31.622850 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:14:31.622850 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c24d379-bb60-46d3-8f49-1c3310a970fc could not be found. Aug 27 03:14:31.622850 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:14:31.627215 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a60ff463-1180-46e2-888f-023dd42f9c72 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Returning 404 to user: Instance 0c24d379-bb60-46d3-8f49-1c3310a970fc could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:14:31.628247 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a60ff463-1180-46e2-888f-023dd42f9c72 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "GET /compute/v2.1/servers/0c24d379-bb60-46d3-8f49-1c3310a970fc" status: 404 len: 111 microversion: 2.1 time: 0.081821 Aug 27 03:14:31.628984 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2711/5465] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:31 2022] GET /compute/v2.1/servers/0c24d379-bb60-46d3-8f49-1c3310a970fc => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:14:37.301715 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-de064871-2561-4539-9c7b-990872c28358 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:37.302323 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-de064871-2561-4539-9c7b-990872c28358 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 3ae351e6-e583-4f93-bdae-771141c96703] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:37.333731 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-de064871-2561-4539-9c7b-990872c28358 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:37.335749 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-de064871-2561-4539-9c7b-990872c28358 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:37.336582 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-de064871-2561-4539-9c7b-990872c28358 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:37.341936 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-de064871-2561-4539-9c7b-990872c28358 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:37.342417 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-de064871-2561-4539-9c7b-990872c28358 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:37.342867 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-de064871-2561-4539-9c7b-990872c28358 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:37.378542 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-de064871-2561-4539-9c7b-990872c28358 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] HTTP exception thrown: Instance 3ae351e6-e583-4f93-bdae-771141c96703 could not be found. Aug 27 03:14:37.384382 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-de064871-2561-4539-9c7b-990872c28358 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Request method failure captured: Aug 27 03:14:37.384382 n-d-852278-4 devstack@n-api.service[134051]: request: DELETE /compute/v2.1/servers/3ae351e6-e583-4f93-bdae-771141c96703 HTTP/1.1 Aug 27 03:14:37.384382 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 03:14:37.384382 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 03:14:37.384382 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 03:14:37.384382 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 03:14:37.384382 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 03:14:37.384382 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 03:14:37.384382 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 03:14:37.384382 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 03:14:37.384382 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYq440P3xsAabxN7nGlE2F1Ccxicf_9DU586MSNagRbCITstsgHyyHbnbZoUsiVfiyCUhE6F_2SvHrXIrDKvSEnzb0XjME8fkYvCR9LlCkoQHUfv6A1aESh1h-tIQR1qbnjbVFsJiiWy_WcC2U4qzkQvsEYcwujqY5DDaX4NjUQt4DA Aug 27 03:14:37.384382 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 03:14:37.384382 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 03:14:37.384382 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 03:14:37.384382 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 03:14:37.384382 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 03:14:37.384382 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 03:14:37.384382 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: b92af206e05f44cf948b7c25d1acc139 Aug 27 03:14:37.384382 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-AttachVolumeNegativeTest-878461886 Aug 27 03:14:37.384382 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 03:14:37.384382 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 03:14:37.384382 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b92af206e05f44cf948b7c25d1acc139"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_b92af206e05f44cf948b7c25d1acc139", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b92af206e05f44cf948b7c25d1acc139"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/b92af206e05f44cf948b7c25d1acc139"}]}] Aug 27 03:14:37.384382 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-AttachVolumeNegativeTest-878461886 Aug 27 03:14:37.384382 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: b92af206e05f44cf948b7c25d1acc139 Aug 27 03:14:37.384382 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-878461886 Aug 27 03:14:37.384382 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-AttachVolumeNegativeTest-878461886-project Aug 27 03:14:37.384382 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 03:14:37.384382 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 03:14:37.384382 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: a549f85910184bf7a697cce7fa3dff96 Aug 27 03:14:37.384382 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-AttachVolumeNegativeTest-878461886-project Aug 27 03:14:37.384382 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 03:14:37.384382 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance 3ae351e6-e583-4f93-bdae-771141c96703 could not be found. Aug 27 03:14:37.384382 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '3ae351e6-e583-4f93-bdae-771141c96703'} Aug 27 03:14:37.384382 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:14:37.384382 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:14:37.384382 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:14:37.384382 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:14:37.384382 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:14:37.384382 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:14:37.384382 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:14:37.384382 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:14:37.384382 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:14:37.384382 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:14:37.384382 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ae351e6-e583-4f93-bdae-771141c96703 could not be found. Aug 27 03:14:37.384382 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:14:37.384382 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:14:37.384382 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:14:37.384382 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:14:37.384382 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:14:37.384382 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:14:37.384382 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:14:37.384382 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:14:37.384382 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:14:37.384382 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:14:37.384382 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 03:14:37.384382 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 03:14:37.384382 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 03:14:37.384382 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 03:14:37.384382 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:14:37.384382 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:14:37.384382 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:14:37.384382 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:14:37.390039 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ae351e6-e583-4f93-bdae-771141c96703 could not be found. Aug 27 03:14:37.390039 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:14:37.390039 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:14:37.390039 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:14:37.390039 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:14:37.390039 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:14:37.390039 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:14:37.390039 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:14:37.390039 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:14:37.390039 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ae351e6-e583-4f93-bdae-771141c96703 could not be found. Aug 27 03:14:37.390039 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:14:37.390039 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-de064871-2561-4539-9c7b-990872c28358 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Returning 404 to user: Instance 3ae351e6-e583-4f93-bdae-771141c96703 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:14:37.390039 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-de064871-2561-4539-9c7b-990872c28358 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "DELETE /compute/v2.1/servers/3ae351e6-e583-4f93-bdae-771141c96703" status: 404 len: 111 microversion: 2.1 time: 0.090925 Aug 27 03:14:37.399300 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a0f2fb0c-1ece-440b-bcb0-cecec772826d tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:37.400357 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a0f2fb0c-1ece-440b-bcb0-cecec772826d tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 3ae351e6-e583-4f93-bdae-771141c96703] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:37.405352 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2755/5466] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 03:14:37 2022] DELETE /compute/v2.1/servers/3ae351e6-e583-4f93-bdae-771141c96703 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:14:37.411287 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a0f2fb0c-1ece-440b-bcb0-cecec772826d tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:37.412586 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a0f2fb0c-1ece-440b-bcb0-cecec772826d tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:37.413191 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a0f2fb0c-1ece-440b-bcb0-cecec772826d tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:37.414179 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a0f2fb0c-1ece-440b-bcb0-cecec772826d tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:37.414789 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a0f2fb0c-1ece-440b-bcb0-cecec772826d tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:37.415384 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a0f2fb0c-1ece-440b-bcb0-cecec772826d tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:37.452285 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-a0f2fb0c-1ece-440b-bcb0-cecec772826d tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] HTTP exception thrown: Instance 3ae351e6-e583-4f93-bdae-771141c96703 could not be found. Aug 27 03:14:37.460282 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a0f2fb0c-1ece-440b-bcb0-cecec772826d tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Request method failure captured: Aug 27 03:14:37.460282 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/servers/3ae351e6-e583-4f93-bdae-771141c96703 HTTP/1.1 Aug 27 03:14:37.460282 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 03:14:37.460282 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 03:14:37.460282 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 03:14:37.460282 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 03:14:37.460282 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 03:14:37.460282 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 03:14:37.460282 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 03:14:37.460282 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 03:14:37.460282 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYq440P3xsAabxN7nGlE2F1Ccxicf_9DU586MSNagRbCITstsgHyyHbnbZoUsiVfiyCUhE6F_2SvHrXIrDKvSEnzb0XjME8fkYvCR9LlCkoQHUfv6A1aESh1h-tIQR1qbnjbVFsJiiWy_WcC2U4qzkQvsEYcwujqY5DDaX4NjUQt4DA Aug 27 03:14:37.460282 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 03:14:37.460282 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 03:14:37.460282 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 03:14:37.460282 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 03:14:37.460282 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 03:14:37.460282 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 03:14:37.460282 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: b92af206e05f44cf948b7c25d1acc139 Aug 27 03:14:37.460282 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-AttachVolumeNegativeTest-878461886 Aug 27 03:14:37.460282 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 03:14:37.460282 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 03:14:37.460282 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b92af206e05f44cf948b7c25d1acc139"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_b92af206e05f44cf948b7c25d1acc139", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b92af206e05f44cf948b7c25d1acc139"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/b92af206e05f44cf948b7c25d1acc139"}]}] Aug 27 03:14:37.460282 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-AttachVolumeNegativeTest-878461886 Aug 27 03:14:37.460282 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: b92af206e05f44cf948b7c25d1acc139 Aug 27 03:14:37.460282 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-878461886 Aug 27 03:14:37.460282 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-AttachVolumeNegativeTest-878461886-project Aug 27 03:14:37.460282 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 03:14:37.460282 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 03:14:37.460282 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: a549f85910184bf7a697cce7fa3dff96 Aug 27 03:14:37.460282 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-AttachVolumeNegativeTest-878461886-project Aug 27 03:14:37.460282 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 03:14:37.460282 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance 3ae351e6-e583-4f93-bdae-771141c96703 could not be found. Aug 27 03:14:37.460282 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '3ae351e6-e583-4f93-bdae-771141c96703'} Aug 27 03:14:37.460282 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:14:37.460282 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:14:37.460282 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:14:37.460282 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:14:37.460282 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:14:37.460282 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:14:37.460282 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:14:37.460282 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:14:37.460282 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:14:37.460282 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:14:37.460282 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ae351e6-e583-4f93-bdae-771141c96703 could not be found. Aug 27 03:14:37.460282 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:14:37.460282 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:14:37.460282 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:14:37.460282 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:14:37.460282 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:14:37.460282 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:14:37.460282 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:14:37.460282 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:14:37.460282 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:14:37.460282 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:14:37.460282 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:14:37.460282 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:14:37.460282 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:14:37.460282 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:14:37.460282 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:14:37.460282 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:14:37.460282 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ae351e6-e583-4f93-bdae-771141c96703 could not be found. Aug 27 03:14:37.460282 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:14:37.460282 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:14:37.460282 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:14:37.465756 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:14:37.465756 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:14:37.465756 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:14:37.465756 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:14:37.465756 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:14:37.465756 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ae351e6-e583-4f93-bdae-771141c96703 could not be found. Aug 27 03:14:37.465756 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:14:37.465756 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a0f2fb0c-1ece-440b-bcb0-cecec772826d tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Returning 404 to user: Instance 3ae351e6-e583-4f93-bdae-771141c96703 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:14:37.465756 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a0f2fb0c-1ece-440b-bcb0-cecec772826d tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "GET /compute/v2.1/servers/3ae351e6-e583-4f93-bdae-771141c96703" status: 404 len: 111 microversion: 2.1 time: 0.072899 Aug 27 03:14:37.476113 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8b39c58c-0f04-49c9-8fdd-93b52336b8fc tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:37.477021 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-8b39c58c-0f04-49c9-8fdd-93b52336b8fc tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 77d55af2-92db-4882-a218-690b4752270f] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:37.482041 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2712/5467] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:37 2022] GET /compute/v2.1/servers/3ae351e6-e583-4f93-bdae-771141c96703 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:14:37.486209 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8b39c58c-0f04-49c9-8fdd-93b52336b8fc tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:37.495269 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8b39c58c-0f04-49c9-8fdd-93b52336b8fc tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:37.495945 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8b39c58c-0f04-49c9-8fdd-93b52336b8fc tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:37.497768 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8b39c58c-0f04-49c9-8fdd-93b52336b8fc tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:37.503230 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8b39c58c-0f04-49c9-8fdd-93b52336b8fc tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:37.503945 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8b39c58c-0f04-49c9-8fdd-93b52336b8fc tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:37.558603 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-8b39c58c-0f04-49c9-8fdd-93b52336b8fc tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] HTTP exception thrown: Instance 77d55af2-92db-4882-a218-690b4752270f could not be found. Aug 27 03:14:37.564682 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8b39c58c-0f04-49c9-8fdd-93b52336b8fc tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Request method failure captured: Aug 27 03:14:37.564682 n-d-852278-4 devstack@n-api.service[134051]: request: DELETE /compute/v2.1/servers/77d55af2-92db-4882-a218-690b4752270f HTTP/1.1 Aug 27 03:14:37.564682 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 03:14:37.564682 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 03:14:37.564682 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 03:14:37.564682 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 03:14:37.564682 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 03:14:37.564682 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 03:14:37.564682 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 03:14:37.564682 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 03:14:37.564682 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYq440P3xsAabxN7nGlE2F1Ccxicf_9DU586MSNagRbCITstsgHyyHbnbZoUsiVfiyCUhE6F_2SvHrXIrDKvSEnzb0XjME8fkYvCR9LlCkoQHUfv6A1aESh1h-tIQR1qbnjbVFsJiiWy_WcC2U4qzkQvsEYcwujqY5DDaX4NjUQt4DA Aug 27 03:14:37.564682 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 03:14:37.564682 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 03:14:37.564682 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 03:14:37.564682 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 03:14:37.564682 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 03:14:37.564682 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 03:14:37.564682 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: b92af206e05f44cf948b7c25d1acc139 Aug 27 03:14:37.564682 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-AttachVolumeNegativeTest-878461886 Aug 27 03:14:37.564682 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 03:14:37.564682 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 03:14:37.564682 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b92af206e05f44cf948b7c25d1acc139"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_b92af206e05f44cf948b7c25d1acc139", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b92af206e05f44cf948b7c25d1acc139"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/b92af206e05f44cf948b7c25d1acc139"}]}] Aug 27 03:14:37.564682 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-AttachVolumeNegativeTest-878461886 Aug 27 03:14:37.564682 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: b92af206e05f44cf948b7c25d1acc139 Aug 27 03:14:37.564682 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-878461886 Aug 27 03:14:37.564682 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-AttachVolumeNegativeTest-878461886-project Aug 27 03:14:37.564682 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 03:14:37.564682 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 03:14:37.564682 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: a549f85910184bf7a697cce7fa3dff96 Aug 27 03:14:37.564682 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-AttachVolumeNegativeTest-878461886-project Aug 27 03:14:37.564682 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 03:14:37.564682 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance 77d55af2-92db-4882-a218-690b4752270f could not be found. Aug 27 03:14:37.564682 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '77d55af2-92db-4882-a218-690b4752270f'} Aug 27 03:14:37.564682 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:14:37.564682 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:14:37.564682 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:14:37.564682 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:14:37.564682 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:14:37.564682 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:14:37.564682 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:14:37.564682 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:14:37.564682 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:14:37.564682 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:14:37.564682 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77d55af2-92db-4882-a218-690b4752270f could not be found. Aug 27 03:14:37.564682 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:14:37.564682 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:14:37.564682 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:14:37.564682 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:14:37.564682 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:14:37.564682 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:14:37.564682 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:14:37.564682 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:14:37.564682 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:14:37.564682 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:14:37.564682 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 03:14:37.564682 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 03:14:37.564682 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 03:14:37.564682 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 03:14:37.564682 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:14:37.564682 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:14:37.564682 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:14:37.564682 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:14:37.570277 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77d55af2-92db-4882-a218-690b4752270f could not be found. Aug 27 03:14:37.570277 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:14:37.570277 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:14:37.570277 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:14:37.570277 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:14:37.570277 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:14:37.570277 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:14:37.570277 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:14:37.570277 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:14:37.570277 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77d55af2-92db-4882-a218-690b4752270f could not be found. Aug 27 03:14:37.570277 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:14:37.570277 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8b39c58c-0f04-49c9-8fdd-93b52336b8fc tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Returning 404 to user: Instance 77d55af2-92db-4882-a218-690b4752270f could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:14:37.575390 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-8b39c58c-0f04-49c9-8fdd-93b52336b8fc tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "DELETE /compute/v2.1/servers/77d55af2-92db-4882-a218-690b4752270f" status: 404 len: 111 microversion: 2.1 time: 0.103646 Aug 27 03:14:37.576901 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2756/5468] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 03:14:37 2022] DELETE /compute/v2.1/servers/77d55af2-92db-4882-a218-690b4752270f => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 03:14:37.589962 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f649977f-5c9b-4d0a-b78f-7395d2f2dd30 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:37.590684 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-f649977f-5c9b-4d0a-b78f-7395d2f2dd30 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 77d55af2-92db-4882-a218-690b4752270f] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:37.597185 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f649977f-5c9b-4d0a-b78f-7395d2f2dd30 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:37.597666 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f649977f-5c9b-4d0a-b78f-7395d2f2dd30 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:37.598309 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f649977f-5c9b-4d0a-b78f-7395d2f2dd30 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:37.599203 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f649977f-5c9b-4d0a-b78f-7395d2f2dd30 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:37.599808 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f649977f-5c9b-4d0a-b78f-7395d2f2dd30 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:37.601155 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f649977f-5c9b-4d0a-b78f-7395d2f2dd30 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:37.618396 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-f649977f-5c9b-4d0a-b78f-7395d2f2dd30 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] HTTP exception thrown: Instance 77d55af2-92db-4882-a218-690b4752270f could not be found. Aug 27 03:14:37.620197 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f649977f-5c9b-4d0a-b78f-7395d2f2dd30 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Request method failure captured: Aug 27 03:14:37.620197 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/servers/77d55af2-92db-4882-a218-690b4752270f HTTP/1.1 Aug 27 03:14:37.620197 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 03:14:37.620197 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 03:14:37.620197 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 03:14:37.620197 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 03:14:37.620197 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 03:14:37.620197 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 03:14:37.620197 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 03:14:37.620197 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 03:14:37.620197 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYq440P3xsAabxN7nGlE2F1Ccxicf_9DU586MSNagRbCITstsgHyyHbnbZoUsiVfiyCUhE6F_2SvHrXIrDKvSEnzb0XjME8fkYvCR9LlCkoQHUfv6A1aESh1h-tIQR1qbnjbVFsJiiWy_WcC2U4qzkQvsEYcwujqY5DDaX4NjUQt4DA Aug 27 03:14:37.620197 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 03:14:37.620197 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 03:14:37.620197 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 03:14:37.620197 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 03:14:37.620197 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 03:14:37.620197 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 03:14:37.620197 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: b92af206e05f44cf948b7c25d1acc139 Aug 27 03:14:37.620197 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-AttachVolumeNegativeTest-878461886 Aug 27 03:14:37.620197 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 03:14:37.620197 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 03:14:37.620197 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b92af206e05f44cf948b7c25d1acc139"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_b92af206e05f44cf948b7c25d1acc139", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b92af206e05f44cf948b7c25d1acc139"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/b92af206e05f44cf948b7c25d1acc139"}]}] Aug 27 03:14:37.620197 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-AttachVolumeNegativeTest-878461886 Aug 27 03:14:37.620197 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: b92af206e05f44cf948b7c25d1acc139 Aug 27 03:14:37.620197 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-878461886 Aug 27 03:14:37.620197 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-AttachVolumeNegativeTest-878461886-project Aug 27 03:14:37.620197 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 03:14:37.620197 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 03:14:37.620197 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: a549f85910184bf7a697cce7fa3dff96 Aug 27 03:14:37.620197 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-AttachVolumeNegativeTest-878461886-project Aug 27 03:14:37.620197 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 03:14:37.620197 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance 77d55af2-92db-4882-a218-690b4752270f could not be found. Aug 27 03:14:37.620197 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '77d55af2-92db-4882-a218-690b4752270f'} Aug 27 03:14:37.620197 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:14:37.620197 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:14:37.620197 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:14:37.620197 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:14:37.620197 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:14:37.620197 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:14:37.620197 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:14:37.620197 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:14:37.620197 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:14:37.620197 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:14:37.620197 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77d55af2-92db-4882-a218-690b4752270f could not be found. Aug 27 03:14:37.620197 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:14:37.620197 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:14:37.620197 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:14:37.620197 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:14:37.620197 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:14:37.620197 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:14:37.620197 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:14:37.620197 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:14:37.620197 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:14:37.620197 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:14:37.620197 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:14:37.620197 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:14:37.620197 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:14:37.620197 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:14:37.620197 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:14:37.620197 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:14:37.620197 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77d55af2-92db-4882-a218-690b4752270f could not be found. Aug 27 03:14:37.620197 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:14:37.620197 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:14:37.620197 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:14:37.626417 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:14:37.626417 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:14:37.626417 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:14:37.626417 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:14:37.626417 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:14:37.626417 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77d55af2-92db-4882-a218-690b4752270f could not be found. Aug 27 03:14:37.626417 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:14:37.633019 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f649977f-5c9b-4d0a-b78f-7395d2f2dd30 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Returning 404 to user: Instance 77d55af2-92db-4882-a218-690b4752270f could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:14:37.634227 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f649977f-5c9b-4d0a-b78f-7395d2f2dd30 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "GET /compute/v2.1/servers/77d55af2-92db-4882-a218-690b4752270f" status: 404 len: 111 microversion: 2.1 time: 0.053034 Aug 27 03:14:37.638436 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2713/5469] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:37 2022] GET /compute/v2.1/servers/77d55af2-92db-4882-a218-690b4752270f => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:14:43.936909 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-518fd6e1-7564-422e-a85e-1a8b51e53e4c tempest-TestAggregatesBasicOps-33802804 tempest-TestAggregatesBasicOps-33802804-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-156689510", "availability_zone": "foo_zone"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:14:43.942572 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.objects.aggregate [None req-518fd6e1-7564-422e-a85e-1a8b51e53e4c tempest-TestAggregatesBasicOps-33802804 tempest-TestAggregatesBasicOps-33802804-project-admin] Generated uuid db88711f-fe65-4f55-a944-f4cbc1f35008 for aggregate {{(pid=134051) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 03:14:44.001513 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-518fd6e1-7564-422e-a85e-1a8b51e53e4c tempest-TestAggregatesBasicOps-33802804 tempest-TestAggregatesBasicOps-33802804-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates" status: 200 len: 208 microversion: 2.1 time: 0.530030 Aug 27 03:14:44.003293 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2757/5470] 10.222.0.70 () {60 vars in 1164 bytes} [Sat Aug 27 03:14:43 2022] POST /compute/v2.1/os-aggregates => generated 208 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:14:44.014226 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-af720024-8bf9-41c5-94fb-0f1bad9d4471 tempest-TestAggregatesBasicOps-33802804 tempest-TestAggregatesBasicOps-33802804-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:14:44.073929 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-af720024-8bf9-41c5-94fb-0f1bad9d4471 tempest-TestAggregatesBasicOps-33802804 tempest-TestAggregatesBasicOps-33802804-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 318 microversion: 2.1 time: 0.063965 Aug 27 03:14:44.075242 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2714/5471] 10.222.0.70 () {60 vars in 1194 bytes} [Sat Aug 27 03:14:44 2022] POST /compute/v2.1/os-aggregates/19/action => generated 318 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:14:44.088492 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0323106b-046e-45d8-9241-bccd3ce0a8c3 tempest-TestAggregatesBasicOps-33802804 tempest-TestAggregatesBasicOps-33802804-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:44.092210 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0323106b-046e-45d8-9241-bccd3ce0a8c3 tempest-TestAggregatesBasicOps-33802804 tempest-TestAggregatesBasicOps-33802804-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:44.103587 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0323106b-046e-45d8-9241-bccd3ce0a8c3 tempest-TestAggregatesBasicOps-33802804 tempest-TestAggregatesBasicOps-33802804-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:44.105828 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0323106b-046e-45d8-9241-bccd3ce0a8c3 tempest-TestAggregatesBasicOps-33802804 tempest-TestAggregatesBasicOps-33802804-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:44.111228 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0323106b-046e-45d8-9241-bccd3ce0a8c3 tempest-TestAggregatesBasicOps-33802804 tempest-TestAggregatesBasicOps-33802804-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:44.115916 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0323106b-046e-45d8-9241-bccd3ce0a8c3 tempest-TestAggregatesBasicOps-33802804 tempest-TestAggregatesBasicOps-33802804-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:44.116682 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0323106b-046e-45d8-9241-bccd3ce0a8c3 tempest-TestAggregatesBasicOps-33802804 tempest-TestAggregatesBasicOps-33802804-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:44.178672 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-0323106b-046e-45d8-9241-bccd3ce0a8c3 tempest-TestAggregatesBasicOps-33802804 tempest-TestAggregatesBasicOps-33802804-project-admin] 10.222.0.70 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.096018 Aug 27 03:14:44.186924 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2758/5472] 10.222.0.70 () {58 vars in 1176 bytes} [Sat Aug 27 03:14:44 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:14:44.192492 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-93f2ac9b-011c-42a3-b9f2-5de6bf9b2789 tempest-TestAggregatesBasicOps-33802804 tempest-TestAggregatesBasicOps-33802804-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:44.210555 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-93f2ac9b-011c-42a3-b9f2-5de6bf9b2789 tempest-TestAggregatesBasicOps-33802804 tempest-TestAggregatesBasicOps-33802804-project-admin] 10.222.0.70 "GET /compute/v2.1/os-aggregates" status: 200 len: 297 microversion: 2.1 time: 0.021909 Aug 27 03:14:44.211932 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2715/5473] 10.222.0.70 () {58 vars in 1143 bytes} [Sat Aug 27 03:14:44 2022] GET /compute/v2.1/os-aggregates => generated 297 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:14:44.224587 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-12a76c51-5261-4cd4-8b56-0ee461735e3a tempest-TestAggregatesBasicOps-33802804 tempest-TestAggregatesBasicOps-33802804-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-852278-4"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:14:44.244113 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-12a76c51-5261-4cd4-8b56-0ee461735e3a tempest-TestAggregatesBasicOps-33802804 tempest-TestAggregatesBasicOps-33802804-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:44.244634 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-12a76c51-5261-4cd4-8b56-0ee461735e3a tempest-TestAggregatesBasicOps-33802804 tempest-TestAggregatesBasicOps-33802804-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:44.250160 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-12a76c51-5261-4cd4-8b56-0ee461735e3a tempest-TestAggregatesBasicOps-33802804 tempest-TestAggregatesBasicOps-33802804-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:44.550205 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-91fa1584-b581-4307-b95f-691f1ca02003 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:44.551402 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-91fa1584-b581-4307-b95f-691f1ca02003 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 28d2e08f-ea2f-42f2-beb5-bfdc368b9014] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:44.565040 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-91fa1584-b581-4307-b95f-691f1ca02003 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:44.565919 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-91fa1584-b581-4307-b95f-691f1ca02003 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:44.566803 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-91fa1584-b581-4307-b95f-691f1ca02003 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:44.567934 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-91fa1584-b581-4307-b95f-691f1ca02003 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:44.568561 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-91fa1584-b581-4307-b95f-691f1ca02003 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:44.569535 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-91fa1584-b581-4307-b95f-691f1ca02003 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:44.594116 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-91fa1584-b581-4307-b95f-691f1ca02003 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] HTTP exception thrown: Instance 28d2e08f-ea2f-42f2-beb5-bfdc368b9014 could not be found. Aug 27 03:14:44.596255 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-91fa1584-b581-4307-b95f-691f1ca02003 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Request method failure captured: Aug 27 03:14:44.596255 n-d-852278-4 devstack@n-api.service[134052]: request: DELETE /compute/v2.1/servers/28d2e08f-ea2f-42f2-beb5-bfdc368b9014 HTTP/1.1 Aug 27 03:14:44.596255 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 03:14:44.596255 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 03:14:44.596255 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 03:14:44.596255 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 03:14:44.596255 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 03:14:44.596255 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 03:14:44.596255 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 03:14:44.596255 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 03:14:44.596255 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYq440P3xsAabxN7nGlE2F1Ccxicf_9DU586MSNagRbCITstsgHyyHbnbZoUsiVfiyCUhE6F_2SvHrXIrDKvSEnzb0XjME8fkYvCR9LlCkoQHUfv6A1aESh1h-tIQR1qbnjbVFsJiiWy_WcC2U4qzkQvsEYcwujqY5DDaX4NjUQt4DA Aug 27 03:14:44.596255 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 03:14:44.596255 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 03:14:44.596255 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 03:14:44.596255 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 03:14:44.596255 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 03:14:44.596255 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 03:14:44.596255 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: b92af206e05f44cf948b7c25d1acc139 Aug 27 03:14:44.596255 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-AttachVolumeNegativeTest-878461886 Aug 27 03:14:44.596255 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 03:14:44.596255 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 03:14:44.596255 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b92af206e05f44cf948b7c25d1acc139"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_b92af206e05f44cf948b7c25d1acc139", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b92af206e05f44cf948b7c25d1acc139"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/b92af206e05f44cf948b7c25d1acc139"}]}] Aug 27 03:14:44.596255 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-AttachVolumeNegativeTest-878461886 Aug 27 03:14:44.596255 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: b92af206e05f44cf948b7c25d1acc139 Aug 27 03:14:44.596255 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-878461886 Aug 27 03:14:44.596255 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-AttachVolumeNegativeTest-878461886-project Aug 27 03:14:44.596255 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 03:14:44.596255 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 03:14:44.596255 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: a549f85910184bf7a697cce7fa3dff96 Aug 27 03:14:44.596255 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-AttachVolumeNegativeTest-878461886-project Aug 27 03:14:44.596255 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 03:14:44.596255 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance 28d2e08f-ea2f-42f2-beb5-bfdc368b9014 could not be found. Aug 27 03:14:44.596255 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '28d2e08f-ea2f-42f2-beb5-bfdc368b9014'} Aug 27 03:14:44.596255 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:14:44.596255 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:14:44.596255 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:14:44.596255 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:14:44.596255 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:14:44.596255 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:14:44.596255 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:14:44.596255 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:14:44.596255 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:14:44.596255 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:14:44.596255 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28d2e08f-ea2f-42f2-beb5-bfdc368b9014 could not be found. Aug 27 03:14:44.596255 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:14:44.596255 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:14:44.596255 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:14:44.596255 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:14:44.596255 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:14:44.596255 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:14:44.596255 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:14:44.596255 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:14:44.596255 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:14:44.596255 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:14:44.596255 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 03:14:44.596255 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 03:14:44.596255 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 03:14:44.596255 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 03:14:44.596255 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:14:44.596255 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:14:44.596255 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:14:44.596255 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:14:44.602027 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28d2e08f-ea2f-42f2-beb5-bfdc368b9014 could not be found. Aug 27 03:14:44.602027 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:14:44.602027 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:14:44.602027 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:14:44.602027 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:14:44.602027 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:14:44.602027 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:14:44.602027 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:14:44.602027 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:14:44.602027 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28d2e08f-ea2f-42f2-beb5-bfdc368b9014 could not be found. Aug 27 03:14:44.602027 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:14:44.624799 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-91fa1584-b581-4307-b95f-691f1ca02003 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Returning 404 to user: Instance 28d2e08f-ea2f-42f2-beb5-bfdc368b9014 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:14:44.626416 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-91fa1584-b581-4307-b95f-691f1ca02003 tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "DELETE /compute/v2.1/servers/28d2e08f-ea2f-42f2-beb5-bfdc368b9014" status: 404 len: 111 microversion: 2.1 time: 0.083608 Aug 27 03:14:44.627582 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2716/5474] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 03:14:44 2022] DELETE /compute/v2.1/servers/28d2e08f-ea2f-42f2-beb5-bfdc368b9014 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:14:44.643801 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-dfb1dd30-86cd-4f9b-ac9a-6a08007a5c1d tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:44.647668 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-dfb1dd30-86cd-4f9b-ac9a-6a08007a5c1d tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] [instance: 28d2e08f-ea2f-42f2-beb5-bfdc368b9014] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:44.671323 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dfb1dd30-86cd-4f9b-ac9a-6a08007a5c1d tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:44.674909 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dfb1dd30-86cd-4f9b-ac9a-6a08007a5c1d tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:44.676819 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dfb1dd30-86cd-4f9b-ac9a-6a08007a5c1d tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:44.679178 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dfb1dd30-86cd-4f9b-ac9a-6a08007a5c1d tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:44.681041 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dfb1dd30-86cd-4f9b-ac9a-6a08007a5c1d tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:44.682990 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dfb1dd30-86cd-4f9b-ac9a-6a08007a5c1d tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:44.723679 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-dfb1dd30-86cd-4f9b-ac9a-6a08007a5c1d tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] HTTP exception thrown: Instance 28d2e08f-ea2f-42f2-beb5-bfdc368b9014 could not be found. Aug 27 03:14:44.729457 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-dfb1dd30-86cd-4f9b-ac9a-6a08007a5c1d tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Request method failure captured: Aug 27 03:14:44.729457 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/servers/28d2e08f-ea2f-42f2-beb5-bfdc368b9014 HTTP/1.1 Aug 27 03:14:44.729457 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 03:14:44.729457 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 03:14:44.729457 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 03:14:44.729457 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 03:14:44.729457 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 03:14:44.729457 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 03:14:44.729457 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 03:14:44.729457 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 03:14:44.729457 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYq440P3xsAabxN7nGlE2F1Ccxicf_9DU586MSNagRbCITstsgHyyHbnbZoUsiVfiyCUhE6F_2SvHrXIrDKvSEnzb0XjME8fkYvCR9LlCkoQHUfv6A1aESh1h-tIQR1qbnjbVFsJiiWy_WcC2U4qzkQvsEYcwujqY5DDaX4NjUQt4DA Aug 27 03:14:44.729457 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 03:14:44.729457 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 03:14:44.729457 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 03:14:44.729457 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 03:14:44.729457 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 03:14:44.729457 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 03:14:44.729457 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: b92af206e05f44cf948b7c25d1acc139 Aug 27 03:14:44.729457 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-AttachVolumeNegativeTest-878461886 Aug 27 03:14:44.729457 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 03:14:44.729457 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 03:14:44.729457 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b92af206e05f44cf948b7c25d1acc139"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_b92af206e05f44cf948b7c25d1acc139", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b92af206e05f44cf948b7c25d1acc139"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/b92af206e05f44cf948b7c25d1acc139"}]}] Aug 27 03:14:44.729457 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-AttachVolumeNegativeTest-878461886 Aug 27 03:14:44.729457 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: b92af206e05f44cf948b7c25d1acc139 Aug 27 03:14:44.729457 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-878461886 Aug 27 03:14:44.729457 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-AttachVolumeNegativeTest-878461886-project Aug 27 03:14:44.729457 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 03:14:44.729457 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 03:14:44.729457 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: a549f85910184bf7a697cce7fa3dff96 Aug 27 03:14:44.729457 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-AttachVolumeNegativeTest-878461886-project Aug 27 03:14:44.729457 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 03:14:44.729457 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance 28d2e08f-ea2f-42f2-beb5-bfdc368b9014 could not be found. Aug 27 03:14:44.729457 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '28d2e08f-ea2f-42f2-beb5-bfdc368b9014'} Aug 27 03:14:44.729457 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:14:44.729457 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:14:44.729457 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:14:44.729457 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:14:44.729457 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:14:44.729457 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:14:44.729457 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:14:44.729457 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:14:44.729457 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:14:44.729457 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:14:44.729457 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28d2e08f-ea2f-42f2-beb5-bfdc368b9014 could not be found. Aug 27 03:14:44.729457 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:14:44.729457 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:14:44.729457 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:14:44.729457 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:14:44.729457 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:14:44.729457 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:14:44.729457 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:14:44.729457 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:14:44.729457 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:14:44.729457 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:14:44.729457 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:14:44.729457 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:14:44.729457 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:14:44.729457 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:14:44.729457 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:14:44.729457 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:14:44.729457 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28d2e08f-ea2f-42f2-beb5-bfdc368b9014 could not be found. Aug 27 03:14:44.729457 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:14:44.729457 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:14:44.729457 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:14:44.736829 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:14:44.736829 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:14:44.736829 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:14:44.736829 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:14:44.736829 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:14:44.736829 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28d2e08f-ea2f-42f2-beb5-bfdc368b9014 could not be found. Aug 27 03:14:44.736829 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:14:44.739800 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-dfb1dd30-86cd-4f9b-ac9a-6a08007a5c1d tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] Returning 404 to user: Instance 28d2e08f-ea2f-42f2-beb5-bfdc368b9014 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:14:44.740969 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-dfb1dd30-86cd-4f9b-ac9a-6a08007a5c1d tempest-AttachVolumeNegativeTest-878461886 tempest-AttachVolumeNegativeTest-878461886-project] 10.222.0.70 "GET /compute/v2.1/servers/28d2e08f-ea2f-42f2-beb5-bfdc368b9014" status: 404 len: 111 microversion: 2.1 time: 0.108785 Aug 27 03:14:44.746301 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2717/5475] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:44 2022] GET /compute/v2.1/servers/28d2e08f-ea2f-42f2-beb5-bfdc368b9014 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:14:45.044206 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-12a76c51-5261-4cd4-8b56-0ee461735e3a tempest-TestAggregatesBasicOps-33802804 tempest-TestAggregatesBasicOps-33802804-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 309 microversion: 2.1 time: 0.823662 Aug 27 03:14:45.045750 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2759/5476] 10.222.0.70 () {60 vars in 1194 bytes} [Sat Aug 27 03:14:44 2022] POST /compute/v2.1/os-aggregates/19/action => generated 309 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:14:45.057712 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-27460bca-9061-4fc3-998d-5202e124bd30 tempest-TestAggregatesBasicOps-33802804 tempest-TestAggregatesBasicOps-33802804-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:45.075755 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-27460bca-9061-4fc3-998d-5202e124bd30 tempest-TestAggregatesBasicOps-33802804 tempest-TestAggregatesBasicOps-33802804-project-admin] 10.222.0.70 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 309 microversion: 2.1 time: 0.022720 Aug 27 03:14:45.077234 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2718/5477] 10.222.0.70 () {58 vars in 1152 bytes} [Sat Aug 27 03:14:45 2022] GET /compute/v2.1/os-aggregates/19 => generated 309 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:14:45.088678 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0f983e6a-bd2c-4c7c-952c-b33575d58d44 tempest-TestAggregatesBasicOps-33802804 tempest-TestAggregatesBasicOps-33802804-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-107792321", "availability_zone": "foo_zone"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:14:45.173926 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-0f983e6a-bd2c-4c7c-952c-b33575d58d44 tempest-TestAggregatesBasicOps-33802804 tempest-TestAggregatesBasicOps-33802804-project-admin] 10.222.0.70 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 341 microversion: 2.1 time: 0.087775 Aug 27 03:14:45.175597 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2760/5478] 10.222.0.70 () {60 vars in 1173 bytes} [Sat Aug 27 03:14:45 2022] PUT /compute/v2.1/os-aggregates/19 => generated 341 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:14:45.193118 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e56dc584-4e6c-4b91-b418-6654b424f973 tempest-TestAggregatesBasicOps-33802804 tempest-TestAggregatesBasicOps-33802804-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:14:45.267963 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e56dc584-4e6c-4b91-b418-6654b424f973 tempest-TestAggregatesBasicOps-33802804 tempest-TestAggregatesBasicOps-33802804-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 355 microversion: 2.1 time: 0.084618 Aug 27 03:14:45.276096 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2719/5479] 10.222.0.70 () {60 vars in 1194 bytes} [Sat Aug 27 03:14:45 2022] POST /compute/v2.1/os-aggregates/19/action => generated 355 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:14:45.281516 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0abc8035-c985-4531-bde3-8963d5484842 tempest-TestAggregatesBasicOps-33802804 tempest-TestAggregatesBasicOps-33802804-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:45.297447 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-0abc8035-c985-4531-bde3-8963d5484842 tempest-TestAggregatesBasicOps-33802804 tempest-TestAggregatesBasicOps-33802804-project-admin] 10.222.0.70 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 355 microversion: 2.1 time: 0.021217 Aug 27 03:14:45.298572 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2761/5480] 10.222.0.70 () {58 vars in 1152 bytes} [Sat Aug 27 03:14:45 2022] GET /compute/v2.1/os-aggregates/19 => generated 355 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:14:45.317766 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d6f5a0e8-8c1f-4421-82ff-e529d93a8414 tempest-TestAggregatesBasicOps-33802804 tempest-TestAggregatesBasicOps-33802804-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-852278-4"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:14:45.343054 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d6f5a0e8-8c1f-4421-82ff-e529d93a8414 tempest-TestAggregatesBasicOps-33802804 tempest-TestAggregatesBasicOps-33802804-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:45.343557 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d6f5a0e8-8c1f-4421-82ff-e529d93a8414 tempest-TestAggregatesBasicOps-33802804 tempest-TestAggregatesBasicOps-33802804-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:45.343998 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d6f5a0e8-8c1f-4421-82ff-e529d93a8414 tempest-TestAggregatesBasicOps-33802804 tempest-TestAggregatesBasicOps-33802804-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:46.066303 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d6f5a0e8-8c1f-4421-82ff-e529d93a8414 tempest-TestAggregatesBasicOps-33802804 tempest-TestAggregatesBasicOps-33802804-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 340 microversion: 2.1 time: 0.758388 Aug 27 03:14:46.075069 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2720/5481] 10.222.0.70 () {60 vars in 1194 bytes} [Sat Aug 27 03:14:45 2022] POST /compute/v2.1/os-aggregates/19/action => generated 340 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:14:46.082577 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f333b0ce-4cba-452e-b00d-fe8444938ff3 tempest-TestAggregatesBasicOps-33802804 tempest-TestAggregatesBasicOps-33802804-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:46.129484 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-f333b0ce-4cba-452e-b00d-fe8444938ff3 tempest-TestAggregatesBasicOps-33802804 tempest-TestAggregatesBasicOps-33802804-project-admin] 10.222.0.70 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.053616 Aug 27 03:14:46.136350 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2762/5482] 10.222.0.70 () {58 vars in 1155 bytes} [Sat Aug 27 03:14:46 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Aug 27 03:14:47.855796 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-44d85d5c-f23b-43c5-b149-47fd5642bdd7 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:47.856344 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-44d85d5c-f23b-43c5-b149-47fd5642bdd7 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] [instance: 87d21254-70b6-4272-9b1f-23556ead1aa4] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:47.870560 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-44d85d5c-f23b-43c5-b149-47fd5642bdd7 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:47.870967 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-44d85d5c-f23b-43c5-b149-47fd5642bdd7 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:47.871401 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-44d85d5c-f23b-43c5-b149-47fd5642bdd7 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:47.872121 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-44d85d5c-f23b-43c5-b149-47fd5642bdd7 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:47.872596 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-44d85d5c-f23b-43c5-b149-47fd5642bdd7 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:47.873020 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-44d85d5c-f23b-43c5-b149-47fd5642bdd7 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:47.936506 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-44d85d5c-f23b-43c5-b149-47fd5642bdd7 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] 10.222.0.70 "GET /compute/v2.1/servers/87d21254-70b6-4272-9b1f-23556ead1aa4/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.085233 Aug 27 03:14:47.937112 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2721/5483] 10.222.0.70 () {58 vars in 1293 bytes} [Sat Aug 27 03:14:47 2022] GET /compute/v2.1/servers/87d21254-70b6-4272-9b1f-23556ead1aa4/os-server-password => generated 116 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:14:56.091028 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:14:56.092120 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:14:56.096660 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7be3add1-b38f-41ee-b01f-cbfa16afa299 tempest-VolumesTestJSON-111828655 tempest-VolumesTestJSON-111828655-project] Calling method '.version_select at 0x7f5eddab8820>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:56.117669 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=2,nova_api:INSERT=3,nova_api:DELETE=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:14:56.161002 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-7be3add1-b38f-41ee-b01f-cbfa16afa299 tempest-VolumesTestJSON-111828655 tempest-VolumesTestJSON-111828655-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/0b657525-ede6-47bb-bc6c-f45b693656e0" status: 200 len: 351 microversion: 2.1 time: 0.072779 Aug 27 03:14:56.161973 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2763/5484] 10.222.0.70 () {58 vars in 1245 bytes} [Sat Aug 27 03:14:56 2022] GET /compute/v2.1/os-volumes/0b657525-ede6-47bb-bc6c-f45b693656e0 => generated 351 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:14:58.944188 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-1c0cd40a-3c7c-4215-92f9-8f06609c9a4c tempest-VolumesTestJSON-111828655 tempest-VolumesTestJSON-111828655-project] Calling method '.version_select at 0x7f5ee7219940>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:58.958872 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=44,nova_api:DELETE=2,nova_api:INSERT=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:14:58.959694 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=43 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:14:59.526965 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-1c0cd40a-3c7c-4215-92f9-8f06609c9a4c tempest-VolumesTestJSON-111828655 tempest-VolumesTestJSON-111828655-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/fd52594b-7d50-4a47-a673-5553891707d0" status: 200 len: 350 microversion: 2.1 time: 0.586539 Aug 27 03:14:59.527378 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2722/5485] 10.222.0.70 () {58 vars in 1245 bytes} [Sat Aug 27 03:14:58 2022] GET /compute/v2.1/os-volumes/fd52594b-7d50-4a47-a673-5553891707d0 => generated 350 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:15:02.234577 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-006d8f3f-1c78-4123-a404-10b4d1d5e94f tempest-VolumesTestJSON-111828655 tempest-VolumesTestJSON-111828655-project] Calling method '.version_select at 0x7f5eddace670>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:02.528361 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-006d8f3f-1c78-4123-a404-10b4d1d5e94f tempest-VolumesTestJSON-111828655 tempest-VolumesTestJSON-111828655-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/6ed66a14-ec37-4f96-8b95-cac7a2209d65" status: 200 len: 350 microversion: 2.1 time: 0.297620 Aug 27 03:15:02.542174 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2764/5486] 10.222.0.70 () {58 vars in 1245 bytes} [Sat Aug 27 03:15:02 2022] GET /compute/v2.1/os-volumes/6ed66a14-ec37-4f96-8b95-cac7a2209d65 => generated 350 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:15:02.542711 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-23159c36-5658-4607-8d8b-1557e79ba7bc tempest-VolumesTestJSON-111828655 tempest-VolumesTestJSON-111828655-project] Calling method '.version_select at 0x7f5ee3030a60>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:02.644348 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-23159c36-5658-4607-8d8b-1557e79ba7bc tempest-VolumesTestJSON-111828655 tempest-VolumesTestJSON-111828655-project] 10.222.0.70 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.106564 Aug 27 03:15:02.645016 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2723/5487] 10.222.0.70 () {58 vars in 1134 bytes} [Sat Aug 27 03:15:02 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:15:02.658803 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b3dba6ad-4227-47a2-8212-d631031e2c6a tempest-VolumesTestJSON-111828655 tempest-VolumesTestJSON-111828655-project] Calling method '.version_select at 0x7f5eddab81f0>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:02.767330 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b3dba6ad-4227-47a2-8212-d631031e2c6a tempest-VolumesTestJSON-111828655 tempest-VolumesTestJSON-111828655-project] 10.222.0.70 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.112241 Aug 27 03:15:02.767939 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2765/5488] 10.222.0.70 () {58 vars in 1149 bytes} [Sat Aug 27 03:15:02 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:15:02.781762 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f16fce3d-ca0b-4907-abc4-adf2793cda04 tempest-VolumesTestJSON-111828655 tempest-VolumesTestJSON-111828655-project] Calling method '.version_select at 0x7f5ee1d95ca0>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:02.886776 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f16fce3d-ca0b-4907-abc4-adf2793cda04 tempest-VolumesTestJSON-111828655 tempest-VolumesTestJSON-111828655-project] 10.222.0.70 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.109270 Aug 27 03:15:02.887450 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2724/5489] 10.222.0.70 () {58 vars in 1134 bytes} [Sat Aug 27 03:15:02 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:15:02.901627 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4106b898-2650-4cb4-b4a5-663e99da9330 tempest-VolumesTestJSON-111828655 tempest-VolumesTestJSON-111828655-project] Calling method '.version_select at 0x7f5ede8e6b80>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:03.033360 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-4106b898-2650-4cb4-b4a5-663e99da9330 tempest-VolumesTestJSON-111828655 tempest-VolumesTestJSON-111828655-project] 10.222.0.70 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.136651 Aug 27 03:15:03.033947 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2766/5490] 10.222.0.70 () {58 vars in 1167 bytes} [Sat Aug 27 03:15:02 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:15:03.047624 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b8f9ef45-0a98-4cfe-8434-94a116769a80 tempest-VolumesTestJSON-111828655 tempest-VolumesTestJSON-111828655-project] Calling method '.version_select at 0x7f5ee1eb8820>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:03.171902 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b8f9ef45-0a98-4cfe-8434-94a116769a80 tempest-VolumesTestJSON-111828655 tempest-VolumesTestJSON-111828655-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.127737 Aug 27 03:15:03.172722 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2725/5491] 10.222.0.70 () {58 vars in 1170 bytes} [Sat Aug 27 03:15:03 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:15:03.187404 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-16b5cf74-0ed8-4db1-9786-7b8518c96047 tempest-VolumesTestJSON-111828655 tempest-VolumesTestJSON-111828655-project] Calling method '.version_select at 0x7f5edda4f790>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:03.278398 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-16b5cf74-0ed8-4db1-9786-7b8518c96047 tempest-VolumesTestJSON-111828655 tempest-VolumesTestJSON-111828655-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.095824 Aug 27 03:15:03.287025 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2767/5492] 10.222.0.70 () {58 vars in 1155 bytes} [Sat Aug 27 03:15:03 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:15:03.292281 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ccc83ffc-6933-42ee-98d7-43187e1215de tempest-VolumesTestJSON-111828655 tempest-VolumesTestJSON-111828655-project] Calling method '.version_select at 0x7f5ee1dafd30>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:03.386777 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ccc83ffc-6933-42ee-98d7-43187e1215de tempest-VolumesTestJSON-111828655 tempest-VolumesTestJSON-111828655-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.098373 Aug 27 03:15:03.388279 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2726/5493] 10.222.0.70 () {58 vars in 1188 bytes} [Sat Aug 27 03:15:03 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:15:03.403584 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f2a498a9-c183-4e07-b141-92f5cc369641 tempest-VolumesTestJSON-111828655 tempest-VolumesTestJSON-111828655-project] Calling method '.version_select at 0x7f5eddab89d0>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:03.498901 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-f2a498a9-c183-4e07-b141-92f5cc369641 tempest-VolumesTestJSON-111828655 tempest-VolumesTestJSON-111828655-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.100437 Aug 27 03:15:03.499846 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2768/5494] 10.222.0.70 () {58 vars in 1155 bytes} [Sat Aug 27 03:15:03 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:15:20.792038 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-37b7c288-decd-41e9-9450-aac9668f74c6 tempest-VolumesNegativeTest-700388171 tempest-VolumesNegativeTest-700388171-project] Action: 'create', calling method: .version_select at 0x7f5ee1eb8310>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1549633477", "metadata": {"Type": "work"}}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:15:20.796043 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-37b7c288-decd-41e9-9450-aac9668f74c6 tempest-VolumesNegativeTest-700388171 tempest-VolumesNegativeTest-700388171-project] Request method failure captured: Aug 27 03:15:20.796043 n-d-852278-4 devstack@n-api.service[134052]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 27 03:15:20.796043 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 03:15:20.796043 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 03:15:20.796043 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 03:15:20.796043 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 122 Aug 27 03:15:20.796043 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 03:15:20.796043 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 03:15:20.796043 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 03:15:20.796043 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 03:15:20.796043 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYxIAk4ITD9vQr3jxrjrcaY2Sk9-Ee-pHUU2MvPBzsLCFGfJwadkv2nBqv0RPUK2oFMhyR8DTojMEzqtKijfSXTqsjyrJOlGDVcnL-858PkxF5TfSFUobQ1z_sd88jKmIlfTO_BXur3nDh9LLftblGMZR-_GX9fePOGpUZFGrzfKtmw Aug 27 03:15:20.796043 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 03:15:20.796043 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 03:15:20.796043 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 03:15:20.796043 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 03:15:20.796043 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 03:15:20.796043 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 03:15:20.796043 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: bc49a459f04b44fb88a611d7a9599fc7 Aug 27 03:15:20.796043 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-VolumesNegativeTest-700388171 Aug 27 03:15:20.796043 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 03:15:20.796043 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 03:15:20.796043 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/bc49a459f04b44fb88a611d7a9599fc7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_bc49a459f04b44fb88a611d7a9599fc7", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/bc49a459f04b44fb88a611d7a9599fc7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/bc49a459f04b44fb88a611d7a9599fc7"}]}] Aug 27 03:15:20.796043 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-VolumesNegativeTest-700388171 Aug 27 03:15:20.796043 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: bc49a459f04b44fb88a611d7a9599fc7 Aug 27 03:15:20.796043 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-VolumesNegativeTest-700388171 Aug 27 03:15:20.796043 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-VolumesNegativeTest-700388171-project Aug 27 03:15:20.796043 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 03:15:20.796043 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 03:15:20.796043 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 4f378e7bda274a859fab5147409a8a79 Aug 27 03:15:20.796043 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-VolumesNegativeTest-700388171-project Aug 27 03:15:20.796043 n-d-852278-4 devstack@n-api.service[134052]: Aug 27 03:15:20.796043 n-d-852278-4 devstack@n-api.service[134052]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1549633477", "metadata": {"Type": "work"}}} Aug 27 03:15:20.796043 n-d-852278-4 devstack@n-api.service[134052]: method: Aug 27 03:15:20.796043 n-d-852278-4 devstack@n-api.service[134052]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 27 03:15:20.796043 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1549633477', 'metadata': {'Type': 'work'}}}} Aug 27 03:15:20.796043 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:15:20.796043 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:15:20.796043 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 03:15:20.796043 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 03:15:20.796043 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 03:15:20.796043 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise error Aug 27 03:15:20.796043 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 27 03:15:20.796043 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:15:20.796043 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 27 03:15:20.796043 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 27 03:15:20.796043 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:15:20.796043 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 27 03:15:20.796043 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi '#$%' Aug 27 03:15:20.796043 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:15:20.796043 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:15:20.796043 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:15:20.796043 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:15:20.796043 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:15:20.796043 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:15:20.796043 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:15:20.796043 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:15:20.796043 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:15:20.796043 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:15:20.796043 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:15:20.796043 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:15:20.796043 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 03:15:20.796043 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 03:15:20.796043 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 03:15:20.796043 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 03:15:20.796043 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 03:15:20.796043 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 03:15:20.799944 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 27 03:15:20.799944 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:15:20.799944 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:15:20.799944 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:15:20.799944 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:15:20.799944 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:15:20.799944 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:15:20.799944 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 03:15:20.799944 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 03:15:20.799944 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 27 03:15:20.799944 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:15:20.799944 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-37b7c288-decd-41e9-9450-aac9668f74c6 tempest-VolumesNegativeTest-700388171 tempest-VolumesNegativeTest-700388171-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:15:20.799944 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-37b7c288-decd-41e9-9450-aac9668f74c6 tempest-VolumesNegativeTest-700388171 tempest-VolumesNegativeTest-700388171-project] 10.222.0.70 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.237832 Aug 27 03:15:20.807456 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-15010c7d-19b4-4159-9e83-d14bc067db64 tempest-VolumesNegativeTest-700388171 tempest-VolumesNegativeTest-700388171-project] Action: 'create', calling method: .version_select at 0x7f5eddaac310>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-743027322", "metadata": {"Type": "work"}}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:15:20.808808 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2727/5495] 10.222.0.70 () {60 vars in 1156 bytes} [Sat Aug 27 03:15:20 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 251 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:15:20.811489 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-15010c7d-19b4-4159-9e83-d14bc067db64 tempest-VolumesNegativeTest-700388171 tempest-VolumesNegativeTest-700388171-project] Request method failure captured: Aug 27 03:15:20.811489 n-d-852278-4 devstack@n-api.service[134051]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 27 03:15:20.811489 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 03:15:20.811489 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 03:15:20.811489 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 03:15:20.811489 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 119 Aug 27 03:15:20.811489 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 03:15:20.811489 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 03:15:20.811489 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 03:15:20.811489 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 03:15:20.811489 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYxIAk4ITD9vQr3jxrjrcaY2Sk9-Ee-pHUU2MvPBzsLCFGfJwadkv2nBqv0RPUK2oFMhyR8DTojMEzqtKijfSXTqsjyrJOlGDVcnL-858PkxF5TfSFUobQ1z_sd88jKmIlfTO_BXur3nDh9LLftblGMZR-_GX9fePOGpUZFGrzfKtmw Aug 27 03:15:20.811489 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 03:15:20.811489 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 03:15:20.811489 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 03:15:20.811489 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 03:15:20.811489 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 03:15:20.811489 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 03:15:20.811489 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: bc49a459f04b44fb88a611d7a9599fc7 Aug 27 03:15:20.811489 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-VolumesNegativeTest-700388171 Aug 27 03:15:20.811489 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 03:15:20.811489 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 03:15:20.811489 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/bc49a459f04b44fb88a611d7a9599fc7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_bc49a459f04b44fb88a611d7a9599fc7", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/bc49a459f04b44fb88a611d7a9599fc7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/bc49a459f04b44fb88a611d7a9599fc7"}]}] Aug 27 03:15:20.811489 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-VolumesNegativeTest-700388171 Aug 27 03:15:20.811489 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: bc49a459f04b44fb88a611d7a9599fc7 Aug 27 03:15:20.811489 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-VolumesNegativeTest-700388171 Aug 27 03:15:20.811489 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-VolumesNegativeTest-700388171-project Aug 27 03:15:20.811489 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 03:15:20.811489 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 03:15:20.811489 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 4f378e7bda274a859fab5147409a8a79 Aug 27 03:15:20.811489 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-VolumesNegativeTest-700388171-project Aug 27 03:15:20.811489 n-d-852278-4 devstack@n-api.service[134051]: Aug 27 03:15:20.811489 n-d-852278-4 devstack@n-api.service[134051]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-743027322", "metadata": {"Type": "work"}}} Aug 27 03:15:20.811489 n-d-852278-4 devstack@n-api.service[134051]: method: Aug 27 03:15:20.811489 n-d-852278-4 devstack@n-api.service[134051]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 27 03:15:20.811489 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-743027322', 'metadata': {'Type': 'work'}}}} Aug 27 03:15:20.811489 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:15:20.811489 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:15:20.811489 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 03:15:20.811489 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 03:15:20.811489 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 03:15:20.811489 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise error Aug 27 03:15:20.811489 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 27 03:15:20.811489 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:15:20.811489 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 27 03:15:20.811489 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 27 03:15:20.811489 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:15:20.811489 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 27 03:15:20.811489 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi '0' Aug 27 03:15:20.811489 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:15:20.811489 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:15:20.811489 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:15:20.811489 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:15:20.811489 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:15:20.811489 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:15:20.811489 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:15:20.811489 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:15:20.811489 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:15:20.811489 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:15:20.811489 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:15:20.811489 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:15:20.811489 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 03:15:20.811489 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 03:15:20.811489 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 03:15:20.811489 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 03:15:20.811489 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 03:15:20.811489 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 03:15:20.815588 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 27 03:15:20.815588 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:15:20.815588 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:15:20.815588 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:15:20.815588 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:15:20.815588 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:15:20.815588 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:15:20.815588 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 03:15:20.815588 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 03:15:20.815588 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 27 03:15:20.815588 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:15:20.815588 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-15010c7d-19b4-4159-9e83-d14bc067db64 tempest-VolumesNegativeTest-700388171 tempest-VolumesNegativeTest-700388171-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:15:20.817780 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-15010c7d-19b4-4159-9e83-d14bc067db64 tempest-VolumesNegativeTest-700388171 tempest-VolumesNegativeTest-700388171-project] 10.222.0.70 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009674 Aug 27 03:15:20.817974 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2769/5496] 10.222.0.70 () {60 vars in 1156 bytes} [Sat Aug 27 03:15:20 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:15:20.845990 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-10da1fd3-4891-4629-bc8a-94341bcfc334 tempest-VolumesNegativeTest-700388171 tempest-VolumesNegativeTest-700388171-project] Action: 'create', calling method: .version_select at 0x7f5ee1dd4dc0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1751378192", "metadata": {"Type": "work"}}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:15:20.854349 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-10da1fd3-4891-4629-bc8a-94341bcfc334 tempest-VolumesNegativeTest-700388171 tempest-VolumesNegativeTest-700388171-project] Request method failure captured: Aug 27 03:15:20.854349 n-d-852278-4 devstack@n-api.service[134052]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 27 03:15:20.854349 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 03:15:20.854349 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 03:15:20.854349 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 03:15:20.854349 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 119 Aug 27 03:15:20.854349 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 03:15:20.854349 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 03:15:20.854349 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 03:15:20.854349 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 03:15:20.854349 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYxIAk4ITD9vQr3jxrjrcaY2Sk9-Ee-pHUU2MvPBzsLCFGfJwadkv2nBqv0RPUK2oFMhyR8DTojMEzqtKijfSXTqsjyrJOlGDVcnL-858PkxF5TfSFUobQ1z_sd88jKmIlfTO_BXur3nDh9LLftblGMZR-_GX9fePOGpUZFGrzfKtmw Aug 27 03:15:20.854349 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 03:15:20.854349 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 03:15:20.854349 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 03:15:20.854349 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 03:15:20.854349 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 03:15:20.854349 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 03:15:20.854349 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: bc49a459f04b44fb88a611d7a9599fc7 Aug 27 03:15:20.854349 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-VolumesNegativeTest-700388171 Aug 27 03:15:20.854349 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 03:15:20.854349 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 03:15:20.854349 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/bc49a459f04b44fb88a611d7a9599fc7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_bc49a459f04b44fb88a611d7a9599fc7", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/bc49a459f04b44fb88a611d7a9599fc7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/bc49a459f04b44fb88a611d7a9599fc7"}]}] Aug 27 03:15:20.854349 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-VolumesNegativeTest-700388171 Aug 27 03:15:20.854349 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: bc49a459f04b44fb88a611d7a9599fc7 Aug 27 03:15:20.854349 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-VolumesNegativeTest-700388171 Aug 27 03:15:20.854349 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-VolumesNegativeTest-700388171-project Aug 27 03:15:20.854349 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 03:15:20.854349 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 03:15:20.854349 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 4f378e7bda274a859fab5147409a8a79 Aug 27 03:15:20.854349 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-VolumesNegativeTest-700388171-project Aug 27 03:15:20.854349 n-d-852278-4 devstack@n-api.service[134052]: Aug 27 03:15:20.854349 n-d-852278-4 devstack@n-api.service[134052]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1751378192", "metadata": {"Type": "work"}}} Aug 27 03:15:20.854349 n-d-852278-4 devstack@n-api.service[134052]: method: Aug 27 03:15:20.854349 n-d-852278-4 devstack@n-api.service[134052]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 27 03:15:20.854349 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1751378192', 'metadata': {'Type': 'work'}}}} Aug 27 03:15:20.854349 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:15:20.854349 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:15:20.854349 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 03:15:20.854349 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 03:15:20.854349 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 03:15:20.854349 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise error Aug 27 03:15:20.854349 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 27 03:15:20.854349 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:15:20.854349 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 27 03:15:20.854349 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 27 03:15:20.854349 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:15:20.854349 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 27 03:15:20.854349 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi '' Aug 27 03:15:20.854349 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:15:20.854349 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:15:20.854349 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:15:20.854349 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:15:20.854349 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:15:20.854349 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:15:20.854349 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:15:20.854349 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:15:20.854349 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:15:20.854349 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:15:20.854349 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:15:20.854349 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:15:20.854349 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 03:15:20.854349 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 03:15:20.854349 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 03:15:20.854349 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 03:15:20.854349 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 03:15:20.854349 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 03:15:20.858361 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 27 03:15:20.858361 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:15:20.858361 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:15:20.858361 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:15:20.858361 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:15:20.858361 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:15:20.858361 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:15:20.858361 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 03:15:20.858361 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 03:15:20.858361 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 27 03:15:20.858361 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:15:20.860454 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-10da1fd3-4891-4629-bc8a-94341bcfc334 tempest-VolumesNegativeTest-700388171 tempest-VolumesNegativeTest-700388171-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:15:20.861518 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-10da1fd3-4891-4629-bc8a-94341bcfc334 tempest-VolumesNegativeTest-700388171 tempest-VolumesNegativeTest-700388171-project] 10.222.0.70 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.032386 Aug 27 03:15:20.862749 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2728/5497] 10.222.0.70 () {60 vars in 1156 bytes} [Sat Aug 27 03:15:20 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:15:20.874746 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-337327ae-094b-4896-805d-ebc5aa09dd54 tempest-VolumesNegativeTest-700388171 tempest-VolumesNegativeTest-700388171-project] Calling method '.version_select at 0x7f5eddaac0d0>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:20.918528 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-337327ae-094b-4896-805d-ebc5aa09dd54 tempest-VolumesNegativeTest-700388171 tempest-VolumesNegativeTest-700388171-project] HTTP exception thrown: Volume tempest-invalid-413111999 could not be found. Aug 27 03:15:20.922617 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-337327ae-094b-4896-805d-ebc5aa09dd54 tempest-VolumesNegativeTest-700388171 tempest-VolumesNegativeTest-700388171-project] Request method failure captured: Aug 27 03:15:20.922617 n-d-852278-4 devstack@n-api.service[134051]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-413111999 HTTP/1.1 Aug 27 03:15:20.922617 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 03:15:20.922617 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 03:15:20.922617 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 03:15:20.922617 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 03:15:20.922617 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 03:15:20.922617 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 03:15:20.922617 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 03:15:20.922617 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 03:15:20.922617 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYxIAk4ITD9vQr3jxrjrcaY2Sk9-Ee-pHUU2MvPBzsLCFGfJwadkv2nBqv0RPUK2oFMhyR8DTojMEzqtKijfSXTqsjyrJOlGDVcnL-858PkxF5TfSFUobQ1z_sd88jKmIlfTO_BXur3nDh9LLftblGMZR-_GX9fePOGpUZFGrzfKtmw Aug 27 03:15:20.922617 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 03:15:20.922617 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 03:15:20.922617 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 03:15:20.922617 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 03:15:20.922617 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 03:15:20.922617 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 03:15:20.922617 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: bc49a459f04b44fb88a611d7a9599fc7 Aug 27 03:15:20.922617 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-VolumesNegativeTest-700388171 Aug 27 03:15:20.922617 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 03:15:20.922617 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 03:15:20.922617 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/bc49a459f04b44fb88a611d7a9599fc7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_bc49a459f04b44fb88a611d7a9599fc7", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/bc49a459f04b44fb88a611d7a9599fc7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/bc49a459f04b44fb88a611d7a9599fc7"}]}] Aug 27 03:15:20.922617 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-VolumesNegativeTest-700388171 Aug 27 03:15:20.922617 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: bc49a459f04b44fb88a611d7a9599fc7 Aug 27 03:15:20.922617 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-VolumesNegativeTest-700388171 Aug 27 03:15:20.922617 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-VolumesNegativeTest-700388171-project Aug 27 03:15:20.922617 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 03:15:20.922617 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 03:15:20.922617 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 4f378e7bda274a859fab5147409a8a79 Aug 27 03:15:20.922617 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-VolumesNegativeTest-700388171-project Aug 27 03:15:20.922617 n-d-852278-4 devstack@n-api.service[134051]: method: Aug 27 03:15:20.922617 n-d-852278-4 devstack@n-api.service[134051]: exception: Volume tempest-invalid-413111999 could not be found. Aug 27 03:15:20.922617 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': 'tempest-invalid-413111999'} Aug 27 03:15:20.922617 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:15:20.922617 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:15:20.922617 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 03:15:20.922617 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 03:15:20.922617 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 27 03:15:20.922617 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 27 03:15:20.922617 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 27 03:15:20.922617 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 27 03:15:20.922617 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 27 03:15:20.922617 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 27 03:15:20.922617 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 27 03:15:20.922617 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 27 03:15:20.922617 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 03:15:20.922617 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 03:15:20.922617 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 03:15:20.922617 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 03:15:20.922617 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-413111999 could not be found. (HTTP 404) (Request-ID: req-4ef04ba6-6ab9-4f09-8bef-c3a464e24599) Aug 27 03:15:20.922617 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:15:20.922617 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:15:20.922617 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:15:20.922617 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:15:20.922617 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 27 03:15:20.922617 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 27 03:15:20.922617 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 27 03:15:20.922617 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 27 03:15:20.922617 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 27 03:15:20.922617 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 27 03:15:20.922617 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 27 03:15:20.922617 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 27 03:15:20.922617 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 03:15:20.922617 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 03:15:20.926442 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 27 03:15:20.926442 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 27 03:15:20.926442 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 27 03:15:20.926442 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 27 03:15:20.926442 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 27 03:15:20.926442 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 27 03:15:20.926442 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 27 03:15:20.926442 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 27 03:15:20.926442 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 03:15:20.926442 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 03:15:20.926442 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 03:15:20.926442 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 03:15:20.926442 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-413111999 could not be found. Aug 27 03:15:20.926442 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:15:20.926442 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:15:20.926442 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:15:20.926442 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:15:20.926442 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:15:20.926442 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:15:20.926442 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:15:20.926442 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:15:20.926442 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:15:20.926442 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:15:20.926442 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:15:20.926442 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:15:20.926442 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 27 03:15:20.926442 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:15:20.926442 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-413111999 could not be found. Aug 27 03:15:20.926442 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:15:20.926442 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:15:20.926442 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:15:20.926442 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:15:20.926442 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:15:20.926442 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:15:20.926442 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:15:20.926442 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:15:20.926442 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-413111999 could not be found. Aug 27 03:15:20.926442 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:15:20.929256 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-337327ae-094b-4896-805d-ebc5aa09dd54 tempest-VolumesNegativeTest-700388171 tempest-VolumesNegativeTest-700388171-project] Returning 404 to user: Volume tempest-invalid-413111999 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:15:20.930232 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-337327ae-094b-4896-805d-ebc5aa09dd54 tempest-VolumesNegativeTest-700388171 tempest-VolumesNegativeTest-700388171-project] 10.222.0.70 "DELETE /compute/v2.1/os-volumes/tempest-invalid-413111999" status: 404 len: 98 microversion: 2.1 time: 0.062794 Aug 27 03:15:20.930919 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2770/5498] 10.222.0.70 () {58 vars in 1215 bytes} [Sat Aug 27 03:15:20 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-413111999 => generated 98 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 03:15:20.942545 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d7463a57-f69f-4d6d-9708-3591d3358208 tempest-VolumesNegativeTest-700388171 tempest-VolumesNegativeTest-700388171-project] 10.222.0.70 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005150 Aug 27 03:15:20.943829 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2729/5499] 10.222.0.70 () {58 vars in 1140 bytes} [Sat Aug 27 03:15:20 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 27 03:15:20.952905 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-cfdf7870-cfcb-4fd6-87dc-9e5d25f25952 tempest-VolumesNegativeTest-700388171 tempest-VolumesNegativeTest-700388171-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004099 Aug 27 03:15:20.953583 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2771/5500] 10.222.0.70 () {58 vars in 1137 bytes} [Sat Aug 27 03:15:20 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 27 03:15:20.976713 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9fc64c73-635c-432a-a3e0-a8461e757e21 tempest-VolumesNegativeTest-700388171 tempest-VolumesNegativeTest-700388171-project] Calling method '.version_select at 0x7f5ee1eb8790>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:21.044176 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-9fc64c73-635c-432a-a3e0-a8461e757e21 tempest-VolumesNegativeTest-700388171 tempest-VolumesNegativeTest-700388171-project] HTTP exception thrown: Volume 29f71ef1-c36c-42b6-9bb9-5033e187b263 could not be found. Aug 27 03:15:21.049402 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9fc64c73-635c-432a-a3e0-a8461e757e21 tempest-VolumesNegativeTest-700388171 tempest-VolumesNegativeTest-700388171-project] Request method failure captured: Aug 27 03:15:21.049402 n-d-852278-4 devstack@n-api.service[134052]: request: DELETE /compute/v2.1/os-volumes/29f71ef1-c36c-42b6-9bb9-5033e187b263 HTTP/1.1 Aug 27 03:15:21.049402 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 03:15:21.049402 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 03:15:21.049402 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 03:15:21.049402 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 03:15:21.049402 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 03:15:21.049402 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 03:15:21.049402 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 03:15:21.049402 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 03:15:21.049402 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYxIAk4ITD9vQr3jxrjrcaY2Sk9-Ee-pHUU2MvPBzsLCFGfJwadkv2nBqv0RPUK2oFMhyR8DTojMEzqtKijfSXTqsjyrJOlGDVcnL-858PkxF5TfSFUobQ1z_sd88jKmIlfTO_BXur3nDh9LLftblGMZR-_GX9fePOGpUZFGrzfKtmw Aug 27 03:15:21.049402 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 03:15:21.049402 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 03:15:21.049402 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 03:15:21.049402 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 03:15:21.049402 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 03:15:21.049402 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 03:15:21.049402 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: bc49a459f04b44fb88a611d7a9599fc7 Aug 27 03:15:21.049402 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-VolumesNegativeTest-700388171 Aug 27 03:15:21.049402 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 03:15:21.049402 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 03:15:21.049402 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/bc49a459f04b44fb88a611d7a9599fc7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_bc49a459f04b44fb88a611d7a9599fc7", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/bc49a459f04b44fb88a611d7a9599fc7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/bc49a459f04b44fb88a611d7a9599fc7"}]}] Aug 27 03:15:21.049402 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-VolumesNegativeTest-700388171 Aug 27 03:15:21.049402 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: bc49a459f04b44fb88a611d7a9599fc7 Aug 27 03:15:21.049402 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-VolumesNegativeTest-700388171 Aug 27 03:15:21.049402 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-VolumesNegativeTest-700388171-project Aug 27 03:15:21.049402 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 03:15:21.049402 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 03:15:21.049402 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 4f378e7bda274a859fab5147409a8a79 Aug 27 03:15:21.049402 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-VolumesNegativeTest-700388171-project Aug 27 03:15:21.049402 n-d-852278-4 devstack@n-api.service[134052]: method: Aug 27 03:15:21.049402 n-d-852278-4 devstack@n-api.service[134052]: exception: Volume 29f71ef1-c36c-42b6-9bb9-5033e187b263 could not be found. Aug 27 03:15:21.049402 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '29f71ef1-c36c-42b6-9bb9-5033e187b263'} Aug 27 03:15:21.049402 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:15:21.049402 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:15:21.049402 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 03:15:21.049402 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 03:15:21.049402 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 27 03:15:21.049402 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 27 03:15:21.049402 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 27 03:15:21.049402 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 27 03:15:21.049402 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 27 03:15:21.049402 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 27 03:15:21.049402 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 27 03:15:21.049402 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 27 03:15:21.049402 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 03:15:21.049402 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 03:15:21.049402 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 03:15:21.049402 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 03:15:21.049402 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 29f71ef1-c36c-42b6-9bb9-5033e187b263 could not be found. (HTTP 404) (Request-ID: req-f782bedb-b441-4d5d-8f02-bd85fc01dca9) Aug 27 03:15:21.049402 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:15:21.049402 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:15:21.049402 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:15:21.049402 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:15:21.049402 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 27 03:15:21.049402 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 27 03:15:21.049402 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 27 03:15:21.049402 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 27 03:15:21.049402 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 27 03:15:21.049402 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 27 03:15:21.049402 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 27 03:15:21.049402 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 27 03:15:21.049402 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 03:15:21.053510 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 03:15:21.053510 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 27 03:15:21.053510 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 27 03:15:21.053510 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 27 03:15:21.053510 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 27 03:15:21.053510 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 27 03:15:21.053510 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 27 03:15:21.053510 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 27 03:15:21.053510 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 27 03:15:21.053510 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 03:15:21.053510 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 03:15:21.053510 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 03:15:21.053510 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 03:15:21.053510 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 29f71ef1-c36c-42b6-9bb9-5033e187b263 could not be found. Aug 27 03:15:21.053510 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:15:21.053510 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:15:21.053510 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:15:21.053510 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:15:21.053510 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:15:21.053510 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:15:21.053510 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:15:21.053510 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:15:21.053510 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:15:21.053510 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:15:21.053510 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:15:21.053510 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:15:21.053510 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 27 03:15:21.053510 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:15:21.053510 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 29f71ef1-c36c-42b6-9bb9-5033e187b263 could not be found. Aug 27 03:15:21.053510 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:15:21.053510 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:15:21.053510 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:15:21.053510 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:15:21.053510 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:15:21.053510 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:15:21.053510 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:15:21.053510 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:15:21.053510 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 29f71ef1-c36c-42b6-9bb9-5033e187b263 could not be found. Aug 27 03:15:21.053510 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:15:21.057091 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9fc64c73-635c-432a-a3e0-a8461e757e21 tempest-VolumesNegativeTest-700388171 tempest-VolumesNegativeTest-700388171-project] Returning 404 to user: Volume 29f71ef1-c36c-42b6-9bb9-5033e187b263 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:15:21.058313 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9fc64c73-635c-432a-a3e0-a8461e757e21 tempest-VolumesNegativeTest-700388171 tempest-VolumesNegativeTest-700388171-project] 10.222.0.70 "DELETE /compute/v2.1/os-volumes/29f71ef1-c36c-42b6-9bb9-5033e187b263" status: 404 len: 109 microversion: 2.1 time: 0.098520 Aug 27 03:15:21.058857 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2730/5501] 10.222.0.70 () {58 vars in 1248 bytes} [Sat Aug 27 03:15:20 2022] DELETE /compute/v2.1/os-volumes/29f71ef1-c36c-42b6-9bb9-5033e187b263 => generated 109 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 03:15:21.077955 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c126f08f-043a-4943-ad66-a8f8ab37a53d tempest-VolumesNegativeTest-700388171 tempest-VolumesNegativeTest-700388171-project] Calling method '.version_select at 0x7f5eddab8ca0>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:21.154595 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-c126f08f-043a-4943-ad66-a8f8ab37a53d tempest-VolumesNegativeTest-700388171 tempest-VolumesNegativeTest-700388171-project] HTTP exception thrown: Volume 249eaff1-829b-475f-99a7-633ebb97aee4 could not be found. Aug 27 03:15:21.157221 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c126f08f-043a-4943-ad66-a8f8ab37a53d tempest-VolumesNegativeTest-700388171 tempest-VolumesNegativeTest-700388171-project] Request method failure captured: Aug 27 03:15:21.157221 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/os-volumes/249eaff1-829b-475f-99a7-633ebb97aee4 HTTP/1.1 Aug 27 03:15:21.157221 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 03:15:21.157221 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 03:15:21.157221 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 03:15:21.157221 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 03:15:21.157221 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 03:15:21.157221 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 03:15:21.157221 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 03:15:21.157221 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 03:15:21.157221 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYxIAk4ITD9vQr3jxrjrcaY2Sk9-Ee-pHUU2MvPBzsLCFGfJwadkv2nBqv0RPUK2oFMhyR8DTojMEzqtKijfSXTqsjyrJOlGDVcnL-858PkxF5TfSFUobQ1z_sd88jKmIlfTO_BXur3nDh9LLftblGMZR-_GX9fePOGpUZFGrzfKtmw Aug 27 03:15:21.157221 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 03:15:21.157221 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 03:15:21.157221 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 03:15:21.157221 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 03:15:21.157221 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 03:15:21.157221 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 03:15:21.157221 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: bc49a459f04b44fb88a611d7a9599fc7 Aug 27 03:15:21.157221 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-VolumesNegativeTest-700388171 Aug 27 03:15:21.157221 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 03:15:21.157221 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 03:15:21.157221 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/bc49a459f04b44fb88a611d7a9599fc7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_bc49a459f04b44fb88a611d7a9599fc7", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/bc49a459f04b44fb88a611d7a9599fc7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/bc49a459f04b44fb88a611d7a9599fc7"}]}] Aug 27 03:15:21.157221 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-VolumesNegativeTest-700388171 Aug 27 03:15:21.157221 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: bc49a459f04b44fb88a611d7a9599fc7 Aug 27 03:15:21.157221 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-VolumesNegativeTest-700388171 Aug 27 03:15:21.157221 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-VolumesNegativeTest-700388171-project Aug 27 03:15:21.157221 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 03:15:21.157221 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 03:15:21.157221 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 4f378e7bda274a859fab5147409a8a79 Aug 27 03:15:21.157221 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-VolumesNegativeTest-700388171-project Aug 27 03:15:21.157221 n-d-852278-4 devstack@n-api.service[134051]: method: Aug 27 03:15:21.157221 n-d-852278-4 devstack@n-api.service[134051]: exception: Volume 249eaff1-829b-475f-99a7-633ebb97aee4 could not be found. Aug 27 03:15:21.157221 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '249eaff1-829b-475f-99a7-633ebb97aee4'} Aug 27 03:15:21.157221 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:15:21.157221 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:15:21.157221 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 03:15:21.157221 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 03:15:21.157221 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 27 03:15:21.157221 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 27 03:15:21.157221 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 27 03:15:21.157221 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 27 03:15:21.157221 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 27 03:15:21.157221 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 27 03:15:21.157221 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 27 03:15:21.157221 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 27 03:15:21.157221 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 03:15:21.157221 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 03:15:21.157221 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 03:15:21.157221 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 03:15:21.157221 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 249eaff1-829b-475f-99a7-633ebb97aee4 could not be found. (HTTP 404) (Request-ID: req-7ab4468d-1eaa-4a08-b5e1-cbed462f0afc) Aug 27 03:15:21.157221 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:15:21.157221 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:15:21.157221 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:15:21.157221 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:15:21.157221 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 27 03:15:21.157221 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 27 03:15:21.157221 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 27 03:15:21.157221 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 27 03:15:21.157221 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 27 03:15:21.157221 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 27 03:15:21.157221 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 27 03:15:21.157221 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 27 03:15:21.157221 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 03:15:21.161257 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 03:15:21.161257 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 27 03:15:21.161257 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 27 03:15:21.161257 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 27 03:15:21.161257 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 27 03:15:21.161257 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 27 03:15:21.161257 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 27 03:15:21.161257 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 27 03:15:21.161257 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 27 03:15:21.161257 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 03:15:21.161257 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 03:15:21.161257 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 03:15:21.161257 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 03:15:21.161257 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 249eaff1-829b-475f-99a7-633ebb97aee4 could not be found. Aug 27 03:15:21.161257 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:15:21.161257 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:15:21.161257 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:15:21.161257 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:15:21.161257 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:15:21.161257 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:15:21.161257 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:15:21.161257 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:15:21.161257 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:15:21.161257 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:15:21.161257 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:15:21.161257 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:15:21.161257 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 27 03:15:21.161257 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:15:21.161257 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 249eaff1-829b-475f-99a7-633ebb97aee4 could not be found. Aug 27 03:15:21.161257 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:15:21.161257 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:15:21.161257 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:15:21.161257 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:15:21.161257 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:15:21.161257 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:15:21.161257 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:15:21.161257 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:15:21.161257 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 249eaff1-829b-475f-99a7-633ebb97aee4 could not be found. Aug 27 03:15:21.161257 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:15:21.161257 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c126f08f-043a-4943-ad66-a8f8ab37a53d tempest-VolumesNegativeTest-700388171 tempest-VolumesNegativeTest-700388171-project] Returning 404 to user: Volume 249eaff1-829b-475f-99a7-633ebb97aee4 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:15:21.165480 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c126f08f-043a-4943-ad66-a8f8ab37a53d tempest-VolumesNegativeTest-700388171 tempest-VolumesNegativeTest-700388171-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/249eaff1-829b-475f-99a7-633ebb97aee4" status: 404 len: 109 microversion: 2.1 time: 0.097917 Aug 27 03:15:21.165480 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2772/5502] 10.222.0.70 () {58 vars in 1245 bytes} [Sat Aug 27 03:15:21 2022] GET /compute/v2.1/os-volumes/249eaff1-829b-475f-99a7-633ebb97aee4 => generated 109 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:15:21.918025 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6d72f350-ca9d-4177-9f5e-a5b278fdcc0d tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:21.921669 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6d72f350-ca9d-4177-9f5e-a5b278fdcc0d tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:21.922390 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6d72f350-ca9d-4177-9f5e-a5b278fdcc0d tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:21.923081 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6d72f350-ca9d-4177-9f5e-a5b278fdcc0d tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:21.926264 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6d72f350-ca9d-4177-9f5e-a5b278fdcc0d tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:21.945039 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6d72f350-ca9d-4177-9f5e-a5b278fdcc0d tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:21.945709 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6d72f350-ca9d-4177-9f5e-a5b278fdcc0d tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:21.997425 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-6d72f350-ca9d-4177-9f5e-a5b278fdcc0d tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] 10.222.0.70 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.399625 Aug 27 03:15:22.001641 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2731/5503] 10.222.0.70 () {58 vars in 1185 bytes} [Sat Aug 27 03:15:21 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:15:22.142892 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-185e9525-60be-4bd7-bd1c-a4d9165dece5 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-568586738", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "availability_zone": "nova:n-h2-852278-4", "networks": [{"uuid": "a99f11d1-b234-4f0e-9e07-1b05341591ca"}]}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:15:22.220207 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.network.neutron [None req-185e9525-60be-4bd7-bd1c-a4d9165dece5 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] validate_networks() for [('a99f11d1-b234-4f0e-9e07-1b05341591ca', None, None, None, None, None)] {{(pid=134051) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:15:22.940415 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-185e9525-60be-4bd7-bd1c-a4d9165dece5 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Flavor limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:15:22.941595 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-185e9525-60be-4bd7-bd1c-a4d9165dece5 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Image limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:15:22.942209 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-185e9525-60be-4bd7-bd1c-a4d9165dece5 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Flavor pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:15:22.942774 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-185e9525-60be-4bd7-bd1c-a4d9165dece5 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Image pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:15:22.943843 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-185e9525-60be-4bd7-bd1c-a4d9165dece5 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:15:22.969049 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-185e9525-60be-4bd7-bd1c-a4d9165dece5 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:22.969537 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-185e9525-60be-4bd7-bd1c-a4d9165dece5 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:22.970837 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-185e9525-60be-4bd7-bd1c-a4d9165dece5 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:22.973210 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-185e9525-60be-4bd7-bd1c-a4d9165dece5 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:22.973670 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-185e9525-60be-4bd7-bd1c-a4d9165dece5 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:22.974417 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-185e9525-60be-4bd7-bd1c-a4d9165dece5 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:23.044590 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-185e9525-60be-4bd7-bd1c-a4d9165dece5 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Getting quotas for project 02f7b37c5e1f49ea8777d94036fc518f. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:15:23.074366 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-185e9525-60be-4bd7-bd1c-a4d9165dece5 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Getting quotas for user e78d14e7c20f478aa8d4ea7fc4aaf052 and project 02f7b37c5e1f49ea8777d94036fc518f. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:15:23.112168 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-185e9525-60be-4bd7-bd1c-a4d9165dece5 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Going to run 1 instances... {{(pid=134051) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:15:23.117113 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-185e9525-60be-4bd7-bd1c-a4d9165dece5 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] [instance: a9ad77c8-c9b3-4e94-a886-d87a18a4ee2f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134051) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:15:23.223742 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-185e9525-60be-4bd7-bd1c-a4d9165dece5 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.085854 Aug 27 03:15:23.232688 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2773/5504] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 03:15:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1095 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:15:23.235365 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c7c7a132-4e26-4b19-ba57-b3eeb910cc00 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:23.236068 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-c7c7a132-4e26-4b19-ba57-b3eeb910cc00 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] [instance: a9ad77c8-c9b3-4e94-a886-d87a18a4ee2f] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:23.368672 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c7c7a132-4e26-4b19-ba57-b3eeb910cc00 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/a9ad77c8-c9b3-4e94-a886-d87a18a4ee2f" status: 200 len: 1328 microversion: 2.1 time: 0.136952 Aug 27 03:15:23.371138 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2732/5505] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:15:23 2022] GET /compute/v2.1/servers/a9ad77c8-c9b3-4e94-a886-d87a18a4ee2f => generated 1328 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:15:24.394153 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4151136e-c84e-4760-b2b0-c5e8e7d78e96 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:24.395131 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-4151136e-c84e-4760-b2b0-c5e8e7d78e96 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] [instance: a9ad77c8-c9b3-4e94-a886-d87a18a4ee2f] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:24.436137 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4151136e-c84e-4760-b2b0-c5e8e7d78e96 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:24.438724 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4151136e-c84e-4760-b2b0-c5e8e7d78e96 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:24.439174 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4151136e-c84e-4760-b2b0-c5e8e7d78e96 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:24.445688 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4151136e-c84e-4760-b2b0-c5e8e7d78e96 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:24.447836 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4151136e-c84e-4760-b2b0-c5e8e7d78e96 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:24.454494 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4151136e-c84e-4760-b2b0-c5e8e7d78e96 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:24.673179 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-4151136e-c84e-4760-b2b0-c5e8e7d78e96 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/a9ad77c8-c9b3-4e94-a886-d87a18a4ee2f" status: 200 len: 1415 microversion: 2.1 time: 0.282140 Aug 27 03:15:24.673814 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2774/5506] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:15:24 2022] GET /compute/v2.1/servers/a9ad77c8-c9b3-4e94-a886-d87a18a4ee2f => generated 1415 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:15:25.701280 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-2dc34dea-04c4-45bf-b455-04b9a99347fd tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:25.702491 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-2dc34dea-04c4-45bf-b455-04b9a99347fd tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] [instance: a9ad77c8-c9b3-4e94-a886-d87a18a4ee2f] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:25.715705 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2dc34dea-04c4-45bf-b455-04b9a99347fd tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:25.716977 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2dc34dea-04c4-45bf-b455-04b9a99347fd tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:25.725327 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2dc34dea-04c4-45bf-b455-04b9a99347fd tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:25.727022 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2dc34dea-04c4-45bf-b455-04b9a99347fd tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:25.727760 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2dc34dea-04c4-45bf-b455-04b9a99347fd tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:25.730230 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2dc34dea-04c4-45bf-b455-04b9a99347fd tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:25.910663 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-2dc34dea-04c4-45bf-b455-04b9a99347fd tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/a9ad77c8-c9b3-4e94-a886-d87a18a4ee2f" status: 200 len: 1421 microversion: 2.1 time: 0.211110 Aug 27 03:15:25.912292 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2733/5507] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:15:25 2022] GET /compute/v2.1/servers/a9ad77c8-c9b3-4e94-a886-d87a18a4ee2f => generated 1421 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:15:26.934087 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-63dbfa3a-3cd4-4563-ba74-c4308685fa59 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:26.934753 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-63dbfa3a-3cd4-4563-ba74-c4308685fa59 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] [instance: a9ad77c8-c9b3-4e94-a886-d87a18a4ee2f] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:26.949286 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-63dbfa3a-3cd4-4563-ba74-c4308685fa59 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:26.949794 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-63dbfa3a-3cd4-4563-ba74-c4308685fa59 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:26.950240 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-63dbfa3a-3cd4-4563-ba74-c4308685fa59 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:26.950967 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-63dbfa3a-3cd4-4563-ba74-c4308685fa59 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:26.951423 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-63dbfa3a-3cd4-4563-ba74-c4308685fa59 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:26.951894 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-63dbfa3a-3cd4-4563-ba74-c4308685fa59 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:27.756205 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-63dbfa3a-3cd4-4563-ba74-c4308685fa59 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/a9ad77c8-c9b3-4e94-a886-d87a18a4ee2f" status: 200 len: 1463 microversion: 2.1 time: 0.826769 Aug 27 03:15:27.767551 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2775/5508] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:15:26 2022] GET /compute/v2.1/servers/a9ad77c8-c9b3-4e94-a886-d87a18a4ee2f => generated 1463 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:15:27.896723 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-bb7be0b3-009f-4f5d-92b9-4f264e237799 req-ef6dde62-a537-4c8b-8e08-0a57dc47fef0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9ad77c8-c9b3-4e94-a886-d87a18a4ee2f", "tag": "af5103db-a01b-4bcd-a069-19d5d586eace"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:15:27.919704 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-bb7be0b3-009f-4f5d-92b9-4f264e237799 req-ef6dde62-a537-4c8b-8e08-0a57dc47fef0 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:27.920182 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-bb7be0b3-009f-4f5d-92b9-4f264e237799 req-ef6dde62-a537-4c8b-8e08-0a57dc47fef0 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:27.923239 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-bb7be0b3-009f-4f5d-92b9-4f264e237799 req-ef6dde62-a537-4c8b-8e08-0a57dc47fef0 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:27.961934 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-bb7be0b3-009f-4f5d-92b9-4f264e237799 req-ef6dde62-a537-4c8b-8e08-0a57dc47fef0 service nova] Creating event network-changed:af5103db-a01b-4bcd-a069-19d5d586eace for instance a9ad77c8-c9b3-4e94-a886-d87a18a4ee2f on n-h2-852278-4 Aug 27 03:15:27.974781 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-bb7be0b3-009f-4f5d-92b9-4f264e237799 req-ef6dde62-a537-4c8b-8e08-0a57dc47fef0 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082313 Aug 27 03:15:27.979666 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2734/5509] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:15:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:15:28.787859 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-05939dfe-6c43-4df3-9d81-a6e1230da6f4 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:28.788575 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-05939dfe-6c43-4df3-9d81-a6e1230da6f4 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] [instance: a9ad77c8-c9b3-4e94-a886-d87a18a4ee2f] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:28.802190 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-05939dfe-6c43-4df3-9d81-a6e1230da6f4 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:28.802699 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-05939dfe-6c43-4df3-9d81-a6e1230da6f4 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:28.803137 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-05939dfe-6c43-4df3-9d81-a6e1230da6f4 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:28.804088 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-05939dfe-6c43-4df3-9d81-a6e1230da6f4 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:28.804571 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-05939dfe-6c43-4df3-9d81-a6e1230da6f4 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:28.805001 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-05939dfe-6c43-4df3-9d81-a6e1230da6f4 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:29.009395 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-05939dfe-6c43-4df3-9d81-a6e1230da6f4 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/a9ad77c8-c9b3-4e94-a886-d87a18a4ee2f" status: 200 len: 1463 microversion: 2.1 time: 0.225354 Aug 27 03:15:29.012670 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2776/5510] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:15:28 2022] GET /compute/v2.1/servers/a9ad77c8-c9b3-4e94-a886-d87a18a4ee2f => generated 1463 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:15:30.030436 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8e9b5f03-818b-4e2c-9873-5a0736e477f5 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:30.031132 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-8e9b5f03-818b-4e2c-9873-5a0736e477f5 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] [instance: a9ad77c8-c9b3-4e94-a886-d87a18a4ee2f] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:30.038670 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8e9b5f03-818b-4e2c-9873-5a0736e477f5 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:30.039371 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8e9b5f03-818b-4e2c-9873-5a0736e477f5 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:30.039992 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8e9b5f03-818b-4e2c-9873-5a0736e477f5 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:30.040949 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8e9b5f03-818b-4e2c-9873-5a0736e477f5 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:30.041543 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8e9b5f03-818b-4e2c-9873-5a0736e477f5 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:30.042562 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8e9b5f03-818b-4e2c-9873-5a0736e477f5 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:30.469767 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-8e9b5f03-818b-4e2c-9873-5a0736e477f5 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/a9ad77c8-c9b3-4e94-a886-d87a18a4ee2f" status: 200 len: 1463 microversion: 2.1 time: 0.443386 Aug 27 03:15:30.474773 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2735/5511] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:15:30 2022] GET /compute/v2.1/servers/a9ad77c8-c9b3-4e94-a886-d87a18a4ee2f => generated 1463 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:15:31.495048 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-38359b2a-49f0-43ce-9441-3918c85fcd48 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:31.495646 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-38359b2a-49f0-43ce-9441-3918c85fcd48 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] [instance: a9ad77c8-c9b3-4e94-a886-d87a18a4ee2f] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:31.507053 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-38359b2a-49f0-43ce-9441-3918c85fcd48 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:31.508291 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-38359b2a-49f0-43ce-9441-3918c85fcd48 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:31.508789 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-38359b2a-49f0-43ce-9441-3918c85fcd48 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:31.509559 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-38359b2a-49f0-43ce-9441-3918c85fcd48 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:31.510022 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-38359b2a-49f0-43ce-9441-3918c85fcd48 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:31.510456 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-38359b2a-49f0-43ce-9441-3918c85fcd48 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:31.669819 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-38359b2a-49f0-43ce-9441-3918c85fcd48 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/a9ad77c8-c9b3-4e94-a886-d87a18a4ee2f" status: 200 len: 1463 microversion: 2.1 time: 0.178385 Aug 27 03:15:31.671183 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2777/5512] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:15:31 2022] GET /compute/v2.1/servers/a9ad77c8-c9b3-4e94-a886-d87a18a4ee2f => generated 1463 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:15:32.304351 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-75a1b267-cca9-4592-a4ee-ec07183e3359 req-0c00d299-1309-4909-aa61-a1b7b3606021 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9ad77c8-c9b3-4e94-a886-d87a18a4ee2f", "name": "network-vif-plugged", "status": "completed", "tag": "af5103db-a01b-4bcd-a069-19d5d586eace"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:15:32.321464 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:15:32.328155 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-75a1b267-cca9-4592-a4ee-ec07183e3359 req-0c00d299-1309-4909-aa61-a1b7b3606021 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:32.329230 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-75a1b267-cca9-4592-a4ee-ec07183e3359 req-0c00d299-1309-4909-aa61-a1b7b3606021 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:32.330453 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-75a1b267-cca9-4592-a4ee-ec07183e3359 req-0c00d299-1309-4909-aa61-a1b7b3606021 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:32.347075 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-75a1b267-cca9-4592-a4ee-ec07183e3359 req-0c00d299-1309-4909-aa61-a1b7b3606021 service nova] Creating event network-vif-plugged:af5103db-a01b-4bcd-a069-19d5d586eace for instance a9ad77c8-c9b3-4e94-a886-d87a18a4ee2f on n-h2-852278-4 Aug 27 03:15:32.355640 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-75a1b267-cca9-4592-a4ee-ec07183e3359 req-0c00d299-1309-4909-aa61-a1b7b3606021 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058060 Aug 27 03:15:32.357819 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2736/5513] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:15:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:15:32.691466 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d12ce440-7c4a-428a-90ec-97559eff5bae tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:32.692919 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d12ce440-7c4a-428a-90ec-97559eff5bae tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] [instance: a9ad77c8-c9b3-4e94-a886-d87a18a4ee2f] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:32.702948 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d12ce440-7c4a-428a-90ec-97559eff5bae tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:32.703985 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d12ce440-7c4a-428a-90ec-97559eff5bae tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:32.704629 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d12ce440-7c4a-428a-90ec-97559eff5bae tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:32.705711 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d12ce440-7c4a-428a-90ec-97559eff5bae tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:32.706514 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d12ce440-7c4a-428a-90ec-97559eff5bae tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:32.707093 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d12ce440-7c4a-428a-90ec-97559eff5bae tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:32.897758 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d12ce440-7c4a-428a-90ec-97559eff5bae tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/a9ad77c8-c9b3-4e94-a886-d87a18a4ee2f" status: 200 len: 1463 microversion: 2.1 time: 0.209898 Aug 27 03:15:32.898600 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2778/5514] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:15:32 2022] GET /compute/v2.1/servers/a9ad77c8-c9b3-4e94-a886-d87a18a4ee2f => generated 1463 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:15:33.921499 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9cfb89a3-96ee-4d1a-8f31-2f6bb608fc05 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:33.923172 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-9cfb89a3-96ee-4d1a-8f31-2f6bb608fc05 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] [instance: a9ad77c8-c9b3-4e94-a886-d87a18a4ee2f] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:33.927757 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:15:33.932241 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9cfb89a3-96ee-4d1a-8f31-2f6bb608fc05 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:33.932919 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9cfb89a3-96ee-4d1a-8f31-2f6bb608fc05 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:33.933354 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9cfb89a3-96ee-4d1a-8f31-2f6bb608fc05 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:33.934059 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9cfb89a3-96ee-4d1a-8f31-2f6bb608fc05 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:33.934502 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9cfb89a3-96ee-4d1a-8f31-2f6bb608fc05 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:33.935077 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9cfb89a3-96ee-4d1a-8f31-2f6bb608fc05 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:34.088041 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9cfb89a3-96ee-4d1a-8f31-2f6bb608fc05 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/a9ad77c8-c9b3-4e94-a886-d87a18a4ee2f" status: 200 len: 1648 microversion: 2.1 time: 0.172148 Aug 27 03:15:34.088817 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2737/5515] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:15:33 2022] GET /compute/v2.1/servers/a9ad77c8-c9b3-4e94-a886-d87a18a4ee2f => generated 1648 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:15:34.106256 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:15:34.107201 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=6 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:15:34.112918 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b2972cca-7a6f-4d2c-a388-75f0495d703c tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:34.113636 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b2972cca-7a6f-4d2c-a388-75f0495d703c tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] [instance: a9ad77c8-c9b3-4e94-a886-d87a18a4ee2f] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:34.127952 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b2972cca-7a6f-4d2c-a388-75f0495d703c tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:34.130005 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b2972cca-7a6f-4d2c-a388-75f0495d703c tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:34.130706 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b2972cca-7a6f-4d2c-a388-75f0495d703c tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:34.131856 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b2972cca-7a6f-4d2c-a388-75f0495d703c tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:34.132614 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b2972cca-7a6f-4d2c-a388-75f0495d703c tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:34.133300 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b2972cca-7a6f-4d2c-a388-75f0495d703c tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:34.284673 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b2972cca-7a6f-4d2c-a388-75f0495d703c tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/a9ad77c8-c9b3-4e94-a886-d87a18a4ee2f" status: 200 len: 1648 microversion: 2.1 time: 0.179018 Aug 27 03:15:34.299234 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2779/5516] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:15:34 2022] GET /compute/v2.1/servers/a9ad77c8-c9b3-4e94-a886-d87a18a4ee2f => generated 1648 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:15:34.304501 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-2c453873-1e89-4dbd-a90d-dd972a9f6ce4 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:34.305107 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-2c453873-1e89-4dbd-a90d-dd972a9f6ce4 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] [instance: a9ad77c8-c9b3-4e94-a886-d87a18a4ee2f] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:34.313783 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2c453873-1e89-4dbd-a90d-dd972a9f6ce4 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:34.314868 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2c453873-1e89-4dbd-a90d-dd972a9f6ce4 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:34.315574 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2c453873-1e89-4dbd-a90d-dd972a9f6ce4 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:34.316513 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2c453873-1e89-4dbd-a90d-dd972a9f6ce4 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:34.317042 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2c453873-1e89-4dbd-a90d-dd972a9f6ce4 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:34.317736 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2c453873-1e89-4dbd-a90d-dd972a9f6ce4 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:34.488131 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-2c453873-1e89-4dbd-a90d-dd972a9f6ce4 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/a9ad77c8-c9b3-4e94-a886-d87a18a4ee2f" status: 200 len: 1648 microversion: 2.1 time: 0.186714 Aug 27 03:15:34.489080 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2738/5517] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:15:34 2022] GET /compute/v2.1/servers/a9ad77c8-c9b3-4e94-a886-d87a18a4ee2f => generated 1648 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:15:34.708700 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0b4930a0-6c8b-47b0-a398-673ce594c666 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-632296061", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "availability_zone": "nova:n-h1-852278-4", "networks": [{"uuid": "a99f11d1-b234-4f0e-9e07-1b05341591ca"}]}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:15:34.801543 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.network.neutron [None req-0b4930a0-6c8b-47b0-a398-673ce594c666 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] validate_networks() for [('a99f11d1-b234-4f0e-9e07-1b05341591ca', None, None, None, None, None)] {{(pid=134051) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:15:35.221298 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-0b4930a0-6c8b-47b0-a398-673ce594c666 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Flavor limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:15:35.221963 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-0b4930a0-6c8b-47b0-a398-673ce594c666 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Image limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:15:35.222479 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-0b4930a0-6c8b-47b0-a398-673ce594c666 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Flavor pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:15:35.222900 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-0b4930a0-6c8b-47b0-a398-673ce594c666 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Image pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:15:35.223309 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-0b4930a0-6c8b-47b0-a398-673ce594c666 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:15:35.232798 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0b4930a0-6c8b-47b0-a398-673ce594c666 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:35.233378 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0b4930a0-6c8b-47b0-a398-673ce594c666 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:35.233817 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0b4930a0-6c8b-47b0-a398-673ce594c666 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:35.234543 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0b4930a0-6c8b-47b0-a398-673ce594c666 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:35.234997 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0b4930a0-6c8b-47b0-a398-673ce594c666 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:35.235421 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0b4930a0-6c8b-47b0-a398-673ce594c666 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:35.252440 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-0b4930a0-6c8b-47b0-a398-673ce594c666 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Getting quotas for project 02f7b37c5e1f49ea8777d94036fc518f. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:15:35.257764 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-0b4930a0-6c8b-47b0-a398-673ce594c666 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Getting quotas for user e78d14e7c20f478aa8d4ea7fc4aaf052 and project 02f7b37c5e1f49ea8777d94036fc518f. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:15:35.270812 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-0b4930a0-6c8b-47b0-a398-673ce594c666 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Going to run 1 instances... {{(pid=134051) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:15:35.273092 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-0b4930a0-6c8b-47b0-a398-673ce594c666 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] [instance: 5f31adb7-e7c3-41b0-ab69-160db5609911] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134051) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:15:35.324002 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-0b4930a0-6c8b-47b0-a398-673ce594c666 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.629557 Aug 27 03:15:35.332508 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2780/5518] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 03:15:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 639 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:15:35.336514 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8aaac21b-0d35-42ae-8a25-dd083fcc5240 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:35.338441 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-8aaac21b-0d35-42ae-8a25-dd083fcc5240 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] [instance: 5f31adb7-e7c3-41b0-ab69-160db5609911] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:35.432454 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-8aaac21b-0d35-42ae-8a25-dd083fcc5240 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/5f31adb7-e7c3-41b0-ab69-160db5609911" status: 200 len: 1328 microversion: 2.1 time: 0.099855 Aug 27 03:15:35.433321 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2739/5519] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:15:35 2022] GET /compute/v2.1/servers/5f31adb7-e7c3-41b0-ab69-160db5609911 => generated 1328 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:15:36.457684 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-592e07d0-a580-4aad-8699-a6916f52976d tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:36.458756 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-592e07d0-a580-4aad-8699-a6916f52976d tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] [instance: 5f31adb7-e7c3-41b0-ab69-160db5609911] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:36.468920 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-592e07d0-a580-4aad-8699-a6916f52976d tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:36.469636 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-592e07d0-a580-4aad-8699-a6916f52976d tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:36.470288 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-592e07d0-a580-4aad-8699-a6916f52976d tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:36.471276 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-592e07d0-a580-4aad-8699-a6916f52976d tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:36.471798 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-592e07d0-a580-4aad-8699-a6916f52976d tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:36.472347 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-592e07d0-a580-4aad-8699-a6916f52976d tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:36.583013 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-592e07d0-a580-4aad-8699-a6916f52976d tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/5f31adb7-e7c3-41b0-ab69-160db5609911" status: 200 len: 1415 microversion: 2.1 time: 0.128969 Aug 27 03:15:36.583680 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2781/5520] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:15:36 2022] GET /compute/v2.1/servers/5f31adb7-e7c3-41b0-ab69-160db5609911 => generated 1415 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:15:37.605965 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5fc3694c-9041-4b83-82e2-ec88feaed0bb tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:37.606823 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-5fc3694c-9041-4b83-82e2-ec88feaed0bb tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] [instance: 5f31adb7-e7c3-41b0-ab69-160db5609911] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:37.617422 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5fc3694c-9041-4b83-82e2-ec88feaed0bb tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:37.618197 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5fc3694c-9041-4b83-82e2-ec88feaed0bb tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:37.618730 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5fc3694c-9041-4b83-82e2-ec88feaed0bb tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:37.619652 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5fc3694c-9041-4b83-82e2-ec88feaed0bb tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:37.620279 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5fc3694c-9041-4b83-82e2-ec88feaed0bb tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:37.620923 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5fc3694c-9041-4b83-82e2-ec88feaed0bb tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:37.794750 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-5fc3694c-9041-4b83-82e2-ec88feaed0bb tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/5f31adb7-e7c3-41b0-ab69-160db5609911" status: 200 len: 1463 microversion: 2.1 time: 0.192066 Aug 27 03:15:37.795784 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2740/5521] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:15:37 2022] GET /compute/v2.1/servers/5f31adb7-e7c3-41b0-ab69-160db5609911 => generated 1463 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:15:38.271109 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-f95c7651-4157-4579-bf98-d68ee1e6529e req-3c9b76be-ba71-4775-af28-31b09c7c8933 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f31adb7-e7c3-41b0-ab69-160db5609911", "tag": "77188b89-c819-495f-a44e-715d00f0949a"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:15:38.287396 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-f95c7651-4157-4579-bf98-d68ee1e6529e req-3c9b76be-ba71-4775-af28-31b09c7c8933 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:38.288229 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-f95c7651-4157-4579-bf98-d68ee1e6529e req-3c9b76be-ba71-4775-af28-31b09c7c8933 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:38.288687 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-f95c7651-4157-4579-bf98-d68ee1e6529e req-3c9b76be-ba71-4775-af28-31b09c7c8933 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:38.303011 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-f95c7651-4157-4579-bf98-d68ee1e6529e req-3c9b76be-ba71-4775-af28-31b09c7c8933 service nova] Creating event network-changed:77188b89-c819-495f-a44e-715d00f0949a for instance 5f31adb7-e7c3-41b0-ab69-160db5609911 on n-h1-852278-4 Aug 27 03:15:38.309362 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-f95c7651-4157-4579-bf98-d68ee1e6529e req-3c9b76be-ba71-4775-af28-31b09c7c8933 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044924 Aug 27 03:15:38.311012 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2782/5522] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:15:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:15:38.817136 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-548cf875-c660-40d9-8c33-ccde36800c00 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:38.817856 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-548cf875-c660-40d9-8c33-ccde36800c00 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] [instance: 5f31adb7-e7c3-41b0-ab69-160db5609911] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:38.827333 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-548cf875-c660-40d9-8c33-ccde36800c00 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:38.827829 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-548cf875-c660-40d9-8c33-ccde36800c00 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:38.828270 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-548cf875-c660-40d9-8c33-ccde36800c00 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:38.829003 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-548cf875-c660-40d9-8c33-ccde36800c00 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:38.829455 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-548cf875-c660-40d9-8c33-ccde36800c00 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:38.829877 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-548cf875-c660-40d9-8c33-ccde36800c00 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:39.060550 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-548cf875-c660-40d9-8c33-ccde36800c00 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/5f31adb7-e7c3-41b0-ab69-160db5609911" status: 200 len: 1463 microversion: 2.1 time: 0.246274 Aug 27 03:15:39.061731 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2741/5523] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:15:38 2022] GET /compute/v2.1/servers/5f31adb7-e7c3-41b0-ab69-160db5609911 => generated 1463 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:15:40.082556 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ea5ed76a-c7fe-4cf3-bafb-771850f60d3c tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:40.083264 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-ea5ed76a-c7fe-4cf3-bafb-771850f60d3c tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] [instance: 5f31adb7-e7c3-41b0-ab69-160db5609911] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:40.090780 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ea5ed76a-c7fe-4cf3-bafb-771850f60d3c tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:40.091282 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ea5ed76a-c7fe-4cf3-bafb-771850f60d3c tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:40.091704 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ea5ed76a-c7fe-4cf3-bafb-771850f60d3c tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:40.102006 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ea5ed76a-c7fe-4cf3-bafb-771850f60d3c tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:40.103137 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ea5ed76a-c7fe-4cf3-bafb-771850f60d3c tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:40.104108 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ea5ed76a-c7fe-4cf3-bafb-771850f60d3c tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:40.282067 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ea5ed76a-c7fe-4cf3-bafb-771850f60d3c tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/5f31adb7-e7c3-41b0-ab69-160db5609911" status: 200 len: 1463 microversion: 2.1 time: 0.203834 Aug 27 03:15:40.292643 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2783/5524] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:15:40 2022] GET /compute/v2.1/servers/5f31adb7-e7c3-41b0-ab69-160db5609911 => generated 1463 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:15:41.306016 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-20d6cf4b-0439-4708-aa03-9a1a787e9ee5 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:41.307329 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-20d6cf4b-0439-4708-aa03-9a1a787e9ee5 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] [instance: 5f31adb7-e7c3-41b0-ab69-160db5609911] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:41.314760 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-20d6cf4b-0439-4708-aa03-9a1a787e9ee5 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:41.315242 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-20d6cf4b-0439-4708-aa03-9a1a787e9ee5 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:41.315676 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-20d6cf4b-0439-4708-aa03-9a1a787e9ee5 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:41.316397 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-20d6cf4b-0439-4708-aa03-9a1a787e9ee5 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:41.316844 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-20d6cf4b-0439-4708-aa03-9a1a787e9ee5 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:41.317272 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-20d6cf4b-0439-4708-aa03-9a1a787e9ee5 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:41.472027 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-20d6cf4b-0439-4708-aa03-9a1a787e9ee5 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/5f31adb7-e7c3-41b0-ab69-160db5609911" status: 200 len: 1463 microversion: 2.1 time: 0.158859 Aug 27 03:15:41.473504 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2742/5525] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:15:41 2022] GET /compute/v2.1/servers/5f31adb7-e7c3-41b0-ab69-160db5609911 => generated 1463 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:15:42.494068 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3544f525-c009-4d7b-bc48-37009d44420e tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:42.494920 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-3544f525-c009-4d7b-bc48-37009d44420e tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] [instance: 5f31adb7-e7c3-41b0-ab69-160db5609911] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:42.502267 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3544f525-c009-4d7b-bc48-37009d44420e tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:42.502757 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3544f525-c009-4d7b-bc48-37009d44420e tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:42.503189 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3544f525-c009-4d7b-bc48-37009d44420e tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:42.503892 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3544f525-c009-4d7b-bc48-37009d44420e tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:42.504356 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3544f525-c009-4d7b-bc48-37009d44420e tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:42.504935 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3544f525-c009-4d7b-bc48-37009d44420e tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:42.729063 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-3544f525-c009-4d7b-bc48-37009d44420e tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/5f31adb7-e7c3-41b0-ab69-160db5609911" status: 200 len: 1463 microversion: 2.1 time: 0.234292 Aug 27 03:15:42.729063 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2784/5526] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:15:42 2022] GET /compute/v2.1/servers/5f31adb7-e7c3-41b0-ab69-160db5609911 => generated 1463 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:15:43.749400 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-767126f7-2664-49eb-ae2a-e01aabcb6655 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:43.750021 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-767126f7-2664-49eb-ae2a-e01aabcb6655 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] [instance: 5f31adb7-e7c3-41b0-ab69-160db5609911] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:43.757266 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-767126f7-2664-49eb-ae2a-e01aabcb6655 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:43.757963 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-767126f7-2664-49eb-ae2a-e01aabcb6655 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:43.758398 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-767126f7-2664-49eb-ae2a-e01aabcb6655 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:43.759107 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-767126f7-2664-49eb-ae2a-e01aabcb6655 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:43.759554 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-767126f7-2664-49eb-ae2a-e01aabcb6655 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:43.759983 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-767126f7-2664-49eb-ae2a-e01aabcb6655 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:43.904801 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-767126f7-2664-49eb-ae2a-e01aabcb6655 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/5f31adb7-e7c3-41b0-ab69-160db5609911" status: 200 len: 1463 microversion: 2.1 time: 0.158911 Aug 27 03:15:43.905872 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2743/5527] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:15:43 2022] GET /compute/v2.1/servers/5f31adb7-e7c3-41b0-ab69-160db5609911 => generated 1463 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:15:44.250161 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-f7f070dd-bbbf-43a0-ac73-3fbfa61c3026 req-e9800281-c73e-4578-b2e9-0199fc54d44e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f31adb7-e7c3-41b0-ab69-160db5609911", "name": "network-vif-plugged", "status": "completed", "tag": "77188b89-c819-495f-a44e-715d00f0949a"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:15:44.268594 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-f7f070dd-bbbf-43a0-ac73-3fbfa61c3026 req-e9800281-c73e-4578-b2e9-0199fc54d44e service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:44.269482 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-f7f070dd-bbbf-43a0-ac73-3fbfa61c3026 req-e9800281-c73e-4578-b2e9-0199fc54d44e service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:44.270214 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-f7f070dd-bbbf-43a0-ac73-3fbfa61c3026 req-e9800281-c73e-4578-b2e9-0199fc54d44e service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:44.286281 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-f7f070dd-bbbf-43a0-ac73-3fbfa61c3026 req-e9800281-c73e-4578-b2e9-0199fc54d44e service nova] Creating event network-vif-plugged:77188b89-c819-495f-a44e-715d00f0949a for instance 5f31adb7-e7c3-41b0-ab69-160db5609911 on n-h1-852278-4 Aug 27 03:15:44.293189 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-f7f070dd-bbbf-43a0-ac73-3fbfa61c3026 req-e9800281-c73e-4578-b2e9-0199fc54d44e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050064 Aug 27 03:15:44.294694 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2785/5528] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:15:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:15:44.929322 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-02992e26-06e0-4341-a6b5-09cb1b4e6eea tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:44.929803 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-02992e26-06e0-4341-a6b5-09cb1b4e6eea tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] [instance: 5f31adb7-e7c3-41b0-ab69-160db5609911] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:44.938614 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-02992e26-06e0-4341-a6b5-09cb1b4e6eea tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:44.939286 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-02992e26-06e0-4341-a6b5-09cb1b4e6eea tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:44.939727 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-02992e26-06e0-4341-a6b5-09cb1b4e6eea tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:44.940546 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-02992e26-06e0-4341-a6b5-09cb1b4e6eea tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:44.941010 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-02992e26-06e0-4341-a6b5-09cb1b4e6eea tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:44.941437 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-02992e26-06e0-4341-a6b5-09cb1b4e6eea tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:45.088429 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-02992e26-06e0-4341-a6b5-09cb1b4e6eea tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/5f31adb7-e7c3-41b0-ab69-160db5609911" status: 200 len: 1463 microversion: 2.1 time: 0.164307 Aug 27 03:15:45.089156 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2744/5529] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:15:44 2022] GET /compute/v2.1/servers/5f31adb7-e7c3-41b0-ab69-160db5609911 => generated 1463 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:15:46.107633 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:15:46.108989 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=6 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:15:46.114162 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-982f2ec2-1fb3-4230-8add-528b4f425b0f tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:46.115142 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-982f2ec2-1fb3-4230-8add-528b4f425b0f tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] [instance: 5f31adb7-e7c3-41b0-ab69-160db5609911] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:46.124121 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-982f2ec2-1fb3-4230-8add-528b4f425b0f tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:46.129520 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-982f2ec2-1fb3-4230-8add-528b4f425b0f tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:46.130590 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-982f2ec2-1fb3-4230-8add-528b4f425b0f tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:46.131530 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-982f2ec2-1fb3-4230-8add-528b4f425b0f tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:46.132176 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-982f2ec2-1fb3-4230-8add-528b4f425b0f tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:46.132612 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-982f2ec2-1fb3-4230-8add-528b4f425b0f tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:46.290150 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-982f2ec2-1fb3-4230-8add-528b4f425b0f tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/5f31adb7-e7c3-41b0-ab69-160db5609911" status: 200 len: 1648 microversion: 2.1 time: 0.182957 Aug 27 03:15:46.297436 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2786/5530] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:15:46 2022] GET /compute/v2.1/servers/5f31adb7-e7c3-41b0-ab69-160db5609911 => generated 1648 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:15:46.315216 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ab1d6e0b-e8b6-4484-9d20-85dd1d1d8c13 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:46.317467 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-ab1d6e0b-e8b6-4484-9d20-85dd1d1d8c13 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] [instance: 5f31adb7-e7c3-41b0-ab69-160db5609911] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:46.319540 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:15:46.327020 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ab1d6e0b-e8b6-4484-9d20-85dd1d1d8c13 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:46.327785 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ab1d6e0b-e8b6-4484-9d20-85dd1d1d8c13 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:46.328114 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ab1d6e0b-e8b6-4484-9d20-85dd1d1d8c13 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:46.328834 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ab1d6e0b-e8b6-4484-9d20-85dd1d1d8c13 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:46.329811 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ab1d6e0b-e8b6-4484-9d20-85dd1d1d8c13 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:46.330524 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ab1d6e0b-e8b6-4484-9d20-85dd1d1d8c13 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:46.467715 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ab1d6e0b-e8b6-4484-9d20-85dd1d1d8c13 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/5f31adb7-e7c3-41b0-ab69-160db5609911" status: 200 len: 1648 microversion: 2.1 time: 0.158698 Aug 27 03:15:46.468341 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2745/5531] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:15:46 2022] GET /compute/v2.1/servers/5f31adb7-e7c3-41b0-ab69-160db5609911 => generated 1648 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:15:46.488525 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-df50a37b-9342-4736-9904-362857a225ef tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:46.489152 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-df50a37b-9342-4736-9904-362857a225ef tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] [instance: 5f31adb7-e7c3-41b0-ab69-160db5609911] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:46.495485 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-df50a37b-9342-4736-9904-362857a225ef tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:46.495971 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-df50a37b-9342-4736-9904-362857a225ef tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:46.497733 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-df50a37b-9342-4736-9904-362857a225ef tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:46.498479 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-df50a37b-9342-4736-9904-362857a225ef tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:46.498939 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-df50a37b-9342-4736-9904-362857a225ef tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:46.499364 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-df50a37b-9342-4736-9904-362857a225ef tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:46.675760 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-df50a37b-9342-4736-9904-362857a225ef tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/5f31adb7-e7c3-41b0-ab69-160db5609911" status: 200 len: 1648 microversion: 2.1 time: 0.191641 Aug 27 03:15:46.676623 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2787/5532] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:15:46 2022] GET /compute/v2.1/servers/5f31adb7-e7c3-41b0-ab69-160db5609911 => generated 1648 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:15:46.708566 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8ba4dae9-c5ff-4c52-ad79-4e62900d774e tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:46.708566 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-8ba4dae9-c5ff-4c52-ad79-4e62900d774e tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] [instance: 5f31adb7-e7c3-41b0-ab69-160db5609911] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:46.720287 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8ba4dae9-c5ff-4c52-ad79-4e62900d774e tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:46.721323 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8ba4dae9-c5ff-4c52-ad79-4e62900d774e tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:46.721778 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8ba4dae9-c5ff-4c52-ad79-4e62900d774e tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:46.725078 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8ba4dae9-c5ff-4c52-ad79-4e62900d774e tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:46.727834 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8ba4dae9-c5ff-4c52-ad79-4e62900d774e tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:46.728421 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8ba4dae9-c5ff-4c52-ad79-4e62900d774e tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:46.787106 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-8ba4dae9-c5ff-4c52-ad79-4e62900d774e tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] [instance: 5f31adb7-e7c3-41b0-ab69-160db5609911] Going to try to terminate instance {{(pid=134052) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:15:46.967039 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-8ba4dae9-c5ff-4c52-ad79-4e62900d774e tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] 10.222.0.70 "DELETE /compute/v2.1/servers/5f31adb7-e7c3-41b0-ab69-160db5609911" status: 204 len: 0 microversion: 2.1 time: 0.272010 Aug 27 03:15:46.967713 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2746/5533] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 03:15:46 2022] DELETE /compute/v2.1/servers/5f31adb7-e7c3-41b0-ab69-160db5609911 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:15:46.979432 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-46ca9d77-18d7-44db-9616-0cd539f86baf tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:46.980182 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-46ca9d77-18d7-44db-9616-0cd539f86baf tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] [instance: 5f31adb7-e7c3-41b0-ab69-160db5609911] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:46.993048 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-46ca9d77-18d7-44db-9616-0cd539f86baf tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:46.993805 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-46ca9d77-18d7-44db-9616-0cd539f86baf tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:46.994316 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-46ca9d77-18d7-44db-9616-0cd539f86baf tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:46.995249 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-46ca9d77-18d7-44db-9616-0cd539f86baf tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:46.995910 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-46ca9d77-18d7-44db-9616-0cd539f86baf tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:46.996433 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-46ca9d77-18d7-44db-9616-0cd539f86baf tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:47.225817 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-46ca9d77-18d7-44db-9616-0cd539f86baf tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/5f31adb7-e7c3-41b0-ab69-160db5609911" status: 200 len: 1654 microversion: 2.1 time: 0.250555 Aug 27 03:15:47.227497 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2788/5534] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:15:46 2022] GET /compute/v2.1/servers/5f31adb7-e7c3-41b0-ab69-160db5609911 => generated 1654 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:15:48.248008 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6d4a689c-11bb-42b3-98f6-08a8b1efb992 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:48.248836 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-6d4a689c-11bb-42b3-98f6-08a8b1efb992 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] [instance: 5f31adb7-e7c3-41b0-ab69-160db5609911] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:48.256659 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6d4a689c-11bb-42b3-98f6-08a8b1efb992 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:48.257352 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6d4a689c-11bb-42b3-98f6-08a8b1efb992 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:48.257852 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6d4a689c-11bb-42b3-98f6-08a8b1efb992 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:48.258631 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6d4a689c-11bb-42b3-98f6-08a8b1efb992 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:48.259081 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6d4a689c-11bb-42b3-98f6-08a8b1efb992 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:48.259492 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6d4a689c-11bb-42b3-98f6-08a8b1efb992 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:48.396946 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-6d4a689c-11bb-42b3-98f6-08a8b1efb992 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/5f31adb7-e7c3-41b0-ab69-160db5609911" status: 200 len: 1654 microversion: 2.1 time: 0.153297 Aug 27 03:15:48.397874 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2747/5535] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:15:48 2022] GET /compute/v2.1/servers/5f31adb7-e7c3-41b0-ab69-160db5609911 => generated 1654 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:15:48.837899 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-3388fac9-87b4-4952-8fde-d61118c85cb2 req-3a1bf14d-0e27-4c30-bc0c-98d0b2bd94ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f31adb7-e7c3-41b0-ab69-160db5609911", "name": "network-vif-deleted", "tag": "77188b89-c819-495f-a44e-715d00f0949a"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:15:48.852612 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-3388fac9-87b4-4952-8fde-d61118c85cb2 req-3a1bf14d-0e27-4c30-bc0c-98d0b2bd94ef service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:48.853097 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-3388fac9-87b4-4952-8fde-d61118c85cb2 req-3a1bf14d-0e27-4c30-bc0c-98d0b2bd94ef service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:48.853529 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-3388fac9-87b4-4952-8fde-d61118c85cb2 req-3a1bf14d-0e27-4c30-bc0c-98d0b2bd94ef service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:48.866816 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-3388fac9-87b4-4952-8fde-d61118c85cb2 req-3a1bf14d-0e27-4c30-bc0c-98d0b2bd94ef service nova] Creating event network-vif-deleted:77188b89-c819-495f-a44e-715d00f0949a for instance 5f31adb7-e7c3-41b0-ab69-160db5609911 on n-h1-852278-4 Aug 27 03:15:48.872711 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-3388fac9-87b4-4952-8fde-d61118c85cb2 req-3a1bf14d-0e27-4c30-bc0c-98d0b2bd94ef service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045093 Aug 27 03:15:48.874177 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2789/5536] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:15:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:15:49.419090 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a59a3307-b3a1-4a28-a45f-796170b2751d tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:49.419699 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a59a3307-b3a1-4a28-a45f-796170b2751d tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] [instance: 5f31adb7-e7c3-41b0-ab69-160db5609911] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:49.427079 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a59a3307-b3a1-4a28-a45f-796170b2751d tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:49.427611 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a59a3307-b3a1-4a28-a45f-796170b2751d tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:49.428129 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a59a3307-b3a1-4a28-a45f-796170b2751d tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:49.428892 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a59a3307-b3a1-4a28-a45f-796170b2751d tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:49.429337 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a59a3307-b3a1-4a28-a45f-796170b2751d tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:49.429772 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a59a3307-b3a1-4a28-a45f-796170b2751d tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:49.466398 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a59a3307-b3a1-4a28-a45f-796170b2751d tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:49.467220 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a59a3307-b3a1-4a28-a45f-796170b2751d tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:49.467975 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a59a3307-b3a1-4a28-a45f-796170b2751d tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:49.468846 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.instance [None req-a59a3307-b3a1-4a28-a45f-796170b2751d tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lazy-loading 'fault' on Instance uuid 5f31adb7-e7c3-41b0-ab69-160db5609911 {{(pid=134052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:15:49.527130 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a59a3307-b3a1-4a28-a45f-796170b2751d tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/5f31adb7-e7c3-41b0-ab69-160db5609911" status: 200 len: 1453 microversion: 2.1 time: 0.112894 Aug 27 03:15:49.528454 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2748/5537] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:15:49 2022] GET /compute/v2.1/servers/5f31adb7-e7c3-41b0-ab69-160db5609911 => generated 1453 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:15:50.552630 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-75a44c8d-cb67-459c-be4c-6b6102583e3b tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:50.553769 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-75a44c8d-cb67-459c-be4c-6b6102583e3b tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] [instance: 5f31adb7-e7c3-41b0-ab69-160db5609911] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:50.563629 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-75a44c8d-cb67-459c-be4c-6b6102583e3b tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:50.563629 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-75a44c8d-cb67-459c-be4c-6b6102583e3b tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:50.563629 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-75a44c8d-cb67-459c-be4c-6b6102583e3b tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:50.563629 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-75a44c8d-cb67-459c-be4c-6b6102583e3b tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:50.563913 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-75a44c8d-cb67-459c-be4c-6b6102583e3b tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:50.564242 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-75a44c8d-cb67-459c-be4c-6b6102583e3b tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:50.581026 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-75a44c8d-cb67-459c-be4c-6b6102583e3b tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] HTTP exception thrown: Instance 5f31adb7-e7c3-41b0-ab69-160db5609911 could not be found. Aug 27 03:15:50.582703 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-75a44c8d-cb67-459c-be4c-6b6102583e3b tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Request method failure captured: Aug 27 03:15:50.582703 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/5f31adb7-e7c3-41b0-ab69-160db5609911 HTTP/1.1 Aug 27 03:15:50.582703 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 03:15:50.582703 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 03:15:50.582703 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 03:15:50.582703 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 03:15:50.582703 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 03:15:50.582703 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 03:15:50.582703 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 03:15:50.582703 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 03:15:50.582703 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYxJoxM8Vvk2AOdbcuO3yxWBjLGGs8uQCVd4N2ccHym45MnjnKG9hV5mmI9YK6FpevjUmZ4ngR8XAKagzfHsqk5ZwsrTQXy2nCgGhj5RbMnaOe1ZiClQm9grbDdA24QCwvQtDJB0SK_Uk8KCbxHJvjxilj2R18s31M1lcUvWnp-4-zs Aug 27 03:15:50.582703 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 03:15:50.582703 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 03:15:50.582703 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 03:15:50.582703 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 03:15:50.582703 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 03:15:50.582703 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 03:15:50.582703 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 02f7b37c5e1f49ea8777d94036fc518f Aug 27 03:15:50.582703 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-TestServerMultinode-342287408 Aug 27 03:15:50.582703 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,admin,member Aug 27 03:15:50.582703 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,admin,member Aug 27 03:15:50.582703 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/02f7b37c5e1f49ea8777d94036fc518f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_02f7b37c5e1f49ea8777d94036fc518f", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/02f7b37c5e1f49ea8777d94036fc518f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/02f7b37c5e1f49ea8777d94036fc518f"}]}] Aug 27 03:15:50.582703 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-TestServerMultinode-342287408 Aug 27 03:15:50.582703 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 02f7b37c5e1f49ea8777d94036fc518f Aug 27 03:15:50.582703 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-TestServerMultinode-342287408 Aug 27 03:15:50.582703 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-TestServerMultinode-342287408-project-admin Aug 27 03:15:50.582703 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 03:15:50.582703 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 03:15:50.582703 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: e78d14e7c20f478aa8d4ea7fc4aaf052 Aug 27 03:15:50.582703 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-TestServerMultinode-342287408-project-admin Aug 27 03:15:50.582703 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 03:15:50.582703 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance 5f31adb7-e7c3-41b0-ab69-160db5609911 could not be found. Aug 27 03:15:50.582703 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '5f31adb7-e7c3-41b0-ab69-160db5609911'} Aug 27 03:15:50.582703 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:15:50.582703 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:15:50.582703 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:15:50.582703 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:15:50.582703 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:15:50.582703 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:15:50.582703 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:15:50.582703 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:15:50.582703 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:15:50.582703 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:15:50.582703 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f31adb7-e7c3-41b0-ab69-160db5609911 could not be found. Aug 27 03:15:50.582703 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:15:50.582703 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:15:50.582703 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:15:50.582703 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:15:50.582703 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:15:50.582703 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:15:50.582703 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:15:50.582703 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:15:50.582703 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:15:50.582703 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:15:50.582703 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:15:50.582703 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:15:50.582703 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:15:50.582703 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:15:50.582703 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:15:50.582703 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:15:50.582703 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f31adb7-e7c3-41b0-ab69-160db5609911 could not be found. Aug 27 03:15:50.582703 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:15:50.582703 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:15:50.582703 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:15:50.587478 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:15:50.587478 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:15:50.587478 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:15:50.587478 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:15:50.587478 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:15:50.587478 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f31adb7-e7c3-41b0-ab69-160db5609911 could not be found. Aug 27 03:15:50.587478 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:15:50.587478 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-75a44c8d-cb67-459c-be4c-6b6102583e3b tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Returning 404 to user: Instance 5f31adb7-e7c3-41b0-ab69-160db5609911 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:15:50.587478 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-75a44c8d-cb67-459c-be4c-6b6102583e3b tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/5f31adb7-e7c3-41b0-ab69-160db5609911" status: 404 len: 111 microversion: 2.1 time: 0.037505 Aug 27 03:15:50.588885 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2790/5538] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:15:50 2022] GET /compute/v2.1/servers/5f31adb7-e7c3-41b0-ab69-160db5609911 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:15:50.593074 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b8adb5dd-bbe1-483a-a5bd-81e41fa0fd9a tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:50.593655 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b8adb5dd-bbe1-483a-a5bd-81e41fa0fd9a tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] [instance: a9ad77c8-c9b3-4e94-a886-d87a18a4ee2f] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:50.603530 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:15:50.606509 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b8adb5dd-bbe1-483a-a5bd-81e41fa0fd9a tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:50.607153 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b8adb5dd-bbe1-483a-a5bd-81e41fa0fd9a tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:50.607908 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b8adb5dd-bbe1-483a-a5bd-81e41fa0fd9a tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:50.608950 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b8adb5dd-bbe1-483a-a5bd-81e41fa0fd9a tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:50.609406 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b8adb5dd-bbe1-483a-a5bd-81e41fa0fd9a tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:50.609997 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b8adb5dd-bbe1-483a-a5bd-81e41fa0fd9a tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:50.636989 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:15:50.647849 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b8adb5dd-bbe1-483a-a5bd-81e41fa0fd9a tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] [instance: a9ad77c8-c9b3-4e94-a886-d87a18a4ee2f] Going to try to terminate instance {{(pid=134052) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:15:50.738773 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b8adb5dd-bbe1-483a-a5bd-81e41fa0fd9a tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] 10.222.0.70 "DELETE /compute/v2.1/servers/a9ad77c8-c9b3-4e94-a886-d87a18a4ee2f" status: 204 len: 0 microversion: 2.1 time: 0.148899 Aug 27 03:15:50.739650 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2749/5539] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 03:15:50 2022] DELETE /compute/v2.1/servers/a9ad77c8-c9b3-4e94-a886-d87a18a4ee2f => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:15:50.750070 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8c2f2a4d-fe47-4886-8ee5-df8d8cd11cb5 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:50.751146 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-8c2f2a4d-fe47-4886-8ee5-df8d8cd11cb5 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] [instance: a9ad77c8-c9b3-4e94-a886-d87a18a4ee2f] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:50.757631 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8c2f2a4d-fe47-4886-8ee5-df8d8cd11cb5 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:50.758202 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8c2f2a4d-fe47-4886-8ee5-df8d8cd11cb5 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:50.758710 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8c2f2a4d-fe47-4886-8ee5-df8d8cd11cb5 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:50.759587 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8c2f2a4d-fe47-4886-8ee5-df8d8cd11cb5 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:50.760126 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8c2f2a4d-fe47-4886-8ee5-df8d8cd11cb5 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:50.760657 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8c2f2a4d-fe47-4886-8ee5-df8d8cd11cb5 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:50.909860 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=89 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:15:50.916809 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-8c2f2a4d-fe47-4886-8ee5-df8d8cd11cb5 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/a9ad77c8-c9b3-4e94-a886-d87a18a4ee2f" status: 200 len: 1654 microversion: 2.1 time: 0.172146 Aug 27 03:15:50.917972 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2791/5540] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:15:50 2022] GET /compute/v2.1/servers/a9ad77c8-c9b3-4e94-a886-d87a18a4ee2f => generated 1654 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:15:51.939122 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d63e2f18-5ee2-46ac-a2fe-ddabfc76fed9 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:51.939822 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d63e2f18-5ee2-46ac-a2fe-ddabfc76fed9 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] [instance: a9ad77c8-c9b3-4e94-a886-d87a18a4ee2f] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:51.946565 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d63e2f18-5ee2-46ac-a2fe-ddabfc76fed9 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:51.947053 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d63e2f18-5ee2-46ac-a2fe-ddabfc76fed9 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:51.947487 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d63e2f18-5ee2-46ac-a2fe-ddabfc76fed9 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:51.948389 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d63e2f18-5ee2-46ac-a2fe-ddabfc76fed9 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:51.948877 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d63e2f18-5ee2-46ac-a2fe-ddabfc76fed9 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:51.949271 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d63e2f18-5ee2-46ac-a2fe-ddabfc76fed9 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:52.103265 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d63e2f18-5ee2-46ac-a2fe-ddabfc76fed9 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/a9ad77c8-c9b3-4e94-a886-d87a18a4ee2f" status: 200 len: 1654 microversion: 2.1 time: 0.168530 Aug 27 03:15:52.103959 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2750/5541] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:15:51 2022] GET /compute/v2.1/servers/a9ad77c8-c9b3-4e94-a886-d87a18a4ee2f => generated 1654 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:15:52.640893 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-0eba31b1-34a6-47d5-9d92-420158a28e17 req-6583a9b5-9a47-4f08-a8d6-01853a3bd8cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9ad77c8-c9b3-4e94-a886-d87a18a4ee2f", "name": "network-vif-deleted", "tag": "af5103db-a01b-4bcd-a069-19d5d586eace"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:15:52.683080 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=6 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:15:52.690752 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-0eba31b1-34a6-47d5-9d92-420158a28e17 req-6583a9b5-9a47-4f08-a8d6-01853a3bd8cc service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:52.691625 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-0eba31b1-34a6-47d5-9d92-420158a28e17 req-6583a9b5-9a47-4f08-a8d6-01853a3bd8cc service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:52.692129 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-0eba31b1-34a6-47d5-9d92-420158a28e17 req-6583a9b5-9a47-4f08-a8d6-01853a3bd8cc service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:52.718123 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-0eba31b1-34a6-47d5-9d92-420158a28e17 req-6583a9b5-9a47-4f08-a8d6-01853a3bd8cc service nova] Creating event network-vif-deleted:af5103db-a01b-4bcd-a069-19d5d586eace for instance a9ad77c8-c9b3-4e94-a886-d87a18a4ee2f on n-h2-852278-4 Aug 27 03:15:52.723345 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-0eba31b1-34a6-47d5-9d92-420158a28e17 req-6583a9b5-9a47-4f08-a8d6-01853a3bd8cc service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095629 Aug 27 03:15:52.724394 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2792/5542] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:15:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:15:53.128991 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0dbf96c2-d2be-4c73-8638-25a6354de3d2 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:53.129600 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-0dbf96c2-d2be-4c73-8638-25a6354de3d2 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] [instance: a9ad77c8-c9b3-4e94-a886-d87a18a4ee2f] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:53.139415 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0dbf96c2-d2be-4c73-8638-25a6354de3d2 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:53.140610 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0dbf96c2-d2be-4c73-8638-25a6354de3d2 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:53.141277 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0dbf96c2-d2be-4c73-8638-25a6354de3d2 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:53.142382 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0dbf96c2-d2be-4c73-8638-25a6354de3d2 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:53.143118 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0dbf96c2-d2be-4c73-8638-25a6354de3d2 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:53.143744 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0dbf96c2-d2be-4c73-8638-25a6354de3d2 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:53.179216 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0dbf96c2-d2be-4c73-8638-25a6354de3d2 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:53.179975 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0dbf96c2-d2be-4c73-8638-25a6354de3d2 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:53.180677 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0dbf96c2-d2be-4c73-8638-25a6354de3d2 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:53.181421 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.instance [None req-0dbf96c2-d2be-4c73-8638-25a6354de3d2 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lazy-loading 'fault' on Instance uuid a9ad77c8-c9b3-4e94-a886-d87a18a4ee2f {{(pid=134052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:15:53.243488 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-0dbf96c2-d2be-4c73-8638-25a6354de3d2 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/a9ad77c8-c9b3-4e94-a886-d87a18a4ee2f" status: 200 len: 1453 microversion: 2.1 time: 0.119897 Aug 27 03:15:53.245934 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2751/5543] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:15:53 2022] GET /compute/v2.1/servers/a9ad77c8-c9b3-4e94-a886-d87a18a4ee2f => generated 1453 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:15:54.268208 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-5659caab-1e08-4d2d-9202-b09db0dd9536 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:54.269485 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-5659caab-1e08-4d2d-9202-b09db0dd9536 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] [instance: a9ad77c8-c9b3-4e94-a886-d87a18a4ee2f] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:54.277362 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5659caab-1e08-4d2d-9202-b09db0dd9536 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:54.277997 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5659caab-1e08-4d2d-9202-b09db0dd9536 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:54.278589 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5659caab-1e08-4d2d-9202-b09db0dd9536 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:54.279451 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5659caab-1e08-4d2d-9202-b09db0dd9536 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:54.280056 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5659caab-1e08-4d2d-9202-b09db0dd9536 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:54.280788 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5659caab-1e08-4d2d-9202-b09db0dd9536 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:54.295170 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-5659caab-1e08-4d2d-9202-b09db0dd9536 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] HTTP exception thrown: Instance a9ad77c8-c9b3-4e94-a886-d87a18a4ee2f could not be found. Aug 27 03:15:54.297059 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-5659caab-1e08-4d2d-9202-b09db0dd9536 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Request method failure captured: Aug 27 03:15:54.297059 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/a9ad77c8-c9b3-4e94-a886-d87a18a4ee2f HTTP/1.1 Aug 27 03:15:54.297059 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 03:15:54.297059 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 03:15:54.297059 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 03:15:54.297059 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 03:15:54.297059 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 03:15:54.297059 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 03:15:54.297059 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 03:15:54.297059 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 03:15:54.297059 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYxJoxM8Vvk2AOdbcuO3yxWBjLGGs8uQCVd4N2ccHym45MnjnKG9hV5mmI9YK6FpevjUmZ4ngR8XAKagzfHsqk5ZwsrTQXy2nCgGhj5RbMnaOe1ZiClQm9grbDdA24QCwvQtDJB0SK_Uk8KCbxHJvjxilj2R18s31M1lcUvWnp-4-zs Aug 27 03:15:54.297059 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 03:15:54.297059 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 03:15:54.297059 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 03:15:54.297059 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 03:15:54.297059 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 03:15:54.297059 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 03:15:54.297059 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 02f7b37c5e1f49ea8777d94036fc518f Aug 27 03:15:54.297059 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-TestServerMultinode-342287408 Aug 27 03:15:54.297059 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,admin,member Aug 27 03:15:54.297059 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,admin,member Aug 27 03:15:54.297059 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/02f7b37c5e1f49ea8777d94036fc518f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_02f7b37c5e1f49ea8777d94036fc518f", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/02f7b37c5e1f49ea8777d94036fc518f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/02f7b37c5e1f49ea8777d94036fc518f"}]}] Aug 27 03:15:54.297059 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-TestServerMultinode-342287408 Aug 27 03:15:54.297059 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 02f7b37c5e1f49ea8777d94036fc518f Aug 27 03:15:54.297059 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-TestServerMultinode-342287408 Aug 27 03:15:54.297059 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-TestServerMultinode-342287408-project-admin Aug 27 03:15:54.297059 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 03:15:54.297059 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 03:15:54.297059 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: e78d14e7c20f478aa8d4ea7fc4aaf052 Aug 27 03:15:54.297059 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-TestServerMultinode-342287408-project-admin Aug 27 03:15:54.297059 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 03:15:54.297059 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance a9ad77c8-c9b3-4e94-a886-d87a18a4ee2f could not be found. Aug 27 03:15:54.297059 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': 'a9ad77c8-c9b3-4e94-a886-d87a18a4ee2f'} Aug 27 03:15:54.297059 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:15:54.297059 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:15:54.297059 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:15:54.297059 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:15:54.297059 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:15:54.297059 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:15:54.297059 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:15:54.297059 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:15:54.297059 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:15:54.297059 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:15:54.297059 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9ad77c8-c9b3-4e94-a886-d87a18a4ee2f could not be found. Aug 27 03:15:54.297059 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:15:54.297059 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:15:54.297059 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:15:54.297059 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:15:54.297059 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:15:54.297059 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:15:54.297059 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:15:54.297059 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:15:54.297059 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:15:54.297059 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:15:54.297059 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:15:54.297059 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:15:54.297059 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:15:54.297059 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:15:54.297059 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:15:54.297059 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:15:54.297059 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9ad77c8-c9b3-4e94-a886-d87a18a4ee2f could not be found. Aug 27 03:15:54.297059 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:15:54.297059 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:15:54.297059 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:15:54.300501 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:15:54.300501 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:15:54.300501 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:15:54.300501 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:15:54.300501 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:15:54.300501 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9ad77c8-c9b3-4e94-a886-d87a18a4ee2f could not be found. Aug 27 03:15:54.300501 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:15:54.302258 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-5659caab-1e08-4d2d-9202-b09db0dd9536 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] Returning 404 to user: Instance a9ad77c8-c9b3-4e94-a886-d87a18a4ee2f could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:15:54.303303 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-5659caab-1e08-4d2d-9202-b09db0dd9536 tempest-TestServerMultinode-342287408 tempest-TestServerMultinode-342287408-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/a9ad77c8-c9b3-4e94-a886-d87a18a4ee2f" status: 404 len: 111 microversion: 2.1 time: 0.039577 Aug 27 03:15:54.308091 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2793/5544] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:15:54 2022] GET /compute/v2.1/servers/a9ad77c8-c9b3-4e94-a886-d87a18a4ee2f => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:16:04.713633 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=12,nova_api:UPDATE=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:16:04.714972 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:16:04.926955 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e0da55c0-d569-4bf8-a9b5-7523e0a94584 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-294192653", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "networks": [{"uuid": "ac9fba11-9f80-4365-a32a-0507b9a6560d"}]}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:16:04.997500 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.network.neutron [None req-e0da55c0-d569-4bf8-a9b5-7523e0a94584 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] validate_networks() for [('ac9fba11-9f80-4365-a32a-0507b9a6560d', None, None, None, None, None)] {{(pid=134052) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:16:05.398769 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-e0da55c0-d569-4bf8-a9b5-7523e0a94584 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Flavor limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:16:05.399496 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-e0da55c0-d569-4bf8-a9b5-7523e0a94584 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Image limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:16:05.400143 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-e0da55c0-d569-4bf8-a9b5-7523e0a94584 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Flavor pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:16:05.400751 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-e0da55c0-d569-4bf8-a9b5-7523e0a94584 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Image pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:16:05.401147 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-e0da55c0-d569-4bf8-a9b5-7523e0a94584 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:16:05.410669 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e0da55c0-d569-4bf8-a9b5-7523e0a94584 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:05.411316 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e0da55c0-d569-4bf8-a9b5-7523e0a94584 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:05.411828 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e0da55c0-d569-4bf8-a9b5-7523e0a94584 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:05.412679 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e0da55c0-d569-4bf8-a9b5-7523e0a94584 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:05.413190 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e0da55c0-d569-4bf8-a9b5-7523e0a94584 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:05.413826 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e0da55c0-d569-4bf8-a9b5-7523e0a94584 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:05.436022 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-e0da55c0-d569-4bf8-a9b5-7523e0a94584 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Getting quotas for project aa8743b5e17a4a5e9d378ba9bd0d0bd4. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:16:05.441708 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-e0da55c0-d569-4bf8-a9b5-7523e0a94584 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Getting quotas for user 9c678da620f546d2a0f91a81bcbfc0ec and project aa8743b5e17a4a5e9d378ba9bd0d0bd4. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:16:05.454494 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-e0da55c0-d569-4bf8-a9b5-7523e0a94584 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Going to run 1 instances... {{(pid=134052) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:16:05.457028 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-e0da55c0-d569-4bf8-a9b5-7523e0a94584 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] [instance: ddfa06a9-0e17-4fb8-92ca-715b8aa80b00] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134052) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:16:05.512883 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e0da55c0-d569-4bf8-a9b5-7523e0a94584 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.805511 Aug 27 03:16:05.517181 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2752/5545] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 03:16:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 811 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:16:05.525932 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ad119241-3c24-4a5c-8d93-09123686081b tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:05.526867 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-ad119241-3c24-4a5c-8d93-09123686081b tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] [instance: ddfa06a9-0e17-4fb8-92ca-715b8aa80b00] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:05.533582 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=3 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:16:05.536709 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=5 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:16:05.635917 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-ad119241-3c24-4a5c-8d93-09123686081b tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c678da620f546d2a0f91a81bcbfc0ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8743b5e17a4a5e9d378ba9bd0d0bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:05.644538 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ad119241-3c24-4a5c-8d93-09123686081b tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] 10.222.0.70 "GET /compute/v2.1/servers/ddfa06a9-0e17-4fb8-92ca-715b8aa80b00" status: 200 len: 1214 microversion: 2.1 time: 0.123914 Aug 27 03:16:05.645456 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2794/5546] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:05 2022] GET /compute/v2.1/servers/ddfa06a9-0e17-4fb8-92ca-715b8aa80b00 => generated 1214 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:06.665328 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9ca29e9e-42f8-4b65-b260-a08fa83f13d5 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:06.667762 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-9ca29e9e-42f8-4b65-b260-a08fa83f13d5 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] [instance: ddfa06a9-0e17-4fb8-92ca-715b8aa80b00] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:06.679236 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9ca29e9e-42f8-4b65-b260-a08fa83f13d5 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:06.680468 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9ca29e9e-42f8-4b65-b260-a08fa83f13d5 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:06.681204 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9ca29e9e-42f8-4b65-b260-a08fa83f13d5 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:06.683228 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9ca29e9e-42f8-4b65-b260-a08fa83f13d5 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:06.684712 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9ca29e9e-42f8-4b65-b260-a08fa83f13d5 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:06.685326 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9ca29e9e-42f8-4b65-b260-a08fa83f13d5 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:06.831735 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-9ca29e9e-42f8-4b65-b260-a08fa83f13d5 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c678da620f546d2a0f91a81bcbfc0ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8743b5e17a4a5e9d378ba9bd0d0bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:06.848634 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9ca29e9e-42f8-4b65-b260-a08fa83f13d5 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] 10.222.0.70 "GET /compute/v2.1/servers/ddfa06a9-0e17-4fb8-92ca-715b8aa80b00" status: 200 len: 1266 microversion: 2.1 time: 0.188099 Aug 27 03:16:06.854956 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2753/5547] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:06 2022] GET /compute/v2.1/servers/ddfa06a9-0e17-4fb8-92ca-715b8aa80b00 => generated 1266 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:07.880862 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f91e56cf-174c-4fd3-8d32-cd3a02e1cdab tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:07.881414 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-f91e56cf-174c-4fd3-8d32-cd3a02e1cdab tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] [instance: ddfa06a9-0e17-4fb8-92ca-715b8aa80b00] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:07.893517 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f91e56cf-174c-4fd3-8d32-cd3a02e1cdab tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:07.894117 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f91e56cf-174c-4fd3-8d32-cd3a02e1cdab tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:07.895352 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f91e56cf-174c-4fd3-8d32-cd3a02e1cdab tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:07.896348 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f91e56cf-174c-4fd3-8d32-cd3a02e1cdab tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:07.898529 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f91e56cf-174c-4fd3-8d32-cd3a02e1cdab tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:07.899294 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f91e56cf-174c-4fd3-8d32-cd3a02e1cdab tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:08.083026 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-f91e56cf-174c-4fd3-8d32-cd3a02e1cdab tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c678da620f546d2a0f91a81bcbfc0ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8743b5e17a4a5e9d378ba9bd0d0bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:08.095363 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-f91e56cf-174c-4fd3-8d32-cd3a02e1cdab tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] 10.222.0.70 "GET /compute/v2.1/servers/ddfa06a9-0e17-4fb8-92ca-715b8aa80b00" status: 200 len: 1272 microversion: 2.1 time: 0.220431 Aug 27 03:16:08.097797 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2795/5548] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:07 2022] GET /compute/v2.1/servers/ddfa06a9-0e17-4fb8-92ca-715b8aa80b00 => generated 1272 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:09.118733 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c35fe48e-5606-486d-99d7-9ac9e5826575 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:09.124341 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-c35fe48e-5606-486d-99d7-9ac9e5826575 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] [instance: ddfa06a9-0e17-4fb8-92ca-715b8aa80b00] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:09.136250 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c35fe48e-5606-486d-99d7-9ac9e5826575 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:09.136798 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c35fe48e-5606-486d-99d7-9ac9e5826575 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:09.137245 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c35fe48e-5606-486d-99d7-9ac9e5826575 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:09.139572 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c35fe48e-5606-486d-99d7-9ac9e5826575 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:09.140150 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c35fe48e-5606-486d-99d7-9ac9e5826575 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:09.140599 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c35fe48e-5606-486d-99d7-9ac9e5826575 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:09.367617 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-c35fe48e-5606-486d-99d7-9ac9e5826575 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c678da620f546d2a0f91a81bcbfc0ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8743b5e17a4a5e9d378ba9bd0d0bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:09.376583 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c35fe48e-5606-486d-99d7-9ac9e5826575 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] 10.222.0.70 "GET /compute/v2.1/servers/ddfa06a9-0e17-4fb8-92ca-715b8aa80b00" status: 200 len: 1314 microversion: 2.1 time: 0.262046 Aug 27 03:16:09.394365 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2754/5549] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:09 2022] GET /compute/v2.1/servers/ddfa06a9-0e17-4fb8-92ca-715b8aa80b00 => generated 1314 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:10.312387 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-0e24a31c-f9ba-404c-97ac-3dd27b5dc684 req-18a4e53d-6831-44ba-b5ca-d9c2f24289c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ddfa06a9-0e17-4fb8-92ca-715b8aa80b00", "tag": "5ff33f5b-b6c7-4baf-bb26-642d5707201e"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:16:10.330458 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-0e24a31c-f9ba-404c-97ac-3dd27b5dc684 req-18a4e53d-6831-44ba-b5ca-d9c2f24289c4 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:10.332703 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-0e24a31c-f9ba-404c-97ac-3dd27b5dc684 req-18a4e53d-6831-44ba-b5ca-d9c2f24289c4 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:10.333388 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-0e24a31c-f9ba-404c-97ac-3dd27b5dc684 req-18a4e53d-6831-44ba-b5ca-d9c2f24289c4 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:10.349929 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-0e24a31c-f9ba-404c-97ac-3dd27b5dc684 req-18a4e53d-6831-44ba-b5ca-d9c2f24289c4 service nova] Creating event network-changed:5ff33f5b-b6c7-4baf-bb26-642d5707201e for instance ddfa06a9-0e17-4fb8-92ca-715b8aa80b00 on n-h1-852278-4 Aug 27 03:16:10.356346 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-0e24a31c-f9ba-404c-97ac-3dd27b5dc684 req-18a4e53d-6831-44ba-b5ca-d9c2f24289c4 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047992 Aug 27 03:16:10.357073 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2796/5550] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:16:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:16:10.418699 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8f9c53d8-4220-4ec3-ab29-e8380482e230 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:10.420949 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-8f9c53d8-4220-4ec3-ab29-e8380482e230 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] [instance: ddfa06a9-0e17-4fb8-92ca-715b8aa80b00] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:10.428343 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8f9c53d8-4220-4ec3-ab29-e8380482e230 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:10.428842 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8f9c53d8-4220-4ec3-ab29-e8380482e230 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:10.429275 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8f9c53d8-4220-4ec3-ab29-e8380482e230 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:10.430010 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8f9c53d8-4220-4ec3-ab29-e8380482e230 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:10.430462 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8f9c53d8-4220-4ec3-ab29-e8380482e230 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:10.430887 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8f9c53d8-4220-4ec3-ab29-e8380482e230 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:10.626201 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-8f9c53d8-4220-4ec3-ab29-e8380482e230 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c678da620f546d2a0f91a81bcbfc0ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8743b5e17a4a5e9d378ba9bd0d0bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:10.635068 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-8f9c53d8-4220-4ec3-ab29-e8380482e230 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] 10.222.0.70 "GET /compute/v2.1/servers/ddfa06a9-0e17-4fb8-92ca-715b8aa80b00" status: 200 len: 1314 microversion: 2.1 time: 0.223699 Aug 27 03:16:10.636447 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2755/5551] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:10 2022] GET /compute/v2.1/servers/ddfa06a9-0e17-4fb8-92ca-715b8aa80b00 => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:11.657533 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a64a8d85-3344-4f56-b135-a548f24b49bb tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:11.658231 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-a64a8d85-3344-4f56-b135-a548f24b49bb tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] [instance: ddfa06a9-0e17-4fb8-92ca-715b8aa80b00] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:11.679646 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a64a8d85-3344-4f56-b135-a548f24b49bb tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:11.681239 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a64a8d85-3344-4f56-b135-a548f24b49bb tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:11.683969 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a64a8d85-3344-4f56-b135-a548f24b49bb tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:11.685255 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a64a8d85-3344-4f56-b135-a548f24b49bb tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:11.686363 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a64a8d85-3344-4f56-b135-a548f24b49bb tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:11.687072 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a64a8d85-3344-4f56-b135-a548f24b49bb tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:12.012842 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-a64a8d85-3344-4f56-b135-a548f24b49bb tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c678da620f546d2a0f91a81bcbfc0ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8743b5e17a4a5e9d378ba9bd0d0bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:12.028432 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a64a8d85-3344-4f56-b135-a548f24b49bb tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] 10.222.0.70 "GET /compute/v2.1/servers/ddfa06a9-0e17-4fb8-92ca-715b8aa80b00" status: 200 len: 1314 microversion: 2.1 time: 0.375239 Aug 27 03:16:12.030832 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2797/5552] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:11 2022] GET /compute/v2.1/servers/ddfa06a9-0e17-4fb8-92ca-715b8aa80b00 => generated 1314 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:13.051065 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-44dc7619-7546-48d2-a15b-b4639672338a tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:13.052175 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-44dc7619-7546-48d2-a15b-b4639672338a tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] [instance: ddfa06a9-0e17-4fb8-92ca-715b8aa80b00] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:13.062063 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-44dc7619-7546-48d2-a15b-b4639672338a tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:13.062802 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-44dc7619-7546-48d2-a15b-b4639672338a tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:13.064172 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-44dc7619-7546-48d2-a15b-b4639672338a tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:13.065763 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-44dc7619-7546-48d2-a15b-b4639672338a tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:13.066476 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-44dc7619-7546-48d2-a15b-b4639672338a tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:13.068370 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-44dc7619-7546-48d2-a15b-b4639672338a tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:13.642049 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-44dc7619-7546-48d2-a15b-b4639672338a tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c678da620f546d2a0f91a81bcbfc0ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8743b5e17a4a5e9d378ba9bd0d0bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:13.653873 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-44dc7619-7546-48d2-a15b-b4639672338a tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] 10.222.0.70 "GET /compute/v2.1/servers/ddfa06a9-0e17-4fb8-92ca-715b8aa80b00" status: 200 len: 1314 microversion: 2.1 time: 0.607791 Aug 27 03:16:13.654472 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2756/5553] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:13 2022] GET /compute/v2.1/servers/ddfa06a9-0e17-4fb8-92ca-715b8aa80b00 => generated 1314 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:14.675816 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-85e47e1c-b1c7-48ea-80ca-6294b1598bc6 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:14.677183 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-85e47e1c-b1c7-48ea-80ca-6294b1598bc6 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] [instance: ddfa06a9-0e17-4fb8-92ca-715b8aa80b00] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:14.689774 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-85e47e1c-b1c7-48ea-80ca-6294b1598bc6 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:14.691586 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-85e47e1c-b1c7-48ea-80ca-6294b1598bc6 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:14.693825 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-85e47e1c-b1c7-48ea-80ca-6294b1598bc6 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:14.694691 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-85e47e1c-b1c7-48ea-80ca-6294b1598bc6 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:14.696107 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-85e47e1c-b1c7-48ea-80ca-6294b1598bc6 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:14.700233 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-85e47e1c-b1c7-48ea-80ca-6294b1598bc6 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:15.008999 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-85e47e1c-b1c7-48ea-80ca-6294b1598bc6 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c678da620f546d2a0f91a81bcbfc0ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8743b5e17a4a5e9d378ba9bd0d0bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:15.021924 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-85e47e1c-b1c7-48ea-80ca-6294b1598bc6 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] 10.222.0.70 "GET /compute/v2.1/servers/ddfa06a9-0e17-4fb8-92ca-715b8aa80b00" status: 200 len: 1314 microversion: 2.1 time: 0.346647 Aug 27 03:16:15.026162 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2798/5554] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:14 2022] GET /compute/v2.1/servers/ddfa06a9-0e17-4fb8-92ca-715b8aa80b00 => generated 1314 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:16.046486 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e0fa291f-171c-4c77-aa7b-600c772a199e tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:16.047237 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-e0fa291f-171c-4c77-aa7b-600c772a199e tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] [instance: ddfa06a9-0e17-4fb8-92ca-715b8aa80b00] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:16.055670 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:16:16.059132 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=6 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:16:16.063908 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e0fa291f-171c-4c77-aa7b-600c772a199e tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:16.064546 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e0fa291f-171c-4c77-aa7b-600c772a199e tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:16.065492 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e0fa291f-171c-4c77-aa7b-600c772a199e tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:16.066570 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e0fa291f-171c-4c77-aa7b-600c772a199e tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:16.067239 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e0fa291f-171c-4c77-aa7b-600c772a199e tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:16.067860 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e0fa291f-171c-4c77-aa7b-600c772a199e tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:16.402974 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-e0fa291f-171c-4c77-aa7b-600c772a199e tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c678da620f546d2a0f91a81bcbfc0ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8743b5e17a4a5e9d378ba9bd0d0bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:16.430502 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e0fa291f-171c-4c77-aa7b-600c772a199e tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] 10.222.0.70 "GET /compute/v2.1/servers/ddfa06a9-0e17-4fb8-92ca-715b8aa80b00" status: 200 len: 1314 microversion: 2.1 time: 0.386791 Aug 27 03:16:16.436510 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2757/5555] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:16 2022] GET /compute/v2.1/servers/ddfa06a9-0e17-4fb8-92ca-715b8aa80b00 => generated 1314 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:16.718841 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-f090d2bb-f500-4ef7-9f38-ee2cb64c88aa req-ff9d642e-a754-4241-a960-ca70dea8abf5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddfa06a9-0e17-4fb8-92ca-715b8aa80b00", "name": "network-vif-plugged", "status": "completed", "tag": "5ff33f5b-b6c7-4baf-bb26-642d5707201e"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:16:16.737798 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:16:16.744875 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-f090d2bb-f500-4ef7-9f38-ee2cb64c88aa req-ff9d642e-a754-4241-a960-ca70dea8abf5 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:16.746266 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-f090d2bb-f500-4ef7-9f38-ee2cb64c88aa req-ff9d642e-a754-4241-a960-ca70dea8abf5 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:16.747306 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-f090d2bb-f500-4ef7-9f38-ee2cb64c88aa req-ff9d642e-a754-4241-a960-ca70dea8abf5 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:16.804167 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-f090d2bb-f500-4ef7-9f38-ee2cb64c88aa req-ff9d642e-a754-4241-a960-ca70dea8abf5 service nova] Creating event network-vif-plugged:5ff33f5b-b6c7-4baf-bb26-642d5707201e for instance ddfa06a9-0e17-4fb8-92ca-715b8aa80b00 on n-h1-852278-4 Aug 27 03:16:16.821517 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-f090d2bb-f500-4ef7-9f38-ee2cb64c88aa req-ff9d642e-a754-4241-a960-ca70dea8abf5 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108259 Aug 27 03:16:16.822544 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2799/5556] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:16:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:16:17.457075 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8ba0f9ff-1285-4ca2-964e-8e161d0fc504 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:17.458400 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-8ba0f9ff-1285-4ca2-964e-8e161d0fc504 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] [instance: ddfa06a9-0e17-4fb8-92ca-715b8aa80b00] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:17.481485 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8ba0f9ff-1285-4ca2-964e-8e161d0fc504 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:17.484621 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8ba0f9ff-1285-4ca2-964e-8e161d0fc504 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:17.485289 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8ba0f9ff-1285-4ca2-964e-8e161d0fc504 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:17.486040 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8ba0f9ff-1285-4ca2-964e-8e161d0fc504 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:17.489085 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8ba0f9ff-1285-4ca2-964e-8e161d0fc504 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:17.489546 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8ba0f9ff-1285-4ca2-964e-8e161d0fc504 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:17.678988 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-8ba0f9ff-1285-4ca2-964e-8e161d0fc504 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c678da620f546d2a0f91a81bcbfc0ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8743b5e17a4a5e9d378ba9bd0d0bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:17.700439 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-8ba0f9ff-1285-4ca2-964e-8e161d0fc504 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] 10.222.0.70 "GET /compute/v2.1/servers/ddfa06a9-0e17-4fb8-92ca-715b8aa80b00" status: 200 len: 1314 microversion: 2.1 time: 0.247036 Aug 27 03:16:17.701701 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2758/5557] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:17 2022] GET /compute/v2.1/servers/ddfa06a9-0e17-4fb8-92ca-715b8aa80b00 => generated 1314 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:18.727540 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0dae698a-41f0-4c12-8238-14282c6558e6 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:18.728246 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-0dae698a-41f0-4c12-8238-14282c6558e6 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] [instance: ddfa06a9-0e17-4fb8-92ca-715b8aa80b00] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:18.739613 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0dae698a-41f0-4c12-8238-14282c6558e6 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:18.743199 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0dae698a-41f0-4c12-8238-14282c6558e6 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:18.743875 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0dae698a-41f0-4c12-8238-14282c6558e6 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:18.746415 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0dae698a-41f0-4c12-8238-14282c6558e6 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:18.747101 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0dae698a-41f0-4c12-8238-14282c6558e6 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:18.747693 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0dae698a-41f0-4c12-8238-14282c6558e6 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:19.057287 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-0dae698a-41f0-4c12-8238-14282c6558e6 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c678da620f546d2a0f91a81bcbfc0ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8743b5e17a4a5e9d378ba9bd0d0bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:19.073253 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-0dae698a-41f0-4c12-8238-14282c6558e6 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] 10.222.0.70 "GET /compute/v2.1/servers/ddfa06a9-0e17-4fb8-92ca-715b8aa80b00" status: 200 len: 1499 microversion: 2.1 time: 0.349650 Aug 27 03:16:19.075551 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2800/5558] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:18 2022] GET /compute/v2.1/servers/ddfa06a9-0e17-4fb8-92ca-715b8aa80b00 => generated 1499 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:19.096977 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0e2f8cad-6dfb-4d00-a0c9-6998618de248 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:19.098151 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-0e2f8cad-6dfb-4d00-a0c9-6998618de248 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] [instance: ddfa06a9-0e17-4fb8-92ca-715b8aa80b00] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:19.105389 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0e2f8cad-6dfb-4d00-a0c9-6998618de248 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:19.106105 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0e2f8cad-6dfb-4d00-a0c9-6998618de248 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:19.106741 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0e2f8cad-6dfb-4d00-a0c9-6998618de248 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:19.107804 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0e2f8cad-6dfb-4d00-a0c9-6998618de248 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:19.108333 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0e2f8cad-6dfb-4d00-a0c9-6998618de248 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:19.109425 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0e2f8cad-6dfb-4d00-a0c9-6998618de248 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:19.308689 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0e2f8cad-6dfb-4d00-a0c9-6998618de248 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c678da620f546d2a0f91a81bcbfc0ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8743b5e17a4a5e9d378ba9bd0d0bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:19.325326 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-0e2f8cad-6dfb-4d00-a0c9-6998618de248 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] 10.222.0.70 "GET /compute/v2.1/servers/ddfa06a9-0e17-4fb8-92ca-715b8aa80b00" status: 200 len: 1499 microversion: 2.1 time: 0.232698 Aug 27 03:16:19.336400 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2759/5559] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:19 2022] GET /compute/v2.1/servers/ddfa06a9-0e17-4fb8-92ca-715b8aa80b00 => generated 1499 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:19.349545 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-9e955b76-12df-4d73-88bb-bfeb4a63d0fb tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:16:19.350553 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-9e955b76-12df-4d73-88bb-bfeb4a63d0fb tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] [instance: ddfa06a9-0e17-4fb8-92ca-715b8aa80b00] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:19.359008 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9e955b76-12df-4d73-88bb-bfeb4a63d0fb tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:19.361113 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9e955b76-12df-4d73-88bb-bfeb4a63d0fb tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:19.362217 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9e955b76-12df-4d73-88bb-bfeb4a63d0fb tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:19.364398 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9e955b76-12df-4d73-88bb-bfeb4a63d0fb tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:19.365744 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9e955b76-12df-4d73-88bb-bfeb4a63d0fb tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:19.369352 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9e955b76-12df-4d73-88bb-bfeb4a63d0fb tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:19.409266 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.objects.instance [None req-9e955b76-12df-4d73-88bb-bfeb4a63d0fb tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lazy-loading 'flavor' on Instance uuid ddfa06a9-0e17-4fb8-92ca-715b8aa80b00 {{(pid=134051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:16:19.599954 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-9e955b76-12df-4d73-88bb-bfeb4a63d0fb tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] 10.222.0.70 "POST /compute/v2.1/servers/ddfa06a9-0e17-4fb8-92ca-715b8aa80b00/action" status: 202 len: 0 microversion: 2.1 time: 0.239498 Aug 27 03:16:19.607254 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2801/5560] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:16:19 2022] POST /compute/v2.1/servers/ddfa06a9-0e17-4fb8-92ca-715b8aa80b00/action => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:16:19.611599 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-44db558b-a669-48ab-a940-2c6509862986 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:19.612218 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-44db558b-a669-48ab-a940-2c6509862986 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] [instance: ddfa06a9-0e17-4fb8-92ca-715b8aa80b00] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:19.630617 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-44db558b-a669-48ab-a940-2c6509862986 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:19.631441 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-44db558b-a669-48ab-a940-2c6509862986 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:19.631919 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-44db558b-a669-48ab-a940-2c6509862986 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:19.632668 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-44db558b-a669-48ab-a940-2c6509862986 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:19.633116 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-44db558b-a669-48ab-a940-2c6509862986 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:19.633576 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-44db558b-a669-48ab-a940-2c6509862986 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:19.858177 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-44db558b-a669-48ab-a940-2c6509862986 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c678da620f546d2a0f91a81bcbfc0ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8743b5e17a4a5e9d378ba9bd0d0bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:19.874787 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-44db558b-a669-48ab-a940-2c6509862986 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] 10.222.0.70 "GET /compute/v2.1/servers/ddfa06a9-0e17-4fb8-92ca-715b8aa80b00" status: 200 len: 1507 microversion: 2.1 time: 0.267464 Aug 27 03:16:19.882997 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2760/5561] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:19 2022] GET /compute/v2.1/servers/ddfa06a9-0e17-4fb8-92ca-715b8aa80b00 => generated 1507 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:20.900021 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-321c399f-d594-4740-b98d-1e714a7aea93 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:20.901523 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-321c399f-d594-4740-b98d-1e714a7aea93 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] [instance: ddfa06a9-0e17-4fb8-92ca-715b8aa80b00] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:20.931148 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-321c399f-d594-4740-b98d-1e714a7aea93 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:20.936558 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-321c399f-d594-4740-b98d-1e714a7aea93 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:20.937554 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-321c399f-d594-4740-b98d-1e714a7aea93 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:20.938504 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-321c399f-d594-4740-b98d-1e714a7aea93 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:20.938969 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-321c399f-d594-4740-b98d-1e714a7aea93 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:20.940680 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-321c399f-d594-4740-b98d-1e714a7aea93 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:21.190841 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-321c399f-d594-4740-b98d-1e714a7aea93 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c678da620f546d2a0f91a81bcbfc0ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8743b5e17a4a5e9d378ba9bd0d0bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:21.199568 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-321c399f-d594-4740-b98d-1e714a7aea93 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] 10.222.0.70 "GET /compute/v2.1/servers/ddfa06a9-0e17-4fb8-92ca-715b8aa80b00" status: 200 len: 1490 microversion: 2.1 time: 0.304421 Aug 27 03:16:21.201165 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2802/5562] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:20 2022] GET /compute/v2.1/servers/ddfa06a9-0e17-4fb8-92ca-715b8aa80b00 => generated 1490 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:21.225235 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-02c15739-19ed-498e-82d3-2a362ef34706 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:16:21.226711 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-02c15739-19ed-498e-82d3-2a362ef34706 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] [instance: ddfa06a9-0e17-4fb8-92ca-715b8aa80b00] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:21.236053 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-02c15739-19ed-498e-82d3-2a362ef34706 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:21.236918 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-02c15739-19ed-498e-82d3-2a362ef34706 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:21.237366 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-02c15739-19ed-498e-82d3-2a362ef34706 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:21.238229 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-02c15739-19ed-498e-82d3-2a362ef34706 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:21.238831 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-02c15739-19ed-498e-82d3-2a362ef34706 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:21.239263 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-02c15739-19ed-498e-82d3-2a362ef34706 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:21.323926 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-02c15739-19ed-498e-82d3-2a362ef34706 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] 10.222.0.70 "POST /compute/v2.1/servers/ddfa06a9-0e17-4fb8-92ca-715b8aa80b00/action" status: 202 len: 0 microversion: 2.1 time: 0.102639 Aug 27 03:16:21.325158 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2761/5563] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:16:21 2022] POST /compute/v2.1/servers/ddfa06a9-0e17-4fb8-92ca-715b8aa80b00/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:16:21.334712 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-663d310f-f8fd-46b5-9654-762a7d92b506 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:21.335756 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-663d310f-f8fd-46b5-9654-762a7d92b506 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] [instance: ddfa06a9-0e17-4fb8-92ca-715b8aa80b00] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:21.343099 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-663d310f-f8fd-46b5-9654-762a7d92b506 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:21.343960 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-663d310f-f8fd-46b5-9654-762a7d92b506 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:21.344631 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-663d310f-f8fd-46b5-9654-762a7d92b506 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:21.345989 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-663d310f-f8fd-46b5-9654-762a7d92b506 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:21.346883 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-663d310f-f8fd-46b5-9654-762a7d92b506 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:21.347865 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-663d310f-f8fd-46b5-9654-762a7d92b506 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:21.535118 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-663d310f-f8fd-46b5-9654-762a7d92b506 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c678da620f546d2a0f91a81bcbfc0ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8743b5e17a4a5e9d378ba9bd0d0bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:21.543745 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-663d310f-f8fd-46b5-9654-762a7d92b506 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] 10.222.0.70 "GET /compute/v2.1/servers/ddfa06a9-0e17-4fb8-92ca-715b8aa80b00" status: 200 len: 1496 microversion: 2.1 time: 0.214284 Aug 27 03:16:21.548559 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2803/5564] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:21 2022] GET /compute/v2.1/servers/ddfa06a9-0e17-4fb8-92ca-715b8aa80b00 => generated 1496 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:22.569483 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0a591898-2fe1-4f33-88d7-c0583affbb26 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:22.570975 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-0a591898-2fe1-4f33-88d7-c0583affbb26 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] [instance: ddfa06a9-0e17-4fb8-92ca-715b8aa80b00] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:22.579433 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0a591898-2fe1-4f33-88d7-c0583affbb26 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:22.580205 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0a591898-2fe1-4f33-88d7-c0583affbb26 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:22.580928 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0a591898-2fe1-4f33-88d7-c0583affbb26 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:22.582595 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0a591898-2fe1-4f33-88d7-c0583affbb26 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:22.583725 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0a591898-2fe1-4f33-88d7-c0583affbb26 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:22.584156 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0a591898-2fe1-4f33-88d7-c0583affbb26 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:22.823331 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0a591898-2fe1-4f33-88d7-c0583affbb26 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c678da620f546d2a0f91a81bcbfc0ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8743b5e17a4a5e9d378ba9bd0d0bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:22.834732 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-0a591898-2fe1-4f33-88d7-c0583affbb26 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] 10.222.0.70 "GET /compute/v2.1/servers/ddfa06a9-0e17-4fb8-92ca-715b8aa80b00" status: 200 len: 1496 microversion: 2.1 time: 0.271365 Aug 27 03:16:22.836243 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2762/5565] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:22 2022] GET /compute/v2.1/servers/ddfa06a9-0e17-4fb8-92ca-715b8aa80b00 => generated 1496 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:23.856663 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-51f0917b-290b-458f-a1a4-3099c3de7259 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:23.857618 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-51f0917b-290b-458f-a1a4-3099c3de7259 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] [instance: ddfa06a9-0e17-4fb8-92ca-715b8aa80b00] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:23.866539 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-51f0917b-290b-458f-a1a4-3099c3de7259 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:23.867023 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-51f0917b-290b-458f-a1a4-3099c3de7259 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:23.867454 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-51f0917b-290b-458f-a1a4-3099c3de7259 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:23.868539 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-51f0917b-290b-458f-a1a4-3099c3de7259 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:23.868989 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-51f0917b-290b-458f-a1a4-3099c3de7259 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:23.869402 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-51f0917b-290b-458f-a1a4-3099c3de7259 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:24.015708 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-51f0917b-290b-458f-a1a4-3099c3de7259 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c678da620f546d2a0f91a81bcbfc0ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8743b5e17a4a5e9d378ba9bd0d0bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:24.024381 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-51f0917b-290b-458f-a1a4-3099c3de7259 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] 10.222.0.70 "GET /compute/v2.1/servers/ddfa06a9-0e17-4fb8-92ca-715b8aa80b00" status: 200 len: 1499 microversion: 2.1 time: 0.173013 Aug 27 03:16:24.024972 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2804/5566] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:23 2022] GET /compute/v2.1/servers/ddfa06a9-0e17-4fb8-92ca-715b8aa80b00 => generated 1499 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:16:24.045473 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-be4dd94e-ddae-48f8-8c75-c359d2251ec3 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:16:24.046089 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-be4dd94e-ddae-48f8-8c75-c359d2251ec3 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] [instance: ddfa06a9-0e17-4fb8-92ca-715b8aa80b00] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:24.053387 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-be4dd94e-ddae-48f8-8c75-c359d2251ec3 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:24.053969 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-be4dd94e-ddae-48f8-8c75-c359d2251ec3 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:24.054496 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-be4dd94e-ddae-48f8-8c75-c359d2251ec3 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:24.055266 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-be4dd94e-ddae-48f8-8c75-c359d2251ec3 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:24.055773 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-be4dd94e-ddae-48f8-8c75-c359d2251ec3 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:24.056254 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-be4dd94e-ddae-48f8-8c75-c359d2251ec3 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:24.081902 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.instance [None req-be4dd94e-ddae-48f8-8c75-c359d2251ec3 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lazy-loading 'flavor' on Instance uuid ddfa06a9-0e17-4fb8-92ca-715b8aa80b00 {{(pid=134052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:16:24.168117 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-be4dd94e-ddae-48f8-8c75-c359d2251ec3 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] 10.222.0.70 "POST /compute/v2.1/servers/ddfa06a9-0e17-4fb8-92ca-715b8aa80b00/action" status: 202 len: 0 microversion: 2.1 time: 0.126138 Aug 27 03:16:24.169051 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2763/5567] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:16:24 2022] POST /compute/v2.1/servers/ddfa06a9-0e17-4fb8-92ca-715b8aa80b00/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:16:24.177212 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4680fa01-e339-4298-80b6-17339f59d68f tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:24.177928 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-4680fa01-e339-4298-80b6-17339f59d68f tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] [instance: ddfa06a9-0e17-4fb8-92ca-715b8aa80b00] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:24.192124 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4680fa01-e339-4298-80b6-17339f59d68f tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:24.192788 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4680fa01-e339-4298-80b6-17339f59d68f tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:24.193518 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4680fa01-e339-4298-80b6-17339f59d68f tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:24.194445 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4680fa01-e339-4298-80b6-17339f59d68f tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:24.194960 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4680fa01-e339-4298-80b6-17339f59d68f tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:24.195510 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4680fa01-e339-4298-80b6-17339f59d68f tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:24.356115 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-4680fa01-e339-4298-80b6-17339f59d68f tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c678da620f546d2a0f91a81bcbfc0ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8743b5e17a4a5e9d378ba9bd0d0bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:24.365936 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-4680fa01-e339-4298-80b6-17339f59d68f tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] 10.222.0.70 "GET /compute/v2.1/servers/ddfa06a9-0e17-4fb8-92ca-715b8aa80b00" status: 200 len: 1507 microversion: 2.1 time: 0.192538 Aug 27 03:16:24.366969 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2805/5568] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:24 2022] GET /compute/v2.1/servers/ddfa06a9-0e17-4fb8-92ca-715b8aa80b00 => generated 1507 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:16:24.899480 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-71d4fe17-b8e2-46f6-9e6e-32deea2e78a4 tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-638481113", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:16:24.959023 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.network.neutron [None req-71d4fe17-b8e2-46f6-9e6e-32deea2e78a4 tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] validate_networks() for None {{(pid=134052) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:16:25.246803 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-71d4fe17-b8e2-46f6-9e6e-32deea2e78a4 tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Flavor limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:16:25.247398 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-71d4fe17-b8e2-46f6-9e6e-32deea2e78a4 tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Image limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:16:25.247738 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-71d4fe17-b8e2-46f6-9e6e-32deea2e78a4 tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Flavor pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:16:25.248127 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-71d4fe17-b8e2-46f6-9e6e-32deea2e78a4 tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Image pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:16:25.248581 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-71d4fe17-b8e2-46f6-9e6e-32deea2e78a4 tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:16:25.257990 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-71d4fe17-b8e2-46f6-9e6e-32deea2e78a4 tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:25.258477 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-71d4fe17-b8e2-46f6-9e6e-32deea2e78a4 tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:25.258915 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-71d4fe17-b8e2-46f6-9e6e-32deea2e78a4 tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:25.259649 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-71d4fe17-b8e2-46f6-9e6e-32deea2e78a4 tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:25.260097 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-71d4fe17-b8e2-46f6-9e6e-32deea2e78a4 tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:25.260546 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-71d4fe17-b8e2-46f6-9e6e-32deea2e78a4 tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:25.277941 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-71d4fe17-b8e2-46f6-9e6e-32deea2e78a4 tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Getting quotas for project 5b6250339865435391ef90912db5f0c8. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:16:25.283285 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-71d4fe17-b8e2-46f6-9e6e-32deea2e78a4 tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Getting quotas for user ab36c57cb91a48d4b9f5500fb46f43ce and project 5b6250339865435391ef90912db5f0c8. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:16:25.296266 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-71d4fe17-b8e2-46f6-9e6e-32deea2e78a4 tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Going to run 1 instances... {{(pid=134052) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:16:25.298756 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-71d4fe17-b8e2-46f6-9e6e-32deea2e78a4 tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] [instance: 0b7bdf3f-0f3f-4c1b-9a5b-c43cc7df7420] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134052) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:16:25.344147 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-71d4fe17-b8e2-46f6-9e6e-32deea2e78a4 tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.448956 Aug 27 03:16:25.345074 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2764/5569] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 03:16:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 451 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 03:16:25.355898 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-edbb3680-f826-4df0-8bb4-03a15aafa5bc tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:25.356697 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-edbb3680-f826-4df0-8bb4-03a15aafa5bc tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] [instance: 0b7bdf3f-0f3f-4c1b-9a5b-c43cc7df7420] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:25.395569 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8146e9bf-0d41-40ca-b413-6056a551e949 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:25.396376 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-8146e9bf-0d41-40ca-b413-6056a551e949 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] [instance: ddfa06a9-0e17-4fb8-92ca-715b8aa80b00] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:25.404421 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8146e9bf-0d41-40ca-b413-6056a551e949 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:25.405157 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8146e9bf-0d41-40ca-b413-6056a551e949 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:25.405693 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8146e9bf-0d41-40ca-b413-6056a551e949 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:25.406607 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8146e9bf-0d41-40ca-b413-6056a551e949 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:25.407208 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8146e9bf-0d41-40ca-b413-6056a551e949 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:25.408246 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8146e9bf-0d41-40ca-b413-6056a551e949 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:25.420505 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-edbb3680-f826-4df0-8bb4-03a15aafa5bc tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab36c57cb91a48d4b9f5500fb46f43ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b6250339865435391ef90912db5f0c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:25.429745 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-edbb3680-f826-4df0-8bb4-03a15aafa5bc tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] 10.222.0.70 "GET /compute/v2.1/servers/0b7bdf3f-0f3f-4c1b-9a5b-c43cc7df7420" status: 200 len: 1213 microversion: 2.1 time: 0.077878 Aug 27 03:16:25.431005 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2806/5570] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:25 2022] GET /compute/v2.1/servers/0b7bdf3f-0f3f-4c1b-9a5b-c43cc7df7420 => generated 1213 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:25.566349 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-8146e9bf-0d41-40ca-b413-6056a551e949 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c678da620f546d2a0f91a81bcbfc0ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8743b5e17a4a5e9d378ba9bd0d0bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:25.575018 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-8146e9bf-0d41-40ca-b413-6056a551e949 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] 10.222.0.70 "GET /compute/v2.1/servers/ddfa06a9-0e17-4fb8-92ca-715b8aa80b00" status: 200 len: 1490 microversion: 2.1 time: 0.188387 Aug 27 03:16:25.576730 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2765/5571] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:25 2022] GET /compute/v2.1/servers/ddfa06a9-0e17-4fb8-92ca-715b8aa80b00 => generated 1490 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:25.596025 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-84067999-b996-4e00-afae-493cc6fbe488 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:16:25.596562 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-84067999-b996-4e00-afae-493cc6fbe488 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] [instance: ddfa06a9-0e17-4fb8-92ca-715b8aa80b00] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:25.603610 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-84067999-b996-4e00-afae-493cc6fbe488 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:25.604103 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-84067999-b996-4e00-afae-493cc6fbe488 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:25.604573 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-84067999-b996-4e00-afae-493cc6fbe488 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:25.605276 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-84067999-b996-4e00-afae-493cc6fbe488 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:25.605728 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-84067999-b996-4e00-afae-493cc6fbe488 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:25.606149 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-84067999-b996-4e00-afae-493cc6fbe488 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:25.682818 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-84067999-b996-4e00-afae-493cc6fbe488 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] 10.222.0.70 "POST /compute/v2.1/servers/ddfa06a9-0e17-4fb8-92ca-715b8aa80b00/action" status: 202 len: 0 microversion: 2.1 time: 0.090225 Aug 27 03:16:25.688175 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2807/5572] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:16:25 2022] POST /compute/v2.1/servers/ddfa06a9-0e17-4fb8-92ca-715b8aa80b00/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:16:25.696896 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0b8522b5-45c9-46eb-b129-e20768086638 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:25.697852 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-0b8522b5-45c9-46eb-b129-e20768086638 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] [instance: ddfa06a9-0e17-4fb8-92ca-715b8aa80b00] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:25.708069 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0b8522b5-45c9-46eb-b129-e20768086638 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:25.708614 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0b8522b5-45c9-46eb-b129-e20768086638 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:25.709056 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0b8522b5-45c9-46eb-b129-e20768086638 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:25.709816 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0b8522b5-45c9-46eb-b129-e20768086638 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:25.710273 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0b8522b5-45c9-46eb-b129-e20768086638 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:25.710696 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0b8522b5-45c9-46eb-b129-e20768086638 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:26.026394 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0b8522b5-45c9-46eb-b129-e20768086638 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c678da620f546d2a0f91a81bcbfc0ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8743b5e17a4a5e9d378ba9bd0d0bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:26.038904 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-0b8522b5-45c9-46eb-b129-e20768086638 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] 10.222.0.70 "GET /compute/v2.1/servers/ddfa06a9-0e17-4fb8-92ca-715b8aa80b00" status: 200 len: 1496 microversion: 2.1 time: 0.349644 Aug 27 03:16:26.040935 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2766/5573] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:25 2022] GET /compute/v2.1/servers/ddfa06a9-0e17-4fb8-92ca-715b8aa80b00 => generated 1496 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:26.452551 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e49c6cc7-33d9-4c42-99d3-8ee2669d4d8b tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:26.454334 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-e49c6cc7-33d9-4c42-99d3-8ee2669d4d8b tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] [instance: 0b7bdf3f-0f3f-4c1b-9a5b-c43cc7df7420] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:26.460499 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e49c6cc7-33d9-4c42-99d3-8ee2669d4d8b tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:26.460994 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e49c6cc7-33d9-4c42-99d3-8ee2669d4d8b tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:26.461434 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e49c6cc7-33d9-4c42-99d3-8ee2669d4d8b tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:26.462137 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e49c6cc7-33d9-4c42-99d3-8ee2669d4d8b tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:26.462594 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e49c6cc7-33d9-4c42-99d3-8ee2669d4d8b tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:26.463017 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e49c6cc7-33d9-4c42-99d3-8ee2669d4d8b tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:26.534777 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e49c6cc7-33d9-4c42-99d3-8ee2669d4d8b tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab36c57cb91a48d4b9f5500fb46f43ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b6250339865435391ef90912db5f0c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:26.543115 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e49c6cc7-33d9-4c42-99d3-8ee2669d4d8b tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] 10.222.0.70 "GET /compute/v2.1/servers/0b7bdf3f-0f3f-4c1b-9a5b-c43cc7df7420" status: 200 len: 1265 microversion: 2.1 time: 0.095894 Aug 27 03:16:26.543720 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2808/5574] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:26 2022] GET /compute/v2.1/servers/0b7bdf3f-0f3f-4c1b-9a5b-c43cc7df7420 => generated 1265 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:27.060220 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-2f14d200-ffab-4b90-bd03-4a11427d5a07 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:27.061441 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-2f14d200-ffab-4b90-bd03-4a11427d5a07 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] [instance: ddfa06a9-0e17-4fb8-92ca-715b8aa80b00] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:27.068228 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2f14d200-ffab-4b90-bd03-4a11427d5a07 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:27.068865 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2f14d200-ffab-4b90-bd03-4a11427d5a07 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:27.069379 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2f14d200-ffab-4b90-bd03-4a11427d5a07 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:27.070223 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2f14d200-ffab-4b90-bd03-4a11427d5a07 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:27.070783 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2f14d200-ffab-4b90-bd03-4a11427d5a07 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:27.071271 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2f14d200-ffab-4b90-bd03-4a11427d5a07 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:27.076363 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:16:27.305410 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-2f14d200-ffab-4b90-bd03-4a11427d5a07 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c678da620f546d2a0f91a81bcbfc0ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8743b5e17a4a5e9d378ba9bd0d0bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:27.314927 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-2f14d200-ffab-4b90-bd03-4a11427d5a07 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] 10.222.0.70 "GET /compute/v2.1/servers/ddfa06a9-0e17-4fb8-92ca-715b8aa80b00" status: 200 len: 1496 microversion: 2.1 time: 0.258567 Aug 27 03:16:27.315547 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2767/5575] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:27 2022] GET /compute/v2.1/servers/ddfa06a9-0e17-4fb8-92ca-715b8aa80b00 => generated 1496 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:27.566287 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-52e43059-96fb-4e02-84fe-812b792666d9 tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:27.567037 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-52e43059-96fb-4e02-84fe-812b792666d9 tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] [instance: 0b7bdf3f-0f3f-4c1b-9a5b-c43cc7df7420] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:27.577393 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-52e43059-96fb-4e02-84fe-812b792666d9 tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:27.577926 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-52e43059-96fb-4e02-84fe-812b792666d9 tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:27.578873 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-52e43059-96fb-4e02-84fe-812b792666d9 tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:27.579891 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-52e43059-96fb-4e02-84fe-812b792666d9 tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:27.580396 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-52e43059-96fb-4e02-84fe-812b792666d9 tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:27.580831 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-52e43059-96fb-4e02-84fe-812b792666d9 tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:27.666324 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-52e43059-96fb-4e02-84fe-812b792666d9 tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab36c57cb91a48d4b9f5500fb46f43ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b6250339865435391ef90912db5f0c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:27.681945 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-52e43059-96fb-4e02-84fe-812b792666d9 tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] 10.222.0.70 "GET /compute/v2.1/servers/0b7bdf3f-0f3f-4c1b-9a5b-c43cc7df7420" status: 200 len: 1271 microversion: 2.1 time: 0.121121 Aug 27 03:16:27.692236 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2809/5576] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:27 2022] GET /compute/v2.1/servers/0b7bdf3f-0f3f-4c1b-9a5b-c43cc7df7420 => generated 1271 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:28.335195 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-738f1334-2c9e-436b-bc6d-003fb6e41b39 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:28.335825 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-738f1334-2c9e-436b-bc6d-003fb6e41b39 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] [instance: ddfa06a9-0e17-4fb8-92ca-715b8aa80b00] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:28.344629 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-738f1334-2c9e-436b-bc6d-003fb6e41b39 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:28.345211 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-738f1334-2c9e-436b-bc6d-003fb6e41b39 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:28.345710 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-738f1334-2c9e-436b-bc6d-003fb6e41b39 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:28.346462 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-738f1334-2c9e-436b-bc6d-003fb6e41b39 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:28.347061 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-738f1334-2c9e-436b-bc6d-003fb6e41b39 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:28.347612 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-738f1334-2c9e-436b-bc6d-003fb6e41b39 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:28.533737 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-738f1334-2c9e-436b-bc6d-003fb6e41b39 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c678da620f546d2a0f91a81bcbfc0ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8743b5e17a4a5e9d378ba9bd0d0bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:28.543795 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-738f1334-2c9e-436b-bc6d-003fb6e41b39 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] 10.222.0.70 "GET /compute/v2.1/servers/ddfa06a9-0e17-4fb8-92ca-715b8aa80b00" status: 200 len: 1499 microversion: 2.1 time: 0.212687 Aug 27 03:16:28.544758 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2768/5577] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:28 2022] GET /compute/v2.1/servers/ddfa06a9-0e17-4fb8-92ca-715b8aa80b00 => generated 1499 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:28.564464 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4321b956-cd16-44c0-b368-1ce635795fa4 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:28.564980 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-4321b956-cd16-44c0-b368-1ce635795fa4 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] [instance: ddfa06a9-0e17-4fb8-92ca-715b8aa80b00] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:28.571420 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4321b956-cd16-44c0-b368-1ce635795fa4 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:28.572709 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4321b956-cd16-44c0-b368-1ce635795fa4 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:28.573361 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4321b956-cd16-44c0-b368-1ce635795fa4 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:28.574307 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4321b956-cd16-44c0-b368-1ce635795fa4 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:28.574972 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4321b956-cd16-44c0-b368-1ce635795fa4 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:28.575460 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4321b956-cd16-44c0-b368-1ce635795fa4 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:28.609526 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-4321b956-cd16-44c0-b368-1ce635795fa4 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] [instance: ddfa06a9-0e17-4fb8-92ca-715b8aa80b00] Going to try to terminate instance {{(pid=134051) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:16:28.631476 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:16:28.732108 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-4321b956-cd16-44c0-b368-1ce635795fa4 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] 10.222.0.70 "DELETE /compute/v2.1/servers/ddfa06a9-0e17-4fb8-92ca-715b8aa80b00" status: 204 len: 0 microversion: 2.1 time: 0.171754 Aug 27 03:16:28.733424 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2810/5578] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 03:16:28 2022] DELETE /compute/v2.1/servers/ddfa06a9-0e17-4fb8-92ca-715b8aa80b00 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:16:28.739242 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-bad8ba4b-590b-4857-8b5b-707719d51943 tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:28.740206 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-bad8ba4b-590b-4857-8b5b-707719d51943 tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] [instance: 0b7bdf3f-0f3f-4c1b-9a5b-c43cc7df7420] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:28.749807 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bad8ba4b-590b-4857-8b5b-707719d51943 tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:28.750309 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bad8ba4b-590b-4857-8b5b-707719d51943 tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:28.750944 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bad8ba4b-590b-4857-8b5b-707719d51943 tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:28.751665 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bad8ba4b-590b-4857-8b5b-707719d51943 tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:28.752283 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bad8ba4b-590b-4857-8b5b-707719d51943 tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:28.752764 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bad8ba4b-590b-4857-8b5b-707719d51943 tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:28.795842 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-0539006e-fa23-4c44-a75e-06d03d450b37 req-d59d2d8f-ab74-43e1-bf16-a99fc3d8a311 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b7bdf3f-0f3f-4c1b-9a5b-c43cc7df7420", "tag": "50207fcd-ebfe-4bcf-9b4c-d06fa9db0693"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:16:28.806612 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-0539006e-fa23-4c44-a75e-06d03d450b37 req-d59d2d8f-ab74-43e1-bf16-a99fc3d8a311 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:28.807086 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-0539006e-fa23-4c44-a75e-06d03d450b37 req-d59d2d8f-ab74-43e1-bf16-a99fc3d8a311 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:28.807688 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-0539006e-fa23-4c44-a75e-06d03d450b37 req-d59d2d8f-ab74-43e1-bf16-a99fc3d8a311 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:28.822976 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-0539006e-fa23-4c44-a75e-06d03d450b37 req-d59d2d8f-ab74-43e1-bf16-a99fc3d8a311 service nova] Creating event network-changed:50207fcd-ebfe-4bcf-9b4c-d06fa9db0693 for instance 0b7bdf3f-0f3f-4c1b-9a5b-c43cc7df7420 on n-h2-852278-4 Aug 27 03:16:28.828158 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-0539006e-fa23-4c44-a75e-06d03d450b37 req-d59d2d8f-ab74-43e1-bf16-a99fc3d8a311 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.218481 Aug 27 03:16:28.828839 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2769/5579] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:16:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:16:28.834907 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4015f654-cd9d-41f7-978e-396578fb7bd6 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:28.835757 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-4015f654-cd9d-41f7-978e-396578fb7bd6 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] [instance: ddfa06a9-0e17-4fb8-92ca-715b8aa80b00] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:28.842474 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4015f654-cd9d-41f7-978e-396578fb7bd6 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:28.843030 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4015f654-cd9d-41f7-978e-396578fb7bd6 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:28.843529 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4015f654-cd9d-41f7-978e-396578fb7bd6 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:28.844501 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4015f654-cd9d-41f7-978e-396578fb7bd6 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:28.845018 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4015f654-cd9d-41f7-978e-396578fb7bd6 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:28.845503 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4015f654-cd9d-41f7-978e-396578fb7bd6 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:29.040821 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-bad8ba4b-590b-4857-8b5b-707719d51943 tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab36c57cb91a48d4b9f5500fb46f43ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b6250339865435391ef90912db5f0c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:29.050251 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-bad8ba4b-590b-4857-8b5b-707719d51943 tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] 10.222.0.70 "GET /compute/v2.1/servers/0b7bdf3f-0f3f-4c1b-9a5b-c43cc7df7420" status: 200 len: 1313 microversion: 2.1 time: 0.315381 Aug 27 03:16:29.063741 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2811/5580] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:28 2022] GET /compute/v2.1/servers/0b7bdf3f-0f3f-4c1b-9a5b-c43cc7df7420 => generated 1313 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:29.126255 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-4015f654-cd9d-41f7-978e-396578fb7bd6 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c678da620f546d2a0f91a81bcbfc0ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8743b5e17a4a5e9d378ba9bd0d0bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:29.137286 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-4015f654-cd9d-41f7-978e-396578fb7bd6 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] 10.222.0.70 "GET /compute/v2.1/servers/ddfa06a9-0e17-4fb8-92ca-715b8aa80b00" status: 200 len: 1505 microversion: 2.1 time: 0.306472 Aug 27 03:16:29.138320 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2770/5581] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:28 2022] GET /compute/v2.1/servers/ddfa06a9-0e17-4fb8-92ca-715b8aa80b00 => generated 1505 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:30.071207 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-5acfa1fa-971f-4182-807c-6e566a5cc573 tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:30.071915 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-5acfa1fa-971f-4182-807c-6e566a5cc573 tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] [instance: 0b7bdf3f-0f3f-4c1b-9a5b-c43cc7df7420] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:30.078944 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5acfa1fa-971f-4182-807c-6e566a5cc573 tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:30.079525 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5acfa1fa-971f-4182-807c-6e566a5cc573 tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:30.080022 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5acfa1fa-971f-4182-807c-6e566a5cc573 tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:30.080815 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5acfa1fa-971f-4182-807c-6e566a5cc573 tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:30.081330 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5acfa1fa-971f-4182-807c-6e566a5cc573 tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:30.081780 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5acfa1fa-971f-4182-807c-6e566a5cc573 tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:30.161422 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-fa2a7535-4dad-40da-9383-f8b18b335ba6 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:30.162496 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-fa2a7535-4dad-40da-9383-f8b18b335ba6 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] [instance: ddfa06a9-0e17-4fb8-92ca-715b8aa80b00] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:30.169913 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fa2a7535-4dad-40da-9383-f8b18b335ba6 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:30.170432 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fa2a7535-4dad-40da-9383-f8b18b335ba6 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:30.170860 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fa2a7535-4dad-40da-9383-f8b18b335ba6 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:30.171577 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fa2a7535-4dad-40da-9383-f8b18b335ba6 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:30.172016 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fa2a7535-4dad-40da-9383-f8b18b335ba6 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:30.172464 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fa2a7535-4dad-40da-9383-f8b18b335ba6 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:30.735844 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-5acfa1fa-971f-4182-807c-6e566a5cc573 tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab36c57cb91a48d4b9f5500fb46f43ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b6250339865435391ef90912db5f0c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:30.743329 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-fa2a7535-4dad-40da-9383-f8b18b335ba6 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c678da620f546d2a0f91a81bcbfc0ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8743b5e17a4a5e9d378ba9bd0d0bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:30.747528 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-5acfa1fa-971f-4182-807c-6e566a5cc573 tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] 10.222.0.70 "GET /compute/v2.1/servers/0b7bdf3f-0f3f-4c1b-9a5b-c43cc7df7420" status: 200 len: 1313 microversion: 2.1 time: 0.679921 Aug 27 03:16:30.752837 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-fa2a7535-4dad-40da-9383-f8b18b335ba6 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] 10.222.0.70 "GET /compute/v2.1/servers/ddfa06a9-0e17-4fb8-92ca-715b8aa80b00" status: 200 len: 1505 microversion: 2.1 time: 0.597217 Aug 27 03:16:30.754108 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2771/5582] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:30 2022] GET /compute/v2.1/servers/ddfa06a9-0e17-4fb8-92ca-715b8aa80b00 => generated 1505 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:16:30.763073 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2812/5583] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:30 2022] GET /compute/v2.1/servers/0b7bdf3f-0f3f-4c1b-9a5b-c43cc7df7420 => generated 1313 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:31.477569 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-9fd736af-55d1-4025-9735-8de04e496f67 req-0057d2e2-0b6a-40cd-b696-27528638471f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddfa06a9-0e17-4fb8-92ca-715b8aa80b00", "name": "network-vif-deleted", "tag": "5ff33f5b-b6c7-4baf-bb26-642d5707201e"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:16:31.488693 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-9fd736af-55d1-4025-9735-8de04e496f67 req-0057d2e2-0b6a-40cd-b696-27528638471f service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:31.489167 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-9fd736af-55d1-4025-9735-8de04e496f67 req-0057d2e2-0b6a-40cd-b696-27528638471f service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:31.489587 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-9fd736af-55d1-4025-9735-8de04e496f67 req-0057d2e2-0b6a-40cd-b696-27528638471f service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:31.501286 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-9fd736af-55d1-4025-9735-8de04e496f67 req-0057d2e2-0b6a-40cd-b696-27528638471f service nova] Creating event network-vif-deleted:5ff33f5b-b6c7-4baf-bb26-642d5707201e for instance ddfa06a9-0e17-4fb8-92ca-715b8aa80b00 on n-h1-852278-4 Aug 27 03:16:31.506603 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-9fd736af-55d1-4025-9735-8de04e496f67 req-0057d2e2-0b6a-40cd-b696-27528638471f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032529 Aug 27 03:16:31.507417 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2772/5584] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:16:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:16:31.768575 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-63592f9d-0d96-428a-bb7a-4fdecb75e09b tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:31.770096 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-63592f9d-0d96-428a-bb7a-4fdecb75e09b tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] [instance: 0b7bdf3f-0f3f-4c1b-9a5b-c43cc7df7420] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:31.774955 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-859fcb02-dd2f-4bfa-baf3-d865261fc80f tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:31.775804 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-859fcb02-dd2f-4bfa-baf3-d865261fc80f tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] [instance: ddfa06a9-0e17-4fb8-92ca-715b8aa80b00] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:31.777702 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-63592f9d-0d96-428a-bb7a-4fdecb75e09b tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:31.778203 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-63592f9d-0d96-428a-bb7a-4fdecb75e09b tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:31.778655 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-63592f9d-0d96-428a-bb7a-4fdecb75e09b tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:31.779395 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-63592f9d-0d96-428a-bb7a-4fdecb75e09b tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:31.780037 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-63592f9d-0d96-428a-bb7a-4fdecb75e09b tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:31.780702 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-63592f9d-0d96-428a-bb7a-4fdecb75e09b tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:31.783477 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-859fcb02-dd2f-4bfa-baf3-d865261fc80f tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:31.784192 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-859fcb02-dd2f-4bfa-baf3-d865261fc80f tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:31.784669 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-859fcb02-dd2f-4bfa-baf3-d865261fc80f tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:31.785512 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-859fcb02-dd2f-4bfa-baf3-d865261fc80f tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:31.785891 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-859fcb02-dd2f-4bfa-baf3-d865261fc80f tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:31.786314 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-859fcb02-dd2f-4bfa-baf3-d865261fc80f tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:31.821778 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-859fcb02-dd2f-4bfa-baf3-d865261fc80f tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:31.822263 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-859fcb02-dd2f-4bfa-baf3-d865261fc80f tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:31.822727 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-859fcb02-dd2f-4bfa-baf3-d865261fc80f tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:31.823178 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.instance [None req-859fcb02-dd2f-4bfa-baf3-d865261fc80f tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lazy-loading 'fault' on Instance uuid ddfa06a9-0e17-4fb8-92ca-715b8aa80b00 {{(pid=134052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:16:31.901721 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-859fcb02-dd2f-4bfa-baf3-d865261fc80f tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c678da620f546d2a0f91a81bcbfc0ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8743b5e17a4a5e9d378ba9bd0d0bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:31.910243 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-859fcb02-dd2f-4bfa-baf3-d865261fc80f tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] 10.222.0.70 "GET /compute/v2.1/servers/ddfa06a9-0e17-4fb8-92ca-715b8aa80b00" status: 200 len: 1304 microversion: 2.1 time: 0.139644 Aug 27 03:16:31.910992 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2773/5585] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:31 2022] GET /compute/v2.1/servers/ddfa06a9-0e17-4fb8-92ca-715b8aa80b00 => generated 1304 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:32.070249 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-63592f9d-0d96-428a-bb7a-4fdecb75e09b tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab36c57cb91a48d4b9f5500fb46f43ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b6250339865435391ef90912db5f0c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:32.078890 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-63592f9d-0d96-428a-bb7a-4fdecb75e09b tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] 10.222.0.70 "GET /compute/v2.1/servers/0b7bdf3f-0f3f-4c1b-9a5b-c43cc7df7420" status: 200 len: 1313 microversion: 2.1 time: 0.314299 Aug 27 03:16:32.079451 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2813/5586] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:31 2022] GET /compute/v2.1/servers/0b7bdf3f-0f3f-4c1b-9a5b-c43cc7df7420 => generated 1313 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:32.505663 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-73bb018c-3f98-47d8-add4-54006f0673ec req-911ce319-0b7a-4f67-93cc-229892443a23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b7bdf3f-0f3f-4c1b-9a5b-c43cc7df7420", "name": "network-vif-plugged", "status": "completed", "tag": "50207fcd-ebfe-4bcf-9b4c-d06fa9db0693"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:16:32.518737 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-73bb018c-3f98-47d8-add4-54006f0673ec req-911ce319-0b7a-4f67-93cc-229892443a23 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:32.519224 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-73bb018c-3f98-47d8-add4-54006f0673ec req-911ce319-0b7a-4f67-93cc-229892443a23 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:32.519657 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-73bb018c-3f98-47d8-add4-54006f0673ec req-911ce319-0b7a-4f67-93cc-229892443a23 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:32.532726 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-73bb018c-3f98-47d8-add4-54006f0673ec req-911ce319-0b7a-4f67-93cc-229892443a23 service nova] Creating event network-vif-plugged:50207fcd-ebfe-4bcf-9b4c-d06fa9db0693 for instance 0b7bdf3f-0f3f-4c1b-9a5b-c43cc7df7420 on n-h2-852278-4 Aug 27 03:16:32.538314 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-73bb018c-3f98-47d8-add4-54006f0673ec req-911ce319-0b7a-4f67-93cc-229892443a23 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113652 Aug 27 03:16:32.538615 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2774/5587] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:16:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:16:32.931417 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-6a526029-a6b9-4166-820d-0a6b74903b87 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:32.932029 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-6a526029-a6b9-4166-820d-0a6b74903b87 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] [instance: ddfa06a9-0e17-4fb8-92ca-715b8aa80b00] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:32.939682 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6a526029-a6b9-4166-820d-0a6b74903b87 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:32.940172 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6a526029-a6b9-4166-820d-0a6b74903b87 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:32.940614 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6a526029-a6b9-4166-820d-0a6b74903b87 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:32.941342 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6a526029-a6b9-4166-820d-0a6b74903b87 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:32.941863 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6a526029-a6b9-4166-820d-0a6b74903b87 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:32.942227 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6a526029-a6b9-4166-820d-0a6b74903b87 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:32.957157 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-6a526029-a6b9-4166-820d-0a6b74903b87 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] HTTP exception thrown: Instance ddfa06a9-0e17-4fb8-92ca-715b8aa80b00 could not be found. Aug 27 03:16:32.958966 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-6a526029-a6b9-4166-820d-0a6b74903b87 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Request method failure captured: Aug 27 03:16:32.958966 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/ddfa06a9-0e17-4fb8-92ca-715b8aa80b00 HTTP/1.1 Aug 27 03:16:32.958966 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 03:16:32.958966 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 03:16:32.958966 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 03:16:32.958966 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 03:16:32.958966 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 03:16:32.958966 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 03:16:32.958966 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 03:16:32.958966 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 03:16:32.958966 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYxyIJPX1zr6L_-LY9CamHKjJqYONYAefnkDQQ8Qwbn1D0kU8AFK6CUu1TW5Qc9-uw6lBf_s2VhtYtAyeYKwRCUkN04bjy02eX02BpHPyvKs4OealiwjixssVqKseHMoMgPUuzIkoQ-nOdpEbpZtSDAQrW2cNe4MbruUn7cuVgxgNts Aug 27 03:16:32.958966 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 03:16:32.958966 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 03:16:32.958966 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 03:16:32.958966 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 03:16:32.958966 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 03:16:32.958966 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 03:16:32.958966 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: aa8743b5e17a4a5e9d378ba9bd0d0bd4 Aug 27 03:16:32.958966 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-TestServerAdvancedOps-530183709 Aug 27 03:16:32.958966 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 03:16:32.958966 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 03:16:32.958966 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/aa8743b5e17a4a5e9d378ba9bd0d0bd4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_aa8743b5e17a4a5e9d378ba9bd0d0bd4", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/aa8743b5e17a4a5e9d378ba9bd0d0bd4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/aa8743b5e17a4a5e9d378ba9bd0d0bd4"}]}] Aug 27 03:16:32.958966 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-TestServerAdvancedOps-530183709 Aug 27 03:16:32.958966 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: aa8743b5e17a4a5e9d378ba9bd0d0bd4 Aug 27 03:16:32.958966 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-TestServerAdvancedOps-530183709 Aug 27 03:16:32.958966 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-TestServerAdvancedOps-530183709-project Aug 27 03:16:32.958966 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 03:16:32.958966 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 03:16:32.958966 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 9c678da620f546d2a0f91a81bcbfc0ec Aug 27 03:16:32.958966 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-TestServerAdvancedOps-530183709-project Aug 27 03:16:32.958966 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 03:16:32.958966 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance ddfa06a9-0e17-4fb8-92ca-715b8aa80b00 could not be found. Aug 27 03:16:32.958966 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': 'ddfa06a9-0e17-4fb8-92ca-715b8aa80b00'} Aug 27 03:16:32.958966 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:16:32.958966 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:16:32.958966 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:16:32.958966 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:16:32.958966 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:16:32.958966 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:16:32.958966 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:16:32.958966 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:16:32.958966 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:16:32.958966 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:16:32.958966 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ddfa06a9-0e17-4fb8-92ca-715b8aa80b00 could not be found. Aug 27 03:16:32.958966 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:16:32.958966 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:16:32.958966 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:16:32.958966 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:16:32.958966 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:16:32.958966 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:16:32.958966 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:16:32.958966 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:16:32.958966 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:16:32.958966 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:16:32.958966 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:16:32.958966 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:16:32.958966 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:16:32.958966 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:16:32.958966 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:16:32.958966 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:16:32.958966 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ddfa06a9-0e17-4fb8-92ca-715b8aa80b00 could not be found. Aug 27 03:16:32.958966 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:16:32.958966 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:16:32.958966 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:16:32.963334 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:16:32.963334 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:16:32.963334 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:16:32.963334 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:16:32.963334 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:16:32.963334 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ddfa06a9-0e17-4fb8-92ca-715b8aa80b00 could not be found. Aug 27 03:16:32.963334 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:16:32.963334 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-6a526029-a6b9-4166-820d-0a6b74903b87 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] Returning 404 to user: Instance ddfa06a9-0e17-4fb8-92ca-715b8aa80b00 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:16:32.963334 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-6a526029-a6b9-4166-820d-0a6b74903b87 tempest-TestServerAdvancedOps-530183709 tempest-TestServerAdvancedOps-530183709-project] 10.222.0.70 "GET /compute/v2.1/servers/ddfa06a9-0e17-4fb8-92ca-715b8aa80b00" status: 404 len: 111 microversion: 2.1 time: 0.033040 Aug 27 03:16:32.963334 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2814/5588] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:32 2022] GET /compute/v2.1/servers/ddfa06a9-0e17-4fb8-92ca-715b8aa80b00 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:16:33.100355 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-200c453e-d05a-481f-8f1c-e35ea2678083 tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:33.101555 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-200c453e-d05a-481f-8f1c-e35ea2678083 tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] [instance: 0b7bdf3f-0f3f-4c1b-9a5b-c43cc7df7420] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:33.109579 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-200c453e-d05a-481f-8f1c-e35ea2678083 tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:33.110401 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-200c453e-d05a-481f-8f1c-e35ea2678083 tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:33.111356 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-200c453e-d05a-481f-8f1c-e35ea2678083 tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:33.112229 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-200c453e-d05a-481f-8f1c-e35ea2678083 tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:33.112989 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-200c453e-d05a-481f-8f1c-e35ea2678083 tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:33.113564 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-200c453e-d05a-481f-8f1c-e35ea2678083 tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:33.316077 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-200c453e-d05a-481f-8f1c-e35ea2678083 tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab36c57cb91a48d4b9f5500fb46f43ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b6250339865435391ef90912db5f0c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:33.325610 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-200c453e-d05a-481f-8f1c-e35ea2678083 tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] 10.222.0.70 "GET /compute/v2.1/servers/0b7bdf3f-0f3f-4c1b-9a5b-c43cc7df7420" status: 200 len: 1313 microversion: 2.1 time: 0.230148 Aug 27 03:16:33.326412 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2775/5589] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:33 2022] GET /compute/v2.1/servers/0b7bdf3f-0f3f-4c1b-9a5b-c43cc7df7420 => generated 1313 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:34.359367 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-6d6845d5-9382-429b-b428-0014824a8420 tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:34.360718 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-6d6845d5-9382-429b-b428-0014824a8420 tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] [instance: 0b7bdf3f-0f3f-4c1b-9a5b-c43cc7df7420] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:34.375833 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6d6845d5-9382-429b-b428-0014824a8420 tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:34.378885 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6d6845d5-9382-429b-b428-0014824a8420 tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:34.379471 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6d6845d5-9382-429b-b428-0014824a8420 tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:34.380303 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6d6845d5-9382-429b-b428-0014824a8420 tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:34.381023 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6d6845d5-9382-429b-b428-0014824a8420 tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:34.381660 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6d6845d5-9382-429b-b428-0014824a8420 tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:34.648473 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-6d6845d5-9382-429b-b428-0014824a8420 tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab36c57cb91a48d4b9f5500fb46f43ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b6250339865435391ef90912db5f0c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:34.656814 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-6d6845d5-9382-429b-b428-0014824a8420 tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] 10.222.0.70 "GET /compute/v2.1/servers/0b7bdf3f-0f3f-4c1b-9a5b-c43cc7df7420" status: 200 len: 1463 microversion: 2.1 time: 0.313542 Aug 27 03:16:34.657564 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2815/5590] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:34 2022] GET /compute/v2.1/servers/0b7bdf3f-0f3f-4c1b-9a5b-c43cc7df7420 => generated 1463 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:34.678985 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-00588639-9f8c-4b1e-9f2b-05db0c76d378 tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d9e54a7e-ce8e-4be3-ab70-d096758c87b1", "device": "/dev/sdb"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:16:34.681501 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-00588639-9f8c-4b1e-9f2b-05db0c76d378 tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] [instance: 0b7bdf3f-0f3f-4c1b-9a5b-c43cc7df7420] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:34.692118 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-00588639-9f8c-4b1e-9f2b-05db0c76d378 tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:34.692823 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-00588639-9f8c-4b1e-9f2b-05db0c76d378 tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:34.693421 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-00588639-9f8c-4b1e-9f2b-05db0c76d378 tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:34.694304 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-00588639-9f8c-4b1e-9f2b-05db0c76d378 tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:34.694900 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-00588639-9f8c-4b1e-9f2b-05db0c76d378 tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:34.695496 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-00588639-9f8c-4b1e-9f2b-05db0c76d378 tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:35.050733 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-00588639-9f8c-4b1e-9f2b-05db0c76d378 tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] 10.222.0.70 "POST /compute/v2.1/servers/0b7bdf3f-0f3f-4c1b-9a5b-c43cc7df7420/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.375478 Aug 27 03:16:35.051449 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2776/5591] 10.222.0.70 () {60 vars in 1323 bytes} [Sat Aug 27 03:16:34 2022] POST /compute/v2.1/servers/0b7bdf3f-0f3f-4c1b-9a5b-c43cc7df7420/os-volume_attachments => generated 194 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:16:52.455242 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ba60df7d-d5fe-404a-83dc-20320714be85 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-401497865", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "54daeea4-007e-48ed-bc85-012cfa8d0b6d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "02524c0f-c44c-4ea0-899e-226a790199dc"}]}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:16:52.480844 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:16:52.485493 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:16:52.486819 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:16:52.610638 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.network.neutron [None req-ba60df7d-d5fe-404a-83dc-20320714be85 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] validate_networks() for [('02524c0f-c44c-4ea0-899e-226a790199dc', None, None, None, None, None)] {{(pid=134051) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:16:53.195526 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-ba60df7d-d5fe-404a-83dc-20320714be85 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Flavor limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:16:53.195909 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-ba60df7d-d5fe-404a-83dc-20320714be85 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Image limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:16:53.196405 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-ba60df7d-d5fe-404a-83dc-20320714be85 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Flavor pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:16:53.196814 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-ba60df7d-d5fe-404a-83dc-20320714be85 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Image pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:16:53.197591 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-ba60df7d-d5fe-404a-83dc-20320714be85 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:16:53.208736 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ba60df7d-d5fe-404a-83dc-20320714be85 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:53.209269 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ba60df7d-d5fe-404a-83dc-20320714be85 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:53.209711 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ba60df7d-d5fe-404a-83dc-20320714be85 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:53.210450 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ba60df7d-d5fe-404a-83dc-20320714be85 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:53.211183 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ba60df7d-d5fe-404a-83dc-20320714be85 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:53.211612 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ba60df7d-d5fe-404a-83dc-20320714be85 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:53.234762 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-ba60df7d-d5fe-404a-83dc-20320714be85 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Getting quotas for project 7b2673a034c24d1898493bfea9ca5d1d. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:16:53.242291 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-ba60df7d-d5fe-404a-83dc-20320714be85 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Getting quotas for user 4aa867d7baa043b1b1e6763046463b3f and project 7b2673a034c24d1898493bfea9ca5d1d. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:16:53.331727 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-ba60df7d-d5fe-404a-83dc-20320714be85 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Going to run 1 instances... {{(pid=134051) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:16:53.334070 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-ba60df7d-d5fe-404a-83dc-20320714be85 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 24bc4434-d4e0-4a90-a669-a74cbfc3c08d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='54daeea4-007e-48ed-bc85-012cfa8d0b6d',volume_size=None,volume_type=None)] {{(pid=134051) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:16:53.556108 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ba60df7d-d5fe-404a-83dc-20320714be85 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.105454 Aug 27 03:16:53.558172 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2816/5592] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 03:16:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1109 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:16:53.569136 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:16:53.571135 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=6 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:16:53.574464 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=6 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:16:53.575206 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:16:53.585963 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0d119c44-82db-4501-af82-4d1e72dc4e83 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:53.586967 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-0d119c44-82db-4501-af82-4d1e72dc4e83 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 24bc4434-d4e0-4a90-a669-a74cbfc3c08d] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:53.672498 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0d119c44-82db-4501-af82-4d1e72dc4e83 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:53.680099 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-0d119c44-82db-4501-af82-4d1e72dc4e83 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/24bc4434-d4e0-4a90-a669-a74cbfc3c08d" status: 200 len: 1056 microversion: 2.1 time: 0.113652 Aug 27 03:16:53.694942 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2777/5593] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:53 2022] GET /compute/v2.1/servers/24bc4434-d4e0-4a90-a669-a74cbfc3c08d => generated 1056 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:54.708458 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-36f6792c-cffe-4a21-b9d6-59a8e4f4c482 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:54.714342 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-36f6792c-cffe-4a21-b9d6-59a8e4f4c482 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 24bc4434-d4e0-4a90-a669-a74cbfc3c08d] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:54.722050 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-36f6792c-cffe-4a21-b9d6-59a8e4f4c482 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:54.722735 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-36f6792c-cffe-4a21-b9d6-59a8e4f4c482 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:54.723337 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-36f6792c-cffe-4a21-b9d6-59a8e4f4c482 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:54.724924 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-36f6792c-cffe-4a21-b9d6-59a8e4f4c482 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:54.725337 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-36f6792c-cffe-4a21-b9d6-59a8e4f4c482 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:54.725912 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-36f6792c-cffe-4a21-b9d6-59a8e4f4c482 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:54.873291 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-36f6792c-cffe-4a21-b9d6-59a8e4f4c482 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:54.883448 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-36f6792c-cffe-4a21-b9d6-59a8e4f4c482 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/24bc4434-d4e0-4a90-a669-a74cbfc3c08d" status: 200 len: 1154 microversion: 2.1 time: 0.183387 Aug 27 03:16:54.884477 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2817/5594] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:54 2022] GET /compute/v2.1/servers/24bc4434-d4e0-4a90-a669-a74cbfc3c08d => generated 1154 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:55.906248 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-45569b7e-1d64-4bb2-8ea4-90fae8708449 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:55.907471 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-45569b7e-1d64-4bb2-8ea4-90fae8708449 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 24bc4434-d4e0-4a90-a669-a74cbfc3c08d] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:55.926666 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-45569b7e-1d64-4bb2-8ea4-90fae8708449 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:55.933141 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-45569b7e-1d64-4bb2-8ea4-90fae8708449 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:55.933853 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-45569b7e-1d64-4bb2-8ea4-90fae8708449 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:55.934783 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-45569b7e-1d64-4bb2-8ea4-90fae8708449 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:55.935406 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-45569b7e-1d64-4bb2-8ea4-90fae8708449 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:55.935984 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-45569b7e-1d64-4bb2-8ea4-90fae8708449 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:56.345532 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-45569b7e-1d64-4bb2-8ea4-90fae8708449 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:56.355286 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-45569b7e-1d64-4bb2-8ea4-90fae8708449 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/24bc4434-d4e0-4a90-a669-a74cbfc3c08d" status: 200 len: 1214 microversion: 2.1 time: 0.453300 Aug 27 03:16:56.369259 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2778/5595] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:55 2022] GET /compute/v2.1/servers/24bc4434-d4e0-4a90-a669-a74cbfc3c08d => generated 1214 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:57.121881 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-990f7daa-28b7-4089-9751-0028afece6a3 req-aa409d26-d4fb-4e60-861a-e53d7b5d427a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24bc4434-d4e0-4a90-a669-a74cbfc3c08d", "tag": "9e367c25-072b-4e9f-8d97-10daf30aae78"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:16:57.147915 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-990f7daa-28b7-4089-9751-0028afece6a3 req-aa409d26-d4fb-4e60-861a-e53d7b5d427a service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:57.148444 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-990f7daa-28b7-4089-9751-0028afece6a3 req-aa409d26-d4fb-4e60-861a-e53d7b5d427a service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:57.148884 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-990f7daa-28b7-4089-9751-0028afece6a3 req-aa409d26-d4fb-4e60-861a-e53d7b5d427a service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:57.168004 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-990f7daa-28b7-4089-9751-0028afece6a3 req-aa409d26-d4fb-4e60-861a-e53d7b5d427a service nova] Creating event network-changed:9e367c25-072b-4e9f-8d97-10daf30aae78 for instance 24bc4434-d4e0-4a90-a669-a74cbfc3c08d on n-h1-852278-4 Aug 27 03:16:57.172987 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-990f7daa-28b7-4089-9751-0028afece6a3 req-aa409d26-d4fb-4e60-861a-e53d7b5d427a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061890 Aug 27 03:16:57.173607 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2818/5596] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:16:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:16:57.391651 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-7bcace06-2b25-448a-b4c2-6637f2f28e22 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:57.394366 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-7bcace06-2b25-448a-b4c2-6637f2f28e22 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 24bc4434-d4e0-4a90-a669-a74cbfc3c08d] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:57.404891 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7bcace06-2b25-448a-b4c2-6637f2f28e22 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:57.405634 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7bcace06-2b25-448a-b4c2-6637f2f28e22 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:57.406375 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7bcace06-2b25-448a-b4c2-6637f2f28e22 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:57.410540 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7bcace06-2b25-448a-b4c2-6637f2f28e22 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:57.413714 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7bcace06-2b25-448a-b4c2-6637f2f28e22 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:57.414349 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7bcace06-2b25-448a-b4c2-6637f2f28e22 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:57.643487 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-7bcace06-2b25-448a-b4c2-6637f2f28e22 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:57.662158 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-7bcace06-2b25-448a-b4c2-6637f2f28e22 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/24bc4434-d4e0-4a90-a669-a74cbfc3c08d" status: 200 len: 1214 microversion: 2.1 time: 0.284984 Aug 27 03:16:57.663326 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2779/5597] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:57 2022] GET /compute/v2.1/servers/24bc4434-d4e0-4a90-a669-a74cbfc3c08d => generated 1214 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:58.684600 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0180320e-41bf-40fd-b901-8323e1953970 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:58.686020 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-0180320e-41bf-40fd-b901-8323e1953970 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 24bc4434-d4e0-4a90-a669-a74cbfc3c08d] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:58.701657 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0180320e-41bf-40fd-b901-8323e1953970 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:58.702408 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0180320e-41bf-40fd-b901-8323e1953970 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:58.702994 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0180320e-41bf-40fd-b901-8323e1953970 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:58.703860 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0180320e-41bf-40fd-b901-8323e1953970 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:58.704485 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0180320e-41bf-40fd-b901-8323e1953970 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:58.705071 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0180320e-41bf-40fd-b901-8323e1953970 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:58.956755 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-0180320e-41bf-40fd-b901-8323e1953970 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:58.965947 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-0180320e-41bf-40fd-b901-8323e1953970 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/24bc4434-d4e0-4a90-a669-a74cbfc3c08d" status: 200 len: 1214 microversion: 2.1 time: 0.286447 Aug 27 03:16:58.979750 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2819/5598] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:58 2022] GET /compute/v2.1/servers/24bc4434-d4e0-4a90-a669-a74cbfc3c08d => generated 1214 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:59.987047 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d6257591-2e82-4c5b-8d77-9f697ebeb04f tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:59.988438 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d6257591-2e82-4c5b-8d77-9f697ebeb04f tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 24bc4434-d4e0-4a90-a669-a74cbfc3c08d] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:59.999394 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d6257591-2e82-4c5b-8d77-9f697ebeb04f tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:00.000877 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d6257591-2e82-4c5b-8d77-9f697ebeb04f tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:00.001332 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d6257591-2e82-4c5b-8d77-9f697ebeb04f tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:00.002061 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d6257591-2e82-4c5b-8d77-9f697ebeb04f tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:00.002512 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d6257591-2e82-4c5b-8d77-9f697ebeb04f tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:00.003000 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d6257591-2e82-4c5b-8d77-9f697ebeb04f tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:00.368559 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-d6257591-2e82-4c5b-8d77-9f697ebeb04f tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:00.380248 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d6257591-2e82-4c5b-8d77-9f697ebeb04f tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/24bc4434-d4e0-4a90-a669-a74cbfc3c08d" status: 200 len: 1214 microversion: 2.1 time: 0.396180 Aug 27 03:17:00.393673 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2780/5599] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:59 2022] GET /compute/v2.1/servers/24bc4434-d4e0-4a90-a669-a74cbfc3c08d => generated 1214 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:01.404705 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c7e3ba25-850c-4c15-a0f4-681f1251340f tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:01.406877 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-c7e3ba25-850c-4c15-a0f4-681f1251340f tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 24bc4434-d4e0-4a90-a669-a74cbfc3c08d] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:01.415212 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c7e3ba25-850c-4c15-a0f4-681f1251340f tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:01.415902 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c7e3ba25-850c-4c15-a0f4-681f1251340f tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:01.416550 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c7e3ba25-850c-4c15-a0f4-681f1251340f tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:01.417572 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c7e3ba25-850c-4c15-a0f4-681f1251340f tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:01.418191 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c7e3ba25-850c-4c15-a0f4-681f1251340f tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:01.420757 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c7e3ba25-850c-4c15-a0f4-681f1251340f tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:01.644812 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-c7e3ba25-850c-4c15-a0f4-681f1251340f tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:01.654296 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c7e3ba25-850c-4c15-a0f4-681f1251340f tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/24bc4434-d4e0-4a90-a669-a74cbfc3c08d" status: 200 len: 1202 microversion: 2.1 time: 0.254796 Aug 27 03:17:01.655456 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2820/5600] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:01 2022] GET /compute/v2.1/servers/24bc4434-d4e0-4a90-a669-a74cbfc3c08d => generated 1202 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:02.676401 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f3c9c2e2-e3c1-4e89-a618-6945ffb3752b tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:02.677152 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-f3c9c2e2-e3c1-4e89-a618-6945ffb3752b tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 24bc4434-d4e0-4a90-a669-a74cbfc3c08d] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:02.685428 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f3c9c2e2-e3c1-4e89-a618-6945ffb3752b tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:02.685970 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f3c9c2e2-e3c1-4e89-a618-6945ffb3752b tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:02.686735 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f3c9c2e2-e3c1-4e89-a618-6945ffb3752b tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:02.687745 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f3c9c2e2-e3c1-4e89-a618-6945ffb3752b tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:02.688289 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f3c9c2e2-e3c1-4e89-a618-6945ffb3752b tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:02.689103 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f3c9c2e2-e3c1-4e89-a618-6945ffb3752b tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:02.870138 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-f3c9c2e2-e3c1-4e89-a618-6945ffb3752b tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:02.878668 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f3c9c2e2-e3c1-4e89-a618-6945ffb3752b tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/24bc4434-d4e0-4a90-a669-a74cbfc3c08d" status: 200 len: 1202 microversion: 2.1 time: 0.207093 Aug 27 03:17:02.893694 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2781/5601] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:02 2022] GET /compute/v2.1/servers/24bc4434-d4e0-4a90-a669-a74cbfc3c08d => generated 1202 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:03.899341 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4f032842-956d-4870-a455-f1c6e9529e4c tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:03.899956 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-4f032842-956d-4870-a455-f1c6e9529e4c tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 24bc4434-d4e0-4a90-a669-a74cbfc3c08d] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:03.902805 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:17:03.903724 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=6 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:17:03.909769 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4f032842-956d-4870-a455-f1c6e9529e4c tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:03.910366 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4f032842-956d-4870-a455-f1c6e9529e4c tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:03.910803 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4f032842-956d-4870-a455-f1c6e9529e4c tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:03.911719 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4f032842-956d-4870-a455-f1c6e9529e4c tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:03.912183 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4f032842-956d-4870-a455-f1c6e9529e4c tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:03.912647 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4f032842-956d-4870-a455-f1c6e9529e4c tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:04.060890 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-4f032842-956d-4870-a455-f1c6e9529e4c tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:04.073552 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-4f032842-956d-4870-a455-f1c6e9529e4c tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/24bc4434-d4e0-4a90-a669-a74cbfc3c08d" status: 200 len: 1202 microversion: 2.1 time: 0.178147 Aug 27 03:17:04.093336 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2821/5602] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:03 2022] GET /compute/v2.1/servers/24bc4434-d4e0-4a90-a669-a74cbfc3c08d => generated 1202 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:05.096481 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9b0aa5f7-df98-4a9b-971f-67ebea74fccf tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:05.097662 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-9b0aa5f7-df98-4a9b-971f-67ebea74fccf tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 24bc4434-d4e0-4a90-a669-a74cbfc3c08d] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:05.099750 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:17:05.106062 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9b0aa5f7-df98-4a9b-971f-67ebea74fccf tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:05.106858 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9b0aa5f7-df98-4a9b-971f-67ebea74fccf tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:05.107439 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9b0aa5f7-df98-4a9b-971f-67ebea74fccf tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:05.108293 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9b0aa5f7-df98-4a9b-971f-67ebea74fccf tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:05.108915 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9b0aa5f7-df98-4a9b-971f-67ebea74fccf tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:05.109481 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9b0aa5f7-df98-4a9b-971f-67ebea74fccf tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:05.426028 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-9b0aa5f7-df98-4a9b-971f-67ebea74fccf tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:05.443043 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9b0aa5f7-df98-4a9b-971f-67ebea74fccf tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/24bc4434-d4e0-4a90-a669-a74cbfc3c08d" status: 200 len: 1202 microversion: 2.1 time: 0.347956 Aug 27 03:17:05.454143 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2782/5603] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:05 2022] GET /compute/v2.1/servers/24bc4434-d4e0-4a90-a669-a74cbfc3c08d => generated 1202 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:06.462386 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3304ce36-8a63-43bf-a9ad-ba1fdc0162c5 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:06.463133 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-3304ce36-8a63-43bf-a9ad-ba1fdc0162c5 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 24bc4434-d4e0-4a90-a669-a74cbfc3c08d] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:06.473533 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3304ce36-8a63-43bf-a9ad-ba1fdc0162c5 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:06.475151 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3304ce36-8a63-43bf-a9ad-ba1fdc0162c5 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:06.475956 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3304ce36-8a63-43bf-a9ad-ba1fdc0162c5 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:06.476976 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3304ce36-8a63-43bf-a9ad-ba1fdc0162c5 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:06.477558 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3304ce36-8a63-43bf-a9ad-ba1fdc0162c5 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:06.478095 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3304ce36-8a63-43bf-a9ad-ba1fdc0162c5 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:06.755385 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-3304ce36-8a63-43bf-a9ad-ba1fdc0162c5 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:06.770303 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-3304ce36-8a63-43bf-a9ad-ba1fdc0162c5 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/24bc4434-d4e0-4a90-a669-a74cbfc3c08d" status: 200 len: 1202 microversion: 2.1 time: 0.312728 Aug 27 03:17:06.780569 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2822/5604] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:06 2022] GET /compute/v2.1/servers/24bc4434-d4e0-4a90-a669-a74cbfc3c08d => generated 1202 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:17:07.792785 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-71b814e4-32d3-433a-9dde-193bf699f6cd tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:07.793971 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-71b814e4-32d3-433a-9dde-193bf699f6cd tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 24bc4434-d4e0-4a90-a669-a74cbfc3c08d] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:07.803010 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-71b814e4-32d3-433a-9dde-193bf699f6cd tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:07.803729 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-71b814e4-32d3-433a-9dde-193bf699f6cd tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:07.804839 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-71b814e4-32d3-433a-9dde-193bf699f6cd tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:07.807990 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-71b814e4-32d3-433a-9dde-193bf699f6cd tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:07.808783 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-71b814e4-32d3-433a-9dde-193bf699f6cd tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:07.809373 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-71b814e4-32d3-433a-9dde-193bf699f6cd tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:07.940940 n-d-852278-4 devstack@n-api.service[134052]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:17:07.941358 n-d-852278-4 devstack@n-api.service[134052]: Sat Aug 27 03:17:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/24bc4434-d4e0-4a90-a669-a74cbfc3c08d (ip 10.222.0.70) !!! Aug 27 03:17:08.066494 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-71b814e4-32d3-433a-9dde-193bf699f6cd tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:08.081871 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-71b814e4-32d3-433a-9dde-193bf699f6cd tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/24bc4434-d4e0-4a90-a669-a74cbfc3c08d" status: 200 len: 1202 microversion: 2.1 time: 0.292676 Aug 27 03:17:08.084073 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2783/5605] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:07 2022] GET /compute/v2.1/servers/24bc4434-d4e0-4a90-a669-a74cbfc3c08d => generated 1202 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:09.103257 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b0f5f9a7-9ba4-4bd3-9685-3fca39b9fa35 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:09.103870 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b0f5f9a7-9ba4-4bd3-9685-3fca39b9fa35 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 24bc4434-d4e0-4a90-a669-a74cbfc3c08d] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:09.116633 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b0f5f9a7-9ba4-4bd3-9685-3fca39b9fa35 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:09.117225 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b0f5f9a7-9ba4-4bd3-9685-3fca39b9fa35 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:09.118423 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b0f5f9a7-9ba4-4bd3-9685-3fca39b9fa35 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:09.121413 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b0f5f9a7-9ba4-4bd3-9685-3fca39b9fa35 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:09.122208 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b0f5f9a7-9ba4-4bd3-9685-3fca39b9fa35 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:09.122832 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b0f5f9a7-9ba4-4bd3-9685-3fca39b9fa35 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:09.330129 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-b0f5f9a7-9ba4-4bd3-9685-3fca39b9fa35 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:09.345557 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b0f5f9a7-9ba4-4bd3-9685-3fca39b9fa35 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/24bc4434-d4e0-4a90-a669-a74cbfc3c08d" status: 200 len: 1202 microversion: 2.1 time: 0.246487 Aug 27 03:17:09.348832 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2823/5606] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:09 2022] GET /compute/v2.1/servers/24bc4434-d4e0-4a90-a669-a74cbfc3c08d => generated 1202 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:10.367087 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-310ece96-e359-4a84-a612-0026bdbc8b8a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:10.368369 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-310ece96-e359-4a84-a612-0026bdbc8b8a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 24bc4434-d4e0-4a90-a669-a74cbfc3c08d] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:10.385863 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-310ece96-e359-4a84-a612-0026bdbc8b8a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:10.386685 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-310ece96-e359-4a84-a612-0026bdbc8b8a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:10.389047 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-310ece96-e359-4a84-a612-0026bdbc8b8a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:10.389969 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-310ece96-e359-4a84-a612-0026bdbc8b8a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:10.391339 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-310ece96-e359-4a84-a612-0026bdbc8b8a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:10.392376 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-310ece96-e359-4a84-a612-0026bdbc8b8a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:10.667239 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-310ece96-e359-4a84-a612-0026bdbc8b8a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:10.679687 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-310ece96-e359-4a84-a612-0026bdbc8b8a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/24bc4434-d4e0-4a90-a669-a74cbfc3c08d" status: 200 len: 1202 microversion: 2.1 time: 0.317529 Aug 27 03:17:10.697644 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2784/5607] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:10 2022] GET /compute/v2.1/servers/24bc4434-d4e0-4a90-a669-a74cbfc3c08d => generated 1202 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:10.979539 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-a05ab941-f1e2-4d81-91c5-b234d56210ec req-0afbdb24-32fa-476c-b814-e91344912caa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24bc4434-d4e0-4a90-a669-a74cbfc3c08d", "name": "network-vif-plugged", "status": "completed", "tag": "9e367c25-072b-4e9f-8d97-10daf30aae78"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:17:11.006474 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-a05ab941-f1e2-4d81-91c5-b234d56210ec req-0afbdb24-32fa-476c-b814-e91344912caa service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:11.007168 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-a05ab941-f1e2-4d81-91c5-b234d56210ec req-0afbdb24-32fa-476c-b814-e91344912caa service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:11.008388 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-a05ab941-f1e2-4d81-91c5-b234d56210ec req-0afbdb24-32fa-476c-b814-e91344912caa service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:11.028387 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-a05ab941-f1e2-4d81-91c5-b234d56210ec req-0afbdb24-32fa-476c-b814-e91344912caa service nova] Creating event network-vif-plugged:9e367c25-072b-4e9f-8d97-10daf30aae78 for instance 24bc4434-d4e0-4a90-a669-a74cbfc3c08d on n-h1-852278-4 Aug 27 03:17:11.039761 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-a05ab941-f1e2-4d81-91c5-b234d56210ec req-0afbdb24-32fa-476c-b814-e91344912caa service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064923 Aug 27 03:17:11.040700 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2824/5608] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:17:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:17:11.703039 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c7d83e31-dc47-47d7-bd44-22d65de78b8d tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:11.703754 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-c7d83e31-dc47-47d7-bd44-22d65de78b8d tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 24bc4434-d4e0-4a90-a669-a74cbfc3c08d] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:11.711867 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c7d83e31-dc47-47d7-bd44-22d65de78b8d tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:11.713022 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c7d83e31-dc47-47d7-bd44-22d65de78b8d tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:11.713472 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c7d83e31-dc47-47d7-bd44-22d65de78b8d tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:11.714536 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c7d83e31-dc47-47d7-bd44-22d65de78b8d tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:11.715025 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c7d83e31-dc47-47d7-bd44-22d65de78b8d tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:11.715415 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c7d83e31-dc47-47d7-bd44-22d65de78b8d tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:11.863694 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-c7d83e31-dc47-47d7-bd44-22d65de78b8d tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:11.871883 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c7d83e31-dc47-47d7-bd44-22d65de78b8d tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/24bc4434-d4e0-4a90-a669-a74cbfc3c08d" status: 200 len: 1202 microversion: 2.1 time: 0.173225 Aug 27 03:17:11.872516 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2785/5609] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:11 2022] GET /compute/v2.1/servers/24bc4434-d4e0-4a90-a669-a74cbfc3c08d => generated 1202 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:12.894417 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0455f657-5d6f-455d-9ae5-44bbef80010d tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:12.896124 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-0455f657-5d6f-455d-9ae5-44bbef80010d tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 24bc4434-d4e0-4a90-a669-a74cbfc3c08d] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:12.902083 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0455f657-5d6f-455d-9ae5-44bbef80010d tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:12.902890 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0455f657-5d6f-455d-9ae5-44bbef80010d tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:12.903542 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0455f657-5d6f-455d-9ae5-44bbef80010d tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:12.904680 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0455f657-5d6f-455d-9ae5-44bbef80010d tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:12.905309 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0455f657-5d6f-455d-9ae5-44bbef80010d tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:12.906222 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0455f657-5d6f-455d-9ae5-44bbef80010d tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:13.060922 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-0455f657-5d6f-455d-9ae5-44bbef80010d tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:13.070092 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-0455f657-5d6f-455d-9ae5-44bbef80010d tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/24bc4434-d4e0-4a90-a669-a74cbfc3c08d" status: 200 len: 1389 microversion: 2.1 time: 0.181072 Aug 27 03:17:13.073387 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2825/5610] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:12 2022] GET /compute/v2.1/servers/24bc4434-d4e0-4a90-a669-a74cbfc3c08d => generated 1389 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:13.095832 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0bd1181a-8617-4982-9ea2-409f84391a9c tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:13.096600 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-0bd1181a-8617-4982-9ea2-409f84391a9c tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 24bc4434-d4e0-4a90-a669-a74cbfc3c08d] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:13.104346 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0bd1181a-8617-4982-9ea2-409f84391a9c tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:13.105435 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0bd1181a-8617-4982-9ea2-409f84391a9c tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:13.106232 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0bd1181a-8617-4982-9ea2-409f84391a9c tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:13.108808 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0bd1181a-8617-4982-9ea2-409f84391a9c tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:13.109559 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0bd1181a-8617-4982-9ea2-409f84391a9c tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:13.110066 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0bd1181a-8617-4982-9ea2-409f84391a9c tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:13.260622 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0bd1181a-8617-4982-9ea2-409f84391a9c tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:13.269985 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-0bd1181a-8617-4982-9ea2-409f84391a9c tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/24bc4434-d4e0-4a90-a669-a74cbfc3c08d" status: 200 len: 1389 microversion: 2.1 time: 0.180958 Aug 27 03:17:13.272349 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2786/5611] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:13 2022] GET /compute/v2.1/servers/24bc4434-d4e0-4a90-a669-a74cbfc3c08d => generated 1389 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:13.289752 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-25174a79-4c15-47c8-8dc7-3dff936fe096 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:13.290367 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-25174a79-4c15-47c8-8dc7-3dff936fe096 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 24bc4434-d4e0-4a90-a669-a74cbfc3c08d] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:13.296476 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-25174a79-4c15-47c8-8dc7-3dff936fe096 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:13.297136 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-25174a79-4c15-47c8-8dc7-3dff936fe096 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:13.297718 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-25174a79-4c15-47c8-8dc7-3dff936fe096 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:13.298668 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-25174a79-4c15-47c8-8dc7-3dff936fe096 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:13.299188 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-25174a79-4c15-47c8-8dc7-3dff936fe096 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:13.299699 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-25174a79-4c15-47c8-8dc7-3dff936fe096 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:13.449061 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-25174a79-4c15-47c8-8dc7-3dff936fe096 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:13.457369 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-25174a79-4c15-47c8-8dc7-3dff936fe096 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/24bc4434-d4e0-4a90-a669-a74cbfc3c08d" status: 200 len: 1389 microversion: 2.1 time: 0.171669 Aug 27 03:17:13.458626 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2826/5612] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:13 2022] GET /compute/v2.1/servers/24bc4434-d4e0-4a90-a669-a74cbfc3c08d => generated 1389 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:13.479235 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b8e60ac8-aaf2-42c9-a82c-5f368b257049 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:13.480135 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b8e60ac8-aaf2-42c9-a82c-5f368b257049 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 24bc4434-d4e0-4a90-a669-a74cbfc3c08d] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:13.487007 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b8e60ac8-aaf2-42c9-a82c-5f368b257049 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:13.487842 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b8e60ac8-aaf2-42c9-a82c-5f368b257049 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:13.488561 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b8e60ac8-aaf2-42c9-a82c-5f368b257049 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:13.489580 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b8e60ac8-aaf2-42c9-a82c-5f368b257049 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:13.490269 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b8e60ac8-aaf2-42c9-a82c-5f368b257049 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:13.490895 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b8e60ac8-aaf2-42c9-a82c-5f368b257049 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:13.530035 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b8e60ac8-aaf2-42c9-a82c-5f368b257049 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 24bc4434-d4e0-4a90-a669-a74cbfc3c08d] Going to try to terminate instance {{(pid=134052) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:17:13.654409 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b8e60ac8-aaf2-42c9-a82c-5f368b257049 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "DELETE /compute/v2.1/servers/24bc4434-d4e0-4a90-a669-a74cbfc3c08d" status: 204 len: 0 microversion: 2.1 time: 0.178481 Aug 27 03:17:13.655206 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2787/5613] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 03:17:13 2022] DELETE /compute/v2.1/servers/24bc4434-d4e0-4a90-a669-a74cbfc3c08d => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:17:13.663187 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-fe370063-31c3-4823-a3f6-d0fec6503b10 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:13.664032 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-fe370063-31c3-4823-a3f6-d0fec6503b10 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 24bc4434-d4e0-4a90-a669-a74cbfc3c08d] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:13.673980 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fe370063-31c3-4823-a3f6-d0fec6503b10 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:13.674875 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fe370063-31c3-4823-a3f6-d0fec6503b10 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:13.675546 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fe370063-31c3-4823-a3f6-d0fec6503b10 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:13.677609 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fe370063-31c3-4823-a3f6-d0fec6503b10 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:13.678398 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fe370063-31c3-4823-a3f6-d0fec6503b10 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:13.679069 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fe370063-31c3-4823-a3f6-d0fec6503b10 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:14.011725 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-fe370063-31c3-4823-a3f6-d0fec6503b10 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:14.034783 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-fe370063-31c3-4823-a3f6-d0fec6503b10 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/24bc4434-d4e0-4a90-a669-a74cbfc3c08d" status: 200 len: 1395 microversion: 2.1 time: 0.375378 Aug 27 03:17:14.035354 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2827/5614] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:13 2022] GET /compute/v2.1/servers/24bc4434-d4e0-4a90-a669-a74cbfc3c08d => generated 1395 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:15.056385 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4650ca1d-fbc3-4deb-8086-8e8d298daf83 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:15.057183 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-4650ca1d-fbc3-4deb-8086-8e8d298daf83 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 24bc4434-d4e0-4a90-a669-a74cbfc3c08d] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:15.080446 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4650ca1d-fbc3-4deb-8086-8e8d298daf83 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:15.081011 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4650ca1d-fbc3-4deb-8086-8e8d298daf83 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:15.082403 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4650ca1d-fbc3-4deb-8086-8e8d298daf83 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:15.086877 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4650ca1d-fbc3-4deb-8086-8e8d298daf83 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:15.087365 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4650ca1d-fbc3-4deb-8086-8e8d298daf83 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:15.087801 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4650ca1d-fbc3-4deb-8086-8e8d298daf83 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:15.342513 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-4650ca1d-fbc3-4deb-8086-8e8d298daf83 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:15.360482 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-4650ca1d-fbc3-4deb-8086-8e8d298daf83 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/24bc4434-d4e0-4a90-a669-a74cbfc3c08d" status: 200 len: 1395 microversion: 2.1 time: 0.308549 Aug 27 03:17:15.361329 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2788/5615] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:15 2022] GET /compute/v2.1/servers/24bc4434-d4e0-4a90-a669-a74cbfc3c08d => generated 1395 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:16.381819 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-9576b3d3-de66-42ab-aa52-d5dee0d464b4 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:16.382630 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-9576b3d3-de66-42ab-aa52-d5dee0d464b4 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 24bc4434-d4e0-4a90-a669-a74cbfc3c08d] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:16.390503 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9576b3d3-de66-42ab-aa52-d5dee0d464b4 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:16.391252 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9576b3d3-de66-42ab-aa52-d5dee0d464b4 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:16.391854 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9576b3d3-de66-42ab-aa52-d5dee0d464b4 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:16.392691 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9576b3d3-de66-42ab-aa52-d5dee0d464b4 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:16.393210 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9576b3d3-de66-42ab-aa52-d5dee0d464b4 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:16.393700 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9576b3d3-de66-42ab-aa52-d5dee0d464b4 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:16.557307 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-9576b3d3-de66-42ab-aa52-d5dee0d464b4 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:16.566264 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-9576b3d3-de66-42ab-aa52-d5dee0d464b4 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/24bc4434-d4e0-4a90-a669-a74cbfc3c08d" status: 200 len: 1395 microversion: 2.1 time: 0.188567 Aug 27 03:17:16.567294 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2828/5616] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:16 2022] GET /compute/v2.1/servers/24bc4434-d4e0-4a90-a669-a74cbfc3c08d => generated 1395 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:16.880525 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-28be033d-8abb-44fe-a265-e6cd329cd401 req-153927d7-c807-4219-af51-b8aae8306431 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24bc4434-d4e0-4a90-a669-a74cbfc3c08d", "name": "network-vif-deleted", "tag": "9e367c25-072b-4e9f-8d97-10daf30aae78"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:17:16.911002 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-28be033d-8abb-44fe-a265-e6cd329cd401 req-153927d7-c807-4219-af51-b8aae8306431 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:16.911802 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-28be033d-8abb-44fe-a265-e6cd329cd401 req-153927d7-c807-4219-af51-b8aae8306431 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:16.912547 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-28be033d-8abb-44fe-a265-e6cd329cd401 req-153927d7-c807-4219-af51-b8aae8306431 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:16.966633 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-28be033d-8abb-44fe-a265-e6cd329cd401 req-153927d7-c807-4219-af51-b8aae8306431 service nova] Creating event network-vif-deleted:9e367c25-072b-4e9f-8d97-10daf30aae78 for instance 24bc4434-d4e0-4a90-a669-a74cbfc3c08d on n-h1-852278-4 Aug 27 03:17:16.976123 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-28be033d-8abb-44fe-a265-e6cd329cd401 req-153927d7-c807-4219-af51-b8aae8306431 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099643 Aug 27 03:17:16.976783 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2789/5617] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:17:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:17:17.592155 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8947a2fa-1052-44d0-bf7a-d54e663ae21c tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:17.593766 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-8947a2fa-1052-44d0-bf7a-d54e663ae21c tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 24bc4434-d4e0-4a90-a669-a74cbfc3c08d] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:17.608070 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8947a2fa-1052-44d0-bf7a-d54e663ae21c tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:17.608541 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8947a2fa-1052-44d0-bf7a-d54e663ae21c tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:17.608989 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8947a2fa-1052-44d0-bf7a-d54e663ae21c tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:17.612973 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8947a2fa-1052-44d0-bf7a-d54e663ae21c tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:17.613784 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8947a2fa-1052-44d0-bf7a-d54e663ae21c tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:17.614238 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8947a2fa-1052-44d0-bf7a-d54e663ae21c tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:17.730127 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-8947a2fa-1052-44d0-bf7a-d54e663ae21c tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:17.742068 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-8947a2fa-1052-44d0-bf7a-d54e663ae21c tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/24bc4434-d4e0-4a90-a669-a74cbfc3c08d" status: 200 len: 1187 microversion: 2.1 time: 0.154516 Aug 27 03:17:17.751328 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2829/5618] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:17 2022] GET /compute/v2.1/servers/24bc4434-d4e0-4a90-a669-a74cbfc3c08d => generated 1187 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:18.763860 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-77d1c165-6282-4846-b20c-e09a08a098ea tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:18.765361 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-77d1c165-6282-4846-b20c-e09a08a098ea tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 24bc4434-d4e0-4a90-a669-a74cbfc3c08d] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:18.784099 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-77d1c165-6282-4846-b20c-e09a08a098ea tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:18.784838 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-77d1c165-6282-4846-b20c-e09a08a098ea tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:18.785606 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-77d1c165-6282-4846-b20c-e09a08a098ea tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:18.786880 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-77d1c165-6282-4846-b20c-e09a08a098ea tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:18.787724 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-77d1c165-6282-4846-b20c-e09a08a098ea tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:18.788594 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-77d1c165-6282-4846-b20c-e09a08a098ea tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:18.901189 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-77d1c165-6282-4846-b20c-e09a08a098ea tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:18.910783 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-77d1c165-6282-4846-b20c-e09a08a098ea tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/24bc4434-d4e0-4a90-a669-a74cbfc3c08d" status: 200 len: 1187 microversion: 2.1 time: 0.151150 Aug 27 03:17:18.916839 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2790/5619] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:18 2022] GET /compute/v2.1/servers/24bc4434-d4e0-4a90-a669-a74cbfc3c08d => generated 1187 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:19.932167 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7fc8162b-0905-4ae7-a06d-232fbfecab59 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:19.935641 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-7fc8162b-0905-4ae7-a06d-232fbfecab59 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 24bc4434-d4e0-4a90-a669-a74cbfc3c08d] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:19.945911 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7fc8162b-0905-4ae7-a06d-232fbfecab59 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:19.946423 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7fc8162b-0905-4ae7-a06d-232fbfecab59 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:19.946971 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7fc8162b-0905-4ae7-a06d-232fbfecab59 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:19.947702 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7fc8162b-0905-4ae7-a06d-232fbfecab59 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:19.948187 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7fc8162b-0905-4ae7-a06d-232fbfecab59 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:19.948700 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7fc8162b-0905-4ae7-a06d-232fbfecab59 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:20.047239 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-7fc8162b-0905-4ae7-a06d-232fbfecab59 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:20.055645 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-7fc8162b-0905-4ae7-a06d-232fbfecab59 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/24bc4434-d4e0-4a90-a669-a74cbfc3c08d" status: 200 len: 1187 microversion: 2.1 time: 0.128465 Aug 27 03:17:20.057182 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2830/5620] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:19 2022] GET /compute/v2.1/servers/24bc4434-d4e0-4a90-a669-a74cbfc3c08d => generated 1187 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:21.076737 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e21dcb06-39b6-4b4f-beda-4cccd0be3917 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:21.077943 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-e21dcb06-39b6-4b4f-beda-4cccd0be3917 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 24bc4434-d4e0-4a90-a669-a74cbfc3c08d] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:21.086003 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e21dcb06-39b6-4b4f-beda-4cccd0be3917 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:21.086913 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e21dcb06-39b6-4b4f-beda-4cccd0be3917 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:21.087613 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e21dcb06-39b6-4b4f-beda-4cccd0be3917 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:21.088635 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e21dcb06-39b6-4b4f-beda-4cccd0be3917 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:21.089380 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e21dcb06-39b6-4b4f-beda-4cccd0be3917 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:21.090004 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e21dcb06-39b6-4b4f-beda-4cccd0be3917 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:21.160452 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-e21dcb06-39b6-4b4f-beda-4cccd0be3917 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:21.175698 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e21dcb06-39b6-4b4f-beda-4cccd0be3917 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/24bc4434-d4e0-4a90-a669-a74cbfc3c08d" status: 200 len: 1187 microversion: 2.1 time: 0.102987 Aug 27 03:17:21.177118 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2791/5621] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:21 2022] GET /compute/v2.1/servers/24bc4434-d4e0-4a90-a669-a74cbfc3c08d => generated 1187 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:22.199860 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c978be67-4fe8-48a7-aec7-19100467bb96 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:22.200630 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-c978be67-4fe8-48a7-aec7-19100467bb96 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 24bc4434-d4e0-4a90-a669-a74cbfc3c08d] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:22.210345 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c978be67-4fe8-48a7-aec7-19100467bb96 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:22.211106 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c978be67-4fe8-48a7-aec7-19100467bb96 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:22.211869 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c978be67-4fe8-48a7-aec7-19100467bb96 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:22.212719 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c978be67-4fe8-48a7-aec7-19100467bb96 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:22.213250 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c978be67-4fe8-48a7-aec7-19100467bb96 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:22.213755 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c978be67-4fe8-48a7-aec7-19100467bb96 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:22.261704 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c978be67-4fe8-48a7-aec7-19100467bb96 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:22.262276 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c978be67-4fe8-48a7-aec7-19100467bb96 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:22.262801 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c978be67-4fe8-48a7-aec7-19100467bb96 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:22.263468 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.objects.instance [None req-c978be67-4fe8-48a7-aec7-19100467bb96 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lazy-loading 'fault' on Instance uuid 24bc4434-d4e0-4a90-a669-a74cbfc3c08d {{(pid=134051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:17:22.317730 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-c978be67-4fe8-48a7-aec7-19100467bb96 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:22.329129 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c978be67-4fe8-48a7-aec7-19100467bb96 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/24bc4434-d4e0-4a90-a669-a74cbfc3c08d" status: 200 len: 1192 microversion: 2.1 time: 0.134711 Aug 27 03:17:22.343877 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2831/5622] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:22 2022] GET /compute/v2.1/servers/24bc4434-d4e0-4a90-a669-a74cbfc3c08d => generated 1192 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:23.351775 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-aa4f8271-13a6-49d0-8021-fc1309e117b4 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:23.352357 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-aa4f8271-13a6-49d0-8021-fc1309e117b4 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 24bc4434-d4e0-4a90-a669-a74cbfc3c08d] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:23.359453 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-aa4f8271-13a6-49d0-8021-fc1309e117b4 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:23.359928 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-aa4f8271-13a6-49d0-8021-fc1309e117b4 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:23.360382 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-aa4f8271-13a6-49d0-8021-fc1309e117b4 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:23.361254 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-aa4f8271-13a6-49d0-8021-fc1309e117b4 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:23.361846 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-aa4f8271-13a6-49d0-8021-fc1309e117b4 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:23.362406 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-aa4f8271-13a6-49d0-8021-fc1309e117b4 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:23.381469 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-aa4f8271-13a6-49d0-8021-fc1309e117b4 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] HTTP exception thrown: Instance 24bc4434-d4e0-4a90-a669-a74cbfc3c08d could not be found. Aug 27 03:17:23.383154 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-aa4f8271-13a6-49d0-8021-fc1309e117b4 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Request method failure captured: Aug 27 03:17:23.383154 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/servers/24bc4434-d4e0-4a90-a669-a74cbfc3c08d HTTP/1.1 Aug 27 03:17:23.383154 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 03:17:23.383154 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 03:17:23.383154 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 03:17:23.383154 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 03:17:23.383154 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 03:17:23.383154 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 03:17:23.383154 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 03:17:23.383154 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 03:17:23.383154 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYyanRmSitPtUh4DIDjvAfp5Iiwg8r3Bf9-rjIalvb44wIYhFzVkZDLPIdVwR9rbE-qHDjS_3-JeB9MrxSXFOtiOWUfHFokH2CMOJ34en6s6KyuDM-ix0my9F59eD8M1zowb_BqVFIaTj9p6YHs85SeVo0SCpB1hAOakQSi3_cd8UVk Aug 27 03:17:23.383154 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 03:17:23.383154 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 03:17:23.383154 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 03:17:23.383154 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 03:17:23.383154 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 03:17:23.383154 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 03:17:23.383154 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 7b2673a034c24d1898493bfea9ca5d1d Aug 27 03:17:23.383154 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-TestVolumeBootPattern-2103223700 Aug 27 03:17:23.383154 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 03:17:23.383154 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 03:17:23.383154 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7b2673a034c24d1898493bfea9ca5d1d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_7b2673a034c24d1898493bfea9ca5d1d", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7b2673a034c24d1898493bfea9ca5d1d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/7b2673a034c24d1898493bfea9ca5d1d"}]}] Aug 27 03:17:23.383154 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-TestVolumeBootPattern-2103223700 Aug 27 03:17:23.383154 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 7b2673a034c24d1898493bfea9ca5d1d Aug 27 03:17:23.383154 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-TestVolumeBootPattern-2103223700 Aug 27 03:17:23.383154 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-TestVolumeBootPattern-2103223700-project Aug 27 03:17:23.383154 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 03:17:23.383154 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 03:17:23.383154 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 4aa867d7baa043b1b1e6763046463b3f Aug 27 03:17:23.383154 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-TestVolumeBootPattern-2103223700-project Aug 27 03:17:23.383154 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 03:17:23.383154 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance 24bc4434-d4e0-4a90-a669-a74cbfc3c08d could not be found. Aug 27 03:17:23.383154 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '24bc4434-d4e0-4a90-a669-a74cbfc3c08d'} Aug 27 03:17:23.383154 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:17:23.383154 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:17:23.383154 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:17:23.383154 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:17:23.383154 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:17:23.383154 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:17:23.383154 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:17:23.383154 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:17:23.383154 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:17:23.383154 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:17:23.383154 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24bc4434-d4e0-4a90-a669-a74cbfc3c08d could not be found. Aug 27 03:17:23.383154 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:17:23.383154 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:17:23.383154 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:17:23.383154 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:17:23.383154 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:17:23.383154 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:17:23.383154 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:17:23.383154 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:17:23.383154 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:17:23.383154 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:17:23.383154 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:17:23.383154 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:17:23.383154 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:17:23.383154 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:17:23.383154 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:17:23.383154 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:17:23.383154 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24bc4434-d4e0-4a90-a669-a74cbfc3c08d could not be found. Aug 27 03:17:23.383154 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:17:23.383154 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:17:23.383154 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:17:23.390695 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:17:23.390695 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:17:23.390695 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:17:23.390695 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:17:23.390695 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:17:23.390695 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24bc4434-d4e0-4a90-a669-a74cbfc3c08d could not be found. Aug 27 03:17:23.390695 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:17:23.390695 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-aa4f8271-13a6-49d0-8021-fc1309e117b4 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Returning 404 to user: Instance 24bc4434-d4e0-4a90-a669-a74cbfc3c08d could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:17:23.390695 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-aa4f8271-13a6-49d0-8021-fc1309e117b4 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/24bc4434-d4e0-4a90-a669-a74cbfc3c08d" status: 404 len: 111 microversion: 2.1 time: 0.036854 Aug 27 03:17:23.390695 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2792/5623] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:23 2022] GET /compute/v2.1/servers/24bc4434-d4e0-4a90-a669-a74cbfc3c08d => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:17:29.854204 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3e4a6457-f84f-4bc5-b78b-56eccb8ef551 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1634713135", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "3028d34c-f93c-4848-b07b-7004d9d86366", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "02524c0f-c44c-4ea0-899e-226a790199dc"}]}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:17:29.871270 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:17:29.929504 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.network.neutron [None req-3e4a6457-f84f-4bc5-b78b-56eccb8ef551 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] validate_networks() for [('02524c0f-c44c-4ea0-899e-226a790199dc', None, None, None, None, None)] {{(pid=134051) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:17:30.351247 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-3e4a6457-f84f-4bc5-b78b-56eccb8ef551 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Flavor limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:17:30.351821 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-3e4a6457-f84f-4bc5-b78b-56eccb8ef551 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Image limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:17:30.353027 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-3e4a6457-f84f-4bc5-b78b-56eccb8ef551 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Flavor pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:17:30.353701 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-3e4a6457-f84f-4bc5-b78b-56eccb8ef551 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Image pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:17:30.354218 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-3e4a6457-f84f-4bc5-b78b-56eccb8ef551 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:17:30.365264 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3e4a6457-f84f-4bc5-b78b-56eccb8ef551 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:30.365946 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3e4a6457-f84f-4bc5-b78b-56eccb8ef551 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:30.366450 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3e4a6457-f84f-4bc5-b78b-56eccb8ef551 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:30.367390 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3e4a6457-f84f-4bc5-b78b-56eccb8ef551 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:30.367912 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3e4a6457-f84f-4bc5-b78b-56eccb8ef551 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:30.368431 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3e4a6457-f84f-4bc5-b78b-56eccb8ef551 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:30.376352 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=87 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:17:30.388800 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-3e4a6457-f84f-4bc5-b78b-56eccb8ef551 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Getting quotas for project 7b2673a034c24d1898493bfea9ca5d1d. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:17:30.395085 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-3e4a6457-f84f-4bc5-b78b-56eccb8ef551 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Getting quotas for user 4aa867d7baa043b1b1e6763046463b3f and project 7b2673a034c24d1898493bfea9ca5d1d. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:17:30.489993 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-3e4a6457-f84f-4bc5-b78b-56eccb8ef551 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Going to run 1 instances... {{(pid=134051) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:17:30.492091 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-3e4a6457-f84f-4bc5-b78b-56eccb8ef551 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: bc6fa240-aadf-46d3-ae93-b90867f1ac36] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3028d34c-f93c-4848-b07b-7004d9d86366',volume_size=None,volume_type=None)] {{(pid=134051) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:17:30.642998 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-3e4a6457-f84f-4bc5-b78b-56eccb8ef551 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.793555 Aug 27 03:17:30.643448 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2832/5624] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 03:17:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 795 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:17:30.655678 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e7011535-abfe-49d0-a265-1e37074f18e0 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:30.656469 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-e7011535-abfe-49d0-a265-1e37074f18e0 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: bc6fa240-aadf-46d3-ae93-b90867f1ac36] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:30.663605 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:17:30.739343 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-e7011535-abfe-49d0-a265-1e37074f18e0 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:30.758498 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e7011535-abfe-49d0-a265-1e37074f18e0 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/bc6fa240-aadf-46d3-ae93-b90867f1ac36" status: 200 len: 1057 microversion: 2.1 time: 0.107826 Aug 27 03:17:30.769093 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2793/5625] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:30 2022] GET /compute/v2.1/servers/bc6fa240-aadf-46d3-ae93-b90867f1ac36 => generated 1057 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:31.780238 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d2e49616-a32f-417d-a932-aea16ff2d0a0 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:31.781628 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d2e49616-a32f-417d-a932-aea16ff2d0a0 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: bc6fa240-aadf-46d3-ae93-b90867f1ac36] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:31.791411 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d2e49616-a32f-417d-a932-aea16ff2d0a0 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:31.792357 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d2e49616-a32f-417d-a932-aea16ff2d0a0 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:31.793179 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d2e49616-a32f-417d-a932-aea16ff2d0a0 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:31.794100 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d2e49616-a32f-417d-a932-aea16ff2d0a0 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:31.794743 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d2e49616-a32f-417d-a932-aea16ff2d0a0 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:31.795497 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d2e49616-a32f-417d-a932-aea16ff2d0a0 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:31.895409 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d2e49616-a32f-417d-a932-aea16ff2d0a0 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:31.904545 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d2e49616-a32f-417d-a932-aea16ff2d0a0 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/bc6fa240-aadf-46d3-ae93-b90867f1ac36" status: 200 len: 1163 microversion: 2.1 time: 0.128627 Aug 27 03:17:31.906738 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2833/5626] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:31 2022] GET /compute/v2.1/servers/bc6fa240-aadf-46d3-ae93-b90867f1ac36 => generated 1163 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:32.927747 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-54c605e7-c4a6-443e-84ac-6e73f56d1349 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:32.929291 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-54c605e7-c4a6-443e-84ac-6e73f56d1349 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: bc6fa240-aadf-46d3-ae93-b90867f1ac36] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:32.951678 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-54c605e7-c4a6-443e-84ac-6e73f56d1349 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:32.952391 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-54c605e7-c4a6-443e-84ac-6e73f56d1349 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:32.953085 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-54c605e7-c4a6-443e-84ac-6e73f56d1349 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:32.953981 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-54c605e7-c4a6-443e-84ac-6e73f56d1349 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:32.954595 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-54c605e7-c4a6-443e-84ac-6e73f56d1349 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:32.955164 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-54c605e7-c4a6-443e-84ac-6e73f56d1349 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:32.960160 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:17:33.564203 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-54c605e7-c4a6-443e-84ac-6e73f56d1349 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:33.573151 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-54c605e7-c4a6-443e-84ac-6e73f56d1349 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/bc6fa240-aadf-46d3-ae93-b90867f1ac36" status: 200 len: 1215 microversion: 2.1 time: 0.649876 Aug 27 03:17:33.586908 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2794/5627] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:32 2022] GET /compute/v2.1/servers/bc6fa240-aadf-46d3-ae93-b90867f1ac36 => generated 1215 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:33.674280 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-7b232879-2a01-4549-8e91-35439fb4f0c5 req-02d25c4e-089c-42d2-a2a7-23deda56697d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc6fa240-aadf-46d3-ae93-b90867f1ac36", "tag": "738d89db-787e-461b-975d-2d1918e2f9cd"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:17:33.701672 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-7b232879-2a01-4549-8e91-35439fb4f0c5 req-02d25c4e-089c-42d2-a2a7-23deda56697d service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:33.702158 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-7b232879-2a01-4549-8e91-35439fb4f0c5 req-02d25c4e-089c-42d2-a2a7-23deda56697d service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:33.702583 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-7b232879-2a01-4549-8e91-35439fb4f0c5 req-02d25c4e-089c-42d2-a2a7-23deda56697d service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:33.718160 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-7b232879-2a01-4549-8e91-35439fb4f0c5 req-02d25c4e-089c-42d2-a2a7-23deda56697d service nova] Creating event network-changed:738d89db-787e-461b-975d-2d1918e2f9cd for instance bc6fa240-aadf-46d3-ae93-b90867f1ac36 on n-h1-852278-4 Aug 27 03:17:33.725915 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-7b232879-2a01-4549-8e91-35439fb4f0c5 req-02d25c4e-089c-42d2-a2a7-23deda56697d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055176 Aug 27 03:17:33.727377 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2834/5628] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:17:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:17:34.595003 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-2a2a5be7-fea7-49a2-9e16-a6e4a9990353 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:34.595610 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-2a2a5be7-fea7-49a2-9e16-a6e4a9990353 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: bc6fa240-aadf-46d3-ae93-b90867f1ac36] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:34.613138 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2a2a5be7-fea7-49a2-9e16-a6e4a9990353 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:34.613997 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2a2a5be7-fea7-49a2-9e16-a6e4a9990353 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:34.614967 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2a2a5be7-fea7-49a2-9e16-a6e4a9990353 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:34.616094 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2a2a5be7-fea7-49a2-9e16-a6e4a9990353 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:34.616762 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2a2a5be7-fea7-49a2-9e16-a6e4a9990353 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:34.617719 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2a2a5be7-fea7-49a2-9e16-a6e4a9990353 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:34.874364 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-2a2a5be7-fea7-49a2-9e16-a6e4a9990353 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:34.883694 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-2a2a5be7-fea7-49a2-9e16-a6e4a9990353 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/bc6fa240-aadf-46d3-ae93-b90867f1ac36" status: 200 len: 1215 microversion: 2.1 time: 0.292620 Aug 27 03:17:34.902400 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2795/5629] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:34 2022] GET /compute/v2.1/servers/bc6fa240-aadf-46d3-ae93-b90867f1ac36 => generated 1215 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:35.909097 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b8c1604c-2e79-4b83-8578-99a53ddb03fb tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:35.909828 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b8c1604c-2e79-4b83-8578-99a53ddb03fb tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: bc6fa240-aadf-46d3-ae93-b90867f1ac36] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:35.918938 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b8c1604c-2e79-4b83-8578-99a53ddb03fb tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:35.919507 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b8c1604c-2e79-4b83-8578-99a53ddb03fb tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:35.919908 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b8c1604c-2e79-4b83-8578-99a53ddb03fb tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:35.920841 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b8c1604c-2e79-4b83-8578-99a53ddb03fb tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:35.921471 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b8c1604c-2e79-4b83-8578-99a53ddb03fb tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:35.922091 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b8c1604c-2e79-4b83-8578-99a53ddb03fb tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:36.075453 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-b8c1604c-2e79-4b83-8578-99a53ddb03fb tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:36.089194 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b8c1604c-2e79-4b83-8578-99a53ddb03fb tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/bc6fa240-aadf-46d3-ae93-b90867f1ac36" status: 200 len: 1215 microversion: 2.1 time: 0.188651 Aug 27 03:17:36.090811 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2835/5630] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:35 2022] GET /compute/v2.1/servers/bc6fa240-aadf-46d3-ae93-b90867f1ac36 => generated 1215 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:37.114753 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5a2700ff-1079-4094-a434-736b2c4ab0c3 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:37.115388 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-5a2700ff-1079-4094-a434-736b2c4ab0c3 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: bc6fa240-aadf-46d3-ae93-b90867f1ac36] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:37.122506 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5a2700ff-1079-4094-a434-736b2c4ab0c3 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:37.123946 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5a2700ff-1079-4094-a434-736b2c4ab0c3 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:37.124286 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5a2700ff-1079-4094-a434-736b2c4ab0c3 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:37.126429 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5a2700ff-1079-4094-a434-736b2c4ab0c3 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:37.126888 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5a2700ff-1079-4094-a434-736b2c4ab0c3 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:37.127353 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5a2700ff-1079-4094-a434-736b2c4ab0c3 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:37.326359 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-5a2700ff-1079-4094-a434-736b2c4ab0c3 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:37.336394 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-5a2700ff-1079-4094-a434-736b2c4ab0c3 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/bc6fa240-aadf-46d3-ae93-b90867f1ac36" status: 200 len: 1215 microversion: 2.1 time: 0.225706 Aug 27 03:17:37.338196 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2796/5631] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:37 2022] GET /compute/v2.1/servers/bc6fa240-aadf-46d3-ae93-b90867f1ac36 => generated 1215 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:38.377022 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-cb1d2a09-eec3-49f6-b289-5dbac2087fb4 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:38.378315 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-cb1d2a09-eec3-49f6-b289-5dbac2087fb4 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: bc6fa240-aadf-46d3-ae93-b90867f1ac36] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:38.387741 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cb1d2a09-eec3-49f6-b289-5dbac2087fb4 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:38.388427 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cb1d2a09-eec3-49f6-b289-5dbac2087fb4 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:38.389021 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cb1d2a09-eec3-49f6-b289-5dbac2087fb4 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:38.389741 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cb1d2a09-eec3-49f6-b289-5dbac2087fb4 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:38.390197 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cb1d2a09-eec3-49f6-b289-5dbac2087fb4 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:38.390629 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cb1d2a09-eec3-49f6-b289-5dbac2087fb4 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:38.532452 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-cb1d2a09-eec3-49f6-b289-5dbac2087fb4 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:38.543138 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-cb1d2a09-eec3-49f6-b289-5dbac2087fb4 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/bc6fa240-aadf-46d3-ae93-b90867f1ac36" status: 200 len: 1203 microversion: 2.1 time: 0.189811 Aug 27 03:17:38.546951 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2836/5632] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:38 2022] GET /compute/v2.1/servers/bc6fa240-aadf-46d3-ae93-b90867f1ac36 => generated 1203 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:39.564801 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-bd70c4f6-5bb2-4092-b111-150275647558 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:39.566056 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-bd70c4f6-5bb2-4092-b111-150275647558 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: bc6fa240-aadf-46d3-ae93-b90867f1ac36] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:39.587030 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bd70c4f6-5bb2-4092-b111-150275647558 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:39.587712 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bd70c4f6-5bb2-4092-b111-150275647558 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:39.588518 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bd70c4f6-5bb2-4092-b111-150275647558 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:39.589376 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bd70c4f6-5bb2-4092-b111-150275647558 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:39.590430 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bd70c4f6-5bb2-4092-b111-150275647558 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:39.591006 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bd70c4f6-5bb2-4092-b111-150275647558 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:39.779904 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-bd70c4f6-5bb2-4092-b111-150275647558 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:39.789715 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-bd70c4f6-5bb2-4092-b111-150275647558 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/bc6fa240-aadf-46d3-ae93-b90867f1ac36" status: 200 len: 1203 microversion: 2.1 time: 0.229306 Aug 27 03:17:39.801451 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2797/5633] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:39 2022] GET /compute/v2.1/servers/bc6fa240-aadf-46d3-ae93-b90867f1ac36 => generated 1203 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:40.813744 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ae25a544-be7f-46c9-8e8d-e719e74b9947 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:40.815471 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-ae25a544-be7f-46c9-8e8d-e719e74b9947 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: bc6fa240-aadf-46d3-ae93-b90867f1ac36] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:40.820046 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:17:40.821899 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=6 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:17:40.831114 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ae25a544-be7f-46c9-8e8d-e719e74b9947 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:40.832679 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ae25a544-be7f-46c9-8e8d-e719e74b9947 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:40.833758 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ae25a544-be7f-46c9-8e8d-e719e74b9947 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:40.834777 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ae25a544-be7f-46c9-8e8d-e719e74b9947 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:40.835719 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ae25a544-be7f-46c9-8e8d-e719e74b9947 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:40.836710 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ae25a544-be7f-46c9-8e8d-e719e74b9947 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:41.006379 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-ae25a544-be7f-46c9-8e8d-e719e74b9947 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:41.015313 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ae25a544-be7f-46c9-8e8d-e719e74b9947 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/bc6fa240-aadf-46d3-ae93-b90867f1ac36" status: 200 len: 1203 microversion: 2.1 time: 0.207788 Aug 27 03:17:41.016210 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2837/5634] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:40 2022] GET /compute/v2.1/servers/bc6fa240-aadf-46d3-ae93-b90867f1ac36 => generated 1203 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:42.036841 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3148552a-8c29-4c61-aa3f-eca628a234a7 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:42.037789 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-3148552a-8c29-4c61-aa3f-eca628a234a7 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: bc6fa240-aadf-46d3-ae93-b90867f1ac36] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:42.040965 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:17:42.046281 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3148552a-8c29-4c61-aa3f-eca628a234a7 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:42.046895 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3148552a-8c29-4c61-aa3f-eca628a234a7 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:42.047491 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3148552a-8c29-4c61-aa3f-eca628a234a7 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:42.048328 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3148552a-8c29-4c61-aa3f-eca628a234a7 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:42.048938 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3148552a-8c29-4c61-aa3f-eca628a234a7 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:42.049468 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3148552a-8c29-4c61-aa3f-eca628a234a7 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:42.186290 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-3148552a-8c29-4c61-aa3f-eca628a234a7 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:42.195082 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-3148552a-8c29-4c61-aa3f-eca628a234a7 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/bc6fa240-aadf-46d3-ae93-b90867f1ac36" status: 200 len: 1203 microversion: 2.1 time: 0.162245 Aug 27 03:17:42.195677 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2798/5635] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:42 2022] GET /compute/v2.1/servers/bc6fa240-aadf-46d3-ae93-b90867f1ac36 => generated 1203 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:17:43.216663 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-45634c1a-94c3-46af-a93b-583d4ec955e3 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:43.217544 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-45634c1a-94c3-46af-a93b-583d4ec955e3 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: bc6fa240-aadf-46d3-ae93-b90867f1ac36] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:43.224515 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-45634c1a-94c3-46af-a93b-583d4ec955e3 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:43.225269 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-45634c1a-94c3-46af-a93b-583d4ec955e3 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:43.225792 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-45634c1a-94c3-46af-a93b-583d4ec955e3 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:43.226594 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-45634c1a-94c3-46af-a93b-583d4ec955e3 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:43.227123 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-45634c1a-94c3-46af-a93b-583d4ec955e3 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:43.227642 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-45634c1a-94c3-46af-a93b-583d4ec955e3 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:43.367096 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-45634c1a-94c3-46af-a93b-583d4ec955e3 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:43.375250 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-45634c1a-94c3-46af-a93b-583d4ec955e3 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/bc6fa240-aadf-46d3-ae93-b90867f1ac36" status: 200 len: 1203 microversion: 2.1 time: 0.163278 Aug 27 03:17:43.375844 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2838/5636] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:43 2022] GET /compute/v2.1/servers/bc6fa240-aadf-46d3-ae93-b90867f1ac36 => generated 1203 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:44.395605 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f399be95-0d35-43f2-8393-081215cb1f4e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:44.396539 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-f399be95-0d35-43f2-8393-081215cb1f4e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: bc6fa240-aadf-46d3-ae93-b90867f1ac36] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:44.404694 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f399be95-0d35-43f2-8393-081215cb1f4e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:44.405197 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f399be95-0d35-43f2-8393-081215cb1f4e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:44.405639 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f399be95-0d35-43f2-8393-081215cb1f4e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:44.406359 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f399be95-0d35-43f2-8393-081215cb1f4e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:44.406812 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f399be95-0d35-43f2-8393-081215cb1f4e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:44.407344 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f399be95-0d35-43f2-8393-081215cb1f4e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:44.559784 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-f399be95-0d35-43f2-8393-081215cb1f4e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:44.575284 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f399be95-0d35-43f2-8393-081215cb1f4e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/bc6fa240-aadf-46d3-ae93-b90867f1ac36" status: 200 len: 1203 microversion: 2.1 time: 0.183300 Aug 27 03:17:44.576958 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2799/5637] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:44 2022] GET /compute/v2.1/servers/bc6fa240-aadf-46d3-ae93-b90867f1ac36 => generated 1203 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:45.597603 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e6f22097-ff4a-48f9-ac2b-2a3f0b367a43 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:45.598512 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-e6f22097-ff4a-48f9-ac2b-2a3f0b367a43 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: bc6fa240-aadf-46d3-ae93-b90867f1ac36] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:45.605935 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e6f22097-ff4a-48f9-ac2b-2a3f0b367a43 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:45.606589 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e6f22097-ff4a-48f9-ac2b-2a3f0b367a43 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:45.607129 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e6f22097-ff4a-48f9-ac2b-2a3f0b367a43 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:45.608098 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e6f22097-ff4a-48f9-ac2b-2a3f0b367a43 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:45.608682 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e6f22097-ff4a-48f9-ac2b-2a3f0b367a43 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:45.609270 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e6f22097-ff4a-48f9-ac2b-2a3f0b367a43 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:45.758667 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e6f22097-ff4a-48f9-ac2b-2a3f0b367a43 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:45.767606 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e6f22097-ff4a-48f9-ac2b-2a3f0b367a43 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/bc6fa240-aadf-46d3-ae93-b90867f1ac36" status: 200 len: 1203 microversion: 2.1 time: 0.174477 Aug 27 03:17:45.768195 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2839/5638] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:45 2022] GET /compute/v2.1/servers/bc6fa240-aadf-46d3-ae93-b90867f1ac36 => generated 1203 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:46.783449 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-20a4e918-abb2-45b6-ac26-ff4c7bfb4a47 req-2c85d2dd-aef8-4908-9d17-2f3931761e88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc6fa240-aadf-46d3-ae93-b90867f1ac36", "name": "network-vif-plugged", "status": "completed", "tag": "738d89db-787e-461b-975d-2d1918e2f9cd"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:17:46.788382 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d137efc3-7f6d-4785-9d3a-faa150ece4d5 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:46.789000 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d137efc3-7f6d-4785-9d3a-faa150ece4d5 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: bc6fa240-aadf-46d3-ae93-b90867f1ac36] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:46.802910 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-20a4e918-abb2-45b6-ac26-ff4c7bfb4a47 req-2c85d2dd-aef8-4908-9d17-2f3931761e88 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:46.803524 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-20a4e918-abb2-45b6-ac26-ff4c7bfb4a47 req-2c85d2dd-aef8-4908-9d17-2f3931761e88 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:46.804062 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-20a4e918-abb2-45b6-ac26-ff4c7bfb4a47 req-2c85d2dd-aef8-4908-9d17-2f3931761e88 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:46.807947 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d137efc3-7f6d-4785-9d3a-faa150ece4d5 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:46.808465 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d137efc3-7f6d-4785-9d3a-faa150ece4d5 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:46.808903 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d137efc3-7f6d-4785-9d3a-faa150ece4d5 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:46.809609 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d137efc3-7f6d-4785-9d3a-faa150ece4d5 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:46.810075 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d137efc3-7f6d-4785-9d3a-faa150ece4d5 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:46.810588 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d137efc3-7f6d-4785-9d3a-faa150ece4d5 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:46.820325 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-20a4e918-abb2-45b6-ac26-ff4c7bfb4a47 req-2c85d2dd-aef8-4908-9d17-2f3931761e88 service nova] Creating event network-vif-plugged:738d89db-787e-461b-975d-2d1918e2f9cd for instance bc6fa240-aadf-46d3-ae93-b90867f1ac36 on n-h1-852278-4 Aug 27 03:17:46.830128 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-20a4e918-abb2-45b6-ac26-ff4c7bfb4a47 req-2c85d2dd-aef8-4908-9d17-2f3931761e88 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053677 Aug 27 03:17:46.831202 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2800/5639] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:17:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:17:47.059199 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d137efc3-7f6d-4785-9d3a-faa150ece4d5 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:47.069488 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d137efc3-7f6d-4785-9d3a-faa150ece4d5 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/bc6fa240-aadf-46d3-ae93-b90867f1ac36" status: 200 len: 1203 microversion: 2.1 time: 0.285906 Aug 27 03:17:47.081703 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2840/5640] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:46 2022] GET /compute/v2.1/servers/bc6fa240-aadf-46d3-ae93-b90867f1ac36 => generated 1203 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:48.097072 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b434a5f9-aec6-4126-ab97-6f2e7e2bf84c tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:48.097773 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b434a5f9-aec6-4126-ab97-6f2e7e2bf84c tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: bc6fa240-aadf-46d3-ae93-b90867f1ac36] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:48.106464 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b434a5f9-aec6-4126-ab97-6f2e7e2bf84c tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:48.107412 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b434a5f9-aec6-4126-ab97-6f2e7e2bf84c tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:48.108199 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b434a5f9-aec6-4126-ab97-6f2e7e2bf84c tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:48.113875 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b434a5f9-aec6-4126-ab97-6f2e7e2bf84c tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:48.114562 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b434a5f9-aec6-4126-ab97-6f2e7e2bf84c tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:48.115019 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b434a5f9-aec6-4126-ab97-6f2e7e2bf84c tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:48.342762 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b434a5f9-aec6-4126-ab97-6f2e7e2bf84c tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:48.353035 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b434a5f9-aec6-4126-ab97-6f2e7e2bf84c tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/bc6fa240-aadf-46d3-ae93-b90867f1ac36" status: 200 len: 1390 microversion: 2.1 time: 0.262800 Aug 27 03:17:48.353736 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2801/5641] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:48 2022] GET /compute/v2.1/servers/bc6fa240-aadf-46d3-ae93-b90867f1ac36 => generated 1390 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:48.375844 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-586dcf7c-842b-4469-9f18-4f9228a74ceb tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:48.376922 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-586dcf7c-842b-4469-9f18-4f9228a74ceb tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: bc6fa240-aadf-46d3-ae93-b90867f1ac36] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:48.384864 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-586dcf7c-842b-4469-9f18-4f9228a74ceb tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:48.385651 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-586dcf7c-842b-4469-9f18-4f9228a74ceb tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:48.386462 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-586dcf7c-842b-4469-9f18-4f9228a74ceb tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:48.387606 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-586dcf7c-842b-4469-9f18-4f9228a74ceb tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:48.388411 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-586dcf7c-842b-4469-9f18-4f9228a74ceb tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:48.389954 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-586dcf7c-842b-4469-9f18-4f9228a74ceb tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:48.587375 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-586dcf7c-842b-4469-9f18-4f9228a74ceb tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:48.598289 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-586dcf7c-842b-4469-9f18-4f9228a74ceb tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/bc6fa240-aadf-46d3-ae93-b90867f1ac36" status: 200 len: 1390 microversion: 2.1 time: 0.227764 Aug 27 03:17:48.601401 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2841/5642] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:48 2022] GET /compute/v2.1/servers/bc6fa240-aadf-46d3-ae93-b90867f1ac36 => generated 1390 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:48.618973 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-425f4cac-34ac-4788-8fd3-65c2d09c8431 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:48.619965 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-425f4cac-34ac-4788-8fd3-65c2d09c8431 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: bc6fa240-aadf-46d3-ae93-b90867f1ac36] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:48.633685 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-425f4cac-34ac-4788-8fd3-65c2d09c8431 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:48.634670 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-425f4cac-34ac-4788-8fd3-65c2d09c8431 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:48.635262 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-425f4cac-34ac-4788-8fd3-65c2d09c8431 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:48.636581 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-425f4cac-34ac-4788-8fd3-65c2d09c8431 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:48.637521 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-425f4cac-34ac-4788-8fd3-65c2d09c8431 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:48.638088 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-425f4cac-34ac-4788-8fd3-65c2d09c8431 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:48.845168 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-425f4cac-34ac-4788-8fd3-65c2d09c8431 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:48.855044 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-425f4cac-34ac-4788-8fd3-65c2d09c8431 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/bc6fa240-aadf-46d3-ae93-b90867f1ac36" status: 200 len: 1390 microversion: 2.1 time: 0.240780 Aug 27 03:17:48.855711 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2802/5643] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:48 2022] GET /compute/v2.1/servers/bc6fa240-aadf-46d3-ae93-b90867f1ac36 => generated 1390 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:48.874834 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d7b568f9-7a07-4efd-bf7a-99110afc9320 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:48.875667 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d7b568f9-7a07-4efd-bf7a-99110afc9320 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: bc6fa240-aadf-46d3-ae93-b90867f1ac36] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:48.882121 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d7b568f9-7a07-4efd-bf7a-99110afc9320 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:48.882735 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d7b568f9-7a07-4efd-bf7a-99110afc9320 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:48.883093 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d7b568f9-7a07-4efd-bf7a-99110afc9320 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:48.883973 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d7b568f9-7a07-4efd-bf7a-99110afc9320 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:48.884456 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d7b568f9-7a07-4efd-bf7a-99110afc9320 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:48.885077 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d7b568f9-7a07-4efd-bf7a-99110afc9320 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:48.912963 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d7b568f9-7a07-4efd-bf7a-99110afc9320 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: bc6fa240-aadf-46d3-ae93-b90867f1ac36] Going to try to terminate instance {{(pid=134051) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:17:49.022586 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d7b568f9-7a07-4efd-bf7a-99110afc9320 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "DELETE /compute/v2.1/servers/bc6fa240-aadf-46d3-ae93-b90867f1ac36" status: 204 len: 0 microversion: 2.1 time: 0.151200 Aug 27 03:17:49.023499 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2842/5644] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 03:17:48 2022] DELETE /compute/v2.1/servers/bc6fa240-aadf-46d3-ae93-b90867f1ac36 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:17:49.033171 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-eccafafb-92bc-4ec2-baa0-e3607ebae5df tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:49.034023 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-eccafafb-92bc-4ec2-baa0-e3607ebae5df tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: bc6fa240-aadf-46d3-ae93-b90867f1ac36] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:49.040821 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-eccafafb-92bc-4ec2-baa0-e3607ebae5df tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:49.041465 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-eccafafb-92bc-4ec2-baa0-e3607ebae5df tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:49.042074 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-eccafafb-92bc-4ec2-baa0-e3607ebae5df tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:49.042783 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-eccafafb-92bc-4ec2-baa0-e3607ebae5df tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:49.043500 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-eccafafb-92bc-4ec2-baa0-e3607ebae5df tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:49.043803 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-eccafafb-92bc-4ec2-baa0-e3607ebae5df tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:49.197178 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-eccafafb-92bc-4ec2-baa0-e3607ebae5df tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:49.206028 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-eccafafb-92bc-4ec2-baa0-e3607ebae5df tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/bc6fa240-aadf-46d3-ae93-b90867f1ac36" status: 200 len: 1396 microversion: 2.1 time: 0.177583 Aug 27 03:17:49.206838 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2803/5645] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:49 2022] GET /compute/v2.1/servers/bc6fa240-aadf-46d3-ae93-b90867f1ac36 => generated 1396 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:50.232723 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-34964679-394b-4b6c-b04a-1062397699da tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:50.233437 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-34964679-394b-4b6c-b04a-1062397699da tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: bc6fa240-aadf-46d3-ae93-b90867f1ac36] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:50.240670 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-34964679-394b-4b6c-b04a-1062397699da tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:50.241402 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-34964679-394b-4b6c-b04a-1062397699da tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:50.241840 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-34964679-394b-4b6c-b04a-1062397699da tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:50.242551 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-34964679-394b-4b6c-b04a-1062397699da tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:50.243153 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-34964679-394b-4b6c-b04a-1062397699da tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:50.243576 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-34964679-394b-4b6c-b04a-1062397699da tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:50.356140 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d540be27-2b0e-4fc2-a902-3f48da3bfd46 tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:50.357398 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d540be27-2b0e-4fc2-a902-3f48da3bfd46 tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] [instance: 0b7bdf3f-0f3f-4c1b-9a5b-c43cc7df7420] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:50.366105 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d540be27-2b0e-4fc2-a902-3f48da3bfd46 tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:50.366857 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d540be27-2b0e-4fc2-a902-3f48da3bfd46 tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:50.367581 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d540be27-2b0e-4fc2-a902-3f48da3bfd46 tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:50.368493 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d540be27-2b0e-4fc2-a902-3f48da3bfd46 tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:50.369229 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d540be27-2b0e-4fc2-a902-3f48da3bfd46 tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:50.369826 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d540be27-2b0e-4fc2-a902-3f48da3bfd46 tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:50.441772 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-34964679-394b-4b6c-b04a-1062397699da tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:50.453467 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-34964679-394b-4b6c-b04a-1062397699da tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/bc6fa240-aadf-46d3-ae93-b90867f1ac36" status: 200 len: 1396 microversion: 2.1 time: 0.224967 Aug 27 03:17:50.454601 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2843/5646] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:50 2022] GET /compute/v2.1/servers/bc6fa240-aadf-46d3-ae93-b90867f1ac36 => generated 1396 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:50.484940 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.instance [None req-d540be27-2b0e-4fc2-a902-3f48da3bfd46 tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Lazy-loading 'services' on Instance uuid 0b7bdf3f-0f3f-4c1b-9a5b-c43cc7df7420 {{(pid=134052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:17:50.561129 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d540be27-2b0e-4fc2-a902-3f48da3bfd46 tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] 10.222.0.70 "DELETE /compute/v2.1/servers/0b7bdf3f-0f3f-4c1b-9a5b-c43cc7df7420/os-volume_attachments/d9e54a7e-ce8e-4be3-ab70-d096758c87b1" status: 202 len: 0 microversion: 2.1 time: 0.209063 Aug 27 03:17:50.562277 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2804/5647] 10.222.0.70 () {58 vars in 1416 bytes} [Sat Aug 27 03:17:50 2022] DELETE /compute/v2.1/servers/0b7bdf3f-0f3f-4c1b-9a5b-c43cc7df7420/os-volume_attachments/d9e54a7e-ce8e-4be3-ab70-d096758c87b1 => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 03:17:51.477293 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c81cd3a0-f382-44c8-b4a6-8288a908534d tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:51.477907 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-c81cd3a0-f382-44c8-b4a6-8288a908534d tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: bc6fa240-aadf-46d3-ae93-b90867f1ac36] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:51.487072 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c81cd3a0-f382-44c8-b4a6-8288a908534d tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:51.491212 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c81cd3a0-f382-44c8-b4a6-8288a908534d tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:51.492619 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c81cd3a0-f382-44c8-b4a6-8288a908534d tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:51.493387 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c81cd3a0-f382-44c8-b4a6-8288a908534d tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:51.493933 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c81cd3a0-f382-44c8-b4a6-8288a908534d tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:51.494287 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c81cd3a0-f382-44c8-b4a6-8288a908534d tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:51.508950 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-7cc5c0e1-1863-430e-8a3c-3da641d43c63 req-41126952-0c8e-4268-aafc-2e50629a455f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc6fa240-aadf-46d3-ae93-b90867f1ac36", "name": "network-vif-deleted", "tag": "738d89db-787e-461b-975d-2d1918e2f9cd"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:17:51.529634 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-7cc5c0e1-1863-430e-8a3c-3da641d43c63 req-41126952-0c8e-4268-aafc-2e50629a455f service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:51.530393 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-7cc5c0e1-1863-430e-8a3c-3da641d43c63 req-41126952-0c8e-4268-aafc-2e50629a455f service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:51.530973 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-7cc5c0e1-1863-430e-8a3c-3da641d43c63 req-41126952-0c8e-4268-aafc-2e50629a455f service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:51.559684 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-7cc5c0e1-1863-430e-8a3c-3da641d43c63 req-41126952-0c8e-4268-aafc-2e50629a455f service nova] Creating event network-vif-deleted:738d89db-787e-461b-975d-2d1918e2f9cd for instance bc6fa240-aadf-46d3-ae93-b90867f1ac36 on n-h1-852278-4 Aug 27 03:17:51.590697 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-7cc5c0e1-1863-430e-8a3c-3da641d43c63 req-41126952-0c8e-4268-aafc-2e50629a455f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096739 Aug 27 03:17:51.593125 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2805/5648] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:17:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:17:51.610217 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-c81cd3a0-f382-44c8-b4a6-8288a908534d tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:51.622671 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c81cd3a0-f382-44c8-b4a6-8288a908534d tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/bc6fa240-aadf-46d3-ae93-b90867f1ac36" status: 200 len: 1354 microversion: 2.1 time: 0.149092 Aug 27 03:17:51.624039 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2844/5649] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:51 2022] GET /compute/v2.1/servers/bc6fa240-aadf-46d3-ae93-b90867f1ac36 => generated 1354 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:52.648294 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-00a7619f-6a8c-4bf2-ac98-777801b98776 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:52.649040 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-00a7619f-6a8c-4bf2-ac98-777801b98776 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: bc6fa240-aadf-46d3-ae93-b90867f1ac36] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:52.655572 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-00a7619f-6a8c-4bf2-ac98-777801b98776 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:52.656057 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-00a7619f-6a8c-4bf2-ac98-777801b98776 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:52.656592 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-00a7619f-6a8c-4bf2-ac98-777801b98776 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:52.657294 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-00a7619f-6a8c-4bf2-ac98-777801b98776 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:52.657742 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-00a7619f-6a8c-4bf2-ac98-777801b98776 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:52.658164 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-00a7619f-6a8c-4bf2-ac98-777801b98776 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:52.726826 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-00a7619f-6a8c-4bf2-ac98-777801b98776 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:52.739419 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-00a7619f-6a8c-4bf2-ac98-777801b98776 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/bc6fa240-aadf-46d3-ae93-b90867f1ac36" status: 200 len: 1188 microversion: 2.1 time: 0.096261 Aug 27 03:17:52.740388 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2806/5650] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:52 2022] GET /compute/v2.1/servers/bc6fa240-aadf-46d3-ae93-b90867f1ac36 => generated 1188 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:53.759414 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8fb9ff2f-326f-4e9a-a83e-8a42291ca0fc tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:53.760140 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-8fb9ff2f-326f-4e9a-a83e-8a42291ca0fc tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: bc6fa240-aadf-46d3-ae93-b90867f1ac36] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:53.767770 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8fb9ff2f-326f-4e9a-a83e-8a42291ca0fc tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:53.768271 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8fb9ff2f-326f-4e9a-a83e-8a42291ca0fc tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:53.768747 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8fb9ff2f-326f-4e9a-a83e-8a42291ca0fc tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:53.769442 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8fb9ff2f-326f-4e9a-a83e-8a42291ca0fc tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:53.769896 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8fb9ff2f-326f-4e9a-a83e-8a42291ca0fc tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:53.770323 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8fb9ff2f-326f-4e9a-a83e-8a42291ca0fc tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:53.835301 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-8fb9ff2f-326f-4e9a-a83e-8a42291ca0fc tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:53.843612 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-8fb9ff2f-326f-4e9a-a83e-8a42291ca0fc tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/bc6fa240-aadf-46d3-ae93-b90867f1ac36" status: 200 len: 1188 microversion: 2.1 time: 0.088186 Aug 27 03:17:53.844170 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2845/5651] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:53 2022] GET /compute/v2.1/servers/bc6fa240-aadf-46d3-ae93-b90867f1ac36 => generated 1188 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:54.865935 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8c81ac4f-4dac-412b-b0cf-ae5c6a549a39 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:54.866513 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-8c81ac4f-4dac-412b-b0cf-ae5c6a549a39 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: bc6fa240-aadf-46d3-ae93-b90867f1ac36] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:54.873723 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8c81ac4f-4dac-412b-b0cf-ae5c6a549a39 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:54.874217 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8c81ac4f-4dac-412b-b0cf-ae5c6a549a39 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:54.874653 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8c81ac4f-4dac-412b-b0cf-ae5c6a549a39 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:54.875353 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8c81ac4f-4dac-412b-b0cf-ae5c6a549a39 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:54.875799 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8c81ac4f-4dac-412b-b0cf-ae5c6a549a39 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:54.876199 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8c81ac4f-4dac-412b-b0cf-ae5c6a549a39 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:54.939642 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-8c81ac4f-4dac-412b-b0cf-ae5c6a549a39 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:54.948413 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-8c81ac4f-4dac-412b-b0cf-ae5c6a549a39 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/bc6fa240-aadf-46d3-ae93-b90867f1ac36" status: 200 len: 1188 microversion: 2.1 time: 0.088064 Aug 27 03:17:54.948998 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2807/5652] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:54 2022] GET /compute/v2.1/servers/bc6fa240-aadf-46d3-ae93-b90867f1ac36 => generated 1188 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:55.318205 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-321d4036-60c7-4a73-a9aa-0a9777e34348 tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:55.318953 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-321d4036-60c7-4a73-a9aa-0a9777e34348 tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] [instance: 0b7bdf3f-0f3f-4c1b-9a5b-c43cc7df7420] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:55.327218 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-321d4036-60c7-4a73-a9aa-0a9777e34348 tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:55.328033 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-321d4036-60c7-4a73-a9aa-0a9777e34348 tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:55.328730 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-321d4036-60c7-4a73-a9aa-0a9777e34348 tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:55.329659 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-321d4036-60c7-4a73-a9aa-0a9777e34348 tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:55.330410 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-321d4036-60c7-4a73-a9aa-0a9777e34348 tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:55.331051 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-321d4036-60c7-4a73-a9aa-0a9777e34348 tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:55.363506 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-321d4036-60c7-4a73-a9aa-0a9777e34348 tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] [instance: 0b7bdf3f-0f3f-4c1b-9a5b-c43cc7df7420] Going to try to terminate instance {{(pid=134051) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:17:55.420959 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:17:55.459013 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-321d4036-60c7-4a73-a9aa-0a9777e34348 tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] 10.222.0.70 "DELETE /compute/v2.1/servers/0b7bdf3f-0f3f-4c1b-9a5b-c43cc7df7420" status: 204 len: 0 microversion: 2.1 time: 0.144609 Aug 27 03:17:55.460724 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2846/5653] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 03:17:55 2022] DELETE /compute/v2.1/servers/0b7bdf3f-0f3f-4c1b-9a5b-c43cc7df7420 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:17:55.469933 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0c47f5fc-4a9b-4d8e-8119-253404d0491f tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:55.470549 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-0c47f5fc-4a9b-4d8e-8119-253404d0491f tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] [instance: 0b7bdf3f-0f3f-4c1b-9a5b-c43cc7df7420] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:55.477918 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0c47f5fc-4a9b-4d8e-8119-253404d0491f tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:55.478432 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0c47f5fc-4a9b-4d8e-8119-253404d0491f tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:55.479046 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0c47f5fc-4a9b-4d8e-8119-253404d0491f tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:55.479832 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0c47f5fc-4a9b-4d8e-8119-253404d0491f tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:55.480288 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0c47f5fc-4a9b-4d8e-8119-253404d0491f tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:55.480733 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0c47f5fc-4a9b-4d8e-8119-253404d0491f tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:55.621635 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0c47f5fc-4a9b-4d8e-8119-253404d0491f tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab36c57cb91a48d4b9f5500fb46f43ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b6250339865435391ef90912db5f0c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:55.629293 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-0c47f5fc-4a9b-4d8e-8119-253404d0491f tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] 10.222.0.70 "GET /compute/v2.1/servers/0b7bdf3f-0f3f-4c1b-9a5b-c43cc7df7420" status: 200 len: 1469 microversion: 2.1 time: 0.163386 Aug 27 03:17:55.630137 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2808/5654] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:55 2022] GET /compute/v2.1/servers/0b7bdf3f-0f3f-4c1b-9a5b-c43cc7df7420 => generated 1469 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:17:55.969257 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c1120bea-04af-4562-884f-6ea1008191ad tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:55.969971 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-c1120bea-04af-4562-884f-6ea1008191ad tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: bc6fa240-aadf-46d3-ae93-b90867f1ac36] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:55.976859 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c1120bea-04af-4562-884f-6ea1008191ad tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:55.977397 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c1120bea-04af-4562-884f-6ea1008191ad tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:55.977794 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c1120bea-04af-4562-884f-6ea1008191ad tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:55.978718 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c1120bea-04af-4562-884f-6ea1008191ad tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:55.979335 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c1120bea-04af-4562-884f-6ea1008191ad tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:55.979762 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c1120bea-04af-4562-884f-6ea1008191ad tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:56.050531 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-c1120bea-04af-4562-884f-6ea1008191ad tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:56.058786 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c1120bea-04af-4562-884f-6ea1008191ad tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/bc6fa240-aadf-46d3-ae93-b90867f1ac36" status: 200 len: 1188 microversion: 2.1 time: 0.094081 Aug 27 03:17:56.061653 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2847/5655] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:55 2022] GET /compute/v2.1/servers/bc6fa240-aadf-46d3-ae93-b90867f1ac36 => generated 1188 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:56.651126 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c6929807-46e3-471f-8515-a11bb2ad5dbc tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:56.652105 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-c6929807-46e3-471f-8515-a11bb2ad5dbc tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] [instance: 0b7bdf3f-0f3f-4c1b-9a5b-c43cc7df7420] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:56.663966 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c6929807-46e3-471f-8515-a11bb2ad5dbc tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:56.664706 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c6929807-46e3-471f-8515-a11bb2ad5dbc tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:56.665399 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c6929807-46e3-471f-8515-a11bb2ad5dbc tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:56.666332 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c6929807-46e3-471f-8515-a11bb2ad5dbc tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:56.667009 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c6929807-46e3-471f-8515-a11bb2ad5dbc tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:56.667534 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c6929807-46e3-471f-8515-a11bb2ad5dbc tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:56.820998 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-c6929807-46e3-471f-8515-a11bb2ad5dbc tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab36c57cb91a48d4b9f5500fb46f43ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b6250339865435391ef90912db5f0c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:56.830205 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c6929807-46e3-471f-8515-a11bb2ad5dbc tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] 10.222.0.70 "GET /compute/v2.1/servers/0b7bdf3f-0f3f-4c1b-9a5b-c43cc7df7420" status: 200 len: 1469 microversion: 2.1 time: 0.182826 Aug 27 03:17:56.830818 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2809/5656] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:56 2022] GET /compute/v2.1/servers/0b7bdf3f-0f3f-4c1b-9a5b-c43cc7df7420 => generated 1469 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:57.081218 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-69d1506a-d5ba-4df2-bab0-15f13ed4b963 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:57.083071 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-69d1506a-d5ba-4df2-bab0-15f13ed4b963 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: bc6fa240-aadf-46d3-ae93-b90867f1ac36] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:57.092387 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-69d1506a-d5ba-4df2-bab0-15f13ed4b963 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:57.093469 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-69d1506a-d5ba-4df2-bab0-15f13ed4b963 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:57.095091 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-69d1506a-d5ba-4df2-bab0-15f13ed4b963 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:57.097164 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-69d1506a-d5ba-4df2-bab0-15f13ed4b963 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:57.098033 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-69d1506a-d5ba-4df2-bab0-15f13ed4b963 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:57.098681 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-69d1506a-d5ba-4df2-bab0-15f13ed4b963 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:57.222086 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-69d1506a-d5ba-4df2-bab0-15f13ed4b963 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:57.234183 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-69d1506a-d5ba-4df2-bab0-15f13ed4b963 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/bc6fa240-aadf-46d3-ae93-b90867f1ac36" status: 200 len: 1188 microversion: 2.1 time: 0.157995 Aug 27 03:17:57.236762 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2848/5657] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:57 2022] GET /compute/v2.1/servers/bc6fa240-aadf-46d3-ae93-b90867f1ac36 => generated 1188 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:57.547067 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-44f96cc2-7480-4ed2-ada9-da1d671060b6 req-5f084ce6-5e88-4dd6-a0fe-04eefdb05a98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b7bdf3f-0f3f-4c1b-9a5b-c43cc7df7420", "name": "network-vif-deleted", "tag": "50207fcd-ebfe-4bcf-9b4c-d06fa9db0693"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:17:57.559932 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-44f96cc2-7480-4ed2-ada9-da1d671060b6 req-5f084ce6-5e88-4dd6-a0fe-04eefdb05a98 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:57.560459 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-44f96cc2-7480-4ed2-ada9-da1d671060b6 req-5f084ce6-5e88-4dd6-a0fe-04eefdb05a98 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:57.560921 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-44f96cc2-7480-4ed2-ada9-da1d671060b6 req-5f084ce6-5e88-4dd6-a0fe-04eefdb05a98 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:57.576059 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-44f96cc2-7480-4ed2-ada9-da1d671060b6 req-5f084ce6-5e88-4dd6-a0fe-04eefdb05a98 service nova] Creating event network-vif-deleted:50207fcd-ebfe-4bcf-9b4c-d06fa9db0693 for instance 0b7bdf3f-0f3f-4c1b-9a5b-c43cc7df7420 on n-h2-852278-4 Aug 27 03:17:57.584623 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-44f96cc2-7480-4ed2-ada9-da1d671060b6 req-5f084ce6-5e88-4dd6-a0fe-04eefdb05a98 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041106 Aug 27 03:17:57.585875 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2810/5658] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:17:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:17:57.851580 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-dc1a9fc8-61ca-41d4-99fe-3fdee9db9cea tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:57.852437 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-dc1a9fc8-61ca-41d4-99fe-3fdee9db9cea tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] [instance: 0b7bdf3f-0f3f-4c1b-9a5b-c43cc7df7420] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:57.859122 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dc1a9fc8-61ca-41d4-99fe-3fdee9db9cea tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:57.859868 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dc1a9fc8-61ca-41d4-99fe-3fdee9db9cea tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:57.860523 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dc1a9fc8-61ca-41d4-99fe-3fdee9db9cea tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:57.861540 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dc1a9fc8-61ca-41d4-99fe-3fdee9db9cea tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:57.862201 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dc1a9fc8-61ca-41d4-99fe-3fdee9db9cea tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:57.862782 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dc1a9fc8-61ca-41d4-99fe-3fdee9db9cea tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:57.923814 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dc1a9fc8-61ca-41d4-99fe-3fdee9db9cea tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:57.924378 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dc1a9fc8-61ca-41d4-99fe-3fdee9db9cea tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:57.924828 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dc1a9fc8-61ca-41d4-99fe-3fdee9db9cea tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:57.925285 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.objects.instance [None req-dc1a9fc8-61ca-41d4-99fe-3fdee9db9cea tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Lazy-loading 'fault' on Instance uuid 0b7bdf3f-0f3f-4c1b-9a5b-c43cc7df7420 {{(pid=134051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:17:58.019328 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-dc1a9fc8-61ca-41d4-99fe-3fdee9db9cea tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab36c57cb91a48d4b9f5500fb46f43ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b6250339865435391ef90912db5f0c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:58.028838 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-dc1a9fc8-61ca-41d4-99fe-3fdee9db9cea tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] 10.222.0.70 "GET /compute/v2.1/servers/0b7bdf3f-0f3f-4c1b-9a5b-c43cc7df7420" status: 200 len: 1303 microversion: 2.1 time: 0.181459 Aug 27 03:17:58.030443 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2849/5659] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:57 2022] GET /compute/v2.1/servers/0b7bdf3f-0f3f-4c1b-9a5b-c43cc7df7420 => generated 1303 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:58.256158 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a822ddd6-e44f-451c-a494-921d0dbf9040 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:58.257527 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a822ddd6-e44f-451c-a494-921d0dbf9040 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: bc6fa240-aadf-46d3-ae93-b90867f1ac36] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:58.265248 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a822ddd6-e44f-451c-a494-921d0dbf9040 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:58.265921 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a822ddd6-e44f-451c-a494-921d0dbf9040 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:58.266511 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a822ddd6-e44f-451c-a494-921d0dbf9040 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:58.267351 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a822ddd6-e44f-451c-a494-921d0dbf9040 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:58.267947 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a822ddd6-e44f-451c-a494-921d0dbf9040 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:58.268571 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a822ddd6-e44f-451c-a494-921d0dbf9040 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:58.333695 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-a822ddd6-e44f-451c-a494-921d0dbf9040 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:58.342373 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a822ddd6-e44f-451c-a494-921d0dbf9040 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/bc6fa240-aadf-46d3-ae93-b90867f1ac36" status: 200 len: 1188 microversion: 2.1 time: 0.090761 Aug 27 03:17:58.342959 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2811/5660] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:58 2022] GET /compute/v2.1/servers/bc6fa240-aadf-46d3-ae93-b90867f1ac36 => generated 1188 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:59.051188 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-9e3753f0-6497-495c-91cc-222759c581ef tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:59.051791 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-9e3753f0-6497-495c-91cc-222759c581ef tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] [instance: 0b7bdf3f-0f3f-4c1b-9a5b-c43cc7df7420] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:59.058986 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9e3753f0-6497-495c-91cc-222759c581ef tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:59.059467 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9e3753f0-6497-495c-91cc-222759c581ef tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:59.059903 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9e3753f0-6497-495c-91cc-222759c581ef tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:59.060617 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9e3753f0-6497-495c-91cc-222759c581ef tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:59.061064 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9e3753f0-6497-495c-91cc-222759c581ef tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:59.061480 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9e3753f0-6497-495c-91cc-222759c581ef tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:59.075844 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-9e3753f0-6497-495c-91cc-222759c581ef tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] HTTP exception thrown: Instance 0b7bdf3f-0f3f-4c1b-9a5b-c43cc7df7420 could not be found. Aug 27 03:17:59.077543 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-9e3753f0-6497-495c-91cc-222759c581ef tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Request method failure captured: Aug 27 03:17:59.077543 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/0b7bdf3f-0f3f-4c1b-9a5b-c43cc7df7420 HTTP/1.1 Aug 27 03:17:59.077543 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 03:17:59.077543 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 03:17:59.077543 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 03:17:59.077543 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 03:17:59.077543 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 03:17:59.077543 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 03:17:59.077543 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 03:17:59.077543 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 03:17:59.077543 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYyHHwy8W_15uI5Zpi4-v-MzwSyhDHrkJDJ-GYYldTQjY1qZN4qxUd7ep-LFXcZAnjSNxSP3ii4VCO9_5XSAdb0DIHj-01v4vMMYgkH_kKKxOzXkTUKV8QNErPDMctW5fdwgI89KMX_km1OjVQDnhm7UBLXnkocQvgdaXohMjMEMl-k Aug 27 03:17:59.077543 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 03:17:59.077543 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 03:17:59.077543 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 03:17:59.077543 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 03:17:59.077543 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 03:17:59.077543 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 03:17:59.077543 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 5b6250339865435391ef90912db5f0c8 Aug 27 03:17:59.077543 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-VolumesBackupsTest-1866995560 Aug 27 03:17:59.077543 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 03:17:59.077543 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 03:17:59.077543 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5b6250339865435391ef90912db5f0c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_5b6250339865435391ef90912db5f0c8", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5b6250339865435391ef90912db5f0c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/5b6250339865435391ef90912db5f0c8"}]}] Aug 27 03:17:59.077543 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-VolumesBackupsTest-1866995560 Aug 27 03:17:59.077543 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 5b6250339865435391ef90912db5f0c8 Aug 27 03:17:59.077543 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-VolumesBackupsTest-1866995560 Aug 27 03:17:59.077543 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-VolumesBackupsTest-1866995560-project Aug 27 03:17:59.077543 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 03:17:59.077543 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 03:17:59.077543 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: ab36c57cb91a48d4b9f5500fb46f43ce Aug 27 03:17:59.077543 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-VolumesBackupsTest-1866995560-project Aug 27 03:17:59.077543 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 03:17:59.077543 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance 0b7bdf3f-0f3f-4c1b-9a5b-c43cc7df7420 could not be found. Aug 27 03:17:59.077543 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '0b7bdf3f-0f3f-4c1b-9a5b-c43cc7df7420'} Aug 27 03:17:59.077543 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:17:59.077543 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:17:59.077543 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:17:59.077543 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:17:59.077543 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:17:59.077543 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:17:59.077543 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:17:59.077543 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:17:59.077543 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:17:59.077543 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:17:59.077543 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b7bdf3f-0f3f-4c1b-9a5b-c43cc7df7420 could not be found. Aug 27 03:17:59.077543 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:17:59.077543 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:17:59.077543 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:17:59.077543 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:17:59.077543 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:17:59.077543 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:17:59.077543 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:17:59.077543 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:17:59.077543 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:17:59.077543 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:17:59.077543 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:17:59.077543 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:17:59.077543 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:17:59.077543 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:17:59.077543 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:17:59.077543 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:17:59.077543 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b7bdf3f-0f3f-4c1b-9a5b-c43cc7df7420 could not be found. Aug 27 03:17:59.077543 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:17:59.077543 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:17:59.077543 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:17:59.082017 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:17:59.082017 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:17:59.082017 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:17:59.082017 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:17:59.082017 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:17:59.082017 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b7bdf3f-0f3f-4c1b-9a5b-c43cc7df7420 could not be found. Aug 27 03:17:59.082017 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:17:59.082017 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-9e3753f0-6497-495c-91cc-222759c581ef tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] Returning 404 to user: Instance 0b7bdf3f-0f3f-4c1b-9a5b-c43cc7df7420 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:17:59.082017 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-9e3753f0-6497-495c-91cc-222759c581ef tempest-VolumesBackupsTest-1866995560 tempest-VolumesBackupsTest-1866995560-project] 10.222.0.70 "GET /compute/v2.1/servers/0b7bdf3f-0f3f-4c1b-9a5b-c43cc7df7420" status: 404 len: 111 microversion: 2.1 time: 0.031754 Aug 27 03:17:59.082017 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2850/5661] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:59 2022] GET /compute/v2.1/servers/0b7bdf3f-0f3f-4c1b-9a5b-c43cc7df7420 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:17:59.365435 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-1a41f709-94ba-41d2-949f-49c4eef33d7e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:59.366278 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-1a41f709-94ba-41d2-949f-49c4eef33d7e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: bc6fa240-aadf-46d3-ae93-b90867f1ac36] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:59.375412 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1a41f709-94ba-41d2-949f-49c4eef33d7e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:59.376261 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1a41f709-94ba-41d2-949f-49c4eef33d7e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:59.376945 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1a41f709-94ba-41d2-949f-49c4eef33d7e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:59.377859 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1a41f709-94ba-41d2-949f-49c4eef33d7e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:59.378586 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1a41f709-94ba-41d2-949f-49c4eef33d7e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:59.379325 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1a41f709-94ba-41d2-949f-49c4eef33d7e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:59.384479 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:17:59.447896 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-1a41f709-94ba-41d2-949f-49c4eef33d7e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:59.457645 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-1a41f709-94ba-41d2-949f-49c4eef33d7e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/bc6fa240-aadf-46d3-ae93-b90867f1ac36" status: 200 len: 1188 microversion: 2.1 time: 0.097676 Aug 27 03:17:59.458942 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2812/5662] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:59 2022] GET /compute/v2.1/servers/bc6fa240-aadf-46d3-ae93-b90867f1ac36 => generated 1188 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:00.482588 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c804f509-3161-4c3e-9995-1579fa9bb2cf tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:00.485093 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-c804f509-3161-4c3e-9995-1579fa9bb2cf tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: bc6fa240-aadf-46d3-ae93-b90867f1ac36] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:00.491212 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:18:00.497917 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c804f509-3161-4c3e-9995-1579fa9bb2cf tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:00.501333 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c804f509-3161-4c3e-9995-1579fa9bb2cf tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:00.502215 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c804f509-3161-4c3e-9995-1579fa9bb2cf tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:00.503194 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c804f509-3161-4c3e-9995-1579fa9bb2cf tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:00.505109 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c804f509-3161-4c3e-9995-1579fa9bb2cf tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:00.505784 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c804f509-3161-4c3e-9995-1579fa9bb2cf tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:00.534665 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-c804f509-3161-4c3e-9995-1579fa9bb2cf tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] HTTP exception thrown: Instance bc6fa240-aadf-46d3-ae93-b90867f1ac36 could not be found. Aug 27 03:18:00.538260 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c804f509-3161-4c3e-9995-1579fa9bb2cf tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Request method failure captured: Aug 27 03:18:00.538260 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/bc6fa240-aadf-46d3-ae93-b90867f1ac36 HTTP/1.1 Aug 27 03:18:00.538260 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 03:18:00.538260 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 03:18:00.538260 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 03:18:00.538260 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 03:18:00.538260 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 03:18:00.538260 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 03:18:00.538260 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 03:18:00.538260 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 03:18:00.538260 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYyanRmSitPtUh4DIDjvAfp5Iiwg8r3Bf9-rjIalvb44wIYhFzVkZDLPIdVwR9rbE-qHDjS_3-JeB9MrxSXFOtiOWUfHFokH2CMOJ34en6s6KyuDM-ix0my9F59eD8M1zowb_BqVFIaTj9p6YHs85SeVo0SCpB1hAOakQSi3_cd8UVk Aug 27 03:18:00.538260 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 03:18:00.538260 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 03:18:00.538260 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 03:18:00.538260 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 03:18:00.538260 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 03:18:00.538260 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 03:18:00.538260 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 7b2673a034c24d1898493bfea9ca5d1d Aug 27 03:18:00.538260 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-TestVolumeBootPattern-2103223700 Aug 27 03:18:00.538260 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 03:18:00.538260 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 03:18:00.538260 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7b2673a034c24d1898493bfea9ca5d1d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_7b2673a034c24d1898493bfea9ca5d1d", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7b2673a034c24d1898493bfea9ca5d1d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/7b2673a034c24d1898493bfea9ca5d1d"}]}] Aug 27 03:18:00.538260 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-TestVolumeBootPattern-2103223700 Aug 27 03:18:00.538260 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 7b2673a034c24d1898493bfea9ca5d1d Aug 27 03:18:00.538260 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-TestVolumeBootPattern-2103223700 Aug 27 03:18:00.538260 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-TestVolumeBootPattern-2103223700-project Aug 27 03:18:00.538260 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 03:18:00.538260 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 03:18:00.538260 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 4aa867d7baa043b1b1e6763046463b3f Aug 27 03:18:00.538260 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-TestVolumeBootPattern-2103223700-project Aug 27 03:18:00.538260 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 03:18:00.538260 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance bc6fa240-aadf-46d3-ae93-b90867f1ac36 could not be found. Aug 27 03:18:00.538260 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': 'bc6fa240-aadf-46d3-ae93-b90867f1ac36'} Aug 27 03:18:00.538260 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:18:00.538260 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:00.538260 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:18:00.538260 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:18:00.538260 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:18:00.538260 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:18:00.538260 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:18:00.538260 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:18:00.538260 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:18:00.538260 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:18:00.538260 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc6fa240-aadf-46d3-ae93-b90867f1ac36 could not be found. Aug 27 03:18:00.538260 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:18:00.538260 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:18:00.538260 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:18:00.538260 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:00.538260 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:18:00.538260 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:18:00.538260 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:18:00.538260 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:18:00.538260 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:18:00.538260 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:18:00.538260 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:18:00.538260 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:18:00.538260 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:18:00.538260 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:18:00.538260 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:18:00.538260 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:18:00.538260 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc6fa240-aadf-46d3-ae93-b90867f1ac36 could not be found. Aug 27 03:18:00.538260 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:18:00.538260 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:18:00.538260 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:18:00.542147 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:00.542147 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:18:00.542147 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:18:00.542147 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:18:00.542147 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:18:00.542147 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc6fa240-aadf-46d3-ae93-b90867f1ac36 could not be found. Aug 27 03:18:00.542147 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:18:00.542147 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c804f509-3161-4c3e-9995-1579fa9bb2cf tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Returning 404 to user: Instance bc6fa240-aadf-46d3-ae93-b90867f1ac36 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:18:00.547722 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c804f509-3161-4c3e-9995-1579fa9bb2cf tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/bc6fa240-aadf-46d3-ae93-b90867f1ac36" status: 404 len: 111 microversion: 2.1 time: 0.072181 Aug 27 03:18:00.556883 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2851/5663] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:00 2022] GET /compute/v2.1/servers/bc6fa240-aadf-46d3-ae93-b90867f1ac36 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:18:29.720826 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-fdb09323-d88e-473a-a69d-9d4b082587f1 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-717566823", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "8eec45e1-8dba-4ab3-b166-759bbcbdb7ba", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "02524c0f-c44c-4ea0-899e-226a790199dc"}]}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:18:29.736995 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=41 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:18:29.738310 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=5 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:18:29.826844 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.network.neutron [None req-fdb09323-d88e-473a-a69d-9d4b082587f1 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] validate_networks() for [('02524c0f-c44c-4ea0-899e-226a790199dc', None, None, None, None, None)] {{(pid=134052) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:18:30.380764 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-fdb09323-d88e-473a-a69d-9d4b082587f1 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Flavor limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:18:30.381724 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-fdb09323-d88e-473a-a69d-9d4b082587f1 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Image limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:18:30.382372 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-fdb09323-d88e-473a-a69d-9d4b082587f1 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Flavor pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:18:30.382929 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-fdb09323-d88e-473a-a69d-9d4b082587f1 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Image pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:18:30.383497 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-fdb09323-d88e-473a-a69d-9d4b082587f1 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:18:30.393803 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fdb09323-d88e-473a-a69d-9d4b082587f1 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:30.394286 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fdb09323-d88e-473a-a69d-9d4b082587f1 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:30.394928 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fdb09323-d88e-473a-a69d-9d4b082587f1 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:30.395927 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fdb09323-d88e-473a-a69d-9d4b082587f1 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:30.396576 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fdb09323-d88e-473a-a69d-9d4b082587f1 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:30.396997 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fdb09323-d88e-473a-a69d-9d4b082587f1 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:30.417901 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-fdb09323-d88e-473a-a69d-9d4b082587f1 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Getting quotas for project 7b2673a034c24d1898493bfea9ca5d1d. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:18:30.424086 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-fdb09323-d88e-473a-a69d-9d4b082587f1 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Getting quotas for user 4aa867d7baa043b1b1e6763046463b3f and project 7b2673a034c24d1898493bfea9ca5d1d. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:18:30.438646 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-fdb09323-d88e-473a-a69d-9d4b082587f1 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Going to run 1 instances... {{(pid=134052) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:18:30.440958 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-fdb09323-d88e-473a-a69d-9d4b082587f1 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 2e6cb94a-6898-4441-9c34-8ccf3856e265] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='8eec45e1-8dba-4ab3-b166-759bbcbdb7ba',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134052) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:18:30.523669 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-fdb09323-d88e-473a-a69d-9d4b082587f1 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.806054 Aug 27 03:18:30.524651 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2813/5664] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 03:18:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 808 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 03:18:30.535377 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-1ebb5d9a-56fe-44fd-9044-0e81afc6c9db tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:30.536015 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-1ebb5d9a-56fe-44fd-9044-0e81afc6c9db tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 2e6cb94a-6898-4441-9c34-8ccf3856e265] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:30.538510 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=24 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:18:30.539137 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:18:30.644533 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-1ebb5d9a-56fe-44fd-9044-0e81afc6c9db tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:30.674059 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-1ebb5d9a-56fe-44fd-9044-0e81afc6c9db tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/2e6cb94a-6898-4441-9c34-8ccf3856e265" status: 200 len: 1056 microversion: 2.1 time: 0.142373 Aug 27 03:18:30.691476 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2852/5665] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:30 2022] GET /compute/v2.1/servers/2e6cb94a-6898-4441-9c34-8ccf3856e265 => generated 1056 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:31.700182 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9200973f-320f-4e50-bdfa-0bec90f9beeb tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:31.701603 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-9200973f-320f-4e50-bdfa-0bec90f9beeb tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 2e6cb94a-6898-4441-9c34-8ccf3856e265] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:31.710264 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9200973f-320f-4e50-bdfa-0bec90f9beeb tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:31.710973 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9200973f-320f-4e50-bdfa-0bec90f9beeb tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:31.711925 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9200973f-320f-4e50-bdfa-0bec90f9beeb tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:31.712694 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9200973f-320f-4e50-bdfa-0bec90f9beeb tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:31.713129 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9200973f-320f-4e50-bdfa-0bec90f9beeb tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:31.713615 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9200973f-320f-4e50-bdfa-0bec90f9beeb tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:31.799854 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-9200973f-320f-4e50-bdfa-0bec90f9beeb tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:31.809476 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9200973f-320f-4e50-bdfa-0bec90f9beeb tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/2e6cb94a-6898-4441-9c34-8ccf3856e265" status: 200 len: 1116 microversion: 2.1 time: 0.114548 Aug 27 03:18:31.810285 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2814/5666] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:31 2022] GET /compute/v2.1/servers/2e6cb94a-6898-4441-9c34-8ccf3856e265 => generated 1116 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:32.831308 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-104700b2-45de-4420-9404-0f4906fde276 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:32.831935 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-104700b2-45de-4420-9404-0f4906fde276 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 2e6cb94a-6898-4441-9c34-8ccf3856e265] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:33.201519 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-104700b2-45de-4420-9404-0f4906fde276 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:33.202124 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-104700b2-45de-4420-9404-0f4906fde276 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:33.202747 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-104700b2-45de-4420-9404-0f4906fde276 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:33.203682 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-104700b2-45de-4420-9404-0f4906fde276 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:33.204365 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-104700b2-45de-4420-9404-0f4906fde276 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:33.205031 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-104700b2-45de-4420-9404-0f4906fde276 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:33.353033 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-104700b2-45de-4420-9404-0f4906fde276 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:33.362220 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-104700b2-45de-4420-9404-0f4906fde276 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/2e6cb94a-6898-4441-9c34-8ccf3856e265" status: 200 len: 1168 microversion: 2.1 time: 0.535696 Aug 27 03:18:33.363663 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2853/5667] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:32 2022] GET /compute/v2.1/servers/2e6cb94a-6898-4441-9c34-8ccf3856e265 => generated 1168 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:33.614904 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-3042d756-6d98-4b22-b27d-607bb66deeb4 req-f2be5e96-0d25-4ac1-8fd0-a28e04a2b5f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e6cb94a-6898-4441-9c34-8ccf3856e265", "tag": "14a2ac8c-729f-42ec-94dd-21f1b077ba45"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:18:33.635214 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-3042d756-6d98-4b22-b27d-607bb66deeb4 req-f2be5e96-0d25-4ac1-8fd0-a28e04a2b5f4 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:33.635685 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-3042d756-6d98-4b22-b27d-607bb66deeb4 req-f2be5e96-0d25-4ac1-8fd0-a28e04a2b5f4 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:33.636341 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-3042d756-6d98-4b22-b27d-607bb66deeb4 req-f2be5e96-0d25-4ac1-8fd0-a28e04a2b5f4 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:33.675979 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-3042d756-6d98-4b22-b27d-607bb66deeb4 req-f2be5e96-0d25-4ac1-8fd0-a28e04a2b5f4 service nova] Creating event network-changed:14a2ac8c-729f-42ec-94dd-21f1b077ba45 for instance 2e6cb94a-6898-4441-9c34-8ccf3856e265 on n-h1-852278-4 Aug 27 03:18:33.683906 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-3042d756-6d98-4b22-b27d-607bb66deeb4 req-f2be5e96-0d25-4ac1-8fd0-a28e04a2b5f4 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073276 Aug 27 03:18:33.684567 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2815/5668] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:18:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:18:34.383349 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-571353de-1373-4af7-987b-42c3764c3ccc tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:34.384101 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-571353de-1373-4af7-987b-42c3764c3ccc tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 2e6cb94a-6898-4441-9c34-8ccf3856e265] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:34.393264 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-571353de-1373-4af7-987b-42c3764c3ccc tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:34.396635 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-571353de-1373-4af7-987b-42c3764c3ccc tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:34.399380 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-571353de-1373-4af7-987b-42c3764c3ccc tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:34.400229 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-571353de-1373-4af7-987b-42c3764c3ccc tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:34.402115 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-571353de-1373-4af7-987b-42c3764c3ccc tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:34.402631 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-571353de-1373-4af7-987b-42c3764c3ccc tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:34.593359 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-571353de-1373-4af7-987b-42c3764c3ccc tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:34.604739 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-571353de-1373-4af7-987b-42c3764c3ccc tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/2e6cb94a-6898-4441-9c34-8ccf3856e265" status: 200 len: 1168 microversion: 2.1 time: 0.224243 Aug 27 03:18:34.613580 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2854/5669] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:34 2022] GET /compute/v2.1/servers/2e6cb94a-6898-4441-9c34-8ccf3856e265 => generated 1168 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:18:35.634732 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-db1e064a-4a1f-4565-ad3c-4c8f561d421e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:35.635535 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-db1e064a-4a1f-4565-ad3c-4c8f561d421e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 2e6cb94a-6898-4441-9c34-8ccf3856e265] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:35.646146 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-db1e064a-4a1f-4565-ad3c-4c8f561d421e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:35.646692 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-db1e064a-4a1f-4565-ad3c-4c8f561d421e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:35.647127 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-db1e064a-4a1f-4565-ad3c-4c8f561d421e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:35.647934 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-db1e064a-4a1f-4565-ad3c-4c8f561d421e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:35.648591 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-db1e064a-4a1f-4565-ad3c-4c8f561d421e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:35.649020 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-db1e064a-4a1f-4565-ad3c-4c8f561d421e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:35.802508 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-db1e064a-4a1f-4565-ad3c-4c8f561d421e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:35.811543 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-db1e064a-4a1f-4565-ad3c-4c8f561d421e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/2e6cb94a-6898-4441-9c34-8ccf3856e265" status: 200 len: 1168 microversion: 2.1 time: 0.189323 Aug 27 03:18:35.812071 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2816/5670] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:35 2022] GET /compute/v2.1/servers/2e6cb94a-6898-4441-9c34-8ccf3856e265 => generated 1168 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:36.836873 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-168dde8d-aec2-42ca-86fc-38b4c4eef544 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:36.838083 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-168dde8d-aec2-42ca-86fc-38b4c4eef544 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 2e6cb94a-6898-4441-9c34-8ccf3856e265] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:36.844543 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-168dde8d-aec2-42ca-86fc-38b4c4eef544 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:36.845268 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-168dde8d-aec2-42ca-86fc-38b4c4eef544 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:36.845866 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-168dde8d-aec2-42ca-86fc-38b4c4eef544 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:36.846734 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-168dde8d-aec2-42ca-86fc-38b4c4eef544 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:36.847373 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-168dde8d-aec2-42ca-86fc-38b4c4eef544 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:36.848010 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-168dde8d-aec2-42ca-86fc-38b4c4eef544 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:37.104581 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-168dde8d-aec2-42ca-86fc-38b4c4eef544 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:37.114559 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-168dde8d-aec2-42ca-86fc-38b4c4eef544 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/2e6cb94a-6898-4441-9c34-8ccf3856e265" status: 200 len: 1168 microversion: 2.1 time: 0.282574 Aug 27 03:18:37.115758 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2855/5671] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:36 2022] GET /compute/v2.1/servers/2e6cb94a-6898-4441-9c34-8ccf3856e265 => generated 1168 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:38.143062 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-797d49c7-ee47-4e64-879b-94bba5b5b971 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:38.144752 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-797d49c7-ee47-4e64-879b-94bba5b5b971 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 2e6cb94a-6898-4441-9c34-8ccf3856e265] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:38.153226 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-797d49c7-ee47-4e64-879b-94bba5b5b971 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:38.153771 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-797d49c7-ee47-4e64-879b-94bba5b5b971 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:38.154386 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-797d49c7-ee47-4e64-879b-94bba5b5b971 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:38.155372 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-797d49c7-ee47-4e64-879b-94bba5b5b971 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:38.155979 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-797d49c7-ee47-4e64-879b-94bba5b5b971 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:38.156781 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-797d49c7-ee47-4e64-879b-94bba5b5b971 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:38.345114 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-797d49c7-ee47-4e64-879b-94bba5b5b971 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:38.353785 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-797d49c7-ee47-4e64-879b-94bba5b5b971 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/2e6cb94a-6898-4441-9c34-8ccf3856e265" status: 200 len: 1168 microversion: 2.1 time: 0.215448 Aug 27 03:18:38.366740 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2817/5672] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:38 2022] GET /compute/v2.1/servers/2e6cb94a-6898-4441-9c34-8ccf3856e265 => generated 1168 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:39.376416 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-743da1a8-089b-40f5-ba05-4422e6dc845b tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:39.377046 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-743da1a8-089b-40f5-ba05-4422e6dc845b tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 2e6cb94a-6898-4441-9c34-8ccf3856e265] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:39.389719 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-743da1a8-089b-40f5-ba05-4422e6dc845b tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:39.390259 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-743da1a8-089b-40f5-ba05-4422e6dc845b tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:39.390670 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-743da1a8-089b-40f5-ba05-4422e6dc845b tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:39.391660 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-743da1a8-089b-40f5-ba05-4422e6dc845b tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:39.392370 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-743da1a8-089b-40f5-ba05-4422e6dc845b tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:39.393020 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-743da1a8-089b-40f5-ba05-4422e6dc845b tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:39.591321 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-743da1a8-089b-40f5-ba05-4422e6dc845b tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:39.609379 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-743da1a8-089b-40f5-ba05-4422e6dc845b tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/2e6cb94a-6898-4441-9c34-8ccf3856e265" status: 200 len: 1168 microversion: 2.1 time: 0.236392 Aug 27 03:18:39.609722 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2856/5673] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:39 2022] GET /compute/v2.1/servers/2e6cb94a-6898-4441-9c34-8ccf3856e265 => generated 1168 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:18:40.636789 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6e7d9e69-0e0a-46ec-91e0-87827f9a538a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:40.638023 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-6e7d9e69-0e0a-46ec-91e0-87827f9a538a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 2e6cb94a-6898-4441-9c34-8ccf3856e265] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:40.641307 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:18:40.644460 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=6 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:18:40.654643 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6e7d9e69-0e0a-46ec-91e0-87827f9a538a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:40.661301 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6e7d9e69-0e0a-46ec-91e0-87827f9a538a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:40.661908 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6e7d9e69-0e0a-46ec-91e0-87827f9a538a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:40.662878 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6e7d9e69-0e0a-46ec-91e0-87827f9a538a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:40.673298 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6e7d9e69-0e0a-46ec-91e0-87827f9a538a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:40.674161 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6e7d9e69-0e0a-46ec-91e0-87827f9a538a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:40.938791 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-6e7d9e69-0e0a-46ec-91e0-87827f9a538a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:40.947295 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-6e7d9e69-0e0a-46ec-91e0-87827f9a538a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/2e6cb94a-6898-4441-9c34-8ccf3856e265" status: 200 len: 1168 microversion: 2.1 time: 0.314631 Aug 27 03:18:40.968847 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2818/5674] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:40 2022] GET /compute/v2.1/servers/2e6cb94a-6898-4441-9c34-8ccf3856e265 => generated 1168 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:41.977389 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-46de2ed7-eed5-483c-a5ef-6b9b594bb0e1 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:41.979054 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-46de2ed7-eed5-483c-a5ef-6b9b594bb0e1 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 2e6cb94a-6898-4441-9c34-8ccf3856e265] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:41.985986 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:18:41.988716 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-46de2ed7-eed5-483c-a5ef-6b9b594bb0e1 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:41.989406 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-46de2ed7-eed5-483c-a5ef-6b9b594bb0e1 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:41.990030 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-46de2ed7-eed5-483c-a5ef-6b9b594bb0e1 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:41.990932 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-46de2ed7-eed5-483c-a5ef-6b9b594bb0e1 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:41.991545 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-46de2ed7-eed5-483c-a5ef-6b9b594bb0e1 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:41.992143 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-46de2ed7-eed5-483c-a5ef-6b9b594bb0e1 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:42.152993 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-46de2ed7-eed5-483c-a5ef-6b9b594bb0e1 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:42.162847 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-46de2ed7-eed5-483c-a5ef-6b9b594bb0e1 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/2e6cb94a-6898-4441-9c34-8ccf3856e265" status: 200 len: 1168 microversion: 2.1 time: 0.189657 Aug 27 03:18:42.168795 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2857/5675] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:41 2022] GET /compute/v2.1/servers/2e6cb94a-6898-4441-9c34-8ccf3856e265 => generated 1168 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:43.183739 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-71c6c63d-e105-428f-9d05-1e7ea9a36791 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:43.184680 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-71c6c63d-e105-428f-9d05-1e7ea9a36791 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 2e6cb94a-6898-4441-9c34-8ccf3856e265] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:43.192281 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-71c6c63d-e105-428f-9d05-1e7ea9a36791 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:43.193177 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-71c6c63d-e105-428f-9d05-1e7ea9a36791 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:43.193710 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-71c6c63d-e105-428f-9d05-1e7ea9a36791 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:43.194530 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-71c6c63d-e105-428f-9d05-1e7ea9a36791 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:43.195094 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-71c6c63d-e105-428f-9d05-1e7ea9a36791 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:43.195631 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-71c6c63d-e105-428f-9d05-1e7ea9a36791 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:43.348553 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-71c6c63d-e105-428f-9d05-1e7ea9a36791 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:43.356917 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-71c6c63d-e105-428f-9d05-1e7ea9a36791 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/2e6cb94a-6898-4441-9c34-8ccf3856e265" status: 200 len: 1168 microversion: 2.1 time: 0.177389 Aug 27 03:18:43.357632 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2819/5676] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:43 2022] GET /compute/v2.1/servers/2e6cb94a-6898-4441-9c34-8ccf3856e265 => generated 1168 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:18:44.377945 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-dbdfe95c-8e8c-4d3d-84a7-c0716160b2e1 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:44.378783 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-dbdfe95c-8e8c-4d3d-84a7-c0716160b2e1 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 2e6cb94a-6898-4441-9c34-8ccf3856e265] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:44.386052 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dbdfe95c-8e8c-4d3d-84a7-c0716160b2e1 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:44.386611 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dbdfe95c-8e8c-4d3d-84a7-c0716160b2e1 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:44.387126 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dbdfe95c-8e8c-4d3d-84a7-c0716160b2e1 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:44.387884 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dbdfe95c-8e8c-4d3d-84a7-c0716160b2e1 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:44.388446 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dbdfe95c-8e8c-4d3d-84a7-c0716160b2e1 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:44.389065 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dbdfe95c-8e8c-4d3d-84a7-c0716160b2e1 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:44.526224 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-dbdfe95c-8e8c-4d3d-84a7-c0716160b2e1 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:44.545457 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-dbdfe95c-8e8c-4d3d-84a7-c0716160b2e1 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/2e6cb94a-6898-4441-9c34-8ccf3856e265" status: 200 len: 1168 microversion: 2.1 time: 0.171304 Aug 27 03:18:44.546385 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2858/5677] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:44 2022] GET /compute/v2.1/servers/2e6cb94a-6898-4441-9c34-8ccf3856e265 => generated 1168 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:45.567571 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5d85a194-c747-451c-b65e-ddb1922ff24e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:45.568200 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-5d85a194-c747-451c-b65e-ddb1922ff24e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 2e6cb94a-6898-4441-9c34-8ccf3856e265] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:45.575293 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5d85a194-c747-451c-b65e-ddb1922ff24e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:45.575950 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5d85a194-c747-451c-b65e-ddb1922ff24e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:45.580558 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5d85a194-c747-451c-b65e-ddb1922ff24e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:45.581651 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5d85a194-c747-451c-b65e-ddb1922ff24e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:45.582404 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5d85a194-c747-451c-b65e-ddb1922ff24e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:45.583141 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5d85a194-c747-451c-b65e-ddb1922ff24e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:45.735394 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-5d85a194-c747-451c-b65e-ddb1922ff24e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:45.743440 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-5d85a194-c747-451c-b65e-ddb1922ff24e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/2e6cb94a-6898-4441-9c34-8ccf3856e265" status: 200 len: 1168 microversion: 2.1 time: 0.180840 Aug 27 03:18:45.744017 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2820/5678] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:45 2022] GET /compute/v2.1/servers/2e6cb94a-6898-4441-9c34-8ccf3856e265 => generated 1168 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:46.763521 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-19699cfa-643c-41e7-8189-cdf4bd32609a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:46.764156 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-19699cfa-643c-41e7-8189-cdf4bd32609a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 2e6cb94a-6898-4441-9c34-8ccf3856e265] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:46.775504 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-19699cfa-643c-41e7-8189-cdf4bd32609a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:46.776362 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-19699cfa-643c-41e7-8189-cdf4bd32609a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:46.776817 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-19699cfa-643c-41e7-8189-cdf4bd32609a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:46.777559 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-19699cfa-643c-41e7-8189-cdf4bd32609a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:46.778027 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-19699cfa-643c-41e7-8189-cdf4bd32609a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:46.778439 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-19699cfa-643c-41e7-8189-cdf4bd32609a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:46.930138 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-19699cfa-643c-41e7-8189-cdf4bd32609a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:46.939567 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-19699cfa-643c-41e7-8189-cdf4bd32609a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/2e6cb94a-6898-4441-9c34-8ccf3856e265" status: 200 len: 1168 microversion: 2.1 time: 0.180167 Aug 27 03:18:46.940409 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2859/5679] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:46 2022] GET /compute/v2.1/servers/2e6cb94a-6898-4441-9c34-8ccf3856e265 => generated 1168 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:47.961743 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-dabbbbf2-146e-48b9-981f-442b3f79b6d3 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:47.962384 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-dabbbbf2-146e-48b9-981f-442b3f79b6d3 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 2e6cb94a-6898-4441-9c34-8ccf3856e265] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:47.971022 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dabbbbf2-146e-48b9-981f-442b3f79b6d3 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:47.971630 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dabbbbf2-146e-48b9-981f-442b3f79b6d3 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:47.972136 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dabbbbf2-146e-48b9-981f-442b3f79b6d3 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:47.972914 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dabbbbf2-146e-48b9-981f-442b3f79b6d3 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:47.973443 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dabbbbf2-146e-48b9-981f-442b3f79b6d3 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:47.973929 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dabbbbf2-146e-48b9-981f-442b3f79b6d3 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:48.127176 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-dabbbbf2-146e-48b9-981f-442b3f79b6d3 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:48.135611 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-dabbbbf2-146e-48b9-981f-442b3f79b6d3 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/2e6cb94a-6898-4441-9c34-8ccf3856e265" status: 200 len: 1168 microversion: 2.1 time: 0.178018 Aug 27 03:18:48.136189 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2821/5680] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:47 2022] GET /compute/v2.1/servers/2e6cb94a-6898-4441-9c34-8ccf3856e265 => generated 1168 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:49.156962 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-65d19b3c-9415-455a-9668-b427cf1e6cd8 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:49.157567 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-65d19b3c-9415-455a-9668-b427cf1e6cd8 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 2e6cb94a-6898-4441-9c34-8ccf3856e265] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:49.165634 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-65d19b3c-9415-455a-9668-b427cf1e6cd8 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:49.166140 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-65d19b3c-9415-455a-9668-b427cf1e6cd8 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:49.166579 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-65d19b3c-9415-455a-9668-b427cf1e6cd8 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:49.167295 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-65d19b3c-9415-455a-9668-b427cf1e6cd8 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:49.167761 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-65d19b3c-9415-455a-9668-b427cf1e6cd8 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:49.168185 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-65d19b3c-9415-455a-9668-b427cf1e6cd8 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:49.311277 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-65d19b3c-9415-455a-9668-b427cf1e6cd8 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:49.320582 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-65d19b3c-9415-455a-9668-b427cf1e6cd8 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/2e6cb94a-6898-4441-9c34-8ccf3856e265" status: 200 len: 1168 microversion: 2.1 time: 0.167830 Aug 27 03:18:49.321293 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2860/5681] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:49 2022] GET /compute/v2.1/servers/2e6cb94a-6898-4441-9c34-8ccf3856e265 => generated 1168 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:50.341999 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6b10ae21-11f1-40c2-93de-553ebaadb02e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:50.342818 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-6b10ae21-11f1-40c2-93de-553ebaadb02e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 2e6cb94a-6898-4441-9c34-8ccf3856e265] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:50.350540 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6b10ae21-11f1-40c2-93de-553ebaadb02e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:50.351153 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6b10ae21-11f1-40c2-93de-553ebaadb02e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:50.351699 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6b10ae21-11f1-40c2-93de-553ebaadb02e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:50.352530 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6b10ae21-11f1-40c2-93de-553ebaadb02e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:50.353103 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6b10ae21-11f1-40c2-93de-553ebaadb02e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:50.353633 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6b10ae21-11f1-40c2-93de-553ebaadb02e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:50.500844 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-6b10ae21-11f1-40c2-93de-553ebaadb02e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:50.514905 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-6b10ae21-11f1-40c2-93de-553ebaadb02e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/2e6cb94a-6898-4441-9c34-8ccf3856e265" status: 200 len: 1168 microversion: 2.1 time: 0.177229 Aug 27 03:18:50.516638 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2822/5682] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:50 2022] GET /compute/v2.1/servers/2e6cb94a-6898-4441-9c34-8ccf3856e265 => generated 1168 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:51.536560 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-921f536f-81d9-49d1-a8ac-2e457106545d tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:51.537189 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-921f536f-81d9-49d1-a8ac-2e457106545d tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 2e6cb94a-6898-4441-9c34-8ccf3856e265] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:51.544647 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-921f536f-81d9-49d1-a8ac-2e457106545d tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:51.545126 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-921f536f-81d9-49d1-a8ac-2e457106545d tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:51.545584 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-921f536f-81d9-49d1-a8ac-2e457106545d tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:51.546295 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-921f536f-81d9-49d1-a8ac-2e457106545d tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:51.546763 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-921f536f-81d9-49d1-a8ac-2e457106545d tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:51.547187 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-921f536f-81d9-49d1-a8ac-2e457106545d tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:51.587516 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a12f89a5-9322-47d9-9af6-41661ab945ea tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:51.588059 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a12f89a5-9322-47d9-9af6-41661ab945ea tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] [instance: 87d21254-70b6-4272-9b1f-23556ead1aa4] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:51.595357 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a12f89a5-9322-47d9-9af6-41661ab945ea tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:51.595847 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a12f89a5-9322-47d9-9af6-41661ab945ea tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:51.596283 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a12f89a5-9322-47d9-9af6-41661ab945ea tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:51.602923 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a12f89a5-9322-47d9-9af6-41661ab945ea tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:51.603447 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a12f89a5-9322-47d9-9af6-41661ab945ea tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:51.603920 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a12f89a5-9322-47d9-9af6-41661ab945ea tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:51.637488 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a12f89a5-9322-47d9-9af6-41661ab945ea tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] [instance: 87d21254-70b6-4272-9b1f-23556ead1aa4] Going to try to terminate instance {{(pid=134052) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:18:51.718513 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-921f536f-81d9-49d1-a8ac-2e457106545d tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:51.726453 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-921f536f-81d9-49d1-a8ac-2e457106545d tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/2e6cb94a-6898-4441-9c34-8ccf3856e265" status: 200 len: 1168 microversion: 2.1 time: 0.194040 Aug 27 03:18:51.732476 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2861/5683] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:51 2022] GET /compute/v2.1/servers/2e6cb94a-6898-4441-9c34-8ccf3856e265 => generated 1168 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:51.742934 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a12f89a5-9322-47d9-9af6-41661ab945ea tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] 10.222.0.70 "DELETE /compute/v2.1/servers/87d21254-70b6-4272-9b1f-23556ead1aa4" status: 204 len: 0 microversion: 2.1 time: 0.158712 Aug 27 03:18:51.745268 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2823/5684] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 03:18:51 2022] DELETE /compute/v2.1/servers/87d21254-70b6-4272-9b1f-23556ead1aa4 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 03:18:51.763865 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d19f360a-3adb-44bb-bcb0-6a894ae6da3b tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:51.764501 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d19f360a-3adb-44bb-bcb0-6a894ae6da3b tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] [instance: 87d21254-70b6-4272-9b1f-23556ead1aa4] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:51.779769 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d19f360a-3adb-44bb-bcb0-6a894ae6da3b tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:51.780274 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d19f360a-3adb-44bb-bcb0-6a894ae6da3b tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:51.780763 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d19f360a-3adb-44bb-bcb0-6a894ae6da3b tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:51.781482 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d19f360a-3adb-44bb-bcb0-6a894ae6da3b tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:51.781959 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d19f360a-3adb-44bb-bcb0-6a894ae6da3b tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:51.782336 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d19f360a-3adb-44bb-bcb0-6a894ae6da3b tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:51.933395 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d19f360a-3adb-44bb-bcb0-6a894ae6da3b tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca3c3142d0449fd8c32b2d24b8da633', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6a6e91351a4d4187c894fc9562886a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:51.942434 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d19f360a-3adb-44bb-bcb0-6a894ae6da3b tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] 10.222.0.70 "GET /compute/v2.1/servers/87d21254-70b6-4272-9b1f-23556ead1aa4" status: 200 len: 1731 microversion: 2.1 time: 0.193106 Aug 27 03:18:51.943096 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2862/5685] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:51 2022] GET /compute/v2.1/servers/87d21254-70b6-4272-9b1f-23556ead1aa4 => generated 1731 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:52.753400 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-07265e6e-a5d6-47bd-a4b4-3f0e6eb15713 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:52.754963 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-07265e6e-a5d6-47bd-a4b4-3f0e6eb15713 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 2e6cb94a-6898-4441-9c34-8ccf3856e265] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:52.765731 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-07265e6e-a5d6-47bd-a4b4-3f0e6eb15713 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:52.766425 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-07265e6e-a5d6-47bd-a4b4-3f0e6eb15713 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:52.767035 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-07265e6e-a5d6-47bd-a4b4-3f0e6eb15713 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:52.768110 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-07265e6e-a5d6-47bd-a4b4-3f0e6eb15713 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:52.768747 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-07265e6e-a5d6-47bd-a4b4-3f0e6eb15713 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:52.769369 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-07265e6e-a5d6-47bd-a4b4-3f0e6eb15713 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:52.956901 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-07265e6e-a5d6-47bd-a4b4-3f0e6eb15713 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:52.963116 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ed125187-1a85-4797-9285-49f9a60de7a2 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:52.964211 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-ed125187-1a85-4797-9285-49f9a60de7a2 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] [instance: 87d21254-70b6-4272-9b1f-23556ead1aa4] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:52.973184 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-07265e6e-a5d6-47bd-a4b4-3f0e6eb15713 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/2e6cb94a-6898-4441-9c34-8ccf3856e265" status: 200 len: 1168 microversion: 2.1 time: 0.224488 Aug 27 03:18:52.973919 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2824/5686] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:52 2022] GET /compute/v2.1/servers/2e6cb94a-6898-4441-9c34-8ccf3856e265 => generated 1168 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:52.980400 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ed125187-1a85-4797-9285-49f9a60de7a2 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:52.981149 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ed125187-1a85-4797-9285-49f9a60de7a2 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:52.981959 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ed125187-1a85-4797-9285-49f9a60de7a2 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:52.982970 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ed125187-1a85-4797-9285-49f9a60de7a2 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:52.983637 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ed125187-1a85-4797-9285-49f9a60de7a2 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:52.984279 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ed125187-1a85-4797-9285-49f9a60de7a2 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:53.301617 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-ed125187-1a85-4797-9285-49f9a60de7a2 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca3c3142d0449fd8c32b2d24b8da633', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6a6e91351a4d4187c894fc9562886a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:53.328268 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ed125187-1a85-4797-9285-49f9a60de7a2 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] 10.222.0.70 "GET /compute/v2.1/servers/87d21254-70b6-4272-9b1f-23556ead1aa4" status: 200 len: 1731 microversion: 2.1 time: 0.368854 Aug 27 03:18:53.329146 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2863/5687] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:52 2022] GET /compute/v2.1/servers/87d21254-70b6-4272-9b1f-23556ead1aa4 => generated 1731 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:18:53.994864 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0d16d9cd-48c8-4bf7-8480-4e21bbf81344 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:53.995380 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-0d16d9cd-48c8-4bf7-8480-4e21bbf81344 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 2e6cb94a-6898-4441-9c34-8ccf3856e265] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:54.003736 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0d16d9cd-48c8-4bf7-8480-4e21bbf81344 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:54.004654 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0d16d9cd-48c8-4bf7-8480-4e21bbf81344 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:54.005547 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0d16d9cd-48c8-4bf7-8480-4e21bbf81344 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:54.006505 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0d16d9cd-48c8-4bf7-8480-4e21bbf81344 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:54.007172 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0d16d9cd-48c8-4bf7-8480-4e21bbf81344 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:54.008206 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0d16d9cd-48c8-4bf7-8480-4e21bbf81344 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:54.257217 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0d16d9cd-48c8-4bf7-8480-4e21bbf81344 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:54.275079 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-0d16d9cd-48c8-4bf7-8480-4e21bbf81344 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/2e6cb94a-6898-4441-9c34-8ccf3856e265" status: 200 len: 1202 microversion: 2.1 time: 0.284151 Aug 27 03:18:54.276531 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2825/5688] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:53 2022] GET /compute/v2.1/servers/2e6cb94a-6898-4441-9c34-8ccf3856e265 => generated 1202 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:54.289973 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-3adbe442-6877-414f-9d67-c3a62c978e48 req-c79bc155-9e2f-454d-b730-3b37c15fdeb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87d21254-70b6-4272-9b1f-23556ead1aa4", "name": "network-vif-deleted", "tag": "c3159f4d-cd03-47f3-bdfb-8d68dbc1dd88"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:18:54.301433 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-3adbe442-6877-414f-9d67-c3a62c978e48 req-c79bc155-9e2f-454d-b730-3b37c15fdeb5 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:54.302165 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-3adbe442-6877-414f-9d67-c3a62c978e48 req-c79bc155-9e2f-454d-b730-3b37c15fdeb5 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:54.302773 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-3adbe442-6877-414f-9d67-c3a62c978e48 req-c79bc155-9e2f-454d-b730-3b37c15fdeb5 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:54.335164 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-3adbe442-6877-414f-9d67-c3a62c978e48 req-c79bc155-9e2f-454d-b730-3b37c15fdeb5 service nova] Creating event network-vif-deleted:c3159f4d-cd03-47f3-bdfb-8d68dbc1dd88 for instance 87d21254-70b6-4272-9b1f-23556ead1aa4 on n-h2-852278-4 Aug 27 03:18:54.350756 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-fbbb36b3-c016-4ba3-b4a9-fb7959a508bf tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:54.351400 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-fbbb36b3-c016-4ba3-b4a9-fb7959a508bf tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] [instance: 87d21254-70b6-4272-9b1f-23556ead1aa4] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:54.365200 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-3adbe442-6877-414f-9d67-c3a62c978e48 req-c79bc155-9e2f-454d-b730-3b37c15fdeb5 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078912 Aug 27 03:18:54.369104 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2864/5689] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:18:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:18:54.372498 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fbbb36b3-c016-4ba3-b4a9-fb7959a508bf tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:54.376147 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fbbb36b3-c016-4ba3-b4a9-fb7959a508bf tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:54.377129 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fbbb36b3-c016-4ba3-b4a9-fb7959a508bf tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:54.378434 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fbbb36b3-c016-4ba3-b4a9-fb7959a508bf tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:54.380172 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fbbb36b3-c016-4ba3-b4a9-fb7959a508bf tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:54.381076 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fbbb36b3-c016-4ba3-b4a9-fb7959a508bf tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:54.517811 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-fbbb36b3-c016-4ba3-b4a9-fb7959a508bf tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ca3c3142d0449fd8c32b2d24b8da633', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6a6e91351a4d4187c894fc9562886a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:54.527852 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-fbbb36b3-c016-4ba3-b4a9-fb7959a508bf tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] 10.222.0.70 "GET /compute/v2.1/servers/87d21254-70b6-4272-9b1f-23556ead1aa4" status: 200 len: 1383 microversion: 2.1 time: 0.181341 Aug 27 03:18:54.528796 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2826/5690] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:54 2022] GET /compute/v2.1/servers/87d21254-70b6-4272-9b1f-23556ead1aa4 => generated 1383 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:18:55.301418 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-9011dab6-5218-4ade-a7d0-b5bb1eaf1d8a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:55.302247 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-9011dab6-5218-4ade-a7d0-b5bb1eaf1d8a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 2e6cb94a-6898-4441-9c34-8ccf3856e265] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:55.310197 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9011dab6-5218-4ade-a7d0-b5bb1eaf1d8a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:55.310774 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9011dab6-5218-4ade-a7d0-b5bb1eaf1d8a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:55.311282 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9011dab6-5218-4ade-a7d0-b5bb1eaf1d8a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:55.312077 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9011dab6-5218-4ade-a7d0-b5bb1eaf1d8a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:55.313021 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9011dab6-5218-4ade-a7d0-b5bb1eaf1d8a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:55.313520 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9011dab6-5218-4ade-a7d0-b5bb1eaf1d8a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:55.481601 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-9011dab6-5218-4ade-a7d0-b5bb1eaf1d8a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:55.490135 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-9011dab6-5218-4ade-a7d0-b5bb1eaf1d8a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/2e6cb94a-6898-4441-9c34-8ccf3856e265" status: 200 len: 1202 microversion: 2.1 time: 0.193655 Aug 27 03:18:55.491268 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2865/5691] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:55 2022] GET /compute/v2.1/servers/2e6cb94a-6898-4441-9c34-8ccf3856e265 => generated 1202 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:55.549010 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0de4f2a5-f014-4db4-9e36-45a1806a64a3 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:55.549627 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-0de4f2a5-f014-4db4-9e36-45a1806a64a3 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] [instance: 87d21254-70b6-4272-9b1f-23556ead1aa4] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:55.573407 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0de4f2a5-f014-4db4-9e36-45a1806a64a3 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:55.573407 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0de4f2a5-f014-4db4-9e36-45a1806a64a3 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:55.573407 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0de4f2a5-f014-4db4-9e36-45a1806a64a3 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:55.573407 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0de4f2a5-f014-4db4-9e36-45a1806a64a3 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:55.574255 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0de4f2a5-f014-4db4-9e36-45a1806a64a3 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:55.574977 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0de4f2a5-f014-4db4-9e36-45a1806a64a3 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:55.594538 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-0de4f2a5-f014-4db4-9e36-45a1806a64a3 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] HTTP exception thrown: Instance 87d21254-70b6-4272-9b1f-23556ead1aa4 could not be found. Aug 27 03:18:55.596777 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0de4f2a5-f014-4db4-9e36-45a1806a64a3 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Request method failure captured: Aug 27 03:18:55.596777 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/servers/87d21254-70b6-4272-9b1f-23556ead1aa4 HTTP/1.1 Aug 27 03:18:55.596777 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 03:18:55.596777 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 03:18:55.596777 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 03:18:55.596777 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 03:18:55.596777 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 03:18:55.596777 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 03:18:55.596777 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 03:18:55.596777 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 03:18:55.596777 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYvp4Sz2vGi-ov_z1BL4IO9-qaQaK2v97IQeUNMIaRy8m4iu4hWZqaiLo8hRmhSgOAepqRj-dhCe1AHAukoZsBzAeYXaa1Pv66sokN515WXnOxlE7MRG99SuexkwBrbg51d2juEF1WtYWch3ideSD5t6gaqsRWv6s13T0xCMLO1wysI Aug 27 03:18:55.596777 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 03:18:55.596777 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 03:18:55.596777 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 03:18:55.596777 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 03:18:55.596777 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 03:18:55.596777 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 03:18:55.596777 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 8e6a6e91351a4d4187c894fc9562886a Aug 27 03:18:55.596777 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-TestServerBasicOps-557249687 Aug 27 03:18:55.596777 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 03:18:55.596777 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 03:18:55.596777 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8e6a6e91351a4d4187c894fc9562886a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8e6a6e91351a4d4187c894fc9562886a", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8e6a6e91351a4d4187c894fc9562886a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8e6a6e91351a4d4187c894fc9562886a"}]}] Aug 27 03:18:55.596777 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-TestServerBasicOps-557249687 Aug 27 03:18:55.596777 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 8e6a6e91351a4d4187c894fc9562886a Aug 27 03:18:55.596777 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-TestServerBasicOps-557249687 Aug 27 03:18:55.596777 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-TestServerBasicOps-557249687-project Aug 27 03:18:55.596777 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 03:18:55.596777 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 03:18:55.596777 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 0ca3c3142d0449fd8c32b2d24b8da633 Aug 27 03:18:55.596777 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-TestServerBasicOps-557249687-project Aug 27 03:18:55.596777 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 03:18:55.596777 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance 87d21254-70b6-4272-9b1f-23556ead1aa4 could not be found. Aug 27 03:18:55.596777 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '87d21254-70b6-4272-9b1f-23556ead1aa4'} Aug 27 03:18:55.596777 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:18:55.596777 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:55.596777 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:18:55.596777 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:18:55.596777 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:18:55.596777 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:18:55.596777 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:18:55.596777 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:18:55.596777 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:18:55.596777 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:18:55.596777 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87d21254-70b6-4272-9b1f-23556ead1aa4 could not be found. Aug 27 03:18:55.596777 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:18:55.596777 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:18:55.596777 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:18:55.596777 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:55.596777 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:18:55.596777 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:18:55.596777 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:18:55.596777 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:18:55.596777 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:18:55.596777 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:18:55.596777 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:18:55.596777 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:18:55.596777 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:18:55.596777 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:18:55.596777 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:18:55.596777 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:18:55.596777 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87d21254-70b6-4272-9b1f-23556ead1aa4 could not be found. Aug 27 03:18:55.596777 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:18:55.596777 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:18:55.596777 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:18:55.601496 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:55.601496 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:18:55.601496 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:18:55.601496 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:18:55.601496 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:18:55.601496 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87d21254-70b6-4272-9b1f-23556ead1aa4 could not be found. Aug 27 03:18:55.601496 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:18:55.601496 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0de4f2a5-f014-4db4-9e36-45a1806a64a3 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Returning 404 to user: Instance 87d21254-70b6-4272-9b1f-23556ead1aa4 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:18:55.601496 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-0de4f2a5-f014-4db4-9e36-45a1806a64a3 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] 10.222.0.70 "GET /compute/v2.1/servers/87d21254-70b6-4272-9b1f-23556ead1aa4" status: 404 len: 111 microversion: 2.1 time: 0.054217 Aug 27 03:18:55.601496 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2827/5692] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:55 2022] GET /compute/v2.1/servers/87d21254-70b6-4272-9b1f-23556ead1aa4 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:18:56.128643 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3fd42c26-438b-4652-8bd6-f2be33796b0f tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:56.129259 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-3fd42c26-438b-4652-8bd6-f2be33796b0f tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] [instance: 87d21254-70b6-4272-9b1f-23556ead1aa4] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:56.137758 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3fd42c26-438b-4652-8bd6-f2be33796b0f tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:56.138160 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3fd42c26-438b-4652-8bd6-f2be33796b0f tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:56.139373 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3fd42c26-438b-4652-8bd6-f2be33796b0f tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:56.141063 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3fd42c26-438b-4652-8bd6-f2be33796b0f tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:56.141480 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3fd42c26-438b-4652-8bd6-f2be33796b0f tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:56.142029 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3fd42c26-438b-4652-8bd6-f2be33796b0f tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:56.156917 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-3fd42c26-438b-4652-8bd6-f2be33796b0f tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] HTTP exception thrown: Instance 87d21254-70b6-4272-9b1f-23556ead1aa4 could not be found. Aug 27 03:18:56.159015 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3fd42c26-438b-4652-8bd6-f2be33796b0f tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Request method failure captured: Aug 27 03:18:56.159015 n-d-852278-4 devstack@n-api.service[134051]: request: DELETE /compute/v2.1/servers/87d21254-70b6-4272-9b1f-23556ead1aa4 HTTP/1.1 Aug 27 03:18:56.159015 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 03:18:56.159015 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 03:18:56.159015 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 03:18:56.159015 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 03:18:56.159015 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 03:18:56.159015 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 03:18:56.159015 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 03:18:56.159015 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 03:18:56.159015 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYvp4Sz2vGi-ov_z1BL4IO9-qaQaK2v97IQeUNMIaRy8m4iu4hWZqaiLo8hRmhSgOAepqRj-dhCe1AHAukoZsBzAeYXaa1Pv66sokN515WXnOxlE7MRG99SuexkwBrbg51d2juEF1WtYWch3ideSD5t6gaqsRWv6s13T0xCMLO1wysI Aug 27 03:18:56.159015 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 03:18:56.159015 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 03:18:56.159015 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 03:18:56.159015 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 03:18:56.159015 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 03:18:56.159015 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 03:18:56.159015 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 8e6a6e91351a4d4187c894fc9562886a Aug 27 03:18:56.159015 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-TestServerBasicOps-557249687 Aug 27 03:18:56.159015 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 03:18:56.159015 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 03:18:56.159015 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8e6a6e91351a4d4187c894fc9562886a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8e6a6e91351a4d4187c894fc9562886a", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8e6a6e91351a4d4187c894fc9562886a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8e6a6e91351a4d4187c894fc9562886a"}]}] Aug 27 03:18:56.159015 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-TestServerBasicOps-557249687 Aug 27 03:18:56.159015 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 8e6a6e91351a4d4187c894fc9562886a Aug 27 03:18:56.159015 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-TestServerBasicOps-557249687 Aug 27 03:18:56.159015 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-TestServerBasicOps-557249687-project Aug 27 03:18:56.159015 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 03:18:56.159015 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 03:18:56.159015 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 0ca3c3142d0449fd8c32b2d24b8da633 Aug 27 03:18:56.159015 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-TestServerBasicOps-557249687-project Aug 27 03:18:56.159015 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 03:18:56.159015 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance 87d21254-70b6-4272-9b1f-23556ead1aa4 could not be found. Aug 27 03:18:56.159015 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '87d21254-70b6-4272-9b1f-23556ead1aa4'} Aug 27 03:18:56.159015 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:18:56.159015 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:56.159015 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:18:56.159015 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:18:56.159015 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:18:56.159015 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:18:56.159015 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:18:56.159015 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:18:56.159015 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:18:56.159015 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:18:56.159015 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87d21254-70b6-4272-9b1f-23556ead1aa4 could not be found. Aug 27 03:18:56.159015 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:18:56.159015 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:18:56.159015 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:18:56.159015 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:56.159015 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:18:56.159015 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:18:56.159015 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:18:56.159015 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:18:56.159015 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:18:56.159015 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:18:56.159015 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 03:18:56.159015 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 03:18:56.159015 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 03:18:56.159015 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 03:18:56.159015 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:18:56.159015 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:18:56.159015 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:18:56.159015 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:18:56.162803 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87d21254-70b6-4272-9b1f-23556ead1aa4 could not be found. Aug 27 03:18:56.162803 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:18:56.162803 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:18:56.162803 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:18:56.162803 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:56.162803 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:18:56.162803 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:18:56.162803 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:18:56.162803 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:18:56.162803 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87d21254-70b6-4272-9b1f-23556ead1aa4 could not be found. Aug 27 03:18:56.162803 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:18:56.165133 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3fd42c26-438b-4652-8bd6-f2be33796b0f tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Returning 404 to user: Instance 87d21254-70b6-4272-9b1f-23556ead1aa4 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:18:56.166005 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-3fd42c26-438b-4652-8bd6-f2be33796b0f tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] 10.222.0.70 "DELETE /compute/v2.1/servers/87d21254-70b6-4272-9b1f-23556ead1aa4" status: 404 len: 111 microversion: 2.1 time: 0.041635 Aug 27 03:18:56.166565 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2866/5693] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 03:18:56 2022] DELETE /compute/v2.1/servers/87d21254-70b6-4272-9b1f-23556ead1aa4 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:18:56.174817 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-61bea40a-fd4e-4325-9c25-e55d91b6f2d2 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:56.175421 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-61bea40a-fd4e-4325-9c25-e55d91b6f2d2 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] [instance: 87d21254-70b6-4272-9b1f-23556ead1aa4] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:56.181407 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-61bea40a-fd4e-4325-9c25-e55d91b6f2d2 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:56.181908 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-61bea40a-fd4e-4325-9c25-e55d91b6f2d2 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:56.182340 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-61bea40a-fd4e-4325-9c25-e55d91b6f2d2 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:56.183025 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-61bea40a-fd4e-4325-9c25-e55d91b6f2d2 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:56.183467 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-61bea40a-fd4e-4325-9c25-e55d91b6f2d2 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:56.183886 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-61bea40a-fd4e-4325-9c25-e55d91b6f2d2 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:56.198431 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-61bea40a-fd4e-4325-9c25-e55d91b6f2d2 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] HTTP exception thrown: Instance 87d21254-70b6-4272-9b1f-23556ead1aa4 could not be found. Aug 27 03:18:56.199993 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-61bea40a-fd4e-4325-9c25-e55d91b6f2d2 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Request method failure captured: Aug 27 03:18:56.199993 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/servers/87d21254-70b6-4272-9b1f-23556ead1aa4 HTTP/1.1 Aug 27 03:18:56.199993 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 03:18:56.199993 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 03:18:56.199993 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 03:18:56.199993 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 03:18:56.199993 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 03:18:56.199993 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 03:18:56.199993 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 03:18:56.199993 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 03:18:56.199993 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYvp4Sz2vGi-ov_z1BL4IO9-qaQaK2v97IQeUNMIaRy8m4iu4hWZqaiLo8hRmhSgOAepqRj-dhCe1AHAukoZsBzAeYXaa1Pv66sokN515WXnOxlE7MRG99SuexkwBrbg51d2juEF1WtYWch3ideSD5t6gaqsRWv6s13T0xCMLO1wysI Aug 27 03:18:56.199993 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 03:18:56.199993 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 03:18:56.199993 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 03:18:56.199993 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 03:18:56.199993 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 03:18:56.199993 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 03:18:56.199993 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 8e6a6e91351a4d4187c894fc9562886a Aug 27 03:18:56.199993 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-TestServerBasicOps-557249687 Aug 27 03:18:56.199993 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 03:18:56.199993 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 03:18:56.199993 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8e6a6e91351a4d4187c894fc9562886a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8e6a6e91351a4d4187c894fc9562886a", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8e6a6e91351a4d4187c894fc9562886a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8e6a6e91351a4d4187c894fc9562886a"}]}] Aug 27 03:18:56.199993 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-TestServerBasicOps-557249687 Aug 27 03:18:56.199993 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 8e6a6e91351a4d4187c894fc9562886a Aug 27 03:18:56.199993 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-TestServerBasicOps-557249687 Aug 27 03:18:56.199993 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-TestServerBasicOps-557249687-project Aug 27 03:18:56.199993 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 03:18:56.199993 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 03:18:56.199993 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 0ca3c3142d0449fd8c32b2d24b8da633 Aug 27 03:18:56.199993 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-TestServerBasicOps-557249687-project Aug 27 03:18:56.199993 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 03:18:56.199993 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance 87d21254-70b6-4272-9b1f-23556ead1aa4 could not be found. Aug 27 03:18:56.199993 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '87d21254-70b6-4272-9b1f-23556ead1aa4'} Aug 27 03:18:56.199993 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:18:56.199993 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:56.199993 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:18:56.199993 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:18:56.199993 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:18:56.199993 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:18:56.199993 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:18:56.199993 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:18:56.199993 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:18:56.199993 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:18:56.199993 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87d21254-70b6-4272-9b1f-23556ead1aa4 could not be found. Aug 27 03:18:56.199993 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:18:56.199993 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:18:56.199993 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:18:56.199993 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:56.199993 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:18:56.199993 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:18:56.199993 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:18:56.199993 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:18:56.199993 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:18:56.199993 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:18:56.199993 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:18:56.199993 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:18:56.199993 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:18:56.199993 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:18:56.199993 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:18:56.199993 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:18:56.199993 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87d21254-70b6-4272-9b1f-23556ead1aa4 could not be found. Aug 27 03:18:56.199993 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:18:56.199993 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:18:56.199993 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:18:56.204301 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:56.204301 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:18:56.204301 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:18:56.204301 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:18:56.204301 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:18:56.204301 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87d21254-70b6-4272-9b1f-23556ead1aa4 could not be found. Aug 27 03:18:56.204301 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:18:56.204301 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-61bea40a-fd4e-4325-9c25-e55d91b6f2d2 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Returning 404 to user: Instance 87d21254-70b6-4272-9b1f-23556ead1aa4 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:18:56.204301 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-61bea40a-fd4e-4325-9c25-e55d91b6f2d2 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] 10.222.0.70 "GET /compute/v2.1/servers/87d21254-70b6-4272-9b1f-23556ead1aa4" status: 404 len: 111 microversion: 2.1 time: 0.030562 Aug 27 03:18:56.205481 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2828/5694] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:56 2022] GET /compute/v2.1/servers/87d21254-70b6-4272-9b1f-23556ead1aa4 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:18:56.368970 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a87c9f6d-94f8-4f7a-9158-c1f57f6b27a9 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] Calling method '.version_select at 0x7f5edda839d0>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:56.393378 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a87c9f6d-94f8-4f7a-9158-c1f57f6b27a9 tempest-TestServerBasicOps-557249687 tempest-TestServerBasicOps-557249687-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-615301463" status: 202 len: 0 microversion: 2.1 time: 0.028396 Aug 27 03:18:56.394003 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2867/5695] 10.222.0.70 () {58 vars in 1251 bytes} [Sat Aug 27 03:18:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-615301463 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:18:56.511066 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4628ca44-b5c3-464d-bfe2-566c394a0b9c tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:56.511848 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-4628ca44-b5c3-464d-bfe2-566c394a0b9c tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 2e6cb94a-6898-4441-9c34-8ccf3856e265] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:56.518170 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4628ca44-b5c3-464d-bfe2-566c394a0b9c tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:56.518876 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4628ca44-b5c3-464d-bfe2-566c394a0b9c tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:56.519916 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4628ca44-b5c3-464d-bfe2-566c394a0b9c tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:56.520980 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4628ca44-b5c3-464d-bfe2-566c394a0b9c tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:56.521423 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4628ca44-b5c3-464d-bfe2-566c394a0b9c tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:56.522282 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4628ca44-b5c3-464d-bfe2-566c394a0b9c tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:56.685421 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-4628ca44-b5c3-464d-bfe2-566c394a0b9c tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:56.698692 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-4628ca44-b5c3-464d-bfe2-566c394a0b9c tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/2e6cb94a-6898-4441-9c34-8ccf3856e265" status: 200 len: 1202 microversion: 2.1 time: 0.191933 Aug 27 03:18:56.699280 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2829/5696] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:56 2022] GET /compute/v2.1/servers/2e6cb94a-6898-4441-9c34-8ccf3856e265 => generated 1202 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:18:57.723632 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-451db3bf-daf2-4377-8fa3-d39b36b7f69e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:57.725961 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-451db3bf-daf2-4377-8fa3-d39b36b7f69e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 2e6cb94a-6898-4441-9c34-8ccf3856e265] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:57.734030 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-451db3bf-daf2-4377-8fa3-d39b36b7f69e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:57.734804 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-451db3bf-daf2-4377-8fa3-d39b36b7f69e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:57.735480 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-451db3bf-daf2-4377-8fa3-d39b36b7f69e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:57.736462 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-451db3bf-daf2-4377-8fa3-d39b36b7f69e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:57.737146 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-451db3bf-daf2-4377-8fa3-d39b36b7f69e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:57.737807 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-451db3bf-daf2-4377-8fa3-d39b36b7f69e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:57.963320 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-451db3bf-daf2-4377-8fa3-d39b36b7f69e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:57.973610 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-451db3bf-daf2-4377-8fa3-d39b36b7f69e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/2e6cb94a-6898-4441-9c34-8ccf3856e265" status: 200 len: 1202 microversion: 2.1 time: 0.258181 Aug 27 03:18:57.976769 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2868/5697] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:57 2022] GET /compute/v2.1/servers/2e6cb94a-6898-4441-9c34-8ccf3856e265 => generated 1202 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:59.000284 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d4582570-5a87-4cfd-9885-1c58664a5d88 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:59.003113 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d4582570-5a87-4cfd-9885-1c58664a5d88 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 2e6cb94a-6898-4441-9c34-8ccf3856e265] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:59.021342 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d4582570-5a87-4cfd-9885-1c58664a5d88 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:59.023392 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d4582570-5a87-4cfd-9885-1c58664a5d88 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:59.024611 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d4582570-5a87-4cfd-9885-1c58664a5d88 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:59.026524 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d4582570-5a87-4cfd-9885-1c58664a5d88 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:59.027705 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d4582570-5a87-4cfd-9885-1c58664a5d88 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:59.028799 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d4582570-5a87-4cfd-9885-1c58664a5d88 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:59.060496 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:18:59.444595 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-d4582570-5a87-4cfd-9885-1c58664a5d88 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:59.470821 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d4582570-5a87-4cfd-9885-1c58664a5d88 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/2e6cb94a-6898-4441-9c34-8ccf3856e265" status: 200 len: 1202 microversion: 2.1 time: 0.475665 Aug 27 03:18:59.472111 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2830/5698] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:58 2022] GET /compute/v2.1/servers/2e6cb94a-6898-4441-9c34-8ccf3856e265 => generated 1202 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:00.491446 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7976b29a-efbd-4bd8-acc1-302681957c6b tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:00.492191 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-7976b29a-efbd-4bd8-acc1-302681957c6b tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 2e6cb94a-6898-4441-9c34-8ccf3856e265] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:00.500215 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7976b29a-efbd-4bd8-acc1-302681957c6b tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:00.504941 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7976b29a-efbd-4bd8-acc1-302681957c6b tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:00.505573 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7976b29a-efbd-4bd8-acc1-302681957c6b tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:00.506389 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7976b29a-efbd-4bd8-acc1-302681957c6b tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:00.508296 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7976b29a-efbd-4bd8-acc1-302681957c6b tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:00.508921 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7976b29a-efbd-4bd8-acc1-302681957c6b tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:00.883817 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-7976b29a-efbd-4bd8-acc1-302681957c6b tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:00.887392 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=87 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:19:00.899405 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-7976b29a-efbd-4bd8-acc1-302681957c6b tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/2e6cb94a-6898-4441-9c34-8ccf3856e265" status: 200 len: 1202 microversion: 2.1 time: 0.407644 Aug 27 03:19:00.905562 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2869/5699] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:00 2022] GET /compute/v2.1/servers/2e6cb94a-6898-4441-9c34-8ccf3856e265 => generated 1202 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:01.928617 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-7c959f10-47b7-4615-b689-7ff7f82b7972 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:01.929184 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-7c959f10-47b7-4615-b689-7ff7f82b7972 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 2e6cb94a-6898-4441-9c34-8ccf3856e265] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:01.932019 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:19:01.937796 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7c959f10-47b7-4615-b689-7ff7f82b7972 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:01.938455 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7c959f10-47b7-4615-b689-7ff7f82b7972 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:01.939047 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7c959f10-47b7-4615-b689-7ff7f82b7972 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:01.939888 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7c959f10-47b7-4615-b689-7ff7f82b7972 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:01.940502 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7c959f10-47b7-4615-b689-7ff7f82b7972 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:01.941066 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7c959f10-47b7-4615-b689-7ff7f82b7972 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:02.116029 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-7c959f10-47b7-4615-b689-7ff7f82b7972 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:02.140123 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-7c959f10-47b7-4615-b689-7ff7f82b7972 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/2e6cb94a-6898-4441-9c34-8ccf3856e265" status: 200 len: 1202 microversion: 2.1 time: 0.218205 Aug 27 03:19:02.168576 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2831/5700] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:01 2022] GET /compute/v2.1/servers/2e6cb94a-6898-4441-9c34-8ccf3856e265 => generated 1202 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:03.050775 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-3fa1904f-0baa-4fcd-bd48-d53de12a4dbb req-a91a61a6-e9d9-4cdf-b748-70cae823f957 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e6cb94a-6898-4441-9c34-8ccf3856e265", "name": "network-vif-plugged", "status": "completed", "tag": "14a2ac8c-729f-42ec-94dd-21f1b077ba45"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:19:03.073978 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=40,nova_api:DELETE=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:19:03.077628 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-3fa1904f-0baa-4fcd-bd48-d53de12a4dbb req-a91a61a6-e9d9-4cdf-b748-70cae823f957 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:03.079324 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-3fa1904f-0baa-4fcd-bd48-d53de12a4dbb req-a91a61a6-e9d9-4cdf-b748-70cae823f957 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:03.080915 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-3fa1904f-0baa-4fcd-bd48-d53de12a4dbb req-a91a61a6-e9d9-4cdf-b748-70cae823f957 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:03.114586 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-3fa1904f-0baa-4fcd-bd48-d53de12a4dbb req-a91a61a6-e9d9-4cdf-b748-70cae823f957 service nova] Creating event network-vif-plugged:14a2ac8c-729f-42ec-94dd-21f1b077ba45 for instance 2e6cb94a-6898-4441-9c34-8ccf3856e265 on n-h1-852278-4 Aug 27 03:19:03.140468 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-3fa1904f-0baa-4fcd-bd48-d53de12a4dbb req-a91a61a6-e9d9-4cdf-b748-70cae823f957 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091678 Aug 27 03:19:03.142611 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2870/5701] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:19:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:19:03.164674 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-645bd5db-f031-47d9-8c98-713833758198 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:03.165225 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-645bd5db-f031-47d9-8c98-713833758198 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 2e6cb94a-6898-4441-9c34-8ccf3856e265] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:03.176830 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-645bd5db-f031-47d9-8c98-713833758198 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:03.192581 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-645bd5db-f031-47d9-8c98-713833758198 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:03.193218 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-645bd5db-f031-47d9-8c98-713833758198 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:03.194005 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-645bd5db-f031-47d9-8c98-713833758198 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:03.194477 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-645bd5db-f031-47d9-8c98-713833758198 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:03.194907 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-645bd5db-f031-47d9-8c98-713833758198 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:03.640352 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-645bd5db-f031-47d9-8c98-713833758198 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:03.652106 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-645bd5db-f031-47d9-8c98-713833758198 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/2e6cb94a-6898-4441-9c34-8ccf3856e265" status: 200 len: 1202 microversion: 2.1 time: 0.492412 Aug 27 03:19:03.654998 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2832/5702] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:03 2022] GET /compute/v2.1/servers/2e6cb94a-6898-4441-9c34-8ccf3856e265 => generated 1202 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:04.676841 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d0ccff6d-3c1e-4bb3-a237-1637fe9ba19b tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:04.677572 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d0ccff6d-3c1e-4bb3-a237-1637fe9ba19b tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 2e6cb94a-6898-4441-9c34-8ccf3856e265] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:04.689561 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d0ccff6d-3c1e-4bb3-a237-1637fe9ba19b tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:04.690439 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d0ccff6d-3c1e-4bb3-a237-1637fe9ba19b tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:04.691008 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d0ccff6d-3c1e-4bb3-a237-1637fe9ba19b tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:04.692106 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d0ccff6d-3c1e-4bb3-a237-1637fe9ba19b tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:04.692769 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d0ccff6d-3c1e-4bb3-a237-1637fe9ba19b tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:04.693451 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d0ccff6d-3c1e-4bb3-a237-1637fe9ba19b tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:05.008096 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a2bbf4c6-a991-407c-a67b-b7dbb66cd546 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1911181951", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:19:05.083192 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d0ccff6d-3c1e-4bb3-a237-1637fe9ba19b tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:05.109151 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.network.neutron [None req-a2bbf4c6-a991-407c-a67b-b7dbb66cd546 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] validate_networks() for None {{(pid=134052) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:19:05.115530 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d0ccff6d-3c1e-4bb3-a237-1637fe9ba19b tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/2e6cb94a-6898-4441-9c34-8ccf3856e265" status: 200 len: 1389 microversion: 2.1 time: 0.443603 Aug 27 03:19:05.116506 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2871/5703] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:04 2022] GET /compute/v2.1/servers/2e6cb94a-6898-4441-9c34-8ccf3856e265 => generated 1389 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:05.136530 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-25e42e77-7659-44ca-99df-9a4ed91ed5c1 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:05.137341 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-25e42e77-7659-44ca-99df-9a4ed91ed5c1 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 2e6cb94a-6898-4441-9c34-8ccf3856e265] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:05.146898 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-25e42e77-7659-44ca-99df-9a4ed91ed5c1 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:05.147651 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-25e42e77-7659-44ca-99df-9a4ed91ed5c1 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:05.148250 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-25e42e77-7659-44ca-99df-9a4ed91ed5c1 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:05.149191 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-25e42e77-7659-44ca-99df-9a4ed91ed5c1 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:05.149805 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-25e42e77-7659-44ca-99df-9a4ed91ed5c1 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:05.150843 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-25e42e77-7659-44ca-99df-9a4ed91ed5c1 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:05.489539 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-25e42e77-7659-44ca-99df-9a4ed91ed5c1 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:05.508558 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-25e42e77-7659-44ca-99df-9a4ed91ed5c1 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/2e6cb94a-6898-4441-9c34-8ccf3856e265" status: 200 len: 1389 microversion: 2.1 time: 0.376299 Aug 27 03:19:05.509899 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2872/5704] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:05 2022] GET /compute/v2.1/servers/2e6cb94a-6898-4441-9c34-8ccf3856e265 => generated 1389 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:19:05.513791 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-a2bbf4c6-a991-407c-a67b-b7dbb66cd546 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Flavor limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:19:05.514586 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-a2bbf4c6-a991-407c-a67b-b7dbb66cd546 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Image limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:19:05.515382 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-a2bbf4c6-a991-407c-a67b-b7dbb66cd546 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Flavor pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:19:05.515979 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-a2bbf4c6-a991-407c-a67b-b7dbb66cd546 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Image pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:19:05.516640 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-a2bbf4c6-a991-407c-a67b-b7dbb66cd546 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:19:05.527214 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a2bbf4c6-a991-407c-a67b-b7dbb66cd546 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:05.527962 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a2bbf4c6-a991-407c-a67b-b7dbb66cd546 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:05.528682 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a2bbf4c6-a991-407c-a67b-b7dbb66cd546 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:05.528978 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-49c3e926-973a-40c6-a772-088a030a4d40 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:05.529600 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-49c3e926-973a-40c6-a772-088a030a4d40 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 2e6cb94a-6898-4441-9c34-8ccf3856e265] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:05.531045 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a2bbf4c6-a991-407c-a67b-b7dbb66cd546 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:05.531786 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a2bbf4c6-a991-407c-a67b-b7dbb66cd546 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:05.532531 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a2bbf4c6-a991-407c-a67b-b7dbb66cd546 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:05.536653 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-49c3e926-973a-40c6-a772-088a030a4d40 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:05.537180 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-49c3e926-973a-40c6-a772-088a030a4d40 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:05.537624 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-49c3e926-973a-40c6-a772-088a030a4d40 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:05.538331 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-49c3e926-973a-40c6-a772-088a030a4d40 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:05.539021 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-49c3e926-973a-40c6-a772-088a030a4d40 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:05.539643 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-49c3e926-973a-40c6-a772-088a030a4d40 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:05.559503 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-a2bbf4c6-a991-407c-a67b-b7dbb66cd546 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Getting quotas for project ac804342cc1c41768665814b1fa98b0a. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:19:05.579837 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-a2bbf4c6-a991-407c-a67b-b7dbb66cd546 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Getting quotas for user 1367cd3a99184c9b916c9b4aeba4f8e6 and project ac804342cc1c41768665814b1fa98b0a. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:19:05.608782 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a2bbf4c6-a991-407c-a67b-b7dbb66cd546 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Going to run 1 instances... {{(pid=134052) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:19:05.611701 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a2bbf4c6-a991-407c-a67b-b7dbb66cd546 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] [instance: 5bf19d4d-b710-43d3-a5a9-37893342c3bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134052) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:19:05.673639 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a2bbf4c6-a991-407c-a67b-b7dbb66cd546 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.671327 Aug 27 03:19:05.676280 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2833/5705] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 03:19:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 675 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 03:19:05.690867 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9e479ad4-eee3-4e9a-84d8-6e868bd3f8d6 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:05.691518 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-9e479ad4-eee3-4e9a-84d8-6e868bd3f8d6 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] [instance: 5bf19d4d-b710-43d3-a5a9-37893342c3bd] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:05.710097 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-49c3e926-973a-40c6-a772-088a030a4d40 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:05.722227 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-49c3e926-973a-40c6-a772-088a030a4d40 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/2e6cb94a-6898-4441-9c34-8ccf3856e265" status: 200 len: 1389 microversion: 2.1 time: 0.197025 Aug 27 03:19:05.740736 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2873/5706] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:05 2022] GET /compute/v2.1/servers/2e6cb94a-6898-4441-9c34-8ccf3856e265 => generated 1389 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:19:05.771138 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-9e479ad4-eee3-4e9a-84d8-6e868bd3f8d6 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1367cd3a99184c9b916c9b4aeba4f8e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac804342cc1c41768665814b1fa98b0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:05.783164 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9e479ad4-eee3-4e9a-84d8-6e868bd3f8d6 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] 10.222.0.70 "GET /compute/v2.1/servers/5bf19d4d-b710-43d3-a5a9-37893342c3bd" status: 200 len: 1215 microversion: 2.1 time: 0.100429 Aug 27 03:19:05.785020 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2834/5707] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:05 2022] GET /compute/v2.1/servers/5bf19d4d-b710-43d3-a5a9-37893342c3bd => generated 1215 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:19:05.846978 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-9fc105a6-5b6c-4e94-90dc-2e0fc7e3214e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:05.847489 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-9fc105a6-5b6c-4e94-90dc-2e0fc7e3214e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 2e6cb94a-6898-4441-9c34-8ccf3856e265] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:05.854355 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9fc105a6-5b6c-4e94-90dc-2e0fc7e3214e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:05.854462 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9fc105a6-5b6c-4e94-90dc-2e0fc7e3214e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:05.855090 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9fc105a6-5b6c-4e94-90dc-2e0fc7e3214e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:05.856681 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9fc105a6-5b6c-4e94-90dc-2e0fc7e3214e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:05.857361 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9fc105a6-5b6c-4e94-90dc-2e0fc7e3214e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:05.857957 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9fc105a6-5b6c-4e94-90dc-2e0fc7e3214e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:05.888796 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-9fc105a6-5b6c-4e94-90dc-2e0fc7e3214e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 2e6cb94a-6898-4441-9c34-8ccf3856e265] Going to try to terminate instance {{(pid=134051) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:19:06.002767 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-9fc105a6-5b6c-4e94-90dc-2e0fc7e3214e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "DELETE /compute/v2.1/servers/2e6cb94a-6898-4441-9c34-8ccf3856e265" status: 204 len: 0 microversion: 2.1 time: 0.159493 Aug 27 03:19:06.006831 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2874/5708] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 03:19:05 2022] DELETE /compute/v2.1/servers/2e6cb94a-6898-4441-9c34-8ccf3856e265 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:19:06.017113 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-893dd8f5-f15a-46e0-91b1-e3e3aafbc14a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:06.021296 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-893dd8f5-f15a-46e0-91b1-e3e3aafbc14a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 2e6cb94a-6898-4441-9c34-8ccf3856e265] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:06.038698 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-893dd8f5-f15a-46e0-91b1-e3e3aafbc14a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:06.040641 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-893dd8f5-f15a-46e0-91b1-e3e3aafbc14a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:06.041621 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-893dd8f5-f15a-46e0-91b1-e3e3aafbc14a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:06.042451 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-893dd8f5-f15a-46e0-91b1-e3e3aafbc14a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:06.042910 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-893dd8f5-f15a-46e0-91b1-e3e3aafbc14a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:06.043502 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-893dd8f5-f15a-46e0-91b1-e3e3aafbc14a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:06.225250 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-893dd8f5-f15a-46e0-91b1-e3e3aafbc14a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:06.233645 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-893dd8f5-f15a-46e0-91b1-e3e3aafbc14a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/2e6cb94a-6898-4441-9c34-8ccf3856e265" status: 200 len: 1395 microversion: 2.1 time: 0.225620 Aug 27 03:19:06.234764 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2835/5709] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:06 2022] GET /compute/v2.1/servers/2e6cb94a-6898-4441-9c34-8ccf3856e265 => generated 1395 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:06.806626 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7bd5903b-5650-4426-bdbc-54f9ab082401 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:06.808066 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-7bd5903b-5650-4426-bdbc-54f9ab082401 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] [instance: 5bf19d4d-b710-43d3-a5a9-37893342c3bd] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:06.820358 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7bd5903b-5650-4426-bdbc-54f9ab082401 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:06.820857 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7bd5903b-5650-4426-bdbc-54f9ab082401 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:06.821310 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7bd5903b-5650-4426-bdbc-54f9ab082401 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:06.822047 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7bd5903b-5650-4426-bdbc-54f9ab082401 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:06.822510 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7bd5903b-5650-4426-bdbc-54f9ab082401 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:06.822950 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7bd5903b-5650-4426-bdbc-54f9ab082401 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:06.981615 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-7bd5903b-5650-4426-bdbc-54f9ab082401 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1367cd3a99184c9b916c9b4aeba4f8e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac804342cc1c41768665814b1fa98b0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:06.992127 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-7bd5903b-5650-4426-bdbc-54f9ab082401 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] 10.222.0.70 "GET /compute/v2.1/servers/5bf19d4d-b710-43d3-a5a9-37893342c3bd" status: 200 len: 1267 microversion: 2.1 time: 0.190634 Aug 27 03:19:06.993221 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2875/5710] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:06 2022] GET /compute/v2.1/servers/5bf19d4d-b710-43d3-a5a9-37893342c3bd => generated 1267 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:07.255349 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5a23df67-5490-40d2-bb7e-2a2e12756ea9 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:07.255913 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-5a23df67-5490-40d2-bb7e-2a2e12756ea9 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 2e6cb94a-6898-4441-9c34-8ccf3856e265] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:07.267762 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5a23df67-5490-40d2-bb7e-2a2e12756ea9 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:07.268811 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5a23df67-5490-40d2-bb7e-2a2e12756ea9 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:07.269475 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5a23df67-5490-40d2-bb7e-2a2e12756ea9 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:07.270499 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5a23df67-5490-40d2-bb7e-2a2e12756ea9 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:07.271444 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5a23df67-5490-40d2-bb7e-2a2e12756ea9 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:07.272264 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5a23df67-5490-40d2-bb7e-2a2e12756ea9 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:07.481601 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-5a23df67-5490-40d2-bb7e-2a2e12756ea9 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:07.490038 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-5a23df67-5490-40d2-bb7e-2a2e12756ea9 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/2e6cb94a-6898-4441-9c34-8ccf3856e265" status: 200 len: 1395 microversion: 2.1 time: 0.238754 Aug 27 03:19:07.490911 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2836/5711] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:07 2022] GET /compute/v2.1/servers/2e6cb94a-6898-4441-9c34-8ccf3856e265 => generated 1395 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:08.022024 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7c780635-d5e2-4fb1-a0d0-3ede2e714232 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:08.022856 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-7c780635-d5e2-4fb1-a0d0-3ede2e714232 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] [instance: 5bf19d4d-b710-43d3-a5a9-37893342c3bd] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:08.035220 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7c780635-d5e2-4fb1-a0d0-3ede2e714232 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:08.038375 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7c780635-d5e2-4fb1-a0d0-3ede2e714232 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:08.039063 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7c780635-d5e2-4fb1-a0d0-3ede2e714232 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:08.040067 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7c780635-d5e2-4fb1-a0d0-3ede2e714232 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:08.040617 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7c780635-d5e2-4fb1-a0d0-3ede2e714232 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:08.042108 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7c780635-d5e2-4fb1-a0d0-3ede2e714232 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:08.399607 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-7c780635-d5e2-4fb1-a0d0-3ede2e714232 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1367cd3a99184c9b916c9b4aeba4f8e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac804342cc1c41768665814b1fa98b0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:08.410766 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-7c780635-d5e2-4fb1-a0d0-3ede2e714232 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] 10.222.0.70 "GET /compute/v2.1/servers/5bf19d4d-b710-43d3-a5a9-37893342c3bd" status: 200 len: 1315 microversion: 2.1 time: 0.394041 Aug 27 03:19:08.412882 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2876/5712] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:08 2022] GET /compute/v2.1/servers/5bf19d4d-b710-43d3-a5a9-37893342c3bd => generated 1315 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:08.515875 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-fcec6273-cf85-4fa5-a876-4961878b8d2f tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:08.516735 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-fcec6273-cf85-4fa5-a876-4961878b8d2f tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 2e6cb94a-6898-4441-9c34-8ccf3856e265] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:08.533657 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fcec6273-cf85-4fa5-a876-4961878b8d2f tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:08.534441 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fcec6273-cf85-4fa5-a876-4961878b8d2f tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:08.538387 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fcec6273-cf85-4fa5-a876-4961878b8d2f tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:08.542361 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fcec6273-cf85-4fa5-a876-4961878b8d2f tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:08.546132 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fcec6273-cf85-4fa5-a876-4961878b8d2f tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:08.546922 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fcec6273-cf85-4fa5-a876-4961878b8d2f tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:08.678548 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-1647404a-a1e9-4d79-a415-c72c9d7a3370 req-89b19df5-e084-444c-8408-4dcc2c1e0f34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e6cb94a-6898-4441-9c34-8ccf3856e265", "name": "network-vif-deleted", "tag": "14a2ac8c-729f-42ec-94dd-21f1b077ba45"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:19:08.689416 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-1647404a-a1e9-4d79-a415-c72c9d7a3370 req-89b19df5-e084-444c-8408-4dcc2c1e0f34 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:08.690163 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-1647404a-a1e9-4d79-a415-c72c9d7a3370 req-89b19df5-e084-444c-8408-4dcc2c1e0f34 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:08.690759 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-1647404a-a1e9-4d79-a415-c72c9d7a3370 req-89b19df5-e084-444c-8408-4dcc2c1e0f34 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:08.708483 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-1647404a-a1e9-4d79-a415-c72c9d7a3370 req-89b19df5-e084-444c-8408-4dcc2c1e0f34 service nova] Creating event network-vif-deleted:14a2ac8c-729f-42ec-94dd-21f1b077ba45 for instance 2e6cb94a-6898-4441-9c34-8ccf3856e265 on n-h1-852278-4 Aug 27 03:19:08.713847 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-1647404a-a1e9-4d79-a415-c72c9d7a3370 req-89b19df5-e084-444c-8408-4dcc2c1e0f34 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.463915 Aug 27 03:19:08.715008 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2837/5713] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:19:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:19:08.726623 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-fcec6273-cf85-4fa5-a876-4961878b8d2f tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:08.738685 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-fcec6273-cf85-4fa5-a876-4961878b8d2f tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/2e6cb94a-6898-4441-9c34-8ccf3856e265" status: 200 len: 1187 microversion: 2.1 time: 0.231399 Aug 27 03:19:08.752660 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2877/5714] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:08 2022] GET /compute/v2.1/servers/2e6cb94a-6898-4441-9c34-8ccf3856e265 => generated 1187 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:09.004295 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-ab2a8c9e-3a6f-4b35-9bd2-631361c1f9bc req-7ae61ecf-b767-4fe9-bfae-669edeb55eb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bf19d4d-b710-43d3-a5a9-37893342c3bd", "tag": "1dfb0a85-5a90-4785-9eeb-89e4c8c80b09"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:19:09.021317 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-ab2a8c9e-3a6f-4b35-9bd2-631361c1f9bc req-7ae61ecf-b767-4fe9-bfae-669edeb55eb0 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:09.022147 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-ab2a8c9e-3a6f-4b35-9bd2-631361c1f9bc req-7ae61ecf-b767-4fe9-bfae-669edeb55eb0 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:09.022746 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-ab2a8c9e-3a6f-4b35-9bd2-631361c1f9bc req-7ae61ecf-b767-4fe9-bfae-669edeb55eb0 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:09.035656 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-ab2a8c9e-3a6f-4b35-9bd2-631361c1f9bc req-7ae61ecf-b767-4fe9-bfae-669edeb55eb0 service nova] Creating event network-changed:1dfb0a85-5a90-4785-9eeb-89e4c8c80b09 for instance 5bf19d4d-b710-43d3-a5a9-37893342c3bd on n-h2-852278-4 Aug 27 03:19:09.041060 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-ab2a8c9e-3a6f-4b35-9bd2-631361c1f9bc req-7ae61ecf-b767-4fe9-bfae-669edeb55eb0 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040761 Aug 27 03:19:09.042157 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2838/5715] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:19:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:19:09.434554 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-76af2e97-dfc8-4ebd-a292-12dfae9c9a82 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:09.436270 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-76af2e97-dfc8-4ebd-a292-12dfae9c9a82 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] [instance: 5bf19d4d-b710-43d3-a5a9-37893342c3bd] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:09.444997 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-76af2e97-dfc8-4ebd-a292-12dfae9c9a82 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:09.446205 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-76af2e97-dfc8-4ebd-a292-12dfae9c9a82 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:09.446883 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-76af2e97-dfc8-4ebd-a292-12dfae9c9a82 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:09.447798 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-76af2e97-dfc8-4ebd-a292-12dfae9c9a82 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:09.448819 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-76af2e97-dfc8-4ebd-a292-12dfae9c9a82 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:09.449583 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-76af2e97-dfc8-4ebd-a292-12dfae9c9a82 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:09.717251 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-76af2e97-dfc8-4ebd-a292-12dfae9c9a82 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1367cd3a99184c9b916c9b4aeba4f8e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac804342cc1c41768665814b1fa98b0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:09.728356 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-76af2e97-dfc8-4ebd-a292-12dfae9c9a82 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] 10.222.0.70 "GET /compute/v2.1/servers/5bf19d4d-b710-43d3-a5a9-37893342c3bd" status: 200 len: 1315 microversion: 2.1 time: 0.298104 Aug 27 03:19:09.730188 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2878/5716] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:09 2022] GET /compute/v2.1/servers/5bf19d4d-b710-43d3-a5a9-37893342c3bd => generated 1315 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:09.761762 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b31e9d80-e818-4e58-8174-02a298b64776 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:09.763397 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b31e9d80-e818-4e58-8174-02a298b64776 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 2e6cb94a-6898-4441-9c34-8ccf3856e265] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:09.770831 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b31e9d80-e818-4e58-8174-02a298b64776 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:09.771507 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b31e9d80-e818-4e58-8174-02a298b64776 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:09.772258 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b31e9d80-e818-4e58-8174-02a298b64776 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:09.773471 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b31e9d80-e818-4e58-8174-02a298b64776 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:09.774102 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b31e9d80-e818-4e58-8174-02a298b64776 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:09.774680 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b31e9d80-e818-4e58-8174-02a298b64776 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:09.878358 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b31e9d80-e818-4e58-8174-02a298b64776 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:09.897120 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b31e9d80-e818-4e58-8174-02a298b64776 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/2e6cb94a-6898-4441-9c34-8ccf3856e265" status: 200 len: 1187 microversion: 2.1 time: 0.141223 Aug 27 03:19:09.898770 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2839/5717] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:09 2022] GET /compute/v2.1/servers/2e6cb94a-6898-4441-9c34-8ccf3856e265 => generated 1187 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:10.750233 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-34005f50-aa02-4238-905e-d4d19d99d214 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:10.751746 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-34005f50-aa02-4238-905e-d4d19d99d214 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] [instance: 5bf19d4d-b710-43d3-a5a9-37893342c3bd] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:10.759143 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-34005f50-aa02-4238-905e-d4d19d99d214 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:10.759893 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-34005f50-aa02-4238-905e-d4d19d99d214 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:10.760601 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-34005f50-aa02-4238-905e-d4d19d99d214 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:10.761539 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-34005f50-aa02-4238-905e-d4d19d99d214 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:10.762209 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-34005f50-aa02-4238-905e-d4d19d99d214 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:10.762860 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-34005f50-aa02-4238-905e-d4d19d99d214 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:10.929588 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-785568d2-f276-4ceb-9eb5-848b40994310 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:10.930766 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-785568d2-f276-4ceb-9eb5-848b40994310 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 2e6cb94a-6898-4441-9c34-8ccf3856e265] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:10.949537 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-785568d2-f276-4ceb-9eb5-848b40994310 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:10.950028 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-785568d2-f276-4ceb-9eb5-848b40994310 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:10.950497 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-785568d2-f276-4ceb-9eb5-848b40994310 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:10.951289 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-785568d2-f276-4ceb-9eb5-848b40994310 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:10.952161 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-785568d2-f276-4ceb-9eb5-848b40994310 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:10.952617 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-785568d2-f276-4ceb-9eb5-848b40994310 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:11.077596 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-785568d2-f276-4ceb-9eb5-848b40994310 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:11.092389 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-785568d2-f276-4ceb-9eb5-848b40994310 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/2e6cb94a-6898-4441-9c34-8ccf3856e265" status: 200 len: 1187 microversion: 2.1 time: 0.177188 Aug 27 03:19:11.093268 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-34005f50-aa02-4238-905e-d4d19d99d214 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1367cd3a99184c9b916c9b4aeba4f8e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac804342cc1c41768665814b1fa98b0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:11.102281 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-34005f50-aa02-4238-905e-d4d19d99d214 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] 10.222.0.70 "GET /compute/v2.1/servers/5bf19d4d-b710-43d3-a5a9-37893342c3bd" status: 200 len: 1315 microversion: 2.1 time: 0.355921 Aug 27 03:19:11.103147 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2879/5718] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:10 2022] GET /compute/v2.1/servers/5bf19d4d-b710-43d3-a5a9-37893342c3bd => generated 1315 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:11.105869 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2840/5719] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:10 2022] GET /compute/v2.1/servers/2e6cb94a-6898-4441-9c34-8ccf3856e265 => generated 1187 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:12.126438 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-1725c21b-a7ed-4c1a-8671-ac2d1cd15c6a tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:12.128124 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-1725c21b-a7ed-4c1a-8671-ac2d1cd15c6a tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] [instance: 5bf19d4d-b710-43d3-a5a9-37893342c3bd] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:12.128290 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a392c807-ec73-43ed-9fe5-eeea20cb7f22 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:12.130025 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-a392c807-ec73-43ed-9fe5-eeea20cb7f22 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 2e6cb94a-6898-4441-9c34-8ccf3856e265] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:12.137061 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1725c21b-a7ed-4c1a-8671-ac2d1cd15c6a tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:12.138047 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1725c21b-a7ed-4c1a-8671-ac2d1cd15c6a tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:12.138846 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1725c21b-a7ed-4c1a-8671-ac2d1cd15c6a tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:12.139712 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1725c21b-a7ed-4c1a-8671-ac2d1cd15c6a tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:12.140835 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1725c21b-a7ed-4c1a-8671-ac2d1cd15c6a tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:12.141780 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1725c21b-a7ed-4c1a-8671-ac2d1cd15c6a tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:12.149236 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a392c807-ec73-43ed-9fe5-eeea20cb7f22 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:12.150187 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a392c807-ec73-43ed-9fe5-eeea20cb7f22 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:12.150866 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a392c807-ec73-43ed-9fe5-eeea20cb7f22 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:12.152190 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a392c807-ec73-43ed-9fe5-eeea20cb7f22 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:12.152938 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a392c807-ec73-43ed-9fe5-eeea20cb7f22 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:12.154500 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a392c807-ec73-43ed-9fe5-eeea20cb7f22 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:12.262116 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-a392c807-ec73-43ed-9fe5-eeea20cb7f22 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:12.270640 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a392c807-ec73-43ed-9fe5-eeea20cb7f22 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/2e6cb94a-6898-4441-9c34-8ccf3856e265" status: 200 len: 1187 microversion: 2.1 time: 0.149691 Aug 27 03:19:12.272214 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2880/5720] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:12 2022] GET /compute/v2.1/servers/2e6cb94a-6898-4441-9c34-8ccf3856e265 => generated 1187 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:12.331219 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-1725c21b-a7ed-4c1a-8671-ac2d1cd15c6a tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1367cd3a99184c9b916c9b4aeba4f8e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac804342cc1c41768665814b1fa98b0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:12.339238 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-1725c21b-a7ed-4c1a-8671-ac2d1cd15c6a tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] 10.222.0.70 "GET /compute/v2.1/servers/5bf19d4d-b710-43d3-a5a9-37893342c3bd" status: 200 len: 1315 microversion: 2.1 time: 0.217882 Aug 27 03:19:12.340010 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2841/5721] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:12 2022] GET /compute/v2.1/servers/5bf19d4d-b710-43d3-a5a9-37893342c3bd => generated 1315 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:13.291653 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-412486d9-1007-48e7-b4ef-0becd2a33b27 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:13.292270 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-412486d9-1007-48e7-b4ef-0becd2a33b27 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 2e6cb94a-6898-4441-9c34-8ccf3856e265] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:13.299060 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-412486d9-1007-48e7-b4ef-0becd2a33b27 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:13.299548 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-412486d9-1007-48e7-b4ef-0becd2a33b27 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:13.300115 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-412486d9-1007-48e7-b4ef-0becd2a33b27 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:13.300855 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-412486d9-1007-48e7-b4ef-0becd2a33b27 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:13.301346 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-412486d9-1007-48e7-b4ef-0becd2a33b27 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:13.301775 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-412486d9-1007-48e7-b4ef-0becd2a33b27 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:13.335242 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-412486d9-1007-48e7-b4ef-0becd2a33b27 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:13.335726 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-412486d9-1007-48e7-b4ef-0becd2a33b27 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:13.336159 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-412486d9-1007-48e7-b4ef-0becd2a33b27 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:13.336631 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.objects.instance [None req-412486d9-1007-48e7-b4ef-0becd2a33b27 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lazy-loading 'fault' on Instance uuid 2e6cb94a-6898-4441-9c34-8ccf3856e265 {{(pid=134051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:19:13.361999 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0b9377b1-2dac-498e-89aa-722c72cbc2e2 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:13.363397 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-0b9377b1-2dac-498e-89aa-722c72cbc2e2 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] [instance: 5bf19d4d-b710-43d3-a5a9-37893342c3bd] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:13.371667 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0b9377b1-2dac-498e-89aa-722c72cbc2e2 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:13.372388 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0b9377b1-2dac-498e-89aa-722c72cbc2e2 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:13.373105 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0b9377b1-2dac-498e-89aa-722c72cbc2e2 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:13.373987 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0b9377b1-2dac-498e-89aa-722c72cbc2e2 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:13.374587 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0b9377b1-2dac-498e-89aa-722c72cbc2e2 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:13.375156 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0b9377b1-2dac-498e-89aa-722c72cbc2e2 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:13.386867 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-412486d9-1007-48e7-b4ef-0becd2a33b27 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:13.397205 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-412486d9-1007-48e7-b4ef-0becd2a33b27 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/2e6cb94a-6898-4441-9c34-8ccf3856e265" status: 200 len: 1192 microversion: 2.1 time: 0.109505 Aug 27 03:19:13.399174 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2881/5722] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:13 2022] GET /compute/v2.1/servers/2e6cb94a-6898-4441-9c34-8ccf3856e265 => generated 1192 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:13.520726 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0b9377b1-2dac-498e-89aa-722c72cbc2e2 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1367cd3a99184c9b916c9b4aeba4f8e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac804342cc1c41768665814b1fa98b0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:13.529915 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-0b9377b1-2dac-498e-89aa-722c72cbc2e2 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] 10.222.0.70 "GET /compute/v2.1/servers/5bf19d4d-b710-43d3-a5a9-37893342c3bd" status: 200 len: 1315 microversion: 2.1 time: 0.174681 Aug 27 03:19:13.530503 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2842/5723] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:13 2022] GET /compute/v2.1/servers/5bf19d4d-b710-43d3-a5a9-37893342c3bd => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:19:14.418550 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-312674e8-5141-40bf-b1b0-a9d3b929bd15 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:14.419233 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-312674e8-5141-40bf-b1b0-a9d3b929bd15 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 2e6cb94a-6898-4441-9c34-8ccf3856e265] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:14.426552 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-312674e8-5141-40bf-b1b0-a9d3b929bd15 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:14.427075 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-312674e8-5141-40bf-b1b0-a9d3b929bd15 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:14.427510 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-312674e8-5141-40bf-b1b0-a9d3b929bd15 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:14.428211 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-312674e8-5141-40bf-b1b0-a9d3b929bd15 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:14.428683 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-312674e8-5141-40bf-b1b0-a9d3b929bd15 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:14.429107 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-312674e8-5141-40bf-b1b0-a9d3b929bd15 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:14.443832 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-312674e8-5141-40bf-b1b0-a9d3b929bd15 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] HTTP exception thrown: Instance 2e6cb94a-6898-4441-9c34-8ccf3856e265 could not be found. Aug 27 03:19:14.445542 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-312674e8-5141-40bf-b1b0-a9d3b929bd15 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Request method failure captured: Aug 27 03:19:14.445542 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/2e6cb94a-6898-4441-9c34-8ccf3856e265 HTTP/1.1 Aug 27 03:19:14.445542 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 03:19:14.445542 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 03:19:14.445542 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 03:19:14.445542 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 03:19:14.445542 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 03:19:14.445542 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 03:19:14.445542 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 03:19:14.445542 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 03:19:14.445542 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYyanRmSitPtUh4DIDjvAfp5Iiwg8r3Bf9-rjIalvb44wIYhFzVkZDLPIdVwR9rbE-qHDjS_3-JeB9MrxSXFOtiOWUfHFokH2CMOJ34en6s6KyuDM-ix0my9F59eD8M1zowb_BqVFIaTj9p6YHs85SeVo0SCpB1hAOakQSi3_cd8UVk Aug 27 03:19:14.445542 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 03:19:14.445542 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 03:19:14.445542 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 03:19:14.445542 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 03:19:14.445542 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 03:19:14.445542 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 03:19:14.445542 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 7b2673a034c24d1898493bfea9ca5d1d Aug 27 03:19:14.445542 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-TestVolumeBootPattern-2103223700 Aug 27 03:19:14.445542 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 03:19:14.445542 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 03:19:14.445542 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7b2673a034c24d1898493bfea9ca5d1d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_7b2673a034c24d1898493bfea9ca5d1d", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7b2673a034c24d1898493bfea9ca5d1d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/7b2673a034c24d1898493bfea9ca5d1d"}]}] Aug 27 03:19:14.445542 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-TestVolumeBootPattern-2103223700 Aug 27 03:19:14.445542 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 7b2673a034c24d1898493bfea9ca5d1d Aug 27 03:19:14.445542 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-TestVolumeBootPattern-2103223700 Aug 27 03:19:14.445542 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-TestVolumeBootPattern-2103223700-project Aug 27 03:19:14.445542 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 03:19:14.445542 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 03:19:14.445542 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 4aa867d7baa043b1b1e6763046463b3f Aug 27 03:19:14.445542 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-TestVolumeBootPattern-2103223700-project Aug 27 03:19:14.445542 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 03:19:14.445542 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance 2e6cb94a-6898-4441-9c34-8ccf3856e265 could not be found. Aug 27 03:19:14.445542 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '2e6cb94a-6898-4441-9c34-8ccf3856e265'} Aug 27 03:19:14.445542 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:19:14.445542 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:19:14.445542 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:19:14.445542 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:19:14.445542 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:19:14.445542 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:19:14.445542 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:19:14.445542 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:19:14.445542 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:19:14.445542 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:19:14.445542 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e6cb94a-6898-4441-9c34-8ccf3856e265 could not be found. Aug 27 03:19:14.445542 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:19:14.445542 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:19:14.445542 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:19:14.445542 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:19:14.445542 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:19:14.445542 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:19:14.445542 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:19:14.445542 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:19:14.445542 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:19:14.445542 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:19:14.445542 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:19:14.445542 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:19:14.445542 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:19:14.445542 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:19:14.445542 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:19:14.445542 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:19:14.445542 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e6cb94a-6898-4441-9c34-8ccf3856e265 could not be found. Aug 27 03:19:14.445542 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:19:14.445542 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:19:14.445542 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:19:14.449628 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:19:14.449628 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:19:14.449628 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:19:14.449628 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:19:14.449628 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:19:14.449628 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e6cb94a-6898-4441-9c34-8ccf3856e265 could not be found. Aug 27 03:19:14.449628 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:19:14.449628 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-312674e8-5141-40bf-b1b0-a9d3b929bd15 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Returning 404 to user: Instance 2e6cb94a-6898-4441-9c34-8ccf3856e265 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:19:14.449628 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-312674e8-5141-40bf-b1b0-a9d3b929bd15 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/2e6cb94a-6898-4441-9c34-8ccf3856e265" status: 404 len: 111 microversion: 2.1 time: 0.032422 Aug 27 03:19:14.449628 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2882/5724] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:14 2022] GET /compute/v2.1/servers/2e6cb94a-6898-4441-9c34-8ccf3856e265 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:19:14.551021 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-bda16d9c-79fa-4e71-9e17-cf26f622ded5 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:14.551657 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-bda16d9c-79fa-4e71-9e17-cf26f622ded5 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] [instance: 5bf19d4d-b710-43d3-a5a9-37893342c3bd] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:14.559252 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bda16d9c-79fa-4e71-9e17-cf26f622ded5 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:14.559937 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bda16d9c-79fa-4e71-9e17-cf26f622ded5 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:14.560404 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bda16d9c-79fa-4e71-9e17-cf26f622ded5 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:14.561108 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bda16d9c-79fa-4e71-9e17-cf26f622ded5 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:14.561605 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bda16d9c-79fa-4e71-9e17-cf26f622ded5 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:14.561976 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bda16d9c-79fa-4e71-9e17-cf26f622ded5 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:14.715551 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-bda16d9c-79fa-4e71-9e17-cf26f622ded5 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1367cd3a99184c9b916c9b4aeba4f8e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac804342cc1c41768665814b1fa98b0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:14.723874 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-bda16d9c-79fa-4e71-9e17-cf26f622ded5 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] 10.222.0.70 "GET /compute/v2.1/servers/5bf19d4d-b710-43d3-a5a9-37893342c3bd" status: 200 len: 1315 microversion: 2.1 time: 0.177155 Aug 27 03:19:14.737483 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2843/5725] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:14 2022] GET /compute/v2.1/servers/5bf19d4d-b710-43d3-a5a9-37893342c3bd => generated 1315 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:15.234413 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-cb8d74a9-b0d0-4afc-8d4e-f9ee7ee4bcf5 req-607388b1-cd8a-4ad7-af72-842821d5d6cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bf19d4d-b710-43d3-a5a9-37893342c3bd", "name": "network-vif-plugged", "status": "completed", "tag": "1dfb0a85-5a90-4785-9eeb-89e4c8c80b09"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:19:15.245495 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-cb8d74a9-b0d0-4afc-8d4e-f9ee7ee4bcf5 req-607388b1-cd8a-4ad7-af72-842821d5d6cf service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:15.246338 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-cb8d74a9-b0d0-4afc-8d4e-f9ee7ee4bcf5 req-607388b1-cd8a-4ad7-af72-842821d5d6cf service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:15.246959 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-cb8d74a9-b0d0-4afc-8d4e-f9ee7ee4bcf5 req-607388b1-cd8a-4ad7-af72-842821d5d6cf service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:15.260626 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-cb8d74a9-b0d0-4afc-8d4e-f9ee7ee4bcf5 req-607388b1-cd8a-4ad7-af72-842821d5d6cf service nova] Creating event network-vif-plugged:1dfb0a85-5a90-4785-9eeb-89e4c8c80b09 for instance 5bf19d4d-b710-43d3-a5a9-37893342c3bd on n-h2-852278-4 Aug 27 03:19:15.266007 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-cb8d74a9-b0d0-4afc-8d4e-f9ee7ee4bcf5 req-607388b1-cd8a-4ad7-af72-842821d5d6cf service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035447 Aug 27 03:19:15.267276 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2883/5726] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:19:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:19:15.745605 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0bbf2f97-adc2-4de2-a8a3-f55e0c604725 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:15.746671 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-0bbf2f97-adc2-4de2-a8a3-f55e0c604725 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] [instance: 5bf19d4d-b710-43d3-a5a9-37893342c3bd] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:15.748943 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:19:15.755571 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0bbf2f97-adc2-4de2-a8a3-f55e0c604725 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:15.756270 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0bbf2f97-adc2-4de2-a8a3-f55e0c604725 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:15.756853 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0bbf2f97-adc2-4de2-a8a3-f55e0c604725 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:15.757668 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0bbf2f97-adc2-4de2-a8a3-f55e0c604725 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:15.758221 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0bbf2f97-adc2-4de2-a8a3-f55e0c604725 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:15.758752 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0bbf2f97-adc2-4de2-a8a3-f55e0c604725 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:16.045658 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=8 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:19:16.175602 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0bbf2f97-adc2-4de2-a8a3-f55e0c604725 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1367cd3a99184c9b916c9b4aeba4f8e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac804342cc1c41768665814b1fa98b0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:16.183475 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-0bbf2f97-adc2-4de2-a8a3-f55e0c604725 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] 10.222.0.70 "GET /compute/v2.1/servers/5bf19d4d-b710-43d3-a5a9-37893342c3bd" status: 200 len: 1315 microversion: 2.1 time: 0.442192 Aug 27 03:19:16.184051 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2844/5727] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:15 2022] GET /compute/v2.1/servers/5bf19d4d-b710-43d3-a5a9-37893342c3bd => generated 1315 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:16.608657 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8870aae4-2f1a-4f6e-95e0-c6c89933c1c4 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:16.609358 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-8870aae4-2f1a-4f6e-95e0-c6c89933c1c4 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 2e6cb94a-6898-4441-9c34-8ccf3856e265] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:16.617323 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8870aae4-2f1a-4f6e-95e0-c6c89933c1c4 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:16.618422 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8870aae4-2f1a-4f6e-95e0-c6c89933c1c4 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:16.619430 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8870aae4-2f1a-4f6e-95e0-c6c89933c1c4 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:16.620256 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8870aae4-2f1a-4f6e-95e0-c6c89933c1c4 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:16.620859 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8870aae4-2f1a-4f6e-95e0-c6c89933c1c4 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:16.621393 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8870aae4-2f1a-4f6e-95e0-c6c89933c1c4 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:16.636830 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-8870aae4-2f1a-4f6e-95e0-c6c89933c1c4 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] HTTP exception thrown: Instance 2e6cb94a-6898-4441-9c34-8ccf3856e265 could not be found. Aug 27 03:19:16.638676 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8870aae4-2f1a-4f6e-95e0-c6c89933c1c4 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Request method failure captured: Aug 27 03:19:16.638676 n-d-852278-4 devstack@n-api.service[134051]: request: DELETE /compute/v2.1/servers/2e6cb94a-6898-4441-9c34-8ccf3856e265 HTTP/1.1 Aug 27 03:19:16.638676 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 03:19:16.638676 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 03:19:16.638676 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 03:19:16.638676 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 03:19:16.638676 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 03:19:16.638676 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 03:19:16.638676 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 03:19:16.638676 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 03:19:16.638676 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYyanRmSitPtUh4DIDjvAfp5Iiwg8r3Bf9-rjIalvb44wIYhFzVkZDLPIdVwR9rbE-qHDjS_3-JeB9MrxSXFOtiOWUfHFokH2CMOJ34en6s6KyuDM-ix0my9F59eD8M1zowb_BqVFIaTj9p6YHs85SeVo0SCpB1hAOakQSi3_cd8UVk Aug 27 03:19:16.638676 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 03:19:16.638676 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 03:19:16.638676 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 03:19:16.638676 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 03:19:16.638676 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 03:19:16.638676 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 03:19:16.638676 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 7b2673a034c24d1898493bfea9ca5d1d Aug 27 03:19:16.638676 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-TestVolumeBootPattern-2103223700 Aug 27 03:19:16.638676 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 03:19:16.638676 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 03:19:16.638676 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7b2673a034c24d1898493bfea9ca5d1d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_7b2673a034c24d1898493bfea9ca5d1d", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7b2673a034c24d1898493bfea9ca5d1d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/7b2673a034c24d1898493bfea9ca5d1d"}]}] Aug 27 03:19:16.638676 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-TestVolumeBootPattern-2103223700 Aug 27 03:19:16.638676 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 7b2673a034c24d1898493bfea9ca5d1d Aug 27 03:19:16.638676 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-TestVolumeBootPattern-2103223700 Aug 27 03:19:16.638676 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-TestVolumeBootPattern-2103223700-project Aug 27 03:19:16.638676 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 03:19:16.638676 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 03:19:16.638676 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 4aa867d7baa043b1b1e6763046463b3f Aug 27 03:19:16.638676 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-TestVolumeBootPattern-2103223700-project Aug 27 03:19:16.638676 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 03:19:16.638676 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance 2e6cb94a-6898-4441-9c34-8ccf3856e265 could not be found. Aug 27 03:19:16.638676 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '2e6cb94a-6898-4441-9c34-8ccf3856e265'} Aug 27 03:19:16.638676 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:19:16.638676 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:19:16.638676 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:19:16.638676 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:19:16.638676 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:19:16.638676 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:19:16.638676 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:19:16.638676 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:19:16.638676 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:19:16.638676 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:19:16.638676 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e6cb94a-6898-4441-9c34-8ccf3856e265 could not be found. Aug 27 03:19:16.638676 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:19:16.638676 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:19:16.638676 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:19:16.638676 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:19:16.638676 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:19:16.638676 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:19:16.638676 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:19:16.638676 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:19:16.638676 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:19:16.638676 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:19:16.638676 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 03:19:16.638676 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 03:19:16.638676 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 03:19:16.638676 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 03:19:16.638676 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:19:16.638676 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:19:16.638676 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:19:16.638676 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:19:16.643390 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e6cb94a-6898-4441-9c34-8ccf3856e265 could not be found. Aug 27 03:19:16.643390 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:19:16.643390 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:19:16.643390 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:19:16.643390 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:19:16.643390 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:19:16.643390 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:19:16.643390 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:19:16.643390 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:19:16.643390 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e6cb94a-6898-4441-9c34-8ccf3856e265 could not be found. Aug 27 03:19:16.643390 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:19:16.643390 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8870aae4-2f1a-4f6e-95e0-c6c89933c1c4 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Returning 404 to user: Instance 2e6cb94a-6898-4441-9c34-8ccf3856e265 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:19:16.645423 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-8870aae4-2f1a-4f6e-95e0-c6c89933c1c4 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "DELETE /compute/v2.1/servers/2e6cb94a-6898-4441-9c34-8ccf3856e265" status: 404 len: 111 microversion: 2.1 time: 0.040644 Aug 27 03:19:16.646090 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2884/5728] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 03:19:16 2022] DELETE /compute/v2.1/servers/2e6cb94a-6898-4441-9c34-8ccf3856e265 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:19:16.655086 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4562d44b-08db-4c42-87f3-83a30e4b79f8 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:16.655940 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-4562d44b-08db-4c42-87f3-83a30e4b79f8 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 2e6cb94a-6898-4441-9c34-8ccf3856e265] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:16.662524 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4562d44b-08db-4c42-87f3-83a30e4b79f8 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:16.663044 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4562d44b-08db-4c42-87f3-83a30e4b79f8 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:16.663580 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4562d44b-08db-4c42-87f3-83a30e4b79f8 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:16.664255 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4562d44b-08db-4c42-87f3-83a30e4b79f8 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:16.665159 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4562d44b-08db-4c42-87f3-83a30e4b79f8 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:16.665760 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4562d44b-08db-4c42-87f3-83a30e4b79f8 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:16.681343 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-4562d44b-08db-4c42-87f3-83a30e4b79f8 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] HTTP exception thrown: Instance 2e6cb94a-6898-4441-9c34-8ccf3856e265 could not be found. Aug 27 03:19:16.683055 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4562d44b-08db-4c42-87f3-83a30e4b79f8 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Request method failure captured: Aug 27 03:19:16.683055 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/servers/2e6cb94a-6898-4441-9c34-8ccf3856e265 HTTP/1.1 Aug 27 03:19:16.683055 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 03:19:16.683055 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 03:19:16.683055 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 03:19:16.683055 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 03:19:16.683055 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 03:19:16.683055 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 03:19:16.683055 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 03:19:16.683055 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 03:19:16.683055 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYyanRmSitPtUh4DIDjvAfp5Iiwg8r3Bf9-rjIalvb44wIYhFzVkZDLPIdVwR9rbE-qHDjS_3-JeB9MrxSXFOtiOWUfHFokH2CMOJ34en6s6KyuDM-ix0my9F59eD8M1zowb_BqVFIaTj9p6YHs85SeVo0SCpB1hAOakQSi3_cd8UVk Aug 27 03:19:16.683055 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 03:19:16.683055 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 03:19:16.683055 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 03:19:16.683055 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 03:19:16.683055 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 03:19:16.683055 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 03:19:16.683055 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 7b2673a034c24d1898493bfea9ca5d1d Aug 27 03:19:16.683055 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-TestVolumeBootPattern-2103223700 Aug 27 03:19:16.683055 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 03:19:16.683055 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 03:19:16.683055 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7b2673a034c24d1898493bfea9ca5d1d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_7b2673a034c24d1898493bfea9ca5d1d", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7b2673a034c24d1898493bfea9ca5d1d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/7b2673a034c24d1898493bfea9ca5d1d"}]}] Aug 27 03:19:16.683055 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-TestVolumeBootPattern-2103223700 Aug 27 03:19:16.683055 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 7b2673a034c24d1898493bfea9ca5d1d Aug 27 03:19:16.683055 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-TestVolumeBootPattern-2103223700 Aug 27 03:19:16.683055 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-TestVolumeBootPattern-2103223700-project Aug 27 03:19:16.683055 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 03:19:16.683055 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 03:19:16.683055 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 4aa867d7baa043b1b1e6763046463b3f Aug 27 03:19:16.683055 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-TestVolumeBootPattern-2103223700-project Aug 27 03:19:16.683055 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 03:19:16.683055 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance 2e6cb94a-6898-4441-9c34-8ccf3856e265 could not be found. Aug 27 03:19:16.683055 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '2e6cb94a-6898-4441-9c34-8ccf3856e265'} Aug 27 03:19:16.683055 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:19:16.683055 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:19:16.683055 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:19:16.683055 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:19:16.683055 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:19:16.683055 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:19:16.683055 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:19:16.683055 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:19:16.683055 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:19:16.683055 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:19:16.683055 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e6cb94a-6898-4441-9c34-8ccf3856e265 could not be found. Aug 27 03:19:16.683055 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:19:16.683055 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:19:16.683055 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:19:16.683055 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:19:16.683055 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:19:16.683055 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:19:16.683055 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:19:16.683055 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:19:16.683055 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:19:16.683055 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:19:16.683055 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:19:16.683055 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:19:16.683055 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:19:16.683055 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:19:16.683055 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:19:16.683055 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:19:16.683055 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e6cb94a-6898-4441-9c34-8ccf3856e265 could not be found. Aug 27 03:19:16.683055 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:19:16.683055 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:19:16.683055 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:19:16.688052 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:19:16.688052 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:19:16.688052 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:19:16.688052 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:19:16.688052 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:19:16.688052 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e6cb94a-6898-4441-9c34-8ccf3856e265 could not be found. Aug 27 03:19:16.688052 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:19:16.688052 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4562d44b-08db-4c42-87f3-83a30e4b79f8 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Returning 404 to user: Instance 2e6cb94a-6898-4441-9c34-8ccf3856e265 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:19:16.688052 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-4562d44b-08db-4c42-87f3-83a30e4b79f8 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/2e6cb94a-6898-4441-9c34-8ccf3856e265" status: 404 len: 111 microversion: 2.1 time: 0.033995 Aug 27 03:19:16.688937 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2845/5729] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:16 2022] GET /compute/v2.1/servers/2e6cb94a-6898-4441-9c34-8ccf3856e265 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:19:17.204772 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d742cff7-7db1-4cfc-b9c1-72d61944a4a2 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:17.205502 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d742cff7-7db1-4cfc-b9c1-72d61944a4a2 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] [instance: 5bf19d4d-b710-43d3-a5a9-37893342c3bd] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:17.211875 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d742cff7-7db1-4cfc-b9c1-72d61944a4a2 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:17.212625 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d742cff7-7db1-4cfc-b9c1-72d61944a4a2 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:17.213072 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d742cff7-7db1-4cfc-b9c1-72d61944a4a2 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:17.213782 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d742cff7-7db1-4cfc-b9c1-72d61944a4a2 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:17.214268 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d742cff7-7db1-4cfc-b9c1-72d61944a4a2 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:17.214702 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d742cff7-7db1-4cfc-b9c1-72d61944a4a2 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:17.356911 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d742cff7-7db1-4cfc-b9c1-72d61944a4a2 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1367cd3a99184c9b916c9b4aeba4f8e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac804342cc1c41768665814b1fa98b0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:17.366038 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d742cff7-7db1-4cfc-b9c1-72d61944a4a2 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] 10.222.0.70 "GET /compute/v2.1/servers/5bf19d4d-b710-43d3-a5a9-37893342c3bd" status: 200 len: 1465 microversion: 2.1 time: 0.165260 Aug 27 03:19:17.366549 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2885/5730] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:17 2022] GET /compute/v2.1/servers/5bf19d4d-b710-43d3-a5a9-37893342c3bd => generated 1465 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:19:17.415977 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8e714230-8787-42ad-870f-4c5a4b7dbbff tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:17.416592 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-8e714230-8787-42ad-870f-4c5a4b7dbbff tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] [instance: 5bf19d4d-b710-43d3-a5a9-37893342c3bd] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:17.424866 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8e714230-8787-42ad-870f-4c5a4b7dbbff tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:17.425404 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8e714230-8787-42ad-870f-4c5a4b7dbbff tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:17.425854 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8e714230-8787-42ad-870f-4c5a4b7dbbff tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:17.426816 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8e714230-8787-42ad-870f-4c5a4b7dbbff tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:17.427440 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8e714230-8787-42ad-870f-4c5a4b7dbbff tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:17.427911 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8e714230-8787-42ad-870f-4c5a4b7dbbff tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:17.456001 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-8e714230-8787-42ad-870f-4c5a4b7dbbff tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] [instance: 5bf19d4d-b710-43d3-a5a9-37893342c3bd] Going to try to terminate instance {{(pid=134052) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:19:17.545971 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-8e714230-8787-42ad-870f-4c5a4b7dbbff tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] 10.222.0.70 "DELETE /compute/v2.1/servers/5bf19d4d-b710-43d3-a5a9-37893342c3bd" status: 204 len: 0 microversion: 2.1 time: 0.133884 Aug 27 03:19:17.546986 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2846/5731] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 03:19:17 2022] DELETE /compute/v2.1/servers/5bf19d4d-b710-43d3-a5a9-37893342c3bd => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:19:17.555533 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-83a43fa7-d7c3-4d00-b13c-70f55a859276 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:17.556226 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-83a43fa7-d7c3-4d00-b13c-70f55a859276 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] [instance: 5bf19d4d-b710-43d3-a5a9-37893342c3bd] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:17.562971 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-83a43fa7-d7c3-4d00-b13c-70f55a859276 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:17.563495 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-83a43fa7-d7c3-4d00-b13c-70f55a859276 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:17.563931 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-83a43fa7-d7c3-4d00-b13c-70f55a859276 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:17.564690 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-83a43fa7-d7c3-4d00-b13c-70f55a859276 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:17.565141 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-83a43fa7-d7c3-4d00-b13c-70f55a859276 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:17.565559 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-83a43fa7-d7c3-4d00-b13c-70f55a859276 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:17.703932 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-83a43fa7-d7c3-4d00-b13c-70f55a859276 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1367cd3a99184c9b916c9b4aeba4f8e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac804342cc1c41768665814b1fa98b0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:17.712516 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-83a43fa7-d7c3-4d00-b13c-70f55a859276 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] 10.222.0.70 "GET /compute/v2.1/servers/5bf19d4d-b710-43d3-a5a9-37893342c3bd" status: 200 len: 1471 microversion: 2.1 time: 0.160939 Aug 27 03:19:17.713233 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2886/5732] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:17 2022] GET /compute/v2.1/servers/5bf19d4d-b710-43d3-a5a9-37893342c3bd => generated 1471 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:18.735048 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-eda6b2e7-6e22-4d3c-956a-52a24b1cbdc7 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:18.735917 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-eda6b2e7-6e22-4d3c-956a-52a24b1cbdc7 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] [instance: 5bf19d4d-b710-43d3-a5a9-37893342c3bd] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:18.743723 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-eda6b2e7-6e22-4d3c-956a-52a24b1cbdc7 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:18.744231 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-eda6b2e7-6e22-4d3c-956a-52a24b1cbdc7 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:18.744714 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-eda6b2e7-6e22-4d3c-956a-52a24b1cbdc7 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:18.745459 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-eda6b2e7-6e22-4d3c-956a-52a24b1cbdc7 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:18.745980 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-eda6b2e7-6e22-4d3c-956a-52a24b1cbdc7 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:18.746412 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-eda6b2e7-6e22-4d3c-956a-52a24b1cbdc7 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:18.998677 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-eda6b2e7-6e22-4d3c-956a-52a24b1cbdc7 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1367cd3a99184c9b916c9b4aeba4f8e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac804342cc1c41768665814b1fa98b0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:19.010220 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-eda6b2e7-6e22-4d3c-956a-52a24b1cbdc7 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] 10.222.0.70 "GET /compute/v2.1/servers/5bf19d4d-b710-43d3-a5a9-37893342c3bd" status: 200 len: 1471 microversion: 2.1 time: 0.279016 Aug 27 03:19:19.011670 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2847/5733] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:18 2022] GET /compute/v2.1/servers/5bf19d4d-b710-43d3-a5a9-37893342c3bd => generated 1471 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:19.395558 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-2d20450b-adee-46ea-a364-fd797beb621c req-87940eaf-c223-4b30-b3bd-e2d1cebe6601 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bf19d4d-b710-43d3-a5a9-37893342c3bd", "name": "network-vif-deleted", "tag": "1dfb0a85-5a90-4785-9eeb-89e4c8c80b09"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:19:19.407178 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-2d20450b-adee-46ea-a364-fd797beb621c req-87940eaf-c223-4b30-b3bd-e2d1cebe6601 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:19.407935 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-2d20450b-adee-46ea-a364-fd797beb621c req-87940eaf-c223-4b30-b3bd-e2d1cebe6601 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:19.408558 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-2d20450b-adee-46ea-a364-fd797beb621c req-87940eaf-c223-4b30-b3bd-e2d1cebe6601 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:19.421695 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:19:19.426357 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-2d20450b-adee-46ea-a364-fd797beb621c req-87940eaf-c223-4b30-b3bd-e2d1cebe6601 service nova] Creating event network-vif-deleted:1dfb0a85-5a90-4785-9eeb-89e4c8c80b09 for instance 5bf19d4d-b710-43d3-a5a9-37893342c3bd on n-h2-852278-4 Aug 27 03:19:19.448577 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-2d20450b-adee-46ea-a364-fd797beb621c req-87940eaf-c223-4b30-b3bd-e2d1cebe6601 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056724 Aug 27 03:19:19.456672 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2887/5734] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:19:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:19:20.033311 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d7e9d1a8-e645-4a7c-a508-7abc6525e4e5 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:20.035332 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d7e9d1a8-e645-4a7c-a508-7abc6525e4e5 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] [instance: 5bf19d4d-b710-43d3-a5a9-37893342c3bd] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:20.044965 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d7e9d1a8-e645-4a7c-a508-7abc6525e4e5 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:20.045728 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d7e9d1a8-e645-4a7c-a508-7abc6525e4e5 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:20.046320 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d7e9d1a8-e645-4a7c-a508-7abc6525e4e5 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:20.047445 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d7e9d1a8-e645-4a7c-a508-7abc6525e4e5 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:20.048084 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d7e9d1a8-e645-4a7c-a508-7abc6525e4e5 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:20.048926 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d7e9d1a8-e645-4a7c-a508-7abc6525e4e5 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:20.066785 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-d7e9d1a8-e645-4a7c-a508-7abc6525e4e5 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] HTTP exception thrown: Instance 5bf19d4d-b710-43d3-a5a9-37893342c3bd could not be found. Aug 27 03:19:20.068807 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d7e9d1a8-e645-4a7c-a508-7abc6525e4e5 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Request method failure captured: Aug 27 03:19:20.068807 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/servers/5bf19d4d-b710-43d3-a5a9-37893342c3bd HTTP/1.1 Aug 27 03:19:20.068807 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 03:19:20.068807 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 03:19:20.068807 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 03:19:20.068807 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 03:19:20.068807 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 03:19:20.068807 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 03:19:20.068807 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 03:19:20.068807 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 03:19:20.068807 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCY0mCcZLQOjN9-hVIdrb7nGNUKfgQFPuflnwurYxl1eyeq96mYPqup9hOdhPqFUFPMaRm5YFkiscGn-A1k9w9KqbSy2CHlkqluJKRwl02_VU30wrJjx2FhO8wlqeqzpPjzQXFDulOzyHPi-os7s6UNZlSGcRNerl6Z0D-popGyoxGoA Aug 27 03:19:20.068807 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 03:19:20.068807 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 03:19:20.068807 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 03:19:20.068807 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 03:19:20.068807 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 03:19:20.068807 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 03:19:20.068807 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: ac804342cc1c41768665814b1fa98b0a Aug 27 03:19:20.068807 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-VolumesNegativeTest-1407194730 Aug 27 03:19:20.068807 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 03:19:20.068807 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 03:19:20.068807 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ac804342cc1c41768665814b1fa98b0a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_ac804342cc1c41768665814b1fa98b0a", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ac804342cc1c41768665814b1fa98b0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/ac804342cc1c41768665814b1fa98b0a"}]}] Aug 27 03:19:20.068807 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-VolumesNegativeTest-1407194730 Aug 27 03:19:20.068807 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: ac804342cc1c41768665814b1fa98b0a Aug 27 03:19:20.068807 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-VolumesNegativeTest-1407194730 Aug 27 03:19:20.068807 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-VolumesNegativeTest-1407194730-project Aug 27 03:19:20.068807 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 03:19:20.068807 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 03:19:20.068807 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 1367cd3a99184c9b916c9b4aeba4f8e6 Aug 27 03:19:20.068807 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-VolumesNegativeTest-1407194730-project Aug 27 03:19:20.068807 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 03:19:20.068807 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance 5bf19d4d-b710-43d3-a5a9-37893342c3bd could not be found. Aug 27 03:19:20.068807 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '5bf19d4d-b710-43d3-a5a9-37893342c3bd'} Aug 27 03:19:20.068807 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:19:20.068807 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:19:20.068807 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:19:20.068807 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:19:20.068807 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:19:20.068807 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:19:20.068807 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:19:20.068807 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:19:20.068807 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:19:20.068807 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:19:20.068807 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5bf19d4d-b710-43d3-a5a9-37893342c3bd could not be found. Aug 27 03:19:20.068807 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:19:20.068807 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:19:20.068807 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:19:20.068807 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:19:20.068807 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:19:20.068807 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:19:20.068807 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:19:20.068807 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:19:20.068807 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:19:20.068807 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:19:20.068807 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:19:20.068807 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:19:20.068807 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:19:20.068807 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:19:20.068807 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:19:20.068807 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:19:20.068807 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5bf19d4d-b710-43d3-a5a9-37893342c3bd could not be found. Aug 27 03:19:20.068807 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:19:20.068807 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:19:20.068807 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:19:20.073477 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:19:20.073477 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:19:20.073477 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:19:20.073477 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:19:20.073477 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:19:20.073477 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5bf19d4d-b710-43d3-a5a9-37893342c3bd could not be found. Aug 27 03:19:20.073477 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:19:20.074810 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d7e9d1a8-e645-4a7c-a508-7abc6525e4e5 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] Returning 404 to user: Instance 5bf19d4d-b710-43d3-a5a9-37893342c3bd could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:19:20.076241 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d7e9d1a8-e645-4a7c-a508-7abc6525e4e5 tempest-VolumesNegativeTest-1407194730 tempest-VolumesNegativeTest-1407194730-project] 10.222.0.70 "GET /compute/v2.1/servers/5bf19d4d-b710-43d3-a5a9-37893342c3bd" status: 404 len: 111 microversion: 2.1 time: 0.048679 Aug 27 03:19:20.082699 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2848/5735] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:20 2022] GET /compute/v2.1/servers/5bf19d4d-b710-43d3-a5a9-37893342c3bd => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:19:41.129395 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:19:41.135481 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f412e65c-e9cc-4e92-a15e-07c27958f505 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1385947202", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "5374946f-8b37-421a-8c6a-a5203051e54b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "02524c0f-c44c-4ea0-899e-226a790199dc"}]}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:19:41.204342 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.network.neutron [None req-f412e65c-e9cc-4e92-a15e-07c27958f505 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] validate_networks() for [('02524c0f-c44c-4ea0-899e-226a790199dc', None, None, None, None, None)] {{(pid=134051) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:19:41.712814 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-f412e65c-e9cc-4e92-a15e-07c27958f505 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Flavor limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:19:41.713525 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-f412e65c-e9cc-4e92-a15e-07c27958f505 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Image limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:19:41.714131 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-f412e65c-e9cc-4e92-a15e-07c27958f505 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Flavor pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:19:41.714625 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-f412e65c-e9cc-4e92-a15e-07c27958f505 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Image pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:19:41.715120 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-f412e65c-e9cc-4e92-a15e-07c27958f505 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:19:41.725772 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f412e65c-e9cc-4e92-a15e-07c27958f505 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:41.726372 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f412e65c-e9cc-4e92-a15e-07c27958f505 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:41.726907 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f412e65c-e9cc-4e92-a15e-07c27958f505 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:41.727870 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f412e65c-e9cc-4e92-a15e-07c27958f505 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:41.728564 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f412e65c-e9cc-4e92-a15e-07c27958f505 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:41.729084 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f412e65c-e9cc-4e92-a15e-07c27958f505 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:41.750419 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-f412e65c-e9cc-4e92-a15e-07c27958f505 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Getting quotas for project 7b2673a034c24d1898493bfea9ca5d1d. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:19:41.756411 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-f412e65c-e9cc-4e92-a15e-07c27958f505 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Getting quotas for user 4aa867d7baa043b1b1e6763046463b3f and project 7b2673a034c24d1898493bfea9ca5d1d. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:19:41.819503 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-f412e65c-e9cc-4e92-a15e-07c27958f505 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Going to run 1 instances... {{(pid=134051) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:19:41.822119 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-f412e65c-e9cc-4e92-a15e-07c27958f505 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 3050c41d-6baa-4fe4-b722-1610cbc83d86] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5374946f-8b37-421a-8c6a-a5203051e54b',volume_size=None,volume_type=None)] {{(pid=134051) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:19:41.965290 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-f412e65c-e9cc-4e92-a15e-07c27958f505 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.838693 Aug 27 03:19:41.972344 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2888/5736] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 03:19:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 840 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:19:41.978163 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5ccc112b-ed00-4443-a013-6f74252ece41 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:41.978871 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-5ccc112b-ed00-4443-a013-6f74252ece41 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 3050c41d-6baa-4fe4-b722-1610cbc83d86] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:41.984297 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:19:41.985295 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:19:42.044487 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-5ccc112b-ed00-4443-a013-6f74252ece41 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:42.059140 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-5ccc112b-ed00-4443-a013-6f74252ece41 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/3050c41d-6baa-4fe4-b722-1610cbc83d86" status: 200 len: 1071 microversion: 2.1 time: 0.085355 Aug 27 03:19:42.063459 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2849/5737] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:41 2022] GET /compute/v2.1/servers/3050c41d-6baa-4fe4-b722-1610cbc83d86 => generated 1071 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:43.089662 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f0de68aa-5f87-4316-8a57-e81c619211fb tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:43.090947 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-f0de68aa-5f87-4316-8a57-e81c619211fb tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 3050c41d-6baa-4fe4-b722-1610cbc83d86] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:43.101849 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f0de68aa-5f87-4316-8a57-e81c619211fb tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:43.102339 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f0de68aa-5f87-4316-8a57-e81c619211fb tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:43.102912 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f0de68aa-5f87-4316-8a57-e81c619211fb tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:43.103687 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f0de68aa-5f87-4316-8a57-e81c619211fb tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:43.104125 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f0de68aa-5f87-4316-8a57-e81c619211fb tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:43.104791 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f0de68aa-5f87-4316-8a57-e81c619211fb tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:43.188280 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-f0de68aa-5f87-4316-8a57-e81c619211fb tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:43.197482 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-f0de68aa-5f87-4316-8a57-e81c619211fb tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/3050c41d-6baa-4fe4-b722-1610cbc83d86" status: 200 len: 1187 microversion: 2.1 time: 0.116069 Aug 27 03:19:43.198729 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2889/5738] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:43 2022] GET /compute/v2.1/servers/3050c41d-6baa-4fe4-b722-1610cbc83d86 => generated 1187 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:44.221503 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-01cb0fd6-14c8-4fb5-b429-e55d8b7da515 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:44.223280 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-01cb0fd6-14c8-4fb5-b429-e55d8b7da515 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 3050c41d-6baa-4fe4-b722-1610cbc83d86] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:44.236991 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-01cb0fd6-14c8-4fb5-b429-e55d8b7da515 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:44.239159 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-01cb0fd6-14c8-4fb5-b429-e55d8b7da515 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:44.239855 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-01cb0fd6-14c8-4fb5-b429-e55d8b7da515 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:44.241697 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-01cb0fd6-14c8-4fb5-b429-e55d8b7da515 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:44.243800 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-01cb0fd6-14c8-4fb5-b429-e55d8b7da515 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:44.248446 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-01cb0fd6-14c8-4fb5-b429-e55d8b7da515 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:44.467597 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-01cb0fd6-14c8-4fb5-b429-e55d8b7da515 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:44.476995 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-01cb0fd6-14c8-4fb5-b429-e55d8b7da515 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/3050c41d-6baa-4fe4-b722-1610cbc83d86" status: 200 len: 1229 microversion: 2.1 time: 0.259848 Aug 27 03:19:44.478408 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2850/5739] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:44 2022] GET /compute/v2.1/servers/3050c41d-6baa-4fe4-b722-1610cbc83d86 => generated 1229 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:44.766411 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-a19b41b1-2516-4f5b-b0f6-b4cc70191956 req-f6f826c6-5a24-4006-af74-b988331acdca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3050c41d-6baa-4fe4-b722-1610cbc83d86", "tag": "aa5d2005-9431-4d12-888f-960e552f9642"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:19:44.792146 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-a19b41b1-2516-4f5b-b0f6-b4cc70191956 req-f6f826c6-5a24-4006-af74-b988331acdca service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:44.793891 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-a19b41b1-2516-4f5b-b0f6-b4cc70191956 req-f6f826c6-5a24-4006-af74-b988331acdca service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:44.794344 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-a19b41b1-2516-4f5b-b0f6-b4cc70191956 req-f6f826c6-5a24-4006-af74-b988331acdca service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:44.807503 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-a19b41b1-2516-4f5b-b0f6-b4cc70191956 req-f6f826c6-5a24-4006-af74-b988331acdca service nova] Creating event network-changed:aa5d2005-9431-4d12-888f-960e552f9642 for instance 3050c41d-6baa-4fe4-b722-1610cbc83d86 on n-h2-852278-4 Aug 27 03:19:44.819352 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-a19b41b1-2516-4f5b-b0f6-b4cc70191956 req-f6f826c6-5a24-4006-af74-b988331acdca service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056491 Aug 27 03:19:44.820372 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2890/5740] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:19:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:19:45.500031 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-136dbf0d-5e5c-4f27-9a8e-c55fc3ddde73 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:45.500746 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-136dbf0d-5e5c-4f27-9a8e-c55fc3ddde73 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 3050c41d-6baa-4fe4-b722-1610cbc83d86] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:45.513242 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-136dbf0d-5e5c-4f27-9a8e-c55fc3ddde73 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:45.514121 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-136dbf0d-5e5c-4f27-9a8e-c55fc3ddde73 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:45.514761 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-136dbf0d-5e5c-4f27-9a8e-c55fc3ddde73 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:45.515977 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-136dbf0d-5e5c-4f27-9a8e-c55fc3ddde73 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:45.516626 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-136dbf0d-5e5c-4f27-9a8e-c55fc3ddde73 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:45.517963 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-136dbf0d-5e5c-4f27-9a8e-c55fc3ddde73 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:45.776614 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-136dbf0d-5e5c-4f27-9a8e-c55fc3ddde73 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:45.788628 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-136dbf0d-5e5c-4f27-9a8e-c55fc3ddde73 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/3050c41d-6baa-4fe4-b722-1610cbc83d86" status: 200 len: 1229 microversion: 2.1 time: 0.293587 Aug 27 03:19:45.801312 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2851/5741] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:45 2022] GET /compute/v2.1/servers/3050c41d-6baa-4fe4-b722-1610cbc83d86 => generated 1229 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:46.812304 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a3bee313-6d65-4e80-b536-9620594bce9b tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:46.822868 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-a3bee313-6d65-4e80-b536-9620594bce9b tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 3050c41d-6baa-4fe4-b722-1610cbc83d86] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:46.832349 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a3bee313-6d65-4e80-b536-9620594bce9b tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:46.832920 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a3bee313-6d65-4e80-b536-9620594bce9b tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:46.833771 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a3bee313-6d65-4e80-b536-9620594bce9b tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:46.834687 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a3bee313-6d65-4e80-b536-9620594bce9b tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:46.835723 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a3bee313-6d65-4e80-b536-9620594bce9b tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:46.835723 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a3bee313-6d65-4e80-b536-9620594bce9b tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:47.021726 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-a3bee313-6d65-4e80-b536-9620594bce9b tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:47.031368 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a3bee313-6d65-4e80-b536-9620594bce9b tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/3050c41d-6baa-4fe4-b722-1610cbc83d86" status: 200 len: 1229 microversion: 2.1 time: 0.225351 Aug 27 03:19:47.032272 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2891/5742] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:46 2022] GET /compute/v2.1/servers/3050c41d-6baa-4fe4-b722-1610cbc83d86 => generated 1229 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:48.051287 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-11a5f37d-6522-4505-851d-51e1926b2f02 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:48.051873 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-11a5f37d-6522-4505-851d-51e1926b2f02 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 3050c41d-6baa-4fe4-b722-1610cbc83d86] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:48.059607 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-11a5f37d-6522-4505-851d-51e1926b2f02 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:48.060096 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-11a5f37d-6522-4505-851d-51e1926b2f02 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:48.060570 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-11a5f37d-6522-4505-851d-51e1926b2f02 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:48.061284 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-11a5f37d-6522-4505-851d-51e1926b2f02 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:48.061755 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-11a5f37d-6522-4505-851d-51e1926b2f02 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:48.062181 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-11a5f37d-6522-4505-851d-51e1926b2f02 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:48.201993 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-11a5f37d-6522-4505-851d-51e1926b2f02 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:48.210406 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-11a5f37d-6522-4505-851d-51e1926b2f02 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/3050c41d-6baa-4fe4-b722-1610cbc83d86" status: 200 len: 1229 microversion: 2.1 time: 0.163013 Aug 27 03:19:48.211004 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2852/5743] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:48 2022] GET /compute/v2.1/servers/3050c41d-6baa-4fe4-b722-1610cbc83d86 => generated 1229 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:49.231922 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-1d981497-8aef-4b9e-8694-0ad44e4b46b4 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:49.232611 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-1d981497-8aef-4b9e-8694-0ad44e4b46b4 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 3050c41d-6baa-4fe4-b722-1610cbc83d86] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:49.240294 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1d981497-8aef-4b9e-8694-0ad44e4b46b4 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:49.240821 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1d981497-8aef-4b9e-8694-0ad44e4b46b4 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:49.241256 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1d981497-8aef-4b9e-8694-0ad44e4b46b4 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:49.241971 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1d981497-8aef-4b9e-8694-0ad44e4b46b4 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:49.242421 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1d981497-8aef-4b9e-8694-0ad44e4b46b4 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:49.242848 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1d981497-8aef-4b9e-8694-0ad44e4b46b4 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:49.375767 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-1d981497-8aef-4b9e-8694-0ad44e4b46b4 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:49.384472 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-1d981497-8aef-4b9e-8694-0ad44e4b46b4 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/3050c41d-6baa-4fe4-b722-1610cbc83d86" status: 200 len: 1229 microversion: 2.1 time: 0.156750 Aug 27 03:19:49.385063 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2892/5744] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:49 2022] GET /compute/v2.1/servers/3050c41d-6baa-4fe4-b722-1610cbc83d86 => generated 1229 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:50.404926 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-965ad041-e52e-45a2-b302-35659b29112d tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:50.405533 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-965ad041-e52e-45a2-b302-35659b29112d tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 3050c41d-6baa-4fe4-b722-1610cbc83d86] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:50.412801 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-965ad041-e52e-45a2-b302-35659b29112d tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:50.413291 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-965ad041-e52e-45a2-b302-35659b29112d tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:50.413718 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-965ad041-e52e-45a2-b302-35659b29112d tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:50.414409 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-965ad041-e52e-45a2-b302-35659b29112d tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:50.414854 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-965ad041-e52e-45a2-b302-35659b29112d tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:50.415274 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-965ad041-e52e-45a2-b302-35659b29112d tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:50.552327 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-965ad041-e52e-45a2-b302-35659b29112d tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:50.560824 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-965ad041-e52e-45a2-b302-35659b29112d tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/3050c41d-6baa-4fe4-b722-1610cbc83d86" status: 200 len: 1229 microversion: 2.1 time: 0.159707 Aug 27 03:19:50.561429 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2853/5745] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:50 2022] GET /compute/v2.1/servers/3050c41d-6baa-4fe4-b722-1610cbc83d86 => generated 1229 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:51.583038 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ed6bb020-0334-434a-acf3-ff8f7d8f9b7e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:51.583647 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-ed6bb020-0334-434a-acf3-ff8f7d8f9b7e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 3050c41d-6baa-4fe4-b722-1610cbc83d86] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:51.591636 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ed6bb020-0334-434a-acf3-ff8f7d8f9b7e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:51.592160 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ed6bb020-0334-434a-acf3-ff8f7d8f9b7e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:51.592653 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ed6bb020-0334-434a-acf3-ff8f7d8f9b7e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:51.593405 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ed6bb020-0334-434a-acf3-ff8f7d8f9b7e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:51.593877 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ed6bb020-0334-434a-acf3-ff8f7d8f9b7e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:51.594305 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ed6bb020-0334-434a-acf3-ff8f7d8f9b7e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:51.739788 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:19:51.763903 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=6 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:19:52.038090 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-ed6bb020-0334-434a-acf3-ff8f7d8f9b7e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:52.046144 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ed6bb020-0334-434a-acf3-ff8f7d8f9b7e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/3050c41d-6baa-4fe4-b722-1610cbc83d86" status: 200 len: 1217 microversion: 2.1 time: 0.468090 Aug 27 03:19:52.046725 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2893/5746] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:51 2022] GET /compute/v2.1/servers/3050c41d-6baa-4fe4-b722-1610cbc83d86 => generated 1217 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:53.071162 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4beaae79-8b73-4c91-beb8-c8404f54003a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:53.071793 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-4beaae79-8b73-4c91-beb8-c8404f54003a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 3050c41d-6baa-4fe4-b722-1610cbc83d86] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:53.074530 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:19:53.081248 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4beaae79-8b73-4c91-beb8-c8404f54003a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:53.081823 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4beaae79-8b73-4c91-beb8-c8404f54003a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:53.082411 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4beaae79-8b73-4c91-beb8-c8404f54003a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:53.083145 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4beaae79-8b73-4c91-beb8-c8404f54003a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:53.083670 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4beaae79-8b73-4c91-beb8-c8404f54003a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:53.084171 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4beaae79-8b73-4c91-beb8-c8404f54003a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:53.234386 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-4beaae79-8b73-4c91-beb8-c8404f54003a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:53.243181 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-4beaae79-8b73-4c91-beb8-c8404f54003a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/3050c41d-6baa-4fe4-b722-1610cbc83d86" status: 200 len: 1217 microversion: 2.1 time: 0.178027 Aug 27 03:19:53.243768 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2854/5747] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:53 2022] GET /compute/v2.1/servers/3050c41d-6baa-4fe4-b722-1610cbc83d86 => generated 1217 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:54.263383 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-fa7160f5-96bb-4859-9bab-a22850ed7ec8 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:54.264384 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-fa7160f5-96bb-4859-9bab-a22850ed7ec8 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 3050c41d-6baa-4fe4-b722-1610cbc83d86] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:54.272714 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fa7160f5-96bb-4859-9bab-a22850ed7ec8 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:54.273352 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fa7160f5-96bb-4859-9bab-a22850ed7ec8 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:54.273869 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fa7160f5-96bb-4859-9bab-a22850ed7ec8 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:54.275140 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fa7160f5-96bb-4859-9bab-a22850ed7ec8 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:54.275799 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fa7160f5-96bb-4859-9bab-a22850ed7ec8 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:54.276926 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fa7160f5-96bb-4859-9bab-a22850ed7ec8 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:54.414535 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-fa7160f5-96bb-4859-9bab-a22850ed7ec8 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:54.422949 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-fa7160f5-96bb-4859-9bab-a22850ed7ec8 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/3050c41d-6baa-4fe4-b722-1610cbc83d86" status: 200 len: 1217 microversion: 2.1 time: 0.163374 Aug 27 03:19:54.423481 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2894/5748] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:54 2022] GET /compute/v2.1/servers/3050c41d-6baa-4fe4-b722-1610cbc83d86 => generated 1217 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:55.443704 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-243ac3c1-80ea-4e40-988c-5ec027b52e55 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:55.444274 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-243ac3c1-80ea-4e40-988c-5ec027b52e55 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 3050c41d-6baa-4fe4-b722-1610cbc83d86] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:55.451355 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-243ac3c1-80ea-4e40-988c-5ec027b52e55 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:55.451851 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-243ac3c1-80ea-4e40-988c-5ec027b52e55 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:55.452276 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-243ac3c1-80ea-4e40-988c-5ec027b52e55 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:55.453011 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-243ac3c1-80ea-4e40-988c-5ec027b52e55 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:55.453460 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-243ac3c1-80ea-4e40-988c-5ec027b52e55 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:55.453883 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-243ac3c1-80ea-4e40-988c-5ec027b52e55 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:55.597934 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-243ac3c1-80ea-4e40-988c-5ec027b52e55 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:55.606301 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-243ac3c1-80ea-4e40-988c-5ec027b52e55 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/3050c41d-6baa-4fe4-b722-1610cbc83d86" status: 200 len: 1217 microversion: 2.1 time: 0.166574 Aug 27 03:19:55.606892 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2855/5749] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:55 2022] GET /compute/v2.1/servers/3050c41d-6baa-4fe4-b722-1610cbc83d86 => generated 1217 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:56.628195 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b4afd3ca-5659-449e-8bdc-818653e2ad42 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:56.628870 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b4afd3ca-5659-449e-8bdc-818653e2ad42 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 3050c41d-6baa-4fe4-b722-1610cbc83d86] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:56.636055 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b4afd3ca-5659-449e-8bdc-818653e2ad42 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:56.636590 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b4afd3ca-5659-449e-8bdc-818653e2ad42 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:56.637056 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b4afd3ca-5659-449e-8bdc-818653e2ad42 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:56.637756 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b4afd3ca-5659-449e-8bdc-818653e2ad42 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:56.638207 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b4afd3ca-5659-449e-8bdc-818653e2ad42 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:56.638619 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b4afd3ca-5659-449e-8bdc-818653e2ad42 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:56.783211 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-b4afd3ca-5659-449e-8bdc-818653e2ad42 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:56.791496 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b4afd3ca-5659-449e-8bdc-818653e2ad42 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/3050c41d-6baa-4fe4-b722-1610cbc83d86" status: 200 len: 1217 microversion: 2.1 time: 0.168312 Aug 27 03:19:56.792120 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2895/5750] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:56 2022] GET /compute/v2.1/servers/3050c41d-6baa-4fe4-b722-1610cbc83d86 => generated 1217 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:57.814377 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8c55ba06-aefe-4a65-b26b-bcf1083d5b25 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:57.815468 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-8c55ba06-aefe-4a65-b26b-bcf1083d5b25 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 3050c41d-6baa-4fe4-b722-1610cbc83d86] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:57.824062 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8c55ba06-aefe-4a65-b26b-bcf1083d5b25 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:57.824823 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8c55ba06-aefe-4a65-b26b-bcf1083d5b25 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:57.825531 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8c55ba06-aefe-4a65-b26b-bcf1083d5b25 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:57.826605 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8c55ba06-aefe-4a65-b26b-bcf1083d5b25 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:57.827249 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8c55ba06-aefe-4a65-b26b-bcf1083d5b25 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:57.827909 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8c55ba06-aefe-4a65-b26b-bcf1083d5b25 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:58.149445 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-8c55ba06-aefe-4a65-b26b-bcf1083d5b25 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:58.158218 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-8c55ba06-aefe-4a65-b26b-bcf1083d5b25 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/3050c41d-6baa-4fe4-b722-1610cbc83d86" status: 200 len: 1217 microversion: 2.1 time: 0.349815 Aug 27 03:19:58.158917 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2856/5751] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:57 2022] GET /compute/v2.1/servers/3050c41d-6baa-4fe4-b722-1610cbc83d86 => generated 1217 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:59.179624 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-200d101d-4fbc-4d19-a13a-625597b322a6 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:59.180217 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-200d101d-4fbc-4d19-a13a-625597b322a6 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 3050c41d-6baa-4fe4-b722-1610cbc83d86] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:59.188572 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-200d101d-4fbc-4d19-a13a-625597b322a6 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:59.189052 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-200d101d-4fbc-4d19-a13a-625597b322a6 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:59.190763 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-200d101d-4fbc-4d19-a13a-625597b322a6 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:59.191698 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-200d101d-4fbc-4d19-a13a-625597b322a6 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:59.192202 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-200d101d-4fbc-4d19-a13a-625597b322a6 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:59.193091 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-200d101d-4fbc-4d19-a13a-625597b322a6 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:59.349735 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-200d101d-4fbc-4d19-a13a-625597b322a6 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:59.358777 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-200d101d-4fbc-4d19-a13a-625597b322a6 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/3050c41d-6baa-4fe4-b722-1610cbc83d86" status: 200 len: 1217 microversion: 2.1 time: 0.183032 Aug 27 03:19:59.359405 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2896/5752] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:59 2022] GET /compute/v2.1/servers/3050c41d-6baa-4fe4-b722-1610cbc83d86 => generated 1217 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:00.380192 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-cc0505af-1e6e-45b4-9492-cdf088cee60e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:00.381046 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-cc0505af-1e6e-45b4-9492-cdf088cee60e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 3050c41d-6baa-4fe4-b722-1610cbc83d86] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:00.388285 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cc0505af-1e6e-45b4-9492-cdf088cee60e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:00.388798 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cc0505af-1e6e-45b4-9492-cdf088cee60e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:00.389211 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cc0505af-1e6e-45b4-9492-cdf088cee60e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:00.390186 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cc0505af-1e6e-45b4-9492-cdf088cee60e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:00.390631 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cc0505af-1e6e-45b4-9492-cdf088cee60e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:00.391045 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cc0505af-1e6e-45b4-9492-cdf088cee60e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:00.531609 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-cc0505af-1e6e-45b4-9492-cdf088cee60e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:00.540343 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-cc0505af-1e6e-45b4-9492-cdf088cee60e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/3050c41d-6baa-4fe4-b722-1610cbc83d86" status: 200 len: 1217 microversion: 2.1 time: 0.164197 Aug 27 03:20:00.541574 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2857/5753] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:00 2022] GET /compute/v2.1/servers/3050c41d-6baa-4fe4-b722-1610cbc83d86 => generated 1217 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:01.348690 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-741ab88e-67c5-488f-8575-99fa2e06918b req-49d6e949-d4ee-4f47-9148-0d677735b07f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3050c41d-6baa-4fe4-b722-1610cbc83d86", "name": "network-vif-plugged", "status": "completed", "tag": "aa5d2005-9431-4d12-888f-960e552f9642"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:20:01.360438 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-741ab88e-67c5-488f-8575-99fa2e06918b req-49d6e949-d4ee-4f47-9148-0d677735b07f service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:01.360923 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-741ab88e-67c5-488f-8575-99fa2e06918b req-49d6e949-d4ee-4f47-9148-0d677735b07f service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:01.361350 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-741ab88e-67c5-488f-8575-99fa2e06918b req-49d6e949-d4ee-4f47-9148-0d677735b07f service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:01.388264 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-741ab88e-67c5-488f-8575-99fa2e06918b req-49d6e949-d4ee-4f47-9148-0d677735b07f service nova] Creating event network-vif-plugged:aa5d2005-9431-4d12-888f-960e552f9642 for instance 3050c41d-6baa-4fe4-b722-1610cbc83d86 on n-h2-852278-4 Aug 27 03:20:01.393660 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-741ab88e-67c5-488f-8575-99fa2e06918b req-49d6e949-d4ee-4f47-9148-0d677735b07f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049306 Aug 27 03:20:01.394351 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2897/5754] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:20:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:20:01.561847 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d6d82030-d024-461e-a354-7b43ab6e49bb tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:01.563355 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d6d82030-d024-461e-a354-7b43ab6e49bb tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 3050c41d-6baa-4fe4-b722-1610cbc83d86] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:01.574280 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d6d82030-d024-461e-a354-7b43ab6e49bb tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:01.574849 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d6d82030-d024-461e-a354-7b43ab6e49bb tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:01.575348 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d6d82030-d024-461e-a354-7b43ab6e49bb tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:01.576114 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d6d82030-d024-461e-a354-7b43ab6e49bb tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:01.576660 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d6d82030-d024-461e-a354-7b43ab6e49bb tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:01.577137 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d6d82030-d024-461e-a354-7b43ab6e49bb tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:01.724458 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-d6d82030-d024-461e-a354-7b43ab6e49bb tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:01.733055 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d6d82030-d024-461e-a354-7b43ab6e49bb tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/3050c41d-6baa-4fe4-b722-1610cbc83d86" status: 200 len: 1217 microversion: 2.1 time: 0.175888 Aug 27 03:20:01.733611 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2858/5755] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:01 2022] GET /compute/v2.1/servers/3050c41d-6baa-4fe4-b722-1610cbc83d86 => generated 1217 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:02.755467 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-1eea5f2d-7800-4a83-bb7d-5637676288a7 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:02.756129 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-1eea5f2d-7800-4a83-bb7d-5637676288a7 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 3050c41d-6baa-4fe4-b722-1610cbc83d86] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:02.763161 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1eea5f2d-7800-4a83-bb7d-5637676288a7 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:02.763666 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1eea5f2d-7800-4a83-bb7d-5637676288a7 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:02.764106 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1eea5f2d-7800-4a83-bb7d-5637676288a7 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:02.764872 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1eea5f2d-7800-4a83-bb7d-5637676288a7 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:02.765327 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1eea5f2d-7800-4a83-bb7d-5637676288a7 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:02.765751 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1eea5f2d-7800-4a83-bb7d-5637676288a7 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:02.977774 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-1eea5f2d-7800-4a83-bb7d-5637676288a7 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:02.986311 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-1eea5f2d-7800-4a83-bb7d-5637676288a7 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/3050c41d-6baa-4fe4-b722-1610cbc83d86" status: 200 len: 1405 microversion: 2.1 time: 0.236330 Aug 27 03:20:02.986907 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2898/5756] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:02 2022] GET /compute/v2.1/servers/3050c41d-6baa-4fe4-b722-1610cbc83d86 => generated 1405 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:03.011959 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-edbb0da7-ce55-486f-845b-dbae40f9a405 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:03.012660 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-edbb0da7-ce55-486f-845b-dbae40f9a405 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 3050c41d-6baa-4fe4-b722-1610cbc83d86] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:03.019596 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-edbb0da7-ce55-486f-845b-dbae40f9a405 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:03.020088 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-edbb0da7-ce55-486f-845b-dbae40f9a405 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:03.020541 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-edbb0da7-ce55-486f-845b-dbae40f9a405 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:03.021233 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-edbb0da7-ce55-486f-845b-dbae40f9a405 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:03.021706 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-edbb0da7-ce55-486f-845b-dbae40f9a405 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:03.022121 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-edbb0da7-ce55-486f-845b-dbae40f9a405 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:03.162444 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-edbb0da7-ce55-486f-845b-dbae40f9a405 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:03.170988 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-edbb0da7-ce55-486f-845b-dbae40f9a405 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/3050c41d-6baa-4fe4-b722-1610cbc83d86" status: 200 len: 1405 microversion: 2.1 time: 0.163299 Aug 27 03:20:03.171514 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2859/5757] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:03 2022] GET /compute/v2.1/servers/3050c41d-6baa-4fe4-b722-1610cbc83d86 => generated 1405 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:03.192017 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-59a9dddf-c680-4e0a-9add-470b1eb8945f tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-360509130"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:20:03.194621 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-59a9dddf-c680-4e0a-9add-470b1eb8945f tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 3050c41d-6baa-4fe4-b722-1610cbc83d86] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:03.201626 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-59a9dddf-c680-4e0a-9add-470b1eb8945f tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:03.202457 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-59a9dddf-c680-4e0a-9add-470b1eb8945f tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:03.202898 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-59a9dddf-c680-4e0a-9add-470b1eb8945f tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:03.203641 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-59a9dddf-c680-4e0a-9add-470b1eb8945f tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:03.204077 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-59a9dddf-c680-4e0a-9add-470b1eb8945f tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:03.204723 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-59a9dddf-c680-4e0a-9add-470b1eb8945f tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:03.310762 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.compute.api [None req-59a9dddf-c680-4e0a-9add-470b1eb8945f tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 3050c41d-6baa-4fe4-b722-1610cbc83d86] Attempting to quiesce instance before volume snapshot. Aug 27 03:20:03.366575 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.compute.api [None req-59a9dddf-c680-4e0a-9add-470b1eb8945f tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 3050c41d-6baa-4fe4-b722-1610cbc83d86] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Aug 27 03:20:03.450514 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-59a9dddf-c680-4e0a-9add-470b1eb8945f tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 3050c41d-6baa-4fe4-b722-1610cbc83d86] Creating snapshot from volume 5374946f-8b37-421a-8c6a-a5203051e54b. {{(pid=134051) snapshot_instance /opt/stack/nova/nova/compute/api.py:3509}} Aug 27 03:20:04.317081 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-59a9dddf-c680-4e0a-9add-470b1eb8945f tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "POST /compute/v2.1/servers/3050c41d-6baa-4fe4-b722-1610cbc83d86/action" status: 202 len: 0 microversion: 2.1 time: 1.129003 Aug 27 03:20:04.318247 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2899/5758] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:20:03 2022] POST /compute/v2.1/servers/3050c41d-6baa-4fe4-b722-1610cbc83d86/action => generated 0 bytes in 1131 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 27 03:20:05.541835 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e066366f-6613-42e6-a336-6d7f43156d7a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-576472600", "imageRef": "d03de0af-c651-4fd0-af7f-1ff9d375b3c6", "flavorRef": "452", "networks": [{"uuid": "02524c0f-c44c-4ea0-899e-226a790199dc"}]}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:20:05.605976 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.network.neutron [None req-e066366f-6613-42e6-a336-6d7f43156d7a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] validate_networks() for [('02524c0f-c44c-4ea0-899e-226a790199dc', None, None, None, None, None)] {{(pid=134052) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:20:06.001558 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-e066366f-6613-42e6-a336-6d7f43156d7a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Flavor limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:20:06.001984 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-e066366f-6613-42e6-a336-6d7f43156d7a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Image limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:20:06.002456 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-e066366f-6613-42e6-a336-6d7f43156d7a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Flavor pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:20:06.002864 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-e066366f-6613-42e6-a336-6d7f43156d7a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Image pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:20:06.003330 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-e066366f-6613-42e6-a336-6d7f43156d7a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:20:06.012875 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e066366f-6613-42e6-a336-6d7f43156d7a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:06.013431 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e066366f-6613-42e6-a336-6d7f43156d7a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:06.013929 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e066366f-6613-42e6-a336-6d7f43156d7a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:06.014654 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e066366f-6613-42e6-a336-6d7f43156d7a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:06.015097 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e066366f-6613-42e6-a336-6d7f43156d7a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:06.015511 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e066366f-6613-42e6-a336-6d7f43156d7a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:06.033172 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-e066366f-6613-42e6-a336-6d7f43156d7a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Getting quotas for project 7b2673a034c24d1898493bfea9ca5d1d. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:20:06.045508 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-e066366f-6613-42e6-a336-6d7f43156d7a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Getting quotas for user 4aa867d7baa043b1b1e6763046463b3f and project 7b2673a034c24d1898493bfea9ca5d1d. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:20:06.060175 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-e066366f-6613-42e6-a336-6d7f43156d7a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Going to run 1 instances... {{(pid=134052) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:20:06.062797 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-e066366f-6613-42e6-a336-6d7f43156d7a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 9e6fe47c-ae2f-4f14-8677-368fec05ce55] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='9cc68e29-a977-4017-94eb-e0456b45a8e6',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=134052) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:20:06.156455 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e066366f-6613-42e6-a336-6d7f43156d7a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.619071 Aug 27 03:20:06.157296 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2860/5759] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 03:20:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 621 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:20:06.169405 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7c285321-1986-4a56-adc1-2b30c272f114 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:06.170298 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-7c285321-1986-4a56-adc1-2b30c272f114 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 9e6fe47c-ae2f-4f14-8677-368fec05ce55] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:06.245114 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-7c285321-1986-4a56-adc1-2b30c272f114 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:06.252750 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-7c285321-1986-4a56-adc1-2b30c272f114 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/9e6fe47c-ae2f-4f14-8677-368fec05ce55" status: 200 len: 1229 microversion: 2.1 time: 0.088467 Aug 27 03:20:06.253480 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2900/5760] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:06 2022] GET /compute/v2.1/servers/9e6fe47c-ae2f-4f14-8677-368fec05ce55 => generated 1229 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:07.275012 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9699fad4-3413-4b0d-9a0a-75312ac45f26 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:07.276529 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-9699fad4-3413-4b0d-9a0a-75312ac45f26 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 9e6fe47c-ae2f-4f14-8677-368fec05ce55] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:07.283809 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9699fad4-3413-4b0d-9a0a-75312ac45f26 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:07.284303 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9699fad4-3413-4b0d-9a0a-75312ac45f26 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:07.284880 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9699fad4-3413-4b0d-9a0a-75312ac45f26 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:07.285496 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9699fad4-3413-4b0d-9a0a-75312ac45f26 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:07.286001 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9699fad4-3413-4b0d-9a0a-75312ac45f26 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:07.286427 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9699fad4-3413-4b0d-9a0a-75312ac45f26 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:07.352268 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-9699fad4-3413-4b0d-9a0a-75312ac45f26 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:07.360858 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9699fad4-3413-4b0d-9a0a-75312ac45f26 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/9e6fe47c-ae2f-4f14-8677-368fec05ce55" status: 200 len: 1289 microversion: 2.1 time: 0.091017 Aug 27 03:20:07.361449 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2861/5761] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:07 2022] GET /compute/v2.1/servers/9e6fe47c-ae2f-4f14-8677-368fec05ce55 => generated 1289 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:08.385240 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-9c5c456c-2cd9-477a-b709-f08065d65200 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:08.386452 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-9c5c456c-2cd9-477a-b709-f08065d65200 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 9e6fe47c-ae2f-4f14-8677-368fec05ce55] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:08.395507 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9c5c456c-2cd9-477a-b709-f08065d65200 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:08.396259 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9c5c456c-2cd9-477a-b709-f08065d65200 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:08.396880 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9c5c456c-2cd9-477a-b709-f08065d65200 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:08.397750 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9c5c456c-2cd9-477a-b709-f08065d65200 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:08.399281 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9c5c456c-2cd9-477a-b709-f08065d65200 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:08.399905 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9c5c456c-2cd9-477a-b709-f08065d65200 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:08.563602 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-9c5c456c-2cd9-477a-b709-f08065d65200 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:08.572364 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-9c5c456c-2cd9-477a-b709-f08065d65200 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/9e6fe47c-ae2f-4f14-8677-368fec05ce55" status: 200 len: 1341 microversion: 2.1 time: 0.192520 Aug 27 03:20:08.573461 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2901/5762] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:08 2022] GET /compute/v2.1/servers/9e6fe47c-ae2f-4f14-8677-368fec05ce55 => generated 1341 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:08.879083 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-8607eca8-21a2-4c25-82af-14312efdd5ae req-0f9dda3c-2806-4f5d-881f-fabeadc9583e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e6fe47c-ae2f-4f14-8677-368fec05ce55", "tag": "3efbf457-0a5c-4b1f-a535-1f0c816048c6"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:20:08.895869 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-8607eca8-21a2-4c25-82af-14312efdd5ae req-0f9dda3c-2806-4f5d-881f-fabeadc9583e service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:08.896716 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-8607eca8-21a2-4c25-82af-14312efdd5ae req-0f9dda3c-2806-4f5d-881f-fabeadc9583e service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:08.897328 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-8607eca8-21a2-4c25-82af-14312efdd5ae req-0f9dda3c-2806-4f5d-881f-fabeadc9583e service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:08.911252 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-8607eca8-21a2-4c25-82af-14312efdd5ae req-0f9dda3c-2806-4f5d-881f-fabeadc9583e service nova] Creating event network-changed:3efbf457-0a5c-4b1f-a535-1f0c816048c6 for instance 9e6fe47c-ae2f-4f14-8677-368fec05ce55 on n-h1-852278-4 Aug 27 03:20:08.916864 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-8607eca8-21a2-4c25-82af-14312efdd5ae req-0f9dda3c-2806-4f5d-881f-fabeadc9583e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041372 Aug 27 03:20:08.925746 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2862/5763] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:20:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:20:09.593849 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b94be948-93f6-45be-8916-6e9a7bba4eda tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:09.595327 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b94be948-93f6-45be-8916-6e9a7bba4eda tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 9e6fe47c-ae2f-4f14-8677-368fec05ce55] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:09.603026 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b94be948-93f6-45be-8916-6e9a7bba4eda tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:09.603866 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b94be948-93f6-45be-8916-6e9a7bba4eda tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:09.604568 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b94be948-93f6-45be-8916-6e9a7bba4eda tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:09.605530 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b94be948-93f6-45be-8916-6e9a7bba4eda tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:09.606212 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b94be948-93f6-45be-8916-6e9a7bba4eda tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:09.606891 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b94be948-93f6-45be-8916-6e9a7bba4eda tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:09.768219 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-b94be948-93f6-45be-8916-6e9a7bba4eda tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:09.779008 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b94be948-93f6-45be-8916-6e9a7bba4eda tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/9e6fe47c-ae2f-4f14-8677-368fec05ce55" status: 200 len: 1341 microversion: 2.1 time: 0.187863 Aug 27 03:20:09.780723 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2902/5764] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:09 2022] GET /compute/v2.1/servers/9e6fe47c-ae2f-4f14-8677-368fec05ce55 => generated 1341 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:10.802020 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0d1cc370-443b-41e0-bbe3-514b1b732aaf tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:10.803028 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-0d1cc370-443b-41e0-bbe3-514b1b732aaf tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 9e6fe47c-ae2f-4f14-8677-368fec05ce55] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:10.809978 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0d1cc370-443b-41e0-bbe3-514b1b732aaf tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:10.810578 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0d1cc370-443b-41e0-bbe3-514b1b732aaf tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:10.811095 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0d1cc370-443b-41e0-bbe3-514b1b732aaf tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:10.811885 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0d1cc370-443b-41e0-bbe3-514b1b732aaf tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:10.813035 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0d1cc370-443b-41e0-bbe3-514b1b732aaf tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:10.813759 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0d1cc370-443b-41e0-bbe3-514b1b732aaf tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:10.962097 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0d1cc370-443b-41e0-bbe3-514b1b732aaf tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:10.970454 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-0d1cc370-443b-41e0-bbe3-514b1b732aaf tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/9e6fe47c-ae2f-4f14-8677-368fec05ce55" status: 200 len: 1341 microversion: 2.1 time: 0.173697 Aug 27 03:20:10.971446 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2863/5765] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:10 2022] GET /compute/v2.1/servers/9e6fe47c-ae2f-4f14-8677-368fec05ce55 => generated 1341 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:11.992918 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-10f0f0c7-3a82-49f2-ba1e-16a8497e3a53 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:11.994697 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-10f0f0c7-3a82-49f2-ba1e-16a8497e3a53 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 9e6fe47c-ae2f-4f14-8677-368fec05ce55] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:11.998978 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:20:12.009143 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-10f0f0c7-3a82-49f2-ba1e-16a8497e3a53 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:12.010117 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-10f0f0c7-3a82-49f2-ba1e-16a8497e3a53 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:12.010818 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-10f0f0c7-3a82-49f2-ba1e-16a8497e3a53 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:12.012618 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-10f0f0c7-3a82-49f2-ba1e-16a8497e3a53 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:12.013362 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-10f0f0c7-3a82-49f2-ba1e-16a8497e3a53 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:12.013868 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-10f0f0c7-3a82-49f2-ba1e-16a8497e3a53 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:12.019375 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=82,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:20:12.201460 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-10f0f0c7-3a82-49f2-ba1e-16a8497e3a53 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:12.210100 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-10f0f0c7-3a82-49f2-ba1e-16a8497e3a53 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/9e6fe47c-ae2f-4f14-8677-368fec05ce55" status: 200 len: 1341 microversion: 2.1 time: 0.222073 Aug 27 03:20:12.210685 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2903/5766] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:11 2022] GET /compute/v2.1/servers/9e6fe47c-ae2f-4f14-8677-368fec05ce55 => generated 1341 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:13.237385 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-90b60422-73dd-4a3d-9f34-cee7b2b15564 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:13.238038 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-90b60422-73dd-4a3d-9f34-cee7b2b15564 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 9e6fe47c-ae2f-4f14-8677-368fec05ce55] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:13.240242 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:20:13.246826 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-90b60422-73dd-4a3d-9f34-cee7b2b15564 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:13.248969 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-90b60422-73dd-4a3d-9f34-cee7b2b15564 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:13.249749 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-90b60422-73dd-4a3d-9f34-cee7b2b15564 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:13.250705 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-90b60422-73dd-4a3d-9f34-cee7b2b15564 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:13.251665 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-90b60422-73dd-4a3d-9f34-cee7b2b15564 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:13.252573 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-90b60422-73dd-4a3d-9f34-cee7b2b15564 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:13.257918 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=77 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:20:13.424762 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-90b60422-73dd-4a3d-9f34-cee7b2b15564 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:13.435664 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-90b60422-73dd-4a3d-9f34-cee7b2b15564 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/9e6fe47c-ae2f-4f14-8677-368fec05ce55" status: 200 len: 1341 microversion: 2.1 time: 0.206828 Aug 27 03:20:13.436591 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2864/5767] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:13 2022] GET /compute/v2.1/servers/9e6fe47c-ae2f-4f14-8677-368fec05ce55 => generated 1341 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:14.467442 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ca8a17f4-29b7-4f26-9d30-0796a029989e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:14.470762 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-ca8a17f4-29b7-4f26-9d30-0796a029989e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 9e6fe47c-ae2f-4f14-8677-368fec05ce55] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:14.489083 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ca8a17f4-29b7-4f26-9d30-0796a029989e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:14.489762 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ca8a17f4-29b7-4f26-9d30-0796a029989e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:14.490880 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ca8a17f4-29b7-4f26-9d30-0796a029989e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:14.492705 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ca8a17f4-29b7-4f26-9d30-0796a029989e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:14.493658 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ca8a17f4-29b7-4f26-9d30-0796a029989e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:14.494655 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ca8a17f4-29b7-4f26-9d30-0796a029989e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:14.694491 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-ca8a17f4-29b7-4f26-9d30-0796a029989e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:14.703621 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ca8a17f4-29b7-4f26-9d30-0796a029989e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/9e6fe47c-ae2f-4f14-8677-368fec05ce55" status: 200 len: 1341 microversion: 2.1 time: 0.246607 Aug 27 03:20:14.715067 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2904/5768] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:14 2022] GET /compute/v2.1/servers/9e6fe47c-ae2f-4f14-8677-368fec05ce55 => generated 1341 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:15.725608 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-47a52f20-5e87-4cc3-8a6d-6c3f5c7073e3 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:15.726819 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-47a52f20-5e87-4cc3-8a6d-6c3f5c7073e3 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 9e6fe47c-ae2f-4f14-8677-368fec05ce55] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:15.765369 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-47a52f20-5e87-4cc3-8a6d-6c3f5c7073e3 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:15.768398 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-47a52f20-5e87-4cc3-8a6d-6c3f5c7073e3 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:15.768398 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-47a52f20-5e87-4cc3-8a6d-6c3f5c7073e3 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:15.768398 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-47a52f20-5e87-4cc3-8a6d-6c3f5c7073e3 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:15.769597 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-47a52f20-5e87-4cc3-8a6d-6c3f5c7073e3 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:15.770606 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-47a52f20-5e87-4cc3-8a6d-6c3f5c7073e3 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:15.947548 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-47a52f20-5e87-4cc3-8a6d-6c3f5c7073e3 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:15.958182 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-47a52f20-5e87-4cc3-8a6d-6c3f5c7073e3 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/9e6fe47c-ae2f-4f14-8677-368fec05ce55" status: 200 len: 1341 microversion: 2.1 time: 0.236340 Aug 27 03:20:15.958588 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2865/5769] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:15 2022] GET /compute/v2.1/servers/9e6fe47c-ae2f-4f14-8677-368fec05ce55 => generated 1341 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:16.980141 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-48d03ff2-12f7-43f0-81f5-81825f1002b9 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:16.981330 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-48d03ff2-12f7-43f0-81f5-81825f1002b9 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 9e6fe47c-ae2f-4f14-8677-368fec05ce55] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:16.984036 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:20:16.989524 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-48d03ff2-12f7-43f0-81f5-81825f1002b9 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:16.990181 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-48d03ff2-12f7-43f0-81f5-81825f1002b9 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:16.990639 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-48d03ff2-12f7-43f0-81f5-81825f1002b9 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:16.991365 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-48d03ff2-12f7-43f0-81f5-81825f1002b9 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:16.991834 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-48d03ff2-12f7-43f0-81f5-81825f1002b9 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:16.992275 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-48d03ff2-12f7-43f0-81f5-81825f1002b9 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:17.127056 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-48d03ff2-12f7-43f0-81f5-81825f1002b9 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:17.135708 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-48d03ff2-12f7-43f0-81f5-81825f1002b9 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/9e6fe47c-ae2f-4f14-8677-368fec05ce55" status: 200 len: 1341 microversion: 2.1 time: 0.160350 Aug 27 03:20:17.144116 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2905/5770] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:16 2022] GET /compute/v2.1/servers/9e6fe47c-ae2f-4f14-8677-368fec05ce55 => generated 1341 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:18.157082 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4dfabff9-afb0-4a65-9148-736e88156cf3 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:18.157657 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-4dfabff9-afb0-4a65-9148-736e88156cf3 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 9e6fe47c-ae2f-4f14-8677-368fec05ce55] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:18.160112 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:20:18.161730 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=6 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:20:18.169168 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4dfabff9-afb0-4a65-9148-736e88156cf3 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:18.169728 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4dfabff9-afb0-4a65-9148-736e88156cf3 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:18.170166 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4dfabff9-afb0-4a65-9148-736e88156cf3 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:18.170906 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4dfabff9-afb0-4a65-9148-736e88156cf3 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:18.171471 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4dfabff9-afb0-4a65-9148-736e88156cf3 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:18.171907 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4dfabff9-afb0-4a65-9148-736e88156cf3 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:18.319808 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-4dfabff9-afb0-4a65-9148-736e88156cf3 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:18.328230 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-4dfabff9-afb0-4a65-9148-736e88156cf3 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/9e6fe47c-ae2f-4f14-8677-368fec05ce55" status: 200 len: 1341 microversion: 2.1 time: 0.175105 Aug 27 03:20:18.340041 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2866/5771] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:18 2022] GET /compute/v2.1/servers/9e6fe47c-ae2f-4f14-8677-368fec05ce55 => generated 1341 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:19.349413 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-905aed5f-42e8-4b2f-aeee-9d9d317f9262 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:19.351473 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-905aed5f-42e8-4b2f-aeee-9d9d317f9262 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 9e6fe47c-ae2f-4f14-8677-368fec05ce55] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:19.358923 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-905aed5f-42e8-4b2f-aeee-9d9d317f9262 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:19.359666 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-905aed5f-42e8-4b2f-aeee-9d9d317f9262 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:19.360124 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-905aed5f-42e8-4b2f-aeee-9d9d317f9262 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:19.360875 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-905aed5f-42e8-4b2f-aeee-9d9d317f9262 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:19.361347 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-905aed5f-42e8-4b2f-aeee-9d9d317f9262 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:19.361791 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-905aed5f-42e8-4b2f-aeee-9d9d317f9262 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:19.513438 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-905aed5f-42e8-4b2f-aeee-9d9d317f9262 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:19.523205 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-905aed5f-42e8-4b2f-aeee-9d9d317f9262 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/9e6fe47c-ae2f-4f14-8677-368fec05ce55" status: 200 len: 1341 microversion: 2.1 time: 0.177900 Aug 27 03:20:19.527802 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2906/5772] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:19 2022] GET /compute/v2.1/servers/9e6fe47c-ae2f-4f14-8677-368fec05ce55 => generated 1341 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:20.546127 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-966eef73-16cf-4bcf-8758-6c99a4233b73 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:20.546748 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-966eef73-16cf-4bcf-8758-6c99a4233b73 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 9e6fe47c-ae2f-4f14-8677-368fec05ce55] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:20.554500 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-966eef73-16cf-4bcf-8758-6c99a4233b73 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:20.555409 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-966eef73-16cf-4bcf-8758-6c99a4233b73 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:20.555993 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-966eef73-16cf-4bcf-8758-6c99a4233b73 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:20.556905 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-966eef73-16cf-4bcf-8758-6c99a4233b73 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:20.557522 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-966eef73-16cf-4bcf-8758-6c99a4233b73 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:20.557964 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-966eef73-16cf-4bcf-8758-6c99a4233b73 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:20.727977 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-966eef73-16cf-4bcf-8758-6c99a4233b73 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:20.739673 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-966eef73-16cf-4bcf-8758-6c99a4233b73 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/9e6fe47c-ae2f-4f14-8677-368fec05ce55" status: 200 len: 1341 microversion: 2.1 time: 0.196367 Aug 27 03:20:20.741572 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2867/5773] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:20 2022] GET /compute/v2.1/servers/9e6fe47c-ae2f-4f14-8677-368fec05ce55 => generated 1341 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:21.768640 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8322528c-126a-47cc-a80e-ed4a6a44f88d tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:21.769580 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-8322528c-126a-47cc-a80e-ed4a6a44f88d tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 9e6fe47c-ae2f-4f14-8677-368fec05ce55] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:21.780660 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8322528c-126a-47cc-a80e-ed4a6a44f88d tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:21.781437 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8322528c-126a-47cc-a80e-ed4a6a44f88d tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:21.782131 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8322528c-126a-47cc-a80e-ed4a6a44f88d tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:21.783285 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8322528c-126a-47cc-a80e-ed4a6a44f88d tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:21.784022 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8322528c-126a-47cc-a80e-ed4a6a44f88d tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:21.784760 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8322528c-126a-47cc-a80e-ed4a6a44f88d tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:21.924930 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-8322528c-126a-47cc-a80e-ed4a6a44f88d tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:21.933581 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-8322528c-126a-47cc-a80e-ed4a6a44f88d tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/9e6fe47c-ae2f-4f14-8677-368fec05ce55" status: 200 len: 1341 microversion: 2.1 time: 0.171511 Aug 27 03:20:21.934243 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2907/5774] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:21 2022] GET /compute/v2.1/servers/9e6fe47c-ae2f-4f14-8677-368fec05ce55 => generated 1341 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:22.954753 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-7b140486-0c5a-4c64-a941-0afa8f255e26 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:22.955408 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-7b140486-0c5a-4c64-a941-0afa8f255e26 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 9e6fe47c-ae2f-4f14-8677-368fec05ce55] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:22.962838 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7b140486-0c5a-4c64-a941-0afa8f255e26 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:22.963328 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7b140486-0c5a-4c64-a941-0afa8f255e26 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:22.963765 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7b140486-0c5a-4c64-a941-0afa8f255e26 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:22.964518 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7b140486-0c5a-4c64-a941-0afa8f255e26 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:22.965018 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7b140486-0c5a-4c64-a941-0afa8f255e26 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:22.965442 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7b140486-0c5a-4c64-a941-0afa8f255e26 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:23.111271 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-7b140486-0c5a-4c64-a941-0afa8f255e26 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:23.121441 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-7b140486-0c5a-4c64-a941-0afa8f255e26 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/9e6fe47c-ae2f-4f14-8677-368fec05ce55" status: 200 len: 1375 microversion: 2.1 time: 0.170524 Aug 27 03:20:23.122076 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2868/5775] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:22 2022] GET /compute/v2.1/servers/9e6fe47c-ae2f-4f14-8677-368fec05ce55 => generated 1375 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:24.144253 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7f3a0467-4f2d-477e-affa-1fb1a2a88fe8 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:24.145447 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-7f3a0467-4f2d-477e-affa-1fb1a2a88fe8 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 9e6fe47c-ae2f-4f14-8677-368fec05ce55] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:24.153900 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7f3a0467-4f2d-477e-affa-1fb1a2a88fe8 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:24.154684 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7f3a0467-4f2d-477e-affa-1fb1a2a88fe8 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:24.155146 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7f3a0467-4f2d-477e-affa-1fb1a2a88fe8 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:24.156069 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7f3a0467-4f2d-477e-affa-1fb1a2a88fe8 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:24.156513 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7f3a0467-4f2d-477e-affa-1fb1a2a88fe8 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:24.156994 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7f3a0467-4f2d-477e-affa-1fb1a2a88fe8 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:24.304065 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-7f3a0467-4f2d-477e-affa-1fb1a2a88fe8 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:24.312366 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-7f3a0467-4f2d-477e-affa-1fb1a2a88fe8 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/9e6fe47c-ae2f-4f14-8677-368fec05ce55" status: 200 len: 1375 microversion: 2.1 time: 0.172991 Aug 27 03:20:24.312959 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2908/5776] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:24 2022] GET /compute/v2.1/servers/9e6fe47c-ae2f-4f14-8677-368fec05ce55 => generated 1375 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:25.338273 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c08f45f6-2a4d-41e5-a734-8dfd974c5d58 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:25.338943 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-c08f45f6-2a4d-41e5-a734-8dfd974c5d58 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 9e6fe47c-ae2f-4f14-8677-368fec05ce55] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:25.347219 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c08f45f6-2a4d-41e5-a734-8dfd974c5d58 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:25.347856 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c08f45f6-2a4d-41e5-a734-8dfd974c5d58 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:25.348235 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c08f45f6-2a4d-41e5-a734-8dfd974c5d58 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:25.348983 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c08f45f6-2a4d-41e5-a734-8dfd974c5d58 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:25.349436 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c08f45f6-2a4d-41e5-a734-8dfd974c5d58 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:25.349849 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c08f45f6-2a4d-41e5-a734-8dfd974c5d58 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:25.491046 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-c08f45f6-2a4d-41e5-a734-8dfd974c5d58 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:25.501314 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c08f45f6-2a4d-41e5-a734-8dfd974c5d58 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/9e6fe47c-ae2f-4f14-8677-368fec05ce55" status: 200 len: 1375 microversion: 2.1 time: 0.167447 Aug 27 03:20:25.502082 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2869/5777] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:25 2022] GET /compute/v2.1/servers/9e6fe47c-ae2f-4f14-8677-368fec05ce55 => generated 1375 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:26.524450 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-be97be01-1968-4d62-8029-8515422165f5 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:26.525242 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-be97be01-1968-4d62-8029-8515422165f5 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 9e6fe47c-ae2f-4f14-8677-368fec05ce55] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:26.532956 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-be97be01-1968-4d62-8029-8515422165f5 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:26.533487 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-be97be01-1968-4d62-8029-8515422165f5 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:26.534112 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-be97be01-1968-4d62-8029-8515422165f5 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:26.534810 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-be97be01-1968-4d62-8029-8515422165f5 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:26.535284 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-be97be01-1968-4d62-8029-8515422165f5 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:26.535725 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-be97be01-1968-4d62-8029-8515422165f5 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:26.675853 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-be97be01-1968-4d62-8029-8515422165f5 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:26.684181 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-be97be01-1968-4d62-8029-8515422165f5 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/9e6fe47c-ae2f-4f14-8677-368fec05ce55" status: 200 len: 1375 microversion: 2.1 time: 0.164333 Aug 27 03:20:26.684792 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2909/5778] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:26 2022] GET /compute/v2.1/servers/9e6fe47c-ae2f-4f14-8677-368fec05ce55 => generated 1375 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:27.706924 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6cd832d2-ed37-4e11-a0d4-b76a43ff2272 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:27.707550 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-6cd832d2-ed37-4e11-a0d4-b76a43ff2272 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 9e6fe47c-ae2f-4f14-8677-368fec05ce55] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:27.718015 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6cd832d2-ed37-4e11-a0d4-b76a43ff2272 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:27.718857 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6cd832d2-ed37-4e11-a0d4-b76a43ff2272 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:27.719256 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6cd832d2-ed37-4e11-a0d4-b76a43ff2272 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:27.720084 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6cd832d2-ed37-4e11-a0d4-b76a43ff2272 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:27.720617 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6cd832d2-ed37-4e11-a0d4-b76a43ff2272 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:27.721081 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6cd832d2-ed37-4e11-a0d4-b76a43ff2272 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:27.889199 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-6cd832d2-ed37-4e11-a0d4-b76a43ff2272 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:27.898418 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-6cd832d2-ed37-4e11-a0d4-b76a43ff2272 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/9e6fe47c-ae2f-4f14-8677-368fec05ce55" status: 200 len: 1375 microversion: 2.1 time: 0.196087 Aug 27 03:20:27.899122 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2870/5779] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:27 2022] GET /compute/v2.1/servers/9e6fe47c-ae2f-4f14-8677-368fec05ce55 => generated 1375 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:28.920809 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-9247095a-7aa2-4f03-b24f-a2568b2ebfbb tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:28.921586 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-9247095a-7aa2-4f03-b24f-a2568b2ebfbb tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 9e6fe47c-ae2f-4f14-8677-368fec05ce55] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:28.929601 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9247095a-7aa2-4f03-b24f-a2568b2ebfbb tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:28.930065 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9247095a-7aa2-4f03-b24f-a2568b2ebfbb tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:28.930596 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9247095a-7aa2-4f03-b24f-a2568b2ebfbb tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:28.931336 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9247095a-7aa2-4f03-b24f-a2568b2ebfbb tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:28.931883 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9247095a-7aa2-4f03-b24f-a2568b2ebfbb tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:28.932375 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9247095a-7aa2-4f03-b24f-a2568b2ebfbb tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:29.075172 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-9247095a-7aa2-4f03-b24f-a2568b2ebfbb tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:29.084013 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-9247095a-7aa2-4f03-b24f-a2568b2ebfbb tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/9e6fe47c-ae2f-4f14-8677-368fec05ce55" status: 200 len: 1375 microversion: 2.1 time: 0.167341 Aug 27 03:20:29.086843 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2910/5780] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:28 2022] GET /compute/v2.1/servers/9e6fe47c-ae2f-4f14-8677-368fec05ce55 => generated 1375 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:30.105760 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9df2dbdf-f694-47d7-a745-ff64c847bcfd tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:30.106448 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-9df2dbdf-f694-47d7-a745-ff64c847bcfd tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 9e6fe47c-ae2f-4f14-8677-368fec05ce55] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:30.108405 n-d-852278-4 devstack@n-api.service[134052]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:20:30.108569 n-d-852278-4 devstack@n-api.service[134052]: Sat Aug 27 03:20:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9e6fe47c-ae2f-4f14-8677-368fec05ce55 (ip 10.222.0.70) !!! Aug 27 03:20:30.116074 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9df2dbdf-f694-47d7-a745-ff64c847bcfd tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:30.116585 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9df2dbdf-f694-47d7-a745-ff64c847bcfd tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:30.117024 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9df2dbdf-f694-47d7-a745-ff64c847bcfd tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:30.117720 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9df2dbdf-f694-47d7-a745-ff64c847bcfd tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:30.118171 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9df2dbdf-f694-47d7-a745-ff64c847bcfd tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:30.118591 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9df2dbdf-f694-47d7-a745-ff64c847bcfd tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:30.266209 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-9df2dbdf-f694-47d7-a745-ff64c847bcfd tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:30.274702 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9df2dbdf-f694-47d7-a745-ff64c847bcfd tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/9e6fe47c-ae2f-4f14-8677-368fec05ce55" status: 200 len: 1375 microversion: 2.1 time: 0.172921 Aug 27 03:20:30.275302 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2871/5781] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:30 2022] GET /compute/v2.1/servers/9e6fe47c-ae2f-4f14-8677-368fec05ce55 => generated 1375 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:20:31.296731 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e1bb12d9-7aa3-488d-8ce4-57d0e594a386 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:31.297457 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-e1bb12d9-7aa3-488d-8ce4-57d0e594a386 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 9e6fe47c-ae2f-4f14-8677-368fec05ce55] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:31.305674 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e1bb12d9-7aa3-488d-8ce4-57d0e594a386 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:31.306224 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e1bb12d9-7aa3-488d-8ce4-57d0e594a386 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:31.306778 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e1bb12d9-7aa3-488d-8ce4-57d0e594a386 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:31.307612 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e1bb12d9-7aa3-488d-8ce4-57d0e594a386 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:31.308140 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e1bb12d9-7aa3-488d-8ce4-57d0e594a386 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:31.308705 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e1bb12d9-7aa3-488d-8ce4-57d0e594a386 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:31.455347 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e1bb12d9-7aa3-488d-8ce4-57d0e594a386 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:31.463914 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e1bb12d9-7aa3-488d-8ce4-57d0e594a386 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/9e6fe47c-ae2f-4f14-8677-368fec05ce55" status: 200 len: 1375 microversion: 2.1 time: 0.171851 Aug 27 03:20:31.464543 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2911/5782] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:31 2022] GET /compute/v2.1/servers/9e6fe47c-ae2f-4f14-8677-368fec05ce55 => generated 1375 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:20:32.485822 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-fa00b4cc-0210-4648-9e99-124dd2745cee tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:32.486515 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-fa00b4cc-0210-4648-9e99-124dd2745cee tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 9e6fe47c-ae2f-4f14-8677-368fec05ce55] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:32.494654 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fa00b4cc-0210-4648-9e99-124dd2745cee tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:32.495292 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fa00b4cc-0210-4648-9e99-124dd2745cee tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:32.495734 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fa00b4cc-0210-4648-9e99-124dd2745cee tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:32.496492 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fa00b4cc-0210-4648-9e99-124dd2745cee tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:32.496962 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fa00b4cc-0210-4648-9e99-124dd2745cee tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:32.497431 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fa00b4cc-0210-4648-9e99-124dd2745cee tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:32.648001 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-fa00b4cc-0210-4648-9e99-124dd2745cee tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:32.657795 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-fa00b4cc-0210-4648-9e99-124dd2745cee tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/9e6fe47c-ae2f-4f14-8677-368fec05ce55" status: 200 len: 1375 microversion: 2.1 time: 0.176249 Aug 27 03:20:32.658657 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2872/5783] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:32 2022] GET /compute/v2.1/servers/9e6fe47c-ae2f-4f14-8677-368fec05ce55 => generated 1375 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:33.203000 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-8c49027c-2839-4c80-befd-0d8da7e6ae03 req-4666f2f9-d629-47cd-b4ef-c596ad49614a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e6fe47c-ae2f-4f14-8677-368fec05ce55", "name": "network-vif-plugged", "status": "completed", "tag": "3efbf457-0a5c-4b1f-a535-1f0c816048c6"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:20:33.218079 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-8c49027c-2839-4c80-befd-0d8da7e6ae03 req-4666f2f9-d629-47cd-b4ef-c596ad49614a service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:33.218622 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-8c49027c-2839-4c80-befd-0d8da7e6ae03 req-4666f2f9-d629-47cd-b4ef-c596ad49614a service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:33.219179 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-8c49027c-2839-4c80-befd-0d8da7e6ae03 req-4666f2f9-d629-47cd-b4ef-c596ad49614a service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:33.232682 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-8c49027c-2839-4c80-befd-0d8da7e6ae03 req-4666f2f9-d629-47cd-b4ef-c596ad49614a service nova] Creating event network-vif-plugged:3efbf457-0a5c-4b1f-a535-1f0c816048c6 for instance 9e6fe47c-ae2f-4f14-8677-368fec05ce55 on n-h1-852278-4 Aug 27 03:20:33.239354 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-8c49027c-2839-4c80-befd-0d8da7e6ae03 req-4666f2f9-d629-47cd-b4ef-c596ad49614a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042479 Aug 27 03:20:33.240338 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2912/5784] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:20:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:20:33.680142 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-58b16f88-b25e-455a-9d5e-8b2463bd9949 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:33.680852 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-58b16f88-b25e-455a-9d5e-8b2463bd9949 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 9e6fe47c-ae2f-4f14-8677-368fec05ce55] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:33.688081 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-58b16f88-b25e-455a-9d5e-8b2463bd9949 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:33.688976 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-58b16f88-b25e-455a-9d5e-8b2463bd9949 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:33.689497 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-58b16f88-b25e-455a-9d5e-8b2463bd9949 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:33.690301 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-58b16f88-b25e-455a-9d5e-8b2463bd9949 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:33.690711 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-58b16f88-b25e-455a-9d5e-8b2463bd9949 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:33.691101 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-58b16f88-b25e-455a-9d5e-8b2463bd9949 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:33.856708 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-58b16f88-b25e-455a-9d5e-8b2463bd9949 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:33.874288 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-58b16f88-b25e-455a-9d5e-8b2463bd9949 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/9e6fe47c-ae2f-4f14-8677-368fec05ce55" status: 200 len: 1375 microversion: 2.1 time: 0.198159 Aug 27 03:20:33.874889 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2873/5785] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:33 2022] GET /compute/v2.1/servers/9e6fe47c-ae2f-4f14-8677-368fec05ce55 => generated 1375 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:20:34.897365 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-25d29e28-c768-4b02-b772-6a02e056da48 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:34.898343 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-25d29e28-c768-4b02-b772-6a02e056da48 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 9e6fe47c-ae2f-4f14-8677-368fec05ce55] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:34.907058 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-25d29e28-c768-4b02-b772-6a02e056da48 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:34.908678 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-25d29e28-c768-4b02-b772-6a02e056da48 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:34.908678 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-25d29e28-c768-4b02-b772-6a02e056da48 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:34.909050 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-25d29e28-c768-4b02-b772-6a02e056da48 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:34.909579 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-25d29e28-c768-4b02-b772-6a02e056da48 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:34.910058 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-25d29e28-c768-4b02-b772-6a02e056da48 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:35.089523 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-25d29e28-c768-4b02-b772-6a02e056da48 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:35.098489 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-25d29e28-c768-4b02-b772-6a02e056da48 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/9e6fe47c-ae2f-4f14-8677-368fec05ce55" status: 200 len: 1563 microversion: 2.1 time: 0.206621 Aug 27 03:20:35.099600 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2913/5786] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:34 2022] GET /compute/v2.1/servers/9e6fe47c-ae2f-4f14-8677-368fec05ce55 => generated 1563 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:35.122676 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-984c5ff2-26e0-45da-a08a-976b1de96603 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:35.123335 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-984c5ff2-26e0-45da-a08a-976b1de96603 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 9e6fe47c-ae2f-4f14-8677-368fec05ce55] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:35.131443 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-984c5ff2-26e0-45da-a08a-976b1de96603 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:35.132019 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-984c5ff2-26e0-45da-a08a-976b1de96603 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:35.132592 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-984c5ff2-26e0-45da-a08a-976b1de96603 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:35.133395 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-984c5ff2-26e0-45da-a08a-976b1de96603 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:35.133872 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-984c5ff2-26e0-45da-a08a-976b1de96603 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:35.134381 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-984c5ff2-26e0-45da-a08a-976b1de96603 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:35.281068 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-984c5ff2-26e0-45da-a08a-976b1de96603 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:35.289334 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-984c5ff2-26e0-45da-a08a-976b1de96603 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/9e6fe47c-ae2f-4f14-8677-368fec05ce55" status: 200 len: 1563 microversion: 2.1 time: 0.171354 Aug 27 03:20:35.289938 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2874/5787] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:35 2022] GET /compute/v2.1/servers/9e6fe47c-ae2f-4f14-8677-368fec05ce55 => generated 1563 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:35.366815 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-bd132ad4-8ccb-4b52-b054-14fb79ff1daa tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:35.367409 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-bd132ad4-8ccb-4b52-b054-14fb79ff1daa tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 9e6fe47c-ae2f-4f14-8677-368fec05ce55] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:35.374061 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bd132ad4-8ccb-4b52-b054-14fb79ff1daa tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:35.374673 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bd132ad4-8ccb-4b52-b054-14fb79ff1daa tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:35.375272 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bd132ad4-8ccb-4b52-b054-14fb79ff1daa tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:35.376061 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bd132ad4-8ccb-4b52-b054-14fb79ff1daa tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:35.376630 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bd132ad4-8ccb-4b52-b054-14fb79ff1daa tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:35.377135 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bd132ad4-8ccb-4b52-b054-14fb79ff1daa tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:35.407324 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-bd132ad4-8ccb-4b52-b054-14fb79ff1daa tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 9e6fe47c-ae2f-4f14-8677-368fec05ce55] Going to try to terminate instance {{(pid=134051) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:20:35.489186 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-bd132ad4-8ccb-4b52-b054-14fb79ff1daa tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "DELETE /compute/v2.1/servers/9e6fe47c-ae2f-4f14-8677-368fec05ce55" status: 204 len: 0 microversion: 2.1 time: 0.126187 Aug 27 03:20:35.489892 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2914/5788] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 03:20:35 2022] DELETE /compute/v2.1/servers/9e6fe47c-ae2f-4f14-8677-368fec05ce55 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:20:35.505953 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-bec23ccc-b214-4162-8c7a-89c6642bff02 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:35.506757 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-bec23ccc-b214-4162-8c7a-89c6642bff02 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 9e6fe47c-ae2f-4f14-8677-368fec05ce55] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:35.513319 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bec23ccc-b214-4162-8c7a-89c6642bff02 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:35.513802 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bec23ccc-b214-4162-8c7a-89c6642bff02 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:35.514242 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bec23ccc-b214-4162-8c7a-89c6642bff02 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:35.514960 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bec23ccc-b214-4162-8c7a-89c6642bff02 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:35.515615 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bec23ccc-b214-4162-8c7a-89c6642bff02 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:35.516060 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bec23ccc-b214-4162-8c7a-89c6642bff02 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:35.660426 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-bec23ccc-b214-4162-8c7a-89c6642bff02 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:35.668841 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-bec23ccc-b214-4162-8c7a-89c6642bff02 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/9e6fe47c-ae2f-4f14-8677-368fec05ce55" status: 200 len: 1569 microversion: 2.1 time: 0.167104 Aug 27 03:20:35.669413 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2875/5789] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:35 2022] GET /compute/v2.1/servers/9e6fe47c-ae2f-4f14-8677-368fec05ce55 => generated 1569 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:36.691218 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-208050f1-c30b-44a7-bf41-5389e93963ac tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:36.692366 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-208050f1-c30b-44a7-bf41-5389e93963ac tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 9e6fe47c-ae2f-4f14-8677-368fec05ce55] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:36.699998 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-208050f1-c30b-44a7-bf41-5389e93963ac tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:36.700557 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-208050f1-c30b-44a7-bf41-5389e93963ac tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:36.701031 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-208050f1-c30b-44a7-bf41-5389e93963ac tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:36.701765 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-208050f1-c30b-44a7-bf41-5389e93963ac tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:36.702237 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-208050f1-c30b-44a7-bf41-5389e93963ac tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:36.702681 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-208050f1-c30b-44a7-bf41-5389e93963ac tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:36.840347 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-208050f1-c30b-44a7-bf41-5389e93963ac tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:36.848937 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-208050f1-c30b-44a7-bf41-5389e93963ac tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/9e6fe47c-ae2f-4f14-8677-368fec05ce55" status: 200 len: 1569 microversion: 2.1 time: 0.162363 Aug 27 03:20:36.849542 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2915/5790] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:36 2022] GET /compute/v2.1/servers/9e6fe47c-ae2f-4f14-8677-368fec05ce55 => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:37.553432 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-c72e41ab-611d-4259-a39e-e07409cdca0d req-4cb138f1-1dc9-42c9-afe5-b30dc00ac716 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e6fe47c-ae2f-4f14-8677-368fec05ce55", "name": "network-vif-deleted", "tag": "3efbf457-0a5c-4b1f-a535-1f0c816048c6"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:20:37.568598 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-c72e41ab-611d-4259-a39e-e07409cdca0d req-4cb138f1-1dc9-42c9-afe5-b30dc00ac716 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:37.569086 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-c72e41ab-611d-4259-a39e-e07409cdca0d req-4cb138f1-1dc9-42c9-afe5-b30dc00ac716 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:37.569518 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-c72e41ab-611d-4259-a39e-e07409cdca0d req-4cb138f1-1dc9-42c9-afe5-b30dc00ac716 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:37.602106 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-c72e41ab-611d-4259-a39e-e07409cdca0d req-4cb138f1-1dc9-42c9-afe5-b30dc00ac716 service nova] Creating event network-vif-deleted:3efbf457-0a5c-4b1f-a535-1f0c816048c6 for instance 9e6fe47c-ae2f-4f14-8677-368fec05ce55 on n-h1-852278-4 Aug 27 03:20:37.608658 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-c72e41ab-611d-4259-a39e-e07409cdca0d req-4cb138f1-1dc9-42c9-afe5-b30dc00ac716 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059700 Aug 27 03:20:37.609773 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2876/5791] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:20:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:20:37.875325 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-35c49586-5c64-4eb4-b2da-eda7979707d8 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:37.876039 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-35c49586-5c64-4eb4-b2da-eda7979707d8 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 9e6fe47c-ae2f-4f14-8677-368fec05ce55] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:37.883230 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-35c49586-5c64-4eb4-b2da-eda7979707d8 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:37.883831 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-35c49586-5c64-4eb4-b2da-eda7979707d8 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:37.884375 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-35c49586-5c64-4eb4-b2da-eda7979707d8 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:37.885152 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-35c49586-5c64-4eb4-b2da-eda7979707d8 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:37.885683 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-35c49586-5c64-4eb4-b2da-eda7979707d8 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:37.886175 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-35c49586-5c64-4eb4-b2da-eda7979707d8 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:37.966279 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-35c49586-5c64-4eb4-b2da-eda7979707d8 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:37.974534 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-35c49586-5c64-4eb4-b2da-eda7979707d8 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/9e6fe47c-ae2f-4f14-8677-368fec05ce55" status: 200 len: 1360 microversion: 2.1 time: 0.103305 Aug 27 03:20:37.975333 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2916/5792] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:37 2022] GET /compute/v2.1/servers/9e6fe47c-ae2f-4f14-8677-368fec05ce55 => generated 1360 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:38.996232 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d8540ccb-a836-4a7a-a98e-62886bf02d71 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:38.996987 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d8540ccb-a836-4a7a-a98e-62886bf02d71 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 9e6fe47c-ae2f-4f14-8677-368fec05ce55] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:39.004864 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d8540ccb-a836-4a7a-a98e-62886bf02d71 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:39.005414 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d8540ccb-a836-4a7a-a98e-62886bf02d71 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:39.005850 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d8540ccb-a836-4a7a-a98e-62886bf02d71 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:39.006556 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d8540ccb-a836-4a7a-a98e-62886bf02d71 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:39.007006 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d8540ccb-a836-4a7a-a98e-62886bf02d71 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:39.007425 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d8540ccb-a836-4a7a-a98e-62886bf02d71 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:39.082582 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-d8540ccb-a836-4a7a-a98e-62886bf02d71 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:39.091446 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d8540ccb-a836-4a7a-a98e-62886bf02d71 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/9e6fe47c-ae2f-4f14-8677-368fec05ce55" status: 200 len: 1360 microversion: 2.1 time: 0.100013 Aug 27 03:20:39.092130 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2877/5793] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:38 2022] GET /compute/v2.1/servers/9e6fe47c-ae2f-4f14-8677-368fec05ce55 => generated 1360 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:40.113027 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-70ef980d-ab05-4e6b-a2bc-9f49004a7bdc tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:40.114286 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-70ef980d-ab05-4e6b-a2bc-9f49004a7bdc tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 9e6fe47c-ae2f-4f14-8677-368fec05ce55] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:40.122213 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-70ef980d-ab05-4e6b-a2bc-9f49004a7bdc tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:40.125706 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-70ef980d-ab05-4e6b-a2bc-9f49004a7bdc tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:40.125706 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-70ef980d-ab05-4e6b-a2bc-9f49004a7bdc tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:40.125706 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-70ef980d-ab05-4e6b-a2bc-9f49004a7bdc tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:40.125706 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-70ef980d-ab05-4e6b-a2bc-9f49004a7bdc tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:40.125706 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-70ef980d-ab05-4e6b-a2bc-9f49004a7bdc tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:40.203868 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-70ef980d-ab05-4e6b-a2bc-9f49004a7bdc tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:40.216398 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-70ef980d-ab05-4e6b-a2bc-9f49004a7bdc tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/9e6fe47c-ae2f-4f14-8677-368fec05ce55" status: 200 len: 1360 microversion: 2.1 time: 0.107224 Aug 27 03:20:40.217821 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2917/5794] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:40 2022] GET /compute/v2.1/servers/9e6fe47c-ae2f-4f14-8677-368fec05ce55 => generated 1360 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:41.239871 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f9a82be2-4487-489f-85a0-d4e3deed1037 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:41.241597 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-f9a82be2-4487-489f-85a0-d4e3deed1037 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 9e6fe47c-ae2f-4f14-8677-368fec05ce55] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:41.250526 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f9a82be2-4487-489f-85a0-d4e3deed1037 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:41.251401 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f9a82be2-4487-489f-85a0-d4e3deed1037 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:41.252089 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f9a82be2-4487-489f-85a0-d4e3deed1037 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:41.252995 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f9a82be2-4487-489f-85a0-d4e3deed1037 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:41.253623 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f9a82be2-4487-489f-85a0-d4e3deed1037 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:41.254423 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f9a82be2-4487-489f-85a0-d4e3deed1037 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:41.330211 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-f9a82be2-4487-489f-85a0-d4e3deed1037 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:41.339935 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f9a82be2-4487-489f-85a0-d4e3deed1037 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/9e6fe47c-ae2f-4f14-8677-368fec05ce55" status: 200 len: 1360 microversion: 2.1 time: 0.105125 Aug 27 03:20:41.340888 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2878/5795] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:41 2022] GET /compute/v2.1/servers/9e6fe47c-ae2f-4f14-8677-368fec05ce55 => generated 1360 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:42.364706 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-9f2fad57-07ed-45d4-b239-826906972cb0 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:42.365982 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-9f2fad57-07ed-45d4-b239-826906972cb0 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 9e6fe47c-ae2f-4f14-8677-368fec05ce55] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:42.369848 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:20:42.377036 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9f2fad57-07ed-45d4-b239-826906972cb0 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:42.377730 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9f2fad57-07ed-45d4-b239-826906972cb0 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:42.386034 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9f2fad57-07ed-45d4-b239-826906972cb0 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:42.386805 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9f2fad57-07ed-45d4-b239-826906972cb0 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:42.387270 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9f2fad57-07ed-45d4-b239-826906972cb0 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:42.387709 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9f2fad57-07ed-45d4-b239-826906972cb0 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:42.413892 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:20:42.426177 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9f2fad57-07ed-45d4-b239-826906972cb0 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:42.426679 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9f2fad57-07ed-45d4-b239-826906972cb0 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:42.427165 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9f2fad57-07ed-45d4-b239-826906972cb0 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:42.427636 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.objects.instance [None req-9f2fad57-07ed-45d4-b239-826906972cb0 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lazy-loading 'fault' on Instance uuid 9e6fe47c-ae2f-4f14-8677-368fec05ce55 {{(pid=134051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:20:42.496483 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-9f2fad57-07ed-45d4-b239-826906972cb0 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:42.504923 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-9f2fad57-07ed-45d4-b239-826906972cb0 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/9e6fe47c-ae2f-4f14-8677-368fec05ce55" status: 200 len: 1365 microversion: 2.1 time: 0.146828 Aug 27 03:20:42.534953 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2918/5796] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:42 2022] GET /compute/v2.1/servers/9e6fe47c-ae2f-4f14-8677-368fec05ce55 => generated 1365 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:43.530485 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-65e4db3a-460e-4279-8615-528d66484936 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:43.531175 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-65e4db3a-460e-4279-8615-528d66484936 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 9e6fe47c-ae2f-4f14-8677-368fec05ce55] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:43.534410 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=30 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:20:43.540062 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-65e4db3a-460e-4279-8615-528d66484936 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:43.540939 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-65e4db3a-460e-4279-8615-528d66484936 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:43.541471 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-65e4db3a-460e-4279-8615-528d66484936 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:43.542292 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-65e4db3a-460e-4279-8615-528d66484936 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:43.542837 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-65e4db3a-460e-4279-8615-528d66484936 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:43.543355 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-65e4db3a-460e-4279-8615-528d66484936 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:43.547294 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=86 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:20:43.564720 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-65e4db3a-460e-4279-8615-528d66484936 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] HTTP exception thrown: Instance 9e6fe47c-ae2f-4f14-8677-368fec05ce55 could not be found. Aug 27 03:20:43.566849 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-65e4db3a-460e-4279-8615-528d66484936 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Request method failure captured: Aug 27 03:20:43.566849 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/servers/9e6fe47c-ae2f-4f14-8677-368fec05ce55 HTTP/1.1 Aug 27 03:20:43.566849 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 03:20:43.566849 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 03:20:43.566849 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 03:20:43.566849 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 03:20:43.566849 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 03:20:43.566849 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 03:20:43.566849 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 03:20:43.566849 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 03:20:43.566849 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYyanRmSitPtUh4DIDjvAfp5Iiwg8r3Bf9-rjIalvb44wIYhFzVkZDLPIdVwR9rbE-qHDjS_3-JeB9MrxSXFOtiOWUfHFokH2CMOJ34en6s6KyuDM-ix0my9F59eD8M1zowb_BqVFIaTj9p6YHs85SeVo0SCpB1hAOakQSi3_cd8UVk Aug 27 03:20:43.566849 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 03:20:43.566849 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 03:20:43.566849 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 03:20:43.566849 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 03:20:43.566849 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 03:20:43.566849 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 03:20:43.566849 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 7b2673a034c24d1898493bfea9ca5d1d Aug 27 03:20:43.566849 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-TestVolumeBootPattern-2103223700 Aug 27 03:20:43.566849 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 03:20:43.566849 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 03:20:43.566849 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7b2673a034c24d1898493bfea9ca5d1d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_7b2673a034c24d1898493bfea9ca5d1d", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7b2673a034c24d1898493bfea9ca5d1d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/7b2673a034c24d1898493bfea9ca5d1d"}]}] Aug 27 03:20:43.566849 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-TestVolumeBootPattern-2103223700 Aug 27 03:20:43.566849 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 7b2673a034c24d1898493bfea9ca5d1d Aug 27 03:20:43.566849 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-TestVolumeBootPattern-2103223700 Aug 27 03:20:43.566849 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-TestVolumeBootPattern-2103223700-project Aug 27 03:20:43.566849 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 03:20:43.566849 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 03:20:43.566849 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 4aa867d7baa043b1b1e6763046463b3f Aug 27 03:20:43.566849 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-TestVolumeBootPattern-2103223700-project Aug 27 03:20:43.566849 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 03:20:43.566849 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance 9e6fe47c-ae2f-4f14-8677-368fec05ce55 could not be found. Aug 27 03:20:43.566849 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '9e6fe47c-ae2f-4f14-8677-368fec05ce55'} Aug 27 03:20:43.566849 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:20:43.566849 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:20:43.566849 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:20:43.566849 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:20:43.566849 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:20:43.566849 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:20:43.566849 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:20:43.566849 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:20:43.566849 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:20:43.566849 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:20:43.566849 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e6fe47c-ae2f-4f14-8677-368fec05ce55 could not be found. Aug 27 03:20:43.566849 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:20:43.566849 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:20:43.566849 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:20:43.566849 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:20:43.566849 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:20:43.566849 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:20:43.566849 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:20:43.566849 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:20:43.566849 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:20:43.566849 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:20:43.566849 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:20:43.566849 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:20:43.566849 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:20:43.566849 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:20:43.566849 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:20:43.566849 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:20:43.566849 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e6fe47c-ae2f-4f14-8677-368fec05ce55 could not be found. Aug 27 03:20:43.566849 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:20:43.566849 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:20:43.566849 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:20:43.571947 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:20:43.571947 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:20:43.571947 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:20:43.571947 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:20:43.571947 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:20:43.571947 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e6fe47c-ae2f-4f14-8677-368fec05ce55 could not be found. Aug 27 03:20:43.571947 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:20:43.571947 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-65e4db3a-460e-4279-8615-528d66484936 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Returning 404 to user: Instance 9e6fe47c-ae2f-4f14-8677-368fec05ce55 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:20:43.571947 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-65e4db3a-460e-4279-8615-528d66484936 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/9e6fe47c-ae2f-4f14-8677-368fec05ce55" status: 404 len: 111 microversion: 2.1 time: 0.042710 Aug 27 03:20:43.571947 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2879/5797] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:43 2022] GET /compute/v2.1/servers/9e6fe47c-ae2f-4f14-8677-368fec05ce55 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:20:47.937230 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-650f24a8-a9bf-44bd-a1bd-b601a5d5ab09 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:47.937832 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-650f24a8-a9bf-44bd-a1bd-b601a5d5ab09 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 3050c41d-6baa-4fe4-b722-1610cbc83d86] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:47.946107 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-650f24a8-a9bf-44bd-a1bd-b601a5d5ab09 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:47.951585 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-650f24a8-a9bf-44bd-a1bd-b601a5d5ab09 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:47.952185 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-650f24a8-a9bf-44bd-a1bd-b601a5d5ab09 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:47.953038 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-650f24a8-a9bf-44bd-a1bd-b601a5d5ab09 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:47.953529 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-650f24a8-a9bf-44bd-a1bd-b601a5d5ab09 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:47.954014 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-650f24a8-a9bf-44bd-a1bd-b601a5d5ab09 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:47.983590 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-650f24a8-a9bf-44bd-a1bd-b601a5d5ab09 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 3050c41d-6baa-4fe4-b722-1610cbc83d86] Going to try to terminate instance {{(pid=134051) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:20:48.067811 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-650f24a8-a9bf-44bd-a1bd-b601a5d5ab09 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "DELETE /compute/v2.1/servers/3050c41d-6baa-4fe4-b722-1610cbc83d86" status: 204 len: 0 microversion: 2.1 time: 0.134123 Aug 27 03:20:48.068661 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2919/5798] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 03:20:47 2022] DELETE /compute/v2.1/servers/3050c41d-6baa-4fe4-b722-1610cbc83d86 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:20:48.077320 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4a181427-3eaa-421a-9a0d-468c7bded377 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:48.077943 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-4a181427-3eaa-421a-9a0d-468c7bded377 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 3050c41d-6baa-4fe4-b722-1610cbc83d86] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:48.085793 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4a181427-3eaa-421a-9a0d-468c7bded377 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:48.086277 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4a181427-3eaa-421a-9a0d-468c7bded377 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:48.086714 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4a181427-3eaa-421a-9a0d-468c7bded377 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:48.087412 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4a181427-3eaa-421a-9a0d-468c7bded377 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:48.087866 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4a181427-3eaa-421a-9a0d-468c7bded377 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:48.088285 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4a181427-3eaa-421a-9a0d-468c7bded377 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:48.230810 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-4a181427-3eaa-421a-9a0d-468c7bded377 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:48.240008 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-4a181427-3eaa-421a-9a0d-468c7bded377 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/3050c41d-6baa-4fe4-b722-1610cbc83d86" status: 200 len: 1411 microversion: 2.1 time: 0.166507 Aug 27 03:20:48.244962 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2880/5799] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:48 2022] GET /compute/v2.1/servers/3050c41d-6baa-4fe4-b722-1610cbc83d86 => generated 1411 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:49.261438 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b204b328-0d16-4b27-ab2e-1677e17addf9 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:49.262163 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b204b328-0d16-4b27-ab2e-1677e17addf9 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 3050c41d-6baa-4fe4-b722-1610cbc83d86] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:49.270721 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b204b328-0d16-4b27-ab2e-1677e17addf9 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:49.271523 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b204b328-0d16-4b27-ab2e-1677e17addf9 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:49.272092 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b204b328-0d16-4b27-ab2e-1677e17addf9 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:49.272879 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b204b328-0d16-4b27-ab2e-1677e17addf9 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:49.273916 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b204b328-0d16-4b27-ab2e-1677e17addf9 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:49.276959 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b204b328-0d16-4b27-ab2e-1677e17addf9 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:49.414559 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-b204b328-0d16-4b27-ab2e-1677e17addf9 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:49.422611 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b204b328-0d16-4b27-ab2e-1677e17addf9 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/3050c41d-6baa-4fe4-b722-1610cbc83d86" status: 200 len: 1411 microversion: 2.1 time: 0.165520 Aug 27 03:20:49.423203 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2920/5800] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:49 2022] GET /compute/v2.1/servers/3050c41d-6baa-4fe4-b722-1610cbc83d86 => generated 1411 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:50.072502 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-ecd39d09-a1f1-4a7a-bca1-0a721ad31aad req-4c0bc71c-c9c0-40ae-89ec-8fbf657b5d04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3050c41d-6baa-4fe4-b722-1610cbc83d86", "name": "network-vif-deleted", "tag": "aa5d2005-9431-4d12-888f-960e552f9642"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:20:50.085568 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-ecd39d09-a1f1-4a7a-bca1-0a721ad31aad req-4c0bc71c-c9c0-40ae-89ec-8fbf657b5d04 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:50.086193 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-ecd39d09-a1f1-4a7a-bca1-0a721ad31aad req-4c0bc71c-c9c0-40ae-89ec-8fbf657b5d04 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:50.086703 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-ecd39d09-a1f1-4a7a-bca1-0a721ad31aad req-4c0bc71c-c9c0-40ae-89ec-8fbf657b5d04 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:50.100612 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-ecd39d09-a1f1-4a7a-bca1-0a721ad31aad req-4c0bc71c-c9c0-40ae-89ec-8fbf657b5d04 service nova] Creating event network-vif-deleted:aa5d2005-9431-4d12-888f-960e552f9642 for instance 3050c41d-6baa-4fe4-b722-1610cbc83d86 on n-h2-852278-4 Aug 27 03:20:50.105874 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-ecd39d09-a1f1-4a7a-bca1-0a721ad31aad req-4c0bc71c-c9c0-40ae-89ec-8fbf657b5d04 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037189 Aug 27 03:20:50.106473 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2881/5801] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:20:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:20:50.443694 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e0eac121-d047-40f9-9f03-07939cbda36b tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:50.444374 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-e0eac121-d047-40f9-9f03-07939cbda36b tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 3050c41d-6baa-4fe4-b722-1610cbc83d86] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:50.463318 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e0eac121-d047-40f9-9f03-07939cbda36b tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:50.463837 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e0eac121-d047-40f9-9f03-07939cbda36b tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:50.464326 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e0eac121-d047-40f9-9f03-07939cbda36b tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:50.465071 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e0eac121-d047-40f9-9f03-07939cbda36b tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:50.476021 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e0eac121-d047-40f9-9f03-07939cbda36b tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:50.476627 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e0eac121-d047-40f9-9f03-07939cbda36b tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:50.547694 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e0eac121-d047-40f9-9f03-07939cbda36b tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:50.557006 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e0eac121-d047-40f9-9f03-07939cbda36b tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/3050c41d-6baa-4fe4-b722-1610cbc83d86" status: 200 len: 1202 microversion: 2.1 time: 0.117351 Aug 27 03:20:50.560804 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2921/5802] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:50 2022] GET /compute/v2.1/servers/3050c41d-6baa-4fe4-b722-1610cbc83d86 => generated 1202 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:51.582841 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3e9892d3-7a8f-4b02-8d61-1aa19dd59879 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:51.583531 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-3e9892d3-7a8f-4b02-8d61-1aa19dd59879 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 3050c41d-6baa-4fe4-b722-1610cbc83d86] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:51.591333 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3e9892d3-7a8f-4b02-8d61-1aa19dd59879 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:51.591822 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3e9892d3-7a8f-4b02-8d61-1aa19dd59879 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:51.592260 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3e9892d3-7a8f-4b02-8d61-1aa19dd59879 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:51.593021 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3e9892d3-7a8f-4b02-8d61-1aa19dd59879 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:51.593475 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3e9892d3-7a8f-4b02-8d61-1aa19dd59879 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:51.593893 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3e9892d3-7a8f-4b02-8d61-1aa19dd59879 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:51.660232 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-3e9892d3-7a8f-4b02-8d61-1aa19dd59879 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:51.668685 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-3e9892d3-7a8f-4b02-8d61-1aa19dd59879 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/3050c41d-6baa-4fe4-b722-1610cbc83d86" status: 200 len: 1202 microversion: 2.1 time: 0.090358 Aug 27 03:20:51.669277 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2882/5803] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:51 2022] GET /compute/v2.1/servers/3050c41d-6baa-4fe4-b722-1610cbc83d86 => generated 1202 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:52.689854 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-49ee0306-650a-4979-ba96-b8d50215801f tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:52.690583 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-49ee0306-650a-4979-ba96-b8d50215801f tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 3050c41d-6baa-4fe4-b722-1610cbc83d86] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:52.698444 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-49ee0306-650a-4979-ba96-b8d50215801f tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:52.698820 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-49ee0306-650a-4979-ba96-b8d50215801f tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:52.699281 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-49ee0306-650a-4979-ba96-b8d50215801f tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:52.700082 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-49ee0306-650a-4979-ba96-b8d50215801f tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:52.700496 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-49ee0306-650a-4979-ba96-b8d50215801f tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:52.700942 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-49ee0306-650a-4979-ba96-b8d50215801f tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:52.788796 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-49ee0306-650a-4979-ba96-b8d50215801f tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:52.797719 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-49ee0306-650a-4979-ba96-b8d50215801f tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/3050c41d-6baa-4fe4-b722-1610cbc83d86" status: 200 len: 1202 microversion: 2.1 time: 0.112076 Aug 27 03:20:52.798304 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2922/5804] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:52 2022] GET /compute/v2.1/servers/3050c41d-6baa-4fe4-b722-1610cbc83d86 => generated 1202 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:53.818868 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-676e1f44-df75-4812-82f2-ef8042688765 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:53.820144 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-676e1f44-df75-4812-82f2-ef8042688765 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 3050c41d-6baa-4fe4-b722-1610cbc83d86] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:53.827547 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-676e1f44-df75-4812-82f2-ef8042688765 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:53.828031 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-676e1f44-df75-4812-82f2-ef8042688765 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:53.828667 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-676e1f44-df75-4812-82f2-ef8042688765 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:53.829376 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-676e1f44-df75-4812-82f2-ef8042688765 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:53.829820 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-676e1f44-df75-4812-82f2-ef8042688765 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:53.830235 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-676e1f44-df75-4812-82f2-ef8042688765 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:53.899396 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-676e1f44-df75-4812-82f2-ef8042688765 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:53.907607 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-676e1f44-df75-4812-82f2-ef8042688765 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/3050c41d-6baa-4fe4-b722-1610cbc83d86" status: 200 len: 1202 microversion: 2.1 time: 0.092795 Aug 27 03:20:53.908199 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2883/5805] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:53 2022] GET /compute/v2.1/servers/3050c41d-6baa-4fe4-b722-1610cbc83d86 => generated 1202 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:20:54.928863 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3ea76060-efdd-48c5-9373-9ca7d375e723 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:54.929503 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-3ea76060-efdd-48c5-9373-9ca7d375e723 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 3050c41d-6baa-4fe4-b722-1610cbc83d86] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:54.948141 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3ea76060-efdd-48c5-9373-9ca7d375e723 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:54.948602 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3ea76060-efdd-48c5-9373-9ca7d375e723 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:54.949059 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3ea76060-efdd-48c5-9373-9ca7d375e723 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:54.949797 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3ea76060-efdd-48c5-9373-9ca7d375e723 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:54.950303 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3ea76060-efdd-48c5-9373-9ca7d375e723 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:54.950748 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3ea76060-efdd-48c5-9373-9ca7d375e723 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:54.966507 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-3ea76060-efdd-48c5-9373-9ca7d375e723 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] HTTP exception thrown: Instance 3050c41d-6baa-4fe4-b722-1610cbc83d86 could not be found. Aug 27 03:20:54.968262 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3ea76060-efdd-48c5-9373-9ca7d375e723 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Request method failure captured: Aug 27 03:20:54.968262 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/3050c41d-6baa-4fe4-b722-1610cbc83d86 HTTP/1.1 Aug 27 03:20:54.968262 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 03:20:54.968262 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 03:20:54.968262 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 03:20:54.968262 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 03:20:54.968262 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 03:20:54.968262 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 03:20:54.968262 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 03:20:54.968262 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 03:20:54.968262 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYyanRmSitPtUh4DIDjvAfp5Iiwg8r3Bf9-rjIalvb44wIYhFzVkZDLPIdVwR9rbE-qHDjS_3-JeB9MrxSXFOtiOWUfHFokH2CMOJ34en6s6KyuDM-ix0my9F59eD8M1zowb_BqVFIaTj9p6YHs85SeVo0SCpB1hAOakQSi3_cd8UVk Aug 27 03:20:54.968262 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 03:20:54.968262 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 03:20:54.968262 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 03:20:54.968262 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 03:20:54.968262 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 03:20:54.968262 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 03:20:54.968262 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 7b2673a034c24d1898493bfea9ca5d1d Aug 27 03:20:54.968262 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-TestVolumeBootPattern-2103223700 Aug 27 03:20:54.968262 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 03:20:54.968262 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 03:20:54.968262 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7b2673a034c24d1898493bfea9ca5d1d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_7b2673a034c24d1898493bfea9ca5d1d", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7b2673a034c24d1898493bfea9ca5d1d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/7b2673a034c24d1898493bfea9ca5d1d"}]}] Aug 27 03:20:54.968262 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-TestVolumeBootPattern-2103223700 Aug 27 03:20:54.968262 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 7b2673a034c24d1898493bfea9ca5d1d Aug 27 03:20:54.968262 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-TestVolumeBootPattern-2103223700 Aug 27 03:20:54.968262 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-TestVolumeBootPattern-2103223700-project Aug 27 03:20:54.968262 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 03:20:54.968262 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 03:20:54.968262 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 4aa867d7baa043b1b1e6763046463b3f Aug 27 03:20:54.968262 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-TestVolumeBootPattern-2103223700-project Aug 27 03:20:54.968262 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 03:20:54.968262 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance 3050c41d-6baa-4fe4-b722-1610cbc83d86 could not be found. Aug 27 03:20:54.968262 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '3050c41d-6baa-4fe4-b722-1610cbc83d86'} Aug 27 03:20:54.968262 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:20:54.968262 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:20:54.968262 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:20:54.968262 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:20:54.968262 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:20:54.968262 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:20:54.968262 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:20:54.968262 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:20:54.968262 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:20:54.968262 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:20:54.968262 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3050c41d-6baa-4fe4-b722-1610cbc83d86 could not be found. Aug 27 03:20:54.968262 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:20:54.968262 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:20:54.968262 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:20:54.968262 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:20:54.968262 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:20:54.968262 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:20:54.968262 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:20:54.968262 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:20:54.968262 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:20:54.968262 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:20:54.968262 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:20:54.968262 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:20:54.968262 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:20:54.968262 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:20:54.968262 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:20:54.968262 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:20:54.968262 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3050c41d-6baa-4fe4-b722-1610cbc83d86 could not be found. Aug 27 03:20:54.968262 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:20:54.968262 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:20:54.968262 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:20:54.973166 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:20:54.973166 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:20:54.973166 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:20:54.973166 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:20:54.973166 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:20:54.973166 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3050c41d-6baa-4fe4-b722-1610cbc83d86 could not be found. Aug 27 03:20:54.973166 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:20:54.973166 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3ea76060-efdd-48c5-9373-9ca7d375e723 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Returning 404 to user: Instance 3050c41d-6baa-4fe4-b722-1610cbc83d86 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:20:54.973166 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-3ea76060-efdd-48c5-9373-9ca7d375e723 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/3050c41d-6baa-4fe4-b722-1610cbc83d86" status: 404 len: 111 microversion: 2.1 time: 0.045519 Aug 27 03:20:54.973961 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2923/5806] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:54 2022] GET /compute/v2.1/servers/3050c41d-6baa-4fe4-b722-1610cbc83d86 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:20:57.125210 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b2e66d6a-4da1-42ba-9229-1e9e44a694e7 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:57.125720 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b2e66d6a-4da1-42ba-9229-1e9e44a694e7 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 9e6fe47c-ae2f-4f14-8677-368fec05ce55] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:57.133495 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b2e66d6a-4da1-42ba-9229-1e9e44a694e7 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:57.133989 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b2e66d6a-4da1-42ba-9229-1e9e44a694e7 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:57.134423 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b2e66d6a-4da1-42ba-9229-1e9e44a694e7 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:57.135178 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b2e66d6a-4da1-42ba-9229-1e9e44a694e7 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:57.135608 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b2e66d6a-4da1-42ba-9229-1e9e44a694e7 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:57.136030 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b2e66d6a-4da1-42ba-9229-1e9e44a694e7 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:57.152041 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-b2e66d6a-4da1-42ba-9229-1e9e44a694e7 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] HTTP exception thrown: Instance 9e6fe47c-ae2f-4f14-8677-368fec05ce55 could not be found. Aug 27 03:20:57.153804 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b2e66d6a-4da1-42ba-9229-1e9e44a694e7 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Request method failure captured: Aug 27 03:20:57.153804 n-d-852278-4 devstack@n-api.service[134052]: request: DELETE /compute/v2.1/servers/9e6fe47c-ae2f-4f14-8677-368fec05ce55 HTTP/1.1 Aug 27 03:20:57.153804 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 03:20:57.153804 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 03:20:57.153804 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 03:20:57.153804 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 03:20:57.153804 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 03:20:57.153804 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 03:20:57.153804 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 03:20:57.153804 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 03:20:57.153804 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYyanRmSitPtUh4DIDjvAfp5Iiwg8r3Bf9-rjIalvb44wIYhFzVkZDLPIdVwR9rbE-qHDjS_3-JeB9MrxSXFOtiOWUfHFokH2CMOJ34en6s6KyuDM-ix0my9F59eD8M1zowb_BqVFIaTj9p6YHs85SeVo0SCpB1hAOakQSi3_cd8UVk Aug 27 03:20:57.153804 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 03:20:57.153804 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 03:20:57.153804 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 03:20:57.153804 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 03:20:57.153804 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 03:20:57.153804 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 03:20:57.153804 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 7b2673a034c24d1898493bfea9ca5d1d Aug 27 03:20:57.153804 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-TestVolumeBootPattern-2103223700 Aug 27 03:20:57.153804 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 03:20:57.153804 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 03:20:57.153804 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7b2673a034c24d1898493bfea9ca5d1d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_7b2673a034c24d1898493bfea9ca5d1d", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7b2673a034c24d1898493bfea9ca5d1d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/7b2673a034c24d1898493bfea9ca5d1d"}]}] Aug 27 03:20:57.153804 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-TestVolumeBootPattern-2103223700 Aug 27 03:20:57.153804 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 7b2673a034c24d1898493bfea9ca5d1d Aug 27 03:20:57.153804 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-TestVolumeBootPattern-2103223700 Aug 27 03:20:57.153804 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-TestVolumeBootPattern-2103223700-project Aug 27 03:20:57.153804 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 03:20:57.153804 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 03:20:57.153804 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 4aa867d7baa043b1b1e6763046463b3f Aug 27 03:20:57.153804 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-TestVolumeBootPattern-2103223700-project Aug 27 03:20:57.153804 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 03:20:57.153804 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance 9e6fe47c-ae2f-4f14-8677-368fec05ce55 could not be found. Aug 27 03:20:57.153804 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '9e6fe47c-ae2f-4f14-8677-368fec05ce55'} Aug 27 03:20:57.153804 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:20:57.153804 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:20:57.153804 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:20:57.153804 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:20:57.153804 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:20:57.153804 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:20:57.153804 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:20:57.153804 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:20:57.153804 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:20:57.153804 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:20:57.153804 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e6fe47c-ae2f-4f14-8677-368fec05ce55 could not be found. Aug 27 03:20:57.153804 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:20:57.153804 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:20:57.153804 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:20:57.153804 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:20:57.153804 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:20:57.153804 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:20:57.153804 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:20:57.153804 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:20:57.153804 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:20:57.153804 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:20:57.153804 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 03:20:57.153804 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 03:20:57.153804 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 03:20:57.153804 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 03:20:57.153804 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:20:57.153804 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:20:57.153804 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:20:57.153804 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:20:57.157552 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e6fe47c-ae2f-4f14-8677-368fec05ce55 could not be found. Aug 27 03:20:57.157552 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:20:57.157552 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:20:57.157552 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:20:57.157552 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:20:57.157552 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:20:57.157552 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:20:57.157552 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:20:57.157552 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:20:57.157552 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e6fe47c-ae2f-4f14-8677-368fec05ce55 could not be found. Aug 27 03:20:57.157552 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:20:57.157552 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b2e66d6a-4da1-42ba-9229-1e9e44a694e7 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Returning 404 to user: Instance 9e6fe47c-ae2f-4f14-8677-368fec05ce55 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:20:57.157552 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b2e66d6a-4da1-42ba-9229-1e9e44a694e7 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "DELETE /compute/v2.1/servers/9e6fe47c-ae2f-4f14-8677-368fec05ce55" status: 404 len: 111 microversion: 2.1 time: 0.034009 Aug 27 03:20:57.157552 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2884/5807] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 03:20:57 2022] DELETE /compute/v2.1/servers/9e6fe47c-ae2f-4f14-8677-368fec05ce55 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:20:57.164743 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-da49b8e2-f09c-4f44-9f35-ed0116e83852 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:57.165588 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-da49b8e2-f09c-4f44-9f35-ed0116e83852 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 9e6fe47c-ae2f-4f14-8677-368fec05ce55] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:57.173009 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-da49b8e2-f09c-4f44-9f35-ed0116e83852 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:57.173526 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-da49b8e2-f09c-4f44-9f35-ed0116e83852 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:57.174080 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-da49b8e2-f09c-4f44-9f35-ed0116e83852 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:57.174850 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-da49b8e2-f09c-4f44-9f35-ed0116e83852 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:57.175480 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-da49b8e2-f09c-4f44-9f35-ed0116e83852 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:57.175990 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-da49b8e2-f09c-4f44-9f35-ed0116e83852 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:57.192771 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-da49b8e2-f09c-4f44-9f35-ed0116e83852 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] HTTP exception thrown: Instance 9e6fe47c-ae2f-4f14-8677-368fec05ce55 could not be found. Aug 27 03:20:57.194699 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-da49b8e2-f09c-4f44-9f35-ed0116e83852 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Request method failure captured: Aug 27 03:20:57.194699 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/9e6fe47c-ae2f-4f14-8677-368fec05ce55 HTTP/1.1 Aug 27 03:20:57.194699 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 03:20:57.194699 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 03:20:57.194699 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 03:20:57.194699 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 03:20:57.194699 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 03:20:57.194699 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 03:20:57.194699 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 03:20:57.194699 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 03:20:57.194699 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYyanRmSitPtUh4DIDjvAfp5Iiwg8r3Bf9-rjIalvb44wIYhFzVkZDLPIdVwR9rbE-qHDjS_3-JeB9MrxSXFOtiOWUfHFokH2CMOJ34en6s6KyuDM-ix0my9F59eD8M1zowb_BqVFIaTj9p6YHs85SeVo0SCpB1hAOakQSi3_cd8UVk Aug 27 03:20:57.194699 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 03:20:57.194699 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 03:20:57.194699 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 03:20:57.194699 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 03:20:57.194699 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 03:20:57.194699 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 03:20:57.194699 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 7b2673a034c24d1898493bfea9ca5d1d Aug 27 03:20:57.194699 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-TestVolumeBootPattern-2103223700 Aug 27 03:20:57.194699 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 03:20:57.194699 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 03:20:57.194699 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7b2673a034c24d1898493bfea9ca5d1d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_7b2673a034c24d1898493bfea9ca5d1d", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7b2673a034c24d1898493bfea9ca5d1d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/7b2673a034c24d1898493bfea9ca5d1d"}]}] Aug 27 03:20:57.194699 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-TestVolumeBootPattern-2103223700 Aug 27 03:20:57.194699 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 7b2673a034c24d1898493bfea9ca5d1d Aug 27 03:20:57.194699 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-TestVolumeBootPattern-2103223700 Aug 27 03:20:57.194699 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-TestVolumeBootPattern-2103223700-project Aug 27 03:20:57.194699 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 03:20:57.194699 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 03:20:57.194699 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 4aa867d7baa043b1b1e6763046463b3f Aug 27 03:20:57.194699 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-TestVolumeBootPattern-2103223700-project Aug 27 03:20:57.194699 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 03:20:57.194699 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance 9e6fe47c-ae2f-4f14-8677-368fec05ce55 could not be found. Aug 27 03:20:57.194699 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '9e6fe47c-ae2f-4f14-8677-368fec05ce55'} Aug 27 03:20:57.194699 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:20:57.194699 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:20:57.194699 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:20:57.194699 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:20:57.194699 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:20:57.194699 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:20:57.194699 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:20:57.194699 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:20:57.194699 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:20:57.194699 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:20:57.194699 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e6fe47c-ae2f-4f14-8677-368fec05ce55 could not be found. Aug 27 03:20:57.194699 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:20:57.194699 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:20:57.194699 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:20:57.194699 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:20:57.194699 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:20:57.194699 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:20:57.194699 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:20:57.194699 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:20:57.194699 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:20:57.194699 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:20:57.194699 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:20:57.194699 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:20:57.194699 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:20:57.194699 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:20:57.194699 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:20:57.194699 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:20:57.194699 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e6fe47c-ae2f-4f14-8677-368fec05ce55 could not be found. Aug 27 03:20:57.194699 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:20:57.194699 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:20:57.194699 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:20:57.199356 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:20:57.199356 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:20:57.199356 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:20:57.199356 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:20:57.199356 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:20:57.199356 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e6fe47c-ae2f-4f14-8677-368fec05ce55 could not be found. Aug 27 03:20:57.199356 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:20:57.199356 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-da49b8e2-f09c-4f44-9f35-ed0116e83852 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Returning 404 to user: Instance 9e6fe47c-ae2f-4f14-8677-368fec05ce55 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:20:57.199356 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-da49b8e2-f09c-4f44-9f35-ed0116e83852 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/9e6fe47c-ae2f-4f14-8677-368fec05ce55" status: 404 len: 111 microversion: 2.1 time: 0.035815 Aug 27 03:20:57.200534 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2924/5808] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:57 2022] GET /compute/v2.1/servers/9e6fe47c-ae2f-4f14-8677-368fec05ce55 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:20:57.612044 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-2412421a-e483-4daa-a86e-e08887c0c59a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:57.612571 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-2412421a-e483-4daa-a86e-e08887c0c59a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 3050c41d-6baa-4fe4-b722-1610cbc83d86] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:57.619370 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2412421a-e483-4daa-a86e-e08887c0c59a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:57.619859 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2412421a-e483-4daa-a86e-e08887c0c59a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:57.620289 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2412421a-e483-4daa-a86e-e08887c0c59a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:57.621093 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2412421a-e483-4daa-a86e-e08887c0c59a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:57.621553 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2412421a-e483-4daa-a86e-e08887c0c59a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:57.621967 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2412421a-e483-4daa-a86e-e08887c0c59a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:57.637264 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-2412421a-e483-4daa-a86e-e08887c0c59a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] HTTP exception thrown: Instance 3050c41d-6baa-4fe4-b722-1610cbc83d86 could not be found. Aug 27 03:20:57.638846 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-2412421a-e483-4daa-a86e-e08887c0c59a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Request method failure captured: Aug 27 03:20:57.638846 n-d-852278-4 devstack@n-api.service[134052]: request: DELETE /compute/v2.1/servers/3050c41d-6baa-4fe4-b722-1610cbc83d86 HTTP/1.1 Aug 27 03:20:57.638846 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 03:20:57.638846 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 03:20:57.638846 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 03:20:57.638846 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 03:20:57.638846 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 03:20:57.638846 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 03:20:57.638846 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 03:20:57.638846 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 03:20:57.638846 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYyanRmSitPtUh4DIDjvAfp5Iiwg8r3Bf9-rjIalvb44wIYhFzVkZDLPIdVwR9rbE-qHDjS_3-JeB9MrxSXFOtiOWUfHFokH2CMOJ34en6s6KyuDM-ix0my9F59eD8M1zowb_BqVFIaTj9p6YHs85SeVo0SCpB1hAOakQSi3_cd8UVk Aug 27 03:20:57.638846 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 03:20:57.638846 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 03:20:57.638846 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 03:20:57.638846 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 03:20:57.638846 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 03:20:57.638846 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 03:20:57.638846 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 7b2673a034c24d1898493bfea9ca5d1d Aug 27 03:20:57.638846 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-TestVolumeBootPattern-2103223700 Aug 27 03:20:57.638846 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 03:20:57.638846 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 03:20:57.638846 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7b2673a034c24d1898493bfea9ca5d1d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_7b2673a034c24d1898493bfea9ca5d1d", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7b2673a034c24d1898493bfea9ca5d1d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/7b2673a034c24d1898493bfea9ca5d1d"}]}] Aug 27 03:20:57.638846 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-TestVolumeBootPattern-2103223700 Aug 27 03:20:57.638846 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 7b2673a034c24d1898493bfea9ca5d1d Aug 27 03:20:57.638846 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-TestVolumeBootPattern-2103223700 Aug 27 03:20:57.638846 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-TestVolumeBootPattern-2103223700-project Aug 27 03:20:57.638846 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 03:20:57.638846 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 03:20:57.638846 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 4aa867d7baa043b1b1e6763046463b3f Aug 27 03:20:57.638846 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-TestVolumeBootPattern-2103223700-project Aug 27 03:20:57.638846 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 03:20:57.638846 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance 3050c41d-6baa-4fe4-b722-1610cbc83d86 could not be found. Aug 27 03:20:57.638846 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '3050c41d-6baa-4fe4-b722-1610cbc83d86'} Aug 27 03:20:57.638846 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:20:57.638846 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:20:57.638846 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:20:57.638846 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:20:57.638846 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:20:57.638846 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:20:57.638846 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:20:57.638846 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:20:57.638846 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:20:57.638846 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:20:57.638846 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3050c41d-6baa-4fe4-b722-1610cbc83d86 could not be found. Aug 27 03:20:57.638846 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:20:57.638846 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:20:57.638846 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:20:57.638846 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:20:57.638846 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:20:57.638846 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:20:57.638846 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:20:57.638846 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:20:57.638846 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:20:57.638846 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:20:57.638846 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 03:20:57.638846 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 03:20:57.638846 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 03:20:57.638846 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 03:20:57.638846 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:20:57.638846 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:20:57.638846 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:20:57.638846 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:20:57.643770 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3050c41d-6baa-4fe4-b722-1610cbc83d86 could not be found. Aug 27 03:20:57.643770 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:20:57.643770 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:20:57.643770 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:20:57.643770 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:20:57.643770 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:20:57.643770 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:20:57.643770 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:20:57.643770 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:20:57.643770 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3050c41d-6baa-4fe4-b722-1610cbc83d86 could not be found. Aug 27 03:20:57.643770 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:20:57.643770 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-2412421a-e483-4daa-a86e-e08887c0c59a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Returning 404 to user: Instance 3050c41d-6baa-4fe4-b722-1610cbc83d86 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:20:57.643770 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-2412421a-e483-4daa-a86e-e08887c0c59a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "DELETE /compute/v2.1/servers/3050c41d-6baa-4fe4-b722-1610cbc83d86" status: 404 len: 111 microversion: 2.1 time: 0.032354 Aug 27 03:20:57.643770 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2885/5809] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 03:20:57 2022] DELETE /compute/v2.1/servers/3050c41d-6baa-4fe4-b722-1610cbc83d86 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:20:57.650158 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-1c1bd638-ed40-4881-8557-7c8dc3388664 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:57.650844 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-1c1bd638-ed40-4881-8557-7c8dc3388664 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 3050c41d-6baa-4fe4-b722-1610cbc83d86] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:57.657181 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1c1bd638-ed40-4881-8557-7c8dc3388664 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:57.657722 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1c1bd638-ed40-4881-8557-7c8dc3388664 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:57.658175 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1c1bd638-ed40-4881-8557-7c8dc3388664 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:57.658958 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1c1bd638-ed40-4881-8557-7c8dc3388664 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:57.659451 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1c1bd638-ed40-4881-8557-7c8dc3388664 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:57.659892 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1c1bd638-ed40-4881-8557-7c8dc3388664 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:57.674864 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-1c1bd638-ed40-4881-8557-7c8dc3388664 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] HTTP exception thrown: Instance 3050c41d-6baa-4fe4-b722-1610cbc83d86 could not be found. Aug 27 03:20:57.676612 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-1c1bd638-ed40-4881-8557-7c8dc3388664 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Request method failure captured: Aug 27 03:20:57.676612 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/3050c41d-6baa-4fe4-b722-1610cbc83d86 HTTP/1.1 Aug 27 03:20:57.676612 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 03:20:57.676612 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 03:20:57.676612 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 03:20:57.676612 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 03:20:57.676612 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 03:20:57.676612 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 03:20:57.676612 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 03:20:57.676612 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 03:20:57.676612 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYyanRmSitPtUh4DIDjvAfp5Iiwg8r3Bf9-rjIalvb44wIYhFzVkZDLPIdVwR9rbE-qHDjS_3-JeB9MrxSXFOtiOWUfHFokH2CMOJ34en6s6KyuDM-ix0my9F59eD8M1zowb_BqVFIaTj9p6YHs85SeVo0SCpB1hAOakQSi3_cd8UVk Aug 27 03:20:57.676612 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 03:20:57.676612 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 03:20:57.676612 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 03:20:57.676612 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 03:20:57.676612 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 03:20:57.676612 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 03:20:57.676612 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 7b2673a034c24d1898493bfea9ca5d1d Aug 27 03:20:57.676612 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-TestVolumeBootPattern-2103223700 Aug 27 03:20:57.676612 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 03:20:57.676612 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 03:20:57.676612 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7b2673a034c24d1898493bfea9ca5d1d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_7b2673a034c24d1898493bfea9ca5d1d", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7b2673a034c24d1898493bfea9ca5d1d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/7b2673a034c24d1898493bfea9ca5d1d"}]}] Aug 27 03:20:57.676612 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-TestVolumeBootPattern-2103223700 Aug 27 03:20:57.676612 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 7b2673a034c24d1898493bfea9ca5d1d Aug 27 03:20:57.676612 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-TestVolumeBootPattern-2103223700 Aug 27 03:20:57.676612 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-TestVolumeBootPattern-2103223700-project Aug 27 03:20:57.676612 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 03:20:57.676612 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 03:20:57.676612 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 4aa867d7baa043b1b1e6763046463b3f Aug 27 03:20:57.676612 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-TestVolumeBootPattern-2103223700-project Aug 27 03:20:57.676612 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 03:20:57.676612 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance 3050c41d-6baa-4fe4-b722-1610cbc83d86 could not be found. Aug 27 03:20:57.676612 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '3050c41d-6baa-4fe4-b722-1610cbc83d86'} Aug 27 03:20:57.676612 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:20:57.676612 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:20:57.676612 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:20:57.676612 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:20:57.676612 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:20:57.676612 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:20:57.676612 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:20:57.676612 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:20:57.676612 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:20:57.676612 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:20:57.676612 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3050c41d-6baa-4fe4-b722-1610cbc83d86 could not be found. Aug 27 03:20:57.676612 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:20:57.676612 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:20:57.676612 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:20:57.676612 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:20:57.676612 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:20:57.676612 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:20:57.676612 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:20:57.676612 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:20:57.676612 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:20:57.676612 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:20:57.676612 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:20:57.676612 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:20:57.676612 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:20:57.676612 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:20:57.676612 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:20:57.676612 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:20:57.676612 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3050c41d-6baa-4fe4-b722-1610cbc83d86 could not be found. Aug 27 03:20:57.676612 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:20:57.676612 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:20:57.676612 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:20:57.681249 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:20:57.681249 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:20:57.681249 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:20:57.681249 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:20:57.681249 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:20:57.681249 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3050c41d-6baa-4fe4-b722-1610cbc83d86 could not be found. Aug 27 03:20:57.681249 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:20:57.681249 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-1c1bd638-ed40-4881-8557-7c8dc3388664 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Returning 404 to user: Instance 3050c41d-6baa-4fe4-b722-1610cbc83d86 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:20:57.681249 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-1c1bd638-ed40-4881-8557-7c8dc3388664 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/3050c41d-6baa-4fe4-b722-1610cbc83d86" status: 404 len: 111 microversion: 2.1 time: 0.032007 Aug 27 03:20:57.681249 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2925/5810] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:57 2022] GET /compute/v2.1/servers/3050c41d-6baa-4fe4-b722-1610cbc83d86 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:20:57.753726 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-2f4b52b6-2697-4241-8d98-0e9aaf164282 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Action: 'create', calling method: .version_select at 0x7f5ee2dfb0d0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1843061337", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGsLplnLz3IrjF7mU+xtLlyS5N1w0ZnuAurnD2ZnRot+jzsJyaJFQw9p3Ub2OnrOuBaWn4iJQ2jYoL4GEWt2dzTeF4+3a8efuplvX8rqA+JvBSgfgOkTINn59w5ijbN9qw=="}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:20:57.770295 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-2f4b52b6-2697-4241-8d98-0e9aaf164282 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Getting quotas for project 7b2673a034c24d1898493bfea9ca5d1d. Resources: {'key_pairs'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:20:57.776193 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-2f4b52b6-2697-4241-8d98-0e9aaf164282 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Getting quotas for user 4aa867d7baa043b1b1e6763046463b3f and project 7b2673a034c24d1898493bfea9ca5d1d. Resources: {'key_pairs'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:20:57.809108 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-2f4b52b6-2697-4241-8d98-0e9aaf164282 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.060157 Aug 27 03:20:57.809907 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2886/5811] 10.222.0.70 () {60 vars in 1159 bytes} [Sat Aug 27 03:20:57 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:21:15.412748 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a832e5f4-f93d-411f-b6db-bd4babc47ab3 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-96415929", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1843061337", "security_groups": [{"name": "tempest-secgroup-smoke-499842507"}], "block_device_mapping_v2": [{"uuid": "2a82fdae-7f91-455b-b9d7-5232f192870f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "02524c0f-c44c-4ea0-899e-226a790199dc"}]}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:21:15.423261 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:21:15.423955 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:21:15.540742 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.network.neutron [None req-a832e5f4-f93d-411f-b6db-bd4babc47ab3 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] validate_networks() for [('02524c0f-c44c-4ea0-899e-226a790199dc', None, None, None, None, None)] {{(pid=134051) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:21:15.931394 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-a832e5f4-f93d-411f-b6db-bd4babc47ab3 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Flavor limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:21:15.931839 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-a832e5f4-f93d-411f-b6db-bd4babc47ab3 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Image limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:21:15.932403 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-a832e5f4-f93d-411f-b6db-bd4babc47ab3 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Flavor pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:21:15.932778 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-a832e5f4-f93d-411f-b6db-bd4babc47ab3 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Image pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:21:15.933206 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-a832e5f4-f93d-411f-b6db-bd4babc47ab3 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:21:15.942802 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a832e5f4-f93d-411f-b6db-bd4babc47ab3 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:15.943304 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a832e5f4-f93d-411f-b6db-bd4babc47ab3 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:15.943759 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a832e5f4-f93d-411f-b6db-bd4babc47ab3 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:15.944569 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a832e5f4-f93d-411f-b6db-bd4babc47ab3 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:15.945043 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a832e5f4-f93d-411f-b6db-bd4babc47ab3 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:15.945487 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a832e5f4-f93d-411f-b6db-bd4babc47ab3 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:15.964922 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-a832e5f4-f93d-411f-b6db-bd4babc47ab3 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Getting quotas for project 7b2673a034c24d1898493bfea9ca5d1d. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:21:15.972407 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-a832e5f4-f93d-411f-b6db-bd4babc47ab3 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Getting quotas for user 4aa867d7baa043b1b1e6763046463b3f and project 7b2673a034c24d1898493bfea9ca5d1d. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:21:16.033524 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-a832e5f4-f93d-411f-b6db-bd4babc47ab3 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Going to run 1 instances... {{(pid=134051) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:21:16.035747 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-a832e5f4-f93d-411f-b6db-bd4babc47ab3 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 5d82e610-a5cf-4a01-8a02-11b1c1ce9960] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2a82fdae-7f91-455b-b9d7-5232f192870f',volume_size=None,volume_type=None)] {{(pid=134051) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:21:16.186321 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a832e5f4-f93d-411f-b6db-bd4babc47ab3 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.778222 Aug 27 03:21:16.187361 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2926/5812] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 03:21:15 2022] POST /compute/v2.1/servers => generated 405 bytes in 780 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:21:16.196673 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=25 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:21:16.197935 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=4 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:21:16.198750 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:21:16.203977 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9edea317-d00a-42a7-a2eb-f3a1db5c8104 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:16.204908 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-9edea317-d00a-42a7-a2eb-f3a1db5c8104 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 5d82e610-a5cf-4a01-8a02-11b1c1ce9960] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:16.272843 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-9edea317-d00a-42a7-a2eb-f3a1db5c8104 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:16.279845 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9edea317-d00a-42a7-a2eb-f3a1db5c8104 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/5d82e610-a5cf-4a01-8a02-11b1c1ce9960" status: 200 len: 1093 microversion: 2.1 time: 0.085412 Aug 27 03:21:16.280595 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2887/5813] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:16 2022] GET /compute/v2.1/servers/5d82e610-a5cf-4a01-8a02-11b1c1ce9960 => generated 1093 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:17.302338 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c80c8ec4-0caa-407a-b6be-5bf39701799d tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:17.303532 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-c80c8ec4-0caa-407a-b6be-5bf39701799d tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 5d82e610-a5cf-4a01-8a02-11b1c1ce9960] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:17.310046 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c80c8ec4-0caa-407a-b6be-5bf39701799d tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:17.310763 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c80c8ec4-0caa-407a-b6be-5bf39701799d tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:17.311377 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c80c8ec4-0caa-407a-b6be-5bf39701799d tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:17.312293 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c80c8ec4-0caa-407a-b6be-5bf39701799d tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:17.312962 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c80c8ec4-0caa-407a-b6be-5bf39701799d tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:17.313564 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c80c8ec4-0caa-407a-b6be-5bf39701799d tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:17.401138 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-c80c8ec4-0caa-407a-b6be-5bf39701799d tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:17.418350 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c80c8ec4-0caa-407a-b6be-5bf39701799d tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/5d82e610-a5cf-4a01-8a02-11b1c1ce9960" status: 200 len: 1199 microversion: 2.1 time: 0.121664 Aug 27 03:21:17.419898 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2927/5814] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:17 2022] GET /compute/v2.1/servers/5d82e610-a5cf-4a01-8a02-11b1c1ce9960 => generated 1199 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:18.440385 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ae1e4f2c-6af4-4bae-9beb-f074d1a718f8 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:18.441975 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-ae1e4f2c-6af4-4bae-9beb-f074d1a718f8 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 5d82e610-a5cf-4a01-8a02-11b1c1ce9960] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:18.449353 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ae1e4f2c-6af4-4bae-9beb-f074d1a718f8 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:18.450098 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ae1e4f2c-6af4-4bae-9beb-f074d1a718f8 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:18.450691 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ae1e4f2c-6af4-4bae-9beb-f074d1a718f8 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:18.451577 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ae1e4f2c-6af4-4bae-9beb-f074d1a718f8 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:18.452180 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ae1e4f2c-6af4-4bae-9beb-f074d1a718f8 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:18.452793 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ae1e4f2c-6af4-4bae-9beb-f074d1a718f8 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:18.750865 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-ae1e4f2c-6af4-4bae-9beb-f074d1a718f8 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:18.760572 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ae1e4f2c-6af4-4bae-9beb-f074d1a718f8 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/5d82e610-a5cf-4a01-8a02-11b1c1ce9960" status: 200 len: 1276 microversion: 2.1 time: 0.324379 Aug 27 03:21:18.762059 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2888/5815] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:18 2022] GET /compute/v2.1/servers/5d82e610-a5cf-4a01-8a02-11b1c1ce9960 => generated 1276 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:19.077361 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-04609e4d-5626-4153-980d-74f16a3f77b4 req-5ad75fa3-3c64-4271-8eaf-722f7bf81449 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d82e610-a5cf-4a01-8a02-11b1c1ce9960", "tag": "b3c62468-8c7b-41f2-aa5f-921725ac63ad"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:21:19.104438 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-04609e4d-5626-4153-980d-74f16a3f77b4 req-5ad75fa3-3c64-4271-8eaf-722f7bf81449 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:19.105379 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-04609e4d-5626-4153-980d-74f16a3f77b4 req-5ad75fa3-3c64-4271-8eaf-722f7bf81449 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:19.106115 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-04609e4d-5626-4153-980d-74f16a3f77b4 req-5ad75fa3-3c64-4271-8eaf-722f7bf81449 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:19.121073 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-04609e4d-5626-4153-980d-74f16a3f77b4 req-5ad75fa3-3c64-4271-8eaf-722f7bf81449 service nova] Creating event network-changed:b3c62468-8c7b-41f2-aa5f-921725ac63ad for instance 5d82e610-a5cf-4a01-8a02-11b1c1ce9960 on n-h2-852278-4 Aug 27 03:21:19.128166 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-04609e4d-5626-4153-980d-74f16a3f77b4 req-5ad75fa3-3c64-4271-8eaf-722f7bf81449 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058443 Aug 27 03:21:19.129494 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2928/5816] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:21:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:21:19.782504 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ca9ebd6b-e5fe-4947-8ddd-c00ea11cdbe4 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:19.783123 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-ca9ebd6b-e5fe-4947-8ddd-c00ea11cdbe4 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 5d82e610-a5cf-4a01-8a02-11b1c1ce9960] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:19.791634 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ca9ebd6b-e5fe-4947-8ddd-c00ea11cdbe4 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:19.792570 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ca9ebd6b-e5fe-4947-8ddd-c00ea11cdbe4 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:19.793011 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ca9ebd6b-e5fe-4947-8ddd-c00ea11cdbe4 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:19.793740 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ca9ebd6b-e5fe-4947-8ddd-c00ea11cdbe4 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:19.794291 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ca9ebd6b-e5fe-4947-8ddd-c00ea11cdbe4 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:19.794643 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ca9ebd6b-e5fe-4947-8ddd-c00ea11cdbe4 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:20.379856 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-ca9ebd6b-e5fe-4947-8ddd-c00ea11cdbe4 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:20.398171 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ca9ebd6b-e5fe-4947-8ddd-c00ea11cdbe4 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/5d82e610-a5cf-4a01-8a02-11b1c1ce9960" status: 200 len: 1276 microversion: 2.1 time: 0.619791 Aug 27 03:21:20.402955 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2889/5817] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:19 2022] GET /compute/v2.1/servers/5d82e610-a5cf-4a01-8a02-11b1c1ce9960 => generated 1276 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:21.424795 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b58ca1f8-9b77-4d47-86b4-7eaea9b38afc tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:21.425477 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b58ca1f8-9b77-4d47-86b4-7eaea9b38afc tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 5d82e610-a5cf-4a01-8a02-11b1c1ce9960] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:21.432415 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b58ca1f8-9b77-4d47-86b4-7eaea9b38afc tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:21.432919 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b58ca1f8-9b77-4d47-86b4-7eaea9b38afc tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:21.433364 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b58ca1f8-9b77-4d47-86b4-7eaea9b38afc tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:21.434067 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b58ca1f8-9b77-4d47-86b4-7eaea9b38afc tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:21.434502 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b58ca1f8-9b77-4d47-86b4-7eaea9b38afc tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:21.434950 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b58ca1f8-9b77-4d47-86b4-7eaea9b38afc tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:21.577058 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-b58ca1f8-9b77-4d47-86b4-7eaea9b38afc tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:21.585831 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b58ca1f8-9b77-4d47-86b4-7eaea9b38afc tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/5d82e610-a5cf-4a01-8a02-11b1c1ce9960" status: 200 len: 1276 microversion: 2.1 time: 0.166125 Aug 27 03:21:21.586444 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2929/5818] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:21 2022] GET /compute/v2.1/servers/5d82e610-a5cf-4a01-8a02-11b1c1ce9960 => generated 1276 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:22.609553 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-fcc31339-dd85-4530-a78f-55274c6ce232 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:22.610154 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-fcc31339-dd85-4530-a78f-55274c6ce232 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 5d82e610-a5cf-4a01-8a02-11b1c1ce9960] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:22.617775 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fcc31339-dd85-4530-a78f-55274c6ce232 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:22.618264 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fcc31339-dd85-4530-a78f-55274c6ce232 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:22.618695 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fcc31339-dd85-4530-a78f-55274c6ce232 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:22.619396 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fcc31339-dd85-4530-a78f-55274c6ce232 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:22.619865 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fcc31339-dd85-4530-a78f-55274c6ce232 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:22.620285 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fcc31339-dd85-4530-a78f-55274c6ce232 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:22.766835 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-fcc31339-dd85-4530-a78f-55274c6ce232 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:22.778902 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-fcc31339-dd85-4530-a78f-55274c6ce232 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/5d82e610-a5cf-4a01-8a02-11b1c1ce9960" status: 200 len: 1276 microversion: 2.1 time: 0.174939 Aug 27 03:21:22.781034 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2890/5819] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:22 2022] GET /compute/v2.1/servers/5d82e610-a5cf-4a01-8a02-11b1c1ce9960 => generated 1276 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:21:23.801578 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-76a22f25-fb5d-428e-bc54-71236e98aee1 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:23.802149 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-76a22f25-fb5d-428e-bc54-71236e98aee1 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 5d82e610-a5cf-4a01-8a02-11b1c1ce9960] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:23.810359 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-76a22f25-fb5d-428e-bc54-71236e98aee1 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:23.810835 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-76a22f25-fb5d-428e-bc54-71236e98aee1 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:23.811522 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-76a22f25-fb5d-428e-bc54-71236e98aee1 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:23.812275 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-76a22f25-fb5d-428e-bc54-71236e98aee1 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:23.812753 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-76a22f25-fb5d-428e-bc54-71236e98aee1 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:23.813236 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-76a22f25-fb5d-428e-bc54-71236e98aee1 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:23.956834 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-76a22f25-fb5d-428e-bc54-71236e98aee1 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:23.965498 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-76a22f25-fb5d-428e-bc54-71236e98aee1 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/5d82e610-a5cf-4a01-8a02-11b1c1ce9960" status: 200 len: 1264 microversion: 2.1 time: 0.167923 Aug 27 03:21:23.966106 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2930/5820] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:23 2022] GET /compute/v2.1/servers/5d82e610-a5cf-4a01-8a02-11b1c1ce9960 => generated 1264 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:24.986067 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ee208286-e816-4407-aacf-15f5ddedef14 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:24.986670 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-ee208286-e816-4407-aacf-15f5ddedef14 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 5d82e610-a5cf-4a01-8a02-11b1c1ce9960] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:24.996824 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ee208286-e816-4407-aacf-15f5ddedef14 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:24.997313 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ee208286-e816-4407-aacf-15f5ddedef14 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:24.997744 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ee208286-e816-4407-aacf-15f5ddedef14 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:24.998455 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ee208286-e816-4407-aacf-15f5ddedef14 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:24.998903 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ee208286-e816-4407-aacf-15f5ddedef14 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:24.999320 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ee208286-e816-4407-aacf-15f5ddedef14 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:25.134756 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-ee208286-e816-4407-aacf-15f5ddedef14 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:25.143195 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ee208286-e816-4407-aacf-15f5ddedef14 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/5d82e610-a5cf-4a01-8a02-11b1c1ce9960" status: 200 len: 1264 microversion: 2.1 time: 0.161044 Aug 27 03:21:25.143870 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2891/5821] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:24 2022] GET /compute/v2.1/servers/5d82e610-a5cf-4a01-8a02-11b1c1ce9960 => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:26.164152 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-75bd1d69-b050-458b-ad9c-2d562fb4cbde tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:26.164823 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-75bd1d69-b050-458b-ad9c-2d562fb4cbde tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 5d82e610-a5cf-4a01-8a02-11b1c1ce9960] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:26.167782 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:21:26.168506 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=6 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:21:26.174497 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-75bd1d69-b050-458b-ad9c-2d562fb4cbde tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:26.174996 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-75bd1d69-b050-458b-ad9c-2d562fb4cbde tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:26.175454 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-75bd1d69-b050-458b-ad9c-2d562fb4cbde tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:26.176175 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-75bd1d69-b050-458b-ad9c-2d562fb4cbde tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:26.176728 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-75bd1d69-b050-458b-ad9c-2d562fb4cbde tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:26.177127 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-75bd1d69-b050-458b-ad9c-2d562fb4cbde tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:26.311225 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-75bd1d69-b050-458b-ad9c-2d562fb4cbde tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:26.319866 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-75bd1d69-b050-458b-ad9c-2d562fb4cbde tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/5d82e610-a5cf-4a01-8a02-11b1c1ce9960" status: 200 len: 1264 microversion: 2.1 time: 0.159971 Aug 27 03:21:26.320467 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2931/5822] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:26 2022] GET /compute/v2.1/servers/5d82e610-a5cf-4a01-8a02-11b1c1ce9960 => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:27.341291 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8f3fcc0d-f7ca-4103-9e14-cc9bd93fa32a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:27.341908 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-8f3fcc0d-f7ca-4103-9e14-cc9bd93fa32a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 5d82e610-a5cf-4a01-8a02-11b1c1ce9960] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:27.344728 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:21:27.350684 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8f3fcc0d-f7ca-4103-9e14-cc9bd93fa32a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:27.351476 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8f3fcc0d-f7ca-4103-9e14-cc9bd93fa32a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:27.352157 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8f3fcc0d-f7ca-4103-9e14-cc9bd93fa32a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:27.352952 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8f3fcc0d-f7ca-4103-9e14-cc9bd93fa32a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:27.353544 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8f3fcc0d-f7ca-4103-9e14-cc9bd93fa32a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:27.354119 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8f3fcc0d-f7ca-4103-9e14-cc9bd93fa32a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:27.497654 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-8f3fcc0d-f7ca-4103-9e14-cc9bd93fa32a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:27.506031 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-8f3fcc0d-f7ca-4103-9e14-cc9bd93fa32a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/5d82e610-a5cf-4a01-8a02-11b1c1ce9960" status: 200 len: 1264 microversion: 2.1 time: 0.168583 Aug 27 03:21:27.507182 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2892/5823] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:27 2022] GET /compute/v2.1/servers/5d82e610-a5cf-4a01-8a02-11b1c1ce9960 => generated 1264 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:28.527612 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-db2be68a-6984-44b8-b280-8582f7ccca54 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:28.528208 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-db2be68a-6984-44b8-b280-8582f7ccca54 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 5d82e610-a5cf-4a01-8a02-11b1c1ce9960] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:28.535710 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-db2be68a-6984-44b8-b280-8582f7ccca54 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:28.536228 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-db2be68a-6984-44b8-b280-8582f7ccca54 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:28.536749 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-db2be68a-6984-44b8-b280-8582f7ccca54 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:28.537561 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-db2be68a-6984-44b8-b280-8582f7ccca54 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:28.538035 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-db2be68a-6984-44b8-b280-8582f7ccca54 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:28.538477 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-db2be68a-6984-44b8-b280-8582f7ccca54 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:28.676467 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-db2be68a-6984-44b8-b280-8582f7ccca54 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:28.685009 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-db2be68a-6984-44b8-b280-8582f7ccca54 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/5d82e610-a5cf-4a01-8a02-11b1c1ce9960" status: 200 len: 1264 microversion: 2.1 time: 0.161258 Aug 27 03:21:28.685638 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2932/5824] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:28 2022] GET /compute/v2.1/servers/5d82e610-a5cf-4a01-8a02-11b1c1ce9960 => generated 1264 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:29.706331 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-51775c92-dab4-4042-bfda-ae4c1ba0469f tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:29.706925 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-51775c92-dab4-4042-bfda-ae4c1ba0469f tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 5d82e610-a5cf-4a01-8a02-11b1c1ce9960] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:29.714395 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-51775c92-dab4-4042-bfda-ae4c1ba0469f tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:29.714876 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-51775c92-dab4-4042-bfda-ae4c1ba0469f tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:29.715304 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-51775c92-dab4-4042-bfda-ae4c1ba0469f tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:29.715991 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-51775c92-dab4-4042-bfda-ae4c1ba0469f tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:29.716479 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-51775c92-dab4-4042-bfda-ae4c1ba0469f tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:29.716895 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-51775c92-dab4-4042-bfda-ae4c1ba0469f tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:29.858092 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-51775c92-dab4-4042-bfda-ae4c1ba0469f tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:29.867317 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-51775c92-dab4-4042-bfda-ae4c1ba0469f tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/5d82e610-a5cf-4a01-8a02-11b1c1ce9960" status: 200 len: 1264 microversion: 2.1 time: 0.165122 Aug 27 03:21:29.868008 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2893/5825] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:29 2022] GET /compute/v2.1/servers/5d82e610-a5cf-4a01-8a02-11b1c1ce9960 => generated 1264 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:30.892017 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4d0e4cdc-b544-41eb-874f-da27acc8d98e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:30.892695 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-4d0e4cdc-b544-41eb-874f-da27acc8d98e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 5d82e610-a5cf-4a01-8a02-11b1c1ce9960] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:30.900702 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4d0e4cdc-b544-41eb-874f-da27acc8d98e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:30.901471 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4d0e4cdc-b544-41eb-874f-da27acc8d98e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:30.902021 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4d0e4cdc-b544-41eb-874f-da27acc8d98e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:30.902718 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4d0e4cdc-b544-41eb-874f-da27acc8d98e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:30.903170 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4d0e4cdc-b544-41eb-874f-da27acc8d98e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:30.903589 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4d0e4cdc-b544-41eb-874f-da27acc8d98e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:31.051791 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-4d0e4cdc-b544-41eb-874f-da27acc8d98e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:31.060586 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-4d0e4cdc-b544-41eb-874f-da27acc8d98e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/5d82e610-a5cf-4a01-8a02-11b1c1ce9960" status: 200 len: 1264 microversion: 2.1 time: 0.176905 Aug 27 03:21:31.068547 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2933/5826] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:30 2022] GET /compute/v2.1/servers/5d82e610-a5cf-4a01-8a02-11b1c1ce9960 => generated 1264 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:32.081662 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-1ce056c0-2a89-4fbb-870c-9c5129c5d5ae tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:32.082585 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-1ce056c0-2a89-4fbb-870c-9c5129c5d5ae tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 5d82e610-a5cf-4a01-8a02-11b1c1ce9960] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:32.090180 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1ce056c0-2a89-4fbb-870c-9c5129c5d5ae tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:32.090907 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1ce056c0-2a89-4fbb-870c-9c5129c5d5ae tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:32.091425 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1ce056c0-2a89-4fbb-870c-9c5129c5d5ae tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:32.092290 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1ce056c0-2a89-4fbb-870c-9c5129c5d5ae tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:32.093043 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1ce056c0-2a89-4fbb-870c-9c5129c5d5ae tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:32.093525 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1ce056c0-2a89-4fbb-870c-9c5129c5d5ae tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:32.243412 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-1ce056c0-2a89-4fbb-870c-9c5129c5d5ae tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:32.253251 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-1ce056c0-2a89-4fbb-870c-9c5129c5d5ae tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/5d82e610-a5cf-4a01-8a02-11b1c1ce9960" status: 200 len: 1264 microversion: 2.1 time: 0.175788 Aug 27 03:21:32.253965 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2894/5827] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:32 2022] GET /compute/v2.1/servers/5d82e610-a5cf-4a01-8a02-11b1c1ce9960 => generated 1264 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:33.274307 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-afb29cbe-5805-42b5-8cb8-fcc1189ceffe tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:33.274993 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-afb29cbe-5805-42b5-8cb8-fcc1189ceffe tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 5d82e610-a5cf-4a01-8a02-11b1c1ce9960] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:33.282251 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-afb29cbe-5805-42b5-8cb8-fcc1189ceffe tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:33.282680 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-afb29cbe-5805-42b5-8cb8-fcc1189ceffe tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:33.283158 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-afb29cbe-5805-42b5-8cb8-fcc1189ceffe tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:33.284120 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-afb29cbe-5805-42b5-8cb8-fcc1189ceffe tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:33.284700 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-afb29cbe-5805-42b5-8cb8-fcc1189ceffe tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:33.285140 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-afb29cbe-5805-42b5-8cb8-fcc1189ceffe tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:33.422845 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-afb29cbe-5805-42b5-8cb8-fcc1189ceffe tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:33.430789 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-afb29cbe-5805-42b5-8cb8-fcc1189ceffe tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/5d82e610-a5cf-4a01-8a02-11b1c1ce9960" status: 200 len: 1264 microversion: 2.1 time: 0.160650 Aug 27 03:21:33.431379 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2934/5828] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:33 2022] GET /compute/v2.1/servers/5d82e610-a5cf-4a01-8a02-11b1c1ce9960 => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:33.889207 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-9fc1e196-f253-49c9-b33b-bd4c4d8274b8 req-320bc8ea-88de-4551-b1b5-aefacffc8845 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d82e610-a5cf-4a01-8a02-11b1c1ce9960", "name": "network-vif-plugged", "status": "completed", "tag": "b3c62468-8c7b-41f2-aa5f-921725ac63ad"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:21:33.900349 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-9fc1e196-f253-49c9-b33b-bd4c4d8274b8 req-320bc8ea-88de-4551-b1b5-aefacffc8845 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:33.900883 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-9fc1e196-f253-49c9-b33b-bd4c4d8274b8 req-320bc8ea-88de-4551-b1b5-aefacffc8845 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:33.901402 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-9fc1e196-f253-49c9-b33b-bd4c4d8274b8 req-320bc8ea-88de-4551-b1b5-aefacffc8845 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:33.912824 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-9fc1e196-f253-49c9-b33b-bd4c4d8274b8 req-320bc8ea-88de-4551-b1b5-aefacffc8845 service nova] Creating event network-vif-plugged:b3c62468-8c7b-41f2-aa5f-921725ac63ad for instance 5d82e610-a5cf-4a01-8a02-11b1c1ce9960 on n-h2-852278-4 Aug 27 03:21:33.918946 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-9fc1e196-f253-49c9-b33b-bd4c4d8274b8 req-320bc8ea-88de-4551-b1b5-aefacffc8845 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109905 Aug 27 03:21:33.919753 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2895/5829] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:21:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:21:34.452025 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-64691811-fee0-4c92-8c51-1da952429308 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:34.452617 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-64691811-fee0-4c92-8c51-1da952429308 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 5d82e610-a5cf-4a01-8a02-11b1c1ce9960] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:34.460005 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-64691811-fee0-4c92-8c51-1da952429308 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:34.460542 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-64691811-fee0-4c92-8c51-1da952429308 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:34.460998 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-64691811-fee0-4c92-8c51-1da952429308 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:34.461696 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-64691811-fee0-4c92-8c51-1da952429308 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:34.462197 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-64691811-fee0-4c92-8c51-1da952429308 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:34.462629 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-64691811-fee0-4c92-8c51-1da952429308 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:34.607378 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-64691811-fee0-4c92-8c51-1da952429308 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:34.615615 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-64691811-fee0-4c92-8c51-1da952429308 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/5d82e610-a5cf-4a01-8a02-11b1c1ce9960" status: 200 len: 1264 microversion: 2.1 time: 0.167732 Aug 27 03:21:34.616767 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2935/5830] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:34 2022] GET /compute/v2.1/servers/5d82e610-a5cf-4a01-8a02-11b1c1ce9960 => generated 1264 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:35.640053 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-80990ffc-c85e-48f5-a9f1-b1792606f908 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:35.640789 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-80990ffc-c85e-48f5-a9f1-b1792606f908 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 5d82e610-a5cf-4a01-8a02-11b1c1ce9960] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:35.649707 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-80990ffc-c85e-48f5-a9f1-b1792606f908 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:35.650285 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-80990ffc-c85e-48f5-a9f1-b1792606f908 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:35.650785 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-80990ffc-c85e-48f5-a9f1-b1792606f908 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:35.651556 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-80990ffc-c85e-48f5-a9f1-b1792606f908 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:35.652098 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-80990ffc-c85e-48f5-a9f1-b1792606f908 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:35.652610 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-80990ffc-c85e-48f5-a9f1-b1792606f908 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:35.791639 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-80990ffc-c85e-48f5-a9f1-b1792606f908 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:35.799677 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-80990ffc-c85e-48f5-a9f1-b1792606f908 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/5d82e610-a5cf-4a01-8a02-11b1c1ce9960" status: 200 len: 1452 microversion: 2.1 time: 0.165771 Aug 27 03:21:35.800259 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2896/5831] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:35 2022] GET /compute/v2.1/servers/5d82e610-a5cf-4a01-8a02-11b1c1ce9960 => generated 1452 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:35.820569 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-5f47a52d-f555-4212-830b-4167aa627460 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:35.821230 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-5f47a52d-f555-4212-830b-4167aa627460 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 5d82e610-a5cf-4a01-8a02-11b1c1ce9960] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:35.828584 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5f47a52d-f555-4212-830b-4167aa627460 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:35.832346 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5f47a52d-f555-4212-830b-4167aa627460 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:35.832844 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5f47a52d-f555-4212-830b-4167aa627460 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:35.833534 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5f47a52d-f555-4212-830b-4167aa627460 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:35.834193 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5f47a52d-f555-4212-830b-4167aa627460 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:35.834665 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5f47a52d-f555-4212-830b-4167aa627460 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:35.977148 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-5f47a52d-f555-4212-830b-4167aa627460 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:35.985588 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-5f47a52d-f555-4212-830b-4167aa627460 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/5d82e610-a5cf-4a01-8a02-11b1c1ce9960" status: 200 len: 1452 microversion: 2.1 time: 0.169186 Aug 27 03:21:35.986422 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2936/5832] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:35 2022] GET /compute/v2.1/servers/5d82e610-a5cf-4a01-8a02-11b1c1ce9960 => generated 1452 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:38.001335 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-c40dd74b-3480-4ea7-8082-52fca740661d req-4e349870-fa70-4e79-b545-222f790a1a71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d82e610-a5cf-4a01-8a02-11b1c1ce9960", "tag": "b3c62468-8c7b-41f2-aa5f-921725ac63ad"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:21:38.011944 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-c40dd74b-3480-4ea7-8082-52fca740661d req-4e349870-fa70-4e79-b545-222f790a1a71 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:38.012471 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-c40dd74b-3480-4ea7-8082-52fca740661d req-4e349870-fa70-4e79-b545-222f790a1a71 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:38.013080 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-c40dd74b-3480-4ea7-8082-52fca740661d req-4e349870-fa70-4e79-b545-222f790a1a71 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:38.025056 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-c40dd74b-3480-4ea7-8082-52fca740661d req-4e349870-fa70-4e79-b545-222f790a1a71 service nova] Creating event network-changed:b3c62468-8c7b-41f2-aa5f-921725ac63ad for instance 5d82e610-a5cf-4a01-8a02-11b1c1ce9960 on n-h2-852278-4 Aug 27 03:21:38.031925 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-c40dd74b-3480-4ea7-8082-52fca740661d req-4e349870-fa70-4e79-b545-222f790a1a71 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033797 Aug 27 03:21:38.033114 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2897/5833] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:21:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:23:23.790444 n-d-852278-4 devstack@n-api.service[134051]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f9fac4be-af37-4094-9325-9fb8d6a54e45] AMQP server on 10.222.0.70:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 03:23:23.791309 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:23:23.792073 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=58 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:23:23.793410 n-d-852278-4 devstack@n-api.service[134051]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:23:23.793554 n-d-852278-4 devstack@n-api.service[134051]: Sat Aug 27 03:23:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.70) !!! Aug 27 03:23:23.980548 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a872fcc3-0200-461d-a931-fbb858992db2 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Action: 'create', calling method: .version_select at 0x7f5eddab8ca0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-300386274", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBB7acYNMry2LQ0Tt+Xl9Xo2DGf5prhXI5Qe5C7W029HrWT29/mtS4r85Rblmv0KPNCoJMVm9mmfPDEJAH/XUaZtUnZk6MsGcrM3XhGvZ+AyCmR1Jco8e5NCA5obC7DOOQ=="}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:23:23.998464 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-a872fcc3-0200-461d-a931-fbb858992db2 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Getting quotas for project 659b0cee2ff841049f41c7ce12609fc8. Resources: {'key_pairs'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:23:24.004811 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-a872fcc3-0200-461d-a931-fbb858992db2 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Getting quotas for user 36e9eab0eb7c421fa50b90e270847365 and project 659b0cee2ff841049f41c7ce12609fc8. Resources: {'key_pairs'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:23:24.036143 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a872fcc3-0200-461d-a931-fbb858992db2 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.247833 Aug 27 03:23:24.036691 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2937/5834] 10.222.0.70 () {60 vars in 1159 bytes} [Sat Aug 27 03:23:23 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:23:30.015418 n-d-852278-4 devstack@n-api.service[134052]: ERROR oslo.messaging._drivers.impl_rabbit [-] [998cde6e-8682-4408-bcc9-d1ac55bd7468] AMQP server on 10.222.0.70:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 27 03:23:30.016748 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=24 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:23:30.017502 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=52 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:23:30.018316 n-d-852278-4 devstack@n-api.service[134052]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:23:30.018541 n-d-852278-4 devstack@n-api.service[134052]: Sat Aug 27 03:23:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.70) !!! Aug 27 03:23:30.025189 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3955f090-0bc3-4c9c-b9b4-14e6c535c3ab tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-773829451", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "networks": [{"uuid": "44094200-1ee6-4b71-b3f6-2a78f190def8"}], "key_name": "tempest-TestNetworkAdvancedServerOps-300386274", "security_groups": [{"name": "tempest-secgroup-smoke-953975574"}]}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:23:30.149379 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.network.neutron [None req-3955f090-0bc3-4c9c-b9b4-14e6c535c3ab tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] validate_networks() for [('44094200-1ee6-4b71-b3f6-2a78f190def8', None, None, None, None, None)] {{(pid=134052) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:23:30.624598 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-3955f090-0bc3-4c9c-b9b4-14e6c535c3ab tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Flavor limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:23:30.625288 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-3955f090-0bc3-4c9c-b9b4-14e6c535c3ab tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Image limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:23:30.625843 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-3955f090-0bc3-4c9c-b9b4-14e6c535c3ab tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Flavor pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:23:30.626315 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-3955f090-0bc3-4c9c-b9b4-14e6c535c3ab tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Image pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:23:30.626797 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-3955f090-0bc3-4c9c-b9b4-14e6c535c3ab tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:23:30.638117 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3955f090-0bc3-4c9c-b9b4-14e6c535c3ab tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:30.638726 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3955f090-0bc3-4c9c-b9b4-14e6c535c3ab tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:30.639399 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3955f090-0bc3-4c9c-b9b4-14e6c535c3ab tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:30.640222 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3955f090-0bc3-4c9c-b9b4-14e6c535c3ab tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:30.640709 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3955f090-0bc3-4c9c-b9b4-14e6c535c3ab tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:30.641133 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3955f090-0bc3-4c9c-b9b4-14e6c535c3ab tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:30.659255 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-3955f090-0bc3-4c9c-b9b4-14e6c535c3ab tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Getting quotas for project 659b0cee2ff841049f41c7ce12609fc8. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:23:30.665099 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-3955f090-0bc3-4c9c-b9b4-14e6c535c3ab tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Getting quotas for user 36e9eab0eb7c421fa50b90e270847365 and project 659b0cee2ff841049f41c7ce12609fc8. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:23:30.678187 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-3955f090-0bc3-4c9c-b9b4-14e6c535c3ab tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Going to run 1 instances... {{(pid=134052) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:23:30.681001 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-3955f090-0bc3-4c9c-b9b4-14e6c535c3ab tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 0489a6fa-1b33-4960-aff1-8e365ad4c996] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134052) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:23:30.732008 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-3955f090-0bc3-4c9c-b9b4-14e6c535c3ab tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.718509 Aug 27 03:23:30.732723 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2898/5835] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 03:23:30 2022] POST /compute/v2.1/servers => generated 405 bytes in 720 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:23:30.746506 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-830ec83c-29b7-4e10-9c22-53be31ed09cf tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:30.747732 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-830ec83c-29b7-4e10-9c22-53be31ed09cf tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 0489a6fa-1b33-4960-aff1-8e365ad4c996] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:23:30.767915 n-d-852278-4 devstack@n-api.service[134051]: INFO oslo.messaging._drivers.impl_rabbit [-] [f9fac4be-af37-4094-9325-9fb8d6a54e45] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 52690. Aug 27 03:23:30.828394 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-830ec83c-29b7-4e10-9c22-53be31ed09cf tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:30.837076 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-830ec83c-29b7-4e10-9c22-53be31ed09cf tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/0489a6fa-1b33-4960-aff1-8e365ad4c996" status: 200 len: 1265 microversion: 2.1 time: 0.097176 Aug 27 03:23:30.838075 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2938/5836] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:23:30 2022] GET /compute/v2.1/servers/0489a6fa-1b33-4960-aff1-8e365ad4c996 => generated 1265 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:23:31.861225 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f07ff1ae-a3f4-4fcf-83c9-5bd85be41b45 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:31.861871 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-f07ff1ae-a3f4-4fcf-83c9-5bd85be41b45 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 0489a6fa-1b33-4960-aff1-8e365ad4c996] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:23:31.871290 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f07ff1ae-a3f4-4fcf-83c9-5bd85be41b45 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:31.871789 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f07ff1ae-a3f4-4fcf-83c9-5bd85be41b45 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:31.872242 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f07ff1ae-a3f4-4fcf-83c9-5bd85be41b45 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:31.872995 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f07ff1ae-a3f4-4fcf-83c9-5bd85be41b45 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:31.873455 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f07ff1ae-a3f4-4fcf-83c9-5bd85be41b45 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:31.873889 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f07ff1ae-a3f4-4fcf-83c9-5bd85be41b45 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:31.879828 n-d-852278-4 devstack@n-api.service[134052]: INFO oslo.messaging._drivers.impl_rabbit [-] [998cde6e-8682-4408-bcc9-d1ac55bd7468] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 52704. Aug 27 03:23:31.968515 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-f07ff1ae-a3f4-4fcf-83c9-5bd85be41b45 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:31.976646 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f07ff1ae-a3f4-4fcf-83c9-5bd85be41b45 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/0489a6fa-1b33-4960-aff1-8e365ad4c996" status: 200 len: 1317 microversion: 2.1 time: 0.122000 Aug 27 03:23:31.977237 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2899/5837] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:23:31 2022] GET /compute/v2.1/servers/0489a6fa-1b33-4960-aff1-8e365ad4c996 => generated 1317 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:23:32.998872 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-5f39b2f4-ff81-4726-a98f-3122b0dfb721 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:32.999794 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-5f39b2f4-ff81-4726-a98f-3122b0dfb721 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 0489a6fa-1b33-4960-aff1-8e365ad4c996] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:23:33.011829 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5f39b2f4-ff81-4726-a98f-3122b0dfb721 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:33.012364 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5f39b2f4-ff81-4726-a98f-3122b0dfb721 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:33.012829 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5f39b2f4-ff81-4726-a98f-3122b0dfb721 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:33.013561 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5f39b2f4-ff81-4726-a98f-3122b0dfb721 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:33.014204 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5f39b2f4-ff81-4726-a98f-3122b0dfb721 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:33.014644 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5f39b2f4-ff81-4726-a98f-3122b0dfb721 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:33.196972 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-5f39b2f4-ff81-4726-a98f-3122b0dfb721 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:33.209472 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-5f39b2f4-ff81-4726-a98f-3122b0dfb721 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/0489a6fa-1b33-4960-aff1-8e365ad4c996" status: 200 len: 1390 microversion: 2.1 time: 0.215043 Aug 27 03:23:33.210273 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2939/5838] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:23:32 2022] GET /compute/v2.1/servers/0489a6fa-1b33-4960-aff1-8e365ad4c996 => generated 1390 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:23:33.633286 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-b3f97ce2-e4a5-432a-bc45-1177ca0f4a7e req-6ee317a8-7a57-48d0-a6fe-2e7c925eaa04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0489a6fa-1b33-4960-aff1-8e365ad4c996", "tag": "1e7b739d-0500-4bee-8d6f-5ad9f5006661"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:23:33.647387 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-b3f97ce2-e4a5-432a-bc45-1177ca0f4a7e req-6ee317a8-7a57-48d0-a6fe-2e7c925eaa04 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:33.648391 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-b3f97ce2-e4a5-432a-bc45-1177ca0f4a7e req-6ee317a8-7a57-48d0-a6fe-2e7c925eaa04 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:33.649095 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-b3f97ce2-e4a5-432a-bc45-1177ca0f4a7e req-6ee317a8-7a57-48d0-a6fe-2e7c925eaa04 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:33.662962 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-b3f97ce2-e4a5-432a-bc45-1177ca0f4a7e req-6ee317a8-7a57-48d0-a6fe-2e7c925eaa04 service nova] Creating event network-changed:1e7b739d-0500-4bee-8d6f-5ad9f5006661 for instance 0489a6fa-1b33-4960-aff1-8e365ad4c996 on n-h1-852278-4 Aug 27 03:23:33.678323 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-b3f97ce2-e4a5-432a-bc45-1177ca0f4a7e req-6ee317a8-7a57-48d0-a6fe-2e7c925eaa04 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048921 Aug 27 03:23:33.679009 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2900/5839] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:23:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:23:34.233180 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-31370c91-6bcd-4acd-b722-d25c2d8e3115 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:34.233869 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-31370c91-6bcd-4acd-b722-d25c2d8e3115 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 0489a6fa-1b33-4960-aff1-8e365ad4c996] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:23:34.243331 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-31370c91-6bcd-4acd-b722-d25c2d8e3115 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:34.243831 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-31370c91-6bcd-4acd-b722-d25c2d8e3115 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:34.244282 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-31370c91-6bcd-4acd-b722-d25c2d8e3115 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:34.245030 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-31370c91-6bcd-4acd-b722-d25c2d8e3115 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:34.245498 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-31370c91-6bcd-4acd-b722-d25c2d8e3115 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:34.245967 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-31370c91-6bcd-4acd-b722-d25c2d8e3115 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:34.387266 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-31370c91-6bcd-4acd-b722-d25c2d8e3115 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:34.395481 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-31370c91-6bcd-4acd-b722-d25c2d8e3115 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/0489a6fa-1b33-4960-aff1-8e365ad4c996" status: 200 len: 1390 microversion: 2.1 time: 0.167768 Aug 27 03:23:34.396059 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2940/5840] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:23:34 2022] GET /compute/v2.1/servers/0489a6fa-1b33-4960-aff1-8e365ad4c996 => generated 1390 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:23:35.288522 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8c97339d-8565-4b51-a917-f8e7ce2c8f9f tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:35.289169 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-8c97339d-8565-4b51-a917-f8e7ce2c8f9f tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 5d82e610-a5cf-4a01-8a02-11b1c1ce9960] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:23:35.295494 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8c97339d-8565-4b51-a917-f8e7ce2c8f9f tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:35.296006 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8c97339d-8565-4b51-a917-f8e7ce2c8f9f tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:35.296464 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8c97339d-8565-4b51-a917-f8e7ce2c8f9f tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:35.297140 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8c97339d-8565-4b51-a917-f8e7ce2c8f9f tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:35.297583 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8c97339d-8565-4b51-a917-f8e7ce2c8f9f tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:35.297998 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8c97339d-8565-4b51-a917-f8e7ce2c8f9f tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:35.324054 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-8c97339d-8565-4b51-a917-f8e7ce2c8f9f tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 5d82e610-a5cf-4a01-8a02-11b1c1ce9960] Going to try to terminate instance {{(pid=134052) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:23:35.407143 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-8c97339d-8565-4b51-a917-f8e7ce2c8f9f tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "DELETE /compute/v2.1/servers/5d82e610-a5cf-4a01-8a02-11b1c1ce9960" status: 204 len: 0 microversion: 2.1 time: 0.234159 Aug 27 03:23:35.407878 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2901/5841] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 03:23:35 2022] DELETE /compute/v2.1/servers/5d82e610-a5cf-4a01-8a02-11b1c1ce9960 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:23:35.416237 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-2d58cacf-3520-490f-ba94-4b2cdf4672f9 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:35.416857 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-823017b4-7e74-4413-bec5-578d4526200a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:35.417304 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-823017b4-7e74-4413-bec5-578d4526200a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 5d82e610-a5cf-4a01-8a02-11b1c1ce9960] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:23:35.417939 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-2d58cacf-3520-490f-ba94-4b2cdf4672f9 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 0489a6fa-1b33-4960-aff1-8e365ad4c996] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:23:35.423552 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-823017b4-7e74-4413-bec5-578d4526200a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:35.424129 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-823017b4-7e74-4413-bec5-578d4526200a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:35.424611 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-823017b4-7e74-4413-bec5-578d4526200a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:35.425188 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2d58cacf-3520-490f-ba94-4b2cdf4672f9 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:35.425340 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-823017b4-7e74-4413-bec5-578d4526200a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:35.425731 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2d58cacf-3520-490f-ba94-4b2cdf4672f9 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:35.425913 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-823017b4-7e74-4413-bec5-578d4526200a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:35.426147 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2d58cacf-3520-490f-ba94-4b2cdf4672f9 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:35.426301 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-823017b4-7e74-4413-bec5-578d4526200a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:35.427215 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2d58cacf-3520-490f-ba94-4b2cdf4672f9 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:35.427689 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2d58cacf-3520-490f-ba94-4b2cdf4672f9 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:35.428129 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2d58cacf-3520-490f-ba94-4b2cdf4672f9 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:35.626539 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-823017b4-7e74-4413-bec5-578d4526200a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:35.630428 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-2d58cacf-3520-490f-ba94-4b2cdf4672f9 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:35.634832 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-823017b4-7e74-4413-bec5-578d4526200a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/5d82e610-a5cf-4a01-8a02-11b1c1ce9960" status: 200 len: 1577 microversion: 2.1 time: 0.222532 Aug 27 03:23:35.635393 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2902/5842] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:23:35 2022] GET /compute/v2.1/servers/5d82e610-a5cf-4a01-8a02-11b1c1ce9960 => generated 1577 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:23:35.638846 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-2d58cacf-3520-490f-ba94-4b2cdf4672f9 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/0489a6fa-1b33-4960-aff1-8e365ad4c996" status: 200 len: 1390 microversion: 2.1 time: 0.226563 Aug 27 03:23:35.639554 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2941/5843] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:23:35 2022] GET /compute/v2.1/servers/0489a6fa-1b33-4960-aff1-8e365ad4c996 => generated 1390 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:23:36.656666 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-018226cf-477e-4798-bb06-51df3949b1aa tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:36.657265 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-018226cf-477e-4798-bb06-51df3949b1aa tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 5d82e610-a5cf-4a01-8a02-11b1c1ce9960] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:23:36.658971 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-fce522a8-6473-4962-90dd-7cbc52f24870 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:36.659629 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-fce522a8-6473-4962-90dd-7cbc52f24870 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 0489a6fa-1b33-4960-aff1-8e365ad4c996] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:23:36.665233 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-018226cf-477e-4798-bb06-51df3949b1aa tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:36.665764 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-018226cf-477e-4798-bb06-51df3949b1aa tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:36.666281 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-018226cf-477e-4798-bb06-51df3949b1aa tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:36.666996 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-018226cf-477e-4798-bb06-51df3949b1aa tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:36.667142 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fce522a8-6473-4962-90dd-7cbc52f24870 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:36.667448 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-018226cf-477e-4798-bb06-51df3949b1aa tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:36.667594 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fce522a8-6473-4962-90dd-7cbc52f24870 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:36.667859 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-018226cf-477e-4798-bb06-51df3949b1aa tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:36.667966 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fce522a8-6473-4962-90dd-7cbc52f24870 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:36.668702 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fce522a8-6473-4962-90dd-7cbc52f24870 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:36.669165 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fce522a8-6473-4962-90dd-7cbc52f24870 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:36.669602 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fce522a8-6473-4962-90dd-7cbc52f24870 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:36.871614 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-018226cf-477e-4798-bb06-51df3949b1aa tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:36.874913 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-fce522a8-6473-4962-90dd-7cbc52f24870 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:36.879791 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-018226cf-477e-4798-bb06-51df3949b1aa tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/5d82e610-a5cf-4a01-8a02-11b1c1ce9960" status: 200 len: 1577 microversion: 2.1 time: 0.227248 Aug 27 03:23:36.880514 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2903/5844] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:23:36 2022] GET /compute/v2.1/servers/5d82e610-a5cf-4a01-8a02-11b1c1ce9960 => generated 1577 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:23:36.882898 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-fce522a8-6473-4962-90dd-7cbc52f24870 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/0489a6fa-1b33-4960-aff1-8e365ad4c996" status: 200 len: 1390 microversion: 2.1 time: 0.227679 Aug 27 03:23:36.883516 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2942/5845] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:23:36 2022] GET /compute/v2.1/servers/0489a6fa-1b33-4960-aff1-8e365ad4c996 => generated 1390 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:23:37.866313 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-ebbffafd-5d1a-4d95-bcde-c16b1b0c328d req-27e65dcb-81c4-412b-a562-a7734f6acc69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d82e610-a5cf-4a01-8a02-11b1c1ce9960", "name": "network-vif-deleted", "tag": "b3c62468-8c7b-41f2-aa5f-921725ac63ad"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:23:37.876520 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-ebbffafd-5d1a-4d95-bcde-c16b1b0c328d req-27e65dcb-81c4-412b-a562-a7734f6acc69 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:37.877003 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-ebbffafd-5d1a-4d95-bcde-c16b1b0c328d req-27e65dcb-81c4-412b-a562-a7734f6acc69 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:37.877434 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-ebbffafd-5d1a-4d95-bcde-c16b1b0c328d req-27e65dcb-81c4-412b-a562-a7734f6acc69 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:37.904943 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-16c2b81f-dac0-4efb-b0dc-681341a77fc0 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:37.905545 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-16c2b81f-dac0-4efb-b0dc-681341a77fc0 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 5d82e610-a5cf-4a01-8a02-11b1c1ce9960] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:23:37.918425 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-ebbffafd-5d1a-4d95-bcde-c16b1b0c328d req-27e65dcb-81c4-412b-a562-a7734f6acc69 service nova] Creating event network-vif-deleted:b3c62468-8c7b-41f2-aa5f-921725ac63ad for instance 5d82e610-a5cf-4a01-8a02-11b1c1ce9960 on n-h2-852278-4 Aug 27 03:23:37.930494 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-16c2b81f-dac0-4efb-b0dc-681341a77fc0 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:37.930878 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-16c2b81f-dac0-4efb-b0dc-681341a77fc0 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:37.931338 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-16c2b81f-dac0-4efb-b0dc-681341a77fc0 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:37.931908 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-ebbffafd-5d1a-4d95-bcde-c16b1b0c328d req-27e65dcb-81c4-412b-a562-a7734f6acc69 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.157628 Aug 27 03:23:37.932074 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-16c2b81f-dac0-4efb-b0dc-681341a77fc0 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:37.932819 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-16c2b81f-dac0-4efb-b0dc-681341a77fc0 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:37.933453 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-16c2b81f-dac0-4efb-b0dc-681341a77fc0 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:37.935865 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2904/5846] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:23:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:23:37.958599 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ad1f2bf9-cf2d-440b-a026-7a1009e0820c tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:37.958810 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-ad1f2bf9-cf2d-440b-a026-7a1009e0820c tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 0489a6fa-1b33-4960-aff1-8e365ad4c996] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:23:37.971052 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ad1f2bf9-cf2d-440b-a026-7a1009e0820c tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:37.971823 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ad1f2bf9-cf2d-440b-a026-7a1009e0820c tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:37.973818 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ad1f2bf9-cf2d-440b-a026-7a1009e0820c tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:37.978062 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ad1f2bf9-cf2d-440b-a026-7a1009e0820c tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:37.978845 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ad1f2bf9-cf2d-440b-a026-7a1009e0820c tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:37.980221 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ad1f2bf9-cf2d-440b-a026-7a1009e0820c tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:38.043116 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-16c2b81f-dac0-4efb-b0dc-681341a77fc0 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:38.052246 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-16c2b81f-dac0-4efb-b0dc-681341a77fc0 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/5d82e610-a5cf-4a01-8a02-11b1c1ce9960" status: 200 len: 1224 microversion: 2.1 time: 0.152820 Aug 27 03:23:38.053427 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2943/5847] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:23:37 2022] GET /compute/v2.1/servers/5d82e610-a5cf-4a01-8a02-11b1c1ce9960 => generated 1224 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:23:38.213747 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-ad1f2bf9-cf2d-440b-a026-7a1009e0820c tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:38.221888 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ad1f2bf9-cf2d-440b-a026-7a1009e0820c tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/0489a6fa-1b33-4960-aff1-8e365ad4c996" status: 200 len: 1390 microversion: 2.1 time: 0.284670 Aug 27 03:23:38.223080 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2905/5848] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:23:37 2022] GET /compute/v2.1/servers/0489a6fa-1b33-4960-aff1-8e365ad4c996 => generated 1390 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:23:39.074642 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e4441d65-93c7-4712-afb4-3283b21466dc tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:39.075243 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-e4441d65-93c7-4712-afb4-3283b21466dc tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 5d82e610-a5cf-4a01-8a02-11b1c1ce9960] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:23:39.082895 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e4441d65-93c7-4712-afb4-3283b21466dc tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:39.083311 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e4441d65-93c7-4712-afb4-3283b21466dc tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:39.083759 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e4441d65-93c7-4712-afb4-3283b21466dc tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:39.084506 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e4441d65-93c7-4712-afb4-3283b21466dc tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:39.084967 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e4441d65-93c7-4712-afb4-3283b21466dc tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:39.085431 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e4441d65-93c7-4712-afb4-3283b21466dc tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:39.148833 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e4441d65-93c7-4712-afb4-3283b21466dc tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:39.157006 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e4441d65-93c7-4712-afb4-3283b21466dc tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/5d82e610-a5cf-4a01-8a02-11b1c1ce9960" status: 200 len: 1224 microversion: 2.1 time: 0.086534 Aug 27 03:23:39.157557 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2944/5849] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:23:39 2022] GET /compute/v2.1/servers/5d82e610-a5cf-4a01-8a02-11b1c1ce9960 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:23:39.243210 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c27026b9-7122-4c34-ad78-7e338449cc2d tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:39.243822 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-c27026b9-7122-4c34-ad78-7e338449cc2d tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 0489a6fa-1b33-4960-aff1-8e365ad4c996] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:23:39.251417 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c27026b9-7122-4c34-ad78-7e338449cc2d tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:39.251907 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c27026b9-7122-4c34-ad78-7e338449cc2d tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:39.252347 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c27026b9-7122-4c34-ad78-7e338449cc2d tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:39.253087 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c27026b9-7122-4c34-ad78-7e338449cc2d tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:39.253540 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c27026b9-7122-4c34-ad78-7e338449cc2d tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:39.253967 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c27026b9-7122-4c34-ad78-7e338449cc2d tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:39.388999 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-c27026b9-7122-4c34-ad78-7e338449cc2d tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:39.397147 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c27026b9-7122-4c34-ad78-7e338449cc2d tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/0489a6fa-1b33-4960-aff1-8e365ad4c996" status: 200 len: 1390 microversion: 2.1 time: 0.158010 Aug 27 03:23:39.397739 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2906/5850] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:23:39 2022] GET /compute/v2.1/servers/0489a6fa-1b33-4960-aff1-8e365ad4c996 => generated 1390 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:23:39.971507 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-08f6652f-fa24-4ea6-be6d-9f55e62950da req-5003ed17-317f-4d6d-82ef-74c3d35f6741 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0489a6fa-1b33-4960-aff1-8e365ad4c996", "name": "network-vif-plugged", "status": "completed", "tag": "1e7b739d-0500-4bee-8d6f-5ad9f5006661"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:23:39.986473 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-08f6652f-fa24-4ea6-be6d-9f55e62950da req-5003ed17-317f-4d6d-82ef-74c3d35f6741 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:39.987229 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-08f6652f-fa24-4ea6-be6d-9f55e62950da req-5003ed17-317f-4d6d-82ef-74c3d35f6741 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:39.988057 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-08f6652f-fa24-4ea6-be6d-9f55e62950da req-5003ed17-317f-4d6d-82ef-74c3d35f6741 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:40.004253 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-08f6652f-fa24-4ea6-be6d-9f55e62950da req-5003ed17-317f-4d6d-82ef-74c3d35f6741 service nova] Creating event network-vif-plugged:1e7b739d-0500-4bee-8d6f-5ad9f5006661 for instance 0489a6fa-1b33-4960-aff1-8e365ad4c996 on n-h1-852278-4 Aug 27 03:23:40.010481 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-08f6652f-fa24-4ea6-be6d-9f55e62950da req-5003ed17-317f-4d6d-82ef-74c3d35f6741 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043528 Aug 27 03:23:40.011572 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2945/5851] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:23:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:23:40.179969 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-1d6b8e63-807b-4141-a9a6-370765c91725 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:40.181296 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-1d6b8e63-807b-4141-a9a6-370765c91725 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 5d82e610-a5cf-4a01-8a02-11b1c1ce9960] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:23:40.188691 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1d6b8e63-807b-4141-a9a6-370765c91725 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:40.189584 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1d6b8e63-807b-4141-a9a6-370765c91725 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:40.190274 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1d6b8e63-807b-4141-a9a6-370765c91725 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:40.191219 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1d6b8e63-807b-4141-a9a6-370765c91725 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:40.191909 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1d6b8e63-807b-4141-a9a6-370765c91725 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:40.192355 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1d6b8e63-807b-4141-a9a6-370765c91725 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:40.264466 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-1d6b8e63-807b-4141-a9a6-370765c91725 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:40.273121 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-1d6b8e63-807b-4141-a9a6-370765c91725 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/5d82e610-a5cf-4a01-8a02-11b1c1ce9960" status: 200 len: 1224 microversion: 2.1 time: 0.098687 Aug 27 03:23:40.274164 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2907/5852] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:23:40 2022] GET /compute/v2.1/servers/5d82e610-a5cf-4a01-8a02-11b1c1ce9960 => generated 1224 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:23:40.419224 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7aa04f97-eecf-4830-b344-7738983e43b7 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:40.420043 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-7aa04f97-eecf-4830-b344-7738983e43b7 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 0489a6fa-1b33-4960-aff1-8e365ad4c996] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:23:40.428426 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7aa04f97-eecf-4830-b344-7738983e43b7 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:40.428566 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7aa04f97-eecf-4830-b344-7738983e43b7 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:40.429126 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7aa04f97-eecf-4830-b344-7738983e43b7 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:40.429919 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7aa04f97-eecf-4830-b344-7738983e43b7 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:40.430386 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7aa04f97-eecf-4830-b344-7738983e43b7 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:40.430843 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7aa04f97-eecf-4830-b344-7738983e43b7 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:40.587252 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-7aa04f97-eecf-4830-b344-7738983e43b7 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:40.595789 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-7aa04f97-eecf-4830-b344-7738983e43b7 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/0489a6fa-1b33-4960-aff1-8e365ad4c996" status: 200 len: 1390 microversion: 2.1 time: 0.181144 Aug 27 03:23:40.596667 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2946/5853] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:23:40 2022] GET /compute/v2.1/servers/0489a6fa-1b33-4960-aff1-8e365ad4c996 => generated 1390 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:23:41.293656 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e85105ee-db20-42d9-85ce-0657ed2574a9 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:41.294948 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-e85105ee-db20-42d9-85ce-0657ed2574a9 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 5d82e610-a5cf-4a01-8a02-11b1c1ce9960] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:23:41.296853 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:23:41.297951 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=6 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:23:41.305311 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e85105ee-db20-42d9-85ce-0657ed2574a9 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:41.305919 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e85105ee-db20-42d9-85ce-0657ed2574a9 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:41.306427 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e85105ee-db20-42d9-85ce-0657ed2574a9 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:41.307164 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e85105ee-db20-42d9-85ce-0657ed2574a9 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:41.307612 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e85105ee-db20-42d9-85ce-0657ed2574a9 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:41.308024 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e85105ee-db20-42d9-85ce-0657ed2574a9 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:41.376703 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-e85105ee-db20-42d9-85ce-0657ed2574a9 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:41.384933 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e85105ee-db20-42d9-85ce-0657ed2574a9 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/5d82e610-a5cf-4a01-8a02-11b1c1ce9960" status: 200 len: 1224 microversion: 2.1 time: 0.095409 Aug 27 03:23:41.385521 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2908/5854] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:23:41 2022] GET /compute/v2.1/servers/5d82e610-a5cf-4a01-8a02-11b1c1ce9960 => generated 1224 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:23:41.617783 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-286d64d3-2e19-4feb-b6ac-20c3813c3776 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:41.618646 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-286d64d3-2e19-4feb-b6ac-20c3813c3776 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 0489a6fa-1b33-4960-aff1-8e365ad4c996] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:23:41.620968 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=6 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:23:41.627915 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-286d64d3-2e19-4feb-b6ac-20c3813c3776 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:41.628478 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-286d64d3-2e19-4feb-b6ac-20c3813c3776 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:41.628934 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-286d64d3-2e19-4feb-b6ac-20c3813c3776 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:41.629700 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-286d64d3-2e19-4feb-b6ac-20c3813c3776 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:41.630192 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-286d64d3-2e19-4feb-b6ac-20c3813c3776 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:41.630640 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-286d64d3-2e19-4feb-b6ac-20c3813c3776 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:41.768699 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-286d64d3-2e19-4feb-b6ac-20c3813c3776 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:41.777069 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-286d64d3-2e19-4feb-b6ac-20c3813c3776 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/0489a6fa-1b33-4960-aff1-8e365ad4c996" status: 200 len: 1561 microversion: 2.1 time: 0.163672 Aug 27 03:23:41.777662 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2947/5855] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:23:41 2022] GET /compute/v2.1/servers/0489a6fa-1b33-4960-aff1-8e365ad4c996 => generated 1561 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:23:41.797077 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d4c01c82-47f5-47b5-8ebc-c9fcb810bb03 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:41.797597 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d4c01c82-47f5-47b5-8ebc-c9fcb810bb03 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 0489a6fa-1b33-4960-aff1-8e365ad4c996] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:23:41.803741 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d4c01c82-47f5-47b5-8ebc-c9fcb810bb03 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:41.804338 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d4c01c82-47f5-47b5-8ebc-c9fcb810bb03 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:41.804792 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d4c01c82-47f5-47b5-8ebc-c9fcb810bb03 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:41.805480 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d4c01c82-47f5-47b5-8ebc-c9fcb810bb03 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:41.805981 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d4c01c82-47f5-47b5-8ebc-c9fcb810bb03 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:41.806398 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d4c01c82-47f5-47b5-8ebc-c9fcb810bb03 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:41.957016 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-d4c01c82-47f5-47b5-8ebc-c9fcb810bb03 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:41.965540 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d4c01c82-47f5-47b5-8ebc-c9fcb810bb03 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/0489a6fa-1b33-4960-aff1-8e365ad4c996" status: 200 len: 1561 microversion: 2.1 time: 0.172510 Aug 27 03:23:41.966138 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2909/5856] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:23:41 2022] GET /compute/v2.1/servers/0489a6fa-1b33-4960-aff1-8e365ad4c996 => generated 1561 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:23:42.405942 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-71eafb70-e12d-4d1a-a426-43b0bdcc3016 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:42.406753 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-71eafb70-e12d-4d1a-a426-43b0bdcc3016 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 5d82e610-a5cf-4a01-8a02-11b1c1ce9960] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:23:42.413238 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-71eafb70-e12d-4d1a-a426-43b0bdcc3016 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:42.413825 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-71eafb70-e12d-4d1a-a426-43b0bdcc3016 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:42.414334 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-71eafb70-e12d-4d1a-a426-43b0bdcc3016 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:42.415107 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-71eafb70-e12d-4d1a-a426-43b0bdcc3016 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:42.415763 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-71eafb70-e12d-4d1a-a426-43b0bdcc3016 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:42.416600 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-71eafb70-e12d-4d1a-a426-43b0bdcc3016 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:42.450472 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-71eafb70-e12d-4d1a-a426-43b0bdcc3016 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:42.451016 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-71eafb70-e12d-4d1a-a426-43b0bdcc3016 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:42.451476 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-71eafb70-e12d-4d1a-a426-43b0bdcc3016 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:42.452157 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.objects.instance [None req-71eafb70-e12d-4d1a-a426-43b0bdcc3016 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lazy-loading 'fault' on Instance uuid 5d82e610-a5cf-4a01-8a02-11b1c1ce9960 {{(pid=134051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:23:42.516857 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-71eafb70-e12d-4d1a-a426-43b0bdcc3016 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:42.529935 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-71eafb70-e12d-4d1a-a426-43b0bdcc3016 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/5d82e610-a5cf-4a01-8a02-11b1c1ce9960" status: 200 len: 1229 microversion: 2.1 time: 0.127342 Aug 27 03:23:42.531019 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2948/5857] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:23:42 2022] GET /compute/v2.1/servers/5d82e610-a5cf-4a01-8a02-11b1c1ce9960 => generated 1229 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:23:43.551572 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8a64815b-aa11-461f-b7d9-d6ceebb0d2c8 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:43.552250 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-8a64815b-aa11-461f-b7d9-d6ceebb0d2c8 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 5d82e610-a5cf-4a01-8a02-11b1c1ce9960] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:23:43.560001 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8a64815b-aa11-461f-b7d9-d6ceebb0d2c8 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:43.560561 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8a64815b-aa11-461f-b7d9-d6ceebb0d2c8 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:43.560999 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8a64815b-aa11-461f-b7d9-d6ceebb0d2c8 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:43.561703 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8a64815b-aa11-461f-b7d9-d6ceebb0d2c8 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:43.562153 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8a64815b-aa11-461f-b7d9-d6ceebb0d2c8 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:43.562573 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8a64815b-aa11-461f-b7d9-d6ceebb0d2c8 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:43.576888 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-8a64815b-aa11-461f-b7d9-d6ceebb0d2c8 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] HTTP exception thrown: Instance 5d82e610-a5cf-4a01-8a02-11b1c1ce9960 could not be found. Aug 27 03:23:43.578582 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8a64815b-aa11-461f-b7d9-d6ceebb0d2c8 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Request method failure captured: Aug 27 03:23:43.578582 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/servers/5d82e610-a5cf-4a01-8a02-11b1c1ce9960 HTTP/1.1 Aug 27 03:23:43.578582 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 03:23:43.578582 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 03:23:43.578582 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 03:23:43.578582 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 03:23:43.578582 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 03:23:43.578582 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 03:23:43.578582 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 03:23:43.578582 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 03:23:43.578582 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYyanRmSitPtUh4DIDjvAfp5Iiwg8r3Bf9-rjIalvb44wIYhFzVkZDLPIdVwR9rbE-qHDjS_3-JeB9MrxSXFOtiOWUfHFokH2CMOJ34en6s6KyuDM-ix0my9F59eD8M1zowb_BqVFIaTj9p6YHs85SeVo0SCpB1hAOakQSi3_cd8UVk Aug 27 03:23:43.578582 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 03:23:43.578582 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 03:23:43.578582 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 03:23:43.578582 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 03:23:43.578582 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 03:23:43.578582 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 03:23:43.578582 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 7b2673a034c24d1898493bfea9ca5d1d Aug 27 03:23:43.578582 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-TestVolumeBootPattern-2103223700 Aug 27 03:23:43.578582 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 03:23:43.578582 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 03:23:43.578582 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7b2673a034c24d1898493bfea9ca5d1d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_7b2673a034c24d1898493bfea9ca5d1d", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7b2673a034c24d1898493bfea9ca5d1d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/7b2673a034c24d1898493bfea9ca5d1d"}]}] Aug 27 03:23:43.578582 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-TestVolumeBootPattern-2103223700 Aug 27 03:23:43.578582 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 7b2673a034c24d1898493bfea9ca5d1d Aug 27 03:23:43.578582 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-TestVolumeBootPattern-2103223700 Aug 27 03:23:43.578582 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-TestVolumeBootPattern-2103223700-project Aug 27 03:23:43.578582 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 03:23:43.578582 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 03:23:43.578582 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 4aa867d7baa043b1b1e6763046463b3f Aug 27 03:23:43.578582 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-TestVolumeBootPattern-2103223700-project Aug 27 03:23:43.578582 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 03:23:43.578582 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance 5d82e610-a5cf-4a01-8a02-11b1c1ce9960 could not be found. Aug 27 03:23:43.578582 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '5d82e610-a5cf-4a01-8a02-11b1c1ce9960'} Aug 27 03:23:43.578582 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:23:43.578582 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:23:43.578582 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:23:43.578582 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:23:43.578582 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:23:43.578582 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:23:43.578582 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:23:43.578582 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:23:43.578582 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:23:43.578582 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:23:43.578582 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d82e610-a5cf-4a01-8a02-11b1c1ce9960 could not be found. Aug 27 03:23:43.578582 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:23:43.578582 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:23:43.578582 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:23:43.578582 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:23:43.578582 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:23:43.578582 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:23:43.578582 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:23:43.578582 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:23:43.578582 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:23:43.578582 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:23:43.578582 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:23:43.578582 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:23:43.578582 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:23:43.578582 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:23:43.578582 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:23:43.578582 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:23:43.578582 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d82e610-a5cf-4a01-8a02-11b1c1ce9960 could not be found. Aug 27 03:23:43.578582 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:23:43.578582 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:23:43.578582 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:23:43.583053 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:23:43.583053 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:23:43.583053 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:23:43.583053 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:23:43.583053 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:23:43.583053 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d82e610-a5cf-4a01-8a02-11b1c1ce9960 could not be found. Aug 27 03:23:43.583053 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:23:43.583053 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8a64815b-aa11-461f-b7d9-d6ceebb0d2c8 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Returning 404 to user: Instance 5d82e610-a5cf-4a01-8a02-11b1c1ce9960 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:23:43.583053 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-8a64815b-aa11-461f-b7d9-d6ceebb0d2c8 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/5d82e610-a5cf-4a01-8a02-11b1c1ce9960" status: 404 len: 111 microversion: 2.1 time: 0.032686 Aug 27 03:23:43.588791 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2910/5858] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:23:43 2022] GET /compute/v2.1/servers/5d82e610-a5cf-4a01-8a02-11b1c1ce9960 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:23:43.629597 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-83d8d16b-4f88-4c0f-8f0b-2d151dcf9751 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1725032074", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1843061337", "security_groups": [{"name": "tempest-secgroup-smoke-499842507"}], "block_device_mapping_v2": [{"uuid": "2a82fdae-7f91-455b-b9d7-5232f192870f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "02524c0f-c44c-4ea0-899e-226a790199dc"}]}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:23:43.770055 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.network.neutron [None req-83d8d16b-4f88-4c0f-8f0b-2d151dcf9751 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] validate_networks() for [('02524c0f-c44c-4ea0-899e-226a790199dc', None, None, None, None, None)] {{(pid=134051) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:23:44.231578 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-687573b6-a644-4591-970f-795c1cb38439 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:44.232462 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-687573b6-a644-4591-970f-795c1cb38439 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 0489a6fa-1b33-4960-aff1-8e365ad4c996] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:23:44.240215 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-687573b6-a644-4591-970f-795c1cb38439 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:44.240727 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-687573b6-a644-4591-970f-795c1cb38439 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:44.241241 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-687573b6-a644-4591-970f-795c1cb38439 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:44.241958 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-687573b6-a644-4591-970f-795c1cb38439 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:44.242412 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-687573b6-a644-4591-970f-795c1cb38439 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:44.242871 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-687573b6-a644-4591-970f-795c1cb38439 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:44.398234 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-83d8d16b-4f88-4c0f-8f0b-2d151dcf9751 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Flavor limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:23:44.398701 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-83d8d16b-4f88-4c0f-8f0b-2d151dcf9751 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Image limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:23:44.399360 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-83d8d16b-4f88-4c0f-8f0b-2d151dcf9751 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Flavor pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:23:44.400081 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-83d8d16b-4f88-4c0f-8f0b-2d151dcf9751 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Image pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:23:44.401202 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-83d8d16b-4f88-4c0f-8f0b-2d151dcf9751 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:23:44.410682 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-83d8d16b-4f88-4c0f-8f0b-2d151dcf9751 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:44.411189 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-83d8d16b-4f88-4c0f-8f0b-2d151dcf9751 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:44.411644 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-83d8d16b-4f88-4c0f-8f0b-2d151dcf9751 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:44.412634 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-83d8d16b-4f88-4c0f-8f0b-2d151dcf9751 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:44.413107 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-83d8d16b-4f88-4c0f-8f0b-2d151dcf9751 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:44.413593 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-83d8d16b-4f88-4c0f-8f0b-2d151dcf9751 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:44.422979 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-687573b6-a644-4591-970f-795c1cb38439 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:44.431453 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-687573b6-a644-4591-970f-795c1cb38439 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/0489a6fa-1b33-4960-aff1-8e365ad4c996" status: 200 len: 1561 microversion: 2.1 time: 0.204849 Aug 27 03:23:44.432250 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2911/5859] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:23:44 2022] GET /compute/v2.1/servers/0489a6fa-1b33-4960-aff1-8e365ad4c996 => generated 1561 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:23:44.432771 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-83d8d16b-4f88-4c0f-8f0b-2d151dcf9751 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Getting quotas for project 7b2673a034c24d1898493bfea9ca5d1d. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:23:44.437699 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-fae4b132-d9b3-4aef-8b83-e6fcf5693fe5 req-edcde764-97c1-42a3-8cd0-cae9cb1da0b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0489a6fa-1b33-4960-aff1-8e365ad4c996", "tag": "1e7b739d-0500-4bee-8d6f-5ad9f5006661"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:23:44.439217 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-83d8d16b-4f88-4c0f-8f0b-2d151dcf9751 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Getting quotas for user 4aa867d7baa043b1b1e6763046463b3f and project 7b2673a034c24d1898493bfea9ca5d1d. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:23:44.447288 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-fae4b132-d9b3-4aef-8b83-e6fcf5693fe5 req-edcde764-97c1-42a3-8cd0-cae9cb1da0b4 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:44.447764 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-fae4b132-d9b3-4aef-8b83-e6fcf5693fe5 req-edcde764-97c1-42a3-8cd0-cae9cb1da0b4 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:44.448211 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-fae4b132-d9b3-4aef-8b83-e6fcf5693fe5 req-edcde764-97c1-42a3-8cd0-cae9cb1da0b4 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:44.473020 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-fae4b132-d9b3-4aef-8b83-e6fcf5693fe5 req-edcde764-97c1-42a3-8cd0-cae9cb1da0b4 service nova] Creating event network-changed:1e7b739d-0500-4bee-8d6f-5ad9f5006661 for instance 0489a6fa-1b33-4960-aff1-8e365ad4c996 on n-h1-852278-4 Aug 27 03:23:44.479163 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-fae4b132-d9b3-4aef-8b83-e6fcf5693fe5 req-edcde764-97c1-42a3-8cd0-cae9cb1da0b4 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045570 Aug 27 03:23:44.479805 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2912/5860] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:23:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:23:44.507102 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-83d8d16b-4f88-4c0f-8f0b-2d151dcf9751 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Going to run 1 instances... {{(pid=134051) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:23:44.509335 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-83d8d16b-4f88-4c0f-8f0b-2d151dcf9751 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 2438c692-fd2c-44e2-a733-ad3e1215baf9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2a82fdae-7f91-455b-b9d7-5232f192870f',volume_size=None,volume_type=None)] {{(pid=134051) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:23:44.653380 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-83d8d16b-4f88-4c0f-8f0b-2d151dcf9751 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.027652 Aug 27 03:23:44.654910 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2949/5861] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 03:23:43 2022] POST /compute/v2.1/servers => generated 405 bytes in 1030 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:23:44.667739 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-bc56cf6b-b5fa-4eac-8606-415f121511cc tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:44.669750 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-bc56cf6b-b5fa-4eac-8606-415f121511cc tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 2438c692-fd2c-44e2-a733-ad3e1215baf9] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:23:44.733123 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-bc56cf6b-b5fa-4eac-8606-415f121511cc tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:44.742206 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-bc56cf6b-b5fa-4eac-8606-415f121511cc tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/2438c692-fd2c-44e2-a733-ad3e1215baf9" status: 200 len: 1095 microversion: 2.1 time: 0.079229 Aug 27 03:23:44.742939 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2913/5862] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:23:44 2022] GET /compute/v2.1/servers/2438c692-fd2c-44e2-a733-ad3e1215baf9 => generated 1095 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:23:45.765908 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-76e251ef-1452-4ec7-b922-b3ab9c4576ed tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:45.766554 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-76e251ef-1452-4ec7-b922-b3ab9c4576ed tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 2438c692-fd2c-44e2-a733-ad3e1215baf9] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:23:45.778136 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-76e251ef-1452-4ec7-b922-b3ab9c4576ed tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:45.778653 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-76e251ef-1452-4ec7-b922-b3ab9c4576ed tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:45.779110 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-76e251ef-1452-4ec7-b922-b3ab9c4576ed tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:45.780134 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-76e251ef-1452-4ec7-b922-b3ab9c4576ed tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:45.780637 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-76e251ef-1452-4ec7-b922-b3ab9c4576ed tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:45.781077 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-76e251ef-1452-4ec7-b922-b3ab9c4576ed tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:45.861279 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-76e251ef-1452-4ec7-b922-b3ab9c4576ed tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:45.870195 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-76e251ef-1452-4ec7-b922-b3ab9c4576ed tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/2438c692-fd2c-44e2-a733-ad3e1215baf9" status: 200 len: 1211 microversion: 2.1 time: 0.109350 Aug 27 03:23:45.879303 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2950/5863] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:23:45 2022] GET /compute/v2.1/servers/2438c692-fd2c-44e2-a733-ad3e1215baf9 => generated 1211 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:23:46.892943 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-046f1776-a5e9-45aa-8c80-737443cdbcf1 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:46.894353 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-046f1776-a5e9-45aa-8c80-737443cdbcf1 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 2438c692-fd2c-44e2-a733-ad3e1215baf9] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:23:46.903030 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-046f1776-a5e9-45aa-8c80-737443cdbcf1 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:46.903716 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-046f1776-a5e9-45aa-8c80-737443cdbcf1 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:46.906502 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-046f1776-a5e9-45aa-8c80-737443cdbcf1 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:46.907408 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-046f1776-a5e9-45aa-8c80-737443cdbcf1 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:46.908147 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-046f1776-a5e9-45aa-8c80-737443cdbcf1 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:46.908769 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-046f1776-a5e9-45aa-8c80-737443cdbcf1 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:47.095841 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-046f1776-a5e9-45aa-8c80-737443cdbcf1 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:47.104797 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-046f1776-a5e9-45aa-8c80-737443cdbcf1 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/2438c692-fd2c-44e2-a733-ad3e1215baf9" status: 200 len: 1278 microversion: 2.1 time: 0.217061 Aug 27 03:23:47.105802 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2914/5864] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:23:46 2022] GET /compute/v2.1/servers/2438c692-fd2c-44e2-a733-ad3e1215baf9 => generated 1278 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:23:47.173270 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-dbd899f8-c276-4e80-a861-f0cc8cac5538 req-0a912f5f-07fb-4025-8659-454c5de7eafe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2438c692-fd2c-44e2-a733-ad3e1215baf9", "tag": "1f3c37fa-c278-45fc-bb15-a87e4661bf62"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:23:47.187711 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-dbd899f8-c276-4e80-a861-f0cc8cac5538 req-0a912f5f-07fb-4025-8659-454c5de7eafe service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:47.188408 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-dbd899f8-c276-4e80-a861-f0cc8cac5538 req-0a912f5f-07fb-4025-8659-454c5de7eafe service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:47.188932 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-dbd899f8-c276-4e80-a861-f0cc8cac5538 req-0a912f5f-07fb-4025-8659-454c5de7eafe service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:47.202365 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-dbd899f8-c276-4e80-a861-f0cc8cac5538 req-0a912f5f-07fb-4025-8659-454c5de7eafe service nova] Creating event network-changed:1f3c37fa-c278-45fc-bb15-a87e4661bf62 for instance 2438c692-fd2c-44e2-a733-ad3e1215baf9 on n-h2-852278-4 Aug 27 03:23:47.208588 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-dbd899f8-c276-4e80-a861-f0cc8cac5538 req-0a912f5f-07fb-4025-8659-454c5de7eafe service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040493 Aug 27 03:23:47.209268 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2951/5865] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:23:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:23:48.126311 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-86084669-c506-498c-9d71-f8c742bcd1c0 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:48.127567 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-86084669-c506-498c-9d71-f8c742bcd1c0 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 2438c692-fd2c-44e2-a733-ad3e1215baf9] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:23:48.135474 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-86084669-c506-498c-9d71-f8c742bcd1c0 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:48.136259 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-86084669-c506-498c-9d71-f8c742bcd1c0 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:48.136971 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-86084669-c506-498c-9d71-f8c742bcd1c0 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:48.137713 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-86084669-c506-498c-9d71-f8c742bcd1c0 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:48.138169 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-86084669-c506-498c-9d71-f8c742bcd1c0 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:48.138598 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-86084669-c506-498c-9d71-f8c742bcd1c0 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:48.275675 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-86084669-c506-498c-9d71-f8c742bcd1c0 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:48.283789 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-86084669-c506-498c-9d71-f8c742bcd1c0 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/2438c692-fd2c-44e2-a733-ad3e1215baf9" status: 200 len: 1278 microversion: 2.1 time: 0.161616 Aug 27 03:23:48.284376 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2915/5866] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:23:48 2022] GET /compute/v2.1/servers/2438c692-fd2c-44e2-a733-ad3e1215baf9 => generated 1278 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:23:49.306449 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-bd9e3dc2-a954-49ed-8718-ed4c7c75cc51 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:49.307069 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-bd9e3dc2-a954-49ed-8718-ed4c7c75cc51 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 2438c692-fd2c-44e2-a733-ad3e1215baf9] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:23:49.314286 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bd9e3dc2-a954-49ed-8718-ed4c7c75cc51 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:49.314796 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bd9e3dc2-a954-49ed-8718-ed4c7c75cc51 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:49.315253 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bd9e3dc2-a954-49ed-8718-ed4c7c75cc51 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:49.315995 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bd9e3dc2-a954-49ed-8718-ed4c7c75cc51 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:49.316504 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bd9e3dc2-a954-49ed-8718-ed4c7c75cc51 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:49.316954 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bd9e3dc2-a954-49ed-8718-ed4c7c75cc51 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:49.451135 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-bd9e3dc2-a954-49ed-8718-ed4c7c75cc51 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:49.459290 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-bd9e3dc2-a954-49ed-8718-ed4c7c75cc51 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/2438c692-fd2c-44e2-a733-ad3e1215baf9" status: 200 len: 1278 microversion: 2.1 time: 0.158362 Aug 27 03:23:49.459911 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2952/5867] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:23:49 2022] GET /compute/v2.1/servers/2438c692-fd2c-44e2-a733-ad3e1215baf9 => generated 1278 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:23:50.479579 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8984f302-d53c-4dce-b5e6-c696d0ea46a0 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:50.480467 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-8984f302-d53c-4dce-b5e6-c696d0ea46a0 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 2438c692-fd2c-44e2-a733-ad3e1215baf9] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:23:50.490370 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8984f302-d53c-4dce-b5e6-c696d0ea46a0 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:50.490933 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8984f302-d53c-4dce-b5e6-c696d0ea46a0 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:50.491387 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8984f302-d53c-4dce-b5e6-c696d0ea46a0 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:50.492132 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8984f302-d53c-4dce-b5e6-c696d0ea46a0 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:50.492590 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8984f302-d53c-4dce-b5e6-c696d0ea46a0 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:50.493021 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8984f302-d53c-4dce-b5e6-c696d0ea46a0 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:50.635802 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-8984f302-d53c-4dce-b5e6-c696d0ea46a0 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:50.644193 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-8984f302-d53c-4dce-b5e6-c696d0ea46a0 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/2438c692-fd2c-44e2-a733-ad3e1215baf9" status: 200 len: 1278 microversion: 2.1 time: 0.168768 Aug 27 03:23:50.644824 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2916/5868] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:23:50 2022] GET /compute/v2.1/servers/2438c692-fd2c-44e2-a733-ad3e1215baf9 => generated 1278 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:23:51.665494 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-5592d72e-ff1e-466d-8773-c170258f7b56 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:51.666169 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-5592d72e-ff1e-466d-8773-c170258f7b56 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 2438c692-fd2c-44e2-a733-ad3e1215baf9] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:23:51.674634 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5592d72e-ff1e-466d-8773-c170258f7b56 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:51.675154 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5592d72e-ff1e-466d-8773-c170258f7b56 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:51.675628 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5592d72e-ff1e-466d-8773-c170258f7b56 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:51.676442 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5592d72e-ff1e-466d-8773-c170258f7b56 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:51.676919 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5592d72e-ff1e-466d-8773-c170258f7b56 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:51.677363 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5592d72e-ff1e-466d-8773-c170258f7b56 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:51.822636 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-5592d72e-ff1e-466d-8773-c170258f7b56 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:51.833063 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-5592d72e-ff1e-466d-8773-c170258f7b56 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/2438c692-fd2c-44e2-a733-ad3e1215baf9" status: 200 len: 1266 microversion: 2.1 time: 0.171380 Aug 27 03:23:51.833903 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2953/5869] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:23:51 2022] GET /compute/v2.1/servers/2438c692-fd2c-44e2-a733-ad3e1215baf9 => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:23:52.864394 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-209fbcd2-1150-4199-bdb8-72117574e3b4 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:52.865406 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-209fbcd2-1150-4199-bdb8-72117574e3b4 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 2438c692-fd2c-44e2-a733-ad3e1215baf9] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:23:52.874080 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-209fbcd2-1150-4199-bdb8-72117574e3b4 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:52.874570 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-209fbcd2-1150-4199-bdb8-72117574e3b4 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:52.875004 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-209fbcd2-1150-4199-bdb8-72117574e3b4 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:52.875708 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-209fbcd2-1150-4199-bdb8-72117574e3b4 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:52.876160 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-209fbcd2-1150-4199-bdb8-72117574e3b4 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:52.876629 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-209fbcd2-1150-4199-bdb8-72117574e3b4 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:52.880958 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:23:53.023506 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-209fbcd2-1150-4199-bdb8-72117574e3b4 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:53.032064 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-209fbcd2-1150-4199-bdb8-72117574e3b4 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/2438c692-fd2c-44e2-a733-ad3e1215baf9" status: 200 len: 1266 microversion: 2.1 time: 0.174414 Aug 27 03:23:53.032655 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2917/5870] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:23:52 2022] GET /compute/v2.1/servers/2438c692-fd2c-44e2-a733-ad3e1215baf9 => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:23:54.057413 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-6d48f34c-020f-4269-81d7-162d3a514259 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:54.058800 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-6d48f34c-020f-4269-81d7-162d3a514259 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 2438c692-fd2c-44e2-a733-ad3e1215baf9] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:23:54.063417 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=4 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:23:54.072906 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6d48f34c-020f-4269-81d7-162d3a514259 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:54.073858 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6d48f34c-020f-4269-81d7-162d3a514259 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:54.074351 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6d48f34c-020f-4269-81d7-162d3a514259 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:54.075072 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6d48f34c-020f-4269-81d7-162d3a514259 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:54.075546 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6d48f34c-020f-4269-81d7-162d3a514259 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:54.075989 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6d48f34c-020f-4269-81d7-162d3a514259 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:54.079551 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=81 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:23:54.233618 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-6d48f34c-020f-4269-81d7-162d3a514259 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:54.244853 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-6d48f34c-020f-4269-81d7-162d3a514259 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/2438c692-fd2c-44e2-a733-ad3e1215baf9" status: 200 len: 1266 microversion: 2.1 time: 0.193843 Aug 27 03:23:54.245462 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2954/5871] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:23:54 2022] GET /compute/v2.1/servers/2438c692-fd2c-44e2-a733-ad3e1215baf9 => generated 1266 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:23:55.269027 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ed93dfb5-df9e-4fbe-99cd-0fb2fd8b8bea tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:55.269817 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-ed93dfb5-df9e-4fbe-99cd-0fb2fd8b8bea tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 2438c692-fd2c-44e2-a733-ad3e1215baf9] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:23:55.273425 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:23:55.280792 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ed93dfb5-df9e-4fbe-99cd-0fb2fd8b8bea tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:55.281267 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ed93dfb5-df9e-4fbe-99cd-0fb2fd8b8bea tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:55.281692 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ed93dfb5-df9e-4fbe-99cd-0fb2fd8b8bea tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:55.282387 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ed93dfb5-df9e-4fbe-99cd-0fb2fd8b8bea tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:55.282836 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ed93dfb5-df9e-4fbe-99cd-0fb2fd8b8bea tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:55.283262 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ed93dfb5-df9e-4fbe-99cd-0fb2fd8b8bea tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:55.421907 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-ed93dfb5-df9e-4fbe-99cd-0fb2fd8b8bea tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:55.429831 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ed93dfb5-df9e-4fbe-99cd-0fb2fd8b8bea tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/2438c692-fd2c-44e2-a733-ad3e1215baf9" status: 200 len: 1266 microversion: 2.1 time: 0.166031 Aug 27 03:23:55.430389 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2918/5872] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:23:55 2022] GET /compute/v2.1/servers/2438c692-fd2c-44e2-a733-ad3e1215baf9 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:23:56.454885 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-2f5b51e1-86bb-468f-a7d7-b5028fc1cc16 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:56.456047 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-2f5b51e1-86bb-468f-a7d7-b5028fc1cc16 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 2438c692-fd2c-44e2-a733-ad3e1215baf9] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:23:56.458878 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:23:56.460005 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=6 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:23:56.469025 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2f5b51e1-86bb-468f-a7d7-b5028fc1cc16 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:56.469532 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2f5b51e1-86bb-468f-a7d7-b5028fc1cc16 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:56.469991 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2f5b51e1-86bb-468f-a7d7-b5028fc1cc16 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:56.470713 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2f5b51e1-86bb-468f-a7d7-b5028fc1cc16 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:56.471182 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2f5b51e1-86bb-468f-a7d7-b5028fc1cc16 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:56.471638 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2f5b51e1-86bb-468f-a7d7-b5028fc1cc16 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:56.970913 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-2f5b51e1-86bb-468f-a7d7-b5028fc1cc16 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:56.981515 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-2f5b51e1-86bb-468f-a7d7-b5028fc1cc16 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/2438c692-fd2c-44e2-a733-ad3e1215baf9" status: 200 len: 1266 microversion: 2.1 time: 0.533178 Aug 27 03:23:56.982164 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2955/5873] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:23:56 2022] GET /compute/v2.1/servers/2438c692-fd2c-44e2-a733-ad3e1215baf9 => generated 1266 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:23:58.002465 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-70cbe05f-66a6-4d51-baa5-5b60eb50e34a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:58.003155 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-70cbe05f-66a6-4d51-baa5-5b60eb50e34a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 2438c692-fd2c-44e2-a733-ad3e1215baf9] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:23:58.010485 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-70cbe05f-66a6-4d51-baa5-5b60eb50e34a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:58.010990 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-70cbe05f-66a6-4d51-baa5-5b60eb50e34a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:58.011413 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-70cbe05f-66a6-4d51-baa5-5b60eb50e34a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:58.012102 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-70cbe05f-66a6-4d51-baa5-5b60eb50e34a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:58.012556 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-70cbe05f-66a6-4d51-baa5-5b60eb50e34a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:58.013001 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-70cbe05f-66a6-4d51-baa5-5b60eb50e34a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:58.149062 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-70cbe05f-66a6-4d51-baa5-5b60eb50e34a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:58.157056 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-70cbe05f-66a6-4d51-baa5-5b60eb50e34a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/2438c692-fd2c-44e2-a733-ad3e1215baf9" status: 200 len: 1266 microversion: 2.1 time: 0.158551 Aug 27 03:23:58.157613 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2919/5874] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:23:57 2022] GET /compute/v2.1/servers/2438c692-fd2c-44e2-a733-ad3e1215baf9 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:23:59.183727 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7bb9de2a-451c-4d72-a9ac-23dd357fcc43 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:59.184698 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-7bb9de2a-451c-4d72-a9ac-23dd357fcc43 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 2438c692-fd2c-44e2-a733-ad3e1215baf9] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:23:59.197100 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7bb9de2a-451c-4d72-a9ac-23dd357fcc43 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:59.197910 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7bb9de2a-451c-4d72-a9ac-23dd357fcc43 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:59.198675 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7bb9de2a-451c-4d72-a9ac-23dd357fcc43 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:59.199819 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7bb9de2a-451c-4d72-a9ac-23dd357fcc43 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:59.200290 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7bb9de2a-451c-4d72-a9ac-23dd357fcc43 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:59.200784 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7bb9de2a-451c-4d72-a9ac-23dd357fcc43 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:59.337593 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-7bb9de2a-451c-4d72-a9ac-23dd357fcc43 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:59.345504 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-7bb9de2a-451c-4d72-a9ac-23dd357fcc43 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/2438c692-fd2c-44e2-a733-ad3e1215baf9" status: 200 len: 1266 microversion: 2.1 time: 0.168788 Aug 27 03:23:59.346092 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2956/5875] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:23:59 2022] GET /compute/v2.1/servers/2438c692-fd2c-44e2-a733-ad3e1215baf9 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:24:00.370577 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b0f03039-3255-4297-98b9-b4c03ac65367 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:00.371217 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b0f03039-3255-4297-98b9-b4c03ac65367 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 2438c692-fd2c-44e2-a733-ad3e1215baf9] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:00.374284 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:24:00.379992 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b0f03039-3255-4297-98b9-b4c03ac65367 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:00.380490 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b0f03039-3255-4297-98b9-b4c03ac65367 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:00.380945 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b0f03039-3255-4297-98b9-b4c03ac65367 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:00.381790 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b0f03039-3255-4297-98b9-b4c03ac65367 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:00.382237 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b0f03039-3255-4297-98b9-b4c03ac65367 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:00.382644 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b0f03039-3255-4297-98b9-b4c03ac65367 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:00.476838 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-7d659de0-eed6-47a5-9d1c-fb0ee0094016 req-f2456092-a5cf-4d1d-8c27-3a5b9d0d974b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2438c692-fd2c-44e2-a733-ad3e1215baf9", "name": "network-vif-plugged", "status": "completed", "tag": "1f3c37fa-c278-45fc-bb15-a87e4661bf62"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:24:00.497038 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-7d659de0-eed6-47a5-9d1c-fb0ee0094016 req-f2456092-a5cf-4d1d-8c27-3a5b9d0d974b service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:00.497542 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-7d659de0-eed6-47a5-9d1c-fb0ee0094016 req-f2456092-a5cf-4d1d-8c27-3a5b9d0d974b service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:00.498219 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-7d659de0-eed6-47a5-9d1c-fb0ee0094016 req-f2456092-a5cf-4d1d-8c27-3a5b9d0d974b service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:00.511173 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-7d659de0-eed6-47a5-9d1c-fb0ee0094016 req-f2456092-a5cf-4d1d-8c27-3a5b9d0d974b service nova] Creating event network-vif-plugged:1f3c37fa-c278-45fc-bb15-a87e4661bf62 for instance 2438c692-fd2c-44e2-a733-ad3e1215baf9 on n-h2-852278-4 Aug 27 03:24:00.516554 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-7d659de0-eed6-47a5-9d1c-fb0ee0094016 req-f2456092-a5cf-4d1d-8c27-3a5b9d0d974b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049555 Aug 27 03:24:00.517255 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2957/5876] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:24:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:24:00.534592 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b0f03039-3255-4297-98b9-b4c03ac65367 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:00.545380 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b0f03039-3255-4297-98b9-b4c03ac65367 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/2438c692-fd2c-44e2-a733-ad3e1215baf9" status: 200 len: 1266 microversion: 2.1 time: 0.178942 Aug 27 03:24:00.546307 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2920/5877] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:24:00 2022] GET /compute/v2.1/servers/2438c692-fd2c-44e2-a733-ad3e1215baf9 => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:24:01.573851 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-9830c36c-d0a5-4a18-ba75-b3f7ff7f7bef tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:01.575044 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-9830c36c-d0a5-4a18-ba75-b3f7ff7f7bef tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 2438c692-fd2c-44e2-a733-ad3e1215baf9] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:01.582455 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9830c36c-d0a5-4a18-ba75-b3f7ff7f7bef tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:01.582959 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9830c36c-d0a5-4a18-ba75-b3f7ff7f7bef tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:01.583613 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9830c36c-d0a5-4a18-ba75-b3f7ff7f7bef tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:01.584125 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9830c36c-d0a5-4a18-ba75-b3f7ff7f7bef tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:01.584627 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9830c36c-d0a5-4a18-ba75-b3f7ff7f7bef tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:01.585067 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9830c36c-d0a5-4a18-ba75-b3f7ff7f7bef tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:01.731080 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-9830c36c-d0a5-4a18-ba75-b3f7ff7f7bef tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:01.739389 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-9830c36c-d0a5-4a18-ba75-b3f7ff7f7bef tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/2438c692-fd2c-44e2-a733-ad3e1215baf9" status: 200 len: 1266 microversion: 2.1 time: 0.174340 Aug 27 03:24:01.739936 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2958/5878] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:24:01 2022] GET /compute/v2.1/servers/2438c692-fd2c-44e2-a733-ad3e1215baf9 => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:24:02.761523 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6d5c90ee-8a39-4dac-9631-415075f8dd87 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:02.762133 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-6d5c90ee-8a39-4dac-9631-415075f8dd87 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 2438c692-fd2c-44e2-a733-ad3e1215baf9] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:02.769531 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6d5c90ee-8a39-4dac-9631-415075f8dd87 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:02.769961 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6d5c90ee-8a39-4dac-9631-415075f8dd87 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:02.770443 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6d5c90ee-8a39-4dac-9631-415075f8dd87 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:02.771143 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6d5c90ee-8a39-4dac-9631-415075f8dd87 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:02.771598 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6d5c90ee-8a39-4dac-9631-415075f8dd87 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:02.772024 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6d5c90ee-8a39-4dac-9631-415075f8dd87 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:02.908734 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-6d5c90ee-8a39-4dac-9631-415075f8dd87 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:02.918575 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-6d5c90ee-8a39-4dac-9631-415075f8dd87 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/2438c692-fd2c-44e2-a733-ad3e1215baf9" status: 200 len: 1453 microversion: 2.1 time: 0.159751 Aug 27 03:24:02.918575 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2921/5879] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:24:02 2022] GET /compute/v2.1/servers/2438c692-fd2c-44e2-a733-ad3e1215baf9 => generated 1453 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:24:02.938504 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-eaff4a85-8236-43ba-a479-7248d2b04420 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:02.939114 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-eaff4a85-8236-43ba-a479-7248d2b04420 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 2438c692-fd2c-44e2-a733-ad3e1215baf9] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:02.946293 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eaff4a85-8236-43ba-a479-7248d2b04420 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:02.946801 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eaff4a85-8236-43ba-a479-7248d2b04420 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:02.947259 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eaff4a85-8236-43ba-a479-7248d2b04420 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:02.947998 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eaff4a85-8236-43ba-a479-7248d2b04420 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:02.948525 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eaff4a85-8236-43ba-a479-7248d2b04420 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:02.948965 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eaff4a85-8236-43ba-a479-7248d2b04420 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:03.161515 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-eaff4a85-8236-43ba-a479-7248d2b04420 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:03.169958 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-eaff4a85-8236-43ba-a479-7248d2b04420 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/2438c692-fd2c-44e2-a733-ad3e1215baf9" status: 200 len: 1453 microversion: 2.1 time: 0.235512 Aug 27 03:24:03.170552 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2959/5880] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:24:02 2022] GET /compute/v2.1/servers/2438c692-fd2c-44e2-a733-ad3e1215baf9 => generated 1453 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:24:05.231956 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-73f30432-b8d2-4153-a9a5-edd26530b55c req-dd7d5bde-c186-4717-934e-eaafaec77752 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2438c692-fd2c-44e2-a733-ad3e1215baf9", "tag": "1f3c37fa-c278-45fc-bb15-a87e4661bf62"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:24:05.245155 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-73f30432-b8d2-4153-a9a5-edd26530b55c req-dd7d5bde-c186-4717-934e-eaafaec77752 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:05.245917 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-73f30432-b8d2-4153-a9a5-edd26530b55c req-dd7d5bde-c186-4717-934e-eaafaec77752 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:05.246353 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-73f30432-b8d2-4153-a9a5-edd26530b55c req-dd7d5bde-c186-4717-934e-eaafaec77752 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:05.259437 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-73f30432-b8d2-4153-a9a5-edd26530b55c req-dd7d5bde-c186-4717-934e-eaafaec77752 service nova] Creating event network-changed:1f3c37fa-c278-45fc-bb15-a87e4661bf62 for instance 2438c692-fd2c-44e2-a733-ad3e1215baf9 on n-h2-852278-4 Aug 27 03:24:05.266861 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-73f30432-b8d2-4153-a9a5-edd26530b55c req-dd7d5bde-c186-4717-934e-eaafaec77752 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039235 Aug 27 03:24:05.267457 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2922/5881] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:24:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:24:05.718138 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b16b68f5-a9de-492a-a8c0-d6a57149b4cd tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:24:05.720417 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b16b68f5-a9de-492a-a8c0-d6a57149b4cd tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 0489a6fa-1b33-4960-aff1-8e365ad4c996] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:05.727534 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b16b68f5-a9de-492a-a8c0-d6a57149b4cd tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:05.728072 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b16b68f5-a9de-492a-a8c0-d6a57149b4cd tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:05.728551 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b16b68f5-a9de-492a-a8c0-d6a57149b4cd tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:05.729274 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b16b68f5-a9de-492a-a8c0-d6a57149b4cd tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:05.729734 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b16b68f5-a9de-492a-a8c0-d6a57149b4cd tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:05.730168 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b16b68f5-a9de-492a-a8c0-d6a57149b4cd tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:05.803327 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b16b68f5-a9de-492a-a8c0-d6a57149b4cd tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "POST /compute/v2.1/servers/0489a6fa-1b33-4960-aff1-8e365ad4c996/action" status: 200 len: 24571 microversion: 2.1 time: 0.090387 Aug 27 03:24:05.803965 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2960/5882] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:24:05 2022] POST /compute/v2.1/servers/0489a6fa-1b33-4960-aff1-8e365ad4c996/action => generated 24571 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:24:16.885822 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=5 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:24:16.886568 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=30 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:24:16.890666 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-53828a6d-1ff2-45b7-8261-f4f7db402354 tempest-TestNetworkAdvancedServerOps-1663634391 tempest-TestNetworkAdvancedServerOps-1663634391-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:16.891333 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-53828a6d-1ff2-45b7-8261-f4f7db402354 tempest-TestNetworkAdvancedServerOps-1663634391 tempest-TestNetworkAdvancedServerOps-1663634391-project-admin] [instance: 0489a6fa-1b33-4960-aff1-8e365ad4c996] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:16.898287 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-53828a6d-1ff2-45b7-8261-f4f7db402354 tempest-TestNetworkAdvancedServerOps-1663634391 tempest-TestNetworkAdvancedServerOps-1663634391-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:16.898786 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-53828a6d-1ff2-45b7-8261-f4f7db402354 tempest-TestNetworkAdvancedServerOps-1663634391 tempest-TestNetworkAdvancedServerOps-1663634391-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:16.899203 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-53828a6d-1ff2-45b7-8261-f4f7db402354 tempest-TestNetworkAdvancedServerOps-1663634391 tempest-TestNetworkAdvancedServerOps-1663634391-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:16.899887 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-53828a6d-1ff2-45b7-8261-f4f7db402354 tempest-TestNetworkAdvancedServerOps-1663634391 tempest-TestNetworkAdvancedServerOps-1663634391-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:16.900341 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-53828a6d-1ff2-45b7-8261-f4f7db402354 tempest-TestNetworkAdvancedServerOps-1663634391 tempest-TestNetworkAdvancedServerOps-1663634391-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:16.900758 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-53828a6d-1ff2-45b7-8261-f4f7db402354 tempest-TestNetworkAdvancedServerOps-1663634391 tempest-TestNetworkAdvancedServerOps-1663634391-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:17.159325 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-53828a6d-1ff2-45b7-8261-f4f7db402354 tempest-TestNetworkAdvancedServerOps-1663634391 tempest-TestNetworkAdvancedServerOps-1663634391-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/0489a6fa-1b33-4960-aff1-8e365ad4c996" status: 200 len: 1831 microversion: 2.1 time: 0.276624 Aug 27 03:24:17.159911 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2923/5883] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:24:16 2022] GET /compute/v2.1/servers/0489a6fa-1b33-4960-aff1-8e365ad4c996 => generated 1831 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:24:17.187196 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-807b34a4-49ea-40ab-8343-29089ebe6f0d tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:17.188170 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-807b34a4-49ea-40ab-8343-29089ebe6f0d tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 0489a6fa-1b33-4960-aff1-8e365ad4c996] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:17.193652 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=13 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:24:17.194434 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=35 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:24:17.200615 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-807b34a4-49ea-40ab-8343-29089ebe6f0d tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:17.201234 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-807b34a4-49ea-40ab-8343-29089ebe6f0d tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:17.201717 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-807b34a4-49ea-40ab-8343-29089ebe6f0d tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:17.202605 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-807b34a4-49ea-40ab-8343-29089ebe6f0d tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:17.203075 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-807b34a4-49ea-40ab-8343-29089ebe6f0d tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:17.203546 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-807b34a4-49ea-40ab-8343-29089ebe6f0d tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:17.353083 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-807b34a4-49ea-40ab-8343-29089ebe6f0d tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:17.361712 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-807b34a4-49ea-40ab-8343-29089ebe6f0d tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/0489a6fa-1b33-4960-aff1-8e365ad4c996" status: 200 len: 1680 microversion: 2.1 time: 0.183512 Aug 27 03:24:17.362283 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2961/5884] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:24:17 2022] GET /compute/v2.1/servers/0489a6fa-1b33-4960-aff1-8e365ad4c996 => generated 1680 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:24:17.460895 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-97c22572-1a65-4703-bee9-d6c007b9313e tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:24:17.464065 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-97c22572-1a65-4703-bee9-d6c007b9313e tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 0489a6fa-1b33-4960-aff1-8e365ad4c996] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:17.470322 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-97c22572-1a65-4703-bee9-d6c007b9313e tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:17.470807 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-97c22572-1a65-4703-bee9-d6c007b9313e tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:17.471241 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-97c22572-1a65-4703-bee9-d6c007b9313e tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:17.471949 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-97c22572-1a65-4703-bee9-d6c007b9313e tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:17.472428 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-97c22572-1a65-4703-bee9-d6c007b9313e tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:17.472852 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-97c22572-1a65-4703-bee9-d6c007b9313e tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:17.541758 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-97c22572-1a65-4703-bee9-d6c007b9313e tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "POST /compute/v2.1/servers/0489a6fa-1b33-4960-aff1-8e365ad4c996/action" status: 200 len: 32643 microversion: 2.1 time: 0.087437 Aug 27 03:24:17.542670 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2924/5885] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:24:17 2022] POST /compute/v2.1/servers/0489a6fa-1b33-4960-aff1-8e365ad4c996/action => generated 32643 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:24:17.754452 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-60b97e5b-00a0-4493-a38c-eaa25e9e8753 tempest-TestNetworkAdvancedServerOps-1663634391 tempest-TestNetworkAdvancedServerOps-1663634391-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:24:17.755370 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-60b97e5b-00a0-4493-a38c-eaa25e9e8753 tempest-TestNetworkAdvancedServerOps-1663634391 tempest-TestNetworkAdvancedServerOps-1663634391-project-admin] [instance: 0489a6fa-1b33-4960-aff1-8e365ad4c996] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:17.764237 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-60b97e5b-00a0-4493-a38c-eaa25e9e8753 tempest-TestNetworkAdvancedServerOps-1663634391 tempest-TestNetworkAdvancedServerOps-1663634391-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:17.764782 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-60b97e5b-00a0-4493-a38c-eaa25e9e8753 tempest-TestNetworkAdvancedServerOps-1663634391 tempest-TestNetworkAdvancedServerOps-1663634391-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:17.765233 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-60b97e5b-00a0-4493-a38c-eaa25e9e8753 tempest-TestNetworkAdvancedServerOps-1663634391 tempest-TestNetworkAdvancedServerOps-1663634391-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:17.765949 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-60b97e5b-00a0-4493-a38c-eaa25e9e8753 tempest-TestNetworkAdvancedServerOps-1663634391 tempest-TestNetworkAdvancedServerOps-1663634391-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:17.766416 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-60b97e5b-00a0-4493-a38c-eaa25e9e8753 tempest-TestNetworkAdvancedServerOps-1663634391 tempest-TestNetworkAdvancedServerOps-1663634391-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:17.766857 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-60b97e5b-00a0-4493-a38c-eaa25e9e8753 tempest-TestNetworkAdvancedServerOps-1663634391 tempest-TestNetworkAdvancedServerOps-1663634391-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:17.806170 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-60b97e5b-00a0-4493-a38c-eaa25e9e8753 tempest-TestNetworkAdvancedServerOps-1663634391 tempest-TestNetworkAdvancedServerOps-1663634391-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'fad20a657f3e42c7b87739cd4626ddbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eff062c8d50d4175a0ebc1c3b9315e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:17.806779 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-60b97e5b-00a0-4493-a38c-eaa25e9e8753 tempest-TestNetworkAdvancedServerOps-1663634391 tempest-TestNetworkAdvancedServerOps-1663634391-project-admin] [instance: 0489a6fa-1b33-4960-aff1-8e365ad4c996] flavor_id is None. Assuming migration. {{(pid=134051) resize /opt/stack/nova/nova/compute/api.py:4194}} Aug 27 03:24:17.807238 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-60b97e5b-00a0-4493-a38c-eaa25e9e8753 tempest-TestNetworkAdvancedServerOps-1663634391 tempest-TestNetworkAdvancedServerOps-1663634391-project-admin] [instance: 0489a6fa-1b33-4960-aff1-8e365ad4c996] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=134051) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 27 03:24:18.015565 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-60b97e5b-00a0-4493-a38c-eaa25e9e8753 tempest-TestNetworkAdvancedServerOps-1663634391 tempest-TestNetworkAdvancedServerOps-1663634391-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/0489a6fa-1b33-4960-aff1-8e365ad4c996/action" status: 202 len: 0 microversion: 2.1 time: 0.267934 Aug 27 03:24:18.016114 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2962/5886] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:24:17 2022] POST /compute/v2.1/servers/0489a6fa-1b33-4960-aff1-8e365ad4c996/action => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:24:18.025648 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-1d9f9e92-db8c-43a4-a597-8b4e20b9764b tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:18.026348 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-1d9f9e92-db8c-43a4-a597-8b4e20b9764b tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 0489a6fa-1b33-4960-aff1-8e365ad4c996] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:18.035014 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1d9f9e92-db8c-43a4-a597-8b4e20b9764b tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:18.035495 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1d9f9e92-db8c-43a4-a597-8b4e20b9764b tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:18.035932 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1d9f9e92-db8c-43a4-a597-8b4e20b9764b tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:18.036794 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1d9f9e92-db8c-43a4-a597-8b4e20b9764b tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:18.037241 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1d9f9e92-db8c-43a4-a597-8b4e20b9764b tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:18.037664 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1d9f9e92-db8c-43a4-a597-8b4e20b9764b tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:18.218523 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-1d9f9e92-db8c-43a4-a597-8b4e20b9764b tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:18.226813 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-1d9f9e92-db8c-43a4-a597-8b4e20b9764b tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/0489a6fa-1b33-4960-aff1-8e365ad4c996" status: 200 len: 1689 microversion: 2.1 time: 0.205853 Aug 27 03:24:18.227474 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2925/5887] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:24:18 2022] GET /compute/v2.1/servers/0489a6fa-1b33-4960-aff1-8e365ad4c996 => generated 1689 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:24:19.250355 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b09c910b-20d4-4be3-88e0-2c7ddc9886bc tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:19.251678 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b09c910b-20d4-4be3-88e0-2c7ddc9886bc tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 0489a6fa-1b33-4960-aff1-8e365ad4c996] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:19.262506 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b09c910b-20d4-4be3-88e0-2c7ddc9886bc tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:19.263147 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b09c910b-20d4-4be3-88e0-2c7ddc9886bc tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:19.263761 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b09c910b-20d4-4be3-88e0-2c7ddc9886bc tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:19.264632 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b09c910b-20d4-4be3-88e0-2c7ddc9886bc tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:19.265132 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b09c910b-20d4-4be3-88e0-2c7ddc9886bc tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:19.265865 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b09c910b-20d4-4be3-88e0-2c7ddc9886bc tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:19.412846 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-b09c910b-20d4-4be3-88e0-2c7ddc9886bc tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:19.421162 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b09c910b-20d4-4be3-88e0-2c7ddc9886bc tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/0489a6fa-1b33-4960-aff1-8e365ad4c996" status: 200 len: 1689 microversion: 2.1 time: 0.176906 Aug 27 03:24:19.421715 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2963/5888] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:24:19 2022] GET /compute/v2.1/servers/0489a6fa-1b33-4960-aff1-8e365ad4c996 => generated 1689 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:24:20.444451 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-660e2ef9-e05a-4a5e-911c-4a783b70d8e9 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:20.445096 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-660e2ef9-e05a-4a5e-911c-4a783b70d8e9 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 0489a6fa-1b33-4960-aff1-8e365ad4c996] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:20.454054 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-660e2ef9-e05a-4a5e-911c-4a783b70d8e9 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:20.454562 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-660e2ef9-e05a-4a5e-911c-4a783b70d8e9 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:20.455049 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-660e2ef9-e05a-4a5e-911c-4a783b70d8e9 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:20.455947 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-660e2ef9-e05a-4a5e-911c-4a783b70d8e9 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:20.456428 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-660e2ef9-e05a-4a5e-911c-4a783b70d8e9 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:20.456857 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-660e2ef9-e05a-4a5e-911c-4a783b70d8e9 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:20.597191 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-660e2ef9-e05a-4a5e-911c-4a783b70d8e9 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:20.605365 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-660e2ef9-e05a-4a5e-911c-4a783b70d8e9 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/0489a6fa-1b33-4960-aff1-8e365ad4c996" status: 200 len: 1689 microversion: 2.1 time: 0.165617 Aug 27 03:24:20.605954 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2926/5889] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:24:20 2022] GET /compute/v2.1/servers/0489a6fa-1b33-4960-aff1-8e365ad4c996 => generated 1689 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:24:21.630230 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-1108b19f-524b-4983-bc30-232081fd6b63 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:21.631180 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-1108b19f-524b-4983-bc30-232081fd6b63 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 0489a6fa-1b33-4960-aff1-8e365ad4c996] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:21.641682 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1108b19f-524b-4983-bc30-232081fd6b63 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:21.642353 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1108b19f-524b-4983-bc30-232081fd6b63 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:21.643033 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1108b19f-524b-4983-bc30-232081fd6b63 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:21.644155 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1108b19f-524b-4983-bc30-232081fd6b63 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:21.644932 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1108b19f-524b-4983-bc30-232081fd6b63 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:21.645499 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1108b19f-524b-4983-bc30-232081fd6b63 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:21.791257 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-1108b19f-524b-4983-bc30-232081fd6b63 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:21.800284 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-1108b19f-524b-4983-bc30-232081fd6b63 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/0489a6fa-1b33-4960-aff1-8e365ad4c996" status: 200 len: 1694 microversion: 2.1 time: 0.176540 Aug 27 03:24:21.800935 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2964/5890] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:24:21 2022] GET /compute/v2.1/servers/0489a6fa-1b33-4960-aff1-8e365ad4c996 => generated 1694 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:24:22.823057 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ff0f8d06-5287-4043-a5be-e01f16677ba1 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:22.823686 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-ff0f8d06-5287-4043-a5be-e01f16677ba1 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 0489a6fa-1b33-4960-aff1-8e365ad4c996] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:22.831408 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ff0f8d06-5287-4043-a5be-e01f16677ba1 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:22.831909 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ff0f8d06-5287-4043-a5be-e01f16677ba1 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:22.832377 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ff0f8d06-5287-4043-a5be-e01f16677ba1 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:22.833092 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ff0f8d06-5287-4043-a5be-e01f16677ba1 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:22.833550 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ff0f8d06-5287-4043-a5be-e01f16677ba1 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:22.833976 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ff0f8d06-5287-4043-a5be-e01f16677ba1 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:22.987814 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-ff0f8d06-5287-4043-a5be-e01f16677ba1 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:22.997860 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ff0f8d06-5287-4043-a5be-e01f16677ba1 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/0489a6fa-1b33-4960-aff1-8e365ad4c996" status: 200 len: 1694 microversion: 2.1 time: 0.178863 Aug 27 03:24:22.998530 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2927/5891] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:24:22 2022] GET /compute/v2.1/servers/0489a6fa-1b33-4960-aff1-8e365ad4c996 => generated 1694 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:24:24.020982 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e998a54c-d059-41f0-8e8c-6ad17746d6e1 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:24.021608 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-e998a54c-d059-41f0-8e8c-6ad17746d6e1 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 0489a6fa-1b33-4960-aff1-8e365ad4c996] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:24.029296 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e998a54c-d059-41f0-8e8c-6ad17746d6e1 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:24.029804 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e998a54c-d059-41f0-8e8c-6ad17746d6e1 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:24.030257 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e998a54c-d059-41f0-8e8c-6ad17746d6e1 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:24.031066 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e998a54c-d059-41f0-8e8c-6ad17746d6e1 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:24.031619 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e998a54c-d059-41f0-8e8c-6ad17746d6e1 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:24.032064 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e998a54c-d059-41f0-8e8c-6ad17746d6e1 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:24.184027 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e998a54c-d059-41f0-8e8c-6ad17746d6e1 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:24.192467 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e998a54c-d059-41f0-8e8c-6ad17746d6e1 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/0489a6fa-1b33-4960-aff1-8e365ad4c996" status: 200 len: 1694 microversion: 2.1 time: 0.176075 Aug 27 03:24:24.193049 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2965/5892] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:24:24 2022] GET /compute/v2.1/servers/0489a6fa-1b33-4960-aff1-8e365ad4c996 => generated 1694 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:24:25.214644 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-59fb08cc-0f15-4da8-8bb4-392138a1a9f2 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:25.215308 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-59fb08cc-0f15-4da8-8bb4-392138a1a9f2 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 0489a6fa-1b33-4960-aff1-8e365ad4c996] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:25.223216 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-59fb08cc-0f15-4da8-8bb4-392138a1a9f2 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:25.223713 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-59fb08cc-0f15-4da8-8bb4-392138a1a9f2 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:25.224151 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-59fb08cc-0f15-4da8-8bb4-392138a1a9f2 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:25.224903 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-59fb08cc-0f15-4da8-8bb4-392138a1a9f2 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:25.225345 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-59fb08cc-0f15-4da8-8bb4-392138a1a9f2 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:25.225785 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-59fb08cc-0f15-4da8-8bb4-392138a1a9f2 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:25.372094 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-59fb08cc-0f15-4da8-8bb4-392138a1a9f2 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:25.381956 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-59fb08cc-0f15-4da8-8bb4-392138a1a9f2 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/0489a6fa-1b33-4960-aff1-8e365ad4c996" status: 200 len: 1694 microversion: 2.1 time: 0.171406 Aug 27 03:24:25.382777 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2928/5893] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:24:25 2022] GET /compute/v2.1/servers/0489a6fa-1b33-4960-aff1-8e365ad4c996 => generated 1694 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:24:26.405959 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-9569a573-ddda-4596-b4c2-41c564ea8c71 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:26.406643 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-9569a573-ddda-4596-b4c2-41c564ea8c71 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 0489a6fa-1b33-4960-aff1-8e365ad4c996] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:26.414064 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9569a573-ddda-4596-b4c2-41c564ea8c71 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:26.414578 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9569a573-ddda-4596-b4c2-41c564ea8c71 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:26.415022 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9569a573-ddda-4596-b4c2-41c564ea8c71 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:26.415784 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9569a573-ddda-4596-b4c2-41c564ea8c71 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:26.416245 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9569a573-ddda-4596-b4c2-41c564ea8c71 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:26.416761 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9569a573-ddda-4596-b4c2-41c564ea8c71 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:26.570835 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-9569a573-ddda-4596-b4c2-41c564ea8c71 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:26.581588 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-9569a573-ddda-4596-b4c2-41c564ea8c71 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/0489a6fa-1b33-4960-aff1-8e365ad4c996" status: 200 len: 1694 microversion: 2.1 time: 0.180082 Aug 27 03:24:26.582186 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2966/5894] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:24:26 2022] GET /compute/v2.1/servers/0489a6fa-1b33-4960-aff1-8e365ad4c996 => generated 1694 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:24:27.606222 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-059669aa-57dc-46de-a75f-4dd7368fa12a tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:27.607067 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-059669aa-57dc-46de-a75f-4dd7368fa12a tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 0489a6fa-1b33-4960-aff1-8e365ad4c996] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:27.617676 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-059669aa-57dc-46de-a75f-4dd7368fa12a tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:27.618387 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-059669aa-57dc-46de-a75f-4dd7368fa12a tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:27.619050 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-059669aa-57dc-46de-a75f-4dd7368fa12a tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:27.620147 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-059669aa-57dc-46de-a75f-4dd7368fa12a tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:27.620887 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-059669aa-57dc-46de-a75f-4dd7368fa12a tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:27.621487 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-059669aa-57dc-46de-a75f-4dd7368fa12a tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:27.770538 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-059669aa-57dc-46de-a75f-4dd7368fa12a tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:27.778809 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-059669aa-57dc-46de-a75f-4dd7368fa12a tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/0489a6fa-1b33-4960-aff1-8e365ad4c996" status: 200 len: 1694 microversion: 2.1 time: 0.178972 Aug 27 03:24:27.779365 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2929/5895] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:24:27 2022] GET /compute/v2.1/servers/0489a6fa-1b33-4960-aff1-8e365ad4c996 => generated 1694 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:24:28.804666 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e871cbf8-a442-4f89-b66f-8f20f0c99306 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:28.805605 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-e871cbf8-a442-4f89-b66f-8f20f0c99306 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 0489a6fa-1b33-4960-aff1-8e365ad4c996] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:28.815765 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e871cbf8-a442-4f89-b66f-8f20f0c99306 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:28.816280 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e871cbf8-a442-4f89-b66f-8f20f0c99306 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:28.816764 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e871cbf8-a442-4f89-b66f-8f20f0c99306 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:28.817484 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e871cbf8-a442-4f89-b66f-8f20f0c99306 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:28.817958 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e871cbf8-a442-4f89-b66f-8f20f0c99306 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:28.818397 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e871cbf8-a442-4f89-b66f-8f20f0c99306 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:28.958077 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e871cbf8-a442-4f89-b66f-8f20f0c99306 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:28.966529 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e871cbf8-a442-4f89-b66f-8f20f0c99306 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/0489a6fa-1b33-4960-aff1-8e365ad4c996" status: 200 len: 1694 microversion: 2.1 time: 0.168719 Aug 27 03:24:28.967118 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2967/5896] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:24:28 2022] GET /compute/v2.1/servers/0489a6fa-1b33-4960-aff1-8e365ad4c996 => generated 1694 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:24:29.988525 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f9772ad2-7750-45c3-998f-6bef2da882df tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:29.989152 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-f9772ad2-7750-45c3-998f-6bef2da882df tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 0489a6fa-1b33-4960-aff1-8e365ad4c996] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:29.997484 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f9772ad2-7750-45c3-998f-6bef2da882df tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:29.997977 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f9772ad2-7750-45c3-998f-6bef2da882df tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:29.998465 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f9772ad2-7750-45c3-998f-6bef2da882df tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:29.999162 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f9772ad2-7750-45c3-998f-6bef2da882df tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:29.999623 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f9772ad2-7750-45c3-998f-6bef2da882df tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:30.000058 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f9772ad2-7750-45c3-998f-6bef2da882df tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:30.143725 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-f9772ad2-7750-45c3-998f-6bef2da882df tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:30.156452 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f9772ad2-7750-45c3-998f-6bef2da882df tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/0489a6fa-1b33-4960-aff1-8e365ad4c996" status: 200 len: 1694 microversion: 2.1 time: 0.171957 Aug 27 03:24:30.157042 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2930/5897] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:24:29 2022] GET /compute/v2.1/servers/0489a6fa-1b33-4960-aff1-8e365ad4c996 => generated 1694 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:24:31.181084 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-67e59bcc-ed50-4798-b82e-c455af0a3312 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:31.181711 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-67e59bcc-ed50-4798-b82e-c455af0a3312 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 0489a6fa-1b33-4960-aff1-8e365ad4c996] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:31.189388 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-67e59bcc-ed50-4798-b82e-c455af0a3312 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:31.189893 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-67e59bcc-ed50-4798-b82e-c455af0a3312 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:31.190341 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-67e59bcc-ed50-4798-b82e-c455af0a3312 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:31.191053 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-67e59bcc-ed50-4798-b82e-c455af0a3312 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:31.191515 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-67e59bcc-ed50-4798-b82e-c455af0a3312 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:31.191952 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-67e59bcc-ed50-4798-b82e-c455af0a3312 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:31.334559 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-67e59bcc-ed50-4798-b82e-c455af0a3312 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:31.342682 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-67e59bcc-ed50-4798-b82e-c455af0a3312 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/0489a6fa-1b33-4960-aff1-8e365ad4c996" status: 200 len: 1694 microversion: 2.1 time: 0.166192 Aug 27 03:24:31.343283 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2968/5898] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:24:31 2022] GET /compute/v2.1/servers/0489a6fa-1b33-4960-aff1-8e365ad4c996 => generated 1694 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:24:32.364669 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-68921b14-7a35-4851-9b0d-08862554c0b8 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:32.365269 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-68921b14-7a35-4851-9b0d-08862554c0b8 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 0489a6fa-1b33-4960-aff1-8e365ad4c996] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:32.373212 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-68921b14-7a35-4851-9b0d-08862554c0b8 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:32.373700 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-68921b14-7a35-4851-9b0d-08862554c0b8 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:32.374139 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-68921b14-7a35-4851-9b0d-08862554c0b8 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:32.374850 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-68921b14-7a35-4851-9b0d-08862554c0b8 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:32.375301 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-68921b14-7a35-4851-9b0d-08862554c0b8 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:32.375761 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-68921b14-7a35-4851-9b0d-08862554c0b8 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:32.538624 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-68921b14-7a35-4851-9b0d-08862554c0b8 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:32.547347 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-68921b14-7a35-4851-9b0d-08862554c0b8 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/0489a6fa-1b33-4960-aff1-8e365ad4c996" status: 200 len: 1694 microversion: 2.1 time: 0.186968 Aug 27 03:24:32.548242 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2931/5899] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:24:32 2022] GET /compute/v2.1/servers/0489a6fa-1b33-4960-aff1-8e365ad4c996 => generated 1694 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:24:33.174306 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-807f95d1-5b7d-4e7c-a160-c4fea092138f req-7ae5681c-c209-40d6-b21a-66b9d90651fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0489a6fa-1b33-4960-aff1-8e365ad4c996", "name": "network-vif-unplugged", "status": "completed", "tag": "1e7b739d-0500-4bee-8d6f-5ad9f5006661"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:24:33.186806 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-807f95d1-5b7d-4e7c-a160-c4fea092138f req-7ae5681c-c209-40d6-b21a-66b9d90651fe service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:33.187290 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-807f95d1-5b7d-4e7c-a160-c4fea092138f req-7ae5681c-c209-40d6-b21a-66b9d90651fe service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:33.187729 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-807f95d1-5b7d-4e7c-a160-c4fea092138f req-7ae5681c-c209-40d6-b21a-66b9d90651fe service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:33.200239 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-807f95d1-5b7d-4e7c-a160-c4fea092138f req-7ae5681c-c209-40d6-b21a-66b9d90651fe service nova] Creating event network-vif-unplugged:1e7b739d-0500-4bee-8d6f-5ad9f5006661 for instance 0489a6fa-1b33-4960-aff1-8e365ad4c996 on n-h2-852278-4 Aug 27 03:24:33.206267 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [req-807f95d1-5b7d-4e7c-a160-c4fea092138f req-7ae5681c-c209-40d6-b21a-66b9d90651fe service nova] Instance 0489a6fa-1b33-4960-aff1-8e365ad4c996 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-852278-4', 'n-h1-852278-4'} {{(pid=134051) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 03:24:33.217984 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-807f95d1-5b7d-4e7c-a160-c4fea092138f req-7ae5681c-c209-40d6-b21a-66b9d90651fe service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048196 Aug 27 03:24:33.218821 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2969/5900] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:24:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:24:33.568874 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-db50c55d-47ee-41c0-ac08-fd52516ed81e tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:33.569504 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-db50c55d-47ee-41c0-ac08-fd52516ed81e tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 0489a6fa-1b33-4960-aff1-8e365ad4c996] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:33.576614 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-db50c55d-47ee-41c0-ac08-fd52516ed81e tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:33.577124 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-db50c55d-47ee-41c0-ac08-fd52516ed81e tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:33.577564 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-db50c55d-47ee-41c0-ac08-fd52516ed81e tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:33.578261 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-db50c55d-47ee-41c0-ac08-fd52516ed81e tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:33.578733 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-db50c55d-47ee-41c0-ac08-fd52516ed81e tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:33.579247 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-db50c55d-47ee-41c0-ac08-fd52516ed81e tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:33.807270 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-db50c55d-47ee-41c0-ac08-fd52516ed81e tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:33.817363 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-db50c55d-47ee-41c0-ac08-fd52516ed81e tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/0489a6fa-1b33-4960-aff1-8e365ad4c996" status: 200 len: 1693 microversion: 2.1 time: 0.252456 Aug 27 03:24:33.818054 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2932/5901] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:24:33 2022] GET /compute/v2.1/servers/0489a6fa-1b33-4960-aff1-8e365ad4c996 => generated 1693 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:24:34.844260 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f5cbc954-d1cc-48cc-a6b9-1b466285d516 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:34.845603 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-f5cbc954-d1cc-48cc-a6b9-1b466285d516 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 0489a6fa-1b33-4960-aff1-8e365ad4c996] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:34.853468 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f5cbc954-d1cc-48cc-a6b9-1b466285d516 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:34.853975 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f5cbc954-d1cc-48cc-a6b9-1b466285d516 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:34.854432 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f5cbc954-d1cc-48cc-a6b9-1b466285d516 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:34.855150 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f5cbc954-d1cc-48cc-a6b9-1b466285d516 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:34.855623 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f5cbc954-d1cc-48cc-a6b9-1b466285d516 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:34.856064 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f5cbc954-d1cc-48cc-a6b9-1b466285d516 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:35.007574 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-f5cbc954-d1cc-48cc-a6b9-1b466285d516 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:35.015955 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-f5cbc954-d1cc-48cc-a6b9-1b466285d516 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/0489a6fa-1b33-4960-aff1-8e365ad4c996" status: 200 len: 1691 microversion: 2.1 time: 0.178961 Aug 27 03:24:35.016579 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2970/5902] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:24:34 2022] GET /compute/v2.1/servers/0489a6fa-1b33-4960-aff1-8e365ad4c996 => generated 1691 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:24:35.241133 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-4c38515a-ac73-4e1b-932b-ccc597cf8e94 req-d3440e4e-7774-4d5f-9a70-24d6b8938753 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0489a6fa-1b33-4960-aff1-8e365ad4c996", "tag": "1e7b739d-0500-4bee-8d6f-5ad9f5006661"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:24:35.251900 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-4c38515a-ac73-4e1b-932b-ccc597cf8e94 req-d3440e4e-7774-4d5f-9a70-24d6b8938753 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:35.252427 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-4c38515a-ac73-4e1b-932b-ccc597cf8e94 req-d3440e4e-7774-4d5f-9a70-24d6b8938753 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:35.252843 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-4c38515a-ac73-4e1b-932b-ccc597cf8e94 req-d3440e4e-7774-4d5f-9a70-24d6b8938753 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:35.265101 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-4c38515a-ac73-4e1b-932b-ccc597cf8e94 req-d3440e4e-7774-4d5f-9a70-24d6b8938753 service nova] Creating event network-changed:1e7b739d-0500-4bee-8d6f-5ad9f5006661 for instance 0489a6fa-1b33-4960-aff1-8e365ad4c996 on n-h2-852278-4 Aug 27 03:24:35.270741 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [req-4c38515a-ac73-4e1b-932b-ccc597cf8e94 req-d3440e4e-7774-4d5f-9a70-24d6b8938753 service nova] Instance 0489a6fa-1b33-4960-aff1-8e365ad4c996 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-852278-4', 'n-h1-852278-4'} {{(pid=134052) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 03:24:35.281824 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-4c38515a-ac73-4e1b-932b-ccc597cf8e94 req-d3440e4e-7774-4d5f-9a70-24d6b8938753 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044567 Aug 27 03:24:35.282440 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2933/5903] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:24:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:24:36.037969 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f3210508-98ef-461b-9a5d-40df7f6c99b4 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:36.038611 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-f3210508-98ef-461b-9a5d-40df7f6c99b4 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 0489a6fa-1b33-4960-aff1-8e365ad4c996] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:36.046052 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f3210508-98ef-461b-9a5d-40df7f6c99b4 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:36.046544 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f3210508-98ef-461b-9a5d-40df7f6c99b4 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:36.047000 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f3210508-98ef-461b-9a5d-40df7f6c99b4 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:36.047722 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f3210508-98ef-461b-9a5d-40df7f6c99b4 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:36.048192 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f3210508-98ef-461b-9a5d-40df7f6c99b4 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:36.048674 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f3210508-98ef-461b-9a5d-40df7f6c99b4 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:36.187762 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-f3210508-98ef-461b-9a5d-40df7f6c99b4 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:36.196164 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-f3210508-98ef-461b-9a5d-40df7f6c99b4 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/0489a6fa-1b33-4960-aff1-8e365ad4c996" status: 200 len: 1688 microversion: 2.1 time: 0.162372 Aug 27 03:24:36.196830 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2971/5904] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:24:36 2022] GET /compute/v2.1/servers/0489a6fa-1b33-4960-aff1-8e365ad4c996 => generated 1688 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:24:36.217460 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-cc9c0513-a757-433d-ae52-f6cd31deec7b tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:24:36.218088 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-cc9c0513-a757-433d-ae52-f6cd31deec7b tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 0489a6fa-1b33-4960-aff1-8e365ad4c996] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:36.224675 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cc9c0513-a757-433d-ae52-f6cd31deec7b tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:36.225157 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cc9c0513-a757-433d-ae52-f6cd31deec7b tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:36.225596 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cc9c0513-a757-433d-ae52-f6cd31deec7b tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:36.226288 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cc9c0513-a757-433d-ae52-f6cd31deec7b tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:36.226737 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cc9c0513-a757-433d-ae52-f6cd31deec7b tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:36.227162 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cc9c0513-a757-433d-ae52-f6cd31deec7b tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:36.291946 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-cc9c0513-a757-433d-ae52-f6cd31deec7b tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "POST /compute/v2.1/servers/0489a6fa-1b33-4960-aff1-8e365ad4c996/action" status: 204 len: 0 microversion: 2.1 time: 0.078684 Aug 27 03:24:36.292634 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2934/5905] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:24:36 2022] POST /compute/v2.1/servers/0489a6fa-1b33-4960-aff1-8e365ad4c996/action => generated 0 bytes in 80 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:24:36.301306 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-5c7efefd-b52e-476a-b898-173bcaa8e964 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:36.302174 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-5c7efefd-b52e-476a-b898-173bcaa8e964 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 0489a6fa-1b33-4960-aff1-8e365ad4c996] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:36.308968 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5c7efefd-b52e-476a-b898-173bcaa8e964 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:36.309633 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5c7efefd-b52e-476a-b898-173bcaa8e964 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:36.310033 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5c7efefd-b52e-476a-b898-173bcaa8e964 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:36.310804 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5c7efefd-b52e-476a-b898-173bcaa8e964 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:36.311295 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5c7efefd-b52e-476a-b898-173bcaa8e964 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:36.311728 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5c7efefd-b52e-476a-b898-173bcaa8e964 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:36.452890 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-5c7efefd-b52e-476a-b898-173bcaa8e964 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:36.462605 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-5c7efefd-b52e-476a-b898-173bcaa8e964 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/0489a6fa-1b33-4960-aff1-8e365ad4c996" status: 200 len: 1688 microversion: 2.1 time: 0.165532 Aug 27 03:24:36.463555 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2972/5906] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:24:36 2022] GET /compute/v2.1/servers/0489a6fa-1b33-4960-aff1-8e365ad4c996 => generated 1688 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:24:37.490270 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-70363e9a-5b70-4cac-9a95-f2d45bb7eb8f tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:37.490968 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-70363e9a-5b70-4cac-9a95-f2d45bb7eb8f tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 0489a6fa-1b33-4960-aff1-8e365ad4c996] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:37.497825 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-70363e9a-5b70-4cac-9a95-f2d45bb7eb8f tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:37.498312 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-70363e9a-5b70-4cac-9a95-f2d45bb7eb8f tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:37.498751 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-70363e9a-5b70-4cac-9a95-f2d45bb7eb8f tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:37.499450 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-70363e9a-5b70-4cac-9a95-f2d45bb7eb8f tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:37.499904 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-70363e9a-5b70-4cac-9a95-f2d45bb7eb8f tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:37.500353 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-70363e9a-5b70-4cac-9a95-f2d45bb7eb8f tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:37.636486 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-70363e9a-5b70-4cac-9a95-f2d45bb7eb8f tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:37.645358 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-70363e9a-5b70-4cac-9a95-f2d45bb7eb8f tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/0489a6fa-1b33-4960-aff1-8e365ad4c996" status: 200 len: 1688 microversion: 2.1 time: 0.162699 Aug 27 03:24:37.646201 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2935/5907] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:24:37 2022] GET /compute/v2.1/servers/0489a6fa-1b33-4960-aff1-8e365ad4c996 => generated 1688 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:24:38.635609 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-6be402a0-60fa-4e8d-9b1b-0f37f9517b3f req-b48604d5-fa7a-4935-83e8-76b98e41f672 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0489a6fa-1b33-4960-aff1-8e365ad4c996", "name": "network-vif-plugged", "status": "completed", "tag": "1e7b739d-0500-4bee-8d6f-5ad9f5006661"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:24:38.649186 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-6be402a0-60fa-4e8d-9b1b-0f37f9517b3f req-b48604d5-fa7a-4935-83e8-76b98e41f672 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:38.649683 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-6be402a0-60fa-4e8d-9b1b-0f37f9517b3f req-b48604d5-fa7a-4935-83e8-76b98e41f672 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:38.650134 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-6be402a0-60fa-4e8d-9b1b-0f37f9517b3f req-b48604d5-fa7a-4935-83e8-76b98e41f672 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:38.665416 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-6be402a0-60fa-4e8d-9b1b-0f37f9517b3f req-b48604d5-fa7a-4935-83e8-76b98e41f672 service nova] Creating event network-vif-plugged:1e7b739d-0500-4bee-8d6f-5ad9f5006661 for instance 0489a6fa-1b33-4960-aff1-8e365ad4c996 on n-h2-852278-4 Aug 27 03:24:38.669826 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-1de9ee07-c4f5-4dc8-88e9-eb111784f5c0 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:38.670566 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-1de9ee07-c4f5-4dc8-88e9-eb111784f5c0 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 0489a6fa-1b33-4960-aff1-8e365ad4c996] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:38.670686 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-6be402a0-60fa-4e8d-9b1b-0f37f9517b3f req-b48604d5-fa7a-4935-83e8-76b98e41f672 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039379 Aug 27 03:24:38.671454 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2973/5908] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:24:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:24:38.677571 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1de9ee07-c4f5-4dc8-88e9-eb111784f5c0 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:38.678052 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1de9ee07-c4f5-4dc8-88e9-eb111784f5c0 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:38.678489 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1de9ee07-c4f5-4dc8-88e9-eb111784f5c0 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:38.679192 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1de9ee07-c4f5-4dc8-88e9-eb111784f5c0 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:38.679632 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1de9ee07-c4f5-4dc8-88e9-eb111784f5c0 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:38.680140 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1de9ee07-c4f5-4dc8-88e9-eb111784f5c0 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:38.816812 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-1de9ee07-c4f5-4dc8-88e9-eb111784f5c0 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:38.829654 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-1de9ee07-c4f5-4dc8-88e9-eb111784f5c0 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/0489a6fa-1b33-4960-aff1-8e365ad4c996" status: 200 len: 1680 microversion: 2.1 time: 0.163690 Aug 27 03:24:38.830489 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2936/5909] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:24:38 2022] GET /compute/v2.1/servers/0489a6fa-1b33-4960-aff1-8e365ad4c996 => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:25:01.058651 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-fe048833-862b-4d29-991f-e53de00ed048 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:25:01.061055 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-fe048833-862b-4d29-991f-e53de00ed048 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 0489a6fa-1b33-4960-aff1-8e365ad4c996] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:01.063993 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=28 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:25:01.064702 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:25:01.070874 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fe048833-862b-4d29-991f-e53de00ed048 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:01.071380 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fe048833-862b-4d29-991f-e53de00ed048 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:01.071836 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fe048833-862b-4d29-991f-e53de00ed048 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:01.072578 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fe048833-862b-4d29-991f-e53de00ed048 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:01.073054 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fe048833-862b-4d29-991f-e53de00ed048 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:01.073612 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fe048833-862b-4d29-991f-e53de00ed048 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:01.137671 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-fe048833-862b-4d29-991f-e53de00ed048 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "POST /compute/v2.1/servers/0489a6fa-1b33-4960-aff1-8e365ad4c996/action" status: 200 len: 24577 microversion: 2.1 time: 0.083756 Aug 27 03:25:01.138315 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2974/5910] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:25:01 2022] POST /compute/v2.1/servers/0489a6fa-1b33-4960-aff1-8e365ad4c996/action => generated 24577 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:25:07.616290 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9a442f71-6db7-4707-826d-e2deb5fa5e47 tempest-TestNetworkAdvancedServerOps-1663634391 tempest-TestNetworkAdvancedServerOps-1663634391-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:07.617336 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-9a442f71-6db7-4707-826d-e2deb5fa5e47 tempest-TestNetworkAdvancedServerOps-1663634391 tempest-TestNetworkAdvancedServerOps-1663634391-project-admin] [instance: 0489a6fa-1b33-4960-aff1-8e365ad4c996] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:07.621136 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=28 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:25:07.622224 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:25:07.632473 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9a442f71-6db7-4707-826d-e2deb5fa5e47 tempest-TestNetworkAdvancedServerOps-1663634391 tempest-TestNetworkAdvancedServerOps-1663634391-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:07.632976 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9a442f71-6db7-4707-826d-e2deb5fa5e47 tempest-TestNetworkAdvancedServerOps-1663634391 tempest-TestNetworkAdvancedServerOps-1663634391-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:07.633411 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9a442f71-6db7-4707-826d-e2deb5fa5e47 tempest-TestNetworkAdvancedServerOps-1663634391 tempest-TestNetworkAdvancedServerOps-1663634391-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:07.634111 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9a442f71-6db7-4707-826d-e2deb5fa5e47 tempest-TestNetworkAdvancedServerOps-1663634391 tempest-TestNetworkAdvancedServerOps-1663634391-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:07.634584 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9a442f71-6db7-4707-826d-e2deb5fa5e47 tempest-TestNetworkAdvancedServerOps-1663634391 tempest-TestNetworkAdvancedServerOps-1663634391-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:07.635000 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9a442f71-6db7-4707-826d-e2deb5fa5e47 tempest-TestNetworkAdvancedServerOps-1663634391 tempest-TestNetworkAdvancedServerOps-1663634391-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:07.850729 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9a442f71-6db7-4707-826d-e2deb5fa5e47 tempest-TestNetworkAdvancedServerOps-1663634391 tempest-TestNetworkAdvancedServerOps-1663634391-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/0489a6fa-1b33-4960-aff1-8e365ad4c996" status: 200 len: 1831 microversion: 2.1 time: 0.241031 Aug 27 03:25:07.851361 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2937/5911] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:25:07 2022] GET /compute/v2.1/servers/0489a6fa-1b33-4960-aff1-8e365ad4c996 => generated 1831 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:25:09.031824 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-540253f1-9e33-4864-9dc4-b402ede0ddbc tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:09.032455 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-540253f1-9e33-4864-9dc4-b402ede0ddbc tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 0489a6fa-1b33-4960-aff1-8e365ad4c996] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:09.034780 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-38a784bf-8b0e-41af-9354-5859c082f41a req-d1d5c9bc-3ca5-40bf-bb81-5155ae474120 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0489a6fa-1b33-4960-aff1-8e365ad4c996", "tag": "1e7b739d-0500-4bee-8d6f-5ad9f5006661"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:25:09.042806 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-540253f1-9e33-4864-9dc4-b402ede0ddbc tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:09.043411 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-540253f1-9e33-4864-9dc4-b402ede0ddbc tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:09.043890 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-540253f1-9e33-4864-9dc4-b402ede0ddbc tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:09.044985 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-540253f1-9e33-4864-9dc4-b402ede0ddbc tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:09.045422 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-540253f1-9e33-4864-9dc4-b402ede0ddbc tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:09.046098 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-540253f1-9e33-4864-9dc4-b402ede0ddbc tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:09.046545 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-38a784bf-8b0e-41af-9354-5859c082f41a req-d1d5c9bc-3ca5-40bf-bb81-5155ae474120 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:09.047036 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-38a784bf-8b0e-41af-9354-5859c082f41a req-d1d5c9bc-3ca5-40bf-bb81-5155ae474120 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:09.047507 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-38a784bf-8b0e-41af-9354-5859c082f41a req-d1d5c9bc-3ca5-40bf-bb81-5155ae474120 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:09.059972 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-38a784bf-8b0e-41af-9354-5859c082f41a req-d1d5c9bc-3ca5-40bf-bb81-5155ae474120 service nova] Creating event network-changed:1e7b739d-0500-4bee-8d6f-5ad9f5006661 for instance 0489a6fa-1b33-4960-aff1-8e365ad4c996 on n-h2-852278-4 Aug 27 03:25:09.065313 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-38a784bf-8b0e-41af-9354-5859c082f41a req-d1d5c9bc-3ca5-40bf-bb81-5155ae474120 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035438 Aug 27 03:25:09.066092 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2938/5912] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:25:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:25:09.077397 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-540253f1-9e33-4864-9dc4-b402ede0ddbc tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 0489a6fa-1b33-4960-aff1-8e365ad4c996] Going to try to terminate instance {{(pid=134051) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:25:09.163591 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-540253f1-9e33-4864-9dc4-b402ede0ddbc tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "DELETE /compute/v2.1/servers/0489a6fa-1b33-4960-aff1-8e365ad4c996" status: 204 len: 0 microversion: 2.1 time: 0.135773 Aug 27 03:25:09.164547 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2975/5913] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 03:25:09 2022] DELETE /compute/v2.1/servers/0489a6fa-1b33-4960-aff1-8e365ad4c996 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:25:09.174057 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c4dbaac0-b94e-41e5-8b13-430701649822 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:09.175329 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-c4dbaac0-b94e-41e5-8b13-430701649822 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 0489a6fa-1b33-4960-aff1-8e365ad4c996] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:09.186144 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c4dbaac0-b94e-41e5-8b13-430701649822 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:09.187131 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c4dbaac0-b94e-41e5-8b13-430701649822 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:09.187772 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c4dbaac0-b94e-41e5-8b13-430701649822 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:09.188553 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c4dbaac0-b94e-41e5-8b13-430701649822 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:09.189027 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c4dbaac0-b94e-41e5-8b13-430701649822 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:09.189706 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c4dbaac0-b94e-41e5-8b13-430701649822 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:09.350847 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-c4dbaac0-b94e-41e5-8b13-430701649822 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:09.362867 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c4dbaac0-b94e-41e5-8b13-430701649822 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/0489a6fa-1b33-4960-aff1-8e365ad4c996" status: 200 len: 1686 microversion: 2.1 time: 0.193712 Aug 27 03:25:09.363651 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2939/5914] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:25:09 2022] GET /compute/v2.1/servers/0489a6fa-1b33-4960-aff1-8e365ad4c996 => generated 1686 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:25:10.388708 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-81de3e82-b656-452c-90ed-c76e3181a16f tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:10.389468 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-81de3e82-b656-452c-90ed-c76e3181a16f tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 0489a6fa-1b33-4960-aff1-8e365ad4c996] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:10.398314 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-81de3e82-b656-452c-90ed-c76e3181a16f tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:10.398836 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-81de3e82-b656-452c-90ed-c76e3181a16f tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:10.399297 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-81de3e82-b656-452c-90ed-c76e3181a16f tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:10.400086 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-81de3e82-b656-452c-90ed-c76e3181a16f tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:10.400786 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-81de3e82-b656-452c-90ed-c76e3181a16f tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:10.401257 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-81de3e82-b656-452c-90ed-c76e3181a16f tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:10.766210 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-81de3e82-b656-452c-90ed-c76e3181a16f tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:10.774784 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-81de3e82-b656-452c-90ed-c76e3181a16f tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/0489a6fa-1b33-4960-aff1-8e365ad4c996" status: 200 len: 1686 microversion: 2.1 time: 0.393255 Aug 27 03:25:10.775433 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2976/5915] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:25:10 2022] GET /compute/v2.1/servers/0489a6fa-1b33-4960-aff1-8e365ad4c996 => generated 1686 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:25:11.216807 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-1c8b3f72-c1a5-411a-9ecc-4e16849e1086 req-bd052e4c-7d15-4bd7-8dcb-e7926ae53a04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0489a6fa-1b33-4960-aff1-8e365ad4c996", "name": "network-vif-deleted", "tag": "1e7b739d-0500-4bee-8d6f-5ad9f5006661"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:25:11.222613 n-d-852278-4 devstack@n-api.service[134052]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:25:11.222803 n-d-852278-4 devstack@n-api.service[134052]: Sat Aug 27 03:25:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.70) !!! Aug 27 03:25:11.231679 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-1c8b3f72-c1a5-411a-9ecc-4e16849e1086 req-bd052e4c-7d15-4bd7-8dcb-e7926ae53a04 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:11.232160 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-1c8b3f72-c1a5-411a-9ecc-4e16849e1086 req-bd052e4c-7d15-4bd7-8dcb-e7926ae53a04 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:11.232622 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-1c8b3f72-c1a5-411a-9ecc-4e16849e1086 req-bd052e4c-7d15-4bd7-8dcb-e7926ae53a04 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:11.244704 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-1c8b3f72-c1a5-411a-9ecc-4e16849e1086 req-bd052e4c-7d15-4bd7-8dcb-e7926ae53a04 service nova] Creating event network-vif-deleted:1e7b739d-0500-4bee-8d6f-5ad9f5006661 for instance 0489a6fa-1b33-4960-aff1-8e365ad4c996 on n-h2-852278-4 Aug 27 03:25:11.249602 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-1c8b3f72-c1a5-411a-9ecc-4e16849e1086 req-bd052e4c-7d15-4bd7-8dcb-e7926ae53a04 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036602 Aug 27 03:25:11.250249 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2940/5916] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:25:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:25:11.797278 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7dc85382-62cc-4c84-82e9-e3207022876b tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:11.797897 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-7dc85382-62cc-4c84-82e9-e3207022876b tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 0489a6fa-1b33-4960-aff1-8e365ad4c996] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:11.804934 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7dc85382-62cc-4c84-82e9-e3207022876b tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:11.805435 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7dc85382-62cc-4c84-82e9-e3207022876b tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:11.806217 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7dc85382-62cc-4c84-82e9-e3207022876b tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:11.806929 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7dc85382-62cc-4c84-82e9-e3207022876b tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:11.807384 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7dc85382-62cc-4c84-82e9-e3207022876b tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:11.807819 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7dc85382-62cc-4c84-82e9-e3207022876b tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:11.822364 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-7dc85382-62cc-4c84-82e9-e3207022876b tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] HTTP exception thrown: Instance 0489a6fa-1b33-4960-aff1-8e365ad4c996 could not be found. Aug 27 03:25:11.824049 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7dc85382-62cc-4c84-82e9-e3207022876b tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Request method failure captured: Aug 27 03:25:11.824049 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/0489a6fa-1b33-4960-aff1-8e365ad4c996 HTTP/1.1 Aug 27 03:25:11.824049 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 03:25:11.824049 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 03:25:11.824049 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 03:25:11.824049 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 03:25:11.824049 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 03:25:11.824049 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 03:25:11.824049 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 03:25:11.824049 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 03:25:11.824049 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCY4rjgLXIvNBrh9kN4jnznC50AQ6KjWReTgkO1jga9yr7NY-gC8VrzURbe59WZrBpXWePgbVKRMS_e_UPOGvs6kq6xALqK2obNolZqn3ouGxdOKXhnIHVg8gyE_jgUU-tIsjIbg-aNo9qlCKhh6olDObIY67Z71HecsvikaMrjLi4nk Aug 27 03:25:11.824049 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 03:25:11.824049 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 03:25:11.824049 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 03:25:11.824049 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 03:25:11.824049 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 03:25:11.824049 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 03:25:11.824049 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 659b0cee2ff841049f41c7ce12609fc8 Aug 27 03:25:11.824049 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1769414468 Aug 27 03:25:11.824049 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 03:25:11.824049 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 03:25:11.824049 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/659b0cee2ff841049f41c7ce12609fc8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_659b0cee2ff841049f41c7ce12609fc8", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/659b0cee2ff841049f41c7ce12609fc8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/659b0cee2ff841049f41c7ce12609fc8"}]}] Aug 27 03:25:11.824049 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1769414468 Aug 27 03:25:11.824049 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 659b0cee2ff841049f41c7ce12609fc8 Aug 27 03:25:11.824049 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1769414468 Aug 27 03:25:11.824049 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-TestNetworkAdvancedServerOps-1769414468-project Aug 27 03:25:11.824049 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 03:25:11.824049 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 03:25:11.824049 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 36e9eab0eb7c421fa50b90e270847365 Aug 27 03:25:11.824049 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1769414468-project Aug 27 03:25:11.824049 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 03:25:11.824049 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance 0489a6fa-1b33-4960-aff1-8e365ad4c996 could not be found. Aug 27 03:25:11.824049 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '0489a6fa-1b33-4960-aff1-8e365ad4c996'} Aug 27 03:25:11.824049 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:25:11.824049 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:25:11.824049 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:25:11.824049 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:25:11.824049 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:25:11.824049 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:25:11.824049 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:25:11.824049 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:25:11.824049 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:25:11.824049 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:25:11.824049 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0489a6fa-1b33-4960-aff1-8e365ad4c996 could not be found. Aug 27 03:25:11.824049 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:25:11.824049 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:25:11.824049 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:25:11.824049 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:25:11.824049 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:25:11.824049 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:25:11.824049 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:25:11.824049 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:25:11.824049 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:25:11.824049 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:25:11.824049 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:25:11.824049 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:25:11.824049 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:25:11.824049 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:25:11.824049 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:25:11.824049 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:25:11.824049 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0489a6fa-1b33-4960-aff1-8e365ad4c996 could not be found. Aug 27 03:25:11.824049 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:25:11.824049 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:25:11.828692 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:25:11.828692 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:25:11.828692 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:25:11.828692 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:25:11.828692 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:25:11.828692 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:25:11.828692 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0489a6fa-1b33-4960-aff1-8e365ad4c996 could not be found. Aug 27 03:25:11.828692 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:25:11.828692 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7dc85382-62cc-4c84-82e9-e3207022876b tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Returning 404 to user: Instance 0489a6fa-1b33-4960-aff1-8e365ad4c996 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:25:11.828692 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-7dc85382-62cc-4c84-82e9-e3207022876b tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/0489a6fa-1b33-4960-aff1-8e365ad4c996" status: 404 len: 111 microversion: 2.1 time: 0.032357 Aug 27 03:25:11.828692 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2977/5917] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:25:11 2022] GET /compute/v2.1/servers/0489a6fa-1b33-4960-aff1-8e365ad4c996 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:25:15.320446 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9c07355a-18fa-43d8-9c51-8fe438861c7d tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '.version_select at 0x7f5ee727b430>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:15.349494 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9c07355a-18fa-43d8-9c51-8fe438861c7d tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-300386274" status: 202 len: 0 microversion: 2.1 time: 0.034171 Aug 27 03:25:15.350166 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2941/5918] 10.222.0.70 () {58 vars in 1281 bytes} [Sat Aug 27 03:25:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-300386274 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:25:15.383197 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ed92b3a6-114f-4945-826d-a00cf87f8e99 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Action: 'create', calling method: .version_select at 0x7f5ede996af0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-611043332", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA1FWCSkcC8oh6Ta4X7pF4Ks2jO9sgxIkBrHTIluCI403uFRPbDiu+InuhqQ2glHRzXFpKok0AL8kvKcD3AWUJFuZXmj3ycVLH90z0dGR3QH6TFCFP/OTQ7Ke/vWF6BpBA=="}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:25:15.401369 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-ed92b3a6-114f-4945-826d-a00cf87f8e99 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Getting quotas for project 659b0cee2ff841049f41c7ce12609fc8. Resources: {'key_pairs'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:25:15.406710 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-ed92b3a6-114f-4945-826d-a00cf87f8e99 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Getting quotas for user 36e9eab0eb7c421fa50b90e270847365 and project 659b0cee2ff841049f41c7ce12609fc8. Resources: {'key_pairs'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:25:15.432812 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ed92b3a6-114f-4945-826d-a00cf87f8e99 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.053687 Aug 27 03:25:15.433347 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2978/5919] 10.222.0.70 () {60 vars in 1159 bytes} [Sat Aug 27 03:25:15 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:25:21.154111 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-90f0c7d3-d56d-407f-959a-63bcfb49fc8e tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1928659745", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "networks": [{"uuid": "39a529a4-7000-4e77-ae18-8652c10a4efa"}], "key_name": "tempest-TestNetworkAdvancedServerOps-611043332", "security_groups": [{"name": "tempest-secgroup-smoke-1628366338"}]}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:25:21.237763 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=16 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:25:21.268431 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.network.neutron [None req-90f0c7d3-d56d-407f-959a-63bcfb49fc8e tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] validate_networks() for [('39a529a4-7000-4e77-ae18-8652c10a4efa', None, None, None, None, None)] {{(pid=134052) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:25:21.716279 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-90f0c7d3-d56d-407f-959a-63bcfb49fc8e tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Flavor limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:25:21.717193 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-90f0c7d3-d56d-407f-959a-63bcfb49fc8e tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Image limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:25:21.717950 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-90f0c7d3-d56d-407f-959a-63bcfb49fc8e tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Flavor pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:25:21.720774 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-90f0c7d3-d56d-407f-959a-63bcfb49fc8e tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Image pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:25:21.721644 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-90f0c7d3-d56d-407f-959a-63bcfb49fc8e tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:25:21.731529 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-90f0c7d3-d56d-407f-959a-63bcfb49fc8e tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:21.731966 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-90f0c7d3-d56d-407f-959a-63bcfb49fc8e tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:21.732514 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-90f0c7d3-d56d-407f-959a-63bcfb49fc8e tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:21.733290 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-90f0c7d3-d56d-407f-959a-63bcfb49fc8e tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:21.733796 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-90f0c7d3-d56d-407f-959a-63bcfb49fc8e tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:21.734190 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-90f0c7d3-d56d-407f-959a-63bcfb49fc8e tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:21.754557 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-90f0c7d3-d56d-407f-959a-63bcfb49fc8e tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Getting quotas for project 659b0cee2ff841049f41c7ce12609fc8. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:25:21.760836 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-90f0c7d3-d56d-407f-959a-63bcfb49fc8e tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Getting quotas for user 36e9eab0eb7c421fa50b90e270847365 and project 659b0cee2ff841049f41c7ce12609fc8. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:25:21.780291 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-90f0c7d3-d56d-407f-959a-63bcfb49fc8e tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Going to run 1 instances... {{(pid=134052) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:25:21.787987 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-90f0c7d3-d56d-407f-959a-63bcfb49fc8e tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 5e7c9320-06e9-4efa-8b90-26c27f26d3f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134052) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:25:21.893618 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-90f0c7d3-d56d-407f-959a-63bcfb49fc8e tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.744714 Aug 27 03:25:21.894773 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2942/5920] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 03:25:21 2022] POST /compute/v2.1/servers => generated 406 bytes in 747 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:25:21.909469 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:25:21.915433 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-6d4a2f40-bed8-4384-baf8-fe981dee5ecd tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:21.916458 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-6d4a2f40-bed8-4384-baf8-fe981dee5ecd tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 5e7c9320-06e9-4efa-8b90-26c27f26d3f7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:22.026518 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-6d4a2f40-bed8-4384-baf8-fe981dee5ecd tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:22.040624 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-6d4a2f40-bed8-4384-baf8-fe981dee5ecd tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/5e7c9320-06e9-4efa-8b90-26c27f26d3f7" status: 200 len: 1266 microversion: 2.1 time: 0.138631 Aug 27 03:25:22.041691 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2979/5921] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:25:21 2022] GET /compute/v2.1/servers/5e7c9320-06e9-4efa-8b90-26c27f26d3f7 => generated 1266 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:25:23.067990 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9dd1d47b-513f-49f0-910e-5280d4d6058f tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:23.070126 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-9dd1d47b-513f-49f0-910e-5280d4d6058f tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 5e7c9320-06e9-4efa-8b90-26c27f26d3f7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:23.079593 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9dd1d47b-513f-49f0-910e-5280d4d6058f tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:23.080569 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9dd1d47b-513f-49f0-910e-5280d4d6058f tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:23.081208 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9dd1d47b-513f-49f0-910e-5280d4d6058f tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:23.082099 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9dd1d47b-513f-49f0-910e-5280d4d6058f tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:23.082717 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9dd1d47b-513f-49f0-910e-5280d4d6058f tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:23.083313 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9dd1d47b-513f-49f0-910e-5280d4d6058f tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:23.162225 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-9dd1d47b-513f-49f0-910e-5280d4d6058f tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:23.185214 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9dd1d47b-513f-49f0-910e-5280d4d6058f tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/5e7c9320-06e9-4efa-8b90-26c27f26d3f7" status: 200 len: 1326 microversion: 2.1 time: 0.127141 Aug 27 03:25:23.186422 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2943/5922] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:25:23 2022] GET /compute/v2.1/servers/5e7c9320-06e9-4efa-8b90-26c27f26d3f7 => generated 1326 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:25:24.206991 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-9b8c07c0-81d7-4628-a9a6-7ca755b475bf tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:24.208280 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-9b8c07c0-81d7-4628-a9a6-7ca755b475bf tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 5e7c9320-06e9-4efa-8b90-26c27f26d3f7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:24.217044 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9b8c07c0-81d7-4628-a9a6-7ca755b475bf tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:24.217785 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9b8c07c0-81d7-4628-a9a6-7ca755b475bf tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:24.218408 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9b8c07c0-81d7-4628-a9a6-7ca755b475bf tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:24.219396 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9b8c07c0-81d7-4628-a9a6-7ca755b475bf tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:24.220023 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9b8c07c0-81d7-4628-a9a6-7ca755b475bf tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:24.220685 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9b8c07c0-81d7-4628-a9a6-7ca755b475bf tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:24.373487 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-9b8c07c0-81d7-4628-a9a6-7ca755b475bf tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:24.382333 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-9b8c07c0-81d7-4628-a9a6-7ca755b475bf tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/5e7c9320-06e9-4efa-8b90-26c27f26d3f7" status: 200 len: 1392 microversion: 2.1 time: 0.179351 Aug 27 03:25:24.382927 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2980/5923] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:25:24 2022] GET /compute/v2.1/servers/5e7c9320-06e9-4efa-8b90-26c27f26d3f7 => generated 1392 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:25:24.680973 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-557850f8-f889-4082-88c2-0ce87702ef0e req-a1b642cd-c6fe-4752-9a62-7e4cfac1b2a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e7c9320-06e9-4efa-8b90-26c27f26d3f7", "tag": "32946112-b370-4fb0-9a69-4fb4c09568b9"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:25:24.690794 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-557850f8-f889-4082-88c2-0ce87702ef0e req-a1b642cd-c6fe-4752-9a62-7e4cfac1b2a2 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:24.691194 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-557850f8-f889-4082-88c2-0ce87702ef0e req-a1b642cd-c6fe-4752-9a62-7e4cfac1b2a2 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:24.691668 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-557850f8-f889-4082-88c2-0ce87702ef0e req-a1b642cd-c6fe-4752-9a62-7e4cfac1b2a2 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:24.703185 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-557850f8-f889-4082-88c2-0ce87702ef0e req-a1b642cd-c6fe-4752-9a62-7e4cfac1b2a2 service nova] Creating event network-changed:32946112-b370-4fb0-9a69-4fb4c09568b9 for instance 5e7c9320-06e9-4efa-8b90-26c27f26d3f7 on n-h1-852278-4 Aug 27 03:25:24.708427 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-557850f8-f889-4082-88c2-0ce87702ef0e req-a1b642cd-c6fe-4752-9a62-7e4cfac1b2a2 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105478 Aug 27 03:25:24.709052 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2944/5924] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:25:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:25:25.403711 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-1dae43a1-f9a4-4b47-8d6d-fc3726f05937 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:25.404290 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-1dae43a1-f9a4-4b47-8d6d-fc3726f05937 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 5e7c9320-06e9-4efa-8b90-26c27f26d3f7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:25.412084 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1dae43a1-f9a4-4b47-8d6d-fc3726f05937 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:25.413492 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1dae43a1-f9a4-4b47-8d6d-fc3726f05937 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:25.414238 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1dae43a1-f9a4-4b47-8d6d-fc3726f05937 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:25.415450 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1dae43a1-f9a4-4b47-8d6d-fc3726f05937 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:25.416153 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1dae43a1-f9a4-4b47-8d6d-fc3726f05937 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:25.416849 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1dae43a1-f9a4-4b47-8d6d-fc3726f05937 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:25.571765 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-1dae43a1-f9a4-4b47-8d6d-fc3726f05937 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:25.580076 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-1dae43a1-f9a4-4b47-8d6d-fc3726f05937 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/5e7c9320-06e9-4efa-8b90-26c27f26d3f7" status: 200 len: 1392 microversion: 2.1 time: 0.180506 Aug 27 03:25:25.580723 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2981/5925] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:25:25 2022] GET /compute/v2.1/servers/5e7c9320-06e9-4efa-8b90-26c27f26d3f7 => generated 1392 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:25:26.607874 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b62a6835-3a88-4b41-b13c-959c9e12fe54 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:26.609065 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b62a6835-3a88-4b41-b13c-959c9e12fe54 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 5e7c9320-06e9-4efa-8b90-26c27f26d3f7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:26.619836 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b62a6835-3a88-4b41-b13c-959c9e12fe54 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:26.620740 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b62a6835-3a88-4b41-b13c-959c9e12fe54 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:26.621518 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b62a6835-3a88-4b41-b13c-959c9e12fe54 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:26.622725 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b62a6835-3a88-4b41-b13c-959c9e12fe54 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:26.623525 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b62a6835-3a88-4b41-b13c-959c9e12fe54 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:26.624236 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b62a6835-3a88-4b41-b13c-959c9e12fe54 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:26.765494 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b62a6835-3a88-4b41-b13c-959c9e12fe54 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:26.773660 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b62a6835-3a88-4b41-b13c-959c9e12fe54 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/5e7c9320-06e9-4efa-8b90-26c27f26d3f7" status: 200 len: 1392 microversion: 2.1 time: 0.174671 Aug 27 03:25:26.774257 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2945/5926] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:25:26 2022] GET /compute/v2.1/servers/5e7c9320-06e9-4efa-8b90-26c27f26d3f7 => generated 1392 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:25:27.797514 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-93491e81-ea5f-40e4-a2d5-fdc6b9395f94 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:27.798190 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-93491e81-ea5f-40e4-a2d5-fdc6b9395f94 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 5e7c9320-06e9-4efa-8b90-26c27f26d3f7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:27.806435 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-93491e81-ea5f-40e4-a2d5-fdc6b9395f94 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:27.806919 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-93491e81-ea5f-40e4-a2d5-fdc6b9395f94 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:27.807391 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-93491e81-ea5f-40e4-a2d5-fdc6b9395f94 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:27.808111 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-93491e81-ea5f-40e4-a2d5-fdc6b9395f94 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:27.808611 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-93491e81-ea5f-40e4-a2d5-fdc6b9395f94 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:27.809054 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-93491e81-ea5f-40e4-a2d5-fdc6b9395f94 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:27.949510 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-93491e81-ea5f-40e4-a2d5-fdc6b9395f94 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:27.957543 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-93491e81-ea5f-40e4-a2d5-fdc6b9395f94 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/5e7c9320-06e9-4efa-8b90-26c27f26d3f7" status: 200 len: 1392 microversion: 2.1 time: 0.166238 Aug 27 03:25:27.958125 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2982/5927] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:25:27 2022] GET /compute/v2.1/servers/5e7c9320-06e9-4efa-8b90-26c27f26d3f7 => generated 1392 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:25:28.978764 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-68cf6a78-93cb-46c8-9f3c-3a9f715ed7a7 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:28.979358 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-68cf6a78-93cb-46c8-9f3c-3a9f715ed7a7 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 5e7c9320-06e9-4efa-8b90-26c27f26d3f7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:28.986946 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-68cf6a78-93cb-46c8-9f3c-3a9f715ed7a7 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:28.987470 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-68cf6a78-93cb-46c8-9f3c-3a9f715ed7a7 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:28.987895 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-68cf6a78-93cb-46c8-9f3c-3a9f715ed7a7 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:28.988651 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-68cf6a78-93cb-46c8-9f3c-3a9f715ed7a7 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:28.989225 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-68cf6a78-93cb-46c8-9f3c-3a9f715ed7a7 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:28.989895 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-68cf6a78-93cb-46c8-9f3c-3a9f715ed7a7 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:29.134623 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-68cf6a78-93cb-46c8-9f3c-3a9f715ed7a7 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:29.142757 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-68cf6a78-93cb-46c8-9f3c-3a9f715ed7a7 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/5e7c9320-06e9-4efa-8b90-26c27f26d3f7" status: 200 len: 1392 microversion: 2.1 time: 0.168135 Aug 27 03:25:29.143345 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2946/5928] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:25:28 2022] GET /compute/v2.1/servers/5e7c9320-06e9-4efa-8b90-26c27f26d3f7 => generated 1392 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:25:30.166421 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e2052e27-6e01-44e0-9e89-eaa9fbd264d9 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:30.167010 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-e2052e27-6e01-44e0-9e89-eaa9fbd264d9 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 5e7c9320-06e9-4efa-8b90-26c27f26d3f7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:30.176935 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e2052e27-6e01-44e0-9e89-eaa9fbd264d9 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:30.177477 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e2052e27-6e01-44e0-9e89-eaa9fbd264d9 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:30.178133 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e2052e27-6e01-44e0-9e89-eaa9fbd264d9 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:30.178821 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e2052e27-6e01-44e0-9e89-eaa9fbd264d9 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:30.179437 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e2052e27-6e01-44e0-9e89-eaa9fbd264d9 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:30.179902 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e2052e27-6e01-44e0-9e89-eaa9fbd264d9 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:30.316989 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e2052e27-6e01-44e0-9e89-eaa9fbd264d9 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:30.325363 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e2052e27-6e01-44e0-9e89-eaa9fbd264d9 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/5e7c9320-06e9-4efa-8b90-26c27f26d3f7" status: 200 len: 1392 microversion: 2.1 time: 0.165306 Aug 27 03:25:30.325985 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2983/5929] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:25:30 2022] GET /compute/v2.1/servers/5e7c9320-06e9-4efa-8b90-26c27f26d3f7 => generated 1392 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:25:30.377958 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-aa94d08a-dbaf-42ae-9622-31c28daea6c4 req-dcf224a0-470b-44c6-b3e3-a7ca0e353003 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e7c9320-06e9-4efa-8b90-26c27f26d3f7", "name": "network-vif-plugged", "status": "completed", "tag": "32946112-b370-4fb0-9a69-4fb4c09568b9"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:25:30.390730 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-aa94d08a-dbaf-42ae-9622-31c28daea6c4 req-dcf224a0-470b-44c6-b3e3-a7ca0e353003 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:30.391480 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-aa94d08a-dbaf-42ae-9622-31c28daea6c4 req-dcf224a0-470b-44c6-b3e3-a7ca0e353003 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:30.392092 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-aa94d08a-dbaf-42ae-9622-31c28daea6c4 req-dcf224a0-470b-44c6-b3e3-a7ca0e353003 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:30.403889 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-aa94d08a-dbaf-42ae-9622-31c28daea6c4 req-dcf224a0-470b-44c6-b3e3-a7ca0e353003 service nova] Creating event network-vif-plugged:32946112-b370-4fb0-9a69-4fb4c09568b9 for instance 5e7c9320-06e9-4efa-8b90-26c27f26d3f7 on n-h1-852278-4 Aug 27 03:25:30.409051 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-aa94d08a-dbaf-42ae-9622-31c28daea6c4 req-dcf224a0-470b-44c6-b3e3-a7ca0e353003 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034904 Aug 27 03:25:30.409784 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2947/5930] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:25:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:25:31.345594 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c195f99d-8a06-4609-97ed-829cad886b2c tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:31.346250 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-c195f99d-8a06-4609-97ed-829cad886b2c tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 5e7c9320-06e9-4efa-8b90-26c27f26d3f7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:31.348744 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:25:31.354239 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c195f99d-8a06-4609-97ed-829cad886b2c tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:31.354735 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c195f99d-8a06-4609-97ed-829cad886b2c tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:31.355183 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c195f99d-8a06-4609-97ed-829cad886b2c tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:31.355890 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c195f99d-8a06-4609-97ed-829cad886b2c tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:31.356458 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c195f99d-8a06-4609-97ed-829cad886b2c tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:31.356893 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c195f99d-8a06-4609-97ed-829cad886b2c tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:31.493891 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-c195f99d-8a06-4609-97ed-829cad886b2c tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:31.502385 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c195f99d-8a06-4609-97ed-829cad886b2c tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/5e7c9320-06e9-4efa-8b90-26c27f26d3f7" status: 200 len: 1392 microversion: 2.1 time: 0.160778 Aug 27 03:25:31.502975 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2984/5931] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:25:31 2022] GET /compute/v2.1/servers/5e7c9320-06e9-4efa-8b90-26c27f26d3f7 => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:25:32.524553 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:25:32.525898 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=6 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:25:32.534203 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-883a4a5a-79fe-46a9-a78c-dd7756501978 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:32.535389 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-883a4a5a-79fe-46a9-a78c-dd7756501978 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 5e7c9320-06e9-4efa-8b90-26c27f26d3f7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:32.545217 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-883a4a5a-79fe-46a9-a78c-dd7756501978 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:32.545703 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-883a4a5a-79fe-46a9-a78c-dd7756501978 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:32.546136 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-883a4a5a-79fe-46a9-a78c-dd7756501978 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:32.546847 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-883a4a5a-79fe-46a9-a78c-dd7756501978 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:32.547278 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-883a4a5a-79fe-46a9-a78c-dd7756501978 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:32.547695 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-883a4a5a-79fe-46a9-a78c-dd7756501978 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:32.690222 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-883a4a5a-79fe-46a9-a78c-dd7756501978 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:32.699425 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-883a4a5a-79fe-46a9-a78c-dd7756501978 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/5e7c9320-06e9-4efa-8b90-26c27f26d3f7" status: 200 len: 1564 microversion: 2.1 time: 0.178303 Aug 27 03:25:32.700058 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2948/5932] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:25:32 2022] GET /compute/v2.1/servers/5e7c9320-06e9-4efa-8b90-26c27f26d3f7 => generated 1564 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:25:32.721793 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-54cf9888-f5d6-4b8c-a768-0eb7b72a1750 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:32.723111 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-54cf9888-f5d6-4b8c-a768-0eb7b72a1750 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 5e7c9320-06e9-4efa-8b90-26c27f26d3f7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:32.725594 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=6 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:25:32.733919 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-54cf9888-f5d6-4b8c-a768-0eb7b72a1750 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:32.734549 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-54cf9888-f5d6-4b8c-a768-0eb7b72a1750 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:32.735008 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-54cf9888-f5d6-4b8c-a768-0eb7b72a1750 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:32.736236 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-54cf9888-f5d6-4b8c-a768-0eb7b72a1750 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:32.736236 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-54cf9888-f5d6-4b8c-a768-0eb7b72a1750 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:32.736729 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-54cf9888-f5d6-4b8c-a768-0eb7b72a1750 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:32.890055 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-54cf9888-f5d6-4b8c-a768-0eb7b72a1750 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:32.898271 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-54cf9888-f5d6-4b8c-a768-0eb7b72a1750 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/5e7c9320-06e9-4efa-8b90-26c27f26d3f7" status: 200 len: 1564 microversion: 2.1 time: 0.181292 Aug 27 03:25:32.898854 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2985/5933] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:25:32 2022] GET /compute/v2.1/servers/5e7c9320-06e9-4efa-8b90-26c27f26d3f7 => generated 1564 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:25:34.931619 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-44c9282c-3860-4a3c-b05f-f22575b9d280 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:34.932146 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-2b1ffa68-4dac-493f-bb92-41f0700caafd req-1f86d524-28d6-4320-84b1-e40f76115050 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e7c9320-06e9-4efa-8b90-26c27f26d3f7", "tag": "32946112-b370-4fb0-9a69-4fb4c09568b9"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:25:34.932572 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-44c9282c-3860-4a3c-b05f-f22575b9d280 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 5e7c9320-06e9-4efa-8b90-26c27f26d3f7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:34.941583 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-44c9282c-3860-4a3c-b05f-f22575b9d280 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:34.942345 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-44c9282c-3860-4a3c-b05f-f22575b9d280 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:34.942828 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-2b1ffa68-4dac-493f-bb92-41f0700caafd req-1f86d524-28d6-4320-84b1-e40f76115050 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:34.942977 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-44c9282c-3860-4a3c-b05f-f22575b9d280 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:34.943650 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-2b1ffa68-4dac-493f-bb92-41f0700caafd req-1f86d524-28d6-4320-84b1-e40f76115050 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:34.943796 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-44c9282c-3860-4a3c-b05f-f22575b9d280 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:34.944580 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-2b1ffa68-4dac-493f-bb92-41f0700caafd req-1f86d524-28d6-4320-84b1-e40f76115050 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:34.945223 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-44c9282c-3860-4a3c-b05f-f22575b9d280 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:34.945804 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-44c9282c-3860-4a3c-b05f-f22575b9d280 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:34.957087 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-2b1ffa68-4dac-493f-bb92-41f0700caafd req-1f86d524-28d6-4320-84b1-e40f76115050 service nova] Creating event network-changed:32946112-b370-4fb0-9a69-4fb4c09568b9 for instance 5e7c9320-06e9-4efa-8b90-26c27f26d3f7 on n-h1-852278-4 Aug 27 03:25:34.963142 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-2b1ffa68-4dac-493f-bb92-41f0700caafd req-1f86d524-28d6-4320-84b1-e40f76115050 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035347 Aug 27 03:25:34.964468 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2986/5934] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:25:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:25:35.131108 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-44c9282c-3860-4a3c-b05f-f22575b9d280 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:35.142722 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-44c9282c-3860-4a3c-b05f-f22575b9d280 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/5e7c9320-06e9-4efa-8b90-26c27f26d3f7" status: 200 len: 1564 microversion: 2.1 time: 0.217908 Aug 27 03:25:35.154548 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2949/5935] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:25:34 2022] GET /compute/v2.1/servers/5e7c9320-06e9-4efa-8b90-26c27f26d3f7 => generated 1564 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:25:44.028859 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-2c63c78e-ee11-4cc2-9187-d53791c55b66 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2083950081", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1843061337", "security_groups": [{"name": "tempest-secgroup-smoke-499842507"}], "block_device_mapping_v2": [{"uuid": "ade73ab5-0183-472e-93d8-7ee8a56872bb", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "02524c0f-c44c-4ea0-899e-226a790199dc"}]}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:25:44.151165 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.network.neutron [None req-2c63c78e-ee11-4cc2-9187-d53791c55b66 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] validate_networks() for [('02524c0f-c44c-4ea0-899e-226a790199dc', None, None, None, None, None)] {{(pid=134051) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:25:44.616581 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-2c63c78e-ee11-4cc2-9187-d53791c55b66 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Flavor limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:25:44.617027 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-2c63c78e-ee11-4cc2-9187-d53791c55b66 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Image limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:25:44.617522 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-2c63c78e-ee11-4cc2-9187-d53791c55b66 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Flavor pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:25:44.617995 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-2c63c78e-ee11-4cc2-9187-d53791c55b66 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Image pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:25:44.618401 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-2c63c78e-ee11-4cc2-9187-d53791c55b66 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:25:44.628469 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2c63c78e-ee11-4cc2-9187-d53791c55b66 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:44.629055 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2c63c78e-ee11-4cc2-9187-d53791c55b66 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:44.629494 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2c63c78e-ee11-4cc2-9187-d53791c55b66 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:44.630241 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2c63c78e-ee11-4cc2-9187-d53791c55b66 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:44.630715 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2c63c78e-ee11-4cc2-9187-d53791c55b66 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:44.631154 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2c63c78e-ee11-4cc2-9187-d53791c55b66 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:44.648892 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-2c63c78e-ee11-4cc2-9187-d53791c55b66 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Getting quotas for project 7b2673a034c24d1898493bfea9ca5d1d. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:25:44.654517 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-2c63c78e-ee11-4cc2-9187-d53791c55b66 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Getting quotas for user 4aa867d7baa043b1b1e6763046463b3f and project 7b2673a034c24d1898493bfea9ca5d1d. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:25:44.717258 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-2c63c78e-ee11-4cc2-9187-d53791c55b66 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Going to run 1 instances... {{(pid=134051) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:25:44.719548 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-2c63c78e-ee11-4cc2-9187-d53791c55b66 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: fd745775-ded3-4cbb-bec3-1133085c7ec6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ade73ab5-0183-472e-93d8-7ee8a56872bb',volume_size=None,volume_type=None)] {{(pid=134051) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:25:44.855628 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-2c63c78e-ee11-4cc2-9187-d53791c55b66 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.832332 Aug 27 03:25:44.856242 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2987/5936] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 03:25:44 2022] POST /compute/v2.1/servers => generated 405 bytes in 834 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:25:44.867033 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3b586f09-f2d3-4fd4-bc17-87c27a37ca47 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:44.867614 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-3b586f09-f2d3-4fd4-bc17-87c27a37ca47 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: fd745775-ded3-4cbb-bec3-1133085c7ec6] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:44.870625 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=41,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:25:44.928641 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-3b586f09-f2d3-4fd4-bc17-87c27a37ca47 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:44.936918 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-3b586f09-f2d3-4fd4-bc17-87c27a37ca47 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/fd745775-ded3-4cbb-bec3-1133085c7ec6" status: 200 len: 1095 microversion: 2.1 time: 0.073642 Aug 27 03:25:44.937524 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2950/5937] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:25:44 2022] GET /compute/v2.1/servers/fd745775-ded3-4cbb-bec3-1133085c7ec6 => generated 1095 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:25:45.959304 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d20baa25-35ad-484c-9a33-7b519c5638bc tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:45.959933 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d20baa25-35ad-484c-9a33-7b519c5638bc tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: fd745775-ded3-4cbb-bec3-1133085c7ec6] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:45.967931 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d20baa25-35ad-484c-9a33-7b519c5638bc tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:45.968670 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d20baa25-35ad-484c-9a33-7b519c5638bc tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:45.969117 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d20baa25-35ad-484c-9a33-7b519c5638bc tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:45.970191 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d20baa25-35ad-484c-9a33-7b519c5638bc tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:45.970657 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d20baa25-35ad-484c-9a33-7b519c5638bc tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:45.971091 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d20baa25-35ad-484c-9a33-7b519c5638bc tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:46.060982 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d20baa25-35ad-484c-9a33-7b519c5638bc tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:46.070667 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d20baa25-35ad-484c-9a33-7b519c5638bc tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/fd745775-ded3-4cbb-bec3-1133085c7ec6" status: 200 len: 1211 microversion: 2.1 time: 0.115755 Aug 27 03:25:46.071514 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2988/5938] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:25:45 2022] GET /compute/v2.1/servers/fd745775-ded3-4cbb-bec3-1133085c7ec6 => generated 1211 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:25:47.092392 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4eff3494-1356-4af3-a95f-0cefbcd500ff tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:47.092999 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-4eff3494-1356-4af3-a95f-0cefbcd500ff tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: fd745775-ded3-4cbb-bec3-1133085c7ec6] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:47.099527 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=36 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:25:47.103400 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4eff3494-1356-4af3-a95f-0cefbcd500ff tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:47.103890 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4eff3494-1356-4af3-a95f-0cefbcd500ff tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:47.104344 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4eff3494-1356-4af3-a95f-0cefbcd500ff tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:47.105050 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4eff3494-1356-4af3-a95f-0cefbcd500ff tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:47.105672 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4eff3494-1356-4af3-a95f-0cefbcd500ff tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:47.106143 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4eff3494-1356-4af3-a95f-0cefbcd500ff tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:47.338631 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-4eff3494-1356-4af3-a95f-0cefbcd500ff tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:47.349019 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-4eff3494-1356-4af3-a95f-0cefbcd500ff tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/fd745775-ded3-4cbb-bec3-1133085c7ec6" status: 200 len: 1278 microversion: 2.1 time: 0.261163 Aug 27 03:25:47.349597 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2951/5939] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:25:47 2022] GET /compute/v2.1/servers/fd745775-ded3-4cbb-bec3-1133085c7ec6 => generated 1278 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:25:47.654279 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-640b78c9-4871-4e23-a35b-db64cfcfce85 req-95770235-7d8a-4cd8-919d-31451ae75464 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd745775-ded3-4cbb-bec3-1133085c7ec6", "tag": "7ba79a1a-2c31-4c66-b747-5bb78ac13dc9"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:25:47.669946 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-640b78c9-4871-4e23-a35b-db64cfcfce85 req-95770235-7d8a-4cd8-919d-31451ae75464 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:47.670799 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-640b78c9-4871-4e23-a35b-db64cfcfce85 req-95770235-7d8a-4cd8-919d-31451ae75464 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:47.671974 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-640b78c9-4871-4e23-a35b-db64cfcfce85 req-95770235-7d8a-4cd8-919d-31451ae75464 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:47.686945 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-640b78c9-4871-4e23-a35b-db64cfcfce85 req-95770235-7d8a-4cd8-919d-31451ae75464 service nova] Creating event network-changed:7ba79a1a-2c31-4c66-b747-5bb78ac13dc9 for instance fd745775-ded3-4cbb-bec3-1133085c7ec6 on n-h2-852278-4 Aug 27 03:25:47.692244 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-640b78c9-4871-4e23-a35b-db64cfcfce85 req-95770235-7d8a-4cd8-919d-31451ae75464 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043260 Aug 27 03:25:47.692906 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2989/5940] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:25:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:25:48.370079 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-31617b59-2b3c-4b2f-aeb3-7b32efc08c1e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:48.371703 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-31617b59-2b3c-4b2f-aeb3-7b32efc08c1e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: fd745775-ded3-4cbb-bec3-1133085c7ec6] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:48.380758 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-31617b59-2b3c-4b2f-aeb3-7b32efc08c1e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:48.381419 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-31617b59-2b3c-4b2f-aeb3-7b32efc08c1e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:48.382047 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-31617b59-2b3c-4b2f-aeb3-7b32efc08c1e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:48.383241 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-31617b59-2b3c-4b2f-aeb3-7b32efc08c1e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:48.383782 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-31617b59-2b3c-4b2f-aeb3-7b32efc08c1e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:48.384207 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-31617b59-2b3c-4b2f-aeb3-7b32efc08c1e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:48.623856 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-31617b59-2b3c-4b2f-aeb3-7b32efc08c1e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:48.634427 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-31617b59-2b3c-4b2f-aeb3-7b32efc08c1e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/fd745775-ded3-4cbb-bec3-1133085c7ec6" status: 200 len: 1278 microversion: 2.1 time: 0.268679 Aug 27 03:25:48.638481 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2952/5941] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:25:48 2022] GET /compute/v2.1/servers/fd745775-ded3-4cbb-bec3-1133085c7ec6 => generated 1278 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:25:49.656424 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0e06b5b0-be69-4943-8d95-c737e7cfa74c tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:49.657122 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-0e06b5b0-be69-4943-8d95-c737e7cfa74c tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: fd745775-ded3-4cbb-bec3-1133085c7ec6] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:49.664905 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0e06b5b0-be69-4943-8d95-c737e7cfa74c tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:49.665413 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0e06b5b0-be69-4943-8d95-c737e7cfa74c tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:49.665871 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0e06b5b0-be69-4943-8d95-c737e7cfa74c tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:49.666599 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0e06b5b0-be69-4943-8d95-c737e7cfa74c tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:49.667074 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0e06b5b0-be69-4943-8d95-c737e7cfa74c tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:49.667501 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0e06b5b0-be69-4943-8d95-c737e7cfa74c tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:49.809458 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-0e06b5b0-be69-4943-8d95-c737e7cfa74c tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:49.818060 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-0e06b5b0-be69-4943-8d95-c737e7cfa74c tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/fd745775-ded3-4cbb-bec3-1133085c7ec6" status: 200 len: 1278 microversion: 2.1 time: 0.166234 Aug 27 03:25:49.818645 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2990/5942] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:25:49 2022] GET /compute/v2.1/servers/fd745775-ded3-4cbb-bec3-1133085c7ec6 => generated 1278 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:25:50.839235 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a4992ac8-05ca-4e0d-a252-7dda8a666e2e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:50.839879 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a4992ac8-05ca-4e0d-a252-7dda8a666e2e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: fd745775-ded3-4cbb-bec3-1133085c7ec6] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:50.846896 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a4992ac8-05ca-4e0d-a252-7dda8a666e2e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:50.847385 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a4992ac8-05ca-4e0d-a252-7dda8a666e2e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:50.847826 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a4992ac8-05ca-4e0d-a252-7dda8a666e2e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:50.848561 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a4992ac8-05ca-4e0d-a252-7dda8a666e2e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:50.849013 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a4992ac8-05ca-4e0d-a252-7dda8a666e2e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:50.849544 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a4992ac8-05ca-4e0d-a252-7dda8a666e2e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:50.981292 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-a4992ac8-05ca-4e0d-a252-7dda8a666e2e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:50.989570 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a4992ac8-05ca-4e0d-a252-7dda8a666e2e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/fd745775-ded3-4cbb-bec3-1133085c7ec6" status: 200 len: 1278 microversion: 2.1 time: 0.154375 Aug 27 03:25:50.990137 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2953/5943] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:25:50 2022] GET /compute/v2.1/servers/fd745775-ded3-4cbb-bec3-1133085c7ec6 => generated 1278 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:25:52.010892 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-595bdf0d-a60a-415f-b1dd-0056bd41c2e8 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:52.011503 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-595bdf0d-a60a-415f-b1dd-0056bd41c2e8 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: fd745775-ded3-4cbb-bec3-1133085c7ec6] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:52.018621 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-595bdf0d-a60a-415f-b1dd-0056bd41c2e8 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:52.019126 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-595bdf0d-a60a-415f-b1dd-0056bd41c2e8 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:52.019602 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-595bdf0d-a60a-415f-b1dd-0056bd41c2e8 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:52.020327 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-595bdf0d-a60a-415f-b1dd-0056bd41c2e8 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:52.020806 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-595bdf0d-a60a-415f-b1dd-0056bd41c2e8 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:52.021249 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-595bdf0d-a60a-415f-b1dd-0056bd41c2e8 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:52.024012 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=55 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:25:52.166000 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-595bdf0d-a60a-415f-b1dd-0056bd41c2e8 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:52.174030 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-595bdf0d-a60a-415f-b1dd-0056bd41c2e8 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/fd745775-ded3-4cbb-bec3-1133085c7ec6" status: 200 len: 1266 microversion: 2.1 time: 0.167178 Aug 27 03:25:52.174618 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2991/5944] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:25:52 2022] GET /compute/v2.1/servers/fd745775-ded3-4cbb-bec3-1133085c7ec6 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:25:53.197579 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c2bfa9c9-ae9e-4b6f-b1dc-36ba8ebf2ea4 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:53.198598 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-c2bfa9c9-ae9e-4b6f-b1dc-36ba8ebf2ea4 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: fd745775-ded3-4cbb-bec3-1133085c7ec6] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:53.207008 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c2bfa9c9-ae9e-4b6f-b1dc-36ba8ebf2ea4 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:53.207617 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c2bfa9c9-ae9e-4b6f-b1dc-36ba8ebf2ea4 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:53.208076 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c2bfa9c9-ae9e-4b6f-b1dc-36ba8ebf2ea4 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:53.208878 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c2bfa9c9-ae9e-4b6f-b1dc-36ba8ebf2ea4 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:53.209346 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c2bfa9c9-ae9e-4b6f-b1dc-36ba8ebf2ea4 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:53.209794 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c2bfa9c9-ae9e-4b6f-b1dc-36ba8ebf2ea4 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:53.360954 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-c2bfa9c9-ae9e-4b6f-b1dc-36ba8ebf2ea4 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:53.371486 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c2bfa9c9-ae9e-4b6f-b1dc-36ba8ebf2ea4 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/fd745775-ded3-4cbb-bec3-1133085c7ec6" status: 200 len: 1266 microversion: 2.1 time: 0.179430 Aug 27 03:25:53.372152 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2954/5945] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:25:53 2022] GET /compute/v2.1/servers/fd745775-ded3-4cbb-bec3-1133085c7ec6 => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:25:54.392112 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-41a92b5e-5c7c-4c93-9cee-4edb17d93834 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:54.392774 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-41a92b5e-5c7c-4c93-9cee-4edb17d93834 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: fd745775-ded3-4cbb-bec3-1133085c7ec6] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:54.400402 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-41a92b5e-5c7c-4c93-9cee-4edb17d93834 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:54.400984 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-41a92b5e-5c7c-4c93-9cee-4edb17d93834 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:54.401426 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-41a92b5e-5c7c-4c93-9cee-4edb17d93834 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:54.402152 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-41a92b5e-5c7c-4c93-9cee-4edb17d93834 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:54.402621 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-41a92b5e-5c7c-4c93-9cee-4edb17d93834 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:54.403061 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-41a92b5e-5c7c-4c93-9cee-4edb17d93834 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:54.538178 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-41a92b5e-5c7c-4c93-9cee-4edb17d93834 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:54.546462 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-41a92b5e-5c7c-4c93-9cee-4edb17d93834 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/fd745775-ded3-4cbb-bec3-1133085c7ec6" status: 200 len: 1266 microversion: 2.1 time: 0.158381 Aug 27 03:25:54.547056 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2992/5946] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:25:54 2022] GET /compute/v2.1/servers/fd745775-ded3-4cbb-bec3-1133085c7ec6 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:25:55.571324 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3c6c3b11-16f5-4d2a-b8c6-23b059997e95 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:55.572369 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-3c6c3b11-16f5-4d2a-b8c6-23b059997e95 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: fd745775-ded3-4cbb-bec3-1133085c7ec6] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:55.576909 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:25:55.586291 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3c6c3b11-16f5-4d2a-b8c6-23b059997e95 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:55.587343 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3c6c3b11-16f5-4d2a-b8c6-23b059997e95 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:55.587847 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3c6c3b11-16f5-4d2a-b8c6-23b059997e95 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:55.588932 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3c6c3b11-16f5-4d2a-b8c6-23b059997e95 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:55.589370 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3c6c3b11-16f5-4d2a-b8c6-23b059997e95 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:55.589787 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3c6c3b11-16f5-4d2a-b8c6-23b059997e95 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:55.730265 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-3c6c3b11-16f5-4d2a-b8c6-23b059997e95 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:55.738703 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-3c6c3b11-16f5-4d2a-b8c6-23b059997e95 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/fd745775-ded3-4cbb-bec3-1133085c7ec6" status: 200 len: 1266 microversion: 2.1 time: 0.174020 Aug 27 03:25:55.739270 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2955/5947] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:25:55 2022] GET /compute/v2.1/servers/fd745775-ded3-4cbb-bec3-1133085c7ec6 => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:25:56.430509 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-bbe6d567-d273-43e2-96af-b971cc0233db tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:25:56.433905 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-bbe6d567-d273-43e2-96af-b971cc0233db tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 5e7c9320-06e9-4efa-8b90-26c27f26d3f7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:56.436663 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:25:56.437476 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=6 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:25:56.446660 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bbe6d567-d273-43e2-96af-b971cc0233db tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:56.447404 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bbe6d567-d273-43e2-96af-b971cc0233db tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:56.447952 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bbe6d567-d273-43e2-96af-b971cc0233db tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:56.448703 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bbe6d567-d273-43e2-96af-b971cc0233db tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:56.449180 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bbe6d567-d273-43e2-96af-b971cc0233db tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:56.449620 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bbe6d567-d273-43e2-96af-b971cc0233db tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:56.526717 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-bbe6d567-d273-43e2-96af-b971cc0233db tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "POST /compute/v2.1/servers/5e7c9320-06e9-4efa-8b90-26c27f26d3f7/action" status: 200 len: 24561 microversion: 2.1 time: 0.102905 Aug 27 03:25:56.527437 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2993/5948] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:25:56 2022] POST /compute/v2.1/servers/5e7c9320-06e9-4efa-8b90-26c27f26d3f7/action => generated 24561 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:25:56.761841 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9baa11b4-2eab-4fc8-a764-aeb168b2e2c4 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:56.762411 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-9baa11b4-2eab-4fc8-a764-aeb168b2e2c4 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: fd745775-ded3-4cbb-bec3-1133085c7ec6] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:56.769667 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9baa11b4-2eab-4fc8-a764-aeb168b2e2c4 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:56.770162 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9baa11b4-2eab-4fc8-a764-aeb168b2e2c4 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:56.770599 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9baa11b4-2eab-4fc8-a764-aeb168b2e2c4 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:56.771297 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9baa11b4-2eab-4fc8-a764-aeb168b2e2c4 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:56.771750 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9baa11b4-2eab-4fc8-a764-aeb168b2e2c4 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:56.772180 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9baa11b4-2eab-4fc8-a764-aeb168b2e2c4 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:56.913016 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-9baa11b4-2eab-4fc8-a764-aeb168b2e2c4 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:56.921423 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9baa11b4-2eab-4fc8-a764-aeb168b2e2c4 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/fd745775-ded3-4cbb-bec3-1133085c7ec6" status: 200 len: 1266 microversion: 2.1 time: 0.165625 Aug 27 03:25:56.922076 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2956/5949] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:25:56 2022] GET /compute/v2.1/servers/fd745775-ded3-4cbb-bec3-1133085c7ec6 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:25:57.945547 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a5c001dd-dbb5-4a41-92fc-690c312a4c5b tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:57.946471 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-a5c001dd-dbb5-4a41-92fc-690c312a4c5b tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: fd745775-ded3-4cbb-bec3-1133085c7ec6] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:57.954627 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a5c001dd-dbb5-4a41-92fc-690c312a4c5b tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:57.955216 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a5c001dd-dbb5-4a41-92fc-690c312a4c5b tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:57.955672 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a5c001dd-dbb5-4a41-92fc-690c312a4c5b tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:57.956451 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a5c001dd-dbb5-4a41-92fc-690c312a4c5b tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:57.956875 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a5c001dd-dbb5-4a41-92fc-690c312a4c5b tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:57.957308 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a5c001dd-dbb5-4a41-92fc-690c312a4c5b tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:58.102885 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-a5c001dd-dbb5-4a41-92fc-690c312a4c5b tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:58.111753 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a5c001dd-dbb5-4a41-92fc-690c312a4c5b tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/fd745775-ded3-4cbb-bec3-1133085c7ec6" status: 200 len: 1266 microversion: 2.1 time: 0.171712 Aug 27 03:25:58.112447 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2994/5950] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:25:57 2022] GET /compute/v2.1/servers/fd745775-ded3-4cbb-bec3-1133085c7ec6 => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:25:59.135167 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e8594a78-e3ad-4c82-87c7-d1fcc5196b0e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:59.135745 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-e8594a78-e3ad-4c82-87c7-d1fcc5196b0e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: fd745775-ded3-4cbb-bec3-1133085c7ec6] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:59.143131 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e8594a78-e3ad-4c82-87c7-d1fcc5196b0e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:59.143622 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e8594a78-e3ad-4c82-87c7-d1fcc5196b0e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:59.144052 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e8594a78-e3ad-4c82-87c7-d1fcc5196b0e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:59.144789 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e8594a78-e3ad-4c82-87c7-d1fcc5196b0e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:59.145234 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e8594a78-e3ad-4c82-87c7-d1fcc5196b0e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:59.145656 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e8594a78-e3ad-4c82-87c7-d1fcc5196b0e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:59.291853 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-e8594a78-e3ad-4c82-87c7-d1fcc5196b0e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:59.300581 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e8594a78-e3ad-4c82-87c7-d1fcc5196b0e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/fd745775-ded3-4cbb-bec3-1133085c7ec6" status: 200 len: 1266 microversion: 2.1 time: 0.169468 Aug 27 03:25:59.301202 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2957/5951] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:25:59 2022] GET /compute/v2.1/servers/fd745775-ded3-4cbb-bec3-1133085c7ec6 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:26:00.324373 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-9e70801a-47f9-4322-b7df-f1b1da0e416c tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:00.325148 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-9e70801a-47f9-4322-b7df-f1b1da0e416c tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: fd745775-ded3-4cbb-bec3-1133085c7ec6] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:00.333045 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9e70801a-47f9-4322-b7df-f1b1da0e416c tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:00.333552 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9e70801a-47f9-4322-b7df-f1b1da0e416c tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:00.334009 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9e70801a-47f9-4322-b7df-f1b1da0e416c tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:00.334727 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9e70801a-47f9-4322-b7df-f1b1da0e416c tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:00.335201 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9e70801a-47f9-4322-b7df-f1b1da0e416c tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:00.335649 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9e70801a-47f9-4322-b7df-f1b1da0e416c tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:00.468882 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-9e70801a-47f9-4322-b7df-f1b1da0e416c tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:00.477934 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-9e70801a-47f9-4322-b7df-f1b1da0e416c tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/fd745775-ded3-4cbb-bec3-1133085c7ec6" status: 200 len: 1266 microversion: 2.1 time: 0.159487 Aug 27 03:26:00.478493 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2995/5952] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:26:00 2022] GET /compute/v2.1/servers/fd745775-ded3-4cbb-bec3-1133085c7ec6 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:26:01.078496 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-49dccbaf-3c26-45de-93f6-848daa0becea req-aa9aa5e7-4b9c-48fe-b78b-a02ab65b0487 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd745775-ded3-4cbb-bec3-1133085c7ec6", "name": "network-vif-plugged", "status": "completed", "tag": "7ba79a1a-2c31-4c66-b747-5bb78ac13dc9"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:26:01.089243 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-49dccbaf-3c26-45de-93f6-848daa0becea req-aa9aa5e7-4b9c-48fe-b78b-a02ab65b0487 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:01.089723 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-49dccbaf-3c26-45de-93f6-848daa0becea req-aa9aa5e7-4b9c-48fe-b78b-a02ab65b0487 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:01.090869 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-49dccbaf-3c26-45de-93f6-848daa0becea req-aa9aa5e7-4b9c-48fe-b78b-a02ab65b0487 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:01.101736 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-49dccbaf-3c26-45de-93f6-848daa0becea req-aa9aa5e7-4b9c-48fe-b78b-a02ab65b0487 service nova] Creating event network-vif-plugged:7ba79a1a-2c31-4c66-b747-5bb78ac13dc9 for instance fd745775-ded3-4cbb-bec3-1133085c7ec6 on n-h2-852278-4 Aug 27 03:26:01.106750 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-49dccbaf-3c26-45de-93f6-848daa0becea req-aa9aa5e7-4b9c-48fe-b78b-a02ab65b0487 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032467 Aug 27 03:26:01.107373 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2958/5953] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:26:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:26:01.501227 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-be613a30-fad5-4838-9b2b-96850d6d313d tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:01.501848 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-be613a30-fad5-4838-9b2b-96850d6d313d tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: fd745775-ded3-4cbb-bec3-1133085c7ec6] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:01.504525 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:26:01.510088 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-be613a30-fad5-4838-9b2b-96850d6d313d tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:01.510585 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-be613a30-fad5-4838-9b2b-96850d6d313d tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:01.511032 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-be613a30-fad5-4838-9b2b-96850d6d313d tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:01.511735 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-be613a30-fad5-4838-9b2b-96850d6d313d tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:01.512195 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-be613a30-fad5-4838-9b2b-96850d6d313d tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:01.512658 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-be613a30-fad5-4838-9b2b-96850d6d313d tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:01.650652 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-be613a30-fad5-4838-9b2b-96850d6d313d tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:01.658735 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-be613a30-fad5-4838-9b2b-96850d6d313d tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/fd745775-ded3-4cbb-bec3-1133085c7ec6" status: 200 len: 1266 microversion: 2.1 time: 0.162949 Aug 27 03:26:01.659344 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2996/5954] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:26:01 2022] GET /compute/v2.1/servers/fd745775-ded3-4cbb-bec3-1133085c7ec6 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:26:02.681413 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b41a57f5-16a0-478b-9bea-7c82fe8e4a7a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:02.682116 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b41a57f5-16a0-478b-9bea-7c82fe8e4a7a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: fd745775-ded3-4cbb-bec3-1133085c7ec6] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:02.688906 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b41a57f5-16a0-478b-9bea-7c82fe8e4a7a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:02.689392 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b41a57f5-16a0-478b-9bea-7c82fe8e4a7a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:02.689837 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b41a57f5-16a0-478b-9bea-7c82fe8e4a7a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:02.690531 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b41a57f5-16a0-478b-9bea-7c82fe8e4a7a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:02.690973 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b41a57f5-16a0-478b-9bea-7c82fe8e4a7a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:02.691411 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b41a57f5-16a0-478b-9bea-7c82fe8e4a7a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:02.828758 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b41a57f5-16a0-478b-9bea-7c82fe8e4a7a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:02.837327 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b41a57f5-16a0-478b-9bea-7c82fe8e4a7a tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/fd745775-ded3-4cbb-bec3-1133085c7ec6" status: 200 len: 1453 microversion: 2.1 time: 0.161675 Aug 27 03:26:02.837913 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2959/5955] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:26:02 2022] GET /compute/v2.1/servers/fd745775-ded3-4cbb-bec3-1133085c7ec6 => generated 1453 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:26:02.858304 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7a4f9e84-213e-46a5-ad19-8525b322f951 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:02.858937 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-7a4f9e84-213e-46a5-ad19-8525b322f951 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: fd745775-ded3-4cbb-bec3-1133085c7ec6] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:02.866086 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7a4f9e84-213e-46a5-ad19-8525b322f951 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:02.866593 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7a4f9e84-213e-46a5-ad19-8525b322f951 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:02.867012 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7a4f9e84-213e-46a5-ad19-8525b322f951 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:02.867725 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7a4f9e84-213e-46a5-ad19-8525b322f951 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:02.868185 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7a4f9e84-213e-46a5-ad19-8525b322f951 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:02.868644 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7a4f9e84-213e-46a5-ad19-8525b322f951 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:03.003386 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-7a4f9e84-213e-46a5-ad19-8525b322f951 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:03.011928 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-7a4f9e84-213e-46a5-ad19-8525b322f951 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/fd745775-ded3-4cbb-bec3-1133085c7ec6" status: 200 len: 1453 microversion: 2.1 time: 0.157603 Aug 27 03:26:03.012542 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2997/5956] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:26:02 2022] GET /compute/v2.1/servers/fd745775-ded3-4cbb-bec3-1133085c7ec6 => generated 1453 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:26:04.665033 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-58b2fe25-8ce6-4009-a80f-f7a21f7315dc req-41f8182b-8295-404c-ba7a-ba51d940a622 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd745775-ded3-4cbb-bec3-1133085c7ec6", "tag": "7ba79a1a-2c31-4c66-b747-5bb78ac13dc9"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:26:04.675612 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-58b2fe25-8ce6-4009-a80f-f7a21f7315dc req-41f8182b-8295-404c-ba7a-ba51d940a622 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:04.676191 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-58b2fe25-8ce6-4009-a80f-f7a21f7315dc req-41f8182b-8295-404c-ba7a-ba51d940a622 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:04.676709 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-58b2fe25-8ce6-4009-a80f-f7a21f7315dc req-41f8182b-8295-404c-ba7a-ba51d940a622 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:04.688618 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-58b2fe25-8ce6-4009-a80f-f7a21f7315dc req-41f8182b-8295-404c-ba7a-ba51d940a622 service nova] Creating event network-changed:7ba79a1a-2c31-4c66-b747-5bb78ac13dc9 for instance fd745775-ded3-4cbb-bec3-1133085c7ec6 on n-h2-852278-4 Aug 27 03:26:04.693732 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-58b2fe25-8ce6-4009-a80f-f7a21f7315dc req-41f8182b-8295-404c-ba7a-ba51d940a622 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033117 Aug 27 03:26:04.694295 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2960/5957] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:26:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:26:07.508216 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-87a1b6c8-027a-44eb-b929-ec590d57fef1 tempest-TestNetworkAdvancedServerOps-1663634391 tempest-TestNetworkAdvancedServerOps-1663634391-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:07.508876 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-87a1b6c8-027a-44eb-b929-ec590d57fef1 tempest-TestNetworkAdvancedServerOps-1663634391 tempest-TestNetworkAdvancedServerOps-1663634391-project-admin] [instance: 5e7c9320-06e9-4efa-8b90-26c27f26d3f7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:07.517005 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-87a1b6c8-027a-44eb-b929-ec590d57fef1 tempest-TestNetworkAdvancedServerOps-1663634391 tempest-TestNetworkAdvancedServerOps-1663634391-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:07.517508 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-87a1b6c8-027a-44eb-b929-ec590d57fef1 tempest-TestNetworkAdvancedServerOps-1663634391 tempest-TestNetworkAdvancedServerOps-1663634391-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:07.517970 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-87a1b6c8-027a-44eb-b929-ec590d57fef1 tempest-TestNetworkAdvancedServerOps-1663634391 tempest-TestNetworkAdvancedServerOps-1663634391-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:07.518679 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-87a1b6c8-027a-44eb-b929-ec590d57fef1 tempest-TestNetworkAdvancedServerOps-1663634391 tempest-TestNetworkAdvancedServerOps-1663634391-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:07.519150 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-87a1b6c8-027a-44eb-b929-ec590d57fef1 tempest-TestNetworkAdvancedServerOps-1663634391 tempest-TestNetworkAdvancedServerOps-1663634391-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:07.519591 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-87a1b6c8-027a-44eb-b929-ec590d57fef1 tempest-TestNetworkAdvancedServerOps-1663634391 tempest-TestNetworkAdvancedServerOps-1663634391-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:07.656546 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-87a1b6c8-027a-44eb-b929-ec590d57fef1 tempest-TestNetworkAdvancedServerOps-1663634391 tempest-TestNetworkAdvancedServerOps-1663634391-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/5e7c9320-06e9-4efa-8b90-26c27f26d3f7" status: 200 len: 1834 microversion: 2.1 time: 0.152135 Aug 27 03:26:07.657127 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2998/5958] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:26:07 2022] GET /compute/v2.1/servers/5e7c9320-06e9-4efa-8b90-26c27f26d3f7 => generated 1834 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:26:07.679144 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b997386c-0793-4f46-905d-7b74e5f5535c tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:07.680158 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b997386c-0793-4f46-905d-7b74e5f5535c tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 5e7c9320-06e9-4efa-8b90-26c27f26d3f7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:07.686748 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b997386c-0793-4f46-905d-7b74e5f5535c tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:07.687252 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b997386c-0793-4f46-905d-7b74e5f5535c tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:07.687687 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b997386c-0793-4f46-905d-7b74e5f5535c tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:07.688408 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b997386c-0793-4f46-905d-7b74e5f5535c tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:07.688860 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b997386c-0793-4f46-905d-7b74e5f5535c tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:07.689319 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b997386c-0793-4f46-905d-7b74e5f5535c tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:07.833043 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b997386c-0793-4f46-905d-7b74e5f5535c tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:07.841006 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b997386c-0793-4f46-905d-7b74e5f5535c tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/5e7c9320-06e9-4efa-8b90-26c27f26d3f7" status: 200 len: 1683 microversion: 2.1 time: 0.167244 Aug 27 03:26:07.841591 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2961/5959] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:26:07 2022] GET /compute/v2.1/servers/5e7c9320-06e9-4efa-8b90-26c27f26d3f7 => generated 1683 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:26:07.938985 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e3bf64da-2406-4f10-94d1-0e5becbbebcd tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:26:07.941449 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-e3bf64da-2406-4f10-94d1-0e5becbbebcd tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 5e7c9320-06e9-4efa-8b90-26c27f26d3f7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:07.947536 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e3bf64da-2406-4f10-94d1-0e5becbbebcd tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:07.948029 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e3bf64da-2406-4f10-94d1-0e5becbbebcd tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:07.948586 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e3bf64da-2406-4f10-94d1-0e5becbbebcd tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:07.949324 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e3bf64da-2406-4f10-94d1-0e5becbbebcd tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:07.949800 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e3bf64da-2406-4f10-94d1-0e5becbbebcd tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:07.950231 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e3bf64da-2406-4f10-94d1-0e5becbbebcd tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:08.021013 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e3bf64da-2406-4f10-94d1-0e5becbbebcd tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "POST /compute/v2.1/servers/5e7c9320-06e9-4efa-8b90-26c27f26d3f7/action" status: 200 len: 32627 microversion: 2.1 time: 0.085624 Aug 27 03:26:08.021861 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 2999/5960] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:26:07 2022] POST /compute/v2.1/servers/5e7c9320-06e9-4efa-8b90-26c27f26d3f7/action => generated 32627 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:26:08.150418 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-de313175-e97d-4dce-8cee-5b663b6002b2 tempest-TestNetworkAdvancedServerOps-1663634391 tempest-TestNetworkAdvancedServerOps-1663634391-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:26:08.151021 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-de313175-e97d-4dce-8cee-5b663b6002b2 tempest-TestNetworkAdvancedServerOps-1663634391 tempest-TestNetworkAdvancedServerOps-1663634391-project-admin] [instance: 5e7c9320-06e9-4efa-8b90-26c27f26d3f7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:08.158792 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-de313175-e97d-4dce-8cee-5b663b6002b2 tempest-TestNetworkAdvancedServerOps-1663634391 tempest-TestNetworkAdvancedServerOps-1663634391-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:08.159288 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-de313175-e97d-4dce-8cee-5b663b6002b2 tempest-TestNetworkAdvancedServerOps-1663634391 tempest-TestNetworkAdvancedServerOps-1663634391-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:08.159723 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-de313175-e97d-4dce-8cee-5b663b6002b2 tempest-TestNetworkAdvancedServerOps-1663634391 tempest-TestNetworkAdvancedServerOps-1663634391-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:08.160467 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-de313175-e97d-4dce-8cee-5b663b6002b2 tempest-TestNetworkAdvancedServerOps-1663634391 tempest-TestNetworkAdvancedServerOps-1663634391-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:08.161165 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-de313175-e97d-4dce-8cee-5b663b6002b2 tempest-TestNetworkAdvancedServerOps-1663634391 tempest-TestNetworkAdvancedServerOps-1663634391-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:08.161624 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-de313175-e97d-4dce-8cee-5b663b6002b2 tempest-TestNetworkAdvancedServerOps-1663634391 tempest-TestNetworkAdvancedServerOps-1663634391-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:08.203866 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-de313175-e97d-4dce-8cee-5b663b6002b2 tempest-TestNetworkAdvancedServerOps-1663634391 tempest-TestNetworkAdvancedServerOps-1663634391-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'fad20a657f3e42c7b87739cd4626ddbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eff062c8d50d4175a0ebc1c3b9315e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:08.204512 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-de313175-e97d-4dce-8cee-5b663b6002b2 tempest-TestNetworkAdvancedServerOps-1663634391 tempest-TestNetworkAdvancedServerOps-1663634391-project-admin] [instance: 5e7c9320-06e9-4efa-8b90-26c27f26d3f7] flavor_id is None. Assuming migration. {{(pid=134052) resize /opt/stack/nova/nova/compute/api.py:4194}} Aug 27 03:26:08.204949 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-de313175-e97d-4dce-8cee-5b663b6002b2 tempest-TestNetworkAdvancedServerOps-1663634391 tempest-TestNetworkAdvancedServerOps-1663634391-project-admin] [instance: 5e7c9320-06e9-4efa-8b90-26c27f26d3f7] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=134052) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 27 03:26:08.383626 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-de313175-e97d-4dce-8cee-5b663b6002b2 tempest-TestNetworkAdvancedServerOps-1663634391 tempest-TestNetworkAdvancedServerOps-1663634391-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/5e7c9320-06e9-4efa-8b90-26c27f26d3f7/action" status: 202 len: 0 microversion: 2.1 time: 0.238895 Aug 27 03:26:08.384466 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2962/5961] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:26:08 2022] POST /compute/v2.1/servers/5e7c9320-06e9-4efa-8b90-26c27f26d3f7/action => generated 0 bytes in 241 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:26:08.393774 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ea902668-6947-465b-a21c-7e55a6ea69b2 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:08.394489 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-ea902668-6947-465b-a21c-7e55a6ea69b2 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 5e7c9320-06e9-4efa-8b90-26c27f26d3f7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:08.401614 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ea902668-6947-465b-a21c-7e55a6ea69b2 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:08.402042 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ea902668-6947-465b-a21c-7e55a6ea69b2 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:08.402472 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ea902668-6947-465b-a21c-7e55a6ea69b2 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:08.403190 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ea902668-6947-465b-a21c-7e55a6ea69b2 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:08.403649 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ea902668-6947-465b-a21c-7e55a6ea69b2 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:08.404076 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ea902668-6947-465b-a21c-7e55a6ea69b2 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:08.584123 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-ea902668-6947-465b-a21c-7e55a6ea69b2 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:08.592409 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ea902668-6947-465b-a21c-7e55a6ea69b2 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/5e7c9320-06e9-4efa-8b90-26c27f26d3f7" status: 200 len: 1692 microversion: 2.1 time: 0.202967 Aug 27 03:26:08.593019 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3000/5962] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:26:08 2022] GET /compute/v2.1/servers/5e7c9320-06e9-4efa-8b90-26c27f26d3f7 => generated 1692 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:26:09.616131 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a417a357-f804-4a8b-bc30-69029136f621 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:09.616953 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a417a357-f804-4a8b-bc30-69029136f621 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 5e7c9320-06e9-4efa-8b90-26c27f26d3f7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:09.630062 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a417a357-f804-4a8b-bc30-69029136f621 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:09.630584 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a417a357-f804-4a8b-bc30-69029136f621 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:09.631240 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a417a357-f804-4a8b-bc30-69029136f621 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:09.631944 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a417a357-f804-4a8b-bc30-69029136f621 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:09.632422 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a417a357-f804-4a8b-bc30-69029136f621 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:09.632842 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a417a357-f804-4a8b-bc30-69029136f621 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:09.776919 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-a417a357-f804-4a8b-bc30-69029136f621 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:09.785127 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a417a357-f804-4a8b-bc30-69029136f621 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/5e7c9320-06e9-4efa-8b90-26c27f26d3f7" status: 200 len: 1692 microversion: 2.1 time: 0.174091 Aug 27 03:26:09.785905 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2963/5963] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:26:09 2022] GET /compute/v2.1/servers/5e7c9320-06e9-4efa-8b90-26c27f26d3f7 => generated 1692 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:26:10.811674 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-63cad6c4-5c3f-4461-91dd-81aebec7f17a tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:10.812748 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-63cad6c4-5c3f-4461-91dd-81aebec7f17a tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 5e7c9320-06e9-4efa-8b90-26c27f26d3f7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:10.830235 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-63cad6c4-5c3f-4461-91dd-81aebec7f17a tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:10.830764 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-63cad6c4-5c3f-4461-91dd-81aebec7f17a tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:10.831197 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-63cad6c4-5c3f-4461-91dd-81aebec7f17a tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:10.831969 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-63cad6c4-5c3f-4461-91dd-81aebec7f17a tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:10.832461 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-63cad6c4-5c3f-4461-91dd-81aebec7f17a tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:10.832903 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-63cad6c4-5c3f-4461-91dd-81aebec7f17a tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:10.981380 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-63cad6c4-5c3f-4461-91dd-81aebec7f17a tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:10.990047 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-63cad6c4-5c3f-4461-91dd-81aebec7f17a tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/5e7c9320-06e9-4efa-8b90-26c27f26d3f7" status: 200 len: 1697 microversion: 2.1 time: 0.185760 Aug 27 03:26:10.990741 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3001/5964] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:26:10 2022] GET /compute/v2.1/servers/5e7c9320-06e9-4efa-8b90-26c27f26d3f7 => generated 1697 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:26:12.017401 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-adf5bd3c-c7c6-4e00-86e8-27cbd5cc1eb9 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:12.017949 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-adf5bd3c-c7c6-4e00-86e8-27cbd5cc1eb9 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 5e7c9320-06e9-4efa-8b90-26c27f26d3f7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:12.025639 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-adf5bd3c-c7c6-4e00-86e8-27cbd5cc1eb9 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:12.026149 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-adf5bd3c-c7c6-4e00-86e8-27cbd5cc1eb9 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:12.026577 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-adf5bd3c-c7c6-4e00-86e8-27cbd5cc1eb9 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:12.027267 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-adf5bd3c-c7c6-4e00-86e8-27cbd5cc1eb9 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:12.027718 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-adf5bd3c-c7c6-4e00-86e8-27cbd5cc1eb9 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:12.028139 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-adf5bd3c-c7c6-4e00-86e8-27cbd5cc1eb9 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:12.171356 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-adf5bd3c-c7c6-4e00-86e8-27cbd5cc1eb9 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:12.180339 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-adf5bd3c-c7c6-4e00-86e8-27cbd5cc1eb9 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/5e7c9320-06e9-4efa-8b90-26c27f26d3f7" status: 200 len: 1697 microversion: 2.1 time: 0.168769 Aug 27 03:26:12.181018 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2964/5965] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:26:12 2022] GET /compute/v2.1/servers/5e7c9320-06e9-4efa-8b90-26c27f26d3f7 => generated 1697 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:26:13.203534 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-bfc97f84-d583-4aa4-b478-e9c008f68f14 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:13.204260 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-bfc97f84-d583-4aa4-b478-e9c008f68f14 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 5e7c9320-06e9-4efa-8b90-26c27f26d3f7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:13.211718 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bfc97f84-d583-4aa4-b478-e9c008f68f14 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:13.212223 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bfc97f84-d583-4aa4-b478-e9c008f68f14 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:13.212712 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bfc97f84-d583-4aa4-b478-e9c008f68f14 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:13.213439 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bfc97f84-d583-4aa4-b478-e9c008f68f14 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:13.213883 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bfc97f84-d583-4aa4-b478-e9c008f68f14 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:13.214324 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bfc97f84-d583-4aa4-b478-e9c008f68f14 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:13.354487 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-bfc97f84-d583-4aa4-b478-e9c008f68f14 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:13.362766 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-bfc97f84-d583-4aa4-b478-e9c008f68f14 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/5e7c9320-06e9-4efa-8b90-26c27f26d3f7" status: 200 len: 1697 microversion: 2.1 time: 0.163612 Aug 27 03:26:13.363357 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3002/5966] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:26:13 2022] GET /compute/v2.1/servers/5e7c9320-06e9-4efa-8b90-26c27f26d3f7 => generated 1697 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:26:14.391431 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0882de73-8073-41e3-b268-79dfdcf92ebc tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:14.392304 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-0882de73-8073-41e3-b268-79dfdcf92ebc tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 5e7c9320-06e9-4efa-8b90-26c27f26d3f7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:14.400597 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0882de73-8073-41e3-b268-79dfdcf92ebc tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:14.401089 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0882de73-8073-41e3-b268-79dfdcf92ebc tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:14.401535 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0882de73-8073-41e3-b268-79dfdcf92ebc tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:14.402243 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0882de73-8073-41e3-b268-79dfdcf92ebc tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:14.402699 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0882de73-8073-41e3-b268-79dfdcf92ebc tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:14.403126 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0882de73-8073-41e3-b268-79dfdcf92ebc tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:14.546377 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0882de73-8073-41e3-b268-79dfdcf92ebc tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:14.555248 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-0882de73-8073-41e3-b268-79dfdcf92ebc tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/5e7c9320-06e9-4efa-8b90-26c27f26d3f7" status: 200 len: 1697 microversion: 2.1 time: 0.170214 Aug 27 03:26:14.555842 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2965/5967] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:26:14 2022] GET /compute/v2.1/servers/5e7c9320-06e9-4efa-8b90-26c27f26d3f7 => generated 1697 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:26:15.576578 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-32949644-1eaf-46ed-9048-db1b3d005da7 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:15.577274 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-32949644-1eaf-46ed-9048-db1b3d005da7 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 5e7c9320-06e9-4efa-8b90-26c27f26d3f7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:15.585038 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-32949644-1eaf-46ed-9048-db1b3d005da7 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:15.585553 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-32949644-1eaf-46ed-9048-db1b3d005da7 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:15.586012 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-32949644-1eaf-46ed-9048-db1b3d005da7 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:15.586744 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-32949644-1eaf-46ed-9048-db1b3d005da7 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:15.587214 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-32949644-1eaf-46ed-9048-db1b3d005da7 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:15.587660 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-32949644-1eaf-46ed-9048-db1b3d005da7 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:15.734108 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-32949644-1eaf-46ed-9048-db1b3d005da7 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:15.742381 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-32949644-1eaf-46ed-9048-db1b3d005da7 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/5e7c9320-06e9-4efa-8b90-26c27f26d3f7" status: 200 len: 1697 microversion: 2.1 time: 0.169926 Aug 27 03:26:15.742966 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3003/5968] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:26:15 2022] GET /compute/v2.1/servers/5e7c9320-06e9-4efa-8b90-26c27f26d3f7 => generated 1697 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:26:16.773102 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-14bc5a2b-bb5e-440e-8e8c-2c7b0da257be tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:16.773896 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-14bc5a2b-bb5e-440e-8e8c-2c7b0da257be tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 5e7c9320-06e9-4efa-8b90-26c27f26d3f7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:16.776903 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=36 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:26:16.783395 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-14bc5a2b-bb5e-440e-8e8c-2c7b0da257be tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:16.783931 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-14bc5a2b-bb5e-440e-8e8c-2c7b0da257be tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:16.784445 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-14bc5a2b-bb5e-440e-8e8c-2c7b0da257be tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:16.785317 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-14bc5a2b-bb5e-440e-8e8c-2c7b0da257be tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:16.785709 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-14bc5a2b-bb5e-440e-8e8c-2c7b0da257be tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:16.786255 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-14bc5a2b-bb5e-440e-8e8c-2c7b0da257be tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:16.929453 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-14bc5a2b-bb5e-440e-8e8c-2c7b0da257be tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:16.938075 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-14bc5a2b-bb5e-440e-8e8c-2c7b0da257be tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/5e7c9320-06e9-4efa-8b90-26c27f26d3f7" status: 200 len: 1697 microversion: 2.1 time: 0.170711 Aug 27 03:26:16.938716 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2966/5969] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:26:16 2022] GET /compute/v2.1/servers/5e7c9320-06e9-4efa-8b90-26c27f26d3f7 => generated 1697 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:26:17.959307 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a678dd98-5385-41f1-9c48-7242267a376f tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:17.959936 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-a678dd98-5385-41f1-9c48-7242267a376f tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 5e7c9320-06e9-4efa-8b90-26c27f26d3f7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:17.967546 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a678dd98-5385-41f1-9c48-7242267a376f tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:17.968051 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a678dd98-5385-41f1-9c48-7242267a376f tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:17.968550 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a678dd98-5385-41f1-9c48-7242267a376f tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:17.969274 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a678dd98-5385-41f1-9c48-7242267a376f tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:17.969746 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a678dd98-5385-41f1-9c48-7242267a376f tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:17.970210 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a678dd98-5385-41f1-9c48-7242267a376f tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:18.102289 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-a678dd98-5385-41f1-9c48-7242267a376f tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:18.110718 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a678dd98-5385-41f1-9c48-7242267a376f tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/5e7c9320-06e9-4efa-8b90-26c27f26d3f7" status: 200 len: 1697 microversion: 2.1 time: 0.155504 Aug 27 03:26:18.111314 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3004/5970] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:26:17 2022] GET /compute/v2.1/servers/5e7c9320-06e9-4efa-8b90-26c27f26d3f7 => generated 1697 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:26:19.135067 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-2f51e18c-6bbf-4180-896b-ef812b182449 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:19.135930 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-2f51e18c-6bbf-4180-896b-ef812b182449 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 5e7c9320-06e9-4efa-8b90-26c27f26d3f7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:19.147436 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2f51e18c-6bbf-4180-896b-ef812b182449 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:19.147932 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2f51e18c-6bbf-4180-896b-ef812b182449 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:19.148531 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2f51e18c-6bbf-4180-896b-ef812b182449 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:19.149272 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2f51e18c-6bbf-4180-896b-ef812b182449 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:19.149809 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2f51e18c-6bbf-4180-896b-ef812b182449 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:19.150447 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2f51e18c-6bbf-4180-896b-ef812b182449 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:19.154877 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:26:19.296161 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-2f51e18c-6bbf-4180-896b-ef812b182449 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:19.306244 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-2f51e18c-6bbf-4180-896b-ef812b182449 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/5e7c9320-06e9-4efa-8b90-26c27f26d3f7" status: 200 len: 1697 microversion: 2.1 time: 0.176182 Aug 27 03:26:19.306918 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2967/5971] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:26:19 2022] GET /compute/v2.1/servers/5e7c9320-06e9-4efa-8b90-26c27f26d3f7 => generated 1697 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:26:20.327524 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-191bccc0-8d44-4b0a-a383-2b7e76e54736 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:20.328254 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-191bccc0-8d44-4b0a-a383-2b7e76e54736 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 5e7c9320-06e9-4efa-8b90-26c27f26d3f7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:20.335733 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-191bccc0-8d44-4b0a-a383-2b7e76e54736 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:20.336567 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-191bccc0-8d44-4b0a-a383-2b7e76e54736 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:20.337256 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-191bccc0-8d44-4b0a-a383-2b7e76e54736 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:20.337989 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-191bccc0-8d44-4b0a-a383-2b7e76e54736 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:20.338461 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-191bccc0-8d44-4b0a-a383-2b7e76e54736 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:20.338949 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-191bccc0-8d44-4b0a-a383-2b7e76e54736 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:20.485987 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-191bccc0-8d44-4b0a-a383-2b7e76e54736 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:20.498035 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-191bccc0-8d44-4b0a-a383-2b7e76e54736 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/5e7c9320-06e9-4efa-8b90-26c27f26d3f7" status: 200 len: 1697 microversion: 2.1 time: 0.174546 Aug 27 03:26:20.498911 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3005/5972] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:26:20 2022] GET /compute/v2.1/servers/5e7c9320-06e9-4efa-8b90-26c27f26d3f7 => generated 1697 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:26:21.522831 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-69bb2ab7-50b3-4484-bb8c-01a035259154 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:21.523472 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-69bb2ab7-50b3-4484-bb8c-01a035259154 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 5e7c9320-06e9-4efa-8b90-26c27f26d3f7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:21.530967 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-69bb2ab7-50b3-4484-bb8c-01a035259154 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:21.531460 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-69bb2ab7-50b3-4484-bb8c-01a035259154 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:21.531894 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-69bb2ab7-50b3-4484-bb8c-01a035259154 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:21.532736 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-69bb2ab7-50b3-4484-bb8c-01a035259154 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:21.533178 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-69bb2ab7-50b3-4484-bb8c-01a035259154 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:21.533667 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-69bb2ab7-50b3-4484-bb8c-01a035259154 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:21.672957 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-69bb2ab7-50b3-4484-bb8c-01a035259154 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:21.681502 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-69bb2ab7-50b3-4484-bb8c-01a035259154 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/5e7c9320-06e9-4efa-8b90-26c27f26d3f7" status: 200 len: 1697 microversion: 2.1 time: 0.162805 Aug 27 03:26:21.682108 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2968/5973] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:26:21 2022] GET /compute/v2.1/servers/5e7c9320-06e9-4efa-8b90-26c27f26d3f7 => generated 1697 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:26:22.703782 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-1c76f630-39b6-4a01-9ee7-f2ba893ca6ec tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:22.704410 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-1c76f630-39b6-4a01-9ee7-f2ba893ca6ec tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 5e7c9320-06e9-4efa-8b90-26c27f26d3f7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:22.712015 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1c76f630-39b6-4a01-9ee7-f2ba893ca6ec tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:22.712565 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1c76f630-39b6-4a01-9ee7-f2ba893ca6ec tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:22.713030 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1c76f630-39b6-4a01-9ee7-f2ba893ca6ec tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:22.713743 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1c76f630-39b6-4a01-9ee7-f2ba893ca6ec tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:22.714217 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1c76f630-39b6-4a01-9ee7-f2ba893ca6ec tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:22.714656 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1c76f630-39b6-4a01-9ee7-f2ba893ca6ec tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:22.717446 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=86 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:26:22.857353 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-1c76f630-39b6-4a01-9ee7-f2ba893ca6ec tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:22.865377 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-1c76f630-39b6-4a01-9ee7-f2ba893ca6ec tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/5e7c9320-06e9-4efa-8b90-26c27f26d3f7" status: 200 len: 1697 microversion: 2.1 time: 0.165647 Aug 27 03:26:22.865984 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3006/5974] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:26:22 2022] GET /compute/v2.1/servers/5e7c9320-06e9-4efa-8b90-26c27f26d3f7 => generated 1697 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:26:23.887058 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-15e1ac8c-d5ed-4ec9-9328-f411e152c11a tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:23.887703 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-15e1ac8c-d5ed-4ec9-9328-f411e152c11a tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 5e7c9320-06e9-4efa-8b90-26c27f26d3f7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:23.895667 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-15e1ac8c-d5ed-4ec9-9328-f411e152c11a tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:23.896165 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-15e1ac8c-d5ed-4ec9-9328-f411e152c11a tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:23.896685 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-15e1ac8c-d5ed-4ec9-9328-f411e152c11a tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:23.897395 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-15e1ac8c-d5ed-4ec9-9328-f411e152c11a tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:23.897849 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-15e1ac8c-d5ed-4ec9-9328-f411e152c11a tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:23.898279 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-15e1ac8c-d5ed-4ec9-9328-f411e152c11a tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:24.042061 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-15e1ac8c-d5ed-4ec9-9328-f411e152c11a tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:24.050351 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-15e1ac8c-d5ed-4ec9-9328-f411e152c11a tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/5e7c9320-06e9-4efa-8b90-26c27f26d3f7" status: 200 len: 1697 microversion: 2.1 time: 0.167658 Aug 27 03:26:24.050955 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2969/5975] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:26:23 2022] GET /compute/v2.1/servers/5e7c9320-06e9-4efa-8b90-26c27f26d3f7 => generated 1697 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:26:25.071581 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0d5cb196-dc0d-4303-be44-859fd80c3430 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:25.072192 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-0d5cb196-dc0d-4303-be44-859fd80c3430 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 5e7c9320-06e9-4efa-8b90-26c27f26d3f7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:25.079868 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0d5cb196-dc0d-4303-be44-859fd80c3430 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:25.080401 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0d5cb196-dc0d-4303-be44-859fd80c3430 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:25.080847 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0d5cb196-dc0d-4303-be44-859fd80c3430 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:25.081632 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0d5cb196-dc0d-4303-be44-859fd80c3430 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:25.082128 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0d5cb196-dc0d-4303-be44-859fd80c3430 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:25.082569 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0d5cb196-dc0d-4303-be44-859fd80c3430 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:25.245929 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-0d5cb196-dc0d-4303-be44-859fd80c3430 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:25.255192 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-0d5cb196-dc0d-4303-be44-859fd80c3430 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/5e7c9320-06e9-4efa-8b90-26c27f26d3f7" status: 200 len: 1697 microversion: 2.1 time: 0.187420 Aug 27 03:26:25.255901 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3007/5976] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:26:25 2022] GET /compute/v2.1/servers/5e7c9320-06e9-4efa-8b90-26c27f26d3f7 => generated 1697 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:26:26.277934 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-60906f21-5ed1-40eb-ba99-f71e1a474651 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:26.278510 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-60906f21-5ed1-40eb-ba99-f71e1a474651 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 5e7c9320-06e9-4efa-8b90-26c27f26d3f7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:26.286746 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-60906f21-5ed1-40eb-ba99-f71e1a474651 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:26.287431 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-60906f21-5ed1-40eb-ba99-f71e1a474651 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:26.287858 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-60906f21-5ed1-40eb-ba99-f71e1a474651 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:26.288842 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-60906f21-5ed1-40eb-ba99-f71e1a474651 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:26.289442 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-60906f21-5ed1-40eb-ba99-f71e1a474651 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:26.289941 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-60906f21-5ed1-40eb-ba99-f71e1a474651 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:26.450320 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-60906f21-5ed1-40eb-ba99-f71e1a474651 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:26.459484 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-60906f21-5ed1-40eb-ba99-f71e1a474651 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/5e7c9320-06e9-4efa-8b90-26c27f26d3f7" status: 200 len: 1697 microversion: 2.1 time: 0.186194 Aug 27 03:26:26.460062 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2970/5977] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:26:26 2022] GET /compute/v2.1/servers/5e7c9320-06e9-4efa-8b90-26c27f26d3f7 => generated 1697 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:26:27.481899 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-1e105f48-5e84-4b73-9c47-4b30fa643ee7 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:27.482518 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-1e105f48-5e84-4b73-9c47-4b30fa643ee7 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 5e7c9320-06e9-4efa-8b90-26c27f26d3f7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:27.489888 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1e105f48-5e84-4b73-9c47-4b30fa643ee7 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:27.490470 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1e105f48-5e84-4b73-9c47-4b30fa643ee7 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:27.490933 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1e105f48-5e84-4b73-9c47-4b30fa643ee7 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:27.491703 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1e105f48-5e84-4b73-9c47-4b30fa643ee7 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:27.492188 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1e105f48-5e84-4b73-9c47-4b30fa643ee7 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:27.492801 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1e105f48-5e84-4b73-9c47-4b30fa643ee7 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:27.717580 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-1e105f48-5e84-4b73-9c47-4b30fa643ee7 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:27.726361 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-1e105f48-5e84-4b73-9c47-4b30fa643ee7 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/5e7c9320-06e9-4efa-8b90-26c27f26d3f7" status: 200 len: 1696 microversion: 2.1 time: 0.248370 Aug 27 03:26:27.726955 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3008/5978] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:26:27 2022] GET /compute/v2.1/servers/5e7c9320-06e9-4efa-8b90-26c27f26d3f7 => generated 1696 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:26:27.954702 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-b8ca0834-f4e1-4a9c-bc66-8f8a598d8b8f req-657ccc7c-b228-493a-b8f4-5a105f017336 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e7c9320-06e9-4efa-8b90-26c27f26d3f7", "name": "network-vif-unplugged", "status": "completed", "tag": "32946112-b370-4fb0-9a69-4fb4c09568b9"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:26:27.965806 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-b8ca0834-f4e1-4a9c-bc66-8f8a598d8b8f req-657ccc7c-b228-493a-b8f4-5a105f017336 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:27.966354 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-b8ca0834-f4e1-4a9c-bc66-8f8a598d8b8f req-657ccc7c-b228-493a-b8f4-5a105f017336 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:27.966838 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-b8ca0834-f4e1-4a9c-bc66-8f8a598d8b8f req-657ccc7c-b228-493a-b8f4-5a105f017336 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:27.979318 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-b8ca0834-f4e1-4a9c-bc66-8f8a598d8b8f req-657ccc7c-b228-493a-b8f4-5a105f017336 service nova] Creating event network-vif-unplugged:32946112-b370-4fb0-9a69-4fb4c09568b9 for instance 5e7c9320-06e9-4efa-8b90-26c27f26d3f7 on n-h2-852278-4 Aug 27 03:26:27.985419 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [req-b8ca0834-f4e1-4a9c-bc66-8f8a598d8b8f req-657ccc7c-b228-493a-b8f4-5a105f017336 service nova] Instance 5e7c9320-06e9-4efa-8b90-26c27f26d3f7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-852278-4', 'n-h1-852278-4'} {{(pid=134052) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 03:26:27.999320 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-b8ca0834-f4e1-4a9c-bc66-8f8a598d8b8f req-657ccc7c-b228-493a-b8f4-5a105f017336 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047954 Aug 27 03:26:28.000240 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2971/5979] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:26:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:26:28.747962 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-365dc0a1-a775-4a94-81c7-0e4931939c87 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:28.748589 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-365dc0a1-a775-4a94-81c7-0e4931939c87 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 5e7c9320-06e9-4efa-8b90-26c27f26d3f7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:28.756348 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-365dc0a1-a775-4a94-81c7-0e4931939c87 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:28.756880 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-365dc0a1-a775-4a94-81c7-0e4931939c87 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:28.757371 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-365dc0a1-a775-4a94-81c7-0e4931939c87 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:28.758095 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-365dc0a1-a775-4a94-81c7-0e4931939c87 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:28.758564 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-365dc0a1-a775-4a94-81c7-0e4931939c87 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:28.758988 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-365dc0a1-a775-4a94-81c7-0e4931939c87 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:28.960280 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-365dc0a1-a775-4a94-81c7-0e4931939c87 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:28.968775 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-365dc0a1-a775-4a94-81c7-0e4931939c87 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/5e7c9320-06e9-4efa-8b90-26c27f26d3f7" status: 200 len: 1696 microversion: 2.1 time: 0.225281 Aug 27 03:26:28.969378 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3009/5980] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:26:28 2022] GET /compute/v2.1/servers/5e7c9320-06e9-4efa-8b90-26c27f26d3f7 => generated 1696 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:26:29.991577 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ab29b5c4-e83c-4daf-98ac-af24a9b8c019 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:29.992279 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-ab29b5c4-e83c-4daf-98ac-af24a9b8c019 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 5e7c9320-06e9-4efa-8b90-26c27f26d3f7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:30.000087 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ab29b5c4-e83c-4daf-98ac-af24a9b8c019 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:30.000601 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ab29b5c4-e83c-4daf-98ac-af24a9b8c019 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:30.001040 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ab29b5c4-e83c-4daf-98ac-af24a9b8c019 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:30.001741 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ab29b5c4-e83c-4daf-98ac-af24a9b8c019 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:30.002191 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ab29b5c4-e83c-4daf-98ac-af24a9b8c019 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:30.002622 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ab29b5c4-e83c-4daf-98ac-af24a9b8c019 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:30.040933 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-1f0d9e89-59ae-4470-8202-dfc391a70b91 req-4e9e0da8-eafd-483f-bed0-d0f0fdadb9ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e7c9320-06e9-4efa-8b90-26c27f26d3f7", "tag": "32946112-b370-4fb0-9a69-4fb4c09568b9"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:26:30.051960 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-1f0d9e89-59ae-4470-8202-dfc391a70b91 req-4e9e0da8-eafd-483f-bed0-d0f0fdadb9ed service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:30.052488 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-1f0d9e89-59ae-4470-8202-dfc391a70b91 req-4e9e0da8-eafd-483f-bed0-d0f0fdadb9ed service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:30.052926 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-1f0d9e89-59ae-4470-8202-dfc391a70b91 req-4e9e0da8-eafd-483f-bed0-d0f0fdadb9ed service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:30.071379 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-1f0d9e89-59ae-4470-8202-dfc391a70b91 req-4e9e0da8-eafd-483f-bed0-d0f0fdadb9ed service nova] Creating event network-changed:32946112-b370-4fb0-9a69-4fb4c09568b9 for instance 5e7c9320-06e9-4efa-8b90-26c27f26d3f7 on n-h2-852278-4 Aug 27 03:26:30.077673 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [req-1f0d9e89-59ae-4470-8202-dfc391a70b91 req-4e9e0da8-eafd-483f-bed0-d0f0fdadb9ed service nova] Instance 5e7c9320-06e9-4efa-8b90-26c27f26d3f7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-852278-4', 'n-h1-852278-4'} {{(pid=134051) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 03:26:30.089161 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-1f0d9e89-59ae-4470-8202-dfc391a70b91 req-4e9e0da8-eafd-483f-bed0-d0f0fdadb9ed service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052264 Aug 27 03:26:30.089831 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3010/5981] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:26:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:26:30.146810 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-ab29b5c4-e83c-4daf-98ac-af24a9b8c019 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:30.155135 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ab29b5c4-e83c-4daf-98ac-af24a9b8c019 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/5e7c9320-06e9-4efa-8b90-26c27f26d3f7" status: 200 len: 1694 microversion: 2.1 time: 0.168797 Aug 27 03:26:30.155832 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2972/5982] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:26:29 2022] GET /compute/v2.1/servers/5e7c9320-06e9-4efa-8b90-26c27f26d3f7 => generated 1694 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:26:31.179045 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3b02af6f-9d6f-47c8-9aa4-4a8af37c5e41 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:31.179806 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-3b02af6f-9d6f-47c8-9aa4-4a8af37c5e41 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 5e7c9320-06e9-4efa-8b90-26c27f26d3f7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:31.187129 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3b02af6f-9d6f-47c8-9aa4-4a8af37c5e41 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:31.187784 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3b02af6f-9d6f-47c8-9aa4-4a8af37c5e41 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:31.188246 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3b02af6f-9d6f-47c8-9aa4-4a8af37c5e41 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:31.189045 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3b02af6f-9d6f-47c8-9aa4-4a8af37c5e41 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:31.189626 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3b02af6f-9d6f-47c8-9aa4-4a8af37c5e41 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:31.190073 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3b02af6f-9d6f-47c8-9aa4-4a8af37c5e41 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:31.345822 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-3b02af6f-9d6f-47c8-9aa4-4a8af37c5e41 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:31.354102 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-3b02af6f-9d6f-47c8-9aa4-4a8af37c5e41 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/5e7c9320-06e9-4efa-8b90-26c27f26d3f7" status: 200 len: 1691 microversion: 2.1 time: 0.180906 Aug 27 03:26:31.354668 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3011/5983] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:26:31 2022] GET /compute/v2.1/servers/5e7c9320-06e9-4efa-8b90-26c27f26d3f7 => generated 1691 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:26:31.378110 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-2057fd79-65b0-42fb-82b0-954c7a9a4e9d tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:26:31.378729 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-2057fd79-65b0-42fb-82b0-954c7a9a4e9d tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 5e7c9320-06e9-4efa-8b90-26c27f26d3f7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:31.386959 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2057fd79-65b0-42fb-82b0-954c7a9a4e9d tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:31.387440 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2057fd79-65b0-42fb-82b0-954c7a9a4e9d tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:31.387868 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2057fd79-65b0-42fb-82b0-954c7a9a4e9d tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:31.388594 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2057fd79-65b0-42fb-82b0-954c7a9a4e9d tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:31.389037 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2057fd79-65b0-42fb-82b0-954c7a9a4e9d tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:31.389458 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2057fd79-65b0-42fb-82b0-954c7a9a4e9d tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:31.505247 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-2057fd79-65b0-42fb-82b0-954c7a9a4e9d tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "POST /compute/v2.1/servers/5e7c9320-06e9-4efa-8b90-26c27f26d3f7/action" status: 202 len: 0 microversion: 2.1 time: 0.133467 Aug 27 03:26:31.505932 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2973/5984] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:26:31 2022] POST /compute/v2.1/servers/5e7c9320-06e9-4efa-8b90-26c27f26d3f7/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:26:31.514410 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-103d5fb7-9169-41b8-8bbe-e552f5c90ffa tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:31.515063 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-103d5fb7-9169-41b8-8bbe-e552f5c90ffa tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 5e7c9320-06e9-4efa-8b90-26c27f26d3f7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:31.518170 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=33 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:26:31.521985 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-103d5fb7-9169-41b8-8bbe-e552f5c90ffa tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:31.522481 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-103d5fb7-9169-41b8-8bbe-e552f5c90ffa tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:31.522917 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-103d5fb7-9169-41b8-8bbe-e552f5c90ffa tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:31.523635 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-103d5fb7-9169-41b8-8bbe-e552f5c90ffa tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:31.524099 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-103d5fb7-9169-41b8-8bbe-e552f5c90ffa tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:31.524619 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-103d5fb7-9169-41b8-8bbe-e552f5c90ffa tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:31.751866 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-103d5fb7-9169-41b8-8bbe-e552f5c90ffa tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:31.760554 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-103d5fb7-9169-41b8-8bbe-e552f5c90ffa tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/5e7c9320-06e9-4efa-8b90-26c27f26d3f7" status: 200 len: 1690 microversion: 2.1 time: 0.250034 Aug 27 03:26:31.761126 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3012/5985] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:26:31 2022] GET /compute/v2.1/servers/5e7c9320-06e9-4efa-8b90-26c27f26d3f7 => generated 1690 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:26:32.783202 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a7d5c217-41fc-4cd1-8299-c9dfdd015e7b tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:32.783887 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a7d5c217-41fc-4cd1-8299-c9dfdd015e7b tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 5e7c9320-06e9-4efa-8b90-26c27f26d3f7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:32.791328 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a7d5c217-41fc-4cd1-8299-c9dfdd015e7b tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:32.791867 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a7d5c217-41fc-4cd1-8299-c9dfdd015e7b tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:32.792342 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a7d5c217-41fc-4cd1-8299-c9dfdd015e7b tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:32.793153 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a7d5c217-41fc-4cd1-8299-c9dfdd015e7b tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:32.793611 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a7d5c217-41fc-4cd1-8299-c9dfdd015e7b tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:32.794034 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a7d5c217-41fc-4cd1-8299-c9dfdd015e7b tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:32.935216 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-a7d5c217-41fc-4cd1-8299-c9dfdd015e7b tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:32.943729 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a7d5c217-41fc-4cd1-8299-c9dfdd015e7b tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/5e7c9320-06e9-4efa-8b90-26c27f26d3f7" status: 200 len: 1690 microversion: 2.1 time: 0.165913 Aug 27 03:26:32.944643 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2974/5986] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:26:32 2022] GET /compute/v2.1/servers/5e7c9320-06e9-4efa-8b90-26c27f26d3f7 => generated 1690 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:26:33.965221 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8984d52a-2451-4266-a41a-d2d1ec7dd1cf tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:33.965915 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-8984d52a-2451-4266-a41a-d2d1ec7dd1cf tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 5e7c9320-06e9-4efa-8b90-26c27f26d3f7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:33.973096 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8984d52a-2451-4266-a41a-d2d1ec7dd1cf tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:33.973597 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8984d52a-2451-4266-a41a-d2d1ec7dd1cf tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:33.974026 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8984d52a-2451-4266-a41a-d2d1ec7dd1cf tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:33.974799 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8984d52a-2451-4266-a41a-d2d1ec7dd1cf tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:33.975261 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8984d52a-2451-4266-a41a-d2d1ec7dd1cf tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:33.975695 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8984d52a-2451-4266-a41a-d2d1ec7dd1cf tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:34.120480 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-8984d52a-2451-4266-a41a-d2d1ec7dd1cf tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:34.128531 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-8984d52a-2451-4266-a41a-d2d1ec7dd1cf tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/5e7c9320-06e9-4efa-8b90-26c27f26d3f7" status: 200 len: 1690 microversion: 2.1 time: 0.167387 Aug 27 03:26:34.129150 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3013/5987] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:26:33 2022] GET /compute/v2.1/servers/5e7c9320-06e9-4efa-8b90-26c27f26d3f7 => generated 1690 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:26:35.150831 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-79fbd894-f1a8-431d-b8fe-eefdf0ee2135 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:35.151521 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-79fbd894-f1a8-431d-b8fe-eefdf0ee2135 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 5e7c9320-06e9-4efa-8b90-26c27f26d3f7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:35.159081 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-79fbd894-f1a8-431d-b8fe-eefdf0ee2135 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:35.159789 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-79fbd894-f1a8-431d-b8fe-eefdf0ee2135 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:35.160202 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-79fbd894-f1a8-431d-b8fe-eefdf0ee2135 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:35.161000 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-79fbd894-f1a8-431d-b8fe-eefdf0ee2135 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:35.161448 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-79fbd894-f1a8-431d-b8fe-eefdf0ee2135 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:35.161869 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-79fbd894-f1a8-431d-b8fe-eefdf0ee2135 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:35.326904 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-79fbd894-f1a8-431d-b8fe-eefdf0ee2135 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:35.337568 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-79fbd894-f1a8-431d-b8fe-eefdf0ee2135 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/5e7c9320-06e9-4efa-8b90-26c27f26d3f7" status: 200 len: 1690 microversion: 2.1 time: 0.191152 Aug 27 03:26:35.338398 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2975/5988] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:26:35 2022] GET /compute/v2.1/servers/5e7c9320-06e9-4efa-8b90-26c27f26d3f7 => generated 1690 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:26:35.520366 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-da6afaf2-e16e-4223-a3ad-d79879e3ed32 req-08c84ee6-5658-44e0-adf2-31bb8d5cfa37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e7c9320-06e9-4efa-8b90-26c27f26d3f7", "tag": "32946112-b370-4fb0-9a69-4fb4c09568b9"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:26:35.533126 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-da6afaf2-e16e-4223-a3ad-d79879e3ed32 req-08c84ee6-5658-44e0-adf2-31bb8d5cfa37 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:35.533588 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-da6afaf2-e16e-4223-a3ad-d79879e3ed32 req-08c84ee6-5658-44e0-adf2-31bb8d5cfa37 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:35.534029 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-da6afaf2-e16e-4223-a3ad-d79879e3ed32 req-08c84ee6-5658-44e0-adf2-31bb8d5cfa37 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:35.546107 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-da6afaf2-e16e-4223-a3ad-d79879e3ed32 req-08c84ee6-5658-44e0-adf2-31bb8d5cfa37 service nova] Creating event network-changed:32946112-b370-4fb0-9a69-4fb4c09568b9 for instance 5e7c9320-06e9-4efa-8b90-26c27f26d3f7 on n-h1-852278-4 Aug 27 03:26:35.551954 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [req-da6afaf2-e16e-4223-a3ad-d79879e3ed32 req-08c84ee6-5658-44e0-adf2-31bb8d5cfa37 service nova] Instance 5e7c9320-06e9-4efa-8b90-26c27f26d3f7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-852278-4', 'n-h1-852278-4'} {{(pid=134051) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 03:26:35.563940 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-da6afaf2-e16e-4223-a3ad-d79879e3ed32 req-08c84ee6-5658-44e0-adf2-31bb8d5cfa37 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049503 Aug 27 03:26:35.564894 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3014/5989] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:26:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:26:36.362092 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-aabc2b74-0c61-4676-b823-18193813979d tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:36.362663 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-aabc2b74-0c61-4676-b823-18193813979d tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 5e7c9320-06e9-4efa-8b90-26c27f26d3f7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:36.373312 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-aabc2b74-0c61-4676-b823-18193813979d tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:36.373999 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-aabc2b74-0c61-4676-b823-18193813979d tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:36.374639 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-aabc2b74-0c61-4676-b823-18193813979d tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:36.375700 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-aabc2b74-0c61-4676-b823-18193813979d tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:36.376341 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-aabc2b74-0c61-4676-b823-18193813979d tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:36.376838 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-aabc2b74-0c61-4676-b823-18193813979d tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:36.521519 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-aabc2b74-0c61-4676-b823-18193813979d tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:36.533434 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-aabc2b74-0c61-4676-b823-18193813979d tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/5e7c9320-06e9-4efa-8b90-26c27f26d3f7" status: 200 len: 1690 microversion: 2.1 time: 0.177345 Aug 27 03:26:36.534128 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2976/5990] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:26:36 2022] GET /compute/v2.1/servers/5e7c9320-06e9-4efa-8b90-26c27f26d3f7 => generated 1690 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:26:37.560505 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-2a849e4f-1337-4818-8cde-0d236246ce39 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:37.561977 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-2a849e4f-1337-4818-8cde-0d236246ce39 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 5e7c9320-06e9-4efa-8b90-26c27f26d3f7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:37.569201 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2a849e4f-1337-4818-8cde-0d236246ce39 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:37.569991 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2a849e4f-1337-4818-8cde-0d236246ce39 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:37.570786 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2a849e4f-1337-4818-8cde-0d236246ce39 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:37.571696 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2a849e4f-1337-4818-8cde-0d236246ce39 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:37.572351 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2a849e4f-1337-4818-8cde-0d236246ce39 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:37.573116 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2a849e4f-1337-4818-8cde-0d236246ce39 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:37.718445 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-2a849e4f-1337-4818-8cde-0d236246ce39 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:37.727311 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-2a849e4f-1337-4818-8cde-0d236246ce39 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/5e7c9320-06e9-4efa-8b90-26c27f26d3f7" status: 200 len: 1690 microversion: 2.1 time: 0.174993 Aug 27 03:26:37.727913 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3015/5991] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:26:37 2022] GET /compute/v2.1/servers/5e7c9320-06e9-4efa-8b90-26c27f26d3f7 => generated 1690 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:26:38.751157 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-fdc4c72e-0760-4716-8193-fc22e4a86128 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:38.752121 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-fdc4c72e-0760-4716-8193-fc22e4a86128 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 5e7c9320-06e9-4efa-8b90-26c27f26d3f7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:38.760929 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fdc4c72e-0760-4716-8193-fc22e4a86128 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:38.761493 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fdc4c72e-0760-4716-8193-fc22e4a86128 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:38.761991 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fdc4c72e-0760-4716-8193-fc22e4a86128 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:38.762700 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fdc4c72e-0760-4716-8193-fc22e4a86128 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:38.763195 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fdc4c72e-0760-4716-8193-fc22e4a86128 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:38.763640 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fdc4c72e-0760-4716-8193-fc22e4a86128 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:38.900974 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-fdc4c72e-0760-4716-8193-fc22e4a86128 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:38.912731 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-fdc4c72e-0760-4716-8193-fc22e4a86128 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/5e7c9320-06e9-4efa-8b90-26c27f26d3f7" status: 200 len: 1683 microversion: 2.1 time: 0.167617 Aug 27 03:26:38.913530 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2977/5992] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:26:38 2022] GET /compute/v2.1/servers/5e7c9320-06e9-4efa-8b90-26c27f26d3f7 => generated 1683 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:26:40.797063 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-daf695e7-a608-49f5-926c-ef8fe9760e4a req-98455c4b-240b-4b00-85c9-e49cd0dbe3fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e7c9320-06e9-4efa-8b90-26c27f26d3f7", "name": "network-vif-plugged", "status": "completed", "tag": "32946112-b370-4fb0-9a69-4fb4c09568b9"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:26:40.811107 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-daf695e7-a608-49f5-926c-ef8fe9760e4a req-98455c4b-240b-4b00-85c9-e49cd0dbe3fa service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:40.811606 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-daf695e7-a608-49f5-926c-ef8fe9760e4a req-98455c4b-240b-4b00-85c9-e49cd0dbe3fa service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:40.812161 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-daf695e7-a608-49f5-926c-ef8fe9760e4a req-98455c4b-240b-4b00-85c9-e49cd0dbe3fa service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:40.824446 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-daf695e7-a608-49f5-926c-ef8fe9760e4a req-98455c4b-240b-4b00-85c9-e49cd0dbe3fa service nova] Creating event network-vif-plugged:32946112-b370-4fb0-9a69-4fb4c09568b9 for instance 5e7c9320-06e9-4efa-8b90-26c27f26d3f7 on n-h1-852278-4 Aug 27 03:26:40.829865 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-daf695e7-a608-49f5-926c-ef8fe9760e4a req-98455c4b-240b-4b00-85c9-e49cd0dbe3fa service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106830 Aug 27 03:26:40.830512 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3016/5993] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:26:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:27:03.147080 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-60ef747a-f211-4cf3-8760-ec299f1a89c0 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:27:03.149546 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-60ef747a-f211-4cf3-8760-ec299f1a89c0 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 5e7c9320-06e9-4efa-8b90-26c27f26d3f7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:03.152658 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=27 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:27:03.153359 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:27:03.161006 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-60ef747a-f211-4cf3-8760-ec299f1a89c0 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:03.161602 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-60ef747a-f211-4cf3-8760-ec299f1a89c0 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:03.162095 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-60ef747a-f211-4cf3-8760-ec299f1a89c0 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:03.162735 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-60ef747a-f211-4cf3-8760-ec299f1a89c0 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:03.163186 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-60ef747a-f211-4cf3-8760-ec299f1a89c0 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:03.163603 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-60ef747a-f211-4cf3-8760-ec299f1a89c0 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:03.240698 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-60ef747a-f211-4cf3-8760-ec299f1a89c0 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "POST /compute/v2.1/servers/5e7c9320-06e9-4efa-8b90-26c27f26d3f7/action" status: 200 len: 63158 microversion: 2.1 time: 0.097358 Aug 27 03:27:03.241595 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2978/5994] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:27:03 2022] POST /compute/v2.1/servers/5e7c9320-06e9-4efa-8b90-26c27f26d3f7/action => generated 63158 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:27:09.790123 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=8 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:27:09.790913 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=57 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:27:09.794893 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-5517590e-927f-43bd-9bc7-7ec7551d8095 tempest-TestNetworkAdvancedServerOps-1663634391 tempest-TestNetworkAdvancedServerOps-1663634391-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:09.795604 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-5517590e-927f-43bd-9bc7-7ec7551d8095 tempest-TestNetworkAdvancedServerOps-1663634391 tempest-TestNetworkAdvancedServerOps-1663634391-project-admin] [instance: 5e7c9320-06e9-4efa-8b90-26c27f26d3f7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:09.802988 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5517590e-927f-43bd-9bc7-7ec7551d8095 tempest-TestNetworkAdvancedServerOps-1663634391 tempest-TestNetworkAdvancedServerOps-1663634391-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:09.803511 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5517590e-927f-43bd-9bc7-7ec7551d8095 tempest-TestNetworkAdvancedServerOps-1663634391 tempest-TestNetworkAdvancedServerOps-1663634391-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:09.803933 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5517590e-927f-43bd-9bc7-7ec7551d8095 tempest-TestNetworkAdvancedServerOps-1663634391 tempest-TestNetworkAdvancedServerOps-1663634391-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:09.804675 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5517590e-927f-43bd-9bc7-7ec7551d8095 tempest-TestNetworkAdvancedServerOps-1663634391 tempest-TestNetworkAdvancedServerOps-1663634391-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:09.805136 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5517590e-927f-43bd-9bc7-7ec7551d8095 tempest-TestNetworkAdvancedServerOps-1663634391 tempest-TestNetworkAdvancedServerOps-1663634391-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:09.805569 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5517590e-927f-43bd-9bc7-7ec7551d8095 tempest-TestNetworkAdvancedServerOps-1663634391 tempest-TestNetworkAdvancedServerOps-1663634391-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:09.944601 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-5517590e-927f-43bd-9bc7-7ec7551d8095 tempest-TestNetworkAdvancedServerOps-1663634391 tempest-TestNetworkAdvancedServerOps-1663634391-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/5e7c9320-06e9-4efa-8b90-26c27f26d3f7" status: 200 len: 1834 microversion: 2.1 time: 0.158966 Aug 27 03:27:09.945611 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3017/5995] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:09 2022] GET /compute/v2.1/servers/5e7c9320-06e9-4efa-8b90-26c27f26d3f7 => generated 1834 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:10.815136 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ee24d7fd-164d-44bf-8515-f37086c2e4ff tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:10.815718 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-ee24d7fd-164d-44bf-8515-f37086c2e4ff tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 5e7c9320-06e9-4efa-8b90-26c27f26d3f7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:10.816537 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-e1872ea7-d160-45bd-aac1-724f4facd3d8 req-8ff60fd7-5095-46f1-b4eb-7bfc98ec2121 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e7c9320-06e9-4efa-8b90-26c27f26d3f7", "tag": "32946112-b370-4fb0-9a69-4fb4c09568b9"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:27:10.823280 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ee24d7fd-164d-44bf-8515-f37086c2e4ff tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:10.823765 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ee24d7fd-164d-44bf-8515-f37086c2e4ff tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:10.824199 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ee24d7fd-164d-44bf-8515-f37086c2e4ff tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:10.824956 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ee24d7fd-164d-44bf-8515-f37086c2e4ff tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:10.825404 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ee24d7fd-164d-44bf-8515-f37086c2e4ff tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:10.825826 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ee24d7fd-164d-44bf-8515-f37086c2e4ff tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:10.827822 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-e1872ea7-d160-45bd-aac1-724f4facd3d8 req-8ff60fd7-5095-46f1-b4eb-7bfc98ec2121 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:10.828481 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-e1872ea7-d160-45bd-aac1-724f4facd3d8 req-8ff60fd7-5095-46f1-b4eb-7bfc98ec2121 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:10.829014 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-e1872ea7-d160-45bd-aac1-724f4facd3d8 req-8ff60fd7-5095-46f1-b4eb-7bfc98ec2121 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:10.842023 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-e1872ea7-d160-45bd-aac1-724f4facd3d8 req-8ff60fd7-5095-46f1-b4eb-7bfc98ec2121 service nova] Creating event network-changed:32946112-b370-4fb0-9a69-4fb4c09568b9 for instance 5e7c9320-06e9-4efa-8b90-26c27f26d3f7 on n-h1-852278-4 Aug 27 03:27:10.847797 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-e1872ea7-d160-45bd-aac1-724f4facd3d8 req-8ff60fd7-5095-46f1-b4eb-7bfc98ec2121 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035113 Aug 27 03:27:10.852518 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3018/5996] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:27:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:27:10.855227 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-ee24d7fd-164d-44bf-8515-f37086c2e4ff tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 5e7c9320-06e9-4efa-8b90-26c27f26d3f7] Going to try to terminate instance {{(pid=134052) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:27:10.961219 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ee24d7fd-164d-44bf-8515-f37086c2e4ff tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "DELETE /compute/v2.1/servers/5e7c9320-06e9-4efa-8b90-26c27f26d3f7" status: 204 len: 0 microversion: 2.1 time: 0.150080 Aug 27 03:27:10.961969 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2979/5997] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 03:27:10 2022] DELETE /compute/v2.1/servers/5e7c9320-06e9-4efa-8b90-26c27f26d3f7 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:27:10.971934 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-fa9f0e2a-5d90-4679-8adc-1c7c63cbc374 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:10.973377 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-fa9f0e2a-5d90-4679-8adc-1c7c63cbc374 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 5e7c9320-06e9-4efa-8b90-26c27f26d3f7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:10.982637 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fa9f0e2a-5d90-4679-8adc-1c7c63cbc374 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:10.983155 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fa9f0e2a-5d90-4679-8adc-1c7c63cbc374 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:10.983607 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fa9f0e2a-5d90-4679-8adc-1c7c63cbc374 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:10.984633 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fa9f0e2a-5d90-4679-8adc-1c7c63cbc374 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:10.985103 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fa9f0e2a-5d90-4679-8adc-1c7c63cbc374 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:10.985711 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fa9f0e2a-5d90-4679-8adc-1c7c63cbc374 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:11.127865 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-fa9f0e2a-5d90-4679-8adc-1c7c63cbc374 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:11.135892 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-fa9f0e2a-5d90-4679-8adc-1c7c63cbc374 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/5e7c9320-06e9-4efa-8b90-26c27f26d3f7" status: 200 len: 1689 microversion: 2.1 time: 0.168694 Aug 27 03:27:11.136503 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3019/5998] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:10 2022] GET /compute/v2.1/servers/5e7c9320-06e9-4efa-8b90-26c27f26d3f7 => generated 1689 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:27:12.159936 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b1d10ee8-a84c-40d4-9c73-084a065dcdb6 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:12.160751 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b1d10ee8-a84c-40d4-9c73-084a065dcdb6 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 5e7c9320-06e9-4efa-8b90-26c27f26d3f7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:12.169737 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b1d10ee8-a84c-40d4-9c73-084a065dcdb6 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:12.170231 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b1d10ee8-a84c-40d4-9c73-084a065dcdb6 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:12.170670 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b1d10ee8-a84c-40d4-9c73-084a065dcdb6 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:12.171391 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b1d10ee8-a84c-40d4-9c73-084a065dcdb6 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:12.171837 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b1d10ee8-a84c-40d4-9c73-084a065dcdb6 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:12.172264 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b1d10ee8-a84c-40d4-9c73-084a065dcdb6 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:12.315379 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b1d10ee8-a84c-40d4-9c73-084a065dcdb6 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:12.328732 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b1d10ee8-a84c-40d4-9c73-084a065dcdb6 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/5e7c9320-06e9-4efa-8b90-26c27f26d3f7" status: 200 len: 1689 microversion: 2.1 time: 0.174133 Aug 27 03:27:12.329963 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2980/5999] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:12 2022] GET /compute/v2.1/servers/5e7c9320-06e9-4efa-8b90-26c27f26d3f7 => generated 1689 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:12.865013 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-c73c9255-74b7-4967-8bbd-1d147ed74d62 req-3b513358-2a69-4e80-8451-f89a32ac102e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e7c9320-06e9-4efa-8b90-26c27f26d3f7", "name": "network-vif-deleted", "tag": "32946112-b370-4fb0-9a69-4fb4c09568b9"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:27:12.875769 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-c73c9255-74b7-4967-8bbd-1d147ed74d62 req-3b513358-2a69-4e80-8451-f89a32ac102e service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:12.876817 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-c73c9255-74b7-4967-8bbd-1d147ed74d62 req-3b513358-2a69-4e80-8451-f89a32ac102e service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:12.877369 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-c73c9255-74b7-4967-8bbd-1d147ed74d62 req-3b513358-2a69-4e80-8451-f89a32ac102e service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:12.889905 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-c73c9255-74b7-4967-8bbd-1d147ed74d62 req-3b513358-2a69-4e80-8451-f89a32ac102e service nova] Creating event network-vif-deleted:32946112-b370-4fb0-9a69-4fb4c09568b9 for instance 5e7c9320-06e9-4efa-8b90-26c27f26d3f7 on n-h1-852278-4 Aug 27 03:27:12.895126 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-c73c9255-74b7-4967-8bbd-1d147ed74d62 req-3b513358-2a69-4e80-8451-f89a32ac102e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035959 Aug 27 03:27:12.895785 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3020/6000] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:27:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:27:13.350937 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5831febc-e563-42f1-bdb3-035bfda11129 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:13.351667 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-5831febc-e563-42f1-bdb3-035bfda11129 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 5e7c9320-06e9-4efa-8b90-26c27f26d3f7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:13.361457 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5831febc-e563-42f1-bdb3-035bfda11129 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:13.362197 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5831febc-e563-42f1-bdb3-035bfda11129 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:13.362821 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5831febc-e563-42f1-bdb3-035bfda11129 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:13.363897 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5831febc-e563-42f1-bdb3-035bfda11129 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:13.364727 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5831febc-e563-42f1-bdb3-035bfda11129 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:13.365503 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5831febc-e563-42f1-bdb3-035bfda11129 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:13.416267 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5831febc-e563-42f1-bdb3-035bfda11129 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:13.416695 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5831febc-e563-42f1-bdb3-035bfda11129 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:13.417119 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5831febc-e563-42f1-bdb3-035bfda11129 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:13.417716 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.instance [None req-5831febc-e563-42f1-bdb3-035bfda11129 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lazy-loading 'fault' on Instance uuid 5e7c9320-06e9-4efa-8b90-26c27f26d3f7 {{(pid=134052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:27:13.466325 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-5831febc-e563-42f1-bdb3-035bfda11129 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:13.477482 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-5831febc-e563-42f1-bdb3-035bfda11129 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/5e7c9320-06e9-4efa-8b90-26c27f26d3f7" status: 200 len: 1356 microversion: 2.1 time: 0.130317 Aug 27 03:27:13.478096 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2981/6001] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:13 2022] GET /compute/v2.1/servers/5e7c9320-06e9-4efa-8b90-26c27f26d3f7 => generated 1356 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:14.504730 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8591f54e-6188-46fc-acd2-8f4e7969f3e7 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:14.505793 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-8591f54e-6188-46fc-acd2-8f4e7969f3e7 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 5e7c9320-06e9-4efa-8b90-26c27f26d3f7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:14.516650 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8591f54e-6188-46fc-acd2-8f4e7969f3e7 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:14.517448 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8591f54e-6188-46fc-acd2-8f4e7969f3e7 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:14.518248 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8591f54e-6188-46fc-acd2-8f4e7969f3e7 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:14.519430 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8591f54e-6188-46fc-acd2-8f4e7969f3e7 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:14.520216 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8591f54e-6188-46fc-acd2-8f4e7969f3e7 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:14.521002 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8591f54e-6188-46fc-acd2-8f4e7969f3e7 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:14.536834 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-8591f54e-6188-46fc-acd2-8f4e7969f3e7 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] HTTP exception thrown: Instance 5e7c9320-06e9-4efa-8b90-26c27f26d3f7 could not be found. Aug 27 03:27:14.538599 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8591f54e-6188-46fc-acd2-8f4e7969f3e7 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Request method failure captured: Aug 27 03:27:14.538599 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/5e7c9320-06e9-4efa-8b90-26c27f26d3f7 HTTP/1.1 Aug 27 03:27:14.538599 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 03:27:14.538599 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 03:27:14.538599 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 03:27:14.538599 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 03:27:14.538599 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 03:27:14.538599 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 03:27:14.538599 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 03:27:14.538599 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 03:27:14.538599 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCY4rjgLXIvNBrh9kN4jnznC50AQ6KjWReTgkO1jga9yr7NY-gC8VrzURbe59WZrBpXWePgbVKRMS_e_UPOGvs6kq6xALqK2obNolZqn3ouGxdOKXhnIHVg8gyE_jgUU-tIsjIbg-aNo9qlCKhh6olDObIY67Z71HecsvikaMrjLi4nk Aug 27 03:27:14.538599 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 03:27:14.538599 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 03:27:14.538599 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 03:27:14.538599 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 03:27:14.538599 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 03:27:14.538599 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 03:27:14.538599 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 659b0cee2ff841049f41c7ce12609fc8 Aug 27 03:27:14.538599 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1769414468 Aug 27 03:27:14.538599 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 03:27:14.538599 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 03:27:14.538599 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/659b0cee2ff841049f41c7ce12609fc8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_659b0cee2ff841049f41c7ce12609fc8", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/659b0cee2ff841049f41c7ce12609fc8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/659b0cee2ff841049f41c7ce12609fc8"}]}] Aug 27 03:27:14.538599 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1769414468 Aug 27 03:27:14.538599 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 659b0cee2ff841049f41c7ce12609fc8 Aug 27 03:27:14.538599 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1769414468 Aug 27 03:27:14.538599 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-TestNetworkAdvancedServerOps-1769414468-project Aug 27 03:27:14.538599 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 03:27:14.538599 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 03:27:14.538599 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 36e9eab0eb7c421fa50b90e270847365 Aug 27 03:27:14.538599 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1769414468-project Aug 27 03:27:14.538599 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 03:27:14.538599 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance 5e7c9320-06e9-4efa-8b90-26c27f26d3f7 could not be found. Aug 27 03:27:14.538599 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '5e7c9320-06e9-4efa-8b90-26c27f26d3f7'} Aug 27 03:27:14.538599 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:27:14.538599 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:27:14.538599 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:27:14.538599 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:27:14.538599 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:27:14.538599 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:27:14.538599 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:27:14.538599 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:27:14.538599 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:27:14.538599 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:27:14.538599 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e7c9320-06e9-4efa-8b90-26c27f26d3f7 could not be found. Aug 27 03:27:14.538599 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:27:14.538599 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:27:14.538599 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:27:14.538599 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:27:14.538599 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:27:14.538599 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:27:14.538599 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:27:14.538599 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:27:14.538599 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:27:14.538599 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:27:14.538599 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:27:14.538599 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:27:14.538599 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:27:14.538599 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:27:14.538599 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:27:14.538599 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:27:14.538599 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e7c9320-06e9-4efa-8b90-26c27f26d3f7 could not be found. Aug 27 03:27:14.538599 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:27:14.538599 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:27:14.543542 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:27:14.543542 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:27:14.543542 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:27:14.543542 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:27:14.543542 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:27:14.543542 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:27:14.543542 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e7c9320-06e9-4efa-8b90-26c27f26d3f7 could not be found. Aug 27 03:27:14.543542 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:27:14.543542 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8591f54e-6188-46fc-acd2-8f4e7969f3e7 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Returning 404 to user: Instance 5e7c9320-06e9-4efa-8b90-26c27f26d3f7 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:27:14.543542 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-8591f54e-6188-46fc-acd2-8f4e7969f3e7 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/5e7c9320-06e9-4efa-8b90-26c27f26d3f7" status: 404 len: 111 microversion: 2.1 time: 0.044165 Aug 27 03:27:14.543542 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3021/6002] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:14 2022] GET /compute/v2.1/servers/5e7c9320-06e9-4efa-8b90-26c27f26d3f7 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:27:18.003246 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-1a6ef8b9-9387-4389-b876-454ead445150 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '.version_select at 0x7f5ee26b10d0>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:18.024841 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-1a6ef8b9-9387-4389-b876-454ead445150 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-611043332" status: 202 len: 0 microversion: 2.1 time: 0.026037 Aug 27 03:27:18.025611 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2982/6003] 10.222.0.70 () {58 vars in 1281 bytes} [Sat Aug 27 03:27:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-611043332 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:27:18.062915 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-45be9c9b-764d-4641-bbec-9ce34dfa8e69 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Action: 'create', calling method: .version_select at 0x7f5ee7269d30>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1519017219", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP3zkHeFE3tHsj5gOGCsrZ/167PpV/iU0rBp50hJNsykvWnfFY6y25sHeSaoWaEFK0IcuM4AlDlVTjJIeTU33DUKoTVd4nOTsyrYThWU750FAOBWWpIwY54p4TpDDzabDw=="}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:27:18.083462 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-45be9c9b-764d-4641-bbec-9ce34dfa8e69 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Getting quotas for project 659b0cee2ff841049f41c7ce12609fc8. Resources: {'key_pairs'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:27:18.088729 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-45be9c9b-764d-4641-bbec-9ce34dfa8e69 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Getting quotas for user 36e9eab0eb7c421fa50b90e270847365 and project 659b0cee2ff841049f41c7ce12609fc8. Resources: {'key_pairs'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:27:18.116517 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-45be9c9b-764d-4641-bbec-9ce34dfa8e69 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.057730 Aug 27 03:27:18.117113 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3022/6004] 10.222.0.70 () {60 vars in 1159 bytes} [Sat Aug 27 03:27:18 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:27:24.215162 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d826dd97-900d-41bb-b23a-858c64f26160 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1012366521", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "networks": [{"uuid": "0a570d61-e745-40a7-8723-1a2ea4c74a98"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1519017219", "security_groups": [{"name": "tempest-secgroup-smoke-1794298550"}]}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:27:24.226280 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:27:24.341876 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.network.neutron [None req-d826dd97-900d-41bb-b23a-858c64f26160 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] validate_networks() for [('0a570d61-e745-40a7-8723-1a2ea4c74a98', None, None, None, None, None)] {{(pid=134052) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:27:24.738003 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-d826dd97-900d-41bb-b23a-858c64f26160 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Flavor limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:27:24.738502 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-d826dd97-900d-41bb-b23a-858c64f26160 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Image limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:27:24.739047 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-d826dd97-900d-41bb-b23a-858c64f26160 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Flavor pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:27:24.739531 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-d826dd97-900d-41bb-b23a-858c64f26160 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Image pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:27:24.740018 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-d826dd97-900d-41bb-b23a-858c64f26160 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:27:24.749663 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d826dd97-900d-41bb-b23a-858c64f26160 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:24.750182 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d826dd97-900d-41bb-b23a-858c64f26160 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:24.750600 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d826dd97-900d-41bb-b23a-858c64f26160 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:24.751365 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d826dd97-900d-41bb-b23a-858c64f26160 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:24.751821 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d826dd97-900d-41bb-b23a-858c64f26160 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:24.752246 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d826dd97-900d-41bb-b23a-858c64f26160 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:24.769436 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-d826dd97-900d-41bb-b23a-858c64f26160 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Getting quotas for project 659b0cee2ff841049f41c7ce12609fc8. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:27:24.774836 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-d826dd97-900d-41bb-b23a-858c64f26160 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Getting quotas for user 36e9eab0eb7c421fa50b90e270847365 and project 659b0cee2ff841049f41c7ce12609fc8. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:27:24.787293 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d826dd97-900d-41bb-b23a-858c64f26160 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Going to run 1 instances... {{(pid=134052) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:27:24.789773 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d826dd97-900d-41bb-b23a-858c64f26160 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 34b22982-c465-4e12-911e-e89242907b8e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134052) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:27:24.840295 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d826dd97-900d-41bb-b23a-858c64f26160 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.629331 Aug 27 03:27:24.844548 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2983/6005] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 03:27:24 2022] POST /compute/v2.1/servers => generated 406 bytes in 631 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:27:24.852826 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-eab7de18-6f57-47dc-b05b-27a50d4e9c7a tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:24.853640 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-eab7de18-6f57-47dc-b05b-27a50d4e9c7a tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 34b22982-c465-4e12-911e-e89242907b8e] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:24.860990 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=18 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:27:24.931257 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-eab7de18-6f57-47dc-b05b-27a50d4e9c7a tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:24.939101 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-eab7de18-6f57-47dc-b05b-27a50d4e9c7a tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/34b22982-c465-4e12-911e-e89242907b8e" status: 200 len: 1267 microversion: 2.1 time: 0.090582 Aug 27 03:27:24.939937 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3023/6006] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:24 2022] GET /compute/v2.1/servers/34b22982-c465-4e12-911e-e89242907b8e => generated 1267 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:25.963516 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-293af09d-0c50-4300-a8c0-fcddbab5ebd4 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:25.967368 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-293af09d-0c50-4300-a8c0-fcddbab5ebd4 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 34b22982-c465-4e12-911e-e89242907b8e] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:25.975662 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-293af09d-0c50-4300-a8c0-fcddbab5ebd4 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:25.976147 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-293af09d-0c50-4300-a8c0-fcddbab5ebd4 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:25.976629 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-293af09d-0c50-4300-a8c0-fcddbab5ebd4 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:25.977378 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-293af09d-0c50-4300-a8c0-fcddbab5ebd4 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:25.977854 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-293af09d-0c50-4300-a8c0-fcddbab5ebd4 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:25.978237 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-293af09d-0c50-4300-a8c0-fcddbab5ebd4 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:26.043969 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-293af09d-0c50-4300-a8c0-fcddbab5ebd4 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:26.052262 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-293af09d-0c50-4300-a8c0-fcddbab5ebd4 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/34b22982-c465-4e12-911e-e89242907b8e" status: 200 len: 1327 microversion: 2.1 time: 0.094100 Aug 27 03:27:26.053455 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2984/6007] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:25 2022] GET /compute/v2.1/servers/34b22982-c465-4e12-911e-e89242907b8e => generated 1327 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:27.074700 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-382c9dbd-2666-4e42-a6c5-960f5090f91a tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:27.075338 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-382c9dbd-2666-4e42-a6c5-960f5090f91a tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 34b22982-c465-4e12-911e-e89242907b8e] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:27.082430 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-382c9dbd-2666-4e42-a6c5-960f5090f91a tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:27.082940 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-382c9dbd-2666-4e42-a6c5-960f5090f91a tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:27.083394 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-382c9dbd-2666-4e42-a6c5-960f5090f91a tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:27.084155 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-382c9dbd-2666-4e42-a6c5-960f5090f91a tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:27.084644 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-382c9dbd-2666-4e42-a6c5-960f5090f91a tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:27.085085 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-382c9dbd-2666-4e42-a6c5-960f5090f91a tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:27.341780 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-382c9dbd-2666-4e42-a6c5-960f5090f91a tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:27.350134 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-382c9dbd-2666-4e42-a6c5-960f5090f91a tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/34b22982-c465-4e12-911e-e89242907b8e" status: 200 len: 1393 microversion: 2.1 time: 0.279512 Aug 27 03:27:27.351287 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3024/6008] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:27 2022] GET /compute/v2.1/servers/34b22982-c465-4e12-911e-e89242907b8e => generated 1393 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:27.669849 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-4246df08-59f1-4e19-8f3c-200d2253164e req-9518ec72-68b6-4ada-ad45-899d61c7ef31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34b22982-c465-4e12-911e-e89242907b8e", "tag": "86d28938-69c1-4403-b70e-6fd97ab0daf8"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:27:27.681082 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-4246df08-59f1-4e19-8f3c-200d2253164e req-9518ec72-68b6-4ada-ad45-899d61c7ef31 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:27.681550 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-4246df08-59f1-4e19-8f3c-200d2253164e req-9518ec72-68b6-4ada-ad45-899d61c7ef31 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:27.681972 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-4246df08-59f1-4e19-8f3c-200d2253164e req-9518ec72-68b6-4ada-ad45-899d61c7ef31 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:27.693392 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-4246df08-59f1-4e19-8f3c-200d2253164e req-9518ec72-68b6-4ada-ad45-899d61c7ef31 service nova] Creating event network-changed:86d28938-69c1-4403-b70e-6fd97ab0daf8 for instance 34b22982-c465-4e12-911e-e89242907b8e on n-h1-852278-4 Aug 27 03:27:27.699272 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-4246df08-59f1-4e19-8f3c-200d2253164e req-9518ec72-68b6-4ada-ad45-899d61c7ef31 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033253 Aug 27 03:27:27.699900 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2985/6009] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:27:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:27:28.376074 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4743bb04-16be-4433-ada0-d34867fe5e39 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:28.377147 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-4743bb04-16be-4433-ada0-d34867fe5e39 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 34b22982-c465-4e12-911e-e89242907b8e] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:28.386987 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4743bb04-16be-4433-ada0-d34867fe5e39 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:28.387526 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4743bb04-16be-4433-ada0-d34867fe5e39 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:28.387988 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4743bb04-16be-4433-ada0-d34867fe5e39 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:28.388820 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4743bb04-16be-4433-ada0-d34867fe5e39 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:28.389288 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4743bb04-16be-4433-ada0-d34867fe5e39 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:28.389736 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4743bb04-16be-4433-ada0-d34867fe5e39 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:28.525379 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-4743bb04-16be-4433-ada0-d34867fe5e39 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:28.536852 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-4743bb04-16be-4433-ada0-d34867fe5e39 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/34b22982-c465-4e12-911e-e89242907b8e" status: 200 len: 1393 microversion: 2.1 time: 0.167196 Aug 27 03:27:28.537671 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3025/6010] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:28 2022] GET /compute/v2.1/servers/34b22982-c465-4e12-911e-e89242907b8e => generated 1393 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:29.561236 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c33b33ee-e698-49f0-81ac-336a475265ac tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:29.561948 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-c33b33ee-e698-49f0-81ac-336a475265ac tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 34b22982-c465-4e12-911e-e89242907b8e] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:29.568655 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c33b33ee-e698-49f0-81ac-336a475265ac tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:29.569136 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c33b33ee-e698-49f0-81ac-336a475265ac tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:29.569576 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c33b33ee-e698-49f0-81ac-336a475265ac tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:29.570270 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c33b33ee-e698-49f0-81ac-336a475265ac tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:29.570746 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c33b33ee-e698-49f0-81ac-336a475265ac tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:29.571173 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c33b33ee-e698-49f0-81ac-336a475265ac tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:29.728911 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-c33b33ee-e698-49f0-81ac-336a475265ac tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:29.739204 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c33b33ee-e698-49f0-81ac-336a475265ac tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/34b22982-c465-4e12-911e-e89242907b8e" status: 200 len: 1393 microversion: 2.1 time: 0.183184 Aug 27 03:27:29.740076 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2986/6011] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:29 2022] GET /compute/v2.1/servers/34b22982-c465-4e12-911e-e89242907b8e => generated 1393 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:30.769207 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-14ddf7a1-859f-4b7c-90d3-6440001498e5 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:30.769997 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-14ddf7a1-859f-4b7c-90d3-6440001498e5 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 34b22982-c465-4e12-911e-e89242907b8e] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:30.779839 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-14ddf7a1-859f-4b7c-90d3-6440001498e5 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:30.780516 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-14ddf7a1-859f-4b7c-90d3-6440001498e5 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:30.781083 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-14ddf7a1-859f-4b7c-90d3-6440001498e5 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:30.781975 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-14ddf7a1-859f-4b7c-90d3-6440001498e5 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:30.782556 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-14ddf7a1-859f-4b7c-90d3-6440001498e5 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:30.783110 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-14ddf7a1-859f-4b7c-90d3-6440001498e5 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:30.930906 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-14ddf7a1-859f-4b7c-90d3-6440001498e5 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:30.938892 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-14ddf7a1-859f-4b7c-90d3-6440001498e5 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/34b22982-c465-4e12-911e-e89242907b8e" status: 200 len: 1393 microversion: 2.1 time: 0.174587 Aug 27 03:27:30.939588 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3026/6012] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:30 2022] GET /compute/v2.1/servers/34b22982-c465-4e12-911e-e89242907b8e => generated 1393 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:31.959789 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3f934ba2-20f1-416e-a1c9-71f94217d7ae tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:31.960433 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-3f934ba2-20f1-416e-a1c9-71f94217d7ae tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 34b22982-c465-4e12-911e-e89242907b8e] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:31.967827 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3f934ba2-20f1-416e-a1c9-71f94217d7ae tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:31.968336 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3f934ba2-20f1-416e-a1c9-71f94217d7ae tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:31.968794 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3f934ba2-20f1-416e-a1c9-71f94217d7ae tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:31.969495 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3f934ba2-20f1-416e-a1c9-71f94217d7ae tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:31.969947 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3f934ba2-20f1-416e-a1c9-71f94217d7ae tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:31.970381 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3f934ba2-20f1-416e-a1c9-71f94217d7ae tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:32.113802 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-3f934ba2-20f1-416e-a1c9-71f94217d7ae tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:32.121763 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-3f934ba2-20f1-416e-a1c9-71f94217d7ae tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/34b22982-c465-4e12-911e-e89242907b8e" status: 200 len: 1393 microversion: 2.1 time: 0.166016 Aug 27 03:27:32.122387 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2987/6013] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:31 2022] GET /compute/v2.1/servers/34b22982-c465-4e12-911e-e89242907b8e => generated 1393 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:32.997050 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-f7175860-e17a-416e-b41b-3b4d7d0d842c req-e2e0c055-87ef-4b98-994b-451249ab0871 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34b22982-c465-4e12-911e-e89242907b8e", "name": "network-vif-plugged", "status": "completed", "tag": "86d28938-69c1-4403-b70e-6fd97ab0daf8"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:27:33.008243 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-f7175860-e17a-416e-b41b-3b4d7d0d842c req-e2e0c055-87ef-4b98-994b-451249ab0871 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:33.009752 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-f7175860-e17a-416e-b41b-3b4d7d0d842c req-e2e0c055-87ef-4b98-994b-451249ab0871 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:33.010215 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-f7175860-e17a-416e-b41b-3b4d7d0d842c req-e2e0c055-87ef-4b98-994b-451249ab0871 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:33.022024 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-f7175860-e17a-416e-b41b-3b4d7d0d842c req-e2e0c055-87ef-4b98-994b-451249ab0871 service nova] Creating event network-vif-plugged:86d28938-69c1-4403-b70e-6fd97ab0daf8 for instance 34b22982-c465-4e12-911e-e89242907b8e on n-h1-852278-4 Aug 27 03:27:33.027166 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-f7175860-e17a-416e-b41b-3b4d7d0d842c req-e2e0c055-87ef-4b98-994b-451249ab0871 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034480 Aug 27 03:27:33.028143 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3027/6014] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:27:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:27:33.142938 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-40e77292-bd40-41fe-b37d-fbffff18855a tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:33.143509 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-40e77292-bd40-41fe-b37d-fbffff18855a tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 34b22982-c465-4e12-911e-e89242907b8e] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:33.151455 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-40e77292-bd40-41fe-b37d-fbffff18855a tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:33.151942 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-40e77292-bd40-41fe-b37d-fbffff18855a tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:33.152415 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-40e77292-bd40-41fe-b37d-fbffff18855a tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:33.153116 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-40e77292-bd40-41fe-b37d-fbffff18855a tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:33.153548 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-40e77292-bd40-41fe-b37d-fbffff18855a tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:33.153961 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-40e77292-bd40-41fe-b37d-fbffff18855a tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:33.321035 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-40e77292-bd40-41fe-b37d-fbffff18855a tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:33.328952 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-40e77292-bd40-41fe-b37d-fbffff18855a tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/34b22982-c465-4e12-911e-e89242907b8e" status: 200 len: 1393 microversion: 2.1 time: 0.190069 Aug 27 03:27:33.329522 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2988/6015] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:33 2022] GET /compute/v2.1/servers/34b22982-c465-4e12-911e-e89242907b8e => generated 1393 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:34.353803 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4820ec78-6257-4111-95e8-e621258bea8d tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:34.354666 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-4820ec78-6257-4111-95e8-e621258bea8d tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 34b22982-c465-4e12-911e-e89242907b8e] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:34.362413 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4820ec78-6257-4111-95e8-e621258bea8d tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:34.362915 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4820ec78-6257-4111-95e8-e621258bea8d tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:34.363356 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4820ec78-6257-4111-95e8-e621258bea8d tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:34.364091 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4820ec78-6257-4111-95e8-e621258bea8d tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:34.364655 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4820ec78-6257-4111-95e8-e621258bea8d tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:34.365044 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4820ec78-6257-4111-95e8-e621258bea8d tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:34.502633 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-4820ec78-6257-4111-95e8-e621258bea8d tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:34.510813 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-4820ec78-6257-4111-95e8-e621258bea8d tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/34b22982-c465-4e12-911e-e89242907b8e" status: 200 len: 1565 microversion: 2.1 time: 0.162376 Aug 27 03:27:34.511643 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3028/6016] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:34 2022] GET /compute/v2.1/servers/34b22982-c465-4e12-911e-e89242907b8e => generated 1565 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:34.531907 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-2ec77f2c-673e-4e25-bc98-7e949bbbe067 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:34.532552 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-2ec77f2c-673e-4e25-bc98-7e949bbbe067 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 34b22982-c465-4e12-911e-e89242907b8e] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:34.535204 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:27:34.540951 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2ec77f2c-673e-4e25-bc98-7e949bbbe067 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:34.541446 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2ec77f2c-673e-4e25-bc98-7e949bbbe067 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:34.541884 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2ec77f2c-673e-4e25-bc98-7e949bbbe067 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:34.542594 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2ec77f2c-673e-4e25-bc98-7e949bbbe067 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:34.543048 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2ec77f2c-673e-4e25-bc98-7e949bbbe067 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:34.543475 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2ec77f2c-673e-4e25-bc98-7e949bbbe067 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:34.687304 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-2ec77f2c-673e-4e25-bc98-7e949bbbe067 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:34.695858 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-2ec77f2c-673e-4e25-bc98-7e949bbbe067 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/34b22982-c465-4e12-911e-e89242907b8e" status: 200 len: 1565 microversion: 2.1 time: 0.167909 Aug 27 03:27:34.696495 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2989/6017] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:34 2022] GET /compute/v2.1/servers/34b22982-c465-4e12-911e-e89242907b8e => generated 1565 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:36.745408 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-dc6c4826-6797-40e8-a7ec-727e74ba61d6 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:36.746622 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-dc6c4826-6797-40e8-a7ec-727e74ba61d6 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 34b22982-c465-4e12-911e-e89242907b8e] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:36.747512 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-4f93d364-7791-4424-8cb0-dbc135631e84 req-fa4ec4ea-b7b2-4771-83df-ed83e2667ef5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34b22982-c465-4e12-911e-e89242907b8e", "tag": "86d28938-69c1-4403-b70e-6fd97ab0daf8"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:27:36.749939 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=6 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:27:36.756904 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dc6c4826-6797-40e8-a7ec-727e74ba61d6 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:36.757558 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dc6c4826-6797-40e8-a7ec-727e74ba61d6 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:36.758199 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dc6c4826-6797-40e8-a7ec-727e74ba61d6 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:36.759076 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dc6c4826-6797-40e8-a7ec-727e74ba61d6 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:36.759556 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dc6c4826-6797-40e8-a7ec-727e74ba61d6 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:36.759997 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dc6c4826-6797-40e8-a7ec-727e74ba61d6 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:36.760364 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:27:36.761227 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=6 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:27:36.764914 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-4f93d364-7791-4424-8cb0-dbc135631e84 req-fa4ec4ea-b7b2-4771-83df-ed83e2667ef5 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:36.765398 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-4f93d364-7791-4424-8cb0-dbc135631e84 req-fa4ec4ea-b7b2-4771-83df-ed83e2667ef5 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:36.765827 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-4f93d364-7791-4424-8cb0-dbc135631e84 req-fa4ec4ea-b7b2-4771-83df-ed83e2667ef5 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:36.779939 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-4f93d364-7791-4424-8cb0-dbc135631e84 req-fa4ec4ea-b7b2-4771-83df-ed83e2667ef5 service nova] Creating event network-changed:86d28938-69c1-4403-b70e-6fd97ab0daf8 for instance 34b22982-c465-4e12-911e-e89242907b8e on n-h1-852278-4 Aug 27 03:27:36.785939 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-4f93d364-7791-4424-8cb0-dbc135631e84 req-fa4ec4ea-b7b2-4771-83df-ed83e2667ef5 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042045 Aug 27 03:27:36.787124 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2990/6018] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:27:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:27:36.871467 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-19bca461-cc78-4654-9755-8f104eb08613 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:36.872070 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-19bca461-cc78-4654-9755-8f104eb08613 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: fd745775-ded3-4cbb-bec3-1133085c7ec6] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:36.885200 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-19bca461-cc78-4654-9755-8f104eb08613 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:36.886023 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-19bca461-cc78-4654-9755-8f104eb08613 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:36.886458 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-19bca461-cc78-4654-9755-8f104eb08613 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:36.887169 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-19bca461-cc78-4654-9755-8f104eb08613 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:36.887616 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-19bca461-cc78-4654-9755-8f104eb08613 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:36.888039 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-19bca461-cc78-4654-9755-8f104eb08613 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:36.920825 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-19bca461-cc78-4654-9755-8f104eb08613 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: fd745775-ded3-4cbb-bec3-1133085c7ec6] Going to try to terminate instance {{(pid=134052) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:27:37.017546 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-dc6c4826-6797-40e8-a7ec-727e74ba61d6 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:37.029198 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-dc6c4826-6797-40e8-a7ec-727e74ba61d6 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/34b22982-c465-4e12-911e-e89242907b8e" status: 200 len: 1565 microversion: 2.1 time: 0.287713 Aug 27 03:27:37.031145 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3029/6019] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:36 2022] GET /compute/v2.1/servers/34b22982-c465-4e12-911e-e89242907b8e => generated 1565 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:37.036917 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-3c8e8486-004b-464c-a88f-20428f461d4d req-4a65ef98-cea7-4a6b-b08c-934ae2671ec5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd745775-ded3-4cbb-bec3-1133085c7ec6", "tag": "7ba79a1a-2c31-4c66-b747-5bb78ac13dc9"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:27:37.048068 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-3c8e8486-004b-464c-a88f-20428f461d4d req-4a65ef98-cea7-4a6b-b08c-934ae2671ec5 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:37.049122 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-3c8e8486-004b-464c-a88f-20428f461d4d req-4a65ef98-cea7-4a6b-b08c-934ae2671ec5 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:37.049811 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-3c8e8486-004b-464c-a88f-20428f461d4d req-4a65ef98-cea7-4a6b-b08c-934ae2671ec5 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:37.065020 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-19bca461-cc78-4654-9755-8f104eb08613 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "DELETE /compute/v2.1/servers/fd745775-ded3-4cbb-bec3-1133085c7ec6" status: 204 len: 0 microversion: 2.1 time: 0.197600 Aug 27 03:27:37.066434 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2991/6020] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 03:27:36 2022] DELETE /compute/v2.1/servers/fd745775-ded3-4cbb-bec3-1133085c7ec6 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 03:27:37.069761 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-3c8e8486-004b-464c-a88f-20428f461d4d req-4a65ef98-cea7-4a6b-b08c-934ae2671ec5 service nova] Creating event network-changed:7ba79a1a-2c31-4c66-b747-5bb78ac13dc9 for instance fd745775-ded3-4cbb-bec3-1133085c7ec6 on n-h2-852278-4 Aug 27 03:27:37.075784 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-3c8e8486-004b-464c-a88f-20428f461d4d req-4a65ef98-cea7-4a6b-b08c-934ae2671ec5 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043036 Aug 27 03:27:37.077137 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3030/6021] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:27:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:27:37.082908 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-fdef7878-6c4b-495d-9250-99d2fd2ceda9 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:37.083764 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-fdef7878-6c4b-495d-9250-99d2fd2ceda9 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: fd745775-ded3-4cbb-bec3-1133085c7ec6] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:37.090874 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fdef7878-6c4b-495d-9250-99d2fd2ceda9 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:37.092104 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fdef7878-6c4b-495d-9250-99d2fd2ceda9 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:37.092706 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fdef7878-6c4b-495d-9250-99d2fd2ceda9 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:37.093534 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fdef7878-6c4b-495d-9250-99d2fd2ceda9 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:37.094090 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fdef7878-6c4b-495d-9250-99d2fd2ceda9 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:37.094630 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fdef7878-6c4b-495d-9250-99d2fd2ceda9 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:37.330899 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-fdef7878-6c4b-495d-9250-99d2fd2ceda9 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:37.344959 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-fdef7878-6c4b-495d-9250-99d2fd2ceda9 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/fd745775-ded3-4cbb-bec3-1133085c7ec6" status: 200 len: 1578 microversion: 2.1 time: 0.272807 Aug 27 03:27:37.345984 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2992/6022] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:37 2022] GET /compute/v2.1/servers/fd745775-ded3-4cbb-bec3-1133085c7ec6 => generated 1578 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:38.369587 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b66c7277-fa30-4575-a9a4-971acaf314d1 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:38.370674 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b66c7277-fa30-4575-a9a4-971acaf314d1 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: fd745775-ded3-4cbb-bec3-1133085c7ec6] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:38.382525 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b66c7277-fa30-4575-a9a4-971acaf314d1 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:38.383289 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b66c7277-fa30-4575-a9a4-971acaf314d1 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:38.383766 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b66c7277-fa30-4575-a9a4-971acaf314d1 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:38.384533 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b66c7277-fa30-4575-a9a4-971acaf314d1 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:38.385002 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b66c7277-fa30-4575-a9a4-971acaf314d1 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:38.385445 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b66c7277-fa30-4575-a9a4-971acaf314d1 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:38.520480 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-b66c7277-fa30-4575-a9a4-971acaf314d1 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:38.530523 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b66c7277-fa30-4575-a9a4-971acaf314d1 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/fd745775-ded3-4cbb-bec3-1133085c7ec6" status: 200 len: 1578 microversion: 2.1 time: 0.167636 Aug 27 03:27:38.531334 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3031/6023] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:38 2022] GET /compute/v2.1/servers/fd745775-ded3-4cbb-bec3-1133085c7ec6 => generated 1578 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:39.228706 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-bee8bcb3-36d6-4061-b702-ab7a9460f907 req-cdd33093-a6c3-4a90-ade9-0ae99ab3205f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd745775-ded3-4cbb-bec3-1133085c7ec6", "name": "network-vif-deleted", "tag": "7ba79a1a-2c31-4c66-b747-5bb78ac13dc9"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:27:39.241913 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-bee8bcb3-36d6-4061-b702-ab7a9460f907 req-cdd33093-a6c3-4a90-ade9-0ae99ab3205f service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:39.242436 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-bee8bcb3-36d6-4061-b702-ab7a9460f907 req-cdd33093-a6c3-4a90-ade9-0ae99ab3205f service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:39.242912 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-bee8bcb3-36d6-4061-b702-ab7a9460f907 req-cdd33093-a6c3-4a90-ade9-0ae99ab3205f service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:39.256149 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-bee8bcb3-36d6-4061-b702-ab7a9460f907 req-cdd33093-a6c3-4a90-ade9-0ae99ab3205f service nova] Creating event network-vif-deleted:7ba79a1a-2c31-4c66-b747-5bb78ac13dc9 for instance fd745775-ded3-4cbb-bec3-1133085c7ec6 on n-h2-852278-4 Aug 27 03:27:39.261419 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-bee8bcb3-36d6-4061-b702-ab7a9460f907 req-cdd33093-a6c3-4a90-ade9-0ae99ab3205f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036565 Aug 27 03:27:39.262052 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2993/6024] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:27:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:27:39.552791 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e4de3f7c-5b2f-42bb-800a-466cbf07ded6 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:39.553430 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-e4de3f7c-5b2f-42bb-800a-466cbf07ded6 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: fd745775-ded3-4cbb-bec3-1133085c7ec6] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:39.560974 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e4de3f7c-5b2f-42bb-800a-466cbf07ded6 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:39.561739 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e4de3f7c-5b2f-42bb-800a-466cbf07ded6 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:39.562415 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e4de3f7c-5b2f-42bb-800a-466cbf07ded6 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:39.563152 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e4de3f7c-5b2f-42bb-800a-466cbf07ded6 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:39.563625 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e4de3f7c-5b2f-42bb-800a-466cbf07ded6 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:39.564067 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e4de3f7c-5b2f-42bb-800a-466cbf07ded6 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:39.635151 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e4de3f7c-5b2f-42bb-800a-466cbf07ded6 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:39.644578 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e4de3f7c-5b2f-42bb-800a-466cbf07ded6 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/fd745775-ded3-4cbb-bec3-1133085c7ec6" status: 200 len: 1226 microversion: 2.1 time: 0.095932 Aug 27 03:27:39.649785 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3032/6025] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:39 2022] GET /compute/v2.1/servers/fd745775-ded3-4cbb-bec3-1133085c7ec6 => generated 1226 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:40.665897 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ae17bbd3-79de-4629-a34d-c5c467d0e010 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:40.666742 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-ae17bbd3-79de-4629-a34d-c5c467d0e010 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: fd745775-ded3-4cbb-bec3-1133085c7ec6] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:40.674255 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ae17bbd3-79de-4629-a34d-c5c467d0e010 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:40.674745 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ae17bbd3-79de-4629-a34d-c5c467d0e010 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:40.675183 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ae17bbd3-79de-4629-a34d-c5c467d0e010 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:40.675894 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ae17bbd3-79de-4629-a34d-c5c467d0e010 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:40.676349 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ae17bbd3-79de-4629-a34d-c5c467d0e010 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:40.676805 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ae17bbd3-79de-4629-a34d-c5c467d0e010 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:40.744741 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-ae17bbd3-79de-4629-a34d-c5c467d0e010 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:40.754178 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ae17bbd3-79de-4629-a34d-c5c467d0e010 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/fd745775-ded3-4cbb-bec3-1133085c7ec6" status: 200 len: 1226 microversion: 2.1 time: 0.092751 Aug 27 03:27:40.755396 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2994/6026] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:40 2022] GET /compute/v2.1/servers/fd745775-ded3-4cbb-bec3-1133085c7ec6 => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:41.776086 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-cdc6565b-9d7f-4d44-ab76-17d7619e41fb tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:41.776754 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-cdc6565b-9d7f-4d44-ab76-17d7619e41fb tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: fd745775-ded3-4cbb-bec3-1133085c7ec6] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:41.779918 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:27:41.785876 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cdc6565b-9d7f-4d44-ab76-17d7619e41fb tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:41.786385 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cdc6565b-9d7f-4d44-ab76-17d7619e41fb tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:41.786859 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cdc6565b-9d7f-4d44-ab76-17d7619e41fb tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:41.787588 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cdc6565b-9d7f-4d44-ab76-17d7619e41fb tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:41.788051 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cdc6565b-9d7f-4d44-ab76-17d7619e41fb tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:41.788524 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cdc6565b-9d7f-4d44-ab76-17d7619e41fb tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:41.852532 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-cdc6565b-9d7f-4d44-ab76-17d7619e41fb tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:41.860728 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-cdc6565b-9d7f-4d44-ab76-17d7619e41fb tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/fd745775-ded3-4cbb-bec3-1133085c7ec6" status: 200 len: 1226 microversion: 2.1 time: 0.088916 Aug 27 03:27:41.861311 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3033/6027] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:41 2022] GET /compute/v2.1/servers/fd745775-ded3-4cbb-bec3-1133085c7ec6 => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:42.881862 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4f136b92-b503-4c95-92f8-c05217d4d381 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:42.882488 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-4f136b92-b503-4c95-92f8-c05217d4d381 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: fd745775-ded3-4cbb-bec3-1133085c7ec6] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:42.890360 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4f136b92-b503-4c95-92f8-c05217d4d381 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:42.890882 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4f136b92-b503-4c95-92f8-c05217d4d381 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:42.891322 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4f136b92-b503-4c95-92f8-c05217d4d381 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:42.892051 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4f136b92-b503-4c95-92f8-c05217d4d381 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:42.892538 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4f136b92-b503-4c95-92f8-c05217d4d381 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:42.892963 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4f136b92-b503-4c95-92f8-c05217d4d381 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:42.964656 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-4f136b92-b503-4c95-92f8-c05217d4d381 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:42.972793 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-4f136b92-b503-4c95-92f8-c05217d4d381 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/fd745775-ded3-4cbb-bec3-1133085c7ec6" status: 200 len: 1226 microversion: 2.1 time: 0.094977 Aug 27 03:27:42.973465 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2995/6028] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:42 2022] GET /compute/v2.1/servers/fd745775-ded3-4cbb-bec3-1133085c7ec6 => generated 1226 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:43.994349 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-26b52fb8-6b37-45dd-a49c-be2c94e71a45 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:43.994974 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-26b52fb8-6b37-45dd-a49c-be2c94e71a45 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: fd745775-ded3-4cbb-bec3-1133085c7ec6] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:44.002454 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-26b52fb8-6b37-45dd-a49c-be2c94e71a45 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:44.002962 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-26b52fb8-6b37-45dd-a49c-be2c94e71a45 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:44.003398 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-26b52fb8-6b37-45dd-a49c-be2c94e71a45 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:44.004141 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-26b52fb8-6b37-45dd-a49c-be2c94e71a45 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:44.004644 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-26b52fb8-6b37-45dd-a49c-be2c94e71a45 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:44.005086 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-26b52fb8-6b37-45dd-a49c-be2c94e71a45 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:44.018955 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-26b52fb8-6b37-45dd-a49c-be2c94e71a45 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] HTTP exception thrown: Instance fd745775-ded3-4cbb-bec3-1133085c7ec6 could not be found. Aug 27 03:27:44.020685 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-26b52fb8-6b37-45dd-a49c-be2c94e71a45 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Request method failure captured: Aug 27 03:27:44.020685 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/fd745775-ded3-4cbb-bec3-1133085c7ec6 HTTP/1.1 Aug 27 03:27:44.020685 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 03:27:44.020685 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 03:27:44.020685 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 03:27:44.020685 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 03:27:44.020685 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 03:27:44.020685 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 03:27:44.020685 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 03:27:44.020685 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 03:27:44.020685 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYyanRmSitPtUh4DIDjvAfp5Iiwg8r3Bf9-rjIalvb44wIYhFzVkZDLPIdVwR9rbE-qHDjS_3-JeB9MrxSXFOtiOWUfHFokH2CMOJ34en6s6KyuDM-ix0my9F59eD8M1zowb_BqVFIaTj9p6YHs85SeVo0SCpB1hAOakQSi3_cd8UVk Aug 27 03:27:44.020685 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 03:27:44.020685 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 03:27:44.020685 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 03:27:44.020685 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 03:27:44.020685 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 03:27:44.020685 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 03:27:44.020685 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 7b2673a034c24d1898493bfea9ca5d1d Aug 27 03:27:44.020685 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-TestVolumeBootPattern-2103223700 Aug 27 03:27:44.020685 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 03:27:44.020685 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 03:27:44.020685 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7b2673a034c24d1898493bfea9ca5d1d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_7b2673a034c24d1898493bfea9ca5d1d", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7b2673a034c24d1898493bfea9ca5d1d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/7b2673a034c24d1898493bfea9ca5d1d"}]}] Aug 27 03:27:44.020685 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-TestVolumeBootPattern-2103223700 Aug 27 03:27:44.020685 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 7b2673a034c24d1898493bfea9ca5d1d Aug 27 03:27:44.020685 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-TestVolumeBootPattern-2103223700 Aug 27 03:27:44.020685 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-TestVolumeBootPattern-2103223700-project Aug 27 03:27:44.020685 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 03:27:44.020685 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 03:27:44.020685 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 4aa867d7baa043b1b1e6763046463b3f Aug 27 03:27:44.020685 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-TestVolumeBootPattern-2103223700-project Aug 27 03:27:44.020685 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 03:27:44.020685 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance fd745775-ded3-4cbb-bec3-1133085c7ec6 could not be found. Aug 27 03:27:44.020685 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': 'fd745775-ded3-4cbb-bec3-1133085c7ec6'} Aug 27 03:27:44.020685 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:27:44.020685 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:27:44.020685 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:27:44.020685 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:27:44.020685 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:27:44.020685 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:27:44.020685 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:27:44.020685 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:27:44.020685 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:27:44.020685 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:27:44.020685 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd745775-ded3-4cbb-bec3-1133085c7ec6 could not be found. Aug 27 03:27:44.020685 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:27:44.020685 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:27:44.020685 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:27:44.020685 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:27:44.020685 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:27:44.020685 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:27:44.020685 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:27:44.020685 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:27:44.020685 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:27:44.020685 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:27:44.020685 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:27:44.020685 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:27:44.020685 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:27:44.020685 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:27:44.020685 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:27:44.020685 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:27:44.020685 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd745775-ded3-4cbb-bec3-1133085c7ec6 could not be found. Aug 27 03:27:44.020685 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:27:44.020685 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:27:44.020685 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:27:44.026308 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:27:44.026308 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:27:44.026308 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:27:44.026308 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:27:44.026308 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:27:44.026308 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd745775-ded3-4cbb-bec3-1133085c7ec6 could not be found. Aug 27 03:27:44.026308 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:27:44.026308 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-26b52fb8-6b37-45dd-a49c-be2c94e71a45 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Returning 404 to user: Instance fd745775-ded3-4cbb-bec3-1133085c7ec6 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:27:44.026308 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-26b52fb8-6b37-45dd-a49c-be2c94e71a45 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/fd745775-ded3-4cbb-bec3-1133085c7ec6" status: 404 len: 111 microversion: 2.1 time: 0.031904 Aug 27 03:27:44.026308 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3034/6029] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:43 2022] GET /compute/v2.1/servers/fd745775-ded3-4cbb-bec3-1133085c7ec6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:27:50.308044 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c6843a7c-948c-4a0b-b5bd-99535777d5e0 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:50.308658 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-c6843a7c-948c-4a0b-b5bd-99535777d5e0 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 2438c692-fd2c-44e2-a733-ad3e1215baf9] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:50.317397 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-c3934734-b93a-4eee-bde7-072956f2ae2a req-e177d01d-836f-45a6-a298-bb03cad1b767 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2438c692-fd2c-44e2-a733-ad3e1215baf9", "tag": "1f3c37fa-c278-45fc-bb15-a87e4661bf62"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:27:50.329779 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-c3934734-b93a-4eee-bde7-072956f2ae2a req-e177d01d-836f-45a6-a298-bb03cad1b767 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:50.330221 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c6843a7c-948c-4a0b-b5bd-99535777d5e0 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:50.330392 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-c3934734-b93a-4eee-bde7-072956f2ae2a req-e177d01d-836f-45a6-a298-bb03cad1b767 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:50.330671 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-c3934734-b93a-4eee-bde7-072956f2ae2a req-e177d01d-836f-45a6-a298-bb03cad1b767 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:50.330932 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c6843a7c-948c-4a0b-b5bd-99535777d5e0 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:50.331708 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c6843a7c-948c-4a0b-b5bd-99535777d5e0 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:50.332720 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c6843a7c-948c-4a0b-b5bd-99535777d5e0 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:50.333407 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c6843a7c-948c-4a0b-b5bd-99535777d5e0 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:50.334062 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c6843a7c-948c-4a0b-b5bd-99535777d5e0 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:50.342468 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-c3934734-b93a-4eee-bde7-072956f2ae2a req-e177d01d-836f-45a6-a298-bb03cad1b767 service nova] Creating event network-changed:1f3c37fa-c278-45fc-bb15-a87e4661bf62 for instance 2438c692-fd2c-44e2-a733-ad3e1215baf9 on n-h2-852278-4 Aug 27 03:27:50.347871 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-c3934734-b93a-4eee-bde7-072956f2ae2a req-e177d01d-836f-45a6-a298-bb03cad1b767 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034162 Aug 27 03:27:50.348812 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3035/6030] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:27:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:27:50.367900 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-c6843a7c-948c-4a0b-b5bd-99535777d5e0 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 2438c692-fd2c-44e2-a733-ad3e1215baf9] Going to try to terminate instance {{(pid=134052) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:27:50.459999 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c6843a7c-948c-4a0b-b5bd-99535777d5e0 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "DELETE /compute/v2.1/servers/2438c692-fd2c-44e2-a733-ad3e1215baf9" status: 204 len: 0 microversion: 2.1 time: 0.155679 Aug 27 03:27:50.461665 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2996/6031] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 03:27:50 2022] DELETE /compute/v2.1/servers/2438c692-fd2c-44e2-a733-ad3e1215baf9 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:27:50.472902 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-81d24e9e-8f26-4256-ba42-625891df602b tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:50.473680 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-81d24e9e-8f26-4256-ba42-625891df602b tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 2438c692-fd2c-44e2-a733-ad3e1215baf9] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:50.481698 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-81d24e9e-8f26-4256-ba42-625891df602b tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:50.482255 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-81d24e9e-8f26-4256-ba42-625891df602b tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:50.482711 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-81d24e9e-8f26-4256-ba42-625891df602b tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:50.483511 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-81d24e9e-8f26-4256-ba42-625891df602b tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:50.483980 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-81d24e9e-8f26-4256-ba42-625891df602b tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:50.484444 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-81d24e9e-8f26-4256-ba42-625891df602b tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:50.627314 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-81d24e9e-8f26-4256-ba42-625891df602b tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:50.636328 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-81d24e9e-8f26-4256-ba42-625891df602b tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/2438c692-fd2c-44e2-a733-ad3e1215baf9" status: 200 len: 1578 microversion: 2.1 time: 0.170060 Aug 27 03:27:50.636941 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3036/6032] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:50 2022] GET /compute/v2.1/servers/2438c692-fd2c-44e2-a733-ad3e1215baf9 => generated 1578 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:51.658513 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-fc347fc3-49d3-45b4-bdb6-1e5dcee9d913 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:51.659214 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-fc347fc3-49d3-45b4-bdb6-1e5dcee9d913 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 2438c692-fd2c-44e2-a733-ad3e1215baf9] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:51.666694 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fc347fc3-49d3-45b4-bdb6-1e5dcee9d913 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:51.667152 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fc347fc3-49d3-45b4-bdb6-1e5dcee9d913 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:51.667612 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fc347fc3-49d3-45b4-bdb6-1e5dcee9d913 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:51.668348 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fc347fc3-49d3-45b4-bdb6-1e5dcee9d913 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:51.668787 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fc347fc3-49d3-45b4-bdb6-1e5dcee9d913 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:51.669208 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fc347fc3-49d3-45b4-bdb6-1e5dcee9d913 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:51.837386 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-fc347fc3-49d3-45b4-bdb6-1e5dcee9d913 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:51.846241 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-fc347fc3-49d3-45b4-bdb6-1e5dcee9d913 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/2438c692-fd2c-44e2-a733-ad3e1215baf9" status: 200 len: 1578 microversion: 2.1 time: 0.192094 Aug 27 03:27:51.846812 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2997/6033] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:51 2022] GET /compute/v2.1/servers/2438c692-fd2c-44e2-a733-ad3e1215baf9 => generated 1578 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:52.425589 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-a6f6887d-15a8-4f0c-b8ab-aea38c3da8c2 req-96b8c21f-5177-44ba-89b6-826962cb4d47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2438c692-fd2c-44e2-a733-ad3e1215baf9", "name": "network-vif-deleted", "tag": "1f3c37fa-c278-45fc-bb15-a87e4661bf62"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:27:52.438905 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-a6f6887d-15a8-4f0c-b8ab-aea38c3da8c2 req-96b8c21f-5177-44ba-89b6-826962cb4d47 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:52.439314 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-a6f6887d-15a8-4f0c-b8ab-aea38c3da8c2 req-96b8c21f-5177-44ba-89b6-826962cb4d47 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:52.439756 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-a6f6887d-15a8-4f0c-b8ab-aea38c3da8c2 req-96b8c21f-5177-44ba-89b6-826962cb4d47 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:52.451943 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-a6f6887d-15a8-4f0c-b8ab-aea38c3da8c2 req-96b8c21f-5177-44ba-89b6-826962cb4d47 service nova] Creating event network-vif-deleted:1f3c37fa-c278-45fc-bb15-a87e4661bf62 for instance 2438c692-fd2c-44e2-a733-ad3e1215baf9 on n-h2-852278-4 Aug 27 03:27:52.457638 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-a6f6887d-15a8-4f0c-b8ab-aea38c3da8c2 req-96b8c21f-5177-44ba-89b6-826962cb4d47 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035922 Aug 27 03:27:52.458245 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3037/6034] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:27:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:27:52.867711 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-331d58ac-5116-4189-a876-e3d42d5829ad tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:52.868443 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-331d58ac-5116-4189-a876-e3d42d5829ad tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 2438c692-fd2c-44e2-a733-ad3e1215baf9] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:52.876027 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-331d58ac-5116-4189-a876-e3d42d5829ad tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:52.876622 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-331d58ac-5116-4189-a876-e3d42d5829ad tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:52.877151 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-331d58ac-5116-4189-a876-e3d42d5829ad tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:52.877931 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-331d58ac-5116-4189-a876-e3d42d5829ad tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:52.878488 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-331d58ac-5116-4189-a876-e3d42d5829ad tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:52.878958 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-331d58ac-5116-4189-a876-e3d42d5829ad tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:52.950802 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-331d58ac-5116-4189-a876-e3d42d5829ad tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:52.959706 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:27:52.962888 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-331d58ac-5116-4189-a876-e3d42d5829ad tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/2438c692-fd2c-44e2-a733-ad3e1215baf9" status: 200 len: 1226 microversion: 2.1 time: 0.098705 Aug 27 03:27:52.969278 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2998/6035] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:52 2022] GET /compute/v2.1/servers/2438c692-fd2c-44e2-a733-ad3e1215baf9 => generated 1226 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:53.984880 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-5aea219f-7683-475a-b72a-d2d248ed434e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:53.985680 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-5aea219f-7683-475a-b72a-d2d248ed434e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 2438c692-fd2c-44e2-a733-ad3e1215baf9] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:53.994754 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5aea219f-7683-475a-b72a-d2d248ed434e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:53.995330 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5aea219f-7683-475a-b72a-d2d248ed434e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:53.995793 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5aea219f-7683-475a-b72a-d2d248ed434e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:53.996563 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5aea219f-7683-475a-b72a-d2d248ed434e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:53.997043 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5aea219f-7683-475a-b72a-d2d248ed434e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:53.997467 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5aea219f-7683-475a-b72a-d2d248ed434e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:54.066657 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-5aea219f-7683-475a-b72a-d2d248ed434e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:54.075715 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-5aea219f-7683-475a-b72a-d2d248ed434e tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/2438c692-fd2c-44e2-a733-ad3e1215baf9" status: 200 len: 1226 microversion: 2.1 time: 0.095404 Aug 27 03:27:54.076384 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3038/6036] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:53 2022] GET /compute/v2.1/servers/2438c692-fd2c-44e2-a733-ad3e1215baf9 => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:55.097545 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-72b6bd45-5dae-49f7-aaaf-652e2d32d348 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:55.098161 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-72b6bd45-5dae-49f7-aaaf-652e2d32d348 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 2438c692-fd2c-44e2-a733-ad3e1215baf9] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:55.105757 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-72b6bd45-5dae-49f7-aaaf-652e2d32d348 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:55.106238 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-72b6bd45-5dae-49f7-aaaf-652e2d32d348 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:55.106673 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-72b6bd45-5dae-49f7-aaaf-652e2d32d348 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:55.107369 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-72b6bd45-5dae-49f7-aaaf-652e2d32d348 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:55.107870 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-72b6bd45-5dae-49f7-aaaf-652e2d32d348 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:55.108273 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-72b6bd45-5dae-49f7-aaaf-652e2d32d348 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:55.176074 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-72b6bd45-5dae-49f7-aaaf-652e2d32d348 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:55.184919 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-72b6bd45-5dae-49f7-aaaf-652e2d32d348 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/2438c692-fd2c-44e2-a733-ad3e1215baf9" status: 200 len: 1226 microversion: 2.1 time: 0.091742 Aug 27 03:27:55.185516 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 2999/6037] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:55 2022] GET /compute/v2.1/servers/2438c692-fd2c-44e2-a733-ad3e1215baf9 => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:56.205952 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3013ab30-92a2-4249-b3c5-27459be5f675 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:56.206561 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-3013ab30-92a2-4249-b3c5-27459be5f675 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 2438c692-fd2c-44e2-a733-ad3e1215baf9] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:56.213906 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3013ab30-92a2-4249-b3c5-27459be5f675 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:56.214449 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3013ab30-92a2-4249-b3c5-27459be5f675 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:56.215052 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3013ab30-92a2-4249-b3c5-27459be5f675 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:56.215903 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3013ab30-92a2-4249-b3c5-27459be5f675 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:56.216404 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3013ab30-92a2-4249-b3c5-27459be5f675 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:56.216844 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3013ab30-92a2-4249-b3c5-27459be5f675 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:56.221150 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=71 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:27:56.280529 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-3013ab30-92a2-4249-b3c5-27459be5f675 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa867d7baa043b1b1e6763046463b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2673a034c24d1898493bfea9ca5d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:56.289271 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-3013ab30-92a2-4249-b3c5-27459be5f675 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/2438c692-fd2c-44e2-a733-ad3e1215baf9" status: 200 len: 1226 microversion: 2.1 time: 0.087351 Aug 27 03:27:56.290089 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3039/6038] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:56 2022] GET /compute/v2.1/servers/2438c692-fd2c-44e2-a733-ad3e1215baf9 => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:57.314435 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8118ec64-7575-4cbe-a7b6-e31fa7e01830 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:57.315283 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-8118ec64-7575-4cbe-a7b6-e31fa7e01830 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 2438c692-fd2c-44e2-a733-ad3e1215baf9] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:57.326669 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8118ec64-7575-4cbe-a7b6-e31fa7e01830 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:57.327446 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8118ec64-7575-4cbe-a7b6-e31fa7e01830 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:57.328083 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8118ec64-7575-4cbe-a7b6-e31fa7e01830 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:57.329413 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8118ec64-7575-4cbe-a7b6-e31fa7e01830 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:57.330121 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8118ec64-7575-4cbe-a7b6-e31fa7e01830 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:57.330803 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8118ec64-7575-4cbe-a7b6-e31fa7e01830 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:57.347492 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-8118ec64-7575-4cbe-a7b6-e31fa7e01830 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] HTTP exception thrown: Instance 2438c692-fd2c-44e2-a733-ad3e1215baf9 could not be found. Aug 27 03:27:57.349206 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8118ec64-7575-4cbe-a7b6-e31fa7e01830 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Request method failure captured: Aug 27 03:27:57.349206 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/servers/2438c692-fd2c-44e2-a733-ad3e1215baf9 HTTP/1.1 Aug 27 03:27:57.349206 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 03:27:57.349206 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 03:27:57.349206 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 03:27:57.349206 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 03:27:57.349206 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 03:27:57.349206 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 03:27:57.349206 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 03:27:57.349206 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 03:27:57.349206 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYyanRmSitPtUh4DIDjvAfp5Iiwg8r3Bf9-rjIalvb44wIYhFzVkZDLPIdVwR9rbE-qHDjS_3-JeB9MrxSXFOtiOWUfHFokH2CMOJ34en6s6KyuDM-ix0my9F59eD8M1zowb_BqVFIaTj9p6YHs85SeVo0SCpB1hAOakQSi3_cd8UVk Aug 27 03:27:57.349206 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 03:27:57.349206 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 03:27:57.349206 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 03:27:57.349206 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 03:27:57.349206 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 03:27:57.349206 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 03:27:57.349206 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 7b2673a034c24d1898493bfea9ca5d1d Aug 27 03:27:57.349206 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-TestVolumeBootPattern-2103223700 Aug 27 03:27:57.349206 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 03:27:57.349206 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 03:27:57.349206 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7b2673a034c24d1898493bfea9ca5d1d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_7b2673a034c24d1898493bfea9ca5d1d", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7b2673a034c24d1898493bfea9ca5d1d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/7b2673a034c24d1898493bfea9ca5d1d"}]}] Aug 27 03:27:57.349206 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-TestVolumeBootPattern-2103223700 Aug 27 03:27:57.349206 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 7b2673a034c24d1898493bfea9ca5d1d Aug 27 03:27:57.349206 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-TestVolumeBootPattern-2103223700 Aug 27 03:27:57.349206 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-TestVolumeBootPattern-2103223700-project Aug 27 03:27:57.349206 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 03:27:57.349206 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 03:27:57.349206 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 4aa867d7baa043b1b1e6763046463b3f Aug 27 03:27:57.349206 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-TestVolumeBootPattern-2103223700-project Aug 27 03:27:57.349206 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 03:27:57.349206 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance 2438c692-fd2c-44e2-a733-ad3e1215baf9 could not be found. Aug 27 03:27:57.349206 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '2438c692-fd2c-44e2-a733-ad3e1215baf9'} Aug 27 03:27:57.349206 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:27:57.349206 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:27:57.349206 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:27:57.349206 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:27:57.349206 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:27:57.349206 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:27:57.349206 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:27:57.349206 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:27:57.349206 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:27:57.349206 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:27:57.349206 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2438c692-fd2c-44e2-a733-ad3e1215baf9 could not be found. Aug 27 03:27:57.349206 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:27:57.349206 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:27:57.349206 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:27:57.349206 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:27:57.349206 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:27:57.349206 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:27:57.349206 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:27:57.349206 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:27:57.349206 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:27:57.349206 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:27:57.349206 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:27:57.349206 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:27:57.349206 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:27:57.349206 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:27:57.349206 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:27:57.349206 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:27:57.349206 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2438c692-fd2c-44e2-a733-ad3e1215baf9 could not be found. Aug 27 03:27:57.349206 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:27:57.349206 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:27:57.349206 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:27:57.354470 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:27:57.354470 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:27:57.354470 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:27:57.354470 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:27:57.354470 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:27:57.354470 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2438c692-fd2c-44e2-a733-ad3e1215baf9 could not be found. Aug 27 03:27:57.354470 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:27:57.354470 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8118ec64-7575-4cbe-a7b6-e31fa7e01830 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Returning 404 to user: Instance 2438c692-fd2c-44e2-a733-ad3e1215baf9 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:27:57.354470 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-8118ec64-7575-4cbe-a7b6-e31fa7e01830 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/2438c692-fd2c-44e2-a733-ad3e1215baf9" status: 404 len: 111 microversion: 2.1 time: 0.042954 Aug 27 03:27:57.354470 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3000/6039] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:57 2022] GET /compute/v2.1/servers/2438c692-fd2c-44e2-a733-ad3e1215baf9 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:27:57.817768 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-9fdeb947-b56c-4cf4-96a1-badda8435f4f tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:57.818414 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-9fdeb947-b56c-4cf4-96a1-badda8435f4f tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 5d82e610-a5cf-4a01-8a02-11b1c1ce9960] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:57.825765 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9fdeb947-b56c-4cf4-96a1-badda8435f4f tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:57.826330 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9fdeb947-b56c-4cf4-96a1-badda8435f4f tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:57.826718 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9fdeb947-b56c-4cf4-96a1-badda8435f4f tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:57.827427 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9fdeb947-b56c-4cf4-96a1-badda8435f4f tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:57.827894 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9fdeb947-b56c-4cf4-96a1-badda8435f4f tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:57.828346 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9fdeb947-b56c-4cf4-96a1-badda8435f4f tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:57.842663 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-9fdeb947-b56c-4cf4-96a1-badda8435f4f tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] HTTP exception thrown: Instance 5d82e610-a5cf-4a01-8a02-11b1c1ce9960 could not be found. Aug 27 03:27:57.844406 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-9fdeb947-b56c-4cf4-96a1-badda8435f4f tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Request method failure captured: Aug 27 03:27:57.844406 n-d-852278-4 devstack@n-api.service[134051]: request: DELETE /compute/v2.1/servers/5d82e610-a5cf-4a01-8a02-11b1c1ce9960 HTTP/1.1 Aug 27 03:27:57.844406 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 03:27:57.844406 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 03:27:57.844406 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 03:27:57.844406 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 03:27:57.844406 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 03:27:57.844406 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 03:27:57.844406 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 03:27:57.844406 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 03:27:57.844406 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCYyanRmSitPtUh4DIDjvAfp5Iiwg8r3Bf9-rjIalvb44wIYhFzVkZDLPIdVwR9rbE-qHDjS_3-JeB9MrxSXFOtiOWUfHFokH2CMOJ34en6s6KyuDM-ix0my9F59eD8M1zowb_BqVFIaTj9p6YHs85SeVo0SCpB1hAOakQSi3_cd8UVk Aug 27 03:27:57.844406 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 03:27:57.844406 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 03:27:57.844406 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 03:27:57.844406 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 03:27:57.844406 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 03:27:57.844406 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 03:27:57.844406 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 7b2673a034c24d1898493bfea9ca5d1d Aug 27 03:27:57.844406 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-TestVolumeBootPattern-2103223700 Aug 27 03:27:57.844406 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 03:27:57.844406 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 03:27:57.844406 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7b2673a034c24d1898493bfea9ca5d1d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_7b2673a034c24d1898493bfea9ca5d1d", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7b2673a034c24d1898493bfea9ca5d1d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/7b2673a034c24d1898493bfea9ca5d1d"}]}] Aug 27 03:27:57.844406 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-TestVolumeBootPattern-2103223700 Aug 27 03:27:57.844406 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 7b2673a034c24d1898493bfea9ca5d1d Aug 27 03:27:57.844406 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-TestVolumeBootPattern-2103223700 Aug 27 03:27:57.844406 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-TestVolumeBootPattern-2103223700-project Aug 27 03:27:57.844406 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 03:27:57.844406 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 03:27:57.844406 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 4aa867d7baa043b1b1e6763046463b3f Aug 27 03:27:57.844406 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-TestVolumeBootPattern-2103223700-project Aug 27 03:27:57.844406 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 03:27:57.844406 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance 5d82e610-a5cf-4a01-8a02-11b1c1ce9960 could not be found. Aug 27 03:27:57.844406 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '5d82e610-a5cf-4a01-8a02-11b1c1ce9960'} Aug 27 03:27:57.844406 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:27:57.844406 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:27:57.844406 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:27:57.844406 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:27:57.844406 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:27:57.844406 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:27:57.844406 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:27:57.844406 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:27:57.844406 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:27:57.844406 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:27:57.844406 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d82e610-a5cf-4a01-8a02-11b1c1ce9960 could not be found. Aug 27 03:27:57.844406 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:27:57.844406 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:27:57.844406 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:27:57.844406 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:27:57.844406 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:27:57.844406 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:27:57.844406 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:27:57.844406 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:27:57.844406 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:27:57.844406 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:27:57.844406 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 03:27:57.844406 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 03:27:57.844406 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 03:27:57.844406 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 03:27:57.844406 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:27:57.844406 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:27:57.844406 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:27:57.844406 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:27:57.849358 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d82e610-a5cf-4a01-8a02-11b1c1ce9960 could not be found. Aug 27 03:27:57.849358 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:27:57.849358 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:27:57.849358 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:27:57.849358 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:27:57.849358 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:27:57.849358 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:27:57.849358 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:27:57.849358 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:27:57.849358 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d82e610-a5cf-4a01-8a02-11b1c1ce9960 could not be found. Aug 27 03:27:57.849358 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:27:57.849358 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-9fdeb947-b56c-4cf4-96a1-badda8435f4f tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Returning 404 to user: Instance 5d82e610-a5cf-4a01-8a02-11b1c1ce9960 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:27:57.849358 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-9fdeb947-b56c-4cf4-96a1-badda8435f4f tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "DELETE /compute/v2.1/servers/5d82e610-a5cf-4a01-8a02-11b1c1ce9960" status: 404 len: 111 microversion: 2.1 time: 0.032206 Aug 27 03:27:57.849358 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3040/6040] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 03:27:57 2022] DELETE /compute/v2.1/servers/5d82e610-a5cf-4a01-8a02-11b1c1ce9960 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:27:57.858848 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6ec5b022-763f-4d6f-94be-cbb2ae857be2 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:57.859490 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-6ec5b022-763f-4d6f-94be-cbb2ae857be2 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] [instance: 5d82e610-a5cf-4a01-8a02-11b1c1ce9960] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:57.865835 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6ec5b022-763f-4d6f-94be-cbb2ae857be2 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:57.866321 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6ec5b022-763f-4d6f-94be-cbb2ae857be2 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:57.866957 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6ec5b022-763f-4d6f-94be-cbb2ae857be2 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:57.867676 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6ec5b022-763f-4d6f-94be-cbb2ae857be2 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:57.868122 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6ec5b022-763f-4d6f-94be-cbb2ae857be2 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:57.868620 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6ec5b022-763f-4d6f-94be-cbb2ae857be2 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:57.882401 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-6ec5b022-763f-4d6f-94be-cbb2ae857be2 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] HTTP exception thrown: Instance 5d82e610-a5cf-4a01-8a02-11b1c1ce9960 could not be found. Aug 27 03:27:57.884019 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6ec5b022-763f-4d6f-94be-cbb2ae857be2 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Request method failure captured: Aug 27 03:27:57.884019 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/servers/5d82e610-a5cf-4a01-8a02-11b1c1ce9960 HTTP/1.1 Aug 27 03:27:57.884019 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 03:27:57.884019 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 03:27:57.884019 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 03:27:57.884019 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 03:27:57.884019 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 03:27:57.884019 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 03:27:57.884019 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 03:27:57.884019 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 03:27:57.884019 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCYyanRmSitPtUh4DIDjvAfp5Iiwg8r3Bf9-rjIalvb44wIYhFzVkZDLPIdVwR9rbE-qHDjS_3-JeB9MrxSXFOtiOWUfHFokH2CMOJ34en6s6KyuDM-ix0my9F59eD8M1zowb_BqVFIaTj9p6YHs85SeVo0SCpB1hAOakQSi3_cd8UVk Aug 27 03:27:57.884019 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 03:27:57.884019 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 03:27:57.884019 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 03:27:57.884019 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 03:27:57.884019 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 03:27:57.884019 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 03:27:57.884019 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 7b2673a034c24d1898493bfea9ca5d1d Aug 27 03:27:57.884019 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-TestVolumeBootPattern-2103223700 Aug 27 03:27:57.884019 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 03:27:57.884019 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 03:27:57.884019 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7b2673a034c24d1898493bfea9ca5d1d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_7b2673a034c24d1898493bfea9ca5d1d", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7b2673a034c24d1898493bfea9ca5d1d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/7b2673a034c24d1898493bfea9ca5d1d"}]}] Aug 27 03:27:57.884019 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-TestVolumeBootPattern-2103223700 Aug 27 03:27:57.884019 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 7b2673a034c24d1898493bfea9ca5d1d Aug 27 03:27:57.884019 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-TestVolumeBootPattern-2103223700 Aug 27 03:27:57.884019 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-TestVolumeBootPattern-2103223700-project Aug 27 03:27:57.884019 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 03:27:57.884019 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 03:27:57.884019 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 4aa867d7baa043b1b1e6763046463b3f Aug 27 03:27:57.884019 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-TestVolumeBootPattern-2103223700-project Aug 27 03:27:57.884019 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 03:27:57.884019 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance 5d82e610-a5cf-4a01-8a02-11b1c1ce9960 could not be found. Aug 27 03:27:57.884019 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '5d82e610-a5cf-4a01-8a02-11b1c1ce9960'} Aug 27 03:27:57.884019 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:27:57.884019 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:27:57.884019 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:27:57.884019 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:27:57.884019 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:27:57.884019 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:27:57.884019 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:27:57.884019 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:27:57.884019 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:27:57.884019 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:27:57.884019 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d82e610-a5cf-4a01-8a02-11b1c1ce9960 could not be found. Aug 27 03:27:57.884019 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:27:57.884019 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:27:57.884019 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:27:57.884019 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:27:57.884019 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:27:57.884019 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:27:57.884019 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:27:57.884019 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:27:57.884019 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:27:57.884019 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:27:57.884019 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:27:57.884019 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:27:57.884019 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:27:57.884019 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:27:57.884019 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:27:57.884019 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:27:57.884019 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d82e610-a5cf-4a01-8a02-11b1c1ce9960 could not be found. Aug 27 03:27:57.884019 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:27:57.884019 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:27:57.884019 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:27:57.889306 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:27:57.889306 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:27:57.889306 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:27:57.889306 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:27:57.889306 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:27:57.889306 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d82e610-a5cf-4a01-8a02-11b1c1ce9960 could not be found. Aug 27 03:27:57.889306 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:27:57.889306 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6ec5b022-763f-4d6f-94be-cbb2ae857be2 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Returning 404 to user: Instance 5d82e610-a5cf-4a01-8a02-11b1c1ce9960 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:27:57.889306 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-6ec5b022-763f-4d6f-94be-cbb2ae857be2 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "GET /compute/v2.1/servers/5d82e610-a5cf-4a01-8a02-11b1c1ce9960" status: 404 len: 111 microversion: 2.1 time: 0.030729 Aug 27 03:27:57.889306 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3001/6041] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:57 2022] GET /compute/v2.1/servers/5d82e610-a5cf-4a01-8a02-11b1c1ce9960 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:27:58.327519 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e558d85e-2435-4492-ab27-c125263757b8 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:27:58.329731 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-e558d85e-2435-4492-ab27-c125263757b8 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 34b22982-c465-4e12-911e-e89242907b8e] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:58.336441 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e558d85e-2435-4492-ab27-c125263757b8 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:58.336946 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e558d85e-2435-4492-ab27-c125263757b8 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:58.337404 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e558d85e-2435-4492-ab27-c125263757b8 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:58.338125 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e558d85e-2435-4492-ab27-c125263757b8 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:58.338600 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e558d85e-2435-4492-ab27-c125263757b8 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:58.339049 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e558d85e-2435-4492-ab27-c125263757b8 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:58.406398 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e558d85e-2435-4492-ab27-c125263757b8 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "POST /compute/v2.1/servers/34b22982-c465-4e12-911e-e89242907b8e/action" status: 200 len: 24568 microversion: 2.1 time: 0.082731 Aug 27 03:27:58.407065 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3041/6042] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:27:58 2022] POST /compute/v2.1/servers/34b22982-c465-4e12-911e-e89242907b8e/action => generated 24568 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:28:01.321752 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-1ec8cea4-c15c-4aa8-9d69-5e7b929aa993 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] Calling method '.version_select at 0x7f5ee2ce8820>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:01.357593 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-1ec8cea4-c15c-4aa8-9d69-5e7b929aa993 tempest-TestVolumeBootPattern-2103223700 tempest-TestVolumeBootPattern-2103223700-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1843061337" status: 202 len: 0 microversion: 2.1 time: 0.039326 Aug 27 03:28:01.358223 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3002/6043] 10.222.0.70 () {58 vars in 1263 bytes} [Sat Aug 27 03:28:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1843061337 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:28:09.450009 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-141d5428-951e-4d32-b5b8-21efc1cccf0c tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:09.450697 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-141d5428-951e-4d32-b5b8-21efc1cccf0c tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 34b22982-c465-4e12-911e-e89242907b8e] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:09.453590 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=17 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:28:09.454284 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=11 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:28:09.461308 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-141d5428-951e-4d32-b5b8-21efc1cccf0c tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:09.461816 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-141d5428-951e-4d32-b5b8-21efc1cccf0c tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:09.462279 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-141d5428-951e-4d32-b5b8-21efc1cccf0c tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:09.463016 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-141d5428-951e-4d32-b5b8-21efc1cccf0c tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:09.463495 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-141d5428-951e-4d32-b5b8-21efc1cccf0c tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:09.463937 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-141d5428-951e-4d32-b5b8-21efc1cccf0c tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:09.608169 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-141d5428-951e-4d32-b5b8-21efc1cccf0c tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:09.618132 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-141d5428-951e-4d32-b5b8-21efc1cccf0c tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/34b22982-c465-4e12-911e-e89242907b8e" status: 200 len: 1683 microversion: 2.1 time: 0.173103 Aug 27 03:28:09.618729 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3042/6044] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:09 2022] GET /compute/v2.1/servers/34b22982-c465-4e12-911e-e89242907b8e => generated 1683 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:09.731434 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5282df91-0ce8-47d8-8c9b-68b0d88227fe tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:28:09.733739 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-5282df91-0ce8-47d8-8c9b-68b0d88227fe tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 34b22982-c465-4e12-911e-e89242907b8e] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:09.737008 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=10 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:28:09.737653 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:28:09.746279 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5282df91-0ce8-47d8-8c9b-68b0d88227fe tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:09.746907 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5282df91-0ce8-47d8-8c9b-68b0d88227fe tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:09.747566 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5282df91-0ce8-47d8-8c9b-68b0d88227fe tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:09.748713 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5282df91-0ce8-47d8-8c9b-68b0d88227fe tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:09.749386 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5282df91-0ce8-47d8-8c9b-68b0d88227fe tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:09.749987 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5282df91-0ce8-47d8-8c9b-68b0d88227fe tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:09.827640 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-5282df91-0ce8-47d8-8c9b-68b0d88227fe tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "POST /compute/v2.1/servers/34b22982-c465-4e12-911e-e89242907b8e/action" status: 200 len: 32643 microversion: 2.1 time: 0.099726 Aug 27 03:28:09.828986 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3003/6045] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:28:09 2022] POST /compute/v2.1/servers/34b22982-c465-4e12-911e-e89242907b8e/action => generated 32643 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 03:28:09.992566 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-5ba62f2d-7fea-42c1-af3c-49ae932557c4 tempest-TestNetworkAdvancedServerOps-1663634391 tempest-TestNetworkAdvancedServerOps-1663634391-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:09.993102 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-5ba62f2d-7fea-42c1-af3c-49ae932557c4 tempest-TestNetworkAdvancedServerOps-1663634391 tempest-TestNetworkAdvancedServerOps-1663634391-project-admin] [instance: 34b22982-c465-4e12-911e-e89242907b8e] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:10.000078 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5ba62f2d-7fea-42c1-af3c-49ae932557c4 tempest-TestNetworkAdvancedServerOps-1663634391 tempest-TestNetworkAdvancedServerOps-1663634391-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:10.000598 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5ba62f2d-7fea-42c1-af3c-49ae932557c4 tempest-TestNetworkAdvancedServerOps-1663634391 tempest-TestNetworkAdvancedServerOps-1663634391-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:10.001046 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5ba62f2d-7fea-42c1-af3c-49ae932557c4 tempest-TestNetworkAdvancedServerOps-1663634391 tempest-TestNetworkAdvancedServerOps-1663634391-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:10.001756 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5ba62f2d-7fea-42c1-af3c-49ae932557c4 tempest-TestNetworkAdvancedServerOps-1663634391 tempest-TestNetworkAdvancedServerOps-1663634391-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:10.002216 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5ba62f2d-7fea-42c1-af3c-49ae932557c4 tempest-TestNetworkAdvancedServerOps-1663634391 tempest-TestNetworkAdvancedServerOps-1663634391-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:10.002649 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5ba62f2d-7fea-42c1-af3c-49ae932557c4 tempest-TestNetworkAdvancedServerOps-1663634391 tempest-TestNetworkAdvancedServerOps-1663634391-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:10.138853 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-5ba62f2d-7fea-42c1-af3c-49ae932557c4 tempest-TestNetworkAdvancedServerOps-1663634391 tempest-TestNetworkAdvancedServerOps-1663634391-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/34b22982-c465-4e12-911e-e89242907b8e" status: 200 len: 1834 microversion: 2.1 time: 0.151899 Aug 27 03:28:10.139427 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3043/6046] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:09 2022] GET /compute/v2.1/servers/34b22982-c465-4e12-911e-e89242907b8e => generated 1834 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:10.167627 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f4609b12-0054-4395-8e8d-c78c65f327df tempest-TestNetworkAdvancedServerOps-1663634391 tempest-TestNetworkAdvancedServerOps-1663634391-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:28:10.170240 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-f4609b12-0054-4395-8e8d-c78c65f327df tempest-TestNetworkAdvancedServerOps-1663634391 tempest-TestNetworkAdvancedServerOps-1663634391-project-admin] [instance: 34b22982-c465-4e12-911e-e89242907b8e] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:10.178067 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f4609b12-0054-4395-8e8d-c78c65f327df tempest-TestNetworkAdvancedServerOps-1663634391 tempest-TestNetworkAdvancedServerOps-1663634391-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:10.178571 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f4609b12-0054-4395-8e8d-c78c65f327df tempest-TestNetworkAdvancedServerOps-1663634391 tempest-TestNetworkAdvancedServerOps-1663634391-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:10.179072 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f4609b12-0054-4395-8e8d-c78c65f327df tempest-TestNetworkAdvancedServerOps-1663634391 tempest-TestNetworkAdvancedServerOps-1663634391-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:10.179772 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f4609b12-0054-4395-8e8d-c78c65f327df tempest-TestNetworkAdvancedServerOps-1663634391 tempest-TestNetworkAdvancedServerOps-1663634391-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:10.180220 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f4609b12-0054-4395-8e8d-c78c65f327df tempest-TestNetworkAdvancedServerOps-1663634391 tempest-TestNetworkAdvancedServerOps-1663634391-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:10.180660 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f4609b12-0054-4395-8e8d-c78c65f327df tempest-TestNetworkAdvancedServerOps-1663634391 tempest-TestNetworkAdvancedServerOps-1663634391-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:10.210261 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.instance [None req-f4609b12-0054-4395-8e8d-c78c65f327df tempest-TestNetworkAdvancedServerOps-1663634391 tempest-TestNetworkAdvancedServerOps-1663634391-project-admin] Lazy-loading 'flavor' on Instance uuid 34b22982-c465-4e12-911e-e89242907b8e {{(pid=134052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:28:10.223462 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-f4609b12-0054-4395-8e8d-c78c65f327df tempest-TestNetworkAdvancedServerOps-1663634391 tempest-TestNetworkAdvancedServerOps-1663634391-project-admin] [instance: 34b22982-c465-4e12-911e-e89242907b8e] Going to try to live migrate instance to another host {{(pid=134052) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 27 03:28:11.462110 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f4609b12-0054-4395-8e8d-c78c65f327df tempest-TestNetworkAdvancedServerOps-1663634391 tempest-TestNetworkAdvancedServerOps-1663634391-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/34b22982-c465-4e12-911e-e89242907b8e/action" status: 202 len: 0 microversion: 2.1 time: 1.298593 Aug 27 03:28:11.462826 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3004/6047] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:28:10 2022] POST /compute/v2.1/servers/34b22982-c465-4e12-911e-e89242907b8e/action => generated 0 bytes in 1300 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:28:11.472174 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-db22ccb7-cab9-4e1b-9d38-7aeb0f2ab58e tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:11.472863 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-db22ccb7-cab9-4e1b-9d38-7aeb0f2ab58e tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 34b22982-c465-4e12-911e-e89242907b8e] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:11.480043 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-db22ccb7-cab9-4e1b-9d38-7aeb0f2ab58e tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:11.480654 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-db22ccb7-cab9-4e1b-9d38-7aeb0f2ab58e tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:11.481208 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-db22ccb7-cab9-4e1b-9d38-7aeb0f2ab58e tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:11.481974 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-db22ccb7-cab9-4e1b-9d38-7aeb0f2ab58e tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:11.482485 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-db22ccb7-cab9-4e1b-9d38-7aeb0f2ab58e tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:11.482959 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-db22ccb7-cab9-4e1b-9d38-7aeb0f2ab58e tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:11.631005 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-db22ccb7-cab9-4e1b-9d38-7aeb0f2ab58e tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:11.639699 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-db22ccb7-cab9-4e1b-9d38-7aeb0f2ab58e tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/34b22982-c465-4e12-911e-e89242907b8e" status: 200 len: 1693 microversion: 2.1 time: 0.171655 Aug 27 03:28:11.640289 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3044/6048] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:11 2022] GET /compute/v2.1/servers/34b22982-c465-4e12-911e-e89242907b8e => generated 1693 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:12.573202 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-8cb457e2-e82f-401e-9ba1-7b83da966993 req-865330e1-7823-45f9-9773-7d84a5994624 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34b22982-c465-4e12-911e-e89242907b8e", "name": "network-vif-unplugged", "status": "completed", "tag": "86d28938-69c1-4403-b70e-6fd97ab0daf8"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:28:12.585141 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-8cb457e2-e82f-401e-9ba1-7b83da966993 req-865330e1-7823-45f9-9773-7d84a5994624 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:12.585653 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-8cb457e2-e82f-401e-9ba1-7b83da966993 req-865330e1-7823-45f9-9773-7d84a5994624 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:12.586109 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-8cb457e2-e82f-401e-9ba1-7b83da966993 req-865330e1-7823-45f9-9773-7d84a5994624 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:12.597335 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-8cb457e2-e82f-401e-9ba1-7b83da966993 req-865330e1-7823-45f9-9773-7d84a5994624 service nova] Creating event network-vif-unplugged:86d28938-69c1-4403-b70e-6fd97ab0daf8 for instance 34b22982-c465-4e12-911e-e89242907b8e on n-h1-852278-4 Aug 27 03:28:12.602608 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-8cb457e2-e82f-401e-9ba1-7b83da966993 req-865330e1-7823-45f9-9773-7d84a5994624 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033848 Aug 27 03:28:12.603418 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3005/6049] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:28:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:28:12.661602 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-44a68528-4e3f-419b-a3bf-f80b2655418f tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:12.662235 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-44a68528-4e3f-419b-a3bf-f80b2655418f tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 34b22982-c465-4e12-911e-e89242907b8e] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:12.669281 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-44a68528-4e3f-419b-a3bf-f80b2655418f tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:12.669782 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-44a68528-4e3f-419b-a3bf-f80b2655418f tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:12.670226 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-44a68528-4e3f-419b-a3bf-f80b2655418f tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:12.670938 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-44a68528-4e3f-419b-a3bf-f80b2655418f tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:12.671397 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-44a68528-4e3f-419b-a3bf-f80b2655418f tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:12.671882 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-44a68528-4e3f-419b-a3bf-f80b2655418f tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:12.873719 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-44a68528-4e3f-419b-a3bf-f80b2655418f tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:12.883861 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-44a68528-4e3f-419b-a3bf-f80b2655418f tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/34b22982-c465-4e12-911e-e89242907b8e" status: 200 len: 1693 microversion: 2.1 time: 0.226118 Aug 27 03:28:12.884534 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3045/6050] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:12 2022] GET /compute/v2.1/servers/34b22982-c465-4e12-911e-e89242907b8e => generated 1693 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:13.912006 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a2f02f96-2997-4d91-a679-b1666f4d09e9 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:13.913330 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a2f02f96-2997-4d91-a679-b1666f4d09e9 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 34b22982-c465-4e12-911e-e89242907b8e] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:13.920242 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a2f02f96-2997-4d91-a679-b1666f4d09e9 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:13.920751 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a2f02f96-2997-4d91-a679-b1666f4d09e9 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:13.921179 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a2f02f96-2997-4d91-a679-b1666f4d09e9 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:13.921976 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a2f02f96-2997-4d91-a679-b1666f4d09e9 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:13.922402 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a2f02f96-2997-4d91-a679-b1666f4d09e9 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:13.922820 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a2f02f96-2997-4d91-a679-b1666f4d09e9 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:14.069085 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-a2f02f96-2997-4d91-a679-b1666f4d09e9 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:14.081810 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a2f02f96-2997-4d91-a679-b1666f4d09e9 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/34b22982-c465-4e12-911e-e89242907b8e" status: 200 len: 1693 microversion: 2.1 time: 0.178195 Aug 27 03:28:14.082637 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3006/6051] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:13 2022] GET /compute/v2.1/servers/34b22982-c465-4e12-911e-e89242907b8e => generated 1693 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:14.652997 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-67bb4551-f386-42d7-925b-db29a300dbeb req-0f3d60f1-895a-42ac-a962-2a6c10d4efdb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34b22982-c465-4e12-911e-e89242907b8e", "tag": "86d28938-69c1-4403-b70e-6fd97ab0daf8"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:28:14.667805 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-67bb4551-f386-42d7-925b-db29a300dbeb req-0f3d60f1-895a-42ac-a962-2a6c10d4efdb service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:14.668291 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-67bb4551-f386-42d7-925b-db29a300dbeb req-0f3d60f1-895a-42ac-a962-2a6c10d4efdb service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:14.668775 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-67bb4551-f386-42d7-925b-db29a300dbeb req-0f3d60f1-895a-42ac-a962-2a6c10d4efdb service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:14.680914 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-67bb4551-f386-42d7-925b-db29a300dbeb req-0f3d60f1-895a-42ac-a962-2a6c10d4efdb service nova] Creating event network-changed:86d28938-69c1-4403-b70e-6fd97ab0daf8 for instance 34b22982-c465-4e12-911e-e89242907b8e on n-h1-852278-4 Aug 27 03:28:14.686263 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-67bb4551-f386-42d7-925b-db29a300dbeb req-0f3d60f1-895a-42ac-a962-2a6c10d4efdb service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039544 Aug 27 03:28:14.686862 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3046/6052] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:28:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:28:15.105531 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-1f60ec0c-70b0-419e-bab3-4eed47e728cd tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:15.106148 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-1f60ec0c-70b0-419e-bab3-4eed47e728cd tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 34b22982-c465-4e12-911e-e89242907b8e] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:15.113461 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1f60ec0c-70b0-419e-bab3-4eed47e728cd tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:15.113947 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1f60ec0c-70b0-419e-bab3-4eed47e728cd tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:15.114373 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1f60ec0c-70b0-419e-bab3-4eed47e728cd tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:15.115072 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1f60ec0c-70b0-419e-bab3-4eed47e728cd tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:15.115514 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1f60ec0c-70b0-419e-bab3-4eed47e728cd tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:15.115931 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1f60ec0c-70b0-419e-bab3-4eed47e728cd tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:15.615764 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-1f60ec0c-70b0-419e-bab3-4eed47e728cd tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:15.624130 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-1f60ec0c-70b0-419e-bab3-4eed47e728cd tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/34b22982-c465-4e12-911e-e89242907b8e" status: 200 len: 1693 microversion: 2.1 time: 0.522499 Aug 27 03:28:15.624776 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3007/6053] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:15 2022] GET /compute/v2.1/servers/34b22982-c465-4e12-911e-e89242907b8e => generated 1693 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:16.651053 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-90014b9a-ebf3-4cb3-8559-a37b3fa5e817 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:16.651794 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-90014b9a-ebf3-4cb3-8559-a37b3fa5e817 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 34b22982-c465-4e12-911e-e89242907b8e] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:16.658699 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-90014b9a-ebf3-4cb3-8559-a37b3fa5e817 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:16.659205 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-90014b9a-ebf3-4cb3-8559-a37b3fa5e817 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:16.659660 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-90014b9a-ebf3-4cb3-8559-a37b3fa5e817 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:16.660422 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-90014b9a-ebf3-4cb3-8559-a37b3fa5e817 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:16.660896 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-90014b9a-ebf3-4cb3-8559-a37b3fa5e817 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:16.661365 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-90014b9a-ebf3-4cb3-8559-a37b3fa5e817 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:16.810356 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-90014b9a-ebf3-4cb3-8559-a37b3fa5e817 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:16.818842 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-90014b9a-ebf3-4cb3-8559-a37b3fa5e817 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/34b22982-c465-4e12-911e-e89242907b8e" status: 200 len: 1693 microversion: 2.1 time: 0.174438 Aug 27 03:28:16.819527 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3047/6054] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:16 2022] GET /compute/v2.1/servers/34b22982-c465-4e12-911e-e89242907b8e => generated 1693 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:17.840063 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9753d6e5-dbbf-402a-b217-fe0e5f2a59bb tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:17.840761 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-9753d6e5-dbbf-402a-b217-fe0e5f2a59bb tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 34b22982-c465-4e12-911e-e89242907b8e] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:17.847965 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9753d6e5-dbbf-402a-b217-fe0e5f2a59bb tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:17.848479 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9753d6e5-dbbf-402a-b217-fe0e5f2a59bb tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:17.848916 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9753d6e5-dbbf-402a-b217-fe0e5f2a59bb tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:17.849616 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9753d6e5-dbbf-402a-b217-fe0e5f2a59bb tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:17.850065 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9753d6e5-dbbf-402a-b217-fe0e5f2a59bb tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:17.850504 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9753d6e5-dbbf-402a-b217-fe0e5f2a59bb tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:18.063504 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-9753d6e5-dbbf-402a-b217-fe0e5f2a59bb tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:18.072145 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9753d6e5-dbbf-402a-b217-fe0e5f2a59bb tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/34b22982-c465-4e12-911e-e89242907b8e" status: 200 len: 1693 microversion: 2.1 time: 0.236514 Aug 27 03:28:18.072872 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3008/6055] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:17 2022] GET /compute/v2.1/servers/34b22982-c465-4e12-911e-e89242907b8e => generated 1693 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:19.096062 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-2b94c133-45c2-40cf-be20-8e1ca9f6d816 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:19.096744 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-2b94c133-45c2-40cf-be20-8e1ca9f6d816 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 34b22982-c465-4e12-911e-e89242907b8e] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:19.104348 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2b94c133-45c2-40cf-be20-8e1ca9f6d816 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:19.104890 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2b94c133-45c2-40cf-be20-8e1ca9f6d816 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:19.105335 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2b94c133-45c2-40cf-be20-8e1ca9f6d816 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:19.106053 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2b94c133-45c2-40cf-be20-8e1ca9f6d816 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:19.106531 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2b94c133-45c2-40cf-be20-8e1ca9f6d816 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:19.106969 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2b94c133-45c2-40cf-be20-8e1ca9f6d816 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:19.321951 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-2b94c133-45c2-40cf-be20-8e1ca9f6d816 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:19.330154 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-2b94c133-45c2-40cf-be20-8e1ca9f6d816 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/34b22982-c465-4e12-911e-e89242907b8e" status: 200 len: 1693 microversion: 2.1 time: 0.239886 Aug 27 03:28:19.330765 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3048/6056] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:19 2022] GET /compute/v2.1/servers/34b22982-c465-4e12-911e-e89242907b8e => generated 1693 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:20.351214 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-498075ee-a27b-40b2-bb76-c54dd5617665 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:20.351863 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-498075ee-a27b-40b2-bb76-c54dd5617665 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 34b22982-c465-4e12-911e-e89242907b8e] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:20.359391 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-498075ee-a27b-40b2-bb76-c54dd5617665 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:20.359878 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-498075ee-a27b-40b2-bb76-c54dd5617665 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:20.360334 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-498075ee-a27b-40b2-bb76-c54dd5617665 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:20.361048 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-498075ee-a27b-40b2-bb76-c54dd5617665 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:20.361497 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-498075ee-a27b-40b2-bb76-c54dd5617665 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:20.361907 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-498075ee-a27b-40b2-bb76-c54dd5617665 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:20.512077 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-498075ee-a27b-40b2-bb76-c54dd5617665 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:20.524809 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-498075ee-a27b-40b2-bb76-c54dd5617665 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/34b22982-c465-4e12-911e-e89242907b8e" status: 200 len: 1683 microversion: 2.1 time: 0.177129 Aug 27 03:28:20.525685 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3009/6057] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:20 2022] GET /compute/v2.1/servers/34b22982-c465-4e12-911e-e89242907b8e => generated 1683 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:20.550402 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-64800d97-f77f-4645-9236-49035d9724b8 tempest-TestNetworkAdvancedServerOps-1663634391 tempest-TestNetworkAdvancedServerOps-1663634391-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:20.551104 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-64800d97-f77f-4645-9236-49035d9724b8 tempest-TestNetworkAdvancedServerOps-1663634391 tempest-TestNetworkAdvancedServerOps-1663634391-project-admin] [instance: 34b22982-c465-4e12-911e-e89242907b8e] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:20.559161 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-64800d97-f77f-4645-9236-49035d9724b8 tempest-TestNetworkAdvancedServerOps-1663634391 tempest-TestNetworkAdvancedServerOps-1663634391-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:20.559743 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-64800d97-f77f-4645-9236-49035d9724b8 tempest-TestNetworkAdvancedServerOps-1663634391 tempest-TestNetworkAdvancedServerOps-1663634391-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:20.560266 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-64800d97-f77f-4645-9236-49035d9724b8 tempest-TestNetworkAdvancedServerOps-1663634391 tempest-TestNetworkAdvancedServerOps-1663634391-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:20.561135 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-64800d97-f77f-4645-9236-49035d9724b8 tempest-TestNetworkAdvancedServerOps-1663634391 tempest-TestNetworkAdvancedServerOps-1663634391-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:20.561648 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-64800d97-f77f-4645-9236-49035d9724b8 tempest-TestNetworkAdvancedServerOps-1663634391 tempest-TestNetworkAdvancedServerOps-1663634391-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:20.562095 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-64800d97-f77f-4645-9236-49035d9724b8 tempest-TestNetworkAdvancedServerOps-1663634391 tempest-TestNetworkAdvancedServerOps-1663634391-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:20.693754 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-64800d97-f77f-4645-9236-49035d9724b8 tempest-TestNetworkAdvancedServerOps-1663634391 tempest-TestNetworkAdvancedServerOps-1663634391-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/34b22982-c465-4e12-911e-e89242907b8e" status: 200 len: 1834 microversion: 2.1 time: 0.147087 Aug 27 03:28:20.694337 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3049/6058] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:20 2022] GET /compute/v2.1/servers/34b22982-c465-4e12-911e-e89242907b8e => generated 1834 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:20.715501 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6788b28f-3b0d-4eed-bc4a-e40673925569 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:20.716040 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-6788b28f-3b0d-4eed-bc4a-e40673925569 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 34b22982-c465-4e12-911e-e89242907b8e] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:20.722215 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6788b28f-3b0d-4eed-bc4a-e40673925569 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:20.722707 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6788b28f-3b0d-4eed-bc4a-e40673925569 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:20.723141 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6788b28f-3b0d-4eed-bc4a-e40673925569 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:20.723860 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6788b28f-3b0d-4eed-bc4a-e40673925569 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:20.724318 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6788b28f-3b0d-4eed-bc4a-e40673925569 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:20.724759 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6788b28f-3b0d-4eed-bc4a-e40673925569 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:20.868691 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-6788b28f-3b0d-4eed-bc4a-e40673925569 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:20.877119 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-6788b28f-3b0d-4eed-bc4a-e40673925569 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/34b22982-c465-4e12-911e-e89242907b8e" status: 200 len: 1683 microversion: 2.1 time: 0.165637 Aug 27 03:28:20.877711 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3010/6059] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:20 2022] GET /compute/v2.1/servers/34b22982-c465-4e12-911e-e89242907b8e => generated 1683 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:20.974980 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7eaa609e-2c0c-499d-a99b-e2357fe0fa94 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:28:20.977253 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-7eaa609e-2c0c-499d-a99b-e2357fe0fa94 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 34b22982-c465-4e12-911e-e89242907b8e] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:20.983616 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7eaa609e-2c0c-499d-a99b-e2357fe0fa94 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:20.984121 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7eaa609e-2c0c-499d-a99b-e2357fe0fa94 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:20.984626 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7eaa609e-2c0c-499d-a99b-e2357fe0fa94 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:20.985353 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7eaa609e-2c0c-499d-a99b-e2357fe0fa94 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:20.985827 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7eaa609e-2c0c-499d-a99b-e2357fe0fa94 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:20.986275 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7eaa609e-2c0c-499d-a99b-e2357fe0fa94 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:21.039475 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-7eaa609e-2c0c-499d-a99b-e2357fe0fa94 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "POST /compute/v2.1/servers/34b22982-c465-4e12-911e-e89242907b8e/action" status: 200 len: 38648 microversion: 2.1 time: 0.068479 Aug 27 03:28:21.040157 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3050/6060] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:28:20 2022] POST /compute/v2.1/servers/34b22982-c465-4e12-911e-e89242907b8e/action => generated 38648 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:28:22.344338 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-690ef519-9511-4bc2-a8a6-509ff59ecdaf tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:22.344875 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-690ef519-9511-4bc2-a8a6-509ff59ecdaf tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 34b22982-c465-4e12-911e-e89242907b8e] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:22.350559 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-144d461f-7bb0-47f1-9c22-d2553047dde9 req-430c3fbb-c3c3-48c2-8a1d-d323ea749378 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34b22982-c465-4e12-911e-e89242907b8e", "tag": "86d28938-69c1-4403-b70e-6fd97ab0daf8"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:28:22.366476 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-144d461f-7bb0-47f1-9c22-d2553047dde9 req-430c3fbb-c3c3-48c2-8a1d-d323ea749378 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:22.367028 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-144d461f-7bb0-47f1-9c22-d2553047dde9 req-430c3fbb-c3c3-48c2-8a1d-d323ea749378 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:22.367490 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-144d461f-7bb0-47f1-9c22-d2553047dde9 req-430c3fbb-c3c3-48c2-8a1d-d323ea749378 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:22.369771 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-690ef519-9511-4bc2-a8a6-509ff59ecdaf tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:22.369771 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-690ef519-9511-4bc2-a8a6-509ff59ecdaf tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:22.369771 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-690ef519-9511-4bc2-a8a6-509ff59ecdaf tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:22.369771 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-690ef519-9511-4bc2-a8a6-509ff59ecdaf tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:22.370201 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-690ef519-9511-4bc2-a8a6-509ff59ecdaf tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:22.370515 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-690ef519-9511-4bc2-a8a6-509ff59ecdaf tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:22.378963 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-144d461f-7bb0-47f1-9c22-d2553047dde9 req-430c3fbb-c3c3-48c2-8a1d-d323ea749378 service nova] Creating event network-changed:86d28938-69c1-4403-b70e-6fd97ab0daf8 for instance 34b22982-c465-4e12-911e-e89242907b8e on n-h2-852278-4 Aug 27 03:28:22.384217 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-144d461f-7bb0-47f1-9c22-d2553047dde9 req-430c3fbb-c3c3-48c2-8a1d-d323ea749378 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037729 Aug 27 03:28:22.385099 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3051/6061] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:28:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:28:22.398513 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-690ef519-9511-4bc2-a8a6-509ff59ecdaf tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 34b22982-c465-4e12-911e-e89242907b8e] Going to try to terminate instance {{(pid=134052) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:28:22.494216 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-690ef519-9511-4bc2-a8a6-509ff59ecdaf tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "DELETE /compute/v2.1/servers/34b22982-c465-4e12-911e-e89242907b8e" status: 204 len: 0 microversion: 2.1 time: 0.153745 Aug 27 03:28:22.495484 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3011/6062] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 03:28:22 2022] DELETE /compute/v2.1/servers/34b22982-c465-4e12-911e-e89242907b8e => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:28:22.505208 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d5324231-2e82-4367-ab2e-21dd260adb97 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:22.505927 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d5324231-2e82-4367-ab2e-21dd260adb97 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 34b22982-c465-4e12-911e-e89242907b8e] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:22.520225 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d5324231-2e82-4367-ab2e-21dd260adb97 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:22.520821 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d5324231-2e82-4367-ab2e-21dd260adb97 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:22.521370 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d5324231-2e82-4367-ab2e-21dd260adb97 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:22.522074 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d5324231-2e82-4367-ab2e-21dd260adb97 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:22.522546 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d5324231-2e82-4367-ab2e-21dd260adb97 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:22.523152 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d5324231-2e82-4367-ab2e-21dd260adb97 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:22.681996 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d5324231-2e82-4367-ab2e-21dd260adb97 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:22.690680 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d5324231-2e82-4367-ab2e-21dd260adb97 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/34b22982-c465-4e12-911e-e89242907b8e" status: 200 len: 1689 microversion: 2.1 time: 0.190233 Aug 27 03:28:22.691283 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3052/6063] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:22 2022] GET /compute/v2.1/servers/34b22982-c465-4e12-911e-e89242907b8e => generated 1689 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:23.673342 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-efe50b28-41a8-45aa-9276-babaa379872b req-4da4280a-5fae-4193-856d-421ef89ea1c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34b22982-c465-4e12-911e-e89242907b8e", "name": "network-vif-deleted", "tag": "86d28938-69c1-4403-b70e-6fd97ab0daf8"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:28:23.685332 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-efe50b28-41a8-45aa-9276-babaa379872b req-4da4280a-5fae-4193-856d-421ef89ea1c7 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:23.685808 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-efe50b28-41a8-45aa-9276-babaa379872b req-4da4280a-5fae-4193-856d-421ef89ea1c7 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:23.686233 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-efe50b28-41a8-45aa-9276-babaa379872b req-4da4280a-5fae-4193-856d-421ef89ea1c7 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:23.697173 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-efe50b28-41a8-45aa-9276-babaa379872b req-4da4280a-5fae-4193-856d-421ef89ea1c7 service nova] Creating event network-vif-deleted:86d28938-69c1-4403-b70e-6fd97ab0daf8 for instance 34b22982-c465-4e12-911e-e89242907b8e on n-h2-852278-4 Aug 27 03:28:23.702362 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-efe50b28-41a8-45aa-9276-babaa379872b req-4da4280a-5fae-4193-856d-421ef89ea1c7 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033303 Aug 27 03:28:23.702983 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3012/6064] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:28:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:28:23.712467 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-de3af503-5fc2-416a-987a-30f5321c83c1 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:23.713101 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-de3af503-5fc2-416a-987a-30f5321c83c1 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 34b22982-c465-4e12-911e-e89242907b8e] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:23.720255 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-de3af503-5fc2-416a-987a-30f5321c83c1 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:23.720828 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-de3af503-5fc2-416a-987a-30f5321c83c1 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:23.721287 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-de3af503-5fc2-416a-987a-30f5321c83c1 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:23.722063 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-de3af503-5fc2-416a-987a-30f5321c83c1 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:23.722533 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-de3af503-5fc2-416a-987a-30f5321c83c1 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:23.722982 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-de3af503-5fc2-416a-987a-30f5321c83c1 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:23.787322 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-de3af503-5fc2-416a-987a-30f5321c83c1 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:23.795316 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-de3af503-5fc2-416a-987a-30f5321c83c1 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/34b22982-c465-4e12-911e-e89242907b8e" status: 200 len: 1352 microversion: 2.1 time: 0.086939 Aug 27 03:28:23.795972 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3053/6065] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:23 2022] GET /compute/v2.1/servers/34b22982-c465-4e12-911e-e89242907b8e => generated 1352 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:24.823575 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-dd6fbf17-5a76-40e3-a653-1280381bcb87 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:24.824589 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-dd6fbf17-5a76-40e3-a653-1280381bcb87 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: 34b22982-c465-4e12-911e-e89242907b8e] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:24.835217 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dd6fbf17-5a76-40e3-a653-1280381bcb87 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:24.835870 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dd6fbf17-5a76-40e3-a653-1280381bcb87 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:24.836339 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dd6fbf17-5a76-40e3-a653-1280381bcb87 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:24.837031 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dd6fbf17-5a76-40e3-a653-1280381bcb87 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:24.837484 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dd6fbf17-5a76-40e3-a653-1280381bcb87 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:24.837904 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dd6fbf17-5a76-40e3-a653-1280381bcb87 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:24.853078 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-dd6fbf17-5a76-40e3-a653-1280381bcb87 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] HTTP exception thrown: Instance 34b22982-c465-4e12-911e-e89242907b8e could not be found. Aug 27 03:28:24.854716 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-dd6fbf17-5a76-40e3-a653-1280381bcb87 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Request method failure captured: Aug 27 03:28:24.854716 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/servers/34b22982-c465-4e12-911e-e89242907b8e HTTP/1.1 Aug 27 03:28:24.854716 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 03:28:24.854716 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 03:28:24.854716 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 03:28:24.854716 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 03:28:24.854716 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 03:28:24.854716 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 03:28:24.854716 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 03:28:24.854716 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 03:28:24.854716 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCY4rjgLXIvNBrh9kN4jnznC50AQ6KjWReTgkO1jga9yr7NY-gC8VrzURbe59WZrBpXWePgbVKRMS_e_UPOGvs6kq6xALqK2obNolZqn3ouGxdOKXhnIHVg8gyE_jgUU-tIsjIbg-aNo9qlCKhh6olDObIY67Z71HecsvikaMrjLi4nk Aug 27 03:28:24.854716 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 03:28:24.854716 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 03:28:24.854716 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 03:28:24.854716 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 03:28:24.854716 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 03:28:24.854716 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 03:28:24.854716 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 659b0cee2ff841049f41c7ce12609fc8 Aug 27 03:28:24.854716 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1769414468 Aug 27 03:28:24.854716 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 03:28:24.854716 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 03:28:24.854716 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/659b0cee2ff841049f41c7ce12609fc8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_659b0cee2ff841049f41c7ce12609fc8", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/659b0cee2ff841049f41c7ce12609fc8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/659b0cee2ff841049f41c7ce12609fc8"}]}] Aug 27 03:28:24.854716 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1769414468 Aug 27 03:28:24.854716 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 659b0cee2ff841049f41c7ce12609fc8 Aug 27 03:28:24.854716 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1769414468 Aug 27 03:28:24.854716 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-TestNetworkAdvancedServerOps-1769414468-project Aug 27 03:28:24.854716 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 03:28:24.854716 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 03:28:24.854716 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 36e9eab0eb7c421fa50b90e270847365 Aug 27 03:28:24.854716 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1769414468-project Aug 27 03:28:24.854716 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 03:28:24.854716 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance 34b22982-c465-4e12-911e-e89242907b8e could not be found. Aug 27 03:28:24.854716 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '34b22982-c465-4e12-911e-e89242907b8e'} Aug 27 03:28:24.854716 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:28:24.854716 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:28:24.854716 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:28:24.854716 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:28:24.854716 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:28:24.854716 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:28:24.854716 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:28:24.854716 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:28:24.854716 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:28:24.854716 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:28:24.854716 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34b22982-c465-4e12-911e-e89242907b8e could not be found. Aug 27 03:28:24.854716 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:28:24.854716 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:28:24.854716 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:28:24.854716 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:28:24.854716 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:28:24.854716 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:28:24.854716 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:28:24.854716 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:28:24.854716 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:28:24.854716 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:28:24.854716 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:28:24.854716 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:28:24.854716 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:28:24.854716 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:28:24.854716 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:28:24.854716 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:28:24.854716 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34b22982-c465-4e12-911e-e89242907b8e could not be found. Aug 27 03:28:24.854716 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:28:24.854716 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:28:24.859387 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:28:24.859387 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:28:24.859387 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:28:24.859387 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:28:24.859387 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:28:24.859387 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:28:24.859387 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34b22982-c465-4e12-911e-e89242907b8e could not be found. Aug 27 03:28:24.859387 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:28:24.859387 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-dd6fbf17-5a76-40e3-a653-1280381bcb87 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Returning 404 to user: Instance 34b22982-c465-4e12-911e-e89242907b8e could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:28:24.859387 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-dd6fbf17-5a76-40e3-a653-1280381bcb87 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/34b22982-c465-4e12-911e-e89242907b8e" status: 404 len: 111 microversion: 2.1 time: 0.041380 Aug 27 03:28:24.859387 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3013/6066] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:24 2022] GET /compute/v2.1/servers/34b22982-c465-4e12-911e-e89242907b8e => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:28:27.871153 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-10f4d416-ae79-42a6-a16d-77d0f58b502f tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '.version_select at 0x7f5edeacf280>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:27.894131 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-10f4d416-ae79-42a6-a16d-77d0f58b502f tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1519017219" status: 202 len: 0 microversion: 2.1 time: 0.026924 Aug 27 03:28:27.894781 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3054/6067] 10.222.0.70 () {58 vars in 1284 bytes} [Sat Aug 27 03:28:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1519017219 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:28:27.924087 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b7ac7263-df43-4bf8-828f-f49997ad4a27 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Action: 'create', calling method: .version_select at 0x7f5ee2c84d30>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-129643637", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHLZ5gbWhi3xsaYTInTWzWrscx6hf8yNt0RB1YipkP0GKhlJ0lMexz3f8tFzIK7yqKn7GDETxBijYNygQ6XMv4ZbUf0Owr5NNFLnj8MYKRrUgCEoY3zQnNBYy4ewu4j3mg=="}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:28:27.940837 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-b7ac7263-df43-4bf8-828f-f49997ad4a27 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Getting quotas for project 659b0cee2ff841049f41c7ce12609fc8. Resources: {'key_pairs'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:28:27.947611 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-b7ac7263-df43-4bf8-828f-f49997ad4a27 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Getting quotas for user 36e9eab0eb7c421fa50b90e270847365 and project 659b0cee2ff841049f41c7ce12609fc8. Resources: {'key_pairs'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:28:27.974616 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b7ac7263-df43-4bf8-828f-f49997ad4a27 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.054833 Aug 27 03:28:27.981498 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3014/6068] 10.222.0.70 () {60 vars in 1159 bytes} [Sat Aug 27 03:28:27 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:28:34.170624 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=62 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:28:34.174810 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-2fae37e7-496f-4d69-ac7d-0e43a4b9243a tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1820227928", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "networks": [{"uuid": "92b16fcb-e337-4b23-8af7-b9b0253fa3ef"}], "key_name": "tempest-TestNetworkAdvancedServerOps-129643637", "security_groups": [{"name": "tempest-secgroup-smoke-236388032"}]}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:28:34.295805 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.network.neutron [None req-2fae37e7-496f-4d69-ac7d-0e43a4b9243a tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] validate_networks() for [('92b16fcb-e337-4b23-8af7-b9b0253fa3ef', None, None, None, None, None)] {{(pid=134051) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:28:34.744160 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-2fae37e7-496f-4d69-ac7d-0e43a4b9243a tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Flavor limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:28:34.744621 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-2fae37e7-496f-4d69-ac7d-0e43a4b9243a tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Image limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:28:34.745116 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-2fae37e7-496f-4d69-ac7d-0e43a4b9243a tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Flavor pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:28:34.745548 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-2fae37e7-496f-4d69-ac7d-0e43a4b9243a tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Image pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:28:34.745983 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-2fae37e7-496f-4d69-ac7d-0e43a4b9243a tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:28:34.756023 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2fae37e7-496f-4d69-ac7d-0e43a4b9243a tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:34.756595 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2fae37e7-496f-4d69-ac7d-0e43a4b9243a tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:34.757114 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2fae37e7-496f-4d69-ac7d-0e43a4b9243a tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:34.757868 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2fae37e7-496f-4d69-ac7d-0e43a4b9243a tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:34.758338 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2fae37e7-496f-4d69-ac7d-0e43a4b9243a tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:34.758780 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2fae37e7-496f-4d69-ac7d-0e43a4b9243a tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:34.777003 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-2fae37e7-496f-4d69-ac7d-0e43a4b9243a tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Getting quotas for project 659b0cee2ff841049f41c7ce12609fc8. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:28:34.785467 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-2fae37e7-496f-4d69-ac7d-0e43a4b9243a tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Getting quotas for user 36e9eab0eb7c421fa50b90e270847365 and project 659b0cee2ff841049f41c7ce12609fc8. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:28:34.805235 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-2fae37e7-496f-4d69-ac7d-0e43a4b9243a tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Going to run 1 instances... {{(pid=134051) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:28:34.807685 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-2fae37e7-496f-4d69-ac7d-0e43a4b9243a tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: ea96ec49-12a3-46cc-b92d-2bb9936745b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134051) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:28:34.858109 n-d-852278-4 devstack@n-api.service[134051]: ERROR oslo.messaging._drivers.impl_rabbit [None req-2fae37e7-496f-4d69-ac7d-0e43a4b9243a tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [6698c758-4a05-41fa-9c20-a838e0029970] AMQP server on 10.222.0.70:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 27 03:28:35.868127 n-d-852278-4 devstack@n-api.service[134051]: INFO oslo.messaging._drivers.impl_rabbit [None req-2fae37e7-496f-4d69-ac7d-0e43a4b9243a tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [6698c758-4a05-41fa-9c20-a838e0029970] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 53744. Aug 27 03:28:35.873006 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-2fae37e7-496f-4d69-ac7d-0e43a4b9243a tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.704423 Aug 27 03:28:35.873989 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3055/6069] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 03:28:34 2022] POST /compute/v2.1/servers => generated 405 bytes in 1706 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:28:35.885232 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-db6ad274-b98b-489c-9fbf-ef0bde164b40 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:35.885827 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-db6ad274-b98b-489c-9fbf-ef0bde164b40 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: ea96ec49-12a3-46cc-b92d-2bb9936745b7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:35.890463 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:28:35.948762 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-db6ad274-b98b-489c-9fbf-ef0bde164b40 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:35.955972 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-db6ad274-b98b-489c-9fbf-ef0bde164b40 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/ea96ec49-12a3-46cc-b92d-2bb9936745b7" status: 200 len: 1266 microversion: 2.1 time: 0.074706 Aug 27 03:28:35.969296 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3015/6070] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:35 2022] GET /compute/v2.1/servers/ea96ec49-12a3-46cc-b92d-2bb9936745b7 => generated 1266 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:36.979425 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7f782976-5494-4b54-92a8-1ecc56cd069c tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:36.980067 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-7f782976-5494-4b54-92a8-1ecc56cd069c tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: ea96ec49-12a3-46cc-b92d-2bb9936745b7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:36.986968 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7f782976-5494-4b54-92a8-1ecc56cd069c tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:36.987526 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7f782976-5494-4b54-92a8-1ecc56cd069c tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:36.987985 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7f782976-5494-4b54-92a8-1ecc56cd069c tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:36.988755 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7f782976-5494-4b54-92a8-1ecc56cd069c tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:36.989225 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7f782976-5494-4b54-92a8-1ecc56cd069c tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:36.989696 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7f782976-5494-4b54-92a8-1ecc56cd069c tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:37.057281 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-7f782976-5494-4b54-92a8-1ecc56cd069c tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:37.066225 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-7f782976-5494-4b54-92a8-1ecc56cd069c tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/ea96ec49-12a3-46cc-b92d-2bb9936745b7" status: 200 len: 1318 microversion: 2.1 time: 0.092522 Aug 27 03:28:37.066815 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3056/6071] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:36 2022] GET /compute/v2.1/servers/ea96ec49-12a3-46cc-b92d-2bb9936745b7 => generated 1318 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:38.087551 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-309624e3-65cc-4f8b-82db-157415ab39b2 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:38.088123 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-309624e3-65cc-4f8b-82db-157415ab39b2 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: ea96ec49-12a3-46cc-b92d-2bb9936745b7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:38.095796 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-309624e3-65cc-4f8b-82db-157415ab39b2 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:38.096277 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-309624e3-65cc-4f8b-82db-157415ab39b2 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:38.096733 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-309624e3-65cc-4f8b-82db-157415ab39b2 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:38.097429 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-309624e3-65cc-4f8b-82db-157415ab39b2 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:38.098062 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-309624e3-65cc-4f8b-82db-157415ab39b2 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:38.098479 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-309624e3-65cc-4f8b-82db-157415ab39b2 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:38.291262 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-309624e3-65cc-4f8b-82db-157415ab39b2 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:38.299652 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-309624e3-65cc-4f8b-82db-157415ab39b2 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/ea96ec49-12a3-46cc-b92d-2bb9936745b7" status: 200 len: 1391 microversion: 2.1 time: 0.216195 Aug 27 03:28:38.300231 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3016/6072] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:38 2022] GET /compute/v2.1/servers/ea96ec49-12a3-46cc-b92d-2bb9936745b7 => generated 1391 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:38.719692 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-381ab385-772b-484f-8caa-e92e049d55a8 req-57709f3d-80a6-4f6e-afc7-823d954dcaf2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea96ec49-12a3-46cc-b92d-2bb9936745b7", "tag": "4c0dc71b-74ff-4cd5-a627-ac95c2071dc0"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:28:38.729472 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-381ab385-772b-484f-8caa-e92e049d55a8 req-57709f3d-80a6-4f6e-afc7-823d954dcaf2 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:38.729975 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-381ab385-772b-484f-8caa-e92e049d55a8 req-57709f3d-80a6-4f6e-afc7-823d954dcaf2 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:38.730425 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-381ab385-772b-484f-8caa-e92e049d55a8 req-57709f3d-80a6-4f6e-afc7-823d954dcaf2 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:38.741650 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-381ab385-772b-484f-8caa-e92e049d55a8 req-57709f3d-80a6-4f6e-afc7-823d954dcaf2 service nova] Creating event network-changed:4c0dc71b-74ff-4cd5-a627-ac95c2071dc0 for instance ea96ec49-12a3-46cc-b92d-2bb9936745b7 on n-h2-852278-4 Aug 27 03:28:38.746757 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-381ab385-772b-484f-8caa-e92e049d55a8 req-57709f3d-80a6-4f6e-afc7-823d954dcaf2 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.167553 Aug 27 03:28:38.747365 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3057/6073] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:28:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:28:39.321641 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-cf8de67b-e9c7-4dec-8333-972a4ba7713e tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:39.322295 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-cf8de67b-e9c7-4dec-8333-972a4ba7713e tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: ea96ec49-12a3-46cc-b92d-2bb9936745b7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:39.329590 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cf8de67b-e9c7-4dec-8333-972a4ba7713e tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:39.330087 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cf8de67b-e9c7-4dec-8333-972a4ba7713e tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:39.330523 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cf8de67b-e9c7-4dec-8333-972a4ba7713e tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:39.331235 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cf8de67b-e9c7-4dec-8333-972a4ba7713e tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:39.331690 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cf8de67b-e9c7-4dec-8333-972a4ba7713e tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:39.332112 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cf8de67b-e9c7-4dec-8333-972a4ba7713e tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:39.469222 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-cf8de67b-e9c7-4dec-8333-972a4ba7713e tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:39.477558 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-cf8de67b-e9c7-4dec-8333-972a4ba7713e tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/ea96ec49-12a3-46cc-b92d-2bb9936745b7" status: 200 len: 1391 microversion: 2.1 time: 0.160010 Aug 27 03:28:39.478191 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3017/6074] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:39 2022] GET /compute/v2.1/servers/ea96ec49-12a3-46cc-b92d-2bb9936745b7 => generated 1391 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:40.499402 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d64ac7c2-d4ff-4bee-9870-120626105f93 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:40.500057 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d64ac7c2-d4ff-4bee-9870-120626105f93 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: ea96ec49-12a3-46cc-b92d-2bb9936745b7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:40.502919 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=47,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:28:40.508906 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d64ac7c2-d4ff-4bee-9870-120626105f93 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:40.509409 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d64ac7c2-d4ff-4bee-9870-120626105f93 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:40.509872 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d64ac7c2-d4ff-4bee-9870-120626105f93 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:40.510585 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d64ac7c2-d4ff-4bee-9870-120626105f93 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:40.511048 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d64ac7c2-d4ff-4bee-9870-120626105f93 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:40.511534 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d64ac7c2-d4ff-4bee-9870-120626105f93 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:40.652931 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d64ac7c2-d4ff-4bee-9870-120626105f93 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:40.661065 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d64ac7c2-d4ff-4bee-9870-120626105f93 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/ea96ec49-12a3-46cc-b92d-2bb9936745b7" status: 200 len: 1391 microversion: 2.1 time: 0.166248 Aug 27 03:28:40.661659 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3058/6075] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:40 2022] GET /compute/v2.1/servers/ea96ec49-12a3-46cc-b92d-2bb9936745b7 => generated 1391 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:41.683033 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-82ee8dee-a2eb-4b8e-a978-abcd043f5ebc tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:41.683956 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-82ee8dee-a2eb-4b8e-a978-abcd043f5ebc tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: ea96ec49-12a3-46cc-b92d-2bb9936745b7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:41.686672 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:28:41.693441 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-82ee8dee-a2eb-4b8e-a978-abcd043f5ebc tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:41.694538 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-82ee8dee-a2eb-4b8e-a978-abcd043f5ebc tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:41.694981 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-82ee8dee-a2eb-4b8e-a978-abcd043f5ebc tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:41.695721 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-82ee8dee-a2eb-4b8e-a978-abcd043f5ebc tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:41.696194 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-82ee8dee-a2eb-4b8e-a978-abcd043f5ebc tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:41.696820 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-82ee8dee-a2eb-4b8e-a978-abcd043f5ebc tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:41.837165 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-82ee8dee-a2eb-4b8e-a978-abcd043f5ebc tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:41.845074 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-82ee8dee-a2eb-4b8e-a978-abcd043f5ebc tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/ea96ec49-12a3-46cc-b92d-2bb9936745b7" status: 200 len: 1391 microversion: 2.1 time: 0.166403 Aug 27 03:28:41.845706 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3018/6076] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:41 2022] GET /compute/v2.1/servers/ea96ec49-12a3-46cc-b92d-2bb9936745b7 => generated 1391 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:42.870108 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e6a50ef7-3af1-4869-a023-165ccb2fb239 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:42.871165 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-e6a50ef7-3af1-4869-a023-165ccb2fb239 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: ea96ec49-12a3-46cc-b92d-2bb9936745b7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:42.882777 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e6a50ef7-3af1-4869-a023-165ccb2fb239 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:42.883603 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e6a50ef7-3af1-4869-a023-165ccb2fb239 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:42.884474 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e6a50ef7-3af1-4869-a023-165ccb2fb239 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:42.885260 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e6a50ef7-3af1-4869-a023-165ccb2fb239 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:42.885700 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e6a50ef7-3af1-4869-a023-165ccb2fb239 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:42.886095 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e6a50ef7-3af1-4869-a023-165ccb2fb239 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:43.030078 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e6a50ef7-3af1-4869-a023-165ccb2fb239 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:43.041774 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e6a50ef7-3af1-4869-a023-165ccb2fb239 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/ea96ec49-12a3-46cc-b92d-2bb9936745b7" status: 200 len: 1391 microversion: 2.1 time: 0.178482 Aug 27 03:28:43.042359 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3059/6077] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:42 2022] GET /compute/v2.1/servers/ea96ec49-12a3-46cc-b92d-2bb9936745b7 => generated 1391 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:43.731248 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-cb72ffc2-1965-458c-b9d0-ea806bd600ca req-cdd9bcca-6fc4-412f-82ad-12c49fa4e0a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea96ec49-12a3-46cc-b92d-2bb9936745b7", "name": "network-vif-plugged", "status": "completed", "tag": "4c0dc71b-74ff-4cd5-a627-ac95c2071dc0"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:28:43.743058 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-cb72ffc2-1965-458c-b9d0-ea806bd600ca req-cdd9bcca-6fc4-412f-82ad-12c49fa4e0a6 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:43.743605 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-cb72ffc2-1965-458c-b9d0-ea806bd600ca req-cdd9bcca-6fc4-412f-82ad-12c49fa4e0a6 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:43.744876 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-cb72ffc2-1965-458c-b9d0-ea806bd600ca req-cdd9bcca-6fc4-412f-82ad-12c49fa4e0a6 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:43.756918 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-cb72ffc2-1965-458c-b9d0-ea806bd600ca req-cdd9bcca-6fc4-412f-82ad-12c49fa4e0a6 service nova] Creating event network-vif-plugged:4c0dc71b-74ff-4cd5-a627-ac95c2071dc0 for instance ea96ec49-12a3-46cc-b92d-2bb9936745b7 on n-h2-852278-4 Aug 27 03:28:43.762136 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-cb72ffc2-1965-458c-b9d0-ea806bd600ca req-cdd9bcca-6fc4-412f-82ad-12c49fa4e0a6 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034789 Aug 27 03:28:43.762793 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3019/6078] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:28:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:28:44.066296 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-1a80998a-bde2-4719-bb5c-3863c226ed20 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:44.067238 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-1a80998a-bde2-4719-bb5c-3863c226ed20 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: ea96ec49-12a3-46cc-b92d-2bb9936745b7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:44.078219 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1a80998a-bde2-4719-bb5c-3863c226ed20 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:44.078990 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1a80998a-bde2-4719-bb5c-3863c226ed20 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:44.079731 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1a80998a-bde2-4719-bb5c-3863c226ed20 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:44.080891 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1a80998a-bde2-4719-bb5c-3863c226ed20 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:44.081650 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1a80998a-bde2-4719-bb5c-3863c226ed20 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:44.082315 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1a80998a-bde2-4719-bb5c-3863c226ed20 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:44.222556 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-1a80998a-bde2-4719-bb5c-3863c226ed20 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:44.234125 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-1a80998a-bde2-4719-bb5c-3863c226ed20 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/ea96ec49-12a3-46cc-b92d-2bb9936745b7" status: 200 len: 1391 microversion: 2.1 time: 0.173710 Aug 27 03:28:44.234954 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3060/6079] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:44 2022] GET /compute/v2.1/servers/ea96ec49-12a3-46cc-b92d-2bb9936745b7 => generated 1391 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:45.259126 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d49429f2-2cb4-46f1-a5c1-91de39b68561 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:45.259841 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d49429f2-2cb4-46f1-a5c1-91de39b68561 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: ea96ec49-12a3-46cc-b92d-2bb9936745b7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:45.267507 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d49429f2-2cb4-46f1-a5c1-91de39b68561 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:45.268229 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d49429f2-2cb4-46f1-a5c1-91de39b68561 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:45.268715 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d49429f2-2cb4-46f1-a5c1-91de39b68561 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:45.269420 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d49429f2-2cb4-46f1-a5c1-91de39b68561 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:45.269874 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d49429f2-2cb4-46f1-a5c1-91de39b68561 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:45.270307 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d49429f2-2cb4-46f1-a5c1-91de39b68561 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:45.413352 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-d49429f2-2cb4-46f1-a5c1-91de39b68561 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:45.421860 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d49429f2-2cb4-46f1-a5c1-91de39b68561 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/ea96ec49-12a3-46cc-b92d-2bb9936745b7" status: 200 len: 1564 microversion: 2.1 time: 0.167187 Aug 27 03:28:45.422659 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3020/6080] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:45 2022] GET /compute/v2.1/servers/ea96ec49-12a3-46cc-b92d-2bb9936745b7 => generated 1564 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:45.442811 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-984cfd74-908e-4ddf-b5bb-a0ca2501232f tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:45.443322 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-984cfd74-908e-4ddf-b5bb-a0ca2501232f tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: ea96ec49-12a3-46cc-b92d-2bb9936745b7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:45.445275 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:28:45.445968 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=6 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:28:45.452724 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-984cfd74-908e-4ddf-b5bb-a0ca2501232f tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:45.453223 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-984cfd74-908e-4ddf-b5bb-a0ca2501232f tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:45.453677 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-984cfd74-908e-4ddf-b5bb-a0ca2501232f tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:45.454383 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-984cfd74-908e-4ddf-b5bb-a0ca2501232f tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:45.454843 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-984cfd74-908e-4ddf-b5bb-a0ca2501232f tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:45.455287 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-984cfd74-908e-4ddf-b5bb-a0ca2501232f tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:45.602408 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-984cfd74-908e-4ddf-b5bb-a0ca2501232f tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:45.610544 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-984cfd74-908e-4ddf-b5bb-a0ca2501232f tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/ea96ec49-12a3-46cc-b92d-2bb9936745b7" status: 200 len: 1564 microversion: 2.1 time: 0.171752 Aug 27 03:28:45.611137 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3061/6081] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:45 2022] GET /compute/v2.1/servers/ea96ec49-12a3-46cc-b92d-2bb9936745b7 => generated 1564 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:47.319309 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b0550021-a9fe-4a3f-be1c-f609d9d0cb92 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:47.319930 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b0550021-a9fe-4a3f-be1c-f609d9d0cb92 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: ea96ec49-12a3-46cc-b92d-2bb9936745b7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:47.322097 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=6 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:28:47.322601 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-55193ef4-e524-4cbd-b511-eb476a5dbc79 req-5d682bf6-d1d2-4d7f-957e-6217e8eeb490 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea96ec49-12a3-46cc-b92d-2bb9936745b7", "tag": "4c0dc71b-74ff-4cd5-a627-ac95c2071dc0"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:28:47.329433 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b0550021-a9fe-4a3f-be1c-f609d9d0cb92 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:47.329930 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b0550021-a9fe-4a3f-be1c-f609d9d0cb92 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:47.330372 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b0550021-a9fe-4a3f-be1c-f609d9d0cb92 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:47.331085 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b0550021-a9fe-4a3f-be1c-f609d9d0cb92 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:47.331537 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b0550021-a9fe-4a3f-be1c-f609d9d0cb92 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:47.332199 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b0550021-a9fe-4a3f-be1c-f609d9d0cb92 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:47.338119 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-55193ef4-e524-4cbd-b511-eb476a5dbc79 req-5d682bf6-d1d2-4d7f-957e-6217e8eeb490 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:47.338675 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-55193ef4-e524-4cbd-b511-eb476a5dbc79 req-5d682bf6-d1d2-4d7f-957e-6217e8eeb490 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:47.339128 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-55193ef4-e524-4cbd-b511-eb476a5dbc79 req-5d682bf6-d1d2-4d7f-957e-6217e8eeb490 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:47.350691 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-55193ef4-e524-4cbd-b511-eb476a5dbc79 req-5d682bf6-d1d2-4d7f-957e-6217e8eeb490 service nova] Creating event network-changed:4c0dc71b-74ff-4cd5-a627-ac95c2071dc0 for instance ea96ec49-12a3-46cc-b92d-2bb9936745b7 on n-h2-852278-4 Aug 27 03:28:47.355948 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-55193ef4-e524-4cbd-b511-eb476a5dbc79 req-5d682bf6-d1d2-4d7f-957e-6217e8eeb490 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038525 Aug 27 03:28:47.356882 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3062/6082] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:28:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:28:47.556463 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b0550021-a9fe-4a3f-be1c-f609d9d0cb92 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:47.564694 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b0550021-a9fe-4a3f-be1c-f609d9d0cb92 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/ea96ec49-12a3-46cc-b92d-2bb9936745b7" status: 200 len: 1564 microversion: 2.1 time: 0.249517 Aug 27 03:28:47.565589 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3021/6083] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:47 2022] GET /compute/v2.1/servers/ea96ec49-12a3-46cc-b92d-2bb9936745b7 => generated 1564 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:10.872293 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=9 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:29:10.873491 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=36 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:29:10.877733 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0ac85dc4-6dda-4e45-a911-97c8a9ecfdeb tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:29:10.880087 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-0ac85dc4-6dda-4e45-a911-97c8a9ecfdeb tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: ea96ec49-12a3-46cc-b92d-2bb9936745b7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:10.887644 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0ac85dc4-6dda-4e45-a911-97c8a9ecfdeb tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:10.888149 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0ac85dc4-6dda-4e45-a911-97c8a9ecfdeb tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:10.888633 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0ac85dc4-6dda-4e45-a911-97c8a9ecfdeb tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:10.889347 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0ac85dc4-6dda-4e45-a911-97c8a9ecfdeb tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:10.889801 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0ac85dc4-6dda-4e45-a911-97c8a9ecfdeb tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:10.890236 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0ac85dc4-6dda-4e45-a911-97c8a9ecfdeb tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:10.949092 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-0ac85dc4-6dda-4e45-a911-97c8a9ecfdeb tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "POST /compute/v2.1/servers/ea96ec49-12a3-46cc-b92d-2bb9936745b7/action" status: 200 len: 24514 microversion: 2.1 time: 0.080940 Aug 27 03:29:10.949806 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3063/6084] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:29:10 2022] POST /compute/v2.1/servers/ea96ec49-12a3-46cc-b92d-2bb9936745b7/action => generated 24514 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:29:17.332523 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-bba7969d-2d23-4d0e-98dc-288e8ccf0d48 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:29:17.335318 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-bba7969d-2d23-4d0e-98dc-288e8ccf0d48 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: ea96ec49-12a3-46cc-b92d-2bb9936745b7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:17.337539 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=7 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:29:17.338386 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=32 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:29:17.344431 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bba7969d-2d23-4d0e-98dc-288e8ccf0d48 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:17.344923 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bba7969d-2d23-4d0e-98dc-288e8ccf0d48 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:17.345367 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bba7969d-2d23-4d0e-98dc-288e8ccf0d48 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:17.346071 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bba7969d-2d23-4d0e-98dc-288e8ccf0d48 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:17.346522 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bba7969d-2d23-4d0e-98dc-288e8ccf0d48 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:17.346948 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bba7969d-2d23-4d0e-98dc-288e8ccf0d48 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:17.430694 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-bba7969d-2d23-4d0e-98dc-288e8ccf0d48 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Flavor limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:29:17.431116 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-bba7969d-2d23-4d0e-98dc-288e8ccf0d48 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Image limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:29:17.431593 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-bba7969d-2d23-4d0e-98dc-288e8ccf0d48 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Flavor pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:29:17.432005 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-bba7969d-2d23-4d0e-98dc-288e8ccf0d48 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Image pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:29:17.432459 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-bba7969d-2d23-4d0e-98dc-288e8ccf0d48 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:29:17.507937 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-bba7969d-2d23-4d0e-98dc-288e8ccf0d48 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: ea96ec49-12a3-46cc-b92d-2bb9936745b7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:17.514712 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bba7969d-2d23-4d0e-98dc-288e8ccf0d48 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:17.515233 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bba7969d-2d23-4d0e-98dc-288e8ccf0d48 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:17.515673 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bba7969d-2d23-4d0e-98dc-288e8ccf0d48 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:17.516410 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bba7969d-2d23-4d0e-98dc-288e8ccf0d48 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:17.516864 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bba7969d-2d23-4d0e-98dc-288e8ccf0d48 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:17.517294 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bba7969d-2d23-4d0e-98dc-288e8ccf0d48 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:17.546633 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-bba7969d-2d23-4d0e-98dc-288e8ccf0d48 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "POST /compute/v2.1/servers/ea96ec49-12a3-46cc-b92d-2bb9936745b7/action" status: 202 len: 1139 microversion: 2.1 time: 0.218402 Aug 27 03:29:17.547294 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3022/6085] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:29:17 2022] POST /compute/v2.1/servers/ea96ec49-12a3-46cc-b92d-2bb9936745b7/action => generated 1139 bytes in 220 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Aug 27 03:29:17.565632 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3bfa67a6-5002-45ae-a91f-bf861187bdaa tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:17.566316 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-3bfa67a6-5002-45ae-a91f-bf861187bdaa tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: ea96ec49-12a3-46cc-b92d-2bb9936745b7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:17.574470 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3bfa67a6-5002-45ae-a91f-bf861187bdaa tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:17.574978 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3bfa67a6-5002-45ae-a91f-bf861187bdaa tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:17.575431 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3bfa67a6-5002-45ae-a91f-bf861187bdaa tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:17.576155 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3bfa67a6-5002-45ae-a91f-bf861187bdaa tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:17.576844 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3bfa67a6-5002-45ae-a91f-bf861187bdaa tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:17.577274 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3bfa67a6-5002-45ae-a91f-bf861187bdaa tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:17.721829 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-3bfa67a6-5002-45ae-a91f-bf861187bdaa tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:17.729904 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-3bfa67a6-5002-45ae-a91f-bf861187bdaa tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/ea96ec49-12a3-46cc-b92d-2bb9936745b7" status: 200 len: 1692 microversion: 2.1 time: 0.168641 Aug 27 03:29:17.730517 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3064/6086] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:17 2022] GET /compute/v2.1/servers/ea96ec49-12a3-46cc-b92d-2bb9936745b7 => generated 1692 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:18.754952 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-90b4fe5d-5fd7-4217-94ca-ee3f5f6a1ce2 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:18.755981 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-90b4fe5d-5fd7-4217-94ca-ee3f5f6a1ce2 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: ea96ec49-12a3-46cc-b92d-2bb9936745b7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:18.766779 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-90b4fe5d-5fd7-4217-94ca-ee3f5f6a1ce2 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:18.767271 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-90b4fe5d-5fd7-4217-94ca-ee3f5f6a1ce2 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:18.767714 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-90b4fe5d-5fd7-4217-94ca-ee3f5f6a1ce2 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:18.768449 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-90b4fe5d-5fd7-4217-94ca-ee3f5f6a1ce2 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:18.768901 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-90b4fe5d-5fd7-4217-94ca-ee3f5f6a1ce2 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:18.769329 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-90b4fe5d-5fd7-4217-94ca-ee3f5f6a1ce2 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:18.918867 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-90b4fe5d-5fd7-4217-94ca-ee3f5f6a1ce2 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:18.927484 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-90b4fe5d-5fd7-4217-94ca-ee3f5f6a1ce2 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/ea96ec49-12a3-46cc-b92d-2bb9936745b7" status: 200 len: 1692 microversion: 2.1 time: 0.179366 Aug 27 03:29:18.928084 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3023/6087] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:18 2022] GET /compute/v2.1/servers/ea96ec49-12a3-46cc-b92d-2bb9936745b7 => generated 1692 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:19.953137 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-9cca1f4f-db9e-4270-ae9a-339136f1b27e tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:19.953748 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-9cca1f4f-db9e-4270-ae9a-339136f1b27e tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: ea96ec49-12a3-46cc-b92d-2bb9936745b7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:19.965316 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9cca1f4f-db9e-4270-ae9a-339136f1b27e tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:19.966003 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9cca1f4f-db9e-4270-ae9a-339136f1b27e tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:19.966562 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9cca1f4f-db9e-4270-ae9a-339136f1b27e tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:19.967694 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9cca1f4f-db9e-4270-ae9a-339136f1b27e tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:19.968197 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9cca1f4f-db9e-4270-ae9a-339136f1b27e tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:19.968643 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9cca1f4f-db9e-4270-ae9a-339136f1b27e tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:20.103909 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-9cca1f4f-db9e-4270-ae9a-339136f1b27e tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:20.112585 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-9cca1f4f-db9e-4270-ae9a-339136f1b27e tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/ea96ec49-12a3-46cc-b92d-2bb9936745b7" status: 200 len: 1692 microversion: 2.1 time: 0.165500 Aug 27 03:29:20.113178 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3065/6088] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:19 2022] GET /compute/v2.1/servers/ea96ec49-12a3-46cc-b92d-2bb9936745b7 => generated 1692 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:21.138052 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-707df708-f93f-4613-b915-a89db50fe7b6 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:21.139056 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-707df708-f93f-4613-b915-a89db50fe7b6 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: ea96ec49-12a3-46cc-b92d-2bb9936745b7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:21.146888 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-707df708-f93f-4613-b915-a89db50fe7b6 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:21.147356 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-707df708-f93f-4613-b915-a89db50fe7b6 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:21.147800 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-707df708-f93f-4613-b915-a89db50fe7b6 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:21.148544 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-707df708-f93f-4613-b915-a89db50fe7b6 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:21.149006 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-707df708-f93f-4613-b915-a89db50fe7b6 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:21.149438 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-707df708-f93f-4613-b915-a89db50fe7b6 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:21.288527 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-707df708-f93f-4613-b915-a89db50fe7b6 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:21.296953 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-707df708-f93f-4613-b915-a89db50fe7b6 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/ea96ec49-12a3-46cc-b92d-2bb9936745b7" status: 200 len: 1692 microversion: 2.1 time: 0.165507 Aug 27 03:29:21.297539 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3024/6089] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:21 2022] GET /compute/v2.1/servers/ea96ec49-12a3-46cc-b92d-2bb9936745b7 => generated 1692 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:22.322507 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-6cae4e0f-7692-4517-bcef-70f7e2ce66d2 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:22.323556 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-6cae4e0f-7692-4517-bcef-70f7e2ce66d2 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: ea96ec49-12a3-46cc-b92d-2bb9936745b7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:22.334132 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6cae4e0f-7692-4517-bcef-70f7e2ce66d2 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:22.334977 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6cae4e0f-7692-4517-bcef-70f7e2ce66d2 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:22.335734 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6cae4e0f-7692-4517-bcef-70f7e2ce66d2 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:22.337001 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6cae4e0f-7692-4517-bcef-70f7e2ce66d2 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:22.337797 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6cae4e0f-7692-4517-bcef-70f7e2ce66d2 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:22.338575 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6cae4e0f-7692-4517-bcef-70f7e2ce66d2 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:22.488220 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-6cae4e0f-7692-4517-bcef-70f7e2ce66d2 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:22.496590 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-6cae4e0f-7692-4517-bcef-70f7e2ce66d2 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/ea96ec49-12a3-46cc-b92d-2bb9936745b7" status: 200 len: 1692 microversion: 2.1 time: 0.181074 Aug 27 03:29:22.497190 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3066/6090] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:22 2022] GET /compute/v2.1/servers/ea96ec49-12a3-46cc-b92d-2bb9936745b7 => generated 1692 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:23.522634 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5e3693b3-b0bc-4858-bc28-0e15d233efe9 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:23.523535 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-5e3693b3-b0bc-4858-bc28-0e15d233efe9 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: ea96ec49-12a3-46cc-b92d-2bb9936745b7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:23.535432 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5e3693b3-b0bc-4858-bc28-0e15d233efe9 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:23.536243 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5e3693b3-b0bc-4858-bc28-0e15d233efe9 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:23.537017 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5e3693b3-b0bc-4858-bc28-0e15d233efe9 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:23.538169 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5e3693b3-b0bc-4858-bc28-0e15d233efe9 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:23.538937 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5e3693b3-b0bc-4858-bc28-0e15d233efe9 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:23.539649 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5e3693b3-b0bc-4858-bc28-0e15d233efe9 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:23.688174 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-5e3693b3-b0bc-4858-bc28-0e15d233efe9 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:23.696591 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-5e3693b3-b0bc-4858-bc28-0e15d233efe9 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/ea96ec49-12a3-46cc-b92d-2bb9936745b7" status: 200 len: 1692 microversion: 2.1 time: 0.180888 Aug 27 03:29:23.697179 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3025/6091] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:23 2022] GET /compute/v2.1/servers/ea96ec49-12a3-46cc-b92d-2bb9936745b7 => generated 1692 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:24.722128 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3394d1dd-5a6f-478b-9461-9e722e786e01 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:24.723017 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-3394d1dd-5a6f-478b-9461-9e722e786e01 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: ea96ec49-12a3-46cc-b92d-2bb9936745b7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:24.734770 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3394d1dd-5a6f-478b-9461-9e722e786e01 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:24.735574 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3394d1dd-5a6f-478b-9461-9e722e786e01 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:24.736089 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3394d1dd-5a6f-478b-9461-9e722e786e01 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:24.736845 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3394d1dd-5a6f-478b-9461-9e722e786e01 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:24.737316 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3394d1dd-5a6f-478b-9461-9e722e786e01 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:24.737758 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3394d1dd-5a6f-478b-9461-9e722e786e01 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:24.874152 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-3394d1dd-5a6f-478b-9461-9e722e786e01 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:24.886464 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-3394d1dd-5a6f-478b-9461-9e722e786e01 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/ea96ec49-12a3-46cc-b92d-2bb9936745b7" status: 200 len: 1692 microversion: 2.1 time: 0.170767 Aug 27 03:29:24.887325 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3067/6092] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:24 2022] GET /compute/v2.1/servers/ea96ec49-12a3-46cc-b92d-2bb9936745b7 => generated 1692 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:25.909798 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0131476a-ea42-447c-8dc4-627612df30f8 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:25.910404 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-0131476a-ea42-447c-8dc4-627612df30f8 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: ea96ec49-12a3-46cc-b92d-2bb9936745b7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:25.917825 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0131476a-ea42-447c-8dc4-627612df30f8 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:25.918308 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0131476a-ea42-447c-8dc4-627612df30f8 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:25.918710 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0131476a-ea42-447c-8dc4-627612df30f8 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:25.919435 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0131476a-ea42-447c-8dc4-627612df30f8 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:25.919879 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0131476a-ea42-447c-8dc4-627612df30f8 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:25.920299 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0131476a-ea42-447c-8dc4-627612df30f8 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:26.055443 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0131476a-ea42-447c-8dc4-627612df30f8 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:26.063667 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-0131476a-ea42-447c-8dc4-627612df30f8 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/ea96ec49-12a3-46cc-b92d-2bb9936745b7" status: 200 len: 1692 microversion: 2.1 time: 0.157928 Aug 27 03:29:26.064263 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3026/6093] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:25 2022] GET /compute/v2.1/servers/ea96ec49-12a3-46cc-b92d-2bb9936745b7 => generated 1692 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:27.089637 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-051e9c31-413d-40c7-8474-e02a547e0ecf tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:27.090725 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-051e9c31-413d-40c7-8474-e02a547e0ecf tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: ea96ec49-12a3-46cc-b92d-2bb9936745b7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:27.102407 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-051e9c31-413d-40c7-8474-e02a547e0ecf tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:27.103227 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-051e9c31-413d-40c7-8474-e02a547e0ecf tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:27.103969 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-051e9c31-413d-40c7-8474-e02a547e0ecf tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:27.105184 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-051e9c31-413d-40c7-8474-e02a547e0ecf tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:27.105949 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-051e9c31-413d-40c7-8474-e02a547e0ecf tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:27.106715 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-051e9c31-413d-40c7-8474-e02a547e0ecf tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:27.249453 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-051e9c31-413d-40c7-8474-e02a547e0ecf tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:27.257730 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-051e9c31-413d-40c7-8474-e02a547e0ecf tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/ea96ec49-12a3-46cc-b92d-2bb9936745b7" status: 200 len: 1692 microversion: 2.1 time: 0.174774 Aug 27 03:29:27.258315 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3068/6094] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:27 2022] GET /compute/v2.1/servers/ea96ec49-12a3-46cc-b92d-2bb9936745b7 => generated 1692 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:28.283302 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b2287fe8-f4e7-4108-ac85-f776c8bce333 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:28.284423 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b2287fe8-f4e7-4108-ac85-f776c8bce333 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: ea96ec49-12a3-46cc-b92d-2bb9936745b7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:28.291998 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b2287fe8-f4e7-4108-ac85-f776c8bce333 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:28.292526 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b2287fe8-f4e7-4108-ac85-f776c8bce333 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:28.292972 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b2287fe8-f4e7-4108-ac85-f776c8bce333 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:28.293677 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b2287fe8-f4e7-4108-ac85-f776c8bce333 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:28.294130 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b2287fe8-f4e7-4108-ac85-f776c8bce333 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:28.294555 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b2287fe8-f4e7-4108-ac85-f776c8bce333 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:28.433931 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b2287fe8-f4e7-4108-ac85-f776c8bce333 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:28.445283 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b2287fe8-f4e7-4108-ac85-f776c8bce333 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/ea96ec49-12a3-46cc-b92d-2bb9936745b7" status: 200 len: 1692 microversion: 2.1 time: 0.168396 Aug 27 03:29:28.446009 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3027/6095] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:28 2022] GET /compute/v2.1/servers/ea96ec49-12a3-46cc-b92d-2bb9936745b7 => generated 1692 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:29.471651 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c6a0a330-d289-4c23-9b85-8114215e23dc tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:29.472277 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-c6a0a330-d289-4c23-9b85-8114215e23dc tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: ea96ec49-12a3-46cc-b92d-2bb9936745b7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:29.479894 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c6a0a330-d289-4c23-9b85-8114215e23dc tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:29.480425 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c6a0a330-d289-4c23-9b85-8114215e23dc tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:29.480876 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c6a0a330-d289-4c23-9b85-8114215e23dc tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:29.481586 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c6a0a330-d289-4c23-9b85-8114215e23dc tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:29.482061 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c6a0a330-d289-4c23-9b85-8114215e23dc tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:29.482500 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c6a0a330-d289-4c23-9b85-8114215e23dc tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:29.620409 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-c6a0a330-d289-4c23-9b85-8114215e23dc tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:29.629044 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c6a0a330-d289-4c23-9b85-8114215e23dc tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/ea96ec49-12a3-46cc-b92d-2bb9936745b7" status: 200 len: 1698 microversion: 2.1 time: 0.162561 Aug 27 03:29:29.629636 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3069/6096] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:29 2022] GET /compute/v2.1/servers/ea96ec49-12a3-46cc-b92d-2bb9936745b7 => generated 1698 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:30.655080 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f2c5b70a-8ba4-490d-b255-fe1f48b5a493 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:30.656058 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-f2c5b70a-8ba4-490d-b255-fe1f48b5a493 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: ea96ec49-12a3-46cc-b92d-2bb9936745b7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:30.667802 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f2c5b70a-8ba4-490d-b255-fe1f48b5a493 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:30.668683 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f2c5b70a-8ba4-490d-b255-fe1f48b5a493 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:30.669420 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f2c5b70a-8ba4-490d-b255-fe1f48b5a493 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:30.670749 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f2c5b70a-8ba4-490d-b255-fe1f48b5a493 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:30.671513 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f2c5b70a-8ba4-490d-b255-fe1f48b5a493 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:30.672193 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f2c5b70a-8ba4-490d-b255-fe1f48b5a493 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:30.816760 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-f2c5b70a-8ba4-490d-b255-fe1f48b5a493 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:30.826322 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f2c5b70a-8ba4-490d-b255-fe1f48b5a493 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/ea96ec49-12a3-46cc-b92d-2bb9936745b7" status: 200 len: 1698 microversion: 2.1 time: 0.177814 Aug 27 03:29:30.827614 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3028/6097] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:30 2022] GET /compute/v2.1/servers/ea96ec49-12a3-46cc-b92d-2bb9936745b7 => generated 1698 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:31.851527 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-12a3ae70-2122-41fb-b827-4348a6334b14 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:31.852165 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-12a3ae70-2122-41fb-b827-4348a6334b14 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: ea96ec49-12a3-46cc-b92d-2bb9936745b7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:31.859781 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-12a3ae70-2122-41fb-b827-4348a6334b14 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:31.860346 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-12a3ae70-2122-41fb-b827-4348a6334b14 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:31.860854 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-12a3ae70-2122-41fb-b827-4348a6334b14 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:31.861579 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-12a3ae70-2122-41fb-b827-4348a6334b14 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:31.862055 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-12a3ae70-2122-41fb-b827-4348a6334b14 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:31.862529 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-12a3ae70-2122-41fb-b827-4348a6334b14 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:31.997973 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-12a3ae70-2122-41fb-b827-4348a6334b14 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:32.005955 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-12a3ae70-2122-41fb-b827-4348a6334b14 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/ea96ec49-12a3-46cc-b92d-2bb9936745b7" status: 200 len: 1683 microversion: 2.1 time: 0.159733 Aug 27 03:29:32.006748 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3070/6098] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:31 2022] GET /compute/v2.1/servers/ea96ec49-12a3-46cc-b92d-2bb9936745b7 => generated 1683 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:34.002245 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-9e131c9e-0b5c-45f2-b02e-7c6358cb0e64 req-42c8533a-dc50-47ef-b78a-6b0777d4015a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea96ec49-12a3-46cc-b92d-2bb9936745b7", "name": "network-vif-plugged", "status": "completed", "tag": "4c0dc71b-74ff-4cd5-a627-ac95c2071dc0"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:29:34.012900 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-9e131c9e-0b5c-45f2-b02e-7c6358cb0e64 req-42c8533a-dc50-47ef-b78a-6b0777d4015a service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:34.013464 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-9e131c9e-0b5c-45f2-b02e-7c6358cb0e64 req-42c8533a-dc50-47ef-b78a-6b0777d4015a service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:34.013934 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-9e131c9e-0b5c-45f2-b02e-7c6358cb0e64 req-42c8533a-dc50-47ef-b78a-6b0777d4015a service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:34.026456 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-9e131c9e-0b5c-45f2-b02e-7c6358cb0e64 req-42c8533a-dc50-47ef-b78a-6b0777d4015a service nova] Creating event network-vif-plugged:4c0dc71b-74ff-4cd5-a627-ac95c2071dc0 for instance ea96ec49-12a3-46cc-b92d-2bb9936745b7 on n-h2-852278-4 Aug 27 03:29:34.031941 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-9e131c9e-0b5c-45f2-b02e-7c6358cb0e64 req-42c8533a-dc50-47ef-b78a-6b0777d4015a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033568 Aug 27 03:29:34.032611 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3029/6099] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:29:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:29:56.241872 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-10b522f7-4b17-485f-9640-ebacc8f49759 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:29:56.244705 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-10b522f7-4b17-485f-9640-ebacc8f49759 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: ea96ec49-12a3-46cc-b92d-2bb9936745b7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:56.247727 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=16 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:29:56.248444 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=46 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:29:56.254881 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-10b522f7-4b17-485f-9640-ebacc8f49759 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:56.255387 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-10b522f7-4b17-485f-9640-ebacc8f49759 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:56.255838 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-10b522f7-4b17-485f-9640-ebacc8f49759 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:56.256589 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-10b522f7-4b17-485f-9640-ebacc8f49759 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:56.257052 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-10b522f7-4b17-485f-9640-ebacc8f49759 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:56.257497 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-10b522f7-4b17-485f-9640-ebacc8f49759 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:56.307975 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-10b522f7-4b17-485f-9640-ebacc8f49759 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "POST /compute/v2.1/servers/ea96ec49-12a3-46cc-b92d-2bb9936745b7/action" status: 200 len: 24568 microversion: 2.1 time: 0.071415 Aug 27 03:29:56.308614 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3071/6100] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:29:56 2022] POST /compute/v2.1/servers/ea96ec49-12a3-46cc-b92d-2bb9936745b7/action => generated 24568 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:30:08.211392 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=20 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:30:08.212139 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:30:08.217138 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-cbf5eb78-8bf4-423e-83d1-99b61647e316 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:08.217858 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-cbf5eb78-8bf4-423e-83d1-99b61647e316 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: ea96ec49-12a3-46cc-b92d-2bb9936745b7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:08.220856 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-73982416-9673-4c25-9fcf-8899bc58cd9e req-e9944154-6717-4546-ae02-8bf45b48a36f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea96ec49-12a3-46cc-b92d-2bb9936745b7", "tag": "4c0dc71b-74ff-4cd5-a627-ac95c2071dc0"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:30:08.226576 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cbf5eb78-8bf4-423e-83d1-99b61647e316 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:08.227064 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cbf5eb78-8bf4-423e-83d1-99b61647e316 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:08.227492 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:30:08.227649 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cbf5eb78-8bf4-423e-83d1-99b61647e316 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:08.228226 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cbf5eb78-8bf4-423e-83d1-99b61647e316 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:08.228711 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cbf5eb78-8bf4-423e-83d1-99b61647e316 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:08.229162 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cbf5eb78-8bf4-423e-83d1-99b61647e316 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:08.229354 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=4 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:30:08.237826 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-73982416-9673-4c25-9fcf-8899bc58cd9e req-e9944154-6717-4546-ae02-8bf45b48a36f service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:08.238399 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-73982416-9673-4c25-9fcf-8899bc58cd9e req-e9944154-6717-4546-ae02-8bf45b48a36f service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:08.238992 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-73982416-9673-4c25-9fcf-8899bc58cd9e req-e9944154-6717-4546-ae02-8bf45b48a36f service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:08.251035 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-73982416-9673-4c25-9fcf-8899bc58cd9e req-e9944154-6717-4546-ae02-8bf45b48a36f service nova] Creating event network-changed:4c0dc71b-74ff-4cd5-a627-ac95c2071dc0 for instance ea96ec49-12a3-46cc-b92d-2bb9936745b7 on n-h2-852278-4 Aug 27 03:30:08.256401 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-73982416-9673-4c25-9fcf-8899bc58cd9e req-e9944154-6717-4546-ae02-8bf45b48a36f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040151 Aug 27 03:30:08.257462 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3072/6101] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:30:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:30:08.261653 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-cbf5eb78-8bf4-423e-83d1-99b61647e316 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: ea96ec49-12a3-46cc-b92d-2bb9936745b7] Going to try to terminate instance {{(pid=134052) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:30:08.353095 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-cbf5eb78-8bf4-423e-83d1-99b61647e316 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "DELETE /compute/v2.1/servers/ea96ec49-12a3-46cc-b92d-2bb9936745b7" status: 204 len: 0 microversion: 2.1 time: 0.143360 Aug 27 03:30:08.353732 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3030/6102] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 03:30:08 2022] DELETE /compute/v2.1/servers/ea96ec49-12a3-46cc-b92d-2bb9936745b7 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:30:08.364506 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7a193484-054f-470a-b268-9a9954540bd9 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:08.365236 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-7a193484-054f-470a-b268-9a9954540bd9 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: ea96ec49-12a3-46cc-b92d-2bb9936745b7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:08.373088 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7a193484-054f-470a-b268-9a9954540bd9 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:08.373348 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7a193484-054f-470a-b268-9a9954540bd9 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:08.373768 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7a193484-054f-470a-b268-9a9954540bd9 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:08.374492 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7a193484-054f-470a-b268-9a9954540bd9 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:08.374959 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7a193484-054f-470a-b268-9a9954540bd9 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:08.375394 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7a193484-054f-470a-b268-9a9954540bd9 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:08.550279 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-7a193484-054f-470a-b268-9a9954540bd9 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:08.558681 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-7a193484-054f-470a-b268-9a9954540bd9 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/ea96ec49-12a3-46cc-b92d-2bb9936745b7" status: 200 len: 1689 microversion: 2.1 time: 0.200059 Aug 27 03:30:08.559270 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3073/6103] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:08 2022] GET /compute/v2.1/servers/ea96ec49-12a3-46cc-b92d-2bb9936745b7 => generated 1689 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:30:09.584735 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9ba06cdd-79cb-4b23-9314-02ffee5bf9a1 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:09.585612 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-9ba06cdd-79cb-4b23-9314-02ffee5bf9a1 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: ea96ec49-12a3-46cc-b92d-2bb9936745b7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:09.593495 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9ba06cdd-79cb-4b23-9314-02ffee5bf9a1 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:09.593993 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9ba06cdd-79cb-4b23-9314-02ffee5bf9a1 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:09.594430 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9ba06cdd-79cb-4b23-9314-02ffee5bf9a1 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:09.595135 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9ba06cdd-79cb-4b23-9314-02ffee5bf9a1 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:09.595589 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9ba06cdd-79cb-4b23-9314-02ffee5bf9a1 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:09.596018 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9ba06cdd-79cb-4b23-9314-02ffee5bf9a1 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:10.310163 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-9ba06cdd-79cb-4b23-9314-02ffee5bf9a1 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e9eab0eb7c421fa50b90e270847365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659b0cee2ff841049f41c7ce12609fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:10.319015 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9ba06cdd-79cb-4b23-9314-02ffee5bf9a1 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/ea96ec49-12a3-46cc-b92d-2bb9936745b7" status: 200 len: 1689 microversion: 2.1 time: 0.739764 Aug 27 03:30:10.332558 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3031/6104] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:09 2022] GET /compute/v2.1/servers/ea96ec49-12a3-46cc-b92d-2bb9936745b7 => generated 1689 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:10.635093 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-026ae1b4-da27-4700-b992-6c4bb910eae9 req-f498106f-7cce-4e7d-aa48-dbfca6dcc7bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea96ec49-12a3-46cc-b92d-2bb9936745b7", "name": "network-vif-deleted", "tag": "4c0dc71b-74ff-4cd5-a627-ac95c2071dc0"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:30:10.645809 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-026ae1b4-da27-4700-b992-6c4bb910eae9 req-f498106f-7cce-4e7d-aa48-dbfca6dcc7bb service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:10.646332 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-026ae1b4-da27-4700-b992-6c4bb910eae9 req-f498106f-7cce-4e7d-aa48-dbfca6dcc7bb service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:10.646782 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-026ae1b4-da27-4700-b992-6c4bb910eae9 req-f498106f-7cce-4e7d-aa48-dbfca6dcc7bb service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:10.658891 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-026ae1b4-da27-4700-b992-6c4bb910eae9 req-f498106f-7cce-4e7d-aa48-dbfca6dcc7bb service nova] Creating event network-vif-deleted:4c0dc71b-74ff-4cd5-a627-ac95c2071dc0 for instance ea96ec49-12a3-46cc-b92d-2bb9936745b7 on n-h2-852278-4 Aug 27 03:30:10.665067 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-026ae1b4-da27-4700-b992-6c4bb910eae9 req-f498106f-7cce-4e7d-aa48-dbfca6dcc7bb service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033755 Aug 27 03:30:10.665678 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3074/6105] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:30:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:30:11.342789 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-7df50468-045f-4bc2-adc1-3b315a1c46bb tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:11.343755 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-7df50468-045f-4bc2-adc1-3b315a1c46bb tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] [instance: ea96ec49-12a3-46cc-b92d-2bb9936745b7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:11.353339 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7df50468-045f-4bc2-adc1-3b315a1c46bb tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:11.353339 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7df50468-045f-4bc2-adc1-3b315a1c46bb tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:11.353339 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7df50468-045f-4bc2-adc1-3b315a1c46bb tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:11.354169 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7df50468-045f-4bc2-adc1-3b315a1c46bb tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:11.354676 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7df50468-045f-4bc2-adc1-3b315a1c46bb tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:11.355094 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7df50468-045f-4bc2-adc1-3b315a1c46bb tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:11.369602 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-7df50468-045f-4bc2-adc1-3b315a1c46bb tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] HTTP exception thrown: Instance ea96ec49-12a3-46cc-b92d-2bb9936745b7 could not be found. Aug 27 03:30:11.371567 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-7df50468-045f-4bc2-adc1-3b315a1c46bb tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Request method failure captured: Aug 27 03:30:11.371567 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/servers/ea96ec49-12a3-46cc-b92d-2bb9936745b7 HTTP/1.1 Aug 27 03:30:11.371567 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 03:30:11.371567 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 03:30:11.371567 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 03:30:11.371567 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 03:30:11.371567 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 03:30:11.371567 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 03:30:11.371567 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 03:30:11.371567 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 03:30:11.371567 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCY4rjgLXIvNBrh9kN4jnznC50AQ6KjWReTgkO1jga9yr7NY-gC8VrzURbe59WZrBpXWePgbVKRMS_e_UPOGvs6kq6xALqK2obNolZqn3ouGxdOKXhnIHVg8gyE_jgUU-tIsjIbg-aNo9qlCKhh6olDObIY67Z71HecsvikaMrjLi4nk Aug 27 03:30:11.371567 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 03:30:11.371567 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 03:30:11.371567 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 03:30:11.371567 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 03:30:11.371567 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 03:30:11.371567 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 03:30:11.371567 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 659b0cee2ff841049f41c7ce12609fc8 Aug 27 03:30:11.371567 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1769414468 Aug 27 03:30:11.371567 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 03:30:11.371567 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 03:30:11.371567 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/659b0cee2ff841049f41c7ce12609fc8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_659b0cee2ff841049f41c7ce12609fc8", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/659b0cee2ff841049f41c7ce12609fc8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/659b0cee2ff841049f41c7ce12609fc8"}]}] Aug 27 03:30:11.371567 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1769414468 Aug 27 03:30:11.371567 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 659b0cee2ff841049f41c7ce12609fc8 Aug 27 03:30:11.371567 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1769414468 Aug 27 03:30:11.371567 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-TestNetworkAdvancedServerOps-1769414468-project Aug 27 03:30:11.371567 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 03:30:11.371567 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 03:30:11.371567 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 36e9eab0eb7c421fa50b90e270847365 Aug 27 03:30:11.371567 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1769414468-project Aug 27 03:30:11.371567 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 03:30:11.371567 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance ea96ec49-12a3-46cc-b92d-2bb9936745b7 could not be found. Aug 27 03:30:11.371567 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': 'ea96ec49-12a3-46cc-b92d-2bb9936745b7'} Aug 27 03:30:11.371567 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:30:11.371567 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:30:11.371567 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:30:11.371567 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:30:11.371567 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:30:11.371567 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:30:11.371567 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:30:11.371567 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:30:11.371567 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:30:11.371567 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:30:11.371567 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea96ec49-12a3-46cc-b92d-2bb9936745b7 could not be found. Aug 27 03:30:11.371567 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:30:11.371567 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:30:11.371567 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:30:11.371567 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:30:11.371567 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:30:11.371567 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:30:11.371567 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:30:11.371567 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:30:11.371567 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:30:11.371567 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:30:11.371567 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:30:11.371567 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:30:11.371567 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:30:11.371567 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:30:11.371567 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:30:11.371567 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:30:11.371567 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea96ec49-12a3-46cc-b92d-2bb9936745b7 could not be found. Aug 27 03:30:11.371567 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:30:11.371567 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:30:11.377000 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:30:11.377000 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:30:11.377000 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:30:11.377000 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:30:11.377000 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:30:11.377000 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:30:11.377000 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea96ec49-12a3-46cc-b92d-2bb9936745b7 could not be found. Aug 27 03:30:11.377000 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:30:11.377000 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-7df50468-045f-4bc2-adc1-3b315a1c46bb tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Returning 404 to user: Instance ea96ec49-12a3-46cc-b92d-2bb9936745b7 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:30:11.377000 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-7df50468-045f-4bc2-adc1-3b315a1c46bb tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "GET /compute/v2.1/servers/ea96ec49-12a3-46cc-b92d-2bb9936745b7" status: 404 len: 111 microversion: 2.1 time: 0.037789 Aug 27 03:30:11.377925 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3032/6106] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:11 2022] GET /compute/v2.1/servers/ea96ec49-12a3-46cc-b92d-2bb9936745b7 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:30:14.727871 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-2d683db2-b640-4819-9167-e51c9d973495 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] Calling method '.version_select at 0x7f5edec52ee0>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:14.751512 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-2d683db2-b640-4819-9167-e51c9d973495 tempest-TestNetworkAdvancedServerOps-1769414468 tempest-TestNetworkAdvancedServerOps-1769414468-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-129643637" status: 202 len: 0 microversion: 2.1 time: 0.027289 Aug 27 03:30:14.764477 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3075/6107] 10.222.0.70 () {58 vars in 1281 bytes} [Sat Aug 27 03:30:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-129643637 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:30:22.683380 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4e5954d3-fda9-4f3b-83c3-e7ccf2a6b660 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Action: 'create', calling method: .version_select at 0x7f5ee34b9ee0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1150104251", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN/qDzv0tFXM/QcrljZ+1Vf2KMgAm4SnK3+ZPalGc8ZyKYd0ti0y73gTQnNY/c7oe0t/vLKRXftRzzRwq68UEzKfeGldvrUaabFaLvwk1YGVZVwhr5sMgh+5u74GL0I7zA=="}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:30:22.690688 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:30:22.691367 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:30:22.708819 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-4e5954d3-fda9-4f3b-83c3-e7ccf2a6b660 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Getting quotas for project 4adf9e5b8bb54b1589c1b331febab9db. Resources: {'key_pairs'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:30:22.716088 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-4e5954d3-fda9-4f3b-83c3-e7ccf2a6b660 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Getting quotas for user 08cd6a89f36c44d49bb2baabc9d3bd1b and project 4adf9e5b8bb54b1589c1b331febab9db. Resources: {'key_pairs'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:30:22.745607 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-4e5954d3-fda9-4f3b-83c3-e7ccf2a6b660 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.066202 Aug 27 03:30:22.746226 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3033/6108] 10.222.0.70 () {60 vars in 1159 bytes} [Sat Aug 27 03:30:22 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:30:23.749472 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7d1728a0-ef19-4c53-9239-e3d98661590e tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-2093875974", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "networks": [{"uuid": "0a44d279-1282-4233-96e7-df1f36b56c60"}], "key_name": "tempest-TestNetworkBasicOps-1150104251", "security_groups": [{"name": "tempest-secgroup-smoke-1171263092"}]}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:30:23.759697 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=10 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:30:24.063984 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.network.neutron [None req-7d1728a0-ef19-4c53-9239-e3d98661590e tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] validate_networks() for [('0a44d279-1282-4233-96e7-df1f36b56c60', None, None, None, None, None)] {{(pid=134051) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:30:24.486608 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-7d1728a0-ef19-4c53-9239-e3d98661590e tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Flavor limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:30:24.487082 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-7d1728a0-ef19-4c53-9239-e3d98661590e tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Image limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:30:24.487683 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-7d1728a0-ef19-4c53-9239-e3d98661590e tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Flavor pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:30:24.488240 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-7d1728a0-ef19-4c53-9239-e3d98661590e tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Image pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:30:24.488703 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-7d1728a0-ef19-4c53-9239-e3d98661590e tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:30:24.498554 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7d1728a0-ef19-4c53-9239-e3d98661590e tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:24.499059 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7d1728a0-ef19-4c53-9239-e3d98661590e tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:24.499512 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7d1728a0-ef19-4c53-9239-e3d98661590e tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:24.500262 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7d1728a0-ef19-4c53-9239-e3d98661590e tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:24.500754 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7d1728a0-ef19-4c53-9239-e3d98661590e tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:24.501198 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7d1728a0-ef19-4c53-9239-e3d98661590e tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:24.520664 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-7d1728a0-ef19-4c53-9239-e3d98661590e tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Getting quotas for project 4adf9e5b8bb54b1589c1b331febab9db. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:30:24.526507 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-7d1728a0-ef19-4c53-9239-e3d98661590e tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Getting quotas for user 08cd6a89f36c44d49bb2baabc9d3bd1b and project 4adf9e5b8bb54b1589c1b331febab9db. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:30:24.540264 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-7d1728a0-ef19-4c53-9239-e3d98661590e tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Going to run 1 instances... {{(pid=134051) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:30:24.542877 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-7d1728a0-ef19-4c53-9239-e3d98661590e tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] [instance: 12125aad-1a79-43eb-9048-d954269a2700] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134051) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:30:24.594873 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-7d1728a0-ef19-4c53-9239-e3d98661590e tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.849138 Aug 27 03:30:24.600365 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3076/6109] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 03:30:23 2022] POST /compute/v2.1/servers => generated 406 bytes in 851 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:30:24.609247 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0f5138e0-635d-4dd1-a7b2-474fc0ed5bdf tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:24.609874 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-0f5138e0-635d-4dd1-a7b2-474fc0ed5bdf tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] [instance: 12125aad-1a79-43eb-9048-d954269a2700] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:24.681207 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0f5138e0-635d-4dd1-a7b2-474fc0ed5bdf tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08cd6a89f36c44d49bb2baabc9d3bd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adf9e5b8bb54b1589c1b331febab9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:24.688278 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-0f5138e0-635d-4dd1-a7b2-474fc0ed5bdf tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] 10.222.0.70 "GET /compute/v2.1/servers/12125aad-1a79-43eb-9048-d954269a2700" status: 200 len: 1249 microversion: 2.1 time: 0.085015 Aug 27 03:30:24.700368 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3034/6110] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:24 2022] GET /compute/v2.1/servers/12125aad-1a79-43eb-9048-d954269a2700 => generated 1249 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:25.710785 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-33394dac-09da-4c04-ab18-3390adb74041 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:25.711418 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-33394dac-09da-4c04-ab18-3390adb74041 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] [instance: 12125aad-1a79-43eb-9048-d954269a2700] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:25.718199 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-33394dac-09da-4c04-ab18-3390adb74041 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:25.718710 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-33394dac-09da-4c04-ab18-3390adb74041 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:25.719151 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-33394dac-09da-4c04-ab18-3390adb74041 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:25.719860 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-33394dac-09da-4c04-ab18-3390adb74041 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:25.720341 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-33394dac-09da-4c04-ab18-3390adb74041 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:25.720771 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-33394dac-09da-4c04-ab18-3390adb74041 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:25.793960 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-33394dac-09da-4c04-ab18-3390adb74041 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08cd6a89f36c44d49bb2baabc9d3bd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adf9e5b8bb54b1589c1b331febab9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:25.803052 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-33394dac-09da-4c04-ab18-3390adb74041 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] 10.222.0.70 "GET /compute/v2.1/servers/12125aad-1a79-43eb-9048-d954269a2700" status: 200 len: 1301 microversion: 2.1 time: 0.097246 Aug 27 03:30:25.811218 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3077/6111] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:25 2022] GET /compute/v2.1/servers/12125aad-1a79-43eb-9048-d954269a2700 => generated 1301 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:26.823518 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-7c3d75c1-1e08-4957-9985-48fa656f978b tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:26.824286 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-7c3d75c1-1e08-4957-9985-48fa656f978b tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] [instance: 12125aad-1a79-43eb-9048-d954269a2700] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:26.832099 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7c3d75c1-1e08-4957-9985-48fa656f978b tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:26.832625 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7c3d75c1-1e08-4957-9985-48fa656f978b tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:26.833098 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7c3d75c1-1e08-4957-9985-48fa656f978b tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:26.833811 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7c3d75c1-1e08-4957-9985-48fa656f978b tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:26.834293 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7c3d75c1-1e08-4957-9985-48fa656f978b tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:26.834717 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7c3d75c1-1e08-4957-9985-48fa656f978b tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:27.390572 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-7c3d75c1-1e08-4957-9985-48fa656f978b tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08cd6a89f36c44d49bb2baabc9d3bd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adf9e5b8bb54b1589c1b331febab9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:27.399144 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-7c3d75c1-1e08-4957-9985-48fa656f978b tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] 10.222.0.70 "GET /compute/v2.1/servers/12125aad-1a79-43eb-9048-d954269a2700" status: 200 len: 1375 microversion: 2.1 time: 0.579914 Aug 27 03:30:27.399744 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3035/6112] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:26 2022] GET /compute/v2.1/servers/12125aad-1a79-43eb-9048-d954269a2700 => generated 1375 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:27.528800 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-05a6737b-a03a-4735-ad43-03d5b080d407 req-63d534b5-8841-4227-acb2-3703a06288a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12125aad-1a79-43eb-9048-d954269a2700", "tag": "c7f8adac-b14f-4783-934f-5b72b95973b2"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:30:27.539435 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-05a6737b-a03a-4735-ad43-03d5b080d407 req-63d534b5-8841-4227-acb2-3703a06288a0 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:27.539931 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-05a6737b-a03a-4735-ad43-03d5b080d407 req-63d534b5-8841-4227-acb2-3703a06288a0 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:27.540415 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-05a6737b-a03a-4735-ad43-03d5b080d407 req-63d534b5-8841-4227-acb2-3703a06288a0 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:27.553473 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-05a6737b-a03a-4735-ad43-03d5b080d407 req-63d534b5-8841-4227-acb2-3703a06288a0 service nova] Creating event network-changed:c7f8adac-b14f-4783-934f-5b72b95973b2 for instance 12125aad-1a79-43eb-9048-d954269a2700 on n-h2-852278-4 Aug 27 03:30:27.559462 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-05a6737b-a03a-4735-ad43-03d5b080d407 req-63d534b5-8841-4227-acb2-3703a06288a0 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035790 Aug 27 03:30:27.560099 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3078/6113] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:30:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:30:28.425934 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-80559c2c-54ef-4488-bdef-f778e8a66f74 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:28.426926 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-80559c2c-54ef-4488-bdef-f778e8a66f74 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] [instance: 12125aad-1a79-43eb-9048-d954269a2700] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:28.436054 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-80559c2c-54ef-4488-bdef-f778e8a66f74 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:28.437143 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-80559c2c-54ef-4488-bdef-f778e8a66f74 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:28.437584 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-80559c2c-54ef-4488-bdef-f778e8a66f74 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:28.438501 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-80559c2c-54ef-4488-bdef-f778e8a66f74 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:28.438959 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-80559c2c-54ef-4488-bdef-f778e8a66f74 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:28.439389 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-80559c2c-54ef-4488-bdef-f778e8a66f74 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:28.573995 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-80559c2c-54ef-4488-bdef-f778e8a66f74 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08cd6a89f36c44d49bb2baabc9d3bd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adf9e5b8bb54b1589c1b331febab9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:28.582404 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-80559c2c-54ef-4488-bdef-f778e8a66f74 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] 10.222.0.70 "GET /compute/v2.1/servers/12125aad-1a79-43eb-9048-d954269a2700" status: 200 len: 1375 microversion: 2.1 time: 0.164723 Aug 27 03:30:28.582997 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3036/6114] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:28 2022] GET /compute/v2.1/servers/12125aad-1a79-43eb-9048-d954269a2700 => generated 1375 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:29.608468 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d4e54fe4-66ee-4c3a-a275-ba42de9b3f90 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:29.609390 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d4e54fe4-66ee-4c3a-a275-ba42de9b3f90 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] [instance: 12125aad-1a79-43eb-9048-d954269a2700] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:29.617750 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d4e54fe4-66ee-4c3a-a275-ba42de9b3f90 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:29.618376 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d4e54fe4-66ee-4c3a-a275-ba42de9b3f90 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:29.618950 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d4e54fe4-66ee-4c3a-a275-ba42de9b3f90 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:29.619834 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d4e54fe4-66ee-4c3a-a275-ba42de9b3f90 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:29.620455 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d4e54fe4-66ee-4c3a-a275-ba42de9b3f90 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:29.621014 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d4e54fe4-66ee-4c3a-a275-ba42de9b3f90 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:29.762778 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d4e54fe4-66ee-4c3a-a275-ba42de9b3f90 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08cd6a89f36c44d49bb2baabc9d3bd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adf9e5b8bb54b1589c1b331febab9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:29.775358 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d4e54fe4-66ee-4c3a-a275-ba42de9b3f90 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] 10.222.0.70 "GET /compute/v2.1/servers/12125aad-1a79-43eb-9048-d954269a2700" status: 200 len: 1375 microversion: 2.1 time: 0.173781 Aug 27 03:30:29.775932 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3079/6115] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:29 2022] GET /compute/v2.1/servers/12125aad-1a79-43eb-9048-d954269a2700 => generated 1375 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:30.795744 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c87e593f-75fb-4e22-9e00-2c1851344b27 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:30.796282 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-c87e593f-75fb-4e22-9e00-2c1851344b27 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] [instance: 12125aad-1a79-43eb-9048-d954269a2700] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:30.803981 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c87e593f-75fb-4e22-9e00-2c1851344b27 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:30.804532 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c87e593f-75fb-4e22-9e00-2c1851344b27 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:30.804943 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c87e593f-75fb-4e22-9e00-2c1851344b27 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:30.805641 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c87e593f-75fb-4e22-9e00-2c1851344b27 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:30.806090 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c87e593f-75fb-4e22-9e00-2c1851344b27 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:30.806540 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c87e593f-75fb-4e22-9e00-2c1851344b27 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:30.960139 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-c87e593f-75fb-4e22-9e00-2c1851344b27 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08cd6a89f36c44d49bb2baabc9d3bd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adf9e5b8bb54b1589c1b331febab9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:30.968201 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c87e593f-75fb-4e22-9e00-2c1851344b27 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] 10.222.0.70 "GET /compute/v2.1/servers/12125aad-1a79-43eb-9048-d954269a2700" status: 200 len: 1375 microversion: 2.1 time: 0.176595 Aug 27 03:30:30.968828 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3037/6116] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:30 2022] GET /compute/v2.1/servers/12125aad-1a79-43eb-9048-d954269a2700 => generated 1375 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:31.996854 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c00e5ecd-2306-4632-ab12-d2a90edc6c21 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:31.997479 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-c00e5ecd-2306-4632-ab12-d2a90edc6c21 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] [instance: 12125aad-1a79-43eb-9048-d954269a2700] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:32.004529 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c00e5ecd-2306-4632-ab12-d2a90edc6c21 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:32.005034 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c00e5ecd-2306-4632-ab12-d2a90edc6c21 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:32.005485 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c00e5ecd-2306-4632-ab12-d2a90edc6c21 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:32.006195 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c00e5ecd-2306-4632-ab12-d2a90edc6c21 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:32.006663 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c00e5ecd-2306-4632-ab12-d2a90edc6c21 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:32.007100 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c00e5ecd-2306-4632-ab12-d2a90edc6c21 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:32.152079 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-c00e5ecd-2306-4632-ab12-d2a90edc6c21 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08cd6a89f36c44d49bb2baabc9d3bd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adf9e5b8bb54b1589c1b331febab9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:32.160055 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c00e5ecd-2306-4632-ab12-d2a90edc6c21 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] 10.222.0.70 "GET /compute/v2.1/servers/12125aad-1a79-43eb-9048-d954269a2700" status: 200 len: 1375 microversion: 2.1 time: 0.168486 Aug 27 03:30:32.160662 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3080/6117] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:31 2022] GET /compute/v2.1/servers/12125aad-1a79-43eb-9048-d954269a2700 => generated 1375 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:32.232274 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-81215e3e-80fa-4fee-bd17-918a7223d46b req-4e664a58-9c07-4a3f-a5f9-098e10a34031 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12125aad-1a79-43eb-9048-d954269a2700", "name": "network-vif-plugged", "status": "completed", "tag": "c7f8adac-b14f-4783-934f-5b72b95973b2"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:30:32.244725 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-81215e3e-80fa-4fee-bd17-918a7223d46b req-4e664a58-9c07-4a3f-a5f9-098e10a34031 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:32.245216 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-81215e3e-80fa-4fee-bd17-918a7223d46b req-4e664a58-9c07-4a3f-a5f9-098e10a34031 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:32.245649 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-81215e3e-80fa-4fee-bd17-918a7223d46b req-4e664a58-9c07-4a3f-a5f9-098e10a34031 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:32.257262 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-81215e3e-80fa-4fee-bd17-918a7223d46b req-4e664a58-9c07-4a3f-a5f9-098e10a34031 service nova] Creating event network-vif-plugged:c7f8adac-b14f-4783-934f-5b72b95973b2 for instance 12125aad-1a79-43eb-9048-d954269a2700 on n-h2-852278-4 Aug 27 03:30:32.262404 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-81215e3e-80fa-4fee-bd17-918a7223d46b req-4e664a58-9c07-4a3f-a5f9-098e10a34031 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034067 Aug 27 03:30:32.263018 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3038/6118] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:30:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:30:33.184003 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4e794ea3-3f1a-49f1-8c78-669cee54c77e tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:33.184604 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-4e794ea3-3f1a-49f1-8c78-669cee54c77e tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] [instance: 12125aad-1a79-43eb-9048-d954269a2700] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:33.192030 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4e794ea3-3f1a-49f1-8c78-669cee54c77e tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:33.192592 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4e794ea3-3f1a-49f1-8c78-669cee54c77e tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:33.193028 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4e794ea3-3f1a-49f1-8c78-669cee54c77e tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:33.193756 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4e794ea3-3f1a-49f1-8c78-669cee54c77e tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:33.194261 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4e794ea3-3f1a-49f1-8c78-669cee54c77e tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:33.194676 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4e794ea3-3f1a-49f1-8c78-669cee54c77e tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:33.334432 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-4e794ea3-3f1a-49f1-8c78-669cee54c77e tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08cd6a89f36c44d49bb2baabc9d3bd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adf9e5b8bb54b1589c1b331febab9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:33.342713 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-4e794ea3-3f1a-49f1-8c78-669cee54c77e tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] 10.222.0.70 "GET /compute/v2.1/servers/12125aad-1a79-43eb-9048-d954269a2700" status: 200 len: 1375 microversion: 2.1 time: 0.164012 Aug 27 03:30:33.343305 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3081/6119] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:33 2022] GET /compute/v2.1/servers/12125aad-1a79-43eb-9048-d954269a2700 => generated 1375 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:34.364239 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-194e5e6a-8e04-4017-84e5-23e535e22e1a tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:34.364983 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-194e5e6a-8e04-4017-84e5-23e535e22e1a tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] [instance: 12125aad-1a79-43eb-9048-d954269a2700] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:34.372352 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-194e5e6a-8e04-4017-84e5-23e535e22e1a tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:34.372855 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-194e5e6a-8e04-4017-84e5-23e535e22e1a tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:34.373301 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-194e5e6a-8e04-4017-84e5-23e535e22e1a tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:34.374006 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-194e5e6a-8e04-4017-84e5-23e535e22e1a tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:34.374464 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-194e5e6a-8e04-4017-84e5-23e535e22e1a tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:34.374893 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-194e5e6a-8e04-4017-84e5-23e535e22e1a tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:34.516857 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-194e5e6a-8e04-4017-84e5-23e535e22e1a tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08cd6a89f36c44d49bb2baabc9d3bd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adf9e5b8bb54b1589c1b331febab9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:34.525326 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-194e5e6a-8e04-4017-84e5-23e535e22e1a tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] 10.222.0.70 "GET /compute/v2.1/servers/12125aad-1a79-43eb-9048-d954269a2700" status: 200 len: 1548 microversion: 2.1 time: 0.165656 Aug 27 03:30:34.525999 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3039/6120] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:34 2022] GET /compute/v2.1/servers/12125aad-1a79-43eb-9048-d954269a2700 => generated 1548 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:34.546130 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c9d92ac7-03fb-4ed1-9490-1f25e8316e97 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:34.546642 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-c9d92ac7-03fb-4ed1-9490-1f25e8316e97 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] [instance: 12125aad-1a79-43eb-9048-d954269a2700] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:34.549840 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:30:34.550543 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=6 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:30:34.557709 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c9d92ac7-03fb-4ed1-9490-1f25e8316e97 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:34.558229 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c9d92ac7-03fb-4ed1-9490-1f25e8316e97 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:34.558684 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c9d92ac7-03fb-4ed1-9490-1f25e8316e97 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:34.559404 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c9d92ac7-03fb-4ed1-9490-1f25e8316e97 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:34.559874 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c9d92ac7-03fb-4ed1-9490-1f25e8316e97 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:34.560329 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c9d92ac7-03fb-4ed1-9490-1f25e8316e97 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:34.701138 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-c9d92ac7-03fb-4ed1-9490-1f25e8316e97 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08cd6a89f36c44d49bb2baabc9d3bd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adf9e5b8bb54b1589c1b331febab9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:34.710329 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c9d92ac7-03fb-4ed1-9490-1f25e8316e97 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] 10.222.0.70 "GET /compute/v2.1/servers/12125aad-1a79-43eb-9048-d954269a2700" status: 200 len: 1548 microversion: 2.1 time: 0.168271 Aug 27 03:30:34.710917 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3082/6121] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:34 2022] GET /compute/v2.1/servers/12125aad-1a79-43eb-9048-d954269a2700 => generated 1548 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:36.813563 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-1ae668f9-6bc4-401a-8d72-904ca3db1390 req-5e49aa81-8eec-4b29-a934-7ed550286185 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12125aad-1a79-43eb-9048-d954269a2700", "tag": "c7f8adac-b14f-4783-934f-5b72b95973b2"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:30:36.819168 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=6 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:30:36.829093 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-1ae668f9-6bc4-401a-8d72-904ca3db1390 req-5e49aa81-8eec-4b29-a934-7ed550286185 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:36.829841 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-1ae668f9-6bc4-401a-8d72-904ca3db1390 req-5e49aa81-8eec-4b29-a934-7ed550286185 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:36.830271 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-1ae668f9-6bc4-401a-8d72-904ca3db1390 req-5e49aa81-8eec-4b29-a934-7ed550286185 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:36.842594 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-1ae668f9-6bc4-401a-8d72-904ca3db1390 req-5e49aa81-8eec-4b29-a934-7ed550286185 service nova] Creating event network-changed:c7f8adac-b14f-4783-934f-5b72b95973b2 for instance 12125aad-1a79-43eb-9048-d954269a2700 on n-h2-852278-4 Aug 27 03:30:36.847871 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-1ae668f9-6bc4-401a-8d72-904ca3db1390 req-5e49aa81-8eec-4b29-a934-7ed550286185 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038209 Aug 27 03:30:36.848491 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3040/6122] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:30:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:30:59.157724 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-89453218-e0b1-4267-b770-a7c98cffb462 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:30:59.160005 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-89453218-e0b1-4267-b770-a7c98cffb462 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] [instance: 12125aad-1a79-43eb-9048-d954269a2700] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:59.162636 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=36,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:30:59.163421 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=34 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:30:59.170235 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-89453218-e0b1-4267-b770-a7c98cffb462 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:59.170732 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-89453218-e0b1-4267-b770-a7c98cffb462 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:59.171177 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-89453218-e0b1-4267-b770-a7c98cffb462 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:59.171900 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-89453218-e0b1-4267-b770-a7c98cffb462 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:59.172388 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-89453218-e0b1-4267-b770-a7c98cffb462 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:59.172826 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-89453218-e0b1-4267-b770-a7c98cffb462 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:59.231103 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-89453218-e0b1-4267-b770-a7c98cffb462 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] 10.222.0.70 "POST /compute/v2.1/servers/12125aad-1a79-43eb-9048-d954269a2700/action" status: 200 len: 24574 microversion: 2.1 time: 0.077693 Aug 27 03:30:59.231719 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3083/6123] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:30:59 2022] POST /compute/v2.1/servers/12125aad-1a79-43eb-9048-d954269a2700/action => generated 24574 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:31:11.689012 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:31:11.690169 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=28 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:31:11.694357 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-028e8687-7c09-415e-9ea5-a840ef19c505 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Action: 'create', calling method: .version_select at 0x7f5ee304b430>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1295074168", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDs52+1Sz7xICQKcZ/XJgHdT80yH3SET/K2AKXiINCsf4UKrDdye4pnLFbbfc3rQzGUhF3UR2eV5RVL7s/Zh6Dr+edOf6mJFCRMBlUy516iXnZlQU15vSCr9I62cIAu4Qw=="}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:11.711325 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-028e8687-7c09-415e-9ea5-a840ef19c505 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Getting quotas for project 4adf9e5b8bb54b1589c1b331febab9db. Resources: {'key_pairs'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:31:11.716754 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-028e8687-7c09-415e-9ea5-a840ef19c505 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Getting quotas for user 08cd6a89f36c44d49bb2baabc9d3bd1b and project 4adf9e5b8bb54b1589c1b331febab9db. Resources: {'key_pairs'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:31:11.742207 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-028e8687-7c09-415e-9ea5-a840ef19c505 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.055296 Aug 27 03:31:11.742838 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3041/6124] 10.222.0.70 () {60 vars in 1159 bytes} [Sat Aug 27 03:31:11 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:31:13.148858 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-73b0d1ff-643a-4b6b-b4b9-70e9ab156fac tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-2082042659", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "networks": [{"uuid": "371bbce7-0842-4b68-9d9f-ba48bba940d4"}], "key_name": "tempest-TestNetworkBasicOps-1295074168", "security_groups": [{"name": "tempest-secgroup-smoke-1615315998"}]}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:13.158843 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:31:13.159708 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=4 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:31:13.283013 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.network.neutron [None req-73b0d1ff-643a-4b6b-b4b9-70e9ab156fac tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] validate_networks() for [('371bbce7-0842-4b68-9d9f-ba48bba940d4', None, None, None, None, None)] {{(pid=134051) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:31:13.743475 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-73b0d1ff-643a-4b6b-b4b9-70e9ab156fac tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Flavor limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:31:13.743934 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-73b0d1ff-643a-4b6b-b4b9-70e9ab156fac tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Image limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:31:13.744519 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-73b0d1ff-643a-4b6b-b4b9-70e9ab156fac tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Flavor pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:31:13.744964 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-73b0d1ff-643a-4b6b-b4b9-70e9ab156fac tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Image pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:31:13.745382 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-73b0d1ff-643a-4b6b-b4b9-70e9ab156fac tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:31:13.755252 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-73b0d1ff-643a-4b6b-b4b9-70e9ab156fac tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:13.755747 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-73b0d1ff-643a-4b6b-b4b9-70e9ab156fac tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:13.756194 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-73b0d1ff-643a-4b6b-b4b9-70e9ab156fac tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:13.756960 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-73b0d1ff-643a-4b6b-b4b9-70e9ab156fac tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:13.757417 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-73b0d1ff-643a-4b6b-b4b9-70e9ab156fac tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:13.758095 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-73b0d1ff-643a-4b6b-b4b9-70e9ab156fac tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:13.775263 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-73b0d1ff-643a-4b6b-b4b9-70e9ab156fac tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Getting quotas for project 4adf9e5b8bb54b1589c1b331febab9db. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:31:13.780559 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-73b0d1ff-643a-4b6b-b4b9-70e9ab156fac tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Getting quotas for user 08cd6a89f36c44d49bb2baabc9d3bd1b and project 4adf9e5b8bb54b1589c1b331febab9db. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:31:13.793007 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-73b0d1ff-643a-4b6b-b4b9-70e9ab156fac tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Going to run 1 instances... {{(pid=134051) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:31:13.795450 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-73b0d1ff-643a-4b6b-b4b9-70e9ab156fac tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] [instance: 2fede669-343a-45ae-bce1-c67cbc9d27a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134051) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:31:13.852126 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-73b0d1ff-643a-4b6b-b4b9-70e9ab156fac tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.708128 Aug 27 03:31:13.852824 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3084/6125] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 03:31:13 2022] POST /compute/v2.1/servers => generated 406 bytes in 710 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:31:13.864945 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b0d18c53-5ec4-4b64-9812-d1ef4f647b74 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:13.865687 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b0d18c53-5ec4-4b64-9812-d1ef4f647b74 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] [instance: 2fede669-343a-45ae-bce1-c67cbc9d27a1] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:13.922583 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b0d18c53-5ec4-4b64-9812-d1ef4f647b74 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08cd6a89f36c44d49bb2baabc9d3bd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adf9e5b8bb54b1589c1b331febab9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:13.933071 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b0d18c53-5ec4-4b64-9812-d1ef4f647b74 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] 10.222.0.70 "GET /compute/v2.1/servers/2fede669-343a-45ae-bce1-c67cbc9d27a1" status: 200 len: 1249 microversion: 2.1 time: 0.073157 Aug 27 03:31:13.933775 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3042/6126] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:13 2022] GET /compute/v2.1/servers/2fede669-343a-45ae-bce1-c67cbc9d27a1 => generated 1249 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:14.955414 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3131e942-dd23-4e4a-94c1-d807a8d6287e tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:14.956054 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-3131e942-dd23-4e4a-94c1-d807a8d6287e tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] [instance: 2fede669-343a-45ae-bce1-c67cbc9d27a1] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:15.010053 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-3131e942-dd23-4e4a-94c1-d807a8d6287e tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08cd6a89f36c44d49bb2baabc9d3bd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adf9e5b8bb54b1589c1b331febab9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:15.018150 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-3131e942-dd23-4e4a-94c1-d807a8d6287e tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] 10.222.0.70 "GET /compute/v2.1/servers/2fede669-343a-45ae-bce1-c67cbc9d27a1" status: 200 len: 1249 microversion: 2.1 time: 0.067587 Aug 27 03:31:15.018699 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3085/6127] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:14 2022] GET /compute/v2.1/servers/2fede669-343a-45ae-bce1-c67cbc9d27a1 => generated 1249 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:16.039057 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6d5b49e9-0de5-476d-b010-497583a8a1fd tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:16.039735 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-6d5b49e9-0de5-476d-b010-497583a8a1fd tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] [instance: 2fede669-343a-45ae-bce1-c67cbc9d27a1] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:16.094542 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-6d5b49e9-0de5-476d-b010-497583a8a1fd tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08cd6a89f36c44d49bb2baabc9d3bd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adf9e5b8bb54b1589c1b331febab9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:16.102004 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-6d5b49e9-0de5-476d-b010-497583a8a1fd tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] 10.222.0.70 "GET /compute/v2.1/servers/2fede669-343a-45ae-bce1-c67cbc9d27a1" status: 200 len: 1249 microversion: 2.1 time: 0.066964 Aug 27 03:31:16.102588 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3043/6128] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:16 2022] GET /compute/v2.1/servers/2fede669-343a-45ae-bce1-c67cbc9d27a1 => generated 1249 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:17.128561 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-1604afba-1c29-40d0-98c0-42022cf97ea5 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:17.129575 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-1604afba-1c29-40d0-98c0-42022cf97ea5 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] [instance: 2fede669-343a-45ae-bce1-c67cbc9d27a1] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:17.193129 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-1604afba-1c29-40d0-98c0-42022cf97ea5 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08cd6a89f36c44d49bb2baabc9d3bd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adf9e5b8bb54b1589c1b331febab9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:17.200584 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-1604afba-1c29-40d0-98c0-42022cf97ea5 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] 10.222.0.70 "GET /compute/v2.1/servers/2fede669-343a-45ae-bce1-c67cbc9d27a1" status: 200 len: 1249 microversion: 2.1 time: 0.078831 Aug 27 03:31:17.201140 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3086/6129] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:17 2022] GET /compute/v2.1/servers/2fede669-343a-45ae-bce1-c67cbc9d27a1 => generated 1249 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:18.222394 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-84005690-602c-4f3d-976d-67e36d9b136a tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:18.223121 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-84005690-602c-4f3d-976d-67e36d9b136a tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] [instance: 2fede669-343a-45ae-bce1-c67cbc9d27a1] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:18.231153 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-84005690-602c-4f3d-976d-67e36d9b136a tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:18.231640 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-84005690-602c-4f3d-976d-67e36d9b136a tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:18.232097 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-84005690-602c-4f3d-976d-67e36d9b136a tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:18.232829 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-84005690-602c-4f3d-976d-67e36d9b136a tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:18.233277 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-84005690-602c-4f3d-976d-67e36d9b136a tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:18.233700 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-84005690-602c-4f3d-976d-67e36d9b136a tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:18.300199 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-84005690-602c-4f3d-976d-67e36d9b136a tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08cd6a89f36c44d49bb2baabc9d3bd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adf9e5b8bb54b1589c1b331febab9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:18.308214 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-84005690-602c-4f3d-976d-67e36d9b136a tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] 10.222.0.70 "GET /compute/v2.1/servers/2fede669-343a-45ae-bce1-c67cbc9d27a1" status: 200 len: 1307 microversion: 2.1 time: 0.089934 Aug 27 03:31:18.308854 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3044/6130] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:18 2022] GET /compute/v2.1/servers/2fede669-343a-45ae-bce1-c67cbc9d27a1 => generated 1307 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:19.329335 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-01ecb70c-6efc-4e7e-91aa-3f0d0ee62527 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:19.329952 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-01ecb70c-6efc-4e7e-91aa-3f0d0ee62527 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] [instance: 2fede669-343a-45ae-bce1-c67cbc9d27a1] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:19.337967 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-01ecb70c-6efc-4e7e-91aa-3f0d0ee62527 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:19.338493 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-01ecb70c-6efc-4e7e-91aa-3f0d0ee62527 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:19.338914 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-01ecb70c-6efc-4e7e-91aa-3f0d0ee62527 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:19.339630 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-01ecb70c-6efc-4e7e-91aa-3f0d0ee62527 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:19.340095 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-01ecb70c-6efc-4e7e-91aa-3f0d0ee62527 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:19.340562 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-01ecb70c-6efc-4e7e-91aa-3f0d0ee62527 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:19.555160 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-8534562b-7b2c-48f1-a2e7-3b4d667a411e req-c34bfb83-be4e-45bb-9f10-1045b1c6ffb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fede669-343a-45ae-bce1-c67cbc9d27a1", "tag": "42eaca55-df88-4d64-901d-9e1260718e34"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:19.557868 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-01ecb70c-6efc-4e7e-91aa-3f0d0ee62527 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08cd6a89f36c44d49bb2baabc9d3bd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adf9e5b8bb54b1589c1b331febab9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:19.568201 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-01ecb70c-6efc-4e7e-91aa-3f0d0ee62527 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] 10.222.0.70 "GET /compute/v2.1/servers/2fede669-343a-45ae-bce1-c67cbc9d27a1" status: 200 len: 1375 microversion: 2.1 time: 0.242812 Aug 27 03:31:19.569602 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3087/6131] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:19 2022] GET /compute/v2.1/servers/2fede669-343a-45ae-bce1-c67cbc9d27a1 => generated 1375 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:19.579149 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-8534562b-7b2c-48f1-a2e7-3b4d667a411e req-c34bfb83-be4e-45bb-9f10-1045b1c6ffb0 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:19.580597 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-8534562b-7b2c-48f1-a2e7-3b4d667a411e req-c34bfb83-be4e-45bb-9f10-1045b1c6ffb0 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:19.581292 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-8534562b-7b2c-48f1-a2e7-3b4d667a411e req-c34bfb83-be4e-45bb-9f10-1045b1c6ffb0 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:19.594925 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-8534562b-7b2c-48f1-a2e7-3b4d667a411e req-c34bfb83-be4e-45bb-9f10-1045b1c6ffb0 service nova] Creating event network-changed:42eaca55-df88-4d64-901d-9e1260718e34 for instance 2fede669-343a-45ae-bce1-c67cbc9d27a1 on n-h1-852278-4 Aug 27 03:31:19.599907 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-8534562b-7b2c-48f1-a2e7-3b4d667a411e req-c34bfb83-be4e-45bb-9f10-1045b1c6ffb0 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049684 Aug 27 03:31:19.600528 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3045/6132] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:31:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:31:20.593906 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-717e7ab5-7fa9-49ba-b3ac-eade03212be9 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:20.594858 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-717e7ab5-7fa9-49ba-b3ac-eade03212be9 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] [instance: 2fede669-343a-45ae-bce1-c67cbc9d27a1] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:20.606724 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-717e7ab5-7fa9-49ba-b3ac-eade03212be9 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:20.607563 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-717e7ab5-7fa9-49ba-b3ac-eade03212be9 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:20.608360 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-717e7ab5-7fa9-49ba-b3ac-eade03212be9 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:20.609647 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-717e7ab5-7fa9-49ba-b3ac-eade03212be9 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:20.610428 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-717e7ab5-7fa9-49ba-b3ac-eade03212be9 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:20.611158 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-717e7ab5-7fa9-49ba-b3ac-eade03212be9 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:20.753279 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-717e7ab5-7fa9-49ba-b3ac-eade03212be9 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08cd6a89f36c44d49bb2baabc9d3bd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adf9e5b8bb54b1589c1b331febab9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:20.765303 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-717e7ab5-7fa9-49ba-b3ac-eade03212be9 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] 10.222.0.70 "GET /compute/v2.1/servers/2fede669-343a-45ae-bce1-c67cbc9d27a1" status: 200 len: 1375 microversion: 2.1 time: 0.178014 Aug 27 03:31:20.766078 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3088/6133] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:20 2022] GET /compute/v2.1/servers/2fede669-343a-45ae-bce1-c67cbc9d27a1 => generated 1375 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:21.791674 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-61847f1a-c461-4038-a797-073e11e0217c tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:21.792581 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-61847f1a-c461-4038-a797-073e11e0217c tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] [instance: 2fede669-343a-45ae-bce1-c67cbc9d27a1] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:21.801072 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-61847f1a-c461-4038-a797-073e11e0217c tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:21.801578 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-61847f1a-c461-4038-a797-073e11e0217c tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:21.802092 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-61847f1a-c461-4038-a797-073e11e0217c tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:21.802909 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-61847f1a-c461-4038-a797-073e11e0217c tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:21.803470 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-61847f1a-c461-4038-a797-073e11e0217c tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:21.803937 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-61847f1a-c461-4038-a797-073e11e0217c tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:21.946165 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-61847f1a-c461-4038-a797-073e11e0217c tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08cd6a89f36c44d49bb2baabc9d3bd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adf9e5b8bb54b1589c1b331febab9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:21.954572 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-61847f1a-c461-4038-a797-073e11e0217c tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] 10.222.0.70 "GET /compute/v2.1/servers/2fede669-343a-45ae-bce1-c67cbc9d27a1" status: 200 len: 1375 microversion: 2.1 time: 0.169800 Aug 27 03:31:21.955153 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3046/6134] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:21 2022] GET /compute/v2.1/servers/2fede669-343a-45ae-bce1-c67cbc9d27a1 => generated 1375 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:22.975620 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-cfd77e0f-cae5-4b83-9db6-caafd840223c tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:22.976237 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-cfd77e0f-cae5-4b83-9db6-caafd840223c tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] [instance: 2fede669-343a-45ae-bce1-c67cbc9d27a1] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:22.983800 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cfd77e0f-cae5-4b83-9db6-caafd840223c tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:22.984300 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cfd77e0f-cae5-4b83-9db6-caafd840223c tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:22.984770 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cfd77e0f-cae5-4b83-9db6-caafd840223c tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:22.985480 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cfd77e0f-cae5-4b83-9db6-caafd840223c tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:22.985940 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cfd77e0f-cae5-4b83-9db6-caafd840223c tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:22.986375 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cfd77e0f-cae5-4b83-9db6-caafd840223c tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:23.140129 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-cfd77e0f-cae5-4b83-9db6-caafd840223c tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08cd6a89f36c44d49bb2baabc9d3bd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adf9e5b8bb54b1589c1b331febab9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:23.152169 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-cfd77e0f-cae5-4b83-9db6-caafd840223c tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] 10.222.0.70 "GET /compute/v2.1/servers/2fede669-343a-45ae-bce1-c67cbc9d27a1" status: 200 len: 1375 microversion: 2.1 time: 0.180328 Aug 27 03:31:23.153153 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3089/6135] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:22 2022] GET /compute/v2.1/servers/2fede669-343a-45ae-bce1-c67cbc9d27a1 => generated 1375 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:24.174220 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ba31b63e-b339-4d19-97dc-1b9c7f127a19 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:24.174844 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-ba31b63e-b339-4d19-97dc-1b9c7f127a19 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] [instance: 2fede669-343a-45ae-bce1-c67cbc9d27a1] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:24.182253 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ba31b63e-b339-4d19-97dc-1b9c7f127a19 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:24.182702 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ba31b63e-b339-4d19-97dc-1b9c7f127a19 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:24.183132 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ba31b63e-b339-4d19-97dc-1b9c7f127a19 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:24.183827 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ba31b63e-b339-4d19-97dc-1b9c7f127a19 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:24.184256 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ba31b63e-b339-4d19-97dc-1b9c7f127a19 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:24.184718 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ba31b63e-b339-4d19-97dc-1b9c7f127a19 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:24.263419 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-de8ffd8d-2116-4dff-a992-ddec52caf856 req-95c56f23-7487-4215-b25e-48485b38f88b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fede669-343a-45ae-bce1-c67cbc9d27a1", "name": "network-vif-plugged", "status": "completed", "tag": "42eaca55-df88-4d64-901d-9e1260718e34"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:24.278540 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:31:24.283270 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-de8ffd8d-2116-4dff-a992-ddec52caf856 req-95c56f23-7487-4215-b25e-48485b38f88b service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:24.284601 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-de8ffd8d-2116-4dff-a992-ddec52caf856 req-95c56f23-7487-4215-b25e-48485b38f88b service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:24.286091 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-de8ffd8d-2116-4dff-a992-ddec52caf856 req-95c56f23-7487-4215-b25e-48485b38f88b service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:24.305535 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-de8ffd8d-2116-4dff-a992-ddec52caf856 req-95c56f23-7487-4215-b25e-48485b38f88b service nova] Creating event network-vif-plugged:42eaca55-df88-4d64-901d-9e1260718e34 for instance 2fede669-343a-45ae-bce1-c67cbc9d27a1 on n-h1-852278-4 Aug 27 03:31:24.312030 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-de8ffd8d-2116-4dff-a992-ddec52caf856 req-95c56f23-7487-4215-b25e-48485b38f88b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054846 Aug 27 03:31:24.313062 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3090/6136] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:31:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:31:24.327667 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-ba31b63e-b339-4d19-97dc-1b9c7f127a19 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08cd6a89f36c44d49bb2baabc9d3bd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adf9e5b8bb54b1589c1b331febab9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:24.336021 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ba31b63e-b339-4d19-97dc-1b9c7f127a19 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] 10.222.0.70 "GET /compute/v2.1/servers/2fede669-343a-45ae-bce1-c67cbc9d27a1" status: 200 len: 1375 microversion: 2.1 time: 0.166080 Aug 27 03:31:24.336704 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3047/6137] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:24 2022] GET /compute/v2.1/servers/2fede669-343a-45ae-bce1-c67cbc9d27a1 => generated 1375 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:25.365880 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f67bb411-ab3f-4db9-8832-2ebd881f68a5 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:25.367103 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-f67bb411-ab3f-4db9-8832-2ebd881f68a5 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] [instance: 2fede669-343a-45ae-bce1-c67cbc9d27a1] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:25.378025 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f67bb411-ab3f-4db9-8832-2ebd881f68a5 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:25.378855 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f67bb411-ab3f-4db9-8832-2ebd881f68a5 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:25.379613 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f67bb411-ab3f-4db9-8832-2ebd881f68a5 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:25.380876 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f67bb411-ab3f-4db9-8832-2ebd881f68a5 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:25.381348 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f67bb411-ab3f-4db9-8832-2ebd881f68a5 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:25.381787 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f67bb411-ab3f-4db9-8832-2ebd881f68a5 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:25.522944 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-f67bb411-ab3f-4db9-8832-2ebd881f68a5 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08cd6a89f36c44d49bb2baabc9d3bd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adf9e5b8bb54b1589c1b331febab9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:25.531286 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-f67bb411-ab3f-4db9-8832-2ebd881f68a5 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] 10.222.0.70 "GET /compute/v2.1/servers/2fede669-343a-45ae-bce1-c67cbc9d27a1" status: 200 len: 1375 microversion: 2.1 time: 0.173991 Aug 27 03:31:25.531877 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3091/6138] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:25 2022] GET /compute/v2.1/servers/2fede669-343a-45ae-bce1-c67cbc9d27a1 => generated 1375 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:26.554300 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=8 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:31:26.558497 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e5d0ebd6-9d97-4c63-940a-37e7a05bb81c tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:26.559131 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-e5d0ebd6-9d97-4c63-940a-37e7a05bb81c tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] [instance: 2fede669-343a-45ae-bce1-c67cbc9d27a1] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:26.565644 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e5d0ebd6-9d97-4c63-940a-37e7a05bb81c tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:26.566134 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e5d0ebd6-9d97-4c63-940a-37e7a05bb81c tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:26.566571 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e5d0ebd6-9d97-4c63-940a-37e7a05bb81c tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:26.567269 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e5d0ebd6-9d97-4c63-940a-37e7a05bb81c tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:26.567715 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e5d0ebd6-9d97-4c63-940a-37e7a05bb81c tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:26.568138 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e5d0ebd6-9d97-4c63-940a-37e7a05bb81c tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:26.703467 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-e5d0ebd6-9d97-4c63-940a-37e7a05bb81c tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08cd6a89f36c44d49bb2baabc9d3bd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adf9e5b8bb54b1589c1b331febab9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:26.711712 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e5d0ebd6-9d97-4c63-940a-37e7a05bb81c tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] 10.222.0.70 "GET /compute/v2.1/servers/2fede669-343a-45ae-bce1-c67cbc9d27a1" status: 200 len: 1548 microversion: 2.1 time: 0.160493 Aug 27 03:31:26.712302 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3048/6139] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:26 2022] GET /compute/v2.1/servers/2fede669-343a-45ae-bce1-c67cbc9d27a1 => generated 1548 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:26.742102 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3deac956-3a96-4f74-b4a4-c895be7b1a6c tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:26.742696 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-3deac956-3a96-4f74-b4a4-c895be7b1a6c tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] [instance: 2fede669-343a-45ae-bce1-c67cbc9d27a1] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:26.750256 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3deac956-3a96-4f74-b4a4-c895be7b1a6c tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:26.750763 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3deac956-3a96-4f74-b4a4-c895be7b1a6c tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:26.751347 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3deac956-3a96-4f74-b4a4-c895be7b1a6c tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:26.752089 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3deac956-3a96-4f74-b4a4-c895be7b1a6c tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:26.752598 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3deac956-3a96-4f74-b4a4-c895be7b1a6c tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:26.753040 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3deac956-3a96-4f74-b4a4-c895be7b1a6c tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:26.898849 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-3deac956-3a96-4f74-b4a4-c895be7b1a6c tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08cd6a89f36c44d49bb2baabc9d3bd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adf9e5b8bb54b1589c1b331febab9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:26.907158 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-3deac956-3a96-4f74-b4a4-c895be7b1a6c tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] 10.222.0.70 "GET /compute/v2.1/servers/2fede669-343a-45ae-bce1-c67cbc9d27a1" status: 200 len: 1548 microversion: 2.1 time: 0.170591 Aug 27 03:31:26.907828 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3092/6140] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:26 2022] GET /compute/v2.1/servers/2fede669-343a-45ae-bce1-c67cbc9d27a1 => generated 1548 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:52.494759 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f35f971f-d940-46b9-b3a0-823a58c0dfbd tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:52.495275 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-f35f971f-d940-46b9-b3a0-823a58c0dfbd tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] [instance: 2fede669-343a-45ae-bce1-c67cbc9d27a1] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:52.497641 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:31:52.498497 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=26 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:31:52.504352 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f35f971f-d940-46b9-b3a0-823a58c0dfbd tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:52.504800 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f35f971f-d940-46b9-b3a0-823a58c0dfbd tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:52.505255 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f35f971f-d940-46b9-b3a0-823a58c0dfbd tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:52.505964 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f35f971f-d940-46b9-b3a0-823a58c0dfbd tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:52.506414 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f35f971f-d940-46b9-b3a0-823a58c0dfbd tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:52.506834 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f35f971f-d940-46b9-b3a0-823a58c0dfbd tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:52.534160 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-f35f971f-d940-46b9-b3a0-823a58c0dfbd tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] [instance: 2fede669-343a-45ae-bce1-c67cbc9d27a1] Going to try to terminate instance {{(pid=134052) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:31:52.618838 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f35f971f-d940-46b9-b3a0-823a58c0dfbd tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] 10.222.0.70 "DELETE /compute/v2.1/servers/2fede669-343a-45ae-bce1-c67cbc9d27a1" status: 204 len: 0 microversion: 2.1 time: 0.127698 Aug 27 03:31:52.619700 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3049/6141] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 03:31:52 2022] DELETE /compute/v2.1/servers/2fede669-343a-45ae-bce1-c67cbc9d27a1 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:31:52.628778 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-573fc25a-edf1-45ee-875d-0d872070d03f tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:52.629351 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-573fc25a-edf1-45ee-875d-0d872070d03f tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] [instance: 2fede669-343a-45ae-bce1-c67cbc9d27a1] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:52.631489 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=10 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:31:52.635633 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:31:52.639388 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=34 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:31:52.645782 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-573fc25a-edf1-45ee-875d-0d872070d03f tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:52.646748 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-573fc25a-edf1-45ee-875d-0d872070d03f tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:52.647319 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-573fc25a-edf1-45ee-875d-0d872070d03f tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:52.648068 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-573fc25a-edf1-45ee-875d-0d872070d03f tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:52.648609 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-573fc25a-edf1-45ee-875d-0d872070d03f tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:52.649121 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-573fc25a-edf1-45ee-875d-0d872070d03f tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:52.790304 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-573fc25a-edf1-45ee-875d-0d872070d03f tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08cd6a89f36c44d49bb2baabc9d3bd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adf9e5b8bb54b1589c1b331febab9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:52.798484 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-573fc25a-edf1-45ee-875d-0d872070d03f tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] 10.222.0.70 "GET /compute/v2.1/servers/2fede669-343a-45ae-bce1-c67cbc9d27a1" status: 200 len: 1554 microversion: 2.1 time: 0.173807 Aug 27 03:31:52.799092 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3093/6142] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:52 2022] GET /compute/v2.1/servers/2fede669-343a-45ae-bce1-c67cbc9d27a1 => generated 1554 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:53.820176 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0c417849-393e-46db-908c-0026473c5a2d tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:53.821058 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-0c417849-393e-46db-908c-0026473c5a2d tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] [instance: 2fede669-343a-45ae-bce1-c67cbc9d27a1] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:53.828944 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0c417849-393e-46db-908c-0026473c5a2d tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:53.829476 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0c417849-393e-46db-908c-0026473c5a2d tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:53.829918 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0c417849-393e-46db-908c-0026473c5a2d tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:53.830622 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0c417849-393e-46db-908c-0026473c5a2d tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:53.831079 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0c417849-393e-46db-908c-0026473c5a2d tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:53.831600 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0c417849-393e-46db-908c-0026473c5a2d tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:53.976268 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0c417849-393e-46db-908c-0026473c5a2d tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08cd6a89f36c44d49bb2baabc9d3bd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adf9e5b8bb54b1589c1b331febab9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:53.984593 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-0c417849-393e-46db-908c-0026473c5a2d tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] 10.222.0.70 "GET /compute/v2.1/servers/2fede669-343a-45ae-bce1-c67cbc9d27a1" status: 200 len: 1554 microversion: 2.1 time: 0.168992 Aug 27 03:31:53.992302 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3050/6143] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:53 2022] GET /compute/v2.1/servers/2fede669-343a-45ae-bce1-c67cbc9d27a1 => generated 1554 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:54.550747 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-3db26580-0be0-43a1-a65f-7d611b42ed43 req-3dc088c5-c03d-451c-b55c-f7d84d7129ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fede669-343a-45ae-bce1-c67cbc9d27a1", "name": "network-vif-deleted", "tag": "42eaca55-df88-4d64-901d-9e1260718e34"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:54.563522 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-3db26580-0be0-43a1-a65f-7d611b42ed43 req-3dc088c5-c03d-451c-b55c-f7d84d7129ca service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:54.564773 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-3db26580-0be0-43a1-a65f-7d611b42ed43 req-3dc088c5-c03d-451c-b55c-f7d84d7129ca service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:54.565418 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-3db26580-0be0-43a1-a65f-7d611b42ed43 req-3dc088c5-c03d-451c-b55c-f7d84d7129ca service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:54.579316 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-3db26580-0be0-43a1-a65f-7d611b42ed43 req-3dc088c5-c03d-451c-b55c-f7d84d7129ca service nova] Creating event network-vif-deleted:42eaca55-df88-4d64-901d-9e1260718e34 for instance 2fede669-343a-45ae-bce1-c67cbc9d27a1 on n-h1-852278-4 Aug 27 03:31:54.585934 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-3db26580-0be0-43a1-a65f-7d611b42ed43 req-3dc088c5-c03d-451c-b55c-f7d84d7129ca service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039211 Aug 27 03:31:54.586850 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3094/6144] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:31:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:31:55.006286 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b86f5acc-7106-4e3b-85d0-8a7ff621700c tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:55.006898 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b86f5acc-7106-4e3b-85d0-8a7ff621700c tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] [instance: 2fede669-343a-45ae-bce1-c67cbc9d27a1] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:55.015295 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b86f5acc-7106-4e3b-85d0-8a7ff621700c tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:55.015947 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b86f5acc-7106-4e3b-85d0-8a7ff621700c tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:55.016433 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b86f5acc-7106-4e3b-85d0-8a7ff621700c tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:55.017164 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b86f5acc-7106-4e3b-85d0-8a7ff621700c tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:55.017616 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b86f5acc-7106-4e3b-85d0-8a7ff621700c tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:55.018026 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b86f5acc-7106-4e3b-85d0-8a7ff621700c tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:55.052679 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b86f5acc-7106-4e3b-85d0-8a7ff621700c tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:55.053145 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b86f5acc-7106-4e3b-85d0-8a7ff621700c tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:55.053584 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b86f5acc-7106-4e3b-85d0-8a7ff621700c tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:55.054028 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.instance [None req-b86f5acc-7106-4e3b-85d0-8a7ff621700c tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lazy-loading 'fault' on Instance uuid 2fede669-343a-45ae-bce1-c67cbc9d27a1 {{(pid=134052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:31:55.102273 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b86f5acc-7106-4e3b-85d0-8a7ff621700c tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08cd6a89f36c44d49bb2baabc9d3bd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adf9e5b8bb54b1589c1b331febab9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:55.111173 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b86f5acc-7106-4e3b-85d0-8a7ff621700c tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] 10.222.0.70 "GET /compute/v2.1/servers/2fede669-343a-45ae-bce1-c67cbc9d27a1" status: 200 len: 1339 microversion: 2.1 time: 0.108902 Aug 27 03:31:55.111764 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3051/6145] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:55 2022] GET /compute/v2.1/servers/2fede669-343a-45ae-bce1-c67cbc9d27a1 => generated 1339 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:56.137866 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-daf0b820-b2eb-4c59-931c-e974ba148da4 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:56.139081 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-daf0b820-b2eb-4c59-931c-e974ba148da4 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] [instance: 2fede669-343a-45ae-bce1-c67cbc9d27a1] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:56.147998 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-daf0b820-b2eb-4c59-931c-e974ba148da4 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:56.148541 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-daf0b820-b2eb-4c59-931c-e974ba148da4 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:56.149002 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-daf0b820-b2eb-4c59-931c-e974ba148da4 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:56.149713 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-daf0b820-b2eb-4c59-931c-e974ba148da4 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:56.150176 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-daf0b820-b2eb-4c59-931c-e974ba148da4 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:56.150621 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-daf0b820-b2eb-4c59-931c-e974ba148da4 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:56.164693 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-daf0b820-b2eb-4c59-931c-e974ba148da4 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] HTTP exception thrown: Instance 2fede669-343a-45ae-bce1-c67cbc9d27a1 could not be found. Aug 27 03:31:56.166409 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-daf0b820-b2eb-4c59-931c-e974ba148da4 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Request method failure captured: Aug 27 03:31:56.166409 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/2fede669-343a-45ae-bce1-c67cbc9d27a1 HTTP/1.1 Aug 27 03:31:56.166409 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 03:31:56.166409 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 03:31:56.166409 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 03:31:56.166409 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 03:31:56.166409 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 03:31:56.166409 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 03:31:56.166409 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 03:31:56.166409 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 03:31:56.166409 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCY_I_RkkR7PFz1DFGGeu-U4G7d0gma6-SuMR2AffAoxmFKPFKovW8E4o1RgWlj_eXnbt3vBettZe9Q6OaevSxA1t4nDe4Sy6hmqld-zqIpOj3DQgwtha_-uid63sjN99vwTMcUAOi2jrr0wQGIbsU-W_Knbx1KJ-STnqJufBdD63E0Y Aug 27 03:31:56.166409 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 03:31:56.166409 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 03:31:56.166409 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 03:31:56.166409 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 03:31:56.166409 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 03:31:56.166409 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 03:31:56.166409 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 4adf9e5b8bb54b1589c1b331febab9db Aug 27 03:31:56.166409 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-TestNetworkBasicOps-938726110 Aug 27 03:31:56.166409 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 03:31:56.166409 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 03:31:56.166409 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4adf9e5b8bb54b1589c1b331febab9db"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_4adf9e5b8bb54b1589c1b331febab9db", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4adf9e5b8bb54b1589c1b331febab9db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/4adf9e5b8bb54b1589c1b331febab9db"}]}] Aug 27 03:31:56.166409 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-TestNetworkBasicOps-938726110 Aug 27 03:31:56.166409 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 4adf9e5b8bb54b1589c1b331febab9db Aug 27 03:31:56.166409 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-TestNetworkBasicOps-938726110 Aug 27 03:31:56.166409 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-TestNetworkBasicOps-938726110-project Aug 27 03:31:56.166409 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 03:31:56.166409 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 03:31:56.166409 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 08cd6a89f36c44d49bb2baabc9d3bd1b Aug 27 03:31:56.166409 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-TestNetworkBasicOps-938726110-project Aug 27 03:31:56.166409 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 03:31:56.166409 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance 2fede669-343a-45ae-bce1-c67cbc9d27a1 could not be found. Aug 27 03:31:56.166409 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '2fede669-343a-45ae-bce1-c67cbc9d27a1'} Aug 27 03:31:56.166409 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:31:56.166409 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:31:56.166409 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:31:56.166409 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:31:56.166409 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:31:56.166409 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:31:56.166409 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:31:56.166409 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:31:56.166409 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:31:56.166409 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:31:56.166409 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2fede669-343a-45ae-bce1-c67cbc9d27a1 could not be found. Aug 27 03:31:56.166409 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:31:56.166409 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:31:56.166409 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:31:56.166409 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:31:56.166409 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:31:56.166409 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:31:56.166409 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:31:56.166409 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:31:56.166409 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:31:56.166409 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:31:56.166409 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:31:56.166409 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:31:56.166409 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:31:56.166409 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:31:56.166409 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:31:56.166409 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:31:56.166409 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2fede669-343a-45ae-bce1-c67cbc9d27a1 could not be found. Aug 27 03:31:56.166409 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:31:56.166409 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:31:56.166409 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:31:56.172526 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:31:56.172526 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:31:56.172526 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:31:56.172526 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:31:56.172526 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:31:56.172526 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2fede669-343a-45ae-bce1-c67cbc9d27a1 could not be found. Aug 27 03:31:56.172526 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:31:56.172526 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-daf0b820-b2eb-4c59-931c-e974ba148da4 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Returning 404 to user: Instance 2fede669-343a-45ae-bce1-c67cbc9d27a1 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:31:56.172526 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-daf0b820-b2eb-4c59-931c-e974ba148da4 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] 10.222.0.70 "GET /compute/v2.1/servers/2fede669-343a-45ae-bce1-c67cbc9d27a1" status: 404 len: 111 microversion: 2.1 time: 0.037303 Aug 27 03:31:56.172526 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3095/6146] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:56 2022] GET /compute/v2.1/servers/2fede669-343a-45ae-bce1-c67cbc9d27a1 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:31:56.337625 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0ab87e9b-b000-488e-8c83-9f77d1deba3f tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Calling method '.version_select at 0x7f5ee309f3a0>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:56.363134 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-0ab87e9b-b000-488e-8c83-9f77d1deba3f tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1295074168" status: 202 len: 0 microversion: 2.1 time: 0.029841 Aug 27 03:31:56.363923 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3052/6147] 10.222.0.70 () {58 vars in 1257 bytes} [Sat Aug 27 03:31:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1295074168 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:31:58.187103 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-d16bc01a-61d4-41f8-9432-227576db7560 req-85095c50-ab57-45be-a8ae-67651ab84d84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12125aad-1a79-43eb-9048-d954269a2700", "tag": "c7f8adac-b14f-4783-934f-5b72b95973b2"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:58.187877 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d371914f-e2b3-4cc0-b925-8fe62523c240 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:58.188264 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d371914f-e2b3-4cc0-b925-8fe62523c240 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] [instance: 12125aad-1a79-43eb-9048-d954269a2700] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:58.195842 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d371914f-e2b3-4cc0-b925-8fe62523c240 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:58.196352 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d371914f-e2b3-4cc0-b925-8fe62523c240 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:58.196842 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d371914f-e2b3-4cc0-b925-8fe62523c240 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:58.197562 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d371914f-e2b3-4cc0-b925-8fe62523c240 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:58.198012 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d371914f-e2b3-4cc0-b925-8fe62523c240 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:58.198491 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d371914f-e2b3-4cc0-b925-8fe62523c240 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:58.198618 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-d16bc01a-61d4-41f8-9432-227576db7560 req-85095c50-ab57-45be-a8ae-67651ab84d84 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:58.199151 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-d16bc01a-61d4-41f8-9432-227576db7560 req-85095c50-ab57-45be-a8ae-67651ab84d84 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:58.199670 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-d16bc01a-61d4-41f8-9432-227576db7560 req-85095c50-ab57-45be-a8ae-67651ab84d84 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:58.210814 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-d16bc01a-61d4-41f8-9432-227576db7560 req-85095c50-ab57-45be-a8ae-67651ab84d84 service nova] Creating event network-changed:c7f8adac-b14f-4783-934f-5b72b95973b2 for instance 12125aad-1a79-43eb-9048-d954269a2700 on n-h2-852278-4 Aug 27 03:31:58.217063 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-d16bc01a-61d4-41f8-9432-227576db7560 req-85095c50-ab57-45be-a8ae-67651ab84d84 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034459 Aug 27 03:31:58.218063 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3053/6148] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:31:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:31:58.238138 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d371914f-e2b3-4cc0-b925-8fe62523c240 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] [instance: 12125aad-1a79-43eb-9048-d954269a2700] Going to try to terminate instance {{(pid=134051) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:31:58.326516 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d371914f-e2b3-4cc0-b925-8fe62523c240 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] 10.222.0.70 "DELETE /compute/v2.1/servers/12125aad-1a79-43eb-9048-d954269a2700" status: 204 len: 0 microversion: 2.1 time: 0.146235 Aug 27 03:31:58.327950 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3096/6149] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 03:31:58 2022] DELETE /compute/v2.1/servers/12125aad-1a79-43eb-9048-d954269a2700 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:31:58.337580 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e5706987-d237-4f58-876c-3153fa7b13cf tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:58.338719 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-e5706987-d237-4f58-876c-3153fa7b13cf tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] [instance: 12125aad-1a79-43eb-9048-d954269a2700] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:58.346216 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e5706987-d237-4f58-876c-3153fa7b13cf tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:58.346925 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e5706987-d237-4f58-876c-3153fa7b13cf tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:58.347667 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e5706987-d237-4f58-876c-3153fa7b13cf tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:58.348411 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e5706987-d237-4f58-876c-3153fa7b13cf tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:58.348866 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e5706987-d237-4f58-876c-3153fa7b13cf tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:58.349293 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e5706987-d237-4f58-876c-3153fa7b13cf tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:58.487332 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-e5706987-d237-4f58-876c-3153fa7b13cf tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08cd6a89f36c44d49bb2baabc9d3bd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adf9e5b8bb54b1589c1b331febab9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:58.495370 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e5706987-d237-4f58-876c-3153fa7b13cf tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] 10.222.0.70 "GET /compute/v2.1/servers/12125aad-1a79-43eb-9048-d954269a2700" status: 200 len: 1673 microversion: 2.1 time: 0.162660 Aug 27 03:31:58.496031 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3054/6150] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:58 2022] GET /compute/v2.1/servers/12125aad-1a79-43eb-9048-d954269a2700 => generated 1673 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:59.519268 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ff1b5411-259c-47a9-99f0-77b6790d68fb tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:59.520123 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-ff1b5411-259c-47a9-99f0-77b6790d68fb tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] [instance: 12125aad-1a79-43eb-9048-d954269a2700] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:59.528724 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ff1b5411-259c-47a9-99f0-77b6790d68fb tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:59.529315 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ff1b5411-259c-47a9-99f0-77b6790d68fb tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:59.529842 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ff1b5411-259c-47a9-99f0-77b6790d68fb tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:59.530684 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ff1b5411-259c-47a9-99f0-77b6790d68fb tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:59.531294 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ff1b5411-259c-47a9-99f0-77b6790d68fb tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:59.531807 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ff1b5411-259c-47a9-99f0-77b6790d68fb tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:59.854405 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-ff1b5411-259c-47a9-99f0-77b6790d68fb tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08cd6a89f36c44d49bb2baabc9d3bd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adf9e5b8bb54b1589c1b331febab9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:59.863103 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ff1b5411-259c-47a9-99f0-77b6790d68fb tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] 10.222.0.70 "GET /compute/v2.1/servers/12125aad-1a79-43eb-9048-d954269a2700" status: 200 len: 1673 microversion: 2.1 time: 0.349268 Aug 27 03:31:59.876576 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3097/6151] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:59 2022] GET /compute/v2.1/servers/12125aad-1a79-43eb-9048-d954269a2700 => generated 1673 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:00.629491 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-c280ba3b-3ce0-49f5-b873-c2a695ceda62 req-ed39e94a-14d9-4680-9d01-4ce180e1a447 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12125aad-1a79-43eb-9048-d954269a2700", "name": "network-vif-deleted", "tag": "c7f8adac-b14f-4783-934f-5b72b95973b2"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:32:00.641050 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-c280ba3b-3ce0-49f5-b873-c2a695ceda62 req-ed39e94a-14d9-4680-9d01-4ce180e1a447 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:00.641535 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-c280ba3b-3ce0-49f5-b873-c2a695ceda62 req-ed39e94a-14d9-4680-9d01-4ce180e1a447 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:00.641969 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-c280ba3b-3ce0-49f5-b873-c2a695ceda62 req-ed39e94a-14d9-4680-9d01-4ce180e1a447 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:00.657242 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-c280ba3b-3ce0-49f5-b873-c2a695ceda62 req-ed39e94a-14d9-4680-9d01-4ce180e1a447 service nova] Creating event network-vif-deleted:c7f8adac-b14f-4783-934f-5b72b95973b2 for instance 12125aad-1a79-43eb-9048-d954269a2700 on n-h2-852278-4 Aug 27 03:32:00.662253 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-c280ba3b-3ce0-49f5-b873-c2a695ceda62 req-ed39e94a-14d9-4680-9d01-4ce180e1a447 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036765 Aug 27 03:32:00.662867 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3055/6152] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:32:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:32:00.886822 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-94dd00f0-4817-4016-ac1e-ebc4e182e283 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:00.887406 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-94dd00f0-4817-4016-ac1e-ebc4e182e283 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] [instance: 12125aad-1a79-43eb-9048-d954269a2700] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:00.896597 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-94dd00f0-4817-4016-ac1e-ebc4e182e283 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:00.897284 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-94dd00f0-4817-4016-ac1e-ebc4e182e283 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:00.897916 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-94dd00f0-4817-4016-ac1e-ebc4e182e283 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:00.898981 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-94dd00f0-4817-4016-ac1e-ebc4e182e283 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:00.899645 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-94dd00f0-4817-4016-ac1e-ebc4e182e283 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:00.900091 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-94dd00f0-4817-4016-ac1e-ebc4e182e283 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:00.941423 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-94dd00f0-4817-4016-ac1e-ebc4e182e283 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:00.942156 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-94dd00f0-4817-4016-ac1e-ebc4e182e283 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:00.942325 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-94dd00f0-4817-4016-ac1e-ebc4e182e283 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:00.942796 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.objects.instance [None req-94dd00f0-4817-4016-ac1e-ebc4e182e283 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lazy-loading 'fault' on Instance uuid 12125aad-1a79-43eb-9048-d954269a2700 {{(pid=134051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:32:00.990494 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-94dd00f0-4817-4016-ac1e-ebc4e182e283 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08cd6a89f36c44d49bb2baabc9d3bd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adf9e5b8bb54b1589c1b331febab9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:00.998908 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-94dd00f0-4817-4016-ac1e-ebc4e182e283 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] 10.222.0.70 "GET /compute/v2.1/servers/12125aad-1a79-43eb-9048-d954269a2700" status: 200 len: 1339 microversion: 2.1 time: 0.117693 Aug 27 03:32:00.999532 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3098/6153] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:00 2022] GET /compute/v2.1/servers/12125aad-1a79-43eb-9048-d954269a2700 => generated 1339 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:02.022962 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8273f882-d4f9-4010-8c98-909f8e9b91ef tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:02.023640 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-8273f882-d4f9-4010-8c98-909f8e9b91ef tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] [instance: 12125aad-1a79-43eb-9048-d954269a2700] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:02.031025 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8273f882-d4f9-4010-8c98-909f8e9b91ef tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:02.031551 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8273f882-d4f9-4010-8c98-909f8e9b91ef tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:02.032032 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8273f882-d4f9-4010-8c98-909f8e9b91ef tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:02.032803 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8273f882-d4f9-4010-8c98-909f8e9b91ef tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:02.033295 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8273f882-d4f9-4010-8c98-909f8e9b91ef tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:02.033803 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8273f882-d4f9-4010-8c98-909f8e9b91ef tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:02.049052 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-8273f882-d4f9-4010-8c98-909f8e9b91ef tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] HTTP exception thrown: Instance 12125aad-1a79-43eb-9048-d954269a2700 could not be found. Aug 27 03:32:02.050678 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8273f882-d4f9-4010-8c98-909f8e9b91ef tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Request method failure captured: Aug 27 03:32:02.050678 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/servers/12125aad-1a79-43eb-9048-d954269a2700 HTTP/1.1 Aug 27 03:32:02.050678 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 03:32:02.050678 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 03:32:02.050678 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 03:32:02.050678 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 03:32:02.050678 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 03:32:02.050678 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 03:32:02.050678 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 03:32:02.050678 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 03:32:02.050678 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCY_I_RkkR7PFz1DFGGeu-U4G7d0gma6-SuMR2AffAoxmFKPFKovW8E4o1RgWlj_eXnbt3vBettZe9Q6OaevSxA1t4nDe4Sy6hmqld-zqIpOj3DQgwtha_-uid63sjN99vwTMcUAOi2jrr0wQGIbsU-W_Knbx1KJ-STnqJufBdD63E0Y Aug 27 03:32:02.050678 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 03:32:02.050678 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 03:32:02.050678 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 03:32:02.050678 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 03:32:02.050678 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 03:32:02.050678 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 03:32:02.050678 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 4adf9e5b8bb54b1589c1b331febab9db Aug 27 03:32:02.050678 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-TestNetworkBasicOps-938726110 Aug 27 03:32:02.050678 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 03:32:02.050678 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 03:32:02.050678 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4adf9e5b8bb54b1589c1b331febab9db"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_4adf9e5b8bb54b1589c1b331febab9db", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4adf9e5b8bb54b1589c1b331febab9db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/4adf9e5b8bb54b1589c1b331febab9db"}]}] Aug 27 03:32:02.050678 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-TestNetworkBasicOps-938726110 Aug 27 03:32:02.050678 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 4adf9e5b8bb54b1589c1b331febab9db Aug 27 03:32:02.050678 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-TestNetworkBasicOps-938726110 Aug 27 03:32:02.050678 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-TestNetworkBasicOps-938726110-project Aug 27 03:32:02.050678 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 03:32:02.050678 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 03:32:02.050678 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 08cd6a89f36c44d49bb2baabc9d3bd1b Aug 27 03:32:02.050678 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-TestNetworkBasicOps-938726110-project Aug 27 03:32:02.050678 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 03:32:02.050678 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance 12125aad-1a79-43eb-9048-d954269a2700 could not be found. Aug 27 03:32:02.050678 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '12125aad-1a79-43eb-9048-d954269a2700'} Aug 27 03:32:02.050678 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:32:02.050678 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:32:02.050678 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:32:02.050678 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:32:02.050678 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:32:02.050678 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:32:02.050678 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:32:02.050678 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:32:02.050678 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:32:02.050678 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:32:02.050678 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12125aad-1a79-43eb-9048-d954269a2700 could not be found. Aug 27 03:32:02.050678 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:32:02.050678 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:32:02.050678 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:32:02.050678 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:32:02.050678 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:32:02.050678 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:32:02.050678 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:32:02.050678 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:32:02.050678 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:32:02.050678 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:32:02.050678 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:32:02.050678 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:32:02.050678 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:32:02.050678 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:32:02.050678 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:32:02.050678 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:32:02.050678 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12125aad-1a79-43eb-9048-d954269a2700 could not be found. Aug 27 03:32:02.050678 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:32:02.050678 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:32:02.050678 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:32:02.055342 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:32:02.055342 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:32:02.055342 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:32:02.055342 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:32:02.055342 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:32:02.055342 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12125aad-1a79-43eb-9048-d954269a2700 could not be found. Aug 27 03:32:02.055342 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:32:02.055342 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8273f882-d4f9-4010-8c98-909f8e9b91ef tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Returning 404 to user: Instance 12125aad-1a79-43eb-9048-d954269a2700 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:32:02.055342 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-8273f882-d4f9-4010-8c98-909f8e9b91ef tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] 10.222.0.70 "GET /compute/v2.1/servers/12125aad-1a79-43eb-9048-d954269a2700" status: 404 len: 111 microversion: 2.1 time: 0.035304 Aug 27 03:32:02.055342 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3056/6154] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:02 2022] GET /compute/v2.1/servers/12125aad-1a79-43eb-9048-d954269a2700 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:32:02.219727 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-9ad06822-c6c2-4388-9748-c9de0c3cd02a tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Calling method '.version_select at 0x7f5ede2441f0>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:02.246735 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-9ad06822-c6c2-4388-9748-c9de0c3cd02a tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1150104251" status: 202 len: 0 microversion: 2.1 time: 0.031421 Aug 27 03:32:02.247481 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3099/6155] 10.222.0.70 () {58 vars in 1257 bytes} [Sat Aug 27 03:32:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1150104251 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:32:10.454636 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-466a40de-86ba-418e-8e87-88c034192e37 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Action: 'create', calling method: .version_select at 0x7f5ee727b4c0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1960259258", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBtIjP108IswFylRq37IGw1FaGaCIqTINF0/i5gP2YxofMhn5qSY5g6NWWOk+izOQJUrP7ecDpFEYdSN3vVt2RbnG/pKATf245XbVcDOPvaIIGETQ7DWpy8dJlaN/NtzcA=="}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:32:10.461586 n-d-852278-4 devstack@n-api.service[134052]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:32:10.461794 n-d-852278-4 devstack@n-api.service[134052]: Sat Aug 27 03:32:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.70) !!! Aug 27 03:32:10.477067 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-466a40de-86ba-418e-8e87-88c034192e37 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Getting quotas for project 4adf9e5b8bb54b1589c1b331febab9db. Resources: {'key_pairs'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:32:10.484127 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-466a40de-86ba-418e-8e87-88c034192e37 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Getting quotas for user 08cd6a89f36c44d49bb2baabc9d3bd1b and project 4adf9e5b8bb54b1589c1b331febab9db. Resources: {'key_pairs'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:32:10.516695 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-466a40de-86ba-418e-8e87-88c034192e37 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.066316 Aug 27 03:32:10.521733 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3057/6156] 10.222.0.70 () {60 vars in 1159 bytes} [Sat Aug 27 03:32:10 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:32:11.709963 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-42611d7b-f000-4b7a-90d6-4cdbc1140375 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1471435501", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "networks": [{"uuid": "fb7648d3-4d4a-43fc-810e-0f9be31b101b"}], "key_name": "tempest-TestNetworkBasicOps-1960259258", "security_groups": [{"name": "tempest-secgroup-smoke-85350546"}]}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:32:11.723014 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:32:11.820343 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.network.neutron [None req-42611d7b-f000-4b7a-90d6-4cdbc1140375 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] validate_networks() for [('fb7648d3-4d4a-43fc-810e-0f9be31b101b', None, None, None, None, None)] {{(pid=134051) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:32:12.248739 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-42611d7b-f000-4b7a-90d6-4cdbc1140375 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Flavor limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:32:12.249325 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-42611d7b-f000-4b7a-90d6-4cdbc1140375 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Image limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:32:12.249818 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-42611d7b-f000-4b7a-90d6-4cdbc1140375 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Flavor pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:32:12.250242 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-42611d7b-f000-4b7a-90d6-4cdbc1140375 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Image pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:32:12.250674 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-42611d7b-f000-4b7a-90d6-4cdbc1140375 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:32:12.260149 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-42611d7b-f000-4b7a-90d6-4cdbc1140375 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:12.260683 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-42611d7b-f000-4b7a-90d6-4cdbc1140375 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:12.261137 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-42611d7b-f000-4b7a-90d6-4cdbc1140375 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:12.261888 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-42611d7b-f000-4b7a-90d6-4cdbc1140375 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:12.262354 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-42611d7b-f000-4b7a-90d6-4cdbc1140375 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:12.262793 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-42611d7b-f000-4b7a-90d6-4cdbc1140375 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:12.281515 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-42611d7b-f000-4b7a-90d6-4cdbc1140375 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Getting quotas for project 4adf9e5b8bb54b1589c1b331febab9db. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:32:12.287181 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-42611d7b-f000-4b7a-90d6-4cdbc1140375 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Getting quotas for user 08cd6a89f36c44d49bb2baabc9d3bd1b and project 4adf9e5b8bb54b1589c1b331febab9db. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:32:12.301682 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-42611d7b-f000-4b7a-90d6-4cdbc1140375 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Going to run 1 instances... {{(pid=134051) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:32:12.304086 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-42611d7b-f000-4b7a-90d6-4cdbc1140375 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] [instance: 7e2ddab0-69d0-48ba-9305-e66c198895c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134051) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:32:12.355174 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-42611d7b-f000-4b7a-90d6-4cdbc1140375 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.649620 Aug 27 03:32:12.355914 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3100/6157] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 03:32:11 2022] POST /compute/v2.1/servers => generated 404 bytes in 651 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:32:12.365573 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:32:12.370249 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d445fb9d-a151-4b5f-a8b3-1843c6ec7ef5 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:12.371107 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d445fb9d-a151-4b5f-a8b3-1843c6ec7ef5 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] [instance: 7e2ddab0-69d0-48ba-9305-e66c198895c8] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:12.433811 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-d445fb9d-a151-4b5f-a8b3-1843c6ec7ef5 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08cd6a89f36c44d49bb2baabc9d3bd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adf9e5b8bb54b1589c1b331febab9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:12.441650 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d445fb9d-a151-4b5f-a8b3-1843c6ec7ef5 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] 10.222.0.70 "GET /compute/v2.1/servers/7e2ddab0-69d0-48ba-9305-e66c198895c8" status: 200 len: 1249 microversion: 2.1 time: 0.077986 Aug 27 03:32:12.442327 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3058/6158] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:12 2022] GET /compute/v2.1/servers/7e2ddab0-69d0-48ba-9305-e66c198895c8 => generated 1249 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:13.465288 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-57f33103-bdac-40be-a224-c4447fae8273 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:13.466019 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-57f33103-bdac-40be-a224-c4447fae8273 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] [instance: 7e2ddab0-69d0-48ba-9305-e66c198895c8] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:13.473156 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-57f33103-bdac-40be-a224-c4447fae8273 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:13.473744 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-57f33103-bdac-40be-a224-c4447fae8273 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:13.474279 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-57f33103-bdac-40be-a224-c4447fae8273 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:13.475061 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-57f33103-bdac-40be-a224-c4447fae8273 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:13.475803 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-57f33103-bdac-40be-a224-c4447fae8273 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:13.476336 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-57f33103-bdac-40be-a224-c4447fae8273 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:13.543831 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-57f33103-bdac-40be-a224-c4447fae8273 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08cd6a89f36c44d49bb2baabc9d3bd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adf9e5b8bb54b1589c1b331febab9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:13.553120 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-57f33103-bdac-40be-a224-c4447fae8273 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] 10.222.0.70 "GET /compute/v2.1/servers/7e2ddab0-69d0-48ba-9305-e66c198895c8" status: 200 len: 1245 microversion: 2.1 time: 0.094355 Aug 27 03:32:13.554051 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3101/6159] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:13 2022] GET /compute/v2.1/servers/7e2ddab0-69d0-48ba-9305-e66c198895c8 => generated 1245 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:14.575025 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-86965440-1989-4349-a196-45c2a57fbf0c tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:14.575566 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-86965440-1989-4349-a196-45c2a57fbf0c tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] [instance: 7e2ddab0-69d0-48ba-9305-e66c198895c8] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:14.583066 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-86965440-1989-4349-a196-45c2a57fbf0c tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:14.583549 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-86965440-1989-4349-a196-45c2a57fbf0c tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:14.583990 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-86965440-1989-4349-a196-45c2a57fbf0c tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:14.584720 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-86965440-1989-4349-a196-45c2a57fbf0c tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:14.585198 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-86965440-1989-4349-a196-45c2a57fbf0c tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:14.585625 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-86965440-1989-4349-a196-45c2a57fbf0c tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:14.815782 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-86965440-1989-4349-a196-45c2a57fbf0c tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08cd6a89f36c44d49bb2baabc9d3bd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adf9e5b8bb54b1589c1b331febab9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:14.823687 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-86965440-1989-4349-a196-45c2a57fbf0c tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] 10.222.0.70 "GET /compute/v2.1/servers/7e2ddab0-69d0-48ba-9305-e66c198895c8" status: 200 len: 1373 microversion: 2.1 time: 0.252917 Aug 27 03:32:14.824273 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3059/6160] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:14 2022] GET /compute/v2.1/servers/7e2ddab0-69d0-48ba-9305-e66c198895c8 => generated 1373 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:15.373060 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-276e3c43-63ac-4fba-bfdd-49d24e1a0815 req-b4634a6c-c76e-42f3-9693-6e124aa11907 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e2ddab0-69d0-48ba-9305-e66c198895c8", "tag": "652b7103-7819-46e4-9fa3-fcaef5015903"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:32:15.398571 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-276e3c43-63ac-4fba-bfdd-49d24e1a0815 req-b4634a6c-c76e-42f3-9693-6e124aa11907 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:15.400036 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-276e3c43-63ac-4fba-bfdd-49d24e1a0815 req-b4634a6c-c76e-42f3-9693-6e124aa11907 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:15.400857 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-276e3c43-63ac-4fba-bfdd-49d24e1a0815 req-b4634a6c-c76e-42f3-9693-6e124aa11907 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:15.414217 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-276e3c43-63ac-4fba-bfdd-49d24e1a0815 req-b4634a6c-c76e-42f3-9693-6e124aa11907 service nova] Creating event network-changed:652b7103-7819-46e4-9fa3-fcaef5015903 for instance 7e2ddab0-69d0-48ba-9305-e66c198895c8 on n-h2-852278-4 Aug 27 03:32:15.420203 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-276e3c43-63ac-4fba-bfdd-49d24e1a0815 req-b4634a6c-c76e-42f3-9693-6e124aa11907 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054087 Aug 27 03:32:15.422145 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3102/6161] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:32:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:32:15.844669 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-2b11d89d-8b47-470f-a03e-0acb3cb42127 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:15.845195 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-2b11d89d-8b47-470f-a03e-0acb3cb42127 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] [instance: 7e2ddab0-69d0-48ba-9305-e66c198895c8] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:15.853719 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2b11d89d-8b47-470f-a03e-0acb3cb42127 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:15.854216 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2b11d89d-8b47-470f-a03e-0acb3cb42127 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:15.854658 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2b11d89d-8b47-470f-a03e-0acb3cb42127 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:15.855360 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2b11d89d-8b47-470f-a03e-0acb3cb42127 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:15.855821 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2b11d89d-8b47-470f-a03e-0acb3cb42127 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:15.856207 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2b11d89d-8b47-470f-a03e-0acb3cb42127 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:15.997910 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-2b11d89d-8b47-470f-a03e-0acb3cb42127 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08cd6a89f36c44d49bb2baabc9d3bd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adf9e5b8bb54b1589c1b331febab9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:16.006709 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-2b11d89d-8b47-470f-a03e-0acb3cb42127 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] 10.222.0.70 "GET /compute/v2.1/servers/7e2ddab0-69d0-48ba-9305-e66c198895c8" status: 200 len: 1373 microversion: 2.1 time: 0.166194 Aug 27 03:32:16.007272 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3060/6162] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:15 2022] GET /compute/v2.1/servers/7e2ddab0-69d0-48ba-9305-e66c198895c8 => generated 1373 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:17.028382 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ca85b0e2-6ff6-4a2a-a376-5ffc03b0a281 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:17.029011 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-ca85b0e2-6ff6-4a2a-a376-5ffc03b0a281 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] [instance: 7e2ddab0-69d0-48ba-9305-e66c198895c8] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:17.037412 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ca85b0e2-6ff6-4a2a-a376-5ffc03b0a281 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:17.037927 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ca85b0e2-6ff6-4a2a-a376-5ffc03b0a281 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:17.038389 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ca85b0e2-6ff6-4a2a-a376-5ffc03b0a281 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:17.039128 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ca85b0e2-6ff6-4a2a-a376-5ffc03b0a281 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:17.039601 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ca85b0e2-6ff6-4a2a-a376-5ffc03b0a281 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:17.040042 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ca85b0e2-6ff6-4a2a-a376-5ffc03b0a281 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:17.264422 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-ca85b0e2-6ff6-4a2a-a376-5ffc03b0a281 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08cd6a89f36c44d49bb2baabc9d3bd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adf9e5b8bb54b1589c1b331febab9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:17.272823 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ca85b0e2-6ff6-4a2a-a376-5ffc03b0a281 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] 10.222.0.70 "GET /compute/v2.1/servers/7e2ddab0-69d0-48ba-9305-e66c198895c8" status: 200 len: 1373 microversion: 2.1 time: 0.249074 Aug 27 03:32:17.273423 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3103/6163] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:17 2022] GET /compute/v2.1/servers/7e2ddab0-69d0-48ba-9305-e66c198895c8 => generated 1373 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:18.299027 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8373161c-bdf3-463d-a88b-d266365f25ff tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:18.299602 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-8373161c-bdf3-463d-a88b-d266365f25ff tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] [instance: 7e2ddab0-69d0-48ba-9305-e66c198895c8] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:18.307223 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8373161c-bdf3-463d-a88b-d266365f25ff tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:18.307711 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8373161c-bdf3-463d-a88b-d266365f25ff tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:18.308145 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8373161c-bdf3-463d-a88b-d266365f25ff tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:18.308873 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8373161c-bdf3-463d-a88b-d266365f25ff tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:18.309320 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8373161c-bdf3-463d-a88b-d266365f25ff tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:18.309746 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8373161c-bdf3-463d-a88b-d266365f25ff tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:18.448937 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-8373161c-bdf3-463d-a88b-d266365f25ff tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08cd6a89f36c44d49bb2baabc9d3bd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adf9e5b8bb54b1589c1b331febab9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:18.459682 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-8373161c-bdf3-463d-a88b-d266365f25ff tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] 10.222.0.70 "GET /compute/v2.1/servers/7e2ddab0-69d0-48ba-9305-e66c198895c8" status: 200 len: 1373 microversion: 2.1 time: 0.167706 Aug 27 03:32:18.460266 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3061/6164] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:18 2022] GET /compute/v2.1/servers/7e2ddab0-69d0-48ba-9305-e66c198895c8 => generated 1373 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:19.484150 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f2b96116-9cdd-4a5d-977c-ccdca552bc98 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:19.484997 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-f2b96116-9cdd-4a5d-977c-ccdca552bc98 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] [instance: 7e2ddab0-69d0-48ba-9305-e66c198895c8] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:19.496605 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f2b96116-9cdd-4a5d-977c-ccdca552bc98 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:19.497365 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f2b96116-9cdd-4a5d-977c-ccdca552bc98 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:19.498138 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f2b96116-9cdd-4a5d-977c-ccdca552bc98 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:19.499282 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f2b96116-9cdd-4a5d-977c-ccdca552bc98 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:19.500062 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f2b96116-9cdd-4a5d-977c-ccdca552bc98 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:19.500865 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f2b96116-9cdd-4a5d-977c-ccdca552bc98 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:19.644932 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-f2b96116-9cdd-4a5d-977c-ccdca552bc98 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08cd6a89f36c44d49bb2baabc9d3bd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adf9e5b8bb54b1589c1b331febab9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:19.653337 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-f2b96116-9cdd-4a5d-977c-ccdca552bc98 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] 10.222.0.70 "GET /compute/v2.1/servers/7e2ddab0-69d0-48ba-9305-e66c198895c8" status: 200 len: 1373 microversion: 2.1 time: 0.175745 Aug 27 03:32:19.653882 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3104/6165] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:19 2022] GET /compute/v2.1/servers/7e2ddab0-69d0-48ba-9305-e66c198895c8 => generated 1373 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:20.675893 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6a57f04e-b67e-4edf-91b3-404331a4e3fe tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:20.676564 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-6a57f04e-b67e-4edf-91b3-404331a4e3fe tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] [instance: 7e2ddab0-69d0-48ba-9305-e66c198895c8] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:20.683651 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6a57f04e-b67e-4edf-91b3-404331a4e3fe tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:20.684132 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6a57f04e-b67e-4edf-91b3-404331a4e3fe tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:20.684870 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6a57f04e-b67e-4edf-91b3-404331a4e3fe tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:20.685804 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6a57f04e-b67e-4edf-91b3-404331a4e3fe tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:20.685994 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6a57f04e-b67e-4edf-91b3-404331a4e3fe tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:20.686448 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6a57f04e-b67e-4edf-91b3-404331a4e3fe tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:20.771926 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-5153d0ba-6125-4bfe-89f1-fc47775986e1 req-627dadef-5aaa-473a-b5da-5f3e97ea6b02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e2ddab0-69d0-48ba-9305-e66c198895c8", "name": "network-vif-plugged", "status": "completed", "tag": "652b7103-7819-46e4-9fa3-fcaef5015903"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:32:20.782050 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-5153d0ba-6125-4bfe-89f1-fc47775986e1 req-627dadef-5aaa-473a-b5da-5f3e97ea6b02 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:20.782521 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-5153d0ba-6125-4bfe-89f1-fc47775986e1 req-627dadef-5aaa-473a-b5da-5f3e97ea6b02 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:20.783011 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-5153d0ba-6125-4bfe-89f1-fc47775986e1 req-627dadef-5aaa-473a-b5da-5f3e97ea6b02 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:20.798212 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-5153d0ba-6125-4bfe-89f1-fc47775986e1 req-627dadef-5aaa-473a-b5da-5f3e97ea6b02 service nova] Creating event network-vif-plugged:652b7103-7819-46e4-9fa3-fcaef5015903 for instance 7e2ddab0-69d0-48ba-9305-e66c198895c8 on n-h2-852278-4 Aug 27 03:32:20.803647 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-5153d0ba-6125-4bfe-89f1-fc47775986e1 req-627dadef-5aaa-473a-b5da-5f3e97ea6b02 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125256 Aug 27 03:32:20.804330 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3105/6166] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:32:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:32:20.837391 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-6a57f04e-b67e-4edf-91b3-404331a4e3fe tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08cd6a89f36c44d49bb2baabc9d3bd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adf9e5b8bb54b1589c1b331febab9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:20.845685 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-6a57f04e-b67e-4edf-91b3-404331a4e3fe tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] 10.222.0.70 "GET /compute/v2.1/servers/7e2ddab0-69d0-48ba-9305-e66c198895c8" status: 200 len: 1373 microversion: 2.1 time: 0.174111 Aug 27 03:32:20.846262 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3062/6167] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:20 2022] GET /compute/v2.1/servers/7e2ddab0-69d0-48ba-9305-e66c198895c8 => generated 1373 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:21.873400 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7ac5f5f5-149f-461e-ac30-5f79ca665f13 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:21.874522 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-7ac5f5f5-149f-461e-ac30-5f79ca665f13 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] [instance: 7e2ddab0-69d0-48ba-9305-e66c198895c8] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:21.882362 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7ac5f5f5-149f-461e-ac30-5f79ca665f13 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:21.882872 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7ac5f5f5-149f-461e-ac30-5f79ca665f13 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:21.883347 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7ac5f5f5-149f-461e-ac30-5f79ca665f13 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:21.884098 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7ac5f5f5-149f-461e-ac30-5f79ca665f13 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:21.884582 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7ac5f5f5-149f-461e-ac30-5f79ca665f13 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:21.885045 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7ac5f5f5-149f-461e-ac30-5f79ca665f13 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:22.023377 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-7ac5f5f5-149f-461e-ac30-5f79ca665f13 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08cd6a89f36c44d49bb2baabc9d3bd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adf9e5b8bb54b1589c1b331febab9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:22.033294 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-7ac5f5f5-149f-461e-ac30-5f79ca665f13 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] 10.222.0.70 "GET /compute/v2.1/servers/7e2ddab0-69d0-48ba-9305-e66c198895c8" status: 200 len: 1373 microversion: 2.1 time: 0.168421 Aug 27 03:32:22.034374 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3106/6168] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:21 2022] GET /compute/v2.1/servers/7e2ddab0-69d0-48ba-9305-e66c198895c8 => generated 1373 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:23.056153 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6769621c-949a-44f1-8732-119e3aac05d4 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:23.056759 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-6769621c-949a-44f1-8732-119e3aac05d4 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] [instance: 7e2ddab0-69d0-48ba-9305-e66c198895c8] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:23.059675 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=6 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:32:23.060392 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:32:23.066826 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6769621c-949a-44f1-8732-119e3aac05d4 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:23.067341 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6769621c-949a-44f1-8732-119e3aac05d4 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:23.067801 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6769621c-949a-44f1-8732-119e3aac05d4 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:23.068640 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6769621c-949a-44f1-8732-119e3aac05d4 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:23.069127 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6769621c-949a-44f1-8732-119e3aac05d4 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:23.069565 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6769621c-949a-44f1-8732-119e3aac05d4 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:23.217875 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-6769621c-949a-44f1-8732-119e3aac05d4 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08cd6a89f36c44d49bb2baabc9d3bd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adf9e5b8bb54b1589c1b331febab9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:23.226402 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-6769621c-949a-44f1-8732-119e3aac05d4 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] 10.222.0.70 "GET /compute/v2.1/servers/7e2ddab0-69d0-48ba-9305-e66c198895c8" status: 200 len: 1544 microversion: 2.1 time: 0.174783 Aug 27 03:32:23.227008 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3063/6169] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:23 2022] GET /compute/v2.1/servers/7e2ddab0-69d0-48ba-9305-e66c198895c8 => generated 1544 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:23.246783 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ac9c3e84-ae17-441e-8749-f661f64ec98f tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:23.247462 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-ac9c3e84-ae17-441e-8749-f661f64ec98f tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] [instance: 7e2ddab0-69d0-48ba-9305-e66c198895c8] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:23.249548 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:32:23.250242 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=6 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:32:23.251976 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:32:23.257198 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ac9c3e84-ae17-441e-8749-f661f64ec98f tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:23.257689 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ac9c3e84-ae17-441e-8749-f661f64ec98f tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:23.258145 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ac9c3e84-ae17-441e-8749-f661f64ec98f tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:23.258844 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ac9c3e84-ae17-441e-8749-f661f64ec98f tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:23.259328 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ac9c3e84-ae17-441e-8749-f661f64ec98f tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:23.259778 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ac9c3e84-ae17-441e-8749-f661f64ec98f tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:23.413602 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-ac9c3e84-ae17-441e-8749-f661f64ec98f tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08cd6a89f36c44d49bb2baabc9d3bd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adf9e5b8bb54b1589c1b331febab9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:23.422169 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ac9c3e84-ae17-441e-8749-f661f64ec98f tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] 10.222.0.70 "GET /compute/v2.1/servers/7e2ddab0-69d0-48ba-9305-e66c198895c8" status: 200 len: 1544 microversion: 2.1 time: 0.179360 Aug 27 03:32:23.422756 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3107/6170] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:23 2022] GET /compute/v2.1/servers/7e2ddab0-69d0-48ba-9305-e66c198895c8 => generated 1544 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:25.104548 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-e1c2fa6c-93bb-46d2-a4f9-5e464784231f req-2d6cba3e-de2e-464d-9e0f-7ddcbc5eb5a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e2ddab0-69d0-48ba-9305-e66c198895c8", "tag": "652b7103-7819-46e4-9fa3-fcaef5015903"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:32:25.115166 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-e1c2fa6c-93bb-46d2-a4f9-5e464784231f req-2d6cba3e-de2e-464d-9e0f-7ddcbc5eb5a7 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:25.115656 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-e1c2fa6c-93bb-46d2-a4f9-5e464784231f req-2d6cba3e-de2e-464d-9e0f-7ddcbc5eb5a7 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:25.116060 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-e1c2fa6c-93bb-46d2-a4f9-5e464784231f req-2d6cba3e-de2e-464d-9e0f-7ddcbc5eb5a7 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:25.128290 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-e1c2fa6c-93bb-46d2-a4f9-5e464784231f req-2d6cba3e-de2e-464d-9e0f-7ddcbc5eb5a7 service nova] Creating event network-changed:652b7103-7819-46e4-9fa3-fcaef5015903 for instance 7e2ddab0-69d0-48ba-9305-e66c198895c8 on n-h2-852278-4 Aug 27 03:32:25.135368 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-e1c2fa6c-93bb-46d2-a4f9-5e464784231f req-2d6cba3e-de2e-464d-9e0f-7ddcbc5eb5a7 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034692 Aug 27 03:32:25.135972 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3064/6171] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:32:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:32:47.447841 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e7e32fb7-f08c-4a34-896e-718865fa457d tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:32:47.450178 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-e7e32fb7-f08c-4a34-896e-718865fa457d tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] [instance: 7e2ddab0-69d0-48ba-9305-e66c198895c8] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:47.452614 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:32:47.453279 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=36 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:32:47.460420 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e7e32fb7-f08c-4a34-896e-718865fa457d tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:47.460903 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e7e32fb7-f08c-4a34-896e-718865fa457d tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:47.461343 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e7e32fb7-f08c-4a34-896e-718865fa457d tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:47.462055 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e7e32fb7-f08c-4a34-896e-718865fa457d tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:47.462533 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e7e32fb7-f08c-4a34-896e-718865fa457d tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:47.462965 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e7e32fb7-f08c-4a34-896e-718865fa457d tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:47.527689 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e7e32fb7-f08c-4a34-896e-718865fa457d tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] 10.222.0.70 "POST /compute/v2.1/servers/7e2ddab0-69d0-48ba-9305-e66c198895c8/action" status: 200 len: 24568 microversion: 2.1 time: 0.083791 Aug 27 03:32:47.528450 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3108/6172] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:32:47 2022] POST /compute/v2.1/servers/7e2ddab0-69d0-48ba-9305-e66c198895c8/action => generated 24568 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:32:53.985617 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=3 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:32:53.986367 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=32 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:32:53.990862 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-2b492d9d-e7db-40c6-bb17-1e2c71e9e139 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:32:53.993192 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-2b492d9d-e7db-40c6-bb17-1e2c71e9e139 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] [instance: 7e2ddab0-69d0-48ba-9305-e66c198895c8] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:54.000330 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2b492d9d-e7db-40c6-bb17-1e2c71e9e139 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:54.000810 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2b492d9d-e7db-40c6-bb17-1e2c71e9e139 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:54.001245 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2b492d9d-e7db-40c6-bb17-1e2c71e9e139 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:54.001945 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2b492d9d-e7db-40c6-bb17-1e2c71e9e139 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:54.002397 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2b492d9d-e7db-40c6-bb17-1e2c71e9e139 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:54.002854 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2b492d9d-e7db-40c6-bb17-1e2c71e9e139 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:54.058779 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-2b492d9d-e7db-40c6-bb17-1e2c71e9e139 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] 10.222.0.70 "POST /compute/v2.1/servers/7e2ddab0-69d0-48ba-9305-e66c198895c8/action" status: 200 len: 32638 microversion: 2.1 time: 0.075176 Aug 27 03:32:54.059418 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3065/6173] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:32:53 2022] POST /compute/v2.1/servers/7e2ddab0-69d0-48ba-9305-e66c198895c8/action => generated 32638 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:32:55.088500 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-de4ffc06-d39c-43e0-ba30-d6e6f213765d tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:55.089169 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-de4ffc06-d39c-43e0-ba30-d6e6f213765d tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] [instance: 7e2ddab0-69d0-48ba-9305-e66c198895c8] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:55.090919 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-a8ba5db2-0aae-43f4-b9a1-1bedd794b676 req-a4b7f308-d35b-4e8c-b7bb-639db50f6a83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e2ddab0-69d0-48ba-9305-e66c198895c8", "tag": "652b7103-7819-46e4-9fa3-fcaef5015903"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:32:55.097260 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-de4ffc06-d39c-43e0-ba30-d6e6f213765d tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:55.097856 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-de4ffc06-d39c-43e0-ba30-d6e6f213765d tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:55.098843 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-de4ffc06-d39c-43e0-ba30-d6e6f213765d tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:55.099172 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-de4ffc06-d39c-43e0-ba30-d6e6f213765d tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:55.099705 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-de4ffc06-d39c-43e0-ba30-d6e6f213765d tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:55.100213 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-de4ffc06-d39c-43e0-ba30-d6e6f213765d tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:55.103744 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-a8ba5db2-0aae-43f4-b9a1-1bedd794b676 req-a4b7f308-d35b-4e8c-b7bb-639db50f6a83 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:55.104594 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-a8ba5db2-0aae-43f4-b9a1-1bedd794b676 req-a4b7f308-d35b-4e8c-b7bb-639db50f6a83 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:55.105667 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-a8ba5db2-0aae-43f4-b9a1-1bedd794b676 req-a4b7f308-d35b-4e8c-b7bb-639db50f6a83 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:55.119327 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-a8ba5db2-0aae-43f4-b9a1-1bedd794b676 req-a4b7f308-d35b-4e8c-b7bb-639db50f6a83 service nova] Creating event network-changed:652b7103-7819-46e4-9fa3-fcaef5015903 for instance 7e2ddab0-69d0-48ba-9305-e66c198895c8 on n-h2-852278-4 Aug 27 03:32:55.124622 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-a8ba5db2-0aae-43f4-b9a1-1bedd794b676 req-a4b7f308-d35b-4e8c-b7bb-639db50f6a83 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038289 Aug 27 03:32:55.126086 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3066/6174] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:32:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:32:55.130293 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-de4ffc06-d39c-43e0-ba30-d6e6f213765d tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] [instance: 7e2ddab0-69d0-48ba-9305-e66c198895c8] Going to try to terminate instance {{(pid=134051) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:32:55.226794 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-de4ffc06-d39c-43e0-ba30-d6e6f213765d tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] 10.222.0.70 "DELETE /compute/v2.1/servers/7e2ddab0-69d0-48ba-9305-e66c198895c8" status: 204 len: 0 microversion: 2.1 time: 0.142919 Aug 27 03:32:55.227777 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3109/6175] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 03:32:55 2022] DELETE /compute/v2.1/servers/7e2ddab0-69d0-48ba-9305-e66c198895c8 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:32:55.242182 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-15c1a201-be02-4989-a746-823c12d88e16 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:55.242987 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-15c1a201-be02-4989-a746-823c12d88e16 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] [instance: 7e2ddab0-69d0-48ba-9305-e66c198895c8] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:55.250856 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-15c1a201-be02-4989-a746-823c12d88e16 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:55.250856 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-15c1a201-be02-4989-a746-823c12d88e16 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:55.250856 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-15c1a201-be02-4989-a746-823c12d88e16 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:55.251661 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-15c1a201-be02-4989-a746-823c12d88e16 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:55.252466 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-15c1a201-be02-4989-a746-823c12d88e16 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:55.252881 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-15c1a201-be02-4989-a746-823c12d88e16 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:55.421070 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-15c1a201-be02-4989-a746-823c12d88e16 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08cd6a89f36c44d49bb2baabc9d3bd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adf9e5b8bb54b1589c1b331febab9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:55.430187 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-15c1a201-be02-4989-a746-823c12d88e16 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] 10.222.0.70 "GET /compute/v2.1/servers/7e2ddab0-69d0-48ba-9305-e66c198895c8" status: 200 len: 1669 microversion: 2.1 time: 0.195447 Aug 27 03:32:55.430772 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3067/6176] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:55 2022] GET /compute/v2.1/servers/7e2ddab0-69d0-48ba-9305-e66c198895c8 => generated 1669 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:56.456870 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-34e177ef-5b2f-4568-8002-b7ff39c46a37 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:56.457663 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-34e177ef-5b2f-4568-8002-b7ff39c46a37 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] [instance: 7e2ddab0-69d0-48ba-9305-e66c198895c8] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:56.467039 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-34e177ef-5b2f-4568-8002-b7ff39c46a37 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:56.467553 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-34e177ef-5b2f-4568-8002-b7ff39c46a37 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:56.468009 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-34e177ef-5b2f-4568-8002-b7ff39c46a37 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:56.468804 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-34e177ef-5b2f-4568-8002-b7ff39c46a37 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:56.469278 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-34e177ef-5b2f-4568-8002-b7ff39c46a37 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:56.469722 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-34e177ef-5b2f-4568-8002-b7ff39c46a37 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:56.778602 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-34e177ef-5b2f-4568-8002-b7ff39c46a37 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08cd6a89f36c44d49bb2baabc9d3bd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adf9e5b8bb54b1589c1b331febab9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:56.786984 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-34e177ef-5b2f-4568-8002-b7ff39c46a37 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] 10.222.0.70 "GET /compute/v2.1/servers/7e2ddab0-69d0-48ba-9305-e66c198895c8" status: 200 len: 1669 microversion: 2.1 time: 0.337085 Aug 27 03:32:56.787563 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3110/6177] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:56 2022] GET /compute/v2.1/servers/7e2ddab0-69d0-48ba-9305-e66c198895c8 => generated 1669 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:57.543491 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-caa20c70-8646-4605-9a6f-6dcb51156712 req-e76f3220-920e-4631-8aea-364c45a9fb30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e2ddab0-69d0-48ba-9305-e66c198895c8", "name": "network-vif-deleted", "tag": "652b7103-7819-46e4-9fa3-fcaef5015903"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:32:57.554877 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-caa20c70-8646-4605-9a6f-6dcb51156712 req-e76f3220-920e-4631-8aea-364c45a9fb30 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:57.555414 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-caa20c70-8646-4605-9a6f-6dcb51156712 req-e76f3220-920e-4631-8aea-364c45a9fb30 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:57.555842 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-caa20c70-8646-4605-9a6f-6dcb51156712 req-e76f3220-920e-4631-8aea-364c45a9fb30 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:57.566606 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-caa20c70-8646-4605-9a6f-6dcb51156712 req-e76f3220-920e-4631-8aea-364c45a9fb30 service nova] Creating event network-vif-deleted:652b7103-7819-46e4-9fa3-fcaef5015903 for instance 7e2ddab0-69d0-48ba-9305-e66c198895c8 on n-h2-852278-4 Aug 27 03:32:57.571716 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-caa20c70-8646-4605-9a6f-6dcb51156712 req-e76f3220-920e-4631-8aea-364c45a9fb30 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031999 Aug 27 03:32:57.572387 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3068/6178] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:32:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:32:57.813426 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-dd6ee4d7-d870-43e3-930a-8880df08e43f tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:57.814483 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-dd6ee4d7-d870-43e3-930a-8880df08e43f tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] [instance: 7e2ddab0-69d0-48ba-9305-e66c198895c8] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:57.823147 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dd6ee4d7-d870-43e3-930a-8880df08e43f tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:57.823661 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dd6ee4d7-d870-43e3-930a-8880df08e43f tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:57.824119 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dd6ee4d7-d870-43e3-930a-8880df08e43f tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:57.824885 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dd6ee4d7-d870-43e3-930a-8880df08e43f tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:57.825352 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dd6ee4d7-d870-43e3-930a-8880df08e43f tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:57.825788 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dd6ee4d7-d870-43e3-930a-8880df08e43f tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:57.862924 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dd6ee4d7-d870-43e3-930a-8880df08e43f tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:57.863434 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dd6ee4d7-d870-43e3-930a-8880df08e43f tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:57.863889 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dd6ee4d7-d870-43e3-930a-8880df08e43f tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:57.864418 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.objects.instance [None req-dd6ee4d7-d870-43e3-930a-8880df08e43f tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lazy-loading 'fault' on Instance uuid 7e2ddab0-69d0-48ba-9305-e66c198895c8 {{(pid=134051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:32:57.907889 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-dd6ee4d7-d870-43e3-930a-8880df08e43f tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08cd6a89f36c44d49bb2baabc9d3bd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adf9e5b8bb54b1589c1b331febab9db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:57.916596 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-dd6ee4d7-d870-43e3-930a-8880df08e43f tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] 10.222.0.70 "GET /compute/v2.1/servers/7e2ddab0-69d0-48ba-9305-e66c198895c8" status: 200 len: 1339 microversion: 2.1 time: 0.109945 Aug 27 03:32:57.917548 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3111/6179] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:57 2022] GET /compute/v2.1/servers/7e2ddab0-69d0-48ba-9305-e66c198895c8 => generated 1339 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:58.941126 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-1844a3cb-6fba-42d9-b0ef-d8dac8a0ff30 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:58.941903 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-1844a3cb-6fba-42d9-b0ef-d8dac8a0ff30 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] [instance: 7e2ddab0-69d0-48ba-9305-e66c198895c8] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:58.949879 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1844a3cb-6fba-42d9-b0ef-d8dac8a0ff30 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:58.950409 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1844a3cb-6fba-42d9-b0ef-d8dac8a0ff30 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:58.950889 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1844a3cb-6fba-42d9-b0ef-d8dac8a0ff30 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:58.951648 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1844a3cb-6fba-42d9-b0ef-d8dac8a0ff30 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:58.952155 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1844a3cb-6fba-42d9-b0ef-d8dac8a0ff30 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:58.952707 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1844a3cb-6fba-42d9-b0ef-d8dac8a0ff30 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:58.967680 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-1844a3cb-6fba-42d9-b0ef-d8dac8a0ff30 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] HTTP exception thrown: Instance 7e2ddab0-69d0-48ba-9305-e66c198895c8 could not be found. Aug 27 03:32:58.969346 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-1844a3cb-6fba-42d9-b0ef-d8dac8a0ff30 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Request method failure captured: Aug 27 03:32:58.969346 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/servers/7e2ddab0-69d0-48ba-9305-e66c198895c8 HTTP/1.1 Aug 27 03:32:58.969346 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 03:32:58.969346 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 03:32:58.969346 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 03:32:58.969346 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 03:32:58.969346 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 03:32:58.969346 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 03:32:58.969346 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 03:32:58.969346 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 03:32:58.969346 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCY_I_RkkR7PFz1DFGGeu-U4G7d0gma6-SuMR2AffAoxmFKPFKovW8E4o1RgWlj_eXnbt3vBettZe9Q6OaevSxA1t4nDe4Sy6hmqld-zqIpOj3DQgwtha_-uid63sjN99vwTMcUAOi2jrr0wQGIbsU-W_Knbx1KJ-STnqJufBdD63E0Y Aug 27 03:32:58.969346 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 03:32:58.969346 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 03:32:58.969346 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 03:32:58.969346 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 03:32:58.969346 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 03:32:58.969346 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 03:32:58.969346 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 4adf9e5b8bb54b1589c1b331febab9db Aug 27 03:32:58.969346 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-TestNetworkBasicOps-938726110 Aug 27 03:32:58.969346 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 03:32:58.969346 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 03:32:58.969346 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4adf9e5b8bb54b1589c1b331febab9db"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_4adf9e5b8bb54b1589c1b331febab9db", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4adf9e5b8bb54b1589c1b331febab9db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/4adf9e5b8bb54b1589c1b331febab9db"}]}] Aug 27 03:32:58.969346 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-TestNetworkBasicOps-938726110 Aug 27 03:32:58.969346 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 4adf9e5b8bb54b1589c1b331febab9db Aug 27 03:32:58.969346 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-TestNetworkBasicOps-938726110 Aug 27 03:32:58.969346 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-TestNetworkBasicOps-938726110-project Aug 27 03:32:58.969346 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 03:32:58.969346 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 03:32:58.969346 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 08cd6a89f36c44d49bb2baabc9d3bd1b Aug 27 03:32:58.969346 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-TestNetworkBasicOps-938726110-project Aug 27 03:32:58.969346 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 03:32:58.969346 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance 7e2ddab0-69d0-48ba-9305-e66c198895c8 could not be found. Aug 27 03:32:58.969346 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '7e2ddab0-69d0-48ba-9305-e66c198895c8'} Aug 27 03:32:58.969346 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:32:58.969346 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:32:58.969346 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:32:58.969346 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:32:58.969346 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:32:58.969346 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:32:58.969346 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:32:58.969346 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:32:58.969346 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:32:58.969346 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:32:58.969346 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e2ddab0-69d0-48ba-9305-e66c198895c8 could not be found. Aug 27 03:32:58.969346 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:32:58.969346 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:32:58.969346 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:32:58.969346 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:32:58.969346 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:32:58.969346 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:32:58.969346 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:32:58.969346 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:32:58.969346 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:32:58.969346 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:32:58.969346 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:32:58.969346 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:32:58.969346 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:32:58.969346 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:32:58.969346 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:32:58.969346 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:32:58.969346 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e2ddab0-69d0-48ba-9305-e66c198895c8 could not be found. Aug 27 03:32:58.969346 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:32:58.969346 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:32:58.969346 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:32:58.974247 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:32:58.974247 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:32:58.974247 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:32:58.974247 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:32:58.974247 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:32:58.974247 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e2ddab0-69d0-48ba-9305-e66c198895c8 could not be found. Aug 27 03:32:58.974247 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:32:58.974247 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-1844a3cb-6fba-42d9-b0ef-d8dac8a0ff30 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Returning 404 to user: Instance 7e2ddab0-69d0-48ba-9305-e66c198895c8 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:32:58.974247 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-1844a3cb-6fba-42d9-b0ef-d8dac8a0ff30 tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] 10.222.0.70 "GET /compute/v2.1/servers/7e2ddab0-69d0-48ba-9305-e66c198895c8" status: 404 len: 111 microversion: 2.1 time: 0.035421 Aug 27 03:32:58.974247 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3069/6180] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:58 2022] GET /compute/v2.1/servers/7e2ddab0-69d0-48ba-9305-e66c198895c8 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:32:59.136810 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-32bbe5f4-30ed-492c-8071-383f809cba7d tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] Calling method '.version_select at 0x7f5ede2520d0>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:59.160651 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-32bbe5f4-30ed-492c-8071-383f809cba7d tempest-TestNetworkBasicOps-938726110 tempest-TestNetworkBasicOps-938726110-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1960259258" status: 202 len: 0 microversion: 2.1 time: 0.027446 Aug 27 03:32:59.161374 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3112/6181] 10.222.0.70 () {58 vars in 1257 bytes} [Sat Aug 27 03:32:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1960259258 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:33:05.449250 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-de1ac21b-1b49-41ff-8268-293c22ea2e44 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Action: 'create', calling method: .version_select at 0x7f5ee251e700>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-816620621", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN0+Ywwy7Jyx+C8Sy4mGlmEq9Wxx0Cbun5eZq13ZKJKpfv1aRvs0w+8DauWBbguKIIF4uN5KnFYHy0xTVVGYbk4FRGVwTKn2ZQFKJ4udzRNuqf6T57t3Hxd8cD898/Fpsw=="}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:05.469209 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-de1ac21b-1b49-41ff-8268-293c22ea2e44 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Getting quotas for project b5c2f5813d984727a5c4ffc30a8b6a75. Resources: {'key_pairs'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:33:05.475915 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-de1ac21b-1b49-41ff-8268-293c22ea2e44 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Getting quotas for user 0083a579255944a395dacbf39bd70f76 and project b5c2f5813d984727a5c4ffc30a8b6a75. Resources: {'key_pairs'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:33:05.507564 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-de1ac21b-1b49-41ff-8268-293c22ea2e44 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.232476 Aug 27 03:33:05.508422 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3070/6182] 10.222.0.70 () {60 vars in 1159 bytes} [Sat Aug 27 03:33:05 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:33:10.824285 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3360e4f0-7272-4095-8b49-896c1998a208 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-515709419-access_point-330697463", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "networks": [{"uuid": "dde884ba-5f82-4f9d-b849-246cad0b68e4"}], "key_name": "tempest-TestSecurityGroupsBasicOps-816620621", "security_groups": [{"name": "tempest-secgroup_access--1165332855"}, {"name": "tempest-secgroup_general--1364261363"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:10.835029 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:33:10.835756 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:33:10.997038 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.network.neutron [None req-3360e4f0-7272-4095-8b49-896c1998a208 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] validate_networks() for [('dde884ba-5f82-4f9d-b849-246cad0b68e4', None, None, None, None, None)] {{(pid=134051) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:33:11.398694 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-3360e4f0-7272-4095-8b49-896c1998a208 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Flavor limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:33:11.404423 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-3360e4f0-7272-4095-8b49-896c1998a208 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Image limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:33:11.404962 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-3360e4f0-7272-4095-8b49-896c1998a208 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Flavor pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:33:11.405385 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-3360e4f0-7272-4095-8b49-896c1998a208 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Image pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:33:11.409302 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-3360e4f0-7272-4095-8b49-896c1998a208 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:33:11.418331 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3360e4f0-7272-4095-8b49-896c1998a208 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:11.418823 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3360e4f0-7272-4095-8b49-896c1998a208 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:11.419259 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3360e4f0-7272-4095-8b49-896c1998a208 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:11.420188 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3360e4f0-7272-4095-8b49-896c1998a208 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:11.420677 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3360e4f0-7272-4095-8b49-896c1998a208 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:11.421137 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3360e4f0-7272-4095-8b49-896c1998a208 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:11.440035 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-3360e4f0-7272-4095-8b49-896c1998a208 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Getting quotas for project b5c2f5813d984727a5c4ffc30a8b6a75. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:33:11.446225 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-3360e4f0-7272-4095-8b49-896c1998a208 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Getting quotas for user 0083a579255944a395dacbf39bd70f76 and project b5c2f5813d984727a5c4ffc30a8b6a75. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:33:11.460185 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-3360e4f0-7272-4095-8b49-896c1998a208 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Going to run 1 instances... {{(pid=134051) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:33:11.462472 n-d-852278-4 devstack@n-api.service[134051]: WARNING nova.utils [None req-3360e4f0-7272-4095-8b49-896c1998a208 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-515709419-access_point-330697463 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-515709419-acc Aug 27 03:33:11.463249 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-3360e4f0-7272-4095-8b49-896c1998a208 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] [instance: 48950c20-d74e-49a9-8c5f-468511250877] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134051) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:33:11.515415 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-3360e4f0-7272-4095-8b49-896c1998a208 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 458 microversion: 2.1 time: 0.695138 Aug 27 03:33:11.522260 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3113/6183] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 03:33:10 2022] POST /compute/v2.1/servers => generated 458 bytes in 697 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:33:11.525547 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=16 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:33:11.530922 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-512a11c0-5878-4d03-8393-ad015b2def4a tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:11.531659 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-512a11c0-5878-4d03-8393-ad015b2def4a tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] [instance: 48950c20-d74e-49a9-8c5f-468511250877] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:11.603830 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-512a11c0-5878-4d03-8393-ad015b2def4a tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083a579255944a395dacbf39bd70f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c2f5813d984727a5c4ffc30a8b6a75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:11.611718 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-512a11c0-5878-4d03-8393-ad015b2def4a tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] 10.222.0.70 "GET /compute/v2.1/servers/48950c20-d74e-49a9-8c5f-468511250877" status: 200 len: 1292 microversion: 2.1 time: 0.087937 Aug 27 03:33:11.612358 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3071/6184] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:11 2022] GET /compute/v2.1/servers/48950c20-d74e-49a9-8c5f-468511250877 => generated 1292 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:12.633729 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-eb1614bb-72bf-41be-8f2e-633e760a2975 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:12.634593 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-eb1614bb-72bf-41be-8f2e-633e760a2975 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] [instance: 48950c20-d74e-49a9-8c5f-468511250877] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:12.642025 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eb1614bb-72bf-41be-8f2e-633e760a2975 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:12.642538 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eb1614bb-72bf-41be-8f2e-633e760a2975 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:12.642965 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eb1614bb-72bf-41be-8f2e-633e760a2975 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:12.643662 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eb1614bb-72bf-41be-8f2e-633e760a2975 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:12.644136 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eb1614bb-72bf-41be-8f2e-633e760a2975 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:12.644614 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eb1614bb-72bf-41be-8f2e-633e760a2975 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:12.709712 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-eb1614bb-72bf-41be-8f2e-633e760a2975 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083a579255944a395dacbf39bd70f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c2f5813d984727a5c4ffc30a8b6a75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:12.717936 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-eb1614bb-72bf-41be-8f2e-633e760a2975 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] 10.222.0.70 "GET /compute/v2.1/servers/48950c20-d74e-49a9-8c5f-468511250877" status: 200 len: 1344 microversion: 2.1 time: 0.089159 Aug 27 03:33:12.718546 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3114/6185] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:12 2022] GET /compute/v2.1/servers/48950c20-d74e-49a9-8c5f-468511250877 => generated 1344 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:13.739389 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-028d1006-1289-4b2a-b60f-0d3ac8e7329f tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:13.740619 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-028d1006-1289-4b2a-b60f-0d3ac8e7329f tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] [instance: 48950c20-d74e-49a9-8c5f-468511250877] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:13.748567 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-028d1006-1289-4b2a-b60f-0d3ac8e7329f tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:13.749115 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-028d1006-1289-4b2a-b60f-0d3ac8e7329f tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:13.749555 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-028d1006-1289-4b2a-b60f-0d3ac8e7329f tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:13.750254 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-028d1006-1289-4b2a-b60f-0d3ac8e7329f tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:13.750732 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-028d1006-1289-4b2a-b60f-0d3ac8e7329f tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:13.751153 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-028d1006-1289-4b2a-b60f-0d3ac8e7329f tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:14.004149 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-028d1006-1289-4b2a-b60f-0d3ac8e7329f tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083a579255944a395dacbf39bd70f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c2f5813d984727a5c4ffc30a8b6a75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:14.013032 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-028d1006-1289-4b2a-b60f-0d3ac8e7329f tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] 10.222.0.70 "GET /compute/v2.1/servers/48950c20-d74e-49a9-8c5f-468511250877" status: 200 len: 1470 microversion: 2.1 time: 0.277779 Aug 27 03:33:14.013611 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3072/6186] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:13 2022] GET /compute/v2.1/servers/48950c20-d74e-49a9-8c5f-468511250877 => generated 1470 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:14.312348 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-472be3ff-3442-405d-bf4d-933c7adceb8b req-337ab24a-58b3-427b-9560-a3fb3315f23c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48950c20-d74e-49a9-8c5f-468511250877", "tag": "6f4d2333-5d4f-4e20-b0f8-e702f4d4ba30"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:14.324353 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-472be3ff-3442-405d-bf4d-933c7adceb8b req-337ab24a-58b3-427b-9560-a3fb3315f23c service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:14.324846 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-472be3ff-3442-405d-bf4d-933c7adceb8b req-337ab24a-58b3-427b-9560-a3fb3315f23c service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:14.325315 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-472be3ff-3442-405d-bf4d-933c7adceb8b req-337ab24a-58b3-427b-9560-a3fb3315f23c service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:14.337846 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-472be3ff-3442-405d-bf4d-933c7adceb8b req-337ab24a-58b3-427b-9560-a3fb3315f23c service nova] Creating event network-changed:6f4d2333-5d4f-4e20-b0f8-e702f4d4ba30 for instance 48950c20-d74e-49a9-8c5f-468511250877 on n-h2-852278-4 Aug 27 03:33:14.343074 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-472be3ff-3442-405d-bf4d-933c7adceb8b req-337ab24a-58b3-427b-9560-a3fb3315f23c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034722 Aug 27 03:33:14.343675 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3115/6187] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:33:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:33:15.034176 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-2c48046f-a235-4735-b5ed-a27bcc6787d3 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:15.034787 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-2c48046f-a235-4735-b5ed-a27bcc6787d3 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] [instance: 48950c20-d74e-49a9-8c5f-468511250877] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:15.042397 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2c48046f-a235-4735-b5ed-a27bcc6787d3 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:15.042893 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2c48046f-a235-4735-b5ed-a27bcc6787d3 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:15.043327 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2c48046f-a235-4735-b5ed-a27bcc6787d3 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:15.044032 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2c48046f-a235-4735-b5ed-a27bcc6787d3 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:15.044524 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2c48046f-a235-4735-b5ed-a27bcc6787d3 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:15.044965 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2c48046f-a235-4735-b5ed-a27bcc6787d3 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:15.193661 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-2c48046f-a235-4735-b5ed-a27bcc6787d3 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083a579255944a395dacbf39bd70f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c2f5813d984727a5c4ffc30a8b6a75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:15.201656 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-2c48046f-a235-4735-b5ed-a27bcc6787d3 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] 10.222.0.70 "GET /compute/v2.1/servers/48950c20-d74e-49a9-8c5f-468511250877" status: 200 len: 1470 microversion: 2.1 time: 0.171490 Aug 27 03:33:15.202233 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3073/6188] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:15 2022] GET /compute/v2.1/servers/48950c20-d74e-49a9-8c5f-468511250877 => generated 1470 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:16.224407 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c5483378-9c17-4799-b598-e5b3b8926447 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:16.225306 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-c5483378-9c17-4799-b598-e5b3b8926447 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] [instance: 48950c20-d74e-49a9-8c5f-468511250877] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:16.232693 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c5483378-9c17-4799-b598-e5b3b8926447 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:16.233155 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c5483378-9c17-4799-b598-e5b3b8926447 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:16.233665 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c5483378-9c17-4799-b598-e5b3b8926447 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:16.234406 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c5483378-9c17-4799-b598-e5b3b8926447 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:16.234868 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c5483378-9c17-4799-b598-e5b3b8926447 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:16.235306 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c5483378-9c17-4799-b598-e5b3b8926447 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:16.494204 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-c5483378-9c17-4799-b598-e5b3b8926447 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083a579255944a395dacbf39bd70f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c2f5813d984727a5c4ffc30a8b6a75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:16.502585 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c5483378-9c17-4799-b598-e5b3b8926447 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] 10.222.0.70 "GET /compute/v2.1/servers/48950c20-d74e-49a9-8c5f-468511250877" status: 200 len: 1470 microversion: 2.1 time: 0.283464 Aug 27 03:33:16.503177 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3116/6189] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:16 2022] GET /compute/v2.1/servers/48950c20-d74e-49a9-8c5f-468511250877 => generated 1470 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:17.525555 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-333a1a11-f63a-484f-89c5-1ad3450d3e27 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:17.526161 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-333a1a11-f63a-484f-89c5-1ad3450d3e27 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] [instance: 48950c20-d74e-49a9-8c5f-468511250877] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:17.533837 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-333a1a11-f63a-484f-89c5-1ad3450d3e27 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:17.534319 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-333a1a11-f63a-484f-89c5-1ad3450d3e27 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:17.534755 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-333a1a11-f63a-484f-89c5-1ad3450d3e27 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:17.535491 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-333a1a11-f63a-484f-89c5-1ad3450d3e27 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:17.535934 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-333a1a11-f63a-484f-89c5-1ad3450d3e27 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:17.536376 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-333a1a11-f63a-484f-89c5-1ad3450d3e27 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:17.696518 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-333a1a11-f63a-484f-89c5-1ad3450d3e27 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083a579255944a395dacbf39bd70f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c2f5813d984727a5c4ffc30a8b6a75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:17.704680 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-333a1a11-f63a-484f-89c5-1ad3450d3e27 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] 10.222.0.70 "GET /compute/v2.1/servers/48950c20-d74e-49a9-8c5f-468511250877" status: 200 len: 1470 microversion: 2.1 time: 0.183912 Aug 27 03:33:17.705292 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3074/6190] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:17 2022] GET /compute/v2.1/servers/48950c20-d74e-49a9-8c5f-468511250877 => generated 1470 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:18.727202 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8481230b-58b8-4d23-a77a-d600b6bdd428 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:18.727820 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-8481230b-58b8-4d23-a77a-d600b6bdd428 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] [instance: 48950c20-d74e-49a9-8c5f-468511250877] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:18.735233 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8481230b-58b8-4d23-a77a-d600b6bdd428 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:18.735737 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8481230b-58b8-4d23-a77a-d600b6bdd428 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:18.736192 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8481230b-58b8-4d23-a77a-d600b6bdd428 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:18.736936 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8481230b-58b8-4d23-a77a-d600b6bdd428 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:18.737404 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8481230b-58b8-4d23-a77a-d600b6bdd428 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:18.737846 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8481230b-58b8-4d23-a77a-d600b6bdd428 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:18.886230 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-8481230b-58b8-4d23-a77a-d600b6bdd428 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083a579255944a395dacbf39bd70f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c2f5813d984727a5c4ffc30a8b6a75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:18.894522 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-8481230b-58b8-4d23-a77a-d600b6bdd428 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] 10.222.0.70 "GET /compute/v2.1/servers/48950c20-d74e-49a9-8c5f-468511250877" status: 200 len: 1470 microversion: 2.1 time: 0.171813 Aug 27 03:33:18.895462 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3117/6191] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:18 2022] GET /compute/v2.1/servers/48950c20-d74e-49a9-8c5f-468511250877 => generated 1470 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:18.958059 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-67c0a4bb-fcd2-4db5-92a9-209c3969ce7f req-553dd6d2-46f5-48ae-9cc1-11950b8bc608 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48950c20-d74e-49a9-8c5f-468511250877", "name": "network-vif-plugged", "status": "completed", "tag": "6f4d2333-5d4f-4e20-b0f8-e702f4d4ba30"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:18.974154 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-67c0a4bb-fcd2-4db5-92a9-209c3969ce7f req-553dd6d2-46f5-48ae-9cc1-11950b8bc608 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:18.975217 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-67c0a4bb-fcd2-4db5-92a9-209c3969ce7f req-553dd6d2-46f5-48ae-9cc1-11950b8bc608 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:18.975832 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-67c0a4bb-fcd2-4db5-92a9-209c3969ce7f req-553dd6d2-46f5-48ae-9cc1-11950b8bc608 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:19.006879 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-67c0a4bb-fcd2-4db5-92a9-209c3969ce7f req-553dd6d2-46f5-48ae-9cc1-11950b8bc608 service nova] Creating event network-vif-plugged:6f4d2333-5d4f-4e20-b0f8-e702f4d4ba30 for instance 48950c20-d74e-49a9-8c5f-468511250877 on n-h2-852278-4 Aug 27 03:33:19.015648 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-67c0a4bb-fcd2-4db5-92a9-209c3969ce7f req-553dd6d2-46f5-48ae-9cc1-11950b8bc608 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062774 Aug 27 03:33:19.016335 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3075/6192] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:33:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:33:19.920094 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3e1d79e5-c016-44e8-9cd6-59f2c3a66985 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:19.921025 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-3e1d79e5-c016-44e8-9cd6-59f2c3a66985 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] [instance: 48950c20-d74e-49a9-8c5f-468511250877] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:19.931810 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3e1d79e5-c016-44e8-9cd6-59f2c3a66985 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:19.932331 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3e1d79e5-c016-44e8-9cd6-59f2c3a66985 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:19.932783 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3e1d79e5-c016-44e8-9cd6-59f2c3a66985 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:19.933490 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3e1d79e5-c016-44e8-9cd6-59f2c3a66985 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:19.933949 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3e1d79e5-c016-44e8-9cd6-59f2c3a66985 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:19.934378 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3e1d79e5-c016-44e8-9cd6-59f2c3a66985 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:20.090866 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-3e1d79e5-c016-44e8-9cd6-59f2c3a66985 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083a579255944a395dacbf39bd70f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c2f5813d984727a5c4ffc30a8b6a75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:20.102329 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-3e1d79e5-c016-44e8-9cd6-59f2c3a66985 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] 10.222.0.70 "GET /compute/v2.1/servers/48950c20-d74e-49a9-8c5f-468511250877" status: 200 len: 1470 microversion: 2.1 time: 0.188972 Aug 27 03:33:20.102925 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3118/6193] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:19 2022] GET /compute/v2.1/servers/48950c20-d74e-49a9-8c5f-468511250877 => generated 1470 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:21.127846 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a87f2380-f1fe-404b-81be-cf7b77c58292 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:21.129145 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a87f2380-f1fe-404b-81be-cf7b77c58292 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] [instance: 48950c20-d74e-49a9-8c5f-468511250877] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:21.141422 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a87f2380-f1fe-404b-81be-cf7b77c58292 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:21.142284 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a87f2380-f1fe-404b-81be-cf7b77c58292 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:21.143017 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a87f2380-f1fe-404b-81be-cf7b77c58292 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:21.144188 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a87f2380-f1fe-404b-81be-cf7b77c58292 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:21.145025 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a87f2380-f1fe-404b-81be-cf7b77c58292 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:21.145733 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a87f2380-f1fe-404b-81be-cf7b77c58292 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:21.295225 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-a87f2380-f1fe-404b-81be-cf7b77c58292 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083a579255944a395dacbf39bd70f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c2f5813d984727a5c4ffc30a8b6a75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:21.303764 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a87f2380-f1fe-404b-81be-cf7b77c58292 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] 10.222.0.70 "GET /compute/v2.1/servers/48950c20-d74e-49a9-8c5f-468511250877" status: 200 len: 1643 microversion: 2.1 time: 0.183183 Aug 27 03:33:21.304456 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3076/6194] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:21 2022] GET /compute/v2.1/servers/48950c20-d74e-49a9-8c5f-468511250877 => generated 1643 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:21.323933 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-34def90e-9368-4ef0-bcdf-e05cde307acf tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:21.324587 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-34def90e-9368-4ef0-bcdf-e05cde307acf tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] [instance: 48950c20-d74e-49a9-8c5f-468511250877] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:21.331589 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-34def90e-9368-4ef0-bcdf-e05cde307acf tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:21.332092 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-34def90e-9368-4ef0-bcdf-e05cde307acf tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:21.332577 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-34def90e-9368-4ef0-bcdf-e05cde307acf tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:21.333290 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-34def90e-9368-4ef0-bcdf-e05cde307acf tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:21.333753 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-34def90e-9368-4ef0-bcdf-e05cde307acf tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:21.334204 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-34def90e-9368-4ef0-bcdf-e05cde307acf tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:21.430601 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:33:21.452895 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=6 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:33:21.486686 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-34def90e-9368-4ef0-bcdf-e05cde307acf tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083a579255944a395dacbf39bd70f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c2f5813d984727a5c4ffc30a8b6a75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:21.499013 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-34def90e-9368-4ef0-bcdf-e05cde307acf tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] 10.222.0.70 "GET /compute/v2.1/servers/48950c20-d74e-49a9-8c5f-468511250877" status: 200 len: 1643 microversion: 2.1 time: 0.178744 Aug 27 03:33:21.499921 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3119/6195] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:21 2022] GET /compute/v2.1/servers/48950c20-d74e-49a9-8c5f-468511250877 => generated 1643 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:21.521755 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-7904d349-6aef-481e-a40b-0179b0acd8fb tempest-TestSecurityGroupsBasicOps-26077271 tempest-TestSecurityGroupsBasicOps-26077271-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:21.522371 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-7904d349-6aef-481e-a40b-0179b0acd8fb tempest-TestSecurityGroupsBasicOps-26077271 tempest-TestSecurityGroupsBasicOps-26077271-project-admin] [instance: 48950c20-d74e-49a9-8c5f-468511250877] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:21.528957 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7904d349-6aef-481e-a40b-0179b0acd8fb tempest-TestSecurityGroupsBasicOps-26077271 tempest-TestSecurityGroupsBasicOps-26077271-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:21.529449 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7904d349-6aef-481e-a40b-0179b0acd8fb tempest-TestSecurityGroupsBasicOps-26077271 tempest-TestSecurityGroupsBasicOps-26077271-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:21.529891 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7904d349-6aef-481e-a40b-0179b0acd8fb tempest-TestSecurityGroupsBasicOps-26077271 tempest-TestSecurityGroupsBasicOps-26077271-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:21.530593 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7904d349-6aef-481e-a40b-0179b0acd8fb tempest-TestSecurityGroupsBasicOps-26077271 tempest-TestSecurityGroupsBasicOps-26077271-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:21.531046 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7904d349-6aef-481e-a40b-0179b0acd8fb tempest-TestSecurityGroupsBasicOps-26077271 tempest-TestSecurityGroupsBasicOps-26077271-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:21.531478 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7904d349-6aef-481e-a40b-0179b0acd8fb tempest-TestSecurityGroupsBasicOps-26077271 tempest-TestSecurityGroupsBasicOps-26077271-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:21.608673 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=6 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:33:21.773879 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-7904d349-6aef-481e-a40b-0179b0acd8fb tempest-TestSecurityGroupsBasicOps-26077271 tempest-TestSecurityGroupsBasicOps-26077271-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/48950c20-d74e-49a9-8c5f-468511250877" status: 200 len: 1794 microversion: 2.1 time: 0.255864 Aug 27 03:33:21.774456 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3077/6196] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:21 2022] GET /compute/v2.1/servers/48950c20-d74e-49a9-8c5f-468511250877 => generated 1794 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:23.445935 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-7ee86b0d-c769-4b08-a300-1cf6eee07c7d req-a0614662-8327-47da-83fd-7def9982b308 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48950c20-d74e-49a9-8c5f-468511250877", "tag": "6f4d2333-5d4f-4e20-b0f8-e702f4d4ba30"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:23.457114 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-7ee86b0d-c769-4b08-a300-1cf6eee07c7d req-a0614662-8327-47da-83fd-7def9982b308 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:23.457604 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-7ee86b0d-c769-4b08-a300-1cf6eee07c7d req-a0614662-8327-47da-83fd-7def9982b308 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:23.458045 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-7ee86b0d-c769-4b08-a300-1cf6eee07c7d req-a0614662-8327-47da-83fd-7def9982b308 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:23.469986 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-7ee86b0d-c769-4b08-a300-1cf6eee07c7d req-a0614662-8327-47da-83fd-7def9982b308 service nova] Creating event network-changed:6f4d2333-5d4f-4e20-b0f8-e702f4d4ba30 for instance 48950c20-d74e-49a9-8c5f-468511250877 on n-h2-852278-4 Aug 27 03:33:23.475229 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-7ee86b0d-c769-4b08-a300-1cf6eee07c7d req-a0614662-8327-47da-83fd-7def9982b308 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033211 Aug 27 03:33:23.476130 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3120/6197] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:33:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:34:01.919761 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0e121ee7-63c0-4be2-bf8d-397385fae8d9 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-1054185325", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "networks": [{"uuid": "1839c20b-ba4f-4aa3-8327-144f6a6574f4"}], "key_name": "tempest-TestSecurityGroupsBasicOps-816620621", "security_groups": []}, "os:scheduler_hints": {"different_host": ["48950c20-d74e-49a9-8c5f-468511250877"]}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:01.930359 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:34:01.931170 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=32 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:34:02.001243 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.network.neutron [None req-0e121ee7-63c0-4be2-bf8d-397385fae8d9 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] validate_networks() for [('1839c20b-ba4f-4aa3-8327-144f6a6574f4', None, None, None, None, None)] {{(pid=134052) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:34:02.511600 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-0e121ee7-63c0-4be2-bf8d-397385fae8d9 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Flavor limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:34:02.512090 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-0e121ee7-63c0-4be2-bf8d-397385fae8d9 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Image limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:34:02.512685 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-0e121ee7-63c0-4be2-bf8d-397385fae8d9 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Flavor pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:34:02.513195 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-0e121ee7-63c0-4be2-bf8d-397385fae8d9 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Image pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:34:02.513702 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-0e121ee7-63c0-4be2-bf8d-397385fae8d9 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:34:02.526001 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0e121ee7-63c0-4be2-bf8d-397385fae8d9 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:02.527020 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0e121ee7-63c0-4be2-bf8d-397385fae8d9 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:02.527905 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0e121ee7-63c0-4be2-bf8d-397385fae8d9 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:02.529903 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0e121ee7-63c0-4be2-bf8d-397385fae8d9 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:02.530843 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0e121ee7-63c0-4be2-bf8d-397385fae8d9 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:02.531710 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0e121ee7-63c0-4be2-bf8d-397385fae8d9 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:02.552273 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-0e121ee7-63c0-4be2-bf8d-397385fae8d9 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Getting quotas for project b5c2f5813d984727a5c4ffc30a8b6a75. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:34:02.562571 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-0e121ee7-63c0-4be2-bf8d-397385fae8d9 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Getting quotas for user 0083a579255944a395dacbf39bd70f76 and project b5c2f5813d984727a5c4ffc30a8b6a75. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:34:02.576146 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-0e121ee7-63c0-4be2-bf8d-397385fae8d9 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Going to run 1 instances... {{(pid=134052) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:34:02.578633 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-0e121ee7-63c0-4be2-bf8d-397385fae8d9 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] [instance: 184acc38-0e02-4583-acb5-22414ac99dae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134052) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:34:02.633028 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-0e121ee7-63c0-4be2-bf8d-397385fae8d9 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 0.717903 Aug 27 03:34:02.640334 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3078/6198] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 03:34:01 2022] POST /compute/v2.1/servers => generated 361 bytes in 726 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:34:02.643425 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:34:02.644709 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=36 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:34:02.650128 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-50efc74f-1c49-4659-90a2-7e0eb5d388ad tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:02.651102 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-50efc74f-1c49-4659-90a2-7e0eb5d388ad tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] [instance: 184acc38-0e02-4583-acb5-22414ac99dae] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:02.723110 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-50efc74f-1c49-4659-90a2-7e0eb5d388ad tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083a579255944a395dacbf39bd70f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c2f5813d984727a5c4ffc30a8b6a75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:02.730981 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-50efc74f-1c49-4659-90a2-7e0eb5d388ad tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] 10.222.0.70 "GET /compute/v2.1/servers/184acc38-0e02-4583-acb5-22414ac99dae" status: 200 len: 1241 microversion: 2.1 time: 0.089906 Aug 27 03:34:02.731679 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3121/6199] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:02 2022] GET /compute/v2.1/servers/184acc38-0e02-4583-acb5-22414ac99dae => generated 1241 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:34:03.754686 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a74d5e52-edb5-43c1-b155-a2e2b76e27ea tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:03.756163 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a74d5e52-edb5-43c1-b155-a2e2b76e27ea tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] [instance: 184acc38-0e02-4583-acb5-22414ac99dae] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:03.766360 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a74d5e52-edb5-43c1-b155-a2e2b76e27ea tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:03.766955 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a74d5e52-edb5-43c1-b155-a2e2b76e27ea tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:03.767508 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a74d5e52-edb5-43c1-b155-a2e2b76e27ea tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:03.768301 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a74d5e52-edb5-43c1-b155-a2e2b76e27ea tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:03.769005 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a74d5e52-edb5-43c1-b155-a2e2b76e27ea tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:03.769747 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a74d5e52-edb5-43c1-b155-a2e2b76e27ea tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:03.853019 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-a74d5e52-edb5-43c1-b155-a2e2b76e27ea tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083a579255944a395dacbf39bd70f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c2f5813d984727a5c4ffc30a8b6a75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:03.863577 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a74d5e52-edb5-43c1-b155-a2e2b76e27ea tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] 10.222.0.70 "GET /compute/v2.1/servers/184acc38-0e02-4583-acb5-22414ac99dae" status: 200 len: 1301 microversion: 2.1 time: 0.113830 Aug 27 03:34:03.877764 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3079/6200] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:03 2022] GET /compute/v2.1/servers/184acc38-0e02-4583-acb5-22414ac99dae => generated 1301 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:04.887311 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4b36b572-428e-472e-8e3b-98973dd89f07 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:04.887938 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-4b36b572-428e-472e-8e3b-98973dd89f07 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] [instance: 184acc38-0e02-4583-acb5-22414ac99dae] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:04.901054 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4b36b572-428e-472e-8e3b-98973dd89f07 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:04.901546 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4b36b572-428e-472e-8e3b-98973dd89f07 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:04.901986 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4b36b572-428e-472e-8e3b-98973dd89f07 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:04.902893 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4b36b572-428e-472e-8e3b-98973dd89f07 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:04.903524 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4b36b572-428e-472e-8e3b-98973dd89f07 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:04.903957 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4b36b572-428e-472e-8e3b-98973dd89f07 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:05.055452 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-4b36b572-428e-472e-8e3b-98973dd89f07 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083a579255944a395dacbf39bd70f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c2f5813d984727a5c4ffc30a8b6a75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:05.065360 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-4b36b572-428e-472e-8e3b-98973dd89f07 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] 10.222.0.70 "GET /compute/v2.1/servers/184acc38-0e02-4583-acb5-22414ac99dae" status: 200 len: 1299 microversion: 2.1 time: 0.182175 Aug 27 03:34:05.066141 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3122/6201] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:04 2022] GET /compute/v2.1/servers/184acc38-0e02-4583-acb5-22414ac99dae => generated 1299 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:05.307446 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-b59b4678-1ee7-4e54-8873-4a0582fb6f28 req-8339640f-5050-4e49-ae71-ef52d99d3297 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "184acc38-0e02-4583-acb5-22414ac99dae", "tag": "67a501b1-8cf8-4a50-a74f-e75980bb7bd9"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:05.319853 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-b59b4678-1ee7-4e54-8873-4a0582fb6f28 req-8339640f-5050-4e49-ae71-ef52d99d3297 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:05.320366 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-b59b4678-1ee7-4e54-8873-4a0582fb6f28 req-8339640f-5050-4e49-ae71-ef52d99d3297 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:05.321757 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-b59b4678-1ee7-4e54-8873-4a0582fb6f28 req-8339640f-5050-4e49-ae71-ef52d99d3297 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:05.335422 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-b59b4678-1ee7-4e54-8873-4a0582fb6f28 req-8339640f-5050-4e49-ae71-ef52d99d3297 service nova] Creating event network-changed:67a501b1-8cf8-4a50-a74f-e75980bb7bd9 for instance 184acc38-0e02-4583-acb5-22414ac99dae on n-h1-852278-4 Aug 27 03:34:05.340565 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-b59b4678-1ee7-4e54-8873-4a0582fb6f28 req-8339640f-5050-4e49-ae71-ef52d99d3297 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132892 Aug 27 03:34:05.341223 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3080/6202] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:34:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:34:06.091348 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-6f3e1d28-8934-406d-8429-a2f17936b04e tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:06.092376 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-6f3e1d28-8934-406d-8429-a2f17936b04e tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] [instance: 184acc38-0e02-4583-acb5-22414ac99dae] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:06.104499 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6f3e1d28-8934-406d-8429-a2f17936b04e tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:06.105333 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6f3e1d28-8934-406d-8429-a2f17936b04e tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:06.106081 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6f3e1d28-8934-406d-8429-a2f17936b04e tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:06.107263 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6f3e1d28-8934-406d-8429-a2f17936b04e tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:06.108038 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6f3e1d28-8934-406d-8429-a2f17936b04e tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:06.109149 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6f3e1d28-8934-406d-8429-a2f17936b04e tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:06.194762 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-6f3e1d28-8934-406d-8429-a2f17936b04e tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083a579255944a395dacbf39bd70f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c2f5813d984727a5c4ffc30a8b6a75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:06.203075 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-6f3e1d28-8934-406d-8429-a2f17936b04e tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] 10.222.0.70 "GET /compute/v2.1/servers/184acc38-0e02-4583-acb5-22414ac99dae" status: 200 len: 1299 microversion: 2.1 time: 0.118104 Aug 27 03:34:06.203658 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3123/6203] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:06 2022] GET /compute/v2.1/servers/184acc38-0e02-4583-acb5-22414ac99dae => generated 1299 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:07.231478 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6cb4c4c1-c690-4bb2-bd69-8b3e3ac6d50e tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:07.232942 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-6cb4c4c1-c690-4bb2-bd69-8b3e3ac6d50e tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] [instance: 184acc38-0e02-4583-acb5-22414ac99dae] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:07.246460 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6cb4c4c1-c690-4bb2-bd69-8b3e3ac6d50e tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:07.247547 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6cb4c4c1-c690-4bb2-bd69-8b3e3ac6d50e tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:07.248607 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6cb4c4c1-c690-4bb2-bd69-8b3e3ac6d50e tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:07.250193 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6cb4c4c1-c690-4bb2-bd69-8b3e3ac6d50e tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:07.251238 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6cb4c4c1-c690-4bb2-bd69-8b3e3ac6d50e tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:07.252220 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6cb4c4c1-c690-4bb2-bd69-8b3e3ac6d50e tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:07.346072 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-6cb4c4c1-c690-4bb2-bd69-8b3e3ac6d50e tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083a579255944a395dacbf39bd70f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c2f5813d984727a5c4ffc30a8b6a75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:07.354610 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-6cb4c4c1-c690-4bb2-bd69-8b3e3ac6d50e tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] 10.222.0.70 "GET /compute/v2.1/servers/184acc38-0e02-4583-acb5-22414ac99dae" status: 200 len: 1299 microversion: 2.1 time: 0.132754 Aug 27 03:34:07.355171 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3081/6204] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:07 2022] GET /compute/v2.1/servers/184acc38-0e02-4583-acb5-22414ac99dae => generated 1299 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:08.379293 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b33f3e68-5bd3-4e70-b586-adfe0b576a85 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:08.380473 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b33f3e68-5bd3-4e70-b586-adfe0b576a85 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] [instance: 184acc38-0e02-4583-acb5-22414ac99dae] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:08.397207 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b33f3e68-5bd3-4e70-b586-adfe0b576a85 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:08.397734 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b33f3e68-5bd3-4e70-b586-adfe0b576a85 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:08.398189 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b33f3e68-5bd3-4e70-b586-adfe0b576a85 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:08.398904 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b33f3e68-5bd3-4e70-b586-adfe0b576a85 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:08.399366 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b33f3e68-5bd3-4e70-b586-adfe0b576a85 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:08.399798 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b33f3e68-5bd3-4e70-b586-adfe0b576a85 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:08.494359 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-b33f3e68-5bd3-4e70-b586-adfe0b576a85 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083a579255944a395dacbf39bd70f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c2f5813d984727a5c4ffc30a8b6a75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:08.505875 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b33f3e68-5bd3-4e70-b586-adfe0b576a85 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] 10.222.0.70 "GET /compute/v2.1/servers/184acc38-0e02-4583-acb5-22414ac99dae" status: 200 len: 1299 microversion: 2.1 time: 0.133164 Aug 27 03:34:08.506447 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3124/6205] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:08 2022] GET /compute/v2.1/servers/184acc38-0e02-4583-acb5-22414ac99dae => generated 1299 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:09.529800 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-cbf2ea28-e91a-4006-917b-5c09a275817c tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:09.530707 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-cbf2ea28-e91a-4006-917b-5c09a275817c tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] [instance: 184acc38-0e02-4583-acb5-22414ac99dae] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:09.541873 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cbf2ea28-e91a-4006-917b-5c09a275817c tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:09.542645 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cbf2ea28-e91a-4006-917b-5c09a275817c tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:09.543310 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cbf2ea28-e91a-4006-917b-5c09a275817c tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:09.544413 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cbf2ea28-e91a-4006-917b-5c09a275817c tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:09.545146 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cbf2ea28-e91a-4006-917b-5c09a275817c tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:09.545899 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cbf2ea28-e91a-4006-917b-5c09a275817c tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:09.635328 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-cbf2ea28-e91a-4006-917b-5c09a275817c tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083a579255944a395dacbf39bd70f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c2f5813d984727a5c4ffc30a8b6a75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:09.644258 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-cbf2ea28-e91a-4006-917b-5c09a275817c tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] 10.222.0.70 "GET /compute/v2.1/servers/184acc38-0e02-4583-acb5-22414ac99dae" status: 200 len: 1299 microversion: 2.1 time: 0.120657 Aug 27 03:34:09.644872 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3082/6206] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:09 2022] GET /compute/v2.1/servers/184acc38-0e02-4583-acb5-22414ac99dae => generated 1299 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:10.665937 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-9e2813b1-4cc6-4378-8311-fc21cd490e05 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:10.666569 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-9e2813b1-4cc6-4378-8311-fc21cd490e05 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] [instance: 184acc38-0e02-4583-acb5-22414ac99dae] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:10.674230 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9e2813b1-4cc6-4378-8311-fc21cd490e05 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:10.674736 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9e2813b1-4cc6-4378-8311-fc21cd490e05 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:10.675189 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9e2813b1-4cc6-4378-8311-fc21cd490e05 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:10.675906 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9e2813b1-4cc6-4378-8311-fc21cd490e05 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:10.676402 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9e2813b1-4cc6-4378-8311-fc21cd490e05 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:10.676847 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9e2813b1-4cc6-4378-8311-fc21cd490e05 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:10.759698 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-9e2813b1-4cc6-4378-8311-fc21cd490e05 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083a579255944a395dacbf39bd70f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c2f5813d984727a5c4ffc30a8b6a75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:10.767650 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-9e2813b1-4cc6-4378-8311-fc21cd490e05 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] 10.222.0.70 "GET /compute/v2.1/servers/184acc38-0e02-4583-acb5-22414ac99dae" status: 200 len: 1299 microversion: 2.1 time: 0.105931 Aug 27 03:34:10.768227 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3125/6207] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:10 2022] GET /compute/v2.1/servers/184acc38-0e02-4583-acb5-22414ac99dae => generated 1299 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:10.969452 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-f13ddb3d-947f-47e5-9e06-9670b6a3cf86 req-c57be748-a36a-495a-90d3-a33b2435ce6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "184acc38-0e02-4583-acb5-22414ac99dae", "name": "network-vif-plugged", "status": "completed", "tag": "67a501b1-8cf8-4a50-a74f-e75980bb7bd9"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:10.980452 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-f13ddb3d-947f-47e5-9e06-9670b6a3cf86 req-c57be748-a36a-495a-90d3-a33b2435ce6e service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:10.980941 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-f13ddb3d-947f-47e5-9e06-9670b6a3cf86 req-c57be748-a36a-495a-90d3-a33b2435ce6e service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:10.981371 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-f13ddb3d-947f-47e5-9e06-9670b6a3cf86 req-c57be748-a36a-495a-90d3-a33b2435ce6e service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:10.993443 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-f13ddb3d-947f-47e5-9e06-9670b6a3cf86 req-c57be748-a36a-495a-90d3-a33b2435ce6e service nova] Creating event network-vif-plugged:67a501b1-8cf8-4a50-a74f-e75980bb7bd9 for instance 184acc38-0e02-4583-acb5-22414ac99dae on n-h1-852278-4 Aug 27 03:34:10.998707 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-f13ddb3d-947f-47e5-9e06-9670b6a3cf86 req-c57be748-a36a-495a-90d3-a33b2435ce6e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033342 Aug 27 03:34:10.999468 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3083/6208] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:34:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:34:11.793779 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e7d53f26-d3b4-443f-b805-d2889252f8c7 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:11.794896 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-e7d53f26-d3b4-443f-b805-d2889252f8c7 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] [instance: 184acc38-0e02-4583-acb5-22414ac99dae] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:11.805575 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e7d53f26-d3b4-443f-b805-d2889252f8c7 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:11.806208 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e7d53f26-d3b4-443f-b805-d2889252f8c7 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:11.806662 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e7d53f26-d3b4-443f-b805-d2889252f8c7 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:11.807378 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e7d53f26-d3b4-443f-b805-d2889252f8c7 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:11.807961 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e7d53f26-d3b4-443f-b805-d2889252f8c7 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:11.808458 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e7d53f26-d3b4-443f-b805-d2889252f8c7 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:11.894451 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e7d53f26-d3b4-443f-b805-d2889252f8c7 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083a579255944a395dacbf39bd70f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c2f5813d984727a5c4ffc30a8b6a75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:11.902348 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e7d53f26-d3b4-443f-b805-d2889252f8c7 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] 10.222.0.70 "GET /compute/v2.1/servers/184acc38-0e02-4583-acb5-22414ac99dae" status: 200 len: 1299 microversion: 2.1 time: 0.116032 Aug 27 03:34:11.902923 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3126/6209] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:11 2022] GET /compute/v2.1/servers/184acc38-0e02-4583-acb5-22414ac99dae => generated 1299 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:12.927397 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:34:12.928277 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=6 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:34:12.933045 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-1955b072-5524-4123-9b3e-a7c5d0c1eb3a tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:12.933752 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-1955b072-5524-4123-9b3e-a7c5d0c1eb3a tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] [instance: 184acc38-0e02-4583-acb5-22414ac99dae] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:12.941047 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1955b072-5524-4123-9b3e-a7c5d0c1eb3a tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:12.941528 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1955b072-5524-4123-9b3e-a7c5d0c1eb3a tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:12.941964 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1955b072-5524-4123-9b3e-a7c5d0c1eb3a tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:12.942659 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1955b072-5524-4123-9b3e-a7c5d0c1eb3a tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:12.943110 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1955b072-5524-4123-9b3e-a7c5d0c1eb3a tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:12.943527 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1955b072-5524-4123-9b3e-a7c5d0c1eb3a tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:13.032163 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-1955b072-5524-4123-9b3e-a7c5d0c1eb3a tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083a579255944a395dacbf39bd70f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c2f5813d984727a5c4ffc30a8b6a75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:13.040769 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-1955b072-5524-4123-9b3e-a7c5d0c1eb3a tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] 10.222.0.70 "GET /compute/v2.1/servers/184acc38-0e02-4583-acb5-22414ac99dae" status: 200 len: 1471 microversion: 2.1 time: 0.115620 Aug 27 03:34:13.041339 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3084/6210] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:12 2022] GET /compute/v2.1/servers/184acc38-0e02-4583-acb5-22414ac99dae => generated 1471 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:13.064534 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-935b405d-0f77-4f7e-bffb-8ab707a696ef tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:13.065280 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-935b405d-0f77-4f7e-bffb-8ab707a696ef tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] [instance: 184acc38-0e02-4583-acb5-22414ac99dae] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:13.067742 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:34:13.076073 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-935b405d-0f77-4f7e-bffb-8ab707a696ef tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:13.076808 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-935b405d-0f77-4f7e-bffb-8ab707a696ef tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:13.077458 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-935b405d-0f77-4f7e-bffb-8ab707a696ef tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:13.078458 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-935b405d-0f77-4f7e-bffb-8ab707a696ef tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:13.079095 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-935b405d-0f77-4f7e-bffb-8ab707a696ef tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:13.079728 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-935b405d-0f77-4f7e-bffb-8ab707a696ef tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:13.178574 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-935b405d-0f77-4f7e-bffb-8ab707a696ef tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083a579255944a395dacbf39bd70f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c2f5813d984727a5c4ffc30a8b6a75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:13.187110 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-935b405d-0f77-4f7e-bffb-8ab707a696ef tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] 10.222.0.70 "GET /compute/v2.1/servers/184acc38-0e02-4583-acb5-22414ac99dae" status: 200 len: 1471 microversion: 2.1 time: 0.128573 Aug 27 03:34:13.187703 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3127/6211] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:13 2022] GET /compute/v2.1/servers/184acc38-0e02-4583-acb5-22414ac99dae => generated 1471 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:13.206920 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-af44d2c0-12b0-4b02-81f7-af31e3593663 tempest-TestSecurityGroupsBasicOps-26077271 tempest-TestSecurityGroupsBasicOps-26077271-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:13.207534 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-af44d2c0-12b0-4b02-81f7-af31e3593663 tempest-TestSecurityGroupsBasicOps-26077271 tempest-TestSecurityGroupsBasicOps-26077271-project-admin] [instance: 184acc38-0e02-4583-acb5-22414ac99dae] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:13.215289 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-af44d2c0-12b0-4b02-81f7-af31e3593663 tempest-TestSecurityGroupsBasicOps-26077271 tempest-TestSecurityGroupsBasicOps-26077271-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:13.215783 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-af44d2c0-12b0-4b02-81f7-af31e3593663 tempest-TestSecurityGroupsBasicOps-26077271 tempest-TestSecurityGroupsBasicOps-26077271-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:13.216517 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-af44d2c0-12b0-4b02-81f7-af31e3593663 tempest-TestSecurityGroupsBasicOps-26077271 tempest-TestSecurityGroupsBasicOps-26077271-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:13.217336 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-af44d2c0-12b0-4b02-81f7-af31e3593663 tempest-TestSecurityGroupsBasicOps-26077271 tempest-TestSecurityGroupsBasicOps-26077271-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:13.217992 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-af44d2c0-12b0-4b02-81f7-af31e3593663 tempest-TestSecurityGroupsBasicOps-26077271 tempest-TestSecurityGroupsBasicOps-26077271-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:13.218469 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-af44d2c0-12b0-4b02-81f7-af31e3593663 tempest-TestSecurityGroupsBasicOps-26077271 tempest-TestSecurityGroupsBasicOps-26077271-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:13.303695 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-af44d2c0-12b0-4b02-81f7-af31e3593663 tempest-TestSecurityGroupsBasicOps-26077271 tempest-TestSecurityGroupsBasicOps-26077271-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/184acc38-0e02-4583-acb5-22414ac99dae" status: 200 len: 1622 microversion: 2.1 time: 0.100447 Aug 27 03:34:13.304298 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3085/6212] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:13 2022] GET /compute/v2.1/servers/184acc38-0e02-4583-acb5-22414ac99dae => generated 1622 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:13.324048 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-10264e1c-9e2e-4c48-9142-c0a3ed54942d tempest-TestSecurityGroupsBasicOps-26077271 tempest-TestSecurityGroupsBasicOps-26077271-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:13.324609 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-10264e1c-9e2e-4c48-9142-c0a3ed54942d tempest-TestSecurityGroupsBasicOps-26077271 tempest-TestSecurityGroupsBasicOps-26077271-project-admin] [instance: 48950c20-d74e-49a9-8c5f-468511250877] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:13.330885 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-10264e1c-9e2e-4c48-9142-c0a3ed54942d tempest-TestSecurityGroupsBasicOps-26077271 tempest-TestSecurityGroupsBasicOps-26077271-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:13.331405 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-10264e1c-9e2e-4c48-9142-c0a3ed54942d tempest-TestSecurityGroupsBasicOps-26077271 tempest-TestSecurityGroupsBasicOps-26077271-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:13.331866 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-10264e1c-9e2e-4c48-9142-c0a3ed54942d tempest-TestSecurityGroupsBasicOps-26077271 tempest-TestSecurityGroupsBasicOps-26077271-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:13.332599 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-10264e1c-9e2e-4c48-9142-c0a3ed54942d tempest-TestSecurityGroupsBasicOps-26077271 tempest-TestSecurityGroupsBasicOps-26077271-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:13.333073 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-10264e1c-9e2e-4c48-9142-c0a3ed54942d tempest-TestSecurityGroupsBasicOps-26077271 tempest-TestSecurityGroupsBasicOps-26077271-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:13.333544 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-10264e1c-9e2e-4c48-9142-c0a3ed54942d tempest-TestSecurityGroupsBasicOps-26077271 tempest-TestSecurityGroupsBasicOps-26077271-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:13.477718 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-10264e1c-9e2e-4c48-9142-c0a3ed54942d tempest-TestSecurityGroupsBasicOps-26077271 tempest-TestSecurityGroupsBasicOps-26077271-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/48950c20-d74e-49a9-8c5f-468511250877" status: 200 len: 1912 microversion: 2.1 time: 0.157452 Aug 27 03:34:13.478309 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3128/6213] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:13 2022] GET /compute/v2.1/servers/48950c20-d74e-49a9-8c5f-468511250877 => generated 1912 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:13.554570 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d955ca84-1d70-4ab2-b75e-6b76d7cf998a tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:13.555249 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d955ca84-1d70-4ab2-b75e-6b76d7cf998a tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] [instance: 184acc38-0e02-4583-acb5-22414ac99dae] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:13.564803 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d955ca84-1d70-4ab2-b75e-6b76d7cf998a tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:13.565387 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d955ca84-1d70-4ab2-b75e-6b76d7cf998a tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:13.566020 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d955ca84-1d70-4ab2-b75e-6b76d7cf998a tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:13.567140 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d955ca84-1d70-4ab2-b75e-6b76d7cf998a tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:13.567825 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d955ca84-1d70-4ab2-b75e-6b76d7cf998a tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:13.568249 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d955ca84-1d70-4ab2-b75e-6b76d7cf998a tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:13.595460 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d955ca84-1d70-4ab2-b75e-6b76d7cf998a tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] [instance: 184acc38-0e02-4583-acb5-22414ac99dae] Going to try to terminate instance {{(pid=134052) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:34:13.684143 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d955ca84-1d70-4ab2-b75e-6b76d7cf998a tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] 10.222.0.70 "DELETE /compute/v2.1/servers/184acc38-0e02-4583-acb5-22414ac99dae" status: 204 len: 0 microversion: 2.1 time: 0.135713 Aug 27 03:34:13.685134 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3086/6214] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 03:34:13 2022] DELETE /compute/v2.1/servers/184acc38-0e02-4583-acb5-22414ac99dae => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:34:13.693671 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0f3cdd68-b087-4bd4-b58e-2b874e67c983 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:13.694331 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-0f3cdd68-b087-4bd4-b58e-2b874e67c983 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] [instance: 184acc38-0e02-4583-acb5-22414ac99dae] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:13.700691 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0f3cdd68-b087-4bd4-b58e-2b874e67c983 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:13.701189 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0f3cdd68-b087-4bd4-b58e-2b874e67c983 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:13.701638 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0f3cdd68-b087-4bd4-b58e-2b874e67c983 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:13.702346 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0f3cdd68-b087-4bd4-b58e-2b874e67c983 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:13.702808 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0f3cdd68-b087-4bd4-b58e-2b874e67c983 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:13.703241 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0f3cdd68-b087-4bd4-b58e-2b874e67c983 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:13.788884 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-0f3cdd68-b087-4bd4-b58e-2b874e67c983 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083a579255944a395dacbf39bd70f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c2f5813d984727a5c4ffc30a8b6a75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:13.800969 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-0f3cdd68-b087-4bd4-b58e-2b874e67c983 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] 10.222.0.70 "GET /compute/v2.1/servers/184acc38-0e02-4583-acb5-22414ac99dae" status: 200 len: 1477 microversion: 2.1 time: 0.111092 Aug 27 03:34:13.801862 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3129/6215] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:13 2022] GET /compute/v2.1/servers/184acc38-0e02-4583-acb5-22414ac99dae => generated 1477 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:14.825722 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9e3bfe0b-62aa-46e2-91a6-4413c63f9493 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:14.826465 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-9e3bfe0b-62aa-46e2-91a6-4413c63f9493 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] [instance: 184acc38-0e02-4583-acb5-22414ac99dae] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:14.833933 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9e3bfe0b-62aa-46e2-91a6-4413c63f9493 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:14.834419 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9e3bfe0b-62aa-46e2-91a6-4413c63f9493 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:14.834849 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9e3bfe0b-62aa-46e2-91a6-4413c63f9493 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:14.835544 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9e3bfe0b-62aa-46e2-91a6-4413c63f9493 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:14.835984 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9e3bfe0b-62aa-46e2-91a6-4413c63f9493 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:14.836430 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9e3bfe0b-62aa-46e2-91a6-4413c63f9493 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:14.920871 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-9e3bfe0b-62aa-46e2-91a6-4413c63f9493 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083a579255944a395dacbf39bd70f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c2f5813d984727a5c4ffc30a8b6a75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:14.931473 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9e3bfe0b-62aa-46e2-91a6-4413c63f9493 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] 10.222.0.70 "GET /compute/v2.1/servers/184acc38-0e02-4583-acb5-22414ac99dae" status: 200 len: 1477 microversion: 2.1 time: 0.110718 Aug 27 03:34:14.932199 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3087/6216] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:14 2022] GET /compute/v2.1/servers/184acc38-0e02-4583-acb5-22414ac99dae => generated 1477 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:15.557619 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-d4b71abd-6aad-41e8-b4f0-423ae42ceaed req-1c110658-b238-40c6-a6ab-748425f7ecda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "184acc38-0e02-4583-acb5-22414ac99dae", "name": "network-vif-deleted", "tag": "67a501b1-8cf8-4a50-a74f-e75980bb7bd9"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:15.569719 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-d4b71abd-6aad-41e8-b4f0-423ae42ceaed req-1c110658-b238-40c6-a6ab-748425f7ecda service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:15.571049 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-d4b71abd-6aad-41e8-b4f0-423ae42ceaed req-1c110658-b238-40c6-a6ab-748425f7ecda service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:15.571511 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-d4b71abd-6aad-41e8-b4f0-423ae42ceaed req-1c110658-b238-40c6-a6ab-748425f7ecda service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:15.585387 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-d4b71abd-6aad-41e8-b4f0-423ae42ceaed req-1c110658-b238-40c6-a6ab-748425f7ecda service nova] Creating event network-vif-deleted:67a501b1-8cf8-4a50-a74f-e75980bb7bd9 for instance 184acc38-0e02-4583-acb5-22414ac99dae on n-h1-852278-4 Aug 27 03:34:15.591143 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-d4b71abd-6aad-41e8-b4f0-423ae42ceaed req-1c110658-b238-40c6-a6ab-748425f7ecda service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037470 Aug 27 03:34:15.591761 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3130/6217] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:34:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:34:15.953656 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-18d5cd02-e0ed-4407-99a7-a4e7a96d310d tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:15.954251 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-18d5cd02-e0ed-4407-99a7-a4e7a96d310d tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] [instance: 184acc38-0e02-4583-acb5-22414ac99dae] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:15.961720 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-18d5cd02-e0ed-4407-99a7-a4e7a96d310d tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:15.962294 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-18d5cd02-e0ed-4407-99a7-a4e7a96d310d tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:15.962744 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-18d5cd02-e0ed-4407-99a7-a4e7a96d310d tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:15.963449 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-18d5cd02-e0ed-4407-99a7-a4e7a96d310d tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:15.963897 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-18d5cd02-e0ed-4407-99a7-a4e7a96d310d tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:15.964337 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-18d5cd02-e0ed-4407-99a7-a4e7a96d310d tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:16.000079 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-18d5cd02-e0ed-4407-99a7-a4e7a96d310d tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:16.000592 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-18d5cd02-e0ed-4407-99a7-a4e7a96d310d tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:16.001005 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-18d5cd02-e0ed-4407-99a7-a4e7a96d310d tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:16.001460 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.instance [None req-18d5cd02-e0ed-4407-99a7-a4e7a96d310d tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lazy-loading 'fault' on Instance uuid 184acc38-0e02-4583-acb5-22414ac99dae {{(pid=134052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:34:16.044382 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-18d5cd02-e0ed-4407-99a7-a4e7a96d310d tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083a579255944a395dacbf39bd70f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c2f5813d984727a5c4ffc30a8b6a75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:16.052870 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-18d5cd02-e0ed-4407-99a7-a4e7a96d310d tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] 10.222.0.70 "GET /compute/v2.1/servers/184acc38-0e02-4583-acb5-22414ac99dae" status: 200 len: 1331 microversion: 2.1 time: 0.103307 Aug 27 03:34:16.053442 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3088/6218] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:15 2022] GET /compute/v2.1/servers/184acc38-0e02-4583-acb5-22414ac99dae => generated 1331 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:17.075059 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-471fb083-5823-4bfb-9e10-32599df9c03e tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:17.075812 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-471fb083-5823-4bfb-9e10-32599df9c03e tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] [instance: 184acc38-0e02-4583-acb5-22414ac99dae] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:17.082420 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-471fb083-5823-4bfb-9e10-32599df9c03e tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:17.082930 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-471fb083-5823-4bfb-9e10-32599df9c03e tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:17.083383 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-471fb083-5823-4bfb-9e10-32599df9c03e tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:17.084104 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-471fb083-5823-4bfb-9e10-32599df9c03e tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:17.084611 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-471fb083-5823-4bfb-9e10-32599df9c03e tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:17.085050 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-471fb083-5823-4bfb-9e10-32599df9c03e tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:17.099078 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-471fb083-5823-4bfb-9e10-32599df9c03e tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] HTTP exception thrown: Instance 184acc38-0e02-4583-acb5-22414ac99dae could not be found. Aug 27 03:34:17.100794 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-471fb083-5823-4bfb-9e10-32599df9c03e tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Request method failure captured: Aug 27 03:34:17.100794 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/184acc38-0e02-4583-acb5-22414ac99dae HTTP/1.1 Aug 27 03:34:17.100794 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 03:34:17.100794 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 03:34:17.100794 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 03:34:17.100794 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 03:34:17.100794 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 03:34:17.100794 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 03:34:17.100794 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 03:34:17.100794 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 03:34:17.100794 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCZBw2HipOXRuck_tE3qpXlXCNzHKPikPJcdvNmAgzu7Js4wQ17Vv_2NV6bKtT2el0qmVmaJzinxKuTOPIbTabX0GKH4uqxLSjcoV5a6xrtW04Z2vmHXt2AhVZNdYkKKwneUtfix87s-uyJ2gkZ8dbTKnXh80BtwTD4THZ8kgkY8aY1k Aug 27 03:34:17.100794 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 03:34:17.100794 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 03:34:17.100794 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 03:34:17.100794 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 03:34:17.100794 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 03:34:17.100794 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 03:34:17.100794 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: b5c2f5813d984727a5c4ffc30a8b6a75 Aug 27 03:34:17.100794 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-515709419 Aug 27 03:34:17.100794 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 03:34:17.100794 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 03:34:17.100794 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b5c2f5813d984727a5c4ffc30a8b6a75"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_b5c2f5813d984727a5c4ffc30a8b6a75", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b5c2f5813d984727a5c4ffc30a8b6a75"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/b5c2f5813d984727a5c4ffc30a8b6a75"}]}] Aug 27 03:34:17.100794 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-TestSecurityGroupsBasicOps-515709419 Aug 27 03:34:17.100794 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: b5c2f5813d984727a5c4ffc30a8b6a75 Aug 27 03:34:17.100794 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-515709419 Aug 27 03:34:17.100794 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-TestSecurityGroupsBasicOps-515709419-project Aug 27 03:34:17.100794 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 03:34:17.100794 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 03:34:17.100794 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 0083a579255944a395dacbf39bd70f76 Aug 27 03:34:17.100794 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-TestSecurityGroupsBasicOps-515709419-project Aug 27 03:34:17.100794 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 03:34:17.100794 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance 184acc38-0e02-4583-acb5-22414ac99dae could not be found. Aug 27 03:34:17.100794 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '184acc38-0e02-4583-acb5-22414ac99dae'} Aug 27 03:34:17.100794 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:34:17.100794 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:34:17.100794 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:34:17.100794 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:34:17.100794 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:34:17.100794 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:34:17.100794 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:34:17.100794 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:34:17.100794 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:34:17.100794 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:34:17.100794 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 184acc38-0e02-4583-acb5-22414ac99dae could not be found. Aug 27 03:34:17.100794 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:34:17.100794 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:34:17.100794 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:34:17.100794 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:34:17.100794 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:34:17.100794 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:34:17.100794 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:34:17.100794 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:34:17.100794 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:34:17.100794 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:34:17.100794 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:34:17.100794 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:34:17.100794 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:34:17.100794 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:34:17.100794 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:34:17.100794 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:34:17.100794 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 184acc38-0e02-4583-acb5-22414ac99dae could not be found. Aug 27 03:34:17.100794 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:34:17.100794 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:34:17.100794 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:34:17.106587 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:34:17.106587 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:34:17.106587 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:34:17.106587 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:34:17.106587 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:34:17.106587 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 184acc38-0e02-4583-acb5-22414ac99dae could not be found. Aug 27 03:34:17.106587 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:34:17.106587 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-471fb083-5823-4bfb-9e10-32599df9c03e tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Returning 404 to user: Instance 184acc38-0e02-4583-acb5-22414ac99dae could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:34:17.106587 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-471fb083-5823-4bfb-9e10-32599df9c03e tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] 10.222.0.70 "GET /compute/v2.1/servers/184acc38-0e02-4583-acb5-22414ac99dae" status: 404 len: 111 microversion: 2.1 time: 0.032613 Aug 27 03:34:17.106587 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3131/6219] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:17 2022] GET /compute/v2.1/servers/184acc38-0e02-4583-acb5-22414ac99dae => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:34:21.434534 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ab30ae73-78f0-42a9-8835-b6edf6d7f409 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:21.435066 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-ab30ae73-78f0-42a9-8835-b6edf6d7f409 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] [instance: 48950c20-d74e-49a9-8c5f-468511250877] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:21.449862 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ab30ae73-78f0-42a9-8835-b6edf6d7f409 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:21.450583 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ab30ae73-78f0-42a9-8835-b6edf6d7f409 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:21.451226 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ab30ae73-78f0-42a9-8835-b6edf6d7f409 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:21.452618 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ab30ae73-78f0-42a9-8835-b6edf6d7f409 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:21.453561 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ab30ae73-78f0-42a9-8835-b6edf6d7f409 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:21.454467 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ab30ae73-78f0-42a9-8835-b6edf6d7f409 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:21.490532 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-ab30ae73-78f0-42a9-8835-b6edf6d7f409 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] [instance: 48950c20-d74e-49a9-8c5f-468511250877] Going to try to terminate instance {{(pid=134052) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:34:21.515768 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-5c45efa8-79f4-4af6-b5b9-64a2f2ecf80e req-66bddaaf-fe8f-47b9-beca-83aa23c9f82b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48950c20-d74e-49a9-8c5f-468511250877", "tag": "6f4d2333-5d4f-4e20-b0f8-e702f4d4ba30"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:21.526677 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-5c45efa8-79f4-4af6-b5b9-64a2f2ecf80e req-66bddaaf-fe8f-47b9-beca-83aa23c9f82b service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:21.527638 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-5c45efa8-79f4-4af6-b5b9-64a2f2ecf80e req-66bddaaf-fe8f-47b9-beca-83aa23c9f82b service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:21.528606 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-5c45efa8-79f4-4af6-b5b9-64a2f2ecf80e req-66bddaaf-fe8f-47b9-beca-83aa23c9f82b service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:21.542926 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-5c45efa8-79f4-4af6-b5b9-64a2f2ecf80e req-66bddaaf-fe8f-47b9-beca-83aa23c9f82b service nova] Creating event network-changed:6f4d2333-5d4f-4e20-b0f8-e702f4d4ba30 for instance 48950c20-d74e-49a9-8c5f-468511250877 on n-h2-852278-4 Aug 27 03:34:21.548917 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-5c45efa8-79f4-4af6-b5b9-64a2f2ecf80e req-66bddaaf-fe8f-47b9-beca-83aa23c9f82b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120275 Aug 27 03:34:21.549679 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3132/6220] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:34:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:34:21.576614 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ab30ae73-78f0-42a9-8835-b6edf6d7f409 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] 10.222.0.70 "DELETE /compute/v2.1/servers/48950c20-d74e-49a9-8c5f-468511250877" status: 204 len: 0 microversion: 2.1 time: 0.151202 Aug 27 03:34:21.578353 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3089/6221] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 03:34:21 2022] DELETE /compute/v2.1/servers/48950c20-d74e-49a9-8c5f-468511250877 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 03:34:21.590753 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a85125da-e58e-4362-9f1e-ff53c1d9cad7 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:21.592259 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-a85125da-e58e-4362-9f1e-ff53c1d9cad7 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] [instance: 48950c20-d74e-49a9-8c5f-468511250877] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:21.599442 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a85125da-e58e-4362-9f1e-ff53c1d9cad7 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:21.600022 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a85125da-e58e-4362-9f1e-ff53c1d9cad7 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:21.600543 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a85125da-e58e-4362-9f1e-ff53c1d9cad7 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:21.601581 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a85125da-e58e-4362-9f1e-ff53c1d9cad7 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:21.602047 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a85125da-e58e-4362-9f1e-ff53c1d9cad7 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:21.602709 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a85125da-e58e-4362-9f1e-ff53c1d9cad7 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:21.747256 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-a85125da-e58e-4362-9f1e-ff53c1d9cad7 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083a579255944a395dacbf39bd70f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c2f5813d984727a5c4ffc30a8b6a75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:21.755657 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a85125da-e58e-4362-9f1e-ff53c1d9cad7 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] 10.222.0.70 "GET /compute/v2.1/servers/48950c20-d74e-49a9-8c5f-468511250877" status: 200 len: 1767 microversion: 2.1 time: 0.172048 Aug 27 03:34:21.756390 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3133/6222] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:21 2022] GET /compute/v2.1/servers/48950c20-d74e-49a9-8c5f-468511250877 => generated 1767 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:22.778006 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3ce6f970-d2e1-4d05-8e9c-3422645f2d2a tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:22.778867 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-3ce6f970-d2e1-4d05-8e9c-3422645f2d2a tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] [instance: 48950c20-d74e-49a9-8c5f-468511250877] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:22.786164 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3ce6f970-d2e1-4d05-8e9c-3422645f2d2a tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:22.786660 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3ce6f970-d2e1-4d05-8e9c-3422645f2d2a tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:22.787098 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3ce6f970-d2e1-4d05-8e9c-3422645f2d2a tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:22.787812 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3ce6f970-d2e1-4d05-8e9c-3422645f2d2a tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:22.788237 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3ce6f970-d2e1-4d05-8e9c-3422645f2d2a tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:22.788720 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3ce6f970-d2e1-4d05-8e9c-3422645f2d2a tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:23.176469 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-3ce6f970-d2e1-4d05-8e9c-3422645f2d2a tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083a579255944a395dacbf39bd70f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c2f5813d984727a5c4ffc30a8b6a75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:23.184717 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-3ce6f970-d2e1-4d05-8e9c-3422645f2d2a tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] 10.222.0.70 "GET /compute/v2.1/servers/48950c20-d74e-49a9-8c5f-468511250877" status: 200 len: 1767 microversion: 2.1 time: 0.411182 Aug 27 03:34:23.185282 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3090/6223] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:22 2022] GET /compute/v2.1/servers/48950c20-d74e-49a9-8c5f-468511250877 => generated 1767 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:23.634811 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-f67a4339-65d9-4ea3-a58b-ae12c1e017ab req-aa84eb7d-8ce2-45e5-826a-7cb4f551af16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48950c20-d74e-49a9-8c5f-468511250877", "name": "network-vif-deleted", "tag": "6f4d2333-5d4f-4e20-b0f8-e702f4d4ba30"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:23.646101 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-f67a4339-65d9-4ea3-a58b-ae12c1e017ab req-aa84eb7d-8ce2-45e5-826a-7cb4f551af16 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:23.646607 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-f67a4339-65d9-4ea3-a58b-ae12c1e017ab req-aa84eb7d-8ce2-45e5-826a-7cb4f551af16 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:23.647030 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-f67a4339-65d9-4ea3-a58b-ae12c1e017ab req-aa84eb7d-8ce2-45e5-826a-7cb4f551af16 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:23.659111 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-f67a4339-65d9-4ea3-a58b-ae12c1e017ab req-aa84eb7d-8ce2-45e5-826a-7cb4f551af16 service nova] Creating event network-vif-deleted:6f4d2333-5d4f-4e20-b0f8-e702f4d4ba30 for instance 48950c20-d74e-49a9-8c5f-468511250877 on n-h2-852278-4 Aug 27 03:34:23.663851 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-f67a4339-65d9-4ea3-a58b-ae12c1e017ab req-aa84eb7d-8ce2-45e5-826a-7cb4f551af16 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033008 Aug 27 03:34:23.664489 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3134/6224] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:34:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:34:24.206296 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-7c21c02a-f7b3-471a-81a2-a327db5d8a5a tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:24.206881 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-7c21c02a-f7b3-471a-81a2-a327db5d8a5a tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] [instance: 48950c20-d74e-49a9-8c5f-468511250877] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:24.214271 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7c21c02a-f7b3-471a-81a2-a327db5d8a5a tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:24.214759 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7c21c02a-f7b3-471a-81a2-a327db5d8a5a tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:24.215197 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7c21c02a-f7b3-471a-81a2-a327db5d8a5a tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:24.215901 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7c21c02a-f7b3-471a-81a2-a327db5d8a5a tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:24.216345 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7c21c02a-f7b3-471a-81a2-a327db5d8a5a tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:24.216812 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7c21c02a-f7b3-471a-81a2-a327db5d8a5a tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:24.230937 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-7c21c02a-f7b3-471a-81a2-a327db5d8a5a tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] HTTP exception thrown: Instance 48950c20-d74e-49a9-8c5f-468511250877 could not be found. Aug 27 03:34:24.232652 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-7c21c02a-f7b3-471a-81a2-a327db5d8a5a tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Request method failure captured: Aug 27 03:34:24.232652 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/servers/48950c20-d74e-49a9-8c5f-468511250877 HTTP/1.1 Aug 27 03:34:24.232652 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 03:34:24.232652 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 03:34:24.232652 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 03:34:24.232652 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 03:34:24.232652 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 03:34:24.232652 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 03:34:24.232652 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 03:34:24.232652 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 03:34:24.232652 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCZBw2HipOXRuck_tE3qpXlXCNzHKPikPJcdvNmAgzu7Js4wQ17Vv_2NV6bKtT2el0qmVmaJzinxKuTOPIbTabX0GKH4uqxLSjcoV5a6xrtW04Z2vmHXt2AhVZNdYkKKwneUtfix87s-uyJ2gkZ8dbTKnXh80BtwTD4THZ8kgkY8aY1k Aug 27 03:34:24.232652 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 03:34:24.232652 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 03:34:24.232652 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 03:34:24.232652 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 03:34:24.232652 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 03:34:24.232652 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 03:34:24.232652 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: b5c2f5813d984727a5c4ffc30a8b6a75 Aug 27 03:34:24.232652 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-515709419 Aug 27 03:34:24.232652 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 03:34:24.232652 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 03:34:24.232652 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b5c2f5813d984727a5c4ffc30a8b6a75"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_b5c2f5813d984727a5c4ffc30a8b6a75", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b5c2f5813d984727a5c4ffc30a8b6a75"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/b5c2f5813d984727a5c4ffc30a8b6a75"}]}] Aug 27 03:34:24.232652 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-TestSecurityGroupsBasicOps-515709419 Aug 27 03:34:24.232652 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: b5c2f5813d984727a5c4ffc30a8b6a75 Aug 27 03:34:24.232652 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-515709419 Aug 27 03:34:24.232652 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-TestSecurityGroupsBasicOps-515709419-project Aug 27 03:34:24.232652 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 03:34:24.232652 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 03:34:24.232652 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 0083a579255944a395dacbf39bd70f76 Aug 27 03:34:24.232652 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-TestSecurityGroupsBasicOps-515709419-project Aug 27 03:34:24.232652 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 03:34:24.232652 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance 48950c20-d74e-49a9-8c5f-468511250877 could not be found. Aug 27 03:34:24.232652 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '48950c20-d74e-49a9-8c5f-468511250877'} Aug 27 03:34:24.232652 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:34:24.232652 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:34:24.232652 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:34:24.232652 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:34:24.232652 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:34:24.232652 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:34:24.232652 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:34:24.232652 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:34:24.232652 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:34:24.232652 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:34:24.232652 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48950c20-d74e-49a9-8c5f-468511250877 could not be found. Aug 27 03:34:24.232652 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:34:24.232652 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:34:24.232652 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:34:24.232652 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:34:24.232652 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:34:24.232652 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:34:24.232652 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:34:24.232652 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:34:24.232652 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:34:24.232652 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:34:24.232652 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:34:24.232652 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:34:24.232652 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:34:24.232652 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:34:24.232652 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:34:24.232652 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:34:24.232652 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48950c20-d74e-49a9-8c5f-468511250877 could not be found. Aug 27 03:34:24.232652 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:34:24.232652 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:34:24.232652 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:34:24.239666 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:34:24.239666 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:34:24.239666 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:34:24.239666 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:34:24.239666 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:34:24.239666 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48950c20-d74e-49a9-8c5f-468511250877 could not be found. Aug 27 03:34:24.239666 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:34:24.239666 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-7c21c02a-f7b3-471a-81a2-a327db5d8a5a tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Returning 404 to user: Instance 48950c20-d74e-49a9-8c5f-468511250877 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:34:24.239666 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-7c21c02a-f7b3-471a-81a2-a327db5d8a5a tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] 10.222.0.70 "GET /compute/v2.1/servers/48950c20-d74e-49a9-8c5f-468511250877" status: 404 len: 111 microversion: 2.1 time: 0.031849 Aug 27 03:34:24.239666 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3091/6225] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:24 2022] GET /compute/v2.1/servers/48950c20-d74e-49a9-8c5f-468511250877 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:34:27.634639 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d89df8aa-f0c8-444a-92c8-613b4a29eaa9 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] Calling method '.version_select at 0x7f5ede25c040>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:27.656890 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d89df8aa-f0c8-444a-92c8-613b4a29eaa9 tempest-TestSecurityGroupsBasicOps-515709419 tempest-TestSecurityGroupsBasicOps-515709419-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-816620621" status: 202 len: 0 microversion: 2.1 time: 0.028412 Aug 27 03:34:27.660832 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3135/6226] 10.222.0.70 () {58 vars in 1275 bytes} [Sat Aug 27 03:34:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-816620621 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:34:40.421370 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:34:40.422667 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:34:40.546734 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-46183b55-722c-4799-a455-929ede2d2d10 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1638721252", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:40.599022 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.network.neutron [None req-46183b55-722c-4799-a455-929ede2d2d10 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] validate_networks() for None {{(pid=134052) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:34:40.886658 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-46183b55-722c-4799-a455-929ede2d2d10 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Flavor limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:34:40.887076 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-46183b55-722c-4799-a455-929ede2d2d10 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Image limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:34:40.887574 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-46183b55-722c-4799-a455-929ede2d2d10 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Flavor pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:34:40.887976 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-46183b55-722c-4799-a455-929ede2d2d10 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Image pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:34:40.888409 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-46183b55-722c-4799-a455-929ede2d2d10 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:34:40.898549 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-46183b55-722c-4799-a455-929ede2d2d10 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:40.899023 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-46183b55-722c-4799-a455-929ede2d2d10 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:40.899451 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-46183b55-722c-4799-a455-929ede2d2d10 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:40.900167 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-46183b55-722c-4799-a455-929ede2d2d10 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:40.900644 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-46183b55-722c-4799-a455-929ede2d2d10 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:40.901070 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-46183b55-722c-4799-a455-929ede2d2d10 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:40.918427 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-46183b55-722c-4799-a455-929ede2d2d10 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Getting quotas for project 26d7d0869709416e950affd772f873ff. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:34:40.924413 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-46183b55-722c-4799-a455-929ede2d2d10 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Getting quotas for user ad8396f6423c4d468a602390ee4ed738 and project 26d7d0869709416e950affd772f873ff. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:34:40.937912 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-46183b55-722c-4799-a455-929ede2d2d10 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Going to run 1 instances... {{(pid=134052) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:34:40.940247 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-46183b55-722c-4799-a455-929ede2d2d10 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] [instance: c965dc65-aac3-4645-a9d4-127a287569fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134052) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:34:40.992101 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-46183b55-722c-4799-a455-929ede2d2d10 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.575912 Aug 27 03:34:40.992810 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3092/6227] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 03:34:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 577 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:34:41.003311 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=62 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:34:41.004466 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=33,nova_api:DELETE=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:34:41.009042 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-16b12388-5d7f-4296-9286-405a0ce46d09 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:41.009870 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-16b12388-5d7f-4296-9286-405a0ce46d09 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] [instance: c965dc65-aac3-4645-a9d4-127a287569fc] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:41.071173 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-16b12388-5d7f-4296-9286-405a0ce46d09 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad8396f6423c4d468a602390ee4ed738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d7d0869709416e950affd772f873ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:41.079090 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-16b12388-5d7f-4296-9286-405a0ce46d09 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] 10.222.0.70 "GET /compute/v2.1/servers/c965dc65-aac3-4645-a9d4-127a287569fc" status: 200 len: 1222 microversion: 2.1 time: 0.077726 Aug 27 03:34:41.079608 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3136/6228] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:41 2022] GET /compute/v2.1/servers/c965dc65-aac3-4645-a9d4-127a287569fc => generated 1222 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:34:42.105032 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0c4d3ba0-cdec-46ae-b04e-73e9d361ca77 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:42.106174 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-0c4d3ba0-cdec-46ae-b04e-73e9d361ca77 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] [instance: c965dc65-aac3-4645-a9d4-127a287569fc] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:42.117635 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0c4d3ba0-cdec-46ae-b04e-73e9d361ca77 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:42.118512 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0c4d3ba0-cdec-46ae-b04e-73e9d361ca77 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:42.119238 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0c4d3ba0-cdec-46ae-b04e-73e9d361ca77 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:42.120828 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0c4d3ba0-cdec-46ae-b04e-73e9d361ca77 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:42.121405 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0c4d3ba0-cdec-46ae-b04e-73e9d361ca77 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:42.121855 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0c4d3ba0-cdec-46ae-b04e-73e9d361ca77 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:42.183765 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0c4d3ba0-cdec-46ae-b04e-73e9d361ca77 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad8396f6423c4d468a602390ee4ed738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d7d0869709416e950affd772f873ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:42.193522 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-0c4d3ba0-cdec-46ae-b04e-73e9d361ca77 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] 10.222.0.70 "GET /compute/v2.1/servers/c965dc65-aac3-4645-a9d4-127a287569fc" status: 200 len: 1274 microversion: 2.1 time: 0.096808 Aug 27 03:34:42.194144 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3093/6229] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:42 2022] GET /compute/v2.1/servers/c965dc65-aac3-4645-a9d4-127a287569fc => generated 1274 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:43.215133 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d176763d-6894-41a6-b18a-3eddc2d50152 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:43.216103 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d176763d-6894-41a6-b18a-3eddc2d50152 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] [instance: c965dc65-aac3-4645-a9d4-127a287569fc] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:43.232271 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d176763d-6894-41a6-b18a-3eddc2d50152 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:43.233015 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d176763d-6894-41a6-b18a-3eddc2d50152 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:43.233700 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d176763d-6894-41a6-b18a-3eddc2d50152 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:43.234606 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d176763d-6894-41a6-b18a-3eddc2d50152 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:43.235186 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d176763d-6894-41a6-b18a-3eddc2d50152 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:43.236032 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d176763d-6894-41a6-b18a-3eddc2d50152 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:43.481315 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d176763d-6894-41a6-b18a-3eddc2d50152 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad8396f6423c4d468a602390ee4ed738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d7d0869709416e950affd772f873ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:43.489504 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d176763d-6894-41a6-b18a-3eddc2d50152 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] 10.222.0.70 "GET /compute/v2.1/servers/c965dc65-aac3-4645-a9d4-127a287569fc" status: 200 len: 1322 microversion: 2.1 time: 0.278468 Aug 27 03:34:43.490392 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3137/6230] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:43 2022] GET /compute/v2.1/servers/c965dc65-aac3-4645-a9d4-127a287569fc => generated 1322 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:43.825420 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-2492dd5a-a2ff-4581-8e13-633a5c5948b3 req-d2943a25-9cc9-4216-b4d6-49fa497de0ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c965dc65-aac3-4645-a9d4-127a287569fc", "tag": "94dee0ca-5c62-4431-a286-02e4b9f9f3dc"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:43.837029 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-2492dd5a-a2ff-4581-8e13-633a5c5948b3 req-d2943a25-9cc9-4216-b4d6-49fa497de0ca service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:43.837514 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-2492dd5a-a2ff-4581-8e13-633a5c5948b3 req-d2943a25-9cc9-4216-b4d6-49fa497de0ca service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:43.837948 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-2492dd5a-a2ff-4581-8e13-633a5c5948b3 req-d2943a25-9cc9-4216-b4d6-49fa497de0ca service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:43.851241 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-2492dd5a-a2ff-4581-8e13-633a5c5948b3 req-d2943a25-9cc9-4216-b4d6-49fa497de0ca service nova] Creating event network-changed:94dee0ca-5c62-4431-a286-02e4b9f9f3dc for instance c965dc65-aac3-4645-a9d4-127a287569fc on n-h1-852278-4 Aug 27 03:34:43.857790 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-2492dd5a-a2ff-4581-8e13-633a5c5948b3 req-d2943a25-9cc9-4216-b4d6-49fa497de0ca service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036051 Aug 27 03:34:43.858794 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3094/6231] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:34:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:34:44.512280 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-58b90490-6918-4470-9bc8-308980a770a8 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:44.512907 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-58b90490-6918-4470-9bc8-308980a770a8 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] [instance: c965dc65-aac3-4645-a9d4-127a287569fc] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:44.520285 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-58b90490-6918-4470-9bc8-308980a770a8 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:44.520835 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-58b90490-6918-4470-9bc8-308980a770a8 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:44.521284 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-58b90490-6918-4470-9bc8-308980a770a8 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:44.522006 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-58b90490-6918-4470-9bc8-308980a770a8 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:44.522474 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-58b90490-6918-4470-9bc8-308980a770a8 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:44.522912 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-58b90490-6918-4470-9bc8-308980a770a8 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:44.737664 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-58b90490-6918-4470-9bc8-308980a770a8 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad8396f6423c4d468a602390ee4ed738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d7d0869709416e950affd772f873ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:44.746755 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-58b90490-6918-4470-9bc8-308980a770a8 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] 10.222.0.70 "GET /compute/v2.1/servers/c965dc65-aac3-4645-a9d4-127a287569fc" status: 200 len: 1322 microversion: 2.1 time: 0.238369 Aug 27 03:34:44.747426 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3138/6232] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:44 2022] GET /compute/v2.1/servers/c965dc65-aac3-4645-a9d4-127a287569fc => generated 1322 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:45.775792 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0ceb0d01-ae78-4b31-a3d2-f6b25a8e3ca9 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:45.776848 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-0ceb0d01-ae78-4b31-a3d2-f6b25a8e3ca9 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] [instance: c965dc65-aac3-4645-a9d4-127a287569fc] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:45.784677 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0ceb0d01-ae78-4b31-a3d2-f6b25a8e3ca9 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:45.785166 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0ceb0d01-ae78-4b31-a3d2-f6b25a8e3ca9 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:45.785606 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0ceb0d01-ae78-4b31-a3d2-f6b25a8e3ca9 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:45.786313 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0ceb0d01-ae78-4b31-a3d2-f6b25a8e3ca9 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:45.786763 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0ceb0d01-ae78-4b31-a3d2-f6b25a8e3ca9 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:45.787212 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0ceb0d01-ae78-4b31-a3d2-f6b25a8e3ca9 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:45.937672 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0ceb0d01-ae78-4b31-a3d2-f6b25a8e3ca9 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad8396f6423c4d468a602390ee4ed738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d7d0869709416e950affd772f873ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:45.945881 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-0ceb0d01-ae78-4b31-a3d2-f6b25a8e3ca9 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] 10.222.0.70 "GET /compute/v2.1/servers/c965dc65-aac3-4645-a9d4-127a287569fc" status: 200 len: 1322 microversion: 2.1 time: 0.178764 Aug 27 03:34:45.946465 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3095/6233] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:45 2022] GET /compute/v2.1/servers/c965dc65-aac3-4645-a9d4-127a287569fc => generated 1322 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:46.973595 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-da74e69e-1e49-44f0-9638-5aa2ead550d4 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:46.974256 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-da74e69e-1e49-44f0-9638-5aa2ead550d4 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] [instance: c965dc65-aac3-4645-a9d4-127a287569fc] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:46.981695 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-da74e69e-1e49-44f0-9638-5aa2ead550d4 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:46.982210 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-da74e69e-1e49-44f0-9638-5aa2ead550d4 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:46.982670 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-da74e69e-1e49-44f0-9638-5aa2ead550d4 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:46.983435 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-da74e69e-1e49-44f0-9638-5aa2ead550d4 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:46.983895 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-da74e69e-1e49-44f0-9638-5aa2ead550d4 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:46.984345 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-da74e69e-1e49-44f0-9638-5aa2ead550d4 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:47.116486 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-da74e69e-1e49-44f0-9638-5aa2ead550d4 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad8396f6423c4d468a602390ee4ed738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d7d0869709416e950affd772f873ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:47.124353 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-da74e69e-1e49-44f0-9638-5aa2ead550d4 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] 10.222.0.70 "GET /compute/v2.1/servers/c965dc65-aac3-4645-a9d4-127a287569fc" status: 200 len: 1322 microversion: 2.1 time: 0.154737 Aug 27 03:34:47.124969 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3139/6234] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:46 2022] GET /compute/v2.1/servers/c965dc65-aac3-4645-a9d4-127a287569fc => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:48.149907 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d61355c9-6680-47b4-921d-9863c9f10e9a tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:48.150926 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d61355c9-6680-47b4-921d-9863c9f10e9a tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] [instance: c965dc65-aac3-4645-a9d4-127a287569fc] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:48.159915 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d61355c9-6680-47b4-921d-9863c9f10e9a tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:48.160424 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d61355c9-6680-47b4-921d-9863c9f10e9a tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:48.160989 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d61355c9-6680-47b4-921d-9863c9f10e9a tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:48.161684 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d61355c9-6680-47b4-921d-9863c9f10e9a tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:48.162128 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d61355c9-6680-47b4-921d-9863c9f10e9a tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:48.162549 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d61355c9-6680-47b4-921d-9863c9f10e9a tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:48.303068 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-d61355c9-6680-47b4-921d-9863c9f10e9a tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad8396f6423c4d468a602390ee4ed738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d7d0869709416e950affd772f873ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:48.311021 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d61355c9-6680-47b4-921d-9863c9f10e9a tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] 10.222.0.70 "GET /compute/v2.1/servers/c965dc65-aac3-4645-a9d4-127a287569fc" status: 200 len: 1322 microversion: 2.1 time: 0.167799 Aug 27 03:34:48.311600 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3096/6235] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:48 2022] GET /compute/v2.1/servers/c965dc65-aac3-4645-a9d4-127a287569fc => generated 1322 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:49.332562 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-799863b1-1b99-42ce-a1f1-cd4068ff4800 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:49.333204 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-799863b1-1b99-42ce-a1f1-cd4068ff4800 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] [instance: c965dc65-aac3-4645-a9d4-127a287569fc] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:49.341372 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-799863b1-1b99-42ce-a1f1-cd4068ff4800 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:49.341911 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-799863b1-1b99-42ce-a1f1-cd4068ff4800 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:49.342377 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-799863b1-1b99-42ce-a1f1-cd4068ff4800 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:49.343147 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-799863b1-1b99-42ce-a1f1-cd4068ff4800 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:49.343657 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-799863b1-1b99-42ce-a1f1-cd4068ff4800 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:49.344138 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-799863b1-1b99-42ce-a1f1-cd4068ff4800 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:49.481362 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-799863b1-1b99-42ce-a1f1-cd4068ff4800 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad8396f6423c4d468a602390ee4ed738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d7d0869709416e950affd772f873ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:49.489467 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-799863b1-1b99-42ce-a1f1-cd4068ff4800 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] 10.222.0.70 "GET /compute/v2.1/servers/c965dc65-aac3-4645-a9d4-127a287569fc" status: 200 len: 1322 microversion: 2.1 time: 0.161374 Aug 27 03:34:49.490046 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3140/6236] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:49 2022] GET /compute/v2.1/servers/c965dc65-aac3-4645-a9d4-127a287569fc => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:50.514042 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a8919ba5-46d0-4b9f-a007-699d818cde0b tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:50.515126 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a8919ba5-46d0-4b9f-a007-699d818cde0b tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] [instance: c965dc65-aac3-4645-a9d4-127a287569fc] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:50.526651 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a8919ba5-46d0-4b9f-a007-699d818cde0b tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:50.527454 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a8919ba5-46d0-4b9f-a007-699d818cde0b tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:50.528176 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a8919ba5-46d0-4b9f-a007-699d818cde0b tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:50.529272 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a8919ba5-46d0-4b9f-a007-699d818cde0b tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:50.529717 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a8919ba5-46d0-4b9f-a007-699d818cde0b tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:50.530140 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a8919ba5-46d0-4b9f-a007-699d818cde0b tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:50.675083 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-a8919ba5-46d0-4b9f-a007-699d818cde0b tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad8396f6423c4d468a602390ee4ed738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d7d0869709416e950affd772f873ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:50.683314 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a8919ba5-46d0-4b9f-a007-699d818cde0b tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] 10.222.0.70 "GET /compute/v2.1/servers/c965dc65-aac3-4645-a9d4-127a287569fc" status: 200 len: 1322 microversion: 2.1 time: 0.175719 Aug 27 03:34:50.683901 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3097/6237] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:50 2022] GET /compute/v2.1/servers/c965dc65-aac3-4645-a9d4-127a287569fc => generated 1322 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:51.192187 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-f8d34051-02a0-48b0-8863-a50d4b4e943e req-95a395c4-e7ac-47ed-ab3b-397f0083eeae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c965dc65-aac3-4645-a9d4-127a287569fc", "name": "network-vif-plugged", "status": "completed", "tag": "94dee0ca-5c62-4431-a286-02e4b9f9f3dc"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:51.198246 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:34:51.203938 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-f8d34051-02a0-48b0-8863-a50d4b4e943e req-95a395c4-e7ac-47ed-ab3b-397f0083eeae service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:51.204448 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-f8d34051-02a0-48b0-8863-a50d4b4e943e req-95a395c4-e7ac-47ed-ab3b-397f0083eeae service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:51.204900 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-f8d34051-02a0-48b0-8863-a50d4b4e943e req-95a395c4-e7ac-47ed-ab3b-397f0083eeae service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:51.216823 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-f8d34051-02a0-48b0-8863-a50d4b4e943e req-95a395c4-e7ac-47ed-ab3b-397f0083eeae service nova] Creating event network-vif-plugged:94dee0ca-5c62-4431-a286-02e4b9f9f3dc for instance c965dc65-aac3-4645-a9d4-127a287569fc on n-h1-852278-4 Aug 27 03:34:51.222007 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-f8d34051-02a0-48b0-8863-a50d4b4e943e req-95a395c4-e7ac-47ed-ab3b-397f0083eeae service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033697 Aug 27 03:34:51.222813 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3141/6238] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:34:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:34:51.708472 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6cf2194d-3a4a-4ac8-a366-c21e72cf19e6 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:51.709362 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-6cf2194d-3a4a-4ac8-a366-c21e72cf19e6 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] [instance: c965dc65-aac3-4645-a9d4-127a287569fc] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:51.712418 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:34:51.713562 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=6 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:34:51.722141 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6cf2194d-3a4a-4ac8-a366-c21e72cf19e6 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:51.722627 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6cf2194d-3a4a-4ac8-a366-c21e72cf19e6 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:51.723081 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6cf2194d-3a4a-4ac8-a366-c21e72cf19e6 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:51.723777 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6cf2194d-3a4a-4ac8-a366-c21e72cf19e6 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:51.724239 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6cf2194d-3a4a-4ac8-a366-c21e72cf19e6 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:51.724691 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6cf2194d-3a4a-4ac8-a366-c21e72cf19e6 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:51.859901 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-6cf2194d-3a4a-4ac8-a366-c21e72cf19e6 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad8396f6423c4d468a602390ee4ed738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d7d0869709416e950affd772f873ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:51.867760 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-6cf2194d-3a4a-4ac8-a366-c21e72cf19e6 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] 10.222.0.70 "GET /compute/v2.1/servers/c965dc65-aac3-4645-a9d4-127a287569fc" status: 200 len: 1322 microversion: 2.1 time: 0.166108 Aug 27 03:34:51.868346 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3098/6239] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:51 2022] GET /compute/v2.1/servers/c965dc65-aac3-4645-a9d4-127a287569fc => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:52.890261 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d5dddf42-15cd-4509-8724-1b58cdd94936 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:52.891020 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d5dddf42-15cd-4509-8724-1b58cdd94936 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] [instance: c965dc65-aac3-4645-a9d4-127a287569fc] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:52.897993 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d5dddf42-15cd-4509-8724-1b58cdd94936 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:52.898520 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d5dddf42-15cd-4509-8724-1b58cdd94936 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:52.898971 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d5dddf42-15cd-4509-8724-1b58cdd94936 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:52.899671 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d5dddf42-15cd-4509-8724-1b58cdd94936 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:52.900169 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d5dddf42-15cd-4509-8724-1b58cdd94936 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:52.900644 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d5dddf42-15cd-4509-8724-1b58cdd94936 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:53.036933 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d5dddf42-15cd-4509-8724-1b58cdd94936 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad8396f6423c4d468a602390ee4ed738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d7d0869709416e950affd772f873ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:53.048908 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d5dddf42-15cd-4509-8724-1b58cdd94936 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] 10.222.0.70 "GET /compute/v2.1/servers/c965dc65-aac3-4645-a9d4-127a287569fc" status: 200 len: 1472 microversion: 2.1 time: 0.163988 Aug 27 03:34:53.049501 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3142/6240] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:52 2022] GET /compute/v2.1/servers/c965dc65-aac3-4645-a9d4-127a287569fc => generated 1472 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:53.135844 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c423892b-9a33-48f9-9ae0-b8804010dee3 tempest-ServersAdminNegativeTestJSON-925117435 tempest-ServersAdminNegativeTestJSON-925117435-project-admin] Calling method '.version_select at 0x7f5ee38118b0>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:53.209132 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c423892b-9a33-48f9-9ae0-b8804010dee3 tempest-ServersAdminNegativeTestJSON-925117435 tempest-ServersAdminNegativeTestJSON-925117435-project-admin] 10.222.0.70 "GET /compute/v2.1/os-quota-sets/eb029331370d41aeb99d526cea09bf3d" status: 200 len: 371 microversion: 2.1 time: 0.131819 Aug 27 03:34:53.209715 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3099/6241] 10.222.0.70 () {58 vars in 1242 bytes} [Sat Aug 27 03:34:53 2022] GET /compute/v2.1/os-quota-sets/eb029331370d41aeb99d526cea09bf3d => generated 371 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:34:53.221599 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-bf1ea588-e8d4-409b-b7d2-eff0d4f4cdf1 tempest-ServersAdminNegativeTestJSON-925117435 tempest-ServersAdminNegativeTestJSON-925117435-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1529167429", "id": 123627669, "os-flavor-access:is_public": "True"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:53.244090 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-bf1ea588-e8d4-409b-b7d2-eff0d4f4cdf1 tempest-ServersAdminNegativeTestJSON-925117435 tempest-ServersAdminNegativeTestJSON-925117435-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.026557 Aug 27 03:34:53.244726 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3143/6242] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 03:34:53 2022] POST /compute/v2.1/flavors => generated 435 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:34:53.257321 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ed12d672-dbef-4d0b-889a-54ec063085d8 tempest-ServersAdminNegativeTestJSON-925117435 tempest-ServersAdminNegativeTestJSON-925117435-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "123627669"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:53.259631 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-ed12d672-dbef-4d0b-889a-54ec063085d8 tempest-ServersAdminNegativeTestJSON-925117435 tempest-ServersAdminNegativeTestJSON-925117435-project-admin] [instance: c965dc65-aac3-4645-a9d4-127a287569fc] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:53.266084 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ed12d672-dbef-4d0b-889a-54ec063085d8 tempest-ServersAdminNegativeTestJSON-925117435 tempest-ServersAdminNegativeTestJSON-925117435-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:53.266579 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ed12d672-dbef-4d0b-889a-54ec063085d8 tempest-ServersAdminNegativeTestJSON-925117435 tempest-ServersAdminNegativeTestJSON-925117435-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:53.267019 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ed12d672-dbef-4d0b-889a-54ec063085d8 tempest-ServersAdminNegativeTestJSON-925117435 tempest-ServersAdminNegativeTestJSON-925117435-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:53.267717 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ed12d672-dbef-4d0b-889a-54ec063085d8 tempest-ServersAdminNegativeTestJSON-925117435 tempest-ServersAdminNegativeTestJSON-925117435-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:53.268171 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ed12d672-dbef-4d0b-889a-54ec063085d8 tempest-ServersAdminNegativeTestJSON-925117435 tempest-ServersAdminNegativeTestJSON-925117435-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:53.268614 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ed12d672-dbef-4d0b-889a-54ec063085d8 tempest-ServersAdminNegativeTestJSON-925117435 tempest-ServersAdminNegativeTestJSON-925117435-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:53.364457 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-ed12d672-dbef-4d0b-889a-54ec063085d8 tempest-ServersAdminNegativeTestJSON-925117435 tempest-ServersAdminNegativeTestJSON-925117435-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'd860b8a75bdf497888881fea8164d01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb029331370d41aeb99d526cea09bf3d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:53.374370 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-ed12d672-dbef-4d0b-889a-54ec063085d8 tempest-ServersAdminNegativeTestJSON-925117435 tempest-ServersAdminNegativeTestJSON-925117435-project-admin] [instance: c965dc65-aac3-4645-a9d4-127a287569fc] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1529167429 {{(pid=134052) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 27 03:34:53.381850 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ed12d672-dbef-4d0b-889a-54ec063085d8 tempest-ServersAdminNegativeTestJSON-925117435 tempest-ServersAdminNegativeTestJSON-925117435-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:53.382326 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ed12d672-dbef-4d0b-889a-54ec063085d8 tempest-ServersAdminNegativeTestJSON-925117435 tempest-ServersAdminNegativeTestJSON-925117435-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:53.382757 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ed12d672-dbef-4d0b-889a-54ec063085d8 tempest-ServersAdminNegativeTestJSON-925117435 tempest-ServersAdminNegativeTestJSON-925117435-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:53.383475 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ed12d672-dbef-4d0b-889a-54ec063085d8 tempest-ServersAdminNegativeTestJSON-925117435 tempest-ServersAdminNegativeTestJSON-925117435-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:53.383917 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ed12d672-dbef-4d0b-889a-54ec063085d8 tempest-ServersAdminNegativeTestJSON-925117435 tempest-ServersAdminNegativeTestJSON-925117435-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:53.384352 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ed12d672-dbef-4d0b-889a-54ec063085d8 tempest-ServersAdminNegativeTestJSON-925117435 tempest-ServersAdminNegativeTestJSON-925117435-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:53.405330 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-ed12d672-dbef-4d0b-889a-54ec063085d8 tempest-ServersAdminNegativeTestJSON-925117435 tempest-ServersAdminNegativeTestJSON-925117435-project-admin] Getting quotas for project 26d7d0869709416e950affd772f873ff. Resources: {'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:34:53.410910 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-ed12d672-dbef-4d0b-889a-54ec063085d8 tempest-ServersAdminNegativeTestJSON-925117435 tempest-ServersAdminNegativeTestJSON-925117435-project-admin] Getting quotas for user ad8396f6423c4d468a602390ee4ed738 and project 26d7d0869709416e950affd772f873ff. Resources: {'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:34:53.423858 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.compute.api [None req-ed12d672-dbef-4d0b-889a-54ec063085d8 tempest-ServersAdminNegativeTestJSON-925117435 tempest-ServersAdminNegativeTestJSON-925117435-project-admin] ram quota exceeded for eb029331370d41aeb99d526cea09bf3d, tried to resize instance. Aug 27 03:34:53.424446 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-ed12d672-dbef-4d0b-889a-54ec063085d8 tempest-ServersAdminNegativeTestJSON-925117435 tempest-ServersAdminNegativeTestJSON-925117435-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 27 03:34:53.426559 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ed12d672-dbef-4d0b-889a-54ec063085d8 tempest-ServersAdminNegativeTestJSON-925117435 tempest-ServersAdminNegativeTestJSON-925117435-project-admin] Request method failure captured: Aug 27 03:34:53.426559 n-d-852278-4 devstack@n-api.service[134052]: request: POST /compute/v2.1/servers/c965dc65-aac3-4645-a9d4-127a287569fc/action HTTP/1.1 Aug 27 03:34:53.426559 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 03:34:53.426559 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 03:34:53.426559 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 03:34:53.426559 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 38 Aug 27 03:34:53.426559 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 03:34:53.426559 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 03:34:53.426559 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 03:34:53.426559 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 03:34:53.426559 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCZDQrdr-aqAjSMYdYmTrpc3AcKKGM77cTTMyGDsSj8NhdBz-bWBmFF-iIcZwAWtKqRRrM-CsCj6Rj6CAds8WsBCvXw7YLtwuq8sYITIMDWUc6j8x3E6FeuxY6Yv8_mJT9TpGw11ovmnraDxm0Tw42Kw6jx7wFLob2FdIHOoykkbkFVM Aug 27 03:34:53.426559 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 03:34:53.426559 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 03:34:53.426559 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 03:34:53.426559 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 03:34:53.426559 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 03:34:53.426559 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 03:34:53.426559 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: eb029331370d41aeb99d526cea09bf3d Aug 27 03:34:53.426559 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-925117435 Aug 27 03:34:53.426559 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,admin,member Aug 27 03:34:53.426559 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,admin,member Aug 27 03:34:53.426559 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/eb029331370d41aeb99d526cea09bf3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_eb029331370d41aeb99d526cea09bf3d", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/eb029331370d41aeb99d526cea09bf3d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/eb029331370d41aeb99d526cea09bf3d"}]}] Aug 27 03:34:53.426559 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ServersAdminNegativeTestJSON-925117435 Aug 27 03:34:53.426559 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: eb029331370d41aeb99d526cea09bf3d Aug 27 03:34:53.426559 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-925117435 Aug 27 03:34:53.426559 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ServersAdminNegativeTestJSON-925117435-project-admin Aug 27 03:34:53.426559 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 03:34:53.426559 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 03:34:53.426559 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: d860b8a75bdf497888881fea8164d01d Aug 27 03:34:53.426559 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ServersAdminNegativeTestJSON-925117435-project-admin Aug 27 03:34:53.426559 n-d-852278-4 devstack@n-api.service[134052]: Aug 27 03:34:53.426559 n-d-852278-4 devstack@n-api.service[134052]: {"resize": {"flavorRef": "123627669"}} Aug 27 03:34:53.426559 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 03:34:53.426559 n-d-852278-4 devstack@n-api.service[134052]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 27 03:34:53.426559 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': 'c965dc65-aac3-4645-a9d4-127a287569fc', 'body': {'resize': {'flavorRef': '123627669'}}} Aug 27 03:34:53.426559 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:34:53.426559 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:34:53.426559 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3876, in _check_quota_for_upsize Aug 27 03:34:53.426559 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Aug 27 03:34:53.426559 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 03:34:53.426559 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 03:34:53.426559 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 27 03:34:53.426559 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc Aug 27 03:34:53.426559 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 27 03:34:53.426559 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 27 03:34:53.426559 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 03:34:53.426559 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 03:34:53.426559 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 27 03:34:53.426559 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 27 03:34:53.426559 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 27 03:34:53.426559 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 27 03:34:53.426559 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Aug 27 03:34:53.426559 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 27 03:34:53.426559 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Aug 27 03:34:53.426559 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:34:53.426559 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:34:53.426559 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:34:53.426559 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:34:53.426559 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 27 03:34:53.426559 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 27 03:34:53.426559 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 27 03:34:53.426559 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 03:34:53.426559 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 27 03:34:53.432236 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 27 03:34:53.432236 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 27 03:34:53.432236 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 27 03:34:53.432236 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 03:34:53.432236 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 03:34:53.432236 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 27 03:34:53.432236 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 27 03:34:53.432236 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Aug 27 03:34:53.432236 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 03:34:53.432236 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4242, in resize Aug 27 03:34:53.432236 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Aug 27 03:34:53.432236 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3894, in _check_quota_for_upsize Aug 27 03:34:53.432236 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 27 03:34:53.432236 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 27 03:34:53.432236 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:34:53.432236 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:34:53.432236 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:34:53.432236 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:34:53.432236 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:34:53.432236 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:34:53.432236 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:34:53.432236 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:34:53.432236 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:34:53.432236 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:34:53.432236 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:34:53.432236 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:34:53.432236 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 27 03:34:53.432236 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 27 03:34:53.432236 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Aug 27 03:34:53.432236 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 27 03:34:53.432236 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 27 03:34:53.432236 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:34:53.432236 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:34:53.432236 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:34:53.432236 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:34:53.432236 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:34:53.432236 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:34:53.432236 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:34:53.432236 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:34:53.432236 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 27 03:34:53.432236 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:34:53.432236 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ed12d672-dbef-4d0b-889a-54ec063085d8 tempest-ServersAdminNegativeTestJSON-925117435 tempest-ServersAdminNegativeTestJSON-925117435-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:34:53.432236 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ed12d672-dbef-4d0b-889a-54ec063085d8 tempest-ServersAdminNegativeTestJSON-925117435 tempest-ServersAdminNegativeTestJSON-925117435-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/c965dc65-aac3-4645-a9d4-127a287569fc/action" status: 403 len: 118 microversion: 2.1 time: 0.174868 Aug 27 03:34:53.432236 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3100/6243] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:34:53 2022] POST /compute/v2.1/servers/c965dc65-aac3-4645-a9d4-127a287569fc/action => generated 118 bytes in 176 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:34:53.437366 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-de9cceef-3721-4cf8-a707-1b201ff55625 tempest-ServersAdminNegativeTestJSON-925117435 tempest-ServersAdminNegativeTestJSON-925117435-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:53.457778 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-de9cceef-3721-4cf8-a707-1b201ff55625 tempest-ServersAdminNegativeTestJSON-925117435 tempest-ServersAdminNegativeTestJSON-925117435-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/123627669" status: 202 len: 0 microversion: 2.1 time: 0.024364 Aug 27 03:34:53.458402 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3144/6244] 10.222.0.70 () {58 vars in 1158 bytes} [Sat Aug 27 03:34:53 2022] DELETE /compute/v2.1/flavors/123627669 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:34:53.466601 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3c5b6a36-8b96-48ca-883d-458778f50e97 tempest-ServersAdminNegativeTestJSON-925117435 tempest-ServersAdminNegativeTestJSON-925117435-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:53.487498 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-3c5b6a36-8b96-48ca-883d-458778f50e97 tempest-ServersAdminNegativeTestJSON-925117435 tempest-ServersAdminNegativeTestJSON-925117435-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024584 Aug 27 03:34:53.488099 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3101/6245] 10.222.0.70 () {58 vars in 1146 bytes} [Sat Aug 27 03:34:53 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:53.510622 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e9e7c22c-23cd-4571-9739-4c5bddf9bc32 tempest-ServersAdminNegativeTestJSON-925117435 tempest-ServersAdminNegativeTestJSON-925117435-project-admin] Calling method '.version_select at 0x7f5ede25c280>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:53.594759 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e9e7c22c-23cd-4571-9739-4c5bddf9bc32 tempest-ServersAdminNegativeTestJSON-925117435 tempest-ServersAdminNegativeTestJSON-925117435-project-admin] 10.222.0.70 "GET /compute/v2.1/os-quota-sets/eb029331370d41aeb99d526cea09bf3d" status: 200 len: 371 microversion: 2.1 time: 0.090549 Aug 27 03:34:53.595390 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3145/6246] 10.222.0.70 () {58 vars in 1242 bytes} [Sat Aug 27 03:34:53 2022] GET /compute/v2.1/os-quota-sets/eb029331370d41aeb99d526cea09bf3d => generated 371 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:34:53.607579 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-233bb1cc-a320-4794-9aa6-a17e2f82940b tempest-ServersAdminNegativeTestJSON-925117435 tempest-ServersAdminNegativeTestJSON-925117435-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-348251659", "id": 366862651, "os-flavor-access:is_public": "True"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:53.633477 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-233bb1cc-a320-4794-9aa6-a17e2f82940b tempest-ServersAdminNegativeTestJSON-925117435 tempest-ServersAdminNegativeTestJSON-925117435-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 433 microversion: 2.1 time: 0.029341 Aug 27 03:34:53.634197 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3102/6247] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 03:34:53 2022] POST /compute/v2.1/flavors => generated 433 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:34:53.648414 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0029ff18-7f44-4627-84ce-24797331b40a tempest-ServersAdminNegativeTestJSON-925117435 tempest-ServersAdminNegativeTestJSON-925117435-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "366862651"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:53.650791 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-0029ff18-7f44-4627-84ce-24797331b40a tempest-ServersAdminNegativeTestJSON-925117435 tempest-ServersAdminNegativeTestJSON-925117435-project-admin] [instance: c965dc65-aac3-4645-a9d4-127a287569fc] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:53.657225 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0029ff18-7f44-4627-84ce-24797331b40a tempest-ServersAdminNegativeTestJSON-925117435 tempest-ServersAdminNegativeTestJSON-925117435-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:53.657789 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0029ff18-7f44-4627-84ce-24797331b40a tempest-ServersAdminNegativeTestJSON-925117435 tempest-ServersAdminNegativeTestJSON-925117435-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:53.658246 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0029ff18-7f44-4627-84ce-24797331b40a tempest-ServersAdminNegativeTestJSON-925117435 tempest-ServersAdminNegativeTestJSON-925117435-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:53.658959 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0029ff18-7f44-4627-84ce-24797331b40a tempest-ServersAdminNegativeTestJSON-925117435 tempest-ServersAdminNegativeTestJSON-925117435-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:53.659415 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0029ff18-7f44-4627-84ce-24797331b40a tempest-ServersAdminNegativeTestJSON-925117435 tempest-ServersAdminNegativeTestJSON-925117435-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:53.659857 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0029ff18-7f44-4627-84ce-24797331b40a tempest-ServersAdminNegativeTestJSON-925117435 tempest-ServersAdminNegativeTestJSON-925117435-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:53.752476 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-0029ff18-7f44-4627-84ce-24797331b40a tempest-ServersAdminNegativeTestJSON-925117435 tempest-ServersAdminNegativeTestJSON-925117435-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'd860b8a75bdf497888881fea8164d01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb029331370d41aeb99d526cea09bf3d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:53.758940 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-0029ff18-7f44-4627-84ce-24797331b40a tempest-ServersAdminNegativeTestJSON-925117435 tempest-ServersAdminNegativeTestJSON-925117435-project-admin] [instance: c965dc65-aac3-4645-a9d4-127a287569fc] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-348251659 {{(pid=134051) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 27 03:34:53.765929 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0029ff18-7f44-4627-84ce-24797331b40a tempest-ServersAdminNegativeTestJSON-925117435 tempest-ServersAdminNegativeTestJSON-925117435-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:53.766494 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0029ff18-7f44-4627-84ce-24797331b40a tempest-ServersAdminNegativeTestJSON-925117435 tempest-ServersAdminNegativeTestJSON-925117435-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:53.766943 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0029ff18-7f44-4627-84ce-24797331b40a tempest-ServersAdminNegativeTestJSON-925117435 tempest-ServersAdminNegativeTestJSON-925117435-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:53.767680 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0029ff18-7f44-4627-84ce-24797331b40a tempest-ServersAdminNegativeTestJSON-925117435 tempest-ServersAdminNegativeTestJSON-925117435-project-admin] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:53.768148 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0029ff18-7f44-4627-84ce-24797331b40a tempest-ServersAdminNegativeTestJSON-925117435 tempest-ServersAdminNegativeTestJSON-925117435-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:53.768615 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0029ff18-7f44-4627-84ce-24797331b40a tempest-ServersAdminNegativeTestJSON-925117435 tempest-ServersAdminNegativeTestJSON-925117435-project-admin] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:53.793558 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-0029ff18-7f44-4627-84ce-24797331b40a tempest-ServersAdminNegativeTestJSON-925117435 tempest-ServersAdminNegativeTestJSON-925117435-project-admin] Getting quotas for project 26d7d0869709416e950affd772f873ff. Resources: {'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:34:53.799389 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-0029ff18-7f44-4627-84ce-24797331b40a tempest-ServersAdminNegativeTestJSON-925117435 tempest-ServersAdminNegativeTestJSON-925117435-project-admin] Getting quotas for user ad8396f6423c4d468a602390ee4ed738 and project 26d7d0869709416e950affd772f873ff. Resources: {'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:34:53.812170 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.compute.api [None req-0029ff18-7f44-4627-84ce-24797331b40a tempest-ServersAdminNegativeTestJSON-925117435 tempest-ServersAdminNegativeTestJSON-925117435-project-admin] cores quota exceeded for eb029331370d41aeb99d526cea09bf3d, tried to resize instance. Aug 27 03:34:53.812758 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-0029ff18-7f44-4627-84ce-24797331b40a tempest-ServersAdminNegativeTestJSON-925117435 tempest-ServersAdminNegativeTestJSON-925117435-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 27 03:34:53.814869 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0029ff18-7f44-4627-84ce-24797331b40a tempest-ServersAdminNegativeTestJSON-925117435 tempest-ServersAdminNegativeTestJSON-925117435-project-admin] Request method failure captured: Aug 27 03:34:53.814869 n-d-852278-4 devstack@n-api.service[134051]: request: POST /compute/v2.1/servers/c965dc65-aac3-4645-a9d4-127a287569fc/action HTTP/1.1 Aug 27 03:34:53.814869 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 03:34:53.814869 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 03:34:53.814869 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 03:34:53.814869 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 38 Aug 27 03:34:53.814869 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 03:34:53.814869 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 03:34:53.814869 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 03:34:53.814869 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 03:34:53.814869 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCZDQrdr-aqAjSMYdYmTrpc3AcKKGM77cTTMyGDsSj8NhdBz-bWBmFF-iIcZwAWtKqRRrM-CsCj6Rj6CAds8WsBCvXw7YLtwuq8sYITIMDWUc6j8x3E6FeuxY6Yv8_mJT9TpGw11ovmnraDxm0Tw42Kw6jx7wFLob2FdIHOoykkbkFVM Aug 27 03:34:53.814869 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 03:34:53.814869 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 03:34:53.814869 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 03:34:53.814869 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 03:34:53.814869 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 03:34:53.814869 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 03:34:53.814869 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: eb029331370d41aeb99d526cea09bf3d Aug 27 03:34:53.814869 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-925117435 Aug 27 03:34:53.814869 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,admin,member Aug 27 03:34:53.814869 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,admin,member Aug 27 03:34:53.814869 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/eb029331370d41aeb99d526cea09bf3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_eb029331370d41aeb99d526cea09bf3d", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/eb029331370d41aeb99d526cea09bf3d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/eb029331370d41aeb99d526cea09bf3d"}]}] Aug 27 03:34:53.814869 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ServersAdminNegativeTestJSON-925117435 Aug 27 03:34:53.814869 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: eb029331370d41aeb99d526cea09bf3d Aug 27 03:34:53.814869 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-925117435 Aug 27 03:34:53.814869 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ServersAdminNegativeTestJSON-925117435-project-admin Aug 27 03:34:53.814869 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 03:34:53.814869 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 03:34:53.814869 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: d860b8a75bdf497888881fea8164d01d Aug 27 03:34:53.814869 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ServersAdminNegativeTestJSON-925117435-project-admin Aug 27 03:34:53.814869 n-d-852278-4 devstack@n-api.service[134051]: Aug 27 03:34:53.814869 n-d-852278-4 devstack@n-api.service[134051]: {"resize": {"flavorRef": "366862651"}} Aug 27 03:34:53.814869 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 03:34:53.814869 n-d-852278-4 devstack@n-api.service[134051]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 27 03:34:53.814869 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': 'c965dc65-aac3-4645-a9d4-127a287569fc', 'body': {'resize': {'flavorRef': '366862651'}}} Aug 27 03:34:53.814869 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:34:53.814869 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:34:53.814869 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3876, in _check_quota_for_upsize Aug 27 03:34:53.814869 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Aug 27 03:34:53.814869 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 03:34:53.814869 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 03:34:53.814869 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 27 03:34:53.814869 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc Aug 27 03:34:53.814869 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 27 03:34:53.814869 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 27 03:34:53.814869 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 03:34:53.814869 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 03:34:53.814869 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 27 03:34:53.814869 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 27 03:34:53.814869 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 27 03:34:53.814869 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 27 03:34:53.814869 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Aug 27 03:34:53.814869 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 27 03:34:53.814869 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Aug 27 03:34:53.814869 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:34:53.814869 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:34:53.814869 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:34:53.814869 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:34:53.814869 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 27 03:34:53.814869 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 27 03:34:53.814869 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 27 03:34:53.814869 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 03:34:53.814869 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 27 03:34:53.820079 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 27 03:34:53.820079 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 27 03:34:53.820079 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 27 03:34:53.820079 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 03:34:53.820079 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 03:34:53.820079 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 27 03:34:53.820079 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 27 03:34:53.820079 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Aug 27 03:34:53.820079 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 03:34:53.820079 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4242, in resize Aug 27 03:34:53.820079 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Aug 27 03:34:53.820079 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3894, in _check_quota_for_upsize Aug 27 03:34:53.820079 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 27 03:34:53.820079 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 27 03:34:53.820079 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:34:53.820079 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:34:53.820079 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:34:53.820079 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:34:53.820079 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:34:53.820079 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:34:53.820079 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:34:53.820079 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:34:53.820079 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:34:53.820079 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:34:53.820079 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:34:53.820079 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:34:53.820079 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 27 03:34:53.820079 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 27 03:34:53.820079 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Aug 27 03:34:53.820079 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 27 03:34:53.820079 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 27 03:34:53.820079 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:34:53.820079 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:34:53.820079 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:34:53.820079 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:34:53.820079 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:34:53.820079 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:34:53.820079 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:34:53.820079 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:34:53.820079 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 27 03:34:53.820079 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:34:53.820079 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0029ff18-7f44-4627-84ce-24797331b40a tempest-ServersAdminNegativeTestJSON-925117435 tempest-ServersAdminNegativeTestJSON-925117435-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:34:53.820079 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-0029ff18-7f44-4627-84ce-24797331b40a tempest-ServersAdminNegativeTestJSON-925117435 tempest-ServersAdminNegativeTestJSON-925117435-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/c965dc65-aac3-4645-a9d4-127a287569fc/action" status: 403 len: 113 microversion: 2.1 time: 0.171853 Aug 27 03:34:53.820079 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3146/6248] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:34:53 2022] POST /compute/v2.1/servers/c965dc65-aac3-4645-a9d4-127a287569fc/action => generated 113 bytes in 173 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:34:53.825255 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9be2ebb5-be0d-43cb-ae82-fb9c5e1bbbbd tempest-ServersAdminNegativeTestJSON-925117435 tempest-ServersAdminNegativeTestJSON-925117435-project-admin] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:53.845930 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9be2ebb5-be0d-43cb-ae82-fb9c5e1bbbbd tempest-ServersAdminNegativeTestJSON-925117435 tempest-ServersAdminNegativeTestJSON-925117435-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/366862651" status: 202 len: 0 microversion: 2.1 time: 0.024443 Aug 27 03:34:53.849544 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3103/6249] 10.222.0.70 () {58 vars in 1158 bytes} [Sat Aug 27 03:34:53 2022] DELETE /compute/v2.1/flavors/366862651 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 03:34:53.854557 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-66d5cb94-c786-4b56-88a2-ac1e75d94da1 tempest-ServersAdminNegativeTestJSON-925117435 tempest-ServersAdminNegativeTestJSON-925117435-project-admin] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:53.875220 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-66d5cb94-c786-4b56-88a2-ac1e75d94da1 tempest-ServersAdminNegativeTestJSON-925117435 tempest-ServersAdminNegativeTestJSON-925117435-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024307 Aug 27 03:34:53.875848 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3147/6250] 10.222.0.70 () {58 vars in 1146 bytes} [Sat Aug 27 03:34:53 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:53.895435 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9c947cc7-7458-495b-924a-50335c16caf1 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:53.895927 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-9c947cc7-7458-495b-924a-50335c16caf1 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] [instance: c965dc65-aac3-4645-a9d4-127a287569fc] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:53.902355 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9c947cc7-7458-495b-924a-50335c16caf1 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:53.902832 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9c947cc7-7458-495b-924a-50335c16caf1 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:53.903258 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9c947cc7-7458-495b-924a-50335c16caf1 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:53.903939 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9c947cc7-7458-495b-924a-50335c16caf1 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:53.904408 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9c947cc7-7458-495b-924a-50335c16caf1 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:53.904824 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9c947cc7-7458-495b-924a-50335c16caf1 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:53.930976 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-9c947cc7-7458-495b-924a-50335c16caf1 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] [instance: c965dc65-aac3-4645-a9d4-127a287569fc] Going to try to terminate instance {{(pid=134052) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:34:54.019152 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9c947cc7-7458-495b-924a-50335c16caf1 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] 10.222.0.70 "DELETE /compute/v2.1/servers/c965dc65-aac3-4645-a9d4-127a287569fc" status: 204 len: 0 microversion: 2.1 time: 0.127401 Aug 27 03:34:54.019685 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3104/6251] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 03:34:53 2022] DELETE /compute/v2.1/servers/c965dc65-aac3-4645-a9d4-127a287569fc => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:34:54.027908 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-47b0ae19-aeaa-4315-964f-673ac35eac6a tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:54.028659 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-47b0ae19-aeaa-4315-964f-673ac35eac6a tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] [instance: c965dc65-aac3-4645-a9d4-127a287569fc] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:54.035922 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-47b0ae19-aeaa-4315-964f-673ac35eac6a tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:54.036463 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-47b0ae19-aeaa-4315-964f-673ac35eac6a tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:54.037030 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-47b0ae19-aeaa-4315-964f-673ac35eac6a tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:54.037753 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-47b0ae19-aeaa-4315-964f-673ac35eac6a tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:54.038235 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-47b0ae19-aeaa-4315-964f-673ac35eac6a tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:54.038675 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-47b0ae19-aeaa-4315-964f-673ac35eac6a tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:54.169549 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-47b0ae19-aeaa-4315-964f-673ac35eac6a tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad8396f6423c4d468a602390ee4ed738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d7d0869709416e950affd772f873ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:54.178409 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-47b0ae19-aeaa-4315-964f-673ac35eac6a tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] 10.222.0.70 "GET /compute/v2.1/servers/c965dc65-aac3-4645-a9d4-127a287569fc" status: 200 len: 1478 microversion: 2.1 time: 0.154349 Aug 27 03:34:54.178990 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3148/6252] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:54 2022] GET /compute/v2.1/servers/c965dc65-aac3-4645-a9d4-127a287569fc => generated 1478 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:55.204589 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6515a1dd-54ab-4af5-9ef8-de9371af3513 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:55.205263 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-6515a1dd-54ab-4af5-9ef8-de9371af3513 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] [instance: c965dc65-aac3-4645-a9d4-127a287569fc] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:55.212869 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6515a1dd-54ab-4af5-9ef8-de9371af3513 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:55.213384 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6515a1dd-54ab-4af5-9ef8-de9371af3513 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:55.213838 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6515a1dd-54ab-4af5-9ef8-de9371af3513 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:55.214572 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6515a1dd-54ab-4af5-9ef8-de9371af3513 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:55.215042 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6515a1dd-54ab-4af5-9ef8-de9371af3513 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:55.215486 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6515a1dd-54ab-4af5-9ef8-de9371af3513 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:55.357013 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-6515a1dd-54ab-4af5-9ef8-de9371af3513 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad8396f6423c4d468a602390ee4ed738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d7d0869709416e950affd772f873ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:55.365315 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-6515a1dd-54ab-4af5-9ef8-de9371af3513 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] 10.222.0.70 "GET /compute/v2.1/servers/c965dc65-aac3-4645-a9d4-127a287569fc" status: 200 len: 1478 microversion: 2.1 time: 0.167845 Aug 27 03:34:55.365952 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3105/6253] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:55 2022] GET /compute/v2.1/servers/c965dc65-aac3-4645-a9d4-127a287569fc => generated 1478 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:55.859536 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-213dfaa0-6984-43fe-94f1-fe1a606519f7 req-8fac2b87-6b47-4865-b4ed-a369cc21d860 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c965dc65-aac3-4645-a9d4-127a287569fc", "name": "network-vif-deleted", "tag": "94dee0ca-5c62-4431-a286-02e4b9f9f3dc"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:55.870434 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-213dfaa0-6984-43fe-94f1-fe1a606519f7 req-8fac2b87-6b47-4865-b4ed-a369cc21d860 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:55.870965 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-213dfaa0-6984-43fe-94f1-fe1a606519f7 req-8fac2b87-6b47-4865-b4ed-a369cc21d860 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:55.871626 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-213dfaa0-6984-43fe-94f1-fe1a606519f7 req-8fac2b87-6b47-4865-b4ed-a369cc21d860 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:55.884921 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-213dfaa0-6984-43fe-94f1-fe1a606519f7 req-8fac2b87-6b47-4865-b4ed-a369cc21d860 service nova] Creating event network-vif-deleted:94dee0ca-5c62-4431-a286-02e4b9f9f3dc for instance c965dc65-aac3-4645-a9d4-127a287569fc on n-h1-852278-4 Aug 27 03:34:55.894046 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-213dfaa0-6984-43fe-94f1-fe1a606519f7 req-8fac2b87-6b47-4865-b4ed-a369cc21d860 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037994 Aug 27 03:34:55.894321 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3149/6254] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:34:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:34:56.386903 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a68553b0-11f7-4466-b19f-f45aeea750d5 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:56.387545 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a68553b0-11f7-4466-b19f-f45aeea750d5 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] [instance: c965dc65-aac3-4645-a9d4-127a287569fc] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:56.395033 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a68553b0-11f7-4466-b19f-f45aeea750d5 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:56.395522 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a68553b0-11f7-4466-b19f-f45aeea750d5 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:56.395967 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a68553b0-11f7-4466-b19f-f45aeea750d5 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:56.396723 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a68553b0-11f7-4466-b19f-f45aeea750d5 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:56.397173 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a68553b0-11f7-4466-b19f-f45aeea750d5 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:56.397594 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a68553b0-11f7-4466-b19f-f45aeea750d5 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:56.430656 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a68553b0-11f7-4466-b19f-f45aeea750d5 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:56.431152 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a68553b0-11f7-4466-b19f-f45aeea750d5 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:56.431562 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a68553b0-11f7-4466-b19f-f45aeea750d5 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:56.432021 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.instance [None req-a68553b0-11f7-4466-b19f-f45aeea750d5 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Lazy-loading 'fault' on Instance uuid c965dc65-aac3-4645-a9d4-127a287569fc {{(pid=134052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:34:56.482001 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-a68553b0-11f7-4466-b19f-f45aeea750d5 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad8396f6423c4d468a602390ee4ed738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d7d0869709416e950affd772f873ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:56.492119 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a68553b0-11f7-4466-b19f-f45aeea750d5 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] 10.222.0.70 "GET /compute/v2.1/servers/c965dc65-aac3-4645-a9d4-127a287569fc" status: 200 len: 1312 microversion: 2.1 time: 0.109148 Aug 27 03:34:56.492761 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3106/6255] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:56 2022] GET /compute/v2.1/servers/c965dc65-aac3-4645-a9d4-127a287569fc => generated 1312 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:57.518859 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-acb8eaeb-494b-4687-9b0c-68b17a3ef043 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:57.519578 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-acb8eaeb-494b-4687-9b0c-68b17a3ef043 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] [instance: c965dc65-aac3-4645-a9d4-127a287569fc] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:57.526709 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-acb8eaeb-494b-4687-9b0c-68b17a3ef043 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:57.527213 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-acb8eaeb-494b-4687-9b0c-68b17a3ef043 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:57.527666 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-acb8eaeb-494b-4687-9b0c-68b17a3ef043 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:57.528383 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-acb8eaeb-494b-4687-9b0c-68b17a3ef043 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:57.528877 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-acb8eaeb-494b-4687-9b0c-68b17a3ef043 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:57.529320 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-acb8eaeb-494b-4687-9b0c-68b17a3ef043 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:57.543428 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-acb8eaeb-494b-4687-9b0c-68b17a3ef043 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] HTTP exception thrown: Instance c965dc65-aac3-4645-a9d4-127a287569fc could not be found. Aug 27 03:34:57.545153 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-acb8eaeb-494b-4687-9b0c-68b17a3ef043 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Request method failure captured: Aug 27 03:34:57.545153 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/c965dc65-aac3-4645-a9d4-127a287569fc HTTP/1.1 Aug 27 03:34:57.545153 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 03:34:57.545153 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 03:34:57.545153 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 03:34:57.545153 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 03:34:57.545153 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 03:34:57.545153 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 03:34:57.545153 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 03:34:57.545153 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 03:34:57.545153 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCZDPLeFkULj_Bv9-xUHbSb6pSpZ32xZsv6xSMpbmO6nPJzQIfi_MUbZ2UZphAufxQ3oHf4wiLcWEq7SkeGAwAyms7hc0UuGOr4fKQHRNRcfGDxdoVvCd7ccoX6RgSOy1FwiSD3_cuynbjxf2Z2q3a9ukSAjME2tpJUSre4FdHWWDe2k Aug 27 03:34:57.545153 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 03:34:57.545153 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 03:34:57.545153 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 03:34:57.545153 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 03:34:57.545153 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 03:34:57.545153 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 03:34:57.545153 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 26d7d0869709416e950affd772f873ff Aug 27 03:34:57.545153 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-952322415 Aug 27 03:34:57.545153 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 03:34:57.545153 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 03:34:57.545153 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/26d7d0869709416e950affd772f873ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_26d7d0869709416e950affd772f873ff", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/26d7d0869709416e950affd772f873ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/26d7d0869709416e950affd772f873ff"}]}] Aug 27 03:34:57.545153 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ServersAdminNegativeTestJSON-952322415 Aug 27 03:34:57.545153 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 26d7d0869709416e950affd772f873ff Aug 27 03:34:57.545153 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-952322415 Aug 27 03:34:57.545153 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ServersAdminNegativeTestJSON-952322415-project Aug 27 03:34:57.545153 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 03:34:57.545153 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 03:34:57.545153 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: ad8396f6423c4d468a602390ee4ed738 Aug 27 03:34:57.545153 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ServersAdminNegativeTestJSON-952322415-project Aug 27 03:34:57.545153 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 03:34:57.545153 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance c965dc65-aac3-4645-a9d4-127a287569fc could not be found. Aug 27 03:34:57.545153 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': 'c965dc65-aac3-4645-a9d4-127a287569fc'} Aug 27 03:34:57.545153 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:34:57.545153 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:34:57.545153 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:34:57.545153 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:34:57.545153 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:34:57.545153 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:34:57.545153 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:34:57.545153 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:34:57.545153 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:34:57.545153 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:34:57.545153 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c965dc65-aac3-4645-a9d4-127a287569fc could not be found. Aug 27 03:34:57.545153 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:34:57.545153 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:34:57.545153 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:34:57.545153 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:34:57.545153 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:34:57.545153 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:34:57.545153 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:34:57.545153 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:34:57.545153 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:34:57.545153 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:34:57.545153 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:34:57.545153 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:34:57.545153 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:34:57.545153 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:34:57.545153 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:34:57.545153 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:34:57.545153 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c965dc65-aac3-4645-a9d4-127a287569fc could not be found. Aug 27 03:34:57.545153 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:34:57.545153 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:34:57.551130 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:34:57.551130 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:34:57.551130 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:34:57.551130 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:34:57.551130 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:34:57.551130 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:34:57.551130 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c965dc65-aac3-4645-a9d4-127a287569fc could not be found. Aug 27 03:34:57.551130 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:34:57.551130 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-acb8eaeb-494b-4687-9b0c-68b17a3ef043 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] Returning 404 to user: Instance c965dc65-aac3-4645-a9d4-127a287569fc could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:34:57.551130 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-acb8eaeb-494b-4687-9b0c-68b17a3ef043 tempest-ServersAdminNegativeTestJSON-952322415 tempest-ServersAdminNegativeTestJSON-952322415-project] 10.222.0.70 "GET /compute/v2.1/servers/c965dc65-aac3-4645-a9d4-127a287569fc" status: 404 len: 111 microversion: 2.1 time: 0.035098 Aug 27 03:34:57.551130 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3150/6256] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:57 2022] GET /compute/v2.1/servers/c965dc65-aac3-4645-a9d4-127a287569fc => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:35:03.901304 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:35:03.902435 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=3 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:35:04.024640 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-058ede1e-bfc7-4fc8-8ad3-2666ec267659 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-308333473", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "networks": [{"uuid": "753d2a31-ae67-4bce-bde1-1e2169d0d8b4"}]}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:04.079075 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.network.neutron [None req-058ede1e-bfc7-4fc8-8ad3-2666ec267659 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] validate_networks() for [('753d2a31-ae67-4bce-bde1-1e2169d0d8b4', None, None, None, None, None)] {{(pid=134052) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:35:04.462395 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-058ede1e-bfc7-4fc8-8ad3-2666ec267659 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Flavor limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:35:04.462824 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-058ede1e-bfc7-4fc8-8ad3-2666ec267659 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Image limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:35:04.463324 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-058ede1e-bfc7-4fc8-8ad3-2666ec267659 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Flavor pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:35:04.463731 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-058ede1e-bfc7-4fc8-8ad3-2666ec267659 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Image pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:35:04.464143 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-058ede1e-bfc7-4fc8-8ad3-2666ec267659 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:35:04.473653 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-058ede1e-bfc7-4fc8-8ad3-2666ec267659 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:04.474792 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-058ede1e-bfc7-4fc8-8ad3-2666ec267659 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:04.475234 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-058ede1e-bfc7-4fc8-8ad3-2666ec267659 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:04.475974 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-058ede1e-bfc7-4fc8-8ad3-2666ec267659 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:04.476446 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-058ede1e-bfc7-4fc8-8ad3-2666ec267659 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:04.476880 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-058ede1e-bfc7-4fc8-8ad3-2666ec267659 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:04.495061 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-058ede1e-bfc7-4fc8-8ad3-2666ec267659 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Getting quotas for project 4e859e4b40c94f5d892c2835453b645c. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:35:04.500486 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-058ede1e-bfc7-4fc8-8ad3-2666ec267659 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Getting quotas for user 5a7ca6270ea245df9373de99e3c42eaa and project 4e859e4b40c94f5d892c2835453b645c. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:35:04.513448 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-058ede1e-bfc7-4fc8-8ad3-2666ec267659 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Going to run 1 instances... {{(pid=134052) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:35:04.515784 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-058ede1e-bfc7-4fc8-8ad3-2666ec267659 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] [instance: cc14b49f-8c37-4d4b-b0ed-14fcf93f004c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134052) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:35:04.568108 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-058ede1e-bfc7-4fc8-8ad3-2666ec267659 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.672504 Aug 27 03:35:04.568970 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3107/6257] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 03:35:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 674 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:35:04.579663 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-49650104-078d-4f1d-bee8-baeb880df4bc tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:04.580286 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-49650104-078d-4f1d-bee8-baeb880df4bc tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] [instance: cc14b49f-8c37-4d4b-b0ed-14fcf93f004c] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:04.584353 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:35:04.596883 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=3 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:35:04.656281 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-49650104-078d-4f1d-bee8-baeb880df4bc tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ca6270ea245df9373de99e3c42eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e859e4b40c94f5d892c2835453b645c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:04.663571 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-49650104-078d-4f1d-bee8-baeb880df4bc tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] 10.222.0.70 "GET /compute/v2.1/servers/cc14b49f-8c37-4d4b-b0ed-14fcf93f004c" status: 200 len: 1214 microversion: 2.1 time: 0.087681 Aug 27 03:35:04.664150 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3151/6258] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:04 2022] GET /compute/v2.1/servers/cc14b49f-8c37-4d4b-b0ed-14fcf93f004c => generated 1214 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:05.693804 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ae98950a-01df-4d84-8be0-a4b5736826d5 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:05.696191 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-ae98950a-01df-4d84-8be0-a4b5736826d5 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] [instance: cc14b49f-8c37-4d4b-b0ed-14fcf93f004c] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:05.705671 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ae98950a-01df-4d84-8be0-a4b5736826d5 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:05.707539 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ae98950a-01df-4d84-8be0-a4b5736826d5 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:05.708555 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ae98950a-01df-4d84-8be0-a4b5736826d5 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:05.710773 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ae98950a-01df-4d84-8be0-a4b5736826d5 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:05.713572 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ae98950a-01df-4d84-8be0-a4b5736826d5 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:05.718132 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ae98950a-01df-4d84-8be0-a4b5736826d5 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:05.861100 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-ae98950a-01df-4d84-8be0-a4b5736826d5 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ca6270ea245df9373de99e3c42eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e859e4b40c94f5d892c2835453b645c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:05.871478 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ae98950a-01df-4d84-8be0-a4b5736826d5 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] 10.222.0.70 "GET /compute/v2.1/servers/cc14b49f-8c37-4d4b-b0ed-14fcf93f004c" status: 200 len: 1284 microversion: 2.1 time: 0.185353 Aug 27 03:35:05.872077 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3108/6259] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:05 2022] GET /compute/v2.1/servers/cc14b49f-8c37-4d4b-b0ed-14fcf93f004c => generated 1284 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:06.893142 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e88c9651-5dbe-4f10-90fa-d770178b90f8 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:06.894458 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-e88c9651-5dbe-4f10-90fa-d770178b90f8 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] [instance: cc14b49f-8c37-4d4b-b0ed-14fcf93f004c] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:06.903313 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e88c9651-5dbe-4f10-90fa-d770178b90f8 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:06.904048 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e88c9651-5dbe-4f10-90fa-d770178b90f8 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:06.904723 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e88c9651-5dbe-4f10-90fa-d770178b90f8 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:06.905448 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e88c9651-5dbe-4f10-90fa-d770178b90f8 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:06.905976 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e88c9651-5dbe-4f10-90fa-d770178b90f8 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:06.906395 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e88c9651-5dbe-4f10-90fa-d770178b90f8 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:07.125410 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e88c9651-5dbe-4f10-90fa-d770178b90f8 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ca6270ea245df9373de99e3c42eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e859e4b40c94f5d892c2835453b645c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:07.133624 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e88c9651-5dbe-4f10-90fa-d770178b90f8 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] 10.222.0.70 "GET /compute/v2.1/servers/cc14b49f-8c37-4d4b-b0ed-14fcf93f004c" status: 200 len: 1314 microversion: 2.1 time: 0.244416 Aug 27 03:35:07.134211 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3152/6260] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:06 2022] GET /compute/v2.1/servers/cc14b49f-8c37-4d4b-b0ed-14fcf93f004c => generated 1314 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:35:07.264338 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-ba8a7ab7-29db-4c9d-9ee2-72bbef2e3d0e req-59b79e8c-a895-43f9-82f0-a4090e160391 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc14b49f-8c37-4d4b-b0ed-14fcf93f004c", "tag": "88492f0b-8916-44a5-b749-51dbfbf3319f"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:07.275800 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-ba8a7ab7-29db-4c9d-9ee2-72bbef2e3d0e req-59b79e8c-a895-43f9-82f0-a4090e160391 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:07.276196 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-ba8a7ab7-29db-4c9d-9ee2-72bbef2e3d0e req-59b79e8c-a895-43f9-82f0-a4090e160391 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:07.276642 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-ba8a7ab7-29db-4c9d-9ee2-72bbef2e3d0e req-59b79e8c-a895-43f9-82f0-a4090e160391 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:07.292134 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-ba8a7ab7-29db-4c9d-9ee2-72bbef2e3d0e req-59b79e8c-a895-43f9-82f0-a4090e160391 service nova] Creating event network-changed:88492f0b-8916-44a5-b749-51dbfbf3319f for instance cc14b49f-8c37-4d4b-b0ed-14fcf93f004c on n-h1-852278-4 Aug 27 03:35:07.297820 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-ba8a7ab7-29db-4c9d-9ee2-72bbef2e3d0e req-59b79e8c-a895-43f9-82f0-a4090e160391 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037222 Aug 27 03:35:07.298455 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3109/6261] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:35:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:35:08.156597 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-03287aad-4913-44fa-88d9-5e410c9ab828 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:08.157405 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-03287aad-4913-44fa-88d9-5e410c9ab828 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] [instance: cc14b49f-8c37-4d4b-b0ed-14fcf93f004c] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:08.164580 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-03287aad-4913-44fa-88d9-5e410c9ab828 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:08.165077 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-03287aad-4913-44fa-88d9-5e410c9ab828 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:08.165545 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-03287aad-4913-44fa-88d9-5e410c9ab828 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:08.166263 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-03287aad-4913-44fa-88d9-5e410c9ab828 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:08.166732 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-03287aad-4913-44fa-88d9-5e410c9ab828 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:08.167173 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-03287aad-4913-44fa-88d9-5e410c9ab828 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:08.308057 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-03287aad-4913-44fa-88d9-5e410c9ab828 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ca6270ea245df9373de99e3c42eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e859e4b40c94f5d892c2835453b645c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:08.316639 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-03287aad-4913-44fa-88d9-5e410c9ab828 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] 10.222.0.70 "GET /compute/v2.1/servers/cc14b49f-8c37-4d4b-b0ed-14fcf93f004c" status: 200 len: 1314 microversion: 2.1 time: 0.165131 Aug 27 03:35:08.317227 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3153/6262] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:08 2022] GET /compute/v2.1/servers/cc14b49f-8c37-4d4b-b0ed-14fcf93f004c => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:09.343853 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-21455dff-8ad7-4053-85de-9d244df487bc tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:09.344883 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-21455dff-8ad7-4053-85de-9d244df487bc tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] [instance: cc14b49f-8c37-4d4b-b0ed-14fcf93f004c] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:09.356201 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-21455dff-8ad7-4053-85de-9d244df487bc tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:09.357182 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-21455dff-8ad7-4053-85de-9d244df487bc tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:09.357909 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-21455dff-8ad7-4053-85de-9d244df487bc tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:09.359062 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-21455dff-8ad7-4053-85de-9d244df487bc tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:09.359815 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-21455dff-8ad7-4053-85de-9d244df487bc tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:09.360572 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-21455dff-8ad7-4053-85de-9d244df487bc tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:09.591548 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-21455dff-8ad7-4053-85de-9d244df487bc tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ca6270ea245df9373de99e3c42eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e859e4b40c94f5d892c2835453b645c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:09.599568 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-21455dff-8ad7-4053-85de-9d244df487bc tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] 10.222.0.70 "GET /compute/v2.1/servers/cc14b49f-8c37-4d4b-b0ed-14fcf93f004c" status: 200 len: 1314 microversion: 2.1 time: 0.264506 Aug 27 03:35:09.600158 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3110/6263] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:09 2022] GET /compute/v2.1/servers/cc14b49f-8c37-4d4b-b0ed-14fcf93f004c => generated 1314 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:10.624515 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-fb4c1596-cdab-4c3c-b0d5-3b15469ca834 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:10.625520 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-fb4c1596-cdab-4c3c-b0d5-3b15469ca834 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] [instance: cc14b49f-8c37-4d4b-b0ed-14fcf93f004c] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:10.633560 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fb4c1596-cdab-4c3c-b0d5-3b15469ca834 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:10.633989 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fb4c1596-cdab-4c3c-b0d5-3b15469ca834 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:10.634468 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fb4c1596-cdab-4c3c-b0d5-3b15469ca834 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:10.635176 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fb4c1596-cdab-4c3c-b0d5-3b15469ca834 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:10.635643 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fb4c1596-cdab-4c3c-b0d5-3b15469ca834 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:10.636086 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fb4c1596-cdab-4c3c-b0d5-3b15469ca834 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:10.780694 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-fb4c1596-cdab-4c3c-b0d5-3b15469ca834 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ca6270ea245df9373de99e3c42eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e859e4b40c94f5d892c2835453b645c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:10.788608 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-fb4c1596-cdab-4c3c-b0d5-3b15469ca834 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] 10.222.0.70 "GET /compute/v2.1/servers/cc14b49f-8c37-4d4b-b0ed-14fcf93f004c" status: 200 len: 1314 microversion: 2.1 time: 0.170635 Aug 27 03:35:10.789197 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3154/6264] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:10 2022] GET /compute/v2.1/servers/cc14b49f-8c37-4d4b-b0ed-14fcf93f004c => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:11.809804 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d7d240c3-558d-4bdd-8447-441d363da4a1 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:11.810378 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d7d240c3-558d-4bdd-8447-441d363da4a1 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] [instance: cc14b49f-8c37-4d4b-b0ed-14fcf93f004c] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:11.813237 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=7,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:35:11.818673 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d7d240c3-558d-4bdd-8447-441d363da4a1 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:11.819154 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d7d240c3-558d-4bdd-8447-441d363da4a1 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:11.819652 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d7d240c3-558d-4bdd-8447-441d363da4a1 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:11.820349 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d7d240c3-558d-4bdd-8447-441d363da4a1 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:11.820829 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d7d240c3-558d-4bdd-8447-441d363da4a1 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:11.821260 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d7d240c3-558d-4bdd-8447-441d363da4a1 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:11.824589 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:35:11.958263 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-d7d240c3-558d-4bdd-8447-441d363da4a1 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ca6270ea245df9373de99e3c42eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e859e4b40c94f5d892c2835453b645c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:11.966429 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d7d240c3-558d-4bdd-8447-441d363da4a1 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] 10.222.0.70 "GET /compute/v2.1/servers/cc14b49f-8c37-4d4b-b0ed-14fcf93f004c" status: 200 len: 1314 microversion: 2.1 time: 0.160554 Aug 27 03:35:11.967018 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3111/6265] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:11 2022] GET /compute/v2.1/servers/cc14b49f-8c37-4d4b-b0ed-14fcf93f004c => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:12.989754 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e94627c0-8def-438c-bef4-71dc9b2164f2 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:12.990326 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-e94627c0-8def-438c-bef4-71dc9b2164f2 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] [instance: cc14b49f-8c37-4d4b-b0ed-14fcf93f004c] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:12.993083 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=1,nova_api:DELETE=3 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:35:12.998846 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e94627c0-8def-438c-bef4-71dc9b2164f2 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:12.999350 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e94627c0-8def-438c-bef4-71dc9b2164f2 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:12.999803 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e94627c0-8def-438c-bef4-71dc9b2164f2 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:13.000557 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e94627c0-8def-438c-bef4-71dc9b2164f2 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:13.001049 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e94627c0-8def-438c-bef4-71dc9b2164f2 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:13.001489 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e94627c0-8def-438c-bef4-71dc9b2164f2 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:13.004886 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=74 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:35:13.133589 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e94627c0-8def-438c-bef4-71dc9b2164f2 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ca6270ea245df9373de99e3c42eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e859e4b40c94f5d892c2835453b645c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:13.141397 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e94627c0-8def-438c-bef4-71dc9b2164f2 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] 10.222.0.70 "GET /compute/v2.1/servers/cc14b49f-8c37-4d4b-b0ed-14fcf93f004c" status: 200 len: 1314 microversion: 2.1 time: 0.156629 Aug 27 03:35:13.141975 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3155/6266] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:12 2022] GET /compute/v2.1/servers/cc14b49f-8c37-4d4b-b0ed-14fcf93f004c => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:13.340735 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-ccee4d44-c189-45b8-bc74-dc26a7a6e98a req-659361b2-f10f-4465-bc91-2b5227de6943 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc14b49f-8c37-4d4b-b0ed-14fcf93f004c", "name": "network-vif-plugged", "status": "completed", "tag": "88492f0b-8916-44a5-b749-51dbfbf3319f"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:13.351635 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-ccee4d44-c189-45b8-bc74-dc26a7a6e98a req-659361b2-f10f-4465-bc91-2b5227de6943 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:13.352145 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-ccee4d44-c189-45b8-bc74-dc26a7a6e98a req-659361b2-f10f-4465-bc91-2b5227de6943 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:13.352786 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-ccee4d44-c189-45b8-bc74-dc26a7a6e98a req-659361b2-f10f-4465-bc91-2b5227de6943 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:13.364250 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-ccee4d44-c189-45b8-bc74-dc26a7a6e98a req-659361b2-f10f-4465-bc91-2b5227de6943 service nova] Creating event network-vif-plugged:88492f0b-8916-44a5-b749-51dbfbf3319f for instance cc14b49f-8c37-4d4b-b0ed-14fcf93f004c on n-h1-852278-4 Aug 27 03:35:13.369260 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-ccee4d44-c189-45b8-bc74-dc26a7a6e98a req-659361b2-f10f-4465-bc91-2b5227de6943 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032416 Aug 27 03:35:13.369868 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3112/6267] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:35:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:35:14.169281 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4425a704-574f-4698-bdc9-2456d6d4d2e8 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:14.169857 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-4425a704-574f-4698-bdc9-2456d6d4d2e8 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] [instance: cc14b49f-8c37-4d4b-b0ed-14fcf93f004c] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:14.177984 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4425a704-574f-4698-bdc9-2456d6d4d2e8 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:14.178517 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4425a704-574f-4698-bdc9-2456d6d4d2e8 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:14.178998 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4425a704-574f-4698-bdc9-2456d6d4d2e8 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:14.179754 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4425a704-574f-4698-bdc9-2456d6d4d2e8 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:14.180245 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4425a704-574f-4698-bdc9-2456d6d4d2e8 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:14.180762 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4425a704-574f-4698-bdc9-2456d6d4d2e8 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:14.325958 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-4425a704-574f-4698-bdc9-2456d6d4d2e8 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ca6270ea245df9373de99e3c42eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e859e4b40c94f5d892c2835453b645c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:14.333927 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-4425a704-574f-4698-bdc9-2456d6d4d2e8 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] 10.222.0.70 "GET /compute/v2.1/servers/cc14b49f-8c37-4d4b-b0ed-14fcf93f004c" status: 200 len: 1314 microversion: 2.1 time: 0.169016 Aug 27 03:35:14.334742 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3156/6268] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:14 2022] GET /compute/v2.1/servers/cc14b49f-8c37-4d4b-b0ed-14fcf93f004c => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:15.353017 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:35:15.353800 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=6 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:35:15.358080 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a86d66d0-4df5-455a-b9f9-674954cd7883 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:15.358771 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a86d66d0-4df5-455a-b9f9-674954cd7883 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] [instance: cc14b49f-8c37-4d4b-b0ed-14fcf93f004c] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:15.366133 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a86d66d0-4df5-455a-b9f9-674954cd7883 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:15.366613 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a86d66d0-4df5-455a-b9f9-674954cd7883 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:15.367043 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a86d66d0-4df5-455a-b9f9-674954cd7883 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:15.367731 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a86d66d0-4df5-455a-b9f9-674954cd7883 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:15.368179 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a86d66d0-4df5-455a-b9f9-674954cd7883 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:15.368637 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a86d66d0-4df5-455a-b9f9-674954cd7883 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:15.505741 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-a86d66d0-4df5-455a-b9f9-674954cd7883 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ca6270ea245df9373de99e3c42eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e859e4b40c94f5d892c2835453b645c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:15.513868 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a86d66d0-4df5-455a-b9f9-674954cd7883 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] 10.222.0.70 "GET /compute/v2.1/servers/cc14b49f-8c37-4d4b-b0ed-14fcf93f004c" status: 200 len: 1501 microversion: 2.1 time: 0.162727 Aug 27 03:35:15.514484 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3113/6269] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:15 2022] GET /compute/v2.1/servers/cc14b49f-8c37-4d4b-b0ed-14fcf93f004c => generated 1501 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:15.534161 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3539cab1-740f-4cb4-b808-dff526c7ae36 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:15.536485 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-3539cab1-740f-4cb4-b808-dff526c7ae36 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] [instance: cc14b49f-8c37-4d4b-b0ed-14fcf93f004c] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:15.538451 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:35:15.545086 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3539cab1-740f-4cb4-b808-dff526c7ae36 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:15.545587 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3539cab1-740f-4cb4-b808-dff526c7ae36 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:15.546043 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3539cab1-740f-4cb4-b808-dff526c7ae36 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:15.547081 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3539cab1-740f-4cb4-b808-dff526c7ae36 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:15.547550 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3539cab1-740f-4cb4-b808-dff526c7ae36 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:15.547990 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3539cab1-740f-4cb4-b808-dff526c7ae36 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:15.621390 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-3539cab1-740f-4cb4-b808-dff526c7ae36 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '5a7ca6270ea245df9373de99e3c42eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e859e4b40c94f5d892c2835453b645c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:15.627899 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-3539cab1-740f-4cb4-b808-dff526c7ae36 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] [instance: cc14b49f-8c37-4d4b-b0ed-14fcf93f004c] Old instance type m1.heat2, new instance type m1.heat {{(pid=134051) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 27 03:35:15.634673 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-3539cab1-740f-4cb4-b808-dff526c7ae36 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Flavor limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:35:15.635112 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-3539cab1-740f-4cb4-b808-dff526c7ae36 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Image limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:35:15.635600 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-3539cab1-740f-4cb4-b808-dff526c7ae36 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Flavor pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:35:15.636031 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-3539cab1-740f-4cb4-b808-dff526c7ae36 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Image pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:35:15.636488 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-3539cab1-740f-4cb4-b808-dff526c7ae36 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:35:15.750915 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-3539cab1-740f-4cb4-b808-dff526c7ae36 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] 10.222.0.70 "POST /compute/v2.1/servers/cc14b49f-8c37-4d4b-b0ed-14fcf93f004c/action" status: 202 len: 0 microversion: 2.1 time: 0.220695 Aug 27 03:35:15.751846 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3157/6270] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:35:15 2022] POST /compute/v2.1/servers/cc14b49f-8c37-4d4b-b0ed-14fcf93f004c/action => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:35:15.760017 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3f7f1277-aa7e-46c2-92f0-782d542ab0bd tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:15.760569 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-3f7f1277-aa7e-46c2-92f0-782d542ab0bd tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] [instance: cc14b49f-8c37-4d4b-b0ed-14fcf93f004c] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:15.767053 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3f7f1277-aa7e-46c2-92f0-782d542ab0bd tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:15.767535 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3f7f1277-aa7e-46c2-92f0-782d542ab0bd tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:15.767967 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3f7f1277-aa7e-46c2-92f0-782d542ab0bd tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:15.768684 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3f7f1277-aa7e-46c2-92f0-782d542ab0bd tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:15.769138 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3f7f1277-aa7e-46c2-92f0-782d542ab0bd tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:15.769551 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3f7f1277-aa7e-46c2-92f0-782d542ab0bd tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:15.937093 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-3f7f1277-aa7e-46c2-92f0-782d542ab0bd tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ca6270ea245df9373de99e3c42eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e859e4b40c94f5d892c2835453b645c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:15.945155 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-3f7f1277-aa7e-46c2-92f0-782d542ab0bd tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] 10.222.0.70 "GET /compute/v2.1/servers/cc14b49f-8c37-4d4b-b0ed-14fcf93f004c" status: 200 len: 1510 microversion: 2.1 time: 0.189176 Aug 27 03:35:15.945726 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3114/6271] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:15 2022] GET /compute/v2.1/servers/cc14b49f-8c37-4d4b-b0ed-14fcf93f004c => generated 1510 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:16.966798 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-fe0d4e2f-94b0-44b4-a1d6-f8a99e634b6b tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:16.967382 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-fe0d4e2f-94b0-44b4-a1d6-f8a99e634b6b tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] [instance: cc14b49f-8c37-4d4b-b0ed-14fcf93f004c] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:16.974589 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fe0d4e2f-94b0-44b4-a1d6-f8a99e634b6b tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:16.975094 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fe0d4e2f-94b0-44b4-a1d6-f8a99e634b6b tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:16.975549 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fe0d4e2f-94b0-44b4-a1d6-f8a99e634b6b tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:16.976269 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fe0d4e2f-94b0-44b4-a1d6-f8a99e634b6b tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:16.976777 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fe0d4e2f-94b0-44b4-a1d6-f8a99e634b6b tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:16.977223 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fe0d4e2f-94b0-44b4-a1d6-f8a99e634b6b tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:17.109917 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-fe0d4e2f-94b0-44b4-a1d6-f8a99e634b6b tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ca6270ea245df9373de99e3c42eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e859e4b40c94f5d892c2835453b645c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:17.122505 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-fe0d4e2f-94b0-44b4-a1d6-f8a99e634b6b tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] 10.222.0.70 "GET /compute/v2.1/servers/cc14b49f-8c37-4d4b-b0ed-14fcf93f004c" status: 200 len: 1510 microversion: 2.1 time: 0.160144 Aug 27 03:35:17.123413 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3158/6272] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:16 2022] GET /compute/v2.1/servers/cc14b49f-8c37-4d4b-b0ed-14fcf93f004c => generated 1510 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:18.145264 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-fcc7a94a-be60-4dfc-bb19-5ae1746faf3d tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:18.145902 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-fcc7a94a-be60-4dfc-bb19-5ae1746faf3d tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] [instance: cc14b49f-8c37-4d4b-b0ed-14fcf93f004c] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:18.153218 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fcc7a94a-be60-4dfc-bb19-5ae1746faf3d tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:18.153700 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fcc7a94a-be60-4dfc-bb19-5ae1746faf3d tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:18.154129 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fcc7a94a-be60-4dfc-bb19-5ae1746faf3d tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:18.154809 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fcc7a94a-be60-4dfc-bb19-5ae1746faf3d tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:18.155254 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fcc7a94a-be60-4dfc-bb19-5ae1746faf3d tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:18.155676 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fcc7a94a-be60-4dfc-bb19-5ae1746faf3d tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:18.293987 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-fcc7a94a-be60-4dfc-bb19-5ae1746faf3d tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ca6270ea245df9373de99e3c42eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e859e4b40c94f5d892c2835453b645c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:18.302444 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-fcc7a94a-be60-4dfc-bb19-5ae1746faf3d tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] 10.222.0.70 "GET /compute/v2.1/servers/cc14b49f-8c37-4d4b-b0ed-14fcf93f004c" status: 200 len: 1515 microversion: 2.1 time: 0.161119 Aug 27 03:35:18.303019 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3115/6273] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:18 2022] GET /compute/v2.1/servers/cc14b49f-8c37-4d4b-b0ed-14fcf93f004c => generated 1515 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:19.327373 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-eb1bb99b-69ef-4219-a3e2-2b878a46dbe7 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:19.328227 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-eb1bb99b-69ef-4219-a3e2-2b878a46dbe7 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] [instance: cc14b49f-8c37-4d4b-b0ed-14fcf93f004c] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:19.340549 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eb1bb99b-69ef-4219-a3e2-2b878a46dbe7 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:19.341394 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eb1bb99b-69ef-4219-a3e2-2b878a46dbe7 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:19.342131 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eb1bb99b-69ef-4219-a3e2-2b878a46dbe7 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:19.343485 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eb1bb99b-69ef-4219-a3e2-2b878a46dbe7 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:19.344101 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eb1bb99b-69ef-4219-a3e2-2b878a46dbe7 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:19.344907 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-eb1bb99b-69ef-4219-a3e2-2b878a46dbe7 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:19.480652 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-eb1bb99b-69ef-4219-a3e2-2b878a46dbe7 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ca6270ea245df9373de99e3c42eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e859e4b40c94f5d892c2835453b645c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:19.490839 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-eb1bb99b-69ef-4219-a3e2-2b878a46dbe7 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] 10.222.0.70 "GET /compute/v2.1/servers/cc14b49f-8c37-4d4b-b0ed-14fcf93f004c" status: 200 len: 1515 microversion: 2.1 time: 0.169808 Aug 27 03:35:19.491634 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3159/6274] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:19 2022] GET /compute/v2.1/servers/cc14b49f-8c37-4d4b-b0ed-14fcf93f004c => generated 1515 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:20.516833 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3c0a2307-2796-4324-b513-3390b639d857 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:20.518040 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-3c0a2307-2796-4324-b513-3390b639d857 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] [instance: cc14b49f-8c37-4d4b-b0ed-14fcf93f004c] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:20.526253 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3c0a2307-2796-4324-b513-3390b639d857 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:20.526746 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3c0a2307-2796-4324-b513-3390b639d857 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:20.527185 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3c0a2307-2796-4324-b513-3390b639d857 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:20.527903 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3c0a2307-2796-4324-b513-3390b639d857 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:20.528385 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3c0a2307-2796-4324-b513-3390b639d857 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:20.528834 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3c0a2307-2796-4324-b513-3390b639d857 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:20.667528 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-3c0a2307-2796-4324-b513-3390b639d857 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ca6270ea245df9373de99e3c42eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e859e4b40c94f5d892c2835453b645c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:20.676071 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-3c0a2307-2796-4324-b513-3390b639d857 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] 10.222.0.70 "GET /compute/v2.1/servers/cc14b49f-8c37-4d4b-b0ed-14fcf93f004c" status: 200 len: 1515 microversion: 2.1 time: 0.166019 Aug 27 03:35:20.676711 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3116/6275] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:20 2022] GET /compute/v2.1/servers/cc14b49f-8c37-4d4b-b0ed-14fcf93f004c => generated 1515 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:21.701570 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0ea171cf-3f3b-4d98-802c-e0097c1c7ef5 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:21.702462 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-0ea171cf-3f3b-4d98-802c-e0097c1c7ef5 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] [instance: cc14b49f-8c37-4d4b-b0ed-14fcf93f004c] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:21.714073 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0ea171cf-3f3b-4d98-802c-e0097c1c7ef5 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:21.714915 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0ea171cf-3f3b-4d98-802c-e0097c1c7ef5 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:21.715671 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0ea171cf-3f3b-4d98-802c-e0097c1c7ef5 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:21.716848 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0ea171cf-3f3b-4d98-802c-e0097c1c7ef5 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:21.717581 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0ea171cf-3f3b-4d98-802c-e0097c1c7ef5 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:21.718274 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0ea171cf-3f3b-4d98-802c-e0097c1c7ef5 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:21.864690 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-0ea171cf-3f3b-4d98-802c-e0097c1c7ef5 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ca6270ea245df9373de99e3c42eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e859e4b40c94f5d892c2835453b645c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:21.872595 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-0ea171cf-3f3b-4d98-802c-e0097c1c7ef5 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] 10.222.0.70 "GET /compute/v2.1/servers/cc14b49f-8c37-4d4b-b0ed-14fcf93f004c" status: 200 len: 1515 microversion: 2.1 time: 0.177706 Aug 27 03:35:21.873146 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3160/6276] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:21 2022] GET /compute/v2.1/servers/cc14b49f-8c37-4d4b-b0ed-14fcf93f004c => generated 1515 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:22.895329 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-7874b1cb-9600-4caf-ac8d-650c7605d753 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:22.895939 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-7874b1cb-9600-4caf-ac8d-650c7605d753 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] [instance: cc14b49f-8c37-4d4b-b0ed-14fcf93f004c] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:22.903354 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7874b1cb-9600-4caf-ac8d-650c7605d753 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:22.903849 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7874b1cb-9600-4caf-ac8d-650c7605d753 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:22.904284 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7874b1cb-9600-4caf-ac8d-650c7605d753 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:22.905015 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7874b1cb-9600-4caf-ac8d-650c7605d753 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:22.905467 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7874b1cb-9600-4caf-ac8d-650c7605d753 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:22.905891 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7874b1cb-9600-4caf-ac8d-650c7605d753 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:23.036258 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-7874b1cb-9600-4caf-ac8d-650c7605d753 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ca6270ea245df9373de99e3c42eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e859e4b40c94f5d892c2835453b645c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:23.044796 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-7874b1cb-9600-4caf-ac8d-650c7605d753 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] 10.222.0.70 "GET /compute/v2.1/servers/cc14b49f-8c37-4d4b-b0ed-14fcf93f004c" status: 200 len: 1515 microversion: 2.1 time: 0.154574 Aug 27 03:35:23.045359 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3117/6277] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:22 2022] GET /compute/v2.1/servers/cc14b49f-8c37-4d4b-b0ed-14fcf93f004c => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:24.069918 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-397cedca-c6fb-4b0d-9edb-50aef267655f tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:24.070765 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-397cedca-c6fb-4b0d-9edb-50aef267655f tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] [instance: cc14b49f-8c37-4d4b-b0ed-14fcf93f004c] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:24.080238 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-397cedca-c6fb-4b0d-9edb-50aef267655f tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:24.080951 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-397cedca-c6fb-4b0d-9edb-50aef267655f tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:24.081547 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-397cedca-c6fb-4b0d-9edb-50aef267655f tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:24.082482 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-397cedca-c6fb-4b0d-9edb-50aef267655f tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:24.083101 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-397cedca-c6fb-4b0d-9edb-50aef267655f tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:24.083684 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-397cedca-c6fb-4b0d-9edb-50aef267655f tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:24.281758 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-397cedca-c6fb-4b0d-9edb-50aef267655f tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ca6270ea245df9373de99e3c42eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e859e4b40c94f5d892c2835453b645c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:24.292974 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-397cedca-c6fb-4b0d-9edb-50aef267655f tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] 10.222.0.70 "GET /compute/v2.1/servers/cc14b49f-8c37-4d4b-b0ed-14fcf93f004c" status: 200 len: 1515 microversion: 2.1 time: 0.228253 Aug 27 03:35:24.293744 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3161/6278] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:24 2022] GET /compute/v2.1/servers/cc14b49f-8c37-4d4b-b0ed-14fcf93f004c => generated 1515 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:25.316883 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f9540bef-5c8c-4402-b569-e8627ae27073 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:25.317550 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-f9540bef-5c8c-4402-b569-e8627ae27073 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] [instance: cc14b49f-8c37-4d4b-b0ed-14fcf93f004c] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:25.324779 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f9540bef-5c8c-4402-b569-e8627ae27073 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:25.325270 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f9540bef-5c8c-4402-b569-e8627ae27073 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:25.325708 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f9540bef-5c8c-4402-b569-e8627ae27073 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:25.326410 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f9540bef-5c8c-4402-b569-e8627ae27073 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:25.326864 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f9540bef-5c8c-4402-b569-e8627ae27073 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:25.327291 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f9540bef-5c8c-4402-b569-e8627ae27073 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:25.466457 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-f9540bef-5c8c-4402-b569-e8627ae27073 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ca6270ea245df9373de99e3c42eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e859e4b40c94f5d892c2835453b645c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:25.474819 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f9540bef-5c8c-4402-b569-e8627ae27073 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] 10.222.0.70 "GET /compute/v2.1/servers/cc14b49f-8c37-4d4b-b0ed-14fcf93f004c" status: 200 len: 1515 microversion: 2.1 time: 0.163361 Aug 27 03:35:25.475411 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3118/6279] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:25 2022] GET /compute/v2.1/servers/cc14b49f-8c37-4d4b-b0ed-14fcf93f004c => generated 1515 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:26.507964 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-933c06c3-f139-4015-8f87-ebfb289e10bb tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:26.509101 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-933c06c3-f139-4015-8f87-ebfb289e10bb tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] [instance: cc14b49f-8c37-4d4b-b0ed-14fcf93f004c] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:26.520649 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-933c06c3-f139-4015-8f87-ebfb289e10bb tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:26.521161 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-933c06c3-f139-4015-8f87-ebfb289e10bb tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:26.521613 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-933c06c3-f139-4015-8f87-ebfb289e10bb tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:26.522340 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-933c06c3-f139-4015-8f87-ebfb289e10bb tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:26.522812 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-933c06c3-f139-4015-8f87-ebfb289e10bb tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:26.523272 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-933c06c3-f139-4015-8f87-ebfb289e10bb tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:26.664383 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-933c06c3-f139-4015-8f87-ebfb289e10bb tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ca6270ea245df9373de99e3c42eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e859e4b40c94f5d892c2835453b645c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:26.676840 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-933c06c3-f139-4015-8f87-ebfb289e10bb tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] 10.222.0.70 "GET /compute/v2.1/servers/cc14b49f-8c37-4d4b-b0ed-14fcf93f004c" status: 200 len: 1515 microversion: 2.1 time: 0.175668 Aug 27 03:35:26.677441 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3162/6280] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:26 2022] GET /compute/v2.1/servers/cc14b49f-8c37-4d4b-b0ed-14fcf93f004c => generated 1515 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:27.700696 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-cf26f851-a0e5-4ae6-9a36-3122f9eef4de tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:27.701384 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-cf26f851-a0e5-4ae6-9a36-3122f9eef4de tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] [instance: cc14b49f-8c37-4d4b-b0ed-14fcf93f004c] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:27.711953 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cf26f851-a0e5-4ae6-9a36-3122f9eef4de tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:27.712644 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cf26f851-a0e5-4ae6-9a36-3122f9eef4de tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:27.713289 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cf26f851-a0e5-4ae6-9a36-3122f9eef4de tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:27.714291 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cf26f851-a0e5-4ae6-9a36-3122f9eef4de tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:27.714827 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cf26f851-a0e5-4ae6-9a36-3122f9eef4de tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:27.715406 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cf26f851-a0e5-4ae6-9a36-3122f9eef4de tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:27.846954 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-cf26f851-a0e5-4ae6-9a36-3122f9eef4de tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ca6270ea245df9373de99e3c42eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e859e4b40c94f5d892c2835453b645c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:27.855204 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-cf26f851-a0e5-4ae6-9a36-3122f9eef4de tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] 10.222.0.70 "GET /compute/v2.1/servers/cc14b49f-8c37-4d4b-b0ed-14fcf93f004c" status: 200 len: 1515 microversion: 2.1 time: 0.160919 Aug 27 03:35:27.855792 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3119/6281] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:27 2022] GET /compute/v2.1/servers/cc14b49f-8c37-4d4b-b0ed-14fcf93f004c => generated 1515 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:28.880303 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-5f10aa2c-c779-4a68-bb0e-f52f68a3df7e tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:28.881321 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-5f10aa2c-c779-4a68-bb0e-f52f68a3df7e tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] [instance: cc14b49f-8c37-4d4b-b0ed-14fcf93f004c] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:28.892876 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5f10aa2c-c779-4a68-bb0e-f52f68a3df7e tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:28.893769 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5f10aa2c-c779-4a68-bb0e-f52f68a3df7e tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:28.894390 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5f10aa2c-c779-4a68-bb0e-f52f68a3df7e tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:28.895097 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5f10aa2c-c779-4a68-bb0e-f52f68a3df7e tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:28.895565 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5f10aa2c-c779-4a68-bb0e-f52f68a3df7e tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:28.896009 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5f10aa2c-c779-4a68-bb0e-f52f68a3df7e tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:29.037024 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-5f10aa2c-c779-4a68-bb0e-f52f68a3df7e tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ca6270ea245df9373de99e3c42eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e859e4b40c94f5d892c2835453b645c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:29.045035 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-5f10aa2c-c779-4a68-bb0e-f52f68a3df7e tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] 10.222.0.70 "GET /compute/v2.1/servers/cc14b49f-8c37-4d4b-b0ed-14fcf93f004c" status: 200 len: 1515 microversion: 2.1 time: 0.171226 Aug 27 03:35:29.045626 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3163/6282] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:28 2022] GET /compute/v2.1/servers/cc14b49f-8c37-4d4b-b0ed-14fcf93f004c => generated 1515 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:30.070273 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5c8aeaaf-fc11-46a8-a244-3c415829e6ab tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:30.071044 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-5c8aeaaf-fc11-46a8-a244-3c415829e6ab tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] [instance: cc14b49f-8c37-4d4b-b0ed-14fcf93f004c] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:30.080572 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5c8aeaaf-fc11-46a8-a244-3c415829e6ab tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:30.081218 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5c8aeaaf-fc11-46a8-a244-3c415829e6ab tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:30.081795 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5c8aeaaf-fc11-46a8-a244-3c415829e6ab tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:30.082726 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5c8aeaaf-fc11-46a8-a244-3c415829e6ab tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:30.083324 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5c8aeaaf-fc11-46a8-a244-3c415829e6ab tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:30.083888 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5c8aeaaf-fc11-46a8-a244-3c415829e6ab tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:30.225189 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-5c8aeaaf-fc11-46a8-a244-3c415829e6ab tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ca6270ea245df9373de99e3c42eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e859e4b40c94f5d892c2835453b645c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:30.233557 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-5c8aeaaf-fc11-46a8-a244-3c415829e6ab tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] 10.222.0.70 "GET /compute/v2.1/servers/cc14b49f-8c37-4d4b-b0ed-14fcf93f004c" status: 200 len: 1515 microversion: 2.1 time: 0.169196 Aug 27 03:35:30.234134 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3120/6283] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:30 2022] GET /compute/v2.1/servers/cc14b49f-8c37-4d4b-b0ed-14fcf93f004c => generated 1515 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:31.255294 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-525284df-47a8-4144-9702-d101385be0a7 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:31.255918 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-525284df-47a8-4144-9702-d101385be0a7 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] [instance: cc14b49f-8c37-4d4b-b0ed-14fcf93f004c] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:31.263265 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-525284df-47a8-4144-9702-d101385be0a7 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:31.263772 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-525284df-47a8-4144-9702-d101385be0a7 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:31.264222 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-525284df-47a8-4144-9702-d101385be0a7 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:31.264971 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-525284df-47a8-4144-9702-d101385be0a7 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:31.265440 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-525284df-47a8-4144-9702-d101385be0a7 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:31.265883 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-525284df-47a8-4144-9702-d101385be0a7 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:31.410710 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-525284df-47a8-4144-9702-d101385be0a7 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ca6270ea245df9373de99e3c42eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e859e4b40c94f5d892c2835453b645c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:31.418987 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-525284df-47a8-4144-9702-d101385be0a7 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] 10.222.0.70 "GET /compute/v2.1/servers/cc14b49f-8c37-4d4b-b0ed-14fcf93f004c" status: 200 len: 1515 microversion: 2.1 time: 0.167925 Aug 27 03:35:31.419582 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3164/6284] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:31 2022] GET /compute/v2.1/servers/cc14b49f-8c37-4d4b-b0ed-14fcf93f004c => generated 1515 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:32.450962 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-fc89fb69-efba-40e2-8131-943bc2e48a4e tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:32.451866 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-fc89fb69-efba-40e2-8131-943bc2e48a4e tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] [instance: cc14b49f-8c37-4d4b-b0ed-14fcf93f004c] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:32.461363 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fc89fb69-efba-40e2-8131-943bc2e48a4e tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:32.461832 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fc89fb69-efba-40e2-8131-943bc2e48a4e tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:32.462261 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fc89fb69-efba-40e2-8131-943bc2e48a4e tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:32.462950 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fc89fb69-efba-40e2-8131-943bc2e48a4e tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:32.463391 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fc89fb69-efba-40e2-8131-943bc2e48a4e tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:32.463809 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fc89fb69-efba-40e2-8131-943bc2e48a4e tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:32.612021 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-fc89fb69-efba-40e2-8131-943bc2e48a4e tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ca6270ea245df9373de99e3c42eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e859e4b40c94f5d892c2835453b645c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:32.620305 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-fc89fb69-efba-40e2-8131-943bc2e48a4e tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] 10.222.0.70 "GET /compute/v2.1/servers/cc14b49f-8c37-4d4b-b0ed-14fcf93f004c" status: 200 len: 1515 microversion: 2.1 time: 0.176091 Aug 27 03:35:32.620927 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3121/6285] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:32 2022] GET /compute/v2.1/servers/cc14b49f-8c37-4d4b-b0ed-14fcf93f004c => generated 1515 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:33.645672 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-77ed0358-c158-4147-b395-e170f6646085 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:33.646681 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-77ed0358-c158-4147-b395-e170f6646085 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] [instance: cc14b49f-8c37-4d4b-b0ed-14fcf93f004c] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:33.658123 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-77ed0358-c158-4147-b395-e170f6646085 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:33.658938 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-77ed0358-c158-4147-b395-e170f6646085 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:33.659675 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-77ed0358-c158-4147-b395-e170f6646085 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:33.660989 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-77ed0358-c158-4147-b395-e170f6646085 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:33.661558 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-77ed0358-c158-4147-b395-e170f6646085 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:33.661995 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-77ed0358-c158-4147-b395-e170f6646085 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:33.804824 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-77ed0358-c158-4147-b395-e170f6646085 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ca6270ea245df9373de99e3c42eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e859e4b40c94f5d892c2835453b645c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:33.817786 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-77ed0358-c158-4147-b395-e170f6646085 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] 10.222.0.70 "GET /compute/v2.1/servers/cc14b49f-8c37-4d4b-b0ed-14fcf93f004c" status: 200 len: 1515 microversion: 2.1 time: 0.178550 Aug 27 03:35:33.818367 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3165/6286] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:33 2022] GET /compute/v2.1/servers/cc14b49f-8c37-4d4b-b0ed-14fcf93f004c => generated 1515 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:34.843169 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f3bef108-3d84-4dbf-bf0c-7520b26a0290 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:34.844115 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-f3bef108-3d84-4dbf-bf0c-7520b26a0290 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] [instance: cc14b49f-8c37-4d4b-b0ed-14fcf93f004c] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:34.855496 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f3bef108-3d84-4dbf-bf0c-7520b26a0290 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:34.856274 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f3bef108-3d84-4dbf-bf0c-7520b26a0290 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:34.857087 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f3bef108-3d84-4dbf-bf0c-7520b26a0290 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:34.858233 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f3bef108-3d84-4dbf-bf0c-7520b26a0290 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:34.859029 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f3bef108-3d84-4dbf-bf0c-7520b26a0290 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:34.859738 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f3bef108-3d84-4dbf-bf0c-7520b26a0290 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:34.999072 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-f3bef108-3d84-4dbf-bf0c-7520b26a0290 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ca6270ea245df9373de99e3c42eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e859e4b40c94f5d892c2835453b645c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:35.009063 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f3bef108-3d84-4dbf-bf0c-7520b26a0290 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] 10.222.0.70 "GET /compute/v2.1/servers/cc14b49f-8c37-4d4b-b0ed-14fcf93f004c" status: 200 len: 1515 microversion: 2.1 time: 0.172547 Aug 27 03:35:35.009658 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3122/6287] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:34 2022] GET /compute/v2.1/servers/cc14b49f-8c37-4d4b-b0ed-14fcf93f004c => generated 1515 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:36.031138 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4117f72c-7857-40c8-89e4-d51ab744882d tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:36.031730 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-4117f72c-7857-40c8-89e4-d51ab744882d tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] [instance: cc14b49f-8c37-4d4b-b0ed-14fcf93f004c] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:36.039187 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4117f72c-7857-40c8-89e4-d51ab744882d tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:36.039699 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4117f72c-7857-40c8-89e4-d51ab744882d tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:36.040154 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4117f72c-7857-40c8-89e4-d51ab744882d tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:36.040896 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4117f72c-7857-40c8-89e4-d51ab744882d tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:36.041367 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4117f72c-7857-40c8-89e4-d51ab744882d tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:36.041805 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4117f72c-7857-40c8-89e4-d51ab744882d tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:36.183640 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-4117f72c-7857-40c8-89e4-d51ab744882d tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ca6270ea245df9373de99e3c42eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e859e4b40c94f5d892c2835453b645c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:36.194049 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-4117f72c-7857-40c8-89e4-d51ab744882d tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] 10.222.0.70 "GET /compute/v2.1/servers/cc14b49f-8c37-4d4b-b0ed-14fcf93f004c" status: 200 len: 1515 microversion: 2.1 time: 0.166667 Aug 27 03:35:36.194892 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3166/6288] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:36 2022] GET /compute/v2.1/servers/cc14b49f-8c37-4d4b-b0ed-14fcf93f004c => generated 1515 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:37.217108 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f0ad8ba1-9d5b-437e-8e26-bcb71b91d91d tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:37.217825 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-f0ad8ba1-9d5b-437e-8e26-bcb71b91d91d tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] [instance: cc14b49f-8c37-4d4b-b0ed-14fcf93f004c] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:37.226466 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f0ad8ba1-9d5b-437e-8e26-bcb71b91d91d tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:37.226957 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f0ad8ba1-9d5b-437e-8e26-bcb71b91d91d tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:37.227402 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f0ad8ba1-9d5b-437e-8e26-bcb71b91d91d tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:37.228104 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f0ad8ba1-9d5b-437e-8e26-bcb71b91d91d tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:37.228589 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f0ad8ba1-9d5b-437e-8e26-bcb71b91d91d tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:37.229013 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f0ad8ba1-9d5b-437e-8e26-bcb71b91d91d tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:37.372714 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-f0ad8ba1-9d5b-437e-8e26-bcb71b91d91d tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ca6270ea245df9373de99e3c42eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e859e4b40c94f5d892c2835453b645c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:37.380928 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f0ad8ba1-9d5b-437e-8e26-bcb71b91d91d tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] 10.222.0.70 "GET /compute/v2.1/servers/cc14b49f-8c37-4d4b-b0ed-14fcf93f004c" status: 200 len: 1515 microversion: 2.1 time: 0.168964 Aug 27 03:35:37.381524 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3123/6289] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:37 2022] GET /compute/v2.1/servers/cc14b49f-8c37-4d4b-b0ed-14fcf93f004c => generated 1515 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:38.406414 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-2d4e436e-32f4-48eb-909a-4a7394aee20e tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:38.407373 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-2d4e436e-32f4-48eb-909a-4a7394aee20e tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] [instance: cc14b49f-8c37-4d4b-b0ed-14fcf93f004c] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:38.418902 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2d4e436e-32f4-48eb-909a-4a7394aee20e tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:38.419590 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2d4e436e-32f4-48eb-909a-4a7394aee20e tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:38.420382 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2d4e436e-32f4-48eb-909a-4a7394aee20e tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:38.421885 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2d4e436e-32f4-48eb-909a-4a7394aee20e tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:38.422712 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2d4e436e-32f4-48eb-909a-4a7394aee20e tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:38.423446 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2d4e436e-32f4-48eb-909a-4a7394aee20e tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:38.568369 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-2d4e436e-32f4-48eb-909a-4a7394aee20e tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ca6270ea245df9373de99e3c42eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e859e4b40c94f5d892c2835453b645c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:38.579926 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-2d4e436e-32f4-48eb-909a-4a7394aee20e tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] 10.222.0.70 "GET /compute/v2.1/servers/cc14b49f-8c37-4d4b-b0ed-14fcf93f004c" status: 200 len: 1515 microversion: 2.1 time: 0.180143 Aug 27 03:35:38.580795 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3167/6290] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:38 2022] GET /compute/v2.1/servers/cc14b49f-8c37-4d4b-b0ed-14fcf93f004c => generated 1515 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:39.606215 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-de1c58d6-c4c3-49ca-9df5-c7126185aa38 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:39.607172 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-de1c58d6-c4c3-49ca-9df5-c7126185aa38 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] [instance: cc14b49f-8c37-4d4b-b0ed-14fcf93f004c] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:39.618493 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-de1c58d6-c4c3-49ca-9df5-c7126185aa38 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:39.619306 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-de1c58d6-c4c3-49ca-9df5-c7126185aa38 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:39.620077 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-de1c58d6-c4c3-49ca-9df5-c7126185aa38 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:39.621316 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-de1c58d6-c4c3-49ca-9df5-c7126185aa38 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:39.622075 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-de1c58d6-c4c3-49ca-9df5-c7126185aa38 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:39.622784 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-de1c58d6-c4c3-49ca-9df5-c7126185aa38 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:39.756908 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-de1c58d6-c4c3-49ca-9df5-c7126185aa38 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ca6270ea245df9373de99e3c42eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e859e4b40c94f5d892c2835453b645c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:39.764999 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-de1c58d6-c4c3-49ca-9df5-c7126185aa38 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] 10.222.0.70 "GET /compute/v2.1/servers/cc14b49f-8c37-4d4b-b0ed-14fcf93f004c" status: 200 len: 1515 microversion: 2.1 time: 0.165554 Aug 27 03:35:39.765551 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3124/6291] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:39 2022] GET /compute/v2.1/servers/cc14b49f-8c37-4d4b-b0ed-14fcf93f004c => generated 1515 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:40.786434 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7f8ae9a8-f617-4ed2-a3af-b132b362a86f tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:40.787054 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-7f8ae9a8-f617-4ed2-a3af-b132b362a86f tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] [instance: cc14b49f-8c37-4d4b-b0ed-14fcf93f004c] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:40.794488 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7f8ae9a8-f617-4ed2-a3af-b132b362a86f tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:40.795382 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7f8ae9a8-f617-4ed2-a3af-b132b362a86f tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:40.795843 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7f8ae9a8-f617-4ed2-a3af-b132b362a86f tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:40.796990 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7f8ae9a8-f617-4ed2-a3af-b132b362a86f tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:40.797411 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7f8ae9a8-f617-4ed2-a3af-b132b362a86f tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:40.797859 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7f8ae9a8-f617-4ed2-a3af-b132b362a86f tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:41.018928 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-7f8ae9a8-f617-4ed2-a3af-b132b362a86f tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ca6270ea245df9373de99e3c42eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e859e4b40c94f5d892c2835453b645c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:41.026831 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-7f8ae9a8-f617-4ed2-a3af-b132b362a86f tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] 10.222.0.70 "GET /compute/v2.1/servers/cc14b49f-8c37-4d4b-b0ed-14fcf93f004c" status: 200 len: 1515 microversion: 2.1 time: 0.244461 Aug 27 03:35:41.027423 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3168/6292] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:40 2022] GET /compute/v2.1/servers/cc14b49f-8c37-4d4b-b0ed-14fcf93f004c => generated 1515 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:42.051727 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-dd955125-bb5f-46aa-a6db-22645a81c1dc tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:42.052677 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-dd955125-bb5f-46aa-a6db-22645a81c1dc tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] [instance: cc14b49f-8c37-4d4b-b0ed-14fcf93f004c] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:42.057343 n-d-852278-4 devstack@n-api.service[134052]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:35:42.057595 n-d-852278-4 devstack@n-api.service[134052]: Sat Aug 27 03:35:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cc14b49f-8c37-4d4b-b0ed-14fcf93f004c (ip 10.222.0.70) !!! Aug 27 03:35:42.059219 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=28 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:35:42.069664 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dd955125-bb5f-46aa-a6db-22645a81c1dc tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:42.070148 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dd955125-bb5f-46aa-a6db-22645a81c1dc tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:42.070583 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dd955125-bb5f-46aa-a6db-22645a81c1dc tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:42.071295 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dd955125-bb5f-46aa-a6db-22645a81c1dc tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:42.071739 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dd955125-bb5f-46aa-a6db-22645a81c1dc tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:42.072160 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dd955125-bb5f-46aa-a6db-22645a81c1dc tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:42.075478 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=80 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:35:42.210034 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-dd955125-bb5f-46aa-a6db-22645a81c1dc tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ca6270ea245df9373de99e3c42eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e859e4b40c94f5d892c2835453b645c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:42.218087 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-dd955125-bb5f-46aa-a6db-22645a81c1dc tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] 10.222.0.70 "GET /compute/v2.1/servers/cc14b49f-8c37-4d4b-b0ed-14fcf93f004c" status: 200 len: 1515 microversion: 2.1 time: 0.173397 Aug 27 03:35:42.218672 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3125/6293] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:42 2022] GET /compute/v2.1/servers/cc14b49f-8c37-4d4b-b0ed-14fcf93f004c => generated 1515 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:43.240841 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-13dc5423-3ed5-4ee8-81d5-662535591faf tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:43.241588 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-13dc5423-3ed5-4ee8-81d5-662535591faf tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] [instance: cc14b49f-8c37-4d4b-b0ed-14fcf93f004c] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:43.245514 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=32 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:35:43.253301 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-13dc5423-3ed5-4ee8-81d5-662535591faf tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:43.254012 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-13dc5423-3ed5-4ee8-81d5-662535591faf tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:43.254732 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-13dc5423-3ed5-4ee8-81d5-662535591faf tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:43.255476 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-13dc5423-3ed5-4ee8-81d5-662535591faf tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:43.255944 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-13dc5423-3ed5-4ee8-81d5-662535591faf tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:43.256406 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-13dc5423-3ed5-4ee8-81d5-662535591faf tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:43.259398 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:35:43.402370 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-13dc5423-3ed5-4ee8-81d5-662535591faf tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ca6270ea245df9373de99e3c42eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e859e4b40c94f5d892c2835453b645c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:43.410954 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-13dc5423-3ed5-4ee8-81d5-662535591faf tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] 10.222.0.70 "GET /compute/v2.1/servers/cc14b49f-8c37-4d4b-b0ed-14fcf93f004c" status: 200 len: 1515 microversion: 2.1 time: 0.175236 Aug 27 03:35:43.411550 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3169/6294] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:43 2022] GET /compute/v2.1/servers/cc14b49f-8c37-4d4b-b0ed-14fcf93f004c => generated 1515 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:44.436805 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-7a735da0-ecca-4305-89bc-942b87dffd3d tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:44.437774 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-7a735da0-ecca-4305-89bc-942b87dffd3d tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] [instance: cc14b49f-8c37-4d4b-b0ed-14fcf93f004c] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:44.449288 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7a735da0-ecca-4305-89bc-942b87dffd3d tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:44.450095 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7a735da0-ecca-4305-89bc-942b87dffd3d tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:44.450799 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7a735da0-ecca-4305-89bc-942b87dffd3d tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:44.451938 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7a735da0-ecca-4305-89bc-942b87dffd3d tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:44.452732 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7a735da0-ecca-4305-89bc-942b87dffd3d tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:44.453437 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7a735da0-ecca-4305-89bc-942b87dffd3d tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:44.928907 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-7a735da0-ecca-4305-89bc-942b87dffd3d tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ca6270ea245df9373de99e3c42eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e859e4b40c94f5d892c2835453b645c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:44.937389 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-7a735da0-ecca-4305-89bc-942b87dffd3d tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] 10.222.0.70 "GET /compute/v2.1/servers/cc14b49f-8c37-4d4b-b0ed-14fcf93f004c" status: 200 len: 1515 microversion: 2.1 time: 0.507192 Aug 27 03:35:44.937975 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3126/6295] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:44 2022] GET /compute/v2.1/servers/cc14b49f-8c37-4d4b-b0ed-14fcf93f004c => generated 1515 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:45.960518 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-6dfe25ac-48a1-45e6-9641-3b94335dfc32 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:45.961162 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-6dfe25ac-48a1-45e6-9641-3b94335dfc32 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] [instance: cc14b49f-8c37-4d4b-b0ed-14fcf93f004c] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:45.968673 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6dfe25ac-48a1-45e6-9641-3b94335dfc32 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:45.969158 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6dfe25ac-48a1-45e6-9641-3b94335dfc32 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:45.969613 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6dfe25ac-48a1-45e6-9641-3b94335dfc32 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:45.970382 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6dfe25ac-48a1-45e6-9641-3b94335dfc32 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:45.970857 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6dfe25ac-48a1-45e6-9641-3b94335dfc32 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:45.971295 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6dfe25ac-48a1-45e6-9641-3b94335dfc32 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:46.117152 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-6dfe25ac-48a1-45e6-9641-3b94335dfc32 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ca6270ea245df9373de99e3c42eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e859e4b40c94f5d892c2835453b645c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:46.127720 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-6dfe25ac-48a1-45e6-9641-3b94335dfc32 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] 10.222.0.70 "GET /compute/v2.1/servers/cc14b49f-8c37-4d4b-b0ed-14fcf93f004c" status: 200 len: 1515 microversion: 2.1 time: 0.171746 Aug 27 03:35:46.128303 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3170/6296] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:45 2022] GET /compute/v2.1/servers/cc14b49f-8c37-4d4b-b0ed-14fcf93f004c => generated 1515 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:47.152897 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-916d5482-b832-45f4-8198-411dcb86e468 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:47.153821 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-916d5482-b832-45f4-8198-411dcb86e468 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] [instance: cc14b49f-8c37-4d4b-b0ed-14fcf93f004c] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:47.163722 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-916d5482-b832-45f4-8198-411dcb86e468 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:47.164235 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-916d5482-b832-45f4-8198-411dcb86e468 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:47.164695 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-916d5482-b832-45f4-8198-411dcb86e468 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:47.165380 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-916d5482-b832-45f4-8198-411dcb86e468 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:47.165824 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-916d5482-b832-45f4-8198-411dcb86e468 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:47.166236 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-916d5482-b832-45f4-8198-411dcb86e468 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:47.300738 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-916d5482-b832-45f4-8198-411dcb86e468 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ca6270ea245df9373de99e3c42eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e859e4b40c94f5d892c2835453b645c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:47.312212 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-916d5482-b832-45f4-8198-411dcb86e468 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] 10.222.0.70 "GET /compute/v2.1/servers/cc14b49f-8c37-4d4b-b0ed-14fcf93f004c" status: 200 len: 1515 microversion: 2.1 time: 0.165819 Aug 27 03:35:47.313030 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3127/6297] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:47 2022] GET /compute/v2.1/servers/cc14b49f-8c37-4d4b-b0ed-14fcf93f004c => generated 1515 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:48.339246 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0927b928-6e7c-43fa-b9ea-ce47962b65b7 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:48.340374 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-0927b928-6e7c-43fa-b9ea-ce47962b65b7 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] [instance: cc14b49f-8c37-4d4b-b0ed-14fcf93f004c] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:48.350770 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0927b928-6e7c-43fa-b9ea-ce47962b65b7 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:48.351289 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0927b928-6e7c-43fa-b9ea-ce47962b65b7 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:48.351741 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0927b928-6e7c-43fa-b9ea-ce47962b65b7 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:48.352494 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0927b928-6e7c-43fa-b9ea-ce47962b65b7 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:48.352968 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0927b928-6e7c-43fa-b9ea-ce47962b65b7 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:48.353412 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0927b928-6e7c-43fa-b9ea-ce47962b65b7 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:48.489561 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-0927b928-6e7c-43fa-b9ea-ce47962b65b7 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ca6270ea245df9373de99e3c42eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e859e4b40c94f5d892c2835453b645c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:48.498134 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-0927b928-6e7c-43fa-b9ea-ce47962b65b7 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] 10.222.0.70 "GET /compute/v2.1/servers/cc14b49f-8c37-4d4b-b0ed-14fcf93f004c" status: 200 len: 1515 microversion: 2.1 time: 0.165603 Aug 27 03:35:48.498721 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3171/6298] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:48 2022] GET /compute/v2.1/servers/cc14b49f-8c37-4d4b-b0ed-14fcf93f004c => generated 1515 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:49.522316 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ae2171e8-80e8-4682-9e24-340566cb519c tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:49.522905 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-ae2171e8-80e8-4682-9e24-340566cb519c tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] [instance: cc14b49f-8c37-4d4b-b0ed-14fcf93f004c] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:49.530743 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ae2171e8-80e8-4682-9e24-340566cb519c tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:49.531255 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ae2171e8-80e8-4682-9e24-340566cb519c tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:49.531709 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ae2171e8-80e8-4682-9e24-340566cb519c tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:49.532475 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ae2171e8-80e8-4682-9e24-340566cb519c tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:49.532950 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ae2171e8-80e8-4682-9e24-340566cb519c tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:49.533394 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ae2171e8-80e8-4682-9e24-340566cb519c tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:49.716243 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-ae2171e8-80e8-4682-9e24-340566cb519c tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ca6270ea245df9373de99e3c42eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e859e4b40c94f5d892c2835453b645c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:49.726577 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ae2171e8-80e8-4682-9e24-340566cb519c tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] 10.222.0.70 "GET /compute/v2.1/servers/cc14b49f-8c37-4d4b-b0ed-14fcf93f004c" status: 200 len: 1515 microversion: 2.1 time: 0.209786 Aug 27 03:35:49.727253 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3128/6299] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:49 2022] GET /compute/v2.1/servers/cc14b49f-8c37-4d4b-b0ed-14fcf93f004c => generated 1515 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:50.308917 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-e9ce9ad0-eec9-431c-b107-ce8fa15dca0e req-a9fd1812-ba3d-4704-b1f8-473712196563 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc14b49f-8c37-4d4b-b0ed-14fcf93f004c", "name": "network-vif-unplugged", "status": "completed", "tag": "88492f0b-8916-44a5-b749-51dbfbf3319f"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:50.319527 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-e9ce9ad0-eec9-431c-b107-ce8fa15dca0e req-a9fd1812-ba3d-4704-b1f8-473712196563 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:50.320007 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-e9ce9ad0-eec9-431c-b107-ce8fa15dca0e req-a9fd1812-ba3d-4704-b1f8-473712196563 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:50.320726 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-e9ce9ad0-eec9-431c-b107-ce8fa15dca0e req-a9fd1812-ba3d-4704-b1f8-473712196563 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:50.333808 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-e9ce9ad0-eec9-431c-b107-ce8fa15dca0e req-a9fd1812-ba3d-4704-b1f8-473712196563 service nova] Creating event network-vif-unplugged:88492f0b-8916-44a5-b749-51dbfbf3319f for instance cc14b49f-8c37-4d4b-b0ed-14fcf93f004c on n-h2-852278-4 Aug 27 03:35:50.341412 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [req-e9ce9ad0-eec9-431c-b107-ce8fa15dca0e req-a9fd1812-ba3d-4704-b1f8-473712196563 service nova] Instance cc14b49f-8c37-4d4b-b0ed-14fcf93f004c is migrating within the same cell, copying events to all relevant hosts: {'n-h2-852278-4', 'n-h1-852278-4'} {{(pid=134051) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 03:35:50.353096 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-e9ce9ad0-eec9-431c-b107-ce8fa15dca0e req-a9fd1812-ba3d-4704-b1f8-473712196563 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048149 Aug 27 03:35:50.353902 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3172/6300] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:35:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:35:50.748409 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-89517097-0428-483b-90a0-c0c2e42371a7 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:50.749013 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-89517097-0428-483b-90a0-c0c2e42371a7 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] [instance: cc14b49f-8c37-4d4b-b0ed-14fcf93f004c] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:50.756350 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-89517097-0428-483b-90a0-c0c2e42371a7 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:50.756897 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-89517097-0428-483b-90a0-c0c2e42371a7 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:50.757307 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-89517097-0428-483b-90a0-c0c2e42371a7 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:50.758659 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-89517097-0428-483b-90a0-c0c2e42371a7 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:50.759119 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-89517097-0428-483b-90a0-c0c2e42371a7 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:50.759541 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-89517097-0428-483b-90a0-c0c2e42371a7 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:50.974791 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-89517097-0428-483b-90a0-c0c2e42371a7 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ca6270ea245df9373de99e3c42eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e859e4b40c94f5d892c2835453b645c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:50.983645 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-89517097-0428-483b-90a0-c0c2e42371a7 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] 10.222.0.70 "GET /compute/v2.1/servers/cc14b49f-8c37-4d4b-b0ed-14fcf93f004c" status: 200 len: 1514 microversion: 2.1 time: 0.239195 Aug 27 03:35:50.984413 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3129/6301] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:50 2022] GET /compute/v2.1/servers/cc14b49f-8c37-4d4b-b0ed-14fcf93f004c => generated 1514 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:52.009156 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-bd1145c4-f841-45e6-83c6-c6c98921e277 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:52.009895 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-bd1145c4-f841-45e6-83c6-c6c98921e277 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] [instance: cc14b49f-8c37-4d4b-b0ed-14fcf93f004c] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:52.017007 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bd1145c4-f841-45e6-83c6-c6c98921e277 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:52.017530 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bd1145c4-f841-45e6-83c6-c6c98921e277 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:52.017996 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bd1145c4-f841-45e6-83c6-c6c98921e277 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:52.018715 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bd1145c4-f841-45e6-83c6-c6c98921e277 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:52.019182 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bd1145c4-f841-45e6-83c6-c6c98921e277 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:52.019628 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bd1145c4-f841-45e6-83c6-c6c98921e277 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:52.160253 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-bd1145c4-f841-45e6-83c6-c6c98921e277 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ca6270ea245df9373de99e3c42eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e859e4b40c94f5d892c2835453b645c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:52.168243 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-bd1145c4-f841-45e6-83c6-c6c98921e277 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] 10.222.0.70 "GET /compute/v2.1/servers/cc14b49f-8c37-4d4b-b0ed-14fcf93f004c" status: 200 len: 1512 microversion: 2.1 time: 0.164870 Aug 27 03:35:52.168854 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3173/6302] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:52 2022] GET /compute/v2.1/servers/cc14b49f-8c37-4d4b-b0ed-14fcf93f004c => generated 1512 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:52.388806 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-c6d6234c-224d-4f88-8278-68001a4817b6 req-b250dbac-e97e-4ee1-9478-c3493ff4f124 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc14b49f-8c37-4d4b-b0ed-14fcf93f004c", "tag": "88492f0b-8916-44a5-b749-51dbfbf3319f"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:52.401699 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-c6d6234c-224d-4f88-8278-68001a4817b6 req-b250dbac-e97e-4ee1-9478-c3493ff4f124 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:52.402164 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-c6d6234c-224d-4f88-8278-68001a4817b6 req-b250dbac-e97e-4ee1-9478-c3493ff4f124 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:52.402566 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-c6d6234c-224d-4f88-8278-68001a4817b6 req-b250dbac-e97e-4ee1-9478-c3493ff4f124 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:52.414836 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-c6d6234c-224d-4f88-8278-68001a4817b6 req-b250dbac-e97e-4ee1-9478-c3493ff4f124 service nova] Creating event network-changed:88492f0b-8916-44a5-b749-51dbfbf3319f for instance cc14b49f-8c37-4d4b-b0ed-14fcf93f004c on n-h2-852278-4 Aug 27 03:35:52.420718 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [req-c6d6234c-224d-4f88-8278-68001a4817b6 req-b250dbac-e97e-4ee1-9478-c3493ff4f124 service nova] Instance cc14b49f-8c37-4d4b-b0ed-14fcf93f004c is migrating within the same cell, copying events to all relevant hosts: {'n-h2-852278-4', 'n-h1-852278-4'} {{(pid=134052) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 03:35:52.432473 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-c6d6234c-224d-4f88-8278-68001a4817b6 req-b250dbac-e97e-4ee1-9478-c3493ff4f124 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050093 Aug 27 03:35:52.433067 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3130/6303] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:35:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:35:53.190388 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ec0a0946-6481-4b81-a94d-625d0f673b80 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:53.191160 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-ec0a0946-6481-4b81-a94d-625d0f673b80 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] [instance: cc14b49f-8c37-4d4b-b0ed-14fcf93f004c] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:53.198414 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ec0a0946-6481-4b81-a94d-625d0f673b80 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:53.198924 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ec0a0946-6481-4b81-a94d-625d0f673b80 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:53.199380 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ec0a0946-6481-4b81-a94d-625d0f673b80 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:53.200131 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ec0a0946-6481-4b81-a94d-625d0f673b80 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:53.200649 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ec0a0946-6481-4b81-a94d-625d0f673b80 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:53.201112 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ec0a0946-6481-4b81-a94d-625d0f673b80 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:53.378919 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-ec0a0946-6481-4b81-a94d-625d0f673b80 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ca6270ea245df9373de99e3c42eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e859e4b40c94f5d892c2835453b645c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:53.388622 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ec0a0946-6481-4b81-a94d-625d0f673b80 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] 10.222.0.70 "GET /compute/v2.1/servers/cc14b49f-8c37-4d4b-b0ed-14fcf93f004c" status: 200 len: 1509 microversion: 2.1 time: 0.202367 Aug 27 03:35:53.389262 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3174/6304] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:53 2022] GET /compute/v2.1/servers/cc14b49f-8c37-4d4b-b0ed-14fcf93f004c => generated 1509 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:53.410406 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f9cc20a7-1120-4956-82a3-1c5134f1bccb tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:53.411033 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-f9cc20a7-1120-4956-82a3-1c5134f1bccb tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] [instance: cc14b49f-8c37-4d4b-b0ed-14fcf93f004c] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:53.417617 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f9cc20a7-1120-4956-82a3-1c5134f1bccb tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:53.418101 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f9cc20a7-1120-4956-82a3-1c5134f1bccb tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:53.418534 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f9cc20a7-1120-4956-82a3-1c5134f1bccb tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:53.419231 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f9cc20a7-1120-4956-82a3-1c5134f1bccb tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:53.419680 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f9cc20a7-1120-4956-82a3-1c5134f1bccb tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:53.420095 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f9cc20a7-1120-4956-82a3-1c5134f1bccb tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:53.448190 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-f9cc20a7-1120-4956-82a3-1c5134f1bccb tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] [instance: cc14b49f-8c37-4d4b-b0ed-14fcf93f004c] Going to try to terminate instance {{(pid=134052) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:35:53.502007 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.compute.api [None req-f9cc20a7-1120-4956-82a3-1c5134f1bccb tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] [instance: cc14b49f-8c37-4d4b-b0ed-14fcf93f004c] Found an unconfirmed migration during delete, id: 16, status: finished Aug 27 03:35:55.167843 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f9cc20a7-1120-4956-82a3-1c5134f1bccb tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] 10.222.0.70 "DELETE /compute/v2.1/servers/cc14b49f-8c37-4d4b-b0ed-14fcf93f004c" status: 204 len: 0 microversion: 2.1 time: 1.762211 Aug 27 03:35:55.168797 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3131/6305] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 03:35:53 2022] DELETE /compute/v2.1/servers/cc14b49f-8c37-4d4b-b0ed-14fcf93f004c => generated 0 bytes in 1764 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:35:55.178759 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3799f54d-b6b3-43d2-b540-9b54334109e6 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:55.179342 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-3799f54d-b6b3-43d2-b540-9b54334109e6 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] [instance: cc14b49f-8c37-4d4b-b0ed-14fcf93f004c] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:55.189450 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3799f54d-b6b3-43d2-b540-9b54334109e6 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:55.190167 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3799f54d-b6b3-43d2-b540-9b54334109e6 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:55.190849 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3799f54d-b6b3-43d2-b540-9b54334109e6 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:55.192237 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3799f54d-b6b3-43d2-b540-9b54334109e6 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:55.192814 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3799f54d-b6b3-43d2-b540-9b54334109e6 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:55.193225 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3799f54d-b6b3-43d2-b540-9b54334109e6 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:55.341321 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-3799f54d-b6b3-43d2-b540-9b54334109e6 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ca6270ea245df9373de99e3c42eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e859e4b40c94f5d892c2835453b645c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:55.349423 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-3799f54d-b6b3-43d2-b540-9b54334109e6 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] 10.222.0.70 "GET /compute/v2.1/servers/cc14b49f-8c37-4d4b-b0ed-14fcf93f004c" status: 200 len: 1501 microversion: 2.1 time: 0.176294 Aug 27 03:35:55.350016 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3175/6306] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:55 2022] GET /compute/v2.1/servers/cc14b49f-8c37-4d4b-b0ed-14fcf93f004c => generated 1501 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:55.623154 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-ec7e1321-523b-45b3-8b92-6021f7ffae90 req-3809d8c7-143b-4400-add3-cf7529d04897 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc14b49f-8c37-4d4b-b0ed-14fcf93f004c", "name": "network-vif-plugged", "status": "completed", "tag": "88492f0b-8916-44a5-b749-51dbfbf3319f"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:55.634213 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-ec7e1321-523b-45b3-8b92-6021f7ffae90 req-3809d8c7-143b-4400-add3-cf7529d04897 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:55.634392 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-ec7e1321-523b-45b3-8b92-6021f7ffae90 req-3809d8c7-143b-4400-add3-cf7529d04897 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:55.634731 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-ec7e1321-523b-45b3-8b92-6021f7ffae90 req-3809d8c7-143b-4400-add3-cf7529d04897 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:55.647159 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-ec7e1321-523b-45b3-8b92-6021f7ffae90 req-3809d8c7-143b-4400-add3-cf7529d04897 service nova] Creating event network-vif-plugged:88492f0b-8916-44a5-b749-51dbfbf3319f for instance cc14b49f-8c37-4d4b-b0ed-14fcf93f004c on n-h2-852278-4 Aug 27 03:35:55.652126 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-ec7e1321-523b-45b3-8b92-6021f7ffae90 req-3809d8c7-143b-4400-add3-cf7529d04897 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033141 Aug 27 03:35:55.653015 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3132/6307] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:35:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:35:56.371893 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-121b46cb-0ffb-4da2-a1b2-9ab9191a4811 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:56.372612 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-121b46cb-0ffb-4da2-a1b2-9ab9191a4811 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] [instance: cc14b49f-8c37-4d4b-b0ed-14fcf93f004c] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:56.380509 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-121b46cb-0ffb-4da2-a1b2-9ab9191a4811 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:56.381052 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-121b46cb-0ffb-4da2-a1b2-9ab9191a4811 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:56.381617 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-121b46cb-0ffb-4da2-a1b2-9ab9191a4811 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:56.382333 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-121b46cb-0ffb-4da2-a1b2-9ab9191a4811 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:56.382811 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-121b46cb-0ffb-4da2-a1b2-9ab9191a4811 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:56.383253 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-121b46cb-0ffb-4da2-a1b2-9ab9191a4811 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:56.617612 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-121b46cb-0ffb-4da2-a1b2-9ab9191a4811 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7ca6270ea245df9373de99e3c42eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e859e4b40c94f5d892c2835453b645c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:56.625669 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-121b46cb-0ffb-4da2-a1b2-9ab9191a4811 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] 10.222.0.70 "GET /compute/v2.1/servers/cc14b49f-8c37-4d4b-b0ed-14fcf93f004c" status: 200 len: 1501 microversion: 2.1 time: 0.258020 Aug 27 03:35:56.626258 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3176/6308] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:56 2022] GET /compute/v2.1/servers/cc14b49f-8c37-4d4b-b0ed-14fcf93f004c => generated 1501 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:56.985974 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-1264e1f3-c683-4995-9293-48518e14a392 req-6a9e0717-1018-44ce-b125-dcd11c4a0dc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc14b49f-8c37-4d4b-b0ed-14fcf93f004c", "name": "network-vif-deleted", "tag": "88492f0b-8916-44a5-b749-51dbfbf3319f"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:56.997675 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-1264e1f3-c683-4995-9293-48518e14a392 req-6a9e0717-1018-44ce-b125-dcd11c4a0dc0 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:56.998167 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-1264e1f3-c683-4995-9293-48518e14a392 req-6a9e0717-1018-44ce-b125-dcd11c4a0dc0 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:56.998787 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-1264e1f3-c683-4995-9293-48518e14a392 req-6a9e0717-1018-44ce-b125-dcd11c4a0dc0 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:57.011316 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-1264e1f3-c683-4995-9293-48518e14a392 req-6a9e0717-1018-44ce-b125-dcd11c4a0dc0 service nova] Creating event network-vif-deleted:88492f0b-8916-44a5-b749-51dbfbf3319f for instance cc14b49f-8c37-4d4b-b0ed-14fcf93f004c on n-h2-852278-4 Aug 27 03:35:57.016168 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-1264e1f3-c683-4995-9293-48518e14a392 req-6a9e0717-1018-44ce-b125-dcd11c4a0dc0 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035691 Aug 27 03:35:57.016862 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3133/6309] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:35:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:35:57.649893 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ee7968b5-1a4a-4b19-8e71-1bbbd6f0c607 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:57.650495 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-ee7968b5-1a4a-4b19-8e71-1bbbd6f0c607 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] [instance: cc14b49f-8c37-4d4b-b0ed-14fcf93f004c] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:57.658010 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ee7968b5-1a4a-4b19-8e71-1bbbd6f0c607 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:57.658514 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ee7968b5-1a4a-4b19-8e71-1bbbd6f0c607 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:57.658969 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ee7968b5-1a4a-4b19-8e71-1bbbd6f0c607 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:57.659687 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ee7968b5-1a4a-4b19-8e71-1bbbd6f0c607 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:57.660153 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ee7968b5-1a4a-4b19-8e71-1bbbd6f0c607 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:57.660626 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ee7968b5-1a4a-4b19-8e71-1bbbd6f0c607 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:57.675226 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-ee7968b5-1a4a-4b19-8e71-1bbbd6f0c607 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] HTTP exception thrown: Instance cc14b49f-8c37-4d4b-b0ed-14fcf93f004c could not be found. Aug 27 03:35:57.676977 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ee7968b5-1a4a-4b19-8e71-1bbbd6f0c607 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Request method failure captured: Aug 27 03:35:57.676977 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/cc14b49f-8c37-4d4b-b0ed-14fcf93f004c HTTP/1.1 Aug 27 03:35:57.676977 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 03:35:57.676977 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 03:35:57.676977 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 03:35:57.676977 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 03:35:57.676977 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 03:35:57.676977 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 03:35:57.676977 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 03:35:57.676977 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 03:35:57.676977 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCZDnjZvYdT2IWwGBxhFcluJhMCWOpPuCegIKVvoaa4ANngM762m5TGZrx_sQ44S33RaA6N2RToOrywzWo6cqkKivI1Btn4r6JOlcROZzEnbWwT2cJNtsm2hd3d1xSV8ecp4aeT_f57bOzruHMCbuqGqgsrKhkxclPATPSIkcEfCBmig Aug 27 03:35:57.676977 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 03:35:57.676977 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 03:35:57.676977 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 03:35:57.676977 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 03:35:57.676977 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 03:35:57.676977 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 03:35:57.676977 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 4e859e4b40c94f5d892c2835453b645c Aug 27 03:35:57.676977 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-DeleteServersTestJSON-90189588 Aug 27 03:35:57.676977 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 03:35:57.676977 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 03:35:57.676977 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4e859e4b40c94f5d892c2835453b645c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_4e859e4b40c94f5d892c2835453b645c", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4e859e4b40c94f5d892c2835453b645c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/4e859e4b40c94f5d892c2835453b645c"}]}] Aug 27 03:35:57.676977 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-DeleteServersTestJSON-90189588 Aug 27 03:35:57.676977 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 4e859e4b40c94f5d892c2835453b645c Aug 27 03:35:57.676977 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-DeleteServersTestJSON-90189588 Aug 27 03:35:57.676977 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-DeleteServersTestJSON-90189588-project Aug 27 03:35:57.676977 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 03:35:57.676977 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 03:35:57.676977 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 5a7ca6270ea245df9373de99e3c42eaa Aug 27 03:35:57.676977 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-DeleteServersTestJSON-90189588-project Aug 27 03:35:57.676977 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 03:35:57.676977 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance cc14b49f-8c37-4d4b-b0ed-14fcf93f004c could not be found. Aug 27 03:35:57.676977 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': 'cc14b49f-8c37-4d4b-b0ed-14fcf93f004c'} Aug 27 03:35:57.676977 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:35:57.676977 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:35:57.676977 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:35:57.676977 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:35:57.676977 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:35:57.676977 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:35:57.676977 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:35:57.676977 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:35:57.676977 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:35:57.676977 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:35:57.676977 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc14b49f-8c37-4d4b-b0ed-14fcf93f004c could not be found. Aug 27 03:35:57.676977 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:35:57.676977 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:35:57.676977 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:35:57.676977 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:35:57.676977 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:35:57.676977 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:35:57.676977 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:35:57.676977 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:35:57.676977 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:35:57.676977 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:35:57.676977 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:35:57.676977 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:35:57.676977 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:35:57.676977 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:35:57.676977 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:35:57.676977 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:35:57.676977 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc14b49f-8c37-4d4b-b0ed-14fcf93f004c could not be found. Aug 27 03:35:57.676977 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:35:57.676977 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:35:57.676977 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:35:57.682950 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:35:57.682950 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:35:57.682950 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:35:57.682950 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:35:57.682950 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:35:57.682950 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc14b49f-8c37-4d4b-b0ed-14fcf93f004c could not be found. Aug 27 03:35:57.682950 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:35:57.682950 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ee7968b5-1a4a-4b19-8e71-1bbbd6f0c607 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Returning 404 to user: Instance cc14b49f-8c37-4d4b-b0ed-14fcf93f004c could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:35:57.682950 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ee7968b5-1a4a-4b19-8e71-1bbbd6f0c607 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] 10.222.0.70 "GET /compute/v2.1/servers/cc14b49f-8c37-4d4b-b0ed-14fcf93f004c" status: 404 len: 111 microversion: 2.1 time: 0.034175 Aug 27 03:35:57.682950 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3177/6310] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:57 2022] GET /compute/v2.1/servers/cc14b49f-8c37-4d4b-b0ed-14fcf93f004c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:35:57.695045 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-21326c15-b418-442e-980b-f915eb21310c tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:57.695623 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-21326c15-b418-442e-980b-f915eb21310c tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] [instance: cc14b49f-8c37-4d4b-b0ed-14fcf93f004c] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:57.702435 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-21326c15-b418-442e-980b-f915eb21310c tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:57.702912 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-21326c15-b418-442e-980b-f915eb21310c tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:57.703342 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-21326c15-b418-442e-980b-f915eb21310c tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:57.704037 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-21326c15-b418-442e-980b-f915eb21310c tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:57.704523 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-21326c15-b418-442e-980b-f915eb21310c tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:57.704941 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-21326c15-b418-442e-980b-f915eb21310c tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:57.718465 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-21326c15-b418-442e-980b-f915eb21310c tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] HTTP exception thrown: Instance cc14b49f-8c37-4d4b-b0ed-14fcf93f004c could not be found. Aug 27 03:35:57.720093 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-21326c15-b418-442e-980b-f915eb21310c tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Request method failure captured: Aug 27 03:35:57.720093 n-d-852278-4 devstack@n-api.service[134052]: request: DELETE /compute/v2.1/servers/cc14b49f-8c37-4d4b-b0ed-14fcf93f004c HTTP/1.1 Aug 27 03:35:57.720093 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 03:35:57.720093 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 03:35:57.720093 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 03:35:57.720093 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 03:35:57.720093 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 03:35:57.720093 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 03:35:57.720093 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 03:35:57.720093 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 03:35:57.720093 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCZDnjZvYdT2IWwGBxhFcluJhMCWOpPuCegIKVvoaa4ANngM762m5TGZrx_sQ44S33RaA6N2RToOrywzWo6cqkKivI1Btn4r6JOlcROZzEnbWwT2cJNtsm2hd3d1xSV8ecp4aeT_f57bOzruHMCbuqGqgsrKhkxclPATPSIkcEfCBmig Aug 27 03:35:57.720093 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 03:35:57.720093 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 03:35:57.720093 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 03:35:57.720093 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 03:35:57.720093 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 03:35:57.720093 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 03:35:57.720093 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 4e859e4b40c94f5d892c2835453b645c Aug 27 03:35:57.720093 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-DeleteServersTestJSON-90189588 Aug 27 03:35:57.720093 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 03:35:57.720093 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 03:35:57.720093 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4e859e4b40c94f5d892c2835453b645c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_4e859e4b40c94f5d892c2835453b645c", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4e859e4b40c94f5d892c2835453b645c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/4e859e4b40c94f5d892c2835453b645c"}]}] Aug 27 03:35:57.720093 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-DeleteServersTestJSON-90189588 Aug 27 03:35:57.720093 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 4e859e4b40c94f5d892c2835453b645c Aug 27 03:35:57.720093 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-DeleteServersTestJSON-90189588 Aug 27 03:35:57.720093 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-DeleteServersTestJSON-90189588-project Aug 27 03:35:57.720093 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 03:35:57.720093 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 03:35:57.720093 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 5a7ca6270ea245df9373de99e3c42eaa Aug 27 03:35:57.720093 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-DeleteServersTestJSON-90189588-project Aug 27 03:35:57.720093 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 03:35:57.720093 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance cc14b49f-8c37-4d4b-b0ed-14fcf93f004c could not be found. Aug 27 03:35:57.720093 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': 'cc14b49f-8c37-4d4b-b0ed-14fcf93f004c'} Aug 27 03:35:57.720093 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:35:57.720093 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:35:57.720093 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:35:57.720093 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:35:57.720093 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:35:57.720093 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:35:57.720093 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:35:57.720093 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:35:57.720093 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:35:57.720093 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:35:57.720093 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc14b49f-8c37-4d4b-b0ed-14fcf93f004c could not be found. Aug 27 03:35:57.720093 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:35:57.720093 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:35:57.720093 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:35:57.720093 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:35:57.720093 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:35:57.720093 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:35:57.720093 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:35:57.720093 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:35:57.720093 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:35:57.720093 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:35:57.720093 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 03:35:57.720093 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 03:35:57.720093 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 03:35:57.720093 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 03:35:57.720093 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:35:57.720093 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:35:57.720093 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:35:57.720093 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:35:57.725285 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc14b49f-8c37-4d4b-b0ed-14fcf93f004c could not be found. Aug 27 03:35:57.725285 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:35:57.725285 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:35:57.725285 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:35:57.725285 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:35:57.725285 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:35:57.725285 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:35:57.725285 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:35:57.725285 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:35:57.725285 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc14b49f-8c37-4d4b-b0ed-14fcf93f004c could not be found. Aug 27 03:35:57.725285 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:35:57.725285 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-21326c15-b418-442e-980b-f915eb21310c tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Returning 404 to user: Instance cc14b49f-8c37-4d4b-b0ed-14fcf93f004c could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:35:57.725285 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-21326c15-b418-442e-980b-f915eb21310c tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] 10.222.0.70 "DELETE /compute/v2.1/servers/cc14b49f-8c37-4d4b-b0ed-14fcf93f004c" status: 404 len: 111 microversion: 2.1 time: 0.031352 Aug 27 03:35:57.725285 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3134/6311] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 03:35:57 2022] DELETE /compute/v2.1/servers/cc14b49f-8c37-4d4b-b0ed-14fcf93f004c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:35:57.730294 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-83309cf9-f77e-4741-8330-e28c4b13d074 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:57.730941 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-83309cf9-f77e-4741-8330-e28c4b13d074 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] [instance: cc14b49f-8c37-4d4b-b0ed-14fcf93f004c] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:57.737505 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-83309cf9-f77e-4741-8330-e28c4b13d074 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:57.737970 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-83309cf9-f77e-4741-8330-e28c4b13d074 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:57.738540 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-83309cf9-f77e-4741-8330-e28c4b13d074 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:57.739255 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-83309cf9-f77e-4741-8330-e28c4b13d074 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:57.739723 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-83309cf9-f77e-4741-8330-e28c4b13d074 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:57.740160 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-83309cf9-f77e-4741-8330-e28c4b13d074 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:57.754100 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-83309cf9-f77e-4741-8330-e28c4b13d074 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] HTTP exception thrown: Instance cc14b49f-8c37-4d4b-b0ed-14fcf93f004c could not be found. Aug 27 03:35:57.755638 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-83309cf9-f77e-4741-8330-e28c4b13d074 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Request method failure captured: Aug 27 03:35:57.755638 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/cc14b49f-8c37-4d4b-b0ed-14fcf93f004c HTTP/1.1 Aug 27 03:35:57.755638 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 03:35:57.755638 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 03:35:57.755638 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 03:35:57.755638 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 03:35:57.755638 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 03:35:57.755638 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 03:35:57.755638 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 03:35:57.755638 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 03:35:57.755638 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCZDnjZvYdT2IWwGBxhFcluJhMCWOpPuCegIKVvoaa4ANngM762m5TGZrx_sQ44S33RaA6N2RToOrywzWo6cqkKivI1Btn4r6JOlcROZzEnbWwT2cJNtsm2hd3d1xSV8ecp4aeT_f57bOzruHMCbuqGqgsrKhkxclPATPSIkcEfCBmig Aug 27 03:35:57.755638 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 03:35:57.755638 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 03:35:57.755638 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 03:35:57.755638 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 03:35:57.755638 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 03:35:57.755638 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 03:35:57.755638 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 4e859e4b40c94f5d892c2835453b645c Aug 27 03:35:57.755638 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-DeleteServersTestJSON-90189588 Aug 27 03:35:57.755638 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 03:35:57.755638 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 03:35:57.755638 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4e859e4b40c94f5d892c2835453b645c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_4e859e4b40c94f5d892c2835453b645c", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4e859e4b40c94f5d892c2835453b645c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/4e859e4b40c94f5d892c2835453b645c"}]}] Aug 27 03:35:57.755638 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-DeleteServersTestJSON-90189588 Aug 27 03:35:57.755638 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 4e859e4b40c94f5d892c2835453b645c Aug 27 03:35:57.755638 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-DeleteServersTestJSON-90189588 Aug 27 03:35:57.755638 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-DeleteServersTestJSON-90189588-project Aug 27 03:35:57.755638 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 03:35:57.755638 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 03:35:57.755638 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 5a7ca6270ea245df9373de99e3c42eaa Aug 27 03:35:57.755638 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-DeleteServersTestJSON-90189588-project Aug 27 03:35:57.755638 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 03:35:57.755638 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance cc14b49f-8c37-4d4b-b0ed-14fcf93f004c could not be found. Aug 27 03:35:57.755638 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': 'cc14b49f-8c37-4d4b-b0ed-14fcf93f004c'} Aug 27 03:35:57.755638 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:35:57.755638 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:35:57.755638 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:35:57.755638 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:35:57.755638 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:35:57.755638 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:35:57.755638 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:35:57.755638 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:35:57.755638 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:35:57.755638 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:35:57.755638 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc14b49f-8c37-4d4b-b0ed-14fcf93f004c could not be found. Aug 27 03:35:57.755638 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:35:57.755638 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:35:57.755638 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:35:57.755638 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:35:57.755638 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:35:57.755638 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:35:57.755638 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:35:57.755638 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:35:57.755638 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:35:57.755638 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:35:57.755638 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:35:57.755638 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:35:57.755638 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:35:57.755638 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:35:57.755638 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:35:57.755638 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:35:57.755638 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc14b49f-8c37-4d4b-b0ed-14fcf93f004c could not be found. Aug 27 03:35:57.755638 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:35:57.755638 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:35:57.755638 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:35:57.761419 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:35:57.761419 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:35:57.761419 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:35:57.761419 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:35:57.761419 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:35:57.761419 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc14b49f-8c37-4d4b-b0ed-14fcf93f004c could not be found. Aug 27 03:35:57.761419 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:35:57.761419 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-83309cf9-f77e-4741-8330-e28c4b13d074 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] Returning 404 to user: Instance cc14b49f-8c37-4d4b-b0ed-14fcf93f004c could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:35:57.761419 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-83309cf9-f77e-4741-8330-e28c4b13d074 tempest-DeleteServersTestJSON-90189588 tempest-DeleteServersTestJSON-90189588-project] 10.222.0.70 "GET /compute/v2.1/servers/cc14b49f-8c37-4d4b-b0ed-14fcf93f004c" status: 404 len: 111 microversion: 2.1 time: 0.030738 Aug 27 03:35:57.761419 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3178/6312] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:57 2022] GET /compute/v2.1/servers/cc14b49f-8c37-4d4b-b0ed-14fcf93f004c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:36:06.627350 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f6863889-c46b-4308-9397-3ac871dbcd23 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-202143944", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "networks": [{"uuid": "041065b6-9ebe-45c2-af84-b2ea0d38459a"}]}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:36:06.686761 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.network.neutron [None req-f6863889-c46b-4308-9397-3ac871dbcd23 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] validate_networks() for [('041065b6-9ebe-45c2-af84-b2ea0d38459a', None, None, None, None, None)] {{(pid=134052) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:36:07.091738 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-f6863889-c46b-4308-9397-3ac871dbcd23 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Flavor limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:36:07.092135 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-f6863889-c46b-4308-9397-3ac871dbcd23 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Image limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:36:07.092666 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-f6863889-c46b-4308-9397-3ac871dbcd23 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Flavor pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:36:07.093080 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-f6863889-c46b-4308-9397-3ac871dbcd23 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Image pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:36:07.093492 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-f6863889-c46b-4308-9397-3ac871dbcd23 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:36:07.103212 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f6863889-c46b-4308-9397-3ac871dbcd23 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:07.103712 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f6863889-c46b-4308-9397-3ac871dbcd23 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:07.104156 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f6863889-c46b-4308-9397-3ac871dbcd23 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:07.104950 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f6863889-c46b-4308-9397-3ac871dbcd23 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:07.105408 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f6863889-c46b-4308-9397-3ac871dbcd23 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:07.105836 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f6863889-c46b-4308-9397-3ac871dbcd23 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:07.128245 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-f6863889-c46b-4308-9397-3ac871dbcd23 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Getting quotas for project afc621ea3ee54c5eafd4fbb93e357b3f. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:36:07.134319 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-f6863889-c46b-4308-9397-3ac871dbcd23 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Getting quotas for user 5fc98a4e7de34bc1ad629247458a1fe2 and project afc621ea3ee54c5eafd4fbb93e357b3f. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:36:07.147456 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-f6863889-c46b-4308-9397-3ac871dbcd23 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Going to run 1 instances... {{(pid=134052) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:36:07.150237 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-f6863889-c46b-4308-9397-3ac871dbcd23 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] [instance: 0581f7e5-2719-4aa6-8f59-7522c3004ade] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134052) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:36:07.200351 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f6863889-c46b-4308-9397-3ac871dbcd23 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.713547 Aug 27 03:36:07.201607 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3135/6313] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 03:36:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 716 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:36:07.212695 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-1d23d4b7-aa2e-4224-96e4-60f7c5ca8164 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:07.213353 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-1d23d4b7-aa2e-4224-96e4-60f7c5ca8164 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] [instance: 0581f7e5-2719-4aa6-8f59-7522c3004ade] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:07.271829 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-1d23d4b7-aa2e-4224-96e4-60f7c5ca8164 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc98a4e7de34bc1ad629247458a1fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc621ea3ee54c5eafd4fbb93e357b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:07.279805 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-1d23d4b7-aa2e-4224-96e4-60f7c5ca8164 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] 10.222.0.70 "GET /compute/v2.1/servers/0581f7e5-2719-4aa6-8f59-7522c3004ade" status: 200 len: 1217 microversion: 2.1 time: 0.071188 Aug 27 03:36:07.284347 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3179/6314] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:07 2022] GET /compute/v2.1/servers/0581f7e5-2719-4aa6-8f59-7522c3004ade => generated 1217 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:36:08.301072 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3623d4ce-2e4d-40a8-a1f5-7b5e656615c0 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:08.301694 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-3623d4ce-2e4d-40a8-a1f5-7b5e656615c0 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] [instance: 0581f7e5-2719-4aa6-8f59-7522c3004ade] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:08.309721 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3623d4ce-2e4d-40a8-a1f5-7b5e656615c0 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:08.310237 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3623d4ce-2e4d-40a8-a1f5-7b5e656615c0 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:08.310982 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3623d4ce-2e4d-40a8-a1f5-7b5e656615c0 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:08.311757 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3623d4ce-2e4d-40a8-a1f5-7b5e656615c0 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:08.312207 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3623d4ce-2e4d-40a8-a1f5-7b5e656615c0 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:08.312698 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3623d4ce-2e4d-40a8-a1f5-7b5e656615c0 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:08.382340 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-3623d4ce-2e4d-40a8-a1f5-7b5e656615c0 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc98a4e7de34bc1ad629247458a1fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc621ea3ee54c5eafd4fbb93e357b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:08.393029 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-3623d4ce-2e4d-40a8-a1f5-7b5e656615c0 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] 10.222.0.70 "GET /compute/v2.1/servers/0581f7e5-2719-4aa6-8f59-7522c3004ade" status: 200 len: 1269 microversion: 2.1 time: 0.096248 Aug 27 03:36:08.404336 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3136/6315] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:08 2022] GET /compute/v2.1/servers/0581f7e5-2719-4aa6-8f59-7522c3004ade => generated 1269 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:09.417068 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-1bc1b06a-9643-4d8b-8cc0-a756fc5e17e6 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:09.417858 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-1bc1b06a-9643-4d8b-8cc0-a756fc5e17e6 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] [instance: 0581f7e5-2719-4aa6-8f59-7522c3004ade] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:09.422961 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=49 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:36:09.430336 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1bc1b06a-9643-4d8b-8cc0-a756fc5e17e6 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:09.430976 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1bc1b06a-9643-4d8b-8cc0-a756fc5e17e6 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:09.431523 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1bc1b06a-9643-4d8b-8cc0-a756fc5e17e6 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:09.432340 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1bc1b06a-9643-4d8b-8cc0-a756fc5e17e6 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:09.432906 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1bc1b06a-9643-4d8b-8cc0-a756fc5e17e6 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:09.433506 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1bc1b06a-9643-4d8b-8cc0-a756fc5e17e6 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:09.712920 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-1bc1b06a-9643-4d8b-8cc0-a756fc5e17e6 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc98a4e7de34bc1ad629247458a1fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc621ea3ee54c5eafd4fbb93e357b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:09.721594 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-1bc1b06a-9643-4d8b-8cc0-a756fc5e17e6 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] 10.222.0.70 "GET /compute/v2.1/servers/0581f7e5-2719-4aa6-8f59-7522c3004ade" status: 200 len: 1317 microversion: 2.1 time: 0.309628 Aug 27 03:36:09.722330 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3180/6316] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:09 2022] GET /compute/v2.1/servers/0581f7e5-2719-4aa6-8f59-7522c3004ade => generated 1317 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:09.830573 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-5779a5df-c145-41c5-8cb0-b327ddc67cab req-ccbe4ca9-165e-40e4-80c7-15607e804b75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0581f7e5-2719-4aa6-8f59-7522c3004ade", "tag": "2bdae32a-b581-4cff-b413-602f6d16bc7c"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:36:09.842967 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-5779a5df-c145-41c5-8cb0-b327ddc67cab req-ccbe4ca9-165e-40e4-80c7-15607e804b75 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:09.843537 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-5779a5df-c145-41c5-8cb0-b327ddc67cab req-ccbe4ca9-165e-40e4-80c7-15607e804b75 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:09.844454 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-5779a5df-c145-41c5-8cb0-b327ddc67cab req-ccbe4ca9-165e-40e4-80c7-15607e804b75 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:09.857194 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-5779a5df-c145-41c5-8cb0-b327ddc67cab req-ccbe4ca9-165e-40e4-80c7-15607e804b75 service nova] Creating event network-changed:2bdae32a-b581-4cff-b413-602f6d16bc7c for instance 0581f7e5-2719-4aa6-8f59-7522c3004ade on n-h2-852278-4 Aug 27 03:36:09.863502 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-5779a5df-c145-41c5-8cb0-b327ddc67cab req-ccbe4ca9-165e-40e4-80c7-15607e804b75 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036707 Aug 27 03:36:09.864222 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3137/6317] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:36:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:36:10.747032 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-2a45e84a-16db-4676-b353-a65862cfba7e tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:10.748055 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-2a45e84a-16db-4676-b353-a65862cfba7e tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] [instance: 0581f7e5-2719-4aa6-8f59-7522c3004ade] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:10.759605 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2a45e84a-16db-4676-b353-a65862cfba7e tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:10.760101 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2a45e84a-16db-4676-b353-a65862cfba7e tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:10.760602 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2a45e84a-16db-4676-b353-a65862cfba7e tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:10.761280 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2a45e84a-16db-4676-b353-a65862cfba7e tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:10.761739 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2a45e84a-16db-4676-b353-a65862cfba7e tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:10.762169 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2a45e84a-16db-4676-b353-a65862cfba7e tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:10.900239 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-2a45e84a-16db-4676-b353-a65862cfba7e tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc98a4e7de34bc1ad629247458a1fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc621ea3ee54c5eafd4fbb93e357b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:10.912824 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-2a45e84a-16db-4676-b353-a65862cfba7e tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] 10.222.0.70 "GET /compute/v2.1/servers/0581f7e5-2719-4aa6-8f59-7522c3004ade" status: 200 len: 1317 microversion: 2.1 time: 0.172039 Aug 27 03:36:10.913640 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3181/6318] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:10 2022] GET /compute/v2.1/servers/0581f7e5-2719-4aa6-8f59-7522c3004ade => generated 1317 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:11.935585 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-1b28e4ab-edbf-4851-97af-48e2d471f86e tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:11.936389 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-1b28e4ab-edbf-4851-97af-48e2d471f86e tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] [instance: 0581f7e5-2719-4aa6-8f59-7522c3004ade] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:11.942972 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1b28e4ab-edbf-4851-97af-48e2d471f86e tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:11.943523 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1b28e4ab-edbf-4851-97af-48e2d471f86e tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:11.943953 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1b28e4ab-edbf-4851-97af-48e2d471f86e tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:11.944682 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1b28e4ab-edbf-4851-97af-48e2d471f86e tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:11.945128 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1b28e4ab-edbf-4851-97af-48e2d471f86e tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:11.945530 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1b28e4ab-edbf-4851-97af-48e2d471f86e tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:12.085276 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-1b28e4ab-edbf-4851-97af-48e2d471f86e tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc98a4e7de34bc1ad629247458a1fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc621ea3ee54c5eafd4fbb93e357b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:12.087661 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:36:12.094990 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-1b28e4ab-edbf-4851-97af-48e2d471f86e tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] 10.222.0.70 "GET /compute/v2.1/servers/0581f7e5-2719-4aa6-8f59-7522c3004ade" status: 200 len: 1317 microversion: 2.1 time: 0.164571 Aug 27 03:36:12.095566 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3138/6319] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:11 2022] GET /compute/v2.1/servers/0581f7e5-2719-4aa6-8f59-7522c3004ade => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:13.119873 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f18ef4f6-bd3a-4765-b0e0-919ec51bfe92 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:13.120550 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-f18ef4f6-bd3a-4765-b0e0-919ec51bfe92 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] [instance: 0581f7e5-2719-4aa6-8f59-7522c3004ade] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:13.131575 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f18ef4f6-bd3a-4765-b0e0-919ec51bfe92 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:13.132269 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f18ef4f6-bd3a-4765-b0e0-919ec51bfe92 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:13.132895 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f18ef4f6-bd3a-4765-b0e0-919ec51bfe92 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:13.133862 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f18ef4f6-bd3a-4765-b0e0-919ec51bfe92 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:13.134485 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f18ef4f6-bd3a-4765-b0e0-919ec51bfe92 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:13.135018 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f18ef4f6-bd3a-4765-b0e0-919ec51bfe92 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:13.277239 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-f18ef4f6-bd3a-4765-b0e0-919ec51bfe92 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc98a4e7de34bc1ad629247458a1fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc621ea3ee54c5eafd4fbb93e357b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:13.285407 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-f18ef4f6-bd3a-4765-b0e0-919ec51bfe92 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] 10.222.0.70 "GET /compute/v2.1/servers/0581f7e5-2719-4aa6-8f59-7522c3004ade" status: 200 len: 1317 microversion: 2.1 time: 0.172033 Aug 27 03:36:13.286008 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3182/6320] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:13 2022] GET /compute/v2.1/servers/0581f7e5-2719-4aa6-8f59-7522c3004ade => generated 1317 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:13.780854 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-edfa2983-97e6-4661-80d7-72266905b89c req-e778bf2a-bea9-42ea-aacd-417d4df48f55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0581f7e5-2719-4aa6-8f59-7522c3004ade", "name": "network-vif-plugged", "status": "completed", "tag": "2bdae32a-b581-4cff-b413-602f6d16bc7c"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:36:13.786750 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:36:13.793511 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-edfa2983-97e6-4661-80d7-72266905b89c req-e778bf2a-bea9-42ea-aacd-417d4df48f55 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:13.793994 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-edfa2983-97e6-4661-80d7-72266905b89c req-e778bf2a-bea9-42ea-aacd-417d4df48f55 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:13.794426 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-edfa2983-97e6-4661-80d7-72266905b89c req-e778bf2a-bea9-42ea-aacd-417d4df48f55 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:13.807485 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-edfa2983-97e6-4661-80d7-72266905b89c req-e778bf2a-bea9-42ea-aacd-417d4df48f55 service nova] Creating event network-vif-plugged:2bdae32a-b581-4cff-b413-602f6d16bc7c for instance 0581f7e5-2719-4aa6-8f59-7522c3004ade on n-h2-852278-4 Aug 27 03:36:13.812761 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-edfa2983-97e6-4661-80d7-72266905b89c req-e778bf2a-bea9-42ea-aacd-417d4df48f55 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035899 Aug 27 03:36:13.813380 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3139/6321] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:36:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:36:14.306731 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a55c0dee-18db-4fa6-ae12-0504ceff756e tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:14.307319 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-a55c0dee-18db-4fa6-ae12-0504ceff756e tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] [instance: 0581f7e5-2719-4aa6-8f59-7522c3004ade] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:14.310099 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=30 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:36:14.315443 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a55c0dee-18db-4fa6-ae12-0504ceff756e tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:14.315923 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a55c0dee-18db-4fa6-ae12-0504ceff756e tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:14.316391 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a55c0dee-18db-4fa6-ae12-0504ceff756e tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:14.317090 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a55c0dee-18db-4fa6-ae12-0504ceff756e tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:14.317546 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a55c0dee-18db-4fa6-ae12-0504ceff756e tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:14.317990 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a55c0dee-18db-4fa6-ae12-0504ceff756e tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:14.459101 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-a55c0dee-18db-4fa6-ae12-0504ceff756e tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc98a4e7de34bc1ad629247458a1fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc621ea3ee54c5eafd4fbb93e357b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:14.467367 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a55c0dee-18db-4fa6-ae12-0504ceff756e tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] 10.222.0.70 "GET /compute/v2.1/servers/0581f7e5-2719-4aa6-8f59-7522c3004ade" status: 200 len: 1317 microversion: 2.1 time: 0.164586 Aug 27 03:36:14.467940 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3183/6322] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:14 2022] GET /compute/v2.1/servers/0581f7e5-2719-4aa6-8f59-7522c3004ade => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:36:15.489919 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-09e084b6-558e-4500-bb0f-3e9b971191df tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:15.490605 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-09e084b6-558e-4500-bb0f-3e9b971191df tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] [instance: 0581f7e5-2719-4aa6-8f59-7522c3004ade] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:15.497588 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-09e084b6-558e-4500-bb0f-3e9b971191df tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:15.498044 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-09e084b6-558e-4500-bb0f-3e9b971191df tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:15.498473 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-09e084b6-558e-4500-bb0f-3e9b971191df tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:15.499163 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-09e084b6-558e-4500-bb0f-3e9b971191df tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:15.499608 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-09e084b6-558e-4500-bb0f-3e9b971191df tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:15.500024 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-09e084b6-558e-4500-bb0f-3e9b971191df tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:15.643058 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-09e084b6-558e-4500-bb0f-3e9b971191df tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc98a4e7de34bc1ad629247458a1fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc621ea3ee54c5eafd4fbb93e357b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:15.651557 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-09e084b6-558e-4500-bb0f-3e9b971191df tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] 10.222.0.70 "GET /compute/v2.1/servers/0581f7e5-2719-4aa6-8f59-7522c3004ade" status: 200 len: 1506 microversion: 2.1 time: 0.166899 Aug 27 03:36:15.652265 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3140/6323] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:15 2022] GET /compute/v2.1/servers/0581f7e5-2719-4aa6-8f59-7522c3004ade => generated 1506 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:15.672036 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-974a83e0-9ba7-422d-9b81-5ff9d978fa0c tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:15.672833 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-974a83e0-9ba7-422d-9b81-5ff9d978fa0c tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] [instance: 0581f7e5-2719-4aa6-8f59-7522c3004ade] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:15.679825 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-974a83e0-9ba7-422d-9b81-5ff9d978fa0c tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:15.680293 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-974a83e0-9ba7-422d-9b81-5ff9d978fa0c tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:15.680764 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-974a83e0-9ba7-422d-9b81-5ff9d978fa0c tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:15.681473 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-974a83e0-9ba7-422d-9b81-5ff9d978fa0c tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:15.681933 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-974a83e0-9ba7-422d-9b81-5ff9d978fa0c tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:15.682365 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-974a83e0-9ba7-422d-9b81-5ff9d978fa0c tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:15.818569 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-974a83e0-9ba7-422d-9b81-5ff9d978fa0c tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc98a4e7de34bc1ad629247458a1fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc621ea3ee54c5eafd4fbb93e357b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:15.828208 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-974a83e0-9ba7-422d-9b81-5ff9d978fa0c tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] 10.222.0.70 "GET /compute/v2.1/servers/0581f7e5-2719-4aa6-8f59-7522c3004ade" status: 200 len: 1506 microversion: 2.1 time: 0.160502 Aug 27 03:36:15.828844 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3184/6324] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:15 2022] GET /compute/v2.1/servers/0581f7e5-2719-4aa6-8f59-7522c3004ade => generated 1506 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:15.848896 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-cef7b29f-c851-4498-b429-cdbeb2c2cfd7 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:36:15.851313 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-cef7b29f-c851-4498-b429-cdbeb2c2cfd7 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] [instance: 0581f7e5-2719-4aa6-8f59-7522c3004ade] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:15.858581 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cef7b29f-c851-4498-b429-cdbeb2c2cfd7 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:15.859300 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cef7b29f-c851-4498-b429-cdbeb2c2cfd7 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:15.859720 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cef7b29f-c851-4498-b429-cdbeb2c2cfd7 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:15.860469 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cef7b29f-c851-4498-b429-cdbeb2c2cfd7 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:15.860919 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cef7b29f-c851-4498-b429-cdbeb2c2cfd7 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:15.861344 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cef7b29f-c851-4498-b429-cdbeb2c2cfd7 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:15.926856 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-cef7b29f-c851-4498-b429-cdbeb2c2cfd7 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] 10.222.0.70 "PUT /compute/v2.1/servers/0581f7e5-2719-4aa6-8f59-7522c3004ade" status: 200 len: 1078 microversion: 2.1 time: 0.081982 Aug 27 03:36:15.927534 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3141/6325] 10.222.0.70 () {60 vars in 1256 bytes} [Sat Aug 27 03:36:15 2022] PUT /compute/v2.1/servers/0581f7e5-2719-4aa6-8f59-7522c3004ade => generated 1078 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:15.944912 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-db17e93d-b153-4fb7-97d2-cba2cb0d543c tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:15.945557 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-db17e93d-b153-4fb7-97d2-cba2cb0d543c tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] [instance: 0581f7e5-2719-4aa6-8f59-7522c3004ade] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:15.951799 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-db17e93d-b153-4fb7-97d2-cba2cb0d543c tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:15.952302 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-db17e93d-b153-4fb7-97d2-cba2cb0d543c tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:15.952785 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-db17e93d-b153-4fb7-97d2-cba2cb0d543c tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:15.953493 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-db17e93d-b153-4fb7-97d2-cba2cb0d543c tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:15.953958 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-db17e93d-b153-4fb7-97d2-cba2cb0d543c tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:15.954367 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-db17e93d-b153-4fb7-97d2-cba2cb0d543c tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:16.089078 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-db17e93d-b153-4fb7-97d2-cba2cb0d543c tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc98a4e7de34bc1ad629247458a1fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc621ea3ee54c5eafd4fbb93e357b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:16.097231 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-db17e93d-b153-4fb7-97d2-cba2cb0d543c tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] 10.222.0.70 "GET /compute/v2.1/servers/0581f7e5-2719-4aa6-8f59-7522c3004ade" status: 200 len: 1504 microversion: 2.1 time: 0.156266 Aug 27 03:36:16.097791 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3185/6326] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:15 2022] GET /compute/v2.1/servers/0581f7e5-2719-4aa6-8f59-7522c3004ade => generated 1504 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:16.117146 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-400a2aa2-9497-4482-9a72-a151b0f0716e tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:16.117752 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-400a2aa2-9497-4482-9a72-a151b0f0716e tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] [instance: 0581f7e5-2719-4aa6-8f59-7522c3004ade] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:16.124212 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-400a2aa2-9497-4482-9a72-a151b0f0716e tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:16.125002 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-400a2aa2-9497-4482-9a72-a151b0f0716e tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:16.125432 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-400a2aa2-9497-4482-9a72-a151b0f0716e tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:16.126146 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-400a2aa2-9497-4482-9a72-a151b0f0716e tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:16.126585 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-400a2aa2-9497-4482-9a72-a151b0f0716e tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:16.127000 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-400a2aa2-9497-4482-9a72-a151b0f0716e tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:16.265722 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-400a2aa2-9497-4482-9a72-a151b0f0716e tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc98a4e7de34bc1ad629247458a1fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc621ea3ee54c5eafd4fbb93e357b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:16.276897 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-400a2aa2-9497-4482-9a72-a151b0f0716e tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] 10.222.0.70 "GET /compute/v2.1/servers/0581f7e5-2719-4aa6-8f59-7522c3004ade" status: 200 len: 1504 microversion: 2.1 time: 0.163354 Aug 27 03:36:16.277753 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3142/6327] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:16 2022] GET /compute/v2.1/servers/0581f7e5-2719-4aa6-8f59-7522c3004ade => generated 1504 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:16.297727 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-2357b52e-c2a5-4b33-87b7-0cc0ba8be9ec tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:36:16.300153 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-2357b52e-c2a5-4b33-87b7-0cc0ba8be9ec tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] [instance: 0581f7e5-2719-4aa6-8f59-7522c3004ade] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:16.306545 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2357b52e-c2a5-4b33-87b7-0cc0ba8be9ec tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:16.307048 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2357b52e-c2a5-4b33-87b7-0cc0ba8be9ec tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:16.307501 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2357b52e-c2a5-4b33-87b7-0cc0ba8be9ec tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:16.308214 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2357b52e-c2a5-4b33-87b7-0cc0ba8be9ec tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:16.308763 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2357b52e-c2a5-4b33-87b7-0cc0ba8be9ec tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:16.309207 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2357b52e-c2a5-4b33-87b7-0cc0ba8be9ec tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:16.344997 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-2357b52e-c2a5-4b33-87b7-0cc0ba8be9ec tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '5fc98a4e7de34bc1ad629247458a1fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc621ea3ee54c5eafd4fbb93e357b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:16.351219 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-2357b52e-c2a5-4b33-87b7-0cc0ba8be9ec tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] [instance: 0581f7e5-2719-4aa6-8f59-7522c3004ade] Old instance type m1.heat2, new instance type m1.heat {{(pid=134051) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 27 03:36:16.358453 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-2357b52e-c2a5-4b33-87b7-0cc0ba8be9ec tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Flavor limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:36:16.358883 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-2357b52e-c2a5-4b33-87b7-0cc0ba8be9ec tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Image limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:36:16.359371 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-2357b52e-c2a5-4b33-87b7-0cc0ba8be9ec tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Flavor pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:36:16.359783 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-2357b52e-c2a5-4b33-87b7-0cc0ba8be9ec tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Image pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:36:16.360203 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-2357b52e-c2a5-4b33-87b7-0cc0ba8be9ec tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:36:16.432260 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-2357b52e-c2a5-4b33-87b7-0cc0ba8be9ec tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] 10.222.0.70 "POST /compute/v2.1/servers/0581f7e5-2719-4aa6-8f59-7522c3004ade/action" status: 202 len: 0 microversion: 2.1 time: 0.139075 Aug 27 03:36:16.432965 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3186/6328] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:36:16 2022] POST /compute/v2.1/servers/0581f7e5-2719-4aa6-8f59-7522c3004ade/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:36:16.442569 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ce38ea1c-727f-48bd-a82f-55eadc103dce tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:16.443163 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-ce38ea1c-727f-48bd-a82f-55eadc103dce tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] [instance: 0581f7e5-2719-4aa6-8f59-7522c3004ade] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:16.449159 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ce38ea1c-727f-48bd-a82f-55eadc103dce tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:16.449650 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ce38ea1c-727f-48bd-a82f-55eadc103dce tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:16.450083 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ce38ea1c-727f-48bd-a82f-55eadc103dce tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:16.450775 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ce38ea1c-727f-48bd-a82f-55eadc103dce tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:16.451262 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ce38ea1c-727f-48bd-a82f-55eadc103dce tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:16.451694 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ce38ea1c-727f-48bd-a82f-55eadc103dce tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:16.622161 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-ce38ea1c-727f-48bd-a82f-55eadc103dce tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc98a4e7de34bc1ad629247458a1fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc621ea3ee54c5eafd4fbb93e357b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:16.630929 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ce38ea1c-727f-48bd-a82f-55eadc103dce tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] 10.222.0.70 "GET /compute/v2.1/servers/0581f7e5-2719-4aa6-8f59-7522c3004ade" status: 200 len: 1515 microversion: 2.1 time: 0.192123 Aug 27 03:36:16.631616 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3143/6329] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:16 2022] GET /compute/v2.1/servers/0581f7e5-2719-4aa6-8f59-7522c3004ade => generated 1515 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:17.651627 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:36:17.657757 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-6475fce4-6d1e-47ae-bf0e-1eea3894a8ce tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:17.658403 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-6475fce4-6d1e-47ae-bf0e-1eea3894a8ce tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] [instance: 0581f7e5-2719-4aa6-8f59-7522c3004ade] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:17.665659 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6475fce4-6d1e-47ae-bf0e-1eea3894a8ce tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:17.666165 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6475fce4-6d1e-47ae-bf0e-1eea3894a8ce tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:17.666615 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6475fce4-6d1e-47ae-bf0e-1eea3894a8ce tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:17.667331 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6475fce4-6d1e-47ae-bf0e-1eea3894a8ce tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:17.667802 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6475fce4-6d1e-47ae-bf0e-1eea3894a8ce tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:17.668245 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6475fce4-6d1e-47ae-bf0e-1eea3894a8ce tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:17.882207 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-6475fce4-6d1e-47ae-bf0e-1eea3894a8ce tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc98a4e7de34bc1ad629247458a1fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc621ea3ee54c5eafd4fbb93e357b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:17.890323 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-6475fce4-6d1e-47ae-bf0e-1eea3894a8ce tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] 10.222.0.70 "GET /compute/v2.1/servers/0581f7e5-2719-4aa6-8f59-7522c3004ade" status: 200 len: 1515 microversion: 2.1 time: 0.241620 Aug 27 03:36:17.890970 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3187/6330] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:17 2022] GET /compute/v2.1/servers/0581f7e5-2719-4aa6-8f59-7522c3004ade => generated 1515 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:18.912823 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-610b4aac-aaed-4628-b350-de2d166f336d tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:18.913391 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-610b4aac-aaed-4628-b350-de2d166f336d tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] [instance: 0581f7e5-2719-4aa6-8f59-7522c3004ade] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:18.915407 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:36:18.916046 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=6 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:36:18.923511 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-610b4aac-aaed-4628-b350-de2d166f336d tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:18.924014 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-610b4aac-aaed-4628-b350-de2d166f336d tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:18.924508 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-610b4aac-aaed-4628-b350-de2d166f336d tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:18.925221 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-610b4aac-aaed-4628-b350-de2d166f336d tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:18.925969 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-610b4aac-aaed-4628-b350-de2d166f336d tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:18.926076 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-610b4aac-aaed-4628-b350-de2d166f336d tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:19.114256 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-610b4aac-aaed-4628-b350-de2d166f336d tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc98a4e7de34bc1ad629247458a1fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc621ea3ee54c5eafd4fbb93e357b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:19.122934 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-610b4aac-aaed-4628-b350-de2d166f336d tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] 10.222.0.70 "GET /compute/v2.1/servers/0581f7e5-2719-4aa6-8f59-7522c3004ade" status: 200 len: 1520 microversion: 2.1 time: 0.214135 Aug 27 03:36:19.123529 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3144/6331] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:18 2022] GET /compute/v2.1/servers/0581f7e5-2719-4aa6-8f59-7522c3004ade => generated 1520 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:20.148593 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ec030f07-fd1b-4689-b700-3d97f4c988c1 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:20.149708 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-ec030f07-fd1b-4689-b700-3d97f4c988c1 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] [instance: 0581f7e5-2719-4aa6-8f59-7522c3004ade] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:20.158898 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ec030f07-fd1b-4689-b700-3d97f4c988c1 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:20.159390 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ec030f07-fd1b-4689-b700-3d97f4c988c1 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:20.159832 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ec030f07-fd1b-4689-b700-3d97f4c988c1 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:20.160565 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ec030f07-fd1b-4689-b700-3d97f4c988c1 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:20.161025 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ec030f07-fd1b-4689-b700-3d97f4c988c1 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:20.161448 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ec030f07-fd1b-4689-b700-3d97f4c988c1 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:20.301062 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-ec030f07-fd1b-4689-b700-3d97f4c988c1 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc98a4e7de34bc1ad629247458a1fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc621ea3ee54c5eafd4fbb93e357b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:20.313441 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ec030f07-fd1b-4689-b700-3d97f4c988c1 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] 10.222.0.70 "GET /compute/v2.1/servers/0581f7e5-2719-4aa6-8f59-7522c3004ade" status: 200 len: 1520 microversion: 2.1 time: 0.171212 Aug 27 03:36:20.314081 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3188/6332] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:20 2022] GET /compute/v2.1/servers/0581f7e5-2719-4aa6-8f59-7522c3004ade => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:21.341349 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-76afc929-a549-4cfc-8edf-6e407213d516 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:21.342098 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-76afc929-a549-4cfc-8edf-6e407213d516 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] [instance: 0581f7e5-2719-4aa6-8f59-7522c3004ade] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:21.349572 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-76afc929-a549-4cfc-8edf-6e407213d516 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:21.350057 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-76afc929-a549-4cfc-8edf-6e407213d516 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:21.350490 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-76afc929-a549-4cfc-8edf-6e407213d516 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:21.351187 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-76afc929-a549-4cfc-8edf-6e407213d516 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:21.351630 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-76afc929-a549-4cfc-8edf-6e407213d516 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:21.352051 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-76afc929-a549-4cfc-8edf-6e407213d516 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:21.508522 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-76afc929-a549-4cfc-8edf-6e407213d516 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc98a4e7de34bc1ad629247458a1fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc621ea3ee54c5eafd4fbb93e357b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:21.521281 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-76afc929-a549-4cfc-8edf-6e407213d516 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] 10.222.0.70 "GET /compute/v2.1/servers/0581f7e5-2719-4aa6-8f59-7522c3004ade" status: 200 len: 1520 microversion: 2.1 time: 0.185236 Aug 27 03:36:21.522086 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3145/6333] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:21 2022] GET /compute/v2.1/servers/0581f7e5-2719-4aa6-8f59-7522c3004ade => generated 1520 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:22.550322 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-6c4810c4-36fb-43c1-9f1c-701b0992fa48 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:22.551479 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-6c4810c4-36fb-43c1-9f1c-701b0992fa48 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] [instance: 0581f7e5-2719-4aa6-8f59-7522c3004ade] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:22.561423 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6c4810c4-36fb-43c1-9f1c-701b0992fa48 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:22.561925 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6c4810c4-36fb-43c1-9f1c-701b0992fa48 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:22.562371 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6c4810c4-36fb-43c1-9f1c-701b0992fa48 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:22.563086 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6c4810c4-36fb-43c1-9f1c-701b0992fa48 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:22.563545 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6c4810c4-36fb-43c1-9f1c-701b0992fa48 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:22.563986 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6c4810c4-36fb-43c1-9f1c-701b0992fa48 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:22.702708 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-6c4810c4-36fb-43c1-9f1c-701b0992fa48 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc98a4e7de34bc1ad629247458a1fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc621ea3ee54c5eafd4fbb93e357b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:22.710968 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-6c4810c4-36fb-43c1-9f1c-701b0992fa48 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] 10.222.0.70 "GET /compute/v2.1/servers/0581f7e5-2719-4aa6-8f59-7522c3004ade" status: 200 len: 1520 microversion: 2.1 time: 0.168717 Aug 27 03:36:22.711558 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3189/6334] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:22 2022] GET /compute/v2.1/servers/0581f7e5-2719-4aa6-8f59-7522c3004ade => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:23.735507 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8313c507-36ef-44d3-87fd-e28c4510707a tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:23.736527 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-8313c507-36ef-44d3-87fd-e28c4510707a tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] [instance: 0581f7e5-2719-4aa6-8f59-7522c3004ade] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:23.747280 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8313c507-36ef-44d3-87fd-e28c4510707a tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:23.748014 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8313c507-36ef-44d3-87fd-e28c4510707a tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:23.748733 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8313c507-36ef-44d3-87fd-e28c4510707a tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:23.749871 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8313c507-36ef-44d3-87fd-e28c4510707a tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:23.750325 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8313c507-36ef-44d3-87fd-e28c4510707a tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:23.750745 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8313c507-36ef-44d3-87fd-e28c4510707a tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:23.890175 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-8313c507-36ef-44d3-87fd-e28c4510707a tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc98a4e7de34bc1ad629247458a1fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc621ea3ee54c5eafd4fbb93e357b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:23.898984 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-8313c507-36ef-44d3-87fd-e28c4510707a tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] 10.222.0.70 "GET /compute/v2.1/servers/0581f7e5-2719-4aa6-8f59-7522c3004ade" status: 200 len: 1520 microversion: 2.1 time: 0.169571 Aug 27 03:36:23.899571 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3146/6335] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:23 2022] GET /compute/v2.1/servers/0581f7e5-2719-4aa6-8f59-7522c3004ade => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:24.927956 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-cff6955c-dc49-4472-b45a-5ec5344bb046 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:24.928517 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-cff6955c-dc49-4472-b45a-5ec5344bb046 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] [instance: 0581f7e5-2719-4aa6-8f59-7522c3004ade] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:24.936231 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cff6955c-dc49-4472-b45a-5ec5344bb046 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:24.936790 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cff6955c-dc49-4472-b45a-5ec5344bb046 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:24.937286 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cff6955c-dc49-4472-b45a-5ec5344bb046 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:24.938053 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cff6955c-dc49-4472-b45a-5ec5344bb046 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:24.938551 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cff6955c-dc49-4472-b45a-5ec5344bb046 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:24.939014 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cff6955c-dc49-4472-b45a-5ec5344bb046 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:25.088378 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-cff6955c-dc49-4472-b45a-5ec5344bb046 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc98a4e7de34bc1ad629247458a1fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc621ea3ee54c5eafd4fbb93e357b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:25.098804 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-cff6955c-dc49-4472-b45a-5ec5344bb046 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] 10.222.0.70 "GET /compute/v2.1/servers/0581f7e5-2719-4aa6-8f59-7522c3004ade" status: 200 len: 1520 microversion: 2.1 time: 0.175454 Aug 27 03:36:25.099384 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3190/6336] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:24 2022] GET /compute/v2.1/servers/0581f7e5-2719-4aa6-8f59-7522c3004ade => generated 1520 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:26.124586 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-1b97713b-32c3-4a41-b017-70edbae6771c tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:26.125565 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-1b97713b-32c3-4a41-b017-70edbae6771c tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] [instance: 0581f7e5-2719-4aa6-8f59-7522c3004ade] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:26.137453 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1b97713b-32c3-4a41-b017-70edbae6771c tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:26.138253 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1b97713b-32c3-4a41-b017-70edbae6771c tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:26.138972 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1b97713b-32c3-4a41-b017-70edbae6771c tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:26.140116 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1b97713b-32c3-4a41-b017-70edbae6771c tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:26.140898 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1b97713b-32c3-4a41-b017-70edbae6771c tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:26.141595 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1b97713b-32c3-4a41-b017-70edbae6771c tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:26.288618 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-1b97713b-32c3-4a41-b017-70edbae6771c tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc98a4e7de34bc1ad629247458a1fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc621ea3ee54c5eafd4fbb93e357b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:26.296827 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-1b97713b-32c3-4a41-b017-70edbae6771c tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] 10.222.0.70 "GET /compute/v2.1/servers/0581f7e5-2719-4aa6-8f59-7522c3004ade" status: 200 len: 1520 microversion: 2.1 time: 0.178680 Aug 27 03:36:26.297416 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3147/6337] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:26 2022] GET /compute/v2.1/servers/0581f7e5-2719-4aa6-8f59-7522c3004ade => generated 1520 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:27.320246 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c10da52a-6cd1-4017-b853-4b3e243aa973 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:27.321128 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-c10da52a-6cd1-4017-b853-4b3e243aa973 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] [instance: 0581f7e5-2719-4aa6-8f59-7522c3004ade] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:27.330766 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c10da52a-6cd1-4017-b853-4b3e243aa973 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:27.331357 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c10da52a-6cd1-4017-b853-4b3e243aa973 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:27.331987 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c10da52a-6cd1-4017-b853-4b3e243aa973 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:27.332946 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c10da52a-6cd1-4017-b853-4b3e243aa973 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:27.333597 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c10da52a-6cd1-4017-b853-4b3e243aa973 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:27.334146 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c10da52a-6cd1-4017-b853-4b3e243aa973 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:27.485715 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-c10da52a-6cd1-4017-b853-4b3e243aa973 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc98a4e7de34bc1ad629247458a1fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc621ea3ee54c5eafd4fbb93e357b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:27.494230 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c10da52a-6cd1-4017-b853-4b3e243aa973 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] 10.222.0.70 "GET /compute/v2.1/servers/0581f7e5-2719-4aa6-8f59-7522c3004ade" status: 200 len: 1520 microversion: 2.1 time: 0.179120 Aug 27 03:36:27.494810 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3191/6338] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:27 2022] GET /compute/v2.1/servers/0581f7e5-2719-4aa6-8f59-7522c3004ade => generated 1520 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:28.518946 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9c1f9864-d335-4fd3-8937-1f209684ccc3 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:28.519709 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-9c1f9864-d335-4fd3-8937-1f209684ccc3 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] [instance: 0581f7e5-2719-4aa6-8f59-7522c3004ade] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:28.528721 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9c1f9864-d335-4fd3-8937-1f209684ccc3 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:28.529330 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9c1f9864-d335-4fd3-8937-1f209684ccc3 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:28.529874 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9c1f9864-d335-4fd3-8937-1f209684ccc3 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:28.530796 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9c1f9864-d335-4fd3-8937-1f209684ccc3 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:28.531357 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9c1f9864-d335-4fd3-8937-1f209684ccc3 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:28.531889 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9c1f9864-d335-4fd3-8937-1f209684ccc3 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:28.673923 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-9c1f9864-d335-4fd3-8937-1f209684ccc3 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc98a4e7de34bc1ad629247458a1fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc621ea3ee54c5eafd4fbb93e357b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:28.681925 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9c1f9864-d335-4fd3-8937-1f209684ccc3 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] 10.222.0.70 "GET /compute/v2.1/servers/0581f7e5-2719-4aa6-8f59-7522c3004ade" status: 200 len: 1520 microversion: 2.1 time: 0.169283 Aug 27 03:36:28.682484 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3148/6339] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:28 2022] GET /compute/v2.1/servers/0581f7e5-2719-4aa6-8f59-7522c3004ade => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:29.708501 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d8141c28-6ac6-45c0-8354-8f9c68054443 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:29.709520 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d8141c28-6ac6-45c0-8354-8f9c68054443 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] [instance: 0581f7e5-2719-4aa6-8f59-7522c3004ade] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:29.721326 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d8141c28-6ac6-45c0-8354-8f9c68054443 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:29.721828 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d8141c28-6ac6-45c0-8354-8f9c68054443 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:29.722277 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d8141c28-6ac6-45c0-8354-8f9c68054443 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:29.722979 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d8141c28-6ac6-45c0-8354-8f9c68054443 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:29.723442 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d8141c28-6ac6-45c0-8354-8f9c68054443 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:29.723876 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d8141c28-6ac6-45c0-8354-8f9c68054443 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:29.861193 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d8141c28-6ac6-45c0-8354-8f9c68054443 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc98a4e7de34bc1ad629247458a1fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc621ea3ee54c5eafd4fbb93e357b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:29.871525 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d8141c28-6ac6-45c0-8354-8f9c68054443 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] 10.222.0.70 "GET /compute/v2.1/servers/0581f7e5-2719-4aa6-8f59-7522c3004ade" status: 200 len: 1520 microversion: 2.1 time: 0.170380 Aug 27 03:36:29.872338 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3192/6340] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:29 2022] GET /compute/v2.1/servers/0581f7e5-2719-4aa6-8f59-7522c3004ade => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:30.901563 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-60d57e99-fdec-4e45-b953-9b3de00930d4 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:30.902526 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-60d57e99-fdec-4e45-b953-9b3de00930d4 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] [instance: 0581f7e5-2719-4aa6-8f59-7522c3004ade] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:30.913924 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-60d57e99-fdec-4e45-b953-9b3de00930d4 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:30.914473 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-60d57e99-fdec-4e45-b953-9b3de00930d4 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:30.915069 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-60d57e99-fdec-4e45-b953-9b3de00930d4 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:30.916051 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-60d57e99-fdec-4e45-b953-9b3de00930d4 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:30.916565 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-60d57e99-fdec-4e45-b953-9b3de00930d4 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:30.917012 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-60d57e99-fdec-4e45-b953-9b3de00930d4 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:31.065984 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-60d57e99-fdec-4e45-b953-9b3de00930d4 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc98a4e7de34bc1ad629247458a1fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc621ea3ee54c5eafd4fbb93e357b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:31.074290 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-60d57e99-fdec-4e45-b953-9b3de00930d4 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] 10.222.0.70 "GET /compute/v2.1/servers/0581f7e5-2719-4aa6-8f59-7522c3004ade" status: 200 len: 1520 microversion: 2.1 time: 0.178716 Aug 27 03:36:31.074894 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3149/6341] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:30 2022] GET /compute/v2.1/servers/0581f7e5-2719-4aa6-8f59-7522c3004ade => generated 1520 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:32.098652 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-74005e4f-c931-48ea-8b97-b3eff83ccf6d tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:32.099615 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-74005e4f-c931-48ea-8b97-b3eff83ccf6d tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] [instance: 0581f7e5-2719-4aa6-8f59-7522c3004ade] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:32.111222 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-74005e4f-c931-48ea-8b97-b3eff83ccf6d tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:32.111661 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-74005e4f-c931-48ea-8b97-b3eff83ccf6d tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:32.112114 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-74005e4f-c931-48ea-8b97-b3eff83ccf6d tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:32.112860 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-74005e4f-c931-48ea-8b97-b3eff83ccf6d tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:32.113324 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-74005e4f-c931-48ea-8b97-b3eff83ccf6d tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:32.113762 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-74005e4f-c931-48ea-8b97-b3eff83ccf6d tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:32.251644 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-74005e4f-c931-48ea-8b97-b3eff83ccf6d tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc98a4e7de34bc1ad629247458a1fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc621ea3ee54c5eafd4fbb93e357b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:32.259841 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-74005e4f-c931-48ea-8b97-b3eff83ccf6d tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] 10.222.0.70 "GET /compute/v2.1/servers/0581f7e5-2719-4aa6-8f59-7522c3004ade" status: 200 len: 1520 microversion: 2.1 time: 0.168027 Aug 27 03:36:32.260435 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3193/6342] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:32 2022] GET /compute/v2.1/servers/0581f7e5-2719-4aa6-8f59-7522c3004ade => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:33.283275 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6ec50bfb-b1ec-4018-a69b-8866e473c023 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:33.283910 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-6ec50bfb-b1ec-4018-a69b-8866e473c023 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] [instance: 0581f7e5-2719-4aa6-8f59-7522c3004ade] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:33.291249 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6ec50bfb-b1ec-4018-a69b-8866e473c023 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:33.291739 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6ec50bfb-b1ec-4018-a69b-8866e473c023 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:33.292185 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6ec50bfb-b1ec-4018-a69b-8866e473c023 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:33.292914 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6ec50bfb-b1ec-4018-a69b-8866e473c023 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:33.293361 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6ec50bfb-b1ec-4018-a69b-8866e473c023 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:33.293783 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6ec50bfb-b1ec-4018-a69b-8866e473c023 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:33.433782 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-6ec50bfb-b1ec-4018-a69b-8866e473c023 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc98a4e7de34bc1ad629247458a1fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc621ea3ee54c5eafd4fbb93e357b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:33.442037 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-6ec50bfb-b1ec-4018-a69b-8866e473c023 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] 10.222.0.70 "GET /compute/v2.1/servers/0581f7e5-2719-4aa6-8f59-7522c3004ade" status: 200 len: 1520 microversion: 2.1 time: 0.164635 Aug 27 03:36:33.442617 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3150/6343] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:33 2022] GET /compute/v2.1/servers/0581f7e5-2719-4aa6-8f59-7522c3004ade => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:34.464575 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-6aecd9fe-273d-4cb0-9d08-ce1f55d5a87a tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:34.465379 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-6aecd9fe-273d-4cb0-9d08-ce1f55d5a87a tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] [instance: 0581f7e5-2719-4aa6-8f59-7522c3004ade] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:34.474180 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6aecd9fe-273d-4cb0-9d08-ce1f55d5a87a tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:34.474857 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6aecd9fe-273d-4cb0-9d08-ce1f55d5a87a tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:34.475449 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6aecd9fe-273d-4cb0-9d08-ce1f55d5a87a tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:34.476374 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6aecd9fe-273d-4cb0-9d08-ce1f55d5a87a tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:34.476980 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6aecd9fe-273d-4cb0-9d08-ce1f55d5a87a tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:34.477524 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6aecd9fe-273d-4cb0-9d08-ce1f55d5a87a tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:34.624983 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-6aecd9fe-273d-4cb0-9d08-ce1f55d5a87a tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc98a4e7de34bc1ad629247458a1fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc621ea3ee54c5eafd4fbb93e357b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:34.632971 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-6aecd9fe-273d-4cb0-9d08-ce1f55d5a87a tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] 10.222.0.70 "GET /compute/v2.1/servers/0581f7e5-2719-4aa6-8f59-7522c3004ade" status: 200 len: 1520 microversion: 2.1 time: 0.173325 Aug 27 03:36:34.633558 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3194/6344] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:34 2022] GET /compute/v2.1/servers/0581f7e5-2719-4aa6-8f59-7522c3004ade => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:35.658720 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3a60e93e-43f8-4adf-b644-7083f5e56283 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:35.659415 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-3a60e93e-43f8-4adf-b644-7083f5e56283 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] [instance: 0581f7e5-2719-4aa6-8f59-7522c3004ade] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:35.667438 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3a60e93e-43f8-4adf-b644-7083f5e56283 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:35.668027 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3a60e93e-43f8-4adf-b644-7083f5e56283 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:35.668502 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3a60e93e-43f8-4adf-b644-7083f5e56283 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:35.669226 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3a60e93e-43f8-4adf-b644-7083f5e56283 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:35.669683 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3a60e93e-43f8-4adf-b644-7083f5e56283 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:35.670109 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3a60e93e-43f8-4adf-b644-7083f5e56283 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:35.818198 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-3a60e93e-43f8-4adf-b644-7083f5e56283 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc98a4e7de34bc1ad629247458a1fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc621ea3ee54c5eafd4fbb93e357b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:35.830623 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-3a60e93e-43f8-4adf-b644-7083f5e56283 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] 10.222.0.70 "GET /compute/v2.1/servers/0581f7e5-2719-4aa6-8f59-7522c3004ade" status: 200 len: 1520 microversion: 2.1 time: 0.178649 Aug 27 03:36:35.831183 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3151/6345] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:35 2022] GET /compute/v2.1/servers/0581f7e5-2719-4aa6-8f59-7522c3004ade => generated 1520 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:36.853731 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a5ac7a68-1d78-449e-94df-273dee831aaa tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:36.854634 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-a5ac7a68-1d78-449e-94df-273dee831aaa tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] [instance: 0581f7e5-2719-4aa6-8f59-7522c3004ade] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:36.864034 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a5ac7a68-1d78-449e-94df-273dee831aaa tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:36.864570 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a5ac7a68-1d78-449e-94df-273dee831aaa tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:36.865017 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a5ac7a68-1d78-449e-94df-273dee831aaa tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:36.865725 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a5ac7a68-1d78-449e-94df-273dee831aaa tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:36.866190 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a5ac7a68-1d78-449e-94df-273dee831aaa tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:36.866621 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a5ac7a68-1d78-449e-94df-273dee831aaa tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:36.870642 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:36:37.007290 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-a5ac7a68-1d78-449e-94df-273dee831aaa tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc98a4e7de34bc1ad629247458a1fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc621ea3ee54c5eafd4fbb93e357b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:37.016690 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a5ac7a68-1d78-449e-94df-273dee831aaa tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] 10.222.0.70 "GET /compute/v2.1/servers/0581f7e5-2719-4aa6-8f59-7522c3004ade" status: 200 len: 1520 microversion: 2.1 time: 0.168768 Aug 27 03:36:37.017289 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3195/6346] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:36 2022] GET /compute/v2.1/servers/0581f7e5-2719-4aa6-8f59-7522c3004ade => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:38.046042 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-68d35613-6e61-4c11-b67e-694d58af48ec tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:38.047082 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-68d35613-6e61-4c11-b67e-694d58af48ec tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] [instance: 0581f7e5-2719-4aa6-8f59-7522c3004ade] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:38.055333 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-68d35613-6e61-4c11-b67e-694d58af48ec tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:38.055835 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-68d35613-6e61-4c11-b67e-694d58af48ec tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:38.056246 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-68d35613-6e61-4c11-b67e-694d58af48ec tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:38.056993 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-68d35613-6e61-4c11-b67e-694d58af48ec tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:38.057445 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-68d35613-6e61-4c11-b67e-694d58af48ec tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:38.057909 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-68d35613-6e61-4c11-b67e-694d58af48ec tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:38.196772 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-68d35613-6e61-4c11-b67e-694d58af48ec tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc98a4e7de34bc1ad629247458a1fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc621ea3ee54c5eafd4fbb93e357b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:38.204643 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-68d35613-6e61-4c11-b67e-694d58af48ec tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] 10.222.0.70 "GET /compute/v2.1/servers/0581f7e5-2719-4aa6-8f59-7522c3004ade" status: 200 len: 1520 microversion: 2.1 time: 0.165596 Aug 27 03:36:38.205229 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3152/6347] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:38 2022] GET /compute/v2.1/servers/0581f7e5-2719-4aa6-8f59-7522c3004ade => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:39.230383 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-53216775-f20a-409d-a99d-ea6c0fed0b01 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:39.231362 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-53216775-f20a-409d-a99d-ea6c0fed0b01 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] [instance: 0581f7e5-2719-4aa6-8f59-7522c3004ade] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:39.243987 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-53216775-f20a-409d-a99d-ea6c0fed0b01 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:39.244883 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-53216775-f20a-409d-a99d-ea6c0fed0b01 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:39.245633 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-53216775-f20a-409d-a99d-ea6c0fed0b01 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:39.246818 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-53216775-f20a-409d-a99d-ea6c0fed0b01 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:39.247583 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-53216775-f20a-409d-a99d-ea6c0fed0b01 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:39.248304 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-53216775-f20a-409d-a99d-ea6c0fed0b01 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:39.385774 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-53216775-f20a-409d-a99d-ea6c0fed0b01 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc98a4e7de34bc1ad629247458a1fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc621ea3ee54c5eafd4fbb93e357b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:39.398235 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-53216775-f20a-409d-a99d-ea6c0fed0b01 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] 10.222.0.70 "GET /compute/v2.1/servers/0581f7e5-2719-4aa6-8f59-7522c3004ade" status: 200 len: 1520 microversion: 2.1 time: 0.174434 Aug 27 03:36:39.398968 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3196/6348] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:39 2022] GET /compute/v2.1/servers/0581f7e5-2719-4aa6-8f59-7522c3004ade => generated 1520 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:40.425734 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-21797b62-5dbe-473d-837c-7703e13d37df tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:40.426738 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-21797b62-5dbe-473d-837c-7703e13d37df tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] [instance: 0581f7e5-2719-4aa6-8f59-7522c3004ade] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:40.434729 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-21797b62-5dbe-473d-837c-7703e13d37df tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:40.435221 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-21797b62-5dbe-473d-837c-7703e13d37df tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:40.435637 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-21797b62-5dbe-473d-837c-7703e13d37df tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:40.436371 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-21797b62-5dbe-473d-837c-7703e13d37df tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:40.436863 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-21797b62-5dbe-473d-837c-7703e13d37df tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:40.437291 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-21797b62-5dbe-473d-837c-7703e13d37df tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:40.574870 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-21797b62-5dbe-473d-837c-7703e13d37df tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc98a4e7de34bc1ad629247458a1fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc621ea3ee54c5eafd4fbb93e357b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:40.583553 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-21797b62-5dbe-473d-837c-7703e13d37df tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] 10.222.0.70 "GET /compute/v2.1/servers/0581f7e5-2719-4aa6-8f59-7522c3004ade" status: 200 len: 1520 microversion: 2.1 time: 0.163682 Aug 27 03:36:40.584249 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3153/6349] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:40 2022] GET /compute/v2.1/servers/0581f7e5-2719-4aa6-8f59-7522c3004ade => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:41.608889 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b15d1d4d-41a2-442c-b0c9-5a9253b5740d tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:41.609892 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b15d1d4d-41a2-442c-b0c9-5a9253b5740d tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] [instance: 0581f7e5-2719-4aa6-8f59-7522c3004ade] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:41.621860 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b15d1d4d-41a2-442c-b0c9-5a9253b5740d tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:41.622707 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b15d1d4d-41a2-442c-b0c9-5a9253b5740d tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:41.623459 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b15d1d4d-41a2-442c-b0c9-5a9253b5740d tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:41.624679 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b15d1d4d-41a2-442c-b0c9-5a9253b5740d tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:41.625469 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b15d1d4d-41a2-442c-b0c9-5a9253b5740d tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:41.626201 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b15d1d4d-41a2-442c-b0c9-5a9253b5740d tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:41.777003 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-b15d1d4d-41a2-442c-b0c9-5a9253b5740d tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc98a4e7de34bc1ad629247458a1fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc621ea3ee54c5eafd4fbb93e357b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:41.787937 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b15d1d4d-41a2-442c-b0c9-5a9253b5740d tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] 10.222.0.70 "GET /compute/v2.1/servers/0581f7e5-2719-4aa6-8f59-7522c3004ade" status: 200 len: 1520 microversion: 2.1 time: 0.185438 Aug 27 03:36:41.788908 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3197/6350] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:41 2022] GET /compute/v2.1/servers/0581f7e5-2719-4aa6-8f59-7522c3004ade => generated 1520 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:42.814106 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d7015a89-e419-46c3-bccc-e8806054be2f tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:42.815096 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d7015a89-e419-46c3-bccc-e8806054be2f tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] [instance: 0581f7e5-2719-4aa6-8f59-7522c3004ade] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:42.826900 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d7015a89-e419-46c3-bccc-e8806054be2f tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:42.827705 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d7015a89-e419-46c3-bccc-e8806054be2f tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:42.828463 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d7015a89-e419-46c3-bccc-e8806054be2f tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:42.829623 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d7015a89-e419-46c3-bccc-e8806054be2f tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:42.830365 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d7015a89-e419-46c3-bccc-e8806054be2f tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:42.831065 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d7015a89-e419-46c3-bccc-e8806054be2f tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:42.972625 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-d7015a89-e419-46c3-bccc-e8806054be2f tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc98a4e7de34bc1ad629247458a1fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc621ea3ee54c5eafd4fbb93e357b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:42.981203 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d7015a89-e419-46c3-bccc-e8806054be2f tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] 10.222.0.70 "GET /compute/v2.1/servers/0581f7e5-2719-4aa6-8f59-7522c3004ade" status: 200 len: 1520 microversion: 2.1 time: 0.173691 Aug 27 03:36:42.981761 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3154/6351] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:42 2022] GET /compute/v2.1/servers/0581f7e5-2719-4aa6-8f59-7522c3004ade => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:44.002364 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b4c4e3d5-e562-4403-9dca-8bbbf905163d tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:44.002991 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b4c4e3d5-e562-4403-9dca-8bbbf905163d tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] [instance: 0581f7e5-2719-4aa6-8f59-7522c3004ade] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:44.010589 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b4c4e3d5-e562-4403-9dca-8bbbf905163d tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:44.011087 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b4c4e3d5-e562-4403-9dca-8bbbf905163d tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:44.011527 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b4c4e3d5-e562-4403-9dca-8bbbf905163d tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:44.012259 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b4c4e3d5-e562-4403-9dca-8bbbf905163d tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:44.012748 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b4c4e3d5-e562-4403-9dca-8bbbf905163d tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:44.013177 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b4c4e3d5-e562-4403-9dca-8bbbf905163d tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:44.147158 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-b4c4e3d5-e562-4403-9dca-8bbbf905163d tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc98a4e7de34bc1ad629247458a1fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc621ea3ee54c5eafd4fbb93e357b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:44.155585 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b4c4e3d5-e562-4403-9dca-8bbbf905163d tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] 10.222.0.70 "GET /compute/v2.1/servers/0581f7e5-2719-4aa6-8f59-7522c3004ade" status: 200 len: 1520 microversion: 2.1 time: 0.157198 Aug 27 03:36:44.156159 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3198/6352] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:43 2022] GET /compute/v2.1/servers/0581f7e5-2719-4aa6-8f59-7522c3004ade => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:45.177691 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6a81219e-cb97-49f7-b9a2-24b64fcf62b6 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:45.178294 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-6a81219e-cb97-49f7-b9a2-24b64fcf62b6 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] [instance: 0581f7e5-2719-4aa6-8f59-7522c3004ade] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:45.186670 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6a81219e-cb97-49f7-b9a2-24b64fcf62b6 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:45.187153 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6a81219e-cb97-49f7-b9a2-24b64fcf62b6 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:45.187583 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6a81219e-cb97-49f7-b9a2-24b64fcf62b6 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:45.188339 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6a81219e-cb97-49f7-b9a2-24b64fcf62b6 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:45.188796 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6a81219e-cb97-49f7-b9a2-24b64fcf62b6 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:45.189210 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6a81219e-cb97-49f7-b9a2-24b64fcf62b6 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:45.192177 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:36:45.342694 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-6a81219e-cb97-49f7-b9a2-24b64fcf62b6 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc98a4e7de34bc1ad629247458a1fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc621ea3ee54c5eafd4fbb93e357b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:45.351325 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-6a81219e-cb97-49f7-b9a2-24b64fcf62b6 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] 10.222.0.70 "GET /compute/v2.1/servers/0581f7e5-2719-4aa6-8f59-7522c3004ade" status: 200 len: 1520 microversion: 2.1 time: 0.178275 Aug 27 03:36:45.352065 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3155/6353] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:45 2022] GET /compute/v2.1/servers/0581f7e5-2719-4aa6-8f59-7522c3004ade => generated 1520 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:45.819202 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-cb604d2d-e914-4e7a-a206-23f4f9546dca req-53265bf1-a4af-4467-90af-4db76eed6d01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0581f7e5-2719-4aa6-8f59-7522c3004ade", "name": "network-vif-unplugged", "status": "completed", "tag": "2bdae32a-b581-4cff-b413-602f6d16bc7c"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:36:45.825237 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=36 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:36:45.831583 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-cb604d2d-e914-4e7a-a206-23f4f9546dca req-53265bf1-a4af-4467-90af-4db76eed6d01 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:45.832076 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-cb604d2d-e914-4e7a-a206-23f4f9546dca req-53265bf1-a4af-4467-90af-4db76eed6d01 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:45.832687 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-cb604d2d-e914-4e7a-a206-23f4f9546dca req-53265bf1-a4af-4467-90af-4db76eed6d01 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:45.845085 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-cb604d2d-e914-4e7a-a206-23f4f9546dca req-53265bf1-a4af-4467-90af-4db76eed6d01 service nova] Creating event network-vif-unplugged:2bdae32a-b581-4cff-b413-602f6d16bc7c for instance 0581f7e5-2719-4aa6-8f59-7522c3004ade on n-h1-852278-4 Aug 27 03:36:45.851464 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [req-cb604d2d-e914-4e7a-a206-23f4f9546dca req-53265bf1-a4af-4467-90af-4db76eed6d01 service nova] Instance 0581f7e5-2719-4aa6-8f59-7522c3004ade is migrating within the same cell, copying events to all relevant hosts: {'n-h2-852278-4', 'n-h1-852278-4'} {{(pid=134051) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 03:36:45.863025 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-cb604d2d-e914-4e7a-a206-23f4f9546dca req-53265bf1-a4af-4467-90af-4db76eed6d01 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047609 Aug 27 03:36:45.864068 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3199/6354] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:36:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:36:46.373480 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-16ca61c2-a417-4416-9157-c14f648fc458 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:46.374201 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-16ca61c2-a417-4416-9157-c14f648fc458 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] [instance: 0581f7e5-2719-4aa6-8f59-7522c3004ade] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:46.377005 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=34 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:36:46.382992 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-16ca61c2-a417-4416-9157-c14f648fc458 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:46.383483 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-16ca61c2-a417-4416-9157-c14f648fc458 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:46.383937 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-16ca61c2-a417-4416-9157-c14f648fc458 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:46.384695 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-16ca61c2-a417-4416-9157-c14f648fc458 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:46.385146 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-16ca61c2-a417-4416-9157-c14f648fc458 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:46.385565 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-16ca61c2-a417-4416-9157-c14f648fc458 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:46.592128 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-16ca61c2-a417-4416-9157-c14f648fc458 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc98a4e7de34bc1ad629247458a1fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc621ea3ee54c5eafd4fbb93e357b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:46.600486 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-16ca61c2-a417-4416-9157-c14f648fc458 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] 10.222.0.70 "GET /compute/v2.1/servers/0581f7e5-2719-4aa6-8f59-7522c3004ade" status: 200 len: 1519 microversion: 2.1 time: 0.231193 Aug 27 03:36:46.601085 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3156/6355] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:46 2022] GET /compute/v2.1/servers/0581f7e5-2719-4aa6-8f59-7522c3004ade => generated 1519 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:47.628592 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-19aa43ea-179a-4e94-a7e4-7f29df6863be tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:47.629855 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-19aa43ea-179a-4e94-a7e4-7f29df6863be tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] [instance: 0581f7e5-2719-4aa6-8f59-7522c3004ade] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:47.637461 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-19aa43ea-179a-4e94-a7e4-7f29df6863be tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:47.637965 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-19aa43ea-179a-4e94-a7e4-7f29df6863be tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:47.638380 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-19aa43ea-179a-4e94-a7e4-7f29df6863be tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:47.639120 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-19aa43ea-179a-4e94-a7e4-7f29df6863be tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:47.639586 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-19aa43ea-179a-4e94-a7e4-7f29df6863be tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:47.640025 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-19aa43ea-179a-4e94-a7e4-7f29df6863be tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:47.780132 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-19aa43ea-179a-4e94-a7e4-7f29df6863be tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc98a4e7de34bc1ad629247458a1fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc621ea3ee54c5eafd4fbb93e357b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:47.789242 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-19aa43ea-179a-4e94-a7e4-7f29df6863be tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] 10.222.0.70 "GET /compute/v2.1/servers/0581f7e5-2719-4aa6-8f59-7522c3004ade" status: 200 len: 1517 microversion: 2.1 time: 0.169524 Aug 27 03:36:47.789851 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3200/6356] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:47 2022] GET /compute/v2.1/servers/0581f7e5-2719-4aa6-8f59-7522c3004ade => generated 1517 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:47.885861 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-4b6123bb-972d-4fff-ab27-c314a6c5ecad req-f3e0efa7-e3c2-4a1a-bfd4-62c3528754ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0581f7e5-2719-4aa6-8f59-7522c3004ade", "tag": "2bdae32a-b581-4cff-b413-602f6d16bc7c"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:36:47.901376 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-4b6123bb-972d-4fff-ab27-c314a6c5ecad req-f3e0efa7-e3c2-4a1a-bfd4-62c3528754ee service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:47.901834 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-4b6123bb-972d-4fff-ab27-c314a6c5ecad req-f3e0efa7-e3c2-4a1a-bfd4-62c3528754ee service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:47.902259 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-4b6123bb-972d-4fff-ab27-c314a6c5ecad req-f3e0efa7-e3c2-4a1a-bfd4-62c3528754ee service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:47.914277 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-4b6123bb-972d-4fff-ab27-c314a6c5ecad req-f3e0efa7-e3c2-4a1a-bfd4-62c3528754ee service nova] Creating event network-changed:2bdae32a-b581-4cff-b413-602f6d16bc7c for instance 0581f7e5-2719-4aa6-8f59-7522c3004ade on n-h1-852278-4 Aug 27 03:36:47.920052 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [req-4b6123bb-972d-4fff-ab27-c314a6c5ecad req-f3e0efa7-e3c2-4a1a-bfd4-62c3528754ee service nova] Instance 0581f7e5-2719-4aa6-8f59-7522c3004ade is migrating within the same cell, copying events to all relevant hosts: {'n-h2-852278-4', 'n-h1-852278-4'} {{(pid=134052) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 03:36:47.931933 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-4b6123bb-972d-4fff-ab27-c314a6c5ecad req-f3e0efa7-e3c2-4a1a-bfd4-62c3528754ee service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054261 Aug 27 03:36:47.932878 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3157/6357] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:36:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:36:48.811185 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-5328cf2c-96cd-458b-9533-61093cabf446 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:48.811813 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-5328cf2c-96cd-458b-9533-61093cabf446 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] [instance: 0581f7e5-2719-4aa6-8f59-7522c3004ade] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:48.819164 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5328cf2c-96cd-458b-9533-61093cabf446 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:48.819657 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5328cf2c-96cd-458b-9533-61093cabf446 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:48.820072 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5328cf2c-96cd-458b-9533-61093cabf446 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:48.820807 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5328cf2c-96cd-458b-9533-61093cabf446 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:48.821269 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5328cf2c-96cd-458b-9533-61093cabf446 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:48.821700 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5328cf2c-96cd-458b-9533-61093cabf446 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:48.959064 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-5328cf2c-96cd-458b-9533-61093cabf446 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc98a4e7de34bc1ad629247458a1fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc621ea3ee54c5eafd4fbb93e357b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:48.971337 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-5328cf2c-96cd-458b-9533-61093cabf446 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] 10.222.0.70 "GET /compute/v2.1/servers/0581f7e5-2719-4aa6-8f59-7522c3004ade" status: 200 len: 1514 microversion: 2.1 time: 0.163741 Aug 27 03:36:48.972082 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3201/6358] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:48 2022] GET /compute/v2.1/servers/0581f7e5-2719-4aa6-8f59-7522c3004ade => generated 1514 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:48.995078 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5fc101c0-b17a-4e25-a3f5-76d8d4fb383a tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:36:48.995675 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-5fc101c0-b17a-4e25-a3f5-76d8d4fb383a tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] [instance: 0581f7e5-2719-4aa6-8f59-7522c3004ade] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:49.002565 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5fc101c0-b17a-4e25-a3f5-76d8d4fb383a tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:49.003057 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5fc101c0-b17a-4e25-a3f5-76d8d4fb383a tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:49.003524 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5fc101c0-b17a-4e25-a3f5-76d8d4fb383a tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:49.004213 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5fc101c0-b17a-4e25-a3f5-76d8d4fb383a tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:49.004703 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5fc101c0-b17a-4e25-a3f5-76d8d4fb383a tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:49.005126 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5fc101c0-b17a-4e25-a3f5-76d8d4fb383a tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:49.067870 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-5fc101c0-b17a-4e25-a3f5-76d8d4fb383a tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] 10.222.0.70 "POST /compute/v2.1/servers/0581f7e5-2719-4aa6-8f59-7522c3004ade/action" status: 204 len: 0 microversion: 2.1 time: 0.078054 Aug 27 03:36:49.068532 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3158/6359] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:36:48 2022] POST /compute/v2.1/servers/0581f7e5-2719-4aa6-8f59-7522c3004ade/action => generated 0 bytes in 80 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:36:49.077057 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-9940d43d-62f3-499b-9ef2-c9fba1a95c5d tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:49.077687 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-9940d43d-62f3-499b-9ef2-c9fba1a95c5d tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] [instance: 0581f7e5-2719-4aa6-8f59-7522c3004ade] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:49.083765 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9940d43d-62f3-499b-9ef2-c9fba1a95c5d tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:49.084332 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9940d43d-62f3-499b-9ef2-c9fba1a95c5d tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:49.084897 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9940d43d-62f3-499b-9ef2-c9fba1a95c5d tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:49.085611 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9940d43d-62f3-499b-9ef2-c9fba1a95c5d tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:49.086082 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9940d43d-62f3-499b-9ef2-c9fba1a95c5d tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:49.086588 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9940d43d-62f3-499b-9ef2-c9fba1a95c5d tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:49.295780 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-9940d43d-62f3-499b-9ef2-c9fba1a95c5d tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc98a4e7de34bc1ad629247458a1fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc621ea3ee54c5eafd4fbb93e357b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:49.304408 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-9940d43d-62f3-499b-9ef2-c9fba1a95c5d tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] 10.222.0.70 "GET /compute/v2.1/servers/0581f7e5-2719-4aa6-8f59-7522c3004ade" status: 200 len: 1514 microversion: 2.1 time: 0.231305 Aug 27 03:36:49.305006 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3202/6360] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:49 2022] GET /compute/v2.1/servers/0581f7e5-2719-4aa6-8f59-7522c3004ade => generated 1514 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:50.327261 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-415f6555-500b-465a-b05b-d90c2a652b8a tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:50.328058 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-415f6555-500b-465a-b05b-d90c2a652b8a tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] [instance: 0581f7e5-2719-4aa6-8f59-7522c3004ade] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:50.334779 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-415f6555-500b-465a-b05b-d90c2a652b8a tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:50.335252 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-415f6555-500b-465a-b05b-d90c2a652b8a tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:50.335684 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-415f6555-500b-465a-b05b-d90c2a652b8a tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:50.336410 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-415f6555-500b-465a-b05b-d90c2a652b8a tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:50.336858 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-415f6555-500b-465a-b05b-d90c2a652b8a tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:50.337277 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-415f6555-500b-465a-b05b-d90c2a652b8a tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:50.472573 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-415f6555-500b-465a-b05b-d90c2a652b8a tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc98a4e7de34bc1ad629247458a1fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc621ea3ee54c5eafd4fbb93e357b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:50.481051 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-415f6555-500b-465a-b05b-d90c2a652b8a tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] 10.222.0.70 "GET /compute/v2.1/servers/0581f7e5-2719-4aa6-8f59-7522c3004ade" status: 200 len: 1506 microversion: 2.1 time: 0.159061 Aug 27 03:36:50.481639 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3159/6361] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:50 2022] GET /compute/v2.1/servers/0581f7e5-2719-4aa6-8f59-7522c3004ade => generated 1506 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:50.501329 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a9742d54-1363-4b4a-bbd2-9871f714ba75 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:50.501957 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-a9742d54-1363-4b4a-bbd2-9871f714ba75 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] [instance: 0581f7e5-2719-4aa6-8f59-7522c3004ade] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:50.509377 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a9742d54-1363-4b4a-bbd2-9871f714ba75 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:50.509876 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a9742d54-1363-4b4a-bbd2-9871f714ba75 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:50.510319 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a9742d54-1363-4b4a-bbd2-9871f714ba75 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:50.511022 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a9742d54-1363-4b4a-bbd2-9871f714ba75 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:50.511480 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a9742d54-1363-4b4a-bbd2-9871f714ba75 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:50.511912 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a9742d54-1363-4b4a-bbd2-9871f714ba75 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:50.677834 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-a9742d54-1363-4b4a-bbd2-9871f714ba75 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc98a4e7de34bc1ad629247458a1fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc621ea3ee54c5eafd4fbb93e357b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:50.687584 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a9742d54-1363-4b4a-bbd2-9871f714ba75 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] 10.222.0.70 "GET /compute/v2.1/servers/0581f7e5-2719-4aa6-8f59-7522c3004ade" status: 200 len: 1506 microversion: 2.1 time: 0.190222 Aug 27 03:36:50.688190 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3203/6362] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:50 2022] GET /compute/v2.1/servers/0581f7e5-2719-4aa6-8f59-7522c3004ade => generated 1506 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:50.717099 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-848ec767-ca6c-432a-98d3-8818ba5410cb tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Action: 'create', calling method: .version_select at 0x7f5ee24a2dc0>, body: {"keypair": {"name": "tempest-keypair-613354020", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAKgNb5ZSPbIBBtWhj5AdvNOaRNZyPavcqrjfjNBMf7TEuP0FSxKD2mQ+BoLUi9AcQyiSEGAd0ahrYRFRdg1vq59aGsqdMqrCdJPoN7ZZZc4sNvTHFfcSUnZfSivGYGBBg=="}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:36:50.733845 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-848ec767-ca6c-432a-98d3-8818ba5410cb tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Getting quotas for project afc621ea3ee54c5eafd4fbb93e357b3f. Resources: {'key_pairs'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:36:50.739377 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-848ec767-ca6c-432a-98d3-8818ba5410cb tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Getting quotas for user 5fc98a4e7de34bc1ad629247458a1fe2 and project afc621ea3ee54c5eafd4fbb93e357b3f. Resources: {'key_pairs'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:36:50.772153 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-848ec767-ca6c-432a-98d3-8818ba5410cb tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.059064 Aug 27 03:36:50.772885 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3160/6363] 10.222.0.70 () {60 vars in 1159 bytes} [Sat Aug 27 03:36:50 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:36:51.778971 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-d436028c-9fee-463e-81b7-da667c9d11d1 req-c8b9dc18-1f43-4813-b8fe-6c63a9b6952a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0581f7e5-2719-4aa6-8f59-7522c3004ade", "name": "network-vif-plugged", "status": "completed", "tag": "2bdae32a-b581-4cff-b413-602f6d16bc7c"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:36:51.791446 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-d436028c-9fee-463e-81b7-da667c9d11d1 req-c8b9dc18-1f43-4813-b8fe-6c63a9b6952a service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:51.792027 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-d436028c-9fee-463e-81b7-da667c9d11d1 req-c8b9dc18-1f43-4813-b8fe-6c63a9b6952a service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:51.792621 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-d436028c-9fee-463e-81b7-da667c9d11d1 req-c8b9dc18-1f43-4813-b8fe-6c63a9b6952a service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:51.804671 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-d436028c-9fee-463e-81b7-da667c9d11d1 req-c8b9dc18-1f43-4813-b8fe-6c63a9b6952a service nova] Creating event network-vif-plugged:2bdae32a-b581-4cff-b413-602f6d16bc7c for instance 0581f7e5-2719-4aa6-8f59-7522c3004ade on n-h1-852278-4 Aug 27 03:36:51.809834 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-d436028c-9fee-463e-81b7-da667c9d11d1 req-c8b9dc18-1f43-4813-b8fe-6c63a9b6952a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035739 Aug 27 03:36:51.810547 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3204/6364] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:36:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:36:52.008258 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4c36f804-9e58-4bec-a843-df30cb7c99b5 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:52.008902 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-4c36f804-9e58-4bec-a843-df30cb7c99b5 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] [instance: 0581f7e5-2719-4aa6-8f59-7522c3004ade] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:52.015657 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4c36f804-9e58-4bec-a843-df30cb7c99b5 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:52.016274 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4c36f804-9e58-4bec-a843-df30cb7c99b5 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:52.016634 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4c36f804-9e58-4bec-a843-df30cb7c99b5 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:52.017331 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4c36f804-9e58-4bec-a843-df30cb7c99b5 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:52.017782 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4c36f804-9e58-4bec-a843-df30cb7c99b5 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:52.018238 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4c36f804-9e58-4bec-a843-df30cb7c99b5 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:52.149534 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-4c36f804-9e58-4bec-a843-df30cb7c99b5 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc98a4e7de34bc1ad629247458a1fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc621ea3ee54c5eafd4fbb93e357b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:52.158048 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-4c36f804-9e58-4bec-a843-df30cb7c99b5 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] 10.222.0.70 "GET /compute/v2.1/servers/0581f7e5-2719-4aa6-8f59-7522c3004ade" status: 200 len: 1506 microversion: 2.1 time: 0.154763 Aug 27 03:36:52.158629 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3161/6365] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:52 2022] GET /compute/v2.1/servers/0581f7e5-2719-4aa6-8f59-7522c3004ade => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:52.178776 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-748f0c01-fdf0-4651-aad4-eebfa919b35d tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:52.179453 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-748f0c01-fdf0-4651-aad4-eebfa919b35d tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] [instance: 0581f7e5-2719-4aa6-8f59-7522c3004ade] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:52.186097 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-748f0c01-fdf0-4651-aad4-eebfa919b35d tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:52.186599 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-748f0c01-fdf0-4651-aad4-eebfa919b35d tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:52.187052 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-748f0c01-fdf0-4651-aad4-eebfa919b35d tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:52.187766 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-748f0c01-fdf0-4651-aad4-eebfa919b35d tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:52.188235 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-748f0c01-fdf0-4651-aad4-eebfa919b35d tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:52.188739 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-748f0c01-fdf0-4651-aad4-eebfa919b35d tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:52.214765 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-748f0c01-fdf0-4651-aad4-eebfa919b35d tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] [instance: 0581f7e5-2719-4aa6-8f59-7522c3004ade] Going to try to terminate instance {{(pid=134051) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:36:52.304237 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-748f0c01-fdf0-4651-aad4-eebfa919b35d tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] 10.222.0.70 "DELETE /compute/v2.1/servers/0581f7e5-2719-4aa6-8f59-7522c3004ade" status: 204 len: 0 microversion: 2.1 time: 0.129316 Aug 27 03:36:52.304843 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3205/6366] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 03:36:52 2022] DELETE /compute/v2.1/servers/0581f7e5-2719-4aa6-8f59-7522c3004ade => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:36:52.358282 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0a4889a3-aee2-471a-92e4-563544ca933f tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-359616905", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "networks": [{"uuid": "041065b6-9ebe-45c2-af84-b2ea0d38459a"}]}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:36:52.419632 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.network.neutron [None req-0a4889a3-aee2-471a-92e4-563544ca933f tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] validate_networks() for [('041065b6-9ebe-45c2-af84-b2ea0d38459a', None, None, None, None, None)] {{(pid=134052) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:36:53.151716 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-0a4889a3-aee2-471a-92e4-563544ca933f tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Flavor limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:36:53.152296 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-0a4889a3-aee2-471a-92e4-563544ca933f tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Image limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:36:53.152689 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-0a4889a3-aee2-471a-92e4-563544ca933f tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Flavor pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:36:53.153363 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-0a4889a3-aee2-471a-92e4-563544ca933f tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Image pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:36:53.153974 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-0a4889a3-aee2-471a-92e4-563544ca933f tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:36:53.164167 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0a4889a3-aee2-471a-92e4-563544ca933f tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:53.164681 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0a4889a3-aee2-471a-92e4-563544ca933f tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:53.165118 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0a4889a3-aee2-471a-92e4-563544ca933f tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:53.166220 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0a4889a3-aee2-471a-92e4-563544ca933f tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:53.166907 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0a4889a3-aee2-471a-92e4-563544ca933f tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:53.167503 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0a4889a3-aee2-471a-92e4-563544ca933f tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:53.189563 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-0a4889a3-aee2-471a-92e4-563544ca933f tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Getting quotas for project afc621ea3ee54c5eafd4fbb93e357b3f. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:36:53.195018 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-0a4889a3-aee2-471a-92e4-563544ca933f tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Getting quotas for user 5fc98a4e7de34bc1ad629247458a1fe2 and project afc621ea3ee54c5eafd4fbb93e357b3f. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:36:53.207806 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-0a4889a3-aee2-471a-92e4-563544ca933f tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Going to run 1 instances... {{(pid=134052) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:36:53.210185 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-0a4889a3-aee2-471a-92e4-563544ca933f tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] [instance: aa25e047-d120-4c42-af0f-35bb86ce2027] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134052) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:36:53.263274 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-0a4889a3-aee2-471a-92e4-563544ca933f tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.908900 Aug 27 03:36:53.263943 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3162/6367] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 03:36:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 910 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:36:53.275554 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-425e4795-0cef-4feb-8eb3-a28b54a33237 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:53.276602 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-425e4795-0cef-4feb-8eb3-a28b54a33237 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] [instance: aa25e047-d120-4c42-af0f-35bb86ce2027] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:53.334020 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-425e4795-0cef-4feb-8eb3-a28b54a33237 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc98a4e7de34bc1ad629247458a1fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc621ea3ee54c5eafd4fbb93e357b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:53.341729 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-425e4795-0cef-4feb-8eb3-a28b54a33237 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] 10.222.0.70 "GET /compute/v2.1/servers/aa25e047-d120-4c42-af0f-35bb86ce2027" status: 200 len: 1217 microversion: 2.1 time: 0.070524 Aug 27 03:36:53.342361 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3206/6368] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:53 2022] GET /compute/v2.1/servers/aa25e047-d120-4c42-af0f-35bb86ce2027 => generated 1217 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:54.195449 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-74d27b1f-42fc-41b3-a709-12adc1137185 req-7f3dab48-8e85-4909-8d9f-fde334003442 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0581f7e5-2719-4aa6-8f59-7522c3004ade", "name": "network-vif-deleted", "tag": "2bdae32a-b581-4cff-b413-602f6d16bc7c"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:36:54.205317 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-74d27b1f-42fc-41b3-a709-12adc1137185 req-7f3dab48-8e85-4909-8d9f-fde334003442 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:54.205804 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-74d27b1f-42fc-41b3-a709-12adc1137185 req-7f3dab48-8e85-4909-8d9f-fde334003442 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:54.206245 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-74d27b1f-42fc-41b3-a709-12adc1137185 req-7f3dab48-8e85-4909-8d9f-fde334003442 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:54.217363 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-74d27b1f-42fc-41b3-a709-12adc1137185 req-7f3dab48-8e85-4909-8d9f-fde334003442 service nova] Creating event network-vif-deleted:2bdae32a-b581-4cff-b413-602f6d16bc7c for instance 0581f7e5-2719-4aa6-8f59-7522c3004ade on n-h1-852278-4 Aug 27 03:36:54.222563 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-74d27b1f-42fc-41b3-a709-12adc1137185 req-7f3dab48-8e85-4909-8d9f-fde334003442 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031956 Aug 27 03:36:54.223171 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3163/6369] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:36:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:36:54.361935 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8c268630-ada5-471c-9c5b-3b83c182d850 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:54.362586 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-8c268630-ada5-471c-9c5b-3b83c182d850 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] [instance: aa25e047-d120-4c42-af0f-35bb86ce2027] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:54.370033 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8c268630-ada5-471c-9c5b-3b83c182d850 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:54.370530 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8c268630-ada5-471c-9c5b-3b83c182d850 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:54.370985 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8c268630-ada5-471c-9c5b-3b83c182d850 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:54.371846 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8c268630-ada5-471c-9c5b-3b83c182d850 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:54.372259 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8c268630-ada5-471c-9c5b-3b83c182d850 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:54.372747 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8c268630-ada5-471c-9c5b-3b83c182d850 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:54.485779 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-8c268630-ada5-471c-9c5b-3b83c182d850 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc98a4e7de34bc1ad629247458a1fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc621ea3ee54c5eafd4fbb93e357b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:54.508850 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-8c268630-ada5-471c-9c5b-3b83c182d850 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] 10.222.0.70 "GET /compute/v2.1/servers/aa25e047-d120-4c42-af0f-35bb86ce2027" status: 200 len: 1277 microversion: 2.1 time: 0.150396 Aug 27 03:36:54.511383 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3207/6370] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:54 2022] GET /compute/v2.1/servers/aa25e047-d120-4c42-af0f-35bb86ce2027 => generated 1277 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:55.544199 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-1ac8f34c-f896-4acb-aed5-1233d90f42cc tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:55.544939 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-1ac8f34c-f896-4acb-aed5-1233d90f42cc tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] [instance: aa25e047-d120-4c42-af0f-35bb86ce2027] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:55.552355 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1ac8f34c-f896-4acb-aed5-1233d90f42cc tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:55.552859 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1ac8f34c-f896-4acb-aed5-1233d90f42cc tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:55.553313 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1ac8f34c-f896-4acb-aed5-1233d90f42cc tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:55.554032 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1ac8f34c-f896-4acb-aed5-1233d90f42cc tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:55.554514 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1ac8f34c-f896-4acb-aed5-1233d90f42cc tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:55.554939 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1ac8f34c-f896-4acb-aed5-1233d90f42cc tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:55.790450 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-1ac8f34c-f896-4acb-aed5-1233d90f42cc tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc98a4e7de34bc1ad629247458a1fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc621ea3ee54c5eafd4fbb93e357b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:55.798748 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-1ac8f34c-f896-4acb-aed5-1233d90f42cc tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] 10.222.0.70 "GET /compute/v2.1/servers/aa25e047-d120-4c42-af0f-35bb86ce2027" status: 200 len: 1317 microversion: 2.1 time: 0.260246 Aug 27 03:36:55.799360 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3164/6371] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:55 2022] GET /compute/v2.1/servers/aa25e047-d120-4c42-af0f-35bb86ce2027 => generated 1317 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:56.238393 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-153ab704-9f67-46eb-87b4-75e442ffb461 req-ff21172f-5e02-4c20-8e36-3407aa588576 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa25e047-d120-4c42-af0f-35bb86ce2027", "tag": "369bc0e9-f0e8-4b3d-b983-54b8974852f1"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:36:56.249452 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-153ab704-9f67-46eb-87b4-75e442ffb461 req-ff21172f-5e02-4c20-8e36-3407aa588576 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:56.250045 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-153ab704-9f67-46eb-87b4-75e442ffb461 req-ff21172f-5e02-4c20-8e36-3407aa588576 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:56.250781 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-153ab704-9f67-46eb-87b4-75e442ffb461 req-ff21172f-5e02-4c20-8e36-3407aa588576 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:56.262919 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-153ab704-9f67-46eb-87b4-75e442ffb461 req-ff21172f-5e02-4c20-8e36-3407aa588576 service nova] Creating event network-changed:369bc0e9-f0e8-4b3d-b983-54b8974852f1 for instance aa25e047-d120-4c42-af0f-35bb86ce2027 on n-h1-852278-4 Aug 27 03:36:56.267984 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-153ab704-9f67-46eb-87b4-75e442ffb461 req-ff21172f-5e02-4c20-8e36-3407aa588576 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033143 Aug 27 03:36:56.268629 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3208/6372] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:36:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:36:56.823997 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-cf6dcad8-14af-4d8f-8d16-464270f9da43 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:56.825067 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-cf6dcad8-14af-4d8f-8d16-464270f9da43 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] [instance: aa25e047-d120-4c42-af0f-35bb86ce2027] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:56.836598 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cf6dcad8-14af-4d8f-8d16-464270f9da43 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:56.837080 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cf6dcad8-14af-4d8f-8d16-464270f9da43 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:56.837511 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cf6dcad8-14af-4d8f-8d16-464270f9da43 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:56.838199 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cf6dcad8-14af-4d8f-8d16-464270f9da43 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:56.838646 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cf6dcad8-14af-4d8f-8d16-464270f9da43 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:56.839066 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cf6dcad8-14af-4d8f-8d16-464270f9da43 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:56.988799 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-cf6dcad8-14af-4d8f-8d16-464270f9da43 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc98a4e7de34bc1ad629247458a1fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc621ea3ee54c5eafd4fbb93e357b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:56.998205 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-cf6dcad8-14af-4d8f-8d16-464270f9da43 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] 10.222.0.70 "GET /compute/v2.1/servers/aa25e047-d120-4c42-af0f-35bb86ce2027" status: 200 len: 1317 microversion: 2.1 time: 0.180915 Aug 27 03:36:56.998811 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3165/6373] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:56 2022] GET /compute/v2.1/servers/aa25e047-d120-4c42-af0f-35bb86ce2027 => generated 1317 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:58.020014 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e5824417-8793-47ab-91e7-84cc64b63699 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:58.020862 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-e5824417-8793-47ab-91e7-84cc64b63699 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] [instance: aa25e047-d120-4c42-af0f-35bb86ce2027] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:58.029138 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e5824417-8793-47ab-91e7-84cc64b63699 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:58.029642 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e5824417-8793-47ab-91e7-84cc64b63699 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:58.030126 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e5824417-8793-47ab-91e7-84cc64b63699 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:58.030981 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e5824417-8793-47ab-91e7-84cc64b63699 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:58.031773 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e5824417-8793-47ab-91e7-84cc64b63699 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:58.032529 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e5824417-8793-47ab-91e7-84cc64b63699 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:58.169006 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e5824417-8793-47ab-91e7-84cc64b63699 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc98a4e7de34bc1ad629247458a1fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc621ea3ee54c5eafd4fbb93e357b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:58.177344 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e5824417-8793-47ab-91e7-84cc64b63699 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] 10.222.0.70 "GET /compute/v2.1/servers/aa25e047-d120-4c42-af0f-35bb86ce2027" status: 200 len: 1317 microversion: 2.1 time: 0.161779 Aug 27 03:36:58.178131 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3209/6374] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:58 2022] GET /compute/v2.1/servers/aa25e047-d120-4c42-af0f-35bb86ce2027 => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:59.199374 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-96ce4779-8a3f-4ada-9fd9-00bdbf6feb60 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:59.199968 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-96ce4779-8a3f-4ada-9fd9-00bdbf6feb60 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] [instance: aa25e047-d120-4c42-af0f-35bb86ce2027] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:59.208658 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-96ce4779-8a3f-4ada-9fd9-00bdbf6feb60 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:59.209225 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-96ce4779-8a3f-4ada-9fd9-00bdbf6feb60 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:59.209758 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-96ce4779-8a3f-4ada-9fd9-00bdbf6feb60 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:59.210786 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-96ce4779-8a3f-4ada-9fd9-00bdbf6feb60 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:59.211246 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-96ce4779-8a3f-4ada-9fd9-00bdbf6feb60 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:59.211683 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-96ce4779-8a3f-4ada-9fd9-00bdbf6feb60 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:59.364212 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-96ce4779-8a3f-4ada-9fd9-00bdbf6feb60 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc98a4e7de34bc1ad629247458a1fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc621ea3ee54c5eafd4fbb93e357b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:59.372563 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-96ce4779-8a3f-4ada-9fd9-00bdbf6feb60 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] 10.222.0.70 "GET /compute/v2.1/servers/aa25e047-d120-4c42-af0f-35bb86ce2027" status: 200 len: 1317 microversion: 2.1 time: 0.177815 Aug 27 03:36:59.373152 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3166/6375] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:59 2022] GET /compute/v2.1/servers/aa25e047-d120-4c42-af0f-35bb86ce2027 => generated 1317 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:00.397936 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-1faa7394-83c6-487b-87bf-d9022e51068c tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:00.398938 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-1faa7394-83c6-487b-87bf-d9022e51068c tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] [instance: aa25e047-d120-4c42-af0f-35bb86ce2027] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:00.410429 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1faa7394-83c6-487b-87bf-d9022e51068c tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:00.411265 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1faa7394-83c6-487b-87bf-d9022e51068c tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:00.412016 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1faa7394-83c6-487b-87bf-d9022e51068c tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:00.413417 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1faa7394-83c6-487b-87bf-d9022e51068c tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:00.414120 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1faa7394-83c6-487b-87bf-d9022e51068c tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:00.414558 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1faa7394-83c6-487b-87bf-d9022e51068c tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:00.557077 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-1faa7394-83c6-487b-87bf-d9022e51068c tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc98a4e7de34bc1ad629247458a1fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc621ea3ee54c5eafd4fbb93e357b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:00.565285 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-1faa7394-83c6-487b-87bf-d9022e51068c tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] 10.222.0.70 "GET /compute/v2.1/servers/aa25e047-d120-4c42-af0f-35bb86ce2027" status: 200 len: 1317 microversion: 2.1 time: 0.173848 Aug 27 03:37:00.565861 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3210/6376] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:00 2022] GET /compute/v2.1/servers/aa25e047-d120-4c42-af0f-35bb86ce2027 => generated 1317 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:01.590151 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-bf062276-e2e3-4c47-b90c-f5ae60b7e6dd tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:01.591124 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-bf062276-e2e3-4c47-b90c-f5ae60b7e6dd tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] [instance: aa25e047-d120-4c42-af0f-35bb86ce2027] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:01.602471 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bf062276-e2e3-4c47-b90c-f5ae60b7e6dd tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:01.602960 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bf062276-e2e3-4c47-b90c-f5ae60b7e6dd tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:01.603395 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bf062276-e2e3-4c47-b90c-f5ae60b7e6dd tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:01.604090 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bf062276-e2e3-4c47-b90c-f5ae60b7e6dd tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:01.604570 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bf062276-e2e3-4c47-b90c-f5ae60b7e6dd tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:01.604988 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bf062276-e2e3-4c47-b90c-f5ae60b7e6dd tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:01.743325 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-bf062276-e2e3-4c47-b90c-f5ae60b7e6dd tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc98a4e7de34bc1ad629247458a1fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc621ea3ee54c5eafd4fbb93e357b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:01.751266 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-bf062276-e2e3-4c47-b90c-f5ae60b7e6dd tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] 10.222.0.70 "GET /compute/v2.1/servers/aa25e047-d120-4c42-af0f-35bb86ce2027" status: 200 len: 1317 microversion: 2.1 time: 0.167677 Aug 27 03:37:01.751850 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3167/6377] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:01 2022] GET /compute/v2.1/servers/aa25e047-d120-4c42-af0f-35bb86ce2027 => generated 1317 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:01.816880 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-251476d9-3a3b-420f-8cd5-401783fd0058 req-ea7ed742-d1c5-4931-a33b-1a5c324fa9cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa25e047-d120-4c42-af0f-35bb86ce2027", "name": "network-vif-plugged", "status": "completed", "tag": "369bc0e9-f0e8-4b3d-b983-54b8974852f1"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:37:01.827505 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-251476d9-3a3b-420f-8cd5-401783fd0058 req-ea7ed742-d1c5-4931-a33b-1a5c324fa9cb service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:01.827980 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-251476d9-3a3b-420f-8cd5-401783fd0058 req-ea7ed742-d1c5-4931-a33b-1a5c324fa9cb service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:01.828462 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-251476d9-3a3b-420f-8cd5-401783fd0058 req-ea7ed742-d1c5-4931-a33b-1a5c324fa9cb service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:01.839975 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-251476d9-3a3b-420f-8cd5-401783fd0058 req-ea7ed742-d1c5-4931-a33b-1a5c324fa9cb service nova] Creating event network-vif-plugged:369bc0e9-f0e8-4b3d-b983-54b8974852f1 for instance aa25e047-d120-4c42-af0f-35bb86ce2027 on n-h1-852278-4 Aug 27 03:37:01.845108 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-251476d9-3a3b-420f-8cd5-401783fd0058 req-ea7ed742-d1c5-4931-a33b-1a5c324fa9cb service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032306 Aug 27 03:37:01.845752 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3211/6378] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:37:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:37:02.772354 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a8776556-ce59-413c-9e28-5ec498d47ea4 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:02.773007 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a8776556-ce59-413c-9e28-5ec498d47ea4 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] [instance: aa25e047-d120-4c42-af0f-35bb86ce2027] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:02.779860 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a8776556-ce59-413c-9e28-5ec498d47ea4 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:02.780436 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a8776556-ce59-413c-9e28-5ec498d47ea4 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:02.780869 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a8776556-ce59-413c-9e28-5ec498d47ea4 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:02.781556 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a8776556-ce59-413c-9e28-5ec498d47ea4 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:02.781998 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a8776556-ce59-413c-9e28-5ec498d47ea4 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:02.782411 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a8776556-ce59-413c-9e28-5ec498d47ea4 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:02.917712 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-a8776556-ce59-413c-9e28-5ec498d47ea4 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc98a4e7de34bc1ad629247458a1fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc621ea3ee54c5eafd4fbb93e357b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:02.927331 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a8776556-ce59-413c-9e28-5ec498d47ea4 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] 10.222.0.70 "GET /compute/v2.1/servers/aa25e047-d120-4c42-af0f-35bb86ce2027" status: 200 len: 1317 microversion: 2.1 time: 0.158677 Aug 27 03:37:02.928170 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3168/6379] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:02 2022] GET /compute/v2.1/servers/aa25e047-d120-4c42-af0f-35bb86ce2027 => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:03.948208 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:37:03.952613 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-bd021ecb-6069-45d9-a074-d36386e13661 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:03.953332 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-bd021ecb-6069-45d9-a074-d36386e13661 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] [instance: aa25e047-d120-4c42-af0f-35bb86ce2027] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:03.959917 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bd021ecb-6069-45d9-a074-d36386e13661 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:03.960447 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bd021ecb-6069-45d9-a074-d36386e13661 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:03.960901 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bd021ecb-6069-45d9-a074-d36386e13661 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:03.961609 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bd021ecb-6069-45d9-a074-d36386e13661 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:03.962083 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bd021ecb-6069-45d9-a074-d36386e13661 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:03.962523 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bd021ecb-6069-45d9-a074-d36386e13661 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:04.098940 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-bd021ecb-6069-45d9-a074-d36386e13661 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc98a4e7de34bc1ad629247458a1fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc621ea3ee54c5eafd4fbb93e357b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:04.107671 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-bd021ecb-6069-45d9-a074-d36386e13661 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] 10.222.0.70 "GET /compute/v2.1/servers/aa25e047-d120-4c42-af0f-35bb86ce2027" status: 200 len: 1507 microversion: 2.1 time: 0.161361 Aug 27 03:37:04.108256 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3212/6380] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:03 2022] GET /compute/v2.1/servers/aa25e047-d120-4c42-af0f-35bb86ce2027 => generated 1507 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:04.127993 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6547a684-196b-41bf-b8cc-fcfd6f173eac tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:04.128639 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-6547a684-196b-41bf-b8cc-fcfd6f173eac tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] [instance: aa25e047-d120-4c42-af0f-35bb86ce2027] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:04.130816 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:37:04.131622 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=10 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:37:04.138342 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6547a684-196b-41bf-b8cc-fcfd6f173eac tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:04.138824 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6547a684-196b-41bf-b8cc-fcfd6f173eac tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:04.139257 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6547a684-196b-41bf-b8cc-fcfd6f173eac tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:04.139934 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6547a684-196b-41bf-b8cc-fcfd6f173eac tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:04.140469 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6547a684-196b-41bf-b8cc-fcfd6f173eac tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:04.140869 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6547a684-196b-41bf-b8cc-fcfd6f173eac tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:04.287837 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-6547a684-196b-41bf-b8cc-fcfd6f173eac tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc98a4e7de34bc1ad629247458a1fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc621ea3ee54c5eafd4fbb93e357b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:04.297026 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-6547a684-196b-41bf-b8cc-fcfd6f173eac tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] 10.222.0.70 "GET /compute/v2.1/servers/aa25e047-d120-4c42-af0f-35bb86ce2027" status: 200 len: 1507 microversion: 2.1 time: 0.172942 Aug 27 03:37:04.297642 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3169/6381] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:04 2022] GET /compute/v2.1/servers/aa25e047-d120-4c42-af0f-35bb86ce2027 => generated 1507 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:04.317422 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-dc1e07e6-4f97-4cbc-abd4-52eea3701745 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:37:04.319733 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-dc1e07e6-4f97-4cbc-abd4-52eea3701745 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] [instance: aa25e047-d120-4c42-af0f-35bb86ce2027] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:04.325827 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dc1e07e6-4f97-4cbc-abd4-52eea3701745 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:04.326322 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dc1e07e6-4f97-4cbc-abd4-52eea3701745 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:04.326800 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dc1e07e6-4f97-4cbc-abd4-52eea3701745 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:04.327495 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dc1e07e6-4f97-4cbc-abd4-52eea3701745 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:04.327992 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dc1e07e6-4f97-4cbc-abd4-52eea3701745 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:04.328447 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dc1e07e6-4f97-4cbc-abd4-52eea3701745 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:04.348491 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:37:04.358245 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-dc1e07e6-4f97-4cbc-abd4-52eea3701745 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '5fc98a4e7de34bc1ad629247458a1fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc621ea3ee54c5eafd4fbb93e357b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:04.364264 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-dc1e07e6-4f97-4cbc-abd4-52eea3701745 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] [instance: aa25e047-d120-4c42-af0f-35bb86ce2027] Old instance type m1.heat2, new instance type m1.heat {{(pid=134051) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 27 03:37:04.370980 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-dc1e07e6-4f97-4cbc-abd4-52eea3701745 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Flavor limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:37:04.371408 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-dc1e07e6-4f97-4cbc-abd4-52eea3701745 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Image limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:37:04.371888 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-dc1e07e6-4f97-4cbc-abd4-52eea3701745 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Flavor pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:37:04.372320 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-dc1e07e6-4f97-4cbc-abd4-52eea3701745 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Image pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:37:04.372754 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-dc1e07e6-4f97-4cbc-abd4-52eea3701745 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:37:04.444282 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-dc1e07e6-4f97-4cbc-abd4-52eea3701745 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] 10.222.0.70 "POST /compute/v2.1/servers/aa25e047-d120-4c42-af0f-35bb86ce2027/action" status: 202 len: 0 microversion: 2.1 time: 0.130717 Aug 27 03:37:04.444936 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3213/6382] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:37:04 2022] POST /compute/v2.1/servers/aa25e047-d120-4c42-af0f-35bb86ce2027/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:37:04.453181 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-99db5946-9d31-4e7c-a30d-b216ca2f5ab0 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:04.453767 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-99db5946-9d31-4e7c-a30d-b216ca2f5ab0 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] [instance: aa25e047-d120-4c42-af0f-35bb86ce2027] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:04.459819 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-99db5946-9d31-4e7c-a30d-b216ca2f5ab0 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:04.460303 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-99db5946-9d31-4e7c-a30d-b216ca2f5ab0 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:04.460970 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-99db5946-9d31-4e7c-a30d-b216ca2f5ab0 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:04.461676 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-99db5946-9d31-4e7c-a30d-b216ca2f5ab0 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:04.462076 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-99db5946-9d31-4e7c-a30d-b216ca2f5ab0 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:04.462717 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-99db5946-9d31-4e7c-a30d-b216ca2f5ab0 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:04.621639 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-99db5946-9d31-4e7c-a30d-b216ca2f5ab0 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc98a4e7de34bc1ad629247458a1fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc621ea3ee54c5eafd4fbb93e357b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:04.629874 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-99db5946-9d31-4e7c-a30d-b216ca2f5ab0 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] 10.222.0.70 "GET /compute/v2.1/servers/aa25e047-d120-4c42-af0f-35bb86ce2027" status: 200 len: 1514 microversion: 2.1 time: 0.180429 Aug 27 03:37:04.630437 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3170/6383] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:04 2022] GET /compute/v2.1/servers/aa25e047-d120-4c42-af0f-35bb86ce2027 => generated 1514 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:05.650914 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d2661513-48de-4fa1-b299-f68973c4f47d tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:05.651543 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d2661513-48de-4fa1-b299-f68973c4f47d tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] [instance: aa25e047-d120-4c42-af0f-35bb86ce2027] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:05.659088 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d2661513-48de-4fa1-b299-f68973c4f47d tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:05.659583 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d2661513-48de-4fa1-b299-f68973c4f47d tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:05.660809 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d2661513-48de-4fa1-b299-f68973c4f47d tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:05.660988 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d2661513-48de-4fa1-b299-f68973c4f47d tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:05.661624 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d2661513-48de-4fa1-b299-f68973c4f47d tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:05.662238 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d2661513-48de-4fa1-b299-f68973c4f47d tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:05.886772 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d2661513-48de-4fa1-b299-f68973c4f47d tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc98a4e7de34bc1ad629247458a1fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc621ea3ee54c5eafd4fbb93e357b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:05.894671 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d2661513-48de-4fa1-b299-f68973c4f47d tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] 10.222.0.70 "GET /compute/v2.1/servers/aa25e047-d120-4c42-af0f-35bb86ce2027" status: 200 len: 1514 microversion: 2.1 time: 0.247815 Aug 27 03:37:05.895272 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3214/6384] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:05 2022] GET /compute/v2.1/servers/aa25e047-d120-4c42-af0f-35bb86ce2027 => generated 1514 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:06.919347 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-52f0404e-657e-4f2a-b147-454ce185f860 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:06.920087 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-52f0404e-657e-4f2a-b147-454ce185f860 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] [instance: aa25e047-d120-4c42-af0f-35bb86ce2027] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:06.929541 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-52f0404e-657e-4f2a-b147-454ce185f860 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:06.930187 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-52f0404e-657e-4f2a-b147-454ce185f860 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:06.930733 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-52f0404e-657e-4f2a-b147-454ce185f860 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:06.931654 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-52f0404e-657e-4f2a-b147-454ce185f860 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:06.932192 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-52f0404e-657e-4f2a-b147-454ce185f860 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:06.932764 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-52f0404e-657e-4f2a-b147-454ce185f860 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:07.076897 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-52f0404e-657e-4f2a-b147-454ce185f860 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc98a4e7de34bc1ad629247458a1fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc621ea3ee54c5eafd4fbb93e357b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:07.085154 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-52f0404e-657e-4f2a-b147-454ce185f860 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] 10.222.0.70 "GET /compute/v2.1/servers/aa25e047-d120-4c42-af0f-35bb86ce2027" status: 200 len: 1519 microversion: 2.1 time: 0.171652 Aug 27 03:37:07.085742 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3171/6385] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:06 2022] GET /compute/v2.1/servers/aa25e047-d120-4c42-af0f-35bb86ce2027 => generated 1519 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:08.107076 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3c444abc-2bd5-491a-aa6a-731404a6b27b tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:08.107705 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-3c444abc-2bd5-491a-aa6a-731404a6b27b tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] [instance: aa25e047-d120-4c42-af0f-35bb86ce2027] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:08.114981 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3c444abc-2bd5-491a-aa6a-731404a6b27b tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:08.115483 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3c444abc-2bd5-491a-aa6a-731404a6b27b tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:08.115936 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3c444abc-2bd5-491a-aa6a-731404a6b27b tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:08.116676 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3c444abc-2bd5-491a-aa6a-731404a6b27b tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:08.117161 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3c444abc-2bd5-491a-aa6a-731404a6b27b tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:08.117598 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3c444abc-2bd5-491a-aa6a-731404a6b27b tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:08.256735 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-3c444abc-2bd5-491a-aa6a-731404a6b27b tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc98a4e7de34bc1ad629247458a1fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc621ea3ee54c5eafd4fbb93e357b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:08.265721 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-3c444abc-2bd5-491a-aa6a-731404a6b27b tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] 10.222.0.70 "GET /compute/v2.1/servers/aa25e047-d120-4c42-af0f-35bb86ce2027" status: 200 len: 1519 microversion: 2.1 time: 0.162886 Aug 27 03:37:08.266317 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3215/6386] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:08 2022] GET /compute/v2.1/servers/aa25e047-d120-4c42-af0f-35bb86ce2027 => generated 1519 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:09.290163 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-692072e0-6b2c-421b-92b3-98134af54665 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:09.291113 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-692072e0-6b2c-421b-92b3-98134af54665 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] [instance: aa25e047-d120-4c42-af0f-35bb86ce2027] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:09.300432 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-692072e0-6b2c-421b-92b3-98134af54665 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:09.301147 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-692072e0-6b2c-421b-92b3-98134af54665 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:09.301777 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-692072e0-6b2c-421b-92b3-98134af54665 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:09.302832 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-692072e0-6b2c-421b-92b3-98134af54665 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:09.303517 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-692072e0-6b2c-421b-92b3-98134af54665 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:09.304207 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-692072e0-6b2c-421b-92b3-98134af54665 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:09.460426 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-692072e0-6b2c-421b-92b3-98134af54665 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc98a4e7de34bc1ad629247458a1fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc621ea3ee54c5eafd4fbb93e357b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:09.468740 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-692072e0-6b2c-421b-92b3-98134af54665 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] 10.222.0.70 "GET /compute/v2.1/servers/aa25e047-d120-4c42-af0f-35bb86ce2027" status: 200 len: 1519 microversion: 2.1 time: 0.185099 Aug 27 03:37:09.469323 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3172/6387] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:09 2022] GET /compute/v2.1/servers/aa25e047-d120-4c42-af0f-35bb86ce2027 => generated 1519 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:10.494085 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-6b1fd610-a0cf-4b9b-b373-f039f51ce381 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:10.495225 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-6b1fd610-a0cf-4b9b-b373-f039f51ce381 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] [instance: aa25e047-d120-4c42-af0f-35bb86ce2027] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:10.507792 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6b1fd610-a0cf-4b9b-b373-f039f51ce381 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:10.508691 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6b1fd610-a0cf-4b9b-b373-f039f51ce381 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:10.509445 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6b1fd610-a0cf-4b9b-b373-f039f51ce381 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:10.510458 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6b1fd610-a0cf-4b9b-b373-f039f51ce381 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:10.510952 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6b1fd610-a0cf-4b9b-b373-f039f51ce381 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:10.511389 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6b1fd610-a0cf-4b9b-b373-f039f51ce381 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:10.653650 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-6b1fd610-a0cf-4b9b-b373-f039f51ce381 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc98a4e7de34bc1ad629247458a1fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc621ea3ee54c5eafd4fbb93e357b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:10.661923 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-6b1fd610-a0cf-4b9b-b373-f039f51ce381 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] 10.222.0.70 "GET /compute/v2.1/servers/aa25e047-d120-4c42-af0f-35bb86ce2027" status: 200 len: 1519 microversion: 2.1 time: 0.174622 Aug 27 03:37:10.662622 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3216/6388] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:10 2022] GET /compute/v2.1/servers/aa25e047-d120-4c42-af0f-35bb86ce2027 => generated 1519 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:11.689625 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b54e1009-f4c4-4fde-8cbd-eb65748a5af1 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:11.691458 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b54e1009-f4c4-4fde-8cbd-eb65748a5af1 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] [instance: aa25e047-d120-4c42-af0f-35bb86ce2027] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:11.703509 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b54e1009-f4c4-4fde-8cbd-eb65748a5af1 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:11.704298 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b54e1009-f4c4-4fde-8cbd-eb65748a5af1 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:11.705058 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b54e1009-f4c4-4fde-8cbd-eb65748a5af1 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:11.706258 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b54e1009-f4c4-4fde-8cbd-eb65748a5af1 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:11.706991 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b54e1009-f4c4-4fde-8cbd-eb65748a5af1 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:11.707681 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b54e1009-f4c4-4fde-8cbd-eb65748a5af1 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:11.713878 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:37:11.858832 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b54e1009-f4c4-4fde-8cbd-eb65748a5af1 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc98a4e7de34bc1ad629247458a1fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc621ea3ee54c5eafd4fbb93e357b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:11.867422 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b54e1009-f4c4-4fde-8cbd-eb65748a5af1 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] 10.222.0.70 "GET /compute/v2.1/servers/aa25e047-d120-4c42-af0f-35bb86ce2027" status: 200 len: 1519 microversion: 2.1 time: 0.186085 Aug 27 03:37:11.867984 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3173/6389] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:11 2022] GET /compute/v2.1/servers/aa25e047-d120-4c42-af0f-35bb86ce2027 => generated 1519 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:12.891939 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f921e328-057d-499f-9f6e-9ea45e1124f8 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:12.893012 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-f921e328-057d-499f-9f6e-9ea45e1124f8 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] [instance: aa25e047-d120-4c42-af0f-35bb86ce2027] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:12.905233 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f921e328-057d-499f-9f6e-9ea45e1124f8 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:12.906084 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f921e328-057d-499f-9f6e-9ea45e1124f8 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:12.906837 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f921e328-057d-499f-9f6e-9ea45e1124f8 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:12.908020 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f921e328-057d-499f-9f6e-9ea45e1124f8 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:12.908844 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f921e328-057d-499f-9f6e-9ea45e1124f8 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:12.909585 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f921e328-057d-499f-9f6e-9ea45e1124f8 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:13.063042 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-f921e328-057d-499f-9f6e-9ea45e1124f8 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc98a4e7de34bc1ad629247458a1fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc621ea3ee54c5eafd4fbb93e357b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:13.071624 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-f921e328-057d-499f-9f6e-9ea45e1124f8 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] 10.222.0.70 "GET /compute/v2.1/servers/aa25e047-d120-4c42-af0f-35bb86ce2027" status: 200 len: 1519 microversion: 2.1 time: 0.186241 Aug 27 03:37:13.072208 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3217/6390] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:12 2022] GET /compute/v2.1/servers/aa25e047-d120-4c42-af0f-35bb86ce2027 => generated 1519 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:14.096725 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3693d2c6-9b2e-4bb0-8d90-ba7eda480ae5 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:14.097541 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-3693d2c6-9b2e-4bb0-8d90-ba7eda480ae5 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] [instance: aa25e047-d120-4c42-af0f-35bb86ce2027] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:14.107245 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3693d2c6-9b2e-4bb0-8d90-ba7eda480ae5 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:14.107820 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3693d2c6-9b2e-4bb0-8d90-ba7eda480ae5 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:14.108360 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3693d2c6-9b2e-4bb0-8d90-ba7eda480ae5 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:14.109309 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3693d2c6-9b2e-4bb0-8d90-ba7eda480ae5 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:14.109980 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3693d2c6-9b2e-4bb0-8d90-ba7eda480ae5 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:14.110492 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3693d2c6-9b2e-4bb0-8d90-ba7eda480ae5 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:14.250589 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-3693d2c6-9b2e-4bb0-8d90-ba7eda480ae5 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc98a4e7de34bc1ad629247458a1fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc621ea3ee54c5eafd4fbb93e357b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:14.262183 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-3693d2c6-9b2e-4bb0-8d90-ba7eda480ae5 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] 10.222.0.70 "GET /compute/v2.1/servers/aa25e047-d120-4c42-af0f-35bb86ce2027" status: 200 len: 1519 microversion: 2.1 time: 0.171851 Aug 27 03:37:14.262776 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3174/6391] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:14 2022] GET /compute/v2.1/servers/aa25e047-d120-4c42-af0f-35bb86ce2027 => generated 1519 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:15.282638 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a843aa7c-c2c6-401c-826d-b54426a77a96 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:15.283285 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-a843aa7c-c2c6-401c-826d-b54426a77a96 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] [instance: aa25e047-d120-4c42-af0f-35bb86ce2027] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:15.290780 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a843aa7c-c2c6-401c-826d-b54426a77a96 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:15.291305 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a843aa7c-c2c6-401c-826d-b54426a77a96 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:15.291759 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a843aa7c-c2c6-401c-826d-b54426a77a96 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:15.292516 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a843aa7c-c2c6-401c-826d-b54426a77a96 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:15.292982 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a843aa7c-c2c6-401c-826d-b54426a77a96 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:15.293422 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a843aa7c-c2c6-401c-826d-b54426a77a96 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:15.436826 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-a843aa7c-c2c6-401c-826d-b54426a77a96 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc98a4e7de34bc1ad629247458a1fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc621ea3ee54c5eafd4fbb93e357b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:15.445180 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a843aa7c-c2c6-401c-826d-b54426a77a96 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] 10.222.0.70 "GET /compute/v2.1/servers/aa25e047-d120-4c42-af0f-35bb86ce2027" status: 200 len: 1519 microversion: 2.1 time: 0.166634 Aug 27 03:37:15.445764 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3218/6392] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:15 2022] GET /compute/v2.1/servers/aa25e047-d120-4c42-af0f-35bb86ce2027 => generated 1519 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:16.469249 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-05c56f6a-0d26-454e-9e78-76d4f35c8082 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:16.469936 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-05c56f6a-0d26-454e-9e78-76d4f35c8082 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] [instance: aa25e047-d120-4c42-af0f-35bb86ce2027] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:16.472786 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=4 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:37:16.478600 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-05c56f6a-0d26-454e-9e78-76d4f35c8082 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:16.479088 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-05c56f6a-0d26-454e-9e78-76d4f35c8082 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:16.479522 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-05c56f6a-0d26-454e-9e78-76d4f35c8082 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:16.480229 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-05c56f6a-0d26-454e-9e78-76d4f35c8082 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:16.480712 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-05c56f6a-0d26-454e-9e78-76d4f35c8082 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:16.481137 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-05c56f6a-0d26-454e-9e78-76d4f35c8082 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:16.621617 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-05c56f6a-0d26-454e-9e78-76d4f35c8082 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc98a4e7de34bc1ad629247458a1fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc621ea3ee54c5eafd4fbb93e357b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:16.630267 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-05c56f6a-0d26-454e-9e78-76d4f35c8082 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] 10.222.0.70 "GET /compute/v2.1/servers/aa25e047-d120-4c42-af0f-35bb86ce2027" status: 200 len: 1519 microversion: 2.1 time: 0.165852 Aug 27 03:37:16.630858 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3175/6393] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:16 2022] GET /compute/v2.1/servers/aa25e047-d120-4c42-af0f-35bb86ce2027 => generated 1519 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:17.655476 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-1321d5ac-078e-4797-bfb6-f278b4796ef8 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:17.656553 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-1321d5ac-078e-4797-bfb6-f278b4796ef8 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] [instance: aa25e047-d120-4c42-af0f-35bb86ce2027] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:17.661090 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:37:17.670151 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1321d5ac-078e-4797-bfb6-f278b4796ef8 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:17.670659 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1321d5ac-078e-4797-bfb6-f278b4796ef8 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:17.671407 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1321d5ac-078e-4797-bfb6-f278b4796ef8 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:17.672175 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1321d5ac-078e-4797-bfb6-f278b4796ef8 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:17.672674 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1321d5ac-078e-4797-bfb6-f278b4796ef8 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:17.673142 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1321d5ac-078e-4797-bfb6-f278b4796ef8 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:17.803565 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-1321d5ac-078e-4797-bfb6-f278b4796ef8 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc98a4e7de34bc1ad629247458a1fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc621ea3ee54c5eafd4fbb93e357b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:17.811673 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-1321d5ac-078e-4797-bfb6-f278b4796ef8 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] 10.222.0.70 "GET /compute/v2.1/servers/aa25e047-d120-4c42-af0f-35bb86ce2027" status: 200 len: 1519 microversion: 2.1 time: 0.162941 Aug 27 03:37:17.812273 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3219/6394] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:17 2022] GET /compute/v2.1/servers/aa25e047-d120-4c42-af0f-35bb86ce2027 => generated 1519 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:18.843104 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9e77f6fc-bd48-4ae1-bfe1-c580f80630c5 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:18.844037 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-9e77f6fc-bd48-4ae1-bfe1-c580f80630c5 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] [instance: aa25e047-d120-4c42-af0f-35bb86ce2027] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:18.850918 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9e77f6fc-bd48-4ae1-bfe1-c580f80630c5 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:18.851404 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9e77f6fc-bd48-4ae1-bfe1-c580f80630c5 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:18.851837 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9e77f6fc-bd48-4ae1-bfe1-c580f80630c5 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:18.852573 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9e77f6fc-bd48-4ae1-bfe1-c580f80630c5 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:18.853022 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9e77f6fc-bd48-4ae1-bfe1-c580f80630c5 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:18.853445 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9e77f6fc-bd48-4ae1-bfe1-c580f80630c5 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:18.990119 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-9e77f6fc-bd48-4ae1-bfe1-c580f80630c5 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc98a4e7de34bc1ad629247458a1fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc621ea3ee54c5eafd4fbb93e357b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:18.998242 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9e77f6fc-bd48-4ae1-bfe1-c580f80630c5 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] 10.222.0.70 "GET /compute/v2.1/servers/aa25e047-d120-4c42-af0f-35bb86ce2027" status: 200 len: 1519 microversion: 2.1 time: 0.161696 Aug 27 03:37:18.998825 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3176/6395] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:18 2022] GET /compute/v2.1/servers/aa25e047-d120-4c42-af0f-35bb86ce2027 => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:20.019963 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e8f8aeb1-cb50-4b04-968e-95f96e2fa9d3 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:20.020617 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-e8f8aeb1-cb50-4b04-968e-95f96e2fa9d3 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] [instance: aa25e047-d120-4c42-af0f-35bb86ce2027] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:20.028225 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e8f8aeb1-cb50-4b04-968e-95f96e2fa9d3 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:20.028779 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e8f8aeb1-cb50-4b04-968e-95f96e2fa9d3 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:20.029252 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e8f8aeb1-cb50-4b04-968e-95f96e2fa9d3 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:20.029988 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e8f8aeb1-cb50-4b04-968e-95f96e2fa9d3 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:20.030468 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e8f8aeb1-cb50-4b04-968e-95f96e2fa9d3 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:20.030923 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e8f8aeb1-cb50-4b04-968e-95f96e2fa9d3 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:20.165676 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e8f8aeb1-cb50-4b04-968e-95f96e2fa9d3 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc98a4e7de34bc1ad629247458a1fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc621ea3ee54c5eafd4fbb93e357b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:20.181332 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e8f8aeb1-cb50-4b04-968e-95f96e2fa9d3 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] 10.222.0.70 "GET /compute/v2.1/servers/aa25e047-d120-4c42-af0f-35bb86ce2027" status: 200 len: 1519 microversion: 2.1 time: 0.164546 Aug 27 03:37:20.182681 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3220/6396] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:20 2022] GET /compute/v2.1/servers/aa25e047-d120-4c42-af0f-35bb86ce2027 => generated 1519 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:21.211161 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8cecd28f-a7a7-4e15-b287-9ad57c8a9ad4 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:21.211784 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-8cecd28f-a7a7-4e15-b287-9ad57c8a9ad4 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] [instance: aa25e047-d120-4c42-af0f-35bb86ce2027] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:21.219355 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8cecd28f-a7a7-4e15-b287-9ad57c8a9ad4 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:21.219842 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8cecd28f-a7a7-4e15-b287-9ad57c8a9ad4 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:21.220272 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8cecd28f-a7a7-4e15-b287-9ad57c8a9ad4 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:21.221063 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8cecd28f-a7a7-4e15-b287-9ad57c8a9ad4 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:21.221513 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8cecd28f-a7a7-4e15-b287-9ad57c8a9ad4 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:21.221931 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8cecd28f-a7a7-4e15-b287-9ad57c8a9ad4 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:21.364461 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-8cecd28f-a7a7-4e15-b287-9ad57c8a9ad4 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc98a4e7de34bc1ad629247458a1fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc621ea3ee54c5eafd4fbb93e357b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:21.372614 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-8cecd28f-a7a7-4e15-b287-9ad57c8a9ad4 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] 10.222.0.70 "GET /compute/v2.1/servers/aa25e047-d120-4c42-af0f-35bb86ce2027" status: 200 len: 1519 microversion: 2.1 time: 0.165285 Aug 27 03:37:21.373431 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3177/6397] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:21 2022] GET /compute/v2.1/servers/aa25e047-d120-4c42-af0f-35bb86ce2027 => generated 1519 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:22.397363 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-390d3959-31c2-49a7-bab7-0b4a00613346 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:22.398371 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-390d3959-31c2-49a7-bab7-0b4a00613346 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] [instance: aa25e047-d120-4c42-af0f-35bb86ce2027] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:22.407762 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-390d3959-31c2-49a7-bab7-0b4a00613346 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:22.408269 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-390d3959-31c2-49a7-bab7-0b4a00613346 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:22.408745 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-390d3959-31c2-49a7-bab7-0b4a00613346 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:22.409457 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-390d3959-31c2-49a7-bab7-0b4a00613346 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:22.409923 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-390d3959-31c2-49a7-bab7-0b4a00613346 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:22.410358 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-390d3959-31c2-49a7-bab7-0b4a00613346 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:22.549321 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-390d3959-31c2-49a7-bab7-0b4a00613346 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc98a4e7de34bc1ad629247458a1fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc621ea3ee54c5eafd4fbb93e357b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:22.561003 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-390d3959-31c2-49a7-bab7-0b4a00613346 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] 10.222.0.70 "GET /compute/v2.1/servers/aa25e047-d120-4c42-af0f-35bb86ce2027" status: 200 len: 1519 microversion: 2.1 time: 0.170099 Aug 27 03:37:22.561582 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3221/6398] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:22 2022] GET /compute/v2.1/servers/aa25e047-d120-4c42-af0f-35bb86ce2027 => generated 1519 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:23.585683 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-7e31890c-e490-4c6f-bd3b-d0805e2b71f8 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:23.586541 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-7e31890c-e490-4c6f-bd3b-d0805e2b71f8 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] [instance: aa25e047-d120-4c42-af0f-35bb86ce2027] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:23.598856 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7e31890c-e490-4c6f-bd3b-d0805e2b71f8 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:23.599656 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7e31890c-e490-4c6f-bd3b-d0805e2b71f8 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:23.600409 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7e31890c-e490-4c6f-bd3b-d0805e2b71f8 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:23.601612 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7e31890c-e490-4c6f-bd3b-d0805e2b71f8 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:23.602333 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7e31890c-e490-4c6f-bd3b-d0805e2b71f8 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:23.603040 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7e31890c-e490-4c6f-bd3b-d0805e2b71f8 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:23.742650 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-7e31890c-e490-4c6f-bd3b-d0805e2b71f8 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc98a4e7de34bc1ad629247458a1fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc621ea3ee54c5eafd4fbb93e357b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:23.754899 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-7e31890c-e490-4c6f-bd3b-d0805e2b71f8 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] 10.222.0.70 "GET /compute/v2.1/servers/aa25e047-d120-4c42-af0f-35bb86ce2027" status: 200 len: 1519 microversion: 2.1 time: 0.175838 Aug 27 03:37:23.755786 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3178/6399] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:23 2022] GET /compute/v2.1/servers/aa25e047-d120-4c42-af0f-35bb86ce2027 => generated 1519 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:24.779909 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0ad34ee8-5f97-40ee-81e2-b29fa9200780 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:24.780630 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-0ad34ee8-5f97-40ee-81e2-b29fa9200780 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] [instance: aa25e047-d120-4c42-af0f-35bb86ce2027] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:24.788143 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0ad34ee8-5f97-40ee-81e2-b29fa9200780 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:24.788681 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0ad34ee8-5f97-40ee-81e2-b29fa9200780 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:24.789135 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0ad34ee8-5f97-40ee-81e2-b29fa9200780 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:24.789855 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0ad34ee8-5f97-40ee-81e2-b29fa9200780 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:24.790323 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0ad34ee8-5f97-40ee-81e2-b29fa9200780 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:24.790764 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0ad34ee8-5f97-40ee-81e2-b29fa9200780 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:24.941213 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-0ad34ee8-5f97-40ee-81e2-b29fa9200780 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc98a4e7de34bc1ad629247458a1fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc621ea3ee54c5eafd4fbb93e357b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:24.949060 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-0ad34ee8-5f97-40ee-81e2-b29fa9200780 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] 10.222.0.70 "GET /compute/v2.1/servers/aa25e047-d120-4c42-af0f-35bb86ce2027" status: 200 len: 1519 microversion: 2.1 time: 0.175240 Aug 27 03:37:24.949636 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3222/6400] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:24 2022] GET /compute/v2.1/servers/aa25e047-d120-4c42-af0f-35bb86ce2027 => generated 1519 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:25.971127 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9ebc8e4c-8ffb-4d75-9f13-ab5c7ced6bab tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:25.971741 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-9ebc8e4c-8ffb-4d75-9f13-ab5c7ced6bab tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] [instance: aa25e047-d120-4c42-af0f-35bb86ce2027] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:25.980032 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9ebc8e4c-8ffb-4d75-9f13-ab5c7ced6bab tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:25.980605 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9ebc8e4c-8ffb-4d75-9f13-ab5c7ced6bab tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:25.981737 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9ebc8e4c-8ffb-4d75-9f13-ab5c7ced6bab tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:25.982605 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9ebc8e4c-8ffb-4d75-9f13-ab5c7ced6bab tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:25.983066 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9ebc8e4c-8ffb-4d75-9f13-ab5c7ced6bab tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:25.983497 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9ebc8e4c-8ffb-4d75-9f13-ab5c7ced6bab tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:26.124017 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-9ebc8e4c-8ffb-4d75-9f13-ab5c7ced6bab tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc98a4e7de34bc1ad629247458a1fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc621ea3ee54c5eafd4fbb93e357b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:26.132627 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9ebc8e4c-8ffb-4d75-9f13-ab5c7ced6bab tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] 10.222.0.70 "GET /compute/v2.1/servers/aa25e047-d120-4c42-af0f-35bb86ce2027" status: 200 len: 1519 microversion: 2.1 time: 0.165693 Aug 27 03:37:26.133232 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3179/6401] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:25 2022] GET /compute/v2.1/servers/aa25e047-d120-4c42-af0f-35bb86ce2027 => generated 1519 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:27.157134 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-37490dc3-c045-4370-abd0-1690d83c6eb6 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:27.157763 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-37490dc3-c045-4370-abd0-1690d83c6eb6 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] [instance: aa25e047-d120-4c42-af0f-35bb86ce2027] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:27.165333 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-37490dc3-c045-4370-abd0-1690d83c6eb6 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:27.165840 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-37490dc3-c045-4370-abd0-1690d83c6eb6 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:27.166291 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-37490dc3-c045-4370-abd0-1690d83c6eb6 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:27.167012 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-37490dc3-c045-4370-abd0-1690d83c6eb6 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:27.167481 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-37490dc3-c045-4370-abd0-1690d83c6eb6 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:27.167923 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-37490dc3-c045-4370-abd0-1690d83c6eb6 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:27.319896 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-37490dc3-c045-4370-abd0-1690d83c6eb6 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc98a4e7de34bc1ad629247458a1fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc621ea3ee54c5eafd4fbb93e357b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:27.330042 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-37490dc3-c045-4370-abd0-1690d83c6eb6 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] 10.222.0.70 "GET /compute/v2.1/servers/aa25e047-d120-4c42-af0f-35bb86ce2027" status: 200 len: 1519 microversion: 2.1 time: 0.178234 Aug 27 03:37:27.330724 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3223/6402] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:27 2022] GET /compute/v2.1/servers/aa25e047-d120-4c42-af0f-35bb86ce2027 => generated 1519 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:28.355458 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-467c405d-3f75-4183-8270-dc9f9b091dfc tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:28.356605 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-467c405d-3f75-4183-8270-dc9f9b091dfc tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] [instance: aa25e047-d120-4c42-af0f-35bb86ce2027] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:28.364664 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-467c405d-3f75-4183-8270-dc9f9b091dfc tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:28.365154 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-467c405d-3f75-4183-8270-dc9f9b091dfc tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:28.365587 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-467c405d-3f75-4183-8270-dc9f9b091dfc tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:28.366291 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-467c405d-3f75-4183-8270-dc9f9b091dfc tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:28.366738 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-467c405d-3f75-4183-8270-dc9f9b091dfc tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:28.367165 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-467c405d-3f75-4183-8270-dc9f9b091dfc tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:28.515045 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-467c405d-3f75-4183-8270-dc9f9b091dfc tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc98a4e7de34bc1ad629247458a1fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc621ea3ee54c5eafd4fbb93e357b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:28.527361 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-467c405d-3f75-4183-8270-dc9f9b091dfc tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] 10.222.0.70 "GET /compute/v2.1/servers/aa25e047-d120-4c42-af0f-35bb86ce2027" status: 200 len: 1519 microversion: 2.1 time: 0.178414 Aug 27 03:37:28.528256 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3180/6403] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:28 2022] GET /compute/v2.1/servers/aa25e047-d120-4c42-af0f-35bb86ce2027 => generated 1519 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:29.551006 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7596188b-7866-4666-9213-bb02fc430633 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:29.551582 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-7596188b-7866-4666-9213-bb02fc430633 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] [instance: aa25e047-d120-4c42-af0f-35bb86ce2027] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:29.558868 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7596188b-7866-4666-9213-bb02fc430633 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:29.559370 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7596188b-7866-4666-9213-bb02fc430633 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:29.559805 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7596188b-7866-4666-9213-bb02fc430633 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:29.560542 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7596188b-7866-4666-9213-bb02fc430633 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:29.560994 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7596188b-7866-4666-9213-bb02fc430633 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:29.561426 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7596188b-7866-4666-9213-bb02fc430633 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:29.713743 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-7596188b-7866-4666-9213-bb02fc430633 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc98a4e7de34bc1ad629247458a1fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc621ea3ee54c5eafd4fbb93e357b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:29.721853 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-7596188b-7866-4666-9213-bb02fc430633 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] 10.222.0.70 "GET /compute/v2.1/servers/aa25e047-d120-4c42-af0f-35bb86ce2027" status: 200 len: 1519 microversion: 2.1 time: 0.174977 Aug 27 03:37:29.722464 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3224/6404] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:29 2022] GET /compute/v2.1/servers/aa25e047-d120-4c42-af0f-35bb86ce2027 => generated 1519 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:30.744530 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-767ddad8-d757-49b1-b898-7857ddfe3bbb tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:30.745368 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-767ddad8-d757-49b1-b898-7857ddfe3bbb tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] [instance: aa25e047-d120-4c42-af0f-35bb86ce2027] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:30.753634 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-767ddad8-d757-49b1-b898-7857ddfe3bbb tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:30.754115 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-767ddad8-d757-49b1-b898-7857ddfe3bbb tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:30.754547 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-767ddad8-d757-49b1-b898-7857ddfe3bbb tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:30.755278 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-767ddad8-d757-49b1-b898-7857ddfe3bbb tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:30.755727 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-767ddad8-d757-49b1-b898-7857ddfe3bbb tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:30.756148 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-767ddad8-d757-49b1-b898-7857ddfe3bbb tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:30.892178 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-767ddad8-d757-49b1-b898-7857ddfe3bbb tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc98a4e7de34bc1ad629247458a1fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc621ea3ee54c5eafd4fbb93e357b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:30.900416 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-767ddad8-d757-49b1-b898-7857ddfe3bbb tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] 10.222.0.70 "GET /compute/v2.1/servers/aa25e047-d120-4c42-af0f-35bb86ce2027" status: 200 len: 1519 microversion: 2.1 time: 0.160595 Aug 27 03:37:30.901044 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3181/6405] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:30 2022] GET /compute/v2.1/servers/aa25e047-d120-4c42-af0f-35bb86ce2027 => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:31.922609 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-baa2cd73-3062-4922-9aea-3af9841eafe3 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:31.923467 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-baa2cd73-3062-4922-9aea-3af9841eafe3 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] [instance: aa25e047-d120-4c42-af0f-35bb86ce2027] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:31.931119 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-baa2cd73-3062-4922-9aea-3af9841eafe3 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:31.931633 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-baa2cd73-3062-4922-9aea-3af9841eafe3 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:31.932069 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-baa2cd73-3062-4922-9aea-3af9841eafe3 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:31.932841 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-baa2cd73-3062-4922-9aea-3af9841eafe3 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:31.933421 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-baa2cd73-3062-4922-9aea-3af9841eafe3 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:31.933857 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-baa2cd73-3062-4922-9aea-3af9841eafe3 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:32.071757 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-baa2cd73-3062-4922-9aea-3af9841eafe3 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc98a4e7de34bc1ad629247458a1fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc621ea3ee54c5eafd4fbb93e357b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:32.081911 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-baa2cd73-3062-4922-9aea-3af9841eafe3 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] 10.222.0.70 "GET /compute/v2.1/servers/aa25e047-d120-4c42-af0f-35bb86ce2027" status: 200 len: 1519 microversion: 2.1 time: 0.163860 Aug 27 03:37:32.082527 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3225/6406] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:31 2022] GET /compute/v2.1/servers/aa25e047-d120-4c42-af0f-35bb86ce2027 => generated 1519 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:33.107508 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d1fb90e5-efed-49cb-8df9-60abbf09e72c tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:33.108575 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d1fb90e5-efed-49cb-8df9-60abbf09e72c tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] [instance: aa25e047-d120-4c42-af0f-35bb86ce2027] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:33.119895 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d1fb90e5-efed-49cb-8df9-60abbf09e72c tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:33.120769 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d1fb90e5-efed-49cb-8df9-60abbf09e72c tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:33.121508 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d1fb90e5-efed-49cb-8df9-60abbf09e72c tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:33.122659 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d1fb90e5-efed-49cb-8df9-60abbf09e72c tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:33.123296 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d1fb90e5-efed-49cb-8df9-60abbf09e72c tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:33.123725 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d1fb90e5-efed-49cb-8df9-60abbf09e72c tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:33.276273 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-d1fb90e5-efed-49cb-8df9-60abbf09e72c tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc98a4e7de34bc1ad629247458a1fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc621ea3ee54c5eafd4fbb93e357b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:33.284600 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d1fb90e5-efed-49cb-8df9-60abbf09e72c tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] 10.222.0.70 "GET /compute/v2.1/servers/aa25e047-d120-4c42-af0f-35bb86ce2027" status: 200 len: 1519 microversion: 2.1 time: 0.183606 Aug 27 03:37:33.285160 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3182/6407] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:33 2022] GET /compute/v2.1/servers/aa25e047-d120-4c42-af0f-35bb86ce2027 => generated 1519 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:34.307444 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e760ebb3-0458-42fa-8dcc-f7a32763b106 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:34.308088 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-e760ebb3-0458-42fa-8dcc-f7a32763b106 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] [instance: aa25e047-d120-4c42-af0f-35bb86ce2027] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:34.315567 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e760ebb3-0458-42fa-8dcc-f7a32763b106 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:34.316090 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e760ebb3-0458-42fa-8dcc-f7a32763b106 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:34.316572 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e760ebb3-0458-42fa-8dcc-f7a32763b106 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:34.317279 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e760ebb3-0458-42fa-8dcc-f7a32763b106 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:34.317740 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e760ebb3-0458-42fa-8dcc-f7a32763b106 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:34.318170 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e760ebb3-0458-42fa-8dcc-f7a32763b106 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:34.451833 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e760ebb3-0458-42fa-8dcc-f7a32763b106 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc98a4e7de34bc1ad629247458a1fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc621ea3ee54c5eafd4fbb93e357b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:34.454072 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:37:34.461272 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e760ebb3-0458-42fa-8dcc-f7a32763b106 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] 10.222.0.70 "GET /compute/v2.1/servers/aa25e047-d120-4c42-af0f-35bb86ce2027" status: 200 len: 1519 microversion: 2.1 time: 0.158169 Aug 27 03:37:34.461843 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3226/6408] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:34 2022] GET /compute/v2.1/servers/aa25e047-d120-4c42-af0f-35bb86ce2027 => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:35.487403 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-51feb6b0-00db-4504-9566-9a7c0560f3f4 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:35.488429 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-51feb6b0-00db-4504-9566-9a7c0560f3f4 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] [instance: aa25e047-d120-4c42-af0f-35bb86ce2027] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:35.499047 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-51feb6b0-00db-4504-9566-9a7c0560f3f4 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:35.499532 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-51feb6b0-00db-4504-9566-9a7c0560f3f4 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:35.499968 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-51feb6b0-00db-4504-9566-9a7c0560f3f4 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:35.500704 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-51feb6b0-00db-4504-9566-9a7c0560f3f4 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:35.501157 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-51feb6b0-00db-4504-9566-9a7c0560f3f4 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:35.501576 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-51feb6b0-00db-4504-9566-9a7c0560f3f4 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:35.641705 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-51feb6b0-00db-4504-9566-9a7c0560f3f4 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc98a4e7de34bc1ad629247458a1fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc621ea3ee54c5eafd4fbb93e357b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:35.649903 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-51feb6b0-00db-4504-9566-9a7c0560f3f4 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] 10.222.0.70 "GET /compute/v2.1/servers/aa25e047-d120-4c42-af0f-35bb86ce2027" status: 200 len: 1519 microversion: 2.1 time: 0.169739 Aug 27 03:37:35.650599 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3183/6409] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:35 2022] GET /compute/v2.1/servers/aa25e047-d120-4c42-af0f-35bb86ce2027 => generated 1519 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:36.675560 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-9ce756b9-1541-44af-8be0-36c45a27a330 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:36.676158 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-9ce756b9-1541-44af-8be0-36c45a27a330 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] [instance: aa25e047-d120-4c42-af0f-35bb86ce2027] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:36.683484 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9ce756b9-1541-44af-8be0-36c45a27a330 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:36.684003 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9ce756b9-1541-44af-8be0-36c45a27a330 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:36.684488 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9ce756b9-1541-44af-8be0-36c45a27a330 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:36.685274 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9ce756b9-1541-44af-8be0-36c45a27a330 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:36.685740 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9ce756b9-1541-44af-8be0-36c45a27a330 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:36.686192 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9ce756b9-1541-44af-8be0-36c45a27a330 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:36.837112 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-9ce756b9-1541-44af-8be0-36c45a27a330 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc98a4e7de34bc1ad629247458a1fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc621ea3ee54c5eafd4fbb93e357b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:36.845335 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-9ce756b9-1541-44af-8be0-36c45a27a330 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] 10.222.0.70 "GET /compute/v2.1/servers/aa25e047-d120-4c42-af0f-35bb86ce2027" status: 200 len: 1519 microversion: 2.1 time: 0.176121 Aug 27 03:37:36.845920 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3227/6410] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:36 2022] GET /compute/v2.1/servers/aa25e047-d120-4c42-af0f-35bb86ce2027 => generated 1519 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:37.870973 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-046c8e63-9c8d-4044-b1e3-764cf307aa8c tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:37.872031 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-046c8e63-9c8d-4044-b1e3-764cf307aa8c tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] [instance: aa25e047-d120-4c42-af0f-35bb86ce2027] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:37.883923 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-046c8e63-9c8d-4044-b1e3-764cf307aa8c tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:37.884780 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-046c8e63-9c8d-4044-b1e3-764cf307aa8c tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:37.885503 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-046c8e63-9c8d-4044-b1e3-764cf307aa8c tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:37.886653 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-046c8e63-9c8d-4044-b1e3-764cf307aa8c tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:37.887399 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-046c8e63-9c8d-4044-b1e3-764cf307aa8c tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:37.888115 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-046c8e63-9c8d-4044-b1e3-764cf307aa8c tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:38.031647 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-046c8e63-9c8d-4044-b1e3-764cf307aa8c tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc98a4e7de34bc1ad629247458a1fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc621ea3ee54c5eafd4fbb93e357b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:38.039769 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-046c8e63-9c8d-4044-b1e3-764cf307aa8c tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] 10.222.0.70 "GET /compute/v2.1/servers/aa25e047-d120-4c42-af0f-35bb86ce2027" status: 200 len: 1519 microversion: 2.1 time: 0.175328 Aug 27 03:37:38.040606 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3184/6411] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:37 2022] GET /compute/v2.1/servers/aa25e047-d120-4c42-af0f-35bb86ce2027 => generated 1519 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:38.761606 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-34689a9d-6318-4cda-b2cd-547665b7fc82 req-f1ed8573-58fe-43e5-8064-74856bd5168c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa25e047-d120-4c42-af0f-35bb86ce2027", "name": "network-vif-unplugged", "status": "completed", "tag": "369bc0e9-f0e8-4b3d-b983-54b8974852f1"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:37:38.772182 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-34689a9d-6318-4cda-b2cd-547665b7fc82 req-f1ed8573-58fe-43e5-8064-74856bd5168c service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:38.772901 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-34689a9d-6318-4cda-b2cd-547665b7fc82 req-f1ed8573-58fe-43e5-8064-74856bd5168c service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:38.773405 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-34689a9d-6318-4cda-b2cd-547665b7fc82 req-f1ed8573-58fe-43e5-8064-74856bd5168c service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:38.786112 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-34689a9d-6318-4cda-b2cd-547665b7fc82 req-f1ed8573-58fe-43e5-8064-74856bd5168c service nova] Creating event network-vif-unplugged:369bc0e9-f0e8-4b3d-b983-54b8974852f1 for instance aa25e047-d120-4c42-af0f-35bb86ce2027 on n-h2-852278-4 Aug 27 03:37:38.791552 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [req-34689a9d-6318-4cda-b2cd-547665b7fc82 req-f1ed8573-58fe-43e5-8064-74856bd5168c service nova] Instance aa25e047-d120-4c42-af0f-35bb86ce2027 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-852278-4', 'n-h1-852278-4'} {{(pid=134051) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 03:37:38.802752 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-34689a9d-6318-4cda-b2cd-547665b7fc82 req-f1ed8573-58fe-43e5-8064-74856bd5168c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045327 Aug 27 03:37:38.803526 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3228/6412] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:37:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:37:39.061414 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c46cda2d-89cb-4581-b19d-b5450ad2386f tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:39.062026 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-c46cda2d-89cb-4581-b19d-b5450ad2386f tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] [instance: aa25e047-d120-4c42-af0f-35bb86ce2027] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:39.069594 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c46cda2d-89cb-4581-b19d-b5450ad2386f tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:39.070084 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c46cda2d-89cb-4581-b19d-b5450ad2386f tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:39.070515 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c46cda2d-89cb-4581-b19d-b5450ad2386f tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:39.071206 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c46cda2d-89cb-4581-b19d-b5450ad2386f tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:39.071656 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c46cda2d-89cb-4581-b19d-b5450ad2386f tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:39.072077 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c46cda2d-89cb-4581-b19d-b5450ad2386f tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:39.613417 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-c46cda2d-89cb-4581-b19d-b5450ad2386f tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc98a4e7de34bc1ad629247458a1fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc621ea3ee54c5eafd4fbb93e357b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:39.622010 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c46cda2d-89cb-4581-b19d-b5450ad2386f tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] 10.222.0.70 "GET /compute/v2.1/servers/aa25e047-d120-4c42-af0f-35bb86ce2027" status: 200 len: 1518 microversion: 2.1 time: 0.564355 Aug 27 03:37:39.622601 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3185/6413] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:39 2022] GET /compute/v2.1/servers/aa25e047-d120-4c42-af0f-35bb86ce2027 => generated 1518 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:40.643891 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-47fd560c-2edb-4d0d-9606-354af026db14 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:40.644643 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-47fd560c-2edb-4d0d-9606-354af026db14 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] [instance: aa25e047-d120-4c42-af0f-35bb86ce2027] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:40.652101 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-47fd560c-2edb-4d0d-9606-354af026db14 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:40.652624 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-47fd560c-2edb-4d0d-9606-354af026db14 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:40.653069 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-47fd560c-2edb-4d0d-9606-354af026db14 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:40.653772 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-47fd560c-2edb-4d0d-9606-354af026db14 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:40.654502 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-47fd560c-2edb-4d0d-9606-354af026db14 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:40.655129 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-47fd560c-2edb-4d0d-9606-354af026db14 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:40.797509 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-47fd560c-2edb-4d0d-9606-354af026db14 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc98a4e7de34bc1ad629247458a1fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc621ea3ee54c5eafd4fbb93e357b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:40.808878 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-47fd560c-2edb-4d0d-9606-354af026db14 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] 10.222.0.70 "GET /compute/v2.1/servers/aa25e047-d120-4c42-af0f-35bb86ce2027" status: 200 len: 1516 microversion: 2.1 time: 0.169163 Aug 27 03:37:40.809792 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3229/6414] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:40 2022] GET /compute/v2.1/servers/aa25e047-d120-4c42-af0f-35bb86ce2027 => generated 1516 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:40.819383 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-ce66b382-9c33-4976-9757-ee6421996221 req-eee4ca64-50b1-4ca9-9266-4cbb11b4b02c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa25e047-d120-4c42-af0f-35bb86ce2027", "tag": "369bc0e9-f0e8-4b3d-b983-54b8974852f1"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:37:40.831936 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-ce66b382-9c33-4976-9757-ee6421996221 req-eee4ca64-50b1-4ca9-9266-4cbb11b4b02c service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:40.832437 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-ce66b382-9c33-4976-9757-ee6421996221 req-eee4ca64-50b1-4ca9-9266-4cbb11b4b02c service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:40.832879 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-ce66b382-9c33-4976-9757-ee6421996221 req-eee4ca64-50b1-4ca9-9266-4cbb11b4b02c service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:40.844761 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-ce66b382-9c33-4976-9757-ee6421996221 req-eee4ca64-50b1-4ca9-9266-4cbb11b4b02c service nova] Creating event network-changed:369bc0e9-f0e8-4b3d-b983-54b8974852f1 for instance aa25e047-d120-4c42-af0f-35bb86ce2027 on n-h2-852278-4 Aug 27 03:37:40.850685 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [req-ce66b382-9c33-4976-9757-ee6421996221 req-eee4ca64-50b1-4ca9-9266-4cbb11b4b02c service nova] Instance aa25e047-d120-4c42-af0f-35bb86ce2027 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-852278-4', 'n-h1-852278-4'} {{(pid=134052) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 03:37:40.863476 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-ce66b382-9c33-4976-9757-ee6421996221 req-eee4ca64-50b1-4ca9-9266-4cbb11b4b02c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049608 Aug 27 03:37:40.864118 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3186/6415] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:37:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:37:41.835492 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0ebee9c7-afcf-4088-94d4-6c8b87b844c6 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:41.836105 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-0ebee9c7-afcf-4088-94d4-6c8b87b844c6 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] [instance: aa25e047-d120-4c42-af0f-35bb86ce2027] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:41.843041 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0ebee9c7-afcf-4088-94d4-6c8b87b844c6 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:41.843535 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0ebee9c7-afcf-4088-94d4-6c8b87b844c6 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:41.843978 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0ebee9c7-afcf-4088-94d4-6c8b87b844c6 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:41.844703 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0ebee9c7-afcf-4088-94d4-6c8b87b844c6 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:41.845157 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0ebee9c7-afcf-4088-94d4-6c8b87b844c6 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:41.845583 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0ebee9c7-afcf-4088-94d4-6c8b87b844c6 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:41.988120 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-0ebee9c7-afcf-4088-94d4-6c8b87b844c6 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc98a4e7de34bc1ad629247458a1fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc621ea3ee54c5eafd4fbb93e357b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:41.996215 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-0ebee9c7-afcf-4088-94d4-6c8b87b844c6 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] 10.222.0.70 "GET /compute/v2.1/servers/aa25e047-d120-4c42-af0f-35bb86ce2027" status: 200 len: 1513 microversion: 2.1 time: 0.164665 Aug 27 03:37:41.996874 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3230/6416] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:41 2022] GET /compute/v2.1/servers/aa25e047-d120-4c42-af0f-35bb86ce2027 => generated 1513 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:42.018941 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4edeb88f-7c8d-4e45-a3bb-41c9e150c10d tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:37:42.019550 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-4edeb88f-7c8d-4e45-a3bb-41c9e150c10d tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] [instance: aa25e047-d120-4c42-af0f-35bb86ce2027] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:42.025876 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4edeb88f-7c8d-4e45-a3bb-41c9e150c10d tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:42.026324 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4edeb88f-7c8d-4e45-a3bb-41c9e150c10d tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:42.026775 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4edeb88f-7c8d-4e45-a3bb-41c9e150c10d tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:42.027455 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4edeb88f-7c8d-4e45-a3bb-41c9e150c10d tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:42.027917 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4edeb88f-7c8d-4e45-a3bb-41c9e150c10d tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:42.028284 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4edeb88f-7c8d-4e45-a3bb-41c9e150c10d tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:42.030974 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=81 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:37:42.093058 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-4edeb88f-7c8d-4e45-a3bb-41c9e150c10d tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] 10.222.0.70 "POST /compute/v2.1/servers/aa25e047-d120-4c42-af0f-35bb86ce2027/action" status: 204 len: 0 microversion: 2.1 time: 0.078866 Aug 27 03:37:42.093739 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3187/6417] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:37:42 2022] POST /compute/v2.1/servers/aa25e047-d120-4c42-af0f-35bb86ce2027/action => generated 0 bytes in 81 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:37:42.101926 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-218b9f41-6892-4b65-af85-4ca513d89d4f tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:42.102797 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-218b9f41-6892-4b65-af85-4ca513d89d4f tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] [instance: aa25e047-d120-4c42-af0f-35bb86ce2027] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:42.108965 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-218b9f41-6892-4b65-af85-4ca513d89d4f tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:42.109469 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-218b9f41-6892-4b65-af85-4ca513d89d4f tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:42.110124 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-218b9f41-6892-4b65-af85-4ca513d89d4f tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:42.111062 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-218b9f41-6892-4b65-af85-4ca513d89d4f tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:42.111629 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-218b9f41-6892-4b65-af85-4ca513d89d4f tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:42.112161 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-218b9f41-6892-4b65-af85-4ca513d89d4f tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:42.316551 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-218b9f41-6892-4b65-af85-4ca513d89d4f tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc98a4e7de34bc1ad629247458a1fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc621ea3ee54c5eafd4fbb93e357b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:42.324797 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-218b9f41-6892-4b65-af85-4ca513d89d4f tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] 10.222.0.70 "GET /compute/v2.1/servers/aa25e047-d120-4c42-af0f-35bb86ce2027" status: 200 len: 1513 microversion: 2.1 time: 0.226716 Aug 27 03:37:42.325662 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3231/6418] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:42 2022] GET /compute/v2.1/servers/aa25e047-d120-4c42-af0f-35bb86ce2027 => generated 1513 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:43.347624 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f59409c5-1c4c-42ff-b0f4-eb13f5b327ca tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:43.348440 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-f59409c5-1c4c-42ff-b0f4-eb13f5b327ca tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] [instance: aa25e047-d120-4c42-af0f-35bb86ce2027] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:43.357101 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f59409c5-1c4c-42ff-b0f4-eb13f5b327ca tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:43.357581 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f59409c5-1c4c-42ff-b0f4-eb13f5b327ca tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:43.358041 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f59409c5-1c4c-42ff-b0f4-eb13f5b327ca tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:43.358745 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f59409c5-1c4c-42ff-b0f4-eb13f5b327ca tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:43.359205 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f59409c5-1c4c-42ff-b0f4-eb13f5b327ca tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:43.359629 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f59409c5-1c4c-42ff-b0f4-eb13f5b327ca tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:43.562062 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-f59409c5-1c4c-42ff-b0f4-eb13f5b327ca tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc98a4e7de34bc1ad629247458a1fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc621ea3ee54c5eafd4fbb93e357b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:43.570257 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f59409c5-1c4c-42ff-b0f4-eb13f5b327ca tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] 10.222.0.70 "GET /compute/v2.1/servers/aa25e047-d120-4c42-af0f-35bb86ce2027" status: 200 len: 1513 microversion: 2.1 time: 0.228341 Aug 27 03:37:43.570861 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3188/6419] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:43 2022] GET /compute/v2.1/servers/aa25e047-d120-4c42-af0f-35bb86ce2027 => generated 1513 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:44.392397 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-1563519b-a3fe-4290-8454-6ce1294cdba2 req-dfd972dd-1524-40cf-abef-1a6654ad5e3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa25e047-d120-4c42-af0f-35bb86ce2027", "name": "network-vif-plugged", "status": "completed", "tag": "369bc0e9-f0e8-4b3d-b983-54b8974852f1"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:37:44.403009 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-1563519b-a3fe-4290-8454-6ce1294cdba2 req-dfd972dd-1524-40cf-abef-1a6654ad5e3d service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:44.403468 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-1563519b-a3fe-4290-8454-6ce1294cdba2 req-dfd972dd-1524-40cf-abef-1a6654ad5e3d service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:44.403891 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-1563519b-a3fe-4290-8454-6ce1294cdba2 req-dfd972dd-1524-40cf-abef-1a6654ad5e3d service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:44.420001 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-1563519b-a3fe-4290-8454-6ce1294cdba2 req-dfd972dd-1524-40cf-abef-1a6654ad5e3d service nova] Creating event network-vif-plugged:369bc0e9-f0e8-4b3d-b983-54b8974852f1 for instance aa25e047-d120-4c42-af0f-35bb86ce2027 on n-h2-852278-4 Aug 27 03:37:44.425445 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-1563519b-a3fe-4290-8454-6ce1294cdba2 req-dfd972dd-1524-40cf-abef-1a6654ad5e3d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143559 Aug 27 03:37:44.426095 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3232/6420] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:37:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:37:44.596481 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-2c263a08-0e21-47f8-804e-a2371043bcb5 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:44.597494 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-2c263a08-0e21-47f8-804e-a2371043bcb5 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] [instance: aa25e047-d120-4c42-af0f-35bb86ce2027] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:44.609264 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2c263a08-0e21-47f8-804e-a2371043bcb5 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:44.609750 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2c263a08-0e21-47f8-804e-a2371043bcb5 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:44.610186 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2c263a08-0e21-47f8-804e-a2371043bcb5 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:44.610881 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2c263a08-0e21-47f8-804e-a2371043bcb5 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:44.611329 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2c263a08-0e21-47f8-804e-a2371043bcb5 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:44.611749 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2c263a08-0e21-47f8-804e-a2371043bcb5 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:44.760188 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-2c263a08-0e21-47f8-804e-a2371043bcb5 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc98a4e7de34bc1ad629247458a1fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc621ea3ee54c5eafd4fbb93e357b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:44.769057 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-2c263a08-0e21-47f8-804e-a2371043bcb5 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] 10.222.0.70 "GET /compute/v2.1/servers/aa25e047-d120-4c42-af0f-35bb86ce2027" status: 200 len: 1505 microversion: 2.1 time: 0.179291 Aug 27 03:37:44.769701 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3189/6421] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:44 2022] GET /compute/v2.1/servers/aa25e047-d120-4c42-af0f-35bb86ce2027 => generated 1505 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:44.799790 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-87a1b443-dbcf-484c-9e01-0ce33aceac89 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:44.800543 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-87a1b443-dbcf-484c-9e01-0ce33aceac89 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] [instance: aa25e047-d120-4c42-af0f-35bb86ce2027] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:44.807240 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-87a1b443-dbcf-484c-9e01-0ce33aceac89 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:44.807741 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-87a1b443-dbcf-484c-9e01-0ce33aceac89 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:44.808195 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-87a1b443-dbcf-484c-9e01-0ce33aceac89 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:44.808955 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-87a1b443-dbcf-484c-9e01-0ce33aceac89 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:44.809419 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-87a1b443-dbcf-484c-9e01-0ce33aceac89 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:44.809868 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-87a1b443-dbcf-484c-9e01-0ce33aceac89 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:44.963670 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-87a1b443-dbcf-484c-9e01-0ce33aceac89 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc98a4e7de34bc1ad629247458a1fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc621ea3ee54c5eafd4fbb93e357b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:44.971966 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-87a1b443-dbcf-484c-9e01-0ce33aceac89 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] 10.222.0.70 "GET /compute/v2.1/servers/aa25e047-d120-4c42-af0f-35bb86ce2027" status: 200 len: 1505 microversion: 2.1 time: 0.177567 Aug 27 03:37:44.972581 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3233/6422] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:44 2022] GET /compute/v2.1/servers/aa25e047-d120-4c42-af0f-35bb86ce2027 => generated 1505 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:44.994920 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-404a0c0c-2ff3-4f01-860e-569cc195fc66 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:44.995786 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-404a0c0c-2ff3-4f01-860e-569cc195fc66 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] [instance: aa25e047-d120-4c42-af0f-35bb86ce2027] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:45.003369 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-404a0c0c-2ff3-4f01-860e-569cc195fc66 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:45.003888 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-404a0c0c-2ff3-4f01-860e-569cc195fc66 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:45.004345 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-404a0c0c-2ff3-4f01-860e-569cc195fc66 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:45.005081 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-404a0c0c-2ff3-4f01-860e-569cc195fc66 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:45.005542 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-404a0c0c-2ff3-4f01-860e-569cc195fc66 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:45.005964 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-404a0c0c-2ff3-4f01-860e-569cc195fc66 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:45.146095 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-404a0c0c-2ff3-4f01-860e-569cc195fc66 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc98a4e7de34bc1ad629247458a1fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc621ea3ee54c5eafd4fbb93e357b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:45.158811 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-404a0c0c-2ff3-4f01-860e-569cc195fc66 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] 10.222.0.70 "GET /compute/v2.1/servers/aa25e047-d120-4c42-af0f-35bb86ce2027" status: 200 len: 1505 microversion: 2.1 time: 0.170099 Aug 27 03:37:45.159391 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3190/6423] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:44 2022] GET /compute/v2.1/servers/aa25e047-d120-4c42-af0f-35bb86ce2027 => generated 1505 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:45.181492 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-36e43f7f-0bb2-4e4c-8e58-11623489679c tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:45.182103 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-36e43f7f-0bb2-4e4c-8e58-11623489679c tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] [instance: aa25e047-d120-4c42-af0f-35bb86ce2027] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:45.188666 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-36e43f7f-0bb2-4e4c-8e58-11623489679c tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:45.189162 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-36e43f7f-0bb2-4e4c-8e58-11623489679c tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:45.189602 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-36e43f7f-0bb2-4e4c-8e58-11623489679c tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:45.190311 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-36e43f7f-0bb2-4e4c-8e58-11623489679c tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:45.190770 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-36e43f7f-0bb2-4e4c-8e58-11623489679c tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:45.191200 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-36e43f7f-0bb2-4e4c-8e58-11623489679c tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:45.215730 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-36e43f7f-0bb2-4e4c-8e58-11623489679c tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] [instance: aa25e047-d120-4c42-af0f-35bb86ce2027] Going to try to terminate instance {{(pid=134051) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:37:45.301197 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-36e43f7f-0bb2-4e4c-8e58-11623489679c tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] 10.222.0.70 "DELETE /compute/v2.1/servers/aa25e047-d120-4c42-af0f-35bb86ce2027" status: 204 len: 0 microversion: 2.1 time: 0.123088 Aug 27 03:37:45.302274 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3234/6424] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 03:37:45 2022] DELETE /compute/v2.1/servers/aa25e047-d120-4c42-af0f-35bb86ce2027 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:37:45.319061 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f6ba31bd-f3f2-4c56-8023-ec63d430abc3 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:45.319651 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-f6ba31bd-f3f2-4c56-8023-ec63d430abc3 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] [instance: aa25e047-d120-4c42-af0f-35bb86ce2027] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:45.326139 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f6ba31bd-f3f2-4c56-8023-ec63d430abc3 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:45.326625 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f6ba31bd-f3f2-4c56-8023-ec63d430abc3 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:45.327129 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f6ba31bd-f3f2-4c56-8023-ec63d430abc3 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:45.327960 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f6ba31bd-f3f2-4c56-8023-ec63d430abc3 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:45.328452 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f6ba31bd-f3f2-4c56-8023-ec63d430abc3 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:45.328879 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f6ba31bd-f3f2-4c56-8023-ec63d430abc3 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:45.355165 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-f6ba31bd-f3f2-4c56-8023-ec63d430abc3 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] [instance: aa25e047-d120-4c42-af0f-35bb86ce2027] Going to try to terminate instance {{(pid=134052) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:37:45.401909 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.compute.api [None req-f6ba31bd-f3f2-4c56-8023-ec63d430abc3 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] [instance: aa25e047-d120-4c42-af0f-35bb86ce2027] Instance is already in deleting state, ignoring this request Aug 27 03:37:45.402743 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f6ba31bd-f3f2-4c56-8023-ec63d430abc3 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] 10.222.0.70 "DELETE /compute/v2.1/servers/aa25e047-d120-4c42-af0f-35bb86ce2027" status: 204 len: 0 microversion: 2.1 time: 0.087704 Aug 27 03:37:45.403544 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3191/6425] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 03:37:45 2022] DELETE /compute/v2.1/servers/aa25e047-d120-4c42-af0f-35bb86ce2027 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:37:45.413968 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-17f039d4-e76a-4a3a-afc1-fbf566fa0264 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:45.414852 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-17f039d4-e76a-4a3a-afc1-fbf566fa0264 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] [instance: aa25e047-d120-4c42-af0f-35bb86ce2027] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:45.423300 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-17f039d4-e76a-4a3a-afc1-fbf566fa0264 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:45.423831 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-17f039d4-e76a-4a3a-afc1-fbf566fa0264 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:45.424277 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-17f039d4-e76a-4a3a-afc1-fbf566fa0264 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:45.425010 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-17f039d4-e76a-4a3a-afc1-fbf566fa0264 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:45.425466 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-17f039d4-e76a-4a3a-afc1-fbf566fa0264 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:45.425904 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-17f039d4-e76a-4a3a-afc1-fbf566fa0264 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:45.573253 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-17f039d4-e76a-4a3a-afc1-fbf566fa0264 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc98a4e7de34bc1ad629247458a1fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc621ea3ee54c5eafd4fbb93e357b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:45.581451 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-17f039d4-e76a-4a3a-afc1-fbf566fa0264 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] 10.222.0.70 "GET /compute/v2.1/servers/aa25e047-d120-4c42-af0f-35bb86ce2027" status: 200 len: 1511 microversion: 2.1 time: 0.171922 Aug 27 03:37:45.582033 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3235/6426] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:45 2022] GET /compute/v2.1/servers/aa25e047-d120-4c42-af0f-35bb86ce2027 => generated 1511 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:46.606711 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-682ba8c3-a4eb-4800-9b3e-bae3a34dae02 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:46.607759 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-682ba8c3-a4eb-4800-9b3e-bae3a34dae02 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] [instance: aa25e047-d120-4c42-af0f-35bb86ce2027] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:46.612463 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=34 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:37:46.621986 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-682ba8c3-a4eb-4800-9b3e-bae3a34dae02 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:46.622766 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-682ba8c3-a4eb-4800-9b3e-bae3a34dae02 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:46.623538 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-682ba8c3-a4eb-4800-9b3e-bae3a34dae02 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:46.624779 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-682ba8c3-a4eb-4800-9b3e-bae3a34dae02 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:46.625530 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-682ba8c3-a4eb-4800-9b3e-bae3a34dae02 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:46.626234 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-682ba8c3-a4eb-4800-9b3e-bae3a34dae02 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:46.945337 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-682ba8c3-a4eb-4800-9b3e-bae3a34dae02 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc98a4e7de34bc1ad629247458a1fe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc621ea3ee54c5eafd4fbb93e357b3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:46.954273 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-682ba8c3-a4eb-4800-9b3e-bae3a34dae02 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] 10.222.0.70 "GET /compute/v2.1/servers/aa25e047-d120-4c42-af0f-35bb86ce2027" status: 200 len: 1511 microversion: 2.1 time: 0.354364 Aug 27 03:37:46.954860 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3192/6427] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:46 2022] GET /compute/v2.1/servers/aa25e047-d120-4c42-af0f-35bb86ce2027 => generated 1511 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:47.184360 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-c42b18b3-e507-4a5a-9be4-80e26504d280 req-f863b6e2-ca02-445f-8695-81c857cf8d2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa25e047-d120-4c42-af0f-35bb86ce2027", "name": "network-vif-deleted", "tag": "369bc0e9-f0e8-4b3d-b983-54b8974852f1"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:37:47.197228 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-c42b18b3-e507-4a5a-9be4-80e26504d280 req-f863b6e2-ca02-445f-8695-81c857cf8d2b service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:47.197959 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-c42b18b3-e507-4a5a-9be4-80e26504d280 req-f863b6e2-ca02-445f-8695-81c857cf8d2b service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:47.198672 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-c42b18b3-e507-4a5a-9be4-80e26504d280 req-f863b6e2-ca02-445f-8695-81c857cf8d2b service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:47.211959 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-c42b18b3-e507-4a5a-9be4-80e26504d280 req-f863b6e2-ca02-445f-8695-81c857cf8d2b service nova] Creating event network-vif-deleted:369bc0e9-f0e8-4b3d-b983-54b8974852f1 for instance aa25e047-d120-4c42-af0f-35bb86ce2027 on n-h2-852278-4 Aug 27 03:37:47.217267 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-c42b18b3-e507-4a5a-9be4-80e26504d280 req-f863b6e2-ca02-445f-8695-81c857cf8d2b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036752 Aug 27 03:37:47.217885 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3236/6428] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:37:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:37:47.977840 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8a126765-9503-4722-a9ca-38e36a47578b tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:47.978621 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-8a126765-9503-4722-a9ca-38e36a47578b tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] [instance: aa25e047-d120-4c42-af0f-35bb86ce2027] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:47.986659 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8a126765-9503-4722-a9ca-38e36a47578b tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:47.987150 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8a126765-9503-4722-a9ca-38e36a47578b tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:47.987588 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8a126765-9503-4722-a9ca-38e36a47578b tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:47.988592 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8a126765-9503-4722-a9ca-38e36a47578b tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:47.989289 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8a126765-9503-4722-a9ca-38e36a47578b tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:47.989857 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8a126765-9503-4722-a9ca-38e36a47578b tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:48.008296 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-8a126765-9503-4722-a9ca-38e36a47578b tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] HTTP exception thrown: Instance aa25e047-d120-4c42-af0f-35bb86ce2027 could not be found. Aug 27 03:37:48.010014 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8a126765-9503-4722-a9ca-38e36a47578b tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Request method failure captured: Aug 27 03:37:48.010014 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/servers/aa25e047-d120-4c42-af0f-35bb86ce2027 HTTP/1.1 Aug 27 03:37:48.010014 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 03:37:48.010014 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 03:37:48.010014 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 03:37:48.010014 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 03:37:48.010014 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 03:37:48.010014 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 03:37:48.010014 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 03:37:48.010014 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 03:37:48.010014 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCZEmqZudcNQdXPK1yiyTtF9fJ1fZMwFgGmt44ZeOfi_SmO_3lgdUUDT40liQuZ6VZi0yGTTVM2CrldGaAMD5oCfUkhddDR_xT28q7Z_yKkd10IZsMNJdf5iuOxAE5g1aeSxRyoHC5RCd1cvPo7WwftTdUFsLKOZuzOoOOR0WtAZJdUI Aug 27 03:37:48.010014 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 03:37:48.010014 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 03:37:48.010014 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 03:37:48.010014 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 03:37:48.010014 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 03:37:48.010014 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 03:37:48.010014 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: afc621ea3ee54c5eafd4fbb93e357b3f Aug 27 03:37:48.010014 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ServerDiskConfigTestJSON-801621628 Aug 27 03:37:48.010014 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 03:37:48.010014 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 03:37:48.010014 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/afc621ea3ee54c5eafd4fbb93e357b3f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_afc621ea3ee54c5eafd4fbb93e357b3f", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/afc621ea3ee54c5eafd4fbb93e357b3f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/afc621ea3ee54c5eafd4fbb93e357b3f"}]}] Aug 27 03:37:48.010014 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ServerDiskConfigTestJSON-801621628 Aug 27 03:37:48.010014 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: afc621ea3ee54c5eafd4fbb93e357b3f Aug 27 03:37:48.010014 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-801621628 Aug 27 03:37:48.010014 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ServerDiskConfigTestJSON-801621628-project Aug 27 03:37:48.010014 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 03:37:48.010014 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 03:37:48.010014 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 5fc98a4e7de34bc1ad629247458a1fe2 Aug 27 03:37:48.010014 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ServerDiskConfigTestJSON-801621628-project Aug 27 03:37:48.010014 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 03:37:48.010014 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance aa25e047-d120-4c42-af0f-35bb86ce2027 could not be found. Aug 27 03:37:48.010014 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': 'aa25e047-d120-4c42-af0f-35bb86ce2027'} Aug 27 03:37:48.010014 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:37:48.010014 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:37:48.010014 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:37:48.010014 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:37:48.010014 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:37:48.010014 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:37:48.010014 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:37:48.010014 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:37:48.010014 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:37:48.010014 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:37:48.010014 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa25e047-d120-4c42-af0f-35bb86ce2027 could not be found. Aug 27 03:37:48.010014 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:37:48.010014 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:37:48.010014 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:37:48.010014 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:37:48.010014 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:37:48.010014 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:37:48.010014 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:37:48.010014 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:37:48.010014 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:37:48.010014 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:37:48.010014 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:37:48.010014 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:37:48.010014 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:37:48.010014 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:37:48.010014 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:37:48.010014 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:37:48.010014 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa25e047-d120-4c42-af0f-35bb86ce2027 could not be found. Aug 27 03:37:48.010014 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:37:48.010014 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:37:48.010014 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:37:48.013237 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:37:48.013237 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:37:48.013237 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:37:48.013237 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:37:48.013237 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:37:48.013237 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa25e047-d120-4c42-af0f-35bb86ce2027 could not be found. Aug 27 03:37:48.013237 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:37:48.013237 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8a126765-9503-4722-a9ca-38e36a47578b tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Returning 404 to user: Instance aa25e047-d120-4c42-af0f-35bb86ce2027 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:37:48.013237 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-8a126765-9503-4722-a9ca-38e36a47578b tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] 10.222.0.70 "GET /compute/v2.1/servers/aa25e047-d120-4c42-af0f-35bb86ce2027" status: 404 len: 111 microversion: 2.1 time: 0.039917 Aug 27 03:37:48.013237 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3193/6429] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:47 2022] GET /compute/v2.1/servers/aa25e047-d120-4c42-af0f-35bb86ce2027 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:37:48.021026 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-40d3f992-8d0b-43d7-becc-45296e8c92a0 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Calling method '.version_select at 0x7f5edc0f2040>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:48.025598 n-d-852278-4 devstack@n-api.service[134051]: ERROR oslo.messaging._drivers.impl_rabbit [None req-40d3f992-8d0b-43d7-becc-45296e8c92a0 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] [f1aafa46-37af-4041-a1e3-3fd9730c0ab1] AMQP server on 10.222.0.70:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 27 03:37:49.037874 n-d-852278-4 devstack@n-api.service[134051]: INFO oslo.messaging._drivers.impl_rabbit [None req-40d3f992-8d0b-43d7-becc-45296e8c92a0 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] [f1aafa46-37af-4041-a1e3-3fd9730c0ab1] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 55506. Aug 27 03:37:49.050599 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:37:49.066071 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-40d3f992-8d0b-43d7-becc-45296e8c92a0 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-613354020" status: 202 len: 0 microversion: 2.1 time: 1.049271 Aug 27 03:37:49.066654 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3237/6430] 10.222.0.70 () {58 vars in 1218 bytes} [Sat Aug 27 03:37:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-613354020 => generated 0 bytes in 1051 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:37:49.711856 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d1a8c646-09f0-4991-8dbc-6ee0eb7acfb8 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:49.712372 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d1a8c646-09f0-4991-8dbc-6ee0eb7acfb8 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] [instance: 0581f7e5-2719-4aa6-8f59-7522c3004ade] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:49.719666 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d1a8c646-09f0-4991-8dbc-6ee0eb7acfb8 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:49.720156 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d1a8c646-09f0-4991-8dbc-6ee0eb7acfb8 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:49.720611 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d1a8c646-09f0-4991-8dbc-6ee0eb7acfb8 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:49.721302 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d1a8c646-09f0-4991-8dbc-6ee0eb7acfb8 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:49.721743 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d1a8c646-09f0-4991-8dbc-6ee0eb7acfb8 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:49.722159 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d1a8c646-09f0-4991-8dbc-6ee0eb7acfb8 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:49.735740 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-d1a8c646-09f0-4991-8dbc-6ee0eb7acfb8 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] HTTP exception thrown: Instance 0581f7e5-2719-4aa6-8f59-7522c3004ade could not be found. Aug 27 03:37:49.737419 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d1a8c646-09f0-4991-8dbc-6ee0eb7acfb8 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Request method failure captured: Aug 27 03:37:49.737419 n-d-852278-4 devstack@n-api.service[134052]: request: DELETE /compute/v2.1/servers/0581f7e5-2719-4aa6-8f59-7522c3004ade HTTP/1.1 Aug 27 03:37:49.737419 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 03:37:49.737419 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 03:37:49.737419 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 03:37:49.737419 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 03:37:49.737419 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 03:37:49.737419 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 03:37:49.737419 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 03:37:49.737419 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 03:37:49.737419 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCZEmqZudcNQdXPK1yiyTtF9fJ1fZMwFgGmt44ZeOfi_SmO_3lgdUUDT40liQuZ6VZi0yGTTVM2CrldGaAMD5oCfUkhddDR_xT28q7Z_yKkd10IZsMNJdf5iuOxAE5g1aeSxRyoHC5RCd1cvPo7WwftTdUFsLKOZuzOoOOR0WtAZJdUI Aug 27 03:37:49.737419 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 03:37:49.737419 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 03:37:49.737419 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 03:37:49.737419 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 03:37:49.737419 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 03:37:49.737419 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 03:37:49.737419 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: afc621ea3ee54c5eafd4fbb93e357b3f Aug 27 03:37:49.737419 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ServerDiskConfigTestJSON-801621628 Aug 27 03:37:49.737419 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 03:37:49.737419 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 03:37:49.737419 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/afc621ea3ee54c5eafd4fbb93e357b3f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_afc621ea3ee54c5eafd4fbb93e357b3f", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/afc621ea3ee54c5eafd4fbb93e357b3f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/afc621ea3ee54c5eafd4fbb93e357b3f"}]}] Aug 27 03:37:49.737419 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ServerDiskConfigTestJSON-801621628 Aug 27 03:37:49.737419 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: afc621ea3ee54c5eafd4fbb93e357b3f Aug 27 03:37:49.737419 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-801621628 Aug 27 03:37:49.737419 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ServerDiskConfigTestJSON-801621628-project Aug 27 03:37:49.737419 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 03:37:49.737419 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 03:37:49.737419 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 5fc98a4e7de34bc1ad629247458a1fe2 Aug 27 03:37:49.737419 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ServerDiskConfigTestJSON-801621628-project Aug 27 03:37:49.737419 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 03:37:49.737419 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance 0581f7e5-2719-4aa6-8f59-7522c3004ade could not be found. Aug 27 03:37:49.737419 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '0581f7e5-2719-4aa6-8f59-7522c3004ade'} Aug 27 03:37:49.737419 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:37:49.737419 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:37:49.737419 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:37:49.737419 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:37:49.737419 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:37:49.737419 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:37:49.737419 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:37:49.737419 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:37:49.737419 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:37:49.737419 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:37:49.737419 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0581f7e5-2719-4aa6-8f59-7522c3004ade could not be found. Aug 27 03:37:49.737419 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:37:49.737419 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:37:49.737419 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:37:49.737419 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:37:49.737419 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:37:49.737419 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:37:49.737419 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:37:49.737419 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:37:49.737419 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:37:49.737419 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:37:49.737419 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 03:37:49.737419 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 03:37:49.737419 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 03:37:49.737419 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 03:37:49.737419 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:37:49.737419 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:37:49.737419 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:37:49.737419 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:37:49.740816 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0581f7e5-2719-4aa6-8f59-7522c3004ade could not be found. Aug 27 03:37:49.740816 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:37:49.740816 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:37:49.740816 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:37:49.740816 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:37:49.740816 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:37:49.740816 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:37:49.740816 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:37:49.740816 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:37:49.740816 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0581f7e5-2719-4aa6-8f59-7522c3004ade could not be found. Aug 27 03:37:49.740816 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:37:49.740816 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d1a8c646-09f0-4991-8dbc-6ee0eb7acfb8 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Returning 404 to user: Instance 0581f7e5-2719-4aa6-8f59-7522c3004ade could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:37:49.740816 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d1a8c646-09f0-4991-8dbc-6ee0eb7acfb8 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] 10.222.0.70 "DELETE /compute/v2.1/servers/0581f7e5-2719-4aa6-8f59-7522c3004ade" status: 404 len: 111 microversion: 2.1 time: 0.030918 Aug 27 03:37:49.740816 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3194/6431] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 03:37:49 2022] DELETE /compute/v2.1/servers/0581f7e5-2719-4aa6-8f59-7522c3004ade => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:37:49.752681 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3581adfe-2cfc-4fdf-9125-0089b21db129 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:49.753615 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-3581adfe-2cfc-4fdf-9125-0089b21db129 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] [instance: 0581f7e5-2719-4aa6-8f59-7522c3004ade] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:49.763477 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3581adfe-2cfc-4fdf-9125-0089b21db129 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:49.764186 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3581adfe-2cfc-4fdf-9125-0089b21db129 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:49.764793 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3581adfe-2cfc-4fdf-9125-0089b21db129 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:49.765795 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3581adfe-2cfc-4fdf-9125-0089b21db129 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:49.766398 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3581adfe-2cfc-4fdf-9125-0089b21db129 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:49.766931 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3581adfe-2cfc-4fdf-9125-0089b21db129 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:49.780812 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-3581adfe-2cfc-4fdf-9125-0089b21db129 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] HTTP exception thrown: Instance 0581f7e5-2719-4aa6-8f59-7522c3004ade could not be found. Aug 27 03:37:49.782461 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3581adfe-2cfc-4fdf-9125-0089b21db129 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Request method failure captured: Aug 27 03:37:49.782461 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/0581f7e5-2719-4aa6-8f59-7522c3004ade HTTP/1.1 Aug 27 03:37:49.782461 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 03:37:49.782461 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 03:37:49.782461 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 03:37:49.782461 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 03:37:49.782461 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 03:37:49.782461 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 03:37:49.782461 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 03:37:49.782461 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 03:37:49.782461 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCZEmqZudcNQdXPK1yiyTtF9fJ1fZMwFgGmt44ZeOfi_SmO_3lgdUUDT40liQuZ6VZi0yGTTVM2CrldGaAMD5oCfUkhddDR_xT28q7Z_yKkd10IZsMNJdf5iuOxAE5g1aeSxRyoHC5RCd1cvPo7WwftTdUFsLKOZuzOoOOR0WtAZJdUI Aug 27 03:37:49.782461 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 03:37:49.782461 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 03:37:49.782461 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 03:37:49.782461 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 03:37:49.782461 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 03:37:49.782461 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 03:37:49.782461 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: afc621ea3ee54c5eafd4fbb93e357b3f Aug 27 03:37:49.782461 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ServerDiskConfigTestJSON-801621628 Aug 27 03:37:49.782461 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 03:37:49.782461 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 03:37:49.782461 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/afc621ea3ee54c5eafd4fbb93e357b3f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_afc621ea3ee54c5eafd4fbb93e357b3f", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/afc621ea3ee54c5eafd4fbb93e357b3f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/afc621ea3ee54c5eafd4fbb93e357b3f"}]}] Aug 27 03:37:49.782461 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ServerDiskConfigTestJSON-801621628 Aug 27 03:37:49.782461 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: afc621ea3ee54c5eafd4fbb93e357b3f Aug 27 03:37:49.782461 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-801621628 Aug 27 03:37:49.782461 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ServerDiskConfigTestJSON-801621628-project Aug 27 03:37:49.782461 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 03:37:49.782461 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 03:37:49.782461 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 5fc98a4e7de34bc1ad629247458a1fe2 Aug 27 03:37:49.782461 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ServerDiskConfigTestJSON-801621628-project Aug 27 03:37:49.782461 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 03:37:49.782461 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance 0581f7e5-2719-4aa6-8f59-7522c3004ade could not be found. Aug 27 03:37:49.782461 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '0581f7e5-2719-4aa6-8f59-7522c3004ade'} Aug 27 03:37:49.782461 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:37:49.782461 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:37:49.782461 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:37:49.782461 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:37:49.782461 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:37:49.782461 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:37:49.782461 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:37:49.782461 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:37:49.782461 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:37:49.782461 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:37:49.782461 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0581f7e5-2719-4aa6-8f59-7522c3004ade could not be found. Aug 27 03:37:49.782461 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:37:49.782461 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:37:49.782461 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:37:49.782461 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:37:49.782461 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:37:49.782461 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:37:49.782461 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:37:49.782461 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:37:49.782461 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:37:49.782461 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:37:49.782461 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:37:49.782461 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:37:49.782461 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:37:49.782461 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:37:49.782461 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:37:49.782461 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:37:49.782461 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0581f7e5-2719-4aa6-8f59-7522c3004ade could not be found. Aug 27 03:37:49.782461 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:37:49.782461 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:37:49.782461 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:37:49.786003 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:37:49.786003 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:37:49.786003 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:37:49.786003 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:37:49.786003 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:37:49.786003 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0581f7e5-2719-4aa6-8f59-7522c3004ade could not be found. Aug 27 03:37:49.786003 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:37:49.786003 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3581adfe-2cfc-4fdf-9125-0089b21db129 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] Returning 404 to user: Instance 0581f7e5-2719-4aa6-8f59-7522c3004ade could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:37:49.786003 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-3581adfe-2cfc-4fdf-9125-0089b21db129 tempest-ServerDiskConfigTestJSON-801621628 tempest-ServerDiskConfigTestJSON-801621628-project] 10.222.0.70 "GET /compute/v2.1/servers/0581f7e5-2719-4aa6-8f59-7522c3004ade" status: 404 len: 111 microversion: 2.1 time: 0.039738 Aug 27 03:37:49.786003 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3238/6432] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:49 2022] GET /compute/v2.1/servers/0581f7e5-2719-4aa6-8f59-7522c3004ade => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:37:58.542808 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8d34071e-6960-48fa-9f68-87fde1323a29 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Action: 'create', calling method: .version_select at 0x7f5ee2f7eaf0>, body: {"keypair": {"name": "tempest-keypair-1055144708", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHxELiNNLkaNh0KFy8oYDjztl/gvySad+9cG7wXrCRUbH9iHhSaNfNQ73IRbT8mJ+d3JARgxCnMBD2LpofEC6ghesC9x7d5YoLxNXIrPSWGPV/cfIMOeLEwawT3KfLqo2w=="}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:37:58.560651 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-8d34071e-6960-48fa-9f68-87fde1323a29 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Getting quotas for project cc3aa9846bcb40518ac54e31208ce043. Resources: {'key_pairs'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:37:58.566231 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-8d34071e-6960-48fa-9f68-87fde1323a29 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Getting quotas for user c62665fa43c34e6eb695633905cf3b84 and project cc3aa9846bcb40518ac54e31208ce043. Resources: {'key_pairs'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:37:58.593414 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-8d34071e-6960-48fa-9f68-87fde1323a29 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.171133 Aug 27 03:37:58.594032 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3195/6433] 10.222.0.70 () {60 vars in 1159 bytes} [Sat Aug 27 03:37:58 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:37:59.927889 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8b722412-dc38-441e-88cd-44a9ee4e165d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-328236067", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "58a8af60-9bb2-4790-9c69-3b7ee60e6ff0"}], "security_groups": [{"name": "tempest-securitygroup--353980153"}], "key_name": "tempest-keypair-1055144708", "user_data": "}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:37:59.937294 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=4,nova_api:DELETE=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:37:59.938334 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:38:00.243635 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.network.neutron [None req-8b722412-dc38-441e-88cd-44a9ee4e165d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] validate_networks() for [('58a8af60-9bb2-4790-9c69-3b7ee60e6ff0', None, None, None, None, None)] {{(pid=134051) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:38:00.703564 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-8b722412-dc38-441e-88cd-44a9ee4e165d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Flavor limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:38:00.704005 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-8b722412-dc38-441e-88cd-44a9ee4e165d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Image limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:38:00.704700 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-8b722412-dc38-441e-88cd-44a9ee4e165d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Flavor pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:38:00.705151 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-8b722412-dc38-441e-88cd-44a9ee4e165d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Image pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:38:00.705604 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-8b722412-dc38-441e-88cd-44a9ee4e165d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:38:00.714745 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8b722412-dc38-441e-88cd-44a9ee4e165d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:00.715202 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8b722412-dc38-441e-88cd-44a9ee4e165d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:00.716374 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8b722412-dc38-441e-88cd-44a9ee4e165d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:00.716622 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8b722412-dc38-441e-88cd-44a9ee4e165d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:00.717083 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8b722412-dc38-441e-88cd-44a9ee4e165d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:00.717511 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8b722412-dc38-441e-88cd-44a9ee4e165d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:00.734859 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-8b722412-dc38-441e-88cd-44a9ee4e165d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Getting quotas for project cc3aa9846bcb40518ac54e31208ce043. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:38:00.740773 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-8b722412-dc38-441e-88cd-44a9ee4e165d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Getting quotas for user c62665fa43c34e6eb695633905cf3b84 and project cc3aa9846bcb40518ac54e31208ce043. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:38:00.754437 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-8b722412-dc38-441e-88cd-44a9ee4e165d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Going to run 1 instances... {{(pid=134051) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:38:00.758152 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-8b722412-dc38-441e-88cd-44a9ee4e165d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c06803f-bcfc-48f5-be04-98e6f981a03c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134051) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:38:00.812262 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-8b722412-dc38-441e-88cd-44a9ee4e165d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.888750 Aug 27 03:38:00.813127 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3239/6434] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 03:37:59 2022] POST /compute/v2.1/servers => generated 408 bytes in 890 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:38:00.824609 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-85238533-60fb-4fcf-b45e-ee75fbe6e562 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:00.825356 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-85238533-60fb-4fcf-b45e-ee75fbe6e562 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c06803f-bcfc-48f5-be04-98e6f981a03c] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:38:00.844908 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:38:00.899000 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-85238533-60fb-4fcf-b45e-ee75fbe6e562 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:00.906276 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-85238533-60fb-4fcf-b45e-ee75fbe6e562 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/2c06803f-bcfc-48f5-be04-98e6f981a03c" status: 200 len: 1238 microversion: 2.1 time: 0.086108 Aug 27 03:38:00.906862 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3196/6435] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:38:00 2022] GET /compute/v2.1/servers/2c06803f-bcfc-48f5-be04-98e6f981a03c => generated 1238 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:01.929965 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a9acf3c9-bb44-4c45-aaec-3ffcca45ea3e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:01.930833 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-a9acf3c9-bb44-4c45-aaec-3ffcca45ea3e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c06803f-bcfc-48f5-be04-98e6f981a03c] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:38:01.955290 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a9acf3c9-bb44-4c45-aaec-3ffcca45ea3e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:01.958640 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a9acf3c9-bb44-4c45-aaec-3ffcca45ea3e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:01.959294 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a9acf3c9-bb44-4c45-aaec-3ffcca45ea3e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:01.961475 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a9acf3c9-bb44-4c45-aaec-3ffcca45ea3e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:01.962162 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a9acf3c9-bb44-4c45-aaec-3ffcca45ea3e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:01.962829 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a9acf3c9-bb44-4c45-aaec-3ffcca45ea3e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:02.071434 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-a9acf3c9-bb44-4c45-aaec-3ffcca45ea3e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:02.079650 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a9acf3c9-bb44-4c45-aaec-3ffcca45ea3e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/2c06803f-bcfc-48f5-be04-98e6f981a03c" status: 200 len: 1298 microversion: 2.1 time: 0.155810 Aug 27 03:38:02.080339 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3240/6436] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:38:01 2022] GET /compute/v2.1/servers/2c06803f-bcfc-48f5-be04-98e6f981a03c => generated 1298 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:03.100995 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a95fb36d-0e0d-4014-a139-cfe56de5bc3c tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:03.101890 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a95fb36d-0e0d-4014-a139-cfe56de5bc3c tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c06803f-bcfc-48f5-be04-98e6f981a03c] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:38:03.109693 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a95fb36d-0e0d-4014-a139-cfe56de5bc3c tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:03.110357 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a95fb36d-0e0d-4014-a139-cfe56de5bc3c tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:03.110843 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a95fb36d-0e0d-4014-a139-cfe56de5bc3c tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:03.111550 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a95fb36d-0e0d-4014-a139-cfe56de5bc3c tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:03.112129 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a95fb36d-0e0d-4014-a139-cfe56de5bc3c tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:03.112577 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a95fb36d-0e0d-4014-a139-cfe56de5bc3c tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:03.338812 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-a95fb36d-0e0d-4014-a139-cfe56de5bc3c tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:03.346680 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a95fb36d-0e0d-4014-a139-cfe56de5bc3c tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/2c06803f-bcfc-48f5-be04-98e6f981a03c" status: 200 len: 1363 microversion: 2.1 time: 0.249745 Aug 27 03:38:03.347257 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3197/6437] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:38:03 2022] GET /compute/v2.1/servers/2c06803f-bcfc-48f5-be04-98e6f981a03c => generated 1363 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:03.585911 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-a600a0d0-6959-45c5-8c37-ddaa200569cc req-cb6fdc9c-1372-4854-9f88-eab9160016d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c06803f-bcfc-48f5-be04-98e6f981a03c", "tag": "255289de-0344-43e3-831c-2c5982d88961"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:38:03.598464 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-a600a0d0-6959-45c5-8c37-ddaa200569cc req-cb6fdc9c-1372-4854-9f88-eab9160016d6 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:03.599260 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-a600a0d0-6959-45c5-8c37-ddaa200569cc req-cb6fdc9c-1372-4854-9f88-eab9160016d6 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:03.599886 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-a600a0d0-6959-45c5-8c37-ddaa200569cc req-cb6fdc9c-1372-4854-9f88-eab9160016d6 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:03.613659 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-a600a0d0-6959-45c5-8c37-ddaa200569cc req-cb6fdc9c-1372-4854-9f88-eab9160016d6 service nova] Creating event network-changed:255289de-0344-43e3-831c-2c5982d88961 for instance 2c06803f-bcfc-48f5-be04-98e6f981a03c on n-h2-852278-4 Aug 27 03:38:03.621265 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-a600a0d0-6959-45c5-8c37-ddaa200569cc req-cb6fdc9c-1372-4854-9f88-eab9160016d6 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039321 Aug 27 03:38:03.622294 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3241/6438] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:38:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:38:04.370541 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3c0b7ea5-9ef8-40de-b904-44124c500cfa tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:04.371409 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-3c0b7ea5-9ef8-40de-b904-44124c500cfa tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c06803f-bcfc-48f5-be04-98e6f981a03c] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:38:04.380215 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3c0b7ea5-9ef8-40de-b904-44124c500cfa tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:04.380740 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3c0b7ea5-9ef8-40de-b904-44124c500cfa tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:04.381180 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3c0b7ea5-9ef8-40de-b904-44124c500cfa tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:04.381880 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3c0b7ea5-9ef8-40de-b904-44124c500cfa tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:04.382340 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3c0b7ea5-9ef8-40de-b904-44124c500cfa tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:04.382769 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3c0b7ea5-9ef8-40de-b904-44124c500cfa tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:04.519366 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-3c0b7ea5-9ef8-40de-b904-44124c500cfa tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:04.527257 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-3c0b7ea5-9ef8-40de-b904-44124c500cfa tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/2c06803f-bcfc-48f5-be04-98e6f981a03c" status: 200 len: 1363 microversion: 2.1 time: 0.162691 Aug 27 03:38:04.527770 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3198/6439] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:38:04 2022] GET /compute/v2.1/servers/2c06803f-bcfc-48f5-be04-98e6f981a03c => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:05.549847 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-084d320a-82da-40b4-abc1-c1453a2cac65 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:05.550580 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-084d320a-82da-40b4-abc1-c1453a2cac65 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c06803f-bcfc-48f5-be04-98e6f981a03c] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:38:05.557445 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-084d320a-82da-40b4-abc1-c1453a2cac65 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:05.557954 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-084d320a-82da-40b4-abc1-c1453a2cac65 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:05.558414 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-084d320a-82da-40b4-abc1-c1453a2cac65 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:05.559129 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-084d320a-82da-40b4-abc1-c1453a2cac65 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:05.559598 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-084d320a-82da-40b4-abc1-c1453a2cac65 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:05.560040 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-084d320a-82da-40b4-abc1-c1453a2cac65 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:06.051376 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-084d320a-82da-40b4-abc1-c1453a2cac65 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:06.059875 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-084d320a-82da-40b4-abc1-c1453a2cac65 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/2c06803f-bcfc-48f5-be04-98e6f981a03c" status: 200 len: 1363 microversion: 2.1 time: 0.515646 Aug 27 03:38:06.060492 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3242/6440] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:38:05 2022] GET /compute/v2.1/servers/2c06803f-bcfc-48f5-be04-98e6f981a03c => generated 1363 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:07.083152 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b717d439-e8fb-4481-a14b-d033590e008a tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:07.083775 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b717d439-e8fb-4481-a14b-d033590e008a tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c06803f-bcfc-48f5-be04-98e6f981a03c] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:38:07.091342 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b717d439-e8fb-4481-a14b-d033590e008a tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:07.091849 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b717d439-e8fb-4481-a14b-d033590e008a tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:07.092303 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b717d439-e8fb-4481-a14b-d033590e008a tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:07.093054 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b717d439-e8fb-4481-a14b-d033590e008a tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:07.093520 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b717d439-e8fb-4481-a14b-d033590e008a tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:07.093963 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b717d439-e8fb-4481-a14b-d033590e008a tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:07.232204 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b717d439-e8fb-4481-a14b-d033590e008a tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:07.240573 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b717d439-e8fb-4481-a14b-d033590e008a tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/2c06803f-bcfc-48f5-be04-98e6f981a03c" status: 200 len: 1363 microversion: 2.1 time: 0.163030 Aug 27 03:38:07.241157 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3199/6441] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:38:07 2022] GET /compute/v2.1/servers/2c06803f-bcfc-48f5-be04-98e6f981a03c => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:08.262684 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3b8ec6fd-7f1b-4e6b-8129-932b89febcd0 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:08.263400 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-3b8ec6fd-7f1b-4e6b-8129-932b89febcd0 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c06803f-bcfc-48f5-be04-98e6f981a03c] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:38:08.264825 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-26cef234-4cdd-4423-ba29-c272595db978 req-b736c3f3-445f-4208-9317-0c66893fcc14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c06803f-bcfc-48f5-be04-98e6f981a03c", "name": "network-vif-plugged", "status": "completed", "tag": "255289de-0344-43e3-831c-2c5982d88961"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:38:08.270992 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3b8ec6fd-7f1b-4e6b-8129-932b89febcd0 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:08.271570 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3b8ec6fd-7f1b-4e6b-8129-932b89febcd0 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:08.272201 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3b8ec6fd-7f1b-4e6b-8129-932b89febcd0 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:08.273525 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3b8ec6fd-7f1b-4e6b-8129-932b89febcd0 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:08.274170 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3b8ec6fd-7f1b-4e6b-8129-932b89febcd0 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:08.274757 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3b8ec6fd-7f1b-4e6b-8129-932b89febcd0 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:08.276659 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-26cef234-4cdd-4423-ba29-c272595db978 req-b736c3f3-445f-4208-9317-0c66893fcc14 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:08.277143 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-26cef234-4cdd-4423-ba29-c272595db978 req-b736c3f3-445f-4208-9317-0c66893fcc14 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:08.277570 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-26cef234-4cdd-4423-ba29-c272595db978 req-b736c3f3-445f-4208-9317-0c66893fcc14 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:08.290648 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-26cef234-4cdd-4423-ba29-c272595db978 req-b736c3f3-445f-4208-9317-0c66893fcc14 service nova] Creating event network-vif-plugged:255289de-0344-43e3-831c-2c5982d88961 for instance 2c06803f-bcfc-48f5-be04-98e6f981a03c on n-h2-852278-4 Aug 27 03:38:08.297663 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-26cef234-4cdd-4423-ba29-c272595db978 req-b736c3f3-445f-4208-9317-0c66893fcc14 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037324 Aug 27 03:38:08.298377 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3200/6442] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:38:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:38:08.456686 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-3b8ec6fd-7f1b-4e6b-8129-932b89febcd0 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:08.464549 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-3b8ec6fd-7f1b-4e6b-8129-932b89febcd0 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/2c06803f-bcfc-48f5-be04-98e6f981a03c" status: 200 len: 1363 microversion: 2.1 time: 0.206918 Aug 27 03:38:08.465149 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3243/6443] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:38:08 2022] GET /compute/v2.1/servers/2c06803f-bcfc-48f5-be04-98e6f981a03c => generated 1363 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:09.488056 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a5473ebc-1c29-4a49-a3ad-e66609e8f9e9 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:09.488782 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a5473ebc-1c29-4a49-a3ad-e66609e8f9e9 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c06803f-bcfc-48f5-be04-98e6f981a03c] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:38:09.495181 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a5473ebc-1c29-4a49-a3ad-e66609e8f9e9 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:09.495763 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a5473ebc-1c29-4a49-a3ad-e66609e8f9e9 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:09.496241 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a5473ebc-1c29-4a49-a3ad-e66609e8f9e9 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:09.496931 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a5473ebc-1c29-4a49-a3ad-e66609e8f9e9 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:09.497387 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a5473ebc-1c29-4a49-a3ad-e66609e8f9e9 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:09.497815 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a5473ebc-1c29-4a49-a3ad-e66609e8f9e9 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:09.643418 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-a5473ebc-1c29-4a49-a3ad-e66609e8f9e9 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:09.651187 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a5473ebc-1c29-4a49-a3ad-e66609e8f9e9 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/2c06803f-bcfc-48f5-be04-98e6f981a03c" status: 200 len: 1363 microversion: 2.1 time: 0.169918 Aug 27 03:38:09.651769 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3201/6444] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:38:09 2022] GET /compute/v2.1/servers/2c06803f-bcfc-48f5-be04-98e6f981a03c => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:10.672980 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ad4654e6-9372-4d1c-8ccb-86ce485ef805 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:10.673627 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-ad4654e6-9372-4d1c-8ccb-86ce485ef805 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c06803f-bcfc-48f5-be04-98e6f981a03c] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:38:10.681354 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ad4654e6-9372-4d1c-8ccb-86ce485ef805 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:10.681862 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ad4654e6-9372-4d1c-8ccb-86ce485ef805 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:10.682315 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ad4654e6-9372-4d1c-8ccb-86ce485ef805 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:10.683025 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ad4654e6-9372-4d1c-8ccb-86ce485ef805 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:10.683492 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ad4654e6-9372-4d1c-8ccb-86ce485ef805 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:10.683931 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ad4654e6-9372-4d1c-8ccb-86ce485ef805 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:10.724721 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:38:10.747652 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=6 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:38:10.815180 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-ad4654e6-9372-4d1c-8ccb-86ce485ef805 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:10.827655 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ad4654e6-9372-4d1c-8ccb-86ce485ef805 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/2c06803f-bcfc-48f5-be04-98e6f981a03c" status: 200 len: 1549 microversion: 2.1 time: 0.159501 Aug 27 03:38:10.828543 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3244/6445] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:38:10 2022] GET /compute/v2.1/servers/2c06803f-bcfc-48f5-be04-98e6f981a03c => generated 1549 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:10.850692 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c69b725c-0078-43cb-b7cb-29068dbd6d02 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:10.851197 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-c69b725c-0078-43cb-b7cb-29068dbd6d02 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c06803f-bcfc-48f5-be04-98e6f981a03c] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:38:10.858646 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c69b725c-0078-43cb-b7cb-29068dbd6d02 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:10.859133 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c69b725c-0078-43cb-b7cb-29068dbd6d02 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:10.859566 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c69b725c-0078-43cb-b7cb-29068dbd6d02 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:10.860246 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c69b725c-0078-43cb-b7cb-29068dbd6d02 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:10.860757 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c69b725c-0078-43cb-b7cb-29068dbd6d02 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:10.861180 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c69b725c-0078-43cb-b7cb-29068dbd6d02 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:10.906302 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=6 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:38:10.940615 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c69b725c-0078-43cb-b7cb-29068dbd6d02 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/2c06803f-bcfc-48f5-be04-98e6f981a03c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093748 Aug 27 03:38:10.941246 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3202/6446] 10.222.0.70 () {58 vars in 1275 bytes} [Sat Aug 27 03:38:10 2022] GET /compute/v2.1/servers/2c06803f-bcfc-48f5-be04-98e6f981a03c/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:38:11.918681 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-d9c2ac5e-81b9-4791-9515-152e605554e6 req-77414aa9-2b0b-4dc8-9a03-e4aa55aa62ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c06803f-bcfc-48f5-be04-98e6f981a03c", "tag": "255289de-0344-43e3-831c-2c5982d88961"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:38:11.930134 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-d9c2ac5e-81b9-4791-9515-152e605554e6 req-77414aa9-2b0b-4dc8-9a03-e4aa55aa62ca service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:11.930694 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-d9c2ac5e-81b9-4791-9515-152e605554e6 req-77414aa9-2b0b-4dc8-9a03-e4aa55aa62ca service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:11.931142 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-d9c2ac5e-81b9-4791-9515-152e605554e6 req-77414aa9-2b0b-4dc8-9a03-e4aa55aa62ca service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:11.942608 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-d9c2ac5e-81b9-4791-9515-152e605554e6 req-77414aa9-2b0b-4dc8-9a03-e4aa55aa62ca service nova] Creating event network-changed:255289de-0344-43e3-831c-2c5982d88961 for instance 2c06803f-bcfc-48f5-be04-98e6f981a03c on n-h2-852278-4 Aug 27 03:38:11.948018 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-d9c2ac5e-81b9-4791-9515-152e605554e6 req-77414aa9-2b0b-4dc8-9a03-e4aa55aa62ca service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032993 Aug 27 03:38:11.948601 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3245/6447] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:38:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:38:45.809854 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:38:45.810910 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=30 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:38:45.817703 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-53579382-9733-4563-9474-3442a00b0ca7 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:45.818698 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-53579382-9733-4563-9474-3442a00b0ca7 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c06803f-bcfc-48f5-be04-98e6f981a03c] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:38:45.827760 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-53579382-9733-4563-9474-3442a00b0ca7 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:45.828269 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-53579382-9733-4563-9474-3442a00b0ca7 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:45.828736 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-53579382-9733-4563-9474-3442a00b0ca7 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:45.829418 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-53579382-9733-4563-9474-3442a00b0ca7 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:45.829864 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-53579382-9733-4563-9474-3442a00b0ca7 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:45.830287 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-53579382-9733-4563-9474-3442a00b0ca7 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:45.972724 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-53579382-9733-4563-9474-3442a00b0ca7 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:45.983786 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-53579382-9733-4563-9474-3442a00b0ca7 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/2c06803f-bcfc-48f5-be04-98e6f981a03c" status: 200 len: 1667 microversion: 2.1 time: 0.177315 Aug 27 03:38:45.984527 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3203/6448] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:38:45 2022] GET /compute/v2.1/servers/2c06803f-bcfc-48f5-be04-98e6f981a03c => generated 1667 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:46.008139 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:38:46.009145 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=30 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:38:46.015007 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-550c783a-9530-4895-b1b1-6c6240eb7f21 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:46.016065 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-550c783a-9530-4895-b1b1-6c6240eb7f21 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c06803f-bcfc-48f5-be04-98e6f981a03c] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:38:46.026808 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-550c783a-9530-4895-b1b1-6c6240eb7f21 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:46.027525 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-550c783a-9530-4895-b1b1-6c6240eb7f21 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:46.028220 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-550c783a-9530-4895-b1b1-6c6240eb7f21 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:46.029309 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-550c783a-9530-4895-b1b1-6c6240eb7f21 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:46.029996 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-550c783a-9530-4895-b1b1-6c6240eb7f21 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:46.030659 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-550c783a-9530-4895-b1b1-6c6240eb7f21 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:46.171340 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-550c783a-9530-4895-b1b1-6c6240eb7f21 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:46.182570 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-550c783a-9530-4895-b1b1-6c6240eb7f21 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/2c06803f-bcfc-48f5-be04-98e6f981a03c" status: 200 len: 1667 microversion: 2.1 time: 0.177865 Aug 27 03:38:46.183150 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3246/6449] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:38:46 2022] GET /compute/v2.1/servers/2c06803f-bcfc-48f5-be04-98e6f981a03c => generated 1667 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:46.202392 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-85f44dcd-b38b-41c2-87ca-53b86364ffc5 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:46.203025 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-85f44dcd-b38b-41c2-87ca-53b86364ffc5 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c06803f-bcfc-48f5-be04-98e6f981a03c] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:38:46.209501 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-85f44dcd-b38b-41c2-87ca-53b86364ffc5 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:46.209986 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-85f44dcd-b38b-41c2-87ca-53b86364ffc5 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:46.210422 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-85f44dcd-b38b-41c2-87ca-53b86364ffc5 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:46.211124 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-85f44dcd-b38b-41c2-87ca-53b86364ffc5 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:46.211567 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-85f44dcd-b38b-41c2-87ca-53b86364ffc5 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:46.211992 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-85f44dcd-b38b-41c2-87ca-53b86364ffc5 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:46.358884 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-85f44dcd-b38b-41c2-87ca-53b86364ffc5 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:46.369486 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-85f44dcd-b38b-41c2-87ca-53b86364ffc5 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/2c06803f-bcfc-48f5-be04-98e6f981a03c" status: 200 len: 1667 microversion: 2.1 time: 0.170595 Aug 27 03:38:46.370121 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3204/6450] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:38:46 2022] GET /compute/v2.1/servers/2c06803f-bcfc-48f5-be04-98e6f981a03c => generated 1667 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:46.392737 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8f353cff-4094-469a-a945-0e7e083a58b4 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:38:46.396386 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-8f353cff-4094-469a-a945-0e7e083a58b4 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c06803f-bcfc-48f5-be04-98e6f981a03c] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:38:46.404348 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8f353cff-4094-469a-a945-0e7e083a58b4 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:46.404868 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8f353cff-4094-469a-a945-0e7e083a58b4 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:46.405319 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8f353cff-4094-469a-a945-0e7e083a58b4 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:46.406034 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8f353cff-4094-469a-a945-0e7e083a58b4 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:46.406497 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8f353cff-4094-469a-a945-0e7e083a58b4 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:46.406933 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8f353cff-4094-469a-a945-0e7e083a58b4 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:46.437983 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-8f353cff-4094-469a-a945-0e7e083a58b4 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:46.444142 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-8f353cff-4094-469a-a945-0e7e083a58b4 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c06803f-bcfc-48f5-be04-98e6f981a03c] Old instance type m1.heat2, new instance type m1.heat {{(pid=134051) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 27 03:38:46.451694 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-8f353cff-4094-469a-a945-0e7e083a58b4 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Flavor limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:38:46.452123 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-8f353cff-4094-469a-a945-0e7e083a58b4 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Image limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:38:46.452638 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-8f353cff-4094-469a-a945-0e7e083a58b4 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Flavor pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:38:46.453053 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-8f353cff-4094-469a-a945-0e7e083a58b4 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Image pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:38:46.453471 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-8f353cff-4094-469a-a945-0e7e083a58b4 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:38:46.525038 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-8f353cff-4094-469a-a945-0e7e083a58b4 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "POST /compute/v2.1/servers/2c06803f-bcfc-48f5-be04-98e6f981a03c/action" status: 202 len: 0 microversion: 2.1 time: 0.138780 Aug 27 03:38:46.525856 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3247/6451] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:38:46 2022] POST /compute/v2.1/servers/2c06803f-bcfc-48f5-be04-98e6f981a03c/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:38:46.534072 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8689f8e8-5036-4a9c-9e8d-cffb50d8a534 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:46.534810 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-8689f8e8-5036-4a9c-9e8d-cffb50d8a534 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c06803f-bcfc-48f5-be04-98e6f981a03c] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:38:46.541150 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8689f8e8-5036-4a9c-9e8d-cffb50d8a534 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:46.541685 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8689f8e8-5036-4a9c-9e8d-cffb50d8a534 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:46.542124 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8689f8e8-5036-4a9c-9e8d-cffb50d8a534 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:46.542945 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8689f8e8-5036-4a9c-9e8d-cffb50d8a534 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:46.543404 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8689f8e8-5036-4a9c-9e8d-cffb50d8a534 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:46.543829 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8689f8e8-5036-4a9c-9e8d-cffb50d8a534 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:46.706376 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-8689f8e8-5036-4a9c-9e8d-cffb50d8a534 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:46.720180 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-8689f8e8-5036-4a9c-9e8d-cffb50d8a534 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/2c06803f-bcfc-48f5-be04-98e6f981a03c" status: 200 len: 1676 microversion: 2.1 time: 0.190109 Aug 27 03:38:46.721292 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3205/6452] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:38:46 2022] GET /compute/v2.1/servers/2c06803f-bcfc-48f5-be04-98e6f981a03c => generated 1676 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:47.746990 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-540d8552-fb08-494a-86e4-071a84e54f82 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:47.747742 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-540d8552-fb08-494a-86e4-071a84e54f82 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c06803f-bcfc-48f5-be04-98e6f981a03c] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:38:47.754799 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-540d8552-fb08-494a-86e4-071a84e54f82 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:47.755336 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-540d8552-fb08-494a-86e4-071a84e54f82 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:47.755831 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-540d8552-fb08-494a-86e4-071a84e54f82 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:47.756662 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-540d8552-fb08-494a-86e4-071a84e54f82 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:47.757165 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-540d8552-fb08-494a-86e4-071a84e54f82 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:47.757684 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-540d8552-fb08-494a-86e4-071a84e54f82 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:47.931004 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-540d8552-fb08-494a-86e4-071a84e54f82 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:47.939228 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-540d8552-fb08-494a-86e4-071a84e54f82 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/2c06803f-bcfc-48f5-be04-98e6f981a03c" status: 200 len: 1676 microversion: 2.1 time: 0.199306 Aug 27 03:38:47.939810 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3248/6453] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:38:47 2022] GET /compute/v2.1/servers/2c06803f-bcfc-48f5-be04-98e6f981a03c => generated 1676 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:48.960531 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-107e9930-198d-4160-916c-101c7d1b22bc tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:48.961153 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-107e9930-198d-4160-916c-101c7d1b22bc tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c06803f-bcfc-48f5-be04-98e6f981a03c] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:38:48.968496 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-107e9930-198d-4160-916c-101c7d1b22bc tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:48.968985 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-107e9930-198d-4160-916c-101c7d1b22bc tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:48.969422 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-107e9930-198d-4160-916c-101c7d1b22bc tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:48.970127 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-107e9930-198d-4160-916c-101c7d1b22bc tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:48.970580 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-107e9930-198d-4160-916c-101c7d1b22bc tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:48.971003 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-107e9930-198d-4160-916c-101c7d1b22bc tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:49.111840 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-107e9930-198d-4160-916c-101c7d1b22bc tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:49.120431 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-107e9930-198d-4160-916c-101c7d1b22bc tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/2c06803f-bcfc-48f5-be04-98e6f981a03c" status: 200 len: 1681 microversion: 2.1 time: 0.163859 Aug 27 03:38:49.121066 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3206/6454] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:38:48 2022] GET /compute/v2.1/servers/2c06803f-bcfc-48f5-be04-98e6f981a03c => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:50.142942 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7d4eab45-2aae-4249-a7ed-29157f6add09 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:50.143613 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-7d4eab45-2aae-4249-a7ed-29157f6add09 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c06803f-bcfc-48f5-be04-98e6f981a03c] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:38:50.151671 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7d4eab45-2aae-4249-a7ed-29157f6add09 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:50.152181 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7d4eab45-2aae-4249-a7ed-29157f6add09 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:50.152688 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7d4eab45-2aae-4249-a7ed-29157f6add09 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:50.153426 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7d4eab45-2aae-4249-a7ed-29157f6add09 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:50.153894 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7d4eab45-2aae-4249-a7ed-29157f6add09 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:50.154332 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7d4eab45-2aae-4249-a7ed-29157f6add09 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:50.291674 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-7d4eab45-2aae-4249-a7ed-29157f6add09 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:50.299907 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-7d4eab45-2aae-4249-a7ed-29157f6add09 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/2c06803f-bcfc-48f5-be04-98e6f981a03c" status: 200 len: 1681 microversion: 2.1 time: 0.161447 Aug 27 03:38:50.300495 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3249/6455] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:38:50 2022] GET /compute/v2.1/servers/2c06803f-bcfc-48f5-be04-98e6f981a03c => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:51.321371 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9095b9f3-e000-4491-a780-7d02e92b0adb tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:51.321905 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-9095b9f3-e000-4491-a780-7d02e92b0adb tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c06803f-bcfc-48f5-be04-98e6f981a03c] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:38:51.329280 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9095b9f3-e000-4491-a780-7d02e92b0adb tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:51.329766 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9095b9f3-e000-4491-a780-7d02e92b0adb tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:51.330232 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9095b9f3-e000-4491-a780-7d02e92b0adb tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:51.330926 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9095b9f3-e000-4491-a780-7d02e92b0adb tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:51.331504 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9095b9f3-e000-4491-a780-7d02e92b0adb tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:51.331941 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9095b9f3-e000-4491-a780-7d02e92b0adb tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:51.473835 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-9095b9f3-e000-4491-a780-7d02e92b0adb tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:51.482372 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9095b9f3-e000-4491-a780-7d02e92b0adb tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/2c06803f-bcfc-48f5-be04-98e6f981a03c" status: 200 len: 1681 microversion: 2.1 time: 0.165037 Aug 27 03:38:51.482934 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3207/6456] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:38:51 2022] GET /compute/v2.1/servers/2c06803f-bcfc-48f5-be04-98e6f981a03c => generated 1681 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:52.507780 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-640bd4b3-a5f0-4d7e-81a9-fb623485b510 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:52.508725 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-640bd4b3-a5f0-4d7e-81a9-fb623485b510 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c06803f-bcfc-48f5-be04-98e6f981a03c] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:38:52.516996 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-640bd4b3-a5f0-4d7e-81a9-fb623485b510 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:52.517494 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-640bd4b3-a5f0-4d7e-81a9-fb623485b510 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:52.517938 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-640bd4b3-a5f0-4d7e-81a9-fb623485b510 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:52.518640 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-640bd4b3-a5f0-4d7e-81a9-fb623485b510 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:52.519097 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-640bd4b3-a5f0-4d7e-81a9-fb623485b510 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:52.519528 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-640bd4b3-a5f0-4d7e-81a9-fb623485b510 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:52.664515 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-640bd4b3-a5f0-4d7e-81a9-fb623485b510 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:52.673338 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-640bd4b3-a5f0-4d7e-81a9-fb623485b510 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/2c06803f-bcfc-48f5-be04-98e6f981a03c" status: 200 len: 1681 microversion: 2.1 time: 0.172024 Aug 27 03:38:52.673903 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3250/6457] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:38:52 2022] GET /compute/v2.1/servers/2c06803f-bcfc-48f5-be04-98e6f981a03c => generated 1681 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:53.699048 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f705ddf2-8865-4c4d-acc5-419b5021603e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:53.700106 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-f705ddf2-8865-4c4d-acc5-419b5021603e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c06803f-bcfc-48f5-be04-98e6f981a03c] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:38:53.711810 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f705ddf2-8865-4c4d-acc5-419b5021603e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:53.712724 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f705ddf2-8865-4c4d-acc5-419b5021603e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:53.713457 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f705ddf2-8865-4c4d-acc5-419b5021603e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:53.714158 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f705ddf2-8865-4c4d-acc5-419b5021603e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:53.714623 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f705ddf2-8865-4c4d-acc5-419b5021603e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:53.715038 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f705ddf2-8865-4c4d-acc5-419b5021603e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:53.851921 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-f705ddf2-8865-4c4d-acc5-419b5021603e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:53.865054 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f705ddf2-8865-4c4d-acc5-419b5021603e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/2c06803f-bcfc-48f5-be04-98e6f981a03c" status: 200 len: 1681 microversion: 2.1 time: 0.172350 Aug 27 03:38:53.866044 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3208/6458] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:38:53 2022] GET /compute/v2.1/servers/2c06803f-bcfc-48f5-be04-98e6f981a03c => generated 1681 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:54.891317 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-57637480-0328-42ac-9e9d-99768303543f tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:54.892354 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-57637480-0328-42ac-9e9d-99768303543f tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c06803f-bcfc-48f5-be04-98e6f981a03c] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:38:54.904069 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-57637480-0328-42ac-9e9d-99768303543f tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:54.904973 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-57637480-0328-42ac-9e9d-99768303543f tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:54.905734 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-57637480-0328-42ac-9e9d-99768303543f tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:54.906950 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-57637480-0328-42ac-9e9d-99768303543f tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:54.907693 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-57637480-0328-42ac-9e9d-99768303543f tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:54.908483 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-57637480-0328-42ac-9e9d-99768303543f tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:55.058766 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-57637480-0328-42ac-9e9d-99768303543f tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:55.067660 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-57637480-0328-42ac-9e9d-99768303543f tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/2c06803f-bcfc-48f5-be04-98e6f981a03c" status: 200 len: 1681 microversion: 2.1 time: 0.183051 Aug 27 03:38:55.068298 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3251/6459] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:38:54 2022] GET /compute/v2.1/servers/2c06803f-bcfc-48f5-be04-98e6f981a03c => generated 1681 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:56.089273 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3a549dc6-ccba-45b2-aa0b-0536c43cacd8 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:56.090127 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-3a549dc6-ccba-45b2-aa0b-0536c43cacd8 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c06803f-bcfc-48f5-be04-98e6f981a03c] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:38:56.097409 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3a549dc6-ccba-45b2-aa0b-0536c43cacd8 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:56.097923 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3a549dc6-ccba-45b2-aa0b-0536c43cacd8 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:56.098351 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3a549dc6-ccba-45b2-aa0b-0536c43cacd8 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:56.099046 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3a549dc6-ccba-45b2-aa0b-0536c43cacd8 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:56.099489 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3a549dc6-ccba-45b2-aa0b-0536c43cacd8 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:56.099907 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3a549dc6-ccba-45b2-aa0b-0536c43cacd8 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:56.234787 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-3a549dc6-ccba-45b2-aa0b-0536c43cacd8 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:56.243191 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-3a549dc6-ccba-45b2-aa0b-0536c43cacd8 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/2c06803f-bcfc-48f5-be04-98e6f981a03c" status: 200 len: 1681 microversion: 2.1 time: 0.158065 Aug 27 03:38:56.243798 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3209/6460] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:38:56 2022] GET /compute/v2.1/servers/2c06803f-bcfc-48f5-be04-98e6f981a03c => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:57.265718 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d28c8662-025e-4b9d-86cc-ae6129409899 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:57.266450 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d28c8662-025e-4b9d-86cc-ae6129409899 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c06803f-bcfc-48f5-be04-98e6f981a03c] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:38:57.274907 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d28c8662-025e-4b9d-86cc-ae6129409899 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:57.275448 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d28c8662-025e-4b9d-86cc-ae6129409899 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:57.275910 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d28c8662-025e-4b9d-86cc-ae6129409899 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:57.276687 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d28c8662-025e-4b9d-86cc-ae6129409899 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:57.277168 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d28c8662-025e-4b9d-86cc-ae6129409899 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:57.277621 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d28c8662-025e-4b9d-86cc-ae6129409899 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:57.423221 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d28c8662-025e-4b9d-86cc-ae6129409899 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:57.431194 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d28c8662-025e-4b9d-86cc-ae6129409899 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/2c06803f-bcfc-48f5-be04-98e6f981a03c" status: 200 len: 1681 microversion: 2.1 time: 0.169574 Aug 27 03:38:57.432058 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3252/6461] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:38:57 2022] GET /compute/v2.1/servers/2c06803f-bcfc-48f5-be04-98e6f981a03c => generated 1681 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:58.460950 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5c4eb07b-b123-4a52-89c1-5a49b5223af8 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:58.461726 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-5c4eb07b-b123-4a52-89c1-5a49b5223af8 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c06803f-bcfc-48f5-be04-98e6f981a03c] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:38:58.471187 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5c4eb07b-b123-4a52-89c1-5a49b5223af8 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:58.471803 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5c4eb07b-b123-4a52-89c1-5a49b5223af8 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:58.472343 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5c4eb07b-b123-4a52-89c1-5a49b5223af8 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:58.473279 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5c4eb07b-b123-4a52-89c1-5a49b5223af8 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:58.473839 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5c4eb07b-b123-4a52-89c1-5a49b5223af8 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:58.474360 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5c4eb07b-b123-4a52-89c1-5a49b5223af8 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:58.618224 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-5c4eb07b-b123-4a52-89c1-5a49b5223af8 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:58.631221 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-5c4eb07b-b123-4a52-89c1-5a49b5223af8 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/2c06803f-bcfc-48f5-be04-98e6f981a03c" status: 200 len: 1681 microversion: 2.1 time: 0.175102 Aug 27 03:38:58.632059 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3210/6462] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:38:58 2022] GET /compute/v2.1/servers/2c06803f-bcfc-48f5-be04-98e6f981a03c => generated 1681 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:59.656560 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ec995cc1-38d1-4025-acbc-33470213bd99 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:59.657506 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-ec995cc1-38d1-4025-acbc-33470213bd99 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c06803f-bcfc-48f5-be04-98e6f981a03c] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:38:59.667738 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ec995cc1-38d1-4025-acbc-33470213bd99 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:59.668458 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ec995cc1-38d1-4025-acbc-33470213bd99 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:59.669061 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ec995cc1-38d1-4025-acbc-33470213bd99 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:59.670028 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ec995cc1-38d1-4025-acbc-33470213bd99 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:59.670638 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ec995cc1-38d1-4025-acbc-33470213bd99 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:59.671606 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ec995cc1-38d1-4025-acbc-33470213bd99 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:59.830784 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-ec995cc1-38d1-4025-acbc-33470213bd99 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:59.839041 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ec995cc1-38d1-4025-acbc-33470213bd99 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/2c06803f-bcfc-48f5-be04-98e6f981a03c" status: 200 len: 1681 microversion: 2.1 time: 0.188784 Aug 27 03:38:59.839630 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3253/6463] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:38:59 2022] GET /compute/v2.1/servers/2c06803f-bcfc-48f5-be04-98e6f981a03c => generated 1681 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:39:00.863648 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-58721181-6e95-42e2-88be-e2841f4587be tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:39:00.864759 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-58721181-6e95-42e2-88be-e2841f4587be tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c06803f-bcfc-48f5-be04-98e6f981a03c] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:39:00.876019 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-58721181-6e95-42e2-88be-e2841f4587be tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:00.876826 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-58721181-6e95-42e2-88be-e2841f4587be tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:00.877493 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-58721181-6e95-42e2-88be-e2841f4587be tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:00.878555 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-58721181-6e95-42e2-88be-e2841f4587be tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:00.879244 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-58721181-6e95-42e2-88be-e2841f4587be tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:00.879889 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-58721181-6e95-42e2-88be-e2841f4587be tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:01.016208 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-58721181-6e95-42e2-88be-e2841f4587be tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:39:01.024966 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-58721181-6e95-42e2-88be-e2841f4587be tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/2c06803f-bcfc-48f5-be04-98e6f981a03c" status: 200 len: 1681 microversion: 2.1 time: 0.167479 Aug 27 03:39:01.025565 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3211/6464] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:39:00 2022] GET /compute/v2.1/servers/2c06803f-bcfc-48f5-be04-98e6f981a03c => generated 1681 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:39:02.053666 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-259c5358-0ef6-4791-9790-d9ee5e1e826e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:39:02.054544 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-259c5358-0ef6-4791-9790-d9ee5e1e826e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c06803f-bcfc-48f5-be04-98e6f981a03c] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:39:02.062642 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-259c5358-0ef6-4791-9790-d9ee5e1e826e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:02.063146 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-259c5358-0ef6-4791-9790-d9ee5e1e826e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:02.063593 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-259c5358-0ef6-4791-9790-d9ee5e1e826e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:02.064327 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-259c5358-0ef6-4791-9790-d9ee5e1e826e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:02.064801 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-259c5358-0ef6-4791-9790-d9ee5e1e826e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:02.065237 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-259c5358-0ef6-4791-9790-d9ee5e1e826e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:02.208917 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-259c5358-0ef6-4791-9790-d9ee5e1e826e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:39:02.221253 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-259c5358-0ef6-4791-9790-d9ee5e1e826e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/2c06803f-bcfc-48f5-be04-98e6f981a03c" status: 200 len: 1681 microversion: 2.1 time: 0.175042 Aug 27 03:39:02.222137 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3254/6465] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:39:02 2022] GET /compute/v2.1/servers/2c06803f-bcfc-48f5-be04-98e6f981a03c => generated 1681 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:39:03.249792 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-73dedd17-e8d7-40bb-956a-ab1dd606168a tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:39:03.250897 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-73dedd17-e8d7-40bb-956a-ab1dd606168a tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c06803f-bcfc-48f5-be04-98e6f981a03c] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:39:03.261849 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-73dedd17-e8d7-40bb-956a-ab1dd606168a tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:03.262370 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-73dedd17-e8d7-40bb-956a-ab1dd606168a tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:03.262787 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-73dedd17-e8d7-40bb-956a-ab1dd606168a tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:03.263527 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-73dedd17-e8d7-40bb-956a-ab1dd606168a tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:03.263974 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-73dedd17-e8d7-40bb-956a-ab1dd606168a tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:03.264423 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-73dedd17-e8d7-40bb-956a-ab1dd606168a tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:03.413527 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-73dedd17-e8d7-40bb-956a-ab1dd606168a tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:39:03.426123 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-73dedd17-e8d7-40bb-956a-ab1dd606168a tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/2c06803f-bcfc-48f5-be04-98e6f981a03c" status: 200 len: 1681 microversion: 2.1 time: 0.182608 Aug 27 03:39:03.427019 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3212/6466] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:39:03 2022] GET /compute/v2.1/servers/2c06803f-bcfc-48f5-be04-98e6f981a03c => generated 1681 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:39:04.451245 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d8b081c4-8801-4eb1-a01a-7c43964367d2 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:39:04.451883 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d8b081c4-8801-4eb1-a01a-7c43964367d2 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c06803f-bcfc-48f5-be04-98e6f981a03c] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:39:04.462503 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d8b081c4-8801-4eb1-a01a-7c43964367d2 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:04.462983 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d8b081c4-8801-4eb1-a01a-7c43964367d2 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:04.463428 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d8b081c4-8801-4eb1-a01a-7c43964367d2 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:04.464117 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d8b081c4-8801-4eb1-a01a-7c43964367d2 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:04.464601 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d8b081c4-8801-4eb1-a01a-7c43964367d2 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:04.465042 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d8b081c4-8801-4eb1-a01a-7c43964367d2 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:04.613600 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d8b081c4-8801-4eb1-a01a-7c43964367d2 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:39:04.622096 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d8b081c4-8801-4eb1-a01a-7c43964367d2 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/2c06803f-bcfc-48f5-be04-98e6f981a03c" status: 200 len: 1681 microversion: 2.1 time: 0.175444 Aug 27 03:39:04.622690 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3255/6467] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:39:04 2022] GET /compute/v2.1/servers/2c06803f-bcfc-48f5-be04-98e6f981a03c => generated 1681 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:39:05.644194 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-23ca2d5d-ca3b-497a-9680-9acd8f5edcd7 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:39:05.645087 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-23ca2d5d-ca3b-497a-9680-9acd8f5edcd7 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c06803f-bcfc-48f5-be04-98e6f981a03c] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:39:05.657574 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-23ca2d5d-ca3b-497a-9680-9acd8f5edcd7 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:05.658259 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-23ca2d5d-ca3b-497a-9680-9acd8f5edcd7 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:05.658771 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-23ca2d5d-ca3b-497a-9680-9acd8f5edcd7 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:05.659762 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-23ca2d5d-ca3b-497a-9680-9acd8f5edcd7 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:05.660222 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-23ca2d5d-ca3b-497a-9680-9acd8f5edcd7 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:05.660692 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-23ca2d5d-ca3b-497a-9680-9acd8f5edcd7 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:05.913588 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-23ca2d5d-ca3b-497a-9680-9acd8f5edcd7 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:39:05.922352 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-23ca2d5d-ca3b-497a-9680-9acd8f5edcd7 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/2c06803f-bcfc-48f5-be04-98e6f981a03c" status: 200 len: 1680 microversion: 2.1 time: 0.282614 Aug 27 03:39:05.923154 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3213/6468] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:39:05 2022] GET /compute/v2.1/servers/2c06803f-bcfc-48f5-be04-98e6f981a03c => generated 1680 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:39:06.180785 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-f8c38c80-b8d1-4789-a5b6-0ad2c615aeec req-dea55b88-7aaf-4284-a671-479bf9f68675 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c06803f-bcfc-48f5-be04-98e6f981a03c", "name": "network-vif-unplugged", "status": "completed", "tag": "255289de-0344-43e3-831c-2c5982d88961"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:06.191460 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-f8c38c80-b8d1-4789-a5b6-0ad2c615aeec req-dea55b88-7aaf-4284-a671-479bf9f68675 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:06.191959 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-f8c38c80-b8d1-4789-a5b6-0ad2c615aeec req-dea55b88-7aaf-4284-a671-479bf9f68675 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:06.192441 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-f8c38c80-b8d1-4789-a5b6-0ad2c615aeec req-dea55b88-7aaf-4284-a671-479bf9f68675 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:06.204993 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-f8c38c80-b8d1-4789-a5b6-0ad2c615aeec req-dea55b88-7aaf-4284-a671-479bf9f68675 service nova] Creating event network-vif-unplugged:255289de-0344-43e3-831c-2c5982d88961 for instance 2c06803f-bcfc-48f5-be04-98e6f981a03c on n-h1-852278-4 Aug 27 03:39:06.210490 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [req-f8c38c80-b8d1-4789-a5b6-0ad2c615aeec req-dea55b88-7aaf-4284-a671-479bf9f68675 service nova] Instance 2c06803f-bcfc-48f5-be04-98e6f981a03c is migrating within the same cell, copying events to all relevant hosts: {'n-h2-852278-4', 'n-h1-852278-4'} {{(pid=134051) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 03:39:06.222066 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-f8c38c80-b8d1-4789-a5b6-0ad2c615aeec req-dea55b88-7aaf-4284-a671-479bf9f68675 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.110598 Aug 27 03:39:06.222764 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3256/6469] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:39:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:39:06.943820 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d5db2753-4f0f-46fb-96a9-0a58d4813079 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:39:06.944491 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d5db2753-4f0f-46fb-96a9-0a58d4813079 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c06803f-bcfc-48f5-be04-98e6f981a03c] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:39:06.952227 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d5db2753-4f0f-46fb-96a9-0a58d4813079 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:06.952759 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d5db2753-4f0f-46fb-96a9-0a58d4813079 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:06.953196 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d5db2753-4f0f-46fb-96a9-0a58d4813079 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:06.953901 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d5db2753-4f0f-46fb-96a9-0a58d4813079 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:06.954344 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d5db2753-4f0f-46fb-96a9-0a58d4813079 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:06.954766 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d5db2753-4f0f-46fb-96a9-0a58d4813079 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:07.095327 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-d5db2753-4f0f-46fb-96a9-0a58d4813079 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:39:07.104054 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d5db2753-4f0f-46fb-96a9-0a58d4813079 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/2c06803f-bcfc-48f5-be04-98e6f981a03c" status: 200 len: 1680 microversion: 2.1 time: 0.164548 Aug 27 03:39:07.104666 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3214/6470] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:39:06 2022] GET /compute/v2.1/servers/2c06803f-bcfc-48f5-be04-98e6f981a03c => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:39:08.127912 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-bcecc2b7-ed7a-4648-b5e6-e5fb182ab48c tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:39:08.128640 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-bcecc2b7-ed7a-4648-b5e6-e5fb182ab48c tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c06803f-bcfc-48f5-be04-98e6f981a03c] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:39:08.135251 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bcecc2b7-ed7a-4648-b5e6-e5fb182ab48c tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:08.135750 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bcecc2b7-ed7a-4648-b5e6-e5fb182ab48c tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:08.136200 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bcecc2b7-ed7a-4648-b5e6-e5fb182ab48c tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:08.136960 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bcecc2b7-ed7a-4648-b5e6-e5fb182ab48c tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:08.137466 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bcecc2b7-ed7a-4648-b5e6-e5fb182ab48c tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:08.137901 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bcecc2b7-ed7a-4648-b5e6-e5fb182ab48c tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:08.235863 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-789e02f1-0685-4424-bd47-a65aefa06951 req-bca8fa84-14ff-45c6-bf48-57e368bf1888 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c06803f-bcfc-48f5-be04-98e6f981a03c", "tag": "255289de-0344-43e3-831c-2c5982d88961"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:08.248017 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-789e02f1-0685-4424-bd47-a65aefa06951 req-bca8fa84-14ff-45c6-bf48-57e368bf1888 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:08.248565 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-789e02f1-0685-4424-bd47-a65aefa06951 req-bca8fa84-14ff-45c6-bf48-57e368bf1888 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:08.249005 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-789e02f1-0685-4424-bd47-a65aefa06951 req-bca8fa84-14ff-45c6-bf48-57e368bf1888 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:08.262815 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-789e02f1-0685-4424-bd47-a65aefa06951 req-bca8fa84-14ff-45c6-bf48-57e368bf1888 service nova] Creating event network-changed:255289de-0344-43e3-831c-2c5982d88961 for instance 2c06803f-bcfc-48f5-be04-98e6f981a03c on n-h1-852278-4 Aug 27 03:39:08.270231 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [req-789e02f1-0685-4424-bd47-a65aefa06951 req-bca8fa84-14ff-45c6-bf48-57e368bf1888 service nova] Instance 2c06803f-bcfc-48f5-be04-98e6f981a03c is migrating within the same cell, copying events to all relevant hosts: {'n-h2-852278-4', 'n-h1-852278-4'} {{(pid=134052) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 03:39:08.279395 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-bcecc2b7-ed7a-4648-b5e6-e5fb182ab48c tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:39:08.281846 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-789e02f1-0685-4424-bd47-a65aefa06951 req-bca8fa84-14ff-45c6-bf48-57e368bf1888 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050040 Aug 27 03:39:08.282467 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3215/6471] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:39:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:39:08.287721 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-bcecc2b7-ed7a-4648-b5e6-e5fb182ab48c tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/2c06803f-bcfc-48f5-be04-98e6f981a03c" status: 200 len: 1678 microversion: 2.1 time: 0.165139 Aug 27 03:39:08.288519 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3257/6472] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:39:08 2022] GET /compute/v2.1/servers/2c06803f-bcfc-48f5-be04-98e6f981a03c => generated 1678 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:39:09.311558 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-92a7a0b6-907d-4c92-a279-e9d8ec1e0f33 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:39:09.312359 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-92a7a0b6-907d-4c92-a279-e9d8ec1e0f33 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c06803f-bcfc-48f5-be04-98e6f981a03c] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:39:09.319202 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-92a7a0b6-907d-4c92-a279-e9d8ec1e0f33 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:09.319692 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-92a7a0b6-907d-4c92-a279-e9d8ec1e0f33 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:09.320123 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-92a7a0b6-907d-4c92-a279-e9d8ec1e0f33 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:09.320905 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-92a7a0b6-907d-4c92-a279-e9d8ec1e0f33 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:09.321357 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-92a7a0b6-907d-4c92-a279-e9d8ec1e0f33 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:09.321782 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-92a7a0b6-907d-4c92-a279-e9d8ec1e0f33 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:09.557653 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-92a7a0b6-907d-4c92-a279-e9d8ec1e0f33 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:39:09.566217 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-92a7a0b6-907d-4c92-a279-e9d8ec1e0f33 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/2c06803f-bcfc-48f5-be04-98e6f981a03c" status: 200 len: 1675 microversion: 2.1 time: 0.260151 Aug 27 03:39:09.566841 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3216/6473] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:39:09 2022] GET /compute/v2.1/servers/2c06803f-bcfc-48f5-be04-98e6f981a03c => generated 1675 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:39:09.587943 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8850e924-5922-4d23-a12a-19ec7996a1d3 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:09.588516 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-8850e924-5922-4d23-a12a-19ec7996a1d3 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c06803f-bcfc-48f5-be04-98e6f981a03c] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:39:09.595625 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8850e924-5922-4d23-a12a-19ec7996a1d3 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:09.596127 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8850e924-5922-4d23-a12a-19ec7996a1d3 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:09.596593 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8850e924-5922-4d23-a12a-19ec7996a1d3 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:09.597320 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8850e924-5922-4d23-a12a-19ec7996a1d3 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:09.597801 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8850e924-5922-4d23-a12a-19ec7996a1d3 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:09.598226 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8850e924-5922-4d23-a12a-19ec7996a1d3 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:09.658581 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-8850e924-5922-4d23-a12a-19ec7996a1d3 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "POST /compute/v2.1/servers/2c06803f-bcfc-48f5-be04-98e6f981a03c/action" status: 204 len: 0 microversion: 2.1 time: 0.074545 Aug 27 03:39:09.659565 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3258/6474] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:39:09 2022] POST /compute/v2.1/servers/2c06803f-bcfc-48f5-be04-98e6f981a03c/action => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:39:09.667778 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e741e377-d85f-4ca9-85f1-dea94009af7c tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:39:09.668428 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-e741e377-d85f-4ca9-85f1-dea94009af7c tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c06803f-bcfc-48f5-be04-98e6f981a03c] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:39:09.674826 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e741e377-d85f-4ca9-85f1-dea94009af7c tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:09.675320 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e741e377-d85f-4ca9-85f1-dea94009af7c tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:09.675757 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e741e377-d85f-4ca9-85f1-dea94009af7c tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:09.676495 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e741e377-d85f-4ca9-85f1-dea94009af7c tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:09.676942 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e741e377-d85f-4ca9-85f1-dea94009af7c tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:09.677338 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e741e377-d85f-4ca9-85f1-dea94009af7c tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:09.887234 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-e741e377-d85f-4ca9-85f1-dea94009af7c tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:39:09.895260 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e741e377-d85f-4ca9-85f1-dea94009af7c tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/2c06803f-bcfc-48f5-be04-98e6f981a03c" status: 200 len: 1675 microversion: 2.1 time: 0.231431 Aug 27 03:39:09.895873 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3217/6475] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:39:09 2022] GET /compute/v2.1/servers/2c06803f-bcfc-48f5-be04-98e6f981a03c => generated 1675 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:39:10.924921 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-1e8dfb84-525e-4497-910b-4f70d1e9ec01 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:39:10.925658 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-1e8dfb84-525e-4497-910b-4f70d1e9ec01 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c06803f-bcfc-48f5-be04-98e6f981a03c] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:39:10.936193 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1e8dfb84-525e-4497-910b-4f70d1e9ec01 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:10.936701 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1e8dfb84-525e-4497-910b-4f70d1e9ec01 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:10.938423 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1e8dfb84-525e-4497-910b-4f70d1e9ec01 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:10.939162 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1e8dfb84-525e-4497-910b-4f70d1e9ec01 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:10.939633 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1e8dfb84-525e-4497-910b-4f70d1e9ec01 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:10.940067 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1e8dfb84-525e-4497-910b-4f70d1e9ec01 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:11.078554 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-1e8dfb84-525e-4497-910b-4f70d1e9ec01 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:39:11.086903 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-1e8dfb84-525e-4497-910b-4f70d1e9ec01 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/2c06803f-bcfc-48f5-be04-98e6f981a03c" status: 200 len: 1667 microversion: 2.1 time: 0.166624 Aug 27 03:39:11.087515 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3259/6476] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:39:10 2022] GET /compute/v2.1/servers/2c06803f-bcfc-48f5-be04-98e6f981a03c => generated 1667 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:39:11.108861 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-448e59d0-3407-49ea-b043-86680141fbe7 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:39:11.109469 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-448e59d0-3407-49ea-b043-86680141fbe7 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c06803f-bcfc-48f5-be04-98e6f981a03c] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:39:11.116387 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-448e59d0-3407-49ea-b043-86680141fbe7 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:11.116889 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-448e59d0-3407-49ea-b043-86680141fbe7 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:11.117372 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-448e59d0-3407-49ea-b043-86680141fbe7 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:11.118096 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-448e59d0-3407-49ea-b043-86680141fbe7 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:11.118939 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-448e59d0-3407-49ea-b043-86680141fbe7 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:11.120266 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-448e59d0-3407-49ea-b043-86680141fbe7 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:11.260464 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-448e59d0-3407-49ea-b043-86680141fbe7 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:39:11.270883 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-448e59d0-3407-49ea-b043-86680141fbe7 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/2c06803f-bcfc-48f5-be04-98e6f981a03c" status: 200 len: 1667 microversion: 2.1 time: 0.165895 Aug 27 03:39:11.271471 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3218/6477] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:39:11 2022] GET /compute/v2.1/servers/2c06803f-bcfc-48f5-be04-98e6f981a03c => generated 1667 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:39:11.292029 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ceb69c6e-aa1b-4cec-8ced-81fbd5d1e083 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:39:11.292845 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-ceb69c6e-aa1b-4cec-8ced-81fbd5d1e083 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c06803f-bcfc-48f5-be04-98e6f981a03c] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:39:11.299357 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ceb69c6e-aa1b-4cec-8ced-81fbd5d1e083 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:11.299854 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ceb69c6e-aa1b-4cec-8ced-81fbd5d1e083 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:11.300327 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ceb69c6e-aa1b-4cec-8ced-81fbd5d1e083 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:11.301031 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ceb69c6e-aa1b-4cec-8ced-81fbd5d1e083 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:11.301497 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ceb69c6e-aa1b-4cec-8ced-81fbd5d1e083 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:11.301927 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ceb69c6e-aa1b-4cec-8ced-81fbd5d1e083 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:11.317626 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:39:11.435363 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-ceb69c6e-aa1b-4cec-8ced-81fbd5d1e083 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:39:11.443998 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ceb69c6e-aa1b-4cec-8ced-81fbd5d1e083 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/2c06803f-bcfc-48f5-be04-98e6f981a03c" status: 200 len: 1667 microversion: 2.1 time: 0.155822 Aug 27 03:39:11.444661 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3260/6478] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:39:11 2022] GET /compute/v2.1/servers/2c06803f-bcfc-48f5-be04-98e6f981a03c => generated 1667 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:39:11.466705 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-92124e0c-8cbd-4efe-a79e-709ea4836193 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:39:11.467490 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-92124e0c-8cbd-4efe-a79e-709ea4836193 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c06803f-bcfc-48f5-be04-98e6f981a03c] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:39:11.477114 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-92124e0c-8cbd-4efe-a79e-709ea4836193 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:11.477872 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-92124e0c-8cbd-4efe-a79e-709ea4836193 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:11.478561 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-92124e0c-8cbd-4efe-a79e-709ea4836193 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:11.479618 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-92124e0c-8cbd-4efe-a79e-709ea4836193 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:11.480385 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-92124e0c-8cbd-4efe-a79e-709ea4836193 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:11.480801 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-92124e0c-8cbd-4efe-a79e-709ea4836193 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:11.505667 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-92124e0c-8cbd-4efe-a79e-709ea4836193 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c06803f-bcfc-48f5-be04-98e6f981a03c] Going to try to terminate instance {{(pid=134052) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:39:11.508479 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=100 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:39:11.599504 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-92124e0c-8cbd-4efe-a79e-709ea4836193 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "DELETE /compute/v2.1/servers/2c06803f-bcfc-48f5-be04-98e6f981a03c" status: 204 len: 0 microversion: 2.1 time: 0.138954 Aug 27 03:39:11.600194 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3219/6479] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 03:39:11 2022] DELETE /compute/v2.1/servers/2c06803f-bcfc-48f5-be04-98e6f981a03c => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:39:11.608578 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-343e0ea1-0ce7-419b-9b1c-f1356c0244b1 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:39:11.609203 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-343e0ea1-0ce7-419b-9b1c-f1356c0244b1 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c06803f-bcfc-48f5-be04-98e6f981a03c] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:39:11.615493 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-343e0ea1-0ce7-419b-9b1c-f1356c0244b1 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:11.615951 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-343e0ea1-0ce7-419b-9b1c-f1356c0244b1 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:11.616560 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-343e0ea1-0ce7-419b-9b1c-f1356c0244b1 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:11.617251 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-343e0ea1-0ce7-419b-9b1c-f1356c0244b1 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:11.617719 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-343e0ea1-0ce7-419b-9b1c-f1356c0244b1 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:11.618154 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-343e0ea1-0ce7-419b-9b1c-f1356c0244b1 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:11.765675 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-343e0ea1-0ce7-419b-9b1c-f1356c0244b1 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:39:11.774054 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-343e0ea1-0ce7-419b-9b1c-f1356c0244b1 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/2c06803f-bcfc-48f5-be04-98e6f981a03c" status: 200 len: 1673 microversion: 2.1 time: 0.169437 Aug 27 03:39:11.774645 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3261/6480] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:39:11 2022] GET /compute/v2.1/servers/2c06803f-bcfc-48f5-be04-98e6f981a03c => generated 1673 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:39:12.587080 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-f3af250b-dee1-4dd2-9aa3-8fd6229a6ce4 req-eaf467ee-6b84-444b-b278-9f4aa213e87e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c06803f-bcfc-48f5-be04-98e6f981a03c", "name": "network-vif-plugged", "status": "completed", "tag": "255289de-0344-43e3-831c-2c5982d88961"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:12.597199 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-f3af250b-dee1-4dd2-9aa3-8fd6229a6ce4 req-eaf467ee-6b84-444b-b278-9f4aa213e87e service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:12.597669 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-f3af250b-dee1-4dd2-9aa3-8fd6229a6ce4 req-eaf467ee-6b84-444b-b278-9f4aa213e87e service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:12.598099 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-f3af250b-dee1-4dd2-9aa3-8fd6229a6ce4 req-eaf467ee-6b84-444b-b278-9f4aa213e87e service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:12.610069 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-f3af250b-dee1-4dd2-9aa3-8fd6229a6ce4 req-eaf467ee-6b84-444b-b278-9f4aa213e87e service nova] Creating event network-vif-plugged:255289de-0344-43e3-831c-2c5982d88961 for instance 2c06803f-bcfc-48f5-be04-98e6f981a03c on n-h1-852278-4 Aug 27 03:39:12.614996 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-f3af250b-dee1-4dd2-9aa3-8fd6229a6ce4 req-eaf467ee-6b84-444b-b278-9f4aa213e87e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083339 Aug 27 03:39:12.615595 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3220/6481] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:39:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:39:12.796737 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4ba98944-5475-4eaf-8613-2d12b8a7dc5c tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:39:12.797345 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-4ba98944-5475-4eaf-8613-2d12b8a7dc5c tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c06803f-bcfc-48f5-be04-98e6f981a03c] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:39:12.804851 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4ba98944-5475-4eaf-8613-2d12b8a7dc5c tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:12.805355 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4ba98944-5475-4eaf-8613-2d12b8a7dc5c tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:12.805803 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4ba98944-5475-4eaf-8613-2d12b8a7dc5c tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:12.806512 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4ba98944-5475-4eaf-8613-2d12b8a7dc5c tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:12.806981 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4ba98944-5475-4eaf-8613-2d12b8a7dc5c tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:12.807419 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4ba98944-5475-4eaf-8613-2d12b8a7dc5c tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:12.944699 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-4ba98944-5475-4eaf-8613-2d12b8a7dc5c tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:39:12.953360 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-4ba98944-5475-4eaf-8613-2d12b8a7dc5c tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/2c06803f-bcfc-48f5-be04-98e6f981a03c" status: 200 len: 1673 microversion: 2.1 time: 0.161416 Aug 27 03:39:12.953952 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3262/6482] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:39:12 2022] GET /compute/v2.1/servers/2c06803f-bcfc-48f5-be04-98e6f981a03c => generated 1673 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:39:13.977339 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-2610df70-8adf-43f1-9310-36177c442118 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:39:13.979124 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-2610df70-8adf-43f1-9310-36177c442118 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c06803f-bcfc-48f5-be04-98e6f981a03c] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:39:13.986617 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2610df70-8adf-43f1-9310-36177c442118 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:13.986747 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2610df70-8adf-43f1-9310-36177c442118 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:13.987071 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2610df70-8adf-43f1-9310-36177c442118 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:13.987977 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2610df70-8adf-43f1-9310-36177c442118 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:13.988609 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2610df70-8adf-43f1-9310-36177c442118 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:13.989188 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2610df70-8adf-43f1-9310-36177c442118 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:14.038242 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-e5361422-01aa-42fc-bfa1-a3740fca4b0f req-b9bc6708-b76c-4486-90a2-35f11d05fc29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c06803f-bcfc-48f5-be04-98e6f981a03c", "name": "network-vif-deleted", "tag": "255289de-0344-43e3-831c-2c5982d88961"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:14.052484 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-e5361422-01aa-42fc-bfa1-a3740fca4b0f req-b9bc6708-b76c-4486-90a2-35f11d05fc29 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:14.053106 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-e5361422-01aa-42fc-bfa1-a3740fca4b0f req-b9bc6708-b76c-4486-90a2-35f11d05fc29 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:14.053599 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-e5361422-01aa-42fc-bfa1-a3740fca4b0f req-b9bc6708-b76c-4486-90a2-35f11d05fc29 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:14.062365 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-2610df70-8adf-43f1-9310-36177c442118 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:39:14.065976 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-e5361422-01aa-42fc-bfa1-a3740fca4b0f req-b9bc6708-b76c-4486-90a2-35f11d05fc29 service nova] Creating event network-vif-deleted:255289de-0344-43e3-831c-2c5982d88961 for instance 2c06803f-bcfc-48f5-be04-98e6f981a03c on n-h1-852278-4 Aug 27 03:39:14.071557 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-2610df70-8adf-43f1-9310-36177c442118 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/2c06803f-bcfc-48f5-be04-98e6f981a03c" status: 200 len: 1606 microversion: 2.1 time: 0.100495 Aug 27 03:39:14.072231 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-e5361422-01aa-42fc-bfa1-a3740fca4b0f req-b9bc6708-b76c-4486-90a2-35f11d05fc29 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037681 Aug 27 03:39:14.074028 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3263/6483] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:39:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:39:14.087389 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3221/6484] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:39:13 2022] GET /compute/v2.1/servers/2c06803f-bcfc-48f5-be04-98e6f981a03c => generated 1606 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:39:15.095092 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-de7c3ee2-77b1-4992-9635-cf32f31fa89b tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:39:15.095866 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-de7c3ee2-77b1-4992-9635-cf32f31fa89b tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c06803f-bcfc-48f5-be04-98e6f981a03c] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:39:15.102910 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-de7c3ee2-77b1-4992-9635-cf32f31fa89b tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:15.103412 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-de7c3ee2-77b1-4992-9635-cf32f31fa89b tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:15.103874 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-de7c3ee2-77b1-4992-9635-cf32f31fa89b tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:15.104628 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-de7c3ee2-77b1-4992-9635-cf32f31fa89b tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:15.105103 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-de7c3ee2-77b1-4992-9635-cf32f31fa89b tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:15.105548 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-de7c3ee2-77b1-4992-9635-cf32f31fa89b tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:15.119567 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-de7c3ee2-77b1-4992-9635-cf32f31fa89b tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] HTTP exception thrown: Instance 2c06803f-bcfc-48f5-be04-98e6f981a03c could not be found. Aug 27 03:39:15.121313 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-de7c3ee2-77b1-4992-9635-cf32f31fa89b tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Request method failure captured: Aug 27 03:39:15.121313 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/2c06803f-bcfc-48f5-be04-98e6f981a03c HTTP/1.1 Aug 27 03:39:15.121313 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 03:39:15.121313 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 03:39:15.121313 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 03:39:15.121313 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 03:39:15.121313 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 03:39:15.121313 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 03:39:15.121313 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 03:39:15.121313 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 03:39:15.121313 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCZGWxk5BEicF9AwnrkJwBWPfwg6arCi_dT6E6ZVU5_NhdiLiUMoMZ2Q_dYvmFaxRe7rt1FqUkb8B6Jv9aLrdZAOB6sF0tJV32UJ88bJE_iEEa6wH556BrFuazMURlys8Bi6SN-7FaZo2zdThDqlQ_upK7UsTTNFT7YiOxJI35LhaDsc Aug 27 03:39:15.121313 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 03:39:15.121313 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 03:39:15.121313 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 03:39:15.121313 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 03:39:15.121313 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 03:39:15.121313 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 03:39:15.121313 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: cc3aa9846bcb40518ac54e31208ce043 Aug 27 03:39:15.121313 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ServerActionsTestJSON-577023370 Aug 27 03:39:15.121313 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 03:39:15.121313 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 03:39:15.121313 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cc3aa9846bcb40518ac54e31208ce043"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_cc3aa9846bcb40518ac54e31208ce043", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cc3aa9846bcb40518ac54e31208ce043"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/cc3aa9846bcb40518ac54e31208ce043"}]}] Aug 27 03:39:15.121313 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ServerActionsTestJSON-577023370 Aug 27 03:39:15.121313 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: cc3aa9846bcb40518ac54e31208ce043 Aug 27 03:39:15.121313 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ServerActionsTestJSON-577023370 Aug 27 03:39:15.121313 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ServerActionsTestJSON-577023370-project Aug 27 03:39:15.121313 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 03:39:15.121313 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 03:39:15.121313 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: c62665fa43c34e6eb695633905cf3b84 Aug 27 03:39:15.121313 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ServerActionsTestJSON-577023370-project Aug 27 03:39:15.121313 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 03:39:15.121313 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance 2c06803f-bcfc-48f5-be04-98e6f981a03c could not be found. Aug 27 03:39:15.121313 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '2c06803f-bcfc-48f5-be04-98e6f981a03c'} Aug 27 03:39:15.121313 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:39:15.121313 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:39:15.121313 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:39:15.121313 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:39:15.121313 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:39:15.121313 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:39:15.121313 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:39:15.121313 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:39:15.121313 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:39:15.121313 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:39:15.121313 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c06803f-bcfc-48f5-be04-98e6f981a03c could not be found. Aug 27 03:39:15.121313 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:39:15.121313 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:39:15.121313 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:39:15.121313 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:39:15.121313 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:39:15.121313 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:39:15.121313 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:39:15.121313 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:39:15.121313 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:39:15.121313 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:39:15.121313 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:39:15.121313 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:39:15.121313 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:39:15.121313 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:39:15.121313 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:39:15.121313 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:39:15.121313 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c06803f-bcfc-48f5-be04-98e6f981a03c could not be found. Aug 27 03:39:15.121313 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:39:15.121313 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:39:15.121313 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:39:15.125538 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:39:15.125538 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:39:15.125538 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:39:15.125538 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:39:15.125538 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:39:15.125538 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c06803f-bcfc-48f5-be04-98e6f981a03c could not be found. Aug 27 03:39:15.125538 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:39:15.125538 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-de7c3ee2-77b1-4992-9635-cf32f31fa89b tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Returning 404 to user: Instance 2c06803f-bcfc-48f5-be04-98e6f981a03c could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:39:15.125538 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-de7c3ee2-77b1-4992-9635-cf32f31fa89b tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/2c06803f-bcfc-48f5-be04-98e6f981a03c" status: 404 len: 111 microversion: 2.1 time: 0.033144 Aug 27 03:39:15.125538 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3264/6485] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:39:15 2022] GET /compute/v2.1/servers/2c06803f-bcfc-48f5-be04-98e6f981a03c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:39:15.137791 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d71fe99f-d8c4-485e-b22a-fbb0c644faf4 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:39:15.138522 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d71fe99f-d8c4-485e-b22a-fbb0c644faf4 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c06803f-bcfc-48f5-be04-98e6f981a03c] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:39:15.145657 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d71fe99f-d8c4-485e-b22a-fbb0c644faf4 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:15.146099 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d71fe99f-d8c4-485e-b22a-fbb0c644faf4 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:15.146534 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d71fe99f-d8c4-485e-b22a-fbb0c644faf4 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:15.147258 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d71fe99f-d8c4-485e-b22a-fbb0c644faf4 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:15.147710 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d71fe99f-d8c4-485e-b22a-fbb0c644faf4 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:15.148131 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d71fe99f-d8c4-485e-b22a-fbb0c644faf4 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:15.162367 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-d71fe99f-d8c4-485e-b22a-fbb0c644faf4 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] HTTP exception thrown: Instance 2c06803f-bcfc-48f5-be04-98e6f981a03c could not be found. Aug 27 03:39:15.164078 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d71fe99f-d8c4-485e-b22a-fbb0c644faf4 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Request method failure captured: Aug 27 03:39:15.164078 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/servers/2c06803f-bcfc-48f5-be04-98e6f981a03c HTTP/1.1 Aug 27 03:39:15.164078 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 03:39:15.164078 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 03:39:15.164078 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 03:39:15.164078 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 03:39:15.164078 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 03:39:15.164078 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 03:39:15.164078 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 03:39:15.164078 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 03:39:15.164078 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCZGWxk5BEicF9AwnrkJwBWPfwg6arCi_dT6E6ZVU5_NhdiLiUMoMZ2Q_dYvmFaxRe7rt1FqUkb8B6Jv9aLrdZAOB6sF0tJV32UJ88bJE_iEEa6wH556BrFuazMURlys8Bi6SN-7FaZo2zdThDqlQ_upK7UsTTNFT7YiOxJI35LhaDsc Aug 27 03:39:15.164078 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 03:39:15.164078 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 03:39:15.164078 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 03:39:15.164078 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 03:39:15.164078 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 03:39:15.164078 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 03:39:15.164078 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: cc3aa9846bcb40518ac54e31208ce043 Aug 27 03:39:15.164078 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ServerActionsTestJSON-577023370 Aug 27 03:39:15.164078 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 03:39:15.164078 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 03:39:15.164078 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cc3aa9846bcb40518ac54e31208ce043"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_cc3aa9846bcb40518ac54e31208ce043", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cc3aa9846bcb40518ac54e31208ce043"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/cc3aa9846bcb40518ac54e31208ce043"}]}] Aug 27 03:39:15.164078 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ServerActionsTestJSON-577023370 Aug 27 03:39:15.164078 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: cc3aa9846bcb40518ac54e31208ce043 Aug 27 03:39:15.164078 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ServerActionsTestJSON-577023370 Aug 27 03:39:15.164078 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ServerActionsTestJSON-577023370-project Aug 27 03:39:15.164078 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 03:39:15.164078 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 03:39:15.164078 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: c62665fa43c34e6eb695633905cf3b84 Aug 27 03:39:15.164078 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ServerActionsTestJSON-577023370-project Aug 27 03:39:15.164078 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 03:39:15.164078 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance 2c06803f-bcfc-48f5-be04-98e6f981a03c could not be found. Aug 27 03:39:15.164078 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '2c06803f-bcfc-48f5-be04-98e6f981a03c'} Aug 27 03:39:15.164078 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:39:15.164078 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:39:15.164078 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:39:15.164078 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:39:15.164078 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:39:15.164078 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:39:15.164078 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:39:15.164078 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:39:15.164078 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:39:15.164078 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:39:15.164078 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c06803f-bcfc-48f5-be04-98e6f981a03c could not be found. Aug 27 03:39:15.164078 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:39:15.164078 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:39:15.164078 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:39:15.164078 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:39:15.164078 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:39:15.164078 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:39:15.164078 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:39:15.164078 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:39:15.164078 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:39:15.164078 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:39:15.164078 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:39:15.164078 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:39:15.164078 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:39:15.164078 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:39:15.164078 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:39:15.164078 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:39:15.164078 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c06803f-bcfc-48f5-be04-98e6f981a03c could not be found. Aug 27 03:39:15.164078 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:39:15.164078 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:39:15.164078 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:39:15.167787 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:39:15.167787 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:39:15.167787 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:39:15.167787 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:39:15.167787 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:39:15.167787 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c06803f-bcfc-48f5-be04-98e6f981a03c could not be found. Aug 27 03:39:15.167787 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:39:15.167787 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d71fe99f-d8c4-485e-b22a-fbb0c644faf4 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Returning 404 to user: Instance 2c06803f-bcfc-48f5-be04-98e6f981a03c could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:39:15.167787 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d71fe99f-d8c4-485e-b22a-fbb0c644faf4 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/2c06803f-bcfc-48f5-be04-98e6f981a03c" status: 404 len: 111 microversion: 2.1 time: 0.032558 Aug 27 03:39:15.167787 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3222/6486] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:39:15 2022] GET /compute/v2.1/servers/2c06803f-bcfc-48f5-be04-98e6f981a03c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:39:15.215419 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f2da6d71-4f7d-49b3-83f4-0329443e292c tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-476902452", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "networks": [{"uuid": "58a8af60-9bb2-4790-9c69-3b7ee60e6ff0"}], "security_groups": [{"name": "tempest-securitygroup--353980153"}], "key_name": "tempest-keypair-1055144708", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:15.331051 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.network.neutron [None req-f2da6d71-4f7d-49b3-83f4-0329443e292c tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] validate_networks() for [('58a8af60-9bb2-4790-9c69-3b7ee60e6ff0', None, None, None, None, None)] {{(pid=134051) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:39:15.807000 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-f2da6d71-4f7d-49b3-83f4-0329443e292c tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Flavor limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:39:15.807438 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-f2da6d71-4f7d-49b3-83f4-0329443e292c tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Image limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:39:15.807923 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-f2da6d71-4f7d-49b3-83f4-0329443e292c tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Flavor pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:39:15.808349 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-f2da6d71-4f7d-49b3-83f4-0329443e292c tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Image pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:39:15.808785 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-f2da6d71-4f7d-49b3-83f4-0329443e292c tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:39:15.821772 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f2da6d71-4f7d-49b3-83f4-0329443e292c tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:15.822268 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f2da6d71-4f7d-49b3-83f4-0329443e292c tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:15.822744 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f2da6d71-4f7d-49b3-83f4-0329443e292c tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:15.823481 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f2da6d71-4f7d-49b3-83f4-0329443e292c tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:15.823949 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f2da6d71-4f7d-49b3-83f4-0329443e292c tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:15.824413 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f2da6d71-4f7d-49b3-83f4-0329443e292c tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:15.843954 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-f2da6d71-4f7d-49b3-83f4-0329443e292c tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Getting quotas for project cc3aa9846bcb40518ac54e31208ce043. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:39:15.849533 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-f2da6d71-4f7d-49b3-83f4-0329443e292c tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Getting quotas for user c62665fa43c34e6eb695633905cf3b84 and project cc3aa9846bcb40518ac54e31208ce043. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:39:15.863616 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-f2da6d71-4f7d-49b3-83f4-0329443e292c tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Going to run 1 instances... {{(pid=134051) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:39:15.866004 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-f2da6d71-4f7d-49b3-83f4-0329443e292c tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 14245f9c-71e1-4dc8-ab39-783e2610f6e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134051) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:39:15.915714 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-f2da6d71-4f7d-49b3-83f4-0329443e292c tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.704049 Aug 27 03:39:15.916401 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3265/6487] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 03:39:15 2022] POST /compute/v2.1/servers => generated 405 bytes in 706 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:39:15.928059 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b495bbc2-6801-44b1-a01e-f0f0896555fb tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:39:15.928694 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b495bbc2-6801-44b1-a01e-f0f0896555fb tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 14245f9c-71e1-4dc8-ab39-783e2610f6e4] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:39:15.930869 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:39:15.988747 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b495bbc2-6801-44b1-a01e-f0f0896555fb tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:39:15.999198 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b495bbc2-6801-44b1-a01e-f0f0896555fb tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/14245f9c-71e1-4dc8-ab39-783e2610f6e4" status: 200 len: 1238 microversion: 2.1 time: 0.074955 Aug 27 03:39:15.999884 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3223/6488] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:39:15 2022] GET /compute/v2.1/servers/14245f9c-71e1-4dc8-ab39-783e2610f6e4 => generated 1238 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:39:17.021783 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-43b5a148-b3fc-4215-a184-d0393e96ec3e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:39:17.023202 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-43b5a148-b3fc-4215-a184-d0393e96ec3e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 14245f9c-71e1-4dc8-ab39-783e2610f6e4] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:39:17.027433 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:39:17.039401 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-43b5a148-b3fc-4215-a184-d0393e96ec3e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:17.039925 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-43b5a148-b3fc-4215-a184-d0393e96ec3e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:17.040615 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-43b5a148-b3fc-4215-a184-d0393e96ec3e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:17.041513 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-43b5a148-b3fc-4215-a184-d0393e96ec3e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:17.042128 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-43b5a148-b3fc-4215-a184-d0393e96ec3e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:17.042701 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-43b5a148-b3fc-4215-a184-d0393e96ec3e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:17.121162 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-43b5a148-b3fc-4215-a184-d0393e96ec3e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:39:17.129293 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-43b5a148-b3fc-4215-a184-d0393e96ec3e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/14245f9c-71e1-4dc8-ab39-783e2610f6e4" status: 200 len: 1308 microversion: 2.1 time: 0.112333 Aug 27 03:39:17.129869 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3266/6489] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:39:17 2022] GET /compute/v2.1/servers/14245f9c-71e1-4dc8-ab39-783e2610f6e4 => generated 1308 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:39:18.151386 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-bd2046a0-a227-4b97-ae40-7ad251650f98 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:39:18.151966 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-bd2046a0-a227-4b97-ae40-7ad251650f98 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 14245f9c-71e1-4dc8-ab39-783e2610f6e4] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:39:18.160480 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bd2046a0-a227-4b97-ae40-7ad251650f98 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:18.160974 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bd2046a0-a227-4b97-ae40-7ad251650f98 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:18.161412 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bd2046a0-a227-4b97-ae40-7ad251650f98 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:18.162267 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bd2046a0-a227-4b97-ae40-7ad251650f98 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:18.162734 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bd2046a0-a227-4b97-ae40-7ad251650f98 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:18.163162 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bd2046a0-a227-4b97-ae40-7ad251650f98 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:18.374268 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-bd2046a0-a227-4b97-ae40-7ad251650f98 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:39:18.383334 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-bd2046a0-a227-4b97-ae40-7ad251650f98 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/14245f9c-71e1-4dc8-ab39-783e2610f6e4" status: 200 len: 1363 microversion: 2.1 time: 0.235899 Aug 27 03:39:18.384013 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3224/6490] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:39:18 2022] GET /compute/v2.1/servers/14245f9c-71e1-4dc8-ab39-783e2610f6e4 => generated 1363 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:39:18.437765 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-f32f1a27-5611-4fed-8d8b-f6b342c060f3 req-a7d7c672-3d53-4c83-a5ad-2f31f9137abc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14245f9c-71e1-4dc8-ab39-783e2610f6e4", "tag": "bbab562a-46ac-4dcd-bbd2-e1dfdb21b4a6"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:18.448905 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-f32f1a27-5611-4fed-8d8b-f6b342c060f3 req-a7d7c672-3d53-4c83-a5ad-2f31f9137abc service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:18.449445 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-f32f1a27-5611-4fed-8d8b-f6b342c060f3 req-a7d7c672-3d53-4c83-a5ad-2f31f9137abc service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:18.449901 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-f32f1a27-5611-4fed-8d8b-f6b342c060f3 req-a7d7c672-3d53-4c83-a5ad-2f31f9137abc service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:18.465162 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-f32f1a27-5611-4fed-8d8b-f6b342c060f3 req-a7d7c672-3d53-4c83-a5ad-2f31f9137abc service nova] Creating event network-changed:bbab562a-46ac-4dcd-bbd2-e1dfdb21b4a6 for instance 14245f9c-71e1-4dc8-ab39-783e2610f6e4 on n-h2-852278-4 Aug 27 03:39:18.470094 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-f32f1a27-5611-4fed-8d8b-f6b342c060f3 req-a7d7c672-3d53-4c83-a5ad-2f31f9137abc service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036258 Aug 27 03:39:18.471028 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3267/6491] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:39:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:39:19.412225 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-cd7c3679-1ef9-440d-a4b0-ec5cd423989a tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:39:19.413339 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-cd7c3679-1ef9-440d-a4b0-ec5cd423989a tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 14245f9c-71e1-4dc8-ab39-783e2610f6e4] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:39:19.423463 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cd7c3679-1ef9-440d-a4b0-ec5cd423989a tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:19.423952 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cd7c3679-1ef9-440d-a4b0-ec5cd423989a tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:19.424426 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cd7c3679-1ef9-440d-a4b0-ec5cd423989a tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:19.425134 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cd7c3679-1ef9-440d-a4b0-ec5cd423989a tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:19.425589 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cd7c3679-1ef9-440d-a4b0-ec5cd423989a tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:19.426014 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cd7c3679-1ef9-440d-a4b0-ec5cd423989a tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:19.577947 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-cd7c3679-1ef9-440d-a4b0-ec5cd423989a tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:39:19.589734 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-cd7c3679-1ef9-440d-a4b0-ec5cd423989a tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/14245f9c-71e1-4dc8-ab39-783e2610f6e4" status: 200 len: 1363 microversion: 2.1 time: 0.183836 Aug 27 03:39:19.590501 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3225/6492] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:39:19 2022] GET /compute/v2.1/servers/14245f9c-71e1-4dc8-ab39-783e2610f6e4 => generated 1363 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:39:20.622010 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-70b75c1a-9ccc-4cd8-89a5-bafab119defc tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:39:20.622843 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-70b75c1a-9ccc-4cd8-89a5-bafab119defc tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 14245f9c-71e1-4dc8-ab39-783e2610f6e4] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:39:20.629864 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-70b75c1a-9ccc-4cd8-89a5-bafab119defc tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:20.630376 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-70b75c1a-9ccc-4cd8-89a5-bafab119defc tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:20.630831 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-70b75c1a-9ccc-4cd8-89a5-bafab119defc tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:20.631552 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-70b75c1a-9ccc-4cd8-89a5-bafab119defc tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:20.632024 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-70b75c1a-9ccc-4cd8-89a5-bafab119defc tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:20.632495 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-70b75c1a-9ccc-4cd8-89a5-bafab119defc tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:20.769366 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-70b75c1a-9ccc-4cd8-89a5-bafab119defc tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:39:20.778129 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-70b75c1a-9ccc-4cd8-89a5-bafab119defc tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/14245f9c-71e1-4dc8-ab39-783e2610f6e4" status: 200 len: 1363 microversion: 2.1 time: 0.164061 Aug 27 03:39:20.778775 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3268/6493] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:39:20 2022] GET /compute/v2.1/servers/14245f9c-71e1-4dc8-ab39-783e2610f6e4 => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:39:21.804495 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ab56d14b-b45a-41b2-bd86-6f93d91c8dd4 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:39:21.805323 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-ab56d14b-b45a-41b2-bd86-6f93d91c8dd4 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 14245f9c-71e1-4dc8-ab39-783e2610f6e4] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:39:21.817085 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ab56d14b-b45a-41b2-bd86-6f93d91c8dd4 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:21.817892 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ab56d14b-b45a-41b2-bd86-6f93d91c8dd4 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:21.818626 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ab56d14b-b45a-41b2-bd86-6f93d91c8dd4 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:21.819824 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ab56d14b-b45a-41b2-bd86-6f93d91c8dd4 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:21.820628 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ab56d14b-b45a-41b2-bd86-6f93d91c8dd4 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:21.821335 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ab56d14b-b45a-41b2-bd86-6f93d91c8dd4 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:21.956441 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-ab56d14b-b45a-41b2-bd86-6f93d91c8dd4 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:39:21.964739 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ab56d14b-b45a-41b2-bd86-6f93d91c8dd4 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/14245f9c-71e1-4dc8-ab39-783e2610f6e4" status: 200 len: 1363 microversion: 2.1 time: 0.166922 Aug 27 03:39:21.965324 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3226/6494] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:39:21 2022] GET /compute/v2.1/servers/14245f9c-71e1-4dc8-ab39-783e2610f6e4 => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:39:22.697696 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-4fba4877-0d7f-42ed-92d7-ec31284fd1ef req-98208ec4-7058-4474-aba0-3fccc8fcfadb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14245f9c-71e1-4dc8-ab39-783e2610f6e4", "name": "network-vif-plugged", "status": "completed", "tag": "bbab562a-46ac-4dcd-bbd2-e1dfdb21b4a6"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:22.708871 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-4fba4877-0d7f-42ed-92d7-ec31284fd1ef req-98208ec4-7058-4474-aba0-3fccc8fcfadb service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:22.709357 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-4fba4877-0d7f-42ed-92d7-ec31284fd1ef req-98208ec4-7058-4474-aba0-3fccc8fcfadb service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:22.710002 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-4fba4877-0d7f-42ed-92d7-ec31284fd1ef req-98208ec4-7058-4474-aba0-3fccc8fcfadb service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:22.721664 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-4fba4877-0d7f-42ed-92d7-ec31284fd1ef req-98208ec4-7058-4474-aba0-3fccc8fcfadb service nova] Creating event network-vif-plugged:bbab562a-46ac-4dcd-bbd2-e1dfdb21b4a6 for instance 14245f9c-71e1-4dc8-ab39-783e2610f6e4 on n-h2-852278-4 Aug 27 03:39:22.727162 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-4fba4877-0d7f-42ed-92d7-ec31284fd1ef req-98208ec4-7058-4474-aba0-3fccc8fcfadb service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033072 Aug 27 03:39:22.728245 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3269/6495] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:39:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:39:22.990305 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-eb380731-86c2-442f-a0e2-d7a68013d3cd tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:39:22.991268 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-eb380731-86c2-442f-a0e2-d7a68013d3cd tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 14245f9c-71e1-4dc8-ab39-783e2610f6e4] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:39:23.001179 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-eb380731-86c2-442f-a0e2-d7a68013d3cd tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:23.001683 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-eb380731-86c2-442f-a0e2-d7a68013d3cd tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:23.002135 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-eb380731-86c2-442f-a0e2-d7a68013d3cd tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:23.002851 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-eb380731-86c2-442f-a0e2-d7a68013d3cd tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:23.003302 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-eb380731-86c2-442f-a0e2-d7a68013d3cd tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:23.003735 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-eb380731-86c2-442f-a0e2-d7a68013d3cd tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:23.138046 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-eb380731-86c2-442f-a0e2-d7a68013d3cd tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:39:23.148581 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-eb380731-86c2-442f-a0e2-d7a68013d3cd tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/14245f9c-71e1-4dc8-ab39-783e2610f6e4" status: 200 len: 1363 microversion: 2.1 time: 0.164602 Aug 27 03:39:23.149572 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3227/6496] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:39:22 2022] GET /compute/v2.1/servers/14245f9c-71e1-4dc8-ab39-783e2610f6e4 => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:39:24.179363 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b6e4792c-1e46-4919-916b-430b3f99ad5b tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:39:24.179981 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b6e4792c-1e46-4919-916b-430b3f99ad5b tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 14245f9c-71e1-4dc8-ab39-783e2610f6e4] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:39:24.186679 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b6e4792c-1e46-4919-916b-430b3f99ad5b tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:24.187189 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b6e4792c-1e46-4919-916b-430b3f99ad5b tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:24.187652 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b6e4792c-1e46-4919-916b-430b3f99ad5b tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:24.188436 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b6e4792c-1e46-4919-916b-430b3f99ad5b tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:24.188913 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b6e4792c-1e46-4919-916b-430b3f99ad5b tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:24.189362 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b6e4792c-1e46-4919-916b-430b3f99ad5b tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:24.335556 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-b6e4792c-1e46-4919-916b-430b3f99ad5b tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:39:24.343516 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b6e4792c-1e46-4919-916b-430b3f99ad5b tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/14245f9c-71e1-4dc8-ab39-783e2610f6e4" status: 200 len: 1548 microversion: 2.1 time: 0.169521 Aug 27 03:39:24.344105 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3270/6497] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:39:24 2022] GET /compute/v2.1/servers/14245f9c-71e1-4dc8-ab39-783e2610f6e4 => generated 1548 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:39:24.364057 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-58756509-d74d-4d66-ac2a-33625b18bf40 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:39:24.364591 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-58756509-d74d-4d66-ac2a-33625b18bf40 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 14245f9c-71e1-4dc8-ab39-783e2610f6e4] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:39:24.371495 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-58756509-d74d-4d66-ac2a-33625b18bf40 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:24.371978 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-58756509-d74d-4d66-ac2a-33625b18bf40 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:24.372483 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-58756509-d74d-4d66-ac2a-33625b18bf40 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:24.373176 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-58756509-d74d-4d66-ac2a-33625b18bf40 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:24.373622 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-58756509-d74d-4d66-ac2a-33625b18bf40 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:24.374040 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-58756509-d74d-4d66-ac2a-33625b18bf40 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:24.454334 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-58756509-d74d-4d66-ac2a-33625b18bf40 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/14245f9c-71e1-4dc8-ab39-783e2610f6e4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094114 Aug 27 03:39:24.455002 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3228/6498] 10.222.0.70 () {58 vars in 1275 bytes} [Sat Aug 27 03:39:24 2022] GET /compute/v2.1/servers/14245f9c-71e1-4dc8-ab39-783e2610f6e4/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:39:25.405702 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-9d125aa3-f2d7-44bf-81f4-5cd86ad68268 req-2431791c-2016-4f08-a230-41c3dc7d42cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14245f9c-71e1-4dc8-ab39-783e2610f6e4", "tag": "bbab562a-46ac-4dcd-bbd2-e1dfdb21b4a6"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:25.415843 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-9d125aa3-f2d7-44bf-81f4-5cd86ad68268 req-2431791c-2016-4f08-a230-41c3dc7d42cc service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:25.416427 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-9d125aa3-f2d7-44bf-81f4-5cd86ad68268 req-2431791c-2016-4f08-a230-41c3dc7d42cc service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:25.416936 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-9d125aa3-f2d7-44bf-81f4-5cd86ad68268 req-2431791c-2016-4f08-a230-41c3dc7d42cc service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:25.428886 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-9d125aa3-f2d7-44bf-81f4-5cd86ad68268 req-2431791c-2016-4f08-a230-41c3dc7d42cc service nova] Creating event network-changed:bbab562a-46ac-4dcd-bbd2-e1dfdb21b4a6 for instance 14245f9c-71e1-4dc8-ab39-783e2610f6e4 on n-h2-852278-4 Aug 27 03:39:25.435067 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-9d125aa3-f2d7-44bf-81f4-5cd86ad68268 req-2431791c-2016-4f08-a230-41c3dc7d42cc service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033280 Aug 27 03:39:25.435869 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3271/6499] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:39:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:39:58.357020 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:39:58.358294 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=13 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:39:58.359229 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:39:58.365599 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-95e3f161-caa3-4718-811d-f9414cf32e48 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:58.378794 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-95e3f161-caa3-4718-811d-f9414cf32e48 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:58.379294 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-95e3f161-caa3-4718-811d-f9414cf32e48 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:58.379729 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-95e3f161-caa3-4718-811d-f9414cf32e48 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:58.402678 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-95e3f161-caa3-4718-811d-f9414cf32e48 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 14245f9c-71e1-4dc8-ab39-783e2610f6e4] Going to try to stop instance {{(pid=134052) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 27 03:39:58.450742 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-95e3f161-caa3-4718-811d-f9414cf32e48 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "POST /compute/v2.1/servers/14245f9c-71e1-4dc8-ab39-783e2610f6e4/action" status: 202 len: 0 microversion: 2.1 time: 0.096689 Aug 27 03:39:58.451353 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3229/6500] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:39:58 2022] POST /compute/v2.1/servers/14245f9c-71e1-4dc8-ab39-783e2610f6e4/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:39:58.460605 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-39c05711-ac81-498d-a023-a222651f653e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:39:58.461298 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-39c05711-ac81-498d-a023-a222651f653e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 14245f9c-71e1-4dc8-ab39-783e2610f6e4] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:39:58.464537 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:39:58.465562 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=6 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:39:58.467641 n-d-852278-4 devstack@n-api.service[134051]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Aug 27 03:39:58.468443 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=11 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:39:58.469088 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=45 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:39:58.474839 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-39c05711-ac81-498d-a023-a222651f653e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:58.475479 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-39c05711-ac81-498d-a023-a222651f653e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:58.476058 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-39c05711-ac81-498d-a023-a222651f653e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:58.477084 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-39c05711-ac81-498d-a023-a222651f653e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:58.477550 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-39c05711-ac81-498d-a023-a222651f653e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:58.478242 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-39c05711-ac81-498d-a023-a222651f653e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:58.628787 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-39c05711-ac81-498d-a023-a222651f653e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:39:58.638398 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-39c05711-ac81-498d-a023-a222651f653e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/14245f9c-71e1-4dc8-ab39-783e2610f6e4" status: 200 len: 1676 microversion: 2.1 time: 0.182117 Aug 27 03:39:58.639101 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3272/6501] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:39:58 2022] GET /compute/v2.1/servers/14245f9c-71e1-4dc8-ab39-783e2610f6e4 => generated 1676 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:39:59.673769 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d26146ed-2c17-47cf-8445-278d3d41b2e9 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:39:59.674920 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d26146ed-2c17-47cf-8445-278d3d41b2e9 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 14245f9c-71e1-4dc8-ab39-783e2610f6e4] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:39:59.684197 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d26146ed-2c17-47cf-8445-278d3d41b2e9 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:59.684726 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d26146ed-2c17-47cf-8445-278d3d41b2e9 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:59.685166 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d26146ed-2c17-47cf-8445-278d3d41b2e9 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:59.685859 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d26146ed-2c17-47cf-8445-278d3d41b2e9 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:59.686311 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d26146ed-2c17-47cf-8445-278d3d41b2e9 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:59.686733 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d26146ed-2c17-47cf-8445-278d3d41b2e9 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:59.826559 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-d26146ed-2c17-47cf-8445-278d3d41b2e9 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:39:59.838253 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d26146ed-2c17-47cf-8445-278d3d41b2e9 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/14245f9c-71e1-4dc8-ab39-783e2610f6e4" status: 200 len: 1676 microversion: 2.1 time: 0.173269 Aug 27 03:39:59.838823 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3230/6502] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:39:59 2022] GET /compute/v2.1/servers/14245f9c-71e1-4dc8-ab39-783e2610f6e4 => generated 1676 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:40:00.861814 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7bbe699f-6cad-48c0-94bb-a3785ecb55f4 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:00.862690 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-7bbe699f-6cad-48c0-94bb-a3785ecb55f4 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 14245f9c-71e1-4dc8-ab39-783e2610f6e4] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:40:00.876739 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7bbe699f-6cad-48c0-94bb-a3785ecb55f4 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:00.877561 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7bbe699f-6cad-48c0-94bb-a3785ecb55f4 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:00.878302 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7bbe699f-6cad-48c0-94bb-a3785ecb55f4 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:00.879459 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7bbe699f-6cad-48c0-94bb-a3785ecb55f4 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:00.880216 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7bbe699f-6cad-48c0-94bb-a3785ecb55f4 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:00.880974 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7bbe699f-6cad-48c0-94bb-a3785ecb55f4 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:01.021999 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-7bbe699f-6cad-48c0-94bb-a3785ecb55f4 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:01.030280 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-7bbe699f-6cad-48c0-94bb-a3785ecb55f4 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/14245f9c-71e1-4dc8-ab39-783e2610f6e4" status: 200 len: 1676 microversion: 2.1 time: 0.174050 Aug 27 03:40:01.030867 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3273/6503] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:40:00 2022] GET /compute/v2.1/servers/14245f9c-71e1-4dc8-ab39-783e2610f6e4 => generated 1676 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:40:02.056836 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d1594da6-8e68-4e01-bdc0-eb7e3626d1d0 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:02.057684 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d1594da6-8e68-4e01-bdc0-eb7e3626d1d0 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 14245f9c-71e1-4dc8-ab39-783e2610f6e4] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:40:02.064915 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d1594da6-8e68-4e01-bdc0-eb7e3626d1d0 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:02.065432 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d1594da6-8e68-4e01-bdc0-eb7e3626d1d0 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:02.065867 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d1594da6-8e68-4e01-bdc0-eb7e3626d1d0 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:02.066569 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d1594da6-8e68-4e01-bdc0-eb7e3626d1d0 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:02.067043 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d1594da6-8e68-4e01-bdc0-eb7e3626d1d0 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:02.067463 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d1594da6-8e68-4e01-bdc0-eb7e3626d1d0 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:02.215285 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-d1594da6-8e68-4e01-bdc0-eb7e3626d1d0 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:02.223510 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d1594da6-8e68-4e01-bdc0-eb7e3626d1d0 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/14245f9c-71e1-4dc8-ab39-783e2610f6e4" status: 200 len: 1676 microversion: 2.1 time: 0.173754 Aug 27 03:40:02.224112 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3231/6504] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:40:02 2022] GET /compute/v2.1/servers/14245f9c-71e1-4dc8-ab39-783e2610f6e4 => generated 1676 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:40:03.248902 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-9b26bc22-ae46-42d9-a564-9ccf6f326178 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:03.249688 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-9b26bc22-ae46-42d9-a564-9ccf6f326178 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 14245f9c-71e1-4dc8-ab39-783e2610f6e4] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:40:03.261217 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9b26bc22-ae46-42d9-a564-9ccf6f326178 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:03.261855 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9b26bc22-ae46-42d9-a564-9ccf6f326178 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:03.262357 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9b26bc22-ae46-42d9-a564-9ccf6f326178 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:03.263142 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9b26bc22-ae46-42d9-a564-9ccf6f326178 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:03.263593 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9b26bc22-ae46-42d9-a564-9ccf6f326178 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:03.264027 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9b26bc22-ae46-42d9-a564-9ccf6f326178 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:03.405655 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-9b26bc22-ae46-42d9-a564-9ccf6f326178 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:03.417641 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-9b26bc22-ae46-42d9-a564-9ccf6f326178 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/14245f9c-71e1-4dc8-ab39-783e2610f6e4" status: 200 len: 1676 microversion: 2.1 time: 0.175335 Aug 27 03:40:03.418492 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3274/6505] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:40:03 2022] GET /compute/v2.1/servers/14245f9c-71e1-4dc8-ab39-783e2610f6e4 => generated 1676 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:40:04.449791 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b7c0e35a-1218-4266-8d0a-810af55a48e7 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:04.450460 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b7c0e35a-1218-4266-8d0a-810af55a48e7 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 14245f9c-71e1-4dc8-ab39-783e2610f6e4] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:40:04.458461 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b7c0e35a-1218-4266-8d0a-810af55a48e7 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:04.459021 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b7c0e35a-1218-4266-8d0a-810af55a48e7 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:04.459523 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b7c0e35a-1218-4266-8d0a-810af55a48e7 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:04.460348 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b7c0e35a-1218-4266-8d0a-810af55a48e7 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:04.460885 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b7c0e35a-1218-4266-8d0a-810af55a48e7 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:04.461412 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b7c0e35a-1218-4266-8d0a-810af55a48e7 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:04.598888 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b7c0e35a-1218-4266-8d0a-810af55a48e7 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:04.607143 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b7c0e35a-1218-4266-8d0a-810af55a48e7 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/14245f9c-71e1-4dc8-ab39-783e2610f6e4" status: 200 len: 1676 microversion: 2.1 time: 0.164026 Aug 27 03:40:04.607712 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3232/6506] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:40:04 2022] GET /compute/v2.1/servers/14245f9c-71e1-4dc8-ab39-783e2610f6e4 => generated 1676 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:40:05.633342 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-165ec0ae-7518-485d-9a61-85bc3928bc0d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:05.634331 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-165ec0ae-7518-485d-9a61-85bc3928bc0d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 14245f9c-71e1-4dc8-ab39-783e2610f6e4] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:40:05.646312 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-165ec0ae-7518-485d-9a61-85bc3928bc0d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:05.647016 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-165ec0ae-7518-485d-9a61-85bc3928bc0d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:05.647619 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-165ec0ae-7518-485d-9a61-85bc3928bc0d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:05.648666 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-165ec0ae-7518-485d-9a61-85bc3928bc0d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:05.649297 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-165ec0ae-7518-485d-9a61-85bc3928bc0d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:05.649947 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-165ec0ae-7518-485d-9a61-85bc3928bc0d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:05.788908 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-165ec0ae-7518-485d-9a61-85bc3928bc0d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:05.799730 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-165ec0ae-7518-485d-9a61-85bc3928bc0d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/14245f9c-71e1-4dc8-ab39-783e2610f6e4" status: 200 len: 1676 microversion: 2.1 time: 0.172978 Aug 27 03:40:05.800931 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3275/6507] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:40:05 2022] GET /compute/v2.1/servers/14245f9c-71e1-4dc8-ab39-783e2610f6e4 => generated 1676 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:40:06.822499 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ef127775-fcb6-44dd-8da7-89fa8eb04fbe tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:06.823305 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-ef127775-fcb6-44dd-8da7-89fa8eb04fbe tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 14245f9c-71e1-4dc8-ab39-783e2610f6e4] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:40:06.831007 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ef127775-fcb6-44dd-8da7-89fa8eb04fbe tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:06.831494 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ef127775-fcb6-44dd-8da7-89fa8eb04fbe tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:06.831932 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ef127775-fcb6-44dd-8da7-89fa8eb04fbe tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:06.832662 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ef127775-fcb6-44dd-8da7-89fa8eb04fbe tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:06.833114 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ef127775-fcb6-44dd-8da7-89fa8eb04fbe tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:06.833535 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ef127775-fcb6-44dd-8da7-89fa8eb04fbe tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:06.967948 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-ef127775-fcb6-44dd-8da7-89fa8eb04fbe tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:06.976115 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ef127775-fcb6-44dd-8da7-89fa8eb04fbe tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/14245f9c-71e1-4dc8-ab39-783e2610f6e4" status: 200 len: 1676 microversion: 2.1 time: 0.158303 Aug 27 03:40:06.976728 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3233/6508] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:40:06 2022] GET /compute/v2.1/servers/14245f9c-71e1-4dc8-ab39-783e2610f6e4 => generated 1676 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:40:07.998124 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-bebc18d7-6b63-40ab-ae35-c48e38ba35d4 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:07.998765 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-bebc18d7-6b63-40ab-ae35-c48e38ba35d4 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 14245f9c-71e1-4dc8-ab39-783e2610f6e4] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:40:08.005852 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bebc18d7-6b63-40ab-ae35-c48e38ba35d4 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:08.006362 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bebc18d7-6b63-40ab-ae35-c48e38ba35d4 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:08.006813 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bebc18d7-6b63-40ab-ae35-c48e38ba35d4 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:08.007529 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bebc18d7-6b63-40ab-ae35-c48e38ba35d4 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:08.008002 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bebc18d7-6b63-40ab-ae35-c48e38ba35d4 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:08.008495 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bebc18d7-6b63-40ab-ae35-c48e38ba35d4 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:08.144107 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-bebc18d7-6b63-40ab-ae35-c48e38ba35d4 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:08.155922 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-bebc18d7-6b63-40ab-ae35-c48e38ba35d4 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/14245f9c-71e1-4dc8-ab39-783e2610f6e4" status: 200 len: 1676 microversion: 2.1 time: 0.161847 Aug 27 03:40:08.156698 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3276/6509] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:40:07 2022] GET /compute/v2.1/servers/14245f9c-71e1-4dc8-ab39-783e2610f6e4 => generated 1676 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:40:09.181958 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-26f4c512-8f4b-4fdb-bc30-54ec749715ee tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:09.182961 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-26f4c512-8f4b-4fdb-bc30-54ec749715ee tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 14245f9c-71e1-4dc8-ab39-783e2610f6e4] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:40:09.194774 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-26f4c512-8f4b-4fdb-bc30-54ec749715ee tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:09.195581 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-26f4c512-8f4b-4fdb-bc30-54ec749715ee tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:09.196375 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-26f4c512-8f4b-4fdb-bc30-54ec749715ee tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:09.197518 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-26f4c512-8f4b-4fdb-bc30-54ec749715ee tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:09.198354 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-26f4c512-8f4b-4fdb-bc30-54ec749715ee tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:09.198783 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-26f4c512-8f4b-4fdb-bc30-54ec749715ee tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:09.341078 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-26f4c512-8f4b-4fdb-bc30-54ec749715ee tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:09.349302 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-26f4c512-8f4b-4fdb-bc30-54ec749715ee tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/14245f9c-71e1-4dc8-ab39-783e2610f6e4" status: 200 len: 1676 microversion: 2.1 time: 0.174043 Aug 27 03:40:09.349867 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3234/6510] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:40:09 2022] GET /compute/v2.1/servers/14245f9c-71e1-4dc8-ab39-783e2610f6e4 => generated 1676 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:40:10.374564 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-1e5f3bd3-ec52-43be-8a18-0c5d01dd36d1 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:10.375452 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-1e5f3bd3-ec52-43be-8a18-0c5d01dd36d1 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 14245f9c-71e1-4dc8-ab39-783e2610f6e4] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:40:10.385335 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1e5f3bd3-ec52-43be-8a18-0c5d01dd36d1 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:10.386015 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1e5f3bd3-ec52-43be-8a18-0c5d01dd36d1 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:10.386471 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1e5f3bd3-ec52-43be-8a18-0c5d01dd36d1 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:10.387188 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1e5f3bd3-ec52-43be-8a18-0c5d01dd36d1 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:10.387651 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1e5f3bd3-ec52-43be-8a18-0c5d01dd36d1 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:10.388089 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1e5f3bd3-ec52-43be-8a18-0c5d01dd36d1 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:10.536290 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-1e5f3bd3-ec52-43be-8a18-0c5d01dd36d1 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:10.545214 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-1e5f3bd3-ec52-43be-8a18-0c5d01dd36d1 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/14245f9c-71e1-4dc8-ab39-783e2610f6e4" status: 200 len: 1676 microversion: 2.1 time: 0.176513 Aug 27 03:40:10.546078 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3277/6511] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:40:10 2022] GET /compute/v2.1/servers/14245f9c-71e1-4dc8-ab39-783e2610f6e4 => generated 1676 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:40:11.576557 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-79dc7000-acb6-4cc8-8870-0a3a6d49be82 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:11.577263 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-79dc7000-acb6-4cc8-8870-0a3a6d49be82 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 14245f9c-71e1-4dc8-ab39-783e2610f6e4] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:40:11.590283 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-79dc7000-acb6-4cc8-8870-0a3a6d49be82 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:11.590776 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-79dc7000-acb6-4cc8-8870-0a3a6d49be82 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:11.591235 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-79dc7000-acb6-4cc8-8870-0a3a6d49be82 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:11.591971 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-79dc7000-acb6-4cc8-8870-0a3a6d49be82 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:11.592570 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-79dc7000-acb6-4cc8-8870-0a3a6d49be82 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:11.592990 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-79dc7000-acb6-4cc8-8870-0a3a6d49be82 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:11.731518 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-79dc7000-acb6-4cc8-8870-0a3a6d49be82 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:11.739505 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-79dc7000-acb6-4cc8-8870-0a3a6d49be82 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/14245f9c-71e1-4dc8-ab39-783e2610f6e4" status: 200 len: 1676 microversion: 2.1 time: 0.168370 Aug 27 03:40:11.740106 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3235/6512] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:40:11 2022] GET /compute/v2.1/servers/14245f9c-71e1-4dc8-ab39-783e2610f6e4 => generated 1676 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:40:12.762405 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-52820f03-b6f4-4d65-86a1-166527c7a4e0 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:12.763041 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-52820f03-b6f4-4d65-86a1-166527c7a4e0 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 14245f9c-71e1-4dc8-ab39-783e2610f6e4] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:40:12.770605 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-52820f03-b6f4-4d65-86a1-166527c7a4e0 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:12.771117 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-52820f03-b6f4-4d65-86a1-166527c7a4e0 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:12.771567 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-52820f03-b6f4-4d65-86a1-166527c7a4e0 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:12.772287 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-52820f03-b6f4-4d65-86a1-166527c7a4e0 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:12.772840 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-52820f03-b6f4-4d65-86a1-166527c7a4e0 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:12.773262 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-52820f03-b6f4-4d65-86a1-166527c7a4e0 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:12.906690 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-52820f03-b6f4-4d65-86a1-166527c7a4e0 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:12.918110 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-52820f03-b6f4-4d65-86a1-166527c7a4e0 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/14245f9c-71e1-4dc8-ab39-783e2610f6e4" status: 200 len: 1676 microversion: 2.1 time: 0.159786 Aug 27 03:40:12.918689 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3278/6513] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:40:12 2022] GET /compute/v2.1/servers/14245f9c-71e1-4dc8-ab39-783e2610f6e4 => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:40:13.940645 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-59db46ec-3d55-40aa-9c86-5dad72908b71 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:13.941258 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-59db46ec-3d55-40aa-9c86-5dad72908b71 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 14245f9c-71e1-4dc8-ab39-783e2610f6e4] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:40:13.948551 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-59db46ec-3d55-40aa-9c86-5dad72908b71 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:13.949099 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-59db46ec-3d55-40aa-9c86-5dad72908b71 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:13.949529 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-59db46ec-3d55-40aa-9c86-5dad72908b71 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:13.950228 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-59db46ec-3d55-40aa-9c86-5dad72908b71 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:13.950701 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-59db46ec-3d55-40aa-9c86-5dad72908b71 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:13.951105 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-59db46ec-3d55-40aa-9c86-5dad72908b71 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:14.095663 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-59db46ec-3d55-40aa-9c86-5dad72908b71 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:14.108672 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-59db46ec-3d55-40aa-9c86-5dad72908b71 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/14245f9c-71e1-4dc8-ab39-783e2610f6e4" status: 200 len: 1653 microversion: 2.1 time: 0.171681 Aug 27 03:40:14.109619 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3236/6514] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:40:13 2022] GET /compute/v2.1/servers/14245f9c-71e1-4dc8-ab39-783e2610f6e4 => generated 1653 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:40:14.136197 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4d14d31d-e9d3-4506-9c80-38477edecaf6 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:40:14.138546 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-4d14d31d-e9d3-4506-9c80-38477edecaf6 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 14245f9c-71e1-4dc8-ab39-783e2610f6e4] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:40:14.145937 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4d14d31d-e9d3-4506-9c80-38477edecaf6 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:14.146466 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4d14d31d-e9d3-4506-9c80-38477edecaf6 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:14.146923 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4d14d31d-e9d3-4506-9c80-38477edecaf6 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:14.147666 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4d14d31d-e9d3-4506-9c80-38477edecaf6 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:14.148138 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4d14d31d-e9d3-4506-9c80-38477edecaf6 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:14.148617 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4d14d31d-e9d3-4506-9c80-38477edecaf6 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:14.178672 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-4d14d31d-e9d3-4506-9c80-38477edecaf6 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:14.185194 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-4d14d31d-e9d3-4506-9c80-38477edecaf6 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 14245f9c-71e1-4dc8-ab39-783e2610f6e4] Old instance type m1.heat2, new instance type m1.heat {{(pid=134051) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 27 03:40:14.192208 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-4d14d31d-e9d3-4506-9c80-38477edecaf6 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Flavor limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:40:14.192675 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-4d14d31d-e9d3-4506-9c80-38477edecaf6 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Image limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:40:14.193160 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-4d14d31d-e9d3-4506-9c80-38477edecaf6 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Flavor pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:40:14.193583 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-4d14d31d-e9d3-4506-9c80-38477edecaf6 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Image pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:40:14.194007 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-4d14d31d-e9d3-4506-9c80-38477edecaf6 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:40:14.268772 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-4d14d31d-e9d3-4506-9c80-38477edecaf6 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "POST /compute/v2.1/servers/14245f9c-71e1-4dc8-ab39-783e2610f6e4/action" status: 202 len: 0 microversion: 2.1 time: 0.138570 Aug 27 03:40:14.269614 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3279/6515] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:40:14 2022] POST /compute/v2.1/servers/14245f9c-71e1-4dc8-ab39-783e2610f6e4/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:40:14.278128 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e21d4e46-07c1-47a3-81e2-f6138bd58253 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:14.278799 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-e21d4e46-07c1-47a3-81e2-f6138bd58253 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 14245f9c-71e1-4dc8-ab39-783e2610f6e4] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:40:14.285633 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e21d4e46-07c1-47a3-81e2-f6138bd58253 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:14.286136 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e21d4e46-07c1-47a3-81e2-f6138bd58253 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:14.286614 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e21d4e46-07c1-47a3-81e2-f6138bd58253 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:14.287378 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e21d4e46-07c1-47a3-81e2-f6138bd58253 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:14.287852 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e21d4e46-07c1-47a3-81e2-f6138bd58253 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:14.288279 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e21d4e46-07c1-47a3-81e2-f6138bd58253 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:14.436903 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-e21d4e46-07c1-47a3-81e2-f6138bd58253 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:14.445018 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e21d4e46-07c1-47a3-81e2-f6138bd58253 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/14245f9c-71e1-4dc8-ab39-783e2610f6e4" status: 200 len: 1676 microversion: 2.1 time: 0.171276 Aug 27 03:40:14.445691 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3237/6516] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:40:14 2022] GET /compute/v2.1/servers/14245f9c-71e1-4dc8-ab39-783e2610f6e4 => generated 1676 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:40:15.466905 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4b97309b-b500-4711-b015-c8cc28041a4e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:15.467514 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-4b97309b-b500-4711-b015-c8cc28041a4e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 14245f9c-71e1-4dc8-ab39-783e2610f6e4] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:40:15.477337 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4b97309b-b500-4711-b015-c8cc28041a4e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:15.477878 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4b97309b-b500-4711-b015-c8cc28041a4e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:15.478356 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4b97309b-b500-4711-b015-c8cc28041a4e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:15.479073 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4b97309b-b500-4711-b015-c8cc28041a4e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:15.479657 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4b97309b-b500-4711-b015-c8cc28041a4e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:15.480277 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4b97309b-b500-4711-b015-c8cc28041a4e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:15.618381 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-4b97309b-b500-4711-b015-c8cc28041a4e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:15.627602 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-4b97309b-b500-4711-b015-c8cc28041a4e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/14245f9c-71e1-4dc8-ab39-783e2610f6e4" status: 200 len: 1676 microversion: 2.1 time: 0.165469 Aug 27 03:40:15.628272 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3280/6517] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:40:15 2022] GET /compute/v2.1/servers/14245f9c-71e1-4dc8-ab39-783e2610f6e4 => generated 1676 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:40:16.651906 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d38ecfd2-ef4d-4d24-bb3f-37af5d3c87a4 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:16.653134 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d38ecfd2-ef4d-4d24-bb3f-37af5d3c87a4 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 14245f9c-71e1-4dc8-ab39-783e2610f6e4] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:40:16.663536 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d38ecfd2-ef4d-4d24-bb3f-37af5d3c87a4 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:16.664287 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d38ecfd2-ef4d-4d24-bb3f-37af5d3c87a4 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:16.664993 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d38ecfd2-ef4d-4d24-bb3f-37af5d3c87a4 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:16.666037 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d38ecfd2-ef4d-4d24-bb3f-37af5d3c87a4 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:16.666717 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d38ecfd2-ef4d-4d24-bb3f-37af5d3c87a4 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:16.667356 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d38ecfd2-ef4d-4d24-bb3f-37af5d3c87a4 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:16.813241 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-d38ecfd2-ef4d-4d24-bb3f-37af5d3c87a4 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:16.821245 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d38ecfd2-ef4d-4d24-bb3f-37af5d3c87a4 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/14245f9c-71e1-4dc8-ab39-783e2610f6e4" status: 200 len: 1681 microversion: 2.1 time: 0.175309 Aug 27 03:40:16.821877 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3238/6518] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:40:16 2022] GET /compute/v2.1/servers/14245f9c-71e1-4dc8-ab39-783e2610f6e4 => generated 1681 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:40:17.845876 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-73b044d0-5be1-4ac7-a604-6eed8803e4fe tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:17.846485 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-73b044d0-5be1-4ac7-a604-6eed8803e4fe tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 14245f9c-71e1-4dc8-ab39-783e2610f6e4] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:40:17.854952 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-73b044d0-5be1-4ac7-a604-6eed8803e4fe tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:17.855547 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-73b044d0-5be1-4ac7-a604-6eed8803e4fe tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:17.856143 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-73b044d0-5be1-4ac7-a604-6eed8803e4fe tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:17.856905 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-73b044d0-5be1-4ac7-a604-6eed8803e4fe tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:17.857371 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-73b044d0-5be1-4ac7-a604-6eed8803e4fe tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:17.857810 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-73b044d0-5be1-4ac7-a604-6eed8803e4fe tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:17.992229 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-73b044d0-5be1-4ac7-a604-6eed8803e4fe tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:18.000756 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-73b044d0-5be1-4ac7-a604-6eed8803e4fe tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/14245f9c-71e1-4dc8-ab39-783e2610f6e4" status: 200 len: 1681 microversion: 2.1 time: 0.159662 Aug 27 03:40:18.001360 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3281/6519] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:40:17 2022] GET /compute/v2.1/servers/14245f9c-71e1-4dc8-ab39-783e2610f6e4 => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:40:18.711322 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-5b04dffa-b7c7-4746-a4ff-3c34d5accea9 req-5036a42b-3667-4bfb-9f54-cc3e73256654 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14245f9c-71e1-4dc8-ab39-783e2610f6e4", "name": "network-vif-unplugged", "status": "completed", "tag": "bbab562a-46ac-4dcd-bbd2-e1dfdb21b4a6"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:40:18.722831 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-5b04dffa-b7c7-4746-a4ff-3c34d5accea9 req-5036a42b-3667-4bfb-9f54-cc3e73256654 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:18.723304 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-5b04dffa-b7c7-4746-a4ff-3c34d5accea9 req-5036a42b-3667-4bfb-9f54-cc3e73256654 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:18.723733 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-5b04dffa-b7c7-4746-a4ff-3c34d5accea9 req-5036a42b-3667-4bfb-9f54-cc3e73256654 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:18.738723 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-5b04dffa-b7c7-4746-a4ff-3c34d5accea9 req-5036a42b-3667-4bfb-9f54-cc3e73256654 service nova] Creating event network-vif-unplugged:bbab562a-46ac-4dcd-bbd2-e1dfdb21b4a6 for instance 14245f9c-71e1-4dc8-ab39-783e2610f6e4 on n-h1-852278-4 Aug 27 03:40:18.744440 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [req-5b04dffa-b7c7-4746-a4ff-3c34d5accea9 req-5036a42b-3667-4bfb-9f54-cc3e73256654 service nova] Instance 14245f9c-71e1-4dc8-ab39-783e2610f6e4 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-852278-4', 'n-h1-852278-4'} {{(pid=134052) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 03:40:18.755450 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-5b04dffa-b7c7-4746-a4ff-3c34d5accea9 req-5036a42b-3667-4bfb-9f54-cc3e73256654 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048093 Aug 27 03:40:18.756413 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3239/6520] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:40:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:40:19.022204 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a77a12ce-301f-4bf7-bd0b-f3a65df3c581 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:19.023437 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-a77a12ce-301f-4bf7-bd0b-f3a65df3c581 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 14245f9c-71e1-4dc8-ab39-783e2610f6e4] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:40:19.030640 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a77a12ce-301f-4bf7-bd0b-f3a65df3c581 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:19.031174 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a77a12ce-301f-4bf7-bd0b-f3a65df3c581 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:19.031626 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a77a12ce-301f-4bf7-bd0b-f3a65df3c581 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:19.032363 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a77a12ce-301f-4bf7-bd0b-f3a65df3c581 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:19.032864 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a77a12ce-301f-4bf7-bd0b-f3a65df3c581 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:19.033308 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a77a12ce-301f-4bf7-bd0b-f3a65df3c581 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:19.272739 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-a77a12ce-301f-4bf7-bd0b-f3a65df3c581 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:19.282085 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a77a12ce-301f-4bf7-bd0b-f3a65df3c581 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/14245f9c-71e1-4dc8-ab39-783e2610f6e4" status: 200 len: 1680 microversion: 2.1 time: 0.263758 Aug 27 03:40:19.282677 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3282/6521] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:40:19 2022] GET /compute/v2.1/servers/14245f9c-71e1-4dc8-ab39-783e2610f6e4 => generated 1680 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:40:20.307041 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-240dab5d-1eb3-408c-848f-43b78adcd088 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:20.307820 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-240dab5d-1eb3-408c-848f-43b78adcd088 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 14245f9c-71e1-4dc8-ab39-783e2610f6e4] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:40:20.316016 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-240dab5d-1eb3-408c-848f-43b78adcd088 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:20.316727 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-240dab5d-1eb3-408c-848f-43b78adcd088 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:20.317295 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-240dab5d-1eb3-408c-848f-43b78adcd088 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:20.318185 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-240dab5d-1eb3-408c-848f-43b78adcd088 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:20.318766 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-240dab5d-1eb3-408c-848f-43b78adcd088 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:20.319368 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-240dab5d-1eb3-408c-848f-43b78adcd088 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:20.452685 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-240dab5d-1eb3-408c-848f-43b78adcd088 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:20.461049 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-240dab5d-1eb3-408c-848f-43b78adcd088 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/14245f9c-71e1-4dc8-ab39-783e2610f6e4" status: 200 len: 1678 microversion: 2.1 time: 0.160886 Aug 27 03:40:20.461632 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3240/6522] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:40:20 2022] GET /compute/v2.1/servers/14245f9c-71e1-4dc8-ab39-783e2610f6e4 => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:40:20.794692 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-1b14408f-3aee-475f-955d-d65e0d95aed3 req-8e9f2fe3-dbd8-4c24-89fc-a95f54716301 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14245f9c-71e1-4dc8-ab39-783e2610f6e4", "tag": "bbab562a-46ac-4dcd-bbd2-e1dfdb21b4a6"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:40:20.805709 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-1b14408f-3aee-475f-955d-d65e0d95aed3 req-8e9f2fe3-dbd8-4c24-89fc-a95f54716301 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:20.806200 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-1b14408f-3aee-475f-955d-d65e0d95aed3 req-8e9f2fe3-dbd8-4c24-89fc-a95f54716301 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:20.806644 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-1b14408f-3aee-475f-955d-d65e0d95aed3 req-8e9f2fe3-dbd8-4c24-89fc-a95f54716301 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:20.818559 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-1b14408f-3aee-475f-955d-d65e0d95aed3 req-8e9f2fe3-dbd8-4c24-89fc-a95f54716301 service nova] Creating event network-changed:bbab562a-46ac-4dcd-bbd2-e1dfdb21b4a6 for instance 14245f9c-71e1-4dc8-ab39-783e2610f6e4 on n-h1-852278-4 Aug 27 03:40:20.824345 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [req-1b14408f-3aee-475f-955d-d65e0d95aed3 req-8e9f2fe3-dbd8-4c24-89fc-a95f54716301 service nova] Instance 14245f9c-71e1-4dc8-ab39-783e2610f6e4 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-852278-4', 'n-h1-852278-4'} {{(pid=134051) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 03:40:20.835510 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-1b14408f-3aee-475f-955d-d65e0d95aed3 req-8e9f2fe3-dbd8-4c24-89fc-a95f54716301 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044707 Aug 27 03:40:20.836129 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3283/6523] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:40:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:40:21.483411 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-dc785f6a-287a-427b-b6b9-2e70499b45bf tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:21.484342 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-dc785f6a-287a-427b-b6b9-2e70499b45bf tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 14245f9c-71e1-4dc8-ab39-783e2610f6e4] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:40:21.491825 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dc785f6a-287a-427b-b6b9-2e70499b45bf tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:21.492359 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dc785f6a-287a-427b-b6b9-2e70499b45bf tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:21.492794 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dc785f6a-287a-427b-b6b9-2e70499b45bf tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:21.493511 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dc785f6a-287a-427b-b6b9-2e70499b45bf tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:21.493967 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dc785f6a-287a-427b-b6b9-2e70499b45bf tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:21.494590 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dc785f6a-287a-427b-b6b9-2e70499b45bf tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:22.113661 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-dc785f6a-287a-427b-b6b9-2e70499b45bf tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:22.122431 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-dc785f6a-287a-427b-b6b9-2e70499b45bf tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/14245f9c-71e1-4dc8-ab39-783e2610f6e4" status: 200 len: 1674 microversion: 2.1 time: 0.643180 Aug 27 03:40:22.123066 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3241/6524] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:40:21 2022] GET /compute/v2.1/servers/14245f9c-71e1-4dc8-ab39-783e2610f6e4 => generated 1674 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:40:22.147629 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4c792ed5-58e9-460d-aa5e-8d8c04ad03be tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:40:22.149054 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-4c792ed5-58e9-460d-aa5e-8d8c04ad03be tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 14245f9c-71e1-4dc8-ab39-783e2610f6e4] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:40:22.156997 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4c792ed5-58e9-460d-aa5e-8d8c04ad03be tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:22.157519 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4c792ed5-58e9-460d-aa5e-8d8c04ad03be tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:22.158020 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4c792ed5-58e9-460d-aa5e-8d8c04ad03be tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:22.158740 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4c792ed5-58e9-460d-aa5e-8d8c04ad03be tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:22.159229 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4c792ed5-58e9-460d-aa5e-8d8c04ad03be tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:22.159658 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4c792ed5-58e9-460d-aa5e-8d8c04ad03be tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:22.224065 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-4c792ed5-58e9-460d-aa5e-8d8c04ad03be tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "POST /compute/v2.1/servers/14245f9c-71e1-4dc8-ab39-783e2610f6e4/action" status: 204 len: 0 microversion: 2.1 time: 0.081524 Aug 27 03:40:22.224766 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3284/6525] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:40:22 2022] POST /compute/v2.1/servers/14245f9c-71e1-4dc8-ab39-783e2610f6e4/action => generated 0 bytes in 83 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:40:22.234198 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-be9c77ef-107e-4def-b480-4d52d90c8d15 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:22.234796 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-be9c77ef-107e-4def-b480-4d52d90c8d15 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 14245f9c-71e1-4dc8-ab39-783e2610f6e4] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:40:22.241114 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-be9c77ef-107e-4def-b480-4d52d90c8d15 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:22.241598 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-be9c77ef-107e-4def-b480-4d52d90c8d15 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:22.242040 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-be9c77ef-107e-4def-b480-4d52d90c8d15 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:22.242768 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-be9c77ef-107e-4def-b480-4d52d90c8d15 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:22.243209 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-be9c77ef-107e-4def-b480-4d52d90c8d15 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:22.243630 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-be9c77ef-107e-4def-b480-4d52d90c8d15 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:22.450436 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-be9c77ef-107e-4def-b480-4d52d90c8d15 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:22.458747 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-be9c77ef-107e-4def-b480-4d52d90c8d15 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/14245f9c-71e1-4dc8-ab39-783e2610f6e4" status: 200 len: 1674 microversion: 2.1 time: 0.228707 Aug 27 03:40:22.459403 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3242/6526] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:40:22 2022] GET /compute/v2.1/servers/14245f9c-71e1-4dc8-ab39-783e2610f6e4 => generated 1674 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:40:23.482358 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-9e52c5c1-d8b1-46dd-b435-489a72b64758 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:23.483443 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-9e52c5c1-d8b1-46dd-b435-489a72b64758 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 14245f9c-71e1-4dc8-ab39-783e2610f6e4] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:40:23.492451 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9e52c5c1-d8b1-46dd-b435-489a72b64758 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:23.492990 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9e52c5c1-d8b1-46dd-b435-489a72b64758 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:23.493618 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9e52c5c1-d8b1-46dd-b435-489a72b64758 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:23.495160 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9e52c5c1-d8b1-46dd-b435-489a72b64758 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:23.495640 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9e52c5c1-d8b1-46dd-b435-489a72b64758 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:23.496442 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9e52c5c1-d8b1-46dd-b435-489a72b64758 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:23.634460 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-9e52c5c1-d8b1-46dd-b435-489a72b64758 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:23.642569 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-9e52c5c1-d8b1-46dd-b435-489a72b64758 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/14245f9c-71e1-4dc8-ab39-783e2610f6e4" status: 200 len: 1674 microversion: 2.1 time: 0.165957 Aug 27 03:40:23.643196 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3285/6527] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:40:23 2022] GET /compute/v2.1/servers/14245f9c-71e1-4dc8-ab39-783e2610f6e4 => generated 1674 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:40:24.663803 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-af322160-48c4-4e4c-8ded-25536de94b36 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:24.664524 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-af322160-48c4-4e4c-8ded-25536de94b36 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 14245f9c-71e1-4dc8-ab39-783e2610f6e4] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:40:24.671473 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-af322160-48c4-4e4c-8ded-25536de94b36 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:24.671960 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-af322160-48c4-4e4c-8ded-25536de94b36 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:24.672563 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-af322160-48c4-4e4c-8ded-25536de94b36 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:24.673269 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-af322160-48c4-4e4c-8ded-25536de94b36 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:24.673718 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-af322160-48c4-4e4c-8ded-25536de94b36 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:24.674140 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-af322160-48c4-4e4c-8ded-25536de94b36 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:24.778830 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-3f023a87-4943-42af-91a2-b04fb435661b req-2d13cf32-e37f-4459-897c-c9ea1740da34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14245f9c-71e1-4dc8-ab39-783e2610f6e4", "name": "network-vif-plugged", "status": "completed", "tag": "bbab562a-46ac-4dcd-bbd2-e1dfdb21b4a6"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:40:24.794506 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-3f023a87-4943-42af-91a2-b04fb435661b req-2d13cf32-e37f-4459-897c-c9ea1740da34 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:24.795294 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-3f023a87-4943-42af-91a2-b04fb435661b req-2d13cf32-e37f-4459-897c-c9ea1740da34 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:24.796044 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-3f023a87-4943-42af-91a2-b04fb435661b req-2d13cf32-e37f-4459-897c-c9ea1740da34 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:24.810514 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-3f023a87-4943-42af-91a2-b04fb435661b req-2d13cf32-e37f-4459-897c-c9ea1740da34 service nova] Creating event network-vif-plugged:bbab562a-46ac-4dcd-bbd2-e1dfdb21b4a6 for instance 14245f9c-71e1-4dc8-ab39-783e2610f6e4 on n-h1-852278-4 Aug 27 03:40:24.816876 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-3f023a87-4943-42af-91a2-b04fb435661b req-2d13cf32-e37f-4459-897c-c9ea1740da34 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042640 Aug 27 03:40:24.817836 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3286/6528] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:40:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:40:24.822113 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-af322160-48c4-4e4c-8ded-25536de94b36 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:24.830544 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-af322160-48c4-4e4c-8ded-25536de94b36 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/14245f9c-71e1-4dc8-ab39-783e2610f6e4" status: 200 len: 1653 microversion: 2.1 time: 0.171039 Aug 27 03:40:24.831126 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3243/6529] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:40:24 2022] GET /compute/v2.1/servers/14245f9c-71e1-4dc8-ab39-783e2610f6e4 => generated 1653 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:40:24.852647 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-5718730a-e937-4fa5-8b63-a270c42c0c47 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:24.853371 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-5718730a-e937-4fa5-8b63-a270c42c0c47 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 14245f9c-71e1-4dc8-ab39-783e2610f6e4] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:40:24.859636 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5718730a-e937-4fa5-8b63-a270c42c0c47 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:24.860195 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5718730a-e937-4fa5-8b63-a270c42c0c47 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:24.860677 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5718730a-e937-4fa5-8b63-a270c42c0c47 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:24.861385 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5718730a-e937-4fa5-8b63-a270c42c0c47 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:24.861859 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5718730a-e937-4fa5-8b63-a270c42c0c47 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:24.862305 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5718730a-e937-4fa5-8b63-a270c42c0c47 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:24.866398 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:40:25.002494 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-5718730a-e937-4fa5-8b63-a270c42c0c47 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:25.011377 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-5718730a-e937-4fa5-8b63-a270c42c0c47 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/14245f9c-71e1-4dc8-ab39-783e2610f6e4" status: 200 len: 1653 microversion: 2.1 time: 0.163265 Aug 27 03:40:25.012011 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3287/6530] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:40:24 2022] GET /compute/v2.1/servers/14245f9c-71e1-4dc8-ab39-783e2610f6e4 => generated 1653 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:40:25.031809 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-15d2e7f9-f42e-4e6f-ab7f-5be5717525c7 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:40:25.039935 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-15d2e7f9-f42e-4e6f-ab7f-5be5717525c7 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:25.040693 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-15d2e7f9-f42e-4e6f-ab7f-5be5717525c7 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:25.041275 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-15d2e7f9-f42e-4e6f-ab7f-5be5717525c7 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:25.065548 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-15d2e7f9-f42e-4e6f-ab7f-5be5717525c7 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 14245f9c-71e1-4dc8-ab39-783e2610f6e4] Going to try to start instance {{(pid=134052) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 27 03:40:25.069876 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:40:25.113076 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-15d2e7f9-f42e-4e6f-ab7f-5be5717525c7 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "POST /compute/v2.1/servers/14245f9c-71e1-4dc8-ab39-783e2610f6e4/action" status: 202 len: 0 microversion: 2.1 time: 0.085150 Aug 27 03:40:25.113728 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3244/6531] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:40:25 2022] POST /compute/v2.1/servers/14245f9c-71e1-4dc8-ab39-783e2610f6e4/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:40:25.122087 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-5fd7bf2a-5d75-4ff6-b80b-eb51cd048a4b tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:25.122708 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-5fd7bf2a-5d75-4ff6-b80b-eb51cd048a4b tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 14245f9c-71e1-4dc8-ab39-783e2610f6e4] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:40:25.129915 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5fd7bf2a-5d75-4ff6-b80b-eb51cd048a4b tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:25.130399 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5fd7bf2a-5d75-4ff6-b80b-eb51cd048a4b tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:25.130873 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5fd7bf2a-5d75-4ff6-b80b-eb51cd048a4b tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:25.131712 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5fd7bf2a-5d75-4ff6-b80b-eb51cd048a4b tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:25.132182 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5fd7bf2a-5d75-4ff6-b80b-eb51cd048a4b tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:25.132717 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5fd7bf2a-5d75-4ff6-b80b-eb51cd048a4b tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:25.326593 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-5fd7bf2a-5d75-4ff6-b80b-eb51cd048a4b tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:25.334644 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-5fd7bf2a-5d75-4ff6-b80b-eb51cd048a4b tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/14245f9c-71e1-4dc8-ab39-783e2610f6e4" status: 200 len: 1662 microversion: 2.1 time: 0.216419 Aug 27 03:40:25.335219 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3288/6532] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:40:25 2022] GET /compute/v2.1/servers/14245f9c-71e1-4dc8-ab39-783e2610f6e4 => generated 1662 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:40:26.359256 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-cd83a844-0db9-43fd-88f8-7e9501554e8a tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:26.361105 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-cd83a844-0db9-43fd-88f8-7e9501554e8a tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 14245f9c-71e1-4dc8-ab39-783e2610f6e4] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:40:26.366726 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cd83a844-0db9-43fd-88f8-7e9501554e8a tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:26.367215 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cd83a844-0db9-43fd-88f8-7e9501554e8a tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:26.367644 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cd83a844-0db9-43fd-88f8-7e9501554e8a tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:26.368353 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cd83a844-0db9-43fd-88f8-7e9501554e8a tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:26.368796 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cd83a844-0db9-43fd-88f8-7e9501554e8a tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:26.369209 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cd83a844-0db9-43fd-88f8-7e9501554e8a tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:26.506352 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-cd83a844-0db9-43fd-88f8-7e9501554e8a tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:26.514586 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-cd83a844-0db9-43fd-88f8-7e9501554e8a tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/14245f9c-71e1-4dc8-ab39-783e2610f6e4" status: 200 len: 1666 microversion: 2.1 time: 0.161192 Aug 27 03:40:26.515143 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3245/6533] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:40:26 2022] GET /compute/v2.1/servers/14245f9c-71e1-4dc8-ab39-783e2610f6e4 => generated 1666 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:40:26.535150 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4604fa68-195b-4d48-bd89-83fdce76f01e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:26.535654 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-4604fa68-195b-4d48-bd89-83fdce76f01e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 14245f9c-71e1-4dc8-ab39-783e2610f6e4] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:40:26.542985 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4604fa68-195b-4d48-bd89-83fdce76f01e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:26.543488 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4604fa68-195b-4d48-bd89-83fdce76f01e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:26.543939 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4604fa68-195b-4d48-bd89-83fdce76f01e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:26.544687 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4604fa68-195b-4d48-bd89-83fdce76f01e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:26.545170 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4604fa68-195b-4d48-bd89-83fdce76f01e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:26.545597 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4604fa68-195b-4d48-bd89-83fdce76f01e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:26.571946 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-4604fa68-195b-4d48-bd89-83fdce76f01e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 14245f9c-71e1-4dc8-ab39-783e2610f6e4] Going to try to terminate instance {{(pid=134051) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:40:26.652824 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-4604fa68-195b-4d48-bd89-83fdce76f01e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "DELETE /compute/v2.1/servers/14245f9c-71e1-4dc8-ab39-783e2610f6e4" status: 204 len: 0 microversion: 2.1 time: 0.121135 Aug 27 03:40:26.653345 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3289/6534] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 03:40:26 2022] DELETE /compute/v2.1/servers/14245f9c-71e1-4dc8-ab39-783e2610f6e4 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:40:26.664250 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4d9e0f34-bd45-4fea-8899-0f9e25b57763 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:26.665144 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-4d9e0f34-bd45-4fea-8899-0f9e25b57763 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 14245f9c-71e1-4dc8-ab39-783e2610f6e4] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:40:26.673678 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4d9e0f34-bd45-4fea-8899-0f9e25b57763 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:26.674157 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4d9e0f34-bd45-4fea-8899-0f9e25b57763 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:26.674588 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4d9e0f34-bd45-4fea-8899-0f9e25b57763 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:26.675273 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4d9e0f34-bd45-4fea-8899-0f9e25b57763 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:26.675719 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4d9e0f34-bd45-4fea-8899-0f9e25b57763 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:26.676138 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4d9e0f34-bd45-4fea-8899-0f9e25b57763 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:26.818241 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-4d9e0f34-bd45-4fea-8899-0f9e25b57763 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:26.831123 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-4d9e0f34-bd45-4fea-8899-0f9e25b57763 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/14245f9c-71e1-4dc8-ab39-783e2610f6e4" status: 200 len: 1672 microversion: 2.1 time: 0.172501 Aug 27 03:40:26.831933 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3246/6535] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:40:26 2022] GET /compute/v2.1/servers/14245f9c-71e1-4dc8-ab39-783e2610f6e4 => generated 1672 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:40:27.855931 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-1714877e-fc64-47e2-a0bf-5e7d491bc340 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:27.856911 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-1714877e-fc64-47e2-a0bf-5e7d491bc340 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 14245f9c-71e1-4dc8-ab39-783e2610f6e4] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:40:27.866710 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1714877e-fc64-47e2-a0bf-5e7d491bc340 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:27.867427 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1714877e-fc64-47e2-a0bf-5e7d491bc340 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:27.868024 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1714877e-fc64-47e2-a0bf-5e7d491bc340 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:27.869054 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1714877e-fc64-47e2-a0bf-5e7d491bc340 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:27.869660 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1714877e-fc64-47e2-a0bf-5e7d491bc340 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:27.870263 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1714877e-fc64-47e2-a0bf-5e7d491bc340 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:28.005851 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-1714877e-fc64-47e2-a0bf-5e7d491bc340 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:28.014278 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-1714877e-fc64-47e2-a0bf-5e7d491bc340 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/14245f9c-71e1-4dc8-ab39-783e2610f6e4" status: 200 len: 1672 microversion: 2.1 time: 0.164205 Aug 27 03:40:28.014864 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3290/6536] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:40:27 2022] GET /compute/v2.1/servers/14245f9c-71e1-4dc8-ab39-783e2610f6e4 => generated 1672 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:40:28.930428 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-9e15f1db-3dea-4c53-a0d7-9ec4f9172d26 req-cea62f04-d80b-4d29-b826-6bd18e4b382f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14245f9c-71e1-4dc8-ab39-783e2610f6e4", "name": "network-vif-deleted", "tag": "bbab562a-46ac-4dcd-bbd2-e1dfdb21b4a6"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:40:28.938097 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=37 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:40:28.943622 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-9e15f1db-3dea-4c53-a0d7-9ec4f9172d26 req-cea62f04-d80b-4d29-b826-6bd18e4b382f service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:28.944094 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-9e15f1db-3dea-4c53-a0d7-9ec4f9172d26 req-cea62f04-d80b-4d29-b826-6bd18e4b382f service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:28.944550 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-9e15f1db-3dea-4c53-a0d7-9ec4f9172d26 req-cea62f04-d80b-4d29-b826-6bd18e4b382f service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:28.960770 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-9e15f1db-3dea-4c53-a0d7-9ec4f9172d26 req-cea62f04-d80b-4d29-b826-6bd18e4b382f service nova] Creating event network-vif-deleted:bbab562a-46ac-4dcd-bbd2-e1dfdb21b4a6 for instance 14245f9c-71e1-4dc8-ab39-783e2610f6e4 on n-h1-852278-4 Aug 27 03:40:28.967176 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-9e15f1db-3dea-4c53-a0d7-9ec4f9172d26 req-cea62f04-d80b-4d29-b826-6bd18e4b382f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040795 Aug 27 03:40:28.967805 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3247/6537] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:40:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:40:29.037391 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a6fe91cf-3219-45fc-857a-1a66d8f48b36 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:29.037979 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-a6fe91cf-3219-45fc-857a-1a66d8f48b36 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 14245f9c-71e1-4dc8-ab39-783e2610f6e4] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:40:29.041004 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:40:29.046947 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a6fe91cf-3219-45fc-857a-1a66d8f48b36 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:29.047494 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a6fe91cf-3219-45fc-857a-1a66d8f48b36 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:29.048132 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a6fe91cf-3219-45fc-857a-1a66d8f48b36 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:29.048884 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a6fe91cf-3219-45fc-857a-1a66d8f48b36 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:29.049350 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a6fe91cf-3219-45fc-857a-1a66d8f48b36 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:29.049788 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a6fe91cf-3219-45fc-857a-1a66d8f48b36 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:29.083577 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a6fe91cf-3219-45fc-857a-1a66d8f48b36 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:29.084083 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a6fe91cf-3219-45fc-857a-1a66d8f48b36 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:29.084567 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a6fe91cf-3219-45fc-857a-1a66d8f48b36 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:29.085037 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.objects.instance [None req-a6fe91cf-3219-45fc-857a-1a66d8f48b36 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lazy-loading 'fault' on Instance uuid 14245f9c-71e1-4dc8-ab39-783e2610f6e4 {{(pid=134051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:40:29.130314 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-a6fe91cf-3219-45fc-857a-1a66d8f48b36 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:29.141170 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a6fe91cf-3219-45fc-857a-1a66d8f48b36 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/14245f9c-71e1-4dc8-ab39-783e2610f6e4" status: 200 len: 1328 microversion: 2.1 time: 0.107781 Aug 27 03:40:29.143762 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3291/6538] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:40:29 2022] GET /compute/v2.1/servers/14245f9c-71e1-4dc8-ab39-783e2610f6e4 => generated 1328 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:40:30.168877 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-bf92421b-bea0-4036-9722-7c0737497f17 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:30.169581 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-bf92421b-bea0-4036-9722-7c0737497f17 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 14245f9c-71e1-4dc8-ab39-783e2610f6e4] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:40:30.177837 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bf92421b-bea0-4036-9722-7c0737497f17 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:30.178245 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bf92421b-bea0-4036-9722-7c0737497f17 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:30.178679 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bf92421b-bea0-4036-9722-7c0737497f17 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:30.179582 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bf92421b-bea0-4036-9722-7c0737497f17 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:30.180067 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bf92421b-bea0-4036-9722-7c0737497f17 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:30.180559 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bf92421b-bea0-4036-9722-7c0737497f17 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:30.196840 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-bf92421b-bea0-4036-9722-7c0737497f17 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] HTTP exception thrown: Instance 14245f9c-71e1-4dc8-ab39-783e2610f6e4 could not be found. Aug 27 03:40:30.199343 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-bf92421b-bea0-4036-9722-7c0737497f17 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Request method failure captured: Aug 27 03:40:30.199343 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/servers/14245f9c-71e1-4dc8-ab39-783e2610f6e4 HTTP/1.1 Aug 27 03:40:30.199343 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 03:40:30.199343 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 03:40:30.199343 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 03:40:30.199343 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 03:40:30.199343 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 03:40:30.199343 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 03:40:30.199343 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 03:40:30.199343 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 03:40:30.199343 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCZGWxk5BEicF9AwnrkJwBWPfwg6arCi_dT6E6ZVU5_NhdiLiUMoMZ2Q_dYvmFaxRe7rt1FqUkb8B6Jv9aLrdZAOB6sF0tJV32UJ88bJE_iEEa6wH556BrFuazMURlys8Bi6SN-7FaZo2zdThDqlQ_upK7UsTTNFT7YiOxJI35LhaDsc Aug 27 03:40:30.199343 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 03:40:30.199343 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 03:40:30.199343 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 03:40:30.199343 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 03:40:30.199343 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 03:40:30.199343 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 03:40:30.199343 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: cc3aa9846bcb40518ac54e31208ce043 Aug 27 03:40:30.199343 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ServerActionsTestJSON-577023370 Aug 27 03:40:30.199343 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 03:40:30.199343 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 03:40:30.199343 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cc3aa9846bcb40518ac54e31208ce043"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_cc3aa9846bcb40518ac54e31208ce043", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cc3aa9846bcb40518ac54e31208ce043"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/cc3aa9846bcb40518ac54e31208ce043"}]}] Aug 27 03:40:30.199343 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ServerActionsTestJSON-577023370 Aug 27 03:40:30.199343 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: cc3aa9846bcb40518ac54e31208ce043 Aug 27 03:40:30.199343 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ServerActionsTestJSON-577023370 Aug 27 03:40:30.199343 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ServerActionsTestJSON-577023370-project Aug 27 03:40:30.199343 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 03:40:30.199343 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 03:40:30.199343 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: c62665fa43c34e6eb695633905cf3b84 Aug 27 03:40:30.199343 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ServerActionsTestJSON-577023370-project Aug 27 03:40:30.199343 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 03:40:30.199343 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance 14245f9c-71e1-4dc8-ab39-783e2610f6e4 could not be found. Aug 27 03:40:30.199343 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '14245f9c-71e1-4dc8-ab39-783e2610f6e4'} Aug 27 03:40:30.199343 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:40:30.199343 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:40:30.199343 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:40:30.199343 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:40:30.199343 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:40:30.199343 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:40:30.199343 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:40:30.199343 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:40:30.199343 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:40:30.199343 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:40:30.199343 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14245f9c-71e1-4dc8-ab39-783e2610f6e4 could not be found. Aug 27 03:40:30.199343 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:40:30.199343 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:40:30.199343 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:40:30.199343 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:40:30.199343 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:40:30.199343 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:40:30.199343 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:40:30.199343 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:40:30.199343 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:40:30.199343 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:40:30.199343 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:40:30.199343 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:40:30.199343 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:40:30.199343 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:40:30.199343 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:40:30.199343 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:40:30.199343 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14245f9c-71e1-4dc8-ab39-783e2610f6e4 could not be found. Aug 27 03:40:30.199343 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:40:30.199343 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:40:30.199343 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:40:30.203513 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:40:30.203513 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:40:30.203513 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:40:30.203513 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:40:30.203513 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:40:30.203513 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14245f9c-71e1-4dc8-ab39-783e2610f6e4 could not be found. Aug 27 03:40:30.203513 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:40:30.203513 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-bf92421b-bea0-4036-9722-7c0737497f17 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Returning 404 to user: Instance 14245f9c-71e1-4dc8-ab39-783e2610f6e4 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:40:30.203513 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-bf92421b-bea0-4036-9722-7c0737497f17 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/14245f9c-71e1-4dc8-ab39-783e2610f6e4" status: 404 len: 111 microversion: 2.1 time: 0.036534 Aug 27 03:40:30.203513 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3248/6539] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:40:30 2022] GET /compute/v2.1/servers/14245f9c-71e1-4dc8-ab39-783e2610f6e4 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:40:30.220008 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-fb5ee867-ea31-4c2c-8638-2077d52b2c81 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:30.220696 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-fb5ee867-ea31-4c2c-8638-2077d52b2c81 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 14245f9c-71e1-4dc8-ab39-783e2610f6e4] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:40:30.228027 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fb5ee867-ea31-4c2c-8638-2077d52b2c81 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:30.228570 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fb5ee867-ea31-4c2c-8638-2077d52b2c81 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:30.229019 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fb5ee867-ea31-4c2c-8638-2077d52b2c81 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:30.229722 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fb5ee867-ea31-4c2c-8638-2077d52b2c81 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:30.230182 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fb5ee867-ea31-4c2c-8638-2077d52b2c81 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:30.230614 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fb5ee867-ea31-4c2c-8638-2077d52b2c81 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:30.244480 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-fb5ee867-ea31-4c2c-8638-2077d52b2c81 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] HTTP exception thrown: Instance 14245f9c-71e1-4dc8-ab39-783e2610f6e4 could not be found. Aug 27 03:40:30.246216 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-fb5ee867-ea31-4c2c-8638-2077d52b2c81 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Request method failure captured: Aug 27 03:40:30.246216 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/14245f9c-71e1-4dc8-ab39-783e2610f6e4 HTTP/1.1 Aug 27 03:40:30.246216 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 03:40:30.246216 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 03:40:30.246216 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 03:40:30.246216 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 03:40:30.246216 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 03:40:30.246216 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 03:40:30.246216 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 03:40:30.246216 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 03:40:30.246216 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCZGWxk5BEicF9AwnrkJwBWPfwg6arCi_dT6E6ZVU5_NhdiLiUMoMZ2Q_dYvmFaxRe7rt1FqUkb8B6Jv9aLrdZAOB6sF0tJV32UJ88bJE_iEEa6wH556BrFuazMURlys8Bi6SN-7FaZo2zdThDqlQ_upK7UsTTNFT7YiOxJI35LhaDsc Aug 27 03:40:30.246216 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 03:40:30.246216 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 03:40:30.246216 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 03:40:30.246216 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 03:40:30.246216 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 03:40:30.246216 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 03:40:30.246216 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: cc3aa9846bcb40518ac54e31208ce043 Aug 27 03:40:30.246216 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ServerActionsTestJSON-577023370 Aug 27 03:40:30.246216 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 03:40:30.246216 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 03:40:30.246216 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cc3aa9846bcb40518ac54e31208ce043"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_cc3aa9846bcb40518ac54e31208ce043", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cc3aa9846bcb40518ac54e31208ce043"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/cc3aa9846bcb40518ac54e31208ce043"}]}] Aug 27 03:40:30.246216 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ServerActionsTestJSON-577023370 Aug 27 03:40:30.246216 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: cc3aa9846bcb40518ac54e31208ce043 Aug 27 03:40:30.246216 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ServerActionsTestJSON-577023370 Aug 27 03:40:30.246216 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ServerActionsTestJSON-577023370-project Aug 27 03:40:30.246216 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 03:40:30.246216 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 03:40:30.246216 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: c62665fa43c34e6eb695633905cf3b84 Aug 27 03:40:30.246216 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ServerActionsTestJSON-577023370-project Aug 27 03:40:30.246216 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 03:40:30.246216 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance 14245f9c-71e1-4dc8-ab39-783e2610f6e4 could not be found. Aug 27 03:40:30.246216 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '14245f9c-71e1-4dc8-ab39-783e2610f6e4'} Aug 27 03:40:30.246216 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:40:30.246216 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:40:30.246216 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:40:30.246216 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:40:30.246216 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:40:30.246216 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:40:30.246216 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:40:30.246216 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:40:30.246216 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:40:30.246216 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:40:30.246216 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14245f9c-71e1-4dc8-ab39-783e2610f6e4 could not be found. Aug 27 03:40:30.246216 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:40:30.246216 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:40:30.246216 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:40:30.246216 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:40:30.246216 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:40:30.246216 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:40:30.246216 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:40:30.246216 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:40:30.246216 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:40:30.246216 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:40:30.246216 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:40:30.246216 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:40:30.246216 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:40:30.246216 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:40:30.246216 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:40:30.246216 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:40:30.246216 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14245f9c-71e1-4dc8-ab39-783e2610f6e4 could not be found. Aug 27 03:40:30.246216 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:40:30.246216 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:40:30.246216 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:40:30.249793 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:40:30.249793 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:40:30.249793 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:40:30.249793 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:40:30.249793 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:40:30.249793 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14245f9c-71e1-4dc8-ab39-783e2610f6e4 could not be found. Aug 27 03:40:30.249793 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:40:30.249793 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-fb5ee867-ea31-4c2c-8638-2077d52b2c81 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Returning 404 to user: Instance 14245f9c-71e1-4dc8-ab39-783e2610f6e4 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:40:30.249793 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-fb5ee867-ea31-4c2c-8638-2077d52b2c81 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/14245f9c-71e1-4dc8-ab39-783e2610f6e4" status: 404 len: 111 microversion: 2.1 time: 0.031785 Aug 27 03:40:30.249793 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3292/6540] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:40:30 2022] GET /compute/v2.1/servers/14245f9c-71e1-4dc8-ab39-783e2610f6e4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:40:30.299923 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-40003eeb-cb7f-4e9a-bb3a-e851c00af68a tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1060431733", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "networks": [{"uuid": "58a8af60-9bb2-4790-9c69-3b7ee60e6ff0"}], "security_groups": [{"name": "tempest-securitygroup--353980153"}], "key_name": "tempest-keypair-1055144708", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:40:30.412875 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.network.neutron [None req-40003eeb-cb7f-4e9a-bb3a-e851c00af68a tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] validate_networks() for [('58a8af60-9bb2-4790-9c69-3b7ee60e6ff0', None, None, None, None, None)] {{(pid=134052) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:40:30.913980 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-40003eeb-cb7f-4e9a-bb3a-e851c00af68a tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Flavor limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:40:30.914477 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-40003eeb-cb7f-4e9a-bb3a-e851c00af68a tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Image limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:40:30.914979 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-40003eeb-cb7f-4e9a-bb3a-e851c00af68a tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Flavor pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:40:30.915456 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-40003eeb-cb7f-4e9a-bb3a-e851c00af68a tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Image pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:40:30.916018 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-40003eeb-cb7f-4e9a-bb3a-e851c00af68a tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:40:30.925898 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-40003eeb-cb7f-4e9a-bb3a-e851c00af68a tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:30.926354 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-40003eeb-cb7f-4e9a-bb3a-e851c00af68a tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:30.926814 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-40003eeb-cb7f-4e9a-bb3a-e851c00af68a tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:30.927517 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-40003eeb-cb7f-4e9a-bb3a-e851c00af68a tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:30.927984 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-40003eeb-cb7f-4e9a-bb3a-e851c00af68a tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:30.928433 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-40003eeb-cb7f-4e9a-bb3a-e851c00af68a tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:30.948186 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-40003eeb-cb7f-4e9a-bb3a-e851c00af68a tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Getting quotas for project cc3aa9846bcb40518ac54e31208ce043. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:40:30.953537 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-40003eeb-cb7f-4e9a-bb3a-e851c00af68a tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Getting quotas for user c62665fa43c34e6eb695633905cf3b84 and project cc3aa9846bcb40518ac54e31208ce043. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:40:30.965993 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-40003eeb-cb7f-4e9a-bb3a-e851c00af68a tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Going to run 1 instances... {{(pid=134052) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:40:30.968336 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-40003eeb-cb7f-4e9a-bb3a-e851c00af68a tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: f3926721-ba47-4cb4-ac57-6777811cd549] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134052) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:40:31.019008 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-40003eeb-cb7f-4e9a-bb3a-e851c00af68a tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.724209 Aug 27 03:40:31.019654 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3249/6541] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 03:40:30 2022] POST /compute/v2.1/servers => generated 405 bytes in 726 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:40:31.030820 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-cbde7289-ec64-4b2b-b18f-17c3d7e86f78 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:31.031502 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-cbde7289-ec64-4b2b-b18f-17c3d7e86f78 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: f3926721-ba47-4cb4-ac57-6777811cd549] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:40:31.084807 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-cbde7289-ec64-4b2b-b18f-17c3d7e86f78 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:31.092360 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-cbde7289-ec64-4b2b-b18f-17c3d7e86f78 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/f3926721-ba47-4cb4-ac57-6777811cd549" status: 200 len: 1239 microversion: 2.1 time: 0.065493 Aug 27 03:40:31.092930 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3293/6542] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:40:31 2022] GET /compute/v2.1/servers/f3926721-ba47-4cb4-ac57-6777811cd549 => generated 1239 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:40:32.116125 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f45524ab-ca01-47df-94bc-a766db023a9f tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:32.116771 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-f45524ab-ca01-47df-94bc-a766db023a9f tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: f3926721-ba47-4cb4-ac57-6777811cd549] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:40:32.125408 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f45524ab-ca01-47df-94bc-a766db023a9f tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:32.125902 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f45524ab-ca01-47df-94bc-a766db023a9f tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:32.126337 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f45524ab-ca01-47df-94bc-a766db023a9f tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:32.127047 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f45524ab-ca01-47df-94bc-a766db023a9f tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:32.127494 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f45524ab-ca01-47df-94bc-a766db023a9f tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:32.127914 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f45524ab-ca01-47df-94bc-a766db023a9f tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:32.208039 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-f45524ab-ca01-47df-94bc-a766db023a9f tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:32.217300 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f45524ab-ca01-47df-94bc-a766db023a9f tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/f3926721-ba47-4cb4-ac57-6777811cd549" status: 200 len: 1309 microversion: 2.1 time: 0.107271 Aug 27 03:40:32.217997 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3250/6543] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:40:32 2022] GET /compute/v2.1/servers/f3926721-ba47-4cb4-ac57-6777811cd549 => generated 1309 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:40:33.239880 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-9ce385ce-2057-4e0a-9301-3d30bd371231 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:33.240561 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-9ce385ce-2057-4e0a-9301-3d30bd371231 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: f3926721-ba47-4cb4-ac57-6777811cd549] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:40:33.248401 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9ce385ce-2057-4e0a-9301-3d30bd371231 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:33.248925 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9ce385ce-2057-4e0a-9301-3d30bd371231 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:33.249350 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9ce385ce-2057-4e0a-9301-3d30bd371231 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:33.250507 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9ce385ce-2057-4e0a-9301-3d30bd371231 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:33.250977 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9ce385ce-2057-4e0a-9301-3d30bd371231 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:33.251461 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9ce385ce-2057-4e0a-9301-3d30bd371231 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:33.445954 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-9ce385ce-2057-4e0a-9301-3d30bd371231 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:33.454036 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-9ce385ce-2057-4e0a-9301-3d30bd371231 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/f3926721-ba47-4cb4-ac57-6777811cd549" status: 200 len: 1364 microversion: 2.1 time: 0.218252 Aug 27 03:40:33.454846 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3294/6544] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:40:33 2022] GET /compute/v2.1/servers/f3926721-ba47-4cb4-ac57-6777811cd549 => generated 1364 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:40:33.494354 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-fad18375-f352-4b87-8156-944f2e71859e req-ba919618-88fa-4a3f-941b-e5d98ab5ebe0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3926721-ba47-4cb4-ac57-6777811cd549", "tag": "72e555a6-9b79-412e-ad70-96a0a2b894b7"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:40:33.505734 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-fad18375-f352-4b87-8156-944f2e71859e req-ba919618-88fa-4a3f-941b-e5d98ab5ebe0 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:33.506216 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-fad18375-f352-4b87-8156-944f2e71859e req-ba919618-88fa-4a3f-941b-e5d98ab5ebe0 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:33.506678 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-fad18375-f352-4b87-8156-944f2e71859e req-ba919618-88fa-4a3f-941b-e5d98ab5ebe0 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:33.518733 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-fad18375-f352-4b87-8156-944f2e71859e req-ba919618-88fa-4a3f-941b-e5d98ab5ebe0 service nova] Creating event network-changed:72e555a6-9b79-412e-ad70-96a0a2b894b7 for instance f3926721-ba47-4cb4-ac57-6777811cd549 on n-h2-852278-4 Aug 27 03:40:33.524144 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-fad18375-f352-4b87-8156-944f2e71859e req-ba919618-88fa-4a3f-941b-e5d98ab5ebe0 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033618 Aug 27 03:40:33.524801 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3251/6545] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:40:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:40:34.480473 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ee6e19fa-b8ee-44e3-be19-b47231419b5c tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:34.481487 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-ee6e19fa-b8ee-44e3-be19-b47231419b5c tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: f3926721-ba47-4cb4-ac57-6777811cd549] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:40:34.493705 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ee6e19fa-b8ee-44e3-be19-b47231419b5c tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:34.494543 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ee6e19fa-b8ee-44e3-be19-b47231419b5c tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:34.495292 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ee6e19fa-b8ee-44e3-be19-b47231419b5c tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:34.496518 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ee6e19fa-b8ee-44e3-be19-b47231419b5c tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:34.497288 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ee6e19fa-b8ee-44e3-be19-b47231419b5c tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:34.498034 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ee6e19fa-b8ee-44e3-be19-b47231419b5c tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:34.986123 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-ee6e19fa-b8ee-44e3-be19-b47231419b5c tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:34.996247 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ee6e19fa-b8ee-44e3-be19-b47231419b5c tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/f3926721-ba47-4cb4-ac57-6777811cd549" status: 200 len: 1364 microversion: 2.1 time: 0.522362 Aug 27 03:40:35.000468 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3295/6546] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:40:34 2022] GET /compute/v2.1/servers/f3926721-ba47-4cb4-ac57-6777811cd549 => generated 1364 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:40:36.022729 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a4a5ae2a-8049-4ea6-a883-45968a2688ee tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:36.023486 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a4a5ae2a-8049-4ea6-a883-45968a2688ee tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: f3926721-ba47-4cb4-ac57-6777811cd549] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:40:36.032612 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a4a5ae2a-8049-4ea6-a883-45968a2688ee tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:36.033097 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a4a5ae2a-8049-4ea6-a883-45968a2688ee tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:36.033535 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a4a5ae2a-8049-4ea6-a883-45968a2688ee tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:36.034228 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a4a5ae2a-8049-4ea6-a883-45968a2688ee tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:36.034683 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a4a5ae2a-8049-4ea6-a883-45968a2688ee tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:36.035108 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a4a5ae2a-8049-4ea6-a883-45968a2688ee tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:36.169864 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-a4a5ae2a-8049-4ea6-a883-45968a2688ee tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:36.178794 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a4a5ae2a-8049-4ea6-a883-45968a2688ee tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/f3926721-ba47-4cb4-ac57-6777811cd549" status: 200 len: 1364 microversion: 2.1 time: 0.164412 Aug 27 03:40:36.179397 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3252/6547] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:40:36 2022] GET /compute/v2.1/servers/f3926721-ba47-4cb4-ac57-6777811cd549 => generated 1364 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:40:37.029979 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-744243ab-59f5-44db-8251-8a6654a0672b req-a976f6b8-c225-40b4-be9a-32cd7cf13512 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3926721-ba47-4cb4-ac57-6777811cd549", "name": "network-vif-plugged", "status": "completed", "tag": "72e555a6-9b79-412e-ad70-96a0a2b894b7"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:40:37.042398 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-744243ab-59f5-44db-8251-8a6654a0672b req-a976f6b8-c225-40b4-be9a-32cd7cf13512 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:37.042907 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-744243ab-59f5-44db-8251-8a6654a0672b req-a976f6b8-c225-40b4-be9a-32cd7cf13512 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:37.043355 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-744243ab-59f5-44db-8251-8a6654a0672b req-a976f6b8-c225-40b4-be9a-32cd7cf13512 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:37.055519 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-744243ab-59f5-44db-8251-8a6654a0672b req-a976f6b8-c225-40b4-be9a-32cd7cf13512 service nova] Creating event network-vif-plugged:72e555a6-9b79-412e-ad70-96a0a2b894b7 for instance f3926721-ba47-4cb4-ac57-6777811cd549 on n-h2-852278-4 Aug 27 03:40:37.060641 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-744243ab-59f5-44db-8251-8a6654a0672b req-a976f6b8-c225-40b4-be9a-32cd7cf13512 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034649 Aug 27 03:40:37.061249 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3296/6548] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:40:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:40:37.200242 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0f373416-666f-4fce-aa7e-65a288b966c7 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:37.200833 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-0f373416-666f-4fce-aa7e-65a288b966c7 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: f3926721-ba47-4cb4-ac57-6777811cd549] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:40:37.208915 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0f373416-666f-4fce-aa7e-65a288b966c7 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:37.209405 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0f373416-666f-4fce-aa7e-65a288b966c7 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:37.209839 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0f373416-666f-4fce-aa7e-65a288b966c7 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:37.210546 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0f373416-666f-4fce-aa7e-65a288b966c7 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:37.211082 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0f373416-666f-4fce-aa7e-65a288b966c7 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:37.211478 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0f373416-666f-4fce-aa7e-65a288b966c7 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:37.367819 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0f373416-666f-4fce-aa7e-65a288b966c7 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:37.376073 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-0f373416-666f-4fce-aa7e-65a288b966c7 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/f3926721-ba47-4cb4-ac57-6777811cd549" status: 200 len: 1364 microversion: 2.1 time: 0.179717 Aug 27 03:40:37.376726 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3253/6549] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:40:37 2022] GET /compute/v2.1/servers/f3926721-ba47-4cb4-ac57-6777811cd549 => generated 1364 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:40:38.403038 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a24b8e65-be2d-4c68-9c2a-107f1eb3742f tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:38.404129 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-a24b8e65-be2d-4c68-9c2a-107f1eb3742f tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: f3926721-ba47-4cb4-ac57-6777811cd549] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:40:38.414068 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a24b8e65-be2d-4c68-9c2a-107f1eb3742f tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:38.414857 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a24b8e65-be2d-4c68-9c2a-107f1eb3742f tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:38.415561 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a24b8e65-be2d-4c68-9c2a-107f1eb3742f tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:38.416717 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a24b8e65-be2d-4c68-9c2a-107f1eb3742f tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:38.417446 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a24b8e65-be2d-4c68-9c2a-107f1eb3742f tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:38.418133 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a24b8e65-be2d-4c68-9c2a-107f1eb3742f tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:38.565140 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-a24b8e65-be2d-4c68-9c2a-107f1eb3742f tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:38.577828 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a24b8e65-be2d-4c68-9c2a-107f1eb3742f tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/f3926721-ba47-4cb4-ac57-6777811cd549" status: 200 len: 1550 microversion: 2.1 time: 0.182732 Aug 27 03:40:38.578670 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3297/6550] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:40:38 2022] GET /compute/v2.1/servers/f3926721-ba47-4cb4-ac57-6777811cd549 => generated 1550 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:40:38.599335 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4dfbe0a7-4b59-4cc4-bcaf-beea8fe6135d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:38.599866 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-4dfbe0a7-4b59-4cc4-bcaf-beea8fe6135d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: f3926721-ba47-4cb4-ac57-6777811cd549] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:40:38.606995 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4dfbe0a7-4b59-4cc4-bcaf-beea8fe6135d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:38.607485 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4dfbe0a7-4b59-4cc4-bcaf-beea8fe6135d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:38.607923 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4dfbe0a7-4b59-4cc4-bcaf-beea8fe6135d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:38.608678 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4dfbe0a7-4b59-4cc4-bcaf-beea8fe6135d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:38.609128 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4dfbe0a7-4b59-4cc4-bcaf-beea8fe6135d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:38.609551 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4dfbe0a7-4b59-4cc4-bcaf-beea8fe6135d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:38.694013 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-4dfbe0a7-4b59-4cc4-bcaf-beea8fe6135d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/f3926721-ba47-4cb4-ac57-6777811cd549/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.098624 Aug 27 03:40:38.694630 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3254/6551] 10.222.0.70 () {58 vars in 1275 bytes} [Sat Aug 27 03:40:38 2022] GET /compute/v2.1/servers/f3926721-ba47-4cb4-ac57-6777811cd549/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:40:39.673551 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-da83c38a-dd52-4160-a020-b5364c09217c req-f225adc3-cf9f-4459-8f1a-af377c37e172 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3926721-ba47-4cb4-ac57-6777811cd549", "tag": "72e555a6-9b79-412e-ad70-96a0a2b894b7"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:40:39.683841 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-da83c38a-dd52-4160-a020-b5364c09217c req-f225adc3-cf9f-4459-8f1a-af377c37e172 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:39.684363 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-da83c38a-dd52-4160-a020-b5364c09217c req-f225adc3-cf9f-4459-8f1a-af377c37e172 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:39.684781 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-da83c38a-dd52-4160-a020-b5364c09217c req-f225adc3-cf9f-4459-8f1a-af377c37e172 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:39.696472 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-da83c38a-dd52-4160-a020-b5364c09217c req-f225adc3-cf9f-4459-8f1a-af377c37e172 service nova] Creating event network-changed:72e555a6-9b79-412e-ad70-96a0a2b894b7 for instance f3926721-ba47-4cb4-ac57-6777811cd549 on n-h2-852278-4 Aug 27 03:40:39.702052 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-da83c38a-dd52-4160-a020-b5364c09217c req-f225adc3-cf9f-4459-8f1a-af377c37e172 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032548 Aug 27 03:40:39.702643 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3298/6552] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:40:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:41:12.582284 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:41:12.583099 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=6 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:41:12.584409 n-d-852278-4 devstack@n-api.service[134052]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:41:12.584641 n-d-852278-4 devstack@n-api.service[134052]: Sat Aug 27 03:41:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f3926721-ba47-4cb4-ac57-6777811cd549/action (ip 10.222.0.70) !!! Aug 27 03:41:12.585565 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=3 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:41:12.586102 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:41:12.590846 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-09ada508-11d1-4b6d-8b41-fde3eeaaea76 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:41:12.593180 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-09ada508-11d1-4b6d-8b41-fde3eeaaea76 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: f3926721-ba47-4cb4-ac57-6777811cd549] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:41:12.607152 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-09ada508-11d1-4b6d-8b41-fde3eeaaea76 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:41:12.607618 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-09ada508-11d1-4b6d-8b41-fde3eeaaea76 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:41:12.608046 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-09ada508-11d1-4b6d-8b41-fde3eeaaea76 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:41:12.608777 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-09ada508-11d1-4b6d-8b41-fde3eeaaea76 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:41:12.609223 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-09ada508-11d1-4b6d-8b41-fde3eeaaea76 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:41:12.609641 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-09ada508-11d1-4b6d-8b41-fde3eeaaea76 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:41:12.640819 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-09ada508-11d1-4b6d-8b41-fde3eeaaea76 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:41:12.647406 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-09ada508-11d1-4b6d-8b41-fde3eeaaea76 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: f3926721-ba47-4cb4-ac57-6777811cd549] Old instance type m1.heat2, new instance type m1.heat {{(pid=134052) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 27 03:41:12.654342 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-09ada508-11d1-4b6d-8b41-fde3eeaaea76 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Flavor limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:41:12.654799 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-09ada508-11d1-4b6d-8b41-fde3eeaaea76 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Image limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:41:12.655271 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-09ada508-11d1-4b6d-8b41-fde3eeaaea76 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Flavor pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:41:12.655678 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-09ada508-11d1-4b6d-8b41-fde3eeaaea76 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Image pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:41:12.656091 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-09ada508-11d1-4b6d-8b41-fde3eeaaea76 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:41:12.731247 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-09ada508-11d1-4b6d-8b41-fde3eeaaea76 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "POST /compute/v2.1/servers/f3926721-ba47-4cb4-ac57-6777811cd549/action" status: 202 len: 0 microversion: 2.1 time: 0.150879 Aug 27 03:41:12.735168 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3255/6553] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:41:12 2022] POST /compute/v2.1/servers/f3926721-ba47-4cb4-ac57-6777811cd549/action => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:41:12.741581 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:41:12.743507 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=19 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:41:12.744290 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:41:12.748956 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-2b5fc9d9-ef9a-452a-9dbd-523d6dece4b5 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:41:12.749762 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-2b5fc9d9-ef9a-452a-9dbd-523d6dece4b5 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: f3926721-ba47-4cb4-ac57-6777811cd549] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:41:12.757327 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2b5fc9d9-ef9a-452a-9dbd-523d6dece4b5 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:41:12.758554 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2b5fc9d9-ef9a-452a-9dbd-523d6dece4b5 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:41:12.759114 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2b5fc9d9-ef9a-452a-9dbd-523d6dece4b5 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:41:12.759977 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2b5fc9d9-ef9a-452a-9dbd-523d6dece4b5 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:41:12.760574 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2b5fc9d9-ef9a-452a-9dbd-523d6dece4b5 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:41:12.761211 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2b5fc9d9-ef9a-452a-9dbd-523d6dece4b5 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:41:12.927579 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-2b5fc9d9-ef9a-452a-9dbd-523d6dece4b5 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:41:12.935846 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-2b5fc9d9-ef9a-452a-9dbd-523d6dece4b5 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/f3926721-ba47-4cb4-ac57-6777811cd549" status: 200 len: 1677 microversion: 2.1 time: 0.197253 Aug 27 03:41:12.936520 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3299/6554] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:41:12 2022] GET /compute/v2.1/servers/f3926721-ba47-4cb4-ac57-6777811cd549 => generated 1677 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:41:13.958130 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4bed981d-836d-4962-a6ff-4902efeb9879 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:41:13.958794 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-4bed981d-836d-4962-a6ff-4902efeb9879 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: f3926721-ba47-4cb4-ac57-6777811cd549] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:41:13.965332 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4bed981d-836d-4962-a6ff-4902efeb9879 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:41:13.965816 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4bed981d-836d-4962-a6ff-4902efeb9879 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:41:13.966245 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4bed981d-836d-4962-a6ff-4902efeb9879 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:41:13.966906 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4bed981d-836d-4962-a6ff-4902efeb9879 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:41:13.967379 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4bed981d-836d-4962-a6ff-4902efeb9879 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:41:13.967760 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4bed981d-836d-4962-a6ff-4902efeb9879 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:41:14.116478 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-4bed981d-836d-4962-a6ff-4902efeb9879 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:41:14.124582 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-4bed981d-836d-4962-a6ff-4902efeb9879 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/f3926721-ba47-4cb4-ac57-6777811cd549" status: 200 len: 1677 microversion: 2.1 time: 0.171218 Aug 27 03:41:14.125122 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3256/6555] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:41:13 2022] GET /compute/v2.1/servers/f3926721-ba47-4cb4-ac57-6777811cd549 => generated 1677 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:41:15.148438 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-74b0b4f0-893b-4f25-aa6a-fba1528dde8e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:41:15.149024 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-74b0b4f0-893b-4f25-aa6a-fba1528dde8e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: f3926721-ba47-4cb4-ac57-6777811cd549] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:41:15.156624 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-74b0b4f0-893b-4f25-aa6a-fba1528dde8e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:41:15.157128 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-74b0b4f0-893b-4f25-aa6a-fba1528dde8e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:41:15.157580 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-74b0b4f0-893b-4f25-aa6a-fba1528dde8e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:41:15.158291 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-74b0b4f0-893b-4f25-aa6a-fba1528dde8e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:41:15.158754 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-74b0b4f0-893b-4f25-aa6a-fba1528dde8e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:41:15.159188 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-74b0b4f0-893b-4f25-aa6a-fba1528dde8e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:41:15.290541 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-74b0b4f0-893b-4f25-aa6a-fba1528dde8e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:41:15.298710 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-74b0b4f0-893b-4f25-aa6a-fba1528dde8e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/f3926721-ba47-4cb4-ac57-6777811cd549" status: 200 len: 1682 microversion: 2.1 time: 0.156049 Aug 27 03:41:15.299314 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3300/6556] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:41:15 2022] GET /compute/v2.1/servers/f3926721-ba47-4cb4-ac57-6777811cd549 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:41:16.321806 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-fe7c1dc5-0c75-417a-9e33-e527115d057d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:41:16.322400 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-fe7c1dc5-0c75-417a-9e33-e527115d057d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: f3926721-ba47-4cb4-ac57-6777811cd549] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:41:16.330419 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fe7c1dc5-0c75-417a-9e33-e527115d057d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:41:16.330964 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fe7c1dc5-0c75-417a-9e33-e527115d057d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:41:16.331452 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fe7c1dc5-0c75-417a-9e33-e527115d057d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:41:16.332223 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fe7c1dc5-0c75-417a-9e33-e527115d057d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:41:16.333234 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fe7c1dc5-0c75-417a-9e33-e527115d057d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:41:16.333234 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fe7c1dc5-0c75-417a-9e33-e527115d057d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:41:16.471993 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-fe7c1dc5-0c75-417a-9e33-e527115d057d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:41:16.480613 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-fe7c1dc5-0c75-417a-9e33-e527115d057d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/f3926721-ba47-4cb4-ac57-6777811cd549" status: 200 len: 1682 microversion: 2.1 time: 0.163331 Aug 27 03:41:16.481256 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3257/6557] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:41:16 2022] GET /compute/v2.1/servers/f3926721-ba47-4cb4-ac57-6777811cd549 => generated 1682 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:41:17.506238 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-cf7a6304-3174-47be-bc79-5202401bcc73 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:41:17.507281 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-cf7a6304-3174-47be-bc79-5202401bcc73 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: f3926721-ba47-4cb4-ac57-6777811cd549] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:41:17.519053 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cf7a6304-3174-47be-bc79-5202401bcc73 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:41:17.519903 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cf7a6304-3174-47be-bc79-5202401bcc73 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:41:17.520716 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cf7a6304-3174-47be-bc79-5202401bcc73 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:41:17.521902 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cf7a6304-3174-47be-bc79-5202401bcc73 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:41:17.522685 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cf7a6304-3174-47be-bc79-5202401bcc73 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:41:17.523459 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cf7a6304-3174-47be-bc79-5202401bcc73 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:41:17.657377 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-cf7a6304-3174-47be-bc79-5202401bcc73 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:41:17.665996 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-cf7a6304-3174-47be-bc79-5202401bcc73 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/f3926721-ba47-4cb4-ac57-6777811cd549" status: 200 len: 1682 microversion: 2.1 time: 0.166498 Aug 27 03:41:17.666680 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3301/6558] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:41:17 2022] GET /compute/v2.1/servers/f3926721-ba47-4cb4-ac57-6777811cd549 => generated 1682 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:41:18.696165 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8e470f88-e59b-495f-932f-f9148f92082b tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:41:18.697574 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-8e470f88-e59b-495f-932f-f9148f92082b tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: f3926721-ba47-4cb4-ac57-6777811cd549] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:41:18.705757 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8e470f88-e59b-495f-932f-f9148f92082b tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:41:18.706286 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8e470f88-e59b-495f-932f-f9148f92082b tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:41:18.706766 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8e470f88-e59b-495f-932f-f9148f92082b tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:41:18.707534 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8e470f88-e59b-495f-932f-f9148f92082b tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:41:18.708047 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8e470f88-e59b-495f-932f-f9148f92082b tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:41:18.708555 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8e470f88-e59b-495f-932f-f9148f92082b tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:41:18.861016 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-8e470f88-e59b-495f-932f-f9148f92082b tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:41:18.871702 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-8e470f88-e59b-495f-932f-f9148f92082b tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/f3926721-ba47-4cb4-ac57-6777811cd549" status: 200 len: 1682 microversion: 2.1 time: 0.182136 Aug 27 03:41:18.872290 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3258/6559] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:41:18 2022] GET /compute/v2.1/servers/f3926721-ba47-4cb4-ac57-6777811cd549 => generated 1682 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:41:19.904850 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8e29bad4-28bd-47ad-8033-f4e9019b8cfd tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:41:19.905715 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-8e29bad4-28bd-47ad-8033-f4e9019b8cfd tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: f3926721-ba47-4cb4-ac57-6777811cd549] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:41:19.917201 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8e29bad4-28bd-47ad-8033-f4e9019b8cfd tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:41:19.917721 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8e29bad4-28bd-47ad-8033-f4e9019b8cfd tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:41:19.918187 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8e29bad4-28bd-47ad-8033-f4e9019b8cfd tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:41:19.918926 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8e29bad4-28bd-47ad-8033-f4e9019b8cfd tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:41:19.919405 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8e29bad4-28bd-47ad-8033-f4e9019b8cfd tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:41:19.919847 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8e29bad4-28bd-47ad-8033-f4e9019b8cfd tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:41:20.061551 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-8e29bad4-28bd-47ad-8033-f4e9019b8cfd tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:41:20.070159 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-8e29bad4-28bd-47ad-8033-f4e9019b8cfd tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/f3926721-ba47-4cb4-ac57-6777811cd549" status: 200 len: 1682 microversion: 2.1 time: 0.172175 Aug 27 03:41:20.070748 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3302/6560] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:41:19 2022] GET /compute/v2.1/servers/f3926721-ba47-4cb4-ac57-6777811cd549 => generated 1682 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:41:21.095709 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d87c0322-41b1-40a3-a03a-50fa3bfdab29 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:41:21.096757 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d87c0322-41b1-40a3-a03a-50fa3bfdab29 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: f3926721-ba47-4cb4-ac57-6777811cd549] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:41:21.108356 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d87c0322-41b1-40a3-a03a-50fa3bfdab29 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:41:21.109189 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d87c0322-41b1-40a3-a03a-50fa3bfdab29 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:41:21.109913 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d87c0322-41b1-40a3-a03a-50fa3bfdab29 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:41:21.111054 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d87c0322-41b1-40a3-a03a-50fa3bfdab29 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:41:21.111799 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d87c0322-41b1-40a3-a03a-50fa3bfdab29 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:41:21.112551 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d87c0322-41b1-40a3-a03a-50fa3bfdab29 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:41:21.255727 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-d87c0322-41b1-40a3-a03a-50fa3bfdab29 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:41:21.266610 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d87c0322-41b1-40a3-a03a-50fa3bfdab29 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/f3926721-ba47-4cb4-ac57-6777811cd549" status: 200 len: 1682 microversion: 2.1 time: 0.177414 Aug 27 03:41:21.267309 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3259/6561] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:41:21 2022] GET /compute/v2.1/servers/f3926721-ba47-4cb4-ac57-6777811cd549 => generated 1682 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:41:22.289522 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-21469de0-ce28-4b3e-81c6-c0c462066be4 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:41:22.290155 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-21469de0-ce28-4b3e-81c6-c0c462066be4 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: f3926721-ba47-4cb4-ac57-6777811cd549] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:41:22.297765 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-21469de0-ce28-4b3e-81c6-c0c462066be4 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:41:22.298280 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-21469de0-ce28-4b3e-81c6-c0c462066be4 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:41:22.298727 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-21469de0-ce28-4b3e-81c6-c0c462066be4 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:41:22.299440 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-21469de0-ce28-4b3e-81c6-c0c462066be4 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:41:22.299901 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-21469de0-ce28-4b3e-81c6-c0c462066be4 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:41:22.300348 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-21469de0-ce28-4b3e-81c6-c0c462066be4 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:41:22.479116 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-21469de0-ce28-4b3e-81c6-c0c462066be4 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:41:22.487078 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-21469de0-ce28-4b3e-81c6-c0c462066be4 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/f3926721-ba47-4cb4-ac57-6777811cd549" status: 200 len: 1682 microversion: 2.1 time: 0.202106 Aug 27 03:41:22.487735 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3303/6562] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:41:22 2022] GET /compute/v2.1/servers/f3926721-ba47-4cb4-ac57-6777811cd549 => generated 1682 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:41:23.508664 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ecb8c620-ce54-49ba-a9b1-c054645cdba0 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:41:23.509272 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-ecb8c620-ce54-49ba-a9b1-c054645cdba0 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: f3926721-ba47-4cb4-ac57-6777811cd549] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:41:23.516898 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ecb8c620-ce54-49ba-a9b1-c054645cdba0 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:41:23.517391 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ecb8c620-ce54-49ba-a9b1-c054645cdba0 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:41:23.517833 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ecb8c620-ce54-49ba-a9b1-c054645cdba0 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:41:23.518576 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ecb8c620-ce54-49ba-a9b1-c054645cdba0 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:41:23.519122 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ecb8c620-ce54-49ba-a9b1-c054645cdba0 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:41:23.519552 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ecb8c620-ce54-49ba-a9b1-c054645cdba0 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:41:23.666862 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-ecb8c620-ce54-49ba-a9b1-c054645cdba0 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:41:23.675522 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ecb8c620-ce54-49ba-a9b1-c054645cdba0 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/f3926721-ba47-4cb4-ac57-6777811cd549" status: 200 len: 1682 microversion: 2.1 time: 0.170828 Aug 27 03:41:23.676116 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3260/6563] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:41:23 2022] GET /compute/v2.1/servers/f3926721-ba47-4cb4-ac57-6777811cd549 => generated 1682 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:41:24.697466 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-2709cc35-f9e4-49d1-9680-d6b134b50e05 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:41:24.698207 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-2709cc35-f9e4-49d1-9680-d6b134b50e05 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: f3926721-ba47-4cb4-ac57-6777811cd549] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:41:24.707857 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2709cc35-f9e4-49d1-9680-d6b134b50e05 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:41:24.708392 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2709cc35-f9e4-49d1-9680-d6b134b50e05 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:41:24.708847 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2709cc35-f9e4-49d1-9680-d6b134b50e05 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:41:24.709571 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2709cc35-f9e4-49d1-9680-d6b134b50e05 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:41:24.710036 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2709cc35-f9e4-49d1-9680-d6b134b50e05 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:41:24.710470 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2709cc35-f9e4-49d1-9680-d6b134b50e05 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:41:24.862341 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-2709cc35-f9e4-49d1-9680-d6b134b50e05 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:41:24.870676 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-2709cc35-f9e4-49d1-9680-d6b134b50e05 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/f3926721-ba47-4cb4-ac57-6777811cd549" status: 200 len: 1682 microversion: 2.1 time: 0.177489 Aug 27 03:41:24.871260 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3304/6564] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:41:24 2022] GET /compute/v2.1/servers/f3926721-ba47-4cb4-ac57-6777811cd549 => generated 1682 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:41:25.895418 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f1057fa8-6db6-4a7a-96ae-32f6817f9b21 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:41:25.896251 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-f1057fa8-6db6-4a7a-96ae-32f6817f9b21 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: f3926721-ba47-4cb4-ac57-6777811cd549] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:41:25.905363 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f1057fa8-6db6-4a7a-96ae-32f6817f9b21 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:41:25.905866 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f1057fa8-6db6-4a7a-96ae-32f6817f9b21 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:41:25.906293 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f1057fa8-6db6-4a7a-96ae-32f6817f9b21 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:41:25.906981 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f1057fa8-6db6-4a7a-96ae-32f6817f9b21 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:41:25.907426 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f1057fa8-6db6-4a7a-96ae-32f6817f9b21 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:41:25.907839 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f1057fa8-6db6-4a7a-96ae-32f6817f9b21 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:41:26.048767 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-f1057fa8-6db6-4a7a-96ae-32f6817f9b21 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:41:26.057034 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f1057fa8-6db6-4a7a-96ae-32f6817f9b21 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/f3926721-ba47-4cb4-ac57-6777811cd549" status: 200 len: 1682 microversion: 2.1 time: 0.168314 Aug 27 03:41:26.057612 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3261/6565] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:41:25 2022] GET /compute/v2.1/servers/f3926721-ba47-4cb4-ac57-6777811cd549 => generated 1682 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:41:27.083700 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-fec87d79-f199-495b-979c-921409f949ce tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:41:27.084773 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-fec87d79-f199-495b-979c-921409f949ce tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: f3926721-ba47-4cb4-ac57-6777811cd549] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:41:27.096762 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fec87d79-f199-495b-979c-921409f949ce tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:41:27.097606 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fec87d79-f199-495b-979c-921409f949ce tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:41:27.098499 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fec87d79-f199-495b-979c-921409f949ce tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:41:27.099697 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fec87d79-f199-495b-979c-921409f949ce tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:41:27.100525 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fec87d79-f199-495b-979c-921409f949ce tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:41:27.101262 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fec87d79-f199-495b-979c-921409f949ce tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:41:27.245743 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-fec87d79-f199-495b-979c-921409f949ce tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:41:27.257008 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-fec87d79-f199-495b-979c-921409f949ce tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/f3926721-ba47-4cb4-ac57-6777811cd549" status: 200 len: 1682 microversion: 2.1 time: 0.179566 Aug 27 03:41:27.257902 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3305/6566] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:41:27 2022] GET /compute/v2.1/servers/f3926721-ba47-4cb4-ac57-6777811cd549 => generated 1682 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:41:28.280265 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6ef21a26-6241-4fa5-b5ce-0ba7395c2f8e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:41:28.280850 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-6ef21a26-6241-4fa5-b5ce-0ba7395c2f8e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: f3926721-ba47-4cb4-ac57-6777811cd549] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:41:28.288730 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6ef21a26-6241-4fa5-b5ce-0ba7395c2f8e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:41:28.289216 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6ef21a26-6241-4fa5-b5ce-0ba7395c2f8e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:41:28.289639 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6ef21a26-6241-4fa5-b5ce-0ba7395c2f8e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:41:28.290335 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6ef21a26-6241-4fa5-b5ce-0ba7395c2f8e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:41:28.290771 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6ef21a26-6241-4fa5-b5ce-0ba7395c2f8e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:41:28.291187 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6ef21a26-6241-4fa5-b5ce-0ba7395c2f8e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:41:28.426409 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-6ef21a26-6241-4fa5-b5ce-0ba7395c2f8e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:41:28.434759 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-6ef21a26-6241-4fa5-b5ce-0ba7395c2f8e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/f3926721-ba47-4cb4-ac57-6777811cd549" status: 200 len: 1682 microversion: 2.1 time: 0.158755 Aug 27 03:41:28.435311 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3262/6567] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:41:28 2022] GET /compute/v2.1/servers/f3926721-ba47-4cb4-ac57-6777811cd549 => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:41:29.459107 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-5359818b-4252-4cd9-a22f-61f41cedced1 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:41:29.459891 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-5359818b-4252-4cd9-a22f-61f41cedced1 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: f3926721-ba47-4cb4-ac57-6777811cd549] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:41:29.470950 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5359818b-4252-4cd9-a22f-61f41cedced1 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:41:29.471729 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5359818b-4252-4cd9-a22f-61f41cedced1 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:41:29.472447 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5359818b-4252-4cd9-a22f-61f41cedced1 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:41:29.473577 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5359818b-4252-4cd9-a22f-61f41cedced1 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:41:29.474290 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5359818b-4252-4cd9-a22f-61f41cedced1 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:41:29.474998 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5359818b-4252-4cd9-a22f-61f41cedced1 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:41:29.620986 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-5359818b-4252-4cd9-a22f-61f41cedced1 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:41:29.629084 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-5359818b-4252-4cd9-a22f-61f41cedced1 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/f3926721-ba47-4cb4-ac57-6777811cd549" status: 200 len: 1682 microversion: 2.1 time: 0.176476 Aug 27 03:41:29.629667 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3306/6568] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:41:29 2022] GET /compute/v2.1/servers/f3926721-ba47-4cb4-ac57-6777811cd549 => generated 1682 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:41:30.653200 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-289f4051-1a07-48b7-8930-d7b20d00008f tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:41:30.653828 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-289f4051-1a07-48b7-8930-d7b20d00008f tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: f3926721-ba47-4cb4-ac57-6777811cd549] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:41:30.661791 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-289f4051-1a07-48b7-8930-d7b20d00008f tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:41:30.662308 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-289f4051-1a07-48b7-8930-d7b20d00008f tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:41:30.662769 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-289f4051-1a07-48b7-8930-d7b20d00008f tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:41:30.663510 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-289f4051-1a07-48b7-8930-d7b20d00008f tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:41:30.663988 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-289f4051-1a07-48b7-8930-d7b20d00008f tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:41:30.664473 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-289f4051-1a07-48b7-8930-d7b20d00008f tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:41:30.811613 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-289f4051-1a07-48b7-8930-d7b20d00008f tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:41:30.819876 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-289f4051-1a07-48b7-8930-d7b20d00008f tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/f3926721-ba47-4cb4-ac57-6777811cd549" status: 200 len: 1682 microversion: 2.1 time: 0.172886 Aug 27 03:41:30.820524 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3263/6569] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:41:30 2022] GET /compute/v2.1/servers/f3926721-ba47-4cb4-ac57-6777811cd549 => generated 1682 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:41:31.841475 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-6ac6357c-e15a-4c05-8be3-66305e43c4dd tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:41:31.842353 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-6ac6357c-e15a-4c05-8be3-66305e43c4dd tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: f3926721-ba47-4cb4-ac57-6777811cd549] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:41:31.849259 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6ac6357c-e15a-4c05-8be3-66305e43c4dd tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:41:31.849864 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6ac6357c-e15a-4c05-8be3-66305e43c4dd tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:41:31.850315 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6ac6357c-e15a-4c05-8be3-66305e43c4dd tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:41:31.851035 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6ac6357c-e15a-4c05-8be3-66305e43c4dd tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:41:31.851499 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6ac6357c-e15a-4c05-8be3-66305e43c4dd tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:41:31.851934 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6ac6357c-e15a-4c05-8be3-66305e43c4dd tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:41:32.044644 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-6ac6357c-e15a-4c05-8be3-66305e43c4dd tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:41:32.053672 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-6ac6357c-e15a-4c05-8be3-66305e43c4dd tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/f3926721-ba47-4cb4-ac57-6777811cd549" status: 200 len: 1681 microversion: 2.1 time: 0.216442 Aug 27 03:41:32.054260 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3307/6570] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:41:31 2022] GET /compute/v2.1/servers/f3926721-ba47-4cb4-ac57-6777811cd549 => generated 1681 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:41:32.343799 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-7d674d08-176a-4b77-ae9a-ab8012ff5a69 req-462e0cb9-514a-4327-b624-d84837e68a5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3926721-ba47-4cb4-ac57-6777811cd549", "name": "network-vif-unplugged", "status": "completed", "tag": "72e555a6-9b79-412e-ad70-96a0a2b894b7"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:41:32.355488 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-7d674d08-176a-4b77-ae9a-ab8012ff5a69 req-462e0cb9-514a-4327-b624-d84837e68a5a service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:41:32.356070 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-7d674d08-176a-4b77-ae9a-ab8012ff5a69 req-462e0cb9-514a-4327-b624-d84837e68a5a service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:41:32.356667 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-7d674d08-176a-4b77-ae9a-ab8012ff5a69 req-462e0cb9-514a-4327-b624-d84837e68a5a service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:41:32.369434 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-7d674d08-176a-4b77-ae9a-ab8012ff5a69 req-462e0cb9-514a-4327-b624-d84837e68a5a service nova] Creating event network-vif-unplugged:72e555a6-9b79-412e-ad70-96a0a2b894b7 for instance f3926721-ba47-4cb4-ac57-6777811cd549 on n-h1-852278-4 Aug 27 03:41:32.374985 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [req-7d674d08-176a-4b77-ae9a-ab8012ff5a69 req-462e0cb9-514a-4327-b624-d84837e68a5a service nova] Instance f3926721-ba47-4cb4-ac57-6777811cd549 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-852278-4', 'n-h1-852278-4'} {{(pid=134052) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 03:41:32.386331 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-7d674d08-176a-4b77-ae9a-ab8012ff5a69 req-462e0cb9-514a-4327-b624-d84837e68a5a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046388 Aug 27 03:41:32.386959 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3264/6571] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:41:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:41:33.078154 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d1355c6d-a666-411b-94ff-d3fdcf09bce9 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:41:33.078795 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d1355c6d-a666-411b-94ff-d3fdcf09bce9 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: f3926721-ba47-4cb4-ac57-6777811cd549] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:41:33.085755 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d1355c6d-a666-411b-94ff-d3fdcf09bce9 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:41:33.086271 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d1355c6d-a666-411b-94ff-d3fdcf09bce9 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:41:33.086731 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d1355c6d-a666-411b-94ff-d3fdcf09bce9 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:41:33.087458 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d1355c6d-a666-411b-94ff-d3fdcf09bce9 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:41:33.087931 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d1355c6d-a666-411b-94ff-d3fdcf09bce9 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:41:33.088401 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d1355c6d-a666-411b-94ff-d3fdcf09bce9 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:41:33.335432 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d1355c6d-a666-411b-94ff-d3fdcf09bce9 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:41:33.346894 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d1355c6d-a666-411b-94ff-d3fdcf09bce9 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/f3926721-ba47-4cb4-ac57-6777811cd549" status: 200 len: 1681 microversion: 2.1 time: 0.274284 Aug 27 03:41:33.347804 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3308/6572] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:41:33 2022] GET /compute/v2.1/servers/f3926721-ba47-4cb4-ac57-6777811cd549 => generated 1681 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:41:34.369008 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-194917b7-007f-43db-9ead-0ad250c724ed tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:41:34.369691 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-194917b7-007f-43db-9ead-0ad250c724ed tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: f3926721-ba47-4cb4-ac57-6777811cd549] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:41:34.377338 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-194917b7-007f-43db-9ead-0ad250c724ed tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:41:34.377834 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-194917b7-007f-43db-9ead-0ad250c724ed tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:41:34.378266 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-194917b7-007f-43db-9ead-0ad250c724ed tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:41:34.378968 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-194917b7-007f-43db-9ead-0ad250c724ed tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:41:34.379421 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-194917b7-007f-43db-9ead-0ad250c724ed tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:41:34.379847 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-194917b7-007f-43db-9ead-0ad250c724ed tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:41:34.424962 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-111d9c9b-5859-4cb7-a353-2dc9a8636980 req-3724ddd4-58cd-4f9a-8737-03d1caaa091b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3926721-ba47-4cb4-ac57-6777811cd549", "tag": "72e555a6-9b79-412e-ad70-96a0a2b894b7"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:41:34.435554 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-111d9c9b-5859-4cb7-a353-2dc9a8636980 req-3724ddd4-58cd-4f9a-8737-03d1caaa091b service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:41:34.436049 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-111d9c9b-5859-4cb7-a353-2dc9a8636980 req-3724ddd4-58cd-4f9a-8737-03d1caaa091b service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:41:34.436538 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-111d9c9b-5859-4cb7-a353-2dc9a8636980 req-3724ddd4-58cd-4f9a-8737-03d1caaa091b service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:41:34.448543 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-111d9c9b-5859-4cb7-a353-2dc9a8636980 req-3724ddd4-58cd-4f9a-8737-03d1caaa091b service nova] Creating event network-changed:72e555a6-9b79-412e-ad70-96a0a2b894b7 for instance f3926721-ba47-4cb4-ac57-6777811cd549 on n-h1-852278-4 Aug 27 03:41:34.454089 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [req-111d9c9b-5859-4cb7-a353-2dc9a8636980 req-3724ddd4-58cd-4f9a-8737-03d1caaa091b service nova] Instance f3926721-ba47-4cb4-ac57-6777811cd549 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-852278-4', 'n-h1-852278-4'} {{(pid=134051) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 03:41:34.465072 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-111d9c9b-5859-4cb7-a353-2dc9a8636980 req-3724ddd4-58cd-4f9a-8737-03d1caaa091b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044151 Aug 27 03:41:34.465686 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3309/6573] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:41:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:41:34.557078 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-194917b7-007f-43db-9ead-0ad250c724ed tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:41:34.565252 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-194917b7-007f-43db-9ead-0ad250c724ed tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/f3926721-ba47-4cb4-ac57-6777811cd549" status: 200 len: 1679 microversion: 2.1 time: 0.200680 Aug 27 03:41:34.565859 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3265/6574] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:41:34 2022] GET /compute/v2.1/servers/f3926721-ba47-4cb4-ac57-6777811cd549 => generated 1679 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:41:35.588865 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b02647ee-28c1-489e-9ab6-8d60eac2509b tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:41:35.589580 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b02647ee-28c1-489e-9ab6-8d60eac2509b tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: f3926721-ba47-4cb4-ac57-6777811cd549] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:41:35.596300 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b02647ee-28c1-489e-9ab6-8d60eac2509b tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:41:35.596840 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b02647ee-28c1-489e-9ab6-8d60eac2509b tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:41:35.597298 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b02647ee-28c1-489e-9ab6-8d60eac2509b tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:41:35.598022 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b02647ee-28c1-489e-9ab6-8d60eac2509b tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:41:35.598494 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b02647ee-28c1-489e-9ab6-8d60eac2509b tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:41:35.598933 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b02647ee-28c1-489e-9ab6-8d60eac2509b tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:41:35.805393 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-b02647ee-28c1-489e-9ab6-8d60eac2509b tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:41:35.813738 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b02647ee-28c1-489e-9ab6-8d60eac2509b tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/f3926721-ba47-4cb4-ac57-6777811cd549" status: 200 len: 1676 microversion: 2.1 time: 0.230298 Aug 27 03:41:35.814328 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3310/6575] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:41:35 2022] GET /compute/v2.1/servers/f3926721-ba47-4cb4-ac57-6777811cd549 => generated 1676 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:41:35.834515 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-1ddfd882-93ee-43bf-b5e2-8ca1a5463900 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:41:35.835025 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-1ddfd882-93ee-43bf-b5e2-8ca1a5463900 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: f3926721-ba47-4cb4-ac57-6777811cd549] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:41:35.842348 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1ddfd882-93ee-43bf-b5e2-8ca1a5463900 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:41:35.842837 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1ddfd882-93ee-43bf-b5e2-8ca1a5463900 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:41:35.843277 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1ddfd882-93ee-43bf-b5e2-8ca1a5463900 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:41:35.843977 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1ddfd882-93ee-43bf-b5e2-8ca1a5463900 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:41:35.844466 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1ddfd882-93ee-43bf-b5e2-8ca1a5463900 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:41:35.844894 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1ddfd882-93ee-43bf-b5e2-8ca1a5463900 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:41:35.883331 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1ddfd882-93ee-43bf-b5e2-8ca1a5463900 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:41:35.883817 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1ddfd882-93ee-43bf-b5e2-8ca1a5463900 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:41:35.884405 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1ddfd882-93ee-43bf-b5e2-8ca1a5463900 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:41:35.885172 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1ddfd882-93ee-43bf-b5e2-8ca1a5463900 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:41:35.885621 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1ddfd882-93ee-43bf-b5e2-8ca1a5463900 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:41:35.886046 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1ddfd882-93ee-43bf-b5e2-8ca1a5463900 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:41:35.907412 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-1ddfd882-93ee-43bf-b5e2-8ca1a5463900 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Getting quotas for project cc3aa9846bcb40518ac54e31208ce043. Resources: {'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:41:35.912875 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-1ddfd882-93ee-43bf-b5e2-8ca1a5463900 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Getting quotas for user c62665fa43c34e6eb695633905cf3b84 and project cc3aa9846bcb40518ac54e31208ce043. Resources: {'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:41:36.025186 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-1ddfd882-93ee-43bf-b5e2-8ca1a5463900 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "POST /compute/v2.1/servers/f3926721-ba47-4cb4-ac57-6777811cd549/action" status: 202 len: 0 microversion: 2.1 time: 0.194577 Aug 27 03:41:36.029296 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3266/6576] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:41:35 2022] POST /compute/v2.1/servers/f3926721-ba47-4cb4-ac57-6777811cd549/action => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:41:36.034512 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-be4f418d-04af-49d3-b6e9-5de639c87f1f tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:41:36.035130 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-be4f418d-04af-49d3-b6e9-5de639c87f1f tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: f3926721-ba47-4cb4-ac57-6777811cd549] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:41:36.041880 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-be4f418d-04af-49d3-b6e9-5de639c87f1f tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:41:36.042384 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-be4f418d-04af-49d3-b6e9-5de639c87f1f tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:41:36.042829 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-be4f418d-04af-49d3-b6e9-5de639c87f1f tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:41:36.043552 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-be4f418d-04af-49d3-b6e9-5de639c87f1f tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:41:36.044020 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-be4f418d-04af-49d3-b6e9-5de639c87f1f tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:41:36.044490 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-be4f418d-04af-49d3-b6e9-5de639c87f1f tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:41:36.245233 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-be4f418d-04af-49d3-b6e9-5de639c87f1f tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:41:36.253665 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-be4f418d-04af-49d3-b6e9-5de639c87f1f tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/f3926721-ba47-4cb4-ac57-6777811cd549" status: 200 len: 1675 microversion: 2.1 time: 0.223225 Aug 27 03:41:36.256437 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3311/6577] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:41:36 2022] GET /compute/v2.1/servers/f3926721-ba47-4cb4-ac57-6777811cd549 => generated 1675 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:41:37.279053 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b303c34c-0147-4a65-a09d-8f2f2404a46e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:41:37.279708 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b303c34c-0147-4a65-a09d-8f2f2404a46e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: f3926721-ba47-4cb4-ac57-6777811cd549] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:41:37.286680 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b303c34c-0147-4a65-a09d-8f2f2404a46e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:41:37.287158 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b303c34c-0147-4a65-a09d-8f2f2404a46e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:41:37.287560 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b303c34c-0147-4a65-a09d-8f2f2404a46e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:41:37.288273 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b303c34c-0147-4a65-a09d-8f2f2404a46e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:41:37.288746 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b303c34c-0147-4a65-a09d-8f2f2404a46e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:41:37.289161 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b303c34c-0147-4a65-a09d-8f2f2404a46e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:41:37.308287 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:41:37.426886 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b303c34c-0147-4a65-a09d-8f2f2404a46e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:41:37.435268 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b303c34c-0147-4a65-a09d-8f2f2404a46e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/f3926721-ba47-4cb4-ac57-6777811cd549" status: 200 len: 1675 microversion: 2.1 time: 0.161406 Aug 27 03:41:37.435860 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3267/6578] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:41:37 2022] GET /compute/v2.1/servers/f3926721-ba47-4cb4-ac57-6777811cd549 => generated 1675 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:41:38.457963 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e1b4d3b9-d618-45a1-b757-81770edc67bb tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:41:38.458581 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-e1b4d3b9-d618-45a1-b757-81770edc67bb tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: f3926721-ba47-4cb4-ac57-6777811cd549] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:41:38.465592 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e1b4d3b9-d618-45a1-b757-81770edc67bb tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:41:38.466083 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e1b4d3b9-d618-45a1-b757-81770edc67bb tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:41:38.466534 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e1b4d3b9-d618-45a1-b757-81770edc67bb tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:41:38.467249 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e1b4d3b9-d618-45a1-b757-81770edc67bb tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:41:38.467748 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e1b4d3b9-d618-45a1-b757-81770edc67bb tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:41:38.468193 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e1b4d3b9-d618-45a1-b757-81770edc67bb tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:41:38.614232 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e1b4d3b9-d618-45a1-b757-81770edc67bb tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:41:38.625440 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e1b4d3b9-d618-45a1-b757-81770edc67bb tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/f3926721-ba47-4cb4-ac57-6777811cd549" status: 200 len: 1675 microversion: 2.1 time: 0.172328 Aug 27 03:41:38.626032 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3312/6579] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:41:38 2022] GET /compute/v2.1/servers/f3926721-ba47-4cb4-ac57-6777811cd549 => generated 1675 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:41:39.087532 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-2874408c-e979-42ea-bebd-6931f39a79b2 req-a03a4ced-0369-4893-b97c-776c9393a541 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3926721-ba47-4cb4-ac57-6777811cd549", "name": "network-vif-plugged", "status": "completed", "tag": "72e555a6-9b79-412e-ad70-96a0a2b894b7"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:41:39.098530 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-2874408c-e979-42ea-bebd-6931f39a79b2 req-a03a4ced-0369-4893-b97c-776c9393a541 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:41:39.099373 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-2874408c-e979-42ea-bebd-6931f39a79b2 req-a03a4ced-0369-4893-b97c-776c9393a541 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:41:39.099771 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-2874408c-e979-42ea-bebd-6931f39a79b2 req-a03a4ced-0369-4893-b97c-776c9393a541 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:41:39.112764 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-2874408c-e979-42ea-bebd-6931f39a79b2 req-a03a4ced-0369-4893-b97c-776c9393a541 service nova] Creating event network-vif-plugged:72e555a6-9b79-412e-ad70-96a0a2b894b7 for instance f3926721-ba47-4cb4-ac57-6777811cd549 on n-h1-852278-4 Aug 27 03:41:39.119223 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [req-2874408c-e979-42ea-bebd-6931f39a79b2 req-a03a4ced-0369-4893-b97c-776c9393a541 service nova] Instance f3926721-ba47-4cb4-ac57-6777811cd549 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-852278-4', 'n-h1-852278-4'} {{(pid=134052) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 03:41:39.131652 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-2874408c-e979-42ea-bebd-6931f39a79b2 req-a03a4ced-0369-4893-b97c-776c9393a541 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047814 Aug 27 03:41:39.132476 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3268/6580] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:41:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:41:39.648252 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-1376b554-0ef5-49d3-8c65-f1a2223576ba tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:41:39.649198 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-1376b554-0ef5-49d3-8c65-f1a2223576ba tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: f3926721-ba47-4cb4-ac57-6777811cd549] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:41:39.655921 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1376b554-0ef5-49d3-8c65-f1a2223576ba tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:41:39.656627 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1376b554-0ef5-49d3-8c65-f1a2223576ba tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:41:39.657225 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1376b554-0ef5-49d3-8c65-f1a2223576ba tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:41:39.658058 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1376b554-0ef5-49d3-8c65-f1a2223576ba tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:41:39.658668 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1376b554-0ef5-49d3-8c65-f1a2223576ba tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:41:39.659232 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1376b554-0ef5-49d3-8c65-f1a2223576ba tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:41:39.896366 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-1376b554-0ef5-49d3-8c65-f1a2223576ba tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:41:39.905083 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-1376b554-0ef5-49d3-8c65-f1a2223576ba tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/f3926721-ba47-4cb4-ac57-6777811cd549" status: 200 len: 1675 microversion: 2.1 time: 0.262485 Aug 27 03:41:39.905702 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3313/6581] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:41:39 2022] GET /compute/v2.1/servers/f3926721-ba47-4cb4-ac57-6777811cd549 => generated 1675 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:41:39.950190 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-f66e82e4-1f1f-46cb-90e2-6d5b370b028c req-4f61bc99-a518-45aa-8120-78559e5fcd71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3926721-ba47-4cb4-ac57-6777811cd549", "name": "network-vif-unplugged", "status": "completed", "tag": "72e555a6-9b79-412e-ad70-96a0a2b894b7"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:41:39.962650 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-f66e82e4-1f1f-46cb-90e2-6d5b370b028c req-4f61bc99-a518-45aa-8120-78559e5fcd71 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:41:39.963412 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-f66e82e4-1f1f-46cb-90e2-6d5b370b028c req-4f61bc99-a518-45aa-8120-78559e5fcd71 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:41:39.964063 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-f66e82e4-1f1f-46cb-90e2-6d5b370b028c req-4f61bc99-a518-45aa-8120-78559e5fcd71 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:41:39.977245 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-f66e82e4-1f1f-46cb-90e2-6d5b370b028c req-4f61bc99-a518-45aa-8120-78559e5fcd71 service nova] Creating event network-vif-unplugged:72e555a6-9b79-412e-ad70-96a0a2b894b7 for instance f3926721-ba47-4cb4-ac57-6777811cd549 on n-h2-852278-4 Aug 27 03:41:39.988536 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [req-f66e82e4-1f1f-46cb-90e2-6d5b370b028c req-4f61bc99-a518-45aa-8120-78559e5fcd71 service nova] Instance f3926721-ba47-4cb4-ac57-6777811cd549 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-852278-4', 'n-h1-852278-4'} {{(pid=134052) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 03:41:40.000037 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-f66e82e4-1f1f-46cb-90e2-6d5b370b028c req-4f61bc99-a518-45aa-8120-78559e5fcd71 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055454 Aug 27 03:41:40.001083 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3269/6582] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:41:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:41:40.927447 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ae0777e4-7cd0-4ec7-b517-1ac6a8a74545 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:41:40.928098 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-ae0777e4-7cd0-4ec7-b517-1ac6a8a74545 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: f3926721-ba47-4cb4-ac57-6777811cd549] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:41:40.935527 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ae0777e4-7cd0-4ec7-b517-1ac6a8a74545 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:41:40.936077 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ae0777e4-7cd0-4ec7-b517-1ac6a8a74545 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:41:40.936559 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ae0777e4-7cd0-4ec7-b517-1ac6a8a74545 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:41:40.937262 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ae0777e4-7cd0-4ec7-b517-1ac6a8a74545 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:41:40.937723 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ae0777e4-7cd0-4ec7-b517-1ac6a8a74545 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:41:40.938155 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ae0777e4-7cd0-4ec7-b517-1ac6a8a74545 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:41:41.070327 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-ae0777e4-7cd0-4ec7-b517-1ac6a8a74545 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:41:41.078605 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ae0777e4-7cd0-4ec7-b517-1ac6a8a74545 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/f3926721-ba47-4cb4-ac57-6777811cd549" status: 200 len: 1675 microversion: 2.1 time: 0.155096 Aug 27 03:41:41.079189 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3314/6583] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:41:40 2022] GET /compute/v2.1/servers/f3926721-ba47-4cb4-ac57-6777811cd549 => generated 1675 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:41:42.022322 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-e976b566-5a24-4d39-b5a1-66bd7f919618 req-8719c722-9aad-4453-96d3-467a1f1ae766 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3926721-ba47-4cb4-ac57-6777811cd549", "tag": "72e555a6-9b79-412e-ad70-96a0a2b894b7"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:41:42.033397 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-e976b566-5a24-4d39-b5a1-66bd7f919618 req-8719c722-9aad-4453-96d3-467a1f1ae766 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:41:42.033672 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-e976b566-5a24-4d39-b5a1-66bd7f919618 req-8719c722-9aad-4453-96d3-467a1f1ae766 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:41:42.034096 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-e976b566-5a24-4d39-b5a1-66bd7f919618 req-8719c722-9aad-4453-96d3-467a1f1ae766 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:41:42.046162 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-e976b566-5a24-4d39-b5a1-66bd7f919618 req-8719c722-9aad-4453-96d3-467a1f1ae766 service nova] Creating event network-changed:72e555a6-9b79-412e-ad70-96a0a2b894b7 for instance f3926721-ba47-4cb4-ac57-6777811cd549 on n-h2-852278-4 Aug 27 03:41:42.051893 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [req-e976b566-5a24-4d39-b5a1-66bd7f919618 req-8719c722-9aad-4453-96d3-467a1f1ae766 service nova] Instance f3926721-ba47-4cb4-ac57-6777811cd549 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-852278-4', 'n-h1-852278-4'} {{(pid=134052) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 03:41:42.062507 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-e976b566-5a24-4d39-b5a1-66bd7f919618 req-8719c722-9aad-4453-96d3-467a1f1ae766 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044348 Aug 27 03:41:42.063113 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3270/6584] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:41:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:41:42.099213 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-1fdfcd6b-4761-4102-81df-bfcaf2a6d6f0 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:41:42.099834 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-1fdfcd6b-4761-4102-81df-bfcaf2a6d6f0 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: f3926721-ba47-4cb4-ac57-6777811cd549] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:41:42.107200 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1fdfcd6b-4761-4102-81df-bfcaf2a6d6f0 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:41:42.107901 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1fdfcd6b-4761-4102-81df-bfcaf2a6d6f0 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:41:42.108665 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1fdfcd6b-4761-4102-81df-bfcaf2a6d6f0 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:41:42.109444 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1fdfcd6b-4761-4102-81df-bfcaf2a6d6f0 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:41:42.109933 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1fdfcd6b-4761-4102-81df-bfcaf2a6d6f0 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:41:42.110371 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1fdfcd6b-4761-4102-81df-bfcaf2a6d6f0 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:41:42.386565 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-1fdfcd6b-4761-4102-81df-bfcaf2a6d6f0 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:41:42.390695 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=100 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:41:42.395562 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-1fdfcd6b-4761-4102-81df-bfcaf2a6d6f0 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/f3926721-ba47-4cb4-ac57-6777811cd549" status: 200 len: 1675 microversion: 2.1 time: 0.300331 Aug 27 03:41:42.408621 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3315/6585] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:41:42 2022] GET /compute/v2.1/servers/f3926721-ba47-4cb4-ac57-6777811cd549 => generated 1675 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:41:43.422934 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-42bd45c1-26bb-4491-bce9-b6af94a57382 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:41:43.423633 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-42bd45c1-26bb-4491-bce9-b6af94a57382 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: f3926721-ba47-4cb4-ac57-6777811cd549] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:41:43.425672 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:41:43.431445 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-42bd45c1-26bb-4491-bce9-b6af94a57382 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:41:43.431946 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-42bd45c1-26bb-4491-bce9-b6af94a57382 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:41:43.432402 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-42bd45c1-26bb-4491-bce9-b6af94a57382 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:41:43.433119 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-42bd45c1-26bb-4491-bce9-b6af94a57382 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:41:43.433569 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-42bd45c1-26bb-4491-bce9-b6af94a57382 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:41:43.434091 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-42bd45c1-26bb-4491-bce9-b6af94a57382 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:41:43.569152 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-42bd45c1-26bb-4491-bce9-b6af94a57382 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:41:43.577230 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-42bd45c1-26bb-4491-bce9-b6af94a57382 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/f3926721-ba47-4cb4-ac57-6777811cd549" status: 200 len: 1668 microversion: 2.1 time: 0.162720 Aug 27 03:41:43.577901 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3271/6586] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:41:43 2022] GET /compute/v2.1/servers/f3926721-ba47-4cb4-ac57-6777811cd549 => generated 1668 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:41:43.598061 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-2751b212-41aa-457b-ae25-a34289046ce4 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:41:43.598579 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-2751b212-41aa-457b-ae25-a34289046ce4 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: f3926721-ba47-4cb4-ac57-6777811cd549] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:41:43.601203 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=35 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:41:43.606955 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2751b212-41aa-457b-ae25-a34289046ce4 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:41:43.607460 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2751b212-41aa-457b-ae25-a34289046ce4 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:41:43.607919 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2751b212-41aa-457b-ae25-a34289046ce4 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:41:43.608672 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2751b212-41aa-457b-ae25-a34289046ce4 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:41:43.609186 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2751b212-41aa-457b-ae25-a34289046ce4 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:41:43.609632 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2751b212-41aa-457b-ae25-a34289046ce4 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:41:43.750957 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-2751b212-41aa-457b-ae25-a34289046ce4 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:41:43.759563 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-2751b212-41aa-457b-ae25-a34289046ce4 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/f3926721-ba47-4cb4-ac57-6777811cd549" status: 200 len: 1668 microversion: 2.1 time: 0.166016 Aug 27 03:41:43.760165 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3316/6587] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:41:43 2022] GET /compute/v2.1/servers/f3926721-ba47-4cb4-ac57-6777811cd549 => generated 1668 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:41:43.779726 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-be6eb3ec-af1e-4a2e-a2be-9cba8833714a tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:41:43.780340 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-be6eb3ec-af1e-4a2e-a2be-9cba8833714a tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: f3926721-ba47-4cb4-ac57-6777811cd549] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:41:43.786809 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-be6eb3ec-af1e-4a2e-a2be-9cba8833714a tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:41:43.787299 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-be6eb3ec-af1e-4a2e-a2be-9cba8833714a tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:41:43.787738 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-be6eb3ec-af1e-4a2e-a2be-9cba8833714a tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:41:43.788466 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-be6eb3ec-af1e-4a2e-a2be-9cba8833714a tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:41:43.788896 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-be6eb3ec-af1e-4a2e-a2be-9cba8833714a tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:41:43.789327 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-be6eb3ec-af1e-4a2e-a2be-9cba8833714a tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:41:43.929432 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-be6eb3ec-af1e-4a2e-a2be-9cba8833714a tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:41:43.937642 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-be6eb3ec-af1e-4a2e-a2be-9cba8833714a tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/f3926721-ba47-4cb4-ac57-6777811cd549" status: 200 len: 1668 microversion: 2.1 time: 0.161830 Aug 27 03:41:43.938220 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3272/6588] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:41:43 2022] GET /compute/v2.1/servers/f3926721-ba47-4cb4-ac57-6777811cd549 => generated 1668 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:41:43.958062 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0a2b0c0d-0958-4489-86ae-8e6463f4e46e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:41:43.958509 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-0a2b0c0d-0958-4489-86ae-8e6463f4e46e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: f3926721-ba47-4cb4-ac57-6777811cd549] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:41:43.964790 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0a2b0c0d-0958-4489-86ae-8e6463f4e46e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:41:43.965289 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0a2b0c0d-0958-4489-86ae-8e6463f4e46e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:41:43.965743 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0a2b0c0d-0958-4489-86ae-8e6463f4e46e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:41:43.966449 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0a2b0c0d-0958-4489-86ae-8e6463f4e46e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:41:43.966916 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0a2b0c0d-0958-4489-86ae-8e6463f4e46e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:41:43.967354 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0a2b0c0d-0958-4489-86ae-8e6463f4e46e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:41:43.992802 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-0a2b0c0d-0958-4489-86ae-8e6463f4e46e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: f3926721-ba47-4cb4-ac57-6777811cd549] Going to try to terminate instance {{(pid=134051) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:41:44.083003 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-0a2b0c0d-0958-4489-86ae-8e6463f4e46e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "DELETE /compute/v2.1/servers/f3926721-ba47-4cb4-ac57-6777811cd549" status: 204 len: 0 microversion: 2.1 time: 0.128502 Aug 27 03:41:44.083777 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3317/6589] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 03:41:43 2022] DELETE /compute/v2.1/servers/f3926721-ba47-4cb4-ac57-6777811cd549 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:41:44.092624 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-768ea439-ab54-4ae0-8e40-584a1f67054b tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:41:44.093275 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-768ea439-ab54-4ae0-8e40-584a1f67054b tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: f3926721-ba47-4cb4-ac57-6777811cd549] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:41:44.099367 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-768ea439-ab54-4ae0-8e40-584a1f67054b tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:41:44.099857 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-768ea439-ab54-4ae0-8e40-584a1f67054b tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:41:44.100291 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-768ea439-ab54-4ae0-8e40-584a1f67054b tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:41:44.101005 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-768ea439-ab54-4ae0-8e40-584a1f67054b tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:41:44.101469 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-768ea439-ab54-4ae0-8e40-584a1f67054b tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:41:44.101874 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-768ea439-ab54-4ae0-8e40-584a1f67054b tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:41:44.239835 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-768ea439-ab54-4ae0-8e40-584a1f67054b tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:41:44.248246 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-768ea439-ab54-4ae0-8e40-584a1f67054b tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/f3926721-ba47-4cb4-ac57-6777811cd549" status: 200 len: 1674 microversion: 2.1 time: 0.159575 Aug 27 03:41:44.248841 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3273/6590] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:41:44 2022] GET /compute/v2.1/servers/f3926721-ba47-4cb4-ac57-6777811cd549 => generated 1674 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:41:45.273096 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e0c399e9-b79f-42a7-b3bc-fdae207cb72e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:41:45.273777 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-e0c399e9-b79f-42a7-b3bc-fdae207cb72e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: f3926721-ba47-4cb4-ac57-6777811cd549] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:41:45.283088 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e0c399e9-b79f-42a7-b3bc-fdae207cb72e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:41:45.283382 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e0c399e9-b79f-42a7-b3bc-fdae207cb72e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:41:45.283836 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e0c399e9-b79f-42a7-b3bc-fdae207cb72e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:41:45.284591 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e0c399e9-b79f-42a7-b3bc-fdae207cb72e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:41:45.285081 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e0c399e9-b79f-42a7-b3bc-fdae207cb72e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:41:45.285554 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e0c399e9-b79f-42a7-b3bc-fdae207cb72e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:41:45.492195 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e0c399e9-b79f-42a7-b3bc-fdae207cb72e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:41:45.500735 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e0c399e9-b79f-42a7-b3bc-fdae207cb72e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/f3926721-ba47-4cb4-ac57-6777811cd549" status: 200 len: 1674 microversion: 2.1 time: 0.233995 Aug 27 03:41:45.501551 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3318/6591] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:41:45 2022] GET /compute/v2.1/servers/f3926721-ba47-4cb4-ac57-6777811cd549 => generated 1674 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:41:46.522114 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b76d0157-21ed-4fd3-bde8-3706c9da01ee tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:41:46.522836 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b76d0157-21ed-4fd3-bde8-3706c9da01ee tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: f3926721-ba47-4cb4-ac57-6777811cd549] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:41:46.525951 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=3 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:41:46.532509 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b76d0157-21ed-4fd3-bde8-3706c9da01ee tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:41:46.532965 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b76d0157-21ed-4fd3-bde8-3706c9da01ee tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:41:46.533387 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b76d0157-21ed-4fd3-bde8-3706c9da01ee tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:41:46.534131 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b76d0157-21ed-4fd3-bde8-3706c9da01ee tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:41:46.534584 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b76d0157-21ed-4fd3-bde8-3706c9da01ee tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:41:46.535001 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b76d0157-21ed-4fd3-bde8-3706c9da01ee tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:41:46.569151 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-59b7525e-2240-4c4b-a08f-4cced8b3ada8 req-effbd787-ffb4-4f7a-9c56-08bb36573949 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3926721-ba47-4cb4-ac57-6777811cd549", "name": "network-vif-deleted", "tag": "72e555a6-9b79-412e-ad70-96a0a2b894b7"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:41:46.582011 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-59b7525e-2240-4c4b-a08f-4cced8b3ada8 req-effbd787-ffb4-4f7a-9c56-08bb36573949 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:41:46.582695 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-59b7525e-2240-4c4b-a08f-4cced8b3ada8 req-effbd787-ffb4-4f7a-9c56-08bb36573949 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:41:46.583150 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-59b7525e-2240-4c4b-a08f-4cced8b3ada8 req-effbd787-ffb4-4f7a-9c56-08bb36573949 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:41:46.599716 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-59b7525e-2240-4c4b-a08f-4cced8b3ada8 req-effbd787-ffb4-4f7a-9c56-08bb36573949 service nova] Creating event network-vif-deleted:72e555a6-9b79-412e-ad70-96a0a2b894b7 for instance f3926721-ba47-4cb4-ac57-6777811cd549 on n-h2-852278-4 Aug 27 03:41:46.605773 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-59b7525e-2240-4c4b-a08f-4cced8b3ada8 req-effbd787-ffb4-4f7a-9c56-08bb36573949 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040435 Aug 27 03:41:46.606925 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3319/6592] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:41:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:41:46.611414 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b76d0157-21ed-4fd3-bde8-3706c9da01ee tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:41:46.621463 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b76d0157-21ed-4fd3-bde8-3706c9da01ee tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/f3926721-ba47-4cb4-ac57-6777811cd549" status: 200 len: 1607 microversion: 2.1 time: 0.103292 Aug 27 03:41:46.622826 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3274/6593] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:41:46 2022] GET /compute/v2.1/servers/f3926721-ba47-4cb4-ac57-6777811cd549 => generated 1607 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:41:47.647436 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c48ef3cd-f392-4c8c-ab73-8d911c311411 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:41:47.648501 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-c48ef3cd-f392-4c8c-ab73-8d911c311411 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: f3926721-ba47-4cb4-ac57-6777811cd549] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:41:47.658169 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c48ef3cd-f392-4c8c-ab73-8d911c311411 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:41:47.658677 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c48ef3cd-f392-4c8c-ab73-8d911c311411 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:41:47.659133 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c48ef3cd-f392-4c8c-ab73-8d911c311411 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:41:47.659851 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c48ef3cd-f392-4c8c-ab73-8d911c311411 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:41:47.660960 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c48ef3cd-f392-4c8c-ab73-8d911c311411 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:41:47.661445 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c48ef3cd-f392-4c8c-ab73-8d911c311411 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:41:47.676017 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-c48ef3cd-f392-4c8c-ab73-8d911c311411 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] HTTP exception thrown: Instance f3926721-ba47-4cb4-ac57-6777811cd549 could not be found. Aug 27 03:41:47.677693 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c48ef3cd-f392-4c8c-ab73-8d911c311411 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Request method failure captured: Aug 27 03:41:47.677693 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/f3926721-ba47-4cb4-ac57-6777811cd549 HTTP/1.1 Aug 27 03:41:47.677693 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 03:41:47.677693 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 03:41:47.677693 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 03:41:47.677693 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 03:41:47.677693 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 03:41:47.677693 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 03:41:47.677693 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 03:41:47.677693 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 03:41:47.677693 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCZGWxk5BEicF9AwnrkJwBWPfwg6arCi_dT6E6ZVU5_NhdiLiUMoMZ2Q_dYvmFaxRe7rt1FqUkb8B6Jv9aLrdZAOB6sF0tJV32UJ88bJE_iEEa6wH556BrFuazMURlys8Bi6SN-7FaZo2zdThDqlQ_upK7UsTTNFT7YiOxJI35LhaDsc Aug 27 03:41:47.677693 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 03:41:47.677693 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 03:41:47.677693 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 03:41:47.677693 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 03:41:47.677693 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 03:41:47.677693 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 03:41:47.677693 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: cc3aa9846bcb40518ac54e31208ce043 Aug 27 03:41:47.677693 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ServerActionsTestJSON-577023370 Aug 27 03:41:47.677693 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 03:41:47.677693 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 03:41:47.677693 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cc3aa9846bcb40518ac54e31208ce043"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_cc3aa9846bcb40518ac54e31208ce043", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cc3aa9846bcb40518ac54e31208ce043"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/cc3aa9846bcb40518ac54e31208ce043"}]}] Aug 27 03:41:47.677693 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ServerActionsTestJSON-577023370 Aug 27 03:41:47.677693 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: cc3aa9846bcb40518ac54e31208ce043 Aug 27 03:41:47.677693 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ServerActionsTestJSON-577023370 Aug 27 03:41:47.677693 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ServerActionsTestJSON-577023370-project Aug 27 03:41:47.677693 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 03:41:47.677693 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 03:41:47.677693 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: c62665fa43c34e6eb695633905cf3b84 Aug 27 03:41:47.677693 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ServerActionsTestJSON-577023370-project Aug 27 03:41:47.677693 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 03:41:47.677693 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance f3926721-ba47-4cb4-ac57-6777811cd549 could not be found. Aug 27 03:41:47.677693 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': 'f3926721-ba47-4cb4-ac57-6777811cd549'} Aug 27 03:41:47.677693 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:41:47.677693 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:41:47.677693 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:41:47.677693 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:41:47.677693 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:41:47.677693 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:41:47.677693 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:41:47.677693 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:41:47.677693 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:41:47.677693 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:41:47.677693 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3926721-ba47-4cb4-ac57-6777811cd549 could not be found. Aug 27 03:41:47.677693 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:41:47.677693 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:41:47.677693 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:41:47.677693 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:41:47.677693 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:41:47.677693 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:41:47.677693 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:41:47.677693 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:41:47.677693 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:41:47.677693 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:41:47.677693 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:41:47.677693 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:41:47.677693 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:41:47.677693 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:41:47.677693 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:41:47.677693 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:41:47.677693 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3926721-ba47-4cb4-ac57-6777811cd549 could not be found. Aug 27 03:41:47.677693 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:41:47.677693 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:41:47.677693 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:41:47.681886 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:41:47.681886 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:41:47.681886 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:41:47.681886 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:41:47.681886 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:41:47.681886 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3926721-ba47-4cb4-ac57-6777811cd549 could not be found. Aug 27 03:41:47.681886 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:41:47.681886 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c48ef3cd-f392-4c8c-ab73-8d911c311411 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Returning 404 to user: Instance f3926721-ba47-4cb4-ac57-6777811cd549 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:41:47.681886 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c48ef3cd-f392-4c8c-ab73-8d911c311411 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/f3926721-ba47-4cb4-ac57-6777811cd549" status: 404 len: 111 microversion: 2.1 time: 0.038350 Aug 27 03:41:47.681886 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3320/6594] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:41:47 2022] GET /compute/v2.1/servers/f3926721-ba47-4cb4-ac57-6777811cd549 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:41:47.695770 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-16cf2281-533f-49d5-9926-a04380aadeab tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:41:47.696338 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-16cf2281-533f-49d5-9926-a04380aadeab tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: f3926721-ba47-4cb4-ac57-6777811cd549] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:41:47.703470 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-16cf2281-533f-49d5-9926-a04380aadeab tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:41:47.703947 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-16cf2281-533f-49d5-9926-a04380aadeab tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:41:47.704383 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-16cf2281-533f-49d5-9926-a04380aadeab tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:41:47.705073 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-16cf2281-533f-49d5-9926-a04380aadeab tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:41:47.705512 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-16cf2281-533f-49d5-9926-a04380aadeab tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:41:47.705924 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-16cf2281-533f-49d5-9926-a04380aadeab tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:41:47.721813 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-16cf2281-533f-49d5-9926-a04380aadeab tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] HTTP exception thrown: Instance f3926721-ba47-4cb4-ac57-6777811cd549 could not be found. Aug 27 03:41:47.723489 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-16cf2281-533f-49d5-9926-a04380aadeab tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Request method failure captured: Aug 27 03:41:47.723489 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/servers/f3926721-ba47-4cb4-ac57-6777811cd549 HTTP/1.1 Aug 27 03:41:47.723489 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 03:41:47.723489 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 03:41:47.723489 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 03:41:47.723489 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 03:41:47.723489 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 03:41:47.723489 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 03:41:47.723489 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 03:41:47.723489 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 03:41:47.723489 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCZGWxk5BEicF9AwnrkJwBWPfwg6arCi_dT6E6ZVU5_NhdiLiUMoMZ2Q_dYvmFaxRe7rt1FqUkb8B6Jv9aLrdZAOB6sF0tJV32UJ88bJE_iEEa6wH556BrFuazMURlys8Bi6SN-7FaZo2zdThDqlQ_upK7UsTTNFT7YiOxJI35LhaDsc Aug 27 03:41:47.723489 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 03:41:47.723489 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 03:41:47.723489 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 03:41:47.723489 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 03:41:47.723489 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 03:41:47.723489 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 03:41:47.723489 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: cc3aa9846bcb40518ac54e31208ce043 Aug 27 03:41:47.723489 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ServerActionsTestJSON-577023370 Aug 27 03:41:47.723489 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 03:41:47.723489 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 03:41:47.723489 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cc3aa9846bcb40518ac54e31208ce043"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_cc3aa9846bcb40518ac54e31208ce043", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cc3aa9846bcb40518ac54e31208ce043"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/cc3aa9846bcb40518ac54e31208ce043"}]}] Aug 27 03:41:47.723489 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ServerActionsTestJSON-577023370 Aug 27 03:41:47.723489 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: cc3aa9846bcb40518ac54e31208ce043 Aug 27 03:41:47.723489 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ServerActionsTestJSON-577023370 Aug 27 03:41:47.723489 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ServerActionsTestJSON-577023370-project Aug 27 03:41:47.723489 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 03:41:47.723489 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 03:41:47.723489 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: c62665fa43c34e6eb695633905cf3b84 Aug 27 03:41:47.723489 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ServerActionsTestJSON-577023370-project Aug 27 03:41:47.723489 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 03:41:47.723489 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance f3926721-ba47-4cb4-ac57-6777811cd549 could not be found. Aug 27 03:41:47.723489 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': 'f3926721-ba47-4cb4-ac57-6777811cd549'} Aug 27 03:41:47.723489 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:41:47.723489 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:41:47.723489 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:41:47.723489 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:41:47.723489 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:41:47.723489 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:41:47.723489 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:41:47.723489 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:41:47.723489 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:41:47.723489 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:41:47.723489 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3926721-ba47-4cb4-ac57-6777811cd549 could not be found. Aug 27 03:41:47.723489 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:41:47.723489 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:41:47.723489 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:41:47.723489 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:41:47.723489 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:41:47.723489 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:41:47.723489 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:41:47.723489 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:41:47.723489 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:41:47.723489 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:41:47.723489 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:41:47.723489 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:41:47.723489 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:41:47.723489 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:41:47.723489 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:41:47.723489 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:41:47.723489 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3926721-ba47-4cb4-ac57-6777811cd549 could not be found. Aug 27 03:41:47.723489 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:41:47.723489 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:41:47.723489 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:41:47.727328 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:41:47.727328 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:41:47.727328 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:41:47.727328 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:41:47.727328 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:41:47.727328 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3926721-ba47-4cb4-ac57-6777811cd549 could not be found. Aug 27 03:41:47.727328 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:41:47.727328 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-16cf2281-533f-49d5-9926-a04380aadeab tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Returning 404 to user: Instance f3926721-ba47-4cb4-ac57-6777811cd549 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:41:47.727328 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-16cf2281-533f-49d5-9926-a04380aadeab tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/f3926721-ba47-4cb4-ac57-6777811cd549" status: 404 len: 111 microversion: 2.1 time: 0.033176 Aug 27 03:41:47.727328 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3275/6595] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:41:47 2022] GET /compute/v2.1/servers/f3926721-ba47-4cb4-ac57-6777811cd549 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:41:47.776949 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-9dd30eb7-1e6f-45b9-b286-d9b628965e25 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1672998020", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "networks": [{"uuid": "58a8af60-9bb2-4790-9c69-3b7ee60e6ff0"}], "security_groups": [{"name": "tempest-securitygroup--353980153"}], "key_name": "tempest-keypair-1055144708", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:41:47.886045 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.network.neutron [None req-9dd30eb7-1e6f-45b9-b286-d9b628965e25 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] validate_networks() for [('58a8af60-9bb2-4790-9c69-3b7ee60e6ff0', None, None, None, None, None)] {{(pid=134051) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:41:48.285032 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-9dd30eb7-1e6f-45b9-b286-d9b628965e25 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Flavor limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:41:48.285505 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-9dd30eb7-1e6f-45b9-b286-d9b628965e25 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Image limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:41:48.286167 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-9dd30eb7-1e6f-45b9-b286-d9b628965e25 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Flavor pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:41:48.286702 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-9dd30eb7-1e6f-45b9-b286-d9b628965e25 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Image pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:41:48.287287 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-9dd30eb7-1e6f-45b9-b286-d9b628965e25 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:41:48.301897 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9dd30eb7-1e6f-45b9-b286-d9b628965e25 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:41:48.302620 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9dd30eb7-1e6f-45b9-b286-d9b628965e25 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:41:48.303277 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9dd30eb7-1e6f-45b9-b286-d9b628965e25 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:41:48.304451 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9dd30eb7-1e6f-45b9-b286-d9b628965e25 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:41:48.305127 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9dd30eb7-1e6f-45b9-b286-d9b628965e25 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:41:48.305812 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9dd30eb7-1e6f-45b9-b286-d9b628965e25 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:41:48.325795 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-9dd30eb7-1e6f-45b9-b286-d9b628965e25 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Getting quotas for project cc3aa9846bcb40518ac54e31208ce043. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:41:48.331529 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-9dd30eb7-1e6f-45b9-b286-d9b628965e25 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Getting quotas for user c62665fa43c34e6eb695633905cf3b84 and project cc3aa9846bcb40518ac54e31208ce043. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:41:48.344357 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-9dd30eb7-1e6f-45b9-b286-d9b628965e25 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Going to run 1 instances... {{(pid=134051) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:41:48.346772 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-9dd30eb7-1e6f-45b9-b286-d9b628965e25 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c3c1bec-8119-424c-84ad-682c05e27f58] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134051) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:41:48.394669 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-9dd30eb7-1e6f-45b9-b286-d9b628965e25 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.621785 Aug 27 03:41:48.395312 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3321/6596] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 03:41:47 2022] POST /compute/v2.1/servers => generated 405 bytes in 623 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:41:48.408197 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-fd4b2b9b-9de5-4355-ba9b-12333b50db7a tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:41:48.408959 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-fd4b2b9b-9de5-4355-ba9b-12333b50db7a tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c3c1bec-8119-424c-84ad-682c05e27f58] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:41:48.468846 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-fd4b2b9b-9de5-4355-ba9b-12333b50db7a tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:41:48.476394 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-fd4b2b9b-9de5-4355-ba9b-12333b50db7a tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58" status: 200 len: 1239 microversion: 2.1 time: 0.073468 Aug 27 03:41:48.477084 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3276/6597] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:41:48 2022] GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58 => generated 1239 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:41:49.501213 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a9ca5e0f-70e7-4ca3-aec4-079b8194b3e5 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:41:49.501893 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-a9ca5e0f-70e7-4ca3-aec4-079b8194b3e5 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c3c1bec-8119-424c-84ad-682c05e27f58] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:41:49.510253 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a9ca5e0f-70e7-4ca3-aec4-079b8194b3e5 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:41:49.510923 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a9ca5e0f-70e7-4ca3-aec4-079b8194b3e5 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:41:49.511380 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a9ca5e0f-70e7-4ca3-aec4-079b8194b3e5 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:41:49.512536 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a9ca5e0f-70e7-4ca3-aec4-079b8194b3e5 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:41:49.513223 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a9ca5e0f-70e7-4ca3-aec4-079b8194b3e5 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:41:49.513892 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a9ca5e0f-70e7-4ca3-aec4-079b8194b3e5 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:41:49.622669 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-a9ca5e0f-70e7-4ca3-aec4-079b8194b3e5 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:41:49.630935 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a9ca5e0f-70e7-4ca3-aec4-079b8194b3e5 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58" status: 200 len: 1299 microversion: 2.1 time: 0.136855 Aug 27 03:41:49.634624 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3322/6598] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:41:49 2022] GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58 => generated 1299 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:41:50.655513 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ca0ffd8d-ffe8-424c-ada6-2855e83b6254 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:41:50.656067 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-ca0ffd8d-ffe8-424c-ada6-2855e83b6254 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c3c1bec-8119-424c-84ad-682c05e27f58] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:41:50.664199 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ca0ffd8d-ffe8-424c-ada6-2855e83b6254 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:41:50.665048 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ca0ffd8d-ffe8-424c-ada6-2855e83b6254 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:41:50.665492 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ca0ffd8d-ffe8-424c-ada6-2855e83b6254 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:41:50.666198 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ca0ffd8d-ffe8-424c-ada6-2855e83b6254 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:41:50.666655 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ca0ffd8d-ffe8-424c-ada6-2855e83b6254 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:41:50.667074 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ca0ffd8d-ffe8-424c-ada6-2855e83b6254 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:41:50.861734 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-ca0ffd8d-ffe8-424c-ada6-2855e83b6254 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:41:50.869649 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ca0ffd8d-ffe8-424c-ada6-2855e83b6254 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58" status: 200 len: 1364 microversion: 2.1 time: 0.218192 Aug 27 03:41:50.870240 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3277/6599] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:41:50 2022] GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58 => generated 1364 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:41:51.093145 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-2cbb3149-b275-424d-ae5f-a38a4309be41 req-37f27e21-77fc-46cb-a4c5-6283c7ad0ef9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c3c1bec-8119-424c-84ad-682c05e27f58", "tag": "c4574914-6056-490c-94d6-b6cf22330712"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:41:51.104163 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-2cbb3149-b275-424d-ae5f-a38a4309be41 req-37f27e21-77fc-46cb-a4c5-6283c7ad0ef9 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:41:51.104679 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-2cbb3149-b275-424d-ae5f-a38a4309be41 req-37f27e21-77fc-46cb-a4c5-6283c7ad0ef9 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:41:51.105124 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-2cbb3149-b275-424d-ae5f-a38a4309be41 req-37f27e21-77fc-46cb-a4c5-6283c7ad0ef9 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:41:51.116873 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-2cbb3149-b275-424d-ae5f-a38a4309be41 req-37f27e21-77fc-46cb-a4c5-6283c7ad0ef9 service nova] Creating event network-changed:c4574914-6056-490c-94d6-b6cf22330712 for instance 2c3c1bec-8119-424c-84ad-682c05e27f58 on n-h1-852278-4 Aug 27 03:41:51.121675 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-2cbb3149-b275-424d-ae5f-a38a4309be41 req-37f27e21-77fc-46cb-a4c5-6283c7ad0ef9 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032384 Aug 27 03:41:51.122277 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3323/6600] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:41:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:41:51.895045 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-32090385-d5cf-4144-840f-a7931056563b tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:41:51.895754 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-32090385-d5cf-4144-840f-a7931056563b tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c3c1bec-8119-424c-84ad-682c05e27f58] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:41:51.905311 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-32090385-d5cf-4144-840f-a7931056563b tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:41:51.905964 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-32090385-d5cf-4144-840f-a7931056563b tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:41:51.906555 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-32090385-d5cf-4144-840f-a7931056563b tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:41:51.907484 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-32090385-d5cf-4144-840f-a7931056563b tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:41:51.908091 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-32090385-d5cf-4144-840f-a7931056563b tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:41:51.908702 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-32090385-d5cf-4144-840f-a7931056563b tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:41:52.048126 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-32090385-d5cf-4144-840f-a7931056563b tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:41:52.056446 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-32090385-d5cf-4144-840f-a7931056563b tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58" status: 200 len: 1364 microversion: 2.1 time: 0.167454 Aug 27 03:41:52.057037 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3278/6601] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:41:51 2022] GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58 => generated 1364 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:41:53.081403 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7adc6ef6-f277-4bed-8adf-940a6348edd7 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:41:53.082009 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-7adc6ef6-f277-4bed-8adf-940a6348edd7 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c3c1bec-8119-424c-84ad-682c05e27f58] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:41:53.088714 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7adc6ef6-f277-4bed-8adf-940a6348edd7 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:41:53.089207 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7adc6ef6-f277-4bed-8adf-940a6348edd7 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:41:53.089659 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7adc6ef6-f277-4bed-8adf-940a6348edd7 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:41:53.090370 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7adc6ef6-f277-4bed-8adf-940a6348edd7 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:41:53.090836 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7adc6ef6-f277-4bed-8adf-940a6348edd7 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:41:53.091270 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7adc6ef6-f277-4bed-8adf-940a6348edd7 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:41:53.237310 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-7adc6ef6-f277-4bed-8adf-940a6348edd7 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:41:53.245798 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-7adc6ef6-f277-4bed-8adf-940a6348edd7 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58" status: 200 len: 1364 microversion: 2.1 time: 0.170815 Aug 27 03:41:53.246380 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3324/6602] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:41:53 2022] GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58 => generated 1364 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:41:54.270650 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-26ffd178-c712-4b61-b9cb-bc93f23a75c9 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:41:54.271489 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-26ffd178-c712-4b61-b9cb-bc93f23a75c9 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c3c1bec-8119-424c-84ad-682c05e27f58] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:41:54.282781 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-26ffd178-c712-4b61-b9cb-bc93f23a75c9 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:41:54.283300 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-26ffd178-c712-4b61-b9cb-bc93f23a75c9 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:41:54.283771 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-26ffd178-c712-4b61-b9cb-bc93f23a75c9 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:41:54.284517 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-26ffd178-c712-4b61-b9cb-bc93f23a75c9 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:41:54.284982 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-26ffd178-c712-4b61-b9cb-bc93f23a75c9 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:41:54.285478 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-26ffd178-c712-4b61-b9cb-bc93f23a75c9 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:41:54.430171 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-26ffd178-c712-4b61-b9cb-bc93f23a75c9 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:41:54.438141 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-26ffd178-c712-4b61-b9cb-bc93f23a75c9 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58" status: 200 len: 1364 microversion: 2.1 time: 0.174256 Aug 27 03:41:54.438843 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3279/6603] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:41:54 2022] GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58 => generated 1364 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:41:55.459780 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-bda761c8-bebc-4baa-a0dd-97db202a55d7 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:41:55.460443 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-bda761c8-bebc-4baa-a0dd-97db202a55d7 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c3c1bec-8119-424c-84ad-682c05e27f58] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:41:55.468435 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bda761c8-bebc-4baa-a0dd-97db202a55d7 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:41:55.468971 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bda761c8-bebc-4baa-a0dd-97db202a55d7 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:41:55.469437 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bda761c8-bebc-4baa-a0dd-97db202a55d7 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:41:55.470171 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bda761c8-bebc-4baa-a0dd-97db202a55d7 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:41:55.470627 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bda761c8-bebc-4baa-a0dd-97db202a55d7 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:41:55.471086 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bda761c8-bebc-4baa-a0dd-97db202a55d7 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:41:55.603684 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-bda761c8-bebc-4baa-a0dd-97db202a55d7 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:41:55.611678 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-bda761c8-bebc-4baa-a0dd-97db202a55d7 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58" status: 200 len: 1364 microversion: 2.1 time: 0.156109 Aug 27 03:41:55.612261 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3325/6604] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:41:55 2022] GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:41:56.632797 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b702c893-61b1-4090-8d43-d997c67d8387 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:41:56.633410 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b702c893-61b1-4090-8d43-d997c67d8387 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c3c1bec-8119-424c-84ad-682c05e27f58] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:41:56.641329 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b702c893-61b1-4090-8d43-d997c67d8387 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:41:56.641902 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b702c893-61b1-4090-8d43-d997c67d8387 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:41:56.642346 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b702c893-61b1-4090-8d43-d997c67d8387 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:41:56.643052 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b702c893-61b1-4090-8d43-d997c67d8387 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:41:56.643561 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b702c893-61b1-4090-8d43-d997c67d8387 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:41:56.643987 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b702c893-61b1-4090-8d43-d997c67d8387 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:41:56.774692 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b702c893-61b1-4090-8d43-d997c67d8387 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:41:56.783252 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b702c893-61b1-4090-8d43-d997c67d8387 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58" status: 200 len: 1364 microversion: 2.1 time: 0.154546 Aug 27 03:41:56.783838 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3280/6605] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:41:56 2022] GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58 => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:41:57.161969 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-4af66f4e-f12b-4deb-b974-24862e9dd228 req-81050d3d-3d56-4ae7-b5e7-96af87023307 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c3c1bec-8119-424c-84ad-682c05e27f58", "name": "network-vif-plugged", "status": "completed", "tag": "c4574914-6056-490c-94d6-b6cf22330712"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:41:57.173495 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-4af66f4e-f12b-4deb-b974-24862e9dd228 req-81050d3d-3d56-4ae7-b5e7-96af87023307 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:41:57.173997 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-4af66f4e-f12b-4deb-b974-24862e9dd228 req-81050d3d-3d56-4ae7-b5e7-96af87023307 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:41:57.174574 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-4af66f4e-f12b-4deb-b974-24862e9dd228 req-81050d3d-3d56-4ae7-b5e7-96af87023307 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:41:57.186069 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-4af66f4e-f12b-4deb-b974-24862e9dd228 req-81050d3d-3d56-4ae7-b5e7-96af87023307 service nova] Creating event network-vif-plugged:c4574914-6056-490c-94d6-b6cf22330712 for instance 2c3c1bec-8119-424c-84ad-682c05e27f58 on n-h1-852278-4 Aug 27 03:41:57.191529 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-4af66f4e-f12b-4deb-b974-24862e9dd228 req-81050d3d-3d56-4ae7-b5e7-96af87023307 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033365 Aug 27 03:41:57.192154 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3326/6606] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:41:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:41:57.809641 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c0412d07-32aa-4e67-8cfd-2095f78bb026 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:41:57.810655 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-c0412d07-32aa-4e67-8cfd-2095f78bb026 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c3c1bec-8119-424c-84ad-682c05e27f58] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:41:57.822416 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c0412d07-32aa-4e67-8cfd-2095f78bb026 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:41:57.823173 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c0412d07-32aa-4e67-8cfd-2095f78bb026 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:41:57.824125 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c0412d07-32aa-4e67-8cfd-2095f78bb026 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:41:57.825339 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c0412d07-32aa-4e67-8cfd-2095f78bb026 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:41:57.826094 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c0412d07-32aa-4e67-8cfd-2095f78bb026 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:41:57.826953 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c0412d07-32aa-4e67-8cfd-2095f78bb026 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:41:57.977253 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-c0412d07-32aa-4e67-8cfd-2095f78bb026 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:41:57.986467 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c0412d07-32aa-4e67-8cfd-2095f78bb026 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58" status: 200 len: 1364 microversion: 2.1 time: 0.183376 Aug 27 03:41:57.987066 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3281/6607] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:41:57 2022] GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58 => generated 1364 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:41:59.006851 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:41:59.007684 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=6 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:41:59.011979 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3494e87c-0eb6-4ec5-a883-d24ebcc489ee tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:41:59.012743 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-3494e87c-0eb6-4ec5-a883-d24ebcc489ee tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c3c1bec-8119-424c-84ad-682c05e27f58] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:41:59.020037 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3494e87c-0eb6-4ec5-a883-d24ebcc489ee tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:41:59.020578 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3494e87c-0eb6-4ec5-a883-d24ebcc489ee tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:41:59.021031 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3494e87c-0eb6-4ec5-a883-d24ebcc489ee tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:41:59.021739 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3494e87c-0eb6-4ec5-a883-d24ebcc489ee tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:41:59.022205 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3494e87c-0eb6-4ec5-a883-d24ebcc489ee tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:41:59.022644 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3494e87c-0eb6-4ec5-a883-d24ebcc489ee tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:41:59.168740 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-3494e87c-0eb6-4ec5-a883-d24ebcc489ee tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:41:59.177429 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-3494e87c-0eb6-4ec5-a883-d24ebcc489ee tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58" status: 200 len: 1549 microversion: 2.1 time: 0.172523 Aug 27 03:41:59.178015 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3327/6608] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:41:59 2022] GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58 => generated 1549 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:41:59.198498 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6f59b76c-df8c-41a0-b173-1990612ed0c1 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:41:59.199091 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-6f59b76c-df8c-41a0-b173-1990612ed0c1 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c3c1bec-8119-424c-84ad-682c05e27f58] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:41:59.200898 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:41:59.207002 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6f59b76c-df8c-41a0-b173-1990612ed0c1 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:41:59.207484 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6f59b76c-df8c-41a0-b173-1990612ed0c1 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:41:59.207916 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6f59b76c-df8c-41a0-b173-1990612ed0c1 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:41:59.208643 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6f59b76c-df8c-41a0-b173-1990612ed0c1 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:41:59.209131 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6f59b76c-df8c-41a0-b173-1990612ed0c1 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:41:59.209630 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6f59b76c-df8c-41a0-b173-1990612ed0c1 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:41:59.301672 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-6f59b76c-df8c-41a0-b173-1990612ed0c1 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.107137 Aug 27 03:41:59.302312 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3282/6609] 10.222.0.70 () {58 vars in 1275 bytes} [Sat Aug 27 03:41:59 2022] GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58/os-interface => generated 284 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:42:00.260256 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-5c8f7a47-5f99-4ca3-aa8a-52cf72c77389 req-0461faab-ffc3-40c2-a32c-756564bffc76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c3c1bec-8119-424c-84ad-682c05e27f58", "tag": "c4574914-6056-490c-94d6-b6cf22330712"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:42:00.270812 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-5c8f7a47-5f99-4ca3-aa8a-52cf72c77389 req-0461faab-ffc3-40c2-a32c-756564bffc76 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:42:00.271306 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-5c8f7a47-5f99-4ca3-aa8a-52cf72c77389 req-0461faab-ffc3-40c2-a32c-756564bffc76 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:42:00.271755 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-5c8f7a47-5f99-4ca3-aa8a-52cf72c77389 req-0461faab-ffc3-40c2-a32c-756564bffc76 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:42:00.283447 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-5c8f7a47-5f99-4ca3-aa8a-52cf72c77389 req-0461faab-ffc3-40c2-a32c-756564bffc76 service nova] Creating event network-changed:c4574914-6056-490c-94d6-b6cf22330712 for instance 2c3c1bec-8119-424c-84ad-682c05e27f58 on n-h1-852278-4 Aug 27 03:42:00.290167 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-5c8f7a47-5f99-4ca3-aa8a-52cf72c77389 req-0461faab-ffc3-40c2-a32c-756564bffc76 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033705 Aug 27 03:42:00.290983 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3328/6610] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:42:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:42:34.515794 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=25 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:42:34.516799 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=74 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:42:34.521579 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b9355d11-05f9-49f0-8c68-3628423256ee tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:42:34.522181 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b9355d11-05f9-49f0-8c68-3628423256ee tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c3c1bec-8119-424c-84ad-682c05e27f58] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:42:34.528941 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b9355d11-05f9-49f0-8c68-3628423256ee tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:42:34.529422 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b9355d11-05f9-49f0-8c68-3628423256ee tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:42:34.529853 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b9355d11-05f9-49f0-8c68-3628423256ee tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:42:34.530536 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b9355d11-05f9-49f0-8c68-3628423256ee tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:42:34.530982 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b9355d11-05f9-49f0-8c68-3628423256ee tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:42:34.531393 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b9355d11-05f9-49f0-8c68-3628423256ee tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:42:34.662868 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b9355d11-05f9-49f0-8c68-3628423256ee tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:42:34.671244 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b9355d11-05f9-49f0-8c68-3628423256ee tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58" status: 200 len: 1667 microversion: 2.1 time: 0.157476 Aug 27 03:42:34.672041 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3283/6611] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:42:34 2022] GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58 => generated 1667 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:42:34.690775 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:42:34.691592 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:42:34.695982 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-10157138-df23-4369-8afc-e9edd549672a tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f8b9b54b-4297-415e-920f-888cff2e9dd3"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:42:34.698452 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-10157138-df23-4369-8afc-e9edd549672a tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c3c1bec-8119-424c-84ad-682c05e27f58] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:42:34.705896 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-10157138-df23-4369-8afc-e9edd549672a tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:42:34.706384 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-10157138-df23-4369-8afc-e9edd549672a tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:42:34.706817 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-10157138-df23-4369-8afc-e9edd549672a tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:42:34.707526 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-10157138-df23-4369-8afc-e9edd549672a tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:42:34.707986 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-10157138-df23-4369-8afc-e9edd549672a tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:42:34.708446 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-10157138-df23-4369-8afc-e9edd549672a tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:42:35.009332 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-10157138-df23-4369-8afc-e9edd549672a tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "POST /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.320684 Aug 27 03:42:35.009966 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3329/6612] 10.222.0.70 () {60 vars in 1323 bytes} [Sat Aug 27 03:42:34 2022] POST /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58/os-volume_attachments => generated 194 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:42:46.810181 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d8a0ebdb-fdaf-4ce4-bcd0-13c22146973d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:42:46.812442 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d8a0ebdb-fdaf-4ce4-bcd0-13c22146973d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c3c1bec-8119-424c-84ad-682c05e27f58] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:42:46.818122 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:42:46.818892 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=6 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:42:46.822408 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d8a0ebdb-fdaf-4ce4-bcd0-13c22146973d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:42:46.822886 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d8a0ebdb-fdaf-4ce4-bcd0-13c22146973d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:42:46.823369 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d8a0ebdb-fdaf-4ce4-bcd0-13c22146973d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:42:46.824044 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d8a0ebdb-fdaf-4ce4-bcd0-13c22146973d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:42:46.824517 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d8a0ebdb-fdaf-4ce4-bcd0-13c22146973d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:42:46.824933 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d8a0ebdb-fdaf-4ce4-bcd0-13c22146973d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:42:46.854815 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-d8a0ebdb-fdaf-4ce4-bcd0-13c22146973d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:42:46.861420 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d8a0ebdb-fdaf-4ce4-bcd0-13c22146973d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c3c1bec-8119-424c-84ad-682c05e27f58] Old instance type m1.heat2, new instance type m1.heat {{(pid=134052) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 27 03:42:46.868449 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-d8a0ebdb-fdaf-4ce4-bcd0-13c22146973d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Flavor limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:42:46.868898 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-d8a0ebdb-fdaf-4ce4-bcd0-13c22146973d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Image limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:42:46.869363 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-d8a0ebdb-fdaf-4ce4-bcd0-13c22146973d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Flavor pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:42:46.869768 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-d8a0ebdb-fdaf-4ce4-bcd0-13c22146973d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Image pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:42:46.870168 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-d8a0ebdb-fdaf-4ce4-bcd0-13c22146973d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:42:46.941611 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d8a0ebdb-fdaf-4ce4-bcd0-13c22146973d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "POST /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58/action" status: 202 len: 0 microversion: 2.1 time: 0.135359 Aug 27 03:42:46.942260 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3284/6613] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:42:46 2022] POST /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:42:46.951275 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c4ef6641-f80f-4793-bb85-bd35beea3143 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:42:46.951980 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-c4ef6641-f80f-4793-bb85-bd35beea3143 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c3c1bec-8119-424c-84ad-682c05e27f58] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:42:46.954996 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:42:46.955670 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:42:46.961925 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c4ef6641-f80f-4793-bb85-bd35beea3143 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:42:46.962414 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c4ef6641-f80f-4793-bb85-bd35beea3143 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:42:46.962871 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c4ef6641-f80f-4793-bb85-bd35beea3143 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:42:46.963633 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c4ef6641-f80f-4793-bb85-bd35beea3143 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:42:46.964157 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c4ef6641-f80f-4793-bb85-bd35beea3143 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:42:46.964684 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c4ef6641-f80f-4793-bb85-bd35beea3143 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:42:47.132507 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-c4ef6641-f80f-4793-bb85-bd35beea3143 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:42:47.141675 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c4ef6641-f80f-4793-bb85-bd35beea3143 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58" status: 200 len: 1722 microversion: 2.1 time: 0.194685 Aug 27 03:42:47.142251 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3330/6614] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:42:46 2022] GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58 => generated 1722 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:42:48.167381 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0cc6ca3e-3098-46c1-82ff-2d7759cf2906 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:42:48.168609 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-0cc6ca3e-3098-46c1-82ff-2d7759cf2906 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c3c1bec-8119-424c-84ad-682c05e27f58] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:42:48.175536 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0cc6ca3e-3098-46c1-82ff-2d7759cf2906 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:42:48.176039 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0cc6ca3e-3098-46c1-82ff-2d7759cf2906 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:42:48.176480 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0cc6ca3e-3098-46c1-82ff-2d7759cf2906 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:42:48.177171 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0cc6ca3e-3098-46c1-82ff-2d7759cf2906 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:42:48.177618 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0cc6ca3e-3098-46c1-82ff-2d7759cf2906 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:42:48.178037 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0cc6ca3e-3098-46c1-82ff-2d7759cf2906 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:42:48.473466 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0cc6ca3e-3098-46c1-82ff-2d7759cf2906 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:42:48.482754 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-0cc6ca3e-3098-46c1-82ff-2d7759cf2906 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58" status: 200 len: 1722 microversion: 2.1 time: 0.323061 Aug 27 03:42:48.483355 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3285/6615] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:42:48 2022] GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58 => generated 1722 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:42:49.510588 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-bce8b493-d9dd-4611-8cf4-968315148e6d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:42:49.511667 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-bce8b493-d9dd-4611-8cf4-968315148e6d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c3c1bec-8119-424c-84ad-682c05e27f58] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:42:49.525504 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bce8b493-d9dd-4611-8cf4-968315148e6d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:42:49.526402 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bce8b493-d9dd-4611-8cf4-968315148e6d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:42:49.527221 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bce8b493-d9dd-4611-8cf4-968315148e6d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:42:49.528586 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bce8b493-d9dd-4611-8cf4-968315148e6d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:42:49.529459 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bce8b493-d9dd-4611-8cf4-968315148e6d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:42:49.530256 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bce8b493-d9dd-4611-8cf4-968315148e6d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:42:49.674756 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-bce8b493-d9dd-4611-8cf4-968315148e6d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:42:49.687723 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-bce8b493-d9dd-4611-8cf4-968315148e6d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58" status: 200 len: 1727 microversion: 2.1 time: 0.183605 Aug 27 03:42:49.688507 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3331/6616] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:42:49 2022] GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58 => generated 1727 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:42:50.714975 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-30d91bfb-95fa-44d1-bae8-dc4492c4d909 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:42:50.715956 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-30d91bfb-95fa-44d1-bae8-dc4492c4d909 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c3c1bec-8119-424c-84ad-682c05e27f58] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:42:50.726048 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-30d91bfb-95fa-44d1-bae8-dc4492c4d909 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:42:50.726570 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-30d91bfb-95fa-44d1-bae8-dc4492c4d909 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:42:50.727031 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-30d91bfb-95fa-44d1-bae8-dc4492c4d909 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:42:50.727732 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-30d91bfb-95fa-44d1-bae8-dc4492c4d909 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:42:50.728179 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-30d91bfb-95fa-44d1-bae8-dc4492c4d909 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:42:50.728657 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-30d91bfb-95fa-44d1-bae8-dc4492c4d909 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:42:50.866948 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-30d91bfb-95fa-44d1-bae8-dc4492c4d909 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:42:50.876868 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-30d91bfb-95fa-44d1-bae8-dc4492c4d909 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58" status: 200 len: 1727 microversion: 2.1 time: 0.168696 Aug 27 03:42:50.877800 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3286/6617] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:42:50 2022] GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58 => generated 1727 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:42:51.902258 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8ef1c732-accc-47b1-9177-2a5f6a6ed154 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:42:51.903316 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-8ef1c732-accc-47b1-9177-2a5f6a6ed154 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c3c1bec-8119-424c-84ad-682c05e27f58] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:42:51.913989 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8ef1c732-accc-47b1-9177-2a5f6a6ed154 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:42:51.914488 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8ef1c732-accc-47b1-9177-2a5f6a6ed154 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:42:51.914940 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8ef1c732-accc-47b1-9177-2a5f6a6ed154 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:42:51.915648 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8ef1c732-accc-47b1-9177-2a5f6a6ed154 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:42:51.916111 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8ef1c732-accc-47b1-9177-2a5f6a6ed154 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:42:51.916580 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8ef1c732-accc-47b1-9177-2a5f6a6ed154 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:42:52.054316 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-8ef1c732-accc-47b1-9177-2a5f6a6ed154 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:42:52.062822 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-8ef1c732-accc-47b1-9177-2a5f6a6ed154 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58" status: 200 len: 1727 microversion: 2.1 time: 0.167114 Aug 27 03:42:52.063400 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3332/6618] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:42:51 2022] GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58 => generated 1727 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:42:53.086940 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-87378b34-869a-4d9f-80e4-6a2da16369d8 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:42:53.087844 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-87378b34-869a-4d9f-80e4-6a2da16369d8 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c3c1bec-8119-424c-84ad-682c05e27f58] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:42:53.096769 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-87378b34-869a-4d9f-80e4-6a2da16369d8 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:42:53.097350 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-87378b34-869a-4d9f-80e4-6a2da16369d8 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:42:53.097864 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-87378b34-869a-4d9f-80e4-6a2da16369d8 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:42:53.098685 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-87378b34-869a-4d9f-80e4-6a2da16369d8 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:42:53.099215 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-87378b34-869a-4d9f-80e4-6a2da16369d8 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:42:53.099720 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-87378b34-869a-4d9f-80e4-6a2da16369d8 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:42:53.239656 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-87378b34-869a-4d9f-80e4-6a2da16369d8 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:42:53.248620 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-87378b34-869a-4d9f-80e4-6a2da16369d8 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58" status: 200 len: 1727 microversion: 2.1 time: 0.167005 Aug 27 03:42:53.249213 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3287/6619] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:42:53 2022] GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58 => generated 1727 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:42:54.274794 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8dfd84d0-a627-495c-adde-df4a1cca3267 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:42:54.275662 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-8dfd84d0-a627-495c-adde-df4a1cca3267 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c3c1bec-8119-424c-84ad-682c05e27f58] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:42:54.287219 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8dfd84d0-a627-495c-adde-df4a1cca3267 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:42:54.288096 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8dfd84d0-a627-495c-adde-df4a1cca3267 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:42:54.288863 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8dfd84d0-a627-495c-adde-df4a1cca3267 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:42:54.290044 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8dfd84d0-a627-495c-adde-df4a1cca3267 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:42:54.290829 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8dfd84d0-a627-495c-adde-df4a1cca3267 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:42:54.291579 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8dfd84d0-a627-495c-adde-df4a1cca3267 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:42:54.436810 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-8dfd84d0-a627-495c-adde-df4a1cca3267 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:42:54.445730 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-8dfd84d0-a627-495c-adde-df4a1cca3267 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58" status: 200 len: 1727 microversion: 2.1 time: 0.177907 Aug 27 03:42:54.446291 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3333/6620] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:42:54 2022] GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58 => generated 1727 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:42:55.471191 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-88644b22-ae55-4e85-b483-27cefee6a551 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:42:55.472160 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-88644b22-ae55-4e85-b483-27cefee6a551 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c3c1bec-8119-424c-84ad-682c05e27f58] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:42:55.480742 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-88644b22-ae55-4e85-b483-27cefee6a551 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:42:55.481227 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-88644b22-ae55-4e85-b483-27cefee6a551 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:42:55.481666 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-88644b22-ae55-4e85-b483-27cefee6a551 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:42:55.482365 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-88644b22-ae55-4e85-b483-27cefee6a551 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:42:55.482814 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-88644b22-ae55-4e85-b483-27cefee6a551 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:42:55.483235 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-88644b22-ae55-4e85-b483-27cefee6a551 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:42:55.630347 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-88644b22-ae55-4e85-b483-27cefee6a551 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:42:55.642762 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-88644b22-ae55-4e85-b483-27cefee6a551 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58" status: 200 len: 1727 microversion: 2.1 time: 0.178169 Aug 27 03:42:55.643441 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3288/6621] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:42:55 2022] GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58 => generated 1727 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:42:56.669093 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7182087c-b48d-4817-88a5-33fd2f4a75c6 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:42:56.670182 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-7182087c-b48d-4817-88a5-33fd2f4a75c6 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c3c1bec-8119-424c-84ad-682c05e27f58] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:42:56.680773 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7182087c-b48d-4817-88a5-33fd2f4a75c6 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:42:56.681269 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7182087c-b48d-4817-88a5-33fd2f4a75c6 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:42:56.681720 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7182087c-b48d-4817-88a5-33fd2f4a75c6 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:42:56.682432 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7182087c-b48d-4817-88a5-33fd2f4a75c6 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:42:56.682896 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7182087c-b48d-4817-88a5-33fd2f4a75c6 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:42:56.683334 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7182087c-b48d-4817-88a5-33fd2f4a75c6 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:42:56.828228 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-7182087c-b48d-4817-88a5-33fd2f4a75c6 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:42:56.837213 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-7182087c-b48d-4817-88a5-33fd2f4a75c6 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58" status: 200 len: 1727 microversion: 2.1 time: 0.174776 Aug 27 03:42:56.838008 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3334/6622] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:42:56 2022] GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58 => generated 1727 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:42:57.861717 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-7584b79d-69a4-40c1-ba3a-ce9321426672 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:42:57.862935 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-7584b79d-69a4-40c1-ba3a-ce9321426672 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c3c1bec-8119-424c-84ad-682c05e27f58] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:42:57.871641 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7584b79d-69a4-40c1-ba3a-ce9321426672 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:42:57.872121 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7584b79d-69a4-40c1-ba3a-ce9321426672 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:42:57.872583 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7584b79d-69a4-40c1-ba3a-ce9321426672 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:42:57.873276 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7584b79d-69a4-40c1-ba3a-ce9321426672 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:42:57.873718 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7584b79d-69a4-40c1-ba3a-ce9321426672 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:42:57.874143 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7584b79d-69a4-40c1-ba3a-ce9321426672 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:42:58.017795 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-7584b79d-69a4-40c1-ba3a-ce9321426672 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:42:58.026798 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-7584b79d-69a4-40c1-ba3a-ce9321426672 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58" status: 200 len: 1727 microversion: 2.1 time: 0.171768 Aug 27 03:42:58.027390 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3289/6623] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:42:57 2022] GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58 => generated 1727 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:42:59.106797 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-91ba1073-af69-430f-9f5e-8f9fae1147b8 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:42:59.107418 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-91ba1073-af69-430f-9f5e-8f9fae1147b8 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c3c1bec-8119-424c-84ad-682c05e27f58] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:42:59.113526 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-91ba1073-af69-430f-9f5e-8f9fae1147b8 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:42:59.114024 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-91ba1073-af69-430f-9f5e-8f9fae1147b8 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:42:59.114472 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-91ba1073-af69-430f-9f5e-8f9fae1147b8 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:42:59.115176 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-91ba1073-af69-430f-9f5e-8f9fae1147b8 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:42:59.115637 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-91ba1073-af69-430f-9f5e-8f9fae1147b8 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:42:59.116070 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-91ba1073-af69-430f-9f5e-8f9fae1147b8 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:42:59.251389 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-91ba1073-af69-430f-9f5e-8f9fae1147b8 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:42:59.260057 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-91ba1073-af69-430f-9f5e-8f9fae1147b8 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58" status: 200 len: 1727 microversion: 2.1 time: 0.215343 Aug 27 03:42:59.260671 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3335/6624] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:42:59 2022] GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58 => generated 1727 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:43:00.285607 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-1ab7ac84-786d-4456-a316-fa2f3bfa443b tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:43:00.286542 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-1ab7ac84-786d-4456-a316-fa2f3bfa443b tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c3c1bec-8119-424c-84ad-682c05e27f58] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:43:00.299223 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1ab7ac84-786d-4456-a316-fa2f3bfa443b tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:00.300263 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1ab7ac84-786d-4456-a316-fa2f3bfa443b tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:00.301019 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1ab7ac84-786d-4456-a316-fa2f3bfa443b tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:00.302265 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1ab7ac84-786d-4456-a316-fa2f3bfa443b tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:00.303203 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1ab7ac84-786d-4456-a316-fa2f3bfa443b tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:00.303917 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1ab7ac84-786d-4456-a316-fa2f3bfa443b tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:00.440853 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-1ab7ac84-786d-4456-a316-fa2f3bfa443b tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:43:00.451704 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-1ab7ac84-786d-4456-a316-fa2f3bfa443b tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58" status: 200 len: 1727 microversion: 2.1 time: 0.172952 Aug 27 03:43:00.452292 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3290/6625] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:43:00 2022] GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58 => generated 1727 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:43:01.475922 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-434474a2-6f9e-478e-a263-e836f24fd928 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:43:01.476566 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-434474a2-6f9e-478e-a263-e836f24fd928 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c3c1bec-8119-424c-84ad-682c05e27f58] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:43:01.483631 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-434474a2-6f9e-478e-a263-e836f24fd928 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:01.484137 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-434474a2-6f9e-478e-a263-e836f24fd928 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:01.484628 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-434474a2-6f9e-478e-a263-e836f24fd928 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:01.485341 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-434474a2-6f9e-478e-a263-e836f24fd928 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:01.485813 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-434474a2-6f9e-478e-a263-e836f24fd928 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:01.486255 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-434474a2-6f9e-478e-a263-e836f24fd928 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:01.663290 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-434474a2-6f9e-478e-a263-e836f24fd928 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:43:01.672705 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-434474a2-6f9e-478e-a263-e836f24fd928 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58" status: 200 len: 1727 microversion: 2.1 time: 0.203275 Aug 27 03:43:01.673438 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3336/6626] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:43:01 2022] GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58 => generated 1727 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:43:02.697176 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-549f1f09-5cc6-47dc-8fa2-3265c03c1bb8 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:43:02.697823 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-549f1f09-5cc6-47dc-8fa2-3265c03c1bb8 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c3c1bec-8119-424c-84ad-682c05e27f58] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:43:02.705612 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-549f1f09-5cc6-47dc-8fa2-3265c03c1bb8 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:02.706157 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-549f1f09-5cc6-47dc-8fa2-3265c03c1bb8 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:02.706631 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-549f1f09-5cc6-47dc-8fa2-3265c03c1bb8 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:02.707422 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-549f1f09-5cc6-47dc-8fa2-3265c03c1bb8 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:02.707928 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-549f1f09-5cc6-47dc-8fa2-3265c03c1bb8 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:02.708428 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-549f1f09-5cc6-47dc-8fa2-3265c03c1bb8 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:02.859240 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-549f1f09-5cc6-47dc-8fa2-3265c03c1bb8 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:43:02.867907 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-549f1f09-5cc6-47dc-8fa2-3265c03c1bb8 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58" status: 200 len: 1727 microversion: 2.1 time: 0.176263 Aug 27 03:43:02.868561 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3291/6627] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:43:02 2022] GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58 => generated 1727 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:43:03.890689 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d06d77df-ea91-49a0-8df2-845c4850b0c9 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:43:03.891284 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d06d77df-ea91-49a0-8df2-845c4850b0c9 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c3c1bec-8119-424c-84ad-682c05e27f58] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:43:03.899006 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d06d77df-ea91-49a0-8df2-845c4850b0c9 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:03.899504 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d06d77df-ea91-49a0-8df2-845c4850b0c9 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:03.899950 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d06d77df-ea91-49a0-8df2-845c4850b0c9 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:03.900706 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d06d77df-ea91-49a0-8df2-845c4850b0c9 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:03.901170 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d06d77df-ea91-49a0-8df2-845c4850b0c9 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:03.901604 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d06d77df-ea91-49a0-8df2-845c4850b0c9 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:04.036487 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d06d77df-ea91-49a0-8df2-845c4850b0c9 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:43:04.045119 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d06d77df-ea91-49a0-8df2-845c4850b0c9 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58" status: 200 len: 1727 microversion: 2.1 time: 0.158559 Aug 27 03:43:04.045681 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3337/6628] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:43:03 2022] GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58 => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:43:05.072490 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f599541b-37db-4ffd-acad-e3336957dc61 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:43:05.073275 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-f599541b-37db-4ffd-acad-e3336957dc61 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c3c1bec-8119-424c-84ad-682c05e27f58] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:43:05.081720 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f599541b-37db-4ffd-acad-e3336957dc61 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:05.082317 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f599541b-37db-4ffd-acad-e3336957dc61 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:05.082857 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f599541b-37db-4ffd-acad-e3336957dc61 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:05.083710 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f599541b-37db-4ffd-acad-e3336957dc61 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:05.084300 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f599541b-37db-4ffd-acad-e3336957dc61 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:05.084846 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f599541b-37db-4ffd-acad-e3336957dc61 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:05.229061 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-f599541b-37db-4ffd-acad-e3336957dc61 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:43:05.237972 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f599541b-37db-4ffd-acad-e3336957dc61 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58" status: 200 len: 1727 microversion: 2.1 time: 0.171571 Aug 27 03:43:05.238568 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3292/6629] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:43:05 2022] GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58 => generated 1727 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:43:06.259840 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4993a8f7-71bf-4ce8-80b0-72c9ac33d79a tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:43:06.260737 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-4993a8f7-71bf-4ce8-80b0-72c9ac33d79a tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c3c1bec-8119-424c-84ad-682c05e27f58] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:43:06.268595 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4993a8f7-71bf-4ce8-80b0-72c9ac33d79a tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:06.269311 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4993a8f7-71bf-4ce8-80b0-72c9ac33d79a tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:06.269776 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4993a8f7-71bf-4ce8-80b0-72c9ac33d79a tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:06.270504 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4993a8f7-71bf-4ce8-80b0-72c9ac33d79a tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:06.271433 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4993a8f7-71bf-4ce8-80b0-72c9ac33d79a tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:06.271896 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4993a8f7-71bf-4ce8-80b0-72c9ac33d79a tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:06.410467 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-4993a8f7-71bf-4ce8-80b0-72c9ac33d79a tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:43:06.419204 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-4993a8f7-71bf-4ce8-80b0-72c9ac33d79a tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58" status: 200 len: 1727 microversion: 2.1 time: 0.163584 Aug 27 03:43:06.420059 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3338/6630] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:43:06 2022] GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58 => generated 1727 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:43:07.441277 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b66f97cc-8a35-42e2-abc0-36f9fbd6bcc4 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:43:07.441867 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b66f97cc-8a35-42e2-abc0-36f9fbd6bcc4 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c3c1bec-8119-424c-84ad-682c05e27f58] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:43:07.449423 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b66f97cc-8a35-42e2-abc0-36f9fbd6bcc4 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:07.449911 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b66f97cc-8a35-42e2-abc0-36f9fbd6bcc4 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:07.450378 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b66f97cc-8a35-42e2-abc0-36f9fbd6bcc4 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:07.451072 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b66f97cc-8a35-42e2-abc0-36f9fbd6bcc4 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:07.451520 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b66f97cc-8a35-42e2-abc0-36f9fbd6bcc4 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:07.451938 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b66f97cc-8a35-42e2-abc0-36f9fbd6bcc4 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:07.583640 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b66f97cc-8a35-42e2-abc0-36f9fbd6bcc4 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:43:07.592435 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b66f97cc-8a35-42e2-abc0-36f9fbd6bcc4 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58" status: 200 len: 1727 microversion: 2.1 time: 0.155036 Aug 27 03:43:07.593026 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3293/6631] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:43:07 2022] GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:43:08.607742 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-e0e8a124-d9fa-462d-b7a6-489084363053 req-db8e5fe7-33e6-4aeb-9376-13ee2ac8db5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c3c1bec-8119-424c-84ad-682c05e27f58", "name": "network-vif-unplugged", "status": "completed", "tag": "c4574914-6056-490c-94d6-b6cf22330712"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:43:08.615510 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3bcbe447-4383-4a41-bcfd-cebafad47c84 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:43:08.616230 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-3bcbe447-4383-4a41-bcfd-cebafad47c84 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c3c1bec-8119-424c-84ad-682c05e27f58] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:43:08.619326 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-e0e8a124-d9fa-462d-b7a6-489084363053 req-db8e5fe7-33e6-4aeb-9376-13ee2ac8db5c service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:08.619815 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-e0e8a124-d9fa-462d-b7a6-489084363053 req-db8e5fe7-33e6-4aeb-9376-13ee2ac8db5c service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:08.620247 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-e0e8a124-d9fa-462d-b7a6-489084363053 req-db8e5fe7-33e6-4aeb-9376-13ee2ac8db5c service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:08.626428 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3bcbe447-4383-4a41-bcfd-cebafad47c84 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:08.626928 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3bcbe447-4383-4a41-bcfd-cebafad47c84 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:08.627444 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3bcbe447-4383-4a41-bcfd-cebafad47c84 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:08.628287 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3bcbe447-4383-4a41-bcfd-cebafad47c84 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:08.628954 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3bcbe447-4383-4a41-bcfd-cebafad47c84 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:08.629383 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3bcbe447-4383-4a41-bcfd-cebafad47c84 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:08.633329 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-e0e8a124-d9fa-462d-b7a6-489084363053 req-db8e5fe7-33e6-4aeb-9376-13ee2ac8db5c service nova] Creating event network-vif-unplugged:c4574914-6056-490c-94d6-b6cf22330712 for instance 2c3c1bec-8119-424c-84ad-682c05e27f58 on n-h2-852278-4 Aug 27 03:43:08.639241 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [req-e0e8a124-d9fa-462d-b7a6-489084363053 req-db8e5fe7-33e6-4aeb-9376-13ee2ac8db5c service nova] Instance 2c3c1bec-8119-424c-84ad-682c05e27f58 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-852278-4', 'n-h1-852278-4'} {{(pid=134051) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 03:43:08.650556 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-e0e8a124-d9fa-462d-b7a6-489084363053 req-db8e5fe7-33e6-4aeb-9376-13ee2ac8db5c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046757 Aug 27 03:43:08.651494 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3339/6632] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:43:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:43:08.886387 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-3bcbe447-4383-4a41-bcfd-cebafad47c84 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:43:08.895248 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-3bcbe447-4383-4a41-bcfd-cebafad47c84 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58" status: 200 len: 1726 microversion: 2.1 time: 0.284934 Aug 27 03:43:08.895846 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3294/6633] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:43:08 2022] GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58 => generated 1726 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:43:09.918577 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a6cc1f62-4e12-4bd5-b992-6d77100fb9c9 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:43:09.919258 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-a6cc1f62-4e12-4bd5-b992-6d77100fb9c9 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c3c1bec-8119-424c-84ad-682c05e27f58] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:43:09.926912 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a6cc1f62-4e12-4bd5-b992-6d77100fb9c9 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:09.927417 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a6cc1f62-4e12-4bd5-b992-6d77100fb9c9 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:09.927866 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a6cc1f62-4e12-4bd5-b992-6d77100fb9c9 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:09.928696 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a6cc1f62-4e12-4bd5-b992-6d77100fb9c9 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:09.929143 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a6cc1f62-4e12-4bd5-b992-6d77100fb9c9 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:09.929580 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a6cc1f62-4e12-4bd5-b992-6d77100fb9c9 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:10.065022 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-a6cc1f62-4e12-4bd5-b992-6d77100fb9c9 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:43:10.074039 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a6cc1f62-4e12-4bd5-b992-6d77100fb9c9 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58" status: 200 len: 1724 microversion: 2.1 time: 0.160834 Aug 27 03:43:10.074716 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3340/6634] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:43:09 2022] GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:43:10.673085 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-0c40f66f-7fd4-4b50-ae9b-c7560ad19ec9 req-871ba9ef-50c4-4b97-857b-7373b3a4e4bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c3c1bec-8119-424c-84ad-682c05e27f58", "tag": "c4574914-6056-490c-94d6-b6cf22330712"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:43:10.683701 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-0c40f66f-7fd4-4b50-ae9b-c7560ad19ec9 req-871ba9ef-50c4-4b97-857b-7373b3a4e4bf service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:10.684208 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-0c40f66f-7fd4-4b50-ae9b-c7560ad19ec9 req-871ba9ef-50c4-4b97-857b-7373b3a4e4bf service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:10.684658 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-0c40f66f-7fd4-4b50-ae9b-c7560ad19ec9 req-871ba9ef-50c4-4b97-857b-7373b3a4e4bf service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:10.697257 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-0c40f66f-7fd4-4b50-ae9b-c7560ad19ec9 req-871ba9ef-50c4-4b97-857b-7373b3a4e4bf service nova] Creating event network-changed:c4574914-6056-490c-94d6-b6cf22330712 for instance 2c3c1bec-8119-424c-84ad-682c05e27f58 on n-h2-852278-4 Aug 27 03:43:10.702931 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [req-0c40f66f-7fd4-4b50-ae9b-c7560ad19ec9 req-871ba9ef-50c4-4b97-857b-7373b3a4e4bf service nova] Instance 2c3c1bec-8119-424c-84ad-682c05e27f58 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-852278-4', 'n-h1-852278-4'} {{(pid=134052) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 03:43:10.714622 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-0c40f66f-7fd4-4b50-ae9b-c7560ad19ec9 req-871ba9ef-50c4-4b97-857b-7373b3a4e4bf service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045763 Aug 27 03:43:10.715237 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3295/6635] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:43:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:43:11.095718 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8350581b-796c-444b-aed2-da777e0c5d53 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:43:11.096691 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-8350581b-796c-444b-aed2-da777e0c5d53 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c3c1bec-8119-424c-84ad-682c05e27f58] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:43:11.104802 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8350581b-796c-444b-aed2-da777e0c5d53 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:11.105468 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8350581b-796c-444b-aed2-da777e0c5d53 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:11.106116 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8350581b-796c-444b-aed2-da777e0c5d53 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:11.106901 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8350581b-796c-444b-aed2-da777e0c5d53 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:11.107385 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8350581b-796c-444b-aed2-da777e0c5d53 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:11.107965 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8350581b-796c-444b-aed2-da777e0c5d53 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:11.402373 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-8350581b-796c-444b-aed2-da777e0c5d53 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:43:11.417567 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-8350581b-796c-444b-aed2-da777e0c5d53 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58" status: 200 len: 1724 microversion: 2.1 time: 0.326082 Aug 27 03:43:11.418727 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3341/6636] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:43:11 2022] GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58 => generated 1724 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:43:12.441500 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b1876404-f7e9-4fb9-b813-edd2f88412fd tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:43:12.442191 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b1876404-f7e9-4fb9-b813-edd2f88412fd tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c3c1bec-8119-424c-84ad-682c05e27f58] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:43:12.449089 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b1876404-f7e9-4fb9-b813-edd2f88412fd tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:12.449571 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b1876404-f7e9-4fb9-b813-edd2f88412fd tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:12.450000 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b1876404-f7e9-4fb9-b813-edd2f88412fd tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:12.450676 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b1876404-f7e9-4fb9-b813-edd2f88412fd tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:12.451119 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b1876404-f7e9-4fb9-b813-edd2f88412fd tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:12.451533 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b1876404-f7e9-4fb9-b813-edd2f88412fd tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:12.590780 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b1876404-f7e9-4fb9-b813-edd2f88412fd tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:43:12.600928 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b1876404-f7e9-4fb9-b813-edd2f88412fd tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58" status: 200 len: 1724 microversion: 2.1 time: 0.164697 Aug 27 03:43:12.601530 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3296/6637] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:43:12 2022] GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:43:13.622537 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-11e63241-a101-415b-98c8-047eac7c908d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:43:13.623217 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-11e63241-a101-415b-98c8-047eac7c908d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c3c1bec-8119-424c-84ad-682c05e27f58] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:43:13.630664 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-11e63241-a101-415b-98c8-047eac7c908d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:13.631168 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-11e63241-a101-415b-98c8-047eac7c908d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:13.631624 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-11e63241-a101-415b-98c8-047eac7c908d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:13.632346 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-11e63241-a101-415b-98c8-047eac7c908d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:13.632843 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-11e63241-a101-415b-98c8-047eac7c908d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:13.633286 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-11e63241-a101-415b-98c8-047eac7c908d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:13.770419 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-11e63241-a101-415b-98c8-047eac7c908d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:43:13.779301 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-11e63241-a101-415b-98c8-047eac7c908d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58" status: 200 len: 1724 microversion: 2.1 time: 0.160810 Aug 27 03:43:13.779920 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3342/6638] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:43:13 2022] GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:43:14.806189 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-dd07d695-fa2f-4f91-b73a-1b92437df1f0 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:43:14.807170 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-dd07d695-fa2f-4f91-b73a-1b92437df1f0 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c3c1bec-8119-424c-84ad-682c05e27f58] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:43:14.818708 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dd07d695-fa2f-4f91-b73a-1b92437df1f0 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:14.819561 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dd07d695-fa2f-4f91-b73a-1b92437df1f0 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:14.820241 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dd07d695-fa2f-4f91-b73a-1b92437df1f0 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:14.821181 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dd07d695-fa2f-4f91-b73a-1b92437df1f0 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:14.821626 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dd07d695-fa2f-4f91-b73a-1b92437df1f0 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:14.822043 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dd07d695-fa2f-4f91-b73a-1b92437df1f0 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:14.964216 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-dd07d695-fa2f-4f91-b73a-1b92437df1f0 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:43:14.973049 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-dd07d695-fa2f-4f91-b73a-1b92437df1f0 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58" status: 200 len: 1724 microversion: 2.1 time: 0.173654 Aug 27 03:43:14.973644 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3297/6639] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:43:14 2022] GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58 => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:43:15.997218 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-11804f1a-ab34-4f80-9880-ea7ef304b742 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:43:15.997776 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-11804f1a-ab34-4f80-9880-ea7ef304b742 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c3c1bec-8119-424c-84ad-682c05e27f58] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:43:16.005363 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-11804f1a-ab34-4f80-9880-ea7ef304b742 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:16.005870 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-11804f1a-ab34-4f80-9880-ea7ef304b742 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:16.006334 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-11804f1a-ab34-4f80-9880-ea7ef304b742 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:16.007056 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-11804f1a-ab34-4f80-9880-ea7ef304b742 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:16.007529 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-11804f1a-ab34-4f80-9880-ea7ef304b742 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:16.007972 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-11804f1a-ab34-4f80-9880-ea7ef304b742 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:16.153782 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-11804f1a-ab34-4f80-9880-ea7ef304b742 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:43:16.163026 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-11804f1a-ab34-4f80-9880-ea7ef304b742 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58" status: 200 len: 1724 microversion: 2.1 time: 0.170539 Aug 27 03:43:16.163616 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3343/6640] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:43:15 2022] GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:43:17.189663 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0bf8e961-367b-4058-b509-be8ffe092204 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:43:17.190556 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-0bf8e961-367b-4058-b509-be8ffe092204 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c3c1bec-8119-424c-84ad-682c05e27f58] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:43:17.195050 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=33 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:43:17.201866 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0bf8e961-367b-4058-b509-be8ffe092204 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:17.202351 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0bf8e961-367b-4058-b509-be8ffe092204 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:17.202784 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0bf8e961-367b-4058-b509-be8ffe092204 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:17.203478 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0bf8e961-367b-4058-b509-be8ffe092204 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:17.203927 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0bf8e961-367b-4058-b509-be8ffe092204 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:17.204507 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0bf8e961-367b-4058-b509-be8ffe092204 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:17.207249 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:43:17.345402 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0bf8e961-367b-4058-b509-be8ffe092204 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:43:17.354147 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-0bf8e961-367b-4058-b509-be8ffe092204 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58" status: 200 len: 1724 microversion: 2.1 time: 0.171407 Aug 27 03:43:17.354793 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3298/6641] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:43:17 2022] GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58 => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:43:18.377577 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-edd1a66c-9a3b-411b-8cc9-9bae6c49ec4f tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:43:18.378313 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-edd1a66c-9a3b-411b-8cc9-9bae6c49ec4f tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c3c1bec-8119-424c-84ad-682c05e27f58] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:43:18.381816 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=29 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:43:18.388715 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-edd1a66c-9a3b-411b-8cc9-9bae6c49ec4f tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:18.389342 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-edd1a66c-9a3b-411b-8cc9-9bae6c49ec4f tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:18.389892 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-edd1a66c-9a3b-411b-8cc9-9bae6c49ec4f tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:18.390787 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-edd1a66c-9a3b-411b-8cc9-9bae6c49ec4f tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:18.391383 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-edd1a66c-9a3b-411b-8cc9-9bae6c49ec4f tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:18.391935 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-edd1a66c-9a3b-411b-8cc9-9bae6c49ec4f tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:18.395488 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=83 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:43:18.488402 n-d-852278-4 devstack@n-api.service[134051]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:43:18.488607 n-d-852278-4 devstack@n-api.service[134051]: Sat Aug 27 03:43:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58 (ip 10.222.0.70) !!! Aug 27 03:43:18.537389 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-edd1a66c-9a3b-411b-8cc9-9bae6c49ec4f tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:43:18.546304 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-edd1a66c-9a3b-411b-8cc9-9bae6c49ec4f tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58" status: 200 len: 1724 microversion: 2.1 time: 0.173558 Aug 27 03:43:18.546875 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3344/6642] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:43:18 2022] GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58 => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:43:19.571188 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-31adaea7-d8bd-47b5-9a2e-2c37f52e1d0d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:43:19.572233 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-31adaea7-d8bd-47b5-9a2e-2c37f52e1d0d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c3c1bec-8119-424c-84ad-682c05e27f58] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:43:19.580265 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-31adaea7-d8bd-47b5-9a2e-2c37f52e1d0d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:19.580781 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-31adaea7-d8bd-47b5-9a2e-2c37f52e1d0d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:19.581211 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-31adaea7-d8bd-47b5-9a2e-2c37f52e1d0d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:19.581895 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-31adaea7-d8bd-47b5-9a2e-2c37f52e1d0d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:19.582337 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-31adaea7-d8bd-47b5-9a2e-2c37f52e1d0d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:19.582892 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-31adaea7-d8bd-47b5-9a2e-2c37f52e1d0d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:19.726376 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-31adaea7-d8bd-47b5-9a2e-2c37f52e1d0d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:43:19.735263 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-31adaea7-d8bd-47b5-9a2e-2c37f52e1d0d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58" status: 200 len: 1724 microversion: 2.1 time: 0.170630 Aug 27 03:43:19.735842 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3299/6643] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:43:19 2022] GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:43:20.761041 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-6e98bc7a-87e0-4eda-8c71-5c59bc52db01 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:43:20.762064 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-6e98bc7a-87e0-4eda-8c71-5c59bc52db01 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c3c1bec-8119-424c-84ad-682c05e27f58] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:43:20.774078 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6e98bc7a-87e0-4eda-8c71-5c59bc52db01 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:20.774926 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6e98bc7a-87e0-4eda-8c71-5c59bc52db01 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:20.775672 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6e98bc7a-87e0-4eda-8c71-5c59bc52db01 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:20.776858 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6e98bc7a-87e0-4eda-8c71-5c59bc52db01 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:20.777614 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6e98bc7a-87e0-4eda-8c71-5c59bc52db01 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:20.778051 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6e98bc7a-87e0-4eda-8c71-5c59bc52db01 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:20.917625 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-6e98bc7a-87e0-4eda-8c71-5c59bc52db01 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:43:20.928735 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-6e98bc7a-87e0-4eda-8c71-5c59bc52db01 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58" status: 200 len: 1724 microversion: 2.1 time: 0.174224 Aug 27 03:43:20.929598 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3345/6644] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:43:20 2022] GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58 => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:43:21.950164 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-adf9f819-8258-4cc7-9501-7d723f13cac7 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:43:21.950713 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-adf9f819-8258-4cc7-9501-7d723f13cac7 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c3c1bec-8119-424c-84ad-682c05e27f58] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:43:21.957760 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-adf9f819-8258-4cc7-9501-7d723f13cac7 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:21.958240 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-adf9f819-8258-4cc7-9501-7d723f13cac7 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:21.958674 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-adf9f819-8258-4cc7-9501-7d723f13cac7 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:21.959379 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-adf9f819-8258-4cc7-9501-7d723f13cac7 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:21.959821 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-adf9f819-8258-4cc7-9501-7d723f13cac7 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:21.960233 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-adf9f819-8258-4cc7-9501-7d723f13cac7 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:22.453032 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-adf9f819-8258-4cc7-9501-7d723f13cac7 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:43:22.462441 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-adf9f819-8258-4cc7-9501-7d723f13cac7 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58" status: 200 len: 1721 microversion: 2.1 time: 0.516384 Aug 27 03:43:22.463363 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3300/6645] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:43:21 2022] GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58 => generated 1721 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:43:22.489811 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-bac49f1b-6c2a-4224-a5c0-7c7ff769fca0 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:43:22.490330 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-bac49f1b-6c2a-4224-a5c0-7c7ff769fca0 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c3c1bec-8119-424c-84ad-682c05e27f58] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:43:22.497590 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bac49f1b-6c2a-4224-a5c0-7c7ff769fca0 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:22.498094 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bac49f1b-6c2a-4224-a5c0-7c7ff769fca0 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:22.498551 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bac49f1b-6c2a-4224-a5c0-7c7ff769fca0 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:22.499267 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bac49f1b-6c2a-4224-a5c0-7c7ff769fca0 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:22.499740 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bac49f1b-6c2a-4224-a5c0-7c7ff769fca0 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:22.500189 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bac49f1b-6c2a-4224-a5c0-7c7ff769fca0 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:22.548129 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bac49f1b-6c2a-4224-a5c0-7c7ff769fca0 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:22.548646 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bac49f1b-6c2a-4224-a5c0-7c7ff769fca0 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:22.549101 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bac49f1b-6c2a-4224-a5c0-7c7ff769fca0 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:22.549846 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bac49f1b-6c2a-4224-a5c0-7c7ff769fca0 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:22.550313 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bac49f1b-6c2a-4224-a5c0-7c7ff769fca0 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:22.550754 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bac49f1b-6c2a-4224-a5c0-7c7ff769fca0 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:22.571499 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-bac49f1b-6c2a-4224-a5c0-7c7ff769fca0 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Getting quotas for project cc3aa9846bcb40518ac54e31208ce043. Resources: {'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:43:22.576801 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-bac49f1b-6c2a-4224-a5c0-7c7ff769fca0 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Getting quotas for user c62665fa43c34e6eb695633905cf3b84 and project cc3aa9846bcb40518ac54e31208ce043. Resources: {'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:43:22.691812 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-bac49f1b-6c2a-4224-a5c0-7c7ff769fca0 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "POST /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58/action" status: 202 len: 0 microversion: 2.1 time: 0.205724 Aug 27 03:43:22.692448 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3346/6646] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:43:22 2022] POST /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58/action => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:43:22.702627 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-2005db8b-dac9-4468-bb26-343bb823995d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:43:22.703327 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-2005db8b-dac9-4468-bb26-343bb823995d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c3c1bec-8119-424c-84ad-682c05e27f58] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:43:22.709588 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2005db8b-dac9-4468-bb26-343bb823995d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:22.710041 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2005db8b-dac9-4468-bb26-343bb823995d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:22.710473 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2005db8b-dac9-4468-bb26-343bb823995d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:22.711174 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2005db8b-dac9-4468-bb26-343bb823995d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:22.711630 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2005db8b-dac9-4468-bb26-343bb823995d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:22.712033 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2005db8b-dac9-4468-bb26-343bb823995d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:22.943752 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-2005db8b-dac9-4468-bb26-343bb823995d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:43:22.952599 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-2005db8b-dac9-4468-bb26-343bb823995d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58" status: 200 len: 1720 microversion: 2.1 time: 0.253767 Aug 27 03:43:22.953521 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3301/6647] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:43:22 2022] GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58 => generated 1720 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:43:23.979514 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4750ed0d-1c1e-4c97-9111-8de88160a3c7 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:43:23.980343 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-4750ed0d-1c1e-4c97-9111-8de88160a3c7 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c3c1bec-8119-424c-84ad-682c05e27f58] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:43:23.990882 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4750ed0d-1c1e-4c97-9111-8de88160a3c7 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:23.991404 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4750ed0d-1c1e-4c97-9111-8de88160a3c7 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:23.991862 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4750ed0d-1c1e-4c97-9111-8de88160a3c7 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:23.992581 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4750ed0d-1c1e-4c97-9111-8de88160a3c7 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:23.993216 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4750ed0d-1c1e-4c97-9111-8de88160a3c7 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:23.993657 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4750ed0d-1c1e-4c97-9111-8de88160a3c7 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:24.131445 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-4750ed0d-1c1e-4c97-9111-8de88160a3c7 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:43:24.140031 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-4750ed0d-1c1e-4c97-9111-8de88160a3c7 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58" status: 200 len: 1720 microversion: 2.1 time: 0.165927 Aug 27 03:43:24.144636 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3347/6648] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:43:23 2022] GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58 => generated 1720 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:43:25.165781 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-18056c35-7c4e-498b-935c-766ee27c22a1 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:43:25.166874 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-18056c35-7c4e-498b-935c-766ee27c22a1 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c3c1bec-8119-424c-84ad-682c05e27f58] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:43:25.178726 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-18056c35-7c4e-498b-935c-766ee27c22a1 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:25.179618 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-18056c35-7c4e-498b-935c-766ee27c22a1 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:25.180297 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-18056c35-7c4e-498b-935c-766ee27c22a1 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:25.181481 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-18056c35-7c4e-498b-935c-766ee27c22a1 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:25.182219 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-18056c35-7c4e-498b-935c-766ee27c22a1 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:25.182915 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-18056c35-7c4e-498b-935c-766ee27c22a1 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:25.327944 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-18056c35-7c4e-498b-935c-766ee27c22a1 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:43:25.339645 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-18056c35-7c4e-498b-935c-766ee27c22a1 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58" status: 200 len: 1720 microversion: 2.1 time: 0.180155 Aug 27 03:43:25.340594 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3302/6649] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:43:25 2022] GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58 => generated 1720 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:43:25.786804 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-22844a7d-2b86-48dd-b2b4-4d29973916e8 req-9f1906af-3284-4f73-a2ad-957f96baabb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c3c1bec-8119-424c-84ad-682c05e27f58", "name": "network-vif-plugged", "status": "completed", "tag": "c4574914-6056-490c-94d6-b6cf22330712"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:43:25.798866 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-22844a7d-2b86-48dd-b2b4-4d29973916e8 req-9f1906af-3284-4f73-a2ad-957f96baabb2 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:25.799590 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-22844a7d-2b86-48dd-b2b4-4d29973916e8 req-9f1906af-3284-4f73-a2ad-957f96baabb2 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:25.800047 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-22844a7d-2b86-48dd-b2b4-4d29973916e8 req-9f1906af-3284-4f73-a2ad-957f96baabb2 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:25.812887 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-22844a7d-2b86-48dd-b2b4-4d29973916e8 req-9f1906af-3284-4f73-a2ad-957f96baabb2 service nova] Creating event network-vif-plugged:c4574914-6056-490c-94d6-b6cf22330712 for instance 2c3c1bec-8119-424c-84ad-682c05e27f58 on n-h2-852278-4 Aug 27 03:43:25.818695 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [req-22844a7d-2b86-48dd-b2b4-4d29973916e8 req-9f1906af-3284-4f73-a2ad-957f96baabb2 service nova] Instance 2c3c1bec-8119-424c-84ad-682c05e27f58 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-852278-4', 'n-h1-852278-4'} {{(pid=134051) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 03:43:25.830340 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-22844a7d-2b86-48dd-b2b4-4d29973916e8 req-9f1906af-3284-4f73-a2ad-957f96baabb2 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048157 Aug 27 03:43:25.831294 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3348/6650] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:43:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:43:26.361972 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-7c0ee1a3-109a-40d0-83ff-0e1c81ee01df tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:43:26.362775 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-7c0ee1a3-109a-40d0-83ff-0e1c81ee01df tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c3c1bec-8119-424c-84ad-682c05e27f58] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:43:26.370202 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7c0ee1a3-109a-40d0-83ff-0e1c81ee01df tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:26.370800 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7c0ee1a3-109a-40d0-83ff-0e1c81ee01df tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:26.371631 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7c0ee1a3-109a-40d0-83ff-0e1c81ee01df tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:26.372404 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7c0ee1a3-109a-40d0-83ff-0e1c81ee01df tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:26.372856 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7c0ee1a3-109a-40d0-83ff-0e1c81ee01df tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:26.373276 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7c0ee1a3-109a-40d0-83ff-0e1c81ee01df tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:26.506107 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-7c0ee1a3-109a-40d0-83ff-0e1c81ee01df tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:43:26.515558 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-7c0ee1a3-109a-40d0-83ff-0e1c81ee01df tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58" status: 200 len: 1720 microversion: 2.1 time: 0.157419 Aug 27 03:43:26.516188 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3303/6651] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:43:26 2022] GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58 => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:43:27.538954 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-5d40e347-9391-4931-88a1-cf6bdae87d8e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:43:27.539650 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-5d40e347-9391-4931-88a1-cf6bdae87d8e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c3c1bec-8119-424c-84ad-682c05e27f58] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:43:27.546572 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5d40e347-9391-4931-88a1-cf6bdae87d8e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:27.547077 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5d40e347-9391-4931-88a1-cf6bdae87d8e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:27.547534 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5d40e347-9391-4931-88a1-cf6bdae87d8e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:27.548269 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5d40e347-9391-4931-88a1-cf6bdae87d8e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:27.548773 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5d40e347-9391-4931-88a1-cf6bdae87d8e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:27.549215 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5d40e347-9391-4931-88a1-cf6bdae87d8e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:27.692798 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-5d40e347-9391-4931-88a1-cf6bdae87d8e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:43:27.706334 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-5d40e347-9391-4931-88a1-cf6bdae87d8e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58" status: 200 len: 1720 microversion: 2.1 time: 0.172433 Aug 27 03:43:27.706974 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3349/6652] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:43:27 2022] GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58 => generated 1720 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:43:28.728051 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9a906092-02ea-4d9b-9b34-905d7ca38759 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:43:28.728627 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-9a906092-02ea-4d9b-9b34-905d7ca38759 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c3c1bec-8119-424c-84ad-682c05e27f58] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:43:28.735918 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9a906092-02ea-4d9b-9b34-905d7ca38759 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:28.737796 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9a906092-02ea-4d9b-9b34-905d7ca38759 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:28.738712 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9a906092-02ea-4d9b-9b34-905d7ca38759 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:28.739427 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9a906092-02ea-4d9b-9b34-905d7ca38759 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:28.739883 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9a906092-02ea-4d9b-9b34-905d7ca38759 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:28.740319 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9a906092-02ea-4d9b-9b34-905d7ca38759 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:28.743746 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-6b1aad28-ac13-4641-b873-372a7f414705 req-65dac3b1-f865-4513-87ce-d3efc6bee987 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c3c1bec-8119-424c-84ad-682c05e27f58", "name": "network-vif-unplugged", "status": "completed", "tag": "c4574914-6056-490c-94d6-b6cf22330712"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:43:28.755075 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-6b1aad28-ac13-4641-b873-372a7f414705 req-65dac3b1-f865-4513-87ce-d3efc6bee987 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:28.755899 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-6b1aad28-ac13-4641-b873-372a7f414705 req-65dac3b1-f865-4513-87ce-d3efc6bee987 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:28.756791 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-6b1aad28-ac13-4641-b873-372a7f414705 req-65dac3b1-f865-4513-87ce-d3efc6bee987 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:28.769895 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-6b1aad28-ac13-4641-b873-372a7f414705 req-65dac3b1-f865-4513-87ce-d3efc6bee987 service nova] Creating event network-vif-unplugged:c4574914-6056-490c-94d6-b6cf22330712 for instance 2c3c1bec-8119-424c-84ad-682c05e27f58 on n-h1-852278-4 Aug 27 03:43:28.775907 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [req-6b1aad28-ac13-4641-b873-372a7f414705 req-65dac3b1-f865-4513-87ce-d3efc6bee987 service nova] Instance 2c3c1bec-8119-424c-84ad-682c05e27f58 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-852278-4', 'n-h1-852278-4'} {{(pid=134051) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 03:43:28.786579 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-6b1aad28-ac13-4641-b873-372a7f414705 req-65dac3b1-f865-4513-87ce-d3efc6bee987 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046770 Aug 27 03:43:28.787211 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3350/6653] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:43:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:43:29.018666 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-9a906092-02ea-4d9b-9b34-905d7ca38759 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:43:29.027553 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9a906092-02ea-4d9b-9b34-905d7ca38759 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58" status: 200 len: 1720 microversion: 2.1 time: 0.303513 Aug 27 03:43:29.028148 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3304/6654] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:43:28 2022] GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58 => generated 1720 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:43:30.050935 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8befcc5e-37c7-45a9-a1bb-f079695d9dfd tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:43:30.051641 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-8befcc5e-37c7-45a9-a1bb-f079695d9dfd tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c3c1bec-8119-424c-84ad-682c05e27f58] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:43:30.058503 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8befcc5e-37c7-45a9-a1bb-f079695d9dfd tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:30.058943 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8befcc5e-37c7-45a9-a1bb-f079695d9dfd tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:30.059395 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8befcc5e-37c7-45a9-a1bb-f079695d9dfd tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:30.060118 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8befcc5e-37c7-45a9-a1bb-f079695d9dfd tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:30.060621 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8befcc5e-37c7-45a9-a1bb-f079695d9dfd tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:30.061058 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8befcc5e-37c7-45a9-a1bb-f079695d9dfd tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:30.195456 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-8befcc5e-37c7-45a9-a1bb-f079695d9dfd tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:43:30.204336 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-8befcc5e-37c7-45a9-a1bb-f079695d9dfd tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58" status: 200 len: 1720 microversion: 2.1 time: 0.158961 Aug 27 03:43:30.204992 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3351/6655] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:43:30 2022] GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58 => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:43:30.823615 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-0ec0dfa0-7257-4132-8fb8-edbfc3827ea4 req-191f440e-3234-4fe0-bc9e-9a99774412fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c3c1bec-8119-424c-84ad-682c05e27f58", "tag": "c4574914-6056-490c-94d6-b6cf22330712"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:43:30.834403 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-0ec0dfa0-7257-4132-8fb8-edbfc3827ea4 req-191f440e-3234-4fe0-bc9e-9a99774412fc service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:30.834883 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-0ec0dfa0-7257-4132-8fb8-edbfc3827ea4 req-191f440e-3234-4fe0-bc9e-9a99774412fc service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:30.835313 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-0ec0dfa0-7257-4132-8fb8-edbfc3827ea4 req-191f440e-3234-4fe0-bc9e-9a99774412fc service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:30.847525 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-0ec0dfa0-7257-4132-8fb8-edbfc3827ea4 req-191f440e-3234-4fe0-bc9e-9a99774412fc service nova] Creating event network-changed:c4574914-6056-490c-94d6-b6cf22330712 for instance 2c3c1bec-8119-424c-84ad-682c05e27f58 on n-h1-852278-4 Aug 27 03:43:30.853284 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [req-0ec0dfa0-7257-4132-8fb8-edbfc3827ea4 req-191f440e-3234-4fe0-bc9e-9a99774412fc service nova] Instance 2c3c1bec-8119-424c-84ad-682c05e27f58 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-852278-4', 'n-h1-852278-4'} {{(pid=134052) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 03:43:30.864468 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-0ec0dfa0-7257-4132-8fb8-edbfc3827ea4 req-191f440e-3234-4fe0-bc9e-9a99774412fc service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044625 Aug 27 03:43:30.865083 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3305/6656] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:43:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:43:31.226029 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-bee11ef7-b509-4cb7-8de9-796a4611fe3c tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:43:31.226839 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-bee11ef7-b509-4cb7-8de9-796a4611fe3c tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c3c1bec-8119-424c-84ad-682c05e27f58] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:43:31.234317 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bee11ef7-b509-4cb7-8de9-796a4611fe3c tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:31.234956 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bee11ef7-b509-4cb7-8de9-796a4611fe3c tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:31.235483 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bee11ef7-b509-4cb7-8de9-796a4611fe3c tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:31.236343 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bee11ef7-b509-4cb7-8de9-796a4611fe3c tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:31.236887 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bee11ef7-b509-4cb7-8de9-796a4611fe3c tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:31.237442 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bee11ef7-b509-4cb7-8de9-796a4611fe3c tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:31.589450 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-bee11ef7-b509-4cb7-8de9-796a4611fe3c tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:43:31.598739 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-bee11ef7-b509-4cb7-8de9-796a4611fe3c tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58" status: 200 len: 1720 microversion: 2.1 time: 0.376877 Aug 27 03:43:31.604833 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3352/6657] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:43:31 2022] GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58 => generated 1720 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:43:32.620887 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5bbcb529-a558-4265-82f7-7a66d4f1f5bb tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:43:32.621652 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-5bbcb529-a558-4265-82f7-7a66d4f1f5bb tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c3c1bec-8119-424c-84ad-682c05e27f58] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:43:32.628641 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5bbcb529-a558-4265-82f7-7a66d4f1f5bb tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:32.629092 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5bbcb529-a558-4265-82f7-7a66d4f1f5bb tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:32.629557 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5bbcb529-a558-4265-82f7-7a66d4f1f5bb tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:32.630253 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5bbcb529-a558-4265-82f7-7a66d4f1f5bb tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:32.630707 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5bbcb529-a558-4265-82f7-7a66d4f1f5bb tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:32.631128 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5bbcb529-a558-4265-82f7-7a66d4f1f5bb tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:32.777213 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-5bbcb529-a558-4265-82f7-7a66d4f1f5bb tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:43:32.786923 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-5bbcb529-a558-4265-82f7-7a66d4f1f5bb tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58" status: 200 len: 1720 microversion: 2.1 time: 0.171273 Aug 27 03:43:32.787527 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3306/6658] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:43:32 2022] GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58 => generated 1720 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:43:33.809159 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-78723b96-a37f-4e86-ab6d-ffe095af99e5 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:43:33.809806 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-78723b96-a37f-4e86-ab6d-ffe095af99e5 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c3c1bec-8119-424c-84ad-682c05e27f58] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:43:33.812938 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=3 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:43:33.819312 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-78723b96-a37f-4e86-ab6d-ffe095af99e5 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:33.819822 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-78723b96-a37f-4e86-ab6d-ffe095af99e5 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:33.820428 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-78723b96-a37f-4e86-ab6d-ffe095af99e5 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:33.821165 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-78723b96-a37f-4e86-ab6d-ffe095af99e5 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:33.821637 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-78723b96-a37f-4e86-ab6d-ffe095af99e5 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:33.822082 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-78723b96-a37f-4e86-ab6d-ffe095af99e5 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:33.961405 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-78723b96-a37f-4e86-ab6d-ffe095af99e5 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:43:33.970201 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-78723b96-a37f-4e86-ab6d-ffe095af99e5 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58" status: 200 len: 1720 microversion: 2.1 time: 0.165056 Aug 27 03:43:33.970842 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3353/6659] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:43:33 2022] GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58 => generated 1720 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:43:34.995874 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-73657e4a-caf8-45cc-908d-537d6f66a33f tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:43:34.996974 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-73657e4a-caf8-45cc-908d-537d6f66a33f tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c3c1bec-8119-424c-84ad-682c05e27f58] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:43:35.004943 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-73657e4a-caf8-45cc-908d-537d6f66a33f tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:35.005429 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-73657e4a-caf8-45cc-908d-537d6f66a33f tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:35.005865 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-73657e4a-caf8-45cc-908d-537d6f66a33f tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:35.006587 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-73657e4a-caf8-45cc-908d-537d6f66a33f tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:35.007061 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-73657e4a-caf8-45cc-908d-537d6f66a33f tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:35.007478 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-73657e4a-caf8-45cc-908d-537d6f66a33f tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:35.138724 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-73657e4a-caf8-45cc-908d-537d6f66a33f tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:43:35.147268 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-73657e4a-caf8-45cc-908d-537d6f66a33f tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58" status: 200 len: 1720 microversion: 2.1 time: 0.158333 Aug 27 03:43:35.147857 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3307/6660] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:43:34 2022] GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58 => generated 1720 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:43:36.172756 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ede013a7-7f46-49df-a1fb-d3154d63c755 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:43:36.173428 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-ede013a7-7f46-49df-a1fb-d3154d63c755 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c3c1bec-8119-424c-84ad-682c05e27f58] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:43:36.181706 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ede013a7-7f46-49df-a1fb-d3154d63c755 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:36.182194 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ede013a7-7f46-49df-a1fb-d3154d63c755 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:36.182693 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ede013a7-7f46-49df-a1fb-d3154d63c755 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:36.183478 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ede013a7-7f46-49df-a1fb-d3154d63c755 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:36.183992 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ede013a7-7f46-49df-a1fb-d3154d63c755 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:36.184513 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ede013a7-7f46-49df-a1fb-d3154d63c755 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:36.329026 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-ede013a7-7f46-49df-a1fb-d3154d63c755 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:43:36.337669 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ede013a7-7f46-49df-a1fb-d3154d63c755 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58" status: 200 len: 1720 microversion: 2.1 time: 0.171692 Aug 27 03:43:36.338348 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3354/6661] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:43:36 2022] GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58 => generated 1720 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:43:37.359517 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-975a2a09-8353-44fe-8363-8ee4ce893d28 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:43:37.360198 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-975a2a09-8353-44fe-8363-8ee4ce893d28 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c3c1bec-8119-424c-84ad-682c05e27f58] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:43:37.367556 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-975a2a09-8353-44fe-8363-8ee4ce893d28 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:37.368044 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-975a2a09-8353-44fe-8363-8ee4ce893d28 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:37.368518 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-975a2a09-8353-44fe-8363-8ee4ce893d28 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:37.369208 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-975a2a09-8353-44fe-8363-8ee4ce893d28 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:37.369656 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-975a2a09-8353-44fe-8363-8ee4ce893d28 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:37.370076 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-975a2a09-8353-44fe-8363-8ee4ce893d28 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:37.511422 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-975a2a09-8353-44fe-8363-8ee4ce893d28 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:43:37.519914 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-975a2a09-8353-44fe-8363-8ee4ce893d28 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58" status: 200 len: 1720 microversion: 2.1 time: 0.164536 Aug 27 03:43:37.520556 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3308/6662] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:43:37 2022] GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58 => generated 1720 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:43:38.541547 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-daa4b9b2-a768-42c3-b500-abb39cb91d58 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:43:38.542697 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-daa4b9b2-a768-42c3-b500-abb39cb91d58 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c3c1bec-8119-424c-84ad-682c05e27f58] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:43:38.550352 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-daa4b9b2-a768-42c3-b500-abb39cb91d58 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:38.550860 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-daa4b9b2-a768-42c3-b500-abb39cb91d58 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:38.551315 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-daa4b9b2-a768-42c3-b500-abb39cb91d58 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:38.552041 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-daa4b9b2-a768-42c3-b500-abb39cb91d58 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:38.552568 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-daa4b9b2-a768-42c3-b500-abb39cb91d58 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:38.553014 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-daa4b9b2-a768-42c3-b500-abb39cb91d58 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:38.695671 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-daa4b9b2-a768-42c3-b500-abb39cb91d58 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:43:38.706236 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-daa4b9b2-a768-42c3-b500-abb39cb91d58 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58" status: 200 len: 1720 microversion: 2.1 time: 0.168893 Aug 27 03:43:38.706830 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3355/6663] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:43:38 2022] GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58 => generated 1720 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:43:39.727880 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-29893d55-e2d9-4c37-9955-48e3623d3a1f tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:43:39.728602 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-29893d55-e2d9-4c37-9955-48e3623d3a1f tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c3c1bec-8119-424c-84ad-682c05e27f58] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:43:39.736029 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-29893d55-e2d9-4c37-9955-48e3623d3a1f tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:39.736557 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-29893d55-e2d9-4c37-9955-48e3623d3a1f tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:39.736991 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-29893d55-e2d9-4c37-9955-48e3623d3a1f tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:39.737689 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-29893d55-e2d9-4c37-9955-48e3623d3a1f tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:39.738137 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-29893d55-e2d9-4c37-9955-48e3623d3a1f tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:39.738556 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-29893d55-e2d9-4c37-9955-48e3623d3a1f tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:39.872679 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-29893d55-e2d9-4c37-9955-48e3623d3a1f tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:43:39.881585 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-29893d55-e2d9-4c37-9955-48e3623d3a1f tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58" status: 200 len: 1720 microversion: 2.1 time: 0.157787 Aug 27 03:43:39.882182 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3309/6664] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:43:39 2022] GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58 => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:43:40.907448 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d8f7dbf4-c110-4429-b2b5-8979e18b3606 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:43:40.908055 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d8f7dbf4-c110-4429-b2b5-8979e18b3606 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c3c1bec-8119-424c-84ad-682c05e27f58] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:43:40.915568 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d8f7dbf4-c110-4429-b2b5-8979e18b3606 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:40.916076 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d8f7dbf4-c110-4429-b2b5-8979e18b3606 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:40.916579 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d8f7dbf4-c110-4429-b2b5-8979e18b3606 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:40.917293 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d8f7dbf4-c110-4429-b2b5-8979e18b3606 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:40.917772 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d8f7dbf4-c110-4429-b2b5-8979e18b3606 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:40.918207 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d8f7dbf4-c110-4429-b2b5-8979e18b3606 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:41.062132 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d8f7dbf4-c110-4429-b2b5-8979e18b3606 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:43:41.070784 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d8f7dbf4-c110-4429-b2b5-8979e18b3606 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58" status: 200 len: 1720 microversion: 2.1 time: 0.170170 Aug 27 03:43:41.071379 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3356/6665] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:43:40 2022] GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58 => generated 1720 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:43:42.096265 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9ca0df56-08af-49dc-954b-bd926576f244 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:43:42.097401 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-9ca0df56-08af-49dc-954b-bd926576f244 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c3c1bec-8119-424c-84ad-682c05e27f58] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:43:42.109137 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9ca0df56-08af-49dc-954b-bd926576f244 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:42.109941 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9ca0df56-08af-49dc-954b-bd926576f244 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:42.110643 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9ca0df56-08af-49dc-954b-bd926576f244 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:42.111815 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9ca0df56-08af-49dc-954b-bd926576f244 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:42.112548 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9ca0df56-08af-49dc-954b-bd926576f244 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:42.112971 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9ca0df56-08af-49dc-954b-bd926576f244 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:42.260390 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-9ca0df56-08af-49dc-954b-bd926576f244 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:43:42.272983 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9ca0df56-08af-49dc-954b-bd926576f244 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58" status: 200 len: 1713 microversion: 2.1 time: 0.182801 Aug 27 03:43:42.273709 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3310/6666] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:43:42 2022] GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58 => generated 1713 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:43:42.297343 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-873b79b1-e77b-4e91-aa5c-c082b0ec3f47 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:43:42.298153 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-873b79b1-e77b-4e91-aa5c-c082b0ec3f47 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c3c1bec-8119-424c-84ad-682c05e27f58] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:43:42.305851 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-873b79b1-e77b-4e91-aa5c-c082b0ec3f47 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:42.306368 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-873b79b1-e77b-4e91-aa5c-c082b0ec3f47 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:42.306828 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-873b79b1-e77b-4e91-aa5c-c082b0ec3f47 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:42.307538 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-873b79b1-e77b-4e91-aa5c-c082b0ec3f47 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:42.308016 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-873b79b1-e77b-4e91-aa5c-c082b0ec3f47 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:42.308507 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-873b79b1-e77b-4e91-aa5c-c082b0ec3f47 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:42.446130 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-873b79b1-e77b-4e91-aa5c-c082b0ec3f47 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:43:42.459503 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-873b79b1-e77b-4e91-aa5c-c082b0ec3f47 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58" status: 200 len: 1713 microversion: 2.1 time: 0.166033 Aug 27 03:43:42.460193 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3357/6667] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:43:42 2022] GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58 => generated 1713 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:43:42.488037 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3e90f3ef-e267-4e8f-94c4-c69c9047dd7e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:43:42.489287 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-3e90f3ef-e267-4e8f-94c4-c69c9047dd7e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c3c1bec-8119-424c-84ad-682c05e27f58] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:43:42.498699 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3e90f3ef-e267-4e8f-94c4-c69c9047dd7e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:42.499496 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3e90f3ef-e267-4e8f-94c4-c69c9047dd7e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:42.500208 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3e90f3ef-e267-4e8f-94c4-c69c9047dd7e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:42.501356 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3e90f3ef-e267-4e8f-94c4-c69c9047dd7e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:42.502057 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3e90f3ef-e267-4e8f-94c4-c69c9047dd7e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:42.502785 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3e90f3ef-e267-4e8f-94c4-c69c9047dd7e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:42.645520 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-3e90f3ef-e267-4e8f-94c4-c69c9047dd7e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:43:42.654439 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-3e90f3ef-e267-4e8f-94c4-c69c9047dd7e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58" status: 200 len: 1713 microversion: 2.1 time: 0.172894 Aug 27 03:43:42.655032 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3311/6668] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:43:42 2022] GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58 => generated 1713 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:43:42.676771 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7dde572e-1592-415a-83f7-87a8d17adb80 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:43:42.677291 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-7dde572e-1592-415a-83f7-87a8d17adb80 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c3c1bec-8119-424c-84ad-682c05e27f58] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:43:42.683691 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7dde572e-1592-415a-83f7-87a8d17adb80 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:42.684203 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7dde572e-1592-415a-83f7-87a8d17adb80 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:42.684696 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7dde572e-1592-415a-83f7-87a8d17adb80 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:42.685414 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7dde572e-1592-415a-83f7-87a8d17adb80 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:42.685887 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7dde572e-1592-415a-83f7-87a8d17adb80 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:42.686334 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7dde572e-1592-415a-83f7-87a8d17adb80 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:42.701585 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:43:42.714017 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-7dde572e-1592-415a-83f7-87a8d17adb80 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c3c1bec-8119-424c-84ad-682c05e27f58] Going to try to terminate instance {{(pid=134051) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:43:42.796957 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-7dde572e-1592-415a-83f7-87a8d17adb80 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "DELETE /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58" status: 204 len: 0 microversion: 2.1 time: 0.125188 Aug 27 03:43:42.797660 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3358/6669] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 03:43:42 2022] DELETE /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:43:42.808423 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-57a8e045-2572-4160-8549-a1ab2a1533cf tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:43:42.809038 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-57a8e045-2572-4160-8549-a1ab2a1533cf tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c3c1bec-8119-424c-84ad-682c05e27f58] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:43:42.815371 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-57a8e045-2572-4160-8549-a1ab2a1533cf tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:42.815936 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-57a8e045-2572-4160-8549-a1ab2a1533cf tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:42.816537 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-57a8e045-2572-4160-8549-a1ab2a1533cf tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:42.817296 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-57a8e045-2572-4160-8549-a1ab2a1533cf tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:42.817844 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-57a8e045-2572-4160-8549-a1ab2a1533cf tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:42.818418 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-57a8e045-2572-4160-8549-a1ab2a1533cf tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:42.954292 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-57a8e045-2572-4160-8549-a1ab2a1533cf tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:43:42.962845 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-57a8e045-2572-4160-8549-a1ab2a1533cf tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58" status: 200 len: 1719 microversion: 2.1 time: 0.160166 Aug 27 03:43:42.963405 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3312/6670] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:43:42 2022] GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58 => generated 1719 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:43:43.985038 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-072dc0dd-5706-4c7e-a44b-fe50c1681fdb tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:43:43.985746 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-072dc0dd-5706-4c7e-a44b-fe50c1681fdb tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c3c1bec-8119-424c-84ad-682c05e27f58] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:43:43.993320 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-072dc0dd-5706-4c7e-a44b-fe50c1681fdb tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:43.993842 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-072dc0dd-5706-4c7e-a44b-fe50c1681fdb tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:43.994306 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-072dc0dd-5706-4c7e-a44b-fe50c1681fdb tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:43.995046 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-072dc0dd-5706-4c7e-a44b-fe50c1681fdb tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:43.995524 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-072dc0dd-5706-4c7e-a44b-fe50c1681fdb tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:43.995972 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-072dc0dd-5706-4c7e-a44b-fe50c1681fdb tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:44.138434 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-072dc0dd-5706-4c7e-a44b-fe50c1681fdb tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:43:44.149104 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-072dc0dd-5706-4c7e-a44b-fe50c1681fdb tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58" status: 200 len: 1719 microversion: 2.1 time: 0.168456 Aug 27 03:43:44.149665 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3359/6671] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:43:43 2022] GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58 => generated 1719 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:43:45.170627 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-bc17a1a2-d870-40db-b240-a8fef1319a69 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:43:45.171659 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-bc17a1a2-d870-40db-b240-a8fef1319a69 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c3c1bec-8119-424c-84ad-682c05e27f58] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:43:45.180168 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bc17a1a2-d870-40db-b240-a8fef1319a69 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:45.180696 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bc17a1a2-d870-40db-b240-a8fef1319a69 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:45.181125 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bc17a1a2-d870-40db-b240-a8fef1319a69 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:45.181885 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bc17a1a2-d870-40db-b240-a8fef1319a69 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:45.182474 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bc17a1a2-d870-40db-b240-a8fef1319a69 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:45.182889 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bc17a1a2-d870-40db-b240-a8fef1319a69 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:45.650440 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-bc17a1a2-d870-40db-b240-a8fef1319a69 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:43:45.659179 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-bc17a1a2-d870-40db-b240-a8fef1319a69 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58" status: 200 len: 1652 microversion: 2.1 time: 0.492438 Aug 27 03:43:45.659933 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3313/6672] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:43:45 2022] GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58 => generated 1652 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:43:45.719142 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-487259e4-e913-446a-bb32-85b1b3af3203 req-c98f2885-805b-4cb9-88ca-a9c2cb4ec5fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c3c1bec-8119-424c-84ad-682c05e27f58", "name": "network-vif-deleted", "tag": "c4574914-6056-490c-94d6-b6cf22330712"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:43:45.729897 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-487259e4-e913-446a-bb32-85b1b3af3203 req-c98f2885-805b-4cb9-88ca-a9c2cb4ec5fc service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:45.730408 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-487259e4-e913-446a-bb32-85b1b3af3203 req-c98f2885-805b-4cb9-88ca-a9c2cb4ec5fc service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:45.730884 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-487259e4-e913-446a-bb32-85b1b3af3203 req-c98f2885-805b-4cb9-88ca-a9c2cb4ec5fc service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:45.746093 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-487259e4-e913-446a-bb32-85b1b3af3203 req-c98f2885-805b-4cb9-88ca-a9c2cb4ec5fc service nova] Creating event network-vif-deleted:c4574914-6056-490c-94d6-b6cf22330712 for instance 2c3c1bec-8119-424c-84ad-682c05e27f58 on n-h1-852278-4 Aug 27 03:43:45.751279 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-487259e4-e913-446a-bb32-85b1b3af3203 req-c98f2885-805b-4cb9-88ca-a9c2cb4ec5fc service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035814 Aug 27 03:43:45.755026 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3360/6673] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:43:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:43:46.681305 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ca65a85a-26b9-4167-b3ba-8df2c2e1954c tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:43:46.682029 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-ca65a85a-26b9-4167-b3ba-8df2c2e1954c tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c3c1bec-8119-424c-84ad-682c05e27f58] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:43:46.689216 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ca65a85a-26b9-4167-b3ba-8df2c2e1954c tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:46.689706 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ca65a85a-26b9-4167-b3ba-8df2c2e1954c tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:46.690359 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ca65a85a-26b9-4167-b3ba-8df2c2e1954c tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:46.691069 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ca65a85a-26b9-4167-b3ba-8df2c2e1954c tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:46.691511 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ca65a85a-26b9-4167-b3ba-8df2c2e1954c tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:46.691932 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ca65a85a-26b9-4167-b3ba-8df2c2e1954c tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:46.756667 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-ca65a85a-26b9-4167-b3ba-8df2c2e1954c tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:43:46.765646 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ca65a85a-26b9-4167-b3ba-8df2c2e1954c tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58" status: 200 len: 1370 microversion: 2.1 time: 0.088344 Aug 27 03:43:46.766239 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3314/6674] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:43:46 2022] GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58 => generated 1370 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:43:47.788822 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-513ed118-469c-481b-b875-0ad056342e3a tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:43:47.789542 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-513ed118-469c-481b-b875-0ad056342e3a tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c3c1bec-8119-424c-84ad-682c05e27f58] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:43:47.796716 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-513ed118-469c-481b-b875-0ad056342e3a tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:47.797218 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-513ed118-469c-481b-b875-0ad056342e3a tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:47.797671 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-513ed118-469c-481b-b875-0ad056342e3a tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:47.798388 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-513ed118-469c-481b-b875-0ad056342e3a tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:47.798856 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-513ed118-469c-481b-b875-0ad056342e3a tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:47.799332 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-513ed118-469c-481b-b875-0ad056342e3a tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:47.862229 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-513ed118-469c-481b-b875-0ad056342e3a tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:43:47.871045 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-513ed118-469c-481b-b875-0ad056342e3a tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58" status: 200 len: 1370 microversion: 2.1 time: 0.087639 Aug 27 03:43:47.871680 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3361/6675] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:43:47 2022] GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58 => generated 1370 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:43:48.893607 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9f9b8caa-1a3f-4669-ad61-c1eb3280e3a3 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:43:48.894200 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-9f9b8caa-1a3f-4669-ad61-c1eb3280e3a3 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c3c1bec-8119-424c-84ad-682c05e27f58] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:43:48.897557 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=34 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:43:48.903313 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9f9b8caa-1a3f-4669-ad61-c1eb3280e3a3 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:48.903797 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9f9b8caa-1a3f-4669-ad61-c1eb3280e3a3 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:48.904236 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9f9b8caa-1a3f-4669-ad61-c1eb3280e3a3 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:48.904967 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9f9b8caa-1a3f-4669-ad61-c1eb3280e3a3 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:48.905416 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9f9b8caa-1a3f-4669-ad61-c1eb3280e3a3 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:48.905836 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9f9b8caa-1a3f-4669-ad61-c1eb3280e3a3 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:48.908481 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=100 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:43:48.976025 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-9f9b8caa-1a3f-4669-ad61-c1eb3280e3a3 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:43:48.985157 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9f9b8caa-1a3f-4669-ad61-c1eb3280e3a3 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58" status: 200 len: 1370 microversion: 2.1 time: 0.097237 Aug 27 03:43:48.985845 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3315/6676] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:43:48 2022] GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58 => generated 1370 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:43:50.006330 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e728cf4b-feaa-4b49-b105-6682b1d1cddd tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:43:50.006730 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-e728cf4b-feaa-4b49-b105-6682b1d1cddd tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c3c1bec-8119-424c-84ad-682c05e27f58] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:43:50.009593 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:43:50.015575 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e728cf4b-feaa-4b49-b105-6682b1d1cddd tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:50.016119 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e728cf4b-feaa-4b49-b105-6682b1d1cddd tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:50.016655 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e728cf4b-feaa-4b49-b105-6682b1d1cddd tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:50.017383 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e728cf4b-feaa-4b49-b105-6682b1d1cddd tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:50.017856 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e728cf4b-feaa-4b49-b105-6682b1d1cddd tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:50.018298 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e728cf4b-feaa-4b49-b105-6682b1d1cddd tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:50.051670 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e728cf4b-feaa-4b49-b105-6682b1d1cddd tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:50.052094 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e728cf4b-feaa-4b49-b105-6682b1d1cddd tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:50.052579 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e728cf4b-feaa-4b49-b105-6682b1d1cddd tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:50.053074 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.objects.instance [None req-e728cf4b-feaa-4b49-b105-6682b1d1cddd tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lazy-loading 'fault' on Instance uuid 2c3c1bec-8119-424c-84ad-682c05e27f58 {{(pid=134051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:43:50.096758 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e728cf4b-feaa-4b49-b105-6682b1d1cddd tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62665fa43c34e6eb695633905cf3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3aa9846bcb40518ac54e31208ce043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:43:50.105481 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e728cf4b-feaa-4b49-b105-6682b1d1cddd tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58" status: 200 len: 1375 microversion: 2.1 time: 0.103441 Aug 27 03:43:50.106078 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3362/6677] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:43:50 2022] GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58 => generated 1375 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:43:51.188871 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-99735b99-b4c2-4d0e-bf5d-40f726aa20e8 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:43:51.189714 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-99735b99-b4c2-4d0e-bf5d-40f726aa20e8 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c3c1bec-8119-424c-84ad-682c05e27f58] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:43:51.198005 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-99735b99-b4c2-4d0e-bf5d-40f726aa20e8 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:51.198489 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-99735b99-b4c2-4d0e-bf5d-40f726aa20e8 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:51.198919 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-99735b99-b4c2-4d0e-bf5d-40f726aa20e8 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:51.199603 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-99735b99-b4c2-4d0e-bf5d-40f726aa20e8 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:51.200047 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-99735b99-b4c2-4d0e-bf5d-40f726aa20e8 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:51.200497 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-99735b99-b4c2-4d0e-bf5d-40f726aa20e8 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:51.214066 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-99735b99-b4c2-4d0e-bf5d-40f726aa20e8 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] HTTP exception thrown: Instance 2c3c1bec-8119-424c-84ad-682c05e27f58 could not be found. Aug 27 03:43:51.215709 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-99735b99-b4c2-4d0e-bf5d-40f726aa20e8 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Request method failure captured: Aug 27 03:43:51.215709 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58 HTTP/1.1 Aug 27 03:43:51.215709 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 03:43:51.215709 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 03:43:51.215709 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 03:43:51.215709 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 03:43:51.215709 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 03:43:51.215709 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 03:43:51.215709 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 03:43:51.215709 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 03:43:51.215709 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCZGWxk5BEicF9AwnrkJwBWPfwg6arCi_dT6E6ZVU5_NhdiLiUMoMZ2Q_dYvmFaxRe7rt1FqUkb8B6Jv9aLrdZAOB6sF0tJV32UJ88bJE_iEEa6wH556BrFuazMURlys8Bi6SN-7FaZo2zdThDqlQ_upK7UsTTNFT7YiOxJI35LhaDsc Aug 27 03:43:51.215709 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 03:43:51.215709 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 03:43:51.215709 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 03:43:51.215709 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 03:43:51.215709 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 03:43:51.215709 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 03:43:51.215709 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: cc3aa9846bcb40518ac54e31208ce043 Aug 27 03:43:51.215709 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ServerActionsTestJSON-577023370 Aug 27 03:43:51.215709 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 03:43:51.215709 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 03:43:51.215709 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cc3aa9846bcb40518ac54e31208ce043"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_cc3aa9846bcb40518ac54e31208ce043", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cc3aa9846bcb40518ac54e31208ce043"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/cc3aa9846bcb40518ac54e31208ce043"}]}] Aug 27 03:43:51.215709 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ServerActionsTestJSON-577023370 Aug 27 03:43:51.215709 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: cc3aa9846bcb40518ac54e31208ce043 Aug 27 03:43:51.215709 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ServerActionsTestJSON-577023370 Aug 27 03:43:51.215709 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ServerActionsTestJSON-577023370-project Aug 27 03:43:51.215709 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 03:43:51.215709 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 03:43:51.215709 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: c62665fa43c34e6eb695633905cf3b84 Aug 27 03:43:51.215709 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ServerActionsTestJSON-577023370-project Aug 27 03:43:51.215709 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 03:43:51.215709 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance 2c3c1bec-8119-424c-84ad-682c05e27f58 could not be found. Aug 27 03:43:51.215709 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '2c3c1bec-8119-424c-84ad-682c05e27f58'} Aug 27 03:43:51.215709 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:43:51.215709 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:43:51.215709 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:43:51.215709 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:43:51.215709 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:43:51.215709 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:43:51.215709 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:43:51.215709 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:43:51.215709 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:43:51.215709 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:43:51.215709 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c3c1bec-8119-424c-84ad-682c05e27f58 could not be found. Aug 27 03:43:51.215709 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:43:51.215709 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:43:51.215709 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:43:51.215709 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:43:51.215709 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:43:51.215709 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:43:51.215709 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:43:51.215709 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:43:51.215709 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:43:51.215709 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:43:51.215709 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:43:51.215709 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:43:51.215709 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:43:51.215709 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:43:51.215709 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:43:51.215709 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:43:51.215709 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c3c1bec-8119-424c-84ad-682c05e27f58 could not be found. Aug 27 03:43:51.215709 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:43:51.215709 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:43:51.215709 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:43:51.219790 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:43:51.219790 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:43:51.219790 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:43:51.219790 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:43:51.219790 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:43:51.219790 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c3c1bec-8119-424c-84ad-682c05e27f58 could not be found. Aug 27 03:43:51.219790 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:43:51.219790 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-99735b99-b4c2-4d0e-bf5d-40f726aa20e8 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Returning 404 to user: Instance 2c3c1bec-8119-424c-84ad-682c05e27f58 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:43:51.219790 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-99735b99-b4c2-4d0e-bf5d-40f726aa20e8 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58" status: 404 len: 111 microversion: 2.1 time: 0.034992 Aug 27 03:43:51.219790 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3316/6678] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:43:51 2022] GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:43:51.278073 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7a0781d8-a07d-40e4-a561-1e0fbd67a91d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:43:51.280411 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-7a0781d8-a07d-40e4-a561-1e0fbd67a91d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c3c1bec-8119-424c-84ad-682c05e27f58] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:43:51.287685 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7a0781d8-a07d-40e4-a561-1e0fbd67a91d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:51.288185 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7a0781d8-a07d-40e4-a561-1e0fbd67a91d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:51.288677 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7a0781d8-a07d-40e4-a561-1e0fbd67a91d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:51.289396 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7a0781d8-a07d-40e4-a561-1e0fbd67a91d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:51.289864 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7a0781d8-a07d-40e4-a561-1e0fbd67a91d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:51.290337 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7a0781d8-a07d-40e4-a561-1e0fbd67a91d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:51.303901 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-7a0781d8-a07d-40e4-a561-1e0fbd67a91d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] HTTP exception thrown: Instance 2c3c1bec-8119-424c-84ad-682c05e27f58 could not be found. Aug 27 03:43:51.305654 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7a0781d8-a07d-40e4-a561-1e0fbd67a91d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Request method failure captured: Aug 27 03:43:51.305654 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58/os-volume_attachments HTTP/1.1 Aug 27 03:43:51.305654 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 03:43:51.305654 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 03:43:51.305654 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 03:43:51.305654 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 03:43:51.305654 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 03:43:51.305654 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 03:43:51.305654 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 03:43:51.305654 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 03:43:51.305654 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCZGWxk5BEicF9AwnrkJwBWPfwg6arCi_dT6E6ZVU5_NhdiLiUMoMZ2Q_dYvmFaxRe7rt1FqUkb8B6Jv9aLrdZAOB6sF0tJV32UJ88bJE_iEEa6wH556BrFuazMURlys8Bi6SN-7FaZo2zdThDqlQ_upK7UsTTNFT7YiOxJI35LhaDsc Aug 27 03:43:51.305654 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 03:43:51.305654 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 03:43:51.305654 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 03:43:51.305654 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 03:43:51.305654 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 03:43:51.305654 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 03:43:51.305654 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: cc3aa9846bcb40518ac54e31208ce043 Aug 27 03:43:51.305654 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ServerActionsTestJSON-577023370 Aug 27 03:43:51.305654 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 03:43:51.305654 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 03:43:51.305654 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cc3aa9846bcb40518ac54e31208ce043"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_cc3aa9846bcb40518ac54e31208ce043", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cc3aa9846bcb40518ac54e31208ce043"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/cc3aa9846bcb40518ac54e31208ce043"}]}] Aug 27 03:43:51.305654 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ServerActionsTestJSON-577023370 Aug 27 03:43:51.305654 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: cc3aa9846bcb40518ac54e31208ce043 Aug 27 03:43:51.305654 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ServerActionsTestJSON-577023370 Aug 27 03:43:51.305654 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ServerActionsTestJSON-577023370-project Aug 27 03:43:51.305654 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 03:43:51.305654 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 03:43:51.305654 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: c62665fa43c34e6eb695633905cf3b84 Aug 27 03:43:51.305654 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ServerActionsTestJSON-577023370-project Aug 27 03:43:51.305654 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 03:43:51.305654 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance 2c3c1bec-8119-424c-84ad-682c05e27f58 could not be found. Aug 27 03:43:51.305654 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'server_id': '2c3c1bec-8119-424c-84ad-682c05e27f58'} Aug 27 03:43:51.305654 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:43:51.305654 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:43:51.305654 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:43:51.305654 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:43:51.305654 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:43:51.305654 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:43:51.305654 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:43:51.305654 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:43:51.305654 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:43:51.305654 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:43:51.305654 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c3c1bec-8119-424c-84ad-682c05e27f58 could not be found. Aug 27 03:43:51.305654 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:43:51.305654 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:43:51.305654 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:43:51.305654 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:43:51.305654 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:43:51.305654 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:43:51.305654 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:43:51.305654 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:43:51.305654 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:43:51.305654 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:43:51.305654 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 03:43:51.305654 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:43:51.305654 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 03:43:51.305654 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:43:51.305654 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 27 03:43:51.305654 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 27 03:43:51.305654 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:43:51.305654 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:43:51.309787 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c3c1bec-8119-424c-84ad-682c05e27f58 could not be found. Aug 27 03:43:51.309787 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:43:51.309787 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:43:51.309787 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:43:51.309787 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:43:51.309787 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:43:51.309787 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:43:51.309787 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:43:51.309787 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:43:51.309787 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c3c1bec-8119-424c-84ad-682c05e27f58 could not be found. Aug 27 03:43:51.309787 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:43:51.309787 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7a0781d8-a07d-40e4-a561-1e0fbd67a91d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Returning 404 to user: Instance 2c3c1bec-8119-424c-84ad-682c05e27f58 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:43:51.309787 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-7a0781d8-a07d-40e4-a561-1e0fbd67a91d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.033166 Aug 27 03:43:51.309787 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3363/6679] 10.222.0.70 () {58 vars in 1302 bytes} [Sat Aug 27 03:43:51 2022] GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58/os-volume_attachments => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:43:54.633501 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0c5465ef-1b60-44a2-babc-804575a5a1ee tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:43:54.633980 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-0c5465ef-1b60-44a2-babc-804575a5a1ee tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c3c1bec-8119-424c-84ad-682c05e27f58] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:43:54.641159 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0c5465ef-1b60-44a2-babc-804575a5a1ee tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:54.641641 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0c5465ef-1b60-44a2-babc-804575a5a1ee tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:54.642074 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0c5465ef-1b60-44a2-babc-804575a5a1ee tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:54.642772 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0c5465ef-1b60-44a2-babc-804575a5a1ee tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:54.643221 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0c5465ef-1b60-44a2-babc-804575a5a1ee tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:54.643648 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0c5465ef-1b60-44a2-babc-804575a5a1ee tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:54.657536 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-0c5465ef-1b60-44a2-babc-804575a5a1ee tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] HTTP exception thrown: Instance 2c3c1bec-8119-424c-84ad-682c05e27f58 could not be found. Aug 27 03:43:54.659086 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0c5465ef-1b60-44a2-babc-804575a5a1ee tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Request method failure captured: Aug 27 03:43:54.659086 n-d-852278-4 devstack@n-api.service[134052]: request: DELETE /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58 HTTP/1.1 Aug 27 03:43:54.659086 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 03:43:54.659086 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 03:43:54.659086 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 03:43:54.659086 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 03:43:54.659086 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 03:43:54.659086 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 03:43:54.659086 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 03:43:54.659086 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 03:43:54.659086 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCZGWxk5BEicF9AwnrkJwBWPfwg6arCi_dT6E6ZVU5_NhdiLiUMoMZ2Q_dYvmFaxRe7rt1FqUkb8B6Jv9aLrdZAOB6sF0tJV32UJ88bJE_iEEa6wH556BrFuazMURlys8Bi6SN-7FaZo2zdThDqlQ_upK7UsTTNFT7YiOxJI35LhaDsc Aug 27 03:43:54.659086 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 03:43:54.659086 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 03:43:54.659086 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 03:43:54.659086 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 03:43:54.659086 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 03:43:54.659086 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 03:43:54.659086 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: cc3aa9846bcb40518ac54e31208ce043 Aug 27 03:43:54.659086 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ServerActionsTestJSON-577023370 Aug 27 03:43:54.659086 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 03:43:54.659086 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 03:43:54.659086 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cc3aa9846bcb40518ac54e31208ce043"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_cc3aa9846bcb40518ac54e31208ce043", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cc3aa9846bcb40518ac54e31208ce043"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/cc3aa9846bcb40518ac54e31208ce043"}]}] Aug 27 03:43:54.659086 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ServerActionsTestJSON-577023370 Aug 27 03:43:54.659086 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: cc3aa9846bcb40518ac54e31208ce043 Aug 27 03:43:54.659086 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ServerActionsTestJSON-577023370 Aug 27 03:43:54.659086 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ServerActionsTestJSON-577023370-project Aug 27 03:43:54.659086 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 03:43:54.659086 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 03:43:54.659086 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: c62665fa43c34e6eb695633905cf3b84 Aug 27 03:43:54.659086 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ServerActionsTestJSON-577023370-project Aug 27 03:43:54.659086 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 03:43:54.659086 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance 2c3c1bec-8119-424c-84ad-682c05e27f58 could not be found. Aug 27 03:43:54.659086 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '2c3c1bec-8119-424c-84ad-682c05e27f58'} Aug 27 03:43:54.659086 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:43:54.659086 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:43:54.659086 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:43:54.659086 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:43:54.659086 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:43:54.659086 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:43:54.659086 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:43:54.659086 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:43:54.659086 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:43:54.659086 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:43:54.659086 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c3c1bec-8119-424c-84ad-682c05e27f58 could not be found. Aug 27 03:43:54.659086 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:43:54.659086 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:43:54.659086 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:43:54.659086 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:43:54.659086 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:43:54.659086 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:43:54.659086 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:43:54.659086 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:43:54.659086 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:43:54.659086 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:43:54.659086 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 03:43:54.659086 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 03:43:54.659086 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 03:43:54.659086 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 03:43:54.659086 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:43:54.659086 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:43:54.659086 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:43:54.659086 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:43:54.662593 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c3c1bec-8119-424c-84ad-682c05e27f58 could not be found. Aug 27 03:43:54.662593 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:43:54.662593 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:43:54.662593 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:43:54.662593 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:43:54.662593 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:43:54.662593 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:43:54.662593 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:43:54.662593 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:43:54.662593 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c3c1bec-8119-424c-84ad-682c05e27f58 could not be found. Aug 27 03:43:54.662593 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:43:54.662593 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0c5465ef-1b60-44a2-babc-804575a5a1ee tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Returning 404 to user: Instance 2c3c1bec-8119-424c-84ad-682c05e27f58 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:43:54.662593 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-0c5465ef-1b60-44a2-babc-804575a5a1ee tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "DELETE /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58" status: 404 len: 111 microversion: 2.1 time: 0.030963 Aug 27 03:43:54.662593 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3317/6680] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 03:43:54 2022] DELETE /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:43:54.669339 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-5f3728d5-cc6f-4547-b6dc-89dc4394f0f8 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:43:54.669978 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-5f3728d5-cc6f-4547-b6dc-89dc4394f0f8 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c3c1bec-8119-424c-84ad-682c05e27f58] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:43:54.677645 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5f3728d5-cc6f-4547-b6dc-89dc4394f0f8 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:54.678204 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5f3728d5-cc6f-4547-b6dc-89dc4394f0f8 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:54.678665 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5f3728d5-cc6f-4547-b6dc-89dc4394f0f8 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:54.679387 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5f3728d5-cc6f-4547-b6dc-89dc4394f0f8 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:54.679862 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5f3728d5-cc6f-4547-b6dc-89dc4394f0f8 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:54.680330 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5f3728d5-cc6f-4547-b6dc-89dc4394f0f8 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:54.694422 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-5f3728d5-cc6f-4547-b6dc-89dc4394f0f8 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] HTTP exception thrown: Instance 2c3c1bec-8119-424c-84ad-682c05e27f58 could not be found. Aug 27 03:43:54.696010 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-5f3728d5-cc6f-4547-b6dc-89dc4394f0f8 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Request method failure captured: Aug 27 03:43:54.696010 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58 HTTP/1.1 Aug 27 03:43:54.696010 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 03:43:54.696010 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 03:43:54.696010 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 03:43:54.696010 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 03:43:54.696010 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 03:43:54.696010 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 03:43:54.696010 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 03:43:54.696010 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 03:43:54.696010 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCZGWxk5BEicF9AwnrkJwBWPfwg6arCi_dT6E6ZVU5_NhdiLiUMoMZ2Q_dYvmFaxRe7rt1FqUkb8B6Jv9aLrdZAOB6sF0tJV32UJ88bJE_iEEa6wH556BrFuazMURlys8Bi6SN-7FaZo2zdThDqlQ_upK7UsTTNFT7YiOxJI35LhaDsc Aug 27 03:43:54.696010 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 03:43:54.696010 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 03:43:54.696010 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 03:43:54.696010 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 03:43:54.696010 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 03:43:54.696010 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 03:43:54.696010 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: cc3aa9846bcb40518ac54e31208ce043 Aug 27 03:43:54.696010 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ServerActionsTestJSON-577023370 Aug 27 03:43:54.696010 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 03:43:54.696010 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 03:43:54.696010 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cc3aa9846bcb40518ac54e31208ce043"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_cc3aa9846bcb40518ac54e31208ce043", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cc3aa9846bcb40518ac54e31208ce043"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/cc3aa9846bcb40518ac54e31208ce043"}]}] Aug 27 03:43:54.696010 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ServerActionsTestJSON-577023370 Aug 27 03:43:54.696010 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: cc3aa9846bcb40518ac54e31208ce043 Aug 27 03:43:54.696010 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ServerActionsTestJSON-577023370 Aug 27 03:43:54.696010 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ServerActionsTestJSON-577023370-project Aug 27 03:43:54.696010 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 03:43:54.696010 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 03:43:54.696010 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: c62665fa43c34e6eb695633905cf3b84 Aug 27 03:43:54.696010 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ServerActionsTestJSON-577023370-project Aug 27 03:43:54.696010 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 03:43:54.696010 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance 2c3c1bec-8119-424c-84ad-682c05e27f58 could not be found. Aug 27 03:43:54.696010 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '2c3c1bec-8119-424c-84ad-682c05e27f58'} Aug 27 03:43:54.696010 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:43:54.696010 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:43:54.696010 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:43:54.696010 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:43:54.696010 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:43:54.696010 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:43:54.696010 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:43:54.696010 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:43:54.696010 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:43:54.696010 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:43:54.696010 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c3c1bec-8119-424c-84ad-682c05e27f58 could not be found. Aug 27 03:43:54.696010 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:43:54.696010 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:43:54.696010 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:43:54.696010 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:43:54.696010 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:43:54.696010 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:43:54.696010 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:43:54.696010 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:43:54.696010 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:43:54.696010 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:43:54.696010 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:43:54.696010 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:43:54.696010 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:43:54.696010 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:43:54.696010 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:43:54.696010 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:43:54.696010 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c3c1bec-8119-424c-84ad-682c05e27f58 could not be found. Aug 27 03:43:54.696010 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:43:54.696010 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:43:54.696010 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:43:54.699573 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:43:54.699573 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:43:54.699573 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:43:54.699573 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:43:54.699573 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:43:54.699573 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c3c1bec-8119-424c-84ad-682c05e27f58 could not be found. Aug 27 03:43:54.699573 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:43:54.699573 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-5f3728d5-cc6f-4547-b6dc-89dc4394f0f8 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Returning 404 to user: Instance 2c3c1bec-8119-424c-84ad-682c05e27f58 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:43:54.699573 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-5f3728d5-cc6f-4547-b6dc-89dc4394f0f8 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58" status: 404 len: 111 microversion: 2.1 time: 0.032154 Aug 27 03:43:54.699573 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3364/6681] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:43:54 2022] GET /compute/v2.1/servers/2c3c1bec-8119-424c-84ad-682c05e27f58 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:43:54.706326 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ffcd7e69-0cea-45d5-ace8-0a58d4f7dc44 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:43:54.706829 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-ffcd7e69-0cea-45d5-ace8-0a58d4f7dc44 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: f3926721-ba47-4cb4-ac57-6777811cd549] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:43:54.713461 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ffcd7e69-0cea-45d5-ace8-0a58d4f7dc44 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:54.713951 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ffcd7e69-0cea-45d5-ace8-0a58d4f7dc44 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:54.714384 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ffcd7e69-0cea-45d5-ace8-0a58d4f7dc44 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:54.715096 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ffcd7e69-0cea-45d5-ace8-0a58d4f7dc44 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:54.715582 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ffcd7e69-0cea-45d5-ace8-0a58d4f7dc44 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:54.715994 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ffcd7e69-0cea-45d5-ace8-0a58d4f7dc44 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:54.731165 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-ffcd7e69-0cea-45d5-ace8-0a58d4f7dc44 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] HTTP exception thrown: Instance f3926721-ba47-4cb4-ac57-6777811cd549 could not be found. Aug 27 03:43:54.732793 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ffcd7e69-0cea-45d5-ace8-0a58d4f7dc44 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Request method failure captured: Aug 27 03:43:54.732793 n-d-852278-4 devstack@n-api.service[134052]: request: DELETE /compute/v2.1/servers/f3926721-ba47-4cb4-ac57-6777811cd549 HTTP/1.1 Aug 27 03:43:54.732793 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 03:43:54.732793 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 03:43:54.732793 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 03:43:54.732793 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 03:43:54.732793 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 03:43:54.732793 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 03:43:54.732793 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 03:43:54.732793 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 03:43:54.732793 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCZGWxk5BEicF9AwnrkJwBWPfwg6arCi_dT6E6ZVU5_NhdiLiUMoMZ2Q_dYvmFaxRe7rt1FqUkb8B6Jv9aLrdZAOB6sF0tJV32UJ88bJE_iEEa6wH556BrFuazMURlys8Bi6SN-7FaZo2zdThDqlQ_upK7UsTTNFT7YiOxJI35LhaDsc Aug 27 03:43:54.732793 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 03:43:54.732793 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 03:43:54.732793 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 03:43:54.732793 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 03:43:54.732793 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 03:43:54.732793 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 03:43:54.732793 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: cc3aa9846bcb40518ac54e31208ce043 Aug 27 03:43:54.732793 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ServerActionsTestJSON-577023370 Aug 27 03:43:54.732793 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 03:43:54.732793 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 03:43:54.732793 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cc3aa9846bcb40518ac54e31208ce043"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_cc3aa9846bcb40518ac54e31208ce043", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cc3aa9846bcb40518ac54e31208ce043"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/cc3aa9846bcb40518ac54e31208ce043"}]}] Aug 27 03:43:54.732793 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ServerActionsTestJSON-577023370 Aug 27 03:43:54.732793 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: cc3aa9846bcb40518ac54e31208ce043 Aug 27 03:43:54.732793 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ServerActionsTestJSON-577023370 Aug 27 03:43:54.732793 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ServerActionsTestJSON-577023370-project Aug 27 03:43:54.732793 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 03:43:54.732793 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 03:43:54.732793 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: c62665fa43c34e6eb695633905cf3b84 Aug 27 03:43:54.732793 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ServerActionsTestJSON-577023370-project Aug 27 03:43:54.732793 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 03:43:54.732793 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance f3926721-ba47-4cb4-ac57-6777811cd549 could not be found. Aug 27 03:43:54.732793 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': 'f3926721-ba47-4cb4-ac57-6777811cd549'} Aug 27 03:43:54.732793 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:43:54.732793 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:43:54.732793 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:43:54.732793 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:43:54.732793 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:43:54.732793 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:43:54.732793 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:43:54.732793 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:43:54.732793 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:43:54.732793 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:43:54.732793 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3926721-ba47-4cb4-ac57-6777811cd549 could not be found. Aug 27 03:43:54.732793 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:43:54.732793 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:43:54.732793 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:43:54.732793 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:43:54.732793 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:43:54.732793 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:43:54.732793 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:43:54.732793 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:43:54.732793 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:43:54.732793 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:43:54.732793 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 03:43:54.732793 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 03:43:54.732793 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 03:43:54.732793 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 03:43:54.732793 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:43:54.732793 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:43:54.732793 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:43:54.732793 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:43:54.736574 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3926721-ba47-4cb4-ac57-6777811cd549 could not be found. Aug 27 03:43:54.736574 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:43:54.736574 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:43:54.736574 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:43:54.736574 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:43:54.736574 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:43:54.736574 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:43:54.736574 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:43:54.736574 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:43:54.736574 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3926721-ba47-4cb4-ac57-6777811cd549 could not be found. Aug 27 03:43:54.736574 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:43:54.736574 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ffcd7e69-0cea-45d5-ace8-0a58d4f7dc44 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Returning 404 to user: Instance f3926721-ba47-4cb4-ac57-6777811cd549 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:43:54.736574 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ffcd7e69-0cea-45d5-ace8-0a58d4f7dc44 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "DELETE /compute/v2.1/servers/f3926721-ba47-4cb4-ac57-6777811cd549" status: 404 len: 111 microversion: 2.1 time: 0.031848 Aug 27 03:43:54.736574 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3318/6682] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 03:43:54 2022] DELETE /compute/v2.1/servers/f3926721-ba47-4cb4-ac57-6777811cd549 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:43:54.743558 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3e4f56f2-1a9f-4e4b-9b10-ea6618efe42d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:43:54.744193 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-3e4f56f2-1a9f-4e4b-9b10-ea6618efe42d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: f3926721-ba47-4cb4-ac57-6777811cd549] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:43:54.750797 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3e4f56f2-1a9f-4e4b-9b10-ea6618efe42d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:54.751378 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3e4f56f2-1a9f-4e4b-9b10-ea6618efe42d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:54.751835 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3e4f56f2-1a9f-4e4b-9b10-ea6618efe42d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:54.752604 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3e4f56f2-1a9f-4e4b-9b10-ea6618efe42d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:54.753082 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3e4f56f2-1a9f-4e4b-9b10-ea6618efe42d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:54.753530 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3e4f56f2-1a9f-4e4b-9b10-ea6618efe42d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:54.768497 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-3e4f56f2-1a9f-4e4b-9b10-ea6618efe42d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] HTTP exception thrown: Instance f3926721-ba47-4cb4-ac57-6777811cd549 could not be found. Aug 27 03:43:54.770120 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3e4f56f2-1a9f-4e4b-9b10-ea6618efe42d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Request method failure captured: Aug 27 03:43:54.770120 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/f3926721-ba47-4cb4-ac57-6777811cd549 HTTP/1.1 Aug 27 03:43:54.770120 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 03:43:54.770120 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 03:43:54.770120 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 03:43:54.770120 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 03:43:54.770120 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 03:43:54.770120 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 03:43:54.770120 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 03:43:54.770120 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 03:43:54.770120 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCZGWxk5BEicF9AwnrkJwBWPfwg6arCi_dT6E6ZVU5_NhdiLiUMoMZ2Q_dYvmFaxRe7rt1FqUkb8B6Jv9aLrdZAOB6sF0tJV32UJ88bJE_iEEa6wH556BrFuazMURlys8Bi6SN-7FaZo2zdThDqlQ_upK7UsTTNFT7YiOxJI35LhaDsc Aug 27 03:43:54.770120 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 03:43:54.770120 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 03:43:54.770120 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 03:43:54.770120 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 03:43:54.770120 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 03:43:54.770120 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 03:43:54.770120 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: cc3aa9846bcb40518ac54e31208ce043 Aug 27 03:43:54.770120 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ServerActionsTestJSON-577023370 Aug 27 03:43:54.770120 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 03:43:54.770120 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 03:43:54.770120 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cc3aa9846bcb40518ac54e31208ce043"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_cc3aa9846bcb40518ac54e31208ce043", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cc3aa9846bcb40518ac54e31208ce043"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/cc3aa9846bcb40518ac54e31208ce043"}]}] Aug 27 03:43:54.770120 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ServerActionsTestJSON-577023370 Aug 27 03:43:54.770120 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: cc3aa9846bcb40518ac54e31208ce043 Aug 27 03:43:54.770120 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ServerActionsTestJSON-577023370 Aug 27 03:43:54.770120 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ServerActionsTestJSON-577023370-project Aug 27 03:43:54.770120 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 03:43:54.770120 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 03:43:54.770120 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: c62665fa43c34e6eb695633905cf3b84 Aug 27 03:43:54.770120 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ServerActionsTestJSON-577023370-project Aug 27 03:43:54.770120 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 03:43:54.770120 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance f3926721-ba47-4cb4-ac57-6777811cd549 could not be found. Aug 27 03:43:54.770120 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': 'f3926721-ba47-4cb4-ac57-6777811cd549'} Aug 27 03:43:54.770120 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:43:54.770120 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:43:54.770120 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:43:54.770120 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:43:54.770120 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:43:54.770120 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:43:54.770120 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:43:54.770120 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:43:54.770120 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:43:54.770120 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:43:54.770120 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3926721-ba47-4cb4-ac57-6777811cd549 could not be found. Aug 27 03:43:54.770120 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:43:54.770120 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:43:54.770120 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:43:54.770120 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:43:54.770120 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:43:54.770120 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:43:54.770120 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:43:54.770120 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:43:54.770120 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:43:54.770120 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:43:54.770120 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:43:54.770120 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:43:54.770120 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:43:54.770120 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:43:54.770120 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:43:54.770120 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:43:54.770120 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3926721-ba47-4cb4-ac57-6777811cd549 could not be found. Aug 27 03:43:54.770120 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:43:54.770120 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:43:54.770120 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:43:54.774342 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:43:54.774342 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:43:54.774342 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:43:54.774342 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:43:54.774342 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:43:54.774342 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3926721-ba47-4cb4-ac57-6777811cd549 could not be found. Aug 27 03:43:54.774342 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:43:54.774342 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3e4f56f2-1a9f-4e4b-9b10-ea6618efe42d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Returning 404 to user: Instance f3926721-ba47-4cb4-ac57-6777811cd549 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:43:54.774342 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-3e4f56f2-1a9f-4e4b-9b10-ea6618efe42d tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/f3926721-ba47-4cb4-ac57-6777811cd549" status: 404 len: 111 microversion: 2.1 time: 0.032184 Aug 27 03:43:54.774342 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3365/6683] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:43:54 2022] GET /compute/v2.1/servers/f3926721-ba47-4cb4-ac57-6777811cd549 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:43:54.781013 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-04b5b119-9cf1-4ad0-a419-9aff5e4d8938 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:43:54.781499 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-04b5b119-9cf1-4ad0-a419-9aff5e4d8938 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 14245f9c-71e1-4dc8-ab39-783e2610f6e4] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:43:54.787780 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-04b5b119-9cf1-4ad0-a419-9aff5e4d8938 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:54.788261 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-04b5b119-9cf1-4ad0-a419-9aff5e4d8938 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:54.788748 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-04b5b119-9cf1-4ad0-a419-9aff5e4d8938 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:54.789433 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-04b5b119-9cf1-4ad0-a419-9aff5e4d8938 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:54.789873 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-04b5b119-9cf1-4ad0-a419-9aff5e4d8938 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:54.790285 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-04b5b119-9cf1-4ad0-a419-9aff5e4d8938 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:54.805058 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-04b5b119-9cf1-4ad0-a419-9aff5e4d8938 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] HTTP exception thrown: Instance 14245f9c-71e1-4dc8-ab39-783e2610f6e4 could not be found. Aug 27 03:43:54.806613 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-04b5b119-9cf1-4ad0-a419-9aff5e4d8938 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Request method failure captured: Aug 27 03:43:54.806613 n-d-852278-4 devstack@n-api.service[134052]: request: DELETE /compute/v2.1/servers/14245f9c-71e1-4dc8-ab39-783e2610f6e4 HTTP/1.1 Aug 27 03:43:54.806613 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 03:43:54.806613 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 03:43:54.806613 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 03:43:54.806613 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 03:43:54.806613 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 03:43:54.806613 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 03:43:54.806613 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 03:43:54.806613 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 03:43:54.806613 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCZGWxk5BEicF9AwnrkJwBWPfwg6arCi_dT6E6ZVU5_NhdiLiUMoMZ2Q_dYvmFaxRe7rt1FqUkb8B6Jv9aLrdZAOB6sF0tJV32UJ88bJE_iEEa6wH556BrFuazMURlys8Bi6SN-7FaZo2zdThDqlQ_upK7UsTTNFT7YiOxJI35LhaDsc Aug 27 03:43:54.806613 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 03:43:54.806613 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 03:43:54.806613 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 03:43:54.806613 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 03:43:54.806613 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 03:43:54.806613 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 03:43:54.806613 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: cc3aa9846bcb40518ac54e31208ce043 Aug 27 03:43:54.806613 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ServerActionsTestJSON-577023370 Aug 27 03:43:54.806613 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 03:43:54.806613 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 03:43:54.806613 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cc3aa9846bcb40518ac54e31208ce043"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_cc3aa9846bcb40518ac54e31208ce043", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cc3aa9846bcb40518ac54e31208ce043"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/cc3aa9846bcb40518ac54e31208ce043"}]}] Aug 27 03:43:54.806613 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ServerActionsTestJSON-577023370 Aug 27 03:43:54.806613 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: cc3aa9846bcb40518ac54e31208ce043 Aug 27 03:43:54.806613 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ServerActionsTestJSON-577023370 Aug 27 03:43:54.806613 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ServerActionsTestJSON-577023370-project Aug 27 03:43:54.806613 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 03:43:54.806613 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 03:43:54.806613 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: c62665fa43c34e6eb695633905cf3b84 Aug 27 03:43:54.806613 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ServerActionsTestJSON-577023370-project Aug 27 03:43:54.806613 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 03:43:54.806613 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance 14245f9c-71e1-4dc8-ab39-783e2610f6e4 could not be found. Aug 27 03:43:54.806613 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '14245f9c-71e1-4dc8-ab39-783e2610f6e4'} Aug 27 03:43:54.806613 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:43:54.806613 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:43:54.806613 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:43:54.806613 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:43:54.806613 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:43:54.806613 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:43:54.806613 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:43:54.806613 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:43:54.806613 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:43:54.806613 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:43:54.806613 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14245f9c-71e1-4dc8-ab39-783e2610f6e4 could not be found. Aug 27 03:43:54.806613 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:43:54.806613 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:43:54.806613 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:43:54.806613 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:43:54.806613 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:43:54.806613 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:43:54.806613 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:43:54.806613 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:43:54.806613 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:43:54.806613 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:43:54.806613 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 03:43:54.806613 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 03:43:54.806613 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 03:43:54.806613 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 03:43:54.806613 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:43:54.806613 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:43:54.806613 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:43:54.806613 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:43:54.810071 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14245f9c-71e1-4dc8-ab39-783e2610f6e4 could not be found. Aug 27 03:43:54.810071 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:43:54.810071 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:43:54.810071 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:43:54.810071 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:43:54.810071 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:43:54.810071 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:43:54.810071 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:43:54.810071 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:43:54.810071 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14245f9c-71e1-4dc8-ab39-783e2610f6e4 could not be found. Aug 27 03:43:54.810071 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:43:54.810071 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-04b5b119-9cf1-4ad0-a419-9aff5e4d8938 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Returning 404 to user: Instance 14245f9c-71e1-4dc8-ab39-783e2610f6e4 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:43:54.810071 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-04b5b119-9cf1-4ad0-a419-9aff5e4d8938 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "DELETE /compute/v2.1/servers/14245f9c-71e1-4dc8-ab39-783e2610f6e4" status: 404 len: 111 microversion: 2.1 time: 0.031483 Aug 27 03:43:54.810071 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3319/6684] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 03:43:54 2022] DELETE /compute/v2.1/servers/14245f9c-71e1-4dc8-ab39-783e2610f6e4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:43:54.816962 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-bc22a82c-d6b5-41f6-8ebf-de39b919c131 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:43:54.817589 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-bc22a82c-d6b5-41f6-8ebf-de39b919c131 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 14245f9c-71e1-4dc8-ab39-783e2610f6e4] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:43:54.823935 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bc22a82c-d6b5-41f6-8ebf-de39b919c131 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:54.824437 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bc22a82c-d6b5-41f6-8ebf-de39b919c131 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:54.824923 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bc22a82c-d6b5-41f6-8ebf-de39b919c131 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:54.825627 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bc22a82c-d6b5-41f6-8ebf-de39b919c131 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:54.826096 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bc22a82c-d6b5-41f6-8ebf-de39b919c131 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:54.826534 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bc22a82c-d6b5-41f6-8ebf-de39b919c131 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:54.840483 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-bc22a82c-d6b5-41f6-8ebf-de39b919c131 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] HTTP exception thrown: Instance 14245f9c-71e1-4dc8-ab39-783e2610f6e4 could not be found. Aug 27 03:43:54.842075 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-bc22a82c-d6b5-41f6-8ebf-de39b919c131 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Request method failure captured: Aug 27 03:43:54.842075 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/14245f9c-71e1-4dc8-ab39-783e2610f6e4 HTTP/1.1 Aug 27 03:43:54.842075 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 03:43:54.842075 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 03:43:54.842075 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 03:43:54.842075 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 03:43:54.842075 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 03:43:54.842075 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 03:43:54.842075 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 03:43:54.842075 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 03:43:54.842075 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCZGWxk5BEicF9AwnrkJwBWPfwg6arCi_dT6E6ZVU5_NhdiLiUMoMZ2Q_dYvmFaxRe7rt1FqUkb8B6Jv9aLrdZAOB6sF0tJV32UJ88bJE_iEEa6wH556BrFuazMURlys8Bi6SN-7FaZo2zdThDqlQ_upK7UsTTNFT7YiOxJI35LhaDsc Aug 27 03:43:54.842075 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 03:43:54.842075 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 03:43:54.842075 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 03:43:54.842075 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 03:43:54.842075 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 03:43:54.842075 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 03:43:54.842075 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: cc3aa9846bcb40518ac54e31208ce043 Aug 27 03:43:54.842075 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ServerActionsTestJSON-577023370 Aug 27 03:43:54.842075 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 03:43:54.842075 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 03:43:54.842075 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cc3aa9846bcb40518ac54e31208ce043"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_cc3aa9846bcb40518ac54e31208ce043", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cc3aa9846bcb40518ac54e31208ce043"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/cc3aa9846bcb40518ac54e31208ce043"}]}] Aug 27 03:43:54.842075 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ServerActionsTestJSON-577023370 Aug 27 03:43:54.842075 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: cc3aa9846bcb40518ac54e31208ce043 Aug 27 03:43:54.842075 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ServerActionsTestJSON-577023370 Aug 27 03:43:54.842075 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ServerActionsTestJSON-577023370-project Aug 27 03:43:54.842075 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 03:43:54.842075 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 03:43:54.842075 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: c62665fa43c34e6eb695633905cf3b84 Aug 27 03:43:54.842075 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ServerActionsTestJSON-577023370-project Aug 27 03:43:54.842075 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 03:43:54.842075 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance 14245f9c-71e1-4dc8-ab39-783e2610f6e4 could not be found. Aug 27 03:43:54.842075 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '14245f9c-71e1-4dc8-ab39-783e2610f6e4'} Aug 27 03:43:54.842075 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:43:54.842075 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:43:54.842075 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:43:54.842075 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:43:54.842075 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:43:54.842075 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:43:54.842075 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:43:54.842075 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:43:54.842075 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:43:54.842075 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:43:54.842075 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14245f9c-71e1-4dc8-ab39-783e2610f6e4 could not be found. Aug 27 03:43:54.842075 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:43:54.842075 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:43:54.842075 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:43:54.842075 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:43:54.842075 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:43:54.842075 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:43:54.842075 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:43:54.842075 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:43:54.842075 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:43:54.842075 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:43:54.842075 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:43:54.842075 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:43:54.842075 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:43:54.842075 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:43:54.842075 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:43:54.842075 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:43:54.842075 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14245f9c-71e1-4dc8-ab39-783e2610f6e4 could not be found. Aug 27 03:43:54.842075 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:43:54.842075 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:43:54.842075 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:43:54.845710 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:43:54.845710 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:43:54.845710 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:43:54.845710 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:43:54.845710 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:43:54.845710 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14245f9c-71e1-4dc8-ab39-783e2610f6e4 could not be found. Aug 27 03:43:54.845710 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:43:54.845710 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-bc22a82c-d6b5-41f6-8ebf-de39b919c131 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Returning 404 to user: Instance 14245f9c-71e1-4dc8-ab39-783e2610f6e4 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:43:54.845710 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-bc22a82c-d6b5-41f6-8ebf-de39b919c131 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/14245f9c-71e1-4dc8-ab39-783e2610f6e4" status: 404 len: 111 microversion: 2.1 time: 0.030536 Aug 27 03:43:54.845710 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3366/6685] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:43:54 2022] GET /compute/v2.1/servers/14245f9c-71e1-4dc8-ab39-783e2610f6e4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 03:43:54.852192 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4a6e1021-6314-4520-a89a-dd0663d3ba6f tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:43:54.852708 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-4a6e1021-6314-4520-a89a-dd0663d3ba6f tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c06803f-bcfc-48f5-be04-98e6f981a03c] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:43:54.859033 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4a6e1021-6314-4520-a89a-dd0663d3ba6f tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:54.859445 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4a6e1021-6314-4520-a89a-dd0663d3ba6f tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:54.859860 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4a6e1021-6314-4520-a89a-dd0663d3ba6f tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:54.860616 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4a6e1021-6314-4520-a89a-dd0663d3ba6f tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:54.861067 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4a6e1021-6314-4520-a89a-dd0663d3ba6f tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:54.861482 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4a6e1021-6314-4520-a89a-dd0663d3ba6f tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:54.875404 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-4a6e1021-6314-4520-a89a-dd0663d3ba6f tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] HTTP exception thrown: Instance 2c06803f-bcfc-48f5-be04-98e6f981a03c could not be found. Aug 27 03:43:54.877013 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4a6e1021-6314-4520-a89a-dd0663d3ba6f tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Request method failure captured: Aug 27 03:43:54.877013 n-d-852278-4 devstack@n-api.service[134052]: request: DELETE /compute/v2.1/servers/2c06803f-bcfc-48f5-be04-98e6f981a03c HTTP/1.1 Aug 27 03:43:54.877013 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 03:43:54.877013 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 03:43:54.877013 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 03:43:54.877013 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 03:43:54.877013 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 03:43:54.877013 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 03:43:54.877013 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 03:43:54.877013 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 03:43:54.877013 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCZGWxk5BEicF9AwnrkJwBWPfwg6arCi_dT6E6ZVU5_NhdiLiUMoMZ2Q_dYvmFaxRe7rt1FqUkb8B6Jv9aLrdZAOB6sF0tJV32UJ88bJE_iEEa6wH556BrFuazMURlys8Bi6SN-7FaZo2zdThDqlQ_upK7UsTTNFT7YiOxJI35LhaDsc Aug 27 03:43:54.877013 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 03:43:54.877013 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 03:43:54.877013 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 03:43:54.877013 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 03:43:54.877013 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 03:43:54.877013 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 03:43:54.877013 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: cc3aa9846bcb40518ac54e31208ce043 Aug 27 03:43:54.877013 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ServerActionsTestJSON-577023370 Aug 27 03:43:54.877013 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 03:43:54.877013 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 03:43:54.877013 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cc3aa9846bcb40518ac54e31208ce043"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_cc3aa9846bcb40518ac54e31208ce043", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cc3aa9846bcb40518ac54e31208ce043"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/cc3aa9846bcb40518ac54e31208ce043"}]}] Aug 27 03:43:54.877013 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ServerActionsTestJSON-577023370 Aug 27 03:43:54.877013 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: cc3aa9846bcb40518ac54e31208ce043 Aug 27 03:43:54.877013 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ServerActionsTestJSON-577023370 Aug 27 03:43:54.877013 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ServerActionsTestJSON-577023370-project Aug 27 03:43:54.877013 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 03:43:54.877013 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 03:43:54.877013 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: c62665fa43c34e6eb695633905cf3b84 Aug 27 03:43:54.877013 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ServerActionsTestJSON-577023370-project Aug 27 03:43:54.877013 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 03:43:54.877013 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance 2c06803f-bcfc-48f5-be04-98e6f981a03c could not be found. Aug 27 03:43:54.877013 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '2c06803f-bcfc-48f5-be04-98e6f981a03c'} Aug 27 03:43:54.877013 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:43:54.877013 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:43:54.877013 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:43:54.877013 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:43:54.877013 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:43:54.877013 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:43:54.877013 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:43:54.877013 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:43:54.877013 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:43:54.877013 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:43:54.877013 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c06803f-bcfc-48f5-be04-98e6f981a03c could not be found. Aug 27 03:43:54.877013 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:43:54.877013 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:43:54.877013 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:43:54.877013 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:43:54.877013 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:43:54.877013 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:43:54.877013 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:43:54.877013 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:43:54.877013 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:43:54.877013 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:43:54.877013 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 03:43:54.877013 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 03:43:54.877013 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 03:43:54.877013 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 03:43:54.877013 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:43:54.877013 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:43:54.877013 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:43:54.877013 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:43:54.880517 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c06803f-bcfc-48f5-be04-98e6f981a03c could not be found. Aug 27 03:43:54.880517 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:43:54.880517 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:43:54.880517 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:43:54.880517 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:43:54.880517 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:43:54.880517 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:43:54.880517 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:43:54.880517 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:43:54.880517 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c06803f-bcfc-48f5-be04-98e6f981a03c could not be found. Aug 27 03:43:54.880517 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:43:54.880517 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4a6e1021-6314-4520-a89a-dd0663d3ba6f tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Returning 404 to user: Instance 2c06803f-bcfc-48f5-be04-98e6f981a03c could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:43:54.880517 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-4a6e1021-6314-4520-a89a-dd0663d3ba6f tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "DELETE /compute/v2.1/servers/2c06803f-bcfc-48f5-be04-98e6f981a03c" status: 404 len: 111 microversion: 2.1 time: 0.030148 Aug 27 03:43:54.880517 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3320/6686] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 03:43:54 2022] DELETE /compute/v2.1/servers/2c06803f-bcfc-48f5-be04-98e6f981a03c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 03:43:54.887282 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-45618fef-34ed-4730-bf47-a5f535018f3e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:43:54.887925 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-45618fef-34ed-4730-bf47-a5f535018f3e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] [instance: 2c06803f-bcfc-48f5-be04-98e6f981a03c] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:43:54.894259 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-45618fef-34ed-4730-bf47-a5f535018f3e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:54.894770 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-45618fef-34ed-4730-bf47-a5f535018f3e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:54.895228 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-45618fef-34ed-4730-bf47-a5f535018f3e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:54.895951 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-45618fef-34ed-4730-bf47-a5f535018f3e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:54.896516 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-45618fef-34ed-4730-bf47-a5f535018f3e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:54.896969 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-45618fef-34ed-4730-bf47-a5f535018f3e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:54.911280 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-45618fef-34ed-4730-bf47-a5f535018f3e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] HTTP exception thrown: Instance 2c06803f-bcfc-48f5-be04-98e6f981a03c could not be found. Aug 27 03:43:54.912993 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-45618fef-34ed-4730-bf47-a5f535018f3e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Request method failure captured: Aug 27 03:43:54.912993 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/2c06803f-bcfc-48f5-be04-98e6f981a03c HTTP/1.1 Aug 27 03:43:54.912993 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 03:43:54.912993 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 03:43:54.912993 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 03:43:54.912993 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 03:43:54.912993 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 03:43:54.912993 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 03:43:54.912993 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 03:43:54.912993 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 03:43:54.912993 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCZGWxk5BEicF9AwnrkJwBWPfwg6arCi_dT6E6ZVU5_NhdiLiUMoMZ2Q_dYvmFaxRe7rt1FqUkb8B6Jv9aLrdZAOB6sF0tJV32UJ88bJE_iEEa6wH556BrFuazMURlys8Bi6SN-7FaZo2zdThDqlQ_upK7UsTTNFT7YiOxJI35LhaDsc Aug 27 03:43:54.912993 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 03:43:54.912993 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 03:43:54.912993 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 03:43:54.912993 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 03:43:54.912993 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 03:43:54.912993 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 03:43:54.912993 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: cc3aa9846bcb40518ac54e31208ce043 Aug 27 03:43:54.912993 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ServerActionsTestJSON-577023370 Aug 27 03:43:54.912993 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 03:43:54.912993 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 03:43:54.912993 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cc3aa9846bcb40518ac54e31208ce043"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_cc3aa9846bcb40518ac54e31208ce043", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cc3aa9846bcb40518ac54e31208ce043"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/cc3aa9846bcb40518ac54e31208ce043"}]}] Aug 27 03:43:54.912993 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ServerActionsTestJSON-577023370 Aug 27 03:43:54.912993 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: cc3aa9846bcb40518ac54e31208ce043 Aug 27 03:43:54.912993 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ServerActionsTestJSON-577023370 Aug 27 03:43:54.912993 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ServerActionsTestJSON-577023370-project Aug 27 03:43:54.912993 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 03:43:54.912993 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 03:43:54.912993 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: c62665fa43c34e6eb695633905cf3b84 Aug 27 03:43:54.912993 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ServerActionsTestJSON-577023370-project Aug 27 03:43:54.912993 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 03:43:54.912993 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance 2c06803f-bcfc-48f5-be04-98e6f981a03c could not be found. Aug 27 03:43:54.912993 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '2c06803f-bcfc-48f5-be04-98e6f981a03c'} Aug 27 03:43:54.912993 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:43:54.912993 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:43:54.912993 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:43:54.912993 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:43:54.912993 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:43:54.912993 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:43:54.912993 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:43:54.912993 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:43:54.912993 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:43:54.912993 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:43:54.912993 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c06803f-bcfc-48f5-be04-98e6f981a03c could not be found. Aug 27 03:43:54.912993 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:43:54.912993 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:43:54.912993 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:43:54.912993 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:43:54.912993 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:43:54.912993 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:43:54.912993 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:43:54.912993 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:43:54.912993 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:43:54.912993 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:43:54.912993 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:43:54.912993 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:43:54.912993 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:43:54.912993 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:43:54.912993 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:43:54.912993 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:43:54.912993 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c06803f-bcfc-48f5-be04-98e6f981a03c could not be found. Aug 27 03:43:54.912993 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:43:54.912993 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:43:54.912993 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:43:54.916485 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:43:54.916485 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:43:54.916485 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:43:54.916485 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:43:54.916485 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:43:54.916485 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c06803f-bcfc-48f5-be04-98e6f981a03c could not be found. Aug 27 03:43:54.916485 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:43:54.916485 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-45618fef-34ed-4730-bf47-a5f535018f3e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Returning 404 to user: Instance 2c06803f-bcfc-48f5-be04-98e6f981a03c could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:43:54.916485 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-45618fef-34ed-4730-bf47-a5f535018f3e tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "GET /compute/v2.1/servers/2c06803f-bcfc-48f5-be04-98e6f981a03c" status: 404 len: 111 microversion: 2.1 time: 0.031197 Aug 27 03:43:54.916485 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3367/6687] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:43:54 2022] GET /compute/v2.1/servers/2c06803f-bcfc-48f5-be04-98e6f981a03c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:43:54.923954 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d75362b2-a27c-4c83-806e-23d55dbc68c0 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] Calling method '.version_select at 0x7f5ee1d4a280>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:43:54.948928 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d75362b2-a27c-4c83-806e-23d55dbc68c0 tempest-ServerActionsTestJSON-577023370 tempest-ServerActionsTestJSON-577023370-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1055144708" status: 202 len: 0 microversion: 2.1 time: 0.029215 Aug 27 03:43:54.949528 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3321/6688] 10.222.0.70 () {58 vars in 1221 bytes} [Sat Aug 27 03:43:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1055144708 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:44:04.540770 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-55cbbca2-d74c-4a90-b897-bdfafda440d4 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-863889325", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "networks": [{"uuid": "5f42ce35-17c7-415c-9a19-7b32e3339b49"}]}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:44:04.601853 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.network.neutron [None req-55cbbca2-d74c-4a90-b897-bdfafda440d4 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] validate_networks() for [('5f42ce35-17c7-415c-9a19-7b32e3339b49', None, None, None, None, None)] {{(pid=134051) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:44:04.902173 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:44:05.025985 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-55cbbca2-d74c-4a90-b897-bdfafda440d4 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Flavor limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:44:05.026428 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-55cbbca2-d74c-4a90-b897-bdfafda440d4 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Image limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:44:05.026942 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-55cbbca2-d74c-4a90-b897-bdfafda440d4 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Flavor pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:44:05.027399 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-55cbbca2-d74c-4a90-b897-bdfafda440d4 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Image pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:44:05.027823 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-55cbbca2-d74c-4a90-b897-bdfafda440d4 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:44:05.037621 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-55cbbca2-d74c-4a90-b897-bdfafda440d4 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:05.038120 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-55cbbca2-d74c-4a90-b897-bdfafda440d4 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:05.038656 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-55cbbca2-d74c-4a90-b897-bdfafda440d4 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:05.039386 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-55cbbca2-d74c-4a90-b897-bdfafda440d4 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:05.039854 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-55cbbca2-d74c-4a90-b897-bdfafda440d4 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:05.040381 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-55cbbca2-d74c-4a90-b897-bdfafda440d4 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:05.059239 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-55cbbca2-d74c-4a90-b897-bdfafda440d4 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Getting quotas for project 35c9f8663768487f8b3bcf05019bc7c6. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:44:05.065242 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-55cbbca2-d74c-4a90-b897-bdfafda440d4 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Getting quotas for user f4bfa2f8d8664c84bd1e26ac1311dcb0 and project 35c9f8663768487f8b3bcf05019bc7c6. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:44:05.080105 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-55cbbca2-d74c-4a90-b897-bdfafda440d4 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Going to run 1 instances... {{(pid=134051) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:44:05.082620 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-55cbbca2-d74c-4a90-b897-bdfafda440d4 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] [instance: a1d12a99-fc51-4ffa-b296-7cca38d78ae7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134051) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:44:05.132506 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-55cbbca2-d74c-4a90-b897-bdfafda440d4 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.739874 Aug 27 03:44:05.133228 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3368/6689] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 03:44:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 742 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:44:05.142266 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=15 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:44:05.143566 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=14,nova_api:DELETE=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:44:05.148356 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-69c5ad4a-9098-4873-95e5-f48b73ff1bd9 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:44:05.148988 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-69c5ad4a-9098-4873-95e5-f48b73ff1bd9 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] [instance: a1d12a99-fc51-4ffa-b296-7cca38d78ae7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:44:05.205602 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-69c5ad4a-9098-4873-95e5-f48b73ff1bd9 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4bfa2f8d8664c84bd1e26ac1311dcb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c9f8663768487f8b3bcf05019bc7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:44:05.212656 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-69c5ad4a-9098-4873-95e5-f48b73ff1bd9 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] 10.222.0.70 "GET /compute/v2.1/servers/a1d12a99-fc51-4ffa-b296-7cca38d78ae7" status: 200 len: 1216 microversion: 2.1 time: 0.072448 Aug 27 03:44:05.213236 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3322/6690] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:44:05 2022] GET /compute/v2.1/servers/a1d12a99-fc51-4ffa-b296-7cca38d78ae7 => generated 1216 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:44:06.234166 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-2fa9bcd9-c30d-417e-93d2-2ab71b8cd0fc tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:44:06.234699 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-2fa9bcd9-c30d-417e-93d2-2ab71b8cd0fc tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] [instance: a1d12a99-fc51-4ffa-b296-7cca38d78ae7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:44:06.308252 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-2fa9bcd9-c30d-417e-93d2-2ab71b8cd0fc tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4bfa2f8d8664c84bd1e26ac1311dcb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c9f8663768487f8b3bcf05019bc7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:44:06.315551 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-2fa9bcd9-c30d-417e-93d2-2ab71b8cd0fc tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] 10.222.0.70 "GET /compute/v2.1/servers/a1d12a99-fc51-4ffa-b296-7cca38d78ae7" status: 200 len: 1216 microversion: 2.1 time: 0.086336 Aug 27 03:44:06.316150 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3369/6691] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:44:06 2022] GET /compute/v2.1/servers/a1d12a99-fc51-4ffa-b296-7cca38d78ae7 => generated 1216 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:44:07.335567 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-59406440-5bc7-4f71-8ae4-28cc9f2d72fb tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:44:07.336268 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-59406440-5bc7-4f71-8ae4-28cc9f2d72fb tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] [instance: a1d12a99-fc51-4ffa-b296-7cca38d78ae7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:44:07.392257 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-59406440-5bc7-4f71-8ae4-28cc9f2d72fb tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4bfa2f8d8664c84bd1e26ac1311dcb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c9f8663768487f8b3bcf05019bc7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:44:07.399670 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-59406440-5bc7-4f71-8ae4-28cc9f2d72fb tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] 10.222.0.70 "GET /compute/v2.1/servers/a1d12a99-fc51-4ffa-b296-7cca38d78ae7" status: 200 len: 1216 microversion: 2.1 time: 0.068130 Aug 27 03:44:07.400546 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3323/6692] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:44:07 2022] GET /compute/v2.1/servers/a1d12a99-fc51-4ffa-b296-7cca38d78ae7 => generated 1216 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:44:08.420357 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a366ad48-2f29-4029-915d-19c73b6cc543 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:44:08.421378 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-a366ad48-2f29-4029-915d-19c73b6cc543 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] [instance: a1d12a99-fc51-4ffa-b296-7cca38d78ae7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:44:08.428236 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a366ad48-2f29-4029-915d-19c73b6cc543 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:08.428785 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a366ad48-2f29-4029-915d-19c73b6cc543 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:08.429242 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a366ad48-2f29-4029-915d-19c73b6cc543 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:08.429968 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a366ad48-2f29-4029-915d-19c73b6cc543 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:08.430473 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a366ad48-2f29-4029-915d-19c73b6cc543 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:08.430916 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a366ad48-2f29-4029-915d-19c73b6cc543 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:08.506685 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-a366ad48-2f29-4029-915d-19c73b6cc543 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4bfa2f8d8664c84bd1e26ac1311dcb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c9f8663768487f8b3bcf05019bc7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:44:08.515253 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a366ad48-2f29-4029-915d-19c73b6cc543 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] 10.222.0.70 "GET /compute/v2.1/servers/a1d12a99-fc51-4ffa-b296-7cca38d78ae7" status: 200 len: 1274 microversion: 2.1 time: 0.098831 Aug 27 03:44:08.515933 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3370/6693] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:44:08 2022] GET /compute/v2.1/servers/a1d12a99-fc51-4ffa-b296-7cca38d78ae7 => generated 1274 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:44:09.536876 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4cd7671a-6b84-476a-96b2-7d9a64470d82 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:44:09.537522 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-4cd7671a-6b84-476a-96b2-7d9a64470d82 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] [instance: a1d12a99-fc51-4ffa-b296-7cca38d78ae7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:44:09.545356 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4cd7671a-6b84-476a-96b2-7d9a64470d82 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:09.545843 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4cd7671a-6b84-476a-96b2-7d9a64470d82 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:09.546620 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4cd7671a-6b84-476a-96b2-7d9a64470d82 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:09.547317 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4cd7671a-6b84-476a-96b2-7d9a64470d82 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:09.547763 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4cd7671a-6b84-476a-96b2-7d9a64470d82 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:09.548180 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4cd7671a-6b84-476a-96b2-7d9a64470d82 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:09.727184 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-928e00ce-fdd8-48ca-ba21-e91ffc10e64b req-6ec71dbb-9379-42de-aac3-5847b255ba85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1d12a99-fc51-4ffa-b296-7cca38d78ae7", "tag": "e4ad8f5f-8d01-4172-85b0-2d85ee910237"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:44:09.736946 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-928e00ce-fdd8-48ca-ba21-e91ffc10e64b req-6ec71dbb-9379-42de-aac3-5847b255ba85 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:09.737449 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-928e00ce-fdd8-48ca-ba21-e91ffc10e64b req-6ec71dbb-9379-42de-aac3-5847b255ba85 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:09.737899 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-928e00ce-fdd8-48ca-ba21-e91ffc10e64b req-6ec71dbb-9379-42de-aac3-5847b255ba85 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:09.749020 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-928e00ce-fdd8-48ca-ba21-e91ffc10e64b req-6ec71dbb-9379-42de-aac3-5847b255ba85 service nova] Creating event network-changed:e4ad8f5f-8d01-4172-85b0-2d85ee910237 for instance a1d12a99-fc51-4ffa-b296-7cca38d78ae7 on n-h2-852278-4 Aug 27 03:44:09.754141 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-928e00ce-fdd8-48ca-ba21-e91ffc10e64b req-6ec71dbb-9379-42de-aac3-5847b255ba85 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094887 Aug 27 03:44:09.754765 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3371/6694] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:44:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:44:09.803770 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-4cd7671a-6b84-476a-96b2-7d9a64470d82 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4bfa2f8d8664c84bd1e26ac1311dcb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c9f8663768487f8b3bcf05019bc7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:44:09.812692 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-4cd7671a-6b84-476a-96b2-7d9a64470d82 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] 10.222.0.70 "GET /compute/v2.1/servers/a1d12a99-fc51-4ffa-b296-7cca38d78ae7" status: 200 len: 1316 microversion: 2.1 time: 0.279709 Aug 27 03:44:09.815021 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3324/6695] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:44:09 2022] GET /compute/v2.1/servers/a1d12a99-fc51-4ffa-b296-7cca38d78ae7 => generated 1316 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:44:10.840886 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a0d27470-2ab2-4f20-8008-330b70e2a646 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:44:10.841956 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-a0d27470-2ab2-4f20-8008-330b70e2a646 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] [instance: a1d12a99-fc51-4ffa-b296-7cca38d78ae7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:44:10.852271 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a0d27470-2ab2-4f20-8008-330b70e2a646 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:10.852800 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a0d27470-2ab2-4f20-8008-330b70e2a646 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:10.853252 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a0d27470-2ab2-4f20-8008-330b70e2a646 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:10.853969 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a0d27470-2ab2-4f20-8008-330b70e2a646 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:10.854437 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a0d27470-2ab2-4f20-8008-330b70e2a646 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:10.854879 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a0d27470-2ab2-4f20-8008-330b70e2a646 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:11.075713 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-a0d27470-2ab2-4f20-8008-330b70e2a646 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4bfa2f8d8664c84bd1e26ac1311dcb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c9f8663768487f8b3bcf05019bc7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:44:11.086429 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a0d27470-2ab2-4f20-8008-330b70e2a646 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] 10.222.0.70 "GET /compute/v2.1/servers/a1d12a99-fc51-4ffa-b296-7cca38d78ae7" status: 200 len: 1316 microversion: 2.1 time: 0.254622 Aug 27 03:44:11.087018 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3372/6696] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:44:10 2022] GET /compute/v2.1/servers/a1d12a99-fc51-4ffa-b296-7cca38d78ae7 => generated 1316 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:44:12.111954 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-49240680-8cf3-4aec-8871-4b6a1fcf9c58 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:44:12.113110 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-49240680-8cf3-4aec-8871-4b6a1fcf9c58 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] [instance: a1d12a99-fc51-4ffa-b296-7cca38d78ae7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:44:12.124977 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-49240680-8cf3-4aec-8871-4b6a1fcf9c58 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:12.125781 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-49240680-8cf3-4aec-8871-4b6a1fcf9c58 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:12.127144 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-49240680-8cf3-4aec-8871-4b6a1fcf9c58 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:12.127906 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-49240680-8cf3-4aec-8871-4b6a1fcf9c58 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:12.128756 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-49240680-8cf3-4aec-8871-4b6a1fcf9c58 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:12.129430 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-49240680-8cf3-4aec-8871-4b6a1fcf9c58 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:12.261582 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-49240680-8cf3-4aec-8871-4b6a1fcf9c58 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4bfa2f8d8664c84bd1e26ac1311dcb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c9f8663768487f8b3bcf05019bc7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:44:12.269974 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-49240680-8cf3-4aec-8871-4b6a1fcf9c58 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] 10.222.0.70 "GET /compute/v2.1/servers/a1d12a99-fc51-4ffa-b296-7cca38d78ae7" status: 200 len: 1316 microversion: 2.1 time: 0.164710 Aug 27 03:44:12.270556 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3325/6697] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:44:12 2022] GET /compute/v2.1/servers/a1d12a99-fc51-4ffa-b296-7cca38d78ae7 => generated 1316 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:44:13.292012 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d44cd133-672b-4c8e-8ca5-f921268a56c3 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:44:13.292696 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d44cd133-672b-4c8e-8ca5-f921268a56c3 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] [instance: a1d12a99-fc51-4ffa-b296-7cca38d78ae7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:44:13.301382 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d44cd133-672b-4c8e-8ca5-f921268a56c3 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:13.301858 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d44cd133-672b-4c8e-8ca5-f921268a56c3 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:13.302446 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d44cd133-672b-4c8e-8ca5-f921268a56c3 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:13.303147 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d44cd133-672b-4c8e-8ca5-f921268a56c3 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:13.303600 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d44cd133-672b-4c8e-8ca5-f921268a56c3 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:13.304123 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d44cd133-672b-4c8e-8ca5-f921268a56c3 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:13.439707 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d44cd133-672b-4c8e-8ca5-f921268a56c3 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4bfa2f8d8664c84bd1e26ac1311dcb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c9f8663768487f8b3bcf05019bc7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:44:13.448156 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d44cd133-672b-4c8e-8ca5-f921268a56c3 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] 10.222.0.70 "GET /compute/v2.1/servers/a1d12a99-fc51-4ffa-b296-7cca38d78ae7" status: 200 len: 1316 microversion: 2.1 time: 0.160792 Aug 27 03:44:13.448769 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3373/6698] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:44:13 2022] GET /compute/v2.1/servers/a1d12a99-fc51-4ffa-b296-7cca38d78ae7 => generated 1316 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:44:14.469633 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-17062274-125f-4682-b59e-a56b930ce58f tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:44:14.470173 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-17062274-125f-4682-b59e-a56b930ce58f tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] [instance: a1d12a99-fc51-4ffa-b296-7cca38d78ae7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:44:14.477511 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-17062274-125f-4682-b59e-a56b930ce58f tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:14.477996 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-17062274-125f-4682-b59e-a56b930ce58f tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:14.478429 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-17062274-125f-4682-b59e-a56b930ce58f tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:14.479128 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-17062274-125f-4682-b59e-a56b930ce58f tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:14.479574 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-17062274-125f-4682-b59e-a56b930ce58f tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:14.479994 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-17062274-125f-4682-b59e-a56b930ce58f tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:14.622042 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-17062274-125f-4682-b59e-a56b930ce58f tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4bfa2f8d8664c84bd1e26ac1311dcb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c9f8663768487f8b3bcf05019bc7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:44:14.630341 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-17062274-125f-4682-b59e-a56b930ce58f tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] 10.222.0.70 "GET /compute/v2.1/servers/a1d12a99-fc51-4ffa-b296-7cca38d78ae7" status: 200 len: 1316 microversion: 2.1 time: 0.164799 Aug 27 03:44:14.630923 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3326/6699] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:44:14 2022] GET /compute/v2.1/servers/a1d12a99-fc51-4ffa-b296-7cca38d78ae7 => generated 1316 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:44:15.654814 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-bcf18dc3-d3ca-43a9-b9b0-e2173b40a0a4 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:44:15.655425 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-bcf18dc3-d3ca-43a9-b9b0-e2173b40a0a4 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] [instance: a1d12a99-fc51-4ffa-b296-7cca38d78ae7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:44:15.658422 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:44:15.664219 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bcf18dc3-d3ca-43a9-b9b0-e2173b40a0a4 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:15.664741 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bcf18dc3-d3ca-43a9-b9b0-e2173b40a0a4 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:15.665185 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bcf18dc3-d3ca-43a9-b9b0-e2173b40a0a4 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:15.665888 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bcf18dc3-d3ca-43a9-b9b0-e2173b40a0a4 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:15.666352 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bcf18dc3-d3ca-43a9-b9b0-e2173b40a0a4 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:15.666778 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bcf18dc3-d3ca-43a9-b9b0-e2173b40a0a4 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:15.805131 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-bcf18dc3-d3ca-43a9-b9b0-e2173b40a0a4 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4bfa2f8d8664c84bd1e26ac1311dcb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c9f8663768487f8b3bcf05019bc7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:44:15.816568 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-bcf18dc3-d3ca-43a9-b9b0-e2173b40a0a4 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] 10.222.0.70 "GET /compute/v2.1/servers/a1d12a99-fc51-4ffa-b296-7cca38d78ae7" status: 200 len: 1316 microversion: 2.1 time: 0.167485 Aug 27 03:44:15.817286 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3374/6700] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:44:15 2022] GET /compute/v2.1/servers/a1d12a99-fc51-4ffa-b296-7cca38d78ae7 => generated 1316 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:44:16.087035 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-b15f3386-d3c7-4874-846a-4717a2c4162f req-bf8bba05-3c15-48b5-9b52-93990c4b4675 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1d12a99-fc51-4ffa-b296-7cca38d78ae7", "name": "network-vif-plugged", "status": "completed", "tag": "e4ad8f5f-8d01-4172-85b0-2d85ee910237"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:44:16.096574 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-b15f3386-d3c7-4874-846a-4717a2c4162f req-bf8bba05-3c15-48b5-9b52-93990c4b4675 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:16.097049 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-b15f3386-d3c7-4874-846a-4717a2c4162f req-bf8bba05-3c15-48b5-9b52-93990c4b4675 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:16.097469 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-b15f3386-d3c7-4874-846a-4717a2c4162f req-bf8bba05-3c15-48b5-9b52-93990c4b4675 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:16.108658 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-b15f3386-d3c7-4874-846a-4717a2c4162f req-bf8bba05-3c15-48b5-9b52-93990c4b4675 service nova] Creating event network-vif-plugged:e4ad8f5f-8d01-4172-85b0-2d85ee910237 for instance a1d12a99-fc51-4ffa-b296-7cca38d78ae7 on n-h2-852278-4 Aug 27 03:44:16.113639 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-b15f3386-d3c7-4874-846a-4717a2c4162f req-bf8bba05-3c15-48b5-9b52-93990c4b4675 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089722 Aug 27 03:44:16.114235 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3327/6701] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:44:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:44:16.843965 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-89394f66-830c-4d92-a27f-7ec48b1158b1 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:44:16.845073 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-89394f66-830c-4d92-a27f-7ec48b1158b1 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] [instance: a1d12a99-fc51-4ffa-b296-7cca38d78ae7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:44:16.848072 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=8 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:44:16.857828 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-89394f66-830c-4d92-a27f-7ec48b1158b1 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:16.858330 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-89394f66-830c-4d92-a27f-7ec48b1158b1 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:16.858782 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-89394f66-830c-4d92-a27f-7ec48b1158b1 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:16.859500 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-89394f66-830c-4d92-a27f-7ec48b1158b1 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:16.859964 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-89394f66-830c-4d92-a27f-7ec48b1158b1 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:16.860434 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-89394f66-830c-4d92-a27f-7ec48b1158b1 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:16.995030 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-89394f66-830c-4d92-a27f-7ec48b1158b1 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4bfa2f8d8664c84bd1e26ac1311dcb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c9f8663768487f8b3bcf05019bc7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:44:17.003334 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-89394f66-830c-4d92-a27f-7ec48b1158b1 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] 10.222.0.70 "GET /compute/v2.1/servers/a1d12a99-fc51-4ffa-b296-7cca38d78ae7" status: 200 len: 1316 microversion: 2.1 time: 0.165958 Aug 27 03:44:17.003920 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3375/6702] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:44:16 2022] GET /compute/v2.1/servers/a1d12a99-fc51-4ffa-b296-7cca38d78ae7 => generated 1316 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:44:18.022681 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=4 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:44:18.027223 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3ae2a898-61d9-4023-a43c-d10c9cb83e04 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:44:18.027998 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-3ae2a898-61d9-4023-a43c-d10c9cb83e04 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] [instance: a1d12a99-fc51-4ffa-b296-7cca38d78ae7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:44:18.035036 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3ae2a898-61d9-4023-a43c-d10c9cb83e04 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:18.035523 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3ae2a898-61d9-4023-a43c-d10c9cb83e04 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:18.035958 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3ae2a898-61d9-4023-a43c-d10c9cb83e04 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:18.036703 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3ae2a898-61d9-4023-a43c-d10c9cb83e04 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:18.037151 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3ae2a898-61d9-4023-a43c-d10c9cb83e04 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:18.037576 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3ae2a898-61d9-4023-a43c-d10c9cb83e04 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:18.183626 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-3ae2a898-61d9-4023-a43c-d10c9cb83e04 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4bfa2f8d8664c84bd1e26ac1311dcb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c9f8663768487f8b3bcf05019bc7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:44:18.191536 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-3ae2a898-61d9-4023-a43c-d10c9cb83e04 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] 10.222.0.70 "GET /compute/v2.1/servers/a1d12a99-fc51-4ffa-b296-7cca38d78ae7" status: 200 len: 1506 microversion: 2.1 time: 0.170740 Aug 27 03:44:18.192131 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3328/6703] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:44:18 2022] GET /compute/v2.1/servers/a1d12a99-fc51-4ffa-b296-7cca38d78ae7 => generated 1506 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:44:18.251667 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-5c174be0-0bd7-49ef-b8c4-27432181f36f tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-563577569", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "networks": [{"uuid": "5f42ce35-17c7-415c-9a19-7b32e3339b49"}]}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:44:18.318630 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.network.neutron [None req-5c174be0-0bd7-49ef-b8c4-27432181f36f tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] validate_networks() for [('5f42ce35-17c7-415c-9a19-7b32e3339b49', None, None, None, None, None)] {{(pid=134051) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:44:18.764336 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-5c174be0-0bd7-49ef-b8c4-27432181f36f tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Flavor limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:44:18.764834 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-5c174be0-0bd7-49ef-b8c4-27432181f36f tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Image limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:44:18.765325 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-5c174be0-0bd7-49ef-b8c4-27432181f36f tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Flavor pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:44:18.765761 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-5c174be0-0bd7-49ef-b8c4-27432181f36f tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Image pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:44:18.766187 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-5c174be0-0bd7-49ef-b8c4-27432181f36f tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:44:18.776094 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5c174be0-0bd7-49ef-b8c4-27432181f36f tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:18.776625 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5c174be0-0bd7-49ef-b8c4-27432181f36f tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:18.777076 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5c174be0-0bd7-49ef-b8c4-27432181f36f tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:18.777792 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5c174be0-0bd7-49ef-b8c4-27432181f36f tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:18.778288 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5c174be0-0bd7-49ef-b8c4-27432181f36f tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:18.778722 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5c174be0-0bd7-49ef-b8c4-27432181f36f tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:18.796931 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-5c174be0-0bd7-49ef-b8c4-27432181f36f tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Getting quotas for project 35c9f8663768487f8b3bcf05019bc7c6. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:44:18.802720 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-5c174be0-0bd7-49ef-b8c4-27432181f36f tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Getting quotas for user f4bfa2f8d8664c84bd1e26ac1311dcb0 and project 35c9f8663768487f8b3bcf05019bc7c6. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:44:18.816595 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-5c174be0-0bd7-49ef-b8c4-27432181f36f tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Going to run 1 instances... {{(pid=134051) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:44:18.818973 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-5c174be0-0bd7-49ef-b8c4-27432181f36f tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] [instance: d32adf77-8cb0-446c-ad38-585867655f0a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134051) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:44:18.871604 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-5c174be0-0bd7-49ef-b8c4-27432181f36f tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.623919 Aug 27 03:44:18.872431 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3376/6704] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 03:44:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 625 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:44:18.883405 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d5ff1f98-154a-4eca-b38a-99616a8dfc3b tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:44:18.884062 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d5ff1f98-154a-4eca-b38a-99616a8dfc3b tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] [instance: d32adf77-8cb0-446c-ad38-585867655f0a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:44:18.940183 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-d5ff1f98-154a-4eca-b38a-99616a8dfc3b tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4bfa2f8d8664c84bd1e26ac1311dcb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c9f8663768487f8b3bcf05019bc7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:44:18.947294 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d5ff1f98-154a-4eca-b38a-99616a8dfc3b tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] 10.222.0.70 "GET /compute/v2.1/servers/d32adf77-8cb0-446c-ad38-585867655f0a" status: 200 len: 1216 microversion: 2.1 time: 0.067912 Aug 27 03:44:18.947912 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3329/6705] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:44:18 2022] GET /compute/v2.1/servers/d32adf77-8cb0-446c-ad38-585867655f0a => generated 1216 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:44:19.968669 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-608cd64b-5ecf-45ff-93ef-a2e4f069ebf1 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:44:19.969437 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-608cd64b-5ecf-45ff-93ef-a2e4f069ebf1 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] [instance: d32adf77-8cb0-446c-ad38-585867655f0a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:44:19.976833 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-608cd64b-5ecf-45ff-93ef-a2e4f069ebf1 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:19.977612 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-608cd64b-5ecf-45ff-93ef-a2e4f069ebf1 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:19.978060 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-608cd64b-5ecf-45ff-93ef-a2e4f069ebf1 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:19.978790 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-608cd64b-5ecf-45ff-93ef-a2e4f069ebf1 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:19.979248 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-608cd64b-5ecf-45ff-93ef-a2e4f069ebf1 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:19.979789 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-608cd64b-5ecf-45ff-93ef-a2e4f069ebf1 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:20.062210 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-608cd64b-5ecf-45ff-93ef-a2e4f069ebf1 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4bfa2f8d8664c84bd1e26ac1311dcb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c9f8663768487f8b3bcf05019bc7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:44:20.070839 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-608cd64b-5ecf-45ff-93ef-a2e4f069ebf1 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] 10.222.0.70 "GET /compute/v2.1/servers/d32adf77-8cb0-446c-ad38-585867655f0a" status: 200 len: 1276 microversion: 2.1 time: 0.106896 Aug 27 03:44:20.071693 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3377/6706] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:44:19 2022] GET /compute/v2.1/servers/d32adf77-8cb0-446c-ad38-585867655f0a => generated 1276 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:44:21.092534 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c19c3315-02c0-4ac3-8e90-31be5c22feb5 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:44:21.093062 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-c19c3315-02c0-4ac3-8e90-31be5c22feb5 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] [instance: d32adf77-8cb0-446c-ad38-585867655f0a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:44:21.100895 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c19c3315-02c0-4ac3-8e90-31be5c22feb5 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:21.101368 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c19c3315-02c0-4ac3-8e90-31be5c22feb5 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:21.101836 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c19c3315-02c0-4ac3-8e90-31be5c22feb5 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:21.102536 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c19c3315-02c0-4ac3-8e90-31be5c22feb5 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:21.102970 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c19c3315-02c0-4ac3-8e90-31be5c22feb5 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:21.103401 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c19c3315-02c0-4ac3-8e90-31be5c22feb5 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:21.337772 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-c19c3315-02c0-4ac3-8e90-31be5c22feb5 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4bfa2f8d8664c84bd1e26ac1311dcb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c9f8663768487f8b3bcf05019bc7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:44:21.346416 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c19c3315-02c0-4ac3-8e90-31be5c22feb5 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] 10.222.0.70 "GET /compute/v2.1/servers/d32adf77-8cb0-446c-ad38-585867655f0a" status: 200 len: 1316 microversion: 2.1 time: 0.258006 Aug 27 03:44:21.346928 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3330/6707] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:44:21 2022] GET /compute/v2.1/servers/d32adf77-8cb0-446c-ad38-585867655f0a => generated 1316 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:44:21.469804 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-1238dc3e-8039-40bd-96a7-213001f75d6f req-b4ea6d77-94f1-4f0f-af3b-ccfb7c5dc03a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d32adf77-8cb0-446c-ad38-585867655f0a", "tag": "64508bf9-d906-4540-a622-4c15e9adc46f"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:44:21.486247 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=6 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:44:21.491082 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-1238dc3e-8039-40bd-96a7-213001f75d6f req-b4ea6d77-94f1-4f0f-af3b-ccfb7c5dc03a service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:21.491877 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-1238dc3e-8039-40bd-96a7-213001f75d6f req-b4ea6d77-94f1-4f0f-af3b-ccfb7c5dc03a service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:21.492341 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-1238dc3e-8039-40bd-96a7-213001f75d6f req-b4ea6d77-94f1-4f0f-af3b-ccfb7c5dc03a service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:21.504964 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-1238dc3e-8039-40bd-96a7-213001f75d6f req-b4ea6d77-94f1-4f0f-af3b-ccfb7c5dc03a service nova] Creating event network-changed:64508bf9-d906-4540-a622-4c15e9adc46f for instance d32adf77-8cb0-446c-ad38-585867655f0a on n-h1-852278-4 Aug 27 03:44:21.510473 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-1238dc3e-8039-40bd-96a7-213001f75d6f req-b4ea6d77-94f1-4f0f-af3b-ccfb7c5dc03a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044984 Aug 27 03:44:21.511108 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3378/6708] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:44:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:44:22.371488 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6ba6c712-99cb-4883-9309-6c4d52493bc6 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:44:22.372503 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-6ba6c712-99cb-4883-9309-6c4d52493bc6 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] [instance: d32adf77-8cb0-446c-ad38-585867655f0a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:44:22.380541 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6ba6c712-99cb-4883-9309-6c4d52493bc6 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:22.381025 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6ba6c712-99cb-4883-9309-6c4d52493bc6 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:22.381455 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6ba6c712-99cb-4883-9309-6c4d52493bc6 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:22.382151 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6ba6c712-99cb-4883-9309-6c4d52493bc6 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:22.382597 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6ba6c712-99cb-4883-9309-6c4d52493bc6 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:22.383022 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6ba6c712-99cb-4883-9309-6c4d52493bc6 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:23.018358 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-6ba6c712-99cb-4883-9309-6c4d52493bc6 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4bfa2f8d8664c84bd1e26ac1311dcb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c9f8663768487f8b3bcf05019bc7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:44:23.027350 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-6ba6c712-99cb-4883-9309-6c4d52493bc6 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] 10.222.0.70 "GET /compute/v2.1/servers/d32adf77-8cb0-446c-ad38-585867655f0a" status: 200 len: 1316 microversion: 2.1 time: 0.662412 Aug 27 03:44:23.027973 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3331/6709] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:44:22 2022] GET /compute/v2.1/servers/d32adf77-8cb0-446c-ad38-585867655f0a => generated 1316 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:44:24.049674 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-6184e20b-533e-4299-be5b-58f840d3b52c tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:44:24.050395 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-6184e20b-533e-4299-be5b-58f840d3b52c tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] [instance: d32adf77-8cb0-446c-ad38-585867655f0a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:44:24.057347 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6184e20b-533e-4299-be5b-58f840d3b52c tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:24.057850 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6184e20b-533e-4299-be5b-58f840d3b52c tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:24.058302 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6184e20b-533e-4299-be5b-58f840d3b52c tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:24.059055 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6184e20b-533e-4299-be5b-58f840d3b52c tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:24.059523 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6184e20b-533e-4299-be5b-58f840d3b52c tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:24.059955 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6184e20b-533e-4299-be5b-58f840d3b52c tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:24.199781 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-6184e20b-533e-4299-be5b-58f840d3b52c tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4bfa2f8d8664c84bd1e26ac1311dcb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c9f8663768487f8b3bcf05019bc7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:44:24.208178 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-6184e20b-533e-4299-be5b-58f840d3b52c tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] 10.222.0.70 "GET /compute/v2.1/servers/d32adf77-8cb0-446c-ad38-585867655f0a" status: 200 len: 1316 microversion: 2.1 time: 0.164202 Aug 27 03:44:24.208815 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3379/6710] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:44:24 2022] GET /compute/v2.1/servers/d32adf77-8cb0-446c-ad38-585867655f0a => generated 1316 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:44:25.233163 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-73b1f9a9-4a6b-447f-a894-55815e560ce5 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:44:25.234065 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-73b1f9a9-4a6b-447f-a894-55815e560ce5 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] [instance: d32adf77-8cb0-446c-ad38-585867655f0a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:44:25.245607 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-73b1f9a9-4a6b-447f-a894-55815e560ce5 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:25.246405 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-73b1f9a9-4a6b-447f-a894-55815e560ce5 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:25.247120 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-73b1f9a9-4a6b-447f-a894-55815e560ce5 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:25.248262 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-73b1f9a9-4a6b-447f-a894-55815e560ce5 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:25.249024 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-73b1f9a9-4a6b-447f-a894-55815e560ce5 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:25.249751 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-73b1f9a9-4a6b-447f-a894-55815e560ce5 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:25.390454 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-73b1f9a9-4a6b-447f-a894-55815e560ce5 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4bfa2f8d8664c84bd1e26ac1311dcb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c9f8663768487f8b3bcf05019bc7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:44:25.398614 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-73b1f9a9-4a6b-447f-a894-55815e560ce5 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] 10.222.0.70 "GET /compute/v2.1/servers/d32adf77-8cb0-446c-ad38-585867655f0a" status: 200 len: 1316 microversion: 2.1 time: 0.172134 Aug 27 03:44:25.399195 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3332/6711] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:44:25 2022] GET /compute/v2.1/servers/d32adf77-8cb0-446c-ad38-585867655f0a => generated 1316 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:44:25.903000 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-83b728f9-1a4d-4c0e-80dd-7295748c70cd req-4a0ce914-c23d-45ab-8933-3ba4a5e70718 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d32adf77-8cb0-446c-ad38-585867655f0a", "name": "network-vif-plugged", "status": "completed", "tag": "64508bf9-d906-4540-a622-4c15e9adc46f"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:44:25.917049 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-83b728f9-1a4d-4c0e-80dd-7295748c70cd req-4a0ce914-c23d-45ab-8933-3ba4a5e70718 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:25.917555 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-83b728f9-1a4d-4c0e-80dd-7295748c70cd req-4a0ce914-c23d-45ab-8933-3ba4a5e70718 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:25.918008 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-83b728f9-1a4d-4c0e-80dd-7295748c70cd req-4a0ce914-c23d-45ab-8933-3ba4a5e70718 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:25.931857 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-83b728f9-1a4d-4c0e-80dd-7295748c70cd req-4a0ce914-c23d-45ab-8933-3ba4a5e70718 service nova] Creating event network-vif-plugged:64508bf9-d906-4540-a622-4c15e9adc46f for instance d32adf77-8cb0-446c-ad38-585867655f0a on n-h1-852278-4 Aug 27 03:44:25.937105 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-83b728f9-1a4d-4c0e-80dd-7295748c70cd req-4a0ce914-c23d-45ab-8933-3ba4a5e70718 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038076 Aug 27 03:44:25.937979 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3380/6712] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:44:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:44:26.423976 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-24f9cb60-af28-49db-a4d8-0ad6d74ee9d8 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:44:26.424650 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-24f9cb60-af28-49db-a4d8-0ad6d74ee9d8 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] [instance: d32adf77-8cb0-446c-ad38-585867655f0a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:44:26.432834 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-24f9cb60-af28-49db-a4d8-0ad6d74ee9d8 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:26.433361 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-24f9cb60-af28-49db-a4d8-0ad6d74ee9d8 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:26.433868 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-24f9cb60-af28-49db-a4d8-0ad6d74ee9d8 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:26.434646 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-24f9cb60-af28-49db-a4d8-0ad6d74ee9d8 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:26.435157 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-24f9cb60-af28-49db-a4d8-0ad6d74ee9d8 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:26.435632 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-24f9cb60-af28-49db-a4d8-0ad6d74ee9d8 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:26.577108 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-24f9cb60-af28-49db-a4d8-0ad6d74ee9d8 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4bfa2f8d8664c84bd1e26ac1311dcb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c9f8663768487f8b3bcf05019bc7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:44:26.585406 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-24f9cb60-af28-49db-a4d8-0ad6d74ee9d8 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] 10.222.0.70 "GET /compute/v2.1/servers/d32adf77-8cb0-446c-ad38-585867655f0a" status: 200 len: 1316 microversion: 2.1 time: 0.168511 Aug 27 03:44:26.585975 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3333/6713] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:44:26 2022] GET /compute/v2.1/servers/d32adf77-8cb0-446c-ad38-585867655f0a => generated 1316 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:44:27.611259 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-622fff91-25da-4804-aa93-ca3abec49efb tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:44:27.611972 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-622fff91-25da-4804-aa93-ca3abec49efb tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] [instance: d32adf77-8cb0-446c-ad38-585867655f0a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:44:27.619401 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-622fff91-25da-4804-aa93-ca3abec49efb tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:27.619909 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-622fff91-25da-4804-aa93-ca3abec49efb tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:27.620393 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-622fff91-25da-4804-aa93-ca3abec49efb tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:27.621114 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-622fff91-25da-4804-aa93-ca3abec49efb tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:27.621586 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-622fff91-25da-4804-aa93-ca3abec49efb tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:27.622034 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-622fff91-25da-4804-aa93-ca3abec49efb tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:27.762055 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-622fff91-25da-4804-aa93-ca3abec49efb tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4bfa2f8d8664c84bd1e26ac1311dcb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c9f8663768487f8b3bcf05019bc7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:44:27.770517 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-622fff91-25da-4804-aa93-ca3abec49efb tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] 10.222.0.70 "GET /compute/v2.1/servers/d32adf77-8cb0-446c-ad38-585867655f0a" status: 200 len: 1505 microversion: 2.1 time: 0.166422 Aug 27 03:44:27.771107 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3381/6714] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:44:27 2022] GET /compute/v2.1/servers/d32adf77-8cb0-446c-ad38-585867655f0a => generated 1505 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:44:27.790582 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6cc3deba-3505-49e5-8b1f-1b406be7dc1e tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:44:27.791129 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-6cc3deba-3505-49e5-8b1f-1b406be7dc1e tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] [instance: d32adf77-8cb0-446c-ad38-585867655f0a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:44:27.799041 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6cc3deba-3505-49e5-8b1f-1b406be7dc1e tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:27.799503 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6cc3deba-3505-49e5-8b1f-1b406be7dc1e tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:27.799943 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6cc3deba-3505-49e5-8b1f-1b406be7dc1e tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:27.800670 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6cc3deba-3505-49e5-8b1f-1b406be7dc1e tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:27.801118 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6cc3deba-3505-49e5-8b1f-1b406be7dc1e tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:27.801537 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6cc3deba-3505-49e5-8b1f-1b406be7dc1e tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:28.091524 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-6cc3deba-3505-49e5-8b1f-1b406be7dc1e tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] [instance: d32adf77-8cb0-446c-ad38-585867655f0a] Going to try to terminate instance {{(pid=134052) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:44:28.179707 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-6cc3deba-3505-49e5-8b1f-1b406be7dc1e tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] 10.222.0.70 "DELETE /compute/v2.1/servers/d32adf77-8cb0-446c-ad38-585867655f0a" status: 204 len: 0 microversion: 2.1 time: 0.392705 Aug 27 03:44:28.180405 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3334/6715] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 03:44:27 2022] DELETE /compute/v2.1/servers/d32adf77-8cb0-446c-ad38-585867655f0a => generated 0 bytes in 394 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:44:28.188804 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-14615fdd-17ea-47f1-ae7c-35fc630aec41 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:44:28.189456 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-14615fdd-17ea-47f1-ae7c-35fc630aec41 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] [instance: d32adf77-8cb0-446c-ad38-585867655f0a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:44:28.195590 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-14615fdd-17ea-47f1-ae7c-35fc630aec41 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:28.196101 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-14615fdd-17ea-47f1-ae7c-35fc630aec41 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:28.196592 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-14615fdd-17ea-47f1-ae7c-35fc630aec41 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:28.197395 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-14615fdd-17ea-47f1-ae7c-35fc630aec41 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:28.197869 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-14615fdd-17ea-47f1-ae7c-35fc630aec41 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:28.198455 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-14615fdd-17ea-47f1-ae7c-35fc630aec41 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:28.345395 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-14615fdd-17ea-47f1-ae7c-35fc630aec41 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4bfa2f8d8664c84bd1e26ac1311dcb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c9f8663768487f8b3bcf05019bc7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:44:28.355953 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-14615fdd-17ea-47f1-ae7c-35fc630aec41 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] 10.222.0.70 "GET /compute/v2.1/servers/d32adf77-8cb0-446c-ad38-585867655f0a" status: 200 len: 1511 microversion: 2.1 time: 0.171062 Aug 27 03:44:28.356684 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3382/6716] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:44:28 2022] GET /compute/v2.1/servers/d32adf77-8cb0-446c-ad38-585867655f0a => generated 1511 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:44:29.380651 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-51d7e59f-93cb-4bb4-8052-4c97eb3d36f4 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:44:29.381341 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-51d7e59f-93cb-4bb4-8052-4c97eb3d36f4 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] [instance: d32adf77-8cb0-446c-ad38-585867655f0a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:44:29.384162 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:44:29.392787 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-51d7e59f-93cb-4bb4-8052-4c97eb3d36f4 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:29.393288 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-51d7e59f-93cb-4bb4-8052-4c97eb3d36f4 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:29.393736 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-51d7e59f-93cb-4bb4-8052-4c97eb3d36f4 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:29.394466 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-51d7e59f-93cb-4bb4-8052-4c97eb3d36f4 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:29.394918 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-51d7e59f-93cb-4bb4-8052-4c97eb3d36f4 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:29.395336 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-51d7e59f-93cb-4bb4-8052-4c97eb3d36f4 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:29.537671 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-51d7e59f-93cb-4bb4-8052-4c97eb3d36f4 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4bfa2f8d8664c84bd1e26ac1311dcb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c9f8663768487f8b3bcf05019bc7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:44:29.546292 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-51d7e59f-93cb-4bb4-8052-4c97eb3d36f4 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] 10.222.0.70 "GET /compute/v2.1/servers/d32adf77-8cb0-446c-ad38-585867655f0a" status: 200 len: 1511 microversion: 2.1 time: 0.169725 Aug 27 03:44:29.546870 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3335/6717] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:44:29 2022] GET /compute/v2.1/servers/d32adf77-8cb0-446c-ad38-585867655f0a => generated 1511 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:44:30.068678 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-66437408-31be-44dc-9839-1710b7f44c21 req-2bbfe8b8-67a4-4163-89f4-b54722a4a4bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d32adf77-8cb0-446c-ad38-585867655f0a", "name": "network-vif-deleted", "tag": "64508bf9-d906-4540-a622-4c15e9adc46f"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:44:30.078272 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:44:30.079341 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=6 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:44:30.081616 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-66437408-31be-44dc-9839-1710b7f44c21 req-2bbfe8b8-67a4-4163-89f4-b54722a4a4bf service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:30.082416 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-66437408-31be-44dc-9839-1710b7f44c21 req-2bbfe8b8-67a4-4163-89f4-b54722a4a4bf service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:30.082954 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-66437408-31be-44dc-9839-1710b7f44c21 req-2bbfe8b8-67a4-4163-89f4-b54722a4a4bf service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:30.096974 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-66437408-31be-44dc-9839-1710b7f44c21 req-2bbfe8b8-67a4-4163-89f4-b54722a4a4bf service nova] Creating event network-vif-deleted:64508bf9-d906-4540-a622-4c15e9adc46f for instance d32adf77-8cb0-446c-ad38-585867655f0a on n-h1-852278-4 Aug 27 03:44:30.102530 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-66437408-31be-44dc-9839-1710b7f44c21 req-2bbfe8b8-67a4-4163-89f4-b54722a4a4bf service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038631 Aug 27 03:44:30.103439 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3383/6718] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:44:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:44:30.567410 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0de39a88-fdb1-47d6-ae49-06cf5cc0e241 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:44:30.568017 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-0de39a88-fdb1-47d6-ae49-06cf5cc0e241 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] [instance: d32adf77-8cb0-446c-ad38-585867655f0a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:44:30.574899 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0de39a88-fdb1-47d6-ae49-06cf5cc0e241 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:30.575415 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0de39a88-fdb1-47d6-ae49-06cf5cc0e241 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:30.575833 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0de39a88-fdb1-47d6-ae49-06cf5cc0e241 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:30.576523 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0de39a88-fdb1-47d6-ae49-06cf5cc0e241 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:30.576966 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0de39a88-fdb1-47d6-ae49-06cf5cc0e241 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:30.577378 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0de39a88-fdb1-47d6-ae49-06cf5cc0e241 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:30.609293 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0de39a88-fdb1-47d6-ae49-06cf5cc0e241 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:30.609826 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0de39a88-fdb1-47d6-ae49-06cf5cc0e241 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:30.610251 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0de39a88-fdb1-47d6-ae49-06cf5cc0e241 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:30.610714 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.instance [None req-0de39a88-fdb1-47d6-ae49-06cf5cc0e241 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lazy-loading 'fault' on Instance uuid d32adf77-8cb0-446c-ad38-585867655f0a {{(pid=134052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:44:30.653405 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0de39a88-fdb1-47d6-ae49-06cf5cc0e241 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4bfa2f8d8664c84bd1e26ac1311dcb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c9f8663768487f8b3bcf05019bc7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:44:30.660539 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-0de39a88-fdb1-47d6-ae49-06cf5cc0e241 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] 10.222.0.70 "GET /compute/v2.1/servers/d32adf77-8cb0-446c-ad38-585867655f0a" status: 200 len: 1306 microversion: 2.1 time: 0.097237 Aug 27 03:44:30.661110 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3336/6719] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:44:30 2022] GET /compute/v2.1/servers/d32adf77-8cb0-446c-ad38-585867655f0a => generated 1306 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:44:31.688912 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-2b9150c7-b1cf-420e-a65c-ed025bb7d03c tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:44:31.689851 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-2b9150c7-b1cf-420e-a65c-ed025bb7d03c tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] [instance: d32adf77-8cb0-446c-ad38-585867655f0a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:44:31.699970 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2b9150c7-b1cf-420e-a65c-ed025bb7d03c tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:31.700813 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2b9150c7-b1cf-420e-a65c-ed025bb7d03c tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:31.701527 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2b9150c7-b1cf-420e-a65c-ed025bb7d03c tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:31.702669 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2b9150c7-b1cf-420e-a65c-ed025bb7d03c tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:31.703391 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2b9150c7-b1cf-420e-a65c-ed025bb7d03c tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:31.704048 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2b9150c7-b1cf-420e-a65c-ed025bb7d03c tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:31.718404 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-2b9150c7-b1cf-420e-a65c-ed025bb7d03c tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] HTTP exception thrown: Instance d32adf77-8cb0-446c-ad38-585867655f0a could not be found. Aug 27 03:44:31.720080 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-2b9150c7-b1cf-420e-a65c-ed025bb7d03c tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Request method failure captured: Aug 27 03:44:31.720080 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/d32adf77-8cb0-446c-ad38-585867655f0a HTTP/1.1 Aug 27 03:44:31.720080 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 03:44:31.720080 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 03:44:31.720080 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 03:44:31.720080 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 03:44:31.720080 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 03:44:31.720080 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 03:44:31.720080 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 03:44:31.720080 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 03:44:31.720080 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCZMEX5I7MAXUKFEUgvU5lu-KLA5OPRnjt_T07zbueIJLEO8Zo1o4eZZbMp8gfWr1yI7GijU1HmE_WOwk03VHHG9fT8H7Lakjx3KpP6EhdSE-bsBN9OlOixCx3eWyY2dewP5avt6FDuMqWA6Jls0bG6l2bcvygEtlYcTb6Vu4fKqEF2Y Aug 27 03:44:31.720080 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 03:44:31.720080 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 03:44:31.720080 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 03:44:31.720080 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 03:44:31.720080 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 03:44:31.720080 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 03:44:31.720080 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 35c9f8663768487f8b3bcf05019bc7c6 Aug 27 03:44:31.720080 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ServersNegativeTestJSON-1853689643 Aug 27 03:44:31.720080 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 03:44:31.720080 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 03:44:31.720080 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/35c9f8663768487f8b3bcf05019bc7c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_35c9f8663768487f8b3bcf05019bc7c6", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/35c9f8663768487f8b3bcf05019bc7c6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/35c9f8663768487f8b3bcf05019bc7c6"}]}] Aug 27 03:44:31.720080 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ServersNegativeTestJSON-1853689643 Aug 27 03:44:31.720080 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 35c9f8663768487f8b3bcf05019bc7c6 Aug 27 03:44:31.720080 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1853689643 Aug 27 03:44:31.720080 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ServersNegativeTestJSON-1853689643-project Aug 27 03:44:31.720080 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 03:44:31.720080 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 03:44:31.720080 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: f4bfa2f8d8664c84bd1e26ac1311dcb0 Aug 27 03:44:31.720080 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ServersNegativeTestJSON-1853689643-project Aug 27 03:44:31.720080 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 03:44:31.720080 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance d32adf77-8cb0-446c-ad38-585867655f0a could not be found. Aug 27 03:44:31.720080 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': 'd32adf77-8cb0-446c-ad38-585867655f0a'} Aug 27 03:44:31.720080 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:44:31.720080 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:44:31.720080 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:44:31.720080 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:44:31.720080 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:44:31.720080 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:44:31.720080 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:44:31.720080 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:44:31.720080 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:44:31.720080 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:44:31.720080 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d32adf77-8cb0-446c-ad38-585867655f0a could not be found. Aug 27 03:44:31.720080 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:44:31.720080 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:44:31.720080 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:44:31.720080 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:44:31.720080 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:44:31.720080 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:44:31.720080 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:44:31.720080 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:44:31.720080 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:44:31.720080 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:44:31.720080 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:44:31.720080 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:44:31.720080 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:44:31.720080 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:44:31.720080 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:44:31.720080 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:44:31.720080 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d32adf77-8cb0-446c-ad38-585867655f0a could not be found. Aug 27 03:44:31.720080 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:44:31.720080 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:44:31.720080 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:44:31.724137 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:44:31.724137 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:44:31.724137 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:44:31.724137 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:44:31.724137 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:44:31.724137 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d32adf77-8cb0-446c-ad38-585867655f0a could not be found. Aug 27 03:44:31.724137 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:44:31.724137 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-2b9150c7-b1cf-420e-a65c-ed025bb7d03c tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Returning 404 to user: Instance d32adf77-8cb0-446c-ad38-585867655f0a could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:44:31.724137 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-2b9150c7-b1cf-420e-a65c-ed025bb7d03c tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] 10.222.0.70 "GET /compute/v2.1/servers/d32adf77-8cb0-446c-ad38-585867655f0a" status: 404 len: 111 microversion: 2.1 time: 0.041469 Aug 27 03:44:31.724137 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3384/6720] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:44:31 2022] GET /compute/v2.1/servers/d32adf77-8cb0-446c-ad38-585867655f0a => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:44:31.731047 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-97fa0531-64d0-4b88-9f71-15552c3fd903 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:44:31.731656 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-97fa0531-64d0-4b88-9f71-15552c3fd903 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] [instance: a1d12a99-fc51-4ffa-b296-7cca38d78ae7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:44:31.739061 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-97fa0531-64d0-4b88-9f71-15552c3fd903 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:31.739518 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-97fa0531-64d0-4b88-9f71-15552c3fd903 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:31.739950 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-97fa0531-64d0-4b88-9f71-15552c3fd903 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:31.740744 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-97fa0531-64d0-4b88-9f71-15552c3fd903 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:31.741189 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-97fa0531-64d0-4b88-9f71-15552c3fd903 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:31.741608 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-97fa0531-64d0-4b88-9f71-15552c3fd903 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:31.874387 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-97fa0531-64d0-4b88-9f71-15552c3fd903 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4bfa2f8d8664c84bd1e26ac1311dcb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c9f8663768487f8b3bcf05019bc7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:44:31.882707 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-97fa0531-64d0-4b88-9f71-15552c3fd903 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] 10.222.0.70 "GET /compute/v2.1/servers/a1d12a99-fc51-4ffa-b296-7cca38d78ae7" status: 200 len: 1506 microversion: 2.1 time: 0.155617 Aug 27 03:44:31.883286 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3337/6721] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:44:31 2022] GET /compute/v2.1/servers/a1d12a99-fc51-4ffa-b296-7cca38d78ae7 => generated 1506 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:44:31.904214 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b9855bc8-8ceb-49bd-b70d-586bd6e41199 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:44:31.906639 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b9855bc8-8ceb-49bd-b70d-586bd6e41199 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] [instance: 6ab717be-4a5d-422d-ac71-f87ef185a312] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:44:31.912982 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-b9855bc8-8ceb-49bd-b70d-586bd6e41199 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] HTTP exception thrown: Instance 6ab717be-4a5d-422d-ac71-f87ef185a312 could not be found. Aug 27 03:44:31.914577 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b9855bc8-8ceb-49bd-b70d-586bd6e41199 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Request method failure captured: Aug 27 03:44:31.914577 n-d-852278-4 devstack@n-api.service[134051]: request: POST /compute/v2.1/servers/6ab717be-4a5d-422d-ac71-f87ef185a312/action HTTP/1.1 Aug 27 03:44:31.914577 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 03:44:31.914577 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 03:44:31.914577 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 03:44:31.914577 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 32 Aug 27 03:44:31.914577 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 03:44:31.914577 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 03:44:31.914577 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 03:44:31.914577 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 03:44:31.914577 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCZMEX5I7MAXUKFEUgvU5lu-KLA5OPRnjt_T07zbueIJLEO8Zo1o4eZZbMp8gfWr1yI7GijU1HmE_WOwk03VHHG9fT8H7Lakjx3KpP6EhdSE-bsBN9OlOixCx3eWyY2dewP5avt6FDuMqWA6Jls0bG6l2bcvygEtlYcTb6Vu4fKqEF2Y Aug 27 03:44:31.914577 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 03:44:31.914577 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 03:44:31.914577 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 03:44:31.914577 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 03:44:31.914577 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 03:44:31.914577 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 03:44:31.914577 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 35c9f8663768487f8b3bcf05019bc7c6 Aug 27 03:44:31.914577 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ServersNegativeTestJSON-1853689643 Aug 27 03:44:31.914577 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 03:44:31.914577 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 03:44:31.914577 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/35c9f8663768487f8b3bcf05019bc7c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_35c9f8663768487f8b3bcf05019bc7c6", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/35c9f8663768487f8b3bcf05019bc7c6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/35c9f8663768487f8b3bcf05019bc7c6"}]}] Aug 27 03:44:31.914577 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ServersNegativeTestJSON-1853689643 Aug 27 03:44:31.914577 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 35c9f8663768487f8b3bcf05019bc7c6 Aug 27 03:44:31.914577 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1853689643 Aug 27 03:44:31.914577 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ServersNegativeTestJSON-1853689643-project Aug 27 03:44:31.914577 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 03:44:31.914577 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 03:44:31.914577 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: f4bfa2f8d8664c84bd1e26ac1311dcb0 Aug 27 03:44:31.914577 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ServersNegativeTestJSON-1853689643-project Aug 27 03:44:31.914577 n-d-852278-4 devstack@n-api.service[134051]: Aug 27 03:44:31.914577 n-d-852278-4 devstack@n-api.service[134051]: {"resize": {"flavorRef": "452"}} Aug 27 03:44:31.914577 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 03:44:31.914577 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance 6ab717be-4a5d-422d-ac71-f87ef185a312 could not be found. Aug 27 03:44:31.914577 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '6ab717be-4a5d-422d-ac71-f87ef185a312', 'body': {'resize': {'flavorRef': '452'}}} Aug 27 03:44:31.914577 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:44:31.914577 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:44:31.914577 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:44:31.914577 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:44:31.914577 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:44:31.914577 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:44:31.914577 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 03:44:31.914577 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 03:44:31.914577 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ab717be-4a5d-422d-ac71-f87ef185a312 could not be found. Aug 27 03:44:31.914577 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:44:31.914577 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:44:31.914577 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:44:31.914577 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:44:31.914577 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:44:31.914577 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:44:31.914577 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:44:31.914577 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:44:31.914577 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:44:31.914577 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:44:31.914577 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:44:31.914577 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:44:31.914577 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 27 03:44:31.914577 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 27 03:44:31.914577 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Aug 27 03:44:31.914577 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Aug 27 03:44:31.914577 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:44:31.914577 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:44:31.914577 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:44:31.914577 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:44:31.922751 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ab717be-4a5d-422d-ac71-f87ef185a312 could not be found. Aug 27 03:44:31.922751 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:44:31.922751 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:44:31.922751 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:44:31.922751 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:44:31.922751 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:44:31.922751 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:44:31.922751 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:44:31.922751 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:44:31.922751 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ab717be-4a5d-422d-ac71-f87ef185a312 could not be found. Aug 27 03:44:31.922751 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:44:31.922751 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b9855bc8-8ceb-49bd-b70d-586bd6e41199 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Returning 404 to user: Instance 6ab717be-4a5d-422d-ac71-f87ef185a312 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:44:31.922751 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b9855bc8-8ceb-49bd-b70d-586bd6e41199 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] 10.222.0.70 "POST /compute/v2.1/servers/6ab717be-4a5d-422d-ac71-f87ef185a312/action" status: 404 len: 111 microversion: 2.1 time: 0.015932 Aug 27 03:44:31.922751 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3385/6722] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:44:31 2022] POST /compute/v2.1/servers/6ab717be-4a5d-422d-ac71-f87ef185a312/action => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:44:31.928490 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-2165e3a9-01a6-43a3-91dd-3189144368e7 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:44:31.929118 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-2165e3a9-01a6-43a3-91dd-3189144368e7 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] [instance: a1d12a99-fc51-4ffa-b296-7cca38d78ae7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:44:31.938353 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2165e3a9-01a6-43a3-91dd-3189144368e7 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:31.939314 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2165e3a9-01a6-43a3-91dd-3189144368e7 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:31.939963 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2165e3a9-01a6-43a3-91dd-3189144368e7 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:31.940662 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2165e3a9-01a6-43a3-91dd-3189144368e7 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:31.941166 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2165e3a9-01a6-43a3-91dd-3189144368e7 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:31.941601 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2165e3a9-01a6-43a3-91dd-3189144368e7 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:32.082198 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-2165e3a9-01a6-43a3-91dd-3189144368e7 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4bfa2f8d8664c84bd1e26ac1311dcb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c9f8663768487f8b3bcf05019bc7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:44:32.090578 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-2165e3a9-01a6-43a3-91dd-3189144368e7 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] 10.222.0.70 "GET /compute/v2.1/servers/a1d12a99-fc51-4ffa-b296-7cca38d78ae7" status: 200 len: 1506 microversion: 2.1 time: 0.168046 Aug 27 03:44:32.091219 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3338/6723] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:44:31 2022] GET /compute/v2.1/servers/a1d12a99-fc51-4ffa-b296-7cca38d78ae7 => generated 1506 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:44:32.111871 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-9cde9f7d-6667-4604-b0b1-dae430993032 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:44:32.112543 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-9cde9f7d-6667-4604-b0b1-dae430993032 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] [instance: a1d12a99-fc51-4ffa-b296-7cca38d78ae7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:44:32.123168 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9cde9f7d-6667-4604-b0b1-dae430993032 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:32.123701 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9cde9f7d-6667-4604-b0b1-dae430993032 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:32.124181 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9cde9f7d-6667-4604-b0b1-dae430993032 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:32.124963 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9cde9f7d-6667-4604-b0b1-dae430993032 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:32.125527 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9cde9f7d-6667-4604-b0b1-dae430993032 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:32.125925 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9cde9f7d-6667-4604-b0b1-dae430993032 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:32.264792 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-9cde9f7d-6667-4604-b0b1-dae430993032 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4bfa2f8d8664c84bd1e26ac1311dcb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c9f8663768487f8b3bcf05019bc7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:44:32.274098 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-9cde9f7d-6667-4604-b0b1-dae430993032 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] 10.222.0.70 "GET /compute/v2.1/servers/a1d12a99-fc51-4ffa-b296-7cca38d78ae7" status: 200 len: 1506 microversion: 2.1 time: 0.166177 Aug 27 03:44:32.274691 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3386/6724] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:44:32 2022] GET /compute/v2.1/servers/a1d12a99-fc51-4ffa-b296-7cca38d78ae7 => generated 1506 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:44:32.302648 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-662155f9-2d24-4fe0-9ca1-f88dc351b4ef tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "cc8950d1-f3a6-4a72-a6ab-4a8792d282e5"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:44:32.305373 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-662155f9-2d24-4fe0-9ca1-f88dc351b4ef tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] [instance: a1d12a99-fc51-4ffa-b296-7cca38d78ae7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:44:32.311787 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-662155f9-2d24-4fe0-9ca1-f88dc351b4ef tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:32.312274 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-662155f9-2d24-4fe0-9ca1-f88dc351b4ef tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:32.312742 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-662155f9-2d24-4fe0-9ca1-f88dc351b4ef tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:32.313439 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-662155f9-2d24-4fe0-9ca1-f88dc351b4ef tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:32.313885 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-662155f9-2d24-4fe0-9ca1-f88dc351b4ef tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:32.314304 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-662155f9-2d24-4fe0-9ca1-f88dc351b4ef tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:32.343472 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-662155f9-2d24-4fe0-9ca1-f88dc351b4ef tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'f4bfa2f8d8664c84bd1e26ac1311dcb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c9f8663768487f8b3bcf05019bc7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:44:32.348930 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-662155f9-2d24-4fe0-9ca1-f88dc351b4ef tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] HTTP exception thrown: Flavor cc8950d1-f3a6-4a72-a6ab-4a8792d282e5 could not be found. Aug 27 03:44:32.354461 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-662155f9-2d24-4fe0-9ca1-f88dc351b4ef tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Request method failure captured: Aug 27 03:44:32.354461 n-d-852278-4 devstack@n-api.service[134052]: request: POST /compute/v2.1/servers/a1d12a99-fc51-4ffa-b296-7cca38d78ae7/action HTTP/1.1 Aug 27 03:44:32.354461 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 03:44:32.354461 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 03:44:32.354461 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 03:44:32.354461 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 65 Aug 27 03:44:32.354461 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 03:44:32.354461 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 03:44:32.354461 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 03:44:32.354461 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 03:44:32.354461 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCZMEX5I7MAXUKFEUgvU5lu-KLA5OPRnjt_T07zbueIJLEO8Zo1o4eZZbMp8gfWr1yI7GijU1HmE_WOwk03VHHG9fT8H7Lakjx3KpP6EhdSE-bsBN9OlOixCx3eWyY2dewP5avt6FDuMqWA6Jls0bG6l2bcvygEtlYcTb6Vu4fKqEF2Y Aug 27 03:44:32.354461 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 03:44:32.354461 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 03:44:32.354461 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 03:44:32.354461 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 03:44:32.354461 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 03:44:32.354461 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 03:44:32.354461 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 35c9f8663768487f8b3bcf05019bc7c6 Aug 27 03:44:32.354461 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ServersNegativeTestJSON-1853689643 Aug 27 03:44:32.354461 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 03:44:32.354461 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 03:44:32.354461 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/35c9f8663768487f8b3bcf05019bc7c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_35c9f8663768487f8b3bcf05019bc7c6", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/35c9f8663768487f8b3bcf05019bc7c6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/35c9f8663768487f8b3bcf05019bc7c6"}]}] Aug 27 03:44:32.354461 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ServersNegativeTestJSON-1853689643 Aug 27 03:44:32.354461 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 35c9f8663768487f8b3bcf05019bc7c6 Aug 27 03:44:32.354461 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1853689643 Aug 27 03:44:32.354461 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ServersNegativeTestJSON-1853689643-project Aug 27 03:44:32.354461 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 03:44:32.354461 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 03:44:32.354461 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: f4bfa2f8d8664c84bd1e26ac1311dcb0 Aug 27 03:44:32.354461 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ServersNegativeTestJSON-1853689643-project Aug 27 03:44:32.354461 n-d-852278-4 devstack@n-api.service[134052]: Aug 27 03:44:32.354461 n-d-852278-4 devstack@n-api.service[134052]: {"resize": {"flavorRef": "cc8950d1-f3a6-4a72-a6ab-4a8792d282e5"}} Aug 27 03:44:32.354461 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 03:44:32.354461 n-d-852278-4 devstack@n-api.service[134052]: exception: Flavor cc8950d1-f3a6-4a72-a6ab-4a8792d282e5 could not be found. Aug 27 03:44:32.354461 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': 'a1d12a99-fc51-4ffa-b296-7cca38d78ae7', 'body': {'resize': {'flavorRef': 'cc8950d1-f3a6-4a72-a6ab-4a8792d282e5'}}} Aug 27 03:44:32.354461 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:44:32.354461 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:44:32.354461 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 27 03:44:32.354461 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 27 03:44:32.354461 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 27 03:44:32.354461 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 03:44:32.354461 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 27 03:44:32.354461 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 27 03:44:32.354461 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 27 03:44:32.354461 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 27 03:44:32.354461 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 03:44:32.354461 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 03:44:32.354461 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 27 03:44:32.354461 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 27 03:44:32.354461 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Aug 27 03:44:32.354461 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 03:44:32.354461 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4198, in resize Aug 27 03:44:32.354461 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Aug 27 03:44:32.354461 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 27 03:44:32.354461 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 27 03:44:32.354461 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 03:44:32.354461 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 03:44:32.354461 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 27 03:44:32.354461 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 27 03:44:32.354461 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 27 03:44:32.354461 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:44:32.354461 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 27 03:44:32.358247 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 27 03:44:32.358247 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor cc8950d1-f3a6-4a72-a6ab-4a8792d282e5 could not be found. Aug 27 03:44:32.358247 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:44:32.358247 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:44:32.358247 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:44:32.358247 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:44:32.358247 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:44:32.358247 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:44:32.358247 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:44:32.358247 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:44:32.358247 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:44:32.358247 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:44:32.358247 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:44:32.358247 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:44:32.358247 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 27 03:44:32.358247 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 27 03:44:32.358247 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Aug 27 03:44:32.358247 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 27 03:44:32.358247 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor cc8950d1-f3a6-4a72-a6ab-4a8792d282e5 could not be found. Aug 27 03:44:32.358247 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:44:32.358247 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:44:32.358247 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:44:32.358247 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:44:32.358247 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:44:32.358247 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:44:32.358247 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:44:32.358247 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:44:32.358247 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor cc8950d1-f3a6-4a72-a6ab-4a8792d282e5 could not be found. Aug 27 03:44:32.358247 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:44:32.358247 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-662155f9-2d24-4fe0-9ca1-f88dc351b4ef tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Returning 400 to user: Flavor cc8950d1-f3a6-4a72-a6ab-4a8792d282e5 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:44:32.358247 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-662155f9-2d24-4fe0-9ca1-f88dc351b4ef tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] 10.222.0.70 "POST /compute/v2.1/servers/a1d12a99-fc51-4ffa-b296-7cca38d78ae7/action" status: 400 len: 107 microversion: 2.1 time: 0.057766 Aug 27 03:44:32.358247 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3339/6725] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:44:32 2022] POST /compute/v2.1/servers/a1d12a99-fc51-4ffa-b296-7cca38d78ae7/action => generated 107 bytes in 59 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:44:32.365329 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-1026081d-f2ff-484a-9309-0d8b1ca02eab tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:44:32.365970 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-1026081d-f2ff-484a-9309-0d8b1ca02eab tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] [instance: a1d12a99-fc51-4ffa-b296-7cca38d78ae7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:44:32.372451 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1026081d-f2ff-484a-9309-0d8b1ca02eab tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:32.372965 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1026081d-f2ff-484a-9309-0d8b1ca02eab tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:32.373426 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1026081d-f2ff-484a-9309-0d8b1ca02eab tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:32.374169 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1026081d-f2ff-484a-9309-0d8b1ca02eab tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:32.374619 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1026081d-f2ff-484a-9309-0d8b1ca02eab tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:32.375063 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1026081d-f2ff-484a-9309-0d8b1ca02eab tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:32.511643 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-1026081d-f2ff-484a-9309-0d8b1ca02eab tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4bfa2f8d8664c84bd1e26ac1311dcb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c9f8663768487f8b3bcf05019bc7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:44:32.520197 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-1026081d-f2ff-484a-9309-0d8b1ca02eab tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] 10.222.0.70 "GET /compute/v2.1/servers/a1d12a99-fc51-4ffa-b296-7cca38d78ae7" status: 200 len: 1506 microversion: 2.1 time: 0.158846 Aug 27 03:44:32.520791 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3387/6726] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:44:32 2022] GET /compute/v2.1/servers/a1d12a99-fc51-4ffa-b296-7cca38d78ae7 => generated 1506 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:44:32.544236 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-44805c9f-5680-4f01-8f9f-1a21c8d25e42 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:44:32.545270 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-44805c9f-5680-4f01-8f9f-1a21c8d25e42 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] [instance: a1d12a99-fc51-4ffa-b296-7cca38d78ae7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:44:32.555477 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-44805c9f-5680-4f01-8f9f-1a21c8d25e42 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:32.556361 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-44805c9f-5680-4f01-8f9f-1a21c8d25e42 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:32.556936 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-44805c9f-5680-4f01-8f9f-1a21c8d25e42 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:32.558161 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-44805c9f-5680-4f01-8f9f-1a21c8d25e42 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:32.558838 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-44805c9f-5680-4f01-8f9f-1a21c8d25e42 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:32.559578 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-44805c9f-5680-4f01-8f9f-1a21c8d25e42 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:32.579854 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:44:32.695704 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-44805c9f-5680-4f01-8f9f-1a21c8d25e42 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4bfa2f8d8664c84bd1e26ac1311dcb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c9f8663768487f8b3bcf05019bc7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:44:32.704224 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-44805c9f-5680-4f01-8f9f-1a21c8d25e42 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] 10.222.0.70 "GET /compute/v2.1/servers/a1d12a99-fc51-4ffa-b296-7cca38d78ae7" status: 200 len: 1506 microversion: 2.1 time: 0.166093 Aug 27 03:44:32.704816 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3340/6727] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:44:32 2022] GET /compute/v2.1/servers/a1d12a99-fc51-4ffa-b296-7cca38d78ae7 => generated 1506 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:44:32.724444 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e9a8b2e7-6495-4bde-a890-5d021d24952c tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:44:32.738113 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e9a8b2e7-6495-4bde-a890-5d021d24952c tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Request method failure captured: Aug 27 03:44:32.738113 n-d-852278-4 devstack@n-api.service[134051]: request: POST /compute/v2.1/servers/a1d12a99-fc51-4ffa-b296-7cca38d78ae7/action HTTP/1.1 Aug 27 03:44:32.738113 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 03:44:32.738113 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 03:44:32.738113 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 03:44:32.738113 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 29 Aug 27 03:44:32.738113 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 03:44:32.738113 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 03:44:32.738113 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 03:44:32.738113 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 03:44:32.738113 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCZMEX5I7MAXUKFEUgvU5lu-KLA5OPRnjt_T07zbueIJLEO8Zo1o4eZZbMp8gfWr1yI7GijU1HmE_WOwk03VHHG9fT8H7Lakjx3KpP6EhdSE-bsBN9OlOixCx3eWyY2dewP5avt6FDuMqWA6Jls0bG6l2bcvygEtlYcTb6Vu4fKqEF2Y Aug 27 03:44:32.738113 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 03:44:32.738113 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 03:44:32.738113 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 03:44:32.738113 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 03:44:32.738113 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 03:44:32.738113 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 03:44:32.738113 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 35c9f8663768487f8b3bcf05019bc7c6 Aug 27 03:44:32.738113 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ServersNegativeTestJSON-1853689643 Aug 27 03:44:32.738113 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 03:44:32.738113 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 03:44:32.738113 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/35c9f8663768487f8b3bcf05019bc7c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_35c9f8663768487f8b3bcf05019bc7c6", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/35c9f8663768487f8b3bcf05019bc7c6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/35c9f8663768487f8b3bcf05019bc7c6"}]}] Aug 27 03:44:32.738113 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ServersNegativeTestJSON-1853689643 Aug 27 03:44:32.738113 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 35c9f8663768487f8b3bcf05019bc7c6 Aug 27 03:44:32.738113 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1853689643 Aug 27 03:44:32.738113 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ServersNegativeTestJSON-1853689643-project Aug 27 03:44:32.738113 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 03:44:32.738113 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 03:44:32.738113 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: f4bfa2f8d8664c84bd1e26ac1311dcb0 Aug 27 03:44:32.738113 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ServersNegativeTestJSON-1853689643-project Aug 27 03:44:32.738113 n-d-852278-4 devstack@n-api.service[134051]: Aug 27 03:44:32.738113 n-d-852278-4 devstack@n-api.service[134051]: {"resize": {"flavorRef": ""}} Aug 27 03:44:32.738113 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 03:44:32.738113 n-d-852278-4 devstack@n-api.service[134051]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Aug 27 03:44:32.738113 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': 'a1d12a99-fc51-4ffa-b296-7cca38d78ae7', 'body': {'resize': {'flavorRef': ''}}} Aug 27 03:44:32.738113 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:44:32.738113 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:44:32.738113 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 03:44:32.738113 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 03:44:32.738113 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 03:44:32.738113 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise error Aug 27 03:44:32.738113 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 27 03:44:32.738113 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:44:32.738113 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Aug 27 03:44:32.738113 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Aug 27 03:44:32.738113 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:44:32.738113 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi On instance['resize']: Aug 27 03:44:32.738113 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi '' Aug 27 03:44:32.738113 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:44:32.738113 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:44:32.738113 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:44:32.738113 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:44:32.738113 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:44:32.738113 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:44:32.738113 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:44:32.738113 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:44:32.738113 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:44:32.738113 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:44:32.738113 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 03:44:32.738113 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 03:44:32.738113 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 03:44:32.738113 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 03:44:32.738113 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 03:44:32.738113 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 03:44:32.738113 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Aug 27 03:44:32.738113 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:44:32.738113 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:44:32.744823 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:44:32.744823 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:44:32.744823 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:44:32.744823 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:44:32.744823 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 03:44:32.744823 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 03:44:32.744823 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Aug 27 03:44:32.744823 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:44:32.744823 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e9a8b2e7-6495-4bde-a890-5d021d24952c tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:44:32.744823 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e9a8b2e7-6495-4bde-a890-5d021d24952c tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] 10.222.0.70 "POST /compute/v2.1/servers/a1d12a99-fc51-4ffa-b296-7cca38d78ae7/action" status: 400 len: 113 microversion: 2.1 time: 0.019837 Aug 27 03:44:32.744823 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3388/6728] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:44:32 2022] POST /compute/v2.1/servers/a1d12a99-fc51-4ffa-b296-7cca38d78ae7/action => generated 113 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:44:32.755976 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-aaf80a16-f2cd-46ca-b339-056d4ab11050 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:44:32.756632 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-aaf80a16-f2cd-46ca-b339-056d4ab11050 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] [instance: a1d12a99-fc51-4ffa-b296-7cca38d78ae7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:44:32.763939 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-aaf80a16-f2cd-46ca-b339-056d4ab11050 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:32.764386 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-aaf80a16-f2cd-46ca-b339-056d4ab11050 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:32.764865 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-aaf80a16-f2cd-46ca-b339-056d4ab11050 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:32.765566 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-aaf80a16-f2cd-46ca-b339-056d4ab11050 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:32.766014 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-aaf80a16-f2cd-46ca-b339-056d4ab11050 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:32.766440 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-aaf80a16-f2cd-46ca-b339-056d4ab11050 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:32.902384 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-aaf80a16-f2cd-46ca-b339-056d4ab11050 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4bfa2f8d8664c84bd1e26ac1311dcb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c9f8663768487f8b3bcf05019bc7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:44:32.915091 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-aaf80a16-f2cd-46ca-b339-056d4ab11050 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] 10.222.0.70 "GET /compute/v2.1/servers/a1d12a99-fc51-4ffa-b296-7cca38d78ae7" status: 200 len: 1506 microversion: 2.1 time: 0.167989 Aug 27 03:44:32.915954 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3341/6729] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:44:32 2022] GET /compute/v2.1/servers/a1d12a99-fc51-4ffa-b296-7cca38d78ae7 => generated 1506 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:44:32.943343 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b27dc4db-5366-4995-8431-55a24671664c tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:44:32.944101 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b27dc4db-5366-4995-8431-55a24671664c tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] [instance: d32adf77-8cb0-446c-ad38-585867655f0a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:44:32.954129 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b27dc4db-5366-4995-8431-55a24671664c tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:32.954800 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b27dc4db-5366-4995-8431-55a24671664c tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:32.955451 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b27dc4db-5366-4995-8431-55a24671664c tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:32.956424 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b27dc4db-5366-4995-8431-55a24671664c tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:32.956909 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b27dc4db-5366-4995-8431-55a24671664c tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:32.957351 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b27dc4db-5366-4995-8431-55a24671664c tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:32.971722 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-b27dc4db-5366-4995-8431-55a24671664c tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] HTTP exception thrown: Instance d32adf77-8cb0-446c-ad38-585867655f0a could not be found. Aug 27 03:44:32.973356 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b27dc4db-5366-4995-8431-55a24671664c tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Request method failure captured: Aug 27 03:44:32.973356 n-d-852278-4 devstack@n-api.service[134051]: request: DELETE /compute/v2.1/servers/d32adf77-8cb0-446c-ad38-585867655f0a HTTP/1.1 Aug 27 03:44:32.973356 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 03:44:32.973356 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 03:44:32.973356 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 03:44:32.973356 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 03:44:32.973356 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 03:44:32.973356 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 03:44:32.973356 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 03:44:32.973356 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 03:44:32.973356 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCZMEX5I7MAXUKFEUgvU5lu-KLA5OPRnjt_T07zbueIJLEO8Zo1o4eZZbMp8gfWr1yI7GijU1HmE_WOwk03VHHG9fT8H7Lakjx3KpP6EhdSE-bsBN9OlOixCx3eWyY2dewP5avt6FDuMqWA6Jls0bG6l2bcvygEtlYcTb6Vu4fKqEF2Y Aug 27 03:44:32.973356 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 03:44:32.973356 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 03:44:32.973356 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 03:44:32.973356 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 03:44:32.973356 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 03:44:32.973356 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 03:44:32.973356 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 35c9f8663768487f8b3bcf05019bc7c6 Aug 27 03:44:32.973356 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ServersNegativeTestJSON-1853689643 Aug 27 03:44:32.973356 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 03:44:32.973356 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 03:44:32.973356 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/35c9f8663768487f8b3bcf05019bc7c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_35c9f8663768487f8b3bcf05019bc7c6", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/35c9f8663768487f8b3bcf05019bc7c6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/35c9f8663768487f8b3bcf05019bc7c6"}]}] Aug 27 03:44:32.973356 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ServersNegativeTestJSON-1853689643 Aug 27 03:44:32.973356 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 35c9f8663768487f8b3bcf05019bc7c6 Aug 27 03:44:32.973356 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1853689643 Aug 27 03:44:32.973356 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ServersNegativeTestJSON-1853689643-project Aug 27 03:44:32.973356 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 03:44:32.973356 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 03:44:32.973356 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: f4bfa2f8d8664c84bd1e26ac1311dcb0 Aug 27 03:44:32.973356 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ServersNegativeTestJSON-1853689643-project Aug 27 03:44:32.973356 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 03:44:32.973356 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance d32adf77-8cb0-446c-ad38-585867655f0a could not be found. Aug 27 03:44:32.973356 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': 'd32adf77-8cb0-446c-ad38-585867655f0a'} Aug 27 03:44:32.973356 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:44:32.973356 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:44:32.973356 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:44:32.973356 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:44:32.973356 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:44:32.973356 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:44:32.973356 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:44:32.973356 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:44:32.973356 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:44:32.973356 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:44:32.973356 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d32adf77-8cb0-446c-ad38-585867655f0a could not be found. Aug 27 03:44:32.973356 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:44:32.973356 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:44:32.973356 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:44:32.973356 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:44:32.973356 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:44:32.973356 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:44:32.973356 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:44:32.973356 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:44:32.973356 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:44:32.973356 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:44:32.973356 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 03:44:32.973356 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 03:44:32.973356 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 03:44:32.973356 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 03:44:32.973356 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:44:32.973356 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:44:32.973356 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:44:32.973356 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:44:32.977464 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d32adf77-8cb0-446c-ad38-585867655f0a could not be found. Aug 27 03:44:32.977464 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:44:32.977464 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:44:32.977464 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:44:32.977464 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:44:32.977464 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:44:32.977464 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:44:32.977464 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:44:32.977464 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:44:32.977464 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d32adf77-8cb0-446c-ad38-585867655f0a could not be found. Aug 27 03:44:32.977464 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:44:32.977464 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b27dc4db-5366-4995-8431-55a24671664c tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Returning 404 to user: Instance d32adf77-8cb0-446c-ad38-585867655f0a could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:44:32.977464 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b27dc4db-5366-4995-8431-55a24671664c tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] 10.222.0.70 "DELETE /compute/v2.1/servers/d32adf77-8cb0-446c-ad38-585867655f0a" status: 404 len: 111 microversion: 2.1 time: 0.038659 Aug 27 03:44:32.977464 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3389/6730] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 03:44:32 2022] DELETE /compute/v2.1/servers/d32adf77-8cb0-446c-ad38-585867655f0a => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:44:32.983784 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-746de786-835a-4594-9af7-421225d6a310 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:44:32.984429 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-746de786-835a-4594-9af7-421225d6a310 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] [instance: d32adf77-8cb0-446c-ad38-585867655f0a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:44:32.991518 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-746de786-835a-4594-9af7-421225d6a310 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:32.992008 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-746de786-835a-4594-9af7-421225d6a310 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:32.992478 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-746de786-835a-4594-9af7-421225d6a310 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:32.993201 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-746de786-835a-4594-9af7-421225d6a310 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:32.993647 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-746de786-835a-4594-9af7-421225d6a310 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:32.994071 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-746de786-835a-4594-9af7-421225d6a310 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:33.007909 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-746de786-835a-4594-9af7-421225d6a310 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] HTTP exception thrown: Instance d32adf77-8cb0-446c-ad38-585867655f0a could not be found. Aug 27 03:44:33.009501 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-746de786-835a-4594-9af7-421225d6a310 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Request method failure captured: Aug 27 03:44:33.009501 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/servers/d32adf77-8cb0-446c-ad38-585867655f0a HTTP/1.1 Aug 27 03:44:33.009501 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 03:44:33.009501 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 03:44:33.009501 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 03:44:33.009501 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 03:44:33.009501 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 03:44:33.009501 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 03:44:33.009501 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 03:44:33.009501 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 03:44:33.009501 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCZMEX5I7MAXUKFEUgvU5lu-KLA5OPRnjt_T07zbueIJLEO8Zo1o4eZZbMp8gfWr1yI7GijU1HmE_WOwk03VHHG9fT8H7Lakjx3KpP6EhdSE-bsBN9OlOixCx3eWyY2dewP5avt6FDuMqWA6Jls0bG6l2bcvygEtlYcTb6Vu4fKqEF2Y Aug 27 03:44:33.009501 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 03:44:33.009501 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 03:44:33.009501 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 03:44:33.009501 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 03:44:33.009501 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 03:44:33.009501 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 03:44:33.009501 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 35c9f8663768487f8b3bcf05019bc7c6 Aug 27 03:44:33.009501 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-ServersNegativeTestJSON-1853689643 Aug 27 03:44:33.009501 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 03:44:33.009501 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 03:44:33.009501 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/35c9f8663768487f8b3bcf05019bc7c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_35c9f8663768487f8b3bcf05019bc7c6", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/35c9f8663768487f8b3bcf05019bc7c6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/35c9f8663768487f8b3bcf05019bc7c6"}]}] Aug 27 03:44:33.009501 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-ServersNegativeTestJSON-1853689643 Aug 27 03:44:33.009501 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 35c9f8663768487f8b3bcf05019bc7c6 Aug 27 03:44:33.009501 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1853689643 Aug 27 03:44:33.009501 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-ServersNegativeTestJSON-1853689643-project Aug 27 03:44:33.009501 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 03:44:33.009501 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 03:44:33.009501 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: f4bfa2f8d8664c84bd1e26ac1311dcb0 Aug 27 03:44:33.009501 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-ServersNegativeTestJSON-1853689643-project Aug 27 03:44:33.009501 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 03:44:33.009501 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance d32adf77-8cb0-446c-ad38-585867655f0a could not be found. Aug 27 03:44:33.009501 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': 'd32adf77-8cb0-446c-ad38-585867655f0a'} Aug 27 03:44:33.009501 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:44:33.009501 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:44:33.009501 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:44:33.009501 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:44:33.009501 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:44:33.009501 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:44:33.009501 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:44:33.009501 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:44:33.009501 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:44:33.009501 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:44:33.009501 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d32adf77-8cb0-446c-ad38-585867655f0a could not be found. Aug 27 03:44:33.009501 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:44:33.009501 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:44:33.009501 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:44:33.009501 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:44:33.009501 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:44:33.009501 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:44:33.009501 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:44:33.009501 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:44:33.009501 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:44:33.009501 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:44:33.009501 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:44:33.009501 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:44:33.009501 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:44:33.009501 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:44:33.009501 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:44:33.009501 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:44:33.009501 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d32adf77-8cb0-446c-ad38-585867655f0a could not be found. Aug 27 03:44:33.009501 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:44:33.009501 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:44:33.009501 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:44:33.013666 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:44:33.013666 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:44:33.013666 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:44:33.013666 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:44:33.013666 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:44:33.013666 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d32adf77-8cb0-446c-ad38-585867655f0a could not be found. Aug 27 03:44:33.013666 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:44:33.013666 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-746de786-835a-4594-9af7-421225d6a310 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Returning 404 to user: Instance d32adf77-8cb0-446c-ad38-585867655f0a could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:44:33.013666 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-746de786-835a-4594-9af7-421225d6a310 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] 10.222.0.70 "GET /compute/v2.1/servers/d32adf77-8cb0-446c-ad38-585867655f0a" status: 404 len: 111 microversion: 2.1 time: 0.031160 Aug 27 03:44:33.013666 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3342/6731] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:44:32 2022] GET /compute/v2.1/servers/d32adf77-8cb0-446c-ad38-585867655f0a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:44:33.021537 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a70eb337-f5cf-4b1c-965d-26ce5a448e0a tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:44:33.021995 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-a70eb337-f5cf-4b1c-965d-26ce5a448e0a tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] [instance: a1d12a99-fc51-4ffa-b296-7cca38d78ae7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:44:33.028711 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a70eb337-f5cf-4b1c-965d-26ce5a448e0a tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:33.029177 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a70eb337-f5cf-4b1c-965d-26ce5a448e0a tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:33.029664 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a70eb337-f5cf-4b1c-965d-26ce5a448e0a tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:33.030388 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a70eb337-f5cf-4b1c-965d-26ce5a448e0a tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:33.030860 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a70eb337-f5cf-4b1c-965d-26ce5a448e0a tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:33.031309 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a70eb337-f5cf-4b1c-965d-26ce5a448e0a tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:33.057982 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-a70eb337-f5cf-4b1c-965d-26ce5a448e0a tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] [instance: a1d12a99-fc51-4ffa-b296-7cca38d78ae7] Going to try to terminate instance {{(pid=134051) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:44:33.139660 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a70eb337-f5cf-4b1c-965d-26ce5a448e0a tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] 10.222.0.70 "DELETE /compute/v2.1/servers/a1d12a99-fc51-4ffa-b296-7cca38d78ae7" status: 204 len: 0 microversion: 2.1 time: 0.122736 Aug 27 03:44:33.140484 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3390/6732] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 03:44:33 2022] DELETE /compute/v2.1/servers/a1d12a99-fc51-4ffa-b296-7cca38d78ae7 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:44:33.148795 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-57314df2-fa6c-4678-b5a9-f67e7a538eb2 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:44:33.149434 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-57314df2-fa6c-4678-b5a9-f67e7a538eb2 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] [instance: a1d12a99-fc51-4ffa-b296-7cca38d78ae7] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:44:33.156105 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-57314df2-fa6c-4678-b5a9-f67e7a538eb2 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:33.156694 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-57314df2-fa6c-4678-b5a9-f67e7a538eb2 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:33.157107 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-57314df2-fa6c-4678-b5a9-f67e7a538eb2 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:33.157786 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-57314df2-fa6c-4678-b5a9-f67e7a538eb2 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:33.158222 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-57314df2-fa6c-4678-b5a9-f67e7a538eb2 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:33.158633 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-57314df2-fa6c-4678-b5a9-f67e7a538eb2 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:33.292584 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-57314df2-fa6c-4678-b5a9-f67e7a538eb2 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4bfa2f8d8664c84bd1e26ac1311dcb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c9f8663768487f8b3bcf05019bc7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:44:33.302049 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-57314df2-fa6c-4678-b5a9-f67e7a538eb2 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] 10.222.0.70 "GET /compute/v2.1/servers/a1d12a99-fc51-4ffa-b296-7cca38d78ae7" status: 200 len: 1512 microversion: 2.1 time: 0.157207 Aug 27 03:44:33.302685 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3343/6733] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:44:33 2022] GET /compute/v2.1/servers/a1d12a99-fc51-4ffa-b296-7cca38d78ae7 => generated 1512 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:44:34.328786 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-2dfc1d53-bd83-434c-95a9-44ff431d0676 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:44:34.329626 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-2dfc1d53-bd83-434c-95a9-44ff431d0676 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] [instance: a1d12a99-fc51-4ffa-b296-7cca38d78ae7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:44:34.337033 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2dfc1d53-bd83-434c-95a9-44ff431d0676 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:34.337597 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2dfc1d53-bd83-434c-95a9-44ff431d0676 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:34.338074 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2dfc1d53-bd83-434c-95a9-44ff431d0676 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:34.338791 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2dfc1d53-bd83-434c-95a9-44ff431d0676 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:34.339236 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2dfc1d53-bd83-434c-95a9-44ff431d0676 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:34.339697 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2dfc1d53-bd83-434c-95a9-44ff431d0676 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:34.344875 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:44:34.480047 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-2dfc1d53-bd83-434c-95a9-44ff431d0676 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4bfa2f8d8664c84bd1e26ac1311dcb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c9f8663768487f8b3bcf05019bc7c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:44:34.488461 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-2dfc1d53-bd83-434c-95a9-44ff431d0676 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] 10.222.0.70 "GET /compute/v2.1/servers/a1d12a99-fc51-4ffa-b296-7cca38d78ae7" status: 200 len: 1512 microversion: 2.1 time: 0.165369 Aug 27 03:44:34.489042 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3391/6734] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:44:34 2022] GET /compute/v2.1/servers/a1d12a99-fc51-4ffa-b296-7cca38d78ae7 => generated 1512 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:44:34.962984 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-e4f00266-8abf-495d-9370-3517725743ad req-47deb267-2f0e-4fd2-81af-7eaa36377d4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1d12a99-fc51-4ffa-b296-7cca38d78ae7", "name": "network-vif-deleted", "tag": "e4ad8f5f-8d01-4172-85b0-2d85ee910237"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:44:34.974757 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-e4f00266-8abf-495d-9370-3517725743ad req-47deb267-2f0e-4fd2-81af-7eaa36377d4f service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:34.975257 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-e4f00266-8abf-495d-9370-3517725743ad req-47deb267-2f0e-4fd2-81af-7eaa36377d4f service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:34.975701 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-e4f00266-8abf-495d-9370-3517725743ad req-47deb267-2f0e-4fd2-81af-7eaa36377d4f service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:34.991417 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-e4f00266-8abf-495d-9370-3517725743ad req-47deb267-2f0e-4fd2-81af-7eaa36377d4f service nova] Creating event network-vif-deleted:e4ad8f5f-8d01-4172-85b0-2d85ee910237 for instance a1d12a99-fc51-4ffa-b296-7cca38d78ae7 on n-h2-852278-4 Aug 27 03:44:34.996504 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-e4f00266-8abf-495d-9370-3517725743ad req-47deb267-2f0e-4fd2-81af-7eaa36377d4f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037505 Aug 27 03:44:34.997357 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3344/6735] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:44:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:44:35.511346 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c38a9d0d-7b2a-4227-8dbd-ea31e1002230 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:44:35.512202 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-c38a9d0d-7b2a-4227-8dbd-ea31e1002230 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] [instance: a1d12a99-fc51-4ffa-b296-7cca38d78ae7] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:44:35.519475 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c38a9d0d-7b2a-4227-8dbd-ea31e1002230 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:35.519979 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c38a9d0d-7b2a-4227-8dbd-ea31e1002230 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:35.520518 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c38a9d0d-7b2a-4227-8dbd-ea31e1002230 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:35.521233 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c38a9d0d-7b2a-4227-8dbd-ea31e1002230 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:35.521713 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c38a9d0d-7b2a-4227-8dbd-ea31e1002230 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:35.522153 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c38a9d0d-7b2a-4227-8dbd-ea31e1002230 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:35.536090 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-c38a9d0d-7b2a-4227-8dbd-ea31e1002230 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] HTTP exception thrown: Instance a1d12a99-fc51-4ffa-b296-7cca38d78ae7 could not be found. Aug 27 03:44:35.537841 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c38a9d0d-7b2a-4227-8dbd-ea31e1002230 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Request method failure captured: Aug 27 03:44:35.537841 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/a1d12a99-fc51-4ffa-b296-7cca38d78ae7 HTTP/1.1 Aug 27 03:44:35.537841 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 03:44:35.537841 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 03:44:35.537841 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 03:44:35.537841 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 03:44:35.537841 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 03:44:35.537841 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 03:44:35.537841 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 03:44:35.537841 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 03:44:35.537841 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCZMEX5I7MAXUKFEUgvU5lu-KLA5OPRnjt_T07zbueIJLEO8Zo1o4eZZbMp8gfWr1yI7GijU1HmE_WOwk03VHHG9fT8H7Lakjx3KpP6EhdSE-bsBN9OlOixCx3eWyY2dewP5avt6FDuMqWA6Jls0bG6l2bcvygEtlYcTb6Vu4fKqEF2Y Aug 27 03:44:35.537841 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 03:44:35.537841 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 03:44:35.537841 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 03:44:35.537841 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 03:44:35.537841 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 03:44:35.537841 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 03:44:35.537841 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 35c9f8663768487f8b3bcf05019bc7c6 Aug 27 03:44:35.537841 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-ServersNegativeTestJSON-1853689643 Aug 27 03:44:35.537841 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 03:44:35.537841 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 03:44:35.537841 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/35c9f8663768487f8b3bcf05019bc7c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_35c9f8663768487f8b3bcf05019bc7c6", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/35c9f8663768487f8b3bcf05019bc7c6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/35c9f8663768487f8b3bcf05019bc7c6"}]}] Aug 27 03:44:35.537841 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-ServersNegativeTestJSON-1853689643 Aug 27 03:44:35.537841 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 35c9f8663768487f8b3bcf05019bc7c6 Aug 27 03:44:35.537841 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1853689643 Aug 27 03:44:35.537841 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-ServersNegativeTestJSON-1853689643-project Aug 27 03:44:35.537841 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 03:44:35.537841 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 03:44:35.537841 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: f4bfa2f8d8664c84bd1e26ac1311dcb0 Aug 27 03:44:35.537841 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-ServersNegativeTestJSON-1853689643-project Aug 27 03:44:35.537841 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 03:44:35.537841 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance a1d12a99-fc51-4ffa-b296-7cca38d78ae7 could not be found. Aug 27 03:44:35.537841 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': 'a1d12a99-fc51-4ffa-b296-7cca38d78ae7'} Aug 27 03:44:35.537841 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:44:35.537841 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:44:35.537841 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:44:35.537841 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:44:35.537841 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:44:35.537841 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:44:35.537841 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:44:35.537841 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:44:35.537841 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:44:35.537841 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:44:35.537841 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1d12a99-fc51-4ffa-b296-7cca38d78ae7 could not be found. Aug 27 03:44:35.537841 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:44:35.537841 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:44:35.537841 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:44:35.537841 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:44:35.537841 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:44:35.537841 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:44:35.537841 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:44:35.537841 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:44:35.537841 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:44:35.537841 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:44:35.537841 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:44:35.537841 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:44:35.537841 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:44:35.537841 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:44:35.537841 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:44:35.537841 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:44:35.537841 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1d12a99-fc51-4ffa-b296-7cca38d78ae7 could not be found. Aug 27 03:44:35.537841 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:44:35.537841 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:44:35.537841 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:44:35.542120 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:44:35.542120 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:44:35.542120 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:44:35.542120 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:44:35.542120 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:44:35.542120 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1d12a99-fc51-4ffa-b296-7cca38d78ae7 could not be found. Aug 27 03:44:35.542120 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:44:35.542120 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c38a9d0d-7b2a-4227-8dbd-ea31e1002230 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] Returning 404 to user: Instance a1d12a99-fc51-4ffa-b296-7cca38d78ae7 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:44:35.542120 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c38a9d0d-7b2a-4227-8dbd-ea31e1002230 tempest-ServersNegativeTestJSON-1853689643 tempest-ServersNegativeTestJSON-1853689643-project] 10.222.0.70 "GET /compute/v2.1/servers/a1d12a99-fc51-4ffa-b296-7cca38d78ae7" status: 404 len: 111 microversion: 2.1 time: 0.033030 Aug 27 03:44:35.542120 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3392/6736] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:44:35 2022] GET /compute/v2.1/servers/a1d12a99-fc51-4ffa-b296-7cca38d78ae7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:45:07.303323 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:45:07.304681 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=18 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:45:07.516971 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-df8da123-4697-4eec-8a3b-1b2974c7a50d tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Action: 'create', calling method: .version_select at 0x7f5ee1d30280>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1094701189", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO+83GjbolSlqkHXD8pMR86xP/v6nRlo8OJdFsXa1ur3U/hRpLaYNV72REt2IHwgE2ZpLTPjMKWdOX1DMKDNCqbSNg6BALQ6zhQvSdQCF2BwV3tJizhNANX0V78deNXe2Q=="}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:45:07.536827 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-df8da123-4697-4eec-8a3b-1b2974c7a50d tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Getting quotas for project cfd51c7913c94094bf412fc0ac22e291. Resources: {'key_pairs'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:45:07.543634 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-df8da123-4697-4eec-8a3b-1b2974c7a50d tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Getting quotas for user e81627d91d3240a1aec4176d6d8279f5 and project cfd51c7913c94094bf412fc0ac22e291. Resources: {'key_pairs'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:45:07.574184 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-df8da123-4697-4eec-8a3b-1b2974c7a50d tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.273357 Aug 27 03:45:07.574814 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3345/6737] 10.222.0.70 () {60 vars in 1159 bytes} [Sat Aug 27 03:45:07 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:45:07.629333 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f0a20a45-41c3-4920-8225-d646707b4662 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-286079216", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1094701189", "networks": [{"uuid": "aee88d26-e03b-45c2-9472-a64c967023af"}]}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:45:07.645068 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:45:07.646294 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=6 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:45:07.699640 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.network.neutron [None req-f0a20a45-41c3-4920-8225-d646707b4662 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] validate_networks() for [('aee88d26-e03b-45c2-9472-a64c967023af', None, None, None, None, None)] {{(pid=134051) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:45:08.089624 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-f0a20a45-41c3-4920-8225-d646707b4662 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Flavor limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:45:08.090307 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-f0a20a45-41c3-4920-8225-d646707b4662 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Image limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:45:08.090799 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-f0a20a45-41c3-4920-8225-d646707b4662 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Flavor pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:45:08.091230 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-f0a20a45-41c3-4920-8225-d646707b4662 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Image pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:45:08.091660 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-f0a20a45-41c3-4920-8225-d646707b4662 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:45:08.102870 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f0a20a45-41c3-4920-8225-d646707b4662 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:08.103369 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f0a20a45-41c3-4920-8225-d646707b4662 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:08.103886 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f0a20a45-41c3-4920-8225-d646707b4662 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:08.104702 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f0a20a45-41c3-4920-8225-d646707b4662 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:08.105143 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f0a20a45-41c3-4920-8225-d646707b4662 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:08.105720 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f0a20a45-41c3-4920-8225-d646707b4662 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:08.123689 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-f0a20a45-41c3-4920-8225-d646707b4662 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Getting quotas for project cfd51c7913c94094bf412fc0ac22e291. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:45:08.129387 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-f0a20a45-41c3-4920-8225-d646707b4662 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Getting quotas for user e81627d91d3240a1aec4176d6d8279f5 and project cfd51c7913c94094bf412fc0ac22e291. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:45:08.146537 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-f0a20a45-41c3-4920-8225-d646707b4662 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Going to run 1 instances... {{(pid=134051) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:45:08.149054 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-f0a20a45-41c3-4920-8225-d646707b4662 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] [instance: a3280606-1678-4364-8e6e-8b74244024a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134051) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:45:08.203245 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-f0a20a45-41c3-4920-8225-d646707b4662 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.578336 Aug 27 03:45:08.203941 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3393/6738] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 03:45:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 580 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:45:08.216442 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0d7a66d4-7824-4c30-8bf8-ef97c440806d tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:45:08.218041 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-0d7a66d4-7824-4c30-8bf8-ef97c440806d tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] [instance: a3280606-1678-4364-8e6e-8b74244024a0] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:45:08.287979 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0d7a66d4-7824-4c30-8bf8-ef97c440806d tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81627d91d3240a1aec4176d6d8279f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd51c7913c94094bf412fc0ac22e291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:45:08.297409 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-0d7a66d4-7824-4c30-8bf8-ef97c440806d tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] 10.222.0.70 "GET /compute/v2.1/servers/a3280606-1678-4364-8e6e-8b74244024a0" status: 200 len: 1262 microversion: 2.1 time: 0.086593 Aug 27 03:45:08.298020 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3346/6739] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:45:08 2022] GET /compute/v2.1/servers/a3280606-1678-4364-8e6e-8b74244024a0 => generated 1262 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:45:09.319443 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a49b3a0a-7695-4203-b912-06b491bd1a66 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:45:09.320368 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-a49b3a0a-7695-4203-b912-06b491bd1a66 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] [instance: a3280606-1678-4364-8e6e-8b74244024a0] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:45:09.327422 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a49b3a0a-7695-4203-b912-06b491bd1a66 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:09.327945 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a49b3a0a-7695-4203-b912-06b491bd1a66 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:09.328421 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a49b3a0a-7695-4203-b912-06b491bd1a66 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:09.329328 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a49b3a0a-7695-4203-b912-06b491bd1a66 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:09.329791 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a49b3a0a-7695-4203-b912-06b491bd1a66 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:09.330226 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a49b3a0a-7695-4203-b912-06b491bd1a66 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:09.714041 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-a49b3a0a-7695-4203-b912-06b491bd1a66 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81627d91d3240a1aec4176d6d8279f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd51c7913c94094bf412fc0ac22e291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:45:09.722834 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a49b3a0a-7695-4203-b912-06b491bd1a66 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] 10.222.0.70 "GET /compute/v2.1/servers/a3280606-1678-4364-8e6e-8b74244024a0" status: 200 len: 1322 microversion: 2.1 time: 0.407396 Aug 27 03:45:09.724032 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3394/6740] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:45:09 2022] GET /compute/v2.1/servers/a3280606-1678-4364-8e6e-8b74244024a0 => generated 1322 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:45:10.744427 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-074869db-2af4-4cb0-a200-1c5348db9f45 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:45:10.745034 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-074869db-2af4-4cb0-a200-1c5348db9f45 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] [instance: a3280606-1678-4364-8e6e-8b74244024a0] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:45:10.753394 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-074869db-2af4-4cb0-a200-1c5348db9f45 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:10.753874 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-074869db-2af4-4cb0-a200-1c5348db9f45 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:10.754336 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-074869db-2af4-4cb0-a200-1c5348db9f45 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:10.755025 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-074869db-2af4-4cb0-a200-1c5348db9f45 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:10.755545 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-074869db-2af4-4cb0-a200-1c5348db9f45 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:10.756040 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-074869db-2af4-4cb0-a200-1c5348db9f45 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:10.989948 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-074869db-2af4-4cb0-a200-1c5348db9f45 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81627d91d3240a1aec4176d6d8279f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd51c7913c94094bf412fc0ac22e291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:45:10.998219 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-074869db-2af4-4cb0-a200-1c5348db9f45 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] 10.222.0.70 "GET /compute/v2.1/servers/a3280606-1678-4364-8e6e-8b74244024a0" status: 200 len: 1362 microversion: 2.1 time: 0.257905 Aug 27 03:45:10.998829 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3347/6741] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:45:10 2022] GET /compute/v2.1/servers/a3280606-1678-4364-8e6e-8b74244024a0 => generated 1362 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:45:11.108846 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-bd16be9d-56f4-49be-9237-ed1b8ba62080 req-176c1a9d-3d24-42ef-9371-9f8edeb1b102 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3280606-1678-4364-8e6e-8b74244024a0", "tag": "498097ed-4a93-4e64-a30e-185b935f8c77"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:45:11.121236 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-bd16be9d-56f4-49be-9237-ed1b8ba62080 req-176c1a9d-3d24-42ef-9371-9f8edeb1b102 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:11.121786 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-bd16be9d-56f4-49be-9237-ed1b8ba62080 req-176c1a9d-3d24-42ef-9371-9f8edeb1b102 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:11.122186 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-bd16be9d-56f4-49be-9237-ed1b8ba62080 req-176c1a9d-3d24-42ef-9371-9f8edeb1b102 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:11.133542 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-bd16be9d-56f4-49be-9237-ed1b8ba62080 req-176c1a9d-3d24-42ef-9371-9f8edeb1b102 service nova] Creating event network-changed:498097ed-4a93-4e64-a30e-185b935f8c77 for instance a3280606-1678-4364-8e6e-8b74244024a0 on n-h1-852278-4 Aug 27 03:45:11.139513 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-bd16be9d-56f4-49be-9237-ed1b8ba62080 req-176c1a9d-3d24-42ef-9371-9f8edeb1b102 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035026 Aug 27 03:45:11.140413 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3395/6742] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:45:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:45:12.019580 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4b556ccc-c4aa-4e87-ae3d-bd7f47ad80b3 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:45:12.020231 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-4b556ccc-c4aa-4e87-ae3d-bd7f47ad80b3 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] [instance: a3280606-1678-4364-8e6e-8b74244024a0] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:45:12.027701 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4b556ccc-c4aa-4e87-ae3d-bd7f47ad80b3 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:12.028103 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4b556ccc-c4aa-4e87-ae3d-bd7f47ad80b3 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:12.028658 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4b556ccc-c4aa-4e87-ae3d-bd7f47ad80b3 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:12.029380 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4b556ccc-c4aa-4e87-ae3d-bd7f47ad80b3 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:12.030145 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4b556ccc-c4aa-4e87-ae3d-bd7f47ad80b3 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:12.030570 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4b556ccc-c4aa-4e87-ae3d-bd7f47ad80b3 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:12.166426 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-4b556ccc-c4aa-4e87-ae3d-bd7f47ad80b3 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81627d91d3240a1aec4176d6d8279f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd51c7913c94094bf412fc0ac22e291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:45:12.174670 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-4b556ccc-c4aa-4e87-ae3d-bd7f47ad80b3 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] 10.222.0.70 "GET /compute/v2.1/servers/a3280606-1678-4364-8e6e-8b74244024a0" status: 200 len: 1362 microversion: 2.1 time: 0.159285 Aug 27 03:45:12.175240 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3348/6743] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:45:12 2022] GET /compute/v2.1/servers/a3280606-1678-4364-8e6e-8b74244024a0 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:45:13.200399 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7bda822d-1c3e-49e2-8990-0ac34514ff59 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:45:13.201201 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-7bda822d-1c3e-49e2-8990-0ac34514ff59 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] [instance: a3280606-1678-4364-8e6e-8b74244024a0] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:45:13.210850 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7bda822d-1c3e-49e2-8990-0ac34514ff59 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:13.211546 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7bda822d-1c3e-49e2-8990-0ac34514ff59 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:13.211994 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7bda822d-1c3e-49e2-8990-0ac34514ff59 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:13.212754 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7bda822d-1c3e-49e2-8990-0ac34514ff59 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:13.213222 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7bda822d-1c3e-49e2-8990-0ac34514ff59 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:13.213645 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7bda822d-1c3e-49e2-8990-0ac34514ff59 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:13.371450 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-7bda822d-1c3e-49e2-8990-0ac34514ff59 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81627d91d3240a1aec4176d6d8279f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd51c7913c94094bf412fc0ac22e291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:45:13.379488 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-7bda822d-1c3e-49e2-8990-0ac34514ff59 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] 10.222.0.70 "GET /compute/v2.1/servers/a3280606-1678-4364-8e6e-8b74244024a0" status: 200 len: 1362 microversion: 2.1 time: 0.186039 Aug 27 03:45:13.380074 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3396/6744] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:45:13 2022] GET /compute/v2.1/servers/a3280606-1678-4364-8e6e-8b74244024a0 => generated 1362 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:45:14.403890 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ce3fafa2-b398-4673-bc69-a98ae957564a tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:45:14.404878 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-ce3fafa2-b398-4673-bc69-a98ae957564a tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] [instance: a3280606-1678-4364-8e6e-8b74244024a0] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:45:14.415165 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ce3fafa2-b398-4673-bc69-a98ae957564a tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:14.415690 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ce3fafa2-b398-4673-bc69-a98ae957564a tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:14.416105 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ce3fafa2-b398-4673-bc69-a98ae957564a tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:14.416893 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ce3fafa2-b398-4673-bc69-a98ae957564a tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:14.417325 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ce3fafa2-b398-4673-bc69-a98ae957564a tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:14.417776 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ce3fafa2-b398-4673-bc69-a98ae957564a tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:14.553814 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-ce3fafa2-b398-4673-bc69-a98ae957564a tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81627d91d3240a1aec4176d6d8279f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd51c7913c94094bf412fc0ac22e291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:45:14.562069 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ce3fafa2-b398-4673-bc69-a98ae957564a tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] 10.222.0.70 "GET /compute/v2.1/servers/a3280606-1678-4364-8e6e-8b74244024a0" status: 200 len: 1362 microversion: 2.1 time: 0.165026 Aug 27 03:45:14.562728 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3349/6745] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:45:14 2022] GET /compute/v2.1/servers/a3280606-1678-4364-8e6e-8b74244024a0 => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:45:15.584778 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-1a7704de-b74f-4cc8-ac2e-3d442a36e6e3 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:45:15.585381 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-1a7704de-b74f-4cc8-ac2e-3d442a36e6e3 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] [instance: a3280606-1678-4364-8e6e-8b74244024a0] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:45:15.593267 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1a7704de-b74f-4cc8-ac2e-3d442a36e6e3 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:15.593776 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1a7704de-b74f-4cc8-ac2e-3d442a36e6e3 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:15.594229 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1a7704de-b74f-4cc8-ac2e-3d442a36e6e3 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:15.594953 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1a7704de-b74f-4cc8-ac2e-3d442a36e6e3 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:15.595425 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1a7704de-b74f-4cc8-ac2e-3d442a36e6e3 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:15.595863 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1a7704de-b74f-4cc8-ac2e-3d442a36e6e3 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:15.729409 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-1a7704de-b74f-4cc8-ac2e-3d442a36e6e3 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81627d91d3240a1aec4176d6d8279f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd51c7913c94094bf412fc0ac22e291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:45:15.737736 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-1a7704de-b74f-4cc8-ac2e-3d442a36e6e3 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] 10.222.0.70 "GET /compute/v2.1/servers/a3280606-1678-4364-8e6e-8b74244024a0" status: 200 len: 1362 microversion: 2.1 time: 0.157022 Aug 27 03:45:15.738324 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3397/6746] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:45:15 2022] GET /compute/v2.1/servers/a3280606-1678-4364-8e6e-8b74244024a0 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:45:16.035403 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-0e077074-e787-46a8-ae14-b61e49f79224 req-a17cf829-a84e-4011-b587-5b1326ebdb59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3280606-1678-4364-8e6e-8b74244024a0", "name": "network-vif-plugged", "status": "completed", "tag": "498097ed-4a93-4e64-a30e-185b935f8c77"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:45:16.046317 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-0e077074-e787-46a8-ae14-b61e49f79224 req-a17cf829-a84e-4011-b587-5b1326ebdb59 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:16.046823 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-0e077074-e787-46a8-ae14-b61e49f79224 req-a17cf829-a84e-4011-b587-5b1326ebdb59 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:16.047242 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-0e077074-e787-46a8-ae14-b61e49f79224 req-a17cf829-a84e-4011-b587-5b1326ebdb59 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:16.058790 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-0e077074-e787-46a8-ae14-b61e49f79224 req-a17cf829-a84e-4011-b587-5b1326ebdb59 service nova] Creating event network-vif-plugged:498097ed-4a93-4e64-a30e-185b935f8c77 for instance a3280606-1678-4364-8e6e-8b74244024a0 on n-h1-852278-4 Aug 27 03:45:16.063860 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-0e077074-e787-46a8-ae14-b61e49f79224 req-a17cf829-a84e-4011-b587-5b1326ebdb59 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032354 Aug 27 03:45:16.064501 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3350/6747] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:45:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:45:16.762520 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c9ca9db6-a245-4ebe-9acc-dedfb5452f4b tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:45:16.763619 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-c9ca9db6-a245-4ebe-9acc-dedfb5452f4b tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] [instance: a3280606-1678-4364-8e6e-8b74244024a0] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:45:16.774323 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c9ca9db6-a245-4ebe-9acc-dedfb5452f4b tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:16.774835 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c9ca9db6-a245-4ebe-9acc-dedfb5452f4b tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:16.775290 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c9ca9db6-a245-4ebe-9acc-dedfb5452f4b tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:16.776015 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c9ca9db6-a245-4ebe-9acc-dedfb5452f4b tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:16.776535 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c9ca9db6-a245-4ebe-9acc-dedfb5452f4b tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:16.776980 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c9ca9db6-a245-4ebe-9acc-dedfb5452f4b tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:16.917603 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-c9ca9db6-a245-4ebe-9acc-dedfb5452f4b tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81627d91d3240a1aec4176d6d8279f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd51c7913c94094bf412fc0ac22e291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:45:16.926294 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c9ca9db6-a245-4ebe-9acc-dedfb5452f4b tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] 10.222.0.70 "GET /compute/v2.1/servers/a3280606-1678-4364-8e6e-8b74244024a0" status: 200 len: 1362 microversion: 2.1 time: 0.170483 Aug 27 03:45:16.926895 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3398/6748] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:45:16 2022] GET /compute/v2.1/servers/a3280606-1678-4364-8e6e-8b74244024a0 => generated 1362 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:45:17.949262 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-cb5fd58a-e020-4dff-81b2-2e2e022c26be tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:45:17.949994 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-cb5fd58a-e020-4dff-81b2-2e2e022c26be tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] [instance: a3280606-1678-4364-8e6e-8b74244024a0] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:45:17.956838 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cb5fd58a-e020-4dff-81b2-2e2e022c26be tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:17.957323 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cb5fd58a-e020-4dff-81b2-2e2e022c26be tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:17.957758 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cb5fd58a-e020-4dff-81b2-2e2e022c26be tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:17.958469 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cb5fd58a-e020-4dff-81b2-2e2e022c26be tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:17.958903 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cb5fd58a-e020-4dff-81b2-2e2e022c26be tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:17.959329 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cb5fd58a-e020-4dff-81b2-2e2e022c26be tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:18.096674 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-cb5fd58a-e020-4dff-81b2-2e2e022c26be tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81627d91d3240a1aec4176d6d8279f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd51c7913c94094bf412fc0ac22e291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:45:18.105148 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-cb5fd58a-e020-4dff-81b2-2e2e022c26be tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] 10.222.0.70 "GET /compute/v2.1/servers/a3280606-1678-4364-8e6e-8b74244024a0" status: 200 len: 1554 microversion: 2.1 time: 0.161454 Aug 27 03:45:18.105765 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3351/6749] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:45:17 2022] GET /compute/v2.1/servers/a3280606-1678-4364-8e6e-8b74244024a0 => generated 1554 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:45:18.125729 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-372b2e67-2437-4ea5-bc56-8134b81ba4bd tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:45:18.126385 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-372b2e67-2437-4ea5-bc56-8134b81ba4bd tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] [instance: a3280606-1678-4364-8e6e-8b74244024a0] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:45:18.129258 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:45:18.136073 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=6 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:45:18.137666 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-372b2e67-2437-4ea5-bc56-8134b81ba4bd tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:18.138348 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-372b2e67-2437-4ea5-bc56-8134b81ba4bd tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:18.138807 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-372b2e67-2437-4ea5-bc56-8134b81ba4bd tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:18.139769 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-372b2e67-2437-4ea5-bc56-8134b81ba4bd tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:18.140921 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-372b2e67-2437-4ea5-bc56-8134b81ba4bd tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:18.141414 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-372b2e67-2437-4ea5-bc56-8134b81ba4bd tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:18.281712 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-372b2e67-2437-4ea5-bc56-8134b81ba4bd tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81627d91d3240a1aec4176d6d8279f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd51c7913c94094bf412fc0ac22e291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:45:18.294627 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-372b2e67-2437-4ea5-bc56-8134b81ba4bd tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] 10.222.0.70 "GET /compute/v2.1/servers/a3280606-1678-4364-8e6e-8b74244024a0" status: 200 len: 1554 microversion: 2.1 time: 0.172529 Aug 27 03:45:18.295395 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3399/6750] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:45:18 2022] GET /compute/v2.1/servers/a3280606-1678-4364-8e6e-8b74244024a0 => generated 1554 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:45:20.001210 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a782e0aa-c00b-404c-ac86-40d5cf7774d6 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3c2b7598-94fe-4017-bc50-a54c592306d6"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:45:20.003736 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a782e0aa-c00b-404c-ac86-40d5cf7774d6 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] [instance: a3280606-1678-4364-8e6e-8b74244024a0] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:45:20.005775 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=6 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:45:20.012292 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a782e0aa-c00b-404c-ac86-40d5cf7774d6 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:20.012820 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a782e0aa-c00b-404c-ac86-40d5cf7774d6 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:20.013263 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a782e0aa-c00b-404c-ac86-40d5cf7774d6 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:20.013975 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a782e0aa-c00b-404c-ac86-40d5cf7774d6 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:20.014434 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a782e0aa-c00b-404c-ac86-40d5cf7774d6 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:20.014866 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a782e0aa-c00b-404c-ac86-40d5cf7774d6 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:20.299833 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a782e0aa-c00b-404c-ac86-40d5cf7774d6 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] 10.222.0.70 "POST /compute/v2.1/servers/a3280606-1678-4364-8e6e-8b74244024a0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.302612 Aug 27 03:45:20.300446 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3352/6751] 10.222.0.70 () {60 vars in 1323 bytes} [Sat Aug 27 03:45:19 2022] POST /compute/v2.1/servers/a3280606-1678-4364-8e6e-8b74244024a0/os-volume_attachments => generated 194 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:45:31.066804 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-06b69e6a-0da5-4cdb-9700-ae0179b575ea tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:45:31.067372 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-06b69e6a-0da5-4cdb-9700-ae0179b575ea tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] [instance: a3280606-1678-4364-8e6e-8b74244024a0] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:45:31.069952 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:45:31.070823 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=34 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:45:31.076206 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-06b69e6a-0da5-4cdb-9700-ae0179b575ea tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:31.076720 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-06b69e6a-0da5-4cdb-9700-ae0179b575ea tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:31.077170 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-06b69e6a-0da5-4cdb-9700-ae0179b575ea tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:31.077911 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-06b69e6a-0da5-4cdb-9700-ae0179b575ea tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:31.078359 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-06b69e6a-0da5-4cdb-9700-ae0179b575ea tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:31.078801 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-06b69e6a-0da5-4cdb-9700-ae0179b575ea tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:31.165892 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.objects.instance [None req-06b69e6a-0da5-4cdb-9700-ae0179b575ea tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lazy-loading 'services' on Instance uuid a3280606-1678-4364-8e6e-8b74244024a0 {{(pid=134051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:45:31.243024 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-06b69e6a-0da5-4cdb-9700-ae0179b575ea tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] 10.222.0.70 "DELETE /compute/v2.1/servers/a3280606-1678-4364-8e6e-8b74244024a0/os-volume_attachments/3c2b7598-94fe-4017-bc50-a54c592306d6" status: 202 len: 0 microversion: 2.1 time: 0.180086 Aug 27 03:45:31.243619 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3400/6752] 10.222.0.70 () {58 vars in 1416 bytes} [Sat Aug 27 03:45:31 2022] DELETE /compute/v2.1/servers/a3280606-1678-4364-8e6e-8b74244024a0/os-volume_attachments/3c2b7598-94fe-4017-bc50-a54c592306d6 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:45:31.250200 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:45:31.251115 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:45:31.255890 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d6f39b36-bbf7-47af-9a13-d44cea86d2ea tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:45:31.258402 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d6f39b36-bbf7-47af-9a13-d44cea86d2ea tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] [instance: a3280606-1678-4364-8e6e-8b74244024a0] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:45:31.271598 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d6f39b36-bbf7-47af-9a13-d44cea86d2ea tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:31.272182 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d6f39b36-bbf7-47af-9a13-d44cea86d2ea tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:31.272653 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d6f39b36-bbf7-47af-9a13-d44cea86d2ea tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:31.273372 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d6f39b36-bbf7-47af-9a13-d44cea86d2ea tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:31.273828 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d6f39b36-bbf7-47af-9a13-d44cea86d2ea tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:31.274251 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d6f39b36-bbf7-47af-9a13-d44cea86d2ea tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:31.311790 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d6f39b36-bbf7-47af-9a13-d44cea86d2ea tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] 10.222.0.70 "GET /compute/v2.1/servers/a3280606-1678-4364-8e6e-8b74244024a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063201 Aug 27 03:45:31.312543 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3353/6753] 10.222.0.70 () {58 vars in 1302 bytes} [Sat Aug 27 03:45:31 2022] GET /compute/v2.1/servers/a3280606-1678-4364-8e6e-8b74244024a0/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:45:32.326377 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3180fe9a-e1a1-4134-8ca2-37c20e51100c tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:45:32.329091 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-3180fe9a-e1a1-4134-8ca2-37c20e51100c tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] [instance: a3280606-1678-4364-8e6e-8b74244024a0] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:45:32.338677 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3180fe9a-e1a1-4134-8ca2-37c20e51100c tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:32.339181 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3180fe9a-e1a1-4134-8ca2-37c20e51100c tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:32.339692 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3180fe9a-e1a1-4134-8ca2-37c20e51100c tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:32.340447 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3180fe9a-e1a1-4134-8ca2-37c20e51100c tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:32.340939 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3180fe9a-e1a1-4134-8ca2-37c20e51100c tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:32.341394 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3180fe9a-e1a1-4134-8ca2-37c20e51100c tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:32.372711 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-3180fe9a-e1a1-4134-8ca2-37c20e51100c tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] 10.222.0.70 "GET /compute/v2.1/servers/a3280606-1678-4364-8e6e-8b74244024a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051533 Aug 27 03:45:32.373285 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3401/6754] 10.222.0.70 () {58 vars in 1302 bytes} [Sat Aug 27 03:45:32 2022] GET /compute/v2.1/servers/a3280606-1678-4364-8e6e-8b74244024a0/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:45:33.388203 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-46df8e86-6e2d-458b-8b91-88bdd42899e4 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:45:33.391499 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-46df8e86-6e2d-458b-8b91-88bdd42899e4 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] [instance: a3280606-1678-4364-8e6e-8b74244024a0] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:45:33.401761 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-46df8e86-6e2d-458b-8b91-88bdd42899e4 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:33.402256 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-46df8e86-6e2d-458b-8b91-88bdd42899e4 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:33.402695 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-46df8e86-6e2d-458b-8b91-88bdd42899e4 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:33.403417 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-46df8e86-6e2d-458b-8b91-88bdd42899e4 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:33.403871 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-46df8e86-6e2d-458b-8b91-88bdd42899e4 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:33.404338 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-46df8e86-6e2d-458b-8b91-88bdd42899e4 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:33.438773 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-46df8e86-6e2d-458b-8b91-88bdd42899e4 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] 10.222.0.70 "GET /compute/v2.1/servers/a3280606-1678-4364-8e6e-8b74244024a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056902 Aug 27 03:45:33.439358 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3354/6755] 10.222.0.70 () {58 vars in 1302 bytes} [Sat Aug 27 03:45:33 2022] GET /compute/v2.1/servers/a3280606-1678-4364-8e6e-8b74244024a0/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:45:34.451063 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4b24896c-f889-49e9-ad88-a977211c9f8d tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:45:34.453480 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-4b24896c-f889-49e9-ad88-a977211c9f8d tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] [instance: a3280606-1678-4364-8e6e-8b74244024a0] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:45:34.461093 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4b24896c-f889-49e9-ad88-a977211c9f8d tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:34.461598 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4b24896c-f889-49e9-ad88-a977211c9f8d tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:34.462106 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4b24896c-f889-49e9-ad88-a977211c9f8d tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:34.462829 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4b24896c-f889-49e9-ad88-a977211c9f8d tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:34.463275 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4b24896c-f889-49e9-ad88-a977211c9f8d tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:34.463709 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4b24896c-f889-49e9-ad88-a977211c9f8d tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:34.494676 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-4b24896c-f889-49e9-ad88-a977211c9f8d tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] 10.222.0.70 "GET /compute/v2.1/servers/a3280606-1678-4364-8e6e-8b74244024a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047778 Aug 27 03:45:34.495156 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3402/6756] 10.222.0.70 () {58 vars in 1302 bytes} [Sat Aug 27 03:45:34 2022] GET /compute/v2.1/servers/a3280606-1678-4364-8e6e-8b74244024a0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:45:35.510766 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-423ccf61-a737-40ce-b8b1-b3573da68440 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:45:35.515522 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-423ccf61-a737-40ce-b8b1-b3573da68440 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] [instance: a3280606-1678-4364-8e6e-8b74244024a0] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:45:35.525692 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-423ccf61-a737-40ce-b8b1-b3573da68440 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:35.526351 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-423ccf61-a737-40ce-b8b1-b3573da68440 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:35.526807 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-423ccf61-a737-40ce-b8b1-b3573da68440 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:35.527511 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-423ccf61-a737-40ce-b8b1-b3573da68440 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:35.527965 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-423ccf61-a737-40ce-b8b1-b3573da68440 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:35.528428 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-423ccf61-a737-40ce-b8b1-b3573da68440 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:35.559818 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-423ccf61-a737-40ce-b8b1-b3573da68440 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] 10.222.0.70 "GET /compute/v2.1/servers/a3280606-1678-4364-8e6e-8b74244024a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056500 Aug 27 03:45:35.560404 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3355/6757] 10.222.0.70 () {58 vars in 1302 bytes} [Sat Aug 27 03:45:35 2022] GET /compute/v2.1/servers/a3280606-1678-4364-8e6e-8b74244024a0/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:45:36.575097 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4b070ebc-4c3a-4fe6-8de0-e4aff7aa8e67 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:45:36.577804 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-4b070ebc-4c3a-4fe6-8de0-e4aff7aa8e67 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] [instance: a3280606-1678-4364-8e6e-8b74244024a0] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:45:36.587000 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4b070ebc-4c3a-4fe6-8de0-e4aff7aa8e67 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:36.587633 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4b070ebc-4c3a-4fe6-8de0-e4aff7aa8e67 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:36.588205 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4b070ebc-4c3a-4fe6-8de0-e4aff7aa8e67 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:36.589173 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4b070ebc-4c3a-4fe6-8de0-e4aff7aa8e67 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:36.589765 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4b070ebc-4c3a-4fe6-8de0-e4aff7aa8e67 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:36.590317 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4b070ebc-4c3a-4fe6-8de0-e4aff7aa8e67 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:36.623450 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-4b070ebc-4c3a-4fe6-8de0-e4aff7aa8e67 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] 10.222.0.70 "GET /compute/v2.1/servers/a3280606-1678-4364-8e6e-8b74244024a0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054476 Aug 27 03:45:36.624010 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3403/6758] 10.222.0.70 () {58 vars in 1302 bytes} [Sat Aug 27 03:45:36 2022] GET /compute/v2.1/servers/a3280606-1678-4364-8e6e-8b74244024a0/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:45:36.635086 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4dd0471b-8398-4a36-8211-d33874107718 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:45:36.635641 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-4dd0471b-8398-4a36-8211-d33874107718 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] [instance: a3280606-1678-4364-8e6e-8b74244024a0] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:45:36.643470 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4dd0471b-8398-4a36-8211-d33874107718 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:36.643956 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4dd0471b-8398-4a36-8211-d33874107718 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:36.644422 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4dd0471b-8398-4a36-8211-d33874107718 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:36.645111 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4dd0471b-8398-4a36-8211-d33874107718 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:36.645559 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4dd0471b-8398-4a36-8211-d33874107718 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:36.645983 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4dd0471b-8398-4a36-8211-d33874107718 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:36.729995 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-4dd0471b-8398-4a36-8211-d33874107718 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] HTTP exception thrown: Instance a3280606-1678-4364-8e6e-8b74244024a0 is not attached to volume 3c2b7598-94fe-4017-bc50-a54c592306d6 Aug 27 03:45:36.739432 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4dd0471b-8398-4a36-8211-d33874107718 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Request method failure captured: Aug 27 03:45:36.739432 n-d-852278-4 devstack@n-api.service[134052]: request: DELETE /compute/v2.1/servers/a3280606-1678-4364-8e6e-8b74244024a0/os-volume_attachments/3c2b7598-94fe-4017-bc50-a54c592306d6 HTTP/1.1 Aug 27 03:45:36.739432 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 03:45:36.739432 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 03:45:36.739432 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 03:45:36.739432 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 03:45:36.739432 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 03:45:36.739432 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 03:45:36.739432 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 03:45:36.739432 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 03:45:36.739432 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCZM-hx4n_tYWH1kjNds2EDscB9RPLxeL8xFGu8EmwlFPoLVm-YIv4_Wmi5qlBwiQolUKUcPtJm5YPtV1vA47f8r2snsI_cGHbUhdk3dY2p48Z06dkgHraIG40iwIATxhQd78ldrSw5MxPm_YvCQmrrcxG5LAKC3CKVHh_HtajSavrHI Aug 27 03:45:36.739432 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 03:45:36.739432 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 03:45:36.739432 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 03:45:36.739432 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 03:45:36.739432 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 03:45:36.739432 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 03:45:36.739432 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: cfd51c7913c94094bf412fc0ac22e291 Aug 27 03:45:36.739432 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1266117518 Aug 27 03:45:36.739432 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 03:45:36.739432 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 03:45:36.739432 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cfd51c7913c94094bf412fc0ac22e291"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_cfd51c7913c94094bf412fc0ac22e291", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cfd51c7913c94094bf412fc0ac22e291"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/cfd51c7913c94094bf412fc0ac22e291"}]}] Aug 27 03:45:36.739432 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-TestEncryptedCinderVolumes-1266117518 Aug 27 03:45:36.739432 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: cfd51c7913c94094bf412fc0ac22e291 Aug 27 03:45:36.739432 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1266117518 Aug 27 03:45:36.739432 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-TestEncryptedCinderVolumes-1266117518-project Aug 27 03:45:36.739432 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 03:45:36.739432 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 03:45:36.739432 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: e81627d91d3240a1aec4176d6d8279f5 Aug 27 03:45:36.739432 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-TestEncryptedCinderVolumes-1266117518-project Aug 27 03:45:36.739432 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 03:45:36.739432 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance a3280606-1678-4364-8e6e-8b74244024a0 is not attached to volume 3c2b7598-94fe-4017-bc50-a54c592306d6 Aug 27 03:45:36.739432 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'server_id': 'a3280606-1678-4364-8e6e-8b74244024a0', 'id': '3c2b7598-94fe-4017-bc50-a54c592306d6'} Aug 27 03:45:36.739432 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:45:36.739432 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:45:36.739432 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 27 03:45:36.739432 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 27 03:45:36.739432 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 03:45:36.739432 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 03:45:36.739432 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 27 03:45:36.739432 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 27 03:45:36.739432 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 3c2b7598-94fe-4017-bc50-a54c592306d6. Aug 27 03:45:36.739432 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:45:36.739432 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:45:36.739432 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:45:36.739432 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:45:36.739432 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:45:36.739432 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:45:36.739432 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:45:36.739432 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:45:36.739432 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:45:36.739432 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:45:36.739432 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 27 03:45:36.739432 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 27 03:45:36.739432 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3280606-1678-4364-8e6e-8b74244024a0 is not attached to volume 3c2b7598-94fe-4017-bc50-a54c592306d6 Aug 27 03:45:36.739432 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:45:36.739432 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:45:36.739432 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:45:36.739432 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:45:36.739432 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:45:36.739432 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:45:36.743696 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:45:36.743696 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:45:36.743696 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3280606-1678-4364-8e6e-8b74244024a0 is not attached to volume 3c2b7598-94fe-4017-bc50-a54c592306d6 Aug 27 03:45:36.743696 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:45:36.743696 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4dd0471b-8398-4a36-8211-d33874107718 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Returning 404 to user: Instance a3280606-1678-4364-8e6e-8b74244024a0 is not attached to volume 3c2b7598-94fe-4017-bc50-a54c592306d6 {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:45:36.743696 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-4dd0471b-8398-4a36-8211-d33874107718 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] 10.222.0.70 "DELETE /compute/v2.1/servers/a3280606-1678-4364-8e6e-8b74244024a0/os-volume_attachments/3c2b7598-94fe-4017-bc50-a54c592306d6" status: 404 len: 154 microversion: 2.1 time: 0.110060 Aug 27 03:45:36.743696 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3356/6759] 10.222.0.70 () {58 vars in 1416 bytes} [Sat Aug 27 03:45:36 2022] DELETE /compute/v2.1/servers/a3280606-1678-4364-8e6e-8b74244024a0/os-volume_attachments/3c2b7598-94fe-4017-bc50-a54c592306d6 => generated 154 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:45:40.112070 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f10fee80-b853-459b-a444-827636453230 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:45:40.112656 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-f10fee80-b853-459b-a444-827636453230 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] [instance: a3280606-1678-4364-8e6e-8b74244024a0] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:45:40.119310 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f10fee80-b853-459b-a444-827636453230 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:40.119808 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f10fee80-b853-459b-a444-827636453230 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:40.120290 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f10fee80-b853-459b-a444-827636453230 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:40.121053 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f10fee80-b853-459b-a444-827636453230 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:40.121525 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f10fee80-b853-459b-a444-827636453230 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:40.121952 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f10fee80-b853-459b-a444-827636453230 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:40.149529 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-f10fee80-b853-459b-a444-827636453230 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] [instance: a3280606-1678-4364-8e6e-8b74244024a0] Going to try to terminate instance {{(pid=134051) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:45:40.242089 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-f10fee80-b853-459b-a444-827636453230 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] 10.222.0.70 "DELETE /compute/v2.1/servers/a3280606-1678-4364-8e6e-8b74244024a0" status: 204 len: 0 microversion: 2.1 time: 0.133760 Aug 27 03:45:40.246606 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3404/6760] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 03:45:40 2022] DELETE /compute/v2.1/servers/a3280606-1678-4364-8e6e-8b74244024a0 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:45:40.251614 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-99a49eff-d623-4448-bec3-d609db4f23ba tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:45:40.253021 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-99a49eff-d623-4448-bec3-d609db4f23ba tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] [instance: a3280606-1678-4364-8e6e-8b74244024a0] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:45:40.261487 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-99a49eff-d623-4448-bec3-d609db4f23ba tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:40.261970 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-99a49eff-d623-4448-bec3-d609db4f23ba tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:40.262400 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-99a49eff-d623-4448-bec3-d609db4f23ba tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:40.263277 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-99a49eff-d623-4448-bec3-d609db4f23ba tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:40.263729 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-99a49eff-d623-4448-bec3-d609db4f23ba tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:40.264143 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-99a49eff-d623-4448-bec3-d609db4f23ba tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:40.406248 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-99a49eff-d623-4448-bec3-d609db4f23ba tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81627d91d3240a1aec4176d6d8279f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd51c7913c94094bf412fc0ac22e291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:45:40.414880 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-99a49eff-d623-4448-bec3-d609db4f23ba tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] 10.222.0.70 "GET /compute/v2.1/servers/a3280606-1678-4364-8e6e-8b74244024a0" status: 200 len: 1560 microversion: 2.1 time: 0.167205 Aug 27 03:45:40.415636 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3357/6761] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:45:40 2022] GET /compute/v2.1/servers/a3280606-1678-4364-8e6e-8b74244024a0 => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:45:41.441546 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-bb6ccfd6-1400-4d51-acf0-3d3652bf45e1 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:45:41.442744 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-bb6ccfd6-1400-4d51-acf0-3d3652bf45e1 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] [instance: a3280606-1678-4364-8e6e-8b74244024a0] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:45:41.454640 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bb6ccfd6-1400-4d51-acf0-3d3652bf45e1 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:41.455476 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bb6ccfd6-1400-4d51-acf0-3d3652bf45e1 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:41.456182 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bb6ccfd6-1400-4d51-acf0-3d3652bf45e1 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:41.457450 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bb6ccfd6-1400-4d51-acf0-3d3652bf45e1 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:41.458240 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bb6ccfd6-1400-4d51-acf0-3d3652bf45e1 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:41.458979 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bb6ccfd6-1400-4d51-acf0-3d3652bf45e1 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:41.601787 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-bb6ccfd6-1400-4d51-acf0-3d3652bf45e1 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81627d91d3240a1aec4176d6d8279f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd51c7913c94094bf412fc0ac22e291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:45:41.610089 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-bb6ccfd6-1400-4d51-acf0-3d3652bf45e1 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] 10.222.0.70 "GET /compute/v2.1/servers/a3280606-1678-4364-8e6e-8b74244024a0" status: 200 len: 1560 microversion: 2.1 time: 0.175936 Aug 27 03:45:41.610755 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3405/6762] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:45:41 2022] GET /compute/v2.1/servers/a3280606-1678-4364-8e6e-8b74244024a0 => generated 1560 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:45:42.419906 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-c5eee61c-e96f-4316-9df7-6013dcfa4160 req-e7edb4bb-3379-496d-918a-8b951f698585 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3280606-1678-4364-8e6e-8b74244024a0", "name": "network-vif-deleted", "tag": "498097ed-4a93-4e64-a30e-185b935f8c77"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:45:42.431435 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-c5eee61c-e96f-4316-9df7-6013dcfa4160 req-e7edb4bb-3379-496d-918a-8b951f698585 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:42.431937 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-c5eee61c-e96f-4316-9df7-6013dcfa4160 req-e7edb4bb-3379-496d-918a-8b951f698585 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:42.432363 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-c5eee61c-e96f-4316-9df7-6013dcfa4160 req-e7edb4bb-3379-496d-918a-8b951f698585 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:42.444761 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-c5eee61c-e96f-4316-9df7-6013dcfa4160 req-e7edb4bb-3379-496d-918a-8b951f698585 service nova] Creating event network-vif-deleted:498097ed-4a93-4e64-a30e-185b935f8c77 for instance a3280606-1678-4364-8e6e-8b74244024a0 on n-h1-852278-4 Aug 27 03:45:42.450523 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-c5eee61c-e96f-4316-9df7-6013dcfa4160 req-e7edb4bb-3379-496d-918a-8b951f698585 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034387 Aug 27 03:45:42.451230 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3358/6763] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:45:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:45:42.631552 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d9249d8b-ddad-4dde-ad6f-2a9e752f975e tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:45:42.632406 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d9249d8b-ddad-4dde-ad6f-2a9e752f975e tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] [instance: a3280606-1678-4364-8e6e-8b74244024a0] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:45:42.639713 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d9249d8b-ddad-4dde-ad6f-2a9e752f975e tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:42.640230 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d9249d8b-ddad-4dde-ad6f-2a9e752f975e tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:42.640720 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d9249d8b-ddad-4dde-ad6f-2a9e752f975e tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:42.641452 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d9249d8b-ddad-4dde-ad6f-2a9e752f975e tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:42.641895 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d9249d8b-ddad-4dde-ad6f-2a9e752f975e tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:42.642486 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d9249d8b-ddad-4dde-ad6f-2a9e752f975e tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:42.674847 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d9249d8b-ddad-4dde-ad6f-2a9e752f975e tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:42.675278 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d9249d8b-ddad-4dde-ad6f-2a9e752f975e tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:42.675727 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d9249d8b-ddad-4dde-ad6f-2a9e752f975e tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:42.676193 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.objects.instance [None req-d9249d8b-ddad-4dde-ad6f-2a9e752f975e tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lazy-loading 'fault' on Instance uuid a3280606-1678-4364-8e6e-8b74244024a0 {{(pid=134051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:45:42.720856 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d9249d8b-ddad-4dde-ad6f-2a9e752f975e tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81627d91d3240a1aec4176d6d8279f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd51c7913c94094bf412fc0ac22e291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:45:42.729030 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d9249d8b-ddad-4dde-ad6f-2a9e752f975e tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] 10.222.0.70 "GET /compute/v2.1/servers/a3280606-1678-4364-8e6e-8b74244024a0" status: 200 len: 1352 microversion: 2.1 time: 0.101762 Aug 27 03:45:42.729654 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3406/6764] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:45:42 2022] GET /compute/v2.1/servers/a3280606-1678-4364-8e6e-8b74244024a0 => generated 1352 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:45:43.755541 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-87a2b78c-7986-449e-8b73-7c90d4853aa3 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:45:43.756510 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-87a2b78c-7986-449e-8b73-7c90d4853aa3 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] [instance: a3280606-1678-4364-8e6e-8b74244024a0] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:45:43.766257 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-87a2b78c-7986-449e-8b73-7c90d4853aa3 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:43.766979 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-87a2b78c-7986-449e-8b73-7c90d4853aa3 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:43.767614 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-87a2b78c-7986-449e-8b73-7c90d4853aa3 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:43.768729 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-87a2b78c-7986-449e-8b73-7c90d4853aa3 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:43.769409 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-87a2b78c-7986-449e-8b73-7c90d4853aa3 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:43.770049 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-87a2b78c-7986-449e-8b73-7c90d4853aa3 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:43.791356 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-87a2b78c-7986-449e-8b73-7c90d4853aa3 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] HTTP exception thrown: Instance a3280606-1678-4364-8e6e-8b74244024a0 could not be found. Aug 27 03:45:43.793818 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-87a2b78c-7986-449e-8b73-7c90d4853aa3 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Request method failure captured: Aug 27 03:45:43.793818 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/servers/a3280606-1678-4364-8e6e-8b74244024a0 HTTP/1.1 Aug 27 03:45:43.793818 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 03:45:43.793818 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 03:45:43.793818 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 03:45:43.793818 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 03:45:43.793818 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 03:45:43.793818 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 03:45:43.793818 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 03:45:43.793818 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 03:45:43.793818 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCZM-hx4n_tYWH1kjNds2EDscB9RPLxeL8xFGu8EmwlFPoLVm-YIv4_Wmi5qlBwiQolUKUcPtJm5YPtV1vA47f8r2snsI_cGHbUhdk3dY2p48Z06dkgHraIG40iwIATxhQd78ldrSw5MxPm_YvCQmrrcxG5LAKC3CKVHh_HtajSavrHI Aug 27 03:45:43.793818 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 03:45:43.793818 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 03:45:43.793818 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 03:45:43.793818 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 03:45:43.793818 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 03:45:43.793818 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 03:45:43.793818 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: cfd51c7913c94094bf412fc0ac22e291 Aug 27 03:45:43.793818 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1266117518 Aug 27 03:45:43.793818 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 03:45:43.793818 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 03:45:43.793818 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cfd51c7913c94094bf412fc0ac22e291"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_cfd51c7913c94094bf412fc0ac22e291", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cfd51c7913c94094bf412fc0ac22e291"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/cfd51c7913c94094bf412fc0ac22e291"}]}] Aug 27 03:45:43.793818 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-TestEncryptedCinderVolumes-1266117518 Aug 27 03:45:43.793818 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: cfd51c7913c94094bf412fc0ac22e291 Aug 27 03:45:43.793818 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1266117518 Aug 27 03:45:43.793818 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-TestEncryptedCinderVolumes-1266117518-project Aug 27 03:45:43.793818 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 03:45:43.793818 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 03:45:43.793818 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: e81627d91d3240a1aec4176d6d8279f5 Aug 27 03:45:43.793818 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-TestEncryptedCinderVolumes-1266117518-project Aug 27 03:45:43.793818 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 03:45:43.793818 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance a3280606-1678-4364-8e6e-8b74244024a0 could not be found. Aug 27 03:45:43.793818 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': 'a3280606-1678-4364-8e6e-8b74244024a0'} Aug 27 03:45:43.793818 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:45:43.793818 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:45:43.793818 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:45:43.793818 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:45:43.793818 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:45:43.793818 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:45:43.793818 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:45:43.793818 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:45:43.793818 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:45:43.793818 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:45:43.793818 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3280606-1678-4364-8e6e-8b74244024a0 could not be found. Aug 27 03:45:43.793818 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:45:43.793818 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:45:43.793818 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:45:43.793818 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:45:43.793818 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:45:43.793818 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:45:43.793818 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:45:43.793818 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:45:43.793818 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:45:43.793818 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:45:43.793818 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:45:43.793818 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:45:43.793818 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:45:43.793818 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:45:43.793818 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:45:43.793818 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:45:43.793818 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3280606-1678-4364-8e6e-8b74244024a0 could not be found. Aug 27 03:45:43.793818 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:45:43.793818 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:45:43.798417 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:45:43.798417 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:45:43.798417 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:45:43.798417 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:45:43.798417 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:45:43.798417 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:45:43.798417 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3280606-1678-4364-8e6e-8b74244024a0 could not be found. Aug 27 03:45:43.798417 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:45:43.798417 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-87a2b78c-7986-449e-8b73-7c90d4853aa3 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Returning 404 to user: Instance a3280606-1678-4364-8e6e-8b74244024a0 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:45:43.798417 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-87a2b78c-7986-449e-8b73-7c90d4853aa3 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] 10.222.0.70 "GET /compute/v2.1/servers/a3280606-1678-4364-8e6e-8b74244024a0" status: 404 len: 111 microversion: 2.1 time: 0.047688 Aug 27 03:45:43.798417 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3359/6765] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:45:43 2022] GET /compute/v2.1/servers/a3280606-1678-4364-8e6e-8b74244024a0 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:45:43.804786 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f1e51cb1-37c9-4ff7-ab49-d989fbd28731 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Calling method '.version_select at 0x7f5edc152ca0>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:45:43.832462 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-f1e51cb1-37c9-4ff7-ab49-d989fbd28731 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1094701189" status: 202 len: 0 microversion: 2.1 time: 0.031489 Aug 27 03:45:43.833058 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3407/6766] 10.222.0.70 () {58 vars in 1278 bytes} [Sat Aug 27 03:45:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1094701189 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:45:43.852157 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-806efd66-5035-4c2e-9ca1-52496b2ff533 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Action: 'create', calling method: .version_select at 0x7f5ee71d7160>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1855845759", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEji+bvZkPk06/mh/gWo1cpS3R/9BYPrDo6ZK9P95jhW78JPsk28oL2pjVMERCxaclTZW63uTgbi2mpN33AUrAKBVo4cvgt6GyH4jvrrfceYITTlsSbA003seOaf/qVR9g=="}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:45:43.869033 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-806efd66-5035-4c2e-9ca1-52496b2ff533 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Getting quotas for project cfd51c7913c94094bf412fc0ac22e291. Resources: {'key_pairs'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:45:43.875402 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-806efd66-5035-4c2e-9ca1-52496b2ff533 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Getting quotas for user e81627d91d3240a1aec4176d6d8279f5 and project cfd51c7913c94094bf412fc0ac22e291. Resources: {'key_pairs'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:45:43.903655 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-806efd66-5035-4c2e-9ca1-52496b2ff533 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.055553 Aug 27 03:45:43.904269 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3360/6767] 10.222.0.70 () {60 vars in 1159 bytes} [Sat Aug 27 03:45:43 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:45:43.956353 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-208f181a-d751-4295-a794-62d3cdeca043 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-89833883", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1855845759", "networks": [{"uuid": "aee88d26-e03b-45c2-9472-a64c967023af"}]}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:45:44.015288 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.network.neutron [None req-208f181a-d751-4295-a794-62d3cdeca043 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] validate_networks() for [('aee88d26-e03b-45c2-9472-a64c967023af', None, None, None, None, None)] {{(pid=134051) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:45:44.396966 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-208f181a-d751-4295-a794-62d3cdeca043 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Flavor limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:45:44.397424 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-208f181a-d751-4295-a794-62d3cdeca043 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Image limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:45:44.397893 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-208f181a-d751-4295-a794-62d3cdeca043 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Flavor pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:45:44.398306 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-208f181a-d751-4295-a794-62d3cdeca043 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Image pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:45:44.398725 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-208f181a-d751-4295-a794-62d3cdeca043 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:45:44.407980 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-208f181a-d751-4295-a794-62d3cdeca043 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:44.408502 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-208f181a-d751-4295-a794-62d3cdeca043 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:44.408944 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-208f181a-d751-4295-a794-62d3cdeca043 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:44.409701 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-208f181a-d751-4295-a794-62d3cdeca043 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:44.410151 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-208f181a-d751-4295-a794-62d3cdeca043 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:44.410579 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-208f181a-d751-4295-a794-62d3cdeca043 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:44.427935 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-208f181a-d751-4295-a794-62d3cdeca043 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Getting quotas for project cfd51c7913c94094bf412fc0ac22e291. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:45:44.433240 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-208f181a-d751-4295-a794-62d3cdeca043 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Getting quotas for user e81627d91d3240a1aec4176d6d8279f5 and project cfd51c7913c94094bf412fc0ac22e291. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:45:44.445829 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-208f181a-d751-4295-a794-62d3cdeca043 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Going to run 1 instances... {{(pid=134051) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:45:44.448162 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-208f181a-d751-4295-a794-62d3cdeca043 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] [instance: 53d340fe-fd4a-4326-9721-010d0b4751a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134051) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:45:44.498061 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-208f181a-d751-4295-a794-62d3cdeca043 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.545541 Aug 27 03:45:44.498731 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3408/6768] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 03:45:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 547 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:45:44.509713 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-1ce6f5ef-9cf7-4a3d-a479-b86c9677fe2f tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:45:44.510336 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-1ce6f5ef-9cf7-4a3d-a479-b86c9677fe2f tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] [instance: 53d340fe-fd4a-4326-9721-010d0b4751a3] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:45:44.571388 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-1ce6f5ef-9cf7-4a3d-a479-b86c9677fe2f tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81627d91d3240a1aec4176d6d8279f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd51c7913c94094bf412fc0ac22e291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:45:44.578570 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-1ce6f5ef-9cf7-4a3d-a479-b86c9677fe2f tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] 10.222.0.70 "GET /compute/v2.1/servers/53d340fe-fd4a-4326-9721-010d0b4751a3" status: 200 len: 1261 microversion: 2.1 time: 0.072964 Aug 27 03:45:44.579153 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3361/6769] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:45:44 2022] GET /compute/v2.1/servers/53d340fe-fd4a-4326-9721-010d0b4751a3 => generated 1261 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:45:45.599930 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-9a0f5a14-ed48-4ac8-868c-a85980ad0519 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:45:45.600769 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-9a0f5a14-ed48-4ac8-868c-a85980ad0519 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] [instance: 53d340fe-fd4a-4326-9721-010d0b4751a3] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:45:45.608899 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9a0f5a14-ed48-4ac8-868c-a85980ad0519 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:45.609415 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9a0f5a14-ed48-4ac8-868c-a85980ad0519 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:45.609865 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9a0f5a14-ed48-4ac8-868c-a85980ad0519 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:45.610585 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9a0f5a14-ed48-4ac8-868c-a85980ad0519 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:45.611050 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9a0f5a14-ed48-4ac8-868c-a85980ad0519 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:45.611473 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9a0f5a14-ed48-4ac8-868c-a85980ad0519 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:45.689154 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-9a0f5a14-ed48-4ac8-868c-a85980ad0519 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81627d91d3240a1aec4176d6d8279f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd51c7913c94094bf412fc0ac22e291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:45:45.699517 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-9a0f5a14-ed48-4ac8-868c-a85980ad0519 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] 10.222.0.70 "GET /compute/v2.1/servers/53d340fe-fd4a-4326-9721-010d0b4751a3" status: 200 len: 1313 microversion: 2.1 time: 0.104062 Aug 27 03:45:45.700489 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3409/6770] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:45:45 2022] GET /compute/v2.1/servers/53d340fe-fd4a-4326-9721-010d0b4751a3 => generated 1313 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:45:46.720732 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a705455b-6105-4fb3-a462-8023d33828f1 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:45:46.721330 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a705455b-6105-4fb3-a462-8023d33828f1 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] [instance: 53d340fe-fd4a-4326-9721-010d0b4751a3] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:45:46.728994 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a705455b-6105-4fb3-a462-8023d33828f1 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:46.729466 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a705455b-6105-4fb3-a462-8023d33828f1 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:46.730042 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a705455b-6105-4fb3-a462-8023d33828f1 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:46.730783 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a705455b-6105-4fb3-a462-8023d33828f1 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:46.731237 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a705455b-6105-4fb3-a462-8023d33828f1 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:46.731669 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a705455b-6105-4fb3-a462-8023d33828f1 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:46.957546 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-a705455b-6105-4fb3-a462-8023d33828f1 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81627d91d3240a1aec4176d6d8279f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd51c7913c94094bf412fc0ac22e291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:45:46.965696 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a705455b-6105-4fb3-a462-8023d33828f1 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] 10.222.0.70 "GET /compute/v2.1/servers/53d340fe-fd4a-4326-9721-010d0b4751a3" status: 200 len: 1361 microversion: 2.1 time: 0.249181 Aug 27 03:45:46.966288 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3362/6771] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:45:46 2022] GET /compute/v2.1/servers/53d340fe-fd4a-4326-9721-010d0b4751a3 => generated 1361 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:45:47.060209 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-da26d3bb-7697-45c7-af72-5da41fd550ac req-0bb1a863-6619-45c8-b50e-3f7bc0fb4a4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53d340fe-fd4a-4326-9721-010d0b4751a3", "tag": "1e6c23b2-9770-4a47-9a39-06a7ad51a261"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:45:47.071660 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-da26d3bb-7697-45c7-af72-5da41fd550ac req-0bb1a863-6619-45c8-b50e-3f7bc0fb4a4a service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:47.072171 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-da26d3bb-7697-45c7-af72-5da41fd550ac req-0bb1a863-6619-45c8-b50e-3f7bc0fb4a4a service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:47.072664 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-da26d3bb-7697-45c7-af72-5da41fd550ac req-0bb1a863-6619-45c8-b50e-3f7bc0fb4a4a service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:47.084694 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-da26d3bb-7697-45c7-af72-5da41fd550ac req-0bb1a863-6619-45c8-b50e-3f7bc0fb4a4a service nova] Creating event network-changed:1e6c23b2-9770-4a47-9a39-06a7ad51a261 for instance 53d340fe-fd4a-4326-9721-010d0b4751a3 on n-h2-852278-4 Aug 27 03:45:47.089786 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-da26d3bb-7697-45c7-af72-5da41fd550ac req-0bb1a863-6619-45c8-b50e-3f7bc0fb4a4a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033314 Aug 27 03:45:47.090472 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3410/6772] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:45:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:45:47.991534 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-37e1bfc3-5b8b-4e13-bbab-a39d3f93ec39 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:45:47.992681 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-37e1bfc3-5b8b-4e13-bbab-a39d3f93ec39 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] [instance: 53d340fe-fd4a-4326-9721-010d0b4751a3] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:45:48.001443 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-37e1bfc3-5b8b-4e13-bbab-a39d3f93ec39 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:48.001855 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-37e1bfc3-5b8b-4e13-bbab-a39d3f93ec39 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:48.002286 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-37e1bfc3-5b8b-4e13-bbab-a39d3f93ec39 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:48.003047 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-37e1bfc3-5b8b-4e13-bbab-a39d3f93ec39 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:48.003497 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-37e1bfc3-5b8b-4e13-bbab-a39d3f93ec39 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:48.003909 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-37e1bfc3-5b8b-4e13-bbab-a39d3f93ec39 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:48.165217 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-37e1bfc3-5b8b-4e13-bbab-a39d3f93ec39 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81627d91d3240a1aec4176d6d8279f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd51c7913c94094bf412fc0ac22e291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:45:48.173650 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-37e1bfc3-5b8b-4e13-bbab-a39d3f93ec39 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] 10.222.0.70 "GET /compute/v2.1/servers/53d340fe-fd4a-4326-9721-010d0b4751a3" status: 200 len: 1361 microversion: 2.1 time: 0.188777 Aug 27 03:45:48.174410 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3363/6773] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:45:47 2022] GET /compute/v2.1/servers/53d340fe-fd4a-4326-9721-010d0b4751a3 => generated 1361 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:45:49.197098 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-abed7744-ce0f-4fe3-8b81-55644f5b21ad tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:45:49.197673 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-abed7744-ce0f-4fe3-8b81-55644f5b21ad tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] [instance: 53d340fe-fd4a-4326-9721-010d0b4751a3] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:45:49.204975 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-abed7744-ce0f-4fe3-8b81-55644f5b21ad tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:49.205469 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-abed7744-ce0f-4fe3-8b81-55644f5b21ad tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:49.205924 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-abed7744-ce0f-4fe3-8b81-55644f5b21ad tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:49.206629 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-abed7744-ce0f-4fe3-8b81-55644f5b21ad tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:49.207090 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-abed7744-ce0f-4fe3-8b81-55644f5b21ad tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:49.207528 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-abed7744-ce0f-4fe3-8b81-55644f5b21ad tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:49.360089 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-abed7744-ce0f-4fe3-8b81-55644f5b21ad tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81627d91d3240a1aec4176d6d8279f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd51c7913c94094bf412fc0ac22e291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:45:49.372352 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-abed7744-ce0f-4fe3-8b81-55644f5b21ad tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] 10.222.0.70 "GET /compute/v2.1/servers/53d340fe-fd4a-4326-9721-010d0b4751a3" status: 200 len: 1361 microversion: 2.1 time: 0.180396 Aug 27 03:45:49.373345 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3411/6774] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:45:49 2022] GET /compute/v2.1/servers/53d340fe-fd4a-4326-9721-010d0b4751a3 => generated 1361 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:45:50.393468 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b33d11a4-4433-4da3-9eb7-9fab8e03529d tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:45:50.394109 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b33d11a4-4433-4da3-9eb7-9fab8e03529d tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] [instance: 53d340fe-fd4a-4326-9721-010d0b4751a3] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:45:50.401608 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b33d11a4-4433-4da3-9eb7-9fab8e03529d tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:50.402126 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b33d11a4-4433-4da3-9eb7-9fab8e03529d tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:50.402586 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b33d11a4-4433-4da3-9eb7-9fab8e03529d tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:50.403402 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b33d11a4-4433-4da3-9eb7-9fab8e03529d tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:50.403852 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b33d11a4-4433-4da3-9eb7-9fab8e03529d tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:50.404277 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b33d11a4-4433-4da3-9eb7-9fab8e03529d tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:50.541224 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b33d11a4-4433-4da3-9eb7-9fab8e03529d tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81627d91d3240a1aec4176d6d8279f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd51c7913c94094bf412fc0ac22e291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:45:50.550592 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b33d11a4-4433-4da3-9eb7-9fab8e03529d tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] 10.222.0.70 "GET /compute/v2.1/servers/53d340fe-fd4a-4326-9721-010d0b4751a3" status: 200 len: 1361 microversion: 2.1 time: 0.161246 Aug 27 03:45:50.551277 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3364/6775] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:45:50 2022] GET /compute/v2.1/servers/53d340fe-fd4a-4326-9721-010d0b4751a3 => generated 1361 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:45:51.575463 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-baf939f2-a159-4ad4-a2f6-ce3ed508282b tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:45:51.576066 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-baf939f2-a159-4ad4-a2f6-ce3ed508282b tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] [instance: 53d340fe-fd4a-4326-9721-010d0b4751a3] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:45:51.583857 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-baf939f2-a159-4ad4-a2f6-ce3ed508282b tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:51.584413 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-baf939f2-a159-4ad4-a2f6-ce3ed508282b tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:51.584882 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-baf939f2-a159-4ad4-a2f6-ce3ed508282b tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:51.585696 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-baf939f2-a159-4ad4-a2f6-ce3ed508282b tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:51.586168 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-baf939f2-a159-4ad4-a2f6-ce3ed508282b tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:51.586613 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-baf939f2-a159-4ad4-a2f6-ce3ed508282b tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:51.727647 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-baf939f2-a159-4ad4-a2f6-ce3ed508282b tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81627d91d3240a1aec4176d6d8279f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd51c7913c94094bf412fc0ac22e291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:45:51.739600 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-baf939f2-a159-4ad4-a2f6-ce3ed508282b tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] 10.222.0.70 "GET /compute/v2.1/servers/53d340fe-fd4a-4326-9721-010d0b4751a3" status: 200 len: 1361 microversion: 2.1 time: 0.170568 Aug 27 03:45:51.740430 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3412/6776] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:45:51 2022] GET /compute/v2.1/servers/53d340fe-fd4a-4326-9721-010d0b4751a3 => generated 1361 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:45:52.573461 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-e5aceee9-f998-45a6-8ecb-0ec551549888 req-c3bc2ab6-7614-45cd-9c3a-0e61cb2245bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53d340fe-fd4a-4326-9721-010d0b4751a3", "name": "network-vif-plugged", "status": "completed", "tag": "1e6c23b2-9770-4a47-9a39-06a7ad51a261"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:45:52.584177 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-e5aceee9-f998-45a6-8ecb-0ec551549888 req-c3bc2ab6-7614-45cd-9c3a-0e61cb2245bb service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:52.584693 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-e5aceee9-f998-45a6-8ecb-0ec551549888 req-c3bc2ab6-7614-45cd-9c3a-0e61cb2245bb service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:52.585119 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-e5aceee9-f998-45a6-8ecb-0ec551549888 req-c3bc2ab6-7614-45cd-9c3a-0e61cb2245bb service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:52.596521 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-e5aceee9-f998-45a6-8ecb-0ec551549888 req-c3bc2ab6-7614-45cd-9c3a-0e61cb2245bb service nova] Creating event network-vif-plugged:1e6c23b2-9770-4a47-9a39-06a7ad51a261 for instance 53d340fe-fd4a-4326-9721-010d0b4751a3 on n-h2-852278-4 Aug 27 03:45:52.601508 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-e5aceee9-f998-45a6-8ecb-0ec551549888 req-c3bc2ab6-7614-45cd-9c3a-0e61cb2245bb service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031857 Aug 27 03:45:52.602287 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3365/6777] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:45:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:45:52.763522 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-6a04fb4c-4f3d-411c-a1c3-4a0475fd56d1 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:45:52.764411 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-6a04fb4c-4f3d-411c-a1c3-4a0475fd56d1 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] [instance: 53d340fe-fd4a-4326-9721-010d0b4751a3] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:45:52.771561 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6a04fb4c-4f3d-411c-a1c3-4a0475fd56d1 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:52.772065 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6a04fb4c-4f3d-411c-a1c3-4a0475fd56d1 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:52.772571 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6a04fb4c-4f3d-411c-a1c3-4a0475fd56d1 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:52.773290 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6a04fb4c-4f3d-411c-a1c3-4a0475fd56d1 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:52.773761 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6a04fb4c-4f3d-411c-a1c3-4a0475fd56d1 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:52.774200 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6a04fb4c-4f3d-411c-a1c3-4a0475fd56d1 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:52.912704 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-6a04fb4c-4f3d-411c-a1c3-4a0475fd56d1 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81627d91d3240a1aec4176d6d8279f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd51c7913c94094bf412fc0ac22e291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:45:52.922317 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-6a04fb4c-4f3d-411c-a1c3-4a0475fd56d1 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] 10.222.0.70 "GET /compute/v2.1/servers/53d340fe-fd4a-4326-9721-010d0b4751a3" status: 200 len: 1361 microversion: 2.1 time: 0.162724 Aug 27 03:45:52.922921 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3413/6778] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:45:52 2022] GET /compute/v2.1/servers/53d340fe-fd4a-4326-9721-010d0b4751a3 => generated 1361 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:45:53.944904 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a8c9844c-4792-4ab5-ad2d-d91202c2f605 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:45:53.945495 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a8c9844c-4792-4ab5-ad2d-d91202c2f605 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] [instance: 53d340fe-fd4a-4326-9721-010d0b4751a3] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:45:53.952196 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a8c9844c-4792-4ab5-ad2d-d91202c2f605 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:53.952720 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a8c9844c-4792-4ab5-ad2d-d91202c2f605 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:53.953151 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a8c9844c-4792-4ab5-ad2d-d91202c2f605 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:53.953833 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a8c9844c-4792-4ab5-ad2d-d91202c2f605 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:53.954276 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a8c9844c-4792-4ab5-ad2d-d91202c2f605 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:53.954693 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a8c9844c-4792-4ab5-ad2d-d91202c2f605 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:54.102212 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-a8c9844c-4792-4ab5-ad2d-d91202c2f605 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81627d91d3240a1aec4176d6d8279f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd51c7913c94094bf412fc0ac22e291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:45:54.110415 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a8c9844c-4792-4ab5-ad2d-d91202c2f605 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] 10.222.0.70 "GET /compute/v2.1/servers/53d340fe-fd4a-4326-9721-010d0b4751a3" status: 200 len: 1553 microversion: 2.1 time: 0.170874 Aug 27 03:45:54.111044 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3366/6779] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:45:53 2022] GET /compute/v2.1/servers/53d340fe-fd4a-4326-9721-010d0b4751a3 => generated 1553 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:45:54.131841 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c1493697-69f8-421f-aa8d-2a1c7baa1f5f tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:45:54.132529 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-c1493697-69f8-421f-aa8d-2a1c7baa1f5f tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] [instance: 53d340fe-fd4a-4326-9721-010d0b4751a3] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:45:54.140694 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c1493697-69f8-421f-aa8d-2a1c7baa1f5f tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:54.141206 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c1493697-69f8-421f-aa8d-2a1c7baa1f5f tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:54.141661 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c1493697-69f8-421f-aa8d-2a1c7baa1f5f tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:54.142391 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c1493697-69f8-421f-aa8d-2a1c7baa1f5f tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:54.142862 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c1493697-69f8-421f-aa8d-2a1c7baa1f5f tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:54.143307 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c1493697-69f8-421f-aa8d-2a1c7baa1f5f tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:54.284046 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-c1493697-69f8-421f-aa8d-2a1c7baa1f5f tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81627d91d3240a1aec4176d6d8279f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd51c7913c94094bf412fc0ac22e291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:45:54.295597 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c1493697-69f8-421f-aa8d-2a1c7baa1f5f tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] 10.222.0.70 "GET /compute/v2.1/servers/53d340fe-fd4a-4326-9721-010d0b4751a3" status: 200 len: 1553 microversion: 2.1 time: 0.167656 Aug 27 03:45:54.296796 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3414/6780] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:45:54 2022] GET /compute/v2.1/servers/53d340fe-fd4a-4326-9721-010d0b4751a3 => generated 1553 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:45:55.819867 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-2aef5581-8fc1-4378-9e6c-d728c0b66c6e tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "93eb54b8-0606-4996-91af-01c703288f90"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:45:55.822318 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-2aef5581-8fc1-4378-9e6c-d728c0b66c6e tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] [instance: 53d340fe-fd4a-4326-9721-010d0b4751a3] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:45:55.824451 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=6 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:45:55.831119 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2aef5581-8fc1-4378-9e6c-d728c0b66c6e tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:55.831606 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2aef5581-8fc1-4378-9e6c-d728c0b66c6e tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:55.832045 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2aef5581-8fc1-4378-9e6c-d728c0b66c6e tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:55.832785 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2aef5581-8fc1-4378-9e6c-d728c0b66c6e tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:55.833239 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2aef5581-8fc1-4378-9e6c-d728c0b66c6e tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:55.833663 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2aef5581-8fc1-4378-9e6c-d728c0b66c6e tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:56.097023 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-2aef5581-8fc1-4378-9e6c-d728c0b66c6e tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] 10.222.0.70 "POST /compute/v2.1/servers/53d340fe-fd4a-4326-9721-010d0b4751a3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.281209 Aug 27 03:45:56.097574 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3367/6781] 10.222.0.70 () {60 vars in 1323 bytes} [Sat Aug 27 03:45:55 2022] POST /compute/v2.1/servers/53d340fe-fd4a-4326-9721-010d0b4751a3/os-volume_attachments => generated 194 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:46:06.881166 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d5ad8e0e-cfc4-4b6c-96d5-2b1df8604d02 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:06.881677 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d5ad8e0e-cfc4-4b6c-96d5-2b1df8604d02 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] [instance: 53d340fe-fd4a-4326-9721-010d0b4751a3] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:06.883797 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:46:06.884531 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=6 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:46:06.885980 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:46:06.886721 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:46:06.893730 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d5ad8e0e-cfc4-4b6c-96d5-2b1df8604d02 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:06.894230 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d5ad8e0e-cfc4-4b6c-96d5-2b1df8604d02 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:06.894688 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d5ad8e0e-cfc4-4b6c-96d5-2b1df8604d02 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:06.895409 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d5ad8e0e-cfc4-4b6c-96d5-2b1df8604d02 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:06.895867 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d5ad8e0e-cfc4-4b6c-96d5-2b1df8604d02 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:06.896305 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d5ad8e0e-cfc4-4b6c-96d5-2b1df8604d02 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:06.982455 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.objects.instance [None req-d5ad8e0e-cfc4-4b6c-96d5-2b1df8604d02 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lazy-loading 'services' on Instance uuid 53d340fe-fd4a-4326-9721-010d0b4751a3 {{(pid=134051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:46:07.060892 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d5ad8e0e-cfc4-4b6c-96d5-2b1df8604d02 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] 10.222.0.70 "DELETE /compute/v2.1/servers/53d340fe-fd4a-4326-9721-010d0b4751a3/os-volume_attachments/93eb54b8-0606-4996-91af-01c703288f90" status: 202 len: 0 microversion: 2.1 time: 0.183719 Aug 27 03:46:07.061500 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3415/6782] 10.222.0.70 () {58 vars in 1416 bytes} [Sat Aug 27 03:46:06 2022] DELETE /compute/v2.1/servers/53d340fe-fd4a-4326-9721-010d0b4751a3/os-volume_attachments/93eb54b8-0606-4996-91af-01c703288f90 => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:46:07.068935 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:46:07.069814 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:46:07.075013 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-384b4978-0d60-42d6-b756-a4439c672af4 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:07.078070 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-384b4978-0d60-42d6-b756-a4439c672af4 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] [instance: 53d340fe-fd4a-4326-9721-010d0b4751a3] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:07.090186 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-384b4978-0d60-42d6-b756-a4439c672af4 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:07.090670 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-384b4978-0d60-42d6-b756-a4439c672af4 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:07.091095 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-384b4978-0d60-42d6-b756-a4439c672af4 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:07.091891 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-384b4978-0d60-42d6-b756-a4439c672af4 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:07.092397 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-384b4978-0d60-42d6-b756-a4439c672af4 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:07.092807 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-384b4978-0d60-42d6-b756-a4439c672af4 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:07.126745 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-384b4978-0d60-42d6-b756-a4439c672af4 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] 10.222.0.70 "GET /compute/v2.1/servers/53d340fe-fd4a-4326-9721-010d0b4751a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060449 Aug 27 03:46:07.131400 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3368/6783] 10.222.0.70 () {58 vars in 1302 bytes} [Sat Aug 27 03:46:07 2022] GET /compute/v2.1/servers/53d340fe-fd4a-4326-9721-010d0b4751a3/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:46:08.141385 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-bcbe8625-a6b3-4603-8518-74336ed47cbd tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:08.143921 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-bcbe8625-a6b3-4603-8518-74336ed47cbd tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] [instance: 53d340fe-fd4a-4326-9721-010d0b4751a3] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:08.151009 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bcbe8625-a6b3-4603-8518-74336ed47cbd tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:08.151513 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bcbe8625-a6b3-4603-8518-74336ed47cbd tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:08.151967 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bcbe8625-a6b3-4603-8518-74336ed47cbd tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:08.152727 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bcbe8625-a6b3-4603-8518-74336ed47cbd tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:08.153195 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bcbe8625-a6b3-4603-8518-74336ed47cbd tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:08.153638 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bcbe8625-a6b3-4603-8518-74336ed47cbd tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:08.186676 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-bcbe8625-a6b3-4603-8518-74336ed47cbd tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] 10.222.0.70 "GET /compute/v2.1/servers/53d340fe-fd4a-4326-9721-010d0b4751a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050888 Aug 27 03:46:08.187268 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3416/6784] 10.222.0.70 () {58 vars in 1302 bytes} [Sat Aug 27 03:46:08 2022] GET /compute/v2.1/servers/53d340fe-fd4a-4326-9721-010d0b4751a3/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:46:09.199327 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-2a130da3-3bb7-4904-8e9e-48a478c82854 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:09.201619 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-2a130da3-3bb7-4904-8e9e-48a478c82854 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] [instance: 53d340fe-fd4a-4326-9721-010d0b4751a3] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:09.209326 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2a130da3-3bb7-4904-8e9e-48a478c82854 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:09.209816 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2a130da3-3bb7-4904-8e9e-48a478c82854 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:09.210253 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2a130da3-3bb7-4904-8e9e-48a478c82854 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:09.210957 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2a130da3-3bb7-4904-8e9e-48a478c82854 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:09.211403 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2a130da3-3bb7-4904-8e9e-48a478c82854 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:09.211823 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2a130da3-3bb7-4904-8e9e-48a478c82854 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:09.245284 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-2a130da3-3bb7-4904-8e9e-48a478c82854 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] 10.222.0.70 "GET /compute/v2.1/servers/53d340fe-fd4a-4326-9721-010d0b4751a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050055 Aug 27 03:46:09.245879 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3369/6785] 10.222.0.70 () {58 vars in 1302 bytes} [Sat Aug 27 03:46:09 2022] GET /compute/v2.1/servers/53d340fe-fd4a-4326-9721-010d0b4751a3/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:46:10.258404 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-dd7bac7f-49f0-4cca-b939-6a6e4d550a98 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:10.260664 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-dd7bac7f-49f0-4cca-b939-6a6e4d550a98 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] [instance: 53d340fe-fd4a-4326-9721-010d0b4751a3] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:10.268157 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dd7bac7f-49f0-4cca-b939-6a6e4d550a98 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:10.268752 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dd7bac7f-49f0-4cca-b939-6a6e4d550a98 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:10.269198 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dd7bac7f-49f0-4cca-b939-6a6e4d550a98 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:10.269909 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dd7bac7f-49f0-4cca-b939-6a6e4d550a98 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:10.270363 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dd7bac7f-49f0-4cca-b939-6a6e4d550a98 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:10.270794 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dd7bac7f-49f0-4cca-b939-6a6e4d550a98 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:10.302759 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-dd7bac7f-49f0-4cca-b939-6a6e4d550a98 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] 10.222.0.70 "GET /compute/v2.1/servers/53d340fe-fd4a-4326-9721-010d0b4751a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048547 Aug 27 03:46:10.303603 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3417/6786] 10.222.0.70 () {58 vars in 1302 bytes} [Sat Aug 27 03:46:10 2022] GET /compute/v2.1/servers/53d340fe-fd4a-4326-9721-010d0b4751a3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:46:11.318057 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e572a00d-85d8-41ee-b465-9873a3cf72b1 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:11.320248 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-e572a00d-85d8-41ee-b465-9873a3cf72b1 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] [instance: 53d340fe-fd4a-4326-9721-010d0b4751a3] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:11.327792 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e572a00d-85d8-41ee-b465-9873a3cf72b1 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:11.328297 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e572a00d-85d8-41ee-b465-9873a3cf72b1 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:11.328793 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e572a00d-85d8-41ee-b465-9873a3cf72b1 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:11.329496 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e572a00d-85d8-41ee-b465-9873a3cf72b1 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:11.330046 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e572a00d-85d8-41ee-b465-9873a3cf72b1 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:11.330461 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e572a00d-85d8-41ee-b465-9873a3cf72b1 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:11.361338 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e572a00d-85d8-41ee-b465-9873a3cf72b1 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] 10.222.0.70 "GET /compute/v2.1/servers/53d340fe-fd4a-4326-9721-010d0b4751a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048425 Aug 27 03:46:11.361933 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3370/6787] 10.222.0.70 () {58 vars in 1302 bytes} [Sat Aug 27 03:46:11 2022] GET /compute/v2.1/servers/53d340fe-fd4a-4326-9721-010d0b4751a3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:46:12.375164 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-da004eab-e648-460a-bb00-d8dc270707d4 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:12.377578 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-da004eab-e648-460a-bb00-d8dc270707d4 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] [instance: 53d340fe-fd4a-4326-9721-010d0b4751a3] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:12.385028 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-da004eab-e648-460a-bb00-d8dc270707d4 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:12.385551 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-da004eab-e648-460a-bb00-d8dc270707d4 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:12.385972 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-da004eab-e648-460a-bb00-d8dc270707d4 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:12.386763 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-da004eab-e648-460a-bb00-d8dc270707d4 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:12.387281 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-da004eab-e648-460a-bb00-d8dc270707d4 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:12.387789 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-da004eab-e648-460a-bb00-d8dc270707d4 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:12.420940 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-da004eab-e648-460a-bb00-d8dc270707d4 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] 10.222.0.70 "GET /compute/v2.1/servers/53d340fe-fd4a-4326-9721-010d0b4751a3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049904 Aug 27 03:46:12.421858 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3418/6788] 10.222.0.70 () {58 vars in 1302 bytes} [Sat Aug 27 03:46:12 2022] GET /compute/v2.1/servers/53d340fe-fd4a-4326-9721-010d0b4751a3/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:46:12.432653 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ec034603-04a7-45b1-9c43-23ca37ec7cf7 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:12.433183 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-ec034603-04a7-45b1-9c43-23ca37ec7cf7 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] [instance: 53d340fe-fd4a-4326-9721-010d0b4751a3] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:12.440664 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ec034603-04a7-45b1-9c43-23ca37ec7cf7 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:12.441137 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ec034603-04a7-45b1-9c43-23ca37ec7cf7 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:12.441568 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ec034603-04a7-45b1-9c43-23ca37ec7cf7 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:12.442264 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ec034603-04a7-45b1-9c43-23ca37ec7cf7 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:12.442704 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ec034603-04a7-45b1-9c43-23ca37ec7cf7 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:12.443117 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ec034603-04a7-45b1-9c43-23ca37ec7cf7 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:12.526848 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-ec034603-04a7-45b1-9c43-23ca37ec7cf7 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] HTTP exception thrown: Instance 53d340fe-fd4a-4326-9721-010d0b4751a3 is not attached to volume 93eb54b8-0606-4996-91af-01c703288f90 Aug 27 03:46:12.528515 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ec034603-04a7-45b1-9c43-23ca37ec7cf7 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Request method failure captured: Aug 27 03:46:12.528515 n-d-852278-4 devstack@n-api.service[134052]: request: DELETE /compute/v2.1/servers/53d340fe-fd4a-4326-9721-010d0b4751a3/os-volume_attachments/93eb54b8-0606-4996-91af-01c703288f90 HTTP/1.1 Aug 27 03:46:12.528515 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 03:46:12.528515 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 03:46:12.528515 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 03:46:12.528515 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 03:46:12.528515 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 03:46:12.528515 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 03:46:12.528515 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 03:46:12.528515 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 03:46:12.528515 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCZM-hx4n_tYWH1kjNds2EDscB9RPLxeL8xFGu8EmwlFPoLVm-YIv4_Wmi5qlBwiQolUKUcPtJm5YPtV1vA47f8r2snsI_cGHbUhdk3dY2p48Z06dkgHraIG40iwIATxhQd78ldrSw5MxPm_YvCQmrrcxG5LAKC3CKVHh_HtajSavrHI Aug 27 03:46:12.528515 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 03:46:12.528515 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 03:46:12.528515 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 03:46:12.528515 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 03:46:12.528515 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 03:46:12.528515 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 03:46:12.528515 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: cfd51c7913c94094bf412fc0ac22e291 Aug 27 03:46:12.528515 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1266117518 Aug 27 03:46:12.528515 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 03:46:12.528515 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 03:46:12.528515 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cfd51c7913c94094bf412fc0ac22e291"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_cfd51c7913c94094bf412fc0ac22e291", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cfd51c7913c94094bf412fc0ac22e291"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/cfd51c7913c94094bf412fc0ac22e291"}]}] Aug 27 03:46:12.528515 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-TestEncryptedCinderVolumes-1266117518 Aug 27 03:46:12.528515 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: cfd51c7913c94094bf412fc0ac22e291 Aug 27 03:46:12.528515 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1266117518 Aug 27 03:46:12.528515 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-TestEncryptedCinderVolumes-1266117518-project Aug 27 03:46:12.528515 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 03:46:12.528515 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 03:46:12.528515 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: e81627d91d3240a1aec4176d6d8279f5 Aug 27 03:46:12.528515 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-TestEncryptedCinderVolumes-1266117518-project Aug 27 03:46:12.528515 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 03:46:12.528515 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance 53d340fe-fd4a-4326-9721-010d0b4751a3 is not attached to volume 93eb54b8-0606-4996-91af-01c703288f90 Aug 27 03:46:12.528515 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'server_id': '53d340fe-fd4a-4326-9721-010d0b4751a3', 'id': '93eb54b8-0606-4996-91af-01c703288f90'} Aug 27 03:46:12.528515 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:46:12.528515 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:46:12.528515 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 27 03:46:12.528515 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 27 03:46:12.528515 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 03:46:12.528515 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 03:46:12.528515 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 27 03:46:12.528515 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 27 03:46:12.528515 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 93eb54b8-0606-4996-91af-01c703288f90. Aug 27 03:46:12.528515 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:46:12.528515 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:46:12.528515 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:46:12.528515 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:46:12.528515 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:46:12.528515 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:46:12.528515 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:46:12.528515 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:46:12.528515 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:46:12.528515 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:46:12.528515 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 27 03:46:12.528515 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 27 03:46:12.528515 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53d340fe-fd4a-4326-9721-010d0b4751a3 is not attached to volume 93eb54b8-0606-4996-91af-01c703288f90 Aug 27 03:46:12.528515 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:46:12.528515 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:46:12.528515 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:46:12.528515 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:46:12.528515 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:46:12.528515 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:46:12.532263 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:46:12.532263 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:46:12.532263 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53d340fe-fd4a-4326-9721-010d0b4751a3 is not attached to volume 93eb54b8-0606-4996-91af-01c703288f90 Aug 27 03:46:12.532263 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:46:12.532263 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ec034603-04a7-45b1-9c43-23ca37ec7cf7 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Returning 404 to user: Instance 53d340fe-fd4a-4326-9721-010d0b4751a3 is not attached to volume 93eb54b8-0606-4996-91af-01c703288f90 {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:46:12.532263 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ec034603-04a7-45b1-9c43-23ca37ec7cf7 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] 10.222.0.70 "DELETE /compute/v2.1/servers/53d340fe-fd4a-4326-9721-010d0b4751a3/os-volume_attachments/93eb54b8-0606-4996-91af-01c703288f90" status: 404 len: 154 microversion: 2.1 time: 0.101459 Aug 27 03:46:12.532263 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3371/6789] 10.222.0.70 () {58 vars in 1416 bytes} [Sat Aug 27 03:46:12 2022] DELETE /compute/v2.1/servers/53d340fe-fd4a-4326-9721-010d0b4751a3/os-volume_attachments/93eb54b8-0606-4996-91af-01c703288f90 => generated 154 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:46:15.883010 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-47e5a11b-c784-49ee-82e7-763895d7e730 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:15.883494 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-47e5a11b-c784-49ee-82e7-763895d7e730 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] [instance: 53d340fe-fd4a-4326-9721-010d0b4751a3] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:15.890477 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-47e5a11b-c784-49ee-82e7-763895d7e730 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:15.890991 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-47e5a11b-c784-49ee-82e7-763895d7e730 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:15.891434 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-47e5a11b-c784-49ee-82e7-763895d7e730 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:15.892202 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-47e5a11b-c784-49ee-82e7-763895d7e730 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:15.892697 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-47e5a11b-c784-49ee-82e7-763895d7e730 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:15.893136 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-47e5a11b-c784-49ee-82e7-763895d7e730 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:15.925672 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-47e5a11b-c784-49ee-82e7-763895d7e730 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] [instance: 53d340fe-fd4a-4326-9721-010d0b4751a3] Going to try to terminate instance {{(pid=134051) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:46:16.011571 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-47e5a11b-c784-49ee-82e7-763895d7e730 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] 10.222.0.70 "DELETE /compute/v2.1/servers/53d340fe-fd4a-4326-9721-010d0b4751a3" status: 204 len: 0 microversion: 2.1 time: 0.132151 Aug 27 03:46:16.012011 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3419/6790] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 03:46:15 2022] DELETE /compute/v2.1/servers/53d340fe-fd4a-4326-9721-010d0b4751a3 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:46:16.020293 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b2b14f14-42b9-412c-9273-3360fcb30bcb tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:16.020925 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b2b14f14-42b9-412c-9273-3360fcb30bcb tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] [instance: 53d340fe-fd4a-4326-9721-010d0b4751a3] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:16.029227 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b2b14f14-42b9-412c-9273-3360fcb30bcb tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:16.029638 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b2b14f14-42b9-412c-9273-3360fcb30bcb tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:16.030061 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b2b14f14-42b9-412c-9273-3360fcb30bcb tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:16.030755 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b2b14f14-42b9-412c-9273-3360fcb30bcb tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:16.031197 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b2b14f14-42b9-412c-9273-3360fcb30bcb tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:16.031610 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b2b14f14-42b9-412c-9273-3360fcb30bcb tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:16.164788 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b2b14f14-42b9-412c-9273-3360fcb30bcb tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81627d91d3240a1aec4176d6d8279f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd51c7913c94094bf412fc0ac22e291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:16.173347 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b2b14f14-42b9-412c-9273-3360fcb30bcb tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] 10.222.0.70 "GET /compute/v2.1/servers/53d340fe-fd4a-4326-9721-010d0b4751a3" status: 200 len: 1559 microversion: 2.1 time: 0.157005 Aug 27 03:46:16.173915 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3372/6791] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:16 2022] GET /compute/v2.1/servers/53d340fe-fd4a-4326-9721-010d0b4751a3 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:46:17.194632 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7556a9ef-0533-4ae1-bb2a-d61a8c4bc9e9 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:17.195226 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-7556a9ef-0533-4ae1-bb2a-d61a8c4bc9e9 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] [instance: 53d340fe-fd4a-4326-9721-010d0b4751a3] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:17.202730 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7556a9ef-0533-4ae1-bb2a-d61a8c4bc9e9 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:17.203225 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7556a9ef-0533-4ae1-bb2a-d61a8c4bc9e9 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:17.203666 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7556a9ef-0533-4ae1-bb2a-d61a8c4bc9e9 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:17.204400 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7556a9ef-0533-4ae1-bb2a-d61a8c4bc9e9 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:17.204907 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7556a9ef-0533-4ae1-bb2a-d61a8c4bc9e9 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:17.205343 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7556a9ef-0533-4ae1-bb2a-d61a8c4bc9e9 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:17.350967 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-7556a9ef-0533-4ae1-bb2a-d61a8c4bc9e9 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81627d91d3240a1aec4176d6d8279f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd51c7913c94094bf412fc0ac22e291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:17.359218 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-7556a9ef-0533-4ae1-bb2a-d61a8c4bc9e9 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] 10.222.0.70 "GET /compute/v2.1/servers/53d340fe-fd4a-4326-9721-010d0b4751a3" status: 200 len: 1559 microversion: 2.1 time: 0.169020 Aug 27 03:46:17.359780 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3420/6792] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:17 2022] GET /compute/v2.1/servers/53d340fe-fd4a-4326-9721-010d0b4751a3 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:46:18.119827 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-a49c1ecc-9368-4046-ae2f-f4c59f31b06f req-de43ff3c-7539-4cc5-8694-1be1c368ec5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53d340fe-fd4a-4326-9721-010d0b4751a3", "name": "network-vif-deleted", "tag": "1e6c23b2-9770-4a47-9a39-06a7ad51a261"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:46:18.131659 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-a49c1ecc-9368-4046-ae2f-f4c59f31b06f req-de43ff3c-7539-4cc5-8694-1be1c368ec5f service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:18.132522 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-a49c1ecc-9368-4046-ae2f-f4c59f31b06f req-de43ff3c-7539-4cc5-8694-1be1c368ec5f service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:18.133159 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-a49c1ecc-9368-4046-ae2f-f4c59f31b06f req-de43ff3c-7539-4cc5-8694-1be1c368ec5f service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:18.146704 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-a49c1ecc-9368-4046-ae2f-f4c59f31b06f req-de43ff3c-7539-4cc5-8694-1be1c368ec5f service nova] Creating event network-vif-deleted:1e6c23b2-9770-4a47-9a39-06a7ad51a261 for instance 53d340fe-fd4a-4326-9721-010d0b4751a3 on n-h2-852278-4 Aug 27 03:46:18.153190 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-a49c1ecc-9368-4046-ae2f-f4c59f31b06f req-de43ff3c-7539-4cc5-8694-1be1c368ec5f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037716 Aug 27 03:46:18.157908 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3373/6793] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:46:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:46:18.381553 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-1bf2f790-96ff-4825-9f3f-6f819517e3e0 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:18.382142 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-1bf2f790-96ff-4825-9f3f-6f819517e3e0 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] [instance: 53d340fe-fd4a-4326-9721-010d0b4751a3] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:18.389944 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1bf2f790-96ff-4825-9f3f-6f819517e3e0 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:18.390453 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1bf2f790-96ff-4825-9f3f-6f819517e3e0 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:18.390935 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1bf2f790-96ff-4825-9f3f-6f819517e3e0 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:18.391654 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1bf2f790-96ff-4825-9f3f-6f819517e3e0 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:18.392121 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1bf2f790-96ff-4825-9f3f-6f819517e3e0 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:18.392582 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1bf2f790-96ff-4825-9f3f-6f819517e3e0 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:18.425750 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1bf2f790-96ff-4825-9f3f-6f819517e3e0 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:18.426245 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1bf2f790-96ff-4825-9f3f-6f819517e3e0 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:18.426695 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1bf2f790-96ff-4825-9f3f-6f819517e3e0 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:18.427163 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.objects.instance [None req-1bf2f790-96ff-4825-9f3f-6f819517e3e0 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lazy-loading 'fault' on Instance uuid 53d340fe-fd4a-4326-9721-010d0b4751a3 {{(pid=134051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:46:18.481047 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-1bf2f790-96ff-4825-9f3f-6f819517e3e0 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81627d91d3240a1aec4176d6d8279f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd51c7913c94094bf412fc0ac22e291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:18.493304 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-1bf2f790-96ff-4825-9f3f-6f819517e3e0 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] 10.222.0.70 "GET /compute/v2.1/servers/53d340fe-fd4a-4326-9721-010d0b4751a3" status: 200 len: 1351 microversion: 2.1 time: 0.115470 Aug 27 03:46:18.494033 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3421/6794] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:18 2022] GET /compute/v2.1/servers/53d340fe-fd4a-4326-9721-010d0b4751a3 => generated 1351 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:46:19.529221 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c18e9518-b0d7-44ef-8c0c-0fd5e77e5782 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:19.530351 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-c18e9518-b0d7-44ef-8c0c-0fd5e77e5782 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] [instance: 53d340fe-fd4a-4326-9721-010d0b4751a3] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:19.541024 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c18e9518-b0d7-44ef-8c0c-0fd5e77e5782 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:19.541812 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c18e9518-b0d7-44ef-8c0c-0fd5e77e5782 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:19.542533 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c18e9518-b0d7-44ef-8c0c-0fd5e77e5782 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:19.543672 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c18e9518-b0d7-44ef-8c0c-0fd5e77e5782 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:19.544462 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c18e9518-b0d7-44ef-8c0c-0fd5e77e5782 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:19.545168 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c18e9518-b0d7-44ef-8c0c-0fd5e77e5782 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:19.560515 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-c18e9518-b0d7-44ef-8c0c-0fd5e77e5782 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] HTTP exception thrown: Instance 53d340fe-fd4a-4326-9721-010d0b4751a3 could not be found. Aug 27 03:46:19.562144 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c18e9518-b0d7-44ef-8c0c-0fd5e77e5782 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Request method failure captured: Aug 27 03:46:19.562144 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/servers/53d340fe-fd4a-4326-9721-010d0b4751a3 HTTP/1.1 Aug 27 03:46:19.562144 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 03:46:19.562144 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 03:46:19.562144 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 03:46:19.562144 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 03:46:19.562144 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 03:46:19.562144 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 03:46:19.562144 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 03:46:19.562144 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 03:46:19.562144 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCZM-hx4n_tYWH1kjNds2EDscB9RPLxeL8xFGu8EmwlFPoLVm-YIv4_Wmi5qlBwiQolUKUcPtJm5YPtV1vA47f8r2snsI_cGHbUhdk3dY2p48Z06dkgHraIG40iwIATxhQd78ldrSw5MxPm_YvCQmrrcxG5LAKC3CKVHh_HtajSavrHI Aug 27 03:46:19.562144 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 03:46:19.562144 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 03:46:19.562144 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 03:46:19.562144 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 03:46:19.562144 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 03:46:19.562144 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 03:46:19.562144 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: cfd51c7913c94094bf412fc0ac22e291 Aug 27 03:46:19.562144 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1266117518 Aug 27 03:46:19.562144 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 03:46:19.562144 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 03:46:19.562144 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cfd51c7913c94094bf412fc0ac22e291"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_cfd51c7913c94094bf412fc0ac22e291", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cfd51c7913c94094bf412fc0ac22e291"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/cfd51c7913c94094bf412fc0ac22e291"}]}] Aug 27 03:46:19.562144 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-TestEncryptedCinderVolumes-1266117518 Aug 27 03:46:19.562144 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: cfd51c7913c94094bf412fc0ac22e291 Aug 27 03:46:19.562144 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1266117518 Aug 27 03:46:19.562144 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-TestEncryptedCinderVolumes-1266117518-project Aug 27 03:46:19.562144 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 03:46:19.562144 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 03:46:19.562144 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: e81627d91d3240a1aec4176d6d8279f5 Aug 27 03:46:19.562144 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-TestEncryptedCinderVolumes-1266117518-project Aug 27 03:46:19.562144 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 03:46:19.562144 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance 53d340fe-fd4a-4326-9721-010d0b4751a3 could not be found. Aug 27 03:46:19.562144 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '53d340fe-fd4a-4326-9721-010d0b4751a3'} Aug 27 03:46:19.562144 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:46:19.562144 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:46:19.562144 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:46:19.562144 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:46:19.562144 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:46:19.562144 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:46:19.562144 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:46:19.562144 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:46:19.562144 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:46:19.562144 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:46:19.562144 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53d340fe-fd4a-4326-9721-010d0b4751a3 could not be found. Aug 27 03:46:19.562144 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:46:19.562144 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:46:19.562144 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:46:19.562144 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:46:19.562144 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:46:19.562144 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:46:19.562144 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:46:19.562144 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:46:19.562144 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:46:19.562144 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:46:19.562144 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:46:19.562144 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:46:19.562144 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:46:19.562144 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:46:19.562144 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:46:19.562144 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:46:19.562144 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53d340fe-fd4a-4326-9721-010d0b4751a3 could not be found. Aug 27 03:46:19.562144 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:46:19.562144 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:46:19.566062 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:46:19.566062 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:46:19.566062 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:46:19.566062 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:46:19.566062 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:46:19.566062 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:46:19.566062 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53d340fe-fd4a-4326-9721-010d0b4751a3 could not be found. Aug 27 03:46:19.566062 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:46:19.566062 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c18e9518-b0d7-44ef-8c0c-0fd5e77e5782 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Returning 404 to user: Instance 53d340fe-fd4a-4326-9721-010d0b4751a3 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:46:19.566062 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c18e9518-b0d7-44ef-8c0c-0fd5e77e5782 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] 10.222.0.70 "GET /compute/v2.1/servers/53d340fe-fd4a-4326-9721-010d0b4751a3" status: 404 len: 111 microversion: 2.1 time: 0.043065 Aug 27 03:46:19.566062 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3374/6795] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:19 2022] GET /compute/v2.1/servers/53d340fe-fd4a-4326-9721-010d0b4751a3 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:46:19.572561 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-11246497-d07e-4d48-9d44-b76746f535b5 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Calling method '.version_select at 0x7f5ededfcf70>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:19.598088 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-11246497-d07e-4d48-9d44-b76746f535b5 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1855845759" status: 202 len: 0 microversion: 2.1 time: 0.029480 Aug 27 03:46:19.598678 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3422/6796] 10.222.0.70 () {58 vars in 1278 bytes} [Sat Aug 27 03:46:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1855845759 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:46:19.616038 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d9142384-e3e3-4fde-b681-35d08c26b76a tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Action: 'create', calling method: .version_select at 0x7f5ee1d30f70>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-289397334", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBArQT2tzL3yDl5H5ajy3OBFV/HFcWU26l9My1ttwR3pEK8kMXRVxo0zTpa/Tt0MtTWq0d5oWs5cCKLzxX9NRtpir3GERQVaMqAHgdWe1ueAfGYszczzO5WtjIF4OLQR25A=="}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:46:19.632003 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-d9142384-e3e3-4fde-b681-35d08c26b76a tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Getting quotas for project cfd51c7913c94094bf412fc0ac22e291. Resources: {'key_pairs'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:46:19.638236 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-d9142384-e3e3-4fde-b681-35d08c26b76a tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Getting quotas for user e81627d91d3240a1aec4176d6d8279f5 and project cfd51c7913c94094bf412fc0ac22e291. Resources: {'key_pairs'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:46:19.664965 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d9142384-e3e3-4fde-b681-35d08c26b76a tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.053063 Aug 27 03:46:19.665583 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3375/6797] 10.222.0.70 () {60 vars in 1159 bytes} [Sat Aug 27 03:46:19 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:46:19.715432 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-785c19a3-79a2-4ed7-b965-8c6f832e8d32 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1314049872", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-289397334", "networks": [{"uuid": "aee88d26-e03b-45c2-9472-a64c967023af"}]}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:46:19.769151 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.network.neutron [None req-785c19a3-79a2-4ed7-b965-8c6f832e8d32 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] validate_networks() for [('aee88d26-e03b-45c2-9472-a64c967023af', None, None, None, None, None)] {{(pid=134051) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:46:20.156469 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-785c19a3-79a2-4ed7-b965-8c6f832e8d32 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Flavor limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:46:20.156964 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-785c19a3-79a2-4ed7-b965-8c6f832e8d32 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Image limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:46:20.157558 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-785c19a3-79a2-4ed7-b965-8c6f832e8d32 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Flavor pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:46:20.157982 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-785c19a3-79a2-4ed7-b965-8c6f832e8d32 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Image pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:46:20.158402 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-785c19a3-79a2-4ed7-b965-8c6f832e8d32 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:46:20.167611 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-785c19a3-79a2-4ed7-b965-8c6f832e8d32 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:20.168102 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-785c19a3-79a2-4ed7-b965-8c6f832e8d32 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:20.168593 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-785c19a3-79a2-4ed7-b965-8c6f832e8d32 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:20.169328 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-785c19a3-79a2-4ed7-b965-8c6f832e8d32 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:20.169786 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-785c19a3-79a2-4ed7-b965-8c6f832e8d32 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:20.170217 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-785c19a3-79a2-4ed7-b965-8c6f832e8d32 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:20.188723 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-785c19a3-79a2-4ed7-b965-8c6f832e8d32 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Getting quotas for project cfd51c7913c94094bf412fc0ac22e291. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:46:20.194660 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-785c19a3-79a2-4ed7-b965-8c6f832e8d32 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Getting quotas for user e81627d91d3240a1aec4176d6d8279f5 and project cfd51c7913c94094bf412fc0ac22e291. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:46:20.208892 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-785c19a3-79a2-4ed7-b965-8c6f832e8d32 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Going to run 1 instances... {{(pid=134051) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:46:20.211265 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-785c19a3-79a2-4ed7-b965-8c6f832e8d32 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] [instance: 79ecc35f-86e8-4674-ac17-3e27b73230c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134051) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:46:20.263092 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-785c19a3-79a2-4ed7-b965-8c6f832e8d32 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.551694 Aug 27 03:46:20.263811 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3423/6798] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 03:46:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 553 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:46:20.274875 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-226854f8-7f06-4f7e-90f7-313563e0f8a3 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:20.275526 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-226854f8-7f06-4f7e-90f7-313563e0f8a3 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] [instance: 79ecc35f-86e8-4674-ac17-3e27b73230c4] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:20.331584 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-226854f8-7f06-4f7e-90f7-313563e0f8a3 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81627d91d3240a1aec4176d6d8279f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd51c7913c94094bf412fc0ac22e291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:20.338678 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-226854f8-7f06-4f7e-90f7-313563e0f8a3 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] 10.222.0.70 "GET /compute/v2.1/servers/79ecc35f-86e8-4674-ac17-3e27b73230c4" status: 200 len: 1262 microversion: 2.1 time: 0.067982 Aug 27 03:46:20.339264 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3376/6799] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:20 2022] GET /compute/v2.1/servers/79ecc35f-86e8-4674-ac17-3e27b73230c4 => generated 1262 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:46:21.360214 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-76bae84f-3d19-45e4-8172-b0028f5075f0 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:21.361722 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-76bae84f-3d19-45e4-8172-b0028f5075f0 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] [instance: 79ecc35f-86e8-4674-ac17-3e27b73230c4] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:21.367949 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-76bae84f-3d19-45e4-8172-b0028f5075f0 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:21.368715 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-76bae84f-3d19-45e4-8172-b0028f5075f0 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:21.369344 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-76bae84f-3d19-45e4-8172-b0028f5075f0 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:21.370328 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-76bae84f-3d19-45e4-8172-b0028f5075f0 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:21.370797 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-76bae84f-3d19-45e4-8172-b0028f5075f0 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:21.371234 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-76bae84f-3d19-45e4-8172-b0028f5075f0 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:21.445099 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-76bae84f-3d19-45e4-8172-b0028f5075f0 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81627d91d3240a1aec4176d6d8279f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd51c7913c94094bf412fc0ac22e291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:21.453206 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-76bae84f-3d19-45e4-8172-b0028f5075f0 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] 10.222.0.70 "GET /compute/v2.1/servers/79ecc35f-86e8-4674-ac17-3e27b73230c4" status: 200 len: 1332 microversion: 2.1 time: 0.097917 Aug 27 03:46:21.453785 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3424/6800] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:21 2022] GET /compute/v2.1/servers/79ecc35f-86e8-4674-ac17-3e27b73230c4 => generated 1332 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:46:22.474958 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c2e1173d-dac1-492c-ace0-abe7b7954418 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:22.475623 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-c2e1173d-dac1-492c-ace0-abe7b7954418 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] [instance: 79ecc35f-86e8-4674-ac17-3e27b73230c4] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:22.483735 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c2e1173d-dac1-492c-ace0-abe7b7954418 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:22.484409 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c2e1173d-dac1-492c-ace0-abe7b7954418 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:22.484845 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c2e1173d-dac1-492c-ace0-abe7b7954418 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:22.485548 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c2e1173d-dac1-492c-ace0-abe7b7954418 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:22.486161 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c2e1173d-dac1-492c-ace0-abe7b7954418 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:22.486651 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c2e1173d-dac1-492c-ace0-abe7b7954418 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:22.678770 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-c2e1173d-dac1-492c-ace0-abe7b7954418 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81627d91d3240a1aec4176d6d8279f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd51c7913c94094bf412fc0ac22e291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:22.688124 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c2e1173d-dac1-492c-ace0-abe7b7954418 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] 10.222.0.70 "GET /compute/v2.1/servers/79ecc35f-86e8-4674-ac17-3e27b73230c4" status: 200 len: 1362 microversion: 2.1 time: 0.217817 Aug 27 03:46:22.689040 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3377/6801] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:22 2022] GET /compute/v2.1/servers/79ecc35f-86e8-4674-ac17-3e27b73230c4 => generated 1362 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:46:22.699683 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-c2737ea4-57ca-43cd-8123-670c29030336 req-f5e78143-0c91-4016-890d-259209c1dc47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79ecc35f-86e8-4674-ac17-3e27b73230c4", "tag": "d235024a-2eed-4fb5-8c56-96024da01561"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:46:22.712257 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-c2737ea4-57ca-43cd-8123-670c29030336 req-f5e78143-0c91-4016-890d-259209c1dc47 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:22.712843 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-c2737ea4-57ca-43cd-8123-670c29030336 req-f5e78143-0c91-4016-890d-259209c1dc47 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:22.713298 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-c2737ea4-57ca-43cd-8123-670c29030336 req-f5e78143-0c91-4016-890d-259209c1dc47 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:22.725642 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-c2737ea4-57ca-43cd-8123-670c29030336 req-f5e78143-0c91-4016-890d-259209c1dc47 service nova] Creating event network-changed:d235024a-2eed-4fb5-8c56-96024da01561 for instance 79ecc35f-86e8-4674-ac17-3e27b73230c4 on n-h2-852278-4 Aug 27 03:46:22.730737 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-c2737ea4-57ca-43cd-8123-670c29030336 req-f5e78143-0c91-4016-890d-259209c1dc47 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040228 Aug 27 03:46:22.731500 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3425/6802] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:46:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:46:23.713189 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-bb885c68-b3bd-4232-a932-451bbc67a552 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:23.713813 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-bb885c68-b3bd-4232-a932-451bbc67a552 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] [instance: 79ecc35f-86e8-4674-ac17-3e27b73230c4] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:23.723692 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bb885c68-b3bd-4232-a932-451bbc67a552 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:23.724175 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bb885c68-b3bd-4232-a932-451bbc67a552 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:23.724638 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bb885c68-b3bd-4232-a932-451bbc67a552 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:23.725330 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bb885c68-b3bd-4232-a932-451bbc67a552 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:23.725775 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bb885c68-b3bd-4232-a932-451bbc67a552 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:23.726190 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bb885c68-b3bd-4232-a932-451bbc67a552 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:23.860941 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-bb885c68-b3bd-4232-a932-451bbc67a552 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81627d91d3240a1aec4176d6d8279f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd51c7913c94094bf412fc0ac22e291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:23.868950 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-bb885c68-b3bd-4232-a932-451bbc67a552 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] 10.222.0.70 "GET /compute/v2.1/servers/79ecc35f-86e8-4674-ac17-3e27b73230c4" status: 200 len: 1362 microversion: 2.1 time: 0.161622 Aug 27 03:46:23.869548 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3378/6803] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:23 2022] GET /compute/v2.1/servers/79ecc35f-86e8-4674-ac17-3e27b73230c4 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:46:24.895102 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-db9a13c6-b394-4477-b79b-3b05d432e727 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:24.895798 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-db9a13c6-b394-4477-b79b-3b05d432e727 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] [instance: 79ecc35f-86e8-4674-ac17-3e27b73230c4] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:24.902646 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-db9a13c6-b394-4477-b79b-3b05d432e727 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:24.903154 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-db9a13c6-b394-4477-b79b-3b05d432e727 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:24.903611 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-db9a13c6-b394-4477-b79b-3b05d432e727 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:24.904299 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-db9a13c6-b394-4477-b79b-3b05d432e727 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:24.904825 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-db9a13c6-b394-4477-b79b-3b05d432e727 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:24.905289 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-db9a13c6-b394-4477-b79b-3b05d432e727 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:25.057626 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-db9a13c6-b394-4477-b79b-3b05d432e727 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81627d91d3240a1aec4176d6d8279f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd51c7913c94094bf412fc0ac22e291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:25.066191 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-db9a13c6-b394-4477-b79b-3b05d432e727 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] 10.222.0.70 "GET /compute/v2.1/servers/79ecc35f-86e8-4674-ac17-3e27b73230c4" status: 200 len: 1362 microversion: 2.1 time: 0.179140 Aug 27 03:46:25.066775 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3426/6804] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:24 2022] GET /compute/v2.1/servers/79ecc35f-86e8-4674-ac17-3e27b73230c4 => generated 1362 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:46:26.089555 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-79a77e4d-eadc-40fe-8b47-f942e6c0c581 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:26.090317 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-79a77e4d-eadc-40fe-8b47-f942e6c0c581 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] [instance: 79ecc35f-86e8-4674-ac17-3e27b73230c4] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:26.100097 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-79a77e4d-eadc-40fe-8b47-f942e6c0c581 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:26.100805 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-79a77e4d-eadc-40fe-8b47-f942e6c0c581 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:26.101390 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-79a77e4d-eadc-40fe-8b47-f942e6c0c581 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:26.102341 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-79a77e4d-eadc-40fe-8b47-f942e6c0c581 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:26.102960 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-79a77e4d-eadc-40fe-8b47-f942e6c0c581 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:26.103545 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-79a77e4d-eadc-40fe-8b47-f942e6c0c581 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:26.242756 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-79a77e4d-eadc-40fe-8b47-f942e6c0c581 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81627d91d3240a1aec4176d6d8279f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd51c7913c94094bf412fc0ac22e291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:26.252600 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-79a77e4d-eadc-40fe-8b47-f942e6c0c581 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] 10.222.0.70 "GET /compute/v2.1/servers/79ecc35f-86e8-4674-ac17-3e27b73230c4" status: 200 len: 1362 microversion: 2.1 time: 0.168725 Aug 27 03:46:26.253150 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3379/6805] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:26 2022] GET /compute/v2.1/servers/79ecc35f-86e8-4674-ac17-3e27b73230c4 => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:46:27.277519 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-281f59c6-40dd-4691-bfae-06b6e1192203 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:27.278343 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-281f59c6-40dd-4691-bfae-06b6e1192203 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] [instance: 79ecc35f-86e8-4674-ac17-3e27b73230c4] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:27.288248 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-281f59c6-40dd-4691-bfae-06b6e1192203 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:27.288774 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-281f59c6-40dd-4691-bfae-06b6e1192203 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:27.289225 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-281f59c6-40dd-4691-bfae-06b6e1192203 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:27.289927 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-281f59c6-40dd-4691-bfae-06b6e1192203 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:27.290389 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-281f59c6-40dd-4691-bfae-06b6e1192203 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:27.290819 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-281f59c6-40dd-4691-bfae-06b6e1192203 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:27.430392 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-281f59c6-40dd-4691-bfae-06b6e1192203 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81627d91d3240a1aec4176d6d8279f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd51c7913c94094bf412fc0ac22e291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:27.446792 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-281f59c6-40dd-4691-bfae-06b6e1192203 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] 10.222.0.70 "GET /compute/v2.1/servers/79ecc35f-86e8-4674-ac17-3e27b73230c4" status: 200 len: 1362 microversion: 2.1 time: 0.175785 Aug 27 03:46:27.447414 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3427/6806] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:27 2022] GET /compute/v2.1/servers/79ecc35f-86e8-4674-ac17-3e27b73230c4 => generated 1362 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:46:28.471555 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-34f9903b-240b-41e4-b64d-ade470977be4 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:28.472442 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-34f9903b-240b-41e4-b64d-ade470977be4 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] [instance: 79ecc35f-86e8-4674-ac17-3e27b73230c4] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:28.484031 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-34f9903b-240b-41e4-b64d-ade470977be4 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:28.484879 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-34f9903b-240b-41e4-b64d-ade470977be4 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:28.485590 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-34f9903b-240b-41e4-b64d-ade470977be4 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:28.486723 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-34f9903b-240b-41e4-b64d-ade470977be4 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:28.487472 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-34f9903b-240b-41e4-b64d-ade470977be4 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:28.488076 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-34f9903b-240b-41e4-b64d-ade470977be4 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:28.641127 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-34f9903b-240b-41e4-b64d-ade470977be4 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81627d91d3240a1aec4176d6d8279f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd51c7913c94094bf412fc0ac22e291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:28.649308 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-34f9903b-240b-41e4-b64d-ade470977be4 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] 10.222.0.70 "GET /compute/v2.1/servers/79ecc35f-86e8-4674-ac17-3e27b73230c4" status: 200 len: 1362 microversion: 2.1 time: 0.184423 Aug 27 03:46:28.649895 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3380/6807] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:28 2022] GET /compute/v2.1/servers/79ecc35f-86e8-4674-ac17-3e27b73230c4 => generated 1362 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:46:28.783109 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-63c4f5c0-3c87-463d-8038-144186558232 req-d2944c68-8f25-4cce-bce2-49306a53b714 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79ecc35f-86e8-4674-ac17-3e27b73230c4", "name": "network-vif-plugged", "status": "completed", "tag": "d235024a-2eed-4fb5-8c56-96024da01561"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:46:28.794093 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-63c4f5c0-3c87-463d-8038-144186558232 req-d2944c68-8f25-4cce-bce2-49306a53b714 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:28.794578 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-63c4f5c0-3c87-463d-8038-144186558232 req-d2944c68-8f25-4cce-bce2-49306a53b714 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:28.795020 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-63c4f5c0-3c87-463d-8038-144186558232 req-d2944c68-8f25-4cce-bce2-49306a53b714 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:28.806751 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-63c4f5c0-3c87-463d-8038-144186558232 req-d2944c68-8f25-4cce-bce2-49306a53b714 service nova] Creating event network-vif-plugged:d235024a-2eed-4fb5-8c56-96024da01561 for instance 79ecc35f-86e8-4674-ac17-3e27b73230c4 on n-h2-852278-4 Aug 27 03:46:28.812096 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-63c4f5c0-3c87-463d-8038-144186558232 req-d2944c68-8f25-4cce-bce2-49306a53b714 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032870 Aug 27 03:46:28.812705 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3428/6808] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:46:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:46:29.674326 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-64ac9c60-d310-4a8d-abeb-f3c12595048a tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:29.675401 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-64ac9c60-d310-4a8d-abeb-f3c12595048a tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] [instance: 79ecc35f-86e8-4674-ac17-3e27b73230c4] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:29.687038 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-64ac9c60-d310-4a8d-abeb-f3c12595048a tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:29.687847 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-64ac9c60-d310-4a8d-abeb-f3c12595048a tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:29.688620 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-64ac9c60-d310-4a8d-abeb-f3c12595048a tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:29.689754 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-64ac9c60-d310-4a8d-abeb-f3c12595048a tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:29.690490 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-64ac9c60-d310-4a8d-abeb-f3c12595048a tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:29.691156 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-64ac9c60-d310-4a8d-abeb-f3c12595048a tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:29.849015 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-64ac9c60-d310-4a8d-abeb-f3c12595048a tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81627d91d3240a1aec4176d6d8279f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd51c7913c94094bf412fc0ac22e291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:29.858567 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-64ac9c60-d310-4a8d-abeb-f3c12595048a tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] 10.222.0.70 "GET /compute/v2.1/servers/79ecc35f-86e8-4674-ac17-3e27b73230c4" status: 200 len: 1362 microversion: 2.1 time: 0.191179 Aug 27 03:46:29.859146 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3381/6809] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:29 2022] GET /compute/v2.1/servers/79ecc35f-86e8-4674-ac17-3e27b73230c4 => generated 1362 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:46:30.881157 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:46:30.882209 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=6 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:46:30.889841 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-901574bd-8156-488d-97aa-3df1d24b7095 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:30.890969 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-901574bd-8156-488d-97aa-3df1d24b7095 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] [instance: 79ecc35f-86e8-4674-ac17-3e27b73230c4] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:30.899202 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-901574bd-8156-488d-97aa-3df1d24b7095 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:30.899709 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-901574bd-8156-488d-97aa-3df1d24b7095 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:30.900162 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-901574bd-8156-488d-97aa-3df1d24b7095 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:30.900906 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-901574bd-8156-488d-97aa-3df1d24b7095 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:30.901376 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-901574bd-8156-488d-97aa-3df1d24b7095 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:30.901816 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-901574bd-8156-488d-97aa-3df1d24b7095 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:31.038464 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-901574bd-8156-488d-97aa-3df1d24b7095 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81627d91d3240a1aec4176d6d8279f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd51c7913c94094bf412fc0ac22e291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:31.046860 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-901574bd-8156-488d-97aa-3df1d24b7095 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] 10.222.0.70 "GET /compute/v2.1/servers/79ecc35f-86e8-4674-ac17-3e27b73230c4" status: 200 len: 1554 microversion: 2.1 time: 0.168505 Aug 27 03:46:31.047510 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3429/6810] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:30 2022] GET /compute/v2.1/servers/79ecc35f-86e8-4674-ac17-3e27b73230c4 => generated 1554 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:46:31.067167 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4be57c58-514f-4d9c-9753-a091a6985ce6 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:31.067864 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-4be57c58-514f-4d9c-9753-a091a6985ce6 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] [instance: 79ecc35f-86e8-4674-ac17-3e27b73230c4] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:31.069907 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=6 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:46:31.078595 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4be57c58-514f-4d9c-9753-a091a6985ce6 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:31.079393 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4be57c58-514f-4d9c-9753-a091a6985ce6 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:31.079993 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4be57c58-514f-4d9c-9753-a091a6985ce6 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:31.081130 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4be57c58-514f-4d9c-9753-a091a6985ce6 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:31.081779 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4be57c58-514f-4d9c-9753-a091a6985ce6 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:31.082350 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4be57c58-514f-4d9c-9753-a091a6985ce6 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:31.231758 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-4be57c58-514f-4d9c-9753-a091a6985ce6 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81627d91d3240a1aec4176d6d8279f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd51c7913c94094bf412fc0ac22e291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:31.240108 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-4be57c58-514f-4d9c-9753-a091a6985ce6 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] 10.222.0.70 "GET /compute/v2.1/servers/79ecc35f-86e8-4674-ac17-3e27b73230c4" status: 200 len: 1554 microversion: 2.1 time: 0.177022 Aug 27 03:46:31.240737 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3382/6811] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:31 2022] GET /compute/v2.1/servers/79ecc35f-86e8-4674-ac17-3e27b73230c4 => generated 1554 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:46:32.786617 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-de03353d-28d5-436d-b777-998d63cb871e tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "33f4dd6a-d015-4427-9469-7e783a280d2b"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:46:32.789096 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-de03353d-28d5-436d-b777-998d63cb871e tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] [instance: 79ecc35f-86e8-4674-ac17-3e27b73230c4] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:32.796844 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-de03353d-28d5-436d-b777-998d63cb871e tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:32.797359 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-de03353d-28d5-436d-b777-998d63cb871e tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:32.797804 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-de03353d-28d5-436d-b777-998d63cb871e tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:32.798608 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-de03353d-28d5-436d-b777-998d63cb871e tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:32.799066 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-de03353d-28d5-436d-b777-998d63cb871e tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:32.799533 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-de03353d-28d5-436d-b777-998d63cb871e tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:33.047789 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:46:33.069037 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-de03353d-28d5-436d-b777-998d63cb871e tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] 10.222.0.70 "POST /compute/v2.1/servers/79ecc35f-86e8-4674-ac17-3e27b73230c4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.286508 Aug 27 03:46:33.069834 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3430/6812] 10.222.0.70 () {60 vars in 1323 bytes} [Sat Aug 27 03:46:32 2022] POST /compute/v2.1/servers/79ecc35f-86e8-4674-ac17-3e27b73230c4/os-volume_attachments => generated 194 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:46:43.807171 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5444f8e4-f528-4497-a912-273e7672f701 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:43.807739 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-5444f8e4-f528-4497-a912-273e7672f701 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] [instance: 79ecc35f-86e8-4674-ac17-3e27b73230c4] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:43.809942 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:46:43.810640 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=70 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:46:43.816372 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5444f8e4-f528-4497-a912-273e7672f701 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:43.816861 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5444f8e4-f528-4497-a912-273e7672f701 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:43.817288 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5444f8e4-f528-4497-a912-273e7672f701 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:43.817978 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5444f8e4-f528-4497-a912-273e7672f701 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:43.818417 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5444f8e4-f528-4497-a912-273e7672f701 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:43.818834 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5444f8e4-f528-4497-a912-273e7672f701 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:43.909965 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.instance [None req-5444f8e4-f528-4497-a912-273e7672f701 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lazy-loading 'services' on Instance uuid 79ecc35f-86e8-4674-ac17-3e27b73230c4 {{(pid=134052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:46:43.991559 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-5444f8e4-f528-4497-a912-273e7672f701 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] 10.222.0.70 "DELETE /compute/v2.1/servers/79ecc35f-86e8-4674-ac17-3e27b73230c4/os-volume_attachments/33f4dd6a-d015-4427-9469-7e783a280d2b" status: 202 len: 0 microversion: 2.1 time: 0.188510 Aug 27 03:46:43.992205 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3383/6813] 10.222.0.70 () {58 vars in 1416 bytes} [Sat Aug 27 03:46:43 2022] DELETE /compute/v2.1/servers/79ecc35f-86e8-4674-ac17-3e27b73230c4/os-volume_attachments/33f4dd6a-d015-4427-9469-7e783a280d2b => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:46:44.003131 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-31ab455e-f58c-48a1-9eb8-bb2983ea2615 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:44.005673 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-31ab455e-f58c-48a1-9eb8-bb2983ea2615 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] [instance: 79ecc35f-86e8-4674-ac17-3e27b73230c4] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:44.008770 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:46:44.009574 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=1,nova_cell1:INSERT=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:46:44.015422 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-31ab455e-f58c-48a1-9eb8-bb2983ea2615 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:44.015918 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-31ab455e-f58c-48a1-9eb8-bb2983ea2615 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:44.016402 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-31ab455e-f58c-48a1-9eb8-bb2983ea2615 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:44.017145 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-31ab455e-f58c-48a1-9eb8-bb2983ea2615 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:44.017598 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-31ab455e-f58c-48a1-9eb8-bb2983ea2615 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:44.018062 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-31ab455e-f58c-48a1-9eb8-bb2983ea2615 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:44.054489 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-31ab455e-f58c-48a1-9eb8-bb2983ea2615 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] 10.222.0.70 "GET /compute/v2.1/servers/79ecc35f-86e8-4674-ac17-3e27b73230c4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055705 Aug 27 03:46:44.055102 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3431/6814] 10.222.0.70 () {58 vars in 1302 bytes} [Sat Aug 27 03:46:43 2022] GET /compute/v2.1/servers/79ecc35f-86e8-4674-ac17-3e27b73230c4/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:46:45.069186 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-70bcf721-8979-4546-af8b-3e3831aeadd3 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:45.071629 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-70bcf721-8979-4546-af8b-3e3831aeadd3 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] [instance: 79ecc35f-86e8-4674-ac17-3e27b73230c4] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:45.078529 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-70bcf721-8979-4546-af8b-3e3831aeadd3 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:45.079025 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-70bcf721-8979-4546-af8b-3e3831aeadd3 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:45.079436 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-70bcf721-8979-4546-af8b-3e3831aeadd3 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:45.080145 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-70bcf721-8979-4546-af8b-3e3831aeadd3 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:45.080631 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-70bcf721-8979-4546-af8b-3e3831aeadd3 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:45.081219 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-70bcf721-8979-4546-af8b-3e3831aeadd3 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:45.115588 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-70bcf721-8979-4546-af8b-3e3831aeadd3 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] 10.222.0.70 "GET /compute/v2.1/servers/79ecc35f-86e8-4674-ac17-3e27b73230c4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051872 Aug 27 03:46:45.116165 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3384/6815] 10.222.0.70 () {58 vars in 1302 bytes} [Sat Aug 27 03:46:45 2022] GET /compute/v2.1/servers/79ecc35f-86e8-4674-ac17-3e27b73230c4/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:46:46.127571 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-306a5257-fca8-4169-9d1c-48f2d913ab3b tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:46.129907 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-306a5257-fca8-4169-9d1c-48f2d913ab3b tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] [instance: 79ecc35f-86e8-4674-ac17-3e27b73230c4] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:46.137370 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-306a5257-fca8-4169-9d1c-48f2d913ab3b tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:46.137872 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-306a5257-fca8-4169-9d1c-48f2d913ab3b tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:46.138321 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-306a5257-fca8-4169-9d1c-48f2d913ab3b tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:46.139044 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-306a5257-fca8-4169-9d1c-48f2d913ab3b tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:46.139507 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-306a5257-fca8-4169-9d1c-48f2d913ab3b tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:46.139974 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-306a5257-fca8-4169-9d1c-48f2d913ab3b tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:46.170751 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-306a5257-fca8-4169-9d1c-48f2d913ab3b tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] 10.222.0.70 "GET /compute/v2.1/servers/79ecc35f-86e8-4674-ac17-3e27b73230c4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047313 Aug 27 03:46:46.171650 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3432/6816] 10.222.0.70 () {58 vars in 1302 bytes} [Sat Aug 27 03:46:46 2022] GET /compute/v2.1/servers/79ecc35f-86e8-4674-ac17-3e27b73230c4/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:46:47.183170 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d115e87f-5fee-4a33-b62f-f9b62d512936 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:47.185594 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d115e87f-5fee-4a33-b62f-f9b62d512936 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] [instance: 79ecc35f-86e8-4674-ac17-3e27b73230c4] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:47.193524 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d115e87f-5fee-4a33-b62f-f9b62d512936 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:47.194007 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d115e87f-5fee-4a33-b62f-f9b62d512936 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:47.194443 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d115e87f-5fee-4a33-b62f-f9b62d512936 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:47.195147 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d115e87f-5fee-4a33-b62f-f9b62d512936 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:47.195597 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d115e87f-5fee-4a33-b62f-f9b62d512936 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:47.196025 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d115e87f-5fee-4a33-b62f-f9b62d512936 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:47.233029 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d115e87f-5fee-4a33-b62f-f9b62d512936 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] 10.222.0.70 "GET /compute/v2.1/servers/79ecc35f-86e8-4674-ac17-3e27b73230c4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053978 Aug 27 03:46:47.233644 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3385/6817] 10.222.0.70 () {58 vars in 1302 bytes} [Sat Aug 27 03:46:47 2022] GET /compute/v2.1/servers/79ecc35f-86e8-4674-ac17-3e27b73230c4/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:46:48.247320 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-fba10605-4fca-4e1e-84c5-7a6b4ca4b89f tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:48.249599 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-fba10605-4fca-4e1e-84c5-7a6b4ca4b89f tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] [instance: 79ecc35f-86e8-4674-ac17-3e27b73230c4] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:48.260855 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fba10605-4fca-4e1e-84c5-7a6b4ca4b89f tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:48.261350 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fba10605-4fca-4e1e-84c5-7a6b4ca4b89f tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:48.261795 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fba10605-4fca-4e1e-84c5-7a6b4ca4b89f tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:48.262503 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fba10605-4fca-4e1e-84c5-7a6b4ca4b89f tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:48.262961 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fba10605-4fca-4e1e-84c5-7a6b4ca4b89f tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:48.263395 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-fba10605-4fca-4e1e-84c5-7a6b4ca4b89f tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:48.293719 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-fba10605-4fca-4e1e-84c5-7a6b4ca4b89f tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] 10.222.0.70 "GET /compute/v2.1/servers/79ecc35f-86e8-4674-ac17-3e27b73230c4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050551 Aug 27 03:46:48.294296 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3433/6818] 10.222.0.70 () {58 vars in 1302 bytes} [Sat Aug 27 03:46:48 2022] GET /compute/v2.1/servers/79ecc35f-86e8-4674-ac17-3e27b73230c4/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:46:49.310755 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8a40306c-e3b5-4d1d-b42c-9885ac1eb21f tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:49.314164 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-8a40306c-e3b5-4d1d-b42c-9885ac1eb21f tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] [instance: 79ecc35f-86e8-4674-ac17-3e27b73230c4] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:49.327180 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8a40306c-e3b5-4d1d-b42c-9885ac1eb21f tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:49.328030 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8a40306c-e3b5-4d1d-b42c-9885ac1eb21f tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:49.328841 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8a40306c-e3b5-4d1d-b42c-9885ac1eb21f tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:49.329992 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8a40306c-e3b5-4d1d-b42c-9885ac1eb21f tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:49.330797 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8a40306c-e3b5-4d1d-b42c-9885ac1eb21f tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:49.331468 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8a40306c-e3b5-4d1d-b42c-9885ac1eb21f tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:49.361956 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-8a40306c-e3b5-4d1d-b42c-9885ac1eb21f tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] 10.222.0.70 "GET /compute/v2.1/servers/79ecc35f-86e8-4674-ac17-3e27b73230c4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058056 Aug 27 03:46:49.362521 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3386/6819] 10.222.0.70 () {58 vars in 1302 bytes} [Sat Aug 27 03:46:49 2022] GET /compute/v2.1/servers/79ecc35f-86e8-4674-ac17-3e27b73230c4/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:46:49.373856 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-9e59d0f9-c718-4e30-bb81-e7e8a944cd56 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:49.374418 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-9e59d0f9-c718-4e30-bb81-e7e8a944cd56 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] [instance: 79ecc35f-86e8-4674-ac17-3e27b73230c4] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:49.381820 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9e59d0f9-c718-4e30-bb81-e7e8a944cd56 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:49.382329 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9e59d0f9-c718-4e30-bb81-e7e8a944cd56 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:49.382790 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9e59d0f9-c718-4e30-bb81-e7e8a944cd56 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:49.383507 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9e59d0f9-c718-4e30-bb81-e7e8a944cd56 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:49.383982 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9e59d0f9-c718-4e30-bb81-e7e8a944cd56 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:49.384456 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9e59d0f9-c718-4e30-bb81-e7e8a944cd56 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:49.463480 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-9e59d0f9-c718-4e30-bb81-e7e8a944cd56 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] HTTP exception thrown: Instance 79ecc35f-86e8-4674-ac17-3e27b73230c4 is not attached to volume 33f4dd6a-d015-4427-9469-7e783a280d2b Aug 27 03:46:49.465491 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-9e59d0f9-c718-4e30-bb81-e7e8a944cd56 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Request method failure captured: Aug 27 03:46:49.465491 n-d-852278-4 devstack@n-api.service[134051]: request: DELETE /compute/v2.1/servers/79ecc35f-86e8-4674-ac17-3e27b73230c4/os-volume_attachments/33f4dd6a-d015-4427-9469-7e783a280d2b HTTP/1.1 Aug 27 03:46:49.465491 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 03:46:49.465491 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 03:46:49.465491 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 03:46:49.465491 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 03:46:49.465491 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 03:46:49.465491 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 03:46:49.465491 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 03:46:49.465491 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 03:46:49.465491 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCZM-hx4n_tYWH1kjNds2EDscB9RPLxeL8xFGu8EmwlFPoLVm-YIv4_Wmi5qlBwiQolUKUcPtJm5YPtV1vA47f8r2snsI_cGHbUhdk3dY2p48Z06dkgHraIG40iwIATxhQd78ldrSw5MxPm_YvCQmrrcxG5LAKC3CKVHh_HtajSavrHI Aug 27 03:46:49.465491 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 03:46:49.465491 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 03:46:49.465491 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 03:46:49.465491 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 03:46:49.465491 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 03:46:49.465491 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 03:46:49.465491 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: cfd51c7913c94094bf412fc0ac22e291 Aug 27 03:46:49.465491 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1266117518 Aug 27 03:46:49.465491 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 03:46:49.465491 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 03:46:49.465491 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cfd51c7913c94094bf412fc0ac22e291"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_cfd51c7913c94094bf412fc0ac22e291", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cfd51c7913c94094bf412fc0ac22e291"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/cfd51c7913c94094bf412fc0ac22e291"}]}] Aug 27 03:46:49.465491 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-TestEncryptedCinderVolumes-1266117518 Aug 27 03:46:49.465491 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: cfd51c7913c94094bf412fc0ac22e291 Aug 27 03:46:49.465491 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1266117518 Aug 27 03:46:49.465491 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-TestEncryptedCinderVolumes-1266117518-project Aug 27 03:46:49.465491 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 03:46:49.465491 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 03:46:49.465491 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: e81627d91d3240a1aec4176d6d8279f5 Aug 27 03:46:49.465491 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-TestEncryptedCinderVolumes-1266117518-project Aug 27 03:46:49.465491 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 03:46:49.465491 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance 79ecc35f-86e8-4674-ac17-3e27b73230c4 is not attached to volume 33f4dd6a-d015-4427-9469-7e783a280d2b Aug 27 03:46:49.465491 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'server_id': '79ecc35f-86e8-4674-ac17-3e27b73230c4', 'id': '33f4dd6a-d015-4427-9469-7e783a280d2b'} Aug 27 03:46:49.465491 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:46:49.465491 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:46:49.465491 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 27 03:46:49.465491 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 27 03:46:49.465491 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 03:46:49.465491 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 03:46:49.465491 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 27 03:46:49.465491 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 27 03:46:49.465491 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 33f4dd6a-d015-4427-9469-7e783a280d2b. Aug 27 03:46:49.465491 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:46:49.465491 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:46:49.465491 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:46:49.465491 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:46:49.465491 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:46:49.465491 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:46:49.465491 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:46:49.465491 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:46:49.465491 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:46:49.465491 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:46:49.465491 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 27 03:46:49.465491 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 27 03:46:49.465491 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79ecc35f-86e8-4674-ac17-3e27b73230c4 is not attached to volume 33f4dd6a-d015-4427-9469-7e783a280d2b Aug 27 03:46:49.465491 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:46:49.465491 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:46:49.465491 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:46:49.465491 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:46:49.465491 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:46:49.465491 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:46:49.470361 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:46:49.470361 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:46:49.470361 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79ecc35f-86e8-4674-ac17-3e27b73230c4 is not attached to volume 33f4dd6a-d015-4427-9469-7e783a280d2b Aug 27 03:46:49.470361 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:46:49.470361 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-9e59d0f9-c718-4e30-bb81-e7e8a944cd56 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Returning 404 to user: Instance 79ecc35f-86e8-4674-ac17-3e27b73230c4 is not attached to volume 33f4dd6a-d015-4427-9469-7e783a280d2b {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:46:49.470361 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-9e59d0f9-c718-4e30-bb81-e7e8a944cd56 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] 10.222.0.70 "DELETE /compute/v2.1/servers/79ecc35f-86e8-4674-ac17-3e27b73230c4/os-volume_attachments/33f4dd6a-d015-4427-9469-7e783a280d2b" status: 404 len: 154 microversion: 2.1 time: 0.098109 Aug 27 03:46:49.470361 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3434/6820] 10.222.0.70 () {58 vars in 1416 bytes} [Sat Aug 27 03:46:49 2022] DELETE /compute/v2.1/servers/79ecc35f-86e8-4674-ac17-3e27b73230c4/os-volume_attachments/33f4dd6a-d015-4427-9469-7e783a280d2b => generated 154 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:46:52.825948 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-129596d0-1d84-4958-b1fe-a2d8faaa1c15 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:52.826575 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-129596d0-1d84-4958-b1fe-a2d8faaa1c15 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] [instance: 79ecc35f-86e8-4674-ac17-3e27b73230c4] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:52.834034 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-129596d0-1d84-4958-b1fe-a2d8faaa1c15 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:52.834528 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-129596d0-1d84-4958-b1fe-a2d8faaa1c15 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:52.834968 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-129596d0-1d84-4958-b1fe-a2d8faaa1c15 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:52.835689 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-129596d0-1d84-4958-b1fe-a2d8faaa1c15 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:52.836136 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-129596d0-1d84-4958-b1fe-a2d8faaa1c15 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:52.836593 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-129596d0-1d84-4958-b1fe-a2d8faaa1c15 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:52.864626 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-129596d0-1d84-4958-b1fe-a2d8faaa1c15 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] [instance: 79ecc35f-86e8-4674-ac17-3e27b73230c4] Going to try to terminate instance {{(pid=134052) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:46:52.950670 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-129596d0-1d84-4958-b1fe-a2d8faaa1c15 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] 10.222.0.70 "DELETE /compute/v2.1/servers/79ecc35f-86e8-4674-ac17-3e27b73230c4" status: 204 len: 0 microversion: 2.1 time: 0.128930 Aug 27 03:46:52.951330 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3387/6821] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 03:46:52 2022] DELETE /compute/v2.1/servers/79ecc35f-86e8-4674-ac17-3e27b73230c4 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:46:52.960195 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ee10565c-8e94-44f1-b57e-c43d8c8c6aaf tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:52.960941 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-ee10565c-8e94-44f1-b57e-c43d8c8c6aaf tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] [instance: 79ecc35f-86e8-4674-ac17-3e27b73230c4] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:52.968969 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ee10565c-8e94-44f1-b57e-c43d8c8c6aaf tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:52.969476 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ee10565c-8e94-44f1-b57e-c43d8c8c6aaf tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:52.969973 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ee10565c-8e94-44f1-b57e-c43d8c8c6aaf tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:52.970687 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ee10565c-8e94-44f1-b57e-c43d8c8c6aaf tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:52.971137 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ee10565c-8e94-44f1-b57e-c43d8c8c6aaf tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:52.971568 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ee10565c-8e94-44f1-b57e-c43d8c8c6aaf tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:53.105696 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-ee10565c-8e94-44f1-b57e-c43d8c8c6aaf tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81627d91d3240a1aec4176d6d8279f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd51c7913c94094bf412fc0ac22e291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:53.114843 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ee10565c-8e94-44f1-b57e-c43d8c8c6aaf tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] 10.222.0.70 "GET /compute/v2.1/servers/79ecc35f-86e8-4674-ac17-3e27b73230c4" status: 200 len: 1560 microversion: 2.1 time: 0.158580 Aug 27 03:46:53.115396 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3435/6822] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:52 2022] GET /compute/v2.1/servers/79ecc35f-86e8-4674-ac17-3e27b73230c4 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:46:54.137914 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-793f8e47-a8c6-47fa-b058-4b81e8435766 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:54.138584 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-793f8e47-a8c6-47fa-b058-4b81e8435766 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] [instance: 79ecc35f-86e8-4674-ac17-3e27b73230c4] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:54.146745 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-793f8e47-a8c6-47fa-b058-4b81e8435766 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:54.147239 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-793f8e47-a8c6-47fa-b058-4b81e8435766 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:54.147678 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-793f8e47-a8c6-47fa-b058-4b81e8435766 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:54.148419 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-793f8e47-a8c6-47fa-b058-4b81e8435766 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:54.148875 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-793f8e47-a8c6-47fa-b058-4b81e8435766 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:54.149303 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-793f8e47-a8c6-47fa-b058-4b81e8435766 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:54.281204 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-793f8e47-a8c6-47fa-b058-4b81e8435766 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81627d91d3240a1aec4176d6d8279f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd51c7913c94094bf412fc0ac22e291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:54.291465 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-793f8e47-a8c6-47fa-b058-4b81e8435766 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] 10.222.0.70 "GET /compute/v2.1/servers/79ecc35f-86e8-4674-ac17-3e27b73230c4" status: 200 len: 1560 microversion: 2.1 time: 0.158651 Aug 27 03:46:54.292278 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3388/6823] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:54 2022] GET /compute/v2.1/servers/79ecc35f-86e8-4674-ac17-3e27b73230c4 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:46:55.013740 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-456869cd-ef80-4704-8176-ca5f8c735de7 req-8e8e59fc-4e32-4b6f-b206-b933020f2af2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79ecc35f-86e8-4674-ac17-3e27b73230c4", "name": "network-vif-deleted", "tag": "d235024a-2eed-4fb5-8c56-96024da01561"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:46:55.024760 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-456869cd-ef80-4704-8176-ca5f8c735de7 req-8e8e59fc-4e32-4b6f-b206-b933020f2af2 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:55.025257 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-456869cd-ef80-4704-8176-ca5f8c735de7 req-8e8e59fc-4e32-4b6f-b206-b933020f2af2 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:55.025683 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-456869cd-ef80-4704-8176-ca5f8c735de7 req-8e8e59fc-4e32-4b6f-b206-b933020f2af2 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:55.038432 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-456869cd-ef80-4704-8176-ca5f8c735de7 req-8e8e59fc-4e32-4b6f-b206-b933020f2af2 service nova] Creating event network-vif-deleted:d235024a-2eed-4fb5-8c56-96024da01561 for instance 79ecc35f-86e8-4674-ac17-3e27b73230c4 on n-h2-852278-4 Aug 27 03:46:55.043612 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-456869cd-ef80-4704-8176-ca5f8c735de7 req-8e8e59fc-4e32-4b6f-b206-b933020f2af2 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033879 Aug 27 03:46:55.044219 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3436/6824] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:46:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:46:55.312826 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-1e4ca403-18d0-442c-b8e7-ebbce6863ba1 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:55.314112 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-1e4ca403-18d0-442c-b8e7-ebbce6863ba1 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] [instance: 79ecc35f-86e8-4674-ac17-3e27b73230c4] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:55.321950 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1e4ca403-18d0-442c-b8e7-ebbce6863ba1 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:55.322441 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1e4ca403-18d0-442c-b8e7-ebbce6863ba1 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:55.322872 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1e4ca403-18d0-442c-b8e7-ebbce6863ba1 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:55.323613 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1e4ca403-18d0-442c-b8e7-ebbce6863ba1 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:55.324053 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1e4ca403-18d0-442c-b8e7-ebbce6863ba1 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:55.324512 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1e4ca403-18d0-442c-b8e7-ebbce6863ba1 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:55.359815 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1e4ca403-18d0-442c-b8e7-ebbce6863ba1 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:55.360301 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1e4ca403-18d0-442c-b8e7-ebbce6863ba1 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:55.360773 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1e4ca403-18d0-442c-b8e7-ebbce6863ba1 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:55.361227 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.instance [None req-1e4ca403-18d0-442c-b8e7-ebbce6863ba1 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lazy-loading 'fault' on Instance uuid 79ecc35f-86e8-4674-ac17-3e27b73230c4 {{(pid=134052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:46:55.403949 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-1e4ca403-18d0-442c-b8e7-ebbce6863ba1 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81627d91d3240a1aec4176d6d8279f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd51c7913c94094bf412fc0ac22e291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:55.412915 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-1e4ca403-18d0-442c-b8e7-ebbce6863ba1 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] 10.222.0.70 "GET /compute/v2.1/servers/79ecc35f-86e8-4674-ac17-3e27b73230c4" status: 200 len: 1352 microversion: 2.1 time: 0.103939 Aug 27 03:46:55.413755 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3389/6825] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:55 2022] GET /compute/v2.1/servers/79ecc35f-86e8-4674-ac17-3e27b73230c4 => generated 1352 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:46:56.442047 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d7966822-82bb-4376-ac28-d277fd23d4f5 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:56.442764 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d7966822-82bb-4376-ac28-d277fd23d4f5 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] [instance: 79ecc35f-86e8-4674-ac17-3e27b73230c4] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:56.449773 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d7966822-82bb-4376-ac28-d277fd23d4f5 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:56.450267 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d7966822-82bb-4376-ac28-d277fd23d4f5 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:56.450711 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d7966822-82bb-4376-ac28-d277fd23d4f5 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:56.451410 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d7966822-82bb-4376-ac28-d277fd23d4f5 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:56.451877 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d7966822-82bb-4376-ac28-d277fd23d4f5 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:56.452330 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d7966822-82bb-4376-ac28-d277fd23d4f5 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:56.466376 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-d7966822-82bb-4376-ac28-d277fd23d4f5 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] HTTP exception thrown: Instance 79ecc35f-86e8-4674-ac17-3e27b73230c4 could not be found. Aug 27 03:46:56.468012 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d7966822-82bb-4376-ac28-d277fd23d4f5 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Request method failure captured: Aug 27 03:46:56.468012 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/79ecc35f-86e8-4674-ac17-3e27b73230c4 HTTP/1.1 Aug 27 03:46:56.468012 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 03:46:56.468012 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 03:46:56.468012 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 03:46:56.468012 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 03:46:56.468012 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 03:46:56.468012 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 03:46:56.468012 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 03:46:56.468012 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 03:46:56.468012 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCZM-hx4n_tYWH1kjNds2EDscB9RPLxeL8xFGu8EmwlFPoLVm-YIv4_Wmi5qlBwiQolUKUcPtJm5YPtV1vA47f8r2snsI_cGHbUhdk3dY2p48Z06dkgHraIG40iwIATxhQd78ldrSw5MxPm_YvCQmrrcxG5LAKC3CKVHh_HtajSavrHI Aug 27 03:46:56.468012 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 03:46:56.468012 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 03:46:56.468012 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 03:46:56.468012 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 03:46:56.468012 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 03:46:56.468012 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 03:46:56.468012 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: cfd51c7913c94094bf412fc0ac22e291 Aug 27 03:46:56.468012 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1266117518 Aug 27 03:46:56.468012 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 03:46:56.468012 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 03:46:56.468012 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cfd51c7913c94094bf412fc0ac22e291"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_cfd51c7913c94094bf412fc0ac22e291", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cfd51c7913c94094bf412fc0ac22e291"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/cfd51c7913c94094bf412fc0ac22e291"}]}] Aug 27 03:46:56.468012 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-TestEncryptedCinderVolumes-1266117518 Aug 27 03:46:56.468012 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: cfd51c7913c94094bf412fc0ac22e291 Aug 27 03:46:56.468012 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1266117518 Aug 27 03:46:56.468012 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-TestEncryptedCinderVolumes-1266117518-project Aug 27 03:46:56.468012 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 03:46:56.468012 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 03:46:56.468012 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: e81627d91d3240a1aec4176d6d8279f5 Aug 27 03:46:56.468012 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-TestEncryptedCinderVolumes-1266117518-project Aug 27 03:46:56.468012 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 03:46:56.468012 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance 79ecc35f-86e8-4674-ac17-3e27b73230c4 could not be found. Aug 27 03:46:56.468012 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '79ecc35f-86e8-4674-ac17-3e27b73230c4'} Aug 27 03:46:56.468012 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:46:56.468012 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:46:56.468012 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:46:56.468012 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:46:56.468012 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:46:56.468012 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:46:56.468012 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:46:56.468012 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:46:56.468012 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:46:56.468012 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:46:56.468012 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79ecc35f-86e8-4674-ac17-3e27b73230c4 could not be found. Aug 27 03:46:56.468012 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:46:56.468012 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:46:56.468012 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:46:56.468012 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:46:56.468012 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:46:56.468012 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:46:56.468012 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:46:56.468012 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:46:56.468012 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:46:56.468012 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:46:56.468012 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:46:56.468012 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:46:56.468012 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:46:56.468012 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:46:56.468012 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:46:56.468012 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:46:56.468012 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79ecc35f-86e8-4674-ac17-3e27b73230c4 could not be found. Aug 27 03:46:56.468012 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:46:56.468012 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:46:56.471719 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:46:56.471719 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:46:56.471719 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:46:56.471719 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:46:56.471719 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:46:56.471719 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:46:56.471719 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79ecc35f-86e8-4674-ac17-3e27b73230c4 could not be found. Aug 27 03:46:56.471719 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:46:56.471719 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d7966822-82bb-4376-ac28-d277fd23d4f5 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Returning 404 to user: Instance 79ecc35f-86e8-4674-ac17-3e27b73230c4 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:46:56.471719 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d7966822-82bb-4376-ac28-d277fd23d4f5 tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] 10.222.0.70 "GET /compute/v2.1/servers/79ecc35f-86e8-4674-ac17-3e27b73230c4" status: 404 len: 111 microversion: 2.1 time: 0.035927 Aug 27 03:46:56.471719 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3437/6826] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:56 2022] GET /compute/v2.1/servers/79ecc35f-86e8-4674-ac17-3e27b73230c4 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:46:56.478448 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3e43ffaa-c811-49e4-8564-8a0eac123c9d tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] Calling method '.version_select at 0x7f5ee1e59940>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:56.501558 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-3e43ffaa-c811-49e4-8564-8a0eac123c9d tempest-TestEncryptedCinderVolumes-1266117518 tempest-TestEncryptedCinderVolumes-1266117518-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-289397334" status: 202 len: 0 microversion: 2.1 time: 0.027004 Aug 27 03:46:56.502180 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3390/6827] 10.222.0.70 () {58 vars in 1275 bytes} [Sat Aug 27 03:46:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-289397334 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:47:23.077454 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4a7ffc2b-a731-46dd-a051-9a88752d0087 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Action: 'create', calling method: .version_select at 0x7f5eded9f8b0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-856776613", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIU2qbtnueh35ihsD6RF7quRqhVw3cUMQaRHdYiOUyRmFsWaknfTqQJH98Ad7j3kzsRBUxvy6I7H7yMW+62FQteaJNX6kzXD1V3E3GKqNVufRtNOvNp8PJsbnC85UKQWuQ=="}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:47:23.083375 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=14 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:47:23.084161 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=34 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:47:23.095839 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-4a7ffc2b-a731-46dd-a051-9a88752d0087 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Getting quotas for project 06da7a8a5fe84931beb76182a8072fb2. Resources: {'key_pairs'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:47:23.101274 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-4a7ffc2b-a731-46dd-a051-9a88752d0087 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Getting quotas for user f45a1d70add54293919369e7d34bd460 and project 06da7a8a5fe84931beb76182a8072fb2. Resources: {'key_pairs'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:47:23.127118 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-4a7ffc2b-a731-46dd-a051-9a88752d0087 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.053976 Aug 27 03:47:23.127719 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3438/6828] 10.222.0.70 () {60 vars in 1159 bytes} [Sat Aug 27 03:47:23 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:47:23.175703 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:47:23.176506 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:47:23.180770 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b3cb796c-d89c-418f-a9b4-603dc80543b5 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1058348916", "imageRef": "e68b0808-3d04-4add-b041-dafcf517aafb", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-856776613", "networks": [{"uuid": "18a1b180-7959-4fb8-a73c-cb7e9b6d8bae"}]}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:47:23.237258 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.network.neutron [None req-b3cb796c-d89c-418f-a9b4-603dc80543b5 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] validate_networks() for [('18a1b180-7959-4fb8-a73c-cb7e9b6d8bae', None, None, None, None, None)] {{(pid=134052) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:47:23.984635 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-b3cb796c-d89c-418f-a9b4-603dc80543b5 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Flavor limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:47:23.985058 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-b3cb796c-d89c-418f-a9b4-603dc80543b5 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Image limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:47:23.985527 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-b3cb796c-d89c-418f-a9b4-603dc80543b5 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Flavor pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:47:23.985934 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-b3cb796c-d89c-418f-a9b4-603dc80543b5 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Image pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:47:23.986313 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-b3cb796c-d89c-418f-a9b4-603dc80543b5 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:47:23.995791 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b3cb796c-d89c-418f-a9b4-603dc80543b5 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:47:23.996282 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b3cb796c-d89c-418f-a9b4-603dc80543b5 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:47:23.996733 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b3cb796c-d89c-418f-a9b4-603dc80543b5 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:47:23.997453 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b3cb796c-d89c-418f-a9b4-603dc80543b5 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:47:23.997900 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b3cb796c-d89c-418f-a9b4-603dc80543b5 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:47:23.998317 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b3cb796c-d89c-418f-a9b4-603dc80543b5 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:47:24.015198 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-b3cb796c-d89c-418f-a9b4-603dc80543b5 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Getting quotas for project 06da7a8a5fe84931beb76182a8072fb2. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:47:24.020764 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-b3cb796c-d89c-418f-a9b4-603dc80543b5 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Getting quotas for user f45a1d70add54293919369e7d34bd460 and project 06da7a8a5fe84931beb76182a8072fb2. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:47:24.034069 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b3cb796c-d89c-418f-a9b4-603dc80543b5 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Going to run 1 instances... {{(pid=134052) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:47:24.036377 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b3cb796c-d89c-418f-a9b4-603dc80543b5 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] [instance: a141c739-192c-4884-8d6f-404e56f5f5c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e68b0808-3d04-4add-b041-dafcf517aafb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134052) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:47:24.084593 n-d-852278-4 devstack@n-api.service[134052]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b3cb796c-d89c-418f-a9b4-603dc80543b5 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] [1aa1fcac-a02d-4e25-a093-d6ff75be1bb6] AMQP server on 10.222.0.70:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 27 03:47:25.094676 n-d-852278-4 devstack@n-api.service[134052]: INFO oslo.messaging._drivers.impl_rabbit [None req-b3cb796c-d89c-418f-a9b4-603dc80543b5 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] [1aa1fcac-a02d-4e25-a093-d6ff75be1bb6] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 57578. Aug 27 03:47:25.099943 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b3cb796c-d89c-418f-a9b4-603dc80543b5 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.926351 Aug 27 03:47:25.100785 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3391/6829] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 03:47:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1928 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:47:25.113329 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-065312db-8ed1-4856-9885-6c587e7e60fc tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:47:25.113990 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-065312db-8ed1-4856-9885-6c587e7e60fc tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] [instance: a141c739-192c-4884-8d6f-404e56f5f5c6] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:47:25.169966 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-065312db-8ed1-4856-9885-6c587e7e60fc tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45a1d70add54293919369e7d34bd460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06da7a8a5fe84931beb76182a8072fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:47:25.177933 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-065312db-8ed1-4856-9885-6c587e7e60fc tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] 10.222.0.70 "GET /compute/v2.1/servers/a141c739-192c-4884-8d6f-404e56f5f5c6" status: 200 len: 1258 microversion: 2.1 time: 0.069732 Aug 27 03:47:25.178523 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3439/6830] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:47:25 2022] GET /compute/v2.1/servers/a141c739-192c-4884-8d6f-404e56f5f5c6 => generated 1258 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:47:26.200086 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-58424771-21a4-49d7-946e-93598210b3eb tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:47:26.200748 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-58424771-21a4-49d7-946e-93598210b3eb tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] [instance: a141c739-192c-4884-8d6f-404e56f5f5c6] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:47:26.207105 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-58424771-21a4-49d7-946e-93598210b3eb tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:47:26.207583 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-58424771-21a4-49d7-946e-93598210b3eb tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:47:26.208005 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-58424771-21a4-49d7-946e-93598210b3eb tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:47:26.208721 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-58424771-21a4-49d7-946e-93598210b3eb tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:47:26.209285 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-58424771-21a4-49d7-946e-93598210b3eb tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:47:26.209735 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-58424771-21a4-49d7-946e-93598210b3eb tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:47:26.296166 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-58424771-21a4-49d7-946e-93598210b3eb tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45a1d70add54293919369e7d34bd460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06da7a8a5fe84931beb76182a8072fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:47:26.305533 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-58424771-21a4-49d7-946e-93598210b3eb tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] 10.222.0.70 "GET /compute/v2.1/servers/a141c739-192c-4884-8d6f-404e56f5f5c6" status: 200 len: 1318 microversion: 2.1 time: 0.110756 Aug 27 03:47:26.306373 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3392/6831] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:47:26 2022] GET /compute/v2.1/servers/a141c739-192c-4884-8d6f-404e56f5f5c6 => generated 1318 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:47:27.326520 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ebffed5e-773d-4514-b447-1a7401331b73 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:47:27.327251 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-ebffed5e-773d-4514-b447-1a7401331b73 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] [instance: a141c739-192c-4884-8d6f-404e56f5f5c6] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:47:27.340071 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ebffed5e-773d-4514-b447-1a7401331b73 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:47:27.341451 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ebffed5e-773d-4514-b447-1a7401331b73 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:47:27.343109 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ebffed5e-773d-4514-b447-1a7401331b73 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:47:27.344048 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ebffed5e-773d-4514-b447-1a7401331b73 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:47:27.345276 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ebffed5e-773d-4514-b447-1a7401331b73 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:47:27.345895 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ebffed5e-773d-4514-b447-1a7401331b73 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:47:27.490771 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-ebffed5e-773d-4514-b447-1a7401331b73 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45a1d70add54293919369e7d34bd460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06da7a8a5fe84931beb76182a8072fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:47:27.498915 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ebffed5e-773d-4514-b447-1a7401331b73 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] 10.222.0.70 "GET /compute/v2.1/servers/a141c739-192c-4884-8d6f-404e56f5f5c6" status: 200 len: 1358 microversion: 2.1 time: 0.176381 Aug 27 03:47:27.499445 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3440/6832] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:47:27 2022] GET /compute/v2.1/servers/a141c739-192c-4884-8d6f-404e56f5f5c6 => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:47:28.519559 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c1c85f2e-a67e-4bd6-a3cc-5c5070adf3ac tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:47:28.520130 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-c1c85f2e-a67e-4bd6-a3cc-5c5070adf3ac tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] [instance: a141c739-192c-4884-8d6f-404e56f5f5c6] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:47:28.527679 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c1c85f2e-a67e-4bd6-a3cc-5c5070adf3ac tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:47:28.528502 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c1c85f2e-a67e-4bd6-a3cc-5c5070adf3ac tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:47:28.529005 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c1c85f2e-a67e-4bd6-a3cc-5c5070adf3ac tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:47:28.529633 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c1c85f2e-a67e-4bd6-a3cc-5c5070adf3ac tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:47:28.530071 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c1c85f2e-a67e-4bd6-a3cc-5c5070adf3ac tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:47:28.530493 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c1c85f2e-a67e-4bd6-a3cc-5c5070adf3ac tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:47:28.668396 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-c1c85f2e-a67e-4bd6-a3cc-5c5070adf3ac tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45a1d70add54293919369e7d34bd460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06da7a8a5fe84931beb76182a8072fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:47:28.677889 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c1c85f2e-a67e-4bd6-a3cc-5c5070adf3ac tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] 10.222.0.70 "GET /compute/v2.1/servers/a141c739-192c-4884-8d6f-404e56f5f5c6" status: 200 len: 1358 microversion: 2.1 time: 0.162298 Aug 27 03:47:28.691210 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3393/6833] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:47:28 2022] GET /compute/v2.1/servers/a141c739-192c-4884-8d6f-404e56f5f5c6 => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:47:29.698988 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-158b2a4e-bb6a-49eb-bf1c-2c537b567f81 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:47:29.699619 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-158b2a4e-bb6a-49eb-bf1c-2c537b567f81 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] [instance: a141c739-192c-4884-8d6f-404e56f5f5c6] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:47:29.706711 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-158b2a4e-bb6a-49eb-bf1c-2c537b567f81 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:47:29.707215 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-158b2a4e-bb6a-49eb-bf1c-2c537b567f81 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:47:29.707665 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-158b2a4e-bb6a-49eb-bf1c-2c537b567f81 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:47:29.708407 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-158b2a4e-bb6a-49eb-bf1c-2c537b567f81 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:47:29.708929 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-158b2a4e-bb6a-49eb-bf1c-2c537b567f81 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:47:29.709355 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-158b2a4e-bb6a-49eb-bf1c-2c537b567f81 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:47:29.848999 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-158b2a4e-bb6a-49eb-bf1c-2c537b567f81 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45a1d70add54293919369e7d34bd460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06da7a8a5fe84931beb76182a8072fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:47:29.857349 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-158b2a4e-bb6a-49eb-bf1c-2c537b567f81 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] 10.222.0.70 "GET /compute/v2.1/servers/a141c739-192c-4884-8d6f-404e56f5f5c6" status: 200 len: 1358 microversion: 2.1 time: 0.162225 Aug 27 03:47:29.858174 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3441/6834] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:47:29 2022] GET /compute/v2.1/servers/a141c739-192c-4884-8d6f-404e56f5f5c6 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:47:30.877816 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c9eb2d58-abe9-4c32-8f18-88642f6dd14d tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:47:30.879078 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-c9eb2d58-abe9-4c32-8f18-88642f6dd14d tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] [instance: a141c739-192c-4884-8d6f-404e56f5f5c6] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:47:30.888042 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c9eb2d58-abe9-4c32-8f18-88642f6dd14d tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:47:30.888561 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c9eb2d58-abe9-4c32-8f18-88642f6dd14d tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:47:30.889009 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c9eb2d58-abe9-4c32-8f18-88642f6dd14d tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:47:30.889934 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c9eb2d58-abe9-4c32-8f18-88642f6dd14d tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:47:30.890394 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c9eb2d58-abe9-4c32-8f18-88642f6dd14d tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:47:30.890878 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c9eb2d58-abe9-4c32-8f18-88642f6dd14d tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:47:31.031220 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-c9eb2d58-abe9-4c32-8f18-88642f6dd14d tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45a1d70add54293919369e7d34bd460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06da7a8a5fe84931beb76182a8072fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:47:31.047086 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c9eb2d58-abe9-4c32-8f18-88642f6dd14d tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] 10.222.0.70 "GET /compute/v2.1/servers/a141c739-192c-4884-8d6f-404e56f5f5c6" status: 200 len: 1358 microversion: 2.1 time: 0.173229 Aug 27 03:47:31.047906 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3394/6835] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:47:30 2022] GET /compute/v2.1/servers/a141c739-192c-4884-8d6f-404e56f5f5c6 => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:47:32.075393 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-bab3e695-578d-4e9c-be89-7b612a01d2bb tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:47:32.076120 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-bab3e695-578d-4e9c-be89-7b612a01d2bb tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] [instance: a141c739-192c-4884-8d6f-404e56f5f5c6] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:47:32.083216 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bab3e695-578d-4e9c-be89-7b612a01d2bb tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:47:32.083814 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bab3e695-578d-4e9c-be89-7b612a01d2bb tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:47:32.084404 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bab3e695-578d-4e9c-be89-7b612a01d2bb tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:47:32.085147 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bab3e695-578d-4e9c-be89-7b612a01d2bb tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:47:32.085763 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bab3e695-578d-4e9c-be89-7b612a01d2bb tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:47:32.086201 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bab3e695-578d-4e9c-be89-7b612a01d2bb tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:47:32.231817 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-bab3e695-578d-4e9c-be89-7b612a01d2bb tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45a1d70add54293919369e7d34bd460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06da7a8a5fe84931beb76182a8072fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:47:32.240118 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-bab3e695-578d-4e9c-be89-7b612a01d2bb tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] 10.222.0.70 "GET /compute/v2.1/servers/a141c739-192c-4884-8d6f-404e56f5f5c6" status: 200 len: 1358 microversion: 2.1 time: 0.170727 Aug 27 03:47:32.240737 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3442/6836] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:47:32 2022] GET /compute/v2.1/servers/a141c739-192c-4884-8d6f-404e56f5f5c6 => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:47:33.261019 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5f21de30-8570-43a3-9152-4dd5bc5b83db tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:47:33.261620 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-5f21de30-8570-43a3-9152-4dd5bc5b83db tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] [instance: a141c739-192c-4884-8d6f-404e56f5f5c6] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:47:33.268768 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5f21de30-8570-43a3-9152-4dd5bc5b83db tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:47:33.269268 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5f21de30-8570-43a3-9152-4dd5bc5b83db tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:47:33.269707 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5f21de30-8570-43a3-9152-4dd5bc5b83db tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:47:33.270421 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5f21de30-8570-43a3-9152-4dd5bc5b83db tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:47:33.270876 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5f21de30-8570-43a3-9152-4dd5bc5b83db tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:47:33.271299 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5f21de30-8570-43a3-9152-4dd5bc5b83db tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:47:33.437202 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-5f21de30-8570-43a3-9152-4dd5bc5b83db tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45a1d70add54293919369e7d34bd460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06da7a8a5fe84931beb76182a8072fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:47:33.445566 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-5f21de30-8570-43a3-9152-4dd5bc5b83db tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] 10.222.0.70 "GET /compute/v2.1/servers/a141c739-192c-4884-8d6f-404e56f5f5c6" status: 200 len: 1358 microversion: 2.1 time: 0.188412 Aug 27 03:47:33.456377 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3395/6837] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:47:33 2022] GET /compute/v2.1/servers/a141c739-192c-4884-8d6f-404e56f5f5c6 => generated 1358 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:47:34.471183 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0b308db5-ad3e-4d5d-a65a-1fab3dacfd25 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:47:34.472231 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-0b308db5-ad3e-4d5d-a65a-1fab3dacfd25 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] [instance: a141c739-192c-4884-8d6f-404e56f5f5c6] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:47:34.484239 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0b308db5-ad3e-4d5d-a65a-1fab3dacfd25 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:47:34.485811 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0b308db5-ad3e-4d5d-a65a-1fab3dacfd25 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:47:34.486121 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0b308db5-ad3e-4d5d-a65a-1fab3dacfd25 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:47:34.487235 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0b308db5-ad3e-4d5d-a65a-1fab3dacfd25 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:47:34.488014 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0b308db5-ad3e-4d5d-a65a-1fab3dacfd25 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:47:34.488802 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0b308db5-ad3e-4d5d-a65a-1fab3dacfd25 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:47:34.699262 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-0b308db5-ad3e-4d5d-a65a-1fab3dacfd25 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45a1d70add54293919369e7d34bd460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06da7a8a5fe84931beb76182a8072fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:47:34.707555 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-0b308db5-ad3e-4d5d-a65a-1fab3dacfd25 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] 10.222.0.70 "GET /compute/v2.1/servers/a141c739-192c-4884-8d6f-404e56f5f5c6" status: 200 len: 1358 microversion: 2.1 time: 0.242991 Aug 27 03:47:34.708135 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3443/6838] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:47:34 2022] GET /compute/v2.1/servers/a141c739-192c-4884-8d6f-404e56f5f5c6 => generated 1358 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:47:35.160600 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-72bd9057-89a6-47c3-bc66-a48d9870e2a7 req-f843e662-14fc-4515-9977-c5c9959fc00d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a141c739-192c-4884-8d6f-404e56f5f5c6", "tag": "fd4fec0e-5d6e-4cab-939d-14cb92475896"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:47:35.166206 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:47:35.166897 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=6 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:47:35.174822 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-72bd9057-89a6-47c3-bc66-a48d9870e2a7 req-f843e662-14fc-4515-9977-c5c9959fc00d service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:47:35.175329 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-72bd9057-89a6-47c3-bc66-a48d9870e2a7 req-f843e662-14fc-4515-9977-c5c9959fc00d service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:47:35.175761 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-72bd9057-89a6-47c3-bc66-a48d9870e2a7 req-f843e662-14fc-4515-9977-c5c9959fc00d service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:47:35.189915 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-72bd9057-89a6-47c3-bc66-a48d9870e2a7 req-f843e662-14fc-4515-9977-c5c9959fc00d service nova] Creating event network-changed:fd4fec0e-5d6e-4cab-939d-14cb92475896 for instance a141c739-192c-4884-8d6f-404e56f5f5c6 on n-h1-852278-4 Aug 27 03:47:35.195792 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-72bd9057-89a6-47c3-bc66-a48d9870e2a7 req-f843e662-14fc-4515-9977-c5c9959fc00d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039336 Aug 27 03:47:35.196846 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3396/6839] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:47:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:47:35.729215 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-5badc0f0-40bb-4f93-b149-4bae395eed06 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:47:35.729795 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-5badc0f0-40bb-4f93-b149-4bae395eed06 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] [instance: a141c739-192c-4884-8d6f-404e56f5f5c6] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:47:35.731651 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=6 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:47:35.738310 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5badc0f0-40bb-4f93-b149-4bae395eed06 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:47:35.738843 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5badc0f0-40bb-4f93-b149-4bae395eed06 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:47:35.739280 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5badc0f0-40bb-4f93-b149-4bae395eed06 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:47:35.740082 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5badc0f0-40bb-4f93-b149-4bae395eed06 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:47:35.740572 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5badc0f0-40bb-4f93-b149-4bae395eed06 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:47:35.741011 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5badc0f0-40bb-4f93-b149-4bae395eed06 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:47:35.883832 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-5badc0f0-40bb-4f93-b149-4bae395eed06 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45a1d70add54293919369e7d34bd460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06da7a8a5fe84931beb76182a8072fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:47:35.891855 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-5badc0f0-40bb-4f93-b149-4bae395eed06 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] 10.222.0.70 "GET /compute/v2.1/servers/a141c739-192c-4884-8d6f-404e56f5f5c6" status: 200 len: 1358 microversion: 2.1 time: 0.166760 Aug 27 03:47:35.892506 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3444/6840] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:47:35 2022] GET /compute/v2.1/servers/a141c739-192c-4884-8d6f-404e56f5f5c6 => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:47:36.915462 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d9a9a068-3a59-434b-9a9c-eefe6013e2de tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:47:36.916192 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d9a9a068-3a59-434b-9a9c-eefe6013e2de tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] [instance: a141c739-192c-4884-8d6f-404e56f5f5c6] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:47:36.924079 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d9a9a068-3a59-434b-9a9c-eefe6013e2de tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:47:36.924352 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d9a9a068-3a59-434b-9a9c-eefe6013e2de tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:47:36.924813 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d9a9a068-3a59-434b-9a9c-eefe6013e2de tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:47:36.925517 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d9a9a068-3a59-434b-9a9c-eefe6013e2de tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:47:36.925965 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d9a9a068-3a59-434b-9a9c-eefe6013e2de tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:47:36.926379 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d9a9a068-3a59-434b-9a9c-eefe6013e2de tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:47:37.081831 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-d9a9a068-3a59-434b-9a9c-eefe6013e2de tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45a1d70add54293919369e7d34bd460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06da7a8a5fe84931beb76182a8072fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:47:37.089928 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d9a9a068-3a59-434b-9a9c-eefe6013e2de tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] 10.222.0.70 "GET /compute/v2.1/servers/a141c739-192c-4884-8d6f-404e56f5f5c6" status: 200 len: 1358 microversion: 2.1 time: 0.180098 Aug 27 03:47:37.090533 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3397/6841] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:47:36 2022] GET /compute/v2.1/servers/a141c739-192c-4884-8d6f-404e56f5f5c6 => generated 1358 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:47:38.125707 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-aa3c7e30-8480-41c6-b435-7975857c8b49 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:47:38.126760 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-aa3c7e30-8480-41c6-b435-7975857c8b49 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] [instance: a141c739-192c-4884-8d6f-404e56f5f5c6] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:47:38.137825 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-aa3c7e30-8480-41c6-b435-7975857c8b49 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:47:38.138749 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-aa3c7e30-8480-41c6-b435-7975857c8b49 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:47:38.139501 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-aa3c7e30-8480-41c6-b435-7975857c8b49 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:47:38.140740 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-aa3c7e30-8480-41c6-b435-7975857c8b49 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:47:38.141495 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-aa3c7e30-8480-41c6-b435-7975857c8b49 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:47:38.142256 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-aa3c7e30-8480-41c6-b435-7975857c8b49 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:47:38.276522 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-aa3c7e30-8480-41c6-b435-7975857c8b49 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45a1d70add54293919369e7d34bd460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06da7a8a5fe84931beb76182a8072fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:47:38.284501 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-aa3c7e30-8480-41c6-b435-7975857c8b49 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] 10.222.0.70 "GET /compute/v2.1/servers/a141c739-192c-4884-8d6f-404e56f5f5c6" status: 200 len: 1358 microversion: 2.1 time: 0.165697 Aug 27 03:47:38.285081 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3445/6842] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:47:38 2022] GET /compute/v2.1/servers/a141c739-192c-4884-8d6f-404e56f5f5c6 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:47:39.306076 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4f7d4849-b627-46e7-a76b-194364084861 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:47:39.306641 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-4f7d4849-b627-46e7-a76b-194364084861 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] [instance: a141c739-192c-4884-8d6f-404e56f5f5c6] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:47:39.313978 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4f7d4849-b627-46e7-a76b-194364084861 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:47:39.314464 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4f7d4849-b627-46e7-a76b-194364084861 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:47:39.314918 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4f7d4849-b627-46e7-a76b-194364084861 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:47:39.315599 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4f7d4849-b627-46e7-a76b-194364084861 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:47:39.316044 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4f7d4849-b627-46e7-a76b-194364084861 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:47:39.316488 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4f7d4849-b627-46e7-a76b-194364084861 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:47:39.452590 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-4f7d4849-b627-46e7-a76b-194364084861 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45a1d70add54293919369e7d34bd460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06da7a8a5fe84931beb76182a8072fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:47:39.464396 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-4f7d4849-b627-46e7-a76b-194364084861 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] 10.222.0.70 "GET /compute/v2.1/servers/a141c739-192c-4884-8d6f-404e56f5f5c6" status: 200 len: 1358 microversion: 2.1 time: 0.162073 Aug 27 03:47:39.465232 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3398/6843] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:47:39 2022] GET /compute/v2.1/servers/a141c739-192c-4884-8d6f-404e56f5f5c6 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:47:40.488575 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-00cf67c7-e085-4fe4-b8ed-b90f444840cc tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:47:40.489190 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-00cf67c7-e085-4fe4-b8ed-b90f444840cc tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] [instance: a141c739-192c-4884-8d6f-404e56f5f5c6] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:47:40.496873 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-00cf67c7-e085-4fe4-b8ed-b90f444840cc tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:47:40.497373 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-00cf67c7-e085-4fe4-b8ed-b90f444840cc tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:47:40.497823 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-00cf67c7-e085-4fe4-b8ed-b90f444840cc tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:47:40.498509 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-00cf67c7-e085-4fe4-b8ed-b90f444840cc tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:47:40.499002 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-00cf67c7-e085-4fe4-b8ed-b90f444840cc tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:47:40.499434 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-00cf67c7-e085-4fe4-b8ed-b90f444840cc tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:47:40.639597 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-00cf67c7-e085-4fe4-b8ed-b90f444840cc tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45a1d70add54293919369e7d34bd460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06da7a8a5fe84931beb76182a8072fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:47:40.648080 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-00cf67c7-e085-4fe4-b8ed-b90f444840cc tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] 10.222.0.70 "GET /compute/v2.1/servers/a141c739-192c-4884-8d6f-404e56f5f5c6" status: 200 len: 1358 microversion: 2.1 time: 0.163525 Aug 27 03:47:40.648907 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3446/6844] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:47:40 2022] GET /compute/v2.1/servers/a141c739-192c-4884-8d6f-404e56f5f5c6 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:47:40.788394 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-9744592a-4c66-43e9-84e0-16060f77728c req-65fcfb0e-7621-4dd7-a30e-9159e7b57acb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a141c739-192c-4884-8d6f-404e56f5f5c6", "name": "network-vif-plugged", "status": "completed", "tag": "fd4fec0e-5d6e-4cab-939d-14cb92475896"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:47:40.799162 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-9744592a-4c66-43e9-84e0-16060f77728c req-65fcfb0e-7621-4dd7-a30e-9159e7b57acb service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:47:40.799640 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-9744592a-4c66-43e9-84e0-16060f77728c req-65fcfb0e-7621-4dd7-a30e-9159e7b57acb service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:47:40.800062 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-9744592a-4c66-43e9-84e0-16060f77728c req-65fcfb0e-7621-4dd7-a30e-9159e7b57acb service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:47:40.811516 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-9744592a-4c66-43e9-84e0-16060f77728c req-65fcfb0e-7621-4dd7-a30e-9159e7b57acb service nova] Creating event network-vif-plugged:fd4fec0e-5d6e-4cab-939d-14cb92475896 for instance a141c739-192c-4884-8d6f-404e56f5f5c6 on n-h1-852278-4 Aug 27 03:47:40.816420 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-9744592a-4c66-43e9-84e0-16060f77728c req-65fcfb0e-7621-4dd7-a30e-9159e7b57acb service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032001 Aug 27 03:47:40.817023 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3399/6845] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:47:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:47:41.671907 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7de33fda-a57e-45db-939a-ff5ad389bd2b tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:47:41.672554 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-7de33fda-a57e-45db-939a-ff5ad389bd2b tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] [instance: a141c739-192c-4884-8d6f-404e56f5f5c6] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:47:41.682544 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7de33fda-a57e-45db-939a-ff5ad389bd2b tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:47:41.683203 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7de33fda-a57e-45db-939a-ff5ad389bd2b tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:47:41.683789 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7de33fda-a57e-45db-939a-ff5ad389bd2b tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:47:41.684821 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7de33fda-a57e-45db-939a-ff5ad389bd2b tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:47:41.685465 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7de33fda-a57e-45db-939a-ff5ad389bd2b tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:47:41.686013 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7de33fda-a57e-45db-939a-ff5ad389bd2b tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:47:41.823390 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-7de33fda-a57e-45db-939a-ff5ad389bd2b tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45a1d70add54293919369e7d34bd460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06da7a8a5fe84931beb76182a8072fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:47:41.834714 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-7de33fda-a57e-45db-939a-ff5ad389bd2b tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] 10.222.0.70 "GET /compute/v2.1/servers/a141c739-192c-4884-8d6f-404e56f5f5c6" status: 200 len: 1358 microversion: 2.1 time: 0.169270 Aug 27 03:47:41.835282 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3447/6846] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:47:41 2022] GET /compute/v2.1/servers/a141c739-192c-4884-8d6f-404e56f5f5c6 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:47:42.857004 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b0bb05ce-d34d-4d3f-8db4-751713fcf501 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:47:42.857671 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b0bb05ce-d34d-4d3f-8db4-751713fcf501 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] [instance: a141c739-192c-4884-8d6f-404e56f5f5c6] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:47:42.864404 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b0bb05ce-d34d-4d3f-8db4-751713fcf501 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:47:42.864999 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b0bb05ce-d34d-4d3f-8db4-751713fcf501 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:47:42.865472 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b0bb05ce-d34d-4d3f-8db4-751713fcf501 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:47:42.866175 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b0bb05ce-d34d-4d3f-8db4-751713fcf501 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:47:42.866629 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b0bb05ce-d34d-4d3f-8db4-751713fcf501 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:47:42.867053 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b0bb05ce-d34d-4d3f-8db4-751713fcf501 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:47:43.010386 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b0bb05ce-d34d-4d3f-8db4-751713fcf501 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45a1d70add54293919369e7d34bd460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06da7a8a5fe84931beb76182a8072fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:47:43.018404 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b0bb05ce-d34d-4d3f-8db4-751713fcf501 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] 10.222.0.70 "GET /compute/v2.1/servers/a141c739-192c-4884-8d6f-404e56f5f5c6" status: 200 len: 1549 microversion: 2.1 time: 0.166743 Aug 27 03:47:43.018990 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3400/6847] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:47:42 2022] GET /compute/v2.1/servers/a141c739-192c-4884-8d6f-404e56f5f5c6 => generated 1549 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:47:43.038353 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ea5a32b0-9f39-4e9c-a4af-4cbb5b02e068 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:47:43.038957 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-ea5a32b0-9f39-4e9c-a4af-4cbb5b02e068 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] [instance: a141c739-192c-4884-8d6f-404e56f5f5c6] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:47:43.045708 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ea5a32b0-9f39-4e9c-a4af-4cbb5b02e068 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:47:43.046212 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ea5a32b0-9f39-4e9c-a4af-4cbb5b02e068 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:47:43.046986 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ea5a32b0-9f39-4e9c-a4af-4cbb5b02e068 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:47:43.047697 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ea5a32b0-9f39-4e9c-a4af-4cbb5b02e068 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:47:43.048166 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ea5a32b0-9f39-4e9c-a4af-4cbb5b02e068 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:47:43.048635 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ea5a32b0-9f39-4e9c-a4af-4cbb5b02e068 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:47:43.198882 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-ea5a32b0-9f39-4e9c-a4af-4cbb5b02e068 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45a1d70add54293919369e7d34bd460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06da7a8a5fe84931beb76182a8072fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:47:43.207278 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ea5a32b0-9f39-4e9c-a4af-4cbb5b02e068 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] 10.222.0.70 "GET /compute/v2.1/servers/a141c739-192c-4884-8d6f-404e56f5f5c6" status: 200 len: 1549 microversion: 2.1 time: 0.172866 Aug 27 03:47:43.207876 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3448/6848] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:47:43 2022] GET /compute/v2.1/servers/a141c739-192c-4884-8d6f-404e56f5f5c6 => generated 1549 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:47:43.227883 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-54f6d108-baaf-49fa-92ab-0fceaf59a10d tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:47:43.232637 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-54f6d108-baaf-49fa-92ab-0fceaf59a10d tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f45a1d70add54293919369e7d34bd460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06da7a8a5fe84931beb76182a8072fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:47:43.233400 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-54f6d108-baaf-49fa-92ab-0fceaf59a10d tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Searching by: {'deleted': False, 'project_id': '06da7a8a5fe84931beb76182a8072fb2'} {{(pid=134052) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 03:47:43.239116 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-54f6d108-baaf-49fa-92ab-0fceaf59a10d tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:47:43.239617 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-54f6d108-baaf-49fa-92ab-0fceaf59a10d tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:47:43.240144 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-54f6d108-baaf-49fa-92ab-0fceaf59a10d tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:47:43.240906 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-54f6d108-baaf-49fa-92ab-0fceaf59a10d tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:47:43.241347 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-54f6d108-baaf-49fa-92ab-0fceaf59a10d tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:47:43.241739 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-54f6d108-baaf-49fa-92ab-0fceaf59a10d tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:47:43.267954 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.multi_cell_list [None req-54f6d108-baaf-49fa-92ab-0fceaf59a10d tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=134052) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 03:47:43.298528 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-54f6d108-baaf-49fa-92ab-0fceaf59a10d tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] 10.222.0.70 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.074641 Aug 27 03:47:43.299499 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3401/6849] 10.222.0.70 () {58 vars in 1125 bytes} [Sat Aug 27 03:47:43 2022] GET /compute/v2.1/servers => generated 343 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:47:43.311090 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-63fc925e-7a67-49b5-9ef3-7c92bb7ef1bb tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:47:43.311729 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-63fc925e-7a67-49b5-9ef3-7c92bb7ef1bb tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] [instance: a141c739-192c-4884-8d6f-404e56f5f5c6] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:47:43.318442 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-63fc925e-7a67-49b5-9ef3-7c92bb7ef1bb tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:47:43.318948 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-63fc925e-7a67-49b5-9ef3-7c92bb7ef1bb tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:47:43.319404 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-63fc925e-7a67-49b5-9ef3-7c92bb7ef1bb tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:47:43.320120 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-63fc925e-7a67-49b5-9ef3-7c92bb7ef1bb tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:47:43.320614 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-63fc925e-7a67-49b5-9ef3-7c92bb7ef1bb tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:47:43.321081 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-63fc925e-7a67-49b5-9ef3-7c92bb7ef1bb tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:47:43.452742 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-63fc925e-7a67-49b5-9ef3-7c92bb7ef1bb tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45a1d70add54293919369e7d34bd460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06da7a8a5fe84931beb76182a8072fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:47:43.461036 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-63fc925e-7a67-49b5-9ef3-7c92bb7ef1bb tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] 10.222.0.70 "GET /compute/v2.1/servers/a141c739-192c-4884-8d6f-404e56f5f5c6" status: 200 len: 1549 microversion: 2.1 time: 0.153908 Aug 27 03:47:43.461617 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3449/6850] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:47:43 2022] GET /compute/v2.1/servers/a141c739-192c-4884-8d6f-404e56f5f5c6 => generated 1549 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:47:45.030452 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-38ed35d1-0361-4659-93c2-42044153d5ae tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f6296b80-02b8-4a50-97cb-fd90643e9228"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:47:45.032873 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-38ed35d1-0361-4659-93c2-42044153d5ae tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] [instance: a141c739-192c-4884-8d6f-404e56f5f5c6] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:47:45.039918 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-38ed35d1-0361-4659-93c2-42044153d5ae tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:47:45.040431 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-38ed35d1-0361-4659-93c2-42044153d5ae tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:47:45.040870 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-38ed35d1-0361-4659-93c2-42044153d5ae tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:47:45.041566 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-38ed35d1-0361-4659-93c2-42044153d5ae tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:47:45.042020 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-38ed35d1-0361-4659-93c2-42044153d5ae tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:47:45.042445 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-38ed35d1-0361-4659-93c2-42044153d5ae tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:47:45.342455 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-38ed35d1-0361-4659-93c2-42044153d5ae tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] 10.222.0.70 "POST /compute/v2.1/servers/a141c739-192c-4884-8d6f-404e56f5f5c6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.315840 Aug 27 03:47:45.343215 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3402/6851] 10.222.0.70 () {60 vars in 1323 bytes} [Sat Aug 27 03:47:45 2022] POST /compute/v2.1/servers/a141c739-192c-4884-8d6f-404e56f5f5c6/os-volume_attachments => generated 194 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:47:58.617331 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-59eeab0e-2bc4-4636-9825-5edf38ebc142 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:47:58.617963 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-59eeab0e-2bc4-4636-9825-5edf38ebc142 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] [instance: a141c739-192c-4884-8d6f-404e56f5f5c6] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:47:58.620958 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:47:58.621648 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=60 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:47:58.627091 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-59eeab0e-2bc4-4636-9825-5edf38ebc142 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:47:58.627599 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-59eeab0e-2bc4-4636-9825-5edf38ebc142 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:47:58.628056 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-59eeab0e-2bc4-4636-9825-5edf38ebc142 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:47:58.628795 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-59eeab0e-2bc4-4636-9825-5edf38ebc142 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:47:58.629266 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-59eeab0e-2bc4-4636-9825-5edf38ebc142 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:47:58.629707 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-59eeab0e-2bc4-4636-9825-5edf38ebc142 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:47:58.774019 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-59eeab0e-2bc4-4636-9825-5edf38ebc142 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45a1d70add54293919369e7d34bd460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06da7a8a5fe84931beb76182a8072fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:47:58.787475 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-59eeab0e-2bc4-4636-9825-5edf38ebc142 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] 10.222.0.70 "GET /compute/v2.1/servers/a141c739-192c-4884-8d6f-404e56f5f5c6" status: 200 len: 1595 microversion: 2.1 time: 0.174186 Aug 27 03:47:58.788042 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3450/6852] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:47:58 2022] GET /compute/v2.1/servers/a141c739-192c-4884-8d6f-404e56f5f5c6 => generated 1595 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:48:00.774115 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:48:00.775012 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:48:00.775768 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:48:00.781265 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-1563d655-7741-4964-8e8c-88f3b6cb40b2 req-e2df92d9-a988-40f1-ba17-89c5412f8e40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a141c739-192c-4884-8d6f-404e56f5f5c6", "tag": "fd4fec0e-5d6e-4cab-939d-14cb92475896"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:48:00.795318 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-1563d655-7741-4964-8e8c-88f3b6cb40b2 req-e2df92d9-a988-40f1-ba17-89c5412f8e40 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:48:00.795863 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-1563d655-7741-4964-8e8c-88f3b6cb40b2 req-e2df92d9-a988-40f1-ba17-89c5412f8e40 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:48:00.796713 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-1563d655-7741-4964-8e8c-88f3b6cb40b2 req-e2df92d9-a988-40f1-ba17-89c5412f8e40 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:48:00.809174 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-1563d655-7741-4964-8e8c-88f3b6cb40b2 req-e2df92d9-a988-40f1-ba17-89c5412f8e40 service nova] Creating event network-changed:fd4fec0e-5d6e-4cab-939d-14cb92475896 for instance a141c739-192c-4884-8d6f-404e56f5f5c6 on n-h1-852278-4 Aug 27 03:48:00.815626 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-1563d655-7741-4964-8e8c-88f3b6cb40b2 req-e2df92d9-a988-40f1-ba17-89c5412f8e40 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043146 Aug 27 03:48:00.816248 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3403/6853] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:48:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:48:01.876218 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-78b87b10-5c7c-4720-9945-b7b300c7049e tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1377544806"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:48:01.876804 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-78b87b10-5c7c-4720-9945-b7b300c7049e tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] [instance: a141c739-192c-4884-8d6f-404e56f5f5c6] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:48:01.883799 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-78b87b10-5c7c-4720-9945-b7b300c7049e tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:48:01.884331 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-78b87b10-5c7c-4720-9945-b7b300c7049e tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:48:01.884778 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-78b87b10-5c7c-4720-9945-b7b300c7049e tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:48:01.885500 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-78b87b10-5c7c-4720-9945-b7b300c7049e tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:48:01.885959 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-78b87b10-5c7c-4720-9945-b7b300c7049e tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:48:01.886622 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-78b87b10-5c7c-4720-9945-b7b300c7049e tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:48:02.160917 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.network.security_group_api [None req-78b87b10-5c7c-4720-9945-b7b300c7049e tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Adding security group a681d65e-5beb-4f1f-8ef3-533ea8043464 to port fd4fec0e-5d6e-4cab-939d-14cb92475896 Aug 27 03:48:02.510564 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-78b87b10-5c7c-4720-9945-b7b300c7049e tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] 10.222.0.70 "POST /compute/v2.1/servers/a141c739-192c-4884-8d6f-404e56f5f5c6/action" status: 202 len: 0 microversion: 2.1 time: 0.638425 Aug 27 03:48:02.511195 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3451/6854] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:48:01 2022] POST /compute/v2.1/servers/a141c739-192c-4884-8d6f-404e56f5f5c6/action => generated 0 bytes in 640 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:48:02.521337 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d541dcbb-38cf-44a9-ba08-03641f423860 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:02.522039 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d541dcbb-38cf-44a9-ba08-03641f423860 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] [instance: a141c739-192c-4884-8d6f-404e56f5f5c6] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:48:02.529778 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d541dcbb-38cf-44a9-ba08-03641f423860 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:48:02.530257 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d541dcbb-38cf-44a9-ba08-03641f423860 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:48:02.530723 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d541dcbb-38cf-44a9-ba08-03641f423860 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:48:02.531451 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d541dcbb-38cf-44a9-ba08-03641f423860 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:48:02.532583 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d541dcbb-38cf-44a9-ba08-03641f423860 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:48:02.533321 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d541dcbb-38cf-44a9-ba08-03641f423860 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:48:02.752166 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-d541dcbb-38cf-44a9-ba08-03641f423860 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45a1d70add54293919369e7d34bd460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06da7a8a5fe84931beb76182a8072fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:48:02.761568 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d541dcbb-38cf-44a9-ba08-03641f423860 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] 10.222.0.70 "GET /compute/v2.1/servers/a141c739-192c-4884-8d6f-404e56f5f5c6" status: 200 len: 1760 microversion: 2.1 time: 0.245714 Aug 27 03:48:02.762311 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3404/6855] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:48:02 2022] GET /compute/v2.1/servers/a141c739-192c-4884-8d6f-404e56f5f5c6 => generated 1760 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:48:02.835579 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-842bc77d-7747-42e1-8b27-91fe3c7986d0 req-b16e8c05-7682-4295-8aa9-1762db7fa904 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a141c739-192c-4884-8d6f-404e56f5f5c6", "tag": "fd4fec0e-5d6e-4cab-939d-14cb92475896"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:48:02.843812 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-842bc77d-7747-42e1-8b27-91fe3c7986d0 req-b16e8c05-7682-4295-8aa9-1762db7fa904 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:48:02.844492 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-842bc77d-7747-42e1-8b27-91fe3c7986d0 req-b16e8c05-7682-4295-8aa9-1762db7fa904 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:48:02.844937 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-842bc77d-7747-42e1-8b27-91fe3c7986d0 req-b16e8c05-7682-4295-8aa9-1762db7fa904 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:48:02.857862 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-842bc77d-7747-42e1-8b27-91fe3c7986d0 req-b16e8c05-7682-4295-8aa9-1762db7fa904 service nova] Creating event network-changed:fd4fec0e-5d6e-4cab-939d-14cb92475896 for instance a141c739-192c-4884-8d6f-404e56f5f5c6 on n-h1-852278-4 Aug 27 03:48:02.863440 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-842bc77d-7747-42e1-8b27-91fe3c7986d0 req-b16e8c05-7682-4295-8aa9-1762db7fa904 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034590 Aug 27 03:48:02.864051 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3452/6856] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:48:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:49:40.334736 n-d-852278-4 devstack@n-api.service[134052]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9851ddbb-a5ae-40a5-a271-3fff08a3a780] AMQP server on 10.222.0.70:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 03:49:40.335899 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=4 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:49:40.337522 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=8 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:49:40.341855 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8b86d960-6b40-43e6-b6cf-6302c8c466f5 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:49:40.344362 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-8b86d960-6b40-43e6-b6cf-6302c8c466f5 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] [instance: a141c739-192c-4884-8d6f-404e56f5f5c6] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:49:40.351883 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8b86d960-6b40-43e6-b6cf-6302c8c466f5 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:49:40.352399 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8b86d960-6b40-43e6-b6cf-6302c8c466f5 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:49:40.352838 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8b86d960-6b40-43e6-b6cf-6302c8c466f5 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:49:40.353557 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8b86d960-6b40-43e6-b6cf-6302c8c466f5 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:49:40.354009 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8b86d960-6b40-43e6-b6cf-6302c8c466f5 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:49:40.354433 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8b86d960-6b40-43e6-b6cf-6302c8c466f5 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:49:40.443297 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-8b86d960-6b40-43e6-b6cf-6302c8c466f5 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] 10.222.0.70 "POST /compute/v2.1/servers/a141c739-192c-4884-8d6f-404e56f5f5c6/action" status: 202 len: 0 microversion: 2.1 time: 0.110433 Aug 27 03:49:40.444159 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3405/6857] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:49:40 2022] POST /compute/v2.1/servers/a141c739-192c-4884-8d6f-404e56f5f5c6/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:49:40.456056 n-d-852278-4 devstack@n-api.service[134051]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f9fac4be-af37-4094-9325-9fb8d6a54e45] AMQP server on 10.222.0.70:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 27 03:49:40.457128 n-d-852278-4 devstack@n-api.service[134051]: ERROR oslo.messaging._drivers.impl_rabbit [-] [467acb70-6ff8-442b-874d-8e7c3cdab9ba] AMQP server on 10.222.0.70:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 27 03:49:40.457721 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=6 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:49:40.458508 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=12 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:49:40.459277 n-d-852278-4 devstack@n-api.service[134051]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:49:40.465015 n-d-852278-4 devstack@n-api.service[134051]: Sat Aug 27 03:49:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a141c739-192c-4884-8d6f-404e56f5f5c6 (ip 10.222.0.70) !!! Aug 27 03:49:40.474360 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-da819ca2-4a07-4848-9834-b3bb4d4ab318 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:49:40.475127 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-da819ca2-4a07-4848-9834-b3bb4d4ab318 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] [instance: a141c739-192c-4884-8d6f-404e56f5f5c6] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:49:40.485847 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-da819ca2-4a07-4848-9834-b3bb4d4ab318 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:49:40.486354 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-da819ca2-4a07-4848-9834-b3bb4d4ab318 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:49:40.486808 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-da819ca2-4a07-4848-9834-b3bb4d4ab318 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:49:40.487584 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-da819ca2-4a07-4848-9834-b3bb4d4ab318 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:49:40.488053 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-da819ca2-4a07-4848-9834-b3bb4d4ab318 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:49:40.488526 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-da819ca2-4a07-4848-9834-b3bb4d4ab318 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:49:40.701883 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-da819ca2-4a07-4848-9834-b3bb4d4ab318 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45a1d70add54293919369e7d34bd460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06da7a8a5fe84931beb76182a8072fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:49:40.711933 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-da819ca2-4a07-4848-9834-b3bb4d4ab318 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] 10.222.0.70 "GET /compute/v2.1/servers/a141c739-192c-4884-8d6f-404e56f5f5c6" status: 200 len: 1762 microversion: 2.1 time: 0.263140 Aug 27 03:49:40.712746 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3453/6858] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:49:40 2022] GET /compute/v2.1/servers/a141c739-192c-4884-8d6f-404e56f5f5c6 => generated 1762 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:49:41.730850 n-d-852278-4 devstack@n-api.service[134052]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:49:41.731424 n-d-852278-4 devstack@n-api.service[134052]: Sat Aug 27 03:49:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a141c739-192c-4884-8d6f-404e56f5f5c6 (ip 10.222.0.70) !!! Aug 27 03:49:41.736454 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-96da7fad-098b-4b9c-bc0b-73151f833890 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:49:41.737183 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-96da7fad-098b-4b9c-bc0b-73151f833890 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] [instance: a141c739-192c-4884-8d6f-404e56f5f5c6] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:49:41.745970 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-96da7fad-098b-4b9c-bc0b-73151f833890 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:49:41.746457 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-96da7fad-098b-4b9c-bc0b-73151f833890 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:49:41.746893 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-96da7fad-098b-4b9c-bc0b-73151f833890 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:49:41.747598 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-96da7fad-098b-4b9c-bc0b-73151f833890 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:49:41.748048 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-96da7fad-098b-4b9c-bc0b-73151f833890 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:49:41.748503 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-96da7fad-098b-4b9c-bc0b-73151f833890 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:49:41.757413 n-d-852278-4 devstack@n-api.service[134052]: INFO oslo.messaging._drivers.impl_rabbit [-] [9851ddbb-a5ae-40a5-a271-3fff08a3a780] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 57790. Aug 27 03:49:41.902256 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-96da7fad-098b-4b9c-bc0b-73151f833890 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45a1d70add54293919369e7d34bd460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06da7a8a5fe84931beb76182a8072fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:49:41.911277 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-96da7fad-098b-4b9c-bc0b-73151f833890 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] 10.222.0.70 "GET /compute/v2.1/servers/a141c739-192c-4884-8d6f-404e56f5f5c6" status: 200 len: 1760 microversion: 2.1 time: 0.181949 Aug 27 03:49:41.911882 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3406/6859] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:49:41 2022] GET /compute/v2.1/servers/a141c739-192c-4884-8d6f-404e56f5f5c6 => generated 1760 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:50:55.705234 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:50:55.706051 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=6 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:50:55.714894 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-1a5d8ec0-ab49-4eec-92ab-7d36b9b04ea5 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1377544806"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:50:55.715451 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-1a5d8ec0-ab49-4eec-92ab-7d36b9b04ea5 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] [instance: a141c739-192c-4884-8d6f-404e56f5f5c6] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:50:55.723827 n-d-852278-4 devstack@n-api.service[134051]: INFO oslo.messaging._drivers.impl_rabbit [-] [467acb70-6ff8-442b-874d-8e7c3cdab9ba] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 57818. Aug 27 03:50:55.739511 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1a5d8ec0-ab49-4eec-92ab-7d36b9b04ea5 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:50:55.740024 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1a5d8ec0-ab49-4eec-92ab-7d36b9b04ea5 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:50:55.740819 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1a5d8ec0-ab49-4eec-92ab-7d36b9b04ea5 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:50:55.741726 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1a5d8ec0-ab49-4eec-92ab-7d36b9b04ea5 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:50:55.742319 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1a5d8ec0-ab49-4eec-92ab-7d36b9b04ea5 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:50:55.742835 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1a5d8ec0-ab49-4eec-92ab-7d36b9b04ea5 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:50:55.743551 n-d-852278-4 devstack@n-api.service[134051]: INFO oslo.messaging._drivers.impl_rabbit [-] [f9fac4be-af37-4094-9325-9fb8d6a54e45] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 57816. Aug 27 03:50:55.894821 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.network.security_group_api [None req-1a5d8ec0-ab49-4eec-92ab-7d36b9b04ea5 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Removing security group a681d65e-5beb-4f1f-8ef3-533ea8043464 from port fd4fec0e-5d6e-4cab-939d-14cb92475896 Aug 27 03:50:56.232301 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-1a5d8ec0-ab49-4eec-92ab-7d36b9b04ea5 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] 10.222.0.70 "POST /compute/v2.1/servers/a141c739-192c-4884-8d6f-404e56f5f5c6/action" status: 202 len: 0 microversion: 2.1 time: 0.530362 Aug 27 03:50:56.233280 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3454/6860] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:50:55 2022] POST /compute/v2.1/servers/a141c739-192c-4884-8d6f-404e56f5f5c6/action => generated 0 bytes in 532 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:50:56.243776 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=4 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:50:56.244947 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:50:56.445602 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-f6061799-f23c-41bc-b9cd-aaf3ea0372ed req-ac38e2c9-dcee-4904-bce2-7587d90bfd83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a141c739-192c-4884-8d6f-404e56f5f5c6", "tag": "fd4fec0e-5d6e-4cab-939d-14cb92475896"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:50:56.464254 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-f6061799-f23c-41bc-b9cd-aaf3ea0372ed req-ac38e2c9-dcee-4904-bce2-7587d90bfd83 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:50:56.465451 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-f6061799-f23c-41bc-b9cd-aaf3ea0372ed req-ac38e2c9-dcee-4904-bce2-7587d90bfd83 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:50:56.466421 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-f6061799-f23c-41bc-b9cd-aaf3ea0372ed req-ac38e2c9-dcee-4904-bce2-7587d90bfd83 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:50:56.480384 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-f6061799-f23c-41bc-b9cd-aaf3ea0372ed req-ac38e2c9-dcee-4904-bce2-7587d90bfd83 service nova] Creating event network-changed:fd4fec0e-5d6e-4cab-939d-14cb92475896 for instance a141c739-192c-4884-8d6f-404e56f5f5c6 on n-h1-852278-4 Aug 27 03:50:56.487599 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-f6061799-f23c-41bc-b9cd-aaf3ea0372ed req-ac38e2c9-dcee-4904-bce2-7587d90bfd83 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.249712 Aug 27 03:50:56.488600 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3407/6861] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:50:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:50:57.612771 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-205e970a-5b54-4083-ace5-5779046ae544 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:50:57.613734 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-205e970a-5b54-4083-ace5-5779046ae544 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] [instance: a141c739-192c-4884-8d6f-404e56f5f5c6] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:50:57.620356 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-205e970a-5b54-4083-ace5-5779046ae544 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:50:57.621183 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-205e970a-5b54-4083-ace5-5779046ae544 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:50:57.621635 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-205e970a-5b54-4083-ace5-5779046ae544 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:50:57.622583 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-205e970a-5b54-4083-ace5-5779046ae544 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:50:57.623181 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-205e970a-5b54-4083-ace5-5779046ae544 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:50:57.623901 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-205e970a-5b54-4083-ace5-5779046ae544 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:50:57.732394 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-9b90fdb4-431a-452c-a8dd-7f47653c24dc req-12ff9aca-4c86-40e8-8a66-447ef60be20d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a141c739-192c-4884-8d6f-404e56f5f5c6", "tag": "fd4fec0e-5d6e-4cab-939d-14cb92475896"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:50:57.745520 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-9b90fdb4-431a-452c-a8dd-7f47653c24dc req-12ff9aca-4c86-40e8-8a66-447ef60be20d service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:50:57.746552 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-9b90fdb4-431a-452c-a8dd-7f47653c24dc req-12ff9aca-4c86-40e8-8a66-447ef60be20d service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:50:57.747361 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-9b90fdb4-431a-452c-a8dd-7f47653c24dc req-12ff9aca-4c86-40e8-8a66-447ef60be20d service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:50:57.748510 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.objects.instance [None req-205e970a-5b54-4083-ace5-5779046ae544 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lazy-loading 'services' on Instance uuid a141c739-192c-4884-8d6f-404e56f5f5c6 {{(pid=134051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:50:57.762388 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-9b90fdb4-431a-452c-a8dd-7f47653c24dc req-12ff9aca-4c86-40e8-8a66-447ef60be20d service nova] Creating event network-changed:fd4fec0e-5d6e-4cab-939d-14cb92475896 for instance a141c739-192c-4884-8d6f-404e56f5f5c6 on n-h1-852278-4 Aug 27 03:50:57.769317 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-9b90fdb4-431a-452c-a8dd-7f47653c24dc req-12ff9aca-4c86-40e8-8a66-447ef60be20d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103374 Aug 27 03:50:57.770837 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3408/6862] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:50:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:50:57.851164 n-d-852278-4 devstack@n-api.service[134051]: ERROR oslo.messaging._drivers.impl_rabbit [None req-205e970a-5b54-4083-ace5-5779046ae544 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] [aa8d2444-d691-469e-9f0c-7623cba8ae29] AMQP server on 10.222.0.70:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 27 03:50:58.859226 n-d-852278-4 devstack@n-api.service[134051]: INFO oslo.messaging._drivers.impl_rabbit [None req-205e970a-5b54-4083-ace5-5779046ae544 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] [aa8d2444-d691-469e-9f0c-7623cba8ae29] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 57854. Aug 27 03:50:58.862830 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-205e970a-5b54-4083-ace5-5779046ae544 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] 10.222.0.70 "DELETE /compute/v2.1/servers/a141c739-192c-4884-8d6f-404e56f5f5c6/os-volume_attachments/f6296b80-02b8-4a50-97cb-fd90643e9228" status: 202 len: 0 microversion: 2.1 time: 1.255558 Aug 27 03:50:58.863642 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3455/6863] 10.222.0.70 () {58 vars in 1416 bytes} [Sat Aug 27 03:50:57 2022] DELETE /compute/v2.1/servers/a141c739-192c-4884-8d6f-404e56f5f5c6/os-volume_attachments/f6296b80-02b8-4a50-97cb-fd90643e9228 => generated 0 bytes in 1257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 03:50:58.874287 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-17f97bb6-232b-4a92-b5c8-ac4370eb45be tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:50:58.876872 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-17f97bb6-232b-4a92-b5c8-ac4370eb45be tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] [instance: a141c739-192c-4884-8d6f-404e56f5f5c6] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:50:58.889535 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-17f97bb6-232b-4a92-b5c8-ac4370eb45be tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:50:58.890111 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-17f97bb6-232b-4a92-b5c8-ac4370eb45be tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:50:58.890537 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-17f97bb6-232b-4a92-b5c8-ac4370eb45be tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:50:58.891242 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-17f97bb6-232b-4a92-b5c8-ac4370eb45be tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:50:58.891683 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-17f97bb6-232b-4a92-b5c8-ac4370eb45be tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:50:58.892102 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-17f97bb6-232b-4a92-b5c8-ac4370eb45be tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:50:58.926627 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-17f97bb6-232b-4a92-b5c8-ac4370eb45be tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] 10.222.0.70 "GET /compute/v2.1/servers/a141c739-192c-4884-8d6f-404e56f5f5c6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058071 Aug 27 03:50:58.929214 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3409/6864] 10.222.0.70 () {58 vars in 1302 bytes} [Sat Aug 27 03:50:58 2022] GET /compute/v2.1/servers/a141c739-192c-4884-8d6f-404e56f5f5c6/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:50:59.942098 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-28007938-062f-4a91-b240-edeb1c5b5901 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:50:59.944888 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-28007938-062f-4a91-b240-edeb1c5b5901 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] [instance: a141c739-192c-4884-8d6f-404e56f5f5c6] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:50:59.956339 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-28007938-062f-4a91-b240-edeb1c5b5901 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:50:59.957200 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-28007938-062f-4a91-b240-edeb1c5b5901 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:50:59.957646 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-28007938-062f-4a91-b240-edeb1c5b5901 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:50:59.958370 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-28007938-062f-4a91-b240-edeb1c5b5901 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:50:59.958833 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-28007938-062f-4a91-b240-edeb1c5b5901 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:50:59.959265 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-28007938-062f-4a91-b240-edeb1c5b5901 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:50:59.993542 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-28007938-062f-4a91-b240-edeb1c5b5901 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] 10.222.0.70 "GET /compute/v2.1/servers/a141c739-192c-4884-8d6f-404e56f5f5c6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057080 Aug 27 03:50:59.993542 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3456/6865] 10.222.0.70 () {58 vars in 1302 bytes} [Sat Aug 27 03:50:59 2022] GET /compute/v2.1/servers/a141c739-192c-4884-8d6f-404e56f5f5c6/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:51:01.005295 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f2047a45-b417-4af2-a7b8-251f76b4c89f tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:01.007592 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-f2047a45-b417-4af2-a7b8-251f76b4c89f tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] [instance: a141c739-192c-4884-8d6f-404e56f5f5c6] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:51:01.014731 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f2047a45-b417-4af2-a7b8-251f76b4c89f tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:01.015193 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f2047a45-b417-4af2-a7b8-251f76b4c89f tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:01.015644 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f2047a45-b417-4af2-a7b8-251f76b4c89f tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:01.016357 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f2047a45-b417-4af2-a7b8-251f76b4c89f tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:01.016777 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f2047a45-b417-4af2-a7b8-251f76b4c89f tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:01.017223 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f2047a45-b417-4af2-a7b8-251f76b4c89f tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:01.048845 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f2047a45-b417-4af2-a7b8-251f76b4c89f tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] 10.222.0.70 "GET /compute/v2.1/servers/a141c739-192c-4884-8d6f-404e56f5f5c6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047667 Aug 27 03:51:01.049422 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3410/6866] 10.222.0.70 () {58 vars in 1302 bytes} [Sat Aug 27 03:51:00 2022] GET /compute/v2.1/servers/a141c739-192c-4884-8d6f-404e56f5f5c6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:51:02.061768 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-351ad7f9-0c09-4350-837f-9d23f5b2748f tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:02.064327 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-351ad7f9-0c09-4350-837f-9d23f5b2748f tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] [instance: a141c739-192c-4884-8d6f-404e56f5f5c6] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:51:02.071836 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-351ad7f9-0c09-4350-837f-9d23f5b2748f tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:02.072343 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-351ad7f9-0c09-4350-837f-9d23f5b2748f tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:02.072863 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-351ad7f9-0c09-4350-837f-9d23f5b2748f tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:02.073603 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-351ad7f9-0c09-4350-837f-9d23f5b2748f tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:02.074080 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-351ad7f9-0c09-4350-837f-9d23f5b2748f tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:02.074517 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-351ad7f9-0c09-4350-837f-9d23f5b2748f tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:02.105249 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-351ad7f9-0c09-4350-837f-9d23f5b2748f tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] 10.222.0.70 "GET /compute/v2.1/servers/a141c739-192c-4884-8d6f-404e56f5f5c6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047632 Aug 27 03:51:02.106201 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3457/6867] 10.222.0.70 () {58 vars in 1302 bytes} [Sat Aug 27 03:51:02 2022] GET /compute/v2.1/servers/a141c739-192c-4884-8d6f-404e56f5f5c6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:51:03.118524 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f7888d9b-fe88-4ef4-9291-e1382fad70d5 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:03.120898 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-f7888d9b-fe88-4ef4-9291-e1382fad70d5 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] [instance: a141c739-192c-4884-8d6f-404e56f5f5c6] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:51:03.128057 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f7888d9b-fe88-4ef4-9291-e1382fad70d5 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:03.128576 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f7888d9b-fe88-4ef4-9291-e1382fad70d5 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:03.129079 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f7888d9b-fe88-4ef4-9291-e1382fad70d5 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:03.129792 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f7888d9b-fe88-4ef4-9291-e1382fad70d5 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:03.130239 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f7888d9b-fe88-4ef4-9291-e1382fad70d5 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:03.130661 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f7888d9b-fe88-4ef4-9291-e1382fad70d5 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:03.166110 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f7888d9b-fe88-4ef4-9291-e1382fad70d5 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] 10.222.0.70 "GET /compute/v2.1/servers/a141c739-192c-4884-8d6f-404e56f5f5c6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052541 Aug 27 03:51:03.167073 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3411/6868] 10.222.0.70 () {58 vars in 1302 bytes} [Sat Aug 27 03:51:03 2022] GET /compute/v2.1/servers/a141c739-192c-4884-8d6f-404e56f5f5c6/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:51:04.179549 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-549eb92d-458b-4bc4-a969-c05225342ed9 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:04.181883 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-549eb92d-458b-4bc4-a969-c05225342ed9 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] [instance: a141c739-192c-4884-8d6f-404e56f5f5c6] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:51:04.189289 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-549eb92d-458b-4bc4-a969-c05225342ed9 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:04.189797 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-549eb92d-458b-4bc4-a969-c05225342ed9 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:04.190249 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-549eb92d-458b-4bc4-a969-c05225342ed9 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:04.190972 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-549eb92d-458b-4bc4-a969-c05225342ed9 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:04.191485 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-549eb92d-458b-4bc4-a969-c05225342ed9 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:04.191930 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-549eb92d-458b-4bc4-a969-c05225342ed9 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:04.222381 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-549eb92d-458b-4bc4-a969-c05225342ed9 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] 10.222.0.70 "GET /compute/v2.1/servers/a141c739-192c-4884-8d6f-404e56f5f5c6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047129 Aug 27 03:51:04.222962 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3458/6869] 10.222.0.70 () {58 vars in 1302 bytes} [Sat Aug 27 03:51:04 2022] GET /compute/v2.1/servers/a141c739-192c-4884-8d6f-404e56f5f5c6/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:51:04.233606 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8ef8890a-e82a-43a2-8498-f80e38e31d40 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:04.234135 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-8ef8890a-e82a-43a2-8498-f80e38e31d40 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] [instance: a141c739-192c-4884-8d6f-404e56f5f5c6] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:51:04.241240 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8ef8890a-e82a-43a2-8498-f80e38e31d40 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:04.241727 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8ef8890a-e82a-43a2-8498-f80e38e31d40 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:04.242173 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8ef8890a-e82a-43a2-8498-f80e38e31d40 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:04.242867 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8ef8890a-e82a-43a2-8498-f80e38e31d40 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:04.243314 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8ef8890a-e82a-43a2-8498-f80e38e31d40 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:04.243737 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8ef8890a-e82a-43a2-8498-f80e38e31d40 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:04.326400 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-8ef8890a-e82a-43a2-8498-f80e38e31d40 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] HTTP exception thrown: Instance a141c739-192c-4884-8d6f-404e56f5f5c6 is not attached to volume f6296b80-02b8-4a50-97cb-fd90643e9228 Aug 27 03:51:04.328090 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8ef8890a-e82a-43a2-8498-f80e38e31d40 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Request method failure captured: Aug 27 03:51:04.328090 n-d-852278-4 devstack@n-api.service[134052]: request: DELETE /compute/v2.1/servers/a141c739-192c-4884-8d6f-404e56f5f5c6/os-volume_attachments/f6296b80-02b8-4a50-97cb-fd90643e9228 HTTP/1.1 Aug 27 03:51:04.328090 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 03:51:04.328090 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 03:51:04.328090 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 03:51:04.328090 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 03:51:04.328090 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 03:51:04.328090 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 03:51:04.328090 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 03:51:04.328090 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 03:51:04.328090 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCZO8vJlGzy2IiwoDT-3NfsAjSnZh2ozMyQr8juz9NLrHAPg4vRyyE58lRltxrtO4Ij7gAouPoYhqd2SKyvKsuCCwhD3jUJmmOLor8S8R4z9ZXATqQ19oQncxX8wP-QV-p9r9lM_O4F_QrvmUgYxfGRLDtYG6qpqWiHxfSECBBXnJTxU Aug 27 03:51:04.328090 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 03:51:04.328090 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 03:51:04.328090 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 03:51:04.328090 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 03:51:04.328090 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 03:51:04.328090 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 03:51:04.328090 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 06da7a8a5fe84931beb76182a8072fb2 Aug 27 03:51:04.328090 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-TestMinimumBasicScenario-1700299902 Aug 27 03:51:04.328090 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 03:51:04.328090 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 03:51:04.328090 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/06da7a8a5fe84931beb76182a8072fb2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_06da7a8a5fe84931beb76182a8072fb2", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/06da7a8a5fe84931beb76182a8072fb2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/06da7a8a5fe84931beb76182a8072fb2"}]}] Aug 27 03:51:04.328090 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-TestMinimumBasicScenario-1700299902 Aug 27 03:51:04.328090 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 06da7a8a5fe84931beb76182a8072fb2 Aug 27 03:51:04.328090 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1700299902 Aug 27 03:51:04.328090 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-TestMinimumBasicScenario-1700299902-project Aug 27 03:51:04.328090 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 03:51:04.328090 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 03:51:04.328090 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: f45a1d70add54293919369e7d34bd460 Aug 27 03:51:04.328090 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-TestMinimumBasicScenario-1700299902-project Aug 27 03:51:04.328090 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 03:51:04.328090 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance a141c739-192c-4884-8d6f-404e56f5f5c6 is not attached to volume f6296b80-02b8-4a50-97cb-fd90643e9228 Aug 27 03:51:04.328090 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'server_id': 'a141c739-192c-4884-8d6f-404e56f5f5c6', 'id': 'f6296b80-02b8-4a50-97cb-fd90643e9228'} Aug 27 03:51:04.328090 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:51:04.328090 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:51:04.328090 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 27 03:51:04.328090 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 27 03:51:04.328090 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 03:51:04.328090 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 03:51:04.328090 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 27 03:51:04.328090 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 27 03:51:04.328090 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id f6296b80-02b8-4a50-97cb-fd90643e9228. Aug 27 03:51:04.328090 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:51:04.328090 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:51:04.328090 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:51:04.328090 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:51:04.328090 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:51:04.328090 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:51:04.328090 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:51:04.328090 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:51:04.328090 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:51:04.328090 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:51:04.328090 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 27 03:51:04.328090 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 27 03:51:04.328090 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a141c739-192c-4884-8d6f-404e56f5f5c6 is not attached to volume f6296b80-02b8-4a50-97cb-fd90643e9228 Aug 27 03:51:04.328090 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:51:04.328090 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:51:04.328090 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:51:04.328090 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:51:04.328090 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:51:04.328090 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:51:04.331842 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:51:04.331842 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:51:04.331842 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a141c739-192c-4884-8d6f-404e56f5f5c6 is not attached to volume f6296b80-02b8-4a50-97cb-fd90643e9228 Aug 27 03:51:04.331842 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:51:04.331842 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8ef8890a-e82a-43a2-8498-f80e38e31d40 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Returning 404 to user: Instance a141c739-192c-4884-8d6f-404e56f5f5c6 is not attached to volume f6296b80-02b8-4a50-97cb-fd90643e9228 {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:51:04.331842 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-8ef8890a-e82a-43a2-8498-f80e38e31d40 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] 10.222.0.70 "DELETE /compute/v2.1/servers/a141c739-192c-4884-8d6f-404e56f5f5c6/os-volume_attachments/f6296b80-02b8-4a50-97cb-fd90643e9228" status: 404 len: 154 microversion: 2.1 time: 0.100258 Aug 27 03:51:04.331842 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3412/6870] 10.222.0.70 () {58 vars in 1416 bytes} [Sat Aug 27 03:51:04 2022] DELETE /compute/v2.1/servers/a141c739-192c-4884-8d6f-404e56f5f5c6/os-volume_attachments/f6296b80-02b8-4a50-97cb-fd90643e9228 => generated 154 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 03:51:07.589080 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4452ede2-027f-45f7-aa16-47beb60593f8 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:07.589641 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-4452ede2-027f-45f7-aa16-47beb60593f8 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] [instance: a141c739-192c-4884-8d6f-404e56f5f5c6] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:51:07.597056 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4452ede2-027f-45f7-aa16-47beb60593f8 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:07.597706 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4452ede2-027f-45f7-aa16-47beb60593f8 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:07.598169 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4452ede2-027f-45f7-aa16-47beb60593f8 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:07.598901 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4452ede2-027f-45f7-aa16-47beb60593f8 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:07.599377 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4452ede2-027f-45f7-aa16-47beb60593f8 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:07.599817 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4452ede2-027f-45f7-aa16-47beb60593f8 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:07.627029 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-4452ede2-027f-45f7-aa16-47beb60593f8 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] [instance: a141c739-192c-4884-8d6f-404e56f5f5c6] Going to try to terminate instance {{(pid=134051) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:51:07.726631 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-4452ede2-027f-45f7-aa16-47beb60593f8 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] 10.222.0.70 "DELETE /compute/v2.1/servers/a141c739-192c-4884-8d6f-404e56f5f5c6" status: 204 len: 0 microversion: 2.1 time: 0.141466 Aug 27 03:51:07.727626 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3459/6871] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 03:51:07 2022] DELETE /compute/v2.1/servers/a141c739-192c-4884-8d6f-404e56f5f5c6 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:51:07.735836 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-09806e05-e0ad-4a3b-9fdf-337727809e5e tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:07.736490 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-09806e05-e0ad-4a3b-9fdf-337727809e5e tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] [instance: a141c739-192c-4884-8d6f-404e56f5f5c6] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:51:07.744389 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-09806e05-e0ad-4a3b-9fdf-337727809e5e tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:07.745032 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-09806e05-e0ad-4a3b-9fdf-337727809e5e tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:07.745310 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-09806e05-e0ad-4a3b-9fdf-337727809e5e tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:07.746214 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-09806e05-e0ad-4a3b-9fdf-337727809e5e tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:07.746691 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-09806e05-e0ad-4a3b-9fdf-337727809e5e tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:07.747117 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-09806e05-e0ad-4a3b-9fdf-337727809e5e tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:07.892843 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-09806e05-e0ad-4a3b-9fdf-337727809e5e tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45a1d70add54293919369e7d34bd460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06da7a8a5fe84931beb76182a8072fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:51:07.901782 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-09806e05-e0ad-4a3b-9fdf-337727809e5e tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] 10.222.0.70 "GET /compute/v2.1/servers/a141c739-192c-4884-8d6f-404e56f5f5c6" status: 200 len: 1555 microversion: 2.1 time: 0.169515 Aug 27 03:51:07.902419 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3413/6872] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:51:07 2022] GET /compute/v2.1/servers/a141c739-192c-4884-8d6f-404e56f5f5c6 => generated 1555 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:51:08.935747 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c2e2e9ff-5d62-4070-a6ca-eda6671e2291 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:08.936512 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-c2e2e9ff-5d62-4070-a6ca-eda6671e2291 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] [instance: a141c739-192c-4884-8d6f-404e56f5f5c6] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:51:08.943998 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c2e2e9ff-5d62-4070-a6ca-eda6671e2291 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:08.944539 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c2e2e9ff-5d62-4070-a6ca-eda6671e2291 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:08.944999 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c2e2e9ff-5d62-4070-a6ca-eda6671e2291 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:08.945828 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c2e2e9ff-5d62-4070-a6ca-eda6671e2291 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:08.946357 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c2e2e9ff-5d62-4070-a6ca-eda6671e2291 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:08.946832 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c2e2e9ff-5d62-4070-a6ca-eda6671e2291 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:09.099797 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-c2e2e9ff-5d62-4070-a6ca-eda6671e2291 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45a1d70add54293919369e7d34bd460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06da7a8a5fe84931beb76182a8072fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:51:09.108268 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c2e2e9ff-5d62-4070-a6ca-eda6671e2291 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] 10.222.0.70 "GET /compute/v2.1/servers/a141c739-192c-4884-8d6f-404e56f5f5c6" status: 200 len: 1555 microversion: 2.1 time: 0.177110 Aug 27 03:51:09.108942 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3460/6873] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:51:08 2022] GET /compute/v2.1/servers/a141c739-192c-4884-8d6f-404e56f5f5c6 => generated 1555 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:51:09.904322 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-6e367638-e42d-4f6a-9861-5182ffd56467 req-00d9d268-6203-49a1-b93b-6c6d1f9b1143 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a141c739-192c-4884-8d6f-404e56f5f5c6", "name": "network-vif-deleted", "tag": "fd4fec0e-5d6e-4cab-939d-14cb92475896"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:51:09.916058 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-6e367638-e42d-4f6a-9861-5182ffd56467 req-00d9d268-6203-49a1-b93b-6c6d1f9b1143 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:09.916592 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-6e367638-e42d-4f6a-9861-5182ffd56467 req-00d9d268-6203-49a1-b93b-6c6d1f9b1143 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:09.917030 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-6e367638-e42d-4f6a-9861-5182ffd56467 req-00d9d268-6203-49a1-b93b-6c6d1f9b1143 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:09.929993 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-6e367638-e42d-4f6a-9861-5182ffd56467 req-00d9d268-6203-49a1-b93b-6c6d1f9b1143 service nova] Creating event network-vif-deleted:fd4fec0e-5d6e-4cab-939d-14cb92475896 for instance a141c739-192c-4884-8d6f-404e56f5f5c6 on n-h1-852278-4 Aug 27 03:51:09.936001 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-6e367638-e42d-4f6a-9861-5182ffd56467 req-00d9d268-6203-49a1-b93b-6c6d1f9b1143 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035629 Aug 27 03:51:09.936594 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3414/6874] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:51:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:51:10.130195 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-387b9de0-8e73-4c38-a74d-2bb0164320bf tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:10.130834 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-387b9de0-8e73-4c38-a74d-2bb0164320bf tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] [instance: a141c739-192c-4884-8d6f-404e56f5f5c6] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:51:10.138476 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-387b9de0-8e73-4c38-a74d-2bb0164320bf tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:10.139026 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-387b9de0-8e73-4c38-a74d-2bb0164320bf tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:10.139454 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-387b9de0-8e73-4c38-a74d-2bb0164320bf tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:10.140193 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-387b9de0-8e73-4c38-a74d-2bb0164320bf tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:10.140702 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-387b9de0-8e73-4c38-a74d-2bb0164320bf tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:10.141149 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-387b9de0-8e73-4c38-a74d-2bb0164320bf tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:10.177046 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-387b9de0-8e73-4c38-a74d-2bb0164320bf tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:10.177564 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-387b9de0-8e73-4c38-a74d-2bb0164320bf tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:10.178024 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-387b9de0-8e73-4c38-a74d-2bb0164320bf tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:10.178497 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.objects.instance [None req-387b9de0-8e73-4c38-a74d-2bb0164320bf tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lazy-loading 'fault' on Instance uuid a141c739-192c-4884-8d6f-404e56f5f5c6 {{(pid=134051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:51:10.230019 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-387b9de0-8e73-4c38-a74d-2bb0164320bf tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45a1d70add54293919369e7d34bd460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06da7a8a5fe84931beb76182a8072fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:51:10.238760 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-387b9de0-8e73-4c38-a74d-2bb0164320bf tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] 10.222.0.70 "GET /compute/v2.1/servers/a141c739-192c-4884-8d6f-404e56f5f5c6" status: 200 len: 1348 microversion: 2.1 time: 0.112568 Aug 27 03:51:10.239363 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3461/6875] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:51:10 2022] GET /compute/v2.1/servers/a141c739-192c-4884-8d6f-404e56f5f5c6 => generated 1348 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:51:11.262841 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-85e8bf06-6c6f-4657-b38d-e24affab58fc tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:11.263479 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-85e8bf06-6c6f-4657-b38d-e24affab58fc tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] [instance: a141c739-192c-4884-8d6f-404e56f5f5c6] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:51:11.270166 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-85e8bf06-6c6f-4657-b38d-e24affab58fc tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:11.270642 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-85e8bf06-6c6f-4657-b38d-e24affab58fc tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:11.271077 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-85e8bf06-6c6f-4657-b38d-e24affab58fc tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:11.271774 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-85e8bf06-6c6f-4657-b38d-e24affab58fc tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:11.272223 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-85e8bf06-6c6f-4657-b38d-e24affab58fc tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:11.272681 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-85e8bf06-6c6f-4657-b38d-e24affab58fc tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:11.286895 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-85e8bf06-6c6f-4657-b38d-e24affab58fc tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] HTTP exception thrown: Instance a141c739-192c-4884-8d6f-404e56f5f5c6 could not be found. Aug 27 03:51:11.288634 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-85e8bf06-6c6f-4657-b38d-e24affab58fc tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Request method failure captured: Aug 27 03:51:11.288634 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/servers/a141c739-192c-4884-8d6f-404e56f5f5c6 HTTP/1.1 Aug 27 03:51:11.288634 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 03:51:11.288634 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 03:51:11.288634 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 03:51:11.288634 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 03:51:11.288634 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 03:51:11.288634 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 03:51:11.288634 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 03:51:11.288634 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 03:51:11.288634 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCZO8vJlGzy2IiwoDT-3NfsAjSnZh2ozMyQr8juz9NLrHAPg4vRyyE58lRltxrtO4Ij7gAouPoYhqd2SKyvKsuCCwhD3jUJmmOLor8S8R4z9ZXATqQ19oQncxX8wP-QV-p9r9lM_O4F_QrvmUgYxfGRLDtYG6qpqWiHxfSECBBXnJTxU Aug 27 03:51:11.288634 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 03:51:11.288634 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 03:51:11.288634 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 03:51:11.288634 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 03:51:11.288634 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 03:51:11.288634 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 03:51:11.288634 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 06da7a8a5fe84931beb76182a8072fb2 Aug 27 03:51:11.288634 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-TestMinimumBasicScenario-1700299902 Aug 27 03:51:11.288634 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 03:51:11.288634 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 03:51:11.288634 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/06da7a8a5fe84931beb76182a8072fb2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_06da7a8a5fe84931beb76182a8072fb2", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/06da7a8a5fe84931beb76182a8072fb2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/06da7a8a5fe84931beb76182a8072fb2"}]}] Aug 27 03:51:11.288634 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-TestMinimumBasicScenario-1700299902 Aug 27 03:51:11.288634 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 06da7a8a5fe84931beb76182a8072fb2 Aug 27 03:51:11.288634 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1700299902 Aug 27 03:51:11.288634 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-TestMinimumBasicScenario-1700299902-project Aug 27 03:51:11.288634 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 03:51:11.288634 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 03:51:11.288634 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: f45a1d70add54293919369e7d34bd460 Aug 27 03:51:11.288634 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-TestMinimumBasicScenario-1700299902-project Aug 27 03:51:11.288634 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 03:51:11.288634 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance a141c739-192c-4884-8d6f-404e56f5f5c6 could not be found. Aug 27 03:51:11.288634 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': 'a141c739-192c-4884-8d6f-404e56f5f5c6'} Aug 27 03:51:11.288634 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:51:11.288634 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:51:11.288634 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:51:11.288634 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:51:11.288634 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:51:11.288634 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:51:11.288634 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:51:11.288634 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:51:11.288634 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:51:11.288634 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:51:11.288634 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a141c739-192c-4884-8d6f-404e56f5f5c6 could not be found. Aug 27 03:51:11.288634 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:51:11.288634 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:51:11.288634 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:51:11.288634 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:51:11.288634 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:51:11.288634 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:51:11.288634 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:51:11.288634 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:51:11.288634 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:51:11.288634 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:51:11.288634 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:51:11.288634 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:51:11.288634 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:51:11.288634 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:51:11.288634 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:51:11.288634 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:51:11.288634 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a141c739-192c-4884-8d6f-404e56f5f5c6 could not be found. Aug 27 03:51:11.288634 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:51:11.288634 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:51:11.288634 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:51:11.293244 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:51:11.293244 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:51:11.293244 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:51:11.293244 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:51:11.293244 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:51:11.293244 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a141c739-192c-4884-8d6f-404e56f5f5c6 could not be found. Aug 27 03:51:11.293244 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 03:51:11.293244 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-85e8bf06-6c6f-4657-b38d-e24affab58fc tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Returning 404 to user: Instance a141c739-192c-4884-8d6f-404e56f5f5c6 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:51:11.293244 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-85e8bf06-6c6f-4657-b38d-e24affab58fc tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] 10.222.0.70 "GET /compute/v2.1/servers/a141c739-192c-4884-8d6f-404e56f5f5c6" status: 404 len: 111 microversion: 2.1 time: 0.032627 Aug 27 03:51:11.293244 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3415/6876] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:51:11 2022] GET /compute/v2.1/servers/a141c739-192c-4884-8d6f-404e56f5f5c6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:51:11.299471 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-aa0cd720-f31f-4076-820d-0bb4e6cf1598 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Calling method '.version_select at 0x7f5ede981d30>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:11.304144 n-d-852278-4 devstack@n-api.service[134051]: ERROR oslo.messaging._drivers.impl_rabbit [None req-aa0cd720-f31f-4076-820d-0bb4e6cf1598 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] [f1aafa46-37af-4041-a1e3-3fd9730c0ab1] AMQP server on 10.222.0.70:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 27 03:51:12.313903 n-d-852278-4 devstack@n-api.service[134051]: INFO oslo.messaging._drivers.impl_rabbit [None req-aa0cd720-f31f-4076-820d-0bb4e6cf1598 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] [f1aafa46-37af-4041-a1e3-3fd9730c0ab1] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 57896. Aug 27 03:51:12.340726 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-aa0cd720-f31f-4076-820d-0bb4e6cf1598 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-856776613" status: 202 len: 0 microversion: 2.1 time: 1.045389 Aug 27 03:51:12.341349 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3462/6877] 10.222.0.70 () {58 vars in 1269 bytes} [Sat Aug 27 03:51:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-856776613 => generated 0 bytes in 1047 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 03:51:21.522191 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-1285eed3-bc9e-4cca-aeb2-6cba31ff5e1d tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Action: 'create', calling method: .version_select at 0x7f5ee24ddca0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-853938900", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOKoyklgsU3slNEAZgpU1PhnBGEInnIkkn1Y4UWvUXNCST+aHkPIsdk7Y6S7m8wU8aovaprKcmjnNd+x//km/3KmQas/4bj9lsD0PMWuqM/XP336Ou7LKikQxOmdbBcZqg=="}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:51:21.528732 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=18 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:51:21.529397 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=38 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:51:21.541761 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-1285eed3-bc9e-4cca-aeb2-6cba31ff5e1d tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Getting quotas for project 06da7a8a5fe84931beb76182a8072fb2. Resources: {'key_pairs'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:51:21.548559 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-1285eed3-bc9e-4cca-aeb2-6cba31ff5e1d tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Getting quotas for user f45a1d70add54293919369e7d34bd460 and project 06da7a8a5fe84931beb76182a8072fb2. Resources: {'key_pairs'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:51:21.581046 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-1285eed3-bc9e-4cca-aeb2-6cba31ff5e1d tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.063674 Aug 27 03:51:21.581776 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3416/6878] 10.222.0.70 () {60 vars in 1159 bytes} [Sat Aug 27 03:51:21 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:51:21.638124 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=59,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:51:21.643705 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d394e406-0e2d-4baf-aca0-ebf8b8cd150b tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-574681347", "imageRef": "79ef28bf-0d7f-42e9-acf0-848e9d7eedc3", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-853938900", "networks": [{"uuid": "18a1b180-7959-4fb8-a73c-cb7e9b6d8bae"}]}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:51:21.706171 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.network.neutron [None req-d394e406-0e2d-4baf-aca0-ebf8b8cd150b tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] validate_networks() for [('18a1b180-7959-4fb8-a73c-cb7e9b6d8bae', None, None, None, None, None)] {{(pid=134051) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:51:22.186324 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-d394e406-0e2d-4baf-aca0-ebf8b8cd150b tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Flavor limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:51:22.186822 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-d394e406-0e2d-4baf-aca0-ebf8b8cd150b tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Image limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:51:22.187337 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-d394e406-0e2d-4baf-aca0-ebf8b8cd150b tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Flavor pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:51:22.187768 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-d394e406-0e2d-4baf-aca0-ebf8b8cd150b tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Image pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:51:22.188200 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-d394e406-0e2d-4baf-aca0-ebf8b8cd150b tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:51:22.198298 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d394e406-0e2d-4baf-aca0-ebf8b8cd150b tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:22.198956 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d394e406-0e2d-4baf-aca0-ebf8b8cd150b tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:22.199487 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d394e406-0e2d-4baf-aca0-ebf8b8cd150b tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:22.200430 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d394e406-0e2d-4baf-aca0-ebf8b8cd150b tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:22.201082 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d394e406-0e2d-4baf-aca0-ebf8b8cd150b tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:22.201595 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d394e406-0e2d-4baf-aca0-ebf8b8cd150b tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:22.224150 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-d394e406-0e2d-4baf-aca0-ebf8b8cd150b tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Getting quotas for project 06da7a8a5fe84931beb76182a8072fb2. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:51:22.233099 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-d394e406-0e2d-4baf-aca0-ebf8b8cd150b tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Getting quotas for user f45a1d70add54293919369e7d34bd460 and project 06da7a8a5fe84931beb76182a8072fb2. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:51:22.248365 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d394e406-0e2d-4baf-aca0-ebf8b8cd150b tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Going to run 1 instances... {{(pid=134051) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:51:22.250804 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d394e406-0e2d-4baf-aca0-ebf8b8cd150b tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] [instance: 9b4e4b65-ac0b-47ad-b700-50b70e099fdf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='79ef28bf-0d7f-42e9-acf0-848e9d7eedc3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134051) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:51:22.306504 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d394e406-0e2d-4baf-aca0-ebf8b8cd150b tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.670237 Aug 27 03:51:22.307585 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3463/6879] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 03:51:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 672 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:51:22.323753 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-cefe1873-a77f-42af-ad33-fbcd9a52bbbe tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:22.324510 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-cefe1873-a77f-42af-ad33-fbcd9a52bbbe tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] [instance: 9b4e4b65-ac0b-47ad-b700-50b70e099fdf] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:51:22.390928 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-cefe1873-a77f-42af-ad33-fbcd9a52bbbe tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45a1d70add54293919369e7d34bd460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06da7a8a5fe84931beb76182a8072fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:51:22.402051 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-cefe1873-a77f-42af-ad33-fbcd9a52bbbe tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] 10.222.0.70 "GET /compute/v2.1/servers/9b4e4b65-ac0b-47ad-b700-50b70e099fdf" status: 200 len: 1257 microversion: 2.1 time: 0.082667 Aug 27 03:51:22.402921 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3417/6880] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:51:22 2022] GET /compute/v2.1/servers/9b4e4b65-ac0b-47ad-b700-50b70e099fdf => generated 1257 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:51:23.426446 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-31bd0d69-b37f-49db-8ad9-51e3d1bbb026 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:23.427560 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-31bd0d69-b37f-49db-8ad9-51e3d1bbb026 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] [instance: 9b4e4b65-ac0b-47ad-b700-50b70e099fdf] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:51:23.485233 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-31bd0d69-b37f-49db-8ad9-51e3d1bbb026 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45a1d70add54293919369e7d34bd460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06da7a8a5fe84931beb76182a8072fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:51:23.503882 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-31bd0d69-b37f-49db-8ad9-51e3d1bbb026 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] 10.222.0.70 "GET /compute/v2.1/servers/9b4e4b65-ac0b-47ad-b700-50b70e099fdf" status: 200 len: 1257 microversion: 2.1 time: 0.082492 Aug 27 03:51:23.504871 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3464/6881] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:51:23 2022] GET /compute/v2.1/servers/9b4e4b65-ac0b-47ad-b700-50b70e099fdf => generated 1257 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:51:24.531428 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4142251e-fc52-4e27-8c56-6907fee9b738 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:24.532030 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-4142251e-fc52-4e27-8c56-6907fee9b738 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] [instance: 9b4e4b65-ac0b-47ad-b700-50b70e099fdf] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:51:24.597935 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-4142251e-fc52-4e27-8c56-6907fee9b738 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45a1d70add54293919369e7d34bd460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06da7a8a5fe84931beb76182a8072fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:51:24.608461 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-4142251e-fc52-4e27-8c56-6907fee9b738 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] 10.222.0.70 "GET /compute/v2.1/servers/9b4e4b65-ac0b-47ad-b700-50b70e099fdf" status: 200 len: 1257 microversion: 2.1 time: 0.082154 Aug 27 03:51:24.609082 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3418/6882] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:51:24 2022] GET /compute/v2.1/servers/9b4e4b65-ac0b-47ad-b700-50b70e099fdf => generated 1257 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:51:25.632842 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-010218af-2c35-4fb2-97c3-cb70c3387400 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:25.634031 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-010218af-2c35-4fb2-97c3-cb70c3387400 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] [instance: 9b4e4b65-ac0b-47ad-b700-50b70e099fdf] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:51:25.693714 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-010218af-2c35-4fb2-97c3-cb70c3387400 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45a1d70add54293919369e7d34bd460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06da7a8a5fe84931beb76182a8072fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:51:25.701182 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-010218af-2c35-4fb2-97c3-cb70c3387400 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] 10.222.0.70 "GET /compute/v2.1/servers/9b4e4b65-ac0b-47ad-b700-50b70e099fdf" status: 200 len: 1257 microversion: 2.1 time: 0.072970 Aug 27 03:51:25.701771 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3465/6883] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:51:25 2022] GET /compute/v2.1/servers/9b4e4b65-ac0b-47ad-b700-50b70e099fdf => generated 1257 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:51:26.722589 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9bba8cfe-88e3-4c44-bd74-9042fb3f982a tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:26.723168 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-9bba8cfe-88e3-4c44-bd74-9042fb3f982a tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] [instance: 9b4e4b65-ac0b-47ad-b700-50b70e099fdf] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:51:26.734152 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9bba8cfe-88e3-4c44-bd74-9042fb3f982a tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:26.734645 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9bba8cfe-88e3-4c44-bd74-9042fb3f982a tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:26.735081 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9bba8cfe-88e3-4c44-bd74-9042fb3f982a tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:26.735795 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9bba8cfe-88e3-4c44-bd74-9042fb3f982a tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:26.736249 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9bba8cfe-88e3-4c44-bd74-9042fb3f982a tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:26.736702 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9bba8cfe-88e3-4c44-bd74-9042fb3f982a tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:26.803375 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-9bba8cfe-88e3-4c44-bd74-9042fb3f982a tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45a1d70add54293919369e7d34bd460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06da7a8a5fe84931beb76182a8072fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:51:26.811924 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9bba8cfe-88e3-4c44-bd74-9042fb3f982a tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] 10.222.0.70 "GET /compute/v2.1/servers/9b4e4b65-ac0b-47ad-b700-50b70e099fdf" status: 200 len: 1261 microversion: 2.1 time: 0.093369 Aug 27 03:51:26.812556 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3419/6884] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:51:26 2022] GET /compute/v2.1/servers/9b4e4b65-ac0b-47ad-b700-50b70e099fdf => generated 1261 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:51:27.833356 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-550f9663-0ecf-47ce-bc58-e495fb512c51 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:27.834044 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-550f9663-0ecf-47ce-bc58-e495fb512c51 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] [instance: 9b4e4b65-ac0b-47ad-b700-50b70e099fdf] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:51:27.836239 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:51:27.843721 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-550f9663-0ecf-47ce-bc58-e495fb512c51 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:27.844208 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-550f9663-0ecf-47ce-bc58-e495fb512c51 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:27.845000 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-550f9663-0ecf-47ce-bc58-e495fb512c51 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:27.845838 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-550f9663-0ecf-47ce-bc58-e495fb512c51 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:27.846373 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-550f9663-0ecf-47ce-bc58-e495fb512c51 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:27.846884 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-550f9663-0ecf-47ce-bc58-e495fb512c51 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:27.951103 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-550f9663-0ecf-47ce-bc58-e495fb512c51 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45a1d70add54293919369e7d34bd460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06da7a8a5fe84931beb76182a8072fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:51:27.959828 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-550f9663-0ecf-47ce-bc58-e495fb512c51 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] 10.222.0.70 "GET /compute/v2.1/servers/9b4e4b65-ac0b-47ad-b700-50b70e099fdf" status: 200 len: 1315 microversion: 2.1 time: 0.130345 Aug 27 03:51:27.960460 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3466/6885] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:51:27 2022] GET /compute/v2.1/servers/9b4e4b65-ac0b-47ad-b700-50b70e099fdf => generated 1315 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:51:28.982861 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-2a642560-b41d-42a1-8ec8-439c21e756c8 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:28.983534 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-2a642560-b41d-42a1-8ec8-439c21e756c8 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] [instance: 9b4e4b65-ac0b-47ad-b700-50b70e099fdf] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:51:28.992354 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2a642560-b41d-42a1-8ec8-439c21e756c8 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:28.992924 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2a642560-b41d-42a1-8ec8-439c21e756c8 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:28.993373 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2a642560-b41d-42a1-8ec8-439c21e756c8 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:28.994102 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2a642560-b41d-42a1-8ec8-439c21e756c8 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:28.994774 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2a642560-b41d-42a1-8ec8-439c21e756c8 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:28.995241 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2a642560-b41d-42a1-8ec8-439c21e756c8 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:29.148421 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-2a642560-b41d-42a1-8ec8-439c21e756c8 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45a1d70add54293919369e7d34bd460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06da7a8a5fe84931beb76182a8072fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:51:29.156542 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-2a642560-b41d-42a1-8ec8-439c21e756c8 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] 10.222.0.70 "GET /compute/v2.1/servers/9b4e4b65-ac0b-47ad-b700-50b70e099fdf" status: 200 len: 1357 microversion: 2.1 time: 0.177795 Aug 27 03:51:29.157290 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3420/6886] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:51:28 2022] GET /compute/v2.1/servers/9b4e4b65-ac0b-47ad-b700-50b70e099fdf => generated 1357 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:51:30.179688 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-80175f6b-8e5d-48da-b1e4-1154003485a6 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:30.180455 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-80175f6b-8e5d-48da-b1e4-1154003485a6 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] [instance: 9b4e4b65-ac0b-47ad-b700-50b70e099fdf] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:51:30.188096 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-80175f6b-8e5d-48da-b1e4-1154003485a6 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:30.188633 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-80175f6b-8e5d-48da-b1e4-1154003485a6 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:30.189092 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-80175f6b-8e5d-48da-b1e4-1154003485a6 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:30.189861 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-80175f6b-8e5d-48da-b1e4-1154003485a6 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:30.190373 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-80175f6b-8e5d-48da-b1e4-1154003485a6 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:30.190820 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-80175f6b-8e5d-48da-b1e4-1154003485a6 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:30.346905 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-80175f6b-8e5d-48da-b1e4-1154003485a6 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45a1d70add54293919369e7d34bd460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06da7a8a5fe84931beb76182a8072fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:51:30.355862 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-80175f6b-8e5d-48da-b1e4-1154003485a6 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] 10.222.0.70 "GET /compute/v2.1/servers/9b4e4b65-ac0b-47ad-b700-50b70e099fdf" status: 200 len: 1357 microversion: 2.1 time: 0.181516 Aug 27 03:51:30.356921 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3467/6887] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:51:30 2022] GET /compute/v2.1/servers/9b4e4b65-ac0b-47ad-b700-50b70e099fdf => generated 1357 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:51:31.377319 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-595974b3-d442-4139-a12b-c9ab20eb4646 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:31.378084 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-595974b3-d442-4139-a12b-c9ab20eb4646 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] [instance: 9b4e4b65-ac0b-47ad-b700-50b70e099fdf] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:51:31.385575 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-595974b3-d442-4139-a12b-c9ab20eb4646 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:31.386158 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-595974b3-d442-4139-a12b-c9ab20eb4646 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:31.386637 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-595974b3-d442-4139-a12b-c9ab20eb4646 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:31.387354 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-595974b3-d442-4139-a12b-c9ab20eb4646 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:31.387805 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-595974b3-d442-4139-a12b-c9ab20eb4646 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:31.388285 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-595974b3-d442-4139-a12b-c9ab20eb4646 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:31.817042 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-595974b3-d442-4139-a12b-c9ab20eb4646 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45a1d70add54293919369e7d34bd460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06da7a8a5fe84931beb76182a8072fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:51:31.826025 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-595974b3-d442-4139-a12b-c9ab20eb4646 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] 10.222.0.70 "GET /compute/v2.1/servers/9b4e4b65-ac0b-47ad-b700-50b70e099fdf" status: 200 len: 1357 microversion: 2.1 time: 0.452578 Aug 27 03:51:31.826971 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3421/6888] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:51:31 2022] GET /compute/v2.1/servers/9b4e4b65-ac0b-47ad-b700-50b70e099fdf => generated 1357 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:51:32.847824 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c7456b2c-efaf-4094-8ce7-345263c68c73 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:32.848542 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-c7456b2c-efaf-4094-8ce7-345263c68c73 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] [instance: 9b4e4b65-ac0b-47ad-b700-50b70e099fdf] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:51:32.853786 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:51:32.858366 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c7456b2c-efaf-4094-8ce7-345263c68c73 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:32.858944 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c7456b2c-efaf-4094-8ce7-345263c68c73 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:32.859556 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c7456b2c-efaf-4094-8ce7-345263c68c73 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:32.860306 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c7456b2c-efaf-4094-8ce7-345263c68c73 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:32.860832 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c7456b2c-efaf-4094-8ce7-345263c68c73 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:32.861527 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c7456b2c-efaf-4094-8ce7-345263c68c73 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:33.005120 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-c7456b2c-efaf-4094-8ce7-345263c68c73 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45a1d70add54293919369e7d34bd460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06da7a8a5fe84931beb76182a8072fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:51:33.013809 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c7456b2c-efaf-4094-8ce7-345263c68c73 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] 10.222.0.70 "GET /compute/v2.1/servers/9b4e4b65-ac0b-47ad-b700-50b70e099fdf" status: 200 len: 1357 microversion: 2.1 time: 0.170205 Aug 27 03:51:33.014477 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3468/6889] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:51:32 2022] GET /compute/v2.1/servers/9b4e4b65-ac0b-47ad-b700-50b70e099fdf => generated 1357 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:51:34.035213 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-fb979b48-d372-47da-ac3d-5b48c7421e84 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:34.035825 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-fb979b48-d372-47da-ac3d-5b48c7421e84 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] [instance: 9b4e4b65-ac0b-47ad-b700-50b70e099fdf] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:51:34.044154 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fb979b48-d372-47da-ac3d-5b48c7421e84 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:34.044668 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fb979b48-d372-47da-ac3d-5b48c7421e84 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:34.045131 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fb979b48-d372-47da-ac3d-5b48c7421e84 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:34.046052 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fb979b48-d372-47da-ac3d-5b48c7421e84 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:34.046500 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fb979b48-d372-47da-ac3d-5b48c7421e84 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:34.046923 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fb979b48-d372-47da-ac3d-5b48c7421e84 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:34.189116 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-fb979b48-d372-47da-ac3d-5b48c7421e84 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45a1d70add54293919369e7d34bd460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06da7a8a5fe84931beb76182a8072fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:51:34.198144 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-fb979b48-d372-47da-ac3d-5b48c7421e84 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] 10.222.0.70 "GET /compute/v2.1/servers/9b4e4b65-ac0b-47ad-b700-50b70e099fdf" status: 200 len: 1357 microversion: 2.1 time: 0.166852 Aug 27 03:51:34.198683 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3422/6890] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:51:34 2022] GET /compute/v2.1/servers/9b4e4b65-ac0b-47ad-b700-50b70e099fdf => generated 1357 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:51:35.219536 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-07c87d76-fca6-4a11-a0ba-9d602f98e0e9 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:35.220134 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-07c87d76-fca6-4a11-a0ba-9d602f98e0e9 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] [instance: 9b4e4b65-ac0b-47ad-b700-50b70e099fdf] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:51:35.228484 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-07c87d76-fca6-4a11-a0ba-9d602f98e0e9 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:35.229048 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-07c87d76-fca6-4a11-a0ba-9d602f98e0e9 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:35.229517 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-07c87d76-fca6-4a11-a0ba-9d602f98e0e9 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:35.230275 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-07c87d76-fca6-4a11-a0ba-9d602f98e0e9 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:35.230743 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-07c87d76-fca6-4a11-a0ba-9d602f98e0e9 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:35.231483 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-07c87d76-fca6-4a11-a0ba-9d602f98e0e9 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:35.372801 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-07c87d76-fca6-4a11-a0ba-9d602f98e0e9 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45a1d70add54293919369e7d34bd460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06da7a8a5fe84931beb76182a8072fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:51:35.380792 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-07c87d76-fca6-4a11-a0ba-9d602f98e0e9 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] 10.222.0.70 "GET /compute/v2.1/servers/9b4e4b65-ac0b-47ad-b700-50b70e099fdf" status: 200 len: 1357 microversion: 2.1 time: 0.165317 Aug 27 03:51:35.381905 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3469/6891] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:51:35 2022] GET /compute/v2.1/servers/9b4e4b65-ac0b-47ad-b700-50b70e099fdf => generated 1357 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:51:36.353409 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-d88df7b6-82e9-45e6-8636-12419868b288 req-7338440f-5943-4c8f-9b55-fb7d2cd9e197 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b4e4b65-ac0b-47ad-b700-50b70e099fdf", "tag": "7c5562d9-fdde-4329-acdc-c7e41167dc41"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:51:36.358637 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=8 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:51:36.366047 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-d88df7b6-82e9-45e6-8636-12419868b288 req-7338440f-5943-4c8f-9b55-fb7d2cd9e197 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:36.366524 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-d88df7b6-82e9-45e6-8636-12419868b288 req-7338440f-5943-4c8f-9b55-fb7d2cd9e197 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:36.367141 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-d88df7b6-82e9-45e6-8636-12419868b288 req-7338440f-5943-4c8f-9b55-fb7d2cd9e197 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:36.380673 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-d88df7b6-82e9-45e6-8636-12419868b288 req-7338440f-5943-4c8f-9b55-fb7d2cd9e197 service nova] Creating event network-changed:7c5562d9-fdde-4329-acdc-c7e41167dc41 for instance 9b4e4b65-ac0b-47ad-b700-50b70e099fdf on n-h2-852278-4 Aug 27 03:51:36.386310 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-d88df7b6-82e9-45e6-8636-12419868b288 req-7338440f-5943-4c8f-9b55-fb7d2cd9e197 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037377 Aug 27 03:51:36.387301 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3423/6892] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:51:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:51:36.402503 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-35a9ec93-3674-4136-9391-cbee2093c44d tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:36.403139 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-35a9ec93-3674-4136-9391-cbee2093c44d tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] [instance: 9b4e4b65-ac0b-47ad-b700-50b70e099fdf] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:51:36.405267 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=10 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:51:36.412617 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-35a9ec93-3674-4136-9391-cbee2093c44d tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:36.413036 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-35a9ec93-3674-4136-9391-cbee2093c44d tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:36.413935 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-35a9ec93-3674-4136-9391-cbee2093c44d tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:36.414838 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-35a9ec93-3674-4136-9391-cbee2093c44d tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:36.415421 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-35a9ec93-3674-4136-9391-cbee2093c44d tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:36.416105 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-35a9ec93-3674-4136-9391-cbee2093c44d tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:36.696335 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-35a9ec93-3674-4136-9391-cbee2093c44d tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45a1d70add54293919369e7d34bd460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06da7a8a5fe84931beb76182a8072fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:51:36.704867 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-35a9ec93-3674-4136-9391-cbee2093c44d tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] 10.222.0.70 "GET /compute/v2.1/servers/9b4e4b65-ac0b-47ad-b700-50b70e099fdf" status: 200 len: 1357 microversion: 2.1 time: 0.306294 Aug 27 03:51:36.705475 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3470/6893] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:51:36 2022] GET /compute/v2.1/servers/9b4e4b65-ac0b-47ad-b700-50b70e099fdf => generated 1357 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:51:37.727537 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-bff76514-5e07-4814-988b-a2af83ad3008 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:37.728228 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-bff76514-5e07-4814-988b-a2af83ad3008 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] [instance: 9b4e4b65-ac0b-47ad-b700-50b70e099fdf] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:51:37.734779 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bff76514-5e07-4814-988b-a2af83ad3008 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:37.735265 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bff76514-5e07-4814-988b-a2af83ad3008 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:37.735701 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bff76514-5e07-4814-988b-a2af83ad3008 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:37.736438 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bff76514-5e07-4814-988b-a2af83ad3008 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:37.736887 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bff76514-5e07-4814-988b-a2af83ad3008 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:37.737312 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bff76514-5e07-4814-988b-a2af83ad3008 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:37.886516 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-bff76514-5e07-4814-988b-a2af83ad3008 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45a1d70add54293919369e7d34bd460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06da7a8a5fe84931beb76182a8072fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:51:37.895712 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-bff76514-5e07-4814-988b-a2af83ad3008 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] 10.222.0.70 "GET /compute/v2.1/servers/9b4e4b65-ac0b-47ad-b700-50b70e099fdf" status: 200 len: 1357 microversion: 2.1 time: 0.173189 Aug 27 03:51:37.896598 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3424/6894] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:51:37 2022] GET /compute/v2.1/servers/9b4e4b65-ac0b-47ad-b700-50b70e099fdf => generated 1357 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:51:38.921084 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7da6358a-bead-40be-ad9b-fda7bee09ac6 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:38.921714 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-7da6358a-bead-40be-ad9b-fda7bee09ac6 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] [instance: 9b4e4b65-ac0b-47ad-b700-50b70e099fdf] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:51:38.929292 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7da6358a-bead-40be-ad9b-fda7bee09ac6 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:38.929793 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7da6358a-bead-40be-ad9b-fda7bee09ac6 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:38.930238 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7da6358a-bead-40be-ad9b-fda7bee09ac6 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:38.930952 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7da6358a-bead-40be-ad9b-fda7bee09ac6 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:38.931413 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7da6358a-bead-40be-ad9b-fda7bee09ac6 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:38.931849 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7da6358a-bead-40be-ad9b-fda7bee09ac6 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:39.086163 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-7da6358a-bead-40be-ad9b-fda7bee09ac6 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45a1d70add54293919369e7d34bd460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06da7a8a5fe84931beb76182a8072fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:51:39.099095 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-7da6358a-bead-40be-ad9b-fda7bee09ac6 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] 10.222.0.70 "GET /compute/v2.1/servers/9b4e4b65-ac0b-47ad-b700-50b70e099fdf" status: 200 len: 1357 microversion: 2.1 time: 0.181742 Aug 27 03:51:39.100039 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3471/6895] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:51:38 2022] GET /compute/v2.1/servers/9b4e4b65-ac0b-47ad-b700-50b70e099fdf => generated 1357 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:51:40.126009 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-03745d5f-a9ee-47bc-aa9e-ea4482453dc0 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:40.126624 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-03745d5f-a9ee-47bc-aa9e-ea4482453dc0 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] [instance: 9b4e4b65-ac0b-47ad-b700-50b70e099fdf] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:51:40.134649 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-03745d5f-a9ee-47bc-aa9e-ea4482453dc0 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:40.135476 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-03745d5f-a9ee-47bc-aa9e-ea4482453dc0 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:40.135966 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-03745d5f-a9ee-47bc-aa9e-ea4482453dc0 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:40.136681 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-03745d5f-a9ee-47bc-aa9e-ea4482453dc0 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:40.137144 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-03745d5f-a9ee-47bc-aa9e-ea4482453dc0 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:40.137573 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-03745d5f-a9ee-47bc-aa9e-ea4482453dc0 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:40.315505 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-03745d5f-a9ee-47bc-aa9e-ea4482453dc0 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45a1d70add54293919369e7d34bd460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06da7a8a5fe84931beb76182a8072fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:51:40.324392 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-03745d5f-a9ee-47bc-aa9e-ea4482453dc0 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] 10.222.0.70 "GET /compute/v2.1/servers/9b4e4b65-ac0b-47ad-b700-50b70e099fdf" status: 200 len: 1357 microversion: 2.1 time: 0.202316 Aug 27 03:51:40.325385 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3425/6896] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:51:40 2022] GET /compute/v2.1/servers/9b4e4b65-ac0b-47ad-b700-50b70e099fdf => generated 1357 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:51:41.346854 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d1eea6c5-8ee5-4018-bc9b-7213c131a293 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:41.347430 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d1eea6c5-8ee5-4018-bc9b-7213c131a293 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] [instance: 9b4e4b65-ac0b-47ad-b700-50b70e099fdf] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:51:41.355009 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d1eea6c5-8ee5-4018-bc9b-7213c131a293 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:41.355513 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d1eea6c5-8ee5-4018-bc9b-7213c131a293 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:41.355972 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d1eea6c5-8ee5-4018-bc9b-7213c131a293 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:41.356722 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d1eea6c5-8ee5-4018-bc9b-7213c131a293 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:41.357188 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d1eea6c5-8ee5-4018-bc9b-7213c131a293 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:41.357643 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d1eea6c5-8ee5-4018-bc9b-7213c131a293 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:41.501444 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d1eea6c5-8ee5-4018-bc9b-7213c131a293 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45a1d70add54293919369e7d34bd460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06da7a8a5fe84931beb76182a8072fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:51:41.511623 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d1eea6c5-8ee5-4018-bc9b-7213c131a293 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] 10.222.0.70 "GET /compute/v2.1/servers/9b4e4b65-ac0b-47ad-b700-50b70e099fdf" status: 200 len: 1357 microversion: 2.1 time: 0.168599 Aug 27 03:51:41.512244 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3472/6897] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:51:41 2022] GET /compute/v2.1/servers/9b4e4b65-ac0b-47ad-b700-50b70e099fdf => generated 1357 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:51:42.402427 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-268bfbd7-4496-4243-a828-0932c40d2070 req-5c4b64bb-e89e-40d4-9d5b-2d42cdaa0099 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b4e4b65-ac0b-47ad-b700-50b70e099fdf", "name": "network-vif-plugged", "status": "completed", "tag": "7c5562d9-fdde-4329-acdc-c7e41167dc41"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:51:42.412974 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-268bfbd7-4496-4243-a828-0932c40d2070 req-5c4b64bb-e89e-40d4-9d5b-2d42cdaa0099 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:42.413452 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-268bfbd7-4496-4243-a828-0932c40d2070 req-5c4b64bb-e89e-40d4-9d5b-2d42cdaa0099 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:42.413880 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-268bfbd7-4496-4243-a828-0932c40d2070 req-5c4b64bb-e89e-40d4-9d5b-2d42cdaa0099 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:42.428464 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-268bfbd7-4496-4243-a828-0932c40d2070 req-5c4b64bb-e89e-40d4-9d5b-2d42cdaa0099 service nova] Creating event network-vif-plugged:7c5562d9-fdde-4329-acdc-c7e41167dc41 for instance 9b4e4b65-ac0b-47ad-b700-50b70e099fdf on n-h2-852278-4 Aug 27 03:51:42.434820 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-268bfbd7-4496-4243-a828-0932c40d2070 req-5c4b64bb-e89e-40d4-9d5b-2d42cdaa0099 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120171 Aug 27 03:51:42.435488 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3426/6898] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:51:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:51:42.533584 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8ef41f53-6e41-4e0e-bbb3-6664eb1da955 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:42.534244 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-8ef41f53-6e41-4e0e-bbb3-6664eb1da955 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] [instance: 9b4e4b65-ac0b-47ad-b700-50b70e099fdf] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:51:42.542565 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8ef41f53-6e41-4e0e-bbb3-6664eb1da955 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:42.543448 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8ef41f53-6e41-4e0e-bbb3-6664eb1da955 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:42.544219 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8ef41f53-6e41-4e0e-bbb3-6664eb1da955 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:42.545524 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8ef41f53-6e41-4e0e-bbb3-6664eb1da955 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:42.546262 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8ef41f53-6e41-4e0e-bbb3-6664eb1da955 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:42.547046 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8ef41f53-6e41-4e0e-bbb3-6664eb1da955 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:42.735118 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-8ef41f53-6e41-4e0e-bbb3-6664eb1da955 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45a1d70add54293919369e7d34bd460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06da7a8a5fe84931beb76182a8072fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:51:42.744743 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-8ef41f53-6e41-4e0e-bbb3-6664eb1da955 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] 10.222.0.70 "GET /compute/v2.1/servers/9b4e4b65-ac0b-47ad-b700-50b70e099fdf" status: 200 len: 1357 microversion: 2.1 time: 0.214950 Aug 27 03:51:42.745455 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3473/6899] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:51:42 2022] GET /compute/v2.1/servers/9b4e4b65-ac0b-47ad-b700-50b70e099fdf => generated 1357 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:51:43.768990 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0cfcf2df-a13e-4c58-8431-e59c33279753 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:43.769799 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-0cfcf2df-a13e-4c58-8431-e59c33279753 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] [instance: 9b4e4b65-ac0b-47ad-b700-50b70e099fdf] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:51:43.777222 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0cfcf2df-a13e-4c58-8431-e59c33279753 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:43.777704 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0cfcf2df-a13e-4c58-8431-e59c33279753 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:43.778130 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0cfcf2df-a13e-4c58-8431-e59c33279753 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:43.778824 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0cfcf2df-a13e-4c58-8431-e59c33279753 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:43.779265 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0cfcf2df-a13e-4c58-8431-e59c33279753 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:43.779678 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0cfcf2df-a13e-4c58-8431-e59c33279753 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:43.917272 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0cfcf2df-a13e-4c58-8431-e59c33279753 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45a1d70add54293919369e7d34bd460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06da7a8a5fe84931beb76182a8072fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:51:43.925795 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-0cfcf2df-a13e-4c58-8431-e59c33279753 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] 10.222.0.70 "GET /compute/v2.1/servers/9b4e4b65-ac0b-47ad-b700-50b70e099fdf" status: 200 len: 1357 microversion: 2.1 time: 0.161558 Aug 27 03:51:43.926389 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3427/6900] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:51:43 2022] GET /compute/v2.1/servers/9b4e4b65-ac0b-47ad-b700-50b70e099fdf => generated 1357 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:51:44.949000 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-db426f8c-8020-40cd-8a41-a182b385991f tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:44.949651 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-db426f8c-8020-40cd-8a41-a182b385991f tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] [instance: 9b4e4b65-ac0b-47ad-b700-50b70e099fdf] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:51:44.958330 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-db426f8c-8020-40cd-8a41-a182b385991f tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:44.959160 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-db426f8c-8020-40cd-8a41-a182b385991f tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:44.959903 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-db426f8c-8020-40cd-8a41-a182b385991f tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:44.960915 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-db426f8c-8020-40cd-8a41-a182b385991f tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:44.961210 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-db426f8c-8020-40cd-8a41-a182b385991f tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:44.961743 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-db426f8c-8020-40cd-8a41-a182b385991f tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:45.120407 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-db426f8c-8020-40cd-8a41-a182b385991f tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45a1d70add54293919369e7d34bd460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06da7a8a5fe84931beb76182a8072fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:51:45.132844 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-db426f8c-8020-40cd-8a41-a182b385991f tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] 10.222.0.70 "GET /compute/v2.1/servers/9b4e4b65-ac0b-47ad-b700-50b70e099fdf" status: 200 len: 1547 microversion: 2.1 time: 0.188777 Aug 27 03:51:45.133436 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3474/6901] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:51:44 2022] GET /compute/v2.1/servers/9b4e4b65-ac0b-47ad-b700-50b70e099fdf => generated 1547 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:51:45.159116 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c63432cf-d6d0-4477-a347-b7a5cddaa916 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:45.159698 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-c63432cf-d6d0-4477-a347-b7a5cddaa916 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] [instance: 9b4e4b65-ac0b-47ad-b700-50b70e099fdf] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:51:45.167297 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c63432cf-d6d0-4477-a347-b7a5cddaa916 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:45.167781 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c63432cf-d6d0-4477-a347-b7a5cddaa916 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:45.168209 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c63432cf-d6d0-4477-a347-b7a5cddaa916 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:45.168987 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c63432cf-d6d0-4477-a347-b7a5cddaa916 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:45.169360 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c63432cf-d6d0-4477-a347-b7a5cddaa916 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:45.169831 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c63432cf-d6d0-4477-a347-b7a5cddaa916 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:45.307188 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-c63432cf-d6d0-4477-a347-b7a5cddaa916 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45a1d70add54293919369e7d34bd460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06da7a8a5fe84931beb76182a8072fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:51:45.315611 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c63432cf-d6d0-4477-a347-b7a5cddaa916 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] 10.222.0.70 "GET /compute/v2.1/servers/9b4e4b65-ac0b-47ad-b700-50b70e099fdf" status: 200 len: 1547 microversion: 2.1 time: 0.160514 Aug 27 03:51:45.316187 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3428/6902] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:51:45 2022] GET /compute/v2.1/servers/9b4e4b65-ac0b-47ad-b700-50b70e099fdf => generated 1547 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:51:45.335667 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f0dd64f5-b5a7-460b-8cc6-5d2586828de6 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:45.340742 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-f0dd64f5-b5a7-460b-8cc6-5d2586828de6 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f45a1d70add54293919369e7d34bd460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06da7a8a5fe84931beb76182a8072fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:51:45.341524 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-f0dd64f5-b5a7-460b-8cc6-5d2586828de6 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Searching by: {'deleted': False, 'project_id': '06da7a8a5fe84931beb76182a8072fb2'} {{(pid=134051) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 03:51:45.347302 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f0dd64f5-b5a7-460b-8cc6-5d2586828de6 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:45.347791 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f0dd64f5-b5a7-460b-8cc6-5d2586828de6 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:45.348263 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f0dd64f5-b5a7-460b-8cc6-5d2586828de6 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:45.349000 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f0dd64f5-b5a7-460b-8cc6-5d2586828de6 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:45.349458 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f0dd64f5-b5a7-460b-8cc6-5d2586828de6 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:45.350331 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f0dd64f5-b5a7-460b-8cc6-5d2586828de6 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:45.378964 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.multi_cell_list [None req-f0dd64f5-b5a7-460b-8cc6-5d2586828de6 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=134051) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 03:51:45.413261 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-f0dd64f5-b5a7-460b-8cc6-5d2586828de6 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] 10.222.0.70 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.081442 Aug 27 03:51:45.413880 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3475/6903] 10.222.0.70 () {58 vars in 1125 bytes} [Sat Aug 27 03:51:45 2022] GET /compute/v2.1/servers => generated 342 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:51:45.428804 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6db4e058-4be2-41ff-ae15-6e6a56914457 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:45.429459 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-6db4e058-4be2-41ff-ae15-6e6a56914457 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] [instance: 9b4e4b65-ac0b-47ad-b700-50b70e099fdf] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:51:45.435975 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6db4e058-4be2-41ff-ae15-6e6a56914457 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:45.436582 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6db4e058-4be2-41ff-ae15-6e6a56914457 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:45.437027 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6db4e058-4be2-41ff-ae15-6e6a56914457 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:45.437851 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6db4e058-4be2-41ff-ae15-6e6a56914457 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:45.438498 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6db4e058-4be2-41ff-ae15-6e6a56914457 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:45.439131 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6db4e058-4be2-41ff-ae15-6e6a56914457 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:45.582384 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-6db4e058-4be2-41ff-ae15-6e6a56914457 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45a1d70add54293919369e7d34bd460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06da7a8a5fe84931beb76182a8072fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:51:45.591295 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-6db4e058-4be2-41ff-ae15-6e6a56914457 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] 10.222.0.70 "GET /compute/v2.1/servers/9b4e4b65-ac0b-47ad-b700-50b70e099fdf" status: 200 len: 1547 microversion: 2.1 time: 0.167814 Aug 27 03:51:45.591870 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3429/6904] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:51:45 2022] GET /compute/v2.1/servers/9b4e4b65-ac0b-47ad-b700-50b70e099fdf => generated 1547 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:51:47.147858 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-1ad8d0b8-36af-43a4-8665-223e02866885 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6d15f9df-ba7b-4bc2-a518-1332cc85cc1d"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:51:47.150382 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-1ad8d0b8-36af-43a4-8665-223e02866885 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] [instance: 9b4e4b65-ac0b-47ad-b700-50b70e099fdf] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:51:47.157960 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1ad8d0b8-36af-43a4-8665-223e02866885 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:47.158465 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1ad8d0b8-36af-43a4-8665-223e02866885 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:47.158992 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1ad8d0b8-36af-43a4-8665-223e02866885 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:47.159691 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1ad8d0b8-36af-43a4-8665-223e02866885 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:47.160130 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1ad8d0b8-36af-43a4-8665-223e02866885 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:47.160632 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1ad8d0b8-36af-43a4-8665-223e02866885 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:47.458379 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-1ad8d0b8-36af-43a4-8665-223e02866885 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] 10.222.0.70 "POST /compute/v2.1/servers/9b4e4b65-ac0b-47ad-b700-50b70e099fdf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.314293 Aug 27 03:51:47.459539 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3476/6905] 10.222.0.70 () {60 vars in 1323 bytes} [Sat Aug 27 03:51:47 2022] POST /compute/v2.1/servers/9b4e4b65-ac0b-47ad-b700-50b70e099fdf/os-volume_attachments => generated 194 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:51:58.256519 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-efb69d2e-8ab2-4724-983d-d365881f5933 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:58.257117 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-efb69d2e-8ab2-4724-983d-d365881f5933 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] [instance: 9b4e4b65-ac0b-47ad-b700-50b70e099fdf] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:51:58.260235 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:51:58.260935 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=58 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:51:58.267157 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-efb69d2e-8ab2-4724-983d-d365881f5933 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:58.267644 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-efb69d2e-8ab2-4724-983d-d365881f5933 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:58.268082 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-efb69d2e-8ab2-4724-983d-d365881f5933 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:58.268821 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-efb69d2e-8ab2-4724-983d-d365881f5933 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:58.269275 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-efb69d2e-8ab2-4724-983d-d365881f5933 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:58.269703 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-efb69d2e-8ab2-4724-983d-d365881f5933 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:58.405583 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-efb69d2e-8ab2-4724-983d-d365881f5933 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45a1d70add54293919369e7d34bd460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06da7a8a5fe84931beb76182a8072fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:51:58.414238 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-efb69d2e-8ab2-4724-983d-d365881f5933 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] 10.222.0.70 "GET /compute/v2.1/servers/9b4e4b65-ac0b-47ad-b700-50b70e099fdf" status: 200 len: 1593 microversion: 2.1 time: 0.161712 Aug 27 03:51:58.414816 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3430/6906] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:51:58 2022] GET /compute/v2.1/servers/9b4e4b65-ac0b-47ad-b700-50b70e099fdf => generated 1593 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:52:00.163672 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:52:00.164558 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=21 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:52:00.165230 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:52:00.169432 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-8983ccbe-c798-48b1-a7b0-75ff8b1c7e60 req-7b3d7cf6-8e67-4377-9627-cec8caeb0f05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b4e4b65-ac0b-47ad-b700-50b70e099fdf", "tag": "7c5562d9-fdde-4329-acdc-c7e41167dc41"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:52:00.181829 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-8983ccbe-c798-48b1-a7b0-75ff8b1c7e60 req-7b3d7cf6-8e67-4377-9627-cec8caeb0f05 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:00.182223 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-8983ccbe-c798-48b1-a7b0-75ff8b1c7e60 req-7b3d7cf6-8e67-4377-9627-cec8caeb0f05 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:00.182663 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-8983ccbe-c798-48b1-a7b0-75ff8b1c7e60 req-7b3d7cf6-8e67-4377-9627-cec8caeb0f05 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:00.196632 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-8983ccbe-c798-48b1-a7b0-75ff8b1c7e60 req-7b3d7cf6-8e67-4377-9627-cec8caeb0f05 service nova] Creating event network-changed:7c5562d9-fdde-4329-acdc-c7e41167dc41 for instance 9b4e4b65-ac0b-47ad-b700-50b70e099fdf on n-h2-852278-4 Aug 27 03:52:00.202016 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-8983ccbe-c798-48b1-a7b0-75ff8b1c7e60 req-7b3d7cf6-8e67-4377-9627-cec8caeb0f05 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040198 Aug 27 03:52:00.202829 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3477/6907] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:52:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:52:01.286727 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-635b523a-d38a-4069-b5ca-5fd93e0588f2 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1732091812"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:52:01.287392 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-635b523a-d38a-4069-b5ca-5fd93e0588f2 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] [instance: 9b4e4b65-ac0b-47ad-b700-50b70e099fdf] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:52:01.295158 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-635b523a-d38a-4069-b5ca-5fd93e0588f2 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:01.295730 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-635b523a-d38a-4069-b5ca-5fd93e0588f2 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:01.296254 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-635b523a-d38a-4069-b5ca-5fd93e0588f2 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:01.297040 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-635b523a-d38a-4069-b5ca-5fd93e0588f2 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:01.297863 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-635b523a-d38a-4069-b5ca-5fd93e0588f2 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:01.298342 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-635b523a-d38a-4069-b5ca-5fd93e0588f2 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:01.446209 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.network.security_group_api [None req-635b523a-d38a-4069-b5ca-5fd93e0588f2 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Adding security group 00ccceb6-b2f1-4a83-8784-3e495d2a2b62 to port 7c5562d9-fdde-4329-acdc-c7e41167dc41 Aug 27 03:52:01.771387 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-635b523a-d38a-4069-b5ca-5fd93e0588f2 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] 10.222.0.70 "POST /compute/v2.1/servers/9b4e4b65-ac0b-47ad-b700-50b70e099fdf/action" status: 202 len: 0 microversion: 2.1 time: 0.488712 Aug 27 03:52:01.772002 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3431/6908] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:52:01 2022] POST /compute/v2.1/servers/9b4e4b65-ac0b-47ad-b700-50b70e099fdf/action => generated 0 bytes in 490 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:52:01.787654 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a3156038-b43d-41f2-9f86-961212175b3a tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:01.788958 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-a3156038-b43d-41f2-9f86-961212175b3a tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] [instance: 9b4e4b65-ac0b-47ad-b700-50b70e099fdf] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:52:01.792586 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-e8ed9a42-4c2c-4261-a2f0-25123865d855 req-3c2ee239-9931-4548-be85-5c2b8060eaee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b4e4b65-ac0b-47ad-b700-50b70e099fdf", "tag": "7c5562d9-fdde-4329-acdc-c7e41167dc41"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:52:01.803596 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a3156038-b43d-41f2-9f86-961212175b3a tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:01.806106 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a3156038-b43d-41f2-9f86-961212175b3a tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:01.806559 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a3156038-b43d-41f2-9f86-961212175b3a tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:01.807199 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a3156038-b43d-41f2-9f86-961212175b3a tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:01.807711 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a3156038-b43d-41f2-9f86-961212175b3a tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:01.808192 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a3156038-b43d-41f2-9f86-961212175b3a tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:01.814573 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-e8ed9a42-4c2c-4261-a2f0-25123865d855 req-3c2ee239-9931-4548-be85-5c2b8060eaee service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:01.815072 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-e8ed9a42-4c2c-4261-a2f0-25123865d855 req-3c2ee239-9931-4548-be85-5c2b8060eaee service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:01.815508 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-e8ed9a42-4c2c-4261-a2f0-25123865d855 req-3c2ee239-9931-4548-be85-5c2b8060eaee service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:01.830355 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-e8ed9a42-4c2c-4261-a2f0-25123865d855 req-3c2ee239-9931-4548-be85-5c2b8060eaee service nova] Creating event network-changed:7c5562d9-fdde-4329-acdc-c7e41167dc41 for instance 9b4e4b65-ac0b-47ad-b700-50b70e099fdf on n-h2-852278-4 Aug 27 03:52:01.838574 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-e8ed9a42-4c2c-4261-a2f0-25123865d855 req-3c2ee239-9931-4548-be85-5c2b8060eaee service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053817 Aug 27 03:52:01.839198 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3432/6909] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:52:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:52:02.118902 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-a3156038-b43d-41f2-9f86-961212175b3a tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45a1d70add54293919369e7d34bd460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06da7a8a5fe84931beb76182a8072fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:52:02.128734 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a3156038-b43d-41f2-9f86-961212175b3a tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] 10.222.0.70 "GET /compute/v2.1/servers/9b4e4b65-ac0b-47ad-b700-50b70e099fdf" status: 200 len: 1758 microversion: 2.1 time: 0.349568 Aug 27 03:52:02.133848 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3478/6910] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:52:01 2022] GET /compute/v2.1/servers/9b4e4b65-ac0b-47ad-b700-50b70e099fdf => generated 1758 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:52:19.119559 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=6 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:52:19.120439 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=12 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:52:19.170375 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d0cd65a9-a26d-421a-b456-b5f0a0a89333 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:52:19.173140 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d0cd65a9-a26d-421a-b456-b5f0a0a89333 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] [instance: 9b4e4b65-ac0b-47ad-b700-50b70e099fdf] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:52:19.180602 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d0cd65a9-a26d-421a-b456-b5f0a0a89333 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:19.180932 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d0cd65a9-a26d-421a-b456-b5f0a0a89333 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:19.181367 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d0cd65a9-a26d-421a-b456-b5f0a0a89333 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:19.182070 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d0cd65a9-a26d-421a-b456-b5f0a0a89333 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:19.182520 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d0cd65a9-a26d-421a-b456-b5f0a0a89333 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:19.182942 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d0cd65a9-a26d-421a-b456-b5f0a0a89333 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:19.258255 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d0cd65a9-a26d-421a-b456-b5f0a0a89333 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] 10.222.0.70 "POST /compute/v2.1/servers/9b4e4b65-ac0b-47ad-b700-50b70e099fdf/action" status: 202 len: 0 microversion: 2.1 time: 0.140472 Aug 27 03:52:19.258889 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3433/6911] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:52:19 2022] POST /compute/v2.1/servers/9b4e4b65-ac0b-47ad-b700-50b70e099fdf/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:52:19.267223 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e23ae519-c250-4870-bf09-94bdbeb2e60e tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:19.267846 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-e23ae519-c250-4870-bf09-94bdbeb2e60e tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] [instance: 9b4e4b65-ac0b-47ad-b700-50b70e099fdf] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:52:19.270851 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=4 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:52:19.271588 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=8 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:52:19.278082 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e23ae519-c250-4870-bf09-94bdbeb2e60e tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:19.278749 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e23ae519-c250-4870-bf09-94bdbeb2e60e tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:19.279347 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e23ae519-c250-4870-bf09-94bdbeb2e60e tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:19.280120 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e23ae519-c250-4870-bf09-94bdbeb2e60e tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:19.280627 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e23ae519-c250-4870-bf09-94bdbeb2e60e tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:19.281078 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e23ae519-c250-4870-bf09-94bdbeb2e60e tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:19.777285 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e23ae519-c250-4870-bf09-94bdbeb2e60e tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45a1d70add54293919369e7d34bd460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06da7a8a5fe84931beb76182a8072fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:52:19.786174 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e23ae519-c250-4870-bf09-94bdbeb2e60e tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] 10.222.0.70 "GET /compute/v2.1/servers/9b4e4b65-ac0b-47ad-b700-50b70e099fdf" status: 200 len: 1750 microversion: 2.1 time: 0.522911 Aug 27 03:52:19.786832 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3479/6912] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:52:19 2022] GET /compute/v2.1/servers/9b4e4b65-ac0b-47ad-b700-50b70e099fdf => generated 1750 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:52:20.809560 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5cfd6788-2af2-4c47-8674-c21d3944858b tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:20.810336 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-5cfd6788-2af2-4c47-8674-c21d3944858b tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] [instance: 9b4e4b65-ac0b-47ad-b700-50b70e099fdf] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:52:20.817097 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5cfd6788-2af2-4c47-8674-c21d3944858b tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:20.817570 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5cfd6788-2af2-4c47-8674-c21d3944858b tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:20.818011 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5cfd6788-2af2-4c47-8674-c21d3944858b tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:20.818720 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5cfd6788-2af2-4c47-8674-c21d3944858b tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:20.819176 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5cfd6788-2af2-4c47-8674-c21d3944858b tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:20.819599 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5cfd6788-2af2-4c47-8674-c21d3944858b tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:20.970094 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-5cfd6788-2af2-4c47-8674-c21d3944858b tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45a1d70add54293919369e7d34bd460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06da7a8a5fe84931beb76182a8072fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:52:20.978982 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-5cfd6788-2af2-4c47-8674-c21d3944858b tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] 10.222.0.70 "GET /compute/v2.1/servers/9b4e4b65-ac0b-47ad-b700-50b70e099fdf" status: 200 len: 1755 microversion: 2.1 time: 0.174692 Aug 27 03:52:20.979556 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3434/6913] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:52:20 2022] GET /compute/v2.1/servers/9b4e4b65-ac0b-47ad-b700-50b70e099fdf => generated 1755 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:52:22.001516 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-663a8972-3967-4440-b9f4-8a7118ff36c2 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:22.002150 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-663a8972-3967-4440-b9f4-8a7118ff36c2 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] [instance: 9b4e4b65-ac0b-47ad-b700-50b70e099fdf] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:52:22.009932 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-663a8972-3967-4440-b9f4-8a7118ff36c2 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:22.010460 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-663a8972-3967-4440-b9f4-8a7118ff36c2 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:22.010889 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-663a8972-3967-4440-b9f4-8a7118ff36c2 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:22.011610 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-663a8972-3967-4440-b9f4-8a7118ff36c2 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:22.012079 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-663a8972-3967-4440-b9f4-8a7118ff36c2 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:22.012558 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-663a8972-3967-4440-b9f4-8a7118ff36c2 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:22.160812 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-663a8972-3967-4440-b9f4-8a7118ff36c2 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45a1d70add54293919369e7d34bd460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06da7a8a5fe84931beb76182a8072fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:52:22.169893 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-663a8972-3967-4440-b9f4-8a7118ff36c2 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] 10.222.0.70 "GET /compute/v2.1/servers/9b4e4b65-ac0b-47ad-b700-50b70e099fdf" status: 200 len: 1755 microversion: 2.1 time: 0.173111 Aug 27 03:52:22.170494 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3480/6914] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:52:21 2022] GET /compute/v2.1/servers/9b4e4b65-ac0b-47ad-b700-50b70e099fdf => generated 1755 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:52:23.191684 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d66f54b6-ee36-4930-91e0-ea4d4dc86a32 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:23.192249 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d66f54b6-ee36-4930-91e0-ea4d4dc86a32 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] [instance: 9b4e4b65-ac0b-47ad-b700-50b70e099fdf] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:52:23.199688 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d66f54b6-ee36-4930-91e0-ea4d4dc86a32 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:23.200175 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d66f54b6-ee36-4930-91e0-ea4d4dc86a32 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:23.200622 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d66f54b6-ee36-4930-91e0-ea4d4dc86a32 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:23.201335 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d66f54b6-ee36-4930-91e0-ea4d4dc86a32 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:23.201786 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d66f54b6-ee36-4930-91e0-ea4d4dc86a32 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:23.202203 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d66f54b6-ee36-4930-91e0-ea4d4dc86a32 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:23.352863 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-d66f54b6-ee36-4930-91e0-ea4d4dc86a32 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45a1d70add54293919369e7d34bd460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06da7a8a5fe84931beb76182a8072fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:52:23.362431 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d66f54b6-ee36-4930-91e0-ea4d4dc86a32 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] 10.222.0.70 "GET /compute/v2.1/servers/9b4e4b65-ac0b-47ad-b700-50b70e099fdf" status: 200 len: 1755 microversion: 2.1 time: 0.174901 Aug 27 03:52:23.363060 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3435/6915] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:52:23 2022] GET /compute/v2.1/servers/9b4e4b65-ac0b-47ad-b700-50b70e099fdf => generated 1755 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:52:24.384230 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-953bcbde-7cfc-4135-b64b-5c4c1d62e4e2 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:24.384910 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-953bcbde-7cfc-4135-b64b-5c4c1d62e4e2 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] [instance: 9b4e4b65-ac0b-47ad-b700-50b70e099fdf] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:52:24.392147 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-953bcbde-7cfc-4135-b64b-5c4c1d62e4e2 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:24.392711 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-953bcbde-7cfc-4135-b64b-5c4c1d62e4e2 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:24.393166 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-953bcbde-7cfc-4135-b64b-5c4c1d62e4e2 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:24.393886 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-953bcbde-7cfc-4135-b64b-5c4c1d62e4e2 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:24.394357 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-953bcbde-7cfc-4135-b64b-5c4c1d62e4e2 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:24.394800 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-953bcbde-7cfc-4135-b64b-5c4c1d62e4e2 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:24.544929 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-953bcbde-7cfc-4135-b64b-5c4c1d62e4e2 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45a1d70add54293919369e7d34bd460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06da7a8a5fe84931beb76182a8072fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:52:24.554211 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-953bcbde-7cfc-4135-b64b-5c4c1d62e4e2 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] 10.222.0.70 "GET /compute/v2.1/servers/9b4e4b65-ac0b-47ad-b700-50b70e099fdf" status: 200 len: 1755 microversion: 2.1 time: 0.174015 Aug 27 03:52:24.554837 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3481/6916] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:52:24 2022] GET /compute/v2.1/servers/9b4e4b65-ac0b-47ad-b700-50b70e099fdf => generated 1755 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:52:25.575426 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3a2509df-972e-454f-863f-fc745b75d09d tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:25.576060 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-3a2509df-972e-454f-863f-fc745b75d09d tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] [instance: 9b4e4b65-ac0b-47ad-b700-50b70e099fdf] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:52:25.583464 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3a2509df-972e-454f-863f-fc745b75d09d tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:25.583956 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3a2509df-972e-454f-863f-fc745b75d09d tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:25.584426 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3a2509df-972e-454f-863f-fc745b75d09d tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:25.585211 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3a2509df-972e-454f-863f-fc745b75d09d tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:25.585669 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3a2509df-972e-454f-863f-fc745b75d09d tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:25.586096 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3a2509df-972e-454f-863f-fc745b75d09d tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:25.746321 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-3a2509df-972e-454f-863f-fc745b75d09d tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45a1d70add54293919369e7d34bd460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06da7a8a5fe84931beb76182a8072fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:52:25.756718 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-3a2509df-972e-454f-863f-fc745b75d09d tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] 10.222.0.70 "GET /compute/v2.1/servers/9b4e4b65-ac0b-47ad-b700-50b70e099fdf" status: 200 len: 1755 microversion: 2.1 time: 0.185083 Aug 27 03:52:25.757361 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3436/6917] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:52:25 2022] GET /compute/v2.1/servers/9b4e4b65-ac0b-47ad-b700-50b70e099fdf => generated 1755 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:52:26.779722 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-485d97b4-d092-4ad1-baf0-618d4eacc37e tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:26.780541 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-485d97b4-d092-4ad1-baf0-618d4eacc37e tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] [instance: 9b4e4b65-ac0b-47ad-b700-50b70e099fdf] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:52:26.786937 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-485d97b4-d092-4ad1-baf0-618d4eacc37e tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:26.787445 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-485d97b4-d092-4ad1-baf0-618d4eacc37e tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:26.787890 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-485d97b4-d092-4ad1-baf0-618d4eacc37e tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:26.788639 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-485d97b4-d092-4ad1-baf0-618d4eacc37e tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:26.789601 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-485d97b4-d092-4ad1-baf0-618d4eacc37e tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:26.789601 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-485d97b4-d092-4ad1-baf0-618d4eacc37e tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:26.936524 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-485d97b4-d092-4ad1-baf0-618d4eacc37e tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45a1d70add54293919369e7d34bd460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06da7a8a5fe84931beb76182a8072fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:52:26.945223 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-485d97b4-d092-4ad1-baf0-618d4eacc37e tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] 10.222.0.70 "GET /compute/v2.1/servers/9b4e4b65-ac0b-47ad-b700-50b70e099fdf" status: 200 len: 1755 microversion: 2.1 time: 0.169780 Aug 27 03:52:26.945817 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3482/6918] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:52:26 2022] GET /compute/v2.1/servers/9b4e4b65-ac0b-47ad-b700-50b70e099fdf => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:52:27.966575 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-bd5c3599-4c87-4c74-92ab-b5629535dc82 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:27.967185 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-bd5c3599-4c87-4c74-92ab-b5629535dc82 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] [instance: 9b4e4b65-ac0b-47ad-b700-50b70e099fdf] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:52:27.974690 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bd5c3599-4c87-4c74-92ab-b5629535dc82 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:27.975187 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bd5c3599-4c87-4c74-92ab-b5629535dc82 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:27.975628 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bd5c3599-4c87-4c74-92ab-b5629535dc82 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:27.977080 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bd5c3599-4c87-4c74-92ab-b5629535dc82 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:27.977538 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bd5c3599-4c87-4c74-92ab-b5629535dc82 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:27.977966 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bd5c3599-4c87-4c74-92ab-b5629535dc82 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:28.154470 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-bd5c3599-4c87-4c74-92ab-b5629535dc82 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45a1d70add54293919369e7d34bd460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06da7a8a5fe84931beb76182a8072fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:52:28.163875 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-bd5c3599-4c87-4c74-92ab-b5629535dc82 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] 10.222.0.70 "GET /compute/v2.1/servers/9b4e4b65-ac0b-47ad-b700-50b70e099fdf" status: 200 len: 1755 microversion: 2.1 time: 0.201352 Aug 27 03:52:28.164529 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3437/6919] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:52:27 2022] GET /compute/v2.1/servers/9b4e4b65-ac0b-47ad-b700-50b70e099fdf => generated 1755 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:52:29.187544 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-91d8d7b5-370a-4079-8762-aaf292b6fb53 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:29.188393 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-91d8d7b5-370a-4079-8762-aaf292b6fb53 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] [instance: 9b4e4b65-ac0b-47ad-b700-50b70e099fdf] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:52:29.195611 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-91d8d7b5-370a-4079-8762-aaf292b6fb53 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:29.196130 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-91d8d7b5-370a-4079-8762-aaf292b6fb53 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:29.196608 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-91d8d7b5-370a-4079-8762-aaf292b6fb53 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:29.197422 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-91d8d7b5-370a-4079-8762-aaf292b6fb53 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:29.197914 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-91d8d7b5-370a-4079-8762-aaf292b6fb53 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:29.198402 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-91d8d7b5-370a-4079-8762-aaf292b6fb53 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:29.457146 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-91d8d7b5-370a-4079-8762-aaf292b6fb53 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45a1d70add54293919369e7d34bd460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06da7a8a5fe84931beb76182a8072fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:52:29.467721 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-91d8d7b5-370a-4079-8762-aaf292b6fb53 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] 10.222.0.70 "GET /compute/v2.1/servers/9b4e4b65-ac0b-47ad-b700-50b70e099fdf" status: 200 len: 1755 microversion: 2.1 time: 0.284577 Aug 27 03:52:29.468653 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3483/6920] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:52:29 2022] GET /compute/v2.1/servers/9b4e4b65-ac0b-47ad-b700-50b70e099fdf => generated 1755 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:52:30.491787 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d8ed0e93-8a9e-4637-8ab6-350bed125ffc tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:30.492465 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d8ed0e93-8a9e-4637-8ab6-350bed125ffc tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] [instance: 9b4e4b65-ac0b-47ad-b700-50b70e099fdf] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:52:30.500692 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d8ed0e93-8a9e-4637-8ab6-350bed125ffc tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:30.501301 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d8ed0e93-8a9e-4637-8ab6-350bed125ffc tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:30.501784 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d8ed0e93-8a9e-4637-8ab6-350bed125ffc tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:30.502559 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d8ed0e93-8a9e-4637-8ab6-350bed125ffc tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:30.503044 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d8ed0e93-8a9e-4637-8ab6-350bed125ffc tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:30.503571 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d8ed0e93-8a9e-4637-8ab6-350bed125ffc tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:30.665843 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-d8ed0e93-8a9e-4637-8ab6-350bed125ffc tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45a1d70add54293919369e7d34bd460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06da7a8a5fe84931beb76182a8072fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:52:30.674911 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d8ed0e93-8a9e-4637-8ab6-350bed125ffc tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] 10.222.0.70 "GET /compute/v2.1/servers/9b4e4b65-ac0b-47ad-b700-50b70e099fdf" status: 200 len: 1755 microversion: 2.1 time: 0.187250 Aug 27 03:52:30.675498 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3438/6921] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:52:30 2022] GET /compute/v2.1/servers/9b4e4b65-ac0b-47ad-b700-50b70e099fdf => generated 1755 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:52:31.696611 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-676669a0-d0f8-45a3-b02e-94b4f1aa5a3f tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:31.697263 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-676669a0-d0f8-45a3-b02e-94b4f1aa5a3f tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] [instance: 9b4e4b65-ac0b-47ad-b700-50b70e099fdf] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:52:31.704470 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-676669a0-d0f8-45a3-b02e-94b4f1aa5a3f tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:31.704964 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-676669a0-d0f8-45a3-b02e-94b4f1aa5a3f tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:31.705415 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-676669a0-d0f8-45a3-b02e-94b4f1aa5a3f tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:31.706150 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-676669a0-d0f8-45a3-b02e-94b4f1aa5a3f tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:31.706613 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-676669a0-d0f8-45a3-b02e-94b4f1aa5a3f tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:31.707052 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-676669a0-d0f8-45a3-b02e-94b4f1aa5a3f tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:31.872200 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-676669a0-d0f8-45a3-b02e-94b4f1aa5a3f tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45a1d70add54293919369e7d34bd460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06da7a8a5fe84931beb76182a8072fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:52:31.881282 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-676669a0-d0f8-45a3-b02e-94b4f1aa5a3f tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] 10.222.0.70 "GET /compute/v2.1/servers/9b4e4b65-ac0b-47ad-b700-50b70e099fdf" status: 200 len: 1758 microversion: 2.1 time: 0.188571 Aug 27 03:52:31.881878 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3484/6922] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:52:31 2022] GET /compute/v2.1/servers/9b4e4b65-ac0b-47ad-b700-50b70e099fdf => generated 1758 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:53:04.169042 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f19d536c-b883-4a3e-a855-a0527ef61070 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1732091812"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:53:04.169689 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-f19d536c-b883-4a3e-a855-a0527ef61070 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] [instance: 9b4e4b65-ac0b-47ad-b700-50b70e099fdf] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:53:04.172167 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=12 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:53:04.173187 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:53:04.174195 n-d-852278-4 devstack@n-api.service[134052]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:53:04.174344 n-d-852278-4 devstack@n-api.service[134052]: Sat Aug 27 03:53:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9b4e4b65-ac0b-47ad-b700-50b70e099fdf/action (ip 10.222.0.70) !!! Aug 27 03:53:04.186641 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f19d536c-b883-4a3e-a855-a0527ef61070 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:04.187055 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f19d536c-b883-4a3e-a855-a0527ef61070 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:04.187491 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f19d536c-b883-4a3e-a855-a0527ef61070 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:04.188203 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f19d536c-b883-4a3e-a855-a0527ef61070 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:04.188681 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f19d536c-b883-4a3e-a855-a0527ef61070 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:04.189100 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f19d536c-b883-4a3e-a855-a0527ef61070 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:04.387511 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.network.security_group_api [None req-f19d536c-b883-4a3e-a855-a0527ef61070 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Removing security group 00ccceb6-b2f1-4a83-8784-3e495d2a2b62 from port 7c5562d9-fdde-4329-acdc-c7e41167dc41 Aug 27 03:53:04.727767 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f19d536c-b883-4a3e-a855-a0527ef61070 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] 10.222.0.70 "POST /compute/v2.1/servers/9b4e4b65-ac0b-47ad-b700-50b70e099fdf/action" status: 202 len: 0 microversion: 2.1 time: 0.563007 Aug 27 03:53:04.728635 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3439/6923] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:53:04 2022] POST /compute/v2.1/servers/9b4e4b65-ac0b-47ad-b700-50b70e099fdf/action => generated 0 bytes in 564 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:53:04.737348 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-d564e6b2-ec16-4355-b944-e4f8882b28c9 req-bd0be6f1-3c29-4594-beb4-4696215c6d4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b4e4b65-ac0b-47ad-b700-50b70e099fdf", "tag": "7c5562d9-fdde-4329-acdc-c7e41167dc41"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:53:04.763386 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=12 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:53:04.765259 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=36 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:53:04.771599 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-d564e6b2-ec16-4355-b944-e4f8882b28c9 req-bd0be6f1-3c29-4594-beb4-4696215c6d4a service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:04.772527 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-d564e6b2-ec16-4355-b944-e4f8882b28c9 req-bd0be6f1-3c29-4594-beb4-4696215c6d4a service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:04.773847 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-d564e6b2-ec16-4355-b944-e4f8882b28c9 req-bd0be6f1-3c29-4594-beb4-4696215c6d4a service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:04.791418 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-d564e6b2-ec16-4355-b944-e4f8882b28c9 req-bd0be6f1-3c29-4594-beb4-4696215c6d4a service nova] Creating event network-changed:7c5562d9-fdde-4329-acdc-c7e41167dc41 for instance 9b4e4b65-ac0b-47ad-b700-50b70e099fdf on n-h2-852278-4 Aug 27 03:53:04.798871 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-d564e6b2-ec16-4355-b944-e4f8882b28c9 req-bd0be6f1-3c29-4594-beb4-4696215c6d4a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066516 Aug 27 03:53:04.799650 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3485/6924] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:53:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:53:05.851508 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-c13dd9d5-7ba2-4f19-9020-f7166a7de29a req-3917bc3d-e7f0-4c6a-ad70-63adfbf02374 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b4e4b65-ac0b-47ad-b700-50b70e099fdf", "tag": "7c5562d9-fdde-4329-acdc-c7e41167dc41"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:53:05.854227 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-39c1ea8a-18aa-4ca0-8a09-86440e40a66f tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:05.854839 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-39c1ea8a-18aa-4ca0-8a09-86440e40a66f tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] [instance: 9b4e4b65-ac0b-47ad-b700-50b70e099fdf] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:53:05.863237 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-c13dd9d5-7ba2-4f19-9020-f7166a7de29a req-3917bc3d-e7f0-4c6a-ad70-63adfbf02374 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:05.863824 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-c13dd9d5-7ba2-4f19-9020-f7166a7de29a req-3917bc3d-e7f0-4c6a-ad70-63adfbf02374 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:05.868003 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-39c1ea8a-18aa-4ca0-8a09-86440e40a66f tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:05.868204 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-c13dd9d5-7ba2-4f19-9020-f7166a7de29a req-3917bc3d-e7f0-4c6a-ad70-63adfbf02374 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:05.868343 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-39c1ea8a-18aa-4ca0-8a09-86440e40a66f tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:05.868343 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-39c1ea8a-18aa-4ca0-8a09-86440e40a66f tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:05.868343 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-39c1ea8a-18aa-4ca0-8a09-86440e40a66f tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:05.868343 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-39c1ea8a-18aa-4ca0-8a09-86440e40a66f tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:05.868343 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-39c1ea8a-18aa-4ca0-8a09-86440e40a66f tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:05.879795 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-c13dd9d5-7ba2-4f19-9020-f7166a7de29a req-3917bc3d-e7f0-4c6a-ad70-63adfbf02374 service nova] Creating event network-changed:7c5562d9-fdde-4329-acdc-c7e41167dc41 for instance 9b4e4b65-ac0b-47ad-b700-50b70e099fdf on n-h2-852278-4 Aug 27 03:53:05.885340 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-c13dd9d5-7ba2-4f19-9020-f7166a7de29a req-3917bc3d-e7f0-4c6a-ad70-63adfbf02374 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038240 Aug 27 03:53:05.886372 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3486/6925] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:53:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:53:05.997440 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.instance [None req-39c1ea8a-18aa-4ca0-8a09-86440e40a66f tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lazy-loading 'services' on Instance uuid 9b4e4b65-ac0b-47ad-b700-50b70e099fdf {{(pid=134052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:53:06.083353 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-39c1ea8a-18aa-4ca0-8a09-86440e40a66f tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] 10.222.0.70 "DELETE /compute/v2.1/servers/9b4e4b65-ac0b-47ad-b700-50b70e099fdf/os-volume_attachments/6d15f9df-ba7b-4bc2-a518-1332cc85cc1d" status: 202 len: 0 microversion: 2.1 time: 0.239050 Aug 27 03:53:06.084094 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3440/6926] 10.222.0.70 () {58 vars in 1416 bytes} [Sat Aug 27 03:53:05 2022] DELETE /compute/v2.1/servers/9b4e4b65-ac0b-47ad-b700-50b70e099fdf/os-volume_attachments/6d15f9df-ba7b-4bc2-a518-1332cc85cc1d => generated 0 bytes in 241 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:53:06.099630 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-494a2324-00e0-456e-a4b6-bb886e59f214 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:06.107141 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-494a2324-00e0-456e-a4b6-bb886e59f214 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] [instance: 9b4e4b65-ac0b-47ad-b700-50b70e099fdf] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:53:06.117559 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-494a2324-00e0-456e-a4b6-bb886e59f214 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:06.118426 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-494a2324-00e0-456e-a4b6-bb886e59f214 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:06.119074 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-494a2324-00e0-456e-a4b6-bb886e59f214 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:06.120103 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-494a2324-00e0-456e-a4b6-bb886e59f214 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:06.120772 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-494a2324-00e0-456e-a4b6-bb886e59f214 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:06.121386 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-494a2324-00e0-456e-a4b6-bb886e59f214 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:06.158994 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-494a2324-00e0-456e-a4b6-bb886e59f214 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] 10.222.0.70 "GET /compute/v2.1/servers/9b4e4b65-ac0b-47ad-b700-50b70e099fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068074 Aug 27 03:53:06.163917 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3487/6927] 10.222.0.70 () {58 vars in 1302 bytes} [Sat Aug 27 03:53:06 2022] GET /compute/v2.1/servers/9b4e4b65-ac0b-47ad-b700-50b70e099fdf/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:53:07.176817 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-7b899721-ee69-466e-a603-ba0d61d959a5 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:07.179383 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-7b899721-ee69-466e-a603-ba0d61d959a5 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] [instance: 9b4e4b65-ac0b-47ad-b700-50b70e099fdf] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:53:07.186123 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7b899721-ee69-466e-a603-ba0d61d959a5 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:07.186604 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7b899721-ee69-466e-a603-ba0d61d959a5 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:07.187104 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7b899721-ee69-466e-a603-ba0d61d959a5 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:07.187837 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7b899721-ee69-466e-a603-ba0d61d959a5 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:07.188277 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7b899721-ee69-466e-a603-ba0d61d959a5 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:07.188718 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7b899721-ee69-466e-a603-ba0d61d959a5 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:07.237858 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-7b899721-ee69-466e-a603-ba0d61d959a5 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] 10.222.0.70 "GET /compute/v2.1/servers/9b4e4b65-ac0b-47ad-b700-50b70e099fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068289 Aug 27 03:53:07.238501 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3441/6928] 10.222.0.70 () {58 vars in 1302 bytes} [Sat Aug 27 03:53:07 2022] GET /compute/v2.1/servers/9b4e4b65-ac0b-47ad-b700-50b70e099fdf/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:53:08.250920 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-182dd61d-ac92-4126-9445-6ae94b2d5b10 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:08.254034 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-182dd61d-ac92-4126-9445-6ae94b2d5b10 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] [instance: 9b4e4b65-ac0b-47ad-b700-50b70e099fdf] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:53:08.263842 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-182dd61d-ac92-4126-9445-6ae94b2d5b10 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:08.263842 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-182dd61d-ac92-4126-9445-6ae94b2d5b10 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:08.263842 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-182dd61d-ac92-4126-9445-6ae94b2d5b10 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:08.263842 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-182dd61d-ac92-4126-9445-6ae94b2d5b10 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:08.264209 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-182dd61d-ac92-4126-9445-6ae94b2d5b10 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:08.264708 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-182dd61d-ac92-4126-9445-6ae94b2d5b10 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:08.298776 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-182dd61d-ac92-4126-9445-6ae94b2d5b10 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] 10.222.0.70 "GET /compute/v2.1/servers/9b4e4b65-ac0b-47ad-b700-50b70e099fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051961 Aug 27 03:53:08.299367 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3488/6929] 10.222.0.70 () {58 vars in 1302 bytes} [Sat Aug 27 03:53:08 2022] GET /compute/v2.1/servers/9b4e4b65-ac0b-47ad-b700-50b70e099fdf/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:53:09.311843 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a7298b41-6de2-410d-a306-4268bdcf6d1f tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:09.314082 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a7298b41-6de2-410d-a306-4268bdcf6d1f tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] [instance: 9b4e4b65-ac0b-47ad-b700-50b70e099fdf] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:53:09.321894 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a7298b41-6de2-410d-a306-4268bdcf6d1f tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:09.322391 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a7298b41-6de2-410d-a306-4268bdcf6d1f tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:09.322829 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a7298b41-6de2-410d-a306-4268bdcf6d1f tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:09.323548 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a7298b41-6de2-410d-a306-4268bdcf6d1f tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:09.324023 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a7298b41-6de2-410d-a306-4268bdcf6d1f tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:09.324440 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a7298b41-6de2-410d-a306-4268bdcf6d1f tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:09.357387 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a7298b41-6de2-410d-a306-4268bdcf6d1f tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] 10.222.0.70 "GET /compute/v2.1/servers/9b4e4b65-ac0b-47ad-b700-50b70e099fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050148 Aug 27 03:53:09.357981 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3442/6930] 10.222.0.70 () {58 vars in 1302 bytes} [Sat Aug 27 03:53:09 2022] GET /compute/v2.1/servers/9b4e4b65-ac0b-47ad-b700-50b70e099fdf/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:53:10.371724 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-44083e35-a7e4-4d59-9ba4-7aef9220dc02 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:10.374100 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-44083e35-a7e4-4d59-9ba4-7aef9220dc02 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] [instance: 9b4e4b65-ac0b-47ad-b700-50b70e099fdf] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:53:10.382331 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-44083e35-a7e4-4d59-9ba4-7aef9220dc02 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:10.382820 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-44083e35-a7e4-4d59-9ba4-7aef9220dc02 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:10.383280 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-44083e35-a7e4-4d59-9ba4-7aef9220dc02 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:10.384027 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-44083e35-a7e4-4d59-9ba4-7aef9220dc02 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:10.384646 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-44083e35-a7e4-4d59-9ba4-7aef9220dc02 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:10.385003 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-44083e35-a7e4-4d59-9ba4-7aef9220dc02 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:10.418484 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-44083e35-a7e4-4d59-9ba4-7aef9220dc02 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] 10.222.0.70 "GET /compute/v2.1/servers/9b4e4b65-ac0b-47ad-b700-50b70e099fdf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051093 Aug 27 03:53:10.423380 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3489/6931] 10.222.0.70 () {58 vars in 1302 bytes} [Sat Aug 27 03:53:10 2022] GET /compute/v2.1/servers/9b4e4b65-ac0b-47ad-b700-50b70e099fdf/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:53:11.430348 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a5c6340c-91be-451e-a0f0-77737d7e682d tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:11.432697 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a5c6340c-91be-451e-a0f0-77737d7e682d tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] [instance: 9b4e4b65-ac0b-47ad-b700-50b70e099fdf] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:53:11.440404 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a5c6340c-91be-451e-a0f0-77737d7e682d tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:11.440997 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a5c6340c-91be-451e-a0f0-77737d7e682d tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:11.441685 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a5c6340c-91be-451e-a0f0-77737d7e682d tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:11.442488 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a5c6340c-91be-451e-a0f0-77737d7e682d tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:11.443066 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a5c6340c-91be-451e-a0f0-77737d7e682d tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:11.443507 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a5c6340c-91be-451e-a0f0-77737d7e682d tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:11.478164 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a5c6340c-91be-451e-a0f0-77737d7e682d tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] 10.222.0.70 "GET /compute/v2.1/servers/9b4e4b65-ac0b-47ad-b700-50b70e099fdf/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051879 Aug 27 03:53:11.478872 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3443/6932] 10.222.0.70 () {58 vars in 1302 bytes} [Sat Aug 27 03:53:11 2022] GET /compute/v2.1/servers/9b4e4b65-ac0b-47ad-b700-50b70e099fdf/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:53:11.489820 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-87596a79-df5a-45c9-b043-4d2fd0f245ea tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:11.490507 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-87596a79-df5a-45c9-b043-4d2fd0f245ea tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] [instance: 9b4e4b65-ac0b-47ad-b700-50b70e099fdf] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:53:11.498031 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-87596a79-df5a-45c9-b043-4d2fd0f245ea tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:11.498540 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-87596a79-df5a-45c9-b043-4d2fd0f245ea tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:11.499006 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-87596a79-df5a-45c9-b043-4d2fd0f245ea tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:11.499740 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-87596a79-df5a-45c9-b043-4d2fd0f245ea tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:11.500212 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-87596a79-df5a-45c9-b043-4d2fd0f245ea tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:11.500692 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-87596a79-df5a-45c9-b043-4d2fd0f245ea tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:11.687760 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-87596a79-df5a-45c9-b043-4d2fd0f245ea tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] HTTP exception thrown: Instance 9b4e4b65-ac0b-47ad-b700-50b70e099fdf is not attached to volume 6d15f9df-ba7b-4bc2-a518-1332cc85cc1d Aug 27 03:53:11.689774 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-87596a79-df5a-45c9-b043-4d2fd0f245ea tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Request method failure captured: Aug 27 03:53:11.689774 n-d-852278-4 devstack@n-api.service[134051]: request: DELETE /compute/v2.1/servers/9b4e4b65-ac0b-47ad-b700-50b70e099fdf/os-volume_attachments/6d15f9df-ba7b-4bc2-a518-1332cc85cc1d HTTP/1.1 Aug 27 03:53:11.689774 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 03:53:11.689774 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 03:53:11.689774 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 03:53:11.689774 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 03:53:11.689774 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 03:53:11.689774 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 03:53:11.689774 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 03:53:11.689774 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 03:53:11.689774 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCZO8vJlGzy2IiwoDT-3NfsAjSnZh2ozMyQr8juz9NLrHAPg4vRyyE58lRltxrtO4Ij7gAouPoYhqd2SKyvKsuCCwhD3jUJmmOLor8S8R4z9ZXATqQ19oQncxX8wP-QV-p9r9lM_O4F_QrvmUgYxfGRLDtYG6qpqWiHxfSECBBXnJTxU Aug 27 03:53:11.689774 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 03:53:11.689774 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 03:53:11.689774 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 03:53:11.689774 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 03:53:11.689774 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 03:53:11.689774 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 03:53:11.689774 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 06da7a8a5fe84931beb76182a8072fb2 Aug 27 03:53:11.689774 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-TestMinimumBasicScenario-1700299902 Aug 27 03:53:11.689774 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 03:53:11.689774 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 03:53:11.689774 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/06da7a8a5fe84931beb76182a8072fb2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_06da7a8a5fe84931beb76182a8072fb2", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/06da7a8a5fe84931beb76182a8072fb2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/06da7a8a5fe84931beb76182a8072fb2"}]}] Aug 27 03:53:11.689774 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-TestMinimumBasicScenario-1700299902 Aug 27 03:53:11.689774 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 06da7a8a5fe84931beb76182a8072fb2 Aug 27 03:53:11.689774 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1700299902 Aug 27 03:53:11.689774 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-TestMinimumBasicScenario-1700299902-project Aug 27 03:53:11.689774 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 03:53:11.689774 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 03:53:11.689774 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: f45a1d70add54293919369e7d34bd460 Aug 27 03:53:11.689774 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-TestMinimumBasicScenario-1700299902-project Aug 27 03:53:11.689774 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 03:53:11.689774 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance 9b4e4b65-ac0b-47ad-b700-50b70e099fdf is not attached to volume 6d15f9df-ba7b-4bc2-a518-1332cc85cc1d Aug 27 03:53:11.689774 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'server_id': '9b4e4b65-ac0b-47ad-b700-50b70e099fdf', 'id': '6d15f9df-ba7b-4bc2-a518-1332cc85cc1d'} Aug 27 03:53:11.689774 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:53:11.689774 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:53:11.689774 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 27 03:53:11.689774 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 27 03:53:11.689774 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 03:53:11.689774 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 03:53:11.689774 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 27 03:53:11.689774 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 27 03:53:11.689774 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 6d15f9df-ba7b-4bc2-a518-1332cc85cc1d. Aug 27 03:53:11.689774 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:53:11.689774 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:53:11.689774 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:53:11.689774 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:53:11.689774 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:53:11.689774 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:53:11.689774 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:53:11.689774 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:53:11.689774 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:53:11.689774 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:53:11.689774 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 27 03:53:11.689774 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 27 03:53:11.689774 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b4e4b65-ac0b-47ad-b700-50b70e099fdf is not attached to volume 6d15f9df-ba7b-4bc2-a518-1332cc85cc1d Aug 27 03:53:11.689774 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:53:11.689774 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:53:11.689774 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:53:11.689774 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:53:11.689774 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:53:11.689774 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:53:11.693855 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:53:11.693855 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:53:11.693855 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b4e4b65-ac0b-47ad-b700-50b70e099fdf is not attached to volume 6d15f9df-ba7b-4bc2-a518-1332cc85cc1d Aug 27 03:53:11.693855 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:53:11.693855 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-87596a79-df5a-45c9-b043-4d2fd0f245ea tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Returning 404 to user: Instance 9b4e4b65-ac0b-47ad-b700-50b70e099fdf is not attached to volume 6d15f9df-ba7b-4bc2-a518-1332cc85cc1d {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:53:11.693855 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-87596a79-df5a-45c9-b043-4d2fd0f245ea tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] 10.222.0.70 "DELETE /compute/v2.1/servers/9b4e4b65-ac0b-47ad-b700-50b70e099fdf/os-volume_attachments/6d15f9df-ba7b-4bc2-a518-1332cc85cc1d" status: 404 len: 154 microversion: 2.1 time: 0.205816 Aug 27 03:53:11.693855 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3490/6933] 10.222.0.70 () {58 vars in 1416 bytes} [Sat Aug 27 03:53:11 2022] DELETE /compute/v2.1/servers/9b4e4b65-ac0b-47ad-b700-50b70e099fdf/os-volume_attachments/6d15f9df-ba7b-4bc2-a518-1332cc85cc1d => generated 154 bytes in 207 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:53:14.957275 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-1e305635-6c7d-4065-95eb-0cc4bd030fa7 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:14.957827 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-1e305635-6c7d-4065-95eb-0cc4bd030fa7 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] [instance: 9b4e4b65-ac0b-47ad-b700-50b70e099fdf] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:53:14.965015 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1e305635-6c7d-4065-95eb-0cc4bd030fa7 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:14.965501 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1e305635-6c7d-4065-95eb-0cc4bd030fa7 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:14.965930 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1e305635-6c7d-4065-95eb-0cc4bd030fa7 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:14.966641 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1e305635-6c7d-4065-95eb-0cc4bd030fa7 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:14.967080 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1e305635-6c7d-4065-95eb-0cc4bd030fa7 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:14.967493 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1e305635-6c7d-4065-95eb-0cc4bd030fa7 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:14.995541 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-1e305635-6c7d-4065-95eb-0cc4bd030fa7 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] [instance: 9b4e4b65-ac0b-47ad-b700-50b70e099fdf] Going to try to terminate instance {{(pid=134052) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:53:15.084504 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-1e305635-6c7d-4065-95eb-0cc4bd030fa7 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] 10.222.0.70 "DELETE /compute/v2.1/servers/9b4e4b65-ac0b-47ad-b700-50b70e099fdf" status: 204 len: 0 microversion: 2.1 time: 0.130911 Aug 27 03:53:15.089209 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3444/6934] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 03:53:14 2022] DELETE /compute/v2.1/servers/9b4e4b65-ac0b-47ad-b700-50b70e099fdf => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:53:15.094753 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-32fbca96-db59-4b7c-9c67-0bf7a80afab4 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:15.095375 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-32fbca96-db59-4b7c-9c67-0bf7a80afab4 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] [instance: 9b4e4b65-ac0b-47ad-b700-50b70e099fdf] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:53:15.104765 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-32fbca96-db59-4b7c-9c67-0bf7a80afab4 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:15.105280 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-32fbca96-db59-4b7c-9c67-0bf7a80afab4 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:15.105724 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-32fbca96-db59-4b7c-9c67-0bf7a80afab4 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:15.106453 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-32fbca96-db59-4b7c-9c67-0bf7a80afab4 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:15.106919 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-32fbca96-db59-4b7c-9c67-0bf7a80afab4 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:15.107354 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-32fbca96-db59-4b7c-9c67-0bf7a80afab4 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:15.259996 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-32fbca96-db59-4b7c-9c67-0bf7a80afab4 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45a1d70add54293919369e7d34bd460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06da7a8a5fe84931beb76182a8072fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:53:15.268342 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-32fbca96-db59-4b7c-9c67-0bf7a80afab4 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] 10.222.0.70 "GET /compute/v2.1/servers/9b4e4b65-ac0b-47ad-b700-50b70e099fdf" status: 200 len: 1553 microversion: 2.1 time: 0.177795 Aug 27 03:53:15.269000 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3491/6935] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:53:15 2022] GET /compute/v2.1/servers/9b4e4b65-ac0b-47ad-b700-50b70e099fdf => generated 1553 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:53:16.291449 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4b340e6f-093c-449d-92c2-f138b380c92a tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:16.292371 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-4b340e6f-093c-449d-92c2-f138b380c92a tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] [instance: 9b4e4b65-ac0b-47ad-b700-50b70e099fdf] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:53:16.300875 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4b340e6f-093c-449d-92c2-f138b380c92a tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:16.301428 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4b340e6f-093c-449d-92c2-f138b380c92a tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:16.301861 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4b340e6f-093c-449d-92c2-f138b380c92a tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:16.302573 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4b340e6f-093c-449d-92c2-f138b380c92a tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:16.303015 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4b340e6f-093c-449d-92c2-f138b380c92a tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:16.303438 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4b340e6f-093c-449d-92c2-f138b380c92a tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:16.449263 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-4b340e6f-093c-449d-92c2-f138b380c92a tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45a1d70add54293919369e7d34bd460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06da7a8a5fe84931beb76182a8072fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:53:16.462888 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-4b340e6f-093c-449d-92c2-f138b380c92a tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] 10.222.0.70 "GET /compute/v2.1/servers/9b4e4b65-ac0b-47ad-b700-50b70e099fdf" status: 200 len: 1553 microversion: 2.1 time: 0.175889 Aug 27 03:53:16.463791 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3445/6936] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:53:16 2022] GET /compute/v2.1/servers/9b4e4b65-ac0b-47ad-b700-50b70e099fdf => generated 1553 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:53:17.250146 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-5fd2e93e-c94a-470b-a0f8-653b91475c47 req-a1b92cc8-097d-42bc-87ec-a7ae3891bc47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b4e4b65-ac0b-47ad-b700-50b70e099fdf", "name": "network-vif-deleted", "tag": "7c5562d9-fdde-4329-acdc-c7e41167dc41"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:53:17.261184 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-5fd2e93e-c94a-470b-a0f8-653b91475c47 req-a1b92cc8-097d-42bc-87ec-a7ae3891bc47 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:17.261680 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-5fd2e93e-c94a-470b-a0f8-653b91475c47 req-a1b92cc8-097d-42bc-87ec-a7ae3891bc47 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:17.262121 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-5fd2e93e-c94a-470b-a0f8-653b91475c47 req-a1b92cc8-097d-42bc-87ec-a7ae3891bc47 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:17.276683 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-5fd2e93e-c94a-470b-a0f8-653b91475c47 req-a1b92cc8-097d-42bc-87ec-a7ae3891bc47 service nova] Creating event network-vif-deleted:7c5562d9-fdde-4329-acdc-c7e41167dc41 for instance 9b4e4b65-ac0b-47ad-b700-50b70e099fdf on n-h2-852278-4 Aug 27 03:53:17.282392 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-5fd2e93e-c94a-470b-a0f8-653b91475c47 req-a1b92cc8-097d-42bc-87ec-a7ae3891bc47 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035736 Aug 27 03:53:17.283029 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3492/6937] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:53:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:53:17.487715 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-fda19097-dd41-4fd2-bcd8-af0d673f9eeb tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:17.488247 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-fda19097-dd41-4fd2-bcd8-af0d673f9eeb tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] [instance: 9b4e4b65-ac0b-47ad-b700-50b70e099fdf] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:53:17.497274 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fda19097-dd41-4fd2-bcd8-af0d673f9eeb tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:17.497765 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fda19097-dd41-4fd2-bcd8-af0d673f9eeb tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:17.498205 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fda19097-dd41-4fd2-bcd8-af0d673f9eeb tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:17.498913 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fda19097-dd41-4fd2-bcd8-af0d673f9eeb tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:17.499366 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fda19097-dd41-4fd2-bcd8-af0d673f9eeb tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:17.499788 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fda19097-dd41-4fd2-bcd8-af0d673f9eeb tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:17.536850 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fda19097-dd41-4fd2-bcd8-af0d673f9eeb tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:17.537459 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fda19097-dd41-4fd2-bcd8-af0d673f9eeb tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:17.537901 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fda19097-dd41-4fd2-bcd8-af0d673f9eeb tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:17.538383 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.instance [None req-fda19097-dd41-4fd2-bcd8-af0d673f9eeb tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lazy-loading 'fault' on Instance uuid 9b4e4b65-ac0b-47ad-b700-50b70e099fdf {{(pid=134052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:53:17.582784 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-fda19097-dd41-4fd2-bcd8-af0d673f9eeb tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45a1d70add54293919369e7d34bd460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06da7a8a5fe84931beb76182a8072fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:53:17.591233 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-fda19097-dd41-4fd2-bcd8-af0d673f9eeb tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] 10.222.0.70 "GET /compute/v2.1/servers/9b4e4b65-ac0b-47ad-b700-50b70e099fdf" status: 200 len: 1347 microversion: 2.1 time: 0.109512 Aug 27 03:53:17.592087 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3446/6938] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:53:17 2022] GET /compute/v2.1/servers/9b4e4b65-ac0b-47ad-b700-50b70e099fdf => generated 1347 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:53:18.614825 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-6ea41a8d-753d-42d2-bff7-6fa4589cf1f8 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:18.615539 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-6ea41a8d-753d-42d2-bff7-6fa4589cf1f8 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] [instance: 9b4e4b65-ac0b-47ad-b700-50b70e099fdf] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:53:18.622593 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6ea41a8d-753d-42d2-bff7-6fa4589cf1f8 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:18.623099 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6ea41a8d-753d-42d2-bff7-6fa4589cf1f8 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:18.623549 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6ea41a8d-753d-42d2-bff7-6fa4589cf1f8 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:18.624272 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6ea41a8d-753d-42d2-bff7-6fa4589cf1f8 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:18.624775 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6ea41a8d-753d-42d2-bff7-6fa4589cf1f8 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:18.625216 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6ea41a8d-753d-42d2-bff7-6fa4589cf1f8 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:18.639642 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-6ea41a8d-753d-42d2-bff7-6fa4589cf1f8 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] HTTP exception thrown: Instance 9b4e4b65-ac0b-47ad-b700-50b70e099fdf could not be found. Aug 27 03:53:18.641360 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-6ea41a8d-753d-42d2-bff7-6fa4589cf1f8 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Request method failure captured: Aug 27 03:53:18.641360 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/9b4e4b65-ac0b-47ad-b700-50b70e099fdf HTTP/1.1 Aug 27 03:53:18.641360 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 03:53:18.641360 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 03:53:18.641360 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 03:53:18.641360 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 03:53:18.641360 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 03:53:18.641360 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 03:53:18.641360 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 03:53:18.641360 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 03:53:18.641360 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCZO8vJlGzy2IiwoDT-3NfsAjSnZh2ozMyQr8juz9NLrHAPg4vRyyE58lRltxrtO4Ij7gAouPoYhqd2SKyvKsuCCwhD3jUJmmOLor8S8R4z9ZXATqQ19oQncxX8wP-QV-p9r9lM_O4F_QrvmUgYxfGRLDtYG6qpqWiHxfSECBBXnJTxU Aug 27 03:53:18.641360 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 03:53:18.641360 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 03:53:18.641360 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 03:53:18.641360 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 03:53:18.641360 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 03:53:18.641360 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 03:53:18.641360 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 06da7a8a5fe84931beb76182a8072fb2 Aug 27 03:53:18.641360 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-TestMinimumBasicScenario-1700299902 Aug 27 03:53:18.641360 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 03:53:18.641360 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 03:53:18.641360 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/06da7a8a5fe84931beb76182a8072fb2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_06da7a8a5fe84931beb76182a8072fb2", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/06da7a8a5fe84931beb76182a8072fb2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/06da7a8a5fe84931beb76182a8072fb2"}]}] Aug 27 03:53:18.641360 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-TestMinimumBasicScenario-1700299902 Aug 27 03:53:18.641360 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 06da7a8a5fe84931beb76182a8072fb2 Aug 27 03:53:18.641360 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1700299902 Aug 27 03:53:18.641360 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-TestMinimumBasicScenario-1700299902-project Aug 27 03:53:18.641360 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 03:53:18.641360 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 03:53:18.641360 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: f45a1d70add54293919369e7d34bd460 Aug 27 03:53:18.641360 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-TestMinimumBasicScenario-1700299902-project Aug 27 03:53:18.641360 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 03:53:18.641360 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance 9b4e4b65-ac0b-47ad-b700-50b70e099fdf could not be found. Aug 27 03:53:18.641360 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '9b4e4b65-ac0b-47ad-b700-50b70e099fdf'} Aug 27 03:53:18.641360 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:53:18.641360 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:53:18.641360 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:53:18.641360 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:53:18.641360 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:53:18.641360 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:53:18.641360 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:53:18.641360 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:53:18.641360 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:53:18.641360 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:53:18.641360 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b4e4b65-ac0b-47ad-b700-50b70e099fdf could not be found. Aug 27 03:53:18.641360 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:53:18.641360 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:53:18.641360 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:53:18.641360 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:53:18.641360 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:53:18.641360 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:53:18.641360 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:53:18.641360 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:53:18.641360 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:53:18.641360 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:53:18.641360 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:53:18.641360 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:53:18.641360 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:53:18.641360 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:53:18.641360 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:53:18.641360 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:53:18.641360 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b4e4b65-ac0b-47ad-b700-50b70e099fdf could not be found. Aug 27 03:53:18.641360 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:53:18.641360 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:53:18.641360 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:53:18.645624 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:53:18.645624 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:53:18.645624 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:53:18.645624 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:53:18.645624 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:53:18.645624 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b4e4b65-ac0b-47ad-b700-50b70e099fdf could not be found. Aug 27 03:53:18.645624 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:53:18.645624 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-6ea41a8d-753d-42d2-bff7-6fa4589cf1f8 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Returning 404 to user: Instance 9b4e4b65-ac0b-47ad-b700-50b70e099fdf could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:53:18.645624 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-6ea41a8d-753d-42d2-bff7-6fa4589cf1f8 tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] 10.222.0.70 "GET /compute/v2.1/servers/9b4e4b65-ac0b-47ad-b700-50b70e099fdf" status: 404 len: 111 microversion: 2.1 time: 0.033275 Aug 27 03:53:18.645624 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3493/6939] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:53:18 2022] GET /compute/v2.1/servers/9b4e4b65-ac0b-47ad-b700-50b70e099fdf => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:53:18.654566 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-14f2ab11-d856-4586-a8b0-f5e71adac77f tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] Calling method '.version_select at 0x7f5ee240a1f0>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:18.681823 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-14f2ab11-d856-4586-a8b0-f5e71adac77f tempest-TestMinimumBasicScenario-1700299902 tempest-TestMinimumBasicScenario-1700299902-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-853938900" status: 202 len: 0 microversion: 2.1 time: 0.033423 Aug 27 03:53:18.682411 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3447/6940] 10.222.0.70 () {58 vars in 1269 bytes} [Sat Aug 27 03:53:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-853938900 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:53:28.485097 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7a6d3d0b-b7b6-4a49-ba6b-22fdff78c275 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Action: 'create', calling method: .version_select at 0x7f5eded21a60>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1673330020", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDwtAueM+tKAHoVVZ5bDVVBZwBZznEGwp2abtG1WqromMIk04yPyg35vnwtK/aNEZntUyb24vqg6cZSCObupdYBRsLp6qDestej4Is6qK+Z0Z8xI2NtCttK5h7pAwCRIQg=="}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:53:28.504582 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-7a6d3d0b-b7b6-4a49-ba6b-22fdff78c275 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Getting quotas for project 961e5856cfda49f3a46a5db96d35050f. Resources: {'key_pairs'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:53:28.510812 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-7a6d3d0b-b7b6-4a49-ba6b-22fdff78c275 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Getting quotas for user 4dd9a215fc244b839b2334274274675f and project 961e5856cfda49f3a46a5db96d35050f. Resources: {'key_pairs'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:53:28.542443 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-7a6d3d0b-b7b6-4a49-ba6b-22fdff78c275 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.247361 Aug 27 03:53:28.543084 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3494/6941] 10.222.0.70 () {60 vars in 1159 bytes} [Sat Aug 27 03:53:28 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:53:35.203466 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=59,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:53:35.204378 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:53:35.209109 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9eb28cb3-bc94-4ee3-b413-04d4add596bd tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-145902023", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "networks": [{"uuid": "6aeb8505-4534-45f6-afb4-eb551cbfa887"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1673330020", "security_groups": [{"name": "tempest-secgroup-smoke-986809899"}]}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:53:35.339035 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.network.neutron [None req-9eb28cb3-bc94-4ee3-b413-04d4add596bd tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] validate_networks() for [('6aeb8505-4534-45f6-afb4-eb551cbfa887', None, None, None, None, None)] {{(pid=134052) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:53:35.864102 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-9eb28cb3-bc94-4ee3-b413-04d4add596bd tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Flavor limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:53:35.864805 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-9eb28cb3-bc94-4ee3-b413-04d4add596bd tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Image limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:53:35.865337 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-9eb28cb3-bc94-4ee3-b413-04d4add596bd tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Flavor pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:53:35.865864 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-9eb28cb3-bc94-4ee3-b413-04d4add596bd tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Image pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:53:35.866381 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-9eb28cb3-bc94-4ee3-b413-04d4add596bd tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:53:35.878369 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9eb28cb3-bc94-4ee3-b413-04d4add596bd tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:35.878881 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9eb28cb3-bc94-4ee3-b413-04d4add596bd tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:35.879319 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9eb28cb3-bc94-4ee3-b413-04d4add596bd tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:35.880062 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9eb28cb3-bc94-4ee3-b413-04d4add596bd tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:35.880550 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9eb28cb3-bc94-4ee3-b413-04d4add596bd tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:35.881060 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9eb28cb3-bc94-4ee3-b413-04d4add596bd tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:35.901097 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-9eb28cb3-bc94-4ee3-b413-04d4add596bd tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Getting quotas for project 961e5856cfda49f3a46a5db96d35050f. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:53:35.909338 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-9eb28cb3-bc94-4ee3-b413-04d4add596bd tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Getting quotas for user 4dd9a215fc244b839b2334274274675f and project 961e5856cfda49f3a46a5db96d35050f. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:53:35.931215 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-9eb28cb3-bc94-4ee3-b413-04d4add596bd tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Going to run 1 instances... {{(pid=134052) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:53:35.934093 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-9eb28cb3-bc94-4ee3-b413-04d4add596bd tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 1b90d345-fbca-4898-a77a-dea13164ba55] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134052) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:53:36.012154 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9eb28cb3-bc94-4ee3-b413-04d4add596bd tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.811034 Aug 27 03:53:36.021038 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3448/6942] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 03:53:35 2022] POST /compute/v2.1/servers => generated 405 bytes in 813 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:53:36.027193 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=38 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:53:36.039532 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b8df38c9-e5c4-4408-b310-99bf11e65c0a tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:36.041141 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b8df38c9-e5c4-4408-b310-99bf11e65c0a tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 1b90d345-fbca-4898-a77a-dea13164ba55] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:53:36.054649 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:53:36.114377 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-b8df38c9-e5c4-4408-b310-99bf11e65c0a tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:53:36.123949 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b8df38c9-e5c4-4408-b310-99bf11e65c0a tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/1b90d345-fbca-4898-a77a-dea13164ba55" status: 200 len: 1266 microversion: 2.1 time: 0.097899 Aug 27 03:53:36.138154 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3495/6943] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:53:36 2022] GET /compute/v2.1/servers/1b90d345-fbca-4898-a77a-dea13164ba55 => generated 1266 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:53:37.147522 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f9ddafad-3006-411e-b925-3e41f97da3c9 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:37.148142 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-f9ddafad-3006-411e-b925-3e41f97da3c9 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 1b90d345-fbca-4898-a77a-dea13164ba55] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:53:37.155701 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f9ddafad-3006-411e-b925-3e41f97da3c9 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:37.156232 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f9ddafad-3006-411e-b925-3e41f97da3c9 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:37.156725 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f9ddafad-3006-411e-b925-3e41f97da3c9 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:37.157480 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f9ddafad-3006-411e-b925-3e41f97da3c9 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:37.157941 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f9ddafad-3006-411e-b925-3e41f97da3c9 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:37.158373 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f9ddafad-3006-411e-b925-3e41f97da3c9 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:37.232204 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-f9ddafad-3006-411e-b925-3e41f97da3c9 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:53:37.242483 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f9ddafad-3006-411e-b925-3e41f97da3c9 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/1b90d345-fbca-4898-a77a-dea13164ba55" status: 200 len: 1318 microversion: 2.1 time: 0.100557 Aug 27 03:53:37.243335 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3449/6944] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:53:37 2022] GET /compute/v2.1/servers/1b90d345-fbca-4898-a77a-dea13164ba55 => generated 1318 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:53:38.263648 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-9fb8901c-0c0b-474d-91a5-52736676aed5 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:38.265079 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-9fb8901c-0c0b-474d-91a5-52736676aed5 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 1b90d345-fbca-4898-a77a-dea13164ba55] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:53:38.283881 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9fb8901c-0c0b-474d-91a5-52736676aed5 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:38.285276 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9fb8901c-0c0b-474d-91a5-52736676aed5 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:38.286400 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9fb8901c-0c0b-474d-91a5-52736676aed5 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:38.287627 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9fb8901c-0c0b-474d-91a5-52736676aed5 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:38.288391 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9fb8901c-0c0b-474d-91a5-52736676aed5 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:38.289066 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9fb8901c-0c0b-474d-91a5-52736676aed5 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:38.532149 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-9fb8901c-0c0b-474d-91a5-52736676aed5 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:53:38.541413 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-9fb8901c-0c0b-474d-91a5-52736676aed5 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/1b90d345-fbca-4898-a77a-dea13164ba55" status: 200 len: 1391 microversion: 2.1 time: 0.281981 Aug 27 03:53:38.542023 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3496/6945] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:53:38 2022] GET /compute/v2.1/servers/1b90d345-fbca-4898-a77a-dea13164ba55 => generated 1391 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:53:39.351511 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-25cc7705-f2ff-4118-afe5-0fa6f5f2d010 req-70a1c35b-af67-40cb-a7c3-6f1db31a9f8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b90d345-fbca-4898-a77a-dea13164ba55", "tag": "b961bcb3-3f9f-40a1-be82-69b5d2d7c61b"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:53:39.365246 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-25cc7705-f2ff-4118-afe5-0fa6f5f2d010 req-70a1c35b-af67-40cb-a7c3-6f1db31a9f8b service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:39.366232 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-25cc7705-f2ff-4118-afe5-0fa6f5f2d010 req-70a1c35b-af67-40cb-a7c3-6f1db31a9f8b service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:39.374961 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-25cc7705-f2ff-4118-afe5-0fa6f5f2d010 req-70a1c35b-af67-40cb-a7c3-6f1db31a9f8b service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:39.391583 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-25cc7705-f2ff-4118-afe5-0fa6f5f2d010 req-70a1c35b-af67-40cb-a7c3-6f1db31a9f8b service nova] Creating event network-changed:b961bcb3-3f9f-40a1-be82-69b5d2d7c61b for instance 1b90d345-fbca-4898-a77a-dea13164ba55 on n-h2-852278-4 Aug 27 03:53:39.397573 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-25cc7705-f2ff-4118-afe5-0fa6f5f2d010 req-70a1c35b-af67-40cb-a7c3-6f1db31a9f8b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050723 Aug 27 03:53:39.398214 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3450/6946] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:53:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:53:39.563818 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3bfad5ca-4cba-4998-b36b-24cdd808b150 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:39.564462 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-3bfad5ca-4cba-4998-b36b-24cdd808b150 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 1b90d345-fbca-4898-a77a-dea13164ba55] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:53:39.573010 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3bfad5ca-4cba-4998-b36b-24cdd808b150 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:39.573536 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3bfad5ca-4cba-4998-b36b-24cdd808b150 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:39.573986 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3bfad5ca-4cba-4998-b36b-24cdd808b150 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:39.574715 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3bfad5ca-4cba-4998-b36b-24cdd808b150 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:39.575179 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3bfad5ca-4cba-4998-b36b-24cdd808b150 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:39.575600 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3bfad5ca-4cba-4998-b36b-24cdd808b150 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:39.845170 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-3bfad5ca-4cba-4998-b36b-24cdd808b150 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:53:39.856434 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-3bfad5ca-4cba-4998-b36b-24cdd808b150 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/1b90d345-fbca-4898-a77a-dea13164ba55" status: 200 len: 1391 microversion: 2.1 time: 0.296289 Aug 27 03:53:39.858066 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3497/6947] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:53:39 2022] GET /compute/v2.1/servers/1b90d345-fbca-4898-a77a-dea13164ba55 => generated 1391 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:53:40.881195 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8c0f4fad-b7d7-4562-a994-c8954de7248c tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:40.881872 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-8c0f4fad-b7d7-4562-a994-c8954de7248c tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 1b90d345-fbca-4898-a77a-dea13164ba55] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:53:40.889523 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8c0f4fad-b7d7-4562-a994-c8954de7248c tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:40.890097 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8c0f4fad-b7d7-4562-a994-c8954de7248c tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:40.890673 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8c0f4fad-b7d7-4562-a994-c8954de7248c tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:40.891484 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8c0f4fad-b7d7-4562-a994-c8954de7248c tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:40.892009 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8c0f4fad-b7d7-4562-a994-c8954de7248c tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:40.892552 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8c0f4fad-b7d7-4562-a994-c8954de7248c tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:41.132175 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-8c0f4fad-b7d7-4562-a994-c8954de7248c tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:53:41.141320 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-8c0f4fad-b7d7-4562-a994-c8954de7248c tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/1b90d345-fbca-4898-a77a-dea13164ba55" status: 200 len: 1391 microversion: 2.1 time: 0.266130 Aug 27 03:53:41.141929 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3451/6948] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:53:40 2022] GET /compute/v2.1/servers/1b90d345-fbca-4898-a77a-dea13164ba55 => generated 1391 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:53:42.165627 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-6ecb7c2e-823b-44ba-be3a-ebe9224e631f tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:42.166481 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-6ecb7c2e-823b-44ba-be3a-ebe9224e631f tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 1b90d345-fbca-4898-a77a-dea13164ba55] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:53:42.177917 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6ecb7c2e-823b-44ba-be3a-ebe9224e631f tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:42.178398 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6ecb7c2e-823b-44ba-be3a-ebe9224e631f tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:42.178873 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6ecb7c2e-823b-44ba-be3a-ebe9224e631f tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:42.179852 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6ecb7c2e-823b-44ba-be3a-ebe9224e631f tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:42.180580 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6ecb7c2e-823b-44ba-be3a-ebe9224e631f tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:42.181053 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6ecb7c2e-823b-44ba-be3a-ebe9224e631f tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:42.330890 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-6ecb7c2e-823b-44ba-be3a-ebe9224e631f tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:53:42.340263 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-6ecb7c2e-823b-44ba-be3a-ebe9224e631f tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/1b90d345-fbca-4898-a77a-dea13164ba55" status: 200 len: 1391 microversion: 2.1 time: 0.180629 Aug 27 03:53:42.340903 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3498/6949] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:53:42 2022] GET /compute/v2.1/servers/1b90d345-fbca-4898-a77a-dea13164ba55 => generated 1391 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:53:43.361614 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-1648a314-3ee7-4755-9913-4b3c5aea99ca tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:43.362386 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-1648a314-3ee7-4755-9913-4b3c5aea99ca tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 1b90d345-fbca-4898-a77a-dea13164ba55] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:53:43.369332 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1648a314-3ee7-4755-9913-4b3c5aea99ca tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:43.369933 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1648a314-3ee7-4755-9913-4b3c5aea99ca tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:43.370267 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1648a314-3ee7-4755-9913-4b3c5aea99ca tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:43.370987 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1648a314-3ee7-4755-9913-4b3c5aea99ca tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:43.371426 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1648a314-3ee7-4755-9913-4b3c5aea99ca tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:43.371933 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1648a314-3ee7-4755-9913-4b3c5aea99ca tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:43.516438 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-1648a314-3ee7-4755-9913-4b3c5aea99ca tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:53:43.526977 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-1648a314-3ee7-4755-9913-4b3c5aea99ca tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/1b90d345-fbca-4898-a77a-dea13164ba55" status: 200 len: 1391 microversion: 2.1 time: 0.169698 Aug 27 03:53:43.527805 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3452/6950] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:53:43 2022] GET /compute/v2.1/servers/1b90d345-fbca-4898-a77a-dea13164ba55 => generated 1391 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:53:44.548683 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-709954f6-797d-486a-898f-4325150d9a76 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:44.549245 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-709954f6-797d-486a-898f-4325150d9a76 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 1b90d345-fbca-4898-a77a-dea13164ba55] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:53:44.556754 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-709954f6-797d-486a-898f-4325150d9a76 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:44.557262 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-709954f6-797d-486a-898f-4325150d9a76 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:44.557712 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-709954f6-797d-486a-898f-4325150d9a76 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:44.558435 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-709954f6-797d-486a-898f-4325150d9a76 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:44.558903 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-709954f6-797d-486a-898f-4325150d9a76 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:44.559341 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-709954f6-797d-486a-898f-4325150d9a76 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:44.699788 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-709954f6-797d-486a-898f-4325150d9a76 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:53:44.708458 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-709954f6-797d-486a-898f-4325150d9a76 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/1b90d345-fbca-4898-a77a-dea13164ba55" status: 200 len: 1391 microversion: 2.1 time: 0.164113 Aug 27 03:53:44.709096 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3499/6951] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:53:44 2022] GET /compute/v2.1/servers/1b90d345-fbca-4898-a77a-dea13164ba55 => generated 1391 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:53:44.884752 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-2ee9feab-a267-4fa2-a20a-b88658b6fee3 req-bc4a9e8e-c7bf-4a09-b12e-575c7132c274 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b90d345-fbca-4898-a77a-dea13164ba55", "name": "network-vif-plugged", "status": "completed", "tag": "b961bcb3-3f9f-40a1-be82-69b5d2d7c61b"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:53:44.896693 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-2ee9feab-a267-4fa2-a20a-b88658b6fee3 req-bc4a9e8e-c7bf-4a09-b12e-575c7132c274 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:44.897190 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-2ee9feab-a267-4fa2-a20a-b88658b6fee3 req-bc4a9e8e-c7bf-4a09-b12e-575c7132c274 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:44.897632 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-2ee9feab-a267-4fa2-a20a-b88658b6fee3 req-bc4a9e8e-c7bf-4a09-b12e-575c7132c274 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:44.912115 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-2ee9feab-a267-4fa2-a20a-b88658b6fee3 req-bc4a9e8e-c7bf-4a09-b12e-575c7132c274 service nova] Creating event network-vif-plugged:b961bcb3-3f9f-40a1-be82-69b5d2d7c61b for instance 1b90d345-fbca-4898-a77a-dea13164ba55 on n-h2-852278-4 Aug 27 03:53:44.922322 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-2ee9feab-a267-4fa2-a20a-b88658b6fee3 req-bc4a9e8e-c7bf-4a09-b12e-575c7132c274 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037084 Aug 27 03:53:44.922322 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3453/6952] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:53:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:53:45.730878 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3602ef24-fef3-45b0-ac38-843f61d4122b tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:45.731476 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-3602ef24-fef3-45b0-ac38-843f61d4122b tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 1b90d345-fbca-4898-a77a-dea13164ba55] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:53:45.739171 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3602ef24-fef3-45b0-ac38-843f61d4122b tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:45.739699 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3602ef24-fef3-45b0-ac38-843f61d4122b tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:45.740157 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3602ef24-fef3-45b0-ac38-843f61d4122b tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:45.740935 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3602ef24-fef3-45b0-ac38-843f61d4122b tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:45.741408 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3602ef24-fef3-45b0-ac38-843f61d4122b tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:45.741851 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3602ef24-fef3-45b0-ac38-843f61d4122b tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:45.896548 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-3602ef24-fef3-45b0-ac38-843f61d4122b tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:53:45.905474 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-3602ef24-fef3-45b0-ac38-843f61d4122b tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/1b90d345-fbca-4898-a77a-dea13164ba55" status: 200 len: 1391 microversion: 2.1 time: 0.178546 Aug 27 03:53:45.906196 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3500/6953] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:53:45 2022] GET /compute/v2.1/servers/1b90d345-fbca-4898-a77a-dea13164ba55 => generated 1391 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:53:46.932053 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b3dcd14b-f80b-4b92-990c-41533b5230c3 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:46.932791 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b3dcd14b-f80b-4b92-990c-41533b5230c3 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 1b90d345-fbca-4898-a77a-dea13164ba55] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:53:46.935012 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:53:46.936654 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=6 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:53:46.944015 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b3dcd14b-f80b-4b92-990c-41533b5230c3 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:46.944537 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b3dcd14b-f80b-4b92-990c-41533b5230c3 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:46.944982 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b3dcd14b-f80b-4b92-990c-41533b5230c3 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:46.945721 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b3dcd14b-f80b-4b92-990c-41533b5230c3 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:46.946166 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b3dcd14b-f80b-4b92-990c-41533b5230c3 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:46.946590 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b3dcd14b-f80b-4b92-990c-41533b5230c3 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:47.094445 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b3dcd14b-f80b-4b92-990c-41533b5230c3 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:53:47.102899 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b3dcd14b-f80b-4b92-990c-41533b5230c3 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/1b90d345-fbca-4898-a77a-dea13164ba55" status: 200 len: 1562 microversion: 2.1 time: 0.175182 Aug 27 03:53:47.103928 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3454/6954] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:53:46 2022] GET /compute/v2.1/servers/1b90d345-fbca-4898-a77a-dea13164ba55 => generated 1562 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:53:47.124110 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4cd46928-f1f1-45a9-9ad9-58ed1762ceb3 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:47.124773 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-4cd46928-f1f1-45a9-9ad9-58ed1762ceb3 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 1b90d345-fbca-4898-a77a-dea13164ba55] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:53:47.126736 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=6 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:53:47.133685 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4cd46928-f1f1-45a9-9ad9-58ed1762ceb3 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:47.134210 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4cd46928-f1f1-45a9-9ad9-58ed1762ceb3 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:47.134672 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4cd46928-f1f1-45a9-9ad9-58ed1762ceb3 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:47.135420 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4cd46928-f1f1-45a9-9ad9-58ed1762ceb3 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:47.135897 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4cd46928-f1f1-45a9-9ad9-58ed1762ceb3 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:47.136368 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4cd46928-f1f1-45a9-9ad9-58ed1762ceb3 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:47.313512 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-4cd46928-f1f1-45a9-9ad9-58ed1762ceb3 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:53:47.322028 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-4cd46928-f1f1-45a9-9ad9-58ed1762ceb3 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/1b90d345-fbca-4898-a77a-dea13164ba55" status: 200 len: 1562 microversion: 2.1 time: 0.201942 Aug 27 03:53:47.322626 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3501/6955] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:53:47 2022] GET /compute/v2.1/servers/1b90d345-fbca-4898-a77a-dea13164ba55 => generated 1562 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:53:49.242128 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-33963eaf-1b0e-4ce9-886c-92464f6cd4a2 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:49.249149 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-7eb06812-76b6-4b94-bb97-673ab24e5b92 req-0f73ec57-1657-4514-9fa5-77a39da7f6a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b90d345-fbca-4898-a77a-dea13164ba55", "tag": "b961bcb3-3f9f-40a1-be82-69b5d2d7c61b"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:53:49.249951 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-33963eaf-1b0e-4ce9-886c-92464f6cd4a2 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 1b90d345-fbca-4898-a77a-dea13164ba55] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:53:49.258120 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-33963eaf-1b0e-4ce9-886c-92464f6cd4a2 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:49.258617 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-33963eaf-1b0e-4ce9-886c-92464f6cd4a2 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:49.259358 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-33963eaf-1b0e-4ce9-886c-92464f6cd4a2 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:49.260082 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-33963eaf-1b0e-4ce9-886c-92464f6cd4a2 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:49.260956 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-33963eaf-1b0e-4ce9-886c-92464f6cd4a2 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:49.261384 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-33963eaf-1b0e-4ce9-886c-92464f6cd4a2 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:49.264266 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-7eb06812-76b6-4b94-bb97-673ab24e5b92 req-0f73ec57-1657-4514-9fa5-77a39da7f6a6 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:49.265113 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-7eb06812-76b6-4b94-bb97-673ab24e5b92 req-0f73ec57-1657-4514-9fa5-77a39da7f6a6 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:49.265632 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-7eb06812-76b6-4b94-bb97-673ab24e5b92 req-0f73ec57-1657-4514-9fa5-77a39da7f6a6 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:49.278475 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-7eb06812-76b6-4b94-bb97-673ab24e5b92 req-0f73ec57-1657-4514-9fa5-77a39da7f6a6 service nova] Creating event network-changed:b961bcb3-3f9f-40a1-be82-69b5d2d7c61b for instance 1b90d345-fbca-4898-a77a-dea13164ba55 on n-h2-852278-4 Aug 27 03:53:49.284294 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-7eb06812-76b6-4b94-bb97-673ab24e5b92 req-0f73ec57-1657-4514-9fa5-77a39da7f6a6 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040118 Aug 27 03:53:49.285768 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3502/6956] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:53:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:53:49.507460 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-33963eaf-1b0e-4ce9-886c-92464f6cd4a2 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:53:49.518356 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-33963eaf-1b0e-4ce9-886c-92464f6cd4a2 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/1b90d345-fbca-4898-a77a-dea13164ba55" status: 200 len: 1562 microversion: 2.1 time: 0.280489 Aug 27 03:53:49.521714 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3455/6957] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:53:49 2022] GET /compute/v2.1/servers/1b90d345-fbca-4898-a77a-dea13164ba55 => generated 1562 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:54:12.794040 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=17 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:54:12.794817 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=38 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:54:12.799605 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-65b6f2cd-5223-4c99-8318-794dc1b17d74 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:54:12.801975 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-65b6f2cd-5223-4c99-8318-794dc1b17d74 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 1b90d345-fbca-4898-a77a-dea13164ba55] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:54:12.809522 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-65b6f2cd-5223-4c99-8318-794dc1b17d74 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:12.810038 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-65b6f2cd-5223-4c99-8318-794dc1b17d74 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:12.812658 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-65b6f2cd-5223-4c99-8318-794dc1b17d74 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:12.812658 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-65b6f2cd-5223-4c99-8318-794dc1b17d74 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:12.812658 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-65b6f2cd-5223-4c99-8318-794dc1b17d74 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:12.812658 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-65b6f2cd-5223-4c99-8318-794dc1b17d74 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:12.874007 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-65b6f2cd-5223-4c99-8318-794dc1b17d74 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "POST /compute/v2.1/servers/1b90d345-fbca-4898-a77a-dea13164ba55/action" status: 200 len: 24562 microversion: 2.1 time: 0.081978 Aug 27 03:54:12.874860 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3503/6958] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:54:12 2022] POST /compute/v2.1/servers/1b90d345-fbca-4898-a77a-dea13164ba55/action => generated 24562 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:54:19.339218 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-11ac520f-07fd-4226-8c40-3b86facc1f0d tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:54:19.339789 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-11ac520f-07fd-4226-8c40-3b86facc1f0d tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 1b90d345-fbca-4898-a77a-dea13164ba55] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:54:19.341965 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:54:19.342645 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=36 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:54:19.349492 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-11ac520f-07fd-4226-8c40-3b86facc1f0d tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:19.350108 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-11ac520f-07fd-4226-8c40-3b86facc1f0d tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:19.350861 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-11ac520f-07fd-4226-8c40-3b86facc1f0d tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:19.351920 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-11ac520f-07fd-4226-8c40-3b86facc1f0d tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:19.352586 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-11ac520f-07fd-4226-8c40-3b86facc1f0d tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:19.353014 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-11ac520f-07fd-4226-8c40-3b86facc1f0d tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:19.435069 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-11ac520f-07fd-4226-8c40-3b86facc1f0d tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "POST /compute/v2.1/servers/1b90d345-fbca-4898-a77a-dea13164ba55/action" status: 202 len: 0 microversion: 2.1 time: 0.100948 Aug 27 03:54:19.435844 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3456/6959] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:54:19 2022] POST /compute/v2.1/servers/1b90d345-fbca-4898-a77a-dea13164ba55/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:54:19.444917 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-9db1edb1-19b6-4798-97e2-dea8d31f2f79 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:54:19.445606 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-9db1edb1-19b6-4798-97e2-dea8d31f2f79 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 1b90d345-fbca-4898-a77a-dea13164ba55] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:54:19.453380 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9db1edb1-19b6-4798-97e2-dea8d31f2f79 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:19.453873 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9db1edb1-19b6-4798-97e2-dea8d31f2f79 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:19.454338 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9db1edb1-19b6-4798-97e2-dea8d31f2f79 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:19.455081 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9db1edb1-19b6-4798-97e2-dea8d31f2f79 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:19.455517 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9db1edb1-19b6-4798-97e2-dea8d31f2f79 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:19.456025 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9db1edb1-19b6-4798-97e2-dea8d31f2f79 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:19.614708 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-9db1edb1-19b6-4798-97e2-dea8d31f2f79 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:54:19.623196 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-9db1edb1-19b6-4798-97e2-dea8d31f2f79 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/1b90d345-fbca-4898-a77a-dea13164ba55" status: 200 len: 1685 microversion: 2.1 time: 0.182711 Aug 27 03:54:19.623796 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3504/6960] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:54:19 2022] GET /compute/v2.1/servers/1b90d345-fbca-4898-a77a-dea13164ba55 => generated 1685 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:54:20.647750 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-1033b6ae-1e42-472e-a817-42e70b84a355 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:54:20.648557 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-1033b6ae-1e42-472e-a817-42e70b84a355 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 1b90d345-fbca-4898-a77a-dea13164ba55] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:54:20.655447 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1033b6ae-1e42-472e-a817-42e70b84a355 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:20.655950 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1033b6ae-1e42-472e-a817-42e70b84a355 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:20.656462 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1033b6ae-1e42-472e-a817-42e70b84a355 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:20.657182 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1033b6ae-1e42-472e-a817-42e70b84a355 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:20.657688 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1033b6ae-1e42-472e-a817-42e70b84a355 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:20.658121 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1033b6ae-1e42-472e-a817-42e70b84a355 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:20.813150 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-1033b6ae-1e42-472e-a817-42e70b84a355 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:54:20.824083 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-1033b6ae-1e42-472e-a817-42e70b84a355 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/1b90d345-fbca-4898-a77a-dea13164ba55" status: 200 len: 1665 microversion: 2.1 time: 0.182076 Aug 27 03:54:20.824718 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3457/6961] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:54:20 2022] GET /compute/v2.1/servers/1b90d345-fbca-4898-a77a-dea13164ba55 => generated 1665 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:54:21.929845 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-30925b77-4c10-4134-8ff1-e9a8134a2b8b tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:54:21.932121 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-30925b77-4c10-4134-8ff1-e9a8134a2b8b tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 1b90d345-fbca-4898-a77a-dea13164ba55] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:54:21.940696 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-30925b77-4c10-4134-8ff1-e9a8134a2b8b tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:21.941295 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-30925b77-4c10-4134-8ff1-e9a8134a2b8b tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:21.941725 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-30925b77-4c10-4134-8ff1-e9a8134a2b8b tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:21.942484 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-30925b77-4c10-4134-8ff1-e9a8134a2b8b tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:21.942962 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-30925b77-4c10-4134-8ff1-e9a8134a2b8b tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:21.943414 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-30925b77-4c10-4134-8ff1-e9a8134a2b8b tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:22.001108 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-30925b77-4c10-4134-8ff1-e9a8134a2b8b tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "POST /compute/v2.1/servers/1b90d345-fbca-4898-a77a-dea13164ba55/action" status: 200 len: 32632 microversion: 2.1 time: 0.075241 Aug 27 03:54:22.001795 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3505/6962] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:54:21 2022] POST /compute/v2.1/servers/1b90d345-fbca-4898-a77a-dea13164ba55/action => generated 32632 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:54:22.014236 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e0410095-0056-45d3-ae29-4605e1411a13 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:54:22.014798 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-e0410095-0056-45d3-ae29-4605e1411a13 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 1b90d345-fbca-4898-a77a-dea13164ba55] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:54:22.022338 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e0410095-0056-45d3-ae29-4605e1411a13 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:22.022833 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e0410095-0056-45d3-ae29-4605e1411a13 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:22.023274 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e0410095-0056-45d3-ae29-4605e1411a13 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:22.023984 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e0410095-0056-45d3-ae29-4605e1411a13 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:22.024476 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e0410095-0056-45d3-ae29-4605e1411a13 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:22.024906 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e0410095-0056-45d3-ae29-4605e1411a13 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:22.103084 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e0410095-0056-45d3-ae29-4605e1411a13 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "POST /compute/v2.1/servers/1b90d345-fbca-4898-a77a-dea13164ba55/action" status: 202 len: 0 microversion: 2.1 time: 0.092422 Aug 27 03:54:22.103755 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3458/6963] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:54:22 2022] POST /compute/v2.1/servers/1b90d345-fbca-4898-a77a-dea13164ba55/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:54:22.114210 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-5b545041-e2cf-4272-b448-9987e23bd5bb tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:54:22.114714 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-5b545041-e2cf-4272-b448-9987e23bd5bb tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 1b90d345-fbca-4898-a77a-dea13164ba55] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:54:22.121877 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5b545041-e2cf-4272-b448-9987e23bd5bb tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:22.122388 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5b545041-e2cf-4272-b448-9987e23bd5bb tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:22.122836 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5b545041-e2cf-4272-b448-9987e23bd5bb tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:22.123581 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5b545041-e2cf-4272-b448-9987e23bd5bb tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:22.124046 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5b545041-e2cf-4272-b448-9987e23bd5bb tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:22.124542 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5b545041-e2cf-4272-b448-9987e23bd5bb tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:22.294012 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-5b545041-e2cf-4272-b448-9987e23bd5bb tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:54:22.303777 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-5b545041-e2cf-4272-b448-9987e23bd5bb tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/1b90d345-fbca-4898-a77a-dea13164ba55" status: 200 len: 1672 microversion: 2.1 time: 0.194123 Aug 27 03:54:22.304425 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3506/6964] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:54:22 2022] GET /compute/v2.1/servers/1b90d345-fbca-4898-a77a-dea13164ba55 => generated 1672 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:54:23.327256 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-42997275-453a-4466-b575-3e91b0a44cce tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:54:23.327899 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-42997275-453a-4466-b575-3e91b0a44cce tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 1b90d345-fbca-4898-a77a-dea13164ba55] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:54:23.335970 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-42997275-453a-4466-b575-3e91b0a44cce tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:23.336531 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-42997275-453a-4466-b575-3e91b0a44cce tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:23.337278 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-42997275-453a-4466-b575-3e91b0a44cce tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:23.337769 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-42997275-453a-4466-b575-3e91b0a44cce tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:23.338244 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-42997275-453a-4466-b575-3e91b0a44cce tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:23.338682 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-42997275-453a-4466-b575-3e91b0a44cce tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:23.490693 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-42997275-453a-4466-b575-3e91b0a44cce tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:54:23.499995 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-42997275-453a-4466-b575-3e91b0a44cce tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/1b90d345-fbca-4898-a77a-dea13164ba55" status: 200 len: 1680 microversion: 2.1 time: 0.177210 Aug 27 03:54:23.500638 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3459/6965] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:54:23 2022] GET /compute/v2.1/servers/1b90d345-fbca-4898-a77a-dea13164ba55 => generated 1680 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:54:23.610642 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-9c0440a8-8736-40e3-a970-9c0d29cc7ec8 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:54:23.613052 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-9c0440a8-8736-40e3-a970-9c0d29cc7ec8 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 1b90d345-fbca-4898-a77a-dea13164ba55] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:54:23.621420 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9c0440a8-8736-40e3-a970-9c0d29cc7ec8 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:23.621929 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9c0440a8-8736-40e3-a970-9c0d29cc7ec8 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:23.622369 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9c0440a8-8736-40e3-a970-9c0d29cc7ec8 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:23.623082 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9c0440a8-8736-40e3-a970-9c0d29cc7ec8 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:23.623550 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9c0440a8-8736-40e3-a970-9c0d29cc7ec8 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:23.623983 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9c0440a8-8736-40e3-a970-9c0d29cc7ec8 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:23.684222 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-9c0440a8-8736-40e3-a970-9c0d29cc7ec8 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "POST /compute/v2.1/servers/1b90d345-fbca-4898-a77a-dea13164ba55/action" status: 200 len: 35266 microversion: 2.1 time: 0.077394 Aug 27 03:54:23.684982 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3507/6966] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:54:23 2022] POST /compute/v2.1/servers/1b90d345-fbca-4898-a77a-dea13164ba55/action => generated 35266 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:54:24.755654 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c4d6099f-418b-49b1-896a-278b42b6acc6 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:54:24.756554 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-c4d6099f-418b-49b1-896a-278b42b6acc6 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 1b90d345-fbca-4898-a77a-dea13164ba55] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:54:24.757915 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-6879e7f2-380d-4a3c-b363-e350a185178f req-fa35710e-7103-4077-acc6-0a0390677941 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b90d345-fbca-4898-a77a-dea13164ba55", "tag": "b961bcb3-3f9f-40a1-be82-69b5d2d7c61b"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:54:24.764707 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c4d6099f-418b-49b1-896a-278b42b6acc6 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:24.765343 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c4d6099f-418b-49b1-896a-278b42b6acc6 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:24.766045 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c4d6099f-418b-49b1-896a-278b42b6acc6 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:24.766912 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c4d6099f-418b-49b1-896a-278b42b6acc6 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:24.767464 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c4d6099f-418b-49b1-896a-278b42b6acc6 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:24.768118 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c4d6099f-418b-49b1-896a-278b42b6acc6 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:24.771787 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-6879e7f2-380d-4a3c-b363-e350a185178f req-fa35710e-7103-4077-acc6-0a0390677941 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:24.772290 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-6879e7f2-380d-4a3c-b363-e350a185178f req-fa35710e-7103-4077-acc6-0a0390677941 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:24.772763 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-6879e7f2-380d-4a3c-b363-e350a185178f req-fa35710e-7103-4077-acc6-0a0390677941 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:24.786457 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-6879e7f2-380d-4a3c-b363-e350a185178f req-fa35710e-7103-4077-acc6-0a0390677941 service nova] Creating event network-changed:b961bcb3-3f9f-40a1-be82-69b5d2d7c61b for instance 1b90d345-fbca-4898-a77a-dea13164ba55 on n-h2-852278-4 Aug 27 03:54:24.792069 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-6879e7f2-380d-4a3c-b363-e350a185178f req-fa35710e-7103-4077-acc6-0a0390677941 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038129 Aug 27 03:54:24.793088 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3508/6967] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:54:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:54:24.797610 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-c4d6099f-418b-49b1-896a-278b42b6acc6 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 1b90d345-fbca-4898-a77a-dea13164ba55] Going to try to terminate instance {{(pid=134052) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:54:24.899142 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c4d6099f-418b-49b1-896a-278b42b6acc6 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "DELETE /compute/v2.1/servers/1b90d345-fbca-4898-a77a-dea13164ba55" status: 204 len: 0 microversion: 2.1 time: 0.147478 Aug 27 03:54:24.900346 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3460/6968] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 03:54:24 2022] DELETE /compute/v2.1/servers/1b90d345-fbca-4898-a77a-dea13164ba55 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:54:24.909514 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-571923b7-8a3d-43b2-a969-f07314fbdac6 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:54:24.910771 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-571923b7-8a3d-43b2-a969-f07314fbdac6 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 1b90d345-fbca-4898-a77a-dea13164ba55] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:54:24.917661 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-571923b7-8a3d-43b2-a969-f07314fbdac6 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:24.918170 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-571923b7-8a3d-43b2-a969-f07314fbdac6 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:24.918624 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-571923b7-8a3d-43b2-a969-f07314fbdac6 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:24.919350 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-571923b7-8a3d-43b2-a969-f07314fbdac6 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:24.920004 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-571923b7-8a3d-43b2-a969-f07314fbdac6 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:24.920476 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-571923b7-8a3d-43b2-a969-f07314fbdac6 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:25.102866 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-571923b7-8a3d-43b2-a969-f07314fbdac6 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:54:25.111077 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-571923b7-8a3d-43b2-a969-f07314fbdac6 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/1b90d345-fbca-4898-a77a-dea13164ba55" status: 200 len: 1686 microversion: 2.1 time: 0.206046 Aug 27 03:54:25.111686 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3509/6969] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:54:24 2022] GET /compute/v2.1/servers/1b90d345-fbca-4898-a77a-dea13164ba55 => generated 1686 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:54:26.136332 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b3e31460-c17d-4439-ba22-75a628fc43bf tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:54:26.137493 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b3e31460-c17d-4439-ba22-75a628fc43bf tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 1b90d345-fbca-4898-a77a-dea13164ba55] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:54:26.147311 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b3e31460-c17d-4439-ba22-75a628fc43bf tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:26.147778 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b3e31460-c17d-4439-ba22-75a628fc43bf tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:26.148219 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b3e31460-c17d-4439-ba22-75a628fc43bf tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:26.148992 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b3e31460-c17d-4439-ba22-75a628fc43bf tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:26.149449 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b3e31460-c17d-4439-ba22-75a628fc43bf tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:26.149869 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b3e31460-c17d-4439-ba22-75a628fc43bf tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:26.308276 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b3e31460-c17d-4439-ba22-75a628fc43bf tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:54:26.317302 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b3e31460-c17d-4439-ba22-75a628fc43bf tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/1b90d345-fbca-4898-a77a-dea13164ba55" status: 200 len: 1686 microversion: 2.1 time: 0.186824 Aug 27 03:54:26.317901 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3461/6970] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:54:26 2022] GET /compute/v2.1/servers/1b90d345-fbca-4898-a77a-dea13164ba55 => generated 1686 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:54:27.327925 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-119bd9ed-b4d8-4c47-ae78-2a811004a435 req-b8d5b92d-4cab-4cea-be67-51705b3f0c18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b90d345-fbca-4898-a77a-dea13164ba55", "name": "network-vif-deleted", "tag": "b961bcb3-3f9f-40a1-be82-69b5d2d7c61b"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:54:27.340234 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9796391e-bb6c-484b-9ad7-8eab8c9c9608 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:54:27.340910 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-9796391e-bb6c-484b-9ad7-8eab8c9c9608 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 1b90d345-fbca-4898-a77a-dea13164ba55] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:54:27.342627 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-119bd9ed-b4d8-4c47-ae78-2a811004a435 req-b8d5b92d-4cab-4cea-be67-51705b3f0c18 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:27.343729 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-119bd9ed-b4d8-4c47-ae78-2a811004a435 req-b8d5b92d-4cab-4cea-be67-51705b3f0c18 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:27.344587 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-119bd9ed-b4d8-4c47-ae78-2a811004a435 req-b8d5b92d-4cab-4cea-be67-51705b3f0c18 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:27.350278 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9796391e-bb6c-484b-9ad7-8eab8c9c9608 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:27.351030 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9796391e-bb6c-484b-9ad7-8eab8c9c9608 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:27.351643 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9796391e-bb6c-484b-9ad7-8eab8c9c9608 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:27.352748 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9796391e-bb6c-484b-9ad7-8eab8c9c9608 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:27.353237 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9796391e-bb6c-484b-9ad7-8eab8c9c9608 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:27.353647 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9796391e-bb6c-484b-9ad7-8eab8c9c9608 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:27.360078 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-119bd9ed-b4d8-4c47-ae78-2a811004a435 req-b8d5b92d-4cab-4cea-be67-51705b3f0c18 service nova] Creating event network-vif-deleted:b961bcb3-3f9f-40a1-be82-69b5d2d7c61b for instance 1b90d345-fbca-4898-a77a-dea13164ba55 on n-h2-852278-4 Aug 27 03:54:27.366083 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-119bd9ed-b4d8-4c47-ae78-2a811004a435 req-b8d5b92d-4cab-4cea-be67-51705b3f0c18 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045213 Aug 27 03:54:27.366892 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3510/6971] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:54:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:54:27.431713 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-9796391e-bb6c-484b-9ad7-8eab8c9c9608 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:54:27.440067 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9796391e-bb6c-484b-9ad7-8eab8c9c9608 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/1b90d345-fbca-4898-a77a-dea13164ba55" status: 200 len: 1351 microversion: 2.1 time: 0.104315 Aug 27 03:54:27.440710 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3462/6972] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:54:27 2022] GET /compute/v2.1/servers/1b90d345-fbca-4898-a77a-dea13164ba55 => generated 1351 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:54:28.463247 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-660ac3f9-25a6-4bf3-b06b-76e4cdc7aefc tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:54:28.464104 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-660ac3f9-25a6-4bf3-b06b-76e4cdc7aefc tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 1b90d345-fbca-4898-a77a-dea13164ba55] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:54:28.474918 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-660ac3f9-25a6-4bf3-b06b-76e4cdc7aefc tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:28.475420 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-660ac3f9-25a6-4bf3-b06b-76e4cdc7aefc tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:28.475887 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-660ac3f9-25a6-4bf3-b06b-76e4cdc7aefc tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:28.476675 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-660ac3f9-25a6-4bf3-b06b-76e4cdc7aefc tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:28.477152 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-660ac3f9-25a6-4bf3-b06b-76e4cdc7aefc tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:28.477598 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-660ac3f9-25a6-4bf3-b06b-76e4cdc7aefc tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:28.492479 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-660ac3f9-25a6-4bf3-b06b-76e4cdc7aefc tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] HTTP exception thrown: Instance 1b90d345-fbca-4898-a77a-dea13164ba55 could not be found. Aug 27 03:54:28.494259 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-660ac3f9-25a6-4bf3-b06b-76e4cdc7aefc tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Request method failure captured: Aug 27 03:54:28.494259 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/1b90d345-fbca-4898-a77a-dea13164ba55 HTTP/1.1 Aug 27 03:54:28.494259 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 03:54:28.494259 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 03:54:28.494259 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 03:54:28.494259 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 03:54:28.494259 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 03:54:28.494259 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 03:54:28.494259 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 03:54:28.494259 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 03:54:28.494259 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCZU37KUCPlLNPa46uoYyHww48hoe3u_z-BgLN9g-oq2tOv22Rtnsjni3NQSTpUSFvnqw-iilMtJmmXNN3mDjBxOFqxVi8ULOCUVZBgtRQ3Q2tRHScCw5ed_FU_gznAbg4sRYwVid01sApcIv5MJUox6pjFVHV0WUHFDPrPNCAXQKHo4 Aug 27 03:54:28.494259 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 03:54:28.494259 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 03:54:28.494259 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 03:54:28.494259 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 03:54:28.494259 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 03:54:28.494259 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 03:54:28.494259 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 961e5856cfda49f3a46a5db96d35050f Aug 27 03:54:28.494259 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-967904917 Aug 27 03:54:28.494259 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 03:54:28.494259 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 03:54:28.494259 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/961e5856cfda49f3a46a5db96d35050f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_961e5856cfda49f3a46a5db96d35050f", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/961e5856cfda49f3a46a5db96d35050f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/961e5856cfda49f3a46a5db96d35050f"}]}] Aug 27 03:54:28.494259 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-TestNetworkAdvancedServerOps-967904917 Aug 27 03:54:28.494259 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 961e5856cfda49f3a46a5db96d35050f Aug 27 03:54:28.494259 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-967904917 Aug 27 03:54:28.494259 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-TestNetworkAdvancedServerOps-967904917-project Aug 27 03:54:28.494259 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 03:54:28.494259 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 03:54:28.494259 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 4dd9a215fc244b839b2334274274675f Aug 27 03:54:28.494259 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-TestNetworkAdvancedServerOps-967904917-project Aug 27 03:54:28.494259 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 03:54:28.494259 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance 1b90d345-fbca-4898-a77a-dea13164ba55 could not be found. Aug 27 03:54:28.494259 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '1b90d345-fbca-4898-a77a-dea13164ba55'} Aug 27 03:54:28.494259 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:54:28.494259 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:54:28.494259 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:54:28.494259 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:54:28.494259 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:54:28.494259 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:54:28.494259 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:54:28.494259 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:54:28.494259 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:54:28.494259 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:54:28.494259 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b90d345-fbca-4898-a77a-dea13164ba55 could not be found. Aug 27 03:54:28.494259 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:54:28.494259 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:54:28.494259 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:54:28.494259 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:54:28.494259 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:54:28.494259 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:54:28.494259 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:54:28.494259 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:54:28.494259 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:54:28.494259 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:54:28.494259 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:54:28.494259 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:54:28.494259 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:54:28.494259 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:54:28.494259 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:54:28.494259 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:54:28.494259 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b90d345-fbca-4898-a77a-dea13164ba55 could not be found. Aug 27 03:54:28.494259 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:54:28.494259 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:54:28.498440 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:54:28.498440 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:54:28.498440 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:54:28.498440 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:54:28.498440 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:54:28.498440 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:54:28.498440 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b90d345-fbca-4898-a77a-dea13164ba55 could not be found. Aug 27 03:54:28.498440 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:54:28.498440 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-660ac3f9-25a6-4bf3-b06b-76e4cdc7aefc tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Returning 404 to user: Instance 1b90d345-fbca-4898-a77a-dea13164ba55 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:54:28.498440 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-660ac3f9-25a6-4bf3-b06b-76e4cdc7aefc tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/1b90d345-fbca-4898-a77a-dea13164ba55" status: 404 len: 111 microversion: 2.1 time: 0.038111 Aug 27 03:54:28.498440 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3511/6973] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:54:28 2022] GET /compute/v2.1/servers/1b90d345-fbca-4898-a77a-dea13164ba55 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:54:32.058653 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e4d89652-01bf-4809-97e0-2946d414c6c7 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '.version_select at 0x7f5ee2419550>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:54:32.088019 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e4d89652-01bf-4809-97e0-2946d414c6c7 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1673330020" status: 202 len: 0 microversion: 2.1 time: 0.033616 Aug 27 03:54:32.088480 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3463/6974] 10.222.0.70 () {58 vars in 1284 bytes} [Sat Aug 27 03:54:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1673330020 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:54:32.116098 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-6aabfe8a-bbe6-462d-9636-993b3e743117 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Action: 'create', calling method: .version_select at 0x7f5ede923ca0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1091347333", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMUfVB89QHv13v6cOdMrgLY1Q7SoLLad3q8tHB4859shL2fGTU31h3FmapLxtyQbv57/8b7WrCFnzT2yMH4f67G7gJ6c8HllTM6WULqMJBmO2fFQcnwWWDLRO8DGV29kNg=="}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:54:32.137041 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-6aabfe8a-bbe6-462d-9636-993b3e743117 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Getting quotas for project 961e5856cfda49f3a46a5db96d35050f. Resources: {'key_pairs'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:54:32.143994 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-6aabfe8a-bbe6-462d-9636-993b3e743117 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Getting quotas for user 4dd9a215fc244b839b2334274274675f and project 961e5856cfda49f3a46a5db96d35050f. Resources: {'key_pairs'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:54:32.172001 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-6aabfe8a-bbe6-462d-9636-993b3e743117 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.060277 Aug 27 03:54:32.173227 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3512/6975] 10.222.0.70 () {60 vars in 1159 bytes} [Sat Aug 27 03:54:32 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:54:38.260912 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:54:38.265450 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-667ff727-c5b0-4bc5-8503-6bfea9b6512e tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-867330870", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "networks": [{"uuid": "bb14fd17-7bcc-4dd5-9d13-5210e2c7f0ba"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1091347333", "security_groups": [{"name": "tempest-secgroup-smoke-843606990"}]}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:54:38.411025 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.network.neutron [None req-667ff727-c5b0-4bc5-8503-6bfea9b6512e tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] validate_networks() for [('bb14fd17-7bcc-4dd5-9d13-5210e2c7f0ba', None, None, None, None, None)] {{(pid=134052) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:54:38.900665 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-667ff727-c5b0-4bc5-8503-6bfea9b6512e tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Flavor limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:54:38.901356 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-667ff727-c5b0-4bc5-8503-6bfea9b6512e tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Image limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:54:38.901998 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-667ff727-c5b0-4bc5-8503-6bfea9b6512e tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Flavor pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:54:38.902559 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-667ff727-c5b0-4bc5-8503-6bfea9b6512e tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Image pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:54:38.903121 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-667ff727-c5b0-4bc5-8503-6bfea9b6512e tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:54:38.924241 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-667ff727-c5b0-4bc5-8503-6bfea9b6512e tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:38.925539 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-667ff727-c5b0-4bc5-8503-6bfea9b6512e tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:38.926612 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-667ff727-c5b0-4bc5-8503-6bfea9b6512e tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:38.927789 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-667ff727-c5b0-4bc5-8503-6bfea9b6512e tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:38.928444 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-667ff727-c5b0-4bc5-8503-6bfea9b6512e tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:38.929057 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-667ff727-c5b0-4bc5-8503-6bfea9b6512e tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:38.951990 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-667ff727-c5b0-4bc5-8503-6bfea9b6512e tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Getting quotas for project 961e5856cfda49f3a46a5db96d35050f. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:54:38.955912 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-667ff727-c5b0-4bc5-8503-6bfea9b6512e tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Getting quotas for user 4dd9a215fc244b839b2334274274675f and project 961e5856cfda49f3a46a5db96d35050f. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:54:38.971160 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-667ff727-c5b0-4bc5-8503-6bfea9b6512e tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Going to run 1 instances... {{(pid=134052) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:54:38.973920 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-667ff727-c5b0-4bc5-8503-6bfea9b6512e tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 80d5f793-9939-442e-a629-950b36fe785f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134052) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:54:39.029339 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-667ff727-c5b0-4bc5-8503-6bfea9b6512e tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.770459 Aug 27 03:54:39.030633 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3464/6976] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 03:54:38 2022] POST /compute/v2.1/servers => generated 405 bytes in 772 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:54:39.040392 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=36 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:54:39.046966 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-95f80f78-2a0f-476d-a81c-3be714e8d2a7 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:54:39.048381 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-95f80f78-2a0f-476d-a81c-3be714e8d2a7 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 80d5f793-9939-442e-a629-950b36fe785f] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:54:39.141593 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-95f80f78-2a0f-476d-a81c-3be714e8d2a7 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:54:39.153781 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-95f80f78-2a0f-476d-a81c-3be714e8d2a7 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/80d5f793-9939-442e-a629-950b36fe785f" status: 200 len: 1266 microversion: 2.1 time: 0.114973 Aug 27 03:54:39.154834 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3513/6977] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:54:39 2022] GET /compute/v2.1/servers/80d5f793-9939-442e-a629-950b36fe785f => generated 1266 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:54:40.177495 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-29d27f9d-df10-448e-9cb9-5225f51789b6 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:54:40.178154 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-29d27f9d-df10-448e-9cb9-5225f51789b6 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 80d5f793-9939-442e-a629-950b36fe785f] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:54:40.193448 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-29d27f9d-df10-448e-9cb9-5225f51789b6 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:40.194186 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-29d27f9d-df10-448e-9cb9-5225f51789b6 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:40.195269 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-29d27f9d-df10-448e-9cb9-5225f51789b6 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:40.196877 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-29d27f9d-df10-448e-9cb9-5225f51789b6 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:40.197359 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-29d27f9d-df10-448e-9cb9-5225f51789b6 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:40.197802 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-29d27f9d-df10-448e-9cb9-5225f51789b6 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:40.367031 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-29d27f9d-df10-448e-9cb9-5225f51789b6 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:54:40.381613 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-29d27f9d-df10-448e-9cb9-5225f51789b6 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/80d5f793-9939-442e-a629-950b36fe785f" status: 200 len: 1326 microversion: 2.1 time: 0.210512 Aug 27 03:54:40.382518 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3465/6978] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:54:40 2022] GET /compute/v2.1/servers/80d5f793-9939-442e-a629-950b36fe785f => generated 1326 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:54:41.410524 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-2a8a2f7d-3600-4af6-9fb8-0bf416572bd7 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:54:41.411224 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-2a8a2f7d-3600-4af6-9fb8-0bf416572bd7 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 80d5f793-9939-442e-a629-950b36fe785f] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:54:41.422255 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2a8a2f7d-3600-4af6-9fb8-0bf416572bd7 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:41.424746 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2a8a2f7d-3600-4af6-9fb8-0bf416572bd7 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:41.425260 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2a8a2f7d-3600-4af6-9fb8-0bf416572bd7 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:41.426041 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2a8a2f7d-3600-4af6-9fb8-0bf416572bd7 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:41.426673 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2a8a2f7d-3600-4af6-9fb8-0bf416572bd7 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:41.427718 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2a8a2f7d-3600-4af6-9fb8-0bf416572bd7 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:41.669338 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-2a8a2f7d-3600-4af6-9fb8-0bf416572bd7 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:54:41.678317 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-2a8a2f7d-3600-4af6-9fb8-0bf416572bd7 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/80d5f793-9939-442e-a629-950b36fe785f" status: 200 len: 1391 microversion: 2.1 time: 0.275057 Aug 27 03:54:41.678938 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3514/6979] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:54:41 2022] GET /compute/v2.1/servers/80d5f793-9939-442e-a629-950b36fe785f => generated 1391 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:54:42.016214 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-afdea0ec-d32c-4da1-8614-1806d5e49aa1 req-3e016922-f0e8-42fd-93d7-be63133a69be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80d5f793-9939-442e-a629-950b36fe785f", "tag": "217d94d3-7847-4ed1-91ec-d8635e3c07ad"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:54:42.032003 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-afdea0ec-d32c-4da1-8614-1806d5e49aa1 req-3e016922-f0e8-42fd-93d7-be63133a69be service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:42.034758 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-afdea0ec-d32c-4da1-8614-1806d5e49aa1 req-3e016922-f0e8-42fd-93d7-be63133a69be service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:42.034758 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-afdea0ec-d32c-4da1-8614-1806d5e49aa1 req-3e016922-f0e8-42fd-93d7-be63133a69be service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:42.054311 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-afdea0ec-d32c-4da1-8614-1806d5e49aa1 req-3e016922-f0e8-42fd-93d7-be63133a69be service nova] Creating event network-changed:217d94d3-7847-4ed1-91ec-d8635e3c07ad for instance 80d5f793-9939-442e-a629-950b36fe785f on n-h2-852278-4 Aug 27 03:54:42.064357 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-afdea0ec-d32c-4da1-8614-1806d5e49aa1 req-3e016922-f0e8-42fd-93d7-be63133a69be service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052537 Aug 27 03:54:42.065173 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3466/6980] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:54:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:54:42.699794 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e21611f2-edd6-493b-bed9-69de55147181 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:54:42.700445 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-e21611f2-edd6-493b-bed9-69de55147181 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 80d5f793-9939-442e-a629-950b36fe785f] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:54:42.709977 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e21611f2-edd6-493b-bed9-69de55147181 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:42.710495 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e21611f2-edd6-493b-bed9-69de55147181 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:42.710955 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e21611f2-edd6-493b-bed9-69de55147181 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:42.711689 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e21611f2-edd6-493b-bed9-69de55147181 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:42.712164 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e21611f2-edd6-493b-bed9-69de55147181 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:42.712671 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e21611f2-edd6-493b-bed9-69de55147181 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:42.851593 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e21611f2-edd6-493b-bed9-69de55147181 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:54:42.859727 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e21611f2-edd6-493b-bed9-69de55147181 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/80d5f793-9939-442e-a629-950b36fe785f" status: 200 len: 1391 microversion: 2.1 time: 0.164066 Aug 27 03:54:42.860343 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3515/6981] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:54:42 2022] GET /compute/v2.1/servers/80d5f793-9939-442e-a629-950b36fe785f => generated 1391 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:54:43.888204 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a4499966-1c18-4ebe-8d51-1cbd045d6e42 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:54:43.888958 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a4499966-1c18-4ebe-8d51-1cbd045d6e42 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 80d5f793-9939-442e-a629-950b36fe785f] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:54:43.896946 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a4499966-1c18-4ebe-8d51-1cbd045d6e42 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:43.897456 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a4499966-1c18-4ebe-8d51-1cbd045d6e42 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:43.897897 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a4499966-1c18-4ebe-8d51-1cbd045d6e42 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:43.898609 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a4499966-1c18-4ebe-8d51-1cbd045d6e42 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:43.899120 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a4499966-1c18-4ebe-8d51-1cbd045d6e42 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:43.899523 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a4499966-1c18-4ebe-8d51-1cbd045d6e42 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:44.043495 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-a4499966-1c18-4ebe-8d51-1cbd045d6e42 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:54:44.053036 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a4499966-1c18-4ebe-8d51-1cbd045d6e42 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/80d5f793-9939-442e-a629-950b36fe785f" status: 200 len: 1391 microversion: 2.1 time: 0.169662 Aug 27 03:54:44.053594 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3467/6982] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:54:43 2022] GET /compute/v2.1/servers/80d5f793-9939-442e-a629-950b36fe785f => generated 1391 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:54:45.074585 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8864c6b3-193c-46fc-bf76-86981b697b3c tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:54:45.075280 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-8864c6b3-193c-46fc-bf76-86981b697b3c tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 80d5f793-9939-442e-a629-950b36fe785f] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:54:45.078703 n-d-852278-4 devstack@n-api.service[134051]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:54:45.078902 n-d-852278-4 devstack@n-api.service[134051]: Sat Aug 27 03:54:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/80d5f793-9939-442e-a629-950b36fe785f (ip 10.222.0.70) !!! Aug 27 03:54:45.080596 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:54:45.092794 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8864c6b3-193c-46fc-bf76-86981b697b3c tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:45.093435 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8864c6b3-193c-46fc-bf76-86981b697b3c tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:45.093920 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8864c6b3-193c-46fc-bf76-86981b697b3c tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:45.094649 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8864c6b3-193c-46fc-bf76-86981b697b3c tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:45.095106 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8864c6b3-193c-46fc-bf76-86981b697b3c tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:45.095541 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8864c6b3-193c-46fc-bf76-86981b697b3c tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:45.242984 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-8864c6b3-193c-46fc-bf76-86981b697b3c tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:54:45.251410 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-8864c6b3-193c-46fc-bf76-86981b697b3c tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/80d5f793-9939-442e-a629-950b36fe785f" status: 200 len: 1391 microversion: 2.1 time: 0.180817 Aug 27 03:54:45.252026 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3516/6983] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:54:45 2022] GET /compute/v2.1/servers/80d5f793-9939-442e-a629-950b36fe785f => generated 1391 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:54:46.273575 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e7c3f354-5d1b-4472-a7a0-e6a2dee2f28a tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:54:46.274159 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-e7c3f354-5d1b-4472-a7a0-e6a2dee2f28a tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 80d5f793-9939-442e-a629-950b36fe785f] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:54:46.283523 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e7c3f354-5d1b-4472-a7a0-e6a2dee2f28a tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:46.284022 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e7c3f354-5d1b-4472-a7a0-e6a2dee2f28a tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:46.284475 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e7c3f354-5d1b-4472-a7a0-e6a2dee2f28a tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:46.285198 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e7c3f354-5d1b-4472-a7a0-e6a2dee2f28a tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:46.285651 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e7c3f354-5d1b-4472-a7a0-e6a2dee2f28a tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:46.286077 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e7c3f354-5d1b-4472-a7a0-e6a2dee2f28a tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:46.431780 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-e7c3f354-5d1b-4472-a7a0-e6a2dee2f28a tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:54:46.442017 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e7c3f354-5d1b-4472-a7a0-e6a2dee2f28a tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/80d5f793-9939-442e-a629-950b36fe785f" status: 200 len: 1391 microversion: 2.1 time: 0.172552 Aug 27 03:54:46.442614 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3468/6984] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:54:46 2022] GET /compute/v2.1/servers/80d5f793-9939-442e-a629-950b36fe785f => generated 1391 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:54:47.078229 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-2228bcda-6122-4ff3-aaf8-0a45e817a711 req-35d3c501-16f7-4e62-971f-44273e02ab64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80d5f793-9939-442e-a629-950b36fe785f", "name": "network-vif-plugged", "status": "completed", "tag": "217d94d3-7847-4ed1-91ec-d8635e3c07ad"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:54:47.089541 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-2228bcda-6122-4ff3-aaf8-0a45e817a711 req-35d3c501-16f7-4e62-971f-44273e02ab64 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:47.090034 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-2228bcda-6122-4ff3-aaf8-0a45e817a711 req-35d3c501-16f7-4e62-971f-44273e02ab64 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:47.090490 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-2228bcda-6122-4ff3-aaf8-0a45e817a711 req-35d3c501-16f7-4e62-971f-44273e02ab64 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:47.103719 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-2228bcda-6122-4ff3-aaf8-0a45e817a711 req-35d3c501-16f7-4e62-971f-44273e02ab64 service nova] Creating event network-vif-plugged:217d94d3-7847-4ed1-91ec-d8635e3c07ad for instance 80d5f793-9939-442e-a629-950b36fe785f on n-h2-852278-4 Aug 27 03:54:47.109297 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-2228bcda-6122-4ff3-aaf8-0a45e817a711 req-35d3c501-16f7-4e62-971f-44273e02ab64 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034723 Aug 27 03:54:47.109931 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3517/6985] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:54:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:54:47.463281 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9bd5f1e4-5e0a-4de8-9e13-d490d9530d97 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:54:47.463912 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-9bd5f1e4-5e0a-4de8-9e13-d490d9530d97 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 80d5f793-9939-442e-a629-950b36fe785f] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:54:47.473044 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9bd5f1e4-5e0a-4de8-9e13-d490d9530d97 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:47.473537 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9bd5f1e4-5e0a-4de8-9e13-d490d9530d97 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:47.473983 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9bd5f1e4-5e0a-4de8-9e13-d490d9530d97 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:47.474706 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9bd5f1e4-5e0a-4de8-9e13-d490d9530d97 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:47.475157 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9bd5f1e4-5e0a-4de8-9e13-d490d9530d97 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:47.475587 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9bd5f1e4-5e0a-4de8-9e13-d490d9530d97 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:47.629490 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-9bd5f1e4-5e0a-4de8-9e13-d490d9530d97 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:54:47.638689 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9bd5f1e4-5e0a-4de8-9e13-d490d9530d97 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/80d5f793-9939-442e-a629-950b36fe785f" status: 200 len: 1391 microversion: 2.1 time: 0.179563 Aug 27 03:54:47.639294 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3469/6986] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:54:47 2022] GET /compute/v2.1/servers/80d5f793-9939-442e-a629-950b36fe785f => generated 1391 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:54:48.663895 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-26bbf3b4-fe3d-42cc-be67-8f37471641e1 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:54:48.664641 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-26bbf3b4-fe3d-42cc-be67-8f37471641e1 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 80d5f793-9939-442e-a629-950b36fe785f] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:54:48.671757 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-26bbf3b4-fe3d-42cc-be67-8f37471641e1 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:48.672268 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-26bbf3b4-fe3d-42cc-be67-8f37471641e1 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:48.672763 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-26bbf3b4-fe3d-42cc-be67-8f37471641e1 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:48.673867 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-26bbf3b4-fe3d-42cc-be67-8f37471641e1 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:48.674342 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-26bbf3b4-fe3d-42cc-be67-8f37471641e1 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:48.674788 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-26bbf3b4-fe3d-42cc-be67-8f37471641e1 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:49.134034 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-26bbf3b4-fe3d-42cc-be67-8f37471641e1 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:54:49.142531 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-26bbf3b4-fe3d-42cc-be67-8f37471641e1 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/80d5f793-9939-442e-a629-950b36fe785f" status: 200 len: 1562 microversion: 2.1 time: 0.484691 Aug 27 03:54:49.143133 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3518/6987] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:54:48 2022] GET /compute/v2.1/servers/80d5f793-9939-442e-a629-950b36fe785f => generated 1562 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:54:49.166827 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d187effd-1129-4490-b2ef-3664e05045b5 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:54:49.167975 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d187effd-1129-4490-b2ef-3664e05045b5 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 80d5f793-9939-442e-a629-950b36fe785f] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:54:49.173675 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:54:49.174991 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=6 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:54:49.184814 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d187effd-1129-4490-b2ef-3664e05045b5 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:49.185395 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d187effd-1129-4490-b2ef-3664e05045b5 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:49.186378 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d187effd-1129-4490-b2ef-3664e05045b5 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:49.188332 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d187effd-1129-4490-b2ef-3664e05045b5 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:49.189063 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d187effd-1129-4490-b2ef-3664e05045b5 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:49.189755 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d187effd-1129-4490-b2ef-3664e05045b5 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:49.336001 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-d187effd-1129-4490-b2ef-3664e05045b5 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:54:49.345238 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d187effd-1129-4490-b2ef-3664e05045b5 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/80d5f793-9939-442e-a629-950b36fe785f" status: 200 len: 1562 microversion: 2.1 time: 0.184479 Aug 27 03:54:49.345969 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3470/6988] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:54:49 2022] GET /compute/v2.1/servers/80d5f793-9939-442e-a629-950b36fe785f => generated 1562 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:54:51.073073 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-540f6439-805f-45dd-a957-2d6a1acdf674 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:54:51.073729 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-540f6439-805f-45dd-a957-2d6a1acdf674 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 80d5f793-9939-442e-a629-950b36fe785f] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:54:51.075165 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-94a57819-9bb3-4286-a983-13c44913f66e req-a9c48373-88ff-4cbb-82af-90c18b6e1da9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80d5f793-9939-442e-a629-950b36fe785f", "tag": "217d94d3-7847-4ed1-91ec-d8635e3c07ad"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:54:51.075806 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=6 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:54:51.082399 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-540f6439-805f-45dd-a957-2d6a1acdf674 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:51.082908 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-540f6439-805f-45dd-a957-2d6a1acdf674 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:51.083360 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-540f6439-805f-45dd-a957-2d6a1acdf674 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:51.084295 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-540f6439-805f-45dd-a957-2d6a1acdf674 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:51.084960 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-540f6439-805f-45dd-a957-2d6a1acdf674 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:51.085415 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:54:51.086145 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-540f6439-805f-45dd-a957-2d6a1acdf674 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:51.093428 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-94a57819-9bb3-4286-a983-13c44913f66e req-a9c48373-88ff-4cbb-82af-90c18b6e1da9 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:51.093885 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-94a57819-9bb3-4286-a983-13c44913f66e req-a9c48373-88ff-4cbb-82af-90c18b6e1da9 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:51.094508 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-94a57819-9bb3-4286-a983-13c44913f66e req-a9c48373-88ff-4cbb-82af-90c18b6e1da9 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:51.113165 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-94a57819-9bb3-4286-a983-13c44913f66e req-a9c48373-88ff-4cbb-82af-90c18b6e1da9 service nova] Creating event network-changed:217d94d3-7847-4ed1-91ec-d8635e3c07ad for instance 80d5f793-9939-442e-a629-950b36fe785f on n-h2-852278-4 Aug 27 03:54:51.118783 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-94a57819-9bb3-4286-a983-13c44913f66e req-a9c48373-88ff-4cbb-82af-90c18b6e1da9 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047239 Aug 27 03:54:51.119659 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3471/6989] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:54:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:54:51.320777 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-540f6439-805f-45dd-a957-2d6a1acdf674 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:54:51.333325 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-540f6439-805f-45dd-a957-2d6a1acdf674 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/80d5f793-9939-442e-a629-950b36fe785f" status: 200 len: 1562 microversion: 2.1 time: 0.264492 Aug 27 03:54:51.334275 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3519/6990] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:54:51 2022] GET /compute/v2.1/servers/80d5f793-9939-442e-a629-950b36fe785f => generated 1562 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:55:14.623228 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ab32e3b9-23a8-4730-8ab7-b4175385bd56 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:55:14.625619 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-ab32e3b9-23a8-4730-8ab7-b4175385bd56 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 80d5f793-9939-442e-a629-950b36fe785f] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:55:14.627947 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=36 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:55:14.634005 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ab32e3b9-23a8-4730-8ab7-b4175385bd56 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:55:14.634418 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ab32e3b9-23a8-4730-8ab7-b4175385bd56 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:55:14.634845 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ab32e3b9-23a8-4730-8ab7-b4175385bd56 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:55:14.635531 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ab32e3b9-23a8-4730-8ab7-b4175385bd56 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:55:14.635978 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ab32e3b9-23a8-4730-8ab7-b4175385bd56 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:55:14.636419 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ab32e3b9-23a8-4730-8ab7-b4175385bd56 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:55:14.689822 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ab32e3b9-23a8-4730-8ab7-b4175385bd56 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "POST /compute/v2.1/servers/80d5f793-9939-442e-a629-950b36fe785f/action" status: 200 len: 24571 microversion: 2.1 time: 0.071249 Aug 27 03:55:14.690588 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3472/6991] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:55:14 2022] POST /compute/v2.1/servers/80d5f793-9939-442e-a629-950b36fe785f/action => generated 24571 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:55:25.790892 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e44b6d23-f846-4ce4-a41c-85bf0b41d9fa tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:55:25.793194 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-e44b6d23-f846-4ce4-a41c-85bf0b41d9fa tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 80d5f793-9939-442e-a629-950b36fe785f] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:55:25.795275 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=7 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:55:25.795997 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=32 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:55:25.803050 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e44b6d23-f846-4ce4-a41c-85bf0b41d9fa tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:55:25.803573 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e44b6d23-f846-4ce4-a41c-85bf0b41d9fa tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:55:25.804020 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e44b6d23-f846-4ce4-a41c-85bf0b41d9fa tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:55:25.804759 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e44b6d23-f846-4ce4-a41c-85bf0b41d9fa tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:55:25.805220 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e44b6d23-f846-4ce4-a41c-85bf0b41d9fa tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:55:25.805655 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e44b6d23-f846-4ce4-a41c-85bf0b41d9fa tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:55:25.884675 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e44b6d23-f846-4ce4-a41c-85bf0b41d9fa tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "POST /compute/v2.1/servers/80d5f793-9939-442e-a629-950b36fe785f/action" status: 202 len: 0 microversion: 2.1 time: 0.097945 Aug 27 03:55:25.885333 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3520/6992] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:55:25 2022] POST /compute/v2.1/servers/80d5f793-9939-442e-a629-950b36fe785f/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:55:25.894250 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ca99db4b-ebbe-4a0a-be7f-040e2313e3fa tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:55:25.894936 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-ca99db4b-ebbe-4a0a-be7f-040e2313e3fa tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 80d5f793-9939-442e-a629-950b36fe785f] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:55:25.897860 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=3 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:55:25.898511 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=4 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:55:25.905906 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ca99db4b-ebbe-4a0a-be7f-040e2313e3fa tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:55:25.906442 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ca99db4b-ebbe-4a0a-be7f-040e2313e3fa tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:55:25.907053 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ca99db4b-ebbe-4a0a-be7f-040e2313e3fa tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:55:25.907973 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ca99db4b-ebbe-4a0a-be7f-040e2313e3fa tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:55:25.908492 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ca99db4b-ebbe-4a0a-be7f-040e2313e3fa tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:55:25.908985 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ca99db4b-ebbe-4a0a-be7f-040e2313e3fa tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:55:26.140894 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-ca99db4b-ebbe-4a0a-be7f-040e2313e3fa tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:55:26.149614 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ca99db4b-ebbe-4a0a-be7f-040e2313e3fa tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/80d5f793-9939-442e-a629-950b36fe785f" status: 200 len: 1673 microversion: 2.1 time: 0.259239 Aug 27 03:55:26.155156 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3473/6993] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:55:25 2022] GET /compute/v2.1/servers/80d5f793-9939-442e-a629-950b36fe785f => generated 1673 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:55:27.172130 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e62db176-f69e-4bf1-b643-7ba935105b80 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:55:27.172926 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-e62db176-f69e-4bf1-b643-7ba935105b80 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 80d5f793-9939-442e-a629-950b36fe785f] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:55:27.181423 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e62db176-f69e-4bf1-b643-7ba935105b80 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:55:27.181856 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e62db176-f69e-4bf1-b643-7ba935105b80 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:55:27.182317 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e62db176-f69e-4bf1-b643-7ba935105b80 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:55:27.183043 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e62db176-f69e-4bf1-b643-7ba935105b80 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:55:27.183517 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e62db176-f69e-4bf1-b643-7ba935105b80 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:55:27.183959 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e62db176-f69e-4bf1-b643-7ba935105b80 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:55:27.326810 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e62db176-f69e-4bf1-b643-7ba935105b80 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:55:27.335175 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e62db176-f69e-4bf1-b643-7ba935105b80 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/80d5f793-9939-442e-a629-950b36fe785f" status: 200 len: 1678 microversion: 2.1 time: 0.167513 Aug 27 03:55:27.335779 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3521/6994] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:55:27 2022] GET /compute/v2.1/servers/80d5f793-9939-442e-a629-950b36fe785f => generated 1678 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:55:28.357897 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9a225fd7-3a5a-4493-93bf-7477ee51408c tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:55:28.358525 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-9a225fd7-3a5a-4493-93bf-7477ee51408c tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 80d5f793-9939-442e-a629-950b36fe785f] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:55:28.366016 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9a225fd7-3a5a-4493-93bf-7477ee51408c tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:55:28.366546 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9a225fd7-3a5a-4493-93bf-7477ee51408c tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:55:28.367026 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9a225fd7-3a5a-4493-93bf-7477ee51408c tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:55:28.367745 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9a225fd7-3a5a-4493-93bf-7477ee51408c tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:55:28.368198 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9a225fd7-3a5a-4493-93bf-7477ee51408c tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:55:28.368771 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9a225fd7-3a5a-4493-93bf-7477ee51408c tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:55:28.519613 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-9a225fd7-3a5a-4493-93bf-7477ee51408c tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:55:28.527739 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9a225fd7-3a5a-4493-93bf-7477ee51408c tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/80d5f793-9939-442e-a629-950b36fe785f" status: 200 len: 1678 microversion: 2.1 time: 0.174221 Aug 27 03:55:28.528334 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3474/6995] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:55:28 2022] GET /compute/v2.1/servers/80d5f793-9939-442e-a629-950b36fe785f => generated 1678 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:55:29.549988 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-97c7b9d2-bbcf-4f80-a154-21e7060854f1 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:55:29.550802 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-97c7b9d2-bbcf-4f80-a154-21e7060854f1 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 80d5f793-9939-442e-a629-950b36fe785f] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:55:29.557930 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-97c7b9d2-bbcf-4f80-a154-21e7060854f1 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:55:29.558466 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-97c7b9d2-bbcf-4f80-a154-21e7060854f1 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:55:29.558896 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-97c7b9d2-bbcf-4f80-a154-21e7060854f1 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:55:29.559621 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-97c7b9d2-bbcf-4f80-a154-21e7060854f1 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:55:29.560094 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-97c7b9d2-bbcf-4f80-a154-21e7060854f1 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:55:29.560572 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-97c7b9d2-bbcf-4f80-a154-21e7060854f1 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:55:29.703303 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-97c7b9d2-bbcf-4f80-a154-21e7060854f1 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:55:29.711545 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-97c7b9d2-bbcf-4f80-a154-21e7060854f1 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/80d5f793-9939-442e-a629-950b36fe785f" status: 200 len: 1678 microversion: 2.1 time: 0.166180 Aug 27 03:55:29.712125 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3522/6996] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:55:29 2022] GET /compute/v2.1/servers/80d5f793-9939-442e-a629-950b36fe785f => generated 1678 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:55:30.738064 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f824d2a4-a231-4c77-a4b9-835e002b4abd tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:55:30.738903 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-f824d2a4-a231-4c77-a4b9-835e002b4abd tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 80d5f793-9939-442e-a629-950b36fe785f] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:55:30.748361 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f824d2a4-a231-4c77-a4b9-835e002b4abd tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:55:30.748937 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f824d2a4-a231-4c77-a4b9-835e002b4abd tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:55:30.749398 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f824d2a4-a231-4c77-a4b9-835e002b4abd tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:55:30.750087 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f824d2a4-a231-4c77-a4b9-835e002b4abd tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:55:30.750559 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f824d2a4-a231-4c77-a4b9-835e002b4abd tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:55:30.750987 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f824d2a4-a231-4c77-a4b9-835e002b4abd tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:55:30.906733 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-f824d2a4-a231-4c77-a4b9-835e002b4abd tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:55:30.915024 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f824d2a4-a231-4c77-a4b9-835e002b4abd tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/80d5f793-9939-442e-a629-950b36fe785f" status: 200 len: 1678 microversion: 2.1 time: 0.183751 Aug 27 03:55:30.915619 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3475/6997] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:55:30 2022] GET /compute/v2.1/servers/80d5f793-9939-442e-a629-950b36fe785f => generated 1678 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:55:31.937976 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-1781fdf2-979b-40fa-a4c9-1b27b1cf8f7b tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:55:31.938625 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-1781fdf2-979b-40fa-a4c9-1b27b1cf8f7b tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 80d5f793-9939-442e-a629-950b36fe785f] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:55:31.945938 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1781fdf2-979b-40fa-a4c9-1b27b1cf8f7b tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:55:31.946444 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1781fdf2-979b-40fa-a4c9-1b27b1cf8f7b tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:55:31.946912 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1781fdf2-979b-40fa-a4c9-1b27b1cf8f7b tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:55:31.947600 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1781fdf2-979b-40fa-a4c9-1b27b1cf8f7b tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:55:31.948088 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1781fdf2-979b-40fa-a4c9-1b27b1cf8f7b tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:55:31.948566 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1781fdf2-979b-40fa-a4c9-1b27b1cf8f7b tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:55:32.092837 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-1781fdf2-979b-40fa-a4c9-1b27b1cf8f7b tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:55:32.101151 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-1781fdf2-979b-40fa-a4c9-1b27b1cf8f7b tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/80d5f793-9939-442e-a629-950b36fe785f" status: 200 len: 1678 microversion: 2.1 time: 0.167185 Aug 27 03:55:32.101782 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3523/6998] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:55:31 2022] GET /compute/v2.1/servers/80d5f793-9939-442e-a629-950b36fe785f => generated 1678 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:55:33.123846 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b4f264ac-d287-451a-bbed-02efd7e2d288 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:55:33.124512 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b4f264ac-d287-451a-bbed-02efd7e2d288 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 80d5f793-9939-442e-a629-950b36fe785f] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:55:33.131773 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b4f264ac-d287-451a-bbed-02efd7e2d288 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:55:33.132260 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b4f264ac-d287-451a-bbed-02efd7e2d288 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:55:33.132745 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b4f264ac-d287-451a-bbed-02efd7e2d288 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:55:33.133424 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b4f264ac-d287-451a-bbed-02efd7e2d288 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:55:33.133866 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b4f264ac-d287-451a-bbed-02efd7e2d288 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:55:33.134275 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b4f264ac-d287-451a-bbed-02efd7e2d288 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:55:33.275786 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b4f264ac-d287-451a-bbed-02efd7e2d288 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:55:33.283985 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b4f264ac-d287-451a-bbed-02efd7e2d288 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/80d5f793-9939-442e-a629-950b36fe785f" status: 200 len: 1678 microversion: 2.1 time: 0.164580 Aug 27 03:55:33.284661 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3476/6999] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:55:33 2022] GET /compute/v2.1/servers/80d5f793-9939-442e-a629-950b36fe785f => generated 1678 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:55:34.306142 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-6b483a2a-f7fe-4879-a004-89790373ba5a tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:55:34.306774 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-6b483a2a-f7fe-4879-a004-89790373ba5a tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 80d5f793-9939-442e-a629-950b36fe785f] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:55:34.314312 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6b483a2a-f7fe-4879-a004-89790373ba5a tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:55:34.314826 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6b483a2a-f7fe-4879-a004-89790373ba5a tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:55:34.315272 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6b483a2a-f7fe-4879-a004-89790373ba5a tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:55:34.315996 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6b483a2a-f7fe-4879-a004-89790373ba5a tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:55:34.316503 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6b483a2a-f7fe-4879-a004-89790373ba5a tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:55:34.316939 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6b483a2a-f7fe-4879-a004-89790373ba5a tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:55:34.517144 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-6b483a2a-f7fe-4879-a004-89790373ba5a tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:55:34.526510 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-6b483a2a-f7fe-4879-a004-89790373ba5a tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/80d5f793-9939-442e-a629-950b36fe785f" status: 200 len: 1678 microversion: 2.1 time: 0.224264 Aug 27 03:55:34.527120 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3524/7000] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:55:34 2022] GET /compute/v2.1/servers/80d5f793-9939-442e-a629-950b36fe785f => generated 1678 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:55:35.554795 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e28829f4-47cd-47ad-bd55-5040dcf68ead tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:55:35.555427 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-e28829f4-47cd-47ad-bd55-5040dcf68ead tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 80d5f793-9939-442e-a629-950b36fe785f] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:55:35.563099 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e28829f4-47cd-47ad-bd55-5040dcf68ead tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:55:35.563898 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e28829f4-47cd-47ad-bd55-5040dcf68ead tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:55:35.564353 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e28829f4-47cd-47ad-bd55-5040dcf68ead tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:55:35.565078 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e28829f4-47cd-47ad-bd55-5040dcf68ead tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:55:35.565531 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e28829f4-47cd-47ad-bd55-5040dcf68ead tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:55:35.565960 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e28829f4-47cd-47ad-bd55-5040dcf68ead tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:55:35.705324 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-e28829f4-47cd-47ad-bd55-5040dcf68ead tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:55:35.714057 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e28829f4-47cd-47ad-bd55-5040dcf68ead tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/80d5f793-9939-442e-a629-950b36fe785f" status: 200 len: 1678 microversion: 2.1 time: 0.163341 Aug 27 03:55:35.714757 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3477/7001] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:55:35 2022] GET /compute/v2.1/servers/80d5f793-9939-442e-a629-950b36fe785f => generated 1678 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:55:36.736154 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-89f468b7-af12-48cc-af9e-75c5811f71e0 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:55:36.736813 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-89f468b7-af12-48cc-af9e-75c5811f71e0 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 80d5f793-9939-442e-a629-950b36fe785f] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:55:36.747000 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-89f468b7-af12-48cc-af9e-75c5811f71e0 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:55:36.747903 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-89f468b7-af12-48cc-af9e-75c5811f71e0 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:55:36.748664 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-89f468b7-af12-48cc-af9e-75c5811f71e0 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:55:36.749767 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-89f468b7-af12-48cc-af9e-75c5811f71e0 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:55:36.750537 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-89f468b7-af12-48cc-af9e-75c5811f71e0 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:55:36.751228 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-89f468b7-af12-48cc-af9e-75c5811f71e0 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:55:36.934899 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-89f468b7-af12-48cc-af9e-75c5811f71e0 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:55:36.943253 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-89f468b7-af12-48cc-af9e-75c5811f71e0 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/80d5f793-9939-442e-a629-950b36fe785f" status: 200 len: 1678 microversion: 2.1 time: 0.211251 Aug 27 03:55:36.943886 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3525/7002] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:55:36 2022] GET /compute/v2.1/servers/80d5f793-9939-442e-a629-950b36fe785f => generated 1678 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:55:37.965682 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c91ff8ac-4e90-4e5d-95ec-58251f9f086b tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:55:37.966327 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-c91ff8ac-4e90-4e5d-95ec-58251f9f086b tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 80d5f793-9939-442e-a629-950b36fe785f] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:55:37.974465 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c91ff8ac-4e90-4e5d-95ec-58251f9f086b tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:55:37.974952 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c91ff8ac-4e90-4e5d-95ec-58251f9f086b tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:55:37.975385 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c91ff8ac-4e90-4e5d-95ec-58251f9f086b tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:55:37.976089 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c91ff8ac-4e90-4e5d-95ec-58251f9f086b tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:55:37.976571 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c91ff8ac-4e90-4e5d-95ec-58251f9f086b tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:55:37.976992 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c91ff8ac-4e90-4e5d-95ec-58251f9f086b tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:55:38.135920 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-c91ff8ac-4e90-4e5d-95ec-58251f9f086b tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:55:38.146088 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c91ff8ac-4e90-4e5d-95ec-58251f9f086b tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/80d5f793-9939-442e-a629-950b36fe785f" status: 200 len: 1678 microversion: 2.1 time: 0.184501 Aug 27 03:55:38.146716 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3478/7003] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:55:37 2022] GET /compute/v2.1/servers/80d5f793-9939-442e-a629-950b36fe785f => generated 1678 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:55:39.168481 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-141c5e90-a6e6-49ed-a041-9ce9496ee6bd tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:55:39.169159 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-141c5e90-a6e6-49ed-a041-9ce9496ee6bd tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 80d5f793-9939-442e-a629-950b36fe785f] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:55:39.177965 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-141c5e90-a6e6-49ed-a041-9ce9496ee6bd tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:55:39.178520 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-141c5e90-a6e6-49ed-a041-9ce9496ee6bd tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:55:39.179050 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-141c5e90-a6e6-49ed-a041-9ce9496ee6bd tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:55:39.179943 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-141c5e90-a6e6-49ed-a041-9ce9496ee6bd tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:55:39.180537 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-141c5e90-a6e6-49ed-a041-9ce9496ee6bd tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:55:39.181087 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-141c5e90-a6e6-49ed-a041-9ce9496ee6bd tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:55:39.327033 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-141c5e90-a6e6-49ed-a041-9ce9496ee6bd tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:55:39.335259 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-141c5e90-a6e6-49ed-a041-9ce9496ee6bd tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/80d5f793-9939-442e-a629-950b36fe785f" status: 200 len: 1678 microversion: 2.1 time: 0.171066 Aug 27 03:55:39.335860 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3526/7004] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:55:39 2022] GET /compute/v2.1/servers/80d5f793-9939-442e-a629-950b36fe785f => generated 1678 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:55:40.357735 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-06ab849f-3a30-497f-ac7d-a8c2bdb9c41e tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:55:40.359226 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-06ab849f-3a30-497f-ac7d-a8c2bdb9c41e tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 80d5f793-9939-442e-a629-950b36fe785f] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:55:40.367978 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-06ab849f-3a30-497f-ac7d-a8c2bdb9c41e tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:55:40.368546 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-06ab849f-3a30-497f-ac7d-a8c2bdb9c41e tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:55:40.369109 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-06ab849f-3a30-497f-ac7d-a8c2bdb9c41e tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:55:40.370052 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-06ab849f-3a30-497f-ac7d-a8c2bdb9c41e tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:55:40.370505 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-06ab849f-3a30-497f-ac7d-a8c2bdb9c41e tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:55:40.370931 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-06ab849f-3a30-497f-ac7d-a8c2bdb9c41e tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:55:40.511775 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-06ab849f-3a30-497f-ac7d-a8c2bdb9c41e tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:55:40.520063 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-06ab849f-3a30-497f-ac7d-a8c2bdb9c41e tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/80d5f793-9939-442e-a629-950b36fe785f" status: 200 len: 1678 microversion: 2.1 time: 0.166624 Aug 27 03:55:40.520698 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3479/7005] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:55:40 2022] GET /compute/v2.1/servers/80d5f793-9939-442e-a629-950b36fe785f => generated 1678 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:55:41.542585 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d7ad9567-76a8-4092-b3db-b3aedc48c293 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:55:41.543216 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d7ad9567-76a8-4092-b3db-b3aedc48c293 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 80d5f793-9939-442e-a629-950b36fe785f] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:55:41.551638 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d7ad9567-76a8-4092-b3db-b3aedc48c293 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:55:41.552156 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d7ad9567-76a8-4092-b3db-b3aedc48c293 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:55:41.552758 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d7ad9567-76a8-4092-b3db-b3aedc48c293 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:55:41.553458 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d7ad9567-76a8-4092-b3db-b3aedc48c293 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:55:41.553936 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d7ad9567-76a8-4092-b3db-b3aedc48c293 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:55:41.554386 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d7ad9567-76a8-4092-b3db-b3aedc48c293 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:55:41.706622 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d7ad9567-76a8-4092-b3db-b3aedc48c293 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:55:41.715451 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d7ad9567-76a8-4092-b3db-b3aedc48c293 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/80d5f793-9939-442e-a629-950b36fe785f" status: 200 len: 1678 microversion: 2.1 time: 0.177063 Aug 27 03:55:41.716053 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3527/7006] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:55:41 2022] GET /compute/v2.1/servers/80d5f793-9939-442e-a629-950b36fe785f => generated 1678 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:55:42.738231 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9e4fa906-b978-4132-b396-9bef6e25b2cd tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:55:42.738861 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-9e4fa906-b978-4132-b396-9bef6e25b2cd tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 80d5f793-9939-442e-a629-950b36fe785f] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:55:42.745682 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9e4fa906-b978-4132-b396-9bef6e25b2cd tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:55:42.746176 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9e4fa906-b978-4132-b396-9bef6e25b2cd tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:55:42.746615 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9e4fa906-b978-4132-b396-9bef6e25b2cd tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:55:42.747319 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9e4fa906-b978-4132-b396-9bef6e25b2cd tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:55:42.747840 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9e4fa906-b978-4132-b396-9bef6e25b2cd tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:55:42.748266 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9e4fa906-b978-4132-b396-9bef6e25b2cd tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:55:42.915813 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-9e4fa906-b978-4132-b396-9bef6e25b2cd tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:55:42.925073 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9e4fa906-b978-4132-b396-9bef6e25b2cd tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/80d5f793-9939-442e-a629-950b36fe785f" status: 200 len: 1681 microversion: 2.1 time: 0.190420 Aug 27 03:55:42.928038 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3480/7007] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:55:42 2022] GET /compute/v2.1/servers/80d5f793-9939-442e-a629-950b36fe785f => generated 1681 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:56:09.143820 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-afba64d8-f0f6-4212-9a70-4d6a2208d22a tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:56:09.146111 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-afba64d8-f0f6-4212-9a70-4d6a2208d22a tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 80d5f793-9939-442e-a629-950b36fe785f] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:09.148856 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=16 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:56:09.149541 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:56:09.155266 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-afba64d8-f0f6-4212-9a70-4d6a2208d22a tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:09.155763 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-afba64d8-f0f6-4212-9a70-4d6a2208d22a tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:09.156193 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-afba64d8-f0f6-4212-9a70-4d6a2208d22a tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:09.156950 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-afba64d8-f0f6-4212-9a70-4d6a2208d22a tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:09.157395 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-afba64d8-f0f6-4212-9a70-4d6a2208d22a tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:09.157828 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-afba64d8-f0f6-4212-9a70-4d6a2208d22a tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:09.217544 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-afba64d8-f0f6-4212-9a70-4d6a2208d22a tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "POST /compute/v2.1/servers/80d5f793-9939-442e-a629-950b36fe785f/action" status: 200 len: 69026 microversion: 2.1 time: 0.079008 Aug 27 03:56:09.218459 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3528/7008] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:56:09 2022] POST /compute/v2.1/servers/80d5f793-9939-442e-a629-950b36fe785f/action => generated 69026 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:56:17.071767 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a0533ae6-1857-44af-a135-e61cdfe276fd tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:17.072733 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a0533ae6-1857-44af-a135-e61cdfe276fd tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 80d5f793-9939-442e-a629-950b36fe785f] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:17.075860 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=16 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:56:17.076907 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=48 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:56:17.087501 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a0533ae6-1857-44af-a135-e61cdfe276fd tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:17.088451 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a0533ae6-1857-44af-a135-e61cdfe276fd tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:17.089250 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a0533ae6-1857-44af-a135-e61cdfe276fd tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:17.090501 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a0533ae6-1857-44af-a135-e61cdfe276fd tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:17.091350 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a0533ae6-1857-44af-a135-e61cdfe276fd tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:17.092203 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a0533ae6-1857-44af-a135-e61cdfe276fd tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:17.134930 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a0533ae6-1857-44af-a135-e61cdfe276fd tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 80d5f793-9939-442e-a629-950b36fe785f] Going to try to terminate instance {{(pid=134052) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:56:17.159443 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-dc7dc362-6c89-4db8-a00d-fd39e7fd81e8 req-9bfc7a3b-6cfb-4890-9ca6-be99e62a5f00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80d5f793-9939-442e-a629-950b36fe785f", "tag": "217d94d3-7847-4ed1-91ec-d8635e3c07ad"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:56:17.171127 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-dc7dc362-6c89-4db8-a00d-fd39e7fd81e8 req-9bfc7a3b-6cfb-4890-9ca6-be99e62a5f00 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:17.171975 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-dc7dc362-6c89-4db8-a00d-fd39e7fd81e8 req-9bfc7a3b-6cfb-4890-9ca6-be99e62a5f00 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:17.172978 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-dc7dc362-6c89-4db8-a00d-fd39e7fd81e8 req-9bfc7a3b-6cfb-4890-9ca6-be99e62a5f00 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:17.184973 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-dc7dc362-6c89-4db8-a00d-fd39e7fd81e8 req-9bfc7a3b-6cfb-4890-9ca6-be99e62a5f00 service nova] Creating event network-changed:217d94d3-7847-4ed1-91ec-d8635e3c07ad for instance 80d5f793-9939-442e-a629-950b36fe785f on n-h2-852278-4 Aug 27 03:56:17.191465 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-dc7dc362-6c89-4db8-a00d-fd39e7fd81e8 req-9bfc7a3b-6cfb-4890-9ca6-be99e62a5f00 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123259 Aug 27 03:56:17.192421 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3529/7009] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:56:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:56:17.247264 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a0533ae6-1857-44af-a135-e61cdfe276fd tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "DELETE /compute/v2.1/servers/80d5f793-9939-442e-a629-950b36fe785f" status: 204 len: 0 microversion: 2.1 time: 0.181220 Aug 27 03:56:17.248420 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3481/7010] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 03:56:17 2022] DELETE /compute/v2.1/servers/80d5f793-9939-442e-a629-950b36fe785f => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:56:17.259289 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-099ddfa4-6d62-4fc7-bd58-7940f16c4cd8 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:17.260129 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-099ddfa4-6d62-4fc7-bd58-7940f16c4cd8 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 80d5f793-9939-442e-a629-950b36fe785f] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:17.267561 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-099ddfa4-6d62-4fc7-bd58-7940f16c4cd8 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:17.268083 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-099ddfa4-6d62-4fc7-bd58-7940f16c4cd8 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:17.268605 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-099ddfa4-6d62-4fc7-bd58-7940f16c4cd8 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:17.269355 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-099ddfa4-6d62-4fc7-bd58-7940f16c4cd8 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:17.269855 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-099ddfa4-6d62-4fc7-bd58-7940f16c4cd8 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:17.270277 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-099ddfa4-6d62-4fc7-bd58-7940f16c4cd8 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:17.418736 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-099ddfa4-6d62-4fc7-bd58-7940f16c4cd8 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:56:17.427551 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-099ddfa4-6d62-4fc7-bd58-7940f16c4cd8 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/80d5f793-9939-442e-a629-950b36fe785f" status: 200 len: 1687 microversion: 2.1 time: 0.173772 Aug 27 03:56:17.428155 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3530/7011] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:17 2022] GET /compute/v2.1/servers/80d5f793-9939-442e-a629-950b36fe785f => generated 1687 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:56:18.451055 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-79f2a834-4131-4a53-b868-6908b2243f57 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:18.451823 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-79f2a834-4131-4a53-b868-6908b2243f57 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 80d5f793-9939-442e-a629-950b36fe785f] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:18.459970 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-79f2a834-4131-4a53-b868-6908b2243f57 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:18.460482 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-79f2a834-4131-4a53-b868-6908b2243f57 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:18.460924 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-79f2a834-4131-4a53-b868-6908b2243f57 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:18.461647 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-79f2a834-4131-4a53-b868-6908b2243f57 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:18.462085 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-79f2a834-4131-4a53-b868-6908b2243f57 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:18.462500 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-79f2a834-4131-4a53-b868-6908b2243f57 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:18.657821 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-79f2a834-4131-4a53-b868-6908b2243f57 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:56:18.667940 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-79f2a834-4131-4a53-b868-6908b2243f57 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/80d5f793-9939-442e-a629-950b36fe785f" status: 200 len: 1687 microversion: 2.1 time: 0.221926 Aug 27 03:56:18.668579 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3482/7012] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:18 2022] GET /compute/v2.1/servers/80d5f793-9939-442e-a629-950b36fe785f => generated 1687 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:56:19.558884 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-28b7c093-a3f2-4c2d-b23d-36f6e934bb4b req-0b9fe0b1-3b61-4e4f-a199-ae4271780e46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80d5f793-9939-442e-a629-950b36fe785f", "name": "network-vif-deleted", "tag": "217d94d3-7847-4ed1-91ec-d8635e3c07ad"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:56:19.570629 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-28b7c093-a3f2-4c2d-b23d-36f6e934bb4b req-0b9fe0b1-3b61-4e4f-a199-ae4271780e46 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:19.571223 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-28b7c093-a3f2-4c2d-b23d-36f6e934bb4b req-0b9fe0b1-3b61-4e4f-a199-ae4271780e46 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:19.571675 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-28b7c093-a3f2-4c2d-b23d-36f6e934bb4b req-0b9fe0b1-3b61-4e4f-a199-ae4271780e46 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:19.584565 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-28b7c093-a3f2-4c2d-b23d-36f6e934bb4b req-0b9fe0b1-3b61-4e4f-a199-ae4271780e46 service nova] Creating event network-vif-deleted:217d94d3-7847-4ed1-91ec-d8635e3c07ad for instance 80d5f793-9939-442e-a629-950b36fe785f on n-h2-852278-4 Aug 27 03:56:19.591848 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-28b7c093-a3f2-4c2d-b23d-36f6e934bb4b req-0b9fe0b1-3b61-4e4f-a199-ae4271780e46 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036734 Aug 27 03:56:19.592528 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3531/7013] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:56:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:56:19.700948 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f65fa8c0-48ff-48bd-9dbe-bce9a2039ad9 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:19.701965 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-f65fa8c0-48ff-48bd-9dbe-bce9a2039ad9 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 80d5f793-9939-442e-a629-950b36fe785f] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:19.709058 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f65fa8c0-48ff-48bd-9dbe-bce9a2039ad9 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:19.709545 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f65fa8c0-48ff-48bd-9dbe-bce9a2039ad9 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:19.710234 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f65fa8c0-48ff-48bd-9dbe-bce9a2039ad9 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:19.711021 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f65fa8c0-48ff-48bd-9dbe-bce9a2039ad9 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:19.711521 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f65fa8c0-48ff-48bd-9dbe-bce9a2039ad9 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:19.711948 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f65fa8c0-48ff-48bd-9dbe-bce9a2039ad9 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:19.749147 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f65fa8c0-48ff-48bd-9dbe-bce9a2039ad9 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:19.749626 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f65fa8c0-48ff-48bd-9dbe-bce9a2039ad9 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:19.750062 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f65fa8c0-48ff-48bd-9dbe-bce9a2039ad9 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:19.750506 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.instance [None req-f65fa8c0-48ff-48bd-9dbe-bce9a2039ad9 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lazy-loading 'fault' on Instance uuid 80d5f793-9939-442e-a629-950b36fe785f {{(pid=134052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:56:19.799454 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-f65fa8c0-48ff-48bd-9dbe-bce9a2039ad9 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:56:19.807504 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f65fa8c0-48ff-48bd-9dbe-bce9a2039ad9 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/80d5f793-9939-442e-a629-950b36fe785f" status: 200 len: 1356 microversion: 2.1 time: 0.110987 Aug 27 03:56:19.808297 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3483/7014] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:19 2022] GET /compute/v2.1/servers/80d5f793-9939-442e-a629-950b36fe785f => generated 1356 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:56:20.830762 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-10ecb915-fefe-40a0-bf8b-a0fb9e460bb2 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:20.831766 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-10ecb915-fefe-40a0-bf8b-a0fb9e460bb2 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 80d5f793-9939-442e-a629-950b36fe785f] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:20.841046 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-10ecb915-fefe-40a0-bf8b-a0fb9e460bb2 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:20.841633 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-10ecb915-fefe-40a0-bf8b-a0fb9e460bb2 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:20.842244 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-10ecb915-fefe-40a0-bf8b-a0fb9e460bb2 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:20.842968 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-10ecb915-fefe-40a0-bf8b-a0fb9e460bb2 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:20.843441 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-10ecb915-fefe-40a0-bf8b-a0fb9e460bb2 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:20.843882 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-10ecb915-fefe-40a0-bf8b-a0fb9e460bb2 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:20.859574 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-10ecb915-fefe-40a0-bf8b-a0fb9e460bb2 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] HTTP exception thrown: Instance 80d5f793-9939-442e-a629-950b36fe785f could not be found. Aug 27 03:56:20.861360 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-10ecb915-fefe-40a0-bf8b-a0fb9e460bb2 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Request method failure captured: Aug 27 03:56:20.861360 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/80d5f793-9939-442e-a629-950b36fe785f HTTP/1.1 Aug 27 03:56:20.861360 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 03:56:20.861360 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 03:56:20.861360 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 03:56:20.861360 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 03:56:20.861360 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 03:56:20.861360 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 03:56:20.861360 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 03:56:20.861360 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 03:56:20.861360 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCZU37KUCPlLNPa46uoYyHww48hoe3u_z-BgLN9g-oq2tOv22Rtnsjni3NQSTpUSFvnqw-iilMtJmmXNN3mDjBxOFqxVi8ULOCUVZBgtRQ3Q2tRHScCw5ed_FU_gznAbg4sRYwVid01sApcIv5MJUox6pjFVHV0WUHFDPrPNCAXQKHo4 Aug 27 03:56:20.861360 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 03:56:20.861360 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 03:56:20.861360 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 03:56:20.861360 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 03:56:20.861360 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 03:56:20.861360 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 03:56:20.861360 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 961e5856cfda49f3a46a5db96d35050f Aug 27 03:56:20.861360 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-967904917 Aug 27 03:56:20.861360 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 03:56:20.861360 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 03:56:20.861360 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/961e5856cfda49f3a46a5db96d35050f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_961e5856cfda49f3a46a5db96d35050f", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/961e5856cfda49f3a46a5db96d35050f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/961e5856cfda49f3a46a5db96d35050f"}]}] Aug 27 03:56:20.861360 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-TestNetworkAdvancedServerOps-967904917 Aug 27 03:56:20.861360 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 961e5856cfda49f3a46a5db96d35050f Aug 27 03:56:20.861360 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-967904917 Aug 27 03:56:20.861360 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-TestNetworkAdvancedServerOps-967904917-project Aug 27 03:56:20.861360 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 03:56:20.861360 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 03:56:20.861360 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 4dd9a215fc244b839b2334274274675f Aug 27 03:56:20.861360 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-TestNetworkAdvancedServerOps-967904917-project Aug 27 03:56:20.861360 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 03:56:20.861360 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance 80d5f793-9939-442e-a629-950b36fe785f could not be found. Aug 27 03:56:20.861360 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '80d5f793-9939-442e-a629-950b36fe785f'} Aug 27 03:56:20.861360 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:56:20.861360 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:56:20.861360 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:56:20.861360 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:56:20.861360 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:56:20.861360 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:56:20.861360 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:56:20.861360 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:56:20.861360 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:56:20.861360 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:56:20.861360 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80d5f793-9939-442e-a629-950b36fe785f could not be found. Aug 27 03:56:20.861360 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:56:20.861360 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:56:20.861360 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:56:20.861360 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:56:20.861360 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:56:20.861360 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:56:20.861360 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:56:20.861360 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:56:20.861360 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:56:20.861360 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:56:20.861360 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:56:20.861360 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:56:20.861360 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:56:20.861360 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:56:20.861360 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:56:20.861360 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:56:20.861360 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80d5f793-9939-442e-a629-950b36fe785f could not be found. Aug 27 03:56:20.861360 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:56:20.861360 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:56:20.865497 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:56:20.865497 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:56:20.865497 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:56:20.865497 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:56:20.865497 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:56:20.865497 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:56:20.865497 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80d5f793-9939-442e-a629-950b36fe785f could not be found. Aug 27 03:56:20.865497 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:56:20.865497 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-10ecb915-fefe-40a0-bf8b-a0fb9e460bb2 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Returning 404 to user: Instance 80d5f793-9939-442e-a629-950b36fe785f could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:56:20.865497 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-10ecb915-fefe-40a0-bf8b-a0fb9e460bb2 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/80d5f793-9939-442e-a629-950b36fe785f" status: 404 len: 111 microversion: 2.1 time: 0.037024 Aug 27 03:56:20.865497 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3532/7015] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:20 2022] GET /compute/v2.1/servers/80d5f793-9939-442e-a629-950b36fe785f => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:56:24.143344 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c631ec45-b50e-4a84-a11f-fb4ad1dfdfa4 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '.version_select at 0x7f5ee240aaf0>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:24.178184 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c631ec45-b50e-4a84-a11f-fb4ad1dfdfa4 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1091347333" status: 202 len: 0 microversion: 2.1 time: 0.038930 Aug 27 03:56:24.178803 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3484/7016] 10.222.0.70 () {58 vars in 1284 bytes} [Sat Aug 27 03:56:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1091347333 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:56:24.213350 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4df1e9b4-a20f-43ce-938e-555025d3f88d tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Action: 'create', calling method: .version_select at 0x7f5edec721f0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1961471257", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMwHMsYIW0Xo2cW4Px1BETlmuIooZfgS7Mb5KKF31qQDG9AJvFn89Pq+NSVv4dWTvp0jG8Q5pItLRRjCoXLhO7IzW3RxBPC8kFfXYb+oDT2SUbEqP5xj5HBWizhZne+1Lg=="}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:56:24.236510 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-4df1e9b4-a20f-43ce-938e-555025d3f88d tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Getting quotas for project 961e5856cfda49f3a46a5db96d35050f. Resources: {'key_pairs'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:56:24.244363 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-4df1e9b4-a20f-43ce-938e-555025d3f88d tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Getting quotas for user 4dd9a215fc244b839b2334274274675f and project 961e5856cfda49f3a46a5db96d35050f. Resources: {'key_pairs'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:56:24.271604 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-4df1e9b4-a20f-43ce-938e-555025d3f88d tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.062294 Aug 27 03:56:24.272461 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3533/7017] 10.222.0.70 () {60 vars in 1159 bytes} [Sat Aug 27 03:56:24 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:56:30.678379 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9c2911b9-5c05-4244-a768-4f7e2a33f19a tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-553181076", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "networks": [{"uuid": "5afcb546-da13-4694-8151-e181f7ad38f8"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1961471257", "security_groups": [{"name": "tempest-secgroup-smoke-1261407738"}]}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:56:30.697828 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:56:30.832607 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.network.neutron [None req-9c2911b9-5c05-4244-a768-4f7e2a33f19a tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] validate_networks() for [('5afcb546-da13-4694-8151-e181f7ad38f8', None, None, None, None, None)] {{(pid=134052) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:56:31.262344 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-9c2911b9-5c05-4244-a768-4f7e2a33f19a tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Flavor limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:56:31.262916 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-9c2911b9-5c05-4244-a768-4f7e2a33f19a tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Image limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:56:31.263520 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-9c2911b9-5c05-4244-a768-4f7e2a33f19a tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Flavor pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:56:31.264069 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-9c2911b9-5c05-4244-a768-4f7e2a33f19a tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Image pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:56:31.264647 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-9c2911b9-5c05-4244-a768-4f7e2a33f19a tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:56:31.275594 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9c2911b9-5c05-4244-a768-4f7e2a33f19a tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:31.276170 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9c2911b9-5c05-4244-a768-4f7e2a33f19a tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:31.276741 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9c2911b9-5c05-4244-a768-4f7e2a33f19a tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:31.277581 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9c2911b9-5c05-4244-a768-4f7e2a33f19a tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:31.278103 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9c2911b9-5c05-4244-a768-4f7e2a33f19a tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:31.278634 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9c2911b9-5c05-4244-a768-4f7e2a33f19a tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:31.297313 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-9c2911b9-5c05-4244-a768-4f7e2a33f19a tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Getting quotas for project 961e5856cfda49f3a46a5db96d35050f. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:56:31.303038 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-9c2911b9-5c05-4244-a768-4f7e2a33f19a tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Getting quotas for user 4dd9a215fc244b839b2334274274675f and project 961e5856cfda49f3a46a5db96d35050f. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:56:31.317745 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-9c2911b9-5c05-4244-a768-4f7e2a33f19a tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Going to run 1 instances... {{(pid=134052) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:56:31.320260 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-9c2911b9-5c05-4244-a768-4f7e2a33f19a tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: a7c2818c-4019-4f05-a716-503458fd712a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134052) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:56:31.388104 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9c2911b9-5c05-4244-a768-4f7e2a33f19a tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.713574 Aug 27 03:56:31.390026 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3485/7018] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 03:56:30 2022] POST /compute/v2.1/servers => generated 406 bytes in 716 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:56:31.402829 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-bfae4ae8-d26a-4914-8593-4e0fb4d3eff7 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:31.403790 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-bfae4ae8-d26a-4914-8593-4e0fb4d3eff7 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: a7c2818c-4019-4f05-a716-503458fd712a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:31.407476 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=16 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:56:31.480151 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-bfae4ae8-d26a-4914-8593-4e0fb4d3eff7 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:56:31.488764 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-bfae4ae8-d26a-4914-8593-4e0fb4d3eff7 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/a7c2818c-4019-4f05-a716-503458fd712a" status: 200 len: 1266 microversion: 2.1 time: 0.090500 Aug 27 03:56:31.489381 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3534/7019] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:31 2022] GET /compute/v2.1/servers/a7c2818c-4019-4f05-a716-503458fd712a => generated 1266 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:56:32.512933 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9f5b3d3a-02e2-4a31-b858-5aef44a0470c tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:32.513506 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-9f5b3d3a-02e2-4a31-b858-5aef44a0470c tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: a7c2818c-4019-4f05-a716-503458fd712a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:32.596002 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-9f5b3d3a-02e2-4a31-b858-5aef44a0470c tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:56:32.604353 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9f5b3d3a-02e2-4a31-b858-5aef44a0470c tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/a7c2818c-4019-4f05-a716-503458fd712a" status: 200 len: 1266 microversion: 2.1 time: 0.097680 Aug 27 03:56:32.605301 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3486/7020] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:32 2022] GET /compute/v2.1/servers/a7c2818c-4019-4f05-a716-503458fd712a => generated 1266 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:56:33.626700 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3d76466a-87df-413e-8892-f08b5fee4503 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:33.627596 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-3d76466a-87df-413e-8892-f08b5fee4503 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: a7c2818c-4019-4f05-a716-503458fd712a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:33.635995 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3d76466a-87df-413e-8892-f08b5fee4503 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:33.636822 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3d76466a-87df-413e-8892-f08b5fee4503 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:33.637441 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3d76466a-87df-413e-8892-f08b5fee4503 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:33.638331 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3d76466a-87df-413e-8892-f08b5fee4503 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:33.638939 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3d76466a-87df-413e-8892-f08b5fee4503 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:33.639522 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3d76466a-87df-413e-8892-f08b5fee4503 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:33.740998 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-3d76466a-87df-413e-8892-f08b5fee4503 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:56:33.750742 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-3d76466a-87df-413e-8892-f08b5fee4503 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/a7c2818c-4019-4f05-a716-503458fd712a" status: 200 len: 1326 microversion: 2.1 time: 0.127935 Aug 27 03:56:33.751704 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3535/7021] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:33 2022] GET /compute/v2.1/servers/a7c2818c-4019-4f05-a716-503458fd712a => generated 1326 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:56:34.786303 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-94cdf102-29be-4262-a739-ecbce0dceaa5 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:34.787689 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-94cdf102-29be-4262-a739-ecbce0dceaa5 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: a7c2818c-4019-4f05-a716-503458fd712a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:34.798307 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-94cdf102-29be-4262-a739-ecbce0dceaa5 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:34.798942 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-94cdf102-29be-4262-a739-ecbce0dceaa5 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:34.799411 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-94cdf102-29be-4262-a739-ecbce0dceaa5 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:34.800130 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-94cdf102-29be-4262-a739-ecbce0dceaa5 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:34.800614 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-94cdf102-29be-4262-a739-ecbce0dceaa5 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:34.801041 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-94cdf102-29be-4262-a739-ecbce0dceaa5 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:35.035006 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-94cdf102-29be-4262-a739-ecbce0dceaa5 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:56:35.043642 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-94cdf102-29be-4262-a739-ecbce0dceaa5 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/a7c2818c-4019-4f05-a716-503458fd712a" status: 200 len: 1392 microversion: 2.1 time: 0.275265 Aug 27 03:56:35.044348 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3487/7022] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:34 2022] GET /compute/v2.1/servers/a7c2818c-4019-4f05-a716-503458fd712a => generated 1392 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:56:35.657159 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-00aae98b-9a1c-4518-8169-7a35cd7cc476 req-be3f504b-030d-4380-a8f8-82c948446730 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7c2818c-4019-4f05-a716-503458fd712a", "tag": "2ac9313d-274b-400e-aff5-e6b1ccb56784"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:56:35.673831 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-00aae98b-9a1c-4518-8169-7a35cd7cc476 req-be3f504b-030d-4380-a8f8-82c948446730 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:35.674329 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-00aae98b-9a1c-4518-8169-7a35cd7cc476 req-be3f504b-030d-4380-a8f8-82c948446730 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:35.674745 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-00aae98b-9a1c-4518-8169-7a35cd7cc476 req-be3f504b-030d-4380-a8f8-82c948446730 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:35.688087 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-00aae98b-9a1c-4518-8169-7a35cd7cc476 req-be3f504b-030d-4380-a8f8-82c948446730 service nova] Creating event network-changed:2ac9313d-274b-400e-aff5-e6b1ccb56784 for instance a7c2818c-4019-4f05-a716-503458fd712a on n-h1-852278-4 Aug 27 03:56:35.693788 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-00aae98b-9a1c-4518-8169-7a35cd7cc476 req-be3f504b-030d-4380-a8f8-82c948446730 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043942 Aug 27 03:56:35.695158 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3536/7023] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:56:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:56:36.067182 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-7fc15d26-9a35-41c1-95e0-7603608fa6fd tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:36.067935 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-7fc15d26-9a35-41c1-95e0-7603608fa6fd tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: a7c2818c-4019-4f05-a716-503458fd712a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:36.075507 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7fc15d26-9a35-41c1-95e0-7603608fa6fd tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:36.076004 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7fc15d26-9a35-41c1-95e0-7603608fa6fd tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:36.076477 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7fc15d26-9a35-41c1-95e0-7603608fa6fd tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:36.077191 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7fc15d26-9a35-41c1-95e0-7603608fa6fd tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:36.077646 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7fc15d26-9a35-41c1-95e0-7603608fa6fd tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:36.078064 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7fc15d26-9a35-41c1-95e0-7603608fa6fd tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:36.241872 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-7fc15d26-9a35-41c1-95e0-7603608fa6fd tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:56:36.250769 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-7fc15d26-9a35-41c1-95e0-7603608fa6fd tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/a7c2818c-4019-4f05-a716-503458fd712a" status: 200 len: 1392 microversion: 2.1 time: 0.187581 Aug 27 03:56:36.251400 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3488/7024] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:36 2022] GET /compute/v2.1/servers/a7c2818c-4019-4f05-a716-503458fd712a => generated 1392 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:56:37.273442 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-24441881-39a6-416d-986e-8f97b71c14be tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:37.274258 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-24441881-39a6-416d-986e-8f97b71c14be tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: a7c2818c-4019-4f05-a716-503458fd712a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:37.282264 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-24441881-39a6-416d-986e-8f97b71c14be tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:37.282796 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-24441881-39a6-416d-986e-8f97b71c14be tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:37.283278 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-24441881-39a6-416d-986e-8f97b71c14be tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:37.284060 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-24441881-39a6-416d-986e-8f97b71c14be tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:37.284552 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-24441881-39a6-416d-986e-8f97b71c14be tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:37.285001 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-24441881-39a6-416d-986e-8f97b71c14be tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:37.497135 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-24441881-39a6-416d-986e-8f97b71c14be tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:56:37.505587 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-24441881-39a6-416d-986e-8f97b71c14be tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/a7c2818c-4019-4f05-a716-503458fd712a" status: 200 len: 1392 microversion: 2.1 time: 0.237890 Aug 27 03:56:37.506262 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3537/7025] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:37 2022] GET /compute/v2.1/servers/a7c2818c-4019-4f05-a716-503458fd712a => generated 1392 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:56:38.527111 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d8c3a732-39bd-4e60-802a-15d36b1785b5 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:38.527677 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d8c3a732-39bd-4e60-802a-15d36b1785b5 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: a7c2818c-4019-4f05-a716-503458fd712a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:38.535306 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d8c3a732-39bd-4e60-802a-15d36b1785b5 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:38.535792 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d8c3a732-39bd-4e60-802a-15d36b1785b5 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:38.536257 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d8c3a732-39bd-4e60-802a-15d36b1785b5 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:38.536977 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d8c3a732-39bd-4e60-802a-15d36b1785b5 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:38.537425 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d8c3a732-39bd-4e60-802a-15d36b1785b5 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:38.537848 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d8c3a732-39bd-4e60-802a-15d36b1785b5 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:38.696853 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-d8c3a732-39bd-4e60-802a-15d36b1785b5 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:56:38.705272 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d8c3a732-39bd-4e60-802a-15d36b1785b5 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/a7c2818c-4019-4f05-a716-503458fd712a" status: 200 len: 1392 microversion: 2.1 time: 0.182287 Aug 27 03:56:38.705881 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3489/7026] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:38 2022] GET /compute/v2.1/servers/a7c2818c-4019-4f05-a716-503458fd712a => generated 1392 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:56:39.726848 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e93aee91-cc36-4bcc-9251-184a5fae7791 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:39.727433 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-e93aee91-cc36-4bcc-9251-184a5fae7791 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: a7c2818c-4019-4f05-a716-503458fd712a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:39.730631 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:56:39.737015 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e93aee91-cc36-4bcc-9251-184a5fae7791 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:39.737525 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e93aee91-cc36-4bcc-9251-184a5fae7791 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:39.737996 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e93aee91-cc36-4bcc-9251-184a5fae7791 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:39.738736 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e93aee91-cc36-4bcc-9251-184a5fae7791 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:39.739380 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e93aee91-cc36-4bcc-9251-184a5fae7791 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:39.740021 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e93aee91-cc36-4bcc-9251-184a5fae7791 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:39.894309 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e93aee91-cc36-4bcc-9251-184a5fae7791 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:56:39.904229 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e93aee91-cc36-4bcc-9251-184a5fae7791 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/a7c2818c-4019-4f05-a716-503458fd712a" status: 200 len: 1392 microversion: 2.1 time: 0.182268 Aug 27 03:56:39.905629 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3538/7027] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:39 2022] GET /compute/v2.1/servers/a7c2818c-4019-4f05-a716-503458fd712a => generated 1392 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:56:40.926564 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-2ad211b3-319c-447e-aed0-cc761558174a tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:40.927331 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-2ad211b3-319c-447e-aed0-cc761558174a tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: a7c2818c-4019-4f05-a716-503458fd712a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:40.934806 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2ad211b3-319c-447e-aed0-cc761558174a tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:40.935457 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2ad211b3-319c-447e-aed0-cc761558174a tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:40.935894 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2ad211b3-319c-447e-aed0-cc761558174a tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:40.936671 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2ad211b3-319c-447e-aed0-cc761558174a tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:40.937305 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2ad211b3-319c-447e-aed0-cc761558174a tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:40.937981 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2ad211b3-319c-447e-aed0-cc761558174a tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:41.083115 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-2ad211b3-319c-447e-aed0-cc761558174a tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:56:41.092029 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-2ad211b3-319c-447e-aed0-cc761558174a tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/a7c2818c-4019-4f05-a716-503458fd712a" status: 200 len: 1392 microversion: 2.1 time: 0.169374 Aug 27 03:56:41.092665 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3490/7028] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:40 2022] GET /compute/v2.1/servers/a7c2818c-4019-4f05-a716-503458fd712a => generated 1392 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:56:41.379019 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-e888df22-b721-4ec1-8c73-98b27738bd2d req-9ece53f8-04e3-4e85-b6ce-aabb13d85325 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7c2818c-4019-4f05-a716-503458fd712a", "name": "network-vif-plugged", "status": "completed", "tag": "2ac9313d-274b-400e-aff5-e6b1ccb56784"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:56:41.391420 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-e888df22-b721-4ec1-8c73-98b27738bd2d req-9ece53f8-04e3-4e85-b6ce-aabb13d85325 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:41.392305 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-e888df22-b721-4ec1-8c73-98b27738bd2d req-9ece53f8-04e3-4e85-b6ce-aabb13d85325 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:41.392820 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-e888df22-b721-4ec1-8c73-98b27738bd2d req-9ece53f8-04e3-4e85-b6ce-aabb13d85325 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:41.407179 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-e888df22-b721-4ec1-8c73-98b27738bd2d req-9ece53f8-04e3-4e85-b6ce-aabb13d85325 service nova] Creating event network-vif-plugged:2ac9313d-274b-400e-aff5-e6b1ccb56784 for instance a7c2818c-4019-4f05-a716-503458fd712a on n-h1-852278-4 Aug 27 03:56:41.413044 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-e888df22-b721-4ec1-8c73-98b27738bd2d req-9ece53f8-04e3-4e85-b6ce-aabb13d85325 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037808 Aug 27 03:56:41.413668 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3539/7029] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:56:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:56:42.114080 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8f105187-4034-4258-a6fb-a86d24a4e0ae tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:42.114656 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-8f105187-4034-4258-a6fb-a86d24a4e0ae tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: a7c2818c-4019-4f05-a716-503458fd712a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:42.116858 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:56:42.123498 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8f105187-4034-4258-a6fb-a86d24a4e0ae tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:42.123988 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8f105187-4034-4258-a6fb-a86d24a4e0ae tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:42.124456 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8f105187-4034-4258-a6fb-a86d24a4e0ae tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:42.125169 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8f105187-4034-4258-a6fb-a86d24a4e0ae tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:42.125621 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8f105187-4034-4258-a6fb-a86d24a4e0ae tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:42.126045 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8f105187-4034-4258-a6fb-a86d24a4e0ae tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:42.276100 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-8f105187-4034-4258-a6fb-a86d24a4e0ae tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:56:42.284461 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-8f105187-4034-4258-a6fb-a86d24a4e0ae tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/a7c2818c-4019-4f05-a716-503458fd712a" status: 200 len: 1392 microversion: 2.1 time: 0.174678 Aug 27 03:56:42.285064 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3491/7030] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:42 2022] GET /compute/v2.1/servers/a7c2818c-4019-4f05-a716-503458fd712a => generated 1392 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:56:43.306832 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0e983d35-ed3d-4e6d-8c01-b5b088801324 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:43.307590 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-0e983d35-ed3d-4e6d-8c01-b5b088801324 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: a7c2818c-4019-4f05-a716-503458fd712a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:43.309693 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=6 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:56:43.316533 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0e983d35-ed3d-4e6d-8c01-b5b088801324 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:43.317044 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0e983d35-ed3d-4e6d-8c01-b5b088801324 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:43.317499 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0e983d35-ed3d-4e6d-8c01-b5b088801324 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:43.318232 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0e983d35-ed3d-4e6d-8c01-b5b088801324 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:43.318707 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0e983d35-ed3d-4e6d-8c01-b5b088801324 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:43.319152 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0e983d35-ed3d-4e6d-8c01-b5b088801324 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:43.462698 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-0e983d35-ed3d-4e6d-8c01-b5b088801324 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:56:43.472521 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-0e983d35-ed3d-4e6d-8c01-b5b088801324 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/a7c2818c-4019-4f05-a716-503458fd712a" status: 200 len: 1563 microversion: 2.1 time: 0.170044 Aug 27 03:56:43.473197 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3540/7031] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:43 2022] GET /compute/v2.1/servers/a7c2818c-4019-4f05-a716-503458fd712a => generated 1563 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:56:43.494163 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8d7863e6-d967-46d4-8603-e9165f9ffa69 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:43.494897 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-8d7863e6-d967-46d4-8603-e9165f9ffa69 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: a7c2818c-4019-4f05-a716-503458fd712a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:43.496859 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=8 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:56:43.503183 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8d7863e6-d967-46d4-8603-e9165f9ffa69 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:43.503664 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8d7863e6-d967-46d4-8603-e9165f9ffa69 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:43.504092 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8d7863e6-d967-46d4-8603-e9165f9ffa69 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:43.504817 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8d7863e6-d967-46d4-8603-e9165f9ffa69 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:43.505259 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8d7863e6-d967-46d4-8603-e9165f9ffa69 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:43.505678 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8d7863e6-d967-46d4-8603-e9165f9ffa69 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:43.650117 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-8d7863e6-d967-46d4-8603-e9165f9ffa69 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:56:43.658843 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-8d7863e6-d967-46d4-8603-e9165f9ffa69 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/a7c2818c-4019-4f05-a716-503458fd712a" status: 200 len: 1563 microversion: 2.1 time: 0.168523 Aug 27 03:56:43.659384 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3492/7032] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:43 2022] GET /compute/v2.1/servers/a7c2818c-4019-4f05-a716-503458fd712a => generated 1563 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:56:45.351202 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-5eafb522-e062-43e5-9d5e-1101e7627316 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:45.351783 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-5eafb522-e062-43e5-9d5e-1101e7627316 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: a7c2818c-4019-4f05-a716-503458fd712a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:45.359626 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5eafb522-e062-43e5-9d5e-1101e7627316 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:45.360698 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5eafb522-e062-43e5-9d5e-1101e7627316 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:45.360698 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5eafb522-e062-43e5-9d5e-1101e7627316 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:45.361330 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5eafb522-e062-43e5-9d5e-1101e7627316 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:45.361806 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5eafb522-e062-43e5-9d5e-1101e7627316 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:45.362254 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5eafb522-e062-43e5-9d5e-1101e7627316 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:45.426391 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-040dc70e-58dc-46ef-831a-e6d338640b52 req-7533d3cf-6cbe-495a-8786-60a84b5cc261 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7c2818c-4019-4f05-a716-503458fd712a", "tag": "2ac9313d-274b-400e-aff5-e6b1ccb56784"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:56:45.437779 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-040dc70e-58dc-46ef-831a-e6d338640b52 req-7533d3cf-6cbe-495a-8786-60a84b5cc261 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:45.438397 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-040dc70e-58dc-46ef-831a-e6d338640b52 req-7533d3cf-6cbe-495a-8786-60a84b5cc261 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:45.439106 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-040dc70e-58dc-46ef-831a-e6d338640b52 req-7533d3cf-6cbe-495a-8786-60a84b5cc261 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:45.451498 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-040dc70e-58dc-46ef-831a-e6d338640b52 req-7533d3cf-6cbe-495a-8786-60a84b5cc261 service nova] Creating event network-changed:2ac9313d-274b-400e-aff5-e6b1ccb56784 for instance a7c2818c-4019-4f05-a716-503458fd712a on n-h1-852278-4 Aug 27 03:56:45.457326 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-040dc70e-58dc-46ef-831a-e6d338640b52 req-7533d3cf-6cbe-495a-8786-60a84b5cc261 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108532 Aug 27 03:56:45.458548 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3493/7033] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:56:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:56:45.556761 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-5eafb522-e062-43e5-9d5e-1101e7627316 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:56:45.566438 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-5eafb522-e062-43e5-9d5e-1101e7627316 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/a7c2818c-4019-4f05-a716-503458fd712a" status: 200 len: 1563 microversion: 2.1 time: 0.219050 Aug 27 03:56:45.567061 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3541/7034] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:45 2022] GET /compute/v2.1/servers/a7c2818c-4019-4f05-a716-503458fd712a => generated 1563 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:57:06.835277 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:57:06.836094 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=40 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:57:06.840582 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5c506afe-9f72-43ea-8461-3220c7af350b tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:57:06.842916 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-5c506afe-9f72-43ea-8461-3220c7af350b tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: a7c2818c-4019-4f05-a716-503458fd712a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:57:06.850658 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5c506afe-9f72-43ea-8461-3220c7af350b tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:06.851136 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5c506afe-9f72-43ea-8461-3220c7af350b tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:06.851689 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5c506afe-9f72-43ea-8461-3220c7af350b tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:06.852517 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5c506afe-9f72-43ea-8461-3220c7af350b tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:06.852929 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5c506afe-9f72-43ea-8461-3220c7af350b tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:06.853346 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5c506afe-9f72-43ea-8461-3220c7af350b tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:06.925772 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-5c506afe-9f72-43ea-8461-3220c7af350b tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "POST /compute/v2.1/servers/a7c2818c-4019-4f05-a716-503458fd712a/action" status: 200 len: 24572 microversion: 2.1 time: 0.092206 Aug 27 03:57:06.926464 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3494/7035] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:57:06 2022] POST /compute/v2.1/servers/a7c2818c-4019-4f05-a716-503458fd712a/action => generated 24572 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:57:17.992568 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b1e6e898-dacb-4c70-aa44-120bf900929e tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:57:17.994901 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b1e6e898-dacb-4c70-aa44-120bf900929e tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: a7c2818c-4019-4f05-a716-503458fd712a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:57:17.997056 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=7 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:57:17.997745 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=34 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:57:18.006307 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b1e6e898-dacb-4c70-aa44-120bf900929e tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:18.007010 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b1e6e898-dacb-4c70-aa44-120bf900929e tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:18.007710 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b1e6e898-dacb-4c70-aa44-120bf900929e tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:18.008679 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b1e6e898-dacb-4c70-aa44-120bf900929e tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:18.009147 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b1e6e898-dacb-4c70-aa44-120bf900929e tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:18.009585 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b1e6e898-dacb-4c70-aa44-120bf900929e tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:18.111359 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-b1e6e898-dacb-4c70-aa44-120bf900929e tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:57:18.118688 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b1e6e898-dacb-4c70-aa44-120bf900929e tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: a7c2818c-4019-4f05-a716-503458fd712a] Old instance type m1.heat2, new instance type m1.heat {{(pid=134051) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 27 03:57:18.126477 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-b1e6e898-dacb-4c70-aa44-120bf900929e tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Flavor limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:57:18.126943 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-b1e6e898-dacb-4c70-aa44-120bf900929e tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Image limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:57:18.127432 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-b1e6e898-dacb-4c70-aa44-120bf900929e tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Flavor pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:57:18.127843 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-b1e6e898-dacb-4c70-aa44-120bf900929e tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Image pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:57:18.128274 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-b1e6e898-dacb-4c70-aa44-120bf900929e tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:57:18.200176 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b1e6e898-dacb-4c70-aa44-120bf900929e tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "POST /compute/v2.1/servers/a7c2818c-4019-4f05-a716-503458fd712a/action" status: 202 len: 0 microversion: 2.1 time: 0.212476 Aug 27 03:57:18.200771 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3542/7036] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:57:17 2022] POST /compute/v2.1/servers/a7c2818c-4019-4f05-a716-503458fd712a/action => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:57:18.210306 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-7fd54df5-75ee-4691-aed4-1d24950f26ac tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:57:18.211147 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-7fd54df5-75ee-4691-aed4-1d24950f26ac tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: a7c2818c-4019-4f05-a716-503458fd712a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:57:18.214240 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=4 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:57:18.214956 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:57:18.222470 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7fd54df5-75ee-4691-aed4-1d24950f26ac tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:18.223124 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7fd54df5-75ee-4691-aed4-1d24950f26ac tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:18.223566 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7fd54df5-75ee-4691-aed4-1d24950f26ac tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:18.224581 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7fd54df5-75ee-4691-aed4-1d24950f26ac tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:18.225281 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7fd54df5-75ee-4691-aed4-1d24950f26ac tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:18.225764 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7fd54df5-75ee-4691-aed4-1d24950f26ac tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:18.388464 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-7fd54df5-75ee-4691-aed4-1d24950f26ac tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:57:18.397104 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-7fd54df5-75ee-4691-aed4-1d24950f26ac tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/a7c2818c-4019-4f05-a716-503458fd712a" status: 200 len: 1691 microversion: 2.1 time: 0.191276 Aug 27 03:57:18.397798 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3495/7037] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:57:18 2022] GET /compute/v2.1/servers/a7c2818c-4019-4f05-a716-503458fd712a => generated 1691 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:57:19.424203 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b9177a29-3472-4d5c-98b6-eedc89fc8b5b tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:57:19.425029 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b9177a29-3472-4d5c-98b6-eedc89fc8b5b tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: a7c2818c-4019-4f05-a716-503458fd712a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:57:19.431512 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b9177a29-3472-4d5c-98b6-eedc89fc8b5b tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:19.431992 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b9177a29-3472-4d5c-98b6-eedc89fc8b5b tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:19.432472 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b9177a29-3472-4d5c-98b6-eedc89fc8b5b tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:19.433204 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b9177a29-3472-4d5c-98b6-eedc89fc8b5b tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:19.433775 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b9177a29-3472-4d5c-98b6-eedc89fc8b5b tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:19.434247 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b9177a29-3472-4d5c-98b6-eedc89fc8b5b tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:19.589383 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-b9177a29-3472-4d5c-98b6-eedc89fc8b5b tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:57:19.598605 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b9177a29-3472-4d5c-98b6-eedc89fc8b5b tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/a7c2818c-4019-4f05-a716-503458fd712a" status: 200 len: 1691 microversion: 2.1 time: 0.180284 Aug 27 03:57:19.599134 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3543/7038] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:57:19 2022] GET /compute/v2.1/servers/a7c2818c-4019-4f05-a716-503458fd712a => generated 1691 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:57:20.620218 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-478df2f4-7320-4755-aba9-62efe25ab717 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:57:20.620842 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-478df2f4-7320-4755-aba9-62efe25ab717 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: a7c2818c-4019-4f05-a716-503458fd712a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:57:20.628538 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-478df2f4-7320-4755-aba9-62efe25ab717 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:20.629023 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-478df2f4-7320-4755-aba9-62efe25ab717 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:20.629456 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-478df2f4-7320-4755-aba9-62efe25ab717 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:20.630157 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-478df2f4-7320-4755-aba9-62efe25ab717 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:20.630601 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-478df2f4-7320-4755-aba9-62efe25ab717 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:20.631020 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-478df2f4-7320-4755-aba9-62efe25ab717 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:20.785573 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-478df2f4-7320-4755-aba9-62efe25ab717 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:57:20.794022 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-478df2f4-7320-4755-aba9-62efe25ab717 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/a7c2818c-4019-4f05-a716-503458fd712a" status: 200 len: 1696 microversion: 2.1 time: 0.178005 Aug 27 03:57:20.794616 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3496/7039] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:57:20 2022] GET /compute/v2.1/servers/a7c2818c-4019-4f05-a716-503458fd712a => generated 1696 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:57:21.816191 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c46d54b9-0f8f-44f6-84d1-d1aa84e977aa tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:57:21.816851 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-c46d54b9-0f8f-44f6-84d1-d1aa84e977aa tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: a7c2818c-4019-4f05-a716-503458fd712a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:57:21.824332 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c46d54b9-0f8f-44f6-84d1-d1aa84e977aa tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:21.825230 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c46d54b9-0f8f-44f6-84d1-d1aa84e977aa tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:21.830415 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c46d54b9-0f8f-44f6-84d1-d1aa84e977aa tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:21.831277 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c46d54b9-0f8f-44f6-84d1-d1aa84e977aa tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:21.831919 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c46d54b9-0f8f-44f6-84d1-d1aa84e977aa tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:21.832387 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c46d54b9-0f8f-44f6-84d1-d1aa84e977aa tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:21.982514 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-c46d54b9-0f8f-44f6-84d1-d1aa84e977aa tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:57:21.990836 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c46d54b9-0f8f-44f6-84d1-d1aa84e977aa tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/a7c2818c-4019-4f05-a716-503458fd712a" status: 200 len: 1696 microversion: 2.1 time: 0.178623 Aug 27 03:57:21.991445 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3544/7040] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:57:21 2022] GET /compute/v2.1/servers/a7c2818c-4019-4f05-a716-503458fd712a => generated 1696 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:57:23.014251 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-bfd2d3da-3572-4249-82f4-6cbdeeeb4d84 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:57:23.014899 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-bfd2d3da-3572-4249-82f4-6cbdeeeb4d84 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: a7c2818c-4019-4f05-a716-503458fd712a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:57:23.022895 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bfd2d3da-3572-4249-82f4-6cbdeeeb4d84 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:23.023398 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bfd2d3da-3572-4249-82f4-6cbdeeeb4d84 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:23.023872 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bfd2d3da-3572-4249-82f4-6cbdeeeb4d84 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:23.024615 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bfd2d3da-3572-4249-82f4-6cbdeeeb4d84 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:23.025077 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bfd2d3da-3572-4249-82f4-6cbdeeeb4d84 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:23.025813 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bfd2d3da-3572-4249-82f4-6cbdeeeb4d84 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:23.176574 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-bfd2d3da-3572-4249-82f4-6cbdeeeb4d84 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:57:23.185161 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-bfd2d3da-3572-4249-82f4-6cbdeeeb4d84 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/a7c2818c-4019-4f05-a716-503458fd712a" status: 200 len: 1696 microversion: 2.1 time: 0.174880 Aug 27 03:57:23.185756 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3497/7041] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:57:23 2022] GET /compute/v2.1/servers/a7c2818c-4019-4f05-a716-503458fd712a => generated 1696 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:57:24.207212 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3fd0ab30-5abc-4432-a103-553eabef7bcc tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:57:24.207797 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-3fd0ab30-5abc-4432-a103-553eabef7bcc tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: a7c2818c-4019-4f05-a716-503458fd712a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:57:24.215355 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3fd0ab30-5abc-4432-a103-553eabef7bcc tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:24.215869 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3fd0ab30-5abc-4432-a103-553eabef7bcc tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:24.216338 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3fd0ab30-5abc-4432-a103-553eabef7bcc tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:24.217178 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3fd0ab30-5abc-4432-a103-553eabef7bcc tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:24.217515 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3fd0ab30-5abc-4432-a103-553eabef7bcc tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:24.217958 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3fd0ab30-5abc-4432-a103-553eabef7bcc tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:24.365804 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-3fd0ab30-5abc-4432-a103-553eabef7bcc tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:57:24.374939 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-3fd0ab30-5abc-4432-a103-553eabef7bcc tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/a7c2818c-4019-4f05-a716-503458fd712a" status: 200 len: 1696 microversion: 2.1 time: 0.171859 Aug 27 03:57:24.375539 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3545/7042] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:57:24 2022] GET /compute/v2.1/servers/a7c2818c-4019-4f05-a716-503458fd712a => generated 1696 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:57:25.396980 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-cada9f85-8c6c-4514-8d6e-eac03017df75 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:57:25.397571 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-cada9f85-8c6c-4514-8d6e-eac03017df75 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: a7c2818c-4019-4f05-a716-503458fd712a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:57:25.406978 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cada9f85-8c6c-4514-8d6e-eac03017df75 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:25.407499 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cada9f85-8c6c-4514-8d6e-eac03017df75 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:25.408005 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cada9f85-8c6c-4514-8d6e-eac03017df75 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:25.408876 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cada9f85-8c6c-4514-8d6e-eac03017df75 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:25.409337 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cada9f85-8c6c-4514-8d6e-eac03017df75 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:25.409772 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cada9f85-8c6c-4514-8d6e-eac03017df75 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:25.557168 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-cada9f85-8c6c-4514-8d6e-eac03017df75 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:57:25.570695 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-cada9f85-8c6c-4514-8d6e-eac03017df75 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/a7c2818c-4019-4f05-a716-503458fd712a" status: 200 len: 1696 microversion: 2.1 time: 0.177441 Aug 27 03:57:25.571511 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3498/7043] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:57:25 2022] GET /compute/v2.1/servers/a7c2818c-4019-4f05-a716-503458fd712a => generated 1696 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:57:26.593088 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-2ceccc42-21e6-4634-9dea-1d0c56e35ac9 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:57:26.593694 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-2ceccc42-21e6-4634-9dea-1d0c56e35ac9 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: a7c2818c-4019-4f05-a716-503458fd712a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:57:26.601016 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2ceccc42-21e6-4634-9dea-1d0c56e35ac9 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:26.602582 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2ceccc42-21e6-4634-9dea-1d0c56e35ac9 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:26.603121 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2ceccc42-21e6-4634-9dea-1d0c56e35ac9 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:26.603866 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2ceccc42-21e6-4634-9dea-1d0c56e35ac9 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:26.604692 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2ceccc42-21e6-4634-9dea-1d0c56e35ac9 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:26.605136 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2ceccc42-21e6-4634-9dea-1d0c56e35ac9 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:26.752749 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-2ceccc42-21e6-4634-9dea-1d0c56e35ac9 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:57:26.761678 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-2ceccc42-21e6-4634-9dea-1d0c56e35ac9 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/a7c2818c-4019-4f05-a716-503458fd712a" status: 200 len: 1696 microversion: 2.1 time: 0.172896 Aug 27 03:57:26.762576 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3546/7044] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:57:26 2022] GET /compute/v2.1/servers/a7c2818c-4019-4f05-a716-503458fd712a => generated 1696 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:57:27.785446 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-dc4e8256-3e60-4508-a3e1-4dddbd7ed3e8 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:57:27.786089 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-dc4e8256-3e60-4508-a3e1-4dddbd7ed3e8 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: a7c2818c-4019-4f05-a716-503458fd712a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:57:27.793661 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dc4e8256-3e60-4508-a3e1-4dddbd7ed3e8 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:27.794160 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dc4e8256-3e60-4508-a3e1-4dddbd7ed3e8 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:27.794605 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dc4e8256-3e60-4508-a3e1-4dddbd7ed3e8 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:27.795538 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dc4e8256-3e60-4508-a3e1-4dddbd7ed3e8 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:27.796226 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dc4e8256-3e60-4508-a3e1-4dddbd7ed3e8 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:27.796727 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dc4e8256-3e60-4508-a3e1-4dddbd7ed3e8 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:27.948148 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-dc4e8256-3e60-4508-a3e1-4dddbd7ed3e8 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:57:27.956978 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-dc4e8256-3e60-4508-a3e1-4dddbd7ed3e8 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/a7c2818c-4019-4f05-a716-503458fd712a" status: 200 len: 1696 microversion: 2.1 time: 0.175565 Aug 27 03:57:27.957603 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3499/7045] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:57:27 2022] GET /compute/v2.1/servers/a7c2818c-4019-4f05-a716-503458fd712a => generated 1696 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:57:28.979154 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-46f2ad1b-2f59-4e80-a471-71277c21c450 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:57:28.979766 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-46f2ad1b-2f59-4e80-a471-71277c21c450 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: a7c2818c-4019-4f05-a716-503458fd712a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:57:28.988596 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-46f2ad1b-2f59-4e80-a471-71277c21c450 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:28.989114 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-46f2ad1b-2f59-4e80-a471-71277c21c450 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:28.989572 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-46f2ad1b-2f59-4e80-a471-71277c21c450 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:28.990309 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-46f2ad1b-2f59-4e80-a471-71277c21c450 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:28.990783 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-46f2ad1b-2f59-4e80-a471-71277c21c450 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:28.991229 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-46f2ad1b-2f59-4e80-a471-71277c21c450 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:29.131012 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-46f2ad1b-2f59-4e80-a471-71277c21c450 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:57:29.139412 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-46f2ad1b-2f59-4e80-a471-71277c21c450 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/a7c2818c-4019-4f05-a716-503458fd712a" status: 200 len: 1696 microversion: 2.1 time: 0.164279 Aug 27 03:57:29.140018 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3547/7046] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:57:28 2022] GET /compute/v2.1/servers/a7c2818c-4019-4f05-a716-503458fd712a => generated 1696 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:57:30.164133 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9e9fa4e9-31b3-44ef-9f2c-1fa64f86132e tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:57:30.164786 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-9e9fa4e9-31b3-44ef-9f2c-1fa64f86132e tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: a7c2818c-4019-4f05-a716-503458fd712a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:57:30.173564 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9e9fa4e9-31b3-44ef-9f2c-1fa64f86132e tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:30.174109 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9e9fa4e9-31b3-44ef-9f2c-1fa64f86132e tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:30.174809 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9e9fa4e9-31b3-44ef-9f2c-1fa64f86132e tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:30.176004 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9e9fa4e9-31b3-44ef-9f2c-1fa64f86132e tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:30.176730 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9e9fa4e9-31b3-44ef-9f2c-1fa64f86132e tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:30.177160 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9e9fa4e9-31b3-44ef-9f2c-1fa64f86132e tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:30.322797 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-9e9fa4e9-31b3-44ef-9f2c-1fa64f86132e tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:57:30.331331 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9e9fa4e9-31b3-44ef-9f2c-1fa64f86132e tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/a7c2818c-4019-4f05-a716-503458fd712a" status: 200 len: 1696 microversion: 2.1 time: 0.173039 Aug 27 03:57:30.331930 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3500/7047] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:57:30 2022] GET /compute/v2.1/servers/a7c2818c-4019-4f05-a716-503458fd712a => generated 1696 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:57:31.353442 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a9f6e77a-0164-45bb-b6f3-928b0672f48c tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:57:31.354078 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-a9f6e77a-0164-45bb-b6f3-928b0672f48c tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: a7c2818c-4019-4f05-a716-503458fd712a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:57:31.361614 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a9f6e77a-0164-45bb-b6f3-928b0672f48c tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:31.362119 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a9f6e77a-0164-45bb-b6f3-928b0672f48c tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:31.362569 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a9f6e77a-0164-45bb-b6f3-928b0672f48c tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:31.363293 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a9f6e77a-0164-45bb-b6f3-928b0672f48c tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:31.363752 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a9f6e77a-0164-45bb-b6f3-928b0672f48c tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:31.364187 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a9f6e77a-0164-45bb-b6f3-928b0672f48c tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:31.505248 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-a9f6e77a-0164-45bb-b6f3-928b0672f48c tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:57:31.513735 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a9f6e77a-0164-45bb-b6f3-928b0672f48c tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/a7c2818c-4019-4f05-a716-503458fd712a" status: 200 len: 1696 microversion: 2.1 time: 0.164232 Aug 27 03:57:31.514338 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3548/7048] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:57:31 2022] GET /compute/v2.1/servers/a7c2818c-4019-4f05-a716-503458fd712a => generated 1696 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:57:32.535853 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-25af7672-7c94-44f0-9c05-aa1ad0e3b882 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:57:32.536462 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-25af7672-7c94-44f0-9c05-aa1ad0e3b882 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: a7c2818c-4019-4f05-a716-503458fd712a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:57:32.543869 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-25af7672-7c94-44f0-9c05-aa1ad0e3b882 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:32.544373 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-25af7672-7c94-44f0-9c05-aa1ad0e3b882 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:32.544839 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-25af7672-7c94-44f0-9c05-aa1ad0e3b882 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:32.545558 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-25af7672-7c94-44f0-9c05-aa1ad0e3b882 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:32.546359 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-25af7672-7c94-44f0-9c05-aa1ad0e3b882 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:32.546788 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-25af7672-7c94-44f0-9c05-aa1ad0e3b882 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:32.687348 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-25af7672-7c94-44f0-9c05-aa1ad0e3b882 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:57:32.697052 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-25af7672-7c94-44f0-9c05-aa1ad0e3b882 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/a7c2818c-4019-4f05-a716-503458fd712a" status: 200 len: 1696 microversion: 2.1 time: 0.165368 Aug 27 03:57:32.697663 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3501/7049] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:57:32 2022] GET /compute/v2.1/servers/a7c2818c-4019-4f05-a716-503458fd712a => generated 1696 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:57:33.718822 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-6082fcdc-7800-4e15-9dbc-fd3aa2304c1d tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:57:33.719477 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-6082fcdc-7800-4e15-9dbc-fd3aa2304c1d tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: a7c2818c-4019-4f05-a716-503458fd712a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:57:33.728247 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6082fcdc-7800-4e15-9dbc-fd3aa2304c1d tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:33.728822 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6082fcdc-7800-4e15-9dbc-fd3aa2304c1d tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:33.729276 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6082fcdc-7800-4e15-9dbc-fd3aa2304c1d tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:33.730355 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6082fcdc-7800-4e15-9dbc-fd3aa2304c1d tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:33.731060 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6082fcdc-7800-4e15-9dbc-fd3aa2304c1d tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:33.731701 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6082fcdc-7800-4e15-9dbc-fd3aa2304c1d tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:33.880766 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-6082fcdc-7800-4e15-9dbc-fd3aa2304c1d tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:57:33.890257 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-6082fcdc-7800-4e15-9dbc-fd3aa2304c1d tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/a7c2818c-4019-4f05-a716-503458fd712a" status: 200 len: 1696 microversion: 2.1 time: 0.175539 Aug 27 03:57:33.890825 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3549/7050] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:57:33 2022] GET /compute/v2.1/servers/a7c2818c-4019-4f05-a716-503458fd712a => generated 1696 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:57:34.912654 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-41ea5bd6-aaee-4fd3-ba5d-ab08f4708878 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:57:34.913313 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-41ea5bd6-aaee-4fd3-ba5d-ab08f4708878 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: a7c2818c-4019-4f05-a716-503458fd712a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:57:34.921260 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-41ea5bd6-aaee-4fd3-ba5d-ab08f4708878 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:34.921793 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-41ea5bd6-aaee-4fd3-ba5d-ab08f4708878 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:34.922227 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-41ea5bd6-aaee-4fd3-ba5d-ab08f4708878 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:34.922935 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-41ea5bd6-aaee-4fd3-ba5d-ab08f4708878 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:34.923381 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-41ea5bd6-aaee-4fd3-ba5d-ab08f4708878 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:34.923794 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-41ea5bd6-aaee-4fd3-ba5d-ab08f4708878 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:35.074433 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-41ea5bd6-aaee-4fd3-ba5d-ab08f4708878 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:57:35.084171 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-41ea5bd6-aaee-4fd3-ba5d-ab08f4708878 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/a7c2818c-4019-4f05-a716-503458fd712a" status: 200 len: 1696 microversion: 2.1 time: 0.175555 Aug 27 03:57:35.084799 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3502/7051] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:57:34 2022] GET /compute/v2.1/servers/a7c2818c-4019-4f05-a716-503458fd712a => generated 1696 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:57:36.105801 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-bf463ff4-65c1-4b94-95e2-a028ef878988 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:57:36.106414 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-bf463ff4-65c1-4b94-95e2-a028ef878988 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: a7c2818c-4019-4f05-a716-503458fd712a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:57:36.114211 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bf463ff4-65c1-4b94-95e2-a028ef878988 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:36.114728 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bf463ff4-65c1-4b94-95e2-a028ef878988 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:36.115184 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bf463ff4-65c1-4b94-95e2-a028ef878988 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:36.115930 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bf463ff4-65c1-4b94-95e2-a028ef878988 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:36.116436 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bf463ff4-65c1-4b94-95e2-a028ef878988 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:36.116884 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bf463ff4-65c1-4b94-95e2-a028ef878988 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:36.265860 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-bf463ff4-65c1-4b94-95e2-a028ef878988 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:57:36.274280 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-bf463ff4-65c1-4b94-95e2-a028ef878988 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/a7c2818c-4019-4f05-a716-503458fd712a" status: 200 len: 1696 microversion: 2.1 time: 0.172430 Aug 27 03:57:36.274901 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3550/7052] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:57:36 2022] GET /compute/v2.1/servers/a7c2818c-4019-4f05-a716-503458fd712a => generated 1696 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:57:37.300131 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-bf7dcd1b-2010-408e-aa32-6e26d50c0484 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:57:37.300933 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-bf7dcd1b-2010-408e-aa32-6e26d50c0484 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: a7c2818c-4019-4f05-a716-503458fd712a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:57:37.310897 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bf7dcd1b-2010-408e-aa32-6e26d50c0484 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:37.311492 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bf7dcd1b-2010-408e-aa32-6e26d50c0484 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:37.312154 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bf7dcd1b-2010-408e-aa32-6e26d50c0484 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:37.313340 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bf7dcd1b-2010-408e-aa32-6e26d50c0484 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:37.314065 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bf7dcd1b-2010-408e-aa32-6e26d50c0484 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:37.314750 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bf7dcd1b-2010-408e-aa32-6e26d50c0484 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:37.480750 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-bf7dcd1b-2010-408e-aa32-6e26d50c0484 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:57:37.489452 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-bf7dcd1b-2010-408e-aa32-6e26d50c0484 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/a7c2818c-4019-4f05-a716-503458fd712a" status: 200 len: 1696 microversion: 2.1 time: 0.193805 Aug 27 03:57:37.490259 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3503/7053] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:57:37 2022] GET /compute/v2.1/servers/a7c2818c-4019-4f05-a716-503458fd712a => generated 1696 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:57:38.111194 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-3d00cb26-3c2d-440a-99bc-dd70a08e0331 req-0d03e67c-183d-410f-8717-3b937646e03d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7c2818c-4019-4f05-a716-503458fd712a", "name": "network-vif-unplugged", "status": "completed", "tag": "2ac9313d-274b-400e-aff5-e6b1ccb56784"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:57:38.122300 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-3d00cb26-3c2d-440a-99bc-dd70a08e0331 req-0d03e67c-183d-410f-8717-3b937646e03d service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:38.122984 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-3d00cb26-3c2d-440a-99bc-dd70a08e0331 req-0d03e67c-183d-410f-8717-3b937646e03d service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:38.123618 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-3d00cb26-3c2d-440a-99bc-dd70a08e0331 req-0d03e67c-183d-410f-8717-3b937646e03d service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:38.137616 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-3d00cb26-3c2d-440a-99bc-dd70a08e0331 req-0d03e67c-183d-410f-8717-3b937646e03d service nova] Creating event network-vif-unplugged:2ac9313d-274b-400e-aff5-e6b1ccb56784 for instance a7c2818c-4019-4f05-a716-503458fd712a on n-h2-852278-4 Aug 27 03:57:38.144030 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [req-3d00cb26-3c2d-440a-99bc-dd70a08e0331 req-0d03e67c-183d-410f-8717-3b937646e03d service nova] Instance a7c2818c-4019-4f05-a716-503458fd712a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-852278-4', 'n-h1-852278-4'} {{(pid=134051) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 03:57:38.155818 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-3d00cb26-3c2d-440a-99bc-dd70a08e0331 req-0d03e67c-183d-410f-8717-3b937646e03d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048342 Aug 27 03:57:38.156704 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3551/7054] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:57:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:57:38.516698 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b119b843-ffbd-47e1-b754-062c26bdeb24 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:57:38.517358 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b119b843-ffbd-47e1-b754-062c26bdeb24 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: a7c2818c-4019-4f05-a716-503458fd712a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:57:38.526820 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b119b843-ffbd-47e1-b754-062c26bdeb24 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:38.527321 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b119b843-ffbd-47e1-b754-062c26bdeb24 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:38.527732 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b119b843-ffbd-47e1-b754-062c26bdeb24 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:38.528479 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b119b843-ffbd-47e1-b754-062c26bdeb24 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:38.528931 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b119b843-ffbd-47e1-b754-062c26bdeb24 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:38.529356 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b119b843-ffbd-47e1-b754-062c26bdeb24 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:39.074911 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b119b843-ffbd-47e1-b754-062c26bdeb24 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:57:39.093711 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b119b843-ffbd-47e1-b754-062c26bdeb24 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/a7c2818c-4019-4f05-a716-503458fd712a" status: 200 len: 1695 microversion: 2.1 time: 0.582293 Aug 27 03:57:39.094351 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3504/7055] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:57:38 2022] GET /compute/v2.1/servers/a7c2818c-4019-4f05-a716-503458fd712a => generated 1695 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:57:40.118561 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-104bcdd4-af41-4db5-9629-1eb45a6ccd50 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:57:40.119400 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-104bcdd4-af41-4db5-9629-1eb45a6ccd50 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: a7c2818c-4019-4f05-a716-503458fd712a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:57:40.126639 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-104bcdd4-af41-4db5-9629-1eb45a6ccd50 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:40.127095 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-104bcdd4-af41-4db5-9629-1eb45a6ccd50 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:40.127554 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-104bcdd4-af41-4db5-9629-1eb45a6ccd50 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:40.128299 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-104bcdd4-af41-4db5-9629-1eb45a6ccd50 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:40.128928 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-104bcdd4-af41-4db5-9629-1eb45a6ccd50 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:40.129467 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-104bcdd4-af41-4db5-9629-1eb45a6ccd50 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:40.206739 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-f1560c73-3c38-4728-97b1-f64681c8cb89 req-53f673c6-7de5-4c3f-80ce-1c72668098bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7c2818c-4019-4f05-a716-503458fd712a", "tag": "2ac9313d-274b-400e-aff5-e6b1ccb56784"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:57:40.218119 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-f1560c73-3c38-4728-97b1-f64681c8cb89 req-53f673c6-7de5-4c3f-80ce-1c72668098bb service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:40.218605 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-f1560c73-3c38-4728-97b1-f64681c8cb89 req-53f673c6-7de5-4c3f-80ce-1c72668098bb service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:40.219040 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-f1560c73-3c38-4728-97b1-f64681c8cb89 req-53f673c6-7de5-4c3f-80ce-1c72668098bb service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:40.235792 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-f1560c73-3c38-4728-97b1-f64681c8cb89 req-53f673c6-7de5-4c3f-80ce-1c72668098bb service nova] Creating event network-changed:2ac9313d-274b-400e-aff5-e6b1ccb56784 for instance a7c2818c-4019-4f05-a716-503458fd712a on n-h2-852278-4 Aug 27 03:57:40.242374 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [req-f1560c73-3c38-4728-97b1-f64681c8cb89 req-53f673c6-7de5-4c3f-80ce-1c72668098bb service nova] Instance a7c2818c-4019-4f05-a716-503458fd712a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-852278-4', 'n-h1-852278-4'} {{(pid=134052) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 03:57:40.255701 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-f1560c73-3c38-4728-97b1-f64681c8cb89 req-53f673c6-7de5-4c3f-80ce-1c72668098bb service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052662 Aug 27 03:57:40.256775 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3505/7056] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:57:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:57:40.300967 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-104bcdd4-af41-4db5-9629-1eb45a6ccd50 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:57:40.311183 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-104bcdd4-af41-4db5-9629-1eb45a6ccd50 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/a7c2818c-4019-4f05-a716-503458fd712a" status: 200 len: 1693 microversion: 2.1 time: 0.197945 Aug 27 03:57:40.312127 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3552/7057] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:57:40 2022] GET /compute/v2.1/servers/a7c2818c-4019-4f05-a716-503458fd712a => generated 1693 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:57:41.333761 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3b7a6be3-83ed-4eef-bb49-682721c38f63 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:57:41.334469 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-3b7a6be3-83ed-4eef-bb49-682721c38f63 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: a7c2818c-4019-4f05-a716-503458fd712a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:57:41.342049 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3b7a6be3-83ed-4eef-bb49-682721c38f63 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:41.342552 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3b7a6be3-83ed-4eef-bb49-682721c38f63 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:41.342996 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3b7a6be3-83ed-4eef-bb49-682721c38f63 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:41.343719 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3b7a6be3-83ed-4eef-bb49-682721c38f63 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:41.344143 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3b7a6be3-83ed-4eef-bb49-682721c38f63 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:41.344641 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3b7a6be3-83ed-4eef-bb49-682721c38f63 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:41.565582 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-3b7a6be3-83ed-4eef-bb49-682721c38f63 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:57:41.574427 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-3b7a6be3-83ed-4eef-bb49-682721c38f63 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/a7c2818c-4019-4f05-a716-503458fd712a" status: 200 len: 1690 microversion: 2.1 time: 0.244944 Aug 27 03:57:41.575029 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3506/7058] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:57:41 2022] GET /compute/v2.1/servers/a7c2818c-4019-4f05-a716-503458fd712a => generated 1690 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:57:41.596563 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-bd79f05f-c9d1-441d-894a-dee2fbab9e4b tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:57:41.597139 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-bd79f05f-c9d1-441d-894a-dee2fbab9e4b tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: a7c2818c-4019-4f05-a716-503458fd712a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:57:41.604348 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bd79f05f-c9d1-441d-894a-dee2fbab9e4b tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:41.604878 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bd79f05f-c9d1-441d-894a-dee2fbab9e4b tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:41.605335 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bd79f05f-c9d1-441d-894a-dee2fbab9e4b tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:41.606061 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bd79f05f-c9d1-441d-894a-dee2fbab9e4b tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:41.606728 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bd79f05f-c9d1-441d-894a-dee2fbab9e4b tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:41.607163 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bd79f05f-c9d1-441d-894a-dee2fbab9e4b tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:41.673676 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-bd79f05f-c9d1-441d-894a-dee2fbab9e4b tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "POST /compute/v2.1/servers/a7c2818c-4019-4f05-a716-503458fd712a/action" status: 204 len: 0 microversion: 2.1 time: 0.080988 Aug 27 03:57:41.674741 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3553/7059] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:57:41 2022] POST /compute/v2.1/servers/a7c2818c-4019-4f05-a716-503458fd712a/action => generated 0 bytes in 83 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:57:41.683468 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a2c656c9-850f-484b-986a-ae23b72aa9a3 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:57:41.684088 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a2c656c9-850f-484b-986a-ae23b72aa9a3 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: a7c2818c-4019-4f05-a716-503458fd712a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:57:41.691086 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a2c656c9-850f-484b-986a-ae23b72aa9a3 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:41.691702 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a2c656c9-850f-484b-986a-ae23b72aa9a3 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:41.692468 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a2c656c9-850f-484b-986a-ae23b72aa9a3 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:41.693662 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a2c656c9-850f-484b-986a-ae23b72aa9a3 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:41.694445 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a2c656c9-850f-484b-986a-ae23b72aa9a3 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:41.695147 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a2c656c9-850f-484b-986a-ae23b72aa9a3 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:41.930698 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-a2c656c9-850f-484b-986a-ae23b72aa9a3 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:57:41.941506 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a2c656c9-850f-484b-986a-ae23b72aa9a3 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/a7c2818c-4019-4f05-a716-503458fd712a" status: 200 len: 1690 microversion: 2.1 time: 0.261997 Aug 27 03:57:41.942348 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3507/7060] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:57:41 2022] GET /compute/v2.1/servers/a7c2818c-4019-4f05-a716-503458fd712a => generated 1690 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:57:41.962671 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-b5a145ea-5001-4bdd-aeae-e5bdd633b1fe tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:57:41.963398 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-b5a145ea-5001-4bdd-aeae-e5bdd633b1fe tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: a7c2818c-4019-4f05-a716-503458fd712a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:57:41.971344 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b5a145ea-5001-4bdd-aeae-e5bdd633b1fe tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:41.971858 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b5a145ea-5001-4bdd-aeae-e5bdd633b1fe tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:41.972346 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b5a145ea-5001-4bdd-aeae-e5bdd633b1fe tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:41.973260 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b5a145ea-5001-4bdd-aeae-e5bdd633b1fe tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:41.973724 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b5a145ea-5001-4bdd-aeae-e5bdd633b1fe tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:41.974151 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-b5a145ea-5001-4bdd-aeae-e5bdd633b1fe tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:42.226951 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-b5a145ea-5001-4bdd-aeae-e5bdd633b1fe tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:57:42.236381 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-b5a145ea-5001-4bdd-aeae-e5bdd633b1fe tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/a7c2818c-4019-4f05-a716-503458fd712a" status: 200 len: 1690 microversion: 2.1 time: 0.277872 Aug 27 03:57:42.237007 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3554/7061] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:57:41 2022] GET /compute/v2.1/servers/a7c2818c-4019-4f05-a716-503458fd712a => generated 1690 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:57:43.266285 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8aa41d39-b26c-4896-8af2-8c18979635f4 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:57:43.266902 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-8aa41d39-b26c-4896-8af2-8c18979635f4 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: a7c2818c-4019-4f05-a716-503458fd712a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:57:43.274427 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8aa41d39-b26c-4896-8af2-8c18979635f4 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:43.275223 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8aa41d39-b26c-4896-8af2-8c18979635f4 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:43.275667 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8aa41d39-b26c-4896-8af2-8c18979635f4 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:43.276419 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8aa41d39-b26c-4896-8af2-8c18979635f4 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:43.276873 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8aa41d39-b26c-4896-8af2-8c18979635f4 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:43.277302 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8aa41d39-b26c-4896-8af2-8c18979635f4 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:43.428506 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-8aa41d39-b26c-4896-8af2-8c18979635f4 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:57:43.436531 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-8aa41d39-b26c-4896-8af2-8c18979635f4 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/a7c2818c-4019-4f05-a716-503458fd712a" status: 200 len: 1682 microversion: 2.1 time: 0.174264 Aug 27 03:57:43.437120 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3508/7062] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:57:43 2022] GET /compute/v2.1/servers/a7c2818c-4019-4f05-a716-503458fd712a => generated 1682 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:57:44.108217 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-0c0af90c-977d-42b4-9c30-49e124839ccb req-9398e8bb-8a33-4394-943a-d634739dcd39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7c2818c-4019-4f05-a716-503458fd712a", "name": "network-vif-plugged", "status": "completed", "tag": "2ac9313d-274b-400e-aff5-e6b1ccb56784"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:57:44.119797 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-0c0af90c-977d-42b4-9c30-49e124839ccb req-9398e8bb-8a33-4394-943a-d634739dcd39 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:44.120267 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-0c0af90c-977d-42b4-9c30-49e124839ccb req-9398e8bb-8a33-4394-943a-d634739dcd39 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:44.120757 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-0c0af90c-977d-42b4-9c30-49e124839ccb req-9398e8bb-8a33-4394-943a-d634739dcd39 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:44.132879 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-0c0af90c-977d-42b4-9c30-49e124839ccb req-9398e8bb-8a33-4394-943a-d634739dcd39 service nova] Creating event network-vif-plugged:2ac9313d-274b-400e-aff5-e6b1ccb56784 for instance a7c2818c-4019-4f05-a716-503458fd712a on n-h2-852278-4 Aug 27 03:57:44.138237 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-0c0af90c-977d-42b4-9c30-49e124839ccb req-9398e8bb-8a33-4394-943a-d634739dcd39 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101820 Aug 27 03:57:44.139251 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3555/7063] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:57:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:58:05.674819 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=28 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:58:05.675600 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=82 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:58:05.682253 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a142801d-8725-46d0-b124-3a4214323204 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:58:05.685370 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a142801d-8725-46d0-b124-3a4214323204 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: a7c2818c-4019-4f05-a716-503458fd712a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:58:05.692766 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a142801d-8725-46d0-b124-3a4214323204 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:05.693257 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a142801d-8725-46d0-b124-3a4214323204 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:05.693697 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a142801d-8725-46d0-b124-3a4214323204 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:05.694414 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a142801d-8725-46d0-b124-3a4214323204 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:05.694908 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a142801d-8725-46d0-b124-3a4214323204 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:05.695301 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a142801d-8725-46d0-b124-3a4214323204 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:05.756778 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a142801d-8725-46d0-b124-3a4214323204 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "POST /compute/v2.1/servers/a7c2818c-4019-4f05-a716-503458fd712a/action" status: 200 len: 24576 microversion: 2.1 time: 0.083495 Aug 27 03:58:05.757476 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3509/7064] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:58:05 2022] POST /compute/v2.1/servers/a7c2818c-4019-4f05-a716-503458fd712a/action => generated 24576 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:58:12.842275 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-569a2669-e638-466f-8d59-4016df23403c tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:58:12.843584 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-569a2669-e638-466f-8d59-4016df23403c tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: a7c2818c-4019-4f05-a716-503458fd712a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:58:12.844755 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-d7be0537-6335-4021-9f4c-8756b691359d req-c800100d-48ec-4e5c-b125-c40716f83c82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7c2818c-4019-4f05-a716-503458fd712a", "tag": "2ac9313d-274b-400e-aff5-e6b1ccb56784"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:58:12.846683 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=32 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:58:12.847782 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:58:12.855770 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-569a2669-e638-466f-8d59-4016df23403c tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:12.856568 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-569a2669-e638-466f-8d59-4016df23403c tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:12.857266 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-569a2669-e638-466f-8d59-4016df23403c tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:12.858022 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-d7be0537-6335-4021-9f4c-8756b691359d req-c800100d-48ec-4e5c-b125-c40716f83c82 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:12.858261 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-569a2669-e638-466f-8d59-4016df23403c tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:12.859017 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-569a2669-e638-466f-8d59-4016df23403c tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:12.859319 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-d7be0537-6335-4021-9f4c-8756b691359d req-c800100d-48ec-4e5c-b125-c40716f83c82 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:12.859473 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-569a2669-e638-466f-8d59-4016df23403c tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:12.860231 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-d7be0537-6335-4021-9f4c-8756b691359d req-c800100d-48ec-4e5c-b125-c40716f83c82 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:12.874905 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-d7be0537-6335-4021-9f4c-8756b691359d req-c800100d-48ec-4e5c-b125-c40716f83c82 service nova] Creating event network-changed:2ac9313d-274b-400e-aff5-e6b1ccb56784 for instance a7c2818c-4019-4f05-a716-503458fd712a on n-h2-852278-4 Aug 27 03:58:12.880476 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-d7be0537-6335-4021-9f4c-8756b691359d req-c800100d-48ec-4e5c-b125-c40716f83c82 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039823 Aug 27 03:58:12.881370 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3510/7065] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:58:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:58:12.890090 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-569a2669-e638-466f-8d59-4016df23403c tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: a7c2818c-4019-4f05-a716-503458fd712a] Going to try to terminate instance {{(pid=134051) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:58:12.998992 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-569a2669-e638-466f-8d59-4016df23403c tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "DELETE /compute/v2.1/servers/a7c2818c-4019-4f05-a716-503458fd712a" status: 204 len: 0 microversion: 2.1 time: 0.160323 Aug 27 03:58:13.000119 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3556/7066] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 03:58:12 2022] DELETE /compute/v2.1/servers/a7c2818c-4019-4f05-a716-503458fd712a => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:58:13.010293 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-96d4612a-d4ac-4bee-897a-0a0097ceb3ae tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:58:13.011098 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-96d4612a-d4ac-4bee-897a-0a0097ceb3ae tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: a7c2818c-4019-4f05-a716-503458fd712a] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:58:13.018350 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-96d4612a-d4ac-4bee-897a-0a0097ceb3ae tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:13.018810 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-96d4612a-d4ac-4bee-897a-0a0097ceb3ae tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:13.019492 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-96d4612a-d4ac-4bee-897a-0a0097ceb3ae tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:13.020282 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-96d4612a-d4ac-4bee-897a-0a0097ceb3ae tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:13.020758 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-96d4612a-d4ac-4bee-897a-0a0097ceb3ae tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:13.021159 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-96d4612a-d4ac-4bee-897a-0a0097ceb3ae tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:13.236414 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-96d4612a-d4ac-4bee-897a-0a0097ceb3ae tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:58:13.245563 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-96d4612a-d4ac-4bee-897a-0a0097ceb3ae tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/a7c2818c-4019-4f05-a716-503458fd712a" status: 200 len: 1688 microversion: 2.1 time: 0.240183 Aug 27 03:58:13.246308 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3511/7067] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:58:13 2022] GET /compute/v2.1/servers/a7c2818c-4019-4f05-a716-503458fd712a => generated 1688 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:58:14.268183 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-741abe2d-0744-4688-9d4e-a24352ad522f tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:58:14.268929 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-741abe2d-0744-4688-9d4e-a24352ad522f tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: a7c2818c-4019-4f05-a716-503458fd712a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:58:14.276532 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-741abe2d-0744-4688-9d4e-a24352ad522f tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:14.277068 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-741abe2d-0744-4688-9d4e-a24352ad522f tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:14.277580 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-741abe2d-0744-4688-9d4e-a24352ad522f tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:14.278242 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-741abe2d-0744-4688-9d4e-a24352ad522f tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:14.278705 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-741abe2d-0744-4688-9d4e-a24352ad522f tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:14.279146 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-741abe2d-0744-4688-9d4e-a24352ad522f tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:15.025878 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-741abe2d-0744-4688-9d4e-a24352ad522f tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:58:15.034416 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-741abe2d-0744-4688-9d4e-a24352ad522f tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/a7c2818c-4019-4f05-a716-503458fd712a" status: 200 len: 1688 microversion: 2.1 time: 0.770635 Aug 27 03:58:15.035000 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3557/7068] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:58:14 2022] GET /compute/v2.1/servers/a7c2818c-4019-4f05-a716-503458fd712a => generated 1688 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:58:15.497945 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-467f42c2-7ce9-4d55-bce3-cafb0614957d req-22cf35b7-9759-47a8-a6af-43b0bd549469 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7c2818c-4019-4f05-a716-503458fd712a", "name": "network-vif-deleted", "tag": "2ac9313d-274b-400e-aff5-e6b1ccb56784"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:58:15.515189 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-467f42c2-7ce9-4d55-bce3-cafb0614957d req-22cf35b7-9759-47a8-a6af-43b0bd549469 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:15.515651 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-467f42c2-7ce9-4d55-bce3-cafb0614957d req-22cf35b7-9759-47a8-a6af-43b0bd549469 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:15.516078 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-467f42c2-7ce9-4d55-bce3-cafb0614957d req-22cf35b7-9759-47a8-a6af-43b0bd549469 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:15.531300 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-467f42c2-7ce9-4d55-bce3-cafb0614957d req-22cf35b7-9759-47a8-a6af-43b0bd549469 service nova] Creating event network-vif-deleted:2ac9313d-274b-400e-aff5-e6b1ccb56784 for instance a7c2818c-4019-4f05-a716-503458fd712a on n-h2-852278-4 Aug 27 03:58:15.535059 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-467f42c2-7ce9-4d55-bce3-cafb0614957d req-22cf35b7-9759-47a8-a6af-43b0bd549469 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040555 Aug 27 03:58:15.536230 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3512/7069] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:58:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:58:16.057699 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-190005d1-79cd-4285-856f-bffb52496a98 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:58:16.058285 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-190005d1-79cd-4285-856f-bffb52496a98 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: a7c2818c-4019-4f05-a716-503458fd712a] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:58:16.066162 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-190005d1-79cd-4285-856f-bffb52496a98 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:16.066672 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-190005d1-79cd-4285-856f-bffb52496a98 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:16.067119 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-190005d1-79cd-4285-856f-bffb52496a98 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:16.067839 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-190005d1-79cd-4285-856f-bffb52496a98 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:16.068299 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-190005d1-79cd-4285-856f-bffb52496a98 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:16.068764 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-190005d1-79cd-4285-856f-bffb52496a98 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:16.083314 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-190005d1-79cd-4285-856f-bffb52496a98 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] HTTP exception thrown: Instance a7c2818c-4019-4f05-a716-503458fd712a could not be found. Aug 27 03:58:16.085060 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-190005d1-79cd-4285-856f-bffb52496a98 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Request method failure captured: Aug 27 03:58:16.085060 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/a7c2818c-4019-4f05-a716-503458fd712a HTTP/1.1 Aug 27 03:58:16.085060 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 03:58:16.085060 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 03:58:16.085060 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 03:58:16.085060 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 03:58:16.085060 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 03:58:16.085060 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 03:58:16.085060 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 03:58:16.085060 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 03:58:16.085060 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCZU37KUCPlLNPa46uoYyHww48hoe3u_z-BgLN9g-oq2tOv22Rtnsjni3NQSTpUSFvnqw-iilMtJmmXNN3mDjBxOFqxVi8ULOCUVZBgtRQ3Q2tRHScCw5ed_FU_gznAbg4sRYwVid01sApcIv5MJUox6pjFVHV0WUHFDPrPNCAXQKHo4 Aug 27 03:58:16.085060 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 03:58:16.085060 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 03:58:16.085060 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 03:58:16.085060 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 03:58:16.085060 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 03:58:16.085060 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 03:58:16.085060 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 961e5856cfda49f3a46a5db96d35050f Aug 27 03:58:16.085060 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-967904917 Aug 27 03:58:16.085060 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 03:58:16.085060 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 03:58:16.085060 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/961e5856cfda49f3a46a5db96d35050f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_961e5856cfda49f3a46a5db96d35050f", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/961e5856cfda49f3a46a5db96d35050f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/961e5856cfda49f3a46a5db96d35050f"}]}] Aug 27 03:58:16.085060 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-TestNetworkAdvancedServerOps-967904917 Aug 27 03:58:16.085060 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 961e5856cfda49f3a46a5db96d35050f Aug 27 03:58:16.085060 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-967904917 Aug 27 03:58:16.085060 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-TestNetworkAdvancedServerOps-967904917-project Aug 27 03:58:16.085060 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 03:58:16.085060 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 03:58:16.085060 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 4dd9a215fc244b839b2334274274675f Aug 27 03:58:16.085060 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-TestNetworkAdvancedServerOps-967904917-project Aug 27 03:58:16.085060 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 03:58:16.085060 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance a7c2818c-4019-4f05-a716-503458fd712a could not be found. Aug 27 03:58:16.085060 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': 'a7c2818c-4019-4f05-a716-503458fd712a'} Aug 27 03:58:16.085060 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:58:16.085060 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:58:16.085060 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:58:16.085060 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:58:16.085060 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:58:16.085060 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:58:16.085060 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:58:16.085060 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:58:16.085060 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:58:16.085060 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:58:16.085060 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7c2818c-4019-4f05-a716-503458fd712a could not be found. Aug 27 03:58:16.085060 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:58:16.085060 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:58:16.085060 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:58:16.085060 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:58:16.085060 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:58:16.085060 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:58:16.085060 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:58:16.085060 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:58:16.085060 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:58:16.085060 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:58:16.085060 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:58:16.085060 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:58:16.085060 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:58:16.085060 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:58:16.085060 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:58:16.085060 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:58:16.085060 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7c2818c-4019-4f05-a716-503458fd712a could not be found. Aug 27 03:58:16.085060 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:58:16.085060 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:58:16.089711 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:58:16.089711 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:58:16.089711 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:58:16.089711 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:58:16.089711 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:58:16.089711 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:58:16.089711 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7c2818c-4019-4f05-a716-503458fd712a could not be found. Aug 27 03:58:16.089711 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 03:58:16.089711 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-190005d1-79cd-4285-856f-bffb52496a98 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Returning 404 to user: Instance a7c2818c-4019-4f05-a716-503458fd712a could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:58:16.089711 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-190005d1-79cd-4285-856f-bffb52496a98 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/a7c2818c-4019-4f05-a716-503458fd712a" status: 404 len: 111 microversion: 2.1 time: 0.032923 Aug 27 03:58:16.089711 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3558/7070] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:58:16 2022] GET /compute/v2.1/servers/a7c2818c-4019-4f05-a716-503458fd712a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:58:19.412301 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-2f549b37-214a-46a3-b293-d2e215ec1afb tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '.version_select at 0x7f5ee241f280>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:58:19.438498 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-2f549b37-214a-46a3-b293-d2e215ec1afb tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1961471257" status: 202 len: 0 microversion: 2.1 time: 0.030723 Aug 27 03:58:19.439341 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3513/7071] 10.222.0.70 () {58 vars in 1284 bytes} [Sat Aug 27 03:58:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1961471257 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:58:19.470481 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-eecca7f7-6a5a-4e1f-a0a9-9036f5a6d431 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Action: 'create', calling method: .version_select at 0x7f5ede932040>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-545464797", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOh3te955k/kecHWDK4iDtf6PuxhS+kft4vN3vI4ywRkhhGvhLmHQ53GUQeWkbwqUzg49MnjKXrcbzaYak5HFzp9bwa4u3AQhlw7ebdDaMABTRlPUqywIAkpFgEWk3g+UA=="}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:58:19.489885 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-eecca7f7-6a5a-4e1f-a0a9-9036f5a6d431 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Getting quotas for project 961e5856cfda49f3a46a5db96d35050f. Resources: {'key_pairs'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:58:19.496815 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-eecca7f7-6a5a-4e1f-a0a9-9036f5a6d431 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Getting quotas for user 4dd9a215fc244b839b2334274274675f and project 961e5856cfda49f3a46a5db96d35050f. Resources: {'key_pairs'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:58:19.543010 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-eecca7f7-6a5a-4e1f-a0a9-9036f5a6d431 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.076929 Aug 27 03:58:19.543611 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3559/7072] 10.222.0.70 () {60 vars in 1159 bytes} [Sat Aug 27 03:58:19 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:58:25.777332 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e1ff4a48-5c0d-4248-959a-6640b5c9469b tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1323752048", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "networks": [{"uuid": "750abf18-0f58-473a-86de-76012b1a92a3"}], "key_name": "tempest-TestNetworkAdvancedServerOps-545464797", "security_groups": [{"name": "tempest-secgroup-smoke-511788586"}]}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:58:25.789086 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=14 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:58:25.901884 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.network.neutron [None req-e1ff4a48-5c0d-4248-959a-6640b5c9469b tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] validate_networks() for [('750abf18-0f58-473a-86de-76012b1a92a3', None, None, None, None, None)] {{(pid=134052) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:58:26.424139 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-e1ff4a48-5c0d-4248-959a-6640b5c9469b tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Flavor limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:58:26.424705 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-e1ff4a48-5c0d-4248-959a-6640b5c9469b tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Image limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:58:26.425185 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-e1ff4a48-5c0d-4248-959a-6640b5c9469b tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Flavor pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:58:26.425629 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-e1ff4a48-5c0d-4248-959a-6640b5c9469b tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Image pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:58:26.426044 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-e1ff4a48-5c0d-4248-959a-6640b5c9469b tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:58:26.436925 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e1ff4a48-5c0d-4248-959a-6640b5c9469b tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:26.437653 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e1ff4a48-5c0d-4248-959a-6640b5c9469b tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:26.438272 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e1ff4a48-5c0d-4248-959a-6640b5c9469b tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:26.439237 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e1ff4a48-5c0d-4248-959a-6640b5c9469b tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:26.439845 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e1ff4a48-5c0d-4248-959a-6640b5c9469b tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:26.440477 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e1ff4a48-5c0d-4248-959a-6640b5c9469b tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:26.472390 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-e1ff4a48-5c0d-4248-959a-6640b5c9469b tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Getting quotas for project 961e5856cfda49f3a46a5db96d35050f. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:58:26.490443 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-e1ff4a48-5c0d-4248-959a-6640b5c9469b tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Getting quotas for user 4dd9a215fc244b839b2334274274675f and project 961e5856cfda49f3a46a5db96d35050f. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:58:26.520031 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-e1ff4a48-5c0d-4248-959a-6640b5c9469b tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Going to run 1 instances... {{(pid=134052) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:58:26.525200 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-e1ff4a48-5c0d-4248-959a-6640b5c9469b tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 19f2890c-dce8-4285-a311-10613af6907d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134052) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:58:26.592507 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e1ff4a48-5c0d-4248-959a-6640b5c9469b tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.819337 Aug 27 03:58:26.593814 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3514/7073] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 03:58:25 2022] POST /compute/v2.1/servers => generated 405 bytes in 821 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:58:26.603519 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:58:26.610832 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7c0bfa2a-fbd1-4ced-929b-6b7e08dffa4b tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:58:26.611985 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-7c0bfa2a-fbd1-4ced-929b-6b7e08dffa4b tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 19f2890c-dce8-4285-a311-10613af6907d] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:58:26.706272 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-7c0bfa2a-fbd1-4ced-929b-6b7e08dffa4b tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:58:26.715025 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-7c0bfa2a-fbd1-4ced-929b-6b7e08dffa4b tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/19f2890c-dce8-4285-a311-10613af6907d" status: 200 len: 1266 microversion: 2.1 time: 0.113940 Aug 27 03:58:26.728993 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3560/7074] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:58:26 2022] GET /compute/v2.1/servers/19f2890c-dce8-4285-a311-10613af6907d => generated 1266 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:58:27.737055 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-95b0d8a6-7e79-4dc7-9ca8-efc903e36a93 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:58:27.737734 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-95b0d8a6-7e79-4dc7-9ca8-efc903e36a93 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 19f2890c-dce8-4285-a311-10613af6907d] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:58:27.749855 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-95b0d8a6-7e79-4dc7-9ca8-efc903e36a93 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:27.750362 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-95b0d8a6-7e79-4dc7-9ca8-efc903e36a93 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:27.750809 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-95b0d8a6-7e79-4dc7-9ca8-efc903e36a93 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:27.751541 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-95b0d8a6-7e79-4dc7-9ca8-efc903e36a93 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:27.752227 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-95b0d8a6-7e79-4dc7-9ca8-efc903e36a93 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:27.752683 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-95b0d8a6-7e79-4dc7-9ca8-efc903e36a93 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:27.844837 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-95b0d8a6-7e79-4dc7-9ca8-efc903e36a93 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:58:27.857667 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-95b0d8a6-7e79-4dc7-9ca8-efc903e36a93 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/19f2890c-dce8-4285-a311-10613af6907d" status: 200 len: 1318 microversion: 2.1 time: 0.125824 Aug 27 03:58:27.858584 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3515/7075] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:58:27 2022] GET /compute/v2.1/servers/19f2890c-dce8-4285-a311-10613af6907d => generated 1318 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:58:28.879391 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e83d92e9-4c7f-4744-bce7-57a1875011b8 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:58:28.880021 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-e83d92e9-4c7f-4744-bce7-57a1875011b8 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 19f2890c-dce8-4285-a311-10613af6907d] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:58:28.888882 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e83d92e9-4c7f-4744-bce7-57a1875011b8 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:28.889713 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e83d92e9-4c7f-4744-bce7-57a1875011b8 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:28.890337 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e83d92e9-4c7f-4744-bce7-57a1875011b8 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:28.891550 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e83d92e9-4c7f-4744-bce7-57a1875011b8 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:28.892029 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e83d92e9-4c7f-4744-bce7-57a1875011b8 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:28.892480 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e83d92e9-4c7f-4744-bce7-57a1875011b8 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:29.190271 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e83d92e9-4c7f-4744-bce7-57a1875011b8 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:58:29.199554 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e83d92e9-4c7f-4744-bce7-57a1875011b8 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/19f2890c-dce8-4285-a311-10613af6907d" status: 200 len: 1391 microversion: 2.1 time: 0.324026 Aug 27 03:58:29.200494 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3561/7076] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:58:28 2022] GET /compute/v2.1/servers/19f2890c-dce8-4285-a311-10613af6907d => generated 1391 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:58:29.553894 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-523bdc0e-af06-491d-b499-b7891b6ebed2 req-98b3985c-fec1-4575-b63f-e229aa9549fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19f2890c-dce8-4285-a311-10613af6907d", "tag": "e66f1f68-857f-41ad-bd54-73348738c09e"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:58:29.567308 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-523bdc0e-af06-491d-b499-b7891b6ebed2 req-98b3985c-fec1-4575-b63f-e229aa9549fb service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:29.567880 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-523bdc0e-af06-491d-b499-b7891b6ebed2 req-98b3985c-fec1-4575-b63f-e229aa9549fb service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:29.568386 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-523bdc0e-af06-491d-b499-b7891b6ebed2 req-98b3985c-fec1-4575-b63f-e229aa9549fb service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:29.580700 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-523bdc0e-af06-491d-b499-b7891b6ebed2 req-98b3985c-fec1-4575-b63f-e229aa9549fb service nova] Creating event network-changed:e66f1f68-857f-41ad-bd54-73348738c09e for instance 19f2890c-dce8-4285-a311-10613af6907d on n-h1-852278-4 Aug 27 03:58:29.587259 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-523bdc0e-af06-491d-b499-b7891b6ebed2 req-98b3985c-fec1-4575-b63f-e229aa9549fb service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038778 Aug 27 03:58:29.588571 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3516/7077] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:58:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:58:30.221907 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-33866a17-e12c-4256-8368-9cbb153d2dfa tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:58:30.222623 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-33866a17-e12c-4256-8368-9cbb153d2dfa tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 19f2890c-dce8-4285-a311-10613af6907d] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:58:30.230014 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-33866a17-e12c-4256-8368-9cbb153d2dfa tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:30.230532 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-33866a17-e12c-4256-8368-9cbb153d2dfa tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:30.230987 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-33866a17-e12c-4256-8368-9cbb153d2dfa tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:30.231725 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-33866a17-e12c-4256-8368-9cbb153d2dfa tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:30.232196 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-33866a17-e12c-4256-8368-9cbb153d2dfa tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:30.232672 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-33866a17-e12c-4256-8368-9cbb153d2dfa tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:30.381585 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-33866a17-e12c-4256-8368-9cbb153d2dfa tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:58:30.390410 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-33866a17-e12c-4256-8368-9cbb153d2dfa tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/19f2890c-dce8-4285-a311-10613af6907d" status: 200 len: 1391 microversion: 2.1 time: 0.172432 Aug 27 03:58:30.391041 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3562/7078] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:58:30 2022] GET /compute/v2.1/servers/19f2890c-dce8-4285-a311-10613af6907d => generated 1391 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:58:31.413183 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-97b07af7-ec5f-4cf8-b18d-9e812d0516c5 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:58:31.413785 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-97b07af7-ec5f-4cf8-b18d-9e812d0516c5 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 19f2890c-dce8-4285-a311-10613af6907d] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:58:31.421912 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-97b07af7-ec5f-4cf8-b18d-9e812d0516c5 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:31.422414 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-97b07af7-ec5f-4cf8-b18d-9e812d0516c5 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:31.422844 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-97b07af7-ec5f-4cf8-b18d-9e812d0516c5 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:31.423559 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-97b07af7-ec5f-4cf8-b18d-9e812d0516c5 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:31.424014 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-97b07af7-ec5f-4cf8-b18d-9e812d0516c5 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:31.424478 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-97b07af7-ec5f-4cf8-b18d-9e812d0516c5 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:31.571652 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-97b07af7-ec5f-4cf8-b18d-9e812d0516c5 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:58:31.580057 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-97b07af7-ec5f-4cf8-b18d-9e812d0516c5 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/19f2890c-dce8-4285-a311-10613af6907d" status: 200 len: 1391 microversion: 2.1 time: 0.172176 Aug 27 03:58:31.580703 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3517/7079] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:58:31 2022] GET /compute/v2.1/servers/19f2890c-dce8-4285-a311-10613af6907d => generated 1391 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:58:32.601527 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-29c22fcb-7a72-4891-a08e-a04217a68746 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:58:32.602145 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-29c22fcb-7a72-4891-a08e-a04217a68746 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 19f2890c-dce8-4285-a311-10613af6907d] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:58:32.610606 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-29c22fcb-7a72-4891-a08e-a04217a68746 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:32.611462 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-29c22fcb-7a72-4891-a08e-a04217a68746 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:32.612197 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-29c22fcb-7a72-4891-a08e-a04217a68746 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:32.613688 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-29c22fcb-7a72-4891-a08e-a04217a68746 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:32.614256 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-29c22fcb-7a72-4891-a08e-a04217a68746 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:32.614705 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-29c22fcb-7a72-4891-a08e-a04217a68746 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:32.775231 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-29c22fcb-7a72-4891-a08e-a04217a68746 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:58:32.787109 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-29c22fcb-7a72-4891-a08e-a04217a68746 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/19f2890c-dce8-4285-a311-10613af6907d" status: 200 len: 1391 microversion: 2.1 time: 0.189325 Aug 27 03:58:32.787786 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3563/7080] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:58:32 2022] GET /compute/v2.1/servers/19f2890c-dce8-4285-a311-10613af6907d => generated 1391 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:58:33.810851 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-deae834e-1700-402d-ad48-aeed8cb1b6d7 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:58:33.811446 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-deae834e-1700-402d-ad48-aeed8cb1b6d7 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 19f2890c-dce8-4285-a311-10613af6907d] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:58:33.820008 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-deae834e-1700-402d-ad48-aeed8cb1b6d7 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:33.820537 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-deae834e-1700-402d-ad48-aeed8cb1b6d7 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:33.820979 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-deae834e-1700-402d-ad48-aeed8cb1b6d7 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:33.821704 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-deae834e-1700-402d-ad48-aeed8cb1b6d7 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:33.822157 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-deae834e-1700-402d-ad48-aeed8cb1b6d7 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:33.822578 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-deae834e-1700-402d-ad48-aeed8cb1b6d7 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:33.968095 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-deae834e-1700-402d-ad48-aeed8cb1b6d7 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:58:33.977573 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-deae834e-1700-402d-ad48-aeed8cb1b6d7 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/19f2890c-dce8-4285-a311-10613af6907d" status: 200 len: 1391 microversion: 2.1 time: 0.172088 Aug 27 03:58:33.978292 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3518/7081] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:58:33 2022] GET /compute/v2.1/servers/19f2890c-dce8-4285-a311-10613af6907d => generated 1391 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:58:35.001383 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-59c96852-7bcf-4911-bd39-6881fcd516b7 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:58:35.001981 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-59c96852-7bcf-4911-bd39-6881fcd516b7 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 19f2890c-dce8-4285-a311-10613af6907d] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:58:35.009580 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-59c96852-7bcf-4911-bd39-6881fcd516b7 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:35.010078 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-59c96852-7bcf-4911-bd39-6881fcd516b7 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:35.010530 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-59c96852-7bcf-4911-bd39-6881fcd516b7 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:35.011251 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-59c96852-7bcf-4911-bd39-6881fcd516b7 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:35.011718 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-59c96852-7bcf-4911-bd39-6881fcd516b7 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:35.012151 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-59c96852-7bcf-4911-bd39-6881fcd516b7 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:35.153839 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-59c96852-7bcf-4911-bd39-6881fcd516b7 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:58:35.162482 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-59c96852-7bcf-4911-bd39-6881fcd516b7 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/19f2890c-dce8-4285-a311-10613af6907d" status: 200 len: 1391 microversion: 2.1 time: 0.167121 Aug 27 03:58:35.163093 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3564/7082] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:58:34 2022] GET /compute/v2.1/servers/19f2890c-dce8-4285-a311-10613af6907d => generated 1391 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:58:35.996717 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-86417d66-ab2c-4704-98db-3b46718ea928 req-8960415f-aeb4-4885-af73-2db59be0a5b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19f2890c-dce8-4285-a311-10613af6907d", "name": "network-vif-plugged", "status": "completed", "tag": "e66f1f68-857f-41ad-bd54-73348738c09e"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:58:36.003131 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=35,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:58:36.010514 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-86417d66-ab2c-4704-98db-3b46718ea928 req-8960415f-aeb4-4885-af73-2db59be0a5b0 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:36.011330 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-86417d66-ab2c-4704-98db-3b46718ea928 req-8960415f-aeb4-4885-af73-2db59be0a5b0 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:36.011797 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-86417d66-ab2c-4704-98db-3b46718ea928 req-8960415f-aeb4-4885-af73-2db59be0a5b0 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:36.024983 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-86417d66-ab2c-4704-98db-3b46718ea928 req-8960415f-aeb4-4885-af73-2db59be0a5b0 service nova] Creating event network-vif-plugged:e66f1f68-857f-41ad-bd54-73348738c09e for instance 19f2890c-dce8-4285-a311-10613af6907d on n-h1-852278-4 Aug 27 03:58:36.030293 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-86417d66-ab2c-4704-98db-3b46718ea928 req-8960415f-aeb4-4885-af73-2db59be0a5b0 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037378 Aug 27 03:58:36.031105 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3519/7083] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:58:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:58:36.184001 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4a5191cf-4f41-41b2-b483-a459aef31e07 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:58:36.184950 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-4a5191cf-4f41-41b2-b483-a459aef31e07 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 19f2890c-dce8-4285-a311-10613af6907d] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:58:36.192803 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4a5191cf-4f41-41b2-b483-a459aef31e07 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:36.193655 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4a5191cf-4f41-41b2-b483-a459aef31e07 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:36.194213 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4a5191cf-4f41-41b2-b483-a459aef31e07 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:36.195051 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4a5191cf-4f41-41b2-b483-a459aef31e07 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:36.195659 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4a5191cf-4f41-41b2-b483-a459aef31e07 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:36.196203 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4a5191cf-4f41-41b2-b483-a459aef31e07 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:36.352716 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-4a5191cf-4f41-41b2-b483-a459aef31e07 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:58:36.361360 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-4a5191cf-4f41-41b2-b483-a459aef31e07 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/19f2890c-dce8-4285-a311-10613af6907d" status: 200 len: 1391 microversion: 2.1 time: 0.181742 Aug 27 03:58:36.362876 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3565/7084] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:58:36 2022] GET /compute/v2.1/servers/19f2890c-dce8-4285-a311-10613af6907d => generated 1391 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:58:37.381281 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:58:37.382228 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=6 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:58:37.387492 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8bad3c71-9dc9-4049-a062-2fdc03a81f2e tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:58:37.388214 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-8bad3c71-9dc9-4049-a062-2fdc03a81f2e tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 19f2890c-dce8-4285-a311-10613af6907d] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:58:37.395664 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8bad3c71-9dc9-4049-a062-2fdc03a81f2e tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:37.396148 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8bad3c71-9dc9-4049-a062-2fdc03a81f2e tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:37.396614 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8bad3c71-9dc9-4049-a062-2fdc03a81f2e tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:37.397333 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8bad3c71-9dc9-4049-a062-2fdc03a81f2e tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:37.397788 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8bad3c71-9dc9-4049-a062-2fdc03a81f2e tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:37.398210 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8bad3c71-9dc9-4049-a062-2fdc03a81f2e tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:37.546454 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-8bad3c71-9dc9-4049-a062-2fdc03a81f2e tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:58:37.555526 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-8bad3c71-9dc9-4049-a062-2fdc03a81f2e tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/19f2890c-dce8-4285-a311-10613af6907d" status: 200 len: 1562 microversion: 2.1 time: 0.175199 Aug 27 03:58:37.556144 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3520/7085] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:58:37 2022] GET /compute/v2.1/servers/19f2890c-dce8-4285-a311-10613af6907d => generated 1562 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:58:37.576185 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-90937f85-5ce0-4a60-8966-1ac37bad08c1 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:58:37.576783 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-90937f85-5ce0-4a60-8966-1ac37bad08c1 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 19f2890c-dce8-4285-a311-10613af6907d] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:58:37.578811 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=6 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:58:37.585590 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-90937f85-5ce0-4a60-8966-1ac37bad08c1 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:37.586100 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-90937f85-5ce0-4a60-8966-1ac37bad08c1 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:37.586553 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-90937f85-5ce0-4a60-8966-1ac37bad08c1 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:37.587283 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-90937f85-5ce0-4a60-8966-1ac37bad08c1 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:37.587751 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-90937f85-5ce0-4a60-8966-1ac37bad08c1 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:37.588190 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-90937f85-5ce0-4a60-8966-1ac37bad08c1 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:37.727327 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-90937f85-5ce0-4a60-8966-1ac37bad08c1 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:58:37.738643 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-90937f85-5ce0-4a60-8966-1ac37bad08c1 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/19f2890c-dce8-4285-a311-10613af6907d" status: 200 len: 1562 microversion: 2.1 time: 0.166395 Aug 27 03:58:37.739254 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3566/7086] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:58:37 2022] GET /compute/v2.1/servers/19f2890c-dce8-4285-a311-10613af6907d => generated 1562 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:58:39.768140 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b39e2a59-f81b-4fb8-aa3d-d8dcf94fcd1c tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:58:39.769122 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b39e2a59-f81b-4fb8-aa3d-d8dcf94fcd1c tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 19f2890c-dce8-4285-a311-10613af6907d] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:58:39.776354 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b39e2a59-f81b-4fb8-aa3d-d8dcf94fcd1c tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:39.777209 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b39e2a59-f81b-4fb8-aa3d-d8dcf94fcd1c tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:39.777915 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b39e2a59-f81b-4fb8-aa3d-d8dcf94fcd1c tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:39.783602 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-2c3f16d0-f25a-4d76-8be4-10cb3aa3c43e req-dd611204-1390-4ff8-9037-eb55fde0d53e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19f2890c-dce8-4285-a311-10613af6907d", "tag": "e66f1f68-857f-41ad-bd54-73348738c09e"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:58:39.788941 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b39e2a59-f81b-4fb8-aa3d-d8dcf94fcd1c tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:39.795249 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-2c3f16d0-f25a-4d76-8be4-10cb3aa3c43e req-dd611204-1390-4ff8-9037-eb55fde0d53e service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:39.796154 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b39e2a59-f81b-4fb8-aa3d-d8dcf94fcd1c tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:39.796882 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b39e2a59-f81b-4fb8-aa3d-d8dcf94fcd1c tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:39.802226 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-2c3f16d0-f25a-4d76-8be4-10cb3aa3c43e req-dd611204-1390-4ff8-9037-eb55fde0d53e service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:39.803055 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-2c3f16d0-f25a-4d76-8be4-10cb3aa3c43e req-dd611204-1390-4ff8-9037-eb55fde0d53e service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:39.825190 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-2c3f16d0-f25a-4d76-8be4-10cb3aa3c43e req-dd611204-1390-4ff8-9037-eb55fde0d53e service nova] Creating event network-changed:e66f1f68-857f-41ad-bd54-73348738c09e for instance 19f2890c-dce8-4285-a311-10613af6907d on n-h1-852278-4 Aug 27 03:58:39.831428 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-2c3f16d0-f25a-4d76-8be4-10cb3aa3c43e req-dd611204-1390-4ff8-9037-eb55fde0d53e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051489 Aug 27 03:58:39.832248 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3567/7087] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 03:58:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:58:40.049158 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b39e2a59-f81b-4fb8-aa3d-d8dcf94fcd1c tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:58:40.057789 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b39e2a59-f81b-4fb8-aa3d-d8dcf94fcd1c tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/19f2890c-dce8-4285-a311-10613af6907d" status: 200 len: 1562 microversion: 2.1 time: 0.294167 Aug 27 03:58:40.073609 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3521/7088] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:58:39 2022] GET /compute/v2.1/servers/19f2890c-dce8-4285-a311-10613af6907d => generated 1562 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:59:01.325247 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:59:01.325953 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=38 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:59:01.330620 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-83d3c61c-48fb-4933-a64b-30801df8a1f4 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:59:01.333432 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-83d3c61c-48fb-4933-a64b-30801df8a1f4 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 19f2890c-dce8-4285-a311-10613af6907d] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:59:01.341261 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-83d3c61c-48fb-4933-a64b-30801df8a1f4 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:59:01.341774 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-83d3c61c-48fb-4933-a64b-30801df8a1f4 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:59:01.342227 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-83d3c61c-48fb-4933-a64b-30801df8a1f4 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:59:01.342954 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-83d3c61c-48fb-4933-a64b-30801df8a1f4 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:59:01.343426 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-83d3c61c-48fb-4933-a64b-30801df8a1f4 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:59:01.343868 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-83d3c61c-48fb-4933-a64b-30801df8a1f4 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:59:01.422138 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-83d3c61c-48fb-4933-a64b-30801df8a1f4 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "POST /compute/v2.1/servers/19f2890c-dce8-4285-a311-10613af6907d/action" status: 200 len: 24569 microversion: 2.1 time: 0.098848 Aug 27 03:59:01.422912 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3568/7089] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:59:01 2022] POST /compute/v2.1/servers/19f2890c-dce8-4285-a311-10613af6907d/action => generated 24569 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:59:12.441522 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-603ed95b-f14f-4001-9b52-e2ed68681a51 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:59:12.443816 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=5 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:59:12.444484 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=36 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:59:12.450439 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-603ed95b-f14f-4001-9b52-e2ed68681a51 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:59:12.450931 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-603ed95b-f14f-4001-9b52-e2ed68681a51 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:59:12.451360 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-603ed95b-f14f-4001-9b52-e2ed68681a51 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:59:12.475651 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-603ed95b-f14f-4001-9b52-e2ed68681a51 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 19f2890c-dce8-4285-a311-10613af6907d] Going to try to stop instance {{(pid=134052) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 27 03:59:12.523408 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-603ed95b-f14f-4001-9b52-e2ed68681a51 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "POST /compute/v2.1/servers/19f2890c-dce8-4285-a311-10613af6907d/action" status: 202 len: 0 microversion: 2.1 time: 0.085909 Aug 27 03:59:12.524024 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3522/7090] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:59:12 2022] POST /compute/v2.1/servers/19f2890c-dce8-4285-a311-10613af6907d/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:59:12.533428 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-cf57463f-0793-4e12-a962-3170f0b54006 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:59:12.534139 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-cf57463f-0793-4e12-a962-3170f0b54006 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 19f2890c-dce8-4285-a311-10613af6907d] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:59:12.537524 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=4 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:59:12.538450 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:59:12.545505 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cf57463f-0793-4e12-a962-3170f0b54006 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:59:12.546037 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cf57463f-0793-4e12-a962-3170f0b54006 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:59:12.546673 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cf57463f-0793-4e12-a962-3170f0b54006 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:59:12.547425 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cf57463f-0793-4e12-a962-3170f0b54006 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:59:12.547879 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cf57463f-0793-4e12-a962-3170f0b54006 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:59:12.548336 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cf57463f-0793-4e12-a962-3170f0b54006 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:59:12.689659 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-cf57463f-0793-4e12-a962-3170f0b54006 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:59:12.698176 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-cf57463f-0793-4e12-a962-3170f0b54006 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/19f2890c-dce8-4285-a311-10613af6907d" status: 200 len: 1690 microversion: 2.1 time: 0.169156 Aug 27 03:59:12.698752 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3569/7091] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:59:12 2022] GET /compute/v2.1/servers/19f2890c-dce8-4285-a311-10613af6907d => generated 1690 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:59:13.728252 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b3cea485-9f7d-4b4e-9a79-d9db4da54ea9 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:59:13.729527 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b3cea485-9f7d-4b4e-9a79-d9db4da54ea9 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 19f2890c-dce8-4285-a311-10613af6907d] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:59:13.739848 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b3cea485-9f7d-4b4e-9a79-d9db4da54ea9 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:59:13.740346 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b3cea485-9f7d-4b4e-9a79-d9db4da54ea9 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:59:13.740805 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b3cea485-9f7d-4b4e-9a79-d9db4da54ea9 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:59:13.741502 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b3cea485-9f7d-4b4e-9a79-d9db4da54ea9 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:59:13.741951 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b3cea485-9f7d-4b4e-9a79-d9db4da54ea9 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:59:13.742374 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b3cea485-9f7d-4b4e-9a79-d9db4da54ea9 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:59:13.899182 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b3cea485-9f7d-4b4e-9a79-d9db4da54ea9 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:59:13.910056 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b3cea485-9f7d-4b4e-9a79-d9db4da54ea9 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/19f2890c-dce8-4285-a311-10613af6907d" status: 200 len: 1690 microversion: 2.1 time: 0.190739 Aug 27 03:59:13.910622 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3523/7092] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:59:13 2022] GET /compute/v2.1/servers/19f2890c-dce8-4285-a311-10613af6907d => generated 1690 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:59:14.934158 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3986cce9-8fa3-45c1-9ff0-26ce58117c5c tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:59:14.934796 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-3986cce9-8fa3-45c1-9ff0-26ce58117c5c tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 19f2890c-dce8-4285-a311-10613af6907d] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:59:14.943955 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3986cce9-8fa3-45c1-9ff0-26ce58117c5c tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:59:14.944491 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3986cce9-8fa3-45c1-9ff0-26ce58117c5c tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:59:14.944949 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3986cce9-8fa3-45c1-9ff0-26ce58117c5c tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:59:14.945668 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3986cce9-8fa3-45c1-9ff0-26ce58117c5c tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:59:14.946129 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3986cce9-8fa3-45c1-9ff0-26ce58117c5c tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:59:14.946567 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3986cce9-8fa3-45c1-9ff0-26ce58117c5c tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:59:15.084603 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-3986cce9-8fa3-45c1-9ff0-26ce58117c5c tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:59:15.093034 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-3986cce9-8fa3-45c1-9ff0-26ce58117c5c tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/19f2890c-dce8-4285-a311-10613af6907d" status: 200 len: 1690 microversion: 2.1 time: 0.162959 Aug 27 03:59:15.093631 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3570/7093] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:59:14 2022] GET /compute/v2.1/servers/19f2890c-dce8-4285-a311-10613af6907d => generated 1690 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:59:16.116123 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6a719371-f923-4bb5-8117-539a28b7ad93 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:59:16.116798 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-6a719371-f923-4bb5-8117-539a28b7ad93 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 19f2890c-dce8-4285-a311-10613af6907d] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:59:16.124554 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6a719371-f923-4bb5-8117-539a28b7ad93 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:59:16.125195 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6a719371-f923-4bb5-8117-539a28b7ad93 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:59:16.125803 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6a719371-f923-4bb5-8117-539a28b7ad93 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:59:16.126867 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6a719371-f923-4bb5-8117-539a28b7ad93 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:59:16.127520 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6a719371-f923-4bb5-8117-539a28b7ad93 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:59:16.128127 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6a719371-f923-4bb5-8117-539a28b7ad93 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:59:16.280014 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-6a719371-f923-4bb5-8117-539a28b7ad93 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:59:16.288559 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-6a719371-f923-4bb5-8117-539a28b7ad93 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/19f2890c-dce8-4285-a311-10613af6907d" status: 200 len: 1690 microversion: 2.1 time: 0.177450 Aug 27 03:59:16.289166 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3524/7094] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:59:16 2022] GET /compute/v2.1/servers/19f2890c-dce8-4285-a311-10613af6907d => generated 1690 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:59:17.314208 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f0b63571-801d-4666-b6b4-10182891c324 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:59:17.314789 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-f0b63571-801d-4666-b6b4-10182891c324 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 19f2890c-dce8-4285-a311-10613af6907d] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:59:17.322464 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f0b63571-801d-4666-b6b4-10182891c324 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:59:17.323413 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f0b63571-801d-4666-b6b4-10182891c324 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:59:17.323413 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f0b63571-801d-4666-b6b4-10182891c324 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:59:17.324161 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f0b63571-801d-4666-b6b4-10182891c324 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:59:17.324664 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f0b63571-801d-4666-b6b4-10182891c324 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:59:17.325108 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f0b63571-801d-4666-b6b4-10182891c324 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:59:17.472479 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-f0b63571-801d-4666-b6b4-10182891c324 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:59:17.482482 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-f0b63571-801d-4666-b6b4-10182891c324 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/19f2890c-dce8-4285-a311-10613af6907d" status: 200 len: 1690 microversion: 2.1 time: 0.173085 Aug 27 03:59:17.483105 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3571/7095] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:59:17 2022] GET /compute/v2.1/servers/19f2890c-dce8-4285-a311-10613af6907d => generated 1690 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:59:18.504866 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-34dfd7a9-8d8e-4015-92c7-f9426536db3d tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:59:18.505603 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-34dfd7a9-8d8e-4015-92c7-f9426536db3d tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 19f2890c-dce8-4285-a311-10613af6907d] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:59:18.513677 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-34dfd7a9-8d8e-4015-92c7-f9426536db3d tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:59:18.514181 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-34dfd7a9-8d8e-4015-92c7-f9426536db3d tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:59:18.514617 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-34dfd7a9-8d8e-4015-92c7-f9426536db3d tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:59:18.515338 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-34dfd7a9-8d8e-4015-92c7-f9426536db3d tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:59:18.515774 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-34dfd7a9-8d8e-4015-92c7-f9426536db3d tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:59:18.516201 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-34dfd7a9-8d8e-4015-92c7-f9426536db3d tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:59:18.659269 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-34dfd7a9-8d8e-4015-92c7-f9426536db3d tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:59:18.667862 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-34dfd7a9-8d8e-4015-92c7-f9426536db3d tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/19f2890c-dce8-4285-a311-10613af6907d" status: 200 len: 1690 microversion: 2.1 time: 0.167024 Aug 27 03:59:18.668482 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3525/7096] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:59:18 2022] GET /compute/v2.1/servers/19f2890c-dce8-4285-a311-10613af6907d => generated 1690 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:59:19.690013 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-31f3969c-6d74-4823-a131-656e0dc7cff1 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:59:19.690778 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-31f3969c-6d74-4823-a131-656e0dc7cff1 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 19f2890c-dce8-4285-a311-10613af6907d] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:59:19.698114 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-31f3969c-6d74-4823-a131-656e0dc7cff1 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:59:19.698617 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-31f3969c-6d74-4823-a131-656e0dc7cff1 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:59:19.699067 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-31f3969c-6d74-4823-a131-656e0dc7cff1 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:59:19.699795 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-31f3969c-6d74-4823-a131-656e0dc7cff1 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:59:19.700264 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-31f3969c-6d74-4823-a131-656e0dc7cff1 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:59:19.700738 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-31f3969c-6d74-4823-a131-656e0dc7cff1 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:59:19.844563 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-31f3969c-6d74-4823-a131-656e0dc7cff1 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:59:19.852795 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-31f3969c-6d74-4823-a131-656e0dc7cff1 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/19f2890c-dce8-4285-a311-10613af6907d" status: 200 len: 1690 microversion: 2.1 time: 0.166862 Aug 27 03:59:19.853411 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3572/7097] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:59:19 2022] GET /compute/v2.1/servers/19f2890c-dce8-4285-a311-10613af6907d => generated 1690 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:59:20.874442 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-fb6dd8e1-93a9-491e-b969-b04c6223e897 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:59:20.875102 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-fb6dd8e1-93a9-491e-b969-b04c6223e897 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 19f2890c-dce8-4285-a311-10613af6907d] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:59:20.882938 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fb6dd8e1-93a9-491e-b969-b04c6223e897 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:59:20.883440 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fb6dd8e1-93a9-491e-b969-b04c6223e897 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:59:20.883878 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fb6dd8e1-93a9-491e-b969-b04c6223e897 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:59:20.884632 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fb6dd8e1-93a9-491e-b969-b04c6223e897 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:59:20.885092 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fb6dd8e1-93a9-491e-b969-b04c6223e897 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:59:20.885519 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fb6dd8e1-93a9-491e-b969-b04c6223e897 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:59:21.034398 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-fb6dd8e1-93a9-491e-b969-b04c6223e897 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:59:21.043415 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-fb6dd8e1-93a9-491e-b969-b04c6223e897 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/19f2890c-dce8-4285-a311-10613af6907d" status: 200 len: 1690 microversion: 2.1 time: 0.173062 Aug 27 03:59:21.044348 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3526/7098] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:59:20 2022] GET /compute/v2.1/servers/19f2890c-dce8-4285-a311-10613af6907d => generated 1690 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:59:22.066601 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f6e8fbbc-9e86-48ed-bd60-8a2b10bd3073 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:59:22.067232 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-f6e8fbbc-9e86-48ed-bd60-8a2b10bd3073 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 19f2890c-dce8-4285-a311-10613af6907d] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:59:22.074813 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f6e8fbbc-9e86-48ed-bd60-8a2b10bd3073 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:59:22.075320 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f6e8fbbc-9e86-48ed-bd60-8a2b10bd3073 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:59:22.075765 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f6e8fbbc-9e86-48ed-bd60-8a2b10bd3073 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:59:22.076525 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f6e8fbbc-9e86-48ed-bd60-8a2b10bd3073 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:59:22.076973 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f6e8fbbc-9e86-48ed-bd60-8a2b10bd3073 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:59:22.077407 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f6e8fbbc-9e86-48ed-bd60-8a2b10bd3073 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:59:22.221636 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-f6e8fbbc-9e86-48ed-bd60-8a2b10bd3073 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:59:22.230430 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-f6e8fbbc-9e86-48ed-bd60-8a2b10bd3073 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/19f2890c-dce8-4285-a311-10613af6907d" status: 200 len: 1690 microversion: 2.1 time: 0.167703 Aug 27 03:59:22.231034 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3573/7099] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:59:22 2022] GET /compute/v2.1/servers/19f2890c-dce8-4285-a311-10613af6907d => generated 1690 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:59:23.253313 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c017fc96-1ecb-4662-b560-b836f53cdd47 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:59:23.253981 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-c017fc96-1ecb-4662-b560-b836f53cdd47 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 19f2890c-dce8-4285-a311-10613af6907d] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:59:23.261651 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c017fc96-1ecb-4662-b560-b836f53cdd47 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:59:23.262129 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c017fc96-1ecb-4662-b560-b836f53cdd47 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:59:23.262563 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c017fc96-1ecb-4662-b560-b836f53cdd47 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:59:23.263275 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c017fc96-1ecb-4662-b560-b836f53cdd47 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:59:23.263717 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c017fc96-1ecb-4662-b560-b836f53cdd47 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:59:23.264129 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c017fc96-1ecb-4662-b560-b836f53cdd47 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:59:23.405247 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-c017fc96-1ecb-4662-b560-b836f53cdd47 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:59:23.414239 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c017fc96-1ecb-4662-b560-b836f53cdd47 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/19f2890c-dce8-4285-a311-10613af6907d" status: 200 len: 1690 microversion: 2.1 time: 0.165948 Aug 27 03:59:23.414983 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3527/7100] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:59:23 2022] GET /compute/v2.1/servers/19f2890c-dce8-4285-a311-10613af6907d => generated 1690 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:59:24.438015 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-9bbaafe6-a9f0-4f35-83c2-d06e1ebac094 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:59:24.438015 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-9bbaafe6-a9f0-4f35-83c2-d06e1ebac094 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 19f2890c-dce8-4285-a311-10613af6907d] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:59:24.445227 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9bbaafe6-a9f0-4f35-83c2-d06e1ebac094 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:59:24.445730 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9bbaafe6-a9f0-4f35-83c2-d06e1ebac094 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:59:24.446179 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9bbaafe6-a9f0-4f35-83c2-d06e1ebac094 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:59:24.446898 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9bbaafe6-a9f0-4f35-83c2-d06e1ebac094 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:59:24.447354 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9bbaafe6-a9f0-4f35-83c2-d06e1ebac094 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:59:24.447789 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9bbaafe6-a9f0-4f35-83c2-d06e1ebac094 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:59:24.903666 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-9bbaafe6-a9f0-4f35-83c2-d06e1ebac094 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:59:24.911890 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-9bbaafe6-a9f0-4f35-83c2-d06e1ebac094 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/19f2890c-dce8-4285-a311-10613af6907d" status: 200 len: 1690 microversion: 2.1 time: 0.478827 Aug 27 03:59:24.912507 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3574/7101] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:59:24 2022] GET /compute/v2.1/servers/19f2890c-dce8-4285-a311-10613af6907d => generated 1690 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:59:25.935456 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3294cf2f-520c-4968-b127-7d8cbdca25f7 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:59:25.936038 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-3294cf2f-520c-4968-b127-7d8cbdca25f7 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 19f2890c-dce8-4285-a311-10613af6907d] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:59:25.943728 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3294cf2f-520c-4968-b127-7d8cbdca25f7 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:59:25.944143 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3294cf2f-520c-4968-b127-7d8cbdca25f7 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:59:25.944607 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3294cf2f-520c-4968-b127-7d8cbdca25f7 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:59:25.947207 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3294cf2f-520c-4968-b127-7d8cbdca25f7 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:59:25.947207 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3294cf2f-520c-4968-b127-7d8cbdca25f7 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:59:25.947207 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3294cf2f-520c-4968-b127-7d8cbdca25f7 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:59:26.084059 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-3294cf2f-520c-4968-b127-7d8cbdca25f7 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:59:26.092916 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-3294cf2f-520c-4968-b127-7d8cbdca25f7 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/19f2890c-dce8-4285-a311-10613af6907d" status: 200 len: 1690 microversion: 2.1 time: 0.161444 Aug 27 03:59:26.093525 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3528/7102] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:59:25 2022] GET /compute/v2.1/servers/19f2890c-dce8-4285-a311-10613af6907d => generated 1690 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:59:27.115178 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-de3f962a-8603-4573-a8dc-92d605369122 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:59:27.115818 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-de3f962a-8603-4573-a8dc-92d605369122 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 19f2890c-dce8-4285-a311-10613af6907d] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:59:27.123530 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-de3f962a-8603-4573-a8dc-92d605369122 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:59:27.124050 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-de3f962a-8603-4573-a8dc-92d605369122 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:59:27.124557 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-de3f962a-8603-4573-a8dc-92d605369122 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:59:27.125301 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-de3f962a-8603-4573-a8dc-92d605369122 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:59:27.125772 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-de3f962a-8603-4573-a8dc-92d605369122 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:59:27.126211 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-de3f962a-8603-4573-a8dc-92d605369122 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:59:27.272683 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-de3f962a-8603-4573-a8dc-92d605369122 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:59:27.281703 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-de3f962a-8603-4573-a8dc-92d605369122 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/19f2890c-dce8-4285-a311-10613af6907d" status: 200 len: 1690 microversion: 2.1 time: 0.170662 Aug 27 03:59:27.282323 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3575/7103] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:59:27 2022] GET /compute/v2.1/servers/19f2890c-dce8-4285-a311-10613af6907d => generated 1690 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:59:28.305602 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-be498198-c780-4e39-a1c0-fca48b71adc7 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:59:28.306309 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-be498198-c780-4e39-a1c0-fca48b71adc7 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 19f2890c-dce8-4285-a311-10613af6907d] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:59:28.315287 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-be498198-c780-4e39-a1c0-fca48b71adc7 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:59:28.315456 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-be498198-c780-4e39-a1c0-fca48b71adc7 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:59:28.315901 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-be498198-c780-4e39-a1c0-fca48b71adc7 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:59:28.316741 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-be498198-c780-4e39-a1c0-fca48b71adc7 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:59:28.317299 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-be498198-c780-4e39-a1c0-fca48b71adc7 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:59:28.317617 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-be498198-c780-4e39-a1c0-fca48b71adc7 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:59:28.463501 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-be498198-c780-4e39-a1c0-fca48b71adc7 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:59:28.473554 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-be498198-c780-4e39-a1c0-fca48b71adc7 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/19f2890c-dce8-4285-a311-10613af6907d" status: 200 len: 1667 microversion: 2.1 time: 0.172692 Aug 27 03:59:28.474168 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3529/7104] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:59:28 2022] GET /compute/v2.1/servers/19f2890c-dce8-4285-a311-10613af6907d => generated 1667 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:59:29.571852 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-cbe356b3-0cd0-4faa-8a8d-0cb6113c0e1c tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:59:29.574482 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-cbe356b3-0cd0-4faa-8a8d-0cb6113c0e1c tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 19f2890c-dce8-4285-a311-10613af6907d] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:59:29.582111 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cbe356b3-0cd0-4faa-8a8d-0cb6113c0e1c tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:59:29.582626 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cbe356b3-0cd0-4faa-8a8d-0cb6113c0e1c tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:59:29.583080 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cbe356b3-0cd0-4faa-8a8d-0cb6113c0e1c tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:59:29.583813 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cbe356b3-0cd0-4faa-8a8d-0cb6113c0e1c tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:59:29.584282 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cbe356b3-0cd0-4faa-8a8d-0cb6113c0e1c tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:59:29.584802 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cbe356b3-0cd0-4faa-8a8d-0cb6113c0e1c tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:59:29.650185 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-cbe356b3-0cd0-4faa-8a8d-0cb6113c0e1c tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "POST /compute/v2.1/servers/19f2890c-dce8-4285-a311-10613af6907d/action" status: 200 len: 38398 microversion: 2.1 time: 0.082388 Aug 27 03:59:29.651289 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3576/7105] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:59:29 2022] POST /compute/v2.1/servers/19f2890c-dce8-4285-a311-10613af6907d/action => generated 38398 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:59:29.663723 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-955b923e-d81a-4de5-b090-03a2e129dd3e tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:59:29.671861 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-955b923e-d81a-4de5-b090-03a2e129dd3e tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:59:29.672359 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-955b923e-d81a-4de5-b090-03a2e129dd3e tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:59:29.672824 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-955b923e-d81a-4de5-b090-03a2e129dd3e tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:59:29.697248 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-955b923e-d81a-4de5-b090-03a2e129dd3e tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 19f2890c-dce8-4285-a311-10613af6907d] Going to try to start instance {{(pid=134052) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 27 03:59:29.743462 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-955b923e-d81a-4de5-b090-03a2e129dd3e tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "POST /compute/v2.1/servers/19f2890c-dce8-4285-a311-10613af6907d/action" status: 202 len: 0 microversion: 2.1 time: 0.083538 Aug 27 03:59:29.744101 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3530/7106] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:59:29 2022] POST /compute/v2.1/servers/19f2890c-dce8-4285-a311-10613af6907d/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:59:29.753473 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-040c0f3d-5081-479e-9097-226a49ff0635 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:59:29.754207 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-040c0f3d-5081-479e-9097-226a49ff0635 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 19f2890c-dce8-4285-a311-10613af6907d] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:59:29.762981 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-040c0f3d-5081-479e-9097-226a49ff0635 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:59:29.763510 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-040c0f3d-5081-479e-9097-226a49ff0635 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:59:29.764085 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-040c0f3d-5081-479e-9097-226a49ff0635 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:59:29.765155 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-040c0f3d-5081-479e-9097-226a49ff0635 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:59:29.765815 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-040c0f3d-5081-479e-9097-226a49ff0635 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:59:29.766247 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-040c0f3d-5081-479e-9097-226a49ff0635 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:59:29.961925 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-040c0f3d-5081-479e-9097-226a49ff0635 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:59:29.971733 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-040c0f3d-5081-479e-9097-226a49ff0635 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/19f2890c-dce8-4285-a311-10613af6907d" status: 200 len: 1676 microversion: 2.1 time: 0.222553 Aug 27 03:59:29.972423 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3577/7107] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:59:29 2022] GET /compute/v2.1/servers/19f2890c-dce8-4285-a311-10613af6907d => generated 1676 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:59:30.996881 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3b70ba62-d23c-45de-badc-dfe81eb918ff tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:59:30.997615 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-3b70ba62-d23c-45de-badc-dfe81eb918ff tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 19f2890c-dce8-4285-a311-10613af6907d] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:59:31.004536 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3b70ba62-d23c-45de-badc-dfe81eb918ff tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:59:31.005200 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3b70ba62-d23c-45de-badc-dfe81eb918ff tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:59:31.005504 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3b70ba62-d23c-45de-badc-dfe81eb918ff tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:59:31.006415 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3b70ba62-d23c-45de-badc-dfe81eb918ff tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:59:31.006868 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3b70ba62-d23c-45de-badc-dfe81eb918ff tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:59:31.007505 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3b70ba62-d23c-45de-badc-dfe81eb918ff tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:59:31.145747 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-3b70ba62-d23c-45de-badc-dfe81eb918ff tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:59:31.154418 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-3b70ba62-d23c-45de-badc-dfe81eb918ff tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/19f2890c-dce8-4285-a311-10613af6907d" status: 200 len: 1680 microversion: 2.1 time: 0.162725 Aug 27 03:59:31.155028 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3531/7108] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 03:59:30 2022] GET /compute/v2.1/servers/19f2890c-dce8-4285-a311-10613af6907d => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:59:55.376865 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7cf1be3c-a920-4ace-b82c-ebfaaf67f33c tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:59:55.379122 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-7cf1be3c-a920-4ace-b82c-ebfaaf67f33c tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 19f2890c-dce8-4285-a311-10613af6907d] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:59:55.382246 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=18 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:59:55.382934 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=52 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:59:55.384077 n-d-852278-4 devstack@n-api.service[134051]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:59:55.384224 n-d-852278-4 devstack@n-api.service[134051]: Sat Aug 27 03:59:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/19f2890c-dce8-4285-a311-10613af6907d/action (ip 10.222.0.70) !!! Aug 27 03:59:55.393188 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7cf1be3c-a920-4ace-b82c-ebfaaf67f33c tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:59:55.393687 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7cf1be3c-a920-4ace-b82c-ebfaaf67f33c tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:59:55.394139 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7cf1be3c-a920-4ace-b82c-ebfaaf67f33c tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:59:55.394868 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7cf1be3c-a920-4ace-b82c-ebfaaf67f33c tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:59:55.395294 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7cf1be3c-a920-4ace-b82c-ebfaaf67f33c tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:59:55.395788 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7cf1be3c-a920-4ace-b82c-ebfaaf67f33c tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:59:55.474752 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-7cf1be3c-a920-4ace-b82c-ebfaaf67f33c tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "POST /compute/v2.1/servers/19f2890c-dce8-4285-a311-10613af6907d/action" status: 200 len: 62963 microversion: 2.1 time: 0.101587 Aug 27 03:59:55.475672 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3578/7109] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 03:59:55 2022] POST /compute/v2.1/servers/19f2890c-dce8-4285-a311-10613af6907d/action => generated 62963 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:00:02.599903 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-eccd9665-4d7f-40e6-9e68-e8c92a767638 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:00:02.600814 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-eccd9665-4d7f-40e6-9e68-e8c92a767638 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 19f2890c-dce8-4285-a311-10613af6907d] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:00:02.601049 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-d45a5ce9-59fb-457e-883b-3c9c401b809b req-b26ccbde-4f31-4ac4-8335-d85978f2ff4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19f2890c-dce8-4285-a311-10613af6907d", "tag": "e66f1f68-857f-41ad-bd54-73348738c09e"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:00:02.604623 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=20 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:00:02.605303 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:00:02.610765 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-eccd9665-4d7f-40e6-9e68-e8c92a767638 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:02.611712 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-eccd9665-4d7f-40e6-9e68-e8c92a767638 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:02.612130 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-eccd9665-4d7f-40e6-9e68-e8c92a767638 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:02.612876 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-eccd9665-4d7f-40e6-9e68-e8c92a767638 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:02.613114 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-d45a5ce9-59fb-457e-883b-3c9c401b809b req-b26ccbde-4f31-4ac4-8335-d85978f2ff4a service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:02.613303 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-eccd9665-4d7f-40e6-9e68-e8c92a767638 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:02.613626 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-d45a5ce9-59fb-457e-883b-3c9c401b809b req-b26ccbde-4f31-4ac4-8335-d85978f2ff4a service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:02.613919 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-eccd9665-4d7f-40e6-9e68-e8c92a767638 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:02.614060 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-d45a5ce9-59fb-457e-883b-3c9c401b809b req-b26ccbde-4f31-4ac4-8335-d85978f2ff4a service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:02.628045 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-d45a5ce9-59fb-457e-883b-3c9c401b809b req-b26ccbde-4f31-4ac4-8335-d85978f2ff4a service nova] Creating event network-changed:e66f1f68-857f-41ad-bd54-73348738c09e for instance 19f2890c-dce8-4285-a311-10613af6907d on n-h1-852278-4 Aug 27 04:00:02.633668 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-d45a5ce9-59fb-457e-883b-3c9c401b809b req-b26ccbde-4f31-4ac4-8335-d85978f2ff4a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041508 Aug 27 04:00:02.634872 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3579/7110] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 04:00:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:00:02.646751 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-eccd9665-4d7f-40e6-9e68-e8c92a767638 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 19f2890c-dce8-4285-a311-10613af6907d] Going to try to terminate instance {{(pid=134052) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:00:02.732662 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-eccd9665-4d7f-40e6-9e68-e8c92a767638 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "DELETE /compute/v2.1/servers/19f2890c-dce8-4285-a311-10613af6907d" status: 204 len: 0 microversion: 2.1 time: 0.142393 Aug 27 04:00:02.736654 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3532/7111] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 04:00:02 2022] DELETE /compute/v2.1/servers/19f2890c-dce8-4285-a311-10613af6907d => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:00:02.742925 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0f442a7e-0461-4851-b270-7385f7f8c6d0 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:00:02.743641 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-0f442a7e-0461-4851-b270-7385f7f8c6d0 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 19f2890c-dce8-4285-a311-10613af6907d] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:00:02.750078 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0f442a7e-0461-4851-b270-7385f7f8c6d0 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:02.750634 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0f442a7e-0461-4851-b270-7385f7f8c6d0 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:02.751084 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0f442a7e-0461-4851-b270-7385f7f8c6d0 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:02.751806 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0f442a7e-0461-4851-b270-7385f7f8c6d0 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:02.752268 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0f442a7e-0461-4851-b270-7385f7f8c6d0 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:02.753154 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0f442a7e-0461-4851-b270-7385f7f8c6d0 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:02.903552 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-0f442a7e-0461-4851-b270-7385f7f8c6d0 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:00:02.912001 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-0f442a7e-0461-4851-b270-7385f7f8c6d0 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/19f2890c-dce8-4285-a311-10613af6907d" status: 200 len: 1686 microversion: 2.1 time: 0.173789 Aug 27 04:00:02.912714 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3580/7112] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:00:02 2022] GET /compute/v2.1/servers/19f2890c-dce8-4285-a311-10613af6907d => generated 1686 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:00:03.937386 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e7cfd001-c9f1-457e-96ff-3cbd2d8ac163 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:00:03.938368 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-e7cfd001-c9f1-457e-96ff-3cbd2d8ac163 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 19f2890c-dce8-4285-a311-10613af6907d] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:00:03.948349 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e7cfd001-c9f1-457e-96ff-3cbd2d8ac163 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:03.949018 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e7cfd001-c9f1-457e-96ff-3cbd2d8ac163 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:03.949591 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e7cfd001-c9f1-457e-96ff-3cbd2d8ac163 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:03.950518 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e7cfd001-c9f1-457e-96ff-3cbd2d8ac163 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:03.951113 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e7cfd001-c9f1-457e-96ff-3cbd2d8ac163 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:03.951667 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e7cfd001-c9f1-457e-96ff-3cbd2d8ac163 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:04.179298 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-e7cfd001-c9f1-457e-96ff-3cbd2d8ac163 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:00:04.189660 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e7cfd001-c9f1-457e-96ff-3cbd2d8ac163 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/19f2890c-dce8-4285-a311-10613af6907d" status: 200 len: 1686 microversion: 2.1 time: 0.258074 Aug 27 04:00:04.190259 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3533/7113] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:00:03 2022] GET /compute/v2.1/servers/19f2890c-dce8-4285-a311-10613af6907d => generated 1686 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:00:05.089835 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-79669adb-b0a9-4506-9112-55380e8a48e7 req-f64a1635-0338-4fde-82d1-877cb11ee2f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19f2890c-dce8-4285-a311-10613af6907d", "name": "network-vif-deleted", "tag": "e66f1f68-857f-41ad-bd54-73348738c09e"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:00:05.102355 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-79669adb-b0a9-4506-9112-55380e8a48e7 req-f64a1635-0338-4fde-82d1-877cb11ee2f9 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:05.102854 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-79669adb-b0a9-4506-9112-55380e8a48e7 req-f64a1635-0338-4fde-82d1-877cb11ee2f9 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:05.103299 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-79669adb-b0a9-4506-9112-55380e8a48e7 req-f64a1635-0338-4fde-82d1-877cb11ee2f9 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:05.116432 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-79669adb-b0a9-4506-9112-55380e8a48e7 req-f64a1635-0338-4fde-82d1-877cb11ee2f9 service nova] Creating event network-vif-deleted:e66f1f68-857f-41ad-bd54-73348738c09e for instance 19f2890c-dce8-4285-a311-10613af6907d on n-h1-852278-4 Aug 27 04:00:05.122722 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-79669adb-b0a9-4506-9112-55380e8a48e7 req-f64a1635-0338-4fde-82d1-877cb11ee2f9 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036719 Aug 27 04:00:05.123520 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3581/7114] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 04:00:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:00:05.212720 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d83f0064-05d5-4c55-9c14-5e84e1d26e04 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:00:05.213333 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d83f0064-05d5-4c55-9c14-5e84e1d26e04 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 19f2890c-dce8-4285-a311-10613af6907d] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:00:05.221289 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d83f0064-05d5-4c55-9c14-5e84e1d26e04 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:05.221827 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d83f0064-05d5-4c55-9c14-5e84e1d26e04 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:05.222371 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d83f0064-05d5-4c55-9c14-5e84e1d26e04 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:05.223161 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d83f0064-05d5-4c55-9c14-5e84e1d26e04 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:05.223627 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d83f0064-05d5-4c55-9c14-5e84e1d26e04 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:05.224066 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d83f0064-05d5-4c55-9c14-5e84e1d26e04 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:05.269652 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d83f0064-05d5-4c55-9c14-5e84e1d26e04 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:05.270145 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d83f0064-05d5-4c55-9c14-5e84e1d26e04 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:05.270589 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d83f0064-05d5-4c55-9c14-5e84e1d26e04 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:05.271043 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.instance [None req-d83f0064-05d5-4c55-9c14-5e84e1d26e04 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lazy-loading 'fault' on Instance uuid 19f2890c-dce8-4285-a311-10613af6907d {{(pid=134052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:00:05.321419 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-d83f0064-05d5-4c55-9c14-5e84e1d26e04 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:00:05.329868 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d83f0064-05d5-4c55-9c14-5e84e1d26e04 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/19f2890c-dce8-4285-a311-10613af6907d" status: 200 len: 1356 microversion: 2.1 time: 0.121709 Aug 27 04:00:05.330482 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3534/7115] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:00:05 2022] GET /compute/v2.1/servers/19f2890c-dce8-4285-a311-10613af6907d => generated 1356 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:00:06.351853 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-57163209-6d88-4ea8-949f-99d1f151bd22 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:00:06.352696 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-57163209-6d88-4ea8-949f-99d1f151bd22 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 19f2890c-dce8-4285-a311-10613af6907d] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:00:06.361051 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-57163209-6d88-4ea8-949f-99d1f151bd22 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:06.361641 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-57163209-6d88-4ea8-949f-99d1f151bd22 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:06.362102 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-57163209-6d88-4ea8-949f-99d1f151bd22 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:06.362847 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-57163209-6d88-4ea8-949f-99d1f151bd22 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:06.363318 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-57163209-6d88-4ea8-949f-99d1f151bd22 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:06.363761 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-57163209-6d88-4ea8-949f-99d1f151bd22 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:06.378765 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-57163209-6d88-4ea8-949f-99d1f151bd22 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] HTTP exception thrown: Instance 19f2890c-dce8-4285-a311-10613af6907d could not be found. Aug 27 04:00:06.380565 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-57163209-6d88-4ea8-949f-99d1f151bd22 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Request method failure captured: Aug 27 04:00:06.380565 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/19f2890c-dce8-4285-a311-10613af6907d HTTP/1.1 Aug 27 04:00:06.380565 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 04:00:06.380565 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 04:00:06.380565 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 04:00:06.380565 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 04:00:06.380565 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 04:00:06.380565 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 04:00:06.380565 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 04:00:06.380565 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 04:00:06.380565 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCZU37KUCPlLNPa46uoYyHww48hoe3u_z-BgLN9g-oq2tOv22Rtnsjni3NQSTpUSFvnqw-iilMtJmmXNN3mDjBxOFqxVi8ULOCUVZBgtRQ3Q2tRHScCw5ed_FU_gznAbg4sRYwVid01sApcIv5MJUox6pjFVHV0WUHFDPrPNCAXQKHo4 Aug 27 04:00:06.380565 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 04:00:06.380565 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 04:00:06.380565 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 04:00:06.380565 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 04:00:06.380565 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 04:00:06.380565 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 04:00:06.380565 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: 961e5856cfda49f3a46a5db96d35050f Aug 27 04:00:06.380565 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-967904917 Aug 27 04:00:06.380565 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 04:00:06.380565 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 04:00:06.380565 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/961e5856cfda49f3a46a5db96d35050f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_961e5856cfda49f3a46a5db96d35050f", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/961e5856cfda49f3a46a5db96d35050f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/961e5856cfda49f3a46a5db96d35050f"}]}] Aug 27 04:00:06.380565 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-TestNetworkAdvancedServerOps-967904917 Aug 27 04:00:06.380565 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: 961e5856cfda49f3a46a5db96d35050f Aug 27 04:00:06.380565 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-967904917 Aug 27 04:00:06.380565 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-TestNetworkAdvancedServerOps-967904917-project Aug 27 04:00:06.380565 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 04:00:06.380565 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 04:00:06.380565 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: 4dd9a215fc244b839b2334274274675f Aug 27 04:00:06.380565 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-TestNetworkAdvancedServerOps-967904917-project Aug 27 04:00:06.380565 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 04:00:06.380565 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance 19f2890c-dce8-4285-a311-10613af6907d could not be found. Aug 27 04:00:06.380565 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '19f2890c-dce8-4285-a311-10613af6907d'} Aug 27 04:00:06.380565 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:00:06.380565 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:00:06.380565 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:00:06.380565 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:00:06.380565 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:00:06.380565 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:00:06.380565 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:00:06.380565 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:00:06.380565 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:00:06.380565 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:00:06.380565 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19f2890c-dce8-4285-a311-10613af6907d could not be found. Aug 27 04:00:06.380565 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 04:00:06.380565 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:00:06.380565 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 04:00:06.380565 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:00:06.380565 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:00:06.380565 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:00:06.380565 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:00:06.380565 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:00:06.380565 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:00:06.380565 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:00:06.380565 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:00:06.380565 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:00:06.380565 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:00:06.380565 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:00:06.380565 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:00:06.380565 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:00:06.380565 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19f2890c-dce8-4285-a311-10613af6907d could not be found. Aug 27 04:00:06.380565 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 04:00:06.380565 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:00:06.385052 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 04:00:06.385052 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:00:06.385052 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:00:06.385052 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:00:06.385052 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:00:06.385052 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:00:06.385052 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19f2890c-dce8-4285-a311-10613af6907d could not be found. Aug 27 04:00:06.385052 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 04:00:06.385052 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-57163209-6d88-4ea8-949f-99d1f151bd22 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Returning 404 to user: Instance 19f2890c-dce8-4285-a311-10613af6907d could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:00:06.385052 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-57163209-6d88-4ea8-949f-99d1f151bd22 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/19f2890c-dce8-4285-a311-10613af6907d" status: 404 len: 111 microversion: 2.1 time: 0.034518 Aug 27 04:00:06.385052 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3582/7116] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:00:06 2022] GET /compute/v2.1/servers/19f2890c-dce8-4285-a311-10613af6907d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:00:09.737465 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-66644e00-df22-4c40-ba9e-dc486e2334c7 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '.version_select at 0x7f5ee3091b80>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:00:09.769143 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-66644e00-df22-4c40-ba9e-dc486e2334c7 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-545464797" status: 202 len: 0 microversion: 2.1 time: 0.035610 Aug 27 04:00:09.769724 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3535/7117] 10.222.0.70 () {58 vars in 1281 bytes} [Sat Aug 27 04:00:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-545464797 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:00:09.802453 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-84b2e85e-4bb9-45f4-b141-c966e3d9817c tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Action: 'create', calling method: .version_select at 0x7f5ee7206940>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2031501971", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBsD/41+Uq7zC8hsO+ywFx56LBf26845r7csn+cCQp+UiaYOzVn5Gm4pX5O0YPWo5FvhV4MMNn0j0FYbvSaz7LejYuyxTKlhxrnuuv8/lyARjHjWlBQIruWv+xlq2aGDRA=="}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:00:09.820088 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-84b2e85e-4bb9-45f4-b141-c966e3d9817c tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Getting quotas for project 961e5856cfda49f3a46a5db96d35050f. Resources: {'key_pairs'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:00:09.825295 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-84b2e85e-4bb9-45f4-b141-c966e3d9817c tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Getting quotas for user 4dd9a215fc244b839b2334274274675f and project 961e5856cfda49f3a46a5db96d35050f. Resources: {'key_pairs'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:00:09.852206 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-84b2e85e-4bb9-45f4-b141-c966e3d9817c tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.053807 Aug 27 04:00:09.852878 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3583/7118] 10.222.0.70 () {60 vars in 1159 bytes} [Sat Aug 27 04:00:09 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:00:16.064609 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-7fe20a5d-30b1-42e7-b75c-506514bbe30f tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1149574698", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "networks": [{"uuid": "41b18ae4-1a12-42aa-9920-d92d63815dc6"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2031501971", "security_groups": [{"name": "tempest-secgroup-smoke-531037065"}]}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:00:16.080942 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:00:16.184963 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.network.neutron [None req-7fe20a5d-30b1-42e7-b75c-506514bbe30f tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] validate_networks() for [('41b18ae4-1a12-42aa-9920-d92d63815dc6', None, None, None, None, None)] {{(pid=134052) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:00:16.667255 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-7fe20a5d-30b1-42e7-b75c-506514bbe30f tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Flavor limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:00:16.667689 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-7fe20a5d-30b1-42e7-b75c-506514bbe30f tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Image limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:00:16.668167 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-7fe20a5d-30b1-42e7-b75c-506514bbe30f tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Flavor pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:00:16.669490 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-7fe20a5d-30b1-42e7-b75c-506514bbe30f tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Image pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:00:16.669938 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-7fe20a5d-30b1-42e7-b75c-506514bbe30f tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:00:16.680493 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7fe20a5d-30b1-42e7-b75c-506514bbe30f tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:16.681422 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7fe20a5d-30b1-42e7-b75c-506514bbe30f tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:16.682079 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7fe20a5d-30b1-42e7-b75c-506514bbe30f tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:16.683210 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7fe20a5d-30b1-42e7-b75c-506514bbe30f tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:16.683862 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7fe20a5d-30b1-42e7-b75c-506514bbe30f tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:16.684511 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7fe20a5d-30b1-42e7-b75c-506514bbe30f tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:16.705581 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-7fe20a5d-30b1-42e7-b75c-506514bbe30f tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Getting quotas for project 961e5856cfda49f3a46a5db96d35050f. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:00:16.711878 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-7fe20a5d-30b1-42e7-b75c-506514bbe30f tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Getting quotas for user 4dd9a215fc244b839b2334274274675f and project 961e5856cfda49f3a46a5db96d35050f. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:00:16.726659 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-7fe20a5d-30b1-42e7-b75c-506514bbe30f tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Going to run 1 instances... {{(pid=134052) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:00:16.729363 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-7fe20a5d-30b1-42e7-b75c-506514bbe30f tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 74bcbcef-83c7-4be8-8681-490accdc8714] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134052) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:00:16.780987 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-7fe20a5d-30b1-42e7-b75c-506514bbe30f tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.720972 Aug 27 04:00:16.781674 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3536/7119] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 04:00:16 2022] POST /compute/v2.1/servers => generated 405 bytes in 722 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 04:00:16.790808 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=16 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:00:16.795576 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e3528d14-4903-476a-9f5f-41555f3a8b7e tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:00:16.796215 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-e3528d14-4903-476a-9f5f-41555f3a8b7e tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 74bcbcef-83c7-4be8-8681-490accdc8714] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:00:16.861636 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e3528d14-4903-476a-9f5f-41555f3a8b7e tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:00:16.869352 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e3528d14-4903-476a-9f5f-41555f3a8b7e tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/74bcbcef-83c7-4be8-8681-490accdc8714" status: 200 len: 1267 microversion: 2.1 time: 0.080350 Aug 27 04:00:16.877176 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3584/7120] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:00:16 2022] GET /compute/v2.1/servers/74bcbcef-83c7-4be8-8681-490accdc8714 => generated 1267 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:00:17.894759 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ff234f4a-6150-465e-ae94-eaf3fa55a12e tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:00:17.896042 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-ff234f4a-6150-465e-ae94-eaf3fa55a12e tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 74bcbcef-83c7-4be8-8681-490accdc8714] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:00:17.904781 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ff234f4a-6150-465e-ae94-eaf3fa55a12e tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:17.905447 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ff234f4a-6150-465e-ae94-eaf3fa55a12e tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:17.906167 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ff234f4a-6150-465e-ae94-eaf3fa55a12e tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:17.906891 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ff234f4a-6150-465e-ae94-eaf3fa55a12e tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:17.907351 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ff234f4a-6150-465e-ae94-eaf3fa55a12e tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:17.907771 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ff234f4a-6150-465e-ae94-eaf3fa55a12e tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:18.001383 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-ff234f4a-6150-465e-ae94-eaf3fa55a12e tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:00:18.011969 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ff234f4a-6150-465e-ae94-eaf3fa55a12e tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/74bcbcef-83c7-4be8-8681-490accdc8714" status: 200 len: 1327 microversion: 2.1 time: 0.124859 Aug 27 04:00:18.013591 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3537/7121] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:00:17 2022] GET /compute/v2.1/servers/74bcbcef-83c7-4be8-8681-490accdc8714 => generated 1327 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:00:19.033993 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-6a012b5a-2321-4eac-bb07-5ed3297b3950 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:00:19.034623 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-6a012b5a-2321-4eac-bb07-5ed3297b3950 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 74bcbcef-83c7-4be8-8681-490accdc8714] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:00:19.042550 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6a012b5a-2321-4eac-bb07-5ed3297b3950 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:19.043066 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6a012b5a-2321-4eac-bb07-5ed3297b3950 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:19.043870 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6a012b5a-2321-4eac-bb07-5ed3297b3950 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:19.044628 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6a012b5a-2321-4eac-bb07-5ed3297b3950 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:19.045096 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6a012b5a-2321-4eac-bb07-5ed3297b3950 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:19.045539 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6a012b5a-2321-4eac-bb07-5ed3297b3950 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:19.260409 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-6a012b5a-2321-4eac-bb07-5ed3297b3950 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:00:19.269117 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-6a012b5a-2321-4eac-bb07-5ed3297b3950 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/74bcbcef-83c7-4be8-8681-490accdc8714" status: 200 len: 1392 microversion: 2.1 time: 0.239201 Aug 27 04:00:19.284505 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3585/7122] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:00:19 2022] GET /compute/v2.1/servers/74bcbcef-83c7-4be8-8681-490accdc8714 => generated 1392 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:00:19.542782 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-3362d576-ed6e-460f-9001-c33d0e29be0b req-ba2531b5-e03c-4612-96f4-0fa0756d4509 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74bcbcef-83c7-4be8-8681-490accdc8714", "tag": "3376d240-48d4-477b-8fb1-cb1b0c7b2d86"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:00:19.555371 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-3362d576-ed6e-460f-9001-c33d0e29be0b req-ba2531b5-e03c-4612-96f4-0fa0756d4509 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:19.557344 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-3362d576-ed6e-460f-9001-c33d0e29be0b req-ba2531b5-e03c-4612-96f4-0fa0756d4509 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:19.557850 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-3362d576-ed6e-460f-9001-c33d0e29be0b req-ba2531b5-e03c-4612-96f4-0fa0756d4509 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:19.570155 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-3362d576-ed6e-460f-9001-c33d0e29be0b req-ba2531b5-e03c-4612-96f4-0fa0756d4509 service nova] Creating event network-changed:3376d240-48d4-477b-8fb1-cb1b0c7b2d86 for instance 74bcbcef-83c7-4be8-8681-490accdc8714 on n-h2-852278-4 Aug 27 04:00:19.576960 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-3362d576-ed6e-460f-9001-c33d0e29be0b req-ba2531b5-e03c-4612-96f4-0fa0756d4509 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038600 Aug 27 04:00:19.578084 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3538/7123] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 04:00:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:00:20.291031 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0c05f4c7-4b5c-4b21-b646-687c87f7a265 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:00:20.291753 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-0c05f4c7-4b5c-4b21-b646-687c87f7a265 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 74bcbcef-83c7-4be8-8681-490accdc8714] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:00:20.299729 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0c05f4c7-4b5c-4b21-b646-687c87f7a265 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:20.300263 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0c05f4c7-4b5c-4b21-b646-687c87f7a265 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:20.300746 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0c05f4c7-4b5c-4b21-b646-687c87f7a265 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:20.301461 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0c05f4c7-4b5c-4b21-b646-687c87f7a265 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:20.301983 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0c05f4c7-4b5c-4b21-b646-687c87f7a265 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:20.302823 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0c05f4c7-4b5c-4b21-b646-687c87f7a265 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:20.444132 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-0c05f4c7-4b5c-4b21-b646-687c87f7a265 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:00:20.452801 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-0c05f4c7-4b5c-4b21-b646-687c87f7a265 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/74bcbcef-83c7-4be8-8681-490accdc8714" status: 200 len: 1392 microversion: 2.1 time: 0.165689 Aug 27 04:00:20.453453 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3586/7124] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:00:20 2022] GET /compute/v2.1/servers/74bcbcef-83c7-4be8-8681-490accdc8714 => generated 1392 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:00:21.475300 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-90e01311-41ac-4546-911d-f233b31953d3 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:00:21.475870 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-90e01311-41ac-4546-911d-f233b31953d3 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 74bcbcef-83c7-4be8-8681-490accdc8714] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:00:21.482710 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-90e01311-41ac-4546-911d-f233b31953d3 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:21.483200 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-90e01311-41ac-4546-911d-f233b31953d3 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:21.483637 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-90e01311-41ac-4546-911d-f233b31953d3 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:21.484344 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-90e01311-41ac-4546-911d-f233b31953d3 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:21.484961 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-90e01311-41ac-4546-911d-f233b31953d3 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:21.485388 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-90e01311-41ac-4546-911d-f233b31953d3 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:21.627533 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-90e01311-41ac-4546-911d-f233b31953d3 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:00:21.635760 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-90e01311-41ac-4546-911d-f233b31953d3 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/74bcbcef-83c7-4be8-8681-490accdc8714" status: 200 len: 1392 microversion: 2.1 time: 0.165914 Aug 27 04:00:21.636390 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3539/7125] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:00:21 2022] GET /compute/v2.1/servers/74bcbcef-83c7-4be8-8681-490accdc8714 => generated 1392 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:00:22.660695 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-876a0e15-2a1a-4c1f-89d7-3f279089f7d3 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:00:22.661450 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-876a0e15-2a1a-4c1f-89d7-3f279089f7d3 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 74bcbcef-83c7-4be8-8681-490accdc8714] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:00:22.673055 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-876a0e15-2a1a-4c1f-89d7-3f279089f7d3 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:22.673862 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-876a0e15-2a1a-4c1f-89d7-3f279089f7d3 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:22.674324 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-876a0e15-2a1a-4c1f-89d7-3f279089f7d3 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:22.675045 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-876a0e15-2a1a-4c1f-89d7-3f279089f7d3 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:22.675543 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-876a0e15-2a1a-4c1f-89d7-3f279089f7d3 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:22.675990 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-876a0e15-2a1a-4c1f-89d7-3f279089f7d3 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:22.824379 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-876a0e15-2a1a-4c1f-89d7-3f279089f7d3 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:00:22.832657 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-876a0e15-2a1a-4c1f-89d7-3f279089f7d3 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/74bcbcef-83c7-4be8-8681-490accdc8714" status: 200 len: 1392 microversion: 2.1 time: 0.178432 Aug 27 04:00:22.833243 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3587/7126] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:00:22 2022] GET /compute/v2.1/servers/74bcbcef-83c7-4be8-8681-490accdc8714 => generated 1392 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:00:23.857427 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-25d0d56c-ebc1-4f6a-9221-2ab27556c621 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:00:23.858365 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-25d0d56c-ebc1-4f6a-9221-2ab27556c621 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 74bcbcef-83c7-4be8-8681-490accdc8714] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:00:23.870133 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-25d0d56c-ebc1-4f6a-9221-2ab27556c621 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:23.870927 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-25d0d56c-ebc1-4f6a-9221-2ab27556c621 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:23.871641 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-25d0d56c-ebc1-4f6a-9221-2ab27556c621 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:23.872839 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-25d0d56c-ebc1-4f6a-9221-2ab27556c621 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:23.873572 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-25d0d56c-ebc1-4f6a-9221-2ab27556c621 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:23.874221 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-25d0d56c-ebc1-4f6a-9221-2ab27556c621 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:24.021360 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-25d0d56c-ebc1-4f6a-9221-2ab27556c621 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:00:24.031570 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-25d0d56c-ebc1-4f6a-9221-2ab27556c621 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/74bcbcef-83c7-4be8-8681-490accdc8714" status: 200 len: 1392 microversion: 2.1 time: 0.180685 Aug 27 04:00:24.032342 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3540/7127] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:00:23 2022] GET /compute/v2.1/servers/74bcbcef-83c7-4be8-8681-490accdc8714 => generated 1392 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:00:24.987460 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-29dd1ee3-da13-4f8a-8a4e-a060ee090460 req-e35c92bf-27c9-4e95-9c33-7862010e1ec4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74bcbcef-83c7-4be8-8681-490accdc8714", "name": "network-vif-plugged", "status": "completed", "tag": "3376d240-48d4-477b-8fb1-cb1b0c7b2d86"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:00:24.998451 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-29dd1ee3-da13-4f8a-8a4e-a060ee090460 req-e35c92bf-27c9-4e95-9c33-7862010e1ec4 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:24.998979 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-29dd1ee3-da13-4f8a-8a4e-a060ee090460 req-e35c92bf-27c9-4e95-9c33-7862010e1ec4 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:24.999452 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-29dd1ee3-da13-4f8a-8a4e-a060ee090460 req-e35c92bf-27c9-4e95-9c33-7862010e1ec4 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:25.011557 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-29dd1ee3-da13-4f8a-8a4e-a060ee090460 req-e35c92bf-27c9-4e95-9c33-7862010e1ec4 service nova] Creating event network-vif-plugged:3376d240-48d4-477b-8fb1-cb1b0c7b2d86 for instance 74bcbcef-83c7-4be8-8681-490accdc8714 on n-h2-852278-4 Aug 27 04:00:25.016687 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-29dd1ee3-da13-4f8a-8a4e-a060ee090460 req-e35c92bf-27c9-4e95-9c33-7862010e1ec4 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033237 Aug 27 04:00:25.017294 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3588/7128] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 04:00:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:00:25.053279 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a2082ae4-66ef-4719-93eb-83f38a605e50 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:00:25.054747 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a2082ae4-66ef-4719-93eb-83f38a605e50 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 74bcbcef-83c7-4be8-8681-490accdc8714] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:00:25.061850 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a2082ae4-66ef-4719-93eb-83f38a605e50 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:25.062311 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a2082ae4-66ef-4719-93eb-83f38a605e50 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:25.062941 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a2082ae4-66ef-4719-93eb-83f38a605e50 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:25.063805 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a2082ae4-66ef-4719-93eb-83f38a605e50 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:25.064519 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a2082ae4-66ef-4719-93eb-83f38a605e50 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:25.065130 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a2082ae4-66ef-4719-93eb-83f38a605e50 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:25.253396 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-a2082ae4-66ef-4719-93eb-83f38a605e50 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:00:25.261645 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a2082ae4-66ef-4719-93eb-83f38a605e50 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/74bcbcef-83c7-4be8-8681-490accdc8714" status: 200 len: 1392 microversion: 2.1 time: 0.212348 Aug 27 04:00:25.262206 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3541/7129] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:00:25 2022] GET /compute/v2.1/servers/74bcbcef-83c7-4be8-8681-490accdc8714 => generated 1392 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:00:26.284452 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e6473e1a-e843-4c5d-b586-d810bb8abc97 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:00:26.285112 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-e6473e1a-e843-4c5d-b586-d810bb8abc97 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 74bcbcef-83c7-4be8-8681-490accdc8714] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:00:26.287119 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:00:26.292924 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e6473e1a-e843-4c5d-b586-d810bb8abc97 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:26.293753 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e6473e1a-e843-4c5d-b586-d810bb8abc97 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:26.294199 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e6473e1a-e843-4c5d-b586-d810bb8abc97 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:26.294913 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e6473e1a-e843-4c5d-b586-d810bb8abc97 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:26.295367 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e6473e1a-e843-4c5d-b586-d810bb8abc97 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:26.295798 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e6473e1a-e843-4c5d-b586-d810bb8abc97 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:26.458719 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e6473e1a-e843-4c5d-b586-d810bb8abc97 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:00:26.468589 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e6473e1a-e843-4c5d-b586-d810bb8abc97 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/74bcbcef-83c7-4be8-8681-490accdc8714" status: 200 len: 1392 microversion: 2.1 time: 0.189367 Aug 27 04:00:26.469663 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3589/7130] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:00:26 2022] GET /compute/v2.1/servers/74bcbcef-83c7-4be8-8681-490accdc8714 => generated 1392 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:00:27.495291 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e937e5ef-e4de-4041-a38a-2740681ff30c tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:00:27.496152 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-e937e5ef-e4de-4041-a38a-2740681ff30c tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 74bcbcef-83c7-4be8-8681-490accdc8714] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:00:27.500638 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:00:27.501851 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=6 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:00:27.508154 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e937e5ef-e4de-4041-a38a-2740681ff30c tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:27.508661 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e937e5ef-e4de-4041-a38a-2740681ff30c tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:27.509103 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e937e5ef-e4de-4041-a38a-2740681ff30c tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:27.509802 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e937e5ef-e4de-4041-a38a-2740681ff30c tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:27.510253 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e937e5ef-e4de-4041-a38a-2740681ff30c tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:27.510644 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e937e5ef-e4de-4041-a38a-2740681ff30c tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:27.653068 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-e937e5ef-e4de-4041-a38a-2740681ff30c tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:00:27.666051 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e937e5ef-e4de-4041-a38a-2740681ff30c tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/74bcbcef-83c7-4be8-8681-490accdc8714" status: 200 len: 1565 microversion: 2.1 time: 0.177183 Aug 27 04:00:27.666816 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3542/7131] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:00:27 2022] GET /compute/v2.1/servers/74bcbcef-83c7-4be8-8681-490accdc8714 => generated 1565 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:00:27.689054 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-edd5a091-8e86-4200-9258-0e6e0a6b3707 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:00:27.689722 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-edd5a091-8e86-4200-9258-0e6e0a6b3707 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 74bcbcef-83c7-4be8-8681-490accdc8714] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:00:27.691699 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=6 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:00:27.697801 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-edd5a091-8e86-4200-9258-0e6e0a6b3707 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:27.698306 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-edd5a091-8e86-4200-9258-0e6e0a6b3707 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:27.698754 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-edd5a091-8e86-4200-9258-0e6e0a6b3707 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:27.699474 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-edd5a091-8e86-4200-9258-0e6e0a6b3707 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:27.699940 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-edd5a091-8e86-4200-9258-0e6e0a6b3707 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:27.700429 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-edd5a091-8e86-4200-9258-0e6e0a6b3707 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:27.850311 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-edd5a091-8e86-4200-9258-0e6e0a6b3707 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:00:27.858612 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-edd5a091-8e86-4200-9258-0e6e0a6b3707 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/74bcbcef-83c7-4be8-8681-490accdc8714" status: 200 len: 1565 microversion: 2.1 time: 0.173619 Aug 27 04:00:27.859209 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3590/7132] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:00:27 2022] GET /compute/v2.1/servers/74bcbcef-83c7-4be8-8681-490accdc8714 => generated 1565 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:00:29.533354 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5f23fd9b-5783-45f0-924a-29966bcb5c79 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:00:29.533983 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-5f23fd9b-5783-45f0-924a-29966bcb5c79 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 74bcbcef-83c7-4be8-8681-490accdc8714] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:00:29.535997 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-ac78963c-241a-4609-83a6-10799b37b171 req-5f15e8e4-37e0-4031-abb2-dac45ceed157 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74bcbcef-83c7-4be8-8681-490accdc8714", "tag": "3376d240-48d4-477b-8fb1-cb1b0c7b2d86"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:00:29.541419 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5f23fd9b-5783-45f0-924a-29966bcb5c79 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:29.541951 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5f23fd9b-5783-45f0-924a-29966bcb5c79 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:29.543768 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5f23fd9b-5783-45f0-924a-29966bcb5c79 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:29.544725 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5f23fd9b-5783-45f0-924a-29966bcb5c79 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:29.545293 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5f23fd9b-5783-45f0-924a-29966bcb5c79 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:29.545833 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5f23fd9b-5783-45f0-924a-29966bcb5c79 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:29.547495 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-ac78963c-241a-4609-83a6-10799b37b171 req-5f15e8e4-37e0-4031-abb2-dac45ceed157 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:29.548189 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-ac78963c-241a-4609-83a6-10799b37b171 req-5f15e8e4-37e0-4031-abb2-dac45ceed157 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:29.548702 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-ac78963c-241a-4609-83a6-10799b37b171 req-5f15e8e4-37e0-4031-abb2-dac45ceed157 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:29.561054 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-ac78963c-241a-4609-83a6-10799b37b171 req-5f15e8e4-37e0-4031-abb2-dac45ceed157 service nova] Creating event network-changed:3376d240-48d4-477b-8fb1-cb1b0c7b2d86 for instance 74bcbcef-83c7-4be8-8681-490accdc8714 on n-h2-852278-4 Aug 27 04:00:29.567124 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-ac78963c-241a-4609-83a6-10799b37b171 req-5f15e8e4-37e0-4031-abb2-dac45ceed157 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035416 Aug 27 04:00:29.568721 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3591/7133] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 04:00:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:00:29.767637 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-5f23fd9b-5783-45f0-924a-29966bcb5c79 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:00:29.776104 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-5f23fd9b-5783-45f0-924a-29966bcb5c79 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/74bcbcef-83c7-4be8-8681-490accdc8714" status: 200 len: 1565 microversion: 2.1 time: 0.246870 Aug 27 04:00:29.776956 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3543/7134] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:00:29 2022] GET /compute/v2.1/servers/74bcbcef-83c7-4be8-8681-490accdc8714 => generated 1565 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:00:53.050454 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-03095307-5247-4a20-91cb-5a6fbf2d7c6d tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:00:53.053135 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-03095307-5247-4a20-91cb-5a6fbf2d7c6d tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 74bcbcef-83c7-4be8-8681-490accdc8714] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:00:53.056267 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=5 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:00:53.056979 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=34 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:00:53.063661 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-03095307-5247-4a20-91cb-5a6fbf2d7c6d tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:53.064169 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-03095307-5247-4a20-91cb-5a6fbf2d7c6d tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:53.064658 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-03095307-5247-4a20-91cb-5a6fbf2d7c6d tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:53.065465 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-03095307-5247-4a20-91cb-5a6fbf2d7c6d tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:53.065939 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-03095307-5247-4a20-91cb-5a6fbf2d7c6d tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:53.066417 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-03095307-5247-4a20-91cb-5a6fbf2d7c6d tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:53.120128 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-03095307-5247-4a20-91cb-5a6fbf2d7c6d tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "POST /compute/v2.1/servers/74bcbcef-83c7-4be8-8681-490accdc8714/action" status: 200 len: 24571 microversion: 2.1 time: 0.074029 Aug 27 04:00:53.120898 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3592/7135] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 04:00:53 2022] POST /compute/v2.1/servers/74bcbcef-83c7-4be8-8681-490accdc8714/action => generated 24571 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:00:59.543870 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-87c05694-ae16-4b0d-ae0d-e5374299ee87 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:00:59.544473 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-87c05694-ae16-4b0d-ae0d-e5374299ee87 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 74bcbcef-83c7-4be8-8681-490accdc8714] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:00:59.546740 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:00:59.547409 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=40 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:00:59.554352 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-87c05694-ae16-4b0d-ae0d-e5374299ee87 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:59.554846 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-87c05694-ae16-4b0d-ae0d-e5374299ee87 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:59.555287 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-87c05694-ae16-4b0d-ae0d-e5374299ee87 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:59.556000 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-87c05694-ae16-4b0d-ae0d-e5374299ee87 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:59.556635 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-87c05694-ae16-4b0d-ae0d-e5374299ee87 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:59.557057 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-87c05694-ae16-4b0d-ae0d-e5374299ee87 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:59.582393 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.objects.instance [None req-87c05694-ae16-4b0d-ae0d-e5374299ee87 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lazy-loading 'flavor' on Instance uuid 74bcbcef-83c7-4be8-8681-490accdc8714 {{(pid=134052) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:00:59.651718 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-87c05694-ae16-4b0d-ae0d-e5374299ee87 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "POST /compute/v2.1/servers/74bcbcef-83c7-4be8-8681-490accdc8714/action" status: 202 len: 0 microversion: 2.1 time: 0.112280 Aug 27 04:00:59.655362 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3544/7136] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 04:00:59 2022] POST /compute/v2.1/servers/74bcbcef-83c7-4be8-8681-490accdc8714/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:00:59.661593 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-1e2b79af-414e-430e-a333-48bc6a0b2e10 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:00:59.662470 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-1e2b79af-414e-430e-a333-48bc6a0b2e10 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 74bcbcef-83c7-4be8-8681-490accdc8714] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:00:59.670590 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1e2b79af-414e-430e-a333-48bc6a0b2e10 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:59.671070 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1e2b79af-414e-430e-a333-48bc6a0b2e10 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:59.671670 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1e2b79af-414e-430e-a333-48bc6a0b2e10 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:59.672434 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1e2b79af-414e-430e-a333-48bc6a0b2e10 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:59.672942 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1e2b79af-414e-430e-a333-48bc6a0b2e10 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:59.673411 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1e2b79af-414e-430e-a333-48bc6a0b2e10 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:59.821167 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-1e2b79af-414e-430e-a333-48bc6a0b2e10 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:00:59.829223 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-1e2b79af-414e-430e-a333-48bc6a0b2e10 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/74bcbcef-83c7-4be8-8681-490accdc8714" status: 200 len: 1691 microversion: 2.1 time: 0.172197 Aug 27 04:00:59.829809 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3593/7137] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:00:59 2022] GET /compute/v2.1/servers/74bcbcef-83c7-4be8-8681-490accdc8714 => generated 1691 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:01:00.852683 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-2bf73446-c6f7-45b9-9833-4a87619f455a tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:01:00.853385 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-2bf73446-c6f7-45b9-9833-4a87619f455a tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 74bcbcef-83c7-4be8-8681-490accdc8714] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:01:00.859871 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2bf73446-c6f7-45b9-9833-4a87619f455a tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:01:00.860389 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2bf73446-c6f7-45b9-9833-4a87619f455a tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:01:00.860822 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2bf73446-c6f7-45b9-9833-4a87619f455a tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:01:00.861623 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2bf73446-c6f7-45b9-9833-4a87619f455a tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:01:00.862074 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2bf73446-c6f7-45b9-9833-4a87619f455a tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:01:00.862501 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-2bf73446-c6f7-45b9-9833-4a87619f455a tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:01:01.013491 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-2bf73446-c6f7-45b9-9833-4a87619f455a tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:01:01.021486 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-2bf73446-c6f7-45b9-9833-4a87619f455a tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/74bcbcef-83c7-4be8-8681-490accdc8714" status: 200 len: 1674 microversion: 2.1 time: 0.174114 Aug 27 04:01:01.022043 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3545/7138] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:01:00 2022] GET /compute/v2.1/servers/74bcbcef-83c7-4be8-8681-490accdc8714 => generated 1674 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:01:02.123573 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d89c6a87-fcdf-4a65-ad74-990e57e4ea0f tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:01:02.125804 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d89c6a87-fcdf-4a65-ad74-990e57e4ea0f tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 74bcbcef-83c7-4be8-8681-490accdc8714] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:01:02.134300 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d89c6a87-fcdf-4a65-ad74-990e57e4ea0f tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:01:02.134801 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d89c6a87-fcdf-4a65-ad74-990e57e4ea0f tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:01:02.135352 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d89c6a87-fcdf-4a65-ad74-990e57e4ea0f tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:01:02.136229 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d89c6a87-fcdf-4a65-ad74-990e57e4ea0f tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:01:02.136868 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d89c6a87-fcdf-4a65-ad74-990e57e4ea0f tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:01:02.137348 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d89c6a87-fcdf-4a65-ad74-990e57e4ea0f tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:01:02.197976 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d89c6a87-fcdf-4a65-ad74-990e57e4ea0f tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "POST /compute/v2.1/servers/74bcbcef-83c7-4be8-8681-490accdc8714/action" status: 200 len: 35673 microversion: 2.1 time: 0.078226 Aug 27 04:01:02.198647 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3594/7139] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 04:01:02 2022] POST /compute/v2.1/servers/74bcbcef-83c7-4be8-8681-490accdc8714/action => generated 35673 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:01:02.211189 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3ef7ba82-4905-4f7c-b6a6-cfc62c6ed71d tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:01:02.211751 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-3ef7ba82-4905-4f7c-b6a6-cfc62c6ed71d tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 74bcbcef-83c7-4be8-8681-490accdc8714] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:01:02.218630 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3ef7ba82-4905-4f7c-b6a6-cfc62c6ed71d tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:01:02.219128 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3ef7ba82-4905-4f7c-b6a6-cfc62c6ed71d tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:01:02.219561 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3ef7ba82-4905-4f7c-b6a6-cfc62c6ed71d tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:01:02.220384 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3ef7ba82-4905-4f7c-b6a6-cfc62c6ed71d tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:01:02.220769 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3ef7ba82-4905-4f7c-b6a6-cfc62c6ed71d tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:01:02.221203 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3ef7ba82-4905-4f7c-b6a6-cfc62c6ed71d tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:01:02.294610 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-3ef7ba82-4905-4f7c-b6a6-cfc62c6ed71d tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "POST /compute/v2.1/servers/74bcbcef-83c7-4be8-8681-490accdc8714/action" status: 202 len: 0 microversion: 2.1 time: 0.087408 Aug 27 04:01:02.295212 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3546/7140] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 04:01:02 2022] POST /compute/v2.1/servers/74bcbcef-83c7-4be8-8681-490accdc8714/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:01:02.306875 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0720ea82-d8e7-412b-97c4-73a9eb27cb3f tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:01:02.307818 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-0720ea82-d8e7-412b-97c4-73a9eb27cb3f tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 74bcbcef-83c7-4be8-8681-490accdc8714] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:01:02.317222 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0720ea82-d8e7-412b-97c4-73a9eb27cb3f tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:01:02.317838 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0720ea82-d8e7-412b-97c4-73a9eb27cb3f tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:01:02.318449 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0720ea82-d8e7-412b-97c4-73a9eb27cb3f tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:01:02.319253 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0720ea82-d8e7-412b-97c4-73a9eb27cb3f tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:01:02.319797 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0720ea82-d8e7-412b-97c4-73a9eb27cb3f tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:01:02.320293 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0720ea82-d8e7-412b-97c4-73a9eb27cb3f tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:01:02.562649 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-0720ea82-d8e7-412b-97c4-73a9eb27cb3f tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:01:02.571057 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-0720ea82-d8e7-412b-97c4-73a9eb27cb3f tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/74bcbcef-83c7-4be8-8681-490accdc8714" status: 200 len: 1680 microversion: 2.1 time: 0.269897 Aug 27 04:01:02.571687 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3595/7141] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:01:02 2022] GET /compute/v2.1/servers/74bcbcef-83c7-4be8-8681-490accdc8714 => generated 1680 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:01:03.594366 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4095ced4-2447-4b22-a561-e88824fb3fd8 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:01:03.595022 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-4095ced4-2447-4b22-a561-e88824fb3fd8 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 74bcbcef-83c7-4be8-8681-490accdc8714] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:01:03.602145 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4095ced4-2447-4b22-a561-e88824fb3fd8 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:01:03.602628 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4095ced4-2447-4b22-a561-e88824fb3fd8 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:01:03.603060 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4095ced4-2447-4b22-a561-e88824fb3fd8 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:01:03.603750 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4095ced4-2447-4b22-a561-e88824fb3fd8 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:01:03.604245 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4095ced4-2447-4b22-a561-e88824fb3fd8 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:01:03.604779 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4095ced4-2447-4b22-a561-e88824fb3fd8 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:01:03.751678 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-4095ced4-2447-4b22-a561-e88824fb3fd8 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:01:03.760746 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-4095ced4-2447-4b22-a561-e88824fb3fd8 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/74bcbcef-83c7-4be8-8681-490accdc8714" status: 200 len: 1680 microversion: 2.1 time: 0.171350 Aug 27 04:01:03.761335 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3547/7142] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:01:03 2022] GET /compute/v2.1/servers/74bcbcef-83c7-4be8-8681-490accdc8714 => generated 1680 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:01:04.782468 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-22780bd3-45d2-4c24-acdd-6bd6e89a9011 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:01:04.783148 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-22780bd3-45d2-4c24-acdd-6bd6e89a9011 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 74bcbcef-83c7-4be8-8681-490accdc8714] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:01:04.790626 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-22780bd3-45d2-4c24-acdd-6bd6e89a9011 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:01:04.791134 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-22780bd3-45d2-4c24-acdd-6bd6e89a9011 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:01:04.791588 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-22780bd3-45d2-4c24-acdd-6bd6e89a9011 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:01:04.792332 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-22780bd3-45d2-4c24-acdd-6bd6e89a9011 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:01:04.793157 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-22780bd3-45d2-4c24-acdd-6bd6e89a9011 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:01:04.793588 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-22780bd3-45d2-4c24-acdd-6bd6e89a9011 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:01:04.945403 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-22780bd3-45d2-4c24-acdd-6bd6e89a9011 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:01:04.953678 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-22780bd3-45d2-4c24-acdd-6bd6e89a9011 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/74bcbcef-83c7-4be8-8681-490accdc8714" status: 200 len: 1683 microversion: 2.1 time: 0.175354 Aug 27 04:01:04.954158 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3596/7143] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:01:04 2022] GET /compute/v2.1/servers/74bcbcef-83c7-4be8-8681-490accdc8714 => generated 1683 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:01:05.064605 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-32527685-bfea-4041-a98e-27340fdcdca8 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:01:05.066989 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-32527685-bfea-4041-a98e-27340fdcdca8 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 74bcbcef-83c7-4be8-8681-490accdc8714] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:01:05.077015 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-32527685-bfea-4041-a98e-27340fdcdca8 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:01:05.077632 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-32527685-bfea-4041-a98e-27340fdcdca8 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:01:05.078081 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-32527685-bfea-4041-a98e-27340fdcdca8 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:01:05.078982 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-32527685-bfea-4041-a98e-27340fdcdca8 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:01:05.079494 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-32527685-bfea-4041-a98e-27340fdcdca8 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:01:05.080024 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-32527685-bfea-4041-a98e-27340fdcdca8 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:01:05.124581 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-32527685-bfea-4041-a98e-27340fdcdca8 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "POST /compute/v2.1/servers/74bcbcef-83c7-4be8-8681-490accdc8714/action" status: 200 len: 35673 microversion: 2.1 time: 0.064054 Aug 27 04:01:05.125242 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3548/7144] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 04:01:05 2022] POST /compute/v2.1/servers/74bcbcef-83c7-4be8-8681-490accdc8714/action => generated 35673 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:01:06.237011 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ba460caa-f81e-4050-9ebb-52d0f516c8ae tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:01:06.237629 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-ba460caa-f81e-4050-9ebb-52d0f516c8ae tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 74bcbcef-83c7-4be8-8681-490accdc8714] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:01:06.238044 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-dcfb7a79-ae5a-43d7-aba7-837fa649cb10 req-04a29bbf-c33d-4c13-b110-ba7cda337894 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74bcbcef-83c7-4be8-8681-490accdc8714", "tag": "3376d240-48d4-477b-8fb1-cb1b0c7b2d86"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:01:06.245879 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ba460caa-f81e-4050-9ebb-52d0f516c8ae tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:01:06.246697 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ba460caa-f81e-4050-9ebb-52d0f516c8ae tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:01:06.247227 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ba460caa-f81e-4050-9ebb-52d0f516c8ae tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:01:06.248175 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ba460caa-f81e-4050-9ebb-52d0f516c8ae tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:01:06.248999 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ba460caa-f81e-4050-9ebb-52d0f516c8ae tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:01:06.249124 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-dcfb7a79-ae5a-43d7-aba7-837fa649cb10 req-04a29bbf-c33d-4c13-b110-ba7cda337894 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:01:06.249532 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ba460caa-f81e-4050-9ebb-52d0f516c8ae tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:01:06.249655 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-dcfb7a79-ae5a-43d7-aba7-837fa649cb10 req-04a29bbf-c33d-4c13-b110-ba7cda337894 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:01:06.250527 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-dcfb7a79-ae5a-43d7-aba7-837fa649cb10 req-04a29bbf-c33d-4c13-b110-ba7cda337894 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:01:06.264192 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-dcfb7a79-ae5a-43d7-aba7-837fa649cb10 req-04a29bbf-c33d-4c13-b110-ba7cda337894 service nova] Creating event network-changed:3376d240-48d4-477b-8fb1-cb1b0c7b2d86 for instance 74bcbcef-83c7-4be8-8681-490accdc8714 on n-h2-852278-4 Aug 27 04:01:06.270332 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-dcfb7a79-ae5a-43d7-aba7-837fa649cb10 req-04a29bbf-c33d-4c13-b110-ba7cda337894 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036427 Aug 27 04:01:06.271138 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3549/7145] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 04:01:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:01:06.276984 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-ba460caa-f81e-4050-9ebb-52d0f516c8ae tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 74bcbcef-83c7-4be8-8681-490accdc8714] Going to try to terminate instance {{(pid=134051) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:01:06.398411 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ba460caa-f81e-4050-9ebb-52d0f516c8ae tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "DELETE /compute/v2.1/servers/74bcbcef-83c7-4be8-8681-490accdc8714" status: 204 len: 0 microversion: 2.1 time: 0.165465 Aug 27 04:01:06.400856 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3597/7146] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 04:01:06 2022] DELETE /compute/v2.1/servers/74bcbcef-83c7-4be8-8681-490accdc8714 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:01:06.411089 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6a025001-aa83-4ca7-9994-2325f5c41d47 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:01:06.412356 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-6a025001-aa83-4ca7-9994-2325f5c41d47 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 74bcbcef-83c7-4be8-8681-490accdc8714] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:01:06.421114 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6a025001-aa83-4ca7-9994-2325f5c41d47 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:01:06.421824 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6a025001-aa83-4ca7-9994-2325f5c41d47 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:01:06.423210 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6a025001-aa83-4ca7-9994-2325f5c41d47 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:01:06.424339 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6a025001-aa83-4ca7-9994-2325f5c41d47 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:01:06.425126 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6a025001-aa83-4ca7-9994-2325f5c41d47 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:01:06.425803 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6a025001-aa83-4ca7-9994-2325f5c41d47 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:01:06.572718 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-6a025001-aa83-4ca7-9994-2325f5c41d47 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:01:06.582525 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-6a025001-aa83-4ca7-9994-2325f5c41d47 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/74bcbcef-83c7-4be8-8681-490accdc8714" status: 200 len: 1689 microversion: 2.1 time: 0.175754 Aug 27 04:01:06.583214 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3550/7147] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:01:06 2022] GET /compute/v2.1/servers/74bcbcef-83c7-4be8-8681-490accdc8714 => generated 1689 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:01:07.608100 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a7257bf8-7741-42fc-9eb2-96522efdaa9c tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:01:07.608897 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-a7257bf8-7741-42fc-9eb2-96522efdaa9c tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 74bcbcef-83c7-4be8-8681-490accdc8714] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:01:07.617289 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a7257bf8-7741-42fc-9eb2-96522efdaa9c tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:01:07.617852 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a7257bf8-7741-42fc-9eb2-96522efdaa9c tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:01:07.618434 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a7257bf8-7741-42fc-9eb2-96522efdaa9c tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:01:07.619166 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a7257bf8-7741-42fc-9eb2-96522efdaa9c tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:01:07.619630 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a7257bf8-7741-42fc-9eb2-96522efdaa9c tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:01:07.620067 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a7257bf8-7741-42fc-9eb2-96522efdaa9c tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:01:07.800212 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-a7257bf8-7741-42fc-9eb2-96522efdaa9c tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:01:07.810213 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a7257bf8-7741-42fc-9eb2-96522efdaa9c tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/74bcbcef-83c7-4be8-8681-490accdc8714" status: 200 len: 1689 microversion: 2.1 time: 0.208686 Aug 27 04:01:07.811137 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3598/7148] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:01:07 2022] GET /compute/v2.1/servers/74bcbcef-83c7-4be8-8681-490accdc8714 => generated 1689 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:01:08.598561 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-6936f9c2-c55d-4a96-b989-06043703563b req-5692fe78-97bb-4c3f-ae89-2679e7c3a45e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74bcbcef-83c7-4be8-8681-490accdc8714", "name": "network-vif-deleted", "tag": "3376d240-48d4-477b-8fb1-cb1b0c7b2d86"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:01:08.609418 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-6936f9c2-c55d-4a96-b989-06043703563b req-5692fe78-97bb-4c3f-ae89-2679e7c3a45e service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:01:08.609894 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-6936f9c2-c55d-4a96-b989-06043703563b req-5692fe78-97bb-4c3f-ae89-2679e7c3a45e service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:01:08.610334 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-6936f9c2-c55d-4a96-b989-06043703563b req-5692fe78-97bb-4c3f-ae89-2679e7c3a45e service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:01:08.622430 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-6936f9c2-c55d-4a96-b989-06043703563b req-5692fe78-97bb-4c3f-ae89-2679e7c3a45e service nova] Creating event network-vif-deleted:3376d240-48d4-477b-8fb1-cb1b0c7b2d86 for instance 74bcbcef-83c7-4be8-8681-490accdc8714 on n-h2-852278-4 Aug 27 04:01:08.627463 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-6936f9c2-c55d-4a96-b989-06043703563b req-5692fe78-97bb-4c3f-ae89-2679e7c3a45e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032728 Aug 27 04:01:08.628120 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3551/7149] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 04:01:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:01:08.833555 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ffbc0032-77c3-4d14-9c74-1bbb5f7fff63 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:01:08.834120 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-ffbc0032-77c3-4d14-9c74-1bbb5f7fff63 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 74bcbcef-83c7-4be8-8681-490accdc8714] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:01:08.841405 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ffbc0032-77c3-4d14-9c74-1bbb5f7fff63 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:01:08.841915 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ffbc0032-77c3-4d14-9c74-1bbb5f7fff63 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:01:08.842361 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ffbc0032-77c3-4d14-9c74-1bbb5f7fff63 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:01:08.843069 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ffbc0032-77c3-4d14-9c74-1bbb5f7fff63 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:01:08.843533 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ffbc0032-77c3-4d14-9c74-1bbb5f7fff63 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:01:08.843965 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ffbc0032-77c3-4d14-9c74-1bbb5f7fff63 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:01:08.884648 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ffbc0032-77c3-4d14-9c74-1bbb5f7fff63 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:01:08.885155 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ffbc0032-77c3-4d14-9c74-1bbb5f7fff63 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:01:08.885612 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ffbc0032-77c3-4d14-9c74-1bbb5f7fff63 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:01:08.886114 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.objects.instance [None req-ffbc0032-77c3-4d14-9c74-1bbb5f7fff63 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lazy-loading 'fault' on Instance uuid 74bcbcef-83c7-4be8-8681-490accdc8714 {{(pid=134051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:01:08.935843 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-ffbc0032-77c3-4d14-9c74-1bbb5f7fff63 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9a215fc244b839b2334274274675f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e5856cfda49f3a46a5db96d35050f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:01:08.945701 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ffbc0032-77c3-4d14-9c74-1bbb5f7fff63 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/74bcbcef-83c7-4be8-8681-490accdc8714" status: 200 len: 1357 microversion: 2.1 time: 0.116122 Aug 27 04:01:08.946486 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3599/7150] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:01:08 2022] GET /compute/v2.1/servers/74bcbcef-83c7-4be8-8681-490accdc8714 => generated 1357 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:01:09.972370 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b98e027e-4f2c-4929-a5b0-69bc7b25b121 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:01:09.973165 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b98e027e-4f2c-4929-a5b0-69bc7b25b121 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] [instance: 74bcbcef-83c7-4be8-8681-490accdc8714] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:01:09.980386 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b98e027e-4f2c-4929-a5b0-69bc7b25b121 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:01:09.980882 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b98e027e-4f2c-4929-a5b0-69bc7b25b121 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:01:09.981315 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b98e027e-4f2c-4929-a5b0-69bc7b25b121 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:01:09.982137 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b98e027e-4f2c-4929-a5b0-69bc7b25b121 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:01:09.982582 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b98e027e-4f2c-4929-a5b0-69bc7b25b121 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:01:09.983031 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b98e027e-4f2c-4929-a5b0-69bc7b25b121 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:01:09.997798 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-b98e027e-4f2c-4929-a5b0-69bc7b25b121 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] HTTP exception thrown: Instance 74bcbcef-83c7-4be8-8681-490accdc8714 could not be found. Aug 27 04:01:09.999466 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b98e027e-4f2c-4929-a5b0-69bc7b25b121 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Request method failure captured: Aug 27 04:01:09.999466 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/servers/74bcbcef-83c7-4be8-8681-490accdc8714 HTTP/1.1 Aug 27 04:01:09.999466 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 04:01:09.999466 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 04:01:09.999466 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 04:01:09.999466 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 04:01:09.999466 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 04:01:09.999466 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 04:01:09.999466 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 04:01:09.999466 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 04:01:09.999466 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCZU37KUCPlLNPa46uoYyHww48hoe3u_z-BgLN9g-oq2tOv22Rtnsjni3NQSTpUSFvnqw-iilMtJmmXNN3mDjBxOFqxVi8ULOCUVZBgtRQ3Q2tRHScCw5ed_FU_gznAbg4sRYwVid01sApcIv5MJUox6pjFVHV0WUHFDPrPNCAXQKHo4 Aug 27 04:01:09.999466 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 04:01:09.999466 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 04:01:09.999466 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 04:01:09.999466 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 04:01:09.999466 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 04:01:09.999466 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 04:01:09.999466 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 961e5856cfda49f3a46a5db96d35050f Aug 27 04:01:09.999466 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-967904917 Aug 27 04:01:09.999466 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 04:01:09.999466 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 04:01:09.999466 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/961e5856cfda49f3a46a5db96d35050f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_961e5856cfda49f3a46a5db96d35050f", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/961e5856cfda49f3a46a5db96d35050f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/961e5856cfda49f3a46a5db96d35050f"}]}] Aug 27 04:01:09.999466 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-TestNetworkAdvancedServerOps-967904917 Aug 27 04:01:09.999466 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 961e5856cfda49f3a46a5db96d35050f Aug 27 04:01:09.999466 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-967904917 Aug 27 04:01:09.999466 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-TestNetworkAdvancedServerOps-967904917-project Aug 27 04:01:09.999466 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 04:01:09.999466 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 04:01:09.999466 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: 4dd9a215fc244b839b2334274274675f Aug 27 04:01:09.999466 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-TestNetworkAdvancedServerOps-967904917-project Aug 27 04:01:09.999466 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 04:01:09.999466 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance 74bcbcef-83c7-4be8-8681-490accdc8714 could not be found. Aug 27 04:01:09.999466 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '74bcbcef-83c7-4be8-8681-490accdc8714'} Aug 27 04:01:09.999466 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:01:09.999466 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:01:09.999466 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:01:09.999466 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:01:09.999466 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:01:09.999466 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:01:09.999466 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:01:09.999466 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:01:09.999466 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:01:09.999466 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:01:09.999466 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74bcbcef-83c7-4be8-8681-490accdc8714 could not be found. Aug 27 04:01:09.999466 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 04:01:09.999466 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:01:09.999466 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 04:01:09.999466 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:01:09.999466 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:01:09.999466 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:01:09.999466 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:01:09.999466 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:01:09.999466 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:01:09.999466 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:01:09.999466 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:01:09.999466 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:01:09.999466 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:01:09.999466 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:01:09.999466 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:01:09.999466 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:01:09.999466 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74bcbcef-83c7-4be8-8681-490accdc8714 could not be found. Aug 27 04:01:09.999466 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 04:01:09.999466 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:01:10.004336 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 04:01:10.004336 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:01:10.004336 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:01:10.004336 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:01:10.004336 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:01:10.004336 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:01:10.004336 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74bcbcef-83c7-4be8-8681-490accdc8714 could not be found. Aug 27 04:01:10.004336 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 04:01:10.004336 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b98e027e-4f2c-4929-a5b0-69bc7b25b121 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Returning 404 to user: Instance 74bcbcef-83c7-4be8-8681-490accdc8714 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:01:10.004336 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b98e027e-4f2c-4929-a5b0-69bc7b25b121 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "GET /compute/v2.1/servers/74bcbcef-83c7-4be8-8681-490accdc8714" status: 404 len: 111 microversion: 2.1 time: 0.035270 Aug 27 04:01:10.004336 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3552/7151] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:01:09 2022] GET /compute/v2.1/servers/74bcbcef-83c7-4be8-8681-490accdc8714 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:01:13.490916 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8a163f5c-6a9d-41d5-b4de-67a5b70f57d5 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] Calling method '.version_select at 0x7f5edda2d8b0>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:01:13.518061 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-8a163f5c-6a9d-41d5-b4de-67a5b70f57d5 tempest-TestNetworkAdvancedServerOps-967904917 tempest-TestNetworkAdvancedServerOps-967904917-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2031501971" status: 202 len: 0 microversion: 2.1 time: 0.031117 Aug 27 04:01:13.518979 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3600/7152] 10.222.0.70 () {58 vars in 1284 bytes} [Sat Aug 27 04:01:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2031501971 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:01:26.103828 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=18 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:01:26.104645 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:01:26.320481 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-850f166c-440d-447e-b75a-e714ed7a12c9 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Action: 'create', calling method: .version_select at 0x7f5ee3490e50>, body: {"keypair": {"name": "tempest-TestShelveInstance-1317715412", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGFUSqyy5U0EgrfM+lCO3pna0JwCNBn8LLuUt9O8RCiSIMopu5N3bSHJcoFbJt65OwzbX9Z5FSu2ZkLaFv5XFToHD+iHHU0SCkTbmpr0VQ5W3onCvXKJwhux5i8ubAk+Zg=="}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:01:26.342666 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-850f166c-440d-447e-b75a-e714ed7a12c9 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Getting quotas for project f738d5571a8d4f7eb9fbc7c51dfe03d2. Resources: {'key_pairs'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:01:26.355284 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-850f166c-440d-447e-b75a-e714ed7a12c9 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Getting quotas for user b11beacbd367449d909a0512301b31d2 and project f738d5571a8d4f7eb9fbc7c51dfe03d2. Resources: {'key_pairs'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:01:26.391090 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-850f166c-440d-447e-b75a-e714ed7a12c9 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.292446 Aug 27 04:01:26.392268 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3553/7153] 10.222.0.70 () {60 vars in 1159 bytes} [Sat Aug 27 04:01:26 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:01:27.567028 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:01:27.568003 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:01:27.572432 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-8fe6e997-ec09-440d-9746-b5db05f2ec57 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-703231833", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1317715412", "security_groups": [{"name": "tempest-secgroup-smoke-1596849276"}], "networks": [{"uuid": "9e89052a-3731-46a3-bec7-6298ea2e50ce"}]}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:01:27.691668 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.network.neutron [None req-8fe6e997-ec09-440d-9746-b5db05f2ec57 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] validate_networks() for [('9e89052a-3731-46a3-bec7-6298ea2e50ce', None, None, None, None, None)] {{(pid=134051) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:01:28.132505 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-8fe6e997-ec09-440d-9746-b5db05f2ec57 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Flavor limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:01:28.132929 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-8fe6e997-ec09-440d-9746-b5db05f2ec57 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Image limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:01:28.133408 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-8fe6e997-ec09-440d-9746-b5db05f2ec57 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Flavor pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:01:28.133824 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-8fe6e997-ec09-440d-9746-b5db05f2ec57 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Image pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:01:28.134251 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-8fe6e997-ec09-440d-9746-b5db05f2ec57 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:01:28.143765 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8fe6e997-ec09-440d-9746-b5db05f2ec57 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:01:28.144256 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8fe6e997-ec09-440d-9746-b5db05f2ec57 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:01:28.144738 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8fe6e997-ec09-440d-9746-b5db05f2ec57 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:01:28.145469 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8fe6e997-ec09-440d-9746-b5db05f2ec57 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:01:28.146158 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8fe6e997-ec09-440d-9746-b5db05f2ec57 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:01:28.146908 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-8fe6e997-ec09-440d-9746-b5db05f2ec57 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:01:28.164637 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-8fe6e997-ec09-440d-9746-b5db05f2ec57 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Getting quotas for project f738d5571a8d4f7eb9fbc7c51dfe03d2. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:01:28.170728 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-8fe6e997-ec09-440d-9746-b5db05f2ec57 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Getting quotas for user b11beacbd367449d909a0512301b31d2 and project f738d5571a8d4f7eb9fbc7c51dfe03d2. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:01:28.183591 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-8fe6e997-ec09-440d-9746-b5db05f2ec57 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Going to run 1 instances... {{(pid=134051) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:01:28.186006 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-8fe6e997-ec09-440d-9746-b5db05f2ec57 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134051) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:01:28.238191 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-8fe6e997-ec09-440d-9746-b5db05f2ec57 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.673061 Aug 27 04:01:28.239087 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3601/7154] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 04:01:27 2022] POST /compute/v2.1/servers => generated 406 bytes in 675 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 04:01:28.256564 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6ba533bf-7cf7-471b-aea4-257e7d9d02a1 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:01:28.257757 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-6ba533bf-7cf7-471b-aea4-257e7d9d02a1 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:01:28.322616 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-6ba533bf-7cf7-471b-aea4-257e7d9d02a1 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11beacbd367449d909a0512301b31d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738d5571a8d4f7eb9fbc7c51dfe03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:01:28.330682 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-6ba533bf-7cf7-471b-aea4-257e7d9d02a1 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "GET /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae" status: 200 len: 1246 microversion: 2.1 time: 0.083894 Aug 27 04:01:28.331249 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3554/7155] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:01:28 2022] GET /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae => generated 1246 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:01:29.354131 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-5679f5a8-fbdd-475e-b379-0f76b93043eb tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:01:29.355301 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-5679f5a8-fbdd-475e-b379-0f76b93043eb tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:01:29.446213 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-5679f5a8-fbdd-475e-b379-0f76b93043eb tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11beacbd367449d909a0512301b31d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738d5571a8d4f7eb9fbc7c51dfe03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:01:29.454061 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-5679f5a8-fbdd-475e-b379-0f76b93043eb tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "GET /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae" status: 200 len: 1246 microversion: 2.1 time: 0.106232 Aug 27 04:01:29.455011 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3602/7156] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:01:29 2022] GET /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae => generated 1246 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:01:30.478817 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3eef25db-6c87-4c62-948d-dc57d15cce98 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:01:30.479791 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-3eef25db-6c87-4c62-948d-dc57d15cce98 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:01:30.554849 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-3eef25db-6c87-4c62-948d-dc57d15cce98 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11beacbd367449d909a0512301b31d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738d5571a8d4f7eb9fbc7c51dfe03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:01:30.564993 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-3eef25db-6c87-4c62-948d-dc57d15cce98 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "GET /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae" status: 200 len: 1246 microversion: 2.1 time: 0.092227 Aug 27 04:01:30.566682 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3555/7157] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:01:30 2022] GET /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae => generated 1246 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:01:31.588146 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3d7d325f-f132-45da-b52f-bc87e99a7607 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:01:31.588827 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-3d7d325f-f132-45da-b52f-bc87e99a7607 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:01:31.645678 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-3d7d325f-f132-45da-b52f-bc87e99a7607 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11beacbd367449d909a0512301b31d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738d5571a8d4f7eb9fbc7c51dfe03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:01:31.653295 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-3d7d325f-f132-45da-b52f-bc87e99a7607 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "GET /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae" status: 200 len: 1246 microversion: 2.1 time: 0.069800 Aug 27 04:01:31.653896 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3603/7158] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:01:31 2022] GET /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae => generated 1246 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:01:32.675665 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a0b17cd1-6d04-48d6-9f8a-0043812c9a8c tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:01:32.676234 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a0b17cd1-6d04-48d6-9f8a-0043812c9a8c tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:01:32.683798 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a0b17cd1-6d04-48d6-9f8a-0043812c9a8c tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:01:32.684293 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a0b17cd1-6d04-48d6-9f8a-0043812c9a8c tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:01:32.684765 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a0b17cd1-6d04-48d6-9f8a-0043812c9a8c tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:01:32.685470 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a0b17cd1-6d04-48d6-9f8a-0043812c9a8c tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:01:32.685919 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a0b17cd1-6d04-48d6-9f8a-0043812c9a8c tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:01:32.686341 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a0b17cd1-6d04-48d6-9f8a-0043812c9a8c tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:01:32.750614 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-a0b17cd1-6d04-48d6-9f8a-0043812c9a8c tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11beacbd367449d909a0512301b31d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738d5571a8d4f7eb9fbc7c51dfe03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:01:32.759288 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a0b17cd1-6d04-48d6-9f8a-0043812c9a8c tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "GET /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae" status: 200 len: 1250 microversion: 2.1 time: 0.087843 Aug 27 04:01:32.759882 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3556/7159] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:01:32 2022] GET /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae => generated 1250 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:01:33.782455 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-657791c8-fc8b-4a43-9c87-b220e8918bf2 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:01:33.783234 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-657791c8-fc8b-4a43-9c87-b220e8918bf2 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:01:33.791134 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-657791c8-fc8b-4a43-9c87-b220e8918bf2 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:01:33.791635 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-657791c8-fc8b-4a43-9c87-b220e8918bf2 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:01:33.792085 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-657791c8-fc8b-4a43-9c87-b220e8918bf2 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:01:33.793191 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-657791c8-fc8b-4a43-9c87-b220e8918bf2 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:01:33.793629 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-657791c8-fc8b-4a43-9c87-b220e8918bf2 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:01:33.794232 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-657791c8-fc8b-4a43-9c87-b220e8918bf2 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:01:33.863230 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-657791c8-fc8b-4a43-9c87-b220e8918bf2 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11beacbd367449d909a0512301b31d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738d5571a8d4f7eb9fbc7c51dfe03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:01:33.871165 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-657791c8-fc8b-4a43-9c87-b220e8918bf2 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "GET /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae" status: 200 len: 1304 microversion: 2.1 time: 0.093563 Aug 27 04:01:33.871768 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3604/7160] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:01:33 2022] GET /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae => generated 1304 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:01:34.894298 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-50095b46-c8d4-436f-8435-af1254e42557 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:01:34.895138 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-50095b46-c8d4-436f-8435-af1254e42557 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:01:34.902790 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-50095b46-c8d4-436f-8435-af1254e42557 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:01:34.903276 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-50095b46-c8d4-436f-8435-af1254e42557 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:01:34.903809 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-50095b46-c8d4-436f-8435-af1254e42557 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:01:34.904562 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-50095b46-c8d4-436f-8435-af1254e42557 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:01:34.905185 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-50095b46-c8d4-436f-8435-af1254e42557 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:01:34.905433 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-50095b46-c8d4-436f-8435-af1254e42557 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:01:35.099622 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-50095b46-c8d4-436f-8435-af1254e42557 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11beacbd367449d909a0512301b31d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738d5571a8d4f7eb9fbc7c51dfe03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:01:35.108578 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-50095b46-c8d4-436f-8435-af1254e42557 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "GET /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae" status: 200 len: 1372 microversion: 2.1 time: 0.218302 Aug 27 04:01:35.109193 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3557/7161] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:01:34 2022] GET /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae => generated 1372 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:01:35.232090 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-21f2d597-026c-4033-972a-3d82e0a1d727 req-6e718e6f-d0dc-42b4-908d-12f5ec0cc941 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae", "tag": "4ad5abbb-9361-463e-be45-0b499f50c9bd"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:01:35.242329 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-21f2d597-026c-4033-972a-3d82e0a1d727 req-6e718e6f-d0dc-42b4-908d-12f5ec0cc941 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:01:35.242824 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-21f2d597-026c-4033-972a-3d82e0a1d727 req-6e718e6f-d0dc-42b4-908d-12f5ec0cc941 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:01:35.243270 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-21f2d597-026c-4033-972a-3d82e0a1d727 req-6e718e6f-d0dc-42b4-908d-12f5ec0cc941 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:01:35.256073 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-21f2d597-026c-4033-972a-3d82e0a1d727 req-6e718e6f-d0dc-42b4-908d-12f5ec0cc941 service nova] Creating event network-changed:4ad5abbb-9361-463e-be45-0b499f50c9bd for instance 21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae on n-h1-852278-4 Aug 27 04:01:35.261519 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-21f2d597-026c-4033-972a-3d82e0a1d727 req-6e718e6f-d0dc-42b4-908d-12f5ec0cc941 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120365 Aug 27 04:01:35.262137 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3605/7162] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 04:01:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:01:36.135974 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-57e8bc6b-214a-4c00-9810-350345c35243 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:01:36.136703 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-57e8bc6b-214a-4c00-9810-350345c35243 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:01:36.143995 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-57e8bc6b-214a-4c00-9810-350345c35243 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:01:36.144522 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-57e8bc6b-214a-4c00-9810-350345c35243 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:01:36.144965 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-57e8bc6b-214a-4c00-9810-350345c35243 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:01:36.145674 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-57e8bc6b-214a-4c00-9810-350345c35243 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:01:36.146126 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-57e8bc6b-214a-4c00-9810-350345c35243 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:01:36.146553 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-57e8bc6b-214a-4c00-9810-350345c35243 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:01:36.286766 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-57e8bc6b-214a-4c00-9810-350345c35243 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11beacbd367449d909a0512301b31d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738d5571a8d4f7eb9fbc7c51dfe03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:01:36.295887 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-57e8bc6b-214a-4c00-9810-350345c35243 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "GET /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae" status: 200 len: 1372 microversion: 2.1 time: 0.163860 Aug 27 04:01:36.296551 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3558/7163] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:01:36 2022] GET /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae => generated 1372 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:01:37.319704 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f5d10ed4-5221-4a02-b03a-afe733ea6024 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:01:37.320483 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-f5d10ed4-5221-4a02-b03a-afe733ea6024 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:01:37.327743 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f5d10ed4-5221-4a02-b03a-afe733ea6024 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:01:37.328336 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f5d10ed4-5221-4a02-b03a-afe733ea6024 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:01:37.328789 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f5d10ed4-5221-4a02-b03a-afe733ea6024 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:01:37.329654 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f5d10ed4-5221-4a02-b03a-afe733ea6024 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:01:37.330121 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f5d10ed4-5221-4a02-b03a-afe733ea6024 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:01:37.330555 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f5d10ed4-5221-4a02-b03a-afe733ea6024 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:01:37.481551 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-f5d10ed4-5221-4a02-b03a-afe733ea6024 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11beacbd367449d909a0512301b31d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738d5571a8d4f7eb9fbc7c51dfe03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:01:37.489830 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-f5d10ed4-5221-4a02-b03a-afe733ea6024 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "GET /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae" status: 200 len: 1372 microversion: 2.1 time: 0.176505 Aug 27 04:01:37.490400 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3606/7164] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:01:37 2022] GET /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae => generated 1372 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:01:38.512559 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d6e4dc43-21d9-4a87-a681-fe99f427bb2b tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:01:38.513168 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d6e4dc43-21d9-4a87-a681-fe99f427bb2b tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:01:38.520445 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d6e4dc43-21d9-4a87-a681-fe99f427bb2b tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:01:38.520963 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d6e4dc43-21d9-4a87-a681-fe99f427bb2b tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:01:38.521400 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d6e4dc43-21d9-4a87-a681-fe99f427bb2b tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:01:38.522102 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d6e4dc43-21d9-4a87-a681-fe99f427bb2b tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:01:38.522557 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d6e4dc43-21d9-4a87-a681-fe99f427bb2b tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:01:38.522976 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d6e4dc43-21d9-4a87-a681-fe99f427bb2b tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:01:38.672458 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-d6e4dc43-21d9-4a87-a681-fe99f427bb2b tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11beacbd367449d909a0512301b31d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738d5571a8d4f7eb9fbc7c51dfe03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:01:38.681484 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d6e4dc43-21d9-4a87-a681-fe99f427bb2b tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "GET /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae" status: 200 len: 1372 microversion: 2.1 time: 0.172956 Aug 27 04:01:38.682088 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3559/7165] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:01:38 2022] GET /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae => generated 1372 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:01:39.702684 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-2899bdcf-8416-492f-ae7a-a2fa646ddaf1 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:01:39.703414 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-2899bdcf-8416-492f-ae7a-a2fa646ddaf1 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:01:39.705792 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:01:39.712563 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2899bdcf-8416-492f-ae7a-a2fa646ddaf1 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:01:39.713070 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2899bdcf-8416-492f-ae7a-a2fa646ddaf1 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:01:39.713517 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2899bdcf-8416-492f-ae7a-a2fa646ddaf1 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:01:39.714241 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2899bdcf-8416-492f-ae7a-a2fa646ddaf1 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:01:39.714702 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2899bdcf-8416-492f-ae7a-a2fa646ddaf1 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:01:39.715137 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2899bdcf-8416-492f-ae7a-a2fa646ddaf1 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:01:39.864006 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-2899bdcf-8416-492f-ae7a-a2fa646ddaf1 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11beacbd367449d909a0512301b31d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738d5571a8d4f7eb9fbc7c51dfe03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:01:39.872279 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-2899bdcf-8416-492f-ae7a-a2fa646ddaf1 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "GET /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae" status: 200 len: 1372 microversion: 2.1 time: 0.173944 Aug 27 04:01:39.872960 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3607/7166] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:01:39 2022] GET /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae => generated 1372 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:01:40.817514 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-1e99ebf8-f9da-4a7e-9976-d6cec8600da7 req-c5cfe754-99ff-489b-b50c-90fede387a9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae", "name": "network-vif-plugged", "status": "completed", "tag": "4ad5abbb-9361-463e-be45-0b499f50c9bd"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:01:40.823611 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=8 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:01:40.830161 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-1e99ebf8-f9da-4a7e-9976-d6cec8600da7 req-c5cfe754-99ff-489b-b50c-90fede387a9e service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:01:40.830650 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-1e99ebf8-f9da-4a7e-9976-d6cec8600da7 req-c5cfe754-99ff-489b-b50c-90fede387a9e service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:01:40.831081 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-1e99ebf8-f9da-4a7e-9976-d6cec8600da7 req-c5cfe754-99ff-489b-b50c-90fede387a9e service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:01:40.843304 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-1e99ebf8-f9da-4a7e-9976-d6cec8600da7 req-c5cfe754-99ff-489b-b50c-90fede387a9e service nova] Creating event network-vif-plugged:4ad5abbb-9361-463e-be45-0b499f50c9bd for instance 21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae on n-h1-852278-4 Aug 27 04:01:40.848880 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-1e99ebf8-f9da-4a7e-9976-d6cec8600da7 req-c5cfe754-99ff-489b-b50c-90fede387a9e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035100 Aug 27 04:01:40.849539 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3560/7167] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 04:01:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:01:40.906705 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-84a71fdc-9051-4588-ad82-c83ad40ccbb7 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:01:40.908420 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-84a71fdc-9051-4588-ad82-c83ad40ccbb7 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:01:40.918698 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-84a71fdc-9051-4588-ad82-c83ad40ccbb7 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:01:40.919863 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-84a71fdc-9051-4588-ad82-c83ad40ccbb7 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:01:40.920940 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-84a71fdc-9051-4588-ad82-c83ad40ccbb7 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:01:40.922324 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-84a71fdc-9051-4588-ad82-c83ad40ccbb7 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:01:40.923307 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-84a71fdc-9051-4588-ad82-c83ad40ccbb7 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:01:40.924216 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-84a71fdc-9051-4588-ad82-c83ad40ccbb7 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:01:41.130081 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-84a71fdc-9051-4588-ad82-c83ad40ccbb7 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11beacbd367449d909a0512301b31d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738d5571a8d4f7eb9fbc7c51dfe03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:01:41.138616 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-84a71fdc-9051-4588-ad82-c83ad40ccbb7 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "GET /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae" status: 200 len: 1372 microversion: 2.1 time: 0.245739 Aug 27 04:01:41.139338 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3608/7168] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:01:40 2022] GET /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae => generated 1372 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:01:42.162823 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-dea39591-385d-4061-b93c-e8233d043d80 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:01:42.164037 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-dea39591-385d-4061-b93c-e8233d043d80 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:01:42.171949 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dea39591-385d-4061-b93c-e8233d043d80 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:01:42.172462 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dea39591-385d-4061-b93c-e8233d043d80 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:01:42.172955 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dea39591-385d-4061-b93c-e8233d043d80 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:01:42.173678 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dea39591-385d-4061-b93c-e8233d043d80 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:01:42.174130 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dea39591-385d-4061-b93c-e8233d043d80 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:01:42.174532 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dea39591-385d-4061-b93c-e8233d043d80 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:01:42.317594 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-dea39591-385d-4061-b93c-e8233d043d80 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11beacbd367449d909a0512301b31d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738d5571a8d4f7eb9fbc7c51dfe03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:01:42.326026 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-dea39591-385d-4061-b93c-e8233d043d80 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "GET /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae" status: 200 len: 1556 microversion: 2.1 time: 0.170189 Aug 27 04:01:42.326670 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3561/7169] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:01:42 2022] GET /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae => generated 1556 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:01:42.346448 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f09d0b98-2d39-4275-b950-95dce3bdc513 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:01:42.347218 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-f09d0b98-2d39-4275-b950-95dce3bdc513 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:01:42.349247 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=10 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:01:42.356231 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f09d0b98-2d39-4275-b950-95dce3bdc513 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:01:42.356783 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f09d0b98-2d39-4275-b950-95dce3bdc513 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:01:42.357237 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f09d0b98-2d39-4275-b950-95dce3bdc513 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:01:42.357968 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f09d0b98-2d39-4275-b950-95dce3bdc513 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:01:42.358438 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f09d0b98-2d39-4275-b950-95dce3bdc513 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:01:42.358879 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f09d0b98-2d39-4275-b950-95dce3bdc513 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:01:42.496864 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-f09d0b98-2d39-4275-b950-95dce3bdc513 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11beacbd367449d909a0512301b31d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738d5571a8d4f7eb9fbc7c51dfe03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:01:42.505234 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-f09d0b98-2d39-4275-b950-95dce3bdc513 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "GET /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae" status: 200 len: 1556 microversion: 2.1 time: 0.163033 Aug 27 04:01:42.505849 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3609/7170] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:01:42 2022] GET /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae => generated 1556 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:01:44.234680 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-e5bf3c81-7a87-4cb3-9032-ca4df24045f3 req-025d7497-d9fb-4c16-98a9-ae2930260db4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae", "tag": "4ad5abbb-9361-463e-be45-0b499f50c9bd"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:01:44.245999 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-e5bf3c81-7a87-4cb3-9032-ca4df24045f3 req-025d7497-d9fb-4c16-98a9-ae2930260db4 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:01:44.246479 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-e5bf3c81-7a87-4cb3-9032-ca4df24045f3 req-025d7497-d9fb-4c16-98a9-ae2930260db4 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:01:44.247577 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-e5bf3c81-7a87-4cb3-9032-ca4df24045f3 req-025d7497-d9fb-4c16-98a9-ae2930260db4 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:01:44.260571 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-e5bf3c81-7a87-4cb3-9032-ca4df24045f3 req-025d7497-d9fb-4c16-98a9-ae2930260db4 service nova] Creating event network-changed:4ad5abbb-9361-463e-be45-0b499f50c9bd for instance 21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae on n-h1-852278-4 Aug 27 04:01:44.266519 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-e5bf3c81-7a87-4cb3-9032-ca4df24045f3 req-025d7497-d9fb-4c16-98a9-ae2930260db4 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035477 Aug 27 04:01:44.267160 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3562/7171] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 04:01:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:03:39.411562 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:03:39.412716 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=34 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:03:39.414389 n-d-852278-4 devstack@n-api.service[134051]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Aug 27 04:03:39.416739 n-d-852278-4 devstack@n-api.service[134051]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Aug 27 04:03:39.418061 n-d-852278-4 devstack@n-api.service[134051]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Aug 27 04:03:39.425080 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-60f0c723-46bd-42fc-879c-b2a08c1e5f64 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:03:39.425885 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-60f0c723-46bd-42fc-879c-b2a08c1e5f64 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:03:39.439135 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-60f0c723-46bd-42fc-879c-b2a08c1e5f64 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:39.439635 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-60f0c723-46bd-42fc-879c-b2a08c1e5f64 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:39.440191 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-60f0c723-46bd-42fc-879c-b2a08c1e5f64 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:39.440875 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-60f0c723-46bd-42fc-879c-b2a08c1e5f64 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:39.441440 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-60f0c723-46bd-42fc-879c-b2a08c1e5f64 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:39.441881 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-60f0c723-46bd-42fc-879c-b2a08c1e5f64 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:39.465515 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.objects.instance [None req-60f0c723-46bd-42fc-879c-b2a08c1e5f64 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lazy-loading 'flavor' on Instance uuid 21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae {{(pid=134051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:03:39.821812 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-60f0c723-46bd-42fc-879c-b2a08c1e5f64 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "POST /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae/action" status: 202 len: 0 microversion: 2.1 time: 0.413491 Aug 27 04:03:39.822466 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3610/7172] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 04:03:39 2022] POST /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae/action => generated 0 bytes in 416 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:03:39.829758 n-d-852278-4 devstack@n-api.service[134052]: ERROR oslo.messaging._drivers.impl_rabbit [-] [998cde6e-8682-4408-bcc9-d1ac55bd7468] AMQP server on 10.222.0.70:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 27 04:03:39.830438 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:03:39.831287 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=34 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:03:39.833009 n-d-852278-4 devstack@n-api.service[134052]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:03:39.833156 n-d-852278-4 devstack@n-api.service[134052]: Sat Aug 27 04:03:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae (ip 10.222.0.70) !!! Aug 27 04:03:39.838888 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d28eed2f-06ca-4931-9ce2-b9d9774ab2c1 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:39.839801 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d28eed2f-06ca-4931-9ce2-b9d9774ab2c1 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:03:39.850031 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d28eed2f-06ca-4931-9ce2-b9d9774ab2c1 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:39.850629 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d28eed2f-06ca-4931-9ce2-b9d9774ab2c1 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:39.851138 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d28eed2f-06ca-4931-9ce2-b9d9774ab2c1 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:39.851901 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d28eed2f-06ca-4931-9ce2-b9d9774ab2c1 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:39.852678 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d28eed2f-06ca-4931-9ce2-b9d9774ab2c1 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:39.853207 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d28eed2f-06ca-4931-9ce2-b9d9774ab2c1 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:40.045870 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-d28eed2f-06ca-4931-9ce2-b9d9774ab2c1 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11beacbd367449d909a0512301b31d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738d5571a8d4f7eb9fbc7c51dfe03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:40.054183 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d28eed2f-06ca-4931-9ce2-b9d9774ab2c1 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "GET /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae" status: 200 len: 1680 microversion: 2.1 time: 0.226923 Aug 27 04:03:40.054992 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3563/7173] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:03:39 2022] GET /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae => generated 1680 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:41.082632 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3b4d6400-da52-4d99-b176-b2b49ba45aa1 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:41.083472 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-3b4d6400-da52-4d99-b176-b2b49ba45aa1 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:03:41.094261 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3b4d6400-da52-4d99-b176-b2b49ba45aa1 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:41.095427 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3b4d6400-da52-4d99-b176-b2b49ba45aa1 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:41.096075 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3b4d6400-da52-4d99-b176-b2b49ba45aa1 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:41.096907 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3b4d6400-da52-4d99-b176-b2b49ba45aa1 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:41.097124 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3b4d6400-da52-4d99-b176-b2b49ba45aa1 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:41.097543 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3b4d6400-da52-4d99-b176-b2b49ba45aa1 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:41.244394 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-3b4d6400-da52-4d99-b176-b2b49ba45aa1 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11beacbd367449d909a0512301b31d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738d5571a8d4f7eb9fbc7c51dfe03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:41.256488 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-3b4d6400-da52-4d99-b176-b2b49ba45aa1 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "GET /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae" status: 200 len: 1680 microversion: 2.1 time: 0.182457 Aug 27 04:03:41.257364 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3611/7174] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:03:41 2022] GET /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae => generated 1680 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:42.284153 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-cd219dac-f515-40dc-adde-70a50a6ad94e tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:42.284963 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-cd219dac-f515-40dc-adde-70a50a6ad94e tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:03:42.296931 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cd219dac-f515-40dc-adde-70a50a6ad94e tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:42.297682 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cd219dac-f515-40dc-adde-70a50a6ad94e tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:42.298259 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cd219dac-f515-40dc-adde-70a50a6ad94e tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:42.299329 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cd219dac-f515-40dc-adde-70a50a6ad94e tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:42.300035 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cd219dac-f515-40dc-adde-70a50a6ad94e tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:42.300706 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cd219dac-f515-40dc-adde-70a50a6ad94e tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:42.309473 n-d-852278-4 devstack@n-api.service[134052]: INFO oslo.messaging._drivers.impl_rabbit [-] [998cde6e-8682-4408-bcc9-d1ac55bd7468] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 59622. Aug 27 04:03:42.442567 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-cd219dac-f515-40dc-adde-70a50a6ad94e tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11beacbd367449d909a0512301b31d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738d5571a8d4f7eb9fbc7c51dfe03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:42.453833 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-cd219dac-f515-40dc-adde-70a50a6ad94e tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "GET /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae" status: 200 len: 1680 microversion: 2.1 time: 0.176097 Aug 27 04:03:42.454657 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3564/7175] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:03:42 2022] GET /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae => generated 1680 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:43.478751 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e7374a20-9907-404a-b419-3fd8674ac0f8 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:43.479376 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-e7374a20-9907-404a-b419-3fd8674ac0f8 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:03:43.486763 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e7374a20-9907-404a-b419-3fd8674ac0f8 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:43.487270 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e7374a20-9907-404a-b419-3fd8674ac0f8 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:43.487722 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e7374a20-9907-404a-b419-3fd8674ac0f8 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:43.488488 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e7374a20-9907-404a-b419-3fd8674ac0f8 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:43.488953 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e7374a20-9907-404a-b419-3fd8674ac0f8 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:43.489387 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e7374a20-9907-404a-b419-3fd8674ac0f8 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:43.626184 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e7374a20-9907-404a-b419-3fd8674ac0f8 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11beacbd367449d909a0512301b31d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738d5571a8d4f7eb9fbc7c51dfe03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:43.634720 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e7374a20-9907-404a-b419-3fd8674ac0f8 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "GET /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae" status: 200 len: 1680 microversion: 2.1 time: 0.159972 Aug 27 04:03:43.635331 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3612/7176] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:03:43 2022] GET /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:44.657584 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-7ffc9e08-ff31-487d-b832-5434a13f5475 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:44.658166 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-7ffc9e08-ff31-487d-b832-5434a13f5475 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:03:44.665608 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7ffc9e08-ff31-487d-b832-5434a13f5475 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:44.666418 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7ffc9e08-ff31-487d-b832-5434a13f5475 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:44.666886 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7ffc9e08-ff31-487d-b832-5434a13f5475 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:44.667590 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7ffc9e08-ff31-487d-b832-5434a13f5475 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:44.668042 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7ffc9e08-ff31-487d-b832-5434a13f5475 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:44.668534 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7ffc9e08-ff31-487d-b832-5434a13f5475 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:44.817806 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-7ffc9e08-ff31-487d-b832-5434a13f5475 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11beacbd367449d909a0512301b31d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738d5571a8d4f7eb9fbc7c51dfe03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:44.830131 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-7ffc9e08-ff31-487d-b832-5434a13f5475 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "GET /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae" status: 200 len: 1680 microversion: 2.1 time: 0.176841 Aug 27 04:03:44.831016 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3565/7177] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:03:44 2022] GET /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae => generated 1680 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:45.859071 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d3d3a76b-5211-4837-aa66-71b21e26807d tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:45.859757 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d3d3a76b-5211-4837-aa66-71b21e26807d tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:03:45.867488 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d3d3a76b-5211-4837-aa66-71b21e26807d tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:45.868018 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d3d3a76b-5211-4837-aa66-71b21e26807d tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:45.868535 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d3d3a76b-5211-4837-aa66-71b21e26807d tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:45.869286 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d3d3a76b-5211-4837-aa66-71b21e26807d tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:45.869779 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d3d3a76b-5211-4837-aa66-71b21e26807d tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:45.870236 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d3d3a76b-5211-4837-aa66-71b21e26807d tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:46.007891 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d3d3a76b-5211-4837-aa66-71b21e26807d tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11beacbd367449d909a0512301b31d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738d5571a8d4f7eb9fbc7c51dfe03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:46.016282 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d3d3a76b-5211-4837-aa66-71b21e26807d tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "GET /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae" status: 200 len: 1680 microversion: 2.1 time: 0.163500 Aug 27 04:03:46.016877 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3613/7178] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:03:45 2022] GET /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:47.041848 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a9846c9f-5d5c-4026-8a18-6aa11efcd4df tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:47.042836 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a9846c9f-5d5c-4026-8a18-6aa11efcd4df tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:03:47.054008 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a9846c9f-5d5c-4026-8a18-6aa11efcd4df tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:47.054761 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a9846c9f-5d5c-4026-8a18-6aa11efcd4df tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:47.055436 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a9846c9f-5d5c-4026-8a18-6aa11efcd4df tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:47.056567 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a9846c9f-5d5c-4026-8a18-6aa11efcd4df tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:47.057267 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a9846c9f-5d5c-4026-8a18-6aa11efcd4df tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:47.057921 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a9846c9f-5d5c-4026-8a18-6aa11efcd4df tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:47.216961 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-a9846c9f-5d5c-4026-8a18-6aa11efcd4df tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11beacbd367449d909a0512301b31d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738d5571a8d4f7eb9fbc7c51dfe03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:47.225318 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a9846c9f-5d5c-4026-8a18-6aa11efcd4df tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "GET /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae" status: 200 len: 1680 microversion: 2.1 time: 0.190158 Aug 27 04:03:47.225912 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3566/7179] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:03:47 2022] GET /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae => generated 1680 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:48.250310 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4199ddfe-3f51-450e-83cd-6884a4148208 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:48.250924 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-4199ddfe-3f51-450e-83cd-6884a4148208 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:03:48.258232 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4199ddfe-3f51-450e-83cd-6884a4148208 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:48.258735 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4199ddfe-3f51-450e-83cd-6884a4148208 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:48.259187 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4199ddfe-3f51-450e-83cd-6884a4148208 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:48.259893 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4199ddfe-3f51-450e-83cd-6884a4148208 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:48.260347 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4199ddfe-3f51-450e-83cd-6884a4148208 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:48.260832 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4199ddfe-3f51-450e-83cd-6884a4148208 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:48.400876 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-4199ddfe-3f51-450e-83cd-6884a4148208 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11beacbd367449d909a0512301b31d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738d5571a8d4f7eb9fbc7c51dfe03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:48.409386 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-4199ddfe-3f51-450e-83cd-6884a4148208 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "GET /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae" status: 200 len: 1680 microversion: 2.1 time: 0.164476 Aug 27 04:03:48.410052 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3614/7180] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:03:48 2022] GET /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:49.433481 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c76a63d8-30cc-47cd-8682-b0e20ab021a6 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:49.434369 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-c76a63d8-30cc-47cd-8682-b0e20ab021a6 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:03:49.443863 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c76a63d8-30cc-47cd-8682-b0e20ab021a6 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:49.444714 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c76a63d8-30cc-47cd-8682-b0e20ab021a6 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:49.445219 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c76a63d8-30cc-47cd-8682-b0e20ab021a6 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:49.446176 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c76a63d8-30cc-47cd-8682-b0e20ab021a6 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:49.446804 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c76a63d8-30cc-47cd-8682-b0e20ab021a6 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:49.447359 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c76a63d8-30cc-47cd-8682-b0e20ab021a6 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:49.582259 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-c76a63d8-30cc-47cd-8682-b0e20ab021a6 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11beacbd367449d909a0512301b31d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738d5571a8d4f7eb9fbc7c51dfe03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:49.590702 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c76a63d8-30cc-47cd-8682-b0e20ab021a6 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "GET /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae" status: 200 len: 1680 microversion: 2.1 time: 0.162514 Aug 27 04:03:49.591302 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3567/7181] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:03:49 2022] GET /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:50.616057 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-000c6daf-014b-4b49-b366-239985025395 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:50.617187 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-000c6daf-014b-4b49-b366-239985025395 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:03:50.627281 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-000c6daf-014b-4b49-b366-239985025395 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:50.627791 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-000c6daf-014b-4b49-b366-239985025395 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:50.628245 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-000c6daf-014b-4b49-b366-239985025395 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:50.628994 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-000c6daf-014b-4b49-b366-239985025395 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:50.629461 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-000c6daf-014b-4b49-b366-239985025395 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:50.629901 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-000c6daf-014b-4b49-b366-239985025395 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:50.777104 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-000c6daf-014b-4b49-b366-239985025395 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11beacbd367449d909a0512301b31d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738d5571a8d4f7eb9fbc7c51dfe03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:50.786028 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-000c6daf-014b-4b49-b366-239985025395 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "GET /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae" status: 200 len: 1701 microversion: 2.1 time: 0.176537 Aug 27 04:03:50.786610 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3615/7182] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:03:50 2022] GET /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae => generated 1701 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:51.807367 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0f6c4c9a-9246-47bb-9fc0-72f226a731f5 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:51.807996 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-0f6c4c9a-9246-47bb-9fc0-72f226a731f5 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:03:51.815407 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0f6c4c9a-9246-47bb-9fc0-72f226a731f5 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:51.815895 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0f6c4c9a-9246-47bb-9fc0-72f226a731f5 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:51.816353 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0f6c4c9a-9246-47bb-9fc0-72f226a731f5 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:51.817060 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0f6c4c9a-9246-47bb-9fc0-72f226a731f5 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:51.817523 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0f6c4c9a-9246-47bb-9fc0-72f226a731f5 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:51.817947 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0f6c4c9a-9246-47bb-9fc0-72f226a731f5 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:51.956504 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-0f6c4c9a-9246-47bb-9fc0-72f226a731f5 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11beacbd367449d909a0512301b31d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738d5571a8d4f7eb9fbc7c51dfe03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:51.965050 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-0f6c4c9a-9246-47bb-9fc0-72f226a731f5 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "GET /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae" status: 200 len: 1701 microversion: 2.1 time: 0.161634 Aug 27 04:03:51.965686 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3568/7183] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:03:51 2022] GET /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae => generated 1701 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:52.992546 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4ef05bea-2f63-42ab-922b-1d258f2fb246 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:52.993155 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-4ef05bea-2f63-42ab-922b-1d258f2fb246 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:03:53.002399 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4ef05bea-2f63-42ab-922b-1d258f2fb246 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:53.002799 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4ef05bea-2f63-42ab-922b-1d258f2fb246 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:53.003445 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4ef05bea-2f63-42ab-922b-1d258f2fb246 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:53.004364 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4ef05bea-2f63-42ab-922b-1d258f2fb246 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:53.005054 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4ef05bea-2f63-42ab-922b-1d258f2fb246 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:53.005678 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4ef05bea-2f63-42ab-922b-1d258f2fb246 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:53.157199 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-4ef05bea-2f63-42ab-922b-1d258f2fb246 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11beacbd367449d909a0512301b31d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738d5571a8d4f7eb9fbc7c51dfe03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:53.165480 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-4ef05bea-2f63-42ab-922b-1d258f2fb246 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "GET /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae" status: 200 len: 1696 microversion: 2.1 time: 0.182467 Aug 27 04:03:53.166989 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3616/7184] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:03:52 2022] GET /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae => generated 1696 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:53.489745 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-cfad256b-cd38-4a00-9c8d-286c6acaae2d req-f607bf47-1541-4797-aa37-71cb7d5f5934 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae", "name": "network-vif-plugged", "status": "completed", "tag": "4ad5abbb-9361-463e-be45-0b499f50c9bd"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:03:53.504890 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-cfad256b-cd38-4a00-9c8d-286c6acaae2d req-f607bf47-1541-4797-aa37-71cb7d5f5934 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:53.505679 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-cfad256b-cd38-4a00-9c8d-286c6acaae2d req-f607bf47-1541-4797-aa37-71cb7d5f5934 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:53.506447 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-cfad256b-cd38-4a00-9c8d-286c6acaae2d req-f607bf47-1541-4797-aa37-71cb7d5f5934 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:53.519835 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-cfad256b-cd38-4a00-9c8d-286c6acaae2d req-f607bf47-1541-4797-aa37-71cb7d5f5934 service nova] Creating event network-vif-plugged:4ad5abbb-9361-463e-be45-0b499f50c9bd for instance 21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae on n-h1-852278-4 Aug 27 04:03:53.523470 n-d-852278-4 devstack@n-api.service[134052]: ERROR oslo.messaging._drivers.impl_rabbit [req-cfad256b-cd38-4a00-9c8d-286c6acaae2d req-f607bf47-1541-4797-aa37-71cb7d5f5934 service nova] [1f33787d-5511-4b23-9fa0-c68f855f1168] AMQP server on 10.222.0.70:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 27 04:03:54.188222 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-91dda136-f217-4749-8341-d5abde7ab551 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:54.189085 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-91dda136-f217-4749-8341-d5abde7ab551 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:03:54.200071 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-91dda136-f217-4749-8341-d5abde7ab551 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:54.200604 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-91dda136-f217-4749-8341-d5abde7ab551 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:54.201049 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-91dda136-f217-4749-8341-d5abde7ab551 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:54.201768 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-91dda136-f217-4749-8341-d5abde7ab551 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:54.202309 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-91dda136-f217-4749-8341-d5abde7ab551 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:54.202729 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-91dda136-f217-4749-8341-d5abde7ab551 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:54.364652 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-91dda136-f217-4749-8341-d5abde7ab551 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11beacbd367449d909a0512301b31d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738d5571a8d4f7eb9fbc7c51dfe03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:54.374141 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-91dda136-f217-4749-8341-d5abde7ab551 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "GET /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae" status: 200 len: 1696 microversion: 2.1 time: 0.190123 Aug 27 04:03:54.384967 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3617/7185] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:03:54 2022] GET /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae => generated 1696 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:03:54.534998 n-d-852278-4 devstack@n-api.service[134052]: INFO oslo.messaging._drivers.impl_rabbit [req-cfad256b-cd38-4a00-9c8d-286c6acaae2d req-f607bf47-1541-4797-aa37-71cb7d5f5934 service nova] [1f33787d-5511-4b23-9fa0-c68f855f1168] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 59676. Aug 27 04:03:54.539399 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-cfad256b-cd38-4a00-9c8d-286c6acaae2d req-f607bf47-1541-4797-aa37-71cb7d5f5934 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.157964 Aug 27 04:03:54.540473 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3569/7186] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 04:03:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:03:55.399248 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-54ef7527-9450-43f4-9a60-c83281688693 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:55.400141 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-54ef7527-9450-43f4-9a60-c83281688693 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:03:55.407922 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-54ef7527-9450-43f4-9a60-c83281688693 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:55.408454 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-54ef7527-9450-43f4-9a60-c83281688693 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:55.408903 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-54ef7527-9450-43f4-9a60-c83281688693 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:55.409627 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-54ef7527-9450-43f4-9a60-c83281688693 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:55.410091 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-54ef7527-9450-43f4-9a60-c83281688693 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:55.410526 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-54ef7527-9450-43f4-9a60-c83281688693 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:55.595515 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-54ef7527-9450-43f4-9a60-c83281688693 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11beacbd367449d909a0512301b31d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738d5571a8d4f7eb9fbc7c51dfe03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:55.605960 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-54ef7527-9450-43f4-9a60-c83281688693 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "GET /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae" status: 200 len: 1696 microversion: 2.1 time: 0.210842 Aug 27 04:03:55.607535 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3618/7187] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:03:55 2022] GET /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae => generated 1696 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:56.630223 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-30302b91-24a9-41fd-87d2-f04018bd66c6 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:56.630915 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-30302b91-24a9-41fd-87d2-f04018bd66c6 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:03:56.639931 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-30302b91-24a9-41fd-87d2-f04018bd66c6 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:56.640949 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-30302b91-24a9-41fd-87d2-f04018bd66c6 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:56.641389 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-30302b91-24a9-41fd-87d2-f04018bd66c6 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:56.642102 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-30302b91-24a9-41fd-87d2-f04018bd66c6 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:56.642556 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-30302b91-24a9-41fd-87d2-f04018bd66c6 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:56.642980 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-30302b91-24a9-41fd-87d2-f04018bd66c6 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:56.830246 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-30302b91-24a9-41fd-87d2-f04018bd66c6 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11beacbd367449d909a0512301b31d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738d5571a8d4f7eb9fbc7c51dfe03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:56.839657 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-30302b91-24a9-41fd-87d2-f04018bd66c6 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "GET /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae" status: 200 len: 1696 microversion: 2.1 time: 0.215027 Aug 27 04:03:56.840263 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3570/7188] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:03:56 2022] GET /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae => generated 1696 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:57.861894 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d696b7ad-497d-4913-8261-093cac2ed5d9 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:57.862729 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d696b7ad-497d-4913-8261-093cac2ed5d9 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:03:57.876060 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d696b7ad-497d-4913-8261-093cac2ed5d9 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:57.876716 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d696b7ad-497d-4913-8261-093cac2ed5d9 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:57.877328 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d696b7ad-497d-4913-8261-093cac2ed5d9 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:57.878098 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d696b7ad-497d-4913-8261-093cac2ed5d9 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:57.878596 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d696b7ad-497d-4913-8261-093cac2ed5d9 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:57.879105 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d696b7ad-497d-4913-8261-093cac2ed5d9 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:58.042330 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d696b7ad-497d-4913-8261-093cac2ed5d9 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11beacbd367449d909a0512301b31d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738d5571a8d4f7eb9fbc7c51dfe03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:58.055409 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d696b7ad-497d-4913-8261-093cac2ed5d9 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "GET /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae" status: 200 len: 1696 microversion: 2.1 time: 0.198106 Aug 27 04:03:58.056855 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3619/7189] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:03:57 2022] GET /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae => generated 1696 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:59.077350 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-103b388d-2376-4e03-a992-3e70785518db tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:59.078117 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-103b388d-2376-4e03-a992-3e70785518db tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:03:59.087181 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-103b388d-2376-4e03-a992-3e70785518db tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:59.087644 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-103b388d-2376-4e03-a992-3e70785518db tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:59.088415 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-103b388d-2376-4e03-a992-3e70785518db tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:59.089201 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-103b388d-2376-4e03-a992-3e70785518db tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:59.089697 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-103b388d-2376-4e03-a992-3e70785518db tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:59.090194 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-103b388d-2376-4e03-a992-3e70785518db tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:59.251305 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-103b388d-2376-4e03-a992-3e70785518db tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11beacbd367449d909a0512301b31d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738d5571a8d4f7eb9fbc7c51dfe03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:59.261427 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-103b388d-2376-4e03-a992-3e70785518db tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "GET /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae" status: 200 len: 1696 microversion: 2.1 time: 0.187987 Aug 27 04:03:59.262054 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3571/7190] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:03:59 2022] GET /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae => generated 1696 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:00.285118 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-2feba75d-d4e0-46fb-ae2b-33db13fb1131 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:00.285988 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-2feba75d-d4e0-46fb-ae2b-33db13fb1131 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:04:00.295521 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2feba75d-d4e0-46fb-ae2b-33db13fb1131 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:00.296111 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2feba75d-d4e0-46fb-ae2b-33db13fb1131 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:00.296604 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2feba75d-d4e0-46fb-ae2b-33db13fb1131 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:00.297417 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2feba75d-d4e0-46fb-ae2b-33db13fb1131 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:00.297891 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2feba75d-d4e0-46fb-ae2b-33db13fb1131 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:00.298329 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2feba75d-d4e0-46fb-ae2b-33db13fb1131 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:00.483499 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-2feba75d-d4e0-46fb-ae2b-33db13fb1131 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11beacbd367449d909a0512301b31d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738d5571a8d4f7eb9fbc7c51dfe03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:00.491638 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-2feba75d-d4e0-46fb-ae2b-33db13fb1131 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "GET /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae" status: 200 len: 1696 microversion: 2.1 time: 0.211400 Aug 27 04:04:00.492230 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3620/7191] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:04:00 2022] GET /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae => generated 1696 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:01.513938 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ebdfce5c-0a65-4e83-b6c8-e26aa6571969 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:01.514632 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-ebdfce5c-0a65-4e83-b6c8-e26aa6571969 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:04:01.522386 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ebdfce5c-0a65-4e83-b6c8-e26aa6571969 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:01.522879 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ebdfce5c-0a65-4e83-b6c8-e26aa6571969 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:01.523320 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ebdfce5c-0a65-4e83-b6c8-e26aa6571969 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:01.524022 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ebdfce5c-0a65-4e83-b6c8-e26aa6571969 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:01.524515 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ebdfce5c-0a65-4e83-b6c8-e26aa6571969 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:01.524942 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ebdfce5c-0a65-4e83-b6c8-e26aa6571969 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:01.666921 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-ebdfce5c-0a65-4e83-b6c8-e26aa6571969 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11beacbd367449d909a0512301b31d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738d5571a8d4f7eb9fbc7c51dfe03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:01.675514 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ebdfce5c-0a65-4e83-b6c8-e26aa6571969 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "GET /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae" status: 200 len: 1696 microversion: 2.1 time: 0.165652 Aug 27 04:04:01.676116 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3572/7192] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:04:01 2022] GET /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae => generated 1696 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:02.697050 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ce0d6583-7bf5-4769-8a3a-e35837464701 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:02.697691 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-ce0d6583-7bf5-4769-8a3a-e35837464701 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:04:02.704777 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ce0d6583-7bf5-4769-8a3a-e35837464701 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:02.705278 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ce0d6583-7bf5-4769-8a3a-e35837464701 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:02.705721 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ce0d6583-7bf5-4769-8a3a-e35837464701 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:02.706425 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ce0d6583-7bf5-4769-8a3a-e35837464701 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:02.706884 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ce0d6583-7bf5-4769-8a3a-e35837464701 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:02.707422 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ce0d6583-7bf5-4769-8a3a-e35837464701 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:02.862512 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-ce0d6583-7bf5-4769-8a3a-e35837464701 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11beacbd367449d909a0512301b31d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738d5571a8d4f7eb9fbc7c51dfe03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:02.870586 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ce0d6583-7bf5-4769-8a3a-e35837464701 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "GET /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae" status: 200 len: 1678 microversion: 2.1 time: 0.177468 Aug 27 04:04:02.871209 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3621/7193] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:04:02 2022] GET /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae => generated 1678 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:03.894497 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-479722ec-1a59-4c4f-8d80-4db0cac0f6b2 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:03.895204 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-479722ec-1a59-4c4f-8d80-4db0cac0f6b2 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:04:03.904583 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-479722ec-1a59-4c4f-8d80-4db0cac0f6b2 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:03.905194 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-479722ec-1a59-4c4f-8d80-4db0cac0f6b2 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:03.905911 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-479722ec-1a59-4c4f-8d80-4db0cac0f6b2 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:03.907008 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-479722ec-1a59-4c4f-8d80-4db0cac0f6b2 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:03.907575 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-479722ec-1a59-4c4f-8d80-4db0cac0f6b2 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:03.908101 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-479722ec-1a59-4c4f-8d80-4db0cac0f6b2 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:04.065454 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-479722ec-1a59-4c4f-8d80-4db0cac0f6b2 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11beacbd367449d909a0512301b31d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738d5571a8d4f7eb9fbc7c51dfe03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:04.073550 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-479722ec-1a59-4c4f-8d80-4db0cac0f6b2 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "GET /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae" status: 200 len: 1678 microversion: 2.1 time: 0.184065 Aug 27 04:04:04.074140 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3573/7194] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:04:03 2022] GET /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae => generated 1678 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:05.098180 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-260c8870-8940-44c6-97d4-1d779d894b4f tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:05.099098 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-260c8870-8940-44c6-97d4-1d779d894b4f tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:04:05.110379 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-260c8870-8940-44c6-97d4-1d779d894b4f tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:05.110889 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-260c8870-8940-44c6-97d4-1d779d894b4f tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:05.111432 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-260c8870-8940-44c6-97d4-1d779d894b4f tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:05.112162 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-260c8870-8940-44c6-97d4-1d779d894b4f tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:05.112714 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-260c8870-8940-44c6-97d4-1d779d894b4f tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:05.113159 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-260c8870-8940-44c6-97d4-1d779d894b4f tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:05.253081 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-260c8870-8940-44c6-97d4-1d779d894b4f tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11beacbd367449d909a0512301b31d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738d5571a8d4f7eb9fbc7c51dfe03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:05.261650 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-260c8870-8940-44c6-97d4-1d779d894b4f tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "GET /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae" status: 200 len: 1621 microversion: 2.1 time: 0.169640 Aug 27 04:04:05.262229 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3622/7195] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:04:05 2022] GET /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae => generated 1621 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:05.282661 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-dcbaeb57-4c99-47ae-a616-86f58a4e974d tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:04:05.283250 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-dcbaeb57-4c99-47ae-a616-86f58a4e974d tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:04:05.290482 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dcbaeb57-4c99-47ae-a616-86f58a4e974d tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:05.291280 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dcbaeb57-4c99-47ae-a616-86f58a4e974d tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:05.291714 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dcbaeb57-4c99-47ae-a616-86f58a4e974d tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:05.292448 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dcbaeb57-4c99-47ae-a616-86f58a4e974d tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:05.292899 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dcbaeb57-4c99-47ae-a616-86f58a4e974d tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:05.293319 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-dcbaeb57-4c99-47ae-a616-86f58a4e974d tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:05.347861 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-dcbaeb57-4c99-47ae-a616-86f58a4e974d tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=134052) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 27 04:04:05.430242 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-dcbaeb57-4c99-47ae-a616-86f58a4e974d tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "POST /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae/action" status: 202 len: 0 microversion: 2.1 time: 0.151520 Aug 27 04:04:05.430487 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-4e0b51bc-1518-436b-8a7e-ee8c847a07eb req-d8303aca-40aa-451a-9cf7-980e828653e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae", "name": "network-vif-unplugged", "status": "completed", "tag": "4ad5abbb-9361-463e-be45-0b499f50c9bd"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:04:05.430942 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3574/7196] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 04:04:05 2022] POST /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae/action => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:04:05.439975 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d74599a4-66a6-4ec7-b2dc-7185a43c0d4f tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:05.440623 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d74599a4-66a6-4ec7-b2dc-7185a43c0d4f tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:04:05.449509 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d74599a4-66a6-4ec7-b2dc-7185a43c0d4f tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:05.450034 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d74599a4-66a6-4ec7-b2dc-7185a43c0d4f tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:05.450871 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d74599a4-66a6-4ec7-b2dc-7185a43c0d4f tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:05.451209 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d74599a4-66a6-4ec7-b2dc-7185a43c0d4f tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:05.451937 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d74599a4-66a6-4ec7-b2dc-7185a43c0d4f tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:05.452630 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d74599a4-66a6-4ec7-b2dc-7185a43c0d4f tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:05.470050 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-4e0b51bc-1518-436b-8a7e-ee8c847a07eb req-d8303aca-40aa-451a-9cf7-980e828653e3 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:05.470945 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-4e0b51bc-1518-436b-8a7e-ee8c847a07eb req-d8303aca-40aa-451a-9cf7-980e828653e3 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:05.471750 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-4e0b51bc-1518-436b-8a7e-ee8c847a07eb req-d8303aca-40aa-451a-9cf7-980e828653e3 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:05.498640 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.compute.server_external_events [req-4e0b51bc-1518-436b-8a7e-ee8c847a07eb req-d8303aca-40aa-451a-9cf7-980e828653e3 service nova] Unable to find a host for instance 21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae. Dropping event network-vif-unplugged {{(pid=134051) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 27 04:04:05.500068 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-4e0b51bc-1518-436b-8a7e-ee8c847a07eb req-d8303aca-40aa-451a-9cf7-980e828653e3 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.074002 Aug 27 04:04:05.501397 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3623/7197] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 04:04:05 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 76 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 27 04:04:05.620958 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-d74599a4-66a6-4ec7-b2dc-7185a43c0d4f tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11beacbd367449d909a0512301b31d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738d5571a8d4f7eb9fbc7c51dfe03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:05.628878 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d74599a4-66a6-4ec7-b2dc-7185a43c0d4f tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "GET /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae" status: 200 len: 1629 microversion: 2.1 time: 0.193472 Aug 27 04:04:05.629463 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3575/7198] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:04:05 2022] GET /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae => generated 1629 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:04:06.651052 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-5859547e-8078-42e7-a761-1f37d56c95fc tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:06.651674 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-5859547e-8078-42e7-a761-1f37d56c95fc tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:04:06.659151 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5859547e-8078-42e7-a761-1f37d56c95fc tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:06.659655 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5859547e-8078-42e7-a761-1f37d56c95fc tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:06.660103 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5859547e-8078-42e7-a761-1f37d56c95fc tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:06.660854 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5859547e-8078-42e7-a761-1f37d56c95fc tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:06.661317 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5859547e-8078-42e7-a761-1f37d56c95fc tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:06.661755 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5859547e-8078-42e7-a761-1f37d56c95fc tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:06.824059 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-5859547e-8078-42e7-a761-1f37d56c95fc tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11beacbd367449d909a0512301b31d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738d5571a8d4f7eb9fbc7c51dfe03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:06.833581 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-5859547e-8078-42e7-a761-1f37d56c95fc tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "GET /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae" status: 200 len: 1687 microversion: 2.1 time: 0.186484 Aug 27 04:04:06.834575 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3624/7199] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:04:06 2022] GET /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae => generated 1687 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:07.667048 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-3262facf-6b18-4c85-ae2e-210be86127f0 req-314ccad8-8abf-4213-b0e4-bd1a554c5e15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae", "tag": "4ad5abbb-9361-463e-be45-0b499f50c9bd"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:04:07.678873 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-3262facf-6b18-4c85-ae2e-210be86127f0 req-314ccad8-8abf-4213-b0e4-bd1a554c5e15 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:07.679258 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-3262facf-6b18-4c85-ae2e-210be86127f0 req-314ccad8-8abf-4213-b0e4-bd1a554c5e15 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:07.679691 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-3262facf-6b18-4c85-ae2e-210be86127f0 req-314ccad8-8abf-4213-b0e4-bd1a554c5e15 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:07.692093 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-3262facf-6b18-4c85-ae2e-210be86127f0 req-314ccad8-8abf-4213-b0e4-bd1a554c5e15 service nova] Creating event network-changed:4ad5abbb-9361-463e-be45-0b499f50c9bd for instance 21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae on n-h2-852278-4 Aug 27 04:04:07.697709 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-3262facf-6b18-4c85-ae2e-210be86127f0 req-314ccad8-8abf-4213-b0e4-bd1a554c5e15 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035185 Aug 27 04:04:07.698409 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3576/7200] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 04:04:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:04:07.855591 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-34f9bf3d-b992-41a7-ac63-20e5bf02345c tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:07.856222 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-34f9bf3d-b992-41a7-ac63-20e5bf02345c tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:04:07.863711 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-34f9bf3d-b992-41a7-ac63-20e5bf02345c tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:07.864216 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-34f9bf3d-b992-41a7-ac63-20e5bf02345c tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:07.864700 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-34f9bf3d-b992-41a7-ac63-20e5bf02345c tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:07.865416 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-34f9bf3d-b992-41a7-ac63-20e5bf02345c tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:07.865876 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-34f9bf3d-b992-41a7-ac63-20e5bf02345c tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:07.866303 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-34f9bf3d-b992-41a7-ac63-20e5bf02345c tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:07.870813 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:04:08.093731 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-34f9bf3d-b992-41a7-ac63-20e5bf02345c tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11beacbd367449d909a0512301b31d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738d5571a8d4f7eb9fbc7c51dfe03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:08.102376 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-34f9bf3d-b992-41a7-ac63-20e5bf02345c tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "GET /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae" status: 200 len: 1687 microversion: 2.1 time: 0.251161 Aug 27 04:04:08.102976 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3625/7201] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:04:07 2022] GET /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae => generated 1687 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:09.125596 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6ed0baea-ac20-4386-a3cd-6044286cc71e tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:09.126402 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-6ed0baea-ac20-4386-a3cd-6044286cc71e tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:04:09.133094 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6ed0baea-ac20-4386-a3cd-6044286cc71e tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:09.133648 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6ed0baea-ac20-4386-a3cd-6044286cc71e tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:09.134177 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6ed0baea-ac20-4386-a3cd-6044286cc71e tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:09.134933 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6ed0baea-ac20-4386-a3cd-6044286cc71e tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:09.135454 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6ed0baea-ac20-4386-a3cd-6044286cc71e tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:09.135968 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6ed0baea-ac20-4386-a3cd-6044286cc71e tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:09.289200 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-6ed0baea-ac20-4386-a3cd-6044286cc71e tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11beacbd367449d909a0512301b31d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738d5571a8d4f7eb9fbc7c51dfe03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:09.301012 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-6ed0baea-ac20-4386-a3cd-6044286cc71e tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "GET /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae" status: 200 len: 1687 microversion: 2.1 time: 0.180057 Aug 27 04:04:09.301632 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3577/7202] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:04:09 2022] GET /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae => generated 1687 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:10.323322 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-778fe299-4b59-42e5-b6bd-f77b00e4479c tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:10.323881 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-778fe299-4b59-42e5-b6bd-f77b00e4479c tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:04:10.326666 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=33 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:04:10.332581 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-778fe299-4b59-42e5-b6bd-f77b00e4479c tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:10.333095 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-778fe299-4b59-42e5-b6bd-f77b00e4479c tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:10.333548 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-778fe299-4b59-42e5-b6bd-f77b00e4479c tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:10.334285 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-778fe299-4b59-42e5-b6bd-f77b00e4479c tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:10.334751 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-778fe299-4b59-42e5-b6bd-f77b00e4479c tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:10.335193 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-778fe299-4b59-42e5-b6bd-f77b00e4479c tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:10.489339 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-778fe299-4b59-42e5-b6bd-f77b00e4479c tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11beacbd367449d909a0512301b31d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738d5571a8d4f7eb9fbc7c51dfe03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:10.498095 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-778fe299-4b59-42e5-b6bd-f77b00e4479c tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "GET /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae" status: 200 len: 1687 microversion: 2.1 time: 0.178766 Aug 27 04:04:10.498699 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3626/7203] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:04:10 2022] GET /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae => generated 1687 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:11.520478 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3641b8e9-5d69-4467-88f2-8456c5861533 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:11.521441 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-3641b8e9-5d69-4467-88f2-8456c5861533 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:04:11.524943 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:04:11.532244 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3641b8e9-5d69-4467-88f2-8456c5861533 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:11.533941 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3641b8e9-5d69-4467-88f2-8456c5861533 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:11.534509 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3641b8e9-5d69-4467-88f2-8456c5861533 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:11.535374 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3641b8e9-5d69-4467-88f2-8456c5861533 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:11.535932 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3641b8e9-5d69-4467-88f2-8456c5861533 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:11.536472 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3641b8e9-5d69-4467-88f2-8456c5861533 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:11.540290 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:04:11.692856 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-3641b8e9-5d69-4467-88f2-8456c5861533 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11beacbd367449d909a0512301b31d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738d5571a8d4f7eb9fbc7c51dfe03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:11.702362 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-3641b8e9-5d69-4467-88f2-8456c5861533 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "GET /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae" status: 200 len: 1687 microversion: 2.1 time: 0.186074 Aug 27 04:04:11.702881 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3578/7204] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:04:11 2022] GET /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae => generated 1687 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:12.724373 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-379a487d-11ae-4040-9d10-985d3ffbead9 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:12.725181 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-379a487d-11ae-4040-9d10-985d3ffbead9 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:04:12.735402 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-379a487d-11ae-4040-9d10-985d3ffbead9 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:12.735836 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-379a487d-11ae-4040-9d10-985d3ffbead9 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:12.736284 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-379a487d-11ae-4040-9d10-985d3ffbead9 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:12.737081 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-379a487d-11ae-4040-9d10-985d3ffbead9 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:12.737502 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-379a487d-11ae-4040-9d10-985d3ffbead9 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:12.737958 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-379a487d-11ae-4040-9d10-985d3ffbead9 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:12.933833 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-379a487d-11ae-4040-9d10-985d3ffbead9 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11beacbd367449d909a0512301b31d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738d5571a8d4f7eb9fbc7c51dfe03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:12.943250 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-379a487d-11ae-4040-9d10-985d3ffbead9 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "GET /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae" status: 200 len: 1687 microversion: 2.1 time: 0.222896 Aug 27 04:04:12.944279 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3627/7205] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:04:12 2022] GET /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae => generated 1687 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:13.965289 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f7f62111-84e6-4f79-8c5f-3a76ef6b85b6 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:13.965961 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-f7f62111-84e6-4f79-8c5f-3a76ef6b85b6 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:04:13.973198 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f7f62111-84e6-4f79-8c5f-3a76ef6b85b6 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:13.973967 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f7f62111-84e6-4f79-8c5f-3a76ef6b85b6 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:13.974421 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f7f62111-84e6-4f79-8c5f-3a76ef6b85b6 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:13.975231 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f7f62111-84e6-4f79-8c5f-3a76ef6b85b6 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:13.975599 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f7f62111-84e6-4f79-8c5f-3a76ef6b85b6 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:13.976030 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f7f62111-84e6-4f79-8c5f-3a76ef6b85b6 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:14.136217 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-f7f62111-84e6-4f79-8c5f-3a76ef6b85b6 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11beacbd367449d909a0512301b31d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738d5571a8d4f7eb9fbc7c51dfe03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:14.144905 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f7f62111-84e6-4f79-8c5f-3a76ef6b85b6 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "GET /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae" status: 200 len: 1687 microversion: 2.1 time: 0.184015 Aug 27 04:04:14.145690 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3579/7206] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:04:13 2022] GET /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae => generated 1687 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:15.167961 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0789e602-0c22-4576-a19d-21080ca289e9 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:15.168705 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-0789e602-0c22-4576-a19d-21080ca289e9 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:04:15.177079 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0789e602-0c22-4576-a19d-21080ca289e9 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:15.178037 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0789e602-0c22-4576-a19d-21080ca289e9 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:15.178662 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0789e602-0c22-4576-a19d-21080ca289e9 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:15.179582 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0789e602-0c22-4576-a19d-21080ca289e9 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:15.180209 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0789e602-0c22-4576-a19d-21080ca289e9 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:15.180849 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0789e602-0c22-4576-a19d-21080ca289e9 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:15.353977 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-0789e602-0c22-4576-a19d-21080ca289e9 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11beacbd367449d909a0512301b31d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738d5571a8d4f7eb9fbc7c51dfe03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:15.364160 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-0789e602-0c22-4576-a19d-21080ca289e9 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "GET /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae" status: 200 len: 1687 microversion: 2.1 time: 0.202637 Aug 27 04:04:15.365183 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3628/7207] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:04:15 2022] GET /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae => generated 1687 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:16.389742 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-60ce6799-f5fa-488d-9041-62d0fa06018a tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:16.390377 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-60ce6799-f5fa-488d-9041-62d0fa06018a tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:04:16.397984 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-60ce6799-f5fa-488d-9041-62d0fa06018a tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:16.398443 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-60ce6799-f5fa-488d-9041-62d0fa06018a tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:16.398888 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-60ce6799-f5fa-488d-9041-62d0fa06018a tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:16.399723 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-60ce6799-f5fa-488d-9041-62d0fa06018a tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:16.400104 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-60ce6799-f5fa-488d-9041-62d0fa06018a tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:16.400529 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-60ce6799-f5fa-488d-9041-62d0fa06018a tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:16.557269 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-60ce6799-f5fa-488d-9041-62d0fa06018a tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11beacbd367449d909a0512301b31d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738d5571a8d4f7eb9fbc7c51dfe03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:16.566038 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-60ce6799-f5fa-488d-9041-62d0fa06018a tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "GET /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae" status: 200 len: 1687 microversion: 2.1 time: 0.180421 Aug 27 04:04:16.566628 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3580/7208] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:04:16 2022] GET /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae => generated 1687 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:17.592802 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-60f93673-acd0-4547-8ff5-25d5c969b029 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:17.593777 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-60f93673-acd0-4547-8ff5-25d5c969b029 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:04:17.601005 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-60f93673-acd0-4547-8ff5-25d5c969b029 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:17.601471 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-60f93673-acd0-4547-8ff5-25d5c969b029 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:17.601952 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-60f93673-acd0-4547-8ff5-25d5c969b029 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:17.602659 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-60f93673-acd0-4547-8ff5-25d5c969b029 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:17.603119 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-60f93673-acd0-4547-8ff5-25d5c969b029 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:17.603551 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-60f93673-acd0-4547-8ff5-25d5c969b029 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:17.742709 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-60f93673-acd0-4547-8ff5-25d5c969b029 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11beacbd367449d909a0512301b31d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738d5571a8d4f7eb9fbc7c51dfe03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:17.751014 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-60f93673-acd0-4547-8ff5-25d5c969b029 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "GET /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae" status: 200 len: 1687 microversion: 2.1 time: 0.165017 Aug 27 04:04:17.751609 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3629/7209] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:04:17 2022] GET /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae => generated 1687 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:18.773303 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-949f090c-989f-4803-9cde-cf8b0d62bd87 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:18.773884 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-949f090c-989f-4803-9cde-cf8b0d62bd87 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:04:18.781065 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-949f090c-989f-4803-9cde-cf8b0d62bd87 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:18.781553 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-949f090c-989f-4803-9cde-cf8b0d62bd87 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:18.781965 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-949f090c-989f-4803-9cde-cf8b0d62bd87 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:18.782694 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-949f090c-989f-4803-9cde-cf8b0d62bd87 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:18.783138 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-949f090c-989f-4803-9cde-cf8b0d62bd87 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:18.783560 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-949f090c-989f-4803-9cde-cf8b0d62bd87 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:18.931091 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-949f090c-989f-4803-9cde-cf8b0d62bd87 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11beacbd367449d909a0512301b31d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738d5571a8d4f7eb9fbc7c51dfe03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:18.939674 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-949f090c-989f-4803-9cde-cf8b0d62bd87 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "GET /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae" status: 200 len: 1687 microversion: 2.1 time: 0.171222 Aug 27 04:04:18.940277 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3581/7210] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:04:18 2022] GET /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae => generated 1687 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:19.964513 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-63894075-eea2-4e51-942b-a62d193432f2 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:19.965238 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-63894075-eea2-4e51-942b-a62d193432f2 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:04:19.975366 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-63894075-eea2-4e51-942b-a62d193432f2 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:19.975918 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-63894075-eea2-4e51-942b-a62d193432f2 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:19.976432 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-63894075-eea2-4e51-942b-a62d193432f2 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:19.977132 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-63894075-eea2-4e51-942b-a62d193432f2 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:19.977589 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-63894075-eea2-4e51-942b-a62d193432f2 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:19.978020 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-63894075-eea2-4e51-942b-a62d193432f2 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:20.116582 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-63894075-eea2-4e51-942b-a62d193432f2 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11beacbd367449d909a0512301b31d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738d5571a8d4f7eb9fbc7c51dfe03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:20.124694 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-63894075-eea2-4e51-942b-a62d193432f2 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "GET /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae" status: 200 len: 1687 microversion: 2.1 time: 0.167385 Aug 27 04:04:20.125424 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3630/7211] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:04:19 2022] GET /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae => generated 1687 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:20.135378 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-2cb59c2a-2dca-4360-92d6-056be1cd077d req-2b8e922f-472d-4dbd-84ed-6ef29fb4abf2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae", "name": "network-vif-plugged", "status": "completed", "tag": "4ad5abbb-9361-463e-be45-0b499f50c9bd"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:04:20.152755 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-2cb59c2a-2dca-4360-92d6-056be1cd077d req-2b8e922f-472d-4dbd-84ed-6ef29fb4abf2 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:20.153583 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-2cb59c2a-2dca-4360-92d6-056be1cd077d req-2b8e922f-472d-4dbd-84ed-6ef29fb4abf2 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:20.154325 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-2cb59c2a-2dca-4360-92d6-056be1cd077d req-2b8e922f-472d-4dbd-84ed-6ef29fb4abf2 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:20.169174 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-2cb59c2a-2dca-4360-92d6-056be1cd077d req-2b8e922f-472d-4dbd-84ed-6ef29fb4abf2 service nova] Creating event network-vif-plugged:4ad5abbb-9361-463e-be45-0b499f50c9bd for instance 21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae on n-h2-852278-4 Aug 27 04:04:20.174632 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-2cb59c2a-2dca-4360-92d6-056be1cd077d req-2b8e922f-472d-4dbd-84ed-6ef29fb4abf2 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045399 Aug 27 04:04:20.175307 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3582/7212] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 04:04:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:04:21.147622 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-43321d88-fb83-4ddd-8d49-6b2503ab6f56 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:21.148259 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-43321d88-fb83-4ddd-8d49-6b2503ab6f56 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:04:21.155648 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-43321d88-fb83-4ddd-8d49-6b2503ab6f56 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:21.156159 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-43321d88-fb83-4ddd-8d49-6b2503ab6f56 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:21.156679 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-43321d88-fb83-4ddd-8d49-6b2503ab6f56 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:21.157410 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-43321d88-fb83-4ddd-8d49-6b2503ab6f56 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:21.157858 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-43321d88-fb83-4ddd-8d49-6b2503ab6f56 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:21.158303 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-43321d88-fb83-4ddd-8d49-6b2503ab6f56 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:21.299913 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-43321d88-fb83-4ddd-8d49-6b2503ab6f56 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11beacbd367449d909a0512301b31d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738d5571a8d4f7eb9fbc7c51dfe03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:21.309357 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-43321d88-fb83-4ddd-8d49-6b2503ab6f56 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "GET /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae" status: 200 len: 1687 microversion: 2.1 time: 0.165537 Aug 27 04:04:21.310516 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3631/7213] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:04:21 2022] GET /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae => generated 1687 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:22.333562 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3f0515a8-bd30-4443-b4fc-1e69f194be2b tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:22.334239 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-3f0515a8-bd30-4443-b4fc-1e69f194be2b tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:04:22.341848 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3f0515a8-bd30-4443-b4fc-1e69f194be2b tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:22.342336 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3f0515a8-bd30-4443-b4fc-1e69f194be2b tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:22.342773 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3f0515a8-bd30-4443-b4fc-1e69f194be2b tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:22.343629 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3f0515a8-bd30-4443-b4fc-1e69f194be2b tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:22.344087 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3f0515a8-bd30-4443-b4fc-1e69f194be2b tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:22.344551 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3f0515a8-bd30-4443-b4fc-1e69f194be2b tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:22.494505 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-3f0515a8-bd30-4443-b4fc-1e69f194be2b tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11beacbd367449d909a0512301b31d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738d5571a8d4f7eb9fbc7c51dfe03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:22.502593 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-3f0515a8-bd30-4443-b4fc-1e69f194be2b tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "GET /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae" status: 200 len: 1674 microversion: 2.1 time: 0.174848 Aug 27 04:04:22.503180 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3583/7214] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:04:22 2022] GET /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae => generated 1674 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:05:39.208069 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=11 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:05:39.208942 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=40 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:05:39.210574 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=11 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:05:39.212586 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=31 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:05:39.214490 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e33b779c-ee43-4c84-a085-46dab6c73a12 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:05:39.215051 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-e33b779c-ee43-4c84-a085-46dab6c73a12 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:05:39.224275 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e33b779c-ee43-4c84-a085-46dab6c73a12 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:05:39.224815 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e33b779c-ee43-4c84-a085-46dab6c73a12 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:05:39.225276 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e33b779c-ee43-4c84-a085-46dab6c73a12 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:05:39.225956 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e33b779c-ee43-4c84-a085-46dab6c73a12 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:05:39.226448 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e33b779c-ee43-4c84-a085-46dab6c73a12 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:05:39.226877 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e33b779c-ee43-4c84-a085-46dab6c73a12 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:05:39.254287 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-e33b779c-ee43-4c84-a085-46dab6c73a12 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae] Going to try to terminate instance {{(pid=134051) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:05:39.280035 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-bf76ec49-5fcb-49e6-8f5b-3e513565b74e req-2e06b8ff-47ee-4609-85b7-34fb84247729 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae", "tag": "4ad5abbb-9361-463e-be45-0b499f50c9bd"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:05:39.291016 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-bf76ec49-5fcb-49e6-8f5b-3e513565b74e req-2e06b8ff-47ee-4609-85b7-34fb84247729 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:05:39.291512 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-bf76ec49-5fcb-49e6-8f5b-3e513565b74e req-2e06b8ff-47ee-4609-85b7-34fb84247729 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:05:39.292242 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-bf76ec49-5fcb-49e6-8f5b-3e513565b74e req-2e06b8ff-47ee-4609-85b7-34fb84247729 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:05:39.305582 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-bf76ec49-5fcb-49e6-8f5b-3e513565b74e req-2e06b8ff-47ee-4609-85b7-34fb84247729 service nova] Creating event network-changed:4ad5abbb-9361-463e-be45-0b499f50c9bd for instance 21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae on n-h2-852278-4 Aug 27 04:05:39.311969 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-bf76ec49-5fcb-49e6-8f5b-3e513565b74e req-2e06b8ff-47ee-4609-85b7-34fb84247729 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103867 Aug 27 04:05:39.313445 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3584/7215] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 04:05:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:05:39.345266 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e33b779c-ee43-4c84-a085-46dab6c73a12 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "DELETE /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae" status: 204 len: 0 microversion: 2.1 time: 0.138910 Aug 27 04:05:39.346198 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3632/7216] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 04:05:39 2022] DELETE /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:05:39.356020 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9d7eacc7-3cd0-4d74-8059-5d872a57b431 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:05:39.357070 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-9d7eacc7-3cd0-4d74-8059-5d872a57b431 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:05:39.365465 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9d7eacc7-3cd0-4d74-8059-5d872a57b431 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:05:39.366207 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9d7eacc7-3cd0-4d74-8059-5d872a57b431 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:05:39.366846 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9d7eacc7-3cd0-4d74-8059-5d872a57b431 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:05:39.367725 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9d7eacc7-3cd0-4d74-8059-5d872a57b431 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:05:39.368358 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9d7eacc7-3cd0-4d74-8059-5d872a57b431 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:05:39.368960 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-9d7eacc7-3cd0-4d74-8059-5d872a57b431 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:05:39.503378 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-9d7eacc7-3cd0-4d74-8059-5d872a57b431 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11beacbd367449d909a0512301b31d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738d5571a8d4f7eb9fbc7c51dfe03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:05:39.511584 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9d7eacc7-3cd0-4d74-8059-5d872a57b431 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "GET /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae" status: 200 len: 1680 microversion: 2.1 time: 0.160387 Aug 27 04:05:39.512581 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3585/7217] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:05:39 2022] GET /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:05:40.533789 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-26b8171d-e485-412c-b5d5-1f914a8a41dd tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:05:40.534510 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-26b8171d-e485-412c-b5d5-1f914a8a41dd tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:05:40.542485 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-26b8171d-e485-412c-b5d5-1f914a8a41dd tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:05:40.542985 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-26b8171d-e485-412c-b5d5-1f914a8a41dd tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:05:40.543475 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-26b8171d-e485-412c-b5d5-1f914a8a41dd tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:05:40.544137 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-26b8171d-e485-412c-b5d5-1f914a8a41dd tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:05:40.544643 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-26b8171d-e485-412c-b5d5-1f914a8a41dd tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:05:40.545080 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-26b8171d-e485-412c-b5d5-1f914a8a41dd tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:05:40.781630 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-26b8171d-e485-412c-b5d5-1f914a8a41dd tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11beacbd367449d909a0512301b31d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738d5571a8d4f7eb9fbc7c51dfe03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:05:40.790797 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-26b8171d-e485-412c-b5d5-1f914a8a41dd tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "GET /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae" status: 200 len: 1680 microversion: 2.1 time: 0.260872 Aug 27 04:05:40.791387 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3633/7218] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:05:40 2022] GET /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae => generated 1680 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:05:41.435200 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-d42e3c7d-7ed4-4526-8d24-4c6ffa1f5334 req-7f8041a2-563e-44de-be36-03105a4ca27f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae", "name": "network-vif-deleted", "tag": "4ad5abbb-9361-463e-be45-0b499f50c9bd"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:05:41.446145 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-d42e3c7d-7ed4-4526-8d24-4c6ffa1f5334 req-7f8041a2-563e-44de-be36-03105a4ca27f service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:05:41.446627 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-d42e3c7d-7ed4-4526-8d24-4c6ffa1f5334 req-7f8041a2-563e-44de-be36-03105a4ca27f service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:05:41.447055 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-d42e3c7d-7ed4-4526-8d24-4c6ffa1f5334 req-7f8041a2-563e-44de-be36-03105a4ca27f service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:05:41.460974 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-d42e3c7d-7ed4-4526-8d24-4c6ffa1f5334 req-7f8041a2-563e-44de-be36-03105a4ca27f service nova] Creating event network-vif-deleted:4ad5abbb-9361-463e-be45-0b499f50c9bd for instance 21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae on n-h2-852278-4 Aug 27 04:05:41.466000 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-d42e3c7d-7ed4-4526-8d24-4c6ffa1f5334 req-7f8041a2-563e-44de-be36-03105a4ca27f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034650 Aug 27 04:05:41.466632 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3586/7219] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 04:05:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:05:41.812708 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-14a399fc-c523-4e8c-8069-f39d43d88c0b tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:05:41.813363 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-14a399fc-c523-4e8c-8069-f39d43d88c0b tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:05:41.821294 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-14a399fc-c523-4e8c-8069-f39d43d88c0b tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:05:41.821812 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-14a399fc-c523-4e8c-8069-f39d43d88c0b tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:05:41.822286 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-14a399fc-c523-4e8c-8069-f39d43d88c0b tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:05:41.822995 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-14a399fc-c523-4e8c-8069-f39d43d88c0b tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:05:41.823483 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-14a399fc-c523-4e8c-8069-f39d43d88c0b tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:05:41.823891 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-14a399fc-c523-4e8c-8069-f39d43d88c0b tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:05:41.868190 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-14a399fc-c523-4e8c-8069-f39d43d88c0b tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:05:41.869182 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-14a399fc-c523-4e8c-8069-f39d43d88c0b tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:05:41.869742 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-14a399fc-c523-4e8c-8069-f39d43d88c0b tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:05:41.870163 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.objects.instance [None req-14a399fc-c523-4e8c-8069-f39d43d88c0b tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lazy-loading 'fault' on Instance uuid 21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae {{(pid=134051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:05:41.927487 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-14a399fc-c523-4e8c-8069-f39d43d88c0b tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11beacbd367449d909a0512301b31d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738d5571a8d4f7eb9fbc7c51dfe03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:05:41.936742 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-14a399fc-c523-4e8c-8069-f39d43d88c0b tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "GET /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae" status: 200 len: 1336 microversion: 2.1 time: 0.128052 Aug 27 04:05:41.937497 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3634/7220] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:05:41 2022] GET /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae => generated 1336 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:05:42.959915 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3333f2be-e149-4abc-b7c1-d2e968fc5ffc tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:05:42.960670 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-3333f2be-e149-4abc-b7c1-d2e968fc5ffc tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:05:42.967727 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3333f2be-e149-4abc-b7c1-d2e968fc5ffc tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:05:42.968196 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3333f2be-e149-4abc-b7c1-d2e968fc5ffc tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:05:42.968659 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3333f2be-e149-4abc-b7c1-d2e968fc5ffc tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:05:42.969351 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3333f2be-e149-4abc-b7c1-d2e968fc5ffc tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:05:42.969796 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3333f2be-e149-4abc-b7c1-d2e968fc5ffc tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:05:42.970213 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3333f2be-e149-4abc-b7c1-d2e968fc5ffc tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:05:42.983892 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-3333f2be-e149-4abc-b7c1-d2e968fc5ffc tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] HTTP exception thrown: Instance 21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae could not be found. Aug 27 04:05:42.985579 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3333f2be-e149-4abc-b7c1-d2e968fc5ffc tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Request method failure captured: Aug 27 04:05:42.985579 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae HTTP/1.1 Aug 27 04:05:42.985579 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 04:05:42.985579 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 04:05:42.985579 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 04:05:42.985579 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 04:05:42.985579 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 04:05:42.985579 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 04:05:42.985579 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 04:05:42.985579 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 04:05:42.985579 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCZcQW4DYz2CORcYpu__FZQ_x4uhJM8i0pUFFAGZ5P4xpTMiKoDRepwsuS5pEX0VqAJgIdtJ43Y_iVvj6oB84LilJIUoNkAjvvTBVZZlWbl3KROQPZhsw_f2mSDb0WFvB2o0Si24T3h_fgMoS9eo7TsyX8iGaiSioerg4w3y-AOpj5RY Aug 27 04:05:42.985579 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 04:05:42.985579 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 04:05:42.985579 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 04:05:42.985579 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 04:05:42.985579 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 04:05:42.985579 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 04:05:42.985579 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: f738d5571a8d4f7eb9fbc7c51dfe03d2 Aug 27 04:05:42.985579 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-TestShelveInstance-1035129230 Aug 27 04:05:42.985579 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 04:05:42.985579 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 04:05:42.985579 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f738d5571a8d4f7eb9fbc7c51dfe03d2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f738d5571a8d4f7eb9fbc7c51dfe03d2", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f738d5571a8d4f7eb9fbc7c51dfe03d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f738d5571a8d4f7eb9fbc7c51dfe03d2"}]}] Aug 27 04:05:42.985579 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-TestShelveInstance-1035129230 Aug 27 04:05:42.985579 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: f738d5571a8d4f7eb9fbc7c51dfe03d2 Aug 27 04:05:42.985579 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-TestShelveInstance-1035129230 Aug 27 04:05:42.985579 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-TestShelveInstance-1035129230-project Aug 27 04:05:42.985579 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 04:05:42.985579 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 04:05:42.985579 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: b11beacbd367449d909a0512301b31d2 Aug 27 04:05:42.985579 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-TestShelveInstance-1035129230-project Aug 27 04:05:42.985579 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 04:05:42.985579 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance 21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae could not be found. Aug 27 04:05:42.985579 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae'} Aug 27 04:05:42.985579 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:05:42.985579 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:05:42.985579 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:05:42.985579 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:05:42.985579 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:05:42.985579 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:05:42.985579 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:05:42.985579 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:05:42.985579 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:05:42.985579 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:05:42.985579 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae could not be found. Aug 27 04:05:42.985579 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 04:05:42.985579 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:05:42.985579 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 04:05:42.985579 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:05:42.985579 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:05:42.985579 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:05:42.985579 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:05:42.985579 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:05:42.985579 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:05:42.985579 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:05:42.985579 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:05:42.985579 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:05:42.985579 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:05:42.985579 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:05:42.985579 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:05:42.985579 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:05:42.985579 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae could not be found. Aug 27 04:05:42.985579 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 04:05:42.985579 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:05:42.985579 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 04:05:42.990089 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:05:42.990089 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:05:42.990089 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:05:42.990089 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:05:42.990089 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:05:42.990089 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae could not be found. Aug 27 04:05:42.990089 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 04:05:42.990089 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3333f2be-e149-4abc-b7c1-d2e968fc5ffc tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Returning 404 to user: Instance 21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:05:42.990089 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-3333f2be-e149-4abc-b7c1-d2e968fc5ffc tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "GET /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae" status: 404 len: 111 microversion: 2.1 time: 0.032469 Aug 27 04:05:42.990089 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3587/7221] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:05:42 2022] GET /compute/v2.1/servers/21bfe2bf-b7bc-4b39-a64e-8b7cc570d5ae => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:05:43.180582 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7efbbe84-7007-4fde-b55e-aa78a246cfda tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '.version_select at 0x7f5ede981550>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:05:43.216047 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-7efbbe84-7007-4fde-b55e-aa78a246cfda tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1317715412" status: 202 len: 0 microversion: 2.1 time: 0.039625 Aug 27 04:05:43.216719 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3635/7222] 10.222.0.70 () {58 vars in 1254 bytes} [Sat Aug 27 04:05:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1317715412 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:05:43.238285 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-600e9e8c-1a16-421a-9edd-218053a0c089 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Action: 'create', calling method: .version_select at 0x7f5ee2f8aee0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1761943916", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLB6a8D3AlzB/q7oV+inc9P91NTZWki2uqxVSmmNYh1SfQo89/FzzEanJ9G/lTefOhqicq07jOTnBcmcavTC1f11sewDOrTio8wtz55FOfrqy7xBbGfN3Ns0doLLP7zZiw=="}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:05:43.255104 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-600e9e8c-1a16-421a-9edd-218053a0c089 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Getting quotas for project f738d5571a8d4f7eb9fbc7c51dfe03d2. Resources: {'key_pairs'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:05:43.262716 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-600e9e8c-1a16-421a-9edd-218053a0c089 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Getting quotas for user b11beacbd367449d909a0512301b31d2 and project f738d5571a8d4f7eb9fbc7c51dfe03d2. Resources: {'key_pairs'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:05:43.277455 n-d-852278-4 devstack@n-api.service[134052]: ERROR oslo.messaging._drivers.impl_rabbit [None req-600e9e8c-1a16-421a-9edd-218053a0c089 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [5e9d20ba-68b5-46ec-9fd6-9cb868f4573f] AMQP server on 10.222.0.70:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 27 04:05:44.289276 n-d-852278-4 devstack@n-api.service[134052]: INFO oslo.messaging._drivers.impl_rabbit [None req-600e9e8c-1a16-421a-9edd-218053a0c089 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [5e9d20ba-68b5-46ec-9fd6-9cb868f4573f] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 59886. Aug 27 04:05:44.311078 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-600e9e8c-1a16-421a-9edd-218053a0c089 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 1.076942 Aug 27 04:05:44.311742 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3588/7223] 10.222.0.70 () {60 vars in 1159 bytes} [Sat Aug 27 04:05:43 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:06:01.656328 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:06:01.657146 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:06:01.661145 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-76c810c8-ec62-44f3-82d1-5b9da8b86ff3 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1763095842", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1761943916", "security_groups": [{"name": "tempest-secgroup-smoke-1326230142"}], "networks": [{"uuid": "9e89052a-3731-46a3-bec7-6298ea2e50ce"}], "block_device_mapping_v2": [{"uuid": "b32cb322-dcc2-4ff9-a905-e7755bee2339", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:06:01.779325 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.network.neutron [None req-76c810c8-ec62-44f3-82d1-5b9da8b86ff3 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] validate_networks() for [('9e89052a-3731-46a3-bec7-6298ea2e50ce', None, None, None, None, None)] {{(pid=134051) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:06:02.512215 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-76c810c8-ec62-44f3-82d1-5b9da8b86ff3 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Flavor limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:06:02.512699 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-76c810c8-ec62-44f3-82d1-5b9da8b86ff3 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Image limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:06:02.513226 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-76c810c8-ec62-44f3-82d1-5b9da8b86ff3 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Flavor pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:06:02.513649 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-76c810c8-ec62-44f3-82d1-5b9da8b86ff3 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Image pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:06:02.514080 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-76c810c8-ec62-44f3-82d1-5b9da8b86ff3 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:06:02.524207 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-76c810c8-ec62-44f3-82d1-5b9da8b86ff3 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:02.524743 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-76c810c8-ec62-44f3-82d1-5b9da8b86ff3 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:02.525205 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-76c810c8-ec62-44f3-82d1-5b9da8b86ff3 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:02.525955 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-76c810c8-ec62-44f3-82d1-5b9da8b86ff3 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:02.526427 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-76c810c8-ec62-44f3-82d1-5b9da8b86ff3 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:02.526866 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-76c810c8-ec62-44f3-82d1-5b9da8b86ff3 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:02.545125 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-76c810c8-ec62-44f3-82d1-5b9da8b86ff3 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Getting quotas for project f738d5571a8d4f7eb9fbc7c51dfe03d2. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:06:02.550913 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-76c810c8-ec62-44f3-82d1-5b9da8b86ff3 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Getting quotas for user b11beacbd367449d909a0512301b31d2 and project f738d5571a8d4f7eb9fbc7c51dfe03d2. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:06:02.611288 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-76c810c8-ec62-44f3-82d1-5b9da8b86ff3 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Going to run 1 instances... {{(pid=134051) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:06:02.613527 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-76c810c8-ec62-44f3-82d1-5b9da8b86ff3 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 5d08fcac-077b-4c03-b799-f1beb78ea1f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b32cb322-dcc2-4ff9-a905-e7755bee2339',volume_size=None,volume_type=None)] {{(pid=134051) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:06:02.746123 n-d-852278-4 devstack@n-api.service[134051]: ERROR oslo.messaging._drivers.impl_rabbit [None req-76c810c8-ec62-44f3-82d1-5b9da8b86ff3 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [6698c758-4a05-41fa-9c20-a838e0029970] AMQP server on 10.222.0.70:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 27 04:06:03.754482 n-d-852278-4 devstack@n-api.service[134051]: INFO oslo.messaging._drivers.impl_rabbit [None req-76c810c8-ec62-44f3-82d1-5b9da8b86ff3 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [6698c758-4a05-41fa-9c20-a838e0029970] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 60044. Aug 27 04:06:03.759370 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-76c810c8-ec62-44f3-82d1-5b9da8b86ff3 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.104845 Aug 27 04:06:03.760284 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3636/7224] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 04:06:01 2022] POST /compute/v2.1/servers => generated 406 bytes in 2106 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:06:03.769446 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=12 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:06:03.770216 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=4 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:06:03.770881 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:06:03.774924 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d95cd408-9e40-4d59-aa0b-325076dbbeb5 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:03.775537 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d95cd408-9e40-4d59-aa0b-325076dbbeb5 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 5d08fcac-077b-4c03-b799-f1beb78ea1f5] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:06:03.834733 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-d95cd408-9e40-4d59-aa0b-325076dbbeb5 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11beacbd367449d909a0512301b31d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738d5571a8d4f7eb9fbc7c51dfe03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:03.842590 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d95cd408-9e40-4d59-aa0b-325076dbbeb5 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5" status: 200 len: 1089 microversion: 2.1 time: 0.074991 Aug 27 04:06:03.843183 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3589/7225] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:06:03 2022] GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5 => generated 1089 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:06:04.864072 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c36faffb-245d-48fc-a067-a2fb462c38d7 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:04.864757 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-c36faffb-245d-48fc-a067-a2fb462c38d7 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 5d08fcac-077b-4c03-b799-f1beb78ea1f5] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:06:04.919433 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-c36faffb-245d-48fc-a067-a2fb462c38d7 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11beacbd367449d909a0512301b31d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738d5571a8d4f7eb9fbc7c51dfe03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:04.926693 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c36faffb-245d-48fc-a067-a2fb462c38d7 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5" status: 200 len: 1089 microversion: 2.1 time: 0.067460 Aug 27 04:06:04.927383 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3637/7226] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:06:04 2022] GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5 => generated 1089 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:06:05.951107 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-78daafe0-147f-4456-b7a8-d2a0e8c44b7f tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:05.951773 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-78daafe0-147f-4456-b7a8-d2a0e8c44b7f tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 5d08fcac-077b-4c03-b799-f1beb78ea1f5] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:06:06.010243 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-78daafe0-147f-4456-b7a8-d2a0e8c44b7f tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11beacbd367449d909a0512301b31d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738d5571a8d4f7eb9fbc7c51dfe03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:06.017516 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-78daafe0-147f-4456-b7a8-d2a0e8c44b7f tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5" status: 200 len: 1089 microversion: 2.1 time: 0.070814 Aug 27 04:06:06.018097 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3590/7227] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:06:05 2022] GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5 => generated 1089 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:06:07.040632 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-300b9fbb-d03f-475d-ae68-b701bf074b33 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:07.041250 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-300b9fbb-d03f-475d-ae68-b701bf074b33 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 5d08fcac-077b-4c03-b799-f1beb78ea1f5] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:06:07.103143 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-300b9fbb-d03f-475d-ae68-b701bf074b33 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11beacbd367449d909a0512301b31d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738d5571a8d4f7eb9fbc7c51dfe03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:07.110712 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-300b9fbb-d03f-475d-ae68-b701bf074b33 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5" status: 200 len: 1089 microversion: 2.1 time: 0.074458 Aug 27 04:06:07.124160 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3638/7228] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:06:07 2022] GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5 => generated 1089 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:06:08.134442 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8d4bba24-eb3b-4bae-9104-d367f89598a2 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:08.135050 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-8d4bba24-eb3b-4bae-9104-d367f89598a2 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 5d08fcac-077b-4c03-b799-f1beb78ea1f5] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:06:08.143463 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8d4bba24-eb3b-4bae-9104-d367f89598a2 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:08.143949 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8d4bba24-eb3b-4bae-9104-d367f89598a2 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:08.144416 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8d4bba24-eb3b-4bae-9104-d367f89598a2 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:08.145139 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8d4bba24-eb3b-4bae-9104-d367f89598a2 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:08.145591 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8d4bba24-eb3b-4bae-9104-d367f89598a2 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:08.146015 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-8d4bba24-eb3b-4bae-9104-d367f89598a2 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:08.211880 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-8d4bba24-eb3b-4bae-9104-d367f89598a2 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11beacbd367449d909a0512301b31d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738d5571a8d4f7eb9fbc7c51dfe03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:08.220218 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-8d4bba24-eb3b-4bae-9104-d367f89598a2 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5" status: 200 len: 1139 microversion: 2.1 time: 0.091066 Aug 27 04:06:08.220850 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3591/7229] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:06:08 2022] GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5 => generated 1139 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:06:09.244220 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-88a03c71-90a8-4d7c-872f-b9a2b8689c8c tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:09.245221 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-88a03c71-90a8-4d7c-872f-b9a2b8689c8c tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 5d08fcac-077b-4c03-b799-f1beb78ea1f5] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:06:09.253310 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-88a03c71-90a8-4d7c-872f-b9a2b8689c8c tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:09.253936 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-88a03c71-90a8-4d7c-872f-b9a2b8689c8c tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:09.254620 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-88a03c71-90a8-4d7c-872f-b9a2b8689c8c tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:09.255418 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-88a03c71-90a8-4d7c-872f-b9a2b8689c8c tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:09.256069 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-88a03c71-90a8-4d7c-872f-b9a2b8689c8c tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:09.256869 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-88a03c71-90a8-4d7c-872f-b9a2b8689c8c tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:09.367208 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-88a03c71-90a8-4d7c-872f-b9a2b8689c8c tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11beacbd367449d909a0512301b31d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738d5571a8d4f7eb9fbc7c51dfe03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:09.381089 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-88a03c71-90a8-4d7c-872f-b9a2b8689c8c tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5" status: 200 len: 1205 microversion: 2.1 time: 0.141360 Aug 27 04:06:09.382816 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3639/7230] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:06:09 2022] GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5 => generated 1205 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:06:10.402442 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-f5cb24d0-8434-4fbb-9331-426622b2c769 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:10.403095 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-f5cb24d0-8434-4fbb-9331-426622b2c769 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 5d08fcac-077b-4c03-b799-f1beb78ea1f5] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:06:10.411100 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f5cb24d0-8434-4fbb-9331-426622b2c769 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:10.411590 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f5cb24d0-8434-4fbb-9331-426622b2c769 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:10.412026 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f5cb24d0-8434-4fbb-9331-426622b2c769 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:10.412808 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f5cb24d0-8434-4fbb-9331-426622b2c769 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:10.413332 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f5cb24d0-8434-4fbb-9331-426622b2c769 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:10.413764 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-f5cb24d0-8434-4fbb-9331-426622b2c769 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:10.576666 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-f5320d03-5923-428d-8dd1-a9c71bc2128f req-0404775f-7f6a-4365-a74e-b9b0fc5fe607 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d08fcac-077b-4c03-b799-f1beb78ea1f5", "tag": "870c209d-c0a6-46d2-83c3-57a0c1427384"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:06:10.592156 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-f5320d03-5923-428d-8dd1-a9c71bc2128f req-0404775f-7f6a-4365-a74e-b9b0fc5fe607 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:10.594112 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-f5320d03-5923-428d-8dd1-a9c71bc2128f req-0404775f-7f6a-4365-a74e-b9b0fc5fe607 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:10.594824 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-f5320d03-5923-428d-8dd1-a9c71bc2128f req-0404775f-7f6a-4365-a74e-b9b0fc5fe607 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:10.608722 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-f5320d03-5923-428d-8dd1-a9c71bc2128f req-0404775f-7f6a-4365-a74e-b9b0fc5fe607 service nova] Creating event network-changed:870c209d-c0a6-46d2-83c3-57a0c1427384 for instance 5d08fcac-077b-4c03-b799-f1beb78ea1f5 on n-h1-852278-4 Aug 27 04:06:10.630783 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-f5320d03-5923-428d-8dd1-a9c71bc2128f req-0404775f-7f6a-4365-a74e-b9b0fc5fe607 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058059 Aug 27 04:06:10.632174 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3640/7231] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 04:06:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:06:10.660200 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-f5cb24d0-8434-4fbb-9331-426622b2c769 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11beacbd367449d909a0512301b31d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738d5571a8d4f7eb9fbc7c51dfe03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:10.671727 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-f5cb24d0-8434-4fbb-9331-426622b2c769 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5" status: 200 len: 1273 microversion: 2.1 time: 0.271924 Aug 27 04:06:10.671727 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3592/7232] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:06:10 2022] GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5 => generated 1273 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:06:11.693109 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7a51955c-0460-46f2-9d2e-fa54f3774bdd tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:11.693981 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-7a51955c-0460-46f2-9d2e-fa54f3774bdd tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 5d08fcac-077b-4c03-b799-f1beb78ea1f5] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:06:11.701961 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7a51955c-0460-46f2-9d2e-fa54f3774bdd tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:11.702460 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7a51955c-0460-46f2-9d2e-fa54f3774bdd tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:11.703134 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7a51955c-0460-46f2-9d2e-fa54f3774bdd tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:11.704053 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7a51955c-0460-46f2-9d2e-fa54f3774bdd tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:11.704601 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7a51955c-0460-46f2-9d2e-fa54f3774bdd tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:11.705228 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7a51955c-0460-46f2-9d2e-fa54f3774bdd tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:11.858013 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-7a51955c-0460-46f2-9d2e-fa54f3774bdd tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11beacbd367449d909a0512301b31d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738d5571a8d4f7eb9fbc7c51dfe03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:11.866632 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-7a51955c-0460-46f2-9d2e-fa54f3774bdd tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5" status: 200 len: 1273 microversion: 2.1 time: 0.179020 Aug 27 04:06:11.867294 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3641/7233] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:06:11 2022] GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5 => generated 1273 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:06:12.888160 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e60d7df9-6ec4-4029-9ed7-e2bc492bd969 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:12.888865 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-e60d7df9-6ec4-4029-9ed7-e2bc492bd969 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 5d08fcac-077b-4c03-b799-f1beb78ea1f5] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:06:12.895922 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e60d7df9-6ec4-4029-9ed7-e2bc492bd969 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:12.896429 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e60d7df9-6ec4-4029-9ed7-e2bc492bd969 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:12.896983 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e60d7df9-6ec4-4029-9ed7-e2bc492bd969 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:12.897733 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e60d7df9-6ec4-4029-9ed7-e2bc492bd969 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:12.898184 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e60d7df9-6ec4-4029-9ed7-e2bc492bd969 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:12.898608 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e60d7df9-6ec4-4029-9ed7-e2bc492bd969 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:13.045434 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-e60d7df9-6ec4-4029-9ed7-e2bc492bd969 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11beacbd367449d909a0512301b31d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738d5571a8d4f7eb9fbc7c51dfe03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:13.054297 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e60d7df9-6ec4-4029-9ed7-e2bc492bd969 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5" status: 200 len: 1273 microversion: 2.1 time: 0.170218 Aug 27 04:06:13.054906 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3593/7234] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:06:12 2022] GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5 => generated 1273 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:06:14.078505 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e9c9bc09-11cc-4122-a711-334da7e07385 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:14.081443 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-e9c9bc09-11cc-4122-a711-334da7e07385 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 5d08fcac-077b-4c03-b799-f1beb78ea1f5] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:06:14.084923 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:06:14.093025 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e9c9bc09-11cc-4122-a711-334da7e07385 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:14.093744 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e9c9bc09-11cc-4122-a711-334da7e07385 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:14.094289 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e9c9bc09-11cc-4122-a711-334da7e07385 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:14.095160 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e9c9bc09-11cc-4122-a711-334da7e07385 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:14.095742 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e9c9bc09-11cc-4122-a711-334da7e07385 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:14.096200 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e9c9bc09-11cc-4122-a711-334da7e07385 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:14.260512 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e9c9bc09-11cc-4122-a711-334da7e07385 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11beacbd367449d909a0512301b31d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738d5571a8d4f7eb9fbc7c51dfe03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:14.269199 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e9c9bc09-11cc-4122-a711-334da7e07385 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5" status: 200 len: 1273 microversion: 2.1 time: 0.197525 Aug 27 04:06:14.269852 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3642/7235] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:06:14 2022] GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5 => generated 1273 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:06:15.290587 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-76edfea7-c2f7-49bd-af36-ba0579447795 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:15.291142 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-76edfea7-c2f7-49bd-af36-ba0579447795 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 5d08fcac-077b-4c03-b799-f1beb78ea1f5] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:06:15.299165 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-76edfea7-c2f7-49bd-af36-ba0579447795 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:15.299655 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-76edfea7-c2f7-49bd-af36-ba0579447795 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:15.300086 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-76edfea7-c2f7-49bd-af36-ba0579447795 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:15.300837 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-76edfea7-c2f7-49bd-af36-ba0579447795 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:15.301282 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-76edfea7-c2f7-49bd-af36-ba0579447795 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:15.301702 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-76edfea7-c2f7-49bd-af36-ba0579447795 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:15.459560 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-76edfea7-c2f7-49bd-af36-ba0579447795 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11beacbd367449d909a0512301b31d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738d5571a8d4f7eb9fbc7c51dfe03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:15.468588 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-76edfea7-c2f7-49bd-af36-ba0579447795 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5" status: 200 len: 1261 microversion: 2.1 time: 0.182245 Aug 27 04:06:15.469236 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3594/7236] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:06:15 2022] GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5 => generated 1261 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:06:16.490859 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e6dce154-72fd-4847-8b8d-652616d2b506 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:16.491516 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-e6dce154-72fd-4847-8b8d-652616d2b506 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 5d08fcac-077b-4c03-b799-f1beb78ea1f5] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:06:16.499681 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e6dce154-72fd-4847-8b8d-652616d2b506 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:16.500287 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e6dce154-72fd-4847-8b8d-652616d2b506 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:16.500781 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e6dce154-72fd-4847-8b8d-652616d2b506 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:16.501610 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e6dce154-72fd-4847-8b8d-652616d2b506 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:16.502087 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e6dce154-72fd-4847-8b8d-652616d2b506 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:16.502593 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e6dce154-72fd-4847-8b8d-652616d2b506 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:16.651685 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e6dce154-72fd-4847-8b8d-652616d2b506 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11beacbd367449d909a0512301b31d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738d5571a8d4f7eb9fbc7c51dfe03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:16.660579 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e6dce154-72fd-4847-8b8d-652616d2b506 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5" status: 200 len: 1261 microversion: 2.1 time: 0.173824 Aug 27 04:06:16.661221 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3643/7237] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:06:16 2022] GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5 => generated 1261 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:06:17.682208 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-66e60b50-466e-4d2e-916a-57b2db7dd1bf tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:17.682924 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-66e60b50-466e-4d2e-916a-57b2db7dd1bf tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 5d08fcac-077b-4c03-b799-f1beb78ea1f5] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:06:17.685076 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=4 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:06:17.694835 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-66e60b50-466e-4d2e-916a-57b2db7dd1bf tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:17.695329 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-66e60b50-466e-4d2e-916a-57b2db7dd1bf tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:17.695767 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-66e60b50-466e-4d2e-916a-57b2db7dd1bf tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:17.696535 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-66e60b50-466e-4d2e-916a-57b2db7dd1bf tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:17.696988 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-66e60b50-466e-4d2e-916a-57b2db7dd1bf tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:17.697411 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-66e60b50-466e-4d2e-916a-57b2db7dd1bf tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:17.844991 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-66e60b50-466e-4d2e-916a-57b2db7dd1bf tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11beacbd367449d909a0512301b31d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738d5571a8d4f7eb9fbc7c51dfe03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:17.853958 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-66e60b50-466e-4d2e-916a-57b2db7dd1bf tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5" status: 200 len: 1261 microversion: 2.1 time: 0.175972 Aug 27 04:06:17.854799 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3595/7238] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:06:17 2022] GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5 => generated 1261 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:06:18.880107 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-79f7c1b8-00d7-4b41-a1e0-be8ca413a0ed tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:18.880729 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-79f7c1b8-00d7-4b41-a1e0-be8ca413a0ed tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 5d08fcac-077b-4c03-b799-f1beb78ea1f5] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:06:18.882716 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=10 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:06:18.889874 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-79f7c1b8-00d7-4b41-a1e0-be8ca413a0ed tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:18.890372 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-79f7c1b8-00d7-4b41-a1e0-be8ca413a0ed tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:18.890819 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-79f7c1b8-00d7-4b41-a1e0-be8ca413a0ed tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:18.891580 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-79f7c1b8-00d7-4b41-a1e0-be8ca413a0ed tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:18.892037 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-79f7c1b8-00d7-4b41-a1e0-be8ca413a0ed tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:18.892491 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-79f7c1b8-00d7-4b41-a1e0-be8ca413a0ed tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:19.049995 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-79f7c1b8-00d7-4b41-a1e0-be8ca413a0ed tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11beacbd367449d909a0512301b31d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738d5571a8d4f7eb9fbc7c51dfe03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:19.058793 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-79f7c1b8-00d7-4b41-a1e0-be8ca413a0ed tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5" status: 200 len: 1261 microversion: 2.1 time: 0.182661 Aug 27 04:06:19.059476 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3644/7239] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:06:18 2022] GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5 => generated 1261 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:06:20.080125 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-5d97e955-8b14-46ba-a433-d9dde724c999 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:20.080924 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-5d97e955-8b14-46ba-a433-d9dde724c999 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 5d08fcac-077b-4c03-b799-f1beb78ea1f5] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:06:20.087815 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5d97e955-8b14-46ba-a433-d9dde724c999 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:20.088296 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5d97e955-8b14-46ba-a433-d9dde724c999 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:20.088748 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5d97e955-8b14-46ba-a433-d9dde724c999 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:20.089444 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5d97e955-8b14-46ba-a433-d9dde724c999 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:20.089883 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5d97e955-8b14-46ba-a433-d9dde724c999 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:20.090358 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-5d97e955-8b14-46ba-a433-d9dde724c999 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:20.236207 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-5d97e955-8b14-46ba-a433-d9dde724c999 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11beacbd367449d909a0512301b31d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738d5571a8d4f7eb9fbc7c51dfe03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:20.245047 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-5d97e955-8b14-46ba-a433-d9dde724c999 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5" status: 200 len: 1261 microversion: 2.1 time: 0.169059 Aug 27 04:06:20.245654 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3596/7240] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:06:20 2022] GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5 => generated 1261 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:06:21.266540 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-6cc59dd8-d78e-4b71-8227-61bc841f89b8 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:21.267093 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-6cc59dd8-d78e-4b71-8227-61bc841f89b8 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 5d08fcac-077b-4c03-b799-f1beb78ea1f5] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:06:21.274688 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6cc59dd8-d78e-4b71-8227-61bc841f89b8 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:21.275205 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6cc59dd8-d78e-4b71-8227-61bc841f89b8 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:21.275660 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6cc59dd8-d78e-4b71-8227-61bc841f89b8 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:21.276424 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6cc59dd8-d78e-4b71-8227-61bc841f89b8 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:21.277028 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6cc59dd8-d78e-4b71-8227-61bc841f89b8 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:21.277461 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6cc59dd8-d78e-4b71-8227-61bc841f89b8 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:21.419209 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-6cc59dd8-d78e-4b71-8227-61bc841f89b8 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11beacbd367449d909a0512301b31d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738d5571a8d4f7eb9fbc7c51dfe03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:21.427813 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-6cc59dd8-d78e-4b71-8227-61bc841f89b8 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5" status: 200 len: 1261 microversion: 2.1 time: 0.165320 Aug 27 04:06:21.428431 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3645/7241] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:06:21 2022] GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5 => generated 1261 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:06:22.449119 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a48f9424-3243-4a62-8e9b-ab53be6f1baf tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:22.449804 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a48f9424-3243-4a62-8e9b-ab53be6f1baf tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 5d08fcac-077b-4c03-b799-f1beb78ea1f5] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:06:22.457164 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a48f9424-3243-4a62-8e9b-ab53be6f1baf tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:22.457650 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a48f9424-3243-4a62-8e9b-ab53be6f1baf tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:22.458160 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a48f9424-3243-4a62-8e9b-ab53be6f1baf tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:22.460359 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a48f9424-3243-4a62-8e9b-ab53be6f1baf tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:22.460359 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a48f9424-3243-4a62-8e9b-ab53be6f1baf tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:22.460359 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a48f9424-3243-4a62-8e9b-ab53be6f1baf tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:22.613191 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-a48f9424-3243-4a62-8e9b-ab53be6f1baf tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11beacbd367449d909a0512301b31d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738d5571a8d4f7eb9fbc7c51dfe03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:22.623862 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a48f9424-3243-4a62-8e9b-ab53be6f1baf tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5" status: 200 len: 1261 microversion: 2.1 time: 0.178684 Aug 27 04:06:22.624532 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3597/7242] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:06:22 2022] GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5 => generated 1261 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:06:23.645750 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-2aca428d-7eba-4779-a2cc-f17b0290e2e3 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:23.646514 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-2aca428d-7eba-4779-a2cc-f17b0290e2e3 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 5d08fcac-077b-4c03-b799-f1beb78ea1f5] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:06:23.654890 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2aca428d-7eba-4779-a2cc-f17b0290e2e3 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:23.655405 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2aca428d-7eba-4779-a2cc-f17b0290e2e3 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:23.655913 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2aca428d-7eba-4779-a2cc-f17b0290e2e3 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:23.656722 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2aca428d-7eba-4779-a2cc-f17b0290e2e3 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:23.657199 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2aca428d-7eba-4779-a2cc-f17b0290e2e3 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:23.658065 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2aca428d-7eba-4779-a2cc-f17b0290e2e3 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:23.806895 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-2aca428d-7eba-4779-a2cc-f17b0290e2e3 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11beacbd367449d909a0512301b31d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738d5571a8d4f7eb9fbc7c51dfe03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:23.818507 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-2aca428d-7eba-4779-a2cc-f17b0290e2e3 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5" status: 200 len: 1261 microversion: 2.1 time: 0.177112 Aug 27 04:06:23.819550 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3646/7243] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:06:23 2022] GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5 => generated 1261 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:06:24.140264 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-100146f7-8a64-456c-9994-5e6b1b735d8a req-20ed6f85-1dea-42f5-bb50-88174ea04008 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d08fcac-077b-4c03-b799-f1beb78ea1f5", "name": "network-vif-plugged", "status": "completed", "tag": "870c209d-c0a6-46d2-83c3-57a0c1427384"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:06:24.152589 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-100146f7-8a64-456c-9994-5e6b1b735d8a req-20ed6f85-1dea-42f5-bb50-88174ea04008 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:24.152995 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-100146f7-8a64-456c-9994-5e6b1b735d8a req-20ed6f85-1dea-42f5-bb50-88174ea04008 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:24.153449 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-100146f7-8a64-456c-9994-5e6b1b735d8a req-20ed6f85-1dea-42f5-bb50-88174ea04008 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:24.166299 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-100146f7-8a64-456c-9994-5e6b1b735d8a req-20ed6f85-1dea-42f5-bb50-88174ea04008 service nova] Creating event network-vif-plugged:870c209d-c0a6-46d2-83c3-57a0c1427384 for instance 5d08fcac-077b-4c03-b799-f1beb78ea1f5 on n-h1-852278-4 Aug 27 04:06:24.171761 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-100146f7-8a64-456c-9994-5e6b1b735d8a req-20ed6f85-1dea-42f5-bb50-88174ea04008 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035652 Aug 27 04:06:24.172600 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3598/7244] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 04:06:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:06:24.891468 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-6a68b350-b82f-4454-ac9e-fc43679ad00a tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:24.892095 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-6a68b350-b82f-4454-ac9e-fc43679ad00a tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 5d08fcac-077b-4c03-b799-f1beb78ea1f5] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:06:24.898261 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6a68b350-b82f-4454-ac9e-fc43679ad00a tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:24.898804 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6a68b350-b82f-4454-ac9e-fc43679ad00a tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:24.899271 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6a68b350-b82f-4454-ac9e-fc43679ad00a tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:24.899968 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6a68b350-b82f-4454-ac9e-fc43679ad00a tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:24.900455 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6a68b350-b82f-4454-ac9e-fc43679ad00a tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:24.900921 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6a68b350-b82f-4454-ac9e-fc43679ad00a tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:25.047448 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-6a68b350-b82f-4454-ac9e-fc43679ad00a tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11beacbd367449d909a0512301b31d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738d5571a8d4f7eb9fbc7c51dfe03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:25.055961 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-6a68b350-b82f-4454-ac9e-fc43679ad00a tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5" status: 200 len: 1261 microversion: 2.1 time: 0.219986 Aug 27 04:06:25.056739 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3647/7245] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:06:24 2022] GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5 => generated 1261 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:06:26.083092 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c80f69bc-4bf5-42db-acef-f4ccc832860b tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:26.083797 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-c80f69bc-4bf5-42db-acef-f4ccc832860b tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 5d08fcac-077b-4c03-b799-f1beb78ea1f5] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:06:26.090553 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c80f69bc-4bf5-42db-acef-f4ccc832860b tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:26.091036 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c80f69bc-4bf5-42db-acef-f4ccc832860b tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:26.091478 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c80f69bc-4bf5-42db-acef-f4ccc832860b tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:26.092185 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c80f69bc-4bf5-42db-acef-f4ccc832860b tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:26.092685 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c80f69bc-4bf5-42db-acef-f4ccc832860b tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:26.093134 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c80f69bc-4bf5-42db-acef-f4ccc832860b tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:26.234270 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-c80f69bc-4bf5-42db-acef-f4ccc832860b tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11beacbd367449d909a0512301b31d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738d5571a8d4f7eb9fbc7c51dfe03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:26.243612 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c80f69bc-4bf5-42db-acef-f4ccc832860b tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5" status: 200 len: 1444 microversion: 2.1 time: 0.168950 Aug 27 04:06:26.244222 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3599/7246] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:06:26 2022] GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5 => generated 1444 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:06:26.265952 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0e88e871-473f-4b77-9e9b-7d5cbd6adf7c tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:26.266551 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-0e88e871-473f-4b77-9e9b-7d5cbd6adf7c tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 5d08fcac-077b-4c03-b799-f1beb78ea1f5] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:06:26.273363 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0e88e871-473f-4b77-9e9b-7d5cbd6adf7c tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:26.273870 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0e88e871-473f-4b77-9e9b-7d5cbd6adf7c tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:26.274330 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0e88e871-473f-4b77-9e9b-7d5cbd6adf7c tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:26.275101 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0e88e871-473f-4b77-9e9b-7d5cbd6adf7c tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:26.275570 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0e88e871-473f-4b77-9e9b-7d5cbd6adf7c tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:26.276010 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0e88e871-473f-4b77-9e9b-7d5cbd6adf7c tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:26.426589 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-0e88e871-473f-4b77-9e9b-7d5cbd6adf7c tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11beacbd367449d909a0512301b31d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738d5571a8d4f7eb9fbc7c51dfe03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:26.435583 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-0e88e871-473f-4b77-9e9b-7d5cbd6adf7c tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5" status: 200 len: 1444 microversion: 2.1 time: 0.173687 Aug 27 04:06:26.436106 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3648/7247] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:06:26 2022] GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5 => generated 1444 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:06:28.449205 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-e999c86b-6bda-4bb2-a31f-c735e83c3c73 req-7d219df7-c8c0-4630-b917-c83d016fd9a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d08fcac-077b-4c03-b799-f1beb78ea1f5", "tag": "870c209d-c0a6-46d2-83c3-57a0c1427384"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:06:28.460237 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-e999c86b-6bda-4bb2-a31f-c735e83c3c73 req-7d219df7-c8c0-4630-b917-c83d016fd9a4 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:28.461163 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-e999c86b-6bda-4bb2-a31f-c735e83c3c73 req-7d219df7-c8c0-4630-b917-c83d016fd9a4 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:28.461386 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-e999c86b-6bda-4bb2-a31f-c735e83c3c73 req-7d219df7-c8c0-4630-b917-c83d016fd9a4 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:28.484342 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-e999c86b-6bda-4bb2-a31f-c735e83c3c73 req-7d219df7-c8c0-4630-b917-c83d016fd9a4 service nova] Creating event network-changed:870c209d-c0a6-46d2-83c3-57a0c1427384 for instance 5d08fcac-077b-4c03-b799-f1beb78ea1f5 on n-h1-852278-4 Aug 27 04:06:28.489897 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-e999c86b-6bda-4bb2-a31f-c735e83c3c73 req-7d219df7-c8c0-4630-b917-c83d016fd9a4 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044704 Aug 27 04:06:28.493645 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3600/7248] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 04:06:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:08:23.761829 n-d-852278-4 devstack@n-api.service[134051]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f9fac4be-af37-4094-9325-9fb8d6a54e45] AMQP server on 10.222.0.70:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 04:08:23.762731 n-d-852278-4 devstack@n-api.service[134051]: ERROR oslo.messaging._drivers.impl_rabbit [-] [467acb70-6ff8-442b-874d-8e7c3cdab9ba] AMQP server on 10.222.0.70:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 04:08:23.763561 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:08:23.764343 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=58 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:08:23.766020 n-d-852278-4 devstack@n-api.service[134051]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 27 04:08:23.766164 n-d-852278-4 devstack@n-api.service[134051]: Sat Aug 27 04:08:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5/action (ip 10.222.0.70) !!! Aug 27 04:08:23.771276 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-2d663e1b-9bce-4ce8-92b6-8a9432a9e038 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:08:23.771819 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-2d663e1b-9bce-4ce8-92b6-8a9432a9e038 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 5d08fcac-077b-4c03-b799-f1beb78ea1f5] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:08:23.781386 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2d663e1b-9bce-4ce8-92b6-8a9432a9e038 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:23.781898 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2d663e1b-9bce-4ce8-92b6-8a9432a9e038 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:23.782363 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2d663e1b-9bce-4ce8-92b6-8a9432a9e038 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:23.783136 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2d663e1b-9bce-4ce8-92b6-8a9432a9e038 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:23.783596 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2d663e1b-9bce-4ce8-92b6-8a9432a9e038 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:23.784037 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2d663e1b-9bce-4ce8-92b6-8a9432a9e038 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:23.810670 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.objects.instance [None req-2d663e1b-9bce-4ce8-92b6-8a9432a9e038 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lazy-loading 'flavor' on Instance uuid 5d08fcac-077b-4c03-b799-f1beb78ea1f5 {{(pid=134051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:08:23.896947 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-2d663e1b-9bce-4ce8-92b6-8a9432a9e038 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "POST /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5/action" status: 202 len: 0 microversion: 2.1 time: 0.136286 Aug 27 04:08:23.897394 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3649/7249] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 04:08:23 2022] POST /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:08:23.904744 n-d-852278-4 devstack@n-api.service[134052]: ERROR oslo.messaging._drivers.impl_rabbit [-] [998cde6e-8682-4408-bcc9-d1ac55bd7468] AMQP server on 10.222.0.70:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 27 04:08:23.905835 n-d-852278-4 devstack@n-api.service[134052]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9851ddbb-a5ae-40a5-a271-3fff08a3a780] AMQP server on 10.222.0.70:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 27 04:08:23.906588 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=28 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:08:23.907652 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=52 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:08:23.910734 n-d-852278-4 devstack@n-api.service[134052]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:08:23.911224 n-d-852278-4 devstack@n-api.service[134052]: Sat Aug 27 04:08:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5 (ip 10.222.0.70) !!! Aug 27 04:08:23.929985 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d3cc3896-3ff6-442d-a3c2-43ed79349034 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:23.931095 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d3cc3896-3ff6-442d-a3c2-43ed79349034 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 5d08fcac-077b-4c03-b799-f1beb78ea1f5] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:08:23.944343 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d3cc3896-3ff6-442d-a3c2-43ed79349034 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:23.945094 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d3cc3896-3ff6-442d-a3c2-43ed79349034 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:23.945746 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d3cc3896-3ff6-442d-a3c2-43ed79349034 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:23.946875 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d3cc3896-3ff6-442d-a3c2-43ed79349034 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:23.947649 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d3cc3896-3ff6-442d-a3c2-43ed79349034 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:23.948631 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d3cc3896-3ff6-442d-a3c2-43ed79349034 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:24.095727 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-d3cc3896-3ff6-442d-a3c2-43ed79349034 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11beacbd367449d909a0512301b31d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738d5571a8d4f7eb9fbc7c51dfe03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:24.104322 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d3cc3896-3ff6-442d-a3c2-43ed79349034 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5" status: 200 len: 1569 microversion: 2.1 time: 0.201724 Aug 27 04:08:24.105000 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3601/7250] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:08:23 2022] GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5 => generated 1569 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:08:25.131585 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-1771045c-e6ea-4c25-ad43-9ba2e01101af tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:25.132304 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-1771045c-e6ea-4c25-ad43-9ba2e01101af tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 5d08fcac-077b-4c03-b799-f1beb78ea1f5] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:08:25.141182 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1771045c-e6ea-4c25-ad43-9ba2e01101af tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:25.141687 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1771045c-e6ea-4c25-ad43-9ba2e01101af tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:25.142139 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1771045c-e6ea-4c25-ad43-9ba2e01101af tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:25.142854 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1771045c-e6ea-4c25-ad43-9ba2e01101af tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:25.143321 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1771045c-e6ea-4c25-ad43-9ba2e01101af tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:25.143758 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-1771045c-e6ea-4c25-ad43-9ba2e01101af tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:25.148868 n-d-852278-4 devstack@n-api.service[134051]: INFO oslo.messaging._drivers.impl_rabbit [-] [467acb70-6ff8-442b-874d-8e7c3cdab9ba] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 60166. Aug 27 04:08:25.149608 n-d-852278-4 devstack@n-api.service[134051]: INFO oslo.messaging._drivers.impl_rabbit [-] [f9fac4be-af37-4094-9325-9fb8d6a54e45] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 60164. Aug 27 04:08:25.287282 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-1771045c-e6ea-4c25-ad43-9ba2e01101af tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11beacbd367449d909a0512301b31d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738d5571a8d4f7eb9fbc7c51dfe03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:25.300416 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-1771045c-e6ea-4c25-ad43-9ba2e01101af tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5" status: 200 len: 1569 microversion: 2.1 time: 0.176845 Aug 27 04:08:25.301398 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3650/7251] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:08:25 2022] GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5 => generated 1569 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:08:26.322927 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-7b085970-d4d4-4668-b99c-666d20314b10 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:26.323554 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-7b085970-d4d4-4668-b99c-666d20314b10 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 5d08fcac-077b-4c03-b799-f1beb78ea1f5] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:08:26.334974 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7b085970-d4d4-4668-b99c-666d20314b10 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:26.335457 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7b085970-d4d4-4668-b99c-666d20314b10 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:26.335885 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7b085970-d4d4-4668-b99c-666d20314b10 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:26.336620 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7b085970-d4d4-4668-b99c-666d20314b10 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:26.337057 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7b085970-d4d4-4668-b99c-666d20314b10 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:26.337473 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7b085970-d4d4-4668-b99c-666d20314b10 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:26.346806 n-d-852278-4 devstack@n-api.service[134052]: INFO oslo.messaging._drivers.impl_rabbit [-] [998cde6e-8682-4408-bcc9-d1ac55bd7468] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 60170. Aug 27 04:08:26.357552 n-d-852278-4 devstack@n-api.service[134052]: INFO oslo.messaging._drivers.impl_rabbit [-] [9851ddbb-a5ae-40a5-a271-3fff08a3a780] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 60172. Aug 27 04:08:26.482485 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-7b085970-d4d4-4668-b99c-666d20314b10 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11beacbd367449d909a0512301b31d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738d5571a8d4f7eb9fbc7c51dfe03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:26.491615 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-7b085970-d4d4-4668-b99c-666d20314b10 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5" status: 200 len: 1569 microversion: 2.1 time: 0.172804 Aug 27 04:08:26.492195 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3602/7252] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:08:26 2022] GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5 => generated 1569 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:08:27.517460 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-bd7dc80d-c070-4ad4-ac64-5cbc30227161 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:27.518463 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-bd7dc80d-c070-4ad4-ac64-5cbc30227161 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 5d08fcac-077b-4c03-b799-f1beb78ea1f5] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:08:27.526704 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bd7dc80d-c070-4ad4-ac64-5cbc30227161 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:27.527213 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bd7dc80d-c070-4ad4-ac64-5cbc30227161 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:27.527662 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bd7dc80d-c070-4ad4-ac64-5cbc30227161 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:27.528418 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bd7dc80d-c070-4ad4-ac64-5cbc30227161 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:27.528883 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bd7dc80d-c070-4ad4-ac64-5cbc30227161 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:27.529319 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-bd7dc80d-c070-4ad4-ac64-5cbc30227161 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:27.671915 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-bd7dc80d-c070-4ad4-ac64-5cbc30227161 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11beacbd367449d909a0512301b31d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738d5571a8d4f7eb9fbc7c51dfe03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:27.681609 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-bd7dc80d-c070-4ad4-ac64-5cbc30227161 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5" status: 200 len: 1569 microversion: 2.1 time: 0.170785 Aug 27 04:08:27.682247 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3651/7253] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:08:27 2022] GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5 => generated 1569 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:08:28.702957 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-35dd089c-c057-419b-ab2b-adf7921c8917 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:28.703564 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-35dd089c-c057-419b-ab2b-adf7921c8917 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 5d08fcac-077b-4c03-b799-f1beb78ea1f5] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:08:28.711015 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-35dd089c-c057-419b-ab2b-adf7921c8917 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:28.711423 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-35dd089c-c057-419b-ab2b-adf7921c8917 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:28.711848 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-35dd089c-c057-419b-ab2b-adf7921c8917 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:28.712565 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-35dd089c-c057-419b-ab2b-adf7921c8917 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:28.712997 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-35dd089c-c057-419b-ab2b-adf7921c8917 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:28.713435 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-35dd089c-c057-419b-ab2b-adf7921c8917 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:28.867280 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-35dd089c-c057-419b-ab2b-adf7921c8917 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11beacbd367449d909a0512301b31d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738d5571a8d4f7eb9fbc7c51dfe03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:28.876040 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-35dd089c-c057-419b-ab2b-adf7921c8917 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5" status: 200 len: 1569 microversion: 2.1 time: 0.177113 Aug 27 04:08:28.876680 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3603/7254] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:08:28 2022] GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5 => generated 1569 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:08:29.897207 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-6c4137f4-af27-4486-a95a-8f2fddc51ba1 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:29.897852 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-6c4137f4-af27-4486-a95a-8f2fddc51ba1 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 5d08fcac-077b-4c03-b799-f1beb78ea1f5] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:08:29.905565 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6c4137f4-af27-4486-a95a-8f2fddc51ba1 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:29.906070 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6c4137f4-af27-4486-a95a-8f2fddc51ba1 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:29.906540 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6c4137f4-af27-4486-a95a-8f2fddc51ba1 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:29.907263 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6c4137f4-af27-4486-a95a-8f2fddc51ba1 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:29.907737 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6c4137f4-af27-4486-a95a-8f2fddc51ba1 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:29.908180 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6c4137f4-af27-4486-a95a-8f2fddc51ba1 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:30.049546 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-6c4137f4-af27-4486-a95a-8f2fddc51ba1 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11beacbd367449d909a0512301b31d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738d5571a8d4f7eb9fbc7c51dfe03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:30.058324 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-6c4137f4-af27-4486-a95a-8f2fddc51ba1 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5" status: 200 len: 1569 microversion: 2.1 time: 0.165256 Aug 27 04:08:30.058931 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3652/7255] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:08:29 2022] GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5 => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:08:31.079300 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e147942a-a99f-4014-8fb0-a8cecbe9e80c tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:31.079906 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-e147942a-a99f-4014-8fb0-a8cecbe9e80c tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 5d08fcac-077b-4c03-b799-f1beb78ea1f5] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:08:31.087261 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e147942a-a99f-4014-8fb0-a8cecbe9e80c tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:31.087759 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e147942a-a99f-4014-8fb0-a8cecbe9e80c tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:31.088197 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e147942a-a99f-4014-8fb0-a8cecbe9e80c tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:31.089138 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e147942a-a99f-4014-8fb0-a8cecbe9e80c tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:31.089592 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e147942a-a99f-4014-8fb0-a8cecbe9e80c tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:31.090015 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e147942a-a99f-4014-8fb0-a8cecbe9e80c tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:31.241922 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-e147942a-a99f-4014-8fb0-a8cecbe9e80c tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11beacbd367449d909a0512301b31d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738d5571a8d4f7eb9fbc7c51dfe03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:31.251138 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e147942a-a99f-4014-8fb0-a8cecbe9e80c tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5" status: 200 len: 1569 microversion: 2.1 time: 0.175790 Aug 27 04:08:31.251757 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3604/7256] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:08:31 2022] GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5 => generated 1569 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:08:32.273262 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e4e56742-d9d3-4cd2-b9d9-690020b30655 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:32.273889 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-e4e56742-d9d3-4cd2-b9d9-690020b30655 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 5d08fcac-077b-4c03-b799-f1beb78ea1f5] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:08:32.281297 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e4e56742-d9d3-4cd2-b9d9-690020b30655 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:32.281803 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e4e56742-d9d3-4cd2-b9d9-690020b30655 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:32.282245 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e4e56742-d9d3-4cd2-b9d9-690020b30655 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:32.282968 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e4e56742-d9d3-4cd2-b9d9-690020b30655 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:32.283432 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e4e56742-d9d3-4cd2-b9d9-690020b30655 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:32.283879 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e4e56742-d9d3-4cd2-b9d9-690020b30655 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:32.429062 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e4e56742-d9d3-4cd2-b9d9-690020b30655 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11beacbd367449d909a0512301b31d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738d5571a8d4f7eb9fbc7c51dfe03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:32.442456 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e4e56742-d9d3-4cd2-b9d9-690020b30655 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5" status: 200 len: 1569 microversion: 2.1 time: 0.172987 Aug 27 04:08:32.443321 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3653/7257] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:08:32 2022] GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5 => generated 1569 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:08:33.465027 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-b5d25370-f32a-42e8-81bc-656d00fb729d tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:33.465610 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-b5d25370-f32a-42e8-81bc-656d00fb729d tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 5d08fcac-077b-4c03-b799-f1beb78ea1f5] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:08:33.473387 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b5d25370-f32a-42e8-81bc-656d00fb729d tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:33.473921 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b5d25370-f32a-42e8-81bc-656d00fb729d tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:33.474485 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b5d25370-f32a-42e8-81bc-656d00fb729d tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:33.475282 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b5d25370-f32a-42e8-81bc-656d00fb729d tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:33.475738 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b5d25370-f32a-42e8-81bc-656d00fb729d tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:33.476129 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-b5d25370-f32a-42e8-81bc-656d00fb729d tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:33.626816 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-b5d25370-f32a-42e8-81bc-656d00fb729d tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11beacbd367449d909a0512301b31d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738d5571a8d4f7eb9fbc7c51dfe03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:33.635151 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-b5d25370-f32a-42e8-81bc-656d00fb729d tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5" status: 200 len: 1569 microversion: 2.1 time: 0.174225 Aug 27 04:08:33.635766 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3605/7258] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:08:33 2022] GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5 => generated 1569 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:08:34.658013 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-ac8ad354-ca90-4259-bc9a-bd12fb828729 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:34.658640 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-ac8ad354-ca90-4259-bc9a-bd12fb828729 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 5d08fcac-077b-4c03-b799-f1beb78ea1f5] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:08:34.666560 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ac8ad354-ca90-4259-bc9a-bd12fb828729 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:34.667067 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ac8ad354-ca90-4259-bc9a-bd12fb828729 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:34.667516 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ac8ad354-ca90-4259-bc9a-bd12fb828729 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:34.668254 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ac8ad354-ca90-4259-bc9a-bd12fb828729 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:34.668752 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ac8ad354-ca90-4259-bc9a-bd12fb828729 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:34.669198 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-ac8ad354-ca90-4259-bc9a-bd12fb828729 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:35.201169 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-ac8ad354-ca90-4259-bc9a-bd12fb828729 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11beacbd367449d909a0512301b31d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738d5571a8d4f7eb9fbc7c51dfe03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:35.209941 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-ac8ad354-ca90-4259-bc9a-bd12fb828729 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5" status: 200 len: 1569 microversion: 2.1 time: 0.555814 Aug 27 04:08:35.210547 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3654/7259] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:08:34 2022] GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5 => generated 1569 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:08:36.232957 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a39df30d-b4e6-4a99-99be-bcf788e106c1 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:36.233699 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a39df30d-b4e6-4a99-99be-bcf788e106c1 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 5d08fcac-077b-4c03-b799-f1beb78ea1f5] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:08:36.241960 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a39df30d-b4e6-4a99-99be-bcf788e106c1 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:36.242441 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a39df30d-b4e6-4a99-99be-bcf788e106c1 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:36.242850 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a39df30d-b4e6-4a99-99be-bcf788e106c1 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:36.243569 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a39df30d-b4e6-4a99-99be-bcf788e106c1 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:36.244024 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a39df30d-b4e6-4a99-99be-bcf788e106c1 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:36.244499 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a39df30d-b4e6-4a99-99be-bcf788e106c1 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:36.388759 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-a39df30d-b4e6-4a99-99be-bcf788e106c1 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11beacbd367449d909a0512301b31d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738d5571a8d4f7eb9fbc7c51dfe03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:36.397314 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a39df30d-b4e6-4a99-99be-bcf788e106c1 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5" status: 200 len: 1569 microversion: 2.1 time: 0.169445 Aug 27 04:08:36.397909 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3606/7260] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:08:36 2022] GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5 => generated 1569 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:08:37.419025 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-efd9add4-af80-4bee-aaf1-8cf154492342 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:37.419739 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-efd9add4-af80-4bee-aaf1-8cf154492342 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 5d08fcac-077b-4c03-b799-f1beb78ea1f5] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:08:37.427789 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-efd9add4-af80-4bee-aaf1-8cf154492342 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:37.428568 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-efd9add4-af80-4bee-aaf1-8cf154492342 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:37.429046 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-efd9add4-af80-4bee-aaf1-8cf154492342 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:37.429775 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-efd9add4-af80-4bee-aaf1-8cf154492342 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:37.430244 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-efd9add4-af80-4bee-aaf1-8cf154492342 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:37.430683 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-efd9add4-af80-4bee-aaf1-8cf154492342 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:37.571094 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-efd9add4-af80-4bee-aaf1-8cf154492342 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11beacbd367449d909a0512301b31d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738d5571a8d4f7eb9fbc7c51dfe03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:37.582317 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-efd9add4-af80-4bee-aaf1-8cf154492342 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5" status: 200 len: 1569 microversion: 2.1 time: 0.167583 Aug 27 04:08:37.583023 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3655/7261] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:08:37 2022] GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5 => generated 1569 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:08:38.603974 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4eec2ea8-0544-4ef5-b4e8-03d2c55d2b01 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:38.604646 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-4eec2ea8-0544-4ef5-b4e8-03d2c55d2b01 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 5d08fcac-077b-4c03-b799-f1beb78ea1f5] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:08:38.612559 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4eec2ea8-0544-4ef5-b4e8-03d2c55d2b01 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:38.612664 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4eec2ea8-0544-4ef5-b4e8-03d2c55d2b01 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:38.613090 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4eec2ea8-0544-4ef5-b4e8-03d2c55d2b01 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:38.613784 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4eec2ea8-0544-4ef5-b4e8-03d2c55d2b01 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:38.614224 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4eec2ea8-0544-4ef5-b4e8-03d2c55d2b01 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:38.614713 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4eec2ea8-0544-4ef5-b4e8-03d2c55d2b01 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:38.761179 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-4eec2ea8-0544-4ef5-b4e8-03d2c55d2b01 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11beacbd367449d909a0512301b31d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738d5571a8d4f7eb9fbc7c51dfe03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:38.770968 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-4eec2ea8-0544-4ef5-b4e8-03d2c55d2b01 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5" status: 200 len: 1569 microversion: 2.1 time: 0.171233 Aug 27 04:08:38.771538 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3607/7262] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:08:38 2022] GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5 => generated 1569 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:08:39.793447 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3de51404-1372-42ff-a61b-631fbf5ad43f tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:39.794055 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-3de51404-1372-42ff-a61b-631fbf5ad43f tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 5d08fcac-077b-4c03-b799-f1beb78ea1f5] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:08:39.804629 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3de51404-1372-42ff-a61b-631fbf5ad43f tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:39.805129 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3de51404-1372-42ff-a61b-631fbf5ad43f tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:39.805873 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3de51404-1372-42ff-a61b-631fbf5ad43f tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:39.806602 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3de51404-1372-42ff-a61b-631fbf5ad43f tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:39.807080 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3de51404-1372-42ff-a61b-631fbf5ad43f tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:39.807509 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3de51404-1372-42ff-a61b-631fbf5ad43f tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:40.022392 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-3de51404-1372-42ff-a61b-631fbf5ad43f tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11beacbd367449d909a0512301b31d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738d5571a8d4f7eb9fbc7c51dfe03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:40.030588 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-3de51404-1372-42ff-a61b-631fbf5ad43f tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5" status: 200 len: 1510 microversion: 2.1 time: 0.241584 Aug 27 04:08:40.031210 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3656/7263] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:08:39 2022] GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5 => generated 1510 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:08:40.052362 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-bc985b78-3988-40f5-91e3-fc988af20609 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:08:40.052958 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-bc985b78-3988-40f5-91e3-fc988af20609 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 5d08fcac-077b-4c03-b799-f1beb78ea1f5] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:08:40.060010 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bc985b78-3988-40f5-91e3-fc988af20609 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:40.060564 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bc985b78-3988-40f5-91e3-fc988af20609 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:40.061209 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bc985b78-3988-40f5-91e3-fc988af20609 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:40.061944 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bc985b78-3988-40f5-91e3-fc988af20609 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:40.062398 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bc985b78-3988-40f5-91e3-fc988af20609 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:40.062815 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bc985b78-3988-40f5-91e3-fc988af20609 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:40.092083 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-bc985b78-3988-40f5-91e3-fc988af20609 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 5d08fcac-077b-4c03-b799-f1beb78ea1f5] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=134052) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 27 04:08:40.165815 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-bc985b78-3988-40f5-91e3-fc988af20609 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "POST /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5/action" status: 202 len: 0 microversion: 2.1 time: 0.117770 Aug 27 04:08:40.168355 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3608/7264] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 04:08:40 2022] POST /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:08:40.174605 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-303a8dee-c04b-4b45-8b20-d36e52c6d174 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:40.175244 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-303a8dee-c04b-4b45-8b20-d36e52c6d174 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 5d08fcac-077b-4c03-b799-f1beb78ea1f5] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:08:40.181637 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-303a8dee-c04b-4b45-8b20-d36e52c6d174 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:40.182391 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-303a8dee-c04b-4b45-8b20-d36e52c6d174 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:40.182856 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-303a8dee-c04b-4b45-8b20-d36e52c6d174 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:40.183638 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-303a8dee-c04b-4b45-8b20-d36e52c6d174 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:40.184108 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-303a8dee-c04b-4b45-8b20-d36e52c6d174 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:40.184576 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-303a8dee-c04b-4b45-8b20-d36e52c6d174 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:40.364042 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-303a8dee-c04b-4b45-8b20-d36e52c6d174 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11beacbd367449d909a0512301b31d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738d5571a8d4f7eb9fbc7c51dfe03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:40.380945 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-303a8dee-c04b-4b45-8b20-d36e52c6d174 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5" status: 200 len: 1518 microversion: 2.1 time: 0.210088 Aug 27 04:08:40.381729 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3657/7265] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:08:40 2022] GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5 => generated 1518 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:08:40.640097 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-db96b1dc-c333-40c8-9a43-69d3e0062873 req-ba4a856e-a46c-4be1-aaa3-26a977c27bb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d08fcac-077b-4c03-b799-f1beb78ea1f5", "name": "network-vif-unplugged", "status": "completed", "tag": "870c209d-c0a6-46d2-83c3-57a0c1427384"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:08:40.661289 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-db96b1dc-c333-40c8-9a43-69d3e0062873 req-ba4a856e-a46c-4be1-aaa3-26a977c27bb4 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:40.662614 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-db96b1dc-c333-40c8-9a43-69d3e0062873 req-ba4a856e-a46c-4be1-aaa3-26a977c27bb4 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:40.663887 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-db96b1dc-c333-40c8-9a43-69d3e0062873 req-ba4a856e-a46c-4be1-aaa3-26a977c27bb4 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:40.685077 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.compute.server_external_events [req-db96b1dc-c333-40c8-9a43-69d3e0062873 req-ba4a856e-a46c-4be1-aaa3-26a977c27bb4 service nova] Unable to find a host for instance 5d08fcac-077b-4c03-b799-f1beb78ea1f5. Dropping event network-vif-unplugged {{(pid=134052) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 27 04:08:40.687118 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-db96b1dc-c333-40c8-9a43-69d3e0062873 req-ba4a856e-a46c-4be1-aaa3-26a977c27bb4 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.053619 Aug 27 04:08:40.688848 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3609/7266] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 04:08:40 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 56 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 27 04:08:41.402175 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-c16ca1bd-f18f-4abc-b66c-939e883071de tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:41.402910 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-c16ca1bd-f18f-4abc-b66c-939e883071de tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 5d08fcac-077b-4c03-b799-f1beb78ea1f5] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:08:41.410159 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c16ca1bd-f18f-4abc-b66c-939e883071de tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:41.410677 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c16ca1bd-f18f-4abc-b66c-939e883071de tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:41.411112 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c16ca1bd-f18f-4abc-b66c-939e883071de tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:41.411821 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c16ca1bd-f18f-4abc-b66c-939e883071de tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:41.412278 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c16ca1bd-f18f-4abc-b66c-939e883071de tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:41.412742 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-c16ca1bd-f18f-4abc-b66c-939e883071de tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:41.555121 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-c16ca1bd-f18f-4abc-b66c-939e883071de tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11beacbd367449d909a0512301b31d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738d5571a8d4f7eb9fbc7c51dfe03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:41.564418 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-c16ca1bd-f18f-4abc-b66c-939e883071de tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5" status: 200 len: 1520 microversion: 2.1 time: 0.166157 Aug 27 04:08:41.565024 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3658/7267] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:08:41 2022] GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5 => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:08:42.586058 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e34981f3-d7d7-4302-87c1-84c22ef9ebaf tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:42.586657 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-e34981f3-d7d7-4302-87c1-84c22ef9ebaf tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 5d08fcac-077b-4c03-b799-f1beb78ea1f5] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:08:42.593920 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e34981f3-d7d7-4302-87c1-84c22ef9ebaf tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:42.594400 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e34981f3-d7d7-4302-87c1-84c22ef9ebaf tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:42.594829 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e34981f3-d7d7-4302-87c1-84c22ef9ebaf tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:42.595521 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e34981f3-d7d7-4302-87c1-84c22ef9ebaf tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:42.595960 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e34981f3-d7d7-4302-87c1-84c22ef9ebaf tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:42.596382 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e34981f3-d7d7-4302-87c1-84c22ef9ebaf tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:42.791447 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-e34981f3-d7d7-4302-87c1-84c22ef9ebaf tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11beacbd367449d909a0512301b31d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738d5571a8d4f7eb9fbc7c51dfe03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:42.800018 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e34981f3-d7d7-4302-87c1-84c22ef9ebaf tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5" status: 200 len: 1520 microversion: 2.1 time: 0.218148 Aug 27 04:08:42.800711 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3610/7268] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:08:42 2022] GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5 => generated 1520 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:08:43.821602 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-58c68ae8-397c-4b17-8e3a-5ec3b6533757 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:43.822173 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-58c68ae8-397c-4b17-8e3a-5ec3b6533757 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 5d08fcac-077b-4c03-b799-f1beb78ea1f5] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:08:43.829968 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-58c68ae8-397c-4b17-8e3a-5ec3b6533757 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:43.830481 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-58c68ae8-397c-4b17-8e3a-5ec3b6533757 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:43.830937 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-58c68ae8-397c-4b17-8e3a-5ec3b6533757 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:43.831733 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-58c68ae8-397c-4b17-8e3a-5ec3b6533757 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:43.832215 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-58c68ae8-397c-4b17-8e3a-5ec3b6533757 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:43.832724 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-58c68ae8-397c-4b17-8e3a-5ec3b6533757 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:43.991939 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-58c68ae8-397c-4b17-8e3a-5ec3b6533757 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11beacbd367449d909a0512301b31d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738d5571a8d4f7eb9fbc7c51dfe03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:44.001034 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-58c68ae8-397c-4b17-8e3a-5ec3b6533757 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5" status: 200 len: 1520 microversion: 2.1 time: 0.183441 Aug 27 04:08:44.001614 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3659/7269] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:08:43 2022] GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5 => generated 1520 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:08:45.024486 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-d4906899-0d08-4df9-8166-eeea66828980 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:45.025830 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-d4906899-0d08-4df9-8166-eeea66828980 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 5d08fcac-077b-4c03-b799-f1beb78ea1f5] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:08:45.033849 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d4906899-0d08-4df9-8166-eeea66828980 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:45.034434 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d4906899-0d08-4df9-8166-eeea66828980 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:45.035058 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d4906899-0d08-4df9-8166-eeea66828980 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:45.035869 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d4906899-0d08-4df9-8166-eeea66828980 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:45.036416 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d4906899-0d08-4df9-8166-eeea66828980 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:45.036944 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-d4906899-0d08-4df9-8166-eeea66828980 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:45.180256 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-d4906899-0d08-4df9-8166-eeea66828980 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11beacbd367449d909a0512301b31d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738d5571a8d4f7eb9fbc7c51dfe03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:45.190371 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-d4906899-0d08-4df9-8166-eeea66828980 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5" status: 200 len: 1520 microversion: 2.1 time: 0.170646 Aug 27 04:08:45.190978 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3611/7270] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:08:45 2022] GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5 => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:08:46.211595 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-13d3da19-e13d-4256-be39-4feed25d3dae tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:46.212155 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-13d3da19-e13d-4256-be39-4feed25d3dae tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 5d08fcac-077b-4c03-b799-f1beb78ea1f5] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:08:46.219944 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-13d3da19-e13d-4256-be39-4feed25d3dae tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:46.220485 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-13d3da19-e13d-4256-be39-4feed25d3dae tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:46.220945 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-13d3da19-e13d-4256-be39-4feed25d3dae tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:46.221673 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-13d3da19-e13d-4256-be39-4feed25d3dae tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:46.222150 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-13d3da19-e13d-4256-be39-4feed25d3dae tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:46.222585 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-13d3da19-e13d-4256-be39-4feed25d3dae tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:46.437475 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-13d3da19-e13d-4256-be39-4feed25d3dae tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11beacbd367449d909a0512301b31d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738d5571a8d4f7eb9fbc7c51dfe03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:46.446218 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-13d3da19-e13d-4256-be39-4feed25d3dae tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5" status: 200 len: 1576 microversion: 2.1 time: 0.238686 Aug 27 04:08:46.446818 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3660/7271] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:08:46 2022] GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5 => generated 1576 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:08:47.168596 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-b4606ece-6efd-4f6a-8443-9d5c5d5b4f2a req-c03121e0-cab2-4245-84e5-28bb9f4515ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d08fcac-077b-4c03-b799-f1beb78ea1f5", "tag": "870c209d-c0a6-46d2-83c3-57a0c1427384"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:08:47.179934 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-b4606ece-6efd-4f6a-8443-9d5c5d5b4f2a req-c03121e0-cab2-4245-84e5-28bb9f4515ea service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:47.180437 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-b4606ece-6efd-4f6a-8443-9d5c5d5b4f2a req-c03121e0-cab2-4245-84e5-28bb9f4515ea service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:47.180893 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-b4606ece-6efd-4f6a-8443-9d5c5d5b4f2a req-c03121e0-cab2-4245-84e5-28bb9f4515ea service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:47.193056 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-b4606ece-6efd-4f6a-8443-9d5c5d5b4f2a req-c03121e0-cab2-4245-84e5-28bb9f4515ea service nova] Creating event network-changed:870c209d-c0a6-46d2-83c3-57a0c1427384 for instance 5d08fcac-077b-4c03-b799-f1beb78ea1f5 on n-h2-852278-4 Aug 27 04:08:47.200546 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-b4606ece-6efd-4f6a-8443-9d5c5d5b4f2a req-c03121e0-cab2-4245-84e5-28bb9f4515ea service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089866 Aug 27 04:08:47.201492 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3612/7272] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 04:08:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:08:47.467609 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-2e80ade9-e01d-4258-ac7e-1ce94d96faec tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:47.468380 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-2e80ade9-e01d-4258-ac7e-1ce94d96faec tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 5d08fcac-077b-4c03-b799-f1beb78ea1f5] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:08:47.476772 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2e80ade9-e01d-4258-ac7e-1ce94d96faec tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:47.477374 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2e80ade9-e01d-4258-ac7e-1ce94d96faec tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:47.477834 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2e80ade9-e01d-4258-ac7e-1ce94d96faec tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:47.478576 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2e80ade9-e01d-4258-ac7e-1ce94d96faec tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:47.479041 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2e80ade9-e01d-4258-ac7e-1ce94d96faec tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:47.479484 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-2e80ade9-e01d-4258-ac7e-1ce94d96faec tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:47.688942 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-2e80ade9-e01d-4258-ac7e-1ce94d96faec tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11beacbd367449d909a0512301b31d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738d5571a8d4f7eb9fbc7c51dfe03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:47.697572 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-2e80ade9-e01d-4258-ac7e-1ce94d96faec tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5" status: 200 len: 1576 microversion: 2.1 time: 0.233952 Aug 27 04:08:47.698151 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3661/7273] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:08:47 2022] GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5 => generated 1576 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:08:48.721572 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-fb656017-5d5f-43ac-af01-91c287908ae4 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:48.722284 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-fb656017-5d5f-43ac-af01-91c287908ae4 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 5d08fcac-077b-4c03-b799-f1beb78ea1f5] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:08:48.729581 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fb656017-5d5f-43ac-af01-91c287908ae4 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:48.730489 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fb656017-5d5f-43ac-af01-91c287908ae4 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:48.730935 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fb656017-5d5f-43ac-af01-91c287908ae4 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:48.731646 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fb656017-5d5f-43ac-af01-91c287908ae4 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:48.732105 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fb656017-5d5f-43ac-af01-91c287908ae4 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:48.732671 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fb656017-5d5f-43ac-af01-91c287908ae4 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:48.873053 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-fb656017-5d5f-43ac-af01-91c287908ae4 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11beacbd367449d909a0512301b31d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738d5571a8d4f7eb9fbc7c51dfe03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:48.881439 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-fb656017-5d5f-43ac-af01-91c287908ae4 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5" status: 200 len: 1576 microversion: 2.1 time: 0.166299 Aug 27 04:08:48.882089 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3613/7274] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:08:48 2022] GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5 => generated 1576 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:08:49.902751 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-34bbbf09-1c92-43dd-98e3-2fc175ef6080 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:49.903372 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-34bbbf09-1c92-43dd-98e3-2fc175ef6080 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 5d08fcac-077b-4c03-b799-f1beb78ea1f5] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:08:49.911327 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-34bbbf09-1c92-43dd-98e3-2fc175ef6080 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:49.911830 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-34bbbf09-1c92-43dd-98e3-2fc175ef6080 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:49.912273 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-34bbbf09-1c92-43dd-98e3-2fc175ef6080 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:49.913012 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-34bbbf09-1c92-43dd-98e3-2fc175ef6080 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:49.913553 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-34bbbf09-1c92-43dd-98e3-2fc175ef6080 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:49.913903 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-34bbbf09-1c92-43dd-98e3-2fc175ef6080 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:50.051564 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-34bbbf09-1c92-43dd-98e3-2fc175ef6080 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11beacbd367449d909a0512301b31d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738d5571a8d4f7eb9fbc7c51dfe03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:50.065763 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-34bbbf09-1c92-43dd-98e3-2fc175ef6080 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5" status: 200 len: 1576 microversion: 2.1 time: 0.166689 Aug 27 04:08:50.066504 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3662/7275] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:08:49 2022] GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5 => generated 1576 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:08:51.087920 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-7380e4c5-85d4-44ae-abfb-3feaa740d5d8 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:51.088575 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-7380e4c5-85d4-44ae-abfb-3feaa740d5d8 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 5d08fcac-077b-4c03-b799-f1beb78ea1f5] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:08:51.096621 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7380e4c5-85d4-44ae-abfb-3feaa740d5d8 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:51.097118 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7380e4c5-85d4-44ae-abfb-3feaa740d5d8 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:51.097553 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7380e4c5-85d4-44ae-abfb-3feaa740d5d8 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:51.098267 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7380e4c5-85d4-44ae-abfb-3feaa740d5d8 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:51.098713 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7380e4c5-85d4-44ae-abfb-3feaa740d5d8 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:51.099140 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-7380e4c5-85d4-44ae-abfb-3feaa740d5d8 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:51.247047 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-7380e4c5-85d4-44ae-abfb-3feaa740d5d8 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11beacbd367449d909a0512301b31d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738d5571a8d4f7eb9fbc7c51dfe03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:51.255396 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-7380e4c5-85d4-44ae-abfb-3feaa740d5d8 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5" status: 200 len: 1576 microversion: 2.1 time: 0.171722 Aug 27 04:08:51.255991 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3614/7276] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:08:51 2022] GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5 => generated 1576 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:08:52.278409 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-912b018f-462f-454f-ae38-7992a8e899f2 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:52.278969 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-912b018f-462f-454f-ae38-7992a8e899f2 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 5d08fcac-077b-4c03-b799-f1beb78ea1f5] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:08:52.286859 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-912b018f-462f-454f-ae38-7992a8e899f2 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:52.287363 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-912b018f-462f-454f-ae38-7992a8e899f2 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:52.287820 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-912b018f-462f-454f-ae38-7992a8e899f2 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:52.288587 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-912b018f-462f-454f-ae38-7992a8e899f2 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:52.289059 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-912b018f-462f-454f-ae38-7992a8e899f2 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:52.289821 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-912b018f-462f-454f-ae38-7992a8e899f2 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:52.309122 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:08:52.435919 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-912b018f-462f-454f-ae38-7992a8e899f2 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11beacbd367449d909a0512301b31d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738d5571a8d4f7eb9fbc7c51dfe03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:52.445007 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-912b018f-462f-454f-ae38-7992a8e899f2 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5" status: 200 len: 1576 microversion: 2.1 time: 0.170673 Aug 27 04:08:52.445643 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3663/7277] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:08:52 2022] GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5 => generated 1576 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:08:53.466547 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-83728a7a-b538-4556-b924-545d21918bc0 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:53.467285 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-83728a7a-b538-4556-b924-545d21918bc0 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 5d08fcac-077b-4c03-b799-f1beb78ea1f5] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:08:53.477563 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-83728a7a-b538-4556-b924-545d21918bc0 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:53.478069 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-83728a7a-b538-4556-b924-545d21918bc0 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:53.478527 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-83728a7a-b538-4556-b924-545d21918bc0 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:53.479258 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-83728a7a-b538-4556-b924-545d21918bc0 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:53.479707 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-83728a7a-b538-4556-b924-545d21918bc0 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:53.480163 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-83728a7a-b538-4556-b924-545d21918bc0 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:53.625705 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-83728a7a-b538-4556-b924-545d21918bc0 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11beacbd367449d909a0512301b31d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738d5571a8d4f7eb9fbc7c51dfe03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:53.634449 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-83728a7a-b538-4556-b924-545d21918bc0 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5" status: 200 len: 1576 microversion: 2.1 time: 0.172268 Aug 27 04:08:53.635041 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3615/7278] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:08:53 2022] GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5 => generated 1576 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:08:54.655403 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f45a5e44-da8e-4753-8aa5-7854ca3e8034 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:54.656028 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-f45a5e44-da8e-4753-8aa5-7854ca3e8034 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 5d08fcac-077b-4c03-b799-f1beb78ea1f5] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:08:54.658840 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=31 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:08:54.664794 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f45a5e44-da8e-4753-8aa5-7854ca3e8034 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:54.665294 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f45a5e44-da8e-4753-8aa5-7854ca3e8034 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:54.665744 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f45a5e44-da8e-4753-8aa5-7854ca3e8034 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:54.666456 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f45a5e44-da8e-4753-8aa5-7854ca3e8034 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:54.666914 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f45a5e44-da8e-4753-8aa5-7854ca3e8034 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:54.667329 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f45a5e44-da8e-4753-8aa5-7854ca3e8034 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:54.807751 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-f45a5e44-da8e-4753-8aa5-7854ca3e8034 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11beacbd367449d909a0512301b31d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738d5571a8d4f7eb9fbc7c51dfe03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:54.816121 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-f45a5e44-da8e-4753-8aa5-7854ca3e8034 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5" status: 200 len: 1576 microversion: 2.1 time: 0.164709 Aug 27 04:08:54.816760 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3664/7279] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:08:54 2022] GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5 => generated 1576 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:08:55.837627 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ccfbd2c8-2b4a-4914-af20-96bd31110b7d tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:55.838304 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-ccfbd2c8-2b4a-4914-af20-96bd31110b7d tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 5d08fcac-077b-4c03-b799-f1beb78ea1f5] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:08:55.841172 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:08:55.847999 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ccfbd2c8-2b4a-4914-af20-96bd31110b7d tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:55.848529 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ccfbd2c8-2b4a-4914-af20-96bd31110b7d tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:55.848998 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ccfbd2c8-2b4a-4914-af20-96bd31110b7d tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:55.849730 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ccfbd2c8-2b4a-4914-af20-96bd31110b7d tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:55.850181 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ccfbd2c8-2b4a-4914-af20-96bd31110b7d tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:55.850603 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ccfbd2c8-2b4a-4914-af20-96bd31110b7d tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:55.856107 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:08:55.990342 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-ccfbd2c8-2b4a-4914-af20-96bd31110b7d tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11beacbd367449d909a0512301b31d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738d5571a8d4f7eb9fbc7c51dfe03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:55.998513 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ccfbd2c8-2b4a-4914-af20-96bd31110b7d tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5" status: 200 len: 1576 microversion: 2.1 time: 0.164854 Aug 27 04:08:55.999111 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3616/7280] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:08:55 2022] GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5 => generated 1576 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:08:57.020576 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-193d8fdf-77e6-4868-82c3-c05e9de861fc tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:57.021232 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-193d8fdf-77e6-4868-82c3-c05e9de861fc tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 5d08fcac-077b-4c03-b799-f1beb78ea1f5] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:08:57.028373 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-193d8fdf-77e6-4868-82c3-c05e9de861fc tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:57.028916 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-193d8fdf-77e6-4868-82c3-c05e9de861fc tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:57.029366 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-193d8fdf-77e6-4868-82c3-c05e9de861fc tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:57.030073 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-193d8fdf-77e6-4868-82c3-c05e9de861fc tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:57.030548 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-193d8fdf-77e6-4868-82c3-c05e9de861fc tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:57.030975 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-193d8fdf-77e6-4868-82c3-c05e9de861fc tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:57.182212 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-193d8fdf-77e6-4868-82c3-c05e9de861fc tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11beacbd367449d909a0512301b31d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738d5571a8d4f7eb9fbc7c51dfe03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:57.194723 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-193d8fdf-77e6-4868-82c3-c05e9de861fc tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5" status: 200 len: 1576 microversion: 2.1 time: 0.178188 Aug 27 04:08:57.195357 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3665/7281] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:08:57 2022] GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5 => generated 1576 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:08:57.796212 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-ec97d7b7-1e1a-467d-8cd3-eb882af943ae req-50fd597c-af1b-490c-a4bd-111c87f35bf8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d08fcac-077b-4c03-b799-f1beb78ea1f5", "name": "network-vif-plugged", "status": "completed", "tag": "870c209d-c0a6-46d2-83c3-57a0c1427384"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:08:57.806346 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-ec97d7b7-1e1a-467d-8cd3-eb882af943ae req-50fd597c-af1b-490c-a4bd-111c87f35bf8 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:57.807180 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-ec97d7b7-1e1a-467d-8cd3-eb882af943ae req-50fd597c-af1b-490c-a4bd-111c87f35bf8 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:57.807801 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-ec97d7b7-1e1a-467d-8cd3-eb882af943ae req-50fd597c-af1b-490c-a4bd-111c87f35bf8 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:57.824540 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-ec97d7b7-1e1a-467d-8cd3-eb882af943ae req-50fd597c-af1b-490c-a4bd-111c87f35bf8 service nova] Creating event network-vif-plugged:870c209d-c0a6-46d2-83c3-57a0c1427384 for instance 5d08fcac-077b-4c03-b799-f1beb78ea1f5 on n-h2-852278-4 Aug 27 04:08:57.830109 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-ec97d7b7-1e1a-467d-8cd3-eb882af943ae req-50fd597c-af1b-490c-a4bd-111c87f35bf8 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087271 Aug 27 04:08:57.830907 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3617/7282] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 04:08:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:08:58.215641 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-6391598f-dd6e-4581-94b7-f06ea8640687 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:58.216280 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-6391598f-dd6e-4581-94b7-f06ea8640687 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 5d08fcac-077b-4c03-b799-f1beb78ea1f5] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:08:58.224032 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6391598f-dd6e-4581-94b7-f06ea8640687 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:58.224568 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6391598f-dd6e-4581-94b7-f06ea8640687 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:58.225012 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6391598f-dd6e-4581-94b7-f06ea8640687 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:58.225729 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6391598f-dd6e-4581-94b7-f06ea8640687 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:58.226182 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6391598f-dd6e-4581-94b7-f06ea8640687 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:58.226624 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6391598f-dd6e-4581-94b7-f06ea8640687 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:58.368285 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-6391598f-dd6e-4581-94b7-f06ea8640687 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11beacbd367449d909a0512301b31d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738d5571a8d4f7eb9fbc7c51dfe03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:58.376506 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-6391598f-dd6e-4581-94b7-f06ea8640687 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5" status: 200 len: 1576 microversion: 2.1 time: 0.164869 Aug 27 04:08:58.377102 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3666/7283] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:08:58 2022] GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5 => generated 1576 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:08:59.398561 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a27f6997-bad3-4dee-840a-089cd3c4a840 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:59.399269 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a27f6997-bad3-4dee-840a-089cd3c4a840 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 5d08fcac-077b-4c03-b799-f1beb78ea1f5] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:08:59.406684 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a27f6997-bad3-4dee-840a-089cd3c4a840 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:59.407165 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a27f6997-bad3-4dee-840a-089cd3c4a840 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:59.407593 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a27f6997-bad3-4dee-840a-089cd3c4a840 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:59.408289 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a27f6997-bad3-4dee-840a-089cd3c4a840 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:59.408755 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a27f6997-bad3-4dee-840a-089cd3c4a840 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:59.409172 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a27f6997-bad3-4dee-840a-089cd3c4a840 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:59.553848 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-a27f6997-bad3-4dee-840a-089cd3c4a840 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11beacbd367449d909a0512301b31d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738d5571a8d4f7eb9fbc7c51dfe03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:59.562462 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a27f6997-bad3-4dee-840a-089cd3c4a840 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5" status: 200 len: 1563 microversion: 2.1 time: 0.168368 Aug 27 04:08:59.563072 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3618/7284] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:08:59 2022] GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5 => generated 1563 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:10:16.257765 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=5 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:10:16.259925 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=5 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:10:16.260775 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=13 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:10:16.261326 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=20 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:10:16.262658 n-d-852278-4 devstack@n-api.service[134052]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:10:16.262832 n-d-852278-4 devstack@n-api.service[134052]: Sat Aug 27 04:10:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.70) !!! Aug 27 04:10:16.266527 n-d-852278-4 devstack@n-api.service[134051]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:10:16.266676 n-d-852278-4 devstack@n-api.service[134051]: Sat Aug 27 04:10:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5 (ip 10.222.0.70) !!! Aug 27 04:10:16.274131 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-422aea15-da22-41a8-b1d7-6197977f5b6f tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:10:16.274650 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-422aea15-da22-41a8-b1d7-6197977f5b6f tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 5d08fcac-077b-4c03-b799-f1beb78ea1f5] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:10:16.277941 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-33f0269c-2dfc-4614-88dd-62a84c104f59 req-99e988c9-e460-4556-bcd7-d19f295c2a61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d08fcac-077b-4c03-b799-f1beb78ea1f5", "tag": "870c209d-c0a6-46d2-83c3-57a0c1427384"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:10:16.285836 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-422aea15-da22-41a8-b1d7-6197977f5b6f tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:16.287470 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-422aea15-da22-41a8-b1d7-6197977f5b6f tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:16.287938 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-422aea15-da22-41a8-b1d7-6197977f5b6f tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:16.288711 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-422aea15-da22-41a8-b1d7-6197977f5b6f tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:16.289733 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-422aea15-da22-41a8-b1d7-6197977f5b6f tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:16.290665 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-422aea15-da22-41a8-b1d7-6197977f5b6f tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:16.291934 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-33f0269c-2dfc-4614-88dd-62a84c104f59 req-99e988c9-e460-4556-bcd7-d19f295c2a61 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:16.292076 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-33f0269c-2dfc-4614-88dd-62a84c104f59 req-99e988c9-e460-4556-bcd7-d19f295c2a61 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:16.292457 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-33f0269c-2dfc-4614-88dd-62a84c104f59 req-99e988c9-e460-4556-bcd7-d19f295c2a61 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:16.305919 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-33f0269c-2dfc-4614-88dd-62a84c104f59 req-99e988c9-e460-4556-bcd7-d19f295c2a61 service nova] Creating event network-changed:870c209d-c0a6-46d2-83c3-57a0c1427384 for instance 5d08fcac-077b-4c03-b799-f1beb78ea1f5 on n-h2-852278-4 Aug 27 04:10:16.312242 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-33f0269c-2dfc-4614-88dd-62a84c104f59 req-99e988c9-e460-4556-bcd7-d19f295c2a61 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056372 Aug 27 04:10:16.313130 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3619/7285] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 04:10:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:10:16.320490 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-422aea15-da22-41a8-b1d7-6197977f5b6f tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 5d08fcac-077b-4c03-b799-f1beb78ea1f5] Going to try to terminate instance {{(pid=134051) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:10:16.412938 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-422aea15-da22-41a8-b1d7-6197977f5b6f tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "DELETE /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5" status: 204 len: 0 microversion: 2.1 time: 0.158864 Aug 27 04:10:16.414008 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3667/7286] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 04:10:16 2022] DELETE /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:10:16.424200 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a483f60a-fe6b-43a0-8540-537af0e3162e tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:10:16.425126 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a483f60a-fe6b-43a0-8540-537af0e3162e tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 5d08fcac-077b-4c03-b799-f1beb78ea1f5] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:10:16.433360 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a483f60a-fe6b-43a0-8540-537af0e3162e tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:16.433952 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a483f60a-fe6b-43a0-8540-537af0e3162e tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:16.434458 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a483f60a-fe6b-43a0-8540-537af0e3162e tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:16.435263 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a483f60a-fe6b-43a0-8540-537af0e3162e tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:16.435981 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a483f60a-fe6b-43a0-8540-537af0e3162e tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:16.436509 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a483f60a-fe6b-43a0-8540-537af0e3162e tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:16.607383 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-a483f60a-fe6b-43a0-8540-537af0e3162e tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11beacbd367449d909a0512301b31d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738d5571a8d4f7eb9fbc7c51dfe03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:10:16.615909 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a483f60a-fe6b-43a0-8540-537af0e3162e tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5" status: 200 len: 1569 microversion: 2.1 time: 0.196804 Aug 27 04:10:16.616496 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3620/7287] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:10:16 2022] GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5 => generated 1569 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:10:17.638206 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-9cdafb6b-d69d-48ac-a1f7-6bc6dfa3a443 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:10:17.639005 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-9cdafb6b-d69d-48ac-a1f7-6bc6dfa3a443 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 5d08fcac-077b-4c03-b799-f1beb78ea1f5] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:10:17.646454 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9cdafb6b-d69d-48ac-a1f7-6bc6dfa3a443 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:17.646976 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9cdafb6b-d69d-48ac-a1f7-6bc6dfa3a443 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:17.647509 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9cdafb6b-d69d-48ac-a1f7-6bc6dfa3a443 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:17.648154 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9cdafb6b-d69d-48ac-a1f7-6bc6dfa3a443 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:17.651041 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9cdafb6b-d69d-48ac-a1f7-6bc6dfa3a443 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:17.651041 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-9cdafb6b-d69d-48ac-a1f7-6bc6dfa3a443 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:17.867250 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-9cdafb6b-d69d-48ac-a1f7-6bc6dfa3a443 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11beacbd367449d909a0512301b31d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738d5571a8d4f7eb9fbc7c51dfe03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:10:17.875378 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-9cdafb6b-d69d-48ac-a1f7-6bc6dfa3a443 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5" status: 200 len: 1569 microversion: 2.1 time: 0.241555 Aug 27 04:10:17.876000 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3668/7288] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:10:17 2022] GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5 => generated 1569 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:10:18.494379 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-5a88de52-2560-49b5-98a0-bbcfa89bbc5f req-3609f6d8-1343-4183-83b0-8aecbe49a377 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d08fcac-077b-4c03-b799-f1beb78ea1f5", "name": "network-vif-deleted", "tag": "870c209d-c0a6-46d2-83c3-57a0c1427384"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:10:18.505939 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-5a88de52-2560-49b5-98a0-bbcfa89bbc5f req-3609f6d8-1343-4183-83b0-8aecbe49a377 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:18.506400 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-5a88de52-2560-49b5-98a0-bbcfa89bbc5f req-3609f6d8-1343-4183-83b0-8aecbe49a377 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:18.506917 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-5a88de52-2560-49b5-98a0-bbcfa89bbc5f req-3609f6d8-1343-4183-83b0-8aecbe49a377 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:18.523073 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-5a88de52-2560-49b5-98a0-bbcfa89bbc5f req-3609f6d8-1343-4183-83b0-8aecbe49a377 service nova] Creating event network-vif-deleted:870c209d-c0a6-46d2-83c3-57a0c1427384 for instance 5d08fcac-077b-4c03-b799-f1beb78ea1f5 on n-h2-852278-4 Aug 27 04:10:18.528777 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-5a88de52-2560-49b5-98a0-bbcfa89bbc5f req-3609f6d8-1343-4183-83b0-8aecbe49a377 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038346 Aug 27 04:10:18.529508 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3621/7289] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 04:10:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:10:18.896795 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d7183576-304e-42fd-8e8c-e66bf54c0b15 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:10:18.897485 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-d7183576-304e-42fd-8e8c-e66bf54c0b15 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 5d08fcac-077b-4c03-b799-f1beb78ea1f5] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:10:18.905726 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d7183576-304e-42fd-8e8c-e66bf54c0b15 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:18.906291 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d7183576-304e-42fd-8e8c-e66bf54c0b15 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:18.907136 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d7183576-304e-42fd-8e8c-e66bf54c0b15 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:18.907783 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d7183576-304e-42fd-8e8c-e66bf54c0b15 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:18.908737 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d7183576-304e-42fd-8e8c-e66bf54c0b15 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:18.908967 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-d7183576-304e-42fd-8e8c-e66bf54c0b15 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:18.976127 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-d7183576-304e-42fd-8e8c-e66bf54c0b15 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11beacbd367449d909a0512301b31d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738d5571a8d4f7eb9fbc7c51dfe03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:10:18.982783 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d7183576-304e-42fd-8e8c-e66bf54c0b15 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5" status: 200 len: 1220 microversion: 2.1 time: 0.089793 Aug 27 04:10:18.983385 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3669/7290] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:10:18 2022] GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5 => generated 1220 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:10:20.004882 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-1786655e-737a-4be7-8684-0b4c6962a607 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:10:20.005586 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-1786655e-737a-4be7-8684-0b4c6962a607 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 5d08fcac-077b-4c03-b799-f1beb78ea1f5] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:10:20.012672 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1786655e-737a-4be7-8684-0b4c6962a607 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:20.013169 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1786655e-737a-4be7-8684-0b4c6962a607 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:20.013609 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1786655e-737a-4be7-8684-0b4c6962a607 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:20.014333 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1786655e-737a-4be7-8684-0b4c6962a607 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:20.014788 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1786655e-737a-4be7-8684-0b4c6962a607 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:20.015216 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-1786655e-737a-4be7-8684-0b4c6962a607 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:20.082633 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-1786655e-737a-4be7-8684-0b4c6962a607 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11beacbd367449d909a0512301b31d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738d5571a8d4f7eb9fbc7c51dfe03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:10:20.091409 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-1786655e-737a-4be7-8684-0b4c6962a607 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5" status: 200 len: 1220 microversion: 2.1 time: 0.091679 Aug 27 04:10:20.092121 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3622/7291] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:10:19 2022] GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5 => generated 1220 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:10:21.112825 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-dd22efac-671c-4ada-bcee-0f455ab6af59 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:10:21.113434 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-dd22efac-671c-4ada-bcee-0f455ab6af59 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 5d08fcac-077b-4c03-b799-f1beb78ea1f5] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:10:21.121161 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dd22efac-671c-4ada-bcee-0f455ab6af59 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:21.121672 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dd22efac-671c-4ada-bcee-0f455ab6af59 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:21.122125 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dd22efac-671c-4ada-bcee-0f455ab6af59 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:21.122887 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dd22efac-671c-4ada-bcee-0f455ab6af59 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:21.123409 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dd22efac-671c-4ada-bcee-0f455ab6af59 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:21.124235 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dd22efac-671c-4ada-bcee-0f455ab6af59 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:21.189153 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-dd22efac-671c-4ada-bcee-0f455ab6af59 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11beacbd367449d909a0512301b31d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738d5571a8d4f7eb9fbc7c51dfe03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:10:21.197381 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-dd22efac-671c-4ada-bcee-0f455ab6af59 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5" status: 200 len: 1220 microversion: 2.1 time: 0.088744 Aug 27 04:10:21.197994 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3670/7292] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:10:21 2022] GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5 => generated 1220 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:10:22.220260 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-13098298-9da1-4107-961f-d4f10079a17a tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:10:22.220902 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-13098298-9da1-4107-961f-d4f10079a17a tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 5d08fcac-077b-4c03-b799-f1beb78ea1f5] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:10:22.228736 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-13098298-9da1-4107-961f-d4f10079a17a tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:22.229213 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-13098298-9da1-4107-961f-d4f10079a17a tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:22.229641 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-13098298-9da1-4107-961f-d4f10079a17a tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:22.230336 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-13098298-9da1-4107-961f-d4f10079a17a tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:22.230775 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-13098298-9da1-4107-961f-d4f10079a17a tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:22.231189 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-13098298-9da1-4107-961f-d4f10079a17a tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:22.307661 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-13098298-9da1-4107-961f-d4f10079a17a tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11beacbd367449d909a0512301b31d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f738d5571a8d4f7eb9fbc7c51dfe03d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:10:22.316470 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-13098298-9da1-4107-961f-d4f10079a17a tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5" status: 200 len: 1220 microversion: 2.1 time: 0.100801 Aug 27 04:10:22.317186 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3623/7293] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:10:22 2022] GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5 => generated 1220 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:10:23.337800 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a18a6af8-2dc0-45c5-9397-021dbd657861 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:10:23.338510 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-a18a6af8-2dc0-45c5-9397-021dbd657861 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] [instance: 5d08fcac-077b-4c03-b799-f1beb78ea1f5] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:10:23.346995 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a18a6af8-2dc0-45c5-9397-021dbd657861 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:23.347498 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a18a6af8-2dc0-45c5-9397-021dbd657861 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:23.347951 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a18a6af8-2dc0-45c5-9397-021dbd657861 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:23.348708 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a18a6af8-2dc0-45c5-9397-021dbd657861 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:23.349166 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a18a6af8-2dc0-45c5-9397-021dbd657861 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:23.349596 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-a18a6af8-2dc0-45c5-9397-021dbd657861 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:23.367440 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.wsgi [None req-a18a6af8-2dc0-45c5-9397-021dbd657861 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] HTTP exception thrown: Instance 5d08fcac-077b-4c03-b799-f1beb78ea1f5 could not be found. Aug 27 04:10:23.369182 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a18a6af8-2dc0-45c5-9397-021dbd657861 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Request method failure captured: Aug 27 04:10:23.369182 n-d-852278-4 devstack@n-api.service[134051]: request: GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5 HTTP/1.1 Aug 27 04:10:23.369182 n-d-852278-4 devstack@n-api.service[134051]: Accept: application/json Aug 27 04:10:23.369182 n-d-852278-4 devstack@n-api.service[134051]: Accept-Encoding: identity Aug 27 04:10:23.369182 n-d-852278-4 devstack@n-api.service[134051]: Connection: close Aug 27 04:10:23.369182 n-d-852278-4 devstack@n-api.service[134051]: Content-Length: 0 Aug 27 04:10:23.369182 n-d-852278-4 devstack@n-api.service[134051]: Content-Type: application/json Aug 27 04:10:23.369182 n-d-852278-4 devstack@n-api.service[134051]: Host: 10.222.0.70 Aug 27 04:10:23.369182 n-d-852278-4 devstack@n-api.service[134051]: Openstack-System-Scope: None Aug 27 04:10:23.369182 n-d-852278-4 devstack@n-api.service[134051]: User-Agent: python-urllib3/1.26.11 Aug 27 04:10:23.369182 n-d-852278-4 devstack@n-api.service[134051]: X-Auth-Token: gAAAAABjCZcQW4DYz2CORcYpu__FZQ_x4uhJM8i0pUFFAGZ5P4xpTMiKoDRepwsuS5pEX0VqAJgIdtJ43Y_iVvj6oB84LilJIUoNkAjvvTBVZZlWbl3KROQPZhsw_f2mSDb0WFvB2o0Si24T3h_fgMoS9eo7TsyX8iGaiSioerg4w3y-AOpj5RY Aug 27 04:10:23.369182 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Id: None Aug 27 04:10:23.369182 n-d-852278-4 devstack@n-api.service[134051]: X-Domain-Name: None Aug 27 04:10:23.369182 n-d-852278-4 devstack@n-api.service[134051]: X-Identity-Status: Confirmed Aug 27 04:10:23.369182 n-d-852278-4 devstack@n-api.service[134051]: X-Is-Admin-Project: True Aug 27 04:10:23.369182 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Id: default Aug 27 04:10:23.369182 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Domain-Name: Default Aug 27 04:10:23.369182 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Id: f738d5571a8d4f7eb9fbc7c51dfe03d2 Aug 27 04:10:23.369182 n-d-852278-4 devstack@n-api.service[134051]: X-Project-Name: tempest-TestShelveInstance-1035129230 Aug 27 04:10:23.369182 n-d-852278-4 devstack@n-api.service[134051]: X-Role: reader,member Aug 27 04:10:23.369182 n-d-852278-4 devstack@n-api.service[134051]: X-Roles: reader,member Aug 27 04:10:23.369182 n-d-852278-4 devstack@n-api.service[134051]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f738d5571a8d4f7eb9fbc7c51dfe03d2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f738d5571a8d4f7eb9fbc7c51dfe03d2", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f738d5571a8d4f7eb9fbc7c51dfe03d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f738d5571a8d4f7eb9fbc7c51dfe03d2"}]}] Aug 27 04:10:23.369182 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant: tempest-TestShelveInstance-1035129230 Aug 27 04:10:23.369182 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Id: f738d5571a8d4f7eb9fbc7c51dfe03d2 Aug 27 04:10:23.369182 n-d-852278-4 devstack@n-api.service[134051]: X-Tenant-Name: tempest-TestShelveInstance-1035129230 Aug 27 04:10:23.369182 n-d-852278-4 devstack@n-api.service[134051]: X-User: tempest-TestShelveInstance-1035129230-project Aug 27 04:10:23.369182 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Id: default Aug 27 04:10:23.369182 n-d-852278-4 devstack@n-api.service[134051]: X-User-Domain-Name: Default Aug 27 04:10:23.369182 n-d-852278-4 devstack@n-api.service[134051]: X-User-Id: b11beacbd367449d909a0512301b31d2 Aug 27 04:10:23.369182 n-d-852278-4 devstack@n-api.service[134051]: X-User-Name: tempest-TestShelveInstance-1035129230-project Aug 27 04:10:23.369182 n-d-852278-4 devstack@n-api.service[134051]: method: > Aug 27 04:10:23.369182 n-d-852278-4 devstack@n-api.service[134051]: exception: Instance 5d08fcac-077b-4c03-b799-f1beb78ea1f5 could not be found. Aug 27 04:10:23.369182 n-d-852278-4 devstack@n-api.service[134051]: action_args: {'id': '5d08fcac-077b-4c03-b799-f1beb78ea1f5'} Aug 27 04:10:23.369182 n-d-852278-4 devstack@n-api.service[134051]: {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:10:23.369182 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:10:23.369182 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:10:23.369182 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:10:23.369182 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:10:23.369182 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:10:23.369182 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:10:23.369182 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:10:23.369182 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:10:23.369182 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:10:23.369182 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d08fcac-077b-4c03-b799-f1beb78ea1f5 could not be found. Aug 27 04:10:23.369182 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 04:10:23.369182 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:10:23.369182 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 04:10:23.369182 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:10:23.369182 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:10:23.369182 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:10:23.369182 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:10:23.369182 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:10:23.369182 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:10:23.369182 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:10:23.369182 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:10:23.369182 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:10:23.369182 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:10:23.369182 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:10:23.369182 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:10:23.369182 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:10:23.369182 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d08fcac-077b-4c03-b799-f1beb78ea1f5 could not be found. Aug 27 04:10:23.369182 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 04:10:23.369182 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:10:23.369182 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 04:10:23.378905 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:10:23.378905 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:10:23.378905 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:10:23.378905 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:10:23.378905 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:10:23.378905 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d08fcac-077b-4c03-b799-f1beb78ea1f5 could not be found. Aug 27 04:10:23.378905 n-d-852278-4 devstack@n-api.service[134051]: ERROR nova.api.openstack.wsgi Aug 27 04:10:23.378905 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-a18a6af8-2dc0-45c5-9397-021dbd657861 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Returning 404 to user: Instance 5d08fcac-077b-4c03-b799-f1beb78ea1f5 could not be found. {{(pid=134051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:10:23.378905 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-a18a6af8-2dc0-45c5-9397-021dbd657861 tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5" status: 404 len: 111 microversion: 2.1 time: 0.036915 Aug 27 04:10:23.378905 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3671/7294] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:10:23 2022] GET /compute/v2.1/servers/5d08fcac-077b-4c03-b799-f1beb78ea1f5 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:10:23.583471 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-8c6e47a2-26a3-47b7-999a-857d6c1e2b0b tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] Calling method '.version_select at 0x7f5ee72149d0>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:10:23.611351 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-8c6e47a2-26a3-47b7-999a-857d6c1e2b0b tempest-TestShelveInstance-1035129230 tempest-TestShelveInstance-1035129230-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1761943916" status: 202 len: 0 microversion: 2.1 time: 0.032186 Aug 27 04:10:23.616434 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3624/7295] 10.222.0.70 () {58 vars in 1254 bytes} [Sat Aug 27 04:10:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1761943916 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:10:41.932061 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:10:41.934062 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:10:42.170239 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-d7ff7878-233d-47ce-9a52-9094fa86d739 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Action: 'create', calling method: .version_select at 0x7f5edc09f670>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-1480755664", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDwKYWC5LCsIdfkb0bV/Q7GH5iUtIs8okwanFJoDk1NM29N5MwYpC2BOTafCgqwWmb6YFMhXLTatcEvmLsyQZ7yyMOtdpeI5eWFnYRKvGrDvFVnHFr5cvoWHFX+hA0CeQg=="}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:10:42.186974 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-d7ff7878-233d-47ce-9a52-9094fa86d739 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Getting quotas for project 9068b6afff6649c8afdad5835bd4c6f1. Resources: {'key_pairs'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:10:42.192421 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-d7ff7878-233d-47ce-9a52-9094fa86d739 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Getting quotas for user ca6a9b3027ef4bafaa548b6031747a7c and project 9068b6afff6649c8afdad5835bd4c6f1. Resources: {'key_pairs'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:10:42.224969 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-d7ff7878-233d-47ce-9a52-9094fa86d739 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.298468 Aug 27 04:10:42.225689 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3672/7296] 10.222.0.70 () {60 vars in 1159 bytes} [Sat Aug 27 04:10:41 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:10:43.331796 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=22 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:10:43.332991 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:10:43.344825 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-0f6ea6ab-6cee-45d2-852b-c809dd26a48a tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1343744429", "imageRef": "1552acd0-176a-4c81-b680-29d74105e9d6", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1480755664", "security_groups": [{"name": "tempest-secgroup-smoke-734351320"}], "networks": [{"uuid": "9d1653ed-61d7-4abd-9ba0-9a7e544c3cc6"}]}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:10:43.456174 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.network.neutron [None req-0f6ea6ab-6cee-45d2-852b-c809dd26a48a tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] validate_networks() for [('9d1653ed-61d7-4abd-9ba0-9a7e544c3cc6', None, None, None, None, None)] {{(pid=134052) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:10:43.971560 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-0f6ea6ab-6cee-45d2-852b-c809dd26a48a tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Flavor limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:10:43.972098 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-0f6ea6ab-6cee-45d2-852b-c809dd26a48a tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Image limits 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:10:43.972754 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-0f6ea6ab-6cee-45d2-852b-c809dd26a48a tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Flavor pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:10:43.973175 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-0f6ea6ab-6cee-45d2-852b-c809dd26a48a tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Image pref 0:0:0 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:10:43.973664 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.virt.hardware [None req-0f6ea6ab-6cee-45d2-852b-c809dd26a48a tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134052) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:10:43.985167 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0f6ea6ab-6cee-45d2-852b-c809dd26a48a tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:43.985721 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0f6ea6ab-6cee-45d2-852b-c809dd26a48a tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:43.986435 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0f6ea6ab-6cee-45d2-852b-c809dd26a48a tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:43.987260 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0f6ea6ab-6cee-45d2-852b-c809dd26a48a tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:43.987838 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0f6ea6ab-6cee-45d2-852b-c809dd26a48a tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:43.988543 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-0f6ea6ab-6cee-45d2-852b-c809dd26a48a tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:44.013165 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-0f6ea6ab-6cee-45d2-852b-c809dd26a48a tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Getting quotas for project 9068b6afff6649c8afdad5835bd4c6f1. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:10:44.019735 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.quota [None req-0f6ea6ab-6cee-45d2-852b-c809dd26a48a tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Getting quotas for user ca6a9b3027ef4bafaa548b6031747a7c and project 9068b6afff6649c8afdad5835bd4c6f1. Resources: {'instances', 'cores', 'ram'} {{(pid=134052) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:10:44.035657 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-0f6ea6ab-6cee-45d2-852b-c809dd26a48a tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Going to run 1 instances... {{(pid=134052) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:10:44.038843 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-0f6ea6ab-6cee-45d2-852b-c809dd26a48a tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] [instance: 066042e2-8e59-4f20-a70b-18decb114ba1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1552acd0-176a-4c81-b680-29d74105e9d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134052) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:10:44.097591 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-0f6ea6ab-6cee-45d2-852b-c809dd26a48a tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.767701 Aug 27 04:10:44.104290 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3625/7297] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 04:10:43 2022] POST /compute/v2.1/servers => generated 405 bytes in 769 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:10:44.110489 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-bf405a3b-3f8c-4029-be9d-58689a07fbaf tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:10:44.111799 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-bf405a3b-3f8c-4029-be9d-58689a07fbaf tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] [instance: 066042e2-8e59-4f20-a70b-18decb114ba1] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:10:44.173976 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-bf405a3b-3f8c-4029-be9d-58689a07fbaf tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6a9b3027ef4bafaa548b6031747a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9068b6afff6649c8afdad5835bd4c6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:10:44.181728 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-bf405a3b-3f8c-4029-be9d-58689a07fbaf tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] 10.222.0.70 "GET /compute/v2.1/servers/066042e2-8e59-4f20-a70b-18decb114ba1" status: 200 len: 1249 microversion: 2.1 time: 0.076058 Aug 27 04:10:44.182738 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3673/7298] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:10:44 2022] GET /compute/v2.1/servers/066042e2-8e59-4f20-a70b-18decb114ba1 => generated 1249 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:10:45.206292 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-4518f1ac-9d02-467a-b19e-59b2da71bc42 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:10:45.206991 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-4518f1ac-9d02-467a-b19e-59b2da71bc42 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] [instance: 066042e2-8e59-4f20-a70b-18decb114ba1] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:10:45.214027 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4518f1ac-9d02-467a-b19e-59b2da71bc42 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:45.214636 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4518f1ac-9d02-467a-b19e-59b2da71bc42 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:45.215158 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4518f1ac-9d02-467a-b19e-59b2da71bc42 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:45.215947 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4518f1ac-9d02-467a-b19e-59b2da71bc42 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:45.216646 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4518f1ac-9d02-467a-b19e-59b2da71bc42 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:45.217099 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-4518f1ac-9d02-467a-b19e-59b2da71bc42 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:45.298058 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-4518f1ac-9d02-467a-b19e-59b2da71bc42 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6a9b3027ef4bafaa548b6031747a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9068b6afff6649c8afdad5835bd4c6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:10:45.308166 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-4518f1ac-9d02-467a-b19e-59b2da71bc42 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] 10.222.0.70 "GET /compute/v2.1/servers/066042e2-8e59-4f20-a70b-18decb114ba1" status: 200 len: 1301 microversion: 2.1 time: 0.106709 Aug 27 04:10:45.308860 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3626/7299] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:10:45 2022] GET /compute/v2.1/servers/066042e2-8e59-4f20-a70b-18decb114ba1 => generated 1301 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:10:46.333638 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-4e597c3c-c9e9-4ee2-a2e8-8db748317101 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:10:46.334193 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-4e597c3c-c9e9-4ee2-a2e8-8db748317101 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] [instance: 066042e2-8e59-4f20-a70b-18decb114ba1] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:10:46.341786 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4e597c3c-c9e9-4ee2-a2e8-8db748317101 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:46.342328 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4e597c3c-c9e9-4ee2-a2e8-8db748317101 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:46.343569 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4e597c3c-c9e9-4ee2-a2e8-8db748317101 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:46.344355 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4e597c3c-c9e9-4ee2-a2e8-8db748317101 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:46.344833 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4e597c3c-c9e9-4ee2-a2e8-8db748317101 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:46.345262 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-4e597c3c-c9e9-4ee2-a2e8-8db748317101 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:46.567361 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-4e597c3c-c9e9-4ee2-a2e8-8db748317101 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6a9b3027ef4bafaa548b6031747a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9068b6afff6649c8afdad5835bd4c6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:10:46.575681 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-4e597c3c-c9e9-4ee2-a2e8-8db748317101 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] 10.222.0.70 "GET /compute/v2.1/servers/066042e2-8e59-4f20-a70b-18decb114ba1" status: 200 len: 1374 microversion: 2.1 time: 0.249176 Aug 27 04:10:46.576289 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3674/7300] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:10:46 2022] GET /compute/v2.1/servers/066042e2-8e59-4f20-a70b-18decb114ba1 => generated 1374 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:10:47.383138 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-23e95966-10f1-484f-866b-847bbd03f965 req-3691baa8-59bb-47fa-945f-a5b6f4b61738 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "066042e2-8e59-4f20-a70b-18decb114ba1", "tag": "212f4e5b-da57-413f-b8ad-756e7e5bb757"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:10:47.394638 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-23e95966-10f1-484f-866b-847bbd03f965 req-3691baa8-59bb-47fa-945f-a5b6f4b61738 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:47.395464 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-23e95966-10f1-484f-866b-847bbd03f965 req-3691baa8-59bb-47fa-945f-a5b6f4b61738 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:47.395993 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-23e95966-10f1-484f-866b-847bbd03f965 req-3691baa8-59bb-47fa-945f-a5b6f4b61738 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:47.408304 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-23e95966-10f1-484f-866b-847bbd03f965 req-3691baa8-59bb-47fa-945f-a5b6f4b61738 service nova] Creating event network-changed:212f4e5b-da57-413f-b8ad-756e7e5bb757 for instance 066042e2-8e59-4f20-a70b-18decb114ba1 on n-h1-852278-4 Aug 27 04:10:47.414472 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-23e95966-10f1-484f-866b-847bbd03f965 req-3691baa8-59bb-47fa-945f-a5b6f4b61738 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034717 Aug 27 04:10:47.415282 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3627/7301] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 04:10:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:10:47.597018 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-6247a06f-5585-4cf3-9808-ce7da9807216 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:10:47.597655 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-6247a06f-5585-4cf3-9808-ce7da9807216 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] [instance: 066042e2-8e59-4f20-a70b-18decb114ba1] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:10:47.605308 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6247a06f-5585-4cf3-9808-ce7da9807216 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:47.605825 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6247a06f-5585-4cf3-9808-ce7da9807216 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:47.606282 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6247a06f-5585-4cf3-9808-ce7da9807216 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:47.607082 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6247a06f-5585-4cf3-9808-ce7da9807216 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:47.607580 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6247a06f-5585-4cf3-9808-ce7da9807216 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:47.608025 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6247a06f-5585-4cf3-9808-ce7da9807216 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:47.820726 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-6247a06f-5585-4cf3-9808-ce7da9807216 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6a9b3027ef4bafaa548b6031747a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9068b6afff6649c8afdad5835bd4c6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:10:47.829112 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-6247a06f-5585-4cf3-9808-ce7da9807216 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] 10.222.0.70 "GET /compute/v2.1/servers/066042e2-8e59-4f20-a70b-18decb114ba1" status: 200 len: 1374 microversion: 2.1 time: 0.236089 Aug 27 04:10:47.829716 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3675/7302] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:10:47 2022] GET /compute/v2.1/servers/066042e2-8e59-4f20-a70b-18decb114ba1 => generated 1374 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:10:48.852815 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-a4a3fe37-f328-468c-bb76-a9a926d3692e tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:10:48.853492 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-a4a3fe37-f328-468c-bb76-a9a926d3692e tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] [instance: 066042e2-8e59-4f20-a70b-18decb114ba1] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:10:48.860629 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a4a3fe37-f328-468c-bb76-a9a926d3692e tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:48.861406 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a4a3fe37-f328-468c-bb76-a9a926d3692e tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:48.862122 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a4a3fe37-f328-468c-bb76-a9a926d3692e tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:48.862909 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a4a3fe37-f328-468c-bb76-a9a926d3692e tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:48.863585 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a4a3fe37-f328-468c-bb76-a9a926d3692e tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:48.864270 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-a4a3fe37-f328-468c-bb76-a9a926d3692e tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:49.100360 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-a4a3fe37-f328-468c-bb76-a9a926d3692e tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6a9b3027ef4bafaa548b6031747a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9068b6afff6649c8afdad5835bd4c6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:10:49.109243 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-a4a3fe37-f328-468c-bb76-a9a926d3692e tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] 10.222.0.70 "GET /compute/v2.1/servers/066042e2-8e59-4f20-a70b-18decb114ba1" status: 200 len: 1374 microversion: 2.1 time: 0.262420 Aug 27 04:10:49.109833 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3628/7303] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:10:48 2022] GET /compute/v2.1/servers/066042e2-8e59-4f20-a70b-18decb114ba1 => generated 1374 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:10:50.130721 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-5d7256b2-b06a-4cd4-bc2f-7769b6223100 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:10:50.131323 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-5d7256b2-b06a-4cd4-bc2f-7769b6223100 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] [instance: 066042e2-8e59-4f20-a70b-18decb114ba1] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:10:50.139182 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5d7256b2-b06a-4cd4-bc2f-7769b6223100 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:50.139739 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5d7256b2-b06a-4cd4-bc2f-7769b6223100 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:50.140187 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5d7256b2-b06a-4cd4-bc2f-7769b6223100 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:50.140962 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5d7256b2-b06a-4cd4-bc2f-7769b6223100 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:50.141422 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5d7256b2-b06a-4cd4-bc2f-7769b6223100 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:50.141858 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-5d7256b2-b06a-4cd4-bc2f-7769b6223100 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:50.281764 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-5d7256b2-b06a-4cd4-bc2f-7769b6223100 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6a9b3027ef4bafaa548b6031747a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9068b6afff6649c8afdad5835bd4c6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:10:50.290294 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-5d7256b2-b06a-4cd4-bc2f-7769b6223100 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] 10.222.0.70 "GET /compute/v2.1/servers/066042e2-8e59-4f20-a70b-18decb114ba1" status: 200 len: 1374 microversion: 2.1 time: 0.163668 Aug 27 04:10:50.290944 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3676/7304] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:10:50 2022] GET /compute/v2.1/servers/066042e2-8e59-4f20-a70b-18decb114ba1 => generated 1374 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:10:51.313970 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-ade05e29-9e4c-4d22-b021-51a6c9f13074 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:10:51.314837 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-ade05e29-9e4c-4d22-b021-51a6c9f13074 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] [instance: 066042e2-8e59-4f20-a70b-18decb114ba1] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:10:51.325059 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ade05e29-9e4c-4d22-b021-51a6c9f13074 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:51.325798 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ade05e29-9e4c-4d22-b021-51a6c9f13074 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:51.326277 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ade05e29-9e4c-4d22-b021-51a6c9f13074 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:51.327293 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ade05e29-9e4c-4d22-b021-51a6c9f13074 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:51.327918 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ade05e29-9e4c-4d22-b021-51a6c9f13074 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:51.328372 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-ade05e29-9e4c-4d22-b021-51a6c9f13074 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:51.481114 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-ade05e29-9e4c-4d22-b021-51a6c9f13074 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6a9b3027ef4bafaa548b6031747a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9068b6afff6649c8afdad5835bd4c6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:10:51.490383 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-ade05e29-9e4c-4d22-b021-51a6c9f13074 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] 10.222.0.70 "GET /compute/v2.1/servers/066042e2-8e59-4f20-a70b-18decb114ba1" status: 200 len: 1374 microversion: 2.1 time: 0.182924 Aug 27 04:10:51.491199 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3629/7305] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:10:51 2022] GET /compute/v2.1/servers/066042e2-8e59-4f20-a70b-18decb114ba1 => generated 1374 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:10:52.512471 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-cab3a9d7-3197-4f02-9ebd-da0827fad6d4 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:10:52.513101 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-cab3a9d7-3197-4f02-9ebd-da0827fad6d4 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] [instance: 066042e2-8e59-4f20-a70b-18decb114ba1] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:10:52.520874 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cab3a9d7-3197-4f02-9ebd-da0827fad6d4 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:52.521382 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cab3a9d7-3197-4f02-9ebd-da0827fad6d4 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:52.521843 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cab3a9d7-3197-4f02-9ebd-da0827fad6d4 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:52.522563 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cab3a9d7-3197-4f02-9ebd-da0827fad6d4 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:52.523038 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cab3a9d7-3197-4f02-9ebd-da0827fad6d4 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:52.523485 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-cab3a9d7-3197-4f02-9ebd-da0827fad6d4 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:52.662228 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-cab3a9d7-3197-4f02-9ebd-da0827fad6d4 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6a9b3027ef4bafaa548b6031747a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9068b6afff6649c8afdad5835bd4c6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:10:52.670752 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-cab3a9d7-3197-4f02-9ebd-da0827fad6d4 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] 10.222.0.70 "GET /compute/v2.1/servers/066042e2-8e59-4f20-a70b-18decb114ba1" status: 200 len: 1374 microversion: 2.1 time: 0.162482 Aug 27 04:10:52.671331 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3677/7306] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:10:52 2022] GET /compute/v2.1/servers/066042e2-8e59-4f20-a70b-18decb114ba1 => generated 1374 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:10:53.422092 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-bbf1261e-5870-49d5-bac4-de1893ff108f req-918ec9fe-b749-49e7-867f-375e8ff2e94c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "066042e2-8e59-4f20-a70b-18decb114ba1", "name": "network-vif-plugged", "status": "completed", "tag": "212f4e5b-da57-413f-b8ad-756e7e5bb757"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:10:53.433399 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-bbf1261e-5870-49d5-bac4-de1893ff108f req-918ec9fe-b749-49e7-867f-375e8ff2e94c service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:53.433886 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-bbf1261e-5870-49d5-bac4-de1893ff108f req-918ec9fe-b749-49e7-867f-375e8ff2e94c service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:53.434319 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-bbf1261e-5870-49d5-bac4-de1893ff108f req-918ec9fe-b749-49e7-867f-375e8ff2e94c service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:53.451311 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-bbf1261e-5870-49d5-bac4-de1893ff108f req-918ec9fe-b749-49e7-867f-375e8ff2e94c service nova] Creating event network-vif-plugged:212f4e5b-da57-413f-b8ad-756e7e5bb757 for instance 066042e2-8e59-4f20-a70b-18decb114ba1 on n-h1-852278-4 Aug 27 04:10:53.456803 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-bbf1261e-5870-49d5-bac4-de1893ff108f req-918ec9fe-b749-49e7-867f-375e8ff2e94c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038573 Aug 27 04:10:53.457589 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3630/7307] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 04:10:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:10:53.691668 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-e7d668fc-d2be-4b00-9bbf-7acd9adffa1f tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:10:53.692518 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-e7d668fc-d2be-4b00-9bbf-7acd9adffa1f tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] [instance: 066042e2-8e59-4f20-a70b-18decb114ba1] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:10:53.699949 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e7d668fc-d2be-4b00-9bbf-7acd9adffa1f tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:53.700264 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e7d668fc-d2be-4b00-9bbf-7acd9adffa1f tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:53.700784 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e7d668fc-d2be-4b00-9bbf-7acd9adffa1f tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:53.701476 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e7d668fc-d2be-4b00-9bbf-7acd9adffa1f tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:53.701965 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e7d668fc-d2be-4b00-9bbf-7acd9adffa1f tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:53.702401 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-e7d668fc-d2be-4b00-9bbf-7acd9adffa1f tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:53.856451 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-e7d668fc-d2be-4b00-9bbf-7acd9adffa1f tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6a9b3027ef4bafaa548b6031747a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9068b6afff6649c8afdad5835bd4c6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:10:53.864735 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-e7d668fc-d2be-4b00-9bbf-7acd9adffa1f tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] 10.222.0.70 "GET /compute/v2.1/servers/066042e2-8e59-4f20-a70b-18decb114ba1" status: 200 len: 1374 microversion: 2.1 time: 0.177045 Aug 27 04:10:53.865289 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3678/7308] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:10:53 2022] GET /compute/v2.1/servers/066042e2-8e59-4f20-a70b-18decb114ba1 => generated 1374 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:10:54.885221 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:10:54.886112 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=6 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:10:54.891671 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3852a7f0-1080-45dd-8ff6-e224039324ad tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:10:54.892557 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-3852a7f0-1080-45dd-8ff6-e224039324ad tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] [instance: 066042e2-8e59-4f20-a70b-18decb114ba1] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:10:54.899899 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3852a7f0-1080-45dd-8ff6-e224039324ad tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:54.900304 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3852a7f0-1080-45dd-8ff6-e224039324ad tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:54.900770 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3852a7f0-1080-45dd-8ff6-e224039324ad tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:54.901460 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3852a7f0-1080-45dd-8ff6-e224039324ad tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:54.901899 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3852a7f0-1080-45dd-8ff6-e224039324ad tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:54.902345 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3852a7f0-1080-45dd-8ff6-e224039324ad tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:55.048039 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-3852a7f0-1080-45dd-8ff6-e224039324ad tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6a9b3027ef4bafaa548b6031747a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9068b6afff6649c8afdad5835bd4c6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:10:55.055957 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-3852a7f0-1080-45dd-8ff6-e224039324ad tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] 10.222.0.70 "GET /compute/v2.1/servers/066042e2-8e59-4f20-a70b-18decb114ba1" status: 200 len: 1559 microversion: 2.1 time: 0.171769 Aug 27 04:10:55.056607 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3631/7309] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:10:54 2022] GET /compute/v2.1/servers/066042e2-8e59-4f20-a70b-18decb114ba1 => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:10:55.076028 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-24d71e7b-aa7c-431c-a08a-c0976ebfdcdd tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:10:55.076739 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-24d71e7b-aa7c-431c-a08a-c0976ebfdcdd tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] [instance: 066042e2-8e59-4f20-a70b-18decb114ba1] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:10:55.078649 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=6 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:10:55.084963 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-24d71e7b-aa7c-431c-a08a-c0976ebfdcdd tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:55.085458 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-24d71e7b-aa7c-431c-a08a-c0976ebfdcdd tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:55.085908 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-24d71e7b-aa7c-431c-a08a-c0976ebfdcdd tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:55.086622 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-24d71e7b-aa7c-431c-a08a-c0976ebfdcdd tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:55.087086 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-24d71e7b-aa7c-431c-a08a-c0976ebfdcdd tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:55.087491 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-24d71e7b-aa7c-431c-a08a-c0976ebfdcdd tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:55.227690 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-24d71e7b-aa7c-431c-a08a-c0976ebfdcdd tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6a9b3027ef4bafaa548b6031747a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9068b6afff6649c8afdad5835bd4c6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:10:55.236198 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-24d71e7b-aa7c-431c-a08a-c0976ebfdcdd tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] 10.222.0.70 "GET /compute/v2.1/servers/066042e2-8e59-4f20-a70b-18decb114ba1" status: 200 len: 1559 microversion: 2.1 time: 0.164288 Aug 27 04:10:55.236815 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3679/7310] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:10:55 2022] GET /compute/v2.1/servers/066042e2-8e59-4f20-a70b-18decb114ba1 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:10:57.060146 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-cc57c5f3-b3c2-4824-ac87-68b2b54d2a8d req-495dce79-8460-41a0-aec0-f69a18ef46f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "066042e2-8e59-4f20-a70b-18decb114ba1", "tag": "212f4e5b-da57-413f-b8ad-756e7e5bb757"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:10:57.069642 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-cc57c5f3-b3c2-4824-ac87-68b2b54d2a8d req-495dce79-8460-41a0-aec0-f69a18ef46f5 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:57.070360 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-cc57c5f3-b3c2-4824-ac87-68b2b54d2a8d req-495dce79-8460-41a0-aec0-f69a18ef46f5 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:57.070952 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-cc57c5f3-b3c2-4824-ac87-68b2b54d2a8d req-495dce79-8460-41a0-aec0-f69a18ef46f5 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:57.082601 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-cc57c5f3-b3c2-4824-ac87-68b2b54d2a8d req-495dce79-8460-41a0-aec0-f69a18ef46f5 service nova] Creating event network-changed:212f4e5b-da57-413f-b8ad-756e7e5bb757 for instance 066042e2-8e59-4f20-a70b-18decb114ba1 on n-h1-852278-4 Aug 27 04:10:57.087654 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-cc57c5f3-b3c2-4824-ac87-68b2b54d2a8d req-495dce79-8460-41a0-aec0-f69a18ef46f5 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092389 Aug 27 04:10:57.088490 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3632/7311] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 04:10:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:12:52.301214 n-d-852278-4 devstack@n-api.service[134051]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f9fac4be-af37-4094-9325-9fb8d6a54e45] AMQP server on 10.222.0.70:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 04:12:52.303016 n-d-852278-4 devstack@n-api.service[134051]: ERROR oslo.messaging._drivers.impl_rabbit [-] [467acb70-6ff8-442b-874d-8e7c3cdab9ba] AMQP server on 10.222.0.70:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 04:12:52.303891 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:12:52.305237 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=36 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:12:52.313954 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-3a9ea7b4-86e3-468a-a7cf-6bc9e5ea386d tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-772985498"}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:12:52.317875 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-3a9ea7b4-86e3-468a-a7cf-6bc9e5ea386d tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] [instance: 066042e2-8e59-4f20-a70b-18decb114ba1] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:12:52.325463 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3a9ea7b4-86e3-468a-a7cf-6bc9e5ea386d tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:12:52.325963 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3a9ea7b4-86e3-468a-a7cf-6bc9e5ea386d tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:12:52.326416 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3a9ea7b4-86e3-468a-a7cf-6bc9e5ea386d tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:12:52.327117 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3a9ea7b4-86e3-468a-a7cf-6bc9e5ea386d tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:12:52.327581 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3a9ea7b4-86e3-468a-a7cf-6bc9e5ea386d tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:12:52.328018 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-3a9ea7b4-86e3-468a-a7cf-6bc9e5ea386d tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:12:52.532565 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-3a9ea7b4-86e3-468a-a7cf-6bc9e5ea386d tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] 10.222.0.70 "POST /compute/v2.1/servers/066042e2-8e59-4f20-a70b-18decb114ba1/action" status: 202 len: 0 microversion: 2.1 time: 0.234396 Aug 27 04:12:52.533230 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3680/7312] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 04:12:52 2022] POST /compute/v2.1/servers/066042e2-8e59-4f20-a70b-18decb114ba1/action => generated 0 bytes in 236 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 27 04:12:57.984814 n-d-852278-4 devstack@n-api.service[134052]: ERROR oslo.messaging._drivers.impl_rabbit [-] [998cde6e-8682-4408-bcc9-d1ac55bd7468] AMQP server on 10.222.0.70:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 04:12:57.987763 n-d-852278-4 devstack@n-api.service[134052]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9851ddbb-a5ae-40a5-a271-3fff08a3a780] AMQP server on 10.222.0.70:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 04:12:57.988984 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:12:57.993660 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=32 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:12:58.002131 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-a848f974-5d9b-464e-8e7b-e5ad5c521dc7 req-8c837b09-eb76-433a-b256-6414ff4bf546 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "066042e2-8e59-4f20-a70b-18decb114ba1", "name": "network-vif-plugged", "status": "completed", "tag": "212f4e5b-da57-413f-b8ad-756e7e5bb757"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:12:58.020670 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-a848f974-5d9b-464e-8e7b-e5ad5c521dc7 req-8c837b09-eb76-433a-b256-6414ff4bf546 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:12:58.021463 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-a848f974-5d9b-464e-8e7b-e5ad5c521dc7 req-8c837b09-eb76-433a-b256-6414ff4bf546 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:12:58.022115 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-a848f974-5d9b-464e-8e7b-e5ad5c521dc7 req-8c837b09-eb76-433a-b256-6414ff4bf546 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:12:58.046089 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-a848f974-5d9b-464e-8e7b-e5ad5c521dc7 req-8c837b09-eb76-433a-b256-6414ff4bf546 service nova] Creating event network-vif-plugged:212f4e5b-da57-413f-b8ad-756e7e5bb757 for instance 066042e2-8e59-4f20-a70b-18decb114ba1 on n-h1-852278-4 Aug 27 04:12:58.057276 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-a848f974-5d9b-464e-8e7b-e5ad5c521dc7 req-8c837b09-eb76-433a-b256-6414ff4bf546 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075709 Aug 27 04:12:58.058674 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3633/7313] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 04:12:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:13:05.071555 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:13:05.072524 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:13:05.077556 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-885d385a-0648-441a-865f-cb328a919edf tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1191738222", "imageRef": "b7cd338e-2951-40dd-b6f2-893547afbc0b", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1480755664", "security_groups": [{"name": "tempest-secgroup-smoke-734351320"}], "networks": [{"uuid": "9d1653ed-61d7-4abd-9ba0-9a7e544c3cc6"}]}} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:13:05.105467 n-d-852278-4 devstack@n-api.service[134051]: INFO oslo.messaging._drivers.impl_rabbit [-] [f9fac4be-af37-4094-9325-9fb8d6a54e45] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 60664. Aug 27 04:13:05.107453 n-d-852278-4 devstack@n-api.service[134051]: INFO oslo.messaging._drivers.impl_rabbit [-] [467acb70-6ff8-442b-874d-8e7c3cdab9ba] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 60666. Aug 27 04:13:05.194309 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.network.neutron [None req-885d385a-0648-441a-865f-cb328a919edf tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] validate_networks() for [('9d1653ed-61d7-4abd-9ba0-9a7e544c3cc6', None, None, None, None, None)] {{(pid=134051) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:13:05.653336 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-885d385a-0648-441a-865f-cb328a919edf tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Flavor limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:13:05.653769 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-885d385a-0648-441a-865f-cb328a919edf tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Image limits 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:13:05.654246 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-885d385a-0648-441a-865f-cb328a919edf tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Flavor pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:13:05.654657 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-885d385a-0648-441a-865f-cb328a919edf tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Image pref 0:0:0 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:13:05.655076 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.virt.hardware [None req-885d385a-0648-441a-865f-cb328a919edf tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:13:05.664810 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-885d385a-0648-441a-865f-cb328a919edf tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:05.665299 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-885d385a-0648-441a-865f-cb328a919edf tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:05.665749 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-885d385a-0648-441a-865f-cb328a919edf tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:05.666473 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-885d385a-0648-441a-865f-cb328a919edf tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:05.666929 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-885d385a-0648-441a-865f-cb328a919edf tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:05.667358 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-885d385a-0648-441a-865f-cb328a919edf tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:05.688552 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-885d385a-0648-441a-865f-cb328a919edf tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Getting quotas for project 9068b6afff6649c8afdad5835bd4c6f1. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:13:05.696814 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.quota [None req-885d385a-0648-441a-865f-cb328a919edf tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Getting quotas for user ca6a9b3027ef4bafaa548b6031747a7c and project 9068b6afff6649c8afdad5835bd4c6f1. Resources: {'instances', 'cores', 'ram'} {{(pid=134051) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:13:05.710339 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-885d385a-0648-441a-865f-cb328a919edf tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Going to run 1 instances... {{(pid=134051) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:13:05.712865 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-885d385a-0648-441a-865f-cb328a919edf tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] [instance: ce87a865-d21e-4f65-ae4e-6e75406dd100] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b7cd338e-2951-40dd-b6f2-893547afbc0b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134051) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:13:05.762817 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-885d385a-0648-441a-865f-cb328a919edf tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.694058 Aug 27 04:13:05.763544 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3681/7314] 10.222.0.70 () {60 vars in 1147 bytes} [Sat Aug 27 04:13:05 2022] POST /compute/v2.1/servers => generated 405 bytes in 696 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:13:05.777334 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-9d02d8b4-4e8d-4c27-8923-0e3d168e538f tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:05.778117 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-9d02d8b4-4e8d-4c27-8923-0e3d168e538f tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] [instance: ce87a865-d21e-4f65-ae4e-6e75406dd100] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:13:05.810302 n-d-852278-4 devstack@n-api.service[134052]: INFO oslo.messaging._drivers.impl_rabbit [-] [9851ddbb-a5ae-40a5-a271-3fff08a3a780] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 60682. Aug 27 04:13:05.811114 n-d-852278-4 devstack@n-api.service[134052]: INFO oslo.messaging._drivers.impl_rabbit [-] [998cde6e-8682-4408-bcc9-d1ac55bd7468] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 60680. Aug 27 04:13:05.849555 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-9d02d8b4-4e8d-4c27-8923-0e3d168e538f tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6a9b3027ef4bafaa548b6031747a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9068b6afff6649c8afdad5835bd4c6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:05.857206 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-9d02d8b4-4e8d-4c27-8923-0e3d168e538f tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] 10.222.0.70 "GET /compute/v2.1/servers/ce87a865-d21e-4f65-ae4e-6e75406dd100" status: 200 len: 1249 microversion: 2.1 time: 0.086498 Aug 27 04:13:05.857828 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3634/7315] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:13:05 2022] GET /compute/v2.1/servers/ce87a865-d21e-4f65-ae4e-6e75406dd100 => generated 1249 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:13:06.878428 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-68edd925-594f-418e-b241-a5070aa1e7d5 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:06.879041 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-68edd925-594f-418e-b241-a5070aa1e7d5 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] [instance: ce87a865-d21e-4f65-ae4e-6e75406dd100] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:13:06.886916 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-68edd925-594f-418e-b241-a5070aa1e7d5 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:06.887483 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-68edd925-594f-418e-b241-a5070aa1e7d5 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:06.887944 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-68edd925-594f-418e-b241-a5070aa1e7d5 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:06.888708 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-68edd925-594f-418e-b241-a5070aa1e7d5 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:06.889456 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-68edd925-594f-418e-b241-a5070aa1e7d5 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:06.889907 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-68edd925-594f-418e-b241-a5070aa1e7d5 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:06.972822 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-68edd925-594f-418e-b241-a5070aa1e7d5 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6a9b3027ef4bafaa548b6031747a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9068b6afff6649c8afdad5835bd4c6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:06.980799 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-68edd925-594f-418e-b241-a5070aa1e7d5 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] 10.222.0.70 "GET /compute/v2.1/servers/ce87a865-d21e-4f65-ae4e-6e75406dd100" status: 200 len: 1309 microversion: 2.1 time: 0.107121 Aug 27 04:13:06.981612 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3682/7316] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:13:06 2022] GET /compute/v2.1/servers/ce87a865-d21e-4f65-ae4e-6e75406dd100 => generated 1309 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:13:08.003440 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-bb95f30d-a314-422c-96a9-ba9b7764af4f tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:08.004968 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-bb95f30d-a314-422c-96a9-ba9b7764af4f tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] [instance: ce87a865-d21e-4f65-ae4e-6e75406dd100] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:13:08.013289 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bb95f30d-a314-422c-96a9-ba9b7764af4f tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:08.013809 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bb95f30d-a314-422c-96a9-ba9b7764af4f tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:08.014281 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bb95f30d-a314-422c-96a9-ba9b7764af4f tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:08.014996 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bb95f30d-a314-422c-96a9-ba9b7764af4f tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:08.015447 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bb95f30d-a314-422c-96a9-ba9b7764af4f tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:08.015877 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-bb95f30d-a314-422c-96a9-ba9b7764af4f tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:08.177427 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-bb95f30d-a314-422c-96a9-ba9b7764af4f tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6a9b3027ef4bafaa548b6031747a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9068b6afff6649c8afdad5835bd4c6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:08.190315 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-bb95f30d-a314-422c-96a9-ba9b7764af4f tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] 10.222.0.70 "GET /compute/v2.1/servers/ce87a865-d21e-4f65-ae4e-6e75406dd100" status: 200 len: 1374 microversion: 2.1 time: 0.192337 Aug 27 04:13:08.190936 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3635/7317] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:13:07 2022] GET /compute/v2.1/servers/ce87a865-d21e-4f65-ae4e-6e75406dd100 => generated 1374 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:13:09.214034 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-0bc91402-3e29-4fba-a0e6-ae030aa80e70 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:09.214691 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-0bc91402-3e29-4fba-a0e6-ae030aa80e70 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] [instance: ce87a865-d21e-4f65-ae4e-6e75406dd100] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:13:09.224956 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0bc91402-3e29-4fba-a0e6-ae030aa80e70 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:09.225522 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0bc91402-3e29-4fba-a0e6-ae030aa80e70 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:09.225924 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0bc91402-3e29-4fba-a0e6-ae030aa80e70 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:09.226728 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0bc91402-3e29-4fba-a0e6-ae030aa80e70 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:09.227221 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0bc91402-3e29-4fba-a0e6-ae030aa80e70 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:09.227624 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-0bc91402-3e29-4fba-a0e6-ae030aa80e70 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:09.370432 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-0bc91402-3e29-4fba-a0e6-ae030aa80e70 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6a9b3027ef4bafaa548b6031747a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9068b6afff6649c8afdad5835bd4c6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:09.379094 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-0bc91402-3e29-4fba-a0e6-ae030aa80e70 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] 10.222.0.70 "GET /compute/v2.1/servers/ce87a865-d21e-4f65-ae4e-6e75406dd100" status: 200 len: 1374 microversion: 2.1 time: 0.171444 Aug 27 04:13:09.379929 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3683/7318] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:13:09 2022] GET /compute/v2.1/servers/ce87a865-d21e-4f65-ae4e-6e75406dd100 => generated 1374 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:13:09.970409 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-c3234609-74b4-4645-bb6c-292f9bfe2da2 req-de9022fa-43b8-4b09-98b7-e08b03c4d499 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "066042e2-8e59-4f20-a70b-18decb114ba1", "name": "network-vif-unplugged", "status": "completed", "tag": "212f4e5b-da57-413f-b8ad-756e7e5bb757"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:13:09.981937 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-c3234609-74b4-4645-bb6c-292f9bfe2da2 req-de9022fa-43b8-4b09-98b7-e08b03c4d499 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:09.982665 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-c3234609-74b4-4645-bb6c-292f9bfe2da2 req-de9022fa-43b8-4b09-98b7-e08b03c4d499 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:09.983283 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-c3234609-74b4-4645-bb6c-292f9bfe2da2 req-de9022fa-43b8-4b09-98b7-e08b03c4d499 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:10.016903 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-c3234609-74b4-4645-bb6c-292f9bfe2da2 req-de9022fa-43b8-4b09-98b7-e08b03c4d499 service nova] Creating event network-vif-unplugged:212f4e5b-da57-413f-b8ad-756e7e5bb757 for instance 066042e2-8e59-4f20-a70b-18decb114ba1 on n-h1-852278-4 Aug 27 04:13:10.022416 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-c3234609-74b4-4645-bb6c-292f9bfe2da2 req-de9022fa-43b8-4b09-98b7-e08b03c4d499 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055832 Aug 27 04:13:10.023123 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3636/7319] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 04:13:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:13:10.402554 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-510a613b-fc29-460a-bba5-7575fd2887cf tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:10.403813 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-510a613b-fc29-460a-bba5-7575fd2887cf tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] [instance: ce87a865-d21e-4f65-ae4e-6e75406dd100] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:13:10.411326 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-510a613b-fc29-460a-bba5-7575fd2887cf tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:10.411961 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-510a613b-fc29-460a-bba5-7575fd2887cf tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:10.412464 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-510a613b-fc29-460a-bba5-7575fd2887cf tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:10.413445 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-510a613b-fc29-460a-bba5-7575fd2887cf tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:10.414318 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-510a613b-fc29-460a-bba5-7575fd2887cf tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:10.414844 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-510a613b-fc29-460a-bba5-7575fd2887cf tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:10.555015 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-510a613b-fc29-460a-bba5-7575fd2887cf tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6a9b3027ef4bafaa548b6031747a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9068b6afff6649c8afdad5835bd4c6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:10.563854 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-510a613b-fc29-460a-bba5-7575fd2887cf tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] 10.222.0.70 "GET /compute/v2.1/servers/ce87a865-d21e-4f65-ae4e-6e75406dd100" status: 200 len: 1374 microversion: 2.1 time: 0.165288 Aug 27 04:13:10.564614 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3684/7320] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:13:10 2022] GET /compute/v2.1/servers/ce87a865-d21e-4f65-ae4e-6e75406dd100 => generated 1374 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:13:11.586564 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-c0dc3f0c-b333-4f2d-bb52-b4d8df3a94f3 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:11.588974 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-c0dc3f0c-b333-4f2d-bb52-b4d8df3a94f3 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] [instance: ce87a865-d21e-4f65-ae4e-6e75406dd100] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:13:11.595993 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c0dc3f0c-b333-4f2d-bb52-b4d8df3a94f3 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:11.596588 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c0dc3f0c-b333-4f2d-bb52-b4d8df3a94f3 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:11.597107 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c0dc3f0c-b333-4f2d-bb52-b4d8df3a94f3 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:11.597947 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c0dc3f0c-b333-4f2d-bb52-b4d8df3a94f3 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:11.598473 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c0dc3f0c-b333-4f2d-bb52-b4d8df3a94f3 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:11.598951 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-c0dc3f0c-b333-4f2d-bb52-b4d8df3a94f3 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:11.743228 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-c0dc3f0c-b333-4f2d-bb52-b4d8df3a94f3 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6a9b3027ef4bafaa548b6031747a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9068b6afff6649c8afdad5835bd4c6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:11.751844 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-c0dc3f0c-b333-4f2d-bb52-b4d8df3a94f3 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] 10.222.0.70 "GET /compute/v2.1/servers/ce87a865-d21e-4f65-ae4e-6e75406dd100" status: 200 len: 1374 microversion: 2.1 time: 0.170546 Aug 27 04:13:11.752458 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3637/7321] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:13:11 2022] GET /compute/v2.1/servers/ce87a865-d21e-4f65-ae4e-6e75406dd100 => generated 1374 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:13:12.773458 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-f840dc86-9521-480f-a41f-f3eb9d95945e tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:12.774064 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-f840dc86-9521-480f-a41f-f3eb9d95945e tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] [instance: ce87a865-d21e-4f65-ae4e-6e75406dd100] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:13:12.782583 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f840dc86-9521-480f-a41f-f3eb9d95945e tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:12.783101 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f840dc86-9521-480f-a41f-f3eb9d95945e tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:12.783553 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f840dc86-9521-480f-a41f-f3eb9d95945e tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:12.784285 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f840dc86-9521-480f-a41f-f3eb9d95945e tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:12.784776 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f840dc86-9521-480f-a41f-f3eb9d95945e tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:12.785215 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-f840dc86-9521-480f-a41f-f3eb9d95945e tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:12.932646 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-f840dc86-9521-480f-a41f-f3eb9d95945e tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6a9b3027ef4bafaa548b6031747a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9068b6afff6649c8afdad5835bd4c6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:12.941008 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-f840dc86-9521-480f-a41f-f3eb9d95945e tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] 10.222.0.70 "GET /compute/v2.1/servers/ce87a865-d21e-4f65-ae4e-6e75406dd100" status: 200 len: 1374 microversion: 2.1 time: 0.171740 Aug 27 04:13:12.947296 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3685/7322] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:13:12 2022] GET /compute/v2.1/servers/ce87a865-d21e-4f65-ae4e-6e75406dd100 => generated 1374 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:13:13.964930 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-44b239aa-42a7-4af4-9c2a-b284bd6bbb0e tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:13.966123 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-44b239aa-42a7-4af4-9c2a-b284bd6bbb0e tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] [instance: ce87a865-d21e-4f65-ae4e-6e75406dd100] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:13:13.972783 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-44b239aa-42a7-4af4-9c2a-b284bd6bbb0e tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:13.973269 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-44b239aa-42a7-4af4-9c2a-b284bd6bbb0e tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:13.973706 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-44b239aa-42a7-4af4-9c2a-b284bd6bbb0e tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:13.974504 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-44b239aa-42a7-4af4-9c2a-b284bd6bbb0e tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:13.974965 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-44b239aa-42a7-4af4-9c2a-b284bd6bbb0e tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:13.975424 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-44b239aa-42a7-4af4-9c2a-b284bd6bbb0e tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:14.123855 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-44b239aa-42a7-4af4-9c2a-b284bd6bbb0e tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6a9b3027ef4bafaa548b6031747a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9068b6afff6649c8afdad5835bd4c6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:14.132835 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-44b239aa-42a7-4af4-9c2a-b284bd6bbb0e tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] 10.222.0.70 "GET /compute/v2.1/servers/ce87a865-d21e-4f65-ae4e-6e75406dd100" status: 200 len: 1374 microversion: 2.1 time: 0.172847 Aug 27 04:13:14.133443 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3638/7323] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:13:13 2022] GET /compute/v2.1/servers/ce87a865-d21e-4f65-ae4e-6e75406dd100 => generated 1374 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:13:15.158614 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7e01f4c3-4b1f-4c7b-810f-d0699b086126 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:15.159607 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-7e01f4c3-4b1f-4c7b-810f-d0699b086126 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] [instance: ce87a865-d21e-4f65-ae4e-6e75406dd100] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:13:15.169550 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7e01f4c3-4b1f-4c7b-810f-d0699b086126 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:15.170061 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7e01f4c3-4b1f-4c7b-810f-d0699b086126 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:15.170551 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7e01f4c3-4b1f-4c7b-810f-d0699b086126 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:15.171265 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7e01f4c3-4b1f-4c7b-810f-d0699b086126 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:15.171738 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7e01f4c3-4b1f-4c7b-810f-d0699b086126 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:15.172229 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7e01f4c3-4b1f-4c7b-810f-d0699b086126 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:15.311263 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-7e01f4c3-4b1f-4c7b-810f-d0699b086126 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6a9b3027ef4bafaa548b6031747a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9068b6afff6649c8afdad5835bd4c6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:15.319756 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-7e01f4c3-4b1f-4c7b-810f-d0699b086126 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] 10.222.0.70 "GET /compute/v2.1/servers/ce87a865-d21e-4f65-ae4e-6e75406dd100" status: 200 len: 1374 microversion: 2.1 time: 0.167864 Aug 27 04:13:15.320391 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3686/7324] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:13:15 2022] GET /compute/v2.1/servers/ce87a865-d21e-4f65-ae4e-6e75406dd100 => generated 1374 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:13:15.914663 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-736a9cb2-820f-4dd8-9d4f-150b03001bbf req-b8422c16-dd06-4e48-8879-b63da1de7fb2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce87a865-d21e-4f65-ae4e-6e75406dd100", "tag": "0d304bd4-30f7-4be7-9c11-2623971eda0c"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:13:15.922067 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell0:SELECT=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:13:15.929166 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-736a9cb2-820f-4dd8-9d4f-150b03001bbf req-b8422c16-dd06-4e48-8879-b63da1de7fb2 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:15.929973 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-736a9cb2-820f-4dd8-9d4f-150b03001bbf req-b8422c16-dd06-4e48-8879-b63da1de7fb2 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:15.930412 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-736a9cb2-820f-4dd8-9d4f-150b03001bbf req-b8422c16-dd06-4e48-8879-b63da1de7fb2 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:15.944811 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-736a9cb2-820f-4dd8-9d4f-150b03001bbf req-b8422c16-dd06-4e48-8879-b63da1de7fb2 service nova] Creating event network-changed:0d304bd4-30f7-4be7-9c11-2623971eda0c for instance ce87a865-d21e-4f65-ae4e-6e75406dd100 on n-h2-852278-4 Aug 27 04:13:15.950198 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-736a9cb2-820f-4dd8-9d4f-150b03001bbf req-b8422c16-dd06-4e48-8879-b63da1de7fb2 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039919 Aug 27 04:13:15.950821 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3639/7325] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 04:13:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:13:16.343973 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7b54db4c-b368-418b-8917-e7165c62e71f tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:16.344942 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-7b54db4c-b368-418b-8917-e7165c62e71f tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] [instance: ce87a865-d21e-4f65-ae4e-6e75406dd100] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:13:16.347168 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=2 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:13:16.348035 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell0:SELECT=6 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:13:16.355975 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7b54db4c-b368-418b-8917-e7165c62e71f tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:16.356573 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7b54db4c-b368-418b-8917-e7165c62e71f tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:16.357060 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7b54db4c-b368-418b-8917-e7165c62e71f tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:16.357832 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7b54db4c-b368-418b-8917-e7165c62e71f tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:16.358302 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7b54db4c-b368-418b-8917-e7165c62e71f tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:16.358740 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7b54db4c-b368-418b-8917-e7165c62e71f tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:16.771911 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-7b54db4c-b368-418b-8917-e7165c62e71f tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6a9b3027ef4bafaa548b6031747a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9068b6afff6649c8afdad5835bd4c6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:16.786679 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-7b54db4c-b368-418b-8917-e7165c62e71f tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] 10.222.0.70 "GET /compute/v2.1/servers/ce87a865-d21e-4f65-ae4e-6e75406dd100" status: 200 len: 1374 microversion: 2.1 time: 0.446293 Aug 27 04:13:16.787271 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3687/7326] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:13:16 2022] GET /compute/v2.1/servers/ce87a865-d21e-4f65-ae4e-6e75406dd100 => generated 1374 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:13:17.809210 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-45e2abe0-8519-4169-b423-2530af37bd1c tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:17.810136 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-45e2abe0-8519-4169-b423-2530af37bd1c tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] [instance: ce87a865-d21e-4f65-ae4e-6e75406dd100] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:13:17.817156 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-45e2abe0-8519-4169-b423-2530af37bd1c tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:17.817664 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-45e2abe0-8519-4169-b423-2530af37bd1c tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:17.818074 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-45e2abe0-8519-4169-b423-2530af37bd1c tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:17.818809 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-45e2abe0-8519-4169-b423-2530af37bd1c tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:17.819253 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-45e2abe0-8519-4169-b423-2530af37bd1c tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:17.819677 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-45e2abe0-8519-4169-b423-2530af37bd1c tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:18.073572 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-45e2abe0-8519-4169-b423-2530af37bd1c tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6a9b3027ef4bafaa548b6031747a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9068b6afff6649c8afdad5835bd4c6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:18.081718 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-45e2abe0-8519-4169-b423-2530af37bd1c tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] 10.222.0.70 "GET /compute/v2.1/servers/ce87a865-d21e-4f65-ae4e-6e75406dd100" status: 200 len: 1374 microversion: 2.1 time: 0.277824 Aug 27 04:13:18.082278 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3640/7327] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:13:17 2022] GET /compute/v2.1/servers/ce87a865-d21e-4f65-ae4e-6e75406dd100 => generated 1374 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:13:19.103747 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-6feeb12b-1aff-4824-aab7-b869de632ba6 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:19.104421 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-6feeb12b-1aff-4824-aab7-b869de632ba6 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] [instance: ce87a865-d21e-4f65-ae4e-6e75406dd100] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:13:19.113098 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6feeb12b-1aff-4824-aab7-b869de632ba6 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:19.113902 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6feeb12b-1aff-4824-aab7-b869de632ba6 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:19.114360 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6feeb12b-1aff-4824-aab7-b869de632ba6 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:19.115115 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6feeb12b-1aff-4824-aab7-b869de632ba6 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:19.115593 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6feeb12b-1aff-4824-aab7-b869de632ba6 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:19.116060 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6feeb12b-1aff-4824-aab7-b869de632ba6 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:19.253082 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-6feeb12b-1aff-4824-aab7-b869de632ba6 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6a9b3027ef4bafaa548b6031747a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9068b6afff6649c8afdad5835bd4c6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:19.261023 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-6feeb12b-1aff-4824-aab7-b869de632ba6 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] 10.222.0.70 "GET /compute/v2.1/servers/ce87a865-d21e-4f65-ae4e-6e75406dd100" status: 200 len: 1374 microversion: 2.1 time: 0.161455 Aug 27 04:13:19.261620 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3688/7328] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:13:19 2022] GET /compute/v2.1/servers/ce87a865-d21e-4f65-ae4e-6e75406dd100 => generated 1374 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:13:20.286399 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-6577044b-f422-44df-8b72-33c34a9b6c2b tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:20.287271 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-6577044b-f422-44df-8b72-33c34a9b6c2b tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] [instance: ce87a865-d21e-4f65-ae4e-6e75406dd100] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:13:20.299065 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6577044b-f422-44df-8b72-33c34a9b6c2b tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:20.299864 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6577044b-f422-44df-8b72-33c34a9b6c2b tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:20.300628 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6577044b-f422-44df-8b72-33c34a9b6c2b tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:20.301770 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6577044b-f422-44df-8b72-33c34a9b6c2b tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:20.302542 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6577044b-f422-44df-8b72-33c34a9b6c2b tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:20.303202 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-6577044b-f422-44df-8b72-33c34a9b6c2b tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:20.459221 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-6577044b-f422-44df-8b72-33c34a9b6c2b tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6a9b3027ef4bafaa548b6031747a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9068b6afff6649c8afdad5835bd4c6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:20.468900 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-6577044b-f422-44df-8b72-33c34a9b6c2b tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] 10.222.0.70 "GET /compute/v2.1/servers/ce87a865-d21e-4f65-ae4e-6e75406dd100" status: 200 len: 1374 microversion: 2.1 time: 0.189356 Aug 27 04:13:20.469521 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3641/7329] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:13:20 2022] GET /compute/v2.1/servers/ce87a865-d21e-4f65-ae4e-6e75406dd100 => generated 1374 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:13:20.916902 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-47939db5-01db-43c7-aa8e-6dfe7758c339 req-839aadf1-828d-47be-9635-9a5c9c0c17a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce87a865-d21e-4f65-ae4e-6e75406dd100", "name": "network-vif-plugged", "status": "completed", "tag": "0d304bd4-30f7-4be7-9c11-2623971eda0c"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:13:20.930701 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-47939db5-01db-43c7-aa8e-6dfe7758c339 req-839aadf1-828d-47be-9635-9a5c9c0c17a4 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:20.931369 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-47939db5-01db-43c7-aa8e-6dfe7758c339 req-839aadf1-828d-47be-9635-9a5c9c0c17a4 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:20.931906 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-47939db5-01db-43c7-aa8e-6dfe7758c339 req-839aadf1-828d-47be-9635-9a5c9c0c17a4 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:20.943481 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-47939db5-01db-43c7-aa8e-6dfe7758c339 req-839aadf1-828d-47be-9635-9a5c9c0c17a4 service nova] Creating event network-vif-plugged:0d304bd4-30f7-4be7-9c11-2623971eda0c for instance ce87a865-d21e-4f65-ae4e-6e75406dd100 on n-h2-852278-4 Aug 27 04:13:20.948544 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-47939db5-01db-43c7-aa8e-6dfe7758c339 req-839aadf1-828d-47be-9635-9a5c9c0c17a4 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035660 Aug 27 04:13:20.949156 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3689/7330] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 04:13:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:13:21.493856 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-cc71d528-5424-420c-9574-6da61e73289c tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:21.494781 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-cc71d528-5424-420c-9574-6da61e73289c tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] [instance: ce87a865-d21e-4f65-ae4e-6e75406dd100] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:13:21.506472 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cc71d528-5424-420c-9574-6da61e73289c tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:21.507273 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cc71d528-5424-420c-9574-6da61e73289c tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:21.507994 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cc71d528-5424-420c-9574-6da61e73289c tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:21.509198 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cc71d528-5424-420c-9574-6da61e73289c tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:21.509945 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cc71d528-5424-420c-9574-6da61e73289c tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:21.510759 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-cc71d528-5424-420c-9574-6da61e73289c tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:21.655575 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-cc71d528-5424-420c-9574-6da61e73289c tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6a9b3027ef4bafaa548b6031747a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9068b6afff6649c8afdad5835bd4c6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:21.667852 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-cc71d528-5424-420c-9574-6da61e73289c tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] 10.222.0.70 "GET /compute/v2.1/servers/ce87a865-d21e-4f65-ae4e-6e75406dd100" status: 200 len: 1374 microversion: 2.1 time: 0.180616 Aug 27 04:13:21.668610 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3642/7331] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:13:21 2022] GET /compute/v2.1/servers/ce87a865-d21e-4f65-ae4e-6e75406dd100 => generated 1374 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:13:22.701393 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-845416e5-a393-4e92-8d8a-8be9e9ac98ac tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:22.702578 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-845416e5-a393-4e92-8d8a-8be9e9ac98ac tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] [instance: ce87a865-d21e-4f65-ae4e-6e75406dd100] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:13:22.713594 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-845416e5-a393-4e92-8d8a-8be9e9ac98ac tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:22.714375 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-845416e5-a393-4e92-8d8a-8be9e9ac98ac tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:22.714834 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-845416e5-a393-4e92-8d8a-8be9e9ac98ac tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:22.715567 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-845416e5-a393-4e92-8d8a-8be9e9ac98ac tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:22.716033 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-845416e5-a393-4e92-8d8a-8be9e9ac98ac tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:22.716515 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-845416e5-a393-4e92-8d8a-8be9e9ac98ac tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:22.872117 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-845416e5-a393-4e92-8d8a-8be9e9ac98ac tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6a9b3027ef4bafaa548b6031747a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9068b6afff6649c8afdad5835bd4c6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:22.883500 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-845416e5-a393-4e92-8d8a-8be9e9ac98ac tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] 10.222.0.70 "GET /compute/v2.1/servers/ce87a865-d21e-4f65-ae4e-6e75406dd100" status: 200 len: 1558 microversion: 2.1 time: 0.190665 Aug 27 04:13:22.884411 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3690/7332] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:13:22 2022] GET /compute/v2.1/servers/ce87a865-d21e-4f65-ae4e-6e75406dd100 => generated 1558 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:13:22.904399 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-97e4a5d3-5f1e-4421-82ac-1474b4b72a29 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:22.905035 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-97e4a5d3-5f1e-4421-82ac-1474b4b72a29 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] [instance: ce87a865-d21e-4f65-ae4e-6e75406dd100] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:13:22.912614 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-97e4a5d3-5f1e-4421-82ac-1474b4b72a29 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:22.913109 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-97e4a5d3-5f1e-4421-82ac-1474b4b72a29 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:22.913548 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-97e4a5d3-5f1e-4421-82ac-1474b4b72a29 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:22.914599 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-97e4a5d3-5f1e-4421-82ac-1474b4b72a29 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:22.915056 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-97e4a5d3-5f1e-4421-82ac-1474b4b72a29 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:22.915481 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-97e4a5d3-5f1e-4421-82ac-1474b4b72a29 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:23.061875 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-97e4a5d3-5f1e-4421-82ac-1474b4b72a29 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6a9b3027ef4bafaa548b6031747a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9068b6afff6649c8afdad5835bd4c6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:23.074275 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-97e4a5d3-5f1e-4421-82ac-1474b4b72a29 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] 10.222.0.70 "GET /compute/v2.1/servers/ce87a865-d21e-4f65-ae4e-6e75406dd100" status: 200 len: 1558 microversion: 2.1 time: 0.173829 Aug 27 04:13:23.074886 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3643/7333] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:13:22 2022] GET /compute/v2.1/servers/ce87a865-d21e-4f65-ae4e-6e75406dd100 => generated 1558 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:13:24.763274 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-da2dfc99-582b-46d0-b992-a063adf795e7 req-5e9c8da3-4dcc-4311-9cb0-f0aba1ea8926 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce87a865-d21e-4f65-ae4e-6e75406dd100", "tag": "0d304bd4-30f7-4be7-9c11-2623971eda0c"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:13:24.773668 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-da2dfc99-582b-46d0-b992-a063adf795e7 req-5e9c8da3-4dcc-4311-9cb0-f0aba1ea8926 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:24.774162 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-da2dfc99-582b-46d0-b992-a063adf795e7 req-5e9c8da3-4dcc-4311-9cb0-f0aba1ea8926 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:24.774578 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-da2dfc99-582b-46d0-b992-a063adf795e7 req-5e9c8da3-4dcc-4311-9cb0-f0aba1ea8926 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:24.786230 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-da2dfc99-582b-46d0-b992-a063adf795e7 req-5e9c8da3-4dcc-4311-9cb0-f0aba1ea8926 service nova] Creating event network-changed:0d304bd4-30f7-4be7-9c11-2623971eda0c for instance ce87a865-d21e-4f65-ae4e-6e75406dd100 on n-h2-852278-4 Aug 27 04:13:24.791939 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-da2dfc99-582b-46d0-b992-a063adf795e7 req-5e9c8da3-4dcc-4311-9cb0-f0aba1ea8926 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032372 Aug 27 04:13:24.792747 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3691/7334] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 04:13:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:14:56.946168 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=24 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:14:56.947451 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=48 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:14:56.948702 n-d-852278-4 devstack@n-api.service[134052]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:14:56.948871 n-d-852278-4 devstack@n-api.service[134052]: Sat Aug 27 04:14:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ce87a865-d21e-4f65-ae4e-6e75406dd100/action (ip 10.222.0.70) !!! Aug 27 04:14:56.951031 n-d-852278-4 devstack@n-api.service[134052]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:14:56.951198 n-d-852278-4 devstack@n-api.service[134052]: Sat Aug 27 04:14:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ce87a865-d21e-4f65-ae4e-6e75406dd100/action (ip 10.222.0.70) !!! Aug 27 04:14:56.966621 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-fee9abaa-546a-4630-b858-a9771d76d3eb tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1801264670"}} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:14:56.969010 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-fee9abaa-546a-4630-b858-a9771d76d3eb tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] [instance: ce87a865-d21e-4f65-ae4e-6e75406dd100] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:14:56.976150 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fee9abaa-546a-4630-b858-a9771d76d3eb tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:14:56.976675 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fee9abaa-546a-4630-b858-a9771d76d3eb tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:14:56.977111 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fee9abaa-546a-4630-b858-a9771d76d3eb tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:14:56.977808 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fee9abaa-546a-4630-b858-a9771d76d3eb tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:14:56.978257 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fee9abaa-546a-4630-b858-a9771d76d3eb tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:14:56.978681 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-fee9abaa-546a-4630-b858-a9771d76d3eb tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:14:57.405936 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-fee9abaa-546a-4630-b858-a9771d76d3eb tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] 10.222.0.70 "POST /compute/v2.1/servers/ce87a865-d21e-4f65-ae4e-6e75406dd100/action" status: 202 len: 0 microversion: 2.1 time: 0.461852 Aug 27 04:14:57.406507 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3644/7335] 10.222.0.70 () {60 vars in 1278 bytes} [Sat Aug 27 04:14:56 2022] POST /compute/v2.1/servers/ce87a865-d21e-4f65-ae4e-6e75406dd100/action => generated 0 bytes in 464 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 27 04:15:01.542325 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:15:01.543217 n-d-852278-4 devstack@n-api.service[134051]: DEBUG dbcounter [-] [134051] Writing DB stats nova_cell1:SELECT=54 {{(pid=134051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:15:01.544658 n-d-852278-4 devstack@n-api.service[134051]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:15:01.544799 n-d-852278-4 devstack@n-api.service[134051]: Sat Aug 27 04:15:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.70) !!! Aug 27 04:15:01.634825 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-737d886a-b950-4cbc-acf5-2d2dc84f677a req-d66c28e3-34b2-4c9a-9374-87ef26cdb1e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce87a865-d21e-4f65-ae4e-6e75406dd100", "name": "network-vif-plugged", "status": "completed", "tag": "0d304bd4-30f7-4be7-9c11-2623971eda0c"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:15:01.647272 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-737d886a-b950-4cbc-acf5-2d2dc84f677a req-d66c28e3-34b2-4c9a-9374-87ef26cdb1e0 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:15:01.647765 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-737d886a-b950-4cbc-acf5-2d2dc84f677a req-d66c28e3-34b2-4c9a-9374-87ef26cdb1e0 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:15:01.648424 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-737d886a-b950-4cbc-acf5-2d2dc84f677a req-d66c28e3-34b2-4c9a-9374-87ef26cdb1e0 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:15:01.660858 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-737d886a-b950-4cbc-acf5-2d2dc84f677a req-d66c28e3-34b2-4c9a-9374-87ef26cdb1e0 service nova] Creating event network-vif-plugged:0d304bd4-30f7-4be7-9c11-2623971eda0c for instance ce87a865-d21e-4f65-ae4e-6e75406dd100 on n-h2-852278-4 Aug 27 04:15:01.666867 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-737d886a-b950-4cbc-acf5-2d2dc84f677a req-d66c28e3-34b2-4c9a-9374-87ef26cdb1e0 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128578 Aug 27 04:15:01.671182 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3692/7336] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 04:15:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:15:11.425865 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-efac616b-b9ce-42aa-aa3f-99a8aabe4ad8 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:15:11.426462 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-efac616b-b9ce-42aa-aa3f-99a8aabe4ad8 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] [instance: ce87a865-d21e-4f65-ae4e-6e75406dd100] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:15:11.431673 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_api:SELECT=2 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:15:11.432857 n-d-852278-4 devstack@n-api.service[134052]: DEBUG dbcounter [-] [134052] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:15:11.441044 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-efac616b-b9ce-42aa-aa3f-99a8aabe4ad8 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:15:11.441566 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-efac616b-b9ce-42aa-aa3f-99a8aabe4ad8 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:15:11.442357 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-efac616b-b9ce-42aa-aa3f-99a8aabe4ad8 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:15:11.443282 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-efac616b-b9ce-42aa-aa3f-99a8aabe4ad8 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:15:11.443788 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-efac616b-b9ce-42aa-aa3f-99a8aabe4ad8 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:15:11.444359 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-efac616b-b9ce-42aa-aa3f-99a8aabe4ad8 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:15:11.473289 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-efac616b-b9ce-42aa-aa3f-99a8aabe4ad8 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] [instance: ce87a865-d21e-4f65-ae4e-6e75406dd100] Going to try to terminate instance {{(pid=134052) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:15:11.488090 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-d6847454-1199-493e-9939-6c60a4ed4df2 req-5e256752-7235-43e1-bb00-a635577888cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce87a865-d21e-4f65-ae4e-6e75406dd100", "tag": "0d304bd4-30f7-4be7-9c11-2623971eda0c"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:15:11.499676 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-d6847454-1199-493e-9939-6c60a4ed4df2 req-5e256752-7235-43e1-bb00-a635577888cf service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:15:11.500274 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-d6847454-1199-493e-9939-6c60a4ed4df2 req-5e256752-7235-43e1-bb00-a635577888cf service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:15:11.500837 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-d6847454-1199-493e-9939-6c60a4ed4df2 req-5e256752-7235-43e1-bb00-a635577888cf service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:15:11.515971 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-d6847454-1199-493e-9939-6c60a4ed4df2 req-5e256752-7235-43e1-bb00-a635577888cf service nova] Creating event network-changed:0d304bd4-30f7-4be7-9c11-2623971eda0c for instance ce87a865-d21e-4f65-ae4e-6e75406dd100 on n-h2-852278-4 Aug 27 04:15:11.521868 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-d6847454-1199-493e-9939-6c60a4ed4df2 req-5e256752-7235-43e1-bb00-a635577888cf service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098443 Aug 27 04:15:11.522975 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3693/7337] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 04:15:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:15:11.571128 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-efac616b-b9ce-42aa-aa3f-99a8aabe4ad8 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] 10.222.0.70 "DELETE /compute/v2.1/servers/ce87a865-d21e-4f65-ae4e-6e75406dd100" status: 204 len: 0 microversion: 2.1 time: 0.149742 Aug 27 04:15:11.571938 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3645/7338] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 04:15:11 2022] DELETE /compute/v2.1/servers/ce87a865-d21e-4f65-ae4e-6e75406dd100 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:15:11.581350 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-6443e815-f176-4621-8f16-196532667dea tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:15:11.583005 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-6443e815-f176-4621-8f16-196532667dea tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] [instance: ce87a865-d21e-4f65-ae4e-6e75406dd100] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:15:11.591320 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6443e815-f176-4621-8f16-196532667dea tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:15:11.592248 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6443e815-f176-4621-8f16-196532667dea tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:15:11.593007 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6443e815-f176-4621-8f16-196532667dea tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:15:11.594563 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6443e815-f176-4621-8f16-196532667dea tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:15:11.595255 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6443e815-f176-4621-8f16-196532667dea tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:15:11.595896 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-6443e815-f176-4621-8f16-196532667dea tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:15:11.787894 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-6443e815-f176-4621-8f16-196532667dea tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6a9b3027ef4bafaa548b6031747a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9068b6afff6649c8afdad5835bd4c6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:15:11.796337 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-6443e815-f176-4621-8f16-196532667dea tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] 10.222.0.70 "GET /compute/v2.1/servers/ce87a865-d21e-4f65-ae4e-6e75406dd100" status: 200 len: 1682 microversion: 2.1 time: 0.219363 Aug 27 04:15:11.796921 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3694/7339] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:15:11 2022] GET /compute/v2.1/servers/ce87a865-d21e-4f65-ae4e-6e75406dd100 => generated 1682 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:15:12.818564 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-e1df3db7-0e41-45ac-a433-219b6949da33 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:15:12.819153 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-e1df3db7-0e41-45ac-a433-219b6949da33 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] [instance: ce87a865-d21e-4f65-ae4e-6e75406dd100] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:15:12.826364 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e1df3db7-0e41-45ac-a433-219b6949da33 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:15:12.826857 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e1df3db7-0e41-45ac-a433-219b6949da33 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:15:12.827295 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e1df3db7-0e41-45ac-a433-219b6949da33 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:15:12.827997 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e1df3db7-0e41-45ac-a433-219b6949da33 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:15:12.828557 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e1df3db7-0e41-45ac-a433-219b6949da33 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:15:12.828985 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-e1df3db7-0e41-45ac-a433-219b6949da33 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:15:13.064437 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-e1df3db7-0e41-45ac-a433-219b6949da33 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6a9b3027ef4bafaa548b6031747a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9068b6afff6649c8afdad5835bd4c6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:15:13.072771 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-e1df3db7-0e41-45ac-a433-219b6949da33 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] 10.222.0.70 "GET /compute/v2.1/servers/ce87a865-d21e-4f65-ae4e-6e75406dd100" status: 200 len: 1682 microversion: 2.1 time: 0.258579 Aug 27 04:15:13.073300 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3646/7340] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:15:12 2022] GET /compute/v2.1/servers/ce87a865-d21e-4f65-ae4e-6e75406dd100 => generated 1682 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:15:13.452933 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [req-15ed2b58-b365-4163-a905-41c8f897aba9 req-71d68540-c8ca-4bac-b470-457c4b7141a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce87a865-d21e-4f65-ae4e-6e75406dd100", "name": "network-vif-unplugged", "status": "completed", "tag": "0d304bd4-30f7-4be7-9c11-2623971eda0c"}]} {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:15:13.465037 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-15ed2b58-b365-4163-a905-41c8f897aba9 req-71d68540-c8ca-4bac-b470-457c4b7141a3 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:15:13.465653 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-15ed2b58-b365-4163-a905-41c8f897aba9 req-71d68540-c8ca-4bac-b470-457c4b7141a3 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:15:13.466459 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [req-15ed2b58-b365-4163-a905-41c8f897aba9 req-71d68540-c8ca-4bac-b470-457c4b7141a3 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:15:13.479167 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.compute.server_external_events [req-15ed2b58-b365-4163-a905-41c8f897aba9 req-71d68540-c8ca-4bac-b470-457c4b7141a3 service nova] Creating event network-vif-unplugged:0d304bd4-30f7-4be7-9c11-2623971eda0c for instance ce87a865-d21e-4f65-ae4e-6e75406dd100 on n-h2-852278-4 Aug 27 04:15:13.484971 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [req-15ed2b58-b365-4163-a905-41c8f897aba9 req-71d68540-c8ca-4bac-b470-457c4b7141a3 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036083 Aug 27 04:15:13.485695 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3695/7341] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 04:15:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:15:13.743152 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-508e8c1a-4a7e-4b7c-bce6-f020722eddf9 req-8cec38ad-ffec-402b-85dc-c775311c1a31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce87a865-d21e-4f65-ae4e-6e75406dd100", "name": "network-vif-deleted", "tag": "0d304bd4-30f7-4be7-9c11-2623971eda0c"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:15:13.755228 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-508e8c1a-4a7e-4b7c-bce6-f020722eddf9 req-8cec38ad-ffec-402b-85dc-c775311c1a31 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:15:13.755711 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-508e8c1a-4a7e-4b7c-bce6-f020722eddf9 req-8cec38ad-ffec-402b-85dc-c775311c1a31 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:15:13.756143 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-508e8c1a-4a7e-4b7c-bce6-f020722eddf9 req-8cec38ad-ffec-402b-85dc-c775311c1a31 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:15:13.770430 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-508e8c1a-4a7e-4b7c-bce6-f020722eddf9 req-8cec38ad-ffec-402b-85dc-c775311c1a31 service nova] Creating event network-vif-deleted:0d304bd4-30f7-4be7-9c11-2623971eda0c for instance ce87a865-d21e-4f65-ae4e-6e75406dd100 on n-h2-852278-4 Aug 27 04:15:13.777045 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-508e8c1a-4a7e-4b7c-bce6-f020722eddf9 req-8cec38ad-ffec-402b-85dc-c775311c1a31 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037234 Aug 27 04:15:13.777672 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3647/7342] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 04:15:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:15:14.095399 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-dcb7caee-2d21-4c45-a34a-076013561ae6 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:15:14.096215 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-dcb7caee-2d21-4c45-a34a-076013561ae6 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] [instance: ce87a865-d21e-4f65-ae4e-6e75406dd100] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:15:14.103307 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dcb7caee-2d21-4c45-a34a-076013561ae6 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:15:14.103887 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dcb7caee-2d21-4c45-a34a-076013561ae6 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:15:14.104651 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dcb7caee-2d21-4c45-a34a-076013561ae6 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:15:14.105236 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dcb7caee-2d21-4c45-a34a-076013561ae6 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:15:14.105692 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dcb7caee-2d21-4c45-a34a-076013561ae6 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:15:14.106131 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dcb7caee-2d21-4c45-a34a-076013561ae6 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:15:14.144915 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dcb7caee-2d21-4c45-a34a-076013561ae6 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:15:14.145430 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dcb7caee-2d21-4c45-a34a-076013561ae6 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:15:14.145891 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-dcb7caee-2d21-4c45-a34a-076013561ae6 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:15:14.146361 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.objects.instance [None req-dcb7caee-2d21-4c45-a34a-076013561ae6 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lazy-loading 'fault' on Instance uuid ce87a865-d21e-4f65-ae4e-6e75406dd100 {{(pid=134051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:15:14.192925 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-dcb7caee-2d21-4c45-a34a-076013561ae6 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6a9b3027ef4bafaa548b6031747a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9068b6afff6649c8afdad5835bd4c6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:15:14.201829 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-dcb7caee-2d21-4c45-a34a-076013561ae6 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] 10.222.0.70 "GET /compute/v2.1/servers/ce87a865-d21e-4f65-ae4e-6e75406dd100" status: 200 len: 1339 microversion: 2.1 time: 0.110919 Aug 27 04:15:14.202452 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3696/7343] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:15:14 2022] GET /compute/v2.1/servers/ce87a865-d21e-4f65-ae4e-6e75406dd100 => generated 1339 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:15:15.229551 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-62b38527-5e27-4746-bbab-ad82d9efd5bb tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:15:15.230713 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-62b38527-5e27-4746-bbab-ad82d9efd5bb tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] [instance: ce87a865-d21e-4f65-ae4e-6e75406dd100] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:15:15.241594 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-62b38527-5e27-4746-bbab-ad82d9efd5bb tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:15:15.242081 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-62b38527-5e27-4746-bbab-ad82d9efd5bb tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:15:15.242523 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-62b38527-5e27-4746-bbab-ad82d9efd5bb tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:15:15.243244 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-62b38527-5e27-4746-bbab-ad82d9efd5bb tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:15:15.243694 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-62b38527-5e27-4746-bbab-ad82d9efd5bb tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:15:15.244117 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-62b38527-5e27-4746-bbab-ad82d9efd5bb tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:15:15.258202 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-62b38527-5e27-4746-bbab-ad82d9efd5bb tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] HTTP exception thrown: Instance ce87a865-d21e-4f65-ae4e-6e75406dd100 could not be found. Aug 27 04:15:15.259841 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-62b38527-5e27-4746-bbab-ad82d9efd5bb tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Request method failure captured: Aug 27 04:15:15.259841 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/servers/ce87a865-d21e-4f65-ae4e-6e75406dd100 HTTP/1.1 Aug 27 04:15:15.259841 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 04:15:15.259841 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 04:15:15.259841 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 04:15:15.259841 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 04:15:15.259841 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 04:15:15.259841 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 04:15:15.259841 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 04:15:15.259841 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 04:15:15.259841 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCZk8SYqAz1TgwN2QHYM_iEVpyGzumk4-fGE9jgEJXhLRukHcz05HgdT67BX8vT95L7kYPKllFssiLyaYWcv1yEpVAF8Ou5LN2yhusbVAr9ibQgKY9pZaKhYlewAs3EorSgEhEQrS25Af2nehC1YjRv68entNfmwigftYh_26hmc9zVM Aug 27 04:15:15.259841 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 04:15:15.259841 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 04:15:15.259841 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 04:15:15.259841 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 04:15:15.259841 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 04:15:15.259841 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 04:15:15.259841 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 9068b6afff6649c8afdad5835bd4c6f1 Aug 27 04:15:15.259841 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-TestSnapshotPattern-1046990386 Aug 27 04:15:15.259841 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 04:15:15.259841 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 04:15:15.259841 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9068b6afff6649c8afdad5835bd4c6f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_9068b6afff6649c8afdad5835bd4c6f1", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9068b6afff6649c8afdad5835bd4c6f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/9068b6afff6649c8afdad5835bd4c6f1"}]}] Aug 27 04:15:15.259841 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-TestSnapshotPattern-1046990386 Aug 27 04:15:15.259841 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 9068b6afff6649c8afdad5835bd4c6f1 Aug 27 04:15:15.259841 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-TestSnapshotPattern-1046990386 Aug 27 04:15:15.259841 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-TestSnapshotPattern-1046990386-project Aug 27 04:15:15.259841 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 04:15:15.259841 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 04:15:15.259841 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: ca6a9b3027ef4bafaa548b6031747a7c Aug 27 04:15:15.259841 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-TestSnapshotPattern-1046990386-project Aug 27 04:15:15.259841 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 04:15:15.259841 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance ce87a865-d21e-4f65-ae4e-6e75406dd100 could not be found. Aug 27 04:15:15.259841 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': 'ce87a865-d21e-4f65-ae4e-6e75406dd100'} Aug 27 04:15:15.259841 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:15:15.259841 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:15:15.259841 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:15:15.259841 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:15:15.259841 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:15:15.259841 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:15:15.259841 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:15:15.259841 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:15:15.259841 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:15:15.259841 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:15:15.259841 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce87a865-d21e-4f65-ae4e-6e75406dd100 could not be found. Aug 27 04:15:15.259841 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 04:15:15.259841 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:15:15.259841 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 04:15:15.259841 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:15:15.259841 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:15:15.259841 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:15:15.259841 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:15:15.259841 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:15:15.259841 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:15:15.259841 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:15:15.259841 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:15:15.259841 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:15:15.259841 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:15:15.259841 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:15:15.259841 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:15:15.259841 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:15:15.259841 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce87a865-d21e-4f65-ae4e-6e75406dd100 could not be found. Aug 27 04:15:15.259841 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 04:15:15.259841 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:15:15.259841 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 04:15:15.264652 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:15:15.264652 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:15:15.264652 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:15:15.264652 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:15:15.264652 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:15:15.264652 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce87a865-d21e-4f65-ae4e-6e75406dd100 could not be found. Aug 27 04:15:15.264652 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 04:15:15.264652 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-62b38527-5e27-4746-bbab-ad82d9efd5bb tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Returning 404 to user: Instance ce87a865-d21e-4f65-ae4e-6e75406dd100 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:15:15.264652 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-62b38527-5e27-4746-bbab-ad82d9efd5bb tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] 10.222.0.70 "GET /compute/v2.1/servers/ce87a865-d21e-4f65-ae4e-6e75406dd100" status: 404 len: 111 microversion: 2.1 time: 0.040743 Aug 27 04:15:15.264652 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3648/7344] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:15:15 2022] GET /compute/v2.1/servers/ce87a865-d21e-4f65-ae4e-6e75406dd100 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:15:16.712305 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-7c8af673-f4f8-4dfa-b932-44dacf5e09c5 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:15:16.712885 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-7c8af673-f4f8-4dfa-b932-44dacf5e09c5 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] [instance: 066042e2-8e59-4f20-a70b-18decb114ba1] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:15:16.714727 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-579f964a-7058-4aa7-a14a-3ca179ced1ac req-46acd13e-a631-4370-8428-036836dcb607 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "066042e2-8e59-4f20-a70b-18decb114ba1", "tag": "212f4e5b-da57-413f-b8ad-756e7e5bb757"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:15:16.720112 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7c8af673-f4f8-4dfa-b932-44dacf5e09c5 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:15:16.720695 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7c8af673-f4f8-4dfa-b932-44dacf5e09c5 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:15:16.721145 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7c8af673-f4f8-4dfa-b932-44dacf5e09c5 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:15:16.722291 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7c8af673-f4f8-4dfa-b932-44dacf5e09c5 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:15:16.722291 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7c8af673-f4f8-4dfa-b932-44dacf5e09c5 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:15:16.722757 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-7c8af673-f4f8-4dfa-b932-44dacf5e09c5 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:15:16.726069 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-579f964a-7058-4aa7-a14a-3ca179ced1ac req-46acd13e-a631-4370-8428-036836dcb607 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:15:16.726517 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-579f964a-7058-4aa7-a14a-3ca179ced1ac req-46acd13e-a631-4370-8428-036836dcb607 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:15:16.727120 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-579f964a-7058-4aa7-a14a-3ca179ced1ac req-46acd13e-a631-4370-8428-036836dcb607 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:15:16.739140 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-579f964a-7058-4aa7-a14a-3ca179ced1ac req-46acd13e-a631-4370-8428-036836dcb607 service nova] Creating event network-changed:212f4e5b-da57-413f-b8ad-756e7e5bb757 for instance 066042e2-8e59-4f20-a70b-18decb114ba1 on n-h1-852278-4 Aug 27 04:15:16.745355 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-579f964a-7058-4aa7-a14a-3ca179ced1ac req-46acd13e-a631-4370-8428-036836dcb607 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034448 Aug 27 04:15:16.746377 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3649/7345] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 04:15:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:15:16.757689 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-7c8af673-f4f8-4dfa-b932-44dacf5e09c5 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] [instance: 066042e2-8e59-4f20-a70b-18decb114ba1] Going to try to terminate instance {{(pid=134051) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:15:16.852010 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-7c8af673-f4f8-4dfa-b932-44dacf5e09c5 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] 10.222.0.70 "DELETE /compute/v2.1/servers/066042e2-8e59-4f20-a70b-18decb114ba1" status: 204 len: 0 microversion: 2.1 time: 0.143347 Aug 27 04:15:16.855950 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3697/7346] 10.222.0.70 () {58 vars in 1239 bytes} [Sat Aug 27 04:15:16 2022] DELETE /compute/v2.1/servers/066042e2-8e59-4f20-a70b-18decb114ba1 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:15:16.863076 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-3c600cbe-dbd6-4dbc-adee-7283e0c7a6ff tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:15:16.863715 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-3c600cbe-dbd6-4dbc-adee-7283e0c7a6ff tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] [instance: 066042e2-8e59-4f20-a70b-18decb114ba1] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:15:16.870414 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3c600cbe-dbd6-4dbc-adee-7283e0c7a6ff tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:15:16.870899 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3c600cbe-dbd6-4dbc-adee-7283e0c7a6ff tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:15:16.871331 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3c600cbe-dbd6-4dbc-adee-7283e0c7a6ff tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:15:16.872027 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3c600cbe-dbd6-4dbc-adee-7283e0c7a6ff tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:15:16.872500 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3c600cbe-dbd6-4dbc-adee-7283e0c7a6ff tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:15:16.872919 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-3c600cbe-dbd6-4dbc-adee-7283e0c7a6ff tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:15:17.056897 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.policy [None req-3c600cbe-dbd6-4dbc-adee-7283e0c7a6ff tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6a9b3027ef4bafaa548b6031747a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9068b6afff6649c8afdad5835bd4c6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134052) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:15:17.065357 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-3c600cbe-dbd6-4dbc-adee-7283e0c7a6ff tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] 10.222.0.70 "GET /compute/v2.1/servers/066042e2-8e59-4f20-a70b-18decb114ba1" status: 200 len: 1682 microversion: 2.1 time: 0.207373 Aug 27 04:15:17.065961 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3650/7347] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:15:16 2022] GET /compute/v2.1/servers/066042e2-8e59-4f20-a70b-18decb114ba1 => generated 1682 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:15:18.092096 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-682451b1-f9e5-4cd7-bf68-49776e80d21a tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:15:18.093213 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-682451b1-f9e5-4cd7-bf68-49776e80d21a tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] [instance: 066042e2-8e59-4f20-a70b-18decb114ba1] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:15:18.104930 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-682451b1-f9e5-4cd7-bf68-49776e80d21a tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:15:18.105767 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-682451b1-f9e5-4cd7-bf68-49776e80d21a tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:15:18.106539 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-682451b1-f9e5-4cd7-bf68-49776e80d21a tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:15:18.107720 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-682451b1-f9e5-4cd7-bf68-49776e80d21a tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:15:18.108561 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-682451b1-f9e5-4cd7-bf68-49776e80d21a tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:15:18.109352 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-682451b1-f9e5-4cd7-bf68-49776e80d21a tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:15:18.316768 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-682451b1-f9e5-4cd7-bf68-49776e80d21a tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6a9b3027ef4bafaa548b6031747a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9068b6afff6649c8afdad5835bd4c6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:15:18.325194 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-682451b1-f9e5-4cd7-bf68-49776e80d21a tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] 10.222.0.70 "GET /compute/v2.1/servers/066042e2-8e59-4f20-a70b-18decb114ba1" status: 200 len: 1682 microversion: 2.1 time: 0.240447 Aug 27 04:15:18.325643 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3698/7348] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:15:18 2022] GET /compute/v2.1/servers/066042e2-8e59-4f20-a70b-18decb114ba1 => generated 1682 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:15:19.072553 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [req-ddcc2d08-d580-4225-8c62-98a3f8944f34 req-4a1e0a4a-258d-4eec-aeb2-682f28a71d96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "066042e2-8e59-4f20-a70b-18decb114ba1", "name": "network-vif-deleted", "tag": "212f4e5b-da57-413f-b8ad-756e7e5bb757"}]} {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:15:19.083074 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-ddcc2d08-d580-4225-8c62-98a3f8944f34 req-4a1e0a4a-258d-4eec-aeb2-682f28a71d96 service nova] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:15:19.083534 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-ddcc2d08-d580-4225-8c62-98a3f8944f34 req-4a1e0a4a-258d-4eec-aeb2-682f28a71d96 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:15:19.083955 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [req-ddcc2d08-d580-4225-8c62-98a3f8944f34 req-4a1e0a4a-258d-4eec-aeb2-682f28a71d96 service nova] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:15:19.095277 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.compute.server_external_events [req-ddcc2d08-d580-4225-8c62-98a3f8944f34 req-4a1e0a4a-258d-4eec-aeb2-682f28a71d96 service nova] Creating event network-vif-deleted:212f4e5b-da57-413f-b8ad-756e7e5bb757 for instance 066042e2-8e59-4f20-a70b-18decb114ba1 on n-h1-852278-4 Aug 27 04:15:19.100884 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [req-ddcc2d08-d580-4225-8c62-98a3f8944f34 req-4a1e0a4a-258d-4eec-aeb2-682f28a71d96 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031974 Aug 27 04:15:19.101529 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3651/7349] 10.222.0.70 () {64 vars in 1317 bytes} [Sat Aug 27 04:15:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:15:19.349533 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-86af298e-dc4b-45a2-8850-d739f4da72a7 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Calling method '>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:15:19.350278 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.compute.api [None req-86af298e-dc4b-45a2-8850-d739f4da72a7 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] [instance: 066042e2-8e59-4f20-a70b-18decb114ba1] Fetching instance by UUID {{(pid=134051) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:15:19.357664 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-86af298e-dc4b-45a2-8850-d739f4da72a7 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:15:19.358175 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-86af298e-dc4b-45a2-8850-d739f4da72a7 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:15:19.358624 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-86af298e-dc4b-45a2-8850-d739f4da72a7 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:15:19.359362 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-86af298e-dc4b-45a2-8850-d739f4da72a7 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:15:19.359828 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-86af298e-dc4b-45a2-8850-d739f4da72a7 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:15:19.360267 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-86af298e-dc4b-45a2-8850-d739f4da72a7 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:15:19.397479 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-86af298e-dc4b-45a2-8850-d739f4da72a7 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:15:19.397955 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-86af298e-dc4b-45a2-8850-d739f4da72a7 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:15:19.398416 n-d-852278-4 devstack@n-api.service[134051]: DEBUG oslo_concurrency.lockutils [None req-86af298e-dc4b-45a2-8850-d739f4da72a7 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:15:19.398874 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.objects.instance [None req-86af298e-dc4b-45a2-8850-d739f4da72a7 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lazy-loading 'fault' on Instance uuid 066042e2-8e59-4f20-a70b-18decb114ba1 {{(pid=134051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:15:19.441898 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.policy [None req-86af298e-dc4b-45a2-8850-d739f4da72a7 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6a9b3027ef4bafaa548b6031747a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9068b6afff6649c8afdad5835bd4c6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134051) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:15:19.450107 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-86af298e-dc4b-45a2-8850-d739f4da72a7 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] 10.222.0.70 "GET /compute/v2.1/servers/066042e2-8e59-4f20-a70b-18decb114ba1" status: 200 len: 1339 microversion: 2.1 time: 0.104550 Aug 27 04:15:19.450925 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3699/7350] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:15:19 2022] GET /compute/v2.1/servers/066042e2-8e59-4f20-a70b-18decb114ba1 => generated 1339 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:15:20.477283 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-999d67d3-fe61-49f3-bdd1-21c04972c79b tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Calling method '>' {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:15:20.478438 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.compute.api [None req-999d67d3-fe61-49f3-bdd1-21c04972c79b tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] [instance: 066042e2-8e59-4f20-a70b-18decb114ba1] Fetching instance by UUID {{(pid=134052) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:15:20.489125 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-999d67d3-fe61-49f3-bdd1-21c04972c79b tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:15:20.489917 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-999d67d3-fe61-49f3-bdd1-21c04972c79b tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:15:20.490681 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-999d67d3-fe61-49f3-bdd1-21c04972c79b tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:15:20.491843 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-999d67d3-fe61-49f3-bdd1-21c04972c79b tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Acquiring lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:15:20.492292 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-999d67d3-fe61-49f3-bdd1-21c04972c79b tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:15:20.492737 n-d-852278-4 devstack@n-api.service[134052]: DEBUG oslo_concurrency.lockutils [None req-999d67d3-fe61-49f3-bdd1-21c04972c79b tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Lock "9e3f7cc8-d9cf-4064-9831-4fdba8cfa839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:15:20.506509 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.wsgi [None req-999d67d3-fe61-49f3-bdd1-21c04972c79b tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] HTTP exception thrown: Instance 066042e2-8e59-4f20-a70b-18decb114ba1 could not be found. Aug 27 04:15:20.508135 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-999d67d3-fe61-49f3-bdd1-21c04972c79b tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Request method failure captured: Aug 27 04:15:20.508135 n-d-852278-4 devstack@n-api.service[134052]: request: GET /compute/v2.1/servers/066042e2-8e59-4f20-a70b-18decb114ba1 HTTP/1.1 Aug 27 04:15:20.508135 n-d-852278-4 devstack@n-api.service[134052]: Accept: application/json Aug 27 04:15:20.508135 n-d-852278-4 devstack@n-api.service[134052]: Accept-Encoding: identity Aug 27 04:15:20.508135 n-d-852278-4 devstack@n-api.service[134052]: Connection: close Aug 27 04:15:20.508135 n-d-852278-4 devstack@n-api.service[134052]: Content-Length: 0 Aug 27 04:15:20.508135 n-d-852278-4 devstack@n-api.service[134052]: Content-Type: application/json Aug 27 04:15:20.508135 n-d-852278-4 devstack@n-api.service[134052]: Host: 10.222.0.70 Aug 27 04:15:20.508135 n-d-852278-4 devstack@n-api.service[134052]: Openstack-System-Scope: None Aug 27 04:15:20.508135 n-d-852278-4 devstack@n-api.service[134052]: User-Agent: python-urllib3/1.26.11 Aug 27 04:15:20.508135 n-d-852278-4 devstack@n-api.service[134052]: X-Auth-Token: gAAAAABjCZk8SYqAz1TgwN2QHYM_iEVpyGzumk4-fGE9jgEJXhLRukHcz05HgdT67BX8vT95L7kYPKllFssiLyaYWcv1yEpVAF8Ou5LN2yhusbVAr9ibQgKY9pZaKhYlewAs3EorSgEhEQrS25Af2nehC1YjRv68entNfmwigftYh_26hmc9zVM Aug 27 04:15:20.508135 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Id: None Aug 27 04:15:20.508135 n-d-852278-4 devstack@n-api.service[134052]: X-Domain-Name: None Aug 27 04:15:20.508135 n-d-852278-4 devstack@n-api.service[134052]: X-Identity-Status: Confirmed Aug 27 04:15:20.508135 n-d-852278-4 devstack@n-api.service[134052]: X-Is-Admin-Project: True Aug 27 04:15:20.508135 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Id: default Aug 27 04:15:20.508135 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Domain-Name: Default Aug 27 04:15:20.508135 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Id: 9068b6afff6649c8afdad5835bd4c6f1 Aug 27 04:15:20.508135 n-d-852278-4 devstack@n-api.service[134052]: X-Project-Name: tempest-TestSnapshotPattern-1046990386 Aug 27 04:15:20.508135 n-d-852278-4 devstack@n-api.service[134052]: X-Role: reader,member Aug 27 04:15:20.508135 n-d-852278-4 devstack@n-api.service[134052]: X-Roles: reader,member Aug 27 04:15:20.508135 n-d-852278-4 devstack@n-api.service[134052]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9068b6afff6649c8afdad5835bd4c6f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_9068b6afff6649c8afdad5835bd4c6f1", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9068b6afff6649c8afdad5835bd4c6f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/9068b6afff6649c8afdad5835bd4c6f1"}]}] Aug 27 04:15:20.508135 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant: tempest-TestSnapshotPattern-1046990386 Aug 27 04:15:20.508135 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Id: 9068b6afff6649c8afdad5835bd4c6f1 Aug 27 04:15:20.508135 n-d-852278-4 devstack@n-api.service[134052]: X-Tenant-Name: tempest-TestSnapshotPattern-1046990386 Aug 27 04:15:20.508135 n-d-852278-4 devstack@n-api.service[134052]: X-User: tempest-TestSnapshotPattern-1046990386-project Aug 27 04:15:20.508135 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Id: default Aug 27 04:15:20.508135 n-d-852278-4 devstack@n-api.service[134052]: X-User-Domain-Name: Default Aug 27 04:15:20.508135 n-d-852278-4 devstack@n-api.service[134052]: X-User-Id: ca6a9b3027ef4bafaa548b6031747a7c Aug 27 04:15:20.508135 n-d-852278-4 devstack@n-api.service[134052]: X-User-Name: tempest-TestSnapshotPattern-1046990386-project Aug 27 04:15:20.508135 n-d-852278-4 devstack@n-api.service[134052]: method: > Aug 27 04:15:20.508135 n-d-852278-4 devstack@n-api.service[134052]: exception: Instance 066042e2-8e59-4f20-a70b-18decb114ba1 could not be found. Aug 27 04:15:20.508135 n-d-852278-4 devstack@n-api.service[134052]: action_args: {'id': '066042e2-8e59-4f20-a70b-18decb114ba1'} Aug 27 04:15:20.508135 n-d-852278-4 devstack@n-api.service[134052]: {{(pid=134052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:15:20.508135 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:15:20.508135 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:15:20.508135 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:15:20.508135 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:15:20.508135 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:15:20.508135 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:15:20.508135 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:15:20.508135 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:15:20.508135 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:15:20.508135 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 066042e2-8e59-4f20-a70b-18decb114ba1 could not be found. Aug 27 04:15:20.508135 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 04:15:20.508135 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:15:20.508135 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 04:15:20.508135 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:15:20.508135 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:15:20.508135 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:15:20.508135 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:15:20.508135 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:15:20.508135 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:15:20.508135 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:15:20.508135 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:15:20.508135 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:15:20.508135 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:15:20.508135 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:15:20.508135 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:15:20.508135 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:15:20.508135 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 066042e2-8e59-4f20-a70b-18decb114ba1 could not be found. Aug 27 04:15:20.508135 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 04:15:20.508135 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:15:20.508135 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 04:15:20.512534 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:15:20.512534 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:15:20.512534 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:15:20.512534 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:15:20.512534 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:15:20.512534 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 066042e2-8e59-4f20-a70b-18decb114ba1 could not be found. Aug 27 04:15:20.512534 n-d-852278-4 devstack@n-api.service[134052]: ERROR nova.api.openstack.wsgi Aug 27 04:15:20.512534 n-d-852278-4 devstack@n-api.service[134052]: DEBUG nova.api.openstack.wsgi [None req-999d67d3-fe61-49f3-bdd1-21c04972c79b tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Returning 404 to user: Instance 066042e2-8e59-4f20-a70b-18decb114ba1 could not be found. {{(pid=134052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:15:20.512534 n-d-852278-4 devstack@n-api.service[134052]: INFO nova.api.openstack.requestlog [None req-999d67d3-fe61-49f3-bdd1-21c04972c79b tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] 10.222.0.70 "GET /compute/v2.1/servers/066042e2-8e59-4f20-a70b-18decb114ba1" status: 404 len: 111 microversion: 2.1 time: 0.040949 Aug 27 04:15:20.512534 n-d-852278-4 devstack@n-api.service[134052]: [pid: 134052|app: 0|req: 3652/7351] 10.222.0.70 () {58 vars in 1236 bytes} [Sat Aug 27 04:15:20 2022] GET /compute/v2.1/servers/066042e2-8e59-4f20-a70b-18decb114ba1 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:15:20.686772 n-d-852278-4 devstack@n-api.service[134051]: DEBUG nova.api.openstack.wsgi [None req-31d33a42-893a-4603-bd5c-4dd61f8f9408 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] Calling method '.version_select at 0x7f5edc09f280>' {{(pid=134051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:15:20.713840 n-d-852278-4 devstack@n-api.service[134051]: INFO nova.api.openstack.requestlog [None req-31d33a42-893a-4603-bd5c-4dd61f8f9408 tempest-TestSnapshotPattern-1046990386 tempest-TestSnapshotPattern-1046990386-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1480755664" status: 202 len: 0 microversion: 2.1 time: 0.030932 Aug 27 04:15:20.714543 n-d-852278-4 devstack@n-api.service[134051]: [pid: 134051|app: 0|req: 3700/7352] 10.222.0.70 () {58 vars in 1257 bytes} [Sat Aug 27 04:15:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1480755664 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)